2024-01-13T17:00:43.801 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T17:00:43.801 DEBUG:teuthology.run:Teuthology command: teuthology --description rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} --name yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129 --verbose -- /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129/orig.config.yaml 2024-01-13T17:00:43.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T17:00:43.931 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129 branch: wip-yuri11-testing-2024-01-12-1402-reef description: rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} email: yweinste@redhat.com first_in_suite: false job_id: '7516129' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'run run randomized correctness test for rados operations on an erasure-coded pool ' - desc: 'object class functional tests ' - desc: 'generate read/write load with rados objects ranging from 1MB to 25MB ' - desc: 'run basic import/export cli tests for rbd ' - desc: 'librbd C and C++ api tests ' - desc: 'librbd python api tests ' name: yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri11-testing-2024-01-12-1402-reef ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true create_rbd_pool: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: extra_system_packages: - python3-pytest flavor: default sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-yuri11-testing-2024-01-12-1402-reef sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mds.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 6058 sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri11-testing-2024-01-12-1402-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d2f11f33b7063c2c1bc47b2b4e9350f48064868f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0aGLuGhiJx1YWLbwSQfgUcG5/YmiyC0C6dboBQb2XF37ohvkIJVAxab7eP/U2IKwr55KzOxGCWLj7/e15lFSw= smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPxZ9Wkx+QiFZtrjFJ5OTlcUQyS7BRFw31Bv/Ys+Cz0Bw4/VcI4EerC/bZjqnZWVuX+CaHNamPwDVp02xztQ5A= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - print: '**** done start installing quincy cephadm ...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy - print: '**** done end installing quincy cephadm ...' - print: '**** done start cephadm.shell ceph config set mgr...' - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - print: '**** done start telemetry quincy...' - workunit: clients: client.0: - test_telemetry_quincy.sh - print: '**** done end telemetry quincy...' - print: '**** done start parallel' - parallel: - workload - upgrade-sequence - print: '**** done end parallel' - print: '**** done start telemetry x...' - workunit: clients: client.0: - test_telemetry_quincy_x.sh - print: '**** done end telemetry x...' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-13_16:51:28 tube: smithi upgrade-sequence: sequential: - print: '**** done start upgrade, wait' - cephadm.shell: env: - sha1 mon.a: - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - print: '**** done end upgrade, wait...' user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload: full_sequential: - print: '**** done start ec-rados-default.yaml' - rados: clients: - client.0 ec_pool: true objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 4000 write_append_excl: false - print: '**** done end ec-rados-default.yaml' - print: '**** done start rados_api.yaml' - workunit: branch: quincy clients: client.0: - cls - print: '**** done end rados_api.yaml' - print: '**** done start rados_loadgenbig.yaml' - workunit: branch: quincy clients: client.0: - rados/load-gen-big.sh - print: '**** done end rados_loadgenbig.yaml' - print: '**** done start rbd_import_export.yaml' - workunit: branch: quincy clients: client.1: - rbd/import_export.sh env: RBD_CREATE_ARGS: --new-format - print: '**** done end rbd_import_export.yaml' - print: '**** done start test_rbd_api.yaml' - workunit: branch: quincy clients: client.0: - rbd/test_librbd.sh env: RBD_FEATURES: '61' - print: '**** done end test_rbd_api.yaml' - print: '**** done start test_rbd_python.yaml' - workunit: branch: quincy clients: client.0: - rbd/test_librbd_python.sh env: RBD_FEATURES: '61' - print: '**** done end test_rbd_python.yaml' 2024-01-13T17:00:43.931 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d2f11f33b7063c2c1bc47b2b4e9350f48064868f/qa; will attempt to use it 2024-01-13T17:00:43.932 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d2f11f33b7063c2c1bc47b2b4e9350f48064868f/qa/tasks 2024-01-13T17:00:43.932 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-13T17:00:43.934 INFO:teuthology.task.internal:Checking packages... 2024-01-13T17:00:43.956 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2f11f33b7063c2c1bc47b2b4e9350f48064868f' 2024-01-13T17:00:43.956 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-13T17:00:43.956 INFO:teuthology.packaging:ref: None 2024-01-13T17:00:43.956 INFO:teuthology.packaging:tag: None 2024-01-13T17:00:43.956 INFO:teuthology.packaging:branch: wip-yuri11-testing-2024-01-12-1402-reef 2024-01-13T17:00:43.956 INFO:teuthology.packaging:sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T17:00:43.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri11-testing-2024-01-12-1402-reef 2024-01-13T17:00:44.118 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-242.gd2f11f33 2024-01-13T17:00:44.119 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-13T17:00:44.126 INFO:teuthology.task.internal:no buildpackages task found 2024-01-13T17:00:44.126 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-13T17:00:44.180 INFO:teuthology.task.internal:Saving configuration 2024-01-13T17:00:44.198 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-13T17:00:44.204 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T17:00:44.227 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 16:53:56.551432', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0aGLuGhiJx1YWLbwSQfgUcG5/YmiyC0C6dboBQb2XF37ohvkIJVAxab7eP/U2IKwr55KzOxGCWLj7/e15lFSw='} 2024-01-13T17:00:44.252 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 16:53:56.549445', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPxZ9Wkx+QiFZtrjFJ5OTlcUQyS7BRFw31Bv/Ys+Cz0Bw4/VcI4EerC/bZjqnZWVuX+CaHNamPwDVp02xztQ5A='} 2024-01-13T17:00:44.252 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-13T17:00:44.258 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-01-13T17:00:44.258 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-01-13T17:00:44.258 INFO:teuthology.run_tasks:Running task console_log... 2024-01-13T17:00:44.344 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f779cd6c160>, signals=[15]) 2024-01-13T17:00:44.345 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-13T17:00:44.354 INFO:teuthology.task.internal:Opening connections... 2024-01-13T17:00:44.354 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-01-13T17:00:44.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:00:44.429 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-01-13T17:00:44.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:00:44.502 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-13T17:00:44.514 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-01-13T17:00:44.536 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-01-13T17:00:44.536 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-01-13T17:00:44.597 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T17:00:44.598 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T17:00:44.599 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-01-13T17:00:44.620 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-01-13T17:00:44.641 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-01-13T17:00:44.641 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-01-13T17:00:44.703 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-01-13T17:00:44.703 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2024-01-13T17:00:44.703 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-01-13T17:00:44.704 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-01-13T17:00:44.704 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2024-01-13T17:00:44.704 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-01-13T17:00:44.704 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T17:00:44.704 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-01-13T17:00:44.704 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T17:00:44.704 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-01-13T17:00:44.704 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T17:00:44.704 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T17:00:44.704 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T17:00:44.704 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-01-13T17:00:44.727 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-13T17:00:44.737 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-13T17:00:44.755 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-13T17:00:44.756 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-01-13T17:00:44.758 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-01-13T17:00:44.778 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-13T17:00:44.789 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-13T17:00:44.789 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-01-13T17:00:44.819 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-01-13T17:00:44.846 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-13T17:00:44.902 INFO:teuthology.run_tasks:Running task kernel... 2024-01-13T17:00:44.916 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-01-13T17:00:44.917 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-01-13T17:00:44.917 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-13T17:00:44.917 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-13T17:00:44.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T17:00:44.936 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-01-13T17:00:44.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T17:00:44.938 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-01-13T17:00:44.996 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-489.el8.x86_64 2024-01-13T17:00:44.996 INFO:teuthology.task.kernel:Running kernel on smithi084: 4.18.0-489.el8.x86_64 2024-01-13T17:00:44.996 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2024-01-13T17:00:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:4.18.0-489.el8.x86_64 2024-01-13T17:00:45.000 INFO:teuthology.task.kernel:Running kernel on smithi099: 4.18.0-489.el8.x86_64 2024-01-13T17:00:45.000 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum install -y kernel 2024-01-13T17:00:49.492 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - AppStream 18 MB/s | 35 MB 00:01 2024-01-13T17:00:49.742 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - AppStream 17 MB/s | 35 MB 00:02 2024-01-13T17:09:25.063 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - BaseOS 117 kB/s | 58 MB 08:29 2024-01-13T17:09:28.027 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - BaseOS 116 kB/s | 58 MB 08:31 2024-01-13T17:09:33.602 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - Extras 50 kB/s | 18 kB 00:00 2024-01-13T17:09:34.195 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2024-01-13T17:09:34.496 INFO:teuthology.orchestra.run.smithi099.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-01-13T17:09:36.594 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras 71 kB/s | 18 kB 00:00 2024-01-13T17:09:36.983 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 6.9 MB/s | 16 MB 00:02 2024-01-13T17:09:37.369 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.9 kB 00:00 2024-01-13T17:09:37.671 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-01-13T17:09:39.165 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-01-13T17:09:40.788 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 559 kB/s | 24 kB 00:00 2024-01-13T17:09:43.004 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 581 kB/s | 24 kB 00:00 2024-01-13T17:09:44.496 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-01-13T17:09:44.496 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-01-13T17:09:44.800 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-01-13T17:09:44.801 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-13T17:09:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-01-13T17:09:44.801 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-13T17:09:44.801 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-01-13T17:09:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: kernel x86_64 4.18.0-532.el8 baseos 10 M 2024-01-13T17:09:44.802 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-01-13T17:09:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core x86_64 4.18.0-532.el8 baseos 43 M 2024-01-13T17:09:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules x86_64 4.18.0-532.el8 baseos 36 M 2024-01-13T17:09:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:09:44.802 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-01-13T17:09:44.802 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-13T17:09:44.802 INFO:teuthology.orchestra.run.smithi099.stdout:Install 3 Packages 2024-01-13T17:09:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:09:44.803 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 90 M 2024-01-13T17:09:44.803 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 96 M 2024-01-13T17:09:44.803 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-01-13T17:09:46.679 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-01-13T17:09:46.679 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-01-13T17:09:46.995 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-01-13T17:09:46.996 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-01-13T17:09:46.996 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-01-13T17:09:46.996 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-01-13T17:09:46.997 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-01-13T17:09:46.997 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 4.18.0-532.el8 baseos 10 M 2024-01-13T17:09:46.997 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-01-13T17:09:46.997 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-core x86_64 4.18.0-532.el8 baseos 43 M 2024-01-13T17:09:46.997 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules x86_64 4.18.0-532.el8 baseos 36 M 2024-01-13T17:09:46.997 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:09:46.997 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-01-13T17:09:46.997 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-01-13T17:09:46.997 INFO:teuthology.orchestra.run.smithi084.stdout:Install 3 Packages 2024-01-13T17:09:46.998 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:09:46.998 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 90 M 2024-01-13T17:09:46.998 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 96 M 2024-01-13T17:09:46.998 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-01-13T17:13:53.264 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] kernel-4.18.0-532.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-4.18.0-532.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:13:53.265 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] kernel-core-4.18.0-532.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-core-4.18.0-532.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:13:53.265 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] kernel-modules-4.18.0-532.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-modules-4.18.0-532.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:13:54.088 INFO:teuthology.orchestra.run.smithi099.stdout:(1/3): kernel-4.18.0-532.el8.x86_64.rpm 42 kB/s | 10 MB 04:09 2024-01-13T17:13:55.138 INFO:teuthology.orchestra.run.smithi099.stdout:(2/3): kernel-modules-4.18.0-532.el8.x86_64.rpm 148 kB/s | 36 MB 04:10 2024-01-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] kernel-4.18.0-532.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-4.18.0-532.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] kernel-core-4.18.0-532.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-core-4.18.0-532.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] kernel-modules-4.18.0-532.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-modules-4.18.0-532.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:13:55.629 INFO:teuthology.orchestra.run.smithi099.stdout:(3/3): kernel-core-4.18.0-532.el8.x86_64.rpm 178 kB/s | 43 MB 04:10 2024-01-13T17:13:55.630 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-01-13T17:13:55.630 INFO:teuthology.orchestra.run.smithi099.stdout:Total 367 kB/s | 90 MB 04:10 2024-01-13T17:13:56.304 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-01-13T17:13:56.454 INFO:teuthology.orchestra.run.smithi084.stdout:(1/3): kernel-4.18.0-532.el8.x86_64.rpm 42 kB/s | 10 MB 04:09 2024-01-13T17:13:56.739 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-01-13T17:13:56.740 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-01-13T17:13:57.513 INFO:teuthology.orchestra.run.smithi084.stdout:(2/3): kernel-modules-4.18.0-532.el8.x86_64.rpm 148 kB/s | 36 MB 04:10 2024-01-13T17:13:57.939 INFO:teuthology.orchestra.run.smithi084.stdout:(3/3): kernel-core-4.18.0-532.el8.x86_64.rpm 178 kB/s | 43 MB 04:10 2024-01-13T17:13:57.939 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-01-13T17:13:57.939 INFO:teuthology.orchestra.run.smithi084.stdout:Total 367 kB/s | 90 MB 04:10 2024-01-13T17:13:57.973 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-01-13T17:13:58.011 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-01-13T17:13:58.619 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-01-13T17:13:59.052 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-01-13T17:13:59.052 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-01-13T17:14:00.289 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-01-13T17:14:00.319 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-01-13T17:14:00.826 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-01-13T17:14:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-core-4.18.0-532.el8.x86_64 1/3 2024-01-13T17:14:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-01-13T17:14:03.750 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-core-4.18.0-532.el8.x86_64 1/3 2024-01-13T17:14:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-4.18.0-532.el8.x86_64 1/3 2024-01-13T17:14:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-4.18.0-532.el8.x86_64 2/3 2024-01-13T17:14:07.283 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-4.18.0-532.el8.x86_64 1/3 2024-01-13T17:14:07.724 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-modules-4.18.0-532.el8.x86_64 2/3 2024-01-13T17:14:08.704 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-4.18.0-532.el8.x86_64 2/3 2024-01-13T17:14:09.009 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-4.18.0-532.el8.x86_64 3/3 2024-01-13T17:14:11.146 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-4.18.0-532.el8.x86_64 2/3 2024-01-13T17:14:11.439 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-4.18.0-532.el8.x86_64 3/3 2024-01-13T17:14:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-4.18.0-532.el8.x86_64 3/3 2024-01-13T17:14:30.907 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-4.18.0-532.el8.x86_64 3/3 2024-01-13T17:14:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-4.18.0-532.el8.x86_64 3/3 2024-01-13T17:14:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-4.18.0-532.el8.x86_64 1/3 2024-01-13T17:14:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-core-4.18.0-532.el8.x86_64 2/3 2024-01-13T17:14:32.065 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-4.18.0-532.el8.x86_64 3/3 2024-01-13T17:14:32.065 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:14:32.065 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-01-13T17:14:32.065 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-4.18.0-532.el8.x86_64 kernel-core-4.18.0-532.el8.x86_64 2024-01-13T17:14:32.065 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-4.18.0-532.el8.x86_64 2024-01-13T17:14:32.066 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:14:32.066 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-01-13T17:14:32.221 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-01-13T17:14:32.476 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-4.18.0-532.el8.x86_64 2024-01-13T17:14:32.476 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-532.el8.x86_64 2024-01-13T17:14:32.476 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-532.el8.x86_64 2024-01-13T17:14:32.477 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-13T17:14:32.477 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-13T17:14:32.477 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-01-13T17:14:32.477 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-01-13T17:14:32.477 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-01-13T17:14:32.685 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-4.18.0-532.el8.x86_64 2024-01-13T17:14:32.686 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-532.el8.x86_64 2024-01-13T17:14:32.686 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2024-01-13T17:14:32.719 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2024-01-13T17:14:32.719 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2024-01-13T17:14:32.719 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.02 2024-01-13T17:14:32.719 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 129.el8 2024-01-13T17:14:32.719 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2024-01-13T17:14:32.719 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:Group : System Environment/Base 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 9265586 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : kbuilder.bsys.centos.org 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:Relocations : (not relocatable) 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : CentOS BuildSystem 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:14:32.720 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-13T17:14:32.721 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-13T17:14:32.721 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-13T17:14:32.721 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2024-01-13T17:14:32.721 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:14:32.721 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2024-01-13T17:14:32.721 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-13T17:14:32.722 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 4.18.0-532.el8.x86_64 2024-01-13T17:14:32.722 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-13T17:14:33.312 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-4.18.0-532.el8.x86_64 3/3 2024-01-13T17:14:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-4.18.0-532.el8.x86_64 3/3 2024-01-13T17:14:33.680 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-4.18.0-532.el8.x86_64 3/3 2024-01-13T17:14:33.680 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-4.18.0-532.el8.x86_64 1/3 2024-01-13T17:14:33.680 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-core-4.18.0-532.el8.x86_64 2/3 2024-01-13T17:14:34.446 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-01-13T17:14:34.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-modules-4.18.0-532.el8.x86_64 3/3 2024-01-13T17:14:34.549 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:14:34.549 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-01-13T17:14:34.549 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-4.18.0-532.el8.x86_64 kernel-core-4.18.0-532.el8.x86_64 2024-01-13T17:14:34.549 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-4.18.0-532.el8.x86_64 2024-01-13T17:14:34.550 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:14:34.550 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-01-13T17:14:34.696 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-01-13T17:14:34.913 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-532.el8.x86_64 2024-01-13T17:14:34.913 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-532.el8.x86_64 2024-01-13T17:14:34.913 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-532.el8.x86_64 2024-01-13T17:14:34.914 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-13T17:14:34.914 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-13T17:14:34.914 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-01-13T17:14:34.914 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2024-01-13T17:14:34.914 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-01-13T17:14:35.123 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-532.el8.x86_64 2024-01-13T17:14:35.123 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-532.el8.x86_64 2024-01-13T17:14:35.123 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.02 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 129.el8 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Group : System Environment/Base 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 9265586 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : kbuilder.bsys.centos.org 2024-01-13T17:14:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Relocations : (not relocatable) 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : CentOS BuildSystem 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:14:35.158 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2024-01-13T17:14:35.159 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-13T17:14:35.159 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 4.18.0-532.el8.x86_64 2024-01-13T17:14:35.159 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-13T17:14:36.722 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-01-13T17:14:36.724 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-01-13T17:14:36.766 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.JvjWe6yNLz 2024-01-13T17:14:36.766 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JvjWe6yNLz 2024-01-13T17:14:36.839 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.JvjWe6yNLz 2024-01-13T17:14:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-01-13T17:14:36.998 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.JvjWe6yNLz is 6KB 2024-01-13T17:14:37.046 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.JvjWe6yNLz 2024-01-13T17:14:37.064 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2024-01-13T17:14:37.137 INFO:teuthology.orchestra.run.smithi099.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-01-13T17:14:37.137 INFO:teuthology.orchestra.run.smithi099.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-01-13T17:14:37.137 INFO:teuthology.orchestra.run.smithi099.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-01-13T17:14:37.137 INFO:teuthology.orchestra.run.smithi099.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-532.el8.x86_64.conf 2024-01-13T17:14:37.138 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-532.el8.x86_64 2024-01-13T17:14:37.286 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-01-13T17:14:39.127 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-01-13T17:14:39.129 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-01-13T17:14:39.162 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.SnI6OnIoKn 2024-01-13T17:14:39.163 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SnI6OnIoKn 2024-01-13T17:14:39.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.SnI6OnIoKn 2024-01-13T17:14:39.380 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.SnI6OnIoKn is 6KB 2024-01-13T17:14:39.405 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.SnI6OnIoKn 2024-01-13T17:14:39.423 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2024-01-13T17:14:39.505 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-01-13T17:14:39.505 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-01-13T17:14:39.505 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-01-13T17:14:39.505 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-532.el8.x86_64.conf 2024-01-13T17:14:39.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-532.el8.x86_64 2024-01-13T17:14:39.692 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2024-01-13T17:15:07.316 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-13T17:15:07.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-13T17:15:07.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:15:09.698 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-13T17:15:09.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-13T17:15:09.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:15:25.884 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-13T17:15:28.188 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-13T17:15:34.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-13T17:15:34.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:15:37.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-13T17:15:37.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:15:37.948 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-13T17:15:40.252 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-13T17:15:49.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-13T17:15:49.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:15:52.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-13T17:15:52.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:16:08.384 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-13T17:16:10.684 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-13T17:16:23.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-13T17:16:23.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:16:23.728 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-01-13T17:16:23.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-13T17:16:23.960 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-532.el8.x86_64"... 2024-01-13T17:16:23.960 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-01-13T17:16:23.976 INFO:teuthology.orchestra.run.smithi099.stdout:4.18.0-532.el8.x86_64 2024-01-13T17:16:23.977 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-532.el8.x86_64 vs 4.18.0-532.el8.x86_64 2024-01-13T17:16:23.977 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-13T17:16:23.977 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-13T17:16:24.978 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-13T17:16:24.978 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-13T17:16:25.443 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-01-13T17:16:25.486 DEBUG:teuthology.parallel:result is None 2024-01-13T17:16:25.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-13T17:16:25.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:16:26.860 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-01-13T17:16:28.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-13T17:16:28.004 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-532.el8.x86_64"... 2024-01-13T17:16:28.004 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-01-13T17:16:28.021 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-532.el8.x86_64 2024-01-13T17:16:28.021 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-532.el8.x86_64 vs 4.18.0-532.el8.x86_64 2024-01-13T17:16:28.021 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-13T17:16:28.021 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-13T17:16:29.022 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-13T17:16:29.022 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-13T17:16:29.103 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2024-01-13T17:16:29.115 DEBUG:teuthology.parallel:result is None 2024-01-13T17:16:29.116 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-13T17:16:29.122 INFO:teuthology.task.internal:Creating test directory... 2024-01-13T17:16:29.123 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-13T17:16:29.125 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-13T17:16:29.147 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-13T17:16:29.183 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-13T17:16:29.215 INFO:teuthology.task.internal:Creating archive directory... 2024-01-13T17:16:29.216 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-13T17:16:29.218 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-13T17:16:29.255 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-13T17:16:29.262 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-13T17:16:29.262 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-13T17:16:29.279 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-13T17:16:29.310 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-13T17:16:29.320 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-13T17:16:29.334 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-13T17:16:29.345 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-13T17:16:29.347 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-13T17:16:29.354 INFO:teuthology.task.internal:Configuring sudo... 2024-01-13T17:16:29.354 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-13T17:16:29.364 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-13T17:16:29.394 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-13T17:16:29.403 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-13T17:16:29.403 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-13T17:16:29.431 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-13T17:16:29.453 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-13T17:16:29.534 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-13T17:16:29.586 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-13T17:16:29.669 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-13T17:16:29.711 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:16:29.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-13T17:16:29.777 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-13T17:16:29.826 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-13T17:16:29.882 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-13T17:16:29.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-13T17:16:30.014 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:16:30.014 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-13T17:16:30.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-01-13T17:16:30.085 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-01-13T17:16:30.137 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-13T17:16:30.174 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-13T17:16:30.634 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-13T17:16:30.642 INFO:teuthology.task.internal:Starting timer... 2024-01-13T17:16:30.642 INFO:teuthology.run_tasks:Running task pcp... 2024-01-13T17:16:30.686 INFO:teuthology.run_tasks:Running task selinux... 2024-01-13T17:16:30.718 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-01-13T17:16:30.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-01-13T17:16:30.795 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-01-13T17:16:30.797 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-01-13T17:16:30.877 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-01-13T17:16:30.879 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-13T17:16:30.879 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-01-13T17:16:30.906 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-01-13T17:16:30.906 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-01-13T17:16:30.950 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-01-13T17:16:30.950 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi099.front.sepia.ceph.com': 'permissive'} 2024-01-13T17:16:30.951 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-13T17:16:30.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T17:16:30.977 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-13T17:16:31.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T17:16:31.004 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-13T17:16:31.004 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-01-13T17:16:31.043 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-01-13T17:16:31.071 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-13T17:16:31.082 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-13T17:16:31.098 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-13T17:16:31.099 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi099.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-13T17:35:01.179 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com')] 2024-01-13T17:35:01.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-13T17:35:01.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:35:01.256 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-01-13T17:35:01.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-13T17:35:01.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-13T17:35:01.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T17:35:01.401 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-01-13T17:35:01.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-13T17:35:01.472 INFO:teuthology.run_tasks:Running task clock... 2024-01-13T17:35:01.487 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-13T17:35:01.487 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-13T17:35:01.488 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-13T17:35:01.490 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-13T17:35:01.490 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-13T17:35:01.522 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-13T17:35:01.537 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-13T17:35:01.546 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-13T17:35:01.560 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-13T17:35:01.612 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-01-13T17:35:01.623 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-01-13T17:35:01.636 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-13T17:35:01.638 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-01-13T17:35:01.649 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-13T17:35:01.650 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-01-13T17:35:01.663 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-13T17:35:01.676 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-13T17:35:01.721 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2024-01-13T17:35:01.726 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-13T17:35:01.726 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-01-13T17:35:01.726 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-13T17:35:01.726 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-13T17:35:01.726 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-13T17:35:01.726 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-13T17:35:01.752 INFO:teuthology.orchestra.run.smithi099.stderr:bash: ntpq: command not found 2024-01-13T17:35:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-13T17:35:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-01-13T17:35:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-13T17:35:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-13T17:35:01.757 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-13T17:35:01.757 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-13T17:35:01.757 INFO:teuthology.run_tasks:Running task pexec... 2024-01-13T17:35:01.766 INFO:teuthology.task.pexec:Executing custom commands... 2024-01-13T17:35:01.767 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi084.front.sepia.ceph.com 2024-01-13T17:35:01.767 DEBUG:teuthology.orchestra.run.smithi084:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-01-13T17:35:01.767 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi099.front.sepia.ceph.com 2024-01-13T17:35:01.767 DEBUG:teuthology.orchestra.run.smithi099:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-01-13T17:35:02.652 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:05:42 ago on Sat 13 Jan 2024 05:29:20 PM UTC. 2024-01-13T17:35:02.682 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:05:46 ago on Sat 13 Jan 2024 05:29:16 PM UTC. 2024-01-13T17:35:04.831 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-01-13T17:35:04.831 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-01-13T17:35:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-01-13T17:35:04.832 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-01-13T17:35:04.832 INFO:teuthology.orchestra.run.smithi084.stdout:Resetting modules: 2024-01-13T17:35:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: container-tools 2024-01-13T17:35:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:35:04.832 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-01-13T17:35:04.833 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-01-13T17:35:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:35:04.863 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-01-13T17:35:04.864 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-13T17:35:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-01-13T17:35:04.865 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-13T17:35:04.865 INFO:teuthology.orchestra.run.smithi099.stdout:Resetting modules: 2024-01-13T17:35:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: container-tools 2024-01-13T17:35:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:35:04.865 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-01-13T17:35:04.865 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-13T17:35:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:35:05.089 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-01-13T17:35:05.108 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-01-13T17:35:06.031 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:05:45 ago on Sat 13 Jan 2024 05:29:20 PM UTC. 2024-01-13T17:35:06.035 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:05:49 ago on Sat 13 Jan 2024 05:29:16 PM UTC. 2024-01-13T17:35:08.183 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-01-13T17:35:08.184 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-01-13T17:35:08.377 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-13T17:35:08.377 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-01-13T17:35:08.377 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-13T17:35:08.377 INFO:teuthology.orchestra.run.smithi099.stdout:Installing group/module packages: 2024-01-13T17:35:08.377 INFO:teuthology.orchestra.run.smithi099.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2024-01-13T17:35:08.377 INFO:teuthology.orchestra.run.smithi099.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2024-01-13T17:35:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-01-13T17:35:08.379 INFO:teuthology.orchestra.run.smithi099.stdout:Installing module profiles: 2024-01-13T17:35:08.379 INFO:teuthology.orchestra.run.smithi099.stdout: container-tools/common 2024-01-13T17:35:08.379 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:35:08.379 INFO:teuthology.orchestra.run.smithi099.stdout:Enabling module streams: 2024-01-13T17:35:08.379 INFO:teuthology.orchestra.run.smithi099.stdout: container-tools rhel8 2024-01-13T17:35:08.379 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:35:08.379 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-01-13T17:35:08.379 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-13T17:35:08.379 INFO:teuthology.orchestra.run.smithi099.stdout:Install 13 Packages 2024-01-13T17:35:08.379 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:35:08.380 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 27 M 2024-01-13T17:35:08.380 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 89 M 2024-01-13T17:35:08.380 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-01-13T17:35:08.380 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout:Installing group/module packages: 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2024-01-13T17:35:08.381 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout:Installing module profiles: 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: container-tools/common 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling module streams: 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: container-tools rhel8 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout:Install 13 Packages 2024-01-13T17:35:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:35:08.383 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 27 M 2024-01-13T17:35:08.383 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 89 M 2024-01-13T17:35:08.383 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-01-13T17:35:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 1.7 MB/s | 750 kB 00:00 2024-01-13T17:35:09.058 INFO:teuthology.orchestra.run.smithi099.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 2.1 MB/s | 1.0 MB 00:00 2024-01-13T17:35:09.074 INFO:teuthology.orchestra.run.smithi099.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 564 kB/s | 38 kB 00:00 2024-01-13T17:35:09.142 INFO:teuthology.orchestra.run.smithi099.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 2.8 MB/s | 241 kB 00:00 2024-01-13T17:35:09.225 INFO:teuthology.orchestra.run.smithi099.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 2.1 MB/s | 178 kB 00:00 2024-01-13T17:35:09.317 INFO:teuthology.orchestra.run.smithi099.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 270 kB/s | 25 kB 00:00 2024-01-13T17:35:09.384 INFO:teuthology.orchestra.run.smithi099.stdout:(7/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 13 MB/s | 3.9 MB 00:00 2024-01-13T17:35:09.443 INFO:teuthology.orchestra.run.smithi099.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 748 kB/s | 94 kB 00:00 2024-01-13T17:35:09.552 INFO:teuthology.orchestra.run.smithi099.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 9.9 MB/s | 9.6 MB 00:00 2024-01-13T17:35:09.644 INFO:teuthology.orchestra.run.smithi099.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 575 kB/s | 53 kB 00:00 2024-01-13T17:35:09.736 INFO:teuthology.orchestra.run.smithi099.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 446 kB/s | 41 kB 00:00 2024-01-13T17:35:09.853 INFO:teuthology.orchestra.run.smithi099.stdout:(12/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 17 MB/s | 8.1 MB 00:00 2024-01-13T17:35:09.903 INFO:teuthology.orchestra.run.smithi099.stdout:(13/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 5.5 MB/s | 2.5 MB 00:00 2024-01-13T17:35:09.903 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-01-13T17:35:09.903 INFO:teuthology.orchestra.run.smithi099.stdout:Total 17 MB/s | 27 MB 00:01 2024-01-13T17:35:10.057 INFO:teuthology.orchestra.run.smithi084.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 1.5 MB/s | 750 kB 00:00 2024-01-13T17:35:10.091 INFO:teuthology.orchestra.run.smithi084.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 2.0 MB/s | 1.0 MB 00:00 2024-01-13T17:35:10.133 INFO:teuthology.orchestra.run.smithi084.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 504 kB/s | 38 kB 00:00 2024-01-13T17:35:10.168 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-01-13T17:35:10.174 INFO:teuthology.orchestra.run.smithi084.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 2.8 MB/s | 241 kB 00:00 2024-01-13T17:35:10.189 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-01-13T17:35:10.189 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-01-13T17:35:10.308 INFO:teuthology.orchestra.run.smithi084.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 1.3 MB/s | 178 kB 00:00 2024-01-13T17:35:10.446 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-01-13T17:35:10.449 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-01-13T17:35:10.467 INFO:teuthology.orchestra.run.smithi084.stdout:(6/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 11 MB/s | 9.6 MB 00:00 2024-01-13T17:35:10.484 INFO:teuthology.orchestra.run.smithi084.stdout:(7/13): python3-pytoml-0.1.14-5.git7dea353.el8. 141 kB/s | 25 kB 00:00 2024-01-13T17:35:10.542 INFO:teuthology.orchestra.run.smithi084.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 9.6 MB/s | 3.9 MB 00:00 2024-01-13T17:35:10.568 INFO:teuthology.orchestra.run.smithi084.stdout:(9/13): python3-pyxdg-0.25-16.el8.noarch.rpm 935 kB/s | 94 kB 00:00 2024-01-13T17:35:10.643 INFO:teuthology.orchestra.run.smithi084.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 703 kB/s | 53 kB 00:00 2024-01-13T17:35:10.693 INFO:teuthology.orchestra.run.smithi084.stdout:(11/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 17 MB/s | 2.5 MB 00:00 2024-01-13T17:35:10.741 INFO:teuthology.orchestra.run.smithi084.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 418 kB/s | 41 kB 00:00 2024-01-13T17:35:10.927 INFO:teuthology.orchestra.run.smithi084.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 18 MB/s | 8.1 MB 00:00 2024-01-13T17:35:10.928 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-01-13T17:35:10.928 INFO:teuthology.orchestra.run.smithi084.stdout:Total 10 MB/s | 27 MB 00:02 2024-01-13T17:35:11.153 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-01-13T17:35:11.195 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-01-13T17:35:11.216 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-01-13T17:35:11.216 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-01-13T17:35:11.394 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-01-13T17:35:11.463 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-01-13T17:35:11.466 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-01-13T17:35:11.605 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-01-13T17:35:11.825 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2024-01-13T17:35:12.064 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-01-13T17:35:12.207 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-01-13T17:35:12.438 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-01-13T17:35:12.636 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2024-01-13T17:35:12.641 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-01-13T17:35:12.836 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2024-01-13T17:35:13.068 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-01-13T17:35:13.599 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2024-01-13T17:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2024-01-13T17:35:13.858 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2024-01-13T17:35:14.062 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2024-01-13T17:35:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2024-01-13T17:35:14.637 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2024-01-13T17:35:14.818 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2024-01-13T17:35:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2024-01-13T17:35:15.128 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2024-01-13T17:35:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2024-01-13T17:35:15.705 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2024-01-13T17:35:15.803 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2024-01-13T17:35:16.009 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2024-01-13T17:35:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2024-01-13T17:35:16.588 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2024-01-13T17:35:16.589 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2024-01-13T17:35:16.701 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2024-01-13T17:35:17.054 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2024-01-13T17:35:17.282 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2024-01-13T17:35:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-01-13T17:35:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:35:17.480 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-01-13T17:35:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: yajl-2.1.0-12.el8.x86_64 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:35:17.481 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-01-13T17:35:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2024-01-13T17:35:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2024-01-13T17:35:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2024-01-13T17:35:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2024-01-13T17:35:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-01-13T17:35:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2024-01-13T17:35:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2024-01-13T17:35:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2024-01-13T17:35:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-01-13T17:35:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-01-13T17:35:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2024-01-13T17:35:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2024-01-13T17:35:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2024-01-13T17:35:17.727 DEBUG:teuthology.parallel:result is None 2024-01-13T17:35:18.583 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-01-13T17:35:18.583 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:35:18.583 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-01-13T17:35:18.583 INFO:teuthology.orchestra.run.smithi084.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:18.583 INFO:teuthology.orchestra.run.smithi084.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:18.583 INFO:teuthology.orchestra.run.smithi084.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2024-01-13T17:35:18.583 INFO:teuthology.orchestra.run.smithi084.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-01-13T17:35:18.583 INFO:teuthology.orchestra.run.smithi084.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:18.584 INFO:teuthology.orchestra.run.smithi084.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:18.584 INFO:teuthology.orchestra.run.smithi084.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2024-01-13T17:35:18.584 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-01-13T17:35:18.584 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-01-13T17:35:18.584 INFO:teuthology.orchestra.run.smithi084.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:18.584 INFO:teuthology.orchestra.run.smithi084.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2024-01-13T17:35:18.584 INFO:teuthology.orchestra.run.smithi084.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2024-01-13T17:35:18.584 INFO:teuthology.orchestra.run.smithi084.stdout: yajl-2.1.0-12.el8.x86_64 2024-01-13T17:35:18.584 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:35:18.584 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-01-13T17:35:18.871 DEBUG:teuthology.parallel:result is None 2024-01-13T17:35:18.872 INFO:teuthology.run_tasks:Running task install... 2024-01-13T17:35:18.880 DEBUG:teuthology.task.install:project ceph 2024-01-13T17:35:18.881 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'default', 'sha1': 'd2f11f33b7063c2c1bc47b2b4e9350f48064868f'}} 2024-01-13T17:35:18.881 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'extra_system_packages': ['python3-pytest'], 'flavor': 'default', 'sha1': 'd2f11f33b7063c2c1bc47b2b4e9350f48064868f'} 2024-01-13T17:35:18.881 INFO:teuthology.task.install:Using flavor: default 2024-01-13T17:35:18.889 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-13T17:35:18.889 INFO:teuthology.task.install:extra packages: [] 2024-01-13T17:35:18.889 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2f11f33b7063c2c1bc47b2b4e9350f48064868f', 'tag': None, 'wait_for_package': False} 2024-01-13T17:35:18.889 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-13T17:35:18.889 INFO:teuthology.packaging:ref: None 2024-01-13T17:35:18.890 INFO:teuthology.packaging:tag: None 2024-01-13T17:35:18.890 INFO:teuthology.packaging:branch: quincy 2024-01-13T17:35:18.890 INFO:teuthology.packaging:sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T17:35:18.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-01-13T17:35:18.892 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2f11f33b7063c2c1bc47b2b4e9350f48064868f', 'tag': None, 'wait_for_package': False} 2024-01-13T17:35:18.892 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-13T17:35:18.892 INFO:teuthology.packaging:ref: None 2024-01-13T17:35:18.892 INFO:teuthology.packaging:tag: None 2024-01-13T17:35:18.892 INFO:teuthology.packaging:branch: quincy 2024-01-13T17:35:18.892 INFO:teuthology.packaging:sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T17:35:18.892 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-01-13T17:35:19.118 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/6441305d08929b8a72c0322a5c268c64b4a99c65/centos/8/flavors/default/ 2024-01-13T17:35:19.119 INFO:teuthology.task.install.rpm:Package version is 17.2.7-268.g6441305d 2024-01-13T17:35:19.221 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/6441305d08929b8a72c0322a5c268c64b4a99c65/centos/8/flavors/default/ 2024-01-13T17:35:19.221 INFO:teuthology.task.install.rpm:Package version is 17.2.7-268.g6441305d 2024-01-13T17:35:19.229 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6441305d08929b8a72c0322a5c268c64b4a99c65/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6441305d08929b8a72c0322a5c268c64b4a99c65/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6441305d08929b8a72c0322a5c268c64b4a99c65/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-13T17:35:19.229 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:35:19.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-13T17:35:19.257 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest, python3-pytest, python3-pytest on remote rpm x86_64 2024-01-13T17:35:19.257 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-13T17:35:19.257 INFO:teuthology.packaging:ref: None 2024-01-13T17:35:19.257 INFO:teuthology.packaging:tag: None 2024-01-13T17:35:19.257 INFO:teuthology.packaging:branch: quincy 2024-01-13T17:35:19.257 INFO:teuthology.packaging:sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T17:35:19.257 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-13T17:35:19.325 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-13T17:35:19.332 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6441305d08929b8a72c0322a5c268c64b4a99c65/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6441305d08929b8a72c0322a5c268c64b4a99c65/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/6441305d08929b8a72c0322a5c268c64b4a99c65/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-13T17:35:19.332 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:35:19.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-13T17:35:19.366 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest, python3-pytest, python3-pytest, python3-pytest on remote rpm x86_64 2024-01-13T17:35:19.366 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-13T17:35:19.366 INFO:teuthology.packaging:ref: None 2024-01-13T17:35:19.367 INFO:teuthology.packaging:tag: None 2024-01-13T17:35:19.367 INFO:teuthology.packaging:branch: quincy 2024-01-13T17:35:19.367 INFO:teuthology.packaging:sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T17:35:19.367 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-13T17:35:19.404 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-13T17:35:19.438 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-13T17:35:19.470 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-01-13T17:35:19.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-01-13T17:35:19.520 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-13T17:35:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-01-13T17:35:19.591 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-01-13T17:35:19.753 INFO:teuthology.orchestra.run.smithi084.stdout:76 files removed 2024-01-13T17:35:19.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest python3-pytest python3-pytest python3-pytest 2024-01-13T17:35:19.865 INFO:teuthology.orchestra.run.smithi099.stdout:76 files removed 2024-01-13T17:35:19.892 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest python3-pytest python3-pytest python3-pytest 2024-01-13T17:35:20.620 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 181 kB/s | 78 kB 00:00 2024-01-13T17:35:20.762 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 168 kB/s | 78 kB 00:00 2024-01-13T17:35:20.978 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 29 kB/s | 9.1 kB 00:00 2024-01-13T17:35:21.146 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 26 kB/s | 9.1 kB 00:00 2024-01-13T17:35:21.296 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 5.0 kB/s | 1.4 kB 00:00 2024-01-13T17:35:21.539 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 4.0 kB/s | 1.4 kB 00:00 2024-01-13T17:35:23.239 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - AppStream 21 MB/s | 35 MB 00:01 2024-01-13T17:35:23.988 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - AppStream 13 MB/s | 35 MB 00:02 2024-01-13T17:43:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - BaseOS 118 kB/s | 58 MB 08:24 2024-01-13T17:44:01.816 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - BaseOS 117 kB/s | 58 MB 08:31 2024-01-13T17:44:03.591 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - Extras 22 kB/s | 18 kB 00:00 2024-01-13T17:44:04.225 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 6.9 kB 00:00 2024-01-13T17:44:04.951 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - PowerTools 12 MB/s | 6.7 MB 00:00 2024-01-13T17:44:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-01-13T17:44:07.657 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-01-13T17:44:10.564 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2024-01-13T17:44:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.9 kB 00:00 2024-01-13T17:44:11.503 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 405 kB/s | 24 kB 00:00 2024-01-13T17:44:12.124 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 6.7 MB 00:00 2024-01-13T17:44:13.559 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-01-13T17:44:14.903 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-01-13T17:44:15.951 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-13T17:44:15.952 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-13T17:44:16.210 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-01-13T17:44:16.219 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2024-01-13T17:44:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-01-13T17:44:16.220 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2024-01-13T17:44:16.220 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-01-13T17:44:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:17.2.7-268.g6441305d.el8 ceph 6.4 k 2024-01-13T17:44:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:17.2.7-268.g6441305d.el8 ceph 5.2 M 2024-01-13T17:44:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:17.2.7-268.g6441305d.el8 ceph 875 k 2024-01-13T17:44:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-268.g6441305d.el8 ceph 161 k 2024-01-13T17:44:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:17.2.7-268.g6441305d.el8 ceph 1.6 M 2024-01-13T17:44:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 121 k 2024-01-13T17:44:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 1.7 M 2024-01-13T17:44:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 7.4 M 2024-01-13T17:44:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 47 k 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:17.2.7-268.g6441305d.el8 ceph 17 M 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:17.2.7-268.g6441305d.el8 ceph 52 M 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 80 k 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:17.2.7-268.g6441305d.el8 ceph 25 k 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:17.2.7-268.g6441305d.el8 ceph 796 k 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:17.2.7-268.g6441305d.el8 ceph 130 k 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:17.2.7-268.g6441305d.el8 ceph 190 k 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytest noarch 3.4.2-11.el8 appstream 1.3 M 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:17.2.7-268.g6441305d.el8 ceph 371 k 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:17.2.7-268.g6441305d.el8 ceph 358 k 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:17.2.7-268.g6441305d.el8 ceph 107 k 2024-01-13T17:44:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:17.2.7-268.g6441305d.el8 ceph 91 k 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:17.2.7-268.g6441305d.el8 ceph 3.5 M 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:17.2.7-268.g6441305d.el8 ceph 174 k 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:17.2.7-268.g6441305d.el8 ceph 3.5 M 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:17.2.7-268.g6441305d.el8 ceph 3.6 M 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:17.2.7-268.g6441305d.el8 ceph 23 M 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 23 k 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:17.2.7-268.g6441305d.el8 ceph 2.3 M 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 238 k 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:17.2.7-268.g6441305d.el8 ceph 3.9 M 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:17.2.7-268.g6441305d.el8 ceph 17 M 2024-01-13T17:44:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 14 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:17.2.7-268.g6441305d.el8 ceph 24 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:17.2.7-268.g6441305d.el8 ceph 178 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:17.2.7-268.g6441305d.el8 ceph 506 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:17.2.7-268.g6441305d.el8 ceph 5.6 M 2024-01-13T17:44:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs noarch 17.4.0-6.el8 appstream 53 k 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:17.2.7-268.g6441305d.el8 ceph 45 k 2024-01-13T17:44:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:17.2.7-268.g6441305d.el8 ceph 115 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-01-13T17:44:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pluggy noarch 0.6.0-3.el8 appstream 32 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-py noarch 1.5.3-4.el8 appstream 472 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-01-13T17:44:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-01-13T17:44:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout:Install 104 Packages 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 2 Packages 2024-01-13T17:44:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:44:16.229 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 197 M 2024-01-13T17:44:16.229 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-01-13T17:44:16.853 INFO:teuthology.orchestra.run.smithi099.stdout:(1/106): ceph-17.2.7-268.g6441305d.el8.x86_64.r 26 kB/s | 6.4 kB 00:00 2024-01-13T17:44:17.154 INFO:teuthology.orchestra.run.smithi099.stdout:(2/106): ceph-base-17.2.7-268.g6441305d.el8.x86 9.5 MB/s | 5.2 MB 00:00 2024-01-13T17:44:17.254 INFO:teuthology.orchestra.run.smithi099.stdout:(3/106): ceph-immutable-object-cache-17.2.7-268 1.6 MB/s | 161 kB 00:00 2024-01-13T17:44:17.471 INFO:teuthology.orchestra.run.smithi099.stdout:(4/106): ceph-mds-17.2.7-268.g6441305d.el8.x86_ 11 MB/s | 2.3 MB 00:00 2024-01-13T17:44:17.671 INFO:teuthology.orchestra.run.smithi099.stdout:(5/106): ceph-mgr-17.2.7-268.g6441305d.el8.x86_ 7.9 MB/s | 1.6 MB 00:00 2024-01-13T17:44:17.713 INFO:teuthology.orchestra.run.smithi099.stdout:(6/106): ceph-fuse-17.2.7-268.g6441305d.el8.x86 1.0 MB/s | 875 kB 00:00 2024-01-13T17:44:18.388 INFO:teuthology.orchestra.run.smithi099.stdout:(7/106): ceph-common-17.2.7-268.g6441305d.el8.x 13 MB/s | 23 MB 00:01 2024-01-13T17:44:18.455 INFO:teuthology.orchestra.run.smithi099.stdout:(8/106): ceph-mon-17.2.7-268.g6441305d.el8.x86_ 5.0 MB/s | 3.9 MB 00:00 2024-01-13T17:44:18.522 INFO:teuthology.orchestra.run.smithi099.stdout:(9/106): ceph-selinux-17.2.7-268.g6441305d.el8. 364 kB/s | 24 kB 00:00 2024-01-13T17:44:18.809 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 473 kB/s | 24 kB 00:00 2024-01-13T17:44:19.481 INFO:teuthology.orchestra.run.smithi099.stdout:(10/106): ceph-radosgw-17.2.7-268.g6441305d.el8 15 MB/s | 17 MB 00:01 2024-01-13T17:44:19.531 INFO:teuthology.orchestra.run.smithi099.stdout:(11/106): libcephfs-devel-17.2.7-268.g6441305d. 499 kB/s | 25 kB 00:00 2024-01-13T17:44:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:(12/106): libcephfs2-17.2.7-268.g6441305d.el8.x 6.7 MB/s | 796 kB 00:00 2024-01-13T17:44:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:(13/106): libcephsqlite-17.2.7-268.g6441305d.el 2.6 MB/s | 178 kB 00:00 2024-01-13T17:44:19.782 INFO:teuthology.orchestra.run.smithi099.stdout:(14/106): librados-devel-17.2.7-268.g6441305d.e 1.9 MB/s | 130 kB 00:00 2024-01-13T17:44:19.857 INFO:teuthology.orchestra.run.smithi099.stdout:(15/106): libradosstriper1-17.2.7-268.g6441305d 6.6 MB/s | 506 kB 00:00 2024-01-13T17:44:20.332 INFO:teuthology.orchestra.run.smithi099.stdout:(16/106): librgw2-17.2.7-268.g6441305d.el8.x86_ 12 MB/s | 5.6 MB 00:00 2024-01-13T17:44:20.408 INFO:teuthology.orchestra.run.smithi099.stdout:(17/106): python3-ceph-argparse-17.2.7-268.g644 597 kB/s | 45 kB 00:00 2024-01-13T17:44:20.475 INFO:teuthology.orchestra.run.smithi099.stdout:(18/106): python3-ceph-common-17.2.7-268.g64413 1.7 MB/s | 115 kB 00:00 2024-01-13T17:44:20.558 INFO:teuthology.orchestra.run.smithi099.stdout:(19/106): python3-cephfs-17.2.7-268.g6441305d.e 2.2 MB/s | 190 kB 00:00 2024-01-13T17:44:20.650 INFO:teuthology.orchestra.run.smithi099.stdout:(20/106): python3-rados-17.2.7-268.g6441305d.el 4.0 MB/s | 371 kB 00:00 2024-01-13T17:44:20.742 INFO:teuthology.orchestra.run.smithi099.stdout:(21/106): python3-rbd-17.2.7-268.g6441305d.el8. 3.8 MB/s | 358 kB 00:00 2024-01-13T17:44:20.817 INFO:teuthology.orchestra.run.smithi099.stdout:(22/106): python3-rgw-17.2.7-268.g6441305d.el8. 1.4 MB/s | 107 kB 00:00 2024-01-13T17:44:20.892 INFO:teuthology.orchestra.run.smithi099.stdout:(23/106): rbd-fuse-17.2.7-268.g6441305d.el8.x86 1.2 MB/s | 91 kB 00:00 2024-01-13T17:44:21.051 INFO:teuthology.orchestra.run.smithi099.stdout:(24/106): ceph-osd-17.2.7-268.g6441305d.el8.x86 5.0 MB/s | 17 MB 00:03 2024-01-13T17:44:21.185 INFO:teuthology.orchestra.run.smithi099.stdout:(25/106): rbd-mirror-17.2.7-268.g6441305d.el8.x 12 MB/s | 3.5 MB 00:00 2024-01-13T17:44:21.210 INFO:teuthology.orchestra.run.smithi099.stdout:(26/106): rbd-nbd-17.2.7-268.g6441305d.el8.x86_ 1.1 MB/s | 174 kB 00:00 2024-01-13T17:44:21.236 INFO:teuthology.orchestra.run.smithi099.stdout:(27/106): ceph-grafana-dashboards-17.2.7-268.g6 464 kB/s | 23 kB 00:00 2024-01-13T17:44:21.294 INFO:teuthology.orchestra.run.smithi099.stdout:(28/106): ceph-mgr-cephadm-17.2.7-268.g6441305d 1.4 MB/s | 121 kB 00:00 2024-01-13T17:44:21.653 INFO:teuthology.orchestra.run.smithi099.stdout:(29/106): ceph-mgr-dashboard-17.2.7-268.g644130 4.1 MB/s | 1.7 MB 00:00 2024-01-13T17:44:21.736 INFO:teuthology.orchestra.run.smithi099.stdout:(30/106): ceph-mgr-modules-core-17.2.7-268.g644 2.8 MB/s | 238 kB 00:00 2024-01-13T17:44:21.828 INFO:teuthology.orchestra.run.smithi099.stdout:(31/106): ceph-mgr-rook-17.2.7-268.g6441305d.el 517 kB/s | 47 kB 00:00 2024-01-13T17:44:21.912 INFO:teuthology.orchestra.run.smithi099.stdout:(32/106): ceph-prometheus-alerts-17.2.7-268.g64 174 kB/s | 14 kB 00:00 2024-01-13T17:44:22.004 INFO:teuthology.orchestra.run.smithi099.stdout:(33/106): cephadm-17.2.7-268.g6441305d.el8.noar 880 kB/s | 80 kB 00:00 2024-01-13T17:44:22.096 INFO:teuthology.orchestra.run.smithi099.stdout:(34/106): ceph-mgr-diskprediction-local-17.2.7- 9.2 MB/s | 7.4 MB 00:00 2024-01-13T17:44:22.788 INFO:teuthology.orchestra.run.smithi099.stdout:(35/106): ceph-test-17.2.7-268.g6441305d.el8.x8 12 MB/s | 52 MB 00:04 2024-01-13T17:44:22.813 INFO:teuthology.orchestra.run.smithi099.stdout:(36/106): jq-1.6-8.el8.x86_64.rpm 251 kB/s | 203 kB 00:00 2024-01-13T17:44:22.947 INFO:teuthology.orchestra.run.smithi099.stdout:(37/106): oniguruma-6.8.2-2.el8.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2024-01-13T17:44:23.030 INFO:teuthology.orchestra.run.smithi099.stdout:(38/106): librdkafka-1.6.1-1.el8.x86_64.rpm 725 kB/s | 677 kB 00:00 2024-01-13T17:44:23.131 INFO:teuthology.orchestra.run.smithi099.stdout:(39/106): lttng-ust-2.8.1-11.el8.x86_64.rpm 758 kB/s | 259 kB 00:00 2024-01-13T17:44:23.223 INFO:teuthology.orchestra.run.smithi099.stdout:(40/106): python3-attrs-17.4.0-6.el8.noarch.rpm 576 kB/s | 53 kB 00:00 2024-01-13T17:44:23.231 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-13T17:44:23.233 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-13T17:44:23.289 INFO:teuthology.orchestra.run.smithi099.stdout:(41/106): openblas-0.3.15-4.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2024-01-13T17:44:23.397 INFO:teuthology.orchestra.run.smithi099.stdout:(42/106): python3-jinja2-2.10.1-3.el8.noarch.rp 4.9 MB/s | 538 kB 00:00 2024-01-13T17:44:23.473 INFO:teuthology.orchestra.run.smithi099.stdout:(43/106): python3-jsonpatch-1.21-2.el8.noarch.r 350 kB/s | 27 kB 00:00 2024-01-13T17:44:23.493 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-01-13T17:44:23.502 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================================ 2024-01-13T17:44:23.503 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-01-13T17:44:23.503 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================================ 2024-01-13T17:44:23.503 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-01-13T17:44:23.503 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:17.2.7-268.g6441305d.el8 ceph 6.4 k 2024-01-13T17:44:23.503 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:17.2.7-268.g6441305d.el8 ceph 5.2 M 2024-01-13T17:44:23.503 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:17.2.7-268.g6441305d.el8 ceph 875 k 2024-01-13T17:44:23.503 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-268.g6441305d.el8 ceph 161 k 2024-01-13T17:44:23.503 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:17.2.7-268.g6441305d.el8 ceph 1.6 M 2024-01-13T17:44:23.503 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 121 k 2024-01-13T17:44:23.503 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 1.7 M 2024-01-13T17:44:23.503 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 7.4 M 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 47 k 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:17.2.7-268.g6441305d.el8 ceph 17 M 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:17.2.7-268.g6441305d.el8 ceph 52 M 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 80 k 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:17.2.7-268.g6441305d.el8 ceph 25 k 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:17.2.7-268.g6441305d.el8 ceph 796 k 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:17.2.7-268.g6441305d.el8 ceph 130 k 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:17.2.7-268.g6441305d.el8 ceph 190 k 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytest noarch 3.4.2-11.el8 appstream 1.3 M 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:17.2.7-268.g6441305d.el8 ceph 371 k 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:17.2.7-268.g6441305d.el8 ceph 358 k 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:17.2.7-268.g6441305d.el8 ceph 107 k 2024-01-13T17:44:23.504 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:17.2.7-268.g6441305d.el8 ceph 91 k 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:17.2.7-268.g6441305d.el8 ceph 3.5 M 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:17.2.7-268.g6441305d.el8 ceph 174 k 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:17.2.7-268.g6441305d.el8 ceph 3.5 M 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:17.2.7-268.g6441305d.el8 ceph 3.6 M 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:17.2.7-268.g6441305d.el8 ceph 23 M 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 23 k 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:17.2.7-268.g6441305d.el8 ceph 2.3 M 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 238 k 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:17.2.7-268.g6441305d.el8 ceph 3.9 M 2024-01-13T17:44:23.505 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:17.2.7-268.g6441305d.el8 ceph 17 M 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:17.2.7-268.g6441305d.el8 ceph-noarch 14 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:17.2.7-268.g6441305d.el8 ceph 24 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:17.2.7-268.g6441305d.el8 ceph 178 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:17.2.7-268.g6441305d.el8 ceph 506 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-01-13T17:44:23.506 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:17.2.7-268.g6441305d.el8 ceph 5.6 M 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs noarch 17.4.0-6.el8 appstream 53 k 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:17.2.7-268.g6441305d.el8 ceph 45 k 2024-01-13T17:44:23.507 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:17.2.7-268.g6441305d.el8 ceph 115 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-01-13T17:44:23.508 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-01-13T17:44:23.509 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-01-13T17:44:23.509 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-01-13T17:44:23.509 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-01-13T17:44:23.509 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-01-13T17:44:23.512 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-01-13T17:44:23.512 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-01-13T17:44:23.512 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-01-13T17:44:23.512 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-01-13T17:44:23.512 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-01-13T17:44:23.512 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pluggy noarch 0.6.0-3.el8 appstream 32 k 2024-01-13T17:44:23.512 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-01-13T17:44:23.512 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-01-13T17:44:23.512 INFO:teuthology.orchestra.run.smithi084.stdout: python3-py noarch 1.5.3-4.el8 appstream 472 k 2024-01-13T17:44:23.512 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-01-13T17:44:23.512 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-01-13T17:44:23.513 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================================ 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout:Install 104 Packages 2024-01-13T17:44:23.514 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 2 Packages 2024-01-13T17:44:23.515 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:44:23.515 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 197 M 2024-01-13T17:44:23.515 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-01-13T17:44:23.557 INFO:teuthology.orchestra.run.smithi099.stdout:(44/106): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2024-01-13T17:44:23.574 INFO:teuthology.orchestra.run.smithi099.stdout:(45/106): python3-jsonpointer-1.10-11.el8.noarc 199 kB/s | 20 kB 00:00 2024-01-13T17:44:23.633 INFO:teuthology.orchestra.run.smithi099.stdout:(46/106): python3-mako-1.0.6-14.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2024-01-13T17:44:23.649 INFO:teuthology.orchestra.run.smithi099.stdout:(47/106): python3-markupsafe-0.23-19.el8.x86_64 514 kB/s | 39 kB 00:00 2024-01-13T17:44:23.750 INFO:teuthology.orchestra.run.smithi099.stdout:(48/106): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2024-01-13T17:44:23.858 INFO:teuthology.orchestra.run.smithi099.stdout:(49/106): python3-numpy-1.14.3-10.el8.x86_64.rp 17 MB/s | 3.7 MB 00:00 2024-01-13T17:44:23.876 INFO:teuthology.orchestra.run.smithi099.stdout:(50/106): python3-pluggy-0.6.0-3.el8.noarch.rpm 256 kB/s | 32 kB 00:00 2024-01-13T17:44:23.925 INFO:teuthology.orchestra.run.smithi099.stdout:(51/106): python3-prettytable-0.7.2-14.el8.noar 659 kB/s | 44 kB 00:00 2024-01-13T17:44:23.993 INFO:teuthology.orchestra.run.smithi099.stdout:(52/106): openblas-threads-0.3.15-4.el8.x86_64. 5.0 MB/s | 4.9 MB 00:00 2024-01-13T17:44:24.018 INFO:teuthology.orchestra.run.smithi099.stdout:(53/106): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.1 MB/s | 103 kB 00:00 2024-01-13T17:44:24.043 INFO:teuthology.orchestra.run.smithi099.stdout:(54/106): python3-py-1.5.3-4.el8.noarch.rpm 2.8 MB/s | 472 kB 00:00 2024-01-13T17:44:24.077 INFO:teuthology.orchestra.run.smithi099.stdout:(55/106): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.5 MB/s | 126 kB 00:00 2024-01-13T17:44:24.135 INFO:teuthology.orchestra.run.smithi099.stdout:(56/106): python3-pyasn1-modules-0.3.7-6.el8.no 939 kB/s | 110 kB 00:00 2024-01-13T17:44:24.185 INFO:teuthology.orchestra.run.smithi099.stdout:(57/106): python3-pytest-3.4.2-11.el8.noarch.rp 9.4 MB/s | 1.3 MB 00:00 2024-01-13T17:44:24.211 INFO:teuthology.orchestra.run.smithi099.stdout:(58/106): python3-pytz-2017.2-11.el8.noarch.rpm 426 kB/s | 57 kB 00:00 2024-01-13T17:44:24.235 INFO:teuthology.orchestra.run.smithi084.stdout:(1/106): ceph-17.2.7-268.g6441305d.el8.x86_64.r 42 kB/s | 6.4 kB 00:00 2024-01-13T17:44:24.261 INFO:teuthology.orchestra.run.smithi099.stdout:(59/106): python3-werkzeug-0.12.2-4.el8.noarch. 5.9 MB/s | 457 kB 00:00 2024-01-13T17:44:24.336 INFO:teuthology.orchestra.run.smithi099.stdout:(60/106): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2024-01-13T17:44:24.353 INFO:teuthology.orchestra.run.smithi099.stdout:(61/106): xmlstarlet-1.6.1-20.el8.x86_64.rpm 769 kB/s | 71 kB 00:00 2024-01-13T17:44:24.670 INFO:teuthology.orchestra.run.smithi099.stdout:(62/106): python3-scipy-1.0.0-21.module_el8+762 27 MB/s | 14 MB 00:00 2024-01-13T17:44:24.727 INFO:teuthology.orchestra.run.smithi084.stdout:(2/106): ceph-base-17.2.7-268.g6441305d.el8.x86 8.0 MB/s | 5.2 MB 00:00 2024-01-13T17:44:24.819 INFO:teuthology.orchestra.run.smithi084.stdout:(3/106): ceph-immutable-object-cache-17.2.7-268 1.7 MB/s | 161 kB 00:00 2024-01-13T17:44:24.853 INFO:teuthology.orchestra.run.smithi084.stdout:(4/106): ceph-fuse-17.2.7-268.g6441305d.el8.x86 1.4 MB/s | 875 kB 00:00 2024-01-13T17:44:25.103 INFO:teuthology.orchestra.run.smithi084.stdout:(5/106): ceph-mds-17.2.7-268.g6441305d.el8.x86_ 8.1 MB/s | 2.3 MB 00:00 2024-01-13T17:44:25.553 INFO:teuthology.orchestra.run.smithi084.stdout:(6/106): ceph-mon-17.2.7-268.g6441305d.el8.x86_ 8.8 MB/s | 3.9 MB 00:00 2024-01-13T17:44:25.862 INFO:teuthology.orchestra.run.smithi084.stdout:(7/106): ceph-common-17.2.7-268.g6441305d.el8.x 13 MB/s | 23 MB 00:01 2024-01-13T17:44:25.895 INFO:teuthology.orchestra.run.smithi084.stdout:(8/106): ceph-mgr-17.2.7-268.g6441305d.el8.x86_ 1.5 MB/s | 1.6 MB 00:01 2024-01-13T17:44:25.954 INFO:teuthology.orchestra.run.smithi084.stdout:(9/106): ceph-selinux-17.2.7-268.g6441305d.el8. 418 kB/s | 24 kB 00:00 2024-01-13T17:44:27.146 INFO:teuthology.orchestra.run.smithi084.stdout:(10/106): ceph-radosgw-17.2.7-268.g6441305d.el8 13 MB/s | 17 MB 00:01 2024-01-13T17:44:27.338 INFO:teuthology.orchestra.run.smithi084.stdout:(11/106): ceph-osd-17.2.7-268.g6441305d.el8.x86 9.4 MB/s | 17 MB 00:01 2024-01-13T17:44:27.363 INFO:teuthology.orchestra.run.smithi084.stdout:(12/106): libcephfs-devel-17.2.7-268.g6441305d. 115 kB/s | 25 kB 00:00 2024-01-13T17:44:27.413 INFO:teuthology.orchestra.run.smithi084.stdout:(13/106): libcephfs2-17.2.7-268.g6441305d.el8.x 10 MB/s | 796 kB 00:00 2024-01-13T17:44:27.438 INFO:teuthology.orchestra.run.smithi084.stdout:(14/106): libcephsqlite-17.2.7-268.g6441305d.el 2.3 MB/s | 178 kB 00:00 2024-01-13T17:44:27.455 INFO:teuthology.orchestra.run.smithi084.stdout:(15/106): librados-devel-17.2.7-268.g6441305d.e 3.0 MB/s | 130 kB 00:00 2024-01-13T17:44:27.489 INFO:teuthology.orchestra.run.smithi084.stdout:(16/106): libradosstriper1-17.2.7-268.g6441305d 9.9 MB/s | 506 kB 00:00 2024-01-13T17:44:27.539 INFO:teuthology.orchestra.run.smithi084.stdout:(17/106): python3-ceph-argparse-17.2.7-268.g644 897 kB/s | 45 kB 00:00 2024-01-13T17:44:27.598 INFO:teuthology.orchestra.run.smithi084.stdout:(18/106): python3-ceph-common-17.2.7-268.g64413 1.9 MB/s | 115 kB 00:00 2024-01-13T17:44:27.707 INFO:teuthology.orchestra.run.smithi084.stdout:(19/106): python3-cephfs-17.2.7-268.g6441305d.e 1.7 MB/s | 190 kB 00:00 2024-01-13T17:44:27.798 INFO:teuthology.orchestra.run.smithi084.stdout:(20/106): librgw2-17.2.7-268.g6441305d.el8.x86_ 16 MB/s | 5.6 MB 00:00 2024-01-13T17:44:27.824 INFO:teuthology.orchestra.run.smithi084.stdout:(21/106): python3-rados-17.2.7-268.g6441305d.el 3.1 MB/s | 371 kB 00:00 2024-01-13T17:44:27.857 INFO:teuthology.orchestra.run.smithi084.stdout:(22/106): python3-rbd-17.2.7-268.g6441305d.el8. 6.0 MB/s | 358 kB 00:00 2024-01-13T17:44:27.882 INFO:teuthology.orchestra.run.smithi084.stdout:(23/106): python3-rgw-17.2.7-268.g6441305d.el8. 1.8 MB/s | 107 kB 00:00 2024-01-13T17:44:27.908 INFO:teuthology.orchestra.run.smithi084.stdout:(24/106): rbd-fuse-17.2.7-268.g6441305d.el8.x86 1.8 MB/s | 91 kB 00:00 2024-01-13T17:44:27.975 INFO:teuthology.orchestra.run.smithi084.stdout:(25/106): rbd-nbd-17.2.7-268.g6441305d.el8.x86_ 2.6 MB/s | 174 kB 00:00 2024-01-13T17:44:28.042 INFO:teuthology.orchestra.run.smithi084.stdout:(26/106): ceph-grafana-dashboards-17.2.7-268.g6 349 kB/s | 23 kB 00:00 2024-01-13T17:44:28.143 INFO:teuthology.orchestra.run.smithi084.stdout:(27/106): rbd-mirror-17.2.7-268.g6441305d.el8.x 13 MB/s | 3.5 MB 00:00 2024-01-13T17:44:28.176 INFO:teuthology.orchestra.run.smithi084.stdout:(28/106): ceph-mgr-cephadm-17.2.7-268.g6441305d 907 kB/s | 121 kB 00:00 2024-01-13T17:44:28.293 INFO:teuthology.orchestra.run.smithi084.stdout:(29/106): ceph-mgr-dashboard-17.2.7-268.g644130 11 MB/s | 1.7 MB 00:00 2024-01-13T17:44:28.368 INFO:teuthology.orchestra.run.smithi084.stdout:(30/106): ceph-mgr-modules-core-17.2.7-268.g644 3.1 MB/s | 238 kB 00:00 2024-01-13T17:44:28.435 INFO:teuthology.orchestra.run.smithi084.stdout:(31/106): ceph-mgr-rook-17.2.7-268.g6441305d.el 712 kB/s | 47 kB 00:00 2024-01-13T17:44:28.494 INFO:teuthology.orchestra.run.smithi084.stdout:(32/106): ceph-prometheus-alerts-17.2.7-268.g64 249 kB/s | 14 kB 00:00 2024-01-13T17:44:28.552 INFO:teuthology.orchestra.run.smithi084.stdout:(33/106): cephadm-17.2.7-268.g6441305d.el8.noar 1.3 MB/s | 80 kB 00:00 2024-01-13T17:44:28.669 INFO:teuthology.orchestra.run.smithi084.stdout:(34/106): ceph-mgr-diskprediction-local-17.2.7- 15 MB/s | 7.4 MB 00:00 2024-01-13T17:44:28.936 INFO:teuthology.orchestra.run.smithi084.stdout:(35/106): jq-1.6-8.el8.x86_64.rpm 529 kB/s | 203 kB 00:00 2024-01-13T17:44:29.078 INFO:teuthology.orchestra.run.smithi084.stdout:(36/106): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2024-01-13T17:44:29.103 INFO:teuthology.orchestra.run.smithi084.stdout:(37/106): librdkafka-1.6.1-1.el8.x86_64.rpm 1.5 MB/s | 677 kB 00:00 2024-01-13T17:44:29.162 INFO:teuthology.orchestra.run.smithi084.stdout:(38/106): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-01-13T17:44:29.371 INFO:teuthology.orchestra.run.smithi084.stdout:(39/106): openblas-0.3.15-4.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2024-01-13T17:44:29.488 INFO:teuthology.orchestra.run.smithi084.stdout:(40/106): openblas-threads-0.3.15-4.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2024-01-13T17:44:29.546 INFO:teuthology.orchestra.run.smithi084.stdout:(41/106): python3-attrs-17.4.0-6.el8.noarch.rpm 301 kB/s | 53 kB 00:00 2024-01-13T17:44:29.630 INFO:teuthology.orchestra.run.smithi084.stdout:(42/106): python3-jinja2-2.10.1-3.el8.noarch.rp 6.3 MB/s | 538 kB 00:00 2024-01-13T17:44:29.697 INFO:teuthology.orchestra.run.smithi084.stdout:(43/106): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2024-01-13T17:44:29.722 INFO:teuthology.orchestra.run.smithi084.stdout:(44/106): python3-jsonpatch-1.21-2.el8.noarch.r 289 kB/s | 27 kB 00:00 2024-01-13T17:44:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:(45/106): python3-jsonpointer-1.10-11.el8.noarc 298 kB/s | 20 kB 00:00 2024-01-13T17:44:29.831 INFO:teuthology.orchestra.run.smithi084.stdout:(46/106): python3-markupsafe-0.23-19.el8.x86_64 583 kB/s | 39 kB 00:00 2024-01-13T17:44:29.856 INFO:teuthology.orchestra.run.smithi084.stdout:(47/106): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-01-13T17:44:29.932 INFO:teuthology.orchestra.run.smithi084.stdout:(48/106): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.9 MB/s | 225 kB 00:00 2024-01-13T17:44:30.057 INFO:teuthology.orchestra.run.smithi084.stdout:(49/106): python3-numpy-1.14.3-10.el8.x86_64.rp 17 MB/s | 3.7 MB 00:00 2024-01-13T17:44:30.074 INFO:teuthology.orchestra.run.smithi084.stdout:(50/106): python3-pluggy-0.6.0-3.el8.noarch.rpm 227 kB/s | 32 kB 00:00 2024-01-13T17:44:30.124 INFO:teuthology.orchestra.run.smithi084.stdout:(51/106): python3-prettytable-0.7.2-14.el8.noar 657 kB/s | 44 kB 00:00 2024-01-13T17:44:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:(52/106): python3-py-1.5.3-4.el8.noarch.rpm 5.5 MB/s | 472 kB 00:00 2024-01-13T17:44:30.191 INFO:teuthology.orchestra.run.smithi084.stdout:(53/106): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.5 MB/s | 103 kB 00:00 2024-01-13T17:44:30.225 INFO:teuthology.orchestra.run.smithi084.stdout:(54/106): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.8 MB/s | 126 kB 00:00 2024-01-13T17:44:30.267 INFO:teuthology.orchestra.run.smithi084.stdout:(55/106): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2024-01-13T17:44:30.317 INFO:teuthology.orchestra.run.smithi084.stdout:(56/106): python3-pytest-3.4.2-11.el8.noarch.rp 14 MB/s | 1.3 MB 00:00 2024-01-13T17:44:30.343 INFO:teuthology.orchestra.run.smithi084.stdout:(57/106): python3-pytz-2017.2-11.el8.noarch.rpm 757 kB/s | 57 kB 00:00 2024-01-13T17:44:30.449 INFO:teuthology.orchestra.run.smithi084.stdout:(58/106): python3-werkzeug-0.12.2-4.el8.noarch. 4.2 MB/s | 457 kB 00:00 2024-01-13T17:44:30.535 INFO:teuthology.orchestra.run.smithi084.stdout:(59/106): socat-1.7.4.1-1.el8.x86_64.rpm 3.7 MB/s | 323 kB 00:00 2024-01-13T17:44:30.610 INFO:teuthology.orchestra.run.smithi084.stdout:(60/106): xmlstarlet-1.6.1-20.el8.x86_64.rpm 944 kB/s | 71 kB 00:00 2024-01-13T17:44:30.827 INFO:teuthology.orchestra.run.smithi084.stdout:(61/106): python3-scipy-1.0.0-21.module_el8+762 28 MB/s | 14 MB 00:00 2024-01-13T17:44:34.019 INFO:teuthology.orchestra.run.smithi084.stdout:(62/106): ceph-test-17.2.7-268.g6441305d.el8.x8 6.4 MB/s | 52 MB 00:08 2024-01-13T17:48:31.339 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] fuse-2.9.7-17.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/fuse-2.9.7-17.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:48:31.339 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] libgfortran-8.5.0-21.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/libgfortran-8.5.0-21.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:48:31.339 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] libquadmath-8.5.0-21.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/libquadmath-8.5.0-21.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:48:31.452 INFO:teuthology.orchestra.run.smithi099.stdout:(63/106): fuse-2.9.7-17.el8.x86_64.rpm 344 B/s | 83 kB 04:07 2024-01-13T17:48:31.477 INFO:teuthology.orchestra.run.smithi099.stdout:(64/106): libquadmath-8.5.0-21.el8.x86_64.rpm 715 B/s | 172 kB 04:06 2024-01-13T17:48:31.503 INFO:teuthology.orchestra.run.smithi099.stdout:(65/106): librabbitmq-0.9.0-4.el8.x86_64.rpm 935 kB/s | 47 kB 00:00 2024-01-13T17:48:31.544 INFO:teuthology.orchestra.run.smithi099.stdout:(66/106): libgfortran-8.5.0-21.el8.x86_64.rpm 2.6 kB/s | 645 kB 04:07 2024-01-13T17:48:31.570 INFO:teuthology.orchestra.run.smithi099.stdout:(67/106): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.6 MB/s | 249 kB 00:00 2024-01-13T17:48:31.637 INFO:teuthology.orchestra.run.smithi099.stdout:(68/106): python3-cryptography-3.2.1-7.el8.x86_ 4.7 MB/s | 641 kB 00:00 2024-01-13T17:48:31.662 INFO:teuthology.orchestra.run.smithi099.stdout:(69/106): python3-jwt-1.6.1-2.el8.noarch.rpm 364 kB/s | 43 kB 00:00 2024-01-13T17:48:31.687 INFO:teuthology.orchestra.run.smithi099.stdout:(70/106): python3-oauthlib-2.1.0-1.el8.noarch.r 1.3 MB/s | 155 kB 00:00 2024-01-13T17:48:31.745 INFO:teuthology.orchestra.run.smithi099.stdout:(71/106): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2024-01-13T17:48:31.771 INFO:teuthology.orchestra.run.smithi099.stdout:(72/106): python3-requests-oauthlib-1.0.0-1.el8 392 kB/s | 43 kB 00:00 2024-01-13T17:48:32.071 INFO:teuthology.orchestra.run.smithi099.stdout:(73/106): liboath-2.6.2-3.el8.x86_64.rpm 181 kB/s | 59 kB 00:00 2024-01-13T17:48:32.096 INFO:teuthology.orchestra.run.smithi099.stdout:(74/106): libunwind-1.3.1-3.el8.x86_64.rpm 231 kB/s | 75 kB 00:00 2024-01-13T17:48:32.196 INFO:teuthology.orchestra.run.smithi099.stdout:(75/106): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2024-01-13T17:48:32.330 INFO:teuthology.orchestra.run.smithi099.stdout:(76/106): python3-asyncssh-2.7.0-2.el8.noarch.r 1.8 MB/s | 476 kB 00:00 2024-01-13T17:48:32.372 INFO:teuthology.orchestra.run.smithi099.stdout:(77/106): gperftools-libs-2.7-9.el8.x86_64.rpm 489 kB/s | 306 kB 00:00 2024-01-13T17:48:32.438 INFO:teuthology.orchestra.run.smithi099.stdout:(78/106): python3-beautifulsoup4-4.6.3-2.el8.1. 769 kB/s | 185 kB 00:00 2024-01-13T17:48:32.623 INFO:teuthology.orchestra.run.smithi099.stdout:(79/106): python3-cheroot-8.5.2-1.el8.noarch.rp 936 kB/s | 173 kB 00:00 2024-01-13T17:48:32.673 INFO:teuthology.orchestra.run.smithi099.stdout:(80/106): python3-cachetools-3.1.1-4.el8.noarch 96 kB/s | 33 kB 00:00 2024-01-13T17:48:32.715 INFO:teuthology.orchestra.run.smithi099.stdout:(81/106): python3-certifi-2018.10.15-7.el8.noar 48 kB/s | 16 kB 00:00 2024-01-13T17:48:32.740 INFO:teuthology.orchestra.run.smithi099.stdout:(82/106): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2024-01-13T17:48:32.782 INFO:teuthology.orchestra.run.smithi099.stdout:(83/106): python3-cherrypy-18.4.0-1.el8.noarch. 2.4 MB/s | 384 kB 00:00 2024-01-13T17:48:32.799 INFO:teuthology.orchestra.run.smithi099.stdout:(84/106): python3-jaraco-6.2-6.el8.noarch.rpm 132 kB/s | 11 kB 00:00 2024-01-13T17:48:32.816 INFO:teuthology.orchestra.run.smithi099.stdout:(85/106): python3-jaraco-functools-2.0-4.el8.no 232 kB/s | 18 kB 00:00 2024-01-13T17:48:32.866 INFO:teuthology.orchestra.run.smithi099.stdout:(86/106): python3-logutils-0.3.5-11.el8.noarch. 730 kB/s | 49 kB 00:00 2024-01-13T17:48:32.883 INFO:teuthology.orchestra.run.smithi099.stdout:(87/106): python3-more-itertools-7.2.0-3.el8.no 876 kB/s | 59 kB 00:00 2024-01-13T17:48:32.908 INFO:teuthology.orchestra.run.smithi099.stdout:(88/106): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2024-01-13T17:48:33.017 INFO:teuthology.orchestra.run.smithi099.stdout:(89/106): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2024-01-13T17:48:33.042 INFO:teuthology.orchestra.run.smithi099.stdout:(90/106): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2024-01-13T17:48:33.092 INFO:teuthology.orchestra.run.smithi099.stdout:(91/106): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2024-01-13T17:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout:(92/106): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2024-01-13T17:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout:(93/106): python3-kubernetes-11.0.0-6.el8.noarc 2.8 MB/s | 1.2 MB 00:00 2024-01-13T17:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout:(94/106): python3-rsa-4.9-2.el8.noarch.rpm 480 kB/s | 64 kB 00:00 2024-01-13T17:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout:(95/106): python3-simplegeneric-0.8.1-17.el8.no 223 kB/s | 19 kB 00:00 2024-01-13T17:48:33.260 INFO:teuthology.orchestra.run.smithi099.stdout:(96/106): python3-singledispatch-3.4.0.3-18.el8 408 kB/s | 24 kB 00:00 2024-01-13T17:48:33.277 INFO:teuthology.orchestra.run.smithi099.stdout:(97/106): python3-tempora-1.14.1-5.el8.noarch.r 579 kB/s | 29 kB 00:00 2024-01-13T17:48:33.302 INFO:teuthology.orchestra.run.smithi099.stdout:(98/106): python3-trustme-0.6.0-4.el8.noarch.rp 469 kB/s | 27 kB 00:00 2024-01-13T17:48:33.345 INFO:teuthology.orchestra.run.smithi099.stdout:(99/106): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2024-01-13T17:48:33.361 INFO:teuthology.orchestra.run.smithi099.stdout:(100/106): python3-websocket-client-0.56.0-5.el 1.0 MB/s | 61 kB 00:00 2024-01-13T17:48:33.387 INFO:teuthology.orchestra.run.smithi099.stdout:(101/106): python3-webob-1.8.5-1.el8.1.noarch.r 2.2 MB/s | 251 kB 00:00 2024-01-13T17:48:33.412 INFO:teuthology.orchestra.run.smithi099.stdout:(102/106): python3-webtest-2.0.33-1.el8.noarch. 1.2 MB/s | 85 kB 00:00 2024-01-13T17:48:33.437 INFO:teuthology.orchestra.run.smithi099.stdout:(103/106): python3-zc-lockfile-2.0-2.el8.noarch 304 kB/s | 23 kB 00:00 2024-01-13T17:48:33.913 INFO:teuthology.orchestra.run.smithi099.stdout:(104/106): librados2-17.2.7-268.g6441305d.el8.x 6.9 MB/s | 3.5 MB 00:00 2024-01-13T17:48:33.963 INFO:teuthology.orchestra.run.smithi099.stdout:(105/106): librbd1-17.2.7-268.g6441305d.el8.x86 6.8 MB/s | 3.6 MB 00:00 2024-01-13T17:48:34.079 INFO:teuthology.orchestra.run.smithi099.stdout:(106/106): thrift-0.13.0-2.el8.x86_64.rpm 2.5 MB/s | 1.7 MB 00:00 2024-01-13T17:48:34.085 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-01-13T17:48:34.085 INFO:teuthology.orchestra.run.smithi099.stdout:Total 784 kB/s | 197 MB 04:17 2024-01-13T17:48:34.594 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-01-13T17:48:34.684 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-01-13T17:48:34.685 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-01-13T17:48:35.866 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-01-13T17:48:35.870 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-01-13T17:48:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-01-13T17:48:40.195 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/108 2024-01-13T17:48:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/108 2024-01-13T17:48:40.523 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] libgfortran-8.5.0-21.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/libgfortran-8.5.0-21.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:48:40.526 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] fuse-2.9.7-17.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/fuse-2.9.7-17.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:48:40.582 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 3/108 2024-01-13T17:48:40.642 INFO:teuthology.orchestra.run.smithi084.stdout:(63/106): fuse-2.9.7-17.el8.x86_64.rpm 340 B/s | 83 kB 04:10 2024-01-13T17:48:40.734 INFO:teuthology.orchestra.run.smithi084.stdout:(64/106): libgfortran-8.5.0-21.el8.x86_64.rpm 2.6 kB/s | 645 kB 04:09 2024-01-13T17:48:40.774 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/108 2024-01-13T17:48:41.138 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/108 2024-01-13T17:48:41.315 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:17.2.7-268.g6441305d.el8.x86_64 5/108 2024-01-13T17:48:41.708 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:17.2.7-268.g6441305d.el8.x86_64 5/108 2024-01-13T17:48:41.924 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:17.2.7-268.g6441305d.el8.x86_64 6/108 2024-01-13T17:48:42.053 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:17.2.7-268.g6441305d.el8.x86_64 6/108 2024-01-13T17:48:42.224 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:17.2.7-268.g6441305d.el8.x86_64 7/108 2024-01-13T17:48:42.315 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:17.2.7-268.g6441305d.el8.x86_64 7/108 2024-01-13T17:48:42.575 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:17.2.7-268.g6441305d.el8.x86_64 8/108 2024-01-13T17:48:43.253 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/108 2024-01-13T17:48:43.423 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:17.2.7-268.g6441305d.el8.x86_64 10/108 2024-01-13T17:48:43.495 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:17.2.7-268.g6441305d.el8.x86_64 10/108 2024-01-13T17:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/108 2024-01-13T17:48:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/108 2024-01-13T17:48:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:17.2.7-268.g6441305d.el8.x86_64 13/108 2024-01-13T17:48:44.187 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:17.2.7-268.g6441305d.el8.x86_64 13/108 2024-01-13T17:48:44.340 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:17.2.7-268.g6441305d.el8.x86_ 14/108 2024-01-13T17:48:44.440 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:17.2.7-268.g6441305d.el8.x86_ 14/108 2024-01-13T17:48:44.682 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 15/108 2024-01-13T17:48:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 16/108 2024-01-13T17:48:44.943 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 16/108 2024-01-13T17:48:45.056 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 17/108 2024-01-13T17:48:45.640 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 17/108 2024-01-13T17:48:45.798 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.15-4.el8.x86_64 18/108 2024-01-13T17:48:46.410 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 18/108 2024-01-13T17:48:46.547 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 19/108 2024-01-13T17:48:47.236 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 19/108 2024-01-13T17:48:47.564 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/108 2024-01-13T17:48:47.803 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 21/108 2024-01-13T17:48:47.968 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 22/108 2024-01-13T17:48:48.129 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/108 2024-01-13T17:48:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:17.2.7-268.g6441305d.el8 24/108 2024-01-13T17:48:48.579 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:17.2.7-268.g6441305d.el8.x86_64 25/108 2024-01-13T17:48:48.714 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] libquadmath-8.5.0-21.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/libquadmath-8.5.0-21.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:48:48.849 INFO:teuthology.orchestra.run.smithi084.stdout:(65/106): libquadmath-8.5.0-21.el8.x86_64.rpm 693 B/s | 172 kB 04:14 2024-01-13T17:48:48.979 INFO:teuthology.orchestra.run.smithi084.stdout:(66/106): python3-cryptography-3.2.1-7.el8.x86_ 4.8 MB/s | 641 kB 00:00 2024-01-13T17:48:49.033 INFO:teuthology.orchestra.run.smithi084.stdout:(67/106): python3-jwt-1.6.1-2.el8.noarch.rpm 786 kB/s | 43 kB 00:00 2024-01-13T17:48:49.075 INFO:teuthology.orchestra.run.smithi084.stdout:(68/106): python3-oauthlib-2.1.0-1.el8.noarch.r 3.7 MB/s | 155 kB 00:00 2024-01-13T17:48:49.117 INFO:teuthology.orchestra.run.smithi084.stdout:(69/106): python3-pycparser-2.14-14.el8.noarch. 2.6 MB/s | 109 kB 00:00 2024-01-13T17:48:49.158 INFO:teuthology.orchestra.run.smithi084.stdout:(70/106): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2024-01-13T17:48:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 26/108 2024-01-13T17:48:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 27/108 2024-01-13T17:48:49.826 INFO:teuthology.orchestra.run.smithi084.stdout:(71/106): gperftools-libs-2.7-9.el8.x86_64.rpm 459 kB/s | 306 kB 00:00 2024-01-13T17:48:49.913 INFO:teuthology.orchestra.run.smithi084.stdout:(72/106): liboath-2.6.2-3.el8.x86_64.rpm 678 kB/s | 59 kB 00:00 2024-01-13T17:48:49.968 INFO:teuthology.orchestra.run.smithi084.stdout:(73/106): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2024-01-13T17:48:50.026 INFO:teuthology.orchestra.run.smithi084.stdout:(74/106): python3-asyncssh-2.7.0-2.el8.noarch.r 8.0 MB/s | 476 kB 00:00 2024-01-13T17:48:50.068 INFO:teuthology.orchestra.run.smithi084.stdout:(75/106): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2024-01-13T17:48:50.108 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 28/108 2024-01-13T17:48:50.110 INFO:teuthology.orchestra.run.smithi084.stdout:(76/106): python3-beautifulsoup4-4.6.3-2.el8.1. 4.4 MB/s | 185 kB 00:00 2024-01-13T17:48:50.152 INFO:teuthology.orchestra.run.smithi084.stdout:(77/106): python3-cachetools-3.1.1-4.el8.noarch 791 kB/s | 33 kB 00:00 2024-01-13T17:48:50.194 INFO:teuthology.orchestra.run.smithi084.stdout:(78/106): python3-certifi-2018.10.15-7.el8.noar 391 kB/s | 16 kB 00:00 2024-01-13T17:48:50.236 INFO:teuthology.orchestra.run.smithi084.stdout:(79/106): python3-cheroot-8.5.2-1.el8.noarch.rp 4.1 MB/s | 173 kB 00:00 2024-01-13T17:48:50.286 INFO:teuthology.orchestra.run.smithi084.stdout:(80/106): python3-cherrypy-18.4.0-1.el8.noarch. 7.5 MB/s | 384 kB 00:00 2024-01-13T17:48:50.313 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/108 2024-01-13T17:48:50.371 INFO:teuthology.orchestra.run.smithi084.stdout:(81/106): python3-google-auth-1.1.1-10.el8.noar 957 kB/s | 81 kB 00:00 2024-01-13T17:48:50.420 INFO:teuthology.orchestra.run.smithi084.stdout:(82/106): python3-jaraco-6.2-6.el8.noarch.rpm 229 kB/s | 11 kB 00:00 2024-01-13T17:48:50.464 INFO:teuthology.orchestra.run.smithi084.stdout:(83/106): python3-jaraco-functools-2.0-4.el8.no 422 kB/s | 18 kB 00:00 2024-01-13T17:48:50.546 INFO:teuthology.orchestra.run.smithi084.stdout:(84/106): python3-kubernetes-11.0.0-6.el8.noarc 14 MB/s | 1.2 MB 00:00 2024-01-13T17:48:50.588 INFO:teuthology.orchestra.run.smithi084.stdout:(85/106): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2024-01-13T17:48:50.629 INFO:teuthology.orchestra.run.smithi084.stdout:(86/106): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2024-01-13T17:48:50.671 INFO:teuthology.orchestra.run.smithi084.stdout:(87/106): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2024-01-13T17:48:50.721 INFO:teuthology.orchestra.run.smithi084.stdout:(88/106): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2024-01-13T17:48:50.763 INFO:teuthology.orchestra.run.smithi084.stdout:(89/106): python3-portend-2.6-1.el8.noarch.rpm 374 kB/s | 16 kB 00:00 2024-01-13T17:48:50.855 INFO:teuthology.orchestra.run.smithi084.stdout:(90/106): python3-repoze-lru-0.7-6.el8.noarch.r 367 kB/s | 34 kB 00:00 2024-01-13T17:48:50.897 INFO:teuthology.orchestra.run.smithi084.stdout:(91/106): python3-routes-2.4.1-12.el8.noarch.rp 4.6 MB/s | 196 kB 00:00 2024-01-13T17:48:50.939 INFO:teuthology.orchestra.run.smithi084.stdout:(92/106): python3-rsa-4.9-2.el8.noarch.rpm 1.5 MB/s | 64 kB 00:00 2024-01-13T17:48:50.981 INFO:teuthology.orchestra.run.smithi084.stdout:(93/106): python3-simplegeneric-0.8.1-17.el8.no 451 kB/s | 19 kB 00:00 2024-01-13T17:48:51.023 INFO:teuthology.orchestra.run.smithi084.stdout:(94/106): python3-singledispatch-3.4.0.3-18.el8 573 kB/s | 24 kB 00:00 2024-01-13T17:48:51.065 INFO:teuthology.orchestra.run.smithi084.stdout:(95/106): python3-tempora-1.14.1-5.el8.noarch.r 705 kB/s | 29 kB 00:00 2024-01-13T17:48:51.107 INFO:teuthology.orchestra.run.smithi084.stdout:(96/106): python3-trustme-0.6.0-4.el8.noarch.rp 660 kB/s | 27 kB 00:00 2024-01-13T17:48:51.149 INFO:teuthology.orchestra.run.smithi084.stdout:(97/106): python3-waitress-1.4.3-1.el8.noarch.r 6.0 MB/s | 255 kB 00:00 2024-01-13T17:48:51.191 INFO:teuthology.orchestra.run.smithi084.stdout:(98/106): python3-webob-1.8.5-1.el8.1.noarch.rp 5.9 MB/s | 251 kB 00:00 2024-01-13T17:48:51.233 INFO:teuthology.orchestra.run.smithi084.stdout:(99/106): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2024-01-13T17:48:51.317 INFO:teuthology.orchestra.run.smithi084.stdout:(100/106): python3-webtest-2.0.33-1.el8.noarch. 1.0 MB/s | 85 kB 00:00 2024-01-13T17:48:51.358 INFO:teuthology.orchestra.run.smithi084.stdout:(101/106): python3-zc-lockfile-2.0-2.el8.noarch 552 kB/s | 23 kB 00:00 2024-01-13T17:48:51.467 INFO:teuthology.orchestra.run.smithi084.stdout:(102/106): thrift-0.13.0-2.el8.x86_64.rpm 16 MB/s | 1.7 MB 00:00 2024-01-13T17:48:51.868 INFO:teuthology.orchestra.run.smithi084.stdout:(103/106): librados2-17.2.7-268.g6441305d.el8.x 8.7 MB/s | 3.5 MB 00:00 2024-01-13T17:48:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/108 2024-01-13T17:48:52.134 INFO:teuthology.orchestra.run.smithi084.stdout:(104/106): librbd1-17.2.7-268.g6441305d.el8.x86 13 MB/s | 3.6 MB 00:00 2024-01-13T17:48:52.383 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 30/108 2024-01-13T17:48:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/108 2024-01-13T17:48:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/108 2024-01-13T17:48:53.031 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:17.2.7-268.g6441305d.el8.x86_64 33/108 2024-01-13T17:48:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:17.2.7-268.g6441305d.el8.x86_64 34/108 2024-01-13T17:48:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:17.2.7-268.g6441305d.el8.x86_64 35/108 2024-01-13T17:48:53.640 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 36/108 2024-01-13T17:48:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 37/108 2024-01-13T17:48:54.161 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 38/108 2024-01-13T17:48:54.342 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 39/108 2024-01-13T17:48:54.489 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 40/108 2024-01-13T17:48:54.678 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 41/108 2024-01-13T17:48:54.906 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 42/108 2024-01-13T17:48:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 43/108 2024-01-13T17:48:55.273 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 44/108 2024-01-13T17:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 45/108 2024-01-13T17:48:55.632 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 46/108 2024-01-13T17:48:55.867 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 47/108 2024-01-13T17:48:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-2.6-1.el8.noarch 48/108 2024-01-13T17:48:56.320 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 49/108 2024-01-13T17:48:56.536 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 50/108 2024-01-13T17:48:56.768 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 51/108 2024-01-13T17:48:57.031 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 52/108 2024-01-13T17:48:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 53/108 2024-01-13T17:48:57.646 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 54/108 2024-01-13T17:48:57.835 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 55/108 2024-01-13T17:48:58.411 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 56/108 2024-01-13T17:48:58.651 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 57/108 2024-01-13T17:48:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 58/108 2024-01-13T17:48:59.272 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 59/108 2024-01-13T17:48:59.516 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 60/108 2024-01-13T17:48:59.764 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 61/108 2024-01-13T17:49:00.007 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 62/108 2024-01-13T17:49:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 63/108 2024-01-13T17:49:01.451 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 64/108 2024-01-13T17:49:01.693 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 65/108 2024-01-13T17:49:01.944 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 66/108 2024-01-13T17:49:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 67/108 2024-01-13T17:49:02.495 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 68/108 2024-01-13T17:49:02.787 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/108 2024-01-13T17:49:03.003 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.7-17.el8.x86_64 70/108 2024-01-13T17:49:03.223 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 71/108 2024-01-13T17:49:03.539 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 72/108 2024-01-13T17:49:03.810 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-py-1.5.3-4.el8.noarch 73/108 2024-01-13T17:49:03.993 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/108 2024-01-13T17:49:04.233 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pluggy-0.6.0-3.el8.noarch 75/108 2024-01-13T17:49:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 76/108 2024-01-13T17:49:04.635 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 77/108 2024-01-13T17:49:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-attrs-17.4.0-6.el8.noarch 78/108 2024-01-13T17:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 79/108 2024-01-13T17:49:05.144 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 79/108 2024-01-13T17:49:05.336 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : jq-1.6-8.el8.x86_64 80/108 2024-01-13T17:49:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:17.2.7-268.g6441305d.el8.noarch 81/108 2024-01-13T17:49:06.013 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:17.2.7-268.g6441305d.el8.noarch 81/108 2024-01-13T17:49:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-268.g6441305d.el 82/108 2024-01-13T17:49:06.331 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-268.g6441305d.e 83/108 2024-01-13T17:49:06.585 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:17.2.7-268.g6441305d.el8.x 84/108 2024-01-13T17:49:09.231 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 85/108 2024-01-13T17:49:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 85/108 2024-01-13T17:49:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 85/108 2024-01-13T17:49:10.293 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:17.2.7-268.g6441305d.el8.x86_64 86/108 2024-01-13T17:49:10.380 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:17.2.7-268.g6441305d.el8.x86_64 86/108 2024-01-13T17:49:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:17.2.7-268.g6441305d.el8.x86_64 87/108 2024-01-13T17:49:29.929 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:17.2.7-268.g6441305d.el8.x86_64 87/108 2024-01-13T17:49:29.929 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-01-13T17:49:29.929 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-01-13T17:49:29.929 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /dev 2024-01-13T17:49:29.929 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /run 2024-01-13T17:49:29.929 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-01-13T17:49:29.929 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-01-13T17:49:29.929 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-01-13T17:49:29.929 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-01-13T17:49:29.929 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /dev 2024-01-13T17:49:29.929 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:49:30.179 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-268.g6441305d.el8.noar 88/108 2024-01-13T17:49:30.386 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-268.g6441305d.el8.noar 88/108 2024-01-13T17:49:30.596 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-268.g6441305d.el8.no 89/108 2024-01-13T17:49:31.554 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-268.g6441305d.el8.no 89/108 2024-01-13T17:49:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-268.g6441 90/108 2024-01-13T17:49:31.835 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-268.g6441 90/108 2024-01-13T17:49:32.252 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-268.g6441305d.el8 91/108 2024-01-13T17:49:32.471 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:17.2.7-268.g6441305d.el8.x86_64 92/108 2024-01-13T17:49:32.506 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:17.2.7-268.g6441305d.el8.x86_64 92/108 2024-01-13T17:49:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:17.2.7-268.g6441305d.el8.noarch 93/108 2024-01-13T17:49:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-268.g6441305d.el8.noarch 93/108 2024-01-13T17:49:33.071 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:17.2.7-268.g6441305d.el8.x86_64 94/108 2024-01-13T17:49:33.459 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:17.2.7-268.g6441305d.el8.x86_64 94/108 2024-01-13T17:49:33.662 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:17.2.7-268.g6441305d.el8.x86_64 95/108 2024-01-13T17:49:35.134 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:17.2.7-268.g6441305d.el8.x86_64 95/108 2024-01-13T17:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:17.2.7-268.g6441305d.el8.x86_64 96/108 2024-01-13T17:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:17.2.7-268.g6441305d.el8.x86_64 96/108 2024-01-13T17:49:36.963 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:17.2.7-268.g6441305d.el8.x86_64 97/108 2024-01-13T17:49:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:17.2.7-268.g6441305d.el8.x86_64 98/108 2024-01-13T17:49:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-268.g6441305d.el8.x86_64 98/108 2024-01-13T17:49:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-268.g644130 99/108 2024-01-13T17:49:37.841 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-268.g644130 99/108 2024-01-13T17:49:38.011 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:17.2.7-268.g6441305d.el8.x86_64 100/108 2024-01-13T17:49:42.911 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:17.2.7-268.g6441305d.el8.x86_64 100/108 2024-01-13T17:49:43.492 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:17.2.7-268.g6441305d.el8.x86_64 101/108 2024-01-13T17:49:43.817 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytest-3.4.2-11.el8.noarch 102/108 2024-01-13T17:49:44.005 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:17.2.7-268.g6441305d.el8.x86_64 103/108 2024-01-13T17:49:44.251 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:17.2.7-268.g6441305d.el8.x86_6 104/108 2024-01-13T17:49:44.450 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:17.2.7-268.g6441305d.el8.x86_64 105/108 2024-01-13T17:49:44.620 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:17.2.7-268.g6441305d.el8.x86_64 106/108 2024-01-13T17:49:44.620 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 107/108 2024-01-13T17:49:44.829 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 107/108 2024-01-13T17:49:44.829 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 108/108 2024-01-13T17:49:45.623 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 108/108 2024-01-13T17:49:45.623 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:17.2.7-268.g6441305d.el8.x86_64 1/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:17.2.7-268.g6441305d.el8.x86_64 2/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 3/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:17.2.7-268.g6441305d.el8.x86_64 4/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-268.g644130 5/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:17.2.7-268.g6441305d.el8.x86_64 6/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:17.2.7-268.g6441305d.el8.x86_64 7/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:17.2.7-268.g6441305d.el8.x86_64 8/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:17.2.7-268.g6441305d.el8.x86_64 9/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:17.2.7-268.g6441305d.el8.x86_64 10/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:17.2.7-268.g6441305d.el8.x86_64 11/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:17.2.7-268.g6441305d.el8.x86_64 12/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:17.2.7-268.g6441305d.el8.x86_6 13/108 2024-01-13T17:49:45.624 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:17.2.7-268.g6441305d.el8.x86_64 14/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:17.2.7-268.g6441305d.el8.x86_64 15/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:17.2.7-268.g6441305d.el8.x86_64 16/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:17.2.7-268.g6441305d.el8.x86_ 17/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:17.2.7-268.g6441305d.el8.x86_64 18/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:17.2.7-268.g6441305d.el8 19/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:17.2.7-268.g6441305d.el8.x 20/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:17.2.7-268.g6441305d.el8.x86_64 21/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:17.2.7-268.g6441305d.el8.x86_64 22/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:17.2.7-268.g6441305d.el8.x86_64 23/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:17.2.7-268.g6441305d.el8.x86_64 24/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:17.2.7-268.g6441305d.el8.x86_64 25/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:17.2.7-268.g6441305d.el8.x86_64 26/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:17.2.7-268.g6441305d.el8.x86_64 27/108 2024-01-13T17:49:45.625 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-268.g6441305d.e 28/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-268.g6441305d.el8.noar 29/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-268.g6441305d.el8.no 30/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-268.g6441 31/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-268.g6441305d.el8 32/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:17.2.7-268.g6441305d.el8.noarch 33/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-268.g6441305d.el 34/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:17.2.7-268.g6441305d.el8.noarch 35/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : jq-1.6-8.el8.x86_64 36/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 37/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 38/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 39/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 40/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 41/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-attrs-17.4.0-6.el8.noarch 42/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 43/108 2024-01-13T17:49:45.626 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 44/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 45/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 46/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 47/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 48/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 49/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 50/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pluggy-0.6.0-3.el8.noarch 51/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 52/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-py-1.5.3-4.el8.noarch 53/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 54/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 55/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 56/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytest-3.4.2-11.el8.noarch 57/108 2024-01-13T17:49:45.627 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 58/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 59/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 60/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 61/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 62/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 63/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 64/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 65/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 66/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 67/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 68/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 69/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 70/108 2024-01-13T17:49:45.628 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 71/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 72/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 73/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 74/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 75/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 76/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 77/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 79/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 80/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 81/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 82/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 83/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 84/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 85/108 2024-01-13T17:49:45.629 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 86/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 87/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 88/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 89/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 90/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-2.6-1.el8.noarch 91/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 92/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 93/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 94/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 95/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 96/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 97/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 98/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 99/108 2024-01-13T17:49:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 100/108 2024-01-13T17:49:45.631 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 101/108 2024-01-13T17:49:45.631 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 102/108 2024-01-13T17:49:45.631 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 103/108 2024-01-13T17:49:45.631 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 104/108 2024-01-13T17:49:45.631 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:17.2.7-268.g6441305d.el8.x86_64 105/108 2024-01-13T17:49:45.631 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 106/108 2024-01-13T17:49:45.631 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:17.2.7-268.g6441305d.el8.x86_64 107/108 2024-01-13T17:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 108/108 2024-01-13T17:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-01-13T17:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-01-13T17:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: fuse-2.9.7-17.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: jq-1.6-8.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.2-3.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-01-13T17:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.9.0-4.el8.x86_64 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.3.1-3.el8.x86_64 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma-6.8.2-2.el8.x86_64 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.15-4.el8.x86_64 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs-17.4.0-6.el8.noarch 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.5.1-7.el8.noarch 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-01-13T17:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-6.2-6.el8.noarch 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-01-13T17:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.0.6-14.el8.noarch 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-01-13T17:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pluggy-0.6.0-3.el8.noarch 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-2.6-1.el8.noarch 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-py-1.5.3-4.el8.noarch 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.14-14.el8.noarch 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytest-3.4.2-11.el8.noarch 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2017.2-11.el8.noarch 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.4.1-12.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-01-13T17:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-01-13T17:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-1.el8.x86_64 2024-01-13T17:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.13.0-2.el8.x86_64 2024-01-13T17:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-01-13T17:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-01-13T17:49:47.886 DEBUG:teuthology.parallel:result is None 2024-01-13T17:52:50.414 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] librabbitmq-0.9.0-4.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/librabbitmq-0.9.0-4.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:52:50.415 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] python3-cffi-1.11.5-6.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/python3-cffi-1.11.5-6.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-01-13T17:52:50.666 INFO:teuthology.orchestra.run.smithi084.stdout:(105/106): librabbitmq-0.9.0-4.el8.x86_64.rpm 192 B/s | 47 kB 04:10 2024-01-13T17:52:50.733 INFO:teuthology.orchestra.run.smithi084.stdout:(106/106): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.0 kB/s | 249 kB 04:09 2024-01-13T17:52:50.733 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-01-13T17:52:50.733 INFO:teuthology.orchestra.run.smithi084.stdout:Total 399 kB/s | 197 MB 08:27 2024-01-13T17:52:51.242 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-01-13T17:52:51.333 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-01-13T17:52:51.333 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-01-13T17:52:52.578 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-01-13T17:52:52.581 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-01-13T17:52:56.380 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-01-13T17:52:56.737 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/108 2024-01-13T17:52:56.916 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/108 2024-01-13T17:52:57.112 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 3/108 2024-01-13T17:52:57.295 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/108 2024-01-13T17:52:57.680 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/108 2024-01-13T17:52:57.878 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:17.2.7-268.g6441305d.el8.x86_64 5/108 2024-01-13T17:52:58.281 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:17.2.7-268.g6441305d.el8.x86_64 5/108 2024-01-13T17:52:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:17.2.7-268.g6441305d.el8.x86_64 6/108 2024-01-13T17:52:58.623 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:17.2.7-268.g6441305d.el8.x86_64 6/108 2024-01-13T17:52:58.795 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:17.2.7-268.g6441305d.el8.x86_64 7/108 2024-01-13T17:52:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:17.2.7-268.g6441305d.el8.x86_64 7/108 2024-01-13T17:52:59.121 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:17.2.7-268.g6441305d.el8.x86_64 8/108 2024-01-13T17:52:59.773 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/108 2024-01-13T17:52:59.911 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:17.2.7-268.g6441305d.el8.x86_64 10/108 2024-01-13T17:52:59.971 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:17.2.7-268.g6441305d.el8.x86_64 10/108 2024-01-13T17:53:00.172 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/108 2024-01-13T17:53:00.373 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/108 2024-01-13T17:53:00.511 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:17.2.7-268.g6441305d.el8.x86_64 13/108 2024-01-13T17:53:00.615 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:17.2.7-268.g6441305d.el8.x86_64 13/108 2024-01-13T17:53:00.769 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:17.2.7-268.g6441305d.el8.x86_ 14/108 2024-01-13T17:53:00.886 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:17.2.7-268.g6441305d.el8.x86_ 14/108 2024-01-13T17:53:01.098 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 15/108 2024-01-13T17:53:01.228 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 16/108 2024-01-13T17:53:01.345 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 16/108 2024-01-13T17:53:01.486 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 17/108 2024-01-13T17:53:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 17/108 2024-01-13T17:53:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.15-4.el8.x86_64 18/108 2024-01-13T17:53:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 18/108 2024-01-13T17:53:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 19/108 2024-01-13T17:53:03.647 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 19/108 2024-01-13T17:53:03.985 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/108 2024-01-13T17:53:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 21/108 2024-01-13T17:53:04.372 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 22/108 2024-01-13T17:53:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/108 2024-01-13T17:53:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:17.2.7-268.g6441305d.el8 24/108 2024-01-13T17:53:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:17.2.7-268.g6441305d.el8.x86_64 25/108 2024-01-13T17:53:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 26/108 2024-01-13T17:53:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 27/108 2024-01-13T17:53:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 28/108 2024-01-13T17:53:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/108 2024-01-13T17:53:08.438 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/108 2024-01-13T17:53:08.728 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 30/108 2024-01-13T17:53:08.925 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/108 2024-01-13T17:53:09.121 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/108 2024-01-13T17:53:09.352 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:17.2.7-268.g6441305d.el8.x86_64 33/108 2024-01-13T17:53:09.530 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:17.2.7-268.g6441305d.el8.x86_64 34/108 2024-01-13T17:53:09.742 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:17.2.7-268.g6441305d.el8.x86_64 35/108 2024-01-13T17:53:09.919 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 36/108 2024-01-13T17:53:10.292 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 37/108 2024-01-13T17:53:10.515 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 38/108 2024-01-13T17:53:10.688 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 39/108 2024-01-13T17:53:10.844 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 40/108 2024-01-13T17:53:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 41/108 2024-01-13T17:53:11.227 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 42/108 2024-01-13T17:53:11.426 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 43/108 2024-01-13T17:53:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 44/108 2024-01-13T17:53:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 45/108 2024-01-13T17:53:11.886 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 46/108 2024-01-13T17:53:12.126 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 47/108 2024-01-13T17:53:12.312 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-2.6-1.el8.noarch 48/108 2024-01-13T17:53:12.500 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 49/108 2024-01-13T17:53:12.700 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 50/108 2024-01-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 51/108 2024-01-13T17:53:13.134 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 52/108 2024-01-13T17:53:13.446 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 53/108 2024-01-13T17:53:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 54/108 2024-01-13T17:53:13.928 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 55/108 2024-01-13T17:53:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 56/108 2024-01-13T17:53:14.385 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 57/108 2024-01-13T17:53:14.729 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 58/108 2024-01-13T17:53:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 59/108 2024-01-13T17:53:15.216 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 60/108 2024-01-13T17:53:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 61/108 2024-01-13T17:53:15.695 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 62/108 2024-01-13T17:53:16.745 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 63/108 2024-01-13T17:53:17.106 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 64/108 2024-01-13T17:53:17.349 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 65/108 2024-01-13T17:53:17.598 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 66/108 2024-01-13T17:53:17.887 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 67/108 2024-01-13T17:53:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 68/108 2024-01-13T17:53:18.375 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/108 2024-01-13T17:53:18.592 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.7-17.el8.x86_64 70/108 2024-01-13T17:53:18.803 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 71/108 2024-01-13T17:53:19.092 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 72/108 2024-01-13T17:53:19.365 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-py-1.5.3-4.el8.noarch 73/108 2024-01-13T17:53:19.531 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/108 2024-01-13T17:53:19.730 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pluggy-0.6.0-3.el8.noarch 75/108 2024-01-13T17:53:19.939 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 76/108 2024-01-13T17:53:20.123 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 77/108 2024-01-13T17:53:20.351 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-attrs-17.4.0-6.el8.noarch 78/108 2024-01-13T17:53:20.507 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 79/108 2024-01-13T17:53:20.586 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 79/108 2024-01-13T17:53:20.765 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.6-8.el8.x86_64 80/108 2024-01-13T17:53:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:17.2.7-268.g6441305d.el8.noarch 81/108 2024-01-13T17:53:21.780 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:17.2.7-268.g6441305d.el8.noarch 81/108 2024-01-13T17:53:21.897 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-268.g6441305d.el 82/108 2024-01-13T17:53:22.079 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-268.g6441305d.e 83/108 2024-01-13T17:53:22.290 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:17.2.7-268.g6441305d.el8.x 84/108 2024-01-13T17:53:24.924 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 85/108 2024-01-13T17:53:25.148 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 85/108 2024-01-13T17:53:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 85/108 2024-01-13T17:53:25.993 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:17.2.7-268.g6441305d.el8.x86_64 86/108 2024-01-13T17:53:26.094 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:17.2.7-268.g6441305d.el8.x86_64 86/108 2024-01-13T17:53:26.247 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:17.2.7-268.g6441305d.el8.x86_64 87/108 2024-01-13T17:53:45.734 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:17.2.7-268.g6441305d.el8.x86_64 87/108 2024-01-13T17:53:45.734 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-01-13T17:53:45.734 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-01-13T17:53:45.734 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2024-01-13T17:53:45.734 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /run 2024-01-13T17:53:45.735 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-01-13T17:53:45.735 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-01-13T17:53:45.735 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-01-13T17:53:45.735 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-01-13T17:53:45.735 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2024-01-13T17:53:45.735 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:53:46.009 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-268.g6441305d.el8.noar 88/108 2024-01-13T17:53:46.217 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-268.g6441305d.el8.noar 88/108 2024-01-13T17:53:46.429 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-268.g6441305d.el8.no 89/108 2024-01-13T17:53:47.389 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-268.g6441305d.el8.no 89/108 2024-01-13T17:53:47.584 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-268.g6441 90/108 2024-01-13T17:53:47.673 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-268.g6441 90/108 2024-01-13T17:53:48.049 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-268.g6441305d.el8 91/108 2024-01-13T17:53:48.246 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:17.2.7-268.g6441305d.el8.x86_64 92/108 2024-01-13T17:53:48.281 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:17.2.7-268.g6441305d.el8.x86_64 92/108 2024-01-13T17:53:48.467 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:17.2.7-268.g6441305d.el8.noarch 93/108 2024-01-13T17:53:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-268.g6441305d.el8.noarch 93/108 2024-01-13T17:53:48.826 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:17.2.7-268.g6441305d.el8.x86_64 94/108 2024-01-13T17:53:49.220 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:17.2.7-268.g6441305d.el8.x86_64 94/108 2024-01-13T17:53:49.384 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:17.2.7-268.g6441305d.el8.x86_64 95/108 2024-01-13T17:53:50.856 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:17.2.7-268.g6441305d.el8.x86_64 95/108 2024-01-13T17:53:51.062 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:17.2.7-268.g6441305d.el8.x86_64 96/108 2024-01-13T17:53:51.082 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:17.2.7-268.g6441305d.el8.x86_64 96/108 2024-01-13T17:53:52.677 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:17.2.7-268.g6441305d.el8.x86_64 97/108 2024-01-13T17:53:52.880 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:17.2.7-268.g6441305d.el8.x86_64 98/108 2024-01-13T17:53:52.966 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-268.g6441305d.el8.x86_64 98/108 2024-01-13T17:53:53.166 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-268.g644130 99/108 2024-01-13T17:53:53.521 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-268.g644130 99/108 2024-01-13T17:53:53.708 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:17.2.7-268.g6441305d.el8.x86_64 100/108 2024-01-13T17:53:58.624 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:17.2.7-268.g6441305d.el8.x86_64 100/108 2024-01-13T17:53:59.203 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:17.2.7-268.g6441305d.el8.x86_64 101/108 2024-01-13T17:53:59.564 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytest-3.4.2-11.el8.noarch 102/108 2024-01-13T17:53:59.760 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:17.2.7-268.g6441305d.el8.x86_64 103/108 2024-01-13T17:53:59.956 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:17.2.7-268.g6441305d.el8.x86_6 104/108 2024-01-13T17:54:00.147 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:17.2.7-268.g6441305d.el8.x86_64 105/108 2024-01-13T17:54:00.316 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:17.2.7-268.g6441305d.el8.x86_64 106/108 2024-01-13T17:54:00.316 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 107/108 2024-01-13T17:54:00.551 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 107/108 2024-01-13T17:54:00.551 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 108/108 2024-01-13T17:54:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 108/108 2024-01-13T17:54:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:17.2.7-268.g6441305d.el8.x86_64 1/108 2024-01-13T17:54:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:17.2.7-268.g6441305d.el8.x86_64 2/108 2024-01-13T17:54:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 3/108 2024-01-13T17:54:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:17.2.7-268.g6441305d.el8.x86_64 4/108 2024-01-13T17:54:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-268.g644130 5/108 2024-01-13T17:54:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:17.2.7-268.g6441305d.el8.x86_64 6/108 2024-01-13T17:54:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:17.2.7-268.g6441305d.el8.x86_64 7/108 2024-01-13T17:54:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:17.2.7-268.g6441305d.el8.x86_64 8/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:17.2.7-268.g6441305d.el8.x86_64 9/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:17.2.7-268.g6441305d.el8.x86_64 10/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:17.2.7-268.g6441305d.el8.x86_64 11/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:17.2.7-268.g6441305d.el8.x86_64 12/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:17.2.7-268.g6441305d.el8.x86_6 13/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:17.2.7-268.g6441305d.el8.x86_64 14/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:17.2.7-268.g6441305d.el8.x86_64 15/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:17.2.7-268.g6441305d.el8.x86_64 16/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:17.2.7-268.g6441305d.el8.x86_ 17/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:17.2.7-268.g6441305d.el8.x86_64 18/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:17.2.7-268.g6441305d.el8 19/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:17.2.7-268.g6441305d.el8.x 20/108 2024-01-13T17:54:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:17.2.7-268.g6441305d.el8.x86_64 21/108 2024-01-13T17:54:01.311 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:17.2.7-268.g6441305d.el8.x86_64 22/108 2024-01-13T17:54:01.311 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:17.2.7-268.g6441305d.el8.x86_64 23/108 2024-01-13T17:54:01.311 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:17.2.7-268.g6441305d.el8.x86_64 24/108 2024-01-13T17:54:01.311 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:17.2.7-268.g6441305d.el8.x86_64 25/108 2024-01-13T17:54:01.311 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:17.2.7-268.g6441305d.el8.x86_64 26/108 2024-01-13T17:54:01.311 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:17.2.7-268.g6441305d.el8.x86_64 27/108 2024-01-13T17:54:01.318 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-268.g6441305d.e 28/108 2024-01-13T17:54:01.318 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-268.g6441305d.el8.noar 29/108 2024-01-13T17:54:01.318 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-268.g6441305d.el8.no 30/108 2024-01-13T17:54:01.318 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-268.g6441 31/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-268.g6441305d.el8 32/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:17.2.7-268.g6441305d.el8.noarch 33/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-268.g6441305d.el 34/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:17.2.7-268.g6441305d.el8.noarch 35/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.6-8.el8.x86_64 36/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 37/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 38/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 39/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 40/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 41/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-attrs-17.4.0-6.el8.noarch 42/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 43/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 44/108 2024-01-13T17:54:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 45/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 46/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 47/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 48/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 49/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 50/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pluggy-0.6.0-3.el8.noarch 51/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 52/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-py-1.5.3-4.el8.noarch 53/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 54/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 55/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 56/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytest-3.4.2-11.el8.noarch 57/108 2024-01-13T17:54:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 58/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 59/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 60/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 61/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 62/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 63/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 64/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 65/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 66/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 67/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 68/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 69/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 70/108 2024-01-13T17:54:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 71/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 72/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 73/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 74/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 75/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 76/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 77/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 79/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 80/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 81/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 82/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 83/108 2024-01-13T17:54:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 84/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 85/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 86/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 87/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 88/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 89/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 90/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-2.6-1.el8.noarch 91/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 92/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 93/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 94/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 95/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 96/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 97/108 2024-01-13T17:54:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 98/108 2024-01-13T17:54:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 99/108 2024-01-13T17:54:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 100/108 2024-01-13T17:54:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 101/108 2024-01-13T17:54:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 102/108 2024-01-13T17:54:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 103/108 2024-01-13T17:54:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 104/108 2024-01-13T17:54:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:17.2.7-268.g6441305d.el8.x86_64 105/108 2024-01-13T17:54:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 106/108 2024-01-13T17:54:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:17.2.7-268.g6441305d.el8.x86_64 107/108 2024-01-13T17:54:03.568 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 108/108 2024-01-13T17:54:03.568 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:54:03.568 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-01-13T17:54:03.568 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:54:03.569 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:17.2.7-268.g6441305d.el8.noarch 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.7-17.el8.x86_64 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: jq-1.6-8.el8.x86_64 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.570 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.2-3.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.9.0-4.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.3.1-3.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma-6.8.2-2.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.15-4.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-01-13T17:54:03.571 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs-17.4.0-6.el8.noarch 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.5.1-7.el8.noarch 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-01-13T17:54:03.572 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-6.2-6.el8.noarch 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.0.6-14.el8.noarch 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-01-13T17:54:03.573 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pluggy-0.6.0-3.el8.noarch 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-2.6-1.el8.noarch 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-py-1.5.3-4.el8.noarch 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.14-14.el8.noarch 2024-01-13T17:54:03.574 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytest-3.4.2-11.el8.noarch 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2017.2-11.el8.noarch 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.4.1-12.el8.noarch 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el8.noarch 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-01-13T17:54:03.575 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:17.2.7-268.g6441305d.el8.x86_64 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-1.el8.x86_64 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.13.0-2.el8.x86_64 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:54:03.576 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-01-13T17:54:03.742 DEBUG:teuthology.parallel:result is None 2024-01-13T17:54:03.743 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-13T17:54:03.743 INFO:teuthology.packaging:ref: None 2024-01-13T17:54:03.743 INFO:teuthology.packaging:tag: None 2024-01-13T17:54:03.743 INFO:teuthology.packaging:branch: quincy 2024-01-13T17:54:03.743 INFO:teuthology.packaging:sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T17:54:03.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-01-13T17:54:03.952 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-13T17:54:03.976 INFO:teuthology.orchestra.run.smithi084.stdout:17.2.7-268.g6441305d.el8 2024-01-13T17:54:03.977 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-268.g6441305d.el8 2024-01-13T17:54:03.977 INFO:teuthology.task.install:The correct ceph version 17.2.7-268.g6441305d is installed. 2024-01-13T17:54:03.979 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-13T17:54:03.979 INFO:teuthology.packaging:ref: None 2024-01-13T17:54:03.979 INFO:teuthology.packaging:tag: None 2024-01-13T17:54:03.979 INFO:teuthology.packaging:branch: quincy 2024-01-13T17:54:03.979 INFO:teuthology.packaging:sha1: d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T17:54:03.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-01-13T17:54:04.279 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-13T17:54:04.310 INFO:teuthology.orchestra.run.smithi099.stdout:17.2.7-268.g6441305d.el8 2024-01-13T17:54:04.311 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-268.g6441305d.el8 2024-01-13T17:54:04.311 INFO:teuthology.task.install:The correct ceph version 17.2.7-268.g6441305d is installed. 2024-01-13T17:54:04.312 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-13T17:54:04.313 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:54:04.313 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-13T17:54:04.345 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:54:04.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-13T17:54:04.387 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-13T17:54:04.388 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:54:04.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-01-13T17:54:04.416 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-13T17:54:04.483 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:54:04.483 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-01-13T17:54:04.513 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-13T17:54:04.582 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-13T17:54:04.582 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:54:04.582 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-13T17:54:04.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-13T17:54:04.676 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:54:04.676 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-13T17:54:04.705 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-13T17:54:04.774 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-13T17:54:04.774 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:54:04.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-01-13T17:54:04.801 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-13T17:54:04.868 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:54:04.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-01-13T17:54:04.897 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-13T17:54:04.965 INFO:teuthology.run_tasks:Running task print... 2024-01-13T17:54:04.975 INFO:teuthology.task.print:**** done install task... 2024-01-13T17:54:04.975 INFO:teuthology.run_tasks:Running task print... 2024-01-13T17:54:05.002 INFO:teuthology.task.print:**** done start installing quincy cephadm ... 2024-01-13T17:54:05.002 INFO:teuthology.run_tasks:Running task cephadm... 2024-01-13T17:54:05.107 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}, 'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'create_rbd_pool': True, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'd2f11f33b7063c2c1bc47b2b4e9350f48064868f'} 2024-01-13T17:54:05.108 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-01-13T17:54:05.109 INFO:tasks.cephadm:Cluster fsid is be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:54:05.109 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-01-13T17:54:05.109 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.84', 'mon.c': '[v2:172.21.15.84:3301,v1:172.21.15.84:6790]', 'mon.b': '172.21.15.99'} 2024-01-13T17:54:05.109 INFO:tasks.cephadm:First mon is mon.a on smithi084 2024-01-13T17:54:05.109 INFO:tasks.cephadm:First mgr is y 2024-01-13T17:54:05.110 INFO:tasks.cephadm:Normalizing hostnames... 2024-01-13T17:54:05.110 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname $(hostname -s) 2024-01-13T17:54:05.138 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname $(hostname -s) 2024-01-13T17:54:05.168 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-01-13T17:54:05.168 DEBUG:teuthology.orchestra.run.smithi084:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-13T17:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Jan 13 17:54 /home/ubuntu/cephtest/cephadm 2024-01-13T17:54:05.404 DEBUG:teuthology.orchestra.run.smithi099:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-13T17:54:05.602 INFO:teuthology.orchestra.run.smithi099.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Jan 13 17:54 /home/ubuntu/cephtest/cephadm 2024-01-13T17:54:05.603 DEBUG:teuthology.orchestra.run.smithi084:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-13T17:54:05.622 DEBUG:teuthology.orchestra.run.smithi099:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-13T17:54:05.654 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-01-13T17:54:05.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-01-13T17:54:05.664 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-01-13T17:54:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-01-13T17:54:10.142 INFO:teuthology.orchestra.run.smithi084.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-01-13T17:54:32.632 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-13T17:54:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)", 2024-01-13T17:54:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "image_id": "c3a232f785d83f930de30596257bc152e949b0a0d2045f8c153b4a5a153057bd", 2024-01-13T17:54:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "repo_digests": [ 2024-01-13T17:54:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:1c6c19cb0c2f23b107e15db771fed3015fa219174b4acb3bb7355a8628f3e31d" 2024-01-13T17:54:32.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-13T17:54:32.632 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-13T17:54:34.287 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T17:54:34.288 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)", 2024-01-13T17:54:34.288 INFO:teuthology.orchestra.run.smithi084.stdout: "image_id": "c3a232f785d83f930de30596257bc152e949b0a0d2045f8c153b4a5a153057bd", 2024-01-13T17:54:34.288 INFO:teuthology.orchestra.run.smithi084.stdout: "repo_digests": [ 2024-01-13T17:54:34.288 INFO:teuthology.orchestra.run.smithi084.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:1c6c19cb0c2f23b107e15db771fed3015fa219174b4acb3bb7355a8628f3e31d" 2024-01-13T17:54:34.288 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-01-13T17:54:34.288 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T17:54:34.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph 2024-01-13T17:54:34.337 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph 2024-01-13T17:54:34.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /etc/ceph 2024-01-13T17:54:34.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /etc/ceph 2024-01-13T17:54:34.444 INFO:tasks.cephadm:Writing seed config... 2024-01-13T17:54:34.446 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-01-13T17:54:34.446 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-01-13T17:54:34.446 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-01-13T17:54:34.446 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-01-13T17:54:34.446 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-01-13T17:54:34.446 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-01-13T17:54:34.446 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-01-13T17:54:34.446 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-01-13T17:54:34.446 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-01-13T17:54:34.447 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-01-13T17:54:34.447 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-01-13T17:54:34.447 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:54:34.447 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-01-13T17:54:34.465 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = be08b996-b23c-11ee-95ac-87774f69a715 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-01-13T17:54:34.465 DEBUG:teuthology.orchestra.run.smithi084:mon.a> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.a.service 2024-01-13T17:54:34.508 DEBUG:teuthology.orchestra.run.smithi084:mgr.y> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.y.service 2024-01-13T17:54:34.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:-- Logs begin at Sat 2024-01-13 17:16:05 UTC. -- 2024-01-13T17:54:34.534 INFO:tasks.cephadm:Bootstrapping... 2024-01-13T17:54:34.534 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid be08b996-b23c-11ee-95ac-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.84 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-01-13T17:54:34.560 INFO:journalctl@ceph.mgr.y.smithi084.stdout:-- Logs begin at Sat 2024-01-13 17:16:05 UTC. -- 2024-01-13T17:54:34.732 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-01-13T17:54:34.732 INFO:teuthology.orchestra.run.smithi084.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'be08b996-b23c-11ee-95ac-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.84', '--skip-admin-label'] 2024-01-13T17:54:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 4.6.1 2024-01-13T17:54:34.761 INFO:teuthology.orchestra.run.smithi084.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-01-13T17:54:34.761 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying podman|docker is present... 2024-01-13T17:54:34.788 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 4.6.1 2024-01-13T17:54:34.788 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying lvm2 is present... 2024-01-13T17:54:34.788 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying time synchronization is in place... 2024-01-13T17:54:34.795 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-01-13T17:54:34.795 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-01-13T17:54:34.801 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-01-13T17:54:34.801 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-01-13T17:54:34.807 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-01-13T17:54:34.812 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-01-13T17:54:34.813 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-01-13T17:54:34.813 INFO:teuthology.orchestra.run.smithi084.stdout:Repeating the final host check... 2024-01-13T17:54:34.843 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 4.6.1 2024-01-13T17:54:34.843 INFO:teuthology.orchestra.run.smithi084.stdout:podman (/bin/podman) version 4.6.1 is present 2024-01-13T17:54:34.843 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl is present 2024-01-13T17:54:34.843 INFO:teuthology.orchestra.run.smithi084.stdout:lvcreate is present 2024-01-13T17:54:34.849 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-01-13T17:54:34.849 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-01-13T17:54:34.854 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-01-13T17:54:34.854 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-01-13T17:54:34.860 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-01-13T17:54:34.866 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-01-13T17:54:34.866 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-01-13T17:54:34.866 INFO:teuthology.orchestra.run.smithi084.stdout:Host looks OK 2024-01-13T17:54:34.866 INFO:teuthology.orchestra.run.smithi084.stdout:Cluster fsid: be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:54:34.866 INFO:teuthology.orchestra.run.smithi084.stdout:Acquiring lock 140310983326184 on /run/cephadm/be08b996-b23c-11ee-95ac-87774f69a715.lock 2024-01-13T17:54:34.866 INFO:teuthology.orchestra.run.smithi084.stdout:Lock 140310983326184 acquired on /run/cephadm/be08b996-b23c-11ee-95ac-87774f69a715.lock 2024-01-13T17:54:34.867 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 3300 ... 2024-01-13T17:54:34.867 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 6789 ... 2024-01-13T17:54:34.867 INFO:teuthology.orchestra.run.smithi084.stdout:Base mon IP(s) is [172.21.15.84:3300, 172.21.15.84:6789], mon addrv is [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-01-13T17:54:34.871 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.84 metric 100 2024-01-13T17:54:34.871 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.84 metric 100 2024-01-13T17:54:34.875 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-01-13T17:54:34.875 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-01-13T17:54:34.875 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1735sec hoplimit 64 pref medium 2024-01-13T17:54:34.877 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-01-13T17:54:34.877 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-01-13T17:54:34.877 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-01-13T17:54:34.877 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-01-13T17:54:34.877 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2024-01-13T17:54:34.877 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-01-13T17:54:34.877 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-01-13T17:54:34.878 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-01-13T17:54:34.878 INFO:teuthology.orchestra.run.smithi084.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-01-13T17:54:34.878 INFO:teuthology.orchestra.run.smithi084.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-01-13T17:54:34.878 INFO:teuthology.orchestra.run.smithi084.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-01-13T17:54:35.235 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout c3a232f785d83f930de30596257bc152e949b0a0d2045f8c153b4a5a153057bd 2024-01-13T17:54:35.236 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-01-13T17:54:35.236 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Getting image source signatures 2024-01-13T17:54:35.236 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:aebaf716154c1970d30484d8c64e6de04feea816ffee6c602dc9eb55fbe60ece 2024-01-13T17:54:35.236 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:6c507150f7e9f028ef978d633e702dab944bbda82bfbc46f6307495cf6dd9fc7 2024-01-13T17:54:35.236 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying config sha256:c3a232f785d83f930de30596257bc152e949b0a0d2045f8c153b4a5a153057bd 2024-01-13T17:54:35.236 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Writing manifest to image destination 2024-01-13T17:54:35.913 INFO:teuthology.orchestra.run.smithi084.stdout:ceph: stdout ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable) 2024-01-13T17:54:35.913 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph version: ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable) 2024-01-13T17:54:35.913 INFO:teuthology.orchestra.run.smithi084.stdout:Extracting ceph user uid/gid from container image... 2024-01-13T17:54:36.519 INFO:teuthology.orchestra.run.smithi084.stdout:stat: stdout 167 167 2024-01-13T17:54:36.520 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial keys... 2024-01-13T17:54:37.128 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQBczqJlPfKOLhAAVcy7oIm8WrD5mjqrwS7Bag== 2024-01-13T17:54:37.727 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQBdzqJlQ986FhAAaUTYsZ9zh6f11ZlFEoQ2dQ== 2024-01-13T17:54:38.320 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQBdzqJl/EN1ORAAdwcYsey/3MA3OAtd1G6N+Q== 2024-01-13T17:54:38.320 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial monmap... 2024-01-13T17:54:38.911 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-01-13T17:54:38.911 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-01-13T17:54:38.911 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:54:38.911 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-01-13T17:54:38.911 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool for a [v2:172.21.15.84:3300,v1:172.21.15.84:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-01-13T17:54:38.911 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = octopus 2024-01-13T17:54:38.912 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: set fsid to be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:54:38.912 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-01-13T17:54:38.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:54:38.912 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mon... 2024-01-13T17:54:39.540 INFO:teuthology.orchestra.run.smithi084.stdout:create mon.a on 2024-01-13T17:54:39.638 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-01-13T17:54:39.726 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-01-13T17:54:39.821 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-be08b996-b23c-11ee-95ac-87774f69a715.target → /etc/systemd/system/ceph-be08b996-b23c-11ee-95ac-87774f69a715.target. 2024-01-13T17:54:39.821 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-be08b996-b23c-11ee-95ac-87774f69a715.target → /etc/systemd/system/ceph-be08b996-b23c-11ee-95ac-87774f69a715.target. 2024-01-13T17:54:39.940 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.a 2024-01-13T17:54:39.940 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.a.service: Unit ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.a.service not loaded. 2024-01-13T17:54:40.032 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-be08b996-b23c-11ee-95ac-87774f69a715.target.wants/ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.a.service → /etc/systemd/system/ceph-be08b996-b23c-11ee-95ac-87774f69a715@.service. 2024-01-13T17:54:40.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:40 smithi084 systemd[1]: Starting Ceph mon.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:54:40.398 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-13T17:54:40.398 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-01-13T17:54:40.407 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-13T17:54:40.407 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-01-13T17:54:40.407 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-01-13T17:54:40.407 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-01-13T17:54:40.407 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon to start... 2024-01-13T17:54:40.407 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon... 2024-01-13T17:54:40.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:40 smithi084 bash[37387]: a68d56e500dc80c32ba65134959e995cf561283b9fd29597c44d6010195b0abe 2024-01-13T17:54:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:40 smithi084 systemd[1]: Started Ceph mon.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:54:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:40 smithi084 ceph-mon[37424]: mkfs be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:54:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:40 smithi084 ceph-mon[37424]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-13T17:54:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout cluster: 2024-01-13T17:54:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout id: be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:54:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-01-13T17:54:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout services: 2024-01-13T17:54:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.4782s) 2024-01-13T17:54:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-01-13T17:54:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-01-13T17:54:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout data: 2024-01-13T17:54:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-01-13T17:54:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-01-13T17:54:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-01-13T17:54:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pgs: 2024-01-13T17:54:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:mon is available 2024-01-13T17:54:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:Assimilating anything we can from ceph.conf... 2024-01-13T17:54:41.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:41 smithi084 ceph-mon[37424]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-13T17:54:41.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:41 smithi084 ceph-mon[37424]: monmap e1: 1 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T17:54:41.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:41 smithi084 ceph-mon[37424]: fsmap 2024-01-13T17:54:41.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:41 smithi084 ceph-mon[37424]: osdmap e1: 0 total, 0 up, 0 in 2024-01-13T17:54:41.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:41 smithi084 ceph-mon[37424]: mgrmap e1: no daemons active 2024-01-13T17:54:41.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:41 smithi084 ceph-mon[37424]: from='client.? 172.21.15.84:0/619941726' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-01-13T17:54:42.114 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:42.114 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-01-13T17:54:42.114 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:54:42.114 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-01-13T17:54:42.114 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-01-13T17:54:42.115 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-01-13T17:54:42.115 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-01-13T17:54:42.115 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-01-13T17:54:42.115 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:42.115 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-01-13T17:54:42.115 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-01-13T17:54:42.115 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:42.115 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-01-13T17:54:42.115 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-01-13T17:54:42.115 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-01-13T17:54:42.115 INFO:teuthology.orchestra.run.smithi084.stdout:Generating new minimal ceph.conf... 2024-01-13T17:54:42.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:42 smithi084 ceph-mon[37424]: from='client.? 172.21.15.84:0/2322662286' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-01-13T17:54:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:42 smithi084 ceph-mon[37424]: from='client.? 172.21.15.84:0/2322662286' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-01-13T17:54:42.863 INFO:teuthology.orchestra.run.smithi084.stdout:Restarting the monitor... 2024-01-13T17:54:43.054 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:42 smithi084 systemd[1]: Stopping Ceph mon.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:54:43.312 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-a[37401]: 2024-01-13T17:54:43.051+0000 7f4cc50ea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T17:54:43.312 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-a[37401]: 2024-01-13T17:54:43.051+0000 7f4cc50ea700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-13T17:54:43.600 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 bash[37750]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-a 2024-01-13T17:54:43.888 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.a.service: Succeeded. 2024-01-13T17:54:43.889 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 systemd[1]: Stopped Ceph mon.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:54:43.889 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 systemd[1]: Starting Ceph mon.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:54:43.955 INFO:teuthology.orchestra.run.smithi084.stdout:Setting mon public_network to 172.21.0.0/20 2024-01-13T17:54:44.403 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: set uid:gid to 167:167 (ceph:ceph) 2024-01-13T17:54:44.403 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable), process ceph-mon, pid 7 2024-01-13T17:54:44.403 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: pidfile_write: ignore empty --pid-file 2024-01-13T17:54:44.403 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: load: jerasure load: lrc 2024-01-13T17:54:44.403 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: RocksDB version: 6.15.5 2024-01-13T17:54:44.403 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-01-13T17:54:44.403 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Compile date Jan 9 2024 2024-01-13T17:54:44.403 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: DB SUMMARY 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: DB Session ID: ZXX1XVTOEB7HTDPS09B5 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: CURRENT file: CURRENT 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: IDENTITY file: IDENTITY 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 82299 ; 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.error_if_exists: 0 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.create_if_missing: 0 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.paranoid_checks: 1 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.env: 0x5584cc35aa80 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.fs: Posix File System 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.info_log: 0x5584cd335dc0 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_file_opening_threads: 16 2024-01-13T17:54:44.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.statistics: (nil) 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.use_fsync: 0 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_log_file_size: 0 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.keep_log_file_num: 1000 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.recycle_log_file_num: 0 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.allow_fallocate: 1 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.allow_mmap_reads: 0 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.allow_mmap_writes: 0 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.use_direct_reads: 0 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.create_missing_column_families: 0 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.db_log_dir: 2024-01-13T17:54:44.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.advise_random_on_open: 1 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.db_write_buffer_size: 0 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.write_buffer_manager: 0x5584ce028960 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-13T17:54:44.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.rate_limiter: (nil) 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.wal_recovery_mode: 2 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.enable_thread_tracking: 0 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.enable_pipelined_write: 0 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.unordered_write: 0 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.row_cache: None 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.wal_filter: None 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.allow_ingest_behind: 0 2024-01-13T17:54:44.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.preserve_deletes: 0 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.two_write_queues: 0 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.manual_wal_flush: 0 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.atomic_flush: 0 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.log_readahead_size: 0 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.best_efforts_recovery: 0 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.allow_data_in_errors: 0 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.db_host_id: __hostname__ 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_background_jobs: 2 2024-01-13T17:54:44.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_background_compactions: -1 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_subcompactions: 1 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_total_wal_size: 0 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_open_files: -1 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.bytes_per_sync: 0 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-13T17:54:44.409 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_readahead_size: 0 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_background_flushes: -1 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Compression algorithms supported: 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: kZSTD supported: 0 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: kXpressCompression supported: 0 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: kLZ4HCCompression supported: 1 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: kZlibCompression supported: 1 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: kSnappyCompression supported: 1 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: kLZ4Compression supported: 1 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: kBZip2Compression supported: 0 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-13T17:54:44.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.merge_operator: 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_filter: None 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_filter_factory: None 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.sst_partitioner_factory: None 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5584cd308f90) 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_type: 0 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_index_type: 0 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_shortening: 1 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-13T17:54:44.411 INFO:journalctl@ceph.mon.a.smithi084.stdout: hash_index_allow_collision: 1 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: checksum: 1 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: no_block_cache: 0 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache: 0x5584cd33b090 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_options: 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: capacity : 536870912 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_shard_bits : 4 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: strict_capacity_limit : 0 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_compressed: (nil) 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: persistent_cache: (nil) 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size: 4096 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size_deviation: 10 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_restart_interval: 16 2024-01-13T17:54:44.412 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_block_restart_interval: 1 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout: metadata_block_size: 4096 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout: partition_filters: 0 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout: use_delta_encoding: 1 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout: whole_key_filtering: 1 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout: verify_compression: 0 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout: format_version: 4 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_index_compression: 1 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_align: 0 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.write_buffer_size: 33554432 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_write_buffer_number: 2 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compression: NoCompression 2024-01-13T17:54:44.413 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.bottommost_compression: Disabled 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.prefix_extractor: nullptr 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.num_levels: 7 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 bash[37872]: 0eb2ed5f876682f1e43dfc75be9481da38f69554ff6a6ee914872875425653b5 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-13T17:54:44.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compression_opts.level: 32767 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compression_opts.strategy: 0 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compression_opts.enabled: false 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.target_file_size_base: 67108864 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-13T17:54:44.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-13T17:54:44.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-13T17:54:44.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-13T17:54:44.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-13T17:54:44.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-13T17:54:44.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-13T17:54:44.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-13T17:54:44.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-13T17:54:44.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-13T17:54:44.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.arena_block_size: 4194304 2024-01-13T17:54:44.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-13T17:54:44.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.disable_auto_compactions: 0 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-13T17:54:44.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-13T17:54:44.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.table_properties_collectors: 2024-01-13T17:54:44.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.inplace_update_support: 0 2024-01-13T17:54:44.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.bloom_locality: 0 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.max_successive_merges: 0 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.paranoid_file_checks: 0 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.force_consistency_checks: 1 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.report_bg_io_stats: 0 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.ttl: 2592000 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.enable_blob_files: false 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.min_blob_size: 0 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.blob_file_size: 268435456 2024-01-13T17:54:44.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168483949366, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168483950041, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 79003, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 77271, "index_size": 220, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10080, "raw_average_key_size": 48, "raw_value_size": 71518, "raw_average_value_size": 340, "num_data_blocks": 10, "num_entries": 210, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1705168483, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "97782eac-5e93-4661-a114-f379c54797df", "db_session_id": "ZXX1XVTOEB7HTDPS09B5"}} 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168483950351, "job": 1, "event": "recovery_finished"} 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-13T17:54:44.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5584cd2cf180 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: DB pointer 0x5584cd3a4000 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** DB Stats ** 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-13T17:54:44.421 INFO:journalctl@ceph.mon.a.smithi084.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: L0 2/0 78.91 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 170.1 0.00 0.00 1 0.000 0 0 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: Sum 2/0 78.91 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 170.1 0.00 0.00 1 0.000 0 0 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 170.1 0.00 0.00 1 0.000 0 0 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 170.1 0.00 0.00 1 0.000 0 0 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-13T17:54:44.422 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative compaction: 0.00 GB write, 25.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval compaction: 0.00 GB write, 25.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: L0 2/0 78.91 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 170.1 0.00 0.00 1 0.000 0 0 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: Sum 2/0 78.91 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 170.1 0.00 0.00 1 0.000 0 0 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-13T17:54:44.423 INFO:journalctl@ceph.mon.a.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 170.1 0.00 0.00 1 0.000 0 0 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative compaction: 0.00 GB write, 24.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: starting mon.a rank 0 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: mon.a@-1(???) e1 preinit fsid be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:54:44.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 systemd[1]: Started Ceph mon.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: mon.a@-1(???).mds e1 new map 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: mon.a@-1(???).mds e1 print_map 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout: e1 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout: legacy client fscid: -1 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout: No filesystems configured 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:43 smithi084 ceph-mon[37908]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:44 smithi084 ceph-mon[37908]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-13T17:54:44.425 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:44 smithi084 ceph-mon[37908]: monmap e1: 1 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T17:54:44.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:44 smithi084 ceph-mon[37908]: fsmap 2024-01-13T17:54:44.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:44 smithi084 ceph-mon[37908]: osdmap e1: 0 total, 0 up, 0 in 2024-01-13T17:54:44.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:44 smithi084 ceph-mon[37908]: mgrmap e1: no daemons active 2024-01-13T17:54:44.737 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote config to /etc/ceph/ceph.conf 2024-01-13T17:54:44.738 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-01-13T17:54:44.738 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mgr... 2024-01-13T17:54:44.738 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying port 9283 ... 2024-01-13T17:54:44.861 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.y 2024-01-13T17:54:44.861 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.y.service: Unit ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.y.service not loaded. 2024-01-13T17:54:44.948 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-be08b996-b23c-11ee-95ac-87774f69a715.target.wants/ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.y.service → /etc/systemd/system/ceph-be08b996-b23c-11ee-95ac-87774f69a715@.service. 2024-01-13T17:54:45.327 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:44 smithi084 systemd[1]: Starting Ceph mgr.y for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:54:45.343 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-13T17:54:45.343 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-01-13T17:54:45.350 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-13T17:54:45.350 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-01-13T17:54:45.350 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-01-13T17:54:45.351 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-01-13T17:54:45.359 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-13T17:54:45.359 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-01-13T17:54:45.367 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-13T17:54:45.367 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-01-13T17:54:45.367 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-01-13T17:54:45.367 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-01-13T17:54:45.367 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr to start... 2024-01-13T17:54:45.367 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr... 2024-01-13T17:54:45.620 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:45 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2630425797' entity='client.admin' 2024-01-13T17:54:45.620 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:45 smithi084 bash[38143]: 051f8ff2f26dd3c13b8ed05e1a77b4d90f35cb5bae6af9a7bc546b4844104938 2024-01-13T17:54:45.620 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:45 smithi084 systemd[1]: Started Ceph mgr.y for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:54:45.620 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:45 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:45.447+0000 7fcd7c3611c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T17:54:45.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:45 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:45.617+0000 7fcd7c3611c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T17:54:46.156 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:46.156 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-01-13T17:54:46.156 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "be08b996-b23c-11ee-95ac-87774f69a715", 2024-01-13T17:54:46.156 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-01-13T17:54:46.156 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-01-13T17:54:46.158 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-13T17:54:46.158 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:46.158 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-13T17:54:46.158 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:46.158 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-13T17:54:46.158 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-13T17:54:46.158 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-13T17:54:46.158 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-13T17:54:46.161 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-13T17:54:46.161 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:46.162 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:46.163 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-01-13T17:54:40.415285+0000", 2024-01-13T17:54:46.164 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-13T17:54:46.164 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:46.164 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-13T17:54:46.164 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-01-13T17:54:46.164 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (1/15)... 2024-01-13T17:54:46.378 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:45 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:45.931+0000 7fcd7c3611c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T17:54:46.674 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:46 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1358599061' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-13T17:54:46.675 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:46.452+0000 7fcd7c3611c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T17:54:46.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:46.673+0000 7fcd7c3611c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T17:54:47.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:47.008+0000 7fcd7c3611c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T17:54:48.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:47.770+0000 7fcd7c3611c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T17:54:48.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:47.854+0000 7fcd7c3611c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T17:54:48.554 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:48.467+0000 7fcd7c3611c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T17:54:48.555 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:48.553+0000 7fcd7c3611c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T17:54:48.897 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:48 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3766323183' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-13T17:54:48.897 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:48.640+0000 7fcd7c3611c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T17:54:48.897 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:48.734+0000 7fcd7c3611c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T17:54:48.987 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:48.989 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "be08b996-b23c-11ee-95ac-87774f69a715", 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:48.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-01-13T17:54:48.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-13T17:54:48.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:48.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-01-13T17:54:48.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-13T17:54:48.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:48.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-13T17:54:48.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:48.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-13T17:54:48.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-13T17:54:48.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-13T17:54:48.995 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-13T17:54:48.995 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-13T17:54:48.995 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:48.996 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-01-13T17:54:40.415285+0000", 2024-01-13T17:54:48.998 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-13T17:54:48.998 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:48.998 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-13T17:54:48.998 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-01-13T17:54:48.998 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (2/15)... 2024-01-13T17:54:49.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:48.959+0000 7fcd7c3611c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T17:54:49.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:49.051+0000 7fcd7c3611c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T17:54:49.534 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:49.259+0000 7fcd7c3611c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T17:54:49.534 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:49.353+0000 7fcd7c3611c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T17:54:49.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:49.532+0000 7fcd7c3611c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T17:54:49.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:49.615+0000 7fcd7c3611c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T17:54:50.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:50.348+0000 7fcd7c3611c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T17:54:50.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:50.534+0000 7fcd7c3611c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T17:54:51.091 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:50.704+0000 7fcd7c3611c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:54:51.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:51 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:51.309+0000 7fcd7c3611c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T17:54:51.696 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:51 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3317438119' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-13T17:54:51.697 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:51 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:51.499+0000 7fcd7c3611c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:54:51.697 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:51 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:51.676+0000 7fcd7c3611c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "be08b996-b23c-11ee-95ac-87774f69a715", 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-01-13T17:54:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-13T17:54:51.765 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-13T17:54:51.766 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-13T17:54:51.766 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-13T17:54:51.766 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-13T17:54:51.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:51.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-13T17:54:51.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-13T17:54:51.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-13T17:54:51.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-13T17:54:51.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-13T17:54:51.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-13T17:54:51.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-13T17:54:51.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-13T17:54:51.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:51.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-13T17:54:51.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:51.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-13T17:54:51.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:51.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-01-13T17:54:40.415285+0000", 2024-01-13T17:54:51.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-13T17:54:51.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:51.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-13T17:54:51.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-01-13T17:54:51.771 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (3/15)... 2024-01-13T17:54:52.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:51 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:51.793+0000 7fcd7c3611c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: Activating manager daemon y 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: mgrmap e2: y(active, starting, since 0.00288278s) 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: Manager daemon y is now available 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' 2024-01-13T17:54:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:52 smithi084 ceph-mon[37908]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' 2024-01-13T17:54:54.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:53 smithi084 ceph-mon[37908]: mgrmap e3: y(active, since 1.00607s) 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "be08b996-b23c-11ee-95ac-87774f69a715", 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-13T17:54:54.731 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-13T17:54:54.735 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-13T17:54:54.735 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-13T17:54:54.735 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-13T17:54:54.735 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:54.735 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-13T17:54:54.735 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-13T17:54:54.735 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-13T17:54:54.735 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-13T17:54:54.735 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-13T17:54:54.735 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-13T17:54:54.736 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-01-13T17:54:40.415285+0000", 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-01-13T17:54:54.737 INFO:teuthology.orchestra.run.smithi084.stdout:mgr is available 2024-01-13T17:54:55.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:54 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/68228008' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-13T17:54:55.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:54 smithi084 ceph-mon[37908]: mgrmap e4: y(active, since 3s) 2024-01-13T17:54:55.603 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:55.603 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-01-13T17:54:55.603 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:54:55.603 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-01-13T17:54:55.603 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-01-13T17:54:55.603 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-01-13T17:54:55.603 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-01-13T17:54:55.603 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:55.603 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-01-13T17:54:55.604 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-01-13T17:54:55.604 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-01-13T17:54:55.604 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-01-13T17:54:55.604 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-01-13T17:54:55.604 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-01-13T17:54:55.604 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling cephadm module... 2024-01-13T17:54:56.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:55 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/234596188' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-01-13T17:54:57.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:56 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3534422797' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-01-13T17:54:57.296 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:57 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ignoring --setuser ceph since I am not root 2024-01-13T17:54:57.296 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:57 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ignoring --setgroup ceph since I am not root 2024-01-13T17:54:57.297 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:57 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:57.133+0000 7f5c18c821c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T17:54:57.297 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:57 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:57.293+0000 7f5c18c821c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T17:54:57.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:57 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:57.601+0000 7f5c18c821c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T17:54:58.360 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:58 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:58.136+0000 7f5c18c821c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T17:54:58.360 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:57 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3534422797' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-01-13T17:54:58.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:57 smithi084 ceph-mon[37908]: mgrmap e5: y(active, since 5s) 2024-01-13T17:54:58.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:58 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:58.358+0000 7f5c18c821c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T17:54:58.974 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:58 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:58.697+0000 7f5c18c821c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T17:54:59.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:54:58 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/4225349389' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-01-13T17:54:59.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:59 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:59.449+0000 7f5c18c821c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T17:54:59.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:54:59 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:54:59.533+0000 7f5c18c821c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T17:55:00.334 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-01-13T17:55:00.334 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-01-13T17:55:00.334 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-13T17:55:00.334 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-01-13T17:55:00.334 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-01-13T17:55:00.335 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-01-13T17:55:00.335 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-01-13T17:55:00.335 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 5... 2024-01-13T17:55:00.391 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:00.120+0000 7f5c18c821c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T17:55:00.392 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:00.202+0000 7f5c18c821c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T17:55:00.392 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:00.289+0000 7f5c18c821c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T17:55:00.392 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:00.389+0000 7f5c18c821c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T17:55:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:00.609+0000 7f5c18c821c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T17:55:01.002 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:00.699+0000 7f5c18c821c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T17:55:01.002 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:00.914+0000 7f5c18c821c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T17:55:01.286 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:01.011+0000 7f5c18c821c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T17:55:01.286 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:01.201+0000 7f5c18c821c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T17:55:01.286 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:01.283+0000 7f5c18c821c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T17:55:02.383 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:02.019+0000 7f5c18c821c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T17:55:02.383 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:02.206+0000 7f5c18c821c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T17:55:02.383 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:02.380+0000 7f5c18c821c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:55:03.355 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:02.999+0000 7f5c18c821c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T17:55:03.355 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:03.173+0000 7f5c18c821c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:55:03.355 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:03.352+0000 7f5c18c821c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T17:55:03.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:03.467+0000 7f5c18c821c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: Active manager daemon y restarted 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: Activating manager daemon y 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: osdmap e2: 0 total, 0 up, 0 in 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: mgrmap e6: y(active, starting, since 0.00307492s) 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: Manager daemon y is now available 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:03.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:03 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:04.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:04 smithi084 ceph-mon[37908]: Found migration_current of "None". Setting to last migration. 2024-01-13T17:55:04.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:04 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:04 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T17:55:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:04 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T17:55:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:04 smithi084 ceph-mon[37908]: mgrmap e7: y(active, since 1.0051s) 2024-01-13T17:55:05.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:05 smithi084 ceph-mon[37908]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-01-13T17:55:05.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:05 smithi084 ceph-mon[37908]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-01-13T17:55:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:05 smithi084 ceph-mon[37908]: [13/Jan/2024:17:55:04] ENGINE Bus STARTING 2024-01-13T17:55:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:05 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:05 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:06.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:06 smithi084 ceph-mon[37908]: [13/Jan/2024:17:55:05] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T17:55:06.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:06 smithi084 ceph-mon[37908]: [13/Jan/2024:17:55:05] ENGINE Bus STARTED 2024-01-13T17:55:06.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:06 smithi084 ceph-mon[37908]: mgrmap e8: y(active, since 2s) 2024-01-13T17:55:07.170 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-01-13T17:55:07.171 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-01-13T17:55:07.171 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-01-13T17:55:07.171 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-01-13T17:55:07.171 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 5 is available 2024-01-13T17:55:07.171 INFO:teuthology.orchestra.run.smithi084.stdout:Setting orchestrator backend to cephadm... 2024-01-13T17:55:09.040 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout value unchanged 2024-01-13T17:55:09.041 INFO:teuthology.orchestra.run.smithi084.stdout:Generating ssh key... 2024-01-13T17:55:09.144 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:08 smithi084 ceph-mon[37908]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:09.144 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:08 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:09.144 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:08 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:09.892 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: Generating public/private rsa key pair. 2024-01-13T17:55:09.892 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: Your identification has been saved in /tmp/tmpk30tgfjj/key. 2024-01-13T17:55:09.892 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: Your public key has been saved in /tmp/tmpk30tgfjj/key.pub. 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: The key fingerprint is: 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: SHA256:PONwHFYM9+e9KJbfj23+nL/t+PKxh0NF7zS0BS3y9tc ceph-be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: The key's randomart image is: 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: +---[RSA 3072]----+ 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: | .oo .o | 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: | o... ..+| 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: | o .ooo+| 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: | + . oo++| 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: | . S ..=+| 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: | + o . o E| 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: | . + o +.| 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: | . o ==B| 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: | .o&^| 2024-01-13T17:55:09.893 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: +----[SHA256]-----+ 2024-01-13T17:55:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-mon[37908]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:09 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:10.849 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7TO6xvWzGypnGSxn6F6hCI/trrf15MImXz4lZGzZNeTT2CzhVO+gzWlJjM0b4f1oaRvGgDyUXsz3TUUWCdznjbmAZNZPRev629T9/5gYTq2koDWqKPbK2b7RRQSwdGzMNx8t7247IgO8X4Po0Go1InVu/XJe5jaT5n27mqlowJAwi6s1H3nYhoZkkEUZvDquVQdeRDwY+aL84TWwgNMYxFP1O23Lcf831rd+UP47Lme9pi1dxwBb2k79682dfSyYsxldjEaiZAXsdxWpY+H0Hxb89cmjEHhoUzbwUKHjg2I0LGm5EYI5T1zciekT7QpXeq0i4yN5ytIlPSEuZNF13BKmq1L19uWV9/n2kI8h3JvzCqPXVMbSU6E/Mjt6GXcFtsrnjvWdBo6q1SjZWvhCe6FCb0Oe/qzSxHvXHKor9BjkKWSnl6wjOKp8JVdcJfX/RqdcOzCYxSWHUNOXQwASjkALEIMxiU7BWaa6NNpEiUAoYZ9QjJQBdGHk2h8y7zU= ceph-be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:55:10.849 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-01-13T17:55:10.849 INFO:teuthology.orchestra.run.smithi084.stdout:Adding key to root@localhost authorized_keys... 2024-01-13T17:55:10.850 INFO:teuthology.orchestra.run.smithi084.stdout:Adding host smithi084... 2024-01-13T17:55:11.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:10 smithi084 ceph-mon[37908]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:11.414 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:10 smithi084 ceph-mon[37908]: Generating ssh key... 2024-01-13T17:55:12.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:11 smithi084 ceph-mon[37908]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:13.275 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:12 smithi084 ceph-mon[37908]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi084", "addr": "172.21.15.84", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:13.275 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:12 smithi084 ceph-mon[37908]: Deploying cephadm binary to smithi084 2024-01-13T17:55:13.324 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Added host 'smithi084' with addr '172.21.15.84' 2024-01-13T17:55:13.324 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying unmanaged mon service... 2024-01-13T17:55:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:14 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:14.385 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:14 smithi084 ceph-mon[37908]: Added host smithi084 2024-01-13T17:55:14.385 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:14 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:14.385 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:14 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:14.386 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-01-13T17:55:14.386 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying unmanaged mgr service... 2024-01-13T17:55:15.291 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:15 smithi084 ceph-mon[37908]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:15.291 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:15 smithi084 ceph-mon[37908]: Saving service mon spec with placement count:5 2024-01-13T17:55:15.292 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:15 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:15.292 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:15 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:15.348 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-01-13T17:55:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:16 smithi084 ceph-mon[37908]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:16 smithi084 ceph-mon[37908]: Saving service mgr spec with placement count:2 2024-01-13T17:55:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:16 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:16 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/349048563' entity='client.admin' 2024-01-13T17:55:17.222 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling the dashboard module... 2024-01-13T17:55:17.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:17 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:17.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:17 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2131032384' entity='client.admin' 2024-01-13T17:55:17.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:17 smithi084 ceph-mon[37908]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:18.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:18 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/446034677' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-01-13T17:55:18.446 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:18 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ignoring --setuser ceph since I am not root 2024-01-13T17:55:18.446 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:18 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ignoring --setgroup ceph since I am not root 2024-01-13T17:55:18.744 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:18 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:18.449+0000 7f7cceec41c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T17:55:18.744 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:18 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:18.610+0000 7f7cceec41c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T17:55:19.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:18 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:18.924+0000 7f7cceec41c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T17:55:19.557 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:19.458+0000 7f7cceec41c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T17:55:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:19 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/446034677' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-01-13T17:55:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:19 smithi084 ceph-mon[37908]: mgrmap e9: y(active, since 14s) 2024-01-13T17:55:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:19 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3955068304' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-01-13T17:55:19.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-01-13T17:55:19.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-01-13T17:55:19.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-13T17:55:19.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-01-13T17:55:19.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-01-13T17:55:19.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-01-13T17:55:19.630 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-01-13T17:55:19.630 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 9... 2024-01-13T17:55:19.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:19.687+0000 7f7cceec41c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T17:55:20.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:20.053+0000 7f7cceec41c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T17:55:21.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:20.800+0000 7f7cceec41c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T17:55:21.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:20.884+0000 7f7cceec41c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T17:55:21.732 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:21 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:21.473+0000 7f7cceec41c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T17:55:21.732 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:21 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:21.554+0000 7f7cceec41c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T17:55:21.732 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:21 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:21.639+0000 7f7cceec41c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T17:55:21.732 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:21 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:21.730+0000 7f7cceec41c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T17:55:22.040 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:21 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:21.948+0000 7f7cceec41c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T17:55:22.340 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:22 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:22.039+0000 7f7cceec41c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T17:55:22.341 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:22 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:22.246+0000 7f7cceec41c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T17:55:22.600 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:22 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:22.339+0000 7f7cceec41c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T17:55:22.600 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:22 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:22.516+0000 7f7cceec41c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T17:55:22.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:22 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:22.599+0000 7f7cceec41c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T17:55:23.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:23 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:23.322+0000 7f7cceec41c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T17:55:23.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:23 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:23.509+0000 7f7cceec41c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T17:55:24.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:23 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:23.680+0000 7f7cceec41c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:55:24.617 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:24.266+0000 7f7cceec41c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T17:55:24.617 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:24.440+0000 7f7cceec41c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:55:24.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:24.616+0000 7f7cceec41c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T17:55:24.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:55:24.729+0000 7f7cceec41c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T17:55:25.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: Active manager daemon y restarted 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: Activating manager daemon y 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: osdmap e3: 0 total, 0 up, 0 in 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: mgrmap e10: y(active, starting, since 0.00380105s) 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: Manager daemon y is now available 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T17:55:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:24 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T17:55:26.104 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-01-13T17:55:26.104 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-01-13T17:55:26.104 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-01-13T17:55:26.104 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-01-13T17:55:26.104 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 9 is available 2024-01-13T17:55:26.105 INFO:teuthology.orchestra.run.smithi084.stdout:Generating a dashboard self-signed certificate... 2024-01-13T17:55:26.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:26 smithi084 ceph-mon[37908]: [13/Jan/2024:17:55:25] ENGINE Bus STARTING 2024-01-13T17:55:26.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:26 smithi084 ceph-mon[37908]: [13/Jan/2024:17:55:25] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T17:55:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:26 smithi084 ceph-mon[37908]: [13/Jan/2024:17:55:25] ENGINE Bus STARTED 2024-01-13T17:55:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:26 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:26 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:26 smithi084 ceph-mon[37908]: mgrmap e11: y(active, since 1.00553s) 2024-01-13T17:55:27.120 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-01-13T17:55:27.120 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial admin user... 2024-01-13T17:55:27.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:27 smithi084 ceph-mon[37908]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-01-13T17:55:27.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:27 smithi084 ceph-mon[37908]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-01-13T17:55:27.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:27 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:27.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:27 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:27.416 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:27 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:28.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:28 smithi084 ceph-mon[37908]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:28 smithi084 ceph-mon[37908]: mgrmap e12: y(active, since 2s) 2024-01-13T17:55:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:28 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$lP7oQ1E/88vumoO6OhzjZexPSfh/WXmiJ57OKWOgFrRIRGBWf3e8W", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1705168528, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-01-13T17:55:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:Fetching dashboard port number... 2024-01-13T17:55:29.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 8443 2024-01-13T17:55:29.386 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-13T17:55:29.387 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-01-13T17:55:29.394 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-13T17:55:29.394 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-01-13T17:55:29.394 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-01-13T17:55:29.394 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-01-13T17:55:29.396 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph Dashboard is now available at: 2024-01-13T17:55:29.396 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:55:29.396 INFO:teuthology.orchestra.run.smithi084.stdout: URL: https://smithi084.front.sepia.ceph.com:8443/ 2024-01-13T17:55:29.396 INFO:teuthology.orchestra.run.smithi084.stdout: User: admin 2024-01-13T17:55:29.396 INFO:teuthology.orchestra.run.smithi084.stdout: Password: yemxflypkr 2024-01-13T17:55:29.396 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:55:29.397 INFO:teuthology.orchestra.run.smithi084.stdout:Saving cluster configuration to /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config directory 2024-01-13T17:55:29.397 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling autotune for osd_memory_target 2024-01-13T17:55:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:29 smithi084 ceph-mon[37908]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:29 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1116581712' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-01-13T17:55:31.311 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout:Or, if you are only running a single cluster on this host: 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout:Please consider enabling telemetry to help improve Ceph: 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout: ceph telemetry on 2024-01-13T17:55:31.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:55:31.313 INFO:teuthology.orchestra.run.smithi084.stdout:For more information see: 2024-01-13T17:55:31.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:55:31.313 INFO:teuthology.orchestra.run.smithi084.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-01-13T17:55:31.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:55:31.313 INFO:teuthology.orchestra.run.smithi084.stdout:Bootstrap complete. 2024-01-13T17:55:31.346 INFO:tasks.cephadm:Fetching config... 2024-01-13T17:55:31.346 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:55:31.346 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-01-13T17:55:31.364 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-01-13T17:55:31.364 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:55:31.364 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-01-13T17:55:31.422 INFO:tasks.cephadm:Fetching mon keyring... 2024-01-13T17:55:31.422 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:55:31.422 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/keyring of=/dev/stdout 2024-01-13T17:55:31.490 INFO:tasks.cephadm:Fetching pub ssh key... 2024-01-13T17:55:31.490 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:55:31.490 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-01-13T17:55:31.548 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-01-13T17:55:31.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7TO6xvWzGypnGSxn6F6hCI/trrf15MImXz4lZGzZNeTT2CzhVO+gzWlJjM0b4f1oaRvGgDyUXsz3TUUWCdznjbmAZNZPRev629T9/5gYTq2koDWqKPbK2b7RRQSwdGzMNx8t7247IgO8X4Po0Go1InVu/XJe5jaT5n27mqlowJAwi6s1H3nYhoZkkEUZvDquVQdeRDwY+aL84TWwgNMYxFP1O23Lcf831rd+UP47Lme9pi1dxwBb2k79682dfSyYsxldjEaiZAXsdxWpY+H0Hxb89cmjEHhoUzbwUKHjg2I0LGm5EYI5T1zciekT7QpXeq0i4yN5ytIlPSEuZNF13BKmq1L19uWV9/n2kI8h3JvzCqPXVMbSU6E/Mjt6GXcFtsrnjvWdBo6q1SjZWvhCe6FCb0Oe/qzSxHvXHKor9BjkKWSnl6wjOKp8JVdcJfX/RqdcOzCYxSWHUNOXQwASjkALEIMxiU7BWaa6NNpEiUAoYZ9QjJQBdGHk2h8y7zU= ceph-be08b996-b23c-11ee-95ac-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-13T17:55:31.625 INFO:teuthology.orchestra.run.smithi084.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7TO6xvWzGypnGSxn6F6hCI/trrf15MImXz4lZGzZNeTT2CzhVO+gzWlJjM0b4f1oaRvGgDyUXsz3TUUWCdznjbmAZNZPRev629T9/5gYTq2koDWqKPbK2b7RRQSwdGzMNx8t7247IgO8X4Po0Go1InVu/XJe5jaT5n27mqlowJAwi6s1H3nYhoZkkEUZvDquVQdeRDwY+aL84TWwgNMYxFP1O23Lcf831rd+UP47Lme9pi1dxwBb2k79682dfSyYsxldjEaiZAXsdxWpY+H0Hxb89cmjEHhoUzbwUKHjg2I0LGm5EYI5T1zciekT7QpXeq0i4yN5ytIlPSEuZNF13BKmq1L19uWV9/n2kI8h3JvzCqPXVMbSU6E/Mjt6GXcFtsrnjvWdBo6q1SjZWvhCe6FCb0Oe/qzSxHvXHKor9BjkKWSnl6wjOKp8JVdcJfX/RqdcOzCYxSWHUNOXQwASjkALEIMxiU7BWaa6NNpEiUAoYZ9QjJQBdGHk2h8y7zU= ceph-be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:55:31.637 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7TO6xvWzGypnGSxn6F6hCI/trrf15MImXz4lZGzZNeTT2CzhVO+gzWlJjM0b4f1oaRvGgDyUXsz3TUUWCdznjbmAZNZPRev629T9/5gYTq2koDWqKPbK2b7RRQSwdGzMNx8t7247IgO8X4Po0Go1InVu/XJe5jaT5n27mqlowJAwi6s1H3nYhoZkkEUZvDquVQdeRDwY+aL84TWwgNMYxFP1O23Lcf831rd+UP47Lme9pi1dxwBb2k79682dfSyYsxldjEaiZAXsdxWpY+H0Hxb89cmjEHhoUzbwUKHjg2I0LGm5EYI5T1zciekT7QpXeq0i4yN5ytIlPSEuZNF13BKmq1L19uWV9/n2kI8h3JvzCqPXVMbSU6E/Mjt6GXcFtsrnjvWdBo6q1SjZWvhCe6FCb0Oe/qzSxHvXHKor9BjkKWSnl6wjOKp8JVdcJfX/RqdcOzCYxSWHUNOXQwASjkALEIMxiU7BWaa6NNpEiUAoYZ9QjJQBdGHk2h8y7zU= ceph-be08b996-b23c-11ee-95ac-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-13T17:55:31.682 INFO:teuthology.orchestra.run.smithi099.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7TO6xvWzGypnGSxn6F6hCI/trrf15MImXz4lZGzZNeTT2CzhVO+gzWlJjM0b4f1oaRvGgDyUXsz3TUUWCdznjbmAZNZPRev629T9/5gYTq2koDWqKPbK2b7RRQSwdGzMNx8t7247IgO8X4Po0Go1InVu/XJe5jaT5n27mqlowJAwi6s1H3nYhoZkkEUZvDquVQdeRDwY+aL84TWwgNMYxFP1O23Lcf831rd+UP47Lme9pi1dxwBb2k79682dfSyYsxldjEaiZAXsdxWpY+H0Hxb89cmjEHhoUzbwUKHjg2I0LGm5EYI5T1zciekT7QpXeq0i4yN5ytIlPSEuZNF13BKmq1L19uWV9/n2kI8h3JvzCqPXVMbSU6E/Mjt6GXcFtsrnjvWdBo6q1SjZWvhCe6FCb0Oe/qzSxHvXHKor9BjkKWSnl6wjOKp8JVdcJfX/RqdcOzCYxSWHUNOXQwASjkALEIMxiU7BWaa6NNpEiUAoYZ9QjJQBdGHk2h8y7zU= ceph-be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:55:31.694 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-01-13T17:55:31.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:31 smithi084 ceph-mon[37908]: mgrmap e13: y(active, since 6s) 2024-01-13T17:55:31.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:31 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3108352431' entity='client.admin' 2024-01-13T17:55:31.955 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:55:33.850 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-01-13T17:55:33.851 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-01-13T17:55:33.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:33.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:33.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:55:33.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:33.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:33.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:33.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:33 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/454572273' entity='client.admin' 2024-01-13T17:55:33.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:33.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:34.345 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:55:35.933 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi099 2024-01-13T17:55:35.933 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:55:35.933 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/etc/ceph/ceph.conf 2024-01-13T17:55:35.954 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:55:35.955 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:55:36.015 INFO:tasks.cephadm:Adding host smithi099 to orchestrator... 2024-01-13T17:55:36.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch host add smithi099 2024-01-13T17:55:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:55:36.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:36.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:55:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:55:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T17:55:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:55:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:55:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T17:55:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:36 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:38 smithi084 ceph-mon[37908]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi099", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:38 smithi084 ceph-mon[37908]: Deploying cephadm binary to smithi099 2024-01-13T17:55:39.099 INFO:teuthology.orchestra.run.smithi084.stdout:Added host 'smithi099' with addr '172.21.15.99' 2024-01-13T17:55:39.417 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch host ls --format=json 2024-01-13T17:55:39.671 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:55:40.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:40 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:40.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:40 smithi084 ceph-mon[37908]: Added host smithi099 2024-01-13T17:55:40.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:40 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:40.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:40 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:40.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:40 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:40.786 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:55:40.786 INFO:teuthology.orchestra.run.smithi084.stdout:[{"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.99", "hostname": "smithi099", "labels": [], "status": ""}] 2024-01-13T17:55:41.153 INFO:tasks.cephadm:Setting crush tunables to default 2024-01-13T17:55:41.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd crush tunables default 2024-01-13T17:55:41.407 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:55:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:41 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:41 smithi084 ceph-mon[37908]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:55:42.568 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2024-01-13T17:55:42.835 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:42 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2331298890' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-01-13T17:55:42.927 INFO:tasks.cephadm:Adding mon.a on smithi084 2024-01-13T17:55:42.928 INFO:tasks.cephadm:Adding mon.c on smithi084 2024-01-13T17:55:42.928 INFO:tasks.cephadm:Adding mon.b on smithi099 2024-01-13T17:55:42.928 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch apply mon '3;smithi084:172.21.15.84=a;smithi084:[v2:172.21.15.84:3301,v1:172.21.15.84:6790]=c;smithi099:172.21.15.99=b' 2024-01-13T17:55:43.209 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-01-13T17:55:43.270 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:55:43.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2331298890' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-01-13T17:55:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: osdmap e4: 0 total, 0 up, 0 in 2024-01-13T17:55:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:55:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:55:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:55:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T17:55:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:55:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:43 smithi084 ceph-mon[37908]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:55:44.449 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled mon update... 2024-01-13T17:55:44.822 DEBUG:teuthology.orchestra.run.smithi084:mon.c> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.c.service 2024-01-13T17:55:44.824 DEBUG:teuthology.orchestra.run.smithi099:mon.b> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.b.service 2024-01-13T17:55:44.826 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-13T17:55:44.826 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph mon dump -f json 2024-01-13T17:55:44.855 INFO:journalctl@ceph.mon.b.smithi099.stdout:-- Logs begin at Sat 2024-01-13 17:16:04 UTC. -- 2024-01-13T17:55:44.881 INFO:journalctl@ceph.mon.c.smithi084.stdout:-- Logs begin at Sat 2024-01-13 17:16:05 UTC. -- 2024-01-13T17:55:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:44 smithi084 ceph-mon[37908]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T17:55:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:55:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:55:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:55:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:55:45.272 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:55:46.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:45 smithi084 ceph-mon[37908]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi084:[v2:172.21.15.84:3301,v1:172.21.15.84:6790]=c;smithi099:172.21.15.99=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:46.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:45 smithi084 ceph-mon[37908]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi084:[v2:172.21.15.84:3301,v1:172.21.15.84:6790]=c;smithi099:172.21.15.99=b;count:3 2024-01-13T17:55:46.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:45 smithi084 ceph-mon[37908]: Deploying daemon mon.b on smithi099 2024-01-13T17:55:46.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:45 smithi084 ceph-mon[37908]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:55:47.104 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","modified":"2024-01-13T17:54:38.557528Z","created":"2024-01-13T17:54:38.557528Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-01-13T17:55:47.105 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-01-13T17:55:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:47 smithi099 ceph-mon[71325]: mon.b@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2024-01-13T17:55:48.582 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-13T17:55:48.583 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph mon dump -f json 2024-01-13T17:55:48.850 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:55:52.869 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:55:52.869 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: mon.a calling monitor election 2024-01-13T17:55:52.869 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.869 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.869 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:52.869 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.869 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: mon.b calling monitor election 2024-01-13T17:55:52.869 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.869 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: monmap e2: 2 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: fsmap 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: osdmap e4: 0 total, 0 up, 0 in 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: mgrmap e13: y(active, since 27s) 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: overall HEALTH_OK 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:55:52.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:55:52.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:55:52.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: mon.a calling monitor election 2024-01-13T17:55:52.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:52.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: mon.b calling monitor election 2024-01-13T17:55:52.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:52.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:52.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-01-13T17:55:52.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: monmap e2: 2 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T17:55:52.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: fsmap 2024-01-13T17:55:52.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: osdmap e4: 0 total, 0 up, 0 in 2024-01-13T17:55:52.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: mgrmap e13: y(active, since 27s) 2024-01-13T17:55:52.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: overall HEALTH_OK 2024-01-13T17:55:52.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:52.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:52.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:52.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:55:52.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:55:53.093 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:55:53.093 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":2,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","modified":"2024-01-13T17:55:47.395323Z","created":"2024-01-13T17:54:38.557528Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-01-13T17:55:53.095 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 2 2024-01-13T17:55:53.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:53 smithi084 ceph-mon[37908]: Deploying daemon mon.c on smithi084 2024-01-13T17:55:53.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:53 smithi084 ceph-mon[37908]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:53.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:53 smithi084 ceph-mon[37908]: from='client.? 172.21.15.99:0/57438885' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-13T17:55:53.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:53 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:53 smithi099 ceph-mon[71325]: Deploying daemon mon.c on smithi084 2024-01-13T17:55:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:53 smithi099 ceph-mon[71325]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:53 smithi099 ceph-mon[71325]: from='client.? 172.21.15.99:0/57438885' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-13T17:55:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:53 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:54.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 systemd[1]: Starting Ceph mon.c for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:55:54.454 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-13T17:55:54.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph mon dump -f json 2024-01-13T17:55:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:55:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: set uid:gid to 167:167 (ceph:ceph) 2024-01-13T17:55:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable), process ceph-mon, pid 7 2024-01-13T17:55:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: pidfile_write: ignore empty --pid-file 2024-01-13T17:55:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: load: jerasure load: lrc 2024-01-13T17:55:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: RocksDB version: 6.15.5 2024-01-13T17:55:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-01-13T17:55:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Compile date Jan 9 2024 2024-01-13T17:55:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: DB SUMMARY 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: DB Session ID: VNZ82WQJJ7X9CF9KRCIJ 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: CURRENT file: CURRENT 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: IDENTITY file: IDENTITY 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 636 ; 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.error_if_exists: 0 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.create_if_missing: 0 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.paranoid_checks: 1 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.env: 0x558a4f5d9a80 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.fs: Posix File System 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.info_log: 0x558a502e5dc0 2024-01-13T17:55:54.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_file_opening_threads: 16 2024-01-13T17:55:54.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.statistics: (nil) 2024-01-13T17:55:54.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.use_fsync: 0 2024-01-13T17:55:54.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_log_file_size: 0 2024-01-13T17:55:54.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-13T17:55:54.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-13T17:55:54.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.keep_log_file_num: 1000 2024-01-13T17:55:54.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.recycle_log_file_num: 0 2024-01-13T17:55:54.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.allow_fallocate: 1 2024-01-13T17:55:54.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.allow_mmap_reads: 0 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.allow_mmap_writes: 0 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.use_direct_reads: 0 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.create_missing_column_families: 0 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.db_log_dir: 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-13T17:55:54.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.advise_random_on_open: 1 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.db_write_buffer_size: 0 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.write_buffer_manager: 0x558a50fd8930 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.rate_limiter: (nil) 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.wal_recovery_mode: 2 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.enable_thread_tracking: 0 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.enable_pipelined_write: 0 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.unordered_write: 0 2024-01-13T17:55:54.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.row_cache: None 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.wal_filter: None 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.allow_ingest_behind: 0 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.preserve_deletes: 0 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.two_write_queues: 0 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.manual_wal_flush: 0 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.atomic_flush: 0 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-13T17:55:54.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.log_readahead_size: 0 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.best_efforts_recovery: 0 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.allow_data_in_errors: 0 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.db_host_id: __hostname__ 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_background_jobs: 2 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_background_compactions: -1 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_subcompactions: 1 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_total_wal_size: 0 2024-01-13T17:55:54.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 bash[52290]: 510574f8be07267ba3827f03395ddc545b108be4f5cb4bead1a5e578675060ee 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_open_files: -1 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.bytes_per_sync: 0 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_readahead_size: 0 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_background_flushes: -1 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Compression algorithms supported: 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: kZSTD supported: 0 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: kXpressCompression supported: 0 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: kLZ4HCCompression supported: 1 2024-01-13T17:55:54.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: kZlibCompression supported: 1 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: kSnappyCompression supported: 1 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: kLZ4Compression supported: 1 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: kBZip2Compression supported: 0 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.merge_operator: 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_filter: None 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_filter_factory: None 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.sst_partitioner_factory: None 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558a502b8f90) 2024-01-13T17:55:54.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_type: 0 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: data_block_index_type: 0 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_shortening: 1 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: hash_index_allow_collision: 1 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: checksum: 1 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: no_block_cache: 0 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache: 0x558a502eb090 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_options: 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: capacity : 536870912 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: num_shard_bits : 4 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: strict_capacity_limit : 0 2024-01-13T17:55:54.941 INFO:journalctl@ceph.mon.c.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_compressed: (nil) 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: persistent_cache: (nil) 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_size: 4096 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_size_deviation: 10 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_restart_interval: 16 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_block_restart_interval: 1 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: metadata_block_size: 4096 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: partition_filters: 0 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: use_delta_encoding: 1 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: whole_key_filtering: 1 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: verify_compression: 0 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: format_version: 4 2024-01-13T17:55:54.942 INFO:journalctl@ceph.mon.c.smithi084.stdout: enable_index_compression: 1 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_align: 0 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.write_buffer_size: 33554432 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_write_buffer_number: 2 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compression: NoCompression 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.bottommost_compression: Disabled 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.prefix_extractor: nullptr 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.num_levels: 7 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-13T17:55:54.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compression_opts.level: 32767 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compression_opts.strategy: 0 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compression_opts.enabled: false 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.target_file_size_base: 67108864 2024-01-13T17:55:54.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.arena_block_size: 4194304 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-13T17:55:54.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.disable_auto_compactions: 0 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.table_properties_collectors: 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.inplace_update_support: 0 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-13T17:55:54.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.bloom_locality: 0 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.max_successive_merges: 0 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.paranoid_file_checks: 0 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.force_consistency_checks: 1 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.report_bg_io_stats: 0 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.ttl: 2592000 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.enable_blob_files: false 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.min_blob_size: 0 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.blob_file_size: 268435456 2024-01-13T17:55:54.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168554484387, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168554484652, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1670, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1705168554, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "e667bb2f-9cd2-4b95-92b1-959a973ee9d9", "db_session_id": "VNZ82WQJJ7X9CF9KRCIJ"}} 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168554484959, "job": 1, "event": "recovery_finished"} 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x558a5027f180 2024-01-13T17:55:54.948 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: DB pointer 0x558a50354000 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** DB Stats ** 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2024-01-13T17:55:54.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T17:55:54.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.5 0.00 0.00 1 0.000 0 0 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-13T17:55:54.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: using public_addrv [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: starting mon.c rank -1 at public addrs [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] at bind addrs [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(???) e0 preinit fsid be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 systemd[1]: Started Ceph mon.c for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).mds e1 new map 2024-01-13T17:55:54.952 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).mds e1 print_map 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: e1 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: legacy client fscid: -1 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: No filesystems configured 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-13T17:55:54.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-13T17:55:54.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mkfs be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:55:54.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-13T17:55:54.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-13T17:55:54.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: monmap e1: 1 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T17:55:54.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: fsmap 2024-01-13T17:55:54.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: osdmap e1: 0 total, 0 up, 0 in 2024-01-13T17:55:54.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e1: no daemons active 2024-01-13T17:55:54.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/619941726' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-01-13T17:55:54.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2322662286' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-01-13T17:55:54.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2322662286' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-01-13T17:55:54.955 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-13T17:55:54.955 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: monmap e1: 1 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T17:55:54.955 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: fsmap 2024-01-13T17:55:54.955 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: osdmap e1: 0 total, 0 up, 0 in 2024-01-13T17:55:54.955 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e1: no daemons active 2024-01-13T17:55:54.955 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2630425797' entity='client.admin' 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1358599061' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3766323183' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3317438119' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Activating manager daemon y 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e2: y(active, starting, since 0.00288278s) 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Manager daemon y is now available 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T17:55:54.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14100 172.21.15.84:0/2306524530' entity='mgr.y' 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e3: y(active, since 1.00607s) 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/68228008' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e4: y(active, since 3s) 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/234596188' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3534422797' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3534422797' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e5: y(active, since 5s) 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/4225349389' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Active manager daemon y restarted 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Activating manager daemon y 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: osdmap e2: 0 total, 0 up, 0 in 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e6: y(active, starting, since 0.00307492s) 2024-01-13T17:55:54.957 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Manager daemon y is now available 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Found migration_current of "None". Setting to last migration. 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e7: y(active, since 1.0051s) 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-01-13T17:55:54.958 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: [13/Jan/2024:17:55:04] ENGINE Bus STARTING 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: [13/Jan/2024:17:55:05] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: [13/Jan/2024:17:55:05] ENGINE Bus STARTED 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e8: y(active, since 2s) 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Generating ssh key... 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.959 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi084", "addr": "172.21.15.84", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Deploying cephadm binary to smithi084 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Added host smithi084 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Saving service mon spec with placement count:5 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Saving service mgr spec with placement count:2 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/349048563' entity='client.admin' 2024-01-13T17:55:54.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2131032384' entity='client.admin' 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14120 172.21.15.84:0/464883124' entity='mgr.y' 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/446034677' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/446034677' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e9: y(active, since 14s) 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3955068304' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Active manager daemon y restarted 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Activating manager daemon y 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: osdmap e3: 0 total, 0 up, 0 in 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e10: y(active, starting, since 0.00380105s) 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T17:55:54.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Manager daemon y is now available 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: [13/Jan/2024:17:55:25] ENGINE Bus STARTING 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: [13/Jan/2024:17:55:25] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: [13/Jan/2024:17:55:25] ENGINE Bus STARTED 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e11: y(active, since 1.00553s) 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.962 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e12: y(active, since 2s) 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1116581712' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e13: y(active, since 6s) 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3108352431' entity='client.admin' 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/454572273' entity='client.admin' 2024-01-13T17:55:54.963 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.964 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi099", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Deploying cephadm binary to smithi099 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Added host smithi099 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2331298890' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2331298890' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: osdmap e4: 0 total, 0 up, 0 in 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi084:[v2:172.21.15.84:3301,v1:172.21.15.84:6790]=c;smithi099:172.21.15.99=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi084:[v2:172.21.15.84:3301,v1:172.21.15.84:6790]=c;smithi099:172.21.15.99=b;count:3 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Deploying daemon mon.b on smithi099 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.a calling monitor election 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.b calling monitor election 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:54.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: monmap e2: 2 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: fsmap 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: osdmap e4: 0 total, 0 up, 0 in 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mgrmap e13: y(active, since 27s) 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: overall HEALTH_OK 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: Deploying daemon mon.c on smithi084 2024-01-13T17:55:54.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:54.969 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='client.? 172.21.15.99:0/57438885' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-13T17:55:54.969 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:54.969 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-01-13T17:55:54.969 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:54 smithi084 ceph-mon[52328]: mon.c@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2024-01-13T17:55:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:55:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: mon.a calling monitor election 2024-01-13T17:55:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: mon.b calling monitor election 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: mon.c calling monitor election 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: fsmap 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: osdmap e4: 0 total, 0 up, 0 in 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: mgrmap e13: y(active, since 34s) 2024-01-13T17:55:59.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: overall HEALTH_OK 2024-01-13T17:55:59.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:59.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:59.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:59.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:55:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:59.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: mon.a calling monitor election 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: mon.b calling monitor election 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: mon.c calling monitor election 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: fsmap 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: osdmap e4: 0 total, 0 up, 0 in 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: mgrmap e13: y(active, since 34s) 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: overall HEALTH_OK 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: mon.a calling monitor election 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:55:59.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: mon.b calling monitor election 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: mon.c calling monitor election 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: fsmap 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: osdmap e4: 0 total, 0 up, 0 in 2024-01-13T17:55:59.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: mgrmap e13: y(active, since 34s) 2024-01-13T17:55:59.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: overall HEALTH_OK 2024-01-13T17:55:59.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:59.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:59.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:55:59.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:55:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-13T17:56:00.407 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":3,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","modified":"2024-01-13T17:55:54.514731Z","created":"2024-01-13T17:54:38.557528Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3301","nonce":0},{"type":"v1","addr":"172.21.15.84:6790","nonce":0}]},"addr":"172.21.15.84:6790/0","public_addr":"172.21.15.84:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-01-13T17:56:00.409 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 3 2024-01-13T17:56:00.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:00.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.823 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-01-13T17:56:00.823 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph config generate-minimal-conf 2024-01-13T17:56:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:00 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:00 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:00 smithi099 ceph-mon[71325]: from='client.? 172.21.15.99:0/3227236375' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-13T17:56:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:00 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:00 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:00 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:56:00.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:00 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:00 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:00 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:00.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:00 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:00.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[52328]: from='client.? 172.21.15.99:0/3227236375' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-13T17:56:00.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:56:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:00.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:00.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[37908]: from='client.? 172.21.15.99:0/3227236375' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-13T17:56:00.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:56:00.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:00.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:00.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:00 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:01.093 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:56:02.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T17:56:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T17:56:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:56:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:56:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: Reconfiguring mon.a (unknown last config time)... 2024-01-13T17:56:02.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:56:02.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T17:56:02.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:02.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[37908]: Reconfiguring daemon mon.a on smithi084 2024-01-13T17:56:02.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T17:56:02.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T17:56:02.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: Reconfiguring mon.a (unknown last config time)... 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:02.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:02 smithi084 ceph-mon[52328]: Reconfiguring daemon mon.a on smithi084 2024-01-13T17:56:02.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T17:56:02.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T17:56:02.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:02.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:56:02.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:56:02.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:02.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: Reconfiguring mon.a (unknown last config time)... 2024-01-13T17:56:02.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:56:02.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T17:56:02.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:02.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:02 smithi099 ceph-mon[71325]: Reconfiguring daemon mon.a on smithi084 2024-01-13T17:56:02.674 INFO:teuthology.orchestra.run.smithi084.stdout:# minimal ceph.conf for be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:56:02.674 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-01-13T17:56:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T17:56:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: mon_host = [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] 2024-01-13T17:56:03.051 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-01-13T17:56:03.051 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:56:03.051 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.conf 2024-01-13T17:56:03.080 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:56:03.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:56:03.147 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:56:03.147 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.conf 2024-01-13T17:56:03.182 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:56:03.183 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:56:03.253 INFO:tasks.cephadm:Adding mgr.y on smithi084 2024-01-13T17:56:03.254 INFO:tasks.cephadm:Adding mgr.x on smithi099 2024-01-13T17:56:03.254 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch apply mgr '2;smithi084=y;smithi099=x' 2024-01-13T17:56:03.549 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:56:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:03 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:03 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:03 smithi099 ceph-mon[71325]: Reconfiguring mon.c (monmap changed)... 2024-01-13T17:56:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:03 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:56:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:03 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T17:56:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:03 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:03 smithi099 ceph-mon[71325]: Reconfiguring daemon mon.c on smithi084 2024-01-13T17:56:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:03 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3677990787' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:03 smithi099 ceph-mon[71325]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:03.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[37908]: Reconfiguring mon.c (monmap changed)... 2024-01-13T17:56:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:56:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T17:56:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[37908]: Reconfiguring daemon mon.c on smithi084 2024-01-13T17:56:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3677990787' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[37908]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[52328]: Reconfiguring mon.c (monmap changed)... 2024-01-13T17:56:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:56:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T17:56:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[52328]: Reconfiguring daemon mon.c on smithi084 2024-01-13T17:56:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3677990787' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:03 smithi084 ceph-mon[52328]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:04.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:04.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:04.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:04 smithi099 ceph-mon[71325]: Reconfiguring mon.b (monmap changed)... 2024-01-13T17:56:04.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:56:04.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T17:56:04.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:04.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:04 smithi099 ceph-mon[71325]: Reconfiguring daemon mon.b on smithi099 2024-01-13T17:56:04.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:04.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[37908]: Reconfiguring mon.b (monmap changed)... 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[37908]: Reconfiguring daemon mon.b on smithi099 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[52328]: Reconfiguring mon.b (monmap changed)... 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:04 smithi084 ceph-mon[52328]: Reconfiguring daemon mon.b on smithi099 2024-01-13T17:56:04.953 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled mgr update... 2024-01-13T17:56:05.316 DEBUG:teuthology.orchestra.run.smithi099:mgr.x> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.x.service 2024-01-13T17:56:05.431 INFO:tasks.cephadm:Deploying OSDs... 2024-01-13T17:56:05.431 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:56:05.431 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-01-13T17:56:05.455 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-13T17:56:05.455 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-01-13T17:56:05.460 INFO:journalctl@ceph.mgr.x.smithi099.stdout:-- Logs begin at Sat 2024-01-13 17:16:04 UTC. -- 2024-01-13T17:56:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-13T17:56:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-13T17:56:05.518 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 162669 Links: 1 2024-01-13T17:56:05.518 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-13T17:56:05.518 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-01-13T17:56:05.518 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-01-13 17:55:54.127808696 +0000 2024-01-13T17:56:05.518 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-01-13 17:34:25.995565545 +0000 2024-01-13T17:56:05.518 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-01-13 17:34:25.995565545 +0000 2024-01-13T17:56:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-01-13T17:56:05.518 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-13T17:56:05.589 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-01-13T17:56:05.589 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-01-13T17:56:05.589 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000274236 s, 1.9 MB/s 2024-01-13T17:56:05.590 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-13T17:56:05.653 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-01-13T17:56:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-13T17:56:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-13T17:56:05.714 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 165056 Links: 1 2024-01-13T17:56:05.714 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-13T17:56:05.714 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-01-13T17:56:05.714 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-01-13 17:55:54.127808696 +0000 2024-01-13T17:56:05.714 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-01-13 17:34:26.333559587 +0000 2024-01-13T17:56:05.714 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-01-13 17:34:26.333559587 +0000 2024-01-13T17:56:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-01-13T17:56:05.714 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-13T17:56:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-01-13T17:56:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-01-13T17:56:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000216916 s, 2.4 MB/s 2024-01-13T17:56:05.783 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-13T17:56:05.843 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-01-13T17:56:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-13T17:56:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-13T17:56:05.902 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 162736 Links: 1 2024-01-13T17:56:05.902 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-13T17:56:05.902 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-01-13T17:56:05.902 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-01-13 17:55:54.127808696 +0000 2024-01-13T17:56:05.902 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-01-13 17:34:26.706553012 +0000 2024-01-13T17:56:05.902 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-01-13 17:34:26.706553012 +0000 2024-01-13T17:56:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-01-13T17:56:05.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-13T17:56:05.969 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-01-13T17:56:05.969 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-01-13T17:56:05.969 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000185775 s, 2.8 MB/s 2024-01-13T17:56:05.970 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-13T17:56:06.030 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-01-13T17:56:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-13T17:56:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-13T17:56:06.089 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 162773 Links: 1 2024-01-13T17:56:06.089 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-13T17:56:06.089 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-01-13T17:56:06.089 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-01-13 17:55:54.127808696 +0000 2024-01-13T17:56:06.089 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-01-13 17:34:27.047547002 +0000 2024-01-13T17:56:06.089 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-01-13 17:34:27.047547002 +0000 2024-01-13T17:56:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-01-13T17:56:06.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-13T17:56:06.155 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-01-13T17:56:06.155 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-01-13T17:56:06.155 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000316674 s, 1.6 MB/s 2024-01-13T17:56:06.156 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-13T17:56:06.215 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:56:06.215 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-01-13T17:56:06.235 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-13T17:56:06.235 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-01-13T17:56:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-13T17:56:06.294 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-13T17:56:06.294 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 193815 Links: 1 2024-01-13T17:56:06.294 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-13T17:56:06.294 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-01-13T17:56:06.294 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-13 17:56:06.114774094 +0000 2024-01-13T17:56:06.294 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-13 17:34:28.085940355 +0000 2024-01-13T17:56:06.294 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-13 17:34:28.085940355 +0000 2024-01-13T17:56:06.295 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-01-13T17:56:06.295 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-13T17:56:06.360 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:06 smithi099 systemd[1]: Starting Ceph mgr.x for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi084=y;smithi099=x", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: Saving service mgr spec with placement smithi084=y;smithi099=x;count:2 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T17:56:06.361 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-13T17:56:06.362 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T17:56:06.362 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:06.362 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:05 smithi099 ceph-mon[71325]: Deploying daemon mgr.x on smithi099 2024-01-13T17:56:06.363 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-13T17:56:06.363 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-13T17:56:06.363 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000216589 s, 2.4 MB/s 2024-01-13T17:56:06.364 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-13T17:56:06.423 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-01-13T17:56:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi084=y;smithi099=x", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: Saving service mgr spec with placement smithi084=y;smithi099=x;count:2 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[37908]: Deploying daemon mgr.x on smithi099 2024-01-13T17:56:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi084=y;smithi099=x", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: Saving service mgr spec with placement smithi084=y;smithi099=x;count:2 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:05 smithi084 ceph-mon[52328]: Deploying daemon mgr.x on smithi099 2024-01-13T17:56:06.480 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-13T17:56:06.481 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-13T17:56:06.481 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 191335 Links: 1 2024-01-13T17:56:06.481 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-13T17:56:06.481 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-01-13T17:56:06.481 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-13 17:56:06.114774094 +0000 2024-01-13T17:56:06.481 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-13 17:34:28.413932877 +0000 2024-01-13T17:56:06.481 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-13 17:34:28.413932877 +0000 2024-01-13T17:56:06.481 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-01-13T17:56:06.481 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-13T17:56:06.547 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-13T17:56:06.547 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-13T17:56:06.548 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000204796 s, 2.5 MB/s 2024-01-13T17:56:06.548 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-13T17:56:06.609 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-01-13T17:56:06.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:06 smithi099 ceph-mgr[73466]: -- 172.21.15.99:0/2283272203 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5615114329c0 con 0x561511408800 2024-01-13T17:56:06.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:06 smithi099 bash[73312]: 6873f77bac1c7f2e2ef62c84e1a6d1459be385f094da875e6766cf7abed24f38 2024-01-13T17:56:06.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:06 smithi099 systemd[1]: Started Ceph mgr.x for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:56:06.636 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-13T17:56:06.636 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-13T17:56:06.637 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 191438 Links: 1 2024-01-13T17:56:06.637 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-13T17:56:06.637 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-01-13T17:56:06.637 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-13 17:56:06.114774094 +0000 2024-01-13T17:56:06.637 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-13 17:34:28.757925034 +0000 2024-01-13T17:56:06.637 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-13 17:34:28.757925034 +0000 2024-01-13T17:56:06.637 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-01-13T17:56:06.637 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-13T17:56:06.703 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-13T17:56:06.704 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-13T17:56:06.704 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000209327 s, 2.4 MB/s 2024-01-13T17:56:06.705 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-13T17:56:06.764 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-01-13T17:56:06.826 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-13T17:56:06.826 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-13T17:56:06.826 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 190131 Links: 1 2024-01-13T17:56:06.826 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-13T17:56:06.826 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-01-13T17:56:06.827 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-13 17:56:06.115774071 +0000 2024-01-13T17:56:06.827 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-13 17:34:29.105917101 +0000 2024-01-13T17:56:06.827 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-13 17:34:29.105917101 +0000 2024-01-13T17:56:06.827 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-01-13T17:56:06.827 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-13T17:56:06.907 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-13T17:56:06.907 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-13T17:56:06.907 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000228569 s, 2.2 MB/s 2024-01-13T17:56:06.908 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-13T17:56:06.967 INFO:tasks.cephadm:Deploying osd.0 on smithi084 with /dev/vg_nvme/lv_4... 2024-01-13T17:56:06.967 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-13T17:56:07.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:06 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:06.709+0000 7febe3e631c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T17:56:07.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:06 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:06.877+0000 7febe3e631c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T17:56:07.218 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:56:07.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:07.206+0000 7febe3e631c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T17:56:07.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[37908]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:07.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[52328]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:07.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:07 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:07.983 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:07.757+0000 7febe3e631c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T17:56:07.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:07 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:07 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:07 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:07 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:07.984 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:07 smithi099 ceph-mon[71325]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:07.984 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:07 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:08.316 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:07.980+0000 7febe3e631c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T17:56:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-13T17:56:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-13T17:56:08.467 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-01-13T17:56:08.467 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-01-13T17:56:08.467 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.01289 s, 813 MB/s 2024-01-13T17:56:08.467 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-01-13T17:56:08.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:08.313+0000 7febe3e631c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T17:56:08.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:08.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:08.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:08.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:08.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:08.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[37908]: Reconfiguring mgr.y (unknown last config time)... 2024-01-13T17:56:08.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T17:56:08.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T17:56:08.872 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:08.872 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[37908]: Reconfiguring daemon mgr.y on smithi084 2024-01-13T17:56:08.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:08.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:08.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:08.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:08.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:08.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[52328]: Reconfiguring mgr.y (unknown last config time)... 2024-01-13T17:56:08.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T17:56:08.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T17:56:08.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:08.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:08 smithi084 ceph-mon[52328]: Reconfiguring daemon mgr.y on smithi084 2024-01-13T17:56:08.931 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch daemon add osd smithi084:vg_nvme/lv_4 2024-01-13T17:56:09.065 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:08 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:08 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:08 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:09.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:08 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:09.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:08 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:08 smithi099 ceph-mon[71325]: Reconfiguring mgr.y (unknown last config time)... 2024-01-13T17:56:09.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:08 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T17:56:09.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:08 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T17:56:09.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:08 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:09.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:08 smithi099 ceph-mon[71325]: Reconfiguring daemon mgr.y on smithi084 2024-01-13T17:56:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:56:09.369 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:09.063+0000 7febe3e631c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T17:56:09.369 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:09.146+0000 7febe3e631c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T17:56:09.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[37908]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:09.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[52328]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:09 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.988 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-mon[71325]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:09.988 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.988 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.988 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:09.988 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:09.988 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:09.988 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:09.988 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:09.730+0000 7febe3e631c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T17:56:09.988 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:09.812+0000 7febe3e631c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T17:56:09.989 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:09.896+0000 7febe3e631c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T17:56:09.989 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:09 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:09.985+0000 7febe3e631c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T17:56:10.296 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:10 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:10.204+0000 7febe3e631c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T17:56:10.593 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:10 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:10.293+0000 7febe3e631c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T17:56:10.593 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:10 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:10.499+0000 7febe3e631c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T17:56:10.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:10 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:10.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:10 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:10.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:10 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:10.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:10 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:10.853 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:10 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:10.590+0000 7febe3e631c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T17:56:10.853 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:10 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:10.767+0000 7febe3e631c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T17:56:11.025 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:10 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:11.025 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:10 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:11.025 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:10 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:11.026 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:10 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:11.026 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:10 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:11.026 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:10 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:11.026 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:10 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:11.026 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:10 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:11.118 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:10 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:10.850+0000 7febe3e631c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T17:56:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:11 smithi099 ceph-mon[71325]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:11 smithi099 ceph-mon[71325]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:11.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:11 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:11.569+0000 7febe3e631c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T17:56:11.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:11 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:11.752+0000 7febe3e631c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T17:56:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:11 smithi084 ceph-mon[37908]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:11 smithi084 ceph-mon[37908]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:11 smithi084 ceph-mon[52328]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:11 smithi084 ceph-mon[52328]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:12.369 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:11 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:11.923+0000 7febe3e631c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:56:12.809 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:12 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:12.506+0000 7febe3e631c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T17:56:12.809 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:12 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:12.678+0000 7febe3e631c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:56:13.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:12 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:12.851+0000 7febe3e631c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T17:56:13.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:56:12 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:56:12.962+0000 7febe3e631c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T17:56:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:12 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1993624415' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b5ccde8-894c-4122-9298-abbb2e68bb8a"}]: dispatch 2024-01-13T17:56:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:12 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b5ccde8-894c-4122-9298-abbb2e68bb8a"}]: dispatch 2024-01-13T17:56:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:12 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b5ccde8-894c-4122-9298-abbb2e68bb8a"}]': finished 2024-01-13T17:56:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:12 smithi099 ceph-mon[71325]: osdmap e5: 1 total, 0 up, 1 in 2024-01-13T17:56:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:12 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:12 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3602352825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:56:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1993624415' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b5ccde8-894c-4122-9298-abbb2e68bb8a"}]: dispatch 2024-01-13T17:56:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b5ccde8-894c-4122-9298-abbb2e68bb8a"}]: dispatch 2024-01-13T17:56:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b5ccde8-894c-4122-9298-abbb2e68bb8a"}]': finished 2024-01-13T17:56:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[37908]: osdmap e5: 1 total, 0 up, 1 in 2024-01-13T17:56:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3602352825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:56:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1993624415' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b5ccde8-894c-4122-9298-abbb2e68bb8a"}]: dispatch 2024-01-13T17:56:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b5ccde8-894c-4122-9298-abbb2e68bb8a"}]: dispatch 2024-01-13T17:56:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b5ccde8-894c-4122-9298-abbb2e68bb8a"}]': finished 2024-01-13T17:56:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[52328]: osdmap e5: 1 total, 0 up, 1 in 2024-01-13T17:56:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:12 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3602352825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:56:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:13 smithi099 ceph-mon[71325]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:13 smithi099 ceph-mon[71325]: Standby manager daemon x started 2024-01-13T17:56:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:13 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T17:56:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:13 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T17:56:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:13 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T17:56:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:13 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T17:56:14.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[37908]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[37908]: Standby manager daemon x started 2024-01-13T17:56:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T17:56:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T17:56:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T17:56:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T17:56:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[52328]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[52328]: Standby manager daemon x started 2024-01-13T17:56:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T17:56:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T17:56:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T17:56:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:13 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/2877547235' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T17:56:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:14 smithi099 ceph-mon[71325]: mgrmap e14: y(active, since 49s), standbys: x 2024-01-13T17:56:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T17:56:15.125 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:14 smithi084 ceph-mon[52328]: mgrmap e14: y(active, since 49s), standbys: x 2024-01-13T17:56:15.125 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T17:56:15.126 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:14 smithi084 ceph-mon[37908]: mgrmap e14: y(active, since 49s), standbys: x 2024-01-13T17:56:15.126 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T17:56:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:15 smithi099 ceph-mon[71325]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:16.373 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:15 smithi084 ceph-mon[37908]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:16.373 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:15 smithi084 ceph-mon[52328]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:18.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:17 smithi084 ceph-mon[37908]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:18.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:17 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-13T17:56:18.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:17 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:18.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:17 smithi084 ceph-mon[37908]: Deploying daemon osd.0 on smithi084 2024-01-13T17:56:18.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:17 smithi084 ceph-mon[52328]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:18.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:17 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-13T17:56:18.174 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:17 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:18.174 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:17 smithi084 ceph-mon[52328]: Deploying daemon osd.0 on smithi084 2024-01-13T17:56:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:17 smithi099 ceph-mon[71325]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:17 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-13T17:56:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:17 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:17 smithi099 ceph-mon[71325]: Deploying daemon osd.0 on smithi084 2024-01-13T17:56:20.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:19 smithi084 ceph-mon[37908]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:20.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:19 smithi084 ceph-mon[52328]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:20.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:19 smithi099 ceph-mon[71325]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:21.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:21 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:21.741 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:21 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:21.741 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:21 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:21.741 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:21 smithi084 ceph-mon[37908]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:21.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:21 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:21.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:21 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:21.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:21 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:21.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:21 smithi084 ceph-mon[52328]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:21 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:21 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:21 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:21 smithi099 ceph-mon[71325]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:22.586 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 0 on host 'smithi084' 2024-01-13T17:56:22.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:22.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:22.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:22.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:22.960 DEBUG:teuthology.orchestra.run.smithi084:osd.0> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.0.service 2024-01-13T17:56:22.963 INFO:tasks.cephadm:Deploying osd.1 on smithi084 with /dev/vg_nvme/lv_3... 2024-01-13T17:56:22.963 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-13T17:56:22.992 INFO:journalctl@ceph.osd.0.smithi084.stdout:-- Logs begin at Sat 2024-01-13 17:16:05 UTC. -- 2024-01-13T17:56:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:23.504 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:56:24.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:23 smithi084 ceph-mon[37908]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:24.015 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:23 smithi084 ceph-mon[52328]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:24.015 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 17:56:23 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[56997]: 2024-01-13T17:56:23.707+0000 7ff1c81b4540 -1 osd.0 0 log_to_monitors true 2024-01-13T17:56:24.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:23 smithi099 ceph-mon[71325]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:24.762 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-13T17:56:24.762 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-13T17:56:24.762 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-01-13T17:56:24.762 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-01-13T17:56:24.762 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0120764 s, 868 MB/s 2024-01-13T17:56:24.762 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-01-13T17:56:24.989 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:24 smithi084 ceph-mon[52328]: from='osd.0 [v2:172.21.15.84:6802/210095030,v1:172.21.15.84:6803/210095030]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-13T17:56:24.989 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:24 smithi084 ceph-mon[52328]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-13T17:56:24.990 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:24 smithi084 ceph-mon[37908]: from='osd.0 [v2:172.21.15.84:6802/210095030,v1:172.21.15.84:6803/210095030]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-13T17:56:24.990 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:24 smithi084 ceph-mon[37908]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-13T17:56:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:24 smithi099 ceph-mon[71325]: from='osd.0 [v2:172.21.15.84:6802/210095030,v1:172.21.15.84:6803/210095030]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-13T17:56:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:24 smithi099 ceph-mon[71325]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-13T17:56:25.251 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch daemon add osd smithi084:vg_nvme/lv_3 2024-01-13T17:56:25.530 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:56:25.922 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[56997]: 2024-01-13T17:56:25.736+0000 7ff1be988700 -1 osd.0 0 waiting for initial osdmap 2024-01-13T17:56:25.923 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[56997]: 2024-01-13T17:56:25.738+0000 7ff1bb787700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T17:56:25.923 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-13T17:56:25.923 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: osdmap e6: 1 total, 0 up, 1 in 2024-01-13T17:56:25.923 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:25.923 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: from='osd.0 [v2:172.21.15.84:6802/210095030,v1:172.21.15.84:6803/210095030]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:25.923 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:25.923 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:25.923 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:25.923 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:25.923 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: osdmap e6: 1 total, 0 up, 1 in 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: from='osd.0 [v2:172.21.15.84:6802/210095030,v1:172.21.15.84:6803/210095030]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:25.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:25.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:25.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:25.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:25.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:25.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:25 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-13T17:56:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: osdmap e6: 1 total, 0 up, 1 in 2024-01-13T17:56:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: from='osd.0 [v2:172.21.15.84:6802/210095030,v1:172.21.15.84:6803/210095030]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-13T17:56:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:26.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:26.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:26.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:26.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:26.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:26.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:25 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:27.035 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[37908]: purged_snaps scrub starts 2024-01-13T17:56:27.035 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[37908]: purged_snaps scrub ok 2024-01-13T17:56:27.035 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[37908]: Detected new or changed devices on smithi084 2024-01-13T17:56:27.035 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi084 to 16098M 2024-01-13T17:56:27.035 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[37908]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:56:27.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[37908]: osdmap e7: 1 total, 0 up, 1 in 2024-01-13T17:56:27.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:27.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:27.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:27.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:27.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:27.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[52328]: purged_snaps scrub starts 2024-01-13T17:56:27.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[52328]: purged_snaps scrub ok 2024-01-13T17:56:27.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[52328]: Detected new or changed devices on smithi084 2024-01-13T17:56:27.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi084 to 16098M 2024-01-13T17:56:27.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[52328]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:56:27.037 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[52328]: osdmap e7: 1 total, 0 up, 1 in 2024-01-13T17:56:27.037 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:27.037 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:27.037 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:27.037 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:27.037 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:26 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:26 smithi099 ceph-mon[71325]: purged_snaps scrub starts 2024-01-13T17:56:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:26 smithi099 ceph-mon[71325]: purged_snaps scrub ok 2024-01-13T17:56:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:26 smithi099 ceph-mon[71325]: Detected new or changed devices on smithi084 2024-01-13T17:56:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:26 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi084 to 16098M 2024-01-13T17:56:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:26 smithi099 ceph-mon[71325]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:56:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:26 smithi099 ceph-mon[71325]: osdmap e7: 1 total, 0 up, 1 in 2024-01-13T17:56:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:26 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:26 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:27.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:26 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:27.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:26 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:27.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:26 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:27.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:27 smithi084 ceph-mon[37908]: from='client.14247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:27.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:27 smithi084 ceph-mon[37908]: osd.0 [v2:172.21.15.84:6802/210095030,v1:172.21.15.84:6803/210095030] boot 2024-01-13T17:56:27.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:27 smithi084 ceph-mon[37908]: osdmap e8: 1 total, 1 up, 1 in 2024-01-13T17:56:27.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:27 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:27.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:27 smithi084 ceph-mon[37908]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:27 smithi084 ceph-mon[52328]: from='client.14247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:27 smithi084 ceph-mon[52328]: osd.0 [v2:172.21.15.84:6802/210095030,v1:172.21.15.84:6803/210095030] boot 2024-01-13T17:56:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:27 smithi084 ceph-mon[52328]: osdmap e8: 1 total, 1 up, 1 in 2024-01-13T17:56:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:27 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:27 smithi084 ceph-mon[52328]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:27 smithi099 ceph-mon[71325]: from='client.14247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:27 smithi099 ceph-mon[71325]: osd.0 [v2:172.21.15.84:6802/210095030,v1:172.21.15.84:6803/210095030] boot 2024-01-13T17:56:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:27 smithi099 ceph-mon[71325]: osdmap e8: 1 total, 1 up, 1 in 2024-01-13T17:56:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:27 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:56:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:27 smithi099 ceph-mon[71325]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:28 smithi099 ceph-mon[71325]: osdmap e9: 1 total, 1 up, 1 in 2024-01-13T17:56:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:28 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2874111727' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0cff3e1-672f-4a63-953e-7cd5a9688060"}]: dispatch 2024-01-13T17:56:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:28 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0cff3e1-672f-4a63-953e-7cd5a9688060"}]: dispatch 2024-01-13T17:56:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:28 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0cff3e1-672f-4a63-953e-7cd5a9688060"}]': finished 2024-01-13T17:56:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:28 smithi099 ceph-mon[71325]: osdmap e10: 2 total, 1 up, 2 in 2024-01-13T17:56:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:28 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[37908]: osdmap e9: 1 total, 1 up, 1 in 2024-01-13T17:56:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2874111727' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0cff3e1-672f-4a63-953e-7cd5a9688060"}]: dispatch 2024-01-13T17:56:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0cff3e1-672f-4a63-953e-7cd5a9688060"}]: dispatch 2024-01-13T17:56:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0cff3e1-672f-4a63-953e-7cd5a9688060"}]': finished 2024-01-13T17:56:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[37908]: osdmap e10: 2 total, 1 up, 2 in 2024-01-13T17:56:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[52328]: osdmap e9: 1 total, 1 up, 1 in 2024-01-13T17:56:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2874111727' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0cff3e1-672f-4a63-953e-7cd5a9688060"}]: dispatch 2024-01-13T17:56:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0cff3e1-672f-4a63-953e-7cd5a9688060"}]: dispatch 2024-01-13T17:56:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0cff3e1-672f-4a63-953e-7cd5a9688060"}]': finished 2024-01-13T17:56:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[52328]: osdmap e10: 2 total, 1 up, 2 in 2024-01-13T17:56:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:28 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:29 smithi099 ceph-mon[71325]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:29 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/897631789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:56:30.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:29 smithi084 ceph-mon[37908]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:29 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/897631789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:56:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:29 smithi084 ceph-mon[52328]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:29 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/897631789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:56:32.279 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:31 smithi084 ceph-mon[37908]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:32.279 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:31 smithi084 ceph-mon[52328]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:31 smithi099 ceph-mon[71325]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:34.087 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:33 smithi084 ceph-mon[37908]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:34.087 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-13T17:56:34.087 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:34.087 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:33 smithi084 ceph-mon[52328]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:34.087 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:33 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-13T17:56:34.088 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:33 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:33 smithi099 ceph-mon[71325]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:33 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-13T17:56:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:33 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:35.065 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:34 smithi084 ceph-mon[37908]: Deploying daemon osd.1 on smithi084 2024-01-13T17:56:35.065 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:34 smithi084 ceph-mon[52328]: Deploying daemon osd.1 on smithi084 2024-01-13T17:56:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:34 smithi099 ceph-mon[71325]: Deploying daemon osd.1 on smithi084 2024-01-13T17:56:36.287 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:35 smithi084 ceph-mon[37908]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:36.287 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:35 smithi084 ceph-mon[52328]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:36.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:35 smithi099 ceph-mon[71325]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:37.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:37 smithi084 ceph-mon[37908]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:37.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:37 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:37.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:37 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:37.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:37 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:37.999 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:37 smithi084 ceph-mon[52328]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:37.999 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:37 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:37.999 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:37 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:37.999 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:37 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:37 smithi099 ceph-mon[71325]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:37 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:37 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:37 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:38.795 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 1 on host 'smithi084' 2024-01-13T17:56:39.095 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.095 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.095 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:39.095 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:39.095 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.095 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.095 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:39.095 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.096 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.096 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.096 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:39.096 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:39.096 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.096 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.096 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:39.096 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.173 DEBUG:teuthology.orchestra.run.smithi084:osd.1> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.1.service 2024-01-13T17:56:39.175 INFO:tasks.cephadm:Deploying osd.2 on smithi084 with /dev/vg_nvme/lv_2... 2024-01-13T17:56:39.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-13T17:56:39.206 INFO:journalctl@ceph.osd.1.smithi084.stdout:-- Logs begin at Sat 2024-01-13 17:16:05 UTC. -- 2024-01-13T17:56:39.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:39 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:39 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:39 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:39.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:39 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:39.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:39 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:39 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:39 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:39.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:39 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:39.775 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:56:40.291 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:40 smithi084 ceph-mon[37908]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:40.291 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:40 smithi084 ceph-mon[37908]: from='osd.1 [v2:172.21.15.84:6810/2364729003,v1:172.21.15.84:6811/2364729003]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T17:56:40.291 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:40 smithi084 ceph-mon[37908]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T17:56:40.292 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:40 smithi084 ceph-mon[52328]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:40.292 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:40 smithi084 ceph-mon[52328]: from='osd.1 [v2:172.21.15.84:6810/2364729003,v1:172.21.15.84:6811/2364729003]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T17:56:40.292 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:40 smithi084 ceph-mon[52328]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T17:56:40.292 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 17:56:39 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[64637]: 2024-01-13T17:56:39.981+0000 7f60b86f0540 -1 osd.1 0 log_to_monitors true 2024-01-13T17:56:40.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:40 smithi099 ceph-mon[71325]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:40.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:40 smithi099 ceph-mon[71325]: from='osd.1 [v2:172.21.15.84:6810/2364729003,v1:172.21.15.84:6811/2364729003]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T17:56:40.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:40 smithi099 ceph-mon[71325]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T17:56:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-13T17:56:41.139 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-13T17:56:41.139 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-01-13T17:56:41.139 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-01-13T17:56:41.139 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111995 s, 936 MB/s 2024-01-13T17:56:41.139 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-01-13T17:56:41.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch daemon add osd smithi084:vg_nvme/lv_2 2024-01-13T17:56:41.843 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:56:42.105 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[64637]: 2024-01-13T17:56:41.771+0000 7f60aeec4700 -1 osd.1 0 waiting for initial osdmap 2024-01-13T17:56:42.106 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[64637]: 2024-01-13T17:56:41.773+0000 7f60aa4c0700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T17:56:42.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:42.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-13T17:56:42.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: osdmap e11: 2 total, 1 up, 2 in 2024-01-13T17:56:42.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:42.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='osd.1 [v2:172.21.15.84:6810/2364729003,v1:172.21.15.84:6811/2364729003]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:42.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:42.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: osdmap e11: 2 total, 1 up, 2 in 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='osd.1 [v2:172.21.15.84:6810/2364729003,v1:172.21.15.84:6811/2364729003]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.107 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:42.108 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:42.108 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.108 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:42.108 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:42.108 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:41 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: osdmap e11: 2 total, 1 up, 2 in 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='osd.1 [v2:172.21.15.84:6810/2364729003,v1:172.21.15.84:6811/2364729003]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:42.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:41 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[52328]: Detected new or changed devices on smithi084 2024-01-13T17:56:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi084 to 8049M 2024-01-13T17:56:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[52328]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:56:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[52328]: osdmap e12: 2 total, 1 up, 2 in 2024-01-13T17:56:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[37908]: Detected new or changed devices on smithi084 2024-01-13T17:56:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi084 to 8049M 2024-01-13T17:56:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[37908]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:56:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[37908]: osdmap e12: 2 total, 1 up, 2 in 2024-01-13T17:56:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:42 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:42 smithi099 ceph-mon[71325]: Detected new or changed devices on smithi084 2024-01-13T17:56:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:42 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi084 to 8049M 2024-01-13T17:56:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:42 smithi099 ceph-mon[71325]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:56:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:42 smithi099 ceph-mon[71325]: osdmap e12: 2 total, 1 up, 2 in 2024-01-13T17:56:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:42 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:42 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:43.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[37908]: purged_snaps scrub starts 2024-01-13T17:56:43.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[37908]: purged_snaps scrub ok 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[37908]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[37908]: osd.1 [v2:172.21.15.84:6810/2364729003,v1:172.21.15.84:6811/2364729003] boot 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[37908]: osdmap e13: 2 total, 2 up, 2 in 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[37908]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[52328]: purged_snaps scrub starts 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[52328]: purged_snaps scrub ok 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[52328]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[52328]: osd.1 [v2:172.21.15.84:6810/2364729003,v1:172.21.15.84:6811/2364729003] boot 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[52328]: osdmap e13: 2 total, 2 up, 2 in 2024-01-13T17:56:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[52328]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:43 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:43 smithi099 ceph-mon[71325]: purged_snaps scrub starts 2024-01-13T17:56:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:43 smithi099 ceph-mon[71325]: purged_snaps scrub ok 2024-01-13T17:56:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:43 smithi099 ceph-mon[71325]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-01-13T17:56:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:43 smithi099 ceph-mon[71325]: osd.1 [v2:172.21.15.84:6810/2364729003,v1:172.21.15.84:6811/2364729003] boot 2024-01-13T17:56:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:43 smithi099 ceph-mon[71325]: osdmap e13: 2 total, 2 up, 2 in 2024-01-13T17:56:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:43 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:56:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:43 smithi099 ceph-mon[71325]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:43 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:43 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:43 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:44 smithi099 ceph-mon[71325]: osdmap e14: 2 total, 2 up, 2 in 2024-01-13T17:56:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:44 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2894558180' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13d2364a-7e45-4e3e-98fa-f38889f58d44"}]: dispatch 2024-01-13T17:56:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:44 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2894558180' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13d2364a-7e45-4e3e-98fa-f38889f58d44"}]': finished 2024-01-13T17:56:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:44 smithi099 ceph-mon[71325]: osdmap e15: 3 total, 2 up, 3 in 2024-01-13T17:56:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:44 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:44 smithi084 ceph-mon[37908]: osdmap e14: 2 total, 2 up, 2 in 2024-01-13T17:56:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:44 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2894558180' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13d2364a-7e45-4e3e-98fa-f38889f58d44"}]: dispatch 2024-01-13T17:56:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:44 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2894558180' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13d2364a-7e45-4e3e-98fa-f38889f58d44"}]': finished 2024-01-13T17:56:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:44 smithi084 ceph-mon[37908]: osdmap e15: 3 total, 2 up, 3 in 2024-01-13T17:56:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:44 smithi084 ceph-mon[52328]: osdmap e14: 2 total, 2 up, 2 in 2024-01-13T17:56:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:44 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2894558180' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13d2364a-7e45-4e3e-98fa-f38889f58d44"}]: dispatch 2024-01-13T17:56:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:44 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2894558180' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13d2364a-7e45-4e3e-98fa-f38889f58d44"}]': finished 2024-01-13T17:56:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:44 smithi084 ceph-mon[52328]: osdmap e15: 3 total, 2 up, 3 in 2024-01-13T17:56:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:44 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:46.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:45 smithi099 ceph-mon[71325]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:45 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/99575374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:56:46.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:45 smithi084 ceph-mon[37908]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:46.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:45 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/99575374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:56:46.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:45 smithi084 ceph-mon[52328]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:46.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:45 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/99575374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:56:47.812 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:47 smithi084 ceph-mon[37908]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:47.813 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:47 smithi084 ceph-mon[52328]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:47 smithi099 ceph-mon[71325]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:50.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:49 smithi084 ceph-mon[37908]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:50.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:49 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-13T17:56:50.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:49 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:50.309 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:49 smithi084 ceph-mon[52328]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:50.309 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:49 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-13T17:56:50.309 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:49 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:49 smithi099 ceph-mon[71325]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:49 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-13T17:56:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:49 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:51.261 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:50 smithi084 ceph-mon[37908]: Deploying daemon osd.2 on smithi084 2024-01-13T17:56:51.262 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:50 smithi084 ceph-mon[52328]: Deploying daemon osd.2 on smithi084 2024-01-13T17:56:51.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:50 smithi099 ceph-mon[71325]: Deploying daemon osd.2 on smithi084 2024-01-13T17:56:52.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:51 smithi084 ceph-mon[37908]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:52.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:51 smithi084 ceph-mon[52328]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:52.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:51 smithi099 ceph-mon[71325]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:54.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:53 smithi084 ceph-mon[37908]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:54.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:53 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:54.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:53 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:54.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:53 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:54.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:53 smithi084 ceph-mon[52328]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:54.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:53 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:54.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:53 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:54.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:53 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:54.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:53 smithi099 ceph-mon[71325]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:54.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:53 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:54.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:53 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:54.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:53 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:55.251 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 2 on host 'smithi084' 2024-01-13T17:56:55.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.626 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.626 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:55.626 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:55.626 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.626 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[37908]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:55.626 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:55.626 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.626 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:55.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:55.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[52328]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:55.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:55.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:55 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.628 DEBUG:teuthology.orchestra.run.smithi084:osd.2> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.2.service 2024-01-13T17:56:55.630 INFO:tasks.cephadm:Deploying osd.3 on smithi084 with /dev/vg_nvme/lv_1... 2024-01-13T17:56:55.630 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-13T17:56:55.661 INFO:journalctl@ceph.osd.2.smithi084.stdout:-- Logs begin at Sat 2024-01-13 17:16:05 UTC. -- 2024-01-13T17:56:55.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:55 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:55 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:55 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:55.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:55 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:55.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:55 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:55 smithi099 ceph-mon[71325]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:55.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:55 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:56:55.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:55 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:55.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:55 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:56.206 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:56:56.468 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 17:56:56 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[72622]: 2024-01-13T17:56:56.225+0000 7f3d9138a540 -1 osd.2 0 log_to_monitors true 2024-01-13T17:56:56.718 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:56 smithi084 ceph-mon[37908]: from='osd.2 [v2:172.21.15.84:6818/4150510739,v1:172.21.15.84:6819/4150510739]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T17:56:56.719 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:56 smithi084 ceph-mon[37908]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T17:56:56.719 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:56 smithi084 ceph-mon[52328]: from='osd.2 [v2:172.21.15.84:6818/4150510739,v1:172.21.15.84:6819/4150510739]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T17:56:56.719 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:56 smithi084 ceph-mon[52328]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T17:56:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:56 smithi099 ceph-mon[71325]: from='osd.2 [v2:172.21.15.84:6818/4150510739,v1:172.21.15.84:6819/4150510739]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T17:56:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:56 smithi099 ceph-mon[71325]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T17:56:57.489 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-13T17:56:57.490 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-13T17:56:57.490 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-01-13T17:56:57.490 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-01-13T17:56:57.490 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110995 s, 945 MB/s 2024-01-13T17:56:57.490 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-01-13T17:56:57.652 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[72622]: 2024-01-13T17:56:57.524+0000 7f3d87b5e700 -1 osd.2 0 waiting for initial osdmap 2024-01-13T17:56:57.652 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[72622]: 2024-01-13T17:56:57.527+0000 7f3d82959700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T17:56:57.652 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[37908]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-13T17:56:57.652 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[37908]: osdmap e16: 3 total, 2 up, 3 in 2024-01-13T17:56:57.652 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:57.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[37908]: from='osd.2 [v2:172.21.15.84:6818/4150510739,v1:172.21.15.84:6819/4150510739]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:57.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[37908]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:57.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[37908]: pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:57.653 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[52328]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-13T17:56:57.653 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[52328]: osdmap e16: 3 total, 2 up, 3 in 2024-01-13T17:56:57.653 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:57.653 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[52328]: from='osd.2 [v2:172.21.15.84:6818/4150510739,v1:172.21.15.84:6819/4150510739]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:57.653 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[52328]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:57.653 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:57 smithi084 ceph-mon[52328]: pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:57 smithi099 ceph-mon[71325]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-13T17:56:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:57 smithi099 ceph-mon[71325]: osdmap e16: 3 total, 2 up, 3 in 2024-01-13T17:56:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:57 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:57 smithi099 ceph-mon[71325]: from='osd.2 [v2:172.21.15.84:6818/4150510739,v1:172.21.15.84:6819/4150510739]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:57 smithi099 ceph-mon[71325]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:56:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:57 smithi099 ceph-mon[71325]: pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:57.994 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch daemon add osd smithi084:vg_nvme/lv_1 2024-01-13T17:56:58.254 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:56:58.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:56:58.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: osdmap e17: 3 total, 2 up, 3 in 2024-01-13T17:56:58.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:58.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:58.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: Detected new or changed devices on smithi084 2024-01-13T17:56:58.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:58.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:58.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:58.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:58.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:58.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi084 to 5366M 2024-01-13T17:56:58.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:58.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:58.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:58.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:58.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:56:58.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: osdmap e17: 3 total, 2 up, 3 in 2024-01-13T17:56:58.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:58.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:58.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: Detected new or changed devices on smithi084 2024-01-13T17:56:58.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:58.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:58.642 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:58.642 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:58.642 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:58.642 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi084 to 5366M 2024-01-13T17:56:58.642 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:58.642 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:58.642 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:58.642 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:56:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: osdmap e17: 3 total, 2 up, 3 in 2024-01-13T17:56:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: Detected new or changed devices on smithi084 2024-01-13T17:56:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:56:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi084 to 5366M 2024-01-13T17:56:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:56:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:56:59.858 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[37908]: purged_snaps scrub starts 2024-01-13T17:56:59.858 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[37908]: purged_snaps scrub ok 2024-01-13T17:56:59.858 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[37908]: osd.2 [v2:172.21.15.84:6818/4150510739,v1:172.21.15.84:6819/4150510739] boot 2024-01-13T17:56:59.858 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[37908]: osdmap e18: 3 total, 3 up, 3 in 2024-01-13T17:56:59.858 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[37908]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[37908]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[52328]: purged_snaps scrub starts 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[52328]: purged_snaps scrub ok 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[52328]: osd.2 [v2:172.21.15.84:6818/4150510739,v1:172.21.15.84:6819/4150510739] boot 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[52328]: osdmap e18: 3 total, 3 up, 3 in 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[52328]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-13T17:56:59.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[52328]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:59.860 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:59.860 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:59.860 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:56:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:56:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:59 smithi099 ceph-mon[71325]: purged_snaps scrub starts 2024-01-13T17:56:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:59 smithi099 ceph-mon[71325]: purged_snaps scrub ok 2024-01-13T17:56:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:59 smithi099 ceph-mon[71325]: osd.2 [v2:172.21.15.84:6818/4150510739,v1:172.21.15.84:6819/4150510739] boot 2024-01-13T17:56:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:59 smithi099 ceph-mon[71325]: osdmap e18: 3 total, 3 up, 3 in 2024-01-13T17:56:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:56:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:59 smithi099 ceph-mon[71325]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-01-13T17:56:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-01-13T17:56:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:59 smithi099 ceph-mon[71325]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:56:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:56:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:56:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:56:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:00 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-01-13T17:57:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:00 smithi099 ceph-mon[71325]: osdmap e19: 3 total, 3 up, 3 in 2024-01-13T17:57:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:00 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T17:57:00.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:00 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-01-13T17:57:00.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:00 smithi084 ceph-mon[37908]: osdmap e19: 3 total, 3 up, 3 in 2024-01-13T17:57:00.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:00 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T17:57:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:00 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-01-13T17:57:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:00 smithi084 ceph-mon[52328]: osdmap e19: 3 total, 3 up, 3 in 2024-01-13T17:57:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:00 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T17:57:01.630 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-13T17:57:01.630 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[37908]: osdmap e20: 3 total, 3 up, 3 in 2024-01-13T17:57:01.630 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[37908]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:01.630 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/406617046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f74a3f9c-7b25-4a1e-8282-8f9f7f28c070"}]: dispatch 2024-01-13T17:57:01.630 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/406617046' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f74a3f9c-7b25-4a1e-8282-8f9f7f28c070"}]': finished 2024-01-13T17:57:01.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[37908]: osdmap e21: 4 total, 3 up, 4 in 2024-01-13T17:57:01.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:01.631 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-13T17:57:01.631 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[52328]: osdmap e20: 3 total, 3 up, 3 in 2024-01-13T17:57:01.631 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[52328]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:01.631 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/406617046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f74a3f9c-7b25-4a1e-8282-8f9f7f28c070"}]: dispatch 2024-01-13T17:57:01.631 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/406617046' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f74a3f9c-7b25-4a1e-8282-8f9f7f28c070"}]': finished 2024-01-13T17:57:01.631 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[52328]: osdmap e21: 4 total, 3 up, 4 in 2024-01-13T17:57:01.631 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:01 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:01.632 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78531]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-13T17:57:01.632 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78531]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:01.632 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78531]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:01.632 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78531]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:01.632 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78554]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-13T17:57:01.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:01 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-13T17:57:01.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:01 smithi099 ceph-mon[71325]: osdmap e20: 3 total, 3 up, 3 in 2024-01-13T17:57:01.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:01 smithi099 ceph-mon[71325]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:01.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:01 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/406617046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f74a3f9c-7b25-4a1e-8282-8f9f7f28c070"}]: dispatch 2024-01-13T17:57:01.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:01 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/406617046' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f74a3f9c-7b25-4a1e-8282-8f9f7f28c070"}]': finished 2024-01-13T17:57:01.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:01 smithi099 ceph-mon[71325]: osdmap e21: 4 total, 3 up, 4 in 2024-01-13T17:57:01.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:01 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:01.894 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78554]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:01.894 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78554]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:01.894 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78554]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:02.178 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78606]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-13T17:57:02.178 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78606]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:02.178 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78606]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:02.179 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 17:57:01 smithi084 sudo[78606]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:02.179 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78611]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-13T17:57:02.179 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78611]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:02.179 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78611]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:02.179 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78611]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:02.639 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78800]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-13T17:57:02.639 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78800]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:02.639 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78800]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:02.639 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78800]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:02.891 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78988]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-13T17:57:02.891 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78988]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:02.891 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78988]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:02.891 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78988]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:02.891 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78993]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-13T17:57:02.892 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78993]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:02.892 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78993]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:02.892 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:02 smithi084 sudo[78993]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:03.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:03.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1605374010' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:03.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[52328]: osdmap e22: 4 total, 3 up, 4 in 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[52328]: mgrmap e15: y(active, since 97s), standbys: x 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:03 smithi084 sudo[79183]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:03 smithi084 sudo[79183]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:03 smithi084 sudo[79183]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:03 smithi084 sudo[79183]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1605374010' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[37908]: osdmap e22: 4 total, 3 up, 4 in 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[37908]: mgrmap e15: y(active, since 97s), standbys: x 2024-01-13T17:57:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:03 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-13T17:57:03.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:03.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1605374010' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:03.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 ceph-mon[71325]: osdmap e22: 4 total, 3 up, 4 in 2024-01-13T17:57:03.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:03.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 ceph-mon[71325]: mgrmap e15: y(active, since 97s), standbys: x 2024-01-13T17:57:03.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-13T17:57:03.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 sudo[74392]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-13T17:57:03.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 sudo[74392]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:03.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 sudo[74392]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:03.615 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 sudo[74392]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:03.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 sudo[74395]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-13T17:57:03.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 sudo[74395]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:03.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 sudo[74395]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:03.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:03 smithi099 sudo[74395]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:04.135 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:03 smithi084 sudo[79383]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-13T17:57:04.135 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:03 smithi084 sudo[79383]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:04.135 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:03 smithi084 sudo[79383]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:04.135 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:03 smithi084 sudo[79383]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-13T17:57:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:57:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:57:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:57:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 sudo[79547]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 sudo[79547]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 sudo[79547]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-13T17:57:04.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 sudo[79547]: pam_unix(sudo:session): session closed for user root 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:57:04.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:04 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:57:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-13T17:57:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:57:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:57:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:57:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-13T17:57:04.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:57:04.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:57:04.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:57:04.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-13T17:57:04.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:04.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:57:04.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:57:04.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:04 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:57:05.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:05 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-13T17:57:05.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:05 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-13T17:57:05.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:05 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-13T17:57:05.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:05 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-13T17:57:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:05 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-13T17:57:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:05 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-13T17:57:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:06 smithi084 ceph-mon[37908]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:06 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-13T17:57:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:06 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:06 smithi084 ceph-mon[52328]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:06 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-13T17:57:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:06 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:06.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:06 smithi099 ceph-mon[71325]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:06.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:06 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-13T17:57:06.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:06 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:07.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:07 smithi084 ceph-mon[37908]: Deploying daemon osd.3 on smithi084 2024-01-13T17:57:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:07 smithi084 ceph-mon[52328]: Deploying daemon osd.3 on smithi084 2024-01-13T17:57:07.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:07 smithi099 ceph-mon[71325]: Deploying daemon osd.3 on smithi084 2024-01-13T17:57:08.279 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:08 smithi084 ceph-mon[37908]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:08.279 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:08 smithi084 ceph-mon[52328]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:08 smithi099 ceph-mon[71325]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-01-13T17:57:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:10 smithi084 ceph-mon[52328]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-01-13T17:57:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:10 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:10 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:10 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:10 smithi084 ceph-mon[37908]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-01-13T17:57:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:10 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:10.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:10 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:10.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:10 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:10.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:10 smithi099 ceph-mon[71325]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-01-13T17:57:10.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:10 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:10.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:10 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:10.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:10 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:11.576 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 3 on host 'smithi084' 2024-01-13T17:57:11.898 DEBUG:teuthology.orchestra.run.smithi084:osd.3> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.3.service 2024-01-13T17:57:11.901 INFO:tasks.cephadm:Deploying osd.4 on smithi099 with /dev/vg_nvme/lv_4... 2024-01-13T17:57:11.901 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-13T17:57:11.930 INFO:journalctl@ceph.osd.3.smithi084.stdout:-- Logs begin at Sat 2024-01-13 17:16:05 UTC. -- 2024-01-13T17:57:12.076 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[37908]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-01-13T17:57:12.076 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.076 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.076 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[52328]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.077 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.078 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:11 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:12.165 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:57:12.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:11 smithi099 ceph-mon[71325]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-01-13T17:57:12.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:11 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:11 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:11 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:12.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:11 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:12.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:11 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:11 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:11 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:12.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:11 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:12.929 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 17:57:12 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[80454]: 2024-01-13T17:57:12.655+0000 7f498fc7e540 -1 osd.3 0 log_to_monitors true 2024-01-13T17:57:13.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:12 smithi099 ceph-mon[71325]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-13T17:57:13.399 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-13T17:57:13.399 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-13T17:57:13.399 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-01-13T17:57:13.399 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-01-13T17:57:13.399 INFO:teuthology.orchestra.run.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.01462 s, 717 MB/s 2024-01-13T17:57:13.399 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 2024-01-13T17:57:13.399 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-01-13T17:57:13.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:12 smithi084 ceph-mon[37908]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-13T17:57:13.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:12 smithi084 ceph-mon[52328]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-13T17:57:13.743 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_4 2024-01-13T17:57:13.999 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:57:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:13 smithi099 ceph-mon[71325]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-01-13T17:57:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:13 smithi099 ceph-mon[71325]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-13T17:57:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:13 smithi099 ceph-mon[71325]: osdmap e23: 4 total, 3 up, 4 in 2024-01-13T17:57:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:13 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:13 smithi099 ceph-mon[71325]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:57:14.178 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[80454]: 2024-01-13T17:57:13.942+0000 7f4986452700 -1 osd.3 0 waiting for initial osdmap 2024-01-13T17:57:14.178 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[80454]: 2024-01-13T17:57:13.948+0000 7f498124d700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T17:57:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-mon[37908]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-01-13T17:57:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-mon[37908]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-13T17:57:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-mon[37908]: osdmap e23: 4 total, 3 up, 4 in 2024-01-13T17:57:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-mon[37908]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:57:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-mon[52328]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-01-13T17:57:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-mon[52328]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-13T17:57:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-mon[52328]: osdmap e23: 4 total, 3 up, 4 in 2024-01-13T17:57:14.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:14.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:13 smithi084 ceph-mon[52328]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T17:57:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:57:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: osdmap e24: 4 total, 3 up, 4 in 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: Detected new or changed devices on smithi084 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi084 to 4024M 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:15.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:15.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: osdmap e24: 4 total, 3 up, 4 in 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: Detected new or changed devices on smithi084 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi084 to 4024M 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: osdmap e24: 4 total, 3 up, 4 in 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: Detected new or changed devices on smithi084 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:15.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi084 to 4024M 2024-01-13T17:57:15.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:15.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:15.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:15.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:16.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:15 smithi099 ceph-mon[71325]: purged_snaps scrub starts 2024-01-13T17:57:16.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:15 smithi099 ceph-mon[71325]: purged_snaps scrub ok 2024-01-13T17:57:16.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:15 smithi099 ceph-mon[71325]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-01-13T17:57:16.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:15 smithi099 ceph-mon[71325]: osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377] boot 2024-01-13T17:57:16.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:15 smithi099 ceph-mon[71325]: osdmap e25: 4 total, 4 up, 4 in 2024-01-13T17:57:16.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:15 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:16.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:15 smithi099 ceph-mon[71325]: from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:57:16.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:15 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:57:16.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:15 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:57:16.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:15 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:16.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[37908]: purged_snaps scrub starts 2024-01-13T17:57:16.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[37908]: purged_snaps scrub ok 2024-01-13T17:57:16.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[37908]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[37908]: osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377] boot 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[37908]: osdmap e25: 4 total, 4 up, 4 in 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[37908]: from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[52328]: purged_snaps scrub starts 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[52328]: purged_snaps scrub ok 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[52328]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[52328]: osd.3 [v2:172.21.15.84:6826/882719377,v1:172.21.15.84:6827/882719377] boot 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[52328]: osdmap e25: 4 total, 4 up, 4 in 2024-01-13T17:57:16.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:57:16.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[52328]: from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:57:16.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:57:16.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:57:16.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:15 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:17 smithi099 ceph-mon[71325]: osdmap e26: 4 total, 4 up, 4 in 2024-01-13T17:57:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:17 smithi099 ceph-mon[71325]: from='client.? 172.21.15.99:0/2602403172' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f581be2-0bfe-4fc4-9b70-60cb787fc03b"}]: dispatch 2024-01-13T17:57:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:17 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f581be2-0bfe-4fc4-9b70-60cb787fc03b"}]: dispatch 2024-01-13T17:57:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:17 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f581be2-0bfe-4fc4-9b70-60cb787fc03b"}]': finished 2024-01-13T17:57:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:17 smithi099 ceph-mon[71325]: osdmap e27: 5 total, 4 up, 5 in 2024-01-13T17:57:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:17 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:17.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[37908]: osdmap e26: 4 total, 4 up, 4 in 2024-01-13T17:57:17.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[37908]: from='client.? 172.21.15.99:0/2602403172' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f581be2-0bfe-4fc4-9b70-60cb787fc03b"}]: dispatch 2024-01-13T17:57:17.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f581be2-0bfe-4fc4-9b70-60cb787fc03b"}]: dispatch 2024-01-13T17:57:17.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f581be2-0bfe-4fc4-9b70-60cb787fc03b"}]': finished 2024-01-13T17:57:17.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[37908]: osdmap e27: 5 total, 4 up, 5 in 2024-01-13T17:57:17.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[52328]: osdmap e26: 4 total, 4 up, 4 in 2024-01-13T17:57:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[52328]: from='client.? 172.21.15.99:0/2602403172' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f581be2-0bfe-4fc4-9b70-60cb787fc03b"}]: dispatch 2024-01-13T17:57:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f581be2-0bfe-4fc4-9b70-60cb787fc03b"}]: dispatch 2024-01-13T17:57:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f581be2-0bfe-4fc4-9b70-60cb787fc03b"}]': finished 2024-01-13T17:57:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[52328]: osdmap e27: 5 total, 4 up, 5 in 2024-01-13T17:57:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:17 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:18 smithi099 ceph-mon[71325]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:18 smithi099 ceph-mon[71325]: from='client.? 172.21.15.99:0/1948273850' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:18.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:18 smithi084 ceph-mon[37908]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:18.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:18 smithi084 ceph-mon[37908]: from='client.? 172.21.15.99:0/1948273850' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:18.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:18 smithi084 ceph-mon[52328]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:18.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:18 smithi084 ceph-mon[52328]: from='client.? 172.21.15.99:0/1948273850' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:20.218 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:20 smithi099 ceph-mon[71325]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:20.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:20 smithi084 ceph-mon[37908]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:20 smithi084 ceph-mon[52328]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:22 smithi099 ceph-mon[71325]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:22.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:22 smithi084 ceph-mon[37908]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:22.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:22 smithi084 ceph-mon[52328]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:23.330 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:23 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-13T17:57:23.330 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:23 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:23.330 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:23 smithi099 ceph-mon[71325]: Deploying daemon osd.4 on smithi099 2024-01-13T17:57:23.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:23 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-13T17:57:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:23 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:23 smithi084 ceph-mon[37908]: Deploying daemon osd.4 on smithi099 2024-01-13T17:57:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:23 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-13T17:57:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:23 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:23 smithi084 ceph-mon[52328]: Deploying daemon osd.4 on smithi099 2024-01-13T17:57:24.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:24 smithi099 ceph-mon[71325]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:24.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:24 smithi084 ceph-mon[37908]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:24 smithi084 ceph-mon[52328]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:26 smithi099 ceph-mon[71325]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:26 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:26 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:26 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:26 smithi084 ceph-mon[37908]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:26.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:26 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:26.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:26 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:26.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:26 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:26 smithi084 ceph-mon[52328]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:26 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:26 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:26 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:28.021 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 4 on host 'smithi099' 2024-01-13T17:57:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:28 smithi099 ceph-mon[71325]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:28 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:28 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:28 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:28 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:28 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:28 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:28 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:28 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:28.395 DEBUG:teuthology.orchestra.run.smithi099:osd.4> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.4.service 2024-01-13T17:57:28.398 INFO:tasks.cephadm:Deploying osd.5 on smithi099 with /dev/vg_nvme/lv_3... 2024-01-13T17:57:28.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-13T17:57:28.428 INFO:journalctl@ceph.osd.4.smithi099.stdout:-- Logs begin at Sat 2024-01-13 17:16:04 UTC. -- 2024-01-13T17:57:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[52328]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:28.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[37908]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:28.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:28.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:28.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:28.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:28 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:28.843 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:57:29.234 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:29 smithi099 ceph-mon[71325]: from='osd.4 [v2:172.21.15.99:6800/343632506,v1:172.21.15.99:6801/343632506]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T17:57:29.234 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:29 smithi099 ceph-mon[71325]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T17:57:29.234 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 17:57:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[77165]: 2024-01-13T17:57:28.974+0000 7f853561f540 -1 osd.4 0 log_to_monitors true 2024-01-13T17:57:29.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:29 smithi084 ceph-mon[52328]: from='osd.4 [v2:172.21.15.99:6800/343632506,v1:172.21.15.99:6801/343632506]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T17:57:29.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:29 smithi084 ceph-mon[52328]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T17:57:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:29 smithi084 ceph-mon[37908]: from='osd.4 [v2:172.21.15.99:6800/343632506,v1:172.21.15.99:6801/343632506]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T17:57:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:29 smithi084 ceph-mon[37908]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T17:57:30.319 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 17:57:30 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[77165]: 2024-01-13T17:57:30.043+0000 7f852bdf3700 -1 osd.4 0 waiting for initial osdmap 2024-01-13T17:57:30.319 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 17:57:30 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[77165]: 2024-01-13T17:57:30.047+0000 7f8524bea700 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T17:57:30.319 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:30 smithi099 ceph-mon[71325]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:30.319 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:30 smithi099 ceph-mon[71325]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-13T17:57:30.319 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:30 smithi099 ceph-mon[71325]: osdmap e28: 5 total, 4 up, 5 in 2024-01-13T17:57:30.320 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:30 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:30.320 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:30 smithi099 ceph-mon[71325]: from='osd.4 [v2:172.21.15.99:6800/343632506,v1:172.21.15.99:6801/343632506]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:30.320 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:30 smithi099 ceph-mon[71325]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:30.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[52328]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[52328]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-13T17:57:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[52328]: osdmap e28: 5 total, 4 up, 5 in 2024-01-13T17:57:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[52328]: from='osd.4 [v2:172.21.15.99:6800/343632506,v1:172.21.15.99:6801/343632506]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[52328]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[37908]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[37908]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-13T17:57:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[37908]: osdmap e28: 5 total, 4 up, 5 in 2024-01-13T17:57:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[37908]: from='osd.4 [v2:172.21.15.99:6800/343632506,v1:172.21.15.99:6801/343632506]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:30 smithi084 ceph-mon[37908]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:30.516 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-13T17:57:30.516 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-13T17:57:30.517 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-01-13T17:57:30.517 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-01-13T17:57:30.517 INFO:teuthology.orchestra.run.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0137323 s, 764 MB/s 2024-01-13T17:57:30.517 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-01-13T17:57:31.024 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_3 2024-01-13T17:57:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:57:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:57:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: osdmap e29: 5 total, 4 up, 5 in 2024-01-13T17:57:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:31.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:31.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:31 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: osdmap e29: 5 total, 4 up, 5 in 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: osdmap e29: 5 total, 4 up, 5 in 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:31 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:32 smithi099 ceph-mon[71325]: purged_snaps scrub starts 2024-01-13T17:57:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:32 smithi099 ceph-mon[71325]: purged_snaps scrub ok 2024-01-13T17:57:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:32 smithi099 ceph-mon[71325]: Detected new or changed devices on smithi099 2024-01-13T17:57:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:32 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi099 to 17122M 2024-01-13T17:57:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:32 smithi099 ceph-mon[71325]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:32 smithi099 ceph-mon[71325]: osd.4 [v2:172.21.15.99:6800/343632506,v1:172.21.15.99:6801/343632506] boot 2024-01-13T17:57:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:32 smithi099 ceph-mon[71325]: osdmap e30: 5 total, 5 up, 5 in 2024-01-13T17:57:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:32 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:32.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[37908]: purged_snaps scrub starts 2024-01-13T17:57:32.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[37908]: purged_snaps scrub ok 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[37908]: Detected new or changed devices on smithi099 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi099 to 17122M 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[37908]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[37908]: osd.4 [v2:172.21.15.99:6800/343632506,v1:172.21.15.99:6801/343632506] boot 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[37908]: osdmap e30: 5 total, 5 up, 5 in 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[52328]: purged_snaps scrub starts 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[52328]: purged_snaps scrub ok 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[52328]: Detected new or changed devices on smithi099 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi099 to 17122M 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[52328]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[52328]: osd.4 [v2:172.21.15.99:6800/343632506,v1:172.21.15.99:6801/343632506] boot 2024-01-13T17:57:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[52328]: osdmap e30: 5 total, 5 up, 5 in 2024-01-13T17:57:32.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:32 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:57:33.178 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:33 smithi099 ceph-mon[71325]: osdmap e31: 5 total, 5 up, 5 in 2024-01-13T17:57:33.178 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:33 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:57:33.178 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:33 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:57:33.178 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:33 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:33.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:33 smithi084 ceph-mon[37908]: osdmap e31: 5 total, 5 up, 5 in 2024-01-13T17:57:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:57:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:57:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:33 smithi084 ceph-mon[52328]: osdmap e31: 5 total, 5 up, 5 in 2024-01-13T17:57:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:33 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:57:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:33 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:57:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:33 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:34 smithi099 ceph-mon[71325]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:57:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:34 smithi099 ceph-mon[71325]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:34.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:34 smithi099 ceph-mon[71325]: osdmap e32: 5 total, 5 up, 5 in 2024-01-13T17:57:34.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:34 smithi099 ceph-mon[71325]: osdmap e33: 5 total, 5 up, 5 in 2024-01-13T17:57:34.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:34 smithi084 ceph-mon[37908]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:57:34.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:34 smithi084 ceph-mon[37908]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:34.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:34 smithi084 ceph-mon[37908]: osdmap e32: 5 total, 5 up, 5 in 2024-01-13T17:57:34.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:34 smithi084 ceph-mon[37908]: osdmap e33: 5 total, 5 up, 5 in 2024-01-13T17:57:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:34 smithi084 ceph-mon[52328]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:57:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:34 smithi084 ceph-mon[52328]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:34 smithi084 ceph-mon[52328]: osdmap e32: 5 total, 5 up, 5 in 2024-01-13T17:57:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:34 smithi084 ceph-mon[52328]: osdmap e33: 5 total, 5 up, 5 in 2024-01-13T17:57:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:35 smithi099 ceph-mon[71325]: from='client.? 172.21.15.99:0/2051326224' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cf8f8f6-eaf3-47f2-a796-98778558ad85"}]: dispatch 2024-01-13T17:57:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:35 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cf8f8f6-eaf3-47f2-a796-98778558ad85"}]: dispatch 2024-01-13T17:57:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:35 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4cf8f8f6-eaf3-47f2-a796-98778558ad85"}]': finished 2024-01-13T17:57:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:35 smithi099 ceph-mon[71325]: osdmap e34: 6 total, 5 up, 6 in 2024-01-13T17:57:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:35 smithi099 ceph-mon[71325]: from='client.? 172.21.15.99:0/339621913' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:35.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[37908]: from='client.? 172.21.15.99:0/2051326224' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cf8f8f6-eaf3-47f2-a796-98778558ad85"}]: dispatch 2024-01-13T17:57:35.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cf8f8f6-eaf3-47f2-a796-98778558ad85"}]: dispatch 2024-01-13T17:57:35.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4cf8f8f6-eaf3-47f2-a796-98778558ad85"}]': finished 2024-01-13T17:57:35.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[37908]: osdmap e34: 6 total, 5 up, 6 in 2024-01-13T17:57:35.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:35.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[37908]: from='client.? 172.21.15.99:0/339621913' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:35.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[52328]: from='client.? 172.21.15.99:0/2051326224' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cf8f8f6-eaf3-47f2-a796-98778558ad85"}]: dispatch 2024-01-13T17:57:35.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cf8f8f6-eaf3-47f2-a796-98778558ad85"}]: dispatch 2024-01-13T17:57:35.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4cf8f8f6-eaf3-47f2-a796-98778558ad85"}]': finished 2024-01-13T17:57:35.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[52328]: osdmap e34: 6 total, 5 up, 6 in 2024-01-13T17:57:35.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:35.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:35 smithi084 ceph-mon[52328]: from='client.? 172.21.15.99:0/339621913' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:36 smithi099 ceph-mon[71325]: pgmap v89: 1 pgs: 1 remapped+peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:36.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:36 smithi084 ceph-mon[37908]: pgmap v89: 1 pgs: 1 remapped+peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:36 smithi084 ceph-mon[52328]: pgmap v89: 1 pgs: 1 remapped+peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:38 smithi099 ceph-mon[71325]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:38 smithi084 ceph-mon[37908]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:38 smithi084 ceph-mon[52328]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:40.526 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:40 smithi099 ceph-mon[71325]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-13T17:57:40.526 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:40 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-13T17:57:40.527 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:40 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:40.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:40 smithi084 ceph-mon[37908]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-13T17:57:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:40 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-13T17:57:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:40 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:40 smithi084 ceph-mon[52328]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-13T17:57:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:40 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-13T17:57:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:40 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:41.443 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:41 smithi099 ceph-mon[71325]: Deploying daemon osd.5 on smithi099 2024-01-13T17:57:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:41 smithi084 ceph-mon[37908]: Deploying daemon osd.5 on smithi099 2024-01-13T17:57:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:41 smithi084 ceph-mon[52328]: Deploying daemon osd.5 on smithi099 2024-01-13T17:57:42.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:42 smithi099 ceph-mon[71325]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-01-13T17:57:42.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:42 smithi084 ceph-mon[37908]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-01-13T17:57:42.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:42 smithi084 ceph-mon[52328]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-01-13T17:57:44.100 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:44 smithi099 ceph-mon[71325]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-01-13T17:57:44.100 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:44 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:44.100 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:44 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:44.100 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:44 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:44.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:44 smithi084 ceph-mon[37908]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-01-13T17:57:44.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:44.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:44.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:44 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:44.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:44 smithi084 ceph-mon[52328]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-01-13T17:57:44.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:44 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:44.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:44 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:44.432 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:44 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:45.362 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:45 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:45.362 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:45 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:45.362 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:45 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:45.362 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:45 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:45.362 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:45 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:45.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:45 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:45.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:45 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:45.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:45 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:45.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:45 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:45.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:45 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:45 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:45 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:45 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:45 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:45 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:45.479 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 5 on host 'smithi099' 2024-01-13T17:57:45.872 DEBUG:teuthology.orchestra.run.smithi099:osd.5> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.5.service 2024-01-13T17:57:45.874 INFO:tasks.cephadm:Deploying osd.6 on smithi099 with /dev/vg_nvme/lv_2... 2024-01-13T17:57:45.874 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-13T17:57:45.905 INFO:journalctl@ceph.osd.5.smithi099.stdout:-- Logs begin at Sat 2024-01-13 17:16:04 UTC. -- 2024-01-13T17:57:46.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:46 smithi099 ceph-mon[71325]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-01-13T17:57:46.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:46 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:46.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:46 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:46.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:46 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:46.369 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 17:57:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[84329]: 2024-01-13T17:57:46.215+0000 7ff8f68f1540 -1 osd.5 0 log_to_monitors true 2024-01-13T17:57:46.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:46 smithi084 ceph-mon[52328]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-01-13T17:57:46.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:46 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:46.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:46 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:46.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:46 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:46.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:46 smithi084 ceph-mon[37908]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-01-13T17:57:46.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:46 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:46.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:46 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:46.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:46 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:57:46.573 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:57:47.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:47 smithi099 ceph-mon[71325]: from='osd.5 [v2:172.21.15.99:6808/1484816369,v1:172.21.15.99:6809/1484816369]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T17:57:47.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:47 smithi099 ceph-mon[71325]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T17:57:47.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:47 smithi084 ceph-mon[37908]: from='osd.5 [v2:172.21.15.99:6808/1484816369,v1:172.21.15.99:6809/1484816369]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T17:57:47.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:47 smithi084 ceph-mon[37908]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T17:57:47.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:47 smithi084 ceph-mon[52328]: from='osd.5 [v2:172.21.15.99:6808/1484816369,v1:172.21.15.99:6809/1484816369]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T17:57:47.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:47 smithi084 ceph-mon[52328]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T17:57:47.927 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-13T17:57:47.927 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-13T17:57:47.927 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-01-13T17:57:47.927 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-01-13T17:57:47.927 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112101 s, 935 MB/s 2024-01-13T17:57:47.927 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-01-13T17:57:48.220 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-13T17:57:48.220 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-13T17:57:48.220 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: osdmap e35: 6 total, 5 up, 6 in 2024-01-13T17:57:48.220 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:48.221 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='osd.5 [v2:172.21.15.99:6808/1484816369,v1:172.21.15.99:6809/1484816369]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:48.221 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:48.221 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.221 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.221 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:48.221 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:48.221 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.221 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:48.221 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:48.221 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.221 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[84329]: 2024-01-13T17:57:48.091+0000 7ff8ed0c5700 -1 osd.5 0 waiting for initial osdmap 2024-01-13T17:57:48.221 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 17:57:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[84329]: 2024-01-13T17:57:48.096+0000 7ff8e9ec4700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T17:57:48.295 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_2 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: osdmap e35: 6 total, 5 up, 6 in 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='osd.5 [v2:172.21.15.99:6808/1484816369,v1:172.21.15.99:6809/1484816369]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: osdmap e35: 6 total, 5 up, 6 in 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='osd.5 [v2:172.21.15.99:6808/1484816369,v1:172.21.15.99:6809/1484816369]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:57:48.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:48.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:57:48.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:48 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:57:48.551 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:57:49.358 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:49 smithi099 ceph-mon[71325]: Detected new or changed devices on smithi099 2024-01-13T17:57:49.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:49 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi099 to 8561M 2024-01-13T17:57:49.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:49 smithi099 ceph-mon[71325]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:57:49.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:49 smithi099 ceph-mon[71325]: osdmap e36: 6 total, 5 up, 6 in 2024-01-13T17:57:49.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:49 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:49.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:49 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:49.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:49 smithi099 ceph-mon[71325]: osd.5 [v2:172.21.15.99:6808/1484816369,v1:172.21.15.99:6809/1484816369] boot 2024-01-13T17:57:49.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:49 smithi099 ceph-mon[71325]: osdmap e37: 6 total, 6 up, 6 in 2024-01-13T17:57:49.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:49 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:49.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[37908]: Detected new or changed devices on smithi099 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi099 to 8561M 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[37908]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[37908]: osdmap e36: 6 total, 5 up, 6 in 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[37908]: osd.5 [v2:172.21.15.99:6808/1484816369,v1:172.21.15.99:6809/1484816369] boot 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[37908]: osdmap e37: 6 total, 6 up, 6 in 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[52328]: Detected new or changed devices on smithi099 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi099 to 8561M 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[52328]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:57:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[52328]: osdmap e36: 6 total, 5 up, 6 in 2024-01-13T17:57:49.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:49.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:49.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[52328]: osd.5 [v2:172.21.15.99:6808/1484816369,v1:172.21.15.99:6809/1484816369] boot 2024-01-13T17:57:49.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[52328]: osdmap e37: 6 total, 6 up, 6 in 2024-01-13T17:57:49.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:49 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:57:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:50 smithi099 ceph-mon[71325]: purged_snaps scrub starts 2024-01-13T17:57:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:50 smithi099 ceph-mon[71325]: purged_snaps scrub ok 2024-01-13T17:57:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:50 smithi099 ceph-mon[71325]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:50 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:57:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:50 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:57:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:50 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:50 smithi099 ceph-mon[71325]: osdmap e38: 6 total, 6 up, 6 in 2024-01-13T17:57:50.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[37908]: purged_snaps scrub starts 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[37908]: purged_snaps scrub ok 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[37908]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[37908]: osdmap e38: 6 total, 6 up, 6 in 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[52328]: purged_snaps scrub starts 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[52328]: purged_snaps scrub ok 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[52328]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:57:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:50.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:50 smithi084 ceph-mon[52328]: osdmap e38: 6 total, 6 up, 6 in 2024-01-13T17:57:51.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:51 smithi099 ceph-mon[71325]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:57:51.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:51 smithi099 ceph-mon[71325]: osdmap e39: 6 total, 6 up, 6 in 2024-01-13T17:57:51.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:51 smithi084 ceph-mon[37908]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:57:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:51 smithi084 ceph-mon[37908]: osdmap e39: 6 total, 6 up, 6 in 2024-01-13T17:57:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:51 smithi084 ceph-mon[52328]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:57:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:51 smithi084 ceph-mon[52328]: osdmap e39: 6 total, 6 up, 6 in 2024-01-13T17:57:52.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:52 smithi099 ceph-mon[71325]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:57:52.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:52 smithi099 ceph-mon[71325]: from='client.? 172.21.15.99:0/1575343322' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae64dc86-5e7d-4812-a9fd-f831ff5806dc"}]: dispatch 2024-01-13T17:57:52.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:52 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae64dc86-5e7d-4812-a9fd-f831ff5806dc"}]: dispatch 2024-01-13T17:57:52.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:52 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae64dc86-5e7d-4812-a9fd-f831ff5806dc"}]': finished 2024-01-13T17:57:52.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:52 smithi099 ceph-mon[71325]: osdmap e40: 7 total, 6 up, 7 in 2024-01-13T17:57:52.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:52 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:57:52.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[37908]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:57:52.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[37908]: from='client.? 172.21.15.99:0/1575343322' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae64dc86-5e7d-4812-a9fd-f831ff5806dc"}]: dispatch 2024-01-13T17:57:52.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae64dc86-5e7d-4812-a9fd-f831ff5806dc"}]: dispatch 2024-01-13T17:57:52.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae64dc86-5e7d-4812-a9fd-f831ff5806dc"}]': finished 2024-01-13T17:57:52.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[37908]: osdmap e40: 7 total, 6 up, 7 in 2024-01-13T17:57:52.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:57:52.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[52328]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:57:52.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[52328]: from='client.? 172.21.15.99:0/1575343322' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae64dc86-5e7d-4812-a9fd-f831ff5806dc"}]: dispatch 2024-01-13T17:57:52.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae64dc86-5e7d-4812-a9fd-f831ff5806dc"}]: dispatch 2024-01-13T17:57:52.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae64dc86-5e7d-4812-a9fd-f831ff5806dc"}]': finished 2024-01-13T17:57:52.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[52328]: osdmap e40: 7 total, 6 up, 7 in 2024-01-13T17:57:52.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:52 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:57:53.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:53 smithi099 ceph-mon[71325]: from='client.? 172.21.15.99:0/2484333474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:53.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:53 smithi099 ceph-mon[71325]: osdmap e41: 7 total, 6 up, 7 in 2024-01-13T17:57:53.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:53 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:57:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:53 smithi084 ceph-mon[37908]: from='client.? 172.21.15.99:0/2484333474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:53 smithi084 ceph-mon[37908]: osdmap e41: 7 total, 6 up, 7 in 2024-01-13T17:57:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:53 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:57:53.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:53 smithi084 ceph-mon[52328]: from='client.? 172.21.15.99:0/2484333474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:57:53.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:53 smithi084 ceph-mon[52328]: osdmap e41: 7 total, 6 up, 7 in 2024-01-13T17:57:53.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:53 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:57:54.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:54 smithi099 ceph-mon[71325]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:57:54.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:54 smithi084 ceph-mon[37908]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:57:54.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:54 smithi084 ceph-mon[52328]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:57:56.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:56 smithi099 ceph-mon[71325]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:57:56.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:56 smithi084 ceph-mon[37908]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:57:56.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:56 smithi084 ceph-mon[52328]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:57:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:57 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-13T17:57:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:57 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:57.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:57 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-13T17:57:57.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:57 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:57.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:57 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-13T17:57:57.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:57 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:57:58.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:58 smithi099 ceph-mon[71325]: Deploying daemon osd.6 on smithi099 2024-01-13T17:57:58.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:57:58 smithi099 ceph-mon[71325]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:57:58.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:58 smithi084 ceph-mon[37908]: Deploying daemon osd.6 on smithi099 2024-01-13T17:57:58.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:57:58 smithi084 ceph-mon[37908]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:57:58.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:58 smithi084 ceph-mon[52328]: Deploying daemon osd.6 on smithi099 2024-01-13T17:57:58.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:57:58 smithi084 ceph-mon[52328]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:00.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:00 smithi084 ceph-mon[37908]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:00.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:00 smithi084 ceph-mon[52328]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:00.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:00 smithi099 ceph-mon[71325]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:01.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:01 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:01.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:01 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:01.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:01 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:01.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:01 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:01.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:01 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:01.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:01 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:01 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:01 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:01 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:02.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:02 smithi099 ceph-mon[71325]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:02.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:02.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:02.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:02.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:02.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:02 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:02.541 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 6 on host 'smithi099' 2024-01-13T17:58:02.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[37908]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:02.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:02.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:02.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:02.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:02.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[52328]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:02.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:02 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:02.917 DEBUG:teuthology.orchestra.run.smithi099:osd.6> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.6.service 2024-01-13T17:58:02.919 INFO:tasks.cephadm:Deploying osd.7 on smithi099 with /dev/vg_nvme/lv_1... 2024-01-13T17:58:02.919 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-13T17:58:02.952 INFO:journalctl@ceph.osd.6.smithi099.stdout:-- Logs begin at Sat 2024-01-13 17:16:04 UTC. -- 2024-01-13T17:58:03.349 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:58:03.712 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 17:58:03 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[91416]: 2024-01-13T17:58:03.500+0000 7f3bcd5df540 -1 osd.6 0 log_to_monitors true 2024-01-13T17:58:03.712 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:03 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:03.712 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:03 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:03.712 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:03 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:03.712 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:03 smithi099 ceph-mon[71325]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:03.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:03 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:03.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:03 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:03.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:03 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:03.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:03 smithi084 ceph-mon[37908]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:03.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:03 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:03.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:03 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:03.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:03 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:03.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:03 smithi084 ceph-mon[52328]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:04 smithi099 ceph-mon[71325]: from='osd.6 [v2:172.21.15.99:6816/65848361,v1:172.21.15.99:6817/65848361]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T17:58:04.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:04 smithi099 ceph-mon[71325]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T17:58:04.846 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-13T17:58:04.846 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-13T17:58:04.847 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-01-13T17:58:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-01-13T17:58:04.847 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126479 s, 829 MB/s 2024-01-13T17:58:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-01-13T17:58:04.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:04 smithi084 ceph-mon[37908]: from='osd.6 [v2:172.21.15.99:6816/65848361,v1:172.21.15.99:6817/65848361]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T17:58:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:04 smithi084 ceph-mon[37908]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T17:58:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:04 smithi084 ceph-mon[52328]: from='osd.6 [v2:172.21.15.99:6816/65848361,v1:172.21.15.99:6817/65848361]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T17:58:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:04 smithi084 ceph-mon[52328]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T17:58:05.476 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_1 2024-01-13T17:58:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:58:05.852 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[91416]: 2024-01-13T17:58:05.514+0000 7f3bc3db3700 -1 osd.6 0 waiting for initial osdmap 2024-01-13T17:58:05.853 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[91416]: 2024-01-13T17:58:05.520+0000 7f3bbebae700 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T17:58:05.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-13T17:58:05.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: osdmap e42: 7 total, 6 up, 7 in 2024-01-13T17:58:05.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:05.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='osd.6 [v2:172.21.15.99:6816/65848361,v1:172.21.15.99:6817/65848361]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:05.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:05.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:05.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: Detected new or changed devices on smithi099 2024-01-13T17:58:05.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:05.853 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:05.854 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:05.854 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:05.854 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:05.854 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi099 to 5707M 2024-01-13T17:58:05.854 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:05.854 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:05.854 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:05.854 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:05 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: osdmap e42: 7 total, 6 up, 7 in 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='osd.6 [v2:172.21.15.99:6816/65848361,v1:172.21.15.99:6817/65848361]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: Detected new or changed devices on smithi099 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi099 to 5707M 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: osdmap e42: 7 total, 6 up, 7 in 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='osd.6 [v2:172.21.15.99:6816/65848361,v1:172.21.15.99:6817/65848361]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: Detected new or changed devices on smithi099 2024-01-13T17:58:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:05.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:05.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:05.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:05.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:05.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi099 to 5707M 2024-01-13T17:58:05.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:05.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:05.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:05.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:05 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:06 smithi099 ceph-mon[71325]: purged_snaps scrub starts 2024-01-13T17:58:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:06 smithi099 ceph-mon[71325]: purged_snaps scrub ok 2024-01-13T17:58:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:06 smithi099 ceph-mon[71325]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:58:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:06 smithi099 ceph-mon[71325]: osdmap e43: 7 total, 6 up, 7 in 2024-01-13T17:58:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:06 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:06 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:06.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[37908]: purged_snaps scrub starts 2024-01-13T17:58:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[37908]: purged_snaps scrub ok 2024-01-13T17:58:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[37908]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:58:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[37908]: osdmap e43: 7 total, 6 up, 7 in 2024-01-13T17:58:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[52328]: purged_snaps scrub starts 2024-01-13T17:58:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[52328]: purged_snaps scrub ok 2024-01-13T17:58:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[52328]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:58:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[52328]: osdmap e43: 7 total, 6 up, 7 in 2024-01-13T17:58:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:06 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:07.612 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:07 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:07.612 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:07 smithi099 ceph-mon[71325]: osd.6 [v2:172.21.15.99:6816/65848361,v1:172.21.15.99:6817/65848361] boot 2024-01-13T17:58:07.612 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:07 smithi099 ceph-mon[71325]: osdmap e44: 7 total, 7 up, 7 in 2024-01-13T17:58:07.612 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:07 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:07.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:07 smithi099 ceph-mon[71325]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:07.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:07 smithi099 ceph-mon[71325]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:07.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:07 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:58:07.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:07 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:58:07.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:07 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[37908]: osd.6 [v2:172.21.15.99:6816/65848361,v1:172.21.15.99:6817/65848361] boot 2024-01-13T17:58:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[37908]: osdmap e44: 7 total, 7 up, 7 in 2024-01-13T17:58:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[37908]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[37908]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:58:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:58:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:07.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:07.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[52328]: osd.6 [v2:172.21.15.99:6816/65848361,v1:172.21.15.99:6817/65848361] boot 2024-01-13T17:58:07.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[52328]: osdmap e44: 7 total, 7 up, 7 in 2024-01-13T17:58:07.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:58:07.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[52328]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-01-13T17:58:07.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[52328]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:07.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-13T17:58:07.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-13T17:58:07.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:07 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:08 smithi099 ceph-mon[71325]: osdmap e45: 7 total, 7 up, 7 in 2024-01-13T17:58:08.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:08 smithi084 ceph-mon[37908]: osdmap e45: 7 total, 7 up, 7 in 2024-01-13T17:58:08.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:08 smithi084 ceph-mon[52328]: osdmap e45: 7 total, 7 up, 7 in 2024-01-13T17:58:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:09 smithi099 ceph-mon[71325]: osdmap e46: 7 total, 7 up, 7 in 2024-01-13T17:58:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:09 smithi099 ceph-mon[71325]: from='client.? 172.21.15.99:0/4200818235' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f700b134-999a-4bca-9f2a-ae52c489c637"}]: dispatch 2024-01-13T17:58:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:09 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f700b134-999a-4bca-9f2a-ae52c489c637"}]: dispatch 2024-01-13T17:58:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:09 smithi099 ceph-mon[71325]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f700b134-999a-4bca-9f2a-ae52c489c637"}]': finished 2024-01-13T17:58:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:09 smithi099 ceph-mon[71325]: osdmap e47: 8 total, 7 up, 8 in 2024-01-13T17:58:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:09 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:09 smithi099 ceph-mon[71325]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-01-13T17:58:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:09 smithi099 ceph-mon[71325]: from='client.? 172.21.15.99:0/1225858272' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:58:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[37908]: osdmap e46: 7 total, 7 up, 7 in 2024-01-13T17:58:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[37908]: from='client.? 172.21.15.99:0/4200818235' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f700b134-999a-4bca-9f2a-ae52c489c637"}]: dispatch 2024-01-13T17:58:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f700b134-999a-4bca-9f2a-ae52c489c637"}]: dispatch 2024-01-13T17:58:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[37908]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f700b134-999a-4bca-9f2a-ae52c489c637"}]': finished 2024-01-13T17:58:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[37908]: osdmap e47: 8 total, 7 up, 8 in 2024-01-13T17:58:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[37908]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-01-13T17:58:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[37908]: from='client.? 172.21.15.99:0/1225858272' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:58:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[52328]: osdmap e46: 7 total, 7 up, 7 in 2024-01-13T17:58:09.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[52328]: from='client.? 172.21.15.99:0/4200818235' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f700b134-999a-4bca-9f2a-ae52c489c637"}]: dispatch 2024-01-13T17:58:09.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f700b134-999a-4bca-9f2a-ae52c489c637"}]: dispatch 2024-01-13T17:58:09.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[52328]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f700b134-999a-4bca-9f2a-ae52c489c637"}]': finished 2024-01-13T17:58:09.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[52328]: osdmap e47: 8 total, 7 up, 8 in 2024-01-13T17:58:09.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:09.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[52328]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-01-13T17:58:09.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:09 smithi084 ceph-mon[52328]: from='client.? 172.21.15.99:0/1225858272' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-13T17:58:11.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:11 smithi099 ceph-mon[71325]: osdmap e48: 8 total, 7 up, 8 in 2024-01-13T17:58:11.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:11 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:11.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:11 smithi084 ceph-mon[37908]: osdmap e48: 8 total, 7 up, 8 in 2024-01-13T17:58:11.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:11 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:11.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:11 smithi084 ceph-mon[52328]: osdmap e48: 8 total, 7 up, 8 in 2024-01-13T17:58:11.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:11 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:12 smithi099 ceph-mon[71325]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-01-13T17:58:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:12 smithi099 ceph-mon[71325]: osdmap e49: 8 total, 7 up, 8 in 2024-01-13T17:58:12.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:12 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:12.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:12 smithi084 ceph-mon[37908]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-01-13T17:58:12.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:12 smithi084 ceph-mon[37908]: osdmap e49: 8 total, 7 up, 8 in 2024-01-13T17:58:12.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:12 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:12.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:12 smithi084 ceph-mon[52328]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-01-13T17:58:12.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:12 smithi084 ceph-mon[52328]: osdmap e49: 8 total, 7 up, 8 in 2024-01-13T17:58:12.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:12 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:14.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:14 smithi099 ceph-mon[71325]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-01-13T17:58:14.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-13T17:58:14.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:14 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:14.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:14 smithi084 ceph-mon[37908]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-01-13T17:58:14.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-13T17:58:14.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:14 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:14.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:14 smithi084 ceph-mon[52328]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-01-13T17:58:14.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-13T17:58:14.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:14 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:15.296 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:15 smithi099 ceph-mon[71325]: Deploying daemon osd.7 on smithi099 2024-01-13T17:58:15.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:15 smithi084 ceph-mon[37908]: Deploying daemon osd.7 on smithi099 2024-01-13T17:58:15.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:15 smithi084 ceph-mon[52328]: Deploying daemon osd.7 on smithi099 2024-01-13T17:58:16.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:16 smithi099 ceph-mon[71325]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-01-13T17:58:16.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:16 smithi084 ceph-mon[37908]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-01-13T17:58:16.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:16 smithi084 ceph-mon[52328]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-01-13T17:58:18.294 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:18 smithi099 ceph-mon[71325]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-13T17:58:18.294 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:18 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:18.294 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:18 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:18.294 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:18 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:18.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:18 smithi084 ceph-mon[37908]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-13T17:58:18.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:18 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:18.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:18 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:18.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:18 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:18.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:18 smithi084 ceph-mon[52328]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-13T17:58:18.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:18 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:18.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:18 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:18.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:18 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 7 on host 'smithi099' 2024-01-13T17:58:20.064 DEBUG:teuthology.orchestra.run.smithi099:osd.7> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.7.service 2024-01-13T17:58:20.066 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-01-13T17:58:20.066 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd stat -f json 2024-01-13T17:58:20.097 INFO:journalctl@ceph.osd.7.smithi099.stdout:-- Logs begin at Sat 2024-01-13 17:16:04 UTC. -- 2024-01-13T17:58:20.337 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:58:20.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[37908]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-01-13T17:58:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[52328]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-01-13T17:58:20.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:20.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:20.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:20 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:20.551 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:20 smithi099 ceph-mon[71325]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-01-13T17:58:20.551 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:20 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.551 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:20 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.551 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:20 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:20.551 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:20 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:20.551 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:20 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.552 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:20 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.552 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:20 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:20.552 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:20 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:20.869 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 17:58:20 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[99404]: 2024-01-13T17:58:20.628+0000 7f165f691540 -1 osd.7 0 log_to_monitors true 2024-01-13T17:58:21.172 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:21 smithi084 ceph-mon[52328]: from='osd.7 [v2:172.21.15.99:6824/4156945024,v1:172.21.15.99:6825/4156945024]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T17:58:21.172 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:21 smithi084 ceph-mon[52328]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T17:58:21.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:21 smithi084 ceph-mon[37908]: from='osd.7 [v2:172.21.15.99:6824/4156945024,v1:172.21.15.99:6825/4156945024]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T17:58:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:21 smithi084 ceph-mon[37908]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T17:58:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:21 smithi099 ceph-mon[71325]: from='osd.7 [v2:172.21.15.99:6824/4156945024,v1:172.21.15.99:6825/4156945024]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T17:58:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:21 smithi099 ceph-mon[71325]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T17:58:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:22.025 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":50,"num_osds":8,"num_up_osds":7,"osd_up_since":1705168686,"num_in_osds":8,"osd_in_since":1705168688,"num_remapped_pgs":0} 2024-01-13T17:58:22.369 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[99404]: 2024-01-13T17:58:22.182+0000 7f1655e65700 -1 osd.7 0 waiting for initial osdmap 2024-01-13T17:58:22.369 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[99404]: 2024-01-13T17:58:22.189+0000 7f1651461700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T17:58:22.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-13T17:58:22.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-13T17:58:22.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: osdmap e50: 8 total, 7 up, 8 in 2024-01-13T17:58:22.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:22.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='osd.7 [v2:172.21.15.99:6824/4156945024,v1:172.21.15.99:6825/4156945024]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1236763438' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:22.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:22 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-13T17:58:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-13T17:58:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: osdmap e50: 8 total, 7 up, 8 in 2024-01-13T17:58:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='osd.7 [v2:172.21.15.99:6824/4156945024,v1:172.21.15.99:6825/4156945024]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1236763438' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-13T17:58:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: osdmap e50: 8 total, 7 up, 8 in 2024-01-13T17:58:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='osd.7 [v2:172.21.15.99:6824/4156945024,v1:172.21.15.99:6825/4156945024]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1236763438' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:22.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:22 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:23.026 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd stat -f json 2024-01-13T17:58:23.297 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:58:23.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[37908]: Detected new or changed devices on smithi099 2024-01-13T17:58:23.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi099 to 4280M 2024-01-13T17:58:23.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[37908]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:58:23.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[37908]: osdmap e51: 8 total, 7 up, 8 in 2024-01-13T17:58:23.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:23.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:23.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[52328]: Detected new or changed devices on smithi099 2024-01-13T17:58:23.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi099 to 4280M 2024-01-13T17:58:23.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[52328]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:58:23.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[52328]: osdmap e51: 8 total, 7 up, 8 in 2024-01-13T17:58:23.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:23.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:23 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:23 smithi099 ceph-mon[71325]: Detected new or changed devices on smithi099 2024-01-13T17:58:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:23 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi099 to 4280M 2024-01-13T17:58:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:23 smithi099 ceph-mon[71325]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-13T17:58:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:23 smithi099 ceph-mon[71325]: osdmap e51: 8 total, 7 up, 8 in 2024-01-13T17:58:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:23 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:23 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:24.418 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:24.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[52328]: purged_snaps scrub starts 2024-01-13T17:58:24.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[52328]: purged_snaps scrub ok 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[52328]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[52328]: osd.7 [v2:172.21.15.99:6824/4156945024,v1:172.21.15.99:6825/4156945024] boot 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[52328]: osdmap e52: 8 total, 8 up, 8 in 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[52328]: osdmap e53: 8 total, 8 up, 8 in 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[37908]: purged_snaps scrub starts 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[37908]: purged_snaps scrub ok 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[37908]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[37908]: osd.7 [v2:172.21.15.99:6824/4156945024,v1:172.21.15.99:6825/4156945024] boot 2024-01-13T17:58:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[37908]: osdmap e52: 8 total, 8 up, 8 in 2024-01-13T17:58:24.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:24.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:24 smithi084 ceph-mon[37908]: osdmap e53: 8 total, 8 up, 8 in 2024-01-13T17:58:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:24 smithi099 ceph-mon[71325]: purged_snaps scrub starts 2024-01-13T17:58:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:24 smithi099 ceph-mon[71325]: purged_snaps scrub ok 2024-01-13T17:58:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:24 smithi099 ceph-mon[71325]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-01-13T17:58:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:24 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:24 smithi099 ceph-mon[71325]: osd.7 [v2:172.21.15.99:6824/4156945024,v1:172.21.15.99:6825/4156945024] boot 2024-01-13T17:58:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:24 smithi099 ceph-mon[71325]: osdmap e52: 8 total, 8 up, 8 in 2024-01-13T17:58:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:24 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:58:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:24 smithi099 ceph-mon[71325]: osdmap e53: 8 total, 8 up, 8 in 2024-01-13T17:58:24.784 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1705168703,"num_in_osds":8,"osd_in_since":1705168688,"num_remapped_pgs":1} 2024-01-13T17:58:24.785 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd dump --format=json 2024-01-13T17:58:25.039 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:58:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:25 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/833731898' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-13T17:58:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:25 smithi084 ceph-mon[52328]: osdmap e54: 8 total, 8 up, 8 in 2024-01-13T17:58:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:25 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/833731898' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-13T17:58:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:25 smithi084 ceph-mon[37908]: osdmap e54: 8 total, 8 up, 8 in 2024-01-13T17:58:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:25 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/833731898' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-13T17:58:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:25 smithi099 ceph-mon[71325]: osdmap e54: 8 total, 8 up, 8 in 2024-01-13T17:58:26.202 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:26.202 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":55,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:58:26.190284+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:58:26.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:26 smithi084 ceph-mon[37908]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:26.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:26 smithi084 ceph-mon[52328]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:26.574 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-13T17:56:59.053508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-01-13T17:58:26.574 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-01-13T17:58:26.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:26 smithi099 ceph-mon[71325]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:26.831 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:58:27.554 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:27 smithi084 ceph-mon[37908]: osdmap e55: 8 total, 8 up, 8 in 2024-01-13T17:58:27.554 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:27 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1564755325' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:27.554 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:27 smithi084 ceph-mon[52328]: osdmap e55: 8 total, 8 up, 8 in 2024-01-13T17:58:27.554 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:27 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1564755325' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:27 smithi099 ceph-mon[71325]: osdmap e55: 8 total, 8 up, 8 in 2024-01-13T17:58:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:27 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1564755325' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:27.937 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-01-13T17:58:28.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:28 smithi084 ceph-mon[37908]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:28.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:28 smithi084 ceph-mon[37908]: osdmap e56: 8 total, 8 up, 8 in 2024-01-13T17:58:28.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:28 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2779424527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:58:28.209 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:28 smithi084 ceph-mon[52328]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:28.209 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:28 smithi084 ceph-mon[52328]: osdmap e56: 8 total, 8 up, 8 in 2024-01-13T17:58:28.209 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:28 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2779424527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:58:28.307 INFO:tasks.cephadm:Adding mds.a on smithi084 2024-01-13T17:58:28.307 INFO:tasks.cephadm:Adding mds.b on smithi099 2024-01-13T17:58:28.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch apply mds all '2;smithi084=a;smithi099=b' 2024-01-13T17:58:28.578 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:58:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:28 smithi099 ceph-mon[71325]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:28 smithi099 ceph-mon[71325]: osdmap e56: 8 total, 8 up, 8 in 2024-01-13T17:58:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:28 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2779424527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:58:29.751 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled mds.all update... 2024-01-13T17:58:30.127 DEBUG:teuthology.orchestra.run.smithi084:mds.a> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mds.a.service 2024-01-13T17:58:30.130 DEBUG:teuthology.orchestra.run.smithi099:mds.b> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mds.b.service 2024-01-13T17:58:30.132 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-01-13T17:58:30.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-13T17:58:30.158 INFO:journalctl@ceph.mds.a.smithi084.stdout:-- Logs begin at Sat 2024-01-13 17:16:05 UTC. -- 2024-01-13T17:58:30.161 INFO:journalctl@ceph.mds.b.smithi099.stdout:-- Logs begin at Sat 2024-01-13 17:16:04 UTC. -- 2024-01-13T17:58:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:30 smithi099 ceph-mon[71325]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:30 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:30 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:30 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:30 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:30 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:30 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T17:58:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:30 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-13T17:58:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:30 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:30.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[37908]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T17:58:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-13T17:58:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[52328]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:30.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:30.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:30.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:30.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T17:58:30.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-13T17:58:30.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:30 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:30.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:30.547 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":56,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:58:27.200977+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:58:30.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-13T17:56:59.053508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-01-13T17:58:30.562 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-13T17:58:30.891 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-01-13T17:58:30.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-13T17:58:31.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:31.318 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-13T17:58:31.320 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 1 2024-01-13T17:58:31.330 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:31 smithi084 ceph-mon[37908]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi084=a;smithi099=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:31.330 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:31 smithi084 ceph-mon[37908]: Saving service mds.all spec with placement smithi084=a;smithi099=b;count:2 2024-01-13T17:58:31.330 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:31 smithi084 ceph-mon[37908]: Deploying daemon mds.a on smithi084 2024-01-13T17:58:31.331 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:31 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1498877279' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:31.331 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:31 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/333817668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:58:31.331 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:31 smithi084 ceph-mon[52328]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi084=a;smithi099=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:31.331 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:31 smithi084 ceph-mon[52328]: Saving service mds.all spec with placement smithi084=a;smithi099=b;count:2 2024-01-13T17:58:31.331 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:31 smithi084 ceph-mon[52328]: Deploying daemon mds.a on smithi084 2024-01-13T17:58:31.331 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:31 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1498877279' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:31.331 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:31 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/333817668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:58:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:31 smithi099 ceph-mon[71325]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi084=a;smithi099=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:31 smithi099 ceph-mon[71325]: Saving service mds.all spec with placement smithi084=a;smithi099=b;count:2 2024-01-13T17:58:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:31 smithi099 ceph-mon[71325]: Deploying daemon mds.a on smithi084 2024-01-13T17:58:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:31 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1498877279' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:31 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/333817668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:58:31.678 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 17:58:31 smithi084 bash[87346]: 0aa496cb2e916d5f2f6ba4ff9f7b57ab471110e623bc97494a0387aaef308c8d 2024-01-13T17:58:31.678 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 17:58:31 smithi084 systemd[1]: Started Ceph mds.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:58:32.478 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:32 smithi099 ceph-mon[71325]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-13T17:58:32.478 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:32 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1589863567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:58:32.478 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:32 smithi099 ceph-mon[71325]: mds.? [v2:172.21.15.84:6834/3944391177,v1:172.21.15.84:6835/3944391177] up:boot 2024-01-13T17:58:32.478 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:32 smithi099 ceph-mon[71325]: fsmap 1 up:standby 2024-01-13T17:58:32.479 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:32 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T17:58:32.479 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:32 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:32.479 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:32 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:32.479 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:32 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:32.479 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:32 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T17:58:32.479 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:32 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-13T17:58:32.479 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:32 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:32.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[37908]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1589863567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[37908]: mds.? [v2:172.21.15.84:6834/3944391177,v1:172.21.15.84:6835/3944391177] up:boot 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[37908]: fsmap 1 up:standby 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[52328]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-13T17:58:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1589863567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:58:32.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[52328]: mds.? [v2:172.21.15.84:6834/3944391177,v1:172.21.15.84:6835/3944391177] up:boot 2024-01-13T17:58:32.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[52328]: fsmap 1 up:standby 2024-01-13T17:58:32.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T17:58:32.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:32.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:32.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:32.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T17:58:32.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-13T17:58:32.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:32 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:32.869 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 17:58:32 smithi099 systemd[1]: Starting Ceph mds.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:58:33.333 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-13T17:58:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:33 smithi099 ceph-mon[71325]: Deploying daemon mds.b on smithi099 2024-01-13T17:58:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:33 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:33 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:33.619 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 17:58:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-b[104423]: starting mds.b at 2024-01-13T17:58:33.619 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 17:58:33 smithi099 bash[104409]: 9c33fc8e4d166aaddbb60b23968de1c491ac79db296e9d32c1649d44fccbcc61 2024-01-13T17:58:33.619 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 17:58:33 smithi099 systemd[1]: Started Ceph mds.b for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:58:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:33 smithi084 ceph-mon[37908]: Deploying daemon mds.b on smithi099 2024-01-13T17:58:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:33 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:33.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:33 smithi084 ceph-mon[52328]: Deploying daemon mds.b on smithi099 2024-01-13T17:58:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:33 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:33 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:33.722 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:33.723 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3944391177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3944391177},{"type":"v1","addr":"172.21.15.84:6835","nonce":3944391177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24337,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/2558131725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2558131725},{"type":"v1","addr":"172.21.15.99:6833","nonce":2558131725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-01-13T17:58:33.725 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2024-01-13T17:58:33.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-13T17:58:34.064 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:34.064 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":56,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:58:27.200977+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:58:34.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-13T17:56:59.053508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-01-13T17:58:34.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-13T17:58:34.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[52328]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-01-13T17:58:34.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[52328]: mds.? [v2:172.21.15.99:6832/2558131725,v1:172.21.15.99:6833/2558131725] up:boot 2024-01-13T17:58:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[52328]: fsmap 2 up:standby 2024-01-13T17:58:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T17:58:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3823145592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:58:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3076644528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:34.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[37908]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-01-13T17:58:34.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[37908]: mds.? [v2:172.21.15.99:6832/2558131725,v1:172.21.15.99:6833/2558131725] up:boot 2024-01-13T17:58:34.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[37908]: fsmap 2 up:standby 2024-01-13T17:58:34.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T17:58:34.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:34.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:34.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:34.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:34.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3823145592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:58:34.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:34 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3076644528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:34.432 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-01-13T17:58:34.447 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-13T17:58:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:34 smithi099 ceph-mon[71325]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-01-13T17:58:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:34 smithi099 ceph-mon[71325]: mds.? [v2:172.21.15.99:6832/2558131725,v1:172.21.15.99:6833/2558131725] up:boot 2024-01-13T17:58:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:34 smithi099 ceph-mon[71325]: fsmap 2 up:standby 2024-01-13T17:58:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:34 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T17:58:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:34 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:34 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:34.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:34 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:34.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:34 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:34.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:34 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3823145592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:58:34.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:34 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3076644528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:34.761 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:34.761 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2024-01-13T17:58:34.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-01-13T17:58:34.761 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2024-01-13T17:58:34.761 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2024-01-13T17:58:34.761 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T17:58:34.761 INFO:teuthology.orchestra.run.smithi084.stdout:] 2024-01-13T17:58:34.775 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-13T17:58:34.775 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-13T17:58:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1314161770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:58:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2188787277' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-13T17:58:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1205504374' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-13T17:58:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:35 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-13T17:58:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1314161770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2188787277' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1205504374' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-13T17:58:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1314161770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2188787277' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-13T17:58:35.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:35.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1205504374' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-13T17:58:35.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:35 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-13T17:58:35.825 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2024-01-13T17:58:35.836 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-13T17:58:36.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:36 smithi084 ceph-mon[37908]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-01-13T17:58:36.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:36 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-13T17:58:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:36 smithi084 ceph-mon[37908]: osdmap e57: 8 total, 8 up, 8 in 2024-01-13T17:58:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:36 smithi084 ceph-mon[52328]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-01-13T17:58:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:36 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-13T17:58:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:36 smithi084 ceph-mon[52328]: osdmap e57: 8 total, 8 up, 8 in 2024-01-13T17:58:36.839 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2024-01-13T17:58:36.849 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-13T17:58:36.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:36 smithi099 ceph-mon[71325]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-01-13T17:58:36.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:36 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-13T17:58:36.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:36 smithi099 ceph-mon[71325]: osdmap e57: 8 total, 8 up, 8 in 2024-01-13T17:58:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/37072443' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-13T17:58:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[37908]: pgmap v143: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-01-13T17:58:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/37072443' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-13T17:58:37.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[37908]: osdmap e58: 8 total, 8 up, 8 in 2024-01-13T17:58:37.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3681886310' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-13T17:58:37.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-13T17:58:37.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[37908]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-01-13T17:58:37.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/37072443' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-13T17:58:37.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[52328]: pgmap v143: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-01-13T17:58:37.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/37072443' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-13T17:58:37.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[52328]: osdmap e58: 8 total, 8 up, 8 in 2024-01-13T17:58:37.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3681886310' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-13T17:58:37.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-13T17:58:37.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:37 smithi084 ceph-mon[52328]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-01-13T17:58:37.831 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2024-01-13T17:58:37.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-13T17:58:37.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:37 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/37072443' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-13T17:58:37.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:37 smithi099 ceph-mon[71325]: pgmap v143: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-01-13T17:58:37.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:37 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/37072443' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-13T17:58:37.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:37 smithi099 ceph-mon[71325]: osdmap e58: 8 total, 8 up, 8 in 2024-01-13T17:58:37.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:37 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3681886310' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-13T17:58:37.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:37 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-13T17:58:37.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:37 smithi099 ceph-mon[71325]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-01-13T17:58:38.154 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:38.154 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":59,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:58:37.203905+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-13T17:58:35.312354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-13T17:58:36.379223+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:58:38.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-13T17:58:38.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[37908]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T17:58:38.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[37908]: osdmap e59: 8 total, 8 up, 8 in 2024-01-13T17:58:38.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-13T17:58:38.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[37908]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-01-13T17:58:38.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[37908]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-01-13T17:58:38.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/778369580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:38.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[52328]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T17:58:38.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[52328]: osdmap e59: 8 total, 8 up, 8 in 2024-01-13T17:58:38.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-13T17:58:38.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[52328]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-01-13T17:58:38.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[52328]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-01-13T17:58:38.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:38 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/778369580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:38.483 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:38.483 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":60,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:58:38.390669+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-13T17:58:35.312354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-13T17:58:36.379223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:58:38.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-13T17:58:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:38 smithi099 ceph-mon[71325]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T17:58:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:38 smithi099 ceph-mon[71325]: osdmap e59: 8 total, 8 up, 8 in 2024-01-13T17:58:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:38 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-13T17:58:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:38 smithi099 ceph-mon[71325]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-01-13T17:58:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:38 smithi099 ceph-mon[71325]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-01-13T17:58:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:38 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/778369580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[37908]: osdmap e60: 8 total, 8 up, 8 in 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/4246544674' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[37908]: pgmap v147: 97 pgs: 10 creating+peering, 26 active+clean, 61 unknown; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[37908]: mds.? [v2:172.21.15.99:6832/2558131725,v1:172.21.15.99:6833/2558131725] up:active 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[37908]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[37908]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/799473387' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[52328]: osdmap e60: 8 total, 8 up, 8 in 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/4246544674' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[52328]: pgmap v147: 97 pgs: 10 creating+peering, 26 active+clean, 61 unknown; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[52328]: mds.? [v2:172.21.15.99:6832/2558131725,v1:172.21.15.99:6833/2558131725] up:active 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[52328]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[52328]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:39 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/799473387' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-13T17:58:39.847 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-13T17:58:39.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-13T17:58:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:39 smithi099 ceph-mon[71325]: osdmap e60: 8 total, 8 up, 8 in 2024-01-13T17:58:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:39 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/4246544674' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:39 smithi099 ceph-mon[71325]: pgmap v147: 97 pgs: 10 creating+peering, 26 active+clean, 61 unknown; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:58:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:39 smithi099 ceph-mon[71325]: mds.? [v2:172.21.15.99:6832/2558131725,v1:172.21.15.99:6833/2558131725] up:active 2024-01-13T17:58:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:39 smithi099 ceph-mon[71325]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:39 smithi099 ceph-mon[71325]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:39 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/799473387' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-13T17:58:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:40 smithi084 ceph-mon[37908]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T17:58:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:40 smithi084 ceph-mon[37908]: Cluster is now healthy 2024-01-13T17:58:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:40 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/799473387' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-13T17:58:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:40 smithi084 ceph-mon[37908]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:40 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3216205548' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-01-13T17:58:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:40 smithi084 ceph-mon[52328]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T17:58:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:40 smithi084 ceph-mon[52328]: Cluster is now healthy 2024-01-13T17:58:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:40 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/799473387' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-13T17:58:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:40 smithi084 ceph-mon[52328]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:40 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3216205548' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-01-13T17:58:40.846 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-13T17:58:40.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-13T17:58:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:40 smithi099 ceph-mon[71325]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T17:58:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:40 smithi099 ceph-mon[71325]: Cluster is now healthy 2024-01-13T17:58:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:40 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/799473387' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-13T17:58:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:40 smithi099 ceph-mon[71325]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:40 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3216205548' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-01-13T17:58:41.200 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:41.200 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3944391177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3944391177},{"type":"v1","addr":"172.21.15.84:6835","nonce":3944391177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-13T17:58:37.204248+0000","modified":"2024-01-13T17:58:40.826281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/2558131725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2558131725},{"type":"v1","addr":"172.21.15.99:6833","nonce":2558131725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-13T17:58:41.202 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-01-13T17:58:41.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-13T17:58:41.525 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:41.525 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":60,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:58:38.390669+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-13T17:58:35.312354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-13T17:58:36.379223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:58:41.539 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-13T17:58:41.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-13T17:58:41.855 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:41.857 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-01-13T17:58:41.867 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-01-13T17:58:40.781114+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":228,"acting":228,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2384536,"kb_used_data":6232,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":747576680,"statfs":{"total":767960285184,"available":765518520320,"internally_reserved":0,"allocated":6381568,"data_stored":3666784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.967295"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416080+0000","last_change":"2024-01-13T17:58:37.416080+0000","last_active":"2024-01-13T17:58:37.416080+0000","last_peered":"2024-01-13T17:58:37.416080+0000","last_clean":"2024-01-13T17:58:37.416080+0000","last_became_active":"2024-01-13T17:58:37.415621+0000","last_became_peered":"2024-01-13T17:58:37.415621+0000","last_unstale":"2024-01-13T17:58:37.416080+0000","last_undegraded":"2024-01-13T17:58:37.416080+0000","last_fullsized":"2024-01-13T17:58:37.416080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:40.991399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.398891+0000","last_change":"2024-01-13T17:58:37.398891+0000","last_active":"2024-01-13T17:58:37.398891+0000","last_peered":"2024-01-13T17:58:37.398891+0000","last_clean":"2024-01-13T17:58:37.398891+0000","last_became_active":"2024-01-13T17:58:37.398476+0000","last_became_peered":"2024-01-13T17:58:37.398476+0000","last_unstale":"2024-01-13T17:58:37.398891+0000","last_undegraded":"2024-01-13T17:58:37.398891+0000","last_fullsized":"2024-01-13T17:58:37.398891+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:05:39.892184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413370+0000","last_change":"2024-01-13T17:58:37.411528+0000","last_active":"2024-01-13T17:58:37.413370+0000","last_peered":"2024-01-13T17:58:37.413370+0000","last_clean":"2024-01-13T17:58:37.413370+0000","last_became_active":"2024-01-13T17:58:37.411056+0000","last_became_peered":"2024-01-13T17:58:37.411056+0000","last_unstale":"2024-01-13T17:58:37.413370+0000","last_undegraded":"2024-01-13T17:58:37.413370+0000","last_fullsized":"2024-01-13T17:58:37.413370+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:13:24.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.415953+0000","last_change":"2024-01-13T17:58:37.415953+0000","last_active":"2024-01-13T17:58:37.415953+0000","last_peered":"2024-01-13T17:58:37.415953+0000","last_clean":"2024-01-13T17:58:37.415953+0000","last_became_active":"2024-01-13T17:58:37.413825+0000","last_became_peered":"2024-01-13T17:58:37.413825+0000","last_unstale":"2024-01-13T17:58:37.415953+0000","last_undegraded":"2024-01-13T17:58:37.415953+0000","last_fullsized":"2024-01-13T17:58:37.415953+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:04:08.326020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402618+0000","last_change":"2024-01-13T17:58:37.399699+0000","last_active":"2024-01-13T17:58:37.402618+0000","last_peered":"2024-01-13T17:58:37.402618+0000","last_clean":"2024-01-13T17:58:37.402618+0000","last_became_active":"2024-01-13T17:58:37.399358+0000","last_became_peered":"2024-01-13T17:58:37.399358+0000","last_unstale":"2024-01-13T17:58:37.402618+0000","last_undegraded":"2024-01-13T17:58:37.402618+0000","last_fullsized":"2024-01-13T17:58:37.402618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:18.403109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413121+0000","last_change":"2024-01-13T17:58:37.413121+0000","last_active":"2024-01-13T17:58:37.413121+0000","last_peered":"2024-01-13T17:58:37.413121+0000","last_clean":"2024-01-13T17:58:37.413121+0000","last_became_active":"2024-01-13T17:58:37.412816+0000","last_became_peered":"2024-01-13T17:58:37.412816+0000","last_unstale":"2024-01-13T17:58:37.413121+0000","last_undegraded":"2024-01-13T17:58:37.413121+0000","last_fullsized":"2024-01-13T17:58:37.413121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:05.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416421+0000","last_change":"2024-01-13T17:58:37.416421+0000","last_active":"2024-01-13T17:58:37.416421+0000","last_peered":"2024-01-13T17:58:37.416421+0000","last_clean":"2024-01-13T17:58:37.416421+0000","last_became_active":"2024-01-13T17:58:37.416138+0000","last_became_peered":"2024-01-13T17:58:37.416138+0000","last_unstale":"2024-01-13T17:58:37.416421+0000","last_undegraded":"2024-01-13T17:58:37.416421+0000","last_fullsized":"2024-01-13T17:58:37.416421+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:10:51.751719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397837+0000","last_change":"2024-01-13T17:58:37.397837+0000","last_active":"2024-01-13T17:58:37.397837+0000","last_peered":"2024-01-13T17:58:37.397837+0000","last_clean":"2024-01-13T17:58:37.397837+0000","last_became_active":"2024-01-13T17:58:37.397557+0000","last_became_peered":"2024-01-13T17:58:37.397557+0000","last_unstale":"2024-01-13T17:58:37.397837+0000","last_undegraded":"2024-01-13T17:58:37.397837+0000","last_fullsized":"2024-01-13T17:58:37.397837+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:38:02.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397136+0000","last_change":"2024-01-13T17:58:37.397136+0000","last_active":"2024-01-13T17:58:37.397136+0000","last_peered":"2024-01-13T17:58:37.397136+0000","last_clean":"2024-01-13T17:58:37.397136+0000","last_became_active":"2024-01-13T17:58:37.396796+0000","last_became_peered":"2024-01-13T17:58:37.396796+0000","last_unstale":"2024-01-13T17:58:37.397136+0000","last_undegraded":"2024-01-13T17:58:37.397136+0000","last_fullsized":"2024-01-13T17:58:37.397136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:09:37.651466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.821008+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:14:27.077823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.394829+0000","last_change":"2024-01-13T17:58:37.394829+0000","last_active":"2024-01-13T17:58:37.394829+0000","last_peered":"2024-01-13T17:58:37.394829+0000","last_clean":"2024-01-13T17:58:37.394829+0000","last_became_active":"2024-01-13T17:58:37.394582+0000","last_became_peered":"2024-01-13T17:58:37.394582+0000","last_unstale":"2024-01-13T17:58:37.394829+0000","last_undegraded":"2024-01-13T17:58:37.394829+0000","last_fullsized":"2024-01-13T17:58:37.394829+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:52:38.944942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413457+0000","last_change":"2024-01-13T17:58:37.412247+0000","last_active":"2024-01-13T17:58:37.413457+0000","last_peered":"2024-01-13T17:58:37.413457+0000","last_clean":"2024-01-13T17:58:37.413457+0000","last_became_active":"2024-01-13T17:58:37.411947+0000","last_became_peered":"2024-01-13T17:58:37.411947+0000","last_unstale":"2024-01-13T17:58:37.413457+0000","last_undegraded":"2024-01-13T17:58:37.413457+0000","last_fullsized":"2024-01-13T17:58:37.413457+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:05:19.184972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413437+0000","last_change":"2024-01-13T17:58:37.411858+0000","last_active":"2024-01-13T17:58:37.413437+0000","last_peered":"2024-01-13T17:58:37.413437+0000","last_clean":"2024-01-13T17:58:37.413437+0000","last_became_active":"2024-01-13T17:58:37.411559+0000","last_became_peered":"2024-01-13T17:58:37.411559+0000","last_unstale":"2024-01-13T17:58:37.413437+0000","last_undegraded":"2024-01-13T17:58:37.413437+0000","last_fullsized":"2024-01-13T17:58:37.413437+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:00:40.870815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409351+0000","last_change":"2024-01-13T17:58:37.409078+0000","last_active":"2024-01-13T17:58:37.409351+0000","last_peered":"2024-01-13T17:58:37.409351+0000","last_clean":"2024-01-13T17:58:37.409351+0000","last_became_active":"2024-01-13T17:58:37.408820+0000","last_became_peered":"2024-01-13T17:58:37.408820+0000","last_unstale":"2024-01-13T17:58:37.409351+0000","last_undegraded":"2024-01-13T17:58:37.409351+0000","last_fullsized":"2024-01-13T17:58:37.409351+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:30:37.097173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414485+0000","last_change":"2024-01-13T17:58:37.414485+0000","last_active":"2024-01-13T17:58:37.414485+0000","last_peered":"2024-01-13T17:58:37.414485+0000","last_clean":"2024-01-13T17:58:37.414485+0000","last_became_active":"2024-01-13T17:58:37.414182+0000","last_became_peered":"2024-01-13T17:58:37.414182+0000","last_unstale":"2024-01-13T17:58:37.414485+0000","last_undegraded":"2024-01-13T17:58:37.414485+0000","last_fullsized":"2024-01-13T17:58:37.414485+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:08:50.844685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.816836+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:13:23.632461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.817887+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:52:09.032473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828316+0000","last_change":"2024-01-13T17:58:36.845520+0000","last_active":"2024-01-13T17:58:37.828316+0000","last_peered":"2024-01-13T17:58:37.828316+0000","last_clean":"2024-01-13T17:58:37.828316+0000","last_became_active":"2024-01-13T17:58:36.845229+0000","last_became_peered":"2024-01-13T17:58:36.845229+0000","last_unstale":"2024-01-13T17:58:37.828316+0000","last_undegraded":"2024-01-13T17:58:37.828316+0000","last_fullsized":"2024-01-13T17:58:37.828316+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:08:01.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401963+0000","last_change":"2024-01-13T17:58:37.400143+0000","last_active":"2024-01-13T17:58:37.401963+0000","last_peered":"2024-01-13T17:58:37.401963+0000","last_clean":"2024-01-13T17:58:37.401963+0000","last_became_active":"2024-01-13T17:58:37.399689+0000","last_became_peered":"2024-01-13T17:58:37.399689+0000","last_unstale":"2024-01-13T17:58:37.401963+0000","last_undegraded":"2024-01-13T17:58:37.401963+0000","last_fullsized":"2024-01-13T17:58:37.401963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:32:04.518468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828159+0000","last_change":"2024-01-13T17:58:36.843954+0000","last_active":"2024-01-13T17:58:37.828159+0000","last_peered":"2024-01-13T17:58:37.828159+0000","last_clean":"2024-01-13T17:58:37.828159+0000","last_became_active":"2024-01-13T17:58:36.843616+0000","last_became_peered":"2024-01-13T17:58:36.843616+0000","last_unstale":"2024-01-13T17:58:37.828159+0000","last_undegraded":"2024-01-13T17:58:37.828159+0000","last_fullsized":"2024-01-13T17:58:37.828159+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:37:08.466053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401894+0000","last_change":"2024-01-13T17:58:37.399242+0000","last_active":"2024-01-13T17:58:37.401894+0000","last_peered":"2024-01-13T17:58:37.401894+0000","last_clean":"2024-01-13T17:58:37.401894+0000","last_became_active":"2024-01-13T17:58:37.398793+0000","last_became_peered":"2024-01-13T17:58:37.398793+0000","last_unstale":"2024-01-13T17:58:37.401894+0000","last_undegraded":"2024-01-13T17:58:37.401894+0000","last_fullsized":"2024-01-13T17:58:37.401894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:05:43.194645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.817520+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:39:02.091518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6,7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820542+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:02:12.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.834075+0000","last_change":"2024-01-13T17:58:36.832810+0000","last_active":"2024-01-13T17:58:36.834075+0000","last_peered":"2024-01-13T17:58:36.834075+0000","last_clean":"2024-01-13T17:58:36.834075+0000","last_became_active":"2024-01-13T17:58:36.831491+0000","last_became_peered":"2024-01-13T17:58:36.831491+0000","last_unstale":"2024-01-13T17:58:36.834075+0000","last_undegraded":"2024-01-13T17:58:36.834075+0000","last_fullsized":"2024-01-13T17:58:36.834075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:50:10.505869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.818287+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:53:33.628358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389767+0000","last_change":"2024-01-13T17:58:36.842527+0000","last_active":"2024-01-13T17:58:37.389767+0000","last_peered":"2024-01-13T17:58:37.389767+0000","last_clean":"2024-01-13T17:58:37.389767+0000","last_became_active":"2024-01-13T17:58:36.841820+0000","last_became_peered":"2024-01-13T17:58:36.841820+0000","last_unstale":"2024-01-13T17:58:37.389767+0000","last_undegraded":"2024-01-13T17:58:37.389767+0000","last_fullsized":"2024-01-13T17:58:37.389767+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:02.120533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.393987+0000","last_change":"2024-01-13T17:58:37.393987+0000","last_active":"2024-01-13T17:58:37.393987+0000","last_peered":"2024-01-13T17:58:37.393987+0000","last_clean":"2024-01-13T17:58:37.393987+0000","last_became_active":"2024-01-13T17:58:37.393657+0000","last_became_peered":"2024-01-13T17:58:37.393657+0000","last_unstale":"2024-01-13T17:58:37.393987+0000","last_undegraded":"2024-01-13T17:58:37.393987+0000","last_fullsized":"2024-01-13T17:58:37.393987+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:44.818236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843910+0000","last_change":"2024-01-13T17:58:36.843560+0000","last_active":"2024-01-13T17:58:36.843910+0000","last_peered":"2024-01-13T17:58:36.843910+0000","last_clean":"2024-01-13T17:58:36.843910+0000","last_became_active":"2024-01-13T17:58:36.843290+0000","last_became_peered":"2024-01-13T17:58:36.843290+0000","last_unstale":"2024-01-13T17:58:36.843910+0000","last_undegraded":"2024-01-13T17:58:36.843910+0000","last_fullsized":"2024-01-13T17:58:36.843910+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:12:58.012752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413415+0000","last_change":"2024-01-13T17:58:37.412880+0000","last_active":"2024-01-13T17:58:37.413415+0000","last_peered":"2024-01-13T17:58:37.413415+0000","last_clean":"2024-01-13T17:58:37.413415+0000","last_became_active":"2024-01-13T17:58:37.412519+0000","last_became_peered":"2024-01-13T17:58:37.412519+0000","last_unstale":"2024-01-13T17:58:37.413415+0000","last_undegraded":"2024-01-13T17:58:37.413415+0000","last_fullsized":"2024-01-13T17:58:37.413415+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:40:03.956715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389488+0000","last_change":"2024-01-13T17:58:36.841704+0000","last_active":"2024-01-13T17:58:37.389488+0000","last_peered":"2024-01-13T17:58:37.389488+0000","last_clean":"2024-01-13T17:58:37.389488+0000","last_became_active":"2024-01-13T17:58:36.841409+0000","last_became_peered":"2024-01-13T17:58:36.841409+0000","last_unstale":"2024-01-13T17:58:37.389488+0000","last_undegraded":"2024-01-13T17:58:37.389488+0000","last_fullsized":"2024-01-13T17:58:37.389488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:56:02.964249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.838673+0000","last_change":"2024-01-13T17:58:36.835474+0000","last_active":"2024-01-13T17:58:36.838673+0000","last_peered":"2024-01-13T17:58:36.838673+0000","last_clean":"2024-01-13T17:58:36.838673+0000","last_became_active":"2024-01-13T17:58:36.835169+0000","last_became_peered":"2024-01-13T17:58:36.835169+0000","last_unstale":"2024-01-13T17:58:36.838673+0000","last_undegraded":"2024-01-13T17:58:36.838673+0000","last_fullsized":"2024-01-13T17:58:36.838673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:02:02.178682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820340+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:04:00.115120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6,7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.837739+0000","last_change":"2024-01-13T17:58:36.836500+0000","last_active":"2024-01-13T17:58:36.837739+0000","last_peered":"2024-01-13T17:58:36.837739+0000","last_clean":"2024-01-13T17:58:36.837739+0000","last_became_active":"2024-01-13T17:58:36.836231+0000","last_became_peered":"2024-01-13T17:58:36.836231+0000","last_unstale":"2024-01-13T17:58:36.837739+0000","last_undegraded":"2024-01-13T17:58:36.837739+0000","last_fullsized":"2024-01-13T17:58:36.837739+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:40:58.818088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409657+0000","last_change":"2024-01-13T17:58:37.409657+0000","last_active":"2024-01-13T17:58:37.409657+0000","last_peered":"2024-01-13T17:58:37.409657+0000","last_clean":"2024-01-13T17:58:37.409657+0000","last_became_active":"2024-01-13T17:58:37.409373+0000","last_became_peered":"2024-01-13T17:58:37.409373+0000","last_unstale":"2024-01-13T17:58:37.409657+0000","last_undegraded":"2024-01-13T17:58:37.409657+0000","last_fullsized":"2024-01-13T17:58:37.409657+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:04.184668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.817379+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:57:36.055163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.391748+0000","last_change":"2024-01-13T17:58:36.841162+0000","last_active":"2024-01-13T17:58:37.391748+0000","last_peered":"2024-01-13T17:58:37.391748+0000","last_clean":"2024-01-13T17:58:37.391748+0000","last_became_active":"2024-01-13T17:58:36.840845+0000","last_became_peered":"2024-01-13T17:58:36.840845+0000","last_unstale":"2024-01-13T17:58:37.391748+0000","last_undegraded":"2024-01-13T17:58:37.391748+0000","last_fullsized":"2024-01-13T17:58:37.391748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:56:48.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414263+0000","last_change":"2024-01-13T17:58:37.414263+0000","last_active":"2024-01-13T17:58:37.414263+0000","last_peered":"2024-01-13T17:58:37.414263+0000","last_clean":"2024-01-13T17:58:37.414263+0000","last_became_active":"2024-01-13T17:58:37.410388+0000","last_became_peered":"2024-01-13T17:58:37.410388+0000","last_unstale":"2024-01-13T17:58:37.414263+0000","last_undegraded":"2024-01-13T17:58:37.414263+0000","last_fullsized":"2024-01-13T17:58:37.414263+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:55:00.346625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.836618+0000","last_change":"2024-01-13T17:58:36.834846+0000","last_active":"2024-01-13T17:58:36.836618+0000","last_peered":"2024-01-13T17:58:36.836618+0000","last_clean":"2024-01-13T17:58:36.836618+0000","last_became_active":"2024-01-13T17:58:36.834531+0000","last_became_peered":"2024-01-13T17:58:36.834531+0000","last_unstale":"2024-01-13T17:58:36.836618+0000","last_undegraded":"2024-01-13T17:58:36.836618+0000","last_fullsized":"2024-01-13T17:58:36.836618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:12:41.632590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.394865+0000","last_change":"2024-01-13T17:58:37.394865+0000","last_active":"2024-01-13T17:58:37.394865+0000","last_peered":"2024-01-13T17:58:37.394865+0000","last_clean":"2024-01-13T17:58:37.394865+0000","last_became_active":"2024-01-13T17:58:37.394490+0000","last_became_peered":"2024-01-13T17:58:37.394490+0000","last_unstale":"2024-01-13T17:58:37.394865+0000","last_undegraded":"2024-01-13T17:58:37.394865+0000","last_fullsized":"2024-01-13T17:58:37.394865+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:04:30.784006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"59'8","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.829812+0000","last_change":"2024-01-13T17:58:36.831518+0000","last_active":"2024-01-13T17:58:37.829812+0000","last_peered":"2024-01-13T17:58:37.829812+0000","last_clean":"2024-01-13T17:58:37.829812+0000","last_became_active":"2024-01-13T17:58:36.831252+0000","last_became_peered":"2024-01-13T17:58:36.831252+0000","last_unstale":"2024-01-13T17:58:37.829812+0000","last_undegraded":"2024-01-13T17:58:37.829812+0000","last_fullsized":"2024-01-13T17:58:37.829812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:42:53.797821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414840+0000","last_change":"2024-01-13T17:58:37.414840+0000","last_active":"2024-01-13T17:58:37.414840+0000","last_peered":"2024-01-13T17:58:37.414840+0000","last_clean":"2024-01-13T17:58:37.414840+0000","last_became_active":"2024-01-13T17:58:37.414540+0000","last_became_peered":"2024-01-13T17:58:37.414540+0000","last_unstale":"2024-01-13T17:58:37.414840+0000","last_undegraded":"2024-01-13T17:58:37.414840+0000","last_fullsized":"2024-01-13T17:58:37.414840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:57.534623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.831411+0000","last_change":"2024-01-13T17:58:36.831411+0000","last_active":"2024-01-13T17:58:36.831411+0000","last_peered":"2024-01-13T17:58:36.831411+0000","last_clean":"2024-01-13T17:58:36.831411+0000","last_became_active":"2024-01-13T17:58:36.831126+0000","last_became_peered":"2024-01-13T17:58:36.831126+0000","last_unstale":"2024-01-13T17:58:36.831411+0000","last_undegraded":"2024-01-13T17:58:36.831411+0000","last_fullsized":"2024-01-13T17:58:36.831411+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:12:48.869393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.408885+0000","last_change":"2024-01-13T17:58:37.408885+0000","last_active":"2024-01-13T17:58:37.408885+0000","last_peered":"2024-01-13T17:58:37.408885+0000","last_clean":"2024-01-13T17:58:37.408885+0000","last_became_active":"2024-01-13T17:58:37.408618+0000","last_became_peered":"2024-01-13T17:58:37.408618+0000","last_unstale":"2024-01-13T17:58:37.408885+0000","last_undegraded":"2024-01-13T17:58:37.408885+0000","last_fullsized":"2024-01-13T17:58:37.408885+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:18:38.241218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.833047+0000","last_change":"2024-01-13T17:58:36.832399+0000","last_active":"2024-01-13T17:58:36.833047+0000","last_peered":"2024-01-13T17:58:36.833047+0000","last_clean":"2024-01-13T17:58:36.833047+0000","last_became_active":"2024-01-13T17:58:36.832100+0000","last_became_peered":"2024-01-13T17:58:36.832100+0000","last_unstale":"2024-01-13T17:58:36.833047+0000","last_undegraded":"2024-01-13T17:58:36.833047+0000","last_fullsized":"2024-01-13T17:58:36.833047+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:01:50.555635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403256+0000","last_change":"2024-01-13T17:58:37.402741+0000","last_active":"2024-01-13T17:58:37.403256+0000","last_peered":"2024-01-13T17:58:37.403256+0000","last_clean":"2024-01-13T17:58:37.403256+0000","last_became_active":"2024-01-13T17:58:37.402379+0000","last_became_peered":"2024-01-13T17:58:37.402379+0000","last_unstale":"2024-01-13T17:58:37.403256+0000","last_undegraded":"2024-01-13T17:58:37.403256+0000","last_fullsized":"2024-01-13T17:58:37.403256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:30:51.621102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.391644+0000","last_change":"2024-01-13T17:58:36.836469+0000","last_active":"2024-01-13T17:58:37.391644+0000","last_peered":"2024-01-13T17:58:37.391644+0000","last_clean":"2024-01-13T17:58:37.391644+0000","last_became_active":"2024-01-13T17:58:36.836161+0000","last_became_peered":"2024-01-13T17:58:36.836161+0000","last_unstale":"2024-01-13T17:58:37.391644+0000","last_undegraded":"2024-01-13T17:58:37.391644+0000","last_fullsized":"2024-01-13T17:58:37.391644+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:00:00.583677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820416+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:51:28.421503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395912+0000","last_change":"2024-01-13T17:58:37.395912+0000","last_active":"2024-01-13T17:58:37.395912+0000","last_peered":"2024-01-13T17:58:37.395912+0000","last_clean":"2024-01-13T17:58:37.395912+0000","last_became_active":"2024-01-13T17:58:37.395625+0000","last_became_peered":"2024-01-13T17:58:37.395625+0000","last_unstale":"2024-01-13T17:58:37.395912+0000","last_undegraded":"2024-01-13T17:58:37.395912+0000","last_fullsized":"2024-01-13T17:58:37.395912+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:28.565536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.390273+0000","last_change":"2024-01-13T17:58:36.839719+0000","last_active":"2024-01-13T17:58:37.390273+0000","last_peered":"2024-01-13T17:58:37.390273+0000","last_clean":"2024-01-13T17:58:37.390273+0000","last_became_active":"2024-01-13T17:58:36.839440+0000","last_became_peered":"2024-01-13T17:58:36.839440+0000","last_unstale":"2024-01-13T17:58:37.390273+0000","last_undegraded":"2024-01-13T17:58:37.390273+0000","last_fullsized":"2024-01-13T17:58:37.390273+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:17:50.836804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389088+0000","last_change":"2024-01-13T17:58:36.842492+0000","last_active":"2024-01-13T17:58:37.389088+0000","last_peered":"2024-01-13T17:58:37.389088+0000","last_clean":"2024-01-13T17:58:37.389088+0000","last_became_active":"2024-01-13T17:58:36.842172+0000","last_became_peered":"2024-01-13T17:58:36.842172+0000","last_unstale":"2024-01-13T17:58:37.389088+0000","last_undegraded":"2024-01-13T17:58:37.389088+0000","last_fullsized":"2024-01-13T17:58:37.389088+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:58:24.249555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":231,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.831586+0000","last_change":"2024-01-13T17:58:27.209773+0000","last_active":"2024-01-13T17:58:36.831586+0000","last_peered":"2024-01-13T17:58:36.831586+0000","last_clean":"2024-01-13T17:58:36.831586+0000","last_became_active":"2024-01-13T17:58:27.209293+0000","last_became_peered":"2024-01-13T17:58:27.209293+0000","last_unstale":"2024-01-13T17:58:36.831586+0000","last_undegraded":"2024-01-13T17:58:36.831586+0000","last_fullsized":"2024-01-13T17:58:36.831586+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_clean_scrub_stamp":"2024-01-13T17:56:59.530229+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:45:29.626217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845898+0000","last_change":"2024-01-13T17:58:36.844962+0000","last_active":"2024-01-13T17:58:36.845898+0000","last_peered":"2024-01-13T17:58:36.845898+0000","last_clean":"2024-01-13T17:58:36.845898+0000","last_became_active":"2024-01-13T17:58:36.844443+0000","last_became_peered":"2024-01-13T17:58:36.844443+0000","last_unstale":"2024-01-13T17:58:36.845898+0000","last_undegraded":"2024-01-13T17:58:36.845898+0000","last_fullsized":"2024-01-13T17:58:36.845898+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:13:21.802704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845882+0000","last_change":"2024-01-13T17:58:36.845469+0000","last_active":"2024-01-13T17:58:36.845882+0000","last_peered":"2024-01-13T17:58:36.845882+0000","last_clean":"2024-01-13T17:58:36.845882+0000","last_became_active":"2024-01-13T17:58:36.845158+0000","last_became_peered":"2024-01-13T17:58:36.845158+0000","last_unstale":"2024-01-13T17:58:36.845882+0000","last_undegraded":"2024-01-13T17:58:36.845882+0000","last_fullsized":"2024-01-13T17:58:36.845882+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:46.603258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395393+0000","last_change":"2024-01-13T17:58:37.395393+0000","last_active":"2024-01-13T17:58:37.395393+0000","last_peered":"2024-01-13T17:58:37.395393+0000","last_clean":"2024-01-13T17:58:37.395393+0000","last_became_active":"2024-01-13T17:58:37.395105+0000","last_became_peered":"2024-01-13T17:58:37.395105+0000","last_unstale":"2024-01-13T17:58:37.395393+0000","last_undegraded":"2024-01-13T17:58:37.395393+0000","last_fullsized":"2024-01-13T17:58:37.395393+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:12.100528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843391+0000","last_change":"2024-01-13T17:58:36.841642+0000","last_active":"2024-01-13T17:58:36.843391+0000","last_peered":"2024-01-13T17:58:36.843391+0000","last_clean":"2024-01-13T17:58:36.843391+0000","last_became_active":"2024-01-13T17:58:36.840768+0000","last_became_peered":"2024-01-13T17:58:36.840768+0000","last_unstale":"2024-01-13T17:58:36.843391+0000","last_undegraded":"2024-01-13T17:58:36.843391+0000","last_fullsized":"2024-01-13T17:58:36.843391+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:03:26.813924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.840582+0000","last_change":"2024-01-13T17:58:36.839829+0000","last_active":"2024-01-13T17:58:36.840582+0000","last_peered":"2024-01-13T17:58:36.840582+0000","last_clean":"2024-01-13T17:58:36.840582+0000","last_became_active":"2024-01-13T17:58:36.839541+0000","last_became_peered":"2024-01-13T17:58:36.839541+0000","last_unstale":"2024-01-13T17:58:36.840582+0000","last_undegraded":"2024-01-13T17:58:36.840582+0000","last_fullsized":"2024-01-13T17:58:36.840582+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:52:18.758870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845880+0000","last_change":"2024-01-13T17:58:36.844748+0000","last_active":"2024-01-13T17:58:36.845880+0000","last_peered":"2024-01-13T17:58:36.845880+0000","last_clean":"2024-01-13T17:58:36.845880+0000","last_became_active":"2024-01-13T17:58:36.844002+0000","last_became_peered":"2024-01-13T17:58:36.844002+0000","last_unstale":"2024-01-13T17:58:36.845880+0000","last_undegraded":"2024-01-13T17:58:36.845880+0000","last_fullsized":"2024-01-13T17:58:36.845880+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:14:57.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820923+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:25.082021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843428+0000","last_change":"2024-01-13T17:58:36.841464+0000","last_active":"2024-01-13T17:58:36.843428+0000","last_peered":"2024-01-13T17:58:36.843428+0000","last_clean":"2024-01-13T17:58:36.843428+0000","last_became_active":"2024-01-13T17:58:36.840078+0000","last_became_peered":"2024-01-13T17:58:36.840078+0000","last_unstale":"2024-01-13T17:58:36.843428+0000","last_undegraded":"2024-01-13T17:58:36.843428+0000","last_fullsized":"2024-01-13T17:58:36.843428+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:39:59.597495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843449+0000","last_change":"2024-01-13T17:58:36.841581+0000","last_active":"2024-01-13T17:58:36.843449+0000","last_peered":"2024-01-13T17:58:36.843449+0000","last_clean":"2024-01-13T17:58:36.843449+0000","last_became_active":"2024-01-13T17:58:36.841192+0000","last_became_peered":"2024-01-13T17:58:36.841192+0000","last_unstale":"2024-01-13T17:58:36.843449+0000","last_undegraded":"2024-01-13T17:58:36.843449+0000","last_fullsized":"2024-01-13T17:58:36.843449+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:39:05.602781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.827128+0000","last_change":"2024-01-13T17:58:36.844613+0000","last_active":"2024-01-13T17:58:37.827128+0000","last_peered":"2024-01-13T17:58:37.827128+0000","last_clean":"2024-01-13T17:58:37.827128+0000","last_became_active":"2024-01-13T17:58:36.844286+0000","last_became_peered":"2024-01-13T17:58:36.844286+0000","last_unstale":"2024-01-13T17:58:37.827128+0000","last_undegraded":"2024-01-13T17:58:37.827128+0000","last_fullsized":"2024-01-13T17:58:37.827128+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:27:48.244809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.399084+0000","last_change":"2024-01-13T17:58:37.399084+0000","last_active":"2024-01-13T17:58:37.399084+0000","last_peered":"2024-01-13T17:58:37.399084+0000","last_clean":"2024-01-13T17:58:37.399084+0000","last_became_active":"2024-01-13T17:58:37.398572+0000","last_became_peered":"2024-01-13T17:58:37.398572+0000","last_unstale":"2024-01-13T17:58:37.399084+0000","last_undegraded":"2024-01-13T17:58:37.399084+0000","last_fullsized":"2024-01-13T17:58:37.399084+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:18:41.057728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.390142+0000","last_change":"2024-01-13T17:58:36.837432+0000","last_active":"2024-01-13T17:58:37.390142+0000","last_peered":"2024-01-13T17:58:37.390142+0000","last_clean":"2024-01-13T17:58:37.390142+0000","last_became_active":"2024-01-13T17:58:36.837168+0000","last_became_peered":"2024-01-13T17:58:36.837168+0000","last_unstale":"2024-01-13T17:58:37.390142+0000","last_undegraded":"2024-01-13T17:58:37.390142+0000","last_fullsized":"2024-01-13T17:58:37.390142+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:30.125718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416032+0000","last_change":"2024-01-13T17:58:37.416032+0000","last_active":"2024-01-13T17:58:37.416032+0000","last_peered":"2024-01-13T17:58:37.416032+0000","last_clean":"2024-01-13T17:58:37.416032+0000","last_became_active":"2024-01-13T17:58:37.415759+0000","last_became_peered":"2024-01-13T17:58:37.415759+0000","last_unstale":"2024-01-13T17:58:37.416032+0000","last_undegraded":"2024-01-13T17:58:37.416032+0000","last_fullsized":"2024-01-13T17:58:37.416032+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:24.483081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.838653+0000","last_change":"2024-01-13T17:58:36.834302+0000","last_active":"2024-01-13T17:58:36.838653+0000","last_peered":"2024-01-13T17:58:36.838653+0000","last_clean":"2024-01-13T17:58:36.838653+0000","last_became_active":"2024-01-13T17:58:36.833658+0000","last_became_peered":"2024-01-13T17:58:36.833658+0000","last_unstale":"2024-01-13T17:58:36.838653+0000","last_undegraded":"2024-01-13T17:58:36.838653+0000","last_fullsized":"2024-01-13T17:58:36.838653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:13:18.505657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403231+0000","last_change":"2024-01-13T17:58:37.402650+0000","last_active":"2024-01-13T17:58:37.403231+0000","last_peered":"2024-01-13T17:58:37.403231+0000","last_clean":"2024-01-13T17:58:37.403231+0000","last_became_active":"2024-01-13T17:58:37.402128+0000","last_became_peered":"2024-01-13T17:58:37.402128+0000","last_unstale":"2024-01-13T17:58:37.403231+0000","last_undegraded":"2024-01-13T17:58:37.403231+0000","last_fullsized":"2024-01-13T17:58:37.403231+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:02:28.745789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.829297+0000","last_change":"2024-01-13T17:58:36.836861+0000","last_active":"2024-01-13T17:58:37.829297+0000","last_peered":"2024-01-13T17:58:37.829297+0000","last_clean":"2024-01-13T17:58:37.829297+0000","last_became_active":"2024-01-13T17:58:36.836593+0000","last_became_peered":"2024-01-13T17:58:36.836593+0000","last_unstale":"2024-01-13T17:58:37.829297+0000","last_undegraded":"2024-01-13T17:58:37.829297+0000","last_fullsized":"2024-01-13T17:58:37.829297+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:34:37.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414378+0000","last_change":"2024-01-13T17:58:37.414378+0000","last_active":"2024-01-13T17:58:37.414378+0000","last_peered":"2024-01-13T17:58:37.414378+0000","last_clean":"2024-01-13T17:58:37.414378+0000","last_became_active":"2024-01-13T17:58:37.414097+0000","last_became_peered":"2024-01-13T17:58:37.414097+0000","last_unstale":"2024-01-13T17:58:37.414378+0000","last_undegraded":"2024-01-13T17:58:37.414378+0000","last_fullsized":"2024-01-13T17:58:37.414378+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:45:12.430007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397227+0000","last_change":"2024-01-13T17:58:37.397227+0000","last_active":"2024-01-13T17:58:37.397227+0000","last_peered":"2024-01-13T17:58:37.397227+0000","last_clean":"2024-01-13T17:58:37.397227+0000","last_became_active":"2024-01-13T17:58:37.396928+0000","last_became_peered":"2024-01-13T17:58:37.396928+0000","last_unstale":"2024-01-13T17:58:37.397227+0000","last_undegraded":"2024-01-13T17:58:37.397227+0000","last_fullsized":"2024-01-13T17:58:37.397227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:59:55.499543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397903+0000","last_change":"2024-01-13T17:58:37.396849+0000","last_active":"2024-01-13T17:58:37.397903+0000","last_peered":"2024-01-13T17:58:37.397903+0000","last_clean":"2024-01-13T17:58:37.397903+0000","last_became_active":"2024-01-13T17:58:37.396585+0000","last_became_peered":"2024-01-13T17:58:37.396585+0000","last_unstale":"2024-01-13T17:58:37.397903+0000","last_undegraded":"2024-01-13T17:58:37.397903+0000","last_fullsized":"2024-01-13T17:58:37.397903+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:32.529315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.404802+0000","last_change":"2024-01-13T17:58:37.403640+0000","last_active":"2024-01-13T17:58:37.404802+0000","last_peered":"2024-01-13T17:58:37.404802+0000","last_clean":"2024-01-13T17:58:37.404802+0000","last_became_active":"2024-01-13T17:58:37.403041+0000","last_became_peered":"2024-01-13T17:58:37.403041+0000","last_unstale":"2024-01-13T17:58:37.404802+0000","last_undegraded":"2024-01-13T17:58:37.404802+0000","last_fullsized":"2024-01-13T17:58:37.404802+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:37.683734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395592+0000","last_change":"2024-01-13T17:58:37.395592+0000","last_active":"2024-01-13T17:58:37.395592+0000","last_peered":"2024-01-13T17:58:37.395592+0000","last_clean":"2024-01-13T17:58:37.395592+0000","last_became_active":"2024-01-13T17:58:37.395306+0000","last_became_peered":"2024-01-13T17:58:37.395306+0000","last_unstale":"2024-01-13T17:58:37.395592+0000","last_undegraded":"2024-01-13T17:58:37.395592+0000","last_fullsized":"2024-01-13T17:58:37.395592+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:06:42.102077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409861+0000","last_change":"2024-01-13T17:58:37.409861+0000","last_active":"2024-01-13T17:58:37.409861+0000","last_peered":"2024-01-13T17:58:37.409861+0000","last_clean":"2024-01-13T17:58:37.409861+0000","last_became_active":"2024-01-13T17:58:37.409345+0000","last_became_peered":"2024-01-13T17:58:37.409345+0000","last_unstale":"2024-01-13T17:58:37.409861+0000","last_undegraded":"2024-01-13T17:58:37.409861+0000","last_fullsized":"2024-01-13T17:58:37.409861+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:00:44.773057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403255+0000","last_change":"2024-01-13T17:58:37.402590+0000","last_active":"2024-01-13T17:58:37.403255+0000","last_peered":"2024-01-13T17:58:37.403255+0000","last_clean":"2024-01-13T17:58:37.403255+0000","last_became_active":"2024-01-13T17:58:37.402233+0000","last_became_peered":"2024-01-13T17:58:37.402233+0000","last_unstale":"2024-01-13T17:58:37.403255+0000","last_undegraded":"2024-01-13T17:58:37.403255+0000","last_fullsized":"2024-01-13T17:58:37.403255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:48:51.046376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413388+0000","last_change":"2024-01-13T17:58:37.411533+0000","last_active":"2024-01-13T17:58:37.413388+0000","last_peered":"2024-01-13T17:58:37.413388+0000","last_clean":"2024-01-13T17:58:37.413388+0000","last_became_active":"2024-01-13T17:58:37.411192+0000","last_became_peered":"2024-01-13T17:58:37.411192+0000","last_unstale":"2024-01-13T17:58:37.413388+0000","last_undegraded":"2024-01-13T17:58:37.413388+0000","last_fullsized":"2024-01-13T17:58:37.413388+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:31:15.289987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.400265+0000","last_change":"2024-01-13T17:58:37.400265+0000","last_active":"2024-01-13T17:58:37.400265+0000","last_peered":"2024-01-13T17:58:37.400265+0000","last_clean":"2024-01-13T17:58:37.400265+0000","last_became_active":"2024-01-13T17:58:37.399952+0000","last_became_peered":"2024-01-13T17:58:37.399952+0000","last_unstale":"2024-01-13T17:58:37.400265+0000","last_undegraded":"2024-01-13T17:58:37.400265+0000","last_fullsized":"2024-01-13T17:58:37.400265+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:04.725745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":129,"acting":129,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":52,"seq":223338299398,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298444,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446708,"statfs":{"total":95995035648,"available":95689428992,"internally_reserved":0,"allocated":1183744,"data_stored":834295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":6,"up_from":44,"seq":188978561031,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298412,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446740,"statfs":{"total":95995035648,"available":95689461760,"internally_reserved":0,"allocated":1150976,"data_stored":819891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297856,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447296,"statfs":{"total":95995035648,"available":95690031104,"internally_reserved":0,"allocated":581632,"data_stored":243409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.215},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.26600000000000001}]},{"osd":2,"last update":"Sat Jan 13 17:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.28100000000000003}]},{"osd":3,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.248},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446736,"statfs":{"total":95995035648,"available":95689457664,"internally_reserved":0,"allocated":1155072,"data_stored":820156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 13 17:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Jan 13 17:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Jan 13 17:58:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.46200000000000002}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411351,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447280,"statfs":{"total":95995035648,"available":95690014720,"internally_reserved":0,"allocated":598016,"data_stored":250392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.437},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.316}]},{"osd":1,"last update":"Sat Jan 13 17:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.38}]},{"osd":3,"last update":"Sat Jan 13 17:58:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.621},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182419,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297824,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447328,"statfs":{"total":95995035648,"available":95690063872,"internally_reserved":0,"allocated":548864,"data_stored":223553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297836,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447316,"statfs":{"total":95995035648,"available":95690051584,"internally_reserved":0,"allocated":561152,"data_stored":229788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46400000000000002}]},{"osd":2,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.47399999999999998}]},{"osd":3,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":5,"up_from":37,"seq":158913789964,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297876,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447276,"statfs":{"total":95995035648,"available":95690010624,"internally_reserved":0,"allocated":602112,"data_stored":245300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-13T17:58:41.874 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-13T17:58:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:41 smithi099 ceph-mon[71325]: pgmap v148: 97 pgs: 10 creating+peering, 66 active+clean, 21 unknown; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 4 op/s 2024-01-13T17:58:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:41 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3216205548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-01-13T17:58:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:41 smithi099 ceph-mon[71325]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:41 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/4078058399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:58:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:41 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3565765549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:42.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:41 smithi084 ceph-mon[37908]: pgmap v148: 97 pgs: 10 creating+peering, 66 active+clean, 21 unknown; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 4 op/s 2024-01-13T17:58:42.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:41 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3216205548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-01-13T17:58:42.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:41 smithi084 ceph-mon[37908]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:42.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:41 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/4078058399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:58:42.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:41 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3565765549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:42.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:41 smithi084 ceph-mon[52328]: pgmap v148: 97 pgs: 10 creating+peering, 66 active+clean, 21 unknown; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 4 op/s 2024-01-13T17:58:42.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:41 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3216205548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-01-13T17:58:42.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:41 smithi084 ceph-mon[52328]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T17:58:42.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:41 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/4078058399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:58:42.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:41 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3565765549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:58:42.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:42.221 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-01-13T17:58:42.231 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-01-13T17:58:40.781114+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":228,"acting":228,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2384536,"kb_used_data":6232,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":747576680,"statfs":{"total":767960285184,"available":765518520320,"internally_reserved":0,"allocated":6381568,"data_stored":3666784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.967295"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416080+0000","last_change":"2024-01-13T17:58:37.416080+0000","last_active":"2024-01-13T17:58:37.416080+0000","last_peered":"2024-01-13T17:58:37.416080+0000","last_clean":"2024-01-13T17:58:37.416080+0000","last_became_active":"2024-01-13T17:58:37.415621+0000","last_became_peered":"2024-01-13T17:58:37.415621+0000","last_unstale":"2024-01-13T17:58:37.416080+0000","last_undegraded":"2024-01-13T17:58:37.416080+0000","last_fullsized":"2024-01-13T17:58:37.416080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:40.991399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.398891+0000","last_change":"2024-01-13T17:58:37.398891+0000","last_active":"2024-01-13T17:58:37.398891+0000","last_peered":"2024-01-13T17:58:37.398891+0000","last_clean":"2024-01-13T17:58:37.398891+0000","last_became_active":"2024-01-13T17:58:37.398476+0000","last_became_peered":"2024-01-13T17:58:37.398476+0000","last_unstale":"2024-01-13T17:58:37.398891+0000","last_undegraded":"2024-01-13T17:58:37.398891+0000","last_fullsized":"2024-01-13T17:58:37.398891+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:05:39.892184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413370+0000","last_change":"2024-01-13T17:58:37.411528+0000","last_active":"2024-01-13T17:58:37.413370+0000","last_peered":"2024-01-13T17:58:37.413370+0000","last_clean":"2024-01-13T17:58:37.413370+0000","last_became_active":"2024-01-13T17:58:37.411056+0000","last_became_peered":"2024-01-13T17:58:37.411056+0000","last_unstale":"2024-01-13T17:58:37.413370+0000","last_undegraded":"2024-01-13T17:58:37.413370+0000","last_fullsized":"2024-01-13T17:58:37.413370+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:13:24.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.415953+0000","last_change":"2024-01-13T17:58:37.415953+0000","last_active":"2024-01-13T17:58:37.415953+0000","last_peered":"2024-01-13T17:58:37.415953+0000","last_clean":"2024-01-13T17:58:37.415953+0000","last_became_active":"2024-01-13T17:58:37.413825+0000","last_became_peered":"2024-01-13T17:58:37.413825+0000","last_unstale":"2024-01-13T17:58:37.415953+0000","last_undegraded":"2024-01-13T17:58:37.415953+0000","last_fullsized":"2024-01-13T17:58:37.415953+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:04:08.326020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402618+0000","last_change":"2024-01-13T17:58:37.399699+0000","last_active":"2024-01-13T17:58:37.402618+0000","last_peered":"2024-01-13T17:58:37.402618+0000","last_clean":"2024-01-13T17:58:37.402618+0000","last_became_active":"2024-01-13T17:58:37.399358+0000","last_became_peered":"2024-01-13T17:58:37.399358+0000","last_unstale":"2024-01-13T17:58:37.402618+0000","last_undegraded":"2024-01-13T17:58:37.402618+0000","last_fullsized":"2024-01-13T17:58:37.402618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:18.403109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413121+0000","last_change":"2024-01-13T17:58:37.413121+0000","last_active":"2024-01-13T17:58:37.413121+0000","last_peered":"2024-01-13T17:58:37.413121+0000","last_clean":"2024-01-13T17:58:37.413121+0000","last_became_active":"2024-01-13T17:58:37.412816+0000","last_became_peered":"2024-01-13T17:58:37.412816+0000","last_unstale":"2024-01-13T17:58:37.413121+0000","last_undegraded":"2024-01-13T17:58:37.413121+0000","last_fullsized":"2024-01-13T17:58:37.413121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:05.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416421+0000","last_change":"2024-01-13T17:58:37.416421+0000","last_active":"2024-01-13T17:58:37.416421+0000","last_peered":"2024-01-13T17:58:37.416421+0000","last_clean":"2024-01-13T17:58:37.416421+0000","last_became_active":"2024-01-13T17:58:37.416138+0000","last_became_peered":"2024-01-13T17:58:37.416138+0000","last_unstale":"2024-01-13T17:58:37.416421+0000","last_undegraded":"2024-01-13T17:58:37.416421+0000","last_fullsized":"2024-01-13T17:58:37.416421+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:10:51.751719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397837+0000","last_change":"2024-01-13T17:58:37.397837+0000","last_active":"2024-01-13T17:58:37.397837+0000","last_peered":"2024-01-13T17:58:37.397837+0000","last_clean":"2024-01-13T17:58:37.397837+0000","last_became_active":"2024-01-13T17:58:37.397557+0000","last_became_peered":"2024-01-13T17:58:37.397557+0000","last_unstale":"2024-01-13T17:58:37.397837+0000","last_undegraded":"2024-01-13T17:58:37.397837+0000","last_fullsized":"2024-01-13T17:58:37.397837+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:38:02.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397136+0000","last_change":"2024-01-13T17:58:37.397136+0000","last_active":"2024-01-13T17:58:37.397136+0000","last_peered":"2024-01-13T17:58:37.397136+0000","last_clean":"2024-01-13T17:58:37.397136+0000","last_became_active":"2024-01-13T17:58:37.396796+0000","last_became_peered":"2024-01-13T17:58:37.396796+0000","last_unstale":"2024-01-13T17:58:37.397136+0000","last_undegraded":"2024-01-13T17:58:37.397136+0000","last_fullsized":"2024-01-13T17:58:37.397136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:09:37.651466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.821008+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:14:27.077823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.394829+0000","last_change":"2024-01-13T17:58:37.394829+0000","last_active":"2024-01-13T17:58:37.394829+0000","last_peered":"2024-01-13T17:58:37.394829+0000","last_clean":"2024-01-13T17:58:37.394829+0000","last_became_active":"2024-01-13T17:58:37.394582+0000","last_became_peered":"2024-01-13T17:58:37.394582+0000","last_unstale":"2024-01-13T17:58:37.394829+0000","last_undegraded":"2024-01-13T17:58:37.394829+0000","last_fullsized":"2024-01-13T17:58:37.394829+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:52:38.944942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413457+0000","last_change":"2024-01-13T17:58:37.412247+0000","last_active":"2024-01-13T17:58:37.413457+0000","last_peered":"2024-01-13T17:58:37.413457+0000","last_clean":"2024-01-13T17:58:37.413457+0000","last_became_active":"2024-01-13T17:58:37.411947+0000","last_became_peered":"2024-01-13T17:58:37.411947+0000","last_unstale":"2024-01-13T17:58:37.413457+0000","last_undegraded":"2024-01-13T17:58:37.413457+0000","last_fullsized":"2024-01-13T17:58:37.413457+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:05:19.184972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413437+0000","last_change":"2024-01-13T17:58:37.411858+0000","last_active":"2024-01-13T17:58:37.413437+0000","last_peered":"2024-01-13T17:58:37.413437+0000","last_clean":"2024-01-13T17:58:37.413437+0000","last_became_active":"2024-01-13T17:58:37.411559+0000","last_became_peered":"2024-01-13T17:58:37.411559+0000","last_unstale":"2024-01-13T17:58:37.413437+0000","last_undegraded":"2024-01-13T17:58:37.413437+0000","last_fullsized":"2024-01-13T17:58:37.413437+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:00:40.870815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409351+0000","last_change":"2024-01-13T17:58:37.409078+0000","last_active":"2024-01-13T17:58:37.409351+0000","last_peered":"2024-01-13T17:58:37.409351+0000","last_clean":"2024-01-13T17:58:37.409351+0000","last_became_active":"2024-01-13T17:58:37.408820+0000","last_became_peered":"2024-01-13T17:58:37.408820+0000","last_unstale":"2024-01-13T17:58:37.409351+0000","last_undegraded":"2024-01-13T17:58:37.409351+0000","last_fullsized":"2024-01-13T17:58:37.409351+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:30:37.097173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414485+0000","last_change":"2024-01-13T17:58:37.414485+0000","last_active":"2024-01-13T17:58:37.414485+0000","last_peered":"2024-01-13T17:58:37.414485+0000","last_clean":"2024-01-13T17:58:37.414485+0000","last_became_active":"2024-01-13T17:58:37.414182+0000","last_became_peered":"2024-01-13T17:58:37.414182+0000","last_unstale":"2024-01-13T17:58:37.414485+0000","last_undegraded":"2024-01-13T17:58:37.414485+0000","last_fullsized":"2024-01-13T17:58:37.414485+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:08:50.844685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.816836+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:13:23.632461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.817887+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:52:09.032473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828316+0000","last_change":"2024-01-13T17:58:36.845520+0000","last_active":"2024-01-13T17:58:37.828316+0000","last_peered":"2024-01-13T17:58:37.828316+0000","last_clean":"2024-01-13T17:58:37.828316+0000","last_became_active":"2024-01-13T17:58:36.845229+0000","last_became_peered":"2024-01-13T17:58:36.845229+0000","last_unstale":"2024-01-13T17:58:37.828316+0000","last_undegraded":"2024-01-13T17:58:37.828316+0000","last_fullsized":"2024-01-13T17:58:37.828316+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:08:01.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401963+0000","last_change":"2024-01-13T17:58:37.400143+0000","last_active":"2024-01-13T17:58:37.401963+0000","last_peered":"2024-01-13T17:58:37.401963+0000","last_clean":"2024-01-13T17:58:37.401963+0000","last_became_active":"2024-01-13T17:58:37.399689+0000","last_became_peered":"2024-01-13T17:58:37.399689+0000","last_unstale":"2024-01-13T17:58:37.401963+0000","last_undegraded":"2024-01-13T17:58:37.401963+0000","last_fullsized":"2024-01-13T17:58:37.401963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:32:04.518468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828159+0000","last_change":"2024-01-13T17:58:36.843954+0000","last_active":"2024-01-13T17:58:37.828159+0000","last_peered":"2024-01-13T17:58:37.828159+0000","last_clean":"2024-01-13T17:58:37.828159+0000","last_became_active":"2024-01-13T17:58:36.843616+0000","last_became_peered":"2024-01-13T17:58:36.843616+0000","last_unstale":"2024-01-13T17:58:37.828159+0000","last_undegraded":"2024-01-13T17:58:37.828159+0000","last_fullsized":"2024-01-13T17:58:37.828159+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:37:08.466053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401894+0000","last_change":"2024-01-13T17:58:37.399242+0000","last_active":"2024-01-13T17:58:37.401894+0000","last_peered":"2024-01-13T17:58:37.401894+0000","last_clean":"2024-01-13T17:58:37.401894+0000","last_became_active":"2024-01-13T17:58:37.398793+0000","last_became_peered":"2024-01-13T17:58:37.398793+0000","last_unstale":"2024-01-13T17:58:37.401894+0000","last_undegraded":"2024-01-13T17:58:37.401894+0000","last_fullsized":"2024-01-13T17:58:37.401894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:05:43.194645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.817520+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:39:02.091518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6,7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820542+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:02:12.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.834075+0000","last_change":"2024-01-13T17:58:36.832810+0000","last_active":"2024-01-13T17:58:36.834075+0000","last_peered":"2024-01-13T17:58:36.834075+0000","last_clean":"2024-01-13T17:58:36.834075+0000","last_became_active":"2024-01-13T17:58:36.831491+0000","last_became_peered":"2024-01-13T17:58:36.831491+0000","last_unstale":"2024-01-13T17:58:36.834075+0000","last_undegraded":"2024-01-13T17:58:36.834075+0000","last_fullsized":"2024-01-13T17:58:36.834075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:50:10.505869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.818287+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:53:33.628358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389767+0000","last_change":"2024-01-13T17:58:36.842527+0000","last_active":"2024-01-13T17:58:37.389767+0000","last_peered":"2024-01-13T17:58:37.389767+0000","last_clean":"2024-01-13T17:58:37.389767+0000","last_became_active":"2024-01-13T17:58:36.841820+0000","last_became_peered":"2024-01-13T17:58:36.841820+0000","last_unstale":"2024-01-13T17:58:37.389767+0000","last_undegraded":"2024-01-13T17:58:37.389767+0000","last_fullsized":"2024-01-13T17:58:37.389767+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:02.120533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.393987+0000","last_change":"2024-01-13T17:58:37.393987+0000","last_active":"2024-01-13T17:58:37.393987+0000","last_peered":"2024-01-13T17:58:37.393987+0000","last_clean":"2024-01-13T17:58:37.393987+0000","last_became_active":"2024-01-13T17:58:37.393657+0000","last_became_peered":"2024-01-13T17:58:37.393657+0000","last_unstale":"2024-01-13T17:58:37.393987+0000","last_undegraded":"2024-01-13T17:58:37.393987+0000","last_fullsized":"2024-01-13T17:58:37.393987+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:44.818236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843910+0000","last_change":"2024-01-13T17:58:36.843560+0000","last_active":"2024-01-13T17:58:36.843910+0000","last_peered":"2024-01-13T17:58:36.843910+0000","last_clean":"2024-01-13T17:58:36.843910+0000","last_became_active":"2024-01-13T17:58:36.843290+0000","last_became_peered":"2024-01-13T17:58:36.843290+0000","last_unstale":"2024-01-13T17:58:36.843910+0000","last_undegraded":"2024-01-13T17:58:36.843910+0000","last_fullsized":"2024-01-13T17:58:36.843910+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:12:58.012752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413415+0000","last_change":"2024-01-13T17:58:37.412880+0000","last_active":"2024-01-13T17:58:37.413415+0000","last_peered":"2024-01-13T17:58:37.413415+0000","last_clean":"2024-01-13T17:58:37.413415+0000","last_became_active":"2024-01-13T17:58:37.412519+0000","last_became_peered":"2024-01-13T17:58:37.412519+0000","last_unstale":"2024-01-13T17:58:37.413415+0000","last_undegraded":"2024-01-13T17:58:37.413415+0000","last_fullsized":"2024-01-13T17:58:37.413415+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:40:03.956715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389488+0000","last_change":"2024-01-13T17:58:36.841704+0000","last_active":"2024-01-13T17:58:37.389488+0000","last_peered":"2024-01-13T17:58:37.389488+0000","last_clean":"2024-01-13T17:58:37.389488+0000","last_became_active":"2024-01-13T17:58:36.841409+0000","last_became_peered":"2024-01-13T17:58:36.841409+0000","last_unstale":"2024-01-13T17:58:37.389488+0000","last_undegraded":"2024-01-13T17:58:37.389488+0000","last_fullsized":"2024-01-13T17:58:37.389488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:56:02.964249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.838673+0000","last_change":"2024-01-13T17:58:36.835474+0000","last_active":"2024-01-13T17:58:36.838673+0000","last_peered":"2024-01-13T17:58:36.838673+0000","last_clean":"2024-01-13T17:58:36.838673+0000","last_became_active":"2024-01-13T17:58:36.835169+0000","last_became_peered":"2024-01-13T17:58:36.835169+0000","last_unstale":"2024-01-13T17:58:36.838673+0000","last_undegraded":"2024-01-13T17:58:36.838673+0000","last_fullsized":"2024-01-13T17:58:36.838673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:02:02.178682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820340+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:04:00.115120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6,7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.837739+0000","last_change":"2024-01-13T17:58:36.836500+0000","last_active":"2024-01-13T17:58:36.837739+0000","last_peered":"2024-01-13T17:58:36.837739+0000","last_clean":"2024-01-13T17:58:36.837739+0000","last_became_active":"2024-01-13T17:58:36.836231+0000","last_became_peered":"2024-01-13T17:58:36.836231+0000","last_unstale":"2024-01-13T17:58:36.837739+0000","last_undegraded":"2024-01-13T17:58:36.837739+0000","last_fullsized":"2024-01-13T17:58:36.837739+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:40:58.818088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409657+0000","last_change":"2024-01-13T17:58:37.409657+0000","last_active":"2024-01-13T17:58:37.409657+0000","last_peered":"2024-01-13T17:58:37.409657+0000","last_clean":"2024-01-13T17:58:37.409657+0000","last_became_active":"2024-01-13T17:58:37.409373+0000","last_became_peered":"2024-01-13T17:58:37.409373+0000","last_unstale":"2024-01-13T17:58:37.409657+0000","last_undegraded":"2024-01-13T17:58:37.409657+0000","last_fullsized":"2024-01-13T17:58:37.409657+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:04.184668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.817379+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:57:36.055163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.391748+0000","last_change":"2024-01-13T17:58:36.841162+0000","last_active":"2024-01-13T17:58:37.391748+0000","last_peered":"2024-01-13T17:58:37.391748+0000","last_clean":"2024-01-13T17:58:37.391748+0000","last_became_active":"2024-01-13T17:58:36.840845+0000","last_became_peered":"2024-01-13T17:58:36.840845+0000","last_unstale":"2024-01-13T17:58:37.391748+0000","last_undegraded":"2024-01-13T17:58:37.391748+0000","last_fullsized":"2024-01-13T17:58:37.391748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:56:48.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414263+0000","last_change":"2024-01-13T17:58:37.414263+0000","last_active":"2024-01-13T17:58:37.414263+0000","last_peered":"2024-01-13T17:58:37.414263+0000","last_clean":"2024-01-13T17:58:37.414263+0000","last_became_active":"2024-01-13T17:58:37.410388+0000","last_became_peered":"2024-01-13T17:58:37.410388+0000","last_unstale":"2024-01-13T17:58:37.414263+0000","last_undegraded":"2024-01-13T17:58:37.414263+0000","last_fullsized":"2024-01-13T17:58:37.414263+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:55:00.346625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.836618+0000","last_change":"2024-01-13T17:58:36.834846+0000","last_active":"2024-01-13T17:58:36.836618+0000","last_peered":"2024-01-13T17:58:36.836618+0000","last_clean":"2024-01-13T17:58:36.836618+0000","last_became_active":"2024-01-13T17:58:36.834531+0000","last_became_peered":"2024-01-13T17:58:36.834531+0000","last_unstale":"2024-01-13T17:58:36.836618+0000","last_undegraded":"2024-01-13T17:58:36.836618+0000","last_fullsized":"2024-01-13T17:58:36.836618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:12:41.632590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.394865+0000","last_change":"2024-01-13T17:58:37.394865+0000","last_active":"2024-01-13T17:58:37.394865+0000","last_peered":"2024-01-13T17:58:37.394865+0000","last_clean":"2024-01-13T17:58:37.394865+0000","last_became_active":"2024-01-13T17:58:37.394490+0000","last_became_peered":"2024-01-13T17:58:37.394490+0000","last_unstale":"2024-01-13T17:58:37.394865+0000","last_undegraded":"2024-01-13T17:58:37.394865+0000","last_fullsized":"2024-01-13T17:58:37.394865+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:04:30.784006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"59'8","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.829812+0000","last_change":"2024-01-13T17:58:36.831518+0000","last_active":"2024-01-13T17:58:37.829812+0000","last_peered":"2024-01-13T17:58:37.829812+0000","last_clean":"2024-01-13T17:58:37.829812+0000","last_became_active":"2024-01-13T17:58:36.831252+0000","last_became_peered":"2024-01-13T17:58:36.831252+0000","last_unstale":"2024-01-13T17:58:37.829812+0000","last_undegraded":"2024-01-13T17:58:37.829812+0000","last_fullsized":"2024-01-13T17:58:37.829812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:42:53.797821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414840+0000","last_change":"2024-01-13T17:58:37.414840+0000","last_active":"2024-01-13T17:58:37.414840+0000","last_peered":"2024-01-13T17:58:37.414840+0000","last_clean":"2024-01-13T17:58:37.414840+0000","last_became_active":"2024-01-13T17:58:37.414540+0000","last_became_peered":"2024-01-13T17:58:37.414540+0000","last_unstale":"2024-01-13T17:58:37.414840+0000","last_undegraded":"2024-01-13T17:58:37.414840+0000","last_fullsized":"2024-01-13T17:58:37.414840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:57.534623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.831411+0000","last_change":"2024-01-13T17:58:36.831411+0000","last_active":"2024-01-13T17:58:36.831411+0000","last_peered":"2024-01-13T17:58:36.831411+0000","last_clean":"2024-01-13T17:58:36.831411+0000","last_became_active":"2024-01-13T17:58:36.831126+0000","last_became_peered":"2024-01-13T17:58:36.831126+0000","last_unstale":"2024-01-13T17:58:36.831411+0000","last_undegraded":"2024-01-13T17:58:36.831411+0000","last_fullsized":"2024-01-13T17:58:36.831411+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:12:48.869393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.408885+0000","last_change":"2024-01-13T17:58:37.408885+0000","last_active":"2024-01-13T17:58:37.408885+0000","last_peered":"2024-01-13T17:58:37.408885+0000","last_clean":"2024-01-13T17:58:37.408885+0000","last_became_active":"2024-01-13T17:58:37.408618+0000","last_became_peered":"2024-01-13T17:58:37.408618+0000","last_unstale":"2024-01-13T17:58:37.408885+0000","last_undegraded":"2024-01-13T17:58:37.408885+0000","last_fullsized":"2024-01-13T17:58:37.408885+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:18:38.241218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.833047+0000","last_change":"2024-01-13T17:58:36.832399+0000","last_active":"2024-01-13T17:58:36.833047+0000","last_peered":"2024-01-13T17:58:36.833047+0000","last_clean":"2024-01-13T17:58:36.833047+0000","last_became_active":"2024-01-13T17:58:36.832100+0000","last_became_peered":"2024-01-13T17:58:36.832100+0000","last_unstale":"2024-01-13T17:58:36.833047+0000","last_undegraded":"2024-01-13T17:58:36.833047+0000","last_fullsized":"2024-01-13T17:58:36.833047+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:01:50.555635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403256+0000","last_change":"2024-01-13T17:58:37.402741+0000","last_active":"2024-01-13T17:58:37.403256+0000","last_peered":"2024-01-13T17:58:37.403256+0000","last_clean":"2024-01-13T17:58:37.403256+0000","last_became_active":"2024-01-13T17:58:37.402379+0000","last_became_peered":"2024-01-13T17:58:37.402379+0000","last_unstale":"2024-01-13T17:58:37.403256+0000","last_undegraded":"2024-01-13T17:58:37.403256+0000","last_fullsized":"2024-01-13T17:58:37.403256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:30:51.621102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.391644+0000","last_change":"2024-01-13T17:58:36.836469+0000","last_active":"2024-01-13T17:58:37.391644+0000","last_peered":"2024-01-13T17:58:37.391644+0000","last_clean":"2024-01-13T17:58:37.391644+0000","last_became_active":"2024-01-13T17:58:36.836161+0000","last_became_peered":"2024-01-13T17:58:36.836161+0000","last_unstale":"2024-01-13T17:58:37.391644+0000","last_undegraded":"2024-01-13T17:58:37.391644+0000","last_fullsized":"2024-01-13T17:58:37.391644+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:00:00.583677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820416+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:51:28.421503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395912+0000","last_change":"2024-01-13T17:58:37.395912+0000","last_active":"2024-01-13T17:58:37.395912+0000","last_peered":"2024-01-13T17:58:37.395912+0000","last_clean":"2024-01-13T17:58:37.395912+0000","last_became_active":"2024-01-13T17:58:37.395625+0000","last_became_peered":"2024-01-13T17:58:37.395625+0000","last_unstale":"2024-01-13T17:58:37.395912+0000","last_undegraded":"2024-01-13T17:58:37.395912+0000","last_fullsized":"2024-01-13T17:58:37.395912+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:28.565536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.390273+0000","last_change":"2024-01-13T17:58:36.839719+0000","last_active":"2024-01-13T17:58:37.390273+0000","last_peered":"2024-01-13T17:58:37.390273+0000","last_clean":"2024-01-13T17:58:37.390273+0000","last_became_active":"2024-01-13T17:58:36.839440+0000","last_became_peered":"2024-01-13T17:58:36.839440+0000","last_unstale":"2024-01-13T17:58:37.390273+0000","last_undegraded":"2024-01-13T17:58:37.390273+0000","last_fullsized":"2024-01-13T17:58:37.390273+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:17:50.836804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389088+0000","last_change":"2024-01-13T17:58:36.842492+0000","last_active":"2024-01-13T17:58:37.389088+0000","last_peered":"2024-01-13T17:58:37.389088+0000","last_clean":"2024-01-13T17:58:37.389088+0000","last_became_active":"2024-01-13T17:58:36.842172+0000","last_became_peered":"2024-01-13T17:58:36.842172+0000","last_unstale":"2024-01-13T17:58:37.389088+0000","last_undegraded":"2024-01-13T17:58:37.389088+0000","last_fullsized":"2024-01-13T17:58:37.389088+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:58:24.249555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":231,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.831586+0000","last_change":"2024-01-13T17:58:27.209773+0000","last_active":"2024-01-13T17:58:36.831586+0000","last_peered":"2024-01-13T17:58:36.831586+0000","last_clean":"2024-01-13T17:58:36.831586+0000","last_became_active":"2024-01-13T17:58:27.209293+0000","last_became_peered":"2024-01-13T17:58:27.209293+0000","last_unstale":"2024-01-13T17:58:36.831586+0000","last_undegraded":"2024-01-13T17:58:36.831586+0000","last_fullsized":"2024-01-13T17:58:36.831586+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_clean_scrub_stamp":"2024-01-13T17:56:59.530229+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:45:29.626217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845898+0000","last_change":"2024-01-13T17:58:36.844962+0000","last_active":"2024-01-13T17:58:36.845898+0000","last_peered":"2024-01-13T17:58:36.845898+0000","last_clean":"2024-01-13T17:58:36.845898+0000","last_became_active":"2024-01-13T17:58:36.844443+0000","last_became_peered":"2024-01-13T17:58:36.844443+0000","last_unstale":"2024-01-13T17:58:36.845898+0000","last_undegraded":"2024-01-13T17:58:36.845898+0000","last_fullsized":"2024-01-13T17:58:36.845898+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:13:21.802704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845882+0000","last_change":"2024-01-13T17:58:36.845469+0000","last_active":"2024-01-13T17:58:36.845882+0000","last_peered":"2024-01-13T17:58:36.845882+0000","last_clean":"2024-01-13T17:58:36.845882+0000","last_became_active":"2024-01-13T17:58:36.845158+0000","last_became_peered":"2024-01-13T17:58:36.845158+0000","last_unstale":"2024-01-13T17:58:36.845882+0000","last_undegraded":"2024-01-13T17:58:36.845882+0000","last_fullsized":"2024-01-13T17:58:36.845882+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:46.603258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395393+0000","last_change":"2024-01-13T17:58:37.395393+0000","last_active":"2024-01-13T17:58:37.395393+0000","last_peered":"2024-01-13T17:58:37.395393+0000","last_clean":"2024-01-13T17:58:37.395393+0000","last_became_active":"2024-01-13T17:58:37.395105+0000","last_became_peered":"2024-01-13T17:58:37.395105+0000","last_unstale":"2024-01-13T17:58:37.395393+0000","last_undegraded":"2024-01-13T17:58:37.395393+0000","last_fullsized":"2024-01-13T17:58:37.395393+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:12.100528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843391+0000","last_change":"2024-01-13T17:58:36.841642+0000","last_active":"2024-01-13T17:58:36.843391+0000","last_peered":"2024-01-13T17:58:36.843391+0000","last_clean":"2024-01-13T17:58:36.843391+0000","last_became_active":"2024-01-13T17:58:36.840768+0000","last_became_peered":"2024-01-13T17:58:36.840768+0000","last_unstale":"2024-01-13T17:58:36.843391+0000","last_undegraded":"2024-01-13T17:58:36.843391+0000","last_fullsized":"2024-01-13T17:58:36.843391+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:03:26.813924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.840582+0000","last_change":"2024-01-13T17:58:36.839829+0000","last_active":"2024-01-13T17:58:36.840582+0000","last_peered":"2024-01-13T17:58:36.840582+0000","last_clean":"2024-01-13T17:58:36.840582+0000","last_became_active":"2024-01-13T17:58:36.839541+0000","last_became_peered":"2024-01-13T17:58:36.839541+0000","last_unstale":"2024-01-13T17:58:36.840582+0000","last_undegraded":"2024-01-13T17:58:36.840582+0000","last_fullsized":"2024-01-13T17:58:36.840582+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:52:18.758870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845880+0000","last_change":"2024-01-13T17:58:36.844748+0000","last_active":"2024-01-13T17:58:36.845880+0000","last_peered":"2024-01-13T17:58:36.845880+0000","last_clean":"2024-01-13T17:58:36.845880+0000","last_became_active":"2024-01-13T17:58:36.844002+0000","last_became_peered":"2024-01-13T17:58:36.844002+0000","last_unstale":"2024-01-13T17:58:36.845880+0000","last_undegraded":"2024-01-13T17:58:36.845880+0000","last_fullsized":"2024-01-13T17:58:36.845880+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:14:57.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820923+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:25.082021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843428+0000","last_change":"2024-01-13T17:58:36.841464+0000","last_active":"2024-01-13T17:58:36.843428+0000","last_peered":"2024-01-13T17:58:36.843428+0000","last_clean":"2024-01-13T17:58:36.843428+0000","last_became_active":"2024-01-13T17:58:36.840078+0000","last_became_peered":"2024-01-13T17:58:36.840078+0000","last_unstale":"2024-01-13T17:58:36.843428+0000","last_undegraded":"2024-01-13T17:58:36.843428+0000","last_fullsized":"2024-01-13T17:58:36.843428+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:39:59.597495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843449+0000","last_change":"2024-01-13T17:58:36.841581+0000","last_active":"2024-01-13T17:58:36.843449+0000","last_peered":"2024-01-13T17:58:36.843449+0000","last_clean":"2024-01-13T17:58:36.843449+0000","last_became_active":"2024-01-13T17:58:36.841192+0000","last_became_peered":"2024-01-13T17:58:36.841192+0000","last_unstale":"2024-01-13T17:58:36.843449+0000","last_undegraded":"2024-01-13T17:58:36.843449+0000","last_fullsized":"2024-01-13T17:58:36.843449+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:39:05.602781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.827128+0000","last_change":"2024-01-13T17:58:36.844613+0000","last_active":"2024-01-13T17:58:37.827128+0000","last_peered":"2024-01-13T17:58:37.827128+0000","last_clean":"2024-01-13T17:58:37.827128+0000","last_became_active":"2024-01-13T17:58:36.844286+0000","last_became_peered":"2024-01-13T17:58:36.844286+0000","last_unstale":"2024-01-13T17:58:37.827128+0000","last_undegraded":"2024-01-13T17:58:37.827128+0000","last_fullsized":"2024-01-13T17:58:37.827128+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:27:48.244809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.399084+0000","last_change":"2024-01-13T17:58:37.399084+0000","last_active":"2024-01-13T17:58:37.399084+0000","last_peered":"2024-01-13T17:58:37.399084+0000","last_clean":"2024-01-13T17:58:37.399084+0000","last_became_active":"2024-01-13T17:58:37.398572+0000","last_became_peered":"2024-01-13T17:58:37.398572+0000","last_unstale":"2024-01-13T17:58:37.399084+0000","last_undegraded":"2024-01-13T17:58:37.399084+0000","last_fullsized":"2024-01-13T17:58:37.399084+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:18:41.057728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.390142+0000","last_change":"2024-01-13T17:58:36.837432+0000","last_active":"2024-01-13T17:58:37.390142+0000","last_peered":"2024-01-13T17:58:37.390142+0000","last_clean":"2024-01-13T17:58:37.390142+0000","last_became_active":"2024-01-13T17:58:36.837168+0000","last_became_peered":"2024-01-13T17:58:36.837168+0000","last_unstale":"2024-01-13T17:58:37.390142+0000","last_undegraded":"2024-01-13T17:58:37.390142+0000","last_fullsized":"2024-01-13T17:58:37.390142+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:30.125718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416032+0000","last_change":"2024-01-13T17:58:37.416032+0000","last_active":"2024-01-13T17:58:37.416032+0000","last_peered":"2024-01-13T17:58:37.416032+0000","last_clean":"2024-01-13T17:58:37.416032+0000","last_became_active":"2024-01-13T17:58:37.415759+0000","last_became_peered":"2024-01-13T17:58:37.415759+0000","last_unstale":"2024-01-13T17:58:37.416032+0000","last_undegraded":"2024-01-13T17:58:37.416032+0000","last_fullsized":"2024-01-13T17:58:37.416032+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:24.483081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.838653+0000","last_change":"2024-01-13T17:58:36.834302+0000","last_active":"2024-01-13T17:58:36.838653+0000","last_peered":"2024-01-13T17:58:36.838653+0000","last_clean":"2024-01-13T17:58:36.838653+0000","last_became_active":"2024-01-13T17:58:36.833658+0000","last_became_peered":"2024-01-13T17:58:36.833658+0000","last_unstale":"2024-01-13T17:58:36.838653+0000","last_undegraded":"2024-01-13T17:58:36.838653+0000","last_fullsized":"2024-01-13T17:58:36.838653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:13:18.505657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403231+0000","last_change":"2024-01-13T17:58:37.402650+0000","last_active":"2024-01-13T17:58:37.403231+0000","last_peered":"2024-01-13T17:58:37.403231+0000","last_clean":"2024-01-13T17:58:37.403231+0000","last_became_active":"2024-01-13T17:58:37.402128+0000","last_became_peered":"2024-01-13T17:58:37.402128+0000","last_unstale":"2024-01-13T17:58:37.403231+0000","last_undegraded":"2024-01-13T17:58:37.403231+0000","last_fullsized":"2024-01-13T17:58:37.403231+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:02:28.745789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.829297+0000","last_change":"2024-01-13T17:58:36.836861+0000","last_active":"2024-01-13T17:58:37.829297+0000","last_peered":"2024-01-13T17:58:37.829297+0000","last_clean":"2024-01-13T17:58:37.829297+0000","last_became_active":"2024-01-13T17:58:36.836593+0000","last_became_peered":"2024-01-13T17:58:36.836593+0000","last_unstale":"2024-01-13T17:58:37.829297+0000","last_undegraded":"2024-01-13T17:58:37.829297+0000","last_fullsized":"2024-01-13T17:58:37.829297+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:34:37.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414378+0000","last_change":"2024-01-13T17:58:37.414378+0000","last_active":"2024-01-13T17:58:37.414378+0000","last_peered":"2024-01-13T17:58:37.414378+0000","last_clean":"2024-01-13T17:58:37.414378+0000","last_became_active":"2024-01-13T17:58:37.414097+0000","last_became_peered":"2024-01-13T17:58:37.414097+0000","last_unstale":"2024-01-13T17:58:37.414378+0000","last_undegraded":"2024-01-13T17:58:37.414378+0000","last_fullsized":"2024-01-13T17:58:37.414378+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:45:12.430007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397227+0000","last_change":"2024-01-13T17:58:37.397227+0000","last_active":"2024-01-13T17:58:37.397227+0000","last_peered":"2024-01-13T17:58:37.397227+0000","last_clean":"2024-01-13T17:58:37.397227+0000","last_became_active":"2024-01-13T17:58:37.396928+0000","last_became_peered":"2024-01-13T17:58:37.396928+0000","last_unstale":"2024-01-13T17:58:37.397227+0000","last_undegraded":"2024-01-13T17:58:37.397227+0000","last_fullsized":"2024-01-13T17:58:37.397227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:59:55.499543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397903+0000","last_change":"2024-01-13T17:58:37.396849+0000","last_active":"2024-01-13T17:58:37.397903+0000","last_peered":"2024-01-13T17:58:37.397903+0000","last_clean":"2024-01-13T17:58:37.397903+0000","last_became_active":"2024-01-13T17:58:37.396585+0000","last_became_peered":"2024-01-13T17:58:37.396585+0000","last_unstale":"2024-01-13T17:58:37.397903+0000","last_undegraded":"2024-01-13T17:58:37.397903+0000","last_fullsized":"2024-01-13T17:58:37.397903+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:32.529315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.404802+0000","last_change":"2024-01-13T17:58:37.403640+0000","last_active":"2024-01-13T17:58:37.404802+0000","last_peered":"2024-01-13T17:58:37.404802+0000","last_clean":"2024-01-13T17:58:37.404802+0000","last_became_active":"2024-01-13T17:58:37.403041+0000","last_became_peered":"2024-01-13T17:58:37.403041+0000","last_unstale":"2024-01-13T17:58:37.404802+0000","last_undegraded":"2024-01-13T17:58:37.404802+0000","last_fullsized":"2024-01-13T17:58:37.404802+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:37.683734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395592+0000","last_change":"2024-01-13T17:58:37.395592+0000","last_active":"2024-01-13T17:58:37.395592+0000","last_peered":"2024-01-13T17:58:37.395592+0000","last_clean":"2024-01-13T17:58:37.395592+0000","last_became_active":"2024-01-13T17:58:37.395306+0000","last_became_peered":"2024-01-13T17:58:37.395306+0000","last_unstale":"2024-01-13T17:58:37.395592+0000","last_undegraded":"2024-01-13T17:58:37.395592+0000","last_fullsized":"2024-01-13T17:58:37.395592+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:06:42.102077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409861+0000","last_change":"2024-01-13T17:58:37.409861+0000","last_active":"2024-01-13T17:58:37.409861+0000","last_peered":"2024-01-13T17:58:37.409861+0000","last_clean":"2024-01-13T17:58:37.409861+0000","last_became_active":"2024-01-13T17:58:37.409345+0000","last_became_peered":"2024-01-13T17:58:37.409345+0000","last_unstale":"2024-01-13T17:58:37.409861+0000","last_undegraded":"2024-01-13T17:58:37.409861+0000","last_fullsized":"2024-01-13T17:58:37.409861+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:00:44.773057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403255+0000","last_change":"2024-01-13T17:58:37.402590+0000","last_active":"2024-01-13T17:58:37.403255+0000","last_peered":"2024-01-13T17:58:37.403255+0000","last_clean":"2024-01-13T17:58:37.403255+0000","last_became_active":"2024-01-13T17:58:37.402233+0000","last_became_peered":"2024-01-13T17:58:37.402233+0000","last_unstale":"2024-01-13T17:58:37.403255+0000","last_undegraded":"2024-01-13T17:58:37.403255+0000","last_fullsized":"2024-01-13T17:58:37.403255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:48:51.046376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413388+0000","last_change":"2024-01-13T17:58:37.411533+0000","last_active":"2024-01-13T17:58:37.413388+0000","last_peered":"2024-01-13T17:58:37.413388+0000","last_clean":"2024-01-13T17:58:37.413388+0000","last_became_active":"2024-01-13T17:58:37.411192+0000","last_became_peered":"2024-01-13T17:58:37.411192+0000","last_unstale":"2024-01-13T17:58:37.413388+0000","last_undegraded":"2024-01-13T17:58:37.413388+0000","last_fullsized":"2024-01-13T17:58:37.413388+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:31:15.289987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.400265+0000","last_change":"2024-01-13T17:58:37.400265+0000","last_active":"2024-01-13T17:58:37.400265+0000","last_peered":"2024-01-13T17:58:37.400265+0000","last_clean":"2024-01-13T17:58:37.400265+0000","last_became_active":"2024-01-13T17:58:37.399952+0000","last_became_peered":"2024-01-13T17:58:37.399952+0000","last_unstale":"2024-01-13T17:58:37.400265+0000","last_undegraded":"2024-01-13T17:58:37.400265+0000","last_fullsized":"2024-01-13T17:58:37.400265+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:04.725745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":129,"acting":129,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":52,"seq":223338299398,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298444,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446708,"statfs":{"total":95995035648,"available":95689428992,"internally_reserved":0,"allocated":1183744,"data_stored":834295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":6,"up_from":44,"seq":188978561031,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298412,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446740,"statfs":{"total":95995035648,"available":95689461760,"internally_reserved":0,"allocated":1150976,"data_stored":819891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297856,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447296,"statfs":{"total":95995035648,"available":95690031104,"internally_reserved":0,"allocated":581632,"data_stored":243409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.215},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.26600000000000001}]},{"osd":2,"last update":"Sat Jan 13 17:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.28100000000000003}]},{"osd":3,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.248},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446736,"statfs":{"total":95995035648,"available":95689457664,"internally_reserved":0,"allocated":1155072,"data_stored":820156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 13 17:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Jan 13 17:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Jan 13 17:58:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.46200000000000002}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411351,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447280,"statfs":{"total":95995035648,"available":95690014720,"internally_reserved":0,"allocated":598016,"data_stored":250392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.437},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.316}]},{"osd":1,"last update":"Sat Jan 13 17:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.38}]},{"osd":3,"last update":"Sat Jan 13 17:58:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.621},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182419,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297824,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447328,"statfs":{"total":95995035648,"available":95690063872,"internally_reserved":0,"allocated":548864,"data_stored":223553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297836,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447316,"statfs":{"total":95995035648,"available":95690051584,"internally_reserved":0,"allocated":561152,"data_stored":229788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46400000000000002}]},{"osd":2,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.47399999999999998}]},{"osd":3,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":5,"up_from":37,"seq":158913789964,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297876,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447276,"statfs":{"total":95995035648,"available":95690010624,"internally_reserved":0,"allocated":602112,"data_stored":245300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-13T17:58:42.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-13T17:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-01-13T17:58:42.601 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-01-13T17:58:40.781114+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":228,"acting":228,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2384536,"kb_used_data":6232,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":747576680,"statfs":{"total":767960285184,"available":765518520320,"internally_reserved":0,"allocated":6381568,"data_stored":3666784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.967295"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416080+0000","last_change":"2024-01-13T17:58:37.416080+0000","last_active":"2024-01-13T17:58:37.416080+0000","last_peered":"2024-01-13T17:58:37.416080+0000","last_clean":"2024-01-13T17:58:37.416080+0000","last_became_active":"2024-01-13T17:58:37.415621+0000","last_became_peered":"2024-01-13T17:58:37.415621+0000","last_unstale":"2024-01-13T17:58:37.416080+0000","last_undegraded":"2024-01-13T17:58:37.416080+0000","last_fullsized":"2024-01-13T17:58:37.416080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:40.991399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.398891+0000","last_change":"2024-01-13T17:58:37.398891+0000","last_active":"2024-01-13T17:58:37.398891+0000","last_peered":"2024-01-13T17:58:37.398891+0000","last_clean":"2024-01-13T17:58:37.398891+0000","last_became_active":"2024-01-13T17:58:37.398476+0000","last_became_peered":"2024-01-13T17:58:37.398476+0000","last_unstale":"2024-01-13T17:58:37.398891+0000","last_undegraded":"2024-01-13T17:58:37.398891+0000","last_fullsized":"2024-01-13T17:58:37.398891+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:05:39.892184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413370+0000","last_change":"2024-01-13T17:58:37.411528+0000","last_active":"2024-01-13T17:58:37.413370+0000","last_peered":"2024-01-13T17:58:37.413370+0000","last_clean":"2024-01-13T17:58:37.413370+0000","last_became_active":"2024-01-13T17:58:37.411056+0000","last_became_peered":"2024-01-13T17:58:37.411056+0000","last_unstale":"2024-01-13T17:58:37.413370+0000","last_undegraded":"2024-01-13T17:58:37.413370+0000","last_fullsized":"2024-01-13T17:58:37.413370+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:13:24.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.415953+0000","last_change":"2024-01-13T17:58:37.415953+0000","last_active":"2024-01-13T17:58:37.415953+0000","last_peered":"2024-01-13T17:58:37.415953+0000","last_clean":"2024-01-13T17:58:37.415953+0000","last_became_active":"2024-01-13T17:58:37.413825+0000","last_became_peered":"2024-01-13T17:58:37.413825+0000","last_unstale":"2024-01-13T17:58:37.415953+0000","last_undegraded":"2024-01-13T17:58:37.415953+0000","last_fullsized":"2024-01-13T17:58:37.415953+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:04:08.326020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402618+0000","last_change":"2024-01-13T17:58:37.399699+0000","last_active":"2024-01-13T17:58:37.402618+0000","last_peered":"2024-01-13T17:58:37.402618+0000","last_clean":"2024-01-13T17:58:37.402618+0000","last_became_active":"2024-01-13T17:58:37.399358+0000","last_became_peered":"2024-01-13T17:58:37.399358+0000","last_unstale":"2024-01-13T17:58:37.402618+0000","last_undegraded":"2024-01-13T17:58:37.402618+0000","last_fullsized":"2024-01-13T17:58:37.402618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:18.403109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413121+0000","last_change":"2024-01-13T17:58:37.413121+0000","last_active":"2024-01-13T17:58:37.413121+0000","last_peered":"2024-01-13T17:58:37.413121+0000","last_clean":"2024-01-13T17:58:37.413121+0000","last_became_active":"2024-01-13T17:58:37.412816+0000","last_became_peered":"2024-01-13T17:58:37.412816+0000","last_unstale":"2024-01-13T17:58:37.413121+0000","last_undegraded":"2024-01-13T17:58:37.413121+0000","last_fullsized":"2024-01-13T17:58:37.413121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:05.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416421+0000","last_change":"2024-01-13T17:58:37.416421+0000","last_active":"2024-01-13T17:58:37.416421+0000","last_peered":"2024-01-13T17:58:37.416421+0000","last_clean":"2024-01-13T17:58:37.416421+0000","last_became_active":"2024-01-13T17:58:37.416138+0000","last_became_peered":"2024-01-13T17:58:37.416138+0000","last_unstale":"2024-01-13T17:58:37.416421+0000","last_undegraded":"2024-01-13T17:58:37.416421+0000","last_fullsized":"2024-01-13T17:58:37.416421+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:10:51.751719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397837+0000","last_change":"2024-01-13T17:58:37.397837+0000","last_active":"2024-01-13T17:58:37.397837+0000","last_peered":"2024-01-13T17:58:37.397837+0000","last_clean":"2024-01-13T17:58:37.397837+0000","last_became_active":"2024-01-13T17:58:37.397557+0000","last_became_peered":"2024-01-13T17:58:37.397557+0000","last_unstale":"2024-01-13T17:58:37.397837+0000","last_undegraded":"2024-01-13T17:58:37.397837+0000","last_fullsized":"2024-01-13T17:58:37.397837+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:38:02.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397136+0000","last_change":"2024-01-13T17:58:37.397136+0000","last_active":"2024-01-13T17:58:37.397136+0000","last_peered":"2024-01-13T17:58:37.397136+0000","last_clean":"2024-01-13T17:58:37.397136+0000","last_became_active":"2024-01-13T17:58:37.396796+0000","last_became_peered":"2024-01-13T17:58:37.396796+0000","last_unstale":"2024-01-13T17:58:37.397136+0000","last_undegraded":"2024-01-13T17:58:37.397136+0000","last_fullsized":"2024-01-13T17:58:37.397136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:09:37.651466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.821008+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:14:27.077823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.394829+0000","last_change":"2024-01-13T17:58:37.394829+0000","last_active":"2024-01-13T17:58:37.394829+0000","last_peered":"2024-01-13T17:58:37.394829+0000","last_clean":"2024-01-13T17:58:37.394829+0000","last_became_active":"2024-01-13T17:58:37.394582+0000","last_became_peered":"2024-01-13T17:58:37.394582+0000","last_unstale":"2024-01-13T17:58:37.394829+0000","last_undegraded":"2024-01-13T17:58:37.394829+0000","last_fullsized":"2024-01-13T17:58:37.394829+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:52:38.944942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413457+0000","last_change":"2024-01-13T17:58:37.412247+0000","last_active":"2024-01-13T17:58:37.413457+0000","last_peered":"2024-01-13T17:58:37.413457+0000","last_clean":"2024-01-13T17:58:37.413457+0000","last_became_active":"2024-01-13T17:58:37.411947+0000","last_became_peered":"2024-01-13T17:58:37.411947+0000","last_unstale":"2024-01-13T17:58:37.413457+0000","last_undegraded":"2024-01-13T17:58:37.413457+0000","last_fullsized":"2024-01-13T17:58:37.413457+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:05:19.184972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413437+0000","last_change":"2024-01-13T17:58:37.411858+0000","last_active":"2024-01-13T17:58:37.413437+0000","last_peered":"2024-01-13T17:58:37.413437+0000","last_clean":"2024-01-13T17:58:37.413437+0000","last_became_active":"2024-01-13T17:58:37.411559+0000","last_became_peered":"2024-01-13T17:58:37.411559+0000","last_unstale":"2024-01-13T17:58:37.413437+0000","last_undegraded":"2024-01-13T17:58:37.413437+0000","last_fullsized":"2024-01-13T17:58:37.413437+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:00:40.870815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409351+0000","last_change":"2024-01-13T17:58:37.409078+0000","last_active":"2024-01-13T17:58:37.409351+0000","last_peered":"2024-01-13T17:58:37.409351+0000","last_clean":"2024-01-13T17:58:37.409351+0000","last_became_active":"2024-01-13T17:58:37.408820+0000","last_became_peered":"2024-01-13T17:58:37.408820+0000","last_unstale":"2024-01-13T17:58:37.409351+0000","last_undegraded":"2024-01-13T17:58:37.409351+0000","last_fullsized":"2024-01-13T17:58:37.409351+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:30:37.097173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414485+0000","last_change":"2024-01-13T17:58:37.414485+0000","last_active":"2024-01-13T17:58:37.414485+0000","last_peered":"2024-01-13T17:58:37.414485+0000","last_clean":"2024-01-13T17:58:37.414485+0000","last_became_active":"2024-01-13T17:58:37.414182+0000","last_became_peered":"2024-01-13T17:58:37.414182+0000","last_unstale":"2024-01-13T17:58:37.414485+0000","last_undegraded":"2024-01-13T17:58:37.414485+0000","last_fullsized":"2024-01-13T17:58:37.414485+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:08:50.844685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.816836+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:13:23.632461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.817887+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:52:09.032473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828316+0000","last_change":"2024-01-13T17:58:36.845520+0000","last_active":"2024-01-13T17:58:37.828316+0000","last_peered":"2024-01-13T17:58:37.828316+0000","last_clean":"2024-01-13T17:58:37.828316+0000","last_became_active":"2024-01-13T17:58:36.845229+0000","last_became_peered":"2024-01-13T17:58:36.845229+0000","last_unstale":"2024-01-13T17:58:37.828316+0000","last_undegraded":"2024-01-13T17:58:37.828316+0000","last_fullsized":"2024-01-13T17:58:37.828316+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:08:01.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401963+0000","last_change":"2024-01-13T17:58:37.400143+0000","last_active":"2024-01-13T17:58:37.401963+0000","last_peered":"2024-01-13T17:58:37.401963+0000","last_clean":"2024-01-13T17:58:37.401963+0000","last_became_active":"2024-01-13T17:58:37.399689+0000","last_became_peered":"2024-01-13T17:58:37.399689+0000","last_unstale":"2024-01-13T17:58:37.401963+0000","last_undegraded":"2024-01-13T17:58:37.401963+0000","last_fullsized":"2024-01-13T17:58:37.401963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:32:04.518468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828159+0000","last_change":"2024-01-13T17:58:36.843954+0000","last_active":"2024-01-13T17:58:37.828159+0000","last_peered":"2024-01-13T17:58:37.828159+0000","last_clean":"2024-01-13T17:58:37.828159+0000","last_became_active":"2024-01-13T17:58:36.843616+0000","last_became_peered":"2024-01-13T17:58:36.843616+0000","last_unstale":"2024-01-13T17:58:37.828159+0000","last_undegraded":"2024-01-13T17:58:37.828159+0000","last_fullsized":"2024-01-13T17:58:37.828159+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:37:08.466053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401894+0000","last_change":"2024-01-13T17:58:37.399242+0000","last_active":"2024-01-13T17:58:37.401894+0000","last_peered":"2024-01-13T17:58:37.401894+0000","last_clean":"2024-01-13T17:58:37.401894+0000","last_became_active":"2024-01-13T17:58:37.398793+0000","last_became_peered":"2024-01-13T17:58:37.398793+0000","last_unstale":"2024-01-13T17:58:37.401894+0000","last_undegraded":"2024-01-13T17:58:37.401894+0000","last_fullsized":"2024-01-13T17:58:37.401894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:05:43.194645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.817520+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:39:02.091518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6,7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820542+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:02:12.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.834075+0000","last_change":"2024-01-13T17:58:36.832810+0000","last_active":"2024-01-13T17:58:36.834075+0000","last_peered":"2024-01-13T17:58:36.834075+0000","last_clean":"2024-01-13T17:58:36.834075+0000","last_became_active":"2024-01-13T17:58:36.831491+0000","last_became_peered":"2024-01-13T17:58:36.831491+0000","last_unstale":"2024-01-13T17:58:36.834075+0000","last_undegraded":"2024-01-13T17:58:36.834075+0000","last_fullsized":"2024-01-13T17:58:36.834075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:50:10.505869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.818287+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:53:33.628358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389767+0000","last_change":"2024-01-13T17:58:36.842527+0000","last_active":"2024-01-13T17:58:37.389767+0000","last_peered":"2024-01-13T17:58:37.389767+0000","last_clean":"2024-01-13T17:58:37.389767+0000","last_became_active":"2024-01-13T17:58:36.841820+0000","last_became_peered":"2024-01-13T17:58:36.841820+0000","last_unstale":"2024-01-13T17:58:37.389767+0000","last_undegraded":"2024-01-13T17:58:37.389767+0000","last_fullsized":"2024-01-13T17:58:37.389767+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:02.120533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.393987+0000","last_change":"2024-01-13T17:58:37.393987+0000","last_active":"2024-01-13T17:58:37.393987+0000","last_peered":"2024-01-13T17:58:37.393987+0000","last_clean":"2024-01-13T17:58:37.393987+0000","last_became_active":"2024-01-13T17:58:37.393657+0000","last_became_peered":"2024-01-13T17:58:37.393657+0000","last_unstale":"2024-01-13T17:58:37.393987+0000","last_undegraded":"2024-01-13T17:58:37.393987+0000","last_fullsized":"2024-01-13T17:58:37.393987+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:44.818236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843910+0000","last_change":"2024-01-13T17:58:36.843560+0000","last_active":"2024-01-13T17:58:36.843910+0000","last_peered":"2024-01-13T17:58:36.843910+0000","last_clean":"2024-01-13T17:58:36.843910+0000","last_became_active":"2024-01-13T17:58:36.843290+0000","last_became_peered":"2024-01-13T17:58:36.843290+0000","last_unstale":"2024-01-13T17:58:36.843910+0000","last_undegraded":"2024-01-13T17:58:36.843910+0000","last_fullsized":"2024-01-13T17:58:36.843910+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:12:58.012752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413415+0000","last_change":"2024-01-13T17:58:37.412880+0000","last_active":"2024-01-13T17:58:37.413415+0000","last_peered":"2024-01-13T17:58:37.413415+0000","last_clean":"2024-01-13T17:58:37.413415+0000","last_became_active":"2024-01-13T17:58:37.412519+0000","last_became_peered":"2024-01-13T17:58:37.412519+0000","last_unstale":"2024-01-13T17:58:37.413415+0000","last_undegraded":"2024-01-13T17:58:37.413415+0000","last_fullsized":"2024-01-13T17:58:37.413415+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:40:03.956715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389488+0000","last_change":"2024-01-13T17:58:36.841704+0000","last_active":"2024-01-13T17:58:37.389488+0000","last_peered":"2024-01-13T17:58:37.389488+0000","last_clean":"2024-01-13T17:58:37.389488+0000","last_became_active":"2024-01-13T17:58:36.841409+0000","last_became_peered":"2024-01-13T17:58:36.841409+0000","last_unstale":"2024-01-13T17:58:37.389488+0000","last_undegraded":"2024-01-13T17:58:37.389488+0000","last_fullsized":"2024-01-13T17:58:37.389488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:56:02.964249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.838673+0000","last_change":"2024-01-13T17:58:36.835474+0000","last_active":"2024-01-13T17:58:36.838673+0000","last_peered":"2024-01-13T17:58:36.838673+0000","last_clean":"2024-01-13T17:58:36.838673+0000","last_became_active":"2024-01-13T17:58:36.835169+0000","last_became_peered":"2024-01-13T17:58:36.835169+0000","last_unstale":"2024-01-13T17:58:36.838673+0000","last_undegraded":"2024-01-13T17:58:36.838673+0000","last_fullsized":"2024-01-13T17:58:36.838673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:02:02.178682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820340+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:04:00.115120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6,7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.837739+0000","last_change":"2024-01-13T17:58:36.836500+0000","last_active":"2024-01-13T17:58:36.837739+0000","last_peered":"2024-01-13T17:58:36.837739+0000","last_clean":"2024-01-13T17:58:36.837739+0000","last_became_active":"2024-01-13T17:58:36.836231+0000","last_became_peered":"2024-01-13T17:58:36.836231+0000","last_unstale":"2024-01-13T17:58:36.837739+0000","last_undegraded":"2024-01-13T17:58:36.837739+0000","last_fullsized":"2024-01-13T17:58:36.837739+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:40:58.818088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409657+0000","last_change":"2024-01-13T17:58:37.409657+0000","last_active":"2024-01-13T17:58:37.409657+0000","last_peered":"2024-01-13T17:58:37.409657+0000","last_clean":"2024-01-13T17:58:37.409657+0000","last_became_active":"2024-01-13T17:58:37.409373+0000","last_became_peered":"2024-01-13T17:58:37.409373+0000","last_unstale":"2024-01-13T17:58:37.409657+0000","last_undegraded":"2024-01-13T17:58:37.409657+0000","last_fullsized":"2024-01-13T17:58:37.409657+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:04.184668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:35.811841+0000","last_change":"2024-01-13T17:58:35.817379+0000","last_active":"2024-01-13T17:58:35.811841+0000","last_peered":"2024-01-13T17:58:35.811841+0000","last_clean":"2024-01-13T17:58:35.811841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:35.811841+0000","last_undegraded":"2024-01-13T17:58:35.811841+0000","last_fullsized":"2024-01-13T17:58:35.811841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:57:36.055163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.391748+0000","last_change":"2024-01-13T17:58:36.841162+0000","last_active":"2024-01-13T17:58:37.391748+0000","last_peered":"2024-01-13T17:58:37.391748+0000","last_clean":"2024-01-13T17:58:37.391748+0000","last_became_active":"2024-01-13T17:58:36.840845+0000","last_became_peered":"2024-01-13T17:58:36.840845+0000","last_unstale":"2024-01-13T17:58:37.391748+0000","last_undegraded":"2024-01-13T17:58:37.391748+0000","last_fullsized":"2024-01-13T17:58:37.391748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:56:48.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414263+0000","last_change":"2024-01-13T17:58:37.414263+0000","last_active":"2024-01-13T17:58:37.414263+0000","last_peered":"2024-01-13T17:58:37.414263+0000","last_clean":"2024-01-13T17:58:37.414263+0000","last_became_active":"2024-01-13T17:58:37.410388+0000","last_became_peered":"2024-01-13T17:58:37.410388+0000","last_unstale":"2024-01-13T17:58:37.414263+0000","last_undegraded":"2024-01-13T17:58:37.414263+0000","last_fullsized":"2024-01-13T17:58:37.414263+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:55:00.346625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.836618+0000","last_change":"2024-01-13T17:58:36.834846+0000","last_active":"2024-01-13T17:58:36.836618+0000","last_peered":"2024-01-13T17:58:36.836618+0000","last_clean":"2024-01-13T17:58:36.836618+0000","last_became_active":"2024-01-13T17:58:36.834531+0000","last_became_peered":"2024-01-13T17:58:36.834531+0000","last_unstale":"2024-01-13T17:58:36.836618+0000","last_undegraded":"2024-01-13T17:58:36.836618+0000","last_fullsized":"2024-01-13T17:58:36.836618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:12:41.632590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.394865+0000","last_change":"2024-01-13T17:58:37.394865+0000","last_active":"2024-01-13T17:58:37.394865+0000","last_peered":"2024-01-13T17:58:37.394865+0000","last_clean":"2024-01-13T17:58:37.394865+0000","last_became_active":"2024-01-13T17:58:37.394490+0000","last_became_peered":"2024-01-13T17:58:37.394490+0000","last_unstale":"2024-01-13T17:58:37.394865+0000","last_undegraded":"2024-01-13T17:58:37.394865+0000","last_fullsized":"2024-01-13T17:58:37.394865+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:04:30.784006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"59'8","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.829812+0000","last_change":"2024-01-13T17:58:36.831518+0000","last_active":"2024-01-13T17:58:37.829812+0000","last_peered":"2024-01-13T17:58:37.829812+0000","last_clean":"2024-01-13T17:58:37.829812+0000","last_became_active":"2024-01-13T17:58:36.831252+0000","last_became_peered":"2024-01-13T17:58:36.831252+0000","last_unstale":"2024-01-13T17:58:37.829812+0000","last_undegraded":"2024-01-13T17:58:37.829812+0000","last_fullsized":"2024-01-13T17:58:37.829812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:42:53.797821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414840+0000","last_change":"2024-01-13T17:58:37.414840+0000","last_active":"2024-01-13T17:58:37.414840+0000","last_peered":"2024-01-13T17:58:37.414840+0000","last_clean":"2024-01-13T17:58:37.414840+0000","last_became_active":"2024-01-13T17:58:37.414540+0000","last_became_peered":"2024-01-13T17:58:37.414540+0000","last_unstale":"2024-01-13T17:58:37.414840+0000","last_undegraded":"2024-01-13T17:58:37.414840+0000","last_fullsized":"2024-01-13T17:58:37.414840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:57.534623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.831411+0000","last_change":"2024-01-13T17:58:36.831411+0000","last_active":"2024-01-13T17:58:36.831411+0000","last_peered":"2024-01-13T17:58:36.831411+0000","last_clean":"2024-01-13T17:58:36.831411+0000","last_became_active":"2024-01-13T17:58:36.831126+0000","last_became_peered":"2024-01-13T17:58:36.831126+0000","last_unstale":"2024-01-13T17:58:36.831411+0000","last_undegraded":"2024-01-13T17:58:36.831411+0000","last_fullsized":"2024-01-13T17:58:36.831411+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:12:48.869393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.408885+0000","last_change":"2024-01-13T17:58:37.408885+0000","last_active":"2024-01-13T17:58:37.408885+0000","last_peered":"2024-01-13T17:58:37.408885+0000","last_clean":"2024-01-13T17:58:37.408885+0000","last_became_active":"2024-01-13T17:58:37.408618+0000","last_became_peered":"2024-01-13T17:58:37.408618+0000","last_unstale":"2024-01-13T17:58:37.408885+0000","last_undegraded":"2024-01-13T17:58:37.408885+0000","last_fullsized":"2024-01-13T17:58:37.408885+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:18:38.241218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.833047+0000","last_change":"2024-01-13T17:58:36.832399+0000","last_active":"2024-01-13T17:58:36.833047+0000","last_peered":"2024-01-13T17:58:36.833047+0000","last_clean":"2024-01-13T17:58:36.833047+0000","last_became_active":"2024-01-13T17:58:36.832100+0000","last_became_peered":"2024-01-13T17:58:36.832100+0000","last_unstale":"2024-01-13T17:58:36.833047+0000","last_undegraded":"2024-01-13T17:58:36.833047+0000","last_fullsized":"2024-01-13T17:58:36.833047+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:01:50.555635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403256+0000","last_change":"2024-01-13T17:58:37.402741+0000","last_active":"2024-01-13T17:58:37.403256+0000","last_peered":"2024-01-13T17:58:37.403256+0000","last_clean":"2024-01-13T17:58:37.403256+0000","last_became_active":"2024-01-13T17:58:37.402379+0000","last_became_peered":"2024-01-13T17:58:37.402379+0000","last_unstale":"2024-01-13T17:58:37.403256+0000","last_undegraded":"2024-01-13T17:58:37.403256+0000","last_fullsized":"2024-01-13T17:58:37.403256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:30:51.621102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.391644+0000","last_change":"2024-01-13T17:58:36.836469+0000","last_active":"2024-01-13T17:58:37.391644+0000","last_peered":"2024-01-13T17:58:37.391644+0000","last_clean":"2024-01-13T17:58:37.391644+0000","last_became_active":"2024-01-13T17:58:36.836161+0000","last_became_peered":"2024-01-13T17:58:36.836161+0000","last_unstale":"2024-01-13T17:58:37.391644+0000","last_undegraded":"2024-01-13T17:58:37.391644+0000","last_fullsized":"2024-01-13T17:58:37.391644+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:00:00.583677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820416+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:51:28.421503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395912+0000","last_change":"2024-01-13T17:58:37.395912+0000","last_active":"2024-01-13T17:58:37.395912+0000","last_peered":"2024-01-13T17:58:37.395912+0000","last_clean":"2024-01-13T17:58:37.395912+0000","last_became_active":"2024-01-13T17:58:37.395625+0000","last_became_peered":"2024-01-13T17:58:37.395625+0000","last_unstale":"2024-01-13T17:58:37.395912+0000","last_undegraded":"2024-01-13T17:58:37.395912+0000","last_fullsized":"2024-01-13T17:58:37.395912+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:28.565536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.390273+0000","last_change":"2024-01-13T17:58:36.839719+0000","last_active":"2024-01-13T17:58:37.390273+0000","last_peered":"2024-01-13T17:58:37.390273+0000","last_clean":"2024-01-13T17:58:37.390273+0000","last_became_active":"2024-01-13T17:58:36.839440+0000","last_became_peered":"2024-01-13T17:58:36.839440+0000","last_unstale":"2024-01-13T17:58:37.390273+0000","last_undegraded":"2024-01-13T17:58:37.390273+0000","last_fullsized":"2024-01-13T17:58:37.390273+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:17:50.836804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389088+0000","last_change":"2024-01-13T17:58:36.842492+0000","last_active":"2024-01-13T17:58:37.389088+0000","last_peered":"2024-01-13T17:58:37.389088+0000","last_clean":"2024-01-13T17:58:37.389088+0000","last_became_active":"2024-01-13T17:58:36.842172+0000","last_became_peered":"2024-01-13T17:58:36.842172+0000","last_unstale":"2024-01-13T17:58:37.389088+0000","last_undegraded":"2024-01-13T17:58:37.389088+0000","last_fullsized":"2024-01-13T17:58:37.389088+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:58:24.249555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":231,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.831586+0000","last_change":"2024-01-13T17:58:27.209773+0000","last_active":"2024-01-13T17:58:36.831586+0000","last_peered":"2024-01-13T17:58:36.831586+0000","last_clean":"2024-01-13T17:58:36.831586+0000","last_became_active":"2024-01-13T17:58:27.209293+0000","last_became_peered":"2024-01-13T17:58:27.209293+0000","last_unstale":"2024-01-13T17:58:36.831586+0000","last_undegraded":"2024-01-13T17:58:36.831586+0000","last_fullsized":"2024-01-13T17:58:36.831586+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_clean_scrub_stamp":"2024-01-13T17:56:59.530229+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:45:29.626217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845898+0000","last_change":"2024-01-13T17:58:36.844962+0000","last_active":"2024-01-13T17:58:36.845898+0000","last_peered":"2024-01-13T17:58:36.845898+0000","last_clean":"2024-01-13T17:58:36.845898+0000","last_became_active":"2024-01-13T17:58:36.844443+0000","last_became_peered":"2024-01-13T17:58:36.844443+0000","last_unstale":"2024-01-13T17:58:36.845898+0000","last_undegraded":"2024-01-13T17:58:36.845898+0000","last_fullsized":"2024-01-13T17:58:36.845898+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:13:21.802704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845882+0000","last_change":"2024-01-13T17:58:36.845469+0000","last_active":"2024-01-13T17:58:36.845882+0000","last_peered":"2024-01-13T17:58:36.845882+0000","last_clean":"2024-01-13T17:58:36.845882+0000","last_became_active":"2024-01-13T17:58:36.845158+0000","last_became_peered":"2024-01-13T17:58:36.845158+0000","last_unstale":"2024-01-13T17:58:36.845882+0000","last_undegraded":"2024-01-13T17:58:36.845882+0000","last_fullsized":"2024-01-13T17:58:36.845882+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:46.603258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395393+0000","last_change":"2024-01-13T17:58:37.395393+0000","last_active":"2024-01-13T17:58:37.395393+0000","last_peered":"2024-01-13T17:58:37.395393+0000","last_clean":"2024-01-13T17:58:37.395393+0000","last_became_active":"2024-01-13T17:58:37.395105+0000","last_became_peered":"2024-01-13T17:58:37.395105+0000","last_unstale":"2024-01-13T17:58:37.395393+0000","last_undegraded":"2024-01-13T17:58:37.395393+0000","last_fullsized":"2024-01-13T17:58:37.395393+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:12.100528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843391+0000","last_change":"2024-01-13T17:58:36.841642+0000","last_active":"2024-01-13T17:58:36.843391+0000","last_peered":"2024-01-13T17:58:36.843391+0000","last_clean":"2024-01-13T17:58:36.843391+0000","last_became_active":"2024-01-13T17:58:36.840768+0000","last_became_peered":"2024-01-13T17:58:36.840768+0000","last_unstale":"2024-01-13T17:58:36.843391+0000","last_undegraded":"2024-01-13T17:58:36.843391+0000","last_fullsized":"2024-01-13T17:58:36.843391+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:03:26.813924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.840582+0000","last_change":"2024-01-13T17:58:36.839829+0000","last_active":"2024-01-13T17:58:36.840582+0000","last_peered":"2024-01-13T17:58:36.840582+0000","last_clean":"2024-01-13T17:58:36.840582+0000","last_became_active":"2024-01-13T17:58:36.839541+0000","last_became_peered":"2024-01-13T17:58:36.839541+0000","last_unstale":"2024-01-13T17:58:36.840582+0000","last_undegraded":"2024-01-13T17:58:36.840582+0000","last_fullsized":"2024-01-13T17:58:36.840582+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:52:18.758870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845880+0000","last_change":"2024-01-13T17:58:36.844748+0000","last_active":"2024-01-13T17:58:36.845880+0000","last_peered":"2024-01-13T17:58:36.845880+0000","last_clean":"2024-01-13T17:58:36.845880+0000","last_became_active":"2024-01-13T17:58:36.844002+0000","last_became_peered":"2024-01-13T17:58:36.844002+0000","last_unstale":"2024-01-13T17:58:36.845880+0000","last_undegraded":"2024-01-13T17:58:36.845880+0000","last_fullsized":"2024-01-13T17:58:36.845880+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:14:57.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.820923+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:25.082021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843428+0000","last_change":"2024-01-13T17:58:36.841464+0000","last_active":"2024-01-13T17:58:36.843428+0000","last_peered":"2024-01-13T17:58:36.843428+0000","last_clean":"2024-01-13T17:58:36.843428+0000","last_became_active":"2024-01-13T17:58:36.840078+0000","last_became_peered":"2024-01-13T17:58:36.840078+0000","last_unstale":"2024-01-13T17:58:36.843428+0000","last_undegraded":"2024-01-13T17:58:36.843428+0000","last_fullsized":"2024-01-13T17:58:36.843428+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:39:59.597495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843449+0000","last_change":"2024-01-13T17:58:36.841581+0000","last_active":"2024-01-13T17:58:36.843449+0000","last_peered":"2024-01-13T17:58:36.843449+0000","last_clean":"2024-01-13T17:58:36.843449+0000","last_became_active":"2024-01-13T17:58:36.841192+0000","last_became_peered":"2024-01-13T17:58:36.841192+0000","last_unstale":"2024-01-13T17:58:36.843449+0000","last_undegraded":"2024-01-13T17:58:36.843449+0000","last_fullsized":"2024-01-13T17:58:36.843449+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:39:05.602781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.827128+0000","last_change":"2024-01-13T17:58:36.844613+0000","last_active":"2024-01-13T17:58:37.827128+0000","last_peered":"2024-01-13T17:58:37.827128+0000","last_clean":"2024-01-13T17:58:37.827128+0000","last_became_active":"2024-01-13T17:58:36.844286+0000","last_became_peered":"2024-01-13T17:58:36.844286+0000","last_unstale":"2024-01-13T17:58:37.827128+0000","last_undegraded":"2024-01-13T17:58:37.827128+0000","last_fullsized":"2024-01-13T17:58:37.827128+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:27:48.244809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.399084+0000","last_change":"2024-01-13T17:58:37.399084+0000","last_active":"2024-01-13T17:58:37.399084+0000","last_peered":"2024-01-13T17:58:37.399084+0000","last_clean":"2024-01-13T17:58:37.399084+0000","last_became_active":"2024-01-13T17:58:37.398572+0000","last_became_peered":"2024-01-13T17:58:37.398572+0000","last_unstale":"2024-01-13T17:58:37.399084+0000","last_undegraded":"2024-01-13T17:58:37.399084+0000","last_fullsized":"2024-01-13T17:58:37.399084+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:18:41.057728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.390142+0000","last_change":"2024-01-13T17:58:36.837432+0000","last_active":"2024-01-13T17:58:37.390142+0000","last_peered":"2024-01-13T17:58:37.390142+0000","last_clean":"2024-01-13T17:58:37.390142+0000","last_became_active":"2024-01-13T17:58:36.837168+0000","last_became_peered":"2024-01-13T17:58:36.837168+0000","last_unstale":"2024-01-13T17:58:37.390142+0000","last_undegraded":"2024-01-13T17:58:37.390142+0000","last_fullsized":"2024-01-13T17:58:37.390142+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:30.125718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416032+0000","last_change":"2024-01-13T17:58:37.416032+0000","last_active":"2024-01-13T17:58:37.416032+0000","last_peered":"2024-01-13T17:58:37.416032+0000","last_clean":"2024-01-13T17:58:37.416032+0000","last_became_active":"2024-01-13T17:58:37.415759+0000","last_became_peered":"2024-01-13T17:58:37.415759+0000","last_unstale":"2024-01-13T17:58:37.416032+0000","last_undegraded":"2024-01-13T17:58:37.416032+0000","last_fullsized":"2024-01-13T17:58:37.416032+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:24.483081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.838653+0000","last_change":"2024-01-13T17:58:36.834302+0000","last_active":"2024-01-13T17:58:36.838653+0000","last_peered":"2024-01-13T17:58:36.838653+0000","last_clean":"2024-01-13T17:58:36.838653+0000","last_became_active":"2024-01-13T17:58:36.833658+0000","last_became_peered":"2024-01-13T17:58:36.833658+0000","last_unstale":"2024-01-13T17:58:36.838653+0000","last_undegraded":"2024-01-13T17:58:36.838653+0000","last_fullsized":"2024-01-13T17:58:36.838653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:13:18.505657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403231+0000","last_change":"2024-01-13T17:58:37.402650+0000","last_active":"2024-01-13T17:58:37.403231+0000","last_peered":"2024-01-13T17:58:37.403231+0000","last_clean":"2024-01-13T17:58:37.403231+0000","last_became_active":"2024-01-13T17:58:37.402128+0000","last_became_peered":"2024-01-13T17:58:37.402128+0000","last_unstale":"2024-01-13T17:58:37.403231+0000","last_undegraded":"2024-01-13T17:58:37.403231+0000","last_fullsized":"2024-01-13T17:58:37.403231+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:02:28.745789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.829297+0000","last_change":"2024-01-13T17:58:36.836861+0000","last_active":"2024-01-13T17:58:37.829297+0000","last_peered":"2024-01-13T17:58:37.829297+0000","last_clean":"2024-01-13T17:58:37.829297+0000","last_became_active":"2024-01-13T17:58:36.836593+0000","last_became_peered":"2024-01-13T17:58:36.836593+0000","last_unstale":"2024-01-13T17:58:37.829297+0000","last_undegraded":"2024-01-13T17:58:37.829297+0000","last_fullsized":"2024-01-13T17:58:37.829297+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:34:37.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414378+0000","last_change":"2024-01-13T17:58:37.414378+0000","last_active":"2024-01-13T17:58:37.414378+0000","last_peered":"2024-01-13T17:58:37.414378+0000","last_clean":"2024-01-13T17:58:37.414378+0000","last_became_active":"2024-01-13T17:58:37.414097+0000","last_became_peered":"2024-01-13T17:58:37.414097+0000","last_unstale":"2024-01-13T17:58:37.414378+0000","last_undegraded":"2024-01-13T17:58:37.414378+0000","last_fullsized":"2024-01-13T17:58:37.414378+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:45:12.430007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397227+0000","last_change":"2024-01-13T17:58:37.397227+0000","last_active":"2024-01-13T17:58:37.397227+0000","last_peered":"2024-01-13T17:58:37.397227+0000","last_clean":"2024-01-13T17:58:37.397227+0000","last_became_active":"2024-01-13T17:58:37.396928+0000","last_became_peered":"2024-01-13T17:58:37.396928+0000","last_unstale":"2024-01-13T17:58:37.397227+0000","last_undegraded":"2024-01-13T17:58:37.397227+0000","last_fullsized":"2024-01-13T17:58:37.397227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:59:55.499543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397903+0000","last_change":"2024-01-13T17:58:37.396849+0000","last_active":"2024-01-13T17:58:37.397903+0000","last_peered":"2024-01-13T17:58:37.397903+0000","last_clean":"2024-01-13T17:58:37.397903+0000","last_became_active":"2024-01-13T17:58:37.396585+0000","last_became_peered":"2024-01-13T17:58:37.396585+0000","last_unstale":"2024-01-13T17:58:37.397903+0000","last_undegraded":"2024-01-13T17:58:37.397903+0000","last_fullsized":"2024-01-13T17:58:37.397903+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:32.529315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.404802+0000","last_change":"2024-01-13T17:58:37.403640+0000","last_active":"2024-01-13T17:58:37.404802+0000","last_peered":"2024-01-13T17:58:37.404802+0000","last_clean":"2024-01-13T17:58:37.404802+0000","last_became_active":"2024-01-13T17:58:37.403041+0000","last_became_peered":"2024-01-13T17:58:37.403041+0000","last_unstale":"2024-01-13T17:58:37.404802+0000","last_undegraded":"2024-01-13T17:58:37.404802+0000","last_fullsized":"2024-01-13T17:58:37.404802+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:37.683734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395592+0000","last_change":"2024-01-13T17:58:37.395592+0000","last_active":"2024-01-13T17:58:37.395592+0000","last_peered":"2024-01-13T17:58:37.395592+0000","last_clean":"2024-01-13T17:58:37.395592+0000","last_became_active":"2024-01-13T17:58:37.395306+0000","last_became_peered":"2024-01-13T17:58:37.395306+0000","last_unstale":"2024-01-13T17:58:37.395592+0000","last_undegraded":"2024-01-13T17:58:37.395592+0000","last_fullsized":"2024-01-13T17:58:37.395592+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:06:42.102077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409861+0000","last_change":"2024-01-13T17:58:37.409861+0000","last_active":"2024-01-13T17:58:37.409861+0000","last_peered":"2024-01-13T17:58:37.409861+0000","last_clean":"2024-01-13T17:58:37.409861+0000","last_became_active":"2024-01-13T17:58:37.409345+0000","last_became_peered":"2024-01-13T17:58:37.409345+0000","last_unstale":"2024-01-13T17:58:37.409861+0000","last_undegraded":"2024-01-13T17:58:37.409861+0000","last_fullsized":"2024-01-13T17:58:37.409861+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:00:44.773057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403255+0000","last_change":"2024-01-13T17:58:37.402590+0000","last_active":"2024-01-13T17:58:37.403255+0000","last_peered":"2024-01-13T17:58:37.403255+0000","last_clean":"2024-01-13T17:58:37.403255+0000","last_became_active":"2024-01-13T17:58:37.402233+0000","last_became_peered":"2024-01-13T17:58:37.402233+0000","last_unstale":"2024-01-13T17:58:37.403255+0000","last_undegraded":"2024-01-13T17:58:37.403255+0000","last_fullsized":"2024-01-13T17:58:37.403255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:48:51.046376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413388+0000","last_change":"2024-01-13T17:58:37.411533+0000","last_active":"2024-01-13T17:58:37.413388+0000","last_peered":"2024-01-13T17:58:37.413388+0000","last_clean":"2024-01-13T17:58:37.413388+0000","last_became_active":"2024-01-13T17:58:37.411192+0000","last_became_peered":"2024-01-13T17:58:37.411192+0000","last_unstale":"2024-01-13T17:58:37.413388+0000","last_undegraded":"2024-01-13T17:58:37.413388+0000","last_fullsized":"2024-01-13T17:58:37.413388+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:31:15.289987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-13T17:58:36.813499+0000","last_change":"2024-01-13T17:58:36.813499+0000","last_active":"2024-01-13T17:58:36.813499+0000","last_peered":"2024-01-13T17:58:36.813499+0000","last_clean":"2024-01-13T17:58:36.813499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-13T17:58:36.813499+0000","last_undegraded":"2024-01-13T17:58:36.813499+0000","last_fullsized":"2024-01-13T17:58:36.813499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.400265+0000","last_change":"2024-01-13T17:58:37.400265+0000","last_active":"2024-01-13T17:58:37.400265+0000","last_peered":"2024-01-13T17:58:37.400265+0000","last_clean":"2024-01-13T17:58:37.400265+0000","last_became_active":"2024-01-13T17:58:37.399952+0000","last_became_peered":"2024-01-13T17:58:37.399952+0000","last_unstale":"2024-01-13T17:58:37.400265+0000","last_undegraded":"2024-01-13T17:58:37.400265+0000","last_fullsized":"2024-01-13T17:58:37.400265+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:04.725745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":129,"acting":129,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":52,"seq":223338299398,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298444,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446708,"statfs":{"total":95995035648,"available":95689428992,"internally_reserved":0,"allocated":1183744,"data_stored":834295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":6,"up_from":44,"seq":188978561031,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298412,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446740,"statfs":{"total":95995035648,"available":95689461760,"internally_reserved":0,"allocated":1150976,"data_stored":819891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297856,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447296,"statfs":{"total":95995035648,"available":95690031104,"internally_reserved":0,"allocated":581632,"data_stored":243409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.215},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.26600000000000001}]},{"osd":2,"last update":"Sat Jan 13 17:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.28100000000000003}]},{"osd":3,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.248},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446736,"statfs":{"total":95995035648,"available":95689457664,"internally_reserved":0,"allocated":1155072,"data_stored":820156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 13 17:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Jan 13 17:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Jan 13 17:58:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.46200000000000002}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411351,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447280,"statfs":{"total":95995035648,"available":95690014720,"internally_reserved":0,"allocated":598016,"data_stored":250392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.437},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.316}]},{"osd":1,"last update":"Sat Jan 13 17:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.38}]},{"osd":3,"last update":"Sat Jan 13 17:58:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.621},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182419,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297824,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447328,"statfs":{"total":95995035648,"available":95690063872,"internally_reserved":0,"allocated":548864,"data_stored":223553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297836,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447316,"statfs":{"total":95995035648,"available":95690051584,"internally_reserved":0,"allocated":561152,"data_stored":229788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46400000000000002}]},{"osd":2,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.47399999999999998}]},{"osd":3,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":5,"up_from":37,"seq":158913789964,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297876,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447276,"statfs":{"total":95995035648,"available":95690010624,"internally_reserved":0,"allocated":602112,"data_stored":245300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-13T17:58:42.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-01-13T17:58:42.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-01-13T17:58:42.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-01-13T17:58:42.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.821008+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-15T03:14:27.077823+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6, 0], 'acting': [4, 6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-13T17:58:42.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-01-13T17:58:42.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-01-13T17:58:42.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-01-13T17:58:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-13T17:58:35.811841+0000', 'last_change': '2024-01-13T17:58:35.816836+0000', 'last_active': '2024-01-13T17:58:35.811841+0000', 'last_peered': '2024-01-13T17:58:35.811841+0000', 'last_clean': '2024-01-13T17:58:35.811841+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:35.811841+0000', 'last_undegraded': '2024-01-13T17:58:35.811841+0000', 'last_fullsized': '2024-01-13T17:58:35.811841+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-14T19:13:23.632461+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7, 4], 'acting': [0, 7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-13T17:58:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-01-13T17:58:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-01-13T17:58:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-13T17:58:35.811841+0000', 'last_change': '2024-01-13T17:58:35.817887+0000', 'last_active': '2024-01-13T17:58:35.811841+0000', 'last_peered': '2024-01-13T17:58:35.811841+0000', 'last_clean': '2024-01-13T17:58:35.811841+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:35.811841+0000', 'last_undegraded': '2024-01-13T17:58:35.811841+0000', 'last_fullsized': '2024-01-13T17:58:35.811841+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-15T01:52:09.032473+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 5], 'acting': [3, 0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-13T17:58:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-01-13T17:58:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-01-13T17:58:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-13T17:58:35.811841+0000', 'last_change': '2024-01-13T17:58:35.817520+0000', 'last_active': '2024-01-13T17:58:35.811841+0000', 'last_peered': '2024-01-13T17:58:35.811841+0000', 'last_clean': '2024-01-13T17:58:35.811841+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:35.811841+0000', 'last_undegraded': '2024-01-13T17:58:35.811841+0000', 'last_fullsized': '2024-01-13T17:58:35.811841+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-15T01:39:02.091518+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7, 6], 'acting': [3, 7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6, 7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-13T17:58:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-01-13T17:58:42.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.820542+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-15T04:02:12.068621+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1, 2], 'acting': [4, 1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1, 2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-13T17:58:35.811841+0000', 'last_change': '2024-01-13T17:58:35.818287+0000', 'last_active': '2024-01-13T17:58:35.811841+0000', 'last_peered': '2024-01-13T17:58:35.811841+0000', 'last_clean': '2024-01-13T17:58:35.811841+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:35.811841+0000', 'last_undegraded': '2024-01-13T17:58:35.811841+0000', 'last_fullsized': '2024-01-13T17:58:35.811841+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-15T04:53:33.628358+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6, 0], 'acting': [3, 6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.820340+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-15T03:04:00.115120+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7, 6], 'acting': [4, 7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6, 7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-01-13T17:58:42.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-13T17:58:35.811841+0000', 'last_change': '2024-01-13T17:58:35.817379+0000', 'last_active': '2024-01-13T17:58:35.811841+0000', 'last_peered': '2024-01-13T17:58:35.811841+0000', 'last_clean': '2024-01-13T17:58:35.811841+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:35.811841+0000', 'last_undegraded': '2024-01-13T17:58:35.811841+0000', 'last_fullsized': '2024-01-13T17:58:35.811841+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:35.811841+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-14T18:57:36.055163+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4, 3], 'acting': [0, 4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3, 4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-13T17:58:42.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-01-13T17:58:42.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-01-13T17:58:42.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.820416+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-14T18:51:28.421503+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0, 6], 'acting': [4, 0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-13T17:58:42.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-01-13T17:58:42.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-01-13T17:58:42.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-01-13T17:58:42.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.820923+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-15T02:39:25.082021+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2, 7], 'acting': [4, 2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-01-13T17:58:42.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-01-13T17:58:42.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-01-13T17:58:42.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-13T17:58:36.813499+0000', 'last_change': '2024-01-13T17:58:36.813499+0000', 'last_active': '2024-01-13T17:58:36.813499+0000', 'last_peered': '2024-01-13T17:58:36.813499+0000', 'last_clean': '2024-01-13T17:58:36.813499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-13T17:58:36.813499+0000', 'last_undegraded': '2024-01-13T17:58:36.813499+0000', 'last_fullsized': '2024-01-13T17:58:36.813499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'last_clean_scrub_stamp': '2024-01-13T17:58:36.813499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-13T17:58:42.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-13T17:58:42.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:42 smithi084 ceph-mon[37908]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:42.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:42 smithi084 ceph-mon[37908]: from='client.14553 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:42 smithi084 ceph-mon[52328]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:42 smithi084 ceph-mon[52328]: from='client.14553 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:43.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:43.029 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":163,"monmap":{"epoch":3,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":60,"num_osds":8,"num_up_osds":8,"osd_up_since":1705168703,"num_in_osds":8,"osd_in_since":1705168688,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592514,"bytes_used":2441990144,"bytes_avail":765518295040,"bytes_total":767960285184,"write_bytes_sec":1876,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24337}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.84:8443/"}},"servicemap":{"epoch":10,"modified":"2024-01-13T17:58:32.779497+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-13T17:58:43.043 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-13T17:58:43.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-13T17:58:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:42 smithi099 ceph-mon[71325]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:42 smithi099 ceph-mon[71325]: from='client.14553 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:43.355 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-01-13T17:58:43.367 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-01-13T17:58:42.781733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592514,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":238,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2384756,"kb_used_data":6452,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":747576460,"statfs":{"total":767960285184,"available":765518295040,"internally_reserved":0,"allocated":6606848,"data_stored":3759991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2146,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001465"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416080+0000","last_change":"2024-01-13T17:58:37.416080+0000","last_active":"2024-01-13T17:58:37.416080+0000","last_peered":"2024-01-13T17:58:37.416080+0000","last_clean":"2024-01-13T17:58:37.416080+0000","last_became_active":"2024-01-13T17:58:37.415621+0000","last_became_peered":"2024-01-13T17:58:37.415621+0000","last_unstale":"2024-01-13T17:58:37.416080+0000","last_undegraded":"2024-01-13T17:58:37.416080+0000","last_fullsized":"2024-01-13T17:58:37.416080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:40.991399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.398891+0000","last_change":"2024-01-13T17:58:37.398891+0000","last_active":"2024-01-13T17:58:37.398891+0000","last_peered":"2024-01-13T17:58:37.398891+0000","last_clean":"2024-01-13T17:58:37.398891+0000","last_became_active":"2024-01-13T17:58:37.398476+0000","last_became_peered":"2024-01-13T17:58:37.398476+0000","last_unstale":"2024-01-13T17:58:37.398891+0000","last_undegraded":"2024-01-13T17:58:37.398891+0000","last_fullsized":"2024-01-13T17:58:37.398891+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:05:39.892184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.400191+0000","last_change":"2024-01-13T17:58:37.399839+0000","last_active":"2024-01-13T17:58:37.400191+0000","last_peered":"2024-01-13T17:58:37.400191+0000","last_clean":"2024-01-13T17:58:37.400191+0000","last_became_active":"2024-01-13T17:58:37.399578+0000","last_became_peered":"2024-01-13T17:58:37.399578+0000","last_unstale":"2024-01-13T17:58:37.400191+0000","last_undegraded":"2024-01-13T17:58:37.400191+0000","last_fullsized":"2024-01-13T17:58:37.400191+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:36:22.906393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413370+0000","last_change":"2024-01-13T17:58:37.411528+0000","last_active":"2024-01-13T17:58:37.413370+0000","last_peered":"2024-01-13T17:58:37.413370+0000","last_clean":"2024-01-13T17:58:37.413370+0000","last_became_active":"2024-01-13T17:58:37.411056+0000","last_became_peered":"2024-01-13T17:58:37.411056+0000","last_unstale":"2024-01-13T17:58:37.413370+0000","last_undegraded":"2024-01-13T17:58:37.413370+0000","last_fullsized":"2024-01-13T17:58:37.413370+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:13:24.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.415953+0000","last_change":"2024-01-13T17:58:37.415953+0000","last_active":"2024-01-13T17:58:37.415953+0000","last_peered":"2024-01-13T17:58:37.415953+0000","last_clean":"2024-01-13T17:58:37.415953+0000","last_became_active":"2024-01-13T17:58:37.413825+0000","last_became_peered":"2024-01-13T17:58:37.413825+0000","last_unstale":"2024-01-13T17:58:37.415953+0000","last_undegraded":"2024-01-13T17:58:37.415953+0000","last_fullsized":"2024-01-13T17:58:37.415953+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:04:08.326020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402618+0000","last_change":"2024-01-13T17:58:37.399699+0000","last_active":"2024-01-13T17:58:37.402618+0000","last_peered":"2024-01-13T17:58:37.402618+0000","last_clean":"2024-01-13T17:58:37.402618+0000","last_became_active":"2024-01-13T17:58:37.399358+0000","last_became_peered":"2024-01-13T17:58:37.399358+0000","last_unstale":"2024-01-13T17:58:37.402618+0000","last_undegraded":"2024-01-13T17:58:37.402618+0000","last_fullsized":"2024-01-13T17:58:37.402618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:18.403109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413121+0000","last_change":"2024-01-13T17:58:37.413121+0000","last_active":"2024-01-13T17:58:37.413121+0000","last_peered":"2024-01-13T17:58:37.413121+0000","last_clean":"2024-01-13T17:58:37.413121+0000","last_became_active":"2024-01-13T17:58:37.412816+0000","last_became_peered":"2024-01-13T17:58:37.412816+0000","last_unstale":"2024-01-13T17:58:37.413121+0000","last_undegraded":"2024-01-13T17:58:37.413121+0000","last_fullsized":"2024-01-13T17:58:37.413121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:05.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397118+0000","last_change":"2024-01-13T17:58:37.393602+0000","last_active":"2024-01-13T17:58:37.397118+0000","last_peered":"2024-01-13T17:58:37.397118+0000","last_clean":"2024-01-13T17:58:37.397118+0000","last_became_active":"2024-01-13T17:58:37.393317+0000","last_became_peered":"2024-01-13T17:58:37.393317+0000","last_unstale":"2024-01-13T17:58:37.397118+0000","last_undegraded":"2024-01-13T17:58:37.397118+0000","last_fullsized":"2024-01-13T17:58:37.397118+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:14:00.225985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416421+0000","last_change":"2024-01-13T17:58:37.416421+0000","last_active":"2024-01-13T17:58:37.416421+0000","last_peered":"2024-01-13T17:58:37.416421+0000","last_clean":"2024-01-13T17:58:37.416421+0000","last_became_active":"2024-01-13T17:58:37.416138+0000","last_became_peered":"2024-01-13T17:58:37.416138+0000","last_unstale":"2024-01-13T17:58:37.416421+0000","last_undegraded":"2024-01-13T17:58:37.416421+0000","last_fullsized":"2024-01-13T17:58:37.416421+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:10:51.751719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.400786+0000","last_change":"2024-01-13T17:58:37.397837+0000","last_active":"2024-01-13T17:58:37.400786+0000","last_peered":"2024-01-13T17:58:37.400786+0000","last_clean":"2024-01-13T17:58:37.400786+0000","last_became_active":"2024-01-13T17:58:37.397557+0000","last_became_peered":"2024-01-13T17:58:37.397557+0000","last_unstale":"2024-01-13T17:58:37.400786+0000","last_undegraded":"2024-01-13T17:58:37.400786+0000","last_fullsized":"2024-01-13T17:58:37.400786+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:38:02.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397989+0000","last_change":"2024-01-13T17:58:37.397136+0000","last_active":"2024-01-13T17:58:37.397989+0000","last_peered":"2024-01-13T17:58:37.397989+0000","last_clean":"2024-01-13T17:58:37.397989+0000","last_became_active":"2024-01-13T17:58:37.396796+0000","last_became_peered":"2024-01-13T17:58:37.396796+0000","last_unstale":"2024-01-13T17:58:37.397989+0000","last_undegraded":"2024-01-13T17:58:37.397989+0000","last_fullsized":"2024-01-13T17:58:37.397989+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:09:37.651466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403379+0000","last_change":"2024-01-13T17:58:37.401738+0000","last_active":"2024-01-13T17:58:37.403379+0000","last_peered":"2024-01-13T17:58:37.403379+0000","last_clean":"2024-01-13T17:58:37.403379+0000","last_became_active":"2024-01-13T17:58:37.401390+0000","last_became_peered":"2024-01-13T17:58:37.401390+0000","last_unstale":"2024-01-13T17:58:37.403379+0000","last_undegraded":"2024-01-13T17:58:37.403379+0000","last_fullsized":"2024-01-13T17:58:37.403379+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:10:08.882123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410911+0000","last_change":"2024-01-13T17:58:37.410693+0000","last_active":"2024-01-13T17:58:37.410911+0000","last_peered":"2024-01-13T17:58:37.410911+0000","last_clean":"2024-01-13T17:58:37.410911+0000","last_became_active":"2024-01-13T17:58:37.410478+0000","last_became_peered":"2024-01-13T17:58:37.410478+0000","last_unstale":"2024-01-13T17:58:37.410911+0000","last_undegraded":"2024-01-13T17:58:37.410911+0000","last_fullsized":"2024-01-13T17:58:37.410911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:54:26.505663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.400065+0000","last_change":"2024-01-13T17:58:37.399587+0000","last_active":"2024-01-13T17:58:37.400065+0000","last_peered":"2024-01-13T17:58:37.400065+0000","last_clean":"2024-01-13T17:58:37.400065+0000","last_became_active":"2024-01-13T17:58:37.399266+0000","last_became_peered":"2024-01-13T17:58:37.399266+0000","last_unstale":"2024-01-13T17:58:37.400065+0000","last_undegraded":"2024-01-13T17:58:37.400065+0000","last_fullsized":"2024-01-13T17:58:37.400065+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:45:41.896344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.394829+0000","last_change":"2024-01-13T17:58:37.394829+0000","last_active":"2024-01-13T17:58:37.394829+0000","last_peered":"2024-01-13T17:58:37.394829+0000","last_clean":"2024-01-13T17:58:37.394829+0000","last_became_active":"2024-01-13T17:58:37.394582+0000","last_became_peered":"2024-01-13T17:58:37.394582+0000","last_unstale":"2024-01-13T17:58:37.394829+0000","last_undegraded":"2024-01-13T17:58:37.394829+0000","last_fullsized":"2024-01-13T17:58:37.394829+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:52:38.944942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413457+0000","last_change":"2024-01-13T17:58:37.412247+0000","last_active":"2024-01-13T17:58:37.413457+0000","last_peered":"2024-01-13T17:58:37.413457+0000","last_clean":"2024-01-13T17:58:37.413457+0000","last_became_active":"2024-01-13T17:58:37.411947+0000","last_became_peered":"2024-01-13T17:58:37.411947+0000","last_unstale":"2024-01-13T17:58:37.413457+0000","last_undegraded":"2024-01-13T17:58:37.413457+0000","last_fullsized":"2024-01-13T17:58:37.413457+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:05:19.184972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413437+0000","last_change":"2024-01-13T17:58:37.411858+0000","last_active":"2024-01-13T17:58:37.413437+0000","last_peered":"2024-01-13T17:58:37.413437+0000","last_clean":"2024-01-13T17:58:37.413437+0000","last_became_active":"2024-01-13T17:58:37.411559+0000","last_became_peered":"2024-01-13T17:58:37.411559+0000","last_unstale":"2024-01-13T17:58:37.413437+0000","last_undegraded":"2024-01-13T17:58:37.413437+0000","last_fullsized":"2024-01-13T17:58:37.413437+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:00:40.870815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409351+0000","last_change":"2024-01-13T17:58:37.409078+0000","last_active":"2024-01-13T17:58:37.409351+0000","last_peered":"2024-01-13T17:58:37.409351+0000","last_clean":"2024-01-13T17:58:37.409351+0000","last_became_active":"2024-01-13T17:58:37.408820+0000","last_became_peered":"2024-01-13T17:58:37.408820+0000","last_unstale":"2024-01-13T17:58:37.409351+0000","last_undegraded":"2024-01-13T17:58:37.409351+0000","last_fullsized":"2024-01-13T17:58:37.409351+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:30:37.097173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414485+0000","last_change":"2024-01-13T17:58:37.414485+0000","last_active":"2024-01-13T17:58:37.414485+0000","last_peered":"2024-01-13T17:58:37.414485+0000","last_clean":"2024-01-13T17:58:37.414485+0000","last_became_active":"2024-01-13T17:58:37.414182+0000","last_became_peered":"2024-01-13T17:58:37.414182+0000","last_unstale":"2024-01-13T17:58:37.414485+0000","last_undegraded":"2024-01-13T17:58:37.414485+0000","last_fullsized":"2024-01-13T17:58:37.414485+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:08:50.844685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"59'4","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.830230+0000","last_change":"2024-01-13T17:58:36.839635+0000","last_active":"2024-01-13T17:58:37.830230+0000","last_peered":"2024-01-13T17:58:37.830230+0000","last_clean":"2024-01-13T17:58:37.830230+0000","last_became_active":"2024-01-13T17:58:36.839344+0000","last_became_peered":"2024-01-13T17:58:36.839344+0000","last_unstale":"2024-01-13T17:58:37.830230+0000","last_undegraded":"2024-01-13T17:58:37.830230+0000","last_fullsized":"2024-01-13T17:58:37.830230+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:41:18.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.406885+0000","last_change":"2024-01-13T17:58:37.403720+0000","last_active":"2024-01-13T17:58:37.406885+0000","last_peered":"2024-01-13T17:58:37.406885+0000","last_clean":"2024-01-13T17:58:37.406885+0000","last_became_active":"2024-01-13T17:58:37.403390+0000","last_became_peered":"2024-01-13T17:58:37.403390+0000","last_unstale":"2024-01-13T17:58:37.406885+0000","last_undegraded":"2024-01-13T17:58:37.406885+0000","last_fullsized":"2024-01-13T17:58:37.406885+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:38:09.594828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828439+0000","last_change":"2024-01-13T17:58:36.846725+0000","last_active":"2024-01-13T17:58:37.828439+0000","last_peered":"2024-01-13T17:58:37.828439+0000","last_clean":"2024-01-13T17:58:37.828439+0000","last_became_active":"2024-01-13T17:58:36.846375+0000","last_became_peered":"2024-01-13T17:58:36.846375+0000","last_unstale":"2024-01-13T17:58:37.828439+0000","last_undegraded":"2024-01-13T17:58:37.828439+0000","last_fullsized":"2024-01-13T17:58:37.828439+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:06:04.006535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.396286+0000","last_change":"2024-01-13T17:58:37.395186+0000","last_active":"2024-01-13T17:58:37.396286+0000","last_peered":"2024-01-13T17:58:37.396286+0000","last_clean":"2024-01-13T17:58:37.396286+0000","last_became_active":"2024-01-13T17:58:37.394880+0000","last_became_peered":"2024-01-13T17:58:37.394880+0000","last_unstale":"2024-01-13T17:58:37.396286+0000","last_undegraded":"2024-01-13T17:58:37.396286+0000","last_fullsized":"2024-01-13T17:58:37.396286+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:02:59.539263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828316+0000","last_change":"2024-01-13T17:58:36.845520+0000","last_active":"2024-01-13T17:58:37.828316+0000","last_peered":"2024-01-13T17:58:37.828316+0000","last_clean":"2024-01-13T17:58:37.828316+0000","last_became_active":"2024-01-13T17:58:36.845229+0000","last_became_peered":"2024-01-13T17:58:36.845229+0000","last_unstale":"2024-01-13T17:58:37.828316+0000","last_undegraded":"2024-01-13T17:58:37.828316+0000","last_fullsized":"2024-01-13T17:58:37.828316+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:08:01.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401963+0000","last_change":"2024-01-13T17:58:37.400143+0000","last_active":"2024-01-13T17:58:37.401963+0000","last_peered":"2024-01-13T17:58:37.401963+0000","last_clean":"2024-01-13T17:58:37.401963+0000","last_became_active":"2024-01-13T17:58:37.399689+0000","last_became_peered":"2024-01-13T17:58:37.399689+0000","last_unstale":"2024-01-13T17:58:37.401963+0000","last_undegraded":"2024-01-13T17:58:37.401963+0000","last_fullsized":"2024-01-13T17:58:37.401963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:32:04.518468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828159+0000","last_change":"2024-01-13T17:58:36.843954+0000","last_active":"2024-01-13T17:58:37.828159+0000","last_peered":"2024-01-13T17:58:37.828159+0000","last_clean":"2024-01-13T17:58:37.828159+0000","last_became_active":"2024-01-13T17:58:36.843616+0000","last_became_peered":"2024-01-13T17:58:36.843616+0000","last_unstale":"2024-01-13T17:58:37.828159+0000","last_undegraded":"2024-01-13T17:58:37.828159+0000","last_fullsized":"2024-01-13T17:58:37.828159+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:37:08.466053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401894+0000","last_change":"2024-01-13T17:58:37.399242+0000","last_active":"2024-01-13T17:58:37.401894+0000","last_peered":"2024-01-13T17:58:37.401894+0000","last_clean":"2024-01-13T17:58:37.401894+0000","last_became_active":"2024-01-13T17:58:37.398793+0000","last_became_peered":"2024-01-13T17:58:37.398793+0000","last_unstale":"2024-01-13T17:58:37.401894+0000","last_undegraded":"2024-01-13T17:58:37.401894+0000","last_fullsized":"2024-01-13T17:58:37.401894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:05:43.194645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.827757+0000","last_change":"2024-01-13T17:58:36.838743+0000","last_active":"2024-01-13T17:58:37.827757+0000","last_peered":"2024-01-13T17:58:37.827757+0000","last_clean":"2024-01-13T17:58:37.827757+0000","last_became_active":"2024-01-13T17:58:36.838444+0000","last_became_peered":"2024-01-13T17:58:36.838444+0000","last_unstale":"2024-01-13T17:58:37.827757+0000","last_undegraded":"2024-01-13T17:58:37.827757+0000","last_fullsized":"2024-01-13T17:58:37.827757+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:48:37.841281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403108+0000","last_change":"2024-01-13T17:58:37.401094+0000","last_active":"2024-01-13T17:58:37.403108+0000","last_peered":"2024-01-13T17:58:37.403108+0000","last_clean":"2024-01-13T17:58:37.403108+0000","last_became_active":"2024-01-13T17:58:37.400621+0000","last_became_peered":"2024-01-13T17:58:37.400621+0000","last_unstale":"2024-01-13T17:58:37.403108+0000","last_undegraded":"2024-01-13T17:58:37.403108+0000","last_fullsized":"2024-01-13T17:58:37.403108+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:15:46.371336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.827927+0000","last_change":"2024-01-13T17:58:36.832810+0000","last_active":"2024-01-13T17:58:37.827927+0000","last_peered":"2024-01-13T17:58:37.827927+0000","last_clean":"2024-01-13T17:58:37.827927+0000","last_became_active":"2024-01-13T17:58:36.831491+0000","last_became_peered":"2024-01-13T17:58:36.831491+0000","last_unstale":"2024-01-13T17:58:37.827927+0000","last_undegraded":"2024-01-13T17:58:37.827927+0000","last_fullsized":"2024-01-13T17:58:37.827927+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:50:10.505869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410260+0000","last_change":"2024-01-13T17:58:37.408148+0000","last_active":"2024-01-13T17:58:37.410260+0000","last_peered":"2024-01-13T17:58:37.410260+0000","last_clean":"2024-01-13T17:58:37.410260+0000","last_became_active":"2024-01-13T17:58:37.407858+0000","last_became_peered":"2024-01-13T17:58:37.407858+0000","last_unstale":"2024-01-13T17:58:37.410260+0000","last_undegraded":"2024-01-13T17:58:37.410260+0000","last_fullsized":"2024-01-13T17:58:37.410260+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:35:47.284096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.386361+0000","last_change":"2024-01-13T17:58:36.843139+0000","last_active":"2024-01-13T17:58:37.386361+0000","last_peered":"2024-01-13T17:58:37.386361+0000","last_clean":"2024-01-13T17:58:37.386361+0000","last_became_active":"2024-01-13T17:58:36.842487+0000","last_became_peered":"2024-01-13T17:58:36.842487+0000","last_unstale":"2024-01-13T17:58:37.386361+0000","last_undegraded":"2024-01-13T17:58:37.386361+0000","last_fullsized":"2024-01-13T17:58:37.386361+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:28:01.688683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402273+0000","last_change":"2024-01-13T17:58:37.401772+0000","last_active":"2024-01-13T17:58:37.402273+0000","last_peered":"2024-01-13T17:58:37.402273+0000","last_clean":"2024-01-13T17:58:37.402273+0000","last_became_active":"2024-01-13T17:58:37.401490+0000","last_became_peered":"2024-01-13T17:58:37.401490+0000","last_unstale":"2024-01-13T17:58:37.402273+0000","last_undegraded":"2024-01-13T17:58:37.402273+0000","last_fullsized":"2024-01-13T17:58:37.402273+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:32:13.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389767+0000","last_change":"2024-01-13T17:58:36.842527+0000","last_active":"2024-01-13T17:58:37.389767+0000","last_peered":"2024-01-13T17:58:37.389767+0000","last_clean":"2024-01-13T17:58:37.389767+0000","last_became_active":"2024-01-13T17:58:36.841820+0000","last_became_peered":"2024-01-13T17:58:36.841820+0000","last_unstale":"2024-01-13T17:58:37.389767+0000","last_undegraded":"2024-01-13T17:58:37.389767+0000","last_fullsized":"2024-01-13T17:58:37.389767+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:02.120533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.393987+0000","last_change":"2024-01-13T17:58:37.393987+0000","last_active":"2024-01-13T17:58:37.393987+0000","last_peered":"2024-01-13T17:58:37.393987+0000","last_clean":"2024-01-13T17:58:37.393987+0000","last_became_active":"2024-01-13T17:58:37.393657+0000","last_became_peered":"2024-01-13T17:58:37.393657+0000","last_unstale":"2024-01-13T17:58:37.393987+0000","last_undegraded":"2024-01-13T17:58:37.393987+0000","last_fullsized":"2024-01-13T17:58:37.393987+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:44.818236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.385390+0000","last_change":"2024-01-13T17:58:36.843560+0000","last_active":"2024-01-13T17:58:37.385390+0000","last_peered":"2024-01-13T17:58:37.385390+0000","last_clean":"2024-01-13T17:58:37.385390+0000","last_became_active":"2024-01-13T17:58:36.843290+0000","last_became_peered":"2024-01-13T17:58:36.843290+0000","last_unstale":"2024-01-13T17:58:37.385390+0000","last_undegraded":"2024-01-13T17:58:37.385390+0000","last_fullsized":"2024-01-13T17:58:37.385390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:12:58.012752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413415+0000","last_change":"2024-01-13T17:58:37.412880+0000","last_active":"2024-01-13T17:58:37.413415+0000","last_peered":"2024-01-13T17:58:37.413415+0000","last_clean":"2024-01-13T17:58:37.413415+0000","last_became_active":"2024-01-13T17:58:37.412519+0000","last_became_peered":"2024-01-13T17:58:37.412519+0000","last_unstale":"2024-01-13T17:58:37.413415+0000","last_undegraded":"2024-01-13T17:58:37.413415+0000","last_fullsized":"2024-01-13T17:58:37.413415+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:40:03.956715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389488+0000","last_change":"2024-01-13T17:58:36.841704+0000","last_active":"2024-01-13T17:58:37.389488+0000","last_peered":"2024-01-13T17:58:37.389488+0000","last_clean":"2024-01-13T17:58:37.389488+0000","last_became_active":"2024-01-13T17:58:36.841409+0000","last_became_peered":"2024-01-13T17:58:36.841409+0000","last_unstale":"2024-01-13T17:58:37.389488+0000","last_undegraded":"2024-01-13T17:58:37.389488+0000","last_fullsized":"2024-01-13T17:58:37.389488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:56:02.964249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403926+0000","last_change":"2024-01-13T17:58:37.403381+0000","last_active":"2024-01-13T17:58:37.403926+0000","last_peered":"2024-01-13T17:58:37.403926+0000","last_clean":"2024-01-13T17:58:37.403926+0000","last_became_active":"2024-01-13T17:58:37.403108+0000","last_became_peered":"2024-01-13T17:58:37.403108+0000","last_unstale":"2024-01-13T17:58:37.403926+0000","last_undegraded":"2024-01-13T17:58:37.403926+0000","last_fullsized":"2024-01-13T17:58:37.403926+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:55:07.654474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.838673+0000","last_change":"2024-01-13T17:58:36.835474+0000","last_active":"2024-01-13T17:58:36.838673+0000","last_peered":"2024-01-13T17:58:36.838673+0000","last_clean":"2024-01-13T17:58:36.838673+0000","last_became_active":"2024-01-13T17:58:36.835169+0000","last_became_peered":"2024-01-13T17:58:36.835169+0000","last_unstale":"2024-01-13T17:58:36.838673+0000","last_undegraded":"2024-01-13T17:58:36.838673+0000","last_fullsized":"2024-01-13T17:58:36.838673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:02:02.178682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.407791+0000","last_change":"2024-01-13T17:58:37.407252+0000","last_active":"2024-01-13T17:58:37.407791+0000","last_peered":"2024-01-13T17:58:37.407791+0000","last_clean":"2024-01-13T17:58:37.407791+0000","last_became_active":"2024-01-13T17:58:37.406352+0000","last_became_peered":"2024-01-13T17:58:37.406352+0000","last_unstale":"2024-01-13T17:58:37.407791+0000","last_undegraded":"2024-01-13T17:58:37.407791+0000","last_fullsized":"2024-01-13T17:58:37.407791+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:21:50.223964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"59'6","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.830644+0000","last_change":"2024-01-13T17:58:36.836500+0000","last_active":"2024-01-13T17:58:37.830644+0000","last_peered":"2024-01-13T17:58:37.830644+0000","last_clean":"2024-01-13T17:58:37.830644+0000","last_became_active":"2024-01-13T17:58:36.836231+0000","last_became_peered":"2024-01-13T17:58:36.836231+0000","last_unstale":"2024-01-13T17:58:37.830644+0000","last_undegraded":"2024-01-13T17:58:37.830644+0000","last_fullsized":"2024-01-13T17:58:37.830644+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:40:58.818088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409657+0000","last_change":"2024-01-13T17:58:37.409657+0000","last_active":"2024-01-13T17:58:37.409657+0000","last_peered":"2024-01-13T17:58:37.409657+0000","last_clean":"2024-01-13T17:58:37.409657+0000","last_became_active":"2024-01-13T17:58:37.409373+0000","last_became_peered":"2024-01-13T17:58:37.409373+0000","last_unstale":"2024-01-13T17:58:37.409657+0000","last_undegraded":"2024-01-13T17:58:37.409657+0000","last_fullsized":"2024-01-13T17:58:37.409657+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:04.184668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.830184+0000","last_change":"2024-01-13T17:58:36.841243+0000","last_active":"2024-01-13T17:58:37.830184+0000","last_peered":"2024-01-13T17:58:37.830184+0000","last_clean":"2024-01-13T17:58:37.830184+0000","last_became_active":"2024-01-13T17:58:36.840803+0000","last_became_peered":"2024-01-13T17:58:36.840803+0000","last_unstale":"2024-01-13T17:58:37.830184+0000","last_undegraded":"2024-01-13T17:58:37.830184+0000","last_fullsized":"2024-01-13T17:58:37.830184+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:02:14.255922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410296+0000","last_change":"2024-01-13T17:58:37.409006+0000","last_active":"2024-01-13T17:58:37.410296+0000","last_peered":"2024-01-13T17:58:37.410296+0000","last_clean":"2024-01-13T17:58:37.410296+0000","last_became_active":"2024-01-13T17:58:37.408736+0000","last_became_peered":"2024-01-13T17:58:37.408736+0000","last_unstale":"2024-01-13T17:58:37.410296+0000","last_undegraded":"2024-01-13T17:58:37.410296+0000","last_fullsized":"2024-01-13T17:58:37.410296+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:10:11.734133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.391748+0000","last_change":"2024-01-13T17:58:36.841162+0000","last_active":"2024-01-13T17:58:37.391748+0000","last_peered":"2024-01-13T17:58:37.391748+0000","last_clean":"2024-01-13T17:58:37.391748+0000","last_became_active":"2024-01-13T17:58:36.840845+0000","last_became_peered":"2024-01-13T17:58:36.840845+0000","last_unstale":"2024-01-13T17:58:37.391748+0000","last_undegraded":"2024-01-13T17:58:37.391748+0000","last_fullsized":"2024-01-13T17:58:37.391748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:56:48.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414263+0000","last_change":"2024-01-13T17:58:37.414263+0000","last_active":"2024-01-13T17:58:37.414263+0000","last_peered":"2024-01-13T17:58:37.414263+0000","last_clean":"2024-01-13T17:58:37.414263+0000","last_became_active":"2024-01-13T17:58:37.410388+0000","last_became_peered":"2024-01-13T17:58:37.410388+0000","last_unstale":"2024-01-13T17:58:37.414263+0000","last_undegraded":"2024-01-13T17:58:37.414263+0000","last_fullsized":"2024-01-13T17:58:37.414263+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:55:00.346625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.385253+0000","last_change":"2024-01-13T17:58:36.834846+0000","last_active":"2024-01-13T17:58:37.385253+0000","last_peered":"2024-01-13T17:58:37.385253+0000","last_clean":"2024-01-13T17:58:37.385253+0000","last_became_active":"2024-01-13T17:58:36.834531+0000","last_became_peered":"2024-01-13T17:58:36.834531+0000","last_unstale":"2024-01-13T17:58:37.385253+0000","last_undegraded":"2024-01-13T17:58:37.385253+0000","last_fullsized":"2024-01-13T17:58:37.385253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:12:41.632590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.396357+0000","last_change":"2024-01-13T17:58:37.394865+0000","last_active":"2024-01-13T17:58:37.396357+0000","last_peered":"2024-01-13T17:58:37.396357+0000","last_clean":"2024-01-13T17:58:37.396357+0000","last_became_active":"2024-01-13T17:58:37.394490+0000","last_became_peered":"2024-01-13T17:58:37.394490+0000","last_unstale":"2024-01-13T17:58:37.396357+0000","last_undegraded":"2024-01-13T17:58:37.396357+0000","last_fullsized":"2024-01-13T17:58:37.396357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:04:30.784006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"59'8","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.829812+0000","last_change":"2024-01-13T17:58:36.831518+0000","last_active":"2024-01-13T17:58:37.829812+0000","last_peered":"2024-01-13T17:58:37.829812+0000","last_clean":"2024-01-13T17:58:37.829812+0000","last_became_active":"2024-01-13T17:58:36.831252+0000","last_became_peered":"2024-01-13T17:58:36.831252+0000","last_unstale":"2024-01-13T17:58:37.829812+0000","last_undegraded":"2024-01-13T17:58:37.829812+0000","last_fullsized":"2024-01-13T17:58:37.829812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:42:53.797821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414840+0000","last_change":"2024-01-13T17:58:37.414840+0000","last_active":"2024-01-13T17:58:37.414840+0000","last_peered":"2024-01-13T17:58:37.414840+0000","last_clean":"2024-01-13T17:58:37.414840+0000","last_became_active":"2024-01-13T17:58:37.414540+0000","last_became_peered":"2024-01-13T17:58:37.414540+0000","last_unstale":"2024-01-13T17:58:37.414840+0000","last_undegraded":"2024-01-13T17:58:37.414840+0000","last_fullsized":"2024-01-13T17:58:37.414840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:57.534623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828801+0000","last_change":"2024-01-13T17:58:36.831411+0000","last_active":"2024-01-13T17:58:37.828801+0000","last_peered":"2024-01-13T17:58:37.828801+0000","last_clean":"2024-01-13T17:58:37.828801+0000","last_became_active":"2024-01-13T17:58:36.831126+0000","last_became_peered":"2024-01-13T17:58:36.831126+0000","last_unstale":"2024-01-13T17:58:37.828801+0000","last_undegraded":"2024-01-13T17:58:37.828801+0000","last_fullsized":"2024-01-13T17:58:37.828801+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:12:48.869393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.408885+0000","last_change":"2024-01-13T17:58:37.408885+0000","last_active":"2024-01-13T17:58:37.408885+0000","last_peered":"2024-01-13T17:58:37.408885+0000","last_clean":"2024-01-13T17:58:37.408885+0000","last_became_active":"2024-01-13T17:58:37.408618+0000","last_became_peered":"2024-01-13T17:58:37.408618+0000","last_unstale":"2024-01-13T17:58:37.408885+0000","last_undegraded":"2024-01-13T17:58:37.408885+0000","last_fullsized":"2024-01-13T17:58:37.408885+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:18:38.241218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.833047+0000","last_change":"2024-01-13T17:58:36.832399+0000","last_active":"2024-01-13T17:58:36.833047+0000","last_peered":"2024-01-13T17:58:36.833047+0000","last_clean":"2024-01-13T17:58:36.833047+0000","last_became_active":"2024-01-13T17:58:36.832100+0000","last_became_peered":"2024-01-13T17:58:36.832100+0000","last_unstale":"2024-01-13T17:58:36.833047+0000","last_undegraded":"2024-01-13T17:58:36.833047+0000","last_fullsized":"2024-01-13T17:58:36.833047+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:01:50.555635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403256+0000","last_change":"2024-01-13T17:58:37.402741+0000","last_active":"2024-01-13T17:58:37.403256+0000","last_peered":"2024-01-13T17:58:37.403256+0000","last_clean":"2024-01-13T17:58:37.403256+0000","last_became_active":"2024-01-13T17:58:37.402379+0000","last_became_peered":"2024-01-13T17:58:37.402379+0000","last_unstale":"2024-01-13T17:58:37.403256+0000","last_undegraded":"2024-01-13T17:58:37.403256+0000","last_fullsized":"2024-01-13T17:58:37.403256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:30:51.621102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.391644+0000","last_change":"2024-01-13T17:58:36.836469+0000","last_active":"2024-01-13T17:58:37.391644+0000","last_peered":"2024-01-13T17:58:37.391644+0000","last_clean":"2024-01-13T17:58:37.391644+0000","last_became_active":"2024-01-13T17:58:36.836161+0000","last_became_peered":"2024-01-13T17:58:36.836161+0000","last_unstale":"2024-01-13T17:58:37.391644+0000","last_undegraded":"2024-01-13T17:58:37.391644+0000","last_fullsized":"2024-01-13T17:58:37.391644+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:00:00.583677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.412101+0000","last_change":"2024-01-13T17:58:37.411383+0000","last_active":"2024-01-13T17:58:37.412101+0000","last_peered":"2024-01-13T17:58:37.412101+0000","last_clean":"2024-01-13T17:58:37.412101+0000","last_became_active":"2024-01-13T17:58:37.411086+0000","last_became_peered":"2024-01-13T17:58:37.411086+0000","last_unstale":"2024-01-13T17:58:37.412101+0000","last_undegraded":"2024-01-13T17:58:37.412101+0000","last_fullsized":"2024-01-13T17:58:37.412101+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:29:49.851426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395912+0000","last_change":"2024-01-13T17:58:37.395912+0000","last_active":"2024-01-13T17:58:37.395912+0000","last_peered":"2024-01-13T17:58:37.395912+0000","last_clean":"2024-01-13T17:58:37.395912+0000","last_became_active":"2024-01-13T17:58:37.395625+0000","last_became_peered":"2024-01-13T17:58:37.395625+0000","last_unstale":"2024-01-13T17:58:37.395912+0000","last_undegraded":"2024-01-13T17:58:37.395912+0000","last_fullsized":"2024-01-13T17:58:37.395912+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:28.565536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.390273+0000","last_change":"2024-01-13T17:58:36.839719+0000","last_active":"2024-01-13T17:58:37.390273+0000","last_peered":"2024-01-13T17:58:37.390273+0000","last_clean":"2024-01-13T17:58:37.390273+0000","last_became_active":"2024-01-13T17:58:36.839440+0000","last_became_peered":"2024-01-13T17:58:36.839440+0000","last_unstale":"2024-01-13T17:58:37.390273+0000","last_undegraded":"2024-01-13T17:58:37.390273+0000","last_fullsized":"2024-01-13T17:58:37.390273+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:17:50.836804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397861+0000","last_change":"2024-01-13T17:58:37.397651+0000","last_active":"2024-01-13T17:58:37.397861+0000","last_peered":"2024-01-13T17:58:37.397861+0000","last_clean":"2024-01-13T17:58:37.397861+0000","last_became_active":"2024-01-13T17:58:37.397326+0000","last_became_peered":"2024-01-13T17:58:37.397326+0000","last_unstale":"2024-01-13T17:58:37.397861+0000","last_undegraded":"2024-01-13T17:58:37.397861+0000","last_fullsized":"2024-01-13T17:58:37.397861+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:24:26.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389088+0000","last_change":"2024-01-13T17:58:36.842492+0000","last_active":"2024-01-13T17:58:37.389088+0000","last_peered":"2024-01-13T17:58:37.389088+0000","last_clean":"2024-01-13T17:58:37.389088+0000","last_became_active":"2024-01-13T17:58:36.842172+0000","last_became_peered":"2024-01-13T17:58:36.842172+0000","last_unstale":"2024-01-13T17:58:37.389088+0000","last_undegraded":"2024-01-13T17:58:37.389088+0000","last_fullsized":"2024-01-13T17:58:37.389088+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:58:24.249555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":231,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.831586+0000","last_change":"2024-01-13T17:58:27.209773+0000","last_active":"2024-01-13T17:58:36.831586+0000","last_peered":"2024-01-13T17:58:36.831586+0000","last_clean":"2024-01-13T17:58:36.831586+0000","last_became_active":"2024-01-13T17:58:27.209293+0000","last_became_peered":"2024-01-13T17:58:27.209293+0000","last_unstale":"2024-01-13T17:58:36.831586+0000","last_undegraded":"2024-01-13T17:58:36.831586+0000","last_fullsized":"2024-01-13T17:58:36.831586+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_clean_scrub_stamp":"2024-01-13T17:56:59.530229+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:45:29.626217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403686+0000","last_change":"2024-01-13T17:58:37.403318+0000","last_active":"2024-01-13T17:58:37.403686+0000","last_peered":"2024-01-13T17:58:37.403686+0000","last_clean":"2024-01-13T17:58:37.403686+0000","last_became_active":"2024-01-13T17:58:37.403022+0000","last_became_peered":"2024-01-13T17:58:37.403022+0000","last_unstale":"2024-01-13T17:58:37.403686+0000","last_undegraded":"2024-01-13T17:58:37.403686+0000","last_fullsized":"2024-01-13T17:58:37.403686+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:13:06.307215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845898+0000","last_change":"2024-01-13T17:58:36.844962+0000","last_active":"2024-01-13T17:58:36.845898+0000","last_peered":"2024-01-13T17:58:36.845898+0000","last_clean":"2024-01-13T17:58:36.845898+0000","last_became_active":"2024-01-13T17:58:36.844443+0000","last_became_peered":"2024-01-13T17:58:36.844443+0000","last_unstale":"2024-01-13T17:58:36.845898+0000","last_undegraded":"2024-01-13T17:58:36.845898+0000","last_fullsized":"2024-01-13T17:58:36.845898+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:13:21.802704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845882+0000","last_change":"2024-01-13T17:58:36.845469+0000","last_active":"2024-01-13T17:58:36.845882+0000","last_peered":"2024-01-13T17:58:36.845882+0000","last_clean":"2024-01-13T17:58:36.845882+0000","last_became_active":"2024-01-13T17:58:36.845158+0000","last_became_peered":"2024-01-13T17:58:36.845158+0000","last_unstale":"2024-01-13T17:58:36.845882+0000","last_undegraded":"2024-01-13T17:58:36.845882+0000","last_fullsized":"2024-01-13T17:58:36.845882+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:46.603258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395393+0000","last_change":"2024-01-13T17:58:37.395393+0000","last_active":"2024-01-13T17:58:37.395393+0000","last_peered":"2024-01-13T17:58:37.395393+0000","last_clean":"2024-01-13T17:58:37.395393+0000","last_became_active":"2024-01-13T17:58:37.395105+0000","last_became_peered":"2024-01-13T17:58:37.395105+0000","last_unstale":"2024-01-13T17:58:37.395393+0000","last_undegraded":"2024-01-13T17:58:37.395393+0000","last_fullsized":"2024-01-13T17:58:37.395393+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:12.100528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843391+0000","last_change":"2024-01-13T17:58:36.841642+0000","last_active":"2024-01-13T17:58:36.843391+0000","last_peered":"2024-01-13T17:58:36.843391+0000","last_clean":"2024-01-13T17:58:36.843391+0000","last_became_active":"2024-01-13T17:58:36.840768+0000","last_became_peered":"2024-01-13T17:58:36.840768+0000","last_unstale":"2024-01-13T17:58:36.843391+0000","last_undegraded":"2024-01-13T17:58:36.843391+0000","last_fullsized":"2024-01-13T17:58:36.843391+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:03:26.813924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414663+0000","last_change":"2024-01-13T17:58:37.414477+0000","last_active":"2024-01-13T17:58:37.414663+0000","last_peered":"2024-01-13T17:58:37.414663+0000","last_clean":"2024-01-13T17:58:37.414663+0000","last_became_active":"2024-01-13T17:58:37.414307+0000","last_became_peered":"2024-01-13T17:58:37.414307+0000","last_unstale":"2024-01-13T17:58:37.414663+0000","last_undegraded":"2024-01-13T17:58:37.414663+0000","last_fullsized":"2024-01-13T17:58:37.414663+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:38:41.330284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828026+0000","last_change":"2024-01-13T17:58:36.839829+0000","last_active":"2024-01-13T17:58:37.828026+0000","last_peered":"2024-01-13T17:58:37.828026+0000","last_clean":"2024-01-13T17:58:37.828026+0000","last_became_active":"2024-01-13T17:58:36.839541+0000","last_became_peered":"2024-01-13T17:58:36.839541+0000","last_unstale":"2024-01-13T17:58:37.828026+0000","last_undegraded":"2024-01-13T17:58:37.828026+0000","last_fullsized":"2024-01-13T17:58:37.828026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:52:18.758870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402568+0000","last_change":"2024-01-13T17:58:37.401139+0000","last_active":"2024-01-13T17:58:37.402568+0000","last_peered":"2024-01-13T17:58:37.402568+0000","last_clean":"2024-01-13T17:58:37.402568+0000","last_became_active":"2024-01-13T17:58:37.400836+0000","last_became_peered":"2024-01-13T17:58:37.400836+0000","last_unstale":"2024-01-13T17:58:37.402568+0000","last_undegraded":"2024-01-13T17:58:37.402568+0000","last_fullsized":"2024-01-13T17:58:37.402568+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:15:29.881505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.845880+0000","last_change":"2024-01-13T17:58:36.844748+0000","last_active":"2024-01-13T17:58:36.845880+0000","last_peered":"2024-01-13T17:58:36.845880+0000","last_clean":"2024-01-13T17:58:36.845880+0000","last_became_active":"2024-01-13T17:58:36.844002+0000","last_became_peered":"2024-01-13T17:58:36.844002+0000","last_unstale":"2024-01-13T17:58:36.845880+0000","last_undegraded":"2024-01-13T17:58:36.845880+0000","last_fullsized":"2024-01-13T17:58:36.845880+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:14:57.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410381+0000","last_change":"2024-01-13T17:58:37.409079+0000","last_active":"2024-01-13T17:58:37.410381+0000","last_peered":"2024-01-13T17:58:37.410381+0000","last_clean":"2024-01-13T17:58:37.410381+0000","last_became_active":"2024-01-13T17:58:37.408807+0000","last_became_peered":"2024-01-13T17:58:37.408807+0000","last_unstale":"2024-01-13T17:58:37.410381+0000","last_undegraded":"2024-01-13T17:58:37.410381+0000","last_fullsized":"2024-01-13T17:58:37.410381+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:53:09.994807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843428+0000","last_change":"2024-01-13T17:58:36.841464+0000","last_active":"2024-01-13T17:58:36.843428+0000","last_peered":"2024-01-13T17:58:36.843428+0000","last_clean":"2024-01-13T17:58:36.843428+0000","last_became_active":"2024-01-13T17:58:36.840078+0000","last_became_peered":"2024-01-13T17:58:36.840078+0000","last_unstale":"2024-01-13T17:58:36.843428+0000","last_undegraded":"2024-01-13T17:58:36.843428+0000","last_fullsized":"2024-01-13T17:58:36.843428+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:39:59.597495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.408984+0000","last_change":"2024-01-13T17:58:37.408303+0000","last_active":"2024-01-13T17:58:37.408984+0000","last_peered":"2024-01-13T17:58:37.408984+0000","last_clean":"2024-01-13T17:58:37.408984+0000","last_became_active":"2024-01-13T17:58:37.407988+0000","last_became_peered":"2024-01-13T17:58:37.407988+0000","last_unstale":"2024-01-13T17:58:37.408984+0000","last_undegraded":"2024-01-13T17:58:37.408984+0000","last_fullsized":"2024-01-13T17:58:37.408984+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:45:25.570947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.843449+0000","last_change":"2024-01-13T17:58:36.841581+0000","last_active":"2024-01-13T17:58:36.843449+0000","last_peered":"2024-01-13T17:58:36.843449+0000","last_clean":"2024-01-13T17:58:36.843449+0000","last_became_active":"2024-01-13T17:58:36.841192+0000","last_became_peered":"2024-01-13T17:58:36.841192+0000","last_unstale":"2024-01-13T17:58:36.843449+0000","last_undegraded":"2024-01-13T17:58:36.843449+0000","last_fullsized":"2024-01-13T17:58:36.843449+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:39:05.602781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402855+0000","last_change":"2024-01-13T17:58:37.402047+0000","last_active":"2024-01-13T17:58:37.402855+0000","last_peered":"2024-01-13T17:58:37.402855+0000","last_clean":"2024-01-13T17:58:37.402855+0000","last_became_active":"2024-01-13T17:58:37.401769+0000","last_became_peered":"2024-01-13T17:58:37.401769+0000","last_unstale":"2024-01-13T17:58:37.402855+0000","last_undegraded":"2024-01-13T17:58:37.402855+0000","last_fullsized":"2024-01-13T17:58:37.402855+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:32:35.369119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"59'2","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.827128+0000","last_change":"2024-01-13T17:58:36.844613+0000","last_active":"2024-01-13T17:58:37.827128+0000","last_peered":"2024-01-13T17:58:37.827128+0000","last_clean":"2024-01-13T17:58:37.827128+0000","last_became_active":"2024-01-13T17:58:36.844286+0000","last_became_peered":"2024-01-13T17:58:36.844286+0000","last_unstale":"2024-01-13T17:58:37.827128+0000","last_undegraded":"2024-01-13T17:58:37.827128+0000","last_fullsized":"2024-01-13T17:58:37.827128+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:27:48.244809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401261+0000","last_change":"2024-01-13T17:58:37.399084+0000","last_active":"2024-01-13T17:58:37.401261+0000","last_peered":"2024-01-13T17:58:37.401261+0000","last_clean":"2024-01-13T17:58:37.401261+0000","last_became_active":"2024-01-13T17:58:37.398572+0000","last_became_peered":"2024-01-13T17:58:37.398572+0000","last_unstale":"2024-01-13T17:58:37.401261+0000","last_undegraded":"2024-01-13T17:58:37.401261+0000","last_fullsized":"2024-01-13T17:58:37.401261+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:18:41.057728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.390142+0000","last_change":"2024-01-13T17:58:36.837432+0000","last_active":"2024-01-13T17:58:37.390142+0000","last_peered":"2024-01-13T17:58:37.390142+0000","last_clean":"2024-01-13T17:58:37.390142+0000","last_became_active":"2024-01-13T17:58:36.837168+0000","last_became_peered":"2024-01-13T17:58:36.837168+0000","last_unstale":"2024-01-13T17:58:37.390142+0000","last_undegraded":"2024-01-13T17:58:37.390142+0000","last_fullsized":"2024-01-13T17:58:37.390142+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:30.125718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416032+0000","last_change":"2024-01-13T17:58:37.416032+0000","last_active":"2024-01-13T17:58:37.416032+0000","last_peered":"2024-01-13T17:58:37.416032+0000","last_clean":"2024-01-13T17:58:37.416032+0000","last_became_active":"2024-01-13T17:58:37.415759+0000","last_became_peered":"2024-01-13T17:58:37.415759+0000","last_unstale":"2024-01-13T17:58:37.416032+0000","last_undegraded":"2024-01-13T17:58:37.416032+0000","last_fullsized":"2024-01-13T17:58:37.416032+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:24.483081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-13T17:58:36.838653+0000","last_change":"2024-01-13T17:58:36.834302+0000","last_active":"2024-01-13T17:58:36.838653+0000","last_peered":"2024-01-13T17:58:36.838653+0000","last_clean":"2024-01-13T17:58:36.838653+0000","last_became_active":"2024-01-13T17:58:36.833658+0000","last_became_peered":"2024-01-13T17:58:36.833658+0000","last_unstale":"2024-01-13T17:58:36.838653+0000","last_undegraded":"2024-01-13T17:58:36.838653+0000","last_fullsized":"2024-01-13T17:58:36.838653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:13:18.505657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403231+0000","last_change":"2024-01-13T17:58:37.402650+0000","last_active":"2024-01-13T17:58:37.403231+0000","last_peered":"2024-01-13T17:58:37.403231+0000","last_clean":"2024-01-13T17:58:37.403231+0000","last_became_active":"2024-01-13T17:58:37.402128+0000","last_became_peered":"2024-01-13T17:58:37.402128+0000","last_unstale":"2024-01-13T17:58:37.403231+0000","last_undegraded":"2024-01-13T17:58:37.403231+0000","last_fullsized":"2024-01-13T17:58:37.403231+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:02:28.745789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.829297+0000","last_change":"2024-01-13T17:58:36.836861+0000","last_active":"2024-01-13T17:58:37.829297+0000","last_peered":"2024-01-13T17:58:37.829297+0000","last_clean":"2024-01-13T17:58:37.829297+0000","last_became_active":"2024-01-13T17:58:36.836593+0000","last_became_peered":"2024-01-13T17:58:36.836593+0000","last_unstale":"2024-01-13T17:58:37.829297+0000","last_undegraded":"2024-01-13T17:58:37.829297+0000","last_fullsized":"2024-01-13T17:58:37.829297+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:34:37.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414378+0000","last_change":"2024-01-13T17:58:37.414378+0000","last_active":"2024-01-13T17:58:37.414378+0000","last_peered":"2024-01-13T17:58:37.414378+0000","last_clean":"2024-01-13T17:58:37.414378+0000","last_became_active":"2024-01-13T17:58:37.414097+0000","last_became_peered":"2024-01-13T17:58:37.414097+0000","last_unstale":"2024-01-13T17:58:37.414378+0000","last_undegraded":"2024-01-13T17:58:37.414378+0000","last_fullsized":"2024-01-13T17:58:37.414378+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:45:12.430007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397973+0000","last_change":"2024-01-13T17:58:37.397227+0000","last_active":"2024-01-13T17:58:37.397973+0000","last_peered":"2024-01-13T17:58:37.397973+0000","last_clean":"2024-01-13T17:58:37.397973+0000","last_became_active":"2024-01-13T17:58:37.396928+0000","last_became_peered":"2024-01-13T17:58:37.396928+0000","last_unstale":"2024-01-13T17:58:37.397973+0000","last_undegraded":"2024-01-13T17:58:37.397973+0000","last_fullsized":"2024-01-13T17:58:37.397973+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:59:55.499543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397903+0000","last_change":"2024-01-13T17:58:37.396849+0000","last_active":"2024-01-13T17:58:37.397903+0000","last_peered":"2024-01-13T17:58:37.397903+0000","last_clean":"2024-01-13T17:58:37.397903+0000","last_became_active":"2024-01-13T17:58:37.396585+0000","last_became_peered":"2024-01-13T17:58:37.396585+0000","last_unstale":"2024-01-13T17:58:37.397903+0000","last_undegraded":"2024-01-13T17:58:37.397903+0000","last_fullsized":"2024-01-13T17:58:37.397903+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:32.529315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.404802+0000","last_change":"2024-01-13T17:58:37.403640+0000","last_active":"2024-01-13T17:58:37.404802+0000","last_peered":"2024-01-13T17:58:37.404802+0000","last_clean":"2024-01-13T17:58:37.404802+0000","last_became_active":"2024-01-13T17:58:37.403041+0000","last_became_peered":"2024-01-13T17:58:37.403041+0000","last_unstale":"2024-01-13T17:58:37.404802+0000","last_undegraded":"2024-01-13T17:58:37.404802+0000","last_fullsized":"2024-01-13T17:58:37.404802+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:37.683734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.404260+0000","last_change":"2024-01-13T17:58:37.403739+0000","last_active":"2024-01-13T17:58:37.404260+0000","last_peered":"2024-01-13T17:58:37.404260+0000","last_clean":"2024-01-13T17:58:37.404260+0000","last_became_active":"2024-01-13T17:58:37.403471+0000","last_became_peered":"2024-01-13T17:58:37.403471+0000","last_unstale":"2024-01-13T17:58:37.404260+0000","last_undegraded":"2024-01-13T17:58:37.404260+0000","last_fullsized":"2024-01-13T17:58:37.404260+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:13:50.178194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402399+0000","last_change":"2024-01-13T17:58:37.401852+0000","last_active":"2024-01-13T17:58:37.402399+0000","last_peered":"2024-01-13T17:58:37.402399+0000","last_clean":"2024-01-13T17:58:37.402399+0000","last_became_active":"2024-01-13T17:58:37.401546+0000","last_became_peered":"2024-01-13T17:58:37.401546+0000","last_unstale":"2024-01-13T17:58:37.402399+0000","last_undegraded":"2024-01-13T17:58:37.402399+0000","last_fullsized":"2024-01-13T17:58:37.402399+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:25:50.041002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.395592+0000","last_change":"2024-01-13T17:58:37.395592+0000","last_active":"2024-01-13T17:58:37.395592+0000","last_peered":"2024-01-13T17:58:37.395592+0000","last_clean":"2024-01-13T17:58:37.395592+0000","last_became_active":"2024-01-13T17:58:37.395306+0000","last_became_peered":"2024-01-13T17:58:37.395306+0000","last_unstale":"2024-01-13T17:58:37.395592+0000","last_undegraded":"2024-01-13T17:58:37.395592+0000","last_fullsized":"2024-01-13T17:58:37.395592+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:06:42.102077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410344+0000","last_change":"2024-01-13T17:58:37.409861+0000","last_active":"2024-01-13T17:58:37.410344+0000","last_peered":"2024-01-13T17:58:37.410344+0000","last_clean":"2024-01-13T17:58:37.410344+0000","last_became_active":"2024-01-13T17:58:37.409345+0000","last_became_peered":"2024-01-13T17:58:37.409345+0000","last_unstale":"2024-01-13T17:58:37.410344+0000","last_undegraded":"2024-01-13T17:58:37.410344+0000","last_fullsized":"2024-01-13T17:58:37.410344+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:00:44.773057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.406348+0000","last_change":"2024-01-13T17:58:37.402771+0000","last_active":"2024-01-13T17:58:37.406348+0000","last_peered":"2024-01-13T17:58:37.406348+0000","last_clean":"2024-01-13T17:58:37.406348+0000","last_became_active":"2024-01-13T17:58:37.402517+0000","last_became_peered":"2024-01-13T17:58:37.402517+0000","last_unstale":"2024-01-13T17:58:37.406348+0000","last_undegraded":"2024-01-13T17:58:37.406348+0000","last_fullsized":"2024-01-13T17:58:37.406348+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:14:28.931595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403255+0000","last_change":"2024-01-13T17:58:37.402590+0000","last_active":"2024-01-13T17:58:37.403255+0000","last_peered":"2024-01-13T17:58:37.403255+0000","last_clean":"2024-01-13T17:58:37.403255+0000","last_became_active":"2024-01-13T17:58:37.402233+0000","last_became_peered":"2024-01-13T17:58:37.402233+0000","last_unstale":"2024-01-13T17:58:37.403255+0000","last_undegraded":"2024-01-13T17:58:37.403255+0000","last_fullsized":"2024-01-13T17:58:37.403255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:48:51.046376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.406447+0000","last_change":"2024-01-13T17:58:37.403312+0000","last_active":"2024-01-13T17:58:37.406447+0000","last_peered":"2024-01-13T17:58:37.406447+0000","last_clean":"2024-01-13T17:58:37.406447+0000","last_became_active":"2024-01-13T17:58:37.403093+0000","last_became_peered":"2024-01-13T17:58:37.403093+0000","last_unstale":"2024-01-13T17:58:37.406447+0000","last_undegraded":"2024-01-13T17:58:37.406447+0000","last_fullsized":"2024-01-13T17:58:37.406447+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:27:24.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413388+0000","last_change":"2024-01-13T17:58:37.411533+0000","last_active":"2024-01-13T17:58:37.413388+0000","last_peered":"2024-01-13T17:58:37.413388+0000","last_clean":"2024-01-13T17:58:37.413388+0000","last_became_active":"2024-01-13T17:58:37.411192+0000","last_became_peered":"2024-01-13T17:58:37.411192+0000","last_unstale":"2024-01-13T17:58:37.413388+0000","last_undegraded":"2024-01-13T17:58:37.413388+0000","last_fullsized":"2024-01-13T17:58:37.413388+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:31:15.289987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410305+0000","last_change":"2024-01-13T17:58:37.409594+0000","last_active":"2024-01-13T17:58:37.410305+0000","last_peered":"2024-01-13T17:58:37.410305+0000","last_clean":"2024-01-13T17:58:37.410305+0000","last_became_active":"2024-01-13T17:58:37.409319+0000","last_became_peered":"2024-01-13T17:58:37.409319+0000","last_unstale":"2024-01-13T17:58:37.410305+0000","last_undegraded":"2024-01-13T17:58:37.410305+0000","last_fullsized":"2024-01-13T17:58:37.410305+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:21:11.322832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401100+0000","last_change":"2024-01-13T17:58:37.400265+0000","last_active":"2024-01-13T17:58:37.401100+0000","last_peered":"2024-01-13T17:58:37.401100+0000","last_clean":"2024-01-13T17:58:37.401100+0000","last_became_active":"2024-01-13T17:58:37.399952+0000","last_became_peered":"2024-01-13T17:58:37.399952+0000","last_unstale":"2024-01-13T17:58:37.401100+0000","last_undegraded":"2024-01-13T17:58:37.401100+0000","last_fullsized":"2024-01-13T17:58:37.401100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:04.725745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2146,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":6758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":52,"seq":223338299398,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298444,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446708,"statfs":{"total":95995035648,"available":95689428992,"internally_reserved":0,"allocated":1183744,"data_stored":834295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":6,"up_from":44,"seq":188978561032,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298460,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446692,"statfs":{"total":95995035648,"available":95689412608,"internally_reserved":0,"allocated":1200128,"data_stored":842031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297856,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447296,"statfs":{"total":95995035648,"available":95690031104,"internally_reserved":0,"allocated":581632,"data_stored":243409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.215},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.26600000000000001}]},{"osd":2,"last update":"Sat Jan 13 17:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.28100000000000003}]},{"osd":3,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.248},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298468,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446684,"statfs":{"total":95995035648,"available":95689404416,"internally_reserved":0,"allocated":1208320,"data_stored":841460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 13 17:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Jan 13 17:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Jan 13 17:58:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.309}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411351,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447280,"statfs":{"total":95995035648,"available":95690014720,"internally_reserved":0,"allocated":598016,"data_stored":250392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.437},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.316}]},{"osd":1,"last update":"Sat Jan 13 17:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.38}]},{"osd":3,"last update":"Sat Jan 13 17:58:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.621},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182420,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447260,"statfs":{"total":95995035648,"available":95689994240,"internally_reserved":0,"allocated":618496,"data_stored":252032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.375}]},{"osd":1,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.27100000000000002}]},{"osd":2,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.318},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":4,"up_from":30,"seq":128849018896,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297888,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447264,"statfs":{"total":95995035648,"available":95689998336,"internally_reserved":0,"allocated":614400,"data_stored":251072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.377},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.58899999999999997}]},{"osd":2,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":5,"up_from":37,"seq":158913789964,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297876,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447276,"statfs":{"total":95995035648,"available":95690010624,"internally_reserved":0,"allocated":602112,"data_stored":245300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-13T17:58:43.619 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 17:58:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-b[104423]: 2024-01-13T17:58:43.225+0000 7f97c5e7b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-13T17:58:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:43 smithi099 ceph-mon[71325]: from='client.24458 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:43 smithi099 ceph-mon[71325]: pgmap v149: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s wr, 6 op/s 2024-01-13T17:58:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:43 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3946177594' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-01-13T17:58:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:43 smithi099 ceph-mon[71325]: from='client.14571 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:44.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:43 smithi084 ceph-mon[37908]: from='client.24458 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:44.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:43 smithi084 ceph-mon[37908]: pgmap v149: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s wr, 6 op/s 2024-01-13T17:58:44.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:43 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3946177594' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-01-13T17:58:44.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:43 smithi084 ceph-mon[37908]: from='client.14571 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:44.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:43 smithi084 ceph-mon[52328]: from='client.24458 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:44.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:43 smithi084 ceph-mon[52328]: pgmap v149: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s wr, 6 op/s 2024-01-13T17:58:44.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:43 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3946177594' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-01-13T17:58:44.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:43 smithi084 ceph-mon[52328]: from='client.14571 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:46.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:46 smithi099 ceph-mon[71325]: pgmap v150: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-01-13T17:58:46.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-13T17:58:46.403 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:46 smithi084 ceph-mon[37908]: pgmap v150: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-01-13T17:58:46.404 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:46 smithi084 ceph-mon[52328]: pgmap v150: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-01-13T17:58:46.702 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:58:46.704 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-01-13T17:58:46.713 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-01-13T17:58:44.782241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2384800,"kb_used_data":6496,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":747576416,"statfs":{"total":767960285184,"available":765518249984,"internally_reserved":0,"allocated":6651904,"data_stored":3780305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.964220"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416820+0000","last_change":"2024-01-13T17:58:37.416080+0000","last_active":"2024-01-13T17:58:37.416820+0000","last_peered":"2024-01-13T17:58:37.416820+0000","last_clean":"2024-01-13T17:58:37.416820+0000","last_became_active":"2024-01-13T17:58:37.415621+0000","last_became_peered":"2024-01-13T17:58:37.415621+0000","last_unstale":"2024-01-13T17:58:37.416820+0000","last_undegraded":"2024-01-13T17:58:37.416820+0000","last_fullsized":"2024-01-13T17:58:37.416820+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:40.991399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.400253+0000","last_change":"2024-01-13T17:58:37.398891+0000","last_active":"2024-01-13T17:58:37.400253+0000","last_peered":"2024-01-13T17:58:37.400253+0000","last_clean":"2024-01-13T17:58:37.400253+0000","last_became_active":"2024-01-13T17:58:37.398476+0000","last_became_peered":"2024-01-13T17:58:37.398476+0000","last_unstale":"2024-01-13T17:58:37.400253+0000","last_undegraded":"2024-01-13T17:58:37.400253+0000","last_fullsized":"2024-01-13T17:58:37.400253+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:05:39.892184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.400191+0000","last_change":"2024-01-13T17:58:37.399839+0000","last_active":"2024-01-13T17:58:37.400191+0000","last_peered":"2024-01-13T17:58:37.400191+0000","last_clean":"2024-01-13T17:58:37.400191+0000","last_became_active":"2024-01-13T17:58:37.399578+0000","last_became_peered":"2024-01-13T17:58:37.399578+0000","last_unstale":"2024-01-13T17:58:37.400191+0000","last_undegraded":"2024-01-13T17:58:37.400191+0000","last_fullsized":"2024-01-13T17:58:37.400191+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:36:22.906393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413370+0000","last_change":"2024-01-13T17:58:37.411528+0000","last_active":"2024-01-13T17:58:37.413370+0000","last_peered":"2024-01-13T17:58:37.413370+0000","last_clean":"2024-01-13T17:58:37.413370+0000","last_became_active":"2024-01-13T17:58:37.411056+0000","last_became_peered":"2024-01-13T17:58:37.411056+0000","last_unstale":"2024-01-13T17:58:37.413370+0000","last_undegraded":"2024-01-13T17:58:37.413370+0000","last_fullsized":"2024-01-13T17:58:37.413370+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:13:24.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416787+0000","last_change":"2024-01-13T17:58:37.415953+0000","last_active":"2024-01-13T17:58:37.416787+0000","last_peered":"2024-01-13T17:58:37.416787+0000","last_clean":"2024-01-13T17:58:37.416787+0000","last_became_active":"2024-01-13T17:58:37.413825+0000","last_became_peered":"2024-01-13T17:58:37.413825+0000","last_unstale":"2024-01-13T17:58:37.416787+0000","last_undegraded":"2024-01-13T17:58:37.416787+0000","last_fullsized":"2024-01-13T17:58:37.416787+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:04:08.326020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402618+0000","last_change":"2024-01-13T17:58:37.399699+0000","last_active":"2024-01-13T17:58:37.402618+0000","last_peered":"2024-01-13T17:58:37.402618+0000","last_clean":"2024-01-13T17:58:37.402618+0000","last_became_active":"2024-01-13T17:58:37.399358+0000","last_became_peered":"2024-01-13T17:58:37.399358+0000","last_unstale":"2024-01-13T17:58:37.402618+0000","last_undegraded":"2024-01-13T17:58:37.402618+0000","last_fullsized":"2024-01-13T17:58:37.402618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:18.403109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414902+0000","last_change":"2024-01-13T17:58:37.413121+0000","last_active":"2024-01-13T17:58:37.414902+0000","last_peered":"2024-01-13T17:58:37.414902+0000","last_clean":"2024-01-13T17:58:37.414902+0000","last_became_active":"2024-01-13T17:58:37.412816+0000","last_became_peered":"2024-01-13T17:58:37.412816+0000","last_unstale":"2024-01-13T17:58:37.414902+0000","last_undegraded":"2024-01-13T17:58:37.414902+0000","last_fullsized":"2024-01-13T17:58:37.414902+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:05.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397118+0000","last_change":"2024-01-13T17:58:37.393602+0000","last_active":"2024-01-13T17:58:37.397118+0000","last_peered":"2024-01-13T17:58:37.397118+0000","last_clean":"2024-01-13T17:58:37.397118+0000","last_became_active":"2024-01-13T17:58:37.393317+0000","last_became_peered":"2024-01-13T17:58:37.393317+0000","last_unstale":"2024-01-13T17:58:37.397118+0000","last_undegraded":"2024-01-13T17:58:37.397118+0000","last_fullsized":"2024-01-13T17:58:37.397118+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:14:00.225985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416944+0000","last_change":"2024-01-13T17:58:37.416421+0000","last_active":"2024-01-13T17:58:37.416944+0000","last_peered":"2024-01-13T17:58:37.416944+0000","last_clean":"2024-01-13T17:58:37.416944+0000","last_became_active":"2024-01-13T17:58:37.416138+0000","last_became_peered":"2024-01-13T17:58:37.416138+0000","last_unstale":"2024-01-13T17:58:37.416944+0000","last_undegraded":"2024-01-13T17:58:37.416944+0000","last_fullsized":"2024-01-13T17:58:37.416944+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:10:51.751719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.400786+0000","last_change":"2024-01-13T17:58:37.397837+0000","last_active":"2024-01-13T17:58:37.400786+0000","last_peered":"2024-01-13T17:58:37.400786+0000","last_clean":"2024-01-13T17:58:37.400786+0000","last_became_active":"2024-01-13T17:58:37.397557+0000","last_became_peered":"2024-01-13T17:58:37.397557+0000","last_unstale":"2024-01-13T17:58:37.400786+0000","last_undegraded":"2024-01-13T17:58:37.400786+0000","last_fullsized":"2024-01-13T17:58:37.400786+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:38:02.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397989+0000","last_change":"2024-01-13T17:58:37.397136+0000","last_active":"2024-01-13T17:58:37.397989+0000","last_peered":"2024-01-13T17:58:37.397989+0000","last_clean":"2024-01-13T17:58:37.397989+0000","last_became_active":"2024-01-13T17:58:37.396796+0000","last_became_peered":"2024-01-13T17:58:37.396796+0000","last_unstale":"2024-01-13T17:58:37.397989+0000","last_undegraded":"2024-01-13T17:58:37.397989+0000","last_fullsized":"2024-01-13T17:58:37.397989+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:09:37.651466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403379+0000","last_change":"2024-01-13T17:58:37.401738+0000","last_active":"2024-01-13T17:58:37.403379+0000","last_peered":"2024-01-13T17:58:37.403379+0000","last_clean":"2024-01-13T17:58:37.403379+0000","last_became_active":"2024-01-13T17:58:37.401390+0000","last_became_peered":"2024-01-13T17:58:37.401390+0000","last_unstale":"2024-01-13T17:58:37.403379+0000","last_undegraded":"2024-01-13T17:58:37.403379+0000","last_fullsized":"2024-01-13T17:58:37.403379+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:10:08.882123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410911+0000","last_change":"2024-01-13T17:58:37.410693+0000","last_active":"2024-01-13T17:58:37.410911+0000","last_peered":"2024-01-13T17:58:37.410911+0000","last_clean":"2024-01-13T17:58:37.410911+0000","last_became_active":"2024-01-13T17:58:37.410478+0000","last_became_peered":"2024-01-13T17:58:37.410478+0000","last_unstale":"2024-01-13T17:58:37.410911+0000","last_undegraded":"2024-01-13T17:58:37.410911+0000","last_fullsized":"2024-01-13T17:58:37.410911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:54:26.505663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.400065+0000","last_change":"2024-01-13T17:58:37.399587+0000","last_active":"2024-01-13T17:58:37.400065+0000","last_peered":"2024-01-13T17:58:37.400065+0000","last_clean":"2024-01-13T17:58:37.400065+0000","last_became_active":"2024-01-13T17:58:37.399266+0000","last_became_peered":"2024-01-13T17:58:37.399266+0000","last_unstale":"2024-01-13T17:58:37.400065+0000","last_undegraded":"2024-01-13T17:58:37.400065+0000","last_fullsized":"2024-01-13T17:58:37.400065+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:45:41.896344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.398352+0000","last_change":"2024-01-13T17:58:37.394829+0000","last_active":"2024-01-13T17:58:37.398352+0000","last_peered":"2024-01-13T17:58:37.398352+0000","last_clean":"2024-01-13T17:58:37.398352+0000","last_became_active":"2024-01-13T17:58:37.394582+0000","last_became_peered":"2024-01-13T17:58:37.394582+0000","last_unstale":"2024-01-13T17:58:37.398352+0000","last_undegraded":"2024-01-13T17:58:37.398352+0000","last_fullsized":"2024-01-13T17:58:37.398352+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:52:38.944942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413457+0000","last_change":"2024-01-13T17:58:37.412247+0000","last_active":"2024-01-13T17:58:37.413457+0000","last_peered":"2024-01-13T17:58:37.413457+0000","last_clean":"2024-01-13T17:58:37.413457+0000","last_became_active":"2024-01-13T17:58:37.411947+0000","last_became_peered":"2024-01-13T17:58:37.411947+0000","last_unstale":"2024-01-13T17:58:37.413457+0000","last_undegraded":"2024-01-13T17:58:37.413457+0000","last_fullsized":"2024-01-13T17:58:37.413457+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:05:19.184972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413437+0000","last_change":"2024-01-13T17:58:37.411858+0000","last_active":"2024-01-13T17:58:37.413437+0000","last_peered":"2024-01-13T17:58:37.413437+0000","last_clean":"2024-01-13T17:58:37.413437+0000","last_became_active":"2024-01-13T17:58:37.411559+0000","last_became_peered":"2024-01-13T17:58:37.411559+0000","last_unstale":"2024-01-13T17:58:37.413437+0000","last_undegraded":"2024-01-13T17:58:37.413437+0000","last_fullsized":"2024-01-13T17:58:37.413437+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:00:40.870815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.409351+0000","last_change":"2024-01-13T17:58:37.409078+0000","last_active":"2024-01-13T17:58:37.409351+0000","last_peered":"2024-01-13T17:58:37.409351+0000","last_clean":"2024-01-13T17:58:37.409351+0000","last_became_active":"2024-01-13T17:58:37.408820+0000","last_became_peered":"2024-01-13T17:58:37.408820+0000","last_unstale":"2024-01-13T17:58:37.409351+0000","last_undegraded":"2024-01-13T17:58:37.409351+0000","last_fullsized":"2024-01-13T17:58:37.409351+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:30:37.097173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.415515+0000","last_change":"2024-01-13T17:58:37.414485+0000","last_active":"2024-01-13T17:58:37.415515+0000","last_peered":"2024-01-13T17:58:37.415515+0000","last_clean":"2024-01-13T17:58:37.415515+0000","last_became_active":"2024-01-13T17:58:37.414182+0000","last_became_peered":"2024-01-13T17:58:37.414182+0000","last_unstale":"2024-01-13T17:58:37.415515+0000","last_undegraded":"2024-01-13T17:58:37.415515+0000","last_fullsized":"2024-01-13T17:58:37.415515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:08:50.844685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"59'4","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.830230+0000","last_change":"2024-01-13T17:58:36.839635+0000","last_active":"2024-01-13T17:58:37.830230+0000","last_peered":"2024-01-13T17:58:37.830230+0000","last_clean":"2024-01-13T17:58:37.830230+0000","last_became_active":"2024-01-13T17:58:36.839344+0000","last_became_peered":"2024-01-13T17:58:36.839344+0000","last_unstale":"2024-01-13T17:58:37.830230+0000","last_undegraded":"2024-01-13T17:58:37.830230+0000","last_fullsized":"2024-01-13T17:58:37.830230+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:41:18.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.406885+0000","last_change":"2024-01-13T17:58:37.403720+0000","last_active":"2024-01-13T17:58:37.406885+0000","last_peered":"2024-01-13T17:58:37.406885+0000","last_clean":"2024-01-13T17:58:37.406885+0000","last_became_active":"2024-01-13T17:58:37.403390+0000","last_became_peered":"2024-01-13T17:58:37.403390+0000","last_unstale":"2024-01-13T17:58:37.406885+0000","last_undegraded":"2024-01-13T17:58:37.406885+0000","last_fullsized":"2024-01-13T17:58:37.406885+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:38:09.594828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828439+0000","last_change":"2024-01-13T17:58:36.846725+0000","last_active":"2024-01-13T17:58:37.828439+0000","last_peered":"2024-01-13T17:58:37.828439+0000","last_clean":"2024-01-13T17:58:37.828439+0000","last_became_active":"2024-01-13T17:58:36.846375+0000","last_became_peered":"2024-01-13T17:58:36.846375+0000","last_unstale":"2024-01-13T17:58:37.828439+0000","last_undegraded":"2024-01-13T17:58:37.828439+0000","last_fullsized":"2024-01-13T17:58:37.828439+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:06:04.006535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.396286+0000","last_change":"2024-01-13T17:58:37.395186+0000","last_active":"2024-01-13T17:58:37.396286+0000","last_peered":"2024-01-13T17:58:37.396286+0000","last_clean":"2024-01-13T17:58:37.396286+0000","last_became_active":"2024-01-13T17:58:37.394880+0000","last_became_peered":"2024-01-13T17:58:37.394880+0000","last_unstale":"2024-01-13T17:58:37.396286+0000","last_undegraded":"2024-01-13T17:58:37.396286+0000","last_fullsized":"2024-01-13T17:58:37.396286+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:02:59.539263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828469+0000","last_change":"2024-01-13T17:58:36.845520+0000","last_active":"2024-01-13T17:58:37.828469+0000","last_peered":"2024-01-13T17:58:37.828469+0000","last_clean":"2024-01-13T17:58:37.828469+0000","last_became_active":"2024-01-13T17:58:36.845229+0000","last_became_peered":"2024-01-13T17:58:36.845229+0000","last_unstale":"2024-01-13T17:58:37.828469+0000","last_undegraded":"2024-01-13T17:58:37.828469+0000","last_fullsized":"2024-01-13T17:58:37.828469+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:08:01.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401963+0000","last_change":"2024-01-13T17:58:37.400143+0000","last_active":"2024-01-13T17:58:37.401963+0000","last_peered":"2024-01-13T17:58:37.401963+0000","last_clean":"2024-01-13T17:58:37.401963+0000","last_became_active":"2024-01-13T17:58:37.399689+0000","last_became_peered":"2024-01-13T17:58:37.399689+0000","last_unstale":"2024-01-13T17:58:37.401963+0000","last_undegraded":"2024-01-13T17:58:37.401963+0000","last_fullsized":"2024-01-13T17:58:37.401963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:32:04.518468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828317+0000","last_change":"2024-01-13T17:58:36.843954+0000","last_active":"2024-01-13T17:58:37.828317+0000","last_peered":"2024-01-13T17:58:37.828317+0000","last_clean":"2024-01-13T17:58:37.828317+0000","last_became_active":"2024-01-13T17:58:36.843616+0000","last_became_peered":"2024-01-13T17:58:36.843616+0000","last_unstale":"2024-01-13T17:58:37.828317+0000","last_undegraded":"2024-01-13T17:58:37.828317+0000","last_fullsized":"2024-01-13T17:58:37.828317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:37:08.466053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401894+0000","last_change":"2024-01-13T17:58:37.399242+0000","last_active":"2024-01-13T17:58:37.401894+0000","last_peered":"2024-01-13T17:58:37.401894+0000","last_clean":"2024-01-13T17:58:37.401894+0000","last_became_active":"2024-01-13T17:58:37.398793+0000","last_became_peered":"2024-01-13T17:58:37.398793+0000","last_unstale":"2024-01-13T17:58:37.401894+0000","last_undegraded":"2024-01-13T17:58:37.401894+0000","last_fullsized":"2024-01-13T17:58:37.401894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:05:43.194645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.827757+0000","last_change":"2024-01-13T17:58:36.838743+0000","last_active":"2024-01-13T17:58:37.827757+0000","last_peered":"2024-01-13T17:58:37.827757+0000","last_clean":"2024-01-13T17:58:37.827757+0000","last_became_active":"2024-01-13T17:58:36.838444+0000","last_became_peered":"2024-01-13T17:58:36.838444+0000","last_unstale":"2024-01-13T17:58:37.827757+0000","last_undegraded":"2024-01-13T17:58:37.827757+0000","last_fullsized":"2024-01-13T17:58:37.827757+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:48:37.841281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403108+0000","last_change":"2024-01-13T17:58:37.401094+0000","last_active":"2024-01-13T17:58:37.403108+0000","last_peered":"2024-01-13T17:58:37.403108+0000","last_clean":"2024-01-13T17:58:37.403108+0000","last_became_active":"2024-01-13T17:58:37.400621+0000","last_became_peered":"2024-01-13T17:58:37.400621+0000","last_unstale":"2024-01-13T17:58:37.403108+0000","last_undegraded":"2024-01-13T17:58:37.403108+0000","last_fullsized":"2024-01-13T17:58:37.403108+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:15:46.371336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.827927+0000","last_change":"2024-01-13T17:58:36.832810+0000","last_active":"2024-01-13T17:58:37.827927+0000","last_peered":"2024-01-13T17:58:37.827927+0000","last_clean":"2024-01-13T17:58:37.827927+0000","last_became_active":"2024-01-13T17:58:36.831491+0000","last_became_peered":"2024-01-13T17:58:36.831491+0000","last_unstale":"2024-01-13T17:58:37.827927+0000","last_undegraded":"2024-01-13T17:58:37.827927+0000","last_fullsized":"2024-01-13T17:58:37.827927+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:50:10.505869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410260+0000","last_change":"2024-01-13T17:58:37.408148+0000","last_active":"2024-01-13T17:58:37.410260+0000","last_peered":"2024-01-13T17:58:37.410260+0000","last_clean":"2024-01-13T17:58:37.410260+0000","last_became_active":"2024-01-13T17:58:37.407858+0000","last_became_peered":"2024-01-13T17:58:37.407858+0000","last_unstale":"2024-01-13T17:58:37.410260+0000","last_undegraded":"2024-01-13T17:58:37.410260+0000","last_fullsized":"2024-01-13T17:58:37.410260+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:35:47.284096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.386361+0000","last_change":"2024-01-13T17:58:36.843139+0000","last_active":"2024-01-13T17:58:37.386361+0000","last_peered":"2024-01-13T17:58:37.386361+0000","last_clean":"2024-01-13T17:58:37.386361+0000","last_became_active":"2024-01-13T17:58:36.842487+0000","last_became_peered":"2024-01-13T17:58:36.842487+0000","last_unstale":"2024-01-13T17:58:37.386361+0000","last_undegraded":"2024-01-13T17:58:37.386361+0000","last_fullsized":"2024-01-13T17:58:37.386361+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:28:01.688683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402273+0000","last_change":"2024-01-13T17:58:37.401772+0000","last_active":"2024-01-13T17:58:37.402273+0000","last_peered":"2024-01-13T17:58:37.402273+0000","last_clean":"2024-01-13T17:58:37.402273+0000","last_became_active":"2024-01-13T17:58:37.401490+0000","last_became_peered":"2024-01-13T17:58:37.401490+0000","last_unstale":"2024-01-13T17:58:37.402273+0000","last_undegraded":"2024-01-13T17:58:37.402273+0000","last_fullsized":"2024-01-13T17:58:37.402273+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:32:13.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389767+0000","last_change":"2024-01-13T17:58:36.842527+0000","last_active":"2024-01-13T17:58:37.389767+0000","last_peered":"2024-01-13T17:58:37.389767+0000","last_clean":"2024-01-13T17:58:37.389767+0000","last_became_active":"2024-01-13T17:58:36.841820+0000","last_became_peered":"2024-01-13T17:58:36.841820+0000","last_unstale":"2024-01-13T17:58:37.389767+0000","last_undegraded":"2024-01-13T17:58:37.389767+0000","last_fullsized":"2024-01-13T17:58:37.389767+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:02.120533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.398335+0000","last_change":"2024-01-13T17:58:37.393987+0000","last_active":"2024-01-13T17:58:37.398335+0000","last_peered":"2024-01-13T17:58:37.398335+0000","last_clean":"2024-01-13T17:58:37.398335+0000","last_became_active":"2024-01-13T17:58:37.393657+0000","last_became_peered":"2024-01-13T17:58:37.393657+0000","last_unstale":"2024-01-13T17:58:37.398335+0000","last_undegraded":"2024-01-13T17:58:37.398335+0000","last_fullsized":"2024-01-13T17:58:37.398335+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:44.818236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.385390+0000","last_change":"2024-01-13T17:58:36.843560+0000","last_active":"2024-01-13T17:58:37.385390+0000","last_peered":"2024-01-13T17:58:37.385390+0000","last_clean":"2024-01-13T17:58:37.385390+0000","last_became_active":"2024-01-13T17:58:36.843290+0000","last_became_peered":"2024-01-13T17:58:36.843290+0000","last_unstale":"2024-01-13T17:58:37.385390+0000","last_undegraded":"2024-01-13T17:58:37.385390+0000","last_fullsized":"2024-01-13T17:58:37.385390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:12:58.012752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413415+0000","last_change":"2024-01-13T17:58:37.412880+0000","last_active":"2024-01-13T17:58:37.413415+0000","last_peered":"2024-01-13T17:58:37.413415+0000","last_clean":"2024-01-13T17:58:37.413415+0000","last_became_active":"2024-01-13T17:58:37.412519+0000","last_became_peered":"2024-01-13T17:58:37.412519+0000","last_unstale":"2024-01-13T17:58:37.413415+0000","last_undegraded":"2024-01-13T17:58:37.413415+0000","last_fullsized":"2024-01-13T17:58:37.413415+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:40:03.956715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389488+0000","last_change":"2024-01-13T17:58:36.841704+0000","last_active":"2024-01-13T17:58:37.389488+0000","last_peered":"2024-01-13T17:58:37.389488+0000","last_clean":"2024-01-13T17:58:37.389488+0000","last_became_active":"2024-01-13T17:58:36.841409+0000","last_became_peered":"2024-01-13T17:58:36.841409+0000","last_unstale":"2024-01-13T17:58:37.389488+0000","last_undegraded":"2024-01-13T17:58:37.389488+0000","last_fullsized":"2024-01-13T17:58:37.389488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:56:02.964249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403926+0000","last_change":"2024-01-13T17:58:37.403381+0000","last_active":"2024-01-13T17:58:37.403926+0000","last_peered":"2024-01-13T17:58:37.403926+0000","last_clean":"2024-01-13T17:58:37.403926+0000","last_became_active":"2024-01-13T17:58:37.403108+0000","last_became_peered":"2024-01-13T17:58:37.403108+0000","last_unstale":"2024-01-13T17:58:37.403926+0000","last_undegraded":"2024-01-13T17:58:37.403926+0000","last_fullsized":"2024-01-13T17:58:37.403926+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:55:07.654474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"59'3","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828592+0000","last_change":"2024-01-13T17:58:36.835474+0000","last_active":"2024-01-13T17:58:37.828592+0000","last_peered":"2024-01-13T17:58:37.828592+0000","last_clean":"2024-01-13T17:58:37.828592+0000","last_became_active":"2024-01-13T17:58:36.835169+0000","last_became_peered":"2024-01-13T17:58:36.835169+0000","last_unstale":"2024-01-13T17:58:37.828592+0000","last_undegraded":"2024-01-13T17:58:37.828592+0000","last_fullsized":"2024-01-13T17:58:37.828592+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:02:02.178682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.407791+0000","last_change":"2024-01-13T17:58:37.407252+0000","last_active":"2024-01-13T17:58:37.407791+0000","last_peered":"2024-01-13T17:58:37.407791+0000","last_clean":"2024-01-13T17:58:37.407791+0000","last_became_active":"2024-01-13T17:58:37.406352+0000","last_became_peered":"2024-01-13T17:58:37.406352+0000","last_unstale":"2024-01-13T17:58:37.407791+0000","last_undegraded":"2024-01-13T17:58:37.407791+0000","last_fullsized":"2024-01-13T17:58:37.407791+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:21:50.223964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"59'6","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.830644+0000","last_change":"2024-01-13T17:58:36.836500+0000","last_active":"2024-01-13T17:58:37.830644+0000","last_peered":"2024-01-13T17:58:37.830644+0000","last_clean":"2024-01-13T17:58:37.830644+0000","last_became_active":"2024-01-13T17:58:36.836231+0000","last_became_peered":"2024-01-13T17:58:36.836231+0000","last_unstale":"2024-01-13T17:58:37.830644+0000","last_undegraded":"2024-01-13T17:58:37.830644+0000","last_fullsized":"2024-01-13T17:58:37.830644+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:40:58.818088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413893+0000","last_change":"2024-01-13T17:58:37.409657+0000","last_active":"2024-01-13T17:58:37.413893+0000","last_peered":"2024-01-13T17:58:37.413893+0000","last_clean":"2024-01-13T17:58:37.413893+0000","last_became_active":"2024-01-13T17:58:37.409373+0000","last_became_peered":"2024-01-13T17:58:37.409373+0000","last_unstale":"2024-01-13T17:58:37.413893+0000","last_undegraded":"2024-01-13T17:58:37.413893+0000","last_fullsized":"2024-01-13T17:58:37.413893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:04.184668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.830184+0000","last_change":"2024-01-13T17:58:36.841243+0000","last_active":"2024-01-13T17:58:37.830184+0000","last_peered":"2024-01-13T17:58:37.830184+0000","last_clean":"2024-01-13T17:58:37.830184+0000","last_became_active":"2024-01-13T17:58:36.840803+0000","last_became_peered":"2024-01-13T17:58:36.840803+0000","last_unstale":"2024-01-13T17:58:37.830184+0000","last_undegraded":"2024-01-13T17:58:37.830184+0000","last_fullsized":"2024-01-13T17:58:37.830184+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:02:14.255922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410296+0000","last_change":"2024-01-13T17:58:37.409006+0000","last_active":"2024-01-13T17:58:37.410296+0000","last_peered":"2024-01-13T17:58:37.410296+0000","last_clean":"2024-01-13T17:58:37.410296+0000","last_became_active":"2024-01-13T17:58:37.408736+0000","last_became_peered":"2024-01-13T17:58:37.408736+0000","last_unstale":"2024-01-13T17:58:37.410296+0000","last_undegraded":"2024-01-13T17:58:37.410296+0000","last_fullsized":"2024-01-13T17:58:37.410296+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:10:11.734133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.391748+0000","last_change":"2024-01-13T17:58:36.841162+0000","last_active":"2024-01-13T17:58:37.391748+0000","last_peered":"2024-01-13T17:58:37.391748+0000","last_clean":"2024-01-13T17:58:37.391748+0000","last_became_active":"2024-01-13T17:58:36.840845+0000","last_became_peered":"2024-01-13T17:58:36.840845+0000","last_unstale":"2024-01-13T17:58:37.391748+0000","last_undegraded":"2024-01-13T17:58:37.391748+0000","last_fullsized":"2024-01-13T17:58:37.391748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:56:48.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.415904+0000","last_change":"2024-01-13T17:58:37.414263+0000","last_active":"2024-01-13T17:58:37.415904+0000","last_peered":"2024-01-13T17:58:37.415904+0000","last_clean":"2024-01-13T17:58:37.415904+0000","last_became_active":"2024-01-13T17:58:37.410388+0000","last_became_peered":"2024-01-13T17:58:37.410388+0000","last_unstale":"2024-01-13T17:58:37.415904+0000","last_undegraded":"2024-01-13T17:58:37.415904+0000","last_fullsized":"2024-01-13T17:58:37.415904+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:55:00.346625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.385253+0000","last_change":"2024-01-13T17:58:36.834846+0000","last_active":"2024-01-13T17:58:37.385253+0000","last_peered":"2024-01-13T17:58:37.385253+0000","last_clean":"2024-01-13T17:58:37.385253+0000","last_became_active":"2024-01-13T17:58:36.834531+0000","last_became_peered":"2024-01-13T17:58:36.834531+0000","last_unstale":"2024-01-13T17:58:37.385253+0000","last_undegraded":"2024-01-13T17:58:37.385253+0000","last_fullsized":"2024-01-13T17:58:37.385253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:12:41.632590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.396357+0000","last_change":"2024-01-13T17:58:37.394865+0000","last_active":"2024-01-13T17:58:37.396357+0000","last_peered":"2024-01-13T17:58:37.396357+0000","last_clean":"2024-01-13T17:58:37.396357+0000","last_became_active":"2024-01-13T17:58:37.394490+0000","last_became_peered":"2024-01-13T17:58:37.394490+0000","last_unstale":"2024-01-13T17:58:37.396357+0000","last_undegraded":"2024-01-13T17:58:37.396357+0000","last_fullsized":"2024-01-13T17:58:37.396357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:04:30.784006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"59'8","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.829812+0000","last_change":"2024-01-13T17:58:36.831518+0000","last_active":"2024-01-13T17:58:37.829812+0000","last_peered":"2024-01-13T17:58:37.829812+0000","last_clean":"2024-01-13T17:58:37.829812+0000","last_became_active":"2024-01-13T17:58:36.831252+0000","last_became_peered":"2024-01-13T17:58:36.831252+0000","last_unstale":"2024-01-13T17:58:37.829812+0000","last_undegraded":"2024-01-13T17:58:37.829812+0000","last_fullsized":"2024-01-13T17:58:37.829812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:42:53.797821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.415590+0000","last_change":"2024-01-13T17:58:37.414840+0000","last_active":"2024-01-13T17:58:37.415590+0000","last_peered":"2024-01-13T17:58:37.415590+0000","last_clean":"2024-01-13T17:58:37.415590+0000","last_became_active":"2024-01-13T17:58:37.414540+0000","last_became_peered":"2024-01-13T17:58:37.414540+0000","last_unstale":"2024-01-13T17:58:37.415590+0000","last_undegraded":"2024-01-13T17:58:37.415590+0000","last_fullsized":"2024-01-13T17:58:37.415590+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:57.534623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828801+0000","last_change":"2024-01-13T17:58:36.831411+0000","last_active":"2024-01-13T17:58:37.828801+0000","last_peered":"2024-01-13T17:58:37.828801+0000","last_clean":"2024-01-13T17:58:37.828801+0000","last_became_active":"2024-01-13T17:58:36.831126+0000","last_became_peered":"2024-01-13T17:58:36.831126+0000","last_unstale":"2024-01-13T17:58:37.828801+0000","last_undegraded":"2024-01-13T17:58:37.828801+0000","last_fullsized":"2024-01-13T17:58:37.828801+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:12:48.869393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414656+0000","last_change":"2024-01-13T17:58:37.408885+0000","last_active":"2024-01-13T17:58:37.414656+0000","last_peered":"2024-01-13T17:58:37.414656+0000","last_clean":"2024-01-13T17:58:37.414656+0000","last_became_active":"2024-01-13T17:58:37.408618+0000","last_became_peered":"2024-01-13T17:58:37.408618+0000","last_unstale":"2024-01-13T17:58:37.414656+0000","last_undegraded":"2024-01-13T17:58:37.414656+0000","last_fullsized":"2024-01-13T17:58:37.414656+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:18:38.241218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.384827+0000","last_change":"2024-01-13T17:58:36.832399+0000","last_active":"2024-01-13T17:58:37.384827+0000","last_peered":"2024-01-13T17:58:37.384827+0000","last_clean":"2024-01-13T17:58:37.384827+0000","last_became_active":"2024-01-13T17:58:36.832100+0000","last_became_peered":"2024-01-13T17:58:36.832100+0000","last_unstale":"2024-01-13T17:58:37.384827+0000","last_undegraded":"2024-01-13T17:58:37.384827+0000","last_fullsized":"2024-01-13T17:58:37.384827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:01:50.555635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403256+0000","last_change":"2024-01-13T17:58:37.402741+0000","last_active":"2024-01-13T17:58:37.403256+0000","last_peered":"2024-01-13T17:58:37.403256+0000","last_clean":"2024-01-13T17:58:37.403256+0000","last_became_active":"2024-01-13T17:58:37.402379+0000","last_became_peered":"2024-01-13T17:58:37.402379+0000","last_unstale":"2024-01-13T17:58:37.403256+0000","last_undegraded":"2024-01-13T17:58:37.403256+0000","last_fullsized":"2024-01-13T17:58:37.403256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:30:51.621102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.391644+0000","last_change":"2024-01-13T17:58:36.836469+0000","last_active":"2024-01-13T17:58:37.391644+0000","last_peered":"2024-01-13T17:58:37.391644+0000","last_clean":"2024-01-13T17:58:37.391644+0000","last_became_active":"2024-01-13T17:58:36.836161+0000","last_became_peered":"2024-01-13T17:58:36.836161+0000","last_unstale":"2024-01-13T17:58:37.391644+0000","last_undegraded":"2024-01-13T17:58:37.391644+0000","last_fullsized":"2024-01-13T17:58:37.391644+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:00:00.583677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.412101+0000","last_change":"2024-01-13T17:58:37.411383+0000","last_active":"2024-01-13T17:58:37.412101+0000","last_peered":"2024-01-13T17:58:37.412101+0000","last_clean":"2024-01-13T17:58:37.412101+0000","last_became_active":"2024-01-13T17:58:37.411086+0000","last_became_peered":"2024-01-13T17:58:37.411086+0000","last_unstale":"2024-01-13T17:58:37.412101+0000","last_undegraded":"2024-01-13T17:58:37.412101+0000","last_fullsized":"2024-01-13T17:58:37.412101+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:29:49.851426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.398229+0000","last_change":"2024-01-13T17:58:37.395912+0000","last_active":"2024-01-13T17:58:37.398229+0000","last_peered":"2024-01-13T17:58:37.398229+0000","last_clean":"2024-01-13T17:58:37.398229+0000","last_became_active":"2024-01-13T17:58:37.395625+0000","last_became_peered":"2024-01-13T17:58:37.395625+0000","last_unstale":"2024-01-13T17:58:37.398229+0000","last_undegraded":"2024-01-13T17:58:37.398229+0000","last_fullsized":"2024-01-13T17:58:37.398229+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:28.565536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.390273+0000","last_change":"2024-01-13T17:58:36.839719+0000","last_active":"2024-01-13T17:58:37.390273+0000","last_peered":"2024-01-13T17:58:37.390273+0000","last_clean":"2024-01-13T17:58:37.390273+0000","last_became_active":"2024-01-13T17:58:36.839440+0000","last_became_peered":"2024-01-13T17:58:36.839440+0000","last_unstale":"2024-01-13T17:58:37.390273+0000","last_undegraded":"2024-01-13T17:58:37.390273+0000","last_fullsized":"2024-01-13T17:58:37.390273+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:17:50.836804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397861+0000","last_change":"2024-01-13T17:58:37.397651+0000","last_active":"2024-01-13T17:58:37.397861+0000","last_peered":"2024-01-13T17:58:37.397861+0000","last_clean":"2024-01-13T17:58:37.397861+0000","last_became_active":"2024-01-13T17:58:37.397326+0000","last_became_peered":"2024-01-13T17:58:37.397326+0000","last_unstale":"2024-01-13T17:58:37.397861+0000","last_undegraded":"2024-01-13T17:58:37.397861+0000","last_fullsized":"2024-01-13T17:58:37.397861+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:24:26.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.389088+0000","last_change":"2024-01-13T17:58:36.842492+0000","last_active":"2024-01-13T17:58:37.389088+0000","last_peered":"2024-01-13T17:58:37.389088+0000","last_clean":"2024-01-13T17:58:37.389088+0000","last_became_active":"2024-01-13T17:58:36.842172+0000","last_became_peered":"2024-01-13T17:58:36.842172+0000","last_unstale":"2024-01-13T17:58:37.389088+0000","last_undegraded":"2024-01-13T17:58:37.389088+0000","last_fullsized":"2024-01-13T17:58:37.389088+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:58:24.249555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":232,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.405907+0000","last_change":"2024-01-13T17:58:27.209773+0000","last_active":"2024-01-13T17:58:37.405907+0000","last_peered":"2024-01-13T17:58:37.405907+0000","last_clean":"2024-01-13T17:58:37.405907+0000","last_became_active":"2024-01-13T17:58:27.209293+0000","last_became_peered":"2024-01-13T17:58:27.209293+0000","last_unstale":"2024-01-13T17:58:37.405907+0000","last_undegraded":"2024-01-13T17:58:37.405907+0000","last_fullsized":"2024-01-13T17:58:37.405907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_clean_scrub_stamp":"2024-01-13T17:56:59.530229+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:45:29.626217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403686+0000","last_change":"2024-01-13T17:58:37.403318+0000","last_active":"2024-01-13T17:58:37.403686+0000","last_peered":"2024-01-13T17:58:37.403686+0000","last_clean":"2024-01-13T17:58:37.403686+0000","last_became_active":"2024-01-13T17:58:37.403022+0000","last_became_peered":"2024-01-13T17:58:37.403022+0000","last_unstale":"2024-01-13T17:58:37.403686+0000","last_undegraded":"2024-01-13T17:58:37.403686+0000","last_fullsized":"2024-01-13T17:58:37.403686+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:13:06.307215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.406934+0000","last_change":"2024-01-13T17:58:36.844962+0000","last_active":"2024-01-13T17:58:37.406934+0000","last_peered":"2024-01-13T17:58:37.406934+0000","last_clean":"2024-01-13T17:58:37.406934+0000","last_became_active":"2024-01-13T17:58:36.844443+0000","last_became_peered":"2024-01-13T17:58:36.844443+0000","last_unstale":"2024-01-13T17:58:37.406934+0000","last_undegraded":"2024-01-13T17:58:37.406934+0000","last_fullsized":"2024-01-13T17:58:37.406934+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:13:21.802704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.406455+0000","last_change":"2024-01-13T17:58:36.845469+0000","last_active":"2024-01-13T17:58:37.406455+0000","last_peered":"2024-01-13T17:58:37.406455+0000","last_clean":"2024-01-13T17:58:37.406455+0000","last_became_active":"2024-01-13T17:58:36.845158+0000","last_became_peered":"2024-01-13T17:58:36.845158+0000","last_unstale":"2024-01-13T17:58:37.406455+0000","last_undegraded":"2024-01-13T17:58:37.406455+0000","last_fullsized":"2024-01-13T17:58:37.406455+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:46.603258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.398131+0000","last_change":"2024-01-13T17:58:37.395393+0000","last_active":"2024-01-13T17:58:37.398131+0000","last_peered":"2024-01-13T17:58:37.398131+0000","last_clean":"2024-01-13T17:58:37.398131+0000","last_became_active":"2024-01-13T17:58:37.395105+0000","last_became_peered":"2024-01-13T17:58:37.395105+0000","last_unstale":"2024-01-13T17:58:37.398131+0000","last_undegraded":"2024-01-13T17:58:37.398131+0000","last_fullsized":"2024-01-13T17:58:37.398131+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:12.100528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.383941+0000","last_change":"2024-01-13T17:58:36.841642+0000","last_active":"2024-01-13T17:58:37.383941+0000","last_peered":"2024-01-13T17:58:37.383941+0000","last_clean":"2024-01-13T17:58:37.383941+0000","last_became_active":"2024-01-13T17:58:36.840768+0000","last_became_peered":"2024-01-13T17:58:36.840768+0000","last_unstale":"2024-01-13T17:58:37.383941+0000","last_undegraded":"2024-01-13T17:58:37.383941+0000","last_fullsized":"2024-01-13T17:58:37.383941+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:03:26.813924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.414663+0000","last_change":"2024-01-13T17:58:37.414477+0000","last_active":"2024-01-13T17:58:37.414663+0000","last_peered":"2024-01-13T17:58:37.414663+0000","last_clean":"2024-01-13T17:58:37.414663+0000","last_became_active":"2024-01-13T17:58:37.414307+0000","last_became_peered":"2024-01-13T17:58:37.414307+0000","last_unstale":"2024-01-13T17:58:37.414663+0000","last_undegraded":"2024-01-13T17:58:37.414663+0000","last_fullsized":"2024-01-13T17:58:37.414663+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:38:41.330284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828026+0000","last_change":"2024-01-13T17:58:36.839829+0000","last_active":"2024-01-13T17:58:37.828026+0000","last_peered":"2024-01-13T17:58:37.828026+0000","last_clean":"2024-01-13T17:58:37.828026+0000","last_became_active":"2024-01-13T17:58:36.839541+0000","last_became_peered":"2024-01-13T17:58:36.839541+0000","last_unstale":"2024-01-13T17:58:37.828026+0000","last_undegraded":"2024-01-13T17:58:37.828026+0000","last_fullsized":"2024-01-13T17:58:37.828026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:52:18.758870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402568+0000","last_change":"2024-01-13T17:58:37.401139+0000","last_active":"2024-01-13T17:58:37.402568+0000","last_peered":"2024-01-13T17:58:37.402568+0000","last_clean":"2024-01-13T17:58:37.402568+0000","last_became_active":"2024-01-13T17:58:37.400836+0000","last_became_peered":"2024-01-13T17:58:37.400836+0000","last_unstale":"2024-01-13T17:58:37.402568+0000","last_undegraded":"2024-01-13T17:58:37.402568+0000","last_fullsized":"2024-01-13T17:58:37.402568+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:15:29.881505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.405810+0000","last_change":"2024-01-13T17:58:36.844748+0000","last_active":"2024-01-13T17:58:37.405810+0000","last_peered":"2024-01-13T17:58:37.405810+0000","last_clean":"2024-01-13T17:58:37.405810+0000","last_became_active":"2024-01-13T17:58:36.844002+0000","last_became_peered":"2024-01-13T17:58:36.844002+0000","last_unstale":"2024-01-13T17:58:37.405810+0000","last_undegraded":"2024-01-13T17:58:37.405810+0000","last_fullsized":"2024-01-13T17:58:37.405810+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:14:57.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410381+0000","last_change":"2024-01-13T17:58:37.409079+0000","last_active":"2024-01-13T17:58:37.410381+0000","last_peered":"2024-01-13T17:58:37.410381+0000","last_clean":"2024-01-13T17:58:37.410381+0000","last_became_active":"2024-01-13T17:58:37.408807+0000","last_became_peered":"2024-01-13T17:58:37.408807+0000","last_unstale":"2024-01-13T17:58:37.410381+0000","last_undegraded":"2024-01-13T17:58:37.410381+0000","last_fullsized":"2024-01-13T17:58:37.410381+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:53:09.994807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.384927+0000","last_change":"2024-01-13T17:58:36.841464+0000","last_active":"2024-01-13T17:58:37.384927+0000","last_peered":"2024-01-13T17:58:37.384927+0000","last_clean":"2024-01-13T17:58:37.384927+0000","last_became_active":"2024-01-13T17:58:36.840078+0000","last_became_peered":"2024-01-13T17:58:36.840078+0000","last_unstale":"2024-01-13T17:58:37.384927+0000","last_undegraded":"2024-01-13T17:58:37.384927+0000","last_fullsized":"2024-01-13T17:58:37.384927+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:39:59.597495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.408984+0000","last_change":"2024-01-13T17:58:37.408303+0000","last_active":"2024-01-13T17:58:37.408984+0000","last_peered":"2024-01-13T17:58:37.408984+0000","last_clean":"2024-01-13T17:58:37.408984+0000","last_became_active":"2024-01-13T17:58:37.407988+0000","last_became_peered":"2024-01-13T17:58:37.407988+0000","last_unstale":"2024-01-13T17:58:37.408984+0000","last_undegraded":"2024-01-13T17:58:37.408984+0000","last_fullsized":"2024-01-13T17:58:37.408984+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:45:25.570947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.384831+0000","last_change":"2024-01-13T17:58:36.841581+0000","last_active":"2024-01-13T17:58:37.384831+0000","last_peered":"2024-01-13T17:58:37.384831+0000","last_clean":"2024-01-13T17:58:37.384831+0000","last_became_active":"2024-01-13T17:58:36.841192+0000","last_became_peered":"2024-01-13T17:58:36.841192+0000","last_unstale":"2024-01-13T17:58:37.384831+0000","last_undegraded":"2024-01-13T17:58:37.384831+0000","last_fullsized":"2024-01-13T17:58:37.384831+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:39:05.602781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402855+0000","last_change":"2024-01-13T17:58:37.402047+0000","last_active":"2024-01-13T17:58:37.402855+0000","last_peered":"2024-01-13T17:58:37.402855+0000","last_clean":"2024-01-13T17:58:37.402855+0000","last_became_active":"2024-01-13T17:58:37.401769+0000","last_became_peered":"2024-01-13T17:58:37.401769+0000","last_unstale":"2024-01-13T17:58:37.402855+0000","last_undegraded":"2024-01-13T17:58:37.402855+0000","last_fullsized":"2024-01-13T17:58:37.402855+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:32:35.369119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.828962+0000","last_change":"2024-01-13T17:58:36.844613+0000","last_active":"2024-01-13T17:58:37.828962+0000","last_peered":"2024-01-13T17:58:37.828962+0000","last_clean":"2024-01-13T17:58:37.828962+0000","last_became_active":"2024-01-13T17:58:36.844286+0000","last_became_peered":"2024-01-13T17:58:36.844286+0000","last_unstale":"2024-01-13T17:58:37.828962+0000","last_undegraded":"2024-01-13T17:58:37.828962+0000","last_fullsized":"2024-01-13T17:58:37.828962+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:27:48.244809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401261+0000","last_change":"2024-01-13T17:58:37.399084+0000","last_active":"2024-01-13T17:58:37.401261+0000","last_peered":"2024-01-13T17:58:37.401261+0000","last_clean":"2024-01-13T17:58:37.401261+0000","last_became_active":"2024-01-13T17:58:37.398572+0000","last_became_peered":"2024-01-13T17:58:37.398572+0000","last_unstale":"2024-01-13T17:58:37.401261+0000","last_undegraded":"2024-01-13T17:58:37.401261+0000","last_fullsized":"2024-01-13T17:58:37.401261+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:18:41.057728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.390142+0000","last_change":"2024-01-13T17:58:36.837432+0000","last_active":"2024-01-13T17:58:37.390142+0000","last_peered":"2024-01-13T17:58:37.390142+0000","last_clean":"2024-01-13T17:58:37.390142+0000","last_became_active":"2024-01-13T17:58:36.837168+0000","last_became_peered":"2024-01-13T17:58:36.837168+0000","last_unstale":"2024-01-13T17:58:37.390142+0000","last_undegraded":"2024-01-13T17:58:37.390142+0000","last_fullsized":"2024-01-13T17:58:37.390142+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:30.125718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.416850+0000","last_change":"2024-01-13T17:58:37.416032+0000","last_active":"2024-01-13T17:58:37.416850+0000","last_peered":"2024-01-13T17:58:37.416850+0000","last_clean":"2024-01-13T17:58:37.416850+0000","last_became_active":"2024-01-13T17:58:37.415759+0000","last_became_peered":"2024-01-13T17:58:37.415759+0000","last_unstale":"2024-01-13T17:58:37.416850+0000","last_undegraded":"2024-01-13T17:58:37.416850+0000","last_fullsized":"2024-01-13T17:58:37.416850+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:24.483081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.827607+0000","last_change":"2024-01-13T17:58:36.834302+0000","last_active":"2024-01-13T17:58:37.827607+0000","last_peered":"2024-01-13T17:58:37.827607+0000","last_clean":"2024-01-13T17:58:37.827607+0000","last_became_active":"2024-01-13T17:58:36.833658+0000","last_became_peered":"2024-01-13T17:58:36.833658+0000","last_unstale":"2024-01-13T17:58:37.827607+0000","last_undegraded":"2024-01-13T17:58:37.827607+0000","last_fullsized":"2024-01-13T17:58:37.827607+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:13:18.505657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403231+0000","last_change":"2024-01-13T17:58:37.402650+0000","last_active":"2024-01-13T17:58:37.403231+0000","last_peered":"2024-01-13T17:58:37.403231+0000","last_clean":"2024-01-13T17:58:37.403231+0000","last_became_active":"2024-01-13T17:58:37.402128+0000","last_became_peered":"2024-01-13T17:58:37.402128+0000","last_unstale":"2024-01-13T17:58:37.403231+0000","last_undegraded":"2024-01-13T17:58:37.403231+0000","last_fullsized":"2024-01-13T17:58:37.403231+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:02:28.745789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.829297+0000","last_change":"2024-01-13T17:58:36.836861+0000","last_active":"2024-01-13T17:58:37.829297+0000","last_peered":"2024-01-13T17:58:37.829297+0000","last_clean":"2024-01-13T17:58:37.829297+0000","last_became_active":"2024-01-13T17:58:36.836593+0000","last_became_peered":"2024-01-13T17:58:36.836593+0000","last_unstale":"2024-01-13T17:58:37.829297+0000","last_undegraded":"2024-01-13T17:58:37.829297+0000","last_fullsized":"2024-01-13T17:58:37.829297+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:34:37.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.415578+0000","last_change":"2024-01-13T17:58:37.414378+0000","last_active":"2024-01-13T17:58:37.415578+0000","last_peered":"2024-01-13T17:58:37.415578+0000","last_clean":"2024-01-13T17:58:37.415578+0000","last_became_active":"2024-01-13T17:58:37.414097+0000","last_became_peered":"2024-01-13T17:58:37.414097+0000","last_unstale":"2024-01-13T17:58:37.415578+0000","last_undegraded":"2024-01-13T17:58:37.415578+0000","last_fullsized":"2024-01-13T17:58:37.415578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:45:12.430007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397973+0000","last_change":"2024-01-13T17:58:37.397227+0000","last_active":"2024-01-13T17:58:37.397973+0000","last_peered":"2024-01-13T17:58:37.397973+0000","last_clean":"2024-01-13T17:58:37.397973+0000","last_became_active":"2024-01-13T17:58:37.396928+0000","last_became_peered":"2024-01-13T17:58:37.396928+0000","last_unstale":"2024-01-13T17:58:37.397973+0000","last_undegraded":"2024-01-13T17:58:37.397973+0000","last_fullsized":"2024-01-13T17:58:37.397973+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:59:55.499543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.397903+0000","last_change":"2024-01-13T17:58:37.396849+0000","last_active":"2024-01-13T17:58:37.397903+0000","last_peered":"2024-01-13T17:58:37.397903+0000","last_clean":"2024-01-13T17:58:37.397903+0000","last_became_active":"2024-01-13T17:58:37.396585+0000","last_became_peered":"2024-01-13T17:58:37.396585+0000","last_unstale":"2024-01-13T17:58:37.397903+0000","last_undegraded":"2024-01-13T17:58:37.397903+0000","last_fullsized":"2024-01-13T17:58:37.397903+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:32.529315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.404802+0000","last_change":"2024-01-13T17:58:37.403640+0000","last_active":"2024-01-13T17:58:37.404802+0000","last_peered":"2024-01-13T17:58:37.404802+0000","last_clean":"2024-01-13T17:58:37.404802+0000","last_became_active":"2024-01-13T17:58:37.403041+0000","last_became_peered":"2024-01-13T17:58:37.403041+0000","last_unstale":"2024-01-13T17:58:37.404802+0000","last_undegraded":"2024-01-13T17:58:37.404802+0000","last_fullsized":"2024-01-13T17:58:37.404802+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:37.683734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.404260+0000","last_change":"2024-01-13T17:58:37.403739+0000","last_active":"2024-01-13T17:58:37.404260+0000","last_peered":"2024-01-13T17:58:37.404260+0000","last_clean":"2024-01-13T17:58:37.404260+0000","last_became_active":"2024-01-13T17:58:37.403471+0000","last_became_peered":"2024-01-13T17:58:37.403471+0000","last_unstale":"2024-01-13T17:58:37.404260+0000","last_undegraded":"2024-01-13T17:58:37.404260+0000","last_fullsized":"2024-01-13T17:58:37.404260+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:13:50.178194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.402399+0000","last_change":"2024-01-13T17:58:37.401852+0000","last_active":"2024-01-13T17:58:37.402399+0000","last_peered":"2024-01-13T17:58:37.402399+0000","last_clean":"2024-01-13T17:58:37.402399+0000","last_became_active":"2024-01-13T17:58:37.401546+0000","last_became_peered":"2024-01-13T17:58:37.401546+0000","last_unstale":"2024-01-13T17:58:37.402399+0000","last_undegraded":"2024-01-13T17:58:37.402399+0000","last_fullsized":"2024-01-13T17:58:37.402399+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:25:50.041002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.398241+0000","last_change":"2024-01-13T17:58:37.395592+0000","last_active":"2024-01-13T17:58:37.398241+0000","last_peered":"2024-01-13T17:58:37.398241+0000","last_clean":"2024-01-13T17:58:37.398241+0000","last_became_active":"2024-01-13T17:58:37.395306+0000","last_became_peered":"2024-01-13T17:58:37.395306+0000","last_unstale":"2024-01-13T17:58:37.398241+0000","last_undegraded":"2024-01-13T17:58:37.398241+0000","last_fullsized":"2024-01-13T17:58:37.398241+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:06:42.102077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410344+0000","last_change":"2024-01-13T17:58:37.409861+0000","last_active":"2024-01-13T17:58:37.410344+0000","last_peered":"2024-01-13T17:58:37.410344+0000","last_clean":"2024-01-13T17:58:37.410344+0000","last_became_active":"2024-01-13T17:58:37.409345+0000","last_became_peered":"2024-01-13T17:58:37.409345+0000","last_unstale":"2024-01-13T17:58:37.410344+0000","last_undegraded":"2024-01-13T17:58:37.410344+0000","last_fullsized":"2024-01-13T17:58:37.410344+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:00:44.773057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.406348+0000","last_change":"2024-01-13T17:58:37.402771+0000","last_active":"2024-01-13T17:58:37.406348+0000","last_peered":"2024-01-13T17:58:37.406348+0000","last_clean":"2024-01-13T17:58:37.406348+0000","last_became_active":"2024-01-13T17:58:37.402517+0000","last_became_peered":"2024-01-13T17:58:37.402517+0000","last_unstale":"2024-01-13T17:58:37.406348+0000","last_undegraded":"2024-01-13T17:58:37.406348+0000","last_fullsized":"2024-01-13T17:58:37.406348+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:14:28.931595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.403255+0000","last_change":"2024-01-13T17:58:37.402590+0000","last_active":"2024-01-13T17:58:37.403255+0000","last_peered":"2024-01-13T17:58:37.403255+0000","last_clean":"2024-01-13T17:58:37.403255+0000","last_became_active":"2024-01-13T17:58:37.402233+0000","last_became_peered":"2024-01-13T17:58:37.402233+0000","last_unstale":"2024-01-13T17:58:37.403255+0000","last_undegraded":"2024-01-13T17:58:37.403255+0000","last_fullsized":"2024-01-13T17:58:37.403255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:48:51.046376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.406447+0000","last_change":"2024-01-13T17:58:37.403312+0000","last_active":"2024-01-13T17:58:37.406447+0000","last_peered":"2024-01-13T17:58:37.406447+0000","last_clean":"2024-01-13T17:58:37.406447+0000","last_became_active":"2024-01-13T17:58:37.403093+0000","last_became_peered":"2024-01-13T17:58:37.403093+0000","last_unstale":"2024-01-13T17:58:37.406447+0000","last_undegraded":"2024-01-13T17:58:37.406447+0000","last_fullsized":"2024-01-13T17:58:37.406447+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:27:24.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.413388+0000","last_change":"2024-01-13T17:58:37.411533+0000","last_active":"2024-01-13T17:58:37.413388+0000","last_peered":"2024-01-13T17:58:37.413388+0000","last_clean":"2024-01-13T17:58:37.413388+0000","last_became_active":"2024-01-13T17:58:37.411192+0000","last_became_peered":"2024-01-13T17:58:37.411192+0000","last_unstale":"2024-01-13T17:58:37.413388+0000","last_undegraded":"2024-01-13T17:58:37.413388+0000","last_fullsized":"2024-01-13T17:58:37.413388+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:31:15.289987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.410305+0000","last_change":"2024-01-13T17:58:37.409594+0000","last_active":"2024-01-13T17:58:37.410305+0000","last_peered":"2024-01-13T17:58:37.410305+0000","last_clean":"2024-01-13T17:58:37.410305+0000","last_became_active":"2024-01-13T17:58:37.409319+0000","last_became_peered":"2024-01-13T17:58:37.409319+0000","last_unstale":"2024-01-13T17:58:37.410305+0000","last_undegraded":"2024-01-13T17:58:37.410305+0000","last_fullsized":"2024-01-13T17:58:37.410305+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:21:11.322832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-13T17:58:37.401100+0000","last_change":"2024-01-13T17:58:37.400265+0000","last_active":"2024-01-13T17:58:37.401100+0000","last_peered":"2024-01-13T17:58:37.401100+0000","last_clean":"2024-01-13T17:58:37.401100+0000","last_became_active":"2024-01-13T17:58:37.399952+0000","last_became_peered":"2024-01-13T17:58:37.399952+0000","last_unstale":"2024-01-13T17:58:37.401100+0000","last_undegraded":"2024-01-13T17:58:37.401100+0000","last_fullsized":"2024-01-13T17:58:37.401100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:04.725745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":6918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":52,"seq":223338299399,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298456,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446696,"statfs":{"total":95995035648,"available":95689416704,"internally_reserved":0,"allocated":1196032,"data_stored":841013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":6,"up_from":44,"seq":188978561032,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298460,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446692,"statfs":{"total":95995035648,"available":95689412608,"internally_reserved":0,"allocated":1200128,"data_stored":842031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297876,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447276,"statfs":{"total":95995035648,"available":95690010624,"internally_reserved":0,"allocated":602112,"data_stored":250287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Jan 13 17:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.27500000000000002}]},{"osd":3,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.379}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298468,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446684,"statfs":{"total":95995035648,"available":95689404416,"internally_reserved":0,"allocated":1208320,"data_stored":841460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 13 17:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Jan 13 17:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Jan 13 17:58:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.309}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411352,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447280,"statfs":{"total":95995035648,"available":95690014720,"internally_reserved":0,"allocated":598016,"data_stored":250392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.434},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.41199999999999998}]},{"osd":1,"last update":"Sat Jan 13 17:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.52800000000000002}]},{"osd":3,"last update":"Sat Jan 13 17:58:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.97399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]}]},{"osd":3,"up_from":25,"seq":107374182420,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447260,"statfs":{"total":95995035648,"available":95689994240,"internally_reserved":0,"allocated":618496,"data_stored":252032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.375}]},{"osd":1,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.27100000000000002}]},{"osd":2,"last update":"Sat Jan 13 17:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.318},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":4,"up_from":30,"seq":128849018896,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297888,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447264,"statfs":{"total":95995035648,"available":95689998336,"internally_reserved":0,"allocated":614400,"data_stored":251072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.377},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.58899999999999997}]},{"osd":2,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297888,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447264,"statfs":{"total":95995035648,"available":95689998336,"internally_reserved":0,"allocated":614400,"data_stored":252018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-13T17:58:46.718 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-13T17:58:46.718 INFO:tasks.cephadm:Adding prometheus.a on smithi099 2024-01-13T17:58:46.719 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch apply prometheus '1;smithi099=a' 2024-01-13T17:58:46.987 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:58:48.181 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled prometheus update... 2024-01-13T17:58:48.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:48 smithi099 ceph-mon[71325]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:48.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:48 smithi099 ceph-mon[71325]: pgmap v151: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-01-13T17:58:48.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:48 smithi084 ceph-mon[37908]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:48.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:48 smithi084 ceph-mon[37908]: pgmap v151: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-01-13T17:58:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:48 smithi084 ceph-mon[52328]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:58:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:48 smithi084 ceph-mon[52328]: pgmap v151: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-01-13T17:58:48.607 DEBUG:teuthology.orchestra.run.smithi099:prometheus.a> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@prometheus.a.service 2024-01-13T17:58:48.610 INFO:tasks.cephadm:Adding node-exporter.a on smithi084 2024-01-13T17:58:48.610 INFO:tasks.cephadm:Adding node-exporter.b on smithi099 2024-01-13T17:58:48.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch apply node-exporter '2;smithi084=a;smithi099=b' 2024-01-13T17:58:48.639 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:-- Logs begin at Sat 2024-01-13 17:16:04 UTC. -- 2024-01-13T17:58:48.907 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:58:49.356 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:49 smithi099 ceph-mon[71325]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:49.356 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:49 smithi099 ceph-mon[71325]: Saving service prometheus spec with placement smithi099=a;count:1 2024-01-13T17:58:49.356 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:49 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:49.356 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:49 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:49.356 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:49 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:49.357 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:49 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:49.357 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:49 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[37908]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[37908]: Saving service prometheus spec with placement smithi099=a;count:1 2024-01-13T17:58:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:49.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:49.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:49.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[52328]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:49.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[52328]: Saving service prometheus spec with placement smithi099=a;count:1 2024-01-13T17:58:49.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:49.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:58:49.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:58:49.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:58:49.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:49 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:50.195 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled node-exporter update... 2024-01-13T17:58:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:50 smithi099 ceph-mon[71325]: Deploying daemon prometheus.a on smithi099 2024-01-13T17:58:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:50 smithi099 ceph-mon[71325]: pgmap v152: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-01-13T17:58:50.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:50 smithi084 ceph-mon[37908]: Deploying daemon prometheus.a on smithi099 2024-01-13T17:58:50.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:50 smithi084 ceph-mon[37908]: pgmap v152: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-01-13T17:58:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:50 smithi084 ceph-mon[52328]: Deploying daemon prometheus.a on smithi099 2024-01-13T17:58:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:50 smithi084 ceph-mon[52328]: pgmap v152: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-01-13T17:58:51.004 DEBUG:teuthology.orchestra.run.smithi084:node-exporter.a> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.a.service 2024-01-13T17:58:51.007 DEBUG:teuthology.orchestra.run.smithi099:node-exporter.b> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.b.service 2024-01-13T17:58:51.009 INFO:tasks.cephadm:Adding alertmanager.a on smithi084 2024-01-13T17:58:51.009 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch apply alertmanager '1;smithi084=a' 2024-01-13T17:58:51.040 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:-- Logs begin at Sat 2024-01-13 17:16:04 UTC. -- 2024-01-13T17:58:51.040 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:-- Logs begin at Sat 2024-01-13 17:16:05 UTC. -- 2024-01-13T17:58:51.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:51 smithi099 ceph-mon[71325]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi084=a;smithi099=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:51.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:51 smithi099 ceph-mon[71325]: Saving service node-exporter spec with placement smithi084=a;smithi099=b;count:2 2024-01-13T17:58:51.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:51 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:51.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:51 smithi084 ceph-mon[37908]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi084=a;smithi099=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:51 smithi084 ceph-mon[37908]: Saving service node-exporter spec with placement smithi084=a;smithi099=b;count:2 2024-01-13T17:58:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:51 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:51 smithi084 ceph-mon[52328]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi084=a;smithi099=b", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:51 smithi084 ceph-mon[52328]: Saving service node-exporter spec with placement smithi084=a;smithi099=b;count:2 2024-01-13T17:58:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:51 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:52 smithi099 ceph-mon[71325]: pgmap v153: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-01-13T17:58:52.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:52 smithi084 ceph-mon[37908]: pgmap v153: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-01-13T17:58:52.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:52 smithi084 ceph-mon[52328]: pgmap v153: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-01-13T17:58:53.012 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:58:54.459 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:54 smithi099 ceph-mon[71325]: pgmap v154: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-01-13T17:58:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:54 smithi084 ceph-mon[37908]: pgmap v154: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-01-13T17:58:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:54 smithi084 ceph-mon[52328]: pgmap v154: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-01-13T17:58:55.365 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled alertmanager update... 2024-01-13T17:58:55.931 DEBUG:teuthology.orchestra.run.smithi084:alertmanager.a> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@alertmanager.a.service 2024-01-13T17:58:55.934 INFO:tasks.cephadm:Adding grafana.a on smithi099 2024-01-13T17:58:55.934 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph orch apply grafana '1;smithi099=a' 2024-01-13T17:58:55.968 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:-- Logs begin at Sat 2024-01-13 17:16:05 UTC. -- 2024-01-13T17:58:56.312 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:58:56.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:56 smithi099 ceph-mon[71325]: pgmap v155: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-01-13T17:58:56.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:56 smithi099 ceph-mon[71325]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi084=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:56.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:56 smithi099 ceph-mon[71325]: Saving service alertmanager spec with placement smithi084=a;count:1 2024-01-13T17:58:56.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:56 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:56.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:56 smithi084 ceph-mon[37908]: pgmap v155: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-01-13T17:58:56.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:56 smithi084 ceph-mon[37908]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi084=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:56 smithi084 ceph-mon[37908]: Saving service alertmanager spec with placement smithi084=a;count:1 2024-01-13T17:58:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:56 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:56 smithi084 ceph-mon[52328]: pgmap v155: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-01-13T17:58:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:56 smithi084 ceph-mon[52328]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi084=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:56 smithi084 ceph-mon[52328]: Saving service alertmanager spec with placement smithi084=a;count:1 2024-01-13T17:58:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:56 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:57.619 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:58:57 smithi099 systemd[1]: Started Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:58:57.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:58:57 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:58:57.398Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=14.093036ms db_storage=705ns remote_storage=959ns web_handler=330ns query_engine=555ns scrape=492.533µs scrape_sd=16.97µs notify=680ns notify_sd=1.412µs rules=13.419516ms tracing=5.736µs 2024-01-13T17:58:57.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:58:57 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:58:57.398Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-01-13T17:58:57.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:58:57 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:58:57.398Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-01-13T17:58:57.759 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled grafana update... 2024-01-13T17:58:58.090 DEBUG:teuthology.orchestra.run.smithi099:grafana.a> sudo journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@grafana.a.service 2024-01-13T17:58:58.092 INFO:tasks.cephadm:Setting up client nodes... 2024-01-13T17:58:58.092 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-01-13T17:58:58.121 INFO:journalctl@ceph.grafana.a.smithi099.stdout:-- Logs begin at Sat 2024-01-13 17:16:04 UTC. -- 2024-01-13T17:58:58.358 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:58:58.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[37908]: pgmap v156: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-01-13T17:58:58.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-01-13T17:58:58.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[52328]: pgmap v156: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-01-13T17:58:58.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-01-13T17:58:58.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:58 smithi099 ceph-mon[71325]: pgmap v156: 97 pgs: 97 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-01-13T17:58:58.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-01-13T17:58:58.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:58 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' 2024-01-13T17:58:58.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:58:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ignoring --setuser ceph since I am not root 2024-01-13T17:58:58.620 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:58:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ignoring --setgroup ceph since I am not root 2024-01-13T17:58:58.620 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:58:58 smithi099 ceph-mgr[73466]: -- 172.21.15.99:0/614770589 <== mon.2 v2:172.21.15.84:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55989e2a69c0 con 0x55989e27cc00 2024-01-13T17:58:58.832 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ignoring --setuser ceph since I am not root 2024-01-13T17:58:58.832 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ignoring --setgroup ceph since I am not root 2024-01-13T17:58:58.832 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-mgr[38181]: -- 172.21.15.84:0/2827998069 <== mon.2 v2:172.21.15.84:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b8cd729c0 con 0x564b8cd48c00 2024-01-13T17:58:58.832 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:58:58.663+0000 7f130a7e61c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T17:58:58.832 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:58:58 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:58:58.829+0000 7f130a7e61c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T17:58:59.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:58:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:58:58.665+0000 7fb08b3951c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T17:58:59.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:58:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:58:58.824+0000 7fb08b3951c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T17:58:59.142 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:58:59 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:58:59.139+0000 7f130a7e61c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T17:58:59.369 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:58:59 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:58:59.116+0000 7fb08b3951c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T17:58:59.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:59 smithi099 ceph-mon[71325]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:59.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:59 smithi099 ceph-mon[71325]: Saving service grafana spec with placement smithi099=a;count:1 2024-01-13T17:58:59.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:59 smithi099 ceph-mon[71325]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-01-13T17:58:59.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:59 smithi084 ceph-mon[37908]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:59.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:59 smithi084 ceph-mon[37908]: Saving service grafana spec with placement smithi099=a;count:1 2024-01-13T17:58:59.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:59 smithi084 ceph-mon[37908]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-01-13T17:58:59.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:58:59 smithi084 ceph-mon[37908]: mgrmap e16: y(active, since 3m), standbys: x 2024-01-13T17:58:59.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:59 smithi084 ceph-mon[52328]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T17:58:59.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:59 smithi084 ceph-mon[52328]: Saving service grafana spec with placement smithi099=a;count:1 2024-01-13T17:58:59.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:59 smithi084 ceph-mon[52328]: from='mgr.14152 172.21.15.84:0/566138781' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-01-13T17:58:59.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:58:59 smithi084 ceph-mon[52328]: mgrmap e16: y(active, since 3m), standbys: x 2024-01-13T17:58:59.684 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-01-13T17:58:59.684 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBjz6JlYCQ2KBAAgDyxVIHiwx2d5u0ql2G/rQ== 2024-01-13T17:58:59.966 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:58:59 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:58:59.690+0000 7f130a7e61c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T17:58:59.966 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:58:59 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:58:59.918+0000 7f130a7e61c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T17:59:00.042 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T17:59:00.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-01-13T17:59:00.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-13T17:59:00.084 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-01-13T17:59:00.108 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:58:59 smithi099 ceph-mon[71325]: mgrmap e16: y(active, since 3m), standbys: x 2024-01-13T17:59:00.108 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:58:59 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:58:59.619+0000 7fb08b3951c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T17:59:00.108 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:58:59 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:58:59.838+0000 7fb08b3951c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T17:59:00.356 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.b/config 2024-01-13T17:59:00.368 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:00 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:00.183+0000 7fb08b3951c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T17:59:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:00.266+0000 7f130a7e61c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T17:59:00.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:00 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1170344545' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:00.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:00 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:00.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:00 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-13T17:59:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:00 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1170344545' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:00 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:00 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-13T17:59:00.695 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:00 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1170344545' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:00.695 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:00 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:00.695 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:00 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-13T17:59:01.264 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:00 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:00.997+0000 7fb08b3951c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T17:59:01.265 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:01.086+0000 7fb08b3951c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T17:59:01.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:01.014+0000 7f130a7e61c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T17:59:01.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:01.097+0000 7f130a7e61c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T17:59:01.707 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2024-01-13T17:59:01.707 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBlz6JlDdHoKRAAWj0QyFvj3SOF6Z0D5fimIQ== 2024-01-13T17:59:01.952 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-mon[37908]: from='client.? 172.21.15.99:0/465298120' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:01.952 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:01.952 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-13T17:59:01.953 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:01.687+0000 7f130a7e61c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T17:59:01.953 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:01.771+0000 7f130a7e61c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T17:59:01.953 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:01.857+0000 7f130a7e61c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T17:59:01.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-mon[52328]: from='client.? 172.21.15.99:0/465298120' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:01.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:01.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-13T17:59:02.006 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:01.726+0000 7fb08b3951c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T17:59:02.006 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:01.820+0000 7fb08b3951c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T17:59:02.006 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:01.910+0000 7fb08b3951c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T17:59:02.006 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:01 smithi099 ceph-mon[71325]: from='client.? 172.21.15.99:0/465298120' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:02.006 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:01 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-13T17:59:02.006 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:01 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-13T17:59:02.081 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T17:59:02.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-01-13T17:59:02.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-13T17:59:02.164 INFO:tasks.cephadm:Waiting for OSDs to come up 2024-01-13T17:59:02.164 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-13T17:59:02.266 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:01.950+0000 7f130a7e61c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T17:59:02.266 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:02.168+0000 7f130a7e61c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T17:59:02.329 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:02 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:02.003+0000 7fb08b3951c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T17:59:02.329 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:02 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:02.234+0000 7fb08b3951c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T17:59:02.330 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:02 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:02.327+0000 7fb08b3951c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T17:59:02.477 INFO:teuthology.misc.health.smithi084.stdout: 2024-01-13T17:59:02.477 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":60,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:58:38.390669+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-13T17:58:35.312354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-13T17:58:36.379223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:59:02.490 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-13T17:59:02.490 INFO:tasks.cephadm:Creating RBD pool 2024-01-13T17:59:02.490 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- sudo ceph --cluster ceph osd pool create rbd 8 2024-01-13T17:59:02.586 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:02.263+0000 7f130a7e61c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T17:59:02.586 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:02.482+0000 7f130a7e61c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T17:59:02.618 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:02 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:02.536+0000 7fb08b3951c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T17:59:02.754 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:02.851 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:02 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3981257058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:02.851 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:02.583+0000 7f130a7e61c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T17:59:02.851 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:02.784+0000 7f130a7e61c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T17:59:02.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:02 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3981257058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:02.896 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:02 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:02.629+0000 7fb08b3951c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T17:59:02.896 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:02 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:02.810+0000 7fb08b3951c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T17:59:02.896 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:02 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3981257058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:03.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:02.874+0000 7f130a7e61c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T17:59:03.853 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:03 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:03.644+0000 7f130a7e61c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T17:59:04.006 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:02 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:02.893+0000 7fb08b3951c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T17:59:04.007 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:03 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:03.644+0000 7fb08b3951c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T17:59:04.007 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:03 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:03.830+0000 7fb08b3951c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T17:59:04.007 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:04.004+0000 7fb08b3951c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:59:04.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:03 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:03.852+0000 7f130a7e61c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T17:59:04.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:04 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:04.034+0000 7f130a7e61c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:59:04.357 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'rbd' created 2024-01-13T17:59:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:04 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/4201591608' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-01-13T17:59:04.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:04.596+0000 7fb08b3951c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T17:59:04.648 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:04 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/4201591608' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-01-13T17:59:04.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:04 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/4201591608' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-01-13T17:59:04.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-01-13T17:59:04.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:04 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:04.651+0000 7f130a7e61c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T17:59:04.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:04 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:04.837+0000 7f130a7e61c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:59:05.004 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:05.067 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:04.773+0000 7fb08b3951c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T17:59:05.067 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:04.951+0000 7fb08b3951c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T17:59:05.290 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.037+0000 7f130a7e61c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T17:59:05.291 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.162+0000 7f130a7e61c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T17:59:05.291 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:05] ENGINE Bus STARTING 2024-01-13T17:59:05.362 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:05.064+0000 7fb08b3951c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T17:59:05.362 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: [13/Jan/2024:17:59:05] ENGINE Bus STARTING 2024-01-13T17:59:05.362 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: CherryPy Checker: 2024-01-13T17:59:05.362 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: The Application mounted at '' has an empty config. 2024-01-13T17:59:05.362 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: 2024-01-13T17:59:05.362 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: [13/Jan/2024:17:59:05] ENGINE Serving on http://:::9283 2024-01-13T17:59:05.362 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: [13/Jan/2024:17:59:05] ENGINE Bus STARTED 2024-01-13T17:59:05.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/4201591608' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-01-13T17:59:05.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: osdmap e61: 8 total, 8 up, 8 in 2024-01-13T17:59:05.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: Standby manager daemon x restarted 2024-01-13T17:59:05.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: Standby manager daemon x started 2024-01-13T17:59:05.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T17:59:05.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T17:59:05.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T17:59:05.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: Active manager daemon y restarted 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: Activating manager daemon y 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: osdmap e62: 8 total, 8 up, 8 in 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: mgrmap e17: y(active, starting, since 0.012538s), standbys: x 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:59:05.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: Manager daemon y is now available 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:05.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:05.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T17:59:05.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T17:59:05.561 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.308+0000 7f1270881700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T17:59:05.561 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.308+0000 7f1270881700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T17:59:05.561 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.308+0000 7f1270881700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T17:59:05.561 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.308+0000 7f1270881700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T17:59:05.561 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.308+0000 7f1270881700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T17:59:05.561 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.308+0000 7f1273887700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T17:59:05.562 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.308+0000 7f1273887700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T17:59:05.562 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.308+0000 7f1273887700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T17:59:05.562 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.308+0000 7f1273887700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T17:59:05.562 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.308+0000 7f1273887700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T17:59:05.562 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: CherryPy Checker: 2024-01-13T17:59:05.562 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: The Application mounted at '' has an empty config. 2024-01-13T17:59:05.562 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T17:59:05.562 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:05] ENGINE Serving on http://:::9283 2024-01-13T17:59:05.562 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:05] ENGINE Bus STARTED 2024-01-13T17:59:05.562 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/4201591608' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: osdmap e61: 8 total, 8 up, 8 in 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: Standby manager daemon x restarted 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: Standby manager daemon x started 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: Active manager daemon y restarted 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: Activating manager daemon y 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: osdmap e62: 8 total, 8 up, 8 in 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: mgrmap e17: y(active, starting, since 0.012538s), standbys: x 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:59:05.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T17:59:05.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T17:59:05.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: Manager daemon y is now available 2024-01-13T17:59:05.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:05.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:05.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:05.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:05.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T17:59:05.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T17:59:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/4201591608' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-01-13T17:59:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: osdmap e61: 8 total, 8 up, 8 in 2024-01-13T17:59:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: Standby manager daemon x restarted 2024-01-13T17:59:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: Standby manager daemon x started 2024-01-13T17:59:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/952931737' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: Active manager daemon y restarted 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: Activating manager daemon y 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: osdmap e62: 8 total, 8 up, 8 in 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: mgrmap e17: y(active, starting, since 0.012538s), standbys: x 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T17:59:05.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T17:59:05.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T17:59:05.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: Manager daemon y is now available 2024-01-13T17:59:05.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:05.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:05.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:05.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:05.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T17:59:05.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T17:59:06.191 INFO:teuthology.orchestra.run.smithi084.stderr:enabled application 'rbd' on pool 'rbd' 2024-01-13T17:59:06.670 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-13T17:59:06.671 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-01-13T17:59:06.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph mgr dump --format=json 2024-01-13T17:59:06.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[37908]: [13/Jan/2024:17:59:05] ENGINE Bus STARTING 2024-01-13T17:59:06.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[37908]: [13/Jan/2024:17:59:05] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T17:59:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[37908]: [13/Jan/2024:17:59:05] ENGINE Bus STARTED 2024-01-13T17:59:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/92306747' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T17:59:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T17:59:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[37908]: mgrmap e18: y(active, since 1.01528s), standbys: x 2024-01-13T17:59:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2024-01-13T17:59:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[37908]: osdmap e63: 8 total, 8 up, 8 in 2024-01-13T17:59:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[37908]: pgmap v4: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 35 MiB/s rd, 852 MiB/s wr, 113.54k op/s; 607 MiB/s, 2.15k objects/s recovering 2024-01-13T17:59:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[52328]: [13/Jan/2024:17:59:05] ENGINE Bus STARTING 2024-01-13T17:59:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[52328]: [13/Jan/2024:17:59:05] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T17:59:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[52328]: [13/Jan/2024:17:59:05] ENGINE Bus STARTED 2024-01-13T17:59:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/92306747' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T17:59:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T17:59:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[52328]: mgrmap e18: y(active, since 1.01528s), standbys: x 2024-01-13T17:59:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2024-01-13T17:59:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[52328]: osdmap e63: 8 total, 8 up, 8 in 2024-01-13T17:59:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:06 smithi084 ceph-mon[52328]: pgmap v4: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 35 MiB/s rd, 852 MiB/s wr, 113.54k op/s; 607 MiB/s, 2.15k objects/s recovering 2024-01-13T17:59:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:06 smithi099 ceph-mon[71325]: [13/Jan/2024:17:59:05] ENGINE Bus STARTING 2024-01-13T17:59:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:06 smithi099 ceph-mon[71325]: [13/Jan/2024:17:59:05] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T17:59:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:06 smithi099 ceph-mon[71325]: [13/Jan/2024:17:59:05] ENGINE Bus STARTED 2024-01-13T17:59:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:06 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:06 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/92306747' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T17:59:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:06 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T17:59:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:06 smithi099 ceph-mon[71325]: mgrmap e18: y(active, since 1.01528s), standbys: x 2024-01-13T17:59:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:06 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2024-01-13T17:59:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:06 smithi099 ceph-mon[71325]: osdmap e63: 8 total, 8 up, 8 in 2024-01-13T17:59:07.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:06 smithi099 ceph-mon[71325]: pgmap v4: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 35 MiB/s rd, 852 MiB/s wr, 113.54k op/s; 607 MiB/s, 2.15k objects/s recovering 2024-01-13T17:59:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: pgmap v5: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 100 KiB/s rd, 2.4 MiB/s wr, 315 op/s; 1.7 MiB/s, 5 objects/s recovering 2024-01-13T17:59:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: pgmap v5: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 100 KiB/s rd, 2.4 MiB/s wr, 315 op/s; 1.7 MiB/s, 5 objects/s recovering 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: pgmap v5: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 100 KiB/s rd, 2.4 MiB/s wr, 315 op/s; 1.7 MiB/s, 5 objects/s recovering 2024-01-13T17:59:08.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:08.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:08.189 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:08.552 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"active_gid":24500,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1542179962},{"type":"v1","addr":"172.21.15.84:6801","nonce":1542179962}]},"active_addr":"172.21.15.84:6801/1542179962","active_change":"2024-01-13T17:59:05.164613+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":24439,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.84:8443/","prometheus":"http://172.21.15.84:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":62,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":172129685}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1247513276}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2821226797}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3087269970}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":4034603162}]}]} 2024-01-13T17:59:08.555 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-01-13T17:59:08.555 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-01-13T17:59:08.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd dump --format=json 2024-01-13T17:59:08.842 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi099 to 3000M 2024-01-13T17:59:08.842 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi084 to 3000M 2024-01-13T17:59:08.842 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T17:59:08.842 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T17:59:08.842 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: mgrmap e19: y(active, since 2s), standbys: x 2024-01-13T17:59:08.842 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:59:08.842 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:59:08.843 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:59:08.843 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:59:08.843 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1143720045' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-13T17:59:08.843 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T17:59:08.843 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T17:59:08.843 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.843 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.843 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.843 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.843 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:08.855 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi099 to 3000M 2024-01-13T17:59:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi084 to 3000M 2024-01-13T17:59:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T17:59:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T17:59:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: mgrmap e19: y(active, since 2s), standbys: x 2024-01-13T17:59:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:59:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:59:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:59:09.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:59:09.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1143720045' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-13T17:59:09.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T17:59:09.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T17:59:09.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:09.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:09.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:09.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:09.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:08 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:09.135 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi099 to 3000M 2024-01-13T17:59:09.135 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi084 to 3000M 2024-01-13T17:59:09.135 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T17:59:09.135 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T17:59:09.135 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: mgrmap e19: y(active, since 2s), standbys: x 2024-01-13T17:59:09.135 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:59:09.135 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T17:59:09.136 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:59:09.136 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T17:59:09.136 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1143720045' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-13T17:59:09.136 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T17:59:09.136 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T17:59:09.136 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:09.136 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:09.136 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:09.136 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:09.136 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:08 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:09.979 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:09.979 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:59:06.172263+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-13T17:58:35.312354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-13T17:58:36.379223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"rbd","create_time":"2024-01-13T17:59:04.296556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:6800/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/1455901095":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3916505137":"2024-01-14T17:59:05.164416+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/1946108910":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3513905448":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:59:10.590 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:10 smithi084 ceph-mon[37908]: Deploying daemon alertmanager.a on smithi084 2024-01-13T17:59:10.590 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:10 smithi084 ceph-mon[37908]: pgmap v6: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 33 KiB/s rd, 809 KiB/s wr, 105 op/s; 576 KiB/s, 1 objects/s recovering 2024-01-13T17:59:10.590 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:10 smithi084 ceph-mon[37908]: mgrmap e20: y(active, since 4s), standbys: x 2024-01-13T17:59:10.591 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:10 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1957292611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:10.591 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:10 smithi084 ceph-mon[52328]: Deploying daemon alertmanager.a on smithi084 2024-01-13T17:59:10.591 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:10 smithi084 ceph-mon[52328]: pgmap v6: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 33 KiB/s rd, 809 KiB/s wr, 105 op/s; 576 KiB/s, 1 objects/s recovering 2024-01-13T17:59:10.591 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:10 smithi084 ceph-mon[52328]: mgrmap e20: y(active, since 4s), standbys: x 2024-01-13T17:59:10.591 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:10 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1957292611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:10.611 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-01-13T17:59:10.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd dump --format=json 2024-01-13T17:59:10.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:10 smithi099 ceph-mon[71325]: Deploying daemon alertmanager.a on smithi084 2024-01-13T17:59:10.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:10 smithi099 ceph-mon[71325]: pgmap v6: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 33 KiB/s rd, 809 KiB/s wr, 105 op/s; 576 KiB/s, 1 objects/s recovering 2024-01-13T17:59:10.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:10 smithi099 ceph-mon[71325]: mgrmap e20: y(active, since 4s), standbys: x 2024-01-13T17:59:10.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:10 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1957292611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:10.898 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:12.238 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:12.239 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:59:06.172263+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-13T17:58:35.312354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-13T17:58:36.379223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"rbd","create_time":"2024-01-13T17:59:04.296556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:6800/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/1455901095":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3916505137":"2024-01-14T17:59:05.164416+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/1946108910":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3513905448":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:59:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:12 smithi099 ceph-mon[71325]: pgmap v7: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 61 KiB/s rd, 485 KiB/s wr, 86 op/s; 346 KiB/s, 1 objects/s recovering 2024-01-13T17:59:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:12 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3960991739' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:12.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:12 smithi084 ceph-mon[37908]: pgmap v7: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 61 KiB/s rd, 485 KiB/s wr, 86 op/s; 346 KiB/s, 1 objects/s recovering 2024-01-13T17:59:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:12 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3960991739' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:12.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:12 smithi084 ceph-mon[52328]: pgmap v7: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 61 KiB/s rd, 485 KiB/s wr, 86 op/s; 346 KiB/s, 1 objects/s recovering 2024-01-13T17:59:12.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:12 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3960991739' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:13.032 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-01-13T17:59:13.033 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-01-13T17:59:13.033 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-01-13T17:59:13.033 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-01-13T17:59:13.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-01-13T17:59:13.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-01-13T17:59:13.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-01-13T17:59:13.035 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-01-13T17:59:13.908 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:13.928 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:14.277 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:14.278 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:14.419 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:14.422 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:14.607 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:14 smithi084 ceph-mon[37908]: pgmap v8: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 347 KiB/s wr, 61 op/s; 247 KiB/s, 0 objects/s recovering 2024-01-13T17:59:14.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:14 smithi084 ceph-mon[52328]: pgmap v8: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 347 KiB/s wr, 61 op/s; 247 KiB/s, 0 objects/s recovering 2024-01-13T17:59:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:14 smithi099 ceph-mon[71325]: pgmap v8: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 347 KiB/s wr, 61 op/s; 247 KiB/s, 0 objects/s recovering 2024-01-13T17:59:14.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:14 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:17:59:14] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T17:59:16.534 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:16 smithi084 ceph-mon[52328]: pgmap v9: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 34 KiB/s rd, 270 KiB/s wr, 47 op/s; 192 KiB/s, 0 objects/s recovering 2024-01-13T17:59:16.535 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:16 smithi084 ceph-mon[37908]: pgmap v9: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 34 KiB/s rd, 270 KiB/s wr, 47 op/s; 192 KiB/s, 0 objects/s recovering 2024-01-13T17:59:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:16 smithi099 ceph-mon[71325]: pgmap v9: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 34 KiB/s rd, 270 KiB/s wr, 47 op/s; 192 KiB/s, 0 objects/s recovering 2024-01-13T17:59:17.277 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:18.031 INFO:teuthology.orchestra.run.smithi084.stdout:128849018903 2024-01-13T17:59:18.031 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-01-13T17:59:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:18 smithi099 ceph-mon[71325]: pgmap v10: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-01-13T17:59:18.633 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:18 smithi084 ceph-mon[37908]: pgmap v10: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-01-13T17:59:18.633 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:18 smithi084 ceph-mon[52328]: pgmap v10: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-01-13T17:59:18.634 INFO:teuthology.orchestra.run.smithi084.stdout:77309411358 2024-01-13T17:59:18.634 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-01-13T17:59:18.750 INFO:teuthology.orchestra.run.smithi084.stdout:107374182427 2024-01-13T17:59:18.751 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-01-13T17:59:19.128 INFO:teuthology.orchestra.run.smithi084.stdout:223338299405 2024-01-13T17:59:19.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-01-13T17:59:19.814 INFO:teuthology.orchestra.run.smithi084.stdout:55834574881 2024-01-13T17:59:19.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-01-13T17:59:20.062 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:20.202 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:20.453 INFO:teuthology.orchestra.run.smithi084.stdout:34359738404 2024-01-13T17:59:20.453 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-01-13T17:59:20.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:20 smithi084 ceph-mon[37908]: pgmap v11: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-01-13T17:59:20.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:20 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:20.483 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:20 smithi084 ceph-mon[52328]: pgmap v11: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-01-13T17:59:20.483 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:20 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:20.483 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[94279]: ts=2024-01-13T17:59:20.299Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-01-13T17:59:20.488 INFO:teuthology.orchestra.run.smithi084.stdout:158913789971 2024-01-13T17:59:20.489 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-01-13T17:59:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:20 smithi099 ceph-mon[71325]: pgmap v11: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-01-13T17:59:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:20 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:20.738 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:20] ENGINE Bus STOPPING 2024-01-13T17:59:20.739 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:20] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T17:59:20.739 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:20] ENGINE Bus STOPPED 2024-01-13T17:59:20.739 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:20] ENGINE Bus STARTING 2024-01-13T17:59:20.739 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:20] ENGINE Serving on http://:::9283 2024-01-13T17:59:20.739 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:20] ENGINE Bus STARTED 2024-01-13T17:59:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:21 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:21 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:21 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:21 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:21 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:21 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:21 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-13T17:59:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:21 smithi099 ceph-mon[71325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-13T17:59:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:21 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:21 smithi099 ceph-mon[71325]: Deploying daemon grafana.a on smithi099 2024-01-13T17:59:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-13T17:59:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[52328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-13T17:59:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[52328]: Deploying daemon grafana.a on smithi099 2024-01-13T17:59:21.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-13T17:59:21.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[37908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-01-13T17:59:21.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:21.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:21 smithi084 ceph-mon[37908]: Deploying daemon grafana.a on smithi099 2024-01-13T17:59:21.739 INFO:teuthology.orchestra.run.smithi084.stdout:188978561039 2024-01-13T17:59:21.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-01-13T17:59:21.769 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:21.802 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:21.899 INFO:teuthology.orchestra.run.smithi084.stdout:107374182428 2024-01-13T17:59:22.332 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182427 got 107374182428 for osd.3 2024-01-13T17:59:22.332 DEBUG:teuthology.parallel:result is None 2024-01-13T17:59:22.348 INFO:teuthology.orchestra.run.smithi084.stdout:128849018904 2024-01-13T17:59:22.496 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:22 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[94279]: ts=2024-01-13T17:59:22.270Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000786823s 2024-01-13T17:59:22.593 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:22.603 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:22.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:22 smithi084 ceph-mon[37908]: pgmap v12: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-01-13T17:59:22.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:22 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/846918417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-13T17:59:22.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:22 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3150239052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-13T17:59:22.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:22 smithi084 ceph-mon[52328]: pgmap v12: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-01-13T17:59:22.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:22 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/846918417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-13T17:59:22.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:22 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3150239052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-13T17:59:22.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:22 smithi099 ceph-mon[71325]: pgmap v12: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-01-13T17:59:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:22 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/846918417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-13T17:59:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:22 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3150239052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-13T17:59:23.376 INFO:teuthology.orchestra.run.smithi084.stdout:77309411359 2024-01-13T17:59:23.429 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018903 got 128849018904 for osd.4 2024-01-13T17:59:23.429 DEBUG:teuthology.parallel:result is None 2024-01-13T17:59:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:23.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:23 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/572331551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-13T17:59:23.666 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:23 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/572331551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-13T17:59:23.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:23 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/572331551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-13T17:59:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:24.055 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411358 got 77309411359 for osd.2 2024-01-13T17:59:24.056 DEBUG:teuthology.parallel:result is None 2024-01-13T17:59:24.316 INFO:teuthology.orchestra.run.smithi084.stdout:223338299406 2024-01-13T17:59:24.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:17:59:24] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T17:59:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:24 smithi099 ceph-mon[71325]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:24 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/4168640886' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-13T17:59:24.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:24 smithi084 ceph-mon[37908]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:24.626 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:24 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/4168640886' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-13T17:59:24.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:24 smithi084 ceph-mon[52328]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:24.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:24 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/4168640886' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-13T17:59:24.978 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299405 got 223338299406 for osd.7 2024-01-13T17:59:24.978 DEBUG:teuthology.parallel:result is None 2024-01-13T17:59:25.326 INFO:teuthology.orchestra.run.smithi084.stdout:55834574882 2024-01-13T17:59:25.540 INFO:teuthology.orchestra.run.smithi084.stdout:158913789972 2024-01-13T17:59:25.901 INFO:teuthology.orchestra.run.smithi084.stdout:188978561040 2024-01-13T17:59:25.933 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574881 got 55834574882 for osd.1 2024-01-13T17:59:25.933 DEBUG:teuthology.parallel:result is None 2024-01-13T17:59:25.961 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789971 got 158913789972 for osd.5 2024-01-13T17:59:25.961 DEBUG:teuthology.parallel:result is None 2024-01-13T17:59:26.387 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561039 got 188978561040 for osd.6 2024-01-13T17:59:26.387 DEBUG:teuthology.parallel:result is None 2024-01-13T17:59:26.500 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:26 smithi084 ceph-mon[37908]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:26.501 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:26 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:26.501 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:26 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1896522448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-13T17:59:26.501 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:26 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2366600132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-13T17:59:26.501 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:26 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1554701728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-13T17:59:26.501 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:26 smithi084 ceph-mon[52328]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:26.501 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:26 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:26.501 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:26 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1896522448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-13T17:59:26.501 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:26 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2366600132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-13T17:59:26.501 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:26 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1554701728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-13T17:59:26.546 INFO:teuthology.orchestra.run.smithi084.stdout:34359738405 2024-01-13T17:59:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:26 smithi099 ceph-mon[71325]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:26 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:26 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1896522448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-13T17:59:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:26 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2366600132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-13T17:59:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:26 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1554701728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-13T17:59:26.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738404 got 34359738405 for osd.0 2024-01-13T17:59:26.894 DEBUG:teuthology.parallel:result is None 2024-01-13T17:59:26.894 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-01-13T17:59:26.894 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph pg dump --format=json 2024-01-13T17:59:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:27 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1451327821' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-13T17:59:27.623 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:27 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1451327821' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-13T17:59:27.623 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:27 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1451327821' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-13T17:59:28.296 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-01-13T17:59:28.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:28 smithi084 ceph-mon[37908]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:28.568 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:28 smithi084 ceph-mon[52328]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:28.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:28 smithi099 ceph-mon[71325]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:28.660 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-01-13T17:59:27.195437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593462,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":315,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2385088,"kb_used_data":6784,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":747576128,"statfs":{"total":767960285184,"available":765517955072,"internally_reserved":0,"allocated":6946816,"data_stored":3954925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002491"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175971+0000","last_change":"2024-01-13T17:58:37.416080+0000","last_active":"2024-01-13T17:59:05.175971+0000","last_peered":"2024-01-13T17:59:05.175971+0000","last_clean":"2024-01-13T17:59:05.175971+0000","last_became_active":"2024-01-13T17:58:37.415621+0000","last_became_peered":"2024-01-13T17:58:37.415621+0000","last_unstale":"2024-01-13T17:59:05.175971+0000","last_undegraded":"2024-01-13T17:59:05.175971+0000","last_fullsized":"2024-01-13T17:59:05.175971+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:40.991399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183536+0000","last_change":"2024-01-13T17:58:37.398891+0000","last_active":"2024-01-13T17:59:05.183536+0000","last_peered":"2024-01-13T17:59:05.183536+0000","last_clean":"2024-01-13T17:59:05.183536+0000","last_became_active":"2024-01-13T17:58:37.398476+0000","last_became_peered":"2024-01-13T17:58:37.398476+0000","last_unstale":"2024-01-13T17:59:05.183536+0000","last_undegraded":"2024-01-13T17:59:05.183536+0000","last_fullsized":"2024-01-13T17:59:05.183536+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:05:39.892184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177794+0000","last_change":"2024-01-13T17:58:37.399839+0000","last_active":"2024-01-13T17:59:05.177794+0000","last_peered":"2024-01-13T17:59:05.177794+0000","last_clean":"2024-01-13T17:59:05.177794+0000","last_became_active":"2024-01-13T17:58:37.399578+0000","last_became_peered":"2024-01-13T17:58:37.399578+0000","last_unstale":"2024-01-13T17:59:05.177794+0000","last_undegraded":"2024-01-13T17:59:05.177794+0000","last_fullsized":"2024-01-13T17:59:05.177794+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:36:22.906393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309318+0000","last_change":"2024-01-13T17:58:37.411528+0000","last_active":"2024-01-13T17:59:05.309318+0000","last_peered":"2024-01-13T17:59:05.309318+0000","last_clean":"2024-01-13T17:59:05.309318+0000","last_became_active":"2024-01-13T17:58:37.411056+0000","last_became_peered":"2024-01-13T17:58:37.411056+0000","last_unstale":"2024-01-13T17:59:05.309318+0000","last_undegraded":"2024-01-13T17:59:05.309318+0000","last_fullsized":"2024-01-13T17:59:05.309318+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:13:24.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175938+0000","last_change":"2024-01-13T17:58:37.415953+0000","last_active":"2024-01-13T17:59:05.175938+0000","last_peered":"2024-01-13T17:59:05.175938+0000","last_clean":"2024-01-13T17:59:05.175938+0000","last_became_active":"2024-01-13T17:58:37.413825+0000","last_became_peered":"2024-01-13T17:58:37.413825+0000","last_unstale":"2024-01-13T17:59:05.175938+0000","last_undegraded":"2024-01-13T17:59:05.175938+0000","last_fullsized":"2024-01-13T17:59:05.175938+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:04:08.326020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309710+0000","last_change":"2024-01-13T17:58:37.399699+0000","last_active":"2024-01-13T17:59:05.309710+0000","last_peered":"2024-01-13T17:59:05.309710+0000","last_clean":"2024-01-13T17:59:05.309710+0000","last_became_active":"2024-01-13T17:58:37.399358+0000","last_became_peered":"2024-01-13T17:58:37.399358+0000","last_unstale":"2024-01-13T17:59:05.309710+0000","last_undegraded":"2024-01-13T17:59:05.309710+0000","last_fullsized":"2024-01-13T17:59:05.309710+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:18.403109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175584+0000","last_change":"2024-01-13T17:58:37.413121+0000","last_active":"2024-01-13T17:59:05.175584+0000","last_peered":"2024-01-13T17:59:05.175584+0000","last_clean":"2024-01-13T17:59:05.175584+0000","last_became_active":"2024-01-13T17:58:37.412816+0000","last_became_peered":"2024-01-13T17:58:37.412816+0000","last_unstale":"2024-01-13T17:59:05.175584+0000","last_undegraded":"2024-01-13T17:59:05.175584+0000","last_fullsized":"2024-01-13T17:59:05.175584+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:05.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177369+0000","last_change":"2024-01-13T17:58:37.393602+0000","last_active":"2024-01-13T17:59:05.177369+0000","last_peered":"2024-01-13T17:59:05.177369+0000","last_clean":"2024-01-13T17:59:05.177369+0000","last_became_active":"2024-01-13T17:58:37.393317+0000","last_became_peered":"2024-01-13T17:58:37.393317+0000","last_unstale":"2024-01-13T17:59:05.177369+0000","last_undegraded":"2024-01-13T17:59:05.177369+0000","last_fullsized":"2024-01-13T17:59:05.177369+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:14:00.225985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175944+0000","last_change":"2024-01-13T17:58:37.416421+0000","last_active":"2024-01-13T17:59:05.175944+0000","last_peered":"2024-01-13T17:59:05.175944+0000","last_clean":"2024-01-13T17:59:05.175944+0000","last_became_active":"2024-01-13T17:58:37.416138+0000","last_became_peered":"2024-01-13T17:58:37.416138+0000","last_unstale":"2024-01-13T17:59:05.175944+0000","last_undegraded":"2024-01-13T17:59:05.175944+0000","last_fullsized":"2024-01-13T17:59:05.175944+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:10:51.751719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180919+0000","last_change":"2024-01-13T17:58:37.397837+0000","last_active":"2024-01-13T17:59:05.180919+0000","last_peered":"2024-01-13T17:59:05.180919+0000","last_clean":"2024-01-13T17:59:05.180919+0000","last_became_active":"2024-01-13T17:58:37.397557+0000","last_became_peered":"2024-01-13T17:58:37.397557+0000","last_unstale":"2024-01-13T17:59:05.180919+0000","last_undegraded":"2024-01-13T17:59:05.180919+0000","last_fullsized":"2024-01-13T17:59:05.180919+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:38:02.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180710+0000","last_change":"2024-01-13T17:58:37.397136+0000","last_active":"2024-01-13T17:59:05.180710+0000","last_peered":"2024-01-13T17:59:05.180710+0000","last_clean":"2024-01-13T17:59:05.180710+0000","last_became_active":"2024-01-13T17:58:37.396796+0000","last_became_peered":"2024-01-13T17:58:37.396796+0000","last_unstale":"2024-01-13T17:59:05.180710+0000","last_undegraded":"2024-01-13T17:59:05.180710+0000","last_fullsized":"2024-01-13T17:59:05.180710+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:09:37.651466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180244+0000","last_change":"2024-01-13T17:58:37.401738+0000","last_active":"2024-01-13T17:59:05.180244+0000","last_peered":"2024-01-13T17:59:05.180244+0000","last_clean":"2024-01-13T17:59:05.180244+0000","last_became_active":"2024-01-13T17:58:37.401390+0000","last_became_peered":"2024-01-13T17:58:37.401390+0000","last_unstale":"2024-01-13T17:59:05.180244+0000","last_undegraded":"2024-01-13T17:59:05.180244+0000","last_fullsized":"2024-01-13T17:59:05.180244+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:10:08.882123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177070+0000","last_change":"2024-01-13T17:58:37.410693+0000","last_active":"2024-01-13T17:59:05.177070+0000","last_peered":"2024-01-13T17:59:05.177070+0000","last_clean":"2024-01-13T17:59:05.177070+0000","last_became_active":"2024-01-13T17:58:37.410478+0000","last_became_peered":"2024-01-13T17:58:37.410478+0000","last_unstale":"2024-01-13T17:59:05.177070+0000","last_undegraded":"2024-01-13T17:59:05.177070+0000","last_fullsized":"2024-01-13T17:59:05.177070+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:54:26.505663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178336+0000","last_change":"2024-01-13T17:58:37.399587+0000","last_active":"2024-01-13T17:59:05.178336+0000","last_peered":"2024-01-13T17:59:05.178336+0000","last_clean":"2024-01-13T17:59:05.178336+0000","last_became_active":"2024-01-13T17:58:37.399266+0000","last_became_peered":"2024-01-13T17:58:37.399266+0000","last_unstale":"2024-01-13T17:59:05.178336+0000","last_undegraded":"2024-01-13T17:59:05.178336+0000","last_fullsized":"2024-01-13T17:59:05.178336+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:45:41.896344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.182878+0000","last_change":"2024-01-13T17:58:37.394829+0000","last_active":"2024-01-13T17:59:05.182878+0000","last_peered":"2024-01-13T17:59:05.182878+0000","last_clean":"2024-01-13T17:59:05.182878+0000","last_became_active":"2024-01-13T17:58:37.394582+0000","last_became_peered":"2024-01-13T17:58:37.394582+0000","last_unstale":"2024-01-13T17:59:05.182878+0000","last_undegraded":"2024-01-13T17:59:05.182878+0000","last_fullsized":"2024-01-13T17:59:05.182878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:52:38.944942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309202+0000","last_change":"2024-01-13T17:58:37.412247+0000","last_active":"2024-01-13T17:59:05.309202+0000","last_peered":"2024-01-13T17:59:05.309202+0000","last_clean":"2024-01-13T17:59:05.309202+0000","last_became_active":"2024-01-13T17:58:37.411947+0000","last_became_peered":"2024-01-13T17:58:37.411947+0000","last_unstale":"2024-01-13T17:59:05.309202+0000","last_undegraded":"2024-01-13T17:59:05.309202+0000","last_fullsized":"2024-01-13T17:59:05.309202+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:05:19.184972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309757+0000","last_change":"2024-01-13T17:58:37.411858+0000","last_active":"2024-01-13T17:59:05.309757+0000","last_peered":"2024-01-13T17:59:05.309757+0000","last_clean":"2024-01-13T17:59:05.309757+0000","last_became_active":"2024-01-13T17:58:37.411559+0000","last_became_peered":"2024-01-13T17:58:37.411559+0000","last_unstale":"2024-01-13T17:59:05.309757+0000","last_undegraded":"2024-01-13T17:59:05.309757+0000","last_fullsized":"2024-01-13T17:59:05.309757+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:00:40.870815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546374+0000","last_change":"2024-01-13T17:58:37.409078+0000","last_active":"2024-01-13T17:59:05.546374+0000","last_peered":"2024-01-13T17:59:05.546374+0000","last_clean":"2024-01-13T17:59:05.546374+0000","last_became_active":"2024-01-13T17:58:37.408820+0000","last_became_peered":"2024-01-13T17:58:37.408820+0000","last_unstale":"2024-01-13T17:59:05.546374+0000","last_undegraded":"2024-01-13T17:59:05.546374+0000","last_fullsized":"2024-01-13T17:59:05.546374+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:30:37.097173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176090+0000","last_change":"2024-01-13T17:58:37.414485+0000","last_active":"2024-01-13T17:59:05.176090+0000","last_peered":"2024-01-13T17:59:05.176090+0000","last_clean":"2024-01-13T17:59:05.176090+0000","last_became_active":"2024-01-13T17:58:37.414182+0000","last_became_peered":"2024-01-13T17:58:37.414182+0000","last_unstale":"2024-01-13T17:59:05.176090+0000","last_undegraded":"2024-01-13T17:59:05.176090+0000","last_fullsized":"2024-01-13T17:59:05.176090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:08:50.844685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"59'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178930+0000","last_change":"2024-01-13T17:58:36.839635+0000","last_active":"2024-01-13T17:59:05.178930+0000","last_peered":"2024-01-13T17:59:05.178930+0000","last_clean":"2024-01-13T17:59:05.178930+0000","last_became_active":"2024-01-13T17:58:36.839344+0000","last_became_peered":"2024-01-13T17:58:36.839344+0000","last_unstale":"2024-01-13T17:59:05.178930+0000","last_undegraded":"2024-01-13T17:59:05.178930+0000","last_fullsized":"2024-01-13T17:59:05.178930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:41:18.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177711+0000","last_change":"2024-01-13T17:58:37.403720+0000","last_active":"2024-01-13T17:59:05.177711+0000","last_peered":"2024-01-13T17:59:05.177711+0000","last_clean":"2024-01-13T17:59:05.177711+0000","last_became_active":"2024-01-13T17:58:37.403390+0000","last_became_peered":"2024-01-13T17:58:37.403390+0000","last_unstale":"2024-01-13T17:59:05.177711+0000","last_undegraded":"2024-01-13T17:59:05.177711+0000","last_fullsized":"2024-01-13T17:59:05.177711+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:38:09.594828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"59'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177799+0000","last_change":"2024-01-13T17:58:36.846725+0000","last_active":"2024-01-13T17:59:05.177799+0000","last_peered":"2024-01-13T17:59:05.177799+0000","last_clean":"2024-01-13T17:59:05.177799+0000","last_became_active":"2024-01-13T17:58:36.846375+0000","last_became_peered":"2024-01-13T17:58:36.846375+0000","last_unstale":"2024-01-13T17:59:05.177799+0000","last_undegraded":"2024-01-13T17:59:05.177799+0000","last_fullsized":"2024-01-13T17:59:05.177799+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:06:04.006535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178795+0000","last_change":"2024-01-13T17:58:37.395186+0000","last_active":"2024-01-13T17:59:05.178795+0000","last_peered":"2024-01-13T17:59:05.178795+0000","last_clean":"2024-01-13T17:59:05.178795+0000","last_became_active":"2024-01-13T17:58:37.394880+0000","last_became_peered":"2024-01-13T17:58:37.394880+0000","last_unstale":"2024-01-13T17:59:05.178795+0000","last_undegraded":"2024-01-13T17:59:05.178795+0000","last_fullsized":"2024-01-13T17:59:05.178795+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:02:59.539263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176411+0000","last_change":"2024-01-13T17:58:36.845520+0000","last_active":"2024-01-13T17:59:05.176411+0000","last_peered":"2024-01-13T17:59:05.176411+0000","last_clean":"2024-01-13T17:59:05.176411+0000","last_became_active":"2024-01-13T17:58:36.845229+0000","last_became_peered":"2024-01-13T17:58:36.845229+0000","last_unstale":"2024-01-13T17:59:05.176411+0000","last_undegraded":"2024-01-13T17:59:05.176411+0000","last_fullsized":"2024-01-13T17:59:05.176411+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:08:01.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309528+0000","last_change":"2024-01-13T17:58:37.400143+0000","last_active":"2024-01-13T17:59:05.309528+0000","last_peered":"2024-01-13T17:59:05.309528+0000","last_clean":"2024-01-13T17:59:05.309528+0000","last_became_active":"2024-01-13T17:58:37.399689+0000","last_became_peered":"2024-01-13T17:58:37.399689+0000","last_unstale":"2024-01-13T17:59:05.309528+0000","last_undegraded":"2024-01-13T17:59:05.309528+0000","last_fullsized":"2024-01-13T17:59:05.309528+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:32:04.518468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175840+0000","last_change":"2024-01-13T17:58:36.843954+0000","last_active":"2024-01-13T17:59:05.175840+0000","last_peered":"2024-01-13T17:59:05.175840+0000","last_clean":"2024-01-13T17:59:05.175840+0000","last_became_active":"2024-01-13T17:58:36.843616+0000","last_became_peered":"2024-01-13T17:58:36.843616+0000","last_unstale":"2024-01-13T17:59:05.175840+0000","last_undegraded":"2024-01-13T17:59:05.175840+0000","last_fullsized":"2024-01-13T17:59:05.175840+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:37:08.466053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309531+0000","last_change":"2024-01-13T17:58:37.399242+0000","last_active":"2024-01-13T17:59:05.309531+0000","last_peered":"2024-01-13T17:59:05.309531+0000","last_clean":"2024-01-13T17:59:05.309531+0000","last_became_active":"2024-01-13T17:58:37.398793+0000","last_became_peered":"2024-01-13T17:58:37.398793+0000","last_unstale":"2024-01-13T17:59:05.309531+0000","last_undegraded":"2024-01-13T17:59:05.309531+0000","last_fullsized":"2024-01-13T17:59:05.309531+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:05:43.194645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"59'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177290+0000","last_change":"2024-01-13T17:58:36.838743+0000","last_active":"2024-01-13T17:59:05.177290+0000","last_peered":"2024-01-13T17:59:05.177290+0000","last_clean":"2024-01-13T17:59:05.177290+0000","last_became_active":"2024-01-13T17:58:36.838444+0000","last_became_peered":"2024-01-13T17:58:36.838444+0000","last_unstale":"2024-01-13T17:59:05.177290+0000","last_undegraded":"2024-01-13T17:59:05.177290+0000","last_fullsized":"2024-01-13T17:59:05.177290+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:48:37.841281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.179990+0000","last_change":"2024-01-13T17:58:37.401094+0000","last_active":"2024-01-13T17:59:05.179990+0000","last_peered":"2024-01-13T17:59:05.179990+0000","last_clean":"2024-01-13T17:59:05.179990+0000","last_became_active":"2024-01-13T17:58:37.400621+0000","last_became_peered":"2024-01-13T17:58:37.400621+0000","last_unstale":"2024-01-13T17:59:05.179990+0000","last_undegraded":"2024-01-13T17:59:05.179990+0000","last_fullsized":"2024-01-13T17:59:05.179990+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:15:46.371336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"59'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181983+0000","last_change":"2024-01-13T17:58:36.832810+0000","last_active":"2024-01-13T17:59:05.181983+0000","last_peered":"2024-01-13T17:59:05.181983+0000","last_clean":"2024-01-13T17:59:05.181983+0000","last_became_active":"2024-01-13T17:58:36.831491+0000","last_became_peered":"2024-01-13T17:58:36.831491+0000","last_unstale":"2024-01-13T17:59:05.181983+0000","last_undegraded":"2024-01-13T17:59:05.181983+0000","last_fullsized":"2024-01-13T17:59:05.181983+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:50:10.505869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177743+0000","last_change":"2024-01-13T17:58:37.408148+0000","last_active":"2024-01-13T17:59:05.177743+0000","last_peered":"2024-01-13T17:59:05.177743+0000","last_clean":"2024-01-13T17:59:05.177743+0000","last_became_active":"2024-01-13T17:58:37.407858+0000","last_became_peered":"2024-01-13T17:58:37.407858+0000","last_unstale":"2024-01-13T17:59:05.177743+0000","last_undegraded":"2024-01-13T17:59:05.177743+0000","last_fullsized":"2024-01-13T17:59:05.177743+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:35:47.284096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176950+0000","last_change":"2024-01-13T17:58:36.843139+0000","last_active":"2024-01-13T17:59:05.176950+0000","last_peered":"2024-01-13T17:59:05.176950+0000","last_clean":"2024-01-13T17:59:05.176950+0000","last_became_active":"2024-01-13T17:58:36.842487+0000","last_became_peered":"2024-01-13T17:58:36.842487+0000","last_unstale":"2024-01-13T17:59:05.176950+0000","last_undegraded":"2024-01-13T17:59:05.176950+0000","last_fullsized":"2024-01-13T17:59:05.176950+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:28:01.688683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177879+0000","last_change":"2024-01-13T17:58:37.401772+0000","last_active":"2024-01-13T17:59:05.177879+0000","last_peered":"2024-01-13T17:59:05.177879+0000","last_clean":"2024-01-13T17:59:05.177879+0000","last_became_active":"2024-01-13T17:58:37.401490+0000","last_became_peered":"2024-01-13T17:58:37.401490+0000","last_unstale":"2024-01-13T17:59:05.177879+0000","last_undegraded":"2024-01-13T17:59:05.177879+0000","last_fullsized":"2024-01-13T17:59:05.177879+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:32:13.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309286+0000","last_change":"2024-01-13T17:58:36.842527+0000","last_active":"2024-01-13T17:59:05.309286+0000","last_peered":"2024-01-13T17:59:05.309286+0000","last_clean":"2024-01-13T17:59:05.309286+0000","last_became_active":"2024-01-13T17:58:36.841820+0000","last_became_peered":"2024-01-13T17:58:36.841820+0000","last_unstale":"2024-01-13T17:59:05.309286+0000","last_undegraded":"2024-01-13T17:59:05.309286+0000","last_fullsized":"2024-01-13T17:59:05.309286+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:02.120533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183074+0000","last_change":"2024-01-13T17:58:37.393987+0000","last_active":"2024-01-13T17:59:05.183074+0000","last_peered":"2024-01-13T17:59:05.183074+0000","last_clean":"2024-01-13T17:59:05.183074+0000","last_became_active":"2024-01-13T17:58:37.393657+0000","last_became_peered":"2024-01-13T17:58:37.393657+0000","last_unstale":"2024-01-13T17:59:05.183074+0000","last_undegraded":"2024-01-13T17:59:05.183074+0000","last_fullsized":"2024-01-13T17:59:05.183074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:44.818236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181323+0000","last_change":"2024-01-13T17:58:36.843560+0000","last_active":"2024-01-13T17:59:05.181323+0000","last_peered":"2024-01-13T17:59:05.181323+0000","last_clean":"2024-01-13T17:59:05.181323+0000","last_became_active":"2024-01-13T17:58:36.843290+0000","last_became_peered":"2024-01-13T17:58:36.843290+0000","last_unstale":"2024-01-13T17:59:05.181323+0000","last_undegraded":"2024-01-13T17:59:05.181323+0000","last_fullsized":"2024-01-13T17:59:05.181323+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:12:58.012752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309998+0000","last_change":"2024-01-13T17:58:37.412880+0000","last_active":"2024-01-13T17:59:05.309998+0000","last_peered":"2024-01-13T17:59:05.309998+0000","last_clean":"2024-01-13T17:59:05.309998+0000","last_became_active":"2024-01-13T17:58:37.412519+0000","last_became_peered":"2024-01-13T17:58:37.412519+0000","last_unstale":"2024-01-13T17:59:05.309998+0000","last_undegraded":"2024-01-13T17:59:05.309998+0000","last_fullsized":"2024-01-13T17:59:05.309998+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:40:03.956715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309904+0000","last_change":"2024-01-13T17:58:36.841704+0000","last_active":"2024-01-13T17:59:05.309904+0000","last_peered":"2024-01-13T17:59:05.309904+0000","last_clean":"2024-01-13T17:59:05.309904+0000","last_became_active":"2024-01-13T17:58:36.841409+0000","last_became_peered":"2024-01-13T17:58:36.841409+0000","last_unstale":"2024-01-13T17:59:05.309904+0000","last_undegraded":"2024-01-13T17:59:05.309904+0000","last_fullsized":"2024-01-13T17:59:05.309904+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:56:02.964249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178720+0000","last_change":"2024-01-13T17:58:37.403381+0000","last_active":"2024-01-13T17:59:05.178720+0000","last_peered":"2024-01-13T17:59:05.178720+0000","last_clean":"2024-01-13T17:59:05.178720+0000","last_became_active":"2024-01-13T17:58:37.403108+0000","last_became_peered":"2024-01-13T17:58:37.403108+0000","last_unstale":"2024-01-13T17:59:05.178720+0000","last_undegraded":"2024-01-13T17:59:05.178720+0000","last_fullsized":"2024-01-13T17:59:05.178720+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:55:07.654474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"59'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183619+0000","last_change":"2024-01-13T17:58:36.835474+0000","last_active":"2024-01-13T17:59:05.183619+0000","last_peered":"2024-01-13T17:59:05.183619+0000","last_clean":"2024-01-13T17:59:05.183619+0000","last_became_active":"2024-01-13T17:58:36.835169+0000","last_became_peered":"2024-01-13T17:58:36.835169+0000","last_unstale":"2024-01-13T17:59:05.183619+0000","last_undegraded":"2024-01-13T17:59:05.183619+0000","last_fullsized":"2024-01-13T17:59:05.183619+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:02:02.178682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180210+0000","last_change":"2024-01-13T17:58:37.407252+0000","last_active":"2024-01-13T17:59:05.180210+0000","last_peered":"2024-01-13T17:59:05.180210+0000","last_clean":"2024-01-13T17:59:05.180210+0000","last_became_active":"2024-01-13T17:58:37.406352+0000","last_became_peered":"2024-01-13T17:58:37.406352+0000","last_unstale":"2024-01-13T17:59:05.180210+0000","last_undegraded":"2024-01-13T17:59:05.180210+0000","last_fullsized":"2024-01-13T17:59:05.180210+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:21:50.223964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"62'9","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.316696+0000","last_change":"2024-01-13T17:58:36.836500+0000","last_active":"2024-01-13T17:59:05.316696+0000","last_peered":"2024-01-13T17:59:05.316696+0000","last_clean":"2024-01-13T17:59:05.316696+0000","last_became_active":"2024-01-13T17:58:36.836231+0000","last_became_peered":"2024-01-13T17:58:36.836231+0000","last_unstale":"2024-01-13T17:59:05.316696+0000","last_undegraded":"2024-01-13T17:59:05.316696+0000","last_fullsized":"2024-01-13T17:59:05.316696+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:40:58.818088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2324,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176172+0000","last_change":"2024-01-13T17:58:37.409657+0000","last_active":"2024-01-13T17:59:05.176172+0000","last_peered":"2024-01-13T17:59:05.176172+0000","last_clean":"2024-01-13T17:59:05.176172+0000","last_became_active":"2024-01-13T17:58:37.409373+0000","last_became_peered":"2024-01-13T17:58:37.409373+0000","last_unstale":"2024-01-13T17:59:05.176172+0000","last_undegraded":"2024-01-13T17:59:05.176172+0000","last_fullsized":"2024-01-13T17:59:05.176172+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:04.184668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177982+0000","last_change":"2024-01-13T17:58:36.841243+0000","last_active":"2024-01-13T17:59:05.177982+0000","last_peered":"2024-01-13T17:59:05.177982+0000","last_clean":"2024-01-13T17:59:05.177982+0000","last_became_active":"2024-01-13T17:58:36.840803+0000","last_became_peered":"2024-01-13T17:58:36.840803+0000","last_unstale":"2024-01-13T17:59:05.177982+0000","last_undegraded":"2024-01-13T17:59:05.177982+0000","last_fullsized":"2024-01-13T17:59:05.177982+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:02:14.255922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178255+0000","last_change":"2024-01-13T17:58:37.409006+0000","last_active":"2024-01-13T17:59:05.178255+0000","last_peered":"2024-01-13T17:59:05.178255+0000","last_clean":"2024-01-13T17:59:05.178255+0000","last_became_active":"2024-01-13T17:58:37.408736+0000","last_became_peered":"2024-01-13T17:58:37.408736+0000","last_unstale":"2024-01-13T17:59:05.178255+0000","last_undegraded":"2024-01-13T17:59:05.178255+0000","last_fullsized":"2024-01-13T17:59:05.178255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:10:11.734133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309525+0000","last_change":"2024-01-13T17:58:36.841162+0000","last_active":"2024-01-13T17:59:05.309525+0000","last_peered":"2024-01-13T17:59:05.309525+0000","last_clean":"2024-01-13T17:59:05.309525+0000","last_became_active":"2024-01-13T17:58:36.840845+0000","last_became_peered":"2024-01-13T17:58:36.840845+0000","last_unstale":"2024-01-13T17:59:05.309525+0000","last_undegraded":"2024-01-13T17:59:05.309525+0000","last_fullsized":"2024-01-13T17:59:05.309525+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:56:48.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175876+0000","last_change":"2024-01-13T17:58:37.414263+0000","last_active":"2024-01-13T17:59:05.175876+0000","last_peered":"2024-01-13T17:59:05.175876+0000","last_clean":"2024-01-13T17:59:05.175876+0000","last_became_active":"2024-01-13T17:58:37.410388+0000","last_became_peered":"2024-01-13T17:58:37.410388+0000","last_unstale":"2024-01-13T17:59:05.175876+0000","last_undegraded":"2024-01-13T17:59:05.175876+0000","last_fullsized":"2024-01-13T17:59:05.175876+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:55:00.346625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.179987+0000","last_change":"2024-01-13T17:58:36.834846+0000","last_active":"2024-01-13T17:59:05.179987+0000","last_peered":"2024-01-13T17:59:05.179987+0000","last_clean":"2024-01-13T17:59:05.179987+0000","last_became_active":"2024-01-13T17:58:36.834531+0000","last_became_peered":"2024-01-13T17:58:36.834531+0000","last_unstale":"2024-01-13T17:59:05.179987+0000","last_undegraded":"2024-01-13T17:59:05.179987+0000","last_fullsized":"2024-01-13T17:59:05.179987+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:12:41.632590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.179967+0000","last_change":"2024-01-13T17:58:37.394865+0000","last_active":"2024-01-13T17:59:05.179967+0000","last_peered":"2024-01-13T17:59:05.179967+0000","last_clean":"2024-01-13T17:59:05.179967+0000","last_became_active":"2024-01-13T17:58:37.394490+0000","last_became_peered":"2024-01-13T17:58:37.394490+0000","last_unstale":"2024-01-13T17:59:05.179967+0000","last_undegraded":"2024-01-13T17:59:05.179967+0000","last_fullsized":"2024-01-13T17:59:05.179967+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:04:30.784006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"59'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546433+0000","last_change":"2024-01-13T17:58:36.831518+0000","last_active":"2024-01-13T17:59:05.546433+0000","last_peered":"2024-01-13T17:59:05.546433+0000","last_clean":"2024-01-13T17:59:05.546433+0000","last_became_active":"2024-01-13T17:58:36.831252+0000","last_became_peered":"2024-01-13T17:58:36.831252+0000","last_unstale":"2024-01-13T17:59:05.546433+0000","last_undegraded":"2024-01-13T17:59:05.546433+0000","last_fullsized":"2024-01-13T17:59:05.546433+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:42:53.797821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175712+0000","last_change":"2024-01-13T17:58:37.414840+0000","last_active":"2024-01-13T17:59:05.175712+0000","last_peered":"2024-01-13T17:59:05.175712+0000","last_clean":"2024-01-13T17:59:05.175712+0000","last_became_active":"2024-01-13T17:58:37.414540+0000","last_became_peered":"2024-01-13T17:58:37.414540+0000","last_unstale":"2024-01-13T17:59:05.175712+0000","last_undegraded":"2024-01-13T17:59:05.175712+0000","last_fullsized":"2024-01-13T17:59:05.175712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:57.534623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"59'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180853+0000","last_change":"2024-01-13T17:58:36.831411+0000","last_active":"2024-01-13T17:59:05.180853+0000","last_peered":"2024-01-13T17:59:05.180853+0000","last_clean":"2024-01-13T17:59:05.180853+0000","last_became_active":"2024-01-13T17:58:36.831126+0000","last_became_peered":"2024-01-13T17:58:36.831126+0000","last_unstale":"2024-01-13T17:59:05.180853+0000","last_undegraded":"2024-01-13T17:59:05.180853+0000","last_fullsized":"2024-01-13T17:59:05.180853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:12:48.869393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176034+0000","last_change":"2024-01-13T17:58:37.408885+0000","last_active":"2024-01-13T17:59:05.176034+0000","last_peered":"2024-01-13T17:59:05.176034+0000","last_clean":"2024-01-13T17:59:05.176034+0000","last_became_active":"2024-01-13T17:58:37.408618+0000","last_became_peered":"2024-01-13T17:58:37.408618+0000","last_unstale":"2024-01-13T17:59:05.176034+0000","last_undegraded":"2024-01-13T17:59:05.176034+0000","last_fullsized":"2024-01-13T17:59:05.176034+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:18:38.241218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.311690+0000","last_change":"2024-01-13T17:59:05.310836+0000","last_active":"2024-01-13T17:59:05.311690+0000","last_peered":"2024-01-13T17:59:05.311690+0000","last_clean":"2024-01-13T17:59:05.311690+0000","last_became_active":"2024-01-13T17:59:05.310557+0000","last_became_peered":"2024-01-13T17:59:05.310557+0000","last_unstale":"2024-01-13T17:59:05.311690+0000","last_undegraded":"2024-01-13T17:59:05.311690+0000","last_fullsized":"2024-01-13T17:59:05.311690+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:10:08.926746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.182755+0000","last_change":"2024-01-13T17:58:36.832399+0000","last_active":"2024-01-13T17:59:05.182755+0000","last_peered":"2024-01-13T17:59:05.182755+0000","last_clean":"2024-01-13T17:59:05.182755+0000","last_became_active":"2024-01-13T17:58:36.832100+0000","last_became_peered":"2024-01-13T17:58:36.832100+0000","last_unstale":"2024-01-13T17:59:05.182755+0000","last_undegraded":"2024-01-13T17:59:05.182755+0000","last_fullsized":"2024-01-13T17:59:05.182755+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:01:50.555635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309578+0000","last_change":"2024-01-13T17:58:37.402741+0000","last_active":"2024-01-13T17:59:05.309578+0000","last_peered":"2024-01-13T17:59:05.309578+0000","last_clean":"2024-01-13T17:59:05.309578+0000","last_became_active":"2024-01-13T17:58:37.402379+0000","last_became_peered":"2024-01-13T17:58:37.402379+0000","last_unstale":"2024-01-13T17:59:05.309578+0000","last_undegraded":"2024-01-13T17:59:05.309578+0000","last_fullsized":"2024-01-13T17:59:05.309578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:30:51.621102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.549487+0000","last_change":"2024-01-13T17:59:05.547393+0000","last_active":"2024-01-13T17:59:05.549487+0000","last_peered":"2024-01-13T17:59:05.549487+0000","last_clean":"2024-01-13T17:59:05.549487+0000","last_became_active":"2024-01-13T17:59:05.547105+0000","last_became_peered":"2024-01-13T17:59:05.547105+0000","last_unstale":"2024-01-13T17:59:05.549487+0000","last_undegraded":"2024-01-13T17:59:05.549487+0000","last_fullsized":"2024-01-13T17:59:05.549487+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:28:35.317481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309440+0000","last_change":"2024-01-13T17:58:36.836469+0000","last_active":"2024-01-13T17:59:05.309440+0000","last_peered":"2024-01-13T17:59:05.309440+0000","last_clean":"2024-01-13T17:59:05.309440+0000","last_became_active":"2024-01-13T17:58:36.836161+0000","last_became_peered":"2024-01-13T17:58:36.836161+0000","last_unstale":"2024-01-13T17:59:05.309440+0000","last_undegraded":"2024-01-13T17:59:05.309440+0000","last_fullsized":"2024-01-13T17:59:05.309440+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:00:00.583677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180878+0000","last_change":"2024-01-13T17:58:37.411383+0000","last_active":"2024-01-13T17:59:05.180878+0000","last_peered":"2024-01-13T17:59:05.180878+0000","last_clean":"2024-01-13T17:59:05.180878+0000","last_became_active":"2024-01-13T17:58:37.411086+0000","last_became_peered":"2024-01-13T17:58:37.411086+0000","last_unstale":"2024-01-13T17:59:05.180878+0000","last_undegraded":"2024-01-13T17:59:05.180878+0000","last_fullsized":"2024-01-13T17:59:05.180878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:29:49.851426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.311473+0000","last_change":"2024-01-13T17:59:05.310768+0000","last_active":"2024-01-13T17:59:05.311473+0000","last_peered":"2024-01-13T17:59:05.311473+0000","last_clean":"2024-01-13T17:59:05.311473+0000","last_became_active":"2024-01-13T17:59:05.310540+0000","last_became_peered":"2024-01-13T17:59:05.310540+0000","last_unstale":"2024-01-13T17:59:05.311473+0000","last_undegraded":"2024-01-13T17:59:05.311473+0000","last_fullsized":"2024-01-13T17:59:05.311473+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:08:47.529142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.182738+0000","last_change":"2024-01-13T17:58:37.395912+0000","last_active":"2024-01-13T17:59:05.182738+0000","last_peered":"2024-01-13T17:59:05.182738+0000","last_clean":"2024-01-13T17:59:05.182738+0000","last_became_active":"2024-01-13T17:58:37.395625+0000","last_became_peered":"2024-01-13T17:58:37.395625+0000","last_unstale":"2024-01-13T17:59:05.182738+0000","last_undegraded":"2024-01-13T17:59:05.182738+0000","last_fullsized":"2024-01-13T17:59:05.182738+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:28.565536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546203+0000","last_change":"2024-01-13T17:58:36.839719+0000","last_active":"2024-01-13T17:59:05.546203+0000","last_peered":"2024-01-13T17:59:05.546203+0000","last_clean":"2024-01-13T17:59:05.546203+0000","last_became_active":"2024-01-13T17:58:36.839440+0000","last_became_peered":"2024-01-13T17:58:36.839440+0000","last_unstale":"2024-01-13T17:59:05.546203+0000","last_undegraded":"2024-01-13T17:59:05.546203+0000","last_fullsized":"2024-01-13T17:59:05.546203+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:17:50.836804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.182907+0000","last_change":"2024-01-13T17:59:05.182636+0000","last_active":"2024-01-13T17:59:05.182907+0000","last_peered":"2024-01-13T17:59:05.182907+0000","last_clean":"2024-01-13T17:59:05.182907+0000","last_became_active":"2024-01-13T17:59:05.182314+0000","last_became_peered":"2024-01-13T17:59:05.182314+0000","last_unstale":"2024-01-13T17:59:05.182907+0000","last_undegraded":"2024-01-13T17:59:05.182907+0000","last_fullsized":"2024-01-13T17:59:05.182907+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:32:50.369684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176919+0000","last_change":"2024-01-13T17:58:37.397651+0000","last_active":"2024-01-13T17:59:05.176919+0000","last_peered":"2024-01-13T17:59:05.176919+0000","last_clean":"2024-01-13T17:59:05.176919+0000","last_became_active":"2024-01-13T17:58:37.397326+0000","last_became_peered":"2024-01-13T17:58:37.397326+0000","last_unstale":"2024-01-13T17:59:05.176919+0000","last_undegraded":"2024-01-13T17:59:05.176919+0000","last_fullsized":"2024-01-13T17:59:05.176919+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:24:26.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309258+0000","last_change":"2024-01-13T17:58:36.842492+0000","last_active":"2024-01-13T17:59:05.309258+0000","last_peered":"2024-01-13T17:59:05.309258+0000","last_clean":"2024-01-13T17:59:05.309258+0000","last_became_active":"2024-01-13T17:58:36.842172+0000","last_became_peered":"2024-01-13T17:58:36.842172+0000","last_unstale":"2024-01-13T17:59:05.309258+0000","last_undegraded":"2024-01-13T17:59:05.309258+0000","last_fullsized":"2024-01-13T17:59:05.309258+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:58:24.249555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"63'128","reported_seq":274,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-01-13T17:59:07.280553+0000","last_change":"2024-01-13T17:58:27.209773+0000","last_active":"2024-01-13T17:59:07.280553+0000","last_peered":"2024-01-13T17:59:07.280553+0000","last_clean":"2024-01-13T17:59:07.280553+0000","last_became_active":"2024-01-13T17:58:27.209293+0000","last_became_peered":"2024-01-13T17:58:27.209293+0000","last_unstale":"2024-01-13T17:59:07.280553+0000","last_undegraded":"2024-01-13T17:59:07.280553+0000","last_fullsized":"2024-01-13T17:59:07.280553+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_clean_scrub_stamp":"2024-01-13T17:56:59.530229+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:45:29.626217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.548596+0000","last_change":"2024-01-13T17:59:05.547394+0000","last_active":"2024-01-13T17:59:05.548596+0000","last_peered":"2024-01-13T17:59:05.548596+0000","last_clean":"2024-01-13T17:59:05.548596+0000","last_became_active":"2024-01-13T17:59:05.547115+0000","last_became_peered":"2024-01-13T17:59:05.547115+0000","last_unstale":"2024-01-13T17:59:05.548596+0000","last_undegraded":"2024-01-13T17:59:05.548596+0000","last_fullsized":"2024-01-13T17:59:05.548596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:38:56.099495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177580+0000","last_change":"2024-01-13T17:58:37.403318+0000","last_active":"2024-01-13T17:59:05.177580+0000","last_peered":"2024-01-13T17:59:05.177580+0000","last_clean":"2024-01-13T17:59:05.177580+0000","last_became_active":"2024-01-13T17:58:37.403022+0000","last_became_peered":"2024-01-13T17:58:37.403022+0000","last_unstale":"2024-01-13T17:59:05.177580+0000","last_undegraded":"2024-01-13T17:59:05.177580+0000","last_fullsized":"2024-01-13T17:59:05.177580+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:13:06.307215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175515+0000","last_change":"2024-01-13T17:58:36.844962+0000","last_active":"2024-01-13T17:59:05.175515+0000","last_peered":"2024-01-13T17:59:05.175515+0000","last_clean":"2024-01-13T17:59:05.175515+0000","last_became_active":"2024-01-13T17:58:36.844443+0000","last_became_peered":"2024-01-13T17:58:36.844443+0000","last_unstale":"2024-01-13T17:59:05.175515+0000","last_undegraded":"2024-01-13T17:59:05.175515+0000","last_fullsized":"2024-01-13T17:59:05.175515+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:13:21.802704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.310961+0000","last_change":"2024-01-13T17:59:05.310298+0000","last_active":"2024-01-13T17:59:05.310961+0000","last_peered":"2024-01-13T17:59:05.310961+0000","last_clean":"2024-01-13T17:59:05.310961+0000","last_became_active":"2024-01-13T17:59:05.310046+0000","last_became_peered":"2024-01-13T17:59:05.310046+0000","last_unstale":"2024-01-13T17:59:05.310961+0000","last_undegraded":"2024-01-13T17:59:05.310961+0000","last_fullsized":"2024-01-13T17:59:05.310961+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:32:39.783518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176327+0000","last_change":"2024-01-13T17:58:36.845469+0000","last_active":"2024-01-13T17:59:05.176327+0000","last_peered":"2024-01-13T17:59:05.176327+0000","last_clean":"2024-01-13T17:59:05.176327+0000","last_became_active":"2024-01-13T17:58:36.845158+0000","last_became_peered":"2024-01-13T17:58:36.845158+0000","last_unstale":"2024-01-13T17:59:05.176327+0000","last_undegraded":"2024-01-13T17:59:05.176327+0000","last_fullsized":"2024-01-13T17:59:05.176327+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:46.603258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183479+0000","last_change":"2024-01-13T17:58:37.395393+0000","last_active":"2024-01-13T17:59:05.183479+0000","last_peered":"2024-01-13T17:59:05.183479+0000","last_clean":"2024-01-13T17:59:05.183479+0000","last_became_active":"2024-01-13T17:58:37.395105+0000","last_became_peered":"2024-01-13T17:58:37.395105+0000","last_unstale":"2024-01-13T17:59:05.183479+0000","last_undegraded":"2024-01-13T17:59:05.183479+0000","last_fullsized":"2024-01-13T17:59:05.183479+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:12.100528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181621+0000","last_change":"2024-01-13T17:59:05.180992+0000","last_active":"2024-01-13T17:59:05.181621+0000","last_peered":"2024-01-13T17:59:05.181621+0000","last_clean":"2024-01-13T17:59:05.181621+0000","last_became_active":"2024-01-13T17:59:05.180705+0000","last_became_peered":"2024-01-13T17:59:05.180705+0000","last_unstale":"2024-01-13T17:59:05.181621+0000","last_undegraded":"2024-01-13T17:59:05.181621+0000","last_fullsized":"2024-01-13T17:59:05.181621+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:28:08.013633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183679+0000","last_change":"2024-01-13T17:58:36.841642+0000","last_active":"2024-01-13T17:59:05.183679+0000","last_peered":"2024-01-13T17:59:05.183679+0000","last_clean":"2024-01-13T17:59:05.183679+0000","last_became_active":"2024-01-13T17:58:36.840768+0000","last_became_peered":"2024-01-13T17:58:36.840768+0000","last_unstale":"2024-01-13T17:59:05.183679+0000","last_undegraded":"2024-01-13T17:59:05.183679+0000","last_fullsized":"2024-01-13T17:59:05.183679+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:03:26.813924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177957+0000","last_change":"2024-01-13T17:58:37.414477+0000","last_active":"2024-01-13T17:59:05.177957+0000","last_peered":"2024-01-13T17:59:05.177957+0000","last_clean":"2024-01-13T17:59:05.177957+0000","last_became_active":"2024-01-13T17:58:37.414307+0000","last_became_peered":"2024-01-13T17:58:37.414307+0000","last_unstale":"2024-01-13T17:59:05.177957+0000","last_undegraded":"2024-01-13T17:59:05.177957+0000","last_fullsized":"2024-01-13T17:59:05.177957+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:38:41.330284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.310692+0000","last_change":"2024-01-13T17:59:05.310494+0000","last_active":"2024-01-13T17:59:05.310692+0000","last_peered":"2024-01-13T17:59:05.310692+0000","last_clean":"2024-01-13T17:59:05.310692+0000","last_became_active":"2024-01-13T17:59:05.310135+0000","last_became_peered":"2024-01-13T17:59:05.310135+0000","last_unstale":"2024-01-13T17:59:05.310692+0000","last_undegraded":"2024-01-13T17:59:05.310692+0000","last_fullsized":"2024-01-13T17:59:05.310692+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:13:06.215978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181231+0000","last_change":"2024-01-13T17:58:36.839829+0000","last_active":"2024-01-13T17:59:05.181231+0000","last_peered":"2024-01-13T17:59:05.181231+0000","last_clean":"2024-01-13T17:59:05.181231+0000","last_became_active":"2024-01-13T17:58:36.839541+0000","last_became_peered":"2024-01-13T17:58:36.839541+0000","last_unstale":"2024-01-13T17:59:05.181231+0000","last_undegraded":"2024-01-13T17:59:05.181231+0000","last_fullsized":"2024-01-13T17:59:05.181231+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:52:18.758870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178618+0000","last_change":"2024-01-13T17:58:37.401139+0000","last_active":"2024-01-13T17:59:05.178618+0000","last_peered":"2024-01-13T17:59:05.178618+0000","last_clean":"2024-01-13T17:59:05.178618+0000","last_became_active":"2024-01-13T17:58:37.400836+0000","last_became_peered":"2024-01-13T17:58:37.400836+0000","last_unstale":"2024-01-13T17:59:05.178618+0000","last_undegraded":"2024-01-13T17:59:05.178618+0000","last_fullsized":"2024-01-13T17:59:05.178618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:15:29.881505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175607+0000","last_change":"2024-01-13T17:58:36.844748+0000","last_active":"2024-01-13T17:59:05.175607+0000","last_peered":"2024-01-13T17:59:05.175607+0000","last_clean":"2024-01-13T17:59:05.175607+0000","last_became_active":"2024-01-13T17:58:36.844002+0000","last_became_peered":"2024-01-13T17:58:36.844002+0000","last_unstale":"2024-01-13T17:59:05.175607+0000","last_undegraded":"2024-01-13T17:59:05.175607+0000","last_fullsized":"2024-01-13T17:59:05.175607+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:14:57.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180372+0000","last_change":"2024-01-13T17:58:37.409079+0000","last_active":"2024-01-13T17:59:05.180372+0000","last_peered":"2024-01-13T17:59:05.180372+0000","last_clean":"2024-01-13T17:59:05.180372+0000","last_became_active":"2024-01-13T17:58:37.408807+0000","last_became_peered":"2024-01-13T17:58:37.408807+0000","last_unstale":"2024-01-13T17:59:05.180372+0000","last_undegraded":"2024-01-13T17:59:05.180372+0000","last_fullsized":"2024-01-13T17:59:05.180372+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:53:09.994807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.182955+0000","last_change":"2024-01-13T17:58:36.841464+0000","last_active":"2024-01-13T17:59:05.182955+0000","last_peered":"2024-01-13T17:59:05.182955+0000","last_clean":"2024-01-13T17:59:05.182955+0000","last_became_active":"2024-01-13T17:58:36.840078+0000","last_became_peered":"2024-01-13T17:58:36.840078+0000","last_unstale":"2024-01-13T17:59:05.182955+0000","last_undegraded":"2024-01-13T17:59:05.182955+0000","last_fullsized":"2024-01-13T17:59:05.182955+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:39:59.597495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177796+0000","last_change":"2024-01-13T17:58:37.408303+0000","last_active":"2024-01-13T17:59:05.177796+0000","last_peered":"2024-01-13T17:59:05.177796+0000","last_clean":"2024-01-13T17:59:05.177796+0000","last_became_active":"2024-01-13T17:58:37.407988+0000","last_became_peered":"2024-01-13T17:58:37.407988+0000","last_unstale":"2024-01-13T17:59:05.177796+0000","last_undegraded":"2024-01-13T17:59:05.177796+0000","last_fullsized":"2024-01-13T17:59:05.177796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:45:25.570947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183261+0000","last_change":"2024-01-13T17:58:36.841581+0000","last_active":"2024-01-13T17:59:05.183261+0000","last_peered":"2024-01-13T17:59:05.183261+0000","last_clean":"2024-01-13T17:59:05.183261+0000","last_became_active":"2024-01-13T17:58:36.841192+0000","last_became_peered":"2024-01-13T17:58:36.841192+0000","last_unstale":"2024-01-13T17:59:05.183261+0000","last_undegraded":"2024-01-13T17:59:05.183261+0000","last_fullsized":"2024-01-13T17:59:05.183261+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:39:05.602781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177145+0000","last_change":"2024-01-13T17:58:37.402047+0000","last_active":"2024-01-13T17:59:05.177145+0000","last_peered":"2024-01-13T17:59:05.177145+0000","last_clean":"2024-01-13T17:59:05.177145+0000","last_became_active":"2024-01-13T17:58:37.401769+0000","last_became_peered":"2024-01-13T17:58:37.401769+0000","last_unstale":"2024-01-13T17:59:05.177145+0000","last_undegraded":"2024-01-13T17:59:05.177145+0000","last_fullsized":"2024-01-13T17:59:05.177145+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:32:35.369119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175774+0000","last_change":"2024-01-13T17:58:36.844613+0000","last_active":"2024-01-13T17:59:05.175774+0000","last_peered":"2024-01-13T17:59:05.175774+0000","last_clean":"2024-01-13T17:59:05.175774+0000","last_became_active":"2024-01-13T17:58:36.844286+0000","last_became_peered":"2024-01-13T17:58:36.844286+0000","last_unstale":"2024-01-13T17:59:05.175774+0000","last_undegraded":"2024-01-13T17:59:05.175774+0000","last_fullsized":"2024-01-13T17:59:05.175774+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:27:48.244809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181937+0000","last_change":"2024-01-13T17:58:37.399084+0000","last_active":"2024-01-13T17:59:05.181937+0000","last_peered":"2024-01-13T17:59:05.181937+0000","last_clean":"2024-01-13T17:59:05.181937+0000","last_became_active":"2024-01-13T17:58:37.398572+0000","last_became_peered":"2024-01-13T17:58:37.398572+0000","last_unstale":"2024-01-13T17:59:05.181937+0000","last_undegraded":"2024-01-13T17:59:05.181937+0000","last_fullsized":"2024-01-13T17:59:05.181937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:18:41.057728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546317+0000","last_change":"2024-01-13T17:58:36.837432+0000","last_active":"2024-01-13T17:59:05.546317+0000","last_peered":"2024-01-13T17:59:05.546317+0000","last_clean":"2024-01-13T17:59:05.546317+0000","last_became_active":"2024-01-13T17:58:36.837168+0000","last_became_peered":"2024-01-13T17:58:36.837168+0000","last_unstale":"2024-01-13T17:59:05.546317+0000","last_undegraded":"2024-01-13T17:59:05.546317+0000","last_fullsized":"2024-01-13T17:59:05.546317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:30.125718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176249+0000","last_change":"2024-01-13T17:58:37.416032+0000","last_active":"2024-01-13T17:59:05.176249+0000","last_peered":"2024-01-13T17:59:05.176249+0000","last_clean":"2024-01-13T17:59:05.176249+0000","last_became_active":"2024-01-13T17:58:37.415759+0000","last_became_peered":"2024-01-13T17:58:37.415759+0000","last_unstale":"2024-01-13T17:59:05.176249+0000","last_undegraded":"2024-01-13T17:59:05.176249+0000","last_fullsized":"2024-01-13T17:59:05.176249+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:24.483081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"59'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183571+0000","last_change":"2024-01-13T17:58:36.834302+0000","last_active":"2024-01-13T17:59:05.183571+0000","last_peered":"2024-01-13T17:59:05.183571+0000","last_clean":"2024-01-13T17:59:05.183571+0000","last_became_active":"2024-01-13T17:58:36.833658+0000","last_became_peered":"2024-01-13T17:58:36.833658+0000","last_unstale":"2024-01-13T17:59:05.183571+0000","last_undegraded":"2024-01-13T17:59:05.183571+0000","last_fullsized":"2024-01-13T17:59:05.183571+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:13:18.505657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309444+0000","last_change":"2024-01-13T17:58:37.402650+0000","last_active":"2024-01-13T17:59:05.309444+0000","last_peered":"2024-01-13T17:59:05.309444+0000","last_clean":"2024-01-13T17:59:05.309444+0000","last_became_active":"2024-01-13T17:58:37.402128+0000","last_became_peered":"2024-01-13T17:58:37.402128+0000","last_unstale":"2024-01-13T17:59:05.309444+0000","last_undegraded":"2024-01-13T17:59:05.309444+0000","last_fullsized":"2024-01-13T17:59:05.309444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:02:28.745789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546466+0000","last_change":"2024-01-13T17:58:36.836861+0000","last_active":"2024-01-13T17:59:05.546466+0000","last_peered":"2024-01-13T17:59:05.546466+0000","last_clean":"2024-01-13T17:59:05.546466+0000","last_became_active":"2024-01-13T17:58:36.836593+0000","last_became_peered":"2024-01-13T17:58:36.836593+0000","last_unstale":"2024-01-13T17:59:05.546466+0000","last_undegraded":"2024-01-13T17:59:05.546466+0000","last_fullsized":"2024-01-13T17:59:05.546466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:34:37.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176053+0000","last_change":"2024-01-13T17:58:37.414378+0000","last_active":"2024-01-13T17:59:05.176053+0000","last_peered":"2024-01-13T17:59:05.176053+0000","last_clean":"2024-01-13T17:59:05.176053+0000","last_became_active":"2024-01-13T17:58:37.414097+0000","last_became_peered":"2024-01-13T17:58:37.414097+0000","last_unstale":"2024-01-13T17:59:05.176053+0000","last_undegraded":"2024-01-13T17:59:05.176053+0000","last_fullsized":"2024-01-13T17:59:05.176053+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:45:12.430007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.179827+0000","last_change":"2024-01-13T17:58:37.397227+0000","last_active":"2024-01-13T17:59:05.179827+0000","last_peered":"2024-01-13T17:59:05.179827+0000","last_clean":"2024-01-13T17:59:05.179827+0000","last_became_active":"2024-01-13T17:58:37.396928+0000","last_became_peered":"2024-01-13T17:58:37.396928+0000","last_unstale":"2024-01-13T17:59:05.179827+0000","last_undegraded":"2024-01-13T17:59:05.179827+0000","last_fullsized":"2024-01-13T17:59:05.179827+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:59:55.499543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546303+0000","last_change":"2024-01-13T17:58:37.396849+0000","last_active":"2024-01-13T17:59:05.546303+0000","last_peered":"2024-01-13T17:59:05.546303+0000","last_clean":"2024-01-13T17:59:05.546303+0000","last_became_active":"2024-01-13T17:58:37.396585+0000","last_became_peered":"2024-01-13T17:58:37.396585+0000","last_unstale":"2024-01-13T17:59:05.546303+0000","last_undegraded":"2024-01-13T17:59:05.546303+0000","last_fullsized":"2024-01-13T17:59:05.546303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:32.529315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309584+0000","last_change":"2024-01-13T17:58:37.403640+0000","last_active":"2024-01-13T17:59:05.309584+0000","last_peered":"2024-01-13T17:59:05.309584+0000","last_clean":"2024-01-13T17:59:05.309584+0000","last_became_active":"2024-01-13T17:58:37.403041+0000","last_became_peered":"2024-01-13T17:58:37.403041+0000","last_unstale":"2024-01-13T17:59:05.309584+0000","last_undegraded":"2024-01-13T17:59:05.309584+0000","last_fullsized":"2024-01-13T17:59:05.309584+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:37.683734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177822+0000","last_change":"2024-01-13T17:58:37.403739+0000","last_active":"2024-01-13T17:59:05.177822+0000","last_peered":"2024-01-13T17:59:05.177822+0000","last_clean":"2024-01-13T17:59:05.177822+0000","last_became_active":"2024-01-13T17:58:37.403471+0000","last_became_peered":"2024-01-13T17:58:37.403471+0000","last_unstale":"2024-01-13T17:59:05.177822+0000","last_undegraded":"2024-01-13T17:59:05.177822+0000","last_fullsized":"2024-01-13T17:59:05.177822+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:13:50.178194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178201+0000","last_change":"2024-01-13T17:58:37.401852+0000","last_active":"2024-01-13T17:59:05.178201+0000","last_peered":"2024-01-13T17:59:05.178201+0000","last_clean":"2024-01-13T17:59:05.178201+0000","last_became_active":"2024-01-13T17:58:37.401546+0000","last_became_peered":"2024-01-13T17:58:37.401546+0000","last_unstale":"2024-01-13T17:59:05.178201+0000","last_undegraded":"2024-01-13T17:59:05.178201+0000","last_fullsized":"2024-01-13T17:59:05.178201+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:25:50.041002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183519+0000","last_change":"2024-01-13T17:58:37.395592+0000","last_active":"2024-01-13T17:59:05.183519+0000","last_peered":"2024-01-13T17:59:05.183519+0000","last_clean":"2024-01-13T17:59:05.183519+0000","last_became_active":"2024-01-13T17:58:37.395306+0000","last_became_peered":"2024-01-13T17:58:37.395306+0000","last_unstale":"2024-01-13T17:59:05.183519+0000","last_undegraded":"2024-01-13T17:59:05.183519+0000","last_fullsized":"2024-01-13T17:59:05.183519+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:06:42.102077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181019+0000","last_change":"2024-01-13T17:58:37.409861+0000","last_active":"2024-01-13T17:59:05.181019+0000","last_peered":"2024-01-13T17:59:05.181019+0000","last_clean":"2024-01-13T17:59:05.181019+0000","last_became_active":"2024-01-13T17:58:37.409345+0000","last_became_peered":"2024-01-13T17:58:37.409345+0000","last_unstale":"2024-01-13T17:59:05.181019+0000","last_undegraded":"2024-01-13T17:59:05.181019+0000","last_fullsized":"2024-01-13T17:59:05.181019+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:00:44.773057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178034+0000","last_change":"2024-01-13T17:58:37.402771+0000","last_active":"2024-01-13T17:59:05.178034+0000","last_peered":"2024-01-13T17:59:05.178034+0000","last_clean":"2024-01-13T17:59:05.178034+0000","last_became_active":"2024-01-13T17:58:37.402517+0000","last_became_peered":"2024-01-13T17:58:37.402517+0000","last_unstale":"2024-01-13T17:59:05.178034+0000","last_undegraded":"2024-01-13T17:59:05.178034+0000","last_fullsized":"2024-01-13T17:59:05.178034+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:14:28.931595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309376+0000","last_change":"2024-01-13T17:58:37.402590+0000","last_active":"2024-01-13T17:59:05.309376+0000","last_peered":"2024-01-13T17:59:05.309376+0000","last_clean":"2024-01-13T17:59:05.309376+0000","last_became_active":"2024-01-13T17:58:37.402233+0000","last_became_peered":"2024-01-13T17:58:37.402233+0000","last_unstale":"2024-01-13T17:59:05.309376+0000","last_undegraded":"2024-01-13T17:59:05.309376+0000","last_fullsized":"2024-01-13T17:59:05.309376+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:48:51.046376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176873+0000","last_change":"2024-01-13T17:58:37.403312+0000","last_active":"2024-01-13T17:59:05.176873+0000","last_peered":"2024-01-13T17:59:05.176873+0000","last_clean":"2024-01-13T17:59:05.176873+0000","last_became_active":"2024-01-13T17:58:37.403093+0000","last_became_peered":"2024-01-13T17:58:37.403093+0000","last_unstale":"2024-01-13T17:59:05.176873+0000","last_undegraded":"2024-01-13T17:59:05.176873+0000","last_fullsized":"2024-01-13T17:59:05.176873+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:27:24.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309599+0000","last_change":"2024-01-13T17:58:37.411533+0000","last_active":"2024-01-13T17:59:05.309599+0000","last_peered":"2024-01-13T17:59:05.309599+0000","last_clean":"2024-01-13T17:59:05.309599+0000","last_became_active":"2024-01-13T17:58:37.411192+0000","last_became_peered":"2024-01-13T17:58:37.411192+0000","last_unstale":"2024-01-13T17:59:05.309599+0000","last_undegraded":"2024-01-13T17:59:05.309599+0000","last_fullsized":"2024-01-13T17:59:05.309599+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:31:15.289987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177898+0000","last_change":"2024-01-13T17:58:37.409594+0000","last_active":"2024-01-13T17:59:05.177898+0000","last_peered":"2024-01-13T17:59:05.177898+0000","last_clean":"2024-01-13T17:59:05.177898+0000","last_became_active":"2024-01-13T17:58:37.409319+0000","last_became_peered":"2024-01-13T17:58:37.409319+0000","last_unstale":"2024-01-13T17:59:05.177898+0000","last_undegraded":"2024-01-13T17:59:05.177898+0000","last_fullsized":"2024-01-13T17:59:05.177898+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:21:11.322832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181737+0000","last_change":"2024-01-13T17:58:37.400265+0000","last_active":"2024-01-13T17:59:05.181737+0000","last_peered":"2024-01-13T17:59:05.181737+0000","last_clean":"2024-01-13T17:59:05.181737+0000","last_became_active":"2024-01-13T17:58:37.399952+0000","last_became_peered":"2024-01-13T17:58:37.399952+0000","last_unstale":"2024-01-13T17:59:05.181737+0000","last_undegraded":"2024-01-13T17:59:05.181737+0000","last_fullsized":"2024-01-13T17:59:05.181737+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:04.725745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3094,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":52,"seq":223338299407,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298492,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446660,"statfs":{"total":95995035648,"available":95689379840,"internally_reserved":0,"allocated":1232896,"data_stored":862545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35899999999999999}]},{"osd":1,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.373},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.30399999999999999}]},{"osd":2,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.1190000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.31900000000000001}]},{"osd":3,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.434},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.48699999999999999}]},{"osd":6,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51500000000000001}]}]},{"osd":6,"up_from":44,"seq":188978561041,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298496,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446656,"statfs":{"total":95995035648,"available":95689375744,"internally_reserved":0,"allocated":1236992,"data_stored":864351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.29399999999999998}]},{"osd":1,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.48499999999999999}]},{"osd":3,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.377},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.432}]},{"osd":5,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.39100000000000001}]},{"osd":7,"last update":"Sat Jan 13 17:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.504},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48999999999999999}]}]},{"osd":4,"up_from":30,"seq":128849018905,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447228,"statfs":{"total":95995035648,"available":95689961472,"internally_reserved":0,"allocated":651264,"data_stored":272604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.437},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.58899999999999997}]},{"osd":1,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.46400000000000002}]},{"osd":5,"last update":"Sat Jan 13 17:58:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.28299999999999997}]},{"osd":6,"last update":"Sat Jan 13 17:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.372},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.317}]},{"osd":7,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.33500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297912,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447240,"statfs":{"total":95995035648,"available":95689973760,"internally_reserved":0,"allocated":638976,"data_stored":271819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:43 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33600000000000002,"15min":0.33100000000000002},"min":{"1min":0.215,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.314},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.34499999999999997,"15min":0.33200000000000002},"min":{"1min":0.26600000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.26000000000000001}]},{"osd":2,"last update":"Sat Jan 13 17:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39400000000000002,"15min":0.39500000000000002},"min":{"1min":0.27500000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55400000000000005,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.29599999999999999}]},{"osd":3,"last update":"Sat Jan 13 17:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.58699999999999997}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39200000000000002}]},{"osd":5,"last update":"Sat Jan 13 17:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46400000000000002}]},{"osd":6,"last update":"Sat Jan 13 17:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298504,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446648,"statfs":{"total":95995035648,"available":95689367552,"internally_reserved":0,"allocated":1245184,"data_stored":862992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 13 17:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38200000000000001,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.40699999999999997,"15min":0.40300000000000002},"min":{"1min":0.28899999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.313}]},{"osd":2,"last update":"Sat Jan 13 17:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.27600000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.44500000000000001,"15min":0.45500000000000002},"min":{"1min":0.26600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53900000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.255}]},{"osd":3,"last update":"Sat Jan 13 17:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.51500000000000001,"15min":0.53300000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.374},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.62,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.34200000000000003}]},{"osd":5,"last update":"Sat Jan 13 17:58:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.502}]},{"osd":6,"last update":"Sat Jan 13 17:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411360,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297908,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447244,"statfs":{"total":95995035648,"available":95689977856,"internally_reserved":0,"allocated":634880,"data_stored":271924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:59:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.38100000000000001,"15min":0.38600000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48799999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.29699999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Jan 13 17:59:03 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.41799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Jan 13 17:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.47099999999999997,"15min":0.47999999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.747,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.313},{"interface":"front","average":{"1min":0.433,"5min":0.48499999999999999,"15min":0.49399999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.36899999999999999}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39600000000000002}]},{"osd":5,"last update":"Sat Jan 13 17:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.436},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.38700000000000001}]},{"osd":6,"last update":"Sat Jan 13 17:59:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182429,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447224,"statfs":{"total":95995035648,"available":95689957376,"internally_reserved":0,"allocated":655360,"data_stored":274352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.51700000000000002,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":11.647,"5min":11.647,"15min":11.647},"last":0.27100000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.59299999999999997,"15min":0.51300000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":13.962,"5min":13.962,"15min":13.962},"last":0.28299999999999997}]},{"osd":1,"last update":"Sat Jan 13 17:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.44700000000000001,"15min":0.45300000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.23300000000000001}]},{"osd":2,"last update":"Sat Jan 13 17:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.495,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.313},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.58299999999999996,"15min":0.52500000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":11.262,"5min":11.262,"15min":11.262},"last":0.30499999999999999}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.35399999999999998}]},{"osd":5,"last update":"Sat Jan 13 17:58:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.41399999999999998}]},{"osd":6,"last update":"Sat Jan 13 17:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.47499999999999998}]},{"osd":7,"last update":"Sat Jan 13 17:59:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":11.346,"5min":11.346,"15min":11.346},"last":0.498},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.39100000000000001}]}]},{"osd":5,"up_from":37,"seq":158913789973,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447228,"statfs":{"total":95995035648,"available":95689961472,"internally_reserved":0,"allocated":651264,"data_stored":274338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.37}]},{"osd":1,"last update":"Sat Jan 13 17:58:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.433}]},{"osd":2,"last update":"Sat Jan 13 17:58:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.48899999999999999}]},{"osd":3,"last update":"Sat Jan 13 17:58:51 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Sat Jan 13 17:58:51 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.313},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44900000000000001}]},{"osd":6,"last update":"Sat Jan 13 17:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-13T17:59:28.666 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph pg dump --format=json 2024-01-13T17:59:28.925 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:29 smithi084 ceph-mon[37908]: from='client.24683 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:59:29.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:29 smithi084 ceph-mon[52328]: from='client.24683 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:59:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:29 smithi099 ceph-mon[71325]: from='client.24683 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:59:30.304 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:30.306 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-01-13T17:59:30.584 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:30 smithi084 ceph-mon[37908]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:30.584 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:30 smithi084 ceph-mon[52328]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:30.584 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[94279]: ts=2024-01-13T17:59:30.272Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002700697s 2024-01-13T17:59:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:30 smithi099 ceph-mon[71325]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:30.677 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-01-13T17:59:29.195955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593462,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":315,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2385088,"kb_used_data":6784,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":747576128,"statfs":{"total":767960285184,"available":765517955072,"internally_reserved":0,"allocated":6946816,"data_stored":3954925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002681"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175971+0000","last_change":"2024-01-13T17:58:37.416080+0000","last_active":"2024-01-13T17:59:05.175971+0000","last_peered":"2024-01-13T17:59:05.175971+0000","last_clean":"2024-01-13T17:59:05.175971+0000","last_became_active":"2024-01-13T17:58:37.415621+0000","last_became_peered":"2024-01-13T17:58:37.415621+0000","last_unstale":"2024-01-13T17:59:05.175971+0000","last_undegraded":"2024-01-13T17:59:05.175971+0000","last_fullsized":"2024-01-13T17:59:05.175971+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:40.991399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183536+0000","last_change":"2024-01-13T17:58:37.398891+0000","last_active":"2024-01-13T17:59:05.183536+0000","last_peered":"2024-01-13T17:59:05.183536+0000","last_clean":"2024-01-13T17:59:05.183536+0000","last_became_active":"2024-01-13T17:58:37.398476+0000","last_became_peered":"2024-01-13T17:58:37.398476+0000","last_unstale":"2024-01-13T17:59:05.183536+0000","last_undegraded":"2024-01-13T17:59:05.183536+0000","last_fullsized":"2024-01-13T17:59:05.183536+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:05:39.892184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177794+0000","last_change":"2024-01-13T17:58:37.399839+0000","last_active":"2024-01-13T17:59:05.177794+0000","last_peered":"2024-01-13T17:59:05.177794+0000","last_clean":"2024-01-13T17:59:05.177794+0000","last_became_active":"2024-01-13T17:58:37.399578+0000","last_became_peered":"2024-01-13T17:58:37.399578+0000","last_unstale":"2024-01-13T17:59:05.177794+0000","last_undegraded":"2024-01-13T17:59:05.177794+0000","last_fullsized":"2024-01-13T17:59:05.177794+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:36:22.906393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309318+0000","last_change":"2024-01-13T17:58:37.411528+0000","last_active":"2024-01-13T17:59:05.309318+0000","last_peered":"2024-01-13T17:59:05.309318+0000","last_clean":"2024-01-13T17:59:05.309318+0000","last_became_active":"2024-01-13T17:58:37.411056+0000","last_became_peered":"2024-01-13T17:58:37.411056+0000","last_unstale":"2024-01-13T17:59:05.309318+0000","last_undegraded":"2024-01-13T17:59:05.309318+0000","last_fullsized":"2024-01-13T17:59:05.309318+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:13:24.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175938+0000","last_change":"2024-01-13T17:58:37.415953+0000","last_active":"2024-01-13T17:59:05.175938+0000","last_peered":"2024-01-13T17:59:05.175938+0000","last_clean":"2024-01-13T17:59:05.175938+0000","last_became_active":"2024-01-13T17:58:37.413825+0000","last_became_peered":"2024-01-13T17:58:37.413825+0000","last_unstale":"2024-01-13T17:59:05.175938+0000","last_undegraded":"2024-01-13T17:59:05.175938+0000","last_fullsized":"2024-01-13T17:59:05.175938+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:04:08.326020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309710+0000","last_change":"2024-01-13T17:58:37.399699+0000","last_active":"2024-01-13T17:59:05.309710+0000","last_peered":"2024-01-13T17:59:05.309710+0000","last_clean":"2024-01-13T17:59:05.309710+0000","last_became_active":"2024-01-13T17:58:37.399358+0000","last_became_peered":"2024-01-13T17:58:37.399358+0000","last_unstale":"2024-01-13T17:59:05.309710+0000","last_undegraded":"2024-01-13T17:59:05.309710+0000","last_fullsized":"2024-01-13T17:59:05.309710+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:18.403109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175584+0000","last_change":"2024-01-13T17:58:37.413121+0000","last_active":"2024-01-13T17:59:05.175584+0000","last_peered":"2024-01-13T17:59:05.175584+0000","last_clean":"2024-01-13T17:59:05.175584+0000","last_became_active":"2024-01-13T17:58:37.412816+0000","last_became_peered":"2024-01-13T17:58:37.412816+0000","last_unstale":"2024-01-13T17:59:05.175584+0000","last_undegraded":"2024-01-13T17:59:05.175584+0000","last_fullsized":"2024-01-13T17:59:05.175584+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:40:05.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177369+0000","last_change":"2024-01-13T17:58:37.393602+0000","last_active":"2024-01-13T17:59:05.177369+0000","last_peered":"2024-01-13T17:59:05.177369+0000","last_clean":"2024-01-13T17:59:05.177369+0000","last_became_active":"2024-01-13T17:58:37.393317+0000","last_became_peered":"2024-01-13T17:58:37.393317+0000","last_unstale":"2024-01-13T17:59:05.177369+0000","last_undegraded":"2024-01-13T17:59:05.177369+0000","last_fullsized":"2024-01-13T17:59:05.177369+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:14:00.225985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175944+0000","last_change":"2024-01-13T17:58:37.416421+0000","last_active":"2024-01-13T17:59:05.175944+0000","last_peered":"2024-01-13T17:59:05.175944+0000","last_clean":"2024-01-13T17:59:05.175944+0000","last_became_active":"2024-01-13T17:58:37.416138+0000","last_became_peered":"2024-01-13T17:58:37.416138+0000","last_unstale":"2024-01-13T17:59:05.175944+0000","last_undegraded":"2024-01-13T17:59:05.175944+0000","last_fullsized":"2024-01-13T17:59:05.175944+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:10:51.751719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180919+0000","last_change":"2024-01-13T17:58:37.397837+0000","last_active":"2024-01-13T17:59:05.180919+0000","last_peered":"2024-01-13T17:59:05.180919+0000","last_clean":"2024-01-13T17:59:05.180919+0000","last_became_active":"2024-01-13T17:58:37.397557+0000","last_became_peered":"2024-01-13T17:58:37.397557+0000","last_unstale":"2024-01-13T17:59:05.180919+0000","last_undegraded":"2024-01-13T17:59:05.180919+0000","last_fullsized":"2024-01-13T17:59:05.180919+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:38:02.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180710+0000","last_change":"2024-01-13T17:58:37.397136+0000","last_active":"2024-01-13T17:59:05.180710+0000","last_peered":"2024-01-13T17:59:05.180710+0000","last_clean":"2024-01-13T17:59:05.180710+0000","last_became_active":"2024-01-13T17:58:37.396796+0000","last_became_peered":"2024-01-13T17:58:37.396796+0000","last_unstale":"2024-01-13T17:59:05.180710+0000","last_undegraded":"2024-01-13T17:59:05.180710+0000","last_fullsized":"2024-01-13T17:59:05.180710+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:09:37.651466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180244+0000","last_change":"2024-01-13T17:58:37.401738+0000","last_active":"2024-01-13T17:59:05.180244+0000","last_peered":"2024-01-13T17:59:05.180244+0000","last_clean":"2024-01-13T17:59:05.180244+0000","last_became_active":"2024-01-13T17:58:37.401390+0000","last_became_peered":"2024-01-13T17:58:37.401390+0000","last_unstale":"2024-01-13T17:59:05.180244+0000","last_undegraded":"2024-01-13T17:59:05.180244+0000","last_fullsized":"2024-01-13T17:59:05.180244+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:10:08.882123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177070+0000","last_change":"2024-01-13T17:58:37.410693+0000","last_active":"2024-01-13T17:59:05.177070+0000","last_peered":"2024-01-13T17:59:05.177070+0000","last_clean":"2024-01-13T17:59:05.177070+0000","last_became_active":"2024-01-13T17:58:37.410478+0000","last_became_peered":"2024-01-13T17:58:37.410478+0000","last_unstale":"2024-01-13T17:59:05.177070+0000","last_undegraded":"2024-01-13T17:59:05.177070+0000","last_fullsized":"2024-01-13T17:59:05.177070+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:54:26.505663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178336+0000","last_change":"2024-01-13T17:58:37.399587+0000","last_active":"2024-01-13T17:59:05.178336+0000","last_peered":"2024-01-13T17:59:05.178336+0000","last_clean":"2024-01-13T17:59:05.178336+0000","last_became_active":"2024-01-13T17:58:37.399266+0000","last_became_peered":"2024-01-13T17:58:37.399266+0000","last_unstale":"2024-01-13T17:59:05.178336+0000","last_undegraded":"2024-01-13T17:59:05.178336+0000","last_fullsized":"2024-01-13T17:59:05.178336+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:45:41.896344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.182878+0000","last_change":"2024-01-13T17:58:37.394829+0000","last_active":"2024-01-13T17:59:05.182878+0000","last_peered":"2024-01-13T17:59:05.182878+0000","last_clean":"2024-01-13T17:59:05.182878+0000","last_became_active":"2024-01-13T17:58:37.394582+0000","last_became_peered":"2024-01-13T17:58:37.394582+0000","last_unstale":"2024-01-13T17:59:05.182878+0000","last_undegraded":"2024-01-13T17:59:05.182878+0000","last_fullsized":"2024-01-13T17:59:05.182878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:52:38.944942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309202+0000","last_change":"2024-01-13T17:58:37.412247+0000","last_active":"2024-01-13T17:59:05.309202+0000","last_peered":"2024-01-13T17:59:05.309202+0000","last_clean":"2024-01-13T17:59:05.309202+0000","last_became_active":"2024-01-13T17:58:37.411947+0000","last_became_peered":"2024-01-13T17:58:37.411947+0000","last_unstale":"2024-01-13T17:59:05.309202+0000","last_undegraded":"2024-01-13T17:59:05.309202+0000","last_fullsized":"2024-01-13T17:59:05.309202+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:05:19.184972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309757+0000","last_change":"2024-01-13T17:58:37.411858+0000","last_active":"2024-01-13T17:59:05.309757+0000","last_peered":"2024-01-13T17:59:05.309757+0000","last_clean":"2024-01-13T17:59:05.309757+0000","last_became_active":"2024-01-13T17:58:37.411559+0000","last_became_peered":"2024-01-13T17:58:37.411559+0000","last_unstale":"2024-01-13T17:59:05.309757+0000","last_undegraded":"2024-01-13T17:59:05.309757+0000","last_fullsized":"2024-01-13T17:59:05.309757+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:00:40.870815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546374+0000","last_change":"2024-01-13T17:58:37.409078+0000","last_active":"2024-01-13T17:59:05.546374+0000","last_peered":"2024-01-13T17:59:05.546374+0000","last_clean":"2024-01-13T17:59:05.546374+0000","last_became_active":"2024-01-13T17:58:37.408820+0000","last_became_peered":"2024-01-13T17:58:37.408820+0000","last_unstale":"2024-01-13T17:59:05.546374+0000","last_undegraded":"2024-01-13T17:59:05.546374+0000","last_fullsized":"2024-01-13T17:59:05.546374+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:30:37.097173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176090+0000","last_change":"2024-01-13T17:58:37.414485+0000","last_active":"2024-01-13T17:59:05.176090+0000","last_peered":"2024-01-13T17:59:05.176090+0000","last_clean":"2024-01-13T17:59:05.176090+0000","last_became_active":"2024-01-13T17:58:37.414182+0000","last_became_peered":"2024-01-13T17:58:37.414182+0000","last_unstale":"2024-01-13T17:59:05.176090+0000","last_undegraded":"2024-01-13T17:59:05.176090+0000","last_fullsized":"2024-01-13T17:59:05.176090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:08:50.844685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"59'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178930+0000","last_change":"2024-01-13T17:58:36.839635+0000","last_active":"2024-01-13T17:59:05.178930+0000","last_peered":"2024-01-13T17:59:05.178930+0000","last_clean":"2024-01-13T17:59:05.178930+0000","last_became_active":"2024-01-13T17:58:36.839344+0000","last_became_peered":"2024-01-13T17:58:36.839344+0000","last_unstale":"2024-01-13T17:59:05.178930+0000","last_undegraded":"2024-01-13T17:59:05.178930+0000","last_fullsized":"2024-01-13T17:59:05.178930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:41:18.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177711+0000","last_change":"2024-01-13T17:58:37.403720+0000","last_active":"2024-01-13T17:59:05.177711+0000","last_peered":"2024-01-13T17:59:05.177711+0000","last_clean":"2024-01-13T17:59:05.177711+0000","last_became_active":"2024-01-13T17:58:37.403390+0000","last_became_peered":"2024-01-13T17:58:37.403390+0000","last_unstale":"2024-01-13T17:59:05.177711+0000","last_undegraded":"2024-01-13T17:59:05.177711+0000","last_fullsized":"2024-01-13T17:59:05.177711+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:38:09.594828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"59'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177799+0000","last_change":"2024-01-13T17:58:36.846725+0000","last_active":"2024-01-13T17:59:05.177799+0000","last_peered":"2024-01-13T17:59:05.177799+0000","last_clean":"2024-01-13T17:59:05.177799+0000","last_became_active":"2024-01-13T17:58:36.846375+0000","last_became_peered":"2024-01-13T17:58:36.846375+0000","last_unstale":"2024-01-13T17:59:05.177799+0000","last_undegraded":"2024-01-13T17:59:05.177799+0000","last_fullsized":"2024-01-13T17:59:05.177799+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:06:04.006535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178795+0000","last_change":"2024-01-13T17:58:37.395186+0000","last_active":"2024-01-13T17:59:05.178795+0000","last_peered":"2024-01-13T17:59:05.178795+0000","last_clean":"2024-01-13T17:59:05.178795+0000","last_became_active":"2024-01-13T17:58:37.394880+0000","last_became_peered":"2024-01-13T17:58:37.394880+0000","last_unstale":"2024-01-13T17:59:05.178795+0000","last_undegraded":"2024-01-13T17:59:05.178795+0000","last_fullsized":"2024-01-13T17:59:05.178795+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:02:59.539263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176411+0000","last_change":"2024-01-13T17:58:36.845520+0000","last_active":"2024-01-13T17:59:05.176411+0000","last_peered":"2024-01-13T17:59:05.176411+0000","last_clean":"2024-01-13T17:59:05.176411+0000","last_became_active":"2024-01-13T17:58:36.845229+0000","last_became_peered":"2024-01-13T17:58:36.845229+0000","last_unstale":"2024-01-13T17:59:05.176411+0000","last_undegraded":"2024-01-13T17:59:05.176411+0000","last_fullsized":"2024-01-13T17:59:05.176411+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:08:01.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309528+0000","last_change":"2024-01-13T17:58:37.400143+0000","last_active":"2024-01-13T17:59:05.309528+0000","last_peered":"2024-01-13T17:59:05.309528+0000","last_clean":"2024-01-13T17:59:05.309528+0000","last_became_active":"2024-01-13T17:58:37.399689+0000","last_became_peered":"2024-01-13T17:58:37.399689+0000","last_unstale":"2024-01-13T17:59:05.309528+0000","last_undegraded":"2024-01-13T17:59:05.309528+0000","last_fullsized":"2024-01-13T17:59:05.309528+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:32:04.518468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175840+0000","last_change":"2024-01-13T17:58:36.843954+0000","last_active":"2024-01-13T17:59:05.175840+0000","last_peered":"2024-01-13T17:59:05.175840+0000","last_clean":"2024-01-13T17:59:05.175840+0000","last_became_active":"2024-01-13T17:58:36.843616+0000","last_became_peered":"2024-01-13T17:58:36.843616+0000","last_unstale":"2024-01-13T17:59:05.175840+0000","last_undegraded":"2024-01-13T17:59:05.175840+0000","last_fullsized":"2024-01-13T17:59:05.175840+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:37:08.466053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309531+0000","last_change":"2024-01-13T17:58:37.399242+0000","last_active":"2024-01-13T17:59:05.309531+0000","last_peered":"2024-01-13T17:59:05.309531+0000","last_clean":"2024-01-13T17:59:05.309531+0000","last_became_active":"2024-01-13T17:58:37.398793+0000","last_became_peered":"2024-01-13T17:58:37.398793+0000","last_unstale":"2024-01-13T17:59:05.309531+0000","last_undegraded":"2024-01-13T17:59:05.309531+0000","last_fullsized":"2024-01-13T17:59:05.309531+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:05:43.194645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"59'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177290+0000","last_change":"2024-01-13T17:58:36.838743+0000","last_active":"2024-01-13T17:59:05.177290+0000","last_peered":"2024-01-13T17:59:05.177290+0000","last_clean":"2024-01-13T17:59:05.177290+0000","last_became_active":"2024-01-13T17:58:36.838444+0000","last_became_peered":"2024-01-13T17:58:36.838444+0000","last_unstale":"2024-01-13T17:59:05.177290+0000","last_undegraded":"2024-01-13T17:59:05.177290+0000","last_fullsized":"2024-01-13T17:59:05.177290+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:48:37.841281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.179990+0000","last_change":"2024-01-13T17:58:37.401094+0000","last_active":"2024-01-13T17:59:05.179990+0000","last_peered":"2024-01-13T17:59:05.179990+0000","last_clean":"2024-01-13T17:59:05.179990+0000","last_became_active":"2024-01-13T17:58:37.400621+0000","last_became_peered":"2024-01-13T17:58:37.400621+0000","last_unstale":"2024-01-13T17:59:05.179990+0000","last_undegraded":"2024-01-13T17:59:05.179990+0000","last_fullsized":"2024-01-13T17:59:05.179990+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:15:46.371336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"59'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181983+0000","last_change":"2024-01-13T17:58:36.832810+0000","last_active":"2024-01-13T17:59:05.181983+0000","last_peered":"2024-01-13T17:59:05.181983+0000","last_clean":"2024-01-13T17:59:05.181983+0000","last_became_active":"2024-01-13T17:58:36.831491+0000","last_became_peered":"2024-01-13T17:58:36.831491+0000","last_unstale":"2024-01-13T17:59:05.181983+0000","last_undegraded":"2024-01-13T17:59:05.181983+0000","last_fullsized":"2024-01-13T17:59:05.181983+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:50:10.505869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177743+0000","last_change":"2024-01-13T17:58:37.408148+0000","last_active":"2024-01-13T17:59:05.177743+0000","last_peered":"2024-01-13T17:59:05.177743+0000","last_clean":"2024-01-13T17:59:05.177743+0000","last_became_active":"2024-01-13T17:58:37.407858+0000","last_became_peered":"2024-01-13T17:58:37.407858+0000","last_unstale":"2024-01-13T17:59:05.177743+0000","last_undegraded":"2024-01-13T17:59:05.177743+0000","last_fullsized":"2024-01-13T17:59:05.177743+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:35:47.284096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176950+0000","last_change":"2024-01-13T17:58:36.843139+0000","last_active":"2024-01-13T17:59:05.176950+0000","last_peered":"2024-01-13T17:59:05.176950+0000","last_clean":"2024-01-13T17:59:05.176950+0000","last_became_active":"2024-01-13T17:58:36.842487+0000","last_became_peered":"2024-01-13T17:58:36.842487+0000","last_unstale":"2024-01-13T17:59:05.176950+0000","last_undegraded":"2024-01-13T17:59:05.176950+0000","last_fullsized":"2024-01-13T17:59:05.176950+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:28:01.688683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177879+0000","last_change":"2024-01-13T17:58:37.401772+0000","last_active":"2024-01-13T17:59:05.177879+0000","last_peered":"2024-01-13T17:59:05.177879+0000","last_clean":"2024-01-13T17:59:05.177879+0000","last_became_active":"2024-01-13T17:58:37.401490+0000","last_became_peered":"2024-01-13T17:58:37.401490+0000","last_unstale":"2024-01-13T17:59:05.177879+0000","last_undegraded":"2024-01-13T17:59:05.177879+0000","last_fullsized":"2024-01-13T17:59:05.177879+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:32:13.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309286+0000","last_change":"2024-01-13T17:58:36.842527+0000","last_active":"2024-01-13T17:59:05.309286+0000","last_peered":"2024-01-13T17:59:05.309286+0000","last_clean":"2024-01-13T17:59:05.309286+0000","last_became_active":"2024-01-13T17:58:36.841820+0000","last_became_peered":"2024-01-13T17:58:36.841820+0000","last_unstale":"2024-01-13T17:59:05.309286+0000","last_undegraded":"2024-01-13T17:59:05.309286+0000","last_fullsized":"2024-01-13T17:59:05.309286+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:02.120533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183074+0000","last_change":"2024-01-13T17:58:37.393987+0000","last_active":"2024-01-13T17:59:05.183074+0000","last_peered":"2024-01-13T17:59:05.183074+0000","last_clean":"2024-01-13T17:59:05.183074+0000","last_became_active":"2024-01-13T17:58:37.393657+0000","last_became_peered":"2024-01-13T17:58:37.393657+0000","last_unstale":"2024-01-13T17:59:05.183074+0000","last_undegraded":"2024-01-13T17:59:05.183074+0000","last_fullsized":"2024-01-13T17:59:05.183074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:44.818236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181323+0000","last_change":"2024-01-13T17:58:36.843560+0000","last_active":"2024-01-13T17:59:05.181323+0000","last_peered":"2024-01-13T17:59:05.181323+0000","last_clean":"2024-01-13T17:59:05.181323+0000","last_became_active":"2024-01-13T17:58:36.843290+0000","last_became_peered":"2024-01-13T17:58:36.843290+0000","last_unstale":"2024-01-13T17:59:05.181323+0000","last_undegraded":"2024-01-13T17:59:05.181323+0000","last_fullsized":"2024-01-13T17:59:05.181323+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:12:58.012752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309998+0000","last_change":"2024-01-13T17:58:37.412880+0000","last_active":"2024-01-13T17:59:05.309998+0000","last_peered":"2024-01-13T17:59:05.309998+0000","last_clean":"2024-01-13T17:59:05.309998+0000","last_became_active":"2024-01-13T17:58:37.412519+0000","last_became_peered":"2024-01-13T17:58:37.412519+0000","last_unstale":"2024-01-13T17:59:05.309998+0000","last_undegraded":"2024-01-13T17:59:05.309998+0000","last_fullsized":"2024-01-13T17:59:05.309998+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:40:03.956715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309904+0000","last_change":"2024-01-13T17:58:36.841704+0000","last_active":"2024-01-13T17:59:05.309904+0000","last_peered":"2024-01-13T17:59:05.309904+0000","last_clean":"2024-01-13T17:59:05.309904+0000","last_became_active":"2024-01-13T17:58:36.841409+0000","last_became_peered":"2024-01-13T17:58:36.841409+0000","last_unstale":"2024-01-13T17:59:05.309904+0000","last_undegraded":"2024-01-13T17:59:05.309904+0000","last_fullsized":"2024-01-13T17:59:05.309904+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:56:02.964249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178720+0000","last_change":"2024-01-13T17:58:37.403381+0000","last_active":"2024-01-13T17:59:05.178720+0000","last_peered":"2024-01-13T17:59:05.178720+0000","last_clean":"2024-01-13T17:59:05.178720+0000","last_became_active":"2024-01-13T17:58:37.403108+0000","last_became_peered":"2024-01-13T17:58:37.403108+0000","last_unstale":"2024-01-13T17:59:05.178720+0000","last_undegraded":"2024-01-13T17:59:05.178720+0000","last_fullsized":"2024-01-13T17:59:05.178720+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:55:07.654474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"59'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183619+0000","last_change":"2024-01-13T17:58:36.835474+0000","last_active":"2024-01-13T17:59:05.183619+0000","last_peered":"2024-01-13T17:59:05.183619+0000","last_clean":"2024-01-13T17:59:05.183619+0000","last_became_active":"2024-01-13T17:58:36.835169+0000","last_became_peered":"2024-01-13T17:58:36.835169+0000","last_unstale":"2024-01-13T17:59:05.183619+0000","last_undegraded":"2024-01-13T17:59:05.183619+0000","last_fullsized":"2024-01-13T17:59:05.183619+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:02:02.178682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180210+0000","last_change":"2024-01-13T17:58:37.407252+0000","last_active":"2024-01-13T17:59:05.180210+0000","last_peered":"2024-01-13T17:59:05.180210+0000","last_clean":"2024-01-13T17:59:05.180210+0000","last_became_active":"2024-01-13T17:58:37.406352+0000","last_became_peered":"2024-01-13T17:58:37.406352+0000","last_unstale":"2024-01-13T17:59:05.180210+0000","last_undegraded":"2024-01-13T17:59:05.180210+0000","last_fullsized":"2024-01-13T17:59:05.180210+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:21:50.223964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"62'9","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.316696+0000","last_change":"2024-01-13T17:58:36.836500+0000","last_active":"2024-01-13T17:59:05.316696+0000","last_peered":"2024-01-13T17:59:05.316696+0000","last_clean":"2024-01-13T17:59:05.316696+0000","last_became_active":"2024-01-13T17:58:36.836231+0000","last_became_peered":"2024-01-13T17:58:36.836231+0000","last_unstale":"2024-01-13T17:59:05.316696+0000","last_undegraded":"2024-01-13T17:59:05.316696+0000","last_fullsized":"2024-01-13T17:59:05.316696+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:40:58.818088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2324,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176172+0000","last_change":"2024-01-13T17:58:37.409657+0000","last_active":"2024-01-13T17:59:05.176172+0000","last_peered":"2024-01-13T17:59:05.176172+0000","last_clean":"2024-01-13T17:59:05.176172+0000","last_became_active":"2024-01-13T17:58:37.409373+0000","last_became_peered":"2024-01-13T17:58:37.409373+0000","last_unstale":"2024-01-13T17:59:05.176172+0000","last_undegraded":"2024-01-13T17:59:05.176172+0000","last_fullsized":"2024-01-13T17:59:05.176172+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:40:04.184668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177982+0000","last_change":"2024-01-13T17:58:36.841243+0000","last_active":"2024-01-13T17:59:05.177982+0000","last_peered":"2024-01-13T17:59:05.177982+0000","last_clean":"2024-01-13T17:59:05.177982+0000","last_became_active":"2024-01-13T17:58:36.840803+0000","last_became_peered":"2024-01-13T17:58:36.840803+0000","last_unstale":"2024-01-13T17:59:05.177982+0000","last_undegraded":"2024-01-13T17:59:05.177982+0000","last_fullsized":"2024-01-13T17:59:05.177982+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:02:14.255922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178255+0000","last_change":"2024-01-13T17:58:37.409006+0000","last_active":"2024-01-13T17:59:05.178255+0000","last_peered":"2024-01-13T17:59:05.178255+0000","last_clean":"2024-01-13T17:59:05.178255+0000","last_became_active":"2024-01-13T17:58:37.408736+0000","last_became_peered":"2024-01-13T17:58:37.408736+0000","last_unstale":"2024-01-13T17:59:05.178255+0000","last_undegraded":"2024-01-13T17:59:05.178255+0000","last_fullsized":"2024-01-13T17:59:05.178255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:10:11.734133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309525+0000","last_change":"2024-01-13T17:58:36.841162+0000","last_active":"2024-01-13T17:59:05.309525+0000","last_peered":"2024-01-13T17:59:05.309525+0000","last_clean":"2024-01-13T17:59:05.309525+0000","last_became_active":"2024-01-13T17:58:36.840845+0000","last_became_peered":"2024-01-13T17:58:36.840845+0000","last_unstale":"2024-01-13T17:59:05.309525+0000","last_undegraded":"2024-01-13T17:59:05.309525+0000","last_fullsized":"2024-01-13T17:59:05.309525+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:56:48.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175876+0000","last_change":"2024-01-13T17:58:37.414263+0000","last_active":"2024-01-13T17:59:05.175876+0000","last_peered":"2024-01-13T17:59:05.175876+0000","last_clean":"2024-01-13T17:59:05.175876+0000","last_became_active":"2024-01-13T17:58:37.410388+0000","last_became_peered":"2024-01-13T17:58:37.410388+0000","last_unstale":"2024-01-13T17:59:05.175876+0000","last_undegraded":"2024-01-13T17:59:05.175876+0000","last_fullsized":"2024-01-13T17:59:05.175876+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:55:00.346625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.179987+0000","last_change":"2024-01-13T17:58:36.834846+0000","last_active":"2024-01-13T17:59:05.179987+0000","last_peered":"2024-01-13T17:59:05.179987+0000","last_clean":"2024-01-13T17:59:05.179987+0000","last_became_active":"2024-01-13T17:58:36.834531+0000","last_became_peered":"2024-01-13T17:58:36.834531+0000","last_unstale":"2024-01-13T17:59:05.179987+0000","last_undegraded":"2024-01-13T17:59:05.179987+0000","last_fullsized":"2024-01-13T17:59:05.179987+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:12:41.632590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.179967+0000","last_change":"2024-01-13T17:58:37.394865+0000","last_active":"2024-01-13T17:59:05.179967+0000","last_peered":"2024-01-13T17:59:05.179967+0000","last_clean":"2024-01-13T17:59:05.179967+0000","last_became_active":"2024-01-13T17:58:37.394490+0000","last_became_peered":"2024-01-13T17:58:37.394490+0000","last_unstale":"2024-01-13T17:59:05.179967+0000","last_undegraded":"2024-01-13T17:59:05.179967+0000","last_fullsized":"2024-01-13T17:59:05.179967+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:04:30.784006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"59'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546433+0000","last_change":"2024-01-13T17:58:36.831518+0000","last_active":"2024-01-13T17:59:05.546433+0000","last_peered":"2024-01-13T17:59:05.546433+0000","last_clean":"2024-01-13T17:59:05.546433+0000","last_became_active":"2024-01-13T17:58:36.831252+0000","last_became_peered":"2024-01-13T17:58:36.831252+0000","last_unstale":"2024-01-13T17:59:05.546433+0000","last_undegraded":"2024-01-13T17:59:05.546433+0000","last_fullsized":"2024-01-13T17:59:05.546433+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:42:53.797821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175712+0000","last_change":"2024-01-13T17:58:37.414840+0000","last_active":"2024-01-13T17:59:05.175712+0000","last_peered":"2024-01-13T17:59:05.175712+0000","last_clean":"2024-01-13T17:59:05.175712+0000","last_became_active":"2024-01-13T17:58:37.414540+0000","last_became_peered":"2024-01-13T17:58:37.414540+0000","last_unstale":"2024-01-13T17:59:05.175712+0000","last_undegraded":"2024-01-13T17:59:05.175712+0000","last_fullsized":"2024-01-13T17:59:05.175712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:24:57.534623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"59'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180853+0000","last_change":"2024-01-13T17:58:36.831411+0000","last_active":"2024-01-13T17:59:05.180853+0000","last_peered":"2024-01-13T17:59:05.180853+0000","last_clean":"2024-01-13T17:59:05.180853+0000","last_became_active":"2024-01-13T17:58:36.831126+0000","last_became_peered":"2024-01-13T17:58:36.831126+0000","last_unstale":"2024-01-13T17:59:05.180853+0000","last_undegraded":"2024-01-13T17:59:05.180853+0000","last_fullsized":"2024-01-13T17:59:05.180853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:12:48.869393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176034+0000","last_change":"2024-01-13T17:58:37.408885+0000","last_active":"2024-01-13T17:59:05.176034+0000","last_peered":"2024-01-13T17:59:05.176034+0000","last_clean":"2024-01-13T17:59:05.176034+0000","last_became_active":"2024-01-13T17:58:37.408618+0000","last_became_peered":"2024-01-13T17:58:37.408618+0000","last_unstale":"2024-01-13T17:59:05.176034+0000","last_undegraded":"2024-01-13T17:59:05.176034+0000","last_fullsized":"2024-01-13T17:59:05.176034+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:18:38.241218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.311690+0000","last_change":"2024-01-13T17:59:05.310836+0000","last_active":"2024-01-13T17:59:05.311690+0000","last_peered":"2024-01-13T17:59:05.311690+0000","last_clean":"2024-01-13T17:59:05.311690+0000","last_became_active":"2024-01-13T17:59:05.310557+0000","last_became_peered":"2024-01-13T17:59:05.310557+0000","last_unstale":"2024-01-13T17:59:05.311690+0000","last_undegraded":"2024-01-13T17:59:05.311690+0000","last_fullsized":"2024-01-13T17:59:05.311690+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:10:08.926746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.182755+0000","last_change":"2024-01-13T17:58:36.832399+0000","last_active":"2024-01-13T17:59:05.182755+0000","last_peered":"2024-01-13T17:59:05.182755+0000","last_clean":"2024-01-13T17:59:05.182755+0000","last_became_active":"2024-01-13T17:58:36.832100+0000","last_became_peered":"2024-01-13T17:58:36.832100+0000","last_unstale":"2024-01-13T17:59:05.182755+0000","last_undegraded":"2024-01-13T17:59:05.182755+0000","last_fullsized":"2024-01-13T17:59:05.182755+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:01:50.555635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309578+0000","last_change":"2024-01-13T17:58:37.402741+0000","last_active":"2024-01-13T17:59:05.309578+0000","last_peered":"2024-01-13T17:59:05.309578+0000","last_clean":"2024-01-13T17:59:05.309578+0000","last_became_active":"2024-01-13T17:58:37.402379+0000","last_became_peered":"2024-01-13T17:58:37.402379+0000","last_unstale":"2024-01-13T17:59:05.309578+0000","last_undegraded":"2024-01-13T17:59:05.309578+0000","last_fullsized":"2024-01-13T17:59:05.309578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:30:51.621102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.549487+0000","last_change":"2024-01-13T17:59:05.547393+0000","last_active":"2024-01-13T17:59:05.549487+0000","last_peered":"2024-01-13T17:59:05.549487+0000","last_clean":"2024-01-13T17:59:05.549487+0000","last_became_active":"2024-01-13T17:59:05.547105+0000","last_became_peered":"2024-01-13T17:59:05.547105+0000","last_unstale":"2024-01-13T17:59:05.549487+0000","last_undegraded":"2024-01-13T17:59:05.549487+0000","last_fullsized":"2024-01-13T17:59:05.549487+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:28:35.317481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309440+0000","last_change":"2024-01-13T17:58:36.836469+0000","last_active":"2024-01-13T17:59:05.309440+0000","last_peered":"2024-01-13T17:59:05.309440+0000","last_clean":"2024-01-13T17:59:05.309440+0000","last_became_active":"2024-01-13T17:58:36.836161+0000","last_became_peered":"2024-01-13T17:58:36.836161+0000","last_unstale":"2024-01-13T17:59:05.309440+0000","last_undegraded":"2024-01-13T17:59:05.309440+0000","last_fullsized":"2024-01-13T17:59:05.309440+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:00:00.583677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180878+0000","last_change":"2024-01-13T17:58:37.411383+0000","last_active":"2024-01-13T17:59:05.180878+0000","last_peered":"2024-01-13T17:59:05.180878+0000","last_clean":"2024-01-13T17:59:05.180878+0000","last_became_active":"2024-01-13T17:58:37.411086+0000","last_became_peered":"2024-01-13T17:58:37.411086+0000","last_unstale":"2024-01-13T17:59:05.180878+0000","last_undegraded":"2024-01-13T17:59:05.180878+0000","last_fullsized":"2024-01-13T17:59:05.180878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:29:49.851426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.311473+0000","last_change":"2024-01-13T17:59:05.310768+0000","last_active":"2024-01-13T17:59:05.311473+0000","last_peered":"2024-01-13T17:59:05.311473+0000","last_clean":"2024-01-13T17:59:05.311473+0000","last_became_active":"2024-01-13T17:59:05.310540+0000","last_became_peered":"2024-01-13T17:59:05.310540+0000","last_unstale":"2024-01-13T17:59:05.311473+0000","last_undegraded":"2024-01-13T17:59:05.311473+0000","last_fullsized":"2024-01-13T17:59:05.311473+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:08:47.529142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.182738+0000","last_change":"2024-01-13T17:58:37.395912+0000","last_active":"2024-01-13T17:59:05.182738+0000","last_peered":"2024-01-13T17:59:05.182738+0000","last_clean":"2024-01-13T17:59:05.182738+0000","last_became_active":"2024-01-13T17:58:37.395625+0000","last_became_peered":"2024-01-13T17:58:37.395625+0000","last_unstale":"2024-01-13T17:59:05.182738+0000","last_undegraded":"2024-01-13T17:59:05.182738+0000","last_fullsized":"2024-01-13T17:59:05.182738+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:28.565536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546203+0000","last_change":"2024-01-13T17:58:36.839719+0000","last_active":"2024-01-13T17:59:05.546203+0000","last_peered":"2024-01-13T17:59:05.546203+0000","last_clean":"2024-01-13T17:59:05.546203+0000","last_became_active":"2024-01-13T17:58:36.839440+0000","last_became_peered":"2024-01-13T17:58:36.839440+0000","last_unstale":"2024-01-13T17:59:05.546203+0000","last_undegraded":"2024-01-13T17:59:05.546203+0000","last_fullsized":"2024-01-13T17:59:05.546203+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:17:50.836804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.182907+0000","last_change":"2024-01-13T17:59:05.182636+0000","last_active":"2024-01-13T17:59:05.182907+0000","last_peered":"2024-01-13T17:59:05.182907+0000","last_clean":"2024-01-13T17:59:05.182907+0000","last_became_active":"2024-01-13T17:59:05.182314+0000","last_became_peered":"2024-01-13T17:59:05.182314+0000","last_unstale":"2024-01-13T17:59:05.182907+0000","last_undegraded":"2024-01-13T17:59:05.182907+0000","last_fullsized":"2024-01-13T17:59:05.182907+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:32:50.369684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176919+0000","last_change":"2024-01-13T17:58:37.397651+0000","last_active":"2024-01-13T17:59:05.176919+0000","last_peered":"2024-01-13T17:59:05.176919+0000","last_clean":"2024-01-13T17:59:05.176919+0000","last_became_active":"2024-01-13T17:58:37.397326+0000","last_became_peered":"2024-01-13T17:58:37.397326+0000","last_unstale":"2024-01-13T17:59:05.176919+0000","last_undegraded":"2024-01-13T17:59:05.176919+0000","last_fullsized":"2024-01-13T17:59:05.176919+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:24:26.902155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309258+0000","last_change":"2024-01-13T17:58:36.842492+0000","last_active":"2024-01-13T17:59:05.309258+0000","last_peered":"2024-01-13T17:59:05.309258+0000","last_clean":"2024-01-13T17:59:05.309258+0000","last_became_active":"2024-01-13T17:58:36.842172+0000","last_became_peered":"2024-01-13T17:58:36.842172+0000","last_unstale":"2024-01-13T17:59:05.309258+0000","last_undegraded":"2024-01-13T17:59:05.309258+0000","last_fullsized":"2024-01-13T17:59:05.309258+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:58:24.249555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"63'128","reported_seq":274,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-01-13T17:59:07.280553+0000","last_change":"2024-01-13T17:58:27.209773+0000","last_active":"2024-01-13T17:59:07.280553+0000","last_peered":"2024-01-13T17:59:07.280553+0000","last_clean":"2024-01-13T17:59:07.280553+0000","last_became_active":"2024-01-13T17:58:27.209293+0000","last_became_peered":"2024-01-13T17:58:27.209293+0000","last_unstale":"2024-01-13T17:59:07.280553+0000","last_undegraded":"2024-01-13T17:59:07.280553+0000","last_fullsized":"2024-01-13T17:59:07.280553+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_clean_scrub_stamp":"2024-01-13T17:56:59.530229+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:45:29.626217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.548596+0000","last_change":"2024-01-13T17:59:05.547394+0000","last_active":"2024-01-13T17:59:05.548596+0000","last_peered":"2024-01-13T17:59:05.548596+0000","last_clean":"2024-01-13T17:59:05.548596+0000","last_became_active":"2024-01-13T17:59:05.547115+0000","last_became_peered":"2024-01-13T17:59:05.547115+0000","last_unstale":"2024-01-13T17:59:05.548596+0000","last_undegraded":"2024-01-13T17:59:05.548596+0000","last_fullsized":"2024-01-13T17:59:05.548596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:38:56.099495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177580+0000","last_change":"2024-01-13T17:58:37.403318+0000","last_active":"2024-01-13T17:59:05.177580+0000","last_peered":"2024-01-13T17:59:05.177580+0000","last_clean":"2024-01-13T17:59:05.177580+0000","last_became_active":"2024-01-13T17:58:37.403022+0000","last_became_peered":"2024-01-13T17:58:37.403022+0000","last_unstale":"2024-01-13T17:59:05.177580+0000","last_undegraded":"2024-01-13T17:59:05.177580+0000","last_fullsized":"2024-01-13T17:59:05.177580+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:13:06.307215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175515+0000","last_change":"2024-01-13T17:58:36.844962+0000","last_active":"2024-01-13T17:59:05.175515+0000","last_peered":"2024-01-13T17:59:05.175515+0000","last_clean":"2024-01-13T17:59:05.175515+0000","last_became_active":"2024-01-13T17:58:36.844443+0000","last_became_peered":"2024-01-13T17:58:36.844443+0000","last_unstale":"2024-01-13T17:59:05.175515+0000","last_undegraded":"2024-01-13T17:59:05.175515+0000","last_fullsized":"2024-01-13T17:59:05.175515+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:13:21.802704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.310961+0000","last_change":"2024-01-13T17:59:05.310298+0000","last_active":"2024-01-13T17:59:05.310961+0000","last_peered":"2024-01-13T17:59:05.310961+0000","last_clean":"2024-01-13T17:59:05.310961+0000","last_became_active":"2024-01-13T17:59:05.310046+0000","last_became_peered":"2024-01-13T17:59:05.310046+0000","last_unstale":"2024-01-13T17:59:05.310961+0000","last_undegraded":"2024-01-13T17:59:05.310961+0000","last_fullsized":"2024-01-13T17:59:05.310961+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:32:39.783518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176327+0000","last_change":"2024-01-13T17:58:36.845469+0000","last_active":"2024-01-13T17:59:05.176327+0000","last_peered":"2024-01-13T17:59:05.176327+0000","last_clean":"2024-01-13T17:59:05.176327+0000","last_became_active":"2024-01-13T17:58:36.845158+0000","last_became_peered":"2024-01-13T17:58:36.845158+0000","last_unstale":"2024-01-13T17:59:05.176327+0000","last_undegraded":"2024-01-13T17:59:05.176327+0000","last_fullsized":"2024-01-13T17:59:05.176327+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:46.603258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183479+0000","last_change":"2024-01-13T17:58:37.395393+0000","last_active":"2024-01-13T17:59:05.183479+0000","last_peered":"2024-01-13T17:59:05.183479+0000","last_clean":"2024-01-13T17:59:05.183479+0000","last_became_active":"2024-01-13T17:58:37.395105+0000","last_became_peered":"2024-01-13T17:58:37.395105+0000","last_unstale":"2024-01-13T17:59:05.183479+0000","last_undegraded":"2024-01-13T17:59:05.183479+0000","last_fullsized":"2024-01-13T17:59:05.183479+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:45:12.100528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181621+0000","last_change":"2024-01-13T17:59:05.180992+0000","last_active":"2024-01-13T17:59:05.181621+0000","last_peered":"2024-01-13T17:59:05.181621+0000","last_clean":"2024-01-13T17:59:05.181621+0000","last_became_active":"2024-01-13T17:59:05.180705+0000","last_became_peered":"2024-01-13T17:59:05.180705+0000","last_unstale":"2024-01-13T17:59:05.181621+0000","last_undegraded":"2024-01-13T17:59:05.181621+0000","last_fullsized":"2024-01-13T17:59:05.181621+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:28:08.013633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183679+0000","last_change":"2024-01-13T17:58:36.841642+0000","last_active":"2024-01-13T17:59:05.183679+0000","last_peered":"2024-01-13T17:59:05.183679+0000","last_clean":"2024-01-13T17:59:05.183679+0000","last_became_active":"2024-01-13T17:58:36.840768+0000","last_became_peered":"2024-01-13T17:58:36.840768+0000","last_unstale":"2024-01-13T17:59:05.183679+0000","last_undegraded":"2024-01-13T17:59:05.183679+0000","last_fullsized":"2024-01-13T17:59:05.183679+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:03:26.813924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177957+0000","last_change":"2024-01-13T17:58:37.414477+0000","last_active":"2024-01-13T17:59:05.177957+0000","last_peered":"2024-01-13T17:59:05.177957+0000","last_clean":"2024-01-13T17:59:05.177957+0000","last_became_active":"2024-01-13T17:58:37.414307+0000","last_became_peered":"2024-01-13T17:58:37.414307+0000","last_unstale":"2024-01-13T17:59:05.177957+0000","last_undegraded":"2024-01-13T17:59:05.177957+0000","last_fullsized":"2024-01-13T17:59:05.177957+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:38:41.330284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.310692+0000","last_change":"2024-01-13T17:59:05.310494+0000","last_active":"2024-01-13T17:59:05.310692+0000","last_peered":"2024-01-13T17:59:05.310692+0000","last_clean":"2024-01-13T17:59:05.310692+0000","last_became_active":"2024-01-13T17:59:05.310135+0000","last_became_peered":"2024-01-13T17:59:05.310135+0000","last_unstale":"2024-01-13T17:59:05.310692+0000","last_undegraded":"2024-01-13T17:59:05.310692+0000","last_fullsized":"2024-01-13T17:59:05.310692+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:13:06.215978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181231+0000","last_change":"2024-01-13T17:58:36.839829+0000","last_active":"2024-01-13T17:59:05.181231+0000","last_peered":"2024-01-13T17:59:05.181231+0000","last_clean":"2024-01-13T17:59:05.181231+0000","last_became_active":"2024-01-13T17:58:36.839541+0000","last_became_peered":"2024-01-13T17:58:36.839541+0000","last_unstale":"2024-01-13T17:59:05.181231+0000","last_undegraded":"2024-01-13T17:59:05.181231+0000","last_fullsized":"2024-01-13T17:59:05.181231+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:52:18.758870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178618+0000","last_change":"2024-01-13T17:58:37.401139+0000","last_active":"2024-01-13T17:59:05.178618+0000","last_peered":"2024-01-13T17:59:05.178618+0000","last_clean":"2024-01-13T17:59:05.178618+0000","last_became_active":"2024-01-13T17:58:37.400836+0000","last_became_peered":"2024-01-13T17:58:37.400836+0000","last_unstale":"2024-01-13T17:59:05.178618+0000","last_undegraded":"2024-01-13T17:59:05.178618+0000","last_fullsized":"2024-01-13T17:59:05.178618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:15:29.881505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175607+0000","last_change":"2024-01-13T17:58:36.844748+0000","last_active":"2024-01-13T17:59:05.175607+0000","last_peered":"2024-01-13T17:59:05.175607+0000","last_clean":"2024-01-13T17:59:05.175607+0000","last_became_active":"2024-01-13T17:58:36.844002+0000","last_became_peered":"2024-01-13T17:58:36.844002+0000","last_unstale":"2024-01-13T17:59:05.175607+0000","last_undegraded":"2024-01-13T17:59:05.175607+0000","last_fullsized":"2024-01-13T17:59:05.175607+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:14:57.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.180372+0000","last_change":"2024-01-13T17:58:37.409079+0000","last_active":"2024-01-13T17:59:05.180372+0000","last_peered":"2024-01-13T17:59:05.180372+0000","last_clean":"2024-01-13T17:59:05.180372+0000","last_became_active":"2024-01-13T17:58:37.408807+0000","last_became_peered":"2024-01-13T17:58:37.408807+0000","last_unstale":"2024-01-13T17:59:05.180372+0000","last_undegraded":"2024-01-13T17:59:05.180372+0000","last_fullsized":"2024-01-13T17:59:05.180372+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:53:09.994807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.182955+0000","last_change":"2024-01-13T17:58:36.841464+0000","last_active":"2024-01-13T17:59:05.182955+0000","last_peered":"2024-01-13T17:59:05.182955+0000","last_clean":"2024-01-13T17:59:05.182955+0000","last_became_active":"2024-01-13T17:58:36.840078+0000","last_became_peered":"2024-01-13T17:58:36.840078+0000","last_unstale":"2024-01-13T17:59:05.182955+0000","last_undegraded":"2024-01-13T17:59:05.182955+0000","last_fullsized":"2024-01-13T17:59:05.182955+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:39:59.597495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177796+0000","last_change":"2024-01-13T17:58:37.408303+0000","last_active":"2024-01-13T17:59:05.177796+0000","last_peered":"2024-01-13T17:59:05.177796+0000","last_clean":"2024-01-13T17:59:05.177796+0000","last_became_active":"2024-01-13T17:58:37.407988+0000","last_became_peered":"2024-01-13T17:58:37.407988+0000","last_unstale":"2024-01-13T17:59:05.177796+0000","last_undegraded":"2024-01-13T17:59:05.177796+0000","last_fullsized":"2024-01-13T17:59:05.177796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:45:25.570947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183261+0000","last_change":"2024-01-13T17:58:36.841581+0000","last_active":"2024-01-13T17:59:05.183261+0000","last_peered":"2024-01-13T17:59:05.183261+0000","last_clean":"2024-01-13T17:59:05.183261+0000","last_became_active":"2024-01-13T17:58:36.841192+0000","last_became_peered":"2024-01-13T17:58:36.841192+0000","last_unstale":"2024-01-13T17:59:05.183261+0000","last_undegraded":"2024-01-13T17:59:05.183261+0000","last_fullsized":"2024-01-13T17:59:05.183261+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:39:05.602781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177145+0000","last_change":"2024-01-13T17:58:37.402047+0000","last_active":"2024-01-13T17:59:05.177145+0000","last_peered":"2024-01-13T17:59:05.177145+0000","last_clean":"2024-01-13T17:59:05.177145+0000","last_became_active":"2024-01-13T17:58:37.401769+0000","last_became_peered":"2024-01-13T17:58:37.401769+0000","last_unstale":"2024-01-13T17:59:05.177145+0000","last_undegraded":"2024-01-13T17:59:05.177145+0000","last_fullsized":"2024-01-13T17:59:05.177145+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:32:35.369119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.175774+0000","last_change":"2024-01-13T17:58:36.844613+0000","last_active":"2024-01-13T17:59:05.175774+0000","last_peered":"2024-01-13T17:59:05.175774+0000","last_clean":"2024-01-13T17:59:05.175774+0000","last_became_active":"2024-01-13T17:58:36.844286+0000","last_became_peered":"2024-01-13T17:58:36.844286+0000","last_unstale":"2024-01-13T17:59:05.175774+0000","last_undegraded":"2024-01-13T17:59:05.175774+0000","last_fullsized":"2024-01-13T17:59:05.175774+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:27:48.244809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181937+0000","last_change":"2024-01-13T17:58:37.399084+0000","last_active":"2024-01-13T17:59:05.181937+0000","last_peered":"2024-01-13T17:59:05.181937+0000","last_clean":"2024-01-13T17:59:05.181937+0000","last_became_active":"2024-01-13T17:58:37.398572+0000","last_became_peered":"2024-01-13T17:58:37.398572+0000","last_unstale":"2024-01-13T17:59:05.181937+0000","last_undegraded":"2024-01-13T17:59:05.181937+0000","last_fullsized":"2024-01-13T17:59:05.181937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:18:41.057728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546317+0000","last_change":"2024-01-13T17:58:36.837432+0000","last_active":"2024-01-13T17:59:05.546317+0000","last_peered":"2024-01-13T17:59:05.546317+0000","last_clean":"2024-01-13T17:59:05.546317+0000","last_became_active":"2024-01-13T17:58:36.837168+0000","last_became_peered":"2024-01-13T17:58:36.837168+0000","last_unstale":"2024-01-13T17:59:05.546317+0000","last_undegraded":"2024-01-13T17:59:05.546317+0000","last_fullsized":"2024-01-13T17:59:05.546317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:37:30.125718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176249+0000","last_change":"2024-01-13T17:58:37.416032+0000","last_active":"2024-01-13T17:59:05.176249+0000","last_peered":"2024-01-13T17:59:05.176249+0000","last_clean":"2024-01-13T17:59:05.176249+0000","last_became_active":"2024-01-13T17:58:37.415759+0000","last_became_peered":"2024-01-13T17:58:37.415759+0000","last_unstale":"2024-01-13T17:59:05.176249+0000","last_undegraded":"2024-01-13T17:59:05.176249+0000","last_fullsized":"2024-01-13T17:59:05.176249+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:24.483081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"59'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183571+0000","last_change":"2024-01-13T17:58:36.834302+0000","last_active":"2024-01-13T17:59:05.183571+0000","last_peered":"2024-01-13T17:59:05.183571+0000","last_clean":"2024-01-13T17:59:05.183571+0000","last_became_active":"2024-01-13T17:58:36.833658+0000","last_became_peered":"2024-01-13T17:58:36.833658+0000","last_unstale":"2024-01-13T17:59:05.183571+0000","last_undegraded":"2024-01-13T17:59:05.183571+0000","last_fullsized":"2024-01-13T17:59:05.183571+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:13:18.505657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309444+0000","last_change":"2024-01-13T17:58:37.402650+0000","last_active":"2024-01-13T17:59:05.309444+0000","last_peered":"2024-01-13T17:59:05.309444+0000","last_clean":"2024-01-13T17:59:05.309444+0000","last_became_active":"2024-01-13T17:58:37.402128+0000","last_became_peered":"2024-01-13T17:58:37.402128+0000","last_unstale":"2024-01-13T17:59:05.309444+0000","last_undegraded":"2024-01-13T17:59:05.309444+0000","last_fullsized":"2024-01-13T17:59:05.309444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:02:28.745789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"59'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546466+0000","last_change":"2024-01-13T17:58:36.836861+0000","last_active":"2024-01-13T17:59:05.546466+0000","last_peered":"2024-01-13T17:59:05.546466+0000","last_clean":"2024-01-13T17:59:05.546466+0000","last_became_active":"2024-01-13T17:58:36.836593+0000","last_became_peered":"2024-01-13T17:58:36.836593+0000","last_unstale":"2024-01-13T17:59:05.546466+0000","last_undegraded":"2024-01-13T17:59:05.546466+0000","last_fullsized":"2024-01-13T17:59:05.546466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:34:37.144467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176053+0000","last_change":"2024-01-13T17:58:37.414378+0000","last_active":"2024-01-13T17:59:05.176053+0000","last_peered":"2024-01-13T17:59:05.176053+0000","last_clean":"2024-01-13T17:59:05.176053+0000","last_became_active":"2024-01-13T17:58:37.414097+0000","last_became_peered":"2024-01-13T17:58:37.414097+0000","last_unstale":"2024-01-13T17:59:05.176053+0000","last_undegraded":"2024-01-13T17:59:05.176053+0000","last_fullsized":"2024-01-13T17:59:05.176053+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:45:12.430007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.179827+0000","last_change":"2024-01-13T17:58:37.397227+0000","last_active":"2024-01-13T17:59:05.179827+0000","last_peered":"2024-01-13T17:59:05.179827+0000","last_clean":"2024-01-13T17:59:05.179827+0000","last_became_active":"2024-01-13T17:58:37.396928+0000","last_became_peered":"2024-01-13T17:58:37.396928+0000","last_unstale":"2024-01-13T17:59:05.179827+0000","last_undegraded":"2024-01-13T17:59:05.179827+0000","last_fullsized":"2024-01-13T17:59:05.179827+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:59:55.499543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.546303+0000","last_change":"2024-01-13T17:58:37.396849+0000","last_active":"2024-01-13T17:59:05.546303+0000","last_peered":"2024-01-13T17:59:05.546303+0000","last_clean":"2024-01-13T17:59:05.546303+0000","last_became_active":"2024-01-13T17:58:37.396585+0000","last_became_peered":"2024-01-13T17:58:37.396585+0000","last_unstale":"2024-01-13T17:59:05.546303+0000","last_undegraded":"2024-01-13T17:59:05.546303+0000","last_fullsized":"2024-01-13T17:59:05.546303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:32.529315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309584+0000","last_change":"2024-01-13T17:58:37.403640+0000","last_active":"2024-01-13T17:59:05.309584+0000","last_peered":"2024-01-13T17:59:05.309584+0000","last_clean":"2024-01-13T17:59:05.309584+0000","last_became_active":"2024-01-13T17:58:37.403041+0000","last_became_peered":"2024-01-13T17:58:37.403041+0000","last_unstale":"2024-01-13T17:59:05.309584+0000","last_undegraded":"2024-01-13T17:59:05.309584+0000","last_fullsized":"2024-01-13T17:59:05.309584+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:11:37.683734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177822+0000","last_change":"2024-01-13T17:58:37.403739+0000","last_active":"2024-01-13T17:59:05.177822+0000","last_peered":"2024-01-13T17:59:05.177822+0000","last_clean":"2024-01-13T17:59:05.177822+0000","last_became_active":"2024-01-13T17:58:37.403471+0000","last_became_peered":"2024-01-13T17:58:37.403471+0000","last_unstale":"2024-01-13T17:59:05.177822+0000","last_undegraded":"2024-01-13T17:59:05.177822+0000","last_fullsized":"2024-01-13T17:59:05.177822+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:13:50.178194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178201+0000","last_change":"2024-01-13T17:58:37.401852+0000","last_active":"2024-01-13T17:59:05.178201+0000","last_peered":"2024-01-13T17:59:05.178201+0000","last_clean":"2024-01-13T17:59:05.178201+0000","last_became_active":"2024-01-13T17:58:37.401546+0000","last_became_peered":"2024-01-13T17:58:37.401546+0000","last_unstale":"2024-01-13T17:59:05.178201+0000","last_undegraded":"2024-01-13T17:59:05.178201+0000","last_fullsized":"2024-01-13T17:59:05.178201+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:25:50.041002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.183519+0000","last_change":"2024-01-13T17:58:37.395592+0000","last_active":"2024-01-13T17:59:05.183519+0000","last_peered":"2024-01-13T17:59:05.183519+0000","last_clean":"2024-01-13T17:59:05.183519+0000","last_became_active":"2024-01-13T17:58:37.395306+0000","last_became_peered":"2024-01-13T17:58:37.395306+0000","last_unstale":"2024-01-13T17:59:05.183519+0000","last_undegraded":"2024-01-13T17:59:05.183519+0000","last_fullsized":"2024-01-13T17:59:05.183519+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:06:42.102077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181019+0000","last_change":"2024-01-13T17:58:37.409861+0000","last_active":"2024-01-13T17:59:05.181019+0000","last_peered":"2024-01-13T17:59:05.181019+0000","last_clean":"2024-01-13T17:59:05.181019+0000","last_became_active":"2024-01-13T17:58:37.409345+0000","last_became_peered":"2024-01-13T17:58:37.409345+0000","last_unstale":"2024-01-13T17:59:05.181019+0000","last_undegraded":"2024-01-13T17:59:05.181019+0000","last_fullsized":"2024-01-13T17:59:05.181019+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:00:44.773057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.178034+0000","last_change":"2024-01-13T17:58:37.402771+0000","last_active":"2024-01-13T17:59:05.178034+0000","last_peered":"2024-01-13T17:59:05.178034+0000","last_clean":"2024-01-13T17:59:05.178034+0000","last_became_active":"2024-01-13T17:58:37.402517+0000","last_became_peered":"2024-01-13T17:58:37.402517+0000","last_unstale":"2024-01-13T17:59:05.178034+0000","last_undegraded":"2024-01-13T17:59:05.178034+0000","last_fullsized":"2024-01-13T17:59:05.178034+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:14:28.931595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309376+0000","last_change":"2024-01-13T17:58:37.402590+0000","last_active":"2024-01-13T17:59:05.309376+0000","last_peered":"2024-01-13T17:59:05.309376+0000","last_clean":"2024-01-13T17:59:05.309376+0000","last_became_active":"2024-01-13T17:58:37.402233+0000","last_became_peered":"2024-01-13T17:58:37.402233+0000","last_unstale":"2024-01-13T17:59:05.309376+0000","last_undegraded":"2024-01-13T17:59:05.309376+0000","last_fullsized":"2024-01-13T17:59:05.309376+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:48:51.046376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.176873+0000","last_change":"2024-01-13T17:58:37.403312+0000","last_active":"2024-01-13T17:59:05.176873+0000","last_peered":"2024-01-13T17:59:05.176873+0000","last_clean":"2024-01-13T17:59:05.176873+0000","last_became_active":"2024-01-13T17:58:37.403093+0000","last_became_peered":"2024-01-13T17:58:37.403093+0000","last_unstale":"2024-01-13T17:59:05.176873+0000","last_undegraded":"2024-01-13T17:59:05.176873+0000","last_fullsized":"2024-01-13T17:59:05.176873+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:27:24.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.309599+0000","last_change":"2024-01-13T17:58:37.411533+0000","last_active":"2024-01-13T17:59:05.309599+0000","last_peered":"2024-01-13T17:59:05.309599+0000","last_clean":"2024-01-13T17:59:05.309599+0000","last_became_active":"2024-01-13T17:58:37.411192+0000","last_became_peered":"2024-01-13T17:58:37.411192+0000","last_unstale":"2024-01-13T17:59:05.309599+0000","last_undegraded":"2024-01-13T17:59:05.309599+0000","last_fullsized":"2024-01-13T17:59:05.309599+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:31:15.289987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.177898+0000","last_change":"2024-01-13T17:58:37.409594+0000","last_active":"2024-01-13T17:59:05.177898+0000","last_peered":"2024-01-13T17:59:05.177898+0000","last_clean":"2024-01-13T17:59:05.177898+0000","last_became_active":"2024-01-13T17:58:37.409319+0000","last_became_peered":"2024-01-13T17:58:37.409319+0000","last_unstale":"2024-01-13T17:59:05.177898+0000","last_undegraded":"2024-01-13T17:59:05.177898+0000","last_fullsized":"2024-01-13T17:59:05.177898+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:21:11.322832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-13T17:59:05.181737+0000","last_change":"2024-01-13T17:58:37.400265+0000","last_active":"2024-01-13T17:59:05.181737+0000","last_peered":"2024-01-13T17:59:05.181737+0000","last_clean":"2024-01-13T17:59:05.181737+0000","last_became_active":"2024-01-13T17:58:37.399952+0000","last_became_peered":"2024-01-13T17:58:37.399952+0000","last_unstale":"2024-01-13T17:59:05.181737+0000","last_undegraded":"2024-01-13T17:59:05.181737+0000","last_fullsized":"2024-01-13T17:59:05.181737+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:04.725745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3094,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":52,"seq":223338299407,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298492,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446660,"statfs":{"total":95995035648,"available":95689379840,"internally_reserved":0,"allocated":1232896,"data_stored":862545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35899999999999999}]},{"osd":1,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.373},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.30399999999999999}]},{"osd":2,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.1190000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.31900000000000001}]},{"osd":3,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.434},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.48699999999999999}]},{"osd":6,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51500000000000001}]}]},{"osd":6,"up_from":44,"seq":188978561041,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298496,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446656,"statfs":{"total":95995035648,"available":95689375744,"internally_reserved":0,"allocated":1236992,"data_stored":864351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.29399999999999998}]},{"osd":1,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.48499999999999999}]},{"osd":3,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.377},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.432}]},{"osd":5,"last update":"Sat Jan 13 17:59:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.39100000000000001}]},{"osd":7,"last update":"Sat Jan 13 17:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.504},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48999999999999999}]}]},{"osd":4,"up_from":30,"seq":128849018905,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447228,"statfs":{"total":95995035648,"available":95689961472,"internally_reserved":0,"allocated":651264,"data_stored":272604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.437},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.58899999999999997}]},{"osd":1,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Sat Jan 13 17:58:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.46400000000000002}]},{"osd":5,"last update":"Sat Jan 13 17:58:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.28299999999999997}]},{"osd":6,"last update":"Sat Jan 13 17:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.372},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.317}]},{"osd":7,"last update":"Sat Jan 13 17:59:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.33500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297912,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447240,"statfs":{"total":95995035648,"available":95689973760,"internally_reserved":0,"allocated":638976,"data_stored":271819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:43 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33600000000000002,"15min":0.33100000000000002},"min":{"1min":0.215,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.314},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.34499999999999997,"15min":0.33200000000000002},"min":{"1min":0.26600000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.26000000000000001}]},{"osd":2,"last update":"Sat Jan 13 17:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39400000000000002,"15min":0.39500000000000002},"min":{"1min":0.27500000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55400000000000005,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.29599999999999999}]},{"osd":3,"last update":"Sat Jan 13 17:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.58699999999999997}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39200000000000002}]},{"osd":5,"last update":"Sat Jan 13 17:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46400000000000002}]},{"osd":6,"last update":"Sat Jan 13 17:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298504,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446648,"statfs":{"total":95995035648,"available":95689367552,"internally_reserved":0,"allocated":1245184,"data_stored":862992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 13 17:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38200000000000001,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.40699999999999997,"15min":0.40300000000000002},"min":{"1min":0.28899999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.313}]},{"osd":2,"last update":"Sat Jan 13 17:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.27600000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.44500000000000001,"15min":0.45500000000000002},"min":{"1min":0.26600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53900000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.255}]},{"osd":3,"last update":"Sat Jan 13 17:59:22 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.51500000000000001,"15min":0.53300000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.374},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.62,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.34200000000000003}]},{"osd":5,"last update":"Sat Jan 13 17:58:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.502}]},{"osd":6,"last update":"Sat Jan 13 17:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411360,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297908,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447244,"statfs":{"total":95995035648,"available":95689977856,"internally_reserved":0,"allocated":634880,"data_stored":271924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:59:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.38100000000000001,"15min":0.38600000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48799999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.29699999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Jan 13 17:59:03 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.41799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Jan 13 17:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.47099999999999997,"15min":0.47999999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.747,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.313},{"interface":"front","average":{"1min":0.433,"5min":0.48499999999999999,"15min":0.49399999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.36899999999999999}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39600000000000002}]},{"osd":5,"last update":"Sat Jan 13 17:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.436},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.38700000000000001}]},{"osd":6,"last update":"Sat Jan 13 17:59:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182429,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447224,"statfs":{"total":95995035648,"available":95689957376,"internally_reserved":0,"allocated":655360,"data_stored":274352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.51700000000000002,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":11.647,"5min":11.647,"15min":11.647},"last":0.27100000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.59299999999999997,"15min":0.51300000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":13.962,"5min":13.962,"15min":13.962},"last":0.28299999999999997}]},{"osd":1,"last update":"Sat Jan 13 17:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.44700000000000001,"15min":0.45300000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.23300000000000001}]},{"osd":2,"last update":"Sat Jan 13 17:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.495,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.313},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.58299999999999996,"15min":0.52500000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":11.262,"5min":11.262,"15min":11.262},"last":0.30499999999999999}]},{"osd":4,"last update":"Sat Jan 13 17:58:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.35399999999999998}]},{"osd":5,"last update":"Sat Jan 13 17:58:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.41399999999999998}]},{"osd":6,"last update":"Sat Jan 13 17:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.47499999999999998}]},{"osd":7,"last update":"Sat Jan 13 17:59:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":11.346,"5min":11.346,"15min":11.346},"last":0.498},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.39100000000000001}]}]},{"osd":5,"up_from":37,"seq":158913789973,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447228,"statfs":{"total":95995035648,"available":95689961472,"internally_reserved":0,"allocated":651264,"data_stored":274338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 17:58:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.37}]},{"osd":1,"last update":"Sat Jan 13 17:58:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.433}]},{"osd":2,"last update":"Sat Jan 13 17:58:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.48899999999999999}]},{"osd":3,"last update":"Sat Jan 13 17:58:51 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Sat Jan 13 17:58:51 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.313},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44900000000000001}]},{"osd":6,"last update":"Sat Jan 13 17:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-13T17:59:30.682 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-01-13T17:59:30.682 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-13T17:59:30.682 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-01-13T17:59:30.683 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph health --format=json 2024-01-13T17:59:30.940 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:31.311 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:31 smithi084 ceph-mon[52328]: from='client.24689 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:59:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:31 smithi099 ceph-mon[71325]: from='client.24689 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:59:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:31 smithi084 ceph-mon[37908]: from='client.24689 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T17:59:32.136 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:32.136 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-13T17:59:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:32 smithi099 ceph-mon[71325]: pgmap v17: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:32 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1552925335' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-13T17:59:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:32 smithi084 ceph-mon[37908]: pgmap v17: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:32 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1552925335' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-13T17:59:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:32 smithi084 ceph-mon[52328]: pgmap v17: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:32 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1552925335' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-13T17:59:32.501 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-01-13T17:59:32.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-13T17:59:32.817 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:32.817 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:59:06.172263+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-13T17:58:35.312354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-13T17:58:36.379223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"rbd","create_time":"2024-01-13T17:59:04.296556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:6800/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/1455901095":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3916505137":"2024-01-14T17:59:05.164416+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/1946108910":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3513905448":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:59:32.831 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-13T17:56:59.053508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-13T17:58:35.312354+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-13T17:58:36.379223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'rbd', 'create_time': '2024-01-13T17:59:04.296556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-13T17:59:32.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-13T17:59:33.143 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-01-13T17:59:33.157 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-13T17:59:33.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:33 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3317271857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:33.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:33 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3129830719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:59:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:33 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3317271857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:33 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3129830719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:59:33.475 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-01-13T17:59:33.490 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-13T17:59:33.505 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3317271857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:33.505 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3129830719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:59:33.505 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 systemd[1]: Starting Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:59:33.808 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-01-13T17:59:33.815 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 bash[108630]: 8bf31d445aaef2672caf3b2f633ca9d5c7ccdc3af419992c802adacbe2a8747f 2024-01-13T17:59:33.815 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 systemd[1]: Started Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:59:33.824 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-13T17:59:34.067 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814430543Z level=info msg="Starting Grafana" version=9.4.7 commit=4add91f03d branch=HEAD compiled=2023-03-16T23:56:52Z 2024-01-13T17:59:34.067 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814629786Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-01-13T17:59:34.067 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814648663Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-01-13T17:59:34.067 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814655683Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-01-13T17:59:34.067 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814661666Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-01-13T17:59:34.067 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814667865Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-01-13T17:59:34.067 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814673399Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-01-13T17:59:34.067 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814679062Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-01-13T17:59:34.067 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814685203Z level=info msg="Path Home" path=/usr/share/grafana 2024-01-13T17:59:34.067 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814691073Z level=info msg="Path Data" path=/var/lib/grafana 2024-01-13T17:59:34.067 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814696484Z level=info msg="Path Logs" path=/var/log/grafana 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814701865Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814707469Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=settings t=2024-01-13T17:59:33.814713692Z level=info msg="App mode production" 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=sqlstore t=2024-01-13T17:59:33.814762333Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=sqlstore t=2024-01-13T17:59:33.814778058Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.815696182Z level=info msg="Starting DB migrations" 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.815765465Z level=info msg="Executing migration" id="create migration_log table" 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.81627833Z level=info msg="Executing migration" id="create user table" 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.816677236Z level=info msg="Executing migration" id="add unique index user.login" 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.817100311Z level=info msg="Executing migration" id="add unique index user.email" 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.817522223Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.817947599Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.818326079Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-01-13T17:59:34.068 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.819054804Z level=info msg="Executing migration" id="create user table v2" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.819453558Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.819843872Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.820266601Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.820564146Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.820945585Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.821314621Z level=info msg="Executing migration" id="Update user table charset" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.821566993Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.821996385Z level=info msg="Executing migration" id="Add missing user data" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.822308304Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.822687279Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.823071238Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.823450634Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.824530169Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.824949967Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-01-13T17:59:34.069 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.825349951Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.825730454Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.828819583Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.831546973Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.834550278Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.837402709Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.84009597Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.84046848Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.84340552Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.846381322Z level=info msg="Executing migration" id="create temp_user v2" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.849123102Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.8495389Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.850345199Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-01-13T17:59:34.070 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.851245621Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.852090926Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.852447092Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.853419988Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.854100517Z level=info msg="Executing migration" id="create star table" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.855003416Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.855822891Z level=info msg="Executing migration" id="create org table v1" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.856774648Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.857441434Z level=info msg="Executing migration" id="create org_user table v1" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.858323607Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.859301373Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.859959493Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.860801349Z level=info msg="Executing migration" id="Update org table charset" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.861787451Z level=info msg="Executing migration" id="Update org_user table charset" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.862556835Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-01-13T17:59:34.071 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.863374834Z level=info msg="Executing migration" id="create dashboard table" 2024-01-13T17:59:34.072 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.864316479Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-01-13T17:59:34.072 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.86703282Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-01-13T17:59:34.072 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.869852841Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-01-13T17:59:34.072 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.872808423Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-01-13T17:59:34.072 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.87541988Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-01-13T17:59:34.072 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.878171251Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-01-13T17:59:34.072 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.881129049Z level=info msg="Executing migration" id="create dashboard v2" 2024-01-13T17:59:34.072 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.883716278Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-01-13T17:59:34.072 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.886635745Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-01-13T17:59:34.072 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.889209479Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.892016976Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.894848188Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.897505747Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.900405839Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.903172218Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.905918932Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.908632429Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.911231878Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.913866123Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.916681127Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.919450956Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.922015972Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.924710017Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-01-13T17:59:34.073 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.927463104Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.930202263Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.932884225Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.935450482Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.937904433Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.940662214Z level=info msg="Executing migration" id="Update dashboard title length" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.943172092Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.945826553Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.948554225Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.951375331Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.954254794Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.956831342Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.959462253Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.96008705Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.961071881Z level=info msg="Executing migration" id="Add check_sum column" 2024-01-13T17:59:34.074 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.961739813Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.962590658Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.963505041Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.964252166Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.965041298Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.965898521Z level=info msg="Executing migration" id="create data_source table" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.966694227Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.967507005Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.968364144Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.969333673Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.969958923Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.971152703Z level=info msg="Executing migration" id="create data_source table v2" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.97201518Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.972800532Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-01-13T17:59:34.075 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.97362959Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.974560492Z level=info msg="Executing migration" id="Add column with_credentials" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.975299155Z level=info msg="Executing migration" id="Add secure json data column" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.976158119Z level=info msg="Executing migration" id="Update data_source table charset" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.97704209Z level=info msg="Executing migration" id="Update initial version to 1" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.977831453Z level=info msg="Executing migration" id="Add read_only data column" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.978803049Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.979530588Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.980444895Z level=info msg="Executing migration" id="Add uid column" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.981227007Z level=info msg="Executing migration" id="Update uid value" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.982044248Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.982950858Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.983837039Z level=info msg="Executing migration" id="create api_key table" 2024-01-13T17:59:34.076 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.98464411Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-01-13T17:59:34.077 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.985522102Z level=info msg="Executing migration" id="add index api_key.key" 2024-01-13T17:59:34.077 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.986277604Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-01-13T17:59:34.077 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.987026388Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-01-13T17:59:34.077 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.987897803Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.988607403Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.991557897Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.992744275Z level=info msg="Executing migration" id="create api_key table v2" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.99551581Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:33.998087125Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.000867907Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.001292247Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.004069029Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.004486236Z level=info msg="Executing migration" id="Update api_key table charset" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.006701377Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.00968166Z level=info msg="Executing migration" id="Add service account foreign key" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.010264654Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.01298445Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.013617209Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-01-13T17:59:34.078 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.015932639Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.018719987Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.019100565Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.021799671Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.02228025Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.024623244Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.027308337Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.027824618Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.030553418Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.033417811Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.03616507Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.036505475Z level=info msg="Executing migration" id="create quota table v1" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.039032468Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.041866302Z level=info msg="Executing migration" id="Update quota table charset" 2024-01-13T17:59:34.079 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.044624114Z level=info msg="Executing migration" id="create plugin_setting table" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.045032122Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.047906788Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.050510709Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.053121182Z level=info msg="Executing migration" id="create session table" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.053557009Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.056153981Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.05884303Z level=info msg="Executing migration" id="create playlist table v2" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.059688011Z level=info msg="Executing migration" id="create playlist item table v2" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.060247424Z level=info msg="Executing migration" id="Update playlist table charset" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.061108957Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.061680812Z level=info msg="Executing migration" id="drop preferences table v2" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.061992548Z level=info msg="Executing migration" id="drop preferences table v3" 2024-01-13T17:59:34.080 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.06292556Z level=info msg="Executing migration" id="create preferences table v3" 2024-01-13T17:59:34.081 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.063431014Z level=info msg="Executing migration" id="Update preferences table charset" 2024-01-13T17:59:34.081 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.063741177Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-01-13T17:59:34.081 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.064344738Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-01-13T17:59:34.081 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.064657196Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-01-13T17:59:34.081 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.065252109Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-01-13T17:59:34.081 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.065882892Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-01-13T17:59:34.081 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.066200289Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-01-13T17:59:34.081 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.066647745Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-01-13T17:59:34.166 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2024-01-13T17:59:34.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-13T17:59:34.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.067151043Z level=info msg="Executing migration" id="create alert table v1" 2024-01-13T17:59:34.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.06975105Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-01-13T17:59:34.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.070338522Z level=info msg="Executing migration" id="add index alert state" 2024-01-13T17:59:34.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.07294331Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-01-13T17:59:34.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.073479373Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-01-13T17:59:34.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.073961895Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-01-13T17:59:34.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.074492962Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-01-13T17:59:34.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.075021293Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-01-13T17:59:34.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.077654865Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.078040473Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.078440916Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.078767557Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.079120061Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.079476226Z level=info msg="Executing migration" id="Add column is_default" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.080123059Z level=info msg="Executing migration" id="Add column frequency" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.080776906Z level=info msg="Executing migration" id="Add column send_reminder" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.081436514Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.082122786Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.082566686Z level=info msg="Executing migration" id="Update alert table charset" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.082858289Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.083122388Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.083511517Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-01-13T17:59:34.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.083938169Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.084314879Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.087059721Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.087524947Z level=info msg="Executing migration" id="Add for to alert table" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.089707351Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.092676064Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.093325101Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.093769954Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.094560042Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.095359246Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.096127689Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.09661863Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.097077167Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.097966327Z level=info msg="Executing migration" id="create annotation table v5" 2024-01-13T17:59:34.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.098676541Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.099144913Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.100004223Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.100470117Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.101482263Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.10208098Z level=info msg="Executing migration" id="Update annotation table charset" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.10295514Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.103655724Z level=info msg="Executing migration" id="Drop category_id index" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.104078862Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.104941723Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.105924869Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.106650423Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-01-13T17:59:34.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.10709831Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.108679438Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.109518186Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.110366759Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.110708537Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.111625341Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.112581837Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.113515423Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.114259439Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.115083908Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.115574674Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.115962946Z level=info msg="Executing migration" id="Add epoch_end column" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.116795486Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.117253909Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-01-13T17:59:34.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.117556343Z level=info msg="Executing migration" id="Move region to single row" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.117947634Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.120307384Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.120775729Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.123140082Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.125862318Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.126292346Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.129252121Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.129645164Z level=info msg="Executing migration" id="create test_data table" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.132037748Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.132501782Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.132973941Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-01-13T17:59:34.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.135773769Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-01-13T17:59:34.323 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.138716521Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-01-13T17:59:34.323 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.141661586Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.141973923Z level=info msg="Executing migration" id="create team table" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.144889712Z level=info msg="Executing migration" id="add index team.org_id" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.147788392Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.150489888Z level=info msg="Executing migration" id="create team member table" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.150916649Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.153713909Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.156058918Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.158819554Z level=info msg="Executing migration" id="Add column email to team table" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.159699794Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.162352992Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.165086338Z level=info msg="Executing migration" id="create dashboard acl table" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.167858742Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.168368955Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-01-13T17:59:34.324 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.171001345Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.171496247Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.174139337Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.174610432Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.175044839Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.17547968Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.175906691Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.176220404Z level=info msg="Executing migration" id="create tag table" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.176621827Z level=info msg="Executing migration" id="add index tag.key_value" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.177065169Z level=info msg="Executing migration" id="create login attempt table" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.177462252Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.177912442Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.178333153Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.180197297Z level=info msg="Executing migration" id="create login_attempt v2" 2024-01-13T17:59:34.325 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.180612557Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.181059858Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.181361462Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.181762184Z level=info msg="Executing migration" id="create user auth table" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.182175438Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.182623603Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.182940939Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.183656465Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.184429543Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.185222873Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.186024245Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.186467005Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.187254878Z level=info msg="Executing migration" id="create server_lock table" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.187677984Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.188176066Z level=info msg="Executing migration" id="create user auth token table" 2024-01-13T17:59:34.326 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.188653593Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.191429033Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.192079282Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.192537511Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.19334174Z level=info msg="Executing migration" id="create cache_data table" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.193794501Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.194291011Z level=info msg="Executing migration" id="create short_url table v1" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.194727024Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.197550219Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.197966683Z level=info msg="Executing migration" id="delete alert_definition table" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.198261221Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.198731184Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.201565859Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.20430947Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.206772507Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-01-13T17:59:34.327 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.207239926Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.21009968Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.210628144Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.211091975Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.211915892Z level=info msg="Executing migration" id="drop alert_definition table" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.212739524Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.213601465Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.214449439Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.215126561Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.216020612Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.216524415Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.217026424Z level=info msg="Executing migration" id="create alert_instance table" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.217752139Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.218248718Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-01-13T17:59:34.328 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.218716113Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.219581878Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.220516646Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.221206903Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.224625479Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.228109309Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.228775749Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.229601266Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.230434848Z level=info msg="Executing migration" id="create alert_rule table" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.231336855Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.232309235Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.232970527Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.233932926Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.236705219Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-01-13T17:59:34.329 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.239474324Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.242253458Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.245044693Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.247713804Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.250715076Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.253462328Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.256142706Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.258837609Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.261659996Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.264524709Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.267266408Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.269729612Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.272511111Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.275391078Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.278016351Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-01-13T17:59:34.330 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.28053057Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.283361877Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.286026472Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.288709113Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.291380275Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.293797245Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.29670723Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.299511354Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.302297906Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.304754898Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.307483105Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.310373582Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.312814967Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-01-13T17:59:34.331 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.315694079Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-01-13T17:59:34.332 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.31815808Z level=info msg="Executing migration" id="create provenance_type table" 2024-01-13T17:59:34.384 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[37908]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:34.384 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2597674066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-13T17:59:34.384 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.384 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.384 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.384 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.384 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/227307757' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-13T17:59:34.384 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/3766309559' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-01-13T17:59:34.385 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[52328]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:34.385 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2597674066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-13T17:59:34.385 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.385 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.385 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.385 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.386 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/227307757' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-13T17:59:34.386 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:34 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/3766309559' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-01-13T17:59:34.386 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:34 smithi084 systemd[1]: Starting Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:59:34.596 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:17:59:34] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T17:59:34.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-mon[71325]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:34.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2597674066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-13T17:59:34.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:34.597 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/227307757' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-13T17:59:34.597 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/3766309559' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.320836786Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.32371339Z level=info msg="Executing migration" id="create alert_image table" 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.326401458Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.328824588Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.330067215Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.330521457Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.331339656Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.331439276Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.332169175Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.333084949Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.333807259Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-01-13T17:59:34.598 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.333950136Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.334092968Z level=info msg="alerts found to migrate" alerts=0 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.33461922Z level=info msg="Executing migration" id="create library_element table v1" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.335421058Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.336194745Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.33698034Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.337976038Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.338685836Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.339500289Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.340421578Z level=info msg="Executing migration" id="create data_keys table" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.341094729Z level=info msg="Executing migration" id="create secrets table" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.341884048Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.346193798Z level=info msg="Executing migration" id="add name column into data_keys" 2024-01-13T17:59:34.599 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.347178663Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-01-13T17:59:34.600 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.348213354Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-01-13T17:59:34.600 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.352484756Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-01-13T17:59:34.600 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.356707056Z level=info msg="Executing migration" id="create kv_store table v1" 2024-01-13T17:59:34.600 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.357518903Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-01-13T17:59:34.600 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.358358931Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-01-13T17:59:34.600 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.359248297Z level=info msg="Executing migration" id="create permission table" 2024-01-13T17:59:34.600 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.36003727Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-01-13T17:59:34.600 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.360828927Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.361849632Z level=info msg="Executing migration" id="create role table" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.362579487Z level=info msg="Executing migration" id="add column display_name" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.363543216Z level=info msg="Executing migration" id="add column group_name" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.364476467Z level=info msg="Executing migration" id="add index role.org_id" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.365502873Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.366275665Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.366945722Z level=info msg="Executing migration" id="create team role table" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.367728705Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.368544388Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.371381576Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.374043749Z level=info msg="Executing migration" id="create user role table" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.376617862Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-01-13T17:59:34.601 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.379349979Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.382239802Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.384978638Z level=info msg="Executing migration" id="create builtin role table" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.387774534Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.390448202Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.393078045Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.39586383Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.398414423Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.401088049Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.40394645Z level=info msg="Executing migration" id="add unique index role.uid" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.406761992Z level=info msg="Executing migration" id="create seed assignment table" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.409611598Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.412231661Z level=info msg="Executing migration" id="add column hidden to role table" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.414931789Z level=info msg="Executing migration" id="create query_history table v1" 2024-01-13T17:59:34.602 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.417710169Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.420490431Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.423041771Z level=info msg="Executing migration" id="teams permissions migration" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.425806462Z level=info msg="Executing migration" id="dashboard permissions" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.428437524Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.43119759Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.433831236Z level=info msg="Executing migration" id="alerting notification permissions" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.436563461Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.436995368Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.437436088Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.43846891Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.438800745Z level=info msg="Executing migration" id="create correlation table v1" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.439249604Z level=info msg="Executing migration" id="add index correlations.uid" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.439685169Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.440129495Z level=info msg="Executing migration" id="add correlation config column" 2024-01-13T17:59:34.603 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.441215666Z level=info msg="Executing migration" id="create entity_events table" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.441711785Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.442479894Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.442575872Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.442858128Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.442935587Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.443206218Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.444185852Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.444764993Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.445207785Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.44610709Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.446932413Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.447767691Z level=info msg="Executing migration" id="Drop public config table" 2024-01-13T17:59:34.604 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.448667051Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.449462585Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.450462818Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.451341079Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.452082282Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.45518602Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.456225464Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.457249905Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.458174367Z level=info msg="Executing migration" id="add share column" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.45925392Z level=info msg="Executing migration" id="create default alerting folders" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.460145958Z level=info msg="Executing migration" id="create file table" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.461015369Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.46190029Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.462700403Z level=info msg="Executing migration" id="create file_meta table" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.463108557Z level=info msg="Executing migration" id="file table idx: path key" 2024-01-13T17:59:34.605 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.46397313Z level=info msg="Executing migration" id="set path collation in file table" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.46485179Z level=info msg="Executing migration" id="managed permissions migration" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.465707777Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.468572775Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.471435945Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.474130288Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.476919724Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.479657815Z level=info msg="Executing migration" id="update group index for alert rules" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.482433831Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.485647114Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.488396004Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.491190212Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.494091712Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.496909594Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-01-13T17:59:34.606 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.506642208Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.509739354Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.512471051Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.515971996Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.519065613Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.524650257Z level=info msg="Executing migration" id="create folder table" 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.527497528Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.530014109Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.532556921Z level=info msg="Executing migration" id="Update folder title length" 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.535085292Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=migrator t=2024-01-13T17:59:34.537728669Z level=info msg="migrations completed" performed=485 skipped=0 duration=721.980699ms 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=sqlstore t=2024-01-13T17:59:34.538158792Z level=info msg="Created default organization" 2024-01-13T17:59:34.607 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=plugin.loader t=2024-01-13T17:59:34.595157247Z level=info msg="Plugin registered" pluginID=input 2024-01-13T17:59:34.622 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:34.623 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3944391177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3944391177},{"type":"v1","addr":"172.21.15.84:6835","nonce":3944391177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-13T17:58:37.204248+0000","modified":"2024-01-13T17:58:40.826281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/2558131725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2558131725},{"type":"v1","addr":"172.21.15.99:6833","nonce":2558131725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-13T17:59:34.625 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-01-13T17:59:34.635 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:34 smithi084 bash[97045]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-01-13T17:59:34.636 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-13T17:59:34.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=plugin.loader t=2024-01-13T17:59:34.623907984Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-01-13T17:59:34.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=plugin.loader t=2024-01-13T17:59:34.623948801Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-01-13T17:59:34.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=secrets t=2024-01-13T17:59:34.624016748Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-01-13T17:59:34.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=query_data t=2024-01-13T17:59:34.62639326Z level=info msg="Query Service initialization" 2024-01-13T17:59:34.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=live.push_http t=2024-01-13T17:59:34.628969924Z level=info msg="Live Push Gateway initialization" 2024-01-13T17:59:34.924 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:34 smithi084 bash[97045]: Getting image source signatures 2024-01-13T17:59:34.956 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:34.956 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:59:06.172263+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-13T17:58:35.312354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-13T17:58:36.379223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"rbd","create_time":"2024-01-13T17:59:04.296556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:6800/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/1455901095":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3916505137":"2024-01-14T17:59:05.164416+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/1946108910":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3513905448":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:59:34.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-13T17:56:59.053508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-13T17:58:35.312354+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-13T17:58:36.379223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'rbd', 'create_time': '2024-01-13T17:59:04.296556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-13T17:59:34.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-13T17:59:35.178 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:34 smithi084 bash[97045]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-01-13T17:59:35.178 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:34 smithi084 bash[97045]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-01-13T17:59:35.178 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:34 smithi084 bash[97045]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-01-13T17:59:35.318 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-01-13T17:59:35.335 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-13T17:59:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-mon[71325]: Deploying daemon node-exporter.a on smithi084 2024-01-13T17:59:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1700818801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:59:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/840796074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/270311168' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:59:35.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=infra.usagestats.collector t=2024-01-13T17:59:35.33704997Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-01-13T17:59:35.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=provisioning.datasources t=2024-01-13T17:59:35.337353559Z level=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-01-13T17:59:35.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=provisioning.datasources t=2024-01-13T17:59:35.369058255Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-01-13T17:59:35.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=provisioning.datasources t=2024-01-13T17:59:35.400808816Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-01-13T17:59:35.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=provisioning.alerting t=2024-01-13T17:59:35.422149421Z level=info msg="starting to provision alerting" 2024-01-13T17:59:35.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=provisioning.alerting t=2024-01-13T17:59:35.422168612Z level=info msg="finished to provision alerting" 2024-01-13T17:59:35.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=ngalert.state.manager t=2024-01-13T17:59:35.422242375Z level=info msg="Warming state cache for startup" 2024-01-13T17:59:35.622 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=grafanaStorageLogger t=2024-01-13T17:59:35.422271785Z level=info msg="storage starting" 2024-01-13T17:59:35.622 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=http.server t=2024-01-13T17:59:35.424197501Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-01-13T17:59:35.622 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=ngalert.state.manager t=2024-01-13T17:59:35.432461195Z level=info msg="State cache has been initialized" states=0 duration=10.218221ms 2024-01-13T17:59:35.622 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=ngalert.multiorg.alertmanager t=2024-01-13T17:59:35.432498396Z level=info msg="starting MultiOrg Alertmanager" 2024-01-13T17:59:35.622 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=ticker t=2024-01-13T17:59:35.432510465Z level=info msg=starting first_tick=2024-01-13T17:59:40Z 2024-01-13T17:59:35.622 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=sqlstore.transactions t=2024-01-13T17:59:35.433629817Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-01-13T17:59:35.622 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=sqlstore.transactions t=2024-01-13T17:59:35.47841548Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-01-13T17:59:35.622 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 17:59:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[108645]: logger=sqlstore.transactions t=2024-01-13T17:59:35.488884767Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-01-13T17:59:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[37908]: Deploying daemon node-exporter.a on smithi084 2024-01-13T17:59:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1700818801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:59:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/840796074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/270311168' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:59:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[52328]: Deploying daemon node-exporter.a on smithi084 2024-01-13T17:59:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1700818801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:59:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/840796074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:35.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:35 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/270311168' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-13T17:59:35.682 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-01-13T17:59:35.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-13T17:59:36.015 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-01-13T17:59:36.028 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:35 smithi084 bash[97045]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-01-13T17:59:36.028 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:35 smithi084 bash[97045]: Writing manifest to image destination 2024-01-13T17:59:36.032 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-13T17:59:36.363 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2024-01-13T17:59:36.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-13T17:59:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:36 smithi099 ceph-mon[71325]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:36 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/333993177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-13T17:59:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:36 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/284409060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-13T17:59:36.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-mon[52328]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/333993177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-13T17:59:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/284409060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-13T17:59:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-mon[37908]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/333993177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-13T17:59:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/284409060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-13T17:59:36.680 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.332Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-01-13T17:59:36.680 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.332Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-01-13T17:59:36.680 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.333Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-01-13T17:59:36.680 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.333Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-01-13T17:59:36.680 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.333Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-01-13T17:59:36.680 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.333Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-01-13T17:59:36.680 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-01-13T17:59:36.680 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=arp 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=bcache 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=bonding 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=btrfs 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=conntrack 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=cpu 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=diskstats 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=dmi 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=edac 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=entropy 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-01-13T17:59:36.681 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=filefd 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=filesystem 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=hwmon 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=infiniband 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=ipvs 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=loadavg 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=mdadm 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=meminfo 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=netclass 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=netdev 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=netstat 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=nfs 2024-01-13T17:59:36.682 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=nfsd 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=nvme 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=os 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=pressure 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=rapl 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=schedstat 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=selinux 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=sockstat 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=softnet 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=stat 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=tapestats 2024-01-13T17:59:36.683 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=textfile 2024-01-13T17:59:36.684 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-01-13T17:59:36.684 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=time 2024-01-13T17:59:36.684 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-01-13T17:59:36.684 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=uname 2024-01-13T17:59:36.684 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=vmstat 2024-01-13T17:59:36.684 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=xfs 2024-01-13T17:59:36.684 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=node_exporter.go:117 level=info collector=zfs 2024-01-13T17:59:36.684 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-01-13T17:59:36.684 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[97334]: ts=2024-01-13T17:59:36.334Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-01-13T17:59:36.684 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 bash[97045]: eaf6d03cde968a57c2e36cf4d917eb35190c19bb956c5fc3aadb738a076fd5f7 2024-01-13T17:59:36.684 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 17:59:36 smithi084 systemd[1]: Started Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:59:36.735 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3944391177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3944391177},{"type":"v1","addr":"172.21.15.84:6835","nonce":3944391177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-13T17:58:37.204248+0000","modified":"2024-01-13T17:58:40.826281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/2558131725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2558131725},{"type":"v1","addr":"172.21.15.99:6833","nonce":2558131725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-13T17:59:36.738 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-01-13T17:59:36.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-13T17:59:37.059 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:37.060 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T17:59:06.172263+0000","last_up_change":"2024-01-13T17:58:23.177434+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-13T17:58:35.312354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-13T17:58:36.379223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"rbd","create_time":"2024-01-13T17:59:04.296556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6803","nonce":210095030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6805","nonce":210095030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6809","nonce":210095030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":210095030},{"type":"v1","addr":"172.21.15.84:6807","nonce":210095030}]},"public_addr":"172.21.15.84:6803/210095030","cluster_addr":"172.21.15.84:6805/210095030","heartbeat_back_addr":"172.21.15.84:6809/210095030","heartbeat_front_addr":"172.21.15.84:6807/210095030","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6811","nonce":2364729003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6813","nonce":2364729003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6817","nonce":2364729003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2364729003},{"type":"v1","addr":"172.21.15.84:6815","nonce":2364729003}]},"public_addr":"172.21.15.84:6811/2364729003","cluster_addr":"172.21.15.84:6813/2364729003","heartbeat_back_addr":"172.21.15.84:6817/2364729003","heartbeat_front_addr":"172.21.15.84:6815/2364729003","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6819","nonce":4150510739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6821","nonce":4150510739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6825","nonce":4150510739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4150510739},{"type":"v1","addr":"172.21.15.84:6823","nonce":4150510739}]},"public_addr":"172.21.15.84:6819/4150510739","cluster_addr":"172.21.15.84:6821/4150510739","heartbeat_back_addr":"172.21.15.84:6825/4150510739","heartbeat_front_addr":"172.21.15.84:6823/4150510739","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6827","nonce":882719377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6829","nonce":882719377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6833","nonce":882719377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":882719377},{"type":"v1","addr":"172.21.15.84:6831","nonce":882719377}]},"public_addr":"172.21.15.84:6827/882719377","cluster_addr":"172.21.15.84:6829/882719377","heartbeat_back_addr":"172.21.15.84:6833/882719377","heartbeat_front_addr":"172.21.15.84:6831/882719377","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6801","nonce":343632506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6803","nonce":343632506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6807","nonce":343632506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":343632506},{"type":"v1","addr":"172.21.15.99:6805","nonce":343632506}]},"public_addr":"172.21.15.99:6801/343632506","cluster_addr":"172.21.15.99:6803/343632506","heartbeat_back_addr":"172.21.15.99:6807/343632506","heartbeat_front_addr":"172.21.15.99:6805/343632506","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6809","nonce":1484816369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6811","nonce":1484816369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6815","nonce":1484816369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1484816369},{"type":"v1","addr":"172.21.15.99:6813","nonce":1484816369}]},"public_addr":"172.21.15.99:6809/1484816369","cluster_addr":"172.21.15.99:6811/1484816369","heartbeat_back_addr":"172.21.15.99:6815/1484816369","heartbeat_front_addr":"172.21.15.99:6813/1484816369","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6817","nonce":65848361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6819","nonce":65848361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6823","nonce":65848361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":65848361},{"type":"v1","addr":"172.21.15.99:6821","nonce":65848361}]},"public_addr":"172.21.15.99:6817/65848361","cluster_addr":"172.21.15.99:6819/65848361","heartbeat_back_addr":"172.21.15.99:6823/65848361","heartbeat_front_addr":"172.21.15.99:6821/65848361","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6825","nonce":4156945024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6827","nonce":4156945024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6831","nonce":4156945024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4156945024},{"type":"v1","addr":"172.21.15.99:6829","nonce":4156945024}]},"public_addr":"172.21.15.99:6825/4156945024","cluster_addr":"172.21.15.99:6827/4156945024","heartbeat_back_addr":"172.21.15.99:6831/4156945024","heartbeat_front_addr":"172.21.15.99:6829/4156945024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:6800/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/1455901095":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3916505137":"2024-01-14T17:59:05.164416+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/1946108910":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/3513905448":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T17:59:37.076 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-13T17:59:37.119 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:37 smithi099 systemd[1]: Starting Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:59:37.427 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T17:59:37.427 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14463,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3944391177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3944391177},{"type":"v1","addr":"172.21.15.84:6835","nonce":3944391177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-13T17:58:37.204248+0000","modified":"2024-01-13T17:58:40.826281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/2558131725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2558131725},{"type":"v1","addr":"172.21.15.99:6833","nonce":2558131725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-13T17:59:37.429 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-01-13T17:59:37.441 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-13T17:58:37.204248+0000', 'modified': '2024-01-13T17:58:40.826281+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24337}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24337': {'gid': 24337, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6833/2558131725', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6832', 'nonce': 2558131725}, {'type': 'v1', 'addr': '172.21.15.99:6833', 'nonce': 2558131725}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-13T17:59:37.441 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-13T17:59:37.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-13T17:59:37.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:37 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1146033113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-01-13T17:59:37.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:37 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:37.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:37 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:37.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:37 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:37.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:37 smithi099 ceph-mon[71325]: Deploying daemon node-exporter.b on smithi099 2024-01-13T17:59:37.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:37 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/4039869182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:59:37.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:37 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1102099606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:37.566 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:37 smithi099 bash[108918]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-01-13T17:59:37.567 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:37 smithi099 bash[108918]: Getting image source signatures 2024-01-13T17:59:37.567 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:37 smithi099 bash[108918]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-01-13T17:59:37.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-01-13T17:59:37.566+0000 7f3b86ff5700 0 client.24791 ms_handle_reset on v2:172.21.15.99:6832/2558131725 2024-01-13T17:59:37.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-01-13T17:59:37.586+0000 7f3b86ff5700 0 client.24797 ms_handle_reset on v2:172.21.15.99:6832/2558131725 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "be08b996-b23c-11ee-95ac-87774f69a715", 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24337, 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 59.767747231000001, 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 8, 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 63, 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 60, 2024-01-13T17:59:37.589 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 64.427054392000002 2024-01-13T17:59:37.590 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T17:59:37.600 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1146033113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-01-13T17:59:37.600 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:37.600 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:37.600 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:37.600 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[52328]: Deploying daemon node-exporter.b on smithi099 2024-01-13T17:59:37.600 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/4039869182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:59:37.600 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1102099606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:37.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1146033113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-01-13T17:59:37.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:37.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:37.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:37.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[37908]: Deploying daemon node-exporter.b on smithi099 2024-01-13T17:59:37.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/4039869182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:59:37.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:37 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1102099606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T17:59:37.602 INFO:tasks.cephadm:Setup complete, yielding 2024-01-13T17:59:37.602 INFO:teuthology.run_tasks:Running task print... 2024-01-13T17:59:37.611 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-01-13T17:59:37.611 INFO:teuthology.run_tasks:Running task print... 2024-01-13T17:59:37.658 INFO:teuthology.task.print:**** done start cephadm.shell ceph config set mgr... 2024-01-13T17:59:37.658 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-01-13T17:59:37.706 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-01-13T17:59:37.706 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-01-13T17:59:37.869 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:37 smithi099 bash[108918]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-01-13T17:59:37.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:37 smithi099 bash[108918]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-01-13T17:59:37.968 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T17:59:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:38 smithi099 ceph-mon[71325]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:38 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2453236044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:59:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:38 smithi084 ceph-mon[37908]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:38 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2453236044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:59:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:38 smithi084 ceph-mon[52328]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:38 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2453236044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T17:59:39.119 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:38 smithi099 bash[108918]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-01-13T17:59:39.119 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:38 smithi099 bash[108918]: Writing manifest to image destination 2024-01-13T17:59:39.407 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:39 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:39] ENGINE Bus STOPPING 2024-01-13T17:59:39.407 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:39 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:39] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T17:59:39.407 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:39 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:39] ENGINE Bus STOPPED 2024-01-13T17:59:39.408 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:39 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:39] ENGINE Bus STARTING 2024-01-13T17:59:39.408 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:39 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:39] ENGINE Serving on http://:::9283 2024-01-13T17:59:39.408 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:39 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:39] ENGINE Bus STARTED 2024-01-13T17:59:39.458 INFO:teuthology.run_tasks:Running task print... 2024-01-13T17:59:39.468 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-01-13T17:59:39.468 INFO:teuthology.run_tasks:Running task print... 2024-01-13T17:59:39.523 INFO:teuthology.task.print:**** done start telemetry quincy... 2024-01-13T17:59:39.523 INFO:teuthology.run_tasks:Running task workunit... 2024-01-13T17:59:39.570 INFO:tasks.workunit:Pulling workunits from ref d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T17:59:39.570 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-13T17:59:39.570 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-13T17:59:39.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T17:59:39.588 INFO:teuthology.orchestra.run.smithi084.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-01-13T17:59:39.588 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-01-13T17:59:39.647 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-01-13T17:59:39.647 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-01-13T17:59:39.704 INFO:tasks.workunit:timeout=3h 2024-01-13T17:59:39.704 INFO:tasks.workunit:cleanup=True 2024-01-13T17:59:39.705 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T17:59:39.763 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-13T17:59:39.869 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.393Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-01-13T17:59:39.869 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.393Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-01-13T17:59:39.869 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.394Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-01-13T17:59:39.869 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.394Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=arp 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=bcache 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=bonding 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=btrfs 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=conntrack 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=cpu 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=diskstats 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=dmi 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=edac 2024-01-13T17:59:39.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=entropy 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=filefd 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=filesystem 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=hwmon 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=infiniband 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=ipvs 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=loadavg 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=mdadm 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=meminfo 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=netclass 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=netdev 2024-01-13T17:59:39.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=netstat 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=nfs 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=nfsd 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=nvme 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=os 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=pressure 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=rapl 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=schedstat 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=selinux 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=sockstat 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=softnet 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=stat 2024-01-13T17:59:39.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=tapestats 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=textfile 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=time 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=uname 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=vmstat 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=xfs 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=node_exporter.go:117 level=info collector=zfs 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[108967]: ts=2024-01-13T17:59:39.395Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 bash[108918]: 14e49e9d78522cb29add61781b4953402615ff900858f2c7a3094ea2839b2ff6 2024-01-13T17:59:39.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 17:59:39 smithi099 systemd[1]: Started Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:59:40.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:40 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' 2024-01-13T17:59:40.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:40 smithi099 ceph-mon[71325]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:40.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:40.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' 2024-01-13T17:59:40.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[37908]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:40.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:40.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' 2024-01-13T17:59:40.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[52328]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:40.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:40.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:41.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:41 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:41 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:41 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[37908]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[52328]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:42 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:42 smithi099 ceph-mon[71325]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:42 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:42 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:42 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:42 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:42 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:42 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:42 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:43.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:43 smithi084 ceph-mon[37908]: Reconfiguring alertmanager.a (dependencies changed)... 2024-01-13T17:59:43.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:43 smithi084 ceph-mon[37908]: Reconfiguring daemon alertmanager.a on smithi084 2024-01-13T17:59:43.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:43 smithi084 ceph-mon[52328]: Reconfiguring alertmanager.a (dependencies changed)... 2024-01-13T17:59:43.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:43 smithi084 ceph-mon[52328]: Reconfiguring daemon alertmanager.a on smithi084 2024-01-13T17:59:43.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:43 smithi084 systemd[1]: Stopping Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:59:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:43 smithi099 ceph-mon[71325]: Reconfiguring alertmanager.a (dependencies changed)... 2024-01-13T17:59:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:43 smithi099 ceph-mon[71325]: Reconfiguring daemon alertmanager.a on smithi084 2024-01-13T17:59:44.145 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[94279]: ts=2024-01-13T17:59:43.739Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-01-13T17:59:44.145 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:43 smithi084 bash[98727]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a 2024-01-13T17:59:44.411 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@alertmanager.a.service: Succeeded. 2024-01-13T17:59:44.411 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 systemd[1]: Stopped Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:59:44.411 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 systemd[1]: Starting Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:59:44.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:17:59:44] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T17:59:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:44 smithi099 ceph-mon[71325]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:44.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:44 smithi084 ceph-mon[37908]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:44.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:44 smithi084 ceph-mon[52328]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:44.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T17:59:44.530Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-01-13T17:59:44.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T17:59:44.530Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-01-13T17:59:44.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T17:59:44.531Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.84 port=9094 2024-01-13T17:59:44.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T17:59:44.532Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-01-13T17:59:44.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 bash[98843]: f4a66f0ea4eda6e13c9758a06cc91492a6d03668a234eee1505e5ec1ecba4e9c 2024-01-13T17:59:44.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 systemd[1]: Started Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:59:44.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T17:59:44.559Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-01-13T17:59:44.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T17:59:44.560Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-01-13T17:59:44.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T17:59:44.562Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-01-13T17:59:44.680 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T17:59:44.562Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-01-13T17:59:45.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:45 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:45.843 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:45 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:45.843 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:45 smithi099 ceph-mon[71325]: Reconfiguring prometheus.a (dependencies changed)... 2024-01-13T17:59:45.843 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:45 smithi099 ceph-mon[71325]: Reconfiguring daemon prometheus.a on smithi099 2024-01-13T17:59:45.843 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:45 smithi099 ceph-mon[71325]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:45.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:45 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:45.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:45 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:45.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:45 smithi084 ceph-mon[52328]: Reconfiguring prometheus.a (dependencies changed)... 2024-01-13T17:59:45.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:45 smithi084 ceph-mon[52328]: Reconfiguring daemon prometheus.a on smithi099 2024-01-13T17:59:45.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:45 smithi084 ceph-mon[52328]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:45 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:45 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:45 smithi084 ceph-mon[37908]: Reconfiguring prometheus.a (dependencies changed)... 2024-01-13T17:59:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:45 smithi084 ceph-mon[37908]: Reconfiguring daemon prometheus.a on smithi099 2024-01-13T17:59:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:45 smithi084 ceph-mon[37908]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:46.799 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 systemd[1]: Stopping Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.676Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.676Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.676Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.676Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.676Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.676Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.676Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.676Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.676Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.677Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.677Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-01-13T17:59:46.800 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[106212]: ts=2024-01-13T17:59:46.677Z caller=main.go:1147 level=info msg="See you next time!" 2024-01-13T17:59:46.928 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T17:59:46.533Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000854296s 2024-01-13T17:59:47.114 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:46 smithi099 bash[109889]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a 2024-01-13T17:59:47.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@prometheus.a.service: Succeeded. 2024-01-13T17:59:47.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 systemd[1]: Stopped Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:59:47.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 systemd[1]: Starting Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T17:59:47.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.520Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-01-13T17:59:47.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.521Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-01-13T17:59:47.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.521Z caller=main.go:570 level=info host_details="(Linux 4.18.0-532.el8.x86_64 #1 SMP Thu Dec 21 12:11:59 UTC 2023 x86_64 smithi099 (none))" 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.521Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.521Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.522Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.523Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.523Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.523Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.525Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.525Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.968µs 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.525Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.525Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.526Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-01-13T17:59:47.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.526Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=28.369µs wal_replay_duration=1.667158ms wbl_replay_duration=119ns total_replay_duration=1.723586ms 2024-01-13T17:59:47.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.527Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-01-13T17:59:47.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.527Z caller=main.go:1029 level=info msg="TSDB started" 2024-01-13T17:59:47.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.527Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-01-13T17:59:47.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 bash[110007]: 79a2b67e3dcdf132dd05a616af48212bda6ef185c80d765ec276ef6493bb5f84 2024-01-13T17:59:47.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 systemd[1]: Started Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T17:59:47.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.543Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=15.451062ms db_storage=705ns remote_storage=1.054µs web_handler=364ns query_engine=533ns scrape=436.948µs scrape_sd=22.279µs notify=18.814µs notify_sd=5.345µs rules=14.752926ms tracing=5.954µs 2024-01-13T17:59:47.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.543Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-01-13T17:59:47.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 17:59:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T17:59:47.543Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-01-13T17:59:47.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STOPPING 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STOPPED 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STARTING 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Serving on http://:::9283 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STARTED 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STOPPING 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STOPPED 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STARTING 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Serving on http://:::9283 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STARTED 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STOPPING 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T17:59:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STOPPED 2024-01-13T17:59:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STARTING 2024-01-13T17:59:48.239 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Serving on http://:::9283 2024-01-13T17:59:48.239 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:17:59:47] ENGINE Bus STARTED 2024-01-13T17:59:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T17:59:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-01-13T17:59:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T17:59:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-01-13T17:59:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T17:59:48.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-01-13T17:59:48.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:48 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:48.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:48.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:48.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T17:59:48.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-01-13T17:59:48.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T17:59:48.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-01-13T17:59:48.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T17:59:48.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-01-13T17:59:48.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:48.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:48 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:49 smithi099 ceph-mon[71325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T17:59:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:49 smithi099 ceph-mon[71325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-01-13T17:59:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:49 smithi099 ceph-mon[71325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T17:59:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:49 smithi099 ceph-mon[71325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-01-13T17:59:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:49 smithi099 ceph-mon[71325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T17:59:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:49 smithi099 ceph-mon[71325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-01-13T17:59:49.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[37908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T17:59:49.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[37908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-01-13T17:59:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[37908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T17:59:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[37908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-01-13T17:59:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[37908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T17:59:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[37908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-01-13T17:59:49.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[52328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T17:59:49.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[52328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-01-13T17:59:49.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[52328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T17:59:49.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[52328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-01-13T17:59:49.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[52328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T17:59:49.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:49 smithi084 ceph-mon[52328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-01-13T17:59:50.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[37908]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:50.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:50.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:50.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:50.741 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:50.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[52328]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:50.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:50.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:50.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:50.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:50 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:50 smithi099 ceph-mon[71325]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:50 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:50 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:50 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:50 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:50 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:50 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:50 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:50 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T17:59:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:50 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T17:59:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:52 smithi099 ceph-mon[71325]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:52 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:52 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:52.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:52 smithi084 ceph-mon[37908]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:52.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:52 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:52.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:52 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:52.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:52 smithi084 ceph-mon[52328]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:52.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:52 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:52.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:52 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:53 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:53 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:53 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:53 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:53 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:53.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:53 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:53 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:53 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:53 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:53 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:53 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:53 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:53 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T17:59:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:53 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T17:59:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:53 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T17:59:54.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 17:59:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:17:59:54] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T17:59:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:54 smithi099 ceph-mon[71325]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:54.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:54 smithi084 ceph-mon[37908]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:54 smithi084 ceph-mon[52328]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:54.929 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 17:59:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T17:59:54.535Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002996738s 2024-01-13T17:59:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:56 smithi099 ceph-mon[71325]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:56.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:56 smithi084 ceph-mon[37908]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:56.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 17:59:56 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:17:59:56] "GET /metrics HTTP/1.1" 200 235711 "" "Prometheus/2.43.0" 2024-01-13T17:59:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:56 smithi084 ceph-mon[52328]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 17:59:58 smithi099 ceph-mon[71325]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:58.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 17:59:58 smithi084 ceph-mon[37908]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T17:59:58.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 17:59:58 smithi084 ceph-mon[52328]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:00 smithi099 ceph-mon[71325]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:00 smithi099 ceph-mon[71325]: overall HEALTH_OK 2024-01-13T18:00:00.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:00 smithi084 ceph-mon[37908]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:00.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:00 smithi084 ceph-mon[37908]: overall HEALTH_OK 2024-01-13T18:00:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:00 smithi084 ceph-mon[52328]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:00 smithi084 ceph-mon[52328]: overall HEALTH_OK 2024-01-13T18:00:02.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:02 smithi099 ceph-mon[71325]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:02.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:02 smithi084 ceph-mon[37908]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:02.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:02 smithi084 ceph-mon[52328]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:04.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:00:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:04] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T18:00:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:04 smithi099 ceph-mon[71325]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:04.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:04 smithi084 ceph-mon[37908]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:04.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:04 smithi084 ceph-mon[52328]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-01-13T18:00:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [0, 1]}]: dispatch 2024-01-13T18:00:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [7, 2]}]: dispatch 2024-01-13T18:00:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [0, 2, 4, 1]}]: dispatch 2024-01-13T18:00:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 1]}]: dispatch 2024-01-13T18:00:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 2]}]: dispatch 2024-01-13T18:00:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.35", "id": [5, 3]}]: dispatch 2024-01-13T18:00:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:05.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-01-13T18:00:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [0, 1]}]: dispatch 2024-01-13T18:00:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [7, 2]}]: dispatch 2024-01-13T18:00:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [0, 2, 4, 1]}]: dispatch 2024-01-13T18:00:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 1]}]: dispatch 2024-01-13T18:00:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 2]}]: dispatch 2024-01-13T18:00:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.35", "id": [5, 3]}]: dispatch 2024-01-13T18:00:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-01-13T18:00:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [0, 1]}]: dispatch 2024-01-13T18:00:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [7, 2]}]: dispatch 2024-01-13T18:00:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [0, 2, 4, 1]}]: dispatch 2024-01-13T18:00:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 1]}]: dispatch 2024-01-13T18:00:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 2]}]: dispatch 2024-01-13T18:00:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.35", "id": [5, 3]}]: dispatch 2024-01-13T18:00:05.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:06 smithi099 ceph-mon[71325]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:06 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-01-13T18:00:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:06 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [0, 1]}]': finished 2024-01-13T18:00:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:06 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [7, 2]}]': finished 2024-01-13T18:00:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:06 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [0, 2, 4, 1]}]': finished 2024-01-13T18:00:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:06 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 1]}]': finished 2024-01-13T18:00:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:06 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 2]}]': finished 2024-01-13T18:00:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:06 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.35", "id": [5, 3]}]': finished 2024-01-13T18:00:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:06 smithi099 ceph-mon[71325]: osdmap e64: 8 total, 8 up, 8 in 2024-01-13T18:00:06.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:06] "GET /metrics HTTP/1.1" 200 235720 "" "Prometheus/2.43.0" 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[37908]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [0, 1]}]': finished 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [7, 2]}]': finished 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [0, 2, 4, 1]}]': finished 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 1]}]': finished 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 2]}]': finished 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.35", "id": [5, 3]}]': finished 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[37908]: osdmap e64: 8 total, 8 up, 8 in 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[52328]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-01-13T18:00:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [0, 1]}]': finished 2024-01-13T18:00:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [7, 2]}]': finished 2024-01-13T18:00:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [0, 2, 4, 1]}]': finished 2024-01-13T18:00:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 1]}]': finished 2024-01-13T18:00:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 2]}]': finished 2024-01-13T18:00:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.35", "id": [5, 3]}]': finished 2024-01-13T18:00:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:06 smithi084 ceph-mon[52328]: osdmap e64: 8 total, 8 up, 8 in 2024-01-13T18:00:07.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:07 smithi099 ceph-mon[71325]: osdmap e65: 8 total, 8 up, 8 in 2024-01-13T18:00:07.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:07 smithi084 ceph-mon[37908]: osdmap e65: 8 total, 8 up, 8 in 2024-01-13T18:00:07.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:07 smithi084 ceph-mon[52328]: osdmap e65: 8 total, 8 up, 8 in 2024-01-13T18:00:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:08 smithi099 ceph-mon[71325]: pgmap v37: 105 pgs: 7 peering, 98 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:08 smithi099 ceph-mon[71325]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-01-13T18:00:08.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:08 smithi084 ceph-mon[37908]: pgmap v37: 105 pgs: 7 peering, 98 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:08.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:08 smithi084 ceph-mon[37908]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-01-13T18:00:08.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:08 smithi084 ceph-mon[52328]: pgmap v37: 105 pgs: 7 peering, 98 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:08.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:08 smithi084 ceph-mon[52328]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-01-13T18:00:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:10 smithi099 ceph-mon[71325]: pgmap v38: 105 pgs: 7 peering, 98 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:10.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:10 smithi084 ceph-mon[37908]: pgmap v38: 105 pgs: 7 peering, 98 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:10.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:10 smithi084 ceph-mon[52328]: pgmap v38: 105 pgs: 7 peering, 98 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:11 smithi099 ceph-mon[71325]: pgmap v39: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:11 smithi099 ceph-mon[71325]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-01-13T18:00:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:11 smithi099 ceph-mon[71325]: Cluster is now healthy 2024-01-13T18:00:11.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:11 smithi084 ceph-mon[37908]: pgmap v39: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:11.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:11 smithi084 ceph-mon[37908]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-01-13T18:00:11.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:11 smithi084 ceph-mon[37908]: Cluster is now healthy 2024-01-13T18:00:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:11 smithi084 ceph-mon[52328]: pgmap v39: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:11 smithi084 ceph-mon[52328]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-01-13T18:00:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:11 smithi084 ceph-mon[52328]: Cluster is now healthy 2024-01-13T18:00:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:14 smithi099 ceph-mon[71325]: pgmap v40: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:14.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:00:14 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:14] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T18:00:14.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:14 smithi084 ceph-mon[37908]: pgmap v40: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:14 smithi084 ceph-mon[52328]: pgmap v40: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:16.579 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:16 smithi084 ceph-mon[37908]: pgmap v41: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:16.579 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:16 smithi084 ceph-mon[52328]: pgmap v41: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:16 smithi099 ceph-mon[71325]: pgmap v41: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:16.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:16 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:16] "GET /metrics HTTP/1.1" 200 235720 "" "Prometheus/2.43.0" 2024-01-13T18:00:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:18 smithi099 ceph-mon[71325]: pgmap v42: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:18 smithi084 ceph-mon[37908]: pgmap v42: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:18 smithi084 ceph-mon[52328]: pgmap v42: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:20 smithi099 ceph-mon[71325]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:20 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:20.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:20 smithi084 ceph-mon[37908]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:20.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:20 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:20.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:20 smithi084 ceph-mon[52328]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:20 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:22 smithi099 ceph-mon[71325]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:22.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:22 smithi084 ceph-mon[37908]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:22.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:22 smithi084 ceph-mon[52328]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-01-13T18:00:24.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:00:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:24] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T18:00:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:24 smithi099 ceph-mon[71325]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:24.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:24 smithi084 ceph-mon[37908]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:24.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:24 smithi084 ceph-mon[52328]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:25.638 INFO:tasks.workunit.client.0.smithi084.stderr:Note: switching to 'd2f11f33b7063c2c1bc47b2b4e9350f48064868f'. 2024-01-13T18:00:25.638 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr:changes and commit them, and you can discard any commits you make in this 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr:state without impacting any branches by switching back to a branch. 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr:If you want to create a new branch to retain commits you create, you may 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr:do so (now or later) by using -c with the switch command. Example: 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr: git switch -c 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr:Or undo this operation with: 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr: git switch - 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-01-13T18:00:25.639 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:25.640 INFO:tasks.workunit.client.0.smithi084.stderr:HEAD is now at d2f11f33b70 Merge branch 'wip-64005-reef' of https://github.com/rzarzynski/ceph into wip-yuri11-testing-2024-01-12-1402-reef 2024-01-13T18:00:25.643 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-13T18:00:25.708 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-13T18:00:25.710 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-13T18:00:25.711 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-13T18:00:26.243 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-13T18:00:26.308 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-13T18:00:26.346 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-13T18:00:26.347 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-13T18:00:26.347 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-13T18:00:26.383 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-13T18:00:26.386 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T18:00:26.386 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-13T18:00:26.445 INFO:tasks.workunit:Running workunits matching test_telemetry_quincy.sh on client.0... 2024-01-13T18:00:26.446 INFO:tasks.workunit:Running workunit test_telemetry_quincy.sh... 2024-01-13T18:00:26.446 DEBUG:teuthology.orchestra.run.smithi084:workunit test test_telemetry_quincy.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2f11f33b7063c2c1bc47b2b4e9350f48064868f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/test_telemetry_quincy.sh 2024-01-13T18:00:26.507 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph config set mgr mgr/telemetry/channel_ident true 2024-01-13T18:00:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:26 smithi099 ceph-mon[71325]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:26.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:26 smithi084 ceph-mon[37908]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:26.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:26 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:26] "GET /metrics HTTP/1.1" 200 235792 "" "Prometheus/2.43.0" 2024-01-13T18:00:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:26 smithi084 ceph-mon[52328]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:26.942 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph config set mgr mgr/telemetry/organization ceph-qa 2024-01-13T18:00:27.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:26 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:26] ENGINE Bus STOPPING 2024-01-13T18:00:27.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:26 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:26] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:00:27.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:26 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:26] ENGINE Bus STOPPED 2024-01-13T18:00:27.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:26 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:26] ENGINE Bus STARTING 2024-01-13T18:00:27.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:26 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:26] ENGINE Serving on http://:::9283 2024-01-13T18:00:27.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:26 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:26] ENGINE Bus STARTED 2024-01-13T18:00:27.398 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph config set mgr mgr/telemetry/description 'upgrade test cluster' 2024-01-13T18:00:27.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE Bus STOPPING 2024-01-13T18:00:27.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:00:27.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE Bus STOPPED 2024-01-13T18:00:27.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE Bus STARTING 2024-01-13T18:00:27.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE Serving on http://:::9283 2024-01-13T18:00:27.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE Bus STARTED 2024-01-13T18:00:27.839 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry preview 2024-01-13T18:00:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2337068672' entity='client.admin' 2024-01-13T18:00:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' 2024-01-13T18:00:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:28.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:28.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:28.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:28.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:28.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' 2024-01-13T18:00:28.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:28.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:28.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:28.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:27 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:28.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE Bus STOPPING 2024-01-13T18:00:28.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:00:28.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE Bus STOPPED 2024-01-13T18:00:28.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE Bus STARTING 2024-01-13T18:00:28.180 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE Serving on http://:::9283 2024-01-13T18:00:28.180 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:27] ENGINE Bus STARTED 2024-01-13T18:00:28.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2337068672' entity='client.admin' 2024-01-13T18:00:28.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:28.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:28.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' 2024-01-13T18:00:28.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:28.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:28.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:28.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:28.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:28.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:28.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:28.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' 2024-01-13T18:00:28.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:28.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:28.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:28.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:28.183 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2337068672' entity='client.admin' 2024-01-13T18:00:28.183 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:28.183 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:28.184 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' 2024-01-13T18:00:28.184 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:28.184 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:28.184 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:28.184 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:28.184 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:28.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:28.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:28.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' 2024-01-13T18:00:28.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:28.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:28.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:28.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:27 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:28.383 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-01-13T18:00:28.383 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer": { 2024-01-13T18:00:28.383 INFO:tasks.workunit.client.0.smithi084.stdout: "active": true, 2024-01-13T18:00:28.383 INFO:tasks.workunit.client.0.smithi084.stdout: "mode": "" 2024-01-13T18:00:28.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.383 INFO:tasks.workunit.client.0.smithi084.stdout: "channels": [ 2024-01-13T18:00:28.383 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-01-13T18:00:28.384 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-01-13T18:00:28.384 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-01-13T18:00:28.384 INFO:tasks.workunit.client.0.smithi084.stdout: "ident" 2024-01-13T18:00:28.384 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.384 INFO:tasks.workunit.client.0.smithi084.stdout: "channels_available": [ 2024-01-13T18:00:28.384 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-01-13T18:00:28.384 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-01-13T18:00:28.384 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-01-13T18:00:28.384 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-01-13T18:00:28.384 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-01-13T18:00:28.384 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_available": [ 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.385 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_opted_in": [ 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "config": { 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "active_changed": [ 2024-01-13T18:00:28.386 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "client_check_pool_perm", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_gid", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_uid", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "client_quota", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "daemonize", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-01-13T18:00:28.387 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "keyring", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_block_size", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_cache_size", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_compression", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_log", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_write_buffer_size", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-01-13T18:00:28.388 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_journald", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_stderr", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_host", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-01-13T18:00:28.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "no_config_file", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-01-13T18:00:28.390 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-01-13T18:00:28.391 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-01-13T18:00:28.391 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-01-13T18:00:28.391 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-01-13T18:00:28.391 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-01-13T18:00:28.391 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-01-13T18:00:28.391 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-01-13T18:00:28.391 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-01-13T18:00:28.391 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-01-13T18:00:28.391 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-01-13T18:00:28.391 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_lim", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_res", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_wgt", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-01-13T18:00:28.392 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addr", 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addrv", 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_default_features", 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_qos_exclude_ops", 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "setgroup", 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "setuser" 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_changed": [ 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-01-13T18:00:28.393 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_join_fs", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/allow_ptrace", 2024-01-13T18:00:28.394 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/container_init", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/migration_current", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/use_repo_digest", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ssl_server_port", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/orchestrator/orchestrator", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_ident", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/description", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/organization", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-01-13T18:00:28.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-01-13T18:00:28.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-01-13T18:00:28.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-01-13T18:00:28.398 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_cache_enabled", 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_ops_log", 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_usage_log" 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "contact": null, 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "crashes": [], 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "created": "2024-01-13T17:54:38.557528Z", 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "crush": { 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_algs": { 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "straw2": 3 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_sizes": { 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "2": 1, 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: "4": 2 2024-01-13T18:00:28.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_types": { 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: "1": 2, 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: "11": 1 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: "compat_weight_set": false, 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: "device_classes": [ 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: 8 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_buckets": 6, 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_devices": 8, 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_rules": 1, 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_types": 12, 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_weight_sets": 0, 2024-01-13T18:00:28.400 INFO:tasks.workunit.client.0.smithi084.stdout: "tunables": { 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "allowed_bucket_algs": 54, 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_fallback_tries": 0, 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_tries": 0, 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_total_tries": 50, 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_descend_once": 1, 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_stable": 1, 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_vary_r": 1, 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v2_rules": 0, 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v3_rules": 0, 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v4_buckets": 1, 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v5_rules": 0, 2024-01-13T18:00:28.401 INFO:tasks.workunit.client.0.smithi084.stdout: "legacy_tunables": 0, 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "minimum_required_version": "jewel", 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "optimal_tunables": 1, 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "profile": "jewel", 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables": 1, 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables2": 1, 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables3": 1, 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables5": 1, 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "straw_calc_version": 1 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "description": "upgrade test cluster", 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "fs": { 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "feature_flags": { 2024-01-13T18:00:28.402 INFO:tasks.workunit.client.0.smithi084.stdout: "enable_multiple": true, 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_enabled_multiple": true 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "filesystems": [ 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "approx_ctime": "2024-01", 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer_enabled": false, 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_caps": 2, 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_dns": 10, 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_inos": 13, 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_subtrees": 2, 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_allowed_features": 0, 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "explicitly_allowed_features": 0, 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "files": 0, 2024-01-13T18:00:28.403 INFO:tasks.workunit.client.0.smithi084.stdout: "max_mds": 1, 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_data_pools": 1, 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_in": 1, 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_mds": 1, 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": 2, 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_replay": 0, 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_up": 1, 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: "snaps": 0, 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: "standby_count_wanted": 0 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_mds": 1, 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: "total_num_mds": 2 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.404 INFO:tasks.workunit.client.0.smithi084.stdout: "hosts": { 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num": 2, 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mds": 2, 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mgr": 2, 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mon": 2, 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_osd": 2 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard": false, 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "license": "sharing-1-0", 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "metadata": { 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 2 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:28.405 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 2 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 2 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 2 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.406 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 2 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 2 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 3 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 3 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:28.407 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 3 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 3 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 3 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 3 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:28.408 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 3 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 8 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 8 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 8 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.409 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 8 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 8 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 8 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 8 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_objectstore": { 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": 8 2024-01-13T18:00:28.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "rotational": { 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "0": 8 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "features": { 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "optional": [], 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "persistent": [ 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "kraken", 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "luminous", 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "mimic", 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap-prune", 2024-01-13T18:00:28.411 INFO:tasks.workunit.client.0.smithi084.stdout: "nautilus", 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "octopus", 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "pacific", 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "elector-pinging", 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "quincy" 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv4_addr_mons": 6, 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv6_addr_mons": 0, 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "min_mon_release": 17, 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "v1_addr_mons": 3, 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "v2_addr_mons": 3 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "organization": "ceph-qa", 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:28.412 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_network": false, 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 8, 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "require_min_compat_client": "luminous", 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "require_osd_release": "quincy" 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": [ 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:28.413 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 1, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 1, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 1, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 1781760, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 1781760, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 2, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:28.414 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 2.450439524182002e-06, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 212, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 313344, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 590368, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 590368, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 1771104, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 179, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 2473984 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.415 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 32, 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 32, 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 2, 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:28.416 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 98304, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 98304, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 22, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 1.3519698427444382e-07, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 3094, 2024-01-13T18:00:28.417 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 3094, 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 9282, 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 48, 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 16384 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:28.418 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:28.419 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.419 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:28.419 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:28.419 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:28.419 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:28.419 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:28.419 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 64, 2024-01-13T18:00:28.420 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 64, 2024-01-13T18:00:28.420 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 3, 2024-01-13T18:00:28.420 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:28.420 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:28.420 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:28.420 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-01-13T18:00:28.420 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:28.420 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:28.420 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-01-13T18:00:28.420 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:28.420 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-01-13T18:00:28.421 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 8, 2024-01-13T18:00:28.422 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 8, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 4, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:28.423 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.424 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": { 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: "mirroring_by_pool": [ 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: false 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_images_by_pool": [ 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pools": 1 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: "report_id": "ece1ff4f-b467-425a-b891-1b2b4dc63da0", 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: "report_timestamp": "2024-01-13T18:00:28.375687", 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: "report_version": 1, 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: "rook": { 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster": { 2024-01-13T18:00:28.425 INFO:tasks.workunit.client.0.smithi084.stdout: "external-mode": null, 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: "allow-multiple-per-node": null, 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: "count": null, 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: "max-id": null, 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: "pvc": { 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: "stretch": { 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: "network": { 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: "provider": null 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.426 INFO:tasks.workunit.client.0.smithi084.stdout: "storage": { 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: "device-set": { 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: "non-portable": null, 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: "portable": null, 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: "csi": { 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes": { 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:28.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "node": { 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes-total": null, 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "with-ceph-daemons": null, 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-cephfs-plugin": null, 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-nfs-plugin": null, 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-rbd-plugin": null 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "storage-class": { 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket": null, 2024-01-13T18:00:28.428 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs": null, 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "nfs": null, 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": null, 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "services": {}, 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 105, 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": 4, 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_by_class": { 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "ssd": { 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 765517758464, 2024-01-13T18:00:28.429 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-01-13T18:00:28.430 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 2442526720, 2024-01-13T18:00:28.430 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_bytes": 2442526720, 2024-01-13T18:00:28.430 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_ratio": 0.003180537838488817 2024-01-13T18:00:28.430 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.430 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.430 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 765517758464, 2024-01-13T18:00:28.430 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-01-13T18:00:28.430 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 2442526720 2024-01-13T18:00:28.430 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.430 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-01-13T18:00:28.430 INFO:tasks.workunit.client.0.smithi084.stdout:Device report is generated separately. To see it run 'ceph telemetry preview-device'. 2024-01-13T18:00:28.431 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry preview-device 2024-01-13T18:00:28.954 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-01-13T18:00:28.954 INFO:tasks.workunit.client.0.smithi084.stdout: "a2b2d4dc-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:28.954 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_a2b354e8-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:28.954 INFO:tasks.workunit.client.0.smithi084.stdout: "20240113-175701": { 2024-01-13T18:00:28.954 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-01-13T18:00:28.954 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-01-13T18:00:28.954 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-01-13T18:00:28.954 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-01-13T18:00:28.954 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-01-13T18:00:28.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.954 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "a2b2d4dc-b23d-11ee-909d-0cc47a8fd751", 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Jan 13 17:57:01 2024 UTC", 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1705168621 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-01-13T18:00:28.955 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.956 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-01-13T18:00:28.957 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:28.957 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:28.957 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.957 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.957 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.957 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-01-13T18:00:28.957 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-01-13T18:00:28.957 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-01-13T18:00:28.957 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-01-13T18:00:28.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.957 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-01-13T18:00:28.958 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 32481125 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.960 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-01-13T18:00:28.960 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.960 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 53452353 2024-01-13T18:00:28.960 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.960 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-01-13T18:00:28.960 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.960 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.960 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.960 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-01-13T18:00:28.960 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.961 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.961 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.961 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-01-13T18:00:28.961 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.961 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.961 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.961 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-01-13T18:00:28.961 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.961 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.961 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.961 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-01-13T18:00:28.962 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.962 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.962 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-01-13T18:00:28.962 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.962 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.962 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-01-13T18:00:28.962 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.962 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:28.963 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-01-13T18:00:28.963 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-01-13T18:00:28.963 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.963 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.963 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-01-13T18:00:28.963 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.963 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:28.963 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.963 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-01-13T18:00:28.963 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:28.964 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3606, 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3625, 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3588 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 105, 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 436064233, 2024-01-13T18:00:28.965 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2128683066, 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 6851839327, 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 35647816531, 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 53973, 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 53976, 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 27, 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 6961 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 53973, 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 53976 2024-01-13T18:00:28.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.967 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-01-13T18:00:28.967 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-01-13T18:00:28.967 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-01-13T18:00:28.967 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:28.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.967 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-01-13T18:00:28.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.967 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-01-13T18:00:28.967 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-4.18.0-532.el8.x86_64] (local build)", 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-01-13T18:00:28.968 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Jan 13 17:57:01 2024 UTC", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-01-13T18:00:28.969 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-01-13T18:00:28.970 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.970 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-01-13T18:00:28.970 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-01-13T18:00:28.970 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-01-13T18:00:28.970 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.970 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-01-13T18:00:28.970 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-01-13T18:00:28.970 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-01-13T18:00:28.970 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-01-13T18:00:28.970 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 27 Celsius", 2024-01-13T18:00:28.971 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 436,064,233 [223 TB]", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,128,683,066 [1.08 PB]", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 6,851,839,327", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 35,647,816,531", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 105", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 53,973", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 53,976", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 6,961", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-01-13T18:00:28.972 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-4.18.0-532.el8.x86_64", 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 27 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.973 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: "a2b45f96-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_a2b4cc9c-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: "20240113-175703": { 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-01-13T18:00:28.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "a2b45f96-b23d-11ee-909d-0cc47a8fd751", 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Jan 13 17:57:03 2024 UTC", 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1705168623 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-01-13T18:00:28.975 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-01-13T18:00:28.976 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-01-13T18:00:28.977 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-01-13T18:00:28.978 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.978 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.978 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-01-13T18:00:28.978 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.978 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.978 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-01-13T18:00:28.978 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.978 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.979 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-01-13T18:00:28.979 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.979 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.979 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-01-13T18:00:28.979 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.979 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 34122724 2024-01-13T18:00:28.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.980 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-01-13T18:00:28.980 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.980 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-01-13T18:00:28.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.980 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-01-13T18:00:28.980 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.981 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.981 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-01-13T18:00:28.981 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.981 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 54939479 2024-01-13T18:00:28.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.981 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-01-13T18:00:28.981 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.981 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.981 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.982 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.984 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3679, 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3697, 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3661 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.985 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 1, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 481777854, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2236266868, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7949654242, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 38141429385, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 52662, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 54648, 2024-01-13T18:00:28.986 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 24, 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 273 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 52662, 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 54648 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.987 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-4.18.0-532.el8.x86_64] (local build)", 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.988 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Jan 13 17:57:03 2024 UTC", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-01-13T18:00:28.989 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-01-13T18:00:28.990 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 24 Celsius", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-01-13T18:00:28.991 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 481,777,854 [246 TB]", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,236,266,868 [1.14 PB]", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,949,654,242", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 38,141,429,385", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 1", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 52,662", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 54,648", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 273", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-01-13T18:00:28.992 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-4.18.0-532.el8.x86_64", 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 24 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-01-13T18:00:28.993 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:28.994 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:28.994 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.994 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.994 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.994 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:28.994 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-01-13T18:00:28.994 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry preview-all 2024-01-13T18:00:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:28 smithi099 ceph-mon[71325]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:28 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:28 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:28 smithi099 ceph-mon[71325]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:29.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:28 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:28 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:28 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:28 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:28 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:28 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[37908]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[37908]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[52328]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[52328]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:28 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:29.526 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-01-13T18:00:29.526 INFO:tasks.workunit.client.0.smithi084.stdout: "device_report": { 2024-01-13T18:00:29.526 INFO:tasks.workunit.client.0.smithi084.stdout: "a2b2d4dc-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:29.526 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_a2b354e8-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:29.526 INFO:tasks.workunit.client.0.smithi084.stdout: "20240113-175701": { 2024-01-13T18:00:29.526 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-01-13T18:00:29.526 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-01-13T18:00:29.527 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-01-13T18:00:29.527 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-01-13T18:00:29.527 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-01-13T18:00:29.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.527 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-01-13T18:00:29.527 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "a2b2d4dc-b23d-11ee-909d-0cc47a8fd751", 2024-01-13T18:00:29.527 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-01-13T18:00:29.527 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:29.527 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:29.527 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.528 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-01-13T18:00:29.528 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Jan 13 17:57:01 2024 UTC", 2024-01-13T18:00:29.528 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1705168621 2024-01-13T18:00:29.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.528 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-01-13T18:00:29.528 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-01-13T18:00:29.528 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-01-13T18:00:29.528 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-01-13T18:00:29.528 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-01-13T18:00:29.528 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:29.528 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 32481125 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-01-13T18:00:29.531 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.532 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-01-13T18:00:29.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.532 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-01-13T18:00:29.532 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.532 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.532 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-01-13T18:00:29.532 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.532 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 53452353 2024-01-13T18:00:29.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.533 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:29.534 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.535 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3606, 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3625, 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3588 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.536 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 105, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 436064233, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2128683066, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 6851839327, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 35647816531, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 53973, 2024-01-13T18:00:29.537 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 53976, 2024-01-13T18:00:29.538 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 27, 2024-01-13T18:00:29.538 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 6961 2024-01-13T18:00:29.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.538 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-01-13T18:00:29.538 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 53973, 2024-01-13T18:00:29.538 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-01-13T18:00:29.538 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 53976 2024-01-13T18:00:29.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.538 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-01-13T18:00:29.538 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-01-13T18:00:29.539 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-4.18.0-532.el8.x86_64] (local build)", 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-01-13T18:00:29.540 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Jan 13 17:57:01 2024 UTC", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-01-13T18:00:29.541 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-01-13T18:00:29.542 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 27 Celsius", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 436,064,233 [223 TB]", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,128,683,066 [1.08 PB]", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 6,851,839,327", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 35,647,816,531", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 105", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 53,973", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 53,976", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 6,961", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-01-13T18:00:29.543 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.544 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-01-13T18:00:29.544 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-01-13T18:00:29.544 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-01-13T18:00:29.544 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.544 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-4.18.0-532.el8.x86_64", 2024-01-13T18:00:29.544 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-01-13T18:00:29.544 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-01-13T18:00:29.544 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:29.544 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:29.544 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:29.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.545 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-01-13T18:00:29.545 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 27 2024-01-13T18:00:29.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.545 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-01-13T18:00:29.545 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:29.545 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:29.545 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.545 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.545 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.545 INFO:tasks.workunit.client.0.smithi084.stdout: "a2b45f96-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_a2b4cc9c-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: "20240113-175703": { 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "a2b45f96-b23d-11ee-909d-0cc47a8fd751", 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:29.546 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Jan 13 17:57:03 2024 UTC", 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1705168623 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.547 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-01-13T18:00:29.548 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.549 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 34122724 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-01-13T18:00:29.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 54939479 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.551 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.552 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:29.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-01-13T18:00:29.554 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3679, 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3697, 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3661 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 1, 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 481777854, 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2236266868, 2024-01-13T18:00:29.555 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7949654242, 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 38141429385, 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 52662, 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 54648, 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 24, 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 273 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 52662, 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-01-13T18:00:29.556 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 54648 2024-01-13T18:00:29.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.557 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-01-13T18:00:29.557 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-01-13T18:00:29.557 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-01-13T18:00:29.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:29.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.557 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-01-13T18:00:29.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.557 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-4.18.0-532.el8.x86_64] (local build)", 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-01-13T18:00:29.558 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.559 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-01-13T18:00:29.559 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-01-13T18:00:29.559 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-01-13T18:00:29.559 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-01-13T18:00:29.559 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-01-13T18:00:29.559 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-01-13T18:00:29.559 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-01-13T18:00:29.559 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-01-13T18:00:29.559 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-01-13T18:00:29.559 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Jan 13 17:57:03 2024 UTC", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-01-13T18:00:29.560 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-01-13T18:00:29.561 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 24 Celsius", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 481,777,854 [246 TB]", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,236,266,868 [1.14 PB]", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,949,654,242", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 38,141,429,385", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 1", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 52,662", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 54,648", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 273", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:29.562 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-4.18.0-532.el8.x86_64", 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 24 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.563 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: "report": { 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer": { 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: "active": true, 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: "mode": "" 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: "channels": [ 2024-01-13T18:00:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-01-13T18:00:29.565 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-01-13T18:00:29.565 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-01-13T18:00:29.565 INFO:tasks.workunit.client.0.smithi084.stdout: "ident" 2024-01-13T18:00:29.565 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.565 INFO:tasks.workunit.client.0.smithi084.stdout: "channels_available": [ 2024-01-13T18:00:29.565 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-01-13T18:00:29.565 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-01-13T18:00:29.565 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-01-13T18:00:29.565 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-01-13T18:00:29.565 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_available": [ 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.566 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_opted_in": [ 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "config": { 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "active_changed": [ 2024-01-13T18:00:29.567 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "client_check_pool_perm", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_gid", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_uid", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "client_quota", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "daemonize", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-01-13T18:00:29.568 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "keyring", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_block_size", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_cache_size", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_compression", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_log", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_write_buffer_size", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-01-13T18:00:29.569 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_journald", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_stderr", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_host", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-01-13T18:00:29.570 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "no_config_file", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-01-13T18:00:29.571 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-01-13T18:00:29.572 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_lim", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_res", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_wgt", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-01-13T18:00:29.573 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addr", 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addrv", 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_default_features", 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_qos_exclude_ops", 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "setgroup", 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "setuser" 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_changed": [ 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-01-13T18:00:29.574 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-01-13T18:00:29.575 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-01-13T18:00:29.575 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-01-13T18:00:29.575 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-01-13T18:00:29.575 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-01-13T18:00:29.575 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-01-13T18:00:29.575 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-01-13T18:00:29.575 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-01-13T18:00:29.575 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-01-13T18:00:29.575 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-01-13T18:00:29.575 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_join_fs", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/allow_ptrace", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/container_init", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/migration_current", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/use_repo_digest", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ssl_server_port", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/orchestrator/orchestrator", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_ident", 2024-01-13T18:00:29.576 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/description", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/organization", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-01-13T18:00:29.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-01-13T18:00:29.578 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-01-13T18:00:29.579 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_cache_enabled", 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_ops_log", 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_usage_log" 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: "contact": null, 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: "crashes": [], 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: "created": "2024-01-13T17:54:38.557528Z", 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: "crush": { 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_algs": { 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: "straw2": 3 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_sizes": { 2024-01-13T18:00:29.580 INFO:tasks.workunit.client.0.smithi084.stdout: "2": 1, 2024-01-13T18:00:29.581 INFO:tasks.workunit.client.0.smithi084.stdout: "4": 2 2024-01-13T18:00:29.581 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.581 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_types": { 2024-01-13T18:00:29.581 INFO:tasks.workunit.client.0.smithi084.stdout: "1": 2, 2024-01-13T18:00:29.581 INFO:tasks.workunit.client.0.smithi084.stdout: "11": 1 2024-01-13T18:00:29.581 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.581 INFO:tasks.workunit.client.0.smithi084.stdout: "compat_weight_set": false, 2024-01-13T18:00:29.581 INFO:tasks.workunit.client.0.smithi084.stdout: "device_classes": [ 2024-01-13T18:00:29.581 INFO:tasks.workunit.client.0.smithi084.stdout: 8 2024-01-13T18:00:29.581 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_buckets": 6, 2024-01-13T18:00:29.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_devices": 8, 2024-01-13T18:00:29.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_rules": 1, 2024-01-13T18:00:29.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_types": 12, 2024-01-13T18:00:29.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_weight_sets": 0, 2024-01-13T18:00:29.582 INFO:tasks.workunit.client.0.smithi084.stdout: "tunables": { 2024-01-13T18:00:29.582 INFO:tasks.workunit.client.0.smithi084.stdout: "allowed_bucket_algs": 54, 2024-01-13T18:00:29.582 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_fallback_tries": 0, 2024-01-13T18:00:29.582 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_tries": 0, 2024-01-13T18:00:29.582 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_total_tries": 50, 2024-01-13T18:00:29.583 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_descend_once": 1, 2024-01-13T18:00:29.583 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_stable": 1, 2024-01-13T18:00:29.583 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_vary_r": 1, 2024-01-13T18:00:29.583 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v2_rules": 0, 2024-01-13T18:00:29.583 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v3_rules": 0, 2024-01-13T18:00:29.583 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v4_buckets": 1, 2024-01-13T18:00:29.583 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v5_rules": 0, 2024-01-13T18:00:29.583 INFO:tasks.workunit.client.0.smithi084.stdout: "legacy_tunables": 0, 2024-01-13T18:00:29.583 INFO:tasks.workunit.client.0.smithi084.stdout: "minimum_required_version": "jewel", 2024-01-13T18:00:29.583 INFO:tasks.workunit.client.0.smithi084.stdout: "optimal_tunables": 1, 2024-01-13T18:00:29.583 INFO:tasks.workunit.client.0.smithi084.stdout: "profile": "jewel", 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables": 1, 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables2": 1, 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables3": 1, 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables5": 1, 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: "straw_calc_version": 1 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: "description": "upgrade test cluster", 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: "fs": { 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: "feature_flags": { 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: "enable_multiple": true, 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_enabled_multiple": true 2024-01-13T18:00:29.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "filesystems": [ 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "approx_ctime": "2024-01", 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer_enabled": false, 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_caps": 2, 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_dns": 10, 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_inos": 13, 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_subtrees": 2, 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_allowed_features": 0, 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "explicitly_allowed_features": 0, 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "files": 0, 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "max_mds": 1, 2024-01-13T18:00:29.585 INFO:tasks.workunit.client.0.smithi084.stdout: "num_data_pools": 1, 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: "num_in": 1, 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: "num_mds": 1, 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": 2, 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_replay": 0, 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: "num_up": 1, 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: "snaps": 0, 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: "standby_count_wanted": 0 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_mds": 1, 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: "total_num_mds": 2 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: "hosts": { 2024-01-13T18:00:29.586 INFO:tasks.workunit.client.0.smithi084.stdout: "num": 2, 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mds": 2, 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mgr": 2, 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mon": 2, 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_osd": 2 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard": false, 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "license": "sharing-1-0", 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "metadata": { 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 2 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:29.587 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:00:29.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.588 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:29.588 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-01-13T18:00:29.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.588 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:29.588 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 2 2024-01-13T18:00:29.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.588 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:29.588 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 2 2024-01-13T18:00:29.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 2 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 2 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 2 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 3 2024-01-13T18:00:29.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.590 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:29.590 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 3 2024-01-13T18:00:29.590 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.590 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:29.590 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-01-13T18:00:29.590 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.590 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:29.591 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 3 2024-01-13T18:00:29.591 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.591 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:29.591 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 3 2024-01-13T18:00:29.591 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.591 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:29.591 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 3 2024-01-13T18:00:29.591 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.591 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:29.591 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 3 2024-01-13T18:00:29.591 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 3 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 8 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 8 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:29.592 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-01-13T18:00:29.593 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.593 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:29.593 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 8 2024-01-13T18:00:29.593 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.593 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:29.593 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 8 2024-01-13T18:00:29.593 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.593 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:29.593 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 8 2024-01-13T18:00:29.593 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.593 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 8 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 8 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_objectstore": { 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": 8 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: "rotational": { 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: "0": 8 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:29.594 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "features": { 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "optional": [], 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "persistent": [ 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "kraken", 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "luminous", 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "mimic", 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap-prune", 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "nautilus", 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "octopus", 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "pacific", 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "elector-pinging", 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: "quincy" 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:29.595 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv4_addr_mons": 6, 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv6_addr_mons": 0, 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "min_mon_release": 17, 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "v1_addr_mons": 3, 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "v2_addr_mons": 3 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "organization": "ceph-qa", 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_network": false, 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 8, 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "require_min_compat_client": "luminous", 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "require_osd_release": "quincy" 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.596 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": [ 2024-01-13T18:00:29.597 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:29.597 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:29.597 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-01-13T18:00:29.597 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.597 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:29.597 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:29.597 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:29.597 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:29.597 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:29.597 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 1, 2024-01-13T18:00:29.597 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 1, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 1, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 1781760, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 1781760, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 2, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:29.598 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 2.450439524182002e-06, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 212, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 313344, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 590368, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 590368, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 1771104, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 179, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 2473984 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:29.599 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 32, 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 32, 2024-01-13T18:00:29.600 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 2, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 98304, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 98304, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 22, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 1.3519698427444382e-07, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:29.601 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 3094, 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 3094, 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 9282, 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 48, 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 16384 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:29.602 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 64, 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 64, 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 3, 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:29.603 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:29.604 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:29.605 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 8, 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 8, 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 4, 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:29.606 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:29.607 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.608 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": { 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: "mirroring_by_pool": [ 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: false 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_images_by_pool": [ 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pools": 1 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: "report_id": "ece1ff4f-b467-425a-b891-1b2b4dc63da0", 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: "report_timestamp": "2024-01-13T18:00:29.507189", 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: "report_version": 1, 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: "rook": { 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster": { 2024-01-13T18:00:29.609 INFO:tasks.workunit.client.0.smithi084.stdout: "external-mode": null, 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: "allow-multiple-per-node": null, 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: "count": null, 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: "max-id": null, 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: "pvc": { 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: "stretch": { 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: "network": { 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: "provider": null 2024-01-13T18:00:29.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.611 INFO:tasks.workunit.client.0.smithi084.stdout: "storage": { 2024-01-13T18:00:29.611 INFO:tasks.workunit.client.0.smithi084.stdout: "device-set": { 2024-01-13T18:00:29.611 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:29.611 INFO:tasks.workunit.client.0.smithi084.stdout: "non-portable": null, 2024-01-13T18:00:29.611 INFO:tasks.workunit.client.0.smithi084.stdout: "portable": null, 2024-01-13T18:00:29.611 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-01-13T18:00:29.611 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.611 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.611 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.611 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.611 INFO:tasks.workunit.client.0.smithi084.stdout: "csi": { 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes": { 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: "node": { 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes-total": null, 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: "with-ceph-daemons": null, 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-cephfs-plugin": null, 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-nfs-plugin": null, 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-rbd-plugin": null 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: "storage-class": { 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket": null, 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs": null, 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: "nfs": null, 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": null, 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: "services": {}, 2024-01-13T18:00:29.613 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 105, 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": 4, 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_by_class": { 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "ssd": { 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 765517758464, 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 2442526720, 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_bytes": 2442526720, 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_ratio": 0.003180537838488817 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 765517758464, 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 2442526720 2024-01-13T18:00:29.614 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.615 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:29.615 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-01-13T18:00:29.615 INFO:tasks.workunit.client.0.smithi084.stderr:++ ceph telemetry collection ls 2024-01-13T18:00:30.073 INFO:tasks.workunit.client.0.smithi084.stderr:+ COLLECTIONS='New collections are available: 2024-01-13T18:00:30.073 INFO:tasks.workunit.client.0.smithi084.stderr:['\''basic_base'\'', '\''basic_mds_metadata'\'', '\''basic_pool_options_bluestore'\'', '\''basic_pool_usage'\'', '\''basic_rook_v01'\'', '\''basic_usage_by_class'\'', '\''crash_base'\'', '\''device_base'\'', '\''ident_base'\'', '\''perf_memory_metrics'\'', '\''perf_perf'\''] 2024-01-13T18:00:30.073 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-01-13T18:00:30.073 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:30.073 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-01-13T18:00:30.073 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-01-13T18:00:30.073 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-01-13T18:00:30.073 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-01-13T18:00:30.073 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-01-13T18:00:30.074 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-01-13T18:00:30.074 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-01-13T18:00:30.074 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-01-13T18:00:30.074 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-01-13T18:00:30.074 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-01-13T18:00:30.074 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-01-13T18:00:30.074 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster ' 2024-01-13T18:00:30.074 INFO:tasks.workunit.client.0.smithi084.stderr:+ NEW_COLLECTIONS=("perf_perf" "basic_mds_metadata" "basic_pool_usage" "basic_rook_v01" "perf_memory_metrics") 2024-01-13T18:00:30.074 INFO:tasks.workunit.client.0.smithi084.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-01-13T18:00:30.074 INFO:tasks.workunit.client.0.smithi084.stderr:+ [[ New collections are available: 2024-01-13T18:00:30.074 INFO:tasks.workunit.client.0.smithi084.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *perf_perf* ]] 2024-01-13T18:00:30.075 INFO:tasks.workunit.client.0.smithi084.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:+ [[ New collections are available: 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-01-13T18:00:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_mds_metadata* ]] 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:+ [[ New collections are available: 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-01-13T18:00:30.077 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_pool_usage* ]] 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:+ [[ New collections are available: 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-01-13T18:00:30.078 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_rook_v01* ]] 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:+ [[ New collections are available: 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T18:00:30.079 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *perf_memory_metrics* ]] 2024-01-13T18:00:30.080 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry on --license sharing-1-0 2024-01-13T18:00:30.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:29 smithi099 ceph-mon[71325]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:29 smithi099 ceph-mon[71325]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:29 smithi099 ceph-mon[71325]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:30.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:29 smithi099 ceph-mon[71325]: from='client.24845 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:29 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:29 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:29 smithi099 ceph-mon[71325]: from='client.24845 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:29 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:29 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[37908]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[37908]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[37908]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:30.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[37908]: from='client.24845 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[37908]: from='client.24845 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[52328]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[52328]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[52328]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:30.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[52328]: from='client.24845 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[52328]: from='client.24845 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:30.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:29 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:30.646 INFO:tasks.workunit.client.0.smithi084.stdout:Telemetry is on. 2024-01-13T18:00:30.646 INFO:tasks.workunit.client.0.smithi084.stdout:Some channels are disabled, please enable with: 2024-01-13T18:00:30.646 INFO:tasks.workunit.client.0.smithi084.stdout:`ceph telemetry enable channel perf` 2024-01-13T18:00:30.658 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry enable channel perf 2024-01-13T18:00:30.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:30] ENGINE Bus STOPPING 2024-01-13T18:00:30.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:30] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:00:30.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:30] ENGINE Bus STOPPED 2024-01-13T18:00:30.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:30] ENGINE Bus STARTING 2024-01-13T18:00:30.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:30] ENGINE Serving on http://:::9283 2024-01-13T18:00:30.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:30] ENGINE Bus STARTED 2024-01-13T18:00:31.193 INFO:tasks.workunit.client.0.smithi084.stdout:channel_perf is enabled 2024-01-13T18:00:31.206 INFO:tasks.workunit.client.0.smithi084.stderr:++ ceph config get mgr mgr/telemetry/last_opt_revision 2024-01-13T18:00:31.323 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:31] ENGINE Bus STOPPING 2024-01-13T18:00:31.324 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:31] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:00:31.324 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:31] ENGINE Bus STOPPED 2024-01-13T18:00:31.324 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:31] ENGINE Bus STARTING 2024-01-13T18:00:31.324 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:31] ENGINE Serving on http://:::9283 2024-01-13T18:00:31.324 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:00:31] ENGINE Bus STARTED 2024-01-13T18:00:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='client.24851 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='client.24851 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: mgrmap e21: y(active, since 85s), standbys: x 2024-01-13T18:00:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:31 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.627 INFO:tasks.workunit.client.0.smithi084.stderr:+ LAST_OPT_REVISION=1 2024-01-13T18:00:31.627 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 1 -ne 1 ']' 2024-01-13T18:00:31.627 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry show 2024-01-13T18:00:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='client.24851 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='client.24851 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: mgrmap e21: y(active, since 85s), standbys: x 2024-01-13T18:00:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='client.24851 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='client.24851 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: mgrmap e21: y(active, since 85s), standbys: x 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:31.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:31.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:31.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:31.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:31 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:32.395 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-01-13T18:00:32.395 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer": { 2024-01-13T18:00:32.395 INFO:tasks.workunit.client.0.smithi084.stdout: "active": true, 2024-01-13T18:00:32.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mode": "" 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "channels": [ 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "channels_available": [ 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-01-13T18:00:32.396 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_available": [ 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_opted_in": [ 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-01-13T18:00:32.397 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "config": { 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "active_changed": [ 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-01-13T18:00:32.398 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "client_check_pool_perm", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_gid", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_uid", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "client_quota", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "daemonize", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-01-13T18:00:32.399 INFO:tasks.workunit.client.0.smithi084.stdout: "keyring", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_block_size", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_cache_size", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_compression", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_log", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_write_buffer_size", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-01-13T18:00:32.400 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_journald", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_stderr", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_host", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-01-13T18:00:32.401 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "no_config_file", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-01-13T18:00:32.402 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_lim", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_res", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_wgt", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-01-13T18:00:32.403 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addr", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addrv", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_default_features", 2024-01-13T18:00:32.404 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_qos_exclude_ops", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "setgroup", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "setuser" 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_changed": [ 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-01-13T18:00:32.405 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_join_fs", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/allow_ptrace", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/container_init", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/migration_current", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/use_repo_digest", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ssl_server_port", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/orchestrator/orchestrator", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_ident", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_perf", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/description", 2024-01-13T18:00:32.406 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/enabled", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/organization", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-01-13T18:00:32.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-01-13T18:00:32.408 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_cache_enabled", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_ops_log", 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_usage_log" 2024-01-13T18:00:32.409 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "contact": null, 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "crashes": [], 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "created": "2024-01-13T17:54:38.557528Z", 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "crush": { 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_algs": { 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "straw2": 3 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_sizes": { 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "2": 1, 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "4": 2 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_types": { 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "1": 2, 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "11": 1 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.410 INFO:tasks.workunit.client.0.smithi084.stdout: "compat_weight_set": false, 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "device_classes": [ 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: 8 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_buckets": 6, 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_devices": 8, 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_rules": 1, 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_types": 12, 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_weight_sets": 0, 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "tunables": { 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "allowed_bucket_algs": 54, 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_fallback_tries": 0, 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_tries": 0, 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_total_tries": 50, 2024-01-13T18:00:32.411 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_descend_once": 1, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_stable": 1, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_vary_r": 1, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v2_rules": 0, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v3_rules": 0, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v4_buckets": 1, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v5_rules": 0, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "legacy_tunables": 0, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "minimum_required_version": "jewel", 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "optimal_tunables": 1, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "profile": "jewel", 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables": 1, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables2": 1, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables3": 1, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables5": 1, 2024-01-13T18:00:32.412 INFO:tasks.workunit.client.0.smithi084.stdout: "straw_calc_version": 1 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: "description": "upgrade test cluster", 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: "fs": { 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: "feature_flags": { 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: "enable_multiple": true, 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_enabled_multiple": true 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: "filesystems": [ 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: "approx_ctime": "2024-01", 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer_enabled": false, 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.413 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_caps": 2, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_dns": 10, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_inos": 13, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_subtrees": 2, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_allowed_features": 0, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "explicitly_allowed_features": 0, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "files": 0, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "max_mds": 1, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_data_pools": 1, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_in": 1, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_mds": 1, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": 2, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_replay": 0, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_up": 1, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "snaps": 0, 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: "standby_count_wanted": 0 2024-01-13T18:00:32.414 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_mds": 1, 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "total_num_mds": 2 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_stats": { 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 20258816, 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 427464, 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 73728, 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 8192, 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 379, 2024-01-13T18:00:32.415 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 1360680, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 20, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 834048, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 14810384, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 20267008 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.e3a6e53c614c51f88d28836624fb3fe0c21bc669": { 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 19218432, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 339496, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 212992, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 0, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 302, 2024-01-13T18:00:32.416 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 744552, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 12, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 746496, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 14422384, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 19218432 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.3986d685fcc5317d5063bf3be95b3875a27bc25b": { 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 35880960, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1269032, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 622592, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 14901248, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 953, 2024-01-13T18:00:32.417 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 6435272, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 21, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1042944, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 23758608, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 50782208 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 34799616, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1034432, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 278528, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 14925824, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 973, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 6069160, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 21, 2024-01-13T18:00:32.418 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1377792, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 23287192, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 49725440 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.e3a6e53c614c51f88d28836624fb3fe0c21bc669": { 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 44883968, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1347992, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 532480, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 7962624, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1661, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 10029648, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 23, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 2894848, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 27326488, 2024-01-13T18:00:32.419 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 52846592 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 273866752, 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 785744, 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 1040384, 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1274, 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4969736, 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 45, 2024-01-13T18:00:32.420 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 2956800, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 262270888, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 274907136 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 238960640, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 688960, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 229376, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1203, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5450528, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 46, 2024-01-13T18:00:32.421 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 2109696, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 227827872, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 239190016 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 237805568, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 829464, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 1449984, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1127, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4228816, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 46, 2024-01-13T18:00:32.422 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 2533888, 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 227329816, 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 239255552 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 270049280, 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 686160, 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 663552, 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1085, 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 3621208, 2024-01-13T18:00:32.423 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 45, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1859072, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 260999256, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 270712832 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 271392768, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 677208, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 8192, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 303104, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1117, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4304560, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-01-13T18:00:32.424 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1820160, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 261699064, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 271695872 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 238092288, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1096184, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 262144, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1130, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4470312, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 46, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1627392, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 228014816, 2024-01-13T18:00:32.425 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 238354432 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 238018560, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 969856, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 1236992, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1137, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4501664, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 45, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1687808, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 227975648, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 239255552 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.426 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 237977600, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1187096, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 24576, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 1277952, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1162, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4379280, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 46, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1767168, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 227735896, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 239255552 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.427 INFO:tasks.workunit.client.0.smithi084.stdout: "hosts": { 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num": 2, 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mds": 2, 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mgr": 2, 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mon": 2, 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_osd": 2 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "io_rate": { 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_stats_delta": { 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 0, 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 0, 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "stamp_delta": "12.002291", 2024-01-13T18:00:32.428 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:32.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:32.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 182, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 278, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 40, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-01-13T18:00:32.431 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 0 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard": false, 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "license": "sharing-1-0", 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "mempool": { 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.432 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.433 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.434 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.435 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213415, 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 65 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 51208, 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 210 2024-01-13T18:00:32.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7944, 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 126 2024-01-13T18:00:32.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.439 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.e3a6e53c614c51f88d28836624fb3fe0c21bc669": { 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.441 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.442 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.443 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.444 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 149304, 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 31 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 856, 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.445 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.446 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.3986d685fcc5317d5063bf3be95b3875a27bc25b": { 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.449 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.450 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1096279, 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 354 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 176, 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6592, 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 125 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5152, 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 83 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.459 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.460 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1087511, 2024-01-13T18:00:32.461 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 344 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 176, 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.462 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6592, 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 125 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.463 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5152, 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 83 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.e3a6e53c614c51f88d28836624fb3fe0c21bc669": { 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.464 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.467 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1094711, 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 340 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 440, 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 5 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6592, 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 125 2024-01-13T18:00:32.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10304, 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.471 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.472 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19600, 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1344, 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 12 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8400, 2024-01-13T18:00:32.473 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19600, 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1120, 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 14 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 602112, 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 16 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 49222, 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 9098 2024-01-13T18:00:32.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 131240, 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 193 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 11020, 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 706 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 30574, 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 193 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.475 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 401202, 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 90 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2435976, 2024-01-13T18:00:32.476 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 192 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6688, 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 76 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 521280, 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 45 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.477 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 88400, 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 174 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213128, 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3359 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:32.479 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18144, 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 162 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.480 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1680, 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 15 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7776, 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 162 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18144, 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 162 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 800, 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 10 2024-01-13T18:00:32.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 35363, 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 43847, 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8183 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 122400, 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 180 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9228, 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 534 2024-01-13T18:00:32.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26810, 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 180 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 421627, 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 96 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.483 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 40192, 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 10 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2426206, 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 177 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5368, 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 61 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.484 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 451776, 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7280, 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 18 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213128, 2024-01-13T18:00:32.485 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3359 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.486 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.487 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18032, 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 161 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1456, 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 13 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7728, 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 161 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.488 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18032, 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 161 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 720, 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 9 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26571, 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 41558, 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 7833 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 116280, 2024-01-13T18:00:32.489 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 171 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7864, 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 481 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 24674, 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 171 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.490 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 306680, 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 68 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 40192, 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 10 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2421904, 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 178 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.491 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4488, 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 51 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 347520, 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 30 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.492 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8112, 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 22 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213640, 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3383 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.493 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:32.494 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18592, 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.495 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7968, 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18592, 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 560, 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 7 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.496 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 42616, 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8135 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 121720, 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 179 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9020, 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 536 2024-01-13T18:00:32.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 25882, 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 179 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 282418, 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 61 2024-01-13T18:00:32.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2441990, 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 185 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4136, 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 47 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.499 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 428608, 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 37 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8840, 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 17 2024-01-13T18:00:32.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213128, 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3359 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.501 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:32.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18480, 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1008, 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 9 2024-01-13T18:00:32.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7920, 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18480, 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 640, 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.504 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4096, 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 43998, 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8276 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 123760, 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9288, 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 540 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.505 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26818, 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 894465, 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 68 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.506 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 40192, 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 10 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2444621, 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 183 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4928, 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 56 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.507 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 451776, 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8944, 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 18 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213384, 2024-01-13T18:00:32.508 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3371 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.509 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:32.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18480, 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 896, 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7920, 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:32.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18480, 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 640, 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.512 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 43998, 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8298 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 124440, 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 183 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9512, 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 542 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.513 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 27074, 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 183 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 836258, 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 54 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.514 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 40192, 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 10 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2409188, 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4928, 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 56 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.515 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 474944, 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 41 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10400, 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 20 2024-01-13T18:00:32.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213640, 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3383 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.517 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.518 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19376, 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 173 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 336, 2024-01-13T18:00:32.519 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8304, 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 173 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19376, 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 173 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 560, 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 7 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.520 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18990, 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 4 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 44213, 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8551 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 123080, 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 181 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10500, 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 696 2024-01-13T18:00:32.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 27758, 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 181 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.522 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 771722, 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2444680, 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 176 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4840, 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 55 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.523 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 451776, 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 86840, 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.524 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213128, 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3359 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.525 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:32.526 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19264, 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 672, 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.527 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8256, 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19264, 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 560, 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 7 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 266240, 2024-01-13T18:00:32.528 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 45771, 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8783 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 127160, 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 187 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 11152, 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 700 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.529 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 29462, 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 187 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 136624, 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 27 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.530 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2425534, 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 207 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5544, 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 63 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:32.531 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 521280, 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 45 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:32.532 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 89440, 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 200 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213128, 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3359 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: "metadata": { 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 2 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.534 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 2 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 2 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 2 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:32.535 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 2 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 2 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 3 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 3 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-01-13T18:00:32.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 3 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 3 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 3 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 3 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 3 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.537 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 8 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 8 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 8 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 8 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:32.538 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 8 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 8 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 8 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_objectstore": { 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": 8 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: "rotational": { 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: "0": 8 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "features": { 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "optional": [], 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "persistent": [ 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "kraken", 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "luminous", 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "mimic", 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap-prune", 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "nautilus", 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "octopus", 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "pacific", 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "elector-pinging", 2024-01-13T18:00:32.540 INFO:tasks.workunit.client.0.smithi084.stdout: "quincy" 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv4_addr_mons": 6, 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv6_addr_mons": 0, 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: "min_mon_release": 17, 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: "v1_addr_mons": 3, 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: "v2_addr_mons": 3 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: "organization": "ceph-qa", 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_network": false, 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 8, 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: "require_min_compat_client": "luminous", 2024-01-13T18:00:32.541 INFO:tasks.workunit.client.0.smithi084.stdout: "require_osd_release": "quincy" 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_perf_histograms": [ 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-01-13T18:00:32.542 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-01-13T18:00:32.543 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.544 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-01-13T18:00:32.545 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-01-13T18:00:32.546 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-01-13T18:00:32.547 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.548 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.549 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 24, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.550 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.551 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.552 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.553 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.554 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.555 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.556 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.557 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.558 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.559 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-01-13T18:00:32.560 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.561 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.562 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.562 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.562 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.562 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.562 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.562 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.562 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.562 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.562 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.563 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.564 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.565 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-01-13T18:00:32.566 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 62, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.567 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.568 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.569 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-01-13T18:00:32.570 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-01-13T18:00:32.571 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-01-13T18:00:32.572 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-01-13T18:00:32.573 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.575 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.576 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.577 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.578 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.579 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.580 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.581 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.582 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.584 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.586 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.587 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.588 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.589 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.590 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.591 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 24, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.592 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.593 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:32.594 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-01-13T18:00:32.595 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-01-13T18:00:32.596 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-01-13T18:00:32.597 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-01-13T18:00:32.598 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-01-13T18:00:32.599 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.600 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.601 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.602 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.603 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.604 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.605 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.606 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.607 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.608 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.609 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.610 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.611 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.612 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.613 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.614 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.615 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.616 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.617 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.618 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 24, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.619 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.620 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:32.621 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-01-13T18:00:32.622 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-01-13T18:00:32.623 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.624 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-01-13T18:00:32.625 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-01-13T18:00:32.626 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-01-13T18:00:32.627 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.628 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.629 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.630 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 10, 5, 0, 0, 0, 0, 0, 0, 14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 11, 2, 0, 0, 0, 0, 0, 0, 11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 21, 1, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.631 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.632 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.633 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.634 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.635 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.636 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-01-13T18:00:32.637 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.638 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.639 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.640 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.643 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.643 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.643 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.643 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.643 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.643 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.643 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.643 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.643 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.643 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.643 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.644 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.645 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.646 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.647 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.648 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.649 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_counters": { 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: "caps": { 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_flush_ack": { 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_flushsnap_ack": { 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_grant": { 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_revoke": { 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_trunc": { 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_commit": { 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_fetch": { 2024-01-13T18:00:32.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_merge": { 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_split": { 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: "exported_inodes": { 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: "forward": { 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.652 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_cap_release": { 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_caps": { 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_caps_dirty": { 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_inode_file_caps": { 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: "imported_inodes": { 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.653 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes": { 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_expired": { 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_pinned": { 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_with_caps": { 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: "load_cent": { 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: "openino_dir_fetch": { 2024-01-13T18:00:32.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: "process_request_cap_release": { 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: "reply_latency": { 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 81713 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: "request": { 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rbytes": { 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rfiles": { 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rsnaps": { 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_reply": { 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: "subtrees": { 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_cache": { 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_enqueue_scrub": { 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.656 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_exportdir": { 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_flush": { 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_fragmentdir": { 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_fragstats": { 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_inodestats": { 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_enqueued": { 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_prioritized": { 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_processing": { 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays": { 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays_delayed": { 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays_enqueuing": { 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_completed": { 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_started": { 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_created": { 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_enqueued": { 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_migrated": { 2024-01-13T18:00:32.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_reintegrated": { 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_log": { 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: "ev": { 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: "evadd": { 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: "evex": { 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: "evexd": { 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: "evexg": { 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: "evtrm": { 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: "jlat": { 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4239951 2024-01-13T18:00:32.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: "replayed": { 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: "seg": { 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: "segadd": { 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: "segex": { 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: "segexd": { 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.662 INFO:tasks.workunit.client.0.smithi084.stdout: "segexg": { 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: "segtrm": { 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_mem": { 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: "cap": { 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: "cap+": { 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.663 INFO:tasks.workunit.client.0.smithi084.stdout: "cap-": { 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: "dir": { 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: "dir+": { 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: "dir-": { 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: "dn": { 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.664 INFO:tasks.workunit.client.0.smithi084.stdout: "dn+": { 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: "dn-": { 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: "heap": { 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 207132 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: "ino": { 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: "ino+": { 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:32.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: "ino-": { 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_server": { 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: "cap_acquisition_throttle": { 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: "cap_revoke_eviction": { 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_request": { 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_session": { 2024-01-13T18:00:32.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_peer_request": { 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: "req_create_latency": { 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getattr_latency": { 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 81713 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.667 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getfilelock_latency": { 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getvxattr_latency": { 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: "req_link_latency": { 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookup_latency": { 2024-01-13T18:00:32.668 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookuphash_latency": { 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupino_latency": { 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupname_latency": { 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupparent_latency": { 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupsnap_latency": { 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lssnap_latency": { 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mkdir_latency": { 2024-01-13T18:00:32.670 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mknod_latency": { 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mksnap_latency": { 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: "req_open_latency": { 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.671 INFO:tasks.workunit.client.0.smithi084.stdout: "req_readdir_latency": { 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rename_latency": { 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: "req_renamesnap_latency": { 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.672 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmdir_latency": { 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmsnap_latency": { 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmxattr_latency": { 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setattr_latency": { 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.673 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setdirlayout_latency": { 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setfilelock_latency": { 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setlayout_latency": { 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setxattr_latency": { 2024-01-13T18:00:32.674 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: "req_symlink_latency": { 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: "req_unlink_latency": { 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_sessions": { 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: "average_load": { 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.675 INFO:tasks.workunit.client.0.smithi084.stdout: "avg_session_uptime": { 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 82 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: "mdthresh_evicted": { 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: "session_count": { 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: "session_remove": { 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: "sessions_open": { 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: "sessions_stale": { 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: "total_load": { 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.677 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: "purge_queue": { 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executed": { 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing": { 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.678 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_high_water": { 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_ops": { 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_ops_high_water": { 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_item_in_journal": { 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.3986d685fcc5317d5063bf3be95b3875a27bc25b": { 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:32.679 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-01-13T18:00:32.680 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 116 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 690 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 690, 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3426733 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 690, 2024-01-13T18:00:32.682 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 226995941 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2999946 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.683 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 691 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.684 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.685 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 691 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 691, 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1574971903 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.686 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.687 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 691 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 691, 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6724253 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 691, 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4993 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-01-13T18:00:32.688 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 691, 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 470991601 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48029696 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 32202752 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.689 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15826944 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277030155 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.690 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 249700 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.691 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70847377 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.692 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277030155 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39583 2024-01-13T18:00:32.693 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.694 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71057494 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.695 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184686770 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.696 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.697 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71165774 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29449, 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65932346 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-01-13T18:00:32.699 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1482, 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 764078979 2024-01-13T18:00:32.700 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-01-13T18:00:32.701 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 50 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-01-13T18:00:32.702 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 700 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 700, 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3451857 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 700, 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 112997387 2024-01-13T18:00:32.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 146 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 701 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 701 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 701, 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1389967901 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.707 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 701 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-01-13T18:00:32.708 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 701, 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6772403 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 701, 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5072 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 701, 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 294993190 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:32.709 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46972928 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31580160 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15392768 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.710 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277030155 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 249700 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.712 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70847377 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:32.713 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277030155 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39583 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.714 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.715 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71057494 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-01-13T18:00:32.716 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184686770 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.718 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71165774 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-01-13T18:00:32.719 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-01-13T18:00:32.720 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29853, 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 59425919 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-01-13T18:00:32.721 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1518, 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 477647850 2024-01-13T18:00:32.722 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.e3a6e53c614c51f88d28836624fb3fe0c21bc669": { 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 187 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.724 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 821 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4453576 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:32.725 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2463 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 179996781 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.726 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 821 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4394524 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.727 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5061 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 432221348 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.728 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1999963 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 823 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 823, 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2120962059 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-01-13T18:00:32.729 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1050 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-01-13T18:00:32.731 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 50094080 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 40484864 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9609216 2024-01-13T18:00:32.732 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277031217 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 249270 2024-01-13T18:00:32.733 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.734 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70846745 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:32.735 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277031217 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 37180 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.736 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.737 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71058835 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-01-13T18:00:32.738 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184687478 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.739 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.740 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71165066 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.741 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 37037, 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 127781996 2024-01-13T18:00:32.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-01-13T18:00:32.743 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1773, 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 668200989 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-01-13T18:00:32.744 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.745 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2871296 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.746 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1712128 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1572864 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:32.747 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.748 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:32.752 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4513792 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:32.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 133149 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.754 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 52491 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 368, 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 86312211 2024-01-13T18:00:32.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 354, 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 17004576 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 368, 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 399272 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 368, 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 86711483 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:32.756 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 19946 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4688 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 819 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 219 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 114, 2024-01-13T18:00:32.758 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2625789 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 312, 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 307062 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 198, 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4549281 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.759 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 49388 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11989142 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 120, 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8658636 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 120, 2024-01-13T18:00:32.760 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 381433941381 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 120, 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 141363221400 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47806629295 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46223 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:32.761 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3264299 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 230575446 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 151514 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 97216317 2024-01-13T18:00:32.762 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23252596 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 877533 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 366367333 2024-01-13T18:00:32.763 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27316913 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4621462 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869131064 2024-01-13T18:00:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 270974976 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 270827520 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146396979 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 147456 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.765 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85922922 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.766 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 602112 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.767 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 72858518 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:32.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644421917 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.770 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68608595 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:32.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57281948 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68546708 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.774 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644421917 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12637 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.775 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1404 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 102502 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 154455 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.776 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68338765 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.777 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 588 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:32.779 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27596602 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2500298 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25455556 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.780 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.781 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:32.782 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 588 2024-01-13T18:00:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27596602 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2500298 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:32.785 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25455556 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1771104 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:32.786 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305692672 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:32.787 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2445312 2024-01-13T18:00:32.788 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1429504 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1290240 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.790 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:32.791 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:32.792 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:32.793 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3805184 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 663552 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 172087 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.796 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 32, 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 79855 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.797 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 299, 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 75387175 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 280, 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15164596 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 299, 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 364830 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.798 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 299, 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 75752005 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1051 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.799 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6936 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4427 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 793 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 226 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 132, 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4121327 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 344, 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 290668 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:32.801 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 212, 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5482066 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 122989 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12245936 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.802 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 116, 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9482861 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 114, 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 250335816695 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 116, 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 106544856263 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 402, 2024-01-13T18:00:32.803 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31280878293 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 402, 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 38256 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3386472 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 268883522 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.804 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 131651 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 107990711 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 19027015 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 286360 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 411598348 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22982817 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:32.806 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2362947 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869131064 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236306432 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236003328 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146396979 2024-01-13T18:00:32.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 303104 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.808 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85958706 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.809 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 20480 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73396174 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644690302 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.812 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.813 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68340210 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.814 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57305804 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.815 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68522852 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644690302 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 90943 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 151573 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.819 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68098862 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:32.820 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:32.821 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 36 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 155 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.822 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2429440 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 853747681 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1052 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 52874123 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-01-13T18:00:32.823 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 216309565 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5305339 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1052 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:32.824 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4725399 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3995253 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18091924 2024-01-13T18:00:32.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7873934 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:32.826 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 17114099 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2429440 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 830350418 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.827 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 40274790 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 195200213 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:32.828 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 590368 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305086464 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-01-13T18:00:32.829 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.830 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2150400 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:32.831 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:32.832 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1253376 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1114112 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:32.833 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:32.834 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.835 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:32.837 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3334144 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:32.838 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 659456 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 162559 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.839 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 16, 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18246 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.840 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 256, 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68542564 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 253, 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7837377 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 256, 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312183 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 256, 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68854747 2024-01-13T18:00:32.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1833 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 797 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.842 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4578 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 579 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:32.843 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 203 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 89, 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1434832 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 251, 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277634 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 162, 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7703863 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.844 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:32.845 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.845 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.845 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:32.845 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:32.845 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 97904 2024-01-13T18:00:32.845 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.847 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:32.847 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:32.847 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8703141 2024-01-13T18:00:32.847 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.847 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:32.847 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 110, 2024-01-13T18:00:32.847 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8602667 2024-01-13T18:00:32.847 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.847 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 108, 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 222455920521 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 110, 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100043610950 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 329, 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 29994972983 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 329, 2024-01-13T18:00:32.848 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 29840 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2960420 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 126198465 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100589 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.849 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 123117978 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23158976 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 286465 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.850 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 284186566 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 26423036 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2758971 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:32.851 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869131064 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236371968 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 234864640 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146396979 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1507328 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.852 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85959942 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.854 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73403130 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:32.855 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644699570 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.857 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.857 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.857 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.857 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.857 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.857 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.857 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.857 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.857 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.857 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68330942 2024-01-13T18:00:32.858 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57306628 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.859 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.860 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.861 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68522028 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644699570 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.862 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13779 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 66140 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 150193 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68101998 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.864 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:32.865 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 29 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.866 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57739665 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3595619 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41679018 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.868 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.869 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57739665 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3595619 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:32.871 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41679018 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.872 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305082368 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:32.873 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:32.874 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 872448 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:32.875 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 733184 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:32.876 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.877 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.878 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:32.879 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.880 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2084864 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 679936 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4956 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.882 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 163, 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 59948726 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 146, 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 16535494 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 163, 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 248856 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:32.883 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 163, 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 60197582 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.884 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10293 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 339 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:32.885 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 208 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 86, 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1146255 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 150, 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 401656 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 64, 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 295403 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13893624 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 47, 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4523639 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 47, 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 505607230825 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:32.887 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 47, 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73941132523 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 408422 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22717 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 263704 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:32.888 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 213784114 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65696 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 91876591 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10905401 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 288893 2024-01-13T18:00:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 330752713 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15936565 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1543842 2024-01-13T18:00:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869131064 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 267829248 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 267083776 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146396979 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.891 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 745472 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.892 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85960645 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73422907 2024-01-13T18:00:32.894 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644704842 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.895 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68325670 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:32.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57307097 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68521559 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644704842 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28671 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 69630 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 146087 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68082450 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 36 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.904 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:32.905 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 655036 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.908 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 655036 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:32.910 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305102848 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-01-13T18:00:32.911 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.913 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 843776 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 704512 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:32.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.915 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.916 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:32.917 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.918 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2039808 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.919 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 675840 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 291344 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.920 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3304 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.921 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 156, 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48681916 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9968598 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 156, 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 194416 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:32.922 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 156, 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48876332 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1515 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.923 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6000 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 351 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:32.924 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 229 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 92, 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 992745 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 154, 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 254332 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 62, 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322724 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:32.925 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 143030 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3075809 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 38, 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3035162 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:32.926 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 36, 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 257135987508 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 38, 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68944724050 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 260, 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 424608 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 260, 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25874 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:32.927 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 245251 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 165337236 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 75649 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 111010155 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.928 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11608510 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 287145 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 954 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 291314506 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:32.929 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14007759 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1719786 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869112785 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 268812288 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 268378112 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.930 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146375475 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 434176 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.931 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85958981 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.932 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.933 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73420475 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.934 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644692360 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.936 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68338152 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57305987 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.937 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68522669 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.939 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644692360 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.940 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4116 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 86452 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 150949 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.941 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68097803 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.943 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5507203 2024-01-13T18:00:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 802295 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5400727 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:32.945 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.946 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.947 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.948 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5507203 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 802295 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:32.949 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5400727 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305098752 2024-01-13T18:00:32.950 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:32.951 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1142784 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.952 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:32.953 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 782336 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 643072 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:32.954 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:32.956 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:32.958 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1855488 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 675840 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:32.959 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 221317 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:32.960 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2630 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 141, 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45715297 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 138, 2024-01-13T18:00:32.961 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7979279 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 141, 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 150583 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 141, 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45865880 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1619 2024-01-13T18:00:32.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 19820 2024-01-13T18:00:32.963 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 315 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 232 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 85, 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 702167 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 134, 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 261050 2024-01-13T18:00:32.964 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 49, 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 197285 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 105918 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6255152 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.965 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2586147 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 31, 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 384331936905 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 49316615597 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:32.966 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 374530 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25750 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 327643 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 171784533 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:32.967 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 77342 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 139346545 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12757413 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 288879 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.968 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 562 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 330513364 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14768190 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3843210 2024-01-13T18:00:32.969 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869112785 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 235470848 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 235012096 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146375475 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.970 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 458752 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.971 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85959164 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73424388 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.974 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644693732 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68336780 2024-01-13T18:00:32.976 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57306109 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.977 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.978 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68522547 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.979 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644693732 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:32.980 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12334 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 79488 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 150754 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68095372 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.982 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.985 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:32.986 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.987 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.989 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:32.990 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305098752 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.991 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1306624 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:32.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 950272 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 811008 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.994 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:32.995 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:32.996 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.997 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2187264 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1261568 2024-01-13T18:00:32.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.000 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6192 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 182, 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 51702174 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.001 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 168, 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13343239 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 182, 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 140291 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 182, 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 51842465 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.003 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4598 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 336 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 82, 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 917388 2024-01-13T18:00:33.004 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 124, 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 216534 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 42, 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 575245 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2304282 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29, 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2502222 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29, 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73842632950 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29, 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 43116336459 2024-01-13T18:00:33.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 399483 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27939 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 204569 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:33.007 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 223172164 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 101147 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 61107872 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12287505 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.008 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 878892 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 624 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 299133366 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14343116 2024-01-13T18:00:33.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1997669 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869112785 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236371968 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 235012096 2024-01-13T18:00:33.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146375475 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1359872 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.011 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85958298 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:33.012 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73412966 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:33.014 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644687238 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.015 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.016 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68343274 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.017 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57305532 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.018 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68523124 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.020 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644687238 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2794 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.021 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12577 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 86643 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 150927 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.022 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68091501 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.024 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2414 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33718376 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 12, 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6164315 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28706374 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.027 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.028 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:33.029 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2414 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33718376 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 12, 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6164315 2024-01-13T18:00:33.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28706374 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:33.031 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305684480 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:33.032 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:33.033 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1155072 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.034 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 851968 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 712704 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.035 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:33.036 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.037 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:33.038 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.039 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:33.040 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1937408 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1257472 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 7, 2024-01-13T18:00:33.041 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 235357 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:33.042 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 7, 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28704 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 158, 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 62988811 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 151, 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9821973 2024-01-13T18:00:33.043 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 158, 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 104821 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 158, 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 63093632 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:33.044 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1620 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.045 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4711 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 600 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 267 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 112, 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2282624 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.046 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 173, 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 276696 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 61, 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1650044 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 64942 2024-01-13T18:00:33.047 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1768935 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 18, 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1529785 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 18, 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 117377432344 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:33.048 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 18, 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28847156163 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 361554 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28789 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 186811 2024-01-13T18:00:33.049 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 207469522 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 83659 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 112757860 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:33.050 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10792154 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 877086 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 726 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 333014629 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:33.051 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12652412 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2204725 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869112785 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236371968 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.052 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 235020288 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146375475 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1351680 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:33.053 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85942577 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 131072 2024-01-13T18:00:33.054 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 126976 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.055 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73174735 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:33.056 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644569334 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:33.058 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68461178 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.059 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57295051 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.060 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.061 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68533605 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.062 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644569334 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4187 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6978 2024-01-13T18:00:33.063 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 97700 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 152134 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:33.064 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68201347 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.066 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 115 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 115, 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 63602373 2024-01-13T18:00:33.067 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 265051 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 117, 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27726209 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 115, 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 56455023 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:33.068 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 80 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 80, 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12538754 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 265051 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 80, 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11515098 2024-01-13T18:00:33.069 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 80, 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9412903 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 30 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 30, 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 29112693 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.070 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 30, 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12776326 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 30, 2024-01-13T18:00:33.071 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27222020 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 21950926 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.072 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 7, 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3434785 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 19820100 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:33.073 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305680384 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": [ 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:33.074 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 1, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 1, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 1, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 1781760, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 1781760, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:33.075 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 2, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 2.450439524182002e-06, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 394, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 598016, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 590368, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 590368, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 1771104, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 219, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 2473984 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:33.076 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 32, 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 32, 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 2, 2024-01-13T18:00:33.077 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 98304, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 98304, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 22, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 1.3519698427444382e-07, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:33.078 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 3094, 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 3094, 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 9282, 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 48, 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 16384 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.079 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 64, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 64, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 3, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-01-13T18:00:33.080 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.081 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 8, 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 8, 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 4, 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:33.082 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-01-13T18:00:33.083 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": { 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: "mirroring_by_pool": [ 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: false 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_images_by_pool": [ 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pools": 1 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "report_id": "ece1ff4f-b467-425a-b891-1b2b4dc63da0", 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "report_timestamp": "2024-01-13T18:00:32.268170", 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "report_version": 1, 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_stats": { 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "6.15.5" 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "rook": { 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster": { 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "external-mode": null, 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "allow-multiple-per-node": null, 2024-01-13T18:00:33.085 INFO:tasks.workunit.client.0.smithi084.stdout: "count": null, 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "max-id": null, 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "pvc": { 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "stretch": { 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "network": { 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "provider": null 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "storage": { 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "device-set": { 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "non-portable": null, 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "portable": null, 2024-01-13T18:00:33.086 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: "csi": { 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes": { 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: "node": { 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes-total": null, 2024-01-13T18:00:33.087 INFO:tasks.workunit.client.0.smithi084.stdout: "with-ceph-daemons": null, 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-cephfs-plugin": null, 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-nfs-plugin": null, 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-rbd-plugin": null 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: "storage-class": { 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket": null, 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs": null, 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: "nfs": null, 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": null, 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-01-13T18:00:33.088 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: "services": {}, 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_per_pg": [ 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.089 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.415621+0000", 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.415621+0000", 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.416080+0000", 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.090 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.091 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3f", 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.092 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:45:40.991399+0000", 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.095 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.096 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.398476+0000", 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.398476+0000", 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.398891+0000", 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.098 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3e", 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.099 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:05:39.892184+0000", 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.102 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.103 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.399578+0000", 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.399578+0000", 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.399839+0000", 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.105 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3d", 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:36:22.906393+0000", 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.109 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.110 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.411056+0000", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.411056+0000", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.411528+0000", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.112 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3c", 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:13:24.718807+0000", 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.413825+0000", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.413825+0000", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.415953+0000", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3b", 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:04:08.326020+0000", 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.123 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.124 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.399358+0000", 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.399358+0000", 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.399699+0000", 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:33.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.126 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3a", 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:40:18.403109+0000", 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.130 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.131 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.412816+0000", 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.412816+0000", 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.413121+0000", 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:33.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.39", 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:40:05.587005+0000", 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.137 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.393317+0000", 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.393317+0000", 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.393602+0000", 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:33.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.139 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.38", 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.140 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:14:00.225985+0000", 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.143 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.144 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.416138+0000", 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.416138+0000", 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.416421+0000", 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:33.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.146 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.37", 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:10:51.751719+0000", 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.150 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.151 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.397557+0000", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.397557+0000", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.397837+0000", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.153 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.36", 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:38:02.359081+0000", 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.157 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:07.184825+0000", 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:07.184825+0000", 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.159 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.35", 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 25, 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.160 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:37:56.619880+0000", 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.163 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.164 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.401390+0000", 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.401390+0000", 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.401738+0000", 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.166 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.34", 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:10:08.882123+0000", 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:33.170 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.171 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.410478+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.410478+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.410693+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:33.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.33", 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.173 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:54:26.505663+0000", 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.177 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.399266+0000", 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.399266+0000", 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.399587+0000", 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.179 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.32", 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:45:41.896344+0000", 2024-01-13T18:00:33.180 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.183 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.184 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:07.183855+0000", 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:07.183855+0000", 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.186 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.31", 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 25, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:09:01.049040+0000", 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.187 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.190 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.411947+0000", 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.411947+0000", 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.412247+0000", 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.191 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.192 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.30", 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.193 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:05:19.184972+0000", 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.196 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.197 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.411559+0000", 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.411559+0000", 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.411858+0000", 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:33.198 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.199 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2f", 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:00:40.870815+0000", 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.203 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.204 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.408820+0000", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.408820+0000", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.409078+0000", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.205 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.206 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2e", 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:30:37.097173+0000", 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.210 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.414182+0000", 2024-01-13T18:00:33.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.414182+0000", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.414485+0000", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:33.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2d", 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.213 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:08:50.844685+0000", 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.217 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.839344+0000", 2024-01-13T18:00:33.218 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.839344+0000", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.839635+0000", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:33.219 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 4, 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 4, 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.220 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1f", 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:41:18.168942+0000", 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 554, 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.221 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 4, 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'4" 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.224 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.403390+0000", 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.403390+0000", 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.403720+0000", 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:33.225 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.226 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1e", 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.227 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:38:09.594828+0000", 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.228 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.230 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.231 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.846375+0000", 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.846375+0000", 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.846725+0000", 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.232 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.233 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1e", 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:06:04.006535+0000", 2024-01-13T18:00:33.234 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.237 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'1" 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.238 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.394880+0000", 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.394880+0000", 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.395186+0000", 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:33.239 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.240 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1f", 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:02:59.539263+0000", 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.243 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.244 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.845229+0000", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.845229+0000", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.845520+0000", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.246 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1d", 2024-01-13T18:00:33.247 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:08:01.977549+0000", 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:33.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.251 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.399689+0000", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.399689+0000", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.400143+0000", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.254 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1c", 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:32:04.518468+0000", 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.258 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.259 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.843616+0000", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.843616+0000", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.843954+0000", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.261 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1c", 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:37:08.466053+0000", 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.262 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:33.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.265 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.266 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.398793+0000", 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.398793+0000", 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.399242+0000", 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:33.267 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.268 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1d", 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:05:43.194645+0000", 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.269 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.273 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.838444+0000", 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.838444+0000", 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.838743+0000", 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:33.274 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.275 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1b", 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.276 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:48:37.841281+0000", 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.277 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.279 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'1" 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.280 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.400621+0000", 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.400621+0000", 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.401094+0000", 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:33.281 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.282 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1a", 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.283 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:15:46.371336+0000", 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.284 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.286 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.287 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.831491+0000", 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.831491+0000", 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.832810+0000", 2024-01-13T18:00:33.288 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:33.289 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1a", 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.290 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:50:10.505869+0000", 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.291 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'1" 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.294 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.407858+0000", 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.407858+0000", 2024-01-13T18:00:33.295 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.408148+0000", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:33.296 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1b", 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.297 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:35:47.284096+0000", 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:33.302 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.842487+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.842487+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.843139+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:33.303 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.19", 2024-01-13T18:00:33.304 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:28:01.688683+0000", 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.305 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.306 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.308 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.309 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.401490+0000", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.401490+0000", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.401772+0000", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.310 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.311 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.18", 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:32:13.633488+0000", 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.312 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.313 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.315 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.316 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.841820+0000", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.841820+0000", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.842527+0000", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.317 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.318 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.18", 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:40:02.120533+0000", 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.319 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.320 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.322 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.323 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.393657+0000", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.393657+0000", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.393987+0000", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.324 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.325 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.19", 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:24:44.818236+0000", 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.329 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.330 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.843290+0000", 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.843290+0000", 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.843560+0000", 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.332 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.17", 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.333 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:12:58.012752+0000", 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.337 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.412519+0000", 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.412519+0000", 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.412880+0000", 2024-01-13T18:00:33.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.339 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.16", 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.340 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:40:03.956715+0000", 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.344 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.841409+0000", 2024-01-13T18:00:33.345 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.841409+0000", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841704+0000", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:33.346 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.16", 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.347 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:56:02.964249+0000", 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.351 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.403108+0000", 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.403108+0000", 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.403381+0000", 2024-01-13T18:00:33.352 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.353 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.17", 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:55:07.654474+0000", 2024-01-13T18:00:33.354 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.355 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.357 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.358 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.835169+0000", 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.835169+0000", 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.835474+0000", 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.359 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 3, 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.360 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 3, 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.15", 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-01-13T18:00:33.361 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:02:02.178682+0000", 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 90, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.362 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.363 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 4, 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'3" 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.365 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.406352+0000", 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.406352+0000", 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.407252+0000", 2024-01-13T18:00:33.366 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.367 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.14", 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.368 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:21:50.223964+0000", 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.369 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.370 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.371 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.372 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.836231+0000", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.836231+0000", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.836500+0000", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.373 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 9, 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 9, 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.14", 2024-01-13T18:00:33.374 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 25, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:40:58.818088+0000", 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 2324, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 12, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 4, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 4, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.377 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 9, 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 6 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "62'9" 2024-01-13T18:00:33.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:33.379 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:06.533641+0000", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:06.533641+0000", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.381 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.15", 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 10, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:42:07.849879+0000", 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.384 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.386 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.840803+0000", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.840803+0000", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841243+0000", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.387 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.388 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.13", 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:02:14.255922+0000", 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 34, 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.391 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 6 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.392 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.393 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.408736+0000", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.408736+0000", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.409006+0000", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.395 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.12", 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:10:11.734133+0000", 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.396 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.397 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.400 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.840845+0000", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.840845+0000", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841162+0000", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.401 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.402 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.12", 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:56:48.776768+0000", 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.403 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.404 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.405 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.410388+0000", 2024-01-13T18:00:33.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.410388+0000", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.414263+0000", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:33.408 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.13", 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.409 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:55:00.346625+0000", 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.834531+0000", 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.834531+0000", 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.834846+0000", 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:33.414 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.415 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.11", 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.416 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:12:41.632590+0000", 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.417 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.420 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:07.183677+0000", 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:07.183677+0000", 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:33.421 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.422 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.10", 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 25, 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.423 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:03:46.666388+0000", 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.424 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.426 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.427 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.831252+0000", 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.831252+0000", 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.831518+0000", 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.428 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 8, 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.429 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 8, 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.10", 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 24, 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.430 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:42:53.797821+0000", 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 12, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 4, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 4, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.432 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 4, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 12, 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'8" 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.434 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.414540+0000", 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.414540+0000", 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.414840+0000", 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.435 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.436 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.11", 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:24:57.534623+0000", 2024-01-13T18:00:33.437 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.440 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:33.441 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.831126+0000", 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.831126+0000", 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.831411+0000", 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.442 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.443 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.f", 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:12:48.869393+0000", 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 22, 2024-01-13T18:00:33.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:33.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'1" 2024-01-13T18:00:33.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:33.448 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.408618+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.408618+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.408885+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:33.449 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.e", 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.450 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:18:38.241218+0000", 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.451 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.453 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.454 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.310557+0000", 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.310557+0000", 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.310836+0000", 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.455 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.456 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.2", 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:10:08.926746+0000", 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.457 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.458 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.460 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.461 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.832100+0000", 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.832100+0000", 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.832399+0000", 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.462 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.4", 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:01:50.555635+0000", 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.464 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.465 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.466 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.467 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.468 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.402379+0000", 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.402379+0000", 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.402741+0000", 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:33.469 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.470 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.5", 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:30:51.621102+0000", 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.474 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:33.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.547105+0000", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.547105+0000", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.547393+0000", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.476 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.477 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.4", 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:28:35.317481+0000", 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.836161+0000", 2024-01-13T18:00:33.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.836161+0000", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.836469+0000", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:33.483 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.2", 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.484 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:00:00.583677+0000", 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.488 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.411086+0000", 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.411086+0000", 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.411383+0000", 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.490 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3", 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:29:49.851426+0000", 2024-01-13T18:00:33.491 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.494 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.495 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.310540+0000", 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.310540+0000", 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.310768+0000", 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:33.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.497 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.7", 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:08:47.529142+0000", 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.499 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.501 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.395625+0000", 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.395625+0000", 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.395912+0000", 2024-01-13T18:00:33.502 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.503 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.0", 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.504 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:45:28.565536+0000", 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.506 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.507 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.508 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.839440+0000", 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.839440+0000", 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.839719+0000", 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.509 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.510 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1", 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:17:50.836804+0000", 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.513 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.514 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:33.515 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.182314+0000", 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.182314+0000", 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.182636+0000", 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:33.516 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.517 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.5", 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:32:50.369684+0000", 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.397326+0000", 2024-01-13T18:00:33.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.397326+0000", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.397651+0000", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:33.523 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.524 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2", 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:24:26.902155+0000", 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.528 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.529 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.842172+0000", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.842172+0000", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.842492+0000", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.530 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.531 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.3", 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:58:24.249555+0000", 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.535 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 19, 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.536 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:27.209293+0000", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:27.209293+0000", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:27.209773+0000", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:56:59.530229+0000", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:56:59.530229+0000", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 56, 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.537 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:56:59.530229+0000", 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 148, 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 55, 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 148, 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.538 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "1.0", 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 348, 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:45:29.626217+0000", 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 590368, 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 1771104, 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-01-13T18:00:33.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 6, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 394, 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 584, 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 219, 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 2416 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.542 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "65'148" 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.543 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.547115+0000", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.547115+0000", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.547394+0000", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.544 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.545 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.6", 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:38:56.099495+0000", 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:33.550 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.403022+0000", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.403022+0000", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.403318+0000", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.551 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.552 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1", 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:13:06.307215+0000", 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.555 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.556 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:33.557 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.844443+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.844443+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.844962+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:33.558 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.0", 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.559 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:13:21.802704+0000", 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.560 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.561 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.563 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.310046+0000", 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.310046+0000", 2024-01-13T18:00:33.564 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.310298+0000", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.3", 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.566 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:32:39.783518+0000", 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.567 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.568 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:33.571 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.845158+0000", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.845158+0000", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.845469+0000", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.572 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.5", 2024-01-13T18:00:33.573 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:37:46.603258+0000", 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.574 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.575 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.577 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.395105+0000", 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.395105+0000", 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.395393+0000", 2024-01-13T18:00:33.578 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:33.579 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.4", 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.580 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:45:12.100528+0000", 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.585 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.180705+0000", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.180705+0000", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.180992+0000", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.586 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.0", 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:28:08.013633+0000", 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.591 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.840768+0000", 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.840768+0000", 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841642+0000", 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.594 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.6", 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:03:26.813924+0000", 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "60'1" 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.599 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.414307+0000", 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.414307+0000", 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.414477+0000", 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:33.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.7", 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:38:41.330284+0000", 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.310135+0000", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.310135+0000", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.310494+0000", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.608 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.1", 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:13:06.215978+0000", 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:33.612 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.613 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.839541+0000", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.839541+0000", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.839829+0000", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.615 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.7", 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:52:18.758870+0000", 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.619 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.400836+0000", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.400836+0000", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.401139+0000", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.622 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.6", 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:15:29.881505+0000", 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.844002+0000", 2024-01-13T18:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.844002+0000", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.844748+0000", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.8", 2024-01-13T18:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:14:57.868739+0000", 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.633 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.408807+0000", 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.408807+0000", 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.409079+0000", 2024-01-13T18:00:33.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:33.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.636 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.9", 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:53:09.994807+0000", 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.640 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:33.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.840078+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.840078+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841464+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:33.642 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.9", 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.643 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:39:59.597495+0000", 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.647 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.407988+0000", 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.407988+0000", 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.408303+0000", 2024-01-13T18:00:33.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.649 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.8", 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.650 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:45:25.570947+0000", 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.654 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.841192+0000", 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.841192+0000", 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841581+0000", 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:33.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.656 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.a", 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.657 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:39:05.602781+0000", 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.661 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.401769+0000", 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.401769+0000", 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.402047+0000", 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.663 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.b", 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:32:35.369119+0000", 2024-01-13T18:00:33.664 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.667 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.668 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.844286+0000", 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.844286+0000", 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.844613+0000", 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.670 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.b", 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:27:48.244809+0000", 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.671 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.674 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.675 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.398572+0000", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.398572+0000", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.399084+0000", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.677 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.a", 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:18:41.057728+0000", 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.678 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.681 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.682 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.837168+0000", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.837168+0000", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.837432+0000", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.684 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.c", 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:37:30.125718+0000", 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.688 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.689 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.415759+0000", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.415759+0000", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.416032+0000", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.691 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.d", 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:11:24.483081+0000", 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.695 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.696 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.833658+0000", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.833658+0000", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.834302+0000", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.698 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.d", 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:13:18.505657+0000", 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 70, 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:33.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'1" 2024-01-13T18:00:33.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.402128+0000", 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.402128+0000", 2024-01-13T18:00:33.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.402650+0000", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:33.704 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.c", 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.705 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:02:28.745789+0000", 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.709 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:06.533628+0000", 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:06.533628+0000", 2024-01-13T18:00:33.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.711 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.e", 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.712 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 32, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:46:09.651787+0000", 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 1, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-01-13T18:00:33.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.716 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.414097+0000", 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.414097+0000", 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.414378+0000", 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:33.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.718 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.f", 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:45:12.430007+0000", 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.722 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.723 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.396928+0000", 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.396928+0000", 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.397227+0000", 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.724 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.725 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.20", 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.726 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:59:55.499543+0000", 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.730 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.396585+0000", 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.396585+0000", 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.396849+0000", 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:33.731 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.732 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.21", 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.733 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:39:32.529315+0000", 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.736 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.737 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.403041+0000", 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.403041+0000", 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.403640+0000", 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.738 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.739 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.22", 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:11:37.683734+0000", 2024-01-13T18:00:33.740 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.743 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:33.744 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:06.534533+0000", 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:06.534533+0000", 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.745 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.746 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.23", 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 10, 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:13:20.351015+0000", 2024-01-13T18:00:33.747 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.750 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.751 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.401546+0000", 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.401546+0000", 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.401852+0000", 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.753 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.24", 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.754 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:25:50.041002+0000", 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.757 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.758 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.395306+0000", 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.395306+0000", 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.395592+0000", 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:33.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.760 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.25", 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.761 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:06:42.102077+0000", 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.765 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.409345+0000", 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.409345+0000", 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.409861+0000", 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.767 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.26", 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.768 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:00:44.773057+0000", 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.771 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.772 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:06.534242+0000", 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:06.534242+0000", 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:33.774 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.27", 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 25, 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:28:19.184443+0000", 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.775 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.778 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.779 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.402233+0000", 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.402233+0000", 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.402590+0000", 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.780 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.781 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.28", 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.782 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:48:51.046376+0000", 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.783 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.786 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.403093+0000", 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.403093+0000", 2024-01-13T18:00:33.787 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.403312+0000", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.788 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.29", 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.789 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:27:24.003935+0000", 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.790 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.793 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.411192+0000", 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.411192+0000", 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.411533+0000", 2024-01-13T18:00:33.794 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.795 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2a", 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.796 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:31:15.289987+0000", 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.797 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.798 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.799 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.800 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.409319+0000", 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.409319+0000", 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.409594+0000", 2024-01-13T18:00:33.801 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.802 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2b", 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.803 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:21:11.322832+0000", 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.804 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.807 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.399952+0000", 2024-01-13T18:00:33.808 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.399952+0000", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.400265+0000", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:33.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2c", 2024-01-13T18:00:33.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:39:04.725745+0000", 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.811 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.812 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.814 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_per_pool": [ 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 24, 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 8, 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 4, 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.817 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-01-13T18:00:33.818 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 24 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 192, 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.819 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 64, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 3, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:33.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 192 2024-01-13T18:00:33.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 3, 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 148, 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 1, 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 3, 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 148, 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 1, 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 590368, 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 1771104, 2024-01-13T18:00:33.824 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.825 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 6, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 394, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 584, 2024-01-13T18:00:33.826 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 219, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 2416 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 1781760, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 1771104, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-01-13T18:00:33.827 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 3 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 96, 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 42, 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 32, 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 42, 2024-01-13T18:00:33.828 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 2, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 3094, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 66, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 22, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 22, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 14, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 1, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 48, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 16 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-01-13T18:00:33.831 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 98304, 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 9282, 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 96 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-01-13T18:00:33.832 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 105, 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": 4, 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_by_class": { 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: "ssd": { 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 765517758464, 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 2442526720, 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_bytes": 2442526720, 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_ratio": 0.003180537838488817 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 765517758464, 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 2442526720 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.833 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-01-13T18:00:33.834 INFO:tasks.workunit.client.0.smithi084.stdout:Device report is generated separately. To see it run 'ceph telemetry show-device'. 2024-01-13T18:00:33.834 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry show-device 2024-01-13T18:00:33.835 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.835 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.835 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.835 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-01-13T18:00:33.835 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/4251974545' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/4251974545' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.838 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.838 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.838 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.838 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-01-13T18:00:33.838 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/4251974545' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-01-13T18:00:33.838 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/4251974545' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-01-13T18:00:33.838 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.838 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.838 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.838 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.838 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.839 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.841 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:33 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.842 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/4251974545' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/4251974545' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.843 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.845 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.845 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.845 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.845 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.845 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.845 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-01-13T18:00:33.845 INFO:tasks.workunit.client.0.smithi084.stdout: "a2b2d4dc-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:33.845 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_a2b354e8-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "20240113-175701": { 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "a2b2d4dc-b23d-11ee-909d-0cc47a8fd751", 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Jan 13 17:57:01 2024 UTC", 2024-01-13T18:00:33.846 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1705168621 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-01-13T18:00:33.847 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-01-13T18:00:33.848 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.849 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 32481125 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 53452353 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.851 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.852 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.853 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3606, 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3625, 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3588 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 105, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 436064233, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2128683066, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 6851839327, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 35647816531, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-01-13T18:00:33.855 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 53973, 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 53976, 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 27, 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 6961 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 53973, 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 53976 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.856 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-4.18.0-532.el8.x86_64] (local build)", 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.857 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Jan 13 17:57:01 2024 UTC", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-01-13T18:00:33.858 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.859 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 27 Celsius", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 436,064,233 [223 TB]", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,128,683,066 [1.08 PB]", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 6,851,839,327", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 35,647,816,531", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 105", 2024-01-13T18:00:33.860 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 53,973", 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 53,976", 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 6,961", 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-4.18.0-532.el8.x86_64", 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.861 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 27 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: "a2b45f96-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_a2b4cc9c-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: "20240113-175703": { 2024-01-13T18:00:33.862 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "a2b45f96-b23d-11ee-909d-0cc47a8fd751", 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Jan 13 17:57:03 2024 UTC", 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1705168623 2024-01-13T18:00:33.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.864 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-01-13T18:00:33.865 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.866 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 34122724 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.867 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 54939479 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-01-13T18:00:33.868 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-01-13T18:00:33.869 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-01-13T18:00:33.870 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3679, 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3697, 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3661 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-01-13T18:00:33.871 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 1, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 481777854, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2236266868, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7949654242, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 38141429385, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 52662, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 54648, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 24, 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 273 2024-01-13T18:00:33.872 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.873 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-01-13T18:00:33.873 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 52662, 2024-01-13T18:00:33.875 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-01-13T18:00:33.875 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 54648 2024-01-13T18:00:33.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.875 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-01-13T18:00:33.875 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-01-13T18:00:33.875 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-01-13T18:00:33.875 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.875 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-01-13T18:00:33.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-4.18.0-532.el8.x86_64] (local build)", 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.876 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Jan 13 17:57:03 2024 UTC", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-01-13T18:00:33.877 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.878 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 24 Celsius", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 481,777,854 [246 TB]", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,236,266,868 [1.14 PB]", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,949,654,242", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 38,141,429,385", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 1", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 52,662", 2024-01-13T18:00:33.879 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 54,648", 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 273", 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-4.18.0-532.el8.x86_64", 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:33.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.881 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-01-13T18:00:33.881 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 24 2024-01-13T18:00:33.881 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.881 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-01-13T18:00:33.881 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.881 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.881 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.881 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.881 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.881 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.881 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-01-13T18:00:33.882 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry show-all 2024-01-13T18:00:33.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.883 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.884 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.884 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.884 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.884 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:33.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.885 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.886 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.886 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:33.886 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:33.886 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:33.886 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:33.886 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:33.886 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.886 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:33 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:33.894 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-01-13T18:00:33.894 INFO:tasks.workunit.client.0.smithi084.stdout: "device_report": { 2024-01-13T18:00:33.894 INFO:tasks.workunit.client.0.smithi084.stdout: "a2b2d4dc-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:33.894 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_a2b354e8-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:33.894 INFO:tasks.workunit.client.0.smithi084.stdout: "20240113-175701": { 2024-01-13T18:00:33.894 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-01-13T18:00:33.894 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-01-13T18:00:33.894 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-01-13T18:00:33.894 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-01-13T18:00:33.894 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "a2b2d4dc-b23d-11ee-909d-0cc47a8fd751", 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Jan 13 17:57:01 2024 UTC", 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1705168621 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-01-13T18:00:33.895 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-01-13T18:00:33.896 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 32481125 2024-01-13T18:00:33.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 53452353 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.899 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-01-13T18:00:33.900 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.901 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-01-13T18:00:33.902 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3606, 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3625, 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3588 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 105, 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 436064233, 2024-01-13T18:00:33.903 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2128683066, 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 6851839327, 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 35647816531, 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 53973, 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 53976, 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 27, 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 6961 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 53973, 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 53976 2024-01-13T18:00:33.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.905 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-4.18.0-532.el8.x86_64] (local build)", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-01-13T18:00:33.906 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Jan 13 17:57:01 2024 UTC", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-01-13T18:00:33.907 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 27 Celsius", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 436,064,233 [223 TB]", 2024-01-13T18:00:33.908 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,128,683,066 [1.08 PB]", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 6,851,839,327", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 35,647,816,531", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 105", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 53,973", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 53,976", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 6,961", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-4.18.0-532.el8.x86_64", 2024-01-13T18:00:33.909 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 27 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.910 INFO:tasks.workunit.client.0.smithi084.stdout: "a2b45f96-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_a2b4cc9c-b23d-11ee-909d-0cc47a8fd751": { 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "20240113-175703": { 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "a2b45f96-b23d-11ee-909d-0cc47a8fd751", 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-01-13T18:00:33.911 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Jan 13 17:57:03 2024 UTC", 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1705168623 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-01-13T18:00:33.912 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-01-13T18:00:33.913 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 34122724 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 54939479 2024-01-13T18:00:33.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-01-13T18:00:33.916 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:33.917 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.918 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3679, 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3697, 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3661 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.919 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 1, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 481777854, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2236266868, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7949654242, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 38141429385, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 52662, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 54648, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 24, 2024-01-13T18:00:33.920 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 273 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 52662, 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 54648 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-01-13T18:00:33.921 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-4.18.0-532.el8.x86_64] (local build)", 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-01-13T18:00:33.922 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Jan 13 17:57:03 2024 UTC", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.923 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-01-13T18:00:33.924 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 24 Celsius", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 481,777,854 [246 TB]", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,236,266,868 [1.14 PB]", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,949,654,242", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 38,141,429,385", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 1", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 52,662", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 54,648", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 273", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-01-13T18:00:33.925 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-4.18.0-532.el8.x86_64", 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 24 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-01-13T18:00:33.926 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: "report": { 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer": { 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: "active": true, 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: "mode": "" 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: "channels": [ 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-01-13T18:00:33.927 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "channels_available": [ 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_available": [ 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-01-13T18:00:33.928 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_opted_in": [ 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-01-13T18:00:33.929 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "config": { 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "active_changed": [ 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "client_check_pool_perm", 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_gid", 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_uid", 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "client_quota", 2024-01-13T18:00:33.930 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "daemonize", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "keyring", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_block_size", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_cache_size", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_compression", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_log", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_write_buffer_size", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-01-13T18:00:33.931 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_journald", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_stderr", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_host", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-01-13T18:00:33.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "no_config_file", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-01-13T18:00:33.933 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_lim", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_res", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_wgt", 2024-01-13T18:00:33.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addr", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addrv", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_default_features", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_qos_exclude_ops", 2024-01-13T18:00:33.935 INFO:tasks.workunit.client.0.smithi084.stdout: "setgroup", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "setuser" 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_changed": [ 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-01-13T18:00:33.936 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_join_fs", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/allow_ptrace", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/container_init", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/migration_current", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/use_repo_digest", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ssl_server_port", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/orchestrator/orchestrator", 2024-01-13T18:00:33.937 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_ident", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_perf", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/description", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/enabled", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/organization", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-01-13T18:00:33.938 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-01-13T18:00:33.939 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-01-13T18:00:33.940 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_cache_enabled", 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_ops_log", 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_usage_log" 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "contact": null, 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "crashes": [], 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "created": "2024-01-13T17:54:38.557528Z", 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "crush": { 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_algs": { 2024-01-13T18:00:33.941 INFO:tasks.workunit.client.0.smithi084.stdout: "straw2": 3 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_sizes": { 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: "2": 1, 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: "4": 2 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_types": { 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: "1": 2, 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: "11": 1 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: "compat_weight_set": false, 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: "device_classes": [ 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: 8 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_buckets": 6, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_devices": 8, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_rules": 1, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_types": 12, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_weight_sets": 0, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "tunables": { 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "allowed_bucket_algs": 54, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_fallback_tries": 0, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_tries": 0, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_total_tries": 50, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_descend_once": 1, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_stable": 1, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_vary_r": 1, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v2_rules": 0, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v3_rules": 0, 2024-01-13T18:00:33.943 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v4_buckets": 1, 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v5_rules": 0, 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "legacy_tunables": 0, 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "minimum_required_version": "jewel", 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "optimal_tunables": 1, 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "profile": "jewel", 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables": 1, 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables2": 1, 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables3": 1, 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables5": 1, 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "straw_calc_version": 1 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "description": "upgrade test cluster", 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "fs": { 2024-01-13T18:00:33.944 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "feature_flags": { 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "enable_multiple": true, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_enabled_multiple": true 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "filesystems": [ 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "approx_ctime": "2024-01", 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer_enabled": false, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_caps": 2, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_dns": 10, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_inos": 13, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_subtrees": 2, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_allowed_features": 0, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "explicitly_allowed_features": 0, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "files": 0, 2024-01-13T18:00:33.945 INFO:tasks.workunit.client.0.smithi084.stdout: "max_mds": 1, 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "num_data_pools": 1, 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "num_in": 1, 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "num_mds": 1, 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": 2, 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_replay": 0, 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "num_up": 1, 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "snaps": 0, 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "standby_count_wanted": 0 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_mds": 1, 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "total_num_mds": 2 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_stats": { 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:33.946 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 20258816, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 417352, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 73728, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 8192, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 379, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 1435816, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 20, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 769024, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 14810384, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 20267008 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.e3a6e53c614c51f88d28836624fb3fe0c21bc669": { 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 19218432, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 336536, 2024-01-13T18:00:33.947 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 196608, 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 0, 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 303, 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 759800, 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 12, 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 750592, 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 14422384, 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 19218432 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.3986d685fcc5317d5063bf3be95b3875a27bc25b": { 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 35913728, 2024-01-13T18:00:33.948 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1245256, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 622592, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 14868480, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 955, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 6446184, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 21, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1165312, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 23681872, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 50782208 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 34545664, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1002336, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:33.949 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 15179776, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 973, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5824856, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 21, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1744384, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 23221576, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 49725440 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.e3a6e53c614c51f88d28836624fb3fe0c21bc669": { 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 44883968, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1582408, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 434176, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 7962624, 2024-01-13T18:00:33.950 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1664, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 9593136, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 23, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3246080, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 27275656, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 52846592 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 273956864, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 852280, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 950272, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1279, 2024-01-13T18:00:33.951 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5019616, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 45, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 2918400, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 262282984, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 274907136 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 239026176, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 694232, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 163840, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1206, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.952 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5519496, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 46, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 2094848, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 227834016, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 239190016 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 237813760, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 814808, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 1441792, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1127, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4378640, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 46, 2024-01-13T18:00:33.953 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 2403840, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 227332888, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 239255552 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 270090240, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 663712, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 24576, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 622592, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1086, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 3660552, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 45, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1855488, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 261002328, 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 270712832 2024-01-13T18:00:33.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 271417344, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 737512, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 278528, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1119, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4404000, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1687040, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 261705208, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 271695872 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 238092288, 2024-01-13T18:00:33.955 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1074824, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 262144, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1130, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4430232, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 46, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1682688, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 228020960, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 238354432 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 238059520, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 986048, 2024-01-13T18:00:33.956 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 8192, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 1196032, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1139, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4575392, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 45, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1617664, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 227988640, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 239255552 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 237854720, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1294696, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-01-13T18:00:33.957 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 1400832, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1162, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4181552, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 46, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1744640, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 227750248, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 239255552 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "hosts": { 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "num": 2, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mds": 2, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mgr": 2, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mon": 2, 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_osd": 2 2024-01-13T18:00:33.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "io_rate": { 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_stats_delta": { 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "stamp_delta": "12.002431", 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:33.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:33.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 182, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 278, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 40, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-01-13T18:00:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 0 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard": false, 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "license": "sharing-1-0", 2024-01-13T18:00:33.962 INFO:tasks.workunit.client.0.smithi084.stdout: "mempool": { 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.963 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.964 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.965 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.966 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213415, 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 65 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 51208, 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 210 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7944, 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 126 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.969 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.e3a6e53c614c51f88d28836624fb3fe0c21bc669": { 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:33.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:33.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:33.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 149304, 2024-01-13T18:00:33.974 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 31 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 856, 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.975 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.976 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.3986d685fcc5317d5063bf3be95b3875a27bc25b": { 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:33.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:33.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1060247, 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 350 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:33.982 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6592, 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 125 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-01-13T18:00:33.983 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5152, 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 83 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:33.984 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:33.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:33.986 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.987 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.988 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1059591, 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 340 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:33.989 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:33.990 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6592, 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 125 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5152, 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 83 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.991 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.e3a6e53c614c51f88d28836624fb3fe0c21bc669": { 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.995 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.996 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1092727, 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 329 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 440, 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 5 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.997 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6592, 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 125 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.998 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10304, 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:33.999 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:34.000 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19600, 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1344, 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 12 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8400, 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19600, 2024-01-13T18:00:34.001 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1120, 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 14 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 602112, 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 16 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 49222, 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 9098 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 131240, 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 193 2024-01-13T18:00:34.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 11020, 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 706 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 30574, 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 193 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.003 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 401202, 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 90 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2435976, 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 192 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6688, 2024-01-13T18:00:34.004 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 76 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 521280, 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 45 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 94640, 2024-01-13T18:00:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 186 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213128, 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3359 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:34.006 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:34.007 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18144, 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 162 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1680, 2024-01-13T18:00:34.008 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 15 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7776, 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 162 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18144, 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 162 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 800, 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 10 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 35363, 2024-01-13T18:00:34.009 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 43847, 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8183 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 122400, 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 180 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9228, 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 534 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26810, 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 180 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 421627, 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 96 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 40192, 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 10 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2426206, 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 177 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5368, 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 61 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.012 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 451776, 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7280, 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 18 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213128, 2024-01-13T18:00:34.013 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3359 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.014 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18032, 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 161 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1456, 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 13 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7728, 2024-01-13T18:00:34.016 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 161 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18032, 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 161 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 720, 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 9 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26571, 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 41558, 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 7833 2024-01-13T18:00:34.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 116280, 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 171 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7864, 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 481 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 24674, 2024-01-13T18:00:34.018 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 171 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 306680, 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 68 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 40192, 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 10 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2421904, 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 178 2024-01-13T18:00:34.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4488, 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 51 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 347520, 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 30 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.020 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8112, 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 22 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213640, 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3383 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.021 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.022 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18592, 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:34.023 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7968, 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18592, 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 560, 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 7 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:34.024 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 42616, 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8135 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 121720, 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 179 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9020, 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 536 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.025 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 25882, 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 179 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 282418, 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 61 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2441990, 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 185 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4136, 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 47 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 428608, 2024-01-13T18:00:34.027 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 37 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8840, 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 17 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213128, 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3359 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:34.029 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.030 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18480, 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1008, 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 9 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7920, 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18480, 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:34.031 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 640, 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4096, 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 43998, 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8276 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 123760, 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-01-13T18:00:34.032 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9288, 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 540 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26818, 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:34.033 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 894465, 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 68 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 40192, 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 10 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2444621, 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 183 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4928, 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 56 2024-01-13T18:00:34.034 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 451776, 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8944, 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 18 2024-01-13T18:00:34.035 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213384, 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3371 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:34.036 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:34.037 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18480, 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 896, 2024-01-13T18:00:34.038 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7920, 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18480, 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 165 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 640, 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.039 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 43998, 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8298 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 124440, 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 183 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9512, 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 542 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.040 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 27074, 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 183 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 836258, 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 54 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:34.041 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 40192, 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 10 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2409188, 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4928, 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 56 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.042 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 474944, 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 41 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10400, 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 20 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213640, 2024-01-13T18:00:34.043 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3383 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:34.044 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:34.045 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19376, 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 173 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 336, 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:34.046 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8304, 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 173 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19376, 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 173 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 560, 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 7 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18990, 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 4 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.047 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 44213, 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8551 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 123080, 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 181 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10500, 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 696 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.048 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 27758, 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 181 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 771722, 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.049 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2444720, 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 176 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4840, 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 55 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.050 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 451776, 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 93080, 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 187 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213128, 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3359 2024-01-13T18:00:34.051 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.052 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5832, 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12672, 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:34.053 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Blob": { 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19264, 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Buffer": { 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 672, 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_Extent": { 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8256, 2024-01-13T18:00:34.054 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_SharedBlob": { 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19264, 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 560, 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 7 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 266240, 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-01-13T18:00:34.055 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 45771, 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8783 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 127160, 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 187 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 11152, 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 700 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.056 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 29462, 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 187 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 136624, 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 27 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2424458, 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 212 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5544, 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 63 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 521280, 2024-01-13T18:00:34.058 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 45 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 96408, 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 223 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 213128, 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3359 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.059 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.060 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: "metadata": { 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 2 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 2 2024-01-13T18:00:34.061 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 2 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 2 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 2 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 2 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 3 2024-01-13T18:00:34.062 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 3 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 3 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 3 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 3 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:34.063 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 3 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 3 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 8 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 8 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-01-13T18:00:34.064 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 8 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 8 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP Thu Dec 21 12:11:59 UTC 2023": 8 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: "4.18.0-532.el8.x86_64": 8 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 8 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.065 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_objectstore": { 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": 8 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "rotational": { 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "0": 8 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "features": { 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "optional": [], 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "persistent": [ 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "kraken", 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "luminous", 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "mimic", 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap-prune", 2024-01-13T18:00:34.066 INFO:tasks.workunit.client.0.smithi084.stdout: "nautilus", 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "octopus", 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "pacific", 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "elector-pinging", 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "quincy" 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv4_addr_mons": 6, 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv6_addr_mons": 0, 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "min_mon_release": 17, 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "v1_addr_mons": 3, 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "v2_addr_mons": 3 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "organization": "ceph-qa", 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_network": false, 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 8, 2024-01-13T18:00:34.067 INFO:tasks.workunit.client.0.smithi084.stdout: "require_min_compat_client": "luminous", 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: "require_osd_release": "quincy" 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_perf_histograms": [ 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:34.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-01-13T18:00:34.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.070 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-01-13T18:00:34.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-01-13T18:00:34.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.075 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 24, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.082 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.087 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 92, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.092 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-01-13T18:00:34.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-01-13T18:00:34.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.095 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-01-13T18:00:34.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-01-13T18:00:34.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.110 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.115 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 36, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-01-13T18:00:34.118 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-01-13T18:00:34.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-01-13T18:00:34.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-01-13T18:00:34.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-01-13T18:00:34.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.123 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.135 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-01-13T18:00:34.140 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 36, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.142 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-01-13T18:00:34.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-01-13T18:00:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.145 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-01-13T18:00:34.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-01-13T18:00:34.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-01-13T18:00:34.150 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 10, 5, 0, 0, 0, 0, 0, 0, 14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 11, 2, 0, 0, 0, 0, 0, 0, 11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 21, 1, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.157 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.158 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.159 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.160 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.161 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.162 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.163 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.164 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.165 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.166 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_counters": { 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: "caps": { 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_flush_ack": { 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.167 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_flushsnap_ack": { 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_grant": { 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_revoke": { 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_trunc": { 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_commit": { 2024-01-13T18:00:34.168 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_fetch": { 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_merge": { 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_split": { 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: "exported_inodes": { 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: "forward": { 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.169 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_cap_release": { 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_caps": { 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_caps_dirty": { 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_inode_file_caps": { 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: "imported_inodes": { 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.170 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes": { 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_expired": { 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_pinned": { 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_with_caps": { 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: "load_cent": { 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: "openino_dir_fetch": { 2024-01-13T18:00:34.171 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: "process_request_cap_release": { 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: "reply_latency": { 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 81713 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: "request": { 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rbytes": { 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.172 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rfiles": { 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rsnaps": { 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_reply": { 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: "subtrees": { 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_cache": { 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_enqueue_scrub": { 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.173 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_exportdir": { 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_flush": { 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_fragmentdir": { 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_fragstats": { 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_inodestats": { 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_enqueued": { 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.174 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_prioritized": { 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_processing": { 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays": { 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays_delayed": { 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays_enqueuing": { 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_completed": { 2024-01-13T18:00:34.175 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_started": { 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_created": { 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_enqueued": { 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_migrated": { 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_reintegrated": { 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.176 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_log": { 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: "ev": { 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: "evadd": { 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: "evex": { 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: "evexd": { 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: "evexg": { 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "evtrm": { 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "jlat": { 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4239951 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "replayed": { 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "seg": { 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "segadd": { 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.178 INFO:tasks.workunit.client.0.smithi084.stdout: "segex": { 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: "segexd": { 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: "segexg": { 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: "segtrm": { 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_mem": { 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: "cap": { 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.179 INFO:tasks.workunit.client.0.smithi084.stdout: "cap+": { 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: "cap-": { 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: "dir": { 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: "dir+": { 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: "dir-": { 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.180 INFO:tasks.workunit.client.0.smithi084.stdout: "dn": { 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: "dn+": { 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: "dn-": { 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: "heap": { 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 207132 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: "ino": { 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.181 INFO:tasks.workunit.client.0.smithi084.stdout: "ino+": { 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: "ino-": { 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_server": { 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: "cap_acquisition_throttle": { 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: "cap_revoke_eviction": { 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_request": { 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.182 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_session": { 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_peer_request": { 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "req_create_latency": { 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getattr_latency": { 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 81713 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getfilelock_latency": { 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.183 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getvxattr_latency": { 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "req_link_latency": { 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookup_latency": { 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookuphash_latency": { 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.184 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupino_latency": { 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupname_latency": { 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupparent_latency": { 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupsnap_latency": { 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lssnap_latency": { 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mkdir_latency": { 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mknod_latency": { 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mksnap_latency": { 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout: "req_open_latency": { 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "req_readdir_latency": { 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rename_latency": { 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "req_renamesnap_latency": { 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmdir_latency": { 2024-01-13T18:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmsnap_latency": { 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmxattr_latency": { 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setattr_latency": { 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setdirlayout_latency": { 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setfilelock_latency": { 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setlayout_latency": { 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setxattr_latency": { 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout: "req_symlink_latency": { 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: "req_unlink_latency": { 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_sessions": { 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: "average_load": { 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: "avg_session_uptime": { 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 82 2024-01-13T18:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: "mdthresh_evicted": { 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: "session_count": { 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: "session_remove": { 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: "sessions_open": { 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: "sessions_stale": { 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: "total_load": { 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.192 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: "purge_queue": { 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executed": { 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing": { 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_high_water": { 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.193 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_ops": { 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_ops_high_water": { 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_item_in_journal": { 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.3986d685fcc5317d5063bf3be95b3875a27bc25b": { 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.194 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 116 2024-01-13T18:00:34.195 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 690 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 690, 2024-01-13T18:00:34.196 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3426733 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 690, 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 226995941 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:34.197 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2999946 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-01-13T18:00:34.198 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 691 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-01-13T18:00:34.199 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 691 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.200 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 691, 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1574971903 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.201 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 691 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 691, 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6724253 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.202 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 691, 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4993 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 691, 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 470991601 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48029696 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.203 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 32202752 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15826944 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277030155 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 249700 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.205 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.206 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70847377 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.207 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277030155 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39583 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.208 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71057494 2024-01-13T18:00:34.209 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184686770 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.210 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.211 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71165774 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.212 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29449, 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65932346 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.213 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.214 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1482, 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 764078979 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.d3cab84abb65d8144362b6f6080262c6dec9892d": { 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.215 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-01-13T18:00:34.216 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 50 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 700 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.217 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 700, 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3451857 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 700, 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 112997387 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-01-13T18:00:34.218 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 146 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.219 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 701 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.220 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-01-13T18:00:34.221 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 701 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 701, 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1389967901 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-01-13T18:00:34.222 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 701 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 701, 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6772403 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.223 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 701, 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5072 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 701, 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 294993190 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46972928 2024-01-13T18:00:34.224 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31580160 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15392768 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.225 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277030155 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 249700 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.226 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70847377 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.228 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277030155 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39583 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.229 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71057494 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.230 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184686770 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.231 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.232 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71165774 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.233 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29853, 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 59425919 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.234 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1518, 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 477647850 2024-01-13T18:00:34.235 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.e3a6e53c614c51f88d28836624fb3fe0c21bc669": { 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-01-13T18:00:34.236 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 187 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-01-13T18:00:34.237 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 821 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4453576 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2463 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 179996781 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.238 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.239 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 821 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4394524 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5061 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-01-13T18:00:34.240 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 821, 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 432221348 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1999963 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.241 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 823 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 823, 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2120962059 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1050 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.242 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.243 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 50094080 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.244 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 40484864 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9609216 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.245 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277031217 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 249270 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.246 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.247 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70846745 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277031217 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.248 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 37180 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.249 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71058835 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.250 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184687478 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.252 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71165066 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-01-13T18:00:34.253 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 37037, 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 127781996 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-01-13T18:00:34.254 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-01-13T18:00:34.255 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1773, 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 668200989 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:34.256 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2871296 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:34.257 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1712128 2024-01-13T18:00:34.258 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1572864 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.259 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.260 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.261 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.262 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.263 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4513792 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.264 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 133149 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.265 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 52491 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 368, 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 86312211 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 354, 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 17004576 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 368, 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 399272 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 368, 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 86711483 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:34.267 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 19946 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.268 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4688 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 819 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 219 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 114, 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2625789 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:34.269 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 312, 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 307062 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 198, 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4549281 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 49388 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11989142 2024-01-13T18:00:34.270 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 120, 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8658636 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 120, 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 381433941381 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 120, 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 141363221400 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47806629295 2024-01-13T18:00:34.271 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46223 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3264299 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 230575446 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 151514 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 97216317 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23252596 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 877533 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.273 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 366367333 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27316913 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 482, 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4621462 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:34.274 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869131064 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 270974976 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 270827520 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146396979 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 147456 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.275 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85922922 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.276 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 602112 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 72858518 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.278 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644421917 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.279 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.280 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68608595 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:34.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57281948 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.282 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.283 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68546708 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644421917 2024-01-13T18:00:34.284 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12637 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1404 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 102502 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.285 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 154455 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68338765 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:34.286 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:34.287 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 588 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:34.288 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27596602 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2500298 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25455556 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.289 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.290 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.291 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-01-13T18:00:34.292 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 588 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27596602 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2500298 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:34.293 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25455556 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1771104 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305692672 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.294 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.295 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2445312 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.296 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1429504 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1290240 2024-01-13T18:00:34.297 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:34.298 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:34.299 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.300 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:34.301 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.302 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3805184 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 663552 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 172087 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.303 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 32, 2024-01-13T18:00:34.304 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 79855 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 299, 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 75387175 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 280, 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15164596 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 299, 2024-01-13T18:00:34.305 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 364830 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 299, 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 75752005 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1051 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.306 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6936 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4427 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.307 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 793 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 226 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 132, 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4121327 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 344, 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 290668 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.308 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 212, 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5482066 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 122989 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12245936 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.309 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 116, 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9482861 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 114, 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 250335816695 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 116, 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 106544856263 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 402, 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31280878293 2024-01-13T18:00:34.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 402, 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 38256 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3386472 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 268883522 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 131651 2024-01-13T18:00:34.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 107990711 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 19027015 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 286360 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.312 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 411598348 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22982817 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 404, 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2362947 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:34.313 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869131064 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236306432 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236003328 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146396979 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 303104 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.314 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85958706 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.316 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 20480 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73396174 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.317 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644690302 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.318 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.319 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68340210 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:34.320 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57305804 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.321 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.322 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68522852 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:34.323 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644690302 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 90943 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 151573 2024-01-13T18:00:34.325 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68098862 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:34.326 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 36 2024-01-13T18:00:34.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 155 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2429440 2024-01-13T18:00:34.328 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 853747681 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1052 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 52874123 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 216309565 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.329 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5305339 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1052 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4725399 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:34.330 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3995253 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18091924 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:34.331 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7873934 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 17114099 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.332 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2429440 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 830350418 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 40274790 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:34.333 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 195200213 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 590368 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305086464 2024-01-13T18:00:34.334 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.335 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2150400 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.336 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1253376 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1114112 2024-01-13T18:00:34.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:34.338 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:34.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.341 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:34.342 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3334144 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 659456 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 162559 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.343 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 16, 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18246 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.344 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 256, 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68542564 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 253, 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7837377 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 256, 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312183 2024-01-13T18:00:34.345 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 256, 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68854747 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1833 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 797 2024-01-13T18:00:34.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4578 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 579 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.347 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 203 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 89, 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1434832 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 251, 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277634 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 162, 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7703863 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.348 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 97904 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8703141 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 110, 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8602667 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 108, 2024-01-13T18:00:34.349 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 222455920521 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 110, 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100043610950 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 329, 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 29994972983 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 329, 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 29840 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:34.350 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2960420 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 126198465 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100589 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 123117978 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:34.351 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23158976 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 286465 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 284186566 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:34.352 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 26423036 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 331, 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2758971 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869131064 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236371968 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 234864640 2024-01-13T18:00:34.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146396979 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1507328 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.354 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85959942 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.355 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.356 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73403130 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.357 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644699570 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.358 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.359 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68330942 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.360 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57306628 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.361 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.362 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68522028 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644699570 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13779 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 66140 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 150193 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68101998 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.366 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 29 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:34.367 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57739665 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.368 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3595619 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41679018 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.369 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.370 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:34.371 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:34.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57739665 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3595619 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.373 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41679018 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305082368 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:34.375 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:34.376 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:34.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 872448 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 733184 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:34.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:34.382 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2084864 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.383 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 679936 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.384 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4956 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.385 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 163, 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 59948726 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 146, 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 16535494 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 163, 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 248856 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:34.386 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 163, 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 60197582 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.387 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10293 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 339 2024-01-13T18:00:34.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 208 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 86, 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1146255 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 150, 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 401656 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 64, 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 295403 2024-01-13T18:00:34.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13893624 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 47, 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4523639 2024-01-13T18:00:34.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 47, 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 505607230825 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 47, 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73941132523 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 408422 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22717 2024-01-13T18:00:34.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 263704 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 213784114 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65696 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:34.392 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 91876591 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10905401 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 288893 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:34.393 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 330752713 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15936565 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 244, 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1543842 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869131064 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.394 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 267829248 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 267083776 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146396979 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 745472 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85960645 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.396 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73422907 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644704842 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.399 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.400 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68325670 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.401 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57307097 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.402 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68521559 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.404 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644704842 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28671 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.405 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 69630 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 146087 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68082450 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.407 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 36 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 655036 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.409 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:34.410 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.412 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:34.413 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 655036 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.414 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305102848 2024-01-13T18:00:34.415 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.416 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:34.417 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 843776 2024-01-13T18:00:34.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 704512 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:34.419 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:34.420 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.421 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.422 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:34.423 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2039808 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.424 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 675840 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 291344 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.425 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3304 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.426 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 156, 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48681916 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9968598 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 156, 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 194416 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 156, 2024-01-13T18:00:34.427 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48876332 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1515 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.428 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6000 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 351 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.429 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 229 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 92, 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 992745 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 154, 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 254332 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 62, 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322724 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 143030 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3075809 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 38, 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3035162 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:34.431 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 36, 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 257135987508 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 38, 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68944724050 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 260, 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 424608 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 260, 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25874 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.432 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 245251 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 165337236 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 75649 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 111010155 2024-01-13T18:00:34.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11608510 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 287145 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 954 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 291314506 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.434 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14007759 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1719786 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869112785 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:34.435 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 268812288 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 268378112 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146375475 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 434176 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:34.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85958981 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.437 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73420475 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.439 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644692360 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.440 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.441 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68338152 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.442 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57305987 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.443 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.444 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68522669 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.445 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644692360 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.446 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4116 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 86452 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 150949 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68097803 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.448 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:34.449 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5507203 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 802295 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5400727 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:34.451 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.453 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5507203 2024-01-13T18:00:34.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 802295 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5400727 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:34.455 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305098752 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.456 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.457 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1142784 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:34.458 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 782336 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 643072 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:34.459 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:34.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:34.461 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1855488 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.464 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 675840 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 221317 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2630 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 141, 2024-01-13T18:00:34.466 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45715297 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 138, 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7979279 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 141, 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 150583 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 141, 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45865880 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:34.467 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1619 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 19820 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 315 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 232 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.469 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 85, 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 702167 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 134, 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 261050 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 49, 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 197285 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:34.470 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 105918 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6255152 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2586147 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 31, 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 384331936905 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:34.471 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 49316615597 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 374530 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 262, 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25750 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 327643 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.472 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 171784533 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 77342 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 139346545 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12757413 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.473 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 288879 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 562 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 330513364 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14768190 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 264, 2024-01-13T18:00:34.474 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3843210 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869112785 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 235470848 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 235012096 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146375475 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:34.475 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 458752 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85959164 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.476 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.477 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73424388 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:34.478 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644693732 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.480 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68336780 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57306109 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.482 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68522547 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.484 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.485 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644693732 2024-01-13T18:00:34.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.485 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.485 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.485 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.485 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.485 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.485 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.486 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12334 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 79488 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 150754 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.487 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68095372 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.488 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.490 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.492 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.494 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.495 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305098752 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-01-13T18:00:34.496 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.497 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1306624 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 950272 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 811008 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:34.499 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:34.500 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:34.501 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:34.502 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:34.503 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:34.504 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2187264 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1261568 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.505 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.506 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6192 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 182, 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 51702174 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 168, 2024-01-13T18:00:34.507 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13343239 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 182, 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 140291 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 182, 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 51842465 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.508 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4598 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 336 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 82, 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 917388 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.510 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 124, 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 216534 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 42, 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 575245 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2304282 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29, 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2502222 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29, 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73842632950 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29, 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 43116336459 2024-01-13T18:00:34.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 399483 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27939 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 204569 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 223172164 2024-01-13T18:00:34.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 101147 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 61107872 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12287505 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 878892 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.514 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 624 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 299133366 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14343116 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 269, 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1997669 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.515 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869112785 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236371968 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 235012096 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146375475 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1359872 2024-01-13T18:00:34.516 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85958298 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.518 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73412966 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.519 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644687238 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68343274 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57305532 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68523124 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644687238 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2794 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12577 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 86643 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 150927 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68091501 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.528 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2414 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33718376 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 12, 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6164315 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.530 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28706374 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:34.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:34.533 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2414 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33718376 2024-01-13T18:00:34.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 12, 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6164315 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28706374 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.535 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305684480 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-01-13T18:00:34.536 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1155072 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-01-13T18:00:34.538 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304414720 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 851968 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 712704 2024-01-13T18:00:34.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312803328 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193929 2024-01-13T18:00:34.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1265664 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1269760 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3653 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-01-13T18:00:34.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3833 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1937408 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1257472 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 7, 2024-01-13T18:00:34.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 235357 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-01-13T18:00:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 7, 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28704 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 158, 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 62988811 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 151, 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9821973 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-01-13T18:00:34.547 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 158, 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 104821 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 158, 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 63093632 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1620 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-01-13T18:00:34.548 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4711 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-01-13T18:00:34.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 600 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 267 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 112, 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2282624 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 173, 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 276696 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 61, 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1650044 2024-01-13T18:00:34.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 64942 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1768935 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 18, 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1529785 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.551 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 18, 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 117377432344 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 18, 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28847156163 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 361554 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28789 2024-01-13T18:00:34.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 186811 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 207469522 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 83659 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 112757860 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.553 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10792154 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 877086 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 726 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 333014629 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.554 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12652412 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 288, 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2204725 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1869112785 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 236371968 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.555 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 235020288 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3146375475 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1351680 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85942577 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 131072 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 126976 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73174735 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644569334 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1168 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68461178 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.562 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57295051 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68533605 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 644569334 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4187 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6978 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.566 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 97700 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 152134 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.567 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68201347 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-01-13T18:00:34.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 115 2024-01-13T18:00:34.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 115, 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 63602373 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 265051 2024-01-13T18:00:34.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 117, 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27726209 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 115, 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 56455023 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 80 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 80, 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12538754 2024-01-13T18:00:34.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 265051 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 80, 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11515098 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 80, 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9412903 2024-01-13T18:00:34.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 30 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 30, 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 29112693 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 30, 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12776326 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 30, 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27222020 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.574 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 21950926 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 7, 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3434785 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-01-13T18:00:34.575 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 19820100 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.576 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305680384 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": [ 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:34.577 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 1, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 1, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 1, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 1781760, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 1781760, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 2, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 2.450439524182002e-06, 2024-01-13T18:00:34.578 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 394, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 598016, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 590368, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 590368, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 1771104, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 219, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 2473984 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.579 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 32, 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 32, 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 2, 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:34.580 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 98304, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 98304, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 22, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 1.3519698427444382e-07, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 3094, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 3094, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 9282, 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 48, 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 16384 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:34.582 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 64, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 64, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 3, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-01-13T18:00:34.583 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:34.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 8, 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 8, 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 4, 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 727116720394, 2024-01-13T18:00:34.585 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 242372247552, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-01-13T18:00:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": { 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: "mirroring_by_pool": [ 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: false 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: "num_images_by_pool": [ 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pools": 1 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "report_id": "ece1ff4f-b467-425a-b891-1b2b4dc63da0", 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "report_timestamp": "2024-01-13T18:00:33.606361", 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "report_version": 1, 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_stats": { 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "6.15.5" 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "rook": { 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster": { 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "external-mode": null, 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "allow-multiple-per-node": null, 2024-01-13T18:00:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: "count": null, 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: "max-id": null, 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: "pvc": { 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: "stretch": { 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: "network": { 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: "provider": null 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: "storage": { 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: "device-set": { 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:34.589 INFO:tasks.workunit.client.0.smithi084.stdout: "non-portable": null, 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: "portable": null, 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: "csi": { 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes": { 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: "node": { 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:34.590 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes-total": null, 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "with-ceph-daemons": null, 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-cephfs-plugin": null, 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-nfs-plugin": null, 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-rbd-plugin": null 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "storage-class": { 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket": null, 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs": null, 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "nfs": null, 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": null, 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-01-13T18:00:34.591 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: "services": {}, 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_per_pg": [ 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.415621+0000", 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.415621+0000", 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.416080+0000", 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:34.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526730+0000", 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3f", 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:45:40.991399+0000", 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.595 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.599 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.398476+0000", 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.398476+0000", 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.398891+0000", 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:34.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530854+0000", 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3e", 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:05:39.892184+0000", 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.602 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.399578+0000", 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.399578+0000", 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.399839+0000", 2024-01-13T18:00:34.606 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528469+0000", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.607 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3d", 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:36:22.906393+0000", 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.609 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.612 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.411056+0000", 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.411056+0000", 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.411528+0000", 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530555+0000", 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3c", 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.615 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:13:24.718807+0000", 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.616 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.413825+0000", 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.413825+0000", 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.415953+0000", 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:34.620 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526222+0000", 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.621 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3b", 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.622 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:04:08.326020+0000", 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.625 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.399358+0000", 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.399358+0000", 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.399699+0000", 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.627 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530870+0000", 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.628 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3a", 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:40:18.403109+0000", 2024-01-13T18:00:34.629 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.632 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.633 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.412816+0000", 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.412816+0000", 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.413121+0000", 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.634 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.525953+0000", 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.635 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.39", 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:40:05.587005+0000", 2024-01-13T18:00:34.636 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.639 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:34.640 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.393317+0000", 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.393317+0000", 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.393602+0000", 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.641 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520586+0000", 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.642 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.38", 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:14:00.225985+0000", 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.643 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.644 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.646 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:34.647 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.416138+0000", 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.416138+0000", 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.416421+0000", 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.648 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526651+0000", 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.649 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.37", 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:10:51.751719+0000", 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.650 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.651 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.653 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.654 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.397557+0000", 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.397557+0000", 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.397837+0000", 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:34.655 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528661+0000", 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.656 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.36", 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:38:02.359081+0000", 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.657 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.658 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.660 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.661 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:07.184825+0000", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:07.184825+0000", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.662 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:07.185071+0000", 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.663 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.35", 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 25, 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:37:56.619880+0000", 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.666 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:34.667 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.668 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.401390+0000", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.401390+0000", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.401738+0000", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.669 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519736+0000", 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.670 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.34", 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:10:08.882123+0000", 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:34.674 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.675 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.410478+0000", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.410478+0000", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.410693+0000", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.521101+0000", 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.33", 2024-01-13T18:00:34.677 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:54:26.505663+0000", 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.678 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.681 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.399266+0000", 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.399266+0000", 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.399587+0000", 2024-01-13T18:00:34.682 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.527365+0000", 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.683 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.32", 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.684 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:45:41.896344+0000", 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.686 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.688 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:07.183855+0000", 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:07.183855+0000", 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.689 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:07.184298+0000", 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.690 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.31", 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 25, 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.691 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:09:01.049040+0000", 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.692 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.693 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.694 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.695 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.411947+0000", 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.411947+0000", 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.412247+0000", 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:34.696 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530310+0000", 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.697 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.30", 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:05:19.184972+0000", 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.701 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.702 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.411559+0000", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.411559+0000", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.411858+0000", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531087+0000", 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.704 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2f", 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:00:40.870815+0000", 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.708 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.408820+0000", 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.408820+0000", 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.409078+0000", 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:34.709 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519951+0000", 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.710 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2e", 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:30:37.097173+0000", 2024-01-13T18:00:34.711 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.714 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:34.715 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.414182+0000", 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.414182+0000", 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.414485+0000", 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.716 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526117+0000", 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.717 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2d", 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:08:50.844685+0000", 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.721 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.722 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.839344+0000", 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.839344+0000", 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.839635+0000", 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:34.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529372+0000", 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 4, 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.724 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 4, 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1f", 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:41:18.168942+0000", 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 554, 2024-01-13T18:00:34.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 4, 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.728 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'4" 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.729 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.403390+0000", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.403390+0000", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.403720+0000", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520070+0000", 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.731 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1e", 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:38:09.594828+0000", 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:34.735 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.736 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.846375+0000", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.846375+0000", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.846725+0000", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.521138+0000", 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1e", 2024-01-13T18:00:34.738 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:06:04.006535+0000", 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'1" 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.742 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.394880+0000", 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.394880+0000", 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.395186+0000", 2024-01-13T18:00:34.743 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529227+0000", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.744 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1f", 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.745 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:02:59.539263+0000", 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.748 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.749 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.845229+0000", 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.845229+0000", 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.845520+0000", 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.750 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526800+0000", 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.751 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1d", 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:08:01.977549+0000", 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.752 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.753 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:34.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.399689+0000", 2024-01-13T18:00:34.756 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.399689+0000", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.400143+0000", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531171+0000", 2024-01-13T18:00:34.757 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1c", 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.758 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:32:04.518468+0000", 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.759 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.760 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.762 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.843616+0000", 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.843616+0000", 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.843954+0000", 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:34.763 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526328+0000", 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:34.764 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1c", 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-01-13T18:00:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:37:08.466053+0000", 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.766 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:34.767 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.768 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.769 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.398793+0000", 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.398793+0000", 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.399242+0000", 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.770 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531141+0000", 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.771 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1d", 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:05:43.194645+0000", 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.772 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.773 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.774 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.775 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.776 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.838444+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.838444+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.838743+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:34.777 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.522680+0000", 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1b", 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.778 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:48:37.841281+0000", 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.780 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.781 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'1" 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.782 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.400621+0000", 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.400621+0000", 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.401094+0000", 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:34.783 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519375+0000", 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.784 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1a", 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.785 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:15:46.371336+0000", 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.787 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.788 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.789 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.831491+0000", 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.831491+0000", 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.832810+0000", 2024-01-13T18:00:34.790 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528465+0000", 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:34.791 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1a", 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.792 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:50:10.505869+0000", 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'1" 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.796 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.407858+0000", 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.407858+0000", 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.408148+0000", 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:34.797 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526444+0000", 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.798 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1b", 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.799 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:35:47.284096+0000", 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.800 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.801 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.802 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.803 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.842487+0000", 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.842487+0000", 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.843139+0000", 2024-01-13T18:00:34.804 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.521147+0000", 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.805 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.19", 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:34.806 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:28:01.688683+0000", 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.808 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.809 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.810 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.401490+0000", 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.401490+0000", 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.401772+0000", 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:34.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.522052+0000", 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.812 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.18", 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.813 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:32:13.633488+0000", 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.817 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.841820+0000", 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.841820+0000", 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.842527+0000", 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530827+0000", 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.819 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.18", 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:34.820 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:40:02.120533+0000", 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.823 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.824 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.393657+0000", 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.393657+0000", 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.393987+0000", 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530626+0000", 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.826 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.19", 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:24:44.818236+0000", 2024-01-13T18:00:34.827 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.830 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.831 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.843290+0000", 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.843290+0000", 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.843560+0000", 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.832 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.833 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.17", 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:12:58.012752+0000", 2024-01-13T18:00:34.834 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.835 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.837 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.838 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.412519+0000", 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.412519+0000", 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.412880+0000", 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:34.839 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531131+0000", 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.840 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.16", 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:40:03.956715+0000", 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.841 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.842 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.844 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.845 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.841409+0000", 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.841409+0000", 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841704+0000", 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.846 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530717+0000", 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.847 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.16", 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:56:02.964249+0000", 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.848 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.849 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.851 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:34.852 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.403108+0000", 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.403108+0000", 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.403381+0000", 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.853 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529148+0000", 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.854 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.17", 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:55:07.654474+0000", 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.855 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.856 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.857 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.858 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.859 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.835169+0000", 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.835169+0000", 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.835474+0000", 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.860 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529248+0000", 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 3, 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.861 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 3, 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.15", 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.862 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:02:02.178682+0000", 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 90, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.863 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.864 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 4, 2024-01-13T18:00:34.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'3" 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.866 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.406352+0000", 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.406352+0000", 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.407252+0000", 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519706+0000", 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.14", 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:21:50.223964+0000", 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:34.873 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.836231+0000", 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.836231+0000", 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.836500+0000", 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:34.874 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528634+0000", 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 9, 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.875 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 9, 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.14", 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 25, 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:40:58.818088+0000", 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 2324, 2024-01-13T18:00:34.876 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.877 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 12, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 4, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 4, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.878 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 9, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 6 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.879 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "62'9" 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.880 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:06.533641+0000", 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:06.533641+0000", 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:34.881 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:06.533955+0000", 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.882 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.15", 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 10, 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T19:42:07.849879+0000", 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.883 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.884 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.885 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.886 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.887 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.840803+0000", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.840803+0000", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841243+0000", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.888 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526625+0000", 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.889 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.13", 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:02:14.255922+0000", 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 34, 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.890 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 6 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:34.893 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.408736+0000", 2024-01-13T18:00:34.894 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.408736+0000", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.409006+0000", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.527280+0000", 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.895 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.12", 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.896 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.897 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.897 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.897 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.897 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:10:11.734133+0000", 2024-01-13T18:00:34.897 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.897 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.897 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.899 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.899 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.899 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.899 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.899 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.899 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.899 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.899 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.899 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.899 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.899 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.900 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.902 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.840845+0000", 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.840845+0000", 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841162+0000", 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:34.903 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530846+0000", 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.904 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.12", 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:34.905 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:56:48.776768+0000", 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.906 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.907 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.909 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.410388+0000", 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.410388+0000", 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.414263+0000", 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.910 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526161+0000", 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.911 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.13", 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.912 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:55:00.346625+0000", 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.913 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.914 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.915 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.916 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.834531+0000", 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.834531+0000", 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.834846+0000", 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.917 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528254+0000", 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.918 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.11", 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:12:41.632590+0000", 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.919 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.922 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:34.923 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:07.183677+0000", 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:07.183677+0000", 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:34.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:07.184113+0000", 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.925 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.10", 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 25, 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:03:46.666388+0000", 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.926 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.927 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:34.929 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.930 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.831252+0000", 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.831252+0000", 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.831518+0000", 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:34.931 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.517935+0000", 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 8, 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.932 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 8, 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.10", 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 24, 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:42:53.797821+0000", 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.933 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.934 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 12, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 4, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 4, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 4, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 12, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.936 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'8" 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.937 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.414540+0000", 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.414540+0000", 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.414840+0000", 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:34.938 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526298+0000", 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.939 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.11", 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:24:57.534623+0000", 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.940 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.941 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.942 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.943 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.944 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.831126+0000", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.831126+0000", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.831411+0000", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.945 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520504+0000", 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.946 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.f", 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:12:48.869393+0000", 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 22, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.947 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.948 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.948 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.948 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.948 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.948 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.948 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.948 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.948 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.948 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.948 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:34.948 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.949 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.950 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'1" 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.408618+0000", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.408618+0000", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.408885+0000", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526733+0000", 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.e", 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:18:38.241218+0000", 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.310557+0000", 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.310557+0000", 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.310836+0000", 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528296+0000", 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.2", 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:10:08.926746+0000", 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.964 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.965 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.832100+0000", 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.832100+0000", 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.832399+0000", 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.966 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528773+0000", 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.967 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.4", 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:01:50.555635+0000", 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.968 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.969 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.971 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.972 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.402379+0000", 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.402379+0000", 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.402741+0000", 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:34.973 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531181+0000", 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.974 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.5", 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:30:51.621102+0000", 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.975 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.978 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.547105+0000", 2024-01-13T18:00:34.979 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.547105+0000", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.547393+0000", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:34.980 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528846+0000", 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.4", 2024-01-13T18:00:34.981 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:28:35.317481+0000", 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.982 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.983 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.984 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.985 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.836161+0000", 2024-01-13T18:00:34.986 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.836161+0000", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.836469+0000", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530440+0000", 2024-01-13T18:00:34.987 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.2", 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.988 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:00:00.583677+0000", 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.989 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.990 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.991 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.992 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.411086+0000", 2024-01-13T18:00:34.993 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.411086+0000", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.411383+0000", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519785+0000", 2024-01-13T18:00:34.994 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3", 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:34.995 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:29:49.851426+0000", 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:34.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:34.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:34.998 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:34.999 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.310540+0000", 2024-01-13T18:00:35.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.310540+0000", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.310768+0000", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529417+0000", 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.001 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.7", 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.002 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:08:47.529142+0000", 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.006 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.395625+0000", 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.395625+0000", 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.395912+0000", 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528095+0000", 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.008 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.0", 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:45:28.565536+0000", 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.009 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.012 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.012 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.012 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.012 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.012 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.012 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo OK 2024-01-13T18:00:35.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:34] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T18:00:35.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.015 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.016 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.839440+0000", 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.839440+0000", 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.839719+0000", 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.518135+0000", 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.018 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1", 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:17:50.836804+0000", 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.019 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.022 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.023 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.182314+0000", 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.182314+0000", 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.182636+0000", 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:35.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528387+0000", 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.025 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.5", 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:32:50.369684+0000", 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.026 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.029 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.030 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.397326+0000", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.397326+0000", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.397651+0000", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.522833+0000", 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.032 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2", 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:24:26.902155+0000", 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.033 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.036 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.037 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.842172+0000", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.842172+0000", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.842492+0000", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.038 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530488+0000", 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.039 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.3", 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:58:24.249555+0000", 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.040 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:35.043 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 19, 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.044 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:27.209293+0000", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:27.209293+0000", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:27.209773+0000", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:56:59.530229+0000", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:56:59.530229+0000", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 56, 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.045 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:56:59.530229+0000", 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:30.529875+0000", 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 148, 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 55, 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 148, 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.046 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "1.0", 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 348, 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:45:29.626217+0000", 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 590368, 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 1771104, 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.047 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 6, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 394, 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 584, 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 219, 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 2416 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:35.050 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "65'148" 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.051 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.547115+0000", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.547115+0000", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.547394+0000", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.052 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528564+0000", 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.053 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.6", 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:38:56.099495+0000", 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:35.058 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.403022+0000", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.403022+0000", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.403318+0000", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:35.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.527082+0000", 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1", 2024-01-13T18:00:35.060 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:13:06.307215+0000", 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.061 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.064 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.844443+0000", 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.844443+0000", 2024-01-13T18:00:35.065 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.844962+0000", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.525819+0000", 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.066 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.0", 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.067 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:13:21.802704+0000", 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.068 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.071 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.310046+0000", 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.310046+0000", 2024-01-13T18:00:35.072 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.310298+0000", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526352+0000", 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.073 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.3", 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.074 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:32:39.783518+0000", 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.075 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.078 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.845158+0000", 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.845158+0000", 2024-01-13T18:00:35.079 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.845469+0000", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526768+0000", 2024-01-13T18:00:35.080 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.5", 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.081 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:37:46.603258+0000", 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.082 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.085 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.395105+0000", 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.395105+0000", 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.395393+0000", 2024-01-13T18:00:35.086 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528920+0000", 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.087 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.4", 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.088 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T20:45:12.100528+0000", 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.089 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.091 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.092 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.180705+0000", 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.180705+0000", 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.180992+0000", 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.093 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.521967+0000", 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.094 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.0", 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:28:08.013633+0000", 2024-01-13T18:00:35.095 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.096 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.098 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.099 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.840768+0000", 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.840768+0000", 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841642+0000", 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:35.100 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:35.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:35.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:35.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530995+0000", 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.105 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.6", 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:03:26.813924+0000", 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:35.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.109 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "60'1" 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.110 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.414307+0000", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.414307+0000", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.414477+0000", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520967+0000", 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.112 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.7", 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:38:41.330284+0000", 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.116 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 61, 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:35.117 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:59:05.310135+0000", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:59:05.310135+0000", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:59:05.310494+0000", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 62, 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:59:04.346729+0000", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:35.118 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519204+0000", 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 61, 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.1", 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.119 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 12, 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:13:06.215978+0000", 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.121 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.123 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.839541+0000", 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.839541+0000", 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.839829+0000", 2024-01-13T18:00:35.124 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528588+0000", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.125 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.7", 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-01-13T18:00:35.126 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:52:18.758870+0000", 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:35.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.129 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.130 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.400836+0000", 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.400836+0000", 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.401139+0000", 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528705+0000", 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.132 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.6", 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:15:29.881505+0000", 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.133 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.136 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:35.137 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.844002+0000", 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.844002+0000", 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.844748+0000", 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.138 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.525974+0000", 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.139 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.8", 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:14:57.868739+0000", 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.140 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.143 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.144 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.408807+0000", 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.408807+0000", 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.409079+0000", 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.519373+0000", 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.146 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.9", 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:53:09.994807+0000", 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.150 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.151 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.840078+0000", 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.840078+0000", 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841464+0000", 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:35.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530550+0000", 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.153 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.9", 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:39:59.597495+0000", 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.157 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.158 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.407988+0000", 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.407988+0000", 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.408303+0000", 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:35.159 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.522082+0000", 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.160 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.8", 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:45:25.570947+0000", 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.164 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.165 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.841192+0000", 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.841192+0000", 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.841581+0000", 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528571+0000", 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.167 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.a", 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T03:39:05.602781+0000", 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-01-13T18:00:35.171 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.172 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.401769+0000", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.401769+0000", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.402047+0000", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.173 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.522940+0000", 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.174 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.b", 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:32:35.369119+0000", 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.178 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.844286+0000", 2024-01-13T18:00:35.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.844286+0000", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.844613+0000", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526142+0000", 2024-01-13T18:00:35.180 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.b", 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.181 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:27:48.244809+0000", 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.185 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.398572+0000", 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.398572+0000", 2024-01-13T18:00:35.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.399084+0000", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528347+0000", 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.187 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.a", 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.188 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:18:41.057728+0000", 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.192 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.837168+0000", 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.837168+0000", 2024-01-13T18:00:35.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.837432+0000", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.518927+0000", 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.194 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.c", 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.195 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 16, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:37:30.125718+0000", 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.199 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.415759+0000", 2024-01-13T18:00:35.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.415759+0000", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.416032+0000", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526696+0000", 2024-01-13T18:00:35.201 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.d", 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.202 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:11:24.483081+0000", 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.206 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:36.833658+0000", 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:36.833658+0000", 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:36.834302+0000", 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529161+0000", 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.208 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.d", 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 17, 2024-01-13T18:00:35.209 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T05:13:18.505657+0000", 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 70, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-01-13T18:00:35.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'1" 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.213 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.402128+0000", 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.402128+0000", 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.402650+0000", 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.531130+0000", 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.215 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.c", 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.216 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T22:02:28.745789+0000", 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.219 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.220 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 57, 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:06.533628+0000", 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:06.533628+0000", 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:35.811841+0000", 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:06.538272+0000", 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.e", 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 32, 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:46:09.651787+0000", 2024-01-13T18:00:35.223 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-01-13T18:00:35.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 1, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.226 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "59'2" 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.227 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.414097+0000", 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.414097+0000", 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.414378+0000", 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526834+0000", 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.229 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.f", 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:45:12.430007+0000", 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.230 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.233 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.234 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.396928+0000", 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.396928+0000", 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.397227+0000", 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:35.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528179+0000", 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.236 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.20", 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:59:55.499543+0000", 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.237 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.240 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.241 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.396585+0000", 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.396585+0000", 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.396849+0000", 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:35.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.518208+0000", 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.243 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.21", 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:39:32.529315+0000", 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:35.247 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.248 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.403041+0000", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.403041+0000", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.403640+0000", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530580+0000", 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.250 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.22", 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T01:11:37.683734+0000", 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.254 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:06.534533+0000", 2024-01-13T18:00:35.255 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:06.534533+0000", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:06.534880+0000", 2024-01-13T18:00:35.256 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.23", 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.257 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 10, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:13:20.351015+0000", 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.261 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.401546+0000", 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.401546+0000", 2024-01-13T18:00:35.262 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.401852+0000", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520146+0000", 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.263 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.24", 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.264 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T00:25:50.041002+0000", 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.267 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.268 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.395306+0000", 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.395306+0000", 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.395592+0000", 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.529076+0000", 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.270 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.25", 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T23:06:42.102077+0000", 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.271 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.274 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.275 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.409345+0000", 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.409345+0000", 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.409861+0000", 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528794+0000", 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.277 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.26", 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:00:44.773057+0000", 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.278 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.281 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.282 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T18:00:06.534242+0000", 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T18:00:06.534242+0000", 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 65, 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:06.534564+0000", 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 64, 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.284 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.27", 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 65, 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 25, 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:28:19.184443+0000", 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.288 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.289 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.402233+0000", 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.402233+0000", 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.402590+0000", 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:35.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530956+0000", 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.291 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.28", 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T18:48:51.046376+0000", 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.292 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.295 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.403093+0000", 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.403093+0000", 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.403312+0000", 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:35.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.520989+0000", 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.298 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.29", 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:27:24.003935+0000", 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:35.302 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.303 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.411192+0000", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.411192+0000", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.411533+0000", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.530692+0000", 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.305 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.306 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2a", 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-14T21:31:15.289987+0000", 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-01-13T18:00:35.310 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:35.311 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.409319+0000", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.409319+0000", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.409594+0000", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:35.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.526537+0000", 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2b", 2024-01-13T18:00:35.313 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T04:21:11.322832+0000", 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.317 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 58, 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-01-13T17:58:37.399952+0000", 2024-01-13T18:00:35.318 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-01-13T17:58:37.399952+0000", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-01-13T17:58:37.400265+0000", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 59, 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-01-13T17:58:36.813499+0000", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-01-13T18:00:05.528727+0000", 2024-01-13T18:00:35.319 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 58, 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2c", 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-01-13T18:00:35.320 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 64, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-01-15T02:39:04.725745+0000", 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_per_pool": [ 2024-01-13T18:00:35.324 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 24, 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 8, 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 4, 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-01-13T18:00:35.328 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 24 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 192, 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 64, 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 3, 2024-01-13T18:00:35.329 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-01-13T18:00:35.332 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 192 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 3, 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-01-13T18:00:35.333 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 148, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 1, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 3, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 148, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 1, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 590368, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 1771104, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 6, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 394, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 584, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 219, 2024-01-13T18:00:35.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 2416 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 1781760, 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 1771104, 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 3 2024-01-13T18:00:35.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 96, 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 42, 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 32, 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 42, 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 2, 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 3094, 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-01-13T18:00:35.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 66, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 22, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-01-13T18:00:35.339 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 22, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 14, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 1, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-01-13T18:00:35.340 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 48, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 16 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 98304, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 9282, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-01-13T18:00:35.341 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 96 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 105, 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": 4, 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_by_class": { 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: "ssd": { 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 765517758464, 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-01-13T18:00:35.342 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 2442526720, 2024-01-13T18:00:35.343 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_bytes": 2442526720, 2024-01-13T18:00:35.343 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_ratio": 0.003180537838488817 2024-01-13T18:00:35.343 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:35.343 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-01-13T18:00:35.343 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 765517758464, 2024-01-13T18:00:35.343 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-01-13T18:00:35.343 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 2442526720 2024-01-13T18:00:35.343 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:35.343 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-01-13T18:00:35.343 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-01-13T18:00:35.343 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-01-13T18:00:35.344 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:00:35.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:00:35.344 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.344 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.346 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.347 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:35.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.349 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.350 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.352 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.352 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.352 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.352 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.352 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.352 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.352 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:35.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.354 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.354 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.354 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.354 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.354 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.354 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.354 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.354 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.354 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.354 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.354 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.355 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.356 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.356 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.356 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.356 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.356 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.356 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.356 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-01-13T18:00:35.356 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-01-13T18:00:35.356 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:00:35.356 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:00:35.356 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:00:35.389 INFO:tasks.workunit:Stopping ['test_telemetry_quincy.sh'] on client.0... 2024-01-13T18:00:35.389 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-13T18:00:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:35 smithi099 ceph-mon[71325]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:35 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:35.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:35 smithi084 ceph-mon[37908]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:35 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:35.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:35 smithi084 ceph-mon[52328]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:35.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:35 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:35.676 DEBUG:teuthology.parallel:result is None 2024-01-13T18:00:35.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:00:35.706 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:00:35.706 DEBUG:teuthology.orchestra.run.smithi084:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:00:35.769 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:00:35.769 INFO:teuthology.run_tasks:Running task print... 2024-01-13T18:00:35.779 INFO:teuthology.task.print:**** done end telemetry quincy... 2024-01-13T18:00:35.779 INFO:teuthology.run_tasks:Running task print... 2024-01-13T18:00:35.831 INFO:teuthology.task.print:**** done start parallel 2024-01-13T18:00:35.831 INFO:teuthology.run_tasks:Running task parallel... 2024-01-13T18:00:35.883 INFO:teuthology.task.parallel:starting parallel... 2024-01-13T18:00:35.883 INFO:teuthology.task.parallel:In parallel, running task full_sequential... 2024-01-13T18:00:35.884 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-01-13T18:00:35.884 INFO:teuthology.task.print:**** done start ec-rados-default.yaml 2024-01-13T18:00:35.884 INFO:teuthology.task.full_sequential:In full_sequential, running task rados... 2024-01-13T18:00:35.886 INFO:tasks.rados:Beginning rados... 2024-01-13T18:00:35.886 INFO:tasks.rados:joining rados 2024-01-13T18:00:35.886 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-01-13T18:00:35.886 INFO:teuthology.task.sequential:In sequential, running task print... 2024-01-13T18:00:35.886 INFO:teuthology.task.print:**** done start upgrade, wait 2024-01-13T18:00:35.887 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-01-13T18:00:35.887 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-01-13T18:00:35.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -e sha1=d2f11f33b7063c2c1bc47b2b4e9350f48064868f -- bash -c 'ceph config set global log_to_journald false --force' 2024-01-13T18:00:35.888 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2024-01-13T18:00:35.888 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd erasure-code-profile set teuthologyprofile k=2 m=1 crush-failure-domain=osd 2024-01-13T18:00:36.153 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:00:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:00:36.579 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:36 smithi084 ceph-mon[37908]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-01-13T18:00:36.579 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:36 smithi084 ceph-mon[52328]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-01-13T18:00:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:36 smithi099 ceph-mon[71325]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-01-13T18:00:36.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:36] "GET /metrics HTTP/1.1" 200 235815 "" "Prometheus/2.43.0" 2024-01-13T18:00:37.485 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:37 smithi084 ceph-mon[37908]: mgrmap e22: y(active, since 91s), standbys: x 2024-01-13T18:00:37.486 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:37 smithi084 ceph-mon[52328]: mgrmap e22: y(active, since 91s), standbys: x 2024-01-13T18:00:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:37 smithi099 ceph-mon[71325]: mgrmap e22: y(active, since 91s), standbys: x 2024-01-13T18:00:38.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -e sha1=d2f11f33b7063c2c1bc47b2b4e9350f48064868f -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-01-13T18:00:38.527 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:38 smithi084 ceph-mon[37908]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 33 KiB/s rd, 255 B/s wr, 33 op/s 2024-01-13T18:00:38.527 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:38 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1429987431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:00:38.528 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:38 smithi084 ceph-mon[52328]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 33 KiB/s rd, 255 B/s wr, 33 op/s 2024-01-13T18:00:38.528 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:38 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1429987431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:00:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:38 smithi099 ceph-mon[71325]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 33 KiB/s rd, 255 B/s wr, 33 op/s 2024-01-13T18:00:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:38 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1429987431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:00:38.697 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:00:38.812 INFO:tasks.rados:starting run 0 out of 1 2024-01-13T18:00:38.812 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2024-01-13T18:00:38.813 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd pool create unique_pool_0 16 16 erasure teuthologyprofile 2024-01-13T18:00:39.331 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:00:39.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:39 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1429987431' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:00:39.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:39 smithi084 ceph-mon[37908]: osdmap e66: 8 total, 8 up, 8 in 2024-01-13T18:00:39.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:39 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1429987431' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:00:39.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:39 smithi084 ceph-mon[52328]: osdmap e66: 8 total, 8 up, 8 in 2024-01-13T18:00:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:39 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1429987431' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:00:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:39 smithi099 ceph-mon[71325]: osdmap e66: 8 total, 8 up, 8 in 2024-01-13T18:00:39.963 INFO:teuthology.orchestra.run.smithi084.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T18:00:40.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -e sha1=d2f11f33b7063c2c1bc47b2b4e9350f48064868f -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done' 2024-01-13T18:00:40.678 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:00:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[52328]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 40 KiB/s rd, 307 B/s wr, 40 op/s 2024-01-13T18:00:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[37908]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 40 KiB/s rd, 307 B/s wr, 40 op/s 2024-01-13T18:00:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:40.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:40.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:40.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:40 smithi099 ceph-mon[71325]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 40 KiB/s rd, 307 B/s wr, 40 op/s 2024-01-13T18:00:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:00:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:00:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:00:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:00:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:41 smithi084 ceph-mon[37908]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d2f11f33b7063c2c1bc47b2b4e9350f48064868f", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:41.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:41 smithi084 ceph-mon[37908]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T18:00:41.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:41 smithi084 ceph-mon[37908]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T18:00:41.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:41 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1052263252' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-01-13T18:00:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:41 smithi084 ceph-mon[52328]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d2f11f33b7063c2c1bc47b2b4e9350f48064868f", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:41 smithi084 ceph-mon[52328]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T18:00:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:41 smithi084 ceph-mon[52328]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T18:00:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:41 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1052263252' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-01-13T18:00:41.840 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:00:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:41 smithi099 ceph-mon[71325]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d2f11f33b7063c2c1bc47b2b4e9350f48064868f", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:41 smithi099 ceph-mon[71325]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T18:00:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:41 smithi099 ceph-mon[71325]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d2f11f33b7063c2c1bc47b2b4e9350f48064868f 2024-01-13T18:00:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:41 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1052263252' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-01-13T18:00:42.163 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:00:42.163 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (57s) 50s ago 81s 17.3M - 0.25.0 c8568f914cd2 f4a66f0ea4ed 2024-01-13T18:00:42.163 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (68s) 49s ago 68s 82.4M - 9.4.7 954c08fa6188 8bf31d445aae 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (2m) 50s ago 2m 13.7M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (2m) 49s ago 2m 17.3M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443 running (4m) 49s ago 4m 438M - 17.2.7-268-g6441305d c3a232f785d8 6873f77bac1c 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:9283 running (5m) 50s ago 5m 495M - 17.2.7-268-g6441305d c3a232f785d8 051f8ff2f26d 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (5m) 50s ago 6m 82.9M 2048M 17.2.7-268-g6441305d c3a232f785d8 0eb2ed5f8766 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (4m) 49s ago 4m 66.6M 2048M 17.2.7-268-g6441305d c3a232f785d8 bf79d7793fc1 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (4m) 50s ago 4m 67.1M 2048M 17.2.7-268-g6441305d c3a232f785d8 510574f8be07 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (66s) 50s ago 65s 4106k - 1.5.0 0da6a335fe13 eaf6d03cde96 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (63s) 49s ago 62s 3900k - 1.5.0 0da6a335fe13 14e49e9d7852 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 50s ago 4m 63.3M 3000M 17.2.7-268-g6441305d c3a232f785d8 809287996fef 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (4m) 50s ago 4m 63.0M 3000M 17.2.7-268-g6441305d c3a232f785d8 fad77ee705d8 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (3m) 50s ago 3m 55.9M 3000M 17.2.7-268-g6441305d c3a232f785d8 14025770cf00 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (3m) 50s ago 3m 50.1M 3000M 17.2.7-268-g6441305d c3a232f785d8 068cf98fa99c 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (3m) 49s ago 3m 52.0M 3000M 17.2.7-268-g6441305d c3a232f785d8 30e0722550a0 2024-01-13T18:00:42.164 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (2m) 49s ago 2m 53.6M 3000M 17.2.7-268-g6441305d c3a232f785d8 51be805dde78 2024-01-13T18:00:42.165 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (2m) 49s ago 2m 52.4M 3000M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:00:42.165 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (2m) 49s ago 2m 58.3M 3000M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:00:42.165 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (54s) 49s ago 104s 28.2M - 2.43.0 a07b618ecd1d 79a2b67e3dcd 2024-01-13T18:00:42.390 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'unique_pool_0' created 2024-01-13T18:00:42.599 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 3 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 8 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 15 2024-01-13T18:00:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:00:42.601 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:00:42.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:42 smithi084 ceph-mon[37908]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s rd, 307 B/s wr, 17 op/s 2024-01-13T18:00:42.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:42 smithi084 ceph-mon[37908]: osdmap e67: 8 total, 8 up, 8 in 2024-01-13T18:00:42.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:42 smithi084 ceph-mon[52328]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s rd, 307 B/s wr, 17 op/s 2024-01-13T18:00:42.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:42 smithi084 ceph-mon[52328]: osdmap e67: 8 total, 8 up, 8 in 2024-01-13T18:00:42.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-01-13T18:00:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:42 smithi099 ceph-mon[71325]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s rd, 307 B/s wr, 17 op/s 2024-01-13T18:00:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:42 smithi099 ceph-mon[71325]: osdmap e67: 8 total, 8 up, 8 in 2024-01-13T18:00:43.030 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:00:43.394 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:43 smithi084 ceph-mon[37908]: from='client.24938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:43.394 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:43 smithi084 ceph-mon[37908]: from='client.24944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:43.394 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:43 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1052263252' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-01-13T18:00:43.394 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:43 smithi084 ceph-mon[37908]: osdmap e68: 8 total, 8 up, 8 in 2024-01-13T18:00:43.394 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:43 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/789329239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:00:43.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:43 smithi084 ceph-mon[52328]: from='client.24938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:43.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:43 smithi084 ceph-mon[52328]: from='client.24944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:43.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:43 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1052263252' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-01-13T18:00:43.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:43 smithi084 ceph-mon[52328]: osdmap e68: 8 total, 8 up, 8 in 2024-01-13T18:00:43.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:43 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/789329239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:00:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:43 smithi099 ceph-mon[71325]: from='client.24938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:43 smithi099 ceph-mon[71325]: from='client.24944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:00:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:43 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1052263252' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-01-13T18:00:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:43 smithi099 ceph-mon[71325]: osdmap e68: 8 total, 8 up, 8 in 2024-01-13T18:00:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:43 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/789329239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:00:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-01-13T18:00:44.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:00:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:44] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T18:00:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:44 smithi099 ceph-mon[71325]: pgmap v58: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:44 smithi099 ceph-mon[71325]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:00:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:44 smithi099 ceph-mon[71325]: osdmap e69: 8 total, 8 up, 8 in 2024-01-13T18:00:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:44 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2189938022' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:00:44.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:44 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:00:44.651 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:44 smithi084 ceph-mon[37908]: pgmap v58: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:44.651 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:44 smithi084 ceph-mon[37908]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:00:44.651 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:44 smithi084 ceph-mon[37908]: osdmap e69: 8 total, 8 up, 8 in 2024-01-13T18:00:44.651 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:44 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2189938022' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:00:44.651 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:44 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:00:44.651 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:44 smithi084 ceph-mon[52328]: pgmap v58: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:44.651 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:44 smithi084 ceph-mon[52328]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:00:44.651 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:44 smithi084 ceph-mon[52328]: osdmap e69: 8 total, 8 up, 8 in 2024-01-13T18:00:44.651 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:44 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2189938022' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:00:44.651 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:44 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:00:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:45 smithi084 ceph-mon[37908]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-01-13T18:00:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:45 smithi084 ceph-mon[37908]: osdmap e70: 8 total, 8 up, 8 in 2024-01-13T18:00:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:45 smithi084 ceph-mon[52328]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-01-13T18:00:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:45 smithi084 ceph-mon[52328]: osdmap e70: 8 total, 8 up, 8 in 2024-01-13T18:00:45.760 DEBUG:teuthology.orchestra.run.smithi084:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0 2024-01-13T18:00:45.789 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight read -> 100 2024-01-13T18:00:45.789 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight delete -> 50 2024-01-13T18:00:45.789 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight snap_create -> 50 2024-01-13T18:00:45.789 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight snap_remove -> 50 2024-01-13T18:00:45.789 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight rollback -> 50 2024-01-13T18:00:45.789 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight setattr -> 25 2024-01-13T18:00:45.789 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight rmattr -> 25 2024-01-13T18:00:45.789 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight copy_from -> 50 2024-01-13T18:00:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight append -> 100 2024-01-13T18:00:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable) 2024-01-13T18:00:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:Configuration: 2024-01-13T18:00:45.790 INFO:tasks.rados.rados.0.smithi084.stdout: Number of operations: 4000 2024-01-13T18:00:45.790 INFO:tasks.rados.rados.0.smithi084.stdout: Number of objects: 50 2024-01-13T18:00:45.790 INFO:tasks.rados.rados.0.smithi084.stdout: Max in flight operations: 16 2024-01-13T18:00:45.790 INFO:tasks.rados.rados.0.smithi084.stdout: Object size (in bytes): 4000000 2024-01-13T18:00:45.790 INFO:tasks.rados.rados.0.smithi084.stdout: Write stride min: 400000 2024-01-13T18:00:45.790 INFO:tasks.rados.rados.0.smithi084.stdout: Write stride max: 800000 2024-01-13T18:00:45.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:45 smithi099 ceph-mon[71325]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-01-13T18:00:45.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:45 smithi099 ceph-mon[71325]: osdmap e70: 8 total, 8 up, 8 in 2024-01-13T18:00:46.413 INFO:tasks.rados.rados.0.smithi084.stdout:1: write initial oid 1 2024-01-13T18:00:46.413 INFO:tasks.rados.rados.0.smithi084.stdout:1: seq_num 0 ranges {0=24576} 2024-01-13T18:00:46.413 INFO:tasks.rados.rados.0.smithi084.stdout:1: writing smithi084102331-1 from 0 to 24576 tid 1 2024-01-13T18:00:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:2: write initial oid 2 2024-01-13T18:00:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:2: seq_num 1 ranges {0=24576} 2024-01-13T18:00:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:2: writing smithi084102331-2 from 0 to 24576 tid 1 2024-01-13T18:00:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:3: write initial oid 3 2024-01-13T18:00:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:3: seq_num 2 ranges {0=40960} 2024-01-13T18:00:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:3: writing smithi084102331-3 from 0 to 40960 tid 1 2024-01-13T18:00:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:4: write initial oid 4 2024-01-13T18:00:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:4: seq_num 3 ranges {0=57344} 2024-01-13T18:00:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:4: writing smithi084102331-4 from 0 to 57344 tid 1 2024-01-13T18:00:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:5: write initial oid 5 2024-01-13T18:00:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:5: seq_num 4 ranges {0=73728} 2024-01-13T18:00:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:5: writing smithi084102331-5 from 0 to 73728 tid 1 2024-01-13T18:00:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:6: write initial oid 6 2024-01-13T18:00:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:6: seq_num 5 ranges {0=90112} 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:6: writing smithi084102331-6 from 0 to 90112 tid 1 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:7: write initial oid 7 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:7: seq_num 6 ranges {0=106496} 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:7: writing smithi084102331-7 from 0 to 106496 tid 1 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:8: write initial oid 8 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:8: seq_num 7 ranges {0=122880} 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:8: writing smithi084102331-8 from 0 to 122880 tid 1 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:9: write initial oid 9 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:9: seq_num 8 ranges {0=139264} 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:9: writing smithi084102331-9 from 0 to 139264 tid 1 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:10: write initial oid 10 2024-01-13T18:00:46.418 INFO:tasks.rados.rados.0.smithi084.stdout:10: seq_num 9 ranges {0=155648} 2024-01-13T18:00:46.421 INFO:tasks.rados.rados.0.smithi084.stdout:10: writing smithi084102331-10 from 0 to 155648 tid 1 2024-01-13T18:00:46.422 INFO:tasks.rados.rados.0.smithi084.stdout:11: write initial oid 11 2024-01-13T18:00:46.422 INFO:tasks.rados.rados.0.smithi084.stdout:11: seq_num 10 ranges {0=172032} 2024-01-13T18:00:46.422 INFO:tasks.rados.rados.0.smithi084.stdout:11: writing smithi084102331-11 from 0 to 172032 tid 1 2024-01-13T18:00:46.422 INFO:tasks.rados.rados.0.smithi084.stdout:12: write initial oid 12 2024-01-13T18:00:46.422 INFO:tasks.rados.rados.0.smithi084.stdout:12: seq_num 11 ranges {0=188416} 2024-01-13T18:00:46.422 INFO:tasks.rados.rados.0.smithi084.stdout:12: writing smithi084102331-12 from 0 to 188416 tid 1 2024-01-13T18:00:46.422 INFO:tasks.rados.rados.0.smithi084.stdout:13: write initial oid 13 2024-01-13T18:00:46.422 INFO:tasks.rados.rados.0.smithi084.stdout:13: seq_num 12 ranges {0=204800} 2024-01-13T18:00:46.426 INFO:tasks.rados.rados.0.smithi084.stdout:13: writing smithi084102331-13 from 0 to 204800 tid 1 2024-01-13T18:00:46.426 INFO:tasks.rados.rados.0.smithi084.stdout:14: write initial oid 14 2024-01-13T18:00:46.426 INFO:tasks.rados.rados.0.smithi084.stdout:14: seq_num 13 ranges {0=221184} 2024-01-13T18:00:46.426 INFO:tasks.rados.rados.0.smithi084.stdout:14: writing smithi084102331-14 from 0 to 221184 tid 1 2024-01-13T18:00:46.426 INFO:tasks.rados.rados.0.smithi084.stdout:15: write initial oid 15 2024-01-13T18:00:46.426 INFO:tasks.rados.rados.0.smithi084.stdout:15: seq_num 14 ranges {0=237568} 2024-01-13T18:00:46.426 INFO:tasks.rados.rados.0.smithi084.stdout:15: writing smithi084102331-15 from 0 to 237568 tid 1 2024-01-13T18:00:46.426 INFO:tasks.rados.rados.0.smithi084.stdout:16: write initial oid 16 2024-01-13T18:00:46.426 INFO:tasks.rados.rados.0.smithi084.stdout:16: seq_num 15 ranges {0=253952} 2024-01-13T18:00:46.428 INFO:tasks.rados.rados.0.smithi084.stdout:16: writing smithi084102331-16 from 0 to 253952 tid 1 2024-01-13T18:00:46.428 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:2: finishing write tid 1 to smithi084102331-2 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:4: finishing write tid 1 to smithi084102331-4 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:5: finishing write tid 1 to smithi084102331-5 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:2: finishing write tid 2 to smithi084102331-2 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:4: finishing write tid 2 to smithi084102331-4 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:1: finishing write tid 1 to smithi084102331-1 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:3: finishing write tid 1 to smithi084102331-3 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:4: finishing write tid 3 to smithi084102331-4 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:11: finishing write tid 1 to smithi084102331-11 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:8: finishing write tid 1 to smithi084102331-8 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:1: finishing write tid 2 to smithi084102331-1 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:2: finishing write tid 3 to smithi084102331-2 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2024-01-13T18:00:46.429 INFO:tasks.rados.rados.0.smithi084.stdout:3: finishing write tid 2 to smithi084102331-3 2024-01-13T18:00:46.430 INFO:tasks.rados.rados.0.smithi084.stdout:7: finishing write tid 1 to smithi084102331-7 2024-01-13T18:00:46.430 INFO:tasks.rados.rados.0.smithi084.stdout:6: finishing write tid 1 to smithi084102331-6 2024-01-13T18:00:46.430 INFO:tasks.rados.rados.0.smithi084.stdout:9: finishing write tid 1 to smithi084102331-9 2024-01-13T18:00:46.430 INFO:tasks.rados.rados.0.smithi084.stdout:5: finishing write tid 2 to smithi084102331-5 2024-01-13T18:00:46.430 INFO:tasks.rados.rados.0.smithi084.stdout:13: finishing write tid 1 to smithi084102331-13 2024-01-13T18:00:46.430 INFO:tasks.rados.rados.0.smithi084.stdout:12: finishing write tid 1 to smithi084102331-12 2024-01-13T18:00:46.430 INFO:tasks.rados.rados.0.smithi084.stdout:2: done (15 left) 2024-01-13T18:00:46.430 INFO:tasks.rados.rados.0.smithi084.stdout:4: done (14 left) 2024-01-13T18:00:46.430 INFO:tasks.rados.rados.0.smithi084.stdout:17: write initial oid 17 2024-01-13T18:00:46.430 INFO:tasks.rados.rados.0.smithi084.stdout:17: seq_num 16 ranges {0=270336} 2024-01-13T18:00:46.432 INFO:tasks.rados.rados.0.smithi084.stdout:17: writing smithi084102331-17 from 0 to 270336 tid 1 2024-01-13T18:00:46.432 INFO:tasks.rados.rados.0.smithi084.stdout:18: write initial oid 18 2024-01-13T18:00:46.432 INFO:tasks.rados.rados.0.smithi084.stdout:18: seq_num 17 ranges {0=286720} 2024-01-13T18:00:46.432 INFO:tasks.rados.rados.0.smithi084.stdout:18: writing smithi084102331-18 from 0 to 286720 tid 1 2024-01-13T18:00:46.432 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-01-13T18:00:46.433 INFO:tasks.rados.rados.0.smithi084.stdout:8: finishing write tid 2 to smithi084102331-8 2024-01-13T18:00:46.433 INFO:tasks.rados.rados.0.smithi084.stdout:11: finishing write tid 2 to smithi084102331-11 2024-01-13T18:00:46.433 INFO:tasks.rados.rados.0.smithi084.stdout:10: finishing write tid 1 to smithi084102331-10 2024-01-13T18:00:46.433 INFO:tasks.rados.rados.0.smithi084.stdout:5: finishing write tid 3 to smithi084102331-5 2024-01-13T18:00:46.433 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 4 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-01-13T18:00:46.433 INFO:tasks.rados.rados.0.smithi084.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:6: finishing write tid 2 to smithi084102331-6 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:12: finishing write tid 2 to smithi084102331-12 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:13: finishing write tid 2 to smithi084102331-13 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:14: finishing write tid 1 to smithi084102331-14 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:3: finishing write tid 3 to smithi084102331-3 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 4 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:1: finishing write tid 3 to smithi084102331-1 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:15: finishing write tid 1 to smithi084102331-15 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:11: finishing write tid 3 to smithi084102331-11 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 2 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:16: finishing write tid 1 to smithi084102331-16 2024-01-13T18:00:46.434 INFO:tasks.rados.rados.0.smithi084.stdout:12: finishing write tid 3 to smithi084102331-12 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 4 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:8: finishing write tid 3 to smithi084102331-8 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 2 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:15: finishing write tid 2 to smithi084102331-15 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:1: done (15 left) 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:3: done (14 left) 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:5: done (13 left) 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:8: done (12 left) 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:11: done (11 left) 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:12: done (10 left) 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:19: write initial oid 19 2024-01-13T18:00:46.435 INFO:tasks.rados.rados.0.smithi084.stdout:19: seq_num 18 ranges {0=303104} 2024-01-13T18:00:46.436 INFO:tasks.rados.rados.0.smithi084.stdout:19: writing smithi084102331-19 from 0 to 303104 tid 1 2024-01-13T18:00:46.439 INFO:tasks.rados.rados.0.smithi084.stdout:20: write initial oid 20 2024-01-13T18:00:46.440 INFO:tasks.rados.rados.0.smithi084.stdout:20: seq_num 19 ranges {0=319488} 2024-01-13T18:00:46.440 INFO:tasks.rados.rados.0.smithi084.stdout:20: writing smithi084102331-20 from 0 to 319488 tid 1 2024-01-13T18:00:46.440 INFO:tasks.rados.rados.0.smithi084.stdout:21: write initial oid 21 2024-01-13T18:00:46.440 INFO:tasks.rados.rados.0.smithi084.stdout:21: seq_num 20 ranges {0=344064} 2024-01-13T18:00:46.440 INFO:tasks.rados.rados.0.smithi084.stdout:21: writing smithi084102331-21 from 0 to 344064 tid 1 2024-01-13T18:00:46.440 INFO:tasks.rados.rados.0.smithi084.stdout:22: write initial oid 22 2024-01-13T18:00:46.441 INFO:tasks.rados.rados.0.smithi084.stdout:22: seq_num 21 ranges {0=360448} 2024-01-13T18:00:46.442 INFO:tasks.rados.rados.0.smithi084.stdout:22: writing smithi084102331-22 from 0 to 360448 tid 1 2024-01-13T18:00:46.442 INFO:tasks.rados.rados.0.smithi084.stdout:23: write initial oid 23 2024-01-13T18:00:46.442 INFO:tasks.rados.rados.0.smithi084.stdout:23: seq_num 22 ranges {0=376832} 2024-01-13T18:00:46.444 INFO:tasks.rados.rados.0.smithi084.stdout:23: writing smithi084102331-23 from 0 to 376832 tid 1 2024-01-13T18:00:46.444 INFO:tasks.rados.rados.0.smithi084.stdout:24: write initial oid 24 2024-01-13T18:00:46.444 INFO:tasks.rados.rados.0.smithi084.stdout:24: seq_num 23 ranges {0=393216} 2024-01-13T18:00:46.447 INFO:tasks.rados.rados.0.smithi084.stdout:24: writing smithi084102331-24 from 0 to 393216 tid 1 2024-01-13T18:00:46.447 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:10: finishing write tid 2 to smithi084102331-10 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:15: finishing write tid 3 to smithi084102331-15 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 4 (ObjNum 14 snap 0 seq_num 14) dirty exists 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:10: finishing write tid 3 to smithi084102331-10 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 2 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:9: finishing write tid 2 to smithi084102331-9 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:6: finishing write tid 3 to smithi084102331-6 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:16: finishing write tid 2 to smithi084102331-16 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:6: done (15 left) 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:10: done (14 left) 2024-01-13T18:00:46.448 INFO:tasks.rados.rados.0.smithi084.stdout:15: done (13 left) 2024-01-13T18:00:46.449 INFO:tasks.rados.rados.0.smithi084.stdout:25: write initial oid 25 2024-01-13T18:00:46.449 INFO:tasks.rados.rados.0.smithi084.stdout:25: seq_num 24 ranges {0=409600} 2024-01-13T18:00:46.449 INFO:tasks.rados.rados.0.smithi084.stdout:25: writing smithi084102331-25 from 0 to 409600 tid 1 2024-01-13T18:00:46.449 INFO:tasks.rados.rados.0.smithi084.stdout:26: write initial oid 26 2024-01-13T18:00:46.449 INFO:tasks.rados.rados.0.smithi084.stdout:26: seq_num 25 ranges {0=425984} 2024-01-13T18:00:46.452 INFO:tasks.rados.rados.0.smithi084.stdout:26: writing smithi084102331-26 from 0 to 425984 tid 1 2024-01-13T18:00:46.452 INFO:tasks.rados.rados.0.smithi084.stdout:27: write initial oid 27 2024-01-13T18:00:46.452 INFO:tasks.rados.rados.0.smithi084.stdout:27: seq_num 26 ranges {0=442368} 2024-01-13T18:00:46.455 INFO:tasks.rados.rados.0.smithi084.stdout:27: writing smithi084102331-27 from 0 to 442368 tid 1 2024-01-13T18:00:46.455 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-01-13T18:00:46.455 INFO:tasks.rados.rados.0.smithi084.stdout:14: finishing write tid 2 to smithi084102331-14 2024-01-13T18:00:46.455 INFO:tasks.rados.rados.0.smithi084.stdout:14: finishing write tid 3 to smithi084102331-14 2024-01-13T18:00:46.455 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 2 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-01-13T18:00:46.455 INFO:tasks.rados.rados.0.smithi084.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:16: finishing write tid 3 to smithi084102331-16 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 2 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:7: finishing write tid 2 to smithi084102331-7 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:17: finishing write tid 1 to smithi084102331-17 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:13: finishing write tid 3 to smithi084102331-13 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 6 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:9: finishing write tid 3 to smithi084102331-9 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 4 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:18: finishing write tid 1 to smithi084102331-18 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:9: done (15 left) 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:13: done (14 left) 2024-01-13T18:00:46.456 INFO:tasks.rados.rados.0.smithi084.stdout:14: done (13 left) 2024-01-13T18:00:46.457 INFO:tasks.rados.rados.0.smithi084.stdout:16: done (12 left) 2024-01-13T18:00:46.457 INFO:tasks.rados.rados.0.smithi084.stdout:28: write initial oid 28 2024-01-13T18:00:46.457 INFO:tasks.rados.rados.0.smithi084.stdout:28: seq_num 27 ranges {0=458752} 2024-01-13T18:00:46.458 INFO:tasks.rados.rados.0.smithi084.stdout:28: writing smithi084102331-28 from 0 to 458752 tid 1 2024-01-13T18:00:46.458 INFO:tasks.rados.rados.0.smithi084.stdout:29: write initial oid 29 2024-01-13T18:00:46.458 INFO:tasks.rados.rados.0.smithi084.stdout:29: seq_num 28 ranges {0=475136} 2024-01-13T18:00:46.461 INFO:tasks.rados.rados.0.smithi084.stdout:29: writing smithi084102331-29 from 0 to 475136 tid 1 2024-01-13T18:00:46.461 INFO:tasks.rados.rados.0.smithi084.stdout:30: write initial oid 30 2024-01-13T18:00:46.461 INFO:tasks.rados.rados.0.smithi084.stdout:30: seq_num 29 ranges {0=491520} 2024-01-13T18:00:46.463 INFO:tasks.rados.rados.0.smithi084.stdout:30: writing smithi084102331-30 from 0 to 491520 tid 1 2024-01-13T18:00:46.464 INFO:tasks.rados.rados.0.smithi084.stdout:31: write initial oid 31 2024-01-13T18:00:46.464 INFO:tasks.rados.rados.0.smithi084.stdout:31: seq_num 30 ranges {0=507904} 2024-01-13T18:00:46.468 INFO:tasks.rados.rados.0.smithi084.stdout:31: writing smithi084102331-31 from 0 to 507904 tid 1 2024-01-13T18:00:46.468 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-01-13T18:00:46.468 INFO:tasks.rados.rados.0.smithi084.stdout:19: finishing write tid 1 to smithi084102331-19 2024-01-13T18:00:46.468 INFO:tasks.rados.rados.0.smithi084.stdout:18: finishing write tid 2 to smithi084102331-18 2024-01-13T18:00:46.468 INFO:tasks.rados.rados.0.smithi084.stdout:17: finishing write tid 2 to smithi084102331-17 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:7: finishing write tid 3 to smithi084102331-7 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:18: finishing write tid 3 to smithi084102331-18 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 4 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:17: finishing write tid 3 to smithi084102331-17 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 8 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:19: finishing write tid 2 to smithi084102331-19 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:20: finishing write tid 1 to smithi084102331-20 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:21: finishing write tid 1 to smithi084102331-21 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:20: finishing write tid 2 to smithi084102331-20 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:19: finishing write tid 3 to smithi084102331-19 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 2 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2024-01-13T18:00:46.469 INFO:tasks.rados.rados.0.smithi084.stdout:21: finishing write tid 2 to smithi084102331-21 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:21: finishing write tid 3 to smithi084102331-21 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 2 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:20: finishing write tid 3 to smithi084102331-20 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 4 (ObjNum 19 snap 0 seq_num 19) dirty exists 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:22: finishing write tid 1 to smithi084102331-22 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:22: finishing write tid 2 to smithi084102331-22 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:23: finishing write tid 1 to smithi084102331-23 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:24: finishing write tid 1 to smithi084102331-24 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:23: finishing write tid 2 to smithi084102331-23 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:22: finishing write tid 3 to smithi084102331-22 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 6 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:24: finishing write tid 2 to smithi084102331-24 2024-01-13T18:00:46.470 INFO:tasks.rados.rados.0.smithi084.stdout:23: finishing write tid 3 to smithi084102331-23 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 8 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:24: finishing write tid 3 to smithi084102331-24 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 4 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:25: finishing write tid 1 to smithi084102331-25 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:25: finishing write tid 2 to smithi084102331-25 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:26: finishing write tid 1 to smithi084102331-26 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:25: finishing write tid 3 to smithi084102331-25 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 2 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:26: finishing write tid 2 to smithi084102331-26 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:26: finishing write tid 3 to smithi084102331-26 2024-01-13T18:00:46.471 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 4 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:27: finishing write tid 1 to smithi084102331-27 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:27: finishing write tid 2 to smithi084102331-27 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:27: finishing write tid 3 to smithi084102331-27 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 4 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:28: finishing write tid 1 to smithi084102331-28 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:28: finishing write tid 2 to smithi084102331-28 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:28: finishing write tid 3 to smithi084102331-28 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 6 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:29: finishing write tid 1 to smithi084102331-29 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:29: finishing write tid 2 to smithi084102331-29 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:29: finishing write tid 3 to smithi084102331-29 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 4 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-01-13T18:00:46.472 INFO:tasks.rados.rados.0.smithi084.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:30: finishing write tid 1 to smithi084102331-30 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:7: done (15 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:17: done (14 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:18: done (13 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:19: done (12 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:20: done (11 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:21: done (10 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:22: done (9 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:23: done (8 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:24: done (7 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:25: done (6 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:26: done (5 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:27: done (4 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:28: done (3 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:29: done (2 left) 2024-01-13T18:00:46.473 INFO:tasks.rados.rados.0.smithi084.stdout:32: write initial oid 32 2024-01-13T18:00:46.474 INFO:tasks.rados.rados.0.smithi084.stdout:32: seq_num 31 ranges {0=524288} 2024-01-13T18:00:46.474 INFO:tasks.rados.rados.0.smithi084.stdout:32: writing smithi084102331-32 from 0 to 524288 tid 1 2024-01-13T18:00:46.474 INFO:tasks.rados.rados.0.smithi084.stdout:33: write initial oid 33 2024-01-13T18:00:46.475 INFO:tasks.rados.rados.0.smithi084.stdout:33: seq_num 32 ranges {0=540672} 2024-01-13T18:00:46.475 INFO:tasks.rados.rados.0.smithi084.stdout:33: writing smithi084102331-33 from 0 to 540672 tid 1 2024-01-13T18:00:46.475 INFO:tasks.rados.rados.0.smithi084.stdout:34: write initial oid 34 2024-01-13T18:00:46.475 INFO:tasks.rados.rados.0.smithi084.stdout:34: seq_num 33 ranges {0=557056} 2024-01-13T18:00:46.477 INFO:tasks.rados.rados.0.smithi084.stdout:34: writing smithi084102331-34 from 0 to 557056 tid 1 2024-01-13T18:00:46.477 INFO:tasks.rados.rados.0.smithi084.stdout:35: write initial oid 35 2024-01-13T18:00:46.477 INFO:tasks.rados.rados.0.smithi084.stdout:35: seq_num 34 ranges {0=573440} 2024-01-13T18:00:46.480 INFO:tasks.rados.rados.0.smithi084.stdout:35: writing smithi084102331-35 from 0 to 573440 tid 1 2024-01-13T18:00:46.481 INFO:tasks.rados.rados.0.smithi084.stdout:36: write initial oid 36 2024-01-13T18:00:46.481 INFO:tasks.rados.rados.0.smithi084.stdout:36: seq_num 35 ranges {0=589824} 2024-01-13T18:00:46.484 INFO:tasks.rados.rados.0.smithi084.stdout:36: writing smithi084102331-36 from 0 to 589824 tid 1 2024-01-13T18:00:46.484 INFO:tasks.rados.rados.0.smithi084.stdout:37: write initial oid 37 2024-01-13T18:00:46.484 INFO:tasks.rados.rados.0.smithi084.stdout:37: seq_num 36 ranges {0=606208} 2024-01-13T18:00:46.488 INFO:tasks.rados.rados.0.smithi084.stdout:37: writing smithi084102331-37 from 0 to 606208 tid 1 2024-01-13T18:00:46.488 INFO:tasks.rados.rados.0.smithi084.stdout:38: write initial oid 38 2024-01-13T18:00:46.489 INFO:tasks.rados.rados.0.smithi084.stdout:38: seq_num 37 ranges {0=622592} 2024-01-13T18:00:46.492 INFO:tasks.rados.rados.0.smithi084.stdout:38: writing smithi084102331-38 from 0 to 622592 tid 1 2024-01-13T18:00:46.492 INFO:tasks.rados.rados.0.smithi084.stdout:39: write initial oid 39 2024-01-13T18:00:46.492 INFO:tasks.rados.rados.0.smithi084.stdout:39: seq_num 38 ranges {0=638976} 2024-01-13T18:00:46.497 INFO:tasks.rados.rados.0.smithi084.stdout:39: writing smithi084102331-39 from 0 to 638976 tid 1 2024-01-13T18:00:46.497 INFO:tasks.rados.rados.0.smithi084.stdout:40: write initial oid 40 2024-01-13T18:00:46.497 INFO:tasks.rados.rados.0.smithi084.stdout:40: seq_num 39 ranges {0=663552} 2024-01-13T18:00:46.501 INFO:tasks.rados.rados.0.smithi084.stdout:40: writing smithi084102331-40 from 0 to 663552 tid 1 2024-01-13T18:00:46.501 INFO:tasks.rados.rados.0.smithi084.stdout:41: write initial oid 41 2024-01-13T18:00:46.501 INFO:tasks.rados.rados.0.smithi084.stdout:41: seq_num 40 ranges {0=679936} 2024-01-13T18:00:46.505 INFO:tasks.rados.rados.0.smithi084.stdout:41: writing smithi084102331-41 from 0 to 679936 tid 1 2024-01-13T18:00:46.505 INFO:tasks.rados.rados.0.smithi084.stdout:42: write initial oid 42 2024-01-13T18:00:46.505 INFO:tasks.rados.rados.0.smithi084.stdout:42: seq_num 41 ranges {0=696320} 2024-01-13T18:00:46.509 INFO:tasks.rados.rados.0.smithi084.stdout:42: writing smithi084102331-42 from 0 to 696320 tid 1 2024-01-13T18:00:46.509 INFO:tasks.rados.rados.0.smithi084.stdout:43: write initial oid 43 2024-01-13T18:00:46.509 INFO:tasks.rados.rados.0.smithi084.stdout:43: seq_num 42 ranges {0=712704} 2024-01-13T18:00:46.514 INFO:tasks.rados.rados.0.smithi084.stdout:43: writing smithi084102331-43 from 0 to 712704 tid 1 2024-01-13T18:00:46.514 INFO:tasks.rados.rados.0.smithi084.stdout:44: write initial oid 44 2024-01-13T18:00:46.514 INFO:tasks.rados.rados.0.smithi084.stdout:44: seq_num 43 ranges {0=729088} 2024-01-13T18:00:46.519 INFO:tasks.rados.rados.0.smithi084.stdout:44: writing smithi084102331-44 from 0 to 729088 tid 1 2024-01-13T18:00:46.519 INFO:tasks.rados.rados.0.smithi084.stdout:45: write initial oid 45 2024-01-13T18:00:46.519 INFO:tasks.rados.rados.0.smithi084.stdout:45: seq_num 44 ranges {0=745472} 2024-01-13T18:00:46.524 INFO:tasks.rados.rados.0.smithi084.stdout:45: writing smithi084102331-45 from 0 to 745472 tid 1 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:30: finishing write tid 2 to smithi084102331-30 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:30: finishing write tid 3 to smithi084102331-30 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 4 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:31: finishing write tid 1 to smithi084102331-31 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:31: finishing write tid 2 to smithi084102331-31 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:31: finishing write tid 3 to smithi084102331-31 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 6 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:32: finishing write tid 1 to smithi084102331-32 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:32: finishing write tid 2 to smithi084102331-32 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:32: finishing write tid 3 to smithi084102331-32 2024-01-13T18:00:46.525 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 6 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:33: finishing write tid 1 to smithi084102331-33 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:33: finishing write tid 2 to smithi084102331-33 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:33: finishing write tid 3 to smithi084102331-33 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 6 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:34: finishing write tid 1 to smithi084102331-34 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:34: finishing write tid 2 to smithi084102331-34 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:30: done (15 left) 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:31: done (14 left) 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:32: done (13 left) 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:33: done (12 left) 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:46: write initial oid 46 2024-01-13T18:00:46.526 INFO:tasks.rados.rados.0.smithi084.stdout:46: seq_num 45 ranges {0=761856} 2024-01-13T18:00:46.529 INFO:tasks.rados.rados.0.smithi084.stdout:46: writing smithi084102331-46 from 0 to 761856 tid 1 2024-01-13T18:00:46.529 INFO:tasks.rados.rados.0.smithi084.stdout:47: write initial oid 47 2024-01-13T18:00:46.529 INFO:tasks.rados.rados.0.smithi084.stdout:34: finishing write tid 3 to smithi084102331-34 2024-01-13T18:00:46.529 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 6 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-01-13T18:00:46.529 INFO:tasks.rados.rados.0.smithi084.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2024-01-13T18:00:46.529 INFO:tasks.rados.rados.0.smithi084.stdout:35: finishing write tid 1 to smithi084102331-35 2024-01-13T18:00:46.529 INFO:tasks.rados.rados.0.smithi084.stdout:47: seq_num 46 ranges {0=778240} 2024-01-13T18:00:46.534 INFO:tasks.rados.rados.0.smithi084.stdout:47: writing smithi084102331-47 from 0 to 778240 tid 1 2024-01-13T18:00:46.534 INFO:tasks.rados.rados.0.smithi084.stdout:34: done (13 left) 2024-01-13T18:00:46.534 INFO:tasks.rados.rados.0.smithi084.stdout:48: write initial oid 48 2024-01-13T18:00:46.534 INFO:tasks.rados.rados.0.smithi084.stdout:48: seq_num 47 ranges {0=794624} 2024-01-13T18:00:46.539 INFO:tasks.rados.rados.0.smithi084.stdout:48: writing smithi084102331-48 from 0 to 794624 tid 1 2024-01-13T18:00:46.539 INFO:tasks.rados.rados.0.smithi084.stdout:49: write initial oid 49 2024-01-13T18:00:46.539 INFO:tasks.rados.rados.0.smithi084.stdout:49: seq_num 48 ranges {0=409600,409600=401408} 2024-01-13T18:00:46.541 INFO:tasks.rados.rados.0.smithi084.stdout:49: writing smithi084102331-49 from 0 to 409600 tid 1 2024-01-13T18:00:46.544 INFO:tasks.rados.rados.0.smithi084.stdout:49: writing smithi084102331-49 from 409600 to 811008 tid 2 2024-01-13T18:00:46.544 INFO:tasks.rados.rados.0.smithi084.stdout:50: write initial oid 50 2024-01-13T18:00:46.544 INFO:tasks.rados.rados.0.smithi084.stdout:50: seq_num 49 ranges {0=425984,425984=401408} 2024-01-13T18:00:46.546 INFO:tasks.rados.rados.0.smithi084.stdout:50: writing smithi084102331-50 from 0 to 425984 tid 1 2024-01-13T18:00:46.552 INFO:tasks.rados.rados.0.smithi084.stdout:50: writing smithi084102331-50 from 425984 to 827392 tid 2 2024-01-13T18:00:46.552 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-01-13T18:00:46.552 INFO:tasks.rados.rados.0.smithi084.stdout:35: finishing write tid 2 to smithi084102331-35 2024-01-13T18:00:46.552 INFO:tasks.rados.rados.0.smithi084.stdout:35: finishing write tid 3 to smithi084102331-35 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 6 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:36: finishing write tid 1 to smithi084102331-36 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:36: finishing write tid 2 to smithi084102331-36 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:36: finishing write tid 3 to smithi084102331-36 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 6 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:37: finishing write tid 1 to smithi084102331-37 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:37: finishing write tid 2 to smithi084102331-37 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:37: finishing write tid 3 to smithi084102331-37 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 8 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:38: finishing write tid 1 to smithi084102331-38 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:38: finishing write tid 2 to smithi084102331-38 2024-01-13T18:00:46.553 INFO:tasks.rados.rados.0.smithi084.stdout:38: finishing write tid 3 to smithi084102331-38 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 8 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:39: finishing write tid 1 to smithi084102331-39 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:39: finishing write tid 2 to smithi084102331-39 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:39: finishing write tid 3 to smithi084102331-39 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 4 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:40: finishing write tid 1 to smithi084102331-40 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:40: finishing write tid 2 to smithi084102331-40 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:40: finishing write tid 3 to smithi084102331-40 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 8 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:41: finishing write tid 1 to smithi084102331-41 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:41: finishing write tid 2 to smithi084102331-41 2024-01-13T18:00:46.554 INFO:tasks.rados.rados.0.smithi084.stdout:41: finishing write tid 3 to smithi084102331-41 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 6 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:35: done (15 left) 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:36: done (14 left) 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:37: done (13 left) 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:38: done (12 left) 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:39: done (11 left) 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:40: done (10 left) 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:41: done (9 left) 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:51: copy_from oid 5 from oid 1 current snap is 0 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:42: finishing write tid 1 to smithi084102331-42 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:42: finishing write tid 2 to smithi084102331-42 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:42: finishing write tid 3 to smithi084102331-42 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 2 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2024-01-13T18:00:46.555 INFO:tasks.rados.rados.0.smithi084.stdout:43: finishing write tid 1 to smithi084102331-43 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:43: finishing write tid 2 to smithi084102331-43 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:43: finishing write tid 3 to smithi084102331-43 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 6 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:44: finishing write tid 1 to smithi084102331-44 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:44: finishing write tid 2 to smithi084102331-44 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:44: finishing write tid 3 to smithi084102331-44 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 8 (ObjNum 43 snap 0 seq_num 43) dirty exists 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:42: done (9 left) 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:43: done (8 left) 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:44: done (7 left) 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 0 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:45: finishing write tid 1 to smithi084102331-45 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:45: finishing write tid 2 to smithi084102331-45 2024-01-13T18:00:46.556 INFO:tasks.rados.rados.0.smithi084.stdout:45: finishing write tid 3 to smithi084102331-45 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 10 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:46: finishing write tid 1 to smithi084102331-46 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:46: finishing write tid 2 to smithi084102331-46 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:46: finishing write tid 3 to smithi084102331-46 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 8 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:47: finishing write tid 1 to smithi084102331-47 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:47: finishing write tid 2 to smithi084102331-47 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:47: finishing write tid 3 to smithi084102331-47 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 10 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:48: finishing write tid 1 to smithi084102331-48 2024-01-13T18:00:46.557 INFO:tasks.rados.rados.0.smithi084.stdout:48: finishing write tid 2 to smithi084102331-48 2024-01-13T18:00:46.558 INFO:tasks.rados.rados.0.smithi084.stdout:49: finishing write tid 1 to smithi084102331-49 2024-01-13T18:00:46.558 INFO:tasks.rados.rados.0.smithi084.stdout:48: finishing write tid 3 to smithi084102331-48 2024-01-13T18:00:46.558 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 10 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-01-13T18:00:46.558 INFO:tasks.rados.rados.0.smithi084.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:00:46.558 INFO:tasks.rados.rados.0.smithi084.stdout:49: finishing write tid 2 to smithi084102331-49 2024-01-13T18:00:46.558 INFO:tasks.rados.rados.0.smithi084.stdout:49: finishing write tid 3 to smithi084102331-49 2024-01-13T18:00:46.558 INFO:tasks.rados.rados.0.smithi084.stdout:49: finishing write tid 4 to smithi084102331-49 2024-01-13T18:00:46.558 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-01-13T18:00:46.558 INFO:tasks.rados.rados.0.smithi084.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2024-01-13T18:00:46.558 INFO:tasks.rados.rados.0.smithi084.stdout:50: finishing write tid 1 to smithi084102331-50 2024-01-13T18:00:46.558 INFO:tasks.rados.rados.0.smithi084.stdout:52: seq_num 50 ranges {606208=442368,1048576=401408} 2024-01-13T18:00:46.560 INFO:tasks.rados.rados.0.smithi084.stdout:52: writing smithi084102331-37 from 606208 to 1048576 tid 1 2024-01-13T18:00:46.560 INFO:tasks.rados.rados.0.smithi084.stdout:52: writing smithi084102331-37 from 1048576 to 1449984 tid 2 2024-01-13T18:00:46.560 INFO:tasks.rados.rados.0.smithi084.stdout:45: done (7 left) 2024-01-13T18:00:46.560 INFO:tasks.rados.rados.0.smithi084.stdout:46: done (6 left) 2024-01-13T18:00:46.560 INFO:tasks.rados.rados.0.smithi084.stdout:47: done (5 left) 2024-01-13T18:00:46.560 INFO:tasks.rados.rados.0.smithi084.stdout:48: done (4 left) 2024-01-13T18:00:46.561 INFO:tasks.rados.rados.0.smithi084.stdout:49: done (3 left) 2024-01-13T18:00:46.561 INFO:tasks.rados.rados.0.smithi084.stdout:53: rmattr oid 23 current snap is 0 2024-01-13T18:00:46.561 INFO:tasks.rados.rados.0.smithi084.stdout:53: done (3 left) 2024-01-13T18:00:46.561 INFO:tasks.rados.rados.0.smithi084.stdout:54: delete oid 11 current snap is 0 2024-01-13T18:00:46.561 INFO:tasks.rados.rados.0.smithi084.stdout:50: finishing write tid 2 to smithi084102331-50 2024-01-13T18:00:46.561 INFO:tasks.rados.rados.0.smithi084.stdout:50: finishing write tid 3 to smithi084102331-50 2024-01-13T18:00:46.561 INFO:tasks.rados.rados.0.smithi084.stdout:51: finishing copy_from to smithi084102331-5 2024-01-13T18:00:46.561 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-01-13T18:00:46.561 INFO:tasks.rados.rados.0.smithi084.stdout:50: finishing write tid 4 to smithi084102331-50 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 11 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:51: finishing copy_from racing read to smithi084102331-5 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:52: finishing write tid 1 to smithi084102331-37 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:50: done (3 left) 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:51: done (2 left) 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:54: done (1 left) 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:55: read oid 15 snap -1 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:55: expect (ObjNum 14 snap 0 seq_num 14) 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:56: rollback oid 30 current snap is 0 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:56: done (2 left) 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:57: read oid 27 snap -1 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:57: expect (ObjNum 26 snap 0 seq_num 26) 2024-01-13T18:00:46.562 INFO:tasks.rados.rados.0.smithi084.stdout:58: copy_from oid 28 from oid 47 current snap is 0 2024-01-13T18:00:46.563 INFO:tasks.rados.rados.0.smithi084.stdout:59: rollback oid 45 current snap is 0 2024-01-13T18:00:46.563 INFO:tasks.rados.rados.0.smithi084.stdout:59: done (4 left) 2024-01-13T18:00:46.563 INFO:tasks.rados.rados.0.smithi084.stdout:60: copy_from oid 22 from oid 48 current snap is 0 2024-01-13T18:00:46.563 INFO:tasks.rados.rados.0.smithi084.stdout:61: delete oid 1 current snap is 0 2024-01-13T18:00:46.563 INFO:tasks.rados.rados.0.smithi084.stdout:52: finishing write tid 2 to smithi084102331-37 2024-01-13T18:00:46.563 INFO:tasks.rados.rados.0.smithi084.stdout:52: finishing write tid 3 to smithi084102331-37 2024-01-13T18:00:46.563 INFO:tasks.rados.rados.0.smithi084.stdout:61: done (5 left) 2024-01-13T18:00:46.563 INFO:tasks.rados.rados.0.smithi084.stdout:62: read oid 17 snap -1 2024-01-13T18:00:46.563 INFO:tasks.rados.rados.0.smithi084.stdout:62: expect (ObjNum 16 snap 0 seq_num 16) 2024-01-13T18:00:46.563 INFO:tasks.rados.rados.0.smithi084.stdout:63: snap_create 2024-01-13T18:00:46.564 INFO:tasks.rados.rados.0.smithi084.stdout:52: finishing write tid 4 to smithi084102331-37 2024-01-13T18:00:46.564 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 14 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-01-13T18:00:46.564 INFO:tasks.rados.rados.0.smithi084.stdout:52: left oid 37 (ObjNum 50 snap 0 seq_num 50) 2024-01-13T18:00:46.564 INFO:tasks.rados.rados.0.smithi084.stdout:55: expect (ObjNum 14 snap 0 seq_num 14) 2024-01-13T18:00:46.569 INFO:tasks.rados.rados.0.smithi084.stdout:57: expect (ObjNum 26 snap 0 seq_num 26) 2024-01-13T18:00:46.583 INFO:tasks.rados.rados.0.smithi084.stdout:60: finishing copy_from to smithi084102331-22 2024-01-13T18:00:46.583 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 10 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-01-13T18:00:46.583 INFO:tasks.rados.rados.0.smithi084.stdout:60: finishing copy_from racing read to smithi084102331-22 2024-01-13T18:00:46.583 INFO:tasks.rados.rados.0.smithi084.stdout:62: expect (ObjNum 16 snap 0 seq_num 16) 2024-01-13T18:00:46.592 INFO:tasks.rados.rados.0.smithi084.stdout:58: finishing copy_from to smithi084102331-28 2024-01-13T18:00:46.592 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 10 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-01-13T18:00:46.592 INFO:tasks.rados.rados.0.smithi084.stdout:58: finishing copy_from racing read to smithi084102331-28 2024-01-13T18:00:46.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:46] "GET /metrics HTTP/1.1" 200 235815 "" "Prometheus/2.43.0" 2024-01-13T18:00:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:46 smithi084 ceph-mon[37908]: pgmap v61: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:46 smithi084 ceph-mon[37908]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:00:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:46 smithi084 ceph-mon[37908]: Cluster is now healthy 2024-01-13T18:00:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:46 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/702473961' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-01-13T18:00:46.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:46 smithi084 ceph-mon[52328]: pgmap v61: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:46.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:46 smithi084 ceph-mon[52328]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:00:46.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:46 smithi084 ceph-mon[52328]: Cluster is now healthy 2024-01-13T18:00:46.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:46 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/702473961' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-01-13T18:00:46.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:46 smithi099 ceph-mon[71325]: pgmap v61: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:46.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:46 smithi099 ceph-mon[71325]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:00:46.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:46 smithi099 ceph-mon[71325]: Cluster is now healthy 2024-01-13T18:00:46.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:46 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/702473961' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-01-13T18:00:47.417 INFO:tasks.rados.rados.0.smithi084.stdout:52: done (6 left) 2024-01-13T18:00:47.417 INFO:tasks.rados.rados.0.smithi084.stdout:55: done (5 left) 2024-01-13T18:00:47.417 INFO:tasks.rados.rados.0.smithi084.stdout:57: done (4 left) 2024-01-13T18:00:47.417 INFO:tasks.rados.rados.0.smithi084.stdout:58: done (3 left) 2024-01-13T18:00:47.417 INFO:tasks.rados.rados.0.smithi084.stdout:60: done (2 left) 2024-01-13T18:00:47.417 INFO:tasks.rados.rados.0.smithi084.stdout:62: done (1 left) 2024-01-13T18:00:47.417 INFO:tasks.rados.rados.0.smithi084.stdout:63: done (0 left) 2024-01-13T18:00:47.418 INFO:tasks.rados.rados.0.smithi084.stdout:64: copy_from oid 15 from oid 2 current snap is 1 2024-01-13T18:00:47.418 INFO:tasks.rados.rados.0.smithi084.stdout:65: read oid 30 snap -1 2024-01-13T18:00:47.418 INFO:tasks.rados.rados.0.smithi084.stdout:65: expect (ObjNum 29 snap 0 seq_num 29) 2024-01-13T18:00:47.418 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 1 2024-01-13T18:00:47.418 INFO:tasks.rados.rados.0.smithi084.stdout:66: seq_num 53 ranges {376832=491520,868352=401408} 2024-01-13T18:00:47.422 INFO:tasks.rados.rados.0.smithi084.stdout:66: writing smithi084102331-23 from 376832 to 868352 tid 1 2024-01-13T18:00:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:66: writing smithi084102331-23 from 868352 to 1269760 tid 2 2024-01-13T18:00:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:67: rollback oid 10 current snap is 1 2024-01-13T18:00:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 0 2024-01-13T18:00:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:68: setattr oid 32 current snap is 1 2024-01-13T18:00:47.426 INFO:tasks.rados.rados.0.smithi084.stdout:65: expect (ObjNum 29 snap 0 seq_num 29) 2024-01-13T18:00:47.440 INFO:tasks.rados.rados.0.smithi084.stdout:64: finishing copy_from to smithi084102331-15 2024-01-13T18:00:47.440 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-01-13T18:00:47.440 INFO:tasks.rados.rados.0.smithi084.stdout:64: finishing copy_from racing read to smithi084102331-15 2024-01-13T18:00:47.440 INFO:tasks.rados.rados.0.smithi084.stdout:66: finishing write tid 1 to smithi084102331-23 2024-01-13T18:00:47.440 INFO:tasks.rados.rados.0.smithi084.stdout:67: finishing rollback tid 0 to smithi084102331-10 2024-01-13T18:00:47.440 INFO:tasks.rados.rados.0.smithi084.stdout:67: finishing rollback tid 1 to smithi084102331-10 2024-01-13T18:00:47.440 INFO:tasks.rados.rados.0.smithi084.stdout:67: finishing rollback tid 2 to smithi084102331-10 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 8 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:66: finishing write tid 2 to smithi084102331-23 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:66: finishing write tid 3 to smithi084102331-23 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:66: finishing write tid 4 to smithi084102331-23 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 15 (ObjNum 53 snap 1 seq_num 53) dirty exists 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:66: left oid 23 (ObjNum 53 snap 1 seq_num 53) 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:64: done (4 left) 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:65: done (3 left) 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:66: done (2 left) 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:67: done (1 left) 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:69: copy_from oid 45 from oid 34 current snap is 1 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:70: read oid 23 snap 0 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:70: expect (ObjNum 22 snap 0 seq_num 22) 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:71: copy_from oid 36 from oid 27 current snap is 1 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:72: rollback oid 49 current snap is 1 2024-01-13T18:00:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 0 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:73: read oid 4 snap 0 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:73: expect (ObjNum 3 snap 0 seq_num 3) 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:74: rmattr oid 7 current snap is 1 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:74: done (6 left) 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:75: copy_from oid 20 from oid 12 current snap is 1 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:76: read oid 39 snap -1 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:76: expect (ObjNum 38 snap 0 seq_num 38) 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:77: copy_from oid 6 from oid 37 current snap is 1 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:78: read oid 2 snap -1 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:78: expect (ObjNum 1 snap 0 seq_num 1) 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:79: setattr oid 41 current snap is 1 2024-01-13T18:00:47.442 INFO:tasks.rados.rados.0.smithi084.stdout:80: snap_create 2024-01-13T18:00:47.443 INFO:tasks.rados.rados.0.smithi084.stdout:73: expect (ObjNum 3 snap 0 seq_num 3) 2024-01-13T18:00:47.444 INFO:tasks.rados.rados.0.smithi084.stdout:72: finishing rollback tid 0 to smithi084102331-49 2024-01-13T18:00:47.444 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 14 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-01-13T18:00:47.444 INFO:tasks.rados.rados.0.smithi084.stdout:72: finishing rollback tid 1 to smithi084102331-49 2024-01-13T18:00:47.445 INFO:tasks.rados.rados.0.smithi084.stdout:70: expect (ObjNum 22 snap 0 seq_num 22) 2024-01-13T18:00:47.456 INFO:tasks.rados.rados.0.smithi084.stdout:72: finishing rollback tid 2 to smithi084102331-49 2024-01-13T18:00:47.456 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 13 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-01-13T18:00:47.456 INFO:tasks.rados.rados.0.smithi084.stdout:78: expect (ObjNum 1 snap 0 seq_num 1) 2024-01-13T18:00:47.457 INFO:tasks.rados.rados.0.smithi084.stdout:71: finishing copy_from to smithi084102331-36 2024-01-13T18:00:47.457 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 4 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-01-13T18:00:47.457 INFO:tasks.rados.rados.0.smithi084.stdout:71: finishing copy_from racing read to smithi084102331-36 2024-01-13T18:00:47.457 INFO:tasks.rados.rados.0.smithi084.stdout:69: finishing copy_from to smithi084102331-45 2024-01-13T18:00:47.457 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 6 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-01-13T18:00:47.457 INFO:tasks.rados.rados.0.smithi084.stdout:76: expect (ObjNum 38 snap 0 seq_num 38) 2024-01-13T18:00:47.479 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 11 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-01-13T18:00:47.479 INFO:tasks.rados.rados.0.smithi084.stdout:69: finishing copy_from racing read to smithi084102331-45 2024-01-13T18:00:47.480 INFO:tasks.rados.rados.0.smithi084.stdout:75: finishing copy_from to smithi084102331-20 2024-01-13T18:00:47.480 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 4 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-01-13T18:00:47.480 INFO:tasks.rados.rados.0.smithi084.stdout:75: finishing copy_from racing read to smithi084102331-20 2024-01-13T18:00:47.480 INFO:tasks.rados.rados.0.smithi084.stdout:77: finishing copy_from to smithi084102331-6 2024-01-13T18:00:47.480 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 14 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-01-13T18:00:47.480 INFO:tasks.rados.rados.0.smithi084.stdout:77: finishing copy_from racing read to smithi084102331-6 2024-01-13T18:00:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:47 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/702473961' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-01-13T18:00:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:47 smithi084 ceph-mon[37908]: osdmap e71: 8 total, 8 up, 8 in 2024-01-13T18:00:47.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:47 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/702473961' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-01-13T18:00:47.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:47 smithi084 ceph-mon[52328]: osdmap e71: 8 total, 8 up, 8 in 2024-01-13T18:00:47.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:47 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/702473961' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-01-13T18:00:47.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:47 smithi099 ceph-mon[71325]: osdmap e71: 8 total, 8 up, 8 in 2024-01-13T18:00:48.428 INFO:tasks.rados.rados.0.smithi084.stdout:68: done (11 left) 2024-01-13T18:00:48.428 INFO:tasks.rados.rados.0.smithi084.stdout:69: done (10 left) 2024-01-13T18:00:48.428 INFO:tasks.rados.rados.0.smithi084.stdout:70: done (9 left) 2024-01-13T18:00:48.428 INFO:tasks.rados.rados.0.smithi084.stdout:71: done (8 left) 2024-01-13T18:00:48.428 INFO:tasks.rados.rados.0.smithi084.stdout:72: done (7 left) 2024-01-13T18:00:48.428 INFO:tasks.rados.rados.0.smithi084.stdout:73: done (6 left) 2024-01-13T18:00:48.428 INFO:tasks.rados.rados.0.smithi084.stdout:75: done (5 left) 2024-01-13T18:00:48.428 INFO:tasks.rados.rados.0.smithi084.stdout:76: done (4 left) 2024-01-13T18:00:48.428 INFO:tasks.rados.rados.0.smithi084.stdout:77: done (3 left) 2024-01-13T18:00:48.428 INFO:tasks.rados.rados.0.smithi084.stdout:78: done (2 left) 2024-01-13T18:00:48.428 INFO:tasks.rados.rados.0.smithi084.stdout:79: done (1 left) 2024-01-13T18:00:48.429 INFO:tasks.rados.rados.0.smithi084.stdout:80: done (0 left) 2024-01-13T18:00:48.429 INFO:tasks.rados.rados.0.smithi084.stdout:81: rollback oid 40 current snap is 2 2024-01-13T18:00:48.429 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 1 2024-01-13T18:00:48.429 INFO:tasks.rados.rados.0.smithi084.stdout:82: snap_create 2024-01-13T18:00:48.429 INFO:tasks.rados.rados.0.smithi084.stdout:81: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:00:48.429 INFO:tasks.rados.rados.0.smithi084.stdout:81: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:00:48.430 INFO:tasks.rados.rados.0.smithi084.stdout:81: finishing rollback tid 2 to smithi084102331-40 2024-01-13T18:00:48.430 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 12 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-01-13T18:00:48.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:48 smithi084 ceph-mon[37908]: pgmap v63: 121 pgs: 121 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:48.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:48 smithi084 ceph-mon[37908]: osdmap e72: 8 total, 8 up, 8 in 2024-01-13T18:00:48.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:48 smithi084 ceph-mon[52328]: pgmap v63: 121 pgs: 121 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:48.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:48 smithi084 ceph-mon[52328]: osdmap e72: 8 total, 8 up, 8 in 2024-01-13T18:00:48.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:48 smithi099 ceph-mon[71325]: pgmap v63: 121 pgs: 121 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:48.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:48 smithi099 ceph-mon[71325]: osdmap e72: 8 total, 8 up, 8 in 2024-01-13T18:00:49.440 INFO:tasks.rados.rados.0.smithi084.stdout:81: done (1 left) 2024-01-13T18:00:49.440 INFO:tasks.rados.rados.0.smithi084.stdout:82: done (0 left) 2024-01-13T18:00:49.440 INFO:tasks.rados.rados.0.smithi084.stdout:83: rollback oid 9 current snap is 3 2024-01-13T18:00:49.440 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 0 2024-01-13T18:00:49.440 INFO:tasks.rados.rados.0.smithi084.stdout:84: read oid 20 snap 1 2024-01-13T18:00:49.440 INFO:tasks.rados.rados.0.smithi084.stdout:84: expect (ObjNum 11 snap 0 seq_num 11) 2024-01-13T18:00:49.440 INFO:tasks.rados.rados.0.smithi084.stdout:85: read oid 41 snap -1 2024-01-13T18:00:49.440 INFO:tasks.rados.rados.0.smithi084.stdout:85: expect (ObjNum 40 snap 0 seq_num 40) 2024-01-13T18:00:49.441 INFO:tasks.rados.rados.0.smithi084.stdout:86: snap_create 2024-01-13T18:00:49.444 INFO:tasks.rados.rados.0.smithi084.stdout:83: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:00:49.445 INFO:tasks.rados.rados.0.smithi084.stdout:83: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:00:49.445 INFO:tasks.rados.rados.0.smithi084.stdout:83: finishing rollback tid 2 to smithi084102331-9 2024-01-13T18:00:49.445 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 17 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-01-13T18:00:49.447 INFO:tasks.rados.rados.0.smithi084.stdout:84: expect (ObjNum 11 snap 0 seq_num 11) 2024-01-13T18:00:49.452 INFO:tasks.rados.rados.0.smithi084.stdout:85: expect (ObjNum 40 snap 0 seq_num 40) 2024-01-13T18:00:49.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:49 smithi099 ceph-mon[71325]: osdmap e73: 8 total, 8 up, 8 in 2024-01-13T18:00:49.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:49 smithi084 ceph-mon[37908]: osdmap e73: 8 total, 8 up, 8 in 2024-01-13T18:00:49.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:49 smithi084 ceph-mon[52328]: osdmap e73: 8 total, 8 up, 8 in 2024-01-13T18:00:50.436 INFO:tasks.rados.rados.0.smithi084.stdout:83: done (3 left) 2024-01-13T18:00:50.437 INFO:tasks.rados.rados.0.smithi084.stdout:84: done (2 left) 2024-01-13T18:00:50.437 INFO:tasks.rados.rados.0.smithi084.stdout:85: done (1 left) 2024-01-13T18:00:50.437 INFO:tasks.rados.rados.0.smithi084.stdout:86: done (0 left) 2024-01-13T18:00:50.437 INFO:tasks.rados.rados.0.smithi084.stdout:87: snap_remove snap 0 2024-01-13T18:00:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:50 smithi099 ceph-mon[71325]: pgmap v66: 121 pgs: 121 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:50 smithi099 ceph-mon[71325]: osdmap e74: 8 total, 8 up, 8 in 2024-01-13T18:00:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:50 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:50.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:50 smithi084 ceph-mon[37908]: pgmap v66: 121 pgs: 121 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:50.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:50 smithi084 ceph-mon[37908]: osdmap e74: 8 total, 8 up, 8 in 2024-01-13T18:00:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:50 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:50 smithi084 ceph-mon[52328]: pgmap v66: 121 pgs: 121 active+clean; 580 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:50 smithi084 ceph-mon[52328]: osdmap e74: 8 total, 8 up, 8 in 2024-01-13T18:00:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:50 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:00:51.440 INFO:tasks.rados.rados.0.smithi084.stdout:87: done (0 left) 2024-01-13T18:00:51.440 INFO:tasks.rados.rados.0.smithi084.stdout:88: read oid 29 snap 3 2024-01-13T18:00:51.440 INFO:tasks.rados.rados.0.smithi084.stdout:88: expect (ObjNum 28 snap 0 seq_num 28) 2024-01-13T18:00:51.440 INFO:tasks.rados.rados.0.smithi084.stdout:89: read oid 46 snap -1 2024-01-13T18:00:51.440 INFO:tasks.rados.rados.0.smithi084.stdout:89: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:00:51.440 INFO:tasks.rados.rados.0.smithi084.stdout:90: copy_from oid 36 from oid 2 current snap is 4 2024-01-13T18:00:51.440 INFO:tasks.rados.rados.0.smithi084.stdout:91: rmattr oid 49 current snap is 4 2024-01-13T18:00:51.440 INFO:tasks.rados.rados.0.smithi084.stdout:91: done (3 left) 2024-01-13T18:00:51.440 INFO:tasks.rados.rados.0.smithi084.stdout:92: snap_remove snap 2 2024-01-13T18:00:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:51 smithi099 ceph-mon[71325]: osdmap e75: 8 total, 8 up, 8 in 2024-01-13T18:00:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:51 smithi099 ceph-mon[71325]: osdmap e76: 8 total, 8 up, 8 in 2024-01-13T18:00:51.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:51 smithi084 ceph-mon[37908]: osdmap e75: 8 total, 8 up, 8 in 2024-01-13T18:00:51.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:51 smithi084 ceph-mon[37908]: osdmap e76: 8 total, 8 up, 8 in 2024-01-13T18:00:51.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:51 smithi084 ceph-mon[52328]: osdmap e75: 8 total, 8 up, 8 in 2024-01-13T18:00:51.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:51 smithi084 ceph-mon[52328]: osdmap e76: 8 total, 8 up, 8 in 2024-01-13T18:00:52.436 INFO:tasks.rados.rados.0.smithi084.stdout:92: done (3 left) 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:93: rmattr oid 30 current snap is 4 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:93: done (3 left) 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:94: read oid 42 snap 1 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:94: expect (ObjNum 41 snap 0 seq_num 41) 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:95: rmattr oid 14 current snap is 4 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:95: done (4 left) 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:96: read oid 9 snap 1 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:96: expect (ObjNum 8 snap 0 seq_num 8) 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 4 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:90: finishing copy_from to smithi084102331-36 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:90: finishing copy_from racing read to smithi084102331-36 2024-01-13T18:00:52.437 INFO:tasks.rados.rados.0.smithi084.stdout:88: expect (ObjNum 28 snap 0 seq_num 28) 2024-01-13T18:00:52.453 INFO:tasks.rados.rados.0.smithi084.stdout:89: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:00:52.474 INFO:tasks.rados.rados.0.smithi084.stdout:97: seq_num 54 ranges {393216=507904,901120=401408} 2024-01-13T18:00:52.479 INFO:tasks.rados.rados.0.smithi084.stdout:97: writing smithi084102331-24 from 393216 to 901120 tid 1 2024-01-13T18:00:52.482 INFO:tasks.rados.rados.0.smithi084.stdout:97: writing smithi084102331-24 from 901120 to 1302528 tid 2 2024-01-13T18:00:52.482 INFO:tasks.rados.rados.0.smithi084.stdout:88: done (5 left) 2024-01-13T18:00:52.483 INFO:tasks.rados.rados.0.smithi084.stdout:89: done (4 left) 2024-01-13T18:00:52.483 INFO:tasks.rados.rados.0.smithi084.stdout:90: done (3 left) 2024-01-13T18:00:52.483 INFO:tasks.rados.rados.0.smithi084.stdout:98: copy_from oid 34 from oid 40 current snap is 4 2024-01-13T18:00:52.483 INFO:tasks.rados.rados.0.smithi084.stdout:96: expect (ObjNum 8 snap 0 seq_num 8) 2024-01-13T18:00:52.487 INFO:tasks.rados.rados.0.smithi084.stdout:96: done (3 left) 2024-01-13T18:00:52.487 INFO:tasks.rados.rados.0.smithi084.stdout:99: snap_remove snap 3 2024-01-13T18:00:52.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:52 smithi099 ceph-mon[71325]: pgmap v69: 121 pgs: 121 active+clean; 25 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 6.4 MiB/s wr, 78 op/s 2024-01-13T18:00:52.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:52 smithi099 ceph-mon[71325]: osdmap e77: 8 total, 8 up, 8 in 2024-01-13T18:00:52.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:52 smithi084 ceph-mon[37908]: pgmap v69: 121 pgs: 121 active+clean; 25 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 6.4 MiB/s wr, 78 op/s 2024-01-13T18:00:52.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:52 smithi084 ceph-mon[37908]: osdmap e77: 8 total, 8 up, 8 in 2024-01-13T18:00:52.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:52 smithi084 ceph-mon[52328]: pgmap v69: 121 pgs: 121 active+clean; 25 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 6.4 MiB/s wr, 78 op/s 2024-01-13T18:00:52.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:52 smithi084 ceph-mon[52328]: osdmap e77: 8 total, 8 up, 8 in 2024-01-13T18:00:53.472 INFO:tasks.rados.rados.0.smithi084.stdout:99: done (3 left) 2024-01-13T18:00:53.472 INFO:tasks.rados.rados.0.smithi084.stdout:100: copy_from oid 37 from oid 35 current snap is 4 2024-01-13T18:00:53.472 INFO:tasks.rados.rados.0.smithi084.stdout:101: read oid 10 snap 1 2024-01-13T18:00:53.472 INFO:tasks.rados.rados.0.smithi084.stdout:101: expect (ObjNum 9 snap 0 seq_num 9) 2024-01-13T18:00:53.472 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 4 2024-01-13T18:00:53.472 INFO:tasks.rados.rados.0.smithi084.stdout:102: seq_num 55 ranges {622592=524288,1146880=401408} 2024-01-13T18:00:53.477 INFO:tasks.rados.rados.0.smithi084.stdout:102: writing smithi084102331-38 from 622592 to 1146880 tid 1 2024-01-13T18:00:53.480 INFO:tasks.rados.rados.0.smithi084.stdout:102: writing smithi084102331-38 from 1146880 to 1548288 tid 2 2024-01-13T18:00:53.480 INFO:tasks.rados.rados.0.smithi084.stdout:103: delete oid 23 current snap is 4 2024-01-13T18:00:53.480 INFO:tasks.rados.rados.0.smithi084.stdout:94: expect (ObjNum 41 snap 0 seq_num 41) 2024-01-13T18:00:53.499 INFO:tasks.rados.rados.0.smithi084.stdout:97: finishing write tid 1 to smithi084102331-24 2024-01-13T18:00:53.499 INFO:tasks.rados.rados.0.smithi084.stdout:97: finishing write tid 2 to smithi084102331-24 2024-01-13T18:00:53.499 INFO:tasks.rados.rados.0.smithi084.stdout:97: finishing write tid 3 to smithi084102331-24 2024-01-13T18:00:53.499 INFO:tasks.rados.rados.0.smithi084.stdout:97: finishing write tid 4 to smithi084102331-24 2024-01-13T18:00:53.499 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 10 (ObjNum 54 snap 4 seq_num 54) dirty exists 2024-01-13T18:00:53.499 INFO:tasks.rados.rados.0.smithi084.stdout:97: left oid 24 (ObjNum 54 snap 4 seq_num 54) 2024-01-13T18:00:53.499 INFO:tasks.rados.rados.0.smithi084.stdout:98: finishing copy_from to smithi084102331-34 2024-01-13T18:00:53.499 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 12 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-01-13T18:00:53.499 INFO:tasks.rados.rados.0.smithi084.stdout:98: finishing copy_from racing read to smithi084102331-34 2024-01-13T18:00:53.499 INFO:tasks.rados.rados.0.smithi084.stdout:101: expect (ObjNum 9 snap 0 seq_num 9) 2024-01-13T18:00:53.503 INFO:tasks.rados.rados.0.smithi084.stdout:100: finishing copy_from to smithi084102331-37 2024-01-13T18:00:53.503 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 6 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-01-13T18:00:53.503 INFO:tasks.rados.rados.0.smithi084.stdout:100: finishing copy_from racing read to smithi084102331-37 2024-01-13T18:00:53.503 INFO:tasks.rados.rados.0.smithi084.stdout:102: finishing write tid 1 to smithi084102331-38 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:102: finishing write tid 2 to smithi084102331-38 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:102: finishing write tid 3 to smithi084102331-38 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:102: finishing write tid 4 to smithi084102331-38 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 19 (ObjNum 55 snap 4 seq_num 55) dirty exists 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:102: left oid 38 (ObjNum 55 snap 4 seq_num 55) 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:94: done (6 left) 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:97: done (5 left) 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:98: done (4 left) 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:100: done (3 left) 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:101: done (2 left) 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:102: done (1 left) 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:103: done (0 left) 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:104: read oid 43 snap -1 2024-01-13T18:00:53.504 INFO:tasks.rados.rados.0.smithi084.stdout:104: expect (ObjNum 42 snap 0 seq_num 42) 2024-01-13T18:00:53.505 INFO:tasks.rados.rados.0.smithi084.stdout:105: rollback oid 38 current snap is 4 2024-01-13T18:00:53.505 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 1 2024-01-13T18:00:53.505 INFO:tasks.rados.rados.0.smithi084.stdout:106: delete oid 12 current snap is 4 2024-01-13T18:00:53.505 INFO:tasks.rados.rados.0.smithi084.stdout:105: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:00:53.506 INFO:tasks.rados.rados.0.smithi084.stdout:106: done (2 left) 2024-01-13T18:00:53.506 INFO:tasks.rados.rados.0.smithi084.stdout:107: read oid 17 snap 1 2024-01-13T18:00:53.506 INFO:tasks.rados.rados.0.smithi084.stdout:107: expect (ObjNum 16 snap 0 seq_num 16) 2024-01-13T18:00:53.506 INFO:tasks.rados.rados.0.smithi084.stdout:108: rollback oid 40 current snap is 4 2024-01-13T18:00:53.506 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 1 2024-01-13T18:00:53.507 INFO:tasks.rados.rados.0.smithi084.stdout:109: delete oid 8 current snap is 4 2024-01-13T18:00:53.508 INFO:tasks.rados.rados.0.smithi084.stdout:105: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:00:53.508 INFO:tasks.rados.rados.0.smithi084.stdout:105: finishing rollback tid 2 to smithi084102331-38 2024-01-13T18:00:53.508 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 22 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-01-13T18:00:53.509 INFO:tasks.rados.rados.0.smithi084.stdout:105: done (4 left) 2024-01-13T18:00:53.509 INFO:tasks.rados.rados.0.smithi084.stdout:109: done (3 left) 2024-01-13T18:00:53.509 INFO:tasks.rados.rados.0.smithi084.stdout:110: setattr oid 46 current snap is 4 2024-01-13T18:00:53.509 INFO:tasks.rados.rados.0.smithi084.stdout:107: expect (ObjNum 16 snap 0 seq_num 16) 2024-01-13T18:00:53.519 INFO:tasks.rados.rados.0.smithi084.stdout:108: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:00:53.519 INFO:tasks.rados.rados.0.smithi084.stdout:108: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:00:53.519 INFO:tasks.rados.rados.0.smithi084.stdout:108: finishing rollback tid 2 to smithi084102331-40 2024-01-13T18:00:53.519 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 17 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-01-13T18:00:53.519 INFO:tasks.rados.rados.0.smithi084.stdout:104: expect (ObjNum 42 snap 0 seq_num 42) 2024-01-13T18:00:53.537 INFO:tasks.rados.rados.0.smithi084.stdout:104: done (3 left) 2024-01-13T18:00:53.537 INFO:tasks.rados.rados.0.smithi084.stdout:107: done (2 left) 2024-01-13T18:00:53.537 INFO:tasks.rados.rados.0.smithi084.stdout:108: done (1 left) 2024-01-13T18:00:53.538 INFO:tasks.rados.rados.0.smithi084.stdout:111: snap_create 2024-01-13T18:00:53.539 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 15 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:00:54.475 INFO:tasks.rados.rados.0.smithi084.stdout:110: done (1 left) 2024-01-13T18:00:54.475 INFO:tasks.rados.rados.0.smithi084.stdout:111: done (0 left) 2024-01-13T18:00:54.475 INFO:tasks.rados.rados.0.smithi084.stdout:112: copy_from oid 25 from oid 6 current snap is 5 2024-01-13T18:00:54.475 INFO:tasks.rados.rados.0.smithi084.stdout:113: setattr oid 23 current snap is 5 2024-01-13T18:00:54.476 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 5 2024-01-13T18:00:54.476 INFO:tasks.rados.rados.0.smithi084.stdout:114: seq_num 59 ranges {24576=598016,622592=401408} 2024-01-13T18:00:54.480 INFO:tasks.rados.rados.0.smithi084.stdout:114: writing smithi084102331-15 from 24576 to 622592 tid 1 2024-01-13T18:00:54.482 INFO:tasks.rados.rados.0.smithi084.stdout:114: writing smithi084102331-15 from 622592 to 1024000 tid 2 2024-01-13T18:00:54.482 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 5 2024-01-13T18:00:54.482 INFO:tasks.rados.rados.0.smithi084.stdout:115: seq_num 60 ranges {188416=614400,802816=401408} 2024-01-13T18:00:54.487 INFO:tasks.rados.rados.0.smithi084.stdout:115: writing smithi084102331-20 from 188416 to 802816 tid 1 2024-01-13T18:00:54.494 INFO:tasks.rados.rados.0.smithi084.stdout:115: writing smithi084102331-20 from 802816 to 1204224 tid 2 2024-01-13T18:00:54.494 INFO:tasks.rados.rados.0.smithi084.stdout:116: rollback oid 31 current snap is 5 2024-01-13T18:00:54.494 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 1 2024-01-13T18:00:54.495 INFO:tasks.rados.rados.0.smithi084.stdout:117: read oid 24 snap -1 2024-01-13T18:00:54.495 INFO:tasks.rados.rados.0.smithi084.stdout:117: expect (ObjNum 54 snap 4 seq_num 54) 2024-01-13T18:00:54.495 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 5 2024-01-13T18:00:54.495 INFO:tasks.rados.rados.0.smithi084.stdout:118: seq_num 61 ranges {638976=630784,1269760=401408} 2024-01-13T18:00:54.499 INFO:tasks.rados.rados.0.smithi084.stdout:118: writing smithi084102331-39 from 638976 to 1269760 tid 1 2024-01-13T18:00:54.502 INFO:tasks.rados.rados.0.smithi084.stdout:118: writing smithi084102331-39 from 1269760 to 1671168 tid 2 2024-01-13T18:00:54.502 INFO:tasks.rados.rados.0.smithi084.stdout:119: snap_create 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 22 (ObjNum 945 snap 0 seq_num 2814407098) dirty exists 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:114: finishing write tid 1 to smithi084102331-15 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:114: finishing write tid 2 to smithi084102331-15 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:114: finishing write tid 3 to smithi084102331-15 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:114: finishing write tid 4 to smithi084102331-15 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 24 (ObjNum 59 snap 5 seq_num 59) dirty exists 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:114: left oid 15 (ObjNum 59 snap 5 seq_num 59) 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:112: finishing copy_from to smithi084102331-25 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 14 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:112: finishing copy_from racing read to smithi084102331-25 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:116: finishing rollback tid 0 to smithi084102331-31 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:116: finishing rollback tid 1 to smithi084102331-31 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:116: finishing rollback tid 2 to smithi084102331-31 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 26 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-01-13T18:00:54.503 INFO:tasks.rados.rados.0.smithi084.stdout:115: finishing write tid 1 to smithi084102331-20 2024-01-13T18:00:54.504 INFO:tasks.rados.rados.0.smithi084.stdout:115: finishing write tid 2 to smithi084102331-20 2024-01-13T18:00:54.504 INFO:tasks.rados.rados.0.smithi084.stdout:115: finishing write tid 3 to smithi084102331-20 2024-01-13T18:00:54.504 INFO:tasks.rados.rados.0.smithi084.stdout:115: finishing write tid 4 to smithi084102331-20 2024-01-13T18:00:54.504 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 12 (ObjNum 60 snap 5 seq_num 60) dirty exists 2024-01-13T18:00:54.504 INFO:tasks.rados.rados.0.smithi084.stdout:115: left oid 20 (ObjNum 60 snap 5 seq_num 60) 2024-01-13T18:00:54.504 INFO:tasks.rados.rados.0.smithi084.stdout:117: expect (ObjNum 54 snap 4 seq_num 54) 2024-01-13T18:00:54.541 INFO:tasks.rados.rados.0.smithi084.stdout:118: finishing write tid 1 to smithi084102331-39 2024-01-13T18:00:54.542 INFO:tasks.rados.rados.0.smithi084.stdout:118: finishing write tid 2 to smithi084102331-39 2024-01-13T18:00:54.542 INFO:tasks.rados.rados.0.smithi084.stdout:118: finishing write tid 3 to smithi084102331-39 2024-01-13T18:00:54.542 INFO:tasks.rados.rados.0.smithi084.stdout:118: finishing write tid 4 to smithi084102331-39 2024-01-13T18:00:54.542 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 19 (ObjNum 61 snap 5 seq_num 61) dirty exists 2024-01-13T18:00:54.542 INFO:tasks.rados.rados.0.smithi084.stdout:118: left oid 39 (ObjNum 61 snap 5 seq_num 61) 2024-01-13T18:00:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:54 smithi099 ceph-mon[71325]: pgmap v72: 121 pgs: 121 active+clean; 25 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 6.4 MiB/s wr, 78 op/s 2024-01-13T18:00:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:54 smithi099 ceph-mon[71325]: osdmap e78: 8 total, 8 up, 8 in 2024-01-13T18:00:54.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:00:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:54] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T18:00:54.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:54 smithi084 ceph-mon[37908]: pgmap v72: 121 pgs: 121 active+clean; 25 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 6.4 MiB/s wr, 78 op/s 2024-01-13T18:00:54.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:54 smithi084 ceph-mon[37908]: osdmap e78: 8 total, 8 up, 8 in 2024-01-13T18:00:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:54 smithi084 ceph-mon[52328]: pgmap v72: 121 pgs: 121 active+clean; 25 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.5 MiB/s rd, 6.4 MiB/s wr, 78 op/s 2024-01-13T18:00:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:54 smithi084 ceph-mon[52328]: osdmap e78: 8 total, 8 up, 8 in 2024-01-13T18:00:55.481 INFO:tasks.rados.rados.0.smithi084.stdout:112: done (7 left) 2024-01-13T18:00:55.481 INFO:tasks.rados.rados.0.smithi084.stdout:113: done (6 left) 2024-01-13T18:00:55.481 INFO:tasks.rados.rados.0.smithi084.stdout:114: done (5 left) 2024-01-13T18:00:55.481 INFO:tasks.rados.rados.0.smithi084.stdout:115: done (4 left) 2024-01-13T18:00:55.481 INFO:tasks.rados.rados.0.smithi084.stdout:116: done (3 left) 2024-01-13T18:00:55.481 INFO:tasks.rados.rados.0.smithi084.stdout:117: done (2 left) 2024-01-13T18:00:55.481 INFO:tasks.rados.rados.0.smithi084.stdout:118: done (1 left) 2024-01-13T18:00:55.481 INFO:tasks.rados.rados.0.smithi084.stdout:119: done (0 left) 2024-01-13T18:00:55.481 INFO:tasks.rados.rados.0.smithi084.stdout:120: read oid 48 snap 4 2024-01-13T18:00:55.481 INFO:tasks.rados.rados.0.smithi084.stdout:120: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:00:55.482 INFO:tasks.rados.rados.0.smithi084.stdout:121: read oid 49 snap 5 2024-01-13T18:00:55.482 INFO:tasks.rados.rados.0.smithi084.stdout:121: expect (ObjNum 48 snap 0 seq_num 48) 2024-01-13T18:00:55.482 INFO:tasks.rados.rados.0.smithi084.stdout:122: delete oid 44 current snap is 6 2024-01-13T18:00:55.483 INFO:tasks.rados.rados.0.smithi084.stdout:122: done (2 left) 2024-01-13T18:00:55.484 INFO:tasks.rados.rados.0.smithi084.stdout:123: rollback oid 23 current snap is 6 2024-01-13T18:00:55.484 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 4 2024-01-13T18:00:55.484 INFO:tasks.rados.rados.0.smithi084.stdout:124: read oid 30 snap -1 2024-01-13T18:00:55.484 INFO:tasks.rados.rados.0.smithi084.stdout:124: expect (ObjNum 29 snap 0 seq_num 29) 2024-01-13T18:00:55.485 INFO:tasks.rados.rados.0.smithi084.stdout:125: setattr oid 35 current snap is 6 2024-01-13T18:00:55.485 INFO:tasks.rados.rados.0.smithi084.stdout:121: expect (ObjNum 48 snap 0 seq_num 48) 2024-01-13T18:00:55.506 INFO:tasks.rados.rados.0.smithi084.stdout:123: finishing rollback tid 0 to smithi084102331-23 2024-01-13T18:00:55.506 INFO:tasks.rados.rados.0.smithi084.stdout:120: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:00:55.526 INFO:tasks.rados.rados.0.smithi084.stdout:123: finishing rollback tid 1 to smithi084102331-23 2024-01-13T18:00:55.526 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 25 (ObjNum -257398736 snap 21877 seq_num 304) dirty dne 2024-01-13T18:00:55.526 INFO:tasks.rados.rados.0.smithi084.stdout:124: expect (ObjNum 29 snap 0 seq_num 29) 2024-01-13T18:00:55.538 INFO:tasks.rados.rados.0.smithi084.stdout:120: done (4 left) 2024-01-13T18:00:55.538 INFO:tasks.rados.rados.0.smithi084.stdout:121: done (3 left) 2024-01-13T18:00:55.538 INFO:tasks.rados.rados.0.smithi084.stdout:123: done (2 left) 2024-01-13T18:00:55.538 INFO:tasks.rados.rados.0.smithi084.stdout:124: done (1 left) 2024-01-13T18:00:55.539 INFO:tasks.rados.rados.0.smithi084.stdout:126: delete oid 5 current snap is 6 2024-01-13T18:00:55.541 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 19 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-01-13T18:00:55.542 INFO:tasks.rados.rados.0.smithi084.stdout:125: done (1 left) 2024-01-13T18:00:55.542 INFO:tasks.rados.rados.0.smithi084.stdout:126: done (0 left) 2024-01-13T18:00:55.542 INFO:tasks.rados.rados.0.smithi084.stdout:127: snap_remove snap 4 2024-01-13T18:00:55.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:55 smithi099 ceph-mon[71325]: osdmap e79: 8 total, 8 up, 8 in 2024-01-13T18:00:55.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:55 smithi084 ceph-mon[37908]: osdmap e79: 8 total, 8 up, 8 in 2024-01-13T18:00:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:55 smithi084 ceph-mon[52328]: osdmap e79: 8 total, 8 up, 8 in 2024-01-13T18:00:56.487 INFO:tasks.rados.rados.0.smithi084.stdout:127: done (0 left) 2024-01-13T18:00:56.487 INFO:tasks.rados.rados.0.smithi084.stdout:128: setattr oid 28 current snap is 6 2024-01-13T18:00:56.489 INFO:tasks.rados.rados.0.smithi084.stdout:129: snap_remove snap 1 2024-01-13T18:00:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:56 smithi099 ceph-mon[71325]: pgmap v75: 121 pgs: 121 active+clean; 25 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:56 smithi099 ceph-mon[71325]: osdmap e80: 8 total, 8 up, 8 in 2024-01-13T18:00:56.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:00:56 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:00:56] "GET /metrics HTTP/1.1" 200 238133 "" "Prometheus/2.43.0" 2024-01-13T18:00:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:56 smithi084 ceph-mon[52328]: pgmap v75: 121 pgs: 121 active+clean; 25 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:56 smithi084 ceph-mon[52328]: osdmap e80: 8 total, 8 up, 8 in 2024-01-13T18:00:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:56 smithi084 ceph-mon[37908]: pgmap v75: 121 pgs: 121 active+clean; 25 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:00:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:56 smithi084 ceph-mon[37908]: osdmap e80: 8 total, 8 up, 8 in 2024-01-13T18:00:57.497 INFO:tasks.rados.rados.0.smithi084.stdout:129: done (1 left) 2024-01-13T18:00:57.497 INFO:tasks.rados.rados.0.smithi084.stdout:130: delete oid 6 current snap is 6 2024-01-13T18:00:57.497 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 11 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-01-13T18:00:57.504 INFO:tasks.rados.rados.0.smithi084.stdout:128: done (1 left) 2024-01-13T18:00:57.504 INFO:tasks.rados.rados.0.smithi084.stdout:130: done (0 left) 2024-01-13T18:00:57.504 INFO:tasks.rados.rados.0.smithi084.stdout:131: snap_remove snap 5 2024-01-13T18:00:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:57 smithi099 ceph-mon[71325]: osdmap e81: 8 total, 8 up, 8 in 2024-01-13T18:00:57.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:57 smithi084 ceph-mon[37908]: osdmap e81: 8 total, 8 up, 8 in 2024-01-13T18:00:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:57 smithi084 ceph-mon[52328]: osdmap e81: 8 total, 8 up, 8 in 2024-01-13T18:00:58.498 INFO:tasks.rados.rados.0.smithi084.stdout:131: done (0 left) 2024-01-13T18:00:58.498 INFO:tasks.rados.rados.0.smithi084.stdout:132: rollback oid 17 current snap is 6 2024-01-13T18:00:58.498 INFO:tasks.rados.rados.0.smithi084.stdout:132: done (0 left) 2024-01-13T18:00:58.499 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 6 2024-01-13T18:00:58.499 INFO:tasks.rados.rados.0.smithi084.stdout:133: seq_num 65 ranges {712704=696320,1409024=401408} 2024-01-13T18:00:58.506 INFO:tasks.rados.rados.0.smithi084.stdout:133: writing smithi084102331-43 from 712704 to 1409024 tid 1 2024-01-13T18:00:58.509 INFO:tasks.rados.rados.0.smithi084.stdout:133: writing smithi084102331-43 from 1409024 to 1810432 tid 2 2024-01-13T18:00:58.510 INFO:tasks.rados.rados.0.smithi084.stdout:134: read oid 11 snap -1 2024-01-13T18:00:58.510 INFO:tasks.rados.rados.0.smithi084.stdout:134: expect deleted 2024-01-13T18:00:58.519 INFO:tasks.rados.rados.0.smithi084.stdout:135: read oid 6 snap -1 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:135: expect deleted 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:136: copy_from oid 18 from oid 46 current snap is 6 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:137: read oid 41 snap -1 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:137: expect (ObjNum 40 snap 0 seq_num 40) 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:138: rmattr oid 37 current snap is 6 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:138: done (5 left) 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:139: read oid 1 snap -1 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:139: expect deleted 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:140: rmattr oid 30 current snap is 6 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:140: done (6 left) 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:141: setattr oid 47 current snap is 6 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:142: copy_from oid 35 from oid 5 current snap is 6 2024-01-13T18:00:58.520 INFO:tasks.rados.rados.0.smithi084.stdout:143: setattr oid 9 current snap is 6 2024-01-13T18:00:58.521 INFO:tasks.rados.rados.0.smithi084.stdout:133: finishing write tid 1 to smithi084102331-43 2024-01-13T18:00:58.521 INFO:tasks.rados.rados.0.smithi084.stdout:133: finishing write tid 2 to smithi084102331-43 2024-01-13T18:00:58.521 INFO:tasks.rados.rados.0.smithi084.stdout:133: finishing write tid 3 to smithi084102331-43 2024-01-13T18:00:58.521 INFO:tasks.rados.rados.0.smithi084.stdout:135: done (8 left) 2024-01-13T18:00:58.521 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 6 2024-01-13T18:00:58.521 INFO:tasks.rados.rados.0.smithi084.stdout:144: seq_num 66 ranges {40960=712704,753664=401408} 2024-01-13T18:00:58.521 INFO:tasks.rados.rados.0.smithi084.stdout:144: writing smithi084102331-3 from 40960 to 753664 tid 1 2024-01-13T18:00:58.522 INFO:tasks.rados.rados.0.smithi084.stdout:144: writing smithi084102331-3 from 753664 to 1155072 tid 2 2024-01-13T18:00:58.522 INFO:tasks.rados.rados.0.smithi084.stdout:145: setattr oid 8 current snap is 6 2024-01-13T18:00:58.522 INFO:tasks.rados.rados.0.smithi084.stdout:133: finishing write tid 4 to smithi084102331-43 2024-01-13T18:00:58.522 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 17 (ObjNum 65 snap 6 seq_num 65) dirty exists 2024-01-13T18:00:58.523 INFO:tasks.rados.rados.0.smithi084.stdout:133: left oid 43 (ObjNum 65 snap 6 seq_num 65) 2024-01-13T18:00:58.523 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 31 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-01-13T18:00:58.523 INFO:tasks.rados.rados.0.smithi084.stdout:142: finishing copy_from to smithi084102331-35 2024-01-13T18:00:58.523 INFO:tasks.rados.rados.0.smithi084.stdout:142: got expected ENOENT (src dne) 2024-01-13T18:00:58.523 INFO:tasks.rados.rados.0.smithi084.stdout:142: finishing copy_from racing read to smithi084102331-35 2024-01-13T18:00:58.523 INFO:tasks.rados.rados.0.smithi084.stdout:137: expect (ObjNum 40 snap 0 seq_num 40) 2024-01-13T18:00:58.540 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 39 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-01-13T18:00:58.540 INFO:tasks.rados.rados.0.smithi084.stdout:136: finishing copy_from to smithi084102331-18 2024-01-13T18:00:58.540 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 15 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:00:58.540 INFO:tasks.rados.rados.0.smithi084.stdout:136: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:00:58.540 INFO:tasks.rados.rados.0.smithi084.stdout:144: finishing write tid 1 to smithi084102331-3 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:144: finishing write tid 2 to smithi084102331-3 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:144: finishing write tid 3 to smithi084102331-3 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:144: finishing write tid 4 to smithi084102331-3 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 35 (ObjNum 66 snap 6 seq_num 66) dirty exists 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:144: left oid 3 (ObjNum 66 snap 6 seq_num 66) 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:133: done (9 left) 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:134: done (8 left) 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:136: done (7 left) 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:137: done (6 left) 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:139: done (5 left) 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:141: done (4 left) 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:142: done (3 left) 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:143: done (2 left) 2024-01-13T18:00:58.541 INFO:tasks.rados.rados.0.smithi084.stdout:144: done (1 left) 2024-01-13T18:00:58.542 INFO:tasks.rados.rados.0.smithi084.stdout:146: snap_create 2024-01-13T18:00:58.542 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 40 (ObjNum 129 snap 0 seq_num 4036985368) dirty exists 2024-01-13T18:00:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:58 smithi099 ceph-mon[71325]: pgmap v78: 121 pgs: 121 active+clean; 30 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-01-13T18:00:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:58 smithi099 ceph-mon[71325]: osdmap e82: 8 total, 8 up, 8 in 2024-01-13T18:00:58.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:58 smithi084 ceph-mon[37908]: pgmap v78: 121 pgs: 121 active+clean; 30 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-01-13T18:00:58.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:58 smithi084 ceph-mon[37908]: osdmap e82: 8 total, 8 up, 8 in 2024-01-13T18:00:58.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:58 smithi084 ceph-mon[52328]: pgmap v78: 121 pgs: 121 active+clean; 30 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-01-13T18:00:58.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:58 smithi084 ceph-mon[52328]: osdmap e82: 8 total, 8 up, 8 in 2024-01-13T18:00:59.330 INFO:tasks.rados.rados.0.smithi084.stdout:145: done (1 left) 2024-01-13T18:00:59.330 INFO:tasks.rados.rados.0.smithi084.stdout:146: done (0 left) 2024-01-13T18:00:59.330 INFO:tasks.rados.rados.0.smithi084.stdout:147: snap_remove snap 6 2024-01-13T18:00:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:59 smithi099 ceph-mon[71325]: osdmap e83: 8 total, 8 up, 8 in 2024-01-13T18:00:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:00:59 smithi099 ceph-mon[71325]: osdmap e84: 8 total, 8 up, 8 in 2024-01-13T18:00:59.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:59 smithi084 ceph-mon[37908]: osdmap e83: 8 total, 8 up, 8 in 2024-01-13T18:00:59.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:00:59 smithi084 ceph-mon[37908]: osdmap e84: 8 total, 8 up, 8 in 2024-01-13T18:00:59.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:59 smithi084 ceph-mon[52328]: osdmap e83: 8 total, 8 up, 8 in 2024-01-13T18:00:59.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:00:59 smithi084 ceph-mon[52328]: osdmap e84: 8 total, 8 up, 8 in 2024-01-13T18:01:00.336 INFO:tasks.rados.rados.0.smithi084.stdout:147: done (0 left) 2024-01-13T18:01:00.336 INFO:tasks.rados.rados.0.smithi084.stdout:148: delete oid 1 current snap is 7 2024-01-13T18:01:00.338 INFO:tasks.rados.rados.0.smithi084.stdout:148: done (0 left) 2024-01-13T18:01:00.338 INFO:tasks.rados.rados.0.smithi084.stdout:149: snap_create 2024-01-13T18:01:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:00 smithi099 ceph-mon[71325]: pgmap v81: 121 pgs: 121 active+clean; 30 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-01-13T18:01:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:00 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:00 smithi099 ceph-mon[71325]: osdmap e85: 8 total, 8 up, 8 in 2024-01-13T18:01:00.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:00 smithi084 ceph-mon[37908]: pgmap v81: 121 pgs: 121 active+clean; 30 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-01-13T18:01:00.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:00 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:00.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:00 smithi084 ceph-mon[37908]: osdmap e85: 8 total, 8 up, 8 in 2024-01-13T18:01:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:00 smithi084 ceph-mon[52328]: pgmap v81: 121 pgs: 121 active+clean; 30 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-01-13T18:01:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:00 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:00 smithi084 ceph-mon[52328]: osdmap e85: 8 total, 8 up, 8 in 2024-01-13T18:01:01.340 INFO:tasks.rados.rados.0.smithi084.stdout:149: done (0 left) 2024-01-13T18:01:01.340 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 8 2024-01-13T18:01:01.340 INFO:tasks.rados.rados.0.smithi084.stdout:150: seq_num 68 ranges {507904=745472,1253376=401408} 2024-01-13T18:01:01.347 INFO:tasks.rados.rados.0.smithi084.stdout:150: writing smithi084102331-31 from 507904 to 1253376 tid 1 2024-01-13T18:01:01.350 INFO:tasks.rados.rados.0.smithi084.stdout:150: writing smithi084102331-31 from 1253376 to 1654784 tid 2 2024-01-13T18:01:01.350 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 8 2024-01-13T18:01:01.350 INFO:tasks.rados.rados.0.smithi084.stdout:151: seq_num 69 ranges {253952=761856,1015808=401408} 2024-01-13T18:01:01.356 INFO:tasks.rados.rados.0.smithi084.stdout:151: writing smithi084102331-16 from 253952 to 1015808 tid 1 2024-01-13T18:01:01.359 INFO:tasks.rados.rados.0.smithi084.stdout:151: writing smithi084102331-16 from 1015808 to 1417216 tid 2 2024-01-13T18:01:01.359 INFO:tasks.rados.rados.0.smithi084.stdout:152: copy_from oid 10 from oid 39 current snap is 8 2024-01-13T18:01:01.359 INFO:tasks.rados.rados.0.smithi084.stdout:153: read oid 48 snap 7 2024-01-13T18:01:01.359 INFO:tasks.rados.rados.0.smithi084.stdout:153: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:01:01.359 INFO:tasks.rados.rados.0.smithi084.stdout:154: copy_from oid 50 from oid 1 current snap is 8 2024-01-13T18:01:01.359 INFO:tasks.rados.rados.0.smithi084.stdout:155: rollback oid 29 current snap is 8 2024-01-13T18:01:01.359 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 7 2024-01-13T18:01:01.359 INFO:tasks.rados.rados.0.smithi084.stdout:156: copy_from oid 47 from oid 13 current snap is 8 2024-01-13T18:01:01.359 INFO:tasks.rados.rados.0.smithi084.stdout:157: snap_create 2024-01-13T18:01:01.360 INFO:tasks.rados.rados.0.smithi084.stdout:150: finishing write tid 1 to smithi084102331-31 2024-01-13T18:01:01.360 INFO:tasks.rados.rados.0.smithi084.stdout:150: finishing write tid 2 to smithi084102331-31 2024-01-13T18:01:01.360 INFO:tasks.rados.rados.0.smithi084.stdout:150: finishing write tid 3 to smithi084102331-31 2024-01-13T18:01:01.360 INFO:tasks.rados.rados.0.smithi084.stdout:150: finishing write tid 4 to smithi084102331-31 2024-01-13T18:01:01.360 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 40 (ObjNum 68 snap 8 seq_num 68) dirty exists 2024-01-13T18:01:01.360 INFO:tasks.rados.rados.0.smithi084.stdout:150: left oid 31 (ObjNum 68 snap 8 seq_num 68) 2024-01-13T18:01:01.361 INFO:tasks.rados.rados.0.smithi084.stdout:154: finishing copy_from to smithi084102331-50 2024-01-13T18:01:01.361 INFO:tasks.rados.rados.0.smithi084.stdout:154: got expected ENOENT (src dne) 2024-01-13T18:01:01.361 INFO:tasks.rados.rados.0.smithi084.stdout:154: finishing copy_from racing read to smithi084102331-50 2024-01-13T18:01:01.363 INFO:tasks.rados.rados.0.smithi084.stdout:151: finishing write tid 1 to smithi084102331-16 2024-01-13T18:01:01.363 INFO:tasks.rados.rados.0.smithi084.stdout:155: finishing rollback tid 0 to smithi084102331-29 2024-01-13T18:01:01.363 INFO:tasks.rados.rados.0.smithi084.stdout:155: finishing rollback tid 1 to smithi084102331-29 2024-01-13T18:01:01.364 INFO:tasks.rados.rados.0.smithi084.stdout:155: finishing rollback tid 2 to smithi084102331-29 2024-01-13T18:01:01.364 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 31 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-01-13T18:01:01.364 INFO:tasks.rados.rados.0.smithi084.stdout:151: finishing write tid 2 to smithi084102331-16 2024-01-13T18:01:01.364 INFO:tasks.rados.rados.0.smithi084.stdout:151: finishing write tid 3 to smithi084102331-16 2024-01-13T18:01:01.366 INFO:tasks.rados.rados.0.smithi084.stdout:153: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:01:01.392 INFO:tasks.rados.rados.0.smithi084.stdout:151: finishing write tid 4 to smithi084102331-16 2024-01-13T18:01:01.392 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 17 (ObjNum 69 snap 8 seq_num 69) dirty exists 2024-01-13T18:01:01.392 INFO:tasks.rados.rados.0.smithi084.stdout:151: left oid 16 (ObjNum 69 snap 8 seq_num 69) 2024-01-13T18:01:01.392 INFO:tasks.rados.rados.0.smithi084.stdout:156: finishing copy_from to smithi084102331-47 2024-01-13T18:01:01.392 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 6 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-01-13T18:01:01.392 INFO:tasks.rados.rados.0.smithi084.stdout:156: finishing copy_from racing read to smithi084102331-47 2024-01-13T18:01:01.392 INFO:tasks.rados.rados.0.smithi084.stdout:152: finishing copy_from to smithi084102331-10 2024-01-13T18:01:01.392 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 19 (ObjNum 61 snap 5 seq_num 61) dirty exists 2024-01-13T18:01:01.393 INFO:tasks.rados.rados.0.smithi084.stdout:152: finishing copy_from racing read to smithi084102331-10 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:150: done (7 left) 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:151: done (6 left) 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:152: done (5 left) 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:153: done (4 left) 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:154: done (3 left) 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:155: done (2 left) 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:156: done (1 left) 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:157: done (0 left) 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:158: read oid 46 snap -1 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:158: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:159: copy_from oid 3 from oid 30 current snap is 9 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:160: copy_from oid 17 from oid 9 current snap is 9 2024-01-13T18:01:02.345 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 9 2024-01-13T18:01:02.346 INFO:tasks.rados.rados.0.smithi084.stdout:161: seq_num 70 ranges {1654784=778240,2433024=401408} 2024-01-13T18:01:02.358 INFO:tasks.rados.rados.0.smithi084.stdout:161: writing smithi084102331-31 from 1654784 to 2433024 tid 1 2024-01-13T18:01:02.360 INFO:tasks.rados.rados.0.smithi084.stdout:161: writing smithi084102331-31 from 2433024 to 2834432 tid 2 2024-01-13T18:01:02.360 INFO:tasks.rados.rados.0.smithi084.stdout:162: setattr oid 32 current snap is 9 2024-01-13T18:01:02.360 INFO:tasks.rados.rados.0.smithi084.stdout:160: finishing copy_from to smithi084102331-17 2024-01-13T18:01:02.361 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 31 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-01-13T18:01:02.361 INFO:tasks.rados.rados.0.smithi084.stdout:158: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:02.388 INFO:tasks.rados.rados.0.smithi084.stdout:160: finishing copy_from racing read to smithi084102331-17 2024-01-13T18:01:02.388 INFO:tasks.rados.rados.0.smithi084.stdout:159: finishing copy_from to smithi084102331-3 2024-01-13T18:01:02.388 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 4 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-01-13T18:01:02.388 INFO:tasks.rados.rados.0.smithi084.stdout:159: finishing copy_from racing read to smithi084102331-3 2024-01-13T18:01:02.388 INFO:tasks.rados.rados.0.smithi084.stdout:161: finishing write tid 1 to smithi084102331-31 2024-01-13T18:01:02.388 INFO:tasks.rados.rados.0.smithi084.stdout:161: finishing write tid 2 to smithi084102331-31 2024-01-13T18:01:02.388 INFO:tasks.rados.rados.0.smithi084.stdout:161: finishing write tid 3 to smithi084102331-31 2024-01-13T18:01:02.388 INFO:tasks.rados.rados.0.smithi084.stdout:161: finishing write tid 4 to smithi084102331-31 2024-01-13T18:01:02.388 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 46 (ObjNum 70 snap 9 seq_num 70) dirty exists 2024-01-13T18:01:02.388 INFO:tasks.rados.rados.0.smithi084.stdout:161: left oid 31 (ObjNum 70 snap 9 seq_num 70) 2024-01-13T18:01:02.389 INFO:tasks.rados.rados.0.smithi084.stdout:158: done (4 left) 2024-01-13T18:01:02.389 INFO:tasks.rados.rados.0.smithi084.stdout:159: done (3 left) 2024-01-13T18:01:02.389 INFO:tasks.rados.rados.0.smithi084.stdout:160: done (2 left) 2024-01-13T18:01:02.389 INFO:tasks.rados.rados.0.smithi084.stdout:161: done (1 left) 2024-01-13T18:01:02.389 INFO:tasks.rados.rados.0.smithi084.stdout:163: snap_remove snap 8 2024-01-13T18:01:02.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:02 smithi099 ceph-mon[71325]: pgmap v84: 121 pgs: 121 active+clean; 26 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 507 KiB/s rd, 726 KiB/s wr, 24 op/s 2024-01-13T18:01:02.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:02 smithi099 ceph-mon[71325]: osdmap e86: 8 total, 8 up, 8 in 2024-01-13T18:01:02.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:02 smithi084 ceph-mon[37908]: pgmap v84: 121 pgs: 121 active+clean; 26 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 507 KiB/s rd, 726 KiB/s wr, 24 op/s 2024-01-13T18:01:02.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:02 smithi084 ceph-mon[37908]: osdmap e86: 8 total, 8 up, 8 in 2024-01-13T18:01:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:02 smithi084 ceph-mon[52328]: pgmap v84: 121 pgs: 121 active+clean; 26 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 507 KiB/s rd, 726 KiB/s wr, 24 op/s 2024-01-13T18:01:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:02 smithi084 ceph-mon[52328]: osdmap e86: 8 total, 8 up, 8 in 2024-01-13T18:01:03.350 INFO:tasks.rados.rados.0.smithi084.stdout:163: done (1 left) 2024-01-13T18:01:03.350 INFO:tasks.rados.rados.0.smithi084.stdout:164: rmattr oid 36 current snap is 9 2024-01-13T18:01:03.350 INFO:tasks.rados.rados.0.smithi084.stdout:164: done (1 left) 2024-01-13T18:01:03.350 INFO:tasks.rados.rados.0.smithi084.stdout:165: copy_from oid 6 from oid 13 current snap is 9 2024-01-13T18:01:03.350 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 44 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-01-13T18:01:03.350 INFO:tasks.rados.rados.0.smithi084.stdout:162: done (1 left) 2024-01-13T18:01:03.351 INFO:tasks.rados.rados.0.smithi084.stdout:166: snap_remove snap 7 2024-01-13T18:01:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:03 smithi099 ceph-mon[71325]: osdmap e87: 8 total, 8 up, 8 in 2024-01-13T18:01:03.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:03 smithi084 ceph-mon[37908]: osdmap e87: 8 total, 8 up, 8 in 2024-01-13T18:01:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:03 smithi084 ceph-mon[52328]: osdmap e87: 8 total, 8 up, 8 in 2024-01-13T18:01:04.329 INFO:tasks.rados.rados.0.smithi084.stdout:166: done (1 left) 2024-01-13T18:01:04.329 INFO:tasks.rados.rados.0.smithi084.stdout:167: read oid 29 snap -1 2024-01-13T18:01:04.329 INFO:tasks.rados.rados.0.smithi084.stdout:167: expect (ObjNum 28 snap 0 seq_num 28) 2024-01-13T18:01:04.329 INFO:tasks.rados.rados.0.smithi084.stdout:168: rollback oid 35 current snap is 9 2024-01-13T18:01:04.329 INFO:tasks.rados.rados.0.smithi084.stdout:168: done (2 left) 2024-01-13T18:01:04.330 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 9 2024-01-13T18:01:04.330 INFO:tasks.rados.rados.0.smithi084.stdout:165: finishing copy_from to smithi084102331-6 2024-01-13T18:01:04.330 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 6 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-01-13T18:01:04.330 INFO:tasks.rados.rados.0.smithi084.stdout:169: seq_num 71 ranges {24576=794624,819200=401408} 2024-01-13T18:01:04.336 INFO:tasks.rados.rados.0.smithi084.stdout:169: writing smithi084102331-2 from 24576 to 819200 tid 1 2024-01-13T18:01:04.336 INFO:tasks.rados.rados.0.smithi084.stdout:169: writing smithi084102331-2 from 819200 to 1220608 tid 2 2024-01-13T18:01:04.336 INFO:tasks.rados.rados.0.smithi084.stdout:170: read oid 42 snap -1 2024-01-13T18:01:04.337 INFO:tasks.rados.rados.0.smithi084.stdout:170: expect (ObjNum 41 snap 0 seq_num 41) 2024-01-13T18:01:04.337 INFO:tasks.rados.rados.0.smithi084.stdout:171: rollback oid 32 current snap is 9 2024-01-13T18:01:04.337 INFO:tasks.rados.rados.0.smithi084.stdout:171: done (4 left) 2024-01-13T18:01:04.337 INFO:tasks.rados.rados.0.smithi084.stdout:172: snap_create 2024-01-13T18:01:04.337 INFO:tasks.rados.rados.0.smithi084.stdout:165: finishing copy_from racing read to smithi084102331-6 2024-01-13T18:01:04.339 INFO:tasks.rados.rados.0.smithi084.stdout:167: expect (ObjNum 28 snap 0 seq_num 28) 2024-01-13T18:01:04.361 INFO:tasks.rados.rados.0.smithi084.stdout:169: finishing write tid 1 to smithi084102331-2 2024-01-13T18:01:04.362 INFO:tasks.rados.rados.0.smithi084.stdout:169: finishing write tid 2 to smithi084102331-2 2024-01-13T18:01:04.362 INFO:tasks.rados.rados.0.smithi084.stdout:169: finishing write tid 3 to smithi084102331-2 2024-01-13T18:01:04.362 INFO:tasks.rados.rados.0.smithi084.stdout:169: finishing write tid 4 to smithi084102331-2 2024-01-13T18:01:04.362 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 34 (ObjNum 71 snap 9 seq_num 71) dirty exists 2024-01-13T18:01:04.362 INFO:tasks.rados.rados.0.smithi084.stdout:169: left oid 2 (ObjNum 71 snap 9 seq_num 71) 2024-01-13T18:01:04.362 INFO:tasks.rados.rados.0.smithi084.stdout:170: expect (ObjNum 41 snap 0 seq_num 41) 2024-01-13T18:01:04.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:01:04] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T18:01:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:04 smithi099 ceph-mon[71325]: pgmap v87: 121 pgs: 121 active+clean; 26 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 507 KiB/s rd, 726 KiB/s wr, 24 op/s 2024-01-13T18:01:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:04 smithi099 ceph-mon[71325]: osdmap e88: 8 total, 8 up, 8 in 2024-01-13T18:01:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:04 smithi099 ceph-mon[71325]: osdmap e89: 8 total, 8 up, 8 in 2024-01-13T18:01:04.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:04 smithi084 ceph-mon[37908]: pgmap v87: 121 pgs: 121 active+clean; 26 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 507 KiB/s rd, 726 KiB/s wr, 24 op/s 2024-01-13T18:01:04.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:04 smithi084 ceph-mon[37908]: osdmap e88: 8 total, 8 up, 8 in 2024-01-13T18:01:04.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:04 smithi084 ceph-mon[37908]: osdmap e89: 8 total, 8 up, 8 in 2024-01-13T18:01:04.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:04 smithi084 ceph-mon[52328]: pgmap v87: 121 pgs: 121 active+clean; 26 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 507 KiB/s rd, 726 KiB/s wr, 24 op/s 2024-01-13T18:01:04.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:04 smithi084 ceph-mon[52328]: osdmap e88: 8 total, 8 up, 8 in 2024-01-13T18:01:04.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:04 smithi084 ceph-mon[52328]: osdmap e89: 8 total, 8 up, 8 in 2024-01-13T18:01:05.339 INFO:tasks.rados.rados.0.smithi084.stdout:165: done (4 left) 2024-01-13T18:01:05.339 INFO:tasks.rados.rados.0.smithi084.stdout:167: done (3 left) 2024-01-13T18:01:05.339 INFO:tasks.rados.rados.0.smithi084.stdout:169: done (2 left) 2024-01-13T18:01:05.339 INFO:tasks.rados.rados.0.smithi084.stdout:170: done (1 left) 2024-01-13T18:01:05.339 INFO:tasks.rados.rados.0.smithi084.stdout:172: done (0 left) 2024-01-13T18:01:05.339 INFO:tasks.rados.rados.0.smithi084.stdout:173: delete oid 11 current snap is 10 2024-01-13T18:01:05.342 INFO:tasks.rados.rados.0.smithi084.stdout:173: done (0 left) 2024-01-13T18:01:05.342 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 10 2024-01-13T18:01:05.342 INFO:tasks.rados.rados.0.smithi084.stdout:174: seq_num 73 ranges {0=425984,425984=409600,835584=393216} 2024-01-13T18:01:05.344 INFO:tasks.rados.rados.0.smithi084.stdout:174: writing smithi084102331-44 from 0 to 425984 tid 1 2024-01-13T18:01:05.346 INFO:tasks.rados.rados.0.smithi084.stdout:174: writing smithi084102331-44 from 425984 to 835584 tid 2 2024-01-13T18:01:05.349 INFO:tasks.rados.rados.0.smithi084.stdout:174: writing smithi084102331-44 from 835584 to 1228800 tid 3 2024-01-13T18:01:05.349 INFO:tasks.rados.rados.0.smithi084.stdout:175: snap_create 2024-01-13T18:01:05.349 INFO:tasks.rados.rados.0.smithi084.stdout:174: finishing write tid 1 to smithi084102331-44 2024-01-13T18:01:05.352 INFO:tasks.rados.rados.0.smithi084.stdout:174: finishing write tid 2 to smithi084102331-44 2024-01-13T18:01:05.352 INFO:tasks.rados.rados.0.smithi084.stdout:174: finishing write tid 3 to smithi084102331-44 2024-01-13T18:01:05.352 INFO:tasks.rados.rados.0.smithi084.stdout:174: finishing write tid 4 to smithi084102331-44 2024-01-13T18:01:05.354 INFO:tasks.rados.rados.0.smithi084.stdout:174: finishing write tid 5 to smithi084102331-44 2024-01-13T18:01:05.354 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 54 (ObjNum 73 snap 10 seq_num 73) dirty exists 2024-01-13T18:01:05.354 INFO:tasks.rados.rados.0.smithi084.stdout:174: left oid 44 (ObjNum 73 snap 10 seq_num 73) 2024-01-13T18:01:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:05 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:05 smithi099 ceph-mon[71325]: osdmap e90: 8 total, 8 up, 8 in 2024-01-13T18:01:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:05 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:05 smithi084 ceph-mon[37908]: osdmap e90: 8 total, 8 up, 8 in 2024-01-13T18:01:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:05 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:05 smithi084 ceph-mon[52328]: osdmap e90: 8 total, 8 up, 8 in 2024-01-13T18:01:06.357 INFO:tasks.rados.rados.0.smithi084.stdout:174: done (1 left) 2024-01-13T18:01:06.357 INFO:tasks.rados.rados.0.smithi084.stdout:175: done (0 left) 2024-01-13T18:01:06.357 INFO:tasks.rados.rados.0.smithi084.stdout:176: snap_remove snap 9 2024-01-13T18:01:06.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:06 smithi099 ceph-mon[71325]: pgmap v90: 121 pgs: 121 active+clean; 26 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:06.654 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:06 smithi084 ceph-mon[37908]: pgmap v90: 121 pgs: 121 active+clean; 26 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:06.655 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:06 smithi084 ceph-mon[52328]: pgmap v90: 121 pgs: 121 active+clean; 26 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:06.655 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:06 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:01:06] "GET /metrics HTTP/1.1" 200 239065 "" "Prometheus/2.43.0" 2024-01-13T18:01:07.353 INFO:tasks.rados.rados.0.smithi084.stdout:176: done (0 left) 2024-01-13T18:01:07.354 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 11 2024-01-13T18:01:07.354 INFO:tasks.rados.rados.0.smithi084.stdout:177: seq_num 74 ranges {794624=442368,1236992=696320,1933312=106496} 2024-01-13T18:01:07.360 INFO:tasks.rados.rados.0.smithi084.stdout:177: writing smithi084102331-22 from 794624 to 1236992 tid 1 2024-01-13T18:01:07.364 INFO:tasks.rados.rados.0.smithi084.stdout:177: writing smithi084102331-22 from 1236992 to 1933312 tid 2 2024-01-13T18:01:07.365 INFO:tasks.rados.rados.0.smithi084.stdout:177: writing smithi084102331-22 from 1933312 to 2039808 tid 3 2024-01-13T18:01:07.365 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 11 2024-01-13T18:01:07.365 INFO:tasks.rados.rados.0.smithi084.stdout:178: seq_num 75 ranges {1671168=458752,2129920=581632,2711552=221184} 2024-01-13T18:01:07.376 INFO:tasks.rados.rados.0.smithi084.stdout:178: writing smithi084102331-10 from 1671168 to 2129920 tid 1 2024-01-13T18:01:07.380 INFO:tasks.rados.rados.0.smithi084.stdout:178: writing smithi084102331-10 from 2129920 to 2711552 tid 2 2024-01-13T18:01:07.382 INFO:tasks.rados.rados.0.smithi084.stdout:178: writing smithi084102331-10 from 2711552 to 2932736 tid 3 2024-01-13T18:01:07.382 INFO:tasks.rados.rados.0.smithi084.stdout:179: setattr oid 6 current snap is 11 2024-01-13T18:01:07.382 INFO:tasks.rados.rados.0.smithi084.stdout:177: finishing write tid 1 to smithi084102331-22 2024-01-13T18:01:07.382 INFO:tasks.rados.rados.0.smithi084.stdout:177: finishing write tid 2 to smithi084102331-22 2024-01-13T18:01:07.382 INFO:tasks.rados.rados.0.smithi084.stdout:177: finishing write tid 3 to smithi084102331-22 2024-01-13T18:01:07.382 INFO:tasks.rados.rados.0.smithi084.stdout:177: finishing write tid 4 to smithi084102331-22 2024-01-13T18:01:07.382 INFO:tasks.rados.rados.0.smithi084.stdout:177: finishing write tid 5 to smithi084102331-22 2024-01-13T18:01:07.382 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 39 (ObjNum 74 snap 11 seq_num 74) dirty exists 2024-01-13T18:01:07.382 INFO:tasks.rados.rados.0.smithi084.stdout:177: left oid 22 (ObjNum 74 snap 11 seq_num 74) 2024-01-13T18:01:07.382 INFO:tasks.rados.rados.0.smithi084.stdout:178: finishing write tid 1 to smithi084102331-10 2024-01-13T18:01:07.382 INFO:tasks.rados.rados.0.smithi084.stdout:178: finishing write tid 2 to smithi084102331-10 2024-01-13T18:01:07.383 INFO:tasks.rados.rados.0.smithi084.stdout:178: finishing write tid 3 to smithi084102331-10 2024-01-13T18:01:07.383 INFO:tasks.rados.rados.0.smithi084.stdout:178: finishing write tid 4 to smithi084102331-10 2024-01-13T18:01:07.384 INFO:tasks.rados.rados.0.smithi084.stdout:177: done (2 left) 2024-01-13T18:01:07.384 INFO:tasks.rados.rados.0.smithi084.stdout:180: read oid 12 snap 10 2024-01-13T18:01:07.384 INFO:tasks.rados.rados.0.smithi084.stdout:180: expect deleted 2024-01-13T18:01:07.384 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 11 2024-01-13T18:01:07.385 INFO:tasks.rados.rados.0.smithi084.stdout:178: finishing write tid 5 to smithi084102331-10 2024-01-13T18:01:07.385 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 23 (ObjNum 75 snap 11 seq_num 75) dirty exists 2024-01-13T18:01:07.385 INFO:tasks.rados.rados.0.smithi084.stdout:178: left oid 10 (ObjNum 75 snap 11 seq_num 75) 2024-01-13T18:01:07.385 INFO:tasks.rados.rados.0.smithi084.stdout:181: seq_num 76 ranges {491520=475136,966656=458752,1425408=344064} 2024-01-13T18:01:07.390 INFO:tasks.rados.rados.0.smithi084.stdout:181: writing smithi084102331-3 from 491520 to 966656 tid 1 2024-01-13T18:01:07.392 INFO:tasks.rados.rados.0.smithi084.stdout:181: writing smithi084102331-3 from 966656 to 1425408 tid 2 2024-01-13T18:01:07.394 INFO:tasks.rados.rados.0.smithi084.stdout:181: writing smithi084102331-3 from 1425408 to 1769472 tid 3 2024-01-13T18:01:07.394 INFO:tasks.rados.rados.0.smithi084.stdout:178: done (3 left) 2024-01-13T18:01:07.394 INFO:tasks.rados.rados.0.smithi084.stdout:182: snap_create 2024-01-13T18:01:07.395 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 34 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-01-13T18:01:07.395 INFO:tasks.rados.rados.0.smithi084.stdout:181: finishing write tid 1 to smithi084102331-3 2024-01-13T18:01:07.395 INFO:tasks.rados.rados.0.smithi084.stdout:181: finishing write tid 2 to smithi084102331-3 2024-01-13T18:01:07.396 INFO:tasks.rados.rados.0.smithi084.stdout:181: finishing write tid 3 to smithi084102331-3 2024-01-13T18:01:07.396 INFO:tasks.rados.rados.0.smithi084.stdout:181: finishing write tid 4 to smithi084102331-3 2024-01-13T18:01:07.398 INFO:tasks.rados.rados.0.smithi084.stdout:181: finishing write tid 5 to smithi084102331-3 2024-01-13T18:01:07.398 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 59 (ObjNum 76 snap 11 seq_num 76) dirty exists 2024-01-13T18:01:07.398 INFO:tasks.rados.rados.0.smithi084.stdout:181: left oid 3 (ObjNum 76 snap 11 seq_num 76) 2024-01-13T18:01:07.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:07 smithi099 ceph-mon[71325]: osdmap e91: 8 total, 8 up, 8 in 2024-01-13T18:01:07.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:07.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:07.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:07 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:07.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:07 smithi099 ceph-mon[71325]: osdmap e92: 8 total, 8 up, 8 in 2024-01-13T18:01:07.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:07 smithi084 ceph-mon[37908]: osdmap e91: 8 total, 8 up, 8 in 2024-01-13T18:01:07.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:07.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:07.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:07 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:07.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:07 smithi084 ceph-mon[37908]: osdmap e92: 8 total, 8 up, 8 in 2024-01-13T18:01:07.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:07 smithi084 ceph-mon[52328]: osdmap e91: 8 total, 8 up, 8 in 2024-01-13T18:01:07.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:07.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:07.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:07 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:07.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:07 smithi084 ceph-mon[52328]: osdmap e92: 8 total, 8 up, 8 in 2024-01-13T18:01:08.369 INFO:tasks.rados.rados.0.smithi084.stdout:179: done (3 left) 2024-01-13T18:01:08.369 INFO:tasks.rados.rados.0.smithi084.stdout:180: done (2 left) 2024-01-13T18:01:08.369 INFO:tasks.rados.rados.0.smithi084.stdout:181: done (1 left) 2024-01-13T18:01:08.369 INFO:tasks.rados.rados.0.smithi084.stdout:182: done (0 left) 2024-01-13T18:01:08.369 INFO:tasks.rados.rados.0.smithi084.stdout:183: snap_create 2024-01-13T18:01:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:08 smithi099 ceph-mon[71325]: Upgrade: Target is version 18.2.1-242-gd2f11f33 (unknown) 2024-01-13T18:01:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:08 smithi099 ceph-mon[71325]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:d6d60d05dff5772f7e350906e2e1b517bcdd3acce20741111cbb18b7fc21aa5d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:d6d60d05dff5772f7e350906e2e1b517bcdd3acce20741111cbb18b7fc21aa5d'] 2024-01-13T18:01:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:08 smithi099 ceph-mon[71325]: Upgrade: Need to upgrade myself (mgr.y) 2024-01-13T18:01:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:08 smithi099 ceph-mon[71325]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:d6d60d05dff5772f7e350906e2e1b517bcdd3acce20741111cbb18b7fc21aa5d on smithi099 2024-01-13T18:01:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:08 smithi099 ceph-mon[71325]: pgmap v93: 121 pgs: 121 active+clean; 32 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-01-13T18:01:08.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:08 smithi084 ceph-mon[52328]: Upgrade: Target is version 18.2.1-242-gd2f11f33 (unknown) 2024-01-13T18:01:08.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:08 smithi084 ceph-mon[52328]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:d6d60d05dff5772f7e350906e2e1b517bcdd3acce20741111cbb18b7fc21aa5d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:d6d60d05dff5772f7e350906e2e1b517bcdd3acce20741111cbb18b7fc21aa5d'] 2024-01-13T18:01:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:08 smithi084 ceph-mon[52328]: Upgrade: Need to upgrade myself (mgr.y) 2024-01-13T18:01:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:08 smithi084 ceph-mon[52328]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:d6d60d05dff5772f7e350906e2e1b517bcdd3acce20741111cbb18b7fc21aa5d on smithi099 2024-01-13T18:01:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:08 smithi084 ceph-mon[52328]: pgmap v93: 121 pgs: 121 active+clean; 32 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-01-13T18:01:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:08 smithi084 ceph-mon[37908]: Upgrade: Target is version 18.2.1-242-gd2f11f33 (unknown) 2024-01-13T18:01:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:08 smithi084 ceph-mon[37908]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:d6d60d05dff5772f7e350906e2e1b517bcdd3acce20741111cbb18b7fc21aa5d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:d6d60d05dff5772f7e350906e2e1b517bcdd3acce20741111cbb18b7fc21aa5d'] 2024-01-13T18:01:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:08 smithi084 ceph-mon[37908]: Upgrade: Need to upgrade myself (mgr.y) 2024-01-13T18:01:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:08 smithi084 ceph-mon[37908]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:d6d60d05dff5772f7e350906e2e1b517bcdd3acce20741111cbb18b7fc21aa5d on smithi099 2024-01-13T18:01:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:08 smithi084 ceph-mon[37908]: pgmap v93: 121 pgs: 121 active+clean; 32 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-01-13T18:01:09.331 INFO:tasks.rados.rados.0.smithi084.stdout:183: done (0 left) 2024-01-13T18:01:09.331 INFO:tasks.rados.rados.0.smithi084.stdout:184: read oid 45 snap -1 2024-01-13T18:01:09.331 INFO:tasks.rados.rados.0.smithi084.stdout:184: expect (ObjNum 33 snap 0 seq_num 33) 2024-01-13T18:01:09.331 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 13 2024-01-13T18:01:09.331 INFO:tasks.rados.rados.0.smithi084.stdout:185: seq_num 77 ranges {2834432=491520,3325952=794624,4120576=8192} 2024-01-13T18:01:09.349 INFO:tasks.rados.rados.0.smithi084.stdout:185: writing smithi084102331-31 from 2834432 to 3325952 tid 1 2024-01-13T18:01:09.354 INFO:tasks.rados.rados.0.smithi084.stdout:185: writing smithi084102331-31 from 3325952 to 4120576 tid 2 2024-01-13T18:01:09.354 INFO:tasks.rados.rados.0.smithi084.stdout:185: writing smithi084102331-31 from 4120576 to 4128768 tid 3 2024-01-13T18:01:09.354 INFO:tasks.rados.rados.0.smithi084.stdout:186: read oid 49 snap -1 2024-01-13T18:01:09.354 INFO:tasks.rados.rados.0.smithi084.stdout:186: expect (ObjNum 48 snap 0 seq_num 48) 2024-01-13T18:01:09.354 INFO:tasks.rados.rados.0.smithi084.stdout:187: read oid 38 snap -1 2024-01-13T18:01:09.354 INFO:tasks.rados.rados.0.smithi084.stdout:187: expect (ObjNum 37 snap 0 seq_num 37) 2024-01-13T18:01:09.354 INFO:tasks.rados.rados.0.smithi084.stdout:188: read oid 40 snap -1 2024-01-13T18:01:09.354 INFO:tasks.rados.rados.0.smithi084.stdout:188: expect (ObjNum 39 snap 0 seq_num 39) 2024-01-13T18:01:09.354 INFO:tasks.rados.rados.0.smithi084.stdout:189: snap_create 2024-01-13T18:01:09.354 INFO:tasks.rados.rados.0.smithi084.stdout:184: expect (ObjNum 33 snap 0 seq_num 33) 2024-01-13T18:01:09.371 INFO:tasks.rados.rados.0.smithi084.stdout:185: finishing write tid 1 to smithi084102331-31 2024-01-13T18:01:09.371 INFO:tasks.rados.rados.0.smithi084.stdout:188: expect (ObjNum 39 snap 0 seq_num 39) 2024-01-13T18:01:09.387 INFO:tasks.rados.rados.0.smithi084.stdout:186: expect (ObjNum 48 snap 0 seq_num 48) 2024-01-13T18:01:09.409 INFO:tasks.rados.rados.0.smithi084.stdout:185: finishing write tid 2 to smithi084102331-31 2024-01-13T18:01:09.409 INFO:tasks.rados.rados.0.smithi084.stdout:185: finishing write tid 3 to smithi084102331-31 2024-01-13T18:01:09.409 INFO:tasks.rados.rados.0.smithi084.stdout:185: finishing write tid 4 to smithi084102331-31 2024-01-13T18:01:09.409 INFO:tasks.rados.rados.0.smithi084.stdout:187: expect (ObjNum 37 snap 0 seq_num 37) 2024-01-13T18:01:09.425 INFO:tasks.rados.rados.0.smithi084.stdout:185: finishing write tid 5 to smithi084102331-31 2024-01-13T18:01:09.425 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 64 (ObjNum 77 snap 13 seq_num 77) dirty exists 2024-01-13T18:01:09.425 INFO:tasks.rados.rados.0.smithi084.stdout:185: left oid 31 (ObjNum 77 snap 13 seq_num 77) 2024-01-13T18:01:09.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:09 smithi084 ceph-mon[37908]: osdmap e93: 8 total, 8 up, 8 in 2024-01-13T18:01:09.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:09 smithi084 ceph-mon[37908]: osdmap e94: 8 total, 8 up, 8 in 2024-01-13T18:01:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:09 smithi084 ceph-mon[52328]: osdmap e93: 8 total, 8 up, 8 in 2024-01-13T18:01:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:09 smithi084 ceph-mon[52328]: osdmap e94: 8 total, 8 up, 8 in 2024-01-13T18:01:09.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:09 smithi099 ceph-mon[71325]: osdmap e93: 8 total, 8 up, 8 in 2024-01-13T18:01:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:09 smithi099 ceph-mon[71325]: osdmap e94: 8 total, 8 up, 8 in 2024-01-13T18:01:10.338 INFO:tasks.rados.rados.0.smithi084.stdout:184: done (5 left) 2024-01-13T18:01:10.338 INFO:tasks.rados.rados.0.smithi084.stdout:185: done (4 left) 2024-01-13T18:01:10.338 INFO:tasks.rados.rados.0.smithi084.stdout:186: done (3 left) 2024-01-13T18:01:10.338 INFO:tasks.rados.rados.0.smithi084.stdout:187: done (2 left) 2024-01-13T18:01:10.338 INFO:tasks.rados.rados.0.smithi084.stdout:188: done (1 left) 2024-01-13T18:01:10.338 INFO:tasks.rados.rados.0.smithi084.stdout:189: done (0 left) 2024-01-13T18:01:10.338 INFO:tasks.rados.rados.0.smithi084.stdout:190: snap_remove snap 13 2024-01-13T18:01:10.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:10 smithi084 ceph-mon[37908]: pgmap v96: 121 pgs: 121 active+clean; 32 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-01-13T18:01:10.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:10 smithi084 ceph-mon[37908]: osdmap e95: 8 total, 8 up, 8 in 2024-01-13T18:01:10.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:10 smithi084 ceph-mon[52328]: pgmap v96: 121 pgs: 121 active+clean; 32 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-01-13T18:01:10.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:10 smithi084 ceph-mon[52328]: osdmap e95: 8 total, 8 up, 8 in 2024-01-13T18:01:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:10 smithi099 ceph-mon[71325]: pgmap v96: 121 pgs: 121 active+clean; 32 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-01-13T18:01:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:10 smithi099 ceph-mon[71325]: osdmap e95: 8 total, 8 up, 8 in 2024-01-13T18:01:11.339 INFO:tasks.rados.rados.0.smithi084.stdout:190: done (0 left) 2024-01-13T18:01:11.339 INFO:tasks.rados.rados.0.smithi084.stdout:191: read oid 36 snap -1 2024-01-13T18:01:11.339 INFO:tasks.rados.rados.0.smithi084.stdout:191: expect (ObjNum 1 snap 0 seq_num 1) 2024-01-13T18:01:11.339 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 14 2024-01-13T18:01:11.339 INFO:tasks.rados.rados.0.smithi084.stdout:192: seq_num 78 ranges {0=516096,516096=679936,1196032=122880} 2024-01-13T18:01:11.342 INFO:tasks.rados.rados.0.smithi084.stdout:192: writing smithi084102331-1 from 0 to 516096 tid 1 2024-01-13T18:01:11.346 INFO:tasks.rados.rados.0.smithi084.stdout:192: writing smithi084102331-1 from 516096 to 1196032 tid 2 2024-01-13T18:01:11.347 INFO:tasks.rados.rados.0.smithi084.stdout:192: writing smithi084102331-1 from 1196032 to 1318912 tid 3 2024-01-13T18:01:11.347 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 14 2024-01-13T18:01:11.347 INFO:tasks.rados.rados.0.smithi084.stdout:193: seq_num 79 ranges {139264=532480,671744=565248,1236992=237568} 2024-01-13T18:01:11.351 INFO:tasks.rados.rados.0.smithi084.stdout:193: writing smithi084102331-9 from 139264 to 671744 tid 1 2024-01-13T18:01:11.354 INFO:tasks.rados.rados.0.smithi084.stdout:193: writing smithi084102331-9 from 671744 to 1236992 tid 2 2024-01-13T18:01:11.356 INFO:tasks.rados.rados.0.smithi084.stdout:193: writing smithi084102331-9 from 1236992 to 1474560 tid 3 2024-01-13T18:01:11.356 INFO:tasks.rados.rados.0.smithi084.stdout:194: rmattr oid 11 current snap is 14 2024-01-13T18:01:11.356 INFO:tasks.rados.rados.0.smithi084.stdout:194: done (3 left) 2024-01-13T18:01:11.356 INFO:tasks.rados.rados.0.smithi084.stdout:195: snap_remove snap 12 2024-01-13T18:01:12.345 INFO:tasks.rados.rados.0.smithi084.stdout:195: done (3 left) 2024-01-13T18:01:12.345 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 14 2024-01-13T18:01:12.345 INFO:tasks.rados.rados.0.smithi084.stdout:196: seq_num 80 ranges {1220608=548864,1769472=450560,2220032=352256} 2024-01-13T18:01:12.355 INFO:tasks.rados.rados.0.smithi084.stdout:196: writing smithi084102331-2 from 1220608 to 1769472 tid 1 2024-01-13T18:01:12.358 INFO:tasks.rados.rados.0.smithi084.stdout:196: writing smithi084102331-2 from 1769472 to 2220032 tid 2 2024-01-13T18:01:12.360 INFO:tasks.rados.rados.0.smithi084.stdout:196: writing smithi084102331-2 from 2220032 to 2572288 tid 3 2024-01-13T18:01:12.360 INFO:tasks.rados.rados.0.smithi084.stdout:197: copy_from oid 38 from oid 46 current snap is 14 2024-01-13T18:01:12.360 INFO:tasks.rados.rados.0.smithi084.stdout:191: expect (ObjNum 1 snap 0 seq_num 1) 2024-01-13T18:01:12.361 INFO:tasks.rados.rados.0.smithi084.stdout:192: finishing write tid 1 to smithi084102331-1 2024-01-13T18:01:12.361 INFO:tasks.rados.rados.0.smithi084.stdout:192: finishing write tid 2 to smithi084102331-1 2024-01-13T18:01:12.362 INFO:tasks.rados.rados.0.smithi084.stdout:192: finishing write tid 3 to smithi084102331-1 2024-01-13T18:01:12.362 INFO:tasks.rados.rados.0.smithi084.stdout:192: finishing write tid 4 to smithi084102331-1 2024-01-13T18:01:12.362 INFO:tasks.rados.rados.0.smithi084.stdout:192: finishing write tid 5 to smithi084102331-1 2024-01-13T18:01:12.362 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 68 (ObjNum 78 snap 14 seq_num 78) dirty exists 2024-01-13T18:01:12.363 INFO:tasks.rados.rados.0.smithi084.stdout:192: left oid 1 (ObjNum 78 snap 14 seq_num 78) 2024-01-13T18:01:12.363 INFO:tasks.rados.rados.0.smithi084.stdout:193: finishing write tid 1 to smithi084102331-9 2024-01-13T18:01:12.363 INFO:tasks.rados.rados.0.smithi084.stdout:191: done (4 left) 2024-01-13T18:01:12.363 INFO:tasks.rados.rados.0.smithi084.stdout:192: done (3 left) 2024-01-13T18:01:12.363 INFO:tasks.rados.rados.0.smithi084.stdout:198: snap_remove snap 10 2024-01-13T18:01:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:12 smithi099 ceph-mon[71325]: pgmap v99: 121 pgs: 121 active+clean; 37 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:01:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:12 smithi099 ceph-mon[71325]: osdmap e96: 8 total, 8 up, 8 in 2024-01-13T18:01:12.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:12 smithi084 ceph-mon[37908]: pgmap v99: 121 pgs: 121 active+clean; 37 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:01:12.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:12 smithi084 ceph-mon[37908]: osdmap e96: 8 total, 8 up, 8 in 2024-01-13T18:01:12.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:12 smithi084 ceph-mon[52328]: pgmap v99: 121 pgs: 121 active+clean; 37 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:01:12.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:12 smithi084 ceph-mon[52328]: osdmap e96: 8 total, 8 up, 8 in 2024-01-13T18:01:12.937 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (88s) 81s ago 112s 17.3M - 0.25.0 c8568f914cd2 f4a66f0ea4ed 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (99s) 80s ago 99s 82.4M - 9.4.7 954c08fa6188 8bf31d445aae 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (2m) 81s ago 2m 13.7M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (2m) 80s ago 2m 17.3M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443 running (5m) 80s ago 5m 438M - 17.2.7-268-g6441305d c3a232f785d8 6873f77bac1c 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:9283 running (6m) 81s ago 6m 495M - 17.2.7-268-g6441305d c3a232f785d8 051f8ff2f26d 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (6m) 81s ago 6m 82.9M 2048M 17.2.7-268-g6441305d c3a232f785d8 0eb2ed5f8766 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (5m) 80s ago 5m 66.6M 2048M 17.2.7-268-g6441305d c3a232f785d8 bf79d7793fc1 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (5m) 81s ago 5m 67.1M 2048M 17.2.7-268-g6441305d c3a232f785d8 510574f8be07 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (97s) 81s ago 96s 4106k - 1.5.0 0da6a335fe13 eaf6d03cde96 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (94s) 80s ago 93s 3900k - 1.5.0 0da6a335fe13 14e49e9d7852 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 81s ago 4m 63.3M 3000M 17.2.7-268-g6441305d c3a232f785d8 809287996fef 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (4m) 81s ago 4m 63.0M 3000M 17.2.7-268-g6441305d c3a232f785d8 fad77ee705d8 2024-01-13T18:01:13.234 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (4m) 81s ago 4m 55.9M 3000M 17.2.7-268-g6441305d c3a232f785d8 14025770cf00 2024-01-13T18:01:13.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (4m) 81s ago 4m 50.1M 3000M 17.2.7-268-g6441305d c3a232f785d8 068cf98fa99c 2024-01-13T18:01:13.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (3m) 80s ago 3m 52.0M 3000M 17.2.7-268-g6441305d c3a232f785d8 30e0722550a0 2024-01-13T18:01:13.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (3m) 80s ago 3m 53.6M 3000M 17.2.7-268-g6441305d c3a232f785d8 51be805dde78 2024-01-13T18:01:13.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (3m) 80s ago 3m 52.4M 3000M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:01:13.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (2m) 80s ago 2m 58.3M 3000M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:01:13.235 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (86s) 80s ago 2m 28.2M - 2.43.0 a07b618ecd1d 79a2b67e3dcd 2024-01-13T18:01:13.354 INFO:tasks.rados.rados.0.smithi084.stdout:198: done (3 left) 2024-01-13T18:01:13.354 INFO:tasks.rados.rados.0.smithi084.stdout:199: rmattr oid 7 current snap is 14 2024-01-13T18:01:13.354 INFO:tasks.rados.rados.0.smithi084.stdout:199: done (3 left) 2024-01-13T18:01:13.354 INFO:tasks.rados.rados.0.smithi084.stdout:200: rmattr oid 24 current snap is 14 2024-01-13T18:01:13.354 INFO:tasks.rados.rados.0.smithi084.stdout:200: done (3 left) 2024-01-13T18:01:13.354 INFO:tasks.rados.rados.0.smithi084.stdout:201: rmattr oid 39 current snap is 14 2024-01-13T18:01:13.354 INFO:tasks.rados.rados.0.smithi084.stdout:201: done (3 left) 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:202: read oid 1 snap -1 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:202: expect (ObjNum 78 snap 14 seq_num 78) 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:203: read oid 50 snap -1 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:203: expect (ObjNum 49 snap 0 seq_num 49) 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:204: setattr oid 35 current snap is 14 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:193: finishing write tid 2 to smithi084102331-9 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:193: finishing write tid 3 to smithi084102331-9 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:193: finishing write tid 4 to smithi084102331-9 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:193: finishing write tid 5 to smithi084102331-9 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 39 (ObjNum 79 snap 14 seq_num 79) dirty exists 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:193: left oid 9 (ObjNum 79 snap 14 seq_num 79) 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:196: finishing write tid 1 to smithi084102331-2 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:196: finishing write tid 2 to smithi084102331-2 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:196: finishing write tid 3 to smithi084102331-2 2024-01-13T18:01:13.355 INFO:tasks.rados.rados.0.smithi084.stdout:196: finishing write tid 4 to smithi084102331-2 2024-01-13T18:01:13.356 INFO:tasks.rados.rados.0.smithi084.stdout:196: finishing write tid 5 to smithi084102331-2 2024-01-13T18:01:13.356 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 44 (ObjNum 80 snap 14 seq_num 80) dirty exists 2024-01-13T18:01:13.356 INFO:tasks.rados.rados.0.smithi084.stdout:196: left oid 2 (ObjNum 80 snap 14 seq_num 80) 2024-01-13T18:01:13.356 INFO:tasks.rados.rados.0.smithi084.stdout:197: finishing copy_from to smithi084102331-38 2024-01-13T18:01:13.356 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 15 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:01:13.356 INFO:tasks.rados.rados.0.smithi084.stdout:197: finishing copy_from racing read to smithi084102331-38 2024-01-13T18:01:13.356 INFO:tasks.rados.rados.0.smithi084.stdout:193: done (5 left) 2024-01-13T18:01:13.356 INFO:tasks.rados.rados.0.smithi084.stdout:196: done (4 left) 2024-01-13T18:01:13.356 INFO:tasks.rados.rados.0.smithi084.stdout:197: done (3 left) 2024-01-13T18:01:13.356 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 14 2024-01-13T18:01:13.356 INFO:tasks.rados.rados.0.smithi084.stdout:205: seq_num 81 ranges {2932736=565248,3497984=737280,4235264=65536} 2024-01-13T18:01:13.373 INFO:tasks.rados.rados.0.smithi084.stdout:205: writing smithi084102331-10 from 2932736 to 3497984 tid 1 2024-01-13T18:01:13.378 INFO:tasks.rados.rados.0.smithi084.stdout:205: writing smithi084102331-10 from 3497984 to 4235264 tid 2 2024-01-13T18:01:13.378 INFO:tasks.rados.rados.0.smithi084.stdout:205: writing smithi084102331-10 from 4235264 to 4300800 tid 3 2024-01-13T18:01:13.378 INFO:tasks.rados.rados.0.smithi084.stdout:206: copy_from oid 25 from oid 11 current snap is 14 2024-01-13T18:01:13.378 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 35 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-01-13T18:01:13.378 INFO:tasks.rados.rados.0.smithi084.stdout:202: expect (ObjNum 78 snap 14 seq_num 78) 2024-01-13T18:01:13.412 INFO:tasks.rados.rados.0.smithi084.stdout:203: expect (ObjNum 49 snap 0 seq_num 49) 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:205: finishing write tid 1 to smithi084102331-10 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:206: finishing copy_from to smithi084102331-25 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:206: got expected ENOENT (src dne) 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:206: finishing copy_from racing read to smithi084102331-25 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:202: done (4 left) 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:203: done (3 left) 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:204: done (2 left) 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:206: done (1 left) 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:207: snap_create 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:205: finishing write tid 2 to smithi084102331-10 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:205: finishing write tid 3 to smithi084102331-10 2024-01-13T18:01:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:205: finishing write tid 4 to smithi084102331-10 2024-01-13T18:01:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:205: finishing write tid 5 to smithi084102331-10 2024-01-13T18:01:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 27 (ObjNum 81 snap 14 seq_num 81) dirty exists 2024-01-13T18:01:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:205: left oid 10 (ObjNum 81 snap 14 seq_num 81) 2024-01-13T18:01:13.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:13 smithi099 ceph-mon[71325]: osdmap e97: 8 total, 8 up, 8 in 2024-01-13T18:01:13.623 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:01:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:01:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 3 2024-01-13T18:01:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:01:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:01:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:01:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:01:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:01:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 8 2024-01-13T18:01:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:01:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:01:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:01:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:01:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:01:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 15 2024-01-13T18:01:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:01:13.624 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:01:13.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:13 smithi084 ceph-mon[52328]: osdmap e97: 8 total, 8 up, 8 in 2024-01-13T18:01:13.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:13 smithi084 ceph-mon[37908]: osdmap e97: 8 total, 8 up, 8 in 2024-01-13T18:01:14.331 INFO:tasks.rados.rados.0.smithi084.stdout:205: done (1 left) 2024-01-13T18:01:14.331 INFO:tasks.rados.rados.0.smithi084.stdout:207: done (0 left) 2024-01-13T18:01:14.331 INFO:tasks.rados.rados.0.smithi084.stdout:208: delete oid 31 current snap is 15 2024-01-13T18:01:14.336 INFO:tasks.rados.rados.0.smithi084.stdout:208: done (0 left) 2024-01-13T18:01:14.336 INFO:tasks.rados.rados.0.smithi084.stdout:209: delete oid 26 current snap is 15 2024-01-13T18:01:14.338 INFO:tasks.rados.rados.0.smithi084.stdout:209: done (0 left) 2024-01-13T18:01:14.338 INFO:tasks.rados.rados.0.smithi084.stdout:210: copy_from oid 20 from oid 42 current snap is 15 2024-01-13T18:01:14.338 INFO:tasks.rados.rados.0.smithi084.stdout:211: delete oid 5 current snap is 15 2024-01-13T18:01:14.342 INFO:tasks.rados.rados.0.smithi084.stdout:211: done (1 left) 2024-01-13T18:01:14.342 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 15 2024-01-13T18:01:14.342 INFO:tasks.rados.rados.0.smithi084.stdout:212: seq_num 85 ranges {204800=630784,835584=720896,1556480=81920} 2024-01-13T18:01:14.347 INFO:tasks.rados.rados.0.smithi084.stdout:212: writing smithi084102331-13 from 204800 to 835584 tid 1 2024-01-13T18:01:14.351 INFO:tasks.rados.rados.0.smithi084.stdout:212: writing smithi084102331-13 from 835584 to 1556480 tid 2 2024-01-13T18:01:14.353 INFO:tasks.rados.rados.0.smithi084.stdout:212: writing smithi084102331-13 from 1556480 to 1638400 tid 3 2024-01-13T18:01:14.353 INFO:tasks.rados.rados.0.smithi084.stdout:213: read oid 19 snap -1 2024-01-13T18:01:14.353 INFO:tasks.rados.rados.0.smithi084.stdout:213: expect (ObjNum 18 snap 0 seq_num 18) 2024-01-13T18:01:14.354 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 15 2024-01-13T18:01:14.354 INFO:tasks.rados.rados.0.smithi084.stdout:210: finishing copy_from to smithi084102331-20 2024-01-13T18:01:14.354 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 2 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-01-13T18:01:14.354 INFO:tasks.rados.rados.0.smithi084.stdout:210: finishing copy_from racing read to smithi084102331-20 2024-01-13T18:01:14.354 INFO:tasks.rados.rados.0.smithi084.stdout:214: seq_num 86 ranges {344064=647168,991232=606208,1597440=196608} 2024-01-13T18:01:14.358 INFO:tasks.rados.rados.0.smithi084.stdout:214: writing smithi084102331-21 from 344064 to 991232 tid 1 2024-01-13T18:01:14.361 INFO:tasks.rados.rados.0.smithi084.stdout:214: writing smithi084102331-21 from 991232 to 1597440 tid 2 2024-01-13T18:01:14.363 INFO:tasks.rados.rados.0.smithi084.stdout:214: writing smithi084102331-21 from 1597440 to 1794048 tid 3 2024-01-13T18:01:14.363 INFO:tasks.rados.rados.0.smithi084.stdout:210: done (3 left) 2024-01-13T18:01:14.363 INFO:tasks.rados.rados.0.smithi084.stdout:215: delete oid 11 current snap is 15 2024-01-13T18:01:14.364 INFO:tasks.rados.rados.0.smithi084.stdout:213: expect (ObjNum 18 snap 0 seq_num 18) 2024-01-13T18:01:14.372 INFO:tasks.rados.rados.0.smithi084.stdout:212: finishing write tid 1 to smithi084102331-13 2024-01-13T18:01:14.372 INFO:tasks.rados.rados.0.smithi084.stdout:212: finishing write tid 2 to smithi084102331-13 2024-01-13T18:01:14.373 INFO:tasks.rados.rados.0.smithi084.stdout:212: finishing write tid 3 to smithi084102331-13 2024-01-13T18:01:14.373 INFO:tasks.rados.rados.0.smithi084.stdout:212: finishing write tid 4 to smithi084102331-13 2024-01-13T18:01:14.373 INFO:tasks.rados.rados.0.smithi084.stdout:212: finishing write tid 5 to smithi084102331-13 2024-01-13T18:01:14.373 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 35 (ObjNum 85 snap 15 seq_num 85) dirty exists 2024-01-13T18:01:14.373 INFO:tasks.rados.rados.0.smithi084.stdout:212: left oid 13 (ObjNum 85 snap 15 seq_num 85) 2024-01-13T18:01:14.373 INFO:tasks.rados.rados.0.smithi084.stdout:214: finishing write tid 1 to smithi084102331-21 2024-01-13T18:01:14.373 INFO:tasks.rados.rados.0.smithi084.stdout:214: finishing write tid 2 to smithi084102331-21 2024-01-13T18:01:14.373 INFO:tasks.rados.rados.0.smithi084.stdout:214: finishing write tid 3 to smithi084102331-21 2024-01-13T18:01:14.374 INFO:tasks.rados.rados.0.smithi084.stdout:214: finishing write tid 4 to smithi084102331-21 2024-01-13T18:01:14.374 INFO:tasks.rados.rados.0.smithi084.stdout:212: done (3 left) 2024-01-13T18:01:14.374 INFO:tasks.rados.rados.0.smithi084.stdout:213: done (2 left) 2024-01-13T18:01:14.374 INFO:tasks.rados.rados.0.smithi084.stdout:215: done (1 left) 2024-01-13T18:01:14.374 INFO:tasks.rados.rados.0.smithi084.stdout:216: read oid 32 snap -1 2024-01-13T18:01:14.374 INFO:tasks.rados.rados.0.smithi084.stdout:216: expect (ObjNum 31 snap 0 seq_num 31) 2024-01-13T18:01:14.374 INFO:tasks.rados.rados.0.smithi084.stdout:217: rollback oid 26 current snap is 15 2024-01-13T18:01:14.375 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 14 2024-01-13T18:01:14.375 INFO:tasks.rados.rados.0.smithi084.stdout:214: finishing write tid 5 to smithi084102331-21 2024-01-13T18:01:14.375 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 40 (ObjNum 86 snap 15 seq_num 86) dirty exists 2024-01-13T18:01:14.375 INFO:tasks.rados.rados.0.smithi084.stdout:214: left oid 21 (ObjNum 86 snap 15 seq_num 86) 2024-01-13T18:01:14.375 INFO:tasks.rados.rados.0.smithi084.stdout:214: done (2 left) 2024-01-13T18:01:14.375 INFO:tasks.rados.rados.0.smithi084.stdout:218: read oid 38 snap -1 2024-01-13T18:01:14.376 INFO:tasks.rados.rados.0.smithi084.stdout:218: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:14.376 INFO:tasks.rados.rados.0.smithi084.stdout:219: snap_create 2024-01-13T18:01:14.377 INFO:tasks.rados.rados.0.smithi084.stdout:217: finishing rollback tid 1 to smithi084102331-26 2024-01-13T18:01:14.377 INFO:tasks.rados.rados.0.smithi084.stdout:217: finishing rollback tid 2 to smithi084102331-26 2024-01-13T18:01:14.377 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 31 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-01-13T18:01:14.377 INFO:tasks.rados.rados.0.smithi084.stdout:218: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:14.395 INFO:tasks.rados.rados.0.smithi084.stdout:216: expect (ObjNum 31 snap 0 seq_num 31) 2024-01-13T18:01:14.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:14 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:01:14] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T18:01:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:14 smithi099 ceph-mon[71325]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:14 smithi099 ceph-mon[71325]: pgmap v102: 121 pgs: 121 active+clean; 37 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:01:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:14 smithi099 ceph-mon[71325]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:14 smithi099 ceph-mon[71325]: osdmap e98: 8 total, 8 up, 8 in 2024-01-13T18:01:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:14 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2442806017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:01:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:14 smithi099 ceph-mon[71325]: osdmap e99: 8 total, 8 up, 8 in 2024-01-13T18:01:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[37908]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[37908]: pgmap v102: 121 pgs: 121 active+clean; 37 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:01:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[37908]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[37908]: osdmap e98: 8 total, 8 up, 8 in 2024-01-13T18:01:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2442806017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:01:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[37908]: osdmap e99: 8 total, 8 up, 8 in 2024-01-13T18:01:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[52328]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[52328]: pgmap v102: 121 pgs: 121 active+clean; 37 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:01:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[52328]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[52328]: osdmap e98: 8 total, 8 up, 8 in 2024-01-13T18:01:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2442806017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:01:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:14 smithi084 ceph-mon[52328]: osdmap e99: 8 total, 8 up, 8 in 2024-01-13T18:01:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:216: done (3 left) 2024-01-13T18:01:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:217: done (2 left) 2024-01-13T18:01:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:218: done (1 left) 2024-01-13T18:01:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:219: done (0 left) 2024-01-13T18:01:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 16 2024-01-13T18:01:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:220: seq_num 88 ranges {1417216=679936,2097152=778240,2875392=24576} 2024-01-13T18:01:15.371 INFO:tasks.rados.rados.0.smithi084.stdout:220: writing smithi084102331-16 from 1417216 to 2097152 tid 1 2024-01-13T18:01:15.377 INFO:tasks.rados.rados.0.smithi084.stdout:220: writing smithi084102331-16 from 2097152 to 2875392 tid 2 2024-01-13T18:01:15.377 INFO:tasks.rados.rados.0.smithi084.stdout:220: writing smithi084102331-16 from 2875392 to 2899968 tid 3 2024-01-13T18:01:15.377 INFO:tasks.rados.rados.0.smithi084.stdout:221: rollback oid 36 current snap is 16 2024-01-13T18:01:15.377 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 14 2024-01-13T18:01:15.377 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 16 2024-01-13T18:01:15.377 INFO:tasks.rados.rados.0.smithi084.stdout:222: seq_num 89 ranges {204800=696320,901120=655360,1556480=147456} 2024-01-13T18:01:15.382 INFO:tasks.rados.rados.0.smithi084.stdout:222: writing smithi084102331-47 from 204800 to 901120 tid 1 2024-01-13T18:01:15.386 INFO:tasks.rados.rados.0.smithi084.stdout:222: writing smithi084102331-47 from 901120 to 1556480 tid 2 2024-01-13T18:01:15.387 INFO:tasks.rados.rados.0.smithi084.stdout:222: writing smithi084102331-47 from 1556480 to 1703936 tid 3 2024-01-13T18:01:15.387 INFO:tasks.rados.rados.0.smithi084.stdout:223: delete oid 24 current snap is 16 2024-01-13T18:01:15.387 INFO:tasks.rados.rados.0.smithi084.stdout:220: finishing write tid 1 to smithi084102331-16 2024-01-13T18:01:15.387 INFO:tasks.rados.rados.0.smithi084.stdout:221: finishing rollback tid 0 to smithi084102331-36 2024-01-13T18:01:15.387 INFO:tasks.rados.rados.0.smithi084.stdout:221: finishing rollback tid 1 to smithi084102331-36 2024-01-13T18:01:15.387 INFO:tasks.rados.rados.0.smithi084.stdout:220: finishing write tid 2 to smithi084102331-16 2024-01-13T18:01:15.387 INFO:tasks.rados.rados.0.smithi084.stdout:221: finishing rollback tid 2 to smithi084102331-36 2024-01-13T18:01:15.387 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 35 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-01-13T18:01:15.387 INFO:tasks.rados.rados.0.smithi084.stdout:220: finishing write tid 3 to smithi084102331-16 2024-01-13T18:01:15.388 INFO:tasks.rados.rados.0.smithi084.stdout:220: finishing write tid 4 to smithi084102331-16 2024-01-13T18:01:15.388 INFO:tasks.rados.rados.0.smithi084.stdout:220: finishing write tid 5 to smithi084102331-16 2024-01-13T18:01:15.388 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 24 (ObjNum 88 snap 16 seq_num 88) dirty exists 2024-01-13T18:01:15.388 INFO:tasks.rados.rados.0.smithi084.stdout:220: left oid 16 (ObjNum 88 snap 16 seq_num 88) 2024-01-13T18:01:15.388 INFO:tasks.rados.rados.0.smithi084.stdout:222: finishing write tid 1 to smithi084102331-47 2024-01-13T18:01:15.389 INFO:tasks.rados.rados.0.smithi084.stdout:220: done (3 left) 2024-01-13T18:01:15.389 INFO:tasks.rados.rados.0.smithi084.stdout:221: done (2 left) 2024-01-13T18:01:15.389 INFO:tasks.rados.rados.0.smithi084.stdout:223: done (1 left) 2024-01-13T18:01:15.389 INFO:tasks.rados.rados.0.smithi084.stdout:224: read oid 46 snap -1 2024-01-13T18:01:15.389 INFO:tasks.rados.rados.0.smithi084.stdout:224: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:15.389 INFO:tasks.rados.rados.0.smithi084.stdout:225: rollback oid 49 current snap is 16 2024-01-13T18:01:15.389 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 15 2024-01-13T18:01:15.389 INFO:tasks.rados.rados.0.smithi084.stdout:226: snap_remove snap 14 2024-01-13T18:01:16.366 INFO:tasks.rados.rados.0.smithi084.stdout:226: done (3 left) 2024-01-13T18:01:16.366 INFO:tasks.rados.rados.0.smithi084.stdout:227: snap_create 2024-01-13T18:01:16.366 INFO:tasks.rados.rados.0.smithi084.stdout:222: finishing write tid 2 to smithi084102331-47 2024-01-13T18:01:16.367 INFO:tasks.rados.rados.0.smithi084.stdout:224: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:16.387 INFO:tasks.rados.rados.0.smithi084.stdout:222: finishing write tid 3 to smithi084102331-47 2024-01-13T18:01:16.387 INFO:tasks.rados.rados.0.smithi084.stdout:222: finishing write tid 4 to smithi084102331-47 2024-01-13T18:01:16.387 INFO:tasks.rados.rados.0.smithi084.stdout:225: finishing rollback tid 0 to smithi084102331-49 2024-01-13T18:01:16.387 INFO:tasks.rados.rados.0.smithi084.stdout:225: finishing rollback tid 1 to smithi084102331-49 2024-01-13T18:01:16.387 INFO:tasks.rados.rados.0.smithi084.stdout:225: finishing rollback tid 2 to smithi084102331-49 2024-01-13T18:01:16.387 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 39 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-01-13T18:01:16.387 INFO:tasks.rados.rados.0.smithi084.stdout:222: finishing write tid 5 to smithi084102331-47 2024-01-13T18:01:16.387 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 59 (ObjNum 89 snap 16 seq_num 89) dirty exists 2024-01-13T18:01:16.387 INFO:tasks.rados.rados.0.smithi084.stdout:222: left oid 47 (ObjNum 89 snap 16 seq_num 89) 2024-01-13T18:01:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:16 smithi099 ceph-mon[71325]: pgmap v105: 121 pgs: 121 active+clean; 37 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:16 smithi099 ceph-mon[71325]: osdmap e100: 8 total, 8 up, 8 in 2024-01-13T18:01:16.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:16 smithi084 ceph-mon[37908]: pgmap v105: 121 pgs: 121 active+clean; 37 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:16 smithi084 ceph-mon[37908]: osdmap e100: 8 total, 8 up, 8 in 2024-01-13T18:01:16.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:16 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:01:16] "GET /metrics HTTP/1.1" 200 239065 "" "Prometheus/2.43.0" 2024-01-13T18:01:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:16 smithi084 ceph-mon[52328]: pgmap v105: 121 pgs: 121 active+clean; 37 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:16 smithi084 ceph-mon[52328]: osdmap e100: 8 total, 8 up, 8 in 2024-01-13T18:01:17.372 INFO:tasks.rados.rados.0.smithi084.stdout:222: done (3 left) 2024-01-13T18:01:17.372 INFO:tasks.rados.rados.0.smithi084.stdout:224: done (2 left) 2024-01-13T18:01:17.372 INFO:tasks.rados.rados.0.smithi084.stdout:225: done (1 left) 2024-01-13T18:01:17.372 INFO:tasks.rados.rados.0.smithi084.stdout:227: done (0 left) 2024-01-13T18:01:17.372 INFO:tasks.rados.rados.0.smithi084.stdout:228: snap_create 2024-01-13T18:01:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:17 smithi099 ceph-mon[71325]: osdmap e101: 8 total, 8 up, 8 in 2024-01-13T18:01:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:17 smithi084 ceph-mon[37908]: osdmap e101: 8 total, 8 up, 8 in 2024-01-13T18:01:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:17 smithi084 ceph-mon[52328]: osdmap e101: 8 total, 8 up, 8 in 2024-01-13T18:01:18.375 INFO:tasks.rados.rados.0.smithi084.stdout:228: done (0 left) 2024-01-13T18:01:18.375 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 18 2024-01-13T18:01:18.375 INFO:tasks.rados.rados.0.smithi084.stdout:229: seq_num 91 ranges {491520=729088,1220608=425984,1646592=376832} 2024-01-13T18:01:18.382 INFO:tasks.rados.rados.0.smithi084.stdout:229: writing smithi084102331-30 from 491520 to 1220608 tid 1 2024-01-13T18:01:18.384 INFO:tasks.rados.rados.0.smithi084.stdout:229: writing smithi084102331-30 from 1220608 to 1646592 tid 2 2024-01-13T18:01:18.386 INFO:tasks.rados.rados.0.smithi084.stdout:229: writing smithi084102331-30 from 1646592 to 2023424 tid 3 2024-01-13T18:01:18.387 INFO:tasks.rados.rados.0.smithi084.stdout:230: rmattr oid 17 current snap is 18 2024-01-13T18:01:18.387 INFO:tasks.rados.rados.0.smithi084.stdout:231: snap_remove snap 16 2024-01-13T18:01:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:18 smithi084 ceph-mon[37908]: pgmap v108: 121 pgs: 121 active+clean; 49 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 25 op/s 2024-01-13T18:01:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:18 smithi084 ceph-mon[37908]: osdmap e102: 8 total, 8 up, 8 in 2024-01-13T18:01:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:18 smithi084 ceph-mon[52328]: pgmap v108: 121 pgs: 121 active+clean; 49 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 25 op/s 2024-01-13T18:01:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:18 smithi084 ceph-mon[52328]: osdmap e102: 8 total, 8 up, 8 in 2024-01-13T18:01:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:18 smithi099 ceph-mon[71325]: pgmap v108: 121 pgs: 121 active+clean; 49 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 25 op/s 2024-01-13T18:01:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:18 smithi099 ceph-mon[71325]: osdmap e102: 8 total, 8 up, 8 in 2024-01-13T18:01:19.333 INFO:tasks.rados.rados.0.smithi084.stdout:231: done (2 left) 2024-01-13T18:01:19.333 INFO:tasks.rados.rados.0.smithi084.stdout:232: snap_remove snap 11 2024-01-13T18:01:19.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:19 smithi084 ceph-mon[37908]: osdmap e103: 8 total, 8 up, 8 in 2024-01-13T18:01:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:19 smithi084 ceph-mon[37908]: osdmap e104: 8 total, 8 up, 8 in 2024-01-13T18:01:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:19 smithi084 ceph-mon[52328]: osdmap e103: 8 total, 8 up, 8 in 2024-01-13T18:01:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:19 smithi084 ceph-mon[52328]: osdmap e104: 8 total, 8 up, 8 in 2024-01-13T18:01:19.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:19 smithi099 ceph-mon[71325]: osdmap e103: 8 total, 8 up, 8 in 2024-01-13T18:01:19.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:19 smithi099 ceph-mon[71325]: osdmap e104: 8 total, 8 up, 8 in 2024-01-13T18:01:20.338 INFO:tasks.rados.rados.0.smithi084.stdout:232: done (2 left) 2024-01-13T18:01:20.338 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 18 2024-01-13T18:01:20.338 INFO:tasks.rados.rados.0.smithi084.stdout:233: seq_num 92 ranges {1474560=745472,2220032=761856,2981888=40960} 2024-01-13T18:01:20.349 INFO:tasks.rados.rados.0.smithi084.stdout:233: writing smithi084102331-9 from 1474560 to 2220032 tid 1 2024-01-13T18:01:20.355 INFO:tasks.rados.rados.0.smithi084.stdout:233: writing smithi084102331-9 from 2220032 to 2981888 tid 2 2024-01-13T18:01:20.355 INFO:tasks.rados.rados.0.smithi084.stdout:233: writing smithi084102331-9 from 2981888 to 3022848 tid 3 2024-01-13T18:01:20.355 INFO:tasks.rados.rados.0.smithi084.stdout:234: read oid 31 snap -1 2024-01-13T18:01:20.355 INFO:tasks.rados.rados.0.smithi084.stdout:234: expect deleted 2024-01-13T18:01:20.355 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 18 2024-01-13T18:01:20.355 INFO:tasks.rados.rados.0.smithi084.stdout:235: seq_num 93 ranges {696320=761856,1458176=647168,2105344=155648} 2024-01-13T18:01:20.363 INFO:tasks.rados.rados.0.smithi084.stdout:235: writing smithi084102331-42 from 696320 to 1458176 tid 1 2024-01-13T18:01:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:235: writing smithi084102331-42 from 1458176 to 2105344 tid 2 2024-01-13T18:01:20.368 INFO:tasks.rados.rados.0.smithi084.stdout:235: writing smithi084102331-42 from 2105344 to 2260992 tid 3 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:236: snap_create 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:229: finishing write tid 1 to smithi084102331-30 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:229: finishing write tid 2 to smithi084102331-30 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:229: finishing write tid 3 to smithi084102331-30 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:229: finishing write tid 4 to smithi084102331-30 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:229: finishing write tid 5 to smithi084102331-30 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 29 (ObjNum 91 snap 18 seq_num 91) dirty exists 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:229: left oid 30 (ObjNum 91 snap 18 seq_num 91) 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 36 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:233: finishing write tid 1 to smithi084102331-9 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:233: finishing write tid 2 to smithi084102331-9 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:233: finishing write tid 3 to smithi084102331-9 2024-01-13T18:01:20.369 INFO:tasks.rados.rados.0.smithi084.stdout:233: finishing write tid 4 to smithi084102331-9 2024-01-13T18:01:20.370 INFO:tasks.rados.rados.0.smithi084.stdout:233: finishing write tid 5 to smithi084102331-9 2024-01-13T18:01:20.370 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 52 (ObjNum 92 snap 18 seq_num 92) dirty exists 2024-01-13T18:01:20.370 INFO:tasks.rados.rados.0.smithi084.stdout:233: left oid 9 (ObjNum 92 snap 18 seq_num 92) 2024-01-13T18:01:20.370 INFO:tasks.rados.rados.0.smithi084.stdout:235: finishing write tid 1 to smithi084102331-42 2024-01-13T18:01:20.370 INFO:tasks.rados.rados.0.smithi084.stdout:235: finishing write tid 2 to smithi084102331-42 2024-01-13T18:01:20.371 INFO:tasks.rados.rados.0.smithi084.stdout:235: finishing write tid 3 to smithi084102331-42 2024-01-13T18:01:20.371 INFO:tasks.rados.rados.0.smithi084.stdout:235: finishing write tid 4 to smithi084102331-42 2024-01-13T18:01:20.371 INFO:tasks.rados.rados.0.smithi084.stdout:235: finishing write tid 5 to smithi084102331-42 2024-01-13T18:01:20.371 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 7 (ObjNum 93 snap 18 seq_num 93) dirty exists 2024-01-13T18:01:20.371 INFO:tasks.rados.rados.0.smithi084.stdout:235: left oid 42 (ObjNum 93 snap 18 seq_num 93) 2024-01-13T18:01:20.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:20 smithi084 ceph-mon[37908]: pgmap v111: 121 pgs: 121 active+clean; 49 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 25 op/s 2024-01-13T18:01:20.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:20 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:20 smithi084 ceph-mon[37908]: osdmap e105: 8 total, 8 up, 8 in 2024-01-13T18:01:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:20 smithi084 ceph-mon[52328]: pgmap v111: 121 pgs: 121 active+clean; 49 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 25 op/s 2024-01-13T18:01:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:20 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:20 smithi084 ceph-mon[52328]: osdmap e105: 8 total, 8 up, 8 in 2024-01-13T18:01:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:20 smithi099 ceph-mon[71325]: pgmap v111: 121 pgs: 121 active+clean; 49 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 25 op/s 2024-01-13T18:01:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:20 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:20 smithi099 ceph-mon[71325]: osdmap e105: 8 total, 8 up, 8 in 2024-01-13T18:01:21.336 INFO:tasks.rados.rados.0.smithi084.stdout:229: done (5 left) 2024-01-13T18:01:21.336 INFO:tasks.rados.rados.0.smithi084.stdout:230: done (4 left) 2024-01-13T18:01:21.336 INFO:tasks.rados.rados.0.smithi084.stdout:233: done (3 left) 2024-01-13T18:01:21.336 INFO:tasks.rados.rados.0.smithi084.stdout:234: done (2 left) 2024-01-13T18:01:21.336 INFO:tasks.rados.rados.0.smithi084.stdout:235: done (1 left) 2024-01-13T18:01:21.337 INFO:tasks.rados.rados.0.smithi084.stdout:236: done (0 left) 2024-01-13T18:01:21.337 INFO:tasks.rados.rados.0.smithi084.stdout:237: delete oid 41 current snap is 19 2024-01-13T18:01:21.343 INFO:tasks.rados.rados.0.smithi084.stdout:237: done (0 left) 2024-01-13T18:01:21.344 INFO:tasks.rados.rados.0.smithi084.stdout:238: read oid 13 snap -1 2024-01-13T18:01:21.344 INFO:tasks.rados.rados.0.smithi084.stdout:238: expect (ObjNum 85 snap 15 seq_num 85) 2024-01-13T18:01:21.344 INFO:tasks.rados.rados.0.smithi084.stdout:239: setattr oid 26 current snap is 19 2024-01-13T18:01:21.345 INFO:tasks.rados.rados.0.smithi084.stdout:240: copy_from oid 32 from oid 7 current snap is 19 2024-01-13T18:01:21.345 INFO:tasks.rados.rados.0.smithi084.stdout:241: read oid 22 snap -1 2024-01-13T18:01:21.345 INFO:tasks.rados.rados.0.smithi084.stdout:241: expect (ObjNum 74 snap 11 seq_num 74) 2024-01-13T18:01:21.345 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 19 2024-01-13T18:01:21.345 INFO:tasks.rados.rados.0.smithi084.stdout:242: seq_num 95 ranges {1024000=794624,1818624=409600,2228224=393216} 2024-01-13T18:01:21.355 INFO:tasks.rados.rados.0.smithi084.stdout:242: writing smithi084102331-15 from 1024000 to 1818624 tid 1 2024-01-13T18:01:21.358 INFO:tasks.rados.rados.0.smithi084.stdout:242: writing smithi084102331-15 from 1818624 to 2228224 tid 2 2024-01-13T18:01:21.360 INFO:tasks.rados.rados.0.smithi084.stdout:242: writing smithi084102331-15 from 2228224 to 2621440 tid 3 2024-01-13T18:01:21.360 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 19 2024-01-13T18:01:21.360 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 53 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-01-13T18:01:21.360 INFO:tasks.rados.rados.0.smithi084.stdout:243: seq_num 96 ranges {811008=409600,1220608=696320,1916928=507904} 2024-01-13T18:01:21.367 INFO:tasks.rados.rados.0.smithi084.stdout:243: writing smithi084102331-49 from 811008 to 1220608 tid 1 2024-01-13T18:01:21.371 INFO:tasks.rados.rados.0.smithi084.stdout:243: writing smithi084102331-49 from 1220608 to 1916928 tid 2 2024-01-13T18:01:21.374 INFO:tasks.rados.rados.0.smithi084.stdout:243: writing smithi084102331-49 from 1916928 to 2424832 tid 3 2024-01-13T18:01:21.375 INFO:tasks.rados.rados.0.smithi084.stdout:239: done (5 left) 2024-01-13T18:01:21.375 INFO:tasks.rados.rados.0.smithi084.stdout:244: rollback oid 28 current snap is 19 2024-01-13T18:01:21.375 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 28 to 15 2024-01-13T18:01:21.375 INFO:tasks.rados.rados.0.smithi084.stdout:240: finishing copy_from to smithi084102331-32 2024-01-13T18:01:21.375 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-01-13T18:01:21.375 INFO:tasks.rados.rados.0.smithi084.stdout:240: finishing copy_from racing read to smithi084102331-32 2024-01-13T18:01:21.375 INFO:tasks.rados.rados.0.smithi084.stdout:238: expect (ObjNum 85 snap 15 seq_num 85) 2024-01-13T18:01:21.420 INFO:tasks.rados.rados.0.smithi084.stdout:242: finishing write tid 1 to smithi084102331-15 2024-01-13T18:01:21.420 INFO:tasks.rados.rados.0.smithi084.stdout:242: finishing write tid 2 to smithi084102331-15 2024-01-13T18:01:21.420 INFO:tasks.rados.rados.0.smithi084.stdout:238: done (5 left) 2024-01-13T18:01:21.420 INFO:tasks.rados.rados.0.smithi084.stdout:240: done (4 left) 2024-01-13T18:01:21.420 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 19 2024-01-13T18:01:21.420 INFO:tasks.rados.rados.0.smithi084.stdout:241: expect (ObjNum 74 snap 11 seq_num 74) 2024-01-13T18:01:21.481 INFO:tasks.rados.rados.0.smithi084.stdout:242: finishing write tid 3 to smithi084102331-15 2024-01-13T18:01:21.481 INFO:tasks.rados.rados.0.smithi084.stdout:242: finishing write tid 4 to smithi084102331-15 2024-01-13T18:01:21.481 INFO:tasks.rados.rados.0.smithi084.stdout:242: finishing write tid 5 to smithi084102331-15 2024-01-13T18:01:21.481 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 70 (ObjNum 95 snap 19 seq_num 95) dirty exists 2024-01-13T18:01:21.481 INFO:tasks.rados.rados.0.smithi084.stdout:242: left oid 15 (ObjNum 95 snap 19 seq_num 95) 2024-01-13T18:01:21.481 INFO:tasks.rados.rados.0.smithi084.stdout:243: finishing write tid 1 to smithi084102331-49 2024-01-13T18:01:21.481 INFO:tasks.rados.rados.0.smithi084.stdout:243: finishing write tid 2 to smithi084102331-49 2024-01-13T18:01:21.481 INFO:tasks.rados.rados.0.smithi084.stdout:245: seq_num 97 ranges {303104=434176,737280=581632,1318912=540672,1859584=81920} 2024-01-13T18:01:21.484 INFO:tasks.rados.rados.0.smithi084.stdout:245: writing smithi084102331-19 from 303104 to 737280 tid 1 2024-01-13T18:01:21.488 INFO:tasks.rados.rados.0.smithi084.stdout:245: writing smithi084102331-19 from 737280 to 1318912 tid 2 2024-01-13T18:01:21.491 INFO:tasks.rados.rados.0.smithi084.stdout:245: writing smithi084102331-19 from 1318912 to 1859584 tid 3 2024-01-13T18:01:21.493 INFO:tasks.rados.rados.0.smithi084.stdout:245: writing smithi084102331-19 from 1859584 to 1941504 tid 4 2024-01-13T18:01:21.493 INFO:tasks.rados.rados.0.smithi084.stdout:241: done (4 left) 2024-01-13T18:01:21.493 INFO:tasks.rados.rados.0.smithi084.stdout:242: done (3 left) 2024-01-13T18:01:21.493 INFO:tasks.rados.rados.0.smithi084.stdout:246: read oid 12 snap -1 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:246: expect deleted 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:247: rollback oid 26 current snap is 19 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 15 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:244: finishing rollback tid 0 to smithi084102331-28 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:244: finishing rollback tid 1 to smithi084102331-28 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:244: finishing rollback tid 2 to smithi084102331-28 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 32 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:243: finishing write tid 3 to smithi084102331-49 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:244: done (4 left) 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:248: rmattr oid 38 current snap is 19 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:243: finishing write tid 4 to smithi084102331-49 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:243: finishing write tid 5 to smithi084102331-49 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 58 (ObjNum 96 snap 19 seq_num 96) dirty exists 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:243: left oid 49 (ObjNum 96 snap 19 seq_num 96) 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:245: finishing write tid 1 to smithi084102331-19 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:245: finishing write tid 2 to smithi084102331-19 2024-01-13T18:01:21.494 INFO:tasks.rados.rados.0.smithi084.stdout:243: done (4 left) 2024-01-13T18:01:21.495 INFO:tasks.rados.rados.0.smithi084.stdout:249: copy_from oid 3 from oid 18 current snap is 19 2024-01-13T18:01:21.495 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 19 2024-01-13T18:01:21.495 INFO:tasks.rados.rados.0.smithi084.stdout:250: seq_num 98 ranges {221184=450560,671744=466944,1138688=737280} 2024-01-13T18:01:21.496 INFO:tasks.rados.rados.0.smithi084.stdout:250: writing smithi084102331-14 from 221184 to 671744 tid 1 2024-01-13T18:01:21.499 INFO:tasks.rados.rados.0.smithi084.stdout:250: writing smithi084102331-14 from 671744 to 1138688 tid 2 2024-01-13T18:01:21.504 INFO:tasks.rados.rados.0.smithi084.stdout:250: writing smithi084102331-14 from 1138688 to 1875968 tid 3 2024-01-13T18:01:21.504 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 19 2024-01-13T18:01:21.504 INFO:tasks.rados.rados.0.smithi084.stdout:251: seq_num 99 ranges {475136=466944,942080=802816,1744896=401408} 2024-01-13T18:01:21.509 INFO:tasks.rados.rados.0.smithi084.stdout:251: writing smithi084102331-29 from 475136 to 942080 tid 1 2024-01-13T18:01:21.514 INFO:tasks.rados.rados.0.smithi084.stdout:251: writing smithi084102331-29 from 942080 to 1744896 tid 2 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:251: writing smithi084102331-29 from 1744896 to 2146304 tid 3 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:252: read oid 13 snap 17 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:252: expect (ObjNum 85 snap 15 seq_num 85) 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:253: rmattr oid 4 current snap is 19 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:253: done (8 left) 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 19 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:247: finishing rollback tid 0 to smithi084102331-26 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:245: finishing write tid 3 to smithi084102331-19 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 88 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:245: finishing write tid 4 to smithi084102331-19 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:247: finishing rollback tid 1 to smithi084102331-26 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:247: finishing rollback tid 2 to smithi084102331-26 2024-01-13T18:01:21.517 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 61 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:245: finishing write tid 5 to smithi084102331-19 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:245: finishing write tid 6 to smithi084102331-19 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 28 (ObjNum 97 snap 19 seq_num 97) dirty exists 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:245: left oid 19 (ObjNum 97 snap 19 seq_num 97) 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:250: finishing write tid 1 to smithi084102331-14 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:250: finishing write tid 2 to smithi084102331-14 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:249: finishing copy_from to smithi084102331-3 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 15 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:249: finishing copy_from racing read to smithi084102331-3 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:250: finishing write tid 3 to smithi084102331-14 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:250: finishing write tid 4 to smithi084102331-14 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:250: finishing write tid 5 to smithi084102331-14 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 66 (ObjNum 98 snap 19 seq_num 98) dirty exists 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:250: left oid 14 (ObjNum 98 snap 19 seq_num 98) 2024-01-13T18:01:21.518 INFO:tasks.rados.rados.0.smithi084.stdout:254: seq_num 100 ranges {1810432=483328,2293760=688128,2981888=516096} 2024-01-13T18:01:21.529 INFO:tasks.rados.rados.0.smithi084.stdout:254: writing smithi084102331-43 from 1810432 to 2293760 tid 1 2024-01-13T18:01:21.533 INFO:tasks.rados.rados.0.smithi084.stdout:254: writing smithi084102331-43 from 2293760 to 2981888 tid 2 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:254: writing smithi084102331-43 from 2981888 to 3497984 tid 3 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:245: done (8 left) 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:246: done (7 left) 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:247: done (6 left) 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:248: done (5 left) 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:249: done (4 left) 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:250: done (3 left) 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:255: read oid 36 snap -1 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:255: expect (ObjNum 1 snap 0 seq_num 1) 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:256: read oid 34 snap 15 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:256: expect (ObjNum 39 snap 0 seq_num 39) 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 19 2024-01-13T18:01:21.537 INFO:tasks.rados.rados.0.smithi084.stdout:251: finishing write tid 1 to smithi084102331-29 2024-01-13T18:01:21.538 INFO:tasks.rados.rados.0.smithi084.stdout:257: seq_num 101 ranges {761856=499712,1261568=573440,1835008=524288,2359296=106496} 2024-01-13T18:01:21.543 INFO:tasks.rados.rados.0.smithi084.stdout:257: writing smithi084102331-38 from 761856 to 1261568 tid 1 2024-01-13T18:01:21.547 INFO:tasks.rados.rados.0.smithi084.stdout:257: writing smithi084102331-38 from 1261568 to 1835008 tid 2 2024-01-13T18:01:21.550 INFO:tasks.rados.rados.0.smithi084.stdout:257: writing smithi084102331-38 from 1835008 to 2359296 tid 3 2024-01-13T18:01:21.551 INFO:tasks.rados.rados.0.smithi084.stdout:257: writing smithi084102331-38 from 2359296 to 2465792 tid 4 2024-01-13T18:01:21.551 INFO:tasks.rados.rados.0.smithi084.stdout:258: snap_remove snap 18 2024-01-13T18:01:22.390 INFO:tasks.rados.rados.0.smithi084.stdout:258: done (6 left) 2024-01-13T18:01:22.390 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 19 2024-01-13T18:01:22.390 INFO:tasks.rados.rados.0.smithi084.stdout:259: seq_num 102 ranges {1228800=516096,1744896=450560,2195456=729088,2924544=24576} 2024-01-13T18:01:22.399 INFO:tasks.rados.rados.0.smithi084.stdout:259: writing smithi084102331-44 from 1228800 to 1744896 tid 1 2024-01-13T18:01:22.402 INFO:tasks.rados.rados.0.smithi084.stdout:259: writing smithi084102331-44 from 1744896 to 2195456 tid 2 2024-01-13T18:01:22.407 INFO:tasks.rados.rados.0.smithi084.stdout:259: writing smithi084102331-44 from 2195456 to 2924544 tid 3 2024-01-13T18:01:22.407 INFO:tasks.rados.rados.0.smithi084.stdout:259: writing smithi084102331-44 from 2924544 to 2949120 tid 4 2024-01-13T18:01:22.407 INFO:tasks.rados.rados.0.smithi084.stdout:260: rollback oid 23 current snap is 19 2024-01-13T18:01:22.407 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 15 2024-01-13T18:01:22.407 INFO:tasks.rados.rados.0.smithi084.stdout:251: finishing write tid 2 to smithi084102331-29 2024-01-13T18:01:22.407 INFO:tasks.rados.rados.0.smithi084.stdout:251: finishing write tid 3 to smithi084102331-29 2024-01-13T18:01:22.407 INFO:tasks.rados.rados.0.smithi084.stdout:251: finishing write tid 4 to smithi084102331-29 2024-01-13T18:01:22.407 INFO:tasks.rados.rados.0.smithi084.stdout:251: finishing write tid 5 to smithi084102331-29 2024-01-13T18:01:22.407 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 51 (ObjNum 99 snap 19 seq_num 99) dirty exists 2024-01-13T18:01:22.408 INFO:tasks.rados.rados.0.smithi084.stdout:251: left oid 29 (ObjNum 99 snap 19 seq_num 99) 2024-01-13T18:01:22.408 INFO:tasks.rados.rados.0.smithi084.stdout:252: expect (ObjNum 85 snap 15 seq_num 85) 2024-01-13T18:01:22.449 INFO:tasks.rados.rados.0.smithi084.stdout:254: finishing write tid 1 to smithi084102331-43 2024-01-13T18:01:22.450 INFO:tasks.rados.rados.0.smithi084.stdout:254: finishing write tid 2 to smithi084102331-43 2024-01-13T18:01:22.450 INFO:tasks.rados.rados.0.smithi084.stdout:251: done (7 left) 2024-01-13T18:01:22.450 INFO:tasks.rados.rados.0.smithi084.stdout:252: done (6 left) 2024-01-13T18:01:22.450 INFO:tasks.rados.rados.0.smithi084.stdout:261: rollback oid 37 current snap is 19 2024-01-13T18:01:22.450 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 17 2024-01-13T18:01:22.450 INFO:tasks.rados.rados.0.smithi084.stdout:255: expect (ObjNum 1 snap 0 seq_num 1) 2024-01-13T18:01:22.450 INFO:tasks.rados.rados.0.smithi084.stdout:254: finishing write tid 3 to smithi084102331-43 2024-01-13T18:01:22.451 INFO:tasks.rados.rados.0.smithi084.stdout:254: finishing write tid 4 to smithi084102331-43 2024-01-13T18:01:22.451 INFO:tasks.rados.rados.0.smithi084.stdout:254: finishing write tid 5 to smithi084102331-43 2024-01-13T18:01:22.451 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 28 (ObjNum 100 snap 19 seq_num 100) dirty exists 2024-01-13T18:01:22.451 INFO:tasks.rados.rados.0.smithi084.stdout:254: left oid 43 (ObjNum 100 snap 19 seq_num 100) 2024-01-13T18:01:22.451 INFO:tasks.rados.rados.0.smithi084.stdout:256: expect (ObjNum 39 snap 0 seq_num 39) 2024-01-13T18:01:22.469 INFO:tasks.rados.rados.0.smithi084.stdout:257: finishing write tid 1 to smithi084102331-38 2024-01-13T18:01:22.469 INFO:tasks.rados.rados.0.smithi084.stdout:257: finishing write tid 2 to smithi084102331-38 2024-01-13T18:01:22.469 INFO:tasks.rados.rados.0.smithi084.stdout:254: done (6 left) 2024-01-13T18:01:22.469 INFO:tasks.rados.rados.0.smithi084.stdout:255: done (5 left) 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:256: done (4 left) 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:262: rmattr oid 2 current snap is 19 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:262: done (4 left) 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:263: rollback oid 13 current snap is 19 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 13 to 15 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:257: finishing write tid 3 to smithi084102331-38 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:257: finishing write tid 4 to smithi084102331-38 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:257: finishing write tid 5 to smithi084102331-38 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:257: finishing write tid 6 to smithi084102331-38 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 95 (ObjNum 101 snap 19 seq_num 101) dirty exists 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:257: left oid 38 (ObjNum 101 snap 19 seq_num 101) 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:259: finishing write tid 1 to smithi084102331-44 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:259: finishing write tid 2 to smithi084102331-44 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:260: finishing rollback tid 1 to smithi084102331-23 2024-01-13T18:01:22.470 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 0 (ObjNum 273 snap 0 seq_num 2818343588) dirty dne 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:259: finishing write tid 3 to smithi084102331-44 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:259: finishing write tid 4 to smithi084102331-44 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:259: finishing write tid 5 to smithi084102331-44 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:259: finishing write tid 6 to smithi084102331-44 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 80 (ObjNum 102 snap 19 seq_num 102) dirty exists 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:259: left oid 44 (ObjNum 102 snap 19 seq_num 102) 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:261: finishing rollback tid 0 to smithi084102331-37 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:261: finishing rollback tid 1 to smithi084102331-37 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:261: finishing rollback tid 2 to smithi084102331-37 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 37 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:257: done (4 left) 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:259: done (3 left) 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:260: done (2 left) 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:261: done (1 left) 2024-01-13T18:01:22.471 INFO:tasks.rados.rados.0.smithi084.stdout:264: rmattr oid 47 current snap is 19 2024-01-13T18:01:22.472 INFO:tasks.rados.rados.0.smithi084.stdout:264: done (1 left) 2024-01-13T18:01:22.472 INFO:tasks.rados.rados.0.smithi084.stdout:265: copy_from oid 19 from oid 3 current snap is 19 2024-01-13T18:01:22.472 INFO:tasks.rados.rados.0.smithi084.stdout:266: rollback oid 38 current snap is 19 2024-01-13T18:01:22.472 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 15 2024-01-13T18:01:22.472 INFO:tasks.rados.rados.0.smithi084.stdout:267: snap_remove snap 17 2024-01-13T18:01:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:22 smithi099 ceph-mon[71325]: pgmap v114: 121 pgs: 121 active+clean; 47 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1.1 MiB/s wr, 4 op/s 2024-01-13T18:01:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:22 smithi099 ceph-mon[71325]: osdmap e106: 8 total, 8 up, 8 in 2024-01-13T18:01:22.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:22 smithi084 ceph-mon[37908]: pgmap v114: 121 pgs: 121 active+clean; 47 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1.1 MiB/s wr, 4 op/s 2024-01-13T18:01:22.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:22 smithi084 ceph-mon[37908]: osdmap e106: 8 total, 8 up, 8 in 2024-01-13T18:01:22.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:22 smithi084 ceph-mon[52328]: pgmap v114: 121 pgs: 121 active+clean; 47 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1.1 MiB/s wr, 4 op/s 2024-01-13T18:01:22.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:22 smithi084 ceph-mon[52328]: osdmap e106: 8 total, 8 up, 8 in 2024-01-13T18:01:23.396 INFO:tasks.rados.rados.0.smithi084.stdout:267: done (3 left) 2024-01-13T18:01:23.396 INFO:tasks.rados.rados.0.smithi084.stdout:268: snap_create 2024-01-13T18:01:23.396 INFO:tasks.rados.rados.0.smithi084.stdout:263: finishing rollback tid 0 to smithi084102331-13 2024-01-13T18:01:23.396 INFO:tasks.rados.rados.0.smithi084.stdout:263: finishing rollback tid 1 to smithi084102331-13 2024-01-13T18:01:23.396 INFO:tasks.rados.rados.0.smithi084.stdout:266: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:01:23.397 INFO:tasks.rados.rados.0.smithi084.stdout:263: finishing rollback tid 2 to smithi084102331-13 2024-01-13T18:01:23.397 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 43 (ObjNum 85 snap 15 seq_num 85) dirty exists 2024-01-13T18:01:23.397 INFO:tasks.rados.rados.0.smithi084.stdout:266: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:01:23.397 INFO:tasks.rados.rados.0.smithi084.stdout:266: finishing rollback tid 2 to smithi084102331-38 2024-01-13T18:01:23.397 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 102 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:01:23.397 INFO:tasks.rados.rados.0.smithi084.stdout:265: finishing copy_from to smithi084102331-19 2024-01-13T18:01:23.397 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 15 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:01:23.397 INFO:tasks.rados.rados.0.smithi084.stdout:265: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:01:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:23 smithi084 ceph-mon[37908]: osdmap e107: 8 total, 8 up, 8 in 2024-01-13T18:01:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:23 smithi084 ceph-mon[52328]: osdmap e107: 8 total, 8 up, 8 in 2024-01-13T18:01:23.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:23 smithi099 ceph-mon[71325]: osdmap e107: 8 total, 8 up, 8 in 2024-01-13T18:01:24.335 INFO:tasks.rados.rados.0.smithi084.stdout:263: done (3 left) 2024-01-13T18:01:24.335 INFO:tasks.rados.rados.0.smithi084.stdout:265: done (2 left) 2024-01-13T18:01:24.335 INFO:tasks.rados.rados.0.smithi084.stdout:266: done (1 left) 2024-01-13T18:01:24.335 INFO:tasks.rados.rados.0.smithi084.stdout:268: done (0 left) 2024-01-13T18:01:24.335 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 20 2024-01-13T18:01:24.335 INFO:tasks.rados.rados.0.smithi084.stdout:269: seq_num 103 ranges {2899968=532480,3432448=737280,4169728=466944} 2024-01-13T18:01:24.353 INFO:tasks.rados.rados.0.smithi084.stdout:269: writing smithi084102331-16 from 2899968 to 3432448 tid 1 2024-01-13T18:01:24.357 INFO:tasks.rados.rados.0.smithi084.stdout:269: writing smithi084102331-16 from 3432448 to 4169728 tid 2 2024-01-13T18:01:24.360 INFO:tasks.rados.rados.0.smithi084.stdout:269: writing smithi084102331-16 from 4169728 to 4636672 tid 3 2024-01-13T18:01:24.361 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 20 2024-01-13T18:01:24.361 INFO:tasks.rados.rados.0.smithi084.stdout:269: finishing write tid 1 to smithi084102331-16 2024-01-13T18:01:24.361 INFO:tasks.rados.rados.0.smithi084.stdout:270: seq_num 104 ranges {761856=548864,1310720=622592,1933312=581632} 2024-01-13T18:01:24.368 INFO:tasks.rados.rados.0.smithi084.stdout:270: writing smithi084102331-18 from 761856 to 1310720 tid 1 2024-01-13T18:01:24.371 INFO:tasks.rados.rados.0.smithi084.stdout:270: writing smithi084102331-18 from 1310720 to 1933312 tid 2 2024-01-13T18:01:24.376 INFO:tasks.rados.rados.0.smithi084.stdout:270: writing smithi084102331-18 from 1933312 to 2514944 tid 3 2024-01-13T18:01:24.376 INFO:tasks.rados.rados.0.smithi084.stdout:271: setattr oid 45 current snap is 20 2024-01-13T18:01:24.376 INFO:tasks.rados.rados.0.smithi084.stdout:269: finishing write tid 2 to smithi084102331-16 2024-01-13T18:01:24.376 INFO:tasks.rados.rados.0.smithi084.stdout:269: finishing write tid 3 to smithi084102331-16 2024-01-13T18:01:24.376 INFO:tasks.rados.rados.0.smithi084.stdout:269: finishing write tid 4 to smithi084102331-16 2024-01-13T18:01:24.376 INFO:tasks.rados.rados.0.smithi084.stdout:269: finishing write tid 5 to smithi084102331-16 2024-01-13T18:01:24.376 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 41 (ObjNum 103 snap 20 seq_num 103) dirty exists 2024-01-13T18:01:24.376 INFO:tasks.rados.rados.0.smithi084.stdout:269: left oid 16 (ObjNum 103 snap 20 seq_num 103) 2024-01-13T18:01:24.376 INFO:tasks.rados.rados.0.smithi084.stdout:270: finishing write tid 1 to smithi084102331-18 2024-01-13T18:01:24.376 INFO:tasks.rados.rados.0.smithi084.stdout:270: finishing write tid 2 to smithi084102331-18 2024-01-13T18:01:24.377 INFO:tasks.rados.rados.0.smithi084.stdout:270: finishing write tid 3 to smithi084102331-18 2024-01-13T18:01:24.378 INFO:tasks.rados.rados.0.smithi084.stdout:269: done (2 left) 2024-01-13T18:01:24.378 INFO:tasks.rados.rados.0.smithi084.stdout:272: snap_remove snap 15 2024-01-13T18:01:24.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[73373]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:01:24] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T18:01:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:24 smithi099 ceph-mon[71325]: pgmap v117: 121 pgs: 121 active+clean; 47 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1.1 MiB/s wr, 4 op/s 2024-01-13T18:01:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:24 smithi099 ceph-mon[71325]: osdmap e108: 8 total, 8 up, 8 in 2024-01-13T18:01:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:24 smithi099 ceph-mon[71325]: osdmap e109: 8 total, 8 up, 8 in 2024-01-13T18:01:24.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:24 smithi084 ceph-mon[37908]: pgmap v117: 121 pgs: 121 active+clean; 47 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1.1 MiB/s wr, 4 op/s 2024-01-13T18:01:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:24 smithi084 ceph-mon[37908]: osdmap e108: 8 total, 8 up, 8 in 2024-01-13T18:01:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:24 smithi084 ceph-mon[37908]: osdmap e109: 8 total, 8 up, 8 in 2024-01-13T18:01:24.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:24 smithi084 ceph-mon[52328]: pgmap v117: 121 pgs: 121 active+clean; 47 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1.1 MiB/s wr, 4 op/s 2024-01-13T18:01:24.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:24 smithi084 ceph-mon[52328]: osdmap e108: 8 total, 8 up, 8 in 2024-01-13T18:01:24.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:24 smithi084 ceph-mon[52328]: osdmap e109: 8 total, 8 up, 8 in 2024-01-13T18:01:25.346 INFO:tasks.rados.rados.0.smithi084.stdout:272: done (2 left) 2024-01-13T18:01:25.346 INFO:tasks.rados.rados.0.smithi084.stdout:273: setattr oid 15 current snap is 20 2024-01-13T18:01:25.346 INFO:tasks.rados.rados.0.smithi084.stdout:274: snap_create 2024-01-13T18:01:25.346 INFO:tasks.rados.rados.0.smithi084.stdout:270: finishing write tid 4 to smithi084102331-18 2024-01-13T18:01:25.346 INFO:tasks.rados.rados.0.smithi084.stdout:270: finishing write tid 5 to smithi084102331-18 2024-01-13T18:01:25.346 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 34 (ObjNum 104 snap 20 seq_num 104) dirty exists 2024-01-13T18:01:25.346 INFO:tasks.rados.rados.0.smithi084.stdout:270: left oid 18 (ObjNum 104 snap 20 seq_num 104) 2024-01-13T18:01:25.347 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 108 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-01-13T18:01:25.351 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 96 (ObjNum 95 snap 19 seq_num 95) dirty exists 2024-01-13T18:01:26.350 INFO:tasks.rados.rados.0.smithi084.stdout:270: done (3 left) 2024-01-13T18:01:26.351 INFO:tasks.rados.rados.0.smithi084.stdout:271: done (2 left) 2024-01-13T18:01:26.351 INFO:tasks.rados.rados.0.smithi084.stdout:273: done (1 left) 2024-01-13T18:01:26.351 INFO:tasks.rados.rados.0.smithi084.stdout:274: done (0 left) 2024-01-13T18:01:26.351 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 21 2024-01-13T18:01:26.351 INFO:tasks.rados.rados.0.smithi084.stdout:275: seq_num 105 ranges {540672=565248,1105920=507904,1613824=507904,2121728=188416} 2024-01-13T18:01:26.357 INFO:tasks.rados.rados.0.smithi084.stdout:275: writing smithi084102331-33 from 540672 to 1105920 tid 1 2024-01-13T18:01:26.359 INFO:tasks.rados.rados.0.smithi084.stdout:275: writing smithi084102331-33 from 1105920 to 1613824 tid 2 2024-01-13T18:01:26.362 INFO:tasks.rados.rados.0.smithi084.stdout:275: writing smithi084102331-33 from 1613824 to 2121728 tid 3 2024-01-13T18:01:26.364 INFO:tasks.rados.rados.0.smithi084.stdout:275: writing smithi084102331-33 from 2121728 to 2310144 tid 4 2024-01-13T18:01:26.364 INFO:tasks.rados.rados.0.smithi084.stdout:276: copy_from oid 18 from oid 13 current snap is 21 2024-01-13T18:01:26.364 INFO:tasks.rados.rados.0.smithi084.stdout:275: finishing write tid 1 to smithi084102331-33 2024-01-13T18:01:26.364 INFO:tasks.rados.rados.0.smithi084.stdout:277: snap_create 2024-01-13T18:01:26.364 INFO:tasks.rados.rados.0.smithi084.stdout:275: finishing write tid 2 to smithi084102331-33 2024-01-13T18:01:26.366 INFO:tasks.rados.rados.0.smithi084.stdout:275: finishing write tid 3 to smithi084102331-33 2024-01-13T18:01:26.367 INFO:tasks.rados.rados.0.smithi084.stdout:275: finishing write tid 4 to smithi084102331-33 2024-01-13T18:01:26.367 INFO:tasks.rados.rados.0.smithi084.stdout:275: finishing write tid 5 to smithi084102331-33 2024-01-13T18:01:26.368 INFO:tasks.rados.rados.0.smithi084.stdout:275: finishing write tid 6 to smithi084102331-33 2024-01-13T18:01:26.368 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 51 (ObjNum 105 snap 21 seq_num 105) dirty exists 2024-01-13T18:01:26.368 INFO:tasks.rados.rados.0.smithi084.stdout:275: left oid 33 (ObjNum 105 snap 21 seq_num 105) 2024-01-13T18:01:26.374 INFO:tasks.rados.rados.0.smithi084.stdout:276: finishing copy_from to smithi084102331-18 2024-01-13T18:01:26.374 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 43 (ObjNum 85 snap 15 seq_num 85) dirty exists 2024-01-13T18:01:26.375 INFO:tasks.rados.rados.0.smithi084.stdout:276: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:01:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:26 smithi099 ceph-mon[71325]: pgmap v120: 121 pgs: 121 active+clean; 47 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:26 smithi099 ceph-mon[71325]: osdmap e110: 8 total, 8 up, 8 in 2024-01-13T18:01:26.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:26 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:01:26] "GET /metrics HTTP/1.1" 200 239195 "" "Prometheus/2.43.0" 2024-01-13T18:01:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:26 smithi084 ceph-mon[52328]: pgmap v120: 121 pgs: 121 active+clean; 47 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:26 smithi084 ceph-mon[52328]: osdmap e110: 8 total, 8 up, 8 in 2024-01-13T18:01:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:26 smithi084 ceph-mon[37908]: pgmap v120: 121 pgs: 121 active+clean; 47 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:26 smithi084 ceph-mon[37908]: osdmap e110: 8 total, 8 up, 8 in 2024-01-13T18:01:27.358 INFO:tasks.rados.rados.0.smithi084.stdout:275: done (2 left) 2024-01-13T18:01:27.358 INFO:tasks.rados.rados.0.smithi084.stdout:276: done (1 left) 2024-01-13T18:01:27.359 INFO:tasks.rados.rados.0.smithi084.stdout:277: done (0 left) 2024-01-13T18:01:27.359 INFO:tasks.rados.rados.0.smithi084.stdout:278: snap_create 2024-01-13T18:01:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:27 smithi099 ceph-mon[71325]: osdmap e111: 8 total, 8 up, 8 in 2024-01-13T18:01:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:27 smithi084 ceph-mon[37908]: osdmap e111: 8 total, 8 up, 8 in 2024-01-13T18:01:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:27 smithi084 ceph-mon[52328]: osdmap e111: 8 total, 8 up, 8 in 2024-01-13T18:01:28.359 INFO:tasks.rados.rados.0.smithi084.stdout:278: done (0 left) 2024-01-13T18:01:28.359 INFO:tasks.rados.rados.0.smithi084.stdout:279: read oid 15 snap -1 2024-01-13T18:01:28.360 INFO:tasks.rados.rados.0.smithi084.stdout:279: expect (ObjNum 95 snap 19 seq_num 95) 2024-01-13T18:01:28.360 INFO:tasks.rados.rados.0.smithi084.stdout:280: snap_create 2024-01-13T18:01:28.379 INFO:tasks.rados.rados.0.smithi084.stdout:279: expect (ObjNum 95 snap 19 seq_num 95) 2024-01-13T18:01:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:28 smithi099 ceph-mon[71325]: pgmap v123: 121 pgs: 121 active+clean; 57 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 39 op/s 2024-01-13T18:01:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:28 smithi099 ceph-mon[71325]: osdmap e112: 8 total, 8 up, 8 in 2024-01-13T18:01:28.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:28 smithi084 ceph-mon[37908]: pgmap v123: 121 pgs: 121 active+clean; 57 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 39 op/s 2024-01-13T18:01:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:28 smithi084 ceph-mon[37908]: osdmap e112: 8 total, 8 up, 8 in 2024-01-13T18:01:28.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:28 smithi084 ceph-mon[52328]: pgmap v123: 121 pgs: 121 active+clean; 57 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 39 op/s 2024-01-13T18:01:28.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:28 smithi084 ceph-mon[52328]: osdmap e112: 8 total, 8 up, 8 in 2024-01-13T18:01:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:279: done (1 left) 2024-01-13T18:01:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:280: done (0 left) 2024-01-13T18:01:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 24 2024-01-13T18:01:29.337 INFO:tasks.rados.rados.0.smithi084.stdout:281: seq_num 106 ranges {0=581632,581632=794624,1376256=409600} 2024-01-13T18:01:29.339 INFO:tasks.rados.rados.0.smithi084.stdout:281: writing smithi084102331-23 from 0 to 581632 tid 1 2024-01-13T18:01:29.344 INFO:tasks.rados.rados.0.smithi084.stdout:281: writing smithi084102331-23 from 581632 to 1376256 tid 2 2024-01-13T18:01:29.347 INFO:tasks.rados.rados.0.smithi084.stdout:281: writing smithi084102331-23 from 1376256 to 1785856 tid 3 2024-01-13T18:01:29.347 INFO:tasks.rados.rados.0.smithi084.stdout:282: rollback oid 9 current snap is 24 2024-01-13T18:01:29.347 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 23 2024-01-13T18:01:29.347 INFO:tasks.rados.rados.0.smithi084.stdout:281: finishing write tid 1 to smithi084102331-23 2024-01-13T18:01:29.347 INFO:tasks.rados.rados.0.smithi084.stdout:283: snap_remove snap 21 2024-01-13T18:01:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:29 smithi099 ceph-mon[71325]: osdmap e113: 8 total, 8 up, 8 in 2024-01-13T18:01:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:29 smithi099 ceph-mon[71325]: osdmap e114: 8 total, 8 up, 8 in 2024-01-13T18:01:29.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:29 smithi084 ceph-mon[52328]: osdmap e113: 8 total, 8 up, 8 in 2024-01-13T18:01:29.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:29 smithi084 ceph-mon[52328]: osdmap e114: 8 total, 8 up, 8 in 2024-01-13T18:01:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:29 smithi084 ceph-mon[37908]: osdmap e113: 8 total, 8 up, 8 in 2024-01-13T18:01:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:29 smithi084 ceph-mon[37908]: osdmap e114: 8 total, 8 up, 8 in 2024-01-13T18:01:30.346 INFO:tasks.rados.rados.0.smithi084.stdout:283: done (2 left) 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:284: read oid 18 snap 22 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:284: expect (ObjNum 85 snap 15 seq_num 85) 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:285: snap_create 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:281: finishing write tid 2 to smithi084102331-23 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:281: finishing write tid 3 to smithi084102331-23 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:281: finishing write tid 4 to smithi084102331-23 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:281: finishing write tid 5 to smithi084102331-23 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 54 (ObjNum 106 snap 24 seq_num 106) dirty exists 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:281: left oid 23 (ObjNum 106 snap 24 seq_num 106) 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:282: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:282: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:282: finishing rollback tid 2 to smithi084102331-9 2024-01-13T18:01:30.347 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 60 (ObjNum 92 snap 18 seq_num 92) dirty exists 2024-01-13T18:01:30.355 INFO:tasks.rados.rados.0.smithi084.stdout:284: expect (ObjNum 85 snap 15 seq_num 85) 2024-01-13T18:01:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:30 smithi099 ceph-mon[71325]: pgmap v126: 121 pgs: 121 active+clean; 57 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 39 op/s 2024-01-13T18:01:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:30 smithi099 ceph-mon[71325]: osdmap e115: 8 total, 8 up, 8 in 2024-01-13T18:01:30.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:30 smithi084 ceph-mon[37908]: pgmap v126: 121 pgs: 121 active+clean; 57 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 39 op/s 2024-01-13T18:01:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:30 smithi084 ceph-mon[37908]: osdmap e115: 8 total, 8 up, 8 in 2024-01-13T18:01:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:30 smithi084 ceph-mon[52328]: pgmap v126: 121 pgs: 121 active+clean; 57 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 39 op/s 2024-01-13T18:01:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:30 smithi084 ceph-mon[52328]: osdmap e115: 8 total, 8 up, 8 in 2024-01-13T18:01:31.347 INFO:tasks.rados.rados.0.smithi084.stdout:281: done (3 left) 2024-01-13T18:01:31.347 INFO:tasks.rados.rados.0.smithi084.stdout:282: done (2 left) 2024-01-13T18:01:31.348 INFO:tasks.rados.rados.0.smithi084.stdout:284: done (1 left) 2024-01-13T18:01:31.348 INFO:tasks.rados.rados.0.smithi084.stdout:285: done (0 left) 2024-01-13T18:01:31.348 INFO:tasks.rados.rados.0.smithi084.stdout:286: read oid 23 snap -1 2024-01-13T18:01:31.348 INFO:tasks.rados.rados.0.smithi084.stdout:286: expect (ObjNum 106 snap 24 seq_num 106) 2024-01-13T18:01:31.348 INFO:tasks.rados.rados.0.smithi084.stdout:287: snap_remove snap 19 2024-01-13T18:01:32.353 INFO:tasks.rados.rados.0.smithi084.stdout:287: done (1 left) 2024-01-13T18:01:32.353 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 25 2024-01-13T18:01:32.353 INFO:tasks.rados.rados.0.smithi084.stdout:288: seq_num 107 ranges {557056=598016,1155072=729088,1884160=466944,2351104=8192} 2024-01-13T18:01:32.360 INFO:tasks.rados.rados.0.smithi084.stdout:288: writing smithi084102331-45 from 557056 to 1155072 tid 1 2024-01-13T18:01:32.364 INFO:tasks.rados.rados.0.smithi084.stdout:288: writing smithi084102331-45 from 1155072 to 1884160 tid 2 2024-01-13T18:01:32.368 INFO:tasks.rados.rados.0.smithi084.stdout:288: writing smithi084102331-45 from 1884160 to 2351104 tid 3 2024-01-13T18:01:32.368 INFO:tasks.rados.rados.0.smithi084.stdout:288: writing smithi084102331-45 from 2351104 to 2359296 tid 4 2024-01-13T18:01:32.368 INFO:tasks.rados.rados.0.smithi084.stdout:289: rollback oid 35 current snap is 25 2024-01-13T18:01:32.368 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 35 to 20 2024-01-13T18:01:32.368 INFO:tasks.rados.rados.0.smithi084.stdout:286: expect (ObjNum 106 snap 24 seq_num 106) 2024-01-13T18:01:32.413 INFO:tasks.rados.rados.0.smithi084.stdout:288: finishing write tid 1 to smithi084102331-45 2024-01-13T18:01:32.413 INFO:tasks.rados.rados.0.smithi084.stdout:288: finishing write tid 2 to smithi084102331-45 2024-01-13T18:01:32.413 INFO:tasks.rados.rados.0.smithi084.stdout:286: done (2 left) 2024-01-13T18:01:32.413 INFO:tasks.rados.rados.0.smithi084.stdout:290: snap_create 2024-01-13T18:01:32.413 INFO:tasks.rados.rados.0.smithi084.stdout:289: finishing rollback tid 0 to smithi084102331-35 2024-01-13T18:01:32.413 INFO:tasks.rados.rados.0.smithi084.stdout:289: finishing rollback tid 1 to smithi084102331-35 2024-01-13T18:01:32.413 INFO:tasks.rados.rados.0.smithi084.stdout:289: finishing rollback tid 2 to smithi084102331-35 2024-01-13T18:01:32.413 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 61 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-01-13T18:01:32.413 INFO:tasks.rados.rados.0.smithi084.stdout:288: finishing write tid 3 to smithi084102331-45 2024-01-13T18:01:32.413 INFO:tasks.rados.rados.0.smithi084.stdout:288: finishing write tid 4 to smithi084102331-45 2024-01-13T18:01:32.414 INFO:tasks.rados.rados.0.smithi084.stdout:288: finishing write tid 5 to smithi084102331-45 2024-01-13T18:01:32.414 INFO:tasks.rados.rados.0.smithi084.stdout:288: finishing write tid 6 to smithi084102331-45 2024-01-13T18:01:32.414 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 122 (ObjNum 107 snap 25 seq_num 107) dirty exists 2024-01-13T18:01:32.414 INFO:tasks.rados.rados.0.smithi084.stdout:288: left oid 45 (ObjNum 107 snap 25 seq_num 107) 2024-01-13T18:01:32.500 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:32 smithi099 ceph-mon[71325]: pgmap v129: 121 pgs: 121 active+clean; 62 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 5 op/s 2024-01-13T18:01:32.500 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:32 smithi099 ceph-mon[71325]: osdmap e116: 8 total, 8 up, 8 in 2024-01-13T18:01:32.500 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:32.500 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:01:32.500 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:01:32.500 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:32 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:01:32.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[37908]: pgmap v129: 121 pgs: 121 active+clean; 62 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 5 op/s 2024-01-13T18:01:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[37908]: osdmap e116: 8 total, 8 up, 8 in 2024-01-13T18:01:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:01:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:01:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:01:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[52328]: pgmap v129: 121 pgs: 121 active+clean; 62 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 5 op/s 2024-01-13T18:01:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[52328]: osdmap e116: 8 total, 8 up, 8 in 2024-01-13T18:01:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:01:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:01:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:32 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:01:33.360 INFO:tasks.rados.rados.0.smithi084.stdout:288: done (2 left) 2024-01-13T18:01:33.360 INFO:tasks.rados.rados.0.smithi084.stdout:289: done (1 left) 2024-01-13T18:01:33.360 INFO:tasks.rados.rados.0.smithi084.stdout:290: done (0 left) 2024-01-13T18:01:33.360 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 26 2024-01-13T18:01:33.360 INFO:tasks.rados.rados.0.smithi084.stdout:291: seq_num 108 ranges {1638400=614400,2252800=606208,2859008=598016} 2024-01-13T18:01:33.371 INFO:tasks.rados.rados.0.smithi084.stdout:291: writing smithi084102331-18 from 1638400 to 2252800 tid 1 2024-01-13T18:01:33.374 INFO:tasks.rados.rados.0.smithi084.stdout:291: writing smithi084102331-18 from 2252800 to 2859008 tid 2 2024-01-13T18:01:33.379 INFO:tasks.rados.rados.0.smithi084.stdout:291: writing smithi084102331-18 from 2859008 to 3457024 tid 3 2024-01-13T18:01:33.379 INFO:tasks.rados.rados.0.smithi084.stdout:292: read oid 31 snap -1 2024-01-13T18:01:33.379 INFO:tasks.rados.rados.0.smithi084.stdout:292: expect deleted 2024-01-13T18:01:33.379 INFO:tasks.rados.rados.0.smithi084.stdout:293: read oid 5 snap -1 2024-01-13T18:01:33.379 INFO:tasks.rados.rados.0.smithi084.stdout:293: expect deleted 2024-01-13T18:01:33.379 INFO:tasks.rados.rados.0.smithi084.stdout:294: copy_from oid 21 from oid 32 current snap is 26 2024-01-13T18:01:33.379 INFO:tasks.rados.rados.0.smithi084.stdout:291: finishing write tid 1 to smithi084102331-18 2024-01-13T18:01:33.379 INFO:tasks.rados.rados.0.smithi084.stdout:295: snap_create 2024-01-13T18:01:33.379 INFO:tasks.rados.rados.0.smithi084.stdout:291: finishing write tid 2 to smithi084102331-18 2024-01-13T18:01:33.381 INFO:tasks.rados.rados.0.smithi084.stdout:291: finishing write tid 3 to smithi084102331-18 2024-01-13T18:01:33.381 INFO:tasks.rados.rados.0.smithi084.stdout:291: finishing write tid 4 to smithi084102331-18 2024-01-13T18:01:33.382 INFO:tasks.rados.rados.0.smithi084.stdout:291: finishing write tid 5 to smithi084102331-18 2024-01-13T18:01:33.382 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 47 (ObjNum 108 snap 26 seq_num 108) dirty exists 2024-01-13T18:01:33.382 INFO:tasks.rados.rados.0.smithi084.stdout:291: left oid 18 (ObjNum 108 snap 26 seq_num 108) 2024-01-13T18:01:33.383 INFO:tasks.rados.rados.0.smithi084.stdout:294: finishing copy_from to smithi084102331-21 2024-01-13T18:01:33.383 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-01-13T18:01:33.383 INFO:tasks.rados.rados.0.smithi084.stdout:294: finishing copy_from racing read to smithi084102331-21 2024-01-13T18:01:33.465 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:33 smithi099 ceph-mon[71325]: Upgrade: Updating mgr.x 2024-01-13T18:01:33.466 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:33 smithi099 ceph-mon[71325]: Deploying daemon mgr.x on smithi099 2024-01-13T18:01:33.466 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:33 smithi099 ceph-mon[71325]: osdmap e117: 8 total, 8 up, 8 in 2024-01-13T18:01:33.466 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:32 smithi099 systemd[1]: Stopping Ceph mgr.x for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:01:33.466 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:33 smithi099 bash[112117]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x 2024-01-13T18:01:33.466 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:33 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-01-13T18:01:33.469 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:33 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-01-13T18:01:33.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:33 smithi084 ceph-mon[52328]: Upgrade: Updating mgr.x 2024-01-13T18:01:33.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:33 smithi084 ceph-mon[52328]: Deploying daemon mgr.x on smithi099 2024-01-13T18:01:33.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:33 smithi084 ceph-mon[52328]: osdmap e117: 8 total, 8 up, 8 in 2024-01-13T18:01:33.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:33 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T18:01:33.506Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi099.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.99:8443: connect: connection refused" 2024-01-13T18:01:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:33 smithi084 ceph-mon[37908]: Upgrade: Updating mgr.x 2024-01-13T18:01:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:33 smithi084 ceph-mon[37908]: Deploying daemon mgr.x on smithi099 2024-01-13T18:01:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:33 smithi084 ceph-mon[37908]: osdmap e117: 8 total, 8 up, 8 in 2024-01-13T18:01:33.835 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:33 smithi099 systemd[1]: Stopped Ceph mgr.x for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:01:33.835 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:33 smithi099 systemd[1]: Starting Ceph mgr.x for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:01:34.270 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:33 smithi099 ceph-mgr[112308]: -- 172.21.15.99:0/3363076700 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563bfb9fd1e0 con 0x563bfb9d2c00 2024-01-13T18:01:34.270 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:33 smithi099 bash[112271]: d5726518d185135f652bd1fb72b6094ec49b14795ba23e5d4daef6cabf052402 2024-01-13T18:01:34.270 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:33 smithi099 systemd[1]: Started Ceph mgr.x for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:01:34.270 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:34.095+0000 7faca9233200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T18:01:34.270 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:34.268+0000 7faca9233200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T18:01:34.339 INFO:tasks.rados.rados.0.smithi084.stdout:291: done (4 left) 2024-01-13T18:01:34.339 INFO:tasks.rados.rados.0.smithi084.stdout:292: done (3 left) 2024-01-13T18:01:34.339 INFO:tasks.rados.rados.0.smithi084.stdout:293: done (2 left) 2024-01-13T18:01:34.339 INFO:tasks.rados.rados.0.smithi084.stdout:294: done (1 left) 2024-01-13T18:01:34.339 INFO:tasks.rados.rados.0.smithi084.stdout:295: done (0 left) 2024-01-13T18:01:34.339 INFO:tasks.rados.rados.0.smithi084.stdout:296: read oid 41 snap -1 2024-01-13T18:01:34.339 INFO:tasks.rados.rados.0.smithi084.stdout:296: expect deleted 2024-01-13T18:01:34.339 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 27 2024-01-13T18:01:34.339 INFO:tasks.rados.rados.0.smithi084.stdout:297: seq_num 109 ranges {4636672=630784,5267456=491520,5758976=483328,6242304=229376} 2024-01-13T18:01:34.365 INFO:tasks.rados.rados.0.smithi084.stdout:297: writing smithi084102331-16 from 4636672 to 5267456 tid 1 2024-01-13T18:01:34.368 INFO:tasks.rados.rados.0.smithi084.stdout:297: writing smithi084102331-16 from 5267456 to 5758976 tid 2 2024-01-13T18:01:34.371 INFO:tasks.rados.rados.0.smithi084.stdout:297: writing smithi084102331-16 from 5758976 to 6242304 tid 3 2024-01-13T18:01:34.373 INFO:tasks.rados.rados.0.smithi084.stdout:297: writing smithi084102331-16 from 6242304 to 6471680 tid 4 2024-01-13T18:01:34.373 INFO:tasks.rados.rados.0.smithi084.stdout:298: setattr oid 13 current snap is 27 2024-01-13T18:01:34.373 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 1 to smithi084102331-16 2024-01-13T18:01:34.373 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 2 to smithi084102331-16 2024-01-13T18:01:34.375 INFO:tasks.rados.rados.0.smithi084.stdout:296: done (2 left) 2024-01-13T18:01:34.375 INFO:tasks.rados.rados.0.smithi084.stdout:299: delete oid 37 current snap is 27 2024-01-13T18:01:34.375 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 3 to smithi084102331-16 2024-01-13T18:01:34.375 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 4 to smithi084102331-16 2024-01-13T18:01:34.375 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 5 to smithi084102331-16 2024-01-13T18:01:34.376 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 6 to smithi084102331-16 2024-01-13T18:01:34.376 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 53 (ObjNum 109 snap 27 seq_num 109) dirty exists 2024-01-13T18:01:34.376 INFO:tasks.rados.rados.0.smithi084.stdout:297: left oid 16 (ObjNum 109 snap 27 seq_num 109) 2024-01-13T18:01:34.378 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 53 (ObjNum 85 snap 15 seq_num 85) dirty exists 2024-01-13T18:01:34.380 INFO:tasks.rados.rados.0.smithi084.stdout:297: done (2 left) 2024-01-13T18:01:34.380 INFO:tasks.rados.rados.0.smithi084.stdout:298: done (1 left) 2024-01-13T18:01:34.380 INFO:tasks.rados.rados.0.smithi084.stdout:299: done (0 left) 2024-01-13T18:01:34.380 INFO:tasks.rados.rados.0.smithi084.stdout:300: read oid 35 snap -1 2024-01-13T18:01:34.380 INFO:tasks.rados.rados.0.smithi084.stdout:300: expect (ObjNum 34 snap 0 seq_num 34) 2024-01-13T18:01:34.380 INFO:tasks.rados.rados.0.smithi084.stdout:301: rmattr oid 39 current snap is 27 2024-01-13T18:01:34.380 INFO:tasks.rados.rados.0.smithi084.stdout:301: done (1 left) 2024-01-13T18:01:34.380 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 27 2024-01-13T18:01:34.380 INFO:tasks.rados.rados.0.smithi084.stdout:302: seq_num 111 ranges {106496=663552,770048=663552,1433600=450560,1884160=90112} 2024-01-13T18:01:34.385 INFO:tasks.rados.rados.0.smithi084.stdout:302: writing smithi084102331-21 from 106496 to 770048 tid 1 2024-01-13T18:01:34.389 INFO:tasks.rados.rados.0.smithi084.stdout:302: writing smithi084102331-21 from 770048 to 1433600 tid 2 2024-01-13T18:01:34.392 INFO:tasks.rados.rados.0.smithi084.stdout:302: writing smithi084102331-21 from 1433600 to 1884160 tid 3 2024-01-13T18:01:34.393 INFO:tasks.rados.rados.0.smithi084.stdout:302: writing smithi084102331-21 from 1884160 to 1974272 tid 4 2024-01-13T18:01:34.393 INFO:tasks.rados.rados.0.smithi084.stdout:303: copy_from oid 38 from oid 14 current snap is 27 2024-01-13T18:01:34.393 INFO:tasks.rados.rados.0.smithi084.stdout:300: expect (ObjNum 34 snap 0 seq_num 34) 2024-01-13T18:01:34.413 INFO:tasks.rados.rados.0.smithi084.stdout:302: finishing write tid 1 to smithi084102331-21 2024-01-13T18:01:34.413 INFO:tasks.rados.rados.0.smithi084.stdout:302: finishing write tid 2 to smithi084102331-21 2024-01-13T18:01:34.413 INFO:tasks.rados.rados.0.smithi084.stdout:300: done (2 left) 2024-01-13T18:01:34.413 INFO:tasks.rados.rados.0.smithi084.stdout:304: rmattr oid 44 current snap is 27 2024-01-13T18:01:34.413 INFO:tasks.rados.rados.0.smithi084.stdout:304: done (2 left) 2024-01-13T18:01:34.413 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 27 2024-01-13T18:01:34.413 INFO:tasks.rados.rados.0.smithi084.stdout:302: finishing write tid 3 to smithi084102331-21 2024-01-13T18:01:34.413 INFO:tasks.rados.rados.0.smithi084.stdout:302: finishing write tid 4 to smithi084102331-21 2024-01-13T18:01:34.413 INFO:tasks.rados.rados.0.smithi084.stdout:302: finishing write tid 5 to smithi084102331-21 2024-01-13T18:01:34.413 INFO:tasks.rados.rados.0.smithi084.stdout:305: seq_num 112 ranges {2621440=679936,3301376=548864,3850240=655360} 2024-01-13T18:01:34.432 INFO:tasks.rados.rados.0.smithi084.stdout:305: writing smithi084102331-15 from 2621440 to 3301376 tid 1 2024-01-13T18:01:34.436 INFO:tasks.rados.rados.0.smithi084.stdout:305: writing smithi084102331-15 from 3301376 to 3850240 tid 2 2024-01-13T18:01:34.441 INFO:tasks.rados.rados.0.smithi084.stdout:305: writing smithi084102331-15 from 3850240 to 4505600 tid 3 2024-01-13T18:01:34.441 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 27 2024-01-13T18:01:34.441 INFO:tasks.rados.rados.0.smithi084.stdout:302: finishing write tid 6 to smithi084102331-21 2024-01-13T18:01:34.441 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 69 (ObjNum 111 snap 27 seq_num 111) dirty exists 2024-01-13T18:01:34.441 INFO:tasks.rados.rados.0.smithi084.stdout:302: left oid 21 (ObjNum 111 snap 27 seq_num 111) 2024-01-13T18:01:34.441 INFO:tasks.rados.rados.0.smithi084.stdout:303: finishing copy_from to smithi084102331-38 2024-01-13T18:01:34.442 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 66 (ObjNum 98 snap 19 seq_num 98) dirty exists 2024-01-13T18:01:34.442 INFO:tasks.rados.rados.0.smithi084.stdout:303: finishing copy_from racing read to smithi084102331-38 2024-01-13T18:01:34.442 INFO:tasks.rados.rados.0.smithi084.stdout:306: seq_num 113 ranges {2039808=696320,2736128=434176,3170304=466944,3637248=303104} 2024-01-13T18:01:34.458 INFO:tasks.rados.rados.0.smithi084.stdout:306: writing smithi084102331-22 from 2039808 to 2736128 tid 1 2024-01-13T18:01:34.461 INFO:tasks.rados.rados.0.smithi084.stdout:306: writing smithi084102331-22 from 2736128 to 3170304 tid 2 2024-01-13T18:01:34.464 INFO:tasks.rados.rados.0.smithi084.stdout:306: writing smithi084102331-22 from 3170304 to 3637248 tid 3 2024-01-13T18:01:34.466 INFO:tasks.rados.rados.0.smithi084.stdout:306: writing smithi084102331-22 from 3637248 to 3940352 tid 4 2024-01-13T18:01:34.466 INFO:tasks.rados.rados.0.smithi084.stdout:302: done (3 left) 2024-01-13T18:01:34.466 INFO:tasks.rados.rados.0.smithi084.stdout:303: done (2 left) 2024-01-13T18:01:34.466 INFO:tasks.rados.rados.0.smithi084.stdout:307: copy_from oid 27 from oid 35 current snap is 27 2024-01-13T18:01:34.467 INFO:tasks.rados.rados.0.smithi084.stdout:305: finishing write tid 1 to smithi084102331-15 2024-01-13T18:01:34.467 INFO:tasks.rados.rados.0.smithi084.stdout:305: finishing write tid 2 to smithi084102331-15 2024-01-13T18:01:34.467 INFO:tasks.rados.rados.0.smithi084.stdout:305: finishing write tid 3 to smithi084102331-15 2024-01-13T18:01:34.467 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 27 2024-01-13T18:01:34.467 INFO:tasks.rados.rados.0.smithi084.stdout:305: finishing write tid 4 to smithi084102331-15 2024-01-13T18:01:34.467 INFO:tasks.rados.rados.0.smithi084.stdout:305: finishing write tid 5 to smithi084102331-15 2024-01-13T18:01:34.467 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 103 (ObjNum 112 snap 27 seq_num 112) dirty exists 2024-01-13T18:01:34.467 INFO:tasks.rados.rados.0.smithi084.stdout:305: left oid 15 (ObjNum 112 snap 27 seq_num 112) 2024-01-13T18:01:34.467 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 1 to smithi084102331-22 2024-01-13T18:01:34.467 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 2 to smithi084102331-22 2024-01-13T18:01:34.467 INFO:tasks.rados.rados.0.smithi084.stdout:308: seq_num 114 ranges {0=712704,712704=712704,1425408=491520} 2024-01-13T18:01:34.470 INFO:tasks.rados.rados.0.smithi084.stdout:308: writing smithi084102331-31 from 0 to 712704 tid 1 2024-01-13T18:01:34.474 INFO:tasks.rados.rados.0.smithi084.stdout:308: writing smithi084102331-31 from 712704 to 1425408 tid 2 2024-01-13T18:01:34.477 INFO:tasks.rados.rados.0.smithi084.stdout:308: writing smithi084102331-31 from 1425408 to 1916928 tid 3 2024-01-13T18:01:34.477 INFO:tasks.rados.rados.0.smithi084.stdout:305: done (3 left) 2024-01-13T18:01:34.477 INFO:tasks.rados.rados.0.smithi084.stdout:309: snap_remove snap 20 2024-01-13T18:01:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:34 smithi099 ceph-mon[71325]: pgmap v132: 121 pgs: 121 active+clean; 62 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 5 op/s 2024-01-13T18:01:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:34 smithi099 ceph-mon[71325]: osdmap e118: 8 total, 8 up, 8 in 2024-01-13T18:01:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:34 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:34 smithi099 ceph-mon[71325]: osdmap e119: 8 total, 8 up, 8 in 2024-01-13T18:01:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[37908]: pgmap v132: 121 pgs: 121 active+clean; 62 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 5 op/s 2024-01-13T18:01:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[37908]: osdmap e118: 8 total, 8 up, 8 in 2024-01-13T18:01:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[37908]: osdmap e119: 8 total, 8 up, 8 in 2024-01-13T18:01:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[52328]: pgmap v132: 121 pgs: 121 active+clean; 62 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 5 op/s 2024-01-13T18:01:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[52328]: osdmap e118: 8 total, 8 up, 8 in 2024-01-13T18:01:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:34 smithi084 ceph-mon[52328]: osdmap e119: 8 total, 8 up, 8 in 2024-01-13T18:01:35.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:34.640+0000 7faca9233200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T18:01:35.373 INFO:tasks.rados.rados.0.smithi084.stdout:309: done (3 left) 2024-01-13T18:01:35.373 INFO:tasks.rados.rados.0.smithi084.stdout:310: copy_from oid 15 from oid 44 current snap is 27 2024-01-13T18:01:35.373 INFO:tasks.rados.rados.0.smithi084.stdout:311: copy_from oid 19 from oid 46 current snap is 27 2024-01-13T18:01:35.373 INFO:tasks.rados.rados.0.smithi084.stdout:312: snap_create 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 3 to smithi084102331-22 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 4 to smithi084102331-22 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 5 to smithi084102331-22 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 6 to smithi084102331-22 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 60 (ObjNum 113 snap 27 seq_num 113) dirty exists 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:306: left oid 22 (ObjNum 113 snap 27 seq_num 113) 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:307: finishing copy_from to smithi084102331-27 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 61 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:307: finishing copy_from racing read to smithi084102331-27 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:308: finishing write tid 1 to smithi084102331-31 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:308: finishing write tid 2 to smithi084102331-31 2024-01-13T18:01:35.375 INFO:tasks.rados.rados.0.smithi084.stdout:308: finishing write tid 3 to smithi084102331-31 2024-01-13T18:01:35.376 INFO:tasks.rados.rados.0.smithi084.stdout:308: finishing write tid 4 to smithi084102331-31 2024-01-13T18:01:35.376 INFO:tasks.rados.rados.0.smithi084.stdout:308: finishing write tid 5 to smithi084102331-31 2024-01-13T18:01:35.376 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 128 (ObjNum 114 snap 27 seq_num 114) dirty exists 2024-01-13T18:01:35.376 INFO:tasks.rados.rados.0.smithi084.stdout:308: left oid 31 (ObjNum 114 snap 27 seq_num 114) 2024-01-13T18:01:35.389 INFO:tasks.rados.rados.0.smithi084.stdout:311: finishing copy_from to smithi084102331-19 2024-01-13T18:01:35.389 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 15 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:01:35.390 INFO:tasks.rados.rados.0.smithi084.stdout:311: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:01:35.395 INFO:tasks.rados.rados.0.smithi084.stdout:310: finishing copy_from to smithi084102331-15 2024-01-13T18:01:35.395 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 80 (ObjNum 102 snap 19 seq_num 102) dirty exists 2024-01-13T18:01:35.396 INFO:tasks.rados.rados.0.smithi084.stdout:310: finishing copy_from racing read to smithi084102331-15 2024-01-13T18:01:35.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:35 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:35.436 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:35.183+0000 7faca9233200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T18:01:35.436 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:35.435+0000 7faca9233200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T18:01:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:35 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:35 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:36.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:35.905+0000 7faca9233200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T18:01:36.371 INFO:tasks.rados.rados.0.smithi084.stdout:306: done (5 left) 2024-01-13T18:01:36.371 INFO:tasks.rados.rados.0.smithi084.stdout:307: done (4 left) 2024-01-13T18:01:36.371 INFO:tasks.rados.rados.0.smithi084.stdout:308: done (3 left) 2024-01-13T18:01:36.372 INFO:tasks.rados.rados.0.smithi084.stdout:310: done (2 left) 2024-01-13T18:01:36.372 INFO:tasks.rados.rados.0.smithi084.stdout:311: done (1 left) 2024-01-13T18:01:36.372 INFO:tasks.rados.rados.0.smithi084.stdout:312: done (0 left) 2024-01-13T18:01:36.372 INFO:tasks.rados.rados.0.smithi084.stdout:313: read oid 15 snap -1 2024-01-13T18:01:36.372 INFO:tasks.rados.rados.0.smithi084.stdout:313: expect (ObjNum 102 snap 19 seq_num 102) 2024-01-13T18:01:36.372 INFO:tasks.rados.rados.0.smithi084.stdout:314: copy_from oid 3 from oid 47 current snap is 28 2024-01-13T18:01:36.372 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 28 2024-01-13T18:01:36.372 INFO:tasks.rados.rados.0.smithi084.stdout:315: seq_num 115 ranges {1875968=729088,2605056=647168,3252224=434176,3686400=122880} 2024-01-13T18:01:36.385 INFO:tasks.rados.rados.0.smithi084.stdout:315: writing smithi084102331-38 from 1875968 to 2605056 tid 1 2024-01-13T18:01:36.388 INFO:tasks.rados.rados.0.smithi084.stdout:315: writing smithi084102331-38 from 2605056 to 3252224 tid 2 2024-01-13T18:01:36.390 INFO:tasks.rados.rados.0.smithi084.stdout:315: writing smithi084102331-38 from 3252224 to 3686400 tid 3 2024-01-13T18:01:36.391 INFO:tasks.rados.rados.0.smithi084.stdout:315: writing smithi084102331-38 from 3686400 to 3809280 tid 4 2024-01-13T18:01:36.391 INFO:tasks.rados.rados.0.smithi084.stdout:316: read oid 39 snap -1 2024-01-13T18:01:36.392 INFO:tasks.rados.rados.0.smithi084.stdout:316: expect (ObjNum 61 snap 5 seq_num 61) 2024-01-13T18:01:36.392 INFO:tasks.rados.rados.0.smithi084.stdout:317: rmattr oid 46 current snap is 28 2024-01-13T18:01:36.392 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 28 2024-01-13T18:01:36.392 INFO:tasks.rados.rados.0.smithi084.stdout:318: seq_num 116 ranges {2310144=745472,3055616=532480,3588096=638976,4227072=32768} 2024-01-13T18:01:36.407 INFO:tasks.rados.rados.0.smithi084.stdout:318: writing smithi084102331-33 from 2310144 to 3055616 tid 1 2024-01-13T18:01:36.410 INFO:tasks.rados.rados.0.smithi084.stdout:318: writing smithi084102331-33 from 3055616 to 3588096 tid 2 2024-01-13T18:01:36.415 INFO:tasks.rados.rados.0.smithi084.stdout:318: writing smithi084102331-33 from 3588096 to 4227072 tid 3 2024-01-13T18:01:36.415 INFO:tasks.rados.rados.0.smithi084.stdout:318: writing smithi084102331-33 from 4227072 to 4259840 tid 4 2024-01-13T18:01:36.415 INFO:tasks.rados.rados.0.smithi084.stdout:319: read oid 2 snap -1 2024-01-13T18:01:36.415 INFO:tasks.rados.rados.0.smithi084.stdout:319: expect (ObjNum 80 snap 14 seq_num 80) 2024-01-13T18:01:36.415 INFO:tasks.rados.rados.0.smithi084.stdout:320: copy_from oid 23 from oid 43 current snap is 28 2024-01-13T18:01:36.415 INFO:tasks.rados.rados.0.smithi084.stdout:316: expect (ObjNum 61 snap 5 seq_num 61) 2024-01-13T18:01:36.470 INFO:tasks.rados.rados.0.smithi084.stdout:319: expect (ObjNum 80 snap 14 seq_num 80) 2024-01-13T18:01:36.552 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 37 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:01:36.552 INFO:tasks.rados.rados.0.smithi084.stdout:318: finishing write tid 1 to smithi084102331-33 2024-01-13T18:01:36.552 INFO:tasks.rados.rados.0.smithi084.stdout:318: finishing write tid 2 to smithi084102331-33 2024-01-13T18:01:36.552 INFO:tasks.rados.rados.0.smithi084.stdout:318: finishing write tid 3 to smithi084102331-33 2024-01-13T18:01:36.552 INFO:tasks.rados.rados.0.smithi084.stdout:318: finishing write tid 4 to smithi084102331-33 2024-01-13T18:01:36.552 INFO:tasks.rados.rados.0.smithi084.stdout:318: finishing write tid 5 to smithi084102331-33 2024-01-13T18:01:36.552 INFO:tasks.rados.rados.0.smithi084.stdout:318: finishing write tid 6 to smithi084102331-33 2024-01-13T18:01:36.552 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 65 (ObjNum 116 snap 28 seq_num 116) dirty exists 2024-01-13T18:01:36.552 INFO:tasks.rados.rados.0.smithi084.stdout:318: left oid 33 (ObjNum 116 snap 28 seq_num 116) 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 1 to smithi084102331-38 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 2 to smithi084102331-38 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:316: done (7 left) 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:317: done (6 left) 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:318: done (5 left) 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:319: done (4 left) 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:321: read oid 19 snap -1 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:321: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:322: snap_create 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 3 to smithi084102331-38 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 4 to smithi084102331-38 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 5 to smithi084102331-38 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 6 to smithi084102331-38 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 138 (ObjNum 115 snap 28 seq_num 115) dirty exists 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:315: left oid 38 (ObjNum 115 snap 28 seq_num 115) 2024-01-13T18:01:36.553 INFO:tasks.rados.rados.0.smithi084.stdout:313: expect (ObjNum 102 snap 19 seq_num 102) 2024-01-13T18:01:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:36 smithi099 ceph-mon[71325]: pgmap v135: 121 pgs: 121 active+clean; 62 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:36 smithi099 ceph-mon[71325]: osdmap e120: 8 total, 8 up, 8 in 2024-01-13T18:01:36.642 INFO:tasks.rados.rados.0.smithi084.stdout:314: finishing copy_from to smithi084102331-3 2024-01-13T18:01:36.642 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 59 (ObjNum 89 snap 16 seq_num 89) dirty exists 2024-01-13T18:01:36.642 INFO:tasks.rados.rados.0.smithi084.stdout:314: finishing copy_from racing read to smithi084102331-3 2024-01-13T18:01:36.642 INFO:tasks.rados.rados.0.smithi084.stdout:320: finishing copy_from to smithi084102331-23 2024-01-13T18:01:36.642 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 28 (ObjNum 100 snap 19 seq_num 100) dirty exists 2024-01-13T18:01:36.642 INFO:tasks.rados.rados.0.smithi084.stdout:320: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:01:36.642 INFO:tasks.rados.rados.0.smithi084.stdout:321: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:36.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:36 smithi084 ceph-mon[37908]: pgmap v135: 121 pgs: 121 active+clean; 62 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:36.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:36 smithi084 ceph-mon[37908]: osdmap e120: 8 total, 8 up, 8 in 2024-01-13T18:01:36.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:36 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:01:36] "GET /metrics HTTP/1.1" 200 239258 "" "Prometheus/2.43.0" 2024-01-13T18:01:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:36 smithi084 ceph-mon[52328]: pgmap v135: 121 pgs: 121 active+clean; 62 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:36 smithi084 ceph-mon[52328]: osdmap e120: 8 total, 8 up, 8 in 2024-01-13T18:01:37.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:36.674+0000 7faca9233200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T18:01:37.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:36.766+0000 7faca9233200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T18:01:37.377 INFO:tasks.rados.rados.0.smithi084.stdout:313: done (5 left) 2024-01-13T18:01:37.377 INFO:tasks.rados.rados.0.smithi084.stdout:314: done (4 left) 2024-01-13T18:01:37.377 INFO:tasks.rados.rados.0.smithi084.stdout:315: done (3 left) 2024-01-13T18:01:37.377 INFO:tasks.rados.rados.0.smithi084.stdout:320: done (2 left) 2024-01-13T18:01:37.378 INFO:tasks.rados.rados.0.smithi084.stdout:321: done (1 left) 2024-01-13T18:01:37.378 INFO:tasks.rados.rados.0.smithi084.stdout:322: done (0 left) 2024-01-13T18:01:37.378 INFO:tasks.rados.rados.0.smithi084.stdout:323: read oid 27 snap -1 2024-01-13T18:01:37.378 INFO:tasks.rados.rados.0.smithi084.stdout:323: expect (ObjNum 34 snap 0 seq_num 34) 2024-01-13T18:01:37.378 INFO:tasks.rados.rados.0.smithi084.stdout:324: read oid 29 snap -1 2024-01-13T18:01:37.378 INFO:tasks.rados.rados.0.smithi084.stdout:324: expect (ObjNum 99 snap 19 seq_num 99) 2024-01-13T18:01:37.378 INFO:tasks.rados.rados.0.smithi084.stdout:325: delete oid 38 current snap is 29 2024-01-13T18:01:37.387 INFO:tasks.rados.rados.0.smithi084.stdout:323: expect (ObjNum 34 snap 0 seq_num 34) 2024-01-13T18:01:37.401 INFO:tasks.rados.rados.0.smithi084.stdout:324: expect (ObjNum 99 snap 19 seq_num 99) 2024-01-13T18:01:37.461 INFO:tasks.rados.rados.0.smithi084.stdout:323: done (2 left) 2024-01-13T18:01:37.461 INFO:tasks.rados.rados.0.smithi084.stdout:324: done (1 left) 2024-01-13T18:01:37.461 INFO:tasks.rados.rados.0.smithi084.stdout:325: done (0 left) 2024-01-13T18:01:37.461 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 29 2024-01-13T18:01:37.461 INFO:tasks.rados.rados.0.smithi084.stdout:326: seq_num 118 ranges {425984=786432,1212416=704512,1916928=499712} 2024-01-13T18:01:37.467 INFO:tasks.rados.rados.0.smithi084.stdout:326: writing smithi084102331-26 from 425984 to 1212416 tid 1 2024-01-13T18:01:37.471 INFO:tasks.rados.rados.0.smithi084.stdout:326: writing smithi084102331-26 from 1212416 to 1916928 tid 2 2024-01-13T18:01:37.474 INFO:tasks.rados.rados.0.smithi084.stdout:326: writing smithi084102331-26 from 1916928 to 2416640 tid 3 2024-01-13T18:01:37.474 INFO:tasks.rados.rados.0.smithi084.stdout:327: delete oid 6 current snap is 29 2024-01-13T18:01:37.474 INFO:tasks.rados.rados.0.smithi084.stdout:326: finishing write tid 1 to smithi084102331-26 2024-01-13T18:01:37.474 INFO:tasks.rados.rados.0.smithi084.stdout:326: finishing write tid 2 to smithi084102331-26 2024-01-13T18:01:37.477 INFO:tasks.rados.rados.0.smithi084.stdout:326: finishing write tid 3 to smithi084102331-26 2024-01-13T18:01:37.477 INFO:tasks.rados.rados.0.smithi084.stdout:326: finishing write tid 4 to smithi084102331-26 2024-01-13T18:01:37.477 INFO:tasks.rados.rados.0.smithi084.stdout:327: done (1 left) 2024-01-13T18:01:37.477 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 29 2024-01-13T18:01:37.477 INFO:tasks.rados.rados.0.smithi084.stdout:328: seq_num 120 ranges {0=417792,417792=475136,892928=622592,1515520=507904} 2024-01-13T18:01:37.479 INFO:tasks.rados.rados.0.smithi084.stdout:328: writing smithi084102331-37 from 0 to 417792 tid 1 2024-01-13T18:01:37.482 INFO:tasks.rados.rados.0.smithi084.stdout:328: writing smithi084102331-37 from 417792 to 892928 tid 2 2024-01-13T18:01:37.486 INFO:tasks.rados.rados.0.smithi084.stdout:328: writing smithi084102331-37 from 892928 to 1515520 tid 3 2024-01-13T18:01:37.489 INFO:tasks.rados.rados.0.smithi084.stdout:328: writing smithi084102331-37 from 1515520 to 2023424 tid 4 2024-01-13T18:01:37.489 INFO:tasks.rados.rados.0.smithi084.stdout:329: copy_from oid 21 from oid 20 current snap is 29 2024-01-13T18:01:37.489 INFO:tasks.rados.rados.0.smithi084.stdout:326: finishing write tid 5 to smithi084102331-26 2024-01-13T18:01:37.489 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 91 (ObjNum 118 snap 29 seq_num 118) dirty exists 2024-01-13T18:01:37.489 INFO:tasks.rados.rados.0.smithi084.stdout:326: left oid 26 (ObjNum 118 snap 29 seq_num 118) 2024-01-13T18:01:37.489 INFO:tasks.rados.rados.0.smithi084.stdout:328: finishing write tid 1 to smithi084102331-37 2024-01-13T18:01:37.489 INFO:tasks.rados.rados.0.smithi084.stdout:328: finishing write tid 2 to smithi084102331-37 2024-01-13T18:01:37.489 INFO:tasks.rados.rados.0.smithi084.stdout:328: finishing write tid 3 to smithi084102331-37 2024-01-13T18:01:37.489 INFO:tasks.rados.rados.0.smithi084.stdout:326: done (2 left) 2024-01-13T18:01:37.490 INFO:tasks.rados.rados.0.smithi084.stdout:330: setattr oid 43 current snap is 29 2024-01-13T18:01:37.490 INFO:tasks.rados.rados.0.smithi084.stdout:331: read oid 34 snap -1 2024-01-13T18:01:37.490 INFO:tasks.rados.rados.0.smithi084.stdout:331: expect (ObjNum 39 snap 0 seq_num 39) 2024-01-13T18:01:37.490 INFO:tasks.rados.rados.0.smithi084.stdout:332: snap_create 2024-01-13T18:01:37.491 INFO:tasks.rados.rados.0.smithi084.stdout:328: finishing write tid 4 to smithi084102331-37 2024-01-13T18:01:37.491 INFO:tasks.rados.rados.0.smithi084.stdout:328: finishing write tid 5 to smithi084102331-37 2024-01-13T18:01:37.492 INFO:tasks.rados.rados.0.smithi084.stdout:328: finishing write tid 6 to smithi084102331-37 2024-01-13T18:01:37.492 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 70 (ObjNum 120 snap 29 seq_num 120) dirty exists 2024-01-13T18:01:37.492 INFO:tasks.rados.rados.0.smithi084.stdout:328: left oid 37 (ObjNum 120 snap 29 seq_num 120) 2024-01-13T18:01:37.493 INFO:tasks.rados.rados.0.smithi084.stdout:331: expect (ObjNum 39 snap 0 seq_num 39) 2024-01-13T18:01:37.510 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 38 (ObjNum 100 snap 19 seq_num 100) dirty exists 2024-01-13T18:01:37.510 INFO:tasks.rados.rados.0.smithi084.stdout:329: finishing copy_from to smithi084102331-21 2024-01-13T18:01:37.510 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 2 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-01-13T18:01:37.510 INFO:tasks.rados.rados.0.smithi084.stdout:329: finishing copy_from racing read to smithi084102331-21 2024-01-13T18:01:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:37 smithi084 ceph-mon[37908]: osdmap e121: 8 total, 8 up, 8 in 2024-01-13T18:01:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:37 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:37 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:37 smithi084 ceph-mon[52328]: osdmap e121: 8 total, 8 up, 8 in 2024-01-13T18:01:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:37 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:37 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:37.831 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:37.405+0000 7faca9233200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T18:01:37.831 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:37.499+0000 7faca9233200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T18:01:37.831 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:37.592+0000 7faca9233200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T18:01:37.831 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:37 smithi099 ceph-mon[71325]: osdmap e121: 8 total, 8 up, 8 in 2024-01-13T18:01:37.831 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:37 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:37.832 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:37 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:38.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:37.829+0000 7faca9233200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T18:01:38.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:37.927+0000 7faca9233200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T18:01:38.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:38.033+0000 7faca9233200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T18:01:38.375 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:38.261+0000 7faca9233200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T18:01:38.376 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:38.364+0000 7faca9233200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T18:01:38.376 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:38 smithi099 ceph-mon[71325]: pgmap v138: 121 pgs: 121 active+clean; 77 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 19 op/s 2024-01-13T18:01:38.384 INFO:tasks.rados.rados.0.smithi084.stdout:328: done (4 left) 2024-01-13T18:01:38.384 INFO:tasks.rados.rados.0.smithi084.stdout:329: done (3 left) 2024-01-13T18:01:38.384 INFO:tasks.rados.rados.0.smithi084.stdout:330: done (2 left) 2024-01-13T18:01:38.384 INFO:tasks.rados.rados.0.smithi084.stdout:331: done (1 left) 2024-01-13T18:01:38.384 INFO:tasks.rados.rados.0.smithi084.stdout:332: done (0 left) 2024-01-13T18:01:38.384 INFO:tasks.rados.rados.0.smithi084.stdout:333: read oid 31 snap -1 2024-01-13T18:01:38.384 INFO:tasks.rados.rados.0.smithi084.stdout:333: expect (ObjNum 114 snap 27 seq_num 114) 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:334: rollback oid 22 current snap is 30 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 28 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:335: read oid 48 snap -1 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:335: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:336: read oid 3 snap 26 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:336: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:337: rmattr oid 6 current snap is 30 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:337: done (4 left) 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:338: rmattr oid 8 current snap is 30 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:339: rmattr oid 19 current snap is 30 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:340: copy_from oid 25 from oid 33 current snap is 30 2024-01-13T18:01:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:341: delete oid 20 current snap is 30 2024-01-13T18:01:38.388 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 108 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:01:38.391 INFO:tasks.rados.rados.0.smithi084.stdout:333: expect (ObjNum 114 snap 27 seq_num 114) 2024-01-13T18:01:38.441 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 39 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:01:38.441 INFO:tasks.rados.rados.0.smithi084.stdout:334: finishing rollback tid 0 to smithi084102331-22 2024-01-13T18:01:38.441 INFO:tasks.rados.rados.0.smithi084.stdout:334: finishing rollback tid 1 to smithi084102331-22 2024-01-13T18:01:38.441 INFO:tasks.rados.rados.0.smithi084.stdout:333: done (7 left) 2024-01-13T18:01:38.441 INFO:tasks.rados.rados.0.smithi084.stdout:338: done (6 left) 2024-01-13T18:01:38.441 INFO:tasks.rados.rados.0.smithi084.stdout:339: done (5 left) 2024-01-13T18:01:38.441 INFO:tasks.rados.rados.0.smithi084.stdout:341: done (4 left) 2024-01-13T18:01:38.441 INFO:tasks.rados.rados.0.smithi084.stdout:342: rollback oid 17 current snap is 30 2024-01-13T18:01:38.441 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 25 2024-01-13T18:01:38.442 INFO:tasks.rados.rados.0.smithi084.stdout:334: finishing rollback tid 2 to smithi084102331-22 2024-01-13T18:01:38.442 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 68 (ObjNum 113 snap 27 seq_num 113) dirty exists 2024-01-13T18:01:38.442 INFO:tasks.rados.rados.0.smithi084.stdout:336: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:38.461 INFO:tasks.rados.rados.0.smithi084.stdout:335: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:01:38.480 INFO:tasks.rados.rados.0.smithi084.stdout:340: finishing copy_from to smithi084102331-25 2024-01-13T18:01:38.480 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 65 (ObjNum 116 snap 28 seq_num 116) dirty exists 2024-01-13T18:01:38.480 INFO:tasks.rados.rados.0.smithi084.stdout:340: finishing copy_from racing read to smithi084102331-25 2024-01-13T18:01:38.480 INFO:tasks.rados.rados.0.smithi084.stdout:334: done (4 left) 2024-01-13T18:01:38.481 INFO:tasks.rados.rados.0.smithi084.stdout:335: done (3 left) 2024-01-13T18:01:38.481 INFO:tasks.rados.rados.0.smithi084.stdout:336: done (2 left) 2024-01-13T18:01:38.481 INFO:tasks.rados.rados.0.smithi084.stdout:340: done (1 left) 2024-01-13T18:01:38.481 INFO:tasks.rados.rados.0.smithi084.stdout:343: read oid 2 snap -1 2024-01-13T18:01:38.481 INFO:tasks.rados.rados.0.smithi084.stdout:343: expect (ObjNum 80 snap 14 seq_num 80) 2024-01-13T18:01:38.481 INFO:tasks.rados.rados.0.smithi084.stdout:344: snap_remove snap 26 2024-01-13T18:01:38.643 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:38.570+0000 7faca9233200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T18:01:38.643 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:38 smithi099 ceph-mon[71325]: osdmap e122: 8 total, 8 up, 8 in 2024-01-13T18:01:38.643 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:38 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:38.644 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:38 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:38 smithi084 ceph-mon[37908]: pgmap v138: 121 pgs: 121 active+clean; 77 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 19 op/s 2024-01-13T18:01:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:38 smithi084 ceph-mon[37908]: osdmap e122: 8 total, 8 up, 8 in 2024-01-13T18:01:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:38 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:38 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:38 smithi084 ceph-mon[52328]: pgmap v138: 121 pgs: 121 active+clean; 77 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 19 op/s 2024-01-13T18:01:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:38 smithi084 ceph-mon[52328]: osdmap e122: 8 total, 8 up, 8 in 2024-01-13T18:01:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:38 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:38 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:38.904 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:38.660+0000 7faca9233200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T18:01:39.346 INFO:tasks.rados.rados.0.smithi084.stdout:344: done (2 left) 2024-01-13T18:01:39.347 INFO:tasks.rados.rados.0.smithi084.stdout:345: delete oid 12 current snap is 30 2024-01-13T18:01:39.347 INFO:tasks.rados.rados.0.smithi084.stdout:342: finishing rollback tid 0 to smithi084102331-17 2024-01-13T18:01:39.347 INFO:tasks.rados.rados.0.smithi084.stdout:342: finishing rollback tid 1 to smithi084102331-17 2024-01-13T18:01:39.347 INFO:tasks.rados.rados.0.smithi084.stdout:342: finishing rollback tid 2 to smithi084102331-17 2024-01-13T18:01:39.347 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 59 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-01-13T18:01:39.347 INFO:tasks.rados.rados.0.smithi084.stdout:343: expect (ObjNum 80 snap 14 seq_num 80) 2024-01-13T18:01:39.436 INFO:tasks.rados.rados.0.smithi084.stdout:342: done (2 left) 2024-01-13T18:01:39.436 INFO:tasks.rados.rados.0.smithi084.stdout:343: done (1 left) 2024-01-13T18:01:39.436 INFO:tasks.rados.rados.0.smithi084.stdout:345: done (0 left) 2024-01-13T18:01:39.436 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 30 2024-01-13T18:01:39.437 INFO:tasks.rados.rados.0.smithi084.stdout:346: seq_num 123 ranges {0=466944,466944=573440,1040384=794624,1835008=237568} 2024-01-13T18:01:39.438 INFO:tasks.rados.rados.0.smithi084.stdout:346: writing smithi084102331-12 from 0 to 466944 tid 1 2024-01-13T18:01:39.441 INFO:tasks.rados.rados.0.smithi084.stdout:346: writing smithi084102331-12 from 466944 to 1040384 tid 2 2024-01-13T18:01:39.446 INFO:tasks.rados.rados.0.smithi084.stdout:346: writing smithi084102331-12 from 1040384 to 1835008 tid 3 2024-01-13T18:01:39.447 INFO:tasks.rados.rados.0.smithi084.stdout:346: writing smithi084102331-12 from 1835008 to 2072576 tid 4 2024-01-13T18:01:39.447 INFO:tasks.rados.rados.0.smithi084.stdout:347: snap_remove snap 23 2024-01-13T18:01:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:39 smithi084 ceph-mon[37908]: osdmap e123: 8 total, 8 up, 8 in 2024-01-13T18:01:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:39 smithi084 ceph-mon[37908]: osdmap e124: 8 total, 8 up, 8 in 2024-01-13T18:01:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:39 smithi084 ceph-mon[52328]: osdmap e123: 8 total, 8 up, 8 in 2024-01-13T18:01:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:39 smithi084 ceph-mon[52328]: osdmap e124: 8 total, 8 up, 8 in 2024-01-13T18:01:39.693 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:39 smithi099 ceph-mon[71325]: osdmap e123: 8 total, 8 up, 8 in 2024-01-13T18:01:39.693 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:39 smithi099 ceph-mon[71325]: osdmap e124: 8 total, 8 up, 8 in 2024-01-13T18:01:39.693 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:39.485+0000 7faca9233200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T18:01:39.693 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:39.691+0000 7faca9233200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T18:01:39.950 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:39.949+0000 7faca9233200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:01:40.394 INFO:tasks.rados.rados.0.smithi084.stdout:347: done (1 left) 2024-01-13T18:01:40.394 INFO:tasks.rados.rados.0.smithi084.stdout:348: snap_remove snap 28 2024-01-13T18:01:40.463 INFO:tasks.rados.rados.0.smithi084.stdout:348: done (1 left) 2024-01-13T18:01:40.463 INFO:tasks.rados.rados.0.smithi084.stdout:349: snap_remove snap 29 2024-01-13T18:01:40.493 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:40 smithi099 ceph-mon[71325]: pgmap v141: 121 pgs: 121 active+clean; 77 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 19 op/s 2024-01-13T18:01:40.493 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:40.493 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:40.493 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:01:40.493 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:01:40.493 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:40 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:40.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[37908]: pgmap v141: 121 pgs: 121 active+clean; 77 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 19 op/s 2024-01-13T18:01:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:01:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:01:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:40.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:40.458+0000 7f12ffce3700 -1 mgr handle_mgr_map I was active but no longer am 2024-01-13T18:01:40.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ignoring --setuser ceph since I am not root 2024-01-13T18:01:40.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ignoring --setgroup ceph since I am not root 2024-01-13T18:01:40.680 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mgr[38181]: -- 172.21.15.84:0/2167412865 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ee078f89c0 con 0x55ee078ce800 2024-01-13T18:01:40.680 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:40.624+0000 7f68017521c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T18:01:40.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[52328]: pgmap v141: 121 pgs: 121 active+clean; 77 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 19 op/s 2024-01-13T18:01:40.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:40.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:40.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:01:40.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:01:40.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' 2024-01-13T18:01:40.830 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:40 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:40.644+0000 7faca9233200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T18:01:41.080 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:40.784+0000 7f68017521c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T18:01:41.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:40 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:40.828+0000 7faca9233200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:01:41.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.017+0000 7faca9233200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T18:01:41.159 INFO:tasks.rados.rados.0.smithi084.stdout:349: done (1 left) 2024-01-13T18:01:41.159 INFO:tasks.rados.rados.0.smithi084.stdout:350: snap_remove snap 27 2024-01-13T18:01:41.391 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:41.077+0000 7f68017521c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T18:01:41.391 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.133+0000 7faca9233200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T18:01:41.391 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:01:41] ENGINE Bus STARTING 2024-01-13T18:01:41.391 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: CherryPy Checker: 2024-01-13T18:01:41.392 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: The Application mounted at '' has an empty config. 2024-01-13T18:01:41.392 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.392 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:01:41] ENGINE Serving on http://:::9283 2024-01-13T18:01:41.392 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:01:41] ENGINE Bus STARTED 2024-01-13T18:01:41.392 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:01:41] ENGINE Bus STOPPING 2024-01-13T18:01:41.392 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:01:41] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:01:41.392 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:01:41] ENGINE Bus STOPPED 2024-01-13T18:01:41.392 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:01:41] ENGINE Bus STARTING 2024-01-13T18:01:41.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: osdmap e125: 8 total, 8 up, 8 in 2024-01-13T18:01:41.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:41.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-01-13T18:01:41.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: osdmap e126: 8 total, 8 up, 8 in 2024-01-13T18:01:41.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-01-13T18:01:41.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: mgrmap e23: x(active, starting, since 0.00586491s) 2024-01-13T18:01:41.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: Active manager daemon x restarted 2024-01-13T18:01:41.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: Activating manager daemon x 2024-01-13T18:01:41.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:01:41.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: osdmap e127: 8 total, 8 up, 8 in 2024-01-13T18:01:41.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:41.604+0000 7f68017521c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T18:01:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: osdmap e125: 8 total, 8 up, 8 in 2024-01-13T18:01:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-01-13T18:01:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: osdmap e126: 8 total, 8 up, 8 in 2024-01-13T18:01:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-01-13T18:01:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: mgrmap e23: x(active, starting, since 0.00586491s) 2024-01-13T18:01:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: Active manager daemon x restarted 2024-01-13T18:01:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: Activating manager daemon x 2024-01-13T18:01:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:01:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: osdmap e127: 8 total, 8 up, 8 in 2024-01-13T18:01:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: mgrmap e24: x(active, starting, since 0.00967883s) 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:01:41.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:01:41.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:01:41.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:01:41.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T18:01:41.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T18:01:41.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T18:01:41.683 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: osdmap e125: 8 total, 8 up, 8 in 2024-01-13T18:01:41.683 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:41.683 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-01-13T18:01:41.683 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: osdmap e126: 8 total, 8 up, 8 in 2024-01-13T18:01:41.683 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24500 172.21.15.84:0/1250836574' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-01-13T18:01:41.683 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: mgrmap e23: x(active, starting, since 0.00586491s) 2024-01-13T18:01:41.683 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: Active manager daemon x restarted 2024-01-13T18:01:41.683 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: Activating manager daemon x 2024-01-13T18:01:41.683 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: osdmap e127: 8 total, 8 up, 8 in 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: mgrmap e24: x(active, starting, since 0.00967883s) 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:01:41.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: Manager daemon x is now available 2024-01-13T18:01:41.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:41.686 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:41.686 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:41.686 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:41.686 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:01:41.686 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:01:41.686 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:01:41.687 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:01:41.687 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:01:41.687 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: Manager daemon x is now available 2024-01-13T18:01:41.687 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:41.687 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:41.687 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:41.687 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:41.688 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:01:41.688 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:01:41.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.428+0000 7fac09e5f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:01:41.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.428+0000 7fac09e5f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:01:41.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.428+0000 7fac09e5f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:01:41.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.428+0000 7fac09e5f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:01:41.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.428+0000 7fac09e5f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:01:41.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.430+0000 7fac06658700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:01:41.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.430+0000 7fac06658700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:01:41.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.430+0000 7fac06658700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:01:41.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.430+0000 7fac06658700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:01:41.870 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:01:41.430+0000 7fac06658700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:01:41.870 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:01:41] ENGINE Serving on http://:::9283 2024-01-13T18:01:41.870 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:01:41] ENGINE Bus STARTED 2024-01-13T18:01:41.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: mgrmap e24: x(active, starting, since 0.00967883s) 2024-01-13T18:01:41.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:01:41.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:01:41.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:01:41.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:01:41.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:01:41.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:01:41.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:01:41.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:01:41.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: Manager daemon x is now available 2024-01-13T18:01:41.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:41.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:41.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:01:41.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:41.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:01:41.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:41 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:01:42.163 INFO:tasks.rados.rados.0.smithi084.stdout:350: done (1 left) 2024-01-13T18:01:42.163 INFO:tasks.rados.rados.0.smithi084.stdout:351: setattr oid 21 current snap is 30 2024-01-13T18:01:42.163 INFO:tasks.rados.rados.0.smithi084.stdout:346: finishing write tid 1 to smithi084102331-12 2024-01-13T18:01:42.163 INFO:tasks.rados.rados.0.smithi084.stdout:346: finishing write tid 2 to smithi084102331-12 2024-01-13T18:01:42.163 INFO:tasks.rados.rados.0.smithi084.stdout:346: finishing write tid 3 to smithi084102331-12 2024-01-13T18:01:42.164 INFO:tasks.rados.rados.0.smithi084.stdout:346: finishing write tid 4 to smithi084102331-12 2024-01-13T18:01:42.164 INFO:tasks.rados.rados.0.smithi084.stdout:346: finishing write tid 5 to smithi084102331-12 2024-01-13T18:01:42.164 INFO:tasks.rados.rados.0.smithi084.stdout:346: finishing write tid 6 to smithi084102331-12 2024-01-13T18:01:42.164 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 78 (ObjNum 123 snap 30 seq_num 123) dirty exists 2024-01-13T18:01:42.164 INFO:tasks.rados.rados.0.smithi084.stdout:346: left oid 12 (ObjNum 123 snap 30 seq_num 123) 2024-01-13T18:01:42.165 INFO:tasks.rados.rados.0.smithi084.stdout:346: done (1 left) 2024-01-13T18:01:42.165 INFO:tasks.rados.rados.0.smithi084.stdout:352: read oid 27 snap -1 2024-01-13T18:01:42.165 INFO:tasks.rados.rados.0.smithi084.stdout:352: expect (ObjNum 34 snap 0 seq_num 34) 2024-01-13T18:01:42.165 INFO:tasks.rados.rados.0.smithi084.stdout:353: read oid 37 snap -1 2024-01-13T18:01:42.165 INFO:tasks.rados.rados.0.smithi084.stdout:353: expect (ObjNum 120 snap 29 seq_num 120) 2024-01-13T18:01:42.165 INFO:tasks.rados.rados.0.smithi084.stdout:354: snap_remove snap 25 2024-01-13T18:01:42.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:41.841+0000 7f68017521c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T18:01:42.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:42.196+0000 7f68017521c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T18:01:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-13T18:01:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-13T18:01:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[37908]: Deploying cephadm binary to smithi099 2024-01-13T18:01:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[37908]: Deploying cephadm binary to smithi084 2024-01-13T18:01:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[37908]: mgrmap e25: x(active, since 1.00999s) 2024-01-13T18:01:42.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[37908]: osdmap e128: 8 total, 8 up, 8 in 2024-01-13T18:01:42.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-13T18:01:42.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-13T18:01:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[52328]: Deploying cephadm binary to smithi099 2024-01-13T18:01:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[52328]: Deploying cephadm binary to smithi084 2024-01-13T18:01:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[52328]: mgrmap e25: x(active, since 1.00999s) 2024-01-13T18:01:42.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-mon[52328]: osdmap e128: 8 total, 8 up, 8 in 2024-01-13T18:01:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:42 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-13T18:01:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:42 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-13T18:01:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:42 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:42 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:42 smithi099 ceph-mon[71325]: Deploying cephadm binary to smithi099 2024-01-13T18:01:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:42 smithi099 ceph-mon[71325]: Deploying cephadm binary to smithi084 2024-01-13T18:01:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:42 smithi099 ceph-mon[71325]: mgrmap e25: x(active, since 1.00999s) 2024-01-13T18:01:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:42 smithi099 ceph-mon[71325]: osdmap e128: 8 total, 8 up, 8 in 2024-01-13T18:01:43.170 INFO:tasks.rados.rados.0.smithi084.stdout:354: done (3 left) 2024-01-13T18:01:43.170 INFO:tasks.rados.rados.0.smithi084.stdout:355: read oid 3 snap -1 2024-01-13T18:01:43.170 INFO:tasks.rados.rados.0.smithi084.stdout:355: expect (ObjNum 89 snap 16 seq_num 89) 2024-01-13T18:01:43.171 INFO:tasks.rados.rados.0.smithi084.stdout:356: read oid 39 snap 22 2024-01-13T18:01:43.171 INFO:tasks.rados.rados.0.smithi084.stdout:356: expect (ObjNum 61 snap 5 seq_num 61) 2024-01-13T18:01:43.171 INFO:tasks.rados.rados.0.smithi084.stdout:357: snap_create 2024-01-13T18:01:43.171 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 84 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-01-13T18:01:43.171 INFO:tasks.rados.rados.0.smithi084.stdout:352: expect (ObjNum 34 snap 0 seq_num 34) 2024-01-13T18:01:43.192 INFO:tasks.rados.rados.0.smithi084.stdout:353: expect (ObjNum 120 snap 29 seq_num 120) 2024-01-13T18:01:43.242 INFO:tasks.rados.rados.0.smithi084.stdout:355: expect (ObjNum 89 snap 16 seq_num 89) 2024-01-13T18:01:43.288 INFO:tasks.rados.rados.0.smithi084.stdout:356: expect (ObjNum 61 snap 5 seq_num 61) 2024-01-13T18:01:43.393 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:42 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:42.948+0000 7f68017521c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T18:01:43.393 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:43.033+0000 7f68017521c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T18:01:43.667 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[37908]: pgmap v4: 121 pgs: 7 active+clean+snaptrim, 114 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:43.667 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[37908]: [13/Jan/2024:18:01:42] ENGINE Bus STARTING 2024-01-13T18:01:43.667 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[37908]: [13/Jan/2024:18:01:42] ENGINE Serving on http://172.21.15.99:8765 2024-01-13T18:01:43.667 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[37908]: [13/Jan/2024:18:01:42] ENGINE Serving on https://172.21.15.99:7150 2024-01-13T18:01:43.667 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[37908]: [13/Jan/2024:18:01:42] ENGINE Bus STARTED 2024-01-13T18:01:43.667 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[37908]: osdmap e129: 8 total, 8 up, 8 in 2024-01-13T18:01:43.667 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:43.664+0000 7f68017521c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T18:01:43.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[52328]: pgmap v4: 121 pgs: 7 active+clean+snaptrim, 114 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:43.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[52328]: [13/Jan/2024:18:01:42] ENGINE Bus STARTING 2024-01-13T18:01:43.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[52328]: [13/Jan/2024:18:01:42] ENGINE Serving on http://172.21.15.99:8765 2024-01-13T18:01:43.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[52328]: [13/Jan/2024:18:01:42] ENGINE Serving on https://172.21.15.99:7150 2024-01-13T18:01:43.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[52328]: [13/Jan/2024:18:01:42] ENGINE Bus STARTED 2024-01-13T18:01:43.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-mon[52328]: osdmap e129: 8 total, 8 up, 8 in 2024-01-13T18:01:43.668 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T18:01:43.477Z caller=notify.go:743 level=info component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify success" attempts=7 2024-01-13T18:01:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:43 smithi099 ceph-mon[71325]: pgmap v4: 121 pgs: 7 active+clean+snaptrim, 114 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:43 smithi099 ceph-mon[71325]: [13/Jan/2024:18:01:42] ENGINE Bus STARTING 2024-01-13T18:01:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:43 smithi099 ceph-mon[71325]: [13/Jan/2024:18:01:42] ENGINE Serving on http://172.21.15.99:8765 2024-01-13T18:01:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:43 smithi099 ceph-mon[71325]: [13/Jan/2024:18:01:42] ENGINE Serving on https://172.21.15.99:7150 2024-01-13T18:01:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:43 smithi099 ceph-mon[71325]: [13/Jan/2024:18:01:42] ENGINE Bus STARTED 2024-01-13T18:01:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:43 smithi099 ceph-mon[71325]: osdmap e129: 8 total, 8 up, 8 in 2024-01-13T18:01:43.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:43.763+0000 7f68017521c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T18:01:43.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:43.861+0000 7f68017521c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T18:01:43.994 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:01:44.164 INFO:tasks.rados.rados.0.smithi084.stdout:351: done (5 left) 2024-01-13T18:01:44.164 INFO:tasks.rados.rados.0.smithi084.stdout:352: done (4 left) 2024-01-13T18:01:44.164 INFO:tasks.rados.rados.0.smithi084.stdout:353: done (3 left) 2024-01-13T18:01:44.164 INFO:tasks.rados.rados.0.smithi084.stdout:355: done (2 left) 2024-01-13T18:01:44.164 INFO:tasks.rados.rados.0.smithi084.stdout:356: done (1 left) 2024-01-13T18:01:44.164 INFO:tasks.rados.rados.0.smithi084.stdout:357: done (0 left) 2024-01-13T18:01:44.164 INFO:tasks.rados.rados.0.smithi084.stdout:358: delete oid 4 current snap is 31 2024-01-13T18:01:44.170 INFO:tasks.rados.rados.0.smithi084.stdout:358: done (0 left) 2024-01-13T18:01:44.170 INFO:tasks.rados.rados.0.smithi084.stdout:359: snap_create 2024-01-13T18:01:44.337 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:43.963+0000 7f68017521c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T18:01:44.337 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:44.208+0000 7f68017521c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T18:01:44.337 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:44.334+0000 7f68017521c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T18:01:44.343 INFO:tasks.rados.rados.0.smithi084.stdout:359: done (0 left) 2024-01-13T18:01:44.344 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 32 2024-01-13T18:01:44.344 INFO:tasks.rados.rados.0.smithi084.stdout:360: seq_num 125 ranges {778240=499712,1277952=745472,2023424=409600,2433024=450560} 2024-01-13T18:01:44.351 INFO:tasks.rados.rados.0.smithi084.stdout:360: writing smithi084102331-28 from 778240 to 1277952 tid 1 2024-01-13T18:01:44.354 INFO:tasks.rados.rados.0.smithi084.stdout:360: writing smithi084102331-28 from 1277952 to 2023424 tid 2 2024-01-13T18:01:44.357 INFO:tasks.rados.rados.0.smithi084.stdout:360: writing smithi084102331-28 from 2023424 to 2433024 tid 3 2024-01-13T18:01:44.361 INFO:tasks.rados.rados.0.smithi084.stdout:360: writing smithi084102331-28 from 2433024 to 2883584 tid 4 2024-01-13T18:01:44.361 INFO:tasks.rados.rados.0.smithi084.stdout:361: rollback oid 34 current snap is 32 2024-01-13T18:01:44.361 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 31 2024-01-13T18:01:44.361 INFO:tasks.rados.rados.0.smithi084.stdout:362: delete oid 8 current snap is 32 2024-01-13T18:01:44.366 INFO:tasks.rados.rados.0.smithi084.stdout:362: done (2 left) 2024-01-13T18:01:44.366 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 32 2024-01-13T18:01:44.366 INFO:tasks.rados.rados.0.smithi084.stdout:363: seq_num 127 ranges {1703936=532480,2236416=507904,2744320=778240,3522560=319488} 2024-01-13T18:01:44.378 INFO:tasks.rados.rados.0.smithi084.stdout:363: writing smithi084102331-47 from 1703936 to 2236416 tid 1 2024-01-13T18:01:44.384 INFO:tasks.rados.rados.0.smithi084.stdout:363: writing smithi084102331-47 from 2236416 to 2744320 tid 2 2024-01-13T18:01:44.385 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:01:44.385 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (2m) 112s ago 2m 17.3M - 0.25.0 c8568f914cd2 f4a66f0ea4ed 2024-01-13T18:01:44.385 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (2m) 7s ago 2m 91.4M - 9.4.7 954c08fa6188 8bf31d445aae 2024-01-13T18:01:44.385 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (3m) 112s ago 3m 13.7M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (3m) 7s ago 3m 18.1M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283 running (10s) 7s ago 5m 51.6M - 18.2.1-242-gd2f11f33 f16b14f4c75d d5726518d185 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:9283 running (6m) 112s ago 6m 495M - 17.2.7-268-g6441305d c3a232f785d8 051f8ff2f26d 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (7m) 112s ago 7m 82.9M 2048M 17.2.7-268-g6441305d c3a232f785d8 0eb2ed5f8766 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (5m) 7s ago 5m 61.7M 2048M 17.2.7-268-g6441305d c3a232f785d8 bf79d7793fc1 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (5m) 112s ago 5m 67.1M 2048M 17.2.7-268-g6441305d c3a232f785d8 510574f8be07 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (2m) 112s ago 2m 4106k - 1.5.0 0da6a335fe13 eaf6d03cde96 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (2m) 7s ago 2m 8766k - 1.5.0 0da6a335fe13 14e49e9d7852 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (5m) 112s ago 5m 63.3M 3000M 17.2.7-268-g6441305d c3a232f785d8 809287996fef 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (5m) 112s ago 5m 63.0M 3000M 17.2.7-268-g6441305d c3a232f785d8 fad77ee705d8 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (4m) 112s ago 4m 55.9M 3000M 17.2.7-268-g6441305d c3a232f785d8 14025770cf00 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (4m) 112s ago 4m 50.1M 3000M 17.2.7-268-g6441305d c3a232f785d8 068cf98fa99c 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (4m) 7s ago 4m 113M 3000M 17.2.7-268-g6441305d c3a232f785d8 30e0722550a0 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (4m) 7s ago 4m 104M 3000M 17.2.7-268-g6441305d c3a232f785d8 51be805dde78 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (3m) 7s ago 3m 93.1M 3000M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:01:44.386 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (3m) 7s ago 3m 89.7M 3000M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:01:44.387 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (117s) 7s ago 2m 48.5M - 2.43.0 a07b618ecd1d 79a2b67e3dcd 2024-01-13T18:01:44.388 INFO:tasks.rados.rados.0.smithi084.stdout:363: writing smithi084102331-47 from 2744320 to 3522560 tid 3 2024-01-13T18:01:44.390 INFO:tasks.rados.rados.0.smithi084.stdout:363: writing smithi084102331-47 from 3522560 to 3842048 tid 4 2024-01-13T18:01:44.390 INFO:tasks.rados.rados.0.smithi084.stdout:364: snap_create 2024-01-13T18:01:44.390 INFO:tasks.rados.rados.0.smithi084.stdout:361: finishing rollback tid 0 to smithi084102331-34 2024-01-13T18:01:44.390 INFO:tasks.rados.rados.0.smithi084.stdout:360: finishing write tid 1 to smithi084102331-28 2024-01-13T18:01:44.390 INFO:tasks.rados.rados.0.smithi084.stdout:360: finishing write tid 2 to smithi084102331-28 2024-01-13T18:01:44.391 INFO:tasks.rados.rados.0.smithi084.stdout:361: finishing rollback tid 1 to smithi084102331-34 2024-01-13T18:01:44.391 INFO:tasks.rados.rados.0.smithi084.stdout:363: finishing write tid 1 to smithi084102331-47 2024-01-13T18:01:44.391 INFO:tasks.rados.rados.0.smithi084.stdout:363: finishing write tid 2 to smithi084102331-47 2024-01-13T18:01:44.391 INFO:tasks.rados.rados.0.smithi084.stdout:361: finishing rollback tid 2 to smithi084102331-34 2024-01-13T18:01:44.391 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 82 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-01-13T18:01:44.391 INFO:tasks.rados.rados.0.smithi084.stdout:360: finishing write tid 3 to smithi084102331-28 2024-01-13T18:01:44.391 INFO:tasks.rados.rados.0.smithi084.stdout:360: finishing write tid 4 to smithi084102331-28 2024-01-13T18:01:44.391 INFO:tasks.rados.rados.0.smithi084.stdout:360: finishing write tid 5 to smithi084102331-28 2024-01-13T18:01:44.391 INFO:tasks.rados.rados.0.smithi084.stdout:360: finishing write tid 6 to smithi084102331-28 2024-01-13T18:01:44.391 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 77 (ObjNum 125 snap 32 seq_num 125) dirty exists 2024-01-13T18:01:44.391 INFO:tasks.rados.rados.0.smithi084.stdout:360: left oid 28 (ObjNum 125 snap 32 seq_num 125) 2024-01-13T18:01:44.392 INFO:tasks.rados.rados.0.smithi084.stdout:363: finishing write tid 3 to smithi084102331-47 2024-01-13T18:01:44.392 INFO:tasks.rados.rados.0.smithi084.stdout:363: finishing write tid 4 to smithi084102331-47 2024-01-13T18:01:44.393 INFO:tasks.rados.rados.0.smithi084.stdout:363: finishing write tid 5 to smithi084102331-47 2024-01-13T18:01:44.394 INFO:tasks.rados.rados.0.smithi084.stdout:363: finishing write tid 6 to smithi084102331-47 2024-01-13T18:01:44.394 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 134 (ObjNum 127 snap 32 seq_num 127) dirty exists 2024-01-13T18:01:44.394 INFO:tasks.rados.rados.0.smithi084.stdout:363: left oid 47 (ObjNum 127 snap 32 seq_num 127) 2024-01-13T18:01:44.606 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-mon[37908]: pgmap v6: 121 pgs: 7 active+clean+snaptrim, 114 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:44.606 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-mon[37908]: mgrmap e26: x(active, since 2s) 2024-01-13T18:01:44.606 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-mon[37908]: osdmap e130: 8 total, 8 up, 8 in 2024-01-13T18:01:44.606 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-mon[37908]: osdmap e131: 8 total, 8 up, 8 in 2024-01-13T18:01:44.607 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:44.603+0000 7f68017521c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T18:01:44.607 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-mon[52328]: pgmap v6: 121 pgs: 7 active+clean+snaptrim, 114 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:44.607 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-mon[52328]: mgrmap e26: x(active, since 2s) 2024-01-13T18:01:44.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-mon[52328]: osdmap e130: 8 total, 8 up, 8 in 2024-01-13T18:01:44.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-mon[52328]: osdmap e131: 8 total, 8 up, 8 in 2024-01-13T18:01:44.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:01:44] "GET /metrics HTTP/1.1" 200 33077 "" "Prometheus/2.43.0" 2024-01-13T18:01:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:44 smithi099 ceph-mon[71325]: pgmap v6: 121 pgs: 7 active+clean+snaptrim, 114 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:44 smithi099 ceph-mon[71325]: mgrmap e26: x(active, since 2s) 2024-01-13T18:01:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:44 smithi099 ceph-mon[71325]: osdmap e130: 8 total, 8 up, 8 in 2024-01-13T18:01:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:44 smithi099 ceph-mon[71325]: osdmap e131: 8 total, 8 up, 8 in 2024-01-13T18:01:44.823 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:01:44.823 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:01:44.823 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 3 2024-01-13T18:01:44.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:01:44.823 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 1 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 8 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 13, 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 1 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:01:44.824 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:01:44.900 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:44.704+0000 7f68017521c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T18:01:45.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:44.897+0000 7f68017521c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T18:01:45.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:44.983+0000 7f68017521c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T18:01:45.359 INFO:tasks.rados.rados.0.smithi084.stdout:360: done (3 left) 2024-01-13T18:01:45.359 INFO:tasks.rados.rados.0.smithi084.stdout:361: done (2 left) 2024-01-13T18:01:45.360 INFO:tasks.rados.rados.0.smithi084.stdout:363: done (1 left) 2024-01-13T18:01:45.360 INFO:tasks.rados.rados.0.smithi084.stdout:364: done (0 left) 2024-01-13T18:01:45.360 INFO:tasks.rados.rados.0.smithi084.stdout:365: read oid 45 snap -1 2024-01-13T18:01:45.360 INFO:tasks.rados.rados.0.smithi084.stdout:365: expect (ObjNum 107 snap 25 seq_num 107) 2024-01-13T18:01:45.360 INFO:tasks.rados.rados.0.smithi084.stdout:366: rmattr oid 18 current snap is 33 2024-01-13T18:01:45.360 INFO:tasks.rados.rados.0.smithi084.stdout:366: done (1 left) 2024-01-13T18:01:45.360 INFO:tasks.rados.rados.0.smithi084.stdout:367: read oid 28 snap -1 2024-01-13T18:01:45.360 INFO:tasks.rados.rados.0.smithi084.stdout:367: expect (ObjNum 125 snap 32 seq_num 125) 2024-01-13T18:01:45.360 INFO:tasks.rados.rados.0.smithi084.stdout:368: snap_create 2024-01-13T18:01:45.368 INFO:tasks.rados.rados.0.smithi084.stdout:365: expect (ObjNum 107 snap 25 seq_num 107) 2024-01-13T18:01:45.449 INFO:tasks.rados.rados.0.smithi084.stdout:367: expect (ObjNum 125 snap 32 seq_num 125) 2024-01-13T18:01:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:45 smithi084 ceph-mon[37908]: from='client.25031 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:45 smithi084 ceph-mon[37908]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:45 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/2270882493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:01:45.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:45 smithi084 ceph-mon[37908]: osdmap e132: 8 total, 8 up, 8 in 2024-01-13T18:01:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:45 smithi084 ceph-mon[52328]: from='client.25031 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:45 smithi084 ceph-mon[52328]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:45 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/2270882493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:01:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:45 smithi084 ceph-mon[52328]: osdmap e132: 8 total, 8 up, 8 in 2024-01-13T18:01:45.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:45 smithi099 ceph-mon[71325]: from='client.25031 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:45.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:45 smithi099 ceph-mon[71325]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:01:45.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:45 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/2270882493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:01:45.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:45 smithi099 ceph-mon[71325]: osdmap e132: 8 total, 8 up, 8 in 2024-01-13T18:01:46.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:45 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:45.799+0000 7f68017521c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T18:01:46.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:46.002+0000 7f68017521c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T18:01:46.357 INFO:tasks.rados.rados.0.smithi084.stdout:365: done (2 left) 2024-01-13T18:01:46.357 INFO:tasks.rados.rados.0.smithi084.stdout:367: done (1 left) 2024-01-13T18:01:46.357 INFO:tasks.rados.rados.0.smithi084.stdout:368: done (0 left) 2024-01-13T18:01:46.357 INFO:tasks.rados.rados.0.smithi084.stdout:369: read oid 10 snap -1 2024-01-13T18:01:46.357 INFO:tasks.rados.rados.0.smithi084.stdout:369: expect (ObjNum 81 snap 14 seq_num 81) 2024-01-13T18:01:46.357 INFO:tasks.rados.rados.0.smithi084.stdout:370: rollback oid 42 current snap is 34 2024-01-13T18:01:46.357 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 24 2024-01-13T18:01:46.357 INFO:tasks.rados.rados.0.smithi084.stdout:371: snap_remove snap 30 2024-01-13T18:01:46.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: pgmap v9: 121 pgs: 7 active+clean+snaptrim, 114 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:46.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: mgrmap e27: x(active, since 4s) 2024-01-13T18:01:46.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:46 smithi099 ceph-mon[71325]: osdmap e133: 8 total, 8 up, 8 in 2024-01-13T18:01:46.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:46.191+0000 7f68017521c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: pgmap v9: 121 pgs: 7 active+clean+snaptrim, 114 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: mgrmap e27: x(active, since 4s) 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[37908]: osdmap e133: 8 total, 8 up, 8 in 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: pgmap v9: 121 pgs: 7 active+clean+snaptrim, 114 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: mgrmap e27: x(active, since 4s) 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:46.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:46.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-mon[52328]: osdmap e133: 8 total, 8 up, 8 in 2024-01-13T18:01:47.161 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:46.796+0000 7f68017521c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T18:01:47.162 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:46.977+0000 7f68017521c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:01:47.357 INFO:tasks.rados.rados.0.smithi084.stdout:371: done (2 left) 2024-01-13T18:01:47.358 INFO:tasks.rados.rados.0.smithi084.stdout:372: setattr oid 49 current snap is 34 2024-01-13T18:01:47.358 INFO:tasks.rados.rados.0.smithi084.stdout:370: finishing rollback tid 0 to smithi084102331-42 2024-01-13T18:01:47.358 INFO:tasks.rados.rados.0.smithi084.stdout:370: finishing rollback tid 1 to smithi084102331-42 2024-01-13T18:01:47.358 INFO:tasks.rados.rados.0.smithi084.stdout:370: finishing rollback tid 2 to smithi084102331-42 2024-01-13T18:01:47.358 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 15 (ObjNum 93 snap 18 seq_num 93) dirty exists 2024-01-13T18:01:47.358 INFO:tasks.rados.rados.0.smithi084.stdout:369: expect (ObjNum 81 snap 14 seq_num 81) 2024-01-13T18:01:47.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:47.159+0000 7f68017521c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T18:01:47.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:47.276+0000 7f68017521c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T18:01:47.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:01:47] ENGINE Bus STARTING 2024-01-13T18:01:47.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: CherryPy Checker: 2024-01-13T18:01:47.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: The Application mounted at '' has an empty config. 2024-01-13T18:01:47.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: 2024-01-13T18:01:47.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:01:47] ENGINE Serving on http://:::9283 2024-01-13T18:01:47.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: [13/Jan/2024:18:01:47] ENGINE Bus STARTED 2024-01-13T18:01:47.548 INFO:tasks.rados.rados.0.smithi084.stdout:369: done (2 left) 2024-01-13T18:01:47.548 INFO:tasks.rados.rados.0.smithi084.stdout:370: done (1 left) 2024-01-13T18:01:47.548 INFO:tasks.rados.rados.0.smithi084.stdout:373: read oid 47 snap -1 2024-01-13T18:01:47.548 INFO:tasks.rados.rados.0.smithi084.stdout:373: expect (ObjNum 127 snap 32 seq_num 127) 2024-01-13T18:01:47.548 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 34 2024-01-13T18:01:47.548 INFO:tasks.rados.rados.0.smithi084.stdout:374: seq_num 128 ranges {2883584=548864,3432448=794624,4227072=581632,4808704=229376} 2024-01-13T18:01:47.569 INFO:tasks.rados.rados.0.smithi084.stdout:374: writing smithi084102331-28 from 2883584 to 3432448 tid 1 2024-01-13T18:01:47.573 INFO:tasks.rados.rados.0.smithi084.stdout:374: writing smithi084102331-28 from 3432448 to 4227072 tid 2 2024-01-13T18:01:47.577 INFO:tasks.rados.rados.0.smithi084.stdout:374: writing smithi084102331-28 from 4227072 to 4808704 tid 3 2024-01-13T18:01:47.578 INFO:tasks.rados.rados.0.smithi084.stdout:374: writing smithi084102331-28 from 4808704 to 5038080 tid 4 2024-01-13T18:01:47.579 INFO:tasks.rados.rados.0.smithi084.stdout:375: delete oid 27 current snap is 34 2024-01-13T18:01:47.579 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 103 (ObjNum 96 snap 19 seq_num 96) dirty exists 2024-01-13T18:01:47.579 INFO:tasks.rados.rados.0.smithi084.stdout:373: expect (ObjNum 127 snap 32 seq_num 127) 2024-01-13T18:01:47.701 INFO:tasks.rados.rados.0.smithi084.stdout:374: finishing write tid 1 to smithi084102331-28 2024-01-13T18:01:47.701 INFO:tasks.rados.rados.0.smithi084.stdout:374: finishing write tid 2 to smithi084102331-28 2024-01-13T18:01:47.701 INFO:tasks.rados.rados.0.smithi084.stdout:374: finishing write tid 3 to smithi084102331-28 2024-01-13T18:01:47.701 INFO:tasks.rados.rados.0.smithi084.stdout:374: finishing write tid 4 to smithi084102331-28 2024-01-13T18:01:47.701 INFO:tasks.rados.rados.0.smithi084.stdout:374: finishing write tid 5 to smithi084102331-28 2024-01-13T18:01:47.701 INFO:tasks.rados.rados.0.smithi084.stdout:374: finishing write tid 6 to smithi084102331-28 2024-01-13T18:01:47.702 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 85 (ObjNum 128 snap 34 seq_num 128) dirty exists 2024-01-13T18:01:47.702 INFO:tasks.rados.rados.0.smithi084.stdout:374: left oid 28 (ObjNum 128 snap 34 seq_num 128) 2024-01-13T18:01:47.702 INFO:tasks.rados.rados.0.smithi084.stdout:372: done (3 left) 2024-01-13T18:01:47.702 INFO:tasks.rados.rados.0.smithi084.stdout:373: done (2 left) 2024-01-13T18:01:47.702 INFO:tasks.rados.rados.0.smithi084.stdout:374: done (1 left) 2024-01-13T18:01:47.702 INFO:tasks.rados.rados.0.smithi084.stdout:375: done (0 left) 2024-01-13T18:01:47.702 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 34 2024-01-13T18:01:47.702 INFO:tasks.rados.rados.0.smithi084.stdout:376: seq_num 130 ranges {2072576=581632,2654208=614400,3268608=598016,3866624=393216} 2024-01-13T18:01:47.714 INFO:tasks.rados.rados.0.smithi084.stdout:376: writing smithi084102331-12 from 2072576 to 2654208 tid 1 2024-01-13T18:01:47.717 INFO:tasks.rados.rados.0.smithi084.stdout:376: writing smithi084102331-12 from 2654208 to 3268608 tid 2 2024-01-13T18:01:47.721 INFO:tasks.rados.rados.0.smithi084.stdout:376: writing smithi084102331-12 from 3268608 to 3866624 tid 3 2024-01-13T18:01:47.723 INFO:tasks.rados.rados.0.smithi084.stdout:376: writing smithi084102331-12 from 3866624 to 4259840 tid 4 2024-01-13T18:01:47.723 INFO:tasks.rados.rados.0.smithi084.stdout:377: read oid 41 snap -1 2024-01-13T18:01:47.723 INFO:tasks.rados.rados.0.smithi084.stdout:377: expect deleted 2024-01-13T18:01:47.723 INFO:tasks.rados.rados.0.smithi084.stdout:378: setattr oid 31 current snap is 34 2024-01-13T18:01:47.723 INFO:tasks.rados.rados.0.smithi084.stdout:376: finishing write tid 1 to smithi084102331-12 2024-01-13T18:01:47.723 INFO:tasks.rados.rados.0.smithi084.stdout:376: finishing write tid 2 to smithi084102331-12 2024-01-13T18:01:47.724 INFO:tasks.rados.rados.0.smithi084.stdout:376: finishing write tid 3 to smithi084102331-12 2024-01-13T18:01:47.725 INFO:tasks.rados.rados.0.smithi084.stdout:377: done (2 left) 2024-01-13T18:01:47.725 INFO:tasks.rados.rados.0.smithi084.stdout:379: read oid 28 snap 31 2024-01-13T18:01:47.725 INFO:tasks.rados.rados.0.smithi084.stdout:379: expect (ObjNum 46 snap 0 seq_num 46) 2024-01-13T18:01:47.725 INFO:tasks.rados.rados.0.smithi084.stdout:380: read oid 7 snap -1 2024-01-13T18:01:47.725 INFO:tasks.rados.rados.0.smithi084.stdout:380: expect (ObjNum 6 snap 0 seq_num 6) 2024-01-13T18:01:47.725 INFO:tasks.rados.rados.0.smithi084.stdout:381: copy_from oid 4 from oid 13 current snap is 34 2024-01-13T18:01:47.725 INFO:tasks.rados.rados.0.smithi084.stdout:382: snap_create 2024-01-13T18:01:47.726 INFO:tasks.rados.rados.0.smithi084.stdout:376: finishing write tid 4 to smithi084102331-12 2024-01-13T18:01:47.726 INFO:tasks.rados.rados.0.smithi084.stdout:376: finishing write tid 5 to smithi084102331-12 2024-01-13T18:01:47.727 INFO:tasks.rados.rados.0.smithi084.stdout:380: expect (ObjNum 6 snap 0 seq_num 6) 2024-01-13T18:01:47.730 INFO:tasks.rados.rados.0.smithi084.stdout:376: finishing write tid 6 to smithi084102331-12 2024-01-13T18:01:47.731 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 98 (ObjNum 130 snap 34 seq_num 130) dirty exists 2024-01-13T18:01:47.731 INFO:tasks.rados.rados.0.smithi084.stdout:376: left oid 12 (ObjNum 130 snap 34 seq_num 130) 2024-01-13T18:01:47.731 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 164 (ObjNum 114 snap 27 seq_num 114) dirty exists 2024-01-13T18:01:47.731 INFO:tasks.rados.rados.0.smithi084.stdout:379: expect (ObjNum 46 snap 0 seq_num 46) 2024-01-13T18:01:47.753 INFO:tasks.rados.rados.0.smithi084.stdout:381: finishing copy_from to smithi084102331-4 2024-01-13T18:01:47.753 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 53 (ObjNum 85 snap 15 seq_num 85) dirty exists 2024-01-13T18:01:47.753 INFO:tasks.rados.rados.0.smithi084.stdout:381: finishing copy_from racing read to smithi084102331-4 2024-01-13T18:01:47.829 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:47 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi084 to 2488M 2024-01-13T18:01:47.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:47 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:47 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:47 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:47 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:47 smithi099 ceph-mon[71325]: Standby manager daemon y started 2024-01-13T18:01:47.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:47 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-13T18:01:47.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:47 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:01:47.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:47 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-13T18:01:47.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:47 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:01:47.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:47 smithi099 ceph-mon[71325]: osdmap e134: 8 total, 8 up, 8 in 2024-01-13T18:01:47.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi084 to 2488M 2024-01-13T18:01:47.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[52328]: Standby manager daemon y started 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[52328]: osdmap e134: 8 total, 8 up, 8 in 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi084 to 2488M 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[37908]: Standby manager daemon y started 2024-01-13T18:01:47.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-13T18:01:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:01:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-13T18:01:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.84:0/4029380510' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:01:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:47 smithi084 ceph-mon[37908]: osdmap e134: 8 total, 8 up, 8 in 2024-01-13T18:01:48.485 INFO:tasks.rados.rados.0.smithi084.stdout:376: done (5 left) 2024-01-13T18:01:48.485 INFO:tasks.rados.rados.0.smithi084.stdout:378: done (4 left) 2024-01-13T18:01:48.485 INFO:tasks.rados.rados.0.smithi084.stdout:379: done (3 left) 2024-01-13T18:01:48.485 INFO:tasks.rados.rados.0.smithi084.stdout:380: done (2 left) 2024-01-13T18:01:48.486 INFO:tasks.rados.rados.0.smithi084.stdout:381: done (1 left) 2024-01-13T18:01:48.486 INFO:tasks.rados.rados.0.smithi084.stdout:382: done (0 left) 2024-01-13T18:01:48.486 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 35 2024-01-13T18:01:48.486 INFO:tasks.rados.rados.0.smithi084.stdout:383: seq_num 131 ranges {4259840=598016,4857856=499712,5357568=753664,6111232=352256} 2024-01-13T18:01:48.511 INFO:tasks.rados.rados.0.smithi084.stdout:383: writing smithi084102331-12 from 4259840 to 4857856 tid 1 2024-01-13T18:01:48.513 INFO:tasks.rados.rados.0.smithi084.stdout:383: writing smithi084102331-12 from 4857856 to 5357568 tid 2 2024-01-13T18:01:48.517 INFO:tasks.rados.rados.0.smithi084.stdout:383: writing smithi084102331-12 from 5357568 to 6111232 tid 3 2024-01-13T18:01:48.519 INFO:tasks.rados.rados.0.smithi084.stdout:383: writing smithi084102331-12 from 6111232 to 6463488 tid 4 2024-01-13T18:01:48.520 INFO:tasks.rados.rados.0.smithi084.stdout:384: read oid 9 snap -1 2024-01-13T18:01:48.520 INFO:tasks.rados.rados.0.smithi084.stdout:384: expect (ObjNum 92 snap 18 seq_num 92) 2024-01-13T18:01:48.520 INFO:tasks.rados.rados.0.smithi084.stdout:385: delete oid 44 current snap is 35 2024-01-13T18:01:48.520 INFO:tasks.rados.rados.0.smithi084.stdout:383: finishing write tid 1 to smithi084102331-12 2024-01-13T18:01:48.520 INFO:tasks.rados.rados.0.smithi084.stdout:383: finishing write tid 2 to smithi084102331-12 2024-01-13T18:01:48.522 INFO:tasks.rados.rados.0.smithi084.stdout:385: done (2 left) 2024-01-13T18:01:48.522 INFO:tasks.rados.rados.0.smithi084.stdout:386: rollback oid 26 current snap is 35 2024-01-13T18:01:48.522 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 33 2024-01-13T18:01:48.523 INFO:tasks.rados.rados.0.smithi084.stdout:387: read oid 46 snap -1 2024-01-13T18:01:48.523 INFO:tasks.rados.rados.0.smithi084.stdout:387: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:48.523 INFO:tasks.rados.rados.0.smithi084.stdout:388: setattr oid 25 current snap is 35 2024-01-13T18:01:48.524 INFO:tasks.rados.rados.0.smithi084.stdout:383: finishing write tid 3 to smithi084102331-12 2024-01-13T18:01:48.524 INFO:tasks.rados.rados.0.smithi084.stdout:383: finishing write tid 4 to smithi084102331-12 2024-01-13T18:01:48.525 INFO:tasks.rados.rados.0.smithi084.stdout:383: finishing write tid 5 to smithi084102331-12 2024-01-13T18:01:48.527 INFO:tasks.rados.rados.0.smithi084.stdout:389: read oid 35 snap -1 2024-01-13T18:01:48.528 INFO:tasks.rados.rados.0.smithi084.stdout:389: expect (ObjNum 34 snap 0 seq_num 34) 2024-01-13T18:01:48.528 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 35 2024-01-13T18:01:48.528 INFO:tasks.rados.rados.0.smithi084.stdout:390: seq_num 133 ranges {0=630784,630784=663552,1294336=770048,2064384=172032} 2024-01-13T18:01:48.532 INFO:tasks.rados.rados.0.smithi084.stdout:390: writing smithi084102331-24 from 0 to 630784 tid 1 2024-01-13T18:01:48.534 INFO:tasks.rados.rados.0.smithi084.stdout:390: writing smithi084102331-24 from 630784 to 1294336 tid 2 2024-01-13T18:01:48.538 INFO:tasks.rados.rados.0.smithi084.stdout:390: writing smithi084102331-24 from 1294336 to 2064384 tid 3 2024-01-13T18:01:48.539 INFO:tasks.rados.rados.0.smithi084.stdout:390: writing smithi084102331-24 from 2064384 to 2236416 tid 4 2024-01-13T18:01:48.539 INFO:tasks.rados.rados.0.smithi084.stdout:391: snap_remove snap 32 2024-01-13T18:01:48.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:48 smithi099 ceph-mon[71325]: pgmap v12: 121 pgs: 6 active+clean+snaptrim, 115 active+clean; 96 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.6 MiB/s rd, 514 KiB/s wr, 33 op/s 2024-01-13T18:01:48.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:48 smithi099 ceph-mon[71325]: mgrmap e28: x(active, since 6s), standbys: y 2024-01-13T18:01:48.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:48 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T18:01:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:48 smithi084 ceph-mon[37908]: pgmap v12: 121 pgs: 6 active+clean+snaptrim, 115 active+clean; 96 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.6 MiB/s rd, 514 KiB/s wr, 33 op/s 2024-01-13T18:01:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:48 smithi084 ceph-mon[37908]: mgrmap e28: x(active, since 6s), standbys: y 2024-01-13T18:01:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:48 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T18:01:48.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:48 smithi084 ceph-mon[52328]: pgmap v12: 121 pgs: 6 active+clean+snaptrim, 115 active+clean; 96 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.6 MiB/s rd, 514 KiB/s wr, 33 op/s 2024-01-13T18:01:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:48 smithi084 ceph-mon[52328]: mgrmap e28: x(active, since 6s), standbys: y 2024-01-13T18:01:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:48 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T18:01:49.493 INFO:tasks.rados.rados.0.smithi084.stdout:391: done (7 left) 2024-01-13T18:01:49.493 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 35 2024-01-13T18:01:49.493 INFO:tasks.rados.rados.0.smithi084.stdout:392: seq_num 134 ranges {0=647168,647168=548864,1196032=573440,1769472=483328} 2024-01-13T18:01:49.497 INFO:tasks.rados.rados.0.smithi084.stdout:392: writing smithi084102331-6 from 0 to 647168 tid 1 2024-01-13T18:01:49.504 INFO:tasks.rados.rados.0.smithi084.stdout:392: writing smithi084102331-6 from 647168 to 1196032 tid 2 2024-01-13T18:01:49.504 INFO:tasks.rados.rados.0.smithi084.stdout:392: writing smithi084102331-6 from 1196032 to 1769472 tid 3 2024-01-13T18:01:49.508 INFO:tasks.rados.rados.0.smithi084.stdout:392: writing smithi084102331-6 from 1769472 to 2252800 tid 4 2024-01-13T18:01:49.509 INFO:tasks.rados.rados.0.smithi084.stdout:393: setattr oid 27 current snap is 35 2024-01-13T18:01:49.509 INFO:tasks.rados.rados.0.smithi084.stdout:394: snap_create 2024-01-13T18:01:49.509 INFO:tasks.rados.rados.0.smithi084.stdout:383: finishing write tid 6 to smithi084102331-12 2024-01-13T18:01:49.509 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 104 (ObjNum 131 snap 35 seq_num 131) dirty exists 2024-01-13T18:01:49.509 INFO:tasks.rados.rados.0.smithi084.stdout:383: left oid 12 (ObjNum 131 snap 35 seq_num 131) 2024-01-13T18:01:49.509 INFO:tasks.rados.rados.0.smithi084.stdout:386: finishing rollback tid 0 to smithi084102331-26 2024-01-13T18:01:49.510 INFO:tasks.rados.rados.0.smithi084.stdout:386: finishing rollback tid 1 to smithi084102331-26 2024-01-13T18:01:49.510 INFO:tasks.rados.rados.0.smithi084.stdout:386: finishing rollback tid 2 to smithi084102331-26 2024-01-13T18:01:49.510 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 107 (ObjNum 118 snap 29 seq_num 118) dirty exists 2024-01-13T18:01:49.510 INFO:tasks.rados.rados.0.smithi084.stdout:387: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:49.533 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 100 (ObjNum 116 snap 28 seq_num 116) dirty exists 2024-01-13T18:01:49.533 INFO:tasks.rados.rados.0.smithi084.stdout:389: expect (ObjNum 34 snap 0 seq_num 34) 2024-01-13T18:01:49.551 INFO:tasks.rados.rados.0.smithi084.stdout:384: expect (ObjNum 92 snap 18 seq_num 92) 2024-01-13T18:01:49.663 INFO:tasks.rados.rados.0.smithi084.stdout:390: finishing write tid 1 to smithi084102331-24 2024-01-13T18:01:49.663 INFO:tasks.rados.rados.0.smithi084.stdout:390: finishing write tid 2 to smithi084102331-24 2024-01-13T18:01:49.664 INFO:tasks.rados.rados.0.smithi084.stdout:390: finishing write tid 3 to smithi084102331-24 2024-01-13T18:01:49.664 INFO:tasks.rados.rados.0.smithi084.stdout:390: finishing write tid 4 to smithi084102331-24 2024-01-13T18:01:49.664 INFO:tasks.rados.rados.0.smithi084.stdout:390: finishing write tid 5 to smithi084102331-24 2024-01-13T18:01:49.664 INFO:tasks.rados.rados.0.smithi084.stdout:390: finishing write tid 6 to smithi084102331-24 2024-01-13T18:01:49.664 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 51 (ObjNum 133 snap 35 seq_num 133) dirty exists 2024-01-13T18:01:49.664 INFO:tasks.rados.rados.0.smithi084.stdout:390: left oid 24 (ObjNum 133 snap 35 seq_num 133) 2024-01-13T18:01:49.664 INFO:tasks.rados.rados.0.smithi084.stdout:392: finishing write tid 1 to smithi084102331-6 2024-01-13T18:01:49.664 INFO:tasks.rados.rados.0.smithi084.stdout:392: finishing write tid 2 to smithi084102331-6 2024-01-13T18:01:49.664 INFO:tasks.rados.rados.0.smithi084.stdout:392: finishing write tid 3 to smithi084102331-6 2024-01-13T18:01:49.664 INFO:tasks.rados.rados.0.smithi084.stdout:392: finishing write tid 4 to smithi084102331-6 2024-01-13T18:01:49.664 INFO:tasks.rados.rados.0.smithi084.stdout:392: finishing write tid 5 to smithi084102331-6 2024-01-13T18:01:49.665 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 92 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:01:49.665 INFO:tasks.rados.rados.0.smithi084.stdout:392: finishing write tid 6 to smithi084102331-6 2024-01-13T18:01:49.665 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 89 (ObjNum 134 snap 35 seq_num 134) dirty exists 2024-01-13T18:01:49.665 INFO:tasks.rados.rados.0.smithi084.stdout:392: left oid 6 (ObjNum 134 snap 35 seq_num 134) 2024-01-13T18:01:49.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:49 smithi099 ceph-mon[71325]: osdmap e135: 8 total, 8 up, 8 in 2024-01-13T18:01:49.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:49 smithi084 ceph-mon[37908]: osdmap e135: 8 total, 8 up, 8 in 2024-01-13T18:01:49.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:49 smithi084 ceph-mon[52328]: osdmap e135: 8 total, 8 up, 8 in 2024-01-13T18:01:50.509 INFO:tasks.rados.rados.0.smithi084.stdout:383: done (9 left) 2024-01-13T18:01:50.509 INFO:tasks.rados.rados.0.smithi084.stdout:384: done (8 left) 2024-01-13T18:01:50.510 INFO:tasks.rados.rados.0.smithi084.stdout:386: done (7 left) 2024-01-13T18:01:50.510 INFO:tasks.rados.rados.0.smithi084.stdout:387: done (6 left) 2024-01-13T18:01:50.510 INFO:tasks.rados.rados.0.smithi084.stdout:388: done (5 left) 2024-01-13T18:01:50.510 INFO:tasks.rados.rados.0.smithi084.stdout:389: done (4 left) 2024-01-13T18:01:50.510 INFO:tasks.rados.rados.0.smithi084.stdout:390: done (3 left) 2024-01-13T18:01:50.510 INFO:tasks.rados.rados.0.smithi084.stdout:392: done (2 left) 2024-01-13T18:01:50.510 INFO:tasks.rados.rados.0.smithi084.stdout:393: done (1 left) 2024-01-13T18:01:50.510 INFO:tasks.rados.rados.0.smithi084.stdout:394: done (0 left) 2024-01-13T18:01:50.510 INFO:tasks.rados.rados.0.smithi084.stdout:395: snap_create 2024-01-13T18:01:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: pgmap v15: 121 pgs: 121 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.0 MiB/s wr, 40 op/s 2024-01-13T18:01:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: osdmap e136: 8 total, 8 up, 8 in 2024-01-13T18:01:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: Adjusting osd_memory_target on smithi099 to 2488M 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:01:50.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:50 smithi099 ceph-mon[71325]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:01:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: pgmap v15: 121 pgs: 121 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.0 MiB/s wr, 40 op/s 2024-01-13T18:01:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: osdmap e136: 8 total, 8 up, 8 in 2024-01-13T18:01:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: Adjusting osd_memory_target on smithi099 to 2488M 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:01:50.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[37908]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: pgmap v15: 121 pgs: 121 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.0 MiB/s wr, 40 op/s 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: osdmap e136: 8 total, 8 up, 8 in 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-13T18:01:50.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: Adjusting osd_memory_target on smithi099 to 2488M 2024-01-13T18:01:50.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:50.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:01:50.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:01:50.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T18:01:50.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T18:01:50.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:01:50.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:50 smithi084 ceph-mon[52328]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:01:51.509 INFO:tasks.rados.rados.0.smithi084.stdout:395: done (0 left) 2024-01-13T18:01:51.509 INFO:tasks.rados.rados.0.smithi084.stdout:396: setattr oid 4 current snap is 37 2024-01-13T18:01:51.510 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 37 2024-01-13T18:01:51.510 INFO:tasks.rados.rados.0.smithi084.stdout:397: seq_num 135 ranges {1875968=663552,2539520=434176,2973696=786432,3760128=385024} 2024-01-13T18:01:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:397: writing smithi084102331-14 from 1875968 to 2539520 tid 1 2024-01-13T18:01:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:397: writing smithi084102331-14 from 2539520 to 2973696 tid 2 2024-01-13T18:01:51.531 INFO:tasks.rados.rados.0.smithi084.stdout:397: writing smithi084102331-14 from 2973696 to 3760128 tid 3 2024-01-13T18:01:51.534 INFO:tasks.rados.rados.0.smithi084.stdout:397: writing smithi084102331-14 from 3760128 to 4145152 tid 4 2024-01-13T18:01:51.534 INFO:tasks.rados.rados.0.smithi084.stdout:398: read oid 16 snap 22 2024-01-13T18:01:51.534 INFO:tasks.rados.rados.0.smithi084.stdout:398: expect (ObjNum 103 snap 20 seq_num 103) 2024-01-13T18:01:51.534 INFO:tasks.rados.rados.0.smithi084.stdout:399: rmattr oid 10 current snap is 37 2024-01-13T18:01:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:399: done (3 left) 2024-01-13T18:01:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:400: copy_from oid 41 from oid 17 current snap is 37 2024-01-13T18:01:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 82 (ObjNum 85 snap 15 seq_num 85) dirty exists 2024-01-13T18:01:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:397: finishing write tid 1 to smithi084102331-14 2024-01-13T18:01:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:397: finishing write tid 2 to smithi084102331-14 2024-01-13T18:01:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:396: done (3 left) 2024-01-13T18:01:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:401: delete oid 22 current snap is 37 2024-01-13T18:01:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:397: finishing write tid 3 to smithi084102331-14 2024-01-13T18:01:51.536 INFO:tasks.rados.rados.0.smithi084.stdout:397: finishing write tid 4 to smithi084102331-14 2024-01-13T18:01:51.536 INFO:tasks.rados.rados.0.smithi084.stdout:397: finishing write tid 5 to smithi084102331-14 2024-01-13T18:01:51.538 INFO:tasks.rados.rados.0.smithi084.stdout:401: done (3 left) 2024-01-13T18:01:51.538 INFO:tasks.rados.rados.0.smithi084.stdout:402: rmattr oid 28 current snap is 37 2024-01-13T18:01:51.538 INFO:tasks.rados.rados.0.smithi084.stdout:403: rollback oid 31 current snap is 37 2024-01-13T18:01:51.539 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 36 2024-01-13T18:01:51.539 INFO:tasks.rados.rados.0.smithi084.stdout:404: copy_from oid 19 from oid 46 current snap is 37 2024-01-13T18:01:51.539 INFO:tasks.rados.rados.0.smithi084.stdout:405: read oid 45 snap -1 2024-01-13T18:01:51.539 INFO:tasks.rados.rados.0.smithi084.stdout:405: expect (ObjNum 107 snap 25 seq_num 107) 2024-01-13T18:01:51.539 INFO:tasks.rados.rados.0.smithi084.stdout:406: snap_remove snap 35 2024-01-13T18:01:51.801 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: osdmap e137: 8 total, 8 up, 8 in 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: Reconfiguring alertmanager.a (dependencies changed)... 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[37908]: Reconfiguring daemon alertmanager.a on smithi084 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: osdmap e137: 8 total, 8 up, 8 in 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.803 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.804 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.804 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.804 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.804 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: Reconfiguring alertmanager.a (dependencies changed)... 2024-01-13T18:01:51.804 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:51 smithi084 ceph-mon[52328]: Reconfiguring daemon alertmanager.a on smithi084 2024-01-13T18:01:51.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: osdmap e137: 8 total, 8 up, 8 in 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:51.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: Reconfiguring alertmanager.a (dependencies changed)... 2024-01-13T18:01:51.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:51 smithi099 ceph-mon[71325]: Reconfiguring daemon alertmanager.a on smithi084 2024-01-13T18:01:52.428 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:52 smithi084 systemd[1]: Stopping Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:01:52.522 INFO:tasks.rados.rados.0.smithi084.stdout:406: done (7 left) 2024-01-13T18:01:52.522 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 37 2024-01-13T18:01:52.522 INFO:tasks.rados.rados.0.smithi084.stdout:407: seq_num 137 ranges {663552=704512,1368064=655360,2023424=753664,2777088=196608} 2024-01-13T18:01:52.530 INFO:tasks.rados.rados.0.smithi084.stdout:407: writing smithi084102331-34 from 663552 to 1368064 tid 1 2024-01-13T18:01:52.534 INFO:tasks.rados.rados.0.smithi084.stdout:407: writing smithi084102331-34 from 1368064 to 2023424 tid 2 2024-01-13T18:01:52.538 INFO:tasks.rados.rados.0.smithi084.stdout:407: writing smithi084102331-34 from 2023424 to 2777088 tid 3 2024-01-13T18:01:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:407: writing smithi084102331-34 from 2777088 to 2973696 tid 4 2024-01-13T18:01:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:408: delete oid 8 current snap is 37 2024-01-13T18:01:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:397: finishing write tid 6 to smithi084102331-14 2024-01-13T18:01:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 117 (ObjNum 135 snap 37 seq_num 135) dirty exists 2024-01-13T18:01:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:397: left oid 14 (ObjNum 135 snap 37 seq_num 135) 2024-01-13T18:01:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:400: finishing copy_from to smithi084102331-41 2024-01-13T18:01:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 59 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-01-13T18:01:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:400: finishing copy_from racing read to smithi084102331-41 2024-01-13T18:01:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:403: finishing rollback tid 0 to smithi084102331-31 2024-01-13T18:01:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:403: finishing rollback tid 1 to smithi084102331-31 2024-01-13T18:01:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:403: finishing rollback tid 2 to smithi084102331-31 2024-01-13T18:01:52.541 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 170 (ObjNum 114 snap 27 seq_num 114) dirty exists 2024-01-13T18:01:52.541 INFO:tasks.rados.rados.0.smithi084.stdout:404: finishing copy_from to smithi084102331-19 2024-01-13T18:01:52.541 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 37 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:01:52.541 INFO:tasks.rados.rados.0.smithi084.stdout:404: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:01:52.541 INFO:tasks.rados.rados.0.smithi084.stdout:405: expect (ObjNum 107 snap 25 seq_num 107) 2024-01-13T18:01:52.611 INFO:tasks.rados.rados.0.smithi084.stdout:398: expect (ObjNum 103 snap 20 seq_num 103) 2024-01-13T18:01:52.802 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 94 (ObjNum 128 snap 34 seq_num 128) dirty exists 2024-01-13T18:01:52.802 INFO:tasks.rados.rados.0.smithi084.stdout:407: finishing write tid 1 to smithi084102331-34 2024-01-13T18:01:52.802 INFO:tasks.rados.rados.0.smithi084.stdout:407: finishing write tid 2 to smithi084102331-34 2024-01-13T18:01:52.802 INFO:tasks.rados.rados.0.smithi084.stdout:397: done (8 left) 2024-01-13T18:01:52.802 INFO:tasks.rados.rados.0.smithi084.stdout:398: done (7 left) 2024-01-13T18:01:52.802 INFO:tasks.rados.rados.0.smithi084.stdout:400: done (6 left) 2024-01-13T18:01:52.802 INFO:tasks.rados.rados.0.smithi084.stdout:402: done (5 left) 2024-01-13T18:01:52.802 INFO:tasks.rados.rados.0.smithi084.stdout:403: done (4 left) 2024-01-13T18:01:52.802 INFO:tasks.rados.rados.0.smithi084.stdout:404: done (3 left) 2024-01-13T18:01:52.802 INFO:tasks.rados.rados.0.smithi084.stdout:405: done (2 left) 2024-01-13T18:01:52.802 INFO:tasks.rados.rados.0.smithi084.stdout:408: done (1 left) 2024-01-13T18:01:52.803 INFO:tasks.rados.rados.0.smithi084.stdout:409: snap_create 2024-01-13T18:01:52.803 INFO:tasks.rados.rados.0.smithi084.stdout:407: finishing write tid 3 to smithi084102331-34 2024-01-13T18:01:52.803 INFO:tasks.rados.rados.0.smithi084.stdout:407: finishing write tid 4 to smithi084102331-34 2024-01-13T18:01:52.803 INFO:tasks.rados.rados.0.smithi084.stdout:407: finishing write tid 5 to smithi084102331-34 2024-01-13T18:01:52.803 INFO:tasks.rados.rados.0.smithi084.stdout:407: finishing write tid 6 to smithi084102331-34 2024-01-13T18:01:52.803 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 95 (ObjNum 137 snap 37 seq_num 137) dirty exists 2024-01-13T18:01:52.803 INFO:tasks.rados.rados.0.smithi084.stdout:407: left oid 34 (ObjNum 137 snap 37 seq_num 137) 2024-01-13T18:01:52.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:52 smithi099 ceph-mon[71325]: pgmap v18: 121 pgs: 121 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.6 MiB/s rd, 522 KiB/s wr, 6 op/s 2024-01-13T18:01:52.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:52 smithi099 ceph-mon[71325]: osdmap e138: 8 total, 8 up, 8 in 2024-01-13T18:01:52.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:52 smithi084 ceph-mon[52328]: pgmap v18: 121 pgs: 121 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.6 MiB/s rd, 522 KiB/s wr, 6 op/s 2024-01-13T18:01:52.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:52 smithi084 ceph-mon[52328]: osdmap e138: 8 total, 8 up, 8 in 2024-01-13T18:01:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:52 smithi084 ceph-mon[37908]: pgmap v18: 121 pgs: 121 active+clean; 94 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.6 MiB/s rd, 522 KiB/s wr, 6 op/s 2024-01-13T18:01:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:52 smithi084 ceph-mon[37908]: osdmap e138: 8 total, 8 up, 8 in 2024-01-13T18:01:52.929 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:52 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[98857]: ts=2024-01-13T18:01:52.510Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-01-13T18:01:52.929 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:52 smithi084 bash[105016]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a 2024-01-13T18:01:53.244 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:52 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@alertmanager.a.service: Succeeded. 2024-01-13T18:01:53.244 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:52 smithi084 systemd[1]: Stopped Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:01:53.244 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:52 smithi084 systemd[1]: Starting Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:01:53.529 INFO:tasks.rados.rados.0.smithi084.stdout:407: done (1 left) 2024-01-13T18:01:53.529 INFO:tasks.rados.rados.0.smithi084.stdout:409: done (0 left) 2024-01-13T18:01:53.529 INFO:tasks.rados.rados.0.smithi084.stdout:410: snap_create 2024-01-13T18:01:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-mon[37908]: osdmap e139: 8 total, 8 up, 8 in 2024-01-13T18:01:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-mon[52328]: osdmap e139: 8 total, 8 up, 8 in 2024-01-13T18:01:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:53.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:01:53.331Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-01-13T18:01:53.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:01:53.331Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-01-13T18:01:53.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:01:53.332Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.84 port=9094 2024-01-13T18:01:53.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:01:53.333Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-01-13T18:01:53.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:53 smithi084 bash[105134]: a5cbc3e01ffb92f28355a8fbe910016db2b80a83950552506027ed738e93d039 2024-01-13T18:01:53.680 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:53 smithi084 systemd[1]: Started Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:01:53.680 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:01:53.357Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-01-13T18:01:53.680 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:01:53.357Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-01-13T18:01:53.680 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:01:53.360Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-01-13T18:01:53.680 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:53 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:01:53.360Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-01-13T18:01:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:53 smithi099 ceph-mon[71325]: osdmap e139: 8 total, 8 up, 8 in 2024-01-13T18:01:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:53 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:53 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:53.957 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:53 smithi084 systemd[1]: Stopping Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:01:54.236 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 bash[105313]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a 2024-01-13T18:01:54.236 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-01-13T18:01:54.239 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-01-13T18:01:54.351 INFO:tasks.rados.rados.0.smithi084.stdout:410: done (0 left) 2024-01-13T18:01:54.351 INFO:tasks.rados.rados.0.smithi084.stdout:411: snap_remove snap 37 2024-01-13T18:01:54.526 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 systemd[1]: Stopped Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:01:54.526 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 systemd[1]: Starting Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:01:54.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:01:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:01:54] "GET /metrics HTTP/1.1" 200 33077 "" "Prometheus/2.43.0" 2024-01-13T18:01:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:54 smithi099 ceph-mon[71325]: pgmap v21: 121 pgs: 121 active+clean; 109 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 3.8 MiB/s wr, 47 op/s 2024-01-13T18:01:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:54 smithi099 ceph-mon[71325]: Reconfiguring node-exporter.a (dependencies changed)... 2024-01-13T18:01:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:54 smithi099 ceph-mon[71325]: Reconfiguring daemon node-exporter.a on smithi084 2024-01-13T18:01:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:54 smithi099 ceph-mon[71325]: osdmap e140: 8 total, 8 up, 8 in 2024-01-13T18:01:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:54 smithi099 ceph-mon[71325]: osdmap e141: 8 total, 8 up, 8 in 2024-01-13T18:01:54.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-mon[52328]: pgmap v21: 121 pgs: 121 active+clean; 109 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 3.8 MiB/s wr, 47 op/s 2024-01-13T18:01:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-mon[52328]: Reconfiguring node-exporter.a (dependencies changed)... 2024-01-13T18:01:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-mon[52328]: Reconfiguring daemon node-exporter.a on smithi084 2024-01-13T18:01:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-mon[52328]: osdmap e140: 8 total, 8 up, 8 in 2024-01-13T18:01:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-mon[52328]: osdmap e141: 8 total, 8 up, 8 in 2024-01-13T18:01:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-mon[37908]: pgmap v21: 121 pgs: 121 active+clean; 109 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 3.8 MiB/s wr, 47 op/s 2024-01-13T18:01:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-mon[37908]: Reconfiguring node-exporter.a (dependencies changed)... 2024-01-13T18:01:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-mon[37908]: Reconfiguring daemon node-exporter.a on smithi084 2024-01-13T18:01:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-mon[37908]: osdmap e140: 8 total, 8 up, 8 in 2024-01-13T18:01:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-mon[37908]: osdmap e141: 8 total, 8 up, 8 in 2024-01-13T18:01:54.930 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.568Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-01-13T18:01:54.930 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.568Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-01-13T18:01:54.930 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-01-13T18:01:54.930 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-01-13T18:01:54.930 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-01-13T18:01:54.930 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=node_exporter.go:117 level=info collector=arp 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=node_exporter.go:117 level=info collector=bcache 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=node_exporter.go:117 level=info collector=bonding 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=node_exporter.go:117 level=info collector=btrfs 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=node_exporter.go:117 level=info collector=conntrack 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=node_exporter.go:117 level=info collector=cpu 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.569Z caller=node_exporter.go:117 level=info collector=diskstats 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=dmi 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=edac 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=entropy 2024-01-13T18:01:54.931 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=filefd 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=filesystem 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=hwmon 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=infiniband 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=ipvs 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=loadavg 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=mdadm 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=meminfo 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=netclass 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=netdev 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=netstat 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=nfs 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=nfsd 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=nvme 2024-01-13T18:01:54.932 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=os 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=pressure 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=rapl 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=schedstat 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=selinux 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=sockstat 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=softnet 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=stat 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=tapestats 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=textfile 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=time 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=uname 2024-01-13T18:01:54.933 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=vmstat 2024-01-13T18:01:54.934 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=xfs 2024-01-13T18:01:54.934 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=node_exporter.go:117 level=info collector=zfs 2024-01-13T18:01:54.934 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-01-13T18:01:54.934 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[105455]: ts=2024-01-13T18:01:54.570Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-01-13T18:01:54.934 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 bash[105440]: b72e6d50f165ad63e96d2dcdff55f6a013e921b7fd09927902bb09bba0bfffe8 2024-01-13T18:01:54.934 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:01:54 smithi084 systemd[1]: Started Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:01:55.355 INFO:tasks.rados.rados.0.smithi084.stdout:411: done (0 left) 2024-01-13T18:01:55.355 INFO:tasks.rados.rados.0.smithi084.stdout:412: read oid 21 snap -1 2024-01-13T18:01:55.355 INFO:tasks.rados.rados.0.smithi084.stdout:412: expect (ObjNum 41 snap 0 seq_num 41) 2024-01-13T18:01:55.355 INFO:tasks.rados.rados.0.smithi084.stdout:413: snap_remove snap 36 2024-01-13T18:01:55.626 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:01:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:01:55.334Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000712222s 2024-01-13T18:01:55.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:55 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:55 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:55 smithi084 ceph-mon[37908]: Reconfiguring prometheus.a (dependencies changed)... 2024-01-13T18:01:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:55 smithi084 ceph-mon[37908]: Reconfiguring daemon prometheus.a on smithi099 2024-01-13T18:01:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:55 smithi084 ceph-mon[37908]: osdmap e142: 8 total, 8 up, 8 in 2024-01-13T18:01:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:55 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:55 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:55 smithi084 ceph-mon[52328]: Reconfiguring prometheus.a (dependencies changed)... 2024-01-13T18:01:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:55 smithi084 ceph-mon[52328]: Reconfiguring daemon prometheus.a on smithi099 2024-01-13T18:01:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:55 smithi084 ceph-mon[52328]: osdmap e142: 8 total, 8 up, 8 in 2024-01-13T18:01:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:55 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:55 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:01:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:55 smithi099 ceph-mon[71325]: Reconfiguring prometheus.a (dependencies changed)... 2024-01-13T18:01:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:55 smithi099 ceph-mon[71325]: Reconfiguring daemon prometheus.a on smithi099 2024-01-13T18:01:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:55 smithi099 ceph-mon[71325]: osdmap e142: 8 total, 8 up, 8 in 2024-01-13T18:01:56.356 INFO:tasks.rados.rados.0.smithi084.stdout:413: done (1 left) 2024-01-13T18:01:56.356 INFO:tasks.rados.rados.0.smithi084.stdout:414: snap_remove snap 34 2024-01-13T18:01:56.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:01:56 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[38158]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:01:56] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-01-13T18:01:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:56 smithi084 ceph-mon[37908]: pgmap v24: 121 pgs: 121 active+clean; 109 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 3.8 MiB/s wr, 47 op/s 2024-01-13T18:01:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:56 smithi084 ceph-mon[37908]: osdmap e143: 8 total, 8 up, 8 in 2024-01-13T18:01:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:56 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:56 smithi084 ceph-mon[52328]: pgmap v24: 121 pgs: 121 active+clean; 109 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 3.8 MiB/s wr, 47 op/s 2024-01-13T18:01:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:56 smithi084 ceph-mon[52328]: osdmap e143: 8 total, 8 up, 8 in 2024-01-13T18:01:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:56 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:56 smithi099 ceph-mon[71325]: pgmap v24: 121 pgs: 121 active+clean; 109 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 3.8 MiB/s wr, 47 op/s 2024-01-13T18:01:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:56 smithi099 ceph-mon[71325]: osdmap e143: 8 total, 8 up, 8 in 2024-01-13T18:01:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:56 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:01:57.358 INFO:tasks.rados.rados.0.smithi084.stdout:414: done (1 left) 2024-01-13T18:01:57.358 INFO:tasks.rados.rados.0.smithi084.stdout:415: copy_from oid 40 from oid 22 current snap is 39 2024-01-13T18:01:57.358 INFO:tasks.rados.rados.0.smithi084.stdout:416: rollback oid 41 current snap is 39 2024-01-13T18:01:57.358 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 33 2024-01-13T18:01:57.358 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 39 2024-01-13T18:01:57.358 INFO:tasks.rados.rados.0.smithi084.stdout:417: seq_num 139 ranges {2949120=737280,3686400=425984,4112384=761856,4874240=417792} 2024-01-13T18:01:57.378 INFO:tasks.rados.rados.0.smithi084.stdout:417: writing smithi084102331-15 from 2949120 to 3686400 tid 1 2024-01-13T18:01:57.380 INFO:tasks.rados.rados.0.smithi084.stdout:417: writing smithi084102331-15 from 3686400 to 4112384 tid 2 2024-01-13T18:01:57.385 INFO:tasks.rados.rados.0.smithi084.stdout:417: writing smithi084102331-15 from 4112384 to 4874240 tid 3 2024-01-13T18:01:57.387 INFO:tasks.rados.rados.0.smithi084.stdout:417: writing smithi084102331-15 from 4874240 to 5292032 tid 4 2024-01-13T18:01:57.388 INFO:tasks.rados.rados.0.smithi084.stdout:418: snap_create 2024-01-13T18:01:57.388 INFO:tasks.rados.rados.0.smithi084.stdout:412: expect (ObjNum 41 snap 0 seq_num 41) 2024-01-13T18:01:57.409 INFO:tasks.rados.rados.0.smithi084.stdout:416: finishing rollback tid 0 to smithi084102331-41 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:416: finishing rollback tid 1 to smithi084102331-41 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 61 (ObjNum 49 snap 0 seq_num 1466462308) dirty dne 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:415: finishing copy_from to smithi084102331-40 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:415: got expected ENOENT (src dne) 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:415: finishing copy_from racing read to smithi084102331-40 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:417: finishing write tid 1 to smithi084102331-15 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:417: finishing write tid 2 to smithi084102331-15 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:417: finishing write tid 3 to smithi084102331-15 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:417: finishing write tid 4 to smithi084102331-15 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:417: finishing write tid 5 to smithi084102331-15 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:417: finishing write tid 6 to smithi084102331-15 2024-01-13T18:01:57.410 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 151 (ObjNum 139 snap 39 seq_num 139) dirty exists 2024-01-13T18:01:57.411 INFO:tasks.rados.rados.0.smithi084.stdout:417: left oid 15 (ObjNum 139 snap 39 seq_num 139) 2024-01-13T18:01:58.363 INFO:tasks.rados.rados.0.smithi084.stdout:412: done (4 left) 2024-01-13T18:01:58.363 INFO:tasks.rados.rados.0.smithi084.stdout:415: done (3 left) 2024-01-13T18:01:58.363 INFO:tasks.rados.rados.0.smithi084.stdout:416: done (2 left) 2024-01-13T18:01:58.363 INFO:tasks.rados.rados.0.smithi084.stdout:417: done (1 left) 2024-01-13T18:01:58.363 INFO:tasks.rados.rados.0.smithi084.stdout:418: done (0 left) 2024-01-13T18:01:58.363 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 40 2024-01-13T18:01:58.363 INFO:tasks.rados.rados.0.smithi084.stdout:419: seq_num 140 ranges {139264=753664,892928=704512,1597440=524288,2121728=376832} 2024-01-13T18:01:58.367 INFO:tasks.rados.rados.0.smithi084.stdout:419: writing smithi084102331-17 from 139264 to 892928 tid 1 2024-01-13T18:01:58.372 INFO:tasks.rados.rados.0.smithi084.stdout:419: writing smithi084102331-17 from 892928 to 1597440 tid 2 2024-01-13T18:01:58.375 INFO:tasks.rados.rados.0.smithi084.stdout:419: writing smithi084102331-17 from 1597440 to 2121728 tid 3 2024-01-13T18:01:58.378 INFO:tasks.rados.rados.0.smithi084.stdout:419: writing smithi084102331-17 from 2121728 to 2498560 tid 4 2024-01-13T18:01:58.378 INFO:tasks.rados.rados.0.smithi084.stdout:420: copy_from oid 28 from oid 42 current snap is 40 2024-01-13T18:01:58.378 INFO:tasks.rados.rados.0.smithi084.stdout:419: finishing write tid 1 to smithi084102331-17 2024-01-13T18:01:58.378 INFO:tasks.rados.rados.0.smithi084.stdout:419: finishing write tid 2 to smithi084102331-17 2024-01-13T18:01:58.378 INFO:tasks.rados.rados.0.smithi084.stdout:421: rollback oid 15 current snap is 40 2024-01-13T18:01:58.378 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 15 to 38 2024-01-13T18:01:58.378 INFO:tasks.rados.rados.0.smithi084.stdout:422: rollback oid 33 current snap is 40 2024-01-13T18:01:58.378 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 33 to 39 2024-01-13T18:01:58.378 INFO:tasks.rados.rados.0.smithi084.stdout:423: delete oid 46 current snap is 40 2024-01-13T18:01:58.378 INFO:tasks.rados.rados.0.smithi084.stdout:419: finishing write tid 3 to smithi084102331-17 2024-01-13T18:01:58.381 INFO:tasks.rados.rados.0.smithi084.stdout:423: done (4 left) 2024-01-13T18:01:58.381 INFO:tasks.rados.rados.0.smithi084.stdout:424: read oid 11 snap 22 2024-01-13T18:01:58.381 INFO:tasks.rados.rados.0.smithi084.stdout:424: expect deleted 2024-01-13T18:01:58.381 INFO:tasks.rados.rados.0.smithi084.stdout:425: read oid 19 snap -1 2024-01-13T18:01:58.381 INFO:tasks.rados.rados.0.smithi084.stdout:425: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:58.381 INFO:tasks.rados.rados.0.smithi084.stdout:426: rmattr oid 22 current snap is 40 2024-01-13T18:01:58.381 INFO:tasks.rados.rados.0.smithi084.stdout:426: done (6 left) 2024-01-13T18:01:58.381 INFO:tasks.rados.rados.0.smithi084.stdout:427: rmattr oid 29 current snap is 40 2024-01-13T18:01:58.381 INFO:tasks.rados.rados.0.smithi084.stdout:427: done (6 left) 2024-01-13T18:01:58.381 INFO:tasks.rados.rados.0.smithi084.stdout:428: delete oid 18 current snap is 40 2024-01-13T18:01:58.385 INFO:tasks.rados.rados.0.smithi084.stdout:419: finishing write tid 4 to smithi084102331-17 2024-01-13T18:01:58.385 INFO:tasks.rados.rados.0.smithi084.stdout:419: finishing write tid 5 to smithi084102331-17 2024-01-13T18:01:58.386 INFO:tasks.rados.rados.0.smithi084.stdout:421: finishing rollback tid 0 to smithi084102331-15 2024-01-13T18:01:58.386 INFO:tasks.rados.rados.0.smithi084.stdout:421: finishing rollback tid 1 to smithi084102331-15 2024-01-13T18:01:58.386 INFO:tasks.rados.rados.0.smithi084.stdout:421: finishing rollback tid 2 to smithi084102331-15 2024-01-13T18:01:58.386 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 155 (ObjNum 102 snap 19 seq_num 102) dirty exists 2024-01-13T18:01:58.386 INFO:tasks.rados.rados.0.smithi084.stdout:422: finishing rollback tid 0 to smithi084102331-33 2024-01-13T18:01:58.386 INFO:tasks.rados.rados.0.smithi084.stdout:421: done (6 left) 2024-01-13T18:01:58.386 INFO:tasks.rados.rados.0.smithi084.stdout:424: done (5 left) 2024-01-13T18:01:58.386 INFO:tasks.rados.rados.0.smithi084.stdout:428: done (4 left) 2024-01-13T18:01:58.386 INFO:tasks.rados.rados.0.smithi084.stdout:429: delete oid 4 current snap is 40 2024-01-13T18:01:58.386 INFO:tasks.rados.rados.0.smithi084.stdout:422: finishing rollback tid 1 to smithi084102331-33 2024-01-13T18:01:58.387 INFO:tasks.rados.rados.0.smithi084.stdout:422: finishing rollback tid 2 to smithi084102331-33 2024-01-13T18:01:58.387 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 108 (ObjNum 116 snap 28 seq_num 116) dirty exists 2024-01-13T18:01:58.389 INFO:tasks.rados.rados.0.smithi084.stdout:425: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:419: finishing write tid 6 to smithi084102331-17 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 94 (ObjNum 140 snap 40 seq_num 140) dirty exists 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:419: left oid 17 (ObjNum 140 snap 40 seq_num 140) 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:420: finishing copy_from to smithi084102331-28 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 15 (ObjNum 93 snap 18 seq_num 93) dirty exists 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:420: finishing copy_from racing read to smithi084102331-28 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:419: done (4 left) 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:420: done (3 left) 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:422: done (2 left) 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:425: done (1 left) 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:429: done (0 left) 2024-01-13T18:01:58.410 INFO:tasks.rados.rados.0.smithi084.stdout:430: rmattr oid 6 current snap is 40 2024-01-13T18:01:58.411 INFO:tasks.rados.rados.0.smithi084.stdout:430: done (0 left) 2024-01-13T18:01:58.411 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 40 2024-01-13T18:01:58.411 INFO:tasks.rados.rados.0.smithi084.stdout:431: seq_num 144 ranges {4145152=16384} 2024-01-13T18:01:58.432 INFO:tasks.rados.rados.0.smithi084.stdout:431: writing smithi084102331-14 from 4145152 to 4161536 tid 1 2024-01-13T18:01:58.432 INFO:tasks.rados.rados.0.smithi084.stdout:432: read oid 4 snap -1 2024-01-13T18:01:58.432 INFO:tasks.rados.rados.0.smithi084.stdout:432: expect deleted 2024-01-13T18:01:58.432 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 40 2024-01-13T18:01:58.432 INFO:tasks.rados.rados.0.smithi084.stdout:433: seq_num 145 ranges {827392=32768} 2024-01-13T18:01:58.436 INFO:tasks.rados.rados.0.smithi084.stdout:433: writing smithi084102331-50 from 827392 to 860160 tid 1 2024-01-13T18:01:58.436 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 40 2024-01-13T18:01:58.436 INFO:tasks.rados.rados.0.smithi084.stdout:434: seq_num 146 ranges {573440=49152} 2024-01-13T18:01:58.440 INFO:tasks.rados.rados.0.smithi084.stdout:434: writing smithi084102331-35 from 573440 to 622592 tid 1 2024-01-13T18:01:58.440 INFO:tasks.rados.rados.0.smithi084.stdout:435: snap_remove snap 22 2024-01-13T18:01:58.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:58 smithi099 ceph-mon[71325]: pgmap v27: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 564 KiB/s wr, 1 op/s 2024-01-13T18:01:58.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:58 smithi099 ceph-mon[71325]: osdmap e144: 8 total, 8 up, 8 in 2024-01-13T18:01:58.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:58 smithi084 ceph-mon[37908]: pgmap v27: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 564 KiB/s wr, 1 op/s 2024-01-13T18:01:58.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:58 smithi084 ceph-mon[37908]: osdmap e144: 8 total, 8 up, 8 in 2024-01-13T18:01:58.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:58 smithi084 ceph-mon[52328]: pgmap v27: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 564 KiB/s wr, 1 op/s 2024-01-13T18:01:58.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:58 smithi084 ceph-mon[52328]: osdmap e144: 8 total, 8 up, 8 in 2024-01-13T18:01:59.370 INFO:tasks.rados.rados.0.smithi084.stdout:435: done (4 left) 2024-01-13T18:01:59.370 INFO:tasks.rados.rados.0.smithi084.stdout:436: snap_create 2024-01-13T18:01:59.370 INFO:tasks.rados.rados.0.smithi084.stdout:431: finishing write tid 1 to smithi084102331-14 2024-01-13T18:01:59.370 INFO:tasks.rados.rados.0.smithi084.stdout:431: finishing write tid 2 to smithi084102331-14 2024-01-13T18:01:59.370 INFO:tasks.rados.rados.0.smithi084.stdout:431: finishing write tid 3 to smithi084102331-14 2024-01-13T18:01:59.370 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 128 (ObjNum 144 snap 40 seq_num 144) dirty exists 2024-01-13T18:01:59.370 INFO:tasks.rados.rados.0.smithi084.stdout:431: left oid 14 (ObjNum 144 snap 40 seq_num 144) 2024-01-13T18:01:59.370 INFO:tasks.rados.rados.0.smithi084.stdout:433: finishing write tid 1 to smithi084102331-50 2024-01-13T18:01:59.370 INFO:tasks.rados.rados.0.smithi084.stdout:433: finishing write tid 2 to smithi084102331-50 2024-01-13T18:01:59.370 INFO:tasks.rados.rados.0.smithi084.stdout:434: finishing write tid 1 to smithi084102331-35 2024-01-13T18:01:59.371 INFO:tasks.rados.rados.0.smithi084.stdout:434: finishing write tid 2 to smithi084102331-35 2024-01-13T18:01:59.371 INFO:tasks.rados.rados.0.smithi084.stdout:433: finishing write tid 3 to smithi084102331-50 2024-01-13T18:01:59.371 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 111 (ObjNum 145 snap 40 seq_num 145) dirty exists 2024-01-13T18:01:59.371 INFO:tasks.rados.rados.0.smithi084.stdout:433: left oid 50 (ObjNum 145 snap 40 seq_num 145) 2024-01-13T18:01:59.371 INFO:tasks.rados.rados.0.smithi084.stdout:434: finishing write tid 3 to smithi084102331-35 2024-01-13T18:01:59.371 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 91 (ObjNum 146 snap 40 seq_num 146) dirty exists 2024-01-13T18:01:59.371 INFO:tasks.rados.rados.0.smithi084.stdout:434: left oid 35 (ObjNum 146 snap 40 seq_num 146) 2024-01-13T18:01:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:01:59 smithi099 ceph-mon[71325]: osdmap e145: 8 total, 8 up, 8 in 2024-01-13T18:01:59.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:01:59 smithi084 ceph-mon[37908]: osdmap e145: 8 total, 8 up, 8 in 2024-01-13T18:01:59.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:01:59 smithi084 ceph-mon[52328]: osdmap e145: 8 total, 8 up, 8 in 2024-01-13T18:02:00.369 INFO:tasks.rados.rados.0.smithi084.stdout:431: done (4 left) 2024-01-13T18:02:00.369 INFO:tasks.rados.rados.0.smithi084.stdout:432: done (3 left) 2024-01-13T18:02:00.369 INFO:tasks.rados.rados.0.smithi084.stdout:433: done (2 left) 2024-01-13T18:02:00.369 INFO:tasks.rados.rados.0.smithi084.stdout:434: done (1 left) 2024-01-13T18:02:00.370 INFO:tasks.rados.rados.0.smithi084.stdout:436: done (0 left) 2024-01-13T18:02:00.370 INFO:tasks.rados.rados.0.smithi084.stdout:437: snap_remove snap 24 2024-01-13T18:02:00.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:00 smithi084 ceph-mon[37908]: pgmap v30: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 529 KiB/s rd, 564 KiB/s wr, 2 op/s 2024-01-13T18:02:00.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:00 smithi084 ceph-mon[37908]: osdmap e146: 8 total, 8 up, 8 in 2024-01-13T18:02:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:00 smithi084 ceph-mon[52328]: pgmap v30: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 529 KiB/s rd, 564 KiB/s wr, 2 op/s 2024-01-13T18:02:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:00 smithi084 ceph-mon[52328]: osdmap e146: 8 total, 8 up, 8 in 2024-01-13T18:02:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:00 smithi099 ceph-mon[71325]: pgmap v30: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 529 KiB/s rd, 564 KiB/s wr, 2 op/s 2024-01-13T18:02:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:00 smithi099 ceph-mon[71325]: osdmap e146: 8 total, 8 up, 8 in 2024-01-13T18:02:01.376 INFO:tasks.rados.rados.0.smithi084.stdout:437: done (0 left) 2024-01-13T18:02:01.376 INFO:tasks.rados.rados.0.smithi084.stdout:438: read oid 16 snap 39 2024-01-13T18:02:01.376 INFO:tasks.rados.rados.0.smithi084.stdout:438: expect (ObjNum 109 snap 27 seq_num 109) 2024-01-13T18:02:01.376 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 41 2024-01-13T18:02:01.376 INFO:tasks.rados.rados.0.smithi084.stdout:439: seq_num 147 ranges {2572288=65536} 2024-01-13T18:02:01.388 INFO:tasks.rados.rados.0.smithi084.stdout:439: writing smithi084102331-2 from 2572288 to 2637824 tid 1 2024-01-13T18:02:01.397 INFO:tasks.rados.rados.0.smithi084.stdout:440: setattr oid 49 current snap is 41 2024-01-13T18:02:01.398 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 41 2024-01-13T18:02:01.398 INFO:tasks.rados.rados.0.smithi084.stdout:441: seq_num 148 ranges {2359296=81920} 2024-01-13T18:02:01.406 INFO:tasks.rados.rados.0.smithi084.stdout:441: writing smithi084102331-45 from 2359296 to 2441216 tid 1 2024-01-13T18:02:01.406 INFO:tasks.rados.rados.0.smithi084.stdout:442: read oid 35 snap -1 2024-01-13T18:02:01.407 INFO:tasks.rados.rados.0.smithi084.stdout:442: expect (ObjNum 146 snap 40 seq_num 146) 2024-01-13T18:02:01.407 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 41 2024-01-13T18:02:01.407 INFO:tasks.rados.rados.0.smithi084.stdout:439: finishing write tid 1 to smithi084102331-2 2024-01-13T18:02:01.407 INFO:tasks.rados.rados.0.smithi084.stdout:443: seq_num 149 ranges {4259840=98304} 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:443: writing smithi084102331-25 from 4259840 to 4358144 tid 1 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:444: rmattr oid 10 current snap is 41 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:439: finishing write tid 2 to smithi084102331-2 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:439: finishing write tid 3 to smithi084102331-2 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 125 (ObjNum 147 snap 41 seq_num 147) dirty exists 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:439: left oid 2 (ObjNum 147 snap 41 seq_num 147) 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 142 (ObjNum 96 snap 19 seq_num 96) dirty exists 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:439: done (6 left) 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:440: done (5 left) 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:444: done (4 left) 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:445: read oid 43 snap -1 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:445: expect (ObjNum 100 snap 19 seq_num 100) 2024-01-13T18:02:01.431 INFO:tasks.rados.rados.0.smithi084.stdout:446: snap_remove snap 40 2024-01-13T18:02:01.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:01 smithi084 ceph-mon[37908]: osdmap e147: 8 total, 8 up, 8 in 2024-01-13T18:02:01.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:01 smithi084 ceph-mon[37908]: osdmap e148: 8 total, 8 up, 8 in 2024-01-13T18:02:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:01 smithi084 ceph-mon[52328]: osdmap e147: 8 total, 8 up, 8 in 2024-01-13T18:02:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:01 smithi084 ceph-mon[52328]: osdmap e148: 8 total, 8 up, 8 in 2024-01-13T18:02:01.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-mon[71325]: osdmap e147: 8 total, 8 up, 8 in 2024-01-13T18:02:01.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-mon[71325]: osdmap e148: 8 total, 8 up, 8 in 2024-01-13T18:02:01.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 systemd[1]: Stopping Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:02.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.957Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-01-13T18:02:02.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.958Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-01-13T18:02:02.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.958Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-01-13T18:02:02.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.958Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-01-13T18:02:02.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.958Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-01-13T18:02:02.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.958Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-01-13T18:02:02.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.958Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-01-13T18:02:02.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.958Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-01-13T18:02:02.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.958Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-01-13T18:02:02.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.959Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-01-13T18:02:02.370 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.959Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-01-13T18:02:02.370 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[110021]: ts=2024-01-13T18:02:01.959Z caller=main.go:1147 level=info msg="See you next time!" 2024-01-13T18:02:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:446: done (5 left) 2024-01-13T18:02:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:447: read oid 30 snap -1 2024-01-13T18:02:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:447: expect (ObjNum 91 snap 18 seq_num 91) 2024-01-13T18:02:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:448: delete oid 22 current snap is 41 2024-01-13T18:02:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:441: finishing write tid 1 to smithi084102331-45 2024-01-13T18:02:02.403 INFO:tasks.rados.rados.0.smithi084.stdout:441: finishing write tid 2 to smithi084102331-45 2024-01-13T18:02:02.403 INFO:tasks.rados.rados.0.smithi084.stdout:442: expect (ObjNum 146 snap 40 seq_num 146) 2024-01-13T18:02:02.432 INFO:tasks.rados.rados.0.smithi084.stdout:441: finishing write tid 3 to smithi084102331-45 2024-01-13T18:02:02.433 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 191 (ObjNum 148 snap 41 seq_num 148) dirty exists 2024-01-13T18:02:02.433 INFO:tasks.rados.rados.0.smithi084.stdout:441: left oid 45 (ObjNum 148 snap 41 seq_num 148) 2024-01-13T18:02:02.433 INFO:tasks.rados.rados.0.smithi084.stdout:438: expect (ObjNum 109 snap 27 seq_num 109) 2024-01-13T18:02:02.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:02 smithi099 ceph-mon[71325]: pgmap v33: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 529 KiB/s rd, 0 op/s 2024-01-13T18:02:02.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:02 smithi084 ceph-mon[37908]: pgmap v33: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 529 KiB/s rd, 0 op/s 2024-01-13T18:02:02.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:02 smithi084 ceph-mon[52328]: pgmap v33: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 529 KiB/s rd, 0 op/s 2024-01-13T18:02:02.729 INFO:tasks.rados.rados.0.smithi084.stdout:443: finishing write tid 1 to smithi084102331-25 2024-01-13T18:02:02.729 INFO:tasks.rados.rados.0.smithi084.stdout:443: finishing write tid 2 to smithi084102331-25 2024-01-13T18:02:02.729 INFO:tasks.rados.rados.0.smithi084.stdout:443: finishing write tid 3 to smithi084102331-25 2024-01-13T18:02:02.729 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 130 (ObjNum 149 snap 41 seq_num 149) dirty exists 2024-01-13T18:02:02.729 INFO:tasks.rados.rados.0.smithi084.stdout:443: left oid 25 (ObjNum 149 snap 41 seq_num 149) 2024-01-13T18:02:02.729 INFO:tasks.rados.rados.0.smithi084.stdout:445: expect (ObjNum 100 snap 19 seq_num 100) 2024-01-13T18:02:02.851 INFO:tasks.rados.rados.0.smithi084.stdout:447: expect (ObjNum 91 snap 18 seq_num 91) 2024-01-13T18:02:02.906 INFO:tasks.rados.rados.0.smithi084.stdout:438: done (6 left) 2024-01-13T18:02:02.907 INFO:tasks.rados.rados.0.smithi084.stdout:441: done (5 left) 2024-01-13T18:02:02.907 INFO:tasks.rados.rados.0.smithi084.stdout:442: done (4 left) 2024-01-13T18:02:02.907 INFO:tasks.rados.rados.0.smithi084.stdout:443: done (3 left) 2024-01-13T18:02:02.907 INFO:tasks.rados.rados.0.smithi084.stdout:445: done (2 left) 2024-01-13T18:02:02.908 INFO:tasks.rados.rados.0.smithi084.stdout:447: done (1 left) 2024-01-13T18:02:02.908 INFO:tasks.rados.rados.0.smithi084.stdout:448: done (0 left) 2024-01-13T18:02:02.908 INFO:tasks.rados.rados.0.smithi084.stdout:449: rollback oid 46 current snap is 41 2024-01-13T18:02:02.908 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 38 2024-01-13T18:02:02.908 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 41 2024-01-13T18:02:02.908 INFO:tasks.rados.rados.0.smithi084.stdout:450: seq_num 151 ranges {2424832=131072} 2024-01-13T18:02:02.921 INFO:tasks.rados.rados.0.smithi084.stdout:450: writing smithi084102331-49 from 2424832 to 2555904 tid 1 2024-01-13T18:02:02.921 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 41 2024-01-13T18:02:02.921 INFO:tasks.rados.rados.0.smithi084.stdout:449: finishing rollback tid 1 to smithi084102331-46 2024-01-13T18:02:02.921 INFO:tasks.rados.rados.0.smithi084.stdout:449: finishing rollback tid 2 to smithi084102331-46 2024-01-13T18:02:02.921 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 64 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:02:02.921 INFO:tasks.rados.rados.0.smithi084.stdout:451: seq_num 152 ranges {4300800=147456} 2024-01-13T18:02:02.945 INFO:tasks.rados.rados.0.smithi084.stdout:451: writing smithi084102331-10 from 4300800 to 4448256 tid 1 2024-01-13T18:02:02.945 INFO:tasks.rados.rados.0.smithi084.stdout:449: done (2 left) 2024-01-13T18:02:02.945 INFO:tasks.rados.rados.0.smithi084.stdout:452: rollback oid 31 current snap is 41 2024-01-13T18:02:02.945 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 38 2024-01-13T18:02:02.945 INFO:tasks.rados.rados.0.smithi084.stdout:450: finishing write tid 1 to smithi084102331-49 2024-01-13T18:02:02.945 INFO:tasks.rados.rados.0.smithi084.stdout:450: finishing write tid 2 to smithi084102331-49 2024-01-13T18:02:02.945 INFO:tasks.rados.rados.0.smithi084.stdout:450: finishing write tid 3 to smithi084102331-49 2024-01-13T18:02:02.946 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 146 (ObjNum 151 snap 41 seq_num 151) dirty exists 2024-01-13T18:02:02.946 INFO:tasks.rados.rados.0.smithi084.stdout:450: left oid 49 (ObjNum 151 snap 41 seq_num 151) 2024-01-13T18:02:02.946 INFO:tasks.rados.rados.0.smithi084.stdout:450: done (2 left) 2024-01-13T18:02:02.946 INFO:tasks.rados.rados.0.smithi084.stdout:453: read oid 39 snap -1 2024-01-13T18:02:02.946 INFO:tasks.rados.rados.0.smithi084.stdout:453: expect (ObjNum 61 snap 5 seq_num 61) 2024-01-13T18:02:02.946 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 41 2024-01-13T18:02:02.946 INFO:tasks.rados.rados.0.smithi084.stdout:454: seq_num 153 ranges {4259840=163840} 2024-01-13T18:02:02.968 INFO:tasks.rados.rados.0.smithi084.stdout:454: writing smithi084102331-33 from 4259840 to 4423680 tid 1 2024-01-13T18:02:02.969 INFO:tasks.rados.rados.0.smithi084.stdout:455: snap_create 2024-01-13T18:02:02.969 INFO:tasks.rados.rados.0.smithi084.stdout:452: finishing rollback tid 0 to smithi084102331-31 2024-01-13T18:02:02.969 INFO:tasks.rados.rados.0.smithi084.stdout:452: finishing rollback tid 1 to smithi084102331-31 2024-01-13T18:02:02.969 INFO:tasks.rados.rados.0.smithi084.stdout:452: finishing rollback tid 2 to smithi084102331-31 2024-01-13T18:02:02.969 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 197 (ObjNum 114 snap 27 seq_num 114) dirty exists 2024-01-13T18:02:02.969 INFO:tasks.rados.rados.0.smithi084.stdout:451: finishing write tid 1 to smithi084102331-10 2024-01-13T18:02:02.970 INFO:tasks.rados.rados.0.smithi084.stdout:451: finishing write tid 2 to smithi084102331-10 2024-01-13T18:02:02.971 INFO:tasks.rados.rados.0.smithi084.stdout:451: finishing write tid 3 to smithi084102331-10 2024-01-13T18:02:02.971 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 60 (ObjNum 152 snap 41 seq_num 152) dirty exists 2024-01-13T18:02:02.971 INFO:tasks.rados.rados.0.smithi084.stdout:451: left oid 10 (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:02:02.971 INFO:tasks.rados.rados.0.smithi084.stdout:453: expect (ObjNum 61 snap 5 seq_num 61) 2024-01-13T18:02:03.018 INFO:tasks.rados.rados.0.smithi084.stdout:454: finishing write tid 1 to smithi084102331-33 2024-01-13T18:02:03.018 INFO:tasks.rados.rados.0.smithi084.stdout:454: finishing write tid 2 to smithi084102331-33 2024-01-13T18:02:03.018 INFO:tasks.rados.rados.0.smithi084.stdout:454: finishing write tid 3 to smithi084102331-33 2024-01-13T18:02:03.018 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 134 (ObjNum 153 snap 41 seq_num 153) dirty exists 2024-01-13T18:02:03.018 INFO:tasks.rados.rados.0.smithi084.stdout:454: left oid 33 (ObjNum 153 snap 41 seq_num 153) 2024-01-13T18:02:03.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:02 smithi099 bash[123949]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a 2024-01-13T18:02:03.411 INFO:tasks.rados.rados.0.smithi084.stdout:451: done (4 left) 2024-01-13T18:02:03.411 INFO:tasks.rados.rados.0.smithi084.stdout:452: done (3 left) 2024-01-13T18:02:03.411 INFO:tasks.rados.rados.0.smithi084.stdout:453: done (2 left) 2024-01-13T18:02:03.411 INFO:tasks.rados.rados.0.smithi084.stdout:454: done (1 left) 2024-01-13T18:02:03.412 INFO:tasks.rados.rados.0.smithi084.stdout:455: done (0 left) 2024-01-13T18:02:03.412 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 42 2024-01-13T18:02:03.412 INFO:tasks.rados.rados.0.smithi084.stdout:456: seq_num 154 ranges {3497984=180224} 2024-01-13T18:02:03.431 INFO:tasks.rados.rados.0.smithi084.stdout:456: writing smithi084102331-23 from 3497984 to 3678208 tid 1 2024-01-13T18:02:03.431 INFO:tasks.rados.rados.0.smithi084.stdout:457: copy_from oid 26 from oid 22 current snap is 42 2024-01-13T18:02:03.431 INFO:tasks.rados.rados.0.smithi084.stdout:458: snap_create 2024-01-13T18:02:03.435 INFO:tasks.rados.rados.0.smithi084.stdout:457: finishing copy_from to smithi084102331-26 2024-01-13T18:02:03.435 INFO:tasks.rados.rados.0.smithi084.stdout:457: got expected ENOENT (src dne) 2024-01-13T18:02:03.435 INFO:tasks.rados.rados.0.smithi084.stdout:456: finishing write tid 1 to smithi084102331-23 2024-01-13T18:02:03.435 INFO:tasks.rados.rados.0.smithi084.stdout:457: finishing copy_from racing read to smithi084102331-26 2024-01-13T18:02:03.436 INFO:tasks.rados.rados.0.smithi084.stdout:456: finishing write tid 2 to smithi084102331-23 2024-01-13T18:02:03.437 INFO:tasks.rados.rados.0.smithi084.stdout:456: finishing write tid 3 to smithi084102331-23 2024-01-13T18:02:03.437 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 131 (ObjNum 154 snap 42 seq_num 154) dirty exists 2024-01-13T18:02:03.438 INFO:tasks.rados.rados.0.smithi084.stdout:456: left oid 23 (ObjNum 154 snap 42 seq_num 154) 2024-01-13T18:02:03.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:03 smithi084 ceph-mon[37908]: osdmap e149: 8 total, 8 up, 8 in 2024-01-13T18:02:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:03 smithi084 ceph-mon[52328]: osdmap e149: 8 total, 8 up, 8 in 2024-01-13T18:02:03.679 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:02:03 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:02:03.335Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002152824s 2024-01-13T18:02:03.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:03 smithi099 ceph-mon[71325]: osdmap e149: 8 total, 8 up, 8 in 2024-01-13T18:02:03.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:03 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@prometheus.a.service: Succeeded. 2024-01-13T18:02:03.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:03 smithi099 systemd[1]: Stopped Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:03.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:03 smithi099 systemd[1]: Starting Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:04.352 INFO:tasks.rados.rados.0.smithi084.stdout:456: done (2 left) 2024-01-13T18:02:04.352 INFO:tasks.rados.rados.0.smithi084.stdout:457: done (1 left) 2024-01-13T18:02:04.352 INFO:tasks.rados.rados.0.smithi084.stdout:458: done (0 left) 2024-01-13T18:02:04.352 INFO:tasks.rados.rados.0.smithi084.stdout:459: snap_create 2024-01-13T18:02:04.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:04 smithi084 ceph-mon[37908]: pgmap v36: 121 pgs: 121 active+clean; 107 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2024-01-13T18:02:04.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:04 smithi084 ceph-mon[37908]: osdmap e150: 8 total, 8 up, 8 in 2024-01-13T18:02:04.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:04 smithi084 ceph-mon[37908]: osdmap e151: 8 total, 8 up, 8 in 2024-01-13T18:02:04.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:04 smithi084 ceph-mon[52328]: pgmap v36: 121 pgs: 121 active+clean; 107 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2024-01-13T18:02:04.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:04 smithi084 ceph-mon[52328]: osdmap e150: 8 total, 8 up, 8 in 2024-01-13T18:02:04.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:04 smithi084 ceph-mon[52328]: osdmap e151: 8 total, 8 up, 8 in 2024-01-13T18:02:04.826 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:04 smithi099 ceph-mon[71325]: pgmap v36: 121 pgs: 121 active+clean; 107 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2024-01-13T18:02:04.826 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:04 smithi099 ceph-mon[71325]: osdmap e150: 8 total, 8 up, 8 in 2024-01-13T18:02:04.827 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:04 smithi099 ceph-mon[71325]: osdmap e151: 8 total, 8 up, 8 in 2024-01-13T18:02:05.351 INFO:tasks.rados.rados.0.smithi084.stdout:459: done (0 left) 2024-01-13T18:02:05.351 INFO:tasks.rados.rados.0.smithi084.stdout:460: delete oid 4 current snap is 44 2024-01-13T18:02:05.353 INFO:tasks.rados.rados.0.smithi084.stdout:460: done (0 left) 2024-01-13T18:02:05.353 INFO:tasks.rados.rados.0.smithi084.stdout:461: delete oid 15 current snap is 44 2024-01-13T18:02:05.355 INFO:tasks.rados.rados.0.smithi084.stdout:461: done (0 left) 2024-01-13T18:02:05.355 INFO:tasks.rados.rados.0.smithi084.stdout:462: snap_create 2024-01-13T18:02:05.549 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 bash[124068]: 786d3aae254bd1d5cdf8bebeafea3c86c93e10ee25c3b79143d818cc5a66b959 2024-01-13T18:02:05.549 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 systemd[1]: Started Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:05.549 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.130Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-01-13T18:02:05.549 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.130Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-01-13T18:02:05.549 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.130Z caller=main.go:570 level=info host_details="(Linux 4.18.0-532.el8.x86_64 #1 SMP Thu Dec 21 12:11:59 UTC 2023 x86_64 smithi099 (none))" 2024-01-13T18:02:05.549 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.130Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-01-13T18:02:05.549 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.130Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-01-13T18:02:05.549 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.133Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-01-13T18:02:05.549 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.134Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-01-13T18:02:05.549 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.134Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-01-13T18:02:05.549 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.134Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.137Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.139Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.019432ms 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.139Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.140Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.162Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.162Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.162Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=46.013µs wal_replay_duration=22.642431ms wbl_replay_duration=100ns total_replay_duration=24.749889ms 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.165Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.165Z caller=main.go:1029 level=info msg="TSDB started" 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.165Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.181Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=16.139921ms db_storage=963ns remote_storage=1.45µs web_handler=493ns query_engine=726ns scrape=508.73µs scrape_sd=82.865µs notify=17.636µs notify_sd=12.061µs rules=15.251422ms tracing=6.475µs 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.181Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-01-13T18:02:05.550 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:05.181Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-01-13T18:02:06.354 INFO:tasks.rados.rados.0.smithi084.stdout:462: done (0 left) 2024-01-13T18:02:06.354 INFO:tasks.rados.rados.0.smithi084.stdout:463: setattr oid 19 current snap is 45 2024-01-13T18:02:06.355 INFO:tasks.rados.rados.0.smithi084.stdout:464: rmattr oid 42 current snap is 45 2024-01-13T18:02:06.356 INFO:tasks.rados.rados.0.smithi084.stdout:464: done (1 left) 2024-01-13T18:02:06.356 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 45 2024-01-13T18:02:06.356 INFO:tasks.rados.rados.0.smithi084.stdout:465: seq_num 157 ranges {1671168=237568} 2024-01-13T18:02:06.366 INFO:tasks.rados.rados.0.smithi084.stdout:465: writing smithi084102331-39 from 1671168 to 1908736 tid 1 2024-01-13T18:02:06.366 INFO:tasks.rados.rados.0.smithi084.stdout:466: read oid 47 snap -1 2024-01-13T18:02:06.366 INFO:tasks.rados.rados.0.smithi084.stdout:466: expect (ObjNum 127 snap 32 seq_num 127) 2024-01-13T18:02:06.366 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 45 2024-01-13T18:02:06.367 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 83 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:02:06.367 INFO:tasks.rados.rados.0.smithi084.stdout:467: seq_num 158 ranges {0=253952} 2024-01-13T18:02:06.368 INFO:tasks.rados.rados.0.smithi084.stdout:467: writing smithi084102331-41 from 0 to 253952 tid 1 2024-01-13T18:02:06.368 INFO:tasks.rados.rados.0.smithi084.stdout:463: done (3 left) 2024-01-13T18:02:06.368 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 45 2024-01-13T18:02:06.368 INFO:tasks.rados.rados.0.smithi084.stdout:468: seq_num 159 ranges {3678208=270336} 2024-01-13T18:02:06.390 INFO:tasks.rados.rados.0.smithi084.stdout:468: writing smithi084102331-23 from 3678208 to 3948544 tid 1 2024-01-13T18:02:06.390 INFO:tasks.rados.rados.0.smithi084.stdout:469: read oid 30 snap -1 2024-01-13T18:02:06.390 INFO:tasks.rados.rados.0.smithi084.stdout:469: expect (ObjNum 91 snap 18 seq_num 91) 2024-01-13T18:02:06.390 INFO:tasks.rados.rados.0.smithi084.stdout:470: copy_from oid 11 from oid 2 current snap is 45 2024-01-13T18:02:06.390 INFO:tasks.rados.rados.0.smithi084.stdout:465: finishing write tid 1 to smithi084102331-39 2024-01-13T18:02:06.390 INFO:tasks.rados.rados.0.smithi084.stdout:465: finishing write tid 2 to smithi084102331-39 2024-01-13T18:02:06.390 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 45 2024-01-13T18:02:06.390 INFO:tasks.rados.rados.0.smithi084.stdout:467: finishing write tid 1 to smithi084102331-41 2024-01-13T18:02:06.390 INFO:tasks.rados.rados.0.smithi084.stdout:471: seq_num 160 ranges {2555904=286720} 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:471: writing smithi084102331-49 from 2555904 to 2842624 tid 1 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:472: delete oid 17 current snap is 45 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:465: finishing write tid 3 to smithi084102331-39 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 66 (ObjNum 157 snap 45 seq_num 157) dirty exists 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:465: left oid 39 (ObjNum 157 snap 45 seq_num 157) 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:467: finishing write tid 2 to smithi084102331-41 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:467: finishing write tid 3 to smithi084102331-41 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 68 (ObjNum 158 snap 45 seq_num 158) dirty exists 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:467: left oid 41 (ObjNum 158 snap 45 seq_num 158) 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:468: finishing write tid 1 to smithi084102331-23 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:468: finishing write tid 2 to smithi084102331-23 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:468: finishing write tid 3 to smithi084102331-23 2024-01-13T18:02:06.406 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 134 (ObjNum 159 snap 45 seq_num 159) dirty exists 2024-01-13T18:02:06.407 INFO:tasks.rados.rados.0.smithi084.stdout:468: left oid 23 (ObjNum 159 snap 45 seq_num 159) 2024-01-13T18:02:06.407 INFO:tasks.rados.rados.0.smithi084.stdout:466: expect (ObjNum 127 snap 32 seq_num 127) 2024-01-13T18:02:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[37908]: pgmap v39: 121 pgs: 121 active+clean; 107 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2024-01-13T18:02:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[37908]: Reconfiguring grafana.a (dependencies changed)... 2024-01-13T18:02:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[37908]: Reconfiguring daemon grafana.a on smithi099 2024-01-13T18:02:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[37908]: osdmap e152: 8 total, 8 up, 8 in 2024-01-13T18:02:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[52328]: pgmap v39: 121 pgs: 121 active+clean; 107 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2024-01-13T18:02:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[52328]: Reconfiguring grafana.a (dependencies changed)... 2024-01-13T18:02:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[52328]: Reconfiguring daemon grafana.a on smithi099 2024-01-13T18:02:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:06 smithi084 ceph-mon[52328]: osdmap e152: 8 total, 8 up, 8 in 2024-01-13T18:02:06.510 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:06 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:06.510 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:06 smithi099 ceph-mon[71325]: pgmap v39: 121 pgs: 121 active+clean; 107 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2024-01-13T18:02:06.510 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:06 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:06.510 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:06 smithi099 ceph-mon[71325]: Reconfiguring grafana.a (dependencies changed)... 2024-01-13T18:02:06.510 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:06 smithi099 ceph-mon[71325]: Reconfiguring daemon grafana.a on smithi099 2024-01-13T18:02:06.510 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:06 smithi099 ceph-mon[71325]: osdmap e152: 8 total, 8 up, 8 in 2024-01-13T18:02:06.527 INFO:tasks.rados.rados.0.smithi084.stdout:469: expect (ObjNum 91 snap 18 seq_num 91) 2024-01-13T18:02:06.583 INFO:tasks.rados.rados.0.smithi084.stdout:470: finishing copy_from to smithi084102331-11 2024-01-13T18:02:06.583 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 125 (ObjNum 147 snap 41 seq_num 147) dirty exists 2024-01-13T18:02:06.583 INFO:tasks.rados.rados.0.smithi084.stdout:470: finishing copy_from racing read to smithi084102331-11 2024-01-13T18:02:06.583 INFO:tasks.rados.rados.0.smithi084.stdout:465: done (7 left) 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:466: done (6 left) 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:467: done (5 left) 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:468: done (4 left) 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:469: done (3 left) 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:470: done (2 left) 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:472: done (1 left) 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 45 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:471: finishing write tid 1 to smithi084102331-49 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:471: finishing write tid 2 to smithi084102331-49 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:471: finishing write tid 3 to smithi084102331-49 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 149 (ObjNum 160 snap 45 seq_num 160) dirty exists 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:471: left oid 49 (ObjNum 160 snap 45 seq_num 160) 2024-01-13T18:02:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:473: seq_num 162 ranges {0=319488} 2024-01-13T18:02:06.585 INFO:tasks.rados.rados.0.smithi084.stdout:473: writing smithi084102331-38 from 0 to 319488 tid 1 2024-01-13T18:02:06.585 INFO:tasks.rados.rados.0.smithi084.stdout:471: done (1 left) 2024-01-13T18:02:06.585 INFO:tasks.rados.rados.0.smithi084.stdout:474: setattr oid 26 current snap is 45 2024-01-13T18:02:06.587 INFO:tasks.rados.rados.0.smithi084.stdout:473: finishing write tid 1 to smithi084102331-38 2024-01-13T18:02:06.587 INFO:tasks.rados.rados.0.smithi084.stdout:473: finishing write tid 2 to smithi084102331-38 2024-01-13T18:02:06.587 INFO:tasks.rados.rados.0.smithi084.stdout:475: delete oid 43 current snap is 45 2024-01-13T18:02:06.588 INFO:tasks.rados.rados.0.smithi084.stdout:473: finishing write tid 3 to smithi084102331-38 2024-01-13T18:02:06.588 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 199 (ObjNum 162 snap 45 seq_num 162) dirty exists 2024-01-13T18:02:06.588 INFO:tasks.rados.rados.0.smithi084.stdout:473: left oid 38 (ObjNum 162 snap 45 seq_num 162) 2024-01-13T18:02:06.590 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 151 (ObjNum 118 snap 29 seq_num 118) dirty exists 2024-01-13T18:02:06.590 INFO:tasks.rados.rados.0.smithi084.stdout:473: done (2 left) 2024-01-13T18:02:06.590 INFO:tasks.rados.rados.0.smithi084.stdout:474: done (1 left) 2024-01-13T18:02:06.591 INFO:tasks.rados.rados.0.smithi084.stdout:475: done (0 left) 2024-01-13T18:02:06.591 INFO:tasks.rados.rados.0.smithi084.stdout:476: snap_remove snap 38 2024-01-13T18:02:06.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:06 smithi099 systemd[1]: Stopping Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:07.295 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 bash[124372]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a 2024-01-13T18:02:07.295 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-01-13T18:02:07.364 INFO:tasks.rados.rados.0.smithi084.stdout:476: done (0 left) 2024-01-13T18:02:07.364 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 45 2024-01-13T18:02:07.364 INFO:tasks.rados.rados.0.smithi084.stdout:477: seq_num 164 ranges {2637824=352256} 2024-01-13T18:02:07.381 INFO:tasks.rados.rados.0.smithi084.stdout:477: writing smithi084102331-2 from 2637824 to 2990080 tid 1 2024-01-13T18:02:07.381 INFO:tasks.rados.rados.0.smithi084.stdout:478: snap_create 2024-01-13T18:02:07.384 INFO:tasks.rados.rados.0.smithi084.stdout:477: finishing write tid 1 to smithi084102331-2 2024-01-13T18:02:07.384 INFO:tasks.rados.rados.0.smithi084.stdout:477: finishing write tid 2 to smithi084102331-2 2024-01-13T18:02:07.385 INFO:tasks.rados.rados.0.smithi084.stdout:477: finishing write tid 3 to smithi084102331-2 2024-01-13T18:02:07.385 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 141 (ObjNum 164 snap 45 seq_num 164) dirty exists 2024-01-13T18:02:07.385 INFO:tasks.rados.rados.0.smithi084.stdout:477: left oid 2 (ObjNum 164 snap 45 seq_num 164) 2024-01-13T18:02:07.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-mon[71325]: osdmap e153: 8 total, 8 up, 8 in 2024-01-13T18:02:07.563 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-01-13T18:02:07.563 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 systemd[1]: Stopped Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:07.563 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 systemd[1]: Starting Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:07.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:07 smithi084 ceph-mon[37908]: osdmap e153: 8 total, 8 up, 8 in 2024-01-13T18:02:07.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:07 smithi084 ceph-mon[52328]: osdmap e153: 8 total, 8 up, 8 in 2024-01-13T18:02:07.967 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 bash[124488]: b6d642480644c140c166cb982cd1a4d9cc9403566bfef984a70a631d3bc40dd2 2024-01-13T18:02:07.967 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 systemd[1]: Started Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:07.967 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.83243881Z level=info msg="Starting Grafana" version=9.4.7 commit=4add91f03d branch=HEAD compiled=2023-03-16T23:56:52Z 2024-01-13T18:02:07.967 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.832729721Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-01-13T18:02:07.967 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.832759301Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-01-13T18:02:07.967 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.83277381Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-01-13T18:02:07.967 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.832786156Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-01-13T18:02:07.967 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.832797041Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-01-13T18:02:07.967 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.832807566Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-01-13T18:02:07.968 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.832818126Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-01-13T18:02:07.968 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.832828456Z level=info msg="Path Home" path=/usr/share/grafana 2024-01-13T18:02:07.968 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.832839186Z level=info msg="Path Data" path=/var/lib/grafana 2024-01-13T18:02:07.968 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.832849166Z level=info msg="Path Logs" path=/var/log/grafana 2024-01-13T18:02:07.968 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.832859531Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-01-13T18:02:07.968 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.832869597Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-01-13T18:02:07.968 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=settings t=2024-01-13T18:02:07.83287975Z level=info msg="App mode production" 2024-01-13T18:02:07.968 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=sqlstore t=2024-01-13T18:02:07.832949673Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-01-13T18:02:07.968 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=sqlstore t=2024-01-13T18:02:07.832978196Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-01-13T18:02:07.968 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=migrator t=2024-01-13T18:02:07.858622146Z level=info msg="Starting DB migrations" 2024-01-13T18:02:07.969 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=migrator t=2024-01-13T18:02:07.863103952Z level=info msg="migrations completed" performed=0 skipped=481 duration=426.533µs 2024-01-13T18:02:07.969 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=sqlstore t=2024-01-13T18:02:07.863468283Z level=info msg="Created default organization" 2024-01-13T18:02:07.969 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=plugin.loader t=2024-01-13T18:02:07.937343888Z level=info msg="Plugin registered" pluginID=input 2024-01-13T18:02:07.969 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=plugin.loader t=2024-01-13T18:02:07.965765696Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-01-13T18:02:07.969 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=plugin.loader t=2024-01-13T18:02:07.96579946Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-01-13T18:02:07.969 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=secrets t=2024-01-13T18:02:07.96584071Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-01-13T18:02:08.358 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 systemd[1]: Stopping Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:08.358 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=query_data t=2024-01-13T18:02:07.969176538Z level=info msg="Query Service initialization" 2024-01-13T18:02:08.359 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=live.push_http t=2024-01-13T18:02:07.972352964Z level=info msg="Live Push Gateway initialization" 2024-01-13T18:02:08.366 INFO:tasks.rados.rados.0.smithi084.stdout:477: done (1 left) 2024-01-13T18:02:08.366 INFO:tasks.rados.rados.0.smithi084.stdout:478: done (0 left) 2024-01-13T18:02:08.367 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 46 2024-01-13T18:02:08.367 INFO:tasks.rados.rados.0.smithi084.stdout:479: seq_num 165 ranges {0=368640} 2024-01-13T18:02:08.368 INFO:tasks.rados.rados.0.smithi084.stdout:479: writing smithi084102331-27 from 0 to 368640 tid 1 2024-01-13T18:02:08.369 INFO:tasks.rados.rados.0.smithi084.stdout:480: rollback oid 16 current snap is 46 2024-01-13T18:02:08.369 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 16 to 45 2024-01-13T18:02:08.369 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 46 2024-01-13T18:02:08.369 INFO:tasks.rados.rados.0.smithi084.stdout:481: seq_num 166 ranges {106496=385024} 2024-01-13T18:02:08.372 INFO:tasks.rados.rados.0.smithi084.stdout:481: writing smithi084102331-32 from 106496 to 491520 tid 1 2024-01-13T18:02:08.372 INFO:tasks.rados.rados.0.smithi084.stdout:482: snap_create 2024-01-13T18:02:08.375 INFO:tasks.rados.rados.0.smithi084.stdout:479: finishing write tid 1 to smithi084102331-27 2024-01-13T18:02:08.375 INFO:tasks.rados.rados.0.smithi084.stdout:479: finishing write tid 2 to smithi084102331-27 2024-01-13T18:02:08.376 INFO:tasks.rados.rados.0.smithi084.stdout:480: finishing rollback tid 0 to smithi084102331-16 2024-01-13T18:02:08.376 INFO:tasks.rados.rados.0.smithi084.stdout:480: finishing rollback tid 1 to smithi084102331-16 2024-01-13T18:02:08.377 INFO:tasks.rados.rados.0.smithi084.stdout:481: finishing write tid 1 to smithi084102331-32 2024-01-13T18:02:08.377 INFO:tasks.rados.rados.0.smithi084.stdout:481: finishing write tid 2 to smithi084102331-32 2024-01-13T18:02:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:479: finishing write tid 3 to smithi084102331-27 2024-01-13T18:02:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 119 (ObjNum 165 snap 46 seq_num 165) dirty exists 2024-01-13T18:02:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:479: left oid 27 (ObjNum 165 snap 46 seq_num 165) 2024-01-13T18:02:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:481: finishing write tid 3 to smithi084102331-32 2024-01-13T18:02:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 178 (ObjNum 166 snap 46 seq_num 166) dirty exists 2024-01-13T18:02:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:481: left oid 32 (ObjNum 166 snap 46 seq_num 166) 2024-01-13T18:02:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:480: finishing rollback tid 2 to smithi084102331-16 2024-01-13T18:02:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 123 (ObjNum 109 snap 27 seq_num 109) dirty exists 2024-01-13T18:02:08.612 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 bash[124669]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b 2024-01-13T18:02:08.613 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-01-13T18:02:08.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-mon[71325]: pgmap v42: 121 pgs: 121 active+clean; 111 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 866 KiB/s wr, 12 op/s 2024-01-13T18:02:08.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-mon[71325]: osdmap e154: 8 total, 8 up, 8 in 2024-01-13T18:02:08.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:08.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:08.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-mon[71325]: Reconfiguring node-exporter.b (dependencies changed)... 2024-01-13T18:02:08.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-mon[71325]: Reconfiguring daemon node-exporter.b on smithi099 2024-01-13T18:02:08.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[37908]: pgmap v42: 121 pgs: 121 active+clean; 111 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 866 KiB/s wr, 12 op/s 2024-01-13T18:02:08.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[37908]: osdmap e154: 8 total, 8 up, 8 in 2024-01-13T18:02:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[37908]: Reconfiguring node-exporter.b (dependencies changed)... 2024-01-13T18:02:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[37908]: Reconfiguring daemon node-exporter.b on smithi099 2024-01-13T18:02:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[52328]: pgmap v42: 121 pgs: 121 active+clean; 111 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 866 KiB/s wr, 12 op/s 2024-01-13T18:02:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[52328]: osdmap e154: 8 total, 8 up, 8 in 2024-01-13T18:02:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[52328]: Reconfiguring node-exporter.b (dependencies changed)... 2024-01-13T18:02:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:08 smithi084 ceph-mon[52328]: Reconfiguring daemon node-exporter.b on smithi099 2024-01-13T18:02:08.868 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-13T18:02:08.868 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 systemd[1]: Stopped Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:08.868 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 systemd[1]: Starting Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:08.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=infra.usagestats.collector t=2024-01-13T18:02:08.748880482Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-01-13T18:02:08.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=provisioning.datasources t=2024-01-13T18:02:08.836897976Z level=info msg="deleted correlations based on configuration" ds_name=Dashboard1 2024-01-13T18:02:08.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=provisioning.datasources t=2024-01-13T18:02:08.836944558Z level=info msg="deleted datasource based on configuration" name=Dashboard1 2024-01-13T18:02:08.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=provisioning.datasources t=2024-01-13T18:02:08.848162897Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-01-13T18:02:09.363 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=provisioning.alerting t=2024-01-13T18:02:08.938878202Z level=info msg="starting to provision alerting" 2024-01-13T18:02:09.363 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=provisioning.alerting t=2024-01-13T18:02:08.938909281Z level=info msg="finished to provision alerting" 2024-01-13T18:02:09.363 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=grafanaStorageLogger t=2024-01-13T18:02:08.93914014Z level=info msg="storage starting" 2024-01-13T18:02:09.363 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=ngalert.state.manager t=2024-01-13T18:02:08.939287969Z level=info msg="Warming state cache for startup" 2024-01-13T18:02:09.363 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=http.server t=2024-01-13T18:02:08.940922478Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-01-13T18:02:09.363 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=ngalert.state.manager t=2024-01-13T18:02:08.950162349Z level=info msg="State cache has been initialized" states=0 duration=10.87331ms 2024-01-13T18:02:09.364 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=ngalert.multiorg.alertmanager t=2024-01-13T18:02:08.950214506Z level=info msg="starting MultiOrg Alertmanager" 2024-01-13T18:02:09.364 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[124502]: logger=ticker t=2024-01-13T18:02:08.950237488Z level=info msg=starting first_tick=2024-01-13T18:02:10Z 2024-01-13T18:02:09.364 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.994Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-01-13T18:02:09.364 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.994Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-01-13T18:02:09.364 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.994Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.994Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=arp 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=bcache 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=bonding 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=btrfs 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=conntrack 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=cpu 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=diskstats 2024-01-13T18:02:09.365 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=dmi 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=edac 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=entropy 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=filefd 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=filesystem 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=hwmon 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=infiniband 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=ipvs 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=loadavg 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=mdadm 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=meminfo 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=netclass 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=netdev 2024-01-13T18:02:09.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=netstat 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=nfs 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=nfsd 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=nvme 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=os 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=pressure 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=rapl 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=schedstat 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=selinux 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=sockstat 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=softnet 2024-01-13T18:02:09.367 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=stat 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=tapestats 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=textfile 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=time 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=uname 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=vmstat 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=xfs 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.995Z caller=node_exporter.go:117 level=info collector=zfs 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.996Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[124799]: ts=2024-01-13T18:02:08.996Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:09 smithi099 bash[124784]: e9f879b5e55bd543c4234e7a429c5ef0d9e424913e315e9ed90d1d66313ed3ba 2024-01-13T18:02:09.368 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:02:09 smithi099 systemd[1]: Started Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:09.372 INFO:tasks.rados.rados.0.smithi084.stdout:479: done (3 left) 2024-01-13T18:02:09.372 INFO:tasks.rados.rados.0.smithi084.stdout:480: done (2 left) 2024-01-13T18:02:09.372 INFO:tasks.rados.rados.0.smithi084.stdout:481: done (1 left) 2024-01-13T18:02:09.372 INFO:tasks.rados.rados.0.smithi084.stdout:482: done (0 left) 2024-01-13T18:02:09.372 INFO:tasks.rados.rados.0.smithi084.stdout:483: setattr oid 7 current snap is 47 2024-01-13T18:02:09.374 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 47 2024-01-13T18:02:09.375 INFO:tasks.rados.rados.0.smithi084.stdout:484: seq_num 167 ranges {761856=401408} 2024-01-13T18:02:09.381 INFO:tasks.rados.rados.0.smithi084.stdout:484: writing smithi084102331-19 from 761856 to 1163264 tid 1 2024-01-13T18:02:09.383 INFO:tasks.rados.rados.0.smithi084.stdout:485: copy_from oid 13 from oid 8 current snap is 47 2024-01-13T18:02:09.383 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 47 2024-01-13T18:02:09.383 INFO:tasks.rados.rados.0.smithi084.stdout:486: seq_num 168 ranges {761856=417792} 2024-01-13T18:02:09.389 INFO:tasks.rados.rados.0.smithi084.stdout:486: writing smithi084102331-46 from 761856 to 1179648 tid 1 2024-01-13T18:02:09.389 INFO:tasks.rados.rados.0.smithi084.stdout:487: read oid 28 snap 31 2024-01-13T18:02:09.389 INFO:tasks.rados.rados.0.smithi084.stdout:487: expect (ObjNum 46 snap 0 seq_num 46) 2024-01-13T18:02:09.389 INFO:tasks.rados.rados.0.smithi084.stdout:488: snap_remove snap 39 2024-01-13T18:02:09.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:09 smithi099 ceph-mon[71325]: osdmap e155: 8 total, 8 up, 8 in 2024-01-13T18:02:09.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:09 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:09.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:09 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:09.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:09 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:02:09.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:09 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:09.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:09 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:02:09.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:09 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:09.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[37908]: osdmap e155: 8 total, 8 up, 8 in 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[52328]: osdmap e155: 8 total, 8 up, 8 in 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:02:09.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:09 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:10.382 INFO:tasks.rados.rados.0.smithi084.stdout:488: done (5 left) 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:489: read oid 6 snap -1 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:489: expect (ObjNum 134 snap 35 seq_num 134) 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:490: rollback oid 31 current snap is 47 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 44 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 61 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:485: finishing copy_from to smithi084102331-13 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:485: got expected ENOENT (src dne) 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:485: finishing copy_from racing read to smithi084102331-13 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:484: finishing write tid 1 to smithi084102331-19 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:484: finishing write tid 2 to smithi084102331-19 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:484: finishing write tid 3 to smithi084102331-19 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 88 (ObjNum 167 snap 47 seq_num 167) dirty exists 2024-01-13T18:02:10.383 INFO:tasks.rados.rados.0.smithi084.stdout:484: left oid 19 (ObjNum 167 snap 47 seq_num 167) 2024-01-13T18:02:10.384 INFO:tasks.rados.rados.0.smithi084.stdout:486: finishing write tid 1 to smithi084102331-46 2024-01-13T18:02:10.384 INFO:tasks.rados.rados.0.smithi084.stdout:483: done (6 left) 2024-01-13T18:02:10.384 INFO:tasks.rados.rados.0.smithi084.stdout:484: done (5 left) 2024-01-13T18:02:10.384 INFO:tasks.rados.rados.0.smithi084.stdout:485: done (4 left) 2024-01-13T18:02:10.384 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 47 2024-01-13T18:02:10.384 INFO:tasks.rados.rados.0.smithi084.stdout:491: seq_num 169 ranges {4423680=434176} 2024-01-13T18:02:10.410 INFO:tasks.rados.rados.0.smithi084.stdout:491: writing smithi084102331-33 from 4423680 to 4857856 tid 1 2024-01-13T18:02:10.410 INFO:tasks.rados.rados.0.smithi084.stdout:492: copy_from oid 17 from oid 42 current snap is 47 2024-01-13T18:02:10.410 INFO:tasks.rados.rados.0.smithi084.stdout:486: finishing write tid 2 to smithi084102331-46 2024-01-13T18:02:10.410 INFO:tasks.rados.rados.0.smithi084.stdout:487: expect (ObjNum 46 snap 0 seq_num 46) 2024-01-13T18:02:10.435 INFO:tasks.rados.rados.0.smithi084.stdout:486: finishing write tid 3 to smithi084102331-46 2024-01-13T18:02:10.435 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 127 (ObjNum 168 snap 47 seq_num 168) dirty exists 2024-01-13T18:02:10.435 INFO:tasks.rados.rados.0.smithi084.stdout:486: left oid 46 (ObjNum 168 snap 47 seq_num 168) 2024-01-13T18:02:10.435 INFO:tasks.rados.rados.0.smithi084.stdout:486: done (5 left) 2024-01-13T18:02:10.435 INFO:tasks.rados.rados.0.smithi084.stdout:487: done (4 left) 2024-01-13T18:02:10.435 INFO:tasks.rados.rados.0.smithi084.stdout:493: rollback oid 39 current snap is 47 2024-01-13T18:02:10.435 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 45 2024-01-13T18:02:10.435 INFO:tasks.rados.rados.0.smithi084.stdout:489: expect (ObjNum 134 snap 35 seq_num 134) 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:490: finishing rollback tid 0 to smithi084102331-31 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:490: finishing rollback tid 1 to smithi084102331-31 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:490: finishing rollback tid 2 to smithi084102331-31 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 207 (ObjNum 114 snap 27 seq_num 114) dirty exists 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:491: finishing write tid 1 to smithi084102331-33 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:491: finishing write tid 2 to smithi084102331-33 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:489: done (4 left) 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:490: done (3 left) 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:494: copy_from oid 18 from oid 23 current snap is 47 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:491: finishing write tid 3 to smithi084102331-33 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 149 (ObjNum 169 snap 47 seq_num 169) dirty exists 2024-01-13T18:02:10.492 INFO:tasks.rados.rados.0.smithi084.stdout:491: left oid 33 (ObjNum 169 snap 47 seq_num 169) 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:492: finishing copy_from to smithi084102331-17 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 15 (ObjNum 93 snap 18 seq_num 93) dirty exists 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:492: finishing copy_from racing read to smithi084102331-17 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:493: finishing rollback tid 0 to smithi084102331-39 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:493: finishing rollback tid 1 to smithi084102331-39 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:493: finishing rollback tid 2 to smithi084102331-39 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 130 (ObjNum 157 snap 45 seq_num 157) dirty exists 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:491: done (3 left) 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:492: done (2 left) 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:493: done (1 left) 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:495: rollback oid 47 current snap is 47 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 33 2024-01-13T18:02:10.493 INFO:tasks.rados.rados.0.smithi084.stdout:496: delete oid 50 current snap is 47 2024-01-13T18:02:10.494 INFO:tasks.rados.rados.0.smithi084.stdout:496: done (2 left) 2024-01-13T18:02:10.494 INFO:tasks.rados.rados.0.smithi084.stdout:497: delete oid 14 current snap is 47 2024-01-13T18:02:10.494 INFO:tasks.rados.rados.0.smithi084.stdout:495: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:02:10.495 INFO:tasks.rados.rados.0.smithi084.stdout:495: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:02:10.496 INFO:tasks.rados.rados.0.smithi084.stdout:495: finishing rollback tid 2 to smithi084102331-47 2024-01-13T18:02:10.496 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 186 (ObjNum 127 snap 32 seq_num 127) dirty exists 2024-01-13T18:02:10.496 INFO:tasks.rados.rados.0.smithi084.stdout:495: done (2 left) 2024-01-13T18:02:10.496 INFO:tasks.rados.rados.0.smithi084.stdout:497: done (1 left) 2024-01-13T18:02:10.496 INFO:tasks.rados.rados.0.smithi084.stdout:498: read oid 20 snap -1 2024-01-13T18:02:10.496 INFO:tasks.rados.rados.0.smithi084.stdout:498: expect deleted 2024-01-13T18:02:10.496 INFO:tasks.rados.rados.0.smithi084.stdout:499: rollback oid 31 current snap is 47 2024-01-13T18:02:10.496 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 33 2024-01-13T18:02:10.496 INFO:tasks.rados.rados.0.smithi084.stdout:500: delete oid 3 current snap is 47 2024-01-13T18:02:10.498 INFO:tasks.rados.rados.0.smithi084.stdout:499: finishing rollback tid 0 to smithi084102331-31 2024-01-13T18:02:10.499 INFO:tasks.rados.rados.0.smithi084.stdout:499: finishing rollback tid 1 to smithi084102331-31 2024-01-13T18:02:10.499 INFO:tasks.rados.rados.0.smithi084.stdout:499: finishing rollback tid 2 to smithi084102331-31 2024-01-13T18:02:10.500 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 214 (ObjNum 114 snap 27 seq_num 114) dirty exists 2024-01-13T18:02:10.500 INFO:tasks.rados.rados.0.smithi084.stdout:498: done (3 left) 2024-01-13T18:02:10.500 INFO:tasks.rados.rados.0.smithi084.stdout:499: done (2 left) 2024-01-13T18:02:10.500 INFO:tasks.rados.rados.0.smithi084.stdout:500: done (1 left) 2024-01-13T18:02:10.500 INFO:tasks.rados.rados.0.smithi084.stdout:501: read oid 10 snap -1 2024-01-13T18:02:10.500 INFO:tasks.rados.rados.0.smithi084.stdout:501: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:02:10.500 INFO:tasks.rados.rados.0.smithi084.stdout:502: snap_create 2024-01-13T18:02:10.523 INFO:tasks.rados.rados.0.smithi084.stdout:501: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:02:10.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:02:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:02:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: Upgrade: Need to upgrade myself (mgr.x) 2024-01-13T18:02:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: Upgrade: Need to upgrade myself (mgr.x) 2024-01-13T18:02:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: pgmap v45: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2024-01-13T18:02:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: osdmap e156: 8 total, 8 up, 8 in 2024-01-13T18:02:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:02:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:02:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:02:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: Upgrade: Need to upgrade myself (mgr.x) 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: Upgrade: Need to upgrade myself (mgr.x) 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: pgmap v45: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: osdmap e156: 8 total, 8 up, 8 in 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:02:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:10 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:10.788 INFO:tasks.rados.rados.0.smithi084.stdout:494: finishing copy_from to smithi084102331-18 2024-01-13T18:02:10.788 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 134 (ObjNum 159 snap 45 seq_num 159) dirty exists 2024-01-13T18:02:10.788 INFO:tasks.rados.rados.0.smithi084.stdout:494: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:02:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:02:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:02:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: Upgrade: Need to upgrade myself (mgr.x) 2024-01-13T18:02:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: Upgrade: Need to upgrade myself (mgr.x) 2024-01-13T18:02:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: pgmap v45: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2024-01-13T18:02:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: osdmap e156: 8 total, 8 up, 8 in 2024-01-13T18:02:10.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:10.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:02:10.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:02:10.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:02:10.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:10 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:11.384 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:11 smithi084 systemd[1]: Stopping Ceph mgr.y for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:11.387 INFO:tasks.rados.rados.0.smithi084.stdout:494: done (2 left) 2024-01-13T18:02:11.387 INFO:tasks.rados.rados.0.smithi084.stdout:501: done (1 left) 2024-01-13T18:02:11.387 INFO:tasks.rados.rados.0.smithi084.stdout:502: done (0 left) 2024-01-13T18:02:11.387 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 48 2024-01-13T18:02:11.387 INFO:tasks.rados.rados.0.smithi084.stdout:503: seq_num 173 ranges {1908736=499712} 2024-01-13T18:02:11.401 INFO:tasks.rados.rados.0.smithi084.stdout:503: writing smithi084102331-39 from 1908736 to 2408448 tid 1 2024-01-13T18:02:11.401 INFO:tasks.rados.rados.0.smithi084.stdout:504: read oid 48 snap -1 2024-01-13T18:02:11.401 INFO:tasks.rados.rados.0.smithi084.stdout:504: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:02:11.401 INFO:tasks.rados.rados.0.smithi084.stdout:505: rollback oid 18 current snap is 48 2024-01-13T18:02:11.401 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 47 2024-01-13T18:02:11.401 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 48 2024-01-13T18:02:11.401 INFO:tasks.rados.rados.0.smithi084.stdout:506: seq_num 174 ranges {0=516096} 2024-01-13T18:02:11.404 INFO:tasks.rados.rados.0.smithi084.stdout:506: writing smithi084102331-44 from 0 to 516096 tid 1 2024-01-13T18:02:11.404 INFO:tasks.rados.rados.0.smithi084.stdout:507: snap_create 2024-01-13T18:02:11.405 INFO:tasks.rados.rados.0.smithi084.stdout:503: finishing write tid 1 to smithi084102331-39 2024-01-13T18:02:11.405 INFO:tasks.rados.rados.0.smithi084.stdout:505: finishing rollback tid 0 to smithi084102331-18 2024-01-13T18:02:11.405 INFO:tasks.rados.rados.0.smithi084.stdout:505: finishing rollback tid 1 to smithi084102331-18 2024-01-13T18:02:11.406 INFO:tasks.rados.rados.0.smithi084.stdout:505: finishing rollback tid 2 to smithi084102331-18 2024-01-13T18:02:11.406 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 137 (ObjNum 159 snap 45 seq_num 159) dirty exists 2024-01-13T18:02:11.406 INFO:tasks.rados.rados.0.smithi084.stdout:503: finishing write tid 2 to smithi084102331-39 2024-01-13T18:02:11.408 INFO:tasks.rados.rados.0.smithi084.stdout:506: finishing write tid 1 to smithi084102331-44 2024-01-13T18:02:11.409 INFO:tasks.rados.rados.0.smithi084.stdout:503: finishing write tid 3 to smithi084102331-39 2024-01-13T18:02:11.409 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 132 (ObjNum 173 snap 48 seq_num 173) dirty exists 2024-01-13T18:02:11.409 INFO:tasks.rados.rados.0.smithi084.stdout:503: left oid 39 (ObjNum 173 snap 48 seq_num 173) 2024-01-13T18:02:11.409 INFO:tasks.rados.rados.0.smithi084.stdout:506: finishing write tid 2 to smithi084102331-44 2024-01-13T18:02:11.410 INFO:tasks.rados.rados.0.smithi084.stdout:504: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:02:11.430 INFO:tasks.rados.rados.0.smithi084.stdout:506: finishing write tid 3 to smithi084102331-44 2024-01-13T18:02:11.430 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 188 (ObjNum 174 snap 48 seq_num 174) dirty exists 2024-01-13T18:02:11.430 INFO:tasks.rados.rados.0.smithi084.stdout:506: left oid 44 (ObjNum 174 snap 48 seq_num 174) 2024-01-13T18:02:11.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:11 smithi084 bash[105862]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y 2024-01-13T18:02:11.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:11 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-01-13T18:02:11.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:11 smithi084 ceph-mon[37908]: Upgrade: Updating mgr.y 2024-01-13T18:02:11.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:11 smithi084 ceph-mon[37908]: Deploying daemon mgr.y on smithi084 2024-01-13T18:02:11.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:11 smithi084 ceph-mon[37908]: osdmap e157: 8 total, 8 up, 8 in 2024-01-13T18:02:11.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:11 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:11.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:11 smithi084 ceph-mon[52328]: Upgrade: Updating mgr.y 2024-01-13T18:02:11.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:11 smithi084 ceph-mon[52328]: Deploying daemon mgr.y on smithi084 2024-01-13T18:02:11.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:11 smithi084 ceph-mon[52328]: osdmap e157: 8 total, 8 up, 8 in 2024-01-13T18:02:11.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:11 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:11 smithi099 ceph-mon[71325]: Upgrade: Updating mgr.y 2024-01-13T18:02:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:11 smithi099 ceph-mon[71325]: Deploying daemon mgr.y on smithi084 2024-01-13T18:02:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:11 smithi099 ceph-mon[71325]: osdmap e157: 8 total, 8 up, 8 in 2024-01-13T18:02:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:11 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:12.159 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:11 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.y.service: Failed with result 'exit-code'. 2024-01-13T18:02:12.159 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:11 smithi084 systemd[1]: Stopped Ceph mgr.y for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:12.159 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:11 smithi084 systemd[1]: Starting Ceph mgr.y for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:12.392 INFO:tasks.rados.rados.0.smithi084.stdout:503: done (4 left) 2024-01-13T18:02:12.392 INFO:tasks.rados.rados.0.smithi084.stdout:504: done (3 left) 2024-01-13T18:02:12.392 INFO:tasks.rados.rados.0.smithi084.stdout:505: done (2 left) 2024-01-13T18:02:12.392 INFO:tasks.rados.rados.0.smithi084.stdout:506: done (1 left) 2024-01-13T18:02:12.392 INFO:tasks.rados.rados.0.smithi084.stdout:507: done (0 left) 2024-01-13T18:02:12.393 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 49 2024-01-13T18:02:12.393 INFO:tasks.rados.rados.0.smithi084.stdout:508: seq_num 175 ranges {3948544=540672} 2024-01-13T18:02:12.416 INFO:tasks.rados.rados.0.smithi084.stdout:508: writing smithi084102331-18 from 3948544 to 4489216 tid 1 2024-01-13T18:02:12.416 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 49 2024-01-13T18:02:12.416 INFO:tasks.rados.rados.0.smithi084.stdout:509: seq_num 176 ranges {2408448=557056} 2024-01-13T18:02:12.433 INFO:tasks.rados.rados.0.smithi084.stdout:509: writing smithi084102331-39 from 2408448 to 2965504 tid 1 2024-01-13T18:02:12.433 INFO:tasks.rados.rados.0.smithi084.stdout:510: setattr oid 49 current snap is 49 2024-01-13T18:02:12.433 INFO:tasks.rados.rados.0.smithi084.stdout:508: finishing write tid 1 to smithi084102331-18 2024-01-13T18:02:12.433 INFO:tasks.rados.rados.0.smithi084.stdout:508: finishing write tid 2 to smithi084102331-18 2024-01-13T18:02:12.433 INFO:tasks.rados.rados.0.smithi084.stdout:508: finishing write tid 3 to smithi084102331-18 2024-01-13T18:02:12.433 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 139 (ObjNum 175 snap 49 seq_num 175) dirty exists 2024-01-13T18:02:12.433 INFO:tasks.rados.rados.0.smithi084.stdout:508: left oid 18 (ObjNum 175 snap 49 seq_num 175) 2024-01-13T18:02:12.433 INFO:tasks.rados.rados.0.smithi084.stdout:508: done (2 left) 2024-01-13T18:02:12.434 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 49 2024-01-13T18:02:12.434 INFO:tasks.rados.rados.0.smithi084.stdout:511: seq_num 177 ranges {0=573440} 2024-01-13T18:02:12.437 INFO:tasks.rados.rados.0.smithi084.stdout:511: writing smithi084102331-8 from 0 to 573440 tid 1 2024-01-13T18:02:12.437 INFO:tasks.rados.rados.0.smithi084.stdout:512: rollback oid 23 current snap is 49 2024-01-13T18:02:12.437 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 44 2024-01-13T18:02:12.437 INFO:tasks.rados.rados.0.smithi084.stdout:513: copy_from oid 9 from oid 18 current snap is 49 2024-01-13T18:02:12.438 INFO:tasks.rados.rados.0.smithi084.stdout:514: snap_remove snap 46 2024-01-13T18:02:12.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-mon[37908]: pgmap v48: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 2.9 MiB/s rd, 264 KiB/s wr, 11 op/s 2024-01-13T18:02:12.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-mon[37908]: osdmap e158: 8 total, 8 up, 8 in 2024-01-13T18:02:12.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:12.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:12.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:12.610 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-mgr[106049]: -- 172.21.15.84:0/2746185008 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56182fd1f1e0 con 0x56182fcf4c00 2024-01-13T18:02:12.610 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:12 smithi084 bash[106011]: 90286ff5aeaa7588339b6a38b84f75ded4ac58077e9be760cb0f3e22aa49b0b2 2024-01-13T18:02:12.610 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:12 smithi084 systemd[1]: Started Ceph mgr.y for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:12.611 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:12.422+0000 7f656f9c6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T18:02:12.611 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:12.602+0000 7f656f9c6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T18:02:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-mon[52328]: pgmap v48: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 2.9 MiB/s rd, 264 KiB/s wr, 11 op/s 2024-01-13T18:02:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-mon[52328]: osdmap e158: 8 total, 8 up, 8 in 2024-01-13T18:02:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:12 smithi099 ceph-mon[71325]: pgmap v48: 121 pgs: 121 active+clean; 112 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 2.9 MiB/s rd, 264 KiB/s wr, 11 op/s 2024-01-13T18:02:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:12 smithi099 ceph-mon[71325]: osdmap e158: 8 total, 8 up, 8 in 2024-01-13T18:02:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:12 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:12 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:12 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:13.360 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:12 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:12.967+0000 7f656f9c6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T18:02:13.399 INFO:tasks.rados.rados.0.smithi084.stdout:514: done (5 left) 2024-01-13T18:02:13.399 INFO:tasks.rados.rados.0.smithi084.stdout:515: copy_from oid 50 from oid 24 current snap is 49 2024-01-13T18:02:13.399 INFO:tasks.rados.rados.0.smithi084.stdout:516: read oid 15 snap 45 2024-01-13T18:02:13.399 INFO:tasks.rados.rados.0.smithi084.stdout:516: expect deleted 2024-01-13T18:02:13.399 INFO:tasks.rados.rados.0.smithi084.stdout:517: copy_from oid 7 from oid 14 current snap is 49 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:518: delete oid 4 current snap is 49 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:509: finishing write tid 1 to smithi084102331-39 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 167 (ObjNum 160 snap 45 seq_num 160) dirty exists 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:509: finishing write tid 2 to smithi084102331-39 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:509: finishing write tid 3 to smithi084102331-39 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 134 (ObjNum 176 snap 49 seq_num 176) dirty exists 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:509: left oid 39 (ObjNum 176 snap 49 seq_num 176) 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:511: finishing write tid 1 to smithi084102331-8 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:511: finishing write tid 2 to smithi084102331-8 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:512: finishing rollback tid 0 to smithi084102331-23 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:512: finishing rollback tid 1 to smithi084102331-23 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:512: finishing rollback tid 2 to smithi084102331-23 2024-01-13T18:02:13.400 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 149 (ObjNum 154 snap 42 seq_num 154) dirty exists 2024-01-13T18:02:13.401 INFO:tasks.rados.rados.0.smithi084.stdout:511: finishing write tid 3 to smithi084102331-8 2024-01-13T18:02:13.401 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 190 (ObjNum 177 snap 49 seq_num 177) dirty exists 2024-01-13T18:02:13.401 INFO:tasks.rados.rados.0.smithi084.stdout:511: left oid 8 (ObjNum 177 snap 49 seq_num 177) 2024-01-13T18:02:13.401 INFO:tasks.rados.rados.0.smithi084.stdout:513: finishing copy_from to smithi084102331-9 2024-01-13T18:02:13.401 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 139 (ObjNum 175 snap 49 seq_num 175) dirty exists 2024-01-13T18:02:13.401 INFO:tasks.rados.rados.0.smithi084.stdout:513: finishing copy_from racing read to smithi084102331-9 2024-01-13T18:02:13.404 INFO:tasks.rados.rados.0.smithi084.stdout:517: finishing copy_from to smithi084102331-7 2024-01-13T18:02:13.405 INFO:tasks.rados.rados.0.smithi084.stdout:517: got expected ENOENT (src dne) 2024-01-13T18:02:13.405 INFO:tasks.rados.rados.0.smithi084.stdout:517: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:02:13.407 INFO:tasks.rados.rados.0.smithi084.stdout:509: done (8 left) 2024-01-13T18:02:13.407 INFO:tasks.rados.rados.0.smithi084.stdout:510: done (7 left) 2024-01-13T18:02:13.407 INFO:tasks.rados.rados.0.smithi084.stdout:511: done (6 left) 2024-01-13T18:02:13.407 INFO:tasks.rados.rados.0.smithi084.stdout:512: done (5 left) 2024-01-13T18:02:13.407 INFO:tasks.rados.rados.0.smithi084.stdout:513: done (4 left) 2024-01-13T18:02:13.407 INFO:tasks.rados.rados.0.smithi084.stdout:516: done (3 left) 2024-01-13T18:02:13.407 INFO:tasks.rados.rados.0.smithi084.stdout:517: done (2 left) 2024-01-13T18:02:13.407 INFO:tasks.rados.rados.0.smithi084.stdout:518: done (1 left) 2024-01-13T18:02:13.408 INFO:tasks.rados.rados.0.smithi084.stdout:519: snap_create 2024-01-13T18:02:13.422 INFO:tasks.rados.rados.0.smithi084.stdout:515: finishing copy_from to smithi084102331-50 2024-01-13T18:02:13.422 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 51 (ObjNum 133 snap 35 seq_num 133) dirty exists 2024-01-13T18:02:13.422 INFO:tasks.rados.rados.0.smithi084.stdout:515: finishing copy_from racing read to smithi084102331-50 2024-01-13T18:02:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:13 smithi084 ceph-mon[37908]: osdmap e159: 8 total, 8 up, 8 in 2024-01-13T18:02:13.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:13 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:13.516+0000 7f656f9c6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T18:02:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:13 smithi084 ceph-mon[52328]: osdmap e159: 8 total, 8 up, 8 in 2024-01-13T18:02:13.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:13 smithi099 ceph-mon[71325]: osdmap e159: 8 total, 8 up, 8 in 2024-01-13T18:02:14.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:13 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:13.768+0000 7f656f9c6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T18:02:14.349 INFO:tasks.rados.rados.0.smithi084.stdout:515: done (1 left) 2024-01-13T18:02:14.350 INFO:tasks.rados.rados.0.smithi084.stdout:519: done (0 left) 2024-01-13T18:02:14.350 INFO:tasks.rados.rados.0.smithi084.stdout:520: read oid 45 snap -1 2024-01-13T18:02:14.350 INFO:tasks.rados.rados.0.smithi084.stdout:520: expect (ObjNum 148 snap 41 seq_num 148) 2024-01-13T18:02:14.350 INFO:tasks.rados.rados.0.smithi084.stdout:521: setattr oid 1 current snap is 50 2024-01-13T18:02:14.352 INFO:tasks.rados.rados.0.smithi084.stdout:522: rmattr oid 34 current snap is 50 2024-01-13T18:02:14.352 INFO:tasks.rados.rados.0.smithi084.stdout:522: done (2 left) 2024-01-13T18:02:14.352 INFO:tasks.rados.rados.0.smithi084.stdout:523: read oid 10 snap -1 2024-01-13T18:02:14.352 INFO:tasks.rados.rados.0.smithi084.stdout:523: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:02:14.352 INFO:tasks.rados.rados.0.smithi084.stdout:524: rollback oid 46 current snap is 50 2024-01-13T18:02:14.352 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 45 2024-01-13T18:02:14.352 INFO:tasks.rados.rados.0.smithi084.stdout:525: copy_from oid 25 from oid 44 current snap is 50 2024-01-13T18:02:14.352 INFO:tasks.rados.rados.0.smithi084.stdout:526: rollback oid 41 current snap is 50 2024-01-13T18:02:14.352 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 31 2024-01-13T18:02:14.352 INFO:tasks.rados.rados.0.smithi084.stdout:527: rollback oid 50 current snap is 50 2024-01-13T18:02:14.352 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 50 to 44 2024-01-13T18:02:14.353 INFO:tasks.rados.rados.0.smithi084.stdout:528: read oid 5 snap -1 2024-01-13T18:02:14.353 INFO:tasks.rados.rados.0.smithi084.stdout:528: expect deleted 2024-01-13T18:02:14.353 INFO:tasks.rados.rados.0.smithi084.stdout:529: rollback oid 4 current snap is 50 2024-01-13T18:02:14.353 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 31 2024-01-13T18:02:14.353 INFO:tasks.rados.rados.0.smithi084.stdout:530: snap_create 2024-01-13T18:02:14.357 INFO:tasks.rados.rados.0.smithi084.stdout:524: finishing rollback tid 0 to smithi084102331-46 2024-01-13T18:02:14.358 INFO:tasks.rados.rados.0.smithi084.stdout:524: finishing rollback tid 1 to smithi084102331-46 2024-01-13T18:02:14.358 INFO:tasks.rados.rados.0.smithi084.stdout:524: finishing rollback tid 2 to smithi084102331-46 2024-01-13T18:02:14.358 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 137 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:02:14.359 INFO:tasks.rados.rados.0.smithi084.stdout:527: finishing rollback tid 0 to smithi084102331-50 2024-01-13T18:02:14.359 INFO:tasks.rados.rados.0.smithi084.stdout:527: finishing rollback tid 1 to smithi084102331-50 2024-01-13T18:02:14.359 INFO:tasks.rados.rados.0.smithi084.stdout:526: finishing rollback tid 0 to smithi084102331-41 2024-01-13T18:02:14.359 INFO:tasks.rados.rados.0.smithi084.stdout:526: finishing rollback tid 1 to smithi084102331-41 2024-01-13T18:02:14.359 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 139 (ObjNum 33 snap 0 seq_num 2817852880) dirty dne 2024-01-13T18:02:14.359 INFO:tasks.rados.rados.0.smithi084.stdout:527: finishing rollback tid 2 to smithi084102331-50 2024-01-13T18:02:14.359 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 160 (ObjNum 145 snap 40 seq_num 145) dirty exists 2024-01-13T18:02:14.360 INFO:tasks.rados.rados.0.smithi084.stdout:529: finishing rollback tid 1 to smithi084102331-4 2024-01-13T18:02:14.360 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 0 (ObjNum 33 snap 0 seq_num 4032368952) dirty dne 2024-01-13T18:02:14.362 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 222 (ObjNum 78 snap 14 seq_num 78) dirty exists 2024-01-13T18:02:14.365 INFO:tasks.rados.rados.0.smithi084.stdout:520: expect (ObjNum 148 snap 41 seq_num 148) 2024-01-13T18:02:14.480 INFO:tasks.rados.rados.0.smithi084.stdout:525: finishing copy_from to smithi084102331-25 2024-01-13T18:02:14.481 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 188 (ObjNum 174 snap 48 seq_num 174) dirty exists 2024-01-13T18:02:14.481 INFO:tasks.rados.rados.0.smithi084.stdout:525: finishing copy_from racing read to smithi084102331-25 2024-01-13T18:02:14.481 INFO:tasks.rados.rados.0.smithi084.stdout:523: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:02:14.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:14 smithi084 ceph-mon[37908]: pgmap v51: 121 pgs: 121 active+clean; 116 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.3 MiB/s wr, 19 op/s 2024-01-13T18:02:14.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:14 smithi084 ceph-mon[37908]: osdmap e160: 8 total, 8 up, 8 in 2024-01-13T18:02:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:14 smithi084 ceph-mon[37908]: osdmap e161: 8 total, 8 up, 8 in 2024-01-13T18:02:14.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:14 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:14.226+0000 7f656f9c6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T18:02:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:14 smithi084 ceph-mon[52328]: pgmap v51: 121 pgs: 121 active+clean; 116 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.3 MiB/s wr, 19 op/s 2024-01-13T18:02:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:14 smithi084 ceph-mon[52328]: osdmap e160: 8 total, 8 up, 8 in 2024-01-13T18:02:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:14 smithi084 ceph-mon[52328]: osdmap e161: 8 total, 8 up, 8 in 2024-01-13T18:02:14.709 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:14 smithi099 ceph-mon[71325]: pgmap v51: 121 pgs: 121 active+clean; 116 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.3 MiB/s wr, 19 op/s 2024-01-13T18:02:14.709 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:14 smithi099 ceph-mon[71325]: osdmap e160: 8 total, 8 up, 8 in 2024-01-13T18:02:14.709 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:14 smithi099 ceph-mon[71325]: osdmap e161: 8 total, 8 up, 8 in 2024-01-13T18:02:15.188 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:02:15.355 INFO:tasks.rados.rados.0.smithi084.stdout:520: done (9 left) 2024-01-13T18:02:15.355 INFO:tasks.rados.rados.0.smithi084.stdout:521: done (8 left) 2024-01-13T18:02:15.355 INFO:tasks.rados.rados.0.smithi084.stdout:523: done (7 left) 2024-01-13T18:02:15.355 INFO:tasks.rados.rados.0.smithi084.stdout:524: done (6 left) 2024-01-13T18:02:15.355 INFO:tasks.rados.rados.0.smithi084.stdout:525: done (5 left) 2024-01-13T18:02:15.355 INFO:tasks.rados.rados.0.smithi084.stdout:526: done (4 left) 2024-01-13T18:02:15.355 INFO:tasks.rados.rados.0.smithi084.stdout:527: done (3 left) 2024-01-13T18:02:15.355 INFO:tasks.rados.rados.0.smithi084.stdout:528: done (2 left) 2024-01-13T18:02:15.355 INFO:tasks.rados.rados.0.smithi084.stdout:529: done (1 left) 2024-01-13T18:02:15.355 INFO:tasks.rados.rados.0.smithi084.stdout:530: done (0 left) 2024-01-13T18:02:15.355 INFO:tasks.rados.rados.0.smithi084.stdout:531: rollback oid 44 current snap is 51 2024-01-13T18:02:15.356 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 41 2024-01-13T18:02:15.358 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 51 2024-01-13T18:02:15.359 INFO:tasks.rados.rados.0.smithi084.stdout:532: seq_num 179 ranges {2023424=606208} 2024-01-13T18:02:15.369 INFO:tasks.rados.rados.0.smithi084.stdout:532: writing smithi084102331-30 from 2023424 to 2629632 tid 1 2024-01-13T18:02:15.370 INFO:tasks.rados.rados.0.smithi084.stdout:533: rollback oid 40 current snap is 51 2024-01-13T18:02:15.370 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 31 2024-01-13T18:02:15.370 INFO:tasks.rados.rados.0.smithi084.stdout:531: finishing rollback tid 0 to smithi084102331-44 2024-01-13T18:02:15.370 INFO:tasks.rados.rados.0.smithi084.stdout:531: finishing rollback tid 1 to smithi084102331-44 2024-01-13T18:02:15.370 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 195 (ObjNum 97 snap 0 seq_num 92) dirty dne 2024-01-13T18:02:15.370 INFO:tasks.rados.rados.0.smithi084.stdout:531: done (2 left) 2024-01-13T18:02:15.370 INFO:tasks.rados.rados.0.smithi084.stdout:534: snap_remove snap 41 2024-01-13T18:02:15.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:15.003+0000 7f656f9c6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T18:02:15.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:15.097+0000 7f656f9c6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T18:02:15.529 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:02:15.529 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (22s) 1s ago 2m 15.7M - 0.25.0 c8568f914cd2 a5cbc3e01ffb 2024-01-13T18:02:15.529 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (8s) 0s ago 2m 68.3M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (3m) 1s ago 3m 14.6M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (3m) 0s ago 3m 18.8M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283 running (41s) 0s ago 6m 506M - 18.2.1-242-gd2f11f33 f16b14f4c75d d5726518d185 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (3s) 1s ago 7m 45.2M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (7m) 1s ago 7m 99.1M 2048M 17.2.7-268-g6441305d c3a232f785d8 0eb2ed5f8766 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (6m) 0s ago 6m 67.5M 2048M 17.2.7-268-g6441305d c3a232f785d8 bf79d7793fc1 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (6m) 1s ago 6m 65.9M 2048M 17.2.7-268-g6441305d c3a232f785d8 510574f8be07 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (21s) 1s ago 2m 4190k - 1.5.0 0da6a335fe13 b72e6d50f165 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (6s) 0s ago 2m 3812k - 1.5.0 0da6a335fe13 e9f879b5e55b 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (5m) 1s ago 5m 200M 2488M 17.2.7-268-g6441305d c3a232f785d8 809287996fef 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (5m) 1s ago 5m 181M 2488M 17.2.7-268-g6441305d c3a232f785d8 fad77ee705d8 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (5m) 1s ago 5m 175M 2488M 17.2.7-268-g6441305d c3a232f785d8 14025770cf00 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (5m) 1s ago 5m 158M 2488M 17.2.7-268-g6441305d c3a232f785d8 068cf98fa99c 2024-01-13T18:02:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (4m) 0s ago 4m 180M 2488M 17.2.7-268-g6441305d c3a232f785d8 30e0722550a0 2024-01-13T18:02:15.531 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (4m) 0s ago 4m 161M 2488M 17.2.7-268-g6441305d c3a232f785d8 51be805dde78 2024-01-13T18:02:15.531 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (4m) 0s ago 4m 134M 2488M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:02:15.531 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (3m) 0s ago 3m 113M 2488M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:02:15.531 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (11s) 0s ago 3m 40.4M - 2.43.0 a07b618ecd1d 786d3aae254b 2024-01-13T18:02:15.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[37908]: osdmap e162: 8 total, 8 up, 8 in 2024-01-13T18:02:15.700 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.700 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.700 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.700 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.700 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.700 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.700 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-mon[52328]: osdmap e162: 8 total, 8 up, 8 in 2024-01-13T18:02:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:15 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:15 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:15 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:15 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:15 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:15 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:15 smithi099 ceph-mon[71325]: osdmap e162: 8 total, 8 up, 8 in 2024-01-13T18:02:15.945 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 3 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 1, 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 1 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 8 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:02:15.946 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 14, 2024-01-13T18:02:15.947 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 1 2024-01-13T18:02:15.947 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:02:15.947 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:02:15.957 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:15.767+0000 7f656f9c6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T18:02:15.957 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:15.863+0000 7f656f9c6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T18:02:16.218 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:15 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:15.955+0000 7f656f9c6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T18:02:16.219 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:16.194+0000 7f656f9c6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T18:02:16.358 INFO:tasks.rados.rados.0.smithi084.stdout:534: done (2 left) 2024-01-13T18:02:16.358 INFO:tasks.rados.rados.0.smithi084.stdout:535: snap_create 2024-01-13T18:02:16.358 INFO:tasks.rados.rados.0.smithi084.stdout:532: finishing write tid 1 to smithi084102331-30 2024-01-13T18:02:16.358 INFO:tasks.rados.rados.0.smithi084.stdout:533: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:02:16.359 INFO:tasks.rados.rados.0.smithi084.stdout:533: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:02:16.359 INFO:tasks.rados.rados.0.smithi084.stdout:533: finishing rollback tid 2 to smithi084102331-40 2024-01-13T18:02:16.359 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 107 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-01-13T18:02:16.359 INFO:tasks.rados.rados.0.smithi084.stdout:532: finishing write tid 2 to smithi084102331-30 2024-01-13T18:02:16.359 INFO:tasks.rados.rados.0.smithi084.stdout:532: finishing write tid 3 to smithi084102331-30 2024-01-13T18:02:16.359 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 190 (ObjNum 179 snap 51 seq_num 179) dirty exists 2024-01-13T18:02:16.359 INFO:tasks.rados.rados.0.smithi084.stdout:532: left oid 30 (ObjNum 179 snap 51 seq_num 179) 2024-01-13T18:02:16.633 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-mon[37908]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:16.633 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-mon[37908]: pgmap v54: 121 pgs: 121 active+clean; 116 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.3 MiB/s wr, 19 op/s 2024-01-13T18:02:16.633 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-mon[37908]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:16.634 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-mon[37908]: from='client.? 172.21.15.84:0/1139256800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:16.634 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-mon[37908]: osdmap e163: 8 total, 8 up, 8 in 2024-01-13T18:02:16.634 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:16.293+0000 7f656f9c6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T18:02:16.634 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:16.399+0000 7f656f9c6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T18:02:16.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-mon[52328]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:16.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-mon[52328]: pgmap v54: 121 pgs: 121 active+clean; 116 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.3 MiB/s wr, 19 op/s 2024-01-13T18:02:16.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-mon[52328]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:16.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/1139256800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:16.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-mon[52328]: osdmap e163: 8 total, 8 up, 8 in 2024-01-13T18:02:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:16 smithi099 ceph-mon[71325]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:16 smithi099 ceph-mon[71325]: pgmap v54: 121 pgs: 121 active+clean; 116 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.3 MiB/s wr, 19 op/s 2024-01-13T18:02:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:16 smithi099 ceph-mon[71325]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:16 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/1139256800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:16 smithi099 ceph-mon[71325]: osdmap e163: 8 total, 8 up, 8 in 2024-01-13T18:02:16.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:16.631+0000 7f656f9c6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T18:02:16.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:16.736+0000 7f656f9c6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T18:02:17.219 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:16 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:16.944+0000 7f656f9c6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T18:02:17.219 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:17 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:17.048+0000 7f656f9c6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T18:02:17.357 INFO:tasks.rados.rados.0.smithi084.stdout:532: done (2 left) 2024-01-13T18:02:17.357 INFO:tasks.rados.rados.0.smithi084.stdout:533: done (1 left) 2024-01-13T18:02:17.357 INFO:tasks.rados.rados.0.smithi084.stdout:535: done (0 left) 2024-01-13T18:02:17.357 INFO:tasks.rados.rados.0.smithi084.stdout:536: rmattr oid 40 current snap is 52 2024-01-13T18:02:17.357 INFO:tasks.rados.rados.0.smithi084.stdout:536: done (0 left) 2024-01-13T18:02:17.357 INFO:tasks.rados.rados.0.smithi084.stdout:537: read oid 10 snap 33 2024-01-13T18:02:17.358 INFO:tasks.rados.rados.0.smithi084.stdout:537: expect (ObjNum 81 snap 14 seq_num 81) 2024-01-13T18:02:17.358 INFO:tasks.rados.rados.0.smithi084.stdout:538: read oid 50 snap -1 2024-01-13T18:02:17.358 INFO:tasks.rados.rados.0.smithi084.stdout:538: expect (ObjNum 145 snap 40 seq_num 145) 2024-01-13T18:02:17.358 INFO:tasks.rados.rados.0.smithi084.stdout:539: setattr oid 7 current snap is 52 2024-01-13T18:02:17.359 INFO:tasks.rados.rados.0.smithi084.stdout:540: read oid 18 snap 48 2024-01-13T18:02:17.359 INFO:tasks.rados.rados.0.smithi084.stdout:540: expect (ObjNum 159 snap 45 seq_num 159) 2024-01-13T18:02:17.359 INFO:tasks.rados.rados.0.smithi084.stdout:541: copy_from oid 42 from oid 35 current snap is 52 2024-01-13T18:02:17.359 INFO:tasks.rados.rados.0.smithi084.stdout:542: read oid 46 snap -1 2024-01-13T18:02:17.359 INFO:tasks.rados.rados.0.smithi084.stdout:542: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:02:17.359 INFO:tasks.rados.rados.0.smithi084.stdout:543: rollback oid 43 current snap is 52 2024-01-13T18:02:17.359 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 47 2024-01-13T18:02:17.359 INFO:tasks.rados.rados.0.smithi084.stdout:544: delete oid 45 current snap is 52 2024-01-13T18:02:17.363 INFO:tasks.rados.rados.0.smithi084.stdout:544: done (7 left) 2024-01-13T18:02:17.364 INFO:tasks.rados.rados.0.smithi084.stdout:545: read oid 19 snap -1 2024-01-13T18:02:17.364 INFO:tasks.rados.rados.0.smithi084.stdout:545: expect (ObjNum 167 snap 47 seq_num 167) 2024-01-13T18:02:17.364 INFO:tasks.rados.rados.0.smithi084.stdout:546: rollback oid 47 current snap is 52 2024-01-13T18:02:17.364 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 51 2024-01-13T18:02:17.364 INFO:tasks.rados.rados.0.smithi084.stdout:547: read oid 31 snap -1 2024-01-13T18:02:17.364 INFO:tasks.rados.rados.0.smithi084.stdout:547: expect (ObjNum 114 snap 27 seq_num 114) 2024-01-13T18:02:17.364 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 52 2024-01-13T18:02:17.364 INFO:tasks.rados.rados.0.smithi084.stdout:548: seq_num 181 ranges {2260992=638976} 2024-01-13T18:02:17.381 INFO:tasks.rados.rados.0.smithi084.stdout:548: writing smithi084102331-28 from 2260992 to 2899968 tid 1 2024-01-13T18:02:17.381 INFO:tasks.rados.rados.0.smithi084.stdout:549: snap_create 2024-01-13T18:02:17.381 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 73 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-01-13T18:02:17.381 INFO:tasks.rados.rados.0.smithi084.stdout:543: finishing rollback tid 1 to smithi084102331-43 2024-01-13T18:02:17.381 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 57 (ObjNum 129 snap 0 seq_num 4035444168) dirty dne 2024-01-13T18:02:17.381 INFO:tasks.rados.rados.0.smithi084.stdout:541: finishing copy_from to smithi084102331-42 2024-01-13T18:02:17.381 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 91 (ObjNum 146 snap 40 seq_num 146) dirty exists 2024-01-13T18:02:17.381 INFO:tasks.rados.rados.0.smithi084.stdout:541: finishing copy_from racing read to smithi084102331-42 2024-01-13T18:02:17.381 INFO:tasks.rados.rados.0.smithi084.stdout:538: expect (ObjNum 145 snap 40 seq_num 145) 2024-01-13T18:02:17.418 INFO:tasks.rados.rados.0.smithi084.stdout:542: expect (ObjNum 45 snap 0 seq_num 45) 2024-01-13T18:02:17.438 INFO:tasks.rados.rados.0.smithi084.stdout:546: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:02:17.438 INFO:tasks.rados.rados.0.smithi084.stdout:546: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:02:17.438 INFO:tasks.rados.rados.0.smithi084.stdout:546: finishing rollback tid 2 to smithi084102331-47 2024-01-13T18:02:17.438 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 205 (ObjNum 127 snap 32 seq_num 127) dirty exists 2024-01-13T18:02:17.438 INFO:tasks.rados.rados.0.smithi084.stdout:547: expect (ObjNum 114 snap 27 seq_num 114) 2024-01-13T18:02:17.487 INFO:tasks.rados.rados.0.smithi084.stdout:537: expect (ObjNum 81 snap 14 seq_num 81) 2024-01-13T18:02:17.682 INFO:tasks.rados.rados.0.smithi084.stdout:545: expect (ObjNum 167 snap 47 seq_num 167) 2024-01-13T18:02:17.726 INFO:tasks.rados.rados.0.smithi084.stdout:548: finishing write tid 1 to smithi084102331-28 2024-01-13T18:02:17.727 INFO:tasks.rados.rados.0.smithi084.stdout:548: finishing write tid 2 to smithi084102331-28 2024-01-13T18:02:17.727 INFO:tasks.rados.rados.0.smithi084.stdout:548: finishing write tid 3 to smithi084102331-28 2024-01-13T18:02:17.727 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 136 (ObjNum 181 snap 52 seq_num 181) dirty exists 2024-01-13T18:02:17.727 INFO:tasks.rados.rados.0.smithi084.stdout:548: left oid 28 (ObjNum 181 snap 52 seq_num 181) 2024-01-13T18:02:17.727 INFO:tasks.rados.rados.0.smithi084.stdout:540: expect (ObjNum 159 snap 45 seq_num 159) 2024-01-13T18:02:17.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:17 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:17.869+0000 7f656f9c6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T18:02:17.971 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:17 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:17.639+0000 7fac9c8cd700 -1 mgr handle_mgr_map I was active but no longer am 2024-01-13T18:02:17.971 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:17 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: ignoring --setuser ceph since I am not root 2024-01-13T18:02:17.971 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:17 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: ignoring --setgroup ceph since I am not root 2024-01-13T18:02:17.971 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:17 smithi099 ceph-mgr[112308]: -- 172.21.15.99:0/2027458472 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5617beb4b1e0 con 0x5617beb20c00 2024-01-13T18:02:17.971 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:17 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:17.806+0000 7fe6d0a31200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T18:02:17.972 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:17 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:17.969+0000 7fe6d0a31200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:537: done (11 left) 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:538: done (10 left) 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:539: done (9 left) 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:540: done (8 left) 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:541: done (7 left) 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:542: done (6 left) 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:543: done (5 left) 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:545: done (4 left) 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:546: done (3 left) 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:547: done (2 left) 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:548: done (1 left) 2024-01-13T18:02:17.982 INFO:tasks.rados.rados.0.smithi084.stdout:549: done (0 left) 2024-01-13T18:02:17.983 INFO:tasks.rados.rados.0.smithi084.stdout:550: delete oid 2 current snap is 53 2024-01-13T18:02:17.984 INFO:tasks.rados.rados.0.smithi084.stdout:550: done (0 left) 2024-01-13T18:02:17.984 INFO:tasks.rados.rados.0.smithi084.stdout:551: delete oid 5 current snap is 53 2024-01-13T18:02:17.987 INFO:tasks.rados.rados.0.smithi084.stdout:551: done (0 left) 2024-01-13T18:02:17.987 INFO:tasks.rados.rados.0.smithi084.stdout:552: read oid 43 snap -1 2024-01-13T18:02:17.987 INFO:tasks.rados.rados.0.smithi084.stdout:552: expect deleted 2024-01-13T18:02:17.987 INFO:tasks.rados.rados.0.smithi084.stdout:553: read oid 28 snap 42 2024-01-13T18:02:17.987 INFO:tasks.rados.rados.0.smithi084.stdout:553: expect (ObjNum 93 snap 18 seq_num 93) 2024-01-13T18:02:17.987 INFO:tasks.rados.rados.0.smithi084.stdout:554: delete oid 17 current snap is 53 2024-01-13T18:02:17.989 INFO:tasks.rados.rados.0.smithi084.stdout:552: done (2 left) 2024-01-13T18:02:17.989 INFO:tasks.rados.rados.0.smithi084.stdout:554: done (1 left) 2024-01-13T18:02:17.989 INFO:tasks.rados.rados.0.smithi084.stdout:555: copy_from oid 45 from oid 13 current snap is 53 2024-01-13T18:02:17.989 INFO:tasks.rados.rados.0.smithi084.stdout:556: rmattr oid 36 current snap is 53 2024-01-13T18:02:17.989 INFO:tasks.rados.rados.0.smithi084.stdout:556: done (2 left) 2024-01-13T18:02:17.989 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 53 2024-01-13T18:02:17.990 INFO:tasks.rados.rados.0.smithi084.stdout:557: seq_num 185 ranges {2637824=704512} 2024-01-13T18:02:18.008 INFO:tasks.rados.rados.0.smithi084.stdout:557: writing smithi084102331-11 from 2637824 to 3342336 tid 1 2024-01-13T18:02:18.008 INFO:tasks.rados.rados.0.smithi084.stdout:558: read oid 19 snap -1 2024-01-13T18:02:18.008 INFO:tasks.rados.rados.0.smithi084.stdout:558: expect (ObjNum 167 snap 47 seq_num 167) 2024-01-13T18:02:18.008 INFO:tasks.rados.rados.0.smithi084.stdout:559: read oid 6 snap -1 2024-01-13T18:02:18.008 INFO:tasks.rados.rados.0.smithi084.stdout:559: expect (ObjNum 134 snap 35 seq_num 134) 2024-01-13T18:02:18.009 INFO:tasks.rados.rados.0.smithi084.stdout:560: rollback oid 26 current snap is 53 2024-01-13T18:02:18.009 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 47 2024-01-13T18:02:18.009 INFO:tasks.rados.rados.0.smithi084.stdout:553: expect (ObjNum 93 snap 18 seq_num 93) 2024-01-13T18:02:18.089 INFO:tasks.rados.rados.0.smithi084.stdout:555: finishing copy_from to smithi084102331-45 2024-01-13T18:02:18.089 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 53 (ObjNum 85 snap 15 seq_num 85) dirty exists 2024-01-13T18:02:18.089 INFO:tasks.rados.rados.0.smithi084.stdout:555: finishing copy_from racing read to smithi084102331-45 2024-01-13T18:02:18.089 INFO:tasks.rados.rados.0.smithi084.stdout:559: expect (ObjNum 134 snap 35 seq_num 134) 2024-01-13T18:02:18.145 INFO:tasks.rados.rados.0.smithi084.stdout:560: finishing rollback tid 0 to smithi084102331-26 2024-01-13T18:02:18.145 INFO:tasks.rados.rados.0.smithi084.stdout:560: finishing rollback tid 1 to smithi084102331-26 2024-01-13T18:02:18.145 INFO:tasks.rados.rados.0.smithi084.stdout:560: finishing rollback tid 2 to smithi084102331-26 2024-01-13T18:02:18.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 181 (ObjNum 118 snap 29 seq_num 118) dirty exists 2024-01-13T18:02:18.145 INFO:tasks.rados.rados.0.smithi084.stdout:557: finishing write tid 1 to smithi084102331-11 2024-01-13T18:02:18.145 INFO:tasks.rados.rados.0.smithi084.stdout:557: finishing write tid 2 to smithi084102331-11 2024-01-13T18:02:18.145 INFO:tasks.rados.rados.0.smithi084.stdout:557: finishing write tid 3 to smithi084102331-11 2024-01-13T18:02:18.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 141 (ObjNum 185 snap 53 seq_num 185) dirty exists 2024-01-13T18:02:18.145 INFO:tasks.rados.rados.0.smithi084.stdout:557: left oid 11 (ObjNum 185 snap 53 seq_num 185) 2024-01-13T18:02:18.145 INFO:tasks.rados.rados.0.smithi084.stdout:558: expect (ObjNum 167 snap 47 seq_num 167) 2024-01-13T18:02:18.189 INFO:tasks.rados.rados.0.smithi084.stdout:553: done (5 left) 2024-01-13T18:02:18.189 INFO:tasks.rados.rados.0.smithi084.stdout:555: done (4 left) 2024-01-13T18:02:18.189 INFO:tasks.rados.rados.0.smithi084.stdout:557: done (3 left) 2024-01-13T18:02:18.189 INFO:tasks.rados.rados.0.smithi084.stdout:558: done (2 left) 2024-01-13T18:02:18.190 INFO:tasks.rados.rados.0.smithi084.stdout:559: done (1 left) 2024-01-13T18:02:18.190 INFO:tasks.rados.rados.0.smithi084.stdout:560: done (0 left) 2024-01-13T18:02:18.190 INFO:tasks.rados.rados.0.smithi084.stdout:561: delete oid 33 current snap is 53 2024-01-13T18:02:18.191 INFO:tasks.rados.rados.0.smithi084.stdout:561: done (0 left) 2024-01-13T18:02:18.191 INFO:tasks.rados.rados.0.smithi084.stdout:562: read oid 39 snap -1 2024-01-13T18:02:18.191 INFO:tasks.rados.rados.0.smithi084.stdout:562: expect (ObjNum 176 snap 49 seq_num 176) 2024-01-13T18:02:18.191 INFO:tasks.rados.rados.0.smithi084.stdout:563: read oid 5 snap -1 2024-01-13T18:02:18.191 INFO:tasks.rados.rados.0.smithi084.stdout:563: expect deleted 2024-01-13T18:02:18.191 INFO:tasks.rados.rados.0.smithi084.stdout:564: snap_remove snap 33 2024-01-13T18:02:18.354 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:18.094+0000 7f656f9c6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T18:02:18.354 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:18.282+0000 7f656f9c6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:02:18.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:18.304+0000 7fe6d0a31200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T18:02:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: osdmap e164: 8 total, 8 up, 8 in 2024-01-13T18:02:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-13T18:02:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-13T18:02:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: osdmap e165: 8 total, 8 up, 8 in 2024-01-13T18:02:18.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: from='mgr.24823 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-01-13T18:02:18.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-mon[71325]: mgrmap e29: y(active, starting, since 0.00906326s) 2024-01-13T18:02:18.642 INFO:tasks.rados.rados.0.smithi084.stdout:564: done (2 left) 2024-01-13T18:02:18.642 INFO:tasks.rados.rados.0.smithi084.stdout:565: snap_remove snap 44 2024-01-13T18:02:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: osdmap e164: 8 total, 8 up, 8 in 2024-01-13T18:02:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: osdmap e165: 8 total, 8 up, 8 in 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: from='mgr.24823 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[37908]: mgrmap e29: y(active, starting, since 0.00906326s) 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: osdmap e164: 8 total, 8 up, 8 in 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' 2024-01-13T18:02:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: from='mgr.24823 172.21.15.99:0/4062254355' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-13T18:02:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-01-13T18:02:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: osdmap e165: 8 total, 8 up, 8 in 2024-01-13T18:02:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: from='mgr.24823 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-01-13T18:02:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-mon[52328]: mgrmap e29: y(active, starting, since 0.00906326s) 2024-01-13T18:02:19.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:18.797+0000 7fe6d0a31200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T18:02:19.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:19.028+0000 7fe6d0a31200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T18:02:19.324 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:18 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:18.949+0000 7f656f9c6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T18:02:19.325 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.137+0000 7f656f9c6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:02:19.466 INFO:tasks.rados.rados.0.smithi084.stdout:565: done (2 left) 2024-01-13T18:02:19.466 INFO:tasks.rados.rados.0.smithi084.stdout:566: snap_remove snap 49 2024-01-13T18:02:19.576 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.322+0000 7f656f9c6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T18:02:19.576 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.443+0000 7f656f9c6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T18:02:19.576 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:19] ENGINE Bus STARTING 2024-01-13T18:02:19.576 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: CherryPy Checker: 2024-01-13T18:02:19.576 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: The Application mounted at '' has an empty config. 2024-01-13T18:02:19.576 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.576 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:19] ENGINE Serving on http://:::9283 2024-01-13T18:02:19.576 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:19] ENGINE Bus STARTED 2024-01-13T18:02:19.576 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:19] ENGINE Bus STOPPING 2024-01-13T18:02:19.577 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:19] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:02:19.734 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:19.447+0000 7fe6d0a31200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: osdmap e166: 8 total, 8 up, 8 in 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: Active manager daemon y restarted 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: Activating manager daemon y 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: osdmap e167: 8 total, 8 up, 8 in 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: mgrmap e30: y(active, starting, since 0.00648607s) 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:02:19.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-13T18:02:19.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:19 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:19.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:19] ENGINE Bus STOPPED 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:19] ENGINE Bus STARTING 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.737+0000 7f64cd5ec700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.737+0000 7f64cd5ec700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.737+0000 7f64cd5ec700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.737+0000 7f64cd5ec700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.737+0000 7f64cd5ec700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.741+0000 7f64d0df3700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.741+0000 7f64d0df3700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.741+0000 7f64d0df3700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.741+0000 7f64d0df3700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:19.741+0000 7f64d0df3700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:19.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:19] ENGINE Serving on http://:::9283 2024-01-13T18:02:19.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:19] ENGINE Bus STARTED 2024-01-13T18:02:19.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: osdmap e166: 8 total, 8 up, 8 in 2024-01-13T18:02:19.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: Active manager daemon y restarted 2024-01-13T18:02:19.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: Activating manager daemon y 2024-01-13T18:02:19.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-13T18:02:19.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: osdmap e167: 8 total, 8 up, 8 in 2024-01-13T18:02:19.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: mgrmap e30: y(active, starting, since 0.00648607s) 2024-01-13T18:02:19.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-13T18:02:19.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:02:19.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T18:02:19.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: osdmap e166: 8 total, 8 up, 8 in 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: Active manager daemon y restarted 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: Activating manager daemon y 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: osdmap e167: 8 total, 8 up, 8 in 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: mgrmap e30: y(active, starting, since 0.00648607s) 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:02:19.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T18:02:19.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T18:02:19.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:19.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-13T18:02:19.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:19 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:20.472 INFO:tasks.rados.rados.0.smithi084.stdout:566: done (2 left) 2024-01-13T18:02:20.472 INFO:tasks.rados.rados.0.smithi084.stdout:567: copy_from oid 22 from oid 10 current snap is 53 2024-01-13T18:02:20.472 INFO:tasks.rados.rados.0.smithi084.stdout:562: expect (ObjNum 176 snap 49 seq_num 176) 2024-01-13T18:02:20.618 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:20 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:20.194+0000 7fe6d0a31200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T18:02:20.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:20 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:20.296+0000 7fe6d0a31200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T18:02:20.666 INFO:tasks.rados.rados.0.smithi084.stdout:562: done (2 left) 2024-01-13T18:02:20.666 INFO:tasks.rados.rados.0.smithi084.stdout:563: done (1 left) 2024-01-13T18:02:20.666 INFO:tasks.rados.rados.0.smithi084.stdout:568: rmattr oid 20 current snap is 53 2024-01-13T18:02:20.666 INFO:tasks.rados.rados.0.smithi084.stdout:568: done (1 left) 2024-01-13T18:02:20.667 INFO:tasks.rados.rados.0.smithi084.stdout:569: read oid 41 snap -1 2024-01-13T18:02:20.667 INFO:tasks.rados.rados.0.smithi084.stdout:569: expect deleted 2024-01-13T18:02:20.667 INFO:tasks.rados.rados.0.smithi084.stdout:570: setattr oid 36 current snap is 53 2024-01-13T18:02:20.667 INFO:tasks.rados.rados.0.smithi084.stdout:571: delete oid 4 current snap is 53 2024-01-13T18:02:20.667 INFO:tasks.rados.rados.0.smithi084.stdout:567: finishing copy_from to smithi084102331-22 2024-01-13T18:02:20.667 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 60 (ObjNum 152 snap 41 seq_num 152) dirty exists 2024-01-13T18:02:20.667 INFO:tasks.rados.rados.0.smithi084.stdout:567: finishing copy_from racing read to smithi084102331-22 2024-01-13T18:02:20.671 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 197 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-01-13T18:02:20.673 INFO:tasks.rados.rados.0.smithi084.stdout:567: done (3 left) 2024-01-13T18:02:20.673 INFO:tasks.rados.rados.0.smithi084.stdout:569: done (2 left) 2024-01-13T18:02:20.673 INFO:tasks.rados.rados.0.smithi084.stdout:570: done (1 left) 2024-01-13T18:02:20.673 INFO:tasks.rados.rados.0.smithi084.stdout:571: done (0 left) 2024-01-13T18:02:20.673 INFO:tasks.rados.rados.0.smithi084.stdout:572: snap_create 2024-01-13T18:02:20.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[37908]: Manager daemon y is now available 2024-01-13T18:02:20.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:20.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:20.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:20.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:02:20.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T18:02:20.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[37908]: osdmap e168: 8 total, 8 up, 8 in 2024-01-13T18:02:20.915 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[52328]: Manager daemon y is now available 2024-01-13T18:02:20.915 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:20.915 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:20.915 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:20.915 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:02:20.916 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T18:02:20.916 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:20 smithi084 ceph-mon[52328]: osdmap e168: 8 total, 8 up, 8 in 2024-01-13T18:02:20.928 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:20 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:20.926+0000 7fe6d0a31200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T18:02:20.928 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:20 smithi099 ceph-mon[71325]: Manager daemon y is now available 2024-01-13T18:02:20.928 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:20 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:20.928 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:20 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:20.929 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:20 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:20.929 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:20 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:02:20.929 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:20 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T18:02:20.929 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:20 smithi099 ceph-mon[71325]: osdmap e168: 8 total, 8 up, 8 in 2024-01-13T18:02:21.285 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:21 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:21.024+0000 7fe6d0a31200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T18:02:21.285 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:21 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:21.118+0000 7fe6d0a31200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T18:02:21.580 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:21 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:21.370+0000 7fe6d0a31200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T18:02:21.580 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:21 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:21.471+0000 7fe6d0a31200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T18:02:21.580 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:21 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:21.579+0000 7fe6d0a31200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T18:02:21.661 INFO:tasks.rados.rados.0.smithi084.stdout:572: done (0 left) 2024-01-13T18:02:21.661 INFO:tasks.rados.rados.0.smithi084.stdout:573: rollback oid 47 current snap is 54 2024-01-13T18:02:21.661 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 50 2024-01-13T18:02:21.661 INFO:tasks.rados.rados.0.smithi084.stdout:574: read oid 10 snap -1 2024-01-13T18:02:21.661 INFO:tasks.rados.rados.0.smithi084.stdout:574: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:02:21.661 INFO:tasks.rados.rados.0.smithi084.stdout:575: read oid 42 snap 43 2024-01-13T18:02:21.662 INFO:tasks.rados.rados.0.smithi084.stdout:575: expect (ObjNum 93 snap 18 seq_num 93) 2024-01-13T18:02:21.662 INFO:tasks.rados.rados.0.smithi084.stdout:576: snap_remove snap 48 2024-01-13T18:02:21.834 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:21 smithi099 ceph-mon[71325]: mgrmap e31: y(active, since 1.1948s) 2024-01-13T18:02:21.834 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:21 smithi099 ceph-mon[71325]: [13/Jan/2024:18:02:21] ENGINE Bus STARTING 2024-01-13T18:02:21.834 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:21 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:21.832+0000 7fe6d0a31200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T18:02:21.896 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:21 smithi084 ceph-mon[37908]: mgrmap e31: y(active, since 1.1948s) 2024-01-13T18:02:21.896 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:21 smithi084 ceph-mon[37908]: [13/Jan/2024:18:02:21] ENGINE Bus STARTING 2024-01-13T18:02:21.896 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:21 smithi084 ceph-mon[52328]: mgrmap e31: y(active, since 1.1948s) 2024-01-13T18:02:21.896 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:21 smithi084 ceph-mon[52328]: [13/Jan/2024:18:02:21] ENGINE Bus STARTING 2024-01-13T18:02:22.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:21 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:21.938+0000 7fe6d0a31200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T18:02:22.587 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:22 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:22.129+0000 7fe6d0a31200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T18:02:22.587 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:22 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:22.218+0000 7fe6d0a31200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T18:02:22.669 INFO:tasks.rados.rados.0.smithi084.stdout:576: done (3 left) 2024-01-13T18:02:22.669 INFO:tasks.rados.rados.0.smithi084.stdout:577: rmattr oid 46 current snap is 54 2024-01-13T18:02:22.669 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 54 2024-01-13T18:02:22.669 INFO:tasks.rados.rados.0.smithi084.stdout:578: seq_num 188 ranges {2416640=753664} 2024-01-13T18:02:22.681 INFO:tasks.rados.rados.0.smithi084.stdout:578: writing smithi084102331-26 from 2416640 to 3170304 tid 1 2024-01-13T18:02:22.682 INFO:tasks.rados.rados.0.smithi084.stdout:579: read oid 24 snap -1 2024-01-13T18:02:22.682 INFO:tasks.rados.rados.0.smithi084.stdout:579: expect (ObjNum 133 snap 35 seq_num 133) 2024-01-13T18:02:22.682 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 54 2024-01-13T18:02:22.682 INFO:tasks.rados.rados.0.smithi084.stdout:580: seq_num 189 ranges {0=770048} 2024-01-13T18:02:22.686 INFO:tasks.rados.rados.0.smithi084.stdout:580: writing smithi084102331-3 from 0 to 770048 tid 1 2024-01-13T18:02:22.686 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 54 2024-01-13T18:02:22.686 INFO:tasks.rados.rados.0.smithi084.stdout:575: expect (ObjNum 93 snap 18 seq_num 93) 2024-01-13T18:02:22.756 INFO:tasks.rados.rados.0.smithi084.stdout:573: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:02:22.756 INFO:tasks.rados.rados.0.smithi084.stdout:573: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:02:22.756 INFO:tasks.rados.rados.0.smithi084.stdout:573: finishing rollback tid 2 to smithi084102331-47 2024-01-13T18:02:22.756 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 225 (ObjNum 127 snap 32 seq_num 127) dirty exists 2024-01-13T18:02:22.756 INFO:tasks.rados.rados.0.smithi084.stdout:581: seq_num 190 ranges {516096=786432} 2024-01-13T18:02:22.764 INFO:tasks.rados.rados.0.smithi084.stdout:581: writing smithi084102331-25 from 516096 to 1302528 tid 1 2024-01-13T18:02:22.764 INFO:tasks.rados.rados.0.smithi084.stdout:573: done (7 left) 2024-01-13T18:02:22.764 INFO:tasks.rados.rados.0.smithi084.stdout:575: done (6 left) 2024-01-13T18:02:22.764 INFO:tasks.rados.rados.0.smithi084.stdout:582: read oid 48 snap 45 2024-01-13T18:02:22.764 INFO:tasks.rados.rados.0.smithi084.stdout:582: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:02:22.764 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 54 2024-01-13T18:02:22.764 INFO:tasks.rados.rados.0.smithi084.stdout:574: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:02:22.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:22 smithi099 ceph-mon[71325]: [13/Jan/2024:18:02:21] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T18:02:22.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:22 smithi099 ceph-mon[71325]: [13/Jan/2024:18:02:21] ENGINE Serving on http://172.21.15.84:8765 2024-01-13T18:02:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:22 smithi099 ceph-mon[71325]: [13/Jan/2024:18:02:21] ENGINE Bus STARTED 2024-01-13T18:02:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:22 smithi099 ceph-mon[71325]: pgmap v5: 121 pgs: 121 active+clean; 129 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:22 smithi099 ceph-mon[71325]: mgrmap e32: y(active, since 2s) 2024-01-13T18:02:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:22 smithi099 ceph-mon[71325]: osdmap e169: 8 total, 8 up, 8 in 2024-01-13T18:02:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:22 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:22 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:22.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[37908]: [13/Jan/2024:18:02:21] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T18:02:22.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[37908]: [13/Jan/2024:18:02:21] ENGINE Serving on http://172.21.15.84:8765 2024-01-13T18:02:22.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[37908]: [13/Jan/2024:18:02:21] ENGINE Bus STARTED 2024-01-13T18:02:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[37908]: pgmap v5: 121 pgs: 121 active+clean; 129 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[37908]: mgrmap e32: y(active, since 2s) 2024-01-13T18:02:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[37908]: osdmap e169: 8 total, 8 up, 8 in 2024-01-13T18:02:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[52328]: [13/Jan/2024:18:02:21] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T18:02:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[52328]: [13/Jan/2024:18:02:21] ENGINE Serving on http://172.21.15.84:8765 2024-01-13T18:02:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[52328]: [13/Jan/2024:18:02:21] ENGINE Bus STARTED 2024-01-13T18:02:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[52328]: pgmap v5: 121 pgs: 121 active+clean; 129 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[52328]: mgrmap e32: y(active, since 2s) 2024-01-13T18:02:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[52328]: osdmap e169: 8 total, 8 up, 8 in 2024-01-13T18:02:22.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:22.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:22 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:23.034 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 142 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-01-13T18:02:23.034 INFO:tasks.rados.rados.0.smithi084.stdout:583: seq_num 191 ranges {319488=802816} 2024-01-13T18:02:23.041 INFO:tasks.rados.rados.0.smithi084.stdout:583: writing smithi084102331-38 from 319488 to 1122304 tid 1 2024-01-13T18:02:23.041 INFO:tasks.rados.rados.0.smithi084.stdout:574: done (7 left) 2024-01-13T18:02:23.041 INFO:tasks.rados.rados.0.smithi084.stdout:577: done (6 left) 2024-01-13T18:02:23.041 INFO:tasks.rados.rados.0.smithi084.stdout:584: rmattr oid 19 current snap is 54 2024-01-13T18:02:23.041 INFO:tasks.rados.rados.0.smithi084.stdout:579: expect (ObjNum 133 snap 35 seq_num 133) 2024-01-13T18:02:23.102 INFO:tasks.rados.rados.0.smithi084.stdout:578: finishing write tid 1 to smithi084102331-26 2024-01-13T18:02:23.102 INFO:tasks.rados.rados.0.smithi084.stdout:578: finishing write tid 2 to smithi084102331-26 2024-01-13T18:02:23.102 INFO:tasks.rados.rados.0.smithi084.stdout:578: finishing write tid 3 to smithi084102331-26 2024-01-13T18:02:23.102 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 206 (ObjNum 188 snap 54 seq_num 188) dirty exists 2024-01-13T18:02:23.102 INFO:tasks.rados.rados.0.smithi084.stdout:578: left oid 26 (ObjNum 188 snap 54 seq_num 188) 2024-01-13T18:02:23.102 INFO:tasks.rados.rados.0.smithi084.stdout:580: finishing write tid 1 to smithi084102331-3 2024-01-13T18:02:23.102 INFO:tasks.rados.rados.0.smithi084.stdout:580: finishing write tid 2 to smithi084102331-3 2024-01-13T18:02:23.102 INFO:tasks.rados.rados.0.smithi084.stdout:580: finishing write tid 3 to smithi084102331-3 2024-01-13T18:02:23.102 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 257 (ObjNum 189 snap 54 seq_num 189) dirty exists 2024-01-13T18:02:23.102 INFO:tasks.rados.rados.0.smithi084.stdout:580: left oid 3 (ObjNum 189 snap 54 seq_num 189) 2024-01-13T18:02:23.102 INFO:tasks.rados.rados.0.smithi084.stdout:578: done (6 left) 2024-01-13T18:02:23.103 INFO:tasks.rados.rados.0.smithi084.stdout:579: done (5 left) 2024-01-13T18:02:23.103 INFO:tasks.rados.rados.0.smithi084.stdout:580: done (4 left) 2024-01-13T18:02:23.103 INFO:tasks.rados.rados.0.smithi084.stdout:585: rmattr oid 47 current snap is 54 2024-01-13T18:02:23.103 INFO:tasks.rados.rados.0.smithi084.stdout:585: done (4 left) 2024-01-13T18:02:23.103 INFO:tasks.rados.rados.0.smithi084.stdout:586: rmattr oid 47 current snap is 54 2024-01-13T18:02:23.103 INFO:tasks.rados.rados.0.smithi084.stdout:586: done (4 left) 2024-01-13T18:02:23.103 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 54 2024-01-13T18:02:23.103 INFO:tasks.rados.rados.0.smithi084.stdout:582: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:02:23.129 INFO:tasks.rados.rados.0.smithi084.stdout:581: finishing write tid 1 to smithi084102331-25 2024-01-13T18:02:23.129 INFO:tasks.rados.rados.0.smithi084.stdout:581: finishing write tid 2 to smithi084102331-25 2024-01-13T18:02:23.129 INFO:tasks.rados.rados.0.smithi084.stdout:581: finishing write tid 3 to smithi084102331-25 2024-01-13T18:02:23.129 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 208 (ObjNum 190 snap 54 seq_num 190) dirty exists 2024-01-13T18:02:23.129 INFO:tasks.rados.rados.0.smithi084.stdout:581: left oid 25 (ObjNum 190 snap 54 seq_num 190) 2024-01-13T18:02:23.129 INFO:tasks.rados.rados.0.smithi084.stdout:587: seq_num 192 ranges {0=417792,417792=401408} 2024-01-13T18:02:23.131 INFO:tasks.rados.rados.0.smithi084.stdout:587: writing smithi084102331-33 from 0 to 417792 tid 1 2024-01-13T18:02:23.134 INFO:tasks.rados.rados.0.smithi084.stdout:587: writing smithi084102331-33 from 417792 to 819200 tid 2 2024-01-13T18:02:23.134 INFO:tasks.rados.rados.0.smithi084.stdout:581: done (4 left) 2024-01-13T18:02:23.134 INFO:tasks.rados.rados.0.smithi084.stdout:582: done (3 left) 2024-01-13T18:02:23.134 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 54 2024-01-13T18:02:23.134 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 100 (ObjNum 167 snap 47 seq_num 167) dirty exists 2024-01-13T18:02:23.134 INFO:tasks.rados.rados.0.smithi084.stdout:583: finishing write tid 1 to smithi084102331-38 2024-01-13T18:02:23.134 INFO:tasks.rados.rados.0.smithi084.stdout:583: finishing write tid 2 to smithi084102331-38 2024-01-13T18:02:23.134 INFO:tasks.rados.rados.0.smithi084.stdout:583: finishing write tid 3 to smithi084102331-38 2024-01-13T18:02:23.134 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 260 (ObjNum 191 snap 54 seq_num 191) dirty exists 2024-01-13T18:02:23.134 INFO:tasks.rados.rados.0.smithi084.stdout:583: left oid 38 (ObjNum 191 snap 54 seq_num 191) 2024-01-13T18:02:23.134 INFO:tasks.rados.rados.0.smithi084.stdout:588: seq_num 193 ranges {368640=434176,802816=401408} 2024-01-13T18:02:23.137 INFO:tasks.rados.rados.0.smithi084.stdout:588: writing smithi084102331-27 from 368640 to 802816 tid 1 2024-01-13T18:02:23.140 INFO:tasks.rados.rados.0.smithi084.stdout:588: writing smithi084102331-27 from 802816 to 1204224 tid 2 2024-01-13T18:02:23.141 INFO:tasks.rados.rados.0.smithi084.stdout:583: done (3 left) 2024-01-13T18:02:23.141 INFO:tasks.rados.rados.0.smithi084.stdout:584: done (2 left) 2024-01-13T18:02:23.141 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 54 2024-01-13T18:02:23.141 INFO:tasks.rados.rados.0.smithi084.stdout:587: finishing write tid 1 to smithi084102331-33 2024-01-13T18:02:23.141 INFO:tasks.rados.rados.0.smithi084.stdout:587: finishing write tid 2 to smithi084102331-33 2024-01-13T18:02:23.141 INFO:tasks.rados.rados.0.smithi084.stdout:587: finishing write tid 3 to smithi084102331-33 2024-01-13T18:02:23.141 INFO:tasks.rados.rados.0.smithi084.stdout:587: finishing write tid 4 to smithi084102331-33 2024-01-13T18:02:23.141 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 211 (ObjNum 192 snap 54 seq_num 192) dirty exists 2024-01-13T18:02:23.141 INFO:tasks.rados.rados.0.smithi084.stdout:587: left oid 33 (ObjNum 192 snap 54 seq_num 192) 2024-01-13T18:02:23.141 INFO:tasks.rados.rados.0.smithi084.stdout:589: seq_num 194 ranges {3678208=458752,4136960=401408} 2024-01-13T18:02:23.163 INFO:tasks.rados.rados.0.smithi084.stdout:589: writing smithi084102331-23 from 3678208 to 4136960 tid 1 2024-01-13T18:02:23.166 INFO:tasks.rados.rados.0.smithi084.stdout:589: writing smithi084102331-23 from 4136960 to 4538368 tid 2 2024-01-13T18:02:23.166 INFO:tasks.rados.rados.0.smithi084.stdout:587: done (2 left) 2024-01-13T18:02:23.166 INFO:tasks.rados.rados.0.smithi084.stdout:590: read oid 20 snap -1 2024-01-13T18:02:23.166 INFO:tasks.rados.rados.0.smithi084.stdout:590: expect deleted 2024-01-13T18:02:23.166 INFO:tasks.rados.rados.0.smithi084.stdout:591: read oid 21 snap -1 2024-01-13T18:02:23.166 INFO:tasks.rados.rados.0.smithi084.stdout:591: expect (ObjNum 41 snap 0 seq_num 41) 2024-01-13T18:02:23.166 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 54 2024-01-13T18:02:23.167 INFO:tasks.rados.rados.0.smithi084.stdout:588: finishing write tid 1 to smithi084102331-27 2024-01-13T18:02:23.167 INFO:tasks.rados.rados.0.smithi084.stdout:588: finishing write tid 2 to smithi084102331-27 2024-01-13T18:02:23.167 INFO:tasks.rados.rados.0.smithi084.stdout:588: finishing write tid 3 to smithi084102331-27 2024-01-13T18:02:23.167 INFO:tasks.rados.rados.0.smithi084.stdout:588: finishing write tid 4 to smithi084102331-27 2024-01-13T18:02:23.167 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 156 (ObjNum 193 snap 54 seq_num 193) dirty exists 2024-01-13T18:02:23.167 INFO:tasks.rados.rados.0.smithi084.stdout:588: left oid 27 (ObjNum 193 snap 54 seq_num 193) 2024-01-13T18:02:23.167 INFO:tasks.rados.rados.0.smithi084.stdout:592: seq_num 195 ranges {0=475136,475136=401408} 2024-01-13T18:02:23.168 INFO:tasks.rados.rados.0.smithi084.stdout:592: writing smithi084102331-43 from 0 to 475136 tid 1 2024-01-13T18:02:23.171 INFO:tasks.rados.rados.0.smithi084.stdout:592: writing smithi084102331-43 from 475136 to 876544 tid 2 2024-01-13T18:02:23.171 INFO:tasks.rados.rados.0.smithi084.stdout:588: done (4 left) 2024-01-13T18:02:23.171 INFO:tasks.rados.rados.0.smithi084.stdout:593: delete oid 12 current snap is 54 2024-01-13T18:02:23.171 INFO:tasks.rados.rados.0.smithi084.stdout:589: finishing write tid 1 to smithi084102331-23 2024-01-13T18:02:23.171 INFO:tasks.rados.rados.0.smithi084.stdout:589: finishing write tid 2 to smithi084102331-23 2024-01-13T18:02:23.171 INFO:tasks.rados.rados.0.smithi084.stdout:589: finishing write tid 3 to smithi084102331-23 2024-01-13T18:02:23.171 INFO:tasks.rados.rados.0.smithi084.stdout:591: expect (ObjNum 41 snap 0 seq_num 41) 2024-01-13T18:02:23.193 INFO:tasks.rados.rados.0.smithi084.stdout:589: finishing write tid 4 to smithi084102331-23 2024-01-13T18:02:23.193 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 180 (ObjNum 194 snap 54 seq_num 194) dirty exists 2024-01-13T18:02:23.193 INFO:tasks.rados.rados.0.smithi084.stdout:589: left oid 23 (ObjNum 194 snap 54 seq_num 194) 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:592: finishing write tid 1 to smithi084102331-43 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:589: done (4 left) 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:590: done (3 left) 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:591: done (2 left) 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:593: done (1 left) 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:594: copy_from oid 34 from oid 26 current snap is 54 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:592: finishing write tid 2 to smithi084102331-43 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:592: finishing write tid 3 to smithi084102331-43 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:592: finishing write tid 4 to smithi084102331-43 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 89 (ObjNum 195 snap 54 seq_num 195) dirty exists 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:592: left oid 43 (ObjNum 195 snap 54 seq_num 195) 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:592: done (1 left) 2024-01-13T18:02:23.194 INFO:tasks.rados.rados.0.smithi084.stdout:595: snap_create 2024-01-13T18:02:23.208 INFO:tasks.rados.rados.0.smithi084.stdout:594: finishing copy_from to smithi084102331-34 2024-01-13T18:02:23.208 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 206 (ObjNum 188 snap 54 seq_num 188) dirty exists 2024-01-13T18:02:23.209 INFO:tasks.rados.rados.0.smithi084.stdout:594: finishing copy_from racing read to smithi084102331-34 2024-01-13T18:02:23.257 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:23 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:23.040+0000 7fe6d0a31200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T18:02:23.257 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:23 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:23.255+0000 7fe6d0a31200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T18:02:23.619 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:23 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:23.461+0000 7fe6d0a31200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:02:23.672 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:02:23 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:02:23.507Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi099.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.99:8443: connect: connection refused" 2024-01-13T18:02:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:23 smithi084 ceph-mon[37908]: osdmap e170: 8 total, 8 up, 8 in 2024-01-13T18:02:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:23 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:23 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:23 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:23 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:23 smithi084 ceph-mon[52328]: osdmap e170: 8 total, 8 up, 8 in 2024-01-13T18:02:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:23 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:23 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:23 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:23.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:23 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:24.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:23 smithi099 ceph-mon[71325]: osdmap e170: 8 total, 8 up, 8 in 2024-01-13T18:02:24.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:23 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:24.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:23 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:24.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:23 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:24.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:23 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:24.201 INFO:tasks.rados.rados.0.smithi084.stdout:594: done (1 left) 2024-01-13T18:02:24.201 INFO:tasks.rados.rados.0.smithi084.stdout:595: done (0 left) 2024-01-13T18:02:24.201 INFO:tasks.rados.rados.0.smithi084.stdout:596: read oid 39 snap -1 2024-01-13T18:02:24.201 INFO:tasks.rados.rados.0.smithi084.stdout:596: expect (ObjNum 176 snap 49 seq_num 176) 2024-01-13T18:02:24.201 INFO:tasks.rados.rados.0.smithi084.stdout:597: read oid 8 snap 51 2024-01-13T18:02:24.201 INFO:tasks.rados.rados.0.smithi084.stdout:597: expect (ObjNum 177 snap 49 seq_num 177) 2024-01-13T18:02:24.201 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 55 2024-01-13T18:02:24.201 INFO:tasks.rados.rados.0.smithi084.stdout:598: seq_num 197 ranges {0=507904,507904=401408} 2024-01-13T18:02:24.204 INFO:tasks.rados.rados.0.smithi084.stdout:598: writing smithi084102331-20 from 0 to 507904 tid 1 2024-01-13T18:02:24.206 INFO:tasks.rados.rados.0.smithi084.stdout:598: writing smithi084102331-20 from 507904 to 909312 tid 2 2024-01-13T18:02:24.206 INFO:tasks.rados.rados.0.smithi084.stdout:599: read oid 11 snap 47 2024-01-13T18:02:24.206 INFO:tasks.rados.rados.0.smithi084.stdout:599: expect (ObjNum 147 snap 41 seq_num 147) 2024-01-13T18:02:24.206 INFO:tasks.rados.rados.0.smithi084.stdout:600: rollback oid 31 current snap is 55 2024-01-13T18:02:24.207 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 47 2024-01-13T18:02:24.207 INFO:tasks.rados.rados.0.smithi084.stdout:601: rollback oid 38 current snap is 55 2024-01-13T18:02:24.207 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 43 2024-01-13T18:02:24.207 INFO:tasks.rados.rados.0.smithi084.stdout:602: setattr oid 50 current snap is 55 2024-01-13T18:02:24.207 INFO:tasks.rados.rados.0.smithi084.stdout:597: expect (ObjNum 177 snap 49 seq_num 177) 2024-01-13T18:02:24.225 INFO:tasks.rados.rados.0.smithi084.stdout:598: finishing write tid 1 to smithi084102331-20 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:600: finishing rollback tid 0 to smithi084102331-31 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:600: finishing rollback tid 1 to smithi084102331-31 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:600: finishing rollback tid 2 to smithi084102331-31 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 264 (ObjNum 114 snap 27 seq_num 114) dirty exists 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:598: finishing write tid 2 to smithi084102331-20 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:601: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:598: finishing write tid 3 to smithi084102331-20 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:601: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 267 (ObjNum 65 snap 0 seq_num 4037701024) dirty dne 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:598: finishing write tid 4 to smithi084102331-20 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 103 (ObjNum 197 snap 55 seq_num 197) dirty exists 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:598: left oid 20 (ObjNum 197 snap 55 seq_num 197) 2024-01-13T18:02:24.226 INFO:tasks.rados.rados.0.smithi084.stdout:596: expect (ObjNum 176 snap 49 seq_num 176) 2024-01-13T18:02:24.417 INFO:tasks.rados.rados.0.smithi084.stdout:599: expect (ObjNum 147 snap 41 seq_num 147) 2024-01-13T18:02:24.541 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:24.154+0000 7fe6d0a31200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T18:02:24.541 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:24.353+0000 7fe6d0a31200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:02:24.552 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 213 (ObjNum 145 snap 40 seq_num 145) dirty exists 2024-01-13T18:02:24.553 INFO:tasks.rados.rados.0.smithi084.stdout:596: done (6 left) 2024-01-13T18:02:24.553 INFO:tasks.rados.rados.0.smithi084.stdout:597: done (5 left) 2024-01-13T18:02:24.553 INFO:tasks.rados.rados.0.smithi084.stdout:598: done (4 left) 2024-01-13T18:02:24.553 INFO:tasks.rados.rados.0.smithi084.stdout:599: done (3 left) 2024-01-13T18:02:24.553 INFO:tasks.rados.rados.0.smithi084.stdout:600: done (2 left) 2024-01-13T18:02:24.553 INFO:tasks.rados.rados.0.smithi084.stdout:601: done (1 left) 2024-01-13T18:02:24.553 INFO:tasks.rados.rados.0.smithi084.stdout:602: done (0 left) 2024-01-13T18:02:24.553 INFO:tasks.rados.rados.0.smithi084.stdout:603: delete oid 25 current snap is 55 2024-01-13T18:02:24.554 INFO:tasks.rados.rados.0.smithi084.stdout:603: done (0 left) 2024-01-13T18:02:24.554 INFO:tasks.rados.rados.0.smithi084.stdout:604: delete oid 49 current snap is 55 2024-01-13T18:02:24.558 INFO:tasks.rados.rados.0.smithi084.stdout:604: done (0 left) 2024-01-13T18:02:24.558 INFO:tasks.rados.rados.0.smithi084.stdout:605: rmattr oid 13 current snap is 55 2024-01-13T18:02:24.558 INFO:tasks.rados.rados.0.smithi084.stdout:606: read oid 28 snap -1 2024-01-13T18:02:24.558 INFO:tasks.rados.rados.0.smithi084.stdout:606: expect (ObjNum 181 snap 52 seq_num 181) 2024-01-13T18:02:24.559 INFO:tasks.rados.rados.0.smithi084.stdout:607: copy_from oid 23 from oid 45 current snap is 55 2024-01-13T18:02:24.560 INFO:tasks.rados.rados.0.smithi084.stdout:608: read oid 2 snap -1 2024-01-13T18:02:24.560 INFO:tasks.rados.rados.0.smithi084.stdout:608: expect deleted 2024-01-13T18:02:24.560 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 55 2024-01-13T18:02:24.560 INFO:tasks.rados.rados.0.smithi084.stdout:609: seq_num 200 ranges {106496=557056,663552=401408} 2024-01-13T18:02:24.562 INFO:tasks.rados.rados.0.smithi084.stdout:609: writing smithi084102331-7 from 106496 to 663552 tid 1 2024-01-13T18:02:24.566 INFO:tasks.rados.rados.0.smithi084.stdout:609: writing smithi084102331-7 from 663552 to 1064960 tid 2 2024-01-13T18:02:24.567 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 55 2024-01-13T18:02:24.567 INFO:tasks.rados.rados.0.smithi084.stdout:610: seq_num 201 ranges {2965504=573440,3538944=401408} 2024-01-13T18:02:24.584 INFO:tasks.rados.rados.0.smithi084.stdout:610: writing smithi084102331-39 from 2965504 to 3538944 tid 1 2024-01-13T18:02:24.587 INFO:tasks.rados.rados.0.smithi084.stdout:610: writing smithi084102331-39 from 3538944 to 3940352 tid 2 2024-01-13T18:02:24.587 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 55 2024-01-13T18:02:24.587 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 138 (ObjNum 85 snap 15 seq_num 85) dirty exists 2024-01-13T18:02:24.587 INFO:tasks.rados.rados.0.smithi084.stdout:611: seq_num 202 ranges {696320=589824,1286144=401408} 2024-01-13T18:02:24.594 INFO:tasks.rados.rados.0.smithi084.stdout:611: writing smithi084102331-21 from 696320 to 1286144 tid 1 2024-01-13T18:02:24.597 INFO:tasks.rados.rados.0.smithi084.stdout:611: writing smithi084102331-21 from 1286144 to 1687552 tid 2 2024-01-13T18:02:24.597 INFO:tasks.rados.rados.0.smithi084.stdout:605: done (6 left) 2024-01-13T18:02:24.597 INFO:tasks.rados.rados.0.smithi084.stdout:612: copy_from oid 11 from oid 12 current snap is 55 2024-01-13T18:02:24.597 INFO:tasks.rados.rados.0.smithi084.stdout:609: finishing write tid 1 to smithi084102331-7 2024-01-13T18:02:24.597 INFO:tasks.rados.rados.0.smithi084.stdout:606: expect (ObjNum 181 snap 52 seq_num 181) 2024-01-13T18:02:24.719 INFO:tasks.rados.rados.0.smithi084.stdout:609: finishing write tid 2 to smithi084102331-7 2024-01-13T18:02:24.719 INFO:tasks.rados.rados.0.smithi084.stdout:609: finishing write tid 3 to smithi084102331-7 2024-01-13T18:02:24.719 INFO:tasks.rados.rados.0.smithi084.stdout:607: finishing copy_from to smithi084102331-23 2024-01-13T18:02:24.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 53 (ObjNum 85 snap 15 seq_num 85) dirty exists 2024-01-13T18:02:24.719 INFO:tasks.rados.rados.0.smithi084.stdout:609: finishing write tid 4 to smithi084102331-7 2024-01-13T18:02:24.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 93 (ObjNum 200 snap 55 seq_num 200) dirty exists 2024-01-13T18:02:24.719 INFO:tasks.rados.rados.0.smithi084.stdout:609: left oid 7 (ObjNum 200 snap 55 seq_num 200) 2024-01-13T18:02:24.719 INFO:tasks.rados.rados.0.smithi084.stdout:607: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:606: done (6 left) 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:607: done (5 left) 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:608: done (4 left) 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:609: done (3 left) 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 55 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:610: finishing write tid 1 to smithi084102331-39 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:610: finishing write tid 2 to smithi084102331-39 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:610: finishing write tid 3 to smithi084102331-39 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:610: finishing write tid 4 to smithi084102331-39 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 145 (ObjNum 201 snap 55 seq_num 201) dirty exists 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:610: left oid 39 (ObjNum 201 snap 55 seq_num 201) 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:611: finishing write tid 1 to smithi084102331-21 2024-01-13T18:02:24.720 INFO:tasks.rados.rados.0.smithi084.stdout:613: seq_num 203 ranges {2252800=606208,2859008=401408} 2024-01-13T18:02:24.734 INFO:tasks.rados.rados.0.smithi084.stdout:613: writing smithi084102331-6 from 2252800 to 2859008 tid 1 2024-01-13T18:02:24.737 INFO:tasks.rados.rados.0.smithi084.stdout:613: writing smithi084102331-6 from 2859008 to 3260416 tid 2 2024-01-13T18:02:24.737 INFO:tasks.rados.rados.0.smithi084.stdout:610: done (3 left) 2024-01-13T18:02:24.737 INFO:tasks.rados.rados.0.smithi084.stdout:614: delete oid 46 current snap is 55 2024-01-13T18:02:24.737 INFO:tasks.rados.rados.0.smithi084.stdout:612: finishing copy_from to smithi084102331-11 2024-01-13T18:02:24.737 INFO:tasks.rados.rados.0.smithi084.stdout:612: got expected ENOENT (src dne) 2024-01-13T18:02:24.737 INFO:tasks.rados.rados.0.smithi084.stdout:612: finishing copy_from racing read to smithi084102331-11 2024-01-13T18:02:24.737 INFO:tasks.rados.rados.0.smithi084.stdout:611: finishing write tid 2 to smithi084102331-21 2024-01-13T18:02:24.737 INFO:tasks.rados.rados.0.smithi084.stdout:611: finishing write tid 3 to smithi084102331-21 2024-01-13T18:02:24.737 INFO:tasks.rados.rados.0.smithi084.stdout:611: finishing write tid 4 to smithi084102331-21 2024-01-13T18:02:24.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 123 (ObjNum 202 snap 55 seq_num 202) dirty exists 2024-01-13T18:02:24.738 INFO:tasks.rados.rados.0.smithi084.stdout:611: left oid 21 (ObjNum 202 snap 55 seq_num 202) 2024-01-13T18:02:24.738 INFO:tasks.rados.rados.0.smithi084.stdout:613: finishing write tid 1 to smithi084102331-6 2024-01-13T18:02:24.738 INFO:tasks.rados.rados.0.smithi084.stdout:613: finishing write tid 2 to smithi084102331-6 2024-01-13T18:02:24.738 INFO:tasks.rados.rados.0.smithi084.stdout:613: finishing write tid 3 to smithi084102331-6 2024-01-13T18:02:24.739 INFO:tasks.rados.rados.0.smithi084.stdout:611: done (3 left) 2024-01-13T18:02:24.739 INFO:tasks.rados.rados.0.smithi084.stdout:612: done (2 left) 2024-01-13T18:02:24.739 INFO:tasks.rados.rados.0.smithi084.stdout:614: done (1 left) 2024-01-13T18:02:24.739 INFO:tasks.rados.rados.0.smithi084.stdout:615: snap_remove snap 45 2024-01-13T18:02:24.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:24.539+0000 7fe6d0a31200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T18:02:24.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:24.668+0000 7fe6d0a31200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T18:02:24.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:02:24] ENGINE Bus STARTING 2024-01-13T18:02:24.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: CherryPy Checker: 2024-01-13T18:02:24.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: The Application mounted at '' has an empty config. 2024-01-13T18:02:24.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: 2024-01-13T18:02:24.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:02:24] ENGINE Serving on http://:::9283 2024-01-13T18:02:24.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[112285]: [13/Jan/2024:18:02:24] ENGINE Bus STARTED 2024-01-13T18:02:25.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: pgmap v8: 121 pgs: 121 active+clean; 129 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: osdmap e171: 8 total, 8 up, 8 in 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: mgrmap e33: y(active, since 4s) 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: osdmap e172: 8 total, 8 up, 8 in 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: Standby manager daemon x started 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: pgmap v8: 121 pgs: 121 active+clean; 129 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: osdmap e171: 8 total, 8 up, 8 in 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: mgrmap e33: y(active, since 4s) 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: osdmap e172: 8 total, 8 up, 8 in 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: Standby manager daemon x started 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:25.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:24 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:25.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: pgmap v8: 121 pgs: 121 active+clean; 129 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:25.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: osdmap e171: 8 total, 8 up, 8 in 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: mgrmap e33: y(active, since 4s) 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: osdmap e172: 8 total, 8 up, 8 in 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: Standby manager daemon x started 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3042031997' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:25.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:24 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:25.371 INFO:tasks.rados.rados.0.smithi084.stdout:615: done (1 left) 2024-01-13T18:02:25.372 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 55 2024-01-13T18:02:25.372 INFO:tasks.rados.rados.0.smithi084.stdout:616: seq_num 205 ranges {622592=638976,1261568=401408} 2024-01-13T18:02:25.380 INFO:tasks.rados.rados.0.smithi084.stdout:616: writing smithi084102331-35 from 622592 to 1261568 tid 1 2024-01-13T18:02:25.380 INFO:tasks.rados.rados.0.smithi084.stdout:616: writing smithi084102331-35 from 1261568 to 1662976 tid 2 2024-01-13T18:02:25.380 INFO:tasks.rados.rados.0.smithi084.stdout:617: read oid 17 snap -1 2024-01-13T18:02:25.380 INFO:tasks.rados.rados.0.smithi084.stdout:617: expect deleted 2024-01-13T18:02:25.380 INFO:tasks.rados.rados.0.smithi084.stdout:618: snap_create 2024-01-13T18:02:25.380 INFO:tasks.rados.rados.0.smithi084.stdout:613: finishing write tid 4 to smithi084102331-6 2024-01-13T18:02:25.380 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 209 (ObjNum 203 snap 55 seq_num 203) dirty exists 2024-01-13T18:02:25.380 INFO:tasks.rados.rados.0.smithi084.stdout:613: left oid 6 (ObjNum 203 snap 55 seq_num 203) 2024-01-13T18:02:25.383 INFO:tasks.rados.rados.0.smithi084.stdout:616: finishing write tid 1 to smithi084102331-35 2024-01-13T18:02:25.386 INFO:tasks.rados.rados.0.smithi084.stdout:616: finishing write tid 2 to smithi084102331-35 2024-01-13T18:02:25.388 INFO:tasks.rados.rados.0.smithi084.stdout:616: finishing write tid 3 to smithi084102331-35 2024-01-13T18:02:25.389 INFO:tasks.rados.rados.0.smithi084.stdout:616: finishing write tid 4 to smithi084102331-35 2024-01-13T18:02:25.389 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 131 (ObjNum 205 snap 55 seq_num 205) dirty exists 2024-01-13T18:02:25.389 INFO:tasks.rados.rados.0.smithi084.stdout:616: left oid 35 (ObjNum 205 snap 55 seq_num 205) 2024-01-13T18:02:25.678 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:02:25.317Z caller=notify.go:743 level=info component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify success" attempts=4 2024-01-13T18:02:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:25 smithi099 ceph-mon[71325]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T18:02:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:25 smithi099 ceph-mon[71325]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T18:02:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:25 smithi099 ceph-mon[71325]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:25 smithi099 ceph-mon[71325]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:25 smithi099 ceph-mon[71325]: mgrmap e34: y(active, since 5s), standbys: x 2024-01-13T18:02:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:25 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T18:02:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:25 smithi099 ceph-mon[71325]: osdmap e173: 8 total, 8 up, 8 in 2024-01-13T18:02:26.376 INFO:tasks.rados.rados.0.smithi084.stdout:613: done (3 left) 2024-01-13T18:02:26.377 INFO:tasks.rados.rados.0.smithi084.stdout:616: done (2 left) 2024-01-13T18:02:26.377 INFO:tasks.rados.rados.0.smithi084.stdout:617: done (1 left) 2024-01-13T18:02:26.377 INFO:tasks.rados.rados.0.smithi084.stdout:618: done (0 left) 2024-01-13T18:02:26.377 INFO:tasks.rados.rados.0.smithi084.stdout:619: setattr oid 33 current snap is 56 2024-01-13T18:02:26.378 INFO:tasks.rados.rados.0.smithi084.stdout:620: read oid 6 snap -1 2024-01-13T18:02:26.378 INFO:tasks.rados.rados.0.smithi084.stdout:620: expect (ObjNum 203 snap 55 seq_num 203) 2024-01-13T18:02:26.378 INFO:tasks.rados.rados.0.smithi084.stdout:621: delete oid 27 current snap is 56 2024-01-13T18:02:26.383 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 225 (ObjNum 192 snap 54 seq_num 192) dirty exists 2024-01-13T18:02:26.384 INFO:tasks.rados.rados.0.smithi084.stdout:619: done (2 left) 2024-01-13T18:02:26.384 INFO:tasks.rados.rados.0.smithi084.stdout:621: done (1 left) 2024-01-13T18:02:26.384 INFO:tasks.rados.rados.0.smithi084.stdout:622: rollback oid 34 current snap is 56 2024-01-13T18:02:26.384 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 50 2024-01-13T18:02:26.384 INFO:tasks.rados.rados.0.smithi084.stdout:623: read oid 9 snap -1 2024-01-13T18:02:26.385 INFO:tasks.rados.rados.0.smithi084.stdout:623: expect (ObjNum 175 snap 49 seq_num 175) 2024-01-13T18:02:26.385 INFO:tasks.rados.rados.0.smithi084.stdout:624: read oid 18 snap 53 2024-01-13T18:02:26.385 INFO:tasks.rados.rados.0.smithi084.stdout:624: expect (ObjNum 175 snap 49 seq_num 175) 2024-01-13T18:02:26.385 INFO:tasks.rados.rados.0.smithi084.stdout:625: snap_create 2024-01-13T18:02:26.401 INFO:tasks.rados.rados.0.smithi084.stdout:620: expect (ObjNum 203 snap 55 seq_num 203) 2024-01-13T18:02:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[37908]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T18:02:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[37908]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T18:02:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[37908]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[37908]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[37908]: mgrmap e34: y(active, since 5s), standbys: x 2024-01-13T18:02:26.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T18:02:26.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[37908]: osdmap e173: 8 total, 8 up, 8 in 2024-01-13T18:02:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[52328]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T18:02:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[52328]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T18:02:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[52328]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[52328]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[52328]: mgrmap e34: y(active, since 5s), standbys: x 2024-01-13T18:02:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T18:02:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:25 smithi084 ceph-mon[52328]: osdmap e173: 8 total, 8 up, 8 in 2024-01-13T18:02:26.516 INFO:tasks.rados.rados.0.smithi084.stdout:622: finishing rollback tid 0 to smithi084102331-34 2024-01-13T18:02:26.516 INFO:tasks.rados.rados.0.smithi084.stdout:622: finishing rollback tid 1 to smithi084102331-34 2024-01-13T18:02:26.516 INFO:tasks.rados.rados.0.smithi084.stdout:622: finishing rollback tid 2 to smithi084102331-34 2024-01-13T18:02:26.517 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 212 (ObjNum 137 snap 37 seq_num 137) dirty exists 2024-01-13T18:02:26.517 INFO:tasks.rados.rados.0.smithi084.stdout:624: expect (ObjNum 175 snap 49 seq_num 175) 2024-01-13T18:02:26.838 INFO:tasks.rados.rados.0.smithi084.stdout:623: expect (ObjNum 175 snap 49 seq_num 175) 2024-01-13T18:02:27.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:27.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:27.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: pgmap v12: 121 pgs: 121 active+clean; 129 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:27.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:27.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:27.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: Reconfiguring prometheus.a (dependencies changed)... 2024-01-13T18:02:27.064 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:26 smithi099 ceph-mon[71325]: osdmap e174: 8 total, 8 up, 8 in 2024-01-13T18:02:27.380 INFO:tasks.rados.rados.0.smithi084.stdout:620: done (4 left) 2024-01-13T18:02:27.380 INFO:tasks.rados.rados.0.smithi084.stdout:622: done (3 left) 2024-01-13T18:02:27.380 INFO:tasks.rados.rados.0.smithi084.stdout:623: done (2 left) 2024-01-13T18:02:27.380 INFO:tasks.rados.rados.0.smithi084.stdout:624: done (1 left) 2024-01-13T18:02:27.380 INFO:tasks.rados.rados.0.smithi084.stdout:625: done (0 left) 2024-01-13T18:02:27.381 INFO:tasks.rados.rados.0.smithi084.stdout:626: snap_remove snap 51 2024-01-13T18:02:27.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:27.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:27.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: pgmap v12: 121 pgs: 121 active+clean; 129 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: Reconfiguring prometheus.a (dependencies changed)... 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[37908]: osdmap e174: 8 total, 8 up, 8 in 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: pgmap v12: 121 pgs: 121 active+clean; 129 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:27.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:27.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:27.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:27.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: Reconfiguring prometheus.a (dependencies changed)... 2024-01-13T18:02:27.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:26 smithi084 ceph-mon[52328]: osdmap e174: 8 total, 8 up, 8 in 2024-01-13T18:02:28.075 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:27 smithi099 ceph-mon[71325]: Reconfiguring daemon prometheus.a on smithi099 2024-01-13T18:02:28.075 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:27 smithi099 ceph-mon[71325]: osdmap e175: 8 total, 8 up, 8 in 2024-01-13T18:02:28.075 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 systemd[1]: Stopping Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:28.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.267Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-01-13T18:02:28.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.268Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-01-13T18:02:28.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.268Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-01-13T18:02:28.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.268Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-01-13T18:02:28.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.268Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-01-13T18:02:28.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.268Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-01-13T18:02:28.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.268Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-01-13T18:02:28.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.268Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-01-13T18:02:28.370 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.268Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-01-13T18:02:28.370 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.268Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-01-13T18:02:28.370 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.268Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-01-13T18:02:28.370 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[124082]: ts=2024-01-13T18:02:28.268Z caller=main.go:1147 level=info msg="See you next time!" 2024-01-13T18:02:28.387 INFO:tasks.rados.rados.0.smithi084.stdout:626: done (0 left) 2024-01-13T18:02:28.387 INFO:tasks.rados.rados.0.smithi084.stdout:627: snap_remove snap 42 2024-01-13T18:02:28.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:27 smithi084 ceph-mon[37908]: Reconfiguring daemon prometheus.a on smithi099 2024-01-13T18:02:28.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:27 smithi084 ceph-mon[37908]: osdmap e175: 8 total, 8 up, 8 in 2024-01-13T18:02:28.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:27 smithi084 ceph-mon[52328]: Reconfiguring daemon prometheus.a on smithi099 2024-01-13T18:02:28.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:27 smithi084 ceph-mon[52328]: osdmap e175: 8 total, 8 up, 8 in 2024-01-13T18:02:28.813 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 bash[127630]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a 2024-01-13T18:02:29.078 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@prometheus.a.service: Succeeded. 2024-01-13T18:02:29.078 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 systemd[1]: Stopped Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:29.078 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:28 smithi099 systemd[1]: Starting Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:29.079 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-mon[71325]: pgmap v15: 121 pgs: 121 active+clean; 145 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 5.0 MiB/s wr, 87 op/s 2024-01-13T18:02:29.079 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:28 smithi099 ceph-mon[71325]: osdmap e176: 8 total, 8 up, 8 in 2024-01-13T18:02:29.361 INFO:tasks.rados.rados.0.smithi084.stdout:627: done (0 left) 2024-01-13T18:02:29.361 INFO:tasks.rados.rados.0.smithi084.stdout:628: copy_from oid 48 from oid 5 current snap is 57 2024-01-13T18:02:29.361 INFO:tasks.rados.rados.0.smithi084.stdout:629: setattr oid 20 current snap is 57 2024-01-13T18:02:29.361 INFO:tasks.rados.rados.0.smithi084.stdout:630: read oid 3 snap -1 2024-01-13T18:02:29.361 INFO:tasks.rados.rados.0.smithi084.stdout:630: expect (ObjNum 189 snap 54 seq_num 189) 2024-01-13T18:02:29.361 INFO:tasks.rados.rados.0.smithi084.stdout:631: copy_from oid 49 from oid 17 current snap is 57 2024-01-13T18:02:29.361 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 57 2024-01-13T18:02:29.362 INFO:tasks.rados.rados.0.smithi084.stdout:632: seq_num 207 ranges {1662976=671744,2334720=401408} 2024-01-13T18:02:29.374 INFO:tasks.rados.rados.0.smithi084.stdout:632: writing smithi084102331-35 from 1662976 to 2334720 tid 1 2024-01-13T18:02:29.378 INFO:tasks.rados.rados.0.smithi084.stdout:632: writing smithi084102331-35 from 2334720 to 2736128 tid 2 2024-01-13T18:02:29.378 INFO:tasks.rados.rados.0.smithi084.stdout:633: copy_from oid 31 from oid 40 current snap is 57 2024-01-13T18:02:29.378 INFO:tasks.rados.rados.0.smithi084.stdout:628: finishing copy_from to smithi084102331-48 2024-01-13T18:02:29.378 INFO:tasks.rados.rados.0.smithi084.stdout:628: got expected ENOENT (src dne) 2024-01-13T18:02:29.378 INFO:tasks.rados.rados.0.smithi084.stdout:634: delete oid 11 current snap is 57 2024-01-13T18:02:29.378 INFO:tasks.rados.rados.0.smithi084.stdout:628: finishing copy_from racing read to smithi084102331-48 2024-01-13T18:02:29.378 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 111 (ObjNum 197 snap 55 seq_num 197) dirty exists 2024-01-13T18:02:29.378 INFO:tasks.rados.rados.0.smithi084.stdout:631: finishing copy_from to smithi084102331-49 2024-01-13T18:02:29.378 INFO:tasks.rados.rados.0.smithi084.stdout:631: got expected ENOENT (src dne) 2024-01-13T18:02:29.378 INFO:tasks.rados.rados.0.smithi084.stdout:631: finishing copy_from racing read to smithi084102331-49 2024-01-13T18:02:29.378 INFO:tasks.rados.rados.0.smithi084.stdout:630: expect (ObjNum 189 snap 54 seq_num 189) 2024-01-13T18:02:29.401 INFO:tasks.rados.rados.0.smithi084.stdout:632: finishing write tid 1 to smithi084102331-35 2024-01-13T18:02:29.401 INFO:tasks.rados.rados.0.smithi084.stdout:632: finishing write tid 2 to smithi084102331-35 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:632: finishing write tid 3 to smithi084102331-35 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:632: finishing write tid 4 to smithi084102331-35 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 145 (ObjNum 207 snap 57 seq_num 207) dirty exists 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:632: left oid 35 (ObjNum 207 snap 57 seq_num 207) 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:633: finishing copy_from to smithi084102331-31 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 107 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:633: finishing copy_from racing read to smithi084102331-31 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:628: done (6 left) 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:629: done (5 left) 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:630: done (4 left) 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:631: done (3 left) 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:632: done (2 left) 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:633: done (1 left) 2024-01-13T18:02:29.402 INFO:tasks.rados.rados.0.smithi084.stdout:634: done (0 left) 2024-01-13T18:02:29.403 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 57 2024-01-13T18:02:29.403 INFO:tasks.rados.rados.0.smithi084.stdout:635: seq_num 209 ranges {3170304=704512,3874816=401408} 2024-01-13T18:02:29.423 INFO:tasks.rados.rados.0.smithi084.stdout:635: writing smithi084102331-26 from 3170304 to 3874816 tid 1 2024-01-13T18:02:29.425 INFO:tasks.rados.rados.0.smithi084.stdout:635: writing smithi084102331-26 from 3874816 to 4276224 tid 2 2024-01-13T18:02:29.425 INFO:tasks.rados.rados.0.smithi084.stdout:636: snap_create 2024-01-13T18:02:29.427 INFO:tasks.rados.rados.0.smithi084.stdout:635: finishing write tid 1 to smithi084102331-26 2024-01-13T18:02:29.427 INFO:tasks.rados.rados.0.smithi084.stdout:635: finishing write tid 2 to smithi084102331-26 2024-01-13T18:02:29.428 INFO:tasks.rados.rados.0.smithi084.stdout:635: finishing write tid 3 to smithi084102331-26 2024-01-13T18:02:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:28 smithi084 ceph-mon[37908]: pgmap v15: 121 pgs: 121 active+clean; 145 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 5.0 MiB/s wr, 87 op/s 2024-01-13T18:02:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:28 smithi084 ceph-mon[37908]: osdmap e176: 8 total, 8 up, 8 in 2024-01-13T18:02:29.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:28 smithi084 ceph-mon[52328]: pgmap v15: 121 pgs: 121 active+clean; 145 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 5.0 MiB/s wr, 87 op/s 2024-01-13T18:02:29.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:28 smithi084 ceph-mon[52328]: osdmap e176: 8 total, 8 up, 8 in 2024-01-13T18:02:29.429 INFO:tasks.rados.rados.0.smithi084.stdout:635: finishing write tid 4 to smithi084102331-26 2024-01-13T18:02:29.429 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 234 (ObjNum 209 snap 57 seq_num 209) dirty exists 2024-01-13T18:02:29.429 INFO:tasks.rados.rados.0.smithi084.stdout:635: left oid 26 (ObjNum 209 snap 57 seq_num 209) 2024-01-13T18:02:29.619 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.213Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-01-13T18:02:29.619 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.214Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-01-13T18:02:29.619 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.214Z caller=main.go:570 level=info host_details="(Linux 4.18.0-532.el8.x86_64 #1 SMP Thu Dec 21 12:11:59 UTC 2023 x86_64 smithi099 (none))" 2024-01-13T18:02:29.619 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.214Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-01-13T18:02:29.619 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.214Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-01-13T18:02:29.619 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.215Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-01-13T18:02:29.619 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.216Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.217Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.217Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 bash[127749]: cb4c11bf6eec7a20e2d8203df4eb6503e02740b03023629cd0a5f4c6af59cda6 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 systemd[1]: Started Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.221Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.222Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.082534ms 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.222Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.222Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.237Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.238Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.238Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-01-13T18:02:29.620 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.238Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=48.83µs wal_replay_duration=16.637966ms wbl_replay_duration=125ns total_replay_duration=17.796528ms 2024-01-13T18:02:29.621 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.241Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-01-13T18:02:29.621 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.241Z caller=main.go:1029 level=info msg="TSDB started" 2024-01-13T18:02:29.621 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.241Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-01-13T18:02:29.621 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.258Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=16.730142ms db_storage=939ns remote_storage=976ns web_handler=364ns query_engine=694ns scrape=463.33µs scrape_sd=70.545µs notify=15.993µs notify_sd=12.39µs rules=15.929845ms tracing=5.922µs 2024-01-13T18:02:29.621 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.258Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-01-13T18:02:29.621 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:29.258Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-01-13T18:02:30.372 INFO:tasks.rados.rados.0.smithi084.stdout:635: done (1 left) 2024-01-13T18:02:30.372 INFO:tasks.rados.rados.0.smithi084.stdout:636: done (0 left) 2024-01-13T18:02:30.373 INFO:tasks.rados.rados.0.smithi084.stdout:637: delete oid 35 current snap is 58 2024-01-13T18:02:30.377 INFO:tasks.rados.rados.0.smithi084.stdout:637: done (0 left) 2024-01-13T18:02:30.377 INFO:tasks.rados.rados.0.smithi084.stdout:638: snap_create 2024-01-13T18:02:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:30 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:30 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:30 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:30 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:30 smithi099 ceph-mon[71325]: osdmap e177: 8 total, 8 up, 8 in 2024-01-13T18:02:30.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:30 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:30 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:30 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:30 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:30 smithi084 ceph-mon[37908]: osdmap e177: 8 total, 8 up, 8 in 2024-01-13T18:02:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:30 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:30 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:30 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:30 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:30 smithi084 ceph-mon[52328]: osdmap e177: 8 total, 8 up, 8 in 2024-01-13T18:02:31.376 INFO:tasks.rados.rados.0.smithi084.stdout:638: done (0 left) 2024-01-13T18:02:31.376 INFO:tasks.rados.rados.0.smithi084.stdout:639: snap_create 2024-01-13T18:02:31.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:31 smithi099 ceph-mon[71325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:31.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:31 smithi099 ceph-mon[71325]: pgmap v18: 121 pgs: 121 active+clean; 145 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 4.1 MiB/s wr, 71 op/s 2024-01-13T18:02:31.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:31 smithi099 ceph-mon[71325]: osdmap e178: 8 total, 8 up, 8 in 2024-01-13T18:02:31.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:31 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:02:31.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:31 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:02:31.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:31 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:31.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[37908]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[37908]: pgmap v18: 121 pgs: 121 active+clean; 145 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 4.1 MiB/s wr, 71 op/s 2024-01-13T18:02:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[37908]: osdmap e178: 8 total, 8 up, 8 in 2024-01-13T18:02:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:02:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:02:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:31.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[52328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:02:31.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[52328]: pgmap v18: 121 pgs: 121 active+clean; 145 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 4.1 MiB/s wr, 71 op/s 2024-01-13T18:02:31.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[52328]: osdmap e178: 8 total, 8 up, 8 in 2024-01-13T18:02:31.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:02:31.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:02:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:31 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:31.837 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:31 smithi099 systemd[1]: Stopping Ceph mgr.x for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:32.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:31 smithi099 bash[128176]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x 2024-01-13T18:02:32.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:32 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-01-13T18:02:32.376 INFO:tasks.rados.rados.0.smithi084.stdout:639: done (0 left) 2024-01-13T18:02:32.376 INFO:tasks.rados.rados.0.smithi084.stdout:640: read oid 22 snap -1 2024-01-13T18:02:32.376 INFO:tasks.rados.rados.0.smithi084.stdout:640: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:02:32.377 INFO:tasks.rados.rados.0.smithi084.stdout:641: snap_remove snap 31 2024-01-13T18:02:32.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:32 smithi099 ceph-mon[71325]: Upgrade: Updating mgr.x 2024-01-13T18:02:32.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:32 smithi099 ceph-mon[71325]: Deploying daemon mgr.x on smithi099 2024-01-13T18:02:32.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:32 smithi099 ceph-mon[71325]: osdmap e179: 8 total, 8 up, 8 in 2024-01-13T18:02:32.515 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:32 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-01-13T18:02:32.515 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:32 smithi099 systemd[1]: Stopped Ceph mgr.x for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:32.515 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:32 smithi099 systemd[1]: Starting Ceph mgr.x for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:32.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:32 smithi084 ceph-mon[37908]: Upgrade: Updating mgr.x 2024-01-13T18:02:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:32 smithi084 ceph-mon[37908]: Deploying daemon mgr.x on smithi099 2024-01-13T18:02:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:32 smithi084 ceph-mon[37908]: osdmap e179: 8 total, 8 up, 8 in 2024-01-13T18:02:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:32 smithi084 ceph-mon[52328]: Upgrade: Updating mgr.x 2024-01-13T18:02:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:32 smithi084 ceph-mon[52328]: Deploying daemon mgr.x on smithi099 2024-01-13T18:02:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:32 smithi084 ceph-mon[52328]: osdmap e179: 8 total, 8 up, 8 in 2024-01-13T18:02:32.814 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:32 smithi099 ceph-mgr[128362]: -- 172.21.15.99:0/4114312665 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bf551131e0 con 0x55bf550e8c00 2024-01-13T18:02:32.814 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:32 smithi099 bash[128325]: db4708bdfc11a7dbb00301611c8cea19db981d7cfb0991e31332982d3ab9e86b 2024-01-13T18:02:32.814 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:32 smithi099 systemd[1]: Started Ceph mgr.x for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:33.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:32 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:32.811+0000 7fbfeb582200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T18:02:33.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:32 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:32.986+0000 7fbfeb582200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T18:02:33.377 INFO:tasks.rados.rados.0.smithi084.stdout:641: done (1 left) 2024-01-13T18:02:33.377 INFO:tasks.rados.rados.0.smithi084.stdout:642: read oid 48 snap -1 2024-01-13T18:02:33.378 INFO:tasks.rados.rados.0.smithi084.stdout:642: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:02:33.378 INFO:tasks.rados.rados.0.smithi084.stdout:643: rmattr oid 49 current snap is 60 2024-01-13T18:02:33.378 INFO:tasks.rados.rados.0.smithi084.stdout:643: done (2 left) 2024-01-13T18:02:33.378 INFO:tasks.rados.rados.0.smithi084.stdout:644: delete oid 2 current snap is 60 2024-01-13T18:02:33.378 INFO:tasks.rados.rados.0.smithi084.stdout:640: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:02:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:33 smithi099 ceph-mon[71325]: pgmap v21: 121 pgs: 121 active+clean; 151 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 694 KiB/s wr, 18 op/s 2024-01-13T18:02:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:33 smithi099 ceph-mon[71325]: osdmap e180: 8 total, 8 up, 8 in 2024-01-13T18:02:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:33 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:33 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:33 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:33.620 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:33.360+0000 7fbfeb582200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T18:02:33.641 INFO:tasks.rados.rados.0.smithi084.stdout:642: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:02:33.660 INFO:tasks.rados.rados.0.smithi084.stdout:640: done (2 left) 2024-01-13T18:02:33.661 INFO:tasks.rados.rados.0.smithi084.stdout:642: done (1 left) 2024-01-13T18:02:33.661 INFO:tasks.rados.rados.0.smithi084.stdout:644: done (0 left) 2024-01-13T18:02:33.661 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 60 2024-01-13T18:02:33.661 INFO:tasks.rados.rados.0.smithi084.stdout:645: seq_num 212 ranges {0=753664,753664=401408} 2024-01-13T18:02:33.669 INFO:tasks.rados.rados.0.smithi084.stdout:645: writing smithi084102331-4 from 0 to 753664 tid 1 2024-01-13T18:02:33.669 INFO:tasks.rados.rados.0.smithi084.stdout:645: writing smithi084102331-4 from 753664 to 1155072 tid 2 2024-01-13T18:02:33.669 INFO:tasks.rados.rados.0.smithi084.stdout:646: read oid 11 snap -1 2024-01-13T18:02:33.669 INFO:tasks.rados.rados.0.smithi084.stdout:646: expect deleted 2024-01-13T18:02:33.669 INFO:tasks.rados.rados.0.smithi084.stdout:647: read oid 42 snap 47 2024-01-13T18:02:33.669 INFO:tasks.rados.rados.0.smithi084.stdout:647: expect (ObjNum 93 snap 18 seq_num 93) 2024-01-13T18:02:33.669 INFO:tasks.rados.rados.0.smithi084.stdout:648: setattr oid 18 current snap is 60 2024-01-13T18:02:33.669 INFO:tasks.rados.rados.0.smithi084.stdout:645: finishing write tid 1 to smithi084102331-4 2024-01-13T18:02:33.670 INFO:tasks.rados.rados.0.smithi084.stdout:646: done (3 left) 2024-01-13T18:02:33.670 INFO:tasks.rados.rados.0.smithi084.stdout:649: snap_remove snap 52 2024-01-13T18:02:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:33 smithi084 ceph-mon[37908]: pgmap v21: 121 pgs: 121 active+clean; 151 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 694 KiB/s wr, 18 op/s 2024-01-13T18:02:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:33 smithi084 ceph-mon[37908]: osdmap e180: 8 total, 8 up, 8 in 2024-01-13T18:02:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:33 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:33 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:33 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:33 smithi084 ceph-mon[52328]: pgmap v21: 121 pgs: 121 active+clean; 151 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 694 KiB/s wr, 18 op/s 2024-01-13T18:02:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:33 smithi084 ceph-mon[52328]: osdmap e180: 8 total, 8 up, 8 in 2024-01-13T18:02:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:33 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:33 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:33 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:34.363 INFO:tasks.rados.rados.0.smithi084.stdout:649: done (3 left) 2024-01-13T18:02:34.363 INFO:tasks.rados.rados.0.smithi084.stdout:650: delete oid 2 current snap is 60 2024-01-13T18:02:34.363 INFO:tasks.rados.rados.0.smithi084.stdout:645: finishing write tid 2 to smithi084102331-4 2024-01-13T18:02:34.363 INFO:tasks.rados.rados.0.smithi084.stdout:645: finishing write tid 3 to smithi084102331-4 2024-01-13T18:02:34.363 INFO:tasks.rados.rados.0.smithi084.stdout:645: finishing write tid 4 to smithi084102331-4 2024-01-13T18:02:34.363 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 155 (ObjNum 212 snap 60 seq_num 212) dirty exists 2024-01-13T18:02:34.364 INFO:tasks.rados.rados.0.smithi084.stdout:645: left oid 4 (ObjNum 212 snap 60 seq_num 212) 2024-01-13T18:02:34.364 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 140 (ObjNum 175 snap 49 seq_num 175) dirty exists 2024-01-13T18:02:34.364 INFO:tasks.rados.rados.0.smithi084.stdout:647: expect (ObjNum 93 snap 18 seq_num 93) 2024-01-13T18:02:34.369 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:33.903+0000 7fbfeb582200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T18:02:34.369 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:34.141+0000 7fbfeb582200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T18:02:34.432 INFO:tasks.rados.rados.0.smithi084.stdout:645: done (3 left) 2024-01-13T18:02:34.432 INFO:tasks.rados.rados.0.smithi084.stdout:647: done (2 left) 2024-01-13T18:02:34.432 INFO:tasks.rados.rados.0.smithi084.stdout:648: done (1 left) 2024-01-13T18:02:34.432 INFO:tasks.rados.rados.0.smithi084.stdout:650: done (0 left) 2024-01-13T18:02:34.432 INFO:tasks.rados.rados.0.smithi084.stdout:651: snap_create 2024-01-13T18:02:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:34 smithi084 ceph-mon[37908]: osdmap e181: 8 total, 8 up, 8 in 2024-01-13T18:02:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:34 smithi084 ceph-mon[37908]: pgmap v24: 121 pgs: 121 active+clean; 151 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 694 KiB/s wr, 18 op/s 2024-01-13T18:02:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:34 smithi084 ceph-mon[37908]: osdmap e182: 8 total, 8 up, 8 in 2024-01-13T18:02:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:34 smithi084 ceph-mon[52328]: osdmap e181: 8 total, 8 up, 8 in 2024-01-13T18:02:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:34 smithi084 ceph-mon[52328]: pgmap v24: 121 pgs: 121 active+clean; 151 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 694 KiB/s wr, 18 op/s 2024-01-13T18:02:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:34 smithi084 ceph-mon[52328]: osdmap e182: 8 total, 8 up, 8 in 2024-01-13T18:02:34.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:34.614+0000 7fbfeb582200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T18:02:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:34 smithi099 ceph-mon[71325]: osdmap e181: 8 total, 8 up, 8 in 2024-01-13T18:02:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:34 smithi099 ceph-mon[71325]: pgmap v24: 121 pgs: 121 active+clean; 151 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.3 MiB/s rd, 694 KiB/s wr, 18 op/s 2024-01-13T18:02:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:34 smithi099 ceph-mon[71325]: osdmap e182: 8 total, 8 up, 8 in 2024-01-13T18:02:35.389 INFO:tasks.rados.rados.0.smithi084.stdout:651: done (0 left) 2024-01-13T18:02:35.389 INFO:tasks.rados.rados.0.smithi084.stdout:652: setattr oid 43 current snap is 61 2024-01-13T18:02:35.389 INFO:tasks.rados.rados.0.smithi084.stdout:653: snap_remove snap 56 2024-01-13T18:02:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:35 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:35 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:35 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:35.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:35.388+0000 7fbfeb582200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T18:02:35.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:35.484+0000 7fbfeb582200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T18:02:36.369 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:36.090+0000 7fbfeb582200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T18:02:36.369 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:36.184+0000 7fbfeb582200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T18:02:36.369 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:36.282+0000 7fbfeb582200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T18:02:36.395 INFO:tasks.rados.rados.0.smithi084.stdout:653: done (1 left) 2024-01-13T18:02:36.395 INFO:tasks.rados.rados.0.smithi084.stdout:654: read oid 21 snap -1 2024-01-13T18:02:36.395 INFO:tasks.rados.rados.0.smithi084.stdout:654: expect (ObjNum 202 snap 55 seq_num 202) 2024-01-13T18:02:36.395 INFO:tasks.rados.rados.0.smithi084.stdout:655: rollback oid 5 current snap is 61 2024-01-13T18:02:36.395 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 53 2024-01-13T18:02:36.396 INFO:tasks.rados.rados.0.smithi084.stdout:656: read oid 48 snap -1 2024-01-13T18:02:36.396 INFO:tasks.rados.rados.0.smithi084.stdout:656: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:02:36.396 INFO:tasks.rados.rados.0.smithi084.stdout:657: snap_remove snap 60 2024-01-13T18:02:36.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:36 smithi084 ceph-mon[52328]: osdmap e183: 8 total, 8 up, 8 in 2024-01-13T18:02:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:36 smithi084 ceph-mon[52328]: pgmap v27: 121 pgs: 121 active+clean; 151 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:36 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:36 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:36 smithi084 ceph-mon[37908]: osdmap e183: 8 total, 8 up, 8 in 2024-01-13T18:02:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:36 smithi084 ceph-mon[37908]: pgmap v27: 121 pgs: 121 active+clean; 151 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:36 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:36 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:36.726 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:36 smithi099 ceph-mon[71325]: osdmap e183: 8 total, 8 up, 8 in 2024-01-13T18:02:36.726 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:36 smithi099 ceph-mon[71325]: pgmap v27: 121 pgs: 121 active+clean; 151 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:02:36.726 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:36 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:36.726 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:36 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:36.727 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:36.523+0000 7fbfeb582200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T18:02:36.727 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:36.623+0000 7fbfeb582200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T18:02:36.727 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:36.724+0000 7fbfeb582200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T18:02:37.074 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:36.960+0000 7fbfeb582200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T18:02:37.074 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:37.071+0000 7fbfeb582200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T18:02:37.358 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:37.266+0000 7fbfeb582200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T18:02:37.358 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:37.355+0000 7fbfeb582200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T18:02:37.395 INFO:tasks.rados.rados.0.smithi084.stdout:657: done (4 left) 2024-01-13T18:02:37.395 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 61 2024-01-13T18:02:37.395 INFO:tasks.rados.rados.0.smithi084.stdout:658: seq_num 214 ranges {2973696=794624,3768320=401408} 2024-01-13T18:02:37.415 INFO:tasks.rados.rados.0.smithi084.stdout:658: writing smithi084102331-34 from 2973696 to 3768320 tid 1 2024-01-13T18:02:37.418 INFO:tasks.rados.rados.0.smithi084.stdout:658: writing smithi084102331-34 from 3768320 to 4169728 tid 2 2024-01-13T18:02:37.418 INFO:tasks.rados.rados.0.smithi084.stdout:659: read oid 22 snap -1 2024-01-13T18:02:37.418 INFO:tasks.rados.rados.0.smithi084.stdout:659: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:02:37.419 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 61 2024-01-13T18:02:37.419 INFO:tasks.rados.rados.0.smithi084.stdout:660: seq_num 215 ranges {770048=409600,1179648=532480,1712128=270336} 2024-01-13T18:02:37.425 INFO:tasks.rados.rados.0.smithi084.stdout:660: writing smithi084102331-3 from 770048 to 1179648 tid 1 2024-01-13T18:02:37.429 INFO:tasks.rados.rados.0.smithi084.stdout:660: writing smithi084102331-3 from 1179648 to 1712128 tid 2 2024-01-13T18:02:37.431 INFO:tasks.rados.rados.0.smithi084.stdout:660: writing smithi084102331-3 from 1712128 to 1982464 tid 3 2024-01-13T18:02:37.431 INFO:tasks.rados.rados.0.smithi084.stdout:661: read oid 13 snap -1 2024-01-13T18:02:37.431 INFO:tasks.rados.rados.0.smithi084.stdout:661: expect (ObjNum 85 snap 15 seq_num 85) 2024-01-13T18:02:37.432 INFO:tasks.rados.rados.0.smithi084.stdout:662: setattr oid 24 current snap is 61 2024-01-13T18:02:37.432 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 109 (ObjNum 195 snap 54 seq_num 195) dirty exists 2024-01-13T18:02:37.432 INFO:tasks.rados.rados.0.smithi084.stdout:655: finishing rollback tid 1 to smithi084102331-5 2024-01-13T18:02:37.432 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 0 (ObjNum 65 snap 0 seq_num 4032374456) dirty dne 2024-01-13T18:02:37.432 INFO:tasks.rados.rados.0.smithi084.stdout:654: expect (ObjNum 202 snap 55 seq_num 202) 2024-01-13T18:02:37.487 INFO:tasks.rados.rados.0.smithi084.stdout:656: expect (ObjNum 47 snap 0 seq_num 47) 2024-01-13T18:02:37.507 INFO:tasks.rados.rados.0.smithi084.stdout:658: finishing write tid 1 to smithi084102331-34 2024-01-13T18:02:37.507 INFO:tasks.rados.rados.0.smithi084.stdout:658: finishing write tid 2 to smithi084102331-34 2024-01-13T18:02:37.507 INFO:tasks.rados.rados.0.smithi084.stdout:658: finishing write tid 3 to smithi084102331-34 2024-01-13T18:02:37.507 INFO:tasks.rados.rados.0.smithi084.stdout:658: finishing write tid 4 to smithi084102331-34 2024-01-13T18:02:37.507 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 215 (ObjNum 214 snap 61 seq_num 214) dirty exists 2024-01-13T18:02:37.507 INFO:tasks.rados.rados.0.smithi084.stdout:658: left oid 34 (ObjNum 214 snap 61 seq_num 214) 2024-01-13T18:02:37.507 INFO:tasks.rados.rados.0.smithi084.stdout:660: finishing write tid 1 to smithi084102331-3 2024-01-13T18:02:37.507 INFO:tasks.rados.rados.0.smithi084.stdout:660: finishing write tid 2 to smithi084102331-3 2024-01-13T18:02:37.507 INFO:tasks.rados.rados.0.smithi084.stdout:660: finishing write tid 3 to smithi084102331-3 2024-01-13T18:02:37.507 INFO:tasks.rados.rados.0.smithi084.stdout:660: finishing write tid 4 to smithi084102331-3 2024-01-13T18:02:37.507 INFO:tasks.rados.rados.0.smithi084.stdout:660: finishing write tid 5 to smithi084102331-3 2024-01-13T18:02:37.508 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 312 (ObjNum 215 snap 61 seq_num 215) dirty exists 2024-01-13T18:02:37.508 INFO:tasks.rados.rados.0.smithi084.stdout:660: left oid 3 (ObjNum 215 snap 61 seq_num 215) 2024-01-13T18:02:37.508 INFO:tasks.rados.rados.0.smithi084.stdout:661: expect (ObjNum 85 snap 15 seq_num 85) 2024-01-13T18:02:37.551 INFO:tasks.rados.rados.0.smithi084.stdout:659: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:02:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:37 smithi099 ceph-mon[71325]: osdmap e184: 8 total, 8 up, 8 in 2024-01-13T18:02:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:37 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:37 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:37 smithi084 ceph-mon[37908]: osdmap e184: 8 total, 8 up, 8 in 2024-01-13T18:02:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:37 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:37 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:37 smithi084 ceph-mon[52328]: osdmap e184: 8 total, 8 up, 8 in 2024-01-13T18:02:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:37 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:37 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:37.807 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 115 (ObjNum 133 snap 35 seq_num 133) dirty exists 2024-01-13T18:02:37.807 INFO:tasks.rados.rados.0.smithi084.stdout:652: done (8 left) 2024-01-13T18:02:37.807 INFO:tasks.rados.rados.0.smithi084.stdout:654: done (7 left) 2024-01-13T18:02:37.807 INFO:tasks.rados.rados.0.smithi084.stdout:655: done (6 left) 2024-01-13T18:02:37.807 INFO:tasks.rados.rados.0.smithi084.stdout:656: done (5 left) 2024-01-13T18:02:37.808 INFO:tasks.rados.rados.0.smithi084.stdout:658: done (4 left) 2024-01-13T18:02:37.808 INFO:tasks.rados.rados.0.smithi084.stdout:659: done (3 left) 2024-01-13T18:02:37.808 INFO:tasks.rados.rados.0.smithi084.stdout:660: done (2 left) 2024-01-13T18:02:37.808 INFO:tasks.rados.rados.0.smithi084.stdout:661: done (1 left) 2024-01-13T18:02:37.808 INFO:tasks.rados.rados.0.smithi084.stdout:662: done (0 left) 2024-01-13T18:02:37.808 INFO:tasks.rados.rados.0.smithi084.stdout:663: setattr oid 33 current snap is 61 2024-01-13T18:02:37.808 INFO:tasks.rados.rados.0.smithi084.stdout:664: snap_create 2024-01-13T18:02:37.811 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 255 (ObjNum 192 snap 54 seq_num 192) dirty exists 2024-01-13T18:02:38.407 INFO:tasks.rados.rados.0.smithi084.stdout:663: done (1 left) 2024-01-13T18:02:38.407 INFO:tasks.rados.rados.0.smithi084.stdout:664: done (0 left) 2024-01-13T18:02:38.407 INFO:tasks.rados.rados.0.smithi084.stdout:665: read oid 20 snap 50 2024-01-13T18:02:38.407 INFO:tasks.rados.rados.0.smithi084.stdout:665: expect deleted 2024-01-13T18:02:38.407 INFO:tasks.rados.rados.0.smithi084.stdout:666: snap_create 2024-01-13T18:02:38.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:38 smithi099 ceph-mon[71325]: osdmap e185: 8 total, 8 up, 8 in 2024-01-13T18:02:38.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:38 smithi099 ceph-mon[71325]: pgmap v30: 121 pgs: 121 active+clean; 139 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 282 KiB/s wr, 13 op/s 2024-01-13T18:02:38.584 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:38.171+0000 7fbfeb582200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T18:02:38.584 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:38.383+0000 7fbfeb582200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T18:02:38.585 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:38.581+0000 7fbfeb582200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:02:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:38 smithi084 ceph-mon[37908]: osdmap e185: 8 total, 8 up, 8 in 2024-01-13T18:02:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:38 smithi084 ceph-mon[37908]: pgmap v30: 121 pgs: 121 active+clean; 139 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 282 KiB/s wr, 13 op/s 2024-01-13T18:02:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:38 smithi084 ceph-mon[52328]: osdmap e185: 8 total, 8 up, 8 in 2024-01-13T18:02:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:38 smithi084 ceph-mon[52328]: pgmap v30: 121 pgs: 121 active+clean; 139 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 282 KiB/s wr, 13 op/s 2024-01-13T18:02:39.359 INFO:tasks.rados.rados.0.smithi084.stdout:665: done (1 left) 2024-01-13T18:02:39.359 INFO:tasks.rados.rados.0.smithi084.stdout:666: done (0 left) 2024-01-13T18:02:39.359 INFO:tasks.rados.rados.0.smithi084.stdout:667: snap_remove snap 47 2024-01-13T18:02:39.488 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:39.291+0000 7fbfeb582200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T18:02:39.488 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:39.486+0000 7fbfeb582200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:02:39.489 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-mon[71325]: osdmap e186: 8 total, 8 up, 8 in 2024-01-13T18:02:39.489 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:39.489 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:39.489 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:39.489 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:39.489 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:39.489 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-mon[71325]: osdmap e187: 8 total, 8 up, 8 in 2024-01-13T18:02:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[37908]: osdmap e186: 8 total, 8 up, 8 in 2024-01-13T18:02:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[37908]: osdmap e187: 8 total, 8 up, 8 in 2024-01-13T18:02:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[52328]: osdmap e186: 8 total, 8 up, 8 in 2024-01-13T18:02:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:39 smithi084 ceph-mon[52328]: osdmap e187: 8 total, 8 up, 8 in 2024-01-13T18:02:39.796 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:39.676+0000 7fbfeb582200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T18:02:40.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:39.793+0000 7fbfeb582200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T18:02:40.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: [13/Jan/2024:18:02:39] ENGINE Bus STARTING 2024-01-13T18:02:40.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: CherryPy Checker: 2024-01-13T18:02:40.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: The Application mounted at '' has an empty config. 2024-01-13T18:02:40.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:40.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: [13/Jan/2024:18:02:39] ENGINE Serving on http://:::9283 2024-01-13T18:02:40.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: [13/Jan/2024:18:02:39] ENGINE Bus STARTED 2024-01-13T18:02:40.362 INFO:tasks.rados.rados.0.smithi084.stdout:667: done (0 left) 2024-01-13T18:02:40.362 INFO:tasks.rados.rados.0.smithi084.stdout:668: snap_create 2024-01-13T18:02:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:02:40] "GET /metrics HTTP/1.1" 200 36011 "" "Prometheus/2.43.0" 2024-01-13T18:02:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: Upgrade: Setting container_image for all mgr 2024-01-13T18:02:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-01-13T18:02:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-01-13T18:02:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-01-13T18:02:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-01-13T18:02:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-13T18:02:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-01-13T18:02:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: Upgrade: It appears safe to stop mon.a 2024-01-13T18:02:40.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: pgmap v33: 121 pgs: 121 active+clean; 139 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 282 KiB/s wr, 13 op/s 2024-01-13T18:02:40.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: Standby manager daemon x restarted 2024-01-13T18:02:40.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: Standby manager daemon x started 2024-01-13T18:02:40.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:02:40.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:40.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:02:40.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:40.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[37908]: osdmap e188: 8 total, 8 up, 8 in 2024-01-13T18:02:40.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:40.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:40.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: Upgrade: Setting container_image for all mgr 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: Upgrade: It appears safe to stop mon.a 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: pgmap v33: 121 pgs: 121 active+clean; 139 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 282 KiB/s wr, 13 op/s 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: Standby manager daemon x restarted 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: Standby manager daemon x started 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:40.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:02:40.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:40.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:40 smithi084 ceph-mon[52328]: osdmap e188: 8 total, 8 up, 8 in 2024-01-13T18:02:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: Upgrade: Setting container_image for all mgr 2024-01-13T18:02:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-01-13T18:02:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-01-13T18:02:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-01-13T18:02:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-01-13T18:02:40.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-13T18:02:40.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-01-13T18:02:40.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: Upgrade: It appears safe to stop mon.a 2024-01-13T18:02:40.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: pgmap v33: 121 pgs: 121 active+clean; 139 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 282 KiB/s wr, 13 op/s 2024-01-13T18:02:40.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: Standby manager daemon x restarted 2024-01-13T18:02:40.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: Standby manager daemon x started 2024-01-13T18:02:40.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:02:40.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:40.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:02:40.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3921325594' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:40.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:40 smithi099 ceph-mon[71325]: osdmap e188: 8 total, 8 up, 8 in 2024-01-13T18:02:41.362 INFO:tasks.rados.rados.0.smithi084.stdout:668: done (0 left) 2024-01-13T18:02:41.363 INFO:tasks.rados.rados.0.smithi084.stdout:669: read oid 1 snap -1 2024-01-13T18:02:41.363 INFO:tasks.rados.rados.0.smithi084.stdout:669: expect (ObjNum 78 snap 14 seq_num 78) 2024-01-13T18:02:41.363 INFO:tasks.rados.rados.0.smithi084.stdout:670: copy_from oid 27 from oid 46 current snap is 64 2024-01-13T18:02:41.363 INFO:tasks.rados.rados.0.smithi084.stdout:671: rollback oid 29 current snap is 64 2024-01-13T18:02:41.363 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 62 2024-01-13T18:02:41.363 INFO:tasks.rados.rados.0.smithi084.stdout:672: setattr oid 49 current snap is 64 2024-01-13T18:02:41.363 INFO:tasks.rados.rados.0.smithi084.stdout:670: finishing copy_from to smithi084102331-27 2024-01-13T18:02:41.363 INFO:tasks.rados.rados.0.smithi084.stdout:670: got expected ENOENT (src dne) 2024-01-13T18:02:41.364 INFO:tasks.rados.rados.0.smithi084.stdout:670: finishing copy_from racing read to smithi084102331-27 2024-01-13T18:02:41.364 INFO:tasks.rados.rados.0.smithi084.stdout:670: done (3 left) 2024-01-13T18:02:41.364 INFO:tasks.rados.rados.0.smithi084.stdout:673: delete oid 40 current snap is 64 2024-01-13T18:02:41.370 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 257 (ObjNum 305 snap 0 seq_num 3552013632) dirty exists 2024-01-13T18:02:41.370 INFO:tasks.rados.rados.0.smithi084.stdout:671: finishing rollback tid 0 to smithi084102331-29 2024-01-13T18:02:41.371 INFO:tasks.rados.rados.0.smithi084.stdout:671: finishing rollback tid 1 to smithi084102331-29 2024-01-13T18:02:41.371 INFO:tasks.rados.rados.0.smithi084.stdout:669: expect (ObjNum 78 snap 14 seq_num 78) 2024-01-13T18:02:41.423 INFO:tasks.rados.rados.0.smithi084.stdout:671: finishing rollback tid 2 to smithi084102331-29 2024-01-13T18:02:41.423 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 169 (ObjNum 99 snap 19 seq_num 99) dirty exists 2024-01-13T18:02:41.423 INFO:tasks.rados.rados.0.smithi084.stdout:669: done (3 left) 2024-01-13T18:02:41.424 INFO:tasks.rados.rados.0.smithi084.stdout:671: done (2 left) 2024-01-13T18:02:41.424 INFO:tasks.rados.rados.0.smithi084.stdout:672: done (1 left) 2024-01-13T18:02:41.424 INFO:tasks.rados.rados.0.smithi084.stdout:673: done (0 left) 2024-01-13T18:02:41.424 INFO:tasks.rados.rados.0.smithi084.stdout:674: snap_create 2024-01-13T18:02:41.635 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[37908]: Upgrade: Updating mon.a 2024-01-13T18:02:41.635 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:41.635 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[37908]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[37908]: Deploying daemon mon.a on smithi084 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[37908]: mgrmap e35: y(active, since 20s), standbys: x 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[37908]: osdmap e189: 8 total, 8 up, 8 in 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 systemd[1]: Stopping Ceph mon.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[52328]: Upgrade: Updating mon.a 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:41.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[52328]: Deploying daemon mon.a on smithi084 2024-01-13T18:02:41.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[52328]: mgrmap e35: y(active, since 20s), standbys: x 2024-01-13T18:02:41.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-mon[52328]: osdmap e189: 8 total, 8 up, 8 in 2024-01-13T18:02:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:41 smithi099 ceph-mon[71325]: Upgrade: Updating mon.a 2024-01-13T18:02:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:41 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' 2024-01-13T18:02:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:41 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:02:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:41 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:02:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:41 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:41 smithi099 ceph-mon[71325]: Deploying daemon mon.a on smithi084 2024-01-13T18:02:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:41 smithi099 ceph-mon[71325]: mgrmap e35: y(active, since 20s), standbys: x 2024-01-13T18:02:41.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:41 smithi099 ceph-mon[71325]: osdmap e189: 8 total, 8 up, 8 in 2024-01-13T18:02:41.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-a[37886]: 2024-01-13T18:02:41.631+0000 7fcac7828700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:02:41.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-a[37886]: 2024-01-13T18:02:41.631+0000 7fcac7828700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-01-13T18:02:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:41 smithi084 bash[116203]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-a 2024-01-13T18:02:41.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:41] ENGINE Bus STOPPING 2024-01-13T18:02:41.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:41] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:02:41.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:41] ENGINE Bus STOPPED 2024-01-13T18:02:41.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:41] ENGINE Bus STARTING 2024-01-13T18:02:41.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:41] ENGINE Serving on http://:::9283 2024-01-13T18:02:41.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:41] ENGINE Bus STARTED 2024-01-13T18:02:42.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.a.service: Succeeded. 2024-01-13T18:02:42.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 systemd[1]: Stopped Ceph mon.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:42.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 systemd[1]: Starting Ceph mon.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: set uid:gid to 167:167 (ceph:ceph) 2024-01-13T18:02:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable), process ceph-mon, pid 7 2024-01-13T18:02:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: pidfile_write: ignore empty --pid-file 2024-01-13T18:02:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: load: jerasure load: lrc 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: RocksDB version: 7.9.2 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Git sha 0 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Compile date 2024-01-12 22:23:15 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: DB SUMMARY 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: DB Session ID: 62YOSI8JLZGNT8E0KWC6 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: CURRENT file: CURRENT 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: IDENTITY file: IDENTITY 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: MANIFEST file: MANIFEST-000015 size: 793 Bytes 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000027.sst 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000025.log size: 4406254 ; 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.error_if_exists: 0 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.create_if_missing: 0 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.paranoid_checks: 1 2024-01-13T18:02:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.flush_verify_memtable_count: 1 2024-01-13T18:02:42.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-13T18:02:42.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-01-13T18:02:42.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.env: 0x56335dfd4720 2024-01-13T18:02:42.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.fs: PosixFileSystem 2024-01-13T18:02:42.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.info_log: 0x563360285440 2024-01-13T18:02:42.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_file_opening_threads: 16 2024-01-13T18:02:42.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.statistics: (nil) 2024-01-13T18:02:42.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.use_fsync: 0 2024-01-13T18:02:42.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_log_file_size: 0 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.keep_log_file_num: 1000 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.recycle_log_file_num: 0 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.allow_fallocate: 1 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.allow_mmap_reads: 0 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.allow_mmap_writes: 0 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.use_direct_reads: 0 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.create_missing_column_families: 0 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.db_log_dir: 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.wal_dir: 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-13T18:02:42.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.advise_random_on_open: 1 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.db_write_buffer_size: 0 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.write_buffer_manager: 0x56335f516320 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.rate_limiter: (nil) 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.wal_recovery_mode: 2 2024-01-13T18:02:42.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.enable_thread_tracking: 0 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.enable_pipelined_write: 0 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.unordered_write: 0 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.row_cache: None 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.wal_filter: None 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.allow_ingest_behind: 0 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.two_write_queues: 0 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.manual_wal_flush: 0 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.wal_compression: 0 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.atomic_flush: 0 2024-01-13T18:02:42.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.log_readahead_size: 0 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.best_efforts_recovery: 0 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.allow_data_in_errors: 0 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.db_host_id: __hostname__ 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.enforce_single_del_contracts: true 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_background_jobs: 2 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_background_compactions: -1 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_subcompactions: 1 2024-01-13T18:02:42.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_total_wal_size: 0 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_open_files: -1 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bytes_per_sync: 0 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_readahead_size: 0 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_background_flushes: -1 2024-01-13T18:02:42.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Compression algorithms supported: 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: kZSTD supported: 0 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: kXpressCompression supported: 0 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: kLZ4HCCompression supported: 1 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: kZlibCompression supported: 1 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: kSnappyCompression supported: 1 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: kLZ4Compression supported: 1 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: kBZip2Compression supported: 0 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: DMutex implementation: pthread_mutex_t 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.merge_operator: 2024-01-13T18:02:42.937 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_filter: None 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_filter_factory: None 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.sst_partitioner_factory: None 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563360285540) 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_type: 0 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_index_type: 0 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_shortening: 1 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout: checksum: 4 2024-01-13T18:02:42.938 INFO:journalctl@ceph.mon.a.smithi084.stdout: no_block_cache: 0 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache: 0x56335f5971f0 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_options: 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: capacity : 536870912 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_shard_bits : 4 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: strict_capacity_limit : 0 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_compressed: (nil) 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: persistent_cache: (nil) 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size: 4096 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size_deviation: 10 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_restart_interval: 16 2024-01-13T18:02:42.939 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_block_restart_interval: 1 2024-01-13T18:02:42.940 INFO:journalctl@ceph.mon.a.smithi084.stdout: metadata_block_size: 4096 2024-01-13T18:02:42.940 INFO:journalctl@ceph.mon.a.smithi084.stdout: partition_filters: 0 2024-01-13T18:02:42.940 INFO:journalctl@ceph.mon.a.smithi084.stdout: use_delta_encoding: 1 2024-01-13T18:02:42.940 INFO:journalctl@ceph.mon.a.smithi084.stdout: filter_policy: bloomfilter 2024-01-13T18:02:42.940 INFO:journalctl@ceph.mon.a.smithi084.stdout: whole_key_filtering: 1 2024-01-13T18:02:42.940 INFO:journalctl@ceph.mon.a.smithi084.stdout: verify_compression: 0 2024-01-13T18:02:42.940 INFO:journalctl@ceph.mon.a.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-01-13T18:02:42.940 INFO:journalctl@ceph.mon.a.smithi084.stdout: format_version: 5 2024-01-13T18:02:42.940 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_index_compression: 1 2024-01-13T18:02:42.940 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_align: 0 2024-01-13T18:02:42.940 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_auto_readahead_size: 262144 2024-01-13T18:02:42.941 INFO:journalctl@ceph.mon.a.smithi084.stdout: prepopulate_block_cache: 0 2024-01-13T18:02:42.941 INFO:journalctl@ceph.mon.a.smithi084.stdout: initial_auto_readahead_size: 8192 2024-01-13T18:02:42.941 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_file_reads_for_auto_readahead: 2 2024-01-13T18:02:42.941 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.write_buffer_size: 33554432 2024-01-13T18:02:42.941 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_write_buffer_number: 2 2024-01-13T18:02:42.941 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compression: NoCompression 2024-01-13T18:02:42.941 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bottommost_compression: Disabled 2024-01-13T18:02:42.941 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.prefix_extractor: nullptr 2024-01-13T18:02:42.941 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-13T18:02:42.941 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.num_levels: 7 2024-01-13T18:02:42.941 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-13T18:02:42.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-13T18:02:42.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-13T18:02:42.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-13T18:02:42.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-13T18:02:42.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-13T18:02:42.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-13T18:02:42.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-13T18:02:42.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-13T18:02:42.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-13T18:02:42.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-01-13T18:02:42.943 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-01-13T18:02:42.943 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-13T18:02:42.943 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compression_opts.level: 32767 2024-01-13T18:02:42.943 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compression_opts.strategy: 0 2024-01-13T18:02:42.943 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-13T18:02:42.943 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compression_opts.enabled: false 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.target_file_size_base: 67108864 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-13T18:02:42.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.arena_block_size: 1048576 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.disable_auto_compactions: 0 2024-01-13T18:02:42.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-13T18:02:42.946 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-13T18:02:42.946 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-13T18:02:42.946 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.table_properties_collectors: 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.inplace_update_support: 0 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.bloom_locality: 0 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.max_successive_merges: 0 2024-01-13T18:02:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-13T18:02:42.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.paranoid_file_checks: 0 2024-01-13T18:02:42.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.force_consistency_checks: 1 2024-01-13T18:02:42.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.report_bg_io_stats: 0 2024-01-13T18:02:42.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.ttl: 2592000 2024-01-13T18:02:42.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-13T18:02:42.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-01-13T18:02:42.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-01-13T18:02:42.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.enable_blob_files: false 2024-01-13T18:02:42.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.min_blob_size: 0 2024-01-13T18:02:42.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.blob_file_size: 268435456 2024-01-13T18:02:42.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.blob_file_starting_level: 0 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 29, last_sequence is 10429, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 97782eac-5e93-4661-a114-f379c54797df 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168962529026, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 bash[116367]: b64908c7a53c569342b54395d92ae4a0a614c4d5a397ecd8d9cb6a4651b524e9 2024-01-13T18:02:42.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 systemd[1]: Started Ceph mon.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168962542754, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4050764, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10430, "largest_seqno": 12596, "table_properties": {"data_size": 4039931, "index_size": 7445, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2373, "raw_key_size": 22427, "raw_average_key_size": 24, "raw_value_size": 4018924, "raw_average_value_size": 4340, "num_data_blocks": 330, "num_entries": 926, "num_filter_entries": 926, "num_deletions": 29, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1705168962, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "97782eac-5e93-4661-a114-f379c54797df", "db_session_id": "62YOSI8JLZGNT8E0KWC6", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168962542854, "job": 1, "event": "recovery_finished"} 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56335f634000 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: DB pointer 0x56335f620000 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** DB Stats ** 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-13T18:02:42.950 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-13T18:02:42.951 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-13T18:02:42.951 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-13T18:02:42.951 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T18:02:42.951 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T18:02:42.951 INFO:journalctl@ceph.mon.a.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-13T18:02:42.951 INFO:journalctl@ceph.mon.a.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-01-13T18:02:42.951 INFO:journalctl@ceph.mon.a.smithi084.stdout: L0 1/0 3.86 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 513.4 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-01-13T18:02:42.951 INFO:journalctl@ceph.mon.a.smithi084.stdout: L6 1/0 7.27 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-01-13T18:02:42.951 INFO:journalctl@ceph.mon.a.smithi084.stdout: Sum 2/0 11.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 513.4 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-01-13T18:02:42.951 INFO:journalctl@ceph.mon.a.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 513.4 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-01-13T18:02:42.951 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T18:02:42.952 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T18:02:42.952 INFO:journalctl@ceph.mon.a.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-13T18:02:42.952 INFO:journalctl@ceph.mon.a.smithi084.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-13T18:02:42.952 INFO:journalctl@ceph.mon.a.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 513.4 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-01-13T18:02:42.952 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T18:02:42.952 INFO:journalctl@ceph.mon.a.smithi084.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-01-13T18:02:42.952 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T18:02:42.952 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T18:02:42.952 INFO:journalctl@ceph.mon.a.smithi084.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative compaction: 0.00 GB write, 237.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval compaction: 0.00 GB write, 237.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache BinnedLRUCache@0x56335f5971f0#7 capacity: 512.00 MB usage: 10.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.53 KB,0.000482798%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: starting mon.a rank 0 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: mon.a@-1(???) e3 preinit fsid be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T18:02:42.953 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: mon.a@-1(???).mds e8 new map 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: mon.a@-1(???).mds e8 print_map 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: e8 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: legacy client fscid: 1 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: Filesystem 'cephfs' (1) 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: fs_name cephfs 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: epoch 8 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: created 2024-01-13T17:58:37.204248+0000 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: modified 2024-01-13T17:58:40.826281+0000 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: tableserver 0 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: root 0 2024-01-13T18:02:42.954 INFO:journalctl@ceph.mon.a.smithi084.stdout: session_timeout 60 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: session_autoclose 300 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_file_size 1099511627776 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_xattr_size 65536 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: required_client_features {} 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: last_failure 0 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: last_failure_osd_epoch 0 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_mds 1 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: in 0 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: up {0=24337} 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: failed 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: damaged 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: stopped 2024-01-13T18:02:42.955 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_pools [3] 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout: metadata_pool 2 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout: inline_data disabled 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout: balancer 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout: bal_rank_mask -1 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout: standby_count_wanted 0 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout: [mds.b{0:24337} state up:active seq 3 addr [v2:172.21.15.99:6832/2558131725,v1:172.21.15.99:6833/2558131725] compat {c=[1],r=[1],i=[7ff]}] 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout: Standby daemons: 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout: [mds.a{-1:14463} state up:standby seq 1 addr [v2:172.21.15.84:6834/3944391177,v1:172.21.15.84:6835/3944391177] compat {c=[1],r=[1],i=[7ff]}] 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: mon.a@-1(???).osd e189 crush map has features 3314933069573799936, adjusting msgr requires 2024-01-13T18:02:42.956 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: mon.a@-1(???).osd e189 crush map has features 432629308056666112, adjusting msgr requires 2024-01-13T18:02:42.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: mon.a@-1(???).osd e189 crush map has features 432629308056666112, adjusting msgr requires 2024-01-13T18:02:42.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: mon.a@-1(???).osd e189 crush map has features 432629308056666112, adjusting msgr requires 2024-01-13T18:02:42.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:42 smithi084 ceph-mon[116404]: mon.a@-1(???).paxosservice(auth 1..17) refresh upgraded, format 0 -> 3 2024-01-13T18:02:43.238 INFO:tasks.rados.rados.0.smithi084.stdout:674: done (0 left) 2024-01-13T18:02:43.238 INFO:tasks.rados.rados.0.smithi084.stdout:675: delete oid 9 current snap is 65 2024-01-13T18:02:43.244 INFO:tasks.rados.rados.0.smithi084.stdout:675: done (0 left) 2024-01-13T18:02:43.244 INFO:tasks.rados.rados.0.smithi084.stdout:676: snap_create 2024-01-13T18:02:43.532 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ignoring --setuser ceph since I am not root 2024-01-13T18:02:43.533 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ignoring --setgroup ceph since I am not root 2024-01-13T18:02:43.533 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mgr[106049]: -- 172.21.15.84:0/863632438 <== mon.2 v2:172.21.15.84:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e22a4e11e0 con 0x55e22a4b6800 2024-01-13T18:02:43.533 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:43.365+0000 7fcb357e7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T18:02:43.533 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:43.530+0000 7fcb357e7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T18:02:43.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:02:43.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:02:43.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:02:43.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: mon.a calling monitor election 2024-01-13T18:02:43.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T18:02:43.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:02:43.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:02:43.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: osdmap e189: 8 total, 8 up, 8 in 2024-01-13T18:02:43.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: mgrmap e35: y(active, since 23s), standbys: x 2024-01-13T18:02:43.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: mgrmap e36: y(active, since 23s), standbys: x 2024-01-13T18:02:43.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: overall HEALTH_OK 2024-01-13T18:02:43.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[116404]: from='mgr.25049 ' entity='' 2024-01-13T18:02:43.534 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:02:43.534 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:02:43.535 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:02:43.535 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: mon.a calling monitor election 2024-01-13T18:02:43.535 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T18:02:43.535 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:02:43.535 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:02:43.535 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: osdmap e189: 8 total, 8 up, 8 in 2024-01-13T18:02:43.535 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: mgrmap e35: y(active, since 23s), standbys: x 2024-01-13T18:02:43.535 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: mgrmap e36: y(active, since 23s), standbys: x 2024-01-13T18:02:43.535 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: overall HEALTH_OK 2024-01-13T18:02:43.535 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-mon[52328]: from='mgr.25049 ' entity='' 2024-01-13T18:02:43.535 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:43.229+0000 7fe138ead700 -1 mon.c@2(peon).osd e190 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:43.536 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: ignoring --setuser ceph since I am not root 2024-01-13T18:02:43.536 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: ignoring --setgroup ceph since I am not root 2024-01-13T18:02:43.536 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mgr[128362]: -- 172.21.15.99:0/3552302714 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fb081ab1e0 con 0x55fb08180c00 2024-01-13T18:02:43.536 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:43.363+0000 7fdca273c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-13T18:02:43.536 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:02:43.536 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:02:43.536 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: from='mgr.25049 172.21.15.84:0/3146818091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:02:43.536 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: mon.a calling monitor election 2024-01-13T18:02:43.536 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T18:02:43.537 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:02:43.537 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:02:43.537 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: osdmap e189: 8 total, 8 up, 8 in 2024-01-13T18:02:43.537 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: mgrmap e35: y(active, since 23s), standbys: x 2024-01-13T18:02:43.537 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: mgrmap e36: y(active, since 23s), standbys: x 2024-01-13T18:02:43.537 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: overall HEALTH_OK 2024-01-13T18:02:43.537 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-mon[71325]: from='mgr.25049 ' entity='' 2024-01-13T18:02:43.537 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:43.229+0000 7fcf840aa700 -1 mon.b@1(peon).osd e190 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:43.857 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:43.532+0000 7fdca273c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-13T18:02:43.857 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:43.855+0000 7fdca273c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T18:02:44.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:43.853+0000 7fcb357e7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-13T18:02:44.238 INFO:tasks.rados.rados.0.smithi084.stdout:676: done (0 left) 2024-01-13T18:02:44.238 INFO:tasks.rados.rados.0.smithi084.stdout:677: rmattr oid 13 current snap is 66 2024-01-13T18:02:44.238 INFO:tasks.rados.rados.0.smithi084.stdout:678: snap_create 2024-01-13T18:02:44.247 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 165 (ObjNum 85 snap 15 seq_num 85) dirty exists 2024-01-13T18:02:44.566 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:44.340+0000 7fdca273c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T18:02:44.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:44.230+0000 7fcf840aa700 -1 mon.b@1(peon).osd e191 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:44.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:44 smithi099 ceph-mon[71325]: osdmap e190: 8 total, 8 up, 8 in 2024-01-13T18:02:44.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:44 smithi099 ceph-mon[71325]: failed to encode map e190 with expected crc 2024-01-13T18:02:44.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:44 smithi099 ceph-mon[71325]: failed to encode map e190 with expected crc 2024-01-13T18:02:44.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:44 smithi099 ceph-mon[71325]: failed to encode map e190 with expected crc 2024-01-13T18:02:44.568 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:44.342+0000 7fcb357e7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-13T18:02:44.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-mon[116404]: osdmap e190: 8 total, 8 up, 8 in 2024-01-13T18:02:44.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-mon[116404]: failed to encode map e190 with expected crc 2024-01-13T18:02:44.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-mon[116404]: failed to encode map e190 with expected crc 2024-01-13T18:02:44.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-mon[116404]: failed to encode map e190 with expected crc 2024-01-13T18:02:44.568 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:44.230+0000 7fe138ead700 -1 mon.c@2(peon).osd e191 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:44.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-mon[52328]: osdmap e190: 8 total, 8 up, 8 in 2024-01-13T18:02:44.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-mon[52328]: failed to encode map e190 with expected crc 2024-01-13T18:02:44.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-mon[52328]: failed to encode map e190 with expected crc 2024-01-13T18:02:44.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-mon[52328]: failed to encode map e190 with expected crc 2024-01-13T18:02:44.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:44.565+0000 7fcb357e7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T18:02:45.242 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:44.564+0000 7fdca273c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-13T18:02:45.243 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:44.982+0000 7fdca273c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T18:02:45.243 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:44.985+0000 7fcb357e7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-13T18:02:45.243 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:45 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:45.240+0000 7fe138ead700 -1 mon.c@2(peon).osd e192 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:45.248 INFO:tasks.rados.rados.0.smithi084.stdout:677: done (1 left) 2024-01-13T18:02:45.248 INFO:tasks.rados.rados.0.smithi084.stdout:678: done (0 left) 2024-01-13T18:02:45.248 INFO:tasks.rados.rados.0.smithi084.stdout:679: copy_from oid 43 from oid 39 current snap is 67 2024-01-13T18:02:45.248 INFO:tasks.rados.rados.0.smithi084.stdout:680: delete oid 49 current snap is 67 2024-01-13T18:02:45.257 INFO:tasks.rados.rados.0.smithi084.stdout:680: done (1 left) 2024-01-13T18:02:45.257 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 67 2024-01-13T18:02:45.257 INFO:tasks.rados.rados.0.smithi084.stdout:681: seq_num 219 ranges {1638400=475136,2113536=466944,2580480=335872} 2024-01-13T18:02:45.269 INFO:tasks.rados.rados.0.smithi084.stdout:681: writing smithi084102331-23 from 1638400 to 2113536 tid 1 2024-01-13T18:02:45.273 INFO:tasks.rados.rados.0.smithi084.stdout:681: writing smithi084102331-23 from 2113536 to 2580480 tid 2 2024-01-13T18:02:45.275 INFO:tasks.rados.rados.0.smithi084.stdout:681: writing smithi084102331-23 from 2580480 to 2916352 tid 3 2024-01-13T18:02:45.275 INFO:tasks.rados.rados.0.smithi084.stdout:682: rollback oid 3 current snap is 67 2024-01-13T18:02:45.275 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 64 2024-01-13T18:02:45.275 INFO:tasks.rados.rados.0.smithi084.stdout:681: finishing write tid 1 to smithi084102331-23 2024-01-13T18:02:45.275 INFO:tasks.rados.rados.0.smithi084.stdout:683: snap_create 2024-01-13T18:02:45.277 INFO:tasks.rados.rados.0.smithi084.stdout:681: finishing write tid 2 to smithi084102331-23 2024-01-13T18:02:45.278 INFO:tasks.rados.rados.0.smithi084.stdout:679: finishing copy_from to smithi084102331-43 2024-01-13T18:02:45.278 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 145 (ObjNum 201 snap 55 seq_num 201) dirty exists 2024-01-13T18:02:45.278 INFO:tasks.rados.rados.0.smithi084.stdout:682: finishing rollback tid 0 to smithi084102331-3 2024-01-13T18:02:45.278 INFO:tasks.rados.rados.0.smithi084.stdout:681: finishing write tid 3 to smithi084102331-23 2024-01-13T18:02:45.278 INFO:tasks.rados.rados.0.smithi084.stdout:682: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:02:45.278 INFO:tasks.rados.rados.0.smithi084.stdout:681: finishing write tid 4 to smithi084102331-23 2024-01-13T18:02:45.278 INFO:tasks.rados.rados.0.smithi084.stdout:679: finishing copy_from racing read to smithi084102331-43 2024-01-13T18:02:45.278 INFO:tasks.rados.rados.0.smithi084.stdout:682: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:02:45.278 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 324 (ObjNum 215 snap 61 seq_num 215) dirty exists 2024-01-13T18:02:45.280 INFO:tasks.rados.rados.0.smithi084.stdout:681: finishing write tid 5 to smithi084102331-23 2024-01-13T18:02:45.280 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 229 (ObjNum 219 snap 67 seq_num 219) dirty exists 2024-01-13T18:02:45.280 INFO:tasks.rados.rados.0.smithi084.stdout:681: left oid 23 (ObjNum 219 snap 67 seq_num 219) 2024-01-13T18:02:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:45.241+0000 7fcf840aa700 -1 mon.b@1(peon).osd e192 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:45 smithi099 ceph-mon[71325]: failed to encode map e191 with expected crc 2024-01-13T18:02:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:45 smithi099 ceph-mon[71325]: failed to encode map e191 with expected crc 2024-01-13T18:02:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:45 smithi099 ceph-mon[71325]: osdmap e191: 8 total, 8 up, 8 in 2024-01-13T18:02:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:45 smithi099 ceph-mon[71325]: failed to encode map e191 with expected crc 2024-01-13T18:02:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:45 smithi084 ceph-mon[116404]: failed to encode map e191 with expected crc 2024-01-13T18:02:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:45 smithi084 ceph-mon[116404]: failed to encode map e191 with expected crc 2024-01-13T18:02:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:45 smithi084 ceph-mon[116404]: osdmap e191: 8 total, 8 up, 8 in 2024-01-13T18:02:45.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:45 smithi084 ceph-mon[116404]: failed to encode map e191 with expected crc 2024-01-13T18:02:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:45 smithi084 ceph-mon[52328]: failed to encode map e191 with expected crc 2024-01-13T18:02:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:45 smithi084 ceph-mon[52328]: failed to encode map e191 with expected crc 2024-01-13T18:02:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:45 smithi084 ceph-mon[52328]: osdmap e191: 8 total, 8 up, 8 in 2024-01-13T18:02:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:45 smithi084 ceph-mon[52328]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:45.694+0000 7fdca273c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T18:02:46.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:45.780+0000 7fdca273c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T18:02:46.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:45 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:45.697+0000 7fcb357e7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-13T18:02:46.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:45 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:45.783+0000 7fcb357e7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-13T18:02:46.258 INFO:tasks.rados.rados.0.smithi084.stdout:679: done (3 left) 2024-01-13T18:02:46.258 INFO:tasks.rados.rados.0.smithi084.stdout:681: done (2 left) 2024-01-13T18:02:46.258 INFO:tasks.rados.rados.0.smithi084.stdout:682: done (1 left) 2024-01-13T18:02:46.258 INFO:tasks.rados.rados.0.smithi084.stdout:683: done (0 left) 2024-01-13T18:02:46.258 INFO:tasks.rados.rados.0.smithi084.stdout:684: read oid 42 snap -1 2024-01-13T18:02:46.258 INFO:tasks.rados.rados.0.smithi084.stdout:684: expect (ObjNum 146 snap 40 seq_num 146) 2024-01-13T18:02:46.258 INFO:tasks.rados.rados.0.smithi084.stdout:685: delete oid 38 current snap is 68 2024-01-13T18:02:46.272 INFO:tasks.rados.rados.0.smithi084.stdout:685: done (1 left) 2024-01-13T18:02:46.273 INFO:tasks.rados.rados.0.smithi084.stdout:686: read oid 9 snap -1 2024-01-13T18:02:46.273 INFO:tasks.rados.rados.0.smithi084.stdout:686: expect deleted 2024-01-13T18:02:46.273 INFO:tasks.rados.rados.0.smithi084.stdout:687: read oid 40 snap 64 2024-01-13T18:02:46.273 INFO:tasks.rados.rados.0.smithi084.stdout:687: expect deleted 2024-01-13T18:02:46.273 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 68 2024-01-13T18:02:46.273 INFO:tasks.rados.rados.0.smithi084.stdout:688: seq_num 221 ranges {2023424=507904,2531328=688128,3219456=114688} 2024-01-13T18:02:46.284 INFO:tasks.rados.rados.0.smithi084.stdout:688: writing smithi084102331-37 from 2023424 to 2531328 tid 1 2024-01-13T18:02:46.288 INFO:tasks.rados.rados.0.smithi084.stdout:688: writing smithi084102331-37 from 2531328 to 3219456 tid 2 2024-01-13T18:02:46.289 INFO:tasks.rados.rados.0.smithi084.stdout:688: writing smithi084102331-37 from 3219456 to 3334144 tid 3 2024-01-13T18:02:46.289 INFO:tasks.rados.rados.0.smithi084.stdout:689: rmattr oid 41 current snap is 68 2024-01-13T18:02:46.289 INFO:tasks.rados.rados.0.smithi084.stdout:689: done (4 left) 2024-01-13T18:02:46.289 INFO:tasks.rados.rados.0.smithi084.stdout:690: snap_remove snap 61 2024-01-13T18:02:46.558 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:46.383+0000 7fdca273c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T18:02:46.558 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:46.467+0000 7fdca273c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T18:02:46.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:46.249+0000 7fcf840aa700 -1 mon.b@1(peon).osd e193 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:46.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-mon[71325]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-mon[71325]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-mon[71325]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-mon[71325]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-mon[71325]: osdmap e192: 8 total, 8 up, 8 in 2024-01-13T18:02:46.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-mon[71325]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-mon[71325]: failed to encode map e192 with expected crc 2024-01-13T18:02:46.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-mon[71325]: failed to encode map e192 with expected crc 2024-01-13T18:02:46.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-mon[71325]: failed to encode map e192 with expected crc 2024-01-13T18:02:46.577 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:46.399+0000 7fcb357e7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-13T18:02:46.577 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:46.485+0000 7fcb357e7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-13T18:02:46.577 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[116404]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.577 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[116404]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[116404]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[116404]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[116404]: osdmap e192: 8 total, 8 up, 8 in 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[116404]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[116404]: failed to encode map e192 with expected crc 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[116404]: failed to encode map e192 with expected crc 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[116404]: failed to encode map e192 with expected crc 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:46.250+0000 7fe138ead700 -1 mon.c@2(peon).osd e193 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[52328]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[52328]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[52328]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[52328]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[52328]: osdmap e192: 8 total, 8 up, 8 in 2024-01-13T18:02:46.578 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[52328]: failed to encode map e191 with expected crc 2024-01-13T18:02:46.579 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[52328]: failed to encode map e192 with expected crc 2024-01-13T18:02:46.579 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[52328]: failed to encode map e192 with expected crc 2024-01-13T18:02:46.579 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-mon[52328]: failed to encode map e192 with expected crc 2024-01-13T18:02:46.868 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:46.556+0000 7fdca273c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T18:02:46.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:46.779+0000 7fdca273c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T18:02:46.900 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:46.575+0000 7fcb357e7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-13T18:02:46.900 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:46.805+0000 7fcb357e7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-13T18:02:47.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:46.898+0000 7fcb357e7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T18:02:47.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:46.991+0000 7fcb357e7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T18:02:47.184 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:46.872+0000 7fdca273c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-13T18:02:47.184 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:46 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:46.966+0000 7fdca273c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-13T18:02:47.184 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:47.182+0000 7fdca273c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T18:02:47.275 INFO:tasks.rados.rados.0.smithi084.stdout:690: done (4 left) 2024-01-13T18:02:47.276 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 68 2024-01-13T18:02:47.276 INFO:tasks.rados.rados.0.smithi084.stdout:684: expect (ObjNum 146 snap 40 seq_num 146) 2024-01-13T18:02:47.304 INFO:tasks.rados.rados.0.smithi084.stdout:688: finishing write tid 1 to smithi084102331-37 2024-01-13T18:02:47.304 INFO:tasks.rados.rados.0.smithi084.stdout:688: finishing write tid 2 to smithi084102331-37 2024-01-13T18:02:47.304 INFO:tasks.rados.rados.0.smithi084.stdout:688: finishing write tid 3 to smithi084102331-37 2024-01-13T18:02:47.304 INFO:tasks.rados.rados.0.smithi084.stdout:691: seq_num 222 ranges {0=524288,524288=565248,1089536=237568} 2024-01-13T18:02:47.307 INFO:tasks.rados.rados.0.smithi084.stdout:691: writing smithi084102331-5 from 0 to 524288 tid 1 2024-01-13T18:02:47.311 INFO:tasks.rados.rados.0.smithi084.stdout:691: writing smithi084102331-5 from 524288 to 1089536 tid 2 2024-01-13T18:02:47.312 INFO:tasks.rados.rados.0.smithi084.stdout:691: writing smithi084102331-5 from 1089536 to 1327104 tid 3 2024-01-13T18:02:47.312 INFO:tasks.rados.rados.0.smithi084.stdout:684: done (4 left) 2024-01-13T18:02:47.312 INFO:tasks.rados.rados.0.smithi084.stdout:686: done (3 left) 2024-01-13T18:02:47.312 INFO:tasks.rados.rados.0.smithi084.stdout:687: done (2 left) 2024-01-13T18:02:47.313 INFO:tasks.rados.rados.0.smithi084.stdout:692: rollback oid 31 current snap is 68 2024-01-13T18:02:47.313 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 54 2024-01-13T18:02:47.313 INFO:tasks.rados.rados.0.smithi084.stdout:688: finishing write tid 4 to smithi084102331-37 2024-01-13T18:02:47.313 INFO:tasks.rados.rados.0.smithi084.stdout:688: finishing write tid 5 to smithi084102331-37 2024-01-13T18:02:47.313 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 266 (ObjNum 221 snap 68 seq_num 221) dirty exists 2024-01-13T18:02:47.313 INFO:tasks.rados.rados.0.smithi084.stdout:688: left oid 37 (ObjNum 221 snap 68 seq_num 221) 2024-01-13T18:02:47.313 INFO:tasks.rados.rados.0.smithi084.stdout:688: done (2 left) 2024-01-13T18:02:47.313 INFO:tasks.rados.rados.0.smithi084.stdout:693: snap_create 2024-01-13T18:02:47.315 INFO:tasks.rados.rados.0.smithi084.stdout:691: finishing write tid 1 to smithi084102331-5 2024-01-13T18:02:47.320 INFO:tasks.rados.rados.0.smithi084.stdout:691: finishing write tid 2 to smithi084102331-5 2024-01-13T18:02:47.320 INFO:tasks.rados.rados.0.smithi084.stdout:691: finishing write tid 3 to smithi084102331-5 2024-01-13T18:02:47.321 INFO:tasks.rados.rados.0.smithi084.stdout:691: finishing write tid 4 to smithi084102331-5 2024-01-13T18:02:47.322 INFO:tasks.rados.rados.0.smithi084.stdout:692: finishing rollback tid 0 to smithi084102331-31 2024-01-13T18:02:47.322 INFO:tasks.rados.rados.0.smithi084.stdout:692: finishing rollback tid 1 to smithi084102331-31 2024-01-13T18:02:47.322 INFO:tasks.rados.rados.0.smithi084.stdout:692: finishing rollback tid 2 to smithi084102331-31 2024-01-13T18:02:47.323 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 331 (ObjNum 114 snap 27 seq_num 114) dirty exists 2024-01-13T18:02:47.323 INFO:tasks.rados.rados.0.smithi084.stdout:691: finishing write tid 5 to smithi084102331-5 2024-01-13T18:02:47.323 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 171 (ObjNum 222 snap 68 seq_num 222) dirty exists 2024-01-13T18:02:47.323 INFO:tasks.rados.rados.0.smithi084.stdout:691: left oid 5 (ObjNum 222 snap 68 seq_num 222) 2024-01-13T18:02:47.473 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:47.282+0000 7fdca273c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T18:02:47.474 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:47 smithi099 ceph-mon[71325]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.474 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:47 smithi099 ceph-mon[71325]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.474 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:47 smithi099 ceph-mon[71325]: osdmap e193: 8 total, 8 up, 8 in 2024-01-13T18:02:47.474 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:47 smithi099 ceph-mon[71325]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.474 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:47 smithi099 ceph-mon[71325]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.474 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:47.268+0000 7fcf840aa700 -1 mon.b@1(peon).osd e194 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:47.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:47.207+0000 7fcb357e7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-13T18:02:47.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:47.310+0000 7fcb357e7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-13T18:02:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-mon[116404]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-mon[116404]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-mon[116404]: osdmap e193: 8 total, 8 up, 8 in 2024-01-13T18:02:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-mon[116404]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-mon[116404]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-mon[52328]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-mon[52328]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-mon[52328]: osdmap e193: 8 total, 8 up, 8 in 2024-01-13T18:02:47.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-mon[52328]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-mon[52328]: failed to encode map e193 with expected crc 2024-01-13T18:02:47.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:47.270+0000 7fe138ead700 -1 mon.c@2(peon).osd e194 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:47.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:47.472+0000 7fdca273c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T18:02:47.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:47 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:47.559+0000 7fdca273c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T18:02:47.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:47.501+0000 7fcb357e7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-13T18:02:47.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:47.590+0000 7fcb357e7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-13T18:02:48.277 INFO:tasks.rados.rados.0.smithi084.stdout:691: done (2 left) 2024-01-13T18:02:48.278 INFO:tasks.rados.rados.0.smithi084.stdout:692: done (1 left) 2024-01-13T18:02:48.278 INFO:tasks.rados.rados.0.smithi084.stdout:693: done (0 left) 2024-01-13T18:02:48.278 INFO:tasks.rados.rados.0.smithi084.stdout:694: copy_from oid 48 from oid 7 current snap is 69 2024-01-13T18:02:48.278 INFO:tasks.rados.rados.0.smithi084.stdout:695: read oid 2 snap -1 2024-01-13T18:02:48.278 INFO:tasks.rados.rados.0.smithi084.stdout:695: expect deleted 2024-01-13T18:02:48.278 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 69 2024-01-13T18:02:48.278 INFO:tasks.rados.rados.0.smithi084.stdout:696: seq_num 223 ranges {1638400=540672,2179072=450560,2629632=352256} 2024-01-13T18:02:48.289 INFO:tasks.rados.rados.0.smithi084.stdout:696: writing smithi084102331-13 from 1638400 to 2179072 tid 1 2024-01-13T18:02:48.292 INFO:tasks.rados.rados.0.smithi084.stdout:696: writing smithi084102331-13 from 2179072 to 2629632 tid 2 2024-01-13T18:02:48.295 INFO:tasks.rados.rados.0.smithi084.stdout:696: writing smithi084102331-13 from 2629632 to 2981888 tid 3 2024-01-13T18:02:48.295 INFO:tasks.rados.rados.0.smithi084.stdout:697: read oid 47 snap -1 2024-01-13T18:02:48.295 INFO:tasks.rados.rados.0.smithi084.stdout:697: expect (ObjNum 127 snap 32 seq_num 127) 2024-01-13T18:02:48.295 INFO:tasks.rados.rados.0.smithi084.stdout:698: delete oid 26 current snap is 69 2024-01-13T18:02:48.295 INFO:tasks.rados.rados.0.smithi084.stdout:694: finishing copy_from to smithi084102331-48 2024-01-13T18:02:48.295 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 93 (ObjNum 200 snap 55 seq_num 200) dirty exists 2024-01-13T18:02:48.295 INFO:tasks.rados.rados.0.smithi084.stdout:696: finishing write tid 1 to smithi084102331-13 2024-01-13T18:02:48.295 INFO:tasks.rados.rados.0.smithi084.stdout:694: finishing copy_from racing read to smithi084102331-48 2024-01-13T18:02:48.295 INFO:tasks.rados.rados.0.smithi084.stdout:696: finishing write tid 2 to smithi084102331-13 2024-01-13T18:02:48.297 INFO:tasks.rados.rados.0.smithi084.stdout:696: finishing write tid 3 to smithi084102331-13 2024-01-13T18:02:48.297 INFO:tasks.rados.rados.0.smithi084.stdout:696: finishing write tid 4 to smithi084102331-13 2024-01-13T18:02:48.299 INFO:tasks.rados.rados.0.smithi084.stdout:696: finishing write tid 5 to smithi084102331-13 2024-01-13T18:02:48.299 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 176 (ObjNum 223 snap 69 seq_num 223) dirty exists 2024-01-13T18:02:48.299 INFO:tasks.rados.rados.0.smithi084.stdout:696: left oid 13 (ObjNum 223 snap 69 seq_num 223) 2024-01-13T18:02:48.301 INFO:tasks.rados.rados.0.smithi084.stdout:694: done (4 left) 2024-01-13T18:02:48.301 INFO:tasks.rados.rados.0.smithi084.stdout:695: done (3 left) 2024-01-13T18:02:48.301 INFO:tasks.rados.rados.0.smithi084.stdout:696: done (2 left) 2024-01-13T18:02:48.301 INFO:tasks.rados.rados.0.smithi084.stdout:698: done (1 left) 2024-01-13T18:02:48.301 INFO:tasks.rados.rados.0.smithi084.stdout:699: read oid 20 snap -1 2024-01-13T18:02:48.301 INFO:tasks.rados.rados.0.smithi084.stdout:699: expect (ObjNum 197 snap 55 seq_num 197) 2024-01-13T18:02:48.302 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 69 2024-01-13T18:02:48.302 INFO:tasks.rados.rados.0.smithi084.stdout:700: seq_num 225 ranges {0=573440,573440=622592,1196032=180224} 2024-01-13T18:02:48.304 INFO:tasks.rados.rados.0.smithi084.stdout:700: writing smithi084102331-40 from 0 to 573440 tid 1 2024-01-13T18:02:48.308 INFO:tasks.rados.rados.0.smithi084.stdout:700: writing smithi084102331-40 from 573440 to 1196032 tid 2 2024-01-13T18:02:48.310 INFO:tasks.rados.rados.0.smithi084.stdout:700: writing smithi084102331-40 from 1196032 to 1376256 tid 3 2024-01-13T18:02:48.310 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 69 2024-01-13T18:02:48.310 INFO:tasks.rados.rados.0.smithi084.stdout:700: finishing write tid 1 to smithi084102331-40 2024-01-13T18:02:48.310 INFO:tasks.rados.rados.0.smithi084.stdout:701: seq_num 226 ranges {2916352=589824,3506176=507904,4014080=294912} 2024-01-13T18:02:48.329 INFO:tasks.rados.rados.0.smithi084.stdout:701: writing smithi084102331-23 from 2916352 to 3506176 tid 1 2024-01-13T18:02:48.332 INFO:tasks.rados.rados.0.smithi084.stdout:701: writing smithi084102331-23 from 3506176 to 4014080 tid 2 2024-01-13T18:02:48.334 INFO:tasks.rados.rados.0.smithi084.stdout:701: writing smithi084102331-23 from 4014080 to 4308992 tid 3 2024-01-13T18:02:48.334 INFO:tasks.rados.rados.0.smithi084.stdout:702: read oid 6 snap -1 2024-01-13T18:02:48.334 INFO:tasks.rados.rados.0.smithi084.stdout:702: expect (ObjNum 203 snap 55 seq_num 203) 2024-01-13T18:02:48.334 INFO:tasks.rados.rados.0.smithi084.stdout:703: copy_from oid 50 from oid 39 current snap is 69 2024-01-13T18:02:48.334 INFO:tasks.rados.rados.0.smithi084.stdout:700: finishing write tid 2 to smithi084102331-40 2024-01-13T18:02:48.334 INFO:tasks.rados.rados.0.smithi084.stdout:700: finishing write tid 3 to smithi084102331-40 2024-01-13T18:02:48.334 INFO:tasks.rados.rados.0.smithi084.stdout:700: finishing write tid 4 to smithi084102331-40 2024-01-13T18:02:48.334 INFO:tasks.rados.rados.0.smithi084.stdout:699: expect (ObjNum 197 snap 55 seq_num 197) 2024-01-13T18:02:48.362 INFO:tasks.rados.rados.0.smithi084.stdout:700: finishing write tid 5 to smithi084102331-40 2024-01-13T18:02:48.362 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 179 (ObjNum 225 snap 69 seq_num 225) dirty exists 2024-01-13T18:02:48.362 INFO:tasks.rados.rados.0.smithi084.stdout:700: left oid 40 (ObjNum 225 snap 69 seq_num 225) 2024-01-13T18:02:48.362 INFO:tasks.rados.rados.0.smithi084.stdout:697: expect (ObjNum 127 snap 32 seq_num 127) 2024-01-13T18:02:48.488 INFO:tasks.rados.rados.0.smithi084.stdout:701: finishing write tid 1 to smithi084102331-23 2024-01-13T18:02:48.488 INFO:tasks.rados.rados.0.smithi084.stdout:697: done (5 left) 2024-01-13T18:02:48.488 INFO:tasks.rados.rados.0.smithi084.stdout:699: done (4 left) 2024-01-13T18:02:48.488 INFO:tasks.rados.rados.0.smithi084.stdout:700: done (3 left) 2024-01-13T18:02:48.488 INFO:tasks.rados.rados.0.smithi084.stdout:704: snap_remove snap 50 2024-01-13T18:02:48.523 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:48.319+0000 7fdca273c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T18:02:48.523 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:48.270+0000 7fcf840aa700 -1 mon.b@1(peon).osd e195 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:48.523 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:48 smithi099 ceph-mon[71325]: failed to encode map e194 with expected crc 2024-01-13T18:02:48.523 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:48 smithi099 ceph-mon[71325]: osdmap e194: 8 total, 8 up, 8 in 2024-01-13T18:02:48.524 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:48 smithi099 ceph-mon[71325]: failed to encode map e194 with expected crc 2024-01-13T18:02:48.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:48 smithi084 ceph-mon[116404]: failed to encode map e194 with expected crc 2024-01-13T18:02:48.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:48 smithi084 ceph-mon[116404]: osdmap e194: 8 total, 8 up, 8 in 2024-01-13T18:02:48.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:48 smithi084 ceph-mon[116404]: failed to encode map e194 with expected crc 2024-01-13T18:02:48.567 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:48.357+0000 7fcb357e7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-13T18:02:48.567 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:48.269+0000 7fe138ead700 -1 mon.c@2(peon).osd e195 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:48.567 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:48 smithi084 ceph-mon[52328]: failed to encode map e194 with expected crc 2024-01-13T18:02:48.567 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:48 smithi084 ceph-mon[52328]: osdmap e194: 8 total, 8 up, 8 in 2024-01-13T18:02:48.567 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:48 smithi084 ceph-mon[52328]: failed to encode map e194 with expected crc 2024-01-13T18:02:48.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:48.522+0000 7fdca273c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T18:02:48.869 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:48.704+0000 7fdca273c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:02:48.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:48.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:02:48.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:48.564+0000 7fcb357e7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-13T18:02:48.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:48.748+0000 7fcb357e7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:02:49.291 INFO:tasks.rados.rados.0.smithi084.stdout:704: done (3 left) 2024-01-13T18:02:49.291 INFO:tasks.rados.rados.0.smithi084.stdout:705: delete oid 31 current snap is 69 2024-01-13T18:02:49.291 INFO:tasks.rados.rados.0.smithi084.stdout:701: finishing write tid 2 to smithi084102331-23 2024-01-13T18:02:49.291 INFO:tasks.rados.rados.0.smithi084.stdout:701: finishing write tid 3 to smithi084102331-23 2024-01-13T18:02:49.291 INFO:tasks.rados.rados.0.smithi084.stdout:701: finishing write tid 4 to smithi084102331-23 2024-01-13T18:02:49.291 INFO:tasks.rados.rados.0.smithi084.stdout:701: finishing write tid 5 to smithi084102331-23 2024-01-13T18:02:49.291 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 238 (ObjNum 226 snap 69 seq_num 226) dirty exists 2024-01-13T18:02:49.291 INFO:tasks.rados.rados.0.smithi084.stdout:701: left oid 23 (ObjNum 226 snap 69 seq_num 226) 2024-01-13T18:02:49.291 INFO:tasks.rados.rados.0.smithi084.stdout:702: expect (ObjNum 203 snap 55 seq_num 203) 2024-01-13T18:02:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:703: finishing copy_from to smithi084102331-50 2024-01-13T18:02:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 145 (ObjNum 201 snap 55 seq_num 201) dirty exists 2024-01-13T18:02:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:703: finishing copy_from racing read to smithi084102331-50 2024-01-13T18:02:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:701: done (3 left) 2024-01-13T18:02:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:702: done (2 left) 2024-01-13T18:02:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:703: done (1 left) 2024-01-13T18:02:49.419 INFO:tasks.rados.rados.0.smithi084.stdout:705: done (0 left) 2024-01-13T18:02:49.419 INFO:tasks.rados.rados.0.smithi084.stdout:706: read oid 11 snap -1 2024-01-13T18:02:49.419 INFO:tasks.rados.rados.0.smithi084.stdout:706: expect deleted 2024-01-13T18:02:49.419 INFO:tasks.rados.rados.0.smithi084.stdout:707: snap_remove snap 57 2024-01-13T18:02:49.563 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:49.375+0000 7fdca273c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T18:02:49.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-mon[71325]: failed to encode map e194 with expected crc 2024-01-13T18:02:49.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-mon[71325]: failed to encode map e194 with expected crc 2024-01-13T18:02:49.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-mon[71325]: osdmap e195: 8 total, 8 up, 8 in 2024-01-13T18:02:49.564 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-mon[71325]: failed to encode map e195 with expected crc 2024-01-13T18:02:49.564 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-mon[71325]: failed to encode map e195 with expected crc 2024-01-13T18:02:49.564 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-mon[71325]: failed to encode map e195 with expected crc 2024-01-13T18:02:49.564 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:49.283+0000 7fcf840aa700 -1 mon.b@1(peon).osd e196 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:49.620 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:49.425+0000 7fcb357e7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-13T18:02:49.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[52328]: failed to encode map e194 with expected crc 2024-01-13T18:02:49.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[52328]: failed to encode map e194 with expected crc 2024-01-13T18:02:49.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[52328]: osdmap e195: 8 total, 8 up, 8 in 2024-01-13T18:02:49.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[52328]: failed to encode map e195 with expected crc 2024-01-13T18:02:49.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[52328]: failed to encode map e195 with expected crc 2024-01-13T18:02:49.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[52328]: failed to encode map e195 with expected crc 2024-01-13T18:02:49.621 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:49.282+0000 7fe138ead700 -1 mon.c@2(peon).osd e196 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:49.621 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[116404]: failed to encode map e194 with expected crc 2024-01-13T18:02:49.621 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[116404]: failed to encode map e194 with expected crc 2024-01-13T18:02:49.621 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[116404]: osdmap e195: 8 total, 8 up, 8 in 2024-01-13T18:02:49.621 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[116404]: failed to encode map e195 with expected crc 2024-01-13T18:02:49.621 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[116404]: failed to encode map e195 with expected crc 2024-01-13T18:02:49.621 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-mon[116404]: failed to encode map e195 with expected crc 2024-01-13T18:02:49.866 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:49.561+0000 7fdca273c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:02:49.866 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:49.747+0000 7fdca273c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T18:02:49.866 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:49.864+0000 7fdca273c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T18:02:49.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:49.617+0000 7fcb357e7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-13T18:02:49.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:49.807+0000 7fcb357e7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-13T18:02:49.953 INFO:tasks.rados.rados.0.smithi084.stdout:707: done (1 left) 2024-01-13T18:02:49.953 INFO:tasks.rados.rados.0.smithi084.stdout:708: read oid 12 snap -1 2024-01-13T18:02:49.953 INFO:tasks.rados.rados.0.smithi084.stdout:708: expect deleted 2024-01-13T18:02:49.953 INFO:tasks.rados.rados.0.smithi084.stdout:709: read oid 29 snap -1 2024-01-13T18:02:49.953 INFO:tasks.rados.rados.0.smithi084.stdout:709: expect (ObjNum 99 snap 19 seq_num 99) 2024-01-13T18:02:49.953 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 69 2024-01-13T18:02:49.953 INFO:tasks.rados.rados.0.smithi084.stdout:710: seq_num 228 ranges {0=622592,622592=671744,1294336=131072} 2024-01-13T18:02:49.957 INFO:tasks.rados.rados.0.smithi084.stdout:710: writing smithi084102331-17 from 0 to 622592 tid 1 2024-01-13T18:02:49.965 INFO:tasks.rados.rados.0.smithi084.stdout:710: writing smithi084102331-17 from 622592 to 1294336 tid 2 2024-01-13T18:02:49.966 INFO:tasks.rados.rados.0.smithi084.stdout:710: writing smithi084102331-17 from 1294336 to 1425408 tid 3 2024-01-13T18:02:49.966 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 69 2024-01-13T18:02:49.966 INFO:tasks.rados.rados.0.smithi084.stdout:711: seq_num 229 ranges {1064960=638976,1703936=606208,2310144=196608} 2024-01-13T18:02:49.973 INFO:tasks.rados.rados.0.smithi084.stdout:711: writing smithi084102331-7 from 1064960 to 1703936 tid 1 2024-01-13T18:02:49.983 INFO:tasks.rados.rados.0.smithi084.stdout:711: writing smithi084102331-7 from 1703936 to 2310144 tid 2 2024-01-13T18:02:49.984 INFO:tasks.rados.rados.0.smithi084.stdout:711: writing smithi084102331-7 from 2310144 to 2506752 tid 3 2024-01-13T18:02:49.984 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 69 2024-01-13T18:02:49.984 INFO:tasks.rados.rados.0.smithi084.stdout:712: seq_num 230 ranges {573440=655360,1228800=491520,1720320=311296} 2024-01-13T18:02:49.986 INFO:tasks.rados.rados.0.smithi084.stdout:712: writing smithi084102331-8 from 573440 to 1228800 tid 1 2024-01-13T18:02:49.988 INFO:tasks.rados.rados.0.smithi084.stdout:712: writing smithi084102331-8 from 1228800 to 1720320 tid 2 2024-01-13T18:02:49.990 INFO:tasks.rados.rados.0.smithi084.stdout:712: writing smithi084102331-8 from 1720320 to 2031616 tid 3 2024-01-13T18:02:49.990 INFO:tasks.rados.rados.0.smithi084.stdout:713: rmattr oid 16 current snap is 69 2024-01-13T18:02:49.990 INFO:tasks.rados.rados.0.smithi084.stdout:713: done (6 left) 2024-01-13T18:02:49.990 INFO:tasks.rados.rados.0.smithi084.stdout:714: snap_remove snap 62 2024-01-13T18:02:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:49.943+0000 7fcf840aa700 -1 mon.b@1(peon).osd e197 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:50.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: [13/Jan/2024:18:02:49] ENGINE Bus STARTING 2024-01-13T18:02:50.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: CherryPy Checker: 2024-01-13T18:02:50.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: The Application mounted at '' has an empty config. 2024-01-13T18:02:50.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: 2024-01-13T18:02:50.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: [13/Jan/2024:18:02:49] ENGINE Serving on http://:::9283 2024-01-13T18:02:50.119 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 18:02:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x[128339]: [13/Jan/2024:18:02:49] ENGINE Bus STARTED 2024-01-13T18:02:50.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:49.925+0000 7fcb357e7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-13T18:02:50.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:50] ENGINE Bus STARTING 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.089+0000 7fca97265700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.089+0000 7fca97265700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.089+0000 7fca97265700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.089+0000 7fca97265700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.089+0000 7fca97265700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.090+0000 7fca9425f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.090+0000 7fca9425f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.090+0000 7fca9425f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.090+0000 7fca9425f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.090+0000 7fca9425f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: CherryPy Checker: 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: The Application mounted at '' has an empty config. 2024-01-13T18:02:50.179 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.180 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:50] ENGINE Serving on http://:::9283 2024-01-13T18:02:50.180 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:02:50] ENGINE Bus STARTED 2024-01-13T18:02:50.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:49.943+0000 7fe138ead700 -1 mon.c@2(peon).osd e197 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: osdmap e196: 8 total, 8 up, 8 in 2024-01-13T18:02:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: failed to encode map e196 with expected crc 2024-01-13T18:02:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: failed to encode map e196 with expected crc 2024-01-13T18:02:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: failed to encode map e196 with expected crc 2024-01-13T18:02:50.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: Standby manager daemon x restarted 2024-01-13T18:02:50.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: Standby manager daemon x started 2024-01-13T18:02:50.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:02:50.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:50.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:02:50.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:50.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: Active manager daemon y restarted 2024-01-13T18:02:50.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: Activating manager daemon y 2024-01-13T18:02:50.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: osdmap e197: 8 total, 8 up, 8 in 2024-01-13T18:02:50.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: mgrmap e37: y(active, starting, since 0.00624058s), standbys: x 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:02:50.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: Manager daemon y is now available 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T18:02:50.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-mon[71325]: [13/Jan/2024:18:02:50] ENGINE Bus STARTING 2024-01-13T18:02:50.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:02:50] "GET /metrics HTTP/1.1" 200 33280 "" "Prometheus/2.43.0" 2024-01-13T18:02:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: osdmap e196: 8 total, 8 up, 8 in 2024-01-13T18:02:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: failed to encode map e196 with expected crc 2024-01-13T18:02:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: failed to encode map e196 with expected crc 2024-01-13T18:02:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: failed to encode map e196 with expected crc 2024-01-13T18:02:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: Standby manager daemon x restarted 2024-01-13T18:02:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: Standby manager daemon x started 2024-01-13T18:02:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:02:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: Active manager daemon y restarted 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: Activating manager daemon y 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: osdmap e197: 8 total, 8 up, 8 in 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: mgrmap e37: y(active, starting, since 0.00624058s), standbys: x 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:02:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:02:50.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:02:50.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T18:02:50.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T18:02:50.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:02:50.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:02:50.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:02:50.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:02:50.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:02:50.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:02:50.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: osdmap e196: 8 total, 8 up, 8 in 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: failed to encode map e196 with expected crc 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: failed to encode map e196 with expected crc 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: failed to encode map e196 with expected crc 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: Standby manager daemon x restarted 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: Standby manager daemon x started 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.? 172.21.15.99:0/3565167307' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: Active manager daemon y restarted 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: Activating manager daemon y 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: osdmap e197: 8 total, 8 up, 8 in 2024-01-13T18:02:50.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: mgrmap e37: y(active, starting, since 0.00624058s), standbys: x 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: failed to encode map e197 with expected crc 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:02:50.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:02:50.684 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:02:50.684 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:02:50.684 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:02:50.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:02:50.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T18:02:50.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T18:02:50.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T18:02:50.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: Manager daemon y is now available 2024-01-13T18:02:50.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:50.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:50.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[116404]: [13/Jan/2024:18:02:50] ENGINE Bus STARTING 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: Manager daemon y is now available 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:02:50.685 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-01-13T18:02:50.686 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-01-13T18:02:50.686 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-mon[52328]: [13/Jan/2024:18:02:50] ENGINE Bus STARTING 2024-01-13T18:02:50.962 INFO:tasks.rados.rados.0.smithi084.stdout:714: done (6 left) 2024-01-13T18:02:50.962 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 69 2024-01-13T18:02:50.963 INFO:tasks.rados.rados.0.smithi084.stdout:710: finishing write tid 1 to smithi084102331-17 2024-01-13T18:02:50.963 INFO:tasks.rados.rados.0.smithi084.stdout:710: finishing write tid 2 to smithi084102331-17 2024-01-13T18:02:50.963 INFO:tasks.rados.rados.0.smithi084.stdout:710: finishing write tid 3 to smithi084102331-17 2024-01-13T18:02:50.963 INFO:tasks.rados.rados.0.smithi084.stdout:710: finishing write tid 4 to smithi084102331-17 2024-01-13T18:02:50.963 INFO:tasks.rados.rados.0.smithi084.stdout:709: expect (ObjNum 99 snap 19 seq_num 99) 2024-01-13T18:02:50.975 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:02:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:711: finishing write tid 1 to smithi084102331-7 2024-01-13T18:02:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:711: finishing write tid 2 to smithi084102331-7 2024-01-13T18:02:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:711: finishing write tid 3 to smithi084102331-7 2024-01-13T18:02:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:711: finishing write tid 4 to smithi084102331-7 2024-01-13T18:02:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:715: seq_num 231 ranges {0=671744,671744=778240,1449984=24576} 2024-01-13T18:02:51.035 INFO:tasks.rados.rados.0.smithi084.stdout:715: writing smithi084102331-9 from 0 to 671744 tid 1 2024-01-13T18:02:51.040 INFO:tasks.rados.rados.0.smithi084.stdout:715: writing smithi084102331-9 from 671744 to 1449984 tid 2 2024-01-13T18:02:51.041 INFO:tasks.rados.rados.0.smithi084.stdout:715: writing smithi084102331-9 from 1449984 to 1474560 tid 3 2024-01-13T18:02:51.041 INFO:tasks.rados.rados.0.smithi084.stdout:706: done (6 left) 2024-01-13T18:02:51.041 INFO:tasks.rados.rados.0.smithi084.stdout:708: done (5 left) 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:709: done (4 left) 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:716: snap_create 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:710: finishing write tid 5 to smithi084102331-17 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 184 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:710: left oid 17 (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:711: finishing write tid 5 to smithi084102331-7 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 149 (ObjNum 229 snap 69 seq_num 229) dirty exists 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:711: left oid 7 (ObjNum 229 snap 69 seq_num 229) 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:712: finishing write tid 1 to smithi084102331-8 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:712: finishing write tid 2 to smithi084102331-8 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:712: finishing write tid 3 to smithi084102331-8 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:712: finishing write tid 4 to smithi084102331-8 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:712: finishing write tid 5 to smithi084102331-8 2024-01-13T18:02:51.042 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 264 (ObjNum 230 snap 69 seq_num 230) dirty exists 2024-01-13T18:02:51.043 INFO:tasks.rados.rados.0.smithi084.stdout:712: left oid 8 (ObjNum 230 snap 69 seq_num 230) 2024-01-13T18:02:51.050 INFO:tasks.rados.rados.0.smithi084.stdout:715: finishing write tid 1 to smithi084102331-9 2024-01-13T18:02:51.050 INFO:tasks.rados.rados.0.smithi084.stdout:715: finishing write tid 2 to smithi084102331-9 2024-01-13T18:02:51.050 INFO:tasks.rados.rados.0.smithi084.stdout:715: finishing write tid 3 to smithi084102331-9 2024-01-13T18:02:51.051 INFO:tasks.rados.rados.0.smithi084.stdout:715: finishing write tid 4 to smithi084102331-9 2024-01-13T18:02:51.052 INFO:tasks.rados.rados.0.smithi084.stdout:715: finishing write tid 5 to smithi084102331-9 2024-01-13T18:02:51.052 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 220 (ObjNum 231 snap 69 seq_num 231) dirty exists 2024-01-13T18:02:51.053 INFO:tasks.rados.rados.0.smithi084.stdout:715: left oid 9 (ObjNum 231 snap 69 seq_num 231) 2024-01-13T18:02:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:50 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:50.954+0000 7fcf840aa700 -1 mon.b@1(peon).osd e198 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:51.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:02:50.948+0000 7fcaf82a4700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-01-13T18:02:51.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:50.953+0000 7fe138ead700 -1 mon.c@2(peon).osd e198 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:51.327 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:02:51.327 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (58s) 29s ago 3m 15.9M - 0.25.0 c8568f914cd2 a5cbc3e01ffb 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (43s) 15s ago 3m 78.2M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (4m) 29s ago 4m 14.7M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (4m) 15s ago 4m 19.1M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (18s) 15s ago 6m 47.6M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (39s) 29s ago 8m 472M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (8m) 29s ago 8m 101M 2048M 17.2.7-268-g6441305d c3a232f785d8 0eb2ed5f8766 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (7m) 15s ago 7m 77.3M 2048M 17.2.7-268-g6441305d c3a232f785d8 bf79d7793fc1 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (6m) 29s ago 6m 69.2M 2048M 17.2.7-268-g6441305d c3a232f785d8 510574f8be07 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (56s) 29s ago 3m 8610k - 1.5.0 0da6a335fe13 b72e6d50f165 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (42s) 15s ago 3m 8288k - 1.5.0 0da6a335fe13 e9f879b5e55b 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (6m) 29s ago 6m 214M 2488M 17.2.7-268-g6441305d c3a232f785d8 809287996fef 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (6m) 29s ago 6m 188M 2488M 17.2.7-268-g6441305d c3a232f785d8 fad77ee705d8 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (5m) 29s ago 5m 179M 2488M 17.2.7-268-g6441305d c3a232f785d8 14025770cf00 2024-01-13T18:02:51.328 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (5m) 29s ago 5m 171M 2488M 17.2.7-268-g6441305d c3a232f785d8 068cf98fa99c 2024-01-13T18:02:51.329 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (5m) 15s ago 5m 222M 2488M 17.2.7-268-g6441305d c3a232f785d8 30e0722550a0 2024-01-13T18:02:51.329 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (5m) 15s ago 5m 201M 2488M 17.2.7-268-g6441305d c3a232f785d8 51be805dde78 2024-01-13T18:02:51.329 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (4m) 15s ago 4m 155M 2488M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:02:51.329 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (4m) 15s ago 4m 123M 2488M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:02:51.329 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (22s) 15s ago 3m 37.7M - 2.43.0 a07b618ecd1d cb4c11bf6eec 2024-01-13T18:02:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: failed to encode map e197 with expected crc 2024-01-13T18:02:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: failed to encode map e197 with expected crc 2024-01-13T18:02:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: [13/Jan/2024:18:02:50] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T18:02:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: [13/Jan/2024:18:02:50] ENGINE Serving on http://172.21.15.84:8765 2024-01-13T18:02:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: [13/Jan/2024:18:02:50] ENGINE Bus STARTED 2024-01-13T18:02:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: mgrmap e38: y(active, since 1.00846s), standbys: x 2024-01-13T18:02:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: osdmap e198: 8 total, 8 up, 8 in 2024-01-13T18:02:51.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: from='client.25127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:51.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: pgmap v4: 121 pgs: 121 active+clean; 159 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 91 GiB/s rd, 40 GiB/s wr, 817.86k op/s; 584 MiB/s, 2.42k objects/s recovering 2024-01-13T18:02:51.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-mon[71325]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: failed to encode map e197 with expected crc 2024-01-13T18:02:51.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: failed to encode map e197 with expected crc 2024-01-13T18:02:51.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: [13/Jan/2024:18:02:50] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T18:02:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: [13/Jan/2024:18:02:50] ENGINE Serving on http://172.21.15.84:8765 2024-01-13T18:02:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: [13/Jan/2024:18:02:50] ENGINE Bus STARTED 2024-01-13T18:02:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: mgrmap e38: y(active, since 1.00846s), standbys: x 2024-01-13T18:02:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: osdmap e198: 8 total, 8 up, 8 in 2024-01-13T18:02:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: from='client.25127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: pgmap v4: 121 pgs: 121 active+clean; 159 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 91 GiB/s rd, 40 GiB/s wr, 817.86k op/s; 584 MiB/s, 2.42k objects/s recovering 2024-01-13T18:02:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[52328]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: failed to encode map e197 with expected crc 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: failed to encode map e197 with expected crc 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: [13/Jan/2024:18:02:50] ENGINE Serving on https://172.21.15.84:7150 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: [13/Jan/2024:18:02:50] ENGINE Serving on http://172.21.15.84:8765 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: [13/Jan/2024:18:02:50] ENGINE Bus STARTED 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: mgrmap e38: y(active, since 1.00846s), standbys: x 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: osdmap e198: 8 total, 8 up, 8 in 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: from='client.25127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: pgmap v4: 121 pgs: 121 active+clean; 159 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 91 GiB/s rd, 40 GiB/s wr, 817.86k op/s; 584 MiB/s, 2.42k objects/s recovering 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-mon[116404]: failed to encode map e198 with expected crc 2024-01-13T18:02:51.748 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:02:51.748 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:02:51.748 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2, 2024-01-13T18:02:51.748 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 1 2024-01-13T18:02:51.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:02:51.748 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:02:51.748 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 8 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 12, 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:02:51.749 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:02:51.965 INFO:tasks.rados.rados.0.smithi084.stdout:710: done (4 left) 2024-01-13T18:02:51.965 INFO:tasks.rados.rados.0.smithi084.stdout:711: done (3 left) 2024-01-13T18:02:51.965 INFO:tasks.rados.rados.0.smithi084.stdout:712: done (2 left) 2024-01-13T18:02:51.965 INFO:tasks.rados.rados.0.smithi084.stdout:715: done (1 left) 2024-01-13T18:02:51.965 INFO:tasks.rados.rados.0.smithi084.stdout:716: done (0 left) 2024-01-13T18:02:51.965 INFO:tasks.rados.rados.0.smithi084.stdout:717: delete oid 46 current snap is 70 2024-01-13T18:02:51.968 INFO:tasks.rados.rados.0.smithi084.stdout:717: done (0 left) 2024-01-13T18:02:51.968 INFO:tasks.rados.rados.0.smithi084.stdout:718: delete oid 44 current snap is 70 2024-01-13T18:02:51.970 INFO:tasks.rados.rados.0.smithi084.stdout:718: done (0 left) 2024-01-13T18:02:51.970 INFO:tasks.rados.rados.0.smithi084.stdout:719: read oid 46 snap -1 2024-01-13T18:02:51.970 INFO:tasks.rados.rados.0.smithi084.stdout:719: expect deleted 2024-01-13T18:02:51.971 INFO:tasks.rados.rados.0.smithi084.stdout:720: rollback oid 47 current snap is 70 2024-01-13T18:02:51.971 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 55 2024-01-13T18:02:51.971 INFO:tasks.rados.rados.0.smithi084.stdout:721: read oid 43 snap -1 2024-01-13T18:02:51.971 INFO:tasks.rados.rados.0.smithi084.stdout:721: expect (ObjNum 201 snap 55 seq_num 201) 2024-01-13T18:02:51.971 INFO:tasks.rados.rados.0.smithi084.stdout:722: copy_from oid 41 from oid 49 current snap is 70 2024-01-13T18:02:51.971 INFO:tasks.rados.rados.0.smithi084.stdout:723: snap_remove snap 65 2024-01-13T18:02:52.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:51 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:51.956+0000 7fe138ead700 -1 mon.c@2(peon).osd e199 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:52.298 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:51 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:51.957+0000 7fcf840aa700 -1 mon.b@1(peon).osd e199 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:52.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:52 smithi099 ceph-mon[71325]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:52.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:52 smithi099 ceph-mon[71325]: from='client.? 172.21.15.84:0/336467457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:52.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:52 smithi099 ceph-mon[71325]: osdmap e199: 8 total, 8 up, 8 in 2024-01-13T18:02:52.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:52 smithi099 ceph-mon[71325]: failed to encode map e199 with expected crc 2024-01-13T18:02:52.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:52 smithi099 ceph-mon[71325]: pgmap v6: 121 pgs: 121 active+clean; 159 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 268 MiB/s rd, 118 MiB/s wr, 2.35k op/s; 1.7 MiB/s, 6 objects/s recovering 2024-01-13T18:02:52.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:52 smithi099 ceph-mon[71325]: failed to encode map e199 with expected crc 2024-01-13T18:02:52.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:52 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:52.553+0000 7fcf840aa700 -1 mon.b@1(peon).osd e200 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:52.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[116404]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:52.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/336467457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:52.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[116404]: osdmap e199: 8 total, 8 up, 8 in 2024-01-13T18:02:52.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[116404]: failed to encode map e199 with expected crc 2024-01-13T18:02:52.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[116404]: pgmap v6: 121 pgs: 121 active+clean; 159 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 268 MiB/s rd, 118 MiB/s wr, 2.35k op/s; 1.7 MiB/s, 6 objects/s recovering 2024-01-13T18:02:52.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[116404]: failed to encode map e199 with expected crc 2024-01-13T18:02:52.556 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[52328]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:02:52.556 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[52328]: from='client.? 172.21.15.84:0/336467457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:52.556 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[52328]: osdmap e199: 8 total, 8 up, 8 in 2024-01-13T18:02:52.556 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[52328]: failed to encode map e199 with expected crc 2024-01-13T18:02:52.556 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[52328]: pgmap v6: 121 pgs: 121 active+clean; 159 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 268 MiB/s rd, 118 MiB/s wr, 2.35k op/s; 1.7 MiB/s, 6 objects/s recovering 2024-01-13T18:02:52.557 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-mon[52328]: failed to encode map e199 with expected crc 2024-01-13T18:02:52.557 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:52 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:52.552+0000 7fe138ead700 -1 mon.c@2(peon).osd e200 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:52.561 INFO:tasks.rados.rados.0.smithi084.stdout:723: done (4 left) 2024-01-13T18:02:52.561 INFO:tasks.rados.rados.0.smithi084.stdout:724: rmattr oid 48 current snap is 70 2024-01-13T18:02:52.561 INFO:tasks.rados.rados.0.smithi084.stdout:722: finishing copy_from to smithi084102331-41 2024-01-13T18:02:52.561 INFO:tasks.rados.rados.0.smithi084.stdout:722: got expected ENOENT (src dne) 2024-01-13T18:02:52.561 INFO:tasks.rados.rados.0.smithi084.stdout:722: finishing copy_from racing read to smithi084102331-41 2024-01-13T18:02:52.561 INFO:tasks.rados.rados.0.smithi084.stdout:720: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:02:52.561 INFO:tasks.rados.rados.0.smithi084.stdout:720: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:02:52.561 INFO:tasks.rados.rados.0.smithi084.stdout:720: finishing rollback tid 2 to smithi084102331-47 2024-01-13T18:02:52.561 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 271 (ObjNum 127 snap 32 seq_num 127) dirty exists 2024-01-13T18:02:52.561 INFO:tasks.rados.rados.0.smithi084.stdout:721: expect (ObjNum 201 snap 55 seq_num 201) 2024-01-13T18:02:52.823 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 256 (ObjNum 200 snap 55 seq_num 200) dirty exists 2024-01-13T18:02:52.823 INFO:tasks.rados.rados.0.smithi084.stdout:719: done (4 left) 2024-01-13T18:02:52.824 INFO:tasks.rados.rados.0.smithi084.stdout:720: done (3 left) 2024-01-13T18:02:52.824 INFO:tasks.rados.rados.0.smithi084.stdout:721: done (2 left) 2024-01-13T18:02:52.824 INFO:tasks.rados.rados.0.smithi084.stdout:722: done (1 left) 2024-01-13T18:02:52.824 INFO:tasks.rados.rados.0.smithi084.stdout:724: done (0 left) 2024-01-13T18:02:52.824 INFO:tasks.rados.rados.0.smithi084.stdout:725: read oid 24 snap -1 2024-01-13T18:02:52.824 INFO:tasks.rados.rados.0.smithi084.stdout:725: expect (ObjNum 133 snap 35 seq_num 133) 2024-01-13T18:02:52.824 INFO:tasks.rados.rados.0.smithi084.stdout:726: snap_create 2024-01-13T18:02:52.834 INFO:tasks.rados.rados.0.smithi084.stdout:725: expect (ObjNum 133 snap 35 seq_num 133) 2024-01-13T18:02:53.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-mon[71325]: failed to encode map e199 with expected crc 2024-01-13T18:02:53.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-mon[71325]: mgrmap e39: y(active, since 2s), standbys: x 2024-01-13T18:02:53.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-mon[71325]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-mon[71325]: osdmap e200: 8 total, 8 up, 8 in 2024-01-13T18:02:53.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-mon[71325]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-mon[71325]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-mon[71325]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[116404]: failed to encode map e199 with expected crc 2024-01-13T18:02:53.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[116404]: mgrmap e39: y(active, since 2s), standbys: x 2024-01-13T18:02:53.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[116404]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[116404]: osdmap e200: 8 total, 8 up, 8 in 2024-01-13T18:02:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[116404]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[116404]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[116404]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.568 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[52328]: failed to encode map e199 with expected crc 2024-01-13T18:02:53.568 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[52328]: mgrmap e39: y(active, since 2s), standbys: x 2024-01-13T18:02:53.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[52328]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[52328]: osdmap e200: 8 total, 8 up, 8 in 2024-01-13T18:02:53.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[52328]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[52328]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[52328]: failed to encode map e200 with expected crc 2024-01-13T18:02:53.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.570 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:53.570 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:53 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:53.563+0000 7fe138ead700 -1 mon.c@2(peon).osd e201 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:53.576 INFO:tasks.rados.rados.0.smithi084.stdout:725: done (1 left) 2024-01-13T18:02:53.576 INFO:tasks.rados.rados.0.smithi084.stdout:726: done (0 left) 2024-01-13T18:02:53.576 INFO:tasks.rados.rados.0.smithi084.stdout:727: delete oid 15 current snap is 71 2024-01-13T18:02:53.583 INFO:tasks.rados.rados.0.smithi084.stdout:727: done (0 left) 2024-01-13T18:02:53.583 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 71 2024-01-13T18:02:53.583 INFO:tasks.rados.rados.0.smithi084.stdout:728: seq_num 235 ranges {3260416=745472,4005888=712704,4718592=90112} 2024-01-13T18:02:53.605 INFO:tasks.rados.rados.0.smithi084.stdout:728: writing smithi084102331-6 from 3260416 to 4005888 tid 1 2024-01-13T18:02:53.609 INFO:tasks.rados.rados.0.smithi084.stdout:728: writing smithi084102331-6 from 4005888 to 4718592 tid 2 2024-01-13T18:02:53.610 INFO:tasks.rados.rados.0.smithi084.stdout:728: writing smithi084102331-6 from 4718592 to 4808704 tid 3 2024-01-13T18:02:53.610 INFO:tasks.rados.rados.0.smithi084.stdout:729: snap_remove snap 64 2024-01-13T18:02:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:53 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:53.564+0000 7fcf840aa700 -1 mon.b@1(peon).osd e201 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:54.586 INFO:tasks.rados.rados.0.smithi084.stdout:729: done (1 left) 2024-01-13T18:02:54.586 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 71 2024-01-13T18:02:54.586 INFO:tasks.rados.rados.0.smithi084.stdout:728: finishing write tid 1 to smithi084102331-6 2024-01-13T18:02:54.586 INFO:tasks.rados.rados.0.smithi084.stdout:728: finishing write tid 2 to smithi084102331-6 2024-01-13T18:02:54.586 INFO:tasks.rados.rados.0.smithi084.stdout:728: finishing write tid 3 to smithi084102331-6 2024-01-13T18:02:54.587 INFO:tasks.rados.rados.0.smithi084.stdout:728: finishing write tid 4 to smithi084102331-6 2024-01-13T18:02:54.587 INFO:tasks.rados.rados.0.smithi084.stdout:730: seq_num 236 ranges {0=761856,761856=647168,1409024=155648} 2024-01-13T18:02:54.591 INFO:tasks.rados.rados.0.smithi084.stdout:730: writing smithi084102331-11 from 0 to 761856 tid 1 2024-01-13T18:02:54.595 INFO:tasks.rados.rados.0.smithi084.stdout:730: writing smithi084102331-11 from 761856 to 1409024 tid 2 2024-01-13T18:02:54.596 INFO:tasks.rados.rados.0.smithi084.stdout:730: writing smithi084102331-11 from 1409024 to 1564672 tid 3 2024-01-13T18:02:54.596 INFO:tasks.rados.rados.0.smithi084.stdout:731: copy_from oid 1 from oid 28 current snap is 71 2024-01-13T18:02:54.596 INFO:tasks.rados.rados.0.smithi084.stdout:732: snap_remove snap 55 2024-01-13T18:02:54.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[116404]: osdmap e201: 8 total, 8 up, 8 in 2024-01-13T18:02:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[116404]: failed to encode map e201 with expected crc 2024-01-13T18:02:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[116404]: failed to encode map e201 with expected crc 2024-01-13T18:02:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[116404]: failed to encode map e201 with expected crc 2024-01-13T18:02:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[116404]: pgmap v9: 121 pgs: 121 active+clean; 159 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 90 MiB/s rd, 40 MiB/s wr, 786 op/s; 575 KiB/s, 2 objects/s recovering 2024-01-13T18:02:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[52328]: osdmap e201: 8 total, 8 up, 8 in 2024-01-13T18:02:54.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[52328]: failed to encode map e201 with expected crc 2024-01-13T18:02:54.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[52328]: failed to encode map e201 with expected crc 2024-01-13T18:02:54.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[52328]: failed to encode map e201 with expected crc 2024-01-13T18:02:54.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[52328]: pgmap v9: 121 pgs: 121 active+clean; 159 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 90 MiB/s rd, 40 MiB/s wr, 786 op/s; 575 KiB/s, 2 objects/s recovering 2024-01-13T18:02:54.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:54.579+0000 7fe138ead700 -1 mon.c@2(peon).osd e202 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:54.731 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:54 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.731 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:54 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.732 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:54 smithi099 ceph-mon[71325]: osdmap e201: 8 total, 8 up, 8 in 2024-01-13T18:02:54.732 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:54 smithi099 ceph-mon[71325]: failed to encode map e201 with expected crc 2024-01-13T18:02:54.732 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:54 smithi099 ceph-mon[71325]: failed to encode map e201 with expected crc 2024-01-13T18:02:54.732 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:54 smithi099 ceph-mon[71325]: failed to encode map e201 with expected crc 2024-01-13T18:02:54.732 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:54 smithi099 ceph-mon[71325]: pgmap v9: 121 pgs: 121 active+clean; 159 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 90 MiB/s rd, 40 MiB/s wr, 786 op/s; 575 KiB/s, 2 objects/s recovering 2024-01-13T18:02:54.732 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:54 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.732 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:54 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:54.732 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:54.579+0000 7fcf840aa700 -1 mon.b@1(peon).osd e202 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:732: done (3 left) 2024-01-13T18:02:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:733: copy_from oid 9 from oid 4 current snap is 71 2024-01-13T18:02:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:728: finishing write tid 5 to smithi084102331-6 2024-01-13T18:02:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 224 (ObjNum 235 snap 71 seq_num 235) dirty exists 2024-01-13T18:02:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:728: left oid 6 (ObjNum 235 snap 71 seq_num 235) 2024-01-13T18:02:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:730: finishing write tid 1 to smithi084102331-11 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:730: finishing write tid 2 to smithi084102331-11 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:730: finishing write tid 3 to smithi084102331-11 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:730: finishing write tid 4 to smithi084102331-11 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:730: finishing write tid 5 to smithi084102331-11 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 185 (ObjNum 236 snap 71 seq_num 236) dirty exists 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:730: left oid 11 (ObjNum 236 snap 71 seq_num 236) 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:731: finishing copy_from to smithi084102331-1 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 136 (ObjNum 181 snap 52 seq_num 181) dirty exists 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:731: finishing copy_from racing read to smithi084102331-1 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:728: done (3 left) 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:730: done (2 left) 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:731: done (1 left) 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:734: copy_from oid 42 from oid 33 current snap is 71 2024-01-13T18:02:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:735: setattr oid 27 current snap is 71 2024-01-13T18:02:55.594 INFO:tasks.rados.rados.0.smithi084.stdout:736: setattr oid 30 current snap is 71 2024-01-13T18:02:55.594 INFO:tasks.rados.rados.0.smithi084.stdout:737: snap_create 2024-01-13T18:02:55.606 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 191 (ObjNum 33 snap 0 seq_num 2) dirty exists 2024-01-13T18:02:55.609 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 300 (ObjNum 179 snap 51 seq_num 179) dirty exists 2024-01-13T18:02:55.615 INFO:tasks.rados.rados.0.smithi084.stdout:733: finishing copy_from to smithi084102331-9 2024-01-13T18:02:55.615 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 155 (ObjNum 212 snap 60 seq_num 212) dirty exists 2024-01-13T18:02:55.616 INFO:tasks.rados.rados.0.smithi084.stdout:733: finishing copy_from racing read to smithi084102331-9 2024-01-13T18:02:55.618 INFO:tasks.rados.rados.0.smithi084.stdout:734: finishing copy_from to smithi084102331-42 2024-01-13T18:02:55.619 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 255 (ObjNum 192 snap 54 seq_num 192) dirty exists 2024-01-13T18:02:55.619 INFO:tasks.rados.rados.0.smithi084.stdout:734: finishing copy_from racing read to smithi084102331-42 2024-01-13T18:02:55.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:55 smithi099 ceph-mon[71325]: mgrmap e40: y(active, since 4s), standbys: x 2024-01-13T18:02:55.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:55 smithi099 ceph-mon[71325]: osdmap e202: 8 total, 8 up, 8 in 2024-01-13T18:02:55.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:55 smithi099 ceph-mon[71325]: failed to encode map e202 with expected crc 2024-01-13T18:02:55.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:55 smithi099 ceph-mon[71325]: failed to encode map e202 with expected crc 2024-01-13T18:02:55.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:55 smithi099 ceph-mon[71325]: failed to encode map e202 with expected crc 2024-01-13T18:02:55.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:55 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:55.582+0000 7fcf840aa700 -1 mon.b@1(peon).osd e203 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:55.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:55 smithi084 ceph-mon[116404]: mgrmap e40: y(active, since 4s), standbys: x 2024-01-13T18:02:55.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:55 smithi084 ceph-mon[116404]: osdmap e202: 8 total, 8 up, 8 in 2024-01-13T18:02:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:55 smithi084 ceph-mon[116404]: failed to encode map e202 with expected crc 2024-01-13T18:02:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:55 smithi084 ceph-mon[116404]: failed to encode map e202 with expected crc 2024-01-13T18:02:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:55 smithi084 ceph-mon[116404]: failed to encode map e202 with expected crc 2024-01-13T18:02:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:55 smithi084 ceph-mon[52328]: mgrmap e40: y(active, since 4s), standbys: x 2024-01-13T18:02:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:55 smithi084 ceph-mon[52328]: osdmap e202: 8 total, 8 up, 8 in 2024-01-13T18:02:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:55 smithi084 ceph-mon[52328]: failed to encode map e202 with expected crc 2024-01-13T18:02:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:55 smithi084 ceph-mon[52328]: failed to encode map e202 with expected crc 2024-01-13T18:02:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:55 smithi084 ceph-mon[52328]: failed to encode map e202 with expected crc 2024-01-13T18:02:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:55.585+0000 7fe138ead700 -1 mon.c@2(peon).osd e203 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:56.602 INFO:tasks.rados.rados.0.smithi084.stdout:733: done (4 left) 2024-01-13T18:02:56.602 INFO:tasks.rados.rados.0.smithi084.stdout:734: done (3 left) 2024-01-13T18:02:56.602 INFO:tasks.rados.rados.0.smithi084.stdout:735: done (2 left) 2024-01-13T18:02:56.602 INFO:tasks.rados.rados.0.smithi084.stdout:736: done (1 left) 2024-01-13T18:02:56.602 INFO:tasks.rados.rados.0.smithi084.stdout:737: done (0 left) 2024-01-13T18:02:56.602 INFO:tasks.rados.rados.0.smithi084.stdout:738: rollback oid 27 current snap is 72 2024-01-13T18:02:56.603 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 53 2024-01-13T18:02:56.603 INFO:tasks.rados.rados.0.smithi084.stdout:739: snap_remove snap 67 2024-01-13T18:02:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:56 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:56.592+0000 7fcf840aa700 -1 mon.b@1(peon).osd e204 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:56 smithi099 ceph-mon[71325]: failed to encode map e203 with expected crc 2024-01-13T18:02:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:56 smithi099 ceph-mon[71325]: failed to encode map e203 with expected crc 2024-01-13T18:02:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:56 smithi099 ceph-mon[71325]: osdmap e203: 8 total, 8 up, 8 in 2024-01-13T18:02:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:56 smithi099 ceph-mon[71325]: failed to encode map e203 with expected crc 2024-01-13T18:02:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:56 smithi099 ceph-mon[71325]: pgmap v12: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 50 op/s 2024-01-13T18:02:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:56 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:56 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:56 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:56 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:56.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[116404]: failed to encode map e203 with expected crc 2024-01-13T18:02:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[116404]: failed to encode map e203 with expected crc 2024-01-13T18:02:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[116404]: osdmap e203: 8 total, 8 up, 8 in 2024-01-13T18:02:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[116404]: failed to encode map e203 with expected crc 2024-01-13T18:02:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[116404]: pgmap v12: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 50 op/s 2024-01-13T18:02:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:56.594+0000 7fe138ead700 -1 mon.c@2(peon).osd e204 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[52328]: failed to encode map e203 with expected crc 2024-01-13T18:02:56.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[52328]: failed to encode map e203 with expected crc 2024-01-13T18:02:56.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[52328]: osdmap e203: 8 total, 8 up, 8 in 2024-01-13T18:02:56.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[52328]: failed to encode map e203 with expected crc 2024-01-13T18:02:56.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[52328]: pgmap v12: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 50 op/s 2024-01-13T18:02:56.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:56.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:56.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:56.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:56 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:02:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:739: done (1 left) 2024-01-13T18:02:57.562 INFO:tasks.rados.rados.0.smithi084.stdout:740: copy_from oid 11 from oid 41 current snap is 72 2024-01-13T18:02:57.562 INFO:tasks.rados.rados.0.smithi084.stdout:738: finishing rollback tid 0 to smithi084102331-27 2024-01-13T18:02:57.562 INFO:tasks.rados.rados.0.smithi084.stdout:738: finishing rollback tid 1 to smithi084102331-27 2024-01-13T18:02:57.562 INFO:tasks.rados.rados.0.smithi084.stdout:738: finishing rollback tid 2 to smithi084102331-27 2024-01-13T18:02:57.562 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 197 (ObjNum 165 snap 46 seq_num 165) dirty exists 2024-01-13T18:02:57.562 INFO:tasks.rados.rados.0.smithi084.stdout:738: done (1 left) 2024-01-13T18:02:57.562 INFO:tasks.rados.rados.0.smithi084.stdout:741: copy_from oid 46 from oid 17 current snap is 72 2024-01-13T18:02:57.562 INFO:tasks.rados.rados.0.smithi084.stdout:742: delete oid 29 current snap is 72 2024-01-13T18:02:57.571 INFO:tasks.rados.rados.0.smithi084.stdout:740: finishing copy_from to smithi084102331-11 2024-01-13T18:02:57.571 INFO:tasks.rados.rados.0.smithi084.stdout:740: got expected ENOENT (src dne) 2024-01-13T18:02:57.571 INFO:tasks.rados.rados.0.smithi084.stdout:740: finishing copy_from racing read to smithi084102331-11 2024-01-13T18:02:57.580 INFO:tasks.rados.rados.0.smithi084.stdout:740: done (2 left) 2024-01-13T18:02:57.580 INFO:tasks.rados.rados.0.smithi084.stdout:742: done (1 left) 2024-01-13T18:02:57.580 INFO:tasks.rados.rados.0.smithi084.stdout:743: snap_remove snap 58 2024-01-13T18:02:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:57.554+0000 7fcf840aa700 -1 mon.b@1(peon).osd e205 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T18:02:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T18:02:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: failed to encode map e204 with expected crc 2024-01-13T18:02:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: failed to encode map e204 with expected crc 2024-01-13T18:02:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: osdmap e204: 8 total, 8 up, 8 in 2024-01-13T18:02:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: failed to encode map e204 with expected crc 2024-01-13T18:02:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:57.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:57.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:57.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:57 smithi099 ceph-mon[71325]: osdmap e205: 8 total, 8 up, 8 in 2024-01-13T18:02:57.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T18:02:57.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T18:02:57.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: failed to encode map e204 with expected crc 2024-01-13T18:02:57.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: failed to encode map e204 with expected crc 2024-01-13T18:02:57.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: osdmap e204: 8 total, 8 up, 8 in 2024-01-13T18:02:57.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: failed to encode map e204 with expected crc 2024-01-13T18:02:57.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:57.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:57.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:57.924 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[116404]: osdmap e205: 8 total, 8 up, 8 in 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:57.557+0000 7fe138ead700 -1 mon.c@2(peon).osd e205 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: Updating smithi084:/etc/ceph/ceph.conf 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: failed to encode map e204 with expected crc 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: failed to encode map e204 with expected crc 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: osdmap e204: 8 total, 8 up, 8 in 2024-01-13T18:02:57.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: failed to encode map e204 with expected crc 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.conf 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: Updating smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: Updating smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/config/ceph.client.admin.keyring 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:57 smithi084 ceph-mon[52328]: osdmap e205: 8 total, 8 up, 8 in 2024-01-13T18:02:58.576 INFO:tasks.rados.rados.0.smithi084.stdout:743: done (1 left) 2024-01-13T18:02:58.576 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 72 2024-01-13T18:02:58.576 INFO:tasks.rados.rados.0.smithi084.stdout:741: finishing copy_from to smithi084102331-46 2024-01-13T18:02:58.576 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 184 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:02:58.576 INFO:tasks.rados.rados.0.smithi084.stdout:744: seq_num 238 ranges {0=794624,794624=417792,1212416=385024} 2024-01-13T18:02:58.580 INFO:tasks.rados.rados.0.smithi084.stdout:744: writing smithi084102331-2 from 0 to 794624 tid 1 2024-01-13T18:02:58.586 INFO:tasks.rados.rados.0.smithi084.stdout:744: writing smithi084102331-2 from 794624 to 1212416 tid 2 2024-01-13T18:02:58.586 INFO:tasks.rados.rados.0.smithi084.stdout:744: writing smithi084102331-2 from 1212416 to 1597440 tid 3 2024-01-13T18:02:58.586 INFO:tasks.rados.rados.0.smithi084.stdout:745: delete oid 5 current snap is 72 2024-01-13T18:02:58.586 INFO:tasks.rados.rados.0.smithi084.stdout:741: finishing copy_from racing read to smithi084102331-46 2024-01-13T18:02:58.596 INFO:tasks.rados.rados.0.smithi084.stdout:741: done (2 left) 2024-01-13T18:02:58.596 INFO:tasks.rados.rados.0.smithi084.stdout:745: done (1 left) 2024-01-13T18:02:58.596 INFO:tasks.rados.rados.0.smithi084.stdout:746: snap_remove snap 68 2024-01-13T18:02:58.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:02:58.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:02:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:58.567+0000 7fcf840aa700 -1 mon.b@1(peon).osd e206 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: Upgrade: It appears safe to stop mon.c 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: pgmap v15: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 50 op/s 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: osdmap e206: 8 total, 8 up, 8 in 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:02:58.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:58 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:58.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:58.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:58.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-13T18:02:58.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-01-13T18:02:58.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: Upgrade: It appears safe to stop mon.c 2024-01-13T18:02:58.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: pgmap v15: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 50 op/s 2024-01-13T18:02:58.900 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: osdmap e206: 8 total, 8 up, 8 in 2024-01-13T18:02:58.900 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:58.900 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:02:58.900 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:02:58.900 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:58.900 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:58.567+0000 7fe138ead700 -1 mon.c@2(peon).osd e206 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:58.900 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.900 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.900 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.900 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.900 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: failed to encode map e205 with expected crc 2024-01-13T18:02:58.901 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:02:58.901 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:02:58.901 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-13T18:02:58.901 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-01-13T18:02:58.901 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: Upgrade: It appears safe to stop mon.c 2024-01-13T18:02:58.901 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: pgmap v15: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 50 op/s 2024-01-13T18:02:58.901 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: osdmap e206: 8 total, 8 up, 8 in 2024-01-13T18:02:58.901 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:02:58.901 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:02:58.901 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:02:58.901 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:58 smithi084 ceph-mon[52328]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:02:59.609 INFO:tasks.rados.rados.0.smithi084.stdout:746: done (1 left) 2024-01-13T18:02:59.610 INFO:tasks.rados.rados.0.smithi084.stdout:747: read oid 9 snap -1 2024-01-13T18:02:59.610 INFO:tasks.rados.rados.0.smithi084.stdout:747: expect (ObjNum 212 snap 60 seq_num 212) 2024-01-13T18:02:59.610 INFO:tasks.rados.rados.0.smithi084.stdout:748: snap_remove snap 43 2024-01-13T18:02:59.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[116404]: Upgrade: Updating mon.c 2024-01-13T18:02:59.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[116404]: failed to encode map e206 with expected crc 2024-01-13T18:02:59.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[116404]: failed to encode map e206 with expected crc 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[116404]: failed to encode map e206 with expected crc 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[116404]: Deploying daemon mon.c on smithi084 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[116404]: failed to encode map e206 with expected crc 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:59 smithi084 systemd[1]: Stopping Ceph mon.c for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:59.601+0000 7fe138ead700 -1 mon.c@2(peon).osd e207 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[52328]: Upgrade: Updating mon.c 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[52328]: failed to encode map e206 with expected crc 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[52328]: failed to encode map e206 with expected crc 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[52328]: failed to encode map e206 with expected crc 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[52328]: Deploying daemon mon.c on smithi084 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-mon[52328]: failed to encode map e206 with expected crc 2024-01-13T18:02:59.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:59.761+0000 7fe13e6b8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:02:59.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:02:59 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[52305]: 2024-01-13T18:02:59.761+0000 7fe13e6b8700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-01-13T18:02:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:59 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:02:59.601+0000 7fcf840aa700 -1 mon.b@1(peon).osd e207 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:02:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:59 smithi099 ceph-mon[71325]: Upgrade: Updating mon.c 2024-01-13T18:02:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:59 smithi099 ceph-mon[71325]: failed to encode map e206 with expected crc 2024-01-13T18:02:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:59 smithi099 ceph-mon[71325]: failed to encode map e206 with expected crc 2024-01-13T18:02:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:59 smithi099 ceph-mon[71325]: failed to encode map e206 with expected crc 2024-01-13T18:02:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:59 smithi099 ceph-mon[71325]: Deploying daemon mon.c on smithi084 2024-01-13T18:02:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:02:59 smithi099 ceph-mon[71325]: failed to encode map e206 with expected crc 2024-01-13T18:03:00.327 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 bash[118909]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c 2024-01-13T18:03:00.327 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:03:00] "GET /metrics HTTP/1.1" 200 33280 "" "Prometheus/2.43.0" 2024-01-13T18:03:00.652 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.c.service: Succeeded. 2024-01-13T18:03:00.653 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 systemd[1]: Stopped Ceph mon.c for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:03:00.653 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 systemd[1]: Starting Ceph mon.c for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:03:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: set uid:gid to 167:167 (ceph:ceph) 2024-01-13T18:03:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable), process ceph-mon, pid 7 2024-01-13T18:03:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: pidfile_write: ignore empty --pid-file 2024-01-13T18:03:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 bash[119060]: e13f01b852fff3580d7d49b44f3d9e68f835af247f7beec0204ff42bf7d0f9ad 2024-01-13T18:03:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 systemd[1]: Started Ceph mon.c for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:03:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: load: jerasure load: lrc 2024-01-13T18:03:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: RocksDB version: 7.9.2 2024-01-13T18:03:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Git sha 0 2024-01-13T18:03:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Compile date 2024-01-12 22:23:15 2024-01-13T18:03:00.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: DB SUMMARY 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: DB Session ID: PH4QIGZ2QB93CV0H5SU8 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: CURRENT file: CURRENT 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: IDENTITY file: IDENTITY 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: MANIFEST file: MANIFEST-000009 size: 905 Bytes 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000024.sst 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000022.log size: 2503142 ; 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.error_if_exists: 0 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.create_if_missing: 0 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.paranoid_checks: 1 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.flush_verify_memtable_count: 1 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.env: 0x55b3eed50720 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.fs: PosixFileSystem 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.info_log: 0x55b3f10a9440 2024-01-13T18:03:00.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_file_opening_threads: 16 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.statistics: (nil) 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.use_fsync: 0 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_log_file_size: 0 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.keep_log_file_num: 1000 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.recycle_log_file_num: 0 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.allow_fallocate: 1 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.allow_mmap_reads: 0 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.allow_mmap_writes: 0 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.use_direct_reads: 0 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-13T18:03:00.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.create_missing_column_families: 0 2024-01-13T18:03:00.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.db_log_dir: 2024-01-13T18:03:00.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.wal_dir: 2024-01-13T18:03:00.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-13T18:03:00.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-13T18:03:00.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-13T18:03:00.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-13T18:03:00.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-13T18:03:00.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-13T18:03:00.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.advise_random_on_open: 1 2024-01-13T18:03:00.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.db_write_buffer_size: 0 2024-01-13T18:03:00.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.write_buffer_manager: 0x55b3f033a320 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.rate_limiter: (nil) 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.wal_recovery_mode: 2 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.enable_thread_tracking: 0 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.enable_pipelined_write: 0 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.unordered_write: 0 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.row_cache: None 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.wal_filter: None 2024-01-13T18:03:00.934 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.allow_ingest_behind: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.two_write_queues: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.manual_wal_flush: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.wal_compression: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.atomic_flush: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.log_readahead_size: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.best_efforts_recovery: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.allow_data_in_errors: 0 2024-01-13T18:03:00.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.db_host_id: __hostname__ 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.enforce_single_del_contracts: true 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_background_jobs: 2 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_background_compactions: -1 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_subcompactions: 1 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_total_wal_size: 0 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_open_files: -1 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bytes_per_sync: 0 2024-01-13T18:03:00.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_readahead_size: 0 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_background_flushes: -1 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Compression algorithms supported: 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: kZSTD supported: 0 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: kXpressCompression supported: 0 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: kLZ4HCCompression supported: 1 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: kZlibCompression supported: 1 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: kSnappyCompression supported: 1 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: kLZ4Compression supported: 1 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: kBZip2Compression supported: 0 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: DMutex implementation: pthread_mutex_t 2024-01-13T18:03:00.937 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.merge_operator: 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_filter: None 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_filter_factory: None 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.sst_partitioner_factory: None 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b3f10a9540) 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_type: 0 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout: data_block_index_type: 0 2024-01-13T18:03:00.938 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_shortening: 1 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: checksum: 4 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: no_block_cache: 0 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache: 0x55b3f03bb1f0 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_options: 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: capacity : 536870912 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: num_shard_bits : 4 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: strict_capacity_limit : 0 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_compressed: (nil) 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: persistent_cache: (nil) 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_size: 4096 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_size_deviation: 10 2024-01-13T18:03:00.939 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_restart_interval: 16 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_block_restart_interval: 1 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: metadata_block_size: 4096 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: partition_filters: 0 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: use_delta_encoding: 1 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: filter_policy: bloomfilter 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: whole_key_filtering: 1 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: verify_compression: 0 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: format_version: 5 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: enable_index_compression: 1 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_align: 0 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: max_auto_readahead_size: 262144 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: prepopulate_block_cache: 0 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: initial_auto_readahead_size: 8192 2024-01-13T18:03:00.940 INFO:journalctl@ceph.mon.c.smithi084.stdout: num_file_reads_for_auto_readahead: 2 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.write_buffer_size: 33554432 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_write_buffer_number: 2 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compression: NoCompression 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bottommost_compression: Disabled 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.prefix_extractor: nullptr 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.num_levels: 7 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-13T18:03:00.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compression_opts.level: 32767 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compression_opts.strategy: 0 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compression_opts.enabled: false 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-01-13T18:03:00.942 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.target_file_size_base: 67108864 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-13T18:03:00.943 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.arena_block_size: 1048576 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.disable_auto_compactions: 0 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-13T18:03:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.table_properties_collectors: 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.inplace_update_support: 0 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.bloom_locality: 0 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.max_successive_merges: 0 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.paranoid_file_checks: 0 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.force_consistency_checks: 1 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.report_bg_io_stats: 0 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.ttl: 2592000 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-01-13T18:03:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.enable_blob_files: false 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.min_blob_size: 0 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.blob_file_size: 268435456 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.blob_file_starting_level: 0 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 13685, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-13T18:03:00.946 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e667bb2f-9cd2-4b95-92b1-959a973ee9d9 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168980762577, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168980768742, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 1601413, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 13690, "largest_seqno": 14258, "table_properties": {"data_size": 1597743, "index_size": 1888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 7688, "raw_average_key_size": 26, "raw_value_size": 1591367, "raw_average_value_size": 5449, "num_data_blocks": 83, "num_entries": 292, "num_filter_entries": 292, "num_deletions": 12, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1705168980, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e667bb2f-9cd2-4b95-92b1-959a973ee9d9", "db_session_id": "PH4QIGZ2QB93CV0H5SU8", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168980768852, "job": 1, "event": "recovery_finished"} 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b3f0458000 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: DB pointer 0x55b3f0444000 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** DB Stats ** 2024-01-13T18:03:00.947 INFO:journalctl@ceph.mon.c.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: L0 1/0 1.53 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 577.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: L6 1/0 9.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-01-13T18:03:00.948 INFO:journalctl@ceph.mon.c.smithi084.stdout: Sum 2/0 11.30 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 577.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 577.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** Compaction Stats [default] ** 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 577.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-13T18:03:00.949 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative compaction: 0.00 GB write, 154.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval compaction: 0.00 GB write, 154.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Block cache BinnedLRUCache@0x55b3f03bb1f0#7 capacity: 512.00 MB usage: 2.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.91 KB,0.000172853%) IndexBlock(1,2.08 KB,0.000396371%) Misc(1,0.00 KB,0%) 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: starting mon.c rank 2 at public addrs [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] at bind addrs [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: mon.c@-1(???) e3 preinit fsid be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: mon.c@-1(???).mds e8 new map 2024-01-13T18:03:00.950 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: mon.c@-1(???).mds e8 print_map 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: e8 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: legacy client fscid: 1 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: Filesystem 'cephfs' (1) 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: fs_name cephfs 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: epoch 8 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: created 2024-01-13T17:58:37.204248+0000 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: modified 2024-01-13T17:58:40.826281+0000 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: tableserver 0 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: root 0 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: session_timeout 60 2024-01-13T18:03:00.951 INFO:journalctl@ceph.mon.c.smithi084.stdout: session_autoclose 300 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: max_file_size 1099511627776 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: max_xattr_size 65536 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: required_client_features {} 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: last_failure 0 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: last_failure_osd_epoch 0 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: max_mds 1 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: in 0 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: up {0=24337} 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: failed 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: damaged 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: stopped 2024-01-13T18:03:00.952 INFO:journalctl@ceph.mon.c.smithi084.stdout: data_pools [3] 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: metadata_pool 2 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: inline_data disabled 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: balancer 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: bal_rank_mask -1 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: standby_count_wanted 0 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: [mds.b{0:24337} state up:active seq 3 addr [v2:172.21.15.99:6832/2558131725,v1:172.21.15.99:6833/2558131725] compat {c=[1],r=[1],i=[7ff]}] 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: Standby daemons: 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout: [mds.a{-1:14463} state up:standby seq 1 addr [v2:172.21.15.84:6834/3944391177,v1:172.21.15.84:6835/3944391177] compat {c=[1],r=[1],i=[7ff]}] 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: mon.c@-1(???).osd e207 crush map has features 3314933069573799936, adjusting msgr requires 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: mon.c@-1(???).osd e207 crush map has features 432629308056666112, adjusting msgr requires 2024-01-13T18:03:00.953 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: mon.c@-1(???).osd e207 crush map has features 432629308056666112, adjusting msgr requires 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: mon.c@-1(???).osd e207 crush map has features 432629308056666112, adjusting msgr requires 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: mon.c@-1(???).paxosservice(auth 1..18) refresh upgraded, format 0 -> 3 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta expand map: {default=false} 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta from 'false' to 'false' 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta expanded map: {default=false} 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta expand map: {default=info} 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta from 'info' to 'info' 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta expanded map: {default=info} 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta expand map: {default=daemon} 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta from 'daemon' to 'daemon' 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta expanded map: {default=daemon} 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta expand map: {default=debug} 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta from 'debug' to 'debug' 2024-01-13T18:03:00.954 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:00 smithi084 ceph-mon[119097]: expand_channel_meta expanded map: {default=debug} 2024-01-13T18:03:01.852 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[116404]: mon.c calling monitor election 2024-01-13T18:03:01.852 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[116404]: mon.a calling monitor election 2024-01-13T18:03:01.852 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[116404]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T18:03:01.852 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[116404]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:03:01.852 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[116404]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:03:01.852 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[116404]: osdmap e207: 8 total, 8 up, 8 in 2024-01-13T18:03:01.852 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[116404]: mgrmap e40: y(active, since 10s), standbys: x 2024-01-13T18:03:01.852 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[116404]: overall HEALTH_OK 2024-01-13T18:03:01.852 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:01.852 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:01.852 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:01.857 INFO:tasks.rados.rados.0.smithi084.stdout:748: done (2 left) 2024-01-13T18:03:01.857 INFO:tasks.rados.rados.0.smithi084.stdout:749: read oid 47 snap -1 2024-01-13T18:03:01.857 INFO:tasks.rados.rados.0.smithi084.stdout:749: expect (ObjNum 127 snap 32 seq_num 127) 2024-01-13T18:03:01.857 INFO:tasks.rados.rados.0.smithi084.stdout:750: rollback oid 33 current snap is 72 2024-01-13T18:03:01.857 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 33 to 59 2024-01-13T18:03:01.857 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 72 2024-01-13T18:03:01.857 INFO:tasks.rados.rados.0.smithi084.stdout:751: seq_num 240 ranges {0=425984,425984=589824,1015808=483328,1499136=131072} 2024-01-13T18:03:01.860 INFO:tasks.rados.rados.0.smithi084.stdout:751: writing smithi084102331-35 from 0 to 425984 tid 1 2024-01-13T18:03:01.863 INFO:tasks.rados.rados.0.smithi084.stdout:751: writing smithi084102331-35 from 425984 to 1015808 tid 2 2024-01-13T18:03:01.867 INFO:tasks.rados.rados.0.smithi084.stdout:751: writing smithi084102331-35 from 1015808 to 1499136 tid 3 2024-01-13T18:03:01.867 INFO:tasks.rados.rados.0.smithi084.stdout:751: writing smithi084102331-35 from 1499136 to 1630208 tid 4 2024-01-13T18:03:01.868 INFO:tasks.rados.rados.0.smithi084.stdout:752: read oid 25 snap -1 2024-01-13T18:03:01.869 INFO:tasks.rados.rados.0.smithi084.stdout:752: expect deleted 2024-01-13T18:03:01.869 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 72 2024-01-13T18:03:01.869 INFO:tasks.rados.rados.0.smithi084.stdout:753: seq_num 241 ranges {491520=442368,933888=466944,1400832=688128,2088960=49152} 2024-01-13T18:03:01.874 INFO:tasks.rados.rados.0.smithi084.stdout:753: writing smithi084102331-32 from 491520 to 933888 tid 1 2024-01-13T18:03:01.877 INFO:tasks.rados.rados.0.smithi084.stdout:753: writing smithi084102331-32 from 933888 to 1400832 tid 2 2024-01-13T18:03:01.881 INFO:tasks.rados.rados.0.smithi084.stdout:753: writing smithi084102331-32 from 1400832 to 2088960 tid 3 2024-01-13T18:03:01.882 INFO:tasks.rados.rados.0.smithi084.stdout:753: writing smithi084102331-32 from 2088960 to 2138112 tid 4 2024-01-13T18:03:01.882 INFO:tasks.rados.rados.0.smithi084.stdout:754: rollback oid 27 current snap is 72 2024-01-13T18:03:01.883 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 53 2024-01-13T18:03:01.883 INFO:tasks.rados.rados.0.smithi084.stdout:744: finishing write tid 1 to smithi084102331-2 2024-01-13T18:03:01.883 INFO:tasks.rados.rados.0.smithi084.stdout:744: finishing write tid 2 to smithi084102331-2 2024-01-13T18:03:01.883 INFO:tasks.rados.rados.0.smithi084.stdout:744: finishing write tid 3 to smithi084102331-2 2024-01-13T18:03:01.883 INFO:tasks.rados.rados.0.smithi084.stdout:744: finishing write tid 4 to smithi084102331-2 2024-01-13T18:03:01.883 INFO:tasks.rados.rados.0.smithi084.stdout:744: finishing write tid 5 to smithi084102331-2 2024-01-13T18:03:01.883 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 276 (ObjNum 238 snap 72 seq_num 238) dirty exists 2024-01-13T18:03:01.883 INFO:tasks.rados.rados.0.smithi084.stdout:744: left oid 2 (ObjNum 238 snap 72 seq_num 238) 2024-01-13T18:03:01.883 INFO:tasks.rados.rados.0.smithi084.stdout:747: expect (ObjNum 212 snap 60 seq_num 212) 2024-01-13T18:03:01.927 INFO:tasks.rados.rados.0.smithi084.stdout:750: finishing rollback tid 0 to smithi084102331-33 2024-01-13T18:03:01.928 INFO:tasks.rados.rados.0.smithi084.stdout:750: finishing rollback tid 1 to smithi084102331-33 2024-01-13T18:03:01.928 INFO:tasks.rados.rados.0.smithi084.stdout:750: finishing rollback tid 2 to smithi084102331-33 2024-01-13T18:03:01.928 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 332 (ObjNum 192 snap 54 seq_num 192) dirty exists 2024-01-13T18:03:01.928 INFO:tasks.rados.rados.0.smithi084.stdout:744: done (7 left) 2024-01-13T18:03:01.928 INFO:tasks.rados.rados.0.smithi084.stdout:747: done (6 left) 2024-01-13T18:03:01.929 INFO:tasks.rados.rados.0.smithi084.stdout:750: done (5 left) 2024-01-13T18:03:01.929 INFO:tasks.rados.rados.0.smithi084.stdout:755: read oid 22 snap -1 2024-01-13T18:03:01.929 INFO:tasks.rados.rados.0.smithi084.stdout:755: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:03:01.929 INFO:tasks.rados.rados.0.smithi084.stdout:756: copy_from oid 11 from oid 2 current snap is 72 2024-01-13T18:03:01.929 INFO:tasks.rados.rados.0.smithi084.stdout:751: finishing write tid 1 to smithi084102331-35 2024-01-13T18:03:01.929 INFO:tasks.rados.rados.0.smithi084.stdout:751: finishing write tid 2 to smithi084102331-35 2024-01-13T18:03:01.930 INFO:tasks.rados.rados.0.smithi084.stdout:751: finishing write tid 3 to smithi084102331-35 2024-01-13T18:03:01.930 INFO:tasks.rados.rados.0.smithi084.stdout:751: finishing write tid 4 to smithi084102331-35 2024-01-13T18:03:01.930 INFO:tasks.rados.rados.0.smithi084.stdout:751: finishing write tid 5 to smithi084102331-35 2024-01-13T18:03:01.930 INFO:tasks.rados.rados.0.smithi084.stdout:751: finishing write tid 6 to smithi084102331-35 2024-01-13T18:03:01.930 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 224 (ObjNum 240 snap 72 seq_num 240) dirty exists 2024-01-13T18:03:01.930 INFO:tasks.rados.rados.0.smithi084.stdout:751: left oid 35 (ObjNum 240 snap 72 seq_num 240) 2024-01-13T18:03:01.931 INFO:tasks.rados.rados.0.smithi084.stdout:749: expect (ObjNum 127 snap 32 seq_num 127) 2024-01-13T18:03:02.058 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 1 to smithi084102331-32 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 2 to smithi084102331-32 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:749: done (6 left) 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:751: done (5 left) 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:752: done (4 left) 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:757: rmattr oid 47 current snap is 72 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:757: done (4 left) 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:758: rollback oid 48 current snap is 72 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 48 to 59 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 3 to smithi084102331-32 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 4 to smithi084102331-32 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 5 to smithi084102331-32 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 6 to smithi084102331-32 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 308 (ObjNum 241 snap 72 seq_num 241) dirty exists 2024-01-13T18:03:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:753: left oid 32 (ObjNum 241 snap 72 seq_num 241) 2024-01-13T18:03:02.060 INFO:tasks.rados.rados.0.smithi084.stdout:754: finishing rollback tid 0 to smithi084102331-27 2024-01-13T18:03:02.060 INFO:tasks.rados.rados.0.smithi084.stdout:754: finishing rollback tid 1 to smithi084102331-27 2024-01-13T18:03:02.060 INFO:tasks.rados.rados.0.smithi084.stdout:754: finishing rollback tid 2 to smithi084102331-27 2024-01-13T18:03:02.060 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 200 (ObjNum 165 snap 46 seq_num 165) dirty exists 2024-01-13T18:03:02.060 INFO:tasks.rados.rados.0.smithi084.stdout:756: finishing copy_from to smithi084102331-11 2024-01-13T18:03:02.060 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 276 (ObjNum 238 snap 72 seq_num 238) dirty exists 2024-01-13T18:03:02.060 INFO:tasks.rados.rados.0.smithi084.stdout:756: finishing copy_from racing read to smithi084102331-11 2024-01-13T18:03:02.060 INFO:tasks.rados.rados.0.smithi084.stdout:755: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:03:01.841+0000 7fcf840aa700 -1 mon.b@1(peon).osd e208 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-mon[71325]: mon.c calling monitor election 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-mon[71325]: mon.a calling monitor election 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-mon[71325]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-mon[71325]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-mon[71325]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-mon[71325]: osdmap e207: 8 total, 8 up, 8 in 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-mon[71325]: mgrmap e40: y(active, since 10s), standbys: x 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-mon[71325]: overall HEALTH_OK 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:01 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:02.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[119097]: mon.c calling monitor election 2024-01-13T18:03:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[119097]: mon.a calling monitor election 2024-01-13T18:03:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[119097]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T18:03:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[119097]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:03:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[119097]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:03:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[119097]: osdmap e207: 8 total, 8 up, 8 in 2024-01-13T18:03:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[119097]: mgrmap e40: y(active, since 10s), standbys: x 2024-01-13T18:03:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[119097]: overall HEALTH_OK 2024-01-13T18:03:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:01 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:02.334 INFO:tasks.rados.rados.0.smithi084.stdout:758: finishing rollback tid 0 to smithi084102331-48 2024-01-13T18:03:02.334 INFO:tasks.rados.rados.0.smithi084.stdout:758: finishing rollback tid 1 to smithi084102331-48 2024-01-13T18:03:02.334 INFO:tasks.rados.rados.0.smithi084.stdout:753: done (4 left) 2024-01-13T18:03:02.334 INFO:tasks.rados.rados.0.smithi084.stdout:754: done (3 left) 2024-01-13T18:03:02.334 INFO:tasks.rados.rados.0.smithi084.stdout:755: done (2 left) 2024-01-13T18:03:02.335 INFO:tasks.rados.rados.0.smithi084.stdout:756: done (1 left) 2024-01-13T18:03:02.335 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 72 2024-01-13T18:03:02.335 INFO:tasks.rados.rados.0.smithi084.stdout:758: finishing rollback tid 2 to smithi084102331-48 2024-01-13T18:03:02.335 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 296 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-01-13T18:03:02.335 INFO:tasks.rados.rados.0.smithi084.stdout:759: seq_num 242 ranges {3940352=458752,4399104=753664,5152768=450560} 2024-01-13T18:03:02.358 INFO:tasks.rados.rados.0.smithi084.stdout:759: writing smithi084102331-43 from 3940352 to 4399104 tid 1 2024-01-13T18:03:02.362 INFO:tasks.rados.rados.0.smithi084.stdout:759: writing smithi084102331-43 from 4399104 to 5152768 tid 2 2024-01-13T18:03:02.366 INFO:tasks.rados.rados.0.smithi084.stdout:759: writing smithi084102331-43 from 5152768 to 5603328 tid 3 2024-01-13T18:03:02.366 INFO:tasks.rados.rados.0.smithi084.stdout:758: done (1 left) 2024-01-13T18:03:02.366 INFO:tasks.rados.rados.0.smithi084.stdout:760: read oid 50 snap -1 2024-01-13T18:03:02.366 INFO:tasks.rados.rados.0.smithi084.stdout:760: expect (ObjNum 201 snap 55 seq_num 201) 2024-01-13T18:03:02.366 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 72 2024-01-13T18:03:02.366 INFO:tasks.rados.rados.0.smithi084.stdout:761: seq_num 243 ranges {4448256=475136,4923392=638976,5562368=565248} 2024-01-13T18:03:02.393 INFO:tasks.rados.rados.0.smithi084.stdout:761: writing smithi084102331-10 from 4448256 to 4923392 tid 1 2024-01-13T18:03:02.398 INFO:tasks.rados.rados.0.smithi084.stdout:761: writing smithi084102331-10 from 4923392 to 5562368 tid 2 2024-01-13T18:03:02.401 INFO:tasks.rados.rados.0.smithi084.stdout:761: writing smithi084102331-10 from 5562368 to 6127616 tid 3 2024-01-13T18:03:02.401 INFO:tasks.rados.rados.0.smithi084.stdout:762: setattr oid 27 current snap is 72 2024-01-13T18:03:02.401 INFO:tasks.rados.rados.0.smithi084.stdout:759: finishing write tid 1 to smithi084102331-43 2024-01-13T18:03:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:759: finishing write tid 2 to smithi084102331-43 2024-01-13T18:03:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:759: finishing write tid 3 to smithi084102331-43 2024-01-13T18:03:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:759: finishing write tid 4 to smithi084102331-43 2024-01-13T18:03:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:759: finishing write tid 5 to smithi084102331-43 2024-01-13T18:03:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 175 (ObjNum 242 snap 72 seq_num 242) dirty exists 2024-01-13T18:03:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:759: left oid 43 (ObjNum 242 snap 72 seq_num 242) 2024-01-13T18:03:02.402 INFO:tasks.rados.rados.0.smithi084.stdout:760: expect (ObjNum 201 snap 55 seq_num 201) 2024-01-13T18:03:02.657 INFO:tasks.rados.rados.0.smithi084.stdout:761: finishing write tid 1 to smithi084102331-10 2024-01-13T18:03:02.657 INFO:tasks.rados.rados.0.smithi084.stdout:761: finishing write tid 2 to smithi084102331-10 2024-01-13T18:03:02.657 INFO:tasks.rados.rados.0.smithi084.stdout:761: finishing write tid 3 to smithi084102331-10 2024-01-13T18:03:02.657 INFO:tasks.rados.rados.0.smithi084.stdout:761: finishing write tid 4 to smithi084102331-10 2024-01-13T18:03:02.657 INFO:tasks.rados.rados.0.smithi084.stdout:761: finishing write tid 5 to smithi084102331-10 2024-01-13T18:03:02.657 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 144 (ObjNum 243 snap 72 seq_num 243) dirty exists 2024-01-13T18:03:02.658 INFO:tasks.rados.rados.0.smithi084.stdout:761: left oid 10 (ObjNum 243 snap 72 seq_num 243) 2024-01-13T18:03:02.658 INFO:tasks.rados.rados.0.smithi084.stdout:759: done (3 left) 2024-01-13T18:03:02.658 INFO:tasks.rados.rados.0.smithi084.stdout:760: done (2 left) 2024-01-13T18:03:02.658 INFO:tasks.rados.rados.0.smithi084.stdout:761: done (1 left) 2024-01-13T18:03:02.658 INFO:tasks.rados.rados.0.smithi084.stdout:763: read oid 21 snap -1 2024-01-13T18:03:02.658 INFO:tasks.rados.rados.0.smithi084.stdout:763: expect (ObjNum 202 snap 55 seq_num 202) 2024-01-13T18:03:02.658 INFO:tasks.rados.rados.0.smithi084.stdout:764: snap_remove snap 59 2024-01-13T18:03:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:02 smithi099 ceph-mon[71325]: failed to encode map e208 with expected crc 2024-01-13T18:03:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:02 smithi099 ceph-mon[71325]: osdmap e208: 8 total, 8 up, 8 in 2024-01-13T18:03:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:02 smithi099 ceph-mon[71325]: failed to encode map e208 with expected crc 2024-01-13T18:03:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:02 smithi099 ceph-mon[71325]: failed to encode map e208 with expected crc 2024-01-13T18:03:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:02 smithi099 ceph-mon[71325]: pgmap v20: 121 pgs: 121 active+clean; 168 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 768 KiB/s rd, 670 KiB/s wr, 3 op/s 2024-01-13T18:03:03.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:02 smithi084 ceph-mon[119097]: failed to encode map e208 with expected crc 2024-01-13T18:03:03.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:02 smithi084 ceph-mon[119097]: osdmap e208: 8 total, 8 up, 8 in 2024-01-13T18:03:03.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:02 smithi084 ceph-mon[119097]: failed to encode map e208 with expected crc 2024-01-13T18:03:03.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:02 smithi084 ceph-mon[119097]: failed to encode map e208 with expected crc 2024-01-13T18:03:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:02 smithi084 ceph-mon[119097]: pgmap v20: 121 pgs: 121 active+clean; 168 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 768 KiB/s rd, 670 KiB/s wr, 3 op/s 2024-01-13T18:03:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:02 smithi084 ceph-mon[116404]: failed to encode map e208 with expected crc 2024-01-13T18:03:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:02 smithi084 ceph-mon[116404]: osdmap e208: 8 total, 8 up, 8 in 2024-01-13T18:03:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:02 smithi084 ceph-mon[116404]: failed to encode map e208 with expected crc 2024-01-13T18:03:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:02 smithi084 ceph-mon[116404]: failed to encode map e208 with expected crc 2024-01-13T18:03:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:02 smithi084 ceph-mon[116404]: pgmap v20: 121 pgs: 121 active+clean; 168 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 768 KiB/s rd, 670 KiB/s wr, 3 op/s 2024-01-13T18:03:03.568 INFO:tasks.rados.rados.0.smithi084.stdout:764: done (2 left) 2024-01-13T18:03:03.569 INFO:tasks.rados.rados.0.smithi084.stdout:765: snap_remove snap 71 2024-01-13T18:03:03.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:03 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:03:03.558+0000 7fcf840aa700 -1 mon.b@1(peon).osd e209 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:03:04.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:03 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:03 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:03 smithi084 ceph-mon[119097]: osdmap e209: 8 total, 8 up, 8 in 2024-01-13T18:03:04.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:03 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:03 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:03 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:03 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:03 smithi084 ceph-mon[116404]: osdmap e209: 8 total, 8 up, 8 in 2024-01-13T18:03:04.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:03 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:03 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:03 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:03 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:03 smithi099 ceph-mon[71325]: osdmap e209: 8 total, 8 up, 8 in 2024-01-13T18:03:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:03 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:03 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:04.567 INFO:tasks.rados.rados.0.smithi084.stdout:765: done (2 left) 2024-01-13T18:03:04.568 INFO:tasks.rados.rados.0.smithi084.stdout:766: snap_remove snap 70 2024-01-13T18:03:04.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:03:04.559+0000 7fcf840aa700 -1 mon.b@1(peon).osd e210 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:03:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:04 smithi084 ceph-mon[116404]: failed to encode map e209 with expected crc 2024-01-13T18:03:05.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:04 smithi084 ceph-mon[116404]: failed to encode map e209 with expected crc 2024-01-13T18:03:05.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:04 smithi084 ceph-mon[116404]: pgmap v22: 121 pgs: 121 active+clean; 168 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 627 KiB/s rd, 547 KiB/s wr, 2 op/s 2024-01-13T18:03:05.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:04 smithi084 ceph-mon[116404]: osdmap e210: 8 total, 8 up, 8 in 2024-01-13T18:03:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:04 smithi084 ceph-mon[119097]: failed to encode map e209 with expected crc 2024-01-13T18:03:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:04 smithi084 ceph-mon[119097]: failed to encode map e209 with expected crc 2024-01-13T18:03:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:04 smithi084 ceph-mon[119097]: pgmap v22: 121 pgs: 121 active+clean; 168 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 627 KiB/s rd, 547 KiB/s wr, 2 op/s 2024-01-13T18:03:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:04 smithi084 ceph-mon[119097]: osdmap e210: 8 total, 8 up, 8 in 2024-01-13T18:03:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:04 smithi099 ceph-mon[71325]: failed to encode map e209 with expected crc 2024-01-13T18:03:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:04 smithi099 ceph-mon[71325]: failed to encode map e209 with expected crc 2024-01-13T18:03:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:04 smithi099 ceph-mon[71325]: pgmap v22: 121 pgs: 121 active+clean; 168 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 627 KiB/s rd, 547 KiB/s wr, 2 op/s 2024-01-13T18:03:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:04 smithi099 ceph-mon[71325]: osdmap e210: 8 total, 8 up, 8 in 2024-01-13T18:03:05.569 INFO:tasks.rados.rados.0.smithi084.stdout:766: done (2 left) 2024-01-13T18:03:05.569 INFO:tasks.rados.rados.0.smithi084.stdout:767: snap_create 2024-01-13T18:03:05.569 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 207 (ObjNum 165 snap 46 seq_num 165) dirty exists 2024-01-13T18:03:05.569 INFO:tasks.rados.rados.0.smithi084.stdout:763: expect (ObjNum 202 snap 55 seq_num 202) 2024-01-13T18:03:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:03:05.561+0000 7fcf840aa700 -1 mon.b@1(peon).osd e211 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:03:05.935 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:03:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:03:05.779+0000 7fcaf82a4700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-13T18:03:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:05 smithi099 ceph-mon[71325]: failed to encode map e210 with expected crc 2024-01-13T18:03:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:05 smithi099 ceph-mon[71325]: failed to encode map e210 with expected crc 2024-01-13T18:03:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:05 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:05 smithi099 ceph-mon[71325]: failed to encode map e211 with expected crc 2024-01-13T18:03:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:05 smithi099 ceph-mon[71325]: osdmap e211: 8 total, 8 up, 8 in 2024-01-13T18:03:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:05 smithi084 ceph-mon[116404]: failed to encode map e210 with expected crc 2024-01-13T18:03:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:05 smithi084 ceph-mon[116404]: failed to encode map e210 with expected crc 2024-01-13T18:03:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:05 smithi084 ceph-mon[116404]: failed to encode map e211 with expected crc 2024-01-13T18:03:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:05 smithi084 ceph-mon[116404]: osdmap e211: 8 total, 8 up, 8 in 2024-01-13T18:03:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:05 smithi084 ceph-mon[119097]: failed to encode map e210 with expected crc 2024-01-13T18:03:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:05 smithi084 ceph-mon[119097]: failed to encode map e210 with expected crc 2024-01-13T18:03:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:05 smithi084 ceph-mon[119097]: failed to encode map e211 with expected crc 2024-01-13T18:03:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:05 smithi084 ceph-mon[119097]: osdmap e211: 8 total, 8 up, 8 in 2024-01-13T18:03:06.572 INFO:tasks.rados.rados.0.smithi084.stdout:762: done (2 left) 2024-01-13T18:03:06.572 INFO:tasks.rados.rados.0.smithi084.stdout:763: done (1 left) 2024-01-13T18:03:06.572 INFO:tasks.rados.rados.0.smithi084.stdout:767: done (0 left) 2024-01-13T18:03:06.572 INFO:tasks.rados.rados.0.smithi084.stdout:768: rollback oid 21 current snap is 73 2024-01-13T18:03:06.573 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 63 2024-01-13T18:03:06.573 INFO:tasks.rados.rados.0.smithi084.stdout:769: copy_from oid 28 from oid 37 current snap is 73 2024-01-13T18:03:06.573 INFO:tasks.rados.rados.0.smithi084.stdout:770: delete oid 1 current snap is 73 2024-01-13T18:03:06.579 INFO:tasks.rados.rados.0.smithi084.stdout:770: done (2 left) 2024-01-13T18:03:06.579 INFO:tasks.rados.rados.0.smithi084.stdout:771: delete oid 20 current snap is 73 2024-01-13T18:03:06.580 INFO:tasks.rados.rados.0.smithi084.stdout:768: finishing rollback tid 0 to smithi084102331-21 2024-01-13T18:03:06.580 INFO:tasks.rados.rados.0.smithi084.stdout:768: finishing rollback tid 1 to smithi084102331-21 2024-01-13T18:03:06.580 INFO:tasks.rados.rados.0.smithi084.stdout:768: finishing rollback tid 2 to smithi084102331-21 2024-01-13T18:03:06.580 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 236 (ObjNum 202 snap 55 seq_num 202) dirty exists 2024-01-13T18:03:06.584 INFO:tasks.rados.rados.0.smithi084.stdout:768: done (2 left) 2024-01-13T18:03:06.585 INFO:tasks.rados.rados.0.smithi084.stdout:771: done (1 left) 2024-01-13T18:03:06.585 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 73 2024-01-13T18:03:06.585 INFO:tasks.rados.rados.0.smithi084.stdout:772: seq_num 246 ranges {2236416=524288,2760704=745472,3506176=425984,3932160=32768} 2024-01-13T18:03:06.600 INFO:tasks.rados.rados.0.smithi084.stdout:772: writing smithi084102331-24 from 2236416 to 2760704 tid 1 2024-01-13T18:03:06.604 INFO:tasks.rados.rados.0.smithi084.stdout:772: writing smithi084102331-24 from 2760704 to 3506176 tid 2 2024-01-13T18:03:06.607 INFO:tasks.rados.rados.0.smithi084.stdout:772: writing smithi084102331-24 from 3506176 to 3932160 tid 3 2024-01-13T18:03:06.607 INFO:tasks.rados.rados.0.smithi084.stdout:772: writing smithi084102331-24 from 3932160 to 3964928 tid 4 2024-01-13T18:03:06.607 INFO:tasks.rados.rados.0.smithi084.stdout:773: rmattr oid 2 current snap is 73 2024-01-13T18:03:06.607 INFO:tasks.rados.rados.0.smithi084.stdout:773: done (2 left) 2024-01-13T18:03:06.608 INFO:tasks.rados.rados.0.smithi084.stdout:774: snap_create 2024-01-13T18:03:06.608 INFO:tasks.rados.rados.0.smithi084.stdout:769: finishing copy_from to smithi084102331-28 2024-01-13T18:03:06.608 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 266 (ObjNum 221 snap 68 seq_num 221) dirty exists 2024-01-13T18:03:06.608 INFO:tasks.rados.rados.0.smithi084.stdout:769: finishing copy_from racing read to smithi084102331-28 2024-01-13T18:03:06.608 INFO:tasks.rados.rados.0.smithi084.stdout:772: finishing write tid 1 to smithi084102331-24 2024-01-13T18:03:06.608 INFO:tasks.rados.rados.0.smithi084.stdout:772: finishing write tid 2 to smithi084102331-24 2024-01-13T18:03:06.609 INFO:tasks.rados.rados.0.smithi084.stdout:772: finishing write tid 3 to smithi084102331-24 2024-01-13T18:03:06.609 INFO:tasks.rados.rados.0.smithi084.stdout:772: finishing write tid 4 to smithi084102331-24 2024-01-13T18:03:06.610 INFO:tasks.rados.rados.0.smithi084.stdout:772: finishing write tid 5 to smithi084102331-24 2024-01-13T18:03:06.611 INFO:tasks.rados.rados.0.smithi084.stdout:772: finishing write tid 6 to smithi084102331-24 2024-01-13T18:03:06.611 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 191 (ObjNum 246 snap 73 seq_num 246) dirty exists 2024-01-13T18:03:06.611 INFO:tasks.rados.rados.0.smithi084.stdout:772: left oid 24 (ObjNum 246 snap 73 seq_num 246) 2024-01-13T18:03:06.789 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:06 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:03:06.562+0000 7fcf840aa700 -1 mon.b@1(peon).osd e212 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:03:07.115 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: failed to encode map e211 with expected crc 2024-01-13T18:03:07.115 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: pgmap v25: 121 pgs: 121 active+clean; 142 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.7 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-01-13T18:03:07.115 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:07.115 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:07.115 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:07.115 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:03:07.115 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-13T18:03:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-01-13T18:03:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: Upgrade: It appears safe to stop mon.b 2024-01-13T18:03:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: failed to encode map e212 with expected crc 2024-01-13T18:03:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: osdmap e212: 8 total, 8 up, 8 in 2024-01-13T18:03:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-mon[71325]: failed to encode map e212 with expected crc 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: failed to encode map e211 with expected crc 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: pgmap v25: 121 pgs: 121 active+clean; 142 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.7 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: Upgrade: It appears safe to stop mon.b 2024-01-13T18:03:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: failed to encode map e212 with expected crc 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: osdmap e212: 8 total, 8 up, 8 in 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[119097]: failed to encode map e212 with expected crc 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: failed to encode map e211 with expected crc 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: pgmap v25: 121 pgs: 121 active+clean; 142 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.7 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:07.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-01-13T18:03:07.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-01-13T18:03:07.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: Upgrade: It appears safe to stop mon.b 2024-01-13T18:03:07.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: failed to encode map e212 with expected crc 2024-01-13T18:03:07.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: osdmap e212: 8 total, 8 up, 8 in 2024-01-13T18:03:07.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:07 smithi084 ceph-mon[116404]: failed to encode map e212 with expected crc 2024-01-13T18:03:07.567 INFO:tasks.rados.rados.0.smithi084.stdout:769: done (2 left) 2024-01-13T18:03:07.567 INFO:tasks.rados.rados.0.smithi084.stdout:772: done (1 left) 2024-01-13T18:03:07.567 INFO:tasks.rados.rados.0.smithi084.stdout:774: done (0 left) 2024-01-13T18:03:07.567 INFO:tasks.rados.rados.0.smithi084.stdout:775: rmattr oid 35 current snap is 74 2024-01-13T18:03:07.567 INFO:tasks.rados.rados.0.smithi084.stdout:775: done (0 left) 2024-01-13T18:03:07.567 INFO:tasks.rados.rados.0.smithi084.stdout:776: read oid 27 snap -1 2024-01-13T18:03:07.568 INFO:tasks.rados.rados.0.smithi084.stdout:776: expect (ObjNum 165 snap 46 seq_num 165) 2024-01-13T18:03:07.568 INFO:tasks.rados.rados.0.smithi084.stdout:777: read oid 26 snap -1 2024-01-13T18:03:07.568 INFO:tasks.rados.rados.0.smithi084.stdout:777: expect deleted 2024-01-13T18:03:07.568 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 74 2024-01-13T18:03:07.568 INFO:tasks.rados.rados.0.smithi084.stdout:778: seq_num 247 ranges {794624=540672,1335296=622592,1957888=581632} 2024-01-13T18:03:07.575 INFO:tasks.rados.rados.0.smithi084.stdout:778: writing smithi084102331-48 from 794624 to 1335296 tid 1 2024-01-13T18:03:07.578 INFO:tasks.rados.rados.0.smithi084.stdout:778: writing smithi084102331-48 from 1335296 to 1957888 tid 2 2024-01-13T18:03:07.582 INFO:tasks.rados.rados.0.smithi084.stdout:778: writing smithi084102331-48 from 1957888 to 2539520 tid 3 2024-01-13T18:03:07.582 INFO:tasks.rados.rados.0.smithi084.stdout:779: read oid 10 snap -1 2024-01-13T18:03:07.582 INFO:tasks.rados.rados.0.smithi084.stdout:779: expect (ObjNum 243 snap 72 seq_num 243) 2024-01-13T18:03:07.582 INFO:tasks.rados.rados.0.smithi084.stdout:780: rollback oid 30 current snap is 74 2024-01-13T18:03:07.582 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 73 2024-01-13T18:03:07.582 INFO:tasks.rados.rados.0.smithi084.stdout:776: expect (ObjNum 165 snap 46 seq_num 165) 2024-01-13T18:03:07.596 INFO:tasks.rados.rados.0.smithi084.stdout:778: finishing write tid 1 to smithi084102331-48 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:778: finishing write tid 2 to smithi084102331-48 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:776: done (4 left) 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:777: done (3 left) 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:781: read oid 45 snap -1 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:781: expect (ObjNum 85 snap 15 seq_num 85) 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:782: snap_create 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:778: finishing write tid 3 to smithi084102331-48 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:778: finishing write tid 4 to smithi084102331-48 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:780: finishing rollback tid 0 to smithi084102331-30 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:780: finishing rollback tid 1 to smithi084102331-30 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:778: finishing write tid 5 to smithi084102331-48 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 309 (ObjNum 247 snap 74 seq_num 247) dirty exists 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:778: left oid 48 (ObjNum 247 snap 74 seq_num 247) 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:780: finishing rollback tid 2 to smithi084102331-30 2024-01-13T18:03:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 356 (ObjNum 179 snap 51 seq_num 179) dirty exists 2024-01-13T18:03:07.603 INFO:tasks.rados.rados.0.smithi084.stdout:781: expect (ObjNum 85 snap 15 seq_num 85) 2024-01-13T18:03:07.650 INFO:tasks.rados.rados.0.smithi084.stdout:779: expect (ObjNum 243 snap 72 seq_num 243) 2024-01-13T18:03:07.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:07 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:03:07.559+0000 7fcf840aa700 -1 mon.b@1(peon).osd e213 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:03:08.572 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: failed to encode map e212 with expected crc 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: failed to encode map e212 with expected crc 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: failed to encode map e212 with expected crc 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: Upgrade: Updating mon.b 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: Deploying daemon mon.b on smithi099 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: failed to encode map e213 with expected crc 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: osdmap e213: 8 total, 8 up, 8 in 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: failed to encode map e213 with expected crc 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-mon[71325]: failed to encode map e213 with expected crc 2024-01-13T18:03:08.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 systemd[1]: Stopping Ceph mon.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:03:08.577 INFO:tasks.rados.rados.0.smithi084.stdout:778: done (4 left) 2024-01-13T18:03:08.577 INFO:tasks.rados.rados.0.smithi084.stdout:779: done (3 left) 2024-01-13T18:03:08.577 INFO:tasks.rados.rados.0.smithi084.stdout:780: done (2 left) 2024-01-13T18:03:08.577 INFO:tasks.rados.rados.0.smithi084.stdout:781: done (1 left) 2024-01-13T18:03:08.577 INFO:tasks.rados.rados.0.smithi084.stdout:782: done (0 left) 2024-01-13T18:03:08.577 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 75 2024-01-13T18:03:08.577 INFO:tasks.rados.rados.0.smithi084.stdout:783: seq_num 248 ranges {24576=557056,581632=507904,1089536=442368,1531904=253952} 2024-01-13T18:03:08.580 INFO:tasks.rados.rados.0.smithi084.stdout:783: writing smithi084102331-36 from 24576 to 581632 tid 1 2024-01-13T18:03:08.583 INFO:tasks.rados.rados.0.smithi084.stdout:783: writing smithi084102331-36 from 581632 to 1089536 tid 2 2024-01-13T18:03:08.586 INFO:tasks.rados.rados.0.smithi084.stdout:783: writing smithi084102331-36 from 1089536 to 1531904 tid 3 2024-01-13T18:03:08.588 INFO:tasks.rados.rados.0.smithi084.stdout:783: writing smithi084102331-36 from 1531904 to 1785856 tid 4 2024-01-13T18:03:08.588 INFO:tasks.rados.rados.0.smithi084.stdout:784: read oid 40 snap -1 2024-01-13T18:03:08.588 INFO:tasks.rados.rados.0.smithi084.stdout:784: expect (ObjNum 225 snap 69 seq_num 225) 2024-01-13T18:03:08.588 INFO:tasks.rados.rados.0.smithi084.stdout:785: read oid 17 snap -1 2024-01-13T18:03:08.588 INFO:tasks.rados.rados.0.smithi084.stdout:785: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:03:08.588 INFO:tasks.rados.rados.0.smithi084.stdout:786: copy_from oid 7 from oid 13 current snap is 75 2024-01-13T18:03:08.588 INFO:tasks.rados.rados.0.smithi084.stdout:783: finishing write tid 1 to smithi084102331-36 2024-01-13T18:03:08.588 INFO:tasks.rados.rados.0.smithi084.stdout:787: setattr oid 44 current snap is 75 2024-01-13T18:03:08.590 INFO:tasks.rados.rados.0.smithi084.stdout:788: copy_from oid 30 from oid 38 current snap is 75 2024-01-13T18:03:08.590 INFO:tasks.rados.rados.0.smithi084.stdout:783: finishing write tid 2 to smithi084102331-36 2024-01-13T18:03:08.590 INFO:tasks.rados.rados.0.smithi084.stdout:789: read oid 50 snap 53 2024-01-13T18:03:08.590 INFO:tasks.rados.rados.0.smithi084.stdout:789: expect (ObjNum 145 snap 40 seq_num 145) 2024-01-13T18:03:08.590 INFO:tasks.rados.rados.0.smithi084.stdout:790: rmattr oid 24 current snap is 75 2024-01-13T18:03:08.590 INFO:tasks.rados.rados.0.smithi084.stdout:783: finishing write tid 3 to smithi084102331-36 2024-01-13T18:03:08.590 INFO:tasks.rados.rados.0.smithi084.stdout:783: finishing write tid 4 to smithi084102331-36 2024-01-13T18:03:08.590 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 75 2024-01-13T18:03:08.590 INFO:tasks.rados.rados.0.smithi084.stdout:791: seq_num 249 ranges {0=573440,573440=794624,1368064=409600} 2024-01-13T18:03:08.593 INFO:tasks.rados.rados.0.smithi084.stdout:791: writing smithi084102331-1 from 0 to 573440 tid 1 2024-01-13T18:03:08.600 INFO:tasks.rados.rados.0.smithi084.stdout:791: writing smithi084102331-1 from 573440 to 1368064 tid 2 2024-01-13T18:03:08.601 INFO:tasks.rados.rados.0.smithi084.stdout:791: writing smithi084102331-1 from 1368064 to 1777664 tid 3 2024-01-13T18:03:08.601 INFO:tasks.rados.rados.0.smithi084.stdout:792: rmattr oid 8 current snap is 75 2024-01-13T18:03:08.602 INFO:tasks.rados.rados.0.smithi084.stdout:792: done (9 left) 2024-01-13T18:03:08.602 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 75 2024-01-13T18:03:08.602 INFO:tasks.rados.rados.0.smithi084.stdout:793: seq_num 250 ranges {1597440=589824,2187264=679936,2867200=409600,3276800=114688} 2024-01-13T18:03:08.613 INFO:tasks.rados.rados.0.smithi084.stdout:793: writing smithi084102331-11 from 1597440 to 2187264 tid 1 2024-01-13T18:03:08.617 INFO:tasks.rados.rados.0.smithi084.stdout:793: writing smithi084102331-11 from 2187264 to 2867200 tid 2 2024-01-13T18:03:08.620 INFO:tasks.rados.rados.0.smithi084.stdout:793: writing smithi084102331-11 from 2867200 to 3276800 tid 3 2024-01-13T18:03:08.621 INFO:tasks.rados.rados.0.smithi084.stdout:793: writing smithi084102331-11 from 3276800 to 3391488 tid 4 2024-01-13T18:03:08.621 INFO:tasks.rados.rados.0.smithi084.stdout:794: read oid 28 snap 74 2024-01-13T18:03:08.621 INFO:tasks.rados.rados.0.smithi084.stdout:794: expect (ObjNum 221 snap 68 seq_num 221) 2024-01-13T18:03:08.621 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 75 2024-01-13T18:03:08.621 INFO:tasks.rados.rados.0.smithi084.stdout:783: finishing write tid 5 to smithi084102331-36 2024-01-13T18:03:08.621 INFO:tasks.rados.rados.0.smithi084.stdout:795: seq_num 251 ranges {6471680=606208,7077888=614400,7692288=589824} 2024-01-13T18:03:08.658 INFO:tasks.rados.rados.0.smithi084.stdout:795: writing smithi084102331-16 from 6471680 to 7077888 tid 1 2024-01-13T18:03:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:795: writing smithi084102331-16 from 7077888 to 7692288 tid 2 2024-01-13T18:03:08.666 INFO:tasks.rados.rados.0.smithi084.stdout:795: writing smithi084102331-16 from 7692288 to 8282112 tid 3 2024-01-13T18:03:08.666 INFO:tasks.rados.rados.0.smithi084.stdout:796: read oid 2 snap 66 2024-01-13T18:03:08.666 INFO:tasks.rados.rados.0.smithi084.stdout:796: expect deleted 2024-01-13T18:03:08.666 INFO:tasks.rados.rados.0.smithi084.stdout:797: setattr oid 46 current snap is 75 2024-01-13T18:03:08.666 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 193 (ObjNum 246 snap 73 seq_num 246) dirty exists 2024-01-13T18:03:08.666 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 319 (ObjNum 721 snap 0 seq_num 2814418496) dirty exists 2024-01-13T18:03:08.666 INFO:tasks.rados.rados.0.smithi084.stdout:785: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:03:08.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: failed to encode map e212 with expected crc 2024-01-13T18:03:08.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: failed to encode map e212 with expected crc 2024-01-13T18:03:08.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: failed to encode map e212 with expected crc 2024-01-13T18:03:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: Upgrade: Updating mon.b 2024-01-13T18:03:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: Deploying daemon mon.b on smithi099 2024-01-13T18:03:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: failed to encode map e213 with expected crc 2024-01-13T18:03:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: osdmap e213: 8 total, 8 up, 8 in 2024-01-13T18:03:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: failed to encode map e213 with expected crc 2024-01-13T18:03:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[119097]: failed to encode map e213 with expected crc 2024-01-13T18:03:08.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: failed to encode map e212 with expected crc 2024-01-13T18:03:08.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: failed to encode map e212 with expected crc 2024-01-13T18:03:08.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: failed to encode map e212 with expected crc 2024-01-13T18:03:08.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: Upgrade: Updating mon.b 2024-01-13T18:03:08.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:08.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:08.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:08.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:08.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: Deploying daemon mon.b on smithi099 2024-01-13T18:03:08.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: failed to encode map e213 with expected crc 2024-01-13T18:03:08.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: osdmap e213: 8 total, 8 up, 8 in 2024-01-13T18:03:08.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: failed to encode map e213 with expected crc 2024-01-13T18:03:08.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:08 smithi084 ceph-mon[116404]: failed to encode map e213 with expected crc 2024-01-13T18:03:08.702 INFO:tasks.rados.rados.0.smithi084.stdout:783: finishing write tid 6 to smithi084102331-36 2024-01-13T18:03:08.702 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 303 (ObjNum 248 snap 75 seq_num 248) dirty exists 2024-01-13T18:03:08.702 INFO:tasks.rados.rados.0.smithi084.stdout:783: left oid 36 (ObjNum 248 snap 75 seq_num 248) 2024-01-13T18:03:08.702 INFO:tasks.rados.rados.0.smithi084.stdout:788: finishing copy_from to smithi084102331-30 2024-01-13T18:03:08.702 INFO:tasks.rados.rados.0.smithi084.stdout:788: got expected ENOENT (src dne) 2024-01-13T18:03:08.702 INFO:tasks.rados.rados.0.smithi084.stdout:788: finishing copy_from racing read to smithi084102331-30 2024-01-13T18:03:08.702 INFO:tasks.rados.rados.0.smithi084.stdout:791: finishing write tid 1 to smithi084102331-1 2024-01-13T18:03:08.702 INFO:tasks.rados.rados.0.smithi084.stdout:784: expect (ObjNum 225 snap 69 seq_num 225) 2024-01-13T18:03:08.738 INFO:tasks.rados.rados.0.smithi084.stdout:791: finishing write tid 2 to smithi084102331-1 2024-01-13T18:03:08.738 INFO:tasks.rados.rados.0.smithi084.stdout:789: expect (ObjNum 145 snap 40 seq_num 145) 2024-01-13T18:03:08.772 INFO:tasks.rados.rados.0.smithi084.stdout:791: finishing write tid 3 to smithi084102331-1 2024-01-13T18:03:08.772 INFO:tasks.rados.rados.0.smithi084.stdout:791: finishing write tid 4 to smithi084102331-1 2024-01-13T18:03:08.772 INFO:tasks.rados.rados.0.smithi084.stdout:783: done (13 left) 2024-01-13T18:03:08.773 INFO:tasks.rados.rados.0.smithi084.stdout:784: done (12 left) 2024-01-13T18:03:08.773 INFO:tasks.rados.rados.0.smithi084.stdout:785: done (11 left) 2024-01-13T18:03:08.773 INFO:tasks.rados.rados.0.smithi084.stdout:787: done (10 left) 2024-01-13T18:03:08.773 INFO:tasks.rados.rados.0.smithi084.stdout:788: done (9 left) 2024-01-13T18:03:08.773 INFO:tasks.rados.rados.0.smithi084.stdout:789: done (8 left) 2024-01-13T18:03:08.773 INFO:tasks.rados.rados.0.smithi084.stdout:790: done (7 left) 2024-01-13T18:03:08.773 INFO:tasks.rados.rados.0.smithi084.stdout:798: read oid 4 snap 74 2024-01-13T18:03:08.773 INFO:tasks.rados.rados.0.smithi084.stdout:798: expect (ObjNum 212 snap 60 seq_num 212) 2024-01-13T18:03:08.773 INFO:tasks.rados.rados.0.smithi084.stdout:799: rmattr oid 48 current snap is 75 2024-01-13T18:03:08.773 INFO:tasks.rados.rados.0.smithi084.stdout:799: done (8 left) 2024-01-13T18:03:08.773 INFO:tasks.rados.rados.0.smithi084.stdout:800: snap_remove snap 73 2024-01-13T18:03:08.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:03:08.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:03:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:03:08.570+0000 7fcf840aa700 -1 mon.b@1(peon).osd e214 update_from_paxos full map CRC mismatch, resetting to canonical 2024-01-13T18:03:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:03:08.712+0000 7fcf898b5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:03:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[71293]: 2024-01-13T18:03:08.712+0000 7fcf898b5700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-01-13T18:03:09.227 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:08 smithi099 bash[138598]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b 2024-01-13T18:03:09.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.b.service: Succeeded. 2024-01-13T18:03:09.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 systemd[1]: Stopped Ceph mon.b for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:03:09.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 systemd[1]: Starting Ceph mon.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:03:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: set uid:gid to 167:167 (ceph:ceph) 2024-01-13T18:03:10.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable), process ceph-mon, pid 7 2024-01-13T18:03:10.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: pidfile_write: ignore empty --pid-file 2024-01-13T18:03:10.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 bash[138751]: be7bb477ea534721287d0e14189f39d3e9634d3089fc0bd7d525cef4a64c5706 2024-01-13T18:03:10.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 systemd[1]: Started Ceph mon.b for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:03:10.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: load: jerasure load: lrc 2024-01-13T18:03:10.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: RocksDB version: 7.9.2 2024-01-13T18:03:10.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Git sha 0 2024-01-13T18:03:10.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Compile date 2024-01-12 22:23:15 2024-01-13T18:03:10.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: DB SUMMARY 2024-01-13T18:03:10.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: DB Session ID: KQCCB8FK2964NRJ2RP4Z 2024-01-13T18:03:10.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: CURRENT file: CURRENT 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: IDENTITY file: IDENTITY 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: MANIFEST file: MANIFEST-000009 size: 905 Bytes 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000024.sst 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000022.log size: 3203434 ; 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.error_if_exists: 0 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.create_if_missing: 0 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.paranoid_checks: 1 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.flush_verify_memtable_count: 1 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.env: 0x5622a28c9720 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.fs: PosixFileSystem 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.info_log: 0x5622a5a87440 2024-01-13T18:03:10.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_file_opening_threads: 16 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.statistics: (nil) 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.use_fsync: 0 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_log_file_size: 0 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.keep_log_file_num: 1000 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.recycle_log_file_num: 0 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.allow_fallocate: 1 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.allow_mmap_reads: 0 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.allow_mmap_writes: 0 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.use_direct_reads: 0 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.create_missing_column_families: 0 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.db_log_dir: 2024-01-13T18:03:10.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.wal_dir: 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.advise_random_on_open: 1 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.db_write_buffer_size: 0 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.write_buffer_manager: 0x5622a4d18320 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.rate_limiter: (nil) 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.wal_recovery_mode: 2 2024-01-13T18:03:10.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.enable_thread_tracking: 0 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.enable_pipelined_write: 0 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.unordered_write: 0 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.row_cache: None 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.wal_filter: None 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.allow_ingest_behind: 0 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.two_write_queues: 0 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.manual_wal_flush: 0 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.wal_compression: 0 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.atomic_flush: 0 2024-01-13T18:03:10.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.log_readahead_size: 0 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.best_efforts_recovery: 0 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.allow_data_in_errors: 0 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.db_host_id: __hostname__ 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.enforce_single_del_contracts: true 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_background_jobs: 2 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_background_compactions: -1 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_subcompactions: 1 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-13T18:03:10.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_total_wal_size: 0 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_open_files: -1 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bytes_per_sync: 0 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_readahead_size: 0 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_background_flushes: -1 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Compression algorithms supported: 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-13T18:03:10.126 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: kZSTD supported: 0 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: kXpressCompression supported: 0 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: kLZ4HCCompression supported: 1 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: kZlibCompression supported: 1 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: kSnappyCompression supported: 1 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: kLZ4Compression supported: 1 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: kBZip2Compression supported: 0 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: DMutex implementation: pthread_mutex_t 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.merge_operator: 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_filter: None 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_filter_factory: None 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.sst_partitioner_factory: None 2024-01-13T18:03:10.127 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5622a5a87540) 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: cache_index_and_filter_blocks: 1 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: pin_top_level_index_and_filter: 1 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: index_type: 0 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: data_block_index_type: 0 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: index_shortening: 1 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: checksum: 4 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: no_block_cache: 0 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: block_cache: 0x5622a4d99350 2024-01-13T18:03:10.128 INFO:journalctl@ceph.mon.b.smithi099.stdout: block_cache_name: BinnedLRUCache 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: block_cache_options: 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: capacity : 536870912 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: num_shard_bits : 4 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: strict_capacity_limit : 0 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: high_pri_pool_ratio: 0.000 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: block_cache_compressed: (nil) 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: persistent_cache: (nil) 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: block_size: 4096 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: block_size_deviation: 10 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: block_restart_interval: 16 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: index_block_restart_interval: 1 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: metadata_block_size: 4096 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: partition_filters: 0 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: use_delta_encoding: 1 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: filter_policy: bloomfilter 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: whole_key_filtering: 1 2024-01-13T18:03:10.129 INFO:journalctl@ceph.mon.b.smithi099.stdout: verify_compression: 0 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout: read_amp_bytes_per_bit: 0 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout: format_version: 5 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout: enable_index_compression: 1 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout: block_align: 0 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout: max_auto_readahead_size: 262144 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout: prepopulate_block_cache: 0 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout: initial_auto_readahead_size: 8192 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout: num_file_reads_for_auto_readahead: 2 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.write_buffer_size: 33554432 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_write_buffer_number: 2 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compression: NoCompression 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bottommost_compression: Disabled 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.prefix_extractor: nullptr 2024-01-13T18:03:10.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.num_levels: 7 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-13T18:03:10.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compression_opts.level: 32767 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compression_opts.strategy: 0 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compression_opts.enabled: false 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.target_file_size_base: 67108864 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-13T18:03:10.132 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.arena_block_size: 1048576 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-13T18:03:10.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.disable_auto_compactions: 0 2024-01-13T18:03:10.134 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-13T18:03:10.134 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-13T18:03:10.134 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-13T18:03:10.134 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-13T18:03:10.134 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-13T18:03:10.134 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.table_properties_collectors: 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.inplace_update_support: 0 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.bloom_locality: 0 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.max_successive_merges: 0 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.paranoid_file_checks: 0 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.force_consistency_checks: 1 2024-01-13T18:03:10.135 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.report_bg_io_stats: 0 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.ttl: 2592000 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.enable_blob_files: false 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.min_blob_size: 0 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.blob_file_size: 268435456 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.blob_file_starting_level: 0 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-01-13T18:03:10.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 13752, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c3a3012e-d7a4-4c16-aa0f-0d40e8278fc0 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168989706049, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168989713675, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 2009190, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 13757, "largest_seqno": 14703, "table_properties": {"data_size": 2004135, "index_size": 2888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1157, "raw_key_size": 11338, "raw_average_key_size": 25, "raw_value_size": 1994535, "raw_average_value_size": 4543, "num_data_blocks": 129, "num_entries": 439, "num_filter_entries": 439, "num_deletions": 21, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1705168989, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c3a3012e-d7a4-4c16-aa0f-0d40e8278fc0", "db_session_id": "KQCCB8FK2964NRJ2RP4Z", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1705168989713791, "job": 1, "event": "recovery_finished"} 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5622a4e36000 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: DB pointer 0x5622a4e22000 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-01-13T18:03:10.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: ** DB Stats ** 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: ** Compaction Stats [default] ** 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: L0 1/0 1.92 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 599.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: L6 1/0 9.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-01-13T18:03:10.138 INFO:journalctl@ceph.mon.b.smithi099.stdout: Sum 2/0 11.69 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 599.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 599.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: ** Compaction Stats [default] ** 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 599.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-13T18:03:10.139 INFO:journalctl@ceph.mon.b.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-13T18:03:10.140 INFO:journalctl@ceph.mon.b.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-13T18:03:10.140 INFO:journalctl@ceph.mon.b.smithi099.stdout: Cumulative compaction: 0.00 GB write, 162.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T18:03:10.140 INFO:journalctl@ceph.mon.b.smithi099.stdout: Interval compaction: 0.00 GB write, 162.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-13T18:03:10.140 INFO:journalctl@ceph.mon.b.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-13T18:03:10.140 INFO:journalctl@ceph.mon.b.smithi099.stdout: Block cache BinnedLRUCache@0x5622a4d99350#7 capacity: 512.00 MB usage: 4.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.28 KB,0.000244379%) IndexBlock(1,3.08 KB,0.000587106%) Misc(1,0.00 KB,0%) 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout: 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: starting mon.b rank 1 at public addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] at bind addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: mon.b@-1(???) e3 preinit fsid be08b996-b23c-11ee-95ac-87774f69a715 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: mon.b@-1(???).mds e8 new map 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: mon.b@-1(???).mds e8 print_map 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout: e8 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout: legacy client fscid: 1 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout: 2024-01-13T18:03:10.141 INFO:journalctl@ceph.mon.b.smithi099.stdout: Filesystem 'cephfs' (1) 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: fs_name cephfs 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: epoch 8 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: created 2024-01-13T17:58:37.204248+0000 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: modified 2024-01-13T17:58:40.826281+0000 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: tableserver 0 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: root 0 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: session_timeout 60 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: session_autoclose 300 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: max_file_size 1099511627776 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: max_xattr_size 65536 2024-01-13T18:03:10.142 INFO:journalctl@ceph.mon.b.smithi099.stdout: required_client_features {} 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: last_failure 0 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: last_failure_osd_epoch 0 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: max_mds 1 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: in 0 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: up {0=24337} 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: failed 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: damaged 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: stopped 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: data_pools [3] 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: metadata_pool 2 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: inline_data disabled 2024-01-13T18:03:10.143 INFO:journalctl@ceph.mon.b.smithi099.stdout: balancer 2024-01-13T18:03:10.144 INFO:journalctl@ceph.mon.b.smithi099.stdout: bal_rank_mask -1 2024-01-13T18:03:10.144 INFO:journalctl@ceph.mon.b.smithi099.stdout: standby_count_wanted 0 2024-01-13T18:03:10.144 INFO:journalctl@ceph.mon.b.smithi099.stdout: [mds.b{0:24337} state up:active seq 3 addr [v2:172.21.15.99:6832/2558131725,v1:172.21.15.99:6833/2558131725] compat {c=[1],r=[1],i=[7ff]}] 2024-01-13T18:03:10.144 INFO:journalctl@ceph.mon.b.smithi099.stdout: 2024-01-13T18:03:10.144 INFO:journalctl@ceph.mon.b.smithi099.stdout: 2024-01-13T18:03:10.144 INFO:journalctl@ceph.mon.b.smithi099.stdout: Standby daemons: 2024-01-13T18:03:10.144 INFO:journalctl@ceph.mon.b.smithi099.stdout: 2024-01-13T18:03:10.144 INFO:journalctl@ceph.mon.b.smithi099.stdout: [mds.a{-1:14463} state up:standby seq 1 addr [v2:172.21.15.84:6834/3944391177,v1:172.21.15.84:6835/3944391177] compat {c=[1],r=[1],i=[7ff]}] 2024-01-13T18:03:10.144 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: mon.b@-1(???).osd e214 crush map has features 3314933069573799936, adjusting msgr requires 2024-01-13T18:03:10.144 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: mon.b@-1(???).osd e214 crush map has features 432629308056666112, adjusting msgr requires 2024-01-13T18:03:10.144 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: mon.b@-1(???).osd e214 crush map has features 432629308056666112, adjusting msgr requires 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: mon.b@-1(???).osd e214 crush map has features 432629308056666112, adjusting msgr requires 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: mon.b@-1(???).paxosservice(auth 1..19) refresh upgraded, format 0 -> 3 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta expand map: {default=false} 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta from 'false' to 'false' 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta expanded map: {default=false} 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta expand map: {default=info} 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta from 'info' to 'info' 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta expanded map: {default=info} 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta expand map: {default=daemon} 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta from 'daemon' to 'daemon' 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta expanded map: {default=daemon} 2024-01-13T18:03:10.145 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta expand map: {default=debug} 2024-01-13T18:03:10.146 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta from 'debug' to 'debug' 2024-01-13T18:03:10.146 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: expand_channel_meta expanded map: {default=debug} 2024-01-13T18:03:10.146 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: failed to encode map e213 with expected crc 2024-01-13T18:03:10.146 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: pgmap v28: 121 pgs: 121 active+clean; 142 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2024-01-13T18:03:10.146 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: osdmap e214: 8 total, 8 up, 8 in 2024-01-13T18:03:10.146 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:09 smithi099 ceph-mon[138788]: failed to encode map e214 with expected crc 2024-01-13T18:03:10.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:09 smithi084 ceph-mon[119097]: failed to encode map e213 with expected crc 2024-01-13T18:03:10.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:09 smithi084 ceph-mon[119097]: pgmap v28: 121 pgs: 121 active+clean; 142 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2024-01-13T18:03:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:09 smithi084 ceph-mon[119097]: osdmap e214: 8 total, 8 up, 8 in 2024-01-13T18:03:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:09 smithi084 ceph-mon[119097]: failed to encode map e214 with expected crc 2024-01-13T18:03:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:09 smithi084 ceph-mon[116404]: failed to encode map e213 with expected crc 2024-01-13T18:03:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:09 smithi084 ceph-mon[116404]: pgmap v28: 121 pgs: 121 active+clean; 142 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2024-01-13T18:03:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:09 smithi084 ceph-mon[116404]: osdmap e214: 8 total, 8 up, 8 in 2024-01-13T18:03:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:09 smithi084 ceph-mon[116404]: failed to encode map e214 with expected crc 2024-01-13T18:03:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:03:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:03:10] "GET /metrics HTTP/1.1" 200 35945 "" "Prometheus/2.43.0" 2024-01-13T18:03:14.885 INFO:tasks.rados.rados.0.smithi084.stdout:800: done (8 left) 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:801: read oid 18 snap -1 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:801: expect (ObjNum 175 snap 49 seq_num 175) 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 75 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:786: finishing copy_from to smithi084102331-7 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 176 (ObjNum 223 snap 69 seq_num 223) dirty exists 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:786: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:791: finishing write tid 5 to smithi084102331-1 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 399 (ObjNum 249 snap 75 seq_num 249) dirty exists 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:791: left oid 1 (ObjNum 249 snap 75 seq_num 249) 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:793: finishing write tid 1 to smithi084102331-11 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:793: finishing write tid 2 to smithi084102331-11 2024-01-13T18:03:14.886 INFO:tasks.rados.rados.0.smithi084.stdout:802: seq_num 252 ranges {0=630784,630784=499712,1130496=425984,1556480=278528} 2024-01-13T18:03:14.889 INFO:tasks.rados.rados.0.smithi084.stdout:802: writing smithi084102331-41 from 0 to 630784 tid 1 2024-01-13T18:03:14.895 INFO:tasks.rados.rados.0.smithi084.stdout:802: writing smithi084102331-41 from 630784 to 1130496 tid 2 2024-01-13T18:03:14.896 INFO:tasks.rados.rados.0.smithi084.stdout:802: writing smithi084102331-41 from 1130496 to 1556480 tid 3 2024-01-13T18:03:14.897 INFO:tasks.rados.rados.0.smithi084.stdout:802: writing smithi084102331-41 from 1556480 to 1835008 tid 4 2024-01-13T18:03:14.897 INFO:tasks.rados.rados.0.smithi084.stdout:786: done (9 left) 2024-01-13T18:03:14.897 INFO:tasks.rados.rados.0.smithi084.stdout:791: done (8 left) 2024-01-13T18:03:14.897 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 75 2024-01-13T18:03:14.897 INFO:tasks.rados.rados.0.smithi084.stdout:793: finishing write tid 3 to smithi084102331-11 2024-01-13T18:03:14.898 INFO:tasks.rados.rados.0.smithi084.stdout:793: finishing write tid 4 to smithi084102331-11 2024-01-13T18:03:14.898 INFO:tasks.rados.rados.0.smithi084.stdout:793: finishing write tid 5 to smithi084102331-11 2024-01-13T18:03:14.898 INFO:tasks.rados.rados.0.smithi084.stdout:793: finishing write tid 6 to smithi084102331-11 2024-01-13T18:03:14.898 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 281 (ObjNum 250 snap 75 seq_num 250) dirty exists 2024-01-13T18:03:14.898 INFO:tasks.rados.rados.0.smithi084.stdout:793: left oid 11 (ObjNum 250 snap 75 seq_num 250) 2024-01-13T18:03:14.898 INFO:tasks.rados.rados.0.smithi084.stdout:803: seq_num 253 ranges {368640=647168,1015808=786432,1802240=417792} 2024-01-13T18:03:14.903 INFO:tasks.rados.rados.0.smithi084.stdout:803: writing smithi084102331-27 from 368640 to 1015808 tid 1 2024-01-13T18:03:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:803: writing smithi084102331-27 from 1015808 to 1802240 tid 2 2024-01-13T18:03:14.911 INFO:tasks.rados.rados.0.smithi084.stdout:803: writing smithi084102331-27 from 1802240 to 2220032 tid 3 2024-01-13T18:03:14.911 INFO:tasks.rados.rados.0.smithi084.stdout:793: done (8 left) 2024-01-13T18:03:14.911 INFO:tasks.rados.rados.0.smithi084.stdout:804: snap_create 2024-01-13T18:03:14.911 INFO:tasks.rados.rados.0.smithi084.stdout:794: expect (ObjNum 221 snap 68 seq_num 221) 2024-01-13T18:03:15.024 INFO:tasks.rados.rados.0.smithi084.stdout:795: finishing write tid 1 to smithi084102331-16 2024-01-13T18:03:15.024 INFO:tasks.rados.rados.0.smithi084.stdout:795: finishing write tid 2 to smithi084102331-16 2024-01-13T18:03:15.024 INFO:tasks.rados.rados.0.smithi084.stdout:795: finishing write tid 3 to smithi084102331-16 2024-01-13T18:03:15.024 INFO:tasks.rados.rados.0.smithi084.stdout:795: finishing write tid 4 to smithi084102331-16 2024-01-13T18:03:15.024 INFO:tasks.rados.rados.0.smithi084.stdout:795: finishing write tid 5 to smithi084102331-16 2024-01-13T18:03:15.024 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 270 (ObjNum 251 snap 75 seq_num 251) dirty exists 2024-01-13T18:03:15.024 INFO:tasks.rados.rados.0.smithi084.stdout:795: left oid 16 (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:03:15.024 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 282 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:03:15.024 INFO:tasks.rados.rados.0.smithi084.stdout:798: expect (ObjNum 212 snap 60 seq_num 212) 2024-01-13T18:03:15.051 INFO:tasks.rados.rados.0.smithi084.stdout:802: finishing write tid 1 to smithi084102331-41 2024-01-13T18:03:15.051 INFO:tasks.rados.rados.0.smithi084.stdout:802: finishing write tid 2 to smithi084102331-41 2024-01-13T18:03:15.051 INFO:tasks.rados.rados.0.smithi084.stdout:802: finishing write tid 3 to smithi084102331-41 2024-01-13T18:03:15.051 INFO:tasks.rados.rados.0.smithi084.stdout:802: finishing write tid 4 to smithi084102331-41 2024-01-13T18:03:15.051 INFO:tasks.rados.rados.0.smithi084.stdout:802: finishing write tid 5 to smithi084102331-41 2024-01-13T18:03:15.051 INFO:tasks.rados.rados.0.smithi084.stdout:802: finishing write tid 6 to smithi084102331-41 2024-01-13T18:03:15.052 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 287 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:03:15.052 INFO:tasks.rados.rados.0.smithi084.stdout:802: left oid 41 (ObjNum 252 snap 75 seq_num 252) 2024-01-13T18:03:15.052 INFO:tasks.rados.rados.0.smithi084.stdout:803: finishing write tid 1 to smithi084102331-27 2024-01-13T18:03:15.052 INFO:tasks.rados.rados.0.smithi084.stdout:803: finishing write tid 2 to smithi084102331-27 2024-01-13T18:03:15.052 INFO:tasks.rados.rados.0.smithi084.stdout:803: finishing write tid 3 to smithi084102331-27 2024-01-13T18:03:15.052 INFO:tasks.rados.rados.0.smithi084.stdout:801: expect (ObjNum 175 snap 49 seq_num 175) 2024-01-13T18:03:15.178 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:03:14.726+0000 7fcaf82a4700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: overall HEALTH_OK 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: mon.a calling monitor election 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: mon.b calling monitor election 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: pgmap v30: 121 pgs: 121 active+clean; 142 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: pgmap v31: 121 pgs: 121 active+clean; 158 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.7 MiB/s wr, 20 op/s 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: pgmap v32: 121 pgs: 121 active+clean; 158 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: monmap e4: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: osdmap e214: 8 total, 8 up, 8 in 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: mgrmap e40: y(active, since 24s), standbys: x 2024-01-13T18:03:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-01-13T18:03:15.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-01-13T18:03:15.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-01-13T18:03:15.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: mon.c (rank 2) addr [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] is down (out of quorum) 2024-01-13T18:03:15.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:15.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:15.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: overall HEALTH_OK 2024-01-13T18:03:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:03:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:03:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:03:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: mon.a calling monitor election 2024-01-13T18:03:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: mon.b calling monitor election 2024-01-13T18:03:15.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: pgmap v30: 121 pgs: 121 active+clean; 142 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2024-01-13T18:03:15.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: pgmap v31: 121 pgs: 121 active+clean; 158 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.7 MiB/s wr, 20 op/s 2024-01-13T18:03:15.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: pgmap v32: 121 pgs: 121 active+clean; 158 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2024-01-13T18:03:15.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-01-13T18:03:15.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: monmap e4: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:03:15.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:03:15.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: osdmap e214: 8 total, 8 up, 8 in 2024-01-13T18:03:15.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: mgrmap e40: y(active, since 24s), standbys: x 2024-01-13T18:03:15.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-01-13T18:03:15.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-01-13T18:03:15.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-01-13T18:03:15.371 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: mon.c (rank 2) addr [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] is down (out of quorum) 2024-01-13T18:03:15.371 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:15.371 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:15.371 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:15.374 INFO:tasks.rados.rados.0.smithi084.stdout:803: finishing write tid 4 to smithi084102331-27 2024-01-13T18:03:15.374 INFO:tasks.rados.rados.0.smithi084.stdout:803: finishing write tid 5 to smithi084102331-27 2024-01-13T18:03:15.374 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 274 (ObjNum 253 snap 75 seq_num 253) dirty exists 2024-01-13T18:03:15.374 INFO:tasks.rados.rados.0.smithi084.stdout:803: left oid 27 (ObjNum 253 snap 75 seq_num 253) 2024-01-13T18:03:15.893 INFO:tasks.rados.rados.0.smithi084.stdout:794: done (8 left) 2024-01-13T18:03:15.894 INFO:tasks.rados.rados.0.smithi084.stdout:795: done (7 left) 2024-01-13T18:03:15.894 INFO:tasks.rados.rados.0.smithi084.stdout:796: done (6 left) 2024-01-13T18:03:15.894 INFO:tasks.rados.rados.0.smithi084.stdout:797: done (5 left) 2024-01-13T18:03:15.894 INFO:tasks.rados.rados.0.smithi084.stdout:798: done (4 left) 2024-01-13T18:03:15.894 INFO:tasks.rados.rados.0.smithi084.stdout:801: done (3 left) 2024-01-13T18:03:15.894 INFO:tasks.rados.rados.0.smithi084.stdout:802: done (2 left) 2024-01-13T18:03:15.894 INFO:tasks.rados.rados.0.smithi084.stdout:803: done (1 left) 2024-01-13T18:03:15.894 INFO:tasks.rados.rados.0.smithi084.stdout:804: done (0 left) 2024-01-13T18:03:15.894 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 76 2024-01-13T18:03:15.894 INFO:tasks.rados.rados.0.smithi084.stdout:805: seq_num 254 ranges {1638400=663552,2301952=663552,2965504=540672} 2024-01-13T18:03:15.905 INFO:tasks.rados.rados.0.smithi084.stdout:805: writing smithi084102331-45 from 1638400 to 2301952 tid 1 2024-01-13T18:03:15.909 INFO:tasks.rados.rados.0.smithi084.stdout:805: writing smithi084102331-45 from 2301952 to 2965504 tid 2 2024-01-13T18:03:15.914 INFO:tasks.rados.rados.0.smithi084.stdout:805: writing smithi084102331-45 from 2965504 to 3506176 tid 3 2024-01-13T18:03:15.914 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 76 2024-01-13T18:03:15.914 INFO:tasks.rados.rados.0.smithi084.stdout:805: finishing write tid 1 to smithi084102331-45 2024-01-13T18:03:15.914 INFO:tasks.rados.rados.0.smithi084.stdout:805: finishing write tid 2 to smithi084102331-45 2024-01-13T18:03:15.914 INFO:tasks.rados.rados.0.smithi084.stdout:806: seq_num 255 ranges {6127616=679936,6807552=548864,7356416=598016,7954432=57344} 2024-01-13T18:03:15.950 INFO:tasks.rados.rados.0.smithi084.stdout:806: writing smithi084102331-10 from 6127616 to 6807552 tid 1 2024-01-13T18:03:15.953 INFO:tasks.rados.rados.0.smithi084.stdout:806: writing smithi084102331-10 from 6807552 to 7356416 tid 2 2024-01-13T18:03:15.956 INFO:tasks.rados.rados.0.smithi084.stdout:806: writing smithi084102331-10 from 7356416 to 7954432 tid 3 2024-01-13T18:03:15.957 INFO:tasks.rados.rados.0.smithi084.stdout:806: writing smithi084102331-10 from 7954432 to 8011776 tid 4 2024-01-13T18:03:15.957 INFO:tasks.rados.rados.0.smithi084.stdout:807: delete oid 7 current snap is 76 2024-01-13T18:03:15.957 INFO:tasks.rados.rados.0.smithi084.stdout:805: finishing write tid 3 to smithi084102331-45 2024-01-13T18:03:15.957 INFO:tasks.rados.rados.0.smithi084.stdout:805: finishing write tid 4 to smithi084102331-45 2024-01-13T18:03:15.957 INFO:tasks.rados.rados.0.smithi084.stdout:805: finishing write tid 5 to smithi084102331-45 2024-01-13T18:03:15.958 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 404 (ObjNum 254 snap 76 seq_num 254) dirty exists 2024-01-13T18:03:15.958 INFO:tasks.rados.rados.0.smithi084.stdout:805: left oid 45 (ObjNum 254 snap 76 seq_num 254) 2024-01-13T18:03:15.958 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 1 to smithi084102331-10 2024-01-13T18:03:15.958 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 2 to smithi084102331-10 2024-01-13T18:03:15.960 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 3 to smithi084102331-10 2024-01-13T18:03:15.960 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 4 to smithi084102331-10 2024-01-13T18:03:15.960 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 5 to smithi084102331-10 2024-01-13T18:03:15.962 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 6 to smithi084102331-10 2024-01-13T18:03:15.962 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 149 (ObjNum 255 snap 76 seq_num 255) dirty exists 2024-01-13T18:03:15.962 INFO:tasks.rados.rados.0.smithi084.stdout:806: left oid 10 (ObjNum 255 snap 76 seq_num 255) 2024-01-13T18:03:15.963 INFO:tasks.rados.rados.0.smithi084.stdout:805: done (2 left) 2024-01-13T18:03:15.963 INFO:tasks.rados.rados.0.smithi084.stdout:806: done (1 left) 2024-01-13T18:03:15.963 INFO:tasks.rados.rados.0.smithi084.stdout:807: done (0 left) 2024-01-13T18:03:15.963 INFO:tasks.rados.rados.0.smithi084.stdout:808: rmattr oid 17 current snap is 76 2024-01-13T18:03:15.963 INFO:tasks.rados.rados.0.smithi084.stdout:808: done (0 left) 2024-01-13T18:03:15.963 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 76 2024-01-13T18:03:15.963 INFO:tasks.rados.rados.0.smithi084.stdout:809: seq_num 257 ranges {2629632=712704,3342336=720896,4063232=483328} 2024-01-13T18:03:15.980 INFO:tasks.rados.rados.0.smithi084.stdout:809: writing smithi084102331-30 from 2629632 to 3342336 tid 1 2024-01-13T18:03:15.984 INFO:tasks.rados.rados.0.smithi084.stdout:809: writing smithi084102331-30 from 3342336 to 4063232 tid 2 2024-01-13T18:03:15.987 INFO:tasks.rados.rados.0.smithi084.stdout:809: writing smithi084102331-30 from 4063232 to 4546560 tid 3 2024-01-13T18:03:15.988 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 76 2024-01-13T18:03:15.988 INFO:tasks.rados.rados.0.smithi084.stdout:809: finishing write tid 1 to smithi084102331-30 2024-01-13T18:03:15.988 INFO:tasks.rados.rados.0.smithi084.stdout:809: finishing write tid 2 to smithi084102331-30 2024-01-13T18:03:15.988 INFO:tasks.rados.rados.0.smithi084.stdout:810: seq_num 258 ranges {2220032=729088,2949120=606208,3555328=598016} 2024-01-13T18:03:16.003 INFO:tasks.rados.rados.0.smithi084.stdout:810: writing smithi084102331-27 from 2220032 to 2949120 tid 1 2024-01-13T18:03:16.007 INFO:tasks.rados.rados.0.smithi084.stdout:810: writing smithi084102331-27 from 2949120 to 3555328 tid 2 2024-01-13T18:03:16.011 INFO:tasks.rados.rados.0.smithi084.stdout:810: writing smithi084102331-27 from 3555328 to 4153344 tid 3 2024-01-13T18:03:16.011 INFO:tasks.rados.rados.0.smithi084.stdout:811: delete oid 20 current snap is 76 2024-01-13T18:03:16.011 INFO:tasks.rados.rados.0.smithi084.stdout:809: finishing write tid 3 to smithi084102331-30 2024-01-13T18:03:16.011 INFO:tasks.rados.rados.0.smithi084.stdout:809: finishing write tid 4 to smithi084102331-30 2024-01-13T18:03:16.011 INFO:tasks.rados.rados.0.smithi084.stdout:809: finishing write tid 5 to smithi084102331-30 2024-01-13T18:03:16.011 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 363 (ObjNum 257 snap 76 seq_num 257) dirty exists 2024-01-13T18:03:16.011 INFO:tasks.rados.rados.0.smithi084.stdout:809: left oid 30 (ObjNum 257 snap 76 seq_num 257) 2024-01-13T18:03:16.011 INFO:tasks.rados.rados.0.smithi084.stdout:810: finishing write tid 1 to smithi084102331-27 2024-01-13T18:03:16.011 INFO:tasks.rados.rados.0.smithi084.stdout:810: finishing write tid 2 to smithi084102331-27 2024-01-13T18:03:16.011 INFO:tasks.rados.rados.0.smithi084.stdout:809: done (2 left) 2024-01-13T18:03:16.011 INFO:tasks.rados.rados.0.smithi084.stdout:811: done (1 left) 2024-01-13T18:03:16.012 INFO:tasks.rados.rados.0.smithi084.stdout:812: snap_create 2024-01-13T18:03:16.013 INFO:tasks.rados.rados.0.smithi084.stdout:810: finishing write tid 3 to smithi084102331-27 2024-01-13T18:03:16.013 INFO:tasks.rados.rados.0.smithi084.stdout:810: finishing write tid 4 to smithi084102331-27 2024-01-13T18:03:16.014 INFO:tasks.rados.rados.0.smithi084.stdout:810: finishing write tid 5 to smithi084102331-27 2024-01-13T18:03:16.014 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 278 (ObjNum 258 snap 76 seq_num 258) dirty exists 2024-01-13T18:03:16.014 INFO:tasks.rados.rados.0.smithi084.stdout:810: left oid 27 (ObjNum 258 snap 76 seq_num 258) 2024-01-13T18:03:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:15 smithi084 ceph-mon[116404]: failed to encode map e215 with expected crc 2024-01-13T18:03:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:15 smithi084 ceph-mon[116404]: osdmap e215: 8 total, 8 up, 8 in 2024-01-13T18:03:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:15 smithi084 ceph-mon[116404]: failed to encode map e215 with expected crc 2024-01-13T18:03:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:15 smithi099 ceph-mon[138788]: failed to encode map e215 with expected crc 2024-01-13T18:03:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:15 smithi099 ceph-mon[138788]: osdmap e215: 8 total, 8 up, 8 in 2024-01-13T18:03:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:15 smithi099 ceph-mon[138788]: failed to encode map e215 with expected crc 2024-01-13T18:03:16.899 INFO:tasks.rados.rados.0.smithi084.stdout:810: done (1 left) 2024-01-13T18:03:16.900 INFO:tasks.rados.rados.0.smithi084.stdout:812: done (0 left) 2024-01-13T18:03:16.900 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 77 2024-01-13T18:03:16.900 INFO:tasks.rados.rados.0.smithi084.stdout:813: seq_num 260 ranges {2981888=761856,3743744=417792,4161536=786432} 2024-01-13T18:03:16.919 INFO:tasks.rados.rados.0.smithi084.stdout:813: writing smithi084102331-13 from 2981888 to 3743744 tid 1 2024-01-13T18:03:16.922 INFO:tasks.rados.rados.0.smithi084.stdout:813: writing smithi084102331-13 from 3743744 to 4161536 tid 2 2024-01-13T18:03:16.927 INFO:tasks.rados.rados.0.smithi084.stdout:813: writing smithi084102331-13 from 4161536 to 4947968 tid 3 2024-01-13T18:03:16.927 INFO:tasks.rados.rados.0.smithi084.stdout:814: delete oid 50 current snap is 77 2024-01-13T18:03:16.927 INFO:tasks.rados.rados.0.smithi084.stdout:813: finishing write tid 1 to smithi084102331-13 2024-01-13T18:03:16.927 INFO:tasks.rados.rados.0.smithi084.stdout:813: finishing write tid 2 to smithi084102331-13 2024-01-13T18:03:16.929 INFO:tasks.rados.rados.0.smithi084.stdout:814: done (1 left) 2024-01-13T18:03:16.929 INFO:tasks.rados.rados.0.smithi084.stdout:815: rollback oid 21 current snap is 77 2024-01-13T18:03:16.929 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 74 2024-01-13T18:03:16.929 INFO:tasks.rados.rados.0.smithi084.stdout:816: snap_remove snap 75 2024-01-13T18:03:17.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:16 smithi084 ceph-mon[116404]: failed to encode map e216 with expected crc 2024-01-13T18:03:17.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:16 smithi084 ceph-mon[116404]: osdmap e216: 8 total, 8 up, 8 in 2024-01-13T18:03:17.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:16 smithi084 ceph-mon[116404]: failed to encode map e216 with expected crc 2024-01-13T18:03:17.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:16 smithi084 ceph-mon[116404]: failed to encode map e216 with expected crc 2024-01-13T18:03:17.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:16 smithi084 ceph-mon[116404]: pgmap v35: 121 pgs: 121 active+clean; 165 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.1 MiB/s rd, 3.1 MiB/s wr, 19 op/s 2024-01-13T18:03:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:16 smithi099 ceph-mon[138788]: failed to encode map e216 with expected crc 2024-01-13T18:03:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:16 smithi099 ceph-mon[138788]: osdmap e216: 8 total, 8 up, 8 in 2024-01-13T18:03:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:16 smithi099 ceph-mon[138788]: failed to encode map e216 with expected crc 2024-01-13T18:03:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:16 smithi099 ceph-mon[138788]: failed to encode map e216 with expected crc 2024-01-13T18:03:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:16 smithi099 ceph-mon[138788]: pgmap v35: 121 pgs: 121 active+clean; 165 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.1 MiB/s rd, 3.1 MiB/s wr, 19 op/s 2024-01-13T18:03:17.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: overall HEALTH_OK 2024-01-13T18:03:17.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-13T18:03:17.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: mon.a calling monitor election 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: mon.b calling monitor election 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: pgmap v30: 121 pgs: 121 active+clean; 142 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: pgmap v31: 121 pgs: 121 active+clean; 158 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.7 MiB/s wr, 20 op/s 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: pgmap v32: 121 pgs: 121 active+clean; 158 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: monmap e4: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: osdmap e214: 8 total, 8 up, 8 in 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: mgrmap e40: y(active, since 24s), standbys: x 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-01-13T18:03:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: mon.c (rank 2) addr [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] is down (out of quorum) 2024-01-13T18:03:17.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:17.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:17.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:17.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: failed to encode map e215 with expected crc 2024-01-13T18:03:17.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: osdmap e215: 8 total, 8 up, 8 in 2024-01-13T18:03:17.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: failed to encode map e215 with expected crc 2024-01-13T18:03:17.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: failed to encode map e216 with expected crc 2024-01-13T18:03:17.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: osdmap e216: 8 total, 8 up, 8 in 2024-01-13T18:03:17.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: failed to encode map e216 with expected crc 2024-01-13T18:03:17.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: failed to encode map e216 with expected crc 2024-01-13T18:03:17.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: pgmap v35: 121 pgs: 121 active+clean; 165 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.1 MiB/s rd, 3.1 MiB/s wr, 19 op/s 2024-01-13T18:03:17.564 INFO:tasks.rados.rados.0.smithi084.stdout:816: done (2 left) 2024-01-13T18:03:17.564 INFO:tasks.rados.rados.0.smithi084.stdout:817: snap_create 2024-01-13T18:03:17.564 INFO:tasks.rados.rados.0.smithi084.stdout:813: finishing write tid 3 to smithi084102331-13 2024-01-13T18:03:17.564 INFO:tasks.rados.rados.0.smithi084.stdout:813: finishing write tid 4 to smithi084102331-13 2024-01-13T18:03:17.564 INFO:tasks.rados.rados.0.smithi084.stdout:813: finishing write tid 5 to smithi084102331-13 2024-01-13T18:03:17.564 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 219 (ObjNum 260 snap 77 seq_num 260) dirty exists 2024-01-13T18:03:17.564 INFO:tasks.rados.rados.0.smithi084.stdout:813: left oid 13 (ObjNum 260 snap 77 seq_num 260) 2024-01-13T18:03:17.564 INFO:tasks.rados.rados.0.smithi084.stdout:815: finishing rollback tid 0 to smithi084102331-21 2024-01-13T18:03:17.564 INFO:tasks.rados.rados.0.smithi084.stdout:815: finishing rollback tid 1 to smithi084102331-21 2024-01-13T18:03:17.564 INFO:tasks.rados.rados.0.smithi084.stdout:815: finishing rollback tid 2 to smithi084102331-21 2024-01-13T18:03:17.564 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 240 (ObjNum 202 snap 55 seq_num 202) dirty exists 2024-01-13T18:03:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: mon.c calling monitor election 2024-01-13T18:03:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: failed to encode map e217 with expected crc 2024-01-13T18:03:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: mon.a calling monitor election 2024-01-13T18:03:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: mon.b calling monitor election 2024-01-13T18:03:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T18:03:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: monmap e4: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:03:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:03:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: osdmap e217: 8 total, 8 up, 8 in 2024-01-13T18:03:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: mgrmap e40: y(active, since 27s), standbys: x 2024-01-13T18:03:18.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-01-13T18:03:18.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:03:18.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: overall HEALTH_OK 2024-01-13T18:03:18.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: failed to encode map e218 with expected crc 2024-01-13T18:03:18.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: osdmap e218: 8 total, 8 up, 8 in 2024-01-13T18:03:18.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:18.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:18.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: mon.c calling monitor election 2024-01-13T18:03:18.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: failed to encode map e217 with expected crc 2024-01-13T18:03:18.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: mon.a calling monitor election 2024-01-13T18:03:18.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: mon.b calling monitor election 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: monmap e4: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: osdmap e217: 8 total, 8 up, 8 in 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: mgrmap e40: y(active, since 27s), standbys: x 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: overall HEALTH_OK 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: failed to encode map e218 with expected crc 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: osdmap e218: 8 total, 8 up, 8 in 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:18.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:17 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: mon.c calling monitor election 2024-01-13T18:03:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: failed to encode map e217 with expected crc 2024-01-13T18:03:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: mon.a calling monitor election 2024-01-13T18:03:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: mon.b calling monitor election 2024-01-13T18:03:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-01-13T18:03:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: monmap e4: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-13T18:03:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:03:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: osdmap e217: 8 total, 8 up, 8 in 2024-01-13T18:03:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: mgrmap e40: y(active, since 27s), standbys: x 2024-01-13T18:03:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-01-13T18:03:18.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:03:18.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: overall HEALTH_OK 2024-01-13T18:03:18.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: failed to encode map e218 with expected crc 2024-01-13T18:03:18.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: osdmap e218: 8 total, 8 up, 8 in 2024-01-13T18:03:18.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:18.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:17 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:18.565 INFO:tasks.rados.rados.0.smithi084.stdout:813: done (2 left) 2024-01-13T18:03:18.566 INFO:tasks.rados.rados.0.smithi084.stdout:815: done (1 left) 2024-01-13T18:03:18.566 INFO:tasks.rados.rados.0.smithi084.stdout:817: done (0 left) 2024-01-13T18:03:18.566 INFO:tasks.rados.rados.0.smithi084.stdout:818: read oid 46 snap -1 2024-01-13T18:03:18.566 INFO:tasks.rados.rados.0.smithi084.stdout:818: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:03:18.566 INFO:tasks.rados.rados.0.smithi084.stdout:819: delete oid 8 current snap is 78 2024-01-13T18:03:18.571 INFO:tasks.rados.rados.0.smithi084.stdout:819: done (1 left) 2024-01-13T18:03:18.572 INFO:tasks.rados.rados.0.smithi084.stdout:820: snap_create 2024-01-13T18:03:18.577 INFO:tasks.rados.rados.0.smithi084.stdout:818: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:03:19.002 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:03:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:03:18.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:03:19.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:19 smithi099 ceph-mon[138788]: failed to encode map e218 with expected crc 2024-01-13T18:03:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:19 smithi099 ceph-mon[138788]: pgmap v38: 121 pgs: 121 active+clean; 165 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:03:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:19 smithi099 ceph-mon[138788]: failed to encode map e219 with expected crc 2024-01-13T18:03:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:19 smithi099 ceph-mon[138788]: osdmap e219: 8 total, 8 up, 8 in 2024-01-13T18:03:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:19 smithi099 ceph-mon[138788]: failed to encode map e219 with expected crc 2024-01-13T18:03:19.566 INFO:tasks.rados.rados.0.smithi084.stdout:818: done (1 left) 2024-01-13T18:03:19.566 INFO:tasks.rados.rados.0.smithi084.stdout:820: done (0 left) 2024-01-13T18:03:19.567 INFO:tasks.rados.rados.0.smithi084.stdout:821: setattr oid 42 current snap is 79 2024-01-13T18:03:19.567 INFO:tasks.rados.rados.0.smithi084.stdout:822: delete oid 12 current snap is 79 2024-01-13T18:03:19.576 INFO:tasks.rados.rados.0.smithi084.stdout:822: done (1 left) 2024-01-13T18:03:19.576 INFO:tasks.rados.rados.0.smithi084.stdout:823: read oid 16 snap 53 2024-01-13T18:03:19.576 INFO:tasks.rados.rados.0.smithi084.stdout:823: expect (ObjNum 109 snap 27 seq_num 109) 2024-01-13T18:03:19.576 INFO:tasks.rados.rados.0.smithi084.stdout:824: rollback oid 44 current snap is 79 2024-01-13T18:03:19.576 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 74 2024-01-13T18:03:19.576 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 256 (ObjNum 192 snap 54 seq_num 192) dirty exists 2024-01-13T18:03:19.576 INFO:tasks.rados.rados.0.smithi084.stdout:821: done (2 left) 2024-01-13T18:03:19.576 INFO:tasks.rados.rados.0.smithi084.stdout:825: rollback oid 14 current snap is 79 2024-01-13T18:03:19.576 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 53 2024-01-13T18:03:19.576 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 79 2024-01-13T18:03:19.576 INFO:tasks.rados.rados.0.smithi084.stdout:826: seq_num 264 ranges {0=425984,425984=761856,1187840=770048,1957888=73728} 2024-01-13T18:03:19.577 INFO:tasks.rados.rados.0.smithi084.stdout:826: writing smithi084102331-20 from 0 to 425984 tid 1 2024-01-13T18:03:19.585 INFO:tasks.rados.rados.0.smithi084.stdout:826: writing smithi084102331-20 from 425984 to 1187840 tid 2 2024-01-13T18:03:19.588 INFO:tasks.rados.rados.0.smithi084.stdout:826: writing smithi084102331-20 from 1187840 to 1957888 tid 3 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:826: writing smithi084102331-20 from 1957888 to 2031616 tid 4 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:827: rollback oid 11 current snap is 79 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 11 to 69 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:824: finishing rollback tid 0 to smithi084102331-44 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:825: finishing rollback tid 1 to smithi084102331-14 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 0 (ObjNum 721 snap 0 seq_num 2814418496) dirty dne 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:824: finishing rollback tid 1 to smithi084102331-44 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 324 (ObjNum 593 snap 0 seq_num 4037807320) dirty dne 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:826: finishing write tid 1 to smithi084102331-20 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:824: done (4 left) 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:825: done (3 left) 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:828: read oid 7 snap -1 2024-01-13T18:03:19.589 INFO:tasks.rados.rados.0.smithi084.stdout:828: expect deleted 2024-01-13T18:03:19.590 INFO:tasks.rados.rados.0.smithi084.stdout:829: snap_create 2024-01-13T18:03:19.590 INFO:tasks.rados.rados.0.smithi084.stdout:826: finishing write tid 2 to smithi084102331-20 2024-01-13T18:03:19.591 INFO:tasks.rados.rados.0.smithi084.stdout:827: finishing rollback tid 0 to smithi084102331-11 2024-01-13T18:03:19.591 INFO:tasks.rados.rados.0.smithi084.stdout:827: finishing rollback tid 1 to smithi084102331-11 2024-01-13T18:03:19.591 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 289 (ObjNum 49 snap 0 seq_num 1953066355) dirty dne 2024-01-13T18:03:19.593 INFO:tasks.rados.rados.0.smithi084.stdout:826: finishing write tid 3 to smithi084102331-20 2024-01-13T18:03:19.593 INFO:tasks.rados.rados.0.smithi084.stdout:826: finishing write tid 4 to smithi084102331-20 2024-01-13T18:03:19.593 INFO:tasks.rados.rados.0.smithi084.stdout:826: finishing write tid 5 to smithi084102331-20 2024-01-13T18:03:19.596 INFO:tasks.rados.rados.0.smithi084.stdout:826: finishing write tid 6 to smithi084102331-20 2024-01-13T18:03:19.596 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 133 (ObjNum 264 snap 79 seq_num 264) dirty exists 2024-01-13T18:03:19.596 INFO:tasks.rados.rados.0.smithi084.stdout:826: left oid 20 (ObjNum 264 snap 79 seq_num 264) 2024-01-13T18:03:19.606 INFO:tasks.rados.rados.0.smithi084.stdout:823: expect (ObjNum 109 snap 27 seq_num 109) 2024-01-13T18:03:19.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[116404]: failed to encode map e218 with expected crc 2024-01-13T18:03:19.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[116404]: pgmap v38: 121 pgs: 121 active+clean; 165 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:03:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[116404]: failed to encode map e219 with expected crc 2024-01-13T18:03:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[116404]: osdmap e219: 8 total, 8 up, 8 in 2024-01-13T18:03:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[116404]: failed to encode map e219 with expected crc 2024-01-13T18:03:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[119097]: failed to encode map e218 with expected crc 2024-01-13T18:03:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[119097]: pgmap v38: 121 pgs: 121 active+clean; 165 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:03:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[119097]: failed to encode map e219 with expected crc 2024-01-13T18:03:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[119097]: osdmap e219: 8 total, 8 up, 8 in 2024-01-13T18:03:19.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:19 smithi084 ceph-mon[119097]: failed to encode map e219 with expected crc 2024-01-13T18:03:20.568 INFO:tasks.rados.rados.0.smithi084.stdout:823: done (4 left) 2024-01-13T18:03:20.569 INFO:tasks.rados.rados.0.smithi084.stdout:826: done (3 left) 2024-01-13T18:03:20.569 INFO:tasks.rados.rados.0.smithi084.stdout:827: done (2 left) 2024-01-13T18:03:20.569 INFO:tasks.rados.rados.0.smithi084.stdout:828: done (1 left) 2024-01-13T18:03:20.569 INFO:tasks.rados.rados.0.smithi084.stdout:829: done (0 left) 2024-01-13T18:03:20.569 INFO:tasks.rados.rados.0.smithi084.stdout:830: snap_remove snap 78 2024-01-13T18:03:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:20 smithi099 ceph-mon[138788]: failed to encode map e219 with expected crc 2024-01-13T18:03:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:20 smithi099 ceph-mon[138788]: osdmap e220: 8 total, 8 up, 8 in 2024-01-13T18:03:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:20 smithi099 ceph-mon[138788]: failed to encode map e220 with expected crc 2024-01-13T18:03:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:20 smithi099 ceph-mon[138788]: failed to encode map e220 with expected crc 2024-01-13T18:03:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:03:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:03:20] "GET /metrics HTTP/1.1" 200 36005 "" "Prometheus/2.43.0" 2024-01-13T18:03:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:20 smithi084 ceph-mon[116404]: failed to encode map e219 with expected crc 2024-01-13T18:03:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:20 smithi084 ceph-mon[116404]: osdmap e220: 8 total, 8 up, 8 in 2024-01-13T18:03:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:20 smithi084 ceph-mon[116404]: failed to encode map e220 with expected crc 2024-01-13T18:03:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:20 smithi084 ceph-mon[116404]: failed to encode map e220 with expected crc 2024-01-13T18:03:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:20 smithi084 ceph-mon[119097]: failed to encode map e219 with expected crc 2024-01-13T18:03:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:20 smithi084 ceph-mon[119097]: osdmap e220: 8 total, 8 up, 8 in 2024-01-13T18:03:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:20 smithi084 ceph-mon[119097]: failed to encode map e220 with expected crc 2024-01-13T18:03:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:20 smithi084 ceph-mon[119097]: failed to encode map e220 with expected crc 2024-01-13T18:03:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: failed to encode map e219 with expected crc 2024-01-13T18:03:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: failed to encode map e220 with expected crc 2024-01-13T18:03:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: failed to encode map e219 with expected crc 2024-01-13T18:03:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: pgmap v41: 121 pgs: 121 active+clean; 165 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:03:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: failed to encode map e221 with expected crc 2024-01-13T18:03:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: failed to encode map e221 with expected crc 2024-01-13T18:03:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: osdmap e221: 8 total, 8 up, 8 in 2024-01-13T18:03:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: failed to encode map e219 with expected crc 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: failed to encode map e220 with expected crc 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: failed to encode map e219 with expected crc 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: pgmap v41: 121 pgs: 121 active+clean; 165 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: failed to encode map e221 with expected crc 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: failed to encode map e221 with expected crc 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: osdmap e221: 8 total, 8 up, 8 in 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:03:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:21.569 INFO:tasks.rados.rados.0.smithi084.stdout:830: done (0 left) 2024-01-13T18:03:21.570 INFO:tasks.rados.rados.0.smithi084.stdout:831: rmattr oid 41 current snap is 80 2024-01-13T18:03:21.570 INFO:tasks.rados.rados.0.smithi084.stdout:831: done (0 left) 2024-01-13T18:03:21.570 INFO:tasks.rados.rados.0.smithi084.stdout:832: snap_remove snap 54 2024-01-13T18:03:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: failed to encode map e219 with expected crc 2024-01-13T18:03:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: failed to encode map e220 with expected crc 2024-01-13T18:03:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: failed to encode map e219 with expected crc 2024-01-13T18:03:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: pgmap v41: 121 pgs: 121 active+clean; 165 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:03:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: failed to encode map e221 with expected crc 2024-01-13T18:03:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: failed to encode map e221 with expected crc 2024-01-13T18:03:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: osdmap e221: 8 total, 8 up, 8 in 2024-01-13T18:03:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:21.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:21.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:03:21.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:21.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:21.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:21.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:22.139 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:03:22.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[116404]: Reconfiguring mon.a (monmap changed)... 2024-01-13T18:03:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[116404]: Reconfiguring daemon mon.a on smithi084 2024-01-13T18:03:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[116404]: failed to encode map e222 with expected crc 2024-01-13T18:03:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[116404]: osdmap e222: 8 total, 8 up, 8 in 2024-01-13T18:03:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:03:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:03:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[116404]: failed to encode map e222 with expected crc 2024-01-13T18:03:22.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[119097]: Reconfiguring mon.a (monmap changed)... 2024-01-13T18:03:22.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[119097]: Reconfiguring daemon mon.a on smithi084 2024-01-13T18:03:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[119097]: failed to encode map e222 with expected crc 2024-01-13T18:03:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[119097]: osdmap e222: 8 total, 8 up, 8 in 2024-01-13T18:03:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:03:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:03:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:22.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:22 smithi084 ceph-mon[119097]: failed to encode map e222 with expected crc 2024-01-13T18:03:22.471 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:03:22.471 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (89s) 19s ago 4m 16.5M - 0.25.0 c8568f914cd2 a5cbc3e01ffb 2024-01-13T18:03:22.471 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (75s) 4s ago 3m 79.4M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:03:22.471 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (4m) 19s ago 4m 15.3M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:03:22.471 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (4m) 4s ago 4m 20.0M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:03:22.471 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (50s) 4s ago 7m 447M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:03:22.471 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (70s) 19s ago 8m 498M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:03:22.471 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (40s) 19s ago 8m 54.3M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d b64908c7a53c 2024-01-13T18:03:22.471 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (12s) 4s ago 7m 23.8M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d be7bb477ea53 2024-01-13T18:03:22.471 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (21s) 19s ago 7m 21.8M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d e13f01b852ff 2024-01-13T18:03:22.471 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (88s) 19s ago 3m 9605k - 1.5.0 0da6a335fe13 b72e6d50f165 2024-01-13T18:03:22.472 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (73s) 4s ago 3m 8514k - 1.5.0 0da6a335fe13 e9f879b5e55b 2024-01-13T18:03:22.472 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (7m) 19s ago 7m 294M 2488M 17.2.7-268-g6441305d c3a232f785d8 809287996fef 2024-01-13T18:03:22.472 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (6m) 19s ago 6m 241M 2488M 17.2.7-268-g6441305d c3a232f785d8 fad77ee705d8 2024-01-13T18:03:22.472 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (6m) 19s ago 6m 237M 2488M 17.2.7-268-g6441305d c3a232f785d8 14025770cf00 2024-01-13T18:03:22.472 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (6m) 19s ago 6m 214M 2488M 17.2.7-268-g6441305d c3a232f785d8 068cf98fa99c 2024-01-13T18:03:22.472 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (5m) 4s ago 5m 272M 2488M 17.2.7-268-g6441305d c3a232f785d8 30e0722550a0 2024-01-13T18:03:22.472 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (5m) 4s ago 5m 268M 2488M 17.2.7-268-g6441305d c3a232f785d8 51be805dde78 2024-01-13T18:03:22.472 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (5m) 4s ago 5m 198M 2488M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:03:22.472 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (5m) 4s ago 5m 144M 2488M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:03:22.472 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (53s) 4s ago 4m 48.2M - 2.43.0 a07b618ecd1d cb4c11bf6eec 2024-01-13T18:03:22.574 INFO:tasks.rados.rados.0.smithi084.stdout:832: done (0 left) 2024-01-13T18:03:22.574 INFO:tasks.rados.rados.0.smithi084.stdout:833: setattr oid 11 current snap is 80 2024-01-13T18:03:22.576 INFO:tasks.rados.rados.0.smithi084.stdout:834: rmattr oid 31 current snap is 80 2024-01-13T18:03:22.576 INFO:tasks.rados.rados.0.smithi084.stdout:834: done (1 left) 2024-01-13T18:03:22.576 INFO:tasks.rados.rados.0.smithi084.stdout:835: rollback oid 42 current snap is 80 2024-01-13T18:03:22.576 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 66 2024-01-13T18:03:22.576 INFO:tasks.rados.rados.0.smithi084.stdout:836: rollback oid 38 current snap is 80 2024-01-13T18:03:22.576 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 79 2024-01-13T18:03:22.576 INFO:tasks.rados.rados.0.smithi084.stdout:837: snap_create 2024-01-13T18:03:22.584 INFO:tasks.rados.rados.0.smithi084.stdout:836: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:03:22.584 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 267 (ObjNum 33 snap 0 seq_num 4037808864) dirty dne 2024-01-13T18:03:22.586 INFO:tasks.rados.rados.0.smithi084.stdout:835: finishing rollback tid 0 to smithi084102331-42 2024-01-13T18:03:22.593 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 290 (ObjNum 49 snap 0 seq_num 4036707504) dirty exists 2024-01-13T18:03:22.596 INFO:tasks.rados.rados.0.smithi084.stdout:835: finishing rollback tid 1 to smithi084102331-42 2024-01-13T18:03:22.596 INFO:tasks.rados.rados.0.smithi084.stdout:835: finishing rollback tid 2 to smithi084102331-42 2024-01-13T18:03:22.596 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 259 (ObjNum 146 snap 40 seq_num 146) dirty exists 2024-01-13T18:03:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:22 smithi099 ceph-mon[138788]: Reconfiguring mon.a (monmap changed)... 2024-01-13T18:03:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:22 smithi099 ceph-mon[138788]: Reconfiguring daemon mon.a on smithi084 2024-01-13T18:03:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:22 smithi099 ceph-mon[138788]: failed to encode map e222 with expected crc 2024-01-13T18:03:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:22 smithi099 ceph-mon[138788]: osdmap e222: 8 total, 8 up, 8 in 2024-01-13T18:03:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:03:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:03:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:22.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:22 smithi099 ceph-mon[138788]: failed to encode map e222 with expected crc 2024-01-13T18:03:22.894 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:03:22.894 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:03:22.894 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:03:22.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:03:22.894 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:03:22.894 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:03:22.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:03:22.894 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:03:22.894 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 8 2024-01-13T18:03:22.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:03:22.894 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:03:22.895 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:03:22.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:03:22.895 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:03:22.895 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 10, 2024-01-13T18:03:22.895 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 5 2024-01-13T18:03:22.895 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:03:22.895 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:03:23.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: failed to encode map e222 with expected crc 2024-01-13T18:03:23.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: Reconfiguring mgr.y (monmap changed)... 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: Reconfiguring daemon mgr.y on smithi084 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: pgmap v44: 121 pgs: 121 active+clean; 170 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: failed to encode map e222 with expected crc 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: from='client.34161 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: failed to encode map e223 with expected crc 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: failed to encode map e223 with expected crc 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: osdmap e223: 8 total, 8 up, 8 in 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: failed to encode map e223 with expected crc 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:23.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/321504058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: failed to encode map e222 with expected crc 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: Reconfiguring mgr.y (monmap changed)... 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: Reconfiguring daemon mgr.y on smithi084 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: pgmap v44: 121 pgs: 121 active+clean; 170 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: failed to encode map e222 with expected crc 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: from='client.34161 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: failed to encode map e223 with expected crc 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: failed to encode map e223 with expected crc 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: osdmap e223: 8 total, 8 up, 8 in 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: failed to encode map e223 with expected crc 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:23.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:23.398 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:23.398 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:23.398 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:23.398 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:23 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/321504058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:23.582 INFO:tasks.rados.rados.0.smithi084.stdout:833: done (3 left) 2024-01-13T18:03:23.582 INFO:tasks.rados.rados.0.smithi084.stdout:835: done (2 left) 2024-01-13T18:03:23.583 INFO:tasks.rados.rados.0.smithi084.stdout:836: done (1 left) 2024-01-13T18:03:23.583 INFO:tasks.rados.rados.0.smithi084.stdout:837: done (0 left) 2024-01-13T18:03:23.583 INFO:tasks.rados.rados.0.smithi084.stdout:838: rollback oid 43 current snap is 81 2024-01-13T18:03:23.583 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 66 2024-01-13T18:03:23.583 INFO:tasks.rados.rados.0.smithi084.stdout:839: snap_create 2024-01-13T18:03:23.589 INFO:tasks.rados.rados.0.smithi084.stdout:838: finishing rollback tid 0 to smithi084102331-43 2024-01-13T18:03:23.589 INFO:tasks.rados.rados.0.smithi084.stdout:838: finishing rollback tid 1 to smithi084102331-43 2024-01-13T18:03:23.589 INFO:tasks.rados.rados.0.smithi084.stdout:838: finishing rollback tid 2 to smithi084102331-43 2024-01-13T18:03:23.589 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 213 (ObjNum 195 snap 54 seq_num 195) dirty exists 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: failed to encode map e222 with expected crc 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: Reconfiguring mgr.y (monmap changed)... 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: Reconfiguring daemon mgr.y on smithi084 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: pgmap v44: 121 pgs: 121 active+clean; 170 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: failed to encode map e222 with expected crc 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: from='client.34161 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: failed to encode map e223 with expected crc 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: failed to encode map e223 with expected crc 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: osdmap e223: 8 total, 8 up, 8 in 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: failed to encode map e223 with expected crc 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:23.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:23.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:23.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:23 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/321504058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:24.584 INFO:tasks.rados.rados.0.smithi084.stdout:838: done (1 left) 2024-01-13T18:03:24.584 INFO:tasks.rados.rados.0.smithi084.stdout:839: done (0 left) 2024-01-13T18:03:24.584 INFO:tasks.rados.rados.0.smithi084.stdout:840: rmattr oid 29 current snap is 82 2024-01-13T18:03:24.584 INFO:tasks.rados.rados.0.smithi084.stdout:840: done (0 left) 2024-01-13T18:03:24.584 INFO:tasks.rados.rados.0.smithi084.stdout:841: snap_create 2024-01-13T18:03:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:24 smithi099 ceph-mon[138788]: from='client.34167 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:24 smithi099 ceph-mon[138788]: failed to encode map e223 with expected crc 2024-01-13T18:03:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:24 smithi099 ceph-mon[138788]: Reconfiguring mon.c (monmap changed)... 2024-01-13T18:03:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:24 smithi099 ceph-mon[138788]: Reconfiguring daemon mon.c on smithi084 2024-01-13T18:03:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:24 smithi099 ceph-mon[138788]: failed to encode map e224 with expected crc 2024-01-13T18:03:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:24 smithi099 ceph-mon[138788]: failed to encode map e224 with expected crc 2024-01-13T18:03:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:24 smithi099 ceph-mon[138788]: osdmap e224: 8 total, 8 up, 8 in 2024-01-13T18:03:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:24 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:24 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:24.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:24 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-13T18:03:24.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:24 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:24.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[116404]: from='client.34167 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:24.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[116404]: failed to encode map e223 with expected crc 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[116404]: Reconfiguring mon.c (monmap changed)... 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[116404]: Reconfiguring daemon mon.c on smithi084 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[116404]: failed to encode map e224 with expected crc 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[116404]: failed to encode map e224 with expected crc 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[116404]: osdmap e224: 8 total, 8 up, 8 in 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[119097]: from='client.34167 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[119097]: failed to encode map e223 with expected crc 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[119097]: Reconfiguring mon.c (monmap changed)... 2024-01-13T18:03:24.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[119097]: Reconfiguring daemon mon.c on smithi084 2024-01-13T18:03:24.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[119097]: failed to encode map e224 with expected crc 2024-01-13T18:03:24.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[119097]: failed to encode map e224 with expected crc 2024-01-13T18:03:24.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[119097]: osdmap e224: 8 total, 8 up, 8 in 2024-01-13T18:03:24.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:24.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:24.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-13T18:03:24.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:24 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:25.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: failed to encode map e224 with expected crc 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: Reconfiguring osd.0 (monmap changed)... 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: Reconfiguring daemon osd.0 on smithi084 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: pgmap v47: 121 pgs: 121 active+clean; 170 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: failed to encode map e225 with expected crc 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: failed to encode map e225 with expected crc 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: osdmap e225: 8 total, 8 up, 8 in 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[116404]: failed to encode map e225 with expected crc 2024-01-13T18:03:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: failed to encode map e224 with expected crc 2024-01-13T18:03:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: Reconfiguring osd.0 (monmap changed)... 2024-01-13T18:03:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: Reconfiguring daemon osd.0 on smithi084 2024-01-13T18:03:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: pgmap v47: 121 pgs: 121 active+clean; 170 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2024-01-13T18:03:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: failed to encode map e225 with expected crc 2024-01-13T18:03:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: failed to encode map e225 with expected crc 2024-01-13T18:03:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: osdmap e225: 8 total, 8 up, 8 in 2024-01-13T18:03:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-13T18:03:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:25 smithi084 ceph-mon[119097]: failed to encode map e225 with expected crc 2024-01-13T18:03:25.579 INFO:tasks.rados.rados.0.smithi084.stdout:841: done (0 left) 2024-01-13T18:03:25.579 INFO:tasks.rados.rados.0.smithi084.stdout:842: delete oid 33 current snap is 83 2024-01-13T18:03:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:842: done (0 left) 2024-01-13T18:03:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:843: setattr oid 48 current snap is 83 2024-01-13T18:03:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 83 2024-01-13T18:03:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:844: seq_num 266 ranges {1597440=458752,2056192=524288,2580480=729088,3309568=352256} 2024-01-13T18:03:25.599 INFO:tasks.rados.rados.0.smithi084.stdout:844: writing smithi084102331-2 from 1597440 to 2056192 tid 1 2024-01-13T18:03:25.602 INFO:tasks.rados.rados.0.smithi084.stdout:844: writing smithi084102331-2 from 2056192 to 2580480 tid 2 2024-01-13T18:03:25.606 INFO:tasks.rados.rados.0.smithi084.stdout:844: writing smithi084102331-2 from 2580480 to 3309568 tid 3 2024-01-13T18:03:25.609 INFO:tasks.rados.rados.0.smithi084.stdout:844: writing smithi084102331-2 from 3309568 to 3661824 tid 4 2024-01-13T18:03:25.609 INFO:tasks.rados.rados.0.smithi084.stdout:845: read oid 37 snap -1 2024-01-13T18:03:25.609 INFO:tasks.rados.rados.0.smithi084.stdout:845: expect (ObjNum 221 snap 68 seq_num 221) 2024-01-13T18:03:25.609 INFO:tasks.rados.rados.0.smithi084.stdout:846: copy_from oid 40 from oid 33 current snap is 83 2024-01-13T18:03:25.609 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 318 (ObjNum 247 snap 74 seq_num 247) dirty exists 2024-01-13T18:03:25.609 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 1 to smithi084102331-2 2024-01-13T18:03:25.609 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 2 to smithi084102331-2 2024-01-13T18:03:25.609 INFO:tasks.rados.rados.0.smithi084.stdout:843: done (3 left) 2024-01-13T18:03:25.609 INFO:tasks.rados.rados.0.smithi084.stdout:847: snap_remove snap 53 2024-01-13T18:03:25.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: failed to encode map e224 with expected crc 2024-01-13T18:03:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: Reconfiguring osd.0 (monmap changed)... 2024-01-13T18:03:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: Reconfiguring daemon osd.0 on smithi084 2024-01-13T18:03:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: pgmap v47: 121 pgs: 121 active+clean; 170 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2024-01-13T18:03:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: failed to encode map e225 with expected crc 2024-01-13T18:03:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: failed to encode map e225 with expected crc 2024-01-13T18:03:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: osdmap e225: 8 total, 8 up, 8 in 2024-01-13T18:03:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-13T18:03:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:25 smithi099 ceph-mon[138788]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: Reconfiguring osd.1 (monmap changed)... 2024-01-13T18:03:26.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: Reconfiguring daemon osd.1 on smithi084 2024-01-13T18:03:26.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: failed to encode map e226 with expected crc 2024-01-13T18:03:26.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: osdmap e226: 8 total, 8 up, 8 in 2024-01-13T18:03:26.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:26.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: Reconfiguring osd.1 (monmap changed)... 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: Reconfiguring daemon osd.1 on smithi084 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: failed to encode map e226 with expected crc 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: osdmap e226: 8 total, 8 up, 8 in 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:26.396 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-13T18:03:26.397 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:847: done (3 left) 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:848: setattr oid 27 current snap is 83 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 3 to smithi084102331-2 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 4 to smithi084102331-2 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 5 to smithi084102331-2 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:846: finishing copy_from to smithi084102331-40 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:846: got expected ENOENT (src dne) 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:846: finishing copy_from racing read to smithi084102331-40 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 6 to smithi084102331-2 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 324 (ObjNum 266 snap 83 seq_num 266) dirty exists 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:844: left oid 2 (ObjNum 266 snap 83 seq_num 266) 2024-01-13T18:03:26.582 INFO:tasks.rados.rados.0.smithi084.stdout:845: expect (ObjNum 221 snap 68 seq_num 221) 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: Reconfiguring osd.1 (monmap changed)... 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: Reconfiguring daemon osd.1 on smithi084 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: failed to encode map e225 with expected crc 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: failed to encode map e226 with expected crc 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: osdmap e226: 8 total, 8 up, 8 in 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-13T18:03:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:26.710 INFO:tasks.rados.rados.0.smithi084.stdout:844: done (3 left) 2024-01-13T18:03:26.710 INFO:tasks.rados.rados.0.smithi084.stdout:845: done (2 left) 2024-01-13T18:03:26.710 INFO:tasks.rados.rados.0.smithi084.stdout:846: done (1 left) 2024-01-13T18:03:26.710 INFO:tasks.rados.rados.0.smithi084.stdout:849: snap_create 2024-01-13T18:03:26.713 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 279 (ObjNum 258 snap 76 seq_num 258) dirty exists 2024-01-13T18:03:27.303 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[116404]: failed to encode map e226 with expected crc 2024-01-13T18:03:27.303 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[116404]: failed to encode map e226 with expected crc 2024-01-13T18:03:27.303 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[116404]: Reconfiguring osd.2 (monmap changed)... 2024-01-13T18:03:27.303 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[116404]: Reconfiguring daemon osd.2 on smithi084 2024-01-13T18:03:27.303 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[116404]: pgmap v50: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.4 MiB/s rd, 504 KiB/s wr, 13 op/s 2024-01-13T18:03:27.303 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[116404]: failed to encode map e227 with expected crc 2024-01-13T18:03:27.303 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[116404]: osdmap e227: 8 total, 8 up, 8 in 2024-01-13T18:03:27.303 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:27.303 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:27.304 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-13T18:03:27.304 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:27.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[119097]: failed to encode map e226 with expected crc 2024-01-13T18:03:27.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[119097]: failed to encode map e226 with expected crc 2024-01-13T18:03:27.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[119097]: Reconfiguring osd.2 (monmap changed)... 2024-01-13T18:03:27.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[119097]: Reconfiguring daemon osd.2 on smithi084 2024-01-13T18:03:27.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[119097]: pgmap v50: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.4 MiB/s rd, 504 KiB/s wr, 13 op/s 2024-01-13T18:03:27.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[119097]: failed to encode map e227 with expected crc 2024-01-13T18:03:27.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[119097]: osdmap e227: 8 total, 8 up, 8 in 2024-01-13T18:03:27.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:27.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:27.305 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-13T18:03:27.305 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:27.567 INFO:tasks.rados.rados.0.smithi084.stdout:848: done (1 left) 2024-01-13T18:03:27.568 INFO:tasks.rados.rados.0.smithi084.stdout:849: done (0 left) 2024-01-13T18:03:27.568 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 84 2024-01-13T18:03:27.568 INFO:tasks.rados.rados.0.smithi084.stdout:850: seq_num 267 ranges {3334144=475136,3809280=458752,4268032=540672,4808704=606208} 2024-01-13T18:03:27.588 INFO:tasks.rados.rados.0.smithi084.stdout:850: writing smithi084102331-37 from 3334144 to 3809280 tid 1 2024-01-13T18:03:27.591 INFO:tasks.rados.rados.0.smithi084.stdout:850: writing smithi084102331-37 from 3809280 to 4268032 tid 2 2024-01-13T18:03:27.594 INFO:tasks.rados.rados.0.smithi084.stdout:850: writing smithi084102331-37 from 4268032 to 4808704 tid 3 2024-01-13T18:03:27.598 INFO:tasks.rados.rados.0.smithi084.stdout:850: writing smithi084102331-37 from 4808704 to 5414912 tid 4 2024-01-13T18:03:27.598 INFO:tasks.rados.rados.0.smithi084.stdout:851: snap_create 2024-01-13T18:03:27.602 INFO:tasks.rados.rados.0.smithi084.stdout:850: finishing write tid 1 to smithi084102331-37 2024-01-13T18:03:27.602 INFO:tasks.rados.rados.0.smithi084.stdout:850: finishing write tid 2 to smithi084102331-37 2024-01-13T18:03:27.602 INFO:tasks.rados.rados.0.smithi084.stdout:850: finishing write tid 3 to smithi084102331-37 2024-01-13T18:03:27.602 INFO:tasks.rados.rados.0.smithi084.stdout:850: finishing write tid 4 to smithi084102331-37 2024-01-13T18:03:27.602 INFO:tasks.rados.rados.0.smithi084.stdout:850: finishing write tid 5 to smithi084102331-37 2024-01-13T18:03:27.603 INFO:tasks.rados.rados.0.smithi084.stdout:850: finishing write tid 6 to smithi084102331-37 2024-01-13T18:03:27.603 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 395 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-01-13T18:03:27.603 INFO:tasks.rados.rados.0.smithi084.stdout:850: left oid 37 (ObjNum 267 snap 84 seq_num 267) 2024-01-13T18:03:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:27 smithi099 ceph-mon[138788]: failed to encode map e226 with expected crc 2024-01-13T18:03:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:27 smithi099 ceph-mon[138788]: failed to encode map e226 with expected crc 2024-01-13T18:03:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:27 smithi099 ceph-mon[138788]: Reconfiguring osd.2 (monmap changed)... 2024-01-13T18:03:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:27 smithi099 ceph-mon[138788]: Reconfiguring daemon osd.2 on smithi084 2024-01-13T18:03:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:27 smithi099 ceph-mon[138788]: pgmap v50: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.4 MiB/s rd, 504 KiB/s wr, 13 op/s 2024-01-13T18:03:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:27 smithi099 ceph-mon[138788]: failed to encode map e227 with expected crc 2024-01-13T18:03:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:27 smithi099 ceph-mon[138788]: osdmap e227: 8 total, 8 up, 8 in 2024-01-13T18:03:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-13T18:03:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:28.597 INFO:tasks.rados.rados.0.smithi084.stdout:850: done (1 left) 2024-01-13T18:03:28.597 INFO:tasks.rados.rados.0.smithi084.stdout:851: done (0 left) 2024-01-13T18:03:28.597 INFO:tasks.rados.rados.0.smithi084.stdout:852: read oid 11 snap 79 2024-01-13T18:03:28.598 INFO:tasks.rados.rados.0.smithi084.stdout:852: expect deleted 2024-01-13T18:03:28.598 INFO:tasks.rados.rados.0.smithi084.stdout:853: snap_create 2024-01-13T18:03:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-mon[138788]: failed to encode map e227 with expected crc 2024-01-13T18:03:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-mon[138788]: Reconfiguring osd.3 (monmap changed)... 2024-01-13T18:03:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-mon[138788]: Reconfiguring daemon osd.3 on smithi084 2024-01-13T18:03:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-mon[138788]: failed to encode map e228 with expected crc 2024-01-13T18:03:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-mon[138788]: failed to encode map e228 with expected crc 2024-01-13T18:03:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-mon[138788]: osdmap e228: 8 total, 8 up, 8 in 2024-01-13T18:03:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:03:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-mon[138788]: failed to encode map e228 with expected crc 2024-01-13T18:03:28.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[116404]: failed to encode map e227 with expected crc 2024-01-13T18:03:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[116404]: Reconfiguring osd.3 (monmap changed)... 2024-01-13T18:03:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[116404]: Reconfiguring daemon osd.3 on smithi084 2024-01-13T18:03:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[116404]: failed to encode map e228 with expected crc 2024-01-13T18:03:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[116404]: failed to encode map e228 with expected crc 2024-01-13T18:03:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[116404]: osdmap e228: 8 total, 8 up, 8 in 2024-01-13T18:03:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:03:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[116404]: failed to encode map e228 with expected crc 2024-01-13T18:03:28.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[119097]: failed to encode map e227 with expected crc 2024-01-13T18:03:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[119097]: Reconfiguring osd.3 (monmap changed)... 2024-01-13T18:03:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[119097]: Reconfiguring daemon osd.3 on smithi084 2024-01-13T18:03:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[119097]: failed to encode map e228 with expected crc 2024-01-13T18:03:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[119097]: failed to encode map e228 with expected crc 2024-01-13T18:03:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[119097]: osdmap e228: 8 total, 8 up, 8 in 2024-01-13T18:03:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:03:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:28 smithi084 ceph-mon[119097]: failed to encode map e228 with expected crc 2024-01-13T18:03:28.913 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:03:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:03:28.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:03:29.605 INFO:tasks.rados.rados.0.smithi084.stdout:852: done (1 left) 2024-01-13T18:03:29.605 INFO:tasks.rados.rados.0.smithi084.stdout:853: done (0 left) 2024-01-13T18:03:29.605 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 86 2024-01-13T18:03:29.605 INFO:tasks.rados.rados.0.smithi084.stdout:854: seq_num 268 ranges {8011776=491520,8503296=745472,9248768=745472,9994240=114688} 2024-01-13T18:03:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: failed to encode map e228 with expected crc 2024-01-13T18:03:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: Reconfiguring mds.a (monmap changed)... 2024-01-13T18:03:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: Reconfiguring daemon mds.a on smithi084 2024-01-13T18:03:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: pgmap v53: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.4 MiB/s rd, 504 KiB/s wr, 13 op/s 2024-01-13T18:03:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: failed to encode map e228 with expected crc 2024-01-13T18:03:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: failed to encode map e229 with expected crc 2024-01-13T18:03:29.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: failed to encode map e229 with expected crc 2024-01-13T18:03:29.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: osdmap e229: 8 total, 8 up, 8 in 2024-01-13T18:03:29.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:29 smithi099 ceph-mon[138788]: failed to encode map e229 with expected crc 2024-01-13T18:03:29.650 INFO:tasks.rados.rados.0.smithi084.stdout:854: writing smithi084102331-10 from 8011776 to 8503296 tid 1 2024-01-13T18:03:29.654 INFO:tasks.rados.rados.0.smithi084.stdout:854: writing smithi084102331-10 from 8503296 to 9248768 tid 2 2024-01-13T18:03:29.659 INFO:tasks.rados.rados.0.smithi084.stdout:854: writing smithi084102331-10 from 9248768 to 9994240 tid 3 2024-01-13T18:03:29.660 INFO:tasks.rados.rados.0.smithi084.stdout:854: writing smithi084102331-10 from 9994240 to 10108928 tid 4 2024-01-13T18:03:29.660 INFO:tasks.rados.rados.0.smithi084.stdout:855: copy_from oid 5 from oid 16 current snap is 86 2024-01-13T18:03:29.660 INFO:tasks.rados.rados.0.smithi084.stdout:854: finishing write tid 1 to smithi084102331-10 2024-01-13T18:03:29.660 INFO:tasks.rados.rados.0.smithi084.stdout:854: finishing write tid 2 to smithi084102331-10 2024-01-13T18:03:29.660 INFO:tasks.rados.rados.0.smithi084.stdout:856: copy_from oid 36 from oid 3 current snap is 86 2024-01-13T18:03:29.660 INFO:tasks.rados.rados.0.smithi084.stdout:857: read oid 6 snap -1 2024-01-13T18:03:29.660 INFO:tasks.rados.rados.0.smithi084.stdout:857: expect (ObjNum 235 snap 71 seq_num 235) 2024-01-13T18:03:29.660 INFO:tasks.rados.rados.0.smithi084.stdout:858: read oid 47 snap -1 2024-01-13T18:03:29.660 INFO:tasks.rados.rados.0.smithi084.stdout:858: expect (ObjNum 127 snap 32 seq_num 127) 2024-01-13T18:03:29.661 INFO:tasks.rados.rados.0.smithi084.stdout:859: delete oid 44 current snap is 86 2024-01-13T18:03:29.662 INFO:tasks.rados.rados.0.smithi084.stdout:854: finishing write tid 3 to smithi084102331-10 2024-01-13T18:03:29.662 INFO:tasks.rados.rados.0.smithi084.stdout:854: finishing write tid 4 to smithi084102331-10 2024-01-13T18:03:29.665 INFO:tasks.rados.rados.0.smithi084.stdout:854: finishing write tid 5 to smithi084102331-10 2024-01-13T18:03:29.667 INFO:tasks.rados.rados.0.smithi084.stdout:854: finishing write tid 6 to smithi084102331-10 2024-01-13T18:03:29.667 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 154 (ObjNum 268 snap 86 seq_num 268) dirty exists 2024-01-13T18:03:29.668 INFO:tasks.rados.rados.0.smithi084.stdout:854: left oid 10 (ObjNum 268 snap 86 seq_num 268) 2024-01-13T18:03:29.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: failed to encode map e228 with expected crc 2024-01-13T18:03:29.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: Reconfiguring mds.a (monmap changed)... 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: Reconfiguring daemon mds.a on smithi084 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: pgmap v53: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.4 MiB/s rd, 504 KiB/s wr, 13 op/s 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: failed to encode map e228 with expected crc 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: failed to encode map e229 with expected crc 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: failed to encode map e229 with expected crc 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: osdmap e229: 8 total, 8 up, 8 in 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[116404]: failed to encode map e229 with expected crc 2024-01-13T18:03:29.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: failed to encode map e228 with expected crc 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: Reconfiguring mds.a (monmap changed)... 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: Reconfiguring daemon mds.a on smithi084 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: pgmap v53: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 2.4 MiB/s rd, 504 KiB/s wr, 13 op/s 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: failed to encode map e228 with expected crc 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: failed to encode map e229 with expected crc 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: failed to encode map e229 with expected crc 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: osdmap e229: 8 total, 8 up, 8 in 2024-01-13T18:03:29.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:29 smithi084 ceph-mon[119097]: failed to encode map e229 with expected crc 2024-01-13T18:03:29.681 INFO:tasks.rados.rados.0.smithi084.stdout:856: finishing copy_from to smithi084102331-36 2024-01-13T18:03:29.681 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 324 (ObjNum 215 snap 61 seq_num 215) dirty exists 2024-01-13T18:03:29.682 INFO:tasks.rados.rados.0.smithi084.stdout:856: finishing copy_from racing read to smithi084102331-36 2024-01-13T18:03:29.685 INFO:tasks.rados.rados.0.smithi084.stdout:858: expect (ObjNum 127 snap 32 seq_num 127) 2024-01-13T18:03:29.815 INFO:tasks.rados.rados.0.smithi084.stdout:854: done (5 left) 2024-01-13T18:03:29.815 INFO:tasks.rados.rados.0.smithi084.stdout:856: done (4 left) 2024-01-13T18:03:29.815 INFO:tasks.rados.rados.0.smithi084.stdout:858: done (3 left) 2024-01-13T18:03:29.815 INFO:tasks.rados.rados.0.smithi084.stdout:859: done (2 left) 2024-01-13T18:03:29.816 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 86 2024-01-13T18:03:29.816 INFO:tasks.rados.rados.0.smithi084.stdout:857: expect (ObjNum 235 snap 71 seq_num 235) 2024-01-13T18:03:30.016 INFO:tasks.rados.rados.0.smithi084.stdout:855: finishing copy_from to smithi084102331-5 2024-01-13T18:03:30.016 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 270 (ObjNum 251 snap 75 seq_num 251) dirty exists 2024-01-13T18:03:30.016 INFO:tasks.rados.rados.0.smithi084.stdout:855: finishing copy_from racing read to smithi084102331-5 2024-01-13T18:03:30.016 INFO:tasks.rados.rados.0.smithi084.stdout:860: seq_num 270 ranges {1630208=524288,2154496=516096,2670592=761856,3432448=327680} 2024-01-13T18:03:30.027 INFO:tasks.rados.rados.0.smithi084.stdout:860: writing smithi084102331-35 from 1630208 to 2154496 tid 1 2024-01-13T18:03:30.030 INFO:tasks.rados.rados.0.smithi084.stdout:860: writing smithi084102331-35 from 2154496 to 2670592 tid 2 2024-01-13T18:03:30.035 INFO:tasks.rados.rados.0.smithi084.stdout:860: writing smithi084102331-35 from 2670592 to 3432448 tid 3 2024-01-13T18:03:30.037 INFO:tasks.rados.rados.0.smithi084.stdout:860: writing smithi084102331-35 from 3432448 to 3760128 tid 4 2024-01-13T18:03:30.037 INFO:tasks.rados.rados.0.smithi084.stdout:855: done (2 left) 2024-01-13T18:03:30.037 INFO:tasks.rados.rados.0.smithi084.stdout:857: done (1 left) 2024-01-13T18:03:30.038 INFO:tasks.rados.rados.0.smithi084.stdout:861: rollback oid 47 current snap is 86 2024-01-13T18:03:30.038 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 82 2024-01-13T18:03:30.038 INFO:tasks.rados.rados.0.smithi084.stdout:862: setattr oid 44 current snap is 86 2024-01-13T18:03:30.038 INFO:tasks.rados.rados.0.smithi084.stdout:860: finishing write tid 1 to smithi084102331-35 2024-01-13T18:03:30.038 INFO:tasks.rados.rados.0.smithi084.stdout:860: finishing write tid 2 to smithi084102331-35 2024-01-13T18:03:30.038 INFO:tasks.rados.rados.0.smithi084.stdout:863: snap_remove snap 63 2024-01-13T18:03:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: failed to encode map e228 with expected crc 2024-01-13T18:03:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: Reconfiguring mon.b (monmap changed)... 2024-01-13T18:03:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: Reconfiguring daemon mon.b on smithi099 2024-01-13T18:03:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: failed to encode map e230 with expected crc 2024-01-13T18:03:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: osdmap e230: 8 total, 8 up, 8 in 2024-01-13T18:03:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: failed to encode map e230 with expected crc 2024-01-13T18:03:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: failed to encode map e230 with expected crc 2024-01-13T18:03:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:30.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:03:30.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:03:30.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:03:30] "GET /metrics HTTP/1.1" 200 36005 "" "Prometheus/2.43.0" 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: failed to encode map e228 with expected crc 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: Reconfiguring mon.b (monmap changed)... 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: Reconfiguring daemon mon.b on smithi099 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: failed to encode map e230 with expected crc 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: osdmap e230: 8 total, 8 up, 8 in 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: failed to encode map e230 with expected crc 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: failed to encode map e230 with expected crc 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:03:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: failed to encode map e228 with expected crc 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: Reconfiguring mon.b (monmap changed)... 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: Reconfiguring daemon mon.b on smithi099 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: failed to encode map e230 with expected crc 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: osdmap e230: 8 total, 8 up, 8 in 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: failed to encode map e230 with expected crc 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: failed to encode map e230 with expected crc 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-13T18:03:30.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:863: done (3 left) 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:864: snap_create 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:860: finishing write tid 3 to smithi084102331-35 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:860: finishing write tid 4 to smithi084102331-35 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:860: finishing write tid 5 to smithi084102331-35 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:861: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:860: finishing write tid 6 to smithi084102331-35 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 264 (ObjNum 270 snap 86 seq_num 270) dirty exists 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:860: left oid 35 (ObjNum 270 snap 86 seq_num 270) 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:861: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:861: finishing rollback tid 2 to smithi084102331-47 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 343 (ObjNum 127 snap 32 seq_num 127) dirty exists 2024-01-13T18:03:30.707 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 344 (ObjNum 129 snap 0 seq_num 4038744792) dirty exists 2024-01-13T18:03:31.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:31 smithi099 ceph-mon[138788]: failed to encode map e230 with expected crc 2024-01-13T18:03:31.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:31 smithi099 ceph-mon[138788]: failed to encode map e230 with expected crc 2024-01-13T18:03:31.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:31 smithi099 ceph-mon[138788]: Reconfiguring mgr.x (monmap changed)... 2024-01-13T18:03:31.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:31 smithi099 ceph-mon[138788]: Reconfiguring daemon mgr.x on smithi099 2024-01-13T18:03:31.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:31 smithi099 ceph-mon[138788]: pgmap v56: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:03:31.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:31.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:31.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-13T18:03:31.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:31.348 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:31 smithi099 ceph-mon[138788]: osdmap e231: 8 total, 8 up, 8 in 2024-01-13T18:03:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[116404]: failed to encode map e230 with expected crc 2024-01-13T18:03:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[116404]: failed to encode map e230 with expected crc 2024-01-13T18:03:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[116404]: Reconfiguring mgr.x (monmap changed)... 2024-01-13T18:03:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[116404]: Reconfiguring daemon mgr.x on smithi099 2024-01-13T18:03:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[116404]: pgmap v56: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:03:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-13T18:03:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[116404]: osdmap e231: 8 total, 8 up, 8 in 2024-01-13T18:03:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[119097]: failed to encode map e230 with expected crc 2024-01-13T18:03:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[119097]: failed to encode map e230 with expected crc 2024-01-13T18:03:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[119097]: Reconfiguring mgr.x (monmap changed)... 2024-01-13T18:03:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[119097]: Reconfiguring daemon mgr.x on smithi099 2024-01-13T18:03:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[119097]: pgmap v56: 121 pgs: 121 active+clean; 167 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:03:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-13T18:03:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:31 smithi084 ceph-mon[119097]: osdmap e231: 8 total, 8 up, 8 in 2024-01-13T18:03:31.709 INFO:tasks.rados.rados.0.smithi084.stdout:860: done (3 left) 2024-01-13T18:03:31.709 INFO:tasks.rados.rados.0.smithi084.stdout:861: done (2 left) 2024-01-13T18:03:31.709 INFO:tasks.rados.rados.0.smithi084.stdout:862: done (1 left) 2024-01-13T18:03:31.709 INFO:tasks.rados.rados.0.smithi084.stdout:864: done (0 left) 2024-01-13T18:03:31.709 INFO:tasks.rados.rados.0.smithi084.stdout:865: rmattr oid 17 current snap is 87 2024-01-13T18:03:31.709 INFO:tasks.rados.rados.0.smithi084.stdout:865: done (0 left) 2024-01-13T18:03:31.709 INFO:tasks.rados.rados.0.smithi084.stdout:866: read oid 48 snap -1 2024-01-13T18:03:31.709 INFO:tasks.rados.rados.0.smithi084.stdout:866: expect (ObjNum 247 snap 74 seq_num 247) 2024-01-13T18:03:31.709 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 87 2024-01-13T18:03:31.709 INFO:tasks.rados.rados.0.smithi084.stdout:867: seq_num 271 ranges {0=540672,540672=802816,1343488=516096,1859584=286720} 2024-01-13T18:03:31.712 INFO:tasks.rados.rados.0.smithi084.stdout:867: writing smithi084102331-26 from 0 to 540672 tid 1 2024-01-13T18:03:31.717 INFO:tasks.rados.rados.0.smithi084.stdout:867: writing smithi084102331-26 from 540672 to 1343488 tid 2 2024-01-13T18:03:31.720 INFO:tasks.rados.rados.0.smithi084.stdout:867: writing smithi084102331-26 from 1343488 to 1859584 tid 3 2024-01-13T18:03:31.722 INFO:tasks.rados.rados.0.smithi084.stdout:867: writing smithi084102331-26 from 1859584 to 2146304 tid 4 2024-01-13T18:03:31.722 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 87 2024-01-13T18:03:31.722 INFO:tasks.rados.rados.0.smithi084.stdout:867: finishing write tid 1 to smithi084102331-26 2024-01-13T18:03:31.723 INFO:tasks.rados.rados.0.smithi084.stdout:868: seq_num 272 ranges {10108928=565248,10674176=688128,11362304=729088,12091392=188416} 2024-01-13T18:03:31.779 INFO:tasks.rados.rados.0.smithi084.stdout:868: writing smithi084102331-10 from 10108928 to 10674176 tid 1 2024-01-13T18:03:31.783 INFO:tasks.rados.rados.0.smithi084.stdout:868: writing smithi084102331-10 from 10674176 to 11362304 tid 2 2024-01-13T18:03:31.787 INFO:tasks.rados.rados.0.smithi084.stdout:868: writing smithi084102331-10 from 11362304 to 12091392 tid 3 2024-01-13T18:03:31.788 INFO:tasks.rados.rados.0.smithi084.stdout:868: writing smithi084102331-10 from 12091392 to 12279808 tid 4 2024-01-13T18:03:31.788 INFO:tasks.rados.rados.0.smithi084.stdout:869: delete oid 31 current snap is 87 2024-01-13T18:03:31.789 INFO:tasks.rados.rados.0.smithi084.stdout:867: finishing write tid 2 to smithi084102331-26 2024-01-13T18:03:31.789 INFO:tasks.rados.rados.0.smithi084.stdout:867: finishing write tid 3 to smithi084102331-26 2024-01-13T18:03:31.789 INFO:tasks.rados.rados.0.smithi084.stdout:866: expect (ObjNum 247 snap 74 seq_num 247) 2024-01-13T18:03:31.865 INFO:tasks.rados.rados.0.smithi084.stdout:867: finishing write tid 4 to smithi084102331-26 2024-01-13T18:03:31.865 INFO:tasks.rados.rados.0.smithi084.stdout:867: finishing write tid 5 to smithi084102331-26 2024-01-13T18:03:31.865 INFO:tasks.rados.rados.0.smithi084.stdout:867: finishing write tid 6 to smithi084102331-26 2024-01-13T18:03:31.865 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 329 (ObjNum 271 snap 87 seq_num 271) dirty exists 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:867: left oid 26 (ObjNum 271 snap 87 seq_num 271) 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:868: finishing write tid 1 to smithi084102331-10 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:868: finishing write tid 2 to smithi084102331-10 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:866: done (3 left) 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:867: done (2 left) 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:869: done (1 left) 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:870: read oid 41 snap -1 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:870: expect (ObjNum 252 snap 75 seq_num 252) 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 87 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:868: finishing write tid 3 to smithi084102331-10 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:868: finishing write tid 4 to smithi084102331-10 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:868: finishing write tid 5 to smithi084102331-10 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:868: finishing write tid 6 to smithi084102331-10 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 159 (ObjNum 272 snap 87 seq_num 272) dirty exists 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:868: left oid 10 (ObjNum 272 snap 87 seq_num 272) 2024-01-13T18:03:31.866 INFO:tasks.rados.rados.0.smithi084.stdout:871: seq_num 274 ranges {0=598016,598016=499712,1097728=745472,1843200=360448} 2024-01-13T18:03:31.868 INFO:tasks.rados.rados.0.smithi084.stdout:871: writing smithi084102331-29 from 0 to 598016 tid 1 2024-01-13T18:03:31.871 INFO:tasks.rados.rados.0.smithi084.stdout:871: writing smithi084102331-29 from 598016 to 1097728 tid 2 2024-01-13T18:03:31.875 INFO:tasks.rados.rados.0.smithi084.stdout:871: writing smithi084102331-29 from 1097728 to 1843200 tid 3 2024-01-13T18:03:31.877 INFO:tasks.rados.rados.0.smithi084.stdout:871: writing smithi084102331-29 from 1843200 to 2203648 tid 4 2024-01-13T18:03:31.877 INFO:tasks.rados.rados.0.smithi084.stdout:868: done (2 left) 2024-01-13T18:03:31.877 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 87 2024-01-13T18:03:31.877 INFO:tasks.rados.rados.0.smithi084.stdout:872: seq_num 275 ranges {4808704=614400,5423104=786432,6209536=499712,6709248=319488} 2024-01-13T18:03:31.906 INFO:tasks.rados.rados.0.smithi084.stdout:872: writing smithi084102331-6 from 4808704 to 5423104 tid 1 2024-01-13T18:03:31.910 INFO:tasks.rados.rados.0.smithi084.stdout:872: writing smithi084102331-6 from 5423104 to 6209536 tid 2 2024-01-13T18:03:31.913 INFO:tasks.rados.rados.0.smithi084.stdout:872: writing smithi084102331-6 from 6209536 to 6709248 tid 3 2024-01-13T18:03:31.915 INFO:tasks.rados.rados.0.smithi084.stdout:872: writing smithi084102331-6 from 6709248 to 7028736 tid 4 2024-01-13T18:03:31.915 INFO:tasks.rados.rados.0.smithi084.stdout:873: delete oid 39 current snap is 87 2024-01-13T18:03:31.915 INFO:tasks.rados.rados.0.smithi084.stdout:871: finishing write tid 1 to smithi084102331-29 2024-01-13T18:03:31.915 INFO:tasks.rados.rados.0.smithi084.stdout:871: finishing write tid 2 to smithi084102331-29 2024-01-13T18:03:31.915 INFO:tasks.rados.rados.0.smithi084.stdout:870: expect (ObjNum 252 snap 75 seq_num 252) 2024-01-13T18:03:31.961 INFO:tasks.rados.rados.0.smithi084.stdout:871: finishing write tid 3 to smithi084102331-29 2024-01-13T18:03:31.961 INFO:tasks.rados.rados.0.smithi084.stdout:871: finishing write tid 4 to smithi084102331-29 2024-01-13T18:03:31.961 INFO:tasks.rados.rados.0.smithi084.stdout:871: finishing write tid 5 to smithi084102331-29 2024-01-13T18:03:31.961 INFO:tasks.rados.rados.0.smithi084.stdout:870: done (3 left) 2024-01-13T18:03:31.961 INFO:tasks.rados.rados.0.smithi084.stdout:873: done (2 left) 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 87 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:871: finishing write tid 6 to smithi084102331-29 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 275 (ObjNum 274 snap 87 seq_num 274) dirty exists 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:871: left oid 29 (ObjNum 274 snap 87 seq_num 274) 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:872: finishing write tid 1 to smithi084102331-6 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:872: finishing write tid 2 to smithi084102331-6 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:872: finishing write tid 3 to smithi084102331-6 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:872: finishing write tid 4 to smithi084102331-6 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:872: finishing write tid 5 to smithi084102331-6 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:872: finishing write tid 6 to smithi084102331-6 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 252 (ObjNum 275 snap 87 seq_num 275) dirty exists 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:872: left oid 6 (ObjNum 275 snap 87 seq_num 275) 2024-01-13T18:03:31.962 INFO:tasks.rados.rados.0.smithi084.stdout:874: seq_num 277 ranges {12279808=647168,12926976=557056,13484032=516096,14000128=532480} 2024-01-13T18:03:32.028 INFO:tasks.rados.rados.0.smithi084.stdout:874: writing smithi084102331-10 from 12279808 to 12926976 tid 1 2024-01-13T18:03:32.031 INFO:tasks.rados.rados.0.smithi084.stdout:874: writing smithi084102331-10 from 12926976 to 13484032 tid 2 2024-01-13T18:03:32.034 INFO:tasks.rados.rados.0.smithi084.stdout:874: writing smithi084102331-10 from 13484032 to 14000128 tid 3 2024-01-13T18:03:32.038 INFO:tasks.rados.rados.0.smithi084.stdout:874: writing smithi084102331-10 from 14000128 to 14532608 tid 4 2024-01-13T18:03:32.038 INFO:tasks.rados.rados.0.smithi084.stdout:871: done (2 left) 2024-01-13T18:03:32.038 INFO:tasks.rados.rados.0.smithi084.stdout:872: done (1 left) 2024-01-13T18:03:32.038 INFO:tasks.rados.rados.0.smithi084.stdout:875: copy_from oid 45 from oid 48 current snap is 87 2024-01-13T18:03:32.038 INFO:tasks.rados.rados.0.smithi084.stdout:874: finishing write tid 1 to smithi084102331-10 2024-01-13T18:03:32.038 INFO:tasks.rados.rados.0.smithi084.stdout:874: finishing write tid 2 to smithi084102331-10 2024-01-13T18:03:32.038 INFO:tasks.rados.rados.0.smithi084.stdout:874: finishing write tid 3 to smithi084102331-10 2024-01-13T18:03:32.038 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 87 2024-01-13T18:03:32.038 INFO:tasks.rados.rados.0.smithi084.stdout:876: seq_num 278 ranges {0=663552,663552=442368,1105920=720896,1826816=442368} 2024-01-13T18:03:32.042 INFO:tasks.rados.rados.0.smithi084.stdout:876: writing smithi084102331-50 from 0 to 663552 tid 1 2024-01-13T18:03:32.044 INFO:tasks.rados.rados.0.smithi084.stdout:876: writing smithi084102331-50 from 663552 to 1105920 tid 2 2024-01-13T18:03:32.049 INFO:tasks.rados.rados.0.smithi084.stdout:876: writing smithi084102331-50 from 1105920 to 1826816 tid 3 2024-01-13T18:03:32.052 INFO:tasks.rados.rados.0.smithi084.stdout:876: writing smithi084102331-50 from 1826816 to 2269184 tid 4 2024-01-13T18:03:32.052 INFO:tasks.rados.rados.0.smithi084.stdout:877: delete oid 19 current snap is 87 2024-01-13T18:03:32.052 INFO:tasks.rados.rados.0.smithi084.stdout:874: finishing write tid 4 to smithi084102331-10 2024-01-13T18:03:32.052 INFO:tasks.rados.rados.0.smithi084.stdout:874: finishing write tid 5 to smithi084102331-10 2024-01-13T18:03:32.052 INFO:tasks.rados.rados.0.smithi084.stdout:874: finishing write tid 6 to smithi084102331-10 2024-01-13T18:03:32.052 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 164 (ObjNum 277 snap 87 seq_num 277) dirty exists 2024-01-13T18:03:32.052 INFO:tasks.rados.rados.0.smithi084.stdout:874: left oid 10 (ObjNum 277 snap 87 seq_num 277) 2024-01-13T18:03:32.052 INFO:tasks.rados.rados.0.smithi084.stdout:876: finishing write tid 1 to smithi084102331-50 2024-01-13T18:03:32.052 INFO:tasks.rados.rados.0.smithi084.stdout:876: finishing write tid 2 to smithi084102331-50 2024-01-13T18:03:32.052 INFO:tasks.rados.rados.0.smithi084.stdout:875: finishing copy_from to smithi084102331-45 2024-01-13T18:03:32.053 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 318 (ObjNum 247 snap 74 seq_num 247) dirty exists 2024-01-13T18:03:32.053 INFO:tasks.rados.rados.0.smithi084.stdout:875: finishing copy_from racing read to smithi084102331-45 2024-01-13T18:03:32.054 INFO:tasks.rados.rados.0.smithi084.stdout:876: finishing write tid 3 to smithi084102331-50 2024-01-13T18:03:32.054 INFO:tasks.rados.rados.0.smithi084.stdout:874: done (3 left) 2024-01-13T18:03:32.054 INFO:tasks.rados.rados.0.smithi084.stdout:875: done (2 left) 2024-01-13T18:03:32.054 INFO:tasks.rados.rados.0.smithi084.stdout:877: done (1 left) 2024-01-13T18:03:32.054 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 87 2024-01-13T18:03:32.054 INFO:tasks.rados.rados.0.smithi084.stdout:878: seq_num 280 ranges {3842048=696320,4538368=606208,5144576=688128,5832704=311296} 2024-01-13T18:03:32.077 INFO:tasks.rados.rados.0.smithi084.stdout:878: writing smithi084102331-47 from 3842048 to 4538368 tid 1 2024-01-13T18:03:32.081 INFO:tasks.rados.rados.0.smithi084.stdout:878: writing smithi084102331-47 from 4538368 to 5144576 tid 2 2024-01-13T18:03:32.085 INFO:tasks.rados.rados.0.smithi084.stdout:878: writing smithi084102331-47 from 5144576 to 5832704 tid 3 2024-01-13T18:03:32.087 INFO:tasks.rados.rados.0.smithi084.stdout:878: writing smithi084102331-47 from 5832704 to 6144000 tid 4 2024-01-13T18:03:32.087 INFO:tasks.rados.rados.0.smithi084.stdout:879: snap_create 2024-01-13T18:03:32.087 INFO:tasks.rados.rados.0.smithi084.stdout:876: finishing write tid 4 to smithi084102331-50 2024-01-13T18:03:32.087 INFO:tasks.rados.rados.0.smithi084.stdout:876: finishing write tid 5 to smithi084102331-50 2024-01-13T18:03:32.087 INFO:tasks.rados.rados.0.smithi084.stdout:876: finishing write tid 6 to smithi084102331-50 2024-01-13T18:03:32.087 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 408 (ObjNum 278 snap 87 seq_num 278) dirty exists 2024-01-13T18:03:32.088 INFO:tasks.rados.rados.0.smithi084.stdout:876: left oid 50 (ObjNum 278 snap 87 seq_num 278) 2024-01-13T18:03:32.088 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 1 to smithi084102331-47 2024-01-13T18:03:32.088 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 2 to smithi084102331-47 2024-01-13T18:03:32.089 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 3 to smithi084102331-47 2024-01-13T18:03:32.089 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 4 to smithi084102331-47 2024-01-13T18:03:32.089 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 5 to smithi084102331-47 2024-01-13T18:03:32.089 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 6 to smithi084102331-47 2024-01-13T18:03:32.089 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 356 (ObjNum 280 snap 87 seq_num 280) dirty exists 2024-01-13T18:03:32.090 INFO:tasks.rados.rados.0.smithi084.stdout:878: left oid 47 (ObjNum 280 snap 87 seq_num 280) 2024-01-13T18:03:32.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:32 smithi099 ceph-mon[138788]: Reconfiguring osd.4 (monmap changed)... 2024-01-13T18:03:32.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:32 smithi099 ceph-mon[138788]: Reconfiguring daemon osd.4 on smithi099 2024-01-13T18:03:32.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:32 smithi099 ceph-mon[138788]: failed to encode map e231 with expected crc 2024-01-13T18:03:32.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:32 smithi099 ceph-mon[138788]: failed to encode map e231 with expected crc 2024-01-13T18:03:32.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:32.585 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:32.585 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-13T18:03:32.585 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:32.585 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:32 smithi099 ceph-mon[138788]: osdmap e232: 8 total, 8 up, 8 in 2024-01-13T18:03:32.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[116404]: Reconfiguring osd.4 (monmap changed)... 2024-01-13T18:03:32.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[116404]: Reconfiguring daemon osd.4 on smithi099 2024-01-13T18:03:32.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[116404]: failed to encode map e231 with expected crc 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[116404]: failed to encode map e231 with expected crc 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[116404]: osdmap e232: 8 total, 8 up, 8 in 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[119097]: Reconfiguring osd.4 (monmap changed)... 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[119097]: Reconfiguring daemon osd.4 on smithi099 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[119097]: failed to encode map e231 with expected crc 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[119097]: failed to encode map e231 with expected crc 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-13T18:03:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:32.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:32 smithi084 ceph-mon[119097]: osdmap e232: 8 total, 8 up, 8 in 2024-01-13T18:03:32.713 INFO:tasks.rados.rados.0.smithi084.stdout:876: done (2 left) 2024-01-13T18:03:32.713 INFO:tasks.rados.rados.0.smithi084.stdout:878: done (1 left) 2024-01-13T18:03:32.713 INFO:tasks.rados.rados.0.smithi084.stdout:879: done (0 left) 2024-01-13T18:03:32.713 INFO:tasks.rados.rados.0.smithi084.stdout:880: snap_remove snap 85 2024-01-13T18:03:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: Reconfiguring osd.5 (monmap changed)... 2024-01-13T18:03:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: Reconfiguring daemon osd.5 on smithi099 2024-01-13T18:03:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: pgmap v59: 121 pgs: 121 active+clean; 155 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 MiB/s rd, 4.0 MiB/s wr, 17 op/s 2024-01-13T18:03:33.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:33.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:33.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: osdmap e233: 8 total, 8 up, 8 in 2024-01-13T18:03:33.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-13T18:03:33.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:33.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:33 smithi099 ceph-mon[138788]: failed to encode map e233 with expected crc 2024-01-13T18:03:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: Reconfiguring osd.5 (monmap changed)... 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: Reconfiguring daemon osd.5 on smithi099 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: pgmap v59: 121 pgs: 121 active+clean; 155 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 MiB/s rd, 4.0 MiB/s wr, 17 op/s 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: osdmap e233: 8 total, 8 up, 8 in 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[116404]: failed to encode map e233 with expected crc 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: Reconfiguring osd.5 (monmap changed)... 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: Reconfiguring daemon osd.5 on smithi099 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: failed to encode map e232 with expected crc 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: pgmap v59: 121 pgs: 121 active+clean; 155 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 MiB/s rd, 4.0 MiB/s wr, 17 op/s 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: osdmap e233: 8 total, 8 up, 8 in 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:33.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:33 smithi084 ceph-mon[119097]: failed to encode map e233 with expected crc 2024-01-13T18:03:33.716 INFO:tasks.rados.rados.0.smithi084.stdout:880: done (0 left) 2024-01-13T18:03:33.716 INFO:tasks.rados.rados.0.smithi084.stdout:881: rmattr oid 46 current snap is 88 2024-01-13T18:03:33.716 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 88 2024-01-13T18:03:33.716 INFO:tasks.rados.rados.0.smithi084.stdout:882: seq_num 281 ranges {2539520=712704,3252224=491520,3743744=491520,4235264=622592} 2024-01-13T18:03:33.734 INFO:tasks.rados.rados.0.smithi084.stdout:882: writing smithi084102331-48 from 2539520 to 3252224 tid 1 2024-01-13T18:03:33.737 INFO:tasks.rados.rados.0.smithi084.stdout:882: writing smithi084102331-48 from 3252224 to 3743744 tid 2 2024-01-13T18:03:33.740 INFO:tasks.rados.rados.0.smithi084.stdout:882: writing smithi084102331-48 from 3743744 to 4235264 tid 3 2024-01-13T18:03:33.743 INFO:tasks.rados.rados.0.smithi084.stdout:882: writing smithi084102331-48 from 4235264 to 4857856 tid 4 2024-01-13T18:03:33.743 INFO:tasks.rados.rados.0.smithi084.stdout:883: delete oid 18 current snap is 88 2024-01-13T18:03:33.744 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 292 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:03:33.744 INFO:tasks.rados.rados.0.smithi084.stdout:882: finishing write tid 1 to smithi084102331-48 2024-01-13T18:03:33.744 INFO:tasks.rados.rados.0.smithi084.stdout:882: finishing write tid 2 to smithi084102331-48 2024-01-13T18:03:33.744 INFO:tasks.rados.rados.0.smithi084.stdout:882: finishing write tid 3 to smithi084102331-48 2024-01-13T18:03:33.746 INFO:tasks.rados.rados.0.smithi084.stdout:881: done (2 left) 2024-01-13T18:03:33.746 INFO:tasks.rados.rados.0.smithi084.stdout:883: done (1 left) 2024-01-13T18:03:33.746 INFO:tasks.rados.rados.0.smithi084.stdout:884: read oid 49 snap -1 2024-01-13T18:03:33.746 INFO:tasks.rados.rados.0.smithi084.stdout:884: expect deleted 2024-01-13T18:03:33.746 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 88 2024-01-13T18:03:33.746 INFO:tasks.rados.rados.0.smithi084.stdout:885: seq_num 283 ranges {4153344=745472,4898816=712704,5611520=458752,6070272=434176} 2024-01-13T18:03:33.772 INFO:tasks.rados.rados.0.smithi084.stdout:885: writing smithi084102331-27 from 4153344 to 4898816 tid 1 2024-01-13T18:03:33.777 INFO:tasks.rados.rados.0.smithi084.stdout:885: writing smithi084102331-27 from 4898816 to 5611520 tid 2 2024-01-13T18:03:33.780 INFO:tasks.rados.rados.0.smithi084.stdout:885: writing smithi084102331-27 from 5611520 to 6070272 tid 3 2024-01-13T18:03:33.783 INFO:tasks.rados.rados.0.smithi084.stdout:885: writing smithi084102331-27 from 6070272 to 6504448 tid 4 2024-01-13T18:03:33.783 INFO:tasks.rados.rados.0.smithi084.stdout:886: read oid 38 snap -1 2024-01-13T18:03:33.783 INFO:tasks.rados.rados.0.smithi084.stdout:886: expect deleted 2024-01-13T18:03:33.783 INFO:tasks.rados.rados.0.smithi084.stdout:887: rmattr oid 12 current snap is 88 2024-01-13T18:03:33.783 INFO:tasks.rados.rados.0.smithi084.stdout:887: done (4 left) 2024-01-13T18:03:33.783 INFO:tasks.rados.rados.0.smithi084.stdout:888: delete oid 29 current snap is 88 2024-01-13T18:03:33.783 INFO:tasks.rados.rados.0.smithi084.stdout:882: finishing write tid 4 to smithi084102331-48 2024-01-13T18:03:33.783 INFO:tasks.rados.rados.0.smithi084.stdout:882: finishing write tid 5 to smithi084102331-48 2024-01-13T18:03:33.783 INFO:tasks.rados.rados.0.smithi084.stdout:882: finishing write tid 6 to smithi084102331-48 2024-01-13T18:03:33.784 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 340 (ObjNum 281 snap 88 seq_num 281) dirty exists 2024-01-13T18:03:33.784 INFO:tasks.rados.rados.0.smithi084.stdout:882: left oid 48 (ObjNum 281 snap 88 seq_num 281) 2024-01-13T18:03:33.784 INFO:tasks.rados.rados.0.smithi084.stdout:885: finishing write tid 1 to smithi084102331-27 2024-01-13T18:03:33.785 INFO:tasks.rados.rados.0.smithi084.stdout:882: done (4 left) 2024-01-13T18:03:33.786 INFO:tasks.rados.rados.0.smithi084.stdout:884: done (3 left) 2024-01-13T18:03:33.786 INFO:tasks.rados.rados.0.smithi084.stdout:886: done (2 left) 2024-01-13T18:03:33.786 INFO:tasks.rados.rados.0.smithi084.stdout:888: done (1 left) 2024-01-13T18:03:33.786 INFO:tasks.rados.rados.0.smithi084.stdout:889: copy_from oid 32 from oid 19 current snap is 88 2024-01-13T18:03:33.786 INFO:tasks.rados.rados.0.smithi084.stdout:890: snap_remove snap 76 2024-01-13T18:03:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: Reconfiguring osd.6 (monmap changed)... 2024-01-13T18:03:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: Reconfiguring daemon osd.6 on smithi099 2024-01-13T18:03:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:34.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:34.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-13T18:03:34.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:34.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: osdmap e234: 8 total, 8 up, 8 in 2024-01-13T18:03:34.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:34 smithi099 ceph-mon[138788]: failed to encode map e234 with expected crc 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: Reconfiguring osd.6 (monmap changed)... 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: Reconfiguring daemon osd.6 on smithi099 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: osdmap e234: 8 total, 8 up, 8 in 2024-01-13T18:03:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[116404]: failed to encode map e234 with expected crc 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: Reconfiguring osd.6 (monmap changed)... 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: Reconfiguring daemon osd.6 on smithi099 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: failed to encode map e233 with expected crc 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:34.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: osdmap e234: 8 total, 8 up, 8 in 2024-01-13T18:03:34.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:34 smithi084 ceph-mon[119097]: failed to encode map e234 with expected crc 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:890: done (2 left) 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:891: snap_create 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:885: finishing write tid 2 to smithi084102331-27 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:885: finishing write tid 3 to smithi084102331-27 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:889: finishing copy_from to smithi084102331-32 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:889: got expected ENOENT (src dne) 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:889: finishing copy_from racing read to smithi084102331-32 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:885: finishing write tid 4 to smithi084102331-27 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:885: finishing write tid 5 to smithi084102331-27 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:885: finishing write tid 6 to smithi084102331-27 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 284 (ObjNum 283 snap 88 seq_num 283) dirty exists 2024-01-13T18:03:34.721 INFO:tasks.rados.rados.0.smithi084.stdout:885: left oid 27 (ObjNum 283 snap 88 seq_num 283) 2024-01-13T18:03:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: Reconfiguring osd.7 (monmap changed)... 2024-01-13T18:03:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: Reconfiguring daemon osd.7 on smithi099 2024-01-13T18:03:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: failed to encode map e234 with expected crc 2024-01-13T18:03:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: failed to encode map e234 with expected crc 2024-01-13T18:03:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: failed to encode map e234 with expected crc 2024-01-13T18:03:35.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: pgmap v62: 121 pgs: 121 active+clean; 155 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 MiB/s rd, 4.0 MiB/s wr, 17 op/s 2024-01-13T18:03:35.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:35.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:35.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: Reconfiguring mds.b (monmap changed)... 2024-01-13T18:03:35.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:03:35.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:35.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: Reconfiguring daemon mds.b on smithi099 2024-01-13T18:03:35.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: osdmap e235: 8 total, 8 up, 8 in 2024-01-13T18:03:35.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: Reconfiguring osd.7 (monmap changed)... 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: Reconfiguring daemon osd.7 on smithi099 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: failed to encode map e234 with expected crc 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: failed to encode map e234 with expected crc 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: failed to encode map e234 with expected crc 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: pgmap v62: 121 pgs: 121 active+clean; 155 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 MiB/s rd, 4.0 MiB/s wr, 17 op/s 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: Reconfiguring mds.b (monmap changed)... 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: Reconfiguring daemon mds.b on smithi099 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: osdmap e235: 8 total, 8 up, 8 in 2024-01-13T18:03:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: Reconfiguring osd.7 (monmap changed)... 2024-01-13T18:03:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: Reconfiguring daemon osd.7 on smithi099 2024-01-13T18:03:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: failed to encode map e234 with expected crc 2024-01-13T18:03:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: failed to encode map e234 with expected crc 2024-01-13T18:03:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: failed to encode map e234 with expected crc 2024-01-13T18:03:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: pgmap v62: 121 pgs: 121 active+clean; 155 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 MiB/s rd, 4.0 MiB/s wr, 17 op/s 2024-01-13T18:03:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: Reconfiguring mds.b (monmap changed)... 2024-01-13T18:03:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:03:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:35.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: Reconfiguring daemon mds.b on smithi099 2024-01-13T18:03:35.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: osdmap e235: 8 total, 8 up, 8 in 2024-01-13T18:03:35.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:35.722 INFO:tasks.rados.rados.0.smithi084.stdout:885: done (2 left) 2024-01-13T18:03:35.723 INFO:tasks.rados.rados.0.smithi084.stdout:889: done (1 left) 2024-01-13T18:03:35.723 INFO:tasks.rados.rados.0.smithi084.stdout:891: done (0 left) 2024-01-13T18:03:35.723 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 89 2024-01-13T18:03:35.723 INFO:tasks.rados.rados.0.smithi084.stdout:892: seq_num 285 ranges {1687552=778240,2465792=475136,2940928=475136,3416064=655360} 2024-01-13T18:03:35.736 INFO:tasks.rados.rados.0.smithi084.stdout:892: writing smithi084102331-21 from 1687552 to 2465792 tid 1 2024-01-13T18:03:35.739 INFO:tasks.rados.rados.0.smithi084.stdout:892: writing smithi084102331-21 from 2465792 to 2940928 tid 2 2024-01-13T18:03:35.742 INFO:tasks.rados.rados.0.smithi084.stdout:892: writing smithi084102331-21 from 2940928 to 3416064 tid 3 2024-01-13T18:03:35.747 INFO:tasks.rados.rados.0.smithi084.stdout:892: writing smithi084102331-21 from 3416064 to 4071424 tid 4 2024-01-13T18:03:35.747 INFO:tasks.rados.rados.0.smithi084.stdout:893: rollback oid 42 current snap is 89 2024-01-13T18:03:35.747 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 74 2024-01-13T18:03:35.748 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 89 2024-01-13T18:03:35.748 INFO:tasks.rados.rados.0.smithi084.stdout:894: seq_num 286 ranges {6144000=794624,6938624=761856,7700480=679936,8380416=163840} 2024-01-13T18:03:35.785 INFO:tasks.rados.rados.0.smithi084.stdout:894: writing smithi084102331-47 from 6144000 to 6938624 tid 1 2024-01-13T18:03:35.790 INFO:tasks.rados.rados.0.smithi084.stdout:894: writing smithi084102331-47 from 6938624 to 7700480 tid 2 2024-01-13T18:03:35.794 INFO:tasks.rados.rados.0.smithi084.stdout:894: writing smithi084102331-47 from 7700480 to 8380416 tid 3 2024-01-13T18:03:35.795 INFO:tasks.rados.rados.0.smithi084.stdout:894: writing smithi084102331-47 from 8380416 to 8544256 tid 4 2024-01-13T18:03:35.795 INFO:tasks.rados.rados.0.smithi084.stdout:895: copy_from oid 13 from oid 7 current snap is 89 2024-01-13T18:03:35.795 INFO:tasks.rados.rados.0.smithi084.stdout:892: finishing write tid 1 to smithi084102331-21 2024-01-13T18:03:35.795 INFO:tasks.rados.rados.0.smithi084.stdout:892: finishing write tid 2 to smithi084102331-21 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:892: finishing write tid 3 to smithi084102331-21 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:892: finishing write tid 4 to smithi084102331-21 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:892: finishing write tid 5 to smithi084102331-21 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:893: finishing rollback tid 0 to smithi084102331-42 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:893: finishing rollback tid 1 to smithi084102331-42 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:893: finishing rollback tid 2 to smithi084102331-42 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 262 (ObjNum 192 snap 54 seq_num 192) dirty exists 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:892: finishing write tid 6 to smithi084102331-21 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 289 (ObjNum 285 snap 89 seq_num 285) dirty exists 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:892: left oid 21 (ObjNum 285 snap 89 seq_num 285) 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:894: finishing write tid 1 to smithi084102331-47 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:894: finishing write tid 2 to smithi084102331-47 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:892: done (3 left) 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:893: done (2 left) 2024-01-13T18:03:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:896: snap_create 2024-01-13T18:03:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:895: finishing copy_from to smithi084102331-13 2024-01-13T18:03:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:895: got expected ENOENT (src dne) 2024-01-13T18:03:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:895: finishing copy_from racing read to smithi084102331-13 2024-01-13T18:03:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:894: finishing write tid 3 to smithi084102331-47 2024-01-13T18:03:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:894: finishing write tid 4 to smithi084102331-47 2024-01-13T18:03:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:894: finishing write tid 5 to smithi084102331-47 2024-01-13T18:03:35.798 INFO:tasks.rados.rados.0.smithi084.stdout:894: finishing write tid 6 to smithi084102331-47 2024-01-13T18:03:35.798 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 370 (ObjNum 286 snap 89 seq_num 286) dirty exists 2024-01-13T18:03:35.798 INFO:tasks.rados.rados.0.smithi084.stdout:894: left oid 47 (ObjNum 286 snap 89 seq_num 286) 2024-01-13T18:03:36.346 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: failed to encode map e235 with expected crc 2024-01-13T18:03:36.346 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: failed to encode map e235 with expected crc 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: Upgrade: Setting container_image for all mon 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: Upgrade: Setting container_image for all crash 2024-01-13T18:03:36.347 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: Upgrade: osd.0 is safe to restart 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: failed to encode map e236 with expected crc 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: osdmap e236: 8 total, 8 up, 8 in 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: failed to encode map e236 with expected crc 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[119097]: pgmap v65: 121 pgs: 121 active+clean; 182 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 21 op/s 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: failed to encode map e235 with expected crc 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: failed to encode map e235 with expected crc 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: Upgrade: Setting container_image for all mon 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: Upgrade: Setting container_image for all crash 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: Upgrade: osd.0 is safe to restart 2024-01-13T18:03:36.349 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: failed to encode map e236 with expected crc 2024-01-13T18:03:36.350 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: osdmap e236: 8 total, 8 up, 8 in 2024-01-13T18:03:36.350 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: failed to encode map e236 with expected crc 2024-01-13T18:03:36.350 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:36 smithi084 ceph-mon[116404]: pgmap v65: 121 pgs: 121 active+clean; 182 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 21 op/s 2024-01-13T18:03:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: failed to encode map e235 with expected crc 2024-01-13T18:03:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: failed to encode map e235 with expected crc 2024-01-13T18:03:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: Upgrade: Setting container_image for all mon 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: Upgrade: Setting container_image for all crash 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: Upgrade: osd.0 is safe to restart 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: failed to encode map e236 with expected crc 2024-01-13T18:03:36.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: osdmap e236: 8 total, 8 up, 8 in 2024-01-13T18:03:36.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: failed to encode map e236 with expected crc 2024-01-13T18:03:36.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:36 smithi099 ceph-mon[138788]: pgmap v65: 121 pgs: 121 active+clean; 182 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 21 op/s 2024-01-13T18:03:36.728 INFO:tasks.rados.rados.0.smithi084.stdout:894: done (2 left) 2024-01-13T18:03:36.728 INFO:tasks.rados.rados.0.smithi084.stdout:895: done (1 left) 2024-01-13T18:03:36.728 INFO:tasks.rados.rados.0.smithi084.stdout:896: done (0 left) 2024-01-13T18:03:36.728 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 90 2024-01-13T18:03:36.728 INFO:tasks.rados.rados.0.smithi084.stdout:897: seq_num 287 ranges {0=8192} 2024-01-13T18:03:36.728 INFO:tasks.rados.rados.0.smithi084.stdout:897: writing smithi084102331-15 from 0 to 8192 tid 1 2024-01-13T18:03:36.728 INFO:tasks.rados.rados.0.smithi084.stdout:898: delete oid 31 current snap is 90 2024-01-13T18:03:36.733 INFO:tasks.rados.rados.0.smithi084.stdout:898: done (1 left) 2024-01-13T18:03:36.733 INFO:tasks.rados.rados.0.smithi084.stdout:899: snap_create 2024-01-13T18:03:36.737 INFO:tasks.rados.rados.0.smithi084.stdout:897: finishing write tid 1 to smithi084102331-15 2024-01-13T18:03:36.738 INFO:tasks.rados.rados.0.smithi084.stdout:897: finishing write tid 2 to smithi084102331-15 2024-01-13T18:03:36.739 INFO:tasks.rados.rados.0.smithi084.stdout:897: finishing write tid 3 to smithi084102331-15 2024-01-13T18:03:36.740 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 372 (ObjNum 287 snap 90 seq_num 287) dirty exists 2024-01-13T18:03:36.740 INFO:tasks.rados.rados.0.smithi084.stdout:897: left oid 15 (ObjNum 287 snap 90 seq_num 287) 2024-01-13T18:03:37.350 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[119097]: failed to encode map e236 with expected crc 2024-01-13T18:03:37.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[119097]: failed to encode map e236 with expected crc 2024-01-13T18:03:37.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[119097]: failed to encode map e237 with expected crc 2024-01-13T18:03:37.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[119097]: Upgrade: Updating osd.0 2024-01-13T18:03:37.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[119097]: osdmap e237: 8 total, 8 up, 8 in 2024-01-13T18:03:37.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[119097]: failed to encode map e237 with expected crc 2024-01-13T18:03:37.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[119097]: failed to encode map e237 with expected crc 2024-01-13T18:03:37.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:37.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-13T18:03:37.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:37.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[119097]: Deploying daemon osd.0 on smithi084 2024-01-13T18:03:37.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[116404]: failed to encode map e236 with expected crc 2024-01-13T18:03:37.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[116404]: failed to encode map e236 with expected crc 2024-01-13T18:03:37.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[116404]: failed to encode map e237 with expected crc 2024-01-13T18:03:37.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[116404]: Upgrade: Updating osd.0 2024-01-13T18:03:37.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[116404]: osdmap e237: 8 total, 8 up, 8 in 2024-01-13T18:03:37.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[116404]: failed to encode map e237 with expected crc 2024-01-13T18:03:37.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[116404]: failed to encode map e237 with expected crc 2024-01-13T18:03:37.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:37.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-13T18:03:37.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:37.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:37 smithi084 ceph-mon[116404]: Deploying daemon osd.0 on smithi084 2024-01-13T18:03:37.569 INFO:tasks.rados.rados.0.smithi084.stdout:897: done (1 left) 2024-01-13T18:03:37.569 INFO:tasks.rados.rados.0.smithi084.stdout:899: done (0 left) 2024-01-13T18:03:37.569 INFO:tasks.rados.rados.0.smithi084.stdout:900: copy_from oid 33 from oid 44 current snap is 91 2024-01-13T18:03:37.569 INFO:tasks.rados.rados.0.smithi084.stdout:901: delete oid 3 current snap is 91 2024-01-13T18:03:37.578 INFO:tasks.rados.rados.0.smithi084.stdout:901: done (1 left) 2024-01-13T18:03:37.578 INFO:tasks.rados.rados.0.smithi084.stdout:902: snap_remove snap 90 2024-01-13T18:03:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:37 smithi099 ceph-mon[138788]: failed to encode map e236 with expected crc 2024-01-13T18:03:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:37 smithi099 ceph-mon[138788]: failed to encode map e236 with expected crc 2024-01-13T18:03:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:37 smithi099 ceph-mon[138788]: failed to encode map e237 with expected crc 2024-01-13T18:03:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:37 smithi099 ceph-mon[138788]: Upgrade: Updating osd.0 2024-01-13T18:03:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:37 smithi099 ceph-mon[138788]: osdmap e237: 8 total, 8 up, 8 in 2024-01-13T18:03:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:37 smithi099 ceph-mon[138788]: failed to encode map e237 with expected crc 2024-01-13T18:03:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:37 smithi099 ceph-mon[138788]: failed to encode map e237 with expected crc 2024-01-13T18:03:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-13T18:03:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:37 smithi099 ceph-mon[138788]: Deploying daemon osd.0 on smithi084 2024-01-13T18:03:38.590 INFO:tasks.rados.rados.0.smithi084.stdout:902: done (1 left) 2024-01-13T18:03:38.590 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 91 2024-01-13T18:03:38.590 INFO:tasks.rados.rados.0.smithi084.stdout:903: seq_num 290 ranges {4071424=57344} 2024-01-13T18:03:38.610 INFO:tasks.rados.rados.0.smithi084.stdout:903: writing smithi084102331-21 from 4071424 to 4128768 tid 1 2024-01-13T18:03:38.610 INFO:tasks.rados.rados.0.smithi084.stdout:904: read oid 3 snap -1 2024-01-13T18:03:38.610 INFO:tasks.rados.rados.0.smithi084.stdout:904: expect deleted 2024-01-13T18:03:38.611 INFO:tasks.rados.rados.0.smithi084.stdout:905: read oid 23 snap -1 2024-01-13T18:03:38.611 INFO:tasks.rados.rados.0.smithi084.stdout:905: expect (ObjNum 226 snap 69 seq_num 226) 2024-01-13T18:03:38.611 INFO:tasks.rados.rados.0.smithi084.stdout:906: delete oid 19 current snap is 91 2024-01-13T18:03:38.611 INFO:tasks.rados.rados.0.smithi084.stdout:900: finishing copy_from to smithi084102331-33 2024-01-13T18:03:38.611 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 344 (ObjNum 4113 snap 0 seq_num 507677830) dirty exists 2024-01-13T18:03:38.611 INFO:tasks.rados.rados.0.smithi084.stdout:900: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:03:38.613 INFO:tasks.rados.rados.0.smithi084.stdout:903: finishing write tid 1 to smithi084102331-21 2024-01-13T18:03:38.614 INFO:tasks.rados.rados.0.smithi084.stdout:903: finishing write tid 2 to smithi084102331-21 2024-01-13T18:03:38.614 INFO:tasks.rados.rados.0.smithi084.stdout:903: finishing write tid 3 to smithi084102331-21 2024-01-13T18:03:38.615 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 292 (ObjNum 290 snap 91 seq_num 290) dirty exists 2024-01-13T18:03:38.615 INFO:tasks.rados.rados.0.smithi084.stdout:903: left oid 21 (ObjNum 290 snap 91 seq_num 290) 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:900: done (4 left) 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:903: done (3 left) 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:904: done (2 left) 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:906: done (1 left) 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:907: rollback oid 25 current snap is 91 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 25 to 72 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:908: rollback oid 48 current snap is 91 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 48 to 69 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:909: rmattr oid 8 current snap is 91 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:909: done (3 left) 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:910: read oid 33 snap -1 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:910: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:911: copy_from oid 27 from oid 31 current snap is 91 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:912: copy_from oid 40 from oid 3 current snap is 91 2024-01-13T18:03:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:913: rollback oid 46 current snap is 91 2024-01-13T18:03:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 81 2024-01-13T18:03:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:914: read oid 50 snap -1 2024-01-13T18:03:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:914: expect (ObjNum 278 snap 87 seq_num 278) 2024-01-13T18:03:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:915: rollback oid 1 current snap is 91 2024-01-13T18:03:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 1 to 88 2024-01-13T18:03:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:916: rollback oid 9 current snap is 91 2024-01-13T18:03:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 74 2024-01-13T18:03:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:917: rollback oid 10 current snap is 91 2024-01-13T18:03:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 79 2024-01-13T18:03:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:918: snap_create 2024-01-13T18:03:38.627 INFO:tasks.rados.rados.0.smithi084.stdout:907: finishing rollback tid 1 to smithi084102331-25 2024-01-13T18:03:38.628 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 0 (ObjNum 129 snap 0 seq_num 4037172264) dirty dne 2024-01-13T18:03:38.628 INFO:tasks.rados.rados.0.smithi084.stdout:910: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:03:38.628 INFO:tasks.rados.rados.0.smithi084.stdout:912: finishing copy_from to smithi084102331-40 2024-01-13T18:03:38.628 INFO:tasks.rados.rados.0.smithi084.stdout:912: got expected ENOENT (src dne) 2024-01-13T18:03:38.628 INFO:tasks.rados.rados.0.smithi084.stdout:912: finishing copy_from racing read to smithi084102331-40 2024-01-13T18:03:38.628 INFO:tasks.rados.rados.0.smithi084.stdout:915: finishing rollback tid 0 to smithi084102331-1 2024-01-13T18:03:38.631 INFO:tasks.rados.rados.0.smithi084.stdout:913: finishing rollback tid 0 to smithi084102331-46 2024-01-13T18:03:38.631 INFO:tasks.rados.rados.0.smithi084.stdout:913: finishing rollback tid 1 to smithi084102331-46 2024-01-13T18:03:38.631 INFO:tasks.rados.rados.0.smithi084.stdout:915: finishing rollback tid 1 to smithi084102331-1 2024-01-13T18:03:38.632 INFO:tasks.rados.rados.0.smithi084.stdout:915: finishing rollback tid 2 to smithi084102331-1 2024-01-13T18:03:38.632 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 449 (ObjNum 249 snap 75 seq_num 249) dirty exists 2024-01-13T18:03:38.632 INFO:tasks.rados.rados.0.smithi084.stdout:913: finishing rollback tid 2 to smithi084102331-46 2024-01-13T18:03:38.632 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 295 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:03:38.632 INFO:tasks.rados.rados.0.smithi084.stdout:917: finishing rollback tid 0 to smithi084102331-10 2024-01-13T18:03:38.632 INFO:tasks.rados.rados.0.smithi084.stdout:917: finishing rollback tid 1 to smithi084102331-10 2024-01-13T18:03:38.632 INFO:tasks.rados.rados.0.smithi084.stdout:917: finishing rollback tid 2 to smithi084102331-10 2024-01-13T18:03:38.632 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 168 (ObjNum 255 snap 76 seq_num 255) dirty exists 2024-01-13T18:03:38.634 INFO:tasks.rados.rados.0.smithi084.stdout:911: finishing copy_from to smithi084102331-27 2024-01-13T18:03:38.634 INFO:tasks.rados.rados.0.smithi084.stdout:911: got expected ENOENT (src dne) 2024-01-13T18:03:38.634 INFO:tasks.rados.rados.0.smithi084.stdout:911: finishing copy_from racing read to smithi084102331-27 2024-01-13T18:03:38.634 INFO:tasks.rados.rados.0.smithi084.stdout:916: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:03:38.635 INFO:tasks.rados.rados.0.smithi084.stdout:916: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:03:38.635 INFO:tasks.rados.rados.0.smithi084.stdout:916: finishing rollback tid 2 to smithi084102331-9 2024-01-13T18:03:38.635 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 260 (ObjNum 212 snap 60 seq_num 212) dirty exists 2024-01-13T18:03:38.645 INFO:tasks.rados.rados.0.smithi084.stdout:905: expect (ObjNum 226 snap 69 seq_num 226) 2024-01-13T18:03:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[116404]: failed to encode map e237 with expected crc 2024-01-13T18:03:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[116404]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[116404]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[116404]: osdmap e238: 8 total, 8 up, 8 in 2024-01-13T18:03:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[116404]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[116404]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[116404]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[116404]: pgmap v68: 121 pgs: 121 active+clean; 182 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 21 op/s 2024-01-13T18:03:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[119097]: failed to encode map e237 with expected crc 2024-01-13T18:03:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[119097]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[119097]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[119097]: osdmap e238: 8 total, 8 up, 8 in 2024-01-13T18:03:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[119097]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[119097]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[119097]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-mon[119097]: pgmap v68: 121 pgs: 121 active+clean; 182 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 21 op/s 2024-01-13T18:03:38.850 INFO:tasks.rados.rados.0.smithi084.stdout:908: finishing rollback tid 0 to smithi084102331-48 2024-01-13T18:03:38.850 INFO:tasks.rados.rados.0.smithi084.stdout:908: finishing rollback tid 1 to smithi084102331-48 2024-01-13T18:03:38.850 INFO:tasks.rados.rados.0.smithi084.stdout:908: finishing rollback tid 2 to smithi084102331-48 2024-01-13T18:03:38.850 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 348 (ObjNum 200 snap 55 seq_num 200) dirty exists 2024-01-13T18:03:38.850 INFO:tasks.rados.rados.0.smithi084.stdout:914: expect (ObjNum 278 snap 87 seq_num 278) 2024-01-13T18:03:38.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:03:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:03:38.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:03:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:38 smithi099 ceph-mon[138788]: failed to encode map e237 with expected crc 2024-01-13T18:03:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:38 smithi099 ceph-mon[138788]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:38 smithi099 ceph-mon[138788]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:38 smithi099 ceph-mon[138788]: osdmap e238: 8 total, 8 up, 8 in 2024-01-13T18:03:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:38 smithi099 ceph-mon[138788]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:38 smithi099 ceph-mon[138788]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:38 smithi099 ceph-mon[138788]: failed to encode map e238 with expected crc 2024-01-13T18:03:38.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:38 smithi099 ceph-mon[138788]: pgmap v68: 121 pgs: 121 active+clean; 182 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 21 op/s 2024-01-13T18:03:39.178 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:38 smithi084 systemd[1]: Stopping Ceph osd.0 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:03:39.178 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[56997]: 2024-01-13T18:03:38.897+0000 7ff1bf98a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:03:39.179 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[56997]: 2024-01-13T18:03:38.897+0000 7ff1bf98a700 -1 osd.0 239 *** Got signal Terminated *** 2024-01-13T18:03:39.179 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:38 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[56997]: 2024-01-13T18:03:38.897+0000 7ff1bf98a700 -1 osd.0 239 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T18:03:39.584 INFO:tasks.rados.rados.0.smithi084.stdout:905: done (11 left) 2024-01-13T18:03:39.584 INFO:tasks.rados.rados.0.smithi084.stdout:907: done (10 left) 2024-01-13T18:03:39.584 INFO:tasks.rados.rados.0.smithi084.stdout:908: done (9 left) 2024-01-13T18:03:39.584 INFO:tasks.rados.rados.0.smithi084.stdout:910: done (8 left) 2024-01-13T18:03:39.584 INFO:tasks.rados.rados.0.smithi084.stdout:911: done (7 left) 2024-01-13T18:03:39.584 INFO:tasks.rados.rados.0.smithi084.stdout:912: done (6 left) 2024-01-13T18:03:39.584 INFO:tasks.rados.rados.0.smithi084.stdout:913: done (5 left) 2024-01-13T18:03:39.584 INFO:tasks.rados.rados.0.smithi084.stdout:914: done (4 left) 2024-01-13T18:03:39.584 INFO:tasks.rados.rados.0.smithi084.stdout:915: done (3 left) 2024-01-13T18:03:39.584 INFO:tasks.rados.rados.0.smithi084.stdout:916: done (2 left) 2024-01-13T18:03:39.584 INFO:tasks.rados.rados.0.smithi084.stdout:917: done (1 left) 2024-01-13T18:03:39.585 INFO:tasks.rados.rados.0.smithi084.stdout:918: done (0 left) 2024-01-13T18:03:39.585 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 92 2024-01-13T18:03:39.585 INFO:tasks.rados.rados.0.smithi084.stdout:919: seq_num 292 ranges {1777664=98304} 2024-01-13T18:03:39.594 INFO:tasks.rados.rados.0.smithi084.stdout:919: writing smithi084102331-1 from 1777664 to 1875968 tid 1 2024-01-13T18:03:39.594 INFO:tasks.rados.rados.0.smithi084.stdout:920: read oid 35 snap -1 2024-01-13T18:03:39.594 INFO:tasks.rados.rados.0.smithi084.stdout:920: expect (ObjNum 270 snap 86 seq_num 270) 2024-01-13T18:03:39.594 INFO:tasks.rados.rados.0.smithi084.stdout:921: snap_create 2024-01-13T18:03:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:39 smithi099 ceph-mon[138788]: failed to encode map e238 with expected crc 2024-01-13T18:03:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:39 smithi099 ceph-mon[138788]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:39 smithi099 ceph-mon[138788]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:39 smithi099 ceph-mon[138788]: osdmap e239: 8 total, 8 up, 8 in 2024-01-13T18:03:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:39 smithi099 ceph-mon[138788]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:39 smithi099 ceph-mon[138788]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:39 smithi099 ceph-mon[138788]: osd.0 marked itself down and dead 2024-01-13T18:03:39.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[116404]: failed to encode map e238 with expected crc 2024-01-13T18:03:39.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[116404]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[116404]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[116404]: osdmap e239: 8 total, 8 up, 8 in 2024-01-13T18:03:39.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[116404]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[116404]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[116404]: osd.0 marked itself down and dead 2024-01-13T18:03:39.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[119097]: failed to encode map e238 with expected crc 2024-01-13T18:03:39.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[119097]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[119097]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[119097]: osdmap e239: 8 total, 8 up, 8 in 2024-01-13T18:03:39.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[119097]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[119097]: failed to encode map e239 with expected crc 2024-01-13T18:03:39.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:39 smithi084 ceph-mon[119097]: osd.0 marked itself down and dead 2024-01-13T18:03:40.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:03:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:03:40] "GET /metrics HTTP/1.1" 200 35936 "" "Prometheus/2.43.0" 2024-01-13T18:03:40.429 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:40 smithi084 bash[125394]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0 2024-01-13T18:03:40.599 INFO:tasks.rados.rados.0.smithi084.stdout:921: done (2 left) 2024-01-13T18:03:40.599 INFO:tasks.rados.rados.0.smithi084.stdout:922: rollback oid 48 current snap is 93 2024-01-13T18:03:40.599 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 48 to 79 2024-01-13T18:03:40.599 INFO:tasks.rados.rados.0.smithi084.stdout:923: delete oid 11 current snap is 93 2024-01-13T18:03:40.613 INFO:tasks.rados.rados.0.smithi084.stdout:919: finishing write tid 1 to smithi084102331-1 2024-01-13T18:03:40.614 INFO:tasks.rados.rados.0.smithi084.stdout:919: finishing write tid 2 to smithi084102331-1 2024-01-13T18:03:40.616 INFO:tasks.rados.rados.0.smithi084.stdout:919: finishing write tid 3 to smithi084102331-1 2024-01-13T18:03:40.616 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 452 (ObjNum 292 snap 92 seq_num 292) dirty exists 2024-01-13T18:03:40.616 INFO:tasks.rados.rados.0.smithi084.stdout:919: left oid 1 (ObjNum 292 snap 92 seq_num 292) 2024-01-13T18:03:40.620 INFO:tasks.rados.rados.0.smithi084.stdout:922: finishing rollback tid 0 to smithi084102331-48 2024-01-13T18:03:40.620 INFO:tasks.rados.rados.0.smithi084.stdout:922: finishing rollback tid 1 to smithi084102331-48 2024-01-13T18:03:40.620 INFO:tasks.rados.rados.0.smithi084.stdout:922: finishing rollback tid 2 to smithi084102331-48 2024-01-13T18:03:40.620 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 352 (ObjNum 247 snap 74 seq_num 247) dirty exists 2024-01-13T18:03:40.622 INFO:tasks.rados.rados.0.smithi084.stdout:919: done (3 left) 2024-01-13T18:03:40.622 INFO:tasks.rados.rados.0.smithi084.stdout:922: done (2 left) 2024-01-13T18:03:40.622 INFO:tasks.rados.rados.0.smithi084.stdout:923: done (1 left) 2024-01-13T18:03:40.622 INFO:tasks.rados.rados.0.smithi084.stdout:924: copy_from oid 39 from oid 8 current snap is 93 2024-01-13T18:03:40.622 INFO:tasks.rados.rados.0.smithi084.stdout:925: read oid 46 snap 87 2024-01-13T18:03:40.622 INFO:tasks.rados.rados.0.smithi084.stdout:925: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:03:40.622 INFO:tasks.rados.rados.0.smithi084.stdout:926: rmattr oid 14 current snap is 93 2024-01-13T18:03:40.622 INFO:tasks.rados.rados.0.smithi084.stdout:926: done (3 left) 2024-01-13T18:03:40.622 INFO:tasks.rados.rados.0.smithi084.stdout:927: read oid 16 snap -1 2024-01-13T18:03:40.623 INFO:tasks.rados.rados.0.smithi084.stdout:927: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:03:40.623 INFO:tasks.rados.rados.0.smithi084.stdout:928: rollback oid 40 current snap is 93 2024-01-13T18:03:40.623 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 84 2024-01-13T18:03:40.623 INFO:tasks.rados.rados.0.smithi084.stdout:929: delete oid 36 current snap is 93 2024-01-13T18:03:40.623 INFO:tasks.rados.rados.0.smithi084.stdout:924: finishing copy_from to smithi084102331-39 2024-01-13T18:03:40.624 INFO:tasks.rados.rados.0.smithi084.stdout:924: got expected ENOENT (src dne) 2024-01-13T18:03:40.624 INFO:tasks.rados.rados.0.smithi084.stdout:924: finishing copy_from racing read to smithi084102331-39 2024-01-13T18:03:40.625 INFO:tasks.rados.rados.0.smithi084.stdout:924: done (5 left) 2024-01-13T18:03:40.625 INFO:tasks.rados.rados.0.smithi084.stdout:929: done (4 left) 2024-01-13T18:03:40.625 INFO:tasks.rados.rados.0.smithi084.stdout:930: delete oid 20 current snap is 93 2024-01-13T18:03:40.628 INFO:tasks.rados.rados.0.smithi084.stdout:930: done (4 left) 2024-01-13T18:03:40.628 INFO:tasks.rados.rados.0.smithi084.stdout:931: copy_from oid 24 from oid 5 current snap is 93 2024-01-13T18:03:40.633 INFO:tasks.rados.rados.0.smithi084.stdout:932: read oid 48 snap 84 2024-01-13T18:03:40.634 INFO:tasks.rados.rados.0.smithi084.stdout:932: expect (ObjNum 247 snap 74 seq_num 247) 2024-01-13T18:03:40.634 INFO:tasks.rados.rados.0.smithi084.stdout:933: read oid 11 snap -1 2024-01-13T18:03:40.634 INFO:tasks.rados.rados.0.smithi084.stdout:933: expect deleted 2024-01-13T18:03:40.634 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 93 2024-01-13T18:03:40.634 INFO:tasks.rados.rados.0.smithi084.stdout:934: seq_num 296 ranges {5414912=163840} 2024-01-13T18:03:40.662 INFO:tasks.rados.rados.0.smithi084.stdout:934: writing smithi084102331-37 from 5414912 to 5578752 tid 1 2024-01-13T18:03:40.662 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 93 2024-01-13T18:03:40.662 INFO:tasks.rados.rados.0.smithi084.stdout:935: seq_num 297 ranges {0=180224} 2024-01-13T18:03:40.663 INFO:tasks.rados.rados.0.smithi084.stdout:935: writing smithi084102331-38 from 0 to 180224 tid 1 2024-01-13T18:03:40.663 INFO:tasks.rados.rados.0.smithi084.stdout:936: snap_remove snap 86 2024-01-13T18:03:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:40 smithi099 ceph-mon[138788]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:03:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:40 smithi099 ceph-mon[138788]: failed to encode map e240 with expected crc 2024-01-13T18:03:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:40 smithi099 ceph-mon[138788]: failed to encode map e240 with expected crc 2024-01-13T18:03:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:40 smithi099 ceph-mon[138788]: osdmap e240: 8 total, 7 up, 8 in 2024-01-13T18:03:40.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:40 smithi099 ceph-mon[138788]: pgmap v71: 121 pgs: 15 stale+active+clean, 106 active+clean; 182 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:03:40.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:40 smithi084 ceph-mon[116404]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:03:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:40 smithi084 ceph-mon[116404]: failed to encode map e240 with expected crc 2024-01-13T18:03:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:40 smithi084 ceph-mon[116404]: failed to encode map e240 with expected crc 2024-01-13T18:03:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:40 smithi084 ceph-mon[116404]: osdmap e240: 8 total, 7 up, 8 in 2024-01-13T18:03:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:40 smithi084 ceph-mon[116404]: pgmap v71: 121 pgs: 15 stale+active+clean, 106 active+clean; 182 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:03:40.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:40 smithi084 ceph-mon[119097]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:03:40.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:40 smithi084 ceph-mon[119097]: failed to encode map e240 with expected crc 2024-01-13T18:03:40.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:40 smithi084 ceph-mon[119097]: failed to encode map e240 with expected crc 2024-01-13T18:03:40.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:40 smithi084 ceph-mon[119097]: osdmap e240: 8 total, 7 up, 8 in 2024-01-13T18:03:40.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:40 smithi084 ceph-mon[119097]: pgmap v71: 121 pgs: 15 stale+active+clean, 106 active+clean; 182 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:03:41.593 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:41 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.0.service: Succeeded. 2024-01-13T18:03:41.594 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:41 smithi084 systemd[1]: Stopped Ceph osd.0 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:03:41.594 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:41 smithi084 systemd[1]: Starting Ceph osd.0 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:03:41.595 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[116404]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.595 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[116404]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.595 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[116404]: osdmap e241: 8 total, 7 up, 8 in 2024-01-13T18:03:41.595 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[116404]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.595 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[116404]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.595 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[116404]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.595 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[116404]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.595 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[116404]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.595 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[116404]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.595 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[116404]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.596 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[119097]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.596 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[119097]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.596 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[119097]: osdmap e241: 8 total, 7 up, 8 in 2024-01-13T18:03:41.596 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[119097]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.596 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[119097]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.596 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[119097]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.596 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[119097]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.596 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[119097]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.596 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[119097]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.596 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:41 smithi084 ceph-mon[119097]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.602 INFO:tasks.rados.rados.0.smithi084.stdout:936: done (9 left) 2024-01-13T18:03:41.602 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 93 2024-01-13T18:03:41.602 INFO:tasks.rados.rados.0.smithi084.stdout:920: expect (ObjNum 270 snap 86 seq_num 270) 2024-01-13T18:03:41.727 INFO:tasks.rados.rados.0.smithi084.stdout:928: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:03:41.727 INFO:tasks.rados.rados.0.smithi084.stdout:925: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:03:41.767 INFO:tasks.rados.rados.0.smithi084.stdout:928: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:03:41.767 INFO:tasks.rados.rados.0.smithi084.stdout:928: finishing rollback tid 2 to smithi084102331-40 2024-01-13T18:03:41.767 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 296 (ObjNum 225 snap 69 seq_num 225) dirty exists 2024-01-13T18:03:41.767 INFO:tasks.rados.rados.0.smithi084.stdout:932: expect (ObjNum 247 snap 74 seq_num 247) 2024-01-13T18:03:41.845 INFO:tasks.rados.rados.0.smithi084.stdout:934: finishing write tid 1 to smithi084102331-37 2024-01-13T18:03:41.845 INFO:tasks.rados.rados.0.smithi084.stdout:934: finishing write tid 2 to smithi084102331-37 2024-01-13T18:03:41.845 INFO:tasks.rados.rados.0.smithi084.stdout:934: finishing write tid 3 to smithi084102331-37 2024-01-13T18:03:41.845 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 418 (ObjNum 296 snap 93 seq_num 296) dirty exists 2024-01-13T18:03:41.845 INFO:tasks.rados.rados.0.smithi084.stdout:934: left oid 37 (ObjNum 296 snap 93 seq_num 296) 2024-01-13T18:03:41.845 INFO:tasks.rados.rados.0.smithi084.stdout:927: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:03:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:41 smithi099 ceph-mon[138788]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:41 smithi099 ceph-mon[138788]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:41 smithi099 ceph-mon[138788]: osdmap e241: 8 total, 7 up, 8 in 2024-01-13T18:03:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:41 smithi099 ceph-mon[138788]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:41 smithi099 ceph-mon[138788]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:41 smithi099 ceph-mon[138788]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:41 smithi099 ceph-mon[138788]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:41 smithi099 ceph-mon[138788]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:41 smithi099 ceph-mon[138788]: failed to encode map e241 with expected crc 2024-01-13T18:03:41.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:41 smithi099 ceph-mon[138788]: failed to encode map e241 with expected crc 2024-01-13T18:03:42.314 INFO:tasks.rados.rados.0.smithi084.stdout:935: finishing write tid 1 to smithi084102331-38 2024-01-13T18:03:42.315 INFO:tasks.rados.rados.0.smithi084.stdout:935: finishing write tid 2 to smithi084102331-38 2024-01-13T18:03:42.315 INFO:tasks.rados.rados.0.smithi084.stdout:935: finishing write tid 3 to smithi084102331-38 2024-01-13T18:03:42.315 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 454 (ObjNum 297 snap 93 seq_num 297) dirty exists 2024-01-13T18:03:42.315 INFO:tasks.rados.rados.0.smithi084.stdout:935: left oid 38 (ObjNum 297 snap 93 seq_num 297) 2024-01-13T18:03:42.315 INFO:tasks.rados.rados.0.smithi084.stdout:931: finishing copy_from to smithi084102331-24 2024-01-13T18:03:42.315 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 270 (ObjNum 251 snap 75 seq_num 251) dirty exists 2024-01-13T18:03:42.315 INFO:tasks.rados.rados.0.smithi084.stdout:931: finishing copy_from racing read to smithi084102331-24 2024-01-13T18:03:42.315 INFO:tasks.rados.rados.0.smithi084.stdout:937: seq_num 298 ranges {819200=196608} 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:937: writing smithi084102331-42 from 819200 to 1015808 tid 1 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:920: done (9 left) 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:925: done (8 left) 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:927: done (7 left) 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:928: done (6 left) 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:931: done (5 left) 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:932: done (4 left) 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:933: done (3 left) 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:934: done (2 left) 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:935: done (1 left) 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:938: copy_from oid 41 from oid 49 current snap is 93 2024-01-13T18:03:42.321 INFO:tasks.rados.rados.0.smithi084.stdout:939: snap_remove snap 77 2024-01-13T18:03:42.428 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:42 smithi084 bash[125662]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-13T18:03:42.428 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:42 smithi084 bash[125662]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-01-13T18:03:42.429 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:42 smithi084 bash[125662]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-01-13T18:03:42.429 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:42 smithi084 bash[125662]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-01-13T18:03:42.429 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:42 smithi084 bash[125662]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-01-13T18:03:42.429 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:42 smithi084 bash[125662]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-13T18:03:42.429 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:42 smithi084 bash[125662]: --> ceph-volume raw activate successful for osd ID: 0 2024-01-13T18:03:42.607 INFO:tasks.rados.rados.0.smithi084.stdout:939: done (2 left) 2024-01-13T18:03:42.607 INFO:tasks.rados.rados.0.smithi084.stdout:940: snap_remove snap 91 2024-01-13T18:03:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:42 smithi099 ceph-mon[138788]: failed to encode map e242 with expected crc 2024-01-13T18:03:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:42 smithi099 ceph-mon[138788]: failed to encode map e242 with expected crc 2024-01-13T18:03:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:42 smithi099 ceph-mon[138788]: osdmap e242: 8 total, 7 up, 8 in 2024-01-13T18:03:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:42 smithi099 ceph-mon[138788]: failed to encode map e242 with expected crc 2024-01-13T18:03:42.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:42 smithi099 ceph-mon[138788]: pgmap v74: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 194 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 96/480 objects degraded (20.000%) 2024-01-13T18:03:42.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:42 smithi084 ceph-mon[119097]: failed to encode map e242 with expected crc 2024-01-13T18:03:42.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:42 smithi084 ceph-mon[119097]: failed to encode map e242 with expected crc 2024-01-13T18:03:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:42 smithi084 ceph-mon[119097]: osdmap e242: 8 total, 7 up, 8 in 2024-01-13T18:03:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:42 smithi084 ceph-mon[119097]: failed to encode map e242 with expected crc 2024-01-13T18:03:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:42 smithi084 ceph-mon[119097]: pgmap v74: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 194 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 96/480 objects degraded (20.000%) 2024-01-13T18:03:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:42 smithi084 ceph-mon[116404]: failed to encode map e242 with expected crc 2024-01-13T18:03:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:42 smithi084 ceph-mon[116404]: failed to encode map e242 with expected crc 2024-01-13T18:03:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:42 smithi084 ceph-mon[116404]: osdmap e242: 8 total, 7 up, 8 in 2024-01-13T18:03:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:42 smithi084 ceph-mon[116404]: failed to encode map e242 with expected crc 2024-01-13T18:03:42.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:42 smithi084 ceph-mon[116404]: pgmap v74: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 194 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 96/480 objects degraded (20.000%) 2024-01-13T18:03:42.929 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:42 smithi084 ceph-osd[125969]: -- 172.21.15.84:0/2740989328 <== mon.2 v2:172.21.15.84:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bd7e1264e0 con 0x55bd7e0f7400 2024-01-13T18:03:42.930 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:42 smithi084 bash[125933]: e18181bdb4a8157a4ced9ae4bf26890fb6682efa35a8c30250eac1eb06c924d1 2024-01-13T18:03:42.930 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:42 smithi084 systemd[1]: Started Ceph osd.0 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:03:43.606 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[125947]: 2024-01-13T18:03:43.271+0000 7f97c5600640 -1 Falling back to public interface 2024-01-13T18:03:43.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[119097]: failed to encode map e242 with expected crc 2024-01-13T18:03:43.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[119097]: Health check failed: Degraded data redundancy: 96/480 objects degraded (20.000%), 15 pgs degraded (PG_DEGRADED) 2024-01-13T18:03:43.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[119097]: failed to encode map e243 with expected crc 2024-01-13T18:03:43.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[119097]: failed to encode map e243 with expected crc 2024-01-13T18:03:43.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[119097]: osdmap e243: 8 total, 7 up, 8 in 2024-01-13T18:03:43.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:43.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:43.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:43.617 INFO:tasks.rados.rados.0.smithi084.stdout:940: done (2 left) 2024-01-13T18:03:43.618 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 93 2024-01-13T18:03:43.618 INFO:tasks.rados.rados.0.smithi084.stdout:938: finishing copy_from to smithi084102331-41 2024-01-13T18:03:43.618 INFO:tasks.rados.rados.0.smithi084.stdout:938: got expected ENOENT (src dne) 2024-01-13T18:03:43.618 INFO:tasks.rados.rados.0.smithi084.stdout:941: seq_num 299 ranges {8282112=212992} 2024-01-13T18:03:43.664 INFO:tasks.rados.rados.0.smithi084.stdout:941: writing smithi084102331-5 from 8282112 to 8495104 tid 1 2024-01-13T18:03:43.665 INFO:tasks.rados.rados.0.smithi084.stdout:942: read oid 4 snap -1 2024-01-13T18:03:43.665 INFO:tasks.rados.rados.0.smithi084.stdout:942: expect (ObjNum 212 snap 60 seq_num 212) 2024-01-13T18:03:43.665 INFO:tasks.rados.rados.0.smithi084.stdout:943: setattr oid 6 current snap is 93 2024-01-13T18:03:43.665 INFO:tasks.rados.rados.0.smithi084.stdout:938: finishing copy_from racing read to smithi084102331-41 2024-01-13T18:03:43.665 INFO:tasks.rados.rados.0.smithi084.stdout:937: finishing write tid 1 to smithi084102331-42 2024-01-13T18:03:43.665 INFO:tasks.rados.rados.0.smithi084.stdout:937: finishing write tid 2 to smithi084102331-42 2024-01-13T18:03:43.665 INFO:tasks.rados.rados.0.smithi084.stdout:937: finishing write tid 3 to smithi084102331-42 2024-01-13T18:03:43.665 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 264 (ObjNum 298 snap 93 seq_num 298) dirty exists 2024-01-13T18:03:43.665 INFO:tasks.rados.rados.0.smithi084.stdout:937: left oid 42 (ObjNum 298 snap 93 seq_num 298) 2024-01-13T18:03:43.666 INFO:tasks.rados.rados.0.smithi084.stdout:937: done (4 left) 2024-01-13T18:03:43.666 INFO:tasks.rados.rados.0.smithi084.stdout:938: done (3 left) 2024-01-13T18:03:43.666 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 93 2024-01-13T18:03:43.666 INFO:tasks.rados.rados.0.smithi084.stdout:944: seq_num 300 ranges {4947968=229376} 2024-01-13T18:03:43.694 INFO:tasks.rados.rados.0.smithi084.stdout:944: writing smithi084102331-13 from 4947968 to 5177344 tid 1 2024-01-13T18:03:43.694 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 93 2024-01-13T18:03:43.694 INFO:tasks.rados.rados.0.smithi084.stdout:945: seq_num 301 ranges {180224=245760} 2024-01-13T18:03:43.697 INFO:tasks.rados.rados.0.smithi084.stdout:945: writing smithi084102331-38 from 180224 to 425984 tid 1 2024-01-13T18:03:43.697 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 262 (ObjNum 275 snap 87 seq_num 275) dirty exists 2024-01-13T18:03:43.698 INFO:tasks.rados.rados.0.smithi084.stdout:943: done (4 left) 2024-01-13T18:03:43.698 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 93 2024-01-13T18:03:43.698 INFO:tasks.rados.rados.0.smithi084.stdout:941: finishing write tid 1 to smithi084102331-5 2024-01-13T18:03:43.698 INFO:tasks.rados.rados.0.smithi084.stdout:946: seq_num 302 ranges {2539520=262144} 2024-01-13T18:03:43.712 INFO:tasks.rados.rados.0.smithi084.stdout:946: writing smithi084102331-45 from 2539520 to 2801664 tid 1 2024-01-13T18:03:43.712 INFO:tasks.rados.rados.0.smithi084.stdout:947: snap_remove snap 88 2024-01-13T18:03:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:43 smithi099 ceph-mon[138788]: failed to encode map e242 with expected crc 2024-01-13T18:03:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:43 smithi099 ceph-mon[138788]: Health check failed: Degraded data redundancy: 96/480 objects degraded (20.000%), 15 pgs degraded (PG_DEGRADED) 2024-01-13T18:03:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:43 smithi099 ceph-mon[138788]: failed to encode map e243 with expected crc 2024-01-13T18:03:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:43 smithi099 ceph-mon[138788]: failed to encode map e243 with expected crc 2024-01-13T18:03:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:43 smithi099 ceph-mon[138788]: osdmap e243: 8 total, 7 up, 8 in 2024-01-13T18:03:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:43.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:43.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[116404]: failed to encode map e242 with expected crc 2024-01-13T18:03:43.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[116404]: Health check failed: Degraded data redundancy: 96/480 objects degraded (20.000%), 15 pgs degraded (PG_DEGRADED) 2024-01-13T18:03:43.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[116404]: failed to encode map e243 with expected crc 2024-01-13T18:03:43.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[116404]: failed to encode map e243 with expected crc 2024-01-13T18:03:43.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[116404]: osdmap e243: 8 total, 7 up, 8 in 2024-01-13T18:03:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:44.622 INFO:tasks.rados.rados.0.smithi084.stdout:947: done (5 left) 2024-01-13T18:03:44.623 INFO:tasks.rados.rados.0.smithi084.stdout:948: setattr oid 16 current snap is 93 2024-01-13T18:03:44.623 INFO:tasks.rados.rados.0.smithi084.stdout:941: finishing write tid 2 to smithi084102331-5 2024-01-13T18:03:44.623 INFO:tasks.rados.rados.0.smithi084.stdout:942: expect (ObjNum 212 snap 60 seq_num 212) 2024-01-13T18:03:44.657 INFO:tasks.rados.rados.0.smithi084.stdout:941: finishing write tid 3 to smithi084102331-5 2024-01-13T18:03:44.657 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 272 (ObjNum 299 snap 93 seq_num 299) dirty exists 2024-01-13T18:03:44.657 INFO:tasks.rados.rados.0.smithi084.stdout:941: left oid 5 (ObjNum 299 snap 93 seq_num 299) 2024-01-13T18:03:44.657 INFO:tasks.rados.rados.0.smithi084.stdout:944: finishing write tid 1 to smithi084102331-13 2024-01-13T18:03:44.657 INFO:tasks.rados.rados.0.smithi084.stdout:944: finishing write tid 2 to smithi084102331-13 2024-01-13T18:03:44.657 INFO:tasks.rados.rados.0.smithi084.stdout:944: finishing write tid 3 to smithi084102331-13 2024-01-13T18:03:44.657 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 274 (ObjNum 300 snap 93 seq_num 300) dirty exists 2024-01-13T18:03:44.657 INFO:tasks.rados.rados.0.smithi084.stdout:944: left oid 13 (ObjNum 300 snap 93 seq_num 300) 2024-01-13T18:03:44.657 INFO:tasks.rados.rados.0.smithi084.stdout:945: finishing write tid 1 to smithi084102331-38 2024-01-13T18:03:44.657 INFO:tasks.rados.rados.0.smithi084.stdout:945: finishing write tid 2 to smithi084102331-38 2024-01-13T18:03:44.657 INFO:tasks.rados.rados.0.smithi084.stdout:945: finishing write tid 3 to smithi084102331-38 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 456 (ObjNum 301 snap 93 seq_num 301) dirty exists 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:945: left oid 38 (ObjNum 301 snap 93 seq_num 301) 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:946: finishing write tid 1 to smithi084102331-45 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:946: finishing write tid 2 to smithi084102331-45 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:946: finishing write tid 3 to smithi084102331-45 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 459 (ObjNum 302 snap 93 seq_num 302) dirty exists 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:946: left oid 45 (ObjNum 302 snap 93 seq_num 302) 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:941: done (5 left) 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:942: done (4 left) 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:944: done (3 left) 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:945: done (2 left) 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:946: done (1 left) 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:949: rollback oid 25 current snap is 93 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 25 to 84 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:950: read oid 33 snap -1 2024-01-13T18:03:44.658 INFO:tasks.rados.rados.0.smithi084.stdout:950: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:951: read oid 22 snap 89 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:951: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:952: read oid 24 snap -1 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:952: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:953: rollback oid 3 current snap is 93 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 69 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:954: setattr oid 17 current snap is 93 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:955: rollback oid 6 current snap is 93 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 6 to 74 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:956: rollback oid 34 current snap is 93 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 84 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:957: read oid 44 snap -1 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:957: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:958: read oid 15 snap 79 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:958: expect deleted 2024-01-13T18:03:44.659 INFO:tasks.rados.rados.0.smithi084.stdout:959: read oid 38 snap -1 2024-01-13T18:03:44.660 INFO:tasks.rados.rados.0.smithi084.stdout:959: expect (ObjNum 301 snap 93 seq_num 301) 2024-01-13T18:03:44.660 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 93 2024-01-13T18:03:44.660 INFO:tasks.rados.rados.0.smithi084.stdout:960: seq_num 303 ranges {1155072=278528} 2024-01-13T18:03:44.665 INFO:tasks.rados.rados.0.smithi084.stdout:960: writing smithi084102331-9 from 1155072 to 1433600 tid 1 2024-01-13T18:03:44.665 INFO:tasks.rados.rados.0.smithi084.stdout:961: snap_remove snap 66 2024-01-13T18:03:44.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:44 smithi084 ceph-mon[116404]: failed to encode map e244 with expected crc 2024-01-13T18:03:44.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:44 smithi084 ceph-mon[116404]: failed to encode map e244 with expected crc 2024-01-13T18:03:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:44 smithi084 ceph-mon[116404]: osdmap e244: 8 total, 7 up, 8 in 2024-01-13T18:03:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:44 smithi084 ceph-mon[116404]: failed to encode map e244 with expected crc 2024-01-13T18:03:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:44 smithi084 ceph-mon[116404]: pgmap v77: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 194 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 96/480 objects degraded (20.000%) 2024-01-13T18:03:44.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:44 smithi084 ceph-mon[119097]: failed to encode map e244 with expected crc 2024-01-13T18:03:44.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:44 smithi084 ceph-mon[119097]: failed to encode map e244 with expected crc 2024-01-13T18:03:44.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:44 smithi084 ceph-mon[119097]: osdmap e244: 8 total, 7 up, 8 in 2024-01-13T18:03:44.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:44 smithi084 ceph-mon[119097]: failed to encode map e244 with expected crc 2024-01-13T18:03:44.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:44 smithi084 ceph-mon[119097]: pgmap v77: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 194 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 96/480 objects degraded (20.000%) 2024-01-13T18:03:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:44 smithi099 ceph-mon[138788]: failed to encode map e244 with expected crc 2024-01-13T18:03:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:44 smithi099 ceph-mon[138788]: failed to encode map e244 with expected crc 2024-01-13T18:03:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:44 smithi099 ceph-mon[138788]: osdmap e244: 8 total, 7 up, 8 in 2024-01-13T18:03:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:44 smithi099 ceph-mon[138788]: failed to encode map e244 with expected crc 2024-01-13T18:03:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:44 smithi099 ceph-mon[138788]: pgmap v77: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 194 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 96/480 objects degraded (20.000%) 2024-01-13T18:03:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:961: done (13 left) 2024-01-13T18:03:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:962: setattr oid 12 current snap is 93 2024-01-13T18:03:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:957: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:03:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:950: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:03:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:949: finishing rollback tid 1 to smithi084102331-25 2024-01-13T18:03:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 0 (ObjNum 33 snap 0 seq_num 4037138992) dirty dne 2024-01-13T18:03:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:953: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:03:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:955: finishing rollback tid 0 to smithi084102331-6 2024-01-13T18:03:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:955: finishing rollback tid 1 to smithi084102331-6 2024-01-13T18:03:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 285 (ObjNum 251 snap 75 seq_num 251) dirty exists 2024-01-13T18:03:45.645 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 275 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:03:45.645 INFO:tasks.rados.rados.0.smithi084.stdout:955: finishing rollback tid 2 to smithi084102331-6 2024-01-13T18:03:45.645 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 265 (ObjNum 235 snap 71 seq_num 235) dirty exists 2024-01-13T18:03:45.645 INFO:tasks.rados.rados.0.smithi084.stdout:953: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:03:45.645 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 461 (ObjNum 215 snap 61 seq_num 215) dirty exists 2024-01-13T18:03:45.645 INFO:tasks.rados.rados.0.smithi084.stdout:959: expect (ObjNum 301 snap 93 seq_num 301) 2024-01-13T18:03:45.658 INFO:tasks.rados.rados.0.smithi084.stdout:956: finishing rollback tid 0 to smithi084102331-34 2024-01-13T18:03:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:956: finishing rollback tid 1 to smithi084102331-34 2024-01-13T18:03:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:956: finishing rollback tid 2 to smithi084102331-34 2024-01-13T18:03:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 269 (ObjNum 214 snap 61 seq_num 214) dirty exists 2024-01-13T18:03:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:960: finishing write tid 1 to smithi084102331-9 2024-01-13T18:03:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:960: finishing write tid 2 to smithi084102331-9 2024-01-13T18:03:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:960: finishing write tid 3 to smithi084102331-9 2024-01-13T18:03:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 272 (ObjNum 303 snap 93 seq_num 303) dirty exists 2024-01-13T18:03:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:960: left oid 9 (ObjNum 303 snap 93 seq_num 303) 2024-01-13T18:03:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:951: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:03:45.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: osdmap e245: 8 total, 7 up, 8 in 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: osdmap e245: 8 total, 7 up, 8 in 2024-01-13T18:03:45.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: failed to encode map e245 with expected crc 2024-01-13T18:03:45.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:45.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:45.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:45.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:45 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:45.930 INFO:tasks.rados.rados.0.smithi084.stdout:952: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:03:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: failed to encode map e245 with expected crc 2024-01-13T18:03:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: failed to encode map e245 with expected crc 2024-01-13T18:03:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: osdmap e245: 8 total, 7 up, 8 in 2024-01-13T18:03:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: failed to encode map e245 with expected crc 2024-01-13T18:03:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: failed to encode map e245 with expected crc 2024-01-13T18:03:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: failed to encode map e245 with expected crc 2024-01-13T18:03:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: failed to encode map e245 with expected crc 2024-01-13T18:03:46.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: failed to encode map e245 with expected crc 2024-01-13T18:03:46.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:46.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:46.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:46.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:45 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:46.261 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[125947]: 2024-01-13T18:03:46.088+0000 7f97c5600640 -1 osd.0 0 read_superblock omap replica is missing. 2024-01-13T18:03:46.261 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[125947]: 2024-01-13T18:03:46.154+0000 7f97c5600640 -1 osd.0 239 log_to_monitors true 2024-01-13T18:03:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 367 (ObjNum 753 snap 0 seq_num 3552014080) dirty exists 2024-01-13T18:03:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:948: done (13 left) 2024-01-13T18:03:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:949: done (12 left) 2024-01-13T18:03:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:950: done (11 left) 2024-01-13T18:03:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:951: done (10 left) 2024-01-13T18:03:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:952: done (9 left) 2024-01-13T18:03:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:953: done (8 left) 2024-01-13T18:03:46.414 INFO:tasks.rados.rados.0.smithi084.stdout:954: done (7 left) 2024-01-13T18:03:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:955: done (6 left) 2024-01-13T18:03:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:956: done (5 left) 2024-01-13T18:03:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:957: done (4 left) 2024-01-13T18:03:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:958: done (3 left) 2024-01-13T18:03:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:959: done (2 left) 2024-01-13T18:03:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:960: done (1 left) 2024-01-13T18:03:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:962: done (0 left) 2024-01-13T18:03:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:963: rmattr oid 33 current snap is 93 2024-01-13T18:03:46.415 INFO:tasks.rados.rados.0.smithi084.stdout:964: snap_remove snap 89 2024-01-13T18:03:46.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-mon[119097]: failed to encode map e246 with expected crc 2024-01-13T18:03:46.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-mon[119097]: osdmap e246: 8 total, 7 up, 8 in 2024-01-13T18:03:46.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-mon[119097]: failed to encode map e246 with expected crc 2024-01-13T18:03:46.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-mon[119097]: pgmap v80: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 193 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 348 KiB/s wr, 31 op/s; 100/483 objects degraded (20.704%) 2024-01-13T18:03:46.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-mon[119097]: from='osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-13T18:03:46.639 INFO:tasks.rados.rados.0.smithi084.stdout:964: done (1 left) 2024-01-13T18:03:46.639 INFO:tasks.rados.rados.0.smithi084.stdout:965: rollback oid 1 current snap is 93 2024-01-13T18:03:46.639 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 1 to 84 2024-01-13T18:03:46.639 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 421 (ObjNum 4449 snap 0 seq_num 3552014912) dirty exists 2024-01-13T18:03:46.639 INFO:tasks.rados.rados.0.smithi084.stdout:963: done (1 left) 2024-01-13T18:03:46.639 INFO:tasks.rados.rados.0.smithi084.stdout:966: delete oid 5 current snap is 93 2024-01-13T18:03:46.648 INFO:tasks.rados.rados.0.smithi084.stdout:966: done (1 left) 2024-01-13T18:03:46.649 INFO:tasks.rados.rados.0.smithi084.stdout:967: delete oid 21 current snap is 93 2024-01-13T18:03:46.651 INFO:tasks.rados.rados.0.smithi084.stdout:965: finishing rollback tid 0 to smithi084102331-1 2024-01-13T18:03:46.651 INFO:tasks.rados.rados.0.smithi084.stdout:965: finishing rollback tid 1 to smithi084102331-1 2024-01-13T18:03:46.651 INFO:tasks.rados.rados.0.smithi084.stdout:965: finishing rollback tid 2 to smithi084102331-1 2024-01-13T18:03:46.651 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 465 (ObjNum 249 snap 75 seq_num 249) dirty exists 2024-01-13T18:03:46.651 INFO:tasks.rados.rados.0.smithi084.stdout:965: done (1 left) 2024-01-13T18:03:46.651 INFO:tasks.rados.rados.0.smithi084.stdout:967: done (0 left) 2024-01-13T18:03:46.651 INFO:tasks.rados.rados.0.smithi084.stdout:968: snap_remove snap 84 2024-01-13T18:03:46.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-mon[116404]: failed to encode map e246 with expected crc 2024-01-13T18:03:46.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-mon[116404]: osdmap e246: 8 total, 7 up, 8 in 2024-01-13T18:03:46.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-mon[116404]: failed to encode map e246 with expected crc 2024-01-13T18:03:46.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-mon[116404]: pgmap v80: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 193 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 348 KiB/s wr, 31 op/s; 100/483 objects degraded (20.704%) 2024-01-13T18:03:46.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-mon[116404]: from='osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-13T18:03:46.930 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 18:03:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[125947]: 2024-01-13T18:03:46.676+0000 7f97b3254700 -1 osd.0 239 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T18:03:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:46 smithi099 ceph-mon[138788]: failed to encode map e246 with expected crc 2024-01-13T18:03:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:46 smithi099 ceph-mon[138788]: osdmap e246: 8 total, 7 up, 8 in 2024-01-13T18:03:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:46 smithi099 ceph-mon[138788]: failed to encode map e246 with expected crc 2024-01-13T18:03:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:46 smithi099 ceph-mon[138788]: pgmap v80: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 193 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 348 KiB/s wr, 31 op/s; 100/483 objects degraded (20.704%) 2024-01-13T18:03:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:46 smithi099 ceph-mon[138788]: from='osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-13T18:03:47.571 INFO:tasks.rados.rados.0.smithi084.stdout:968: done (0 left) 2024-01-13T18:03:47.571 INFO:tasks.rados.rados.0.smithi084.stdout:969: snap_remove snap 80 2024-01-13T18:03:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:03:47.863+0000 7fcaf82a4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-01-13T18:03:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[119097]: failed to encode map e247 with expected crc 2024-01-13T18:03:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[119097]: failed to encode map e247 with expected crc 2024-01-13T18:03:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[119097]: from='osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-13T18:03:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[119097]: osdmap e247: 8 total, 7 up, 8 in 2024-01-13T18:03:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[119097]: from='osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:03:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[119097]: failed to encode map e247 with expected crc 2024-01-13T18:03:47.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[119097]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[119097]: osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474] boot 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[119097]: osdmap e248: 8 total, 8 up, 8 in 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[116404]: failed to encode map e247 with expected crc 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[116404]: failed to encode map e247 with expected crc 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[116404]: from='osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[116404]: osdmap e247: 8 total, 7 up, 8 in 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[116404]: from='osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[116404]: failed to encode map e247 with expected crc 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[116404]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[116404]: osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474] boot 2024-01-13T18:03:47.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[116404]: osdmap e248: 8 total, 8 up, 8 in 2024-01-13T18:03:47.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:47 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:03:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:47 smithi099 ceph-mon[138788]: failed to encode map e247 with expected crc 2024-01-13T18:03:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:47 smithi099 ceph-mon[138788]: failed to encode map e247 with expected crc 2024-01-13T18:03:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:47 smithi099 ceph-mon[138788]: from='osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-13T18:03:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:47 smithi099 ceph-mon[138788]: osdmap e247: 8 total, 7 up, 8 in 2024-01-13T18:03:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:47 smithi099 ceph-mon[138788]: from='osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:03:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:47 smithi099 ceph-mon[138788]: failed to encode map e247 with expected crc 2024-01-13T18:03:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:47 smithi099 ceph-mon[138788]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:03:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:47 smithi099 ceph-mon[138788]: osd.0 [v2:172.21.15.84:6802/3732569474,v1:172.21.15.84:6803/3732569474] boot 2024-01-13T18:03:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:47 smithi099 ceph-mon[138788]: osdmap e248: 8 total, 8 up, 8 in 2024-01-13T18:03:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:47 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-13T18:03:48.575 INFO:tasks.rados.rados.0.smithi084.stdout:969: done (0 left) 2024-01-13T18:03:48.575 INFO:tasks.rados.rados.0.smithi084.stdout:970: snap_create 2024-01-13T18:03:48.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: failed to encode map e248 with expected crc 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: failed to encode map e248 with expected crc 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-01-13T18:03:48.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: pgmap v83: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 193 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 348 KiB/s wr, 31 op/s; 100/483 objects degraded (20.704%) 2024-01-13T18:03:48.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[116404]: osdmap e249: 8 total, 8 up, 8 in 2024-01-13T18:03:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: failed to encode map e248 with expected crc 2024-01-13T18:03:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: failed to encode map e248 with expected crc 2024-01-13T18:03:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:03:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:48.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:48.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:48.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:03:48.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:03:48.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-01-13T18:03:48.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: pgmap v83: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 193 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 348 KiB/s wr, 31 op/s; 100/483 objects degraded (20.704%) 2024-01-13T18:03:48.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:48 smithi084 ceph-mon[119097]: osdmap e249: 8 total, 8 up, 8 in 2024-01-13T18:03:49.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:03:48.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:03:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: failed to encode map e248 with expected crc 2024-01-13T18:03:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: failed to encode map e248 with expected crc 2024-01-13T18:03:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:03:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:03:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:03:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:03:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:03:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-01-13T18:03:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: pgmap v83: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 193 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 348 KiB/s wr, 31 op/s; 100/483 objects degraded (20.704%) 2024-01-13T18:03:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:48 smithi099 ceph-mon[138788]: osdmap e249: 8 total, 8 up, 8 in 2024-01-13T18:03:49.575 INFO:tasks.rados.rados.0.smithi084.stdout:970: done (0 left) 2024-01-13T18:03:49.575 INFO:tasks.rados.rados.0.smithi084.stdout:971: rollback oid 48 current snap is 94 2024-01-13T18:03:49.575 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 48 to 87 2024-01-13T18:03:49.576 INFO:tasks.rados.rados.0.smithi084.stdout:972: copy_from oid 4 from oid 24 current snap is 94 2024-01-13T18:03:49.576 INFO:tasks.rados.rados.0.smithi084.stdout:973: snap_create 2024-01-13T18:03:49.581 INFO:tasks.rados.rados.0.smithi084.stdout:971: finishing rollback tid 0 to smithi084102331-48 2024-01-13T18:03:49.582 INFO:tasks.rados.rados.0.smithi084.stdout:971: finishing rollback tid 1 to smithi084102331-48 2024-01-13T18:03:49.582 INFO:tasks.rados.rados.0.smithi084.stdout:971: finishing rollback tid 2 to smithi084102331-48 2024-01-13T18:03:49.583 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 379 (ObjNum 247 snap 74 seq_num 247) dirty exists 2024-01-13T18:03:49.613 INFO:tasks.rados.rados.0.smithi084.stdout:972: finishing copy_from to smithi084102331-4 2024-01-13T18:03:49.613 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 270 (ObjNum 251 snap 75 seq_num 251) dirty exists 2024-01-13T18:03:49.614 INFO:tasks.rados.rados.0.smithi084.stdout:972: finishing copy_from racing read to smithi084102331-4 2024-01-13T18:03:49.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[116404]: osdmap e250: 8 total, 8 up, 8 in 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: failed to encode map e249 with expected crc 2024-01-13T18:03:49.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:49 smithi084 ceph-mon[119097]: osdmap e250: 8 total, 8 up, 8 in 2024-01-13T18:03:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: failed to encode map e249 with expected crc 2024-01-13T18:03:50.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:49 smithi099 ceph-mon[138788]: osdmap e250: 8 total, 8 up, 8 in 2024-01-13T18:03:50.576 INFO:tasks.rados.rados.0.smithi084.stdout:971: done (2 left) 2024-01-13T18:03:50.577 INFO:tasks.rados.rados.0.smithi084.stdout:972: done (1 left) 2024-01-13T18:03:50.577 INFO:tasks.rados.rados.0.smithi084.stdout:973: done (0 left) 2024-01-13T18:03:50.577 INFO:tasks.rados.rados.0.smithi084.stdout:974: read oid 34 snap 83 2024-01-13T18:03:50.577 INFO:tasks.rados.rados.0.smithi084.stdout:974: expect (ObjNum 214 snap 61 seq_num 214) 2024-01-13T18:03:50.577 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 95 2024-01-13T18:03:50.577 INFO:tasks.rados.rados.0.smithi084.stdout:975: seq_num 306 ranges {2801664=327680} 2024-01-13T18:03:50.594 INFO:tasks.rados.rados.0.smithi084.stdout:975: writing smithi084102331-45 from 2801664 to 3129344 tid 1 2024-01-13T18:03:50.594 INFO:tasks.rados.rados.0.smithi084.stdout:976: delete oid 48 current snap is 95 2024-01-13T18:03:50.595 INFO:tasks.rados.rados.0.smithi084.stdout:974: expect (ObjNum 214 snap 61 seq_num 214) 2024-01-13T18:03:50.644 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[119097]: failed to encode map e250 with expected crc 2024-01-13T18:03:50.644 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:03:50] "GET /metrics HTTP/1.1" 200 35925 "" "Prometheus/2.43.0" 2024-01-13T18:03:50.754 INFO:tasks.rados.rados.0.smithi084.stdout:975: finishing write tid 1 to smithi084102331-45 2024-01-13T18:03:50.755 INFO:tasks.rados.rados.0.smithi084.stdout:975: finishing write tid 2 to smithi084102331-45 2024-01-13T18:03:50.755 INFO:tasks.rados.rados.0.smithi084.stdout:975: finishing write tid 3 to smithi084102331-45 2024-01-13T18:03:50.755 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 486 (ObjNum 306 snap 95 seq_num 306) dirty exists 2024-01-13T18:03:50.755 INFO:tasks.rados.rados.0.smithi084.stdout:975: left oid 45 (ObjNum 306 snap 95 seq_num 306) 2024-01-13T18:03:50.755 INFO:tasks.rados.rados.0.smithi084.stdout:974: done (2 left) 2024-01-13T18:03:50.755 INFO:tasks.rados.rados.0.smithi084.stdout:975: done (1 left) 2024-01-13T18:03:50.755 INFO:tasks.rados.rados.0.smithi084.stdout:976: done (0 left) 2024-01-13T18:03:50.755 INFO:tasks.rados.rados.0.smithi084.stdout:977: setattr oid 29 current snap is 95 2024-01-13T18:03:50.757 INFO:tasks.rados.rados.0.smithi084.stdout:978: rollback oid 3 current snap is 95 2024-01-13T18:03:50.757 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 83 2024-01-13T18:03:50.757 INFO:tasks.rados.rados.0.smithi084.stdout:979: snap_create 2024-01-13T18:03:50.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 311 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:03:50.760 INFO:tasks.rados.rados.0.smithi084.stdout:978: finishing rollback tid 0 to smithi084102331-3 2024-01-13T18:03:50.760 INFO:tasks.rados.rados.0.smithi084.stdout:978: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:03:50.760 INFO:tasks.rados.rados.0.smithi084.stdout:978: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:03:50.760 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 490 (ObjNum 215 snap 61 seq_num 215) dirty exists 2024-01-13T18:03:50.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[119097]: failed to encode map e250 with expected crc 2024-01-13T18:03:50.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[119097]: failed to encode map e250 with expected crc 2024-01-13T18:03:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[119097]: pgmap v86: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 193 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 100/483 objects degraded (20.704%) 2024-01-13T18:03:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[119097]: osdmap e251: 8 total, 8 up, 8 in 2024-01-13T18:03:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[116404]: failed to encode map e250 with expected crc 2024-01-13T18:03:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[116404]: failed to encode map e250 with expected crc 2024-01-13T18:03:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[116404]: failed to encode map e250 with expected crc 2024-01-13T18:03:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[116404]: pgmap v86: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 193 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 100/483 objects degraded (20.704%) 2024-01-13T18:03:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:50 smithi084 ceph-mon[116404]: osdmap e251: 8 total, 8 up, 8 in 2024-01-13T18:03:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:50 smithi099 ceph-mon[138788]: failed to encode map e250 with expected crc 2024-01-13T18:03:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:50 smithi099 ceph-mon[138788]: failed to encode map e250 with expected crc 2024-01-13T18:03:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:50 smithi099 ceph-mon[138788]: failed to encode map e250 with expected crc 2024-01-13T18:03:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:50 smithi099 ceph-mon[138788]: pgmap v86: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 193 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 100/483 objects degraded (20.704%) 2024-01-13T18:03:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:03:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:03:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:50 smithi099 ceph-mon[138788]: osdmap e251: 8 total, 8 up, 8 in 2024-01-13T18:03:51.652 INFO:tasks.rados.rados.0.smithi084.stdout:977: done (2 left) 2024-01-13T18:03:51.652 INFO:tasks.rados.rados.0.smithi084.stdout:978: done (1 left) 2024-01-13T18:03:51.652 INFO:tasks.rados.rados.0.smithi084.stdout:979: done (0 left) 2024-01-13T18:03:51.652 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 96 2024-01-13T18:03:51.652 INFO:tasks.rados.rados.0.smithi084.stdout:980: seq_num 308 ranges {0=360448} 2024-01-13T18:03:51.654 INFO:tasks.rados.rados.0.smithi084.stdout:980: writing smithi084102331-36 from 0 to 360448 tid 1 2024-01-13T18:03:51.654 INFO:tasks.rados.rados.0.smithi084.stdout:981: read oid 24 snap -1 2024-01-13T18:03:51.654 INFO:tasks.rados.rados.0.smithi084.stdout:981: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:03:51.654 INFO:tasks.rados.rados.0.smithi084.stdout:982: snap_remove snap 87 2024-01-13T18:03:51.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:51 smithi084 ceph-mon[116404]: failed to encode map e251 with expected crc 2024-01-13T18:03:51.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:51 smithi084 ceph-mon[116404]: failed to encode map e251 with expected crc 2024-01-13T18:03:51.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:51 smithi084 ceph-mon[119097]: failed to encode map e251 with expected crc 2024-01-13T18:03:51.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:51 smithi084 ceph-mon[119097]: failed to encode map e251 with expected crc 2024-01-13T18:03:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:51 smithi099 ceph-mon[138788]: failed to encode map e251 with expected crc 2024-01-13T18:03:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:51 smithi099 ceph-mon[138788]: failed to encode map e251 with expected crc 2024-01-13T18:03:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:982: done (2 left) 2024-01-13T18:03:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:983: read oid 22 snap -1 2024-01-13T18:03:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:983: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:03:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:984: read oid 46 snap -1 2024-01-13T18:03:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:984: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:03:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:985: rmattr oid 42 current snap is 96 2024-01-13T18:03:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:986: read oid 23 snap -1 2024-01-13T18:03:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:986: expect (ObjNum 226 snap 69 seq_num 226) 2024-01-13T18:03:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 96 2024-01-13T18:03:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:987: seq_num 309 ranges {2138112=376832} 2024-01-13T18:03:52.681 INFO:tasks.rados.rados.0.smithi084.stdout:987: writing smithi084102331-32 from 2138112 to 2514944 tid 1 2024-01-13T18:03:52.681 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 96 2024-01-13T18:03:52.681 INFO:tasks.rados.rados.0.smithi084.stdout:980: finishing write tid 1 to smithi084102331-36 2024-01-13T18:03:52.681 INFO:tasks.rados.rados.0.smithi084.stdout:980: finishing write tid 2 to smithi084102331-36 2024-01-13T18:03:52.681 INFO:tasks.rados.rados.0.smithi084.stdout:980: finishing write tid 3 to smithi084102331-36 2024-01-13T18:03:52.681 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 356 (ObjNum 308 snap 96 seq_num 308) dirty exists 2024-01-13T18:03:52.681 INFO:tasks.rados.rados.0.smithi084.stdout:980: left oid 36 (ObjNum 308 snap 96 seq_num 308) 2024-01-13T18:03:52.682 INFO:tasks.rados.rados.0.smithi084.stdout:981: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:03:52.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[119097]: failed to encode map e252 with expected crc 2024-01-13T18:03:52.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[119097]: failed to encode map e252 with expected crc 2024-01-13T18:03:52.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[119097]: osdmap e252: 8 total, 8 up, 8 in 2024-01-13T18:03:52.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[119097]: failed to encode map e252 with expected crc 2024-01-13T18:03:52.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[119097]: failed to encode map e252 with expected crc 2024-01-13T18:03:52.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[119097]: pgmap v89: 121 pgs: 121 active+clean; 199 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 11 op/s; 16 MiB/s, 6 objects/s recovering 2024-01-13T18:03:52.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 100/483 objects degraded (20.704%), 15 pgs degraded (PG_DEGRADED) 2024-01-13T18:03:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[116404]: failed to encode map e252 with expected crc 2024-01-13T18:03:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[116404]: failed to encode map e252 with expected crc 2024-01-13T18:03:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[116404]: osdmap e252: 8 total, 8 up, 8 in 2024-01-13T18:03:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[116404]: failed to encode map e252 with expected crc 2024-01-13T18:03:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[116404]: failed to encode map e252 with expected crc 2024-01-13T18:03:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[116404]: pgmap v89: 121 pgs: 121 active+clean; 199 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 11 op/s; 16 MiB/s, 6 objects/s recovering 2024-01-13T18:03:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:52 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 100/483 objects degraded (20.704%), 15 pgs degraded (PG_DEGRADED) 2024-01-13T18:03:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:52 smithi099 ceph-mon[138788]: failed to encode map e252 with expected crc 2024-01-13T18:03:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:52 smithi099 ceph-mon[138788]: failed to encode map e252 with expected crc 2024-01-13T18:03:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:52 smithi099 ceph-mon[138788]: osdmap e252: 8 total, 8 up, 8 in 2024-01-13T18:03:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:52 smithi099 ceph-mon[138788]: failed to encode map e252 with expected crc 2024-01-13T18:03:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:52 smithi099 ceph-mon[138788]: failed to encode map e252 with expected crc 2024-01-13T18:03:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:52 smithi099 ceph-mon[138788]: pgmap v89: 121 pgs: 121 active+clean; 199 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 11 op/s; 16 MiB/s, 6 objects/s recovering 2024-01-13T18:03:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:52 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 100/483 objects degraded (20.704%), 15 pgs degraded (PG_DEGRADED) 2024-01-13T18:03:53.140 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 265 (ObjNum 298 snap 93 seq_num 298) dirty exists 2024-01-13T18:03:53.140 INFO:tasks.rados.rados.0.smithi084.stdout:984: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:03:53.179 INFO:tasks.rados.rados.0.smithi084.stdout:987: finishing write tid 1 to smithi084102331-32 2024-01-13T18:03:53.179 INFO:tasks.rados.rados.0.smithi084.stdout:987: finishing write tid 2 to smithi084102331-32 2024-01-13T18:03:53.180 INFO:tasks.rados.rados.0.smithi084.stdout:987: finishing write tid 3 to smithi084102331-32 2024-01-13T18:03:53.180 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 397 (ObjNum 309 snap 96 seq_num 309) dirty exists 2024-01-13T18:03:53.180 INFO:tasks.rados.rados.0.smithi084.stdout:987: left oid 32 (ObjNum 309 snap 96 seq_num 309) 2024-01-13T18:03:53.180 INFO:tasks.rados.rados.0.smithi084.stdout:983: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:03:53.238 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:03:53.446 INFO:tasks.rados.rados.0.smithi084.stdout:986: expect (ObjNum 226 snap 69 seq_num 226) 2024-01-13T18:03:53.553 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:03:53.553 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (2m) 8s ago 4m 16.8M - 0.25.0 c8568f914cd2 a5cbc3e01ffb 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (106s) 35s ago 4m 79.4M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (5m) 8s ago 5m 15.5M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (5m) 35s ago 5m 20.0M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (81s) 35s ago 7m 447M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (101s) 8s ago 9m 505M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (71s) 8s ago 9m 68.9M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d b64908c7a53c 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (44s) 35s ago 8m 23.8M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d be7bb477ea53 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (52s) 8s ago 7m 42.5M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d e13f01b852ff 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (119s) 8s ago 4m 10.2M - 1.5.0 0da6a335fe13 b72e6d50f165 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (104s) 35s ago 4m 8514k - 1.5.0 0da6a335fe13 e9f879b5e55b 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (10s) 8s ago 7m 11.5M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d e18181bdb4a8 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (7m) 8s ago 7m 286M 2488M 17.2.7-268-g6441305d c3a232f785d8 fad77ee705d8 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (7m) 8s ago 7m 295M 2488M 17.2.7-268-g6441305d c3a232f785d8 14025770cf00 2024-01-13T18:03:53.554 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (6m) 8s ago 6m 242M 2488M 17.2.7-268-g6441305d c3a232f785d8 068cf98fa99c 2024-01-13T18:03:53.555 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (6m) 35s ago 6m 272M 2488M 17.2.7-268-g6441305d c3a232f785d8 30e0722550a0 2024-01-13T18:03:53.555 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (6m) 35s ago 6m 268M 2488M 17.2.7-268-g6441305d c3a232f785d8 51be805dde78 2024-01-13T18:03:53.555 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (5m) 35s ago 5m 198M 2488M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:03:53.555 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (5m) 35s ago 5m 144M 2488M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:03:53.555 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (84s) 35s ago 4m 48.2M - 2.43.0 a07b618ecd1d cb4c11bf6eec 2024-01-13T18:03:53.638 INFO:tasks.rados.rados.0.smithi084.stdout:988: seq_num 310 ranges {1982464=401408} 2024-01-13T18:03:53.653 INFO:tasks.rados.rados.0.smithi084.stdout:988: writing smithi084102331-3 from 1982464 to 2383872 tid 1 2024-01-13T18:03:53.653 INFO:tasks.rados.rados.0.smithi084.stdout:980: done (7 left) 2024-01-13T18:03:53.653 INFO:tasks.rados.rados.0.smithi084.stdout:981: done (6 left) 2024-01-13T18:03:53.653 INFO:tasks.rados.rados.0.smithi084.stdout:983: done (5 left) 2024-01-13T18:03:53.653 INFO:tasks.rados.rados.0.smithi084.stdout:984: done (4 left) 2024-01-13T18:03:53.653 INFO:tasks.rados.rados.0.smithi084.stdout:985: done (3 left) 2024-01-13T18:03:53.653 INFO:tasks.rados.rados.0.smithi084.stdout:986: done (2 left) 2024-01-13T18:03:53.654 INFO:tasks.rados.rados.0.smithi084.stdout:987: done (1 left) 2024-01-13T18:03:53.654 INFO:tasks.rados.rados.0.smithi084.stdout:989: copy_from oid 43 from oid 2 current snap is 96 2024-01-13T18:03:53.654 INFO:tasks.rados.rados.0.smithi084.stdout:990: rollback oid 42 current snap is 96 2024-01-13T18:03:53.654 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 81 2024-01-13T18:03:53.654 INFO:tasks.rados.rados.0.smithi084.stdout:991: copy_from oid 31 from oid 7 current snap is 96 2024-01-13T18:03:53.654 INFO:tasks.rados.rados.0.smithi084.stdout:992: read oid 19 snap 92 2024-01-13T18:03:53.654 INFO:tasks.rados.rados.0.smithi084.stdout:992: expect deleted 2024-01-13T18:03:53.654 INFO:tasks.rados.rados.0.smithi084.stdout:993: copy_from oid 1 from oid 47 current snap is 96 2024-01-13T18:03:53.654 INFO:tasks.rados.rados.0.smithi084.stdout:994: snap_create 2024-01-13T18:03:53.655 INFO:tasks.rados.rados.0.smithi084.stdout:990: finishing rollback tid 0 to smithi084102331-42 2024-01-13T18:03:53.656 INFO:tasks.rados.rados.0.smithi084.stdout:988: finishing write tid 1 to smithi084102331-3 2024-01-13T18:03:53.656 INFO:tasks.rados.rados.0.smithi084.stdout:991: finishing copy_from to smithi084102331-31 2024-01-13T18:03:53.656 INFO:tasks.rados.rados.0.smithi084.stdout:991: got expected ENOENT (src dne) 2024-01-13T18:03:53.656 INFO:tasks.rados.rados.0.smithi084.stdout:991: finishing copy_from racing read to smithi084102331-31 2024-01-13T18:03:53.657 INFO:tasks.rados.rados.0.smithi084.stdout:988: finishing write tid 2 to smithi084102331-3 2024-01-13T18:03:53.658 INFO:tasks.rados.rados.0.smithi084.stdout:990: finishing rollback tid 1 to smithi084102331-42 2024-01-13T18:03:53.658 INFO:tasks.rados.rados.0.smithi084.stdout:988: finishing write tid 3 to smithi084102331-3 2024-01-13T18:03:53.658 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 499 (ObjNum 310 snap 96 seq_num 310) dirty exists 2024-01-13T18:03:53.658 INFO:tasks.rados.rados.0.smithi084.stdout:988: left oid 3 (ObjNum 310 snap 96 seq_num 310) 2024-01-13T18:03:53.659 INFO:tasks.rados.rados.0.smithi084.stdout:990: finishing rollback tid 2 to smithi084102331-42 2024-01-13T18:03:53.659 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 268 (ObjNum 146 snap 40 seq_num 146) dirty exists 2024-01-13T18:03:53.667 INFO:tasks.rados.rados.0.smithi084.stdout:988: done (6 left) 2024-01-13T18:03:53.667 INFO:tasks.rados.rados.0.smithi084.stdout:990: done (5 left) 2024-01-13T18:03:53.667 INFO:tasks.rados.rados.0.smithi084.stdout:991: done (4 left) 2024-01-13T18:03:53.667 INFO:tasks.rados.rados.0.smithi084.stdout:992: done (3 left) 2024-01-13T18:03:53.668 INFO:tasks.rados.rados.0.smithi084.stdout:994: done (2 left) 2024-01-13T18:03:53.668 INFO:tasks.rados.rados.0.smithi084.stdout:995: read oid 42 snap -1 2024-01-13T18:03:53.668 INFO:tasks.rados.rados.0.smithi084.stdout:995: expect (ObjNum 146 snap 40 seq_num 146) 2024-01-13T18:03:53.668 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 97 2024-01-13T18:03:53.668 INFO:tasks.rados.rados.0.smithi084.stdout:996: seq_num 311 ranges {8011776=417792} 2024-01-13T18:03:53.715 INFO:tasks.rados.rados.0.smithi084.stdout:996: writing smithi084102331-10 from 8011776 to 8429568 tid 1 2024-01-13T18:03:53.715 INFO:tasks.rados.rados.0.smithi084.stdout:997: copy_from oid 3 from oid 28 current snap is 97 2024-01-13T18:03:53.715 INFO:tasks.rados.rados.0.smithi084.stdout:989: finishing copy_from to smithi084102331-43 2024-01-13T18:03:53.715 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 324 (ObjNum 266 snap 83 seq_num 266) dirty exists 2024-01-13T18:03:53.715 INFO:tasks.rados.rados.0.smithi084.stdout:989: finishing copy_from racing read to smithi084102331-43 2024-01-13T18:03:53.715 INFO:tasks.rados.rados.0.smithi084.stdout:995: expect (ObjNum 146 snap 40 seq_num 146) 2024-01-13T18:03:53.743 INFO:tasks.rados.rados.0.smithi084.stdout:993: finishing copy_from to smithi084102331-1 2024-01-13T18:03:53.743 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 370 (ObjNum 286 snap 89 seq_num 286) dirty exists 2024-01-13T18:03:53.743 INFO:tasks.rados.rados.0.smithi084.stdout:993: finishing copy_from racing read to smithi084102331-1 2024-01-13T18:03:53.743 INFO:tasks.rados.rados.0.smithi084.stdout:996: finishing write tid 1 to smithi084102331-10 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:996: finishing write tid 2 to smithi084102331-10 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:996: finishing write tid 3 to smithi084102331-10 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 179 (ObjNum 311 snap 97 seq_num 311) dirty exists 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:996: left oid 10 (ObjNum 311 snap 97 seq_num 311) 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:989: done (4 left) 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:993: done (3 left) 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:995: done (2 left) 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:996: done (1 left) 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:998: copy_from oid 30 from oid 4 current snap is 97 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:999: read oid 1 snap -1 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:999: expect (ObjNum 286 snap 89 seq_num 286) 2024-01-13T18:03:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:1000: setattr oid 19 current snap is 97 2024-01-13T18:03:53.745 INFO:tasks.rados.rados.0.smithi084.stdout:1001: rollback oid 40 current snap is 97 2024-01-13T18:03:53.745 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 74 2024-01-13T18:03:53.745 INFO:tasks.rados.rados.0.smithi084.stdout:1002: rollback oid 44 current snap is 97 2024-01-13T18:03:53.745 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 82 2024-01-13T18:03:53.745 INFO:tasks.rados.rados.0.smithi084.stdout:1003: read oid 24 snap -1 2024-01-13T18:03:53.745 INFO:tasks.rados.rados.0.smithi084.stdout:1003: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:03:53.745 INFO:tasks.rados.rados.0.smithi084.stdout:1004: rollback oid 39 current snap is 97 2024-01-13T18:03:53.746 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 72 2024-01-13T18:03:53.746 INFO:tasks.rados.rados.0.smithi084.stdout:1005: delete oid 33 current snap is 97 2024-01-13T18:03:53.751 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 155 (ObjNum 33 snap 0 seq_num 4037718128) dirty exists 2024-01-13T18:03:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:1001: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:03:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:1001: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:03:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:1001: finishing rollback tid 2 to smithi084102331-40 2024-01-13T18:03:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 321 (ObjNum 225 snap 69 seq_num 225) dirty exists 2024-01-13T18:03:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:1000: done (8 left) 2024-01-13T18:03:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:1001: done (7 left) 2024-01-13T18:03:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:1005: done (6 left) 2024-01-13T18:03:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:1006: copy_from oid 21 from oid 2 current snap is 97 2024-01-13T18:03:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:1002: finishing rollback tid 0 to smithi084102331-44 2024-01-13T18:03:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:1002: finishing rollback tid 1 to smithi084102331-44 2024-01-13T18:03:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 400 (ObjNum 0 snap 0 seq_num 304) dirty dne 2024-01-13T18:03:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:1004: finishing rollback tid 1 to smithi084102331-39 2024-01-13T18:03:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:1004: finishing rollback tid 2 to smithi084102331-39 2024-01-13T18:03:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 298 (ObjNum 201 snap 55 seq_num 201) dirty exists 2024-01-13T18:03:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:1002: done (6 left) 2024-01-13T18:03:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:1004: done (5 left) 2024-01-13T18:03:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:1007: setattr oid 41 current snap is 97 2024-01-13T18:03:53.760 INFO:tasks.rados.rados.0.smithi084.stdout:1008: snap_create 2024-01-13T18:03:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 299 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:03:53.781 INFO:tasks.rados.rados.0.smithi084.stdout:1003: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:03:53.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[116404]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 100/483 objects degraded (20.704%), 15 pgs degraded) 2024-01-13T18:03:53.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[116404]: failed to encode map e253 with expected crc 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[116404]: failed to encode map e253 with expected crc 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[116404]: osdmap e253: 8 total, 8 up, 8 in 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[116404]: failed to encode map e253 with expected crc 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[116404]: failed to encode map e253 with expected crc 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[116404]: failed to encode map e253 with expected crc 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[116404]: from='client.44123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[119097]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 100/483 objects degraded (20.704%), 15 pgs degraded) 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[119097]: failed to encode map e253 with expected crc 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[119097]: failed to encode map e253 with expected crc 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[119097]: osdmap e253: 8 total, 8 up, 8 in 2024-01-13T18:03:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[119097]: failed to encode map e253 with expected crc 2024-01-13T18:03:53.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[119097]: failed to encode map e253 with expected crc 2024-01-13T18:03:53.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[119097]: failed to encode map e253 with expected crc 2024-01-13T18:03:53.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:53 smithi084 ceph-mon[119097]: from='client.44123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:53.995 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:03:53.995 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:03:53.995 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:03:53.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:03:53.995 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 7, 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 1 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 9, 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 6 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:03:53.996 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:03:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:53 smithi099 ceph-mon[138788]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 100/483 objects degraded (20.704%), 15 pgs degraded) 2024-01-13T18:03:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:53 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:03:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:53 smithi099 ceph-mon[138788]: failed to encode map e253 with expected crc 2024-01-13T18:03:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:53 smithi099 ceph-mon[138788]: failed to encode map e253 with expected crc 2024-01-13T18:03:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:53 smithi099 ceph-mon[138788]: osdmap e253: 8 total, 8 up, 8 in 2024-01-13T18:03:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:53 smithi099 ceph-mon[138788]: failed to encode map e253 with expected crc 2024-01-13T18:03:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:53 smithi099 ceph-mon[138788]: failed to encode map e253 with expected crc 2024-01-13T18:03:54.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:53 smithi099 ceph-mon[138788]: failed to encode map e253 with expected crc 2024-01-13T18:03:54.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:53 smithi099 ceph-mon[138788]: from='client.44123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:54.241 INFO:tasks.rados.rados.0.smithi084.stdout:1006: finishing copy_from to smithi084102331-21 2024-01-13T18:03:54.242 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 324 (ObjNum 266 snap 83 seq_num 266) dirty exists 2024-01-13T18:03:54.242 INFO:tasks.rados.rados.0.smithi084.stdout:999: expect (ObjNum 286 snap 89 seq_num 286) 2024-01-13T18:03:54.627 INFO:tasks.rados.rados.0.smithi084.stdout:997: finishing copy_from to smithi084102331-3 2024-01-13T18:03:54.627 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 266 (ObjNum 221 snap 68 seq_num 221) dirty exists 2024-01-13T18:03:54.627 INFO:tasks.rados.rados.0.smithi084.stdout:1006: finishing copy_from racing read to smithi084102331-21 2024-01-13T18:03:54.627 INFO:tasks.rados.rados.0.smithi084.stdout:997: finishing copy_from racing read to smithi084102331-3 2024-01-13T18:03:54.628 INFO:tasks.rados.rados.0.smithi084.stdout:998: finishing copy_from to smithi084102331-30 2024-01-13T18:03:54.628 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 270 (ObjNum 251 snap 75 seq_num 251) dirty exists 2024-01-13T18:03:54.628 INFO:tasks.rados.rados.0.smithi084.stdout:998: finishing copy_from racing read to smithi084102331-30 2024-01-13T18:03:54.677 INFO:tasks.rados.rados.0.smithi084.stdout:997: done (6 left) 2024-01-13T18:03:54.677 INFO:tasks.rados.rados.0.smithi084.stdout:998: done (5 left) 2024-01-13T18:03:54.677 INFO:tasks.rados.rados.0.smithi084.stdout:999: done (4 left) 2024-01-13T18:03:54.677 INFO:tasks.rados.rados.0.smithi084.stdout:1003: done (3 left) 2024-01-13T18:03:54.677 INFO:tasks.rados.rados.0.smithi084.stdout:1006: done (2 left) 2024-01-13T18:03:54.677 INFO:tasks.rados.rados.0.smithi084.stdout:1007: done (1 left) 2024-01-13T18:03:54.677 INFO:tasks.rados.rados.0.smithi084.stdout:1008: done (0 left) 2024-01-13T18:03:54.678 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 98 2024-01-13T18:03:54.678 INFO:tasks.rados.rados.0.smithi084.stdout:1009: seq_num 313 ranges {4808704=450560} 2024-01-13T18:03:54.705 INFO:tasks.rados.rados.0.smithi084.stdout:1009: writing smithi084102331-6 from 4808704 to 5259264 tid 1 2024-01-13T18:03:54.706 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 98 2024-01-13T18:03:54.706 INFO:tasks.rados.rados.0.smithi084.stdout:1010: seq_num 314 ranges {0=466944} 2024-01-13T18:03:54.708 INFO:tasks.rados.rados.0.smithi084.stdout:1010: writing smithi084102331-44 from 0 to 466944 tid 1 2024-01-13T18:03:54.708 INFO:tasks.rados.rados.0.smithi084.stdout:1011: read oid 50 snap -1 2024-01-13T18:03:54.708 INFO:tasks.rados.rados.0.smithi084.stdout:1011: expect (ObjNum 278 snap 87 seq_num 278) 2024-01-13T18:03:54.708 INFO:tasks.rados.rados.0.smithi084.stdout:1012: snap_create 2024-01-13T18:03:54.709 INFO:tasks.rados.rados.0.smithi084.stdout:1009: finishing write tid 1 to smithi084102331-6 2024-01-13T18:03:54.709 INFO:tasks.rados.rados.0.smithi084.stdout:1009: finishing write tid 2 to smithi084102331-6 2024-01-13T18:03:54.710 INFO:tasks.rados.rados.0.smithi084.stdout:1009: finishing write tid 3 to smithi084102331-6 2024-01-13T18:03:54.710 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 291 (ObjNum 313 snap 98 seq_num 313) dirty exists 2024-01-13T18:03:54.710 INFO:tasks.rados.rados.0.smithi084.stdout:1009: left oid 6 (ObjNum 313 snap 98 seq_num 313) 2024-01-13T18:03:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:1010: finishing write tid 1 to smithi084102331-44 2024-01-13T18:03:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:1010: finishing write tid 2 to smithi084102331-44 2024-01-13T18:03:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:1010: finishing write tid 3 to smithi084102331-44 2024-01-13T18:03:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 402 (ObjNum 314 snap 98 seq_num 314) dirty exists 2024-01-13T18:03:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:1010: left oid 44 (ObjNum 314 snap 98 seq_num 314) 2024-01-13T18:03:54.722 INFO:tasks.rados.rados.0.smithi084.stdout:1011: expect (ObjNum 278 snap 87 seq_num 278) 2024-01-13T18:03:54.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[116404]: from='client.34191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[116404]: failed to encode map e254 with expected crc 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[116404]: failed to encode map e254 with expected crc 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[116404]: osdmap e254: 8 total, 8 up, 8 in 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[116404]: failed to encode map e254 with expected crc 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[116404]: failed to encode map e254 with expected crc 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[116404]: failed to encode map e254 with expected crc 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[116404]: pgmap v92: 121 pgs: 121 active+clean; 199 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 11 op/s; 16 MiB/s, 6 objects/s recovering 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1420507685' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[119097]: from='client.34191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[119097]: failed to encode map e254 with expected crc 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[119097]: failed to encode map e254 with expected crc 2024-01-13T18:03:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[119097]: osdmap e254: 8 total, 8 up, 8 in 2024-01-13T18:03:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[119097]: failed to encode map e254 with expected crc 2024-01-13T18:03:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[119097]: failed to encode map e254 with expected crc 2024-01-13T18:03:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[119097]: failed to encode map e254 with expected crc 2024-01-13T18:03:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[119097]: pgmap v92: 121 pgs: 121 active+clean; 199 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 11 op/s; 16 MiB/s, 6 objects/s recovering 2024-01-13T18:03:54.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:54 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1420507685' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:54 smithi099 ceph-mon[138788]: from='client.34191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:03:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:54 smithi099 ceph-mon[138788]: failed to encode map e254 with expected crc 2024-01-13T18:03:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:54 smithi099 ceph-mon[138788]: failed to encode map e254 with expected crc 2024-01-13T18:03:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:54 smithi099 ceph-mon[138788]: osdmap e254: 8 total, 8 up, 8 in 2024-01-13T18:03:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:54 smithi099 ceph-mon[138788]: failed to encode map e254 with expected crc 2024-01-13T18:03:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:54 smithi099 ceph-mon[138788]: failed to encode map e254 with expected crc 2024-01-13T18:03:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:54 smithi099 ceph-mon[138788]: failed to encode map e254 with expected crc 2024-01-13T18:03:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:54 smithi099 ceph-mon[138788]: pgmap v92: 121 pgs: 121 active+clean; 199 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 11 op/s; 16 MiB/s, 6 objects/s recovering 2024-01-13T18:03:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:54 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1420507685' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:03:55.683 INFO:tasks.rados.rados.0.smithi084.stdout:1009: done (3 left) 2024-01-13T18:03:55.683 INFO:tasks.rados.rados.0.smithi084.stdout:1010: done (2 left) 2024-01-13T18:03:55.683 INFO:tasks.rados.rados.0.smithi084.stdout:1011: done (1 left) 2024-01-13T18:03:55.683 INFO:tasks.rados.rados.0.smithi084.stdout:1012: done (0 left) 2024-01-13T18:03:55.683 INFO:tasks.rados.rados.0.smithi084.stdout:1013: snap_create 2024-01-13T18:03:55.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:55 smithi084 ceph-mon[116404]: failed to encode map e255 with expected crc 2024-01-13T18:03:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:55 smithi084 ceph-mon[116404]: osdmap e255: 8 total, 8 up, 8 in 2024-01-13T18:03:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:55 smithi084 ceph-mon[119097]: failed to encode map e255 with expected crc 2024-01-13T18:03:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:55 smithi084 ceph-mon[119097]: osdmap e255: 8 total, 8 up, 8 in 2024-01-13T18:03:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:55 smithi099 ceph-mon[138788]: failed to encode map e255 with expected crc 2024-01-13T18:03:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:55 smithi099 ceph-mon[138788]: osdmap e255: 8 total, 8 up, 8 in 2024-01-13T18:03:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:1013: done (0 left) 2024-01-13T18:03:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 100 2024-01-13T18:03:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:1014: seq_num 315 ranges {0=483328} 2024-01-13T18:03:56.692 INFO:tasks.rados.rados.0.smithi084.stdout:1014: writing smithi084102331-5 from 0 to 483328 tid 1 2024-01-13T18:03:56.692 INFO:tasks.rados.rados.0.smithi084.stdout:1015: read oid 22 snap -1 2024-01-13T18:03:56.693 INFO:tasks.rados.rados.0.smithi084.stdout:1015: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:03:56.693 INFO:tasks.rados.rados.0.smithi084.stdout:1016: rollback oid 47 current snap is 100 2024-01-13T18:03:56.693 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 99 2024-01-13T18:03:56.693 INFO:tasks.rados.rados.0.smithi084.stdout:1017: delete oid 15 current snap is 100 2024-01-13T18:03:56.700 INFO:tasks.rados.rados.0.smithi084.stdout:1014: finishing write tid 1 to smithi084102331-5 2024-01-13T18:03:56.700 INFO:tasks.rados.rados.0.smithi084.stdout:1014: finishing write tid 2 to smithi084102331-5 2024-01-13T18:03:56.701 INFO:tasks.rados.rados.0.smithi084.stdout:1016: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:03:56.701 INFO:tasks.rados.rados.0.smithi084.stdout:1016: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:03:56.701 INFO:tasks.rados.rados.0.smithi084.stdout:1016: finishing rollback tid 2 to smithi084102331-47 2024-01-13T18:03:56.701 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 406 (ObjNum 286 snap 89 seq_num 286) dirty exists 2024-01-13T18:03:56.702 INFO:tasks.rados.rados.0.smithi084.stdout:1016: done (3 left) 2024-01-13T18:03:56.702 INFO:tasks.rados.rados.0.smithi084.stdout:1017: done (2 left) 2024-01-13T18:03:56.702 INFO:tasks.rados.rados.0.smithi084.stdout:1018: rollback oid 17 current snap is 100 2024-01-13T18:03:56.702 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 98 2024-01-13T18:03:56.702 INFO:tasks.rados.rados.0.smithi084.stdout:1014: finishing write tid 3 to smithi084102331-5 2024-01-13T18:03:56.703 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 278 (ObjNum 315 snap 100 seq_num 315) dirty exists 2024-01-13T18:03:56.703 INFO:tasks.rados.rados.0.smithi084.stdout:1014: left oid 5 (ObjNum 315 snap 100 seq_num 315) 2024-01-13T18:03:56.703 INFO:tasks.rados.rados.0.smithi084.stdout:1014: done (2 left) 2024-01-13T18:03:56.703 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 100 2024-01-13T18:03:56.703 INFO:tasks.rados.rados.0.smithi084.stdout:1019: seq_num 317 ranges {3760128=516096} 2024-01-13T18:03:56.726 INFO:tasks.rados.rados.0.smithi084.stdout:1019: writing smithi084102331-35 from 3760128 to 4276224 tid 1 2024-01-13T18:03:56.726 INFO:tasks.rados.rados.0.smithi084.stdout:1020: delete oid 10 current snap is 100 2024-01-13T18:03:56.726 INFO:tasks.rados.rados.0.smithi084.stdout:1018: finishing rollback tid 0 to smithi084102331-17 2024-01-13T18:03:56.726 INFO:tasks.rados.rados.0.smithi084.stdout:1018: finishing rollback tid 1 to smithi084102331-17 2024-01-13T18:03:56.726 INFO:tasks.rados.rados.0.smithi084.stdout:1018: finishing rollback tid 2 to smithi084102331-17 2024-01-13T18:03:56.727 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 281 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:03:56.727 INFO:tasks.rados.rados.0.smithi084.stdout:1015: expect (ObjNum 152 snap 41 seq_num 152) 2024-01-13T18:03:56.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:56 smithi084 ceph-mon[116404]: failed to encode map e255 with expected crc 2024-01-13T18:03:56.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:56 smithi084 ceph-mon[116404]: failed to encode map e256 with expected crc 2024-01-13T18:03:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:56 smithi084 ceph-mon[116404]: osdmap e256: 8 total, 8 up, 8 in 2024-01-13T18:03:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:56 smithi084 ceph-mon[116404]: pgmap v95: 121 pgs: 121 active+clean; 210 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 3.3 MiB/s wr, 27 op/s 2024-01-13T18:03:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:56 smithi084 ceph-mon[119097]: failed to encode map e255 with expected crc 2024-01-13T18:03:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:56 smithi084 ceph-mon[119097]: failed to encode map e256 with expected crc 2024-01-13T18:03:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:56 smithi084 ceph-mon[119097]: osdmap e256: 8 total, 8 up, 8 in 2024-01-13T18:03:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:56 smithi084 ceph-mon[119097]: pgmap v95: 121 pgs: 121 active+clean; 210 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 3.3 MiB/s wr, 27 op/s 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:1019: finishing write tid 1 to smithi084102331-35 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:1019: finishing write tid 2 to smithi084102331-35 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:1019: finishing write tid 3 to smithi084102331-35 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 326 (ObjNum 317 snap 100 seq_num 317) dirty exists 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:1019: left oid 35 (ObjNum 317 snap 100 seq_num 317) 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:1015: done (3 left) 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:1018: done (2 left) 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:1019: done (1 left) 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:1020: done (0 left) 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:1021: rollback oid 39 current snap is 100 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 83 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:1022: read oid 7 snap -1 2024-01-13T18:03:56.988 INFO:tasks.rados.rados.0.smithi084.stdout:1022: expect deleted 2024-01-13T18:03:56.989 INFO:tasks.rados.rados.0.smithi084.stdout:1023: setattr oid 49 current snap is 100 2024-01-13T18:03:56.989 INFO:tasks.rados.rados.0.smithi084.stdout:1022: done (2 left) 2024-01-13T18:03:56.989 INFO:tasks.rados.rados.0.smithi084.stdout:1024: read oid 31 snap 92 2024-01-13T18:03:56.989 INFO:tasks.rados.rados.0.smithi084.stdout:1024: expect deleted 2024-01-13T18:03:56.989 INFO:tasks.rados.rados.0.smithi084.stdout:1025: snap_create 2024-01-13T18:03:56.990 INFO:tasks.rados.rados.0.smithi084.stdout:1021: finishing rollback tid 0 to smithi084102331-39 2024-01-13T18:03:56.990 INFO:tasks.rados.rados.0.smithi084.stdout:1021: finishing rollback tid 1 to smithi084102331-39 2024-01-13T18:03:56.990 INFO:tasks.rados.rados.0.smithi084.stdout:1021: finishing rollback tid 2 to smithi084102331-39 2024-01-13T18:03:56.990 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 302 (ObjNum 201 snap 55 seq_num 201) dirty exists 2024-01-13T18:03:56.991 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 359 (ObjNum 81 snap 0 seq_num 1684951897) dirty exists 2024-01-13T18:03:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:56 smithi099 ceph-mon[138788]: failed to encode map e255 with expected crc 2024-01-13T18:03:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:56 smithi099 ceph-mon[138788]: failed to encode map e256 with expected crc 2024-01-13T18:03:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:56 smithi099 ceph-mon[138788]: osdmap e256: 8 total, 8 up, 8 in 2024-01-13T18:03:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:56 smithi099 ceph-mon[138788]: pgmap v95: 121 pgs: 121 active+clean; 210 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 3.3 MiB/s wr, 27 op/s 2024-01-13T18:03:57.577 INFO:tasks.rados.rados.0.smithi084.stdout:1021: done (3 left) 2024-01-13T18:03:57.577 INFO:tasks.rados.rados.0.smithi084.stdout:1023: done (2 left) 2024-01-13T18:03:57.577 INFO:tasks.rados.rados.0.smithi084.stdout:1024: done (1 left) 2024-01-13T18:03:57.577 INFO:tasks.rados.rados.0.smithi084.stdout:1025: done (0 left) 2024-01-13T18:03:57.577 INFO:tasks.rados.rados.0.smithi084.stdout:1026: read oid 50 snap -1 2024-01-13T18:03:57.578 INFO:tasks.rados.rados.0.smithi084.stdout:1026: expect (ObjNum 278 snap 87 seq_num 278) 2024-01-13T18:03:57.578 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 101 2024-01-13T18:03:57.578 INFO:tasks.rados.rados.0.smithi084.stdout:1027: seq_num 319 ranges {0=548864} 2024-01-13T18:03:57.580 INFO:tasks.rados.rados.0.smithi084.stdout:1027: writing smithi084102331-49 from 0 to 548864 tid 1 2024-01-13T18:03:57.580 INFO:tasks.rados.rados.0.smithi084.stdout:1028: rollback oid 32 current snap is 101 2024-01-13T18:03:57.580 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 32 to 99 2024-01-13T18:03:57.580 INFO:tasks.rados.rados.0.smithi084.stdout:1029: delete oid 37 current snap is 101 2024-01-13T18:03:57.586 INFO:tasks.rados.rados.0.smithi084.stdout:1027: finishing write tid 1 to smithi084102331-49 2024-01-13T18:03:57.588 INFO:tasks.rados.rados.0.smithi084.stdout:1027: finishing write tid 2 to smithi084102331-49 2024-01-13T18:03:57.588 INFO:tasks.rados.rados.0.smithi084.stdout:1027: finishing write tid 3 to smithi084102331-49 2024-01-13T18:03:57.588 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 362 (ObjNum 319 snap 101 seq_num 319) dirty exists 2024-01-13T18:03:57.588 INFO:tasks.rados.rados.0.smithi084.stdout:1027: left oid 49 (ObjNum 319 snap 101 seq_num 319) 2024-01-13T18:03:57.590 INFO:tasks.rados.rados.0.smithi084.stdout:1028: finishing rollback tid 0 to smithi084102331-32 2024-01-13T18:03:57.590 INFO:tasks.rados.rados.0.smithi084.stdout:1028: finishing rollback tid 1 to smithi084102331-32 2024-01-13T18:03:57.590 INFO:tasks.rados.rados.0.smithi084.stdout:1028: finishing rollback tid 2 to smithi084102331-32 2024-01-13T18:03:57.590 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 412 (ObjNum 309 snap 96 seq_num 309) dirty exists 2024-01-13T18:03:57.600 INFO:tasks.rados.rados.0.smithi084.stdout:1026: expect (ObjNum 278 snap 87 seq_num 278) 2024-01-13T18:03:57.654 INFO:tasks.rados.rados.0.smithi084.stdout:1026: done (3 left) 2024-01-13T18:03:57.654 INFO:tasks.rados.rados.0.smithi084.stdout:1027: done (2 left) 2024-01-13T18:03:57.654 INFO:tasks.rados.rados.0.smithi084.stdout:1028: done (1 left) 2024-01-13T18:03:57.654 INFO:tasks.rados.rados.0.smithi084.stdout:1029: done (0 left) 2024-01-13T18:03:57.654 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 101 2024-01-13T18:03:57.654 INFO:tasks.rados.rados.0.smithi084.stdout:1030: seq_num 321 ranges {0=581632} 2024-01-13T18:03:57.657 INFO:tasks.rados.rados.0.smithi084.stdout:1030: writing smithi084102331-7 from 0 to 581632 tid 1 2024-01-13T18:03:57.657 INFO:tasks.rados.rados.0.smithi084.stdout:1031: delete oid 9 current snap is 101 2024-01-13T18:03:57.662 INFO:tasks.rados.rados.0.smithi084.stdout:1031: done (1 left) 2024-01-13T18:03:57.663 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 101 2024-01-13T18:03:57.663 INFO:tasks.rados.rados.0.smithi084.stdout:1032: seq_num 323 ranges {3334144=614400} 2024-01-13T18:03:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:1032: writing smithi084102331-3 from 3334144 to 3948544 tid 1 2024-01-13T18:03:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:1033: read oid 38 snap -1 2024-01-13T18:03:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:1033: expect (ObjNum 301 snap 93 seq_num 301) 2024-01-13T18:03:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 101 2024-01-13T18:03:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:1030: finishing write tid 1 to smithi084102331-7 2024-01-13T18:03:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:1030: finishing write tid 2 to smithi084102331-7 2024-01-13T18:03:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:1030: finishing write tid 3 to smithi084102331-7 2024-01-13T18:03:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 326 (ObjNum 321 snap 101 seq_num 321) dirty exists 2024-01-13T18:03:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:1030: left oid 7 (ObjNum 321 snap 101 seq_num 321) 2024-01-13T18:03:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:1034: seq_num 324 ranges {0=630784} 2024-01-13T18:03:57.688 INFO:tasks.rados.rados.0.smithi084.stdout:1034: writing smithi084102331-20 from 0 to 630784 tid 1 2024-01-13T18:03:57.688 INFO:tasks.rados.rados.0.smithi084.stdout:1030: done (3 left) 2024-01-13T18:03:57.688 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 101 2024-01-13T18:03:57.688 INFO:tasks.rados.rados.0.smithi084.stdout:1035: seq_num 325 ranges {483328=647168} 2024-01-13T18:03:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1035: writing smithi084102331-5 from 483328 to 1130496 tid 1 2024-01-13T18:03:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1036: snap_create 2024-01-13T18:03:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1032: finishing write tid 1 to smithi084102331-3 2024-01-13T18:03:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1032: finishing write tid 2 to smithi084102331-3 2024-01-13T18:03:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1034: finishing write tid 1 to smithi084102331-20 2024-01-13T18:03:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1032: finishing write tid 3 to smithi084102331-3 2024-01-13T18:03:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 506 (ObjNum 323 snap 101 seq_num 323) dirty exists 2024-01-13T18:03:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1032: left oid 3 (ObjNum 323 snap 101 seq_num 323) 2024-01-13T18:03:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1034: finishing write tid 2 to smithi084102331-20 2024-01-13T18:03:57.696 INFO:tasks.rados.rados.0.smithi084.stdout:1033: expect (ObjNum 301 snap 93 seq_num 301) 2024-01-13T18:03:57.709 INFO:tasks.rados.rados.0.smithi084.stdout:1034: finishing write tid 3 to smithi084102331-20 2024-01-13T18:03:57.709 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 157 (ObjNum 324 snap 101 seq_num 324) dirty exists 2024-01-13T18:03:57.709 INFO:tasks.rados.rados.0.smithi084.stdout:1034: left oid 20 (ObjNum 324 snap 101 seq_num 324) 2024-01-13T18:03:57.709 INFO:tasks.rados.rados.0.smithi084.stdout:1035: finishing write tid 1 to smithi084102331-5 2024-01-13T18:03:57.709 INFO:tasks.rados.rados.0.smithi084.stdout:1035: finishing write tid 2 to smithi084102331-5 2024-01-13T18:03:57.709 INFO:tasks.rados.rados.0.smithi084.stdout:1035: finishing write tid 3 to smithi084102331-5 2024-01-13T18:03:57.709 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 283 (ObjNum 325 snap 101 seq_num 325) dirty exists 2024-01-13T18:03:57.709 INFO:tasks.rados.rados.0.smithi084.stdout:1035: left oid 5 (ObjNum 325 snap 101 seq_num 325) 2024-01-13T18:03:57.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[116404]: failed to encode map e256 with expected crc 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[116404]: failed to encode map e256 with expected crc 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[116404]: osdmap e257: 8 total, 8 up, 8 in 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[116404]: failed to encode map e257 with expected crc 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[116404]: failed to encode map e257 with expected crc 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[116404]: failed to encode map e256 with expected crc 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[116404]: failed to encode map e257 with expected crc 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[116404]: osdmap e258: 8 total, 8 up, 8 in 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[119097]: failed to encode map e256 with expected crc 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[119097]: failed to encode map e256 with expected crc 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[119097]: osdmap e257: 8 total, 8 up, 8 in 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[119097]: failed to encode map e257 with expected crc 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[119097]: failed to encode map e257 with expected crc 2024-01-13T18:03:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[119097]: failed to encode map e256 with expected crc 2024-01-13T18:03:57.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[119097]: failed to encode map e257 with expected crc 2024-01-13T18:03:57.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:57 smithi084 ceph-mon[119097]: osdmap e258: 8 total, 8 up, 8 in 2024-01-13T18:03:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:57 smithi099 ceph-mon[138788]: failed to encode map e256 with expected crc 2024-01-13T18:03:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:57 smithi099 ceph-mon[138788]: failed to encode map e256 with expected crc 2024-01-13T18:03:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:57 smithi099 ceph-mon[138788]: osdmap e257: 8 total, 8 up, 8 in 2024-01-13T18:03:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:57 smithi099 ceph-mon[138788]: failed to encode map e257 with expected crc 2024-01-13T18:03:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:57 smithi099 ceph-mon[138788]: failed to encode map e257 with expected crc 2024-01-13T18:03:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:57 smithi099 ceph-mon[138788]: failed to encode map e256 with expected crc 2024-01-13T18:03:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:57 smithi099 ceph-mon[138788]: failed to encode map e257 with expected crc 2024-01-13T18:03:58.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:57 smithi099 ceph-mon[138788]: osdmap e258: 8 total, 8 up, 8 in 2024-01-13T18:03:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:1032: done (4 left) 2024-01-13T18:03:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:1033: done (3 left) 2024-01-13T18:03:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:1034: done (2 left) 2024-01-13T18:03:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:1035: done (1 left) 2024-01-13T18:03:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:1036: done (0 left) 2024-01-13T18:03:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:1037: copy_from oid 12 from oid 23 current snap is 102 2024-01-13T18:03:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 102 2024-01-13T18:03:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:1038: seq_num 326 ranges {0=663552} 2024-01-13T18:03:58.690 INFO:tasks.rados.rados.0.smithi084.stdout:1038: writing smithi084102331-19 from 0 to 663552 tid 1 2024-01-13T18:03:58.690 INFO:tasks.rados.rados.0.smithi084.stdout:1039: read oid 2 snap -1 2024-01-13T18:03:58.691 INFO:tasks.rados.rados.0.smithi084.stdout:1039: expect (ObjNum 266 snap 83 seq_num 266) 2024-01-13T18:03:58.691 INFO:tasks.rados.rados.0.smithi084.stdout:1040: read oid 14 snap -1 2024-01-13T18:03:58.691 INFO:tasks.rados.rados.0.smithi084.stdout:1040: expect deleted 2024-01-13T18:03:58.691 INFO:tasks.rados.rados.0.smithi084.stdout:1041: copy_from oid 31 from oid 17 current snap is 102 2024-01-13T18:03:58.691 INFO:tasks.rados.rados.0.smithi084.stdout:1042: read oid 5 snap -1 2024-01-13T18:03:58.691 INFO:tasks.rados.rados.0.smithi084.stdout:1042: expect (ObjNum 325 snap 101 seq_num 325) 2024-01-13T18:03:58.691 INFO:tasks.rados.rados.0.smithi084.stdout:1043: snap_remove snap 100 2024-01-13T18:03:59.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:03:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:03:58.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:03:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:58 smithi099 ceph-mon[138788]: failed to encode map e257 with expected crc 2024-01-13T18:03:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:58 smithi099 ceph-mon[138788]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:58 smithi099 ceph-mon[138788]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:58 smithi099 ceph-mon[138788]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:58 smithi099 ceph-mon[138788]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:58 smithi099 ceph-mon[138788]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:58 smithi099 ceph-mon[138788]: pgmap v98: 121 pgs: 121 active+clean; 223 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 27 MiB/s rd, 7.1 MiB/s wr, 31 op/s 2024-01-13T18:03:59.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[116404]: failed to encode map e257 with expected crc 2024-01-13T18:03:59.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[116404]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[116404]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[116404]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[116404]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[116404]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[116404]: pgmap v98: 121 pgs: 121 active+clean; 223 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 27 MiB/s rd, 7.1 MiB/s wr, 31 op/s 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[119097]: failed to encode map e257 with expected crc 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[119097]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[119097]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[119097]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[119097]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[119097]: failed to encode map e258 with expected crc 2024-01-13T18:03:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:58 smithi084 ceph-mon[119097]: pgmap v98: 121 pgs: 121 active+clean; 223 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 27 MiB/s rd, 7.1 MiB/s wr, 31 op/s 2024-01-13T18:03:59.695 INFO:tasks.rados.rados.0.smithi084.stdout:1043: done (6 left) 2024-01-13T18:03:59.695 INFO:tasks.rados.rados.0.smithi084.stdout:1044: snap_create 2024-01-13T18:03:59.695 INFO:tasks.rados.rados.0.smithi084.stdout:1038: finishing write tid 1 to smithi084102331-19 2024-01-13T18:03:59.695 INFO:tasks.rados.rados.0.smithi084.stdout:1038: finishing write tid 2 to smithi084102331-19 2024-01-13T18:03:59.695 INFO:tasks.rados.rados.0.smithi084.stdout:1042: expect (ObjNum 325 snap 101 seq_num 325) 2024-01-13T18:03:59.732 INFO:tasks.rados.rados.0.smithi084.stdout:1041: finishing copy_from to smithi084102331-31 2024-01-13T18:03:59.733 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 281 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:03:59.733 INFO:tasks.rados.rados.0.smithi084.stdout:1041: finishing copy_from racing read to smithi084102331-31 2024-01-13T18:03:59.733 INFO:tasks.rados.rados.0.smithi084.stdout:1039: expect (ObjNum 266 snap 83 seq_num 266) 2024-01-13T18:03:59.844 INFO:tasks.rados.rados.0.smithi084.stdout:1038: finishing write tid 3 to smithi084102331-19 2024-01-13T18:03:59.845 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 160 (ObjNum 326 snap 102 seq_num 326) dirty exists 2024-01-13T18:03:59.845 INFO:tasks.rados.rados.0.smithi084.stdout:1038: left oid 19 (ObjNum 326 snap 102 seq_num 326) 2024-01-13T18:03:59.845 INFO:tasks.rados.rados.0.smithi084.stdout:1037: finishing copy_from to smithi084102331-12 2024-01-13T18:03:59.845 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 238 (ObjNum 226 snap 69 seq_num 226) dirty exists 2024-01-13T18:03:59.845 INFO:tasks.rados.rados.0.smithi084.stdout:1037: finishing copy_from racing read to smithi084102331-12 2024-01-13T18:04:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:59 smithi099 ceph-mon[138788]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:59 smithi099 ceph-mon[138788]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:59 smithi099 ceph-mon[138788]: osdmap e259: 8 total, 8 up, 8 in 2024-01-13T18:04:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:59 smithi099 ceph-mon[138788]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:03:59 smithi099 ceph-mon[138788]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:59 smithi084 ceph-mon[116404]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:59 smithi084 ceph-mon[116404]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:59 smithi084 ceph-mon[116404]: osdmap e259: 8 total, 8 up, 8 in 2024-01-13T18:04:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:59 smithi084 ceph-mon[116404]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:03:59 smithi084 ceph-mon[116404]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:59 smithi084 ceph-mon[119097]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:59 smithi084 ceph-mon[119097]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:59 smithi084 ceph-mon[119097]: osdmap e259: 8 total, 8 up, 8 in 2024-01-13T18:04:00.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:59 smithi084 ceph-mon[119097]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:03:59 smithi084 ceph-mon[119097]: failed to encode map e259 with expected crc 2024-01-13T18:04:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:04:00] "GET /metrics HTTP/1.1" 200 35925 "" "Prometheus/2.43.0" 2024-01-13T18:04:00.698 INFO:tasks.rados.rados.0.smithi084.stdout:1037: done (6 left) 2024-01-13T18:04:00.698 INFO:tasks.rados.rados.0.smithi084.stdout:1038: done (5 left) 2024-01-13T18:04:00.698 INFO:tasks.rados.rados.0.smithi084.stdout:1039: done (4 left) 2024-01-13T18:04:00.698 INFO:tasks.rados.rados.0.smithi084.stdout:1040: done (3 left) 2024-01-13T18:04:00.698 INFO:tasks.rados.rados.0.smithi084.stdout:1041: done (2 left) 2024-01-13T18:04:00.698 INFO:tasks.rados.rados.0.smithi084.stdout:1042: done (1 left) 2024-01-13T18:04:00.699 INFO:tasks.rados.rados.0.smithi084.stdout:1044: done (0 left) 2024-01-13T18:04:00.699 INFO:tasks.rados.rados.0.smithi084.stdout:1045: read oid 29 snap -1 2024-01-13T18:04:00.699 INFO:tasks.rados.rados.0.smithi084.stdout:1045: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:04:00.699 INFO:tasks.rados.rados.0.smithi084.stdout:1046: read oid 50 snap 93 2024-01-13T18:04:00.699 INFO:tasks.rados.rados.0.smithi084.stdout:1046: expect (ObjNum 278 snap 87 seq_num 278) 2024-01-13T18:04:00.699 INFO:tasks.rados.rados.0.smithi084.stdout:1047: rmattr oid 49 current snap is 103 2024-01-13T18:04:00.699 INFO:tasks.rados.rados.0.smithi084.stdout:1048: snap_remove snap 69 2024-01-13T18:04:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:00 smithi099 ceph-mon[138788]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:00 smithi099 ceph-mon[138788]: osdmap e260: 8 total, 8 up, 8 in 2024-01-13T18:04:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:00 smithi099 ceph-mon[138788]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:00 smithi099 ceph-mon[138788]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:00 smithi099 ceph-mon[138788]: pgmap v101: 121 pgs: 121 active+clean; 223 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 3.8 MiB/s wr, 3 op/s 2024-01-13T18:04:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:00 smithi099 ceph-mon[138788]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[119097]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[119097]: osdmap e260: 8 total, 8 up, 8 in 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[119097]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[119097]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[119097]: pgmap v101: 121 pgs: 121 active+clean; 223 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 3.8 MiB/s wr, 3 op/s 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[119097]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[116404]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[116404]: osdmap e260: 8 total, 8 up, 8 in 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[116404]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[116404]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[116404]: pgmap v101: 121 pgs: 121 active+clean; 223 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 3.8 MiB/s wr, 3 op/s 2024-01-13T18:04:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:00 smithi084 ceph-mon[116404]: failed to encode map e260 with expected crc 2024-01-13T18:04:01.699 INFO:tasks.rados.rados.0.smithi084.stdout:1048: done (3 left) 2024-01-13T18:04:01.699 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 103 2024-01-13T18:04:01.700 INFO:tasks.rados.rados.0.smithi084.stdout:1049: seq_num 327 ranges {360448=679936} 2024-01-13T18:04:01.708 INFO:tasks.rados.rados.0.smithi084.stdout:1049: writing smithi084102331-36 from 360448 to 1040384 tid 1 2024-01-13T18:04:01.709 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 103 2024-01-13T18:04:01.709 INFO:tasks.rados.rados.0.smithi084.stdout:1050: seq_num 328 ranges {4448256=696320} 2024-01-13T18:04:01.734 INFO:tasks.rados.rados.0.smithi084.stdout:1050: writing smithi084102331-22 from 4448256 to 5144576 tid 1 2024-01-13T18:04:01.734 INFO:tasks.rados.rados.0.smithi084.stdout:1051: snap_create 2024-01-13T18:04:01.734 INFO:tasks.rados.rados.0.smithi084.stdout:1045: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:04:01.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 366 (ObjNum 319 snap 101 seq_num 319) dirty exists 2024-01-13T18:04:01.738 INFO:tasks.rados.rados.0.smithi084.stdout:1046: expect (ObjNum 278 snap 87 seq_num 278) 2024-01-13T18:04:01.793 INFO:tasks.rados.rados.0.smithi084.stdout:1049: finishing write tid 1 to smithi084102331-36 2024-01-13T18:04:01.793 INFO:tasks.rados.rados.0.smithi084.stdout:1049: finishing write tid 2 to smithi084102331-36 2024-01-13T18:04:01.793 INFO:tasks.rados.rados.0.smithi084.stdout:1049: finishing write tid 3 to smithi084102331-36 2024-01-13T18:04:01.793 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 371 (ObjNum 327 snap 103 seq_num 327) dirty exists 2024-01-13T18:04:01.793 INFO:tasks.rados.rados.0.smithi084.stdout:1049: left oid 36 (ObjNum 327 snap 103 seq_num 327) 2024-01-13T18:04:01.793 INFO:tasks.rados.rados.0.smithi084.stdout:1050: finishing write tid 1 to smithi084102331-22 2024-01-13T18:04:01.793 INFO:tasks.rados.rados.0.smithi084.stdout:1050: finishing write tid 2 to smithi084102331-22 2024-01-13T18:04:01.793 INFO:tasks.rados.rados.0.smithi084.stdout:1050: finishing write tid 3 to smithi084102331-22 2024-01-13T18:04:01.793 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 392 (ObjNum 328 snap 103 seq_num 328) dirty exists 2024-01-13T18:04:01.793 INFO:tasks.rados.rados.0.smithi084.stdout:1050: left oid 22 (ObjNum 328 snap 103 seq_num 328) 2024-01-13T18:04:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:01 smithi099 ceph-mon[138788]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:01 smithi099 ceph-mon[138788]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:01 smithi099 ceph-mon[138788]: osdmap e261: 8 total, 8 up, 8 in 2024-01-13T18:04:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:01 smithi099 ceph-mon[138788]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:01 smithi099 ceph-mon[138788]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:01 smithi084 ceph-mon[119097]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:01 smithi084 ceph-mon[119097]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:01 smithi084 ceph-mon[119097]: osdmap e261: 8 total, 8 up, 8 in 2024-01-13T18:04:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:01 smithi084 ceph-mon[119097]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:01 smithi084 ceph-mon[119097]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:01 smithi084 ceph-mon[116404]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:01 smithi084 ceph-mon[116404]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:01 smithi084 ceph-mon[116404]: osdmap e261: 8 total, 8 up, 8 in 2024-01-13T18:04:02.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:01 smithi084 ceph-mon[116404]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:01 smithi084 ceph-mon[116404]: failed to encode map e261 with expected crc 2024-01-13T18:04:02.709 INFO:tasks.rados.rados.0.smithi084.stdout:1045: done (5 left) 2024-01-13T18:04:02.709 INFO:tasks.rados.rados.0.smithi084.stdout:1046: done (4 left) 2024-01-13T18:04:02.709 INFO:tasks.rados.rados.0.smithi084.stdout:1047: done (3 left) 2024-01-13T18:04:02.710 INFO:tasks.rados.rados.0.smithi084.stdout:1049: done (2 left) 2024-01-13T18:04:02.710 INFO:tasks.rados.rados.0.smithi084.stdout:1050: done (1 left) 2024-01-13T18:04:02.710 INFO:tasks.rados.rados.0.smithi084.stdout:1051: done (0 left) 2024-01-13T18:04:02.710 INFO:tasks.rados.rados.0.smithi084.stdout:1052: read oid 5 snap 81 2024-01-13T18:04:02.710 INFO:tasks.rados.rados.0.smithi084.stdout:1052: expect deleted 2024-01-13T18:04:02.710 INFO:tasks.rados.rados.0.smithi084.stdout:1053: read oid 47 snap 102 2024-01-13T18:04:02.710 INFO:tasks.rados.rados.0.smithi084.stdout:1053: expect (ObjNum 286 snap 89 seq_num 286) 2024-01-13T18:04:02.710 INFO:tasks.rados.rados.0.smithi084.stdout:1054: copy_from oid 23 from oid 15 current snap is 104 2024-01-13T18:04:02.710 INFO:tasks.rados.rados.0.smithi084.stdout:1055: delete oid 9 current snap is 104 2024-01-13T18:04:02.714 INFO:tasks.rados.rados.0.smithi084.stdout:1052: done (3 left) 2024-01-13T18:04:02.714 INFO:tasks.rados.rados.0.smithi084.stdout:1055: done (2 left) 2024-01-13T18:04:02.714 INFO:tasks.rados.rados.0.smithi084.stdout:1056: setattr oid 49 current snap is 104 2024-01-13T18:04:02.717 INFO:tasks.rados.rados.0.smithi084.stdout:1054: finishing copy_from to smithi084102331-23 2024-01-13T18:04:02.717 INFO:tasks.rados.rados.0.smithi084.stdout:1054: got expected ENOENT (src dne) 2024-01-13T18:04:02.717 INFO:tasks.rados.rados.0.smithi084.stdout:1054: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:04:02.717 INFO:tasks.rados.rados.0.smithi084.stdout:1054: done (2 left) 2024-01-13T18:04:02.717 INFO:tasks.rados.rados.0.smithi084.stdout:1057: rollback oid 4 current snap is 104 2024-01-13T18:04:02.717 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 97 2024-01-13T18:04:02.717 INFO:tasks.rados.rados.0.smithi084.stdout:1058: delete oid 13 current snap is 104 2024-01-13T18:04:02.722 INFO:tasks.rados.rados.0.smithi084.stdout:1057: finishing rollback tid 0 to smithi084102331-4 2024-01-13T18:04:02.722 INFO:tasks.rados.rados.0.smithi084.stdout:1057: finishing rollback tid 1 to smithi084102331-4 2024-01-13T18:04:02.722 INFO:tasks.rados.rados.0.smithi084.stdout:1057: finishing rollback tid 2 to smithi084102331-4 2024-01-13T18:04:02.722 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 292 (ObjNum 251 snap 75 seq_num 251) dirty exists 2024-01-13T18:04:02.723 INFO:tasks.rados.rados.0.smithi084.stdout:1057: done (3 left) 2024-01-13T18:04:02.723 INFO:tasks.rados.rados.0.smithi084.stdout:1058: done (2 left) 2024-01-13T18:04:02.723 INFO:tasks.rados.rados.0.smithi084.stdout:1059: copy_from oid 48 from oid 40 current snap is 104 2024-01-13T18:04:02.723 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 104 2024-01-13T18:04:02.723 INFO:tasks.rados.rados.0.smithi084.stdout:1060: seq_num 331 ranges {1130496=753664} 2024-01-13T18:04:02.733 INFO:tasks.rados.rados.0.smithi084.stdout:1060: writing smithi084102331-5 from 1130496 to 1884160 tid 1 2024-01-13T18:04:02.733 INFO:tasks.rados.rados.0.smithi084.stdout:1061: delete oid 46 current snap is 104 2024-01-13T18:04:02.733 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 373 (ObjNum 319 snap 101 seq_num 319) dirty exists 2024-01-13T18:04:02.735 INFO:tasks.rados.rados.0.smithi084.stdout:1059: finishing copy_from to smithi084102331-48 2024-01-13T18:04:02.735 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 321 (ObjNum 225 snap 69 seq_num 225) dirty exists 2024-01-13T18:04:02.736 INFO:tasks.rados.rados.0.smithi084.stdout:1059: finishing copy_from racing read to smithi084102331-48 2024-01-13T18:04:02.737 INFO:tasks.rados.rados.0.smithi084.stdout:1060: finishing write tid 1 to smithi084102331-5 2024-01-13T18:04:02.737 INFO:tasks.rados.rados.0.smithi084.stdout:1060: finishing write tid 2 to smithi084102331-5 2024-01-13T18:04:02.738 INFO:tasks.rados.rados.0.smithi084.stdout:1060: finishing write tid 3 to smithi084102331-5 2024-01-13T18:04:02.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 297 (ObjNum 331 snap 104 seq_num 331) dirty exists 2024-01-13T18:04:02.738 INFO:tasks.rados.rados.0.smithi084.stdout:1060: left oid 5 (ObjNum 331 snap 104 seq_num 331) 2024-01-13T18:04:02.757 INFO:tasks.rados.rados.0.smithi084.stdout:1053: expect (ObjNum 286 snap 89 seq_num 286) 2024-01-13T18:04:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:02 smithi099 ceph-mon[138788]: failed to encode map e262 with expected crc 2024-01-13T18:04:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:02 smithi099 ceph-mon[138788]: failed to encode map e262 with expected crc 2024-01-13T18:04:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:02 smithi099 ceph-mon[138788]: osdmap e262: 8 total, 8 up, 8 in 2024-01-13T18:04:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:02 smithi099 ceph-mon[138788]: pgmap v104: 121 pgs: 121 active+clean; 237 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-01-13T18:04:03.164 INFO:tasks.rados.rados.0.smithi084.stdout:1053: done (4 left) 2024-01-13T18:04:03.164 INFO:tasks.rados.rados.0.smithi084.stdout:1056: done (3 left) 2024-01-13T18:04:03.164 INFO:tasks.rados.rados.0.smithi084.stdout:1059: done (2 left) 2024-01-13T18:04:03.164 INFO:tasks.rados.rados.0.smithi084.stdout:1060: done (1 left) 2024-01-13T18:04:03.164 INFO:tasks.rados.rados.0.smithi084.stdout:1061: done (0 left) 2024-01-13T18:04:03.164 INFO:tasks.rados.rados.0.smithi084.stdout:1062: snap_create 2024-01-13T18:04:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:02 smithi084 ceph-mon[116404]: failed to encode map e262 with expected crc 2024-01-13T18:04:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:02 smithi084 ceph-mon[116404]: failed to encode map e262 with expected crc 2024-01-13T18:04:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:02 smithi084 ceph-mon[116404]: osdmap e262: 8 total, 8 up, 8 in 2024-01-13T18:04:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:02 smithi084 ceph-mon[116404]: pgmap v104: 121 pgs: 121 active+clean; 237 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-01-13T18:04:03.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:02 smithi084 ceph-mon[119097]: failed to encode map e262 with expected crc 2024-01-13T18:04:03.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:02 smithi084 ceph-mon[119097]: failed to encode map e262 with expected crc 2024-01-13T18:04:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:02 smithi084 ceph-mon[119097]: osdmap e262: 8 total, 8 up, 8 in 2024-01-13T18:04:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:02 smithi084 ceph-mon[119097]: pgmap v104: 121 pgs: 121 active+clean; 237 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-01-13T18:04:03.713 INFO:tasks.rados.rados.0.smithi084.stdout:1062: done (0 left) 2024-01-13T18:04:03.713 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 105 2024-01-13T18:04:03.713 INFO:tasks.rados.rados.0.smithi084.stdout:1063: seq_num 333 ranges {8544256=786432} 2024-01-13T18:04:03.731 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[119097]: failed to encode map e263 with expected crc 2024-01-13T18:04:03.731 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[119097]: failed to encode map e263 with expected crc 2024-01-13T18:04:03.731 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[119097]: osdmap e263: 8 total, 8 up, 8 in 2024-01-13T18:04:03.731 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[119097]: failed to encode map e263 with expected crc 2024-01-13T18:04:03.731 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[119097]: failed to encode map e263 with expected crc 2024-01-13T18:04:03.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:04:03.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:04:03.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[119097]: Upgrade: osd.1 is safe to restart 2024-01-13T18:04:03.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[116404]: failed to encode map e263 with expected crc 2024-01-13T18:04:03.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[116404]: failed to encode map e263 with expected crc 2024-01-13T18:04:03.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[116404]: osdmap e263: 8 total, 8 up, 8 in 2024-01-13T18:04:03.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[116404]: failed to encode map e263 with expected crc 2024-01-13T18:04:03.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[116404]: failed to encode map e263 with expected crc 2024-01-13T18:04:03.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:04:03.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:04:03.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:03 smithi084 ceph-mon[116404]: Upgrade: osd.1 is safe to restart 2024-01-13T18:04:03.763 INFO:tasks.rados.rados.0.smithi084.stdout:1063: writing smithi084102331-47 from 8544256 to 9330688 tid 1 2024-01-13T18:04:03.763 INFO:tasks.rados.rados.0.smithi084.stdout:1064: snap_remove snap 104 2024-01-13T18:04:04.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:03 smithi099 ceph-mon[138788]: failed to encode map e263 with expected crc 2024-01-13T18:04:04.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:03 smithi099 ceph-mon[138788]: failed to encode map e263 with expected crc 2024-01-13T18:04:04.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:03 smithi099 ceph-mon[138788]: osdmap e263: 8 total, 8 up, 8 in 2024-01-13T18:04:04.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:03 smithi099 ceph-mon[138788]: failed to encode map e263 with expected crc 2024-01-13T18:04:04.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:03 smithi099 ceph-mon[138788]: failed to encode map e263 with expected crc 2024-01-13T18:04:04.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:03 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:04:04.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:03 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-01-13T18:04:04.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:03 smithi099 ceph-mon[138788]: Upgrade: osd.1 is safe to restart 2024-01-13T18:04:04.720 INFO:tasks.rados.rados.0.smithi084.stdout:1064: done (1 left) 2024-01-13T18:04:04.720 INFO:tasks.rados.rados.0.smithi084.stdout:1065: delete oid 9 current snap is 105 2024-01-13T18:04:04.720 INFO:tasks.rados.rados.0.smithi084.stdout:1063: finishing write tid 1 to smithi084102331-47 2024-01-13T18:04:04.720 INFO:tasks.rados.rados.0.smithi084.stdout:1063: finishing write tid 2 to smithi084102331-47 2024-01-13T18:04:04.720 INFO:tasks.rados.rados.0.smithi084.stdout:1063: finishing write tid 3 to smithi084102331-47 2024-01-13T18:04:04.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 423 (ObjNum 333 snap 105 seq_num 333) dirty exists 2024-01-13T18:04:04.721 INFO:tasks.rados.rados.0.smithi084.stdout:1063: left oid 47 (ObjNum 333 snap 105 seq_num 333) 2024-01-13T18:04:04.729 INFO:tasks.rados.rados.0.smithi084.stdout:1063: done (1 left) 2024-01-13T18:04:04.729 INFO:tasks.rados.rados.0.smithi084.stdout:1065: done (0 left) 2024-01-13T18:04:04.729 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 105 2024-01-13T18:04:04.729 INFO:tasks.rados.rados.0.smithi084.stdout:1066: seq_num 335 ranges {0=417792,417792=401408} 2024-01-13T18:04:04.729 INFO:tasks.rados.rados.0.smithi084.stdout:1066: writing smithi084102331-46 from 0 to 417792 tid 1 2024-01-13T18:04:04.731 INFO:tasks.rados.rados.0.smithi084.stdout:1066: writing smithi084102331-46 from 417792 to 819200 tid 2 2024-01-13T18:04:04.731 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 105 2024-01-13T18:04:04.731 INFO:tasks.rados.rados.0.smithi084.stdout:1067: seq_num 336 ranges {0=434176,434176=401408} 2024-01-13T18:04:04.733 INFO:tasks.rados.rados.0.smithi084.stdout:1067: writing smithi084102331-15 from 0 to 434176 tid 1 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:1067: writing smithi084102331-15 from 434176 to 835584 tid 2 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:1068: read oid 31 snap -1 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:1068: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:1069: copy_from oid 33 from oid 44 current snap is 105 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:1066: finishing write tid 1 to smithi084102331-46 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:1066: finishing write tid 2 to smithi084102331-46 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:1066: finishing write tid 3 to smithi084102331-46 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:1070: snap_create 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:1066: finishing write tid 4 to smithi084102331-46 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 306 (ObjNum 335 snap 105 seq_num 335) dirty exists 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:1066: left oid 46 (ObjNum 335 snap 105 seq_num 335) 2024-01-13T18:04:04.737 INFO:tasks.rados.rados.0.smithi084.stdout:1067: finishing write tid 1 to smithi084102331-15 2024-01-13T18:04:04.739 INFO:tasks.rados.rados.0.smithi084.stdout:1067: finishing write tid 2 to smithi084102331-15 2024-01-13T18:04:04.739 INFO:tasks.rados.rados.0.smithi084.stdout:1067: finishing write tid 3 to smithi084102331-15 2024-01-13T18:04:04.742 INFO:tasks.rados.rados.0.smithi084.stdout:1067: finishing write tid 4 to smithi084102331-15 2024-01-13T18:04:04.742 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 428 (ObjNum 336 snap 105 seq_num 336) dirty exists 2024-01-13T18:04:04.742 INFO:tasks.rados.rados.0.smithi084.stdout:1067: left oid 15 (ObjNum 336 snap 105 seq_num 336) 2024-01-13T18:04:04.743 INFO:tasks.rados.rados.0.smithi084.stdout:1068: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:04:04.781 INFO:tasks.rados.rados.0.smithi084.stdout:1069: finishing copy_from to smithi084102331-33 2024-01-13T18:04:04.781 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 402 (ObjNum 314 snap 98 seq_num 314) dirty exists 2024-01-13T18:04:04.781 INFO:tasks.rados.rados.0.smithi084.stdout:1069: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:04:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[116404]: failed to encode map e264 with expected crc 2024-01-13T18:04:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[116404]: failed to encode map e264 with expected crc 2024-01-13T18:04:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[116404]: osdmap e264: 8 total, 8 up, 8 in 2024-01-13T18:04:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[116404]: Upgrade: Updating osd.1 2024-01-13T18:04:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-13T18:04:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[116404]: Deploying daemon osd.1 on smithi084 2024-01-13T18:04:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[116404]: pgmap v107: 121 pgs: 121 active+clean; 237 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-01-13T18:04:04.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[119097]: failed to encode map e264 with expected crc 2024-01-13T18:04:04.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[119097]: failed to encode map e264 with expected crc 2024-01-13T18:04:04.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[119097]: osdmap e264: 8 total, 8 up, 8 in 2024-01-13T18:04:04.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[119097]: Upgrade: Updating osd.1 2024-01-13T18:04:04.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:04.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-13T18:04:04.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:04.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[119097]: Deploying daemon osd.1 on smithi084 2024-01-13T18:04:04.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:04 smithi084 ceph-mon[119097]: pgmap v107: 121 pgs: 121 active+clean; 237 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-01-13T18:04:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:04 smithi099 ceph-mon[138788]: failed to encode map e264 with expected crc 2024-01-13T18:04:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:04 smithi099 ceph-mon[138788]: failed to encode map e264 with expected crc 2024-01-13T18:04:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:04 smithi099 ceph-mon[138788]: osdmap e264: 8 total, 8 up, 8 in 2024-01-13T18:04:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:04 smithi099 ceph-mon[138788]: Upgrade: Updating osd.1 2024-01-13T18:04:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:04 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:04 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-13T18:04:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:04 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:05.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:04 smithi099 ceph-mon[138788]: Deploying daemon osd.1 on smithi084 2024-01-13T18:04:05.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:04 smithi099 ceph-mon[138788]: pgmap v107: 121 pgs: 121 active+clean; 237 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-01-13T18:04:05.725 INFO:tasks.rados.rados.0.smithi084.stdout:1066: done (4 left) 2024-01-13T18:04:05.726 INFO:tasks.rados.rados.0.smithi084.stdout:1067: done (3 left) 2024-01-13T18:04:05.726 INFO:tasks.rados.rados.0.smithi084.stdout:1068: done (2 left) 2024-01-13T18:04:05.726 INFO:tasks.rados.rados.0.smithi084.stdout:1069: done (1 left) 2024-01-13T18:04:05.726 INFO:tasks.rados.rados.0.smithi084.stdout:1070: done (0 left) 2024-01-13T18:04:05.726 INFO:tasks.rados.rados.0.smithi084.stdout:1071: snap_create 2024-01-13T18:04:05.835 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[116404]: failed to encode map e265 with expected crc 2024-01-13T18:04:05.835 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[116404]: failed to encode map e265 with expected crc 2024-01-13T18:04:05.835 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[116404]: osdmap e265: 8 total, 8 up, 8 in 2024-01-13T18:04:05.836 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[116404]: failed to encode map e265 with expected crc 2024-01-13T18:04:05.836 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[116404]: failed to encode map e265 with expected crc 2024-01-13T18:04:05.836 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:05.836 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:05.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[119097]: failed to encode map e265 with expected crc 2024-01-13T18:04:05.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[119097]: failed to encode map e265 with expected crc 2024-01-13T18:04:05.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[119097]: osdmap e265: 8 total, 8 up, 8 in 2024-01-13T18:04:05.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[119097]: failed to encode map e265 with expected crc 2024-01-13T18:04:05.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[119097]: failed to encode map e265 with expected crc 2024-01-13T18:04:05.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:05.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:05 smithi099 ceph-mon[138788]: failed to encode map e265 with expected crc 2024-01-13T18:04:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:05 smithi099 ceph-mon[138788]: failed to encode map e265 with expected crc 2024-01-13T18:04:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:05 smithi099 ceph-mon[138788]: osdmap e265: 8 total, 8 up, 8 in 2024-01-13T18:04:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:05 smithi099 ceph-mon[138788]: failed to encode map e265 with expected crc 2024-01-13T18:04:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:05 smithi099 ceph-mon[138788]: failed to encode map e265 with expected crc 2024-01-13T18:04:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:06.179 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:05 smithi084 systemd[1]: Stopping Ceph osd.1 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:04:06.179 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[64637]: 2024-01-13T18:04:06.005+0000 7f60afec6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:04:06.179 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[64637]: 2024-01-13T18:04:06.005+0000 7f60afec6700 -1 osd.1 266 *** Got signal Terminated *** 2024-01-13T18:04:06.179 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[64637]: 2024-01-13T18:04:06.005+0000 7f60afec6700 -1 osd.1 266 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T18:04:06.736 INFO:tasks.rados.rados.0.smithi084.stdout:1071: done (0 left) 2024-01-13T18:04:06.736 INFO:tasks.rados.rados.0.smithi084.stdout:1072: snap_remove snap 72 2024-01-13T18:04:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:06 smithi099 ceph-mon[138788]: failed to encode map e266 with expected crc 2024-01-13T18:04:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:06 smithi099 ceph-mon[138788]: failed to encode map e266 with expected crc 2024-01-13T18:04:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:06 smithi099 ceph-mon[138788]: osdmap e266: 8 total, 8 up, 8 in 2024-01-13T18:04:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:06 smithi099 ceph-mon[138788]: pgmap v110: 121 pgs: 121 active+clean; 239 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-01-13T18:04:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:06 smithi099 ceph-mon[138788]: osd.1 marked itself down and dead 2024-01-13T18:04:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-mon[116404]: failed to encode map e266 with expected crc 2024-01-13T18:04:07.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-mon[116404]: failed to encode map e266 with expected crc 2024-01-13T18:04:07.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-mon[116404]: osdmap e266: 8 total, 8 up, 8 in 2024-01-13T18:04:07.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-mon[116404]: pgmap v110: 121 pgs: 121 active+clean; 239 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-01-13T18:04:07.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-mon[116404]: osd.1 marked itself down and dead 2024-01-13T18:04:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-mon[119097]: failed to encode map e266 with expected crc 2024-01-13T18:04:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-mon[119097]: failed to encode map e266 with expected crc 2024-01-13T18:04:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-mon[119097]: osdmap e266: 8 total, 8 up, 8 in 2024-01-13T18:04:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-mon[119097]: pgmap v110: 121 pgs: 121 active+clean; 239 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-01-13T18:04:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:06 smithi084 ceph-mon[119097]: osd.1 marked itself down and dead 2024-01-13T18:04:07.579 INFO:tasks.rados.rados.0.smithi084.stdout:1072: done (0 left) 2024-01-13T18:04:07.579 INFO:tasks.rados.rados.0.smithi084.stdout:1073: snap_remove snap 101 2024-01-13T18:04:07.678 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:07 smithi084 bash[131338]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1 2024-01-13T18:04:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:07 smithi099 ceph-mon[138788]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:04:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:07 smithi099 ceph-mon[138788]: failed to encode map e267 with expected crc 2024-01-13T18:04:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:07 smithi099 ceph-mon[138788]: failed to encode map e267 with expected crc 2024-01-13T18:04:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:07 smithi099 ceph-mon[138788]: osdmap e267: 8 total, 7 up, 8 in 2024-01-13T18:04:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:07 smithi099 ceph-mon[138788]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:07 smithi099 ceph-mon[138788]: osdmap e268: 8 total, 7 up, 8 in 2024-01-13T18:04:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:07 smithi099 ceph-mon[138788]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:07 smithi099 ceph-mon[138788]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[116404]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:04:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[116404]: failed to encode map e267 with expected crc 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[116404]: failed to encode map e267 with expected crc 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[116404]: osdmap e267: 8 total, 7 up, 8 in 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[116404]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[116404]: osdmap e268: 8 total, 7 up, 8 in 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[116404]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[116404]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[119097]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[119097]: failed to encode map e267 with expected crc 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[119097]: failed to encode map e267 with expected crc 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[119097]: osdmap e267: 8 total, 7 up, 8 in 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[119097]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[119097]: osdmap e268: 8 total, 7 up, 8 in 2024-01-13T18:04:08.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[119097]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:07 smithi084 ceph-mon[119097]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.578 INFO:tasks.rados.rados.0.smithi084.stdout:1073: done (0 left) 2024-01-13T18:04:08.578 INFO:tasks.rados.rados.0.smithi084.stdout:1074: delete oid 6 current snap is 107 2024-01-13T18:04:08.585 INFO:tasks.rados.rados.0.smithi084.stdout:1074: done (0 left) 2024-01-13T18:04:08.585 INFO:tasks.rados.rados.0.smithi084.stdout:1075: read oid 23 snap 102 2024-01-13T18:04:08.585 INFO:tasks.rados.rados.0.smithi084.stdout:1075: expect (ObjNum 226 snap 69 seq_num 226) 2024-01-13T18:04:08.585 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 107 2024-01-13T18:04:08.585 INFO:tasks.rados.rados.0.smithi084.stdout:1076: seq_num 338 ranges {0=466944,466944=401408} 2024-01-13T18:04:08.587 INFO:tasks.rados.rados.0.smithi084.stdout:1076: writing smithi084102331-14 from 0 to 466944 tid 1 2024-01-13T18:04:08.590 INFO:tasks.rados.rados.0.smithi084.stdout:1076: writing smithi084102331-14 from 466944 to 868352 tid 2 2024-01-13T18:04:08.590 INFO:tasks.rados.rados.0.smithi084.stdout:1077: delete oid 37 current snap is 107 2024-01-13T18:04:08.592 INFO:tasks.rados.rados.0.smithi084.stdout:1076: finishing write tid 1 to smithi084102331-14 2024-01-13T18:04:08.592 INFO:tasks.rados.rados.0.smithi084.stdout:1076: finishing write tid 2 to smithi084102331-14 2024-01-13T18:04:08.593 INFO:tasks.rados.rados.0.smithi084.stdout:1076: finishing write tid 3 to smithi084102331-14 2024-01-13T18:04:08.594 INFO:tasks.rados.rados.0.smithi084.stdout:1077: done (2 left) 2024-01-13T18:04:08.594 INFO:tasks.rados.rados.0.smithi084.stdout:1078: read oid 4 snap -1 2024-01-13T18:04:08.594 INFO:tasks.rados.rados.0.smithi084.stdout:1078: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:08.594 INFO:tasks.rados.rados.0.smithi084.stdout:1079: snap_remove snap 83 2024-01-13T18:04:08.928 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:08 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.1.service: Succeeded. 2024-01-13T18:04:08.929 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:08 smithi084 systemd[1]: Stopped Ceph osd.1 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:04:08.929 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:08 smithi084 systemd[1]: Starting Ceph osd.1 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:04:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[116404]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[116404]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[116404]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[116404]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[116404]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[116404]: pgmap v113: 121 pgs: 16 stale+active+clean, 105 active+clean; 235 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2024-01-13T18:04:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[116404]: failed to encode map e269 with expected crc 2024-01-13T18:04:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[116404]: osdmap e269: 8 total, 7 up, 8 in 2024-01-13T18:04:08.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[119097]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[119097]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[119097]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[119097]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[119097]: failed to encode map e268 with expected crc 2024-01-13T18:04:08.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[119097]: pgmap v113: 121 pgs: 16 stale+active+clean, 105 active+clean; 235 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2024-01-13T18:04:08.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[119097]: failed to encode map e269 with expected crc 2024-01-13T18:04:08.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:08 smithi084 ceph-mon[119097]: osdmap e269: 8 total, 7 up, 8 in 2024-01-13T18:04:09.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:04:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:04:08.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:04:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:08 smithi099 ceph-mon[138788]: failed to encode map e268 with expected crc 2024-01-13T18:04:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:08 smithi099 ceph-mon[138788]: failed to encode map e268 with expected crc 2024-01-13T18:04:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:08 smithi099 ceph-mon[138788]: failed to encode map e268 with expected crc 2024-01-13T18:04:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:08 smithi099 ceph-mon[138788]: failed to encode map e268 with expected crc 2024-01-13T18:04:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:08 smithi099 ceph-mon[138788]: failed to encode map e268 with expected crc 2024-01-13T18:04:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:08 smithi099 ceph-mon[138788]: pgmap v113: 121 pgs: 16 stale+active+clean, 105 active+clean; 235 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2024-01-13T18:04:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:08 smithi099 ceph-mon[138788]: failed to encode map e269 with expected crc 2024-01-13T18:04:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:08 smithi099 ceph-mon[138788]: osdmap e269: 8 total, 7 up, 8 in 2024-01-13T18:04:09.579 INFO:tasks.rados.rados.0.smithi084.stdout:1079: done (3 left) 2024-01-13T18:04:09.579 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 107 2024-01-13T18:04:09.579 INFO:tasks.rados.rados.0.smithi084.stdout:1076: finishing write tid 4 to smithi084102331-14 2024-01-13T18:04:09.579 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 376 (ObjNum 338 snap 107 seq_num 338) dirty exists 2024-01-13T18:04:09.579 INFO:tasks.rados.rados.0.smithi084.stdout:1076: left oid 14 (ObjNum 338 snap 107 seq_num 338) 2024-01-13T18:04:09.579 INFO:tasks.rados.rados.0.smithi084.stdout:1080: seq_num 340 ranges {2514944=499712,3014656=401408} 2024-01-13T18:04:09.596 INFO:tasks.rados.rados.0.smithi084.stdout:1080: writing smithi084102331-32 from 2514944 to 3014656 tid 1 2024-01-13T18:04:09.598 INFO:tasks.rados.rados.0.smithi084.stdout:1080: writing smithi084102331-32 from 3014656 to 3416064 tid 2 2024-01-13T18:04:09.598 INFO:tasks.rados.rados.0.smithi084.stdout:1076: done (3 left) 2024-01-13T18:04:09.598 INFO:tasks.rados.rados.0.smithi084.stdout:1081: read oid 31 snap -1 2024-01-13T18:04:09.598 INFO:tasks.rados.rados.0.smithi084.stdout:1081: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:04:09.598 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 107 2024-01-13T18:04:09.599 INFO:tasks.rados.rados.0.smithi084.stdout:1075: expect (ObjNum 226 snap 69 seq_num 226) 2024-01-13T18:04:09.735 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:09 smithi084 ceph-mon[116404]: failed to encode map e269 with expected crc 2024-01-13T18:04:09.735 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:09 smithi084 bash[131604]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-13T18:04:09.735 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:09 smithi084 bash[131604]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-01-13T18:04:09.735 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:09 smithi084 bash[131604]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-01-13T18:04:09.735 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:09 smithi084 bash[131604]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-01-13T18:04:09.735 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:09 smithi084 bash[131604]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-01-13T18:04:09.735 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:09 smithi084 bash[131604]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-13T18:04:09.735 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:09 smithi084 bash[131604]: --> ceph-volume raw activate successful for osd ID: 1 2024-01-13T18:04:09.782 INFO:tasks.rados.rados.0.smithi084.stdout:1078: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:10.066 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:09 smithi084 ceph-mon[116404]: failed to encode map e269 with expected crc 2024-01-13T18:04:10.066 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:09 smithi084 ceph-mon[116404]: osdmap e270: 8 total, 7 up, 8 in 2024-01-13T18:04:10.066 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:09 smithi084 ceph-mon[116404]: failed to encode map e270 with expected crc 2024-01-13T18:04:10.066 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:09 smithi084 ceph-mon[119097]: failed to encode map e269 with expected crc 2024-01-13T18:04:10.067 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:09 smithi084 ceph-mon[119097]: failed to encode map e269 with expected crc 2024-01-13T18:04:10.067 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:09 smithi084 ceph-mon[119097]: osdmap e270: 8 total, 7 up, 8 in 2024-01-13T18:04:10.067 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:09 smithi084 ceph-mon[119097]: failed to encode map e270 with expected crc 2024-01-13T18:04:10.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:09 smithi099 ceph-mon[138788]: failed to encode map e269 with expected crc 2024-01-13T18:04:10.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:09 smithi099 ceph-mon[138788]: failed to encode map e269 with expected crc 2024-01-13T18:04:10.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:09 smithi099 ceph-mon[138788]: osdmap e270: 8 total, 7 up, 8 in 2024-01-13T18:04:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:09 smithi099 ceph-mon[138788]: failed to encode map e270 with expected crc 2024-01-13T18:04:10.257 INFO:tasks.rados.rados.0.smithi084.stdout:1080: finishing write tid 1 to smithi084102331-32 2024-01-13T18:04:10.257 INFO:tasks.rados.rados.0.smithi084.stdout:1080: finishing write tid 2 to smithi084102331-32 2024-01-13T18:04:10.257 INFO:tasks.rados.rados.0.smithi084.stdout:1082: seq_num 341 ranges {0=516096,516096=401408} 2024-01-13T18:04:10.260 INFO:tasks.rados.rados.0.smithi084.stdout:1082: writing smithi084102331-9 from 0 to 516096 tid 1 2024-01-13T18:04:10.263 INFO:tasks.rados.rados.0.smithi084.stdout:1082: writing smithi084102331-9 from 516096 to 917504 tid 2 2024-01-13T18:04:10.263 INFO:tasks.rados.rados.0.smithi084.stdout:1075: done (4 left) 2024-01-13T18:04:10.263 INFO:tasks.rados.rados.0.smithi084.stdout:1078: done (3 left) 2024-01-13T18:04:10.263 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 107 2024-01-13T18:04:10.263 INFO:tasks.rados.rados.0.smithi084.stdout:1080: finishing write tid 3 to smithi084102331-32 2024-01-13T18:04:10.263 INFO:tasks.rados.rados.0.smithi084.stdout:1083: seq_num 342 ranges {6504448=532480,7036928=401408} 2024-01-13T18:04:10.301 INFO:tasks.rados.rados.0.smithi084.stdout:1083: writing smithi084102331-27 from 6504448 to 7036928 tid 1 2024-01-13T18:04:10.304 INFO:tasks.rados.rados.0.smithi084.stdout:1083: writing smithi084102331-27 from 7036928 to 7438336 tid 2 2024-01-13T18:04:10.304 INFO:tasks.rados.rados.0.smithi084.stdout:1084: copy_from oid 8 from oid 34 current snap is 107 2024-01-13T18:04:10.304 INFO:tasks.rados.rados.0.smithi084.stdout:1080: finishing write tid 4 to smithi084102331-32 2024-01-13T18:04:10.304 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 444 (ObjNum 340 snap 107 seq_num 340) dirty exists 2024-01-13T18:04:10.304 INFO:tasks.rados.rados.0.smithi084.stdout:1080: left oid 32 (ObjNum 340 snap 107 seq_num 340) 2024-01-13T18:04:10.304 INFO:tasks.rados.rados.0.smithi084.stdout:1081: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:04:10.343 INFO:tasks.rados.rados.0.smithi084.stdout:1082: finishing write tid 1 to smithi084102331-9 2024-01-13T18:04:10.343 INFO:tasks.rados.rados.0.smithi084.stdout:1082: finishing write tid 2 to smithi084102331-9 2024-01-13T18:04:10.343 INFO:tasks.rados.rados.0.smithi084.stdout:1082: finishing write tid 3 to smithi084102331-9 2024-01-13T18:04:10.343 INFO:tasks.rados.rados.0.smithi084.stdout:1080: done (4 left) 2024-01-13T18:04:10.343 INFO:tasks.rados.rados.0.smithi084.stdout:1081: done (3 left) 2024-01-13T18:04:10.343 INFO:tasks.rados.rados.0.smithi084.stdout:1085: snap_remove snap 81 2024-01-13T18:04:10.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:04:10] "GET /metrics HTTP/1.1" 200 36068 "" "Prometheus/2.43.0" 2024-01-13T18:04:10.428 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-osd[131890]: -- 172.21.15.84:0/1249149402 <== mon.2 v2:172.21.15.84:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557b7c3104e0 con 0x557b7c2e1000 2024-01-13T18:04:10.428 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:10 smithi084 bash[131853]: 32bdce285b36d411bd456965725ac119e6b660dd288e8a508a977e52f115952d 2024-01-13T18:04:10.429 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:10 smithi084 systemd[1]: Started Ceph osd.1 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:04:10.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-mon[119097]: failed to encode map e270 with expected crc 2024-01-13T18:04:10.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-mon[119097]: pgmap v116: 121 pgs: 16 stale+active+clean, 105 active+clean; 235 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 MiB/s rd, 0 op/s 2024-01-13T18:04:10.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:10.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:10.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:10.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-mon[116404]: failed to encode map e270 with expected crc 2024-01-13T18:04:10.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-mon[116404]: pgmap v116: 121 pgs: 16 stale+active+clean, 105 active+clean; 235 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 MiB/s rd, 0 op/s 2024-01-13T18:04:10.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:10.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:10.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:10.930 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[131867]: 2024-01-13T18:04:10.665+0000 7efe4d3ab640 -1 Falling back to public interface 2024-01-13T18:04:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:10 smithi099 ceph-mon[138788]: failed to encode map e270 with expected crc 2024-01-13T18:04:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:10 smithi099 ceph-mon[138788]: pgmap v116: 121 pgs: 16 stale+active+clean, 105 active+clean; 235 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 MiB/s rd, 0 op/s 2024-01-13T18:04:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:1085: done (3 left) 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:1086: read oid 46 snap 99 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:1086: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:1087: snap_create 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:1082: finishing write tid 4 to smithi084102331-9 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 308 (ObjNum 341 snap 107 seq_num 341) dirty exists 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:1082: left oid 9 (ObjNum 341 snap 107 seq_num 341) 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:1083: finishing write tid 1 to smithi084102331-27 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:1083: finishing write tid 2 to smithi084102331-27 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:1083: finishing write tid 3 to smithi084102331-27 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:1083: finishing write tid 4 to smithi084102331-27 2024-01-13T18:04:11.204 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 288 (ObjNum 342 snap 107 seq_num 342) dirty exists 2024-01-13T18:04:11.205 INFO:tasks.rados.rados.0.smithi084.stdout:1083: left oid 27 (ObjNum 342 snap 107 seq_num 342) 2024-01-13T18:04:11.205 INFO:tasks.rados.rados.0.smithi084.stdout:1084: finishing copy_from to smithi084102331-8 2024-01-13T18:04:11.205 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 269 (ObjNum 214 snap 61 seq_num 214) dirty exists 2024-01-13T18:04:11.205 INFO:tasks.rados.rados.0.smithi084.stdout:1084: finishing copy_from racing read to smithi084102331-8 2024-01-13T18:04:11.218 INFO:tasks.rados.rados.0.smithi084.stdout:1086: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:04:12.210 INFO:tasks.rados.rados.0.smithi084.stdout:1082: done (4 left) 2024-01-13T18:04:12.210 INFO:tasks.rados.rados.0.smithi084.stdout:1083: done (3 left) 2024-01-13T18:04:12.211 INFO:tasks.rados.rados.0.smithi084.stdout:1084: done (2 left) 2024-01-13T18:04:12.211 INFO:tasks.rados.rados.0.smithi084.stdout:1086: done (1 left) 2024-01-13T18:04:12.211 INFO:tasks.rados.rados.0.smithi084.stdout:1087: done (0 left) 2024-01-13T18:04:12.211 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 108 2024-01-13T18:04:12.211 INFO:tasks.rados.rados.0.smithi084.stdout:1088: seq_num 343 ranges {0=548864,548864=401408} 2024-01-13T18:04:12.213 INFO:tasks.rados.rados.0.smithi084.stdout:1088: writing smithi084102331-13 from 0 to 548864 tid 1 2024-01-13T18:04:12.216 INFO:tasks.rados.rados.0.smithi084.stdout:1088: writing smithi084102331-13 from 548864 to 950272 tid 2 2024-01-13T18:04:12.216 INFO:tasks.rados.rados.0.smithi084.stdout:1089: snap_create 2024-01-13T18:04:12.220 INFO:tasks.rados.rados.0.smithi084.stdout:1088: finishing write tid 1 to smithi084102331-13 2024-01-13T18:04:12.220 INFO:tasks.rados.rados.0.smithi084.stdout:1088: finishing write tid 2 to smithi084102331-13 2024-01-13T18:04:12.220 INFO:tasks.rados.rados.0.smithi084.stdout:1088: finishing write tid 3 to smithi084102331-13 2024-01-13T18:04:12.223 INFO:tasks.rados.rados.0.smithi084.stdout:1088: finishing write tid 4 to smithi084102331-13 2024-01-13T18:04:12.223 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 324 (ObjNum 343 snap 108 seq_num 343) dirty exists 2024-01-13T18:04:12.223 INFO:tasks.rados.rados.0.smithi084.stdout:1088: left oid 13 (ObjNum 343 snap 108 seq_num 343) 2024-01-13T18:04:12.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:12 smithi084 ceph-mon[116404]: failed to encode map e271 with expected crc 2024-01-13T18:04:12.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:12 smithi084 ceph-mon[116404]: failed to encode map e271 with expected crc 2024-01-13T18:04:12.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:12 smithi084 ceph-mon[116404]: osdmap e271: 8 total, 7 up, 8 in 2024-01-13T18:04:12.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:12 smithi084 ceph-mon[116404]: failed to encode map e271 with expected crc 2024-01-13T18:04:12.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:12 smithi084 ceph-mon[119097]: failed to encode map e271 with expected crc 2024-01-13T18:04:12.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:12 smithi084 ceph-mon[119097]: failed to encode map e271 with expected crc 2024-01-13T18:04:12.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:12 smithi084 ceph-mon[119097]: osdmap e271: 8 total, 7 up, 8 in 2024-01-13T18:04:12.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:12 smithi084 ceph-mon[119097]: failed to encode map e271 with expected crc 2024-01-13T18:04:12.579 INFO:tasks.rados.rados.0.smithi084.stdout:1088: done (1 left) 2024-01-13T18:04:12.579 INFO:tasks.rados.rados.0.smithi084.stdout:1089: done (0 left) 2024-01-13T18:04:12.579 INFO:tasks.rados.rados.0.smithi084.stdout:1090: rollback oid 26 current snap is 109 2024-01-13T18:04:12.579 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 99 2024-01-13T18:04:12.579 INFO:tasks.rados.rados.0.smithi084.stdout:1091: copy_from oid 48 from oid 14 current snap is 109 2024-01-13T18:04:12.579 INFO:tasks.rados.rados.0.smithi084.stdout:1092: snap_create 2024-01-13T18:04:12.585 INFO:tasks.rados.rados.0.smithi084.stdout:1090: finishing rollback tid 0 to smithi084102331-26 2024-01-13T18:04:12.586 INFO:tasks.rados.rados.0.smithi084.stdout:1090: finishing rollback tid 1 to smithi084102331-26 2024-01-13T18:04:12.588 INFO:tasks.rados.rados.0.smithi084.stdout:1090: finishing rollback tid 2 to smithi084102331-26 2024-01-13T18:04:12.588 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 380 (ObjNum 271 snap 87 seq_num 271) dirty exists 2024-01-13T18:04:12.594 INFO:tasks.rados.rados.0.smithi084.stdout:1091: finishing copy_from to smithi084102331-48 2024-01-13T18:04:12.594 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 376 (ObjNum 338 snap 107 seq_num 338) dirty exists 2024-01-13T18:04:12.594 INFO:tasks.rados.rados.0.smithi084.stdout:1091: finishing copy_from racing read to smithi084102331-48 2024-01-13T18:04:12.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:12 smithi099 ceph-mon[138788]: failed to encode map e271 with expected crc 2024-01-13T18:04:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:12 smithi099 ceph-mon[138788]: failed to encode map e271 with expected crc 2024-01-13T18:04:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:12 smithi099 ceph-mon[138788]: osdmap e271: 8 total, 7 up, 8 in 2024-01-13T18:04:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:12 smithi099 ceph-mon[138788]: failed to encode map e271 with expected crc 2024-01-13T18:04:13.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: failed to encode map e271 with expected crc 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: pgmap v118: 121 pgs: 10 active+undersized+degraded, 36 active+undersized, 75 active+clean; 240 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.1 MiB/s rd, 1.7 MiB/s wr, 7 op/s; 64/525 objects degraded (12.190%) 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: Health check failed: Degraded data redundancy: 64/525 objects degraded (12.190%), 10 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: failed to encode map e272 with expected crc 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: failed to encode map e272 with expected crc 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: osdmap e272: 8 total, 7 up, 8 in 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: failed to encode map e272 with expected crc 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: osdmap e273: 8 total, 7 up, 8 in 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: failed to encode map e273 with expected crc 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: failed to encode map e273 with expected crc 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: failed to encode map e271 with expected crc 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: pgmap v118: 121 pgs: 10 active+undersized+degraded, 36 active+undersized, 75 active+clean; 240 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.1 MiB/s rd, 1.7 MiB/s wr, 7 op/s; 64/525 objects degraded (12.190%) 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: Health check failed: Degraded data redundancy: 64/525 objects degraded (12.190%), 10 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: failed to encode map e272 with expected crc 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: failed to encode map e272 with expected crc 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: osdmap e272: 8 total, 7 up, 8 in 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: failed to encode map e272 with expected crc 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: osdmap e273: 8 total, 7 up, 8 in 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: failed to encode map e273 with expected crc 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: failed to encode map e273 with expected crc 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.580 INFO:tasks.rados.rados.0.smithi084.stdout:1090: done (2 left) 2024-01-13T18:04:13.581 INFO:tasks.rados.rados.0.smithi084.stdout:1091: done (1 left) 2024-01-13T18:04:13.581 INFO:tasks.rados.rados.0.smithi084.stdout:1092: done (0 left) 2024-01-13T18:04:13.581 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 110 2024-01-13T18:04:13.581 INFO:tasks.rados.rados.0.smithi084.stdout:1093: seq_num 344 ranges {4308992=565248,4874240=401408} 2024-01-13T18:04:13.607 INFO:tasks.rados.rados.0.smithi084.stdout:1093: writing smithi084102331-23 from 4308992 to 4874240 tid 1 2024-01-13T18:04:13.610 INFO:tasks.rados.rados.0.smithi084.stdout:1093: writing smithi084102331-23 from 4874240 to 5275648 tid 2 2024-01-13T18:04:13.610 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 110 2024-01-13T18:04:13.610 INFO:tasks.rados.rados.0.smithi084.stdout:1094: seq_num 345 ranges {1040384=581632,1622016=401408} 2024-01-13T18:04:13.618 INFO:tasks.rados.rados.0.smithi084.stdout:1094: writing smithi084102331-36 from 1040384 to 1622016 tid 1 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: failed to encode map e271 with expected crc 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: pgmap v118: 121 pgs: 10 active+undersized+degraded, 36 active+undersized, 75 active+clean; 240 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.1 MiB/s rd, 1.7 MiB/s wr, 7 op/s; 64/525 objects degraded (12.190%) 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: Health check failed: Degraded data redundancy: 64/525 objects degraded (12.190%), 10 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: failed to encode map e272 with expected crc 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: failed to encode map e272 with expected crc 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: osdmap e272: 8 total, 7 up, 8 in 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: failed to encode map e272 with expected crc 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: osdmap e273: 8 total, 7 up, 8 in 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: failed to encode map e273 with expected crc 2024-01-13T18:04:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: failed to encode map e273 with expected crc 2024-01-13T18:04:13.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:13.621 INFO:tasks.rados.rados.0.smithi084.stdout:1094: writing smithi084102331-36 from 1622016 to 2023424 tid 2 2024-01-13T18:04:13.621 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 110 2024-01-13T18:04:13.621 INFO:tasks.rados.rados.0.smithi084.stdout:1093: finishing write tid 1 to smithi084102331-23 2024-01-13T18:04:13.621 INFO:tasks.rados.rados.0.smithi084.stdout:1095: seq_num 346 ranges {4308992=598016,4907008=401408} 2024-01-13T18:04:13.648 INFO:tasks.rados.rados.0.smithi084.stdout:1095: writing smithi084102331-12 from 4308992 to 4907008 tid 1 2024-01-13T18:04:13.650 INFO:tasks.rados.rados.0.smithi084.stdout:1095: writing smithi084102331-12 from 4907008 to 5308416 tid 2 2024-01-13T18:04:13.650 INFO:tasks.rados.rados.0.smithi084.stdout:1096: snap_create 2024-01-13T18:04:13.650 INFO:tasks.rados.rados.0.smithi084.stdout:1093: finishing write tid 2 to smithi084102331-23 2024-01-13T18:04:13.650 INFO:tasks.rados.rados.0.smithi084.stdout:1093: finishing write tid 3 to smithi084102331-23 2024-01-13T18:04:13.651 INFO:tasks.rados.rados.0.smithi084.stdout:1093: finishing write tid 4 to smithi084102331-23 2024-01-13T18:04:13.651 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 419 (ObjNum 344 snap 110 seq_num 344) dirty exists 2024-01-13T18:04:13.651 INFO:tasks.rados.rados.0.smithi084.stdout:1093: left oid 23 (ObjNum 344 snap 110 seq_num 344) 2024-01-13T18:04:13.651 INFO:tasks.rados.rados.0.smithi084.stdout:1094: finishing write tid 1 to smithi084102331-36 2024-01-13T18:04:13.651 INFO:tasks.rados.rados.0.smithi084.stdout:1094: finishing write tid 2 to smithi084102331-36 2024-01-13T18:04:13.651 INFO:tasks.rados.rados.0.smithi084.stdout:1094: finishing write tid 3 to smithi084102331-36 2024-01-13T18:04:13.651 INFO:tasks.rados.rados.0.smithi084.stdout:1094: finishing write tid 4 to smithi084102331-36 2024-01-13T18:04:13.651 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 384 (ObjNum 345 snap 110 seq_num 345) dirty exists 2024-01-13T18:04:13.651 INFO:tasks.rados.rados.0.smithi084.stdout:1094: left oid 36 (ObjNum 345 snap 110 seq_num 345) 2024-01-13T18:04:13.653 INFO:tasks.rados.rados.0.smithi084.stdout:1095: finishing write tid 1 to smithi084102331-12 2024-01-13T18:04:13.653 INFO:tasks.rados.rados.0.smithi084.stdout:1095: finishing write tid 2 to smithi084102331-12 2024-01-13T18:04:13.653 INFO:tasks.rados.rados.0.smithi084.stdout:1095: finishing write tid 3 to smithi084102331-12 2024-01-13T18:04:13.654 INFO:tasks.rados.rados.0.smithi084.stdout:1095: finishing write tid 4 to smithi084102331-12 2024-01-13T18:04:13.654 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 423 (ObjNum 346 snap 110 seq_num 346) dirty exists 2024-01-13T18:04:13.654 INFO:tasks.rados.rados.0.smithi084.stdout:1095: left oid 12 (ObjNum 346 snap 110 seq_num 346) 2024-01-13T18:04:13.770 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[131867]: 2024-01-13T18:04:13.458+0000 7efe4d3ab640 -1 osd.1 0 read_superblock omap replica is missing. 2024-01-13T18:04:13.771 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[131867]: 2024-01-13T18:04:13.504+0000 7efe4d3ab640 -1 osd.1 266 log_to_monitors true 2024-01-13T18:04:13.771 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 18:04:13 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[131867]: 2024-01-13T18:04:13.602+0000 7efe3e806700 -1 osd.1 266 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T18:04:14.588 INFO:tasks.rados.rados.0.smithi084.stdout:1093: done (3 left) 2024-01-13T18:04:14.588 INFO:tasks.rados.rados.0.smithi084.stdout:1094: done (2 left) 2024-01-13T18:04:14.588 INFO:tasks.rados.rados.0.smithi084.stdout:1095: done (1 left) 2024-01-13T18:04:14.588 INFO:tasks.rados.rados.0.smithi084.stdout:1096: done (0 left) 2024-01-13T18:04:14.588 INFO:tasks.rados.rados.0.smithi084.stdout:1097: read oid 16 snap -1 2024-01-13T18:04:14.588 INFO:tasks.rados.rados.0.smithi084.stdout:1097: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:14.588 INFO:tasks.rados.rados.0.smithi084.stdout:1098: snap_create 2024-01-13T18:04:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:14 smithi099 ceph-mon[138788]: failed to encode map e272 with expected crc 2024-01-13T18:04:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:14 smithi099 ceph-mon[138788]: from='osd.1 [v2:172.21.15.84:6810/217168835,v1:172.21.15.84:6811/217168835]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T18:04:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:14 smithi099 ceph-mon[138788]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T18:04:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:14 smithi099 ceph-mon[138788]: failed to encode map e274 with expected crc 2024-01-13T18:04:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:14 smithi099 ceph-mon[138788]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-13T18:04:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:14 smithi099 ceph-mon[138788]: osdmap e274: 8 total, 7 up, 8 in 2024-01-13T18:04:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:14 smithi099 ceph-mon[138788]: from='osd.1 [v2:172.21.15.84:6810/217168835,v1:172.21.15.84:6811/217168835]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:14 smithi099 ceph-mon[138788]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:14 smithi099 ceph-mon[138788]: failed to encode map e274 with expected crc 2024-01-13T18:04:14.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[116404]: failed to encode map e272 with expected crc 2024-01-13T18:04:14.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[116404]: from='osd.1 [v2:172.21.15.84:6810/217168835,v1:172.21.15.84:6811/217168835]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T18:04:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[116404]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T18:04:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[116404]: failed to encode map e274 with expected crc 2024-01-13T18:04:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[116404]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-13T18:04:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[116404]: osdmap e274: 8 total, 7 up, 8 in 2024-01-13T18:04:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[116404]: from='osd.1 [v2:172.21.15.84:6810/217168835,v1:172.21.15.84:6811/217168835]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[116404]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[116404]: failed to encode map e274 with expected crc 2024-01-13T18:04:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[119097]: failed to encode map e272 with expected crc 2024-01-13T18:04:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[119097]: from='osd.1 [v2:172.21.15.84:6810/217168835,v1:172.21.15.84:6811/217168835]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T18:04:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[119097]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-13T18:04:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[119097]: failed to encode map e274 with expected crc 2024-01-13T18:04:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[119097]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-13T18:04:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[119097]: osdmap e274: 8 total, 7 up, 8 in 2024-01-13T18:04:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[119097]: from='osd.1 [v2:172.21.15.84:6810/217168835,v1:172.21.15.84:6811/217168835]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[119097]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:14.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:14 smithi084 ceph-mon[119097]: failed to encode map e274 with expected crc 2024-01-13T18:04:15.596 INFO:tasks.rados.rados.0.smithi084.stdout:1098: done (1 left) 2024-01-13T18:04:15.596 INFO:tasks.rados.rados.0.smithi084.stdout:1099: rmattr oid 24 current snap is 112 2024-01-13T18:04:15.596 INFO:tasks.rados.rados.0.smithi084.stdout:1099: done (1 left) 2024-01-13T18:04:15.596 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 112 2024-01-13T18:04:15.596 INFO:tasks.rados.rados.0.smithi084.stdout:1100: seq_num 347 ranges {466944=614400,1081344=401408} 2024-01-13T18:04:15.597 INFO:tasks.rados.rados.0.smithi084.stdout:1100: writing smithi084102331-33 from 466944 to 1081344 tid 1 2024-01-13T18:04:15.601 INFO:tasks.rados.rados.0.smithi084.stdout:1100: writing smithi084102331-33 from 1081344 to 1482752 tid 2 2024-01-13T18:04:15.601 INFO:tasks.rados.rados.0.smithi084.stdout:1101: snap_create 2024-01-13T18:04:15.608 INFO:tasks.rados.rados.0.smithi084.stdout:1100: finishing write tid 1 to smithi084102331-33 2024-01-13T18:04:15.610 INFO:tasks.rados.rados.0.smithi084.stdout:1100: finishing write tid 2 to smithi084102331-33 2024-01-13T18:04:15.610 INFO:tasks.rados.rados.0.smithi084.stdout:1100: finishing write tid 3 to smithi084102331-33 2024-01-13T18:04:15.616 INFO:tasks.rados.rados.0.smithi084.stdout:1100: finishing write tid 4 to smithi084102331-33 2024-01-13T18:04:15.616 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 477 (ObjNum 347 snap 112 seq_num 347) dirty exists 2024-01-13T18:04:15.616 INFO:tasks.rados.rados.0.smithi084.stdout:1100: left oid 33 (ObjNum 347 snap 112 seq_num 347) 2024-01-13T18:04:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:15 smithi099 ceph-mon[138788]: failed to encode map e274 with expected crc 2024-01-13T18:04:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:15 smithi099 ceph-mon[138788]: pgmap v122: 121 pgs: 10 active+undersized+degraded, 36 active+undersized, 75 active+clean; 240 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 1.9 MiB/s wr, 7 op/s; 64/525 objects degraded (12.190%) 2024-01-13T18:04:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:15 smithi099 ceph-mon[138788]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:04:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:15 smithi099 ceph-mon[138788]: failed to encode map e275 with expected crc 2024-01-13T18:04:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:15 smithi099 ceph-mon[138788]: failed to encode map e275 with expected crc 2024-01-13T18:04:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:15 smithi099 ceph-mon[138788]: osd.1 [v2:172.21.15.84:6810/217168835,v1:172.21.15.84:6811/217168835] boot 2024-01-13T18:04:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:15 smithi099 ceph-mon[138788]: osdmap e275: 8 total, 8 up, 8 in 2024-01-13T18:04:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:15 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:04:15.645 INFO:tasks.rados.rados.0.smithi084.stdout:1097: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:15.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:04:15.425+0000 7fcaf82a4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-01-13T18:04:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[119097]: failed to encode map e274 with expected crc 2024-01-13T18:04:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[119097]: pgmap v122: 121 pgs: 10 active+undersized+degraded, 36 active+undersized, 75 active+clean; 240 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 1.9 MiB/s wr, 7 op/s; 64/525 objects degraded (12.190%) 2024-01-13T18:04:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[119097]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:04:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[119097]: failed to encode map e275 with expected crc 2024-01-13T18:04:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[119097]: failed to encode map e275 with expected crc 2024-01-13T18:04:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[119097]: osd.1 [v2:172.21.15.84:6810/217168835,v1:172.21.15.84:6811/217168835] boot 2024-01-13T18:04:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[119097]: osdmap e275: 8 total, 8 up, 8 in 2024-01-13T18:04:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:04:15.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[116404]: failed to encode map e274 with expected crc 2024-01-13T18:04:15.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[116404]: pgmap v122: 121 pgs: 10 active+undersized+degraded, 36 active+undersized, 75 active+clean; 240 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 1.9 MiB/s wr, 7 op/s; 64/525 objects degraded (12.190%) 2024-01-13T18:04:15.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[116404]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:04:15.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[116404]: failed to encode map e275 with expected crc 2024-01-13T18:04:15.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[116404]: failed to encode map e275 with expected crc 2024-01-13T18:04:15.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[116404]: osd.1 [v2:172.21.15.84:6810/217168835,v1:172.21.15.84:6811/217168835] boot 2024-01-13T18:04:15.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[116404]: osdmap e275: 8 total, 8 up, 8 in 2024-01-13T18:04:15.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:15 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-13T18:04:16.595 INFO:tasks.rados.rados.0.smithi084.stdout:1097: done (2 left) 2024-01-13T18:04:16.595 INFO:tasks.rados.rados.0.smithi084.stdout:1100: done (1 left) 2024-01-13T18:04:16.595 INFO:tasks.rados.rados.0.smithi084.stdout:1101: done (0 left) 2024-01-13T18:04:16.595 INFO:tasks.rados.rados.0.smithi084.stdout:1102: snap_remove snap 110 2024-01-13T18:04:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: failed to encode map e275 with expected crc 2024-01-13T18:04:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:04:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: osdmap e276: 8 total, 8 up, 8 in 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:16 smithi099 ceph-mon[138788]: pgmap v125: 121 pgs: 5 active+undersized+degraded, 17 active+undersized, 99 active+clean; 242 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.5 MiB/s wr, 8 op/s; 23/534 objects degraded (4.307%); 7.2 MiB/s, 2 objects/s recovering 2024-01-13T18:04:16.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: failed to encode map e275 with expected crc 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-01-13T18:04:16.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: osdmap e276: 8 total, 8 up, 8 in 2024-01-13T18:04:16.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[116404]: pgmap v125: 121 pgs: 5 active+undersized+degraded, 17 active+undersized, 99 active+clean; 242 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.5 MiB/s wr, 8 op/s; 23/534 objects degraded (4.307%); 7.2 MiB/s, 2 objects/s recovering 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: failed to encode map e275 with expected crc 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: osdmap e276: 8 total, 8 up, 8 in 2024-01-13T18:04:16.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:16.682 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:16 smithi084 ceph-mon[119097]: pgmap v125: 121 pgs: 5 active+undersized+degraded, 17 active+undersized, 99 active+clean; 242 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.5 MiB/s wr, 8 op/s; 23/534 objects degraded (4.307%); 7.2 MiB/s, 2 objects/s recovering 2024-01-13T18:04:17.596 INFO:tasks.rados.rados.0.smithi084.stdout:1102: done (0 left) 2024-01-13T18:04:17.596 INFO:tasks.rados.rados.0.smithi084.stdout:1103: copy_from oid 33 from oid 1 current snap is 113 2024-01-13T18:04:17.596 INFO:tasks.rados.rados.0.smithi084.stdout:1104: read oid 46 snap -1 2024-01-13T18:04:17.597 INFO:tasks.rados.rados.0.smithi084.stdout:1104: expect (ObjNum 335 snap 105 seq_num 335) 2024-01-13T18:04:17.597 INFO:tasks.rados.rados.0.smithi084.stdout:1105: snap_remove snap 96 2024-01-13T18:04:17.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:17 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:17 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:17 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:17 smithi099 ceph-mon[138788]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:17 smithi099 ceph-mon[138788]: osdmap e277: 8 total, 8 up, 8 in 2024-01-13T18:04:17.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:17 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:17 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:17 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:17 smithi084 ceph-mon[119097]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:17 smithi084 ceph-mon[119097]: osdmap e277: 8 total, 8 up, 8 in 2024-01-13T18:04:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:17 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:17 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:17 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:17 smithi084 ceph-mon[116404]: failed to encode map e276 with expected crc 2024-01-13T18:04:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:17 smithi084 ceph-mon[116404]: osdmap e277: 8 total, 8 up, 8 in 2024-01-13T18:04:18.603 INFO:tasks.rados.rados.0.smithi084.stdout:1105: done (2 left) 2024-01-13T18:04:18.603 INFO:tasks.rados.rados.0.smithi084.stdout:1106: snap_remove snap 92 2024-01-13T18:04:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-mon[138788]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-mon[138788]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-mon[138788]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-mon[138788]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-mon[138788]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 23/534 objects degraded (4.307%), 5 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-mon[138788]: failed to encode map e278 with expected crc 2024-01-13T18:04:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-mon[138788]: failed to encode map e278 with expected crc 2024-01-13T18:04:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-mon[138788]: osdmap e278: 8 total, 8 up, 8 in 2024-01-13T18:04:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-mon[138788]: failed to encode map e278 with expected crc 2024-01-13T18:04:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-mon[138788]: pgmap v128: 121 pgs: 4 active+undersized+degraded, 12 active+undersized, 105 active+clean; 242 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.4 MiB/s wr, 7 op/s; 11/531 objects degraded (2.072%); 6.8 MiB/s, 2 objects/s recovering 2024-01-13T18:04:18.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[119097]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[119097]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[119097]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[119097]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[119097]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 23/534 objects degraded (4.307%), 5 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[119097]: failed to encode map e278 with expected crc 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[119097]: failed to encode map e278 with expected crc 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[119097]: osdmap e278: 8 total, 8 up, 8 in 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[119097]: failed to encode map e278 with expected crc 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[119097]: pgmap v128: 121 pgs: 4 active+undersized+degraded, 12 active+undersized, 105 active+clean; 242 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.4 MiB/s wr, 7 op/s; 11/531 objects degraded (2.072%); 6.8 MiB/s, 2 objects/s recovering 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[116404]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[116404]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[116404]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[116404]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[116404]: failed to encode map e277 with expected crc 2024-01-13T18:04:18.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 23/534 objects degraded (4.307%), 5 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:18.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[116404]: failed to encode map e278 with expected crc 2024-01-13T18:04:18.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[116404]: failed to encode map e278 with expected crc 2024-01-13T18:04:18.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[116404]: osdmap e278: 8 total, 8 up, 8 in 2024-01-13T18:04:18.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[116404]: failed to encode map e278 with expected crc 2024-01-13T18:04:18.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:18 smithi084 ceph-mon[116404]: pgmap v128: 121 pgs: 4 active+undersized+degraded, 12 active+undersized, 105 active+clean; 242 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.4 MiB/s wr, 7 op/s; 11/531 objects degraded (2.072%); 6.8 MiB/s, 2 objects/s recovering 2024-01-13T18:04:19.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:04:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:04:18.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:04:19.603 INFO:tasks.rados.rados.0.smithi084.stdout:1106: done (2 left) 2024-01-13T18:04:19.604 INFO:tasks.rados.rados.0.smithi084.stdout:1107: snap_create 2024-01-13T18:04:19.604 INFO:tasks.rados.rados.0.smithi084.stdout:1104: expect (ObjNum 335 snap 105 seq_num 335) 2024-01-13T18:04:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:19 smithi099 ceph-mon[138788]: failed to encode map e277 with expected crc 2024-01-13T18:04:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:19 smithi099 ceph-mon[138788]: failed to encode map e277 with expected crc 2024-01-13T18:04:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:19 smithi099 ceph-mon[138788]: failed to encode map e278 with expected crc 2024-01-13T18:04:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:19 smithi099 ceph-mon[138788]: failed to encode map e279 with expected crc 2024-01-13T18:04:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:19 smithi099 ceph-mon[138788]: failed to encode map e279 with expected crc 2024-01-13T18:04:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:19 smithi099 ceph-mon[138788]: osdmap e279: 8 total, 8 up, 8 in 2024-01-13T18:04:19.633 INFO:tasks.rados.rados.0.smithi084.stdout:1103: finishing copy_from to smithi084102331-33 2024-01-13T18:04:19.634 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 370 (ObjNum 286 snap 89 seq_num 286) dirty exists 2024-01-13T18:04:19.634 INFO:tasks.rados.rados.0.smithi084.stdout:1103: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:04:19.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[116404]: failed to encode map e277 with expected crc 2024-01-13T18:04:19.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[116404]: failed to encode map e277 with expected crc 2024-01-13T18:04:19.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[116404]: failed to encode map e278 with expected crc 2024-01-13T18:04:19.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[116404]: failed to encode map e279 with expected crc 2024-01-13T18:04:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[116404]: failed to encode map e279 with expected crc 2024-01-13T18:04:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[116404]: osdmap e279: 8 total, 8 up, 8 in 2024-01-13T18:04:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[119097]: failed to encode map e277 with expected crc 2024-01-13T18:04:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[119097]: failed to encode map e277 with expected crc 2024-01-13T18:04:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[119097]: failed to encode map e278 with expected crc 2024-01-13T18:04:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[119097]: failed to encode map e279 with expected crc 2024-01-13T18:04:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[119097]: failed to encode map e279 with expected crc 2024-01-13T18:04:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:19 smithi084 ceph-mon[119097]: osdmap e279: 8 total, 8 up, 8 in 2024-01-13T18:04:20.606 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:04:20] "GET /metrics HTTP/1.1" 200 36065 "" "Prometheus/2.43.0" 2024-01-13T18:04:20.610 INFO:tasks.rados.rados.0.smithi084.stdout:1103: done (2 left) 2024-01-13T18:04:20.610 INFO:tasks.rados.rados.0.smithi084.stdout:1104: done (1 left) 2024-01-13T18:04:20.611 INFO:tasks.rados.rados.0.smithi084.stdout:1107: done (0 left) 2024-01-13T18:04:20.611 INFO:tasks.rados.rados.0.smithi084.stdout:1108: rmattr oid 26 current snap is 114 2024-01-13T18:04:20.611 INFO:tasks.rados.rados.0.smithi084.stdout:1108: done (0 left) 2024-01-13T18:04:20.611 INFO:tasks.rados.rados.0.smithi084.stdout:1109: rmattr oid 47 current snap is 114 2024-01-13T18:04:20.611 INFO:tasks.rados.rados.0.smithi084.stdout:1109: done (0 left) 2024-01-13T18:04:20.611 INFO:tasks.rados.rados.0.smithi084.stdout:1110: rmattr oid 22 current snap is 114 2024-01-13T18:04:20.611 INFO:tasks.rados.rados.0.smithi084.stdout:1110: done (0 left) 2024-01-13T18:04:20.611 INFO:tasks.rados.rados.0.smithi084.stdout:1111: snap_remove snap 103 2024-01-13T18:04:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:20 smithi099 ceph-mon[138788]: failed to encode map e280 with expected crc 2024-01-13T18:04:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:20 smithi099 ceph-mon[138788]: failed to encode map e280 with expected crc 2024-01-13T18:04:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:20 smithi099 ceph-mon[138788]: osdmap e280: 8 total, 8 up, 8 in 2024-01-13T18:04:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:20 smithi099 ceph-mon[138788]: pgmap v131: 121 pgs: 121 active+clean; 242 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:04:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:20.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[116404]: failed to encode map e280 with expected crc 2024-01-13T18:04:20.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[116404]: failed to encode map e280 with expected crc 2024-01-13T18:04:20.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[116404]: osdmap e280: 8 total, 8 up, 8 in 2024-01-13T18:04:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[116404]: pgmap v131: 121 pgs: 121 active+clean; 242 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:04:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:20.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[119097]: failed to encode map e280 with expected crc 2024-01-13T18:04:20.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[119097]: failed to encode map e280 with expected crc 2024-01-13T18:04:20.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[119097]: osdmap e280: 8 total, 8 up, 8 in 2024-01-13T18:04:20.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[119097]: pgmap v131: 121 pgs: 121 active+clean; 242 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail 2024-01-13T18:04:20.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:20.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:21.615 INFO:tasks.rados.rados.0.smithi084.stdout:1111: done (0 left) 2024-01-13T18:04:21.615 INFO:tasks.rados.rados.0.smithi084.stdout:1112: delete oid 38 current snap is 114 2024-01-13T18:04:21.624 INFO:tasks.rados.rados.0.smithi084.stdout:1112: done (0 left) 2024-01-13T18:04:21.624 INFO:tasks.rados.rados.0.smithi084.stdout:1113: rollback oid 3 current snap is 114 2024-01-13T18:04:21.624 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 93 2024-01-13T18:04:21.624 INFO:tasks.rados.rados.0.smithi084.stdout:1114: setattr oid 37 current snap is 114 2024-01-13T18:04:21.626 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 114 2024-01-13T18:04:21.626 INFO:tasks.rados.rados.0.smithi084.stdout:1115: seq_num 349 ranges {0=655360,655360=401408} 2024-01-13T18:04:21.630 INFO:tasks.rados.rados.0.smithi084.stdout:1115: writing smithi084102331-18 from 0 to 655360 tid 1 2024-01-13T18:04:21.633 INFO:tasks.rados.rados.0.smithi084.stdout:1115: writing smithi084102331-18 from 655360 to 1056768 tid 2 2024-01-13T18:04:21.633 INFO:tasks.rados.rados.0.smithi084.stdout:1116: snap_create 2024-01-13T18:04:21.633 INFO:tasks.rados.rados.0.smithi084.stdout:1113: finishing rollback tid 0 to smithi084102331-3 2024-01-13T18:04:21.633 INFO:tasks.rados.rados.0.smithi084.stdout:1113: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:04:21.633 INFO:tasks.rados.rados.0.smithi084.stdout:1113: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:04:21.633 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 545 (ObjNum 215 snap 61 seq_num 215) dirty exists 2024-01-13T18:04:21.633 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 494 (ObjNum 177 snap 0 seq_num 0) dirty exists 2024-01-13T18:04:21.635 INFO:tasks.rados.rados.0.smithi084.stdout:1115: finishing write tid 1 to smithi084102331-18 2024-01-13T18:04:21.635 INFO:tasks.rados.rados.0.smithi084.stdout:1115: finishing write tid 2 to smithi084102331-18 2024-01-13T18:04:21.635 INFO:tasks.rados.rados.0.smithi084.stdout:1115: finishing write tid 3 to smithi084102331-18 2024-01-13T18:04:21.636 INFO:tasks.rados.rados.0.smithi084.stdout:1115: finishing write tid 4 to smithi084102331-18 2024-01-13T18:04:21.636 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 198 (ObjNum 349 snap 114 seq_num 349) dirty exists 2024-01-13T18:04:21.637 INFO:tasks.rados.rados.0.smithi084.stdout:1115: left oid 18 (ObjNum 349 snap 114 seq_num 349) 2024-01-13T18:04:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:21 smithi099 ceph-mon[138788]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/531 objects degraded (2.072%), 4 pgs degraded) 2024-01-13T18:04:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:21 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:04:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:21 smithi099 ceph-mon[138788]: failed to encode map e281 with expected crc 2024-01-13T18:04:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:21 smithi099 ceph-mon[138788]: osdmap e281: 8 total, 8 up, 8 in 2024-01-13T18:04:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:21 smithi099 ceph-mon[138788]: failed to encode map e281 with expected crc 2024-01-13T18:04:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:21 smithi099 ceph-mon[138788]: failed to encode map e281 with expected crc 2024-01-13T18:04:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:21 smithi099 ceph-mon[138788]: mgrmap e41: y(active, since 91s), standbys: x 2024-01-13T18:04:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:21 smithi099 ceph-mon[138788]: failed to encode map e281 with expected crc 2024-01-13T18:04:21.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[116404]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/531 objects degraded (2.072%), 4 pgs degraded) 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[116404]: failed to encode map e281 with expected crc 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[116404]: osdmap e281: 8 total, 8 up, 8 in 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[116404]: failed to encode map e281 with expected crc 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[116404]: failed to encode map e281 with expected crc 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[116404]: mgrmap e41: y(active, since 91s), standbys: x 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[116404]: failed to encode map e281 with expected crc 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[119097]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/531 objects degraded (2.072%), 4 pgs degraded) 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[119097]: failed to encode map e281 with expected crc 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[119097]: osdmap e281: 8 total, 8 up, 8 in 2024-01-13T18:04:21.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[119097]: failed to encode map e281 with expected crc 2024-01-13T18:04:21.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[119097]: failed to encode map e281 with expected crc 2024-01-13T18:04:21.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[119097]: mgrmap e41: y(active, since 91s), standbys: x 2024-01-13T18:04:21.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:21 smithi084 ceph-mon[119097]: failed to encode map e281 with expected crc 2024-01-13T18:04:22.581 INFO:tasks.rados.rados.0.smithi084.stdout:1113: done (3 left) 2024-01-13T18:04:22.581 INFO:tasks.rados.rados.0.smithi084.stdout:1114: done (2 left) 2024-01-13T18:04:22.581 INFO:tasks.rados.rados.0.smithi084.stdout:1115: done (1 left) 2024-01-13T18:04:22.581 INFO:tasks.rados.rados.0.smithi084.stdout:1116: done (0 left) 2024-01-13T18:04:22.581 INFO:tasks.rados.rados.0.smithi084.stdout:1117: read oid 7 snap 105 2024-01-13T18:04:22.581 INFO:tasks.rados.rados.0.smithi084.stdout:1117: expect (ObjNum 321 snap 101 seq_num 321) 2024-01-13T18:04:22.582 INFO:tasks.rados.rados.0.smithi084.stdout:1118: rmattr oid 2 current snap is 115 2024-01-13T18:04:22.582 INFO:tasks.rados.rados.0.smithi084.stdout:1118: done (1 left) 2024-01-13T18:04:22.582 INFO:tasks.rados.rados.0.smithi084.stdout:1119: copy_from oid 47 from oid 9 current snap is 115 2024-01-13T18:04:22.582 INFO:tasks.rados.rados.0.smithi084.stdout:1120: copy_from oid 42 from oid 35 current snap is 115 2024-01-13T18:04:22.582 INFO:tasks.rados.rados.0.smithi084.stdout:1121: copy_from oid 15 from oid 1 current snap is 115 2024-01-13T18:04:22.582 INFO:tasks.rados.rados.0.smithi084.stdout:1122: delete oid 28 current snap is 115 2024-01-13T18:04:22.589 INFO:tasks.rados.rados.0.smithi084.stdout:1117: expect (ObjNum 321 snap 101 seq_num 321) 2024-01-13T18:04:22.611 INFO:tasks.rados.rados.0.smithi084.stdout:1119: finishing copy_from to smithi084102331-47 2024-01-13T18:04:22.611 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 308 (ObjNum 341 snap 107 seq_num 341) dirty exists 2024-01-13T18:04:22.611 INFO:tasks.rados.rados.0.smithi084.stdout:1119: finishing copy_from racing read to smithi084102331-47 2024-01-13T18:04:22.611 INFO:tasks.rados.rados.0.smithi084.stdout:1117: done (4 left) 2024-01-13T18:04:22.611 INFO:tasks.rados.rados.0.smithi084.stdout:1119: done (3 left) 2024-01-13T18:04:22.612 INFO:tasks.rados.rados.0.smithi084.stdout:1122: done (2 left) 2024-01-13T18:04:22.612 INFO:tasks.rados.rados.0.smithi084.stdout:1123: rollback oid 9 current snap is 115 2024-01-13T18:04:22.612 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 109 2024-01-13T18:04:22.612 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 115 2024-01-13T18:04:22.612 INFO:tasks.rados.rados.0.smithi084.stdout:1124: seq_num 351 ranges {868352=688128,1556480=401408} 2024-01-13T18:04:22.617 INFO:tasks.rados.rados.0.smithi084.stdout:1124: writing smithi084102331-14 from 868352 to 1556480 tid 1 2024-01-13T18:04:22.620 INFO:tasks.rados.rados.0.smithi084.stdout:1124: writing smithi084102331-14 from 1556480 to 1957888 tid 2 2024-01-13T18:04:22.620 INFO:tasks.rados.rados.0.smithi084.stdout:1125: snap_remove snap 82 2024-01-13T18:04:22.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[119097]: failed to encode map e281 with expected crc 2024-01-13T18:04:22.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[119097]: failed to encode map e282 with expected crc 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[119097]: failed to encode map e282 with expected crc 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[119097]: osdmap e282: 8 total, 8 up, 8 in 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[119097]: failed to encode map e282 with expected crc 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[119097]: pgmap v134: 121 pgs: 121 active+clean; 236 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 600 KiB/s rd, 2.0 MiB/s wr, 3 op/s 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[119097]: osdmap e283: 8 total, 8 up, 8 in 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[116404]: failed to encode map e281 with expected crc 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[116404]: failed to encode map e282 with expected crc 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[116404]: failed to encode map e282 with expected crc 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[116404]: osdmap e282: 8 total, 8 up, 8 in 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[116404]: failed to encode map e282 with expected crc 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[116404]: pgmap v134: 121 pgs: 121 active+clean; 236 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 600 KiB/s rd, 2.0 MiB/s wr, 3 op/s 2024-01-13T18:04:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:22 smithi084 ceph-mon[116404]: osdmap e283: 8 total, 8 up, 8 in 2024-01-13T18:04:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:22 smithi099 ceph-mon[138788]: failed to encode map e281 with expected crc 2024-01-13T18:04:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:22 smithi099 ceph-mon[138788]: failed to encode map e282 with expected crc 2024-01-13T18:04:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:22 smithi099 ceph-mon[138788]: failed to encode map e282 with expected crc 2024-01-13T18:04:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:22 smithi099 ceph-mon[138788]: osdmap e282: 8 total, 8 up, 8 in 2024-01-13T18:04:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:22 smithi099 ceph-mon[138788]: failed to encode map e282 with expected crc 2024-01-13T18:04:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:22 smithi099 ceph-mon[138788]: pgmap v134: 121 pgs: 121 active+clean; 236 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 600 KiB/s rd, 2.0 MiB/s wr, 3 op/s 2024-01-13T18:04:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:22 smithi099 ceph-mon[138788]: osdmap e283: 8 total, 8 up, 8 in 2024-01-13T18:04:23.625 INFO:tasks.rados.rados.0.smithi084.stdout:1125: done (4 left) 2024-01-13T18:04:23.625 INFO:tasks.rados.rados.0.smithi084.stdout:1126: snap_remove snap 79 2024-01-13T18:04:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:23 smithi084 ceph-mon[116404]: failed to encode map e283 with expected crc 2024-01-13T18:04:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:23 smithi084 ceph-mon[116404]: failed to encode map e283 with expected crc 2024-01-13T18:04:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:23 smithi084 ceph-mon[116404]: failed to encode map e283 with expected crc 2024-01-13T18:04:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:23 smithi084 ceph-mon[116404]: failed to encode map e283 with expected crc 2024-01-13T18:04:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:23 smithi084 ceph-mon[119097]: failed to encode map e283 with expected crc 2024-01-13T18:04:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:23 smithi084 ceph-mon[119097]: failed to encode map e283 with expected crc 2024-01-13T18:04:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:23 smithi084 ceph-mon[119097]: failed to encode map e283 with expected crc 2024-01-13T18:04:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:23 smithi084 ceph-mon[119097]: failed to encode map e283 with expected crc 2024-01-13T18:04:24.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:23 smithi099 ceph-mon[138788]: failed to encode map e283 with expected crc 2024-01-13T18:04:24.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:23 smithi099 ceph-mon[138788]: failed to encode map e283 with expected crc 2024-01-13T18:04:24.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:23 smithi099 ceph-mon[138788]: failed to encode map e283 with expected crc 2024-01-13T18:04:24.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:23 smithi099 ceph-mon[138788]: failed to encode map e283 with expected crc 2024-01-13T18:04:24.335 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:04:24.623 INFO:tasks.rados.rados.0.smithi084.stdout:1126: done (4 left) 2024-01-13T18:04:24.623 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 115 2024-01-13T18:04:24.624 INFO:tasks.rados.rados.0.smithi084.stdout:1123: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:04:24.624 INFO:tasks.rados.rados.0.smithi084.stdout:1123: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:04:24.624 INFO:tasks.rados.rados.0.smithi084.stdout:1123: finishing rollback tid 2 to smithi084102331-9 2024-01-13T18:04:24.624 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 330 (ObjNum 341 snap 107 seq_num 341) dirty exists 2024-01-13T18:04:24.624 INFO:tasks.rados.rados.0.smithi084.stdout:1120: finishing copy_from to smithi084102331-42 2024-01-13T18:04:24.624 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 326 (ObjNum 317 snap 100 seq_num 317) dirty exists 2024-01-13T18:04:24.624 INFO:tasks.rados.rados.0.smithi084.stdout:1120: finishing copy_from racing read to smithi084102331-42 2024-01-13T18:04:24.624 INFO:tasks.rados.rados.0.smithi084.stdout:1124: finishing write tid 1 to smithi084102331-14 2024-01-13T18:04:24.624 INFO:tasks.rados.rados.0.smithi084.stdout:1124: finishing write tid 2 to smithi084102331-14 2024-01-13T18:04:24.624 INFO:tasks.rados.rados.0.smithi084.stdout:1127: seq_num 352 ranges {1376256=704512,2080768=401408} 2024-01-13T18:04:24.636 INFO:tasks.rados.rados.0.smithi084.stdout:1127: writing smithi084102331-40 from 1376256 to 2080768 tid 1 2024-01-13T18:04:24.638 INFO:tasks.rados.rados.0.smithi084.stdout:1127: writing smithi084102331-40 from 2080768 to 2482176 tid 2 2024-01-13T18:04:24.638 INFO:tasks.rados.rados.0.smithi084.stdout:1120: done (4 left) 2024-01-13T18:04:24.638 INFO:tasks.rados.rados.0.smithi084.stdout:1123: done (3 left) 2024-01-13T18:04:24.639 INFO:tasks.rados.rados.0.smithi084.stdout:1128: read oid 4 snap -1 2024-01-13T18:04:24.639 INFO:tasks.rados.rados.0.smithi084.stdout:1128: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:24.639 INFO:tasks.rados.rados.0.smithi084.stdout:1129: delete oid 10 current snap is 115 2024-01-13T18:04:24.639 INFO:tasks.rados.rados.0.smithi084.stdout:1124: finishing write tid 3 to smithi084102331-14 2024-01-13T18:04:24.639 INFO:tasks.rados.rados.0.smithi084.stdout:1124: finishing write tid 4 to smithi084102331-14 2024-01-13T18:04:24.639 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 410 (ObjNum 351 snap 115 seq_num 351) dirty exists 2024-01-13T18:04:24.639 INFO:tasks.rados.rados.0.smithi084.stdout:1124: left oid 14 (ObjNum 351 snap 115 seq_num 351) 2024-01-13T18:04:24.639 INFO:tasks.rados.rados.0.smithi084.stdout:1121: finishing copy_from to smithi084102331-15 2024-01-13T18:04:24.639 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 370 (ObjNum 286 snap 89 seq_num 286) dirty exists 2024-01-13T18:04:24.639 INFO:tasks.rados.rados.0.smithi084.stdout:1121: finishing copy_from racing read to smithi084102331-15 2024-01-13T18:04:24.643 INFO:tasks.rados.rados.0.smithi084.stdout:1121: done (4 left) 2024-01-13T18:04:24.644 INFO:tasks.rados.rados.0.smithi084.stdout:1124: done (3 left) 2024-01-13T18:04:24.644 INFO:tasks.rados.rados.0.smithi084.stdout:1129: done (2 left) 2024-01-13T18:04:24.644 INFO:tasks.rados.rados.0.smithi084.stdout:1130: rollback oid 10 current snap is 115 2024-01-13T18:04:24.644 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 102 2024-01-13T18:04:24.644 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 115 2024-01-13T18:04:24.644 INFO:tasks.rados.rados.0.smithi084.stdout:1131: seq_num 354 ranges {4169728=737280,4907008=401408} 2024-01-13T18:04:24.662 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:04:24.662 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (2m) 12s ago 5m 17.0M - 0.25.0 c8568f914cd2 a5cbc3e01ffb 2024-01-13T18:04:24.662 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (2m) 67s ago 4m 79.4M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (5m) 12s ago 5m 15.6M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (5m) 67s ago 5m 20.0M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (112s) 67s ago 8m 447M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (2m) 12s ago 9m 508M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (102s) 12s ago 9m 75.8M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d b64908c7a53c 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (75s) 67s ago 8m 23.8M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d be7bb477ea53 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (84s) 12s ago 8m 48.0M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d e13f01b852ff 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (2m) 12s ago 4m 10.4M - 1.5.0 0da6a335fe13 b72e6d50f165 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (2m) 67s ago 4m 8514k - 1.5.0 0da6a335fe13 e9f879b5e55b 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (42s) 12s ago 8m 174M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d e18181bdb4a8 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (14s) 12s ago 7m 11.6M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 32bdce285b36 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (7m) 12s ago 7m 343M 2488M 17.2.7-268-g6441305d c3a232f785d8 14025770cf00 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (7m) 12s ago 7m 277M 2488M 17.2.7-268-g6441305d c3a232f785d8 068cf98fa99c 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (6m) 67s ago 6m 272M 2488M 17.2.7-268-g6441305d c3a232f785d8 30e0722550a0 2024-01-13T18:04:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (6m) 67s ago 6m 268M 2488M 17.2.7-268-g6441305d c3a232f785d8 51be805dde78 2024-01-13T18:04:24.664 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (6m) 67s ago 6m 198M 2488M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:04:24.664 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (6m) 67s ago 6m 144M 2488M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:04:24.664 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (115s) 67s ago 5m 48.2M - 2.43.0 a07b618ecd1d cb4c11bf6eec 2024-01-13T18:04:24.671 INFO:tasks.rados.rados.0.smithi084.stdout:1131: writing smithi084102331-8 from 4169728 to 4907008 tid 1 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:1131: writing smithi084102331-8 from 4907008 to 5308416 tid 2 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:1132: rollback oid 24 current snap is 115 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 94 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:1127: finishing write tid 1 to smithi084102331-40 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:1127: finishing write tid 2 to smithi084102331-40 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:1127: finishing write tid 3 to smithi084102331-40 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:1127: finishing write tid 4 to smithi084102331-40 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 365 (ObjNum 352 snap 115 seq_num 352) dirty exists 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:1127: left oid 40 (ObjNum 352 snap 115 seq_num 352) 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:1130: finishing rollback tid 1 to smithi084102331-10 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 181 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:1127: done (4 left) 2024-01-13T18:04:24.674 INFO:tasks.rados.rados.0.smithi084.stdout:1130: done (3 left) 2024-01-13T18:04:24.675 INFO:tasks.rados.rados.0.smithi084.stdout:1133: delete oid 39 current snap is 115 2024-01-13T18:04:24.679 INFO:tasks.rados.rados.0.smithi084.stdout:1133: done (3 left) 2024-01-13T18:04:24.679 INFO:tasks.rados.rados.0.smithi084.stdout:1134: delete oid 44 current snap is 115 2024-01-13T18:04:24.679 INFO:tasks.rados.rados.0.smithi084.stdout:1131: finishing write tid 1 to smithi084102331-8 2024-01-13T18:04:24.679 INFO:tasks.rados.rados.0.smithi084.stdout:1131: finishing write tid 2 to smithi084102331-8 2024-01-13T18:04:24.679 INFO:tasks.rados.rados.0.smithi084.stdout:1131: finishing write tid 3 to smithi084102331-8 2024-01-13T18:04:24.681 INFO:tasks.rados.rados.0.smithi084.stdout:1131: finishing write tid 4 to smithi084102331-8 2024-01-13T18:04:24.681 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 485 (ObjNum 354 snap 115 seq_num 354) dirty exists 2024-01-13T18:04:24.681 INFO:tasks.rados.rados.0.smithi084.stdout:1131: left oid 8 (ObjNum 354 snap 115 seq_num 354) 2024-01-13T18:04:24.683 INFO:tasks.rados.rados.0.smithi084.stdout:1128: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:24.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[116404]: failed to encode map e284 with expected crc 2024-01-13T18:04:24.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[116404]: osdmap e284: 8 total, 8 up, 8 in 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[116404]: failed to encode map e284 with expected crc 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[116404]: failed to encode map e284 with expected crc 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[116404]: pgmap v137: 121 pgs: 121 active+clean; 237 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 600 KiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[116404]: failed to encode map e284 with expected crc 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[116404]: osdmap e285: 8 total, 8 up, 8 in 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[119097]: failed to encode map e284 with expected crc 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[119097]: osdmap e284: 8 total, 8 up, 8 in 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[119097]: failed to encode map e284 with expected crc 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[119097]: failed to encode map e284 with expected crc 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[119097]: pgmap v137: 121 pgs: 121 active+clean; 237 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 600 KiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[119097]: failed to encode map e284 with expected crc 2024-01-13T18:04:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:24 smithi084 ceph-mon[119097]: osdmap e285: 8 total, 8 up, 8 in 2024-01-13T18:04:25.069 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:04:25.069 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:04:25.069 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:04:25.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 6, 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 8, 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 7 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:04:25.070 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:04:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:24 smithi099 ceph-mon[138788]: failed to encode map e284 with expected crc 2024-01-13T18:04:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:24 smithi099 ceph-mon[138788]: osdmap e284: 8 total, 8 up, 8 in 2024-01-13T18:04:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:24 smithi099 ceph-mon[138788]: failed to encode map e284 with expected crc 2024-01-13T18:04:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:24 smithi099 ceph-mon[138788]: failed to encode map e284 with expected crc 2024-01-13T18:04:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:24 smithi099 ceph-mon[138788]: pgmap v137: 121 pgs: 121 active+clean; 237 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 600 KiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:04:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:24 smithi099 ceph-mon[138788]: failed to encode map e284 with expected crc 2024-01-13T18:04:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:24 smithi099 ceph-mon[138788]: osdmap e285: 8 total, 8 up, 8 in 2024-01-13T18:04:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:1132: finishing rollback tid 0 to smithi084102331-24 2024-01-13T18:04:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:1132: finishing rollback tid 1 to smithi084102331-24 2024-01-13T18:04:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:1128: done (3 left) 2024-01-13T18:04:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:1131: done (2 left) 2024-01-13T18:04:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:1134: done (1 left) 2024-01-13T18:04:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 115 2024-01-13T18:04:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:1132: finishing rollback tid 2 to smithi084102331-24 2024-01-13T18:04:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 329 (ObjNum 251 snap 75 seq_num 251) dirty exists 2024-01-13T18:04:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:1135: seq_num 357 ranges {0=786432,786432=401408} 2024-01-13T18:04:25.149 INFO:tasks.rados.rados.0.smithi084.stdout:1135: writing smithi084102331-28 from 0 to 786432 tid 1 2024-01-13T18:04:25.152 INFO:tasks.rados.rados.0.smithi084.stdout:1135: writing smithi084102331-28 from 786432 to 1187840 tid 2 2024-01-13T18:04:25.152 INFO:tasks.rados.rados.0.smithi084.stdout:1132: done (1 left) 2024-01-13T18:04:25.152 INFO:tasks.rados.rados.0.smithi084.stdout:1136: rmattr oid 1 current snap is 115 2024-01-13T18:04:25.152 INFO:tasks.rados.rados.0.smithi084.stdout:1136: done (1 left) 2024-01-13T18:04:25.152 INFO:tasks.rados.rados.0.smithi084.stdout:1137: read oid 7 snap 106 2024-01-13T18:04:25.152 INFO:tasks.rados.rados.0.smithi084.stdout:1137: expect (ObjNum 321 snap 101 seq_num 321) 2024-01-13T18:04:25.152 INFO:tasks.rados.rados.0.smithi084.stdout:1138: snap_remove snap 108 2024-01-13T18:04:25.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[116404]: from='client.34209 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[116404]: failed to encode map e285 with expected crc 2024-01-13T18:04:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[116404]: failed to encode map e285 with expected crc 2024-01-13T18:04:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[116404]: failed to encode map e285 with expected crc 2024-01-13T18:04:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[116404]: failed to encode map e285 with expected crc 2024-01-13T18:04:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[116404]: failed to encode map e285 with expected crc 2024-01-13T18:04:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[116404]: from='client.44153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/636504990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:25.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[119097]: from='client.34209 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:25.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[119097]: failed to encode map e285 with expected crc 2024-01-13T18:04:25.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[119097]: failed to encode map e285 with expected crc 2024-01-13T18:04:25.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[119097]: failed to encode map e285 with expected crc 2024-01-13T18:04:25.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[119097]: failed to encode map e285 with expected crc 2024-01-13T18:04:25.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[119097]: failed to encode map e285 with expected crc 2024-01-13T18:04:25.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[119097]: from='client.44153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:25.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:25.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:25 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/636504990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:26.072 INFO:tasks.rados.rados.0.smithi084.stdout:1138: done (2 left) 2024-01-13T18:04:26.072 INFO:tasks.rados.rados.0.smithi084.stdout:1139: read oid 12 snap -1 2024-01-13T18:04:26.072 INFO:tasks.rados.rados.0.smithi084.stdout:1139: expect (ObjNum 346 snap 110 seq_num 346) 2024-01-13T18:04:26.072 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 115 2024-01-13T18:04:26.072 INFO:tasks.rados.rados.0.smithi084.stdout:1135: finishing write tid 1 to smithi084102331-28 2024-01-13T18:04:26.072 INFO:tasks.rados.rados.0.smithi084.stdout:1135: finishing write tid 2 to smithi084102331-28 2024-01-13T18:04:26.073 INFO:tasks.rados.rados.0.smithi084.stdout:1135: finishing write tid 3 to smithi084102331-28 2024-01-13T18:04:26.073 INFO:tasks.rados.rados.0.smithi084.stdout:1137: expect (ObjNum 321 snap 101 seq_num 321) 2024-01-13T18:04:26.092 INFO:tasks.rados.rados.0.smithi084.stdout:1135: finishing write tid 4 to smithi084102331-28 2024-01-13T18:04:26.093 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 325 (ObjNum 357 snap 115 seq_num 357) dirty exists 2024-01-13T18:04:26.093 INFO:tasks.rados.rados.0.smithi084.stdout:1135: left oid 28 (ObjNum 357 snap 115 seq_num 357) 2024-01-13T18:04:26.093 INFO:tasks.rados.rados.0.smithi084.stdout:1140: seq_num 358 ranges {819200=802816,1622016=401408} 2024-01-13T18:04:26.101 INFO:tasks.rados.rados.0.smithi084.stdout:1140: writing smithi084102331-46 from 819200 to 1622016 tid 1 2024-01-13T18:04:26.104 INFO:tasks.rados.rados.0.smithi084.stdout:1140: writing smithi084102331-46 from 1622016 to 2023424 tid 2 2024-01-13T18:04:26.104 INFO:tasks.rados.rados.0.smithi084.stdout:1135: done (3 left) 2024-01-13T18:04:26.104 INFO:tasks.rados.rados.0.smithi084.stdout:1137: done (2 left) 2024-01-13T18:04:26.104 INFO:tasks.rados.rados.0.smithi084.stdout:1141: snap_remove snap 113 2024-01-13T18:04:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:25 smithi099 ceph-mon[138788]: from='client.34209 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:25 smithi099 ceph-mon[138788]: failed to encode map e285 with expected crc 2024-01-13T18:04:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:25 smithi099 ceph-mon[138788]: failed to encode map e285 with expected crc 2024-01-13T18:04:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:25 smithi099 ceph-mon[138788]: failed to encode map e285 with expected crc 2024-01-13T18:04:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:25 smithi099 ceph-mon[138788]: failed to encode map e285 with expected crc 2024-01-13T18:04:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:25 smithi099 ceph-mon[138788]: failed to encode map e285 with expected crc 2024-01-13T18:04:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:25 smithi099 ceph-mon[138788]: from='client.44153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:25 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/636504990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:1141: done (2 left) 2024-01-13T18:04:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:1142: read oid 7 snap -1 2024-01-13T18:04:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:1142: expect (ObjNum 321 snap 101 seq_num 321) 2024-01-13T18:04:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:1143: delete oid 36 current snap is 115 2024-01-13T18:04:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:1140: finishing write tid 1 to smithi084102331-46 2024-01-13T18:04:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:1139: expect (ObjNum 346 snap 110 seq_num 346) 2024-01-13T18:04:27.362 INFO:tasks.rados.rados.0.smithi084.stdout:1140: finishing write tid 2 to smithi084102331-46 2024-01-13T18:04:27.362 INFO:tasks.rados.rados.0.smithi084.stdout:1140: finishing write tid 3 to smithi084102331-46 2024-01-13T18:04:27.362 INFO:tasks.rados.rados.0.smithi084.stdout:1140: finishing write tid 4 to smithi084102331-46 2024-01-13T18:04:27.362 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 336 (ObjNum 358 snap 115 seq_num 358) dirty exists 2024-01-13T18:04:27.362 INFO:tasks.rados.rados.0.smithi084.stdout:1140: left oid 46 (ObjNum 358 snap 115 seq_num 358) 2024-01-13T18:04:27.362 INFO:tasks.rados.rados.0.smithi084.stdout:1139: done (3 left) 2024-01-13T18:04:27.362 INFO:tasks.rados.rados.0.smithi084.stdout:1140: done (2 left) 2024-01-13T18:04:27.362 INFO:tasks.rados.rados.0.smithi084.stdout:1143: done (1 left) 2024-01-13T18:04:27.362 INFO:tasks.rados.rados.0.smithi084.stdout:1144: rollback oid 16 current snap is 115 2024-01-13T18:04:27.362 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 16 to 111 2024-01-13T18:04:27.362 INFO:tasks.rados.rados.0.smithi084.stdout:1142: expect (ObjNum 321 snap 101 seq_num 321) 2024-01-13T18:04:27.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:27 smithi099 ceph-mon[138788]: pgmap v139: 121 pgs: 121 active+clean; 249 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.2 MiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-01-13T18:04:27.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:27 smithi099 ceph-mon[138788]: failed to encode map e286 with expected crc 2024-01-13T18:04:27.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:27 smithi099 ceph-mon[138788]: osdmap e286: 8 total, 8 up, 8 in 2024-01-13T18:04:27.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:27 smithi099 ceph-mon[138788]: failed to encode map e286 with expected crc 2024-01-13T18:04:27.377 INFO:tasks.rados.rados.0.smithi084.stdout:1144: finishing rollback tid 0 to smithi084102331-16 2024-01-13T18:04:27.377 INFO:tasks.rados.rados.0.smithi084.stdout:1144: finishing rollback tid 1 to smithi084102331-16 2024-01-13T18:04:27.377 INFO:tasks.rados.rados.0.smithi084.stdout:1144: finishing rollback tid 2 to smithi084102331-16 2024-01-13T18:04:27.377 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 333 (ObjNum 251 snap 75 seq_num 251) dirty exists 2024-01-13T18:04:27.377 INFO:tasks.rados.rados.0.smithi084.stdout:1142: done (1 left) 2024-01-13T18:04:27.377 INFO:tasks.rados.rados.0.smithi084.stdout:1144: done (0 left) 2024-01-13T18:04:27.377 INFO:tasks.rados.rados.0.smithi084.stdout:1145: rmattr oid 33 current snap is 115 2024-01-13T18:04:27.377 INFO:tasks.rados.rados.0.smithi084.stdout:1145: done (0 left) 2024-01-13T18:04:27.377 INFO:tasks.rados.rados.0.smithi084.stdout:1146: delete oid 13 current snap is 115 2024-01-13T18:04:27.379 INFO:tasks.rados.rados.0.smithi084.stdout:1146: done (0 left) 2024-01-13T18:04:27.379 INFO:tasks.rados.rados.0.smithi084.stdout:1147: read oid 26 snap -1 2024-01-13T18:04:27.379 INFO:tasks.rados.rados.0.smithi084.stdout:1147: expect (ObjNum 271 snap 87 seq_num 271) 2024-01-13T18:04:27.379 INFO:tasks.rados.rados.0.smithi084.stdout:1148: snap_create 2024-01-13T18:04:27.384 INFO:tasks.rados.rados.0.smithi084.stdout:1147: expect (ObjNum 271 snap 87 seq_num 271) 2024-01-13T18:04:27.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:27 smithi084 ceph-mon[116404]: pgmap v139: 121 pgs: 121 active+clean; 249 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.2 MiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-01-13T18:04:27.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:27 smithi084 ceph-mon[116404]: failed to encode map e286 with expected crc 2024-01-13T18:04:27.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:27 smithi084 ceph-mon[116404]: osdmap e286: 8 total, 8 up, 8 in 2024-01-13T18:04:27.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:27 smithi084 ceph-mon[116404]: failed to encode map e286 with expected crc 2024-01-13T18:04:27.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:27 smithi084 ceph-mon[119097]: pgmap v139: 121 pgs: 121 active+clean; 249 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.2 MiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-01-13T18:04:27.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:27 smithi084 ceph-mon[119097]: failed to encode map e286 with expected crc 2024-01-13T18:04:27.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:27 smithi084 ceph-mon[119097]: osdmap e286: 8 total, 8 up, 8 in 2024-01-13T18:04:27.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:27 smithi084 ceph-mon[119097]: failed to encode map e286 with expected crc 2024-01-13T18:04:27.582 INFO:tasks.rados.rados.0.smithi084.stdout:1147: done (1 left) 2024-01-13T18:04:27.582 INFO:tasks.rados.rados.0.smithi084.stdout:1148: done (0 left) 2024-01-13T18:04:27.582 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 116 2024-01-13T18:04:27.582 INFO:tasks.rados.rados.0.smithi084.stdout:1149: seq_num 361 ranges {2482176=450560,2932736=581632,3514368=221184} 2024-01-13T18:04:27.597 INFO:tasks.rados.rados.0.smithi084.stdout:1149: writing smithi084102331-40 from 2482176 to 2932736 tid 1 2024-01-13T18:04:27.601 INFO:tasks.rados.rados.0.smithi084.stdout:1149: writing smithi084102331-40 from 2932736 to 3514368 tid 2 2024-01-13T18:04:27.603 INFO:tasks.rados.rados.0.smithi084.stdout:1149: writing smithi084102331-40 from 3514368 to 3735552 tid 3 2024-01-13T18:04:27.603 INFO:tasks.rados.rados.0.smithi084.stdout:1150: delete oid 2 current snap is 116 2024-01-13T18:04:27.603 INFO:tasks.rados.rados.0.smithi084.stdout:1149: finishing write tid 1 to smithi084102331-40 2024-01-13T18:04:27.605 INFO:tasks.rados.rados.0.smithi084.stdout:1149: finishing write tid 2 to smithi084102331-40 2024-01-13T18:04:27.605 INFO:tasks.rados.rados.0.smithi084.stdout:1149: finishing write tid 3 to smithi084102331-40 2024-01-13T18:04:27.605 INFO:tasks.rados.rados.0.smithi084.stdout:1149: finishing write tid 4 to smithi084102331-40 2024-01-13T18:04:27.606 INFO:tasks.rados.rados.0.smithi084.stdout:1149: finishing write tid 5 to smithi084102331-40 2024-01-13T18:04:27.606 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 374 (ObjNum 361 snap 116 seq_num 361) dirty exists 2024-01-13T18:04:27.606 INFO:tasks.rados.rados.0.smithi084.stdout:1149: left oid 40 (ObjNum 361 snap 116 seq_num 361) 2024-01-13T18:04:27.611 INFO:tasks.rados.rados.0.smithi084.stdout:1149: done (1 left) 2024-01-13T18:04:27.611 INFO:tasks.rados.rados.0.smithi084.stdout:1150: done (0 left) 2024-01-13T18:04:27.611 INFO:tasks.rados.rados.0.smithi084.stdout:1151: snap_remove snap 115 2024-01-13T18:04:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:28 smithi099 ceph-mon[138788]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:28 smithi099 ceph-mon[138788]: osdmap e287: 8 total, 8 up, 8 in 2024-01-13T18:04:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:28 smithi099 ceph-mon[138788]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:28 smithi099 ceph-mon[138788]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:28 smithi099 ceph-mon[138788]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:28 smithi099 ceph-mon[138788]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:28 smithi099 ceph-mon[138788]: failed to encode map e288 with expected crc 2024-01-13T18:04:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:28 smithi099 ceph-mon[138788]: osdmap e288: 8 total, 8 up, 8 in 2024-01-13T18:04:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:28 smithi099 ceph-mon[138788]: failed to encode map e288 with expected crc 2024-01-13T18:04:28.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[116404]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[116404]: osdmap e287: 8 total, 8 up, 8 in 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[116404]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[116404]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[116404]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[116404]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[116404]: failed to encode map e288 with expected crc 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[116404]: osdmap e288: 8 total, 8 up, 8 in 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[116404]: failed to encode map e288 with expected crc 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[119097]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[119097]: osdmap e287: 8 total, 8 up, 8 in 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[119097]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[119097]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[119097]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[119097]: failed to encode map e287 with expected crc 2024-01-13T18:04:28.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[119097]: failed to encode map e288 with expected crc 2024-01-13T18:04:28.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[119097]: osdmap e288: 8 total, 8 up, 8 in 2024-01-13T18:04:28.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:28 smithi084 ceph-mon[119097]: failed to encode map e288 with expected crc 2024-01-13T18:04:28.592 INFO:tasks.rados.rados.0.smithi084.stdout:1151: done (0 left) 2024-01-13T18:04:28.592 INFO:tasks.rados.rados.0.smithi084.stdout:1152: copy_from oid 18 from oid 9 current snap is 116 2024-01-13T18:04:28.592 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 116 2024-01-13T18:04:28.592 INFO:tasks.rados.rados.0.smithi084.stdout:1153: seq_num 363 ranges {868352=483328,1351680=753664,2105344=49152} 2024-01-13T18:04:28.600 INFO:tasks.rados.rados.0.smithi084.stdout:1153: writing smithi084102331-48 from 868352 to 1351680 tid 1 2024-01-13T18:04:28.604 INFO:tasks.rados.rados.0.smithi084.stdout:1153: writing smithi084102331-48 from 1351680 to 2105344 tid 2 2024-01-13T18:04:28.605 INFO:tasks.rados.rados.0.smithi084.stdout:1153: writing smithi084102331-48 from 2105344 to 2154496 tid 3 2024-01-13T18:04:28.605 INFO:tasks.rados.rados.0.smithi084.stdout:1154: delete oid 27 current snap is 116 2024-01-13T18:04:28.613 INFO:tasks.rados.rados.0.smithi084.stdout:1153: finishing write tid 1 to smithi084102331-48 2024-01-13T18:04:28.614 INFO:tasks.rados.rados.0.smithi084.stdout:1152: finishing copy_from to smithi084102331-18 2024-01-13T18:04:28.614 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 330 (ObjNum 341 snap 107 seq_num 341) dirty exists 2024-01-13T18:04:28.614 INFO:tasks.rados.rados.0.smithi084.stdout:1154: done (2 left) 2024-01-13T18:04:28.614 INFO:tasks.rados.rados.0.smithi084.stdout:1155: read oid 33 snap 111 2024-01-13T18:04:28.614 INFO:tasks.rados.rados.0.smithi084.stdout:1155: expect (ObjNum 314 snap 98 seq_num 314) 2024-01-13T18:04:28.615 INFO:tasks.rados.rados.0.smithi084.stdout:1156: rollback oid 36 current snap is 116 2024-01-13T18:04:28.616 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 112 2024-01-13T18:04:28.616 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 116 2024-01-13T18:04:28.616 INFO:tasks.rados.rados.0.smithi084.stdout:1157: seq_num 365 ranges {0=516096,516096=573440,1089536=229376} 2024-01-13T18:04:28.618 INFO:tasks.rados.rados.0.smithi084.stdout:1157: writing smithi084102331-25 from 0 to 516096 tid 1 2024-01-13T18:04:28.621 INFO:tasks.rados.rados.0.smithi084.stdout:1157: writing smithi084102331-25 from 516096 to 1089536 tid 2 2024-01-13T18:04:28.623 INFO:tasks.rados.rados.0.smithi084.stdout:1157: writing smithi084102331-25 from 1089536 to 1318912 tid 3 2024-01-13T18:04:28.623 INFO:tasks.rados.rados.0.smithi084.stdout:1158: read oid 20 snap -1 2024-01-13T18:04:28.623 INFO:tasks.rados.rados.0.smithi084.stdout:1158: expect (ObjNum 324 snap 101 seq_num 324) 2024-01-13T18:04:28.624 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 116 2024-01-13T18:04:28.624 INFO:tasks.rados.rados.0.smithi084.stdout:1152: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:04:28.624 INFO:tasks.rados.rados.0.smithi084.stdout:1159: seq_num 366 ranges {2146304=532480,2678784=458752,3137536=344064} 2024-01-13T18:04:28.637 INFO:tasks.rados.rados.0.smithi084.stdout:1159: writing smithi084102331-26 from 2146304 to 2678784 tid 1 2024-01-13T18:04:28.640 INFO:tasks.rados.rados.0.smithi084.stdout:1159: writing smithi084102331-26 from 2678784 to 3137536 tid 2 2024-01-13T18:04:28.642 INFO:tasks.rados.rados.0.smithi084.stdout:1159: writing smithi084102331-26 from 3137536 to 3481600 tid 3 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1152: done (6 left) 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1160: read oid 24 snap -1 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1160: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1161: snap_create 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1153: finishing write tid 2 to smithi084102331-48 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1153: finishing write tid 3 to smithi084102331-48 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1153: finishing write tid 4 to smithi084102331-48 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1156: finishing rollback tid 1 to smithi084102331-36 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1156: finishing rollback tid 2 to smithi084102331-36 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 426 (ObjNum 345 snap 110 seq_num 345) dirty exists 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1153: finishing write tid 5 to smithi084102331-48 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 470 (ObjNum 363 snap 116 seq_num 363) dirty exists 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1153: left oid 48 (ObjNum 363 snap 116 seq_num 363) 2024-01-13T18:04:28.643 INFO:tasks.rados.rados.0.smithi084.stdout:1155: expect (ObjNum 314 snap 98 seq_num 314) 2024-01-13T18:04:28.658 INFO:tasks.rados.rados.0.smithi084.stdout:1157: finishing write tid 1 to smithi084102331-25 2024-01-13T18:04:28.658 INFO:tasks.rados.rados.0.smithi084.stdout:1157: finishing write tid 2 to smithi084102331-25 2024-01-13T18:04:28.658 INFO:tasks.rados.rados.0.smithi084.stdout:1157: finishing write tid 3 to smithi084102331-25 2024-01-13T18:04:28.658 INFO:tasks.rados.rados.0.smithi084.stdout:1157: finishing write tid 4 to smithi084102331-25 2024-01-13T18:04:28.658 INFO:tasks.rados.rados.0.smithi084.stdout:1157: finishing write tid 5 to smithi084102331-25 2024-01-13T18:04:28.659 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 512 (ObjNum 365 snap 116 seq_num 365) dirty exists 2024-01-13T18:04:28.659 INFO:tasks.rados.rados.0.smithi084.stdout:1157: left oid 25 (ObjNum 365 snap 116 seq_num 365) 2024-01-13T18:04:28.659 INFO:tasks.rados.rados.0.smithi084.stdout:1158: expect (ObjNum 324 snap 101 seq_num 324) 2024-01-13T18:04:28.674 INFO:tasks.rados.rados.0.smithi084.stdout:1159: finishing write tid 1 to smithi084102331-26 2024-01-13T18:04:28.674 INFO:tasks.rados.rados.0.smithi084.stdout:1159: finishing write tid 2 to smithi084102331-26 2024-01-13T18:04:28.674 INFO:tasks.rados.rados.0.smithi084.stdout:1159: finishing write tid 3 to smithi084102331-26 2024-01-13T18:04:28.674 INFO:tasks.rados.rados.0.smithi084.stdout:1159: finishing write tid 4 to smithi084102331-26 2024-01-13T18:04:28.674 INFO:tasks.rados.rados.0.smithi084.stdout:1159: finishing write tid 5 to smithi084102331-26 2024-01-13T18:04:28.674 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 431 (ObjNum 366 snap 116 seq_num 366) dirty exists 2024-01-13T18:04:28.675 INFO:tasks.rados.rados.0.smithi084.stdout:1159: left oid 26 (ObjNum 366 snap 116 seq_num 366) 2024-01-13T18:04:28.675 INFO:tasks.rados.rados.0.smithi084.stdout:1160: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:29.083 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:04:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:04:28.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:04:29.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:29 smithi099 ceph-mon[138788]: failed to encode map e288 with expected crc 2024-01-13T18:04:29.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:29 smithi099 ceph-mon[138788]: pgmap v143: 121 pgs: 121 active+clean; 249 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-01-13T18:04:29.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:29 smithi099 ceph-mon[138788]: failed to encode map e289 with expected crc 2024-01-13T18:04:29.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:29 smithi099 ceph-mon[138788]: failed to encode map e289 with expected crc 2024-01-13T18:04:29.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:29 smithi099 ceph-mon[138788]: osdmap e289: 8 total, 8 up, 8 in 2024-01-13T18:04:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:29 smithi084 ceph-mon[116404]: failed to encode map e288 with expected crc 2024-01-13T18:04:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:29 smithi084 ceph-mon[116404]: pgmap v143: 121 pgs: 121 active+clean; 249 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-01-13T18:04:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:29 smithi084 ceph-mon[116404]: failed to encode map e289 with expected crc 2024-01-13T18:04:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:29 smithi084 ceph-mon[116404]: failed to encode map e289 with expected crc 2024-01-13T18:04:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:29 smithi084 ceph-mon[116404]: osdmap e289: 8 total, 8 up, 8 in 2024-01-13T18:04:29.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:29 smithi084 ceph-mon[119097]: failed to encode map e288 with expected crc 2024-01-13T18:04:29.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:29 smithi084 ceph-mon[119097]: pgmap v143: 121 pgs: 121 active+clean; 249 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-01-13T18:04:29.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:29 smithi084 ceph-mon[119097]: failed to encode map e289 with expected crc 2024-01-13T18:04:29.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:29 smithi084 ceph-mon[119097]: failed to encode map e289 with expected crc 2024-01-13T18:04:29.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:29 smithi084 ceph-mon[119097]: osdmap e289: 8 total, 8 up, 8 in 2024-01-13T18:04:29.594 INFO:tasks.rados.rados.0.smithi084.stdout:1153: done (7 left) 2024-01-13T18:04:29.594 INFO:tasks.rados.rados.0.smithi084.stdout:1155: done (6 left) 2024-01-13T18:04:29.594 INFO:tasks.rados.rados.0.smithi084.stdout:1156: done (5 left) 2024-01-13T18:04:29.594 INFO:tasks.rados.rados.0.smithi084.stdout:1157: done (4 left) 2024-01-13T18:04:29.594 INFO:tasks.rados.rados.0.smithi084.stdout:1158: done (3 left) 2024-01-13T18:04:29.594 INFO:tasks.rados.rados.0.smithi084.stdout:1159: done (2 left) 2024-01-13T18:04:29.594 INFO:tasks.rados.rados.0.smithi084.stdout:1160: done (1 left) 2024-01-13T18:04:29.594 INFO:tasks.rados.rados.0.smithi084.stdout:1161: done (0 left) 2024-01-13T18:04:29.594 INFO:tasks.rados.rados.0.smithi084.stdout:1162: read oid 18 snap -1 2024-01-13T18:04:29.594 INFO:tasks.rados.rados.0.smithi084.stdout:1162: expect (ObjNum 341 snap 107 seq_num 341) 2024-01-13T18:04:29.594 INFO:tasks.rados.rados.0.smithi084.stdout:1163: setattr oid 1 current snap is 117 2024-01-13T18:04:29.595 INFO:tasks.rados.rados.0.smithi084.stdout:1164: snap_create 2024-01-13T18:04:29.600 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 567 (ObjNum 286 snap 89 seq_num 286) dirty exists 2024-01-13T18:04:29.601 INFO:tasks.rados.rados.0.smithi084.stdout:1162: expect (ObjNum 341 snap 107 seq_num 341) 2024-01-13T18:04:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:30 smithi099 ceph-mon[138788]: failed to encode map e289 with expected crc 2024-01-13T18:04:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:30 smithi099 ceph-mon[138788]: failed to encode map e289 with expected crc 2024-01-13T18:04:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:30 smithi099 ceph-mon[138788]: osdmap e290: 8 total, 8 up, 8 in 2024-01-13T18:04:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:30 smithi099 ceph-mon[138788]: failed to encode map e290 with expected crc 2024-01-13T18:04:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:30 smithi099 ceph-mon[138788]: failed to encode map e290 with expected crc 2024-01-13T18:04:30.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:04:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:04:30] "GET /metrics HTTP/1.1" 200 36065 "" "Prometheus/2.43.0" 2024-01-13T18:04:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:30 smithi084 ceph-mon[116404]: failed to encode map e289 with expected crc 2024-01-13T18:04:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:30 smithi084 ceph-mon[116404]: failed to encode map e289 with expected crc 2024-01-13T18:04:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:30 smithi084 ceph-mon[116404]: osdmap e290: 8 total, 8 up, 8 in 2024-01-13T18:04:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:30 smithi084 ceph-mon[116404]: failed to encode map e290 with expected crc 2024-01-13T18:04:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:30 smithi084 ceph-mon[116404]: failed to encode map e290 with expected crc 2024-01-13T18:04:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:30 smithi084 ceph-mon[119097]: failed to encode map e289 with expected crc 2024-01-13T18:04:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:30 smithi084 ceph-mon[119097]: failed to encode map e289 with expected crc 2024-01-13T18:04:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:30 smithi084 ceph-mon[119097]: osdmap e290: 8 total, 8 up, 8 in 2024-01-13T18:04:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:30 smithi084 ceph-mon[119097]: failed to encode map e290 with expected crc 2024-01-13T18:04:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:30 smithi084 ceph-mon[119097]: failed to encode map e290 with expected crc 2024-01-13T18:04:30.599 INFO:tasks.rados.rados.0.smithi084.stdout:1162: done (2 left) 2024-01-13T18:04:30.599 INFO:tasks.rados.rados.0.smithi084.stdout:1163: done (1 left) 2024-01-13T18:04:30.600 INFO:tasks.rados.rados.0.smithi084.stdout:1164: done (0 left) 2024-01-13T18:04:30.600 INFO:tasks.rados.rados.0.smithi084.stdout:1165: setattr oid 40 current snap is 118 2024-01-13T18:04:30.601 INFO:tasks.rados.rados.0.smithi084.stdout:1166: read oid 8 snap -1 2024-01-13T18:04:30.601 INFO:tasks.rados.rados.0.smithi084.stdout:1166: expect (ObjNum 354 snap 115 seq_num 354) 2024-01-13T18:04:30.601 INFO:tasks.rados.rados.0.smithi084.stdout:1167: snap_remove snap 116 2024-01-13T18:04:31.333 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[116404]: failed to encode map e290 with expected crc 2024-01-13T18:04:31.334 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[116404]: failed to encode map e290 with expected crc 2024-01-13T18:04:31.334 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[116404]: pgmap v146: 121 pgs: 121 active+clean; 249 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 261 B/s rd, 276 KiB/s wr, 1 op/s 2024-01-13T18:04:31.334 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:31.334 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[116404]: osdmap e291: 8 total, 8 up, 8 in 2024-01-13T18:04:31.334 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[116404]: failed to encode map e291 with expected crc 2024-01-13T18:04:31.334 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[116404]: failed to encode map e291 with expected crc 2024-01-13T18:04:31.334 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[116404]: failed to encode map e291 with expected crc 2024-01-13T18:04:31.335 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[119097]: failed to encode map e290 with expected crc 2024-01-13T18:04:31.335 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[119097]: failed to encode map e290 with expected crc 2024-01-13T18:04:31.335 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[119097]: pgmap v146: 121 pgs: 121 active+clean; 249 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 261 B/s rd, 276 KiB/s wr, 1 op/s 2024-01-13T18:04:31.335 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:31.335 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[119097]: osdmap e291: 8 total, 8 up, 8 in 2024-01-13T18:04:31.336 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[119097]: failed to encode map e291 with expected crc 2024-01-13T18:04:31.336 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[119097]: failed to encode map e291 with expected crc 2024-01-13T18:04:31.336 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:31 smithi084 ceph-mon[119097]: failed to encode map e291 with expected crc 2024-01-13T18:04:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:31 smithi099 ceph-mon[138788]: failed to encode map e290 with expected crc 2024-01-13T18:04:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:31 smithi099 ceph-mon[138788]: failed to encode map e290 with expected crc 2024-01-13T18:04:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:31 smithi099 ceph-mon[138788]: pgmap v146: 121 pgs: 121 active+clean; 249 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 261 B/s rd, 276 KiB/s wr, 1 op/s 2024-01-13T18:04:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:31 smithi099 ceph-mon[138788]: osdmap e291: 8 total, 8 up, 8 in 2024-01-13T18:04:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:31 smithi099 ceph-mon[138788]: failed to encode map e291 with expected crc 2024-01-13T18:04:31.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:31 smithi099 ceph-mon[138788]: failed to encode map e291 with expected crc 2024-01-13T18:04:31.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:31 smithi099 ceph-mon[138788]: failed to encode map e291 with expected crc 2024-01-13T18:04:31.602 INFO:tasks.rados.rados.0.smithi084.stdout:1167: done (2 left) 2024-01-13T18:04:31.602 INFO:tasks.rados.rados.0.smithi084.stdout:1168: read oid 6 snap -1 2024-01-13T18:04:31.602 INFO:tasks.rados.rados.0.smithi084.stdout:1168: expect deleted 2024-01-13T18:04:31.602 INFO:tasks.rados.rados.0.smithi084.stdout:1169: snap_remove snap 95 2024-01-13T18:04:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:32 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:32 smithi099 ceph-mon[138788]: Upgrade: osd.2 is safe to restart 2024-01-13T18:04:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:32 smithi099 ceph-mon[138788]: failed to encode map e291 with expected crc 2024-01-13T18:04:32.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:32 smithi099 ceph-mon[138788]: failed to encode map e291 with expected crc 2024-01-13T18:04:32.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:32.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-13T18:04:32.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:32.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:32 smithi099 ceph-mon[138788]: failed to encode map e292 with expected crc 2024-01-13T18:04:32.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:32 smithi099 ceph-mon[138788]: failed to encode map e292 with expected crc 2024-01-13T18:04:32.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:32 smithi099 ceph-mon[138788]: osdmap e292: 8 total, 8 up, 8 in 2024-01-13T18:04:32.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[116404]: Upgrade: osd.2 is safe to restart 2024-01-13T18:04:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[116404]: failed to encode map e291 with expected crc 2024-01-13T18:04:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[116404]: failed to encode map e291 with expected crc 2024-01-13T18:04:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-13T18:04:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[116404]: failed to encode map e292 with expected crc 2024-01-13T18:04:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[116404]: failed to encode map e292 with expected crc 2024-01-13T18:04:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[116404]: osdmap e292: 8 total, 8 up, 8 in 2024-01-13T18:04:32.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-01-13T18:04:32.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[119097]: Upgrade: osd.2 is safe to restart 2024-01-13T18:04:32.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[119097]: failed to encode map e291 with expected crc 2024-01-13T18:04:32.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[119097]: failed to encode map e291 with expected crc 2024-01-13T18:04:32.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:32.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-13T18:04:32.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:32.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[119097]: failed to encode map e292 with expected crc 2024-01-13T18:04:32.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[119097]: failed to encode map e292 with expected crc 2024-01-13T18:04:32.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:32 smithi084 ceph-mon[119097]: osdmap e292: 8 total, 8 up, 8 in 2024-01-13T18:04:32.583 INFO:tasks.rados.rados.0.smithi084.stdout:1169: done (3 left) 2024-01-13T18:04:32.583 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 118 2024-01-13T18:04:32.583 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 378 (ObjNum 361 snap 116 seq_num 361) dirty exists 2024-01-13T18:04:32.584 INFO:tasks.rados.rados.0.smithi084.stdout:1170: seq_num 367 ranges {663552=548864,1212416=737280,1949696=65536} 2024-01-13T18:04:32.590 INFO:tasks.rados.rados.0.smithi084.stdout:1170: writing smithi084102331-19 from 663552 to 1212416 tid 1 2024-01-13T18:04:32.598 INFO:tasks.rados.rados.0.smithi084.stdout:1170: writing smithi084102331-19 from 1212416 to 1949696 tid 2 2024-01-13T18:04:32.598 INFO:tasks.rados.rados.0.smithi084.stdout:1170: writing smithi084102331-19 from 1949696 to 2015232 tid 3 2024-01-13T18:04:32.598 INFO:tasks.rados.rados.0.smithi084.stdout:1165: done (3 left) 2024-01-13T18:04:32.598 INFO:tasks.rados.rados.0.smithi084.stdout:1171: setattr oid 31 current snap is 118 2024-01-13T18:04:32.598 INFO:tasks.rados.rados.0.smithi084.stdout:1166: expect (ObjNum 354 snap 115 seq_num 354) 2024-01-13T18:04:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:1170: finishing write tid 1 to smithi084102331-19 2024-01-13T18:04:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:1170: finishing write tid 2 to smithi084102331-19 2024-01-13T18:04:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:1170: finishing write tid 3 to smithi084102331-19 2024-01-13T18:04:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:1170: finishing write tid 4 to smithi084102331-19 2024-01-13T18:04:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:1170: finishing write tid 5 to smithi084102331-19 2024-01-13T18:04:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 189 (ObjNum 367 snap 118 seq_num 367) dirty exists 2024-01-13T18:04:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:1170: left oid 19 (ObjNum 367 snap 118 seq_num 367) 2024-01-13T18:04:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:1166: done (3 left) 2024-01-13T18:04:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:1168: done (2 left) 2024-01-13T18:04:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:1170: done (1 left) 2024-01-13T18:04:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:1172: rollback oid 9 current snap is 118 2024-01-13T18:04:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 117 2024-01-13T18:04:32.865 INFO:tasks.rados.rados.0.smithi084.stdout:1173: snap_remove snap 97 2024-01-13T18:04:33.224 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[116404]: Upgrade: Updating osd.2 2024-01-13T18:04:33.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[116404]: Deploying daemon osd.2 on smithi084 2024-01-13T18:04:33.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[116404]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[116404]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[116404]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[116404]: pgmap v149: 121 pgs: 121 active+clean; 257 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2024-01-13T18:04:33.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[116404]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[116404]: failed to encode map e293 with expected crc 2024-01-13T18:04:33.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[116404]: failed to encode map e293 with expected crc 2024-01-13T18:04:33.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[116404]: osdmap e293: 8 total, 8 up, 8 in 2024-01-13T18:04:33.225 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[119097]: Upgrade: Updating osd.2 2024-01-13T18:04:33.225 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[119097]: Deploying daemon osd.2 on smithi084 2024-01-13T18:04:33.226 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[119097]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.226 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[119097]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.226 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[119097]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.226 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[119097]: pgmap v149: 121 pgs: 121 active+clean; 257 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2024-01-13T18:04:33.226 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[119097]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.226 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[119097]: failed to encode map e293 with expected crc 2024-01-13T18:04:33.226 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[119097]: failed to encode map e293 with expected crc 2024-01-13T18:04:33.226 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-mon[119097]: osdmap e293: 8 total, 8 up, 8 in 2024-01-13T18:04:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:33 smithi099 ceph-mon[138788]: Upgrade: Updating osd.2 2024-01-13T18:04:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:33 smithi099 ceph-mon[138788]: Deploying daemon osd.2 on smithi084 2024-01-13T18:04:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:33 smithi099 ceph-mon[138788]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:33 smithi099 ceph-mon[138788]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:33 smithi099 ceph-mon[138788]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:33 smithi099 ceph-mon[138788]: pgmap v149: 121 pgs: 121 active+clean; 257 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2024-01-13T18:04:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:33 smithi099 ceph-mon[138788]: failed to encode map e292 with expected crc 2024-01-13T18:04:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:33 smithi099 ceph-mon[138788]: failed to encode map e293 with expected crc 2024-01-13T18:04:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:33 smithi099 ceph-mon[138788]: failed to encode map e293 with expected crc 2024-01-13T18:04:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:33 smithi099 ceph-mon[138788]: osdmap e293: 8 total, 8 up, 8 in 2024-01-13T18:04:33.607 INFO:tasks.rados.rados.0.smithi084.stdout:1173: done (2 left) 2024-01-13T18:04:33.607 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 118 2024-01-13T18:04:33.607 INFO:tasks.rados.rados.0.smithi084.stdout:1174: seq_num 368 ranges {1187840=573440,1761280=622592,2383872=180224} 2024-01-13T18:04:33.616 INFO:tasks.rados.rados.0.smithi084.stdout:1174: writing smithi084102331-28 from 1187840 to 1761280 tid 1 2024-01-13T18:04:33.620 INFO:tasks.rados.rados.0.smithi084.stdout:1174: writing smithi084102331-28 from 1761280 to 2383872 tid 2 2024-01-13T18:04:33.622 INFO:tasks.rados.rados.0.smithi084.stdout:1174: writing smithi084102331-28 from 2383872 to 2564096 tid 3 2024-01-13T18:04:33.622 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 118 2024-01-13T18:04:33.622 INFO:tasks.rados.rados.0.smithi084.stdout:1172: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:04:33.622 INFO:tasks.rados.rados.0.smithi084.stdout:1175: seq_num 369 ranges {8282112=589824,8871936=507904,9379840=294912} 2024-01-13T18:04:33.672 INFO:tasks.rados.rados.0.smithi084.stdout:1175: writing smithi084102331-4 from 8282112 to 8871936 tid 1 2024-01-13T18:04:33.675 INFO:tasks.rados.rados.0.smithi084.stdout:1175: writing smithi084102331-4 from 8871936 to 9379840 tid 2 2024-01-13T18:04:33.677 INFO:tasks.rados.rados.0.smithi084.stdout:1175: writing smithi084102331-4 from 9379840 to 9674752 tid 3 2024-01-13T18:04:33.677 INFO:tasks.rados.rados.0.smithi084.stdout:1176: read oid 39 snap -1 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:1176: expect deleted 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:1177: copy_from oid 17 from oid 44 current snap is 118 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:1172: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 577 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:1172: finishing rollback tid 2 to smithi084102331-9 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 354 (ObjNum 341 snap 107 seq_num 341) dirty exists 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:1174: finishing write tid 1 to smithi084102331-28 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:1174: finishing write tid 2 to smithi084102331-28 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:1174: finishing write tid 3 to smithi084102331-28 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:1174: finishing write tid 4 to smithi084102331-28 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:1174: finishing write tid 5 to smithi084102331-28 2024-01-13T18:04:33.678 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 346 (ObjNum 368 snap 118 seq_num 368) dirty exists 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1174: left oid 28 (ObjNum 368 snap 118 seq_num 368) 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1175: finishing write tid 1 to smithi084102331-4 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1171: done (5 left) 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1172: done (4 left) 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1174: done (3 left) 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1178: read oid 43 snap -1 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1178: expect (ObjNum 266 snap 83 seq_num 266) 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1179: rollback oid 47 current snap is 118 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 98 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1180: rmattr oid 2 current snap is 118 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1180: done (5 left) 2024-01-13T18:04:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1181: read oid 3 snap -1 2024-01-13T18:04:33.680 INFO:tasks.rados.rados.0.smithi084.stdout:1181: expect (ObjNum 215 snap 61 seq_num 215) 2024-01-13T18:04:33.680 INFO:tasks.rados.rados.0.smithi084.stdout:1182: rmattr oid 46 current snap is 118 2024-01-13T18:04:33.680 INFO:tasks.rados.rados.0.smithi084.stdout:1182: done (6 left) 2024-01-13T18:04:33.680 INFO:tasks.rados.rados.0.smithi084.stdout:1183: rmattr oid 9 current snap is 118 2024-01-13T18:04:33.680 INFO:tasks.rados.rados.0.smithi084.stdout:1183: done (6 left) 2024-01-13T18:04:33.680 INFO:tasks.rados.rados.0.smithi084.stdout:1184: copy_from oid 19 from oid 23 current snap is 118 2024-01-13T18:04:33.680 INFO:tasks.rados.rados.0.smithi084.stdout:1185: snap_create 2024-01-13T18:04:33.681 INFO:tasks.rados.rados.0.smithi084.stdout:1175: finishing write tid 2 to smithi084102331-4 2024-01-13T18:04:33.681 INFO:tasks.rados.rados.0.smithi084.stdout:1175: finishing write tid 3 to smithi084102331-4 2024-01-13T18:04:33.681 INFO:tasks.rados.rados.0.smithi084.stdout:1179: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:04:33.681 INFO:tasks.rados.rados.0.smithi084.stdout:1177: finishing copy_from to smithi084102331-17 2024-01-13T18:04:33.681 INFO:tasks.rados.rados.0.smithi084.stdout:1177: got expected ENOENT (src dne) 2024-01-13T18:04:33.682 INFO:tasks.rados.rados.0.smithi084.stdout:1177: finishing copy_from racing read to smithi084102331-17 2024-01-13T18:04:33.682 INFO:tasks.rados.rados.0.smithi084.stdout:1179: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:04:33.682 INFO:tasks.rados.rados.0.smithi084.stdout:1179: finishing rollback tid 2 to smithi084102331-47 2024-01-13T18:04:33.682 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 521 (ObjNum 286 snap 89 seq_num 286) dirty exists 2024-01-13T18:04:33.682 INFO:tasks.rados.rados.0.smithi084.stdout:1175: finishing write tid 4 to smithi084102331-4 2024-01-13T18:04:33.682 INFO:tasks.rados.rados.0.smithi084.stdout:1175: finishing write tid 5 to smithi084102331-4 2024-01-13T18:04:33.682 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 375 (ObjNum 369 snap 118 seq_num 369) dirty exists 2024-01-13T18:04:33.682 INFO:tasks.rados.rados.0.smithi084.stdout:1175: left oid 4 (ObjNum 369 snap 118 seq_num 369) 2024-01-13T18:04:33.692 INFO:tasks.rados.rados.0.smithi084.stdout:1181: expect (ObjNum 215 snap 61 seq_num 215) 2024-01-13T18:04:33.763 INFO:tasks.rados.rados.0.smithi084.stdout:1178: expect (ObjNum 266 snap 83 seq_num 266) 2024-01-13T18:04:33.879 INFO:tasks.rados.rados.0.smithi084.stdout:1184: finishing copy_from to smithi084102331-19 2024-01-13T18:04:33.879 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 419 (ObjNum 344 snap 110 seq_num 344) dirty exists 2024-01-13T18:04:33.879 INFO:tasks.rados.rados.0.smithi084.stdout:1184: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:04:33.929 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:33 smithi084 systemd[1]: Stopping Ceph osd.2 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:04:33.929 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[72622]: 2024-01-13T18:04:33.784+0000 7f3d88b60700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:04:33.929 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[72622]: 2024-01-13T18:04:33.784+0000 7f3d88b60700 -1 osd.2 294 *** Got signal Terminated *** 2024-01-13T18:04:33.929 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:33 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[72622]: 2024-01-13T18:04:33.784+0000 7f3d88b60700 -1 osd.2 294 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T18:04:34.614 INFO:tasks.rados.rados.0.smithi084.stdout:1175: done (7 left) 2024-01-13T18:04:34.614 INFO:tasks.rados.rados.0.smithi084.stdout:1176: done (6 left) 2024-01-13T18:04:34.614 INFO:tasks.rados.rados.0.smithi084.stdout:1177: done (5 left) 2024-01-13T18:04:34.614 INFO:tasks.rados.rados.0.smithi084.stdout:1178: done (4 left) 2024-01-13T18:04:34.614 INFO:tasks.rados.rados.0.smithi084.stdout:1179: done (3 left) 2024-01-13T18:04:34.614 INFO:tasks.rados.rados.0.smithi084.stdout:1181: done (2 left) 2024-01-13T18:04:34.614 INFO:tasks.rados.rados.0.smithi084.stdout:1184: done (1 left) 2024-01-13T18:04:34.614 INFO:tasks.rados.rados.0.smithi084.stdout:1185: done (0 left) 2024-01-13T18:04:34.615 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 119 2024-01-13T18:04:34.615 INFO:tasks.rados.rados.0.smithi084.stdout:1186: seq_num 370 ranges {2564096=606208,3170304=794624,3964928=8192} 2024-01-13T18:04:34.631 INFO:tasks.rados.rados.0.smithi084.stdout:1186: writing smithi084102331-28 from 2564096 to 3170304 tid 1 2024-01-13T18:04:34.636 INFO:tasks.rados.rados.0.smithi084.stdout:1186: writing smithi084102331-28 from 3170304 to 3964928 tid 2 2024-01-13T18:04:34.636 INFO:tasks.rados.rados.0.smithi084.stdout:1186: writing smithi084102331-28 from 3964928 to 3973120 tid 3 2024-01-13T18:04:34.636 INFO:tasks.rados.rados.0.smithi084.stdout:1187: rmattr oid 39 current snap is 119 2024-01-13T18:04:34.636 INFO:tasks.rados.rados.0.smithi084.stdout:1187: done (1 left) 2024-01-13T18:04:34.636 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 119 2024-01-13T18:04:34.636 INFO:tasks.rados.rados.0.smithi084.stdout:1188: seq_num 371 ranges {4169728=622592,4792320=679936,5472256=122880} 2024-01-13T18:04:34.661 INFO:tasks.rados.rados.0.smithi084.stdout:1188: writing smithi084102331-34 from 4169728 to 4792320 tid 1 2024-01-13T18:04:34.665 INFO:tasks.rados.rados.0.smithi084.stdout:1188: writing smithi084102331-34 from 4792320 to 5472256 tid 2 2024-01-13T18:04:34.666 INFO:tasks.rados.rados.0.smithi084.stdout:1188: writing smithi084102331-34 from 5472256 to 5595136 tid 3 2024-01-13T18:04:34.666 INFO:tasks.rados.rados.0.smithi084.stdout:1189: copy_from oid 3 from oid 13 current snap is 119 2024-01-13T18:04:34.667 INFO:tasks.rados.rados.0.smithi084.stdout:1190: copy_from oid 32 from oid 12 current snap is 119 2024-01-13T18:04:34.667 INFO:tasks.rados.rados.0.smithi084.stdout:1191: snap_create 2024-01-13T18:04:34.687 INFO:tasks.rados.rados.0.smithi084.stdout:1190: finishing copy_from to smithi084102331-32 2024-01-13T18:04:34.687 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 423 (ObjNum 346 snap 110 seq_num 346) dirty exists 2024-01-13T18:04:34.687 INFO:tasks.rados.rados.0.smithi084.stdout:1190: finishing copy_from racing read to smithi084102331-32 2024-01-13T18:04:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:34 smithi099 ceph-mon[138788]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:34 smithi099 ceph-mon[138788]: osdmap e294: 8 total, 8 up, 8 in 2024-01-13T18:04:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:34 smithi099 ceph-mon[138788]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:34 smithi099 ceph-mon[138788]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:34 smithi099 ceph-mon[138788]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:34 smithi099 ceph-mon[138788]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:34 smithi099 ceph-mon[138788]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:34 smithi099 ceph-mon[138788]: osd.2 marked itself down and dead 2024-01-13T18:04:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:34 smithi099 ceph-mon[138788]: pgmap v152: 121 pgs: 121 active+clean; 258 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2024-01-13T18:04:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[116404]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[116404]: osdmap e294: 8 total, 8 up, 8 in 2024-01-13T18:04:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[116404]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[116404]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[116404]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[116404]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[116404]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[116404]: osd.2 marked itself down and dead 2024-01-13T18:04:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[116404]: pgmap v152: 121 pgs: 121 active+clean; 258 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2024-01-13T18:04:34.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[119097]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[119097]: osdmap e294: 8 total, 8 up, 8 in 2024-01-13T18:04:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[119097]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[119097]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[119097]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[119097]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[119097]: failed to encode map e294 with expected crc 2024-01-13T18:04:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[119097]: osd.2 marked itself down and dead 2024-01-13T18:04:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:34 smithi084 ceph-mon[119097]: pgmap v152: 121 pgs: 121 active+clean; 258 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2024-01-13T18:04:35.609 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:35 smithi084 bash[137751]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2 2024-01-13T18:04:35.609 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[116404]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:04:35.620 INFO:tasks.rados.rados.0.smithi084.stdout:1190: done (4 left) 2024-01-13T18:04:35.620 INFO:tasks.rados.rados.0.smithi084.stdout:1191: done (3 left) 2024-01-13T18:04:35.620 INFO:tasks.rados.rados.0.smithi084.stdout:1192: snap_create 2024-01-13T18:04:35.628 INFO:tasks.rados.rados.0.smithi084.stdout:1189: finishing copy_from to smithi084102331-3 2024-01-13T18:04:35.628 INFO:tasks.rados.rados.0.smithi084.stdout:1189: got expected ENOENT (src dne) 2024-01-13T18:04:35.629 INFO:tasks.rados.rados.0.smithi084.stdout:1189: finishing copy_from racing read to smithi084102331-3 2024-01-13T18:04:35.629 INFO:tasks.rados.rados.0.smithi084.stdout:1188: finishing write tid 1 to smithi084102331-34 2024-01-13T18:04:35.629 INFO:tasks.rados.rados.0.smithi084.stdout:1188: finishing write tid 2 to smithi084102331-34 2024-01-13T18:04:35.629 INFO:tasks.rados.rados.0.smithi084.stdout:1188: finishing write tid 3 to smithi084102331-34 2024-01-13T18:04:35.629 INFO:tasks.rados.rados.0.smithi084.stdout:1188: finishing write tid 4 to smithi084102331-34 2024-01-13T18:04:35.631 INFO:tasks.rados.rados.0.smithi084.stdout:1188: finishing write tid 5 to smithi084102331-34 2024-01-13T18:04:35.631 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 363 (ObjNum 371 snap 119 seq_num 371) dirty exists 2024-01-13T18:04:35.631 INFO:tasks.rados.rados.0.smithi084.stdout:1188: left oid 34 (ObjNum 371 snap 119 seq_num 371) 2024-01-13T18:04:35.638 INFO:tasks.rados.rados.0.smithi084.stdout:1186: finishing write tid 1 to smithi084102331-28 2024-01-13T18:04:35.638 INFO:tasks.rados.rados.0.smithi084.stdout:1186: finishing write tid 2 to smithi084102331-28 2024-01-13T18:04:35.639 INFO:tasks.rados.rados.0.smithi084.stdout:1186: finishing write tid 3 to smithi084102331-28 2024-01-13T18:04:35.639 INFO:tasks.rados.rados.0.smithi084.stdout:1186: finishing write tid 4 to smithi084102331-28 2024-01-13T18:04:35.640 INFO:tasks.rados.rados.0.smithi084.stdout:1186: finishing write tid 5 to smithi084102331-28 2024-01-13T18:04:35.640 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 357 (ObjNum 370 snap 119 seq_num 370) dirty exists 2024-01-13T18:04:35.640 INFO:tasks.rados.rados.0.smithi084.stdout:1186: left oid 28 (ObjNum 370 snap 119 seq_num 370) 2024-01-13T18:04:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:35 smithi099 ceph-mon[138788]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:04:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:35 smithi099 ceph-mon[138788]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:35 smithi099 ceph-mon[138788]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:35 smithi099 ceph-mon[138788]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:35 smithi099 ceph-mon[138788]: osdmap e295: 8 total, 7 up, 8 in 2024-01-13T18:04:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:35 smithi099 ceph-mon[138788]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:35.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[116404]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[116404]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[116404]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[116404]: osdmap e295: 8 total, 7 up, 8 in 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[116404]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[119097]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[119097]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[119097]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[119097]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[119097]: osdmap e295: 8 total, 7 up, 8 in 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[119097]: failed to encode map e295 with expected crc 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:36.626 INFO:tasks.rados.rados.0.smithi084.stdout:1186: done (3 left) 2024-01-13T18:04:36.627 INFO:tasks.rados.rados.0.smithi084.stdout:1188: done (2 left) 2024-01-13T18:04:36.627 INFO:tasks.rados.rados.0.smithi084.stdout:1189: done (1 left) 2024-01-13T18:04:36.627 INFO:tasks.rados.rados.0.smithi084.stdout:1192: done (0 left) 2024-01-13T18:04:36.627 INFO:tasks.rados.rados.0.smithi084.stdout:1193: snap_remove snap 114 2024-01-13T18:04:36.831 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:36 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.2.service: Succeeded. 2024-01-13T18:04:36.831 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:36 smithi084 systemd[1]: Stopped Ceph osd.2 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:04:36.832 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:36 smithi084 systemd[1]: Starting Ceph osd.2 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:04:36.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[116404]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[116404]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[116404]: osdmap e296: 8 total, 7 up, 8 in 2024-01-13T18:04:36.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[116404]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[116404]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[116404]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[116404]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[116404]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[116404]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.833 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[116404]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.833 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[116404]: pgmap v155: 121 pgs: 6 active+undersized+degraded, 3 stale+active+clean, 19 active+undersized, 93 active+clean; 280 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 673 KiB/s rd, 4.1 MiB/s wr, 7 op/s; 31/546 objects degraded (5.678%) 2024-01-13T18:04:36.833 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[119097]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.833 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[119097]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.833 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[119097]: osdmap e296: 8 total, 7 up, 8 in 2024-01-13T18:04:36.833 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[119097]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.833 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[119097]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.833 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[119097]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.833 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[119097]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.834 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[119097]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.834 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[119097]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.834 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[119097]: failed to encode map e296 with expected crc 2024-01-13T18:04:36.834 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:36 smithi084 ceph-mon[119097]: pgmap v155: 121 pgs: 6 active+undersized+degraded, 3 stale+active+clean, 19 active+undersized, 93 active+clean; 280 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 673 KiB/s rd, 4.1 MiB/s wr, 7 op/s; 31/546 objects degraded (5.678%) 2024-01-13T18:04:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:36 smithi099 ceph-mon[138788]: failed to encode map e296 with expected crc 2024-01-13T18:04:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:36 smithi099 ceph-mon[138788]: failed to encode map e296 with expected crc 2024-01-13T18:04:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:36 smithi099 ceph-mon[138788]: osdmap e296: 8 total, 7 up, 8 in 2024-01-13T18:04:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:36 smithi099 ceph-mon[138788]: failed to encode map e296 with expected crc 2024-01-13T18:04:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:36 smithi099 ceph-mon[138788]: failed to encode map e296 with expected crc 2024-01-13T18:04:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:36 smithi099 ceph-mon[138788]: failed to encode map e296 with expected crc 2024-01-13T18:04:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:36 smithi099 ceph-mon[138788]: failed to encode map e296 with expected crc 2024-01-13T18:04:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:36 smithi099 ceph-mon[138788]: failed to encode map e296 with expected crc 2024-01-13T18:04:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:36 smithi099 ceph-mon[138788]: failed to encode map e296 with expected crc 2024-01-13T18:04:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:36 smithi099 ceph-mon[138788]: failed to encode map e296 with expected crc 2024-01-13T18:04:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:36 smithi099 ceph-mon[138788]: pgmap v155: 121 pgs: 6 active+undersized+degraded, 3 stale+active+clean, 19 active+undersized, 93 active+clean; 280 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 673 KiB/s rd, 4.1 MiB/s wr, 7 op/s; 31/546 objects degraded (5.678%) 2024-01-13T18:04:37.587 INFO:tasks.rados.rados.0.smithi084.stdout:1193: done (0 left) 2024-01-13T18:04:37.587 INFO:tasks.rados.rados.0.smithi084.stdout:1194: rollback oid 5 current snap is 121 2024-01-13T18:04:37.587 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 98 2024-01-13T18:04:37.587 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 121 2024-01-13T18:04:37.587 INFO:tasks.rados.rados.0.smithi084.stdout:1195: seq_num 372 ranges {0=638976,638976=565248,1204224=237568} 2024-01-13T18:04:37.595 INFO:tasks.rados.rados.0.smithi084.stdout:1195: writing smithi084102331-29 from 0 to 638976 tid 1 2024-01-13T18:04:37.595 INFO:tasks.rados.rados.0.smithi084.stdout:1195: writing smithi084102331-29 from 638976 to 1204224 tid 2 2024-01-13T18:04:37.596 INFO:tasks.rados.rados.0.smithi084.stdout:1195: writing smithi084102331-29 from 1204224 to 1441792 tid 3 2024-01-13T18:04:37.596 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 121 2024-01-13T18:04:37.597 INFO:tasks.rados.rados.0.smithi084.stdout:1196: seq_num 373 ranges {0=655360,655360=499712,1155072=303104} 2024-01-13T18:04:37.600 INFO:tasks.rados.rados.0.smithi084.stdout:1196: writing smithi084102331-10 from 0 to 655360 tid 1 2024-01-13T18:04:37.605 INFO:tasks.rados.rados.0.smithi084.stdout:1196: writing smithi084102331-10 from 655360 to 1155072 tid 2 2024-01-13T18:04:37.606 INFO:tasks.rados.rados.0.smithi084.stdout:1196: writing smithi084102331-10 from 1155072 to 1458176 tid 3 2024-01-13T18:04:37.606 INFO:tasks.rados.rados.0.smithi084.stdout:1197: delete oid 26 current snap is 121 2024-01-13T18:04:37.606 INFO:tasks.rados.rados.0.smithi084.stdout:1194: finishing rollback tid 0 to smithi084102331-5 2024-01-13T18:04:37.606 INFO:tasks.rados.rados.0.smithi084.stdout:1194: finishing rollback tid 1 to smithi084102331-5 2024-01-13T18:04:37.606 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 378 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-01-13T18:04:37.606 INFO:tasks.rados.rados.0.smithi084.stdout:1195: finishing write tid 1 to smithi084102331-29 2024-01-13T18:04:37.606 INFO:tasks.rados.rados.0.smithi084.stdout:1195: finishing write tid 2 to smithi084102331-29 2024-01-13T18:04:37.607 INFO:tasks.rados.rados.0.smithi084.stdout:1195: finishing write tid 3 to smithi084102331-29 2024-01-13T18:04:37.607 INFO:tasks.rados.rados.0.smithi084.stdout:1196: finishing write tid 1 to smithi084102331-10 2024-01-13T18:04:37.607 INFO:tasks.rados.rados.0.smithi084.stdout:1195: finishing write tid 4 to smithi084102331-29 2024-01-13T18:04:37.609 INFO:tasks.rados.rados.0.smithi084.stdout:1195: finishing write tid 5 to smithi084102331-29 2024-01-13T18:04:37.609 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 395 (ObjNum 372 snap 121 seq_num 372) dirty exists 2024-01-13T18:04:37.609 INFO:tasks.rados.rados.0.smithi084.stdout:1195: left oid 29 (ObjNum 372 snap 121 seq_num 372) 2024-01-13T18:04:37.610 INFO:tasks.rados.rados.0.smithi084.stdout:1196: finishing write tid 2 to smithi084102331-10 2024-01-13T18:04:37.610 INFO:tasks.rados.rados.0.smithi084.stdout:1196: finishing write tid 3 to smithi084102331-10 2024-01-13T18:04:37.610 INFO:tasks.rados.rados.0.smithi084.stdout:1196: finishing write tid 4 to smithi084102331-10 2024-01-13T18:04:37.610 INFO:tasks.rados.rados.0.smithi084.stdout:1194: done (3 left) 2024-01-13T18:04:37.610 INFO:tasks.rados.rados.0.smithi084.stdout:1195: done (2 left) 2024-01-13T18:04:37.610 INFO:tasks.rados.rados.0.smithi084.stdout:1197: done (1 left) 2024-01-13T18:04:37.610 INFO:tasks.rados.rados.0.smithi084.stdout:1198: read oid 39 snap -1 2024-01-13T18:04:37.610 INFO:tasks.rados.rados.0.smithi084.stdout:1198: expect deleted 2024-01-13T18:04:37.610 INFO:tasks.rados.rados.0.smithi084.stdout:1199: snap_remove snap 94 2024-01-13T18:04:37.621 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:37 smithi084 bash[138015]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-13T18:04:37.621 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:37 smithi084 bash[138015]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-01-13T18:04:37.621 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:37 smithi084 bash[138015]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-01-13T18:04:37.621 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:37 smithi084 bash[138015]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-01-13T18:04:37.621 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:37 smithi084 bash[138015]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-01-13T18:04:37.621 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:37 smithi084 bash[138015]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-13T18:04:37.621 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:37 smithi084 bash[138015]: --> ceph-volume raw activate successful for osd ID: 2 2024-01-13T18:04:37.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:37 smithi084 ceph-mon[116404]: Health check failed: Degraded data redundancy: 31/546 objects degraded (5.678%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:37.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:37 smithi084 ceph-mon[116404]: failed to encode map e297 with expected crc 2024-01-13T18:04:37.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:37 smithi084 ceph-mon[116404]: osdmap e297: 8 total, 7 up, 8 in 2024-01-13T18:04:37.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:37 smithi084 ceph-mon[116404]: failed to encode map e297 with expected crc 2024-01-13T18:04:37.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:37 smithi084 ceph-mon[116404]: osdmap e298: 8 total, 7 up, 8 in 2024-01-13T18:04:37.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:37 smithi084 ceph-mon[119097]: Health check failed: Degraded data redundancy: 31/546 objects degraded (5.678%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:37.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:37 smithi084 ceph-mon[119097]: failed to encode map e297 with expected crc 2024-01-13T18:04:37.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:37 smithi084 ceph-mon[119097]: osdmap e297: 8 total, 7 up, 8 in 2024-01-13T18:04:37.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:37 smithi084 ceph-mon[119097]: failed to encode map e297 with expected crc 2024-01-13T18:04:37.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:37 smithi084 ceph-mon[119097]: osdmap e298: 8 total, 7 up, 8 in 2024-01-13T18:04:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:37 smithi099 ceph-mon[138788]: Health check failed: Degraded data redundancy: 31/546 objects degraded (5.678%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:37 smithi099 ceph-mon[138788]: failed to encode map e297 with expected crc 2024-01-13T18:04:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:37 smithi099 ceph-mon[138788]: osdmap e297: 8 total, 7 up, 8 in 2024-01-13T18:04:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:37 smithi099 ceph-mon[138788]: failed to encode map e297 with expected crc 2024-01-13T18:04:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:37 smithi099 ceph-mon[138788]: osdmap e298: 8 total, 7 up, 8 in 2024-01-13T18:04:38.600 INFO:tasks.rados.rados.0.smithi084.stdout:1199: done (2 left) 2024-01-13T18:04:38.600 INFO:tasks.rados.rados.0.smithi084.stdout:1200: snap_remove snap 119 2024-01-13T18:04:38.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[116404]: failed to encode map e298 with expected crc 2024-01-13T18:04:38.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[116404]: failed to encode map e298 with expected crc 2024-01-13T18:04:38.627 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-osd[138300]: -- 172.21.15.84:0/3171002206 <== mon.2 v2:172.21.15.84:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558291fec4e0 con 0x558291fbcc00 2024-01-13T18:04:38.627 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:38 smithi084 bash[138263]: 660c53389079c4ab672279b8c25a4336f53479682f202f0ede270e683e04f4fd 2024-01-13T18:04:38.627 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:38 smithi084 systemd[1]: Started Ceph osd.2 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:04:38.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[119097]: failed to encode map e298 with expected crc 2024-01-13T18:04:38.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[119097]: failed to encode map e298 with expected crc 2024-01-13T18:04:38.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[119097]: failed to encode map e298 with expected crc 2024-01-13T18:04:38.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[119097]: pgmap v158: 121 pgs: 8 active+undersized+degraded, 1 stale+active+clean, 22 active+undersized, 90 active+clean; 279 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 14 op/s; 51/552 objects degraded (9.239%) 2024-01-13T18:04:38.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:38.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:38.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:38.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[119097]: osdmap e299: 8 total, 7 up, 8 in 2024-01-13T18:04:38.929 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[138277]: 2024-01-13T18:04:38.711+0000 7fb547799640 -1 Falling back to public interface 2024-01-13T18:04:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[116404]: failed to encode map e298 with expected crc 2024-01-13T18:04:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[116404]: pgmap v158: 121 pgs: 8 active+undersized+degraded, 1 stale+active+clean, 22 active+undersized, 90 active+clean; 279 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 14 op/s; 51/552 objects degraded (9.239%) 2024-01-13T18:04:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:38 smithi084 ceph-mon[116404]: osdmap e299: 8 total, 7 up, 8 in 2024-01-13T18:04:39.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:04:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:04:38.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:04:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:38 smithi099 ceph-mon[138788]: failed to encode map e298 with expected crc 2024-01-13T18:04:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:38 smithi099 ceph-mon[138788]: failed to encode map e298 with expected crc 2024-01-13T18:04:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:38 smithi099 ceph-mon[138788]: failed to encode map e298 with expected crc 2024-01-13T18:04:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:38 smithi099 ceph-mon[138788]: pgmap v158: 121 pgs: 8 active+undersized+degraded, 1 stale+active+clean, 22 active+undersized, 90 active+clean; 279 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 14 op/s; 51/552 objects degraded (9.239%) 2024-01-13T18:04:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:39.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:38 smithi099 ceph-mon[138788]: osdmap e299: 8 total, 7 up, 8 in 2024-01-13T18:04:39.598 INFO:tasks.rados.rados.0.smithi084.stdout:1200: done (2 left) 2024-01-13T18:04:39.599 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 121 2024-01-13T18:04:39.599 INFO:tasks.rados.rados.0.smithi084.stdout:1196: finishing write tid 5 to smithi084102331-10 2024-01-13T18:04:39.599 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 334 (ObjNum 373 snap 121 seq_num 373) dirty exists 2024-01-13T18:04:39.599 INFO:tasks.rados.rados.0.smithi084.stdout:1196: left oid 10 (ObjNum 373 snap 121 seq_num 373) 2024-01-13T18:04:39.599 INFO:tasks.rados.rados.0.smithi084.stdout:1201: seq_num 375 ranges {8544256=688128,9232384=663552,9895936=139264} 2024-01-13T18:04:39.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:39 smithi084 ceph-mon[116404]: failed to encode map e299 with expected crc 2024-01-13T18:04:39.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:39 smithi084 ceph-mon[116404]: failed to encode map e299 with expected crc 2024-01-13T18:04:39.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:39 smithi084 ceph-mon[116404]: osdmap e300: 8 total, 7 up, 8 in 2024-01-13T18:04:39.649 INFO:tasks.rados.rados.0.smithi084.stdout:1201: writing smithi084102331-47 from 8544256 to 9232384 tid 1 2024-01-13T18:04:39.653 INFO:tasks.rados.rados.0.smithi084.stdout:1201: writing smithi084102331-47 from 9232384 to 9895936 tid 2 2024-01-13T18:04:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:1201: writing smithi084102331-47 from 9895936 to 10035200 tid 3 2024-01-13T18:04:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:1196: done (2 left) 2024-01-13T18:04:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:1198: done (1 left) 2024-01-13T18:04:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:1202: copy_from oid 4 from oid 34 current snap is 121 2024-01-13T18:04:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:1203: snap_create 2024-01-13T18:04:39.658 INFO:tasks.rados.rados.0.smithi084.stdout:1201: finishing write tid 1 to smithi084102331-47 2024-01-13T18:04:39.660 INFO:tasks.rados.rados.0.smithi084.stdout:1201: finishing write tid 2 to smithi084102331-47 2024-01-13T18:04:39.660 INFO:tasks.rados.rados.0.smithi084.stdout:1201: finishing write tid 3 to smithi084102331-47 2024-01-13T18:04:39.661 INFO:tasks.rados.rados.0.smithi084.stdout:1201: finishing write tid 4 to smithi084102331-47 2024-01-13T18:04:39.662 INFO:tasks.rados.rados.0.smithi084.stdout:1201: finishing write tid 5 to smithi084102331-47 2024-01-13T18:04:39.662 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 546 (ObjNum 375 snap 121 seq_num 375) dirty exists 2024-01-13T18:04:39.662 INFO:tasks.rados.rados.0.smithi084.stdout:1201: left oid 47 (ObjNum 375 snap 121 seq_num 375) 2024-01-13T18:04:39.686 INFO:tasks.rados.rados.0.smithi084.stdout:1202: finishing copy_from to smithi084102331-4 2024-01-13T18:04:39.686 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 363 (ObjNum 371 snap 119 seq_num 371) dirty exists 2024-01-13T18:04:39.686 INFO:tasks.rados.rados.0.smithi084.stdout:1202: finishing copy_from racing read to smithi084102331-4 2024-01-13T18:04:39.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:39 smithi084 ceph-mon[119097]: failed to encode map e299 with expected crc 2024-01-13T18:04:39.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:39 smithi084 ceph-mon[119097]: failed to encode map e299 with expected crc 2024-01-13T18:04:39.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:39 smithi084 ceph-mon[119097]: osdmap e300: 8 total, 7 up, 8 in 2024-01-13T18:04:40.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:39 smithi099 ceph-mon[138788]: failed to encode map e299 with expected crc 2024-01-13T18:04:40.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:39 smithi099 ceph-mon[138788]: failed to encode map e299 with expected crc 2024-01-13T18:04:40.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:39 smithi099 ceph-mon[138788]: osdmap e300: 8 total, 7 up, 8 in 2024-01-13T18:04:40.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:04:40] "GET /metrics HTTP/1.1" 200 36126 "" "Prometheus/2.43.0" 2024-01-13T18:04:40.636 INFO:tasks.rados.rados.0.smithi084.stdout:1201: done (2 left) 2024-01-13T18:04:40.636 INFO:tasks.rados.rados.0.smithi084.stdout:1202: done (1 left) 2024-01-13T18:04:40.636 INFO:tasks.rados.rados.0.smithi084.stdout:1203: done (0 left) 2024-01-13T18:04:40.636 INFO:tasks.rados.rados.0.smithi084.stdout:1204: delete oid 3 current snap is 122 2024-01-13T18:04:40.639 INFO:tasks.rados.rados.0.smithi084.stdout:1204: done (0 left) 2024-01-13T18:04:40.639 INFO:tasks.rados.rados.0.smithi084.stdout:1205: read oid 6 snap -1 2024-01-13T18:04:40.639 INFO:tasks.rados.rados.0.smithi084.stdout:1205: expect deleted 2024-01-13T18:04:40.639 INFO:tasks.rados.rados.0.smithi084.stdout:1206: delete oid 30 current snap is 122 2024-01-13T18:04:40.644 INFO:tasks.rados.rados.0.smithi084.stdout:1205: done (1 left) 2024-01-13T18:04:40.644 INFO:tasks.rados.rados.0.smithi084.stdout:1206: done (0 left) 2024-01-13T18:04:40.644 INFO:tasks.rados.rados.0.smithi084.stdout:1207: snap_remove snap 99 2024-01-13T18:04:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[116404]: failed to encode map e300 with expected crc 2024-01-13T18:04:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[116404]: failed to encode map e300 with expected crc 2024-01-13T18:04:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[116404]: failed to encode map e300 with expected crc 2024-01-13T18:04:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[116404]: pgmap v161: 121 pgs: 9 active+undersized+degraded, 27 active+undersized, 85 active+clean; 280 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.4 MiB/s rd, 704 KiB/s wr, 9 op/s; 55/549 objects degraded (10.018%) 2024-01-13T18:04:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:40.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[119097]: failed to encode map e300 with expected crc 2024-01-13T18:04:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[119097]: failed to encode map e300 with expected crc 2024-01-13T18:04:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[119097]: failed to encode map e300 with expected crc 2024-01-13T18:04:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[119097]: pgmap v161: 121 pgs: 9 active+undersized+degraded, 27 active+undersized, 85 active+clean; 280 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.4 MiB/s rd, 704 KiB/s wr, 9 op/s; 55/549 objects degraded (10.018%) 2024-01-13T18:04:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:40 smithi099 ceph-mon[138788]: failed to encode map e300 with expected crc 2024-01-13T18:04:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:40 smithi099 ceph-mon[138788]: failed to encode map e300 with expected crc 2024-01-13T18:04:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:40 smithi099 ceph-mon[138788]: failed to encode map e300 with expected crc 2024-01-13T18:04:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:40 smithi099 ceph-mon[138788]: pgmap v161: 121 pgs: 9 active+undersized+degraded, 27 active+undersized, 85 active+clean; 280 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.4 MiB/s rd, 704 KiB/s wr, 9 op/s; 55/549 objects degraded (10.018%) 2024-01-13T18:04:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:41.644 INFO:tasks.rados.rados.0.smithi084.stdout:1207: done (0 left) 2024-01-13T18:04:41.644 INFO:tasks.rados.rados.0.smithi084.stdout:1208: read oid 40 snap -1 2024-01-13T18:04:41.644 INFO:tasks.rados.rados.0.smithi084.stdout:1208: expect (ObjNum 361 snap 116 seq_num 361) 2024-01-13T18:04:41.644 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 122 2024-01-13T18:04:41.644 INFO:tasks.rados.rados.0.smithi084.stdout:1209: seq_num 378 ranges {1458176=737280,2195456=720896,2916352=81920} 2024-01-13T18:04:41.656 INFO:tasks.rados.rados.0.smithi084.stdout:1209: writing smithi084102331-10 from 1458176 to 2195456 tid 1 2024-01-13T18:04:41.661 INFO:tasks.rados.rados.0.smithi084.stdout:1209: writing smithi084102331-10 from 2195456 to 2916352 tid 2 2024-01-13T18:04:41.670 INFO:tasks.rados.rados.0.smithi084.stdout:1209: writing smithi084102331-10 from 2916352 to 2998272 tid 3 2024-01-13T18:04:41.670 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 122 2024-01-13T18:04:41.671 INFO:tasks.rados.rados.0.smithi084.stdout:1210: seq_num 379 ranges {8282112=753664,9035776=606208,9641984=196608} 2024-01-13T18:04:41.714 INFO:tasks.rados.rados.0.smithi084.stdout:1210: writing smithi084102331-16 from 8282112 to 9035776 tid 1 2024-01-13T18:04:41.718 INFO:tasks.rados.rados.0.smithi084.stdout:1210: writing smithi084102331-16 from 9035776 to 9641984 tid 2 2024-01-13T18:04:41.719 INFO:tasks.rados.rados.0.smithi084.stdout:1210: writing smithi084102331-16 from 9641984 to 9838592 tid 3 2024-01-13T18:04:41.719 INFO:tasks.rados.rados.0.smithi084.stdout:1211: read oid 49 snap -1 2024-01-13T18:04:41.719 INFO:tasks.rados.rados.0.smithi084.stdout:1211: expect (ObjNum 319 snap 101 seq_num 319) 2024-01-13T18:04:41.719 INFO:tasks.rados.rados.0.smithi084.stdout:1209: finishing write tid 1 to smithi084102331-10 2024-01-13T18:04:41.719 INFO:tasks.rados.rados.0.smithi084.stdout:1208: expect (ObjNum 361 snap 116 seq_num 361) 2024-01-13T18:04:41.839 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[138277]: 2024-01-13T18:04:41.531+0000 7fb547799640 -1 osd.2 0 read_superblock omap replica is missing. 2024-01-13T18:04:41.839 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[138277]: 2024-01-13T18:04:41.576+0000 7fb547799640 -1 osd.2 294 log_to_monitors true 2024-01-13T18:04:41.839 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[138277]: 2024-01-13T18:04:41.684+0000 7fb536bf0700 -1 osd.2 294 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T18:04:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[116404]: failed to encode map e301 with expected crc 2024-01-13T18:04:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[116404]: osdmap e301: 8 total, 7 up, 8 in 2024-01-13T18:04:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[116404]: failed to encode map e301 with expected crc 2024-01-13T18:04:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[116404]: failed to encode map e301 with expected crc 2024-01-13T18:04:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[116404]: failed to encode map e301 with expected crc 2024-01-13T18:04:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[116404]: failed to encode map e301 with expected crc 2024-01-13T18:04:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[116404]: from='osd.2 [v2:172.21.15.84:6818/454646549,v1:172.21.15.84:6819/454646549]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T18:04:41.840 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[116404]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T18:04:41.841 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[119097]: failed to encode map e301 with expected crc 2024-01-13T18:04:41.841 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[119097]: osdmap e301: 8 total, 7 up, 8 in 2024-01-13T18:04:41.841 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[119097]: failed to encode map e301 with expected crc 2024-01-13T18:04:41.841 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[119097]: failed to encode map e301 with expected crc 2024-01-13T18:04:41.841 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[119097]: failed to encode map e301 with expected crc 2024-01-13T18:04:41.841 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[119097]: failed to encode map e301 with expected crc 2024-01-13T18:04:41.841 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:41.841 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:41.841 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[119097]: from='osd.2 [v2:172.21.15.84:6818/454646549,v1:172.21.15.84:6819/454646549]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T18:04:41.841 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:41 smithi084 ceph-mon[119097]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T18:04:41.879 INFO:tasks.rados.rados.0.smithi084.stdout:1209: finishing write tid 2 to smithi084102331-10 2024-01-13T18:04:41.879 INFO:tasks.rados.rados.0.smithi084.stdout:1209: finishing write tid 3 to smithi084102331-10 2024-01-13T18:04:41.879 INFO:tasks.rados.rados.0.smithi084.stdout:1209: finishing write tid 4 to smithi084102331-10 2024-01-13T18:04:41.879 INFO:tasks.rados.rados.0.smithi084.stdout:1212: read oid 39 snap 98 2024-01-13T18:04:41.879 INFO:tasks.rados.rados.0.smithi084.stdout:1212: expect (ObjNum 201 snap 55 seq_num 201) 2024-01-13T18:04:41.880 INFO:tasks.rados.rados.0.smithi084.stdout:1208: done (4 left) 2024-01-13T18:04:41.880 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 122 2024-01-13T18:04:41.880 INFO:tasks.rados.rados.0.smithi084.stdout:1209: finishing write tid 5 to smithi084102331-10 2024-01-13T18:04:41.880 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 338 (ObjNum 378 snap 122 seq_num 378) dirty exists 2024-01-13T18:04:41.880 INFO:tasks.rados.rados.0.smithi084.stdout:1209: left oid 10 (ObjNum 378 snap 122 seq_num 378) 2024-01-13T18:04:41.880 INFO:tasks.rados.rados.0.smithi084.stdout:1210: finishing write tid 1 to smithi084102331-16 2024-01-13T18:04:41.880 INFO:tasks.rados.rados.0.smithi084.stdout:1213: seq_num 380 ranges {0=770048,770048=483328,1253376=319488} 2024-01-13T18:04:41.883 INFO:tasks.rados.rados.0.smithi084.stdout:1213: writing smithi084102331-2 from 0 to 770048 tid 1 2024-01-13T18:04:41.885 INFO:tasks.rados.rados.0.smithi084.stdout:1213: writing smithi084102331-2 from 770048 to 1253376 tid 2 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:1213: writing smithi084102331-2 from 1253376 to 1572864 tid 3 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:1209: done (4 left) 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:1214: read oid 37 snap -1 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:1214: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:1215: snap_create 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:1210: finishing write tid 2 to smithi084102331-16 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:1210: finishing write tid 3 to smithi084102331-16 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:1210: finishing write tid 4 to smithi084102331-16 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:1210: finishing write tid 5 to smithi084102331-16 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 362 (ObjNum 379 snap 122 seq_num 379) dirty exists 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:1210: left oid 16 (ObjNum 379 snap 122 seq_num 379) 2024-01-13T18:04:41.888 INFO:tasks.rados.rados.0.smithi084.stdout:1211: expect (ObjNum 319 snap 101 seq_num 319) 2024-01-13T18:04:41.903 INFO:tasks.rados.rados.0.smithi084.stdout:1213: finishing write tid 1 to smithi084102331-2 2024-01-13T18:04:41.903 INFO:tasks.rados.rados.0.smithi084.stdout:1214: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:04:41.907 INFO:tasks.rados.rados.0.smithi084.stdout:1213: finishing write tid 2 to smithi084102331-2 2024-01-13T18:04:41.907 INFO:tasks.rados.rados.0.smithi084.stdout:1213: finishing write tid 3 to smithi084102331-2 2024-01-13T18:04:41.907 INFO:tasks.rados.rados.0.smithi084.stdout:1213: finishing write tid 4 to smithi084102331-2 2024-01-13T18:04:41.907 INFO:tasks.rados.rados.0.smithi084.stdout:1213: finishing write tid 5 to smithi084102331-2 2024-01-13T18:04:41.907 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 512 (ObjNum 380 snap 122 seq_num 380) dirty exists 2024-01-13T18:04:41.907 INFO:tasks.rados.rados.0.smithi084.stdout:1213: left oid 2 (ObjNum 380 snap 122 seq_num 380) 2024-01-13T18:04:41.907 INFO:tasks.rados.rados.0.smithi084.stdout:1212: expect (ObjNum 201 snap 55 seq_num 201) 2024-01-13T18:04:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:41 smithi099 ceph-mon[138788]: failed to encode map e301 with expected crc 2024-01-13T18:04:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:41 smithi099 ceph-mon[138788]: osdmap e301: 8 total, 7 up, 8 in 2024-01-13T18:04:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:41 smithi099 ceph-mon[138788]: failed to encode map e301 with expected crc 2024-01-13T18:04:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:41 smithi099 ceph-mon[138788]: failed to encode map e301 with expected crc 2024-01-13T18:04:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:41 smithi099 ceph-mon[138788]: failed to encode map e301 with expected crc 2024-01-13T18:04:42.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:41 smithi099 ceph-mon[138788]: failed to encode map e301 with expected crc 2024-01-13T18:04:42.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:42.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:42.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:41 smithi099 ceph-mon[138788]: from='osd.2 [v2:172.21.15.84:6818/454646549,v1:172.21.15.84:6819/454646549]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T18:04:42.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:41 smithi099 ceph-mon[138788]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-13T18:04:42.590 INFO:tasks.rados.rados.0.smithi084.stdout:1210: done (5 left) 2024-01-13T18:04:42.591 INFO:tasks.rados.rados.0.smithi084.stdout:1211: done (4 left) 2024-01-13T18:04:42.591 INFO:tasks.rados.rados.0.smithi084.stdout:1212: done (3 left) 2024-01-13T18:04:42.591 INFO:tasks.rados.rados.0.smithi084.stdout:1213: done (2 left) 2024-01-13T18:04:42.591 INFO:tasks.rados.rados.0.smithi084.stdout:1214: done (1 left) 2024-01-13T18:04:42.591 INFO:tasks.rados.rados.0.smithi084.stdout:1215: done (0 left) 2024-01-13T18:04:42.591 INFO:tasks.rados.rados.0.smithi084.stdout:1216: rollback oid 36 current snap is 123 2024-01-13T18:04:42.591 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 107 2024-01-13T18:04:42.591 INFO:tasks.rados.rados.0.smithi084.stdout:1217: snap_remove snap 120 2024-01-13T18:04:42.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: osdmap e302: 8 total, 7 up, 8 in 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: failed to encode map e302 with expected crc 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: failed to encode map e302 with expected crc 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: from='osd.2 [v2:172.21.15.84:6818/454646549,v1:172.21.15.84:6819/454646549]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: failed to encode map e302 with expected crc 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: failed to encode map e302 with expected crc 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: pgmap v164: 121 pgs: 9 active+undersized+degraded, 27 active+undersized, 85 active+clean; 285 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 6 op/s; 57/567 objects degraded (10.053%) 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 55/549 objects degraded (10.018%), 9 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: osd.2 [v2:172.21.15.84:6818/454646549,v1:172.21.15.84:6819/454646549] boot 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: osdmap e303: 8 total, 8 up, 8 in 2024-01-13T18:04:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: osdmap e302: 8 total, 7 up, 8 in 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: failed to encode map e302 with expected crc 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: failed to encode map e302 with expected crc 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: from='osd.2 [v2:172.21.15.84:6818/454646549,v1:172.21.15.84:6819/454646549]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: failed to encode map e302 with expected crc 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: failed to encode map e302 with expected crc 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: pgmap v164: 121 pgs: 9 active+undersized+degraded, 27 active+undersized, 85 active+clean; 285 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 6 op/s; 57/567 objects degraded (10.053%) 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 55/549 objects degraded (10.018%), 9 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: osd.2 [v2:172.21.15.84:6818/454646549,v1:172.21.15.84:6819/454646549] boot 2024-01-13T18:04:42.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: osdmap e303: 8 total, 8 up, 8 in 2024-01-13T18:04:42.931 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:42 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:04:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-13T18:04:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: osdmap e302: 8 total, 7 up, 8 in 2024-01-13T18:04:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: failed to encode map e302 with expected crc 2024-01-13T18:04:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: failed to encode map e302 with expected crc 2024-01-13T18:04:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: from='osd.2 [v2:172.21.15.84:6818/454646549,v1:172.21.15.84:6819/454646549]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:04:43.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: failed to encode map e302 with expected crc 2024-01-13T18:04:43.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: failed to encode map e302 with expected crc 2024-01-13T18:04:43.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: pgmap v164: 121 pgs: 9 active+undersized+degraded, 27 active+undersized, 85 active+clean; 285 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 6 op/s; 57/567 objects degraded (10.053%) 2024-01-13T18:04:43.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 55/549 objects degraded (10.018%), 9 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:43.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:04:43.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: osd.2 [v2:172.21.15.84:6818/454646549,v1:172.21.15.84:6819/454646549] boot 2024-01-13T18:04:43.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: osdmap e303: 8 total, 8 up, 8 in 2024-01-13T18:04:43.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:42 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-13T18:04:43.598 INFO:tasks.rados.rados.0.smithi084.stdout:1217: done (1 left) 2024-01-13T18:04:43.598 INFO:tasks.rados.rados.0.smithi084.stdout:1218: rmattr oid 6 current snap is 123 2024-01-13T18:04:43.598 INFO:tasks.rados.rados.0.smithi084.stdout:1218: done (1 left) 2024-01-13T18:04:43.599 INFO:tasks.rados.rados.0.smithi084.stdout:1219: copy_from oid 23 from oid 6 current snap is 123 2024-01-13T18:04:43.599 INFO:tasks.rados.rados.0.smithi084.stdout:1220: delete oid 13 current snap is 123 2024-01-13T18:04:43.599 INFO:tasks.rados.rados.0.smithi084.stdout:1216: finishing rollback tid 0 to smithi084102331-36 2024-01-13T18:04:43.599 INFO:tasks.rados.rados.0.smithi084.stdout:1216: finishing rollback tid 1 to smithi084102331-36 2024-01-13T18:04:43.599 INFO:tasks.rados.rados.0.smithi084.stdout:1216: finishing rollback tid 2 to smithi084102331-36 2024-01-13T18:04:43.599 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 457 (ObjNum 327 snap 103 seq_num 327) dirty exists 2024-01-13T18:04:43.617 INFO:tasks.rados.rados.0.smithi084.stdout:1216: done (2 left) 2024-01-13T18:04:43.617 INFO:tasks.rados.rados.0.smithi084.stdout:1220: done (1 left) 2024-01-13T18:04:43.618 INFO:tasks.rados.rados.0.smithi084.stdout:1221: copy_from oid 44 from oid 50 current snap is 123 2024-01-13T18:04:43.618 INFO:tasks.rados.rados.0.smithi084.stdout:1222: delete oid 34 current snap is 123 2024-01-13T18:04:43.618 INFO:tasks.rados.rados.0.smithi084.stdout:1219: finishing copy_from to smithi084102331-23 2024-01-13T18:04:43.618 INFO:tasks.rados.rados.0.smithi084.stdout:1219: got expected ENOENT (src dne) 2024-01-13T18:04:43.619 INFO:tasks.rados.rados.0.smithi084.stdout:1219: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:04:43.629 INFO:tasks.rados.rados.0.smithi084.stdout:1221: finishing copy_from to smithi084102331-44 2024-01-13T18:04:43.629 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 408 (ObjNum 278 snap 87 seq_num 278) dirty exists 2024-01-13T18:04:43.629 INFO:tasks.rados.rados.0.smithi084.stdout:1221: finishing copy_from racing read to smithi084102331-44 2024-01-13T18:04:43.640 INFO:tasks.rados.rados.0.smithi084.stdout:1219: done (2 left) 2024-01-13T18:04:43.640 INFO:tasks.rados.rados.0.smithi084.stdout:1221: done (1 left) 2024-01-13T18:04:43.641 INFO:tasks.rados.rados.0.smithi084.stdout:1222: done (0 left) 2024-01-13T18:04:43.641 INFO:tasks.rados.rados.0.smithi084.stdout:1223: rollback oid 44 current snap is 123 2024-01-13T18:04:43.641 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 109 2024-01-13T18:04:43.641 INFO:tasks.rados.rados.0.smithi084.stdout:1224: read oid 11 snap -1 2024-01-13T18:04:43.641 INFO:tasks.rados.rados.0.smithi084.stdout:1224: expect deleted 2024-01-13T18:04:43.641 INFO:tasks.rados.rados.0.smithi084.stdout:1225: snap_remove snap 102 2024-01-13T18:04:43.667 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:04:43.572+0000 7fcaf82a4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-01-13T18:04:43.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: failed to encode map e303 with expected crc 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: failed to encode map e303 with expected crc 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:04:43.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[116404]: osdmap e304: 8 total, 8 up, 8 in 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: failed to encode map e303 with expected crc 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: failed to encode map e303 with expected crc 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:04:43.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:43 smithi084 ceph-mon[119097]: osdmap e304: 8 total, 8 up, 8 in 2024-01-13T18:04:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: failed to encode map e303 with expected crc 2024-01-13T18:04:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: failed to encode map e303 with expected crc 2024-01-13T18:04:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:04:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:04:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:04:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:04:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:43 smithi099 ceph-mon[138788]: osdmap e304: 8 total, 8 up, 8 in 2024-01-13T18:04:44.603 INFO:tasks.rados.rados.0.smithi084.stdout:1225: done (2 left) 2024-01-13T18:04:44.603 INFO:tasks.rados.rados.0.smithi084.stdout:1226: delete oid 43 current snap is 123 2024-01-13T18:04:44.603 INFO:tasks.rados.rados.0.smithi084.stdout:1223: finishing rollback tid 0 to smithi084102331-44 2024-01-13T18:04:44.603 INFO:tasks.rados.rados.0.smithi084.stdout:1223: finishing rollback tid 1 to smithi084102331-44 2024-01-13T18:04:44.603 INFO:tasks.rados.rados.0.smithi084.stdout:1223: finishing rollback tid 2 to smithi084102331-44 2024-01-13T18:04:44.603 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 560 (ObjNum 314 snap 98 seq_num 314) dirty exists 2024-01-13T18:04:44.616 INFO:tasks.rados.rados.0.smithi084.stdout:1223: done (2 left) 2024-01-13T18:04:44.616 INFO:tasks.rados.rados.0.smithi084.stdout:1224: done (1 left) 2024-01-13T18:04:44.616 INFO:tasks.rados.rados.0.smithi084.stdout:1226: done (0 left) 2024-01-13T18:04:44.616 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 123 2024-01-13T18:04:44.616 INFO:tasks.rados.rados.0.smithi084.stdout:1227: seq_num 384 ranges {5275648=434176,5709824=475136,6184960=630784,6815744=98304} 2024-01-13T18:04:44.644 INFO:tasks.rados.rados.0.smithi084.stdout:1227: writing smithi084102331-19 from 5275648 to 5709824 tid 1 2024-01-13T18:04:44.647 INFO:tasks.rados.rados.0.smithi084.stdout:1227: writing smithi084102331-19 from 5709824 to 6184960 tid 2 2024-01-13T18:04:44.650 INFO:tasks.rados.rados.0.smithi084.stdout:1227: writing smithi084102331-19 from 6184960 to 6815744 tid 3 2024-01-13T18:04:44.651 INFO:tasks.rados.rados.0.smithi084.stdout:1227: writing smithi084102331-19 from 6815744 to 6914048 tid 4 2024-01-13T18:04:44.651 INFO:tasks.rados.rados.0.smithi084.stdout:1228: snap_create 2024-01-13T18:04:44.651 INFO:tasks.rados.rados.0.smithi084.stdout:1227: finishing write tid 1 to smithi084102331-19 2024-01-13T18:04:44.651 INFO:tasks.rados.rados.0.smithi084.stdout:1227: finishing write tid 2 to smithi084102331-19 2024-01-13T18:04:44.654 INFO:tasks.rados.rados.0.smithi084.stdout:1227: finishing write tid 3 to smithi084102331-19 2024-01-13T18:04:44.654 INFO:tasks.rados.rados.0.smithi084.stdout:1227: finishing write tid 4 to smithi084102331-19 2024-01-13T18:04:44.654 INFO:tasks.rados.rados.0.smithi084.stdout:1227: finishing write tid 5 to smithi084102331-19 2024-01-13T18:04:44.656 INFO:tasks.rados.rados.0.smithi084.stdout:1227: finishing write tid 6 to smithi084102331-19 2024-01-13T18:04:44.656 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 424 (ObjNum 384 snap 123 seq_num 384) dirty exists 2024-01-13T18:04:44.656 INFO:tasks.rados.rados.0.smithi084.stdout:1227: left oid 19 (ObjNum 384 snap 123 seq_num 384) 2024-01-13T18:04:44.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: pgmap v167: 121 pgs: 2 activating, 9 active+undersized+degraded, 22 active+undersized, 88 active+clean; 287 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 6 op/s; 57/570 objects degraded (10.000%) 2024-01-13T18:04:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[116404]: osdmap e305: 8 total, 8 up, 8 in 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: failed to encode map e304 with expected crc 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: pgmap v167: 121 pgs: 2 activating, 9 active+undersized+degraded, 22 active+undersized, 88 active+clean; 287 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 6 op/s; 57/570 objects degraded (10.000%) 2024-01-13T18:04:44.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:44 smithi084 ceph-mon[119097]: osdmap e305: 8 total, 8 up, 8 in 2024-01-13T18:04:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:04:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-01-13T18:04:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: failed to encode map e304 with expected crc 2024-01-13T18:04:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: failed to encode map e304 with expected crc 2024-01-13T18:04:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: failed to encode map e304 with expected crc 2024-01-13T18:04:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: failed to encode map e304 with expected crc 2024-01-13T18:04:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: failed to encode map e304 with expected crc 2024-01-13T18:04:45.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: failed to encode map e304 with expected crc 2024-01-13T18:04:45.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: failed to encode map e304 with expected crc 2024-01-13T18:04:45.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: failed to encode map e304 with expected crc 2024-01-13T18:04:45.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: failed to encode map e304 with expected crc 2024-01-13T18:04:45.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: pgmap v167: 121 pgs: 2 activating, 9 active+undersized+degraded, 22 active+undersized, 88 active+clean; 287 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 6 op/s; 57/570 objects degraded (10.000%) 2024-01-13T18:04:45.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:44 smithi099 ceph-mon[138788]: osdmap e305: 8 total, 8 up, 8 in 2024-01-13T18:04:45.604 INFO:tasks.rados.rados.0.smithi084.stdout:1227: done (1 left) 2024-01-13T18:04:45.604 INFO:tasks.rados.rados.0.smithi084.stdout:1228: done (0 left) 2024-01-13T18:04:45.604 INFO:tasks.rados.rados.0.smithi084.stdout:1229: snap_create 2024-01-13T18:04:45.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:45 smithi084 ceph-mon[116404]: failed to encode map e305 with expected crc 2024-01-13T18:04:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:45 smithi084 ceph-mon[116404]: failed to encode map e305 with expected crc 2024-01-13T18:04:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:45 smithi084 ceph-mon[116404]: failed to encode map e305 with expected crc 2024-01-13T18:04:45.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:45 smithi084 ceph-mon[116404]: osdmap e306: 8 total, 8 up, 8 in 2024-01-13T18:04:45.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:45 smithi084 ceph-mon[119097]: failed to encode map e305 with expected crc 2024-01-13T18:04:45.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:45 smithi084 ceph-mon[119097]: failed to encode map e305 with expected crc 2024-01-13T18:04:45.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:45 smithi084 ceph-mon[119097]: failed to encode map e305 with expected crc 2024-01-13T18:04:45.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:45 smithi084 ceph-mon[119097]: osdmap e306: 8 total, 8 up, 8 in 2024-01-13T18:04:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:45 smithi099 ceph-mon[138788]: failed to encode map e305 with expected crc 2024-01-13T18:04:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:45 smithi099 ceph-mon[138788]: failed to encode map e305 with expected crc 2024-01-13T18:04:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:45 smithi099 ceph-mon[138788]: failed to encode map e305 with expected crc 2024-01-13T18:04:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:45 smithi099 ceph-mon[138788]: osdmap e306: 8 total, 8 up, 8 in 2024-01-13T18:04:46.604 INFO:tasks.rados.rados.0.smithi084.stdout:1229: done (0 left) 2024-01-13T18:04:46.604 INFO:tasks.rados.rados.0.smithi084.stdout:1230: rollback oid 44 current snap is 125 2024-01-13T18:04:46.604 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 117 2024-01-13T18:04:46.604 INFO:tasks.rados.rados.0.smithi084.stdout:1231: read oid 36 snap -1 2024-01-13T18:04:46.604 INFO:tasks.rados.rados.0.smithi084.stdout:1231: expect (ObjNum 327 snap 103 seq_num 327) 2024-01-13T18:04:46.604 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 125 2024-01-13T18:04:46.604 INFO:tasks.rados.rados.0.smithi084.stdout:1232: seq_num 385 ranges {8544256=450560,8994816=761856,9756672=442368} 2024-01-13T18:04:46.651 INFO:tasks.rados.rados.0.smithi084.stdout:1232: writing smithi084102331-1 from 8544256 to 8994816 tid 1 2024-01-13T18:04:46.655 INFO:tasks.rados.rados.0.smithi084.stdout:1232: writing smithi084102331-1 from 8994816 to 9756672 tid 2 2024-01-13T18:04:46.659 INFO:tasks.rados.rados.0.smithi084.stdout:1232: writing smithi084102331-1 from 9756672 to 10199040 tid 3 2024-01-13T18:04:46.659 INFO:tasks.rados.rados.0.smithi084.stdout:1233: delete oid 50 current snap is 125 2024-01-13T18:04:46.659 INFO:tasks.rados.rados.0.smithi084.stdout:1230: finishing rollback tid 0 to smithi084102331-44 2024-01-13T18:04:46.659 INFO:tasks.rados.rados.0.smithi084.stdout:1230: finishing rollback tid 1 to smithi084102331-44 2024-01-13T18:04:46.659 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 569 (ObjNum 1985 snap 0 seq_num 4038715392) dirty dne 2024-01-13T18:04:46.659 INFO:tasks.rados.rados.0.smithi084.stdout:1231: expect (ObjNum 327 snap 103 seq_num 327) 2024-01-13T18:04:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:1232: finishing write tid 1 to smithi084102331-1 2024-01-13T18:04:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:1230: done (3 left) 2024-01-13T18:04:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:1231: done (2 left) 2024-01-13T18:04:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:1233: done (1 left) 2024-01-13T18:04:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:1234: read oid 48 snap -1 2024-01-13T18:04:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:1234: expect (ObjNum 363 snap 116 seq_num 363) 2024-01-13T18:04:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 125 2024-01-13T18:04:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:1232: finishing write tid 2 to smithi084102331-1 2024-01-13T18:04:46.694 INFO:tasks.rados.rados.0.smithi084.stdout:1232: finishing write tid 3 to smithi084102331-1 2024-01-13T18:04:46.694 INFO:tasks.rados.rados.0.smithi084.stdout:1232: finishing write tid 4 to smithi084102331-1 2024-01-13T18:04:46.694 INFO:tasks.rados.rados.0.smithi084.stdout:1232: finishing write tid 5 to smithi084102331-1 2024-01-13T18:04:46.694 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 618 (ObjNum 385 snap 125 seq_num 385) dirty exists 2024-01-13T18:04:46.694 INFO:tasks.rados.rados.0.smithi084.stdout:1232: left oid 1 (ObjNum 385 snap 125 seq_num 385) 2024-01-13T18:04:46.694 INFO:tasks.rados.rados.0.smithi084.stdout:1235: seq_num 387 ranges {0=483328,483328=524288,1007616=679936} 2024-01-13T18:04:46.695 INFO:tasks.rados.rados.0.smithi084.stdout:1235: writing smithi084102331-6 from 0 to 483328 tid 1 2024-01-13T18:04:46.698 INFO:tasks.rados.rados.0.smithi084.stdout:1235: writing smithi084102331-6 from 483328 to 1007616 tid 2 2024-01-13T18:04:46.703 INFO:tasks.rados.rados.0.smithi084.stdout:1235: writing smithi084102331-6 from 1007616 to 1687552 tid 3 2024-01-13T18:04:46.703 INFO:tasks.rados.rados.0.smithi084.stdout:1232: done (2 left) 2024-01-13T18:04:46.703 INFO:tasks.rados.rados.0.smithi084.stdout:1236: snap_create 2024-01-13T18:04:46.703 INFO:tasks.rados.rados.0.smithi084.stdout:1235: finishing write tid 1 to smithi084102331-6 2024-01-13T18:04:46.703 INFO:tasks.rados.rados.0.smithi084.stdout:1235: finishing write tid 2 to smithi084102331-6 2024-01-13T18:04:46.703 INFO:tasks.rados.rados.0.smithi084.stdout:1234: expect (ObjNum 363 snap 116 seq_num 363) 2024-01-13T18:04:46.773 INFO:tasks.rados.rados.0.smithi084.stdout:1235: finishing write tid 3 to smithi084102331-6 2024-01-13T18:04:46.773 INFO:tasks.rados.rados.0.smithi084.stdout:1235: finishing write tid 4 to smithi084102331-6 2024-01-13T18:04:46.773 INFO:tasks.rados.rados.0.smithi084.stdout:1235: finishing write tid 5 to smithi084102331-6 2024-01-13T18:04:46.773 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 383 (ObjNum 387 snap 125 seq_num 387) dirty exists 2024-01-13T18:04:46.774 INFO:tasks.rados.rados.0.smithi084.stdout:1235: left oid 6 (ObjNum 387 snap 125 seq_num 387) 2024-01-13T18:04:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:46 smithi099 ceph-mon[138788]: failed to encode map e306 with expected crc 2024-01-13T18:04:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:46 smithi099 ceph-mon[138788]: failed to encode map e306 with expected crc 2024-01-13T18:04:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:46 smithi099 ceph-mon[138788]: pgmap v170: 121 pgs: 2 activating, 7 active+undersized+degraded, 9 active+undersized, 103 active+clean; 291 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.7 MiB/s wr, 8 op/s; 55/570 objects degraded (9.649%) 2024-01-13T18:04:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:46 smithi099 ceph-mon[138788]: osdmap e307: 8 total, 8 up, 8 in 2024-01-13T18:04:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:46 smithi084 ceph-mon[116404]: failed to encode map e306 with expected crc 2024-01-13T18:04:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:46 smithi084 ceph-mon[116404]: failed to encode map e306 with expected crc 2024-01-13T18:04:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:46 smithi084 ceph-mon[116404]: pgmap v170: 121 pgs: 2 activating, 7 active+undersized+degraded, 9 active+undersized, 103 active+clean; 291 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.7 MiB/s wr, 8 op/s; 55/570 objects degraded (9.649%) 2024-01-13T18:04:47.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:46 smithi084 ceph-mon[116404]: osdmap e307: 8 total, 8 up, 8 in 2024-01-13T18:04:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:46 smithi084 ceph-mon[119097]: failed to encode map e306 with expected crc 2024-01-13T18:04:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:46 smithi084 ceph-mon[119097]: failed to encode map e306 with expected crc 2024-01-13T18:04:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:46 smithi084 ceph-mon[119097]: pgmap v170: 121 pgs: 2 activating, 7 active+undersized+degraded, 9 active+undersized, 103 active+clean; 291 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.7 MiB/s wr, 8 op/s; 55/570 objects degraded (9.649%) 2024-01-13T18:04:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:46 smithi084 ceph-mon[119097]: osdmap e307: 8 total, 8 up, 8 in 2024-01-13T18:04:47.696 INFO:tasks.rados.rados.0.smithi084.stdout:1234: done (2 left) 2024-01-13T18:04:47.697 INFO:tasks.rados.rados.0.smithi084.stdout:1235: done (1 left) 2024-01-13T18:04:47.697 INFO:tasks.rados.rados.0.smithi084.stdout:1236: done (0 left) 2024-01-13T18:04:47.697 INFO:tasks.rados.rados.0.smithi084.stdout:1237: read oid 49 snap -1 2024-01-13T18:04:47.697 INFO:tasks.rados.rados.0.smithi084.stdout:1237: expect (ObjNum 319 snap 101 seq_num 319) 2024-01-13T18:04:47.697 INFO:tasks.rados.rados.0.smithi084.stdout:1238: read oid 22 snap -1 2024-01-13T18:04:47.697 INFO:tasks.rados.rados.0.smithi084.stdout:1238: expect (ObjNum 328 snap 103 seq_num 328) 2024-01-13T18:04:47.697 INFO:tasks.rados.rados.0.smithi084.stdout:1239: delete oid 7 current snap is 126 2024-01-13T18:04:47.702 INFO:tasks.rados.rados.0.smithi084.stdout:1239: done (2 left) 2024-01-13T18:04:47.702 INFO:tasks.rados.rados.0.smithi084.stdout:1240: delete oid 19 current snap is 126 2024-01-13T18:04:47.703 INFO:tasks.rados.rados.0.smithi084.stdout:1237: expect (ObjNum 319 snap 101 seq_num 319) 2024-01-13T18:04:47.721 INFO:tasks.rados.rados.0.smithi084.stdout:1237: done (2 left) 2024-01-13T18:04:47.721 INFO:tasks.rados.rados.0.smithi084.stdout:1240: done (1 left) 2024-01-13T18:04:47.721 INFO:tasks.rados.rados.0.smithi084.stdout:1241: read oid 9 snap -1 2024-01-13T18:04:47.721 INFO:tasks.rados.rados.0.smithi084.stdout:1241: expect (ObjNum 341 snap 107 seq_num 341) 2024-01-13T18:04:47.722 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 126 2024-01-13T18:04:47.722 INFO:tasks.rados.rados.0.smithi084.stdout:1242: seq_num 390 ranges {0=540672,540672=630784,1171456=573440} 2024-01-13T18:04:47.724 INFO:tasks.rados.rados.0.smithi084.stdout:1242: writing smithi084102331-50 from 0 to 540672 tid 1 2024-01-13T18:04:47.728 INFO:tasks.rados.rados.0.smithi084.stdout:1242: writing smithi084102331-50 from 540672 to 1171456 tid 2 2024-01-13T18:04:47.732 INFO:tasks.rados.rados.0.smithi084.stdout:1242: writing smithi084102331-50 from 1171456 to 1744896 tid 3 2024-01-13T18:04:47.732 INFO:tasks.rados.rados.0.smithi084.stdout:1243: rmattr oid 45 current snap is 126 2024-01-13T18:04:47.732 INFO:tasks.rados.rados.0.smithi084.stdout:1241: expect (ObjNum 341 snap 107 seq_num 341) 2024-01-13T18:04:47.756 INFO:tasks.rados.rados.0.smithi084.stdout:1238: expect (ObjNum 328 snap 103 seq_num 328) 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:1242: finishing write tid 1 to smithi084102331-50 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:1242: finishing write tid 2 to smithi084102331-50 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 620 (ObjNum 306 snap 95 seq_num 306) dirty exists 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:1242: finishing write tid 3 to smithi084102331-50 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:1238: done (3 left) 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:1241: done (2 left) 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:1243: done (1 left) 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 126 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:1242: finishing write tid 4 to smithi084102331-50 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:1242: finishing write tid 5 to smithi084102331-50 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 542 (ObjNum 390 snap 126 seq_num 390) dirty exists 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:1242: left oid 50 (ObjNum 390 snap 126 seq_num 390) 2024-01-13T18:04:48.097 INFO:tasks.rados.rados.0.smithi084.stdout:1244: seq_num 391 ranges {5308416=557056,5865472=516096,6381568=688128} 2024-01-13T18:04:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:47 smithi099 ceph-mon[138788]: failed to encode map e307 with expected crc 2024-01-13T18:04:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:47 smithi099 ceph-mon[138788]: failed to encode map e306 with expected crc 2024-01-13T18:04:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:47 smithi099 ceph-mon[138788]: failed to encode map e307 with expected crc 2024-01-13T18:04:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:47 smithi099 ceph-mon[138788]: failed to encode map e307 with expected crc 2024-01-13T18:04:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:47 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 55/570 objects degraded (9.649%), 7 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:48.126 INFO:tasks.rados.rados.0.smithi084.stdout:1244: writing smithi084102331-32 from 5308416 to 5865472 tid 1 2024-01-13T18:04:48.129 INFO:tasks.rados.rados.0.smithi084.stdout:1244: writing smithi084102331-32 from 5865472 to 6381568 tid 2 2024-01-13T18:04:48.134 INFO:tasks.rados.rados.0.smithi084.stdout:1244: writing smithi084102331-32 from 6381568 to 7069696 tid 3 2024-01-13T18:04:48.134 INFO:tasks.rados.rados.0.smithi084.stdout:1242: done (1 left) 2024-01-13T18:04:48.134 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 126 2024-01-13T18:04:48.134 INFO:tasks.rados.rados.0.smithi084.stdout:1244: finishing write tid 1 to smithi084102331-32 2024-01-13T18:04:48.134 INFO:tasks.rados.rados.0.smithi084.stdout:1244: finishing write tid 2 to smithi084102331-32 2024-01-13T18:04:48.135 INFO:tasks.rados.rados.0.smithi084.stdout:1245: seq_num 392 ranges {0=573440,573440=802816,1376256=401408} 2024-01-13T18:04:48.137 INFO:tasks.rados.rados.0.smithi084.stdout:1245: writing smithi084102331-38 from 0 to 573440 tid 1 2024-01-13T18:04:48.141 INFO:tasks.rados.rados.0.smithi084.stdout:1245: writing smithi084102331-38 from 573440 to 1376256 tid 2 2024-01-13T18:04:48.144 INFO:tasks.rados.rados.0.smithi084.stdout:1245: writing smithi084102331-38 from 1376256 to 1777664 tid 3 2024-01-13T18:04:48.144 INFO:tasks.rados.rados.0.smithi084.stdout:1246: snap_remove snap 123 2024-01-13T18:04:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:47 smithi084 ceph-mon[116404]: failed to encode map e307 with expected crc 2024-01-13T18:04:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:47 smithi084 ceph-mon[116404]: failed to encode map e306 with expected crc 2024-01-13T18:04:48.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:47 smithi084 ceph-mon[116404]: failed to encode map e307 with expected crc 2024-01-13T18:04:48.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:47 smithi084 ceph-mon[116404]: failed to encode map e307 with expected crc 2024-01-13T18:04:48.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:47 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 55/570 objects degraded (9.649%), 7 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:47 smithi084 ceph-mon[119097]: failed to encode map e307 with expected crc 2024-01-13T18:04:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:47 smithi084 ceph-mon[119097]: failed to encode map e306 with expected crc 2024-01-13T18:04:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:47 smithi084 ceph-mon[119097]: failed to encode map e307 with expected crc 2024-01-13T18:04:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:47 smithi084 ceph-mon[119097]: failed to encode map e307 with expected crc 2024-01-13T18:04:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:47 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 55/570 objects degraded (9.649%), 7 pgs degraded (PG_DEGRADED) 2024-01-13T18:04:48.701 INFO:tasks.rados.rados.0.smithi084.stdout:1246: done (2 left) 2024-01-13T18:04:48.702 INFO:tasks.rados.rados.0.smithi084.stdout:1247: snap_remove snap 74 2024-01-13T18:04:49.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:04:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:04:48.660Z caller=alerting.go:366 level=warn component="rule manager" alert="unsupported value type" msg="Expanding alert template failed" err="error executing template __alert_CephOSDDown: template: __alert_CephOSDDown:1:358: executing \"__alert_CephOSDDown\" at : error calling query: found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" data="unsupported value type" 2024-01-13T18:04:49.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:04:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:04:48.661Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:04:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:48 smithi099 ceph-mon[138788]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:48 smithi099 ceph-mon[138788]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:48 smithi099 ceph-mon[138788]: osdmap e308: 8 total, 8 up, 8 in 2024-01-13T18:04:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:48 smithi099 ceph-mon[138788]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:48 smithi099 ceph-mon[138788]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:48 smithi099 ceph-mon[138788]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:48 smithi099 ceph-mon[138788]: pgmap v173: 121 pgs: 2 activating, 119 active+clean; 294 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 10 op/s; 12 MiB/s, 2 objects/s recovering 2024-01-13T18:04:49.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[116404]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[116404]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[116404]: osdmap e308: 8 total, 8 up, 8 in 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[116404]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[116404]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[116404]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[116404]: pgmap v173: 121 pgs: 2 activating, 119 active+clean; 294 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 10 op/s; 12 MiB/s, 2 objects/s recovering 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[119097]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[119097]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[119097]: osdmap e308: 8 total, 8 up, 8 in 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[119097]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[119097]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[119097]: failed to encode map e308 with expected crc 2024-01-13T18:04:49.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:48 smithi084 ceph-mon[119097]: pgmap v173: 121 pgs: 2 activating, 119 active+clean; 294 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 10 op/s; 12 MiB/s, 2 objects/s recovering 2024-01-13T18:04:49.710 INFO:tasks.rados.rados.0.smithi084.stdout:1247: done (2 left) 2024-01-13T18:04:49.710 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 126 2024-01-13T18:04:49.711 INFO:tasks.rados.rados.0.smithi084.stdout:1244: finishing write tid 3 to smithi084102331-32 2024-01-13T18:04:49.711 INFO:tasks.rados.rados.0.smithi084.stdout:1248: seq_num 393 ranges {0=589824,589824=679936,1269760=524288} 2024-01-13T18:04:49.721 INFO:tasks.rados.rados.0.smithi084.stdout:1248: writing smithi084102331-43 from 0 to 589824 tid 1 2024-01-13T18:04:49.721 INFO:tasks.rados.rados.0.smithi084.stdout:1248: writing smithi084102331-43 from 589824 to 1269760 tid 2 2024-01-13T18:04:49.721 INFO:tasks.rados.rados.0.smithi084.stdout:1248: writing smithi084102331-43 from 1269760 to 1794048 tid 3 2024-01-13T18:04:49.722 INFO:tasks.rados.rados.0.smithi084.stdout:1249: read oid 27 snap 111 2024-01-13T18:04:49.723 INFO:tasks.rados.rados.0.smithi084.stdout:1249: expect (ObjNum 342 snap 107 seq_num 342) 2024-01-13T18:04:49.723 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 126 2024-01-13T18:04:49.723 INFO:tasks.rados.rados.0.smithi084.stdout:1250: seq_num 394 ranges {0=606208,606208=565248,1171456=557056,1728512=81920} 2024-01-13T18:04:49.725 INFO:tasks.rados.rados.0.smithi084.stdout:1250: writing smithi084102331-44 from 0 to 606208 tid 1 2024-01-13T18:04:49.736 INFO:tasks.rados.rados.0.smithi084.stdout:1250: writing smithi084102331-44 from 606208 to 1171456 tid 2 2024-01-13T18:04:49.737 INFO:tasks.rados.rados.0.smithi084.stdout:1250: writing smithi084102331-44 from 1171456 to 1728512 tid 3 2024-01-13T18:04:49.737 INFO:tasks.rados.rados.0.smithi084.stdout:1250: writing smithi084102331-44 from 1728512 to 1810432 tid 4 2024-01-13T18:04:49.737 INFO:tasks.rados.rados.0.smithi084.stdout:1251: read oid 6 snap -1 2024-01-13T18:04:49.737 INFO:tasks.rados.rados.0.smithi084.stdout:1251: expect (ObjNum 387 snap 125 seq_num 387) 2024-01-13T18:04:49.737 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 126 2024-01-13T18:04:49.737 INFO:tasks.rados.rados.0.smithi084.stdout:1252: seq_num 395 ranges {1425408=622592,2048000=450560,2498560=753664} 2024-01-13T18:04:49.746 INFO:tasks.rados.rados.0.smithi084.stdout:1252: writing smithi084102331-31 from 1425408 to 2048000 tid 1 2024-01-13T18:04:49.749 INFO:tasks.rados.rados.0.smithi084.stdout:1252: writing smithi084102331-31 from 2048000 to 2498560 tid 2 2024-01-13T18:04:49.755 INFO:tasks.rados.rados.0.smithi084.stdout:1252: writing smithi084102331-31 from 2498560 to 3252224 tid 3 2024-01-13T18:04:49.755 INFO:tasks.rados.rados.0.smithi084.stdout:1253: rollback oid 2 current snap is 126 2024-01-13T18:04:49.755 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 105 2024-01-13T18:04:49.755 INFO:tasks.rados.rados.0.smithi084.stdout:1244: finishing write tid 4 to smithi084102331-32 2024-01-13T18:04:49.755 INFO:tasks.rados.rados.0.smithi084.stdout:1244: finishing write tid 5 to smithi084102331-32 2024-01-13T18:04:49.755 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 574 (ObjNum 391 snap 126 seq_num 391) dirty exists 2024-01-13T18:04:49.755 INFO:tasks.rados.rados.0.smithi084.stdout:1244: left oid 32 (ObjNum 391 snap 126 seq_num 391) 2024-01-13T18:04:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:1245: finishing write tid 1 to smithi084102331-38 2024-01-13T18:04:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:1244: done (7 left) 2024-01-13T18:04:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:1254: copy_from oid 50 from oid 21 current snap is 126 2024-01-13T18:04:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:1245: finishing write tid 2 to smithi084102331-38 2024-01-13T18:04:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:1245: finishing write tid 3 to smithi084102331-38 2024-01-13T18:04:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:1245: finishing write tid 4 to smithi084102331-38 2024-01-13T18:04:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:1245: finishing write tid 5 to smithi084102331-38 2024-01-13T18:04:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 624 (ObjNum 392 snap 126 seq_num 392) dirty exists 2024-01-13T18:04:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:1245: left oid 38 (ObjNum 392 snap 126 seq_num 392) 2024-01-13T18:04:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:1245: done (7 left) 2024-01-13T18:04:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:1255: snap_remove snap 109 2024-01-13T18:04:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:49 smithi099 ceph-mon[138788]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/570 objects degraded (9.649%), 7 pgs degraded) 2024-01-13T18:04:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:49 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:04:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:49 smithi099 ceph-mon[138788]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:49 smithi099 ceph-mon[138788]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:49 smithi099 ceph-mon[138788]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:49 smithi099 ceph-mon[138788]: osdmap e309: 8 total, 8 up, 8 in 2024-01-13T18:04:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:49 smithi099 ceph-mon[138788]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[116404]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/570 objects degraded (9.649%), 7 pgs degraded) 2024-01-13T18:04:50.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:04:50.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[116404]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[116404]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[116404]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[116404]: osdmap e309: 8 total, 8 up, 8 in 2024-01-13T18:04:50.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[116404]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[119097]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/570 objects degraded (9.649%), 7 pgs degraded) 2024-01-13T18:04:50.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:04:50.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[119097]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[119097]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[119097]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[119097]: osdmap e309: 8 total, 8 up, 8 in 2024-01-13T18:04:50.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:49 smithi084 ceph-mon[119097]: failed to encode map e309 with expected crc 2024-01-13T18:04:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:04:50] "GET /metrics HTTP/1.1" 200 36141 "" "Prometheus/2.43.0" 2024-01-13T18:04:50.717 INFO:tasks.rados.rados.0.smithi084.stdout:1255: done (7 left) 2024-01-13T18:04:50.718 INFO:tasks.rados.rados.0.smithi084.stdout:1256: snap_remove snap 118 2024-01-13T18:04:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:50 smithi099 ceph-mon[138788]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:50 smithi099 ceph-mon[138788]: osdmap e310: 8 total, 8 up, 8 in 2024-01-13T18:04:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:50 smithi099 ceph-mon[138788]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:50 smithi099 ceph-mon[138788]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:50 smithi099 ceph-mon[138788]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:50 smithi099 ceph-mon[138788]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:50 smithi099 ceph-mon[138788]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:50 smithi099 ceph-mon[138788]: pgmap v176: 121 pgs: 121 active+clean; 294 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 784 KiB/s wr, 2 op/s; 12 MiB/s, 2 objects/s recovering 2024-01-13T18:04:51.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:51.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[116404]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[116404]: osdmap e310: 8 total, 8 up, 8 in 2024-01-13T18:04:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[116404]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[116404]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[116404]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[116404]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[116404]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[116404]: pgmap v176: 121 pgs: 121 active+clean; 294 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 784 KiB/s wr, 2 op/s; 12 MiB/s, 2 objects/s recovering 2024-01-13T18:04:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:51.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:51.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[119097]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[119097]: osdmap e310: 8 total, 8 up, 8 in 2024-01-13T18:04:51.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[119097]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[119097]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[119097]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[119097]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[119097]: failed to encode map e310 with expected crc 2024-01-13T18:04:51.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[119097]: pgmap v176: 121 pgs: 121 active+clean; 294 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 784 KiB/s wr, 2 op/s; 12 MiB/s, 2 objects/s recovering 2024-01-13T18:04:51.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:51.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:04:51.716 INFO:tasks.rados.rados.0.smithi084.stdout:1256: done (7 left) 2024-01-13T18:04:51.716 INFO:tasks.rados.rados.0.smithi084.stdout:1257: snap_create 2024-01-13T18:04:51.716 INFO:tasks.rados.rados.0.smithi084.stdout:1250: finishing write tid 1 to smithi084102331-44 2024-01-13T18:04:51.716 INFO:tasks.rados.rados.0.smithi084.stdout:1248: finishing write tid 1 to smithi084102331-43 2024-01-13T18:04:51.716 INFO:tasks.rados.rados.0.smithi084.stdout:1248: finishing write tid 2 to smithi084102331-43 2024-01-13T18:04:51.716 INFO:tasks.rados.rados.0.smithi084.stdout:1248: finishing write tid 3 to smithi084102331-43 2024-01-13T18:04:51.716 INFO:tasks.rados.rados.0.smithi084.stdout:1248: finishing write tid 4 to smithi084102331-43 2024-01-13T18:04:51.716 INFO:tasks.rados.rados.0.smithi084.stdout:1248: finishing write tid 5 to smithi084102331-43 2024-01-13T18:04:51.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 335 (ObjNum 393 snap 126 seq_num 393) dirty exists 2024-01-13T18:04:51.716 INFO:tasks.rados.rados.0.smithi084.stdout:1248: left oid 43 (ObjNum 393 snap 126 seq_num 393) 2024-01-13T18:04:51.717 INFO:tasks.rados.rados.0.smithi084.stdout:1250: finishing write tid 2 to smithi084102331-44 2024-01-13T18:04:51.717 INFO:tasks.rados.rados.0.smithi084.stdout:1250: finishing write tid 3 to smithi084102331-44 2024-01-13T18:04:51.717 INFO:tasks.rados.rados.0.smithi084.stdout:1250: finishing write tid 4 to smithi084102331-44 2024-01-13T18:04:51.717 INFO:tasks.rados.rados.0.smithi084.stdout:1250: finishing write tid 5 to smithi084102331-44 2024-01-13T18:04:51.717 INFO:tasks.rados.rados.0.smithi084.stdout:1250: finishing write tid 6 to smithi084102331-44 2024-01-13T18:04:51.717 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 589 (ObjNum 394 snap 126 seq_num 394) dirty exists 2024-01-13T18:04:51.717 INFO:tasks.rados.rados.0.smithi084.stdout:1250: left oid 44 (ObjNum 394 snap 126 seq_num 394) 2024-01-13T18:04:51.717 INFO:tasks.rados.rados.0.smithi084.stdout:1251: expect (ObjNum 387 snap 125 seq_num 387) 2024-01-13T18:04:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:1253: finishing rollback tid 0 to smithi084102331-2 2024-01-13T18:04:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:1253: finishing rollback tid 1 to smithi084102331-2 2024-01-13T18:04:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:1253: finishing rollback tid 2 to smithi084102331-2 2024-01-13T18:04:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 532 (ObjNum 266 snap 83 seq_num 266) dirty exists 2024-01-13T18:04:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:1252: finishing write tid 1 to smithi084102331-31 2024-01-13T18:04:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:1252: finishing write tid 2 to smithi084102331-31 2024-01-13T18:04:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:1252: finishing write tid 3 to smithi084102331-31 2024-01-13T18:04:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:1252: finishing write tid 4 to smithi084102331-31 2024-01-13T18:04:51.760 INFO:tasks.rados.rados.0.smithi084.stdout:1249: expect (ObjNum 342 snap 107 seq_num 342) 2024-01-13T18:04:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:51 smithi099 ceph-mon[138788]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:51 smithi099 ceph-mon[138788]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:51 smithi099 ceph-mon[138788]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:51 smithi099 ceph-mon[138788]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:51 smithi099 ceph-mon[138788]: osdmap e311: 8 total, 8 up, 8 in 2024-01-13T18:04:52.152 INFO:tasks.rados.rados.0.smithi084.stdout:1252: finishing write tid 5 to smithi084102331-31 2024-01-13T18:04:52.152 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 637 (ObjNum 395 snap 126 seq_num 395) dirty exists 2024-01-13T18:04:52.152 INFO:tasks.rados.rados.0.smithi084.stdout:1252: left oid 31 (ObjNum 395 snap 126 seq_num 395) 2024-01-13T18:04:52.152 INFO:tasks.rados.rados.0.smithi084.stdout:1254: finishing copy_from to smithi084102331-50 2024-01-13T18:04:52.152 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 324 (ObjNum 266 snap 83 seq_num 266) dirty exists 2024-01-13T18:04:52.152 INFO:tasks.rados.rados.0.smithi084.stdout:1254: finishing copy_from racing read to smithi084102331-50 2024-01-13T18:04:52.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:51 smithi084 ceph-mon[119097]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:51 smithi084 ceph-mon[119097]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:51 smithi084 ceph-mon[119097]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:51 smithi084 ceph-mon[119097]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:51 smithi084 ceph-mon[119097]: osdmap e311: 8 total, 8 up, 8 in 2024-01-13T18:04:52.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:51 smithi084 ceph-mon[116404]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:51 smithi084 ceph-mon[116404]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:51 smithi084 ceph-mon[116404]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:51 smithi084 ceph-mon[116404]: failed to encode map e311 with expected crc 2024-01-13T18:04:52.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:51 smithi084 ceph-mon[116404]: osdmap e311: 8 total, 8 up, 8 in 2024-01-13T18:04:52.593 INFO:tasks.rados.rados.0.smithi084.stdout:1248: done (7 left) 2024-01-13T18:04:52.593 INFO:tasks.rados.rados.0.smithi084.stdout:1249: done (6 left) 2024-01-13T18:04:52.593 INFO:tasks.rados.rados.0.smithi084.stdout:1250: done (5 left) 2024-01-13T18:04:52.593 INFO:tasks.rados.rados.0.smithi084.stdout:1251: done (4 left) 2024-01-13T18:04:52.593 INFO:tasks.rados.rados.0.smithi084.stdout:1252: done (3 left) 2024-01-13T18:04:52.593 INFO:tasks.rados.rados.0.smithi084.stdout:1253: done (2 left) 2024-01-13T18:04:52.593 INFO:tasks.rados.rados.0.smithi084.stdout:1254: done (1 left) 2024-01-13T18:04:52.593 INFO:tasks.rados.rados.0.smithi084.stdout:1257: done (0 left) 2024-01-13T18:04:52.593 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 127 2024-01-13T18:04:52.593 INFO:tasks.rados.rados.0.smithi084.stdout:1258: seq_num 396 ranges {0=638976,638976=786432,1425408=417792} 2024-01-13T18:04:52.596 INFO:tasks.rados.rados.0.smithi084.stdout:1258: writing smithi084102331-11 from 0 to 638976 tid 1 2024-01-13T18:04:52.601 INFO:tasks.rados.rados.0.smithi084.stdout:1258: writing smithi084102331-11 from 638976 to 1425408 tid 2 2024-01-13T18:04:52.603 INFO:tasks.rados.rados.0.smithi084.stdout:1258: writing smithi084102331-11 from 1425408 to 1843200 tid 3 2024-01-13T18:04:52.603 INFO:tasks.rados.rados.0.smithi084.stdout:1259: rmattr oid 30 current snap is 127 2024-01-13T18:04:52.603 INFO:tasks.rados.rados.0.smithi084.stdout:1259: done (1 left) 2024-01-13T18:04:52.603 INFO:tasks.rados.rados.0.smithi084.stdout:1260: delete oid 19 current snap is 127 2024-01-13T18:04:52.607 INFO:tasks.rados.rados.0.smithi084.stdout:1258: finishing write tid 1 to smithi084102331-11 2024-01-13T18:04:52.611 INFO:tasks.rados.rados.0.smithi084.stdout:1260: done (1 left) 2024-01-13T18:04:52.612 INFO:tasks.rados.rados.0.smithi084.stdout:1261: rollback oid 30 current snap is 127 2024-01-13T18:04:52.612 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 111 2024-01-13T18:04:52.612 INFO:tasks.rados.rados.0.smithi084.stdout:1262: copy_from oid 23 from oid 17 current snap is 127 2024-01-13T18:04:52.612 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 127 2024-01-13T18:04:52.612 INFO:tasks.rados.rados.0.smithi084.stdout:1263: seq_num 398 ranges {8282112=671744,8953856=557056,9510912=532480,10043392=114688} 2024-01-13T18:04:52.656 INFO:tasks.rados.rados.0.smithi084.stdout:1263: writing smithi084102331-24 from 8282112 to 8953856 tid 1 2024-01-13T18:04:52.659 INFO:tasks.rados.rados.0.smithi084.stdout:1263: writing smithi084102331-24 from 8953856 to 9510912 tid 2 2024-01-13T18:04:52.662 INFO:tasks.rados.rados.0.smithi084.stdout:1263: writing smithi084102331-24 from 9510912 to 10043392 tid 3 2024-01-13T18:04:52.664 INFO:tasks.rados.rados.0.smithi084.stdout:1263: writing smithi084102331-24 from 10043392 to 10158080 tid 4 2024-01-13T18:04:52.664 INFO:tasks.rados.rados.0.smithi084.stdout:1258: finishing write tid 2 to smithi084102331-11 2024-01-13T18:04:52.664 INFO:tasks.rados.rados.0.smithi084.stdout:1264: read oid 34 snap 107 2024-01-13T18:04:52.664 INFO:tasks.rados.rados.0.smithi084.stdout:1264: expect (ObjNum 214 snap 61 seq_num 214) 2024-01-13T18:04:52.664 INFO:tasks.rados.rados.0.smithi084.stdout:1265: snap_create 2024-01-13T18:04:52.664 INFO:tasks.rados.rados.0.smithi084.stdout:1258: finishing write tid 3 to smithi084102331-11 2024-01-13T18:04:52.664 INFO:tasks.rados.rados.0.smithi084.stdout:1258: finishing write tid 4 to smithi084102331-11 2024-01-13T18:04:52.664 INFO:tasks.rados.rados.0.smithi084.stdout:1258: finishing write tid 5 to smithi084102331-11 2024-01-13T18:04:52.664 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 378 (ObjNum 396 snap 127 seq_num 396) dirty exists 2024-01-13T18:04:52.664 INFO:tasks.rados.rados.0.smithi084.stdout:1258: left oid 11 (ObjNum 396 snap 127 seq_num 396) 2024-01-13T18:04:52.664 INFO:tasks.rados.rados.0.smithi084.stdout:1261: finishing rollback tid 1 to smithi084102331-30 2024-01-13T18:04:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:1261: finishing rollback tid 2 to smithi084102331-30 2024-01-13T18:04:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 565 (ObjNum 251 snap 75 seq_num 251) dirty exists 2024-01-13T18:04:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:1262: finishing copy_from to smithi084102331-23 2024-01-13T18:04:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 281 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:04:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:1262: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:04:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:1263: finishing write tid 1 to smithi084102331-24 2024-01-13T18:04:52.665 INFO:tasks.rados.rados.0.smithi084.stdout:1263: finishing write tid 2 to smithi084102331-24 2024-01-13T18:04:52.666 INFO:tasks.rados.rados.0.smithi084.stdout:1263: finishing write tid 3 to smithi084102331-24 2024-01-13T18:04:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:1263: finishing write tid 4 to smithi084102331-24 2024-01-13T18:04:52.668 INFO:tasks.rados.rados.0.smithi084.stdout:1263: finishing write tid 5 to smithi084102331-24 2024-01-13T18:04:52.670 INFO:tasks.rados.rados.0.smithi084.stdout:1263: finishing write tid 6 to smithi084102331-24 2024-01-13T18:04:52.670 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 340 (ObjNum 398 snap 127 seq_num 398) dirty exists 2024-01-13T18:04:52.670 INFO:tasks.rados.rados.0.smithi084.stdout:1263: left oid 24 (ObjNum 398 snap 127 seq_num 398) 2024-01-13T18:04:52.675 INFO:tasks.rados.rados.0.smithi084.stdout:1264: expect (ObjNum 214 snap 61 seq_num 214) 2024-01-13T18:04:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:52 smithi099 ceph-mon[138788]: failed to encode map e312 with expected crc 2024-01-13T18:04:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:52 smithi099 ceph-mon[138788]: osdmap e312: 8 total, 8 up, 8 in 2024-01-13T18:04:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:52 smithi099 ceph-mon[138788]: failed to encode map e312 with expected crc 2024-01-13T18:04:53.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:52 smithi099 ceph-mon[138788]: failed to encode map e312 with expected crc 2024-01-13T18:04:53.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:52 smithi099 ceph-mon[138788]: pgmap v179: 121 pgs: 121 active+clean; 279 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 3.8 MiB/s wr, 20 op/s 2024-01-13T18:04:53.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:52 smithi099 ceph-mon[138788]: osdmap e313: 8 total, 8 up, 8 in 2024-01-13T18:04:53.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:52 smithi099 ceph-mon[138788]: failed to encode map e313 with expected crc 2024-01-13T18:04:53.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:52 smithi099 ceph-mon[138788]: failed to encode map e313 with expected crc 2024-01-13T18:04:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[116404]: failed to encode map e312 with expected crc 2024-01-13T18:04:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[116404]: osdmap e312: 8 total, 8 up, 8 in 2024-01-13T18:04:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[116404]: failed to encode map e312 with expected crc 2024-01-13T18:04:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[116404]: failed to encode map e312 with expected crc 2024-01-13T18:04:53.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[116404]: pgmap v179: 121 pgs: 121 active+clean; 279 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 3.8 MiB/s wr, 20 op/s 2024-01-13T18:04:53.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[116404]: osdmap e313: 8 total, 8 up, 8 in 2024-01-13T18:04:53.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[116404]: failed to encode map e313 with expected crc 2024-01-13T18:04:53.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[116404]: failed to encode map e313 with expected crc 2024-01-13T18:04:53.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[119097]: failed to encode map e312 with expected crc 2024-01-13T18:04:53.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[119097]: osdmap e312: 8 total, 8 up, 8 in 2024-01-13T18:04:53.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[119097]: failed to encode map e312 with expected crc 2024-01-13T18:04:53.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[119097]: failed to encode map e312 with expected crc 2024-01-13T18:04:53.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[119097]: pgmap v179: 121 pgs: 121 active+clean; 279 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 3.8 MiB/s wr, 20 op/s 2024-01-13T18:04:53.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[119097]: osdmap e313: 8 total, 8 up, 8 in 2024-01-13T18:04:53.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[119097]: failed to encode map e313 with expected crc 2024-01-13T18:04:53.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:52 smithi084 ceph-mon[119097]: failed to encode map e313 with expected crc 2024-01-13T18:04:53.602 INFO:tasks.rados.rados.0.smithi084.stdout:1258: done (5 left) 2024-01-13T18:04:53.602 INFO:tasks.rados.rados.0.smithi084.stdout:1261: done (4 left) 2024-01-13T18:04:53.602 INFO:tasks.rados.rados.0.smithi084.stdout:1262: done (3 left) 2024-01-13T18:04:53.602 INFO:tasks.rados.rados.0.smithi084.stdout:1263: done (2 left) 2024-01-13T18:04:53.602 INFO:tasks.rados.rados.0.smithi084.stdout:1264: done (1 left) 2024-01-13T18:04:53.602 INFO:tasks.rados.rados.0.smithi084.stdout:1265: done (0 left) 2024-01-13T18:04:53.603 INFO:tasks.rados.rados.0.smithi084.stdout:1266: delete oid 26 current snap is 128 2024-01-13T18:04:53.606 INFO:tasks.rados.rados.0.smithi084.stdout:1266: done (0 left) 2024-01-13T18:04:53.606 INFO:tasks.rados.rados.0.smithi084.stdout:1267: delete oid 5 current snap is 128 2024-01-13T18:04:53.608 INFO:tasks.rados.rados.0.smithi084.stdout:1267: done (0 left) 2024-01-13T18:04:53.608 INFO:tasks.rados.rados.0.smithi084.stdout:1268: copy_from oid 21 from oid 29 current snap is 128 2024-01-13T18:04:53.608 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 128 2024-01-13T18:04:53.608 INFO:tasks.rados.rados.0.smithi084.stdout:1269: seq_num 401 ranges {0=720896,720896=606208,1327104=598016} 2024-01-13T18:04:53.612 INFO:tasks.rados.rados.0.smithi084.stdout:1269: writing smithi084102331-3 from 0 to 720896 tid 1 2024-01-13T18:04:53.616 INFO:tasks.rados.rados.0.smithi084.stdout:1269: writing smithi084102331-3 from 720896 to 1327104 tid 2 2024-01-13T18:04:53.620 INFO:tasks.rados.rados.0.smithi084.stdout:1269: writing smithi084102331-3 from 1327104 to 1925120 tid 3 2024-01-13T18:04:53.620 INFO:tasks.rados.rados.0.smithi084.stdout:1270: copy_from oid 35 from oid 34 current snap is 128 2024-01-13T18:04:53.620 INFO:tasks.rados.rados.0.smithi084.stdout:1269: finishing write tid 1 to smithi084102331-3 2024-01-13T18:04:53.620 INFO:tasks.rados.rados.0.smithi084.stdout:1268: finishing copy_from to smithi084102331-21 2024-01-13T18:04:53.620 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 395 (ObjNum 372 snap 121 seq_num 372) dirty exists 2024-01-13T18:04:53.620 INFO:tasks.rados.rados.0.smithi084.stdout:1271: read oid 19 snap -1 2024-01-13T18:04:53.620 INFO:tasks.rados.rados.0.smithi084.stdout:1271: expect deleted 2024-01-13T18:04:53.620 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 128 2024-01-13T18:04:53.620 INFO:tasks.rados.rados.0.smithi084.stdout:1268: finishing copy_from racing read to smithi084102331-21 2024-01-13T18:04:53.621 INFO:tasks.rados.rados.0.smithi084.stdout:1269: finishing write tid 2 to smithi084102331-3 2024-01-13T18:04:53.621 INFO:tasks.rados.rados.0.smithi084.stdout:1272: seq_num 402 ranges {1425408=737280,2162688=491520,2654208=516096,3170304=196608} 2024-01-13T18:04:53.632 INFO:tasks.rados.rados.0.smithi084.stdout:1272: writing smithi084102331-17 from 1425408 to 2162688 tid 1 2024-01-13T18:04:53.634 INFO:tasks.rados.rados.0.smithi084.stdout:1272: writing smithi084102331-17 from 2162688 to 2654208 tid 2 2024-01-13T18:04:53.637 INFO:tasks.rados.rados.0.smithi084.stdout:1272: writing smithi084102331-17 from 2654208 to 3170304 tid 3 2024-01-13T18:04:53.639 INFO:tasks.rados.rados.0.smithi084.stdout:1272: writing smithi084102331-17 from 3170304 to 3366912 tid 4 2024-01-13T18:04:53.639 INFO:tasks.rados.rados.0.smithi084.stdout:1268: done (4 left) 2024-01-13T18:04:53.639 INFO:tasks.rados.rados.0.smithi084.stdout:1273: copy_from oid 31 from oid 32 current snap is 128 2024-01-13T18:04:53.639 INFO:tasks.rados.rados.0.smithi084.stdout:1270: finishing copy_from to smithi084102331-35 2024-01-13T18:04:53.639 INFO:tasks.rados.rados.0.smithi084.stdout:1270: got expected ENOENT (src dne) 2024-01-13T18:04:53.639 INFO:tasks.rados.rados.0.smithi084.stdout:1270: finishing copy_from racing read to smithi084102331-35 2024-01-13T18:04:53.639 INFO:tasks.rados.rados.0.smithi084.stdout:1269: finishing write tid 3 to smithi084102331-3 2024-01-13T18:04:53.639 INFO:tasks.rados.rados.0.smithi084.stdout:1269: finishing write tid 4 to smithi084102331-3 2024-01-13T18:04:53.639 INFO:tasks.rados.rados.0.smithi084.stdout:1270: done (4 left) 2024-01-13T18:04:53.640 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 128 2024-01-13T18:04:53.640 INFO:tasks.rados.rados.0.smithi084.stdout:1269: finishing write tid 5 to smithi084102331-3 2024-01-13T18:04:53.640 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 659 (ObjNum 401 snap 128 seq_num 401) dirty exists 2024-01-13T18:04:53.640 INFO:tasks.rados.rados.0.smithi084.stdout:1269: left oid 3 (ObjNum 401 snap 128 seq_num 401) 2024-01-13T18:04:53.640 INFO:tasks.rados.rados.0.smithi084.stdout:1272: finishing write tid 1 to smithi084102331-17 2024-01-13T18:04:53.640 INFO:tasks.rados.rados.0.smithi084.stdout:1272: finishing write tid 2 to smithi084102331-17 2024-01-13T18:04:53.640 INFO:tasks.rados.rados.0.smithi084.stdout:1274: seq_num 403 ranges {5308416=753664,6062080=425984,6488064=720896,7208960=57344} 2024-01-13T18:04:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:1274: writing smithi084102331-8 from 5308416 to 6062080 tid 1 2024-01-13T18:04:53.674 INFO:tasks.rados.rados.0.smithi084.stdout:1274: writing smithi084102331-8 from 6062080 to 6488064 tid 2 2024-01-13T18:04:53.678 INFO:tasks.rados.rados.0.smithi084.stdout:1274: writing smithi084102331-8 from 6488064 to 7208960 tid 3 2024-01-13T18:04:53.679 INFO:tasks.rados.rados.0.smithi084.stdout:1274: writing smithi084102331-8 from 7208960 to 7266304 tid 4 2024-01-13T18:04:53.679 INFO:tasks.rados.rados.0.smithi084.stdout:1269: done (4 left) 2024-01-13T18:04:53.679 INFO:tasks.rados.rados.0.smithi084.stdout:1271: done (3 left) 2024-01-13T18:04:53.679 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 128 2024-01-13T18:04:53.679 INFO:tasks.rados.rados.0.smithi084.stdout:1272: finishing write tid 3 to smithi084102331-17 2024-01-13T18:04:53.679 INFO:tasks.rados.rados.0.smithi084.stdout:1275: seq_num 404 ranges {5308416=770048,6078464=712704,6791168=491520} 2024-01-13T18:04:53.711 INFO:tasks.rados.rados.0.smithi084.stdout:1275: writing smithi084102331-12 from 5308416 to 6078464 tid 1 2024-01-13T18:04:53.715 INFO:tasks.rados.rados.0.smithi084.stdout:1275: writing smithi084102331-12 from 6078464 to 6791168 tid 2 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1275: writing smithi084102331-12 from 6791168 to 7282688 tid 3 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1276: read oid 30 snap -1 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1276: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1277: snap_create 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1272: finishing write tid 4 to smithi084102331-17 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1272: finishing write tid 5 to smithi084102331-17 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1272: finishing write tid 6 to smithi084102331-17 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 424 (ObjNum 402 snap 128 seq_num 402) dirty exists 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1272: left oid 17 (ObjNum 402 snap 128 seq_num 402) 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1273: finishing copy_from to smithi084102331-31 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 574 (ObjNum 391 snap 126 seq_num 391) dirty exists 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1273: finishing copy_from racing read to smithi084102331-31 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 1 to smithi084102331-8 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 2 to smithi084102331-8 2024-01-13T18:04:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 3 to smithi084102331-8 2024-01-13T18:04:53.720 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 4 to smithi084102331-8 2024-01-13T18:04:53.720 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 5 to smithi084102331-8 2024-01-13T18:04:53.720 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 6 to smithi084102331-8 2024-01-13T18:04:53.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 609 (ObjNum 403 snap 128 seq_num 403) dirty exists 2024-01-13T18:04:53.720 INFO:tasks.rados.rados.0.smithi084.stdout:1274: left oid 8 (ObjNum 403 snap 128 seq_num 403) 2024-01-13T18:04:53.720 INFO:tasks.rados.rados.0.smithi084.stdout:1275: finishing write tid 1 to smithi084102331-12 2024-01-13T18:04:53.720 INFO:tasks.rados.rados.0.smithi084.stdout:1275: finishing write tid 2 to smithi084102331-12 2024-01-13T18:04:53.722 INFO:tasks.rados.rados.0.smithi084.stdout:1275: finishing write tid 3 to smithi084102331-12 2024-01-13T18:04:53.722 INFO:tasks.rados.rados.0.smithi084.stdout:1275: finishing write tid 4 to smithi084102331-12 2024-01-13T18:04:53.723 INFO:tasks.rados.rados.0.smithi084.stdout:1275: finishing write tid 5 to smithi084102331-12 2024-01-13T18:04:53.724 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 547 (ObjNum 404 snap 128 seq_num 404) dirty exists 2024-01-13T18:04:53.724 INFO:tasks.rados.rados.0.smithi084.stdout:1275: left oid 12 (ObjNum 404 snap 128 seq_num 404) 2024-01-13T18:04:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:1276: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:53 smithi099 ceph-mon[138788]: failed to encode map e313 with expected crc 2024-01-13T18:04:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:53 smithi099 ceph-mon[138788]: failed to encode map e313 with expected crc 2024-01-13T18:04:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:53 smithi099 ceph-mon[138788]: failed to encode map e313 with expected crc 2024-01-13T18:04:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:53 smithi099 ceph-mon[138788]: osdmap e314: 8 total, 8 up, 8 in 2024-01-13T18:04:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:53 smithi099 ceph-mon[138788]: failed to encode map e314 with expected crc 2024-01-13T18:04:54.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:53 smithi084 ceph-mon[116404]: failed to encode map e313 with expected crc 2024-01-13T18:04:54.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:53 smithi084 ceph-mon[116404]: failed to encode map e313 with expected crc 2024-01-13T18:04:54.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:53 smithi084 ceph-mon[116404]: failed to encode map e313 with expected crc 2024-01-13T18:04:54.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:53 smithi084 ceph-mon[116404]: osdmap e314: 8 total, 8 up, 8 in 2024-01-13T18:04:54.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:53 smithi084 ceph-mon[116404]: failed to encode map e314 with expected crc 2024-01-13T18:04:54.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:53 smithi084 ceph-mon[119097]: failed to encode map e313 with expected crc 2024-01-13T18:04:54.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:53 smithi084 ceph-mon[119097]: failed to encode map e313 with expected crc 2024-01-13T18:04:54.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:53 smithi084 ceph-mon[119097]: failed to encode map e313 with expected crc 2024-01-13T18:04:54.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:53 smithi084 ceph-mon[119097]: osdmap e314: 8 total, 8 up, 8 in 2024-01-13T18:04:54.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:53 smithi084 ceph-mon[119097]: failed to encode map e314 with expected crc 2024-01-13T18:04:54.602 INFO:tasks.rados.rados.0.smithi084.stdout:1272: done (5 left) 2024-01-13T18:04:54.603 INFO:tasks.rados.rados.0.smithi084.stdout:1273: done (4 left) 2024-01-13T18:04:54.603 INFO:tasks.rados.rados.0.smithi084.stdout:1274: done (3 left) 2024-01-13T18:04:54.603 INFO:tasks.rados.rados.0.smithi084.stdout:1275: done (2 left) 2024-01-13T18:04:54.603 INFO:tasks.rados.rados.0.smithi084.stdout:1276: done (1 left) 2024-01-13T18:04:54.603 INFO:tasks.rados.rados.0.smithi084.stdout:1277: done (0 left) 2024-01-13T18:04:54.603 INFO:tasks.rados.rados.0.smithi084.stdout:1278: setattr oid 23 current snap is 129 2024-01-13T18:04:54.604 INFO:tasks.rados.rados.0.smithi084.stdout:1279: snap_remove snap 125 2024-01-13T18:04:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:54 smithi099 ceph-mon[138788]: failed to encode map e314 with expected crc 2024-01-13T18:04:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:54 smithi099 ceph-mon[138788]: failed to encode map e314 with expected crc 2024-01-13T18:04:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:54 smithi099 ceph-mon[138788]: pgmap v182: 121 pgs: 121 active+clean; 275 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 3.8 MiB/s wr, 20 op/s 2024-01-13T18:04:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:54 smithi099 ceph-mon[138788]: failed to encode map e315 with expected crc 2024-01-13T18:04:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:54 smithi099 ceph-mon[138788]: osdmap e315: 8 total, 8 up, 8 in 2024-01-13T18:04:55.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:54 smithi084 ceph-mon[119097]: failed to encode map e314 with expected crc 2024-01-13T18:04:55.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:54 smithi084 ceph-mon[119097]: failed to encode map e314 with expected crc 2024-01-13T18:04:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:54 smithi084 ceph-mon[119097]: pgmap v182: 121 pgs: 121 active+clean; 275 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 3.8 MiB/s wr, 20 op/s 2024-01-13T18:04:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:54 smithi084 ceph-mon[119097]: failed to encode map e315 with expected crc 2024-01-13T18:04:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:54 smithi084 ceph-mon[119097]: osdmap e315: 8 total, 8 up, 8 in 2024-01-13T18:04:55.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:54 smithi084 ceph-mon[116404]: failed to encode map e314 with expected crc 2024-01-13T18:04:55.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:54 smithi084 ceph-mon[116404]: failed to encode map e314 with expected crc 2024-01-13T18:04:55.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:54 smithi084 ceph-mon[116404]: pgmap v182: 121 pgs: 121 active+clean; 275 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 3.8 MiB/s wr, 20 op/s 2024-01-13T18:04:55.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:54 smithi084 ceph-mon[116404]: failed to encode map e315 with expected crc 2024-01-13T18:04:55.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:54 smithi084 ceph-mon[116404]: osdmap e315: 8 total, 8 up, 8 in 2024-01-13T18:04:55.410 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:04:55.603 INFO:tasks.rados.rados.0.smithi084.stdout:1279: done (1 left) 2024-01-13T18:04:55.603 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 129 2024-01-13T18:04:55.603 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 549 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:04:55.603 INFO:tasks.rados.rados.0.smithi084.stdout:1280: seq_num 405 ranges {3129344=786432,3915776=589824,4505600=614400} 2024-01-13T18:04:55.625 INFO:tasks.rados.rados.0.smithi084.stdout:1280: writing smithi084102331-45 from 3129344 to 3915776 tid 1 2024-01-13T18:04:55.629 INFO:tasks.rados.rados.0.smithi084.stdout:1280: writing smithi084102331-45 from 3915776 to 4505600 tid 2 2024-01-13T18:04:55.634 INFO:tasks.rados.rados.0.smithi084.stdout:1280: writing smithi084102331-45 from 4505600 to 5120000 tid 3 2024-01-13T18:04:55.634 INFO:tasks.rados.rados.0.smithi084.stdout:1278: done (1 left) 2024-01-13T18:04:55.634 INFO:tasks.rados.rados.0.smithi084.stdout:1281: snap_remove snap 121 2024-01-13T18:04:55.736 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:04:55.736 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (3m) 15s ago 5m 17.1M - 0.25.0 c8568f914cd2 a5cbc3e01ffb 2024-01-13T18:04:55.736 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (2m) 98s ago 5m 79.4M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:04:55.736 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (6m) 15s ago 6m 15.7M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:04:55.736 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (6m) 98s ago 6m 20.0M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:04:55.736 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (2m) 98s ago 8m 447M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:04:55.736 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (2m) 15s ago 10m 509M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:04:55.736 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (2m) 15s ago 10m 84.9M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d b64908c7a53c 2024-01-13T18:04:55.736 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (106s) 98s ago 9m 23.8M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d be7bb477ea53 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (115s) 15s ago 9m 54.7M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d e13f01b852ff 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (3m) 15s ago 5m 10.0M - 1.5.0 0da6a335fe13 b72e6d50f165 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (2m) 98s ago 5m 8514k - 1.5.0 0da6a335fe13 e9f879b5e55b 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (73s) 15s ago 8m 202M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d e18181bdb4a8 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (45s) 15s ago 8m 159M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 32bdce285b36 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (17s) 15s ago 8m 14.9M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 660c53389079 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (7m) 15s ago 7m 301M 2488M 17.2.7-268-g6441305d c3a232f785d8 068cf98fa99c 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (7m) 98s ago 7m 272M 2488M 17.2.7-268-g6441305d c3a232f785d8 30e0722550a0 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (7m) 98s ago 7m 268M 2488M 17.2.7-268-g6441305d c3a232f785d8 51be805dde78 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (6m) 98s ago 6m 198M 2488M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (6m) 98s ago 6m 144M 2488M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:04:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (2m) 98s ago 5m 48.2M - 2.43.0 a07b618ecd1d cb4c11bf6eec 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 5, 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:04:56.124 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:04:56.125 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:04:56.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:04:56.125 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:04:56.125 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 7, 2024-01-13T18:04:56.125 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 8 2024-01-13T18:04:56.125 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:04:56.125 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:04:56.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:56 smithi099 ceph-mon[138788]: failed to encode map e315 with expected crc 2024-01-13T18:04:56.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:56 smithi099 ceph-mon[138788]: failed to encode map e315 with expected crc 2024-01-13T18:04:56.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:56 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:56.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:56 smithi099 ceph-mon[138788]: failed to encode map e316 with expected crc 2024-01-13T18:04:56.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:56 smithi099 ceph-mon[138788]: failed to encode map e316 with expected crc 2024-01-13T18:04:56.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:56 smithi099 ceph-mon[138788]: osdmap e316: 8 total, 8 up, 8 in 2024-01-13T18:04:56.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:56 smithi099 ceph-mon[138788]: failed to encode map e316 with expected crc 2024-01-13T18:04:56.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[116404]: failed to encode map e315 with expected crc 2024-01-13T18:04:56.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[116404]: failed to encode map e315 with expected crc 2024-01-13T18:04:56.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:56.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[116404]: failed to encode map e316 with expected crc 2024-01-13T18:04:56.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[116404]: failed to encode map e316 with expected crc 2024-01-13T18:04:56.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[116404]: osdmap e316: 8 total, 8 up, 8 in 2024-01-13T18:04:56.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[116404]: failed to encode map e316 with expected crc 2024-01-13T18:04:56.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[119097]: failed to encode map e315 with expected crc 2024-01-13T18:04:56.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[119097]: failed to encode map e315 with expected crc 2024-01-13T18:04:56.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:04:56.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[119097]: failed to encode map e316 with expected crc 2024-01-13T18:04:56.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[119097]: failed to encode map e316 with expected crc 2024-01-13T18:04:56.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[119097]: osdmap e316: 8 total, 8 up, 8 in 2024-01-13T18:04:56.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:56 smithi084 ceph-mon[119097]: failed to encode map e316 with expected crc 2024-01-13T18:04:56.607 INFO:tasks.rados.rados.0.smithi084.stdout:1281: done (1 left) 2024-01-13T18:04:56.607 INFO:tasks.rados.rados.0.smithi084.stdout:1282: delete oid 14 current snap is 129 2024-01-13T18:04:56.607 INFO:tasks.rados.rados.0.smithi084.stdout:1280: finishing write tid 1 to smithi084102331-45 2024-01-13T18:04:56.607 INFO:tasks.rados.rados.0.smithi084.stdout:1280: finishing write tid 2 to smithi084102331-45 2024-01-13T18:04:56.607 INFO:tasks.rados.rados.0.smithi084.stdout:1280: finishing write tid 3 to smithi084102331-45 2024-01-13T18:04:56.608 INFO:tasks.rados.rados.0.smithi084.stdout:1280: finishing write tid 4 to smithi084102331-45 2024-01-13T18:04:56.608 INFO:tasks.rados.rados.0.smithi084.stdout:1280: finishing write tid 5 to smithi084102331-45 2024-01-13T18:04:56.608 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 670 (ObjNum 405 snap 129 seq_num 405) dirty exists 2024-01-13T18:04:56.608 INFO:tasks.rados.rados.0.smithi084.stdout:1280: left oid 45 (ObjNum 405 snap 129 seq_num 405) 2024-01-13T18:04:56.618 INFO:tasks.rados.rados.0.smithi084.stdout:1280: done (1 left) 2024-01-13T18:04:56.618 INFO:tasks.rados.rados.0.smithi084.stdout:1282: done (0 left) 2024-01-13T18:04:56.618 INFO:tasks.rados.rados.0.smithi084.stdout:1283: rollback oid 50 current snap is 129 2024-01-13T18:04:56.618 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 50 to 124 2024-01-13T18:04:56.618 INFO:tasks.rados.rados.0.smithi084.stdout:1284: copy_from oid 39 from oid 10 current snap is 129 2024-01-13T18:04:56.618 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 129 2024-01-13T18:04:56.618 INFO:tasks.rados.rados.0.smithi084.stdout:1285: seq_num 407 ranges {3661824=425984,4087808=761856,4849664=704512,5554176=139264} 2024-01-13T18:04:56.641 INFO:tasks.rados.rados.0.smithi084.stdout:1285: writing smithi084102331-2 from 3661824 to 4087808 tid 1 2024-01-13T18:04:56.645 INFO:tasks.rados.rados.0.smithi084.stdout:1285: writing smithi084102331-2 from 4087808 to 4849664 tid 2 2024-01-13T18:04:56.649 INFO:tasks.rados.rados.0.smithi084.stdout:1285: writing smithi084102331-2 from 4849664 to 5554176 tid 3 2024-01-13T18:04:56.650 INFO:tasks.rados.rados.0.smithi084.stdout:1285: writing smithi084102331-2 from 5554176 to 5693440 tid 4 2024-01-13T18:04:56.650 INFO:tasks.rados.rados.0.smithi084.stdout:1286: read oid 36 snap -1 2024-01-13T18:04:56.650 INFO:tasks.rados.rados.0.smithi084.stdout:1286: expect (ObjNum 327 snap 103 seq_num 327) 2024-01-13T18:04:56.650 INFO:tasks.rados.rados.0.smithi084.stdout:1287: rollback oid 32 current snap is 129 2024-01-13T18:04:56.650 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 32 to 106 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:1283: finishing rollback tid 0 to smithi084102331-50 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:1283: finishing rollback tid 1 to smithi084102331-50 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:1283: finishing rollback tid 2 to smithi084102331-50 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 573 (ObjNum 278 snap 87 seq_num 278) dirty exists 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:1284: finishing copy_from to smithi084102331-39 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 338 (ObjNum 378 snap 122 seq_num 378) dirty exists 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:1284: finishing copy_from racing read to smithi084102331-39 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:1285: finishing write tid 1 to smithi084102331-2 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:1285: finishing write tid 2 to smithi084102331-2 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:1283: done (4 left) 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:1284: done (3 left) 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:1288: rollback oid 17 current snap is 129 2024-01-13T18:04:56.651 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 93 2024-01-13T18:04:56.652 INFO:tasks.rados.rados.0.smithi084.stdout:1289: copy_from oid 38 from oid 9 current snap is 129 2024-01-13T18:04:56.652 INFO:tasks.rados.rados.0.smithi084.stdout:1290: snap_create 2024-01-13T18:04:56.654 INFO:tasks.rados.rados.0.smithi084.stdout:1286: expect (ObjNum 327 snap 103 seq_num 327) 2024-01-13T18:04:56.688 INFO:tasks.rados.rados.0.smithi084.stdout:1285: finishing write tid 3 to smithi084102331-2 2024-01-13T18:04:56.688 INFO:tasks.rados.rados.0.smithi084.stdout:1285: finishing write tid 4 to smithi084102331-2 2024-01-13T18:04:56.688 INFO:tasks.rados.rados.0.smithi084.stdout:1285: finishing write tid 5 to smithi084102331-2 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:1287: finishing rollback tid 0 to smithi084102331-32 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:1287: finishing rollback tid 1 to smithi084102331-32 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:1287: finishing rollback tid 2 to smithi084102331-32 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 621 (ObjNum 309 snap 96 seq_num 309) dirty exists 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:1285: finishing write tid 6 to smithi084102331-2 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 565 (ObjNum 407 snap 129 seq_num 407) dirty exists 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:1285: left oid 2 (ObjNum 407 snap 129 seq_num 407) 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:1288: finishing rollback tid 0 to smithi084102331-17 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:1288: finishing rollback tid 1 to smithi084102331-17 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:1289: finishing copy_from to smithi084102331-38 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 354 (ObjNum 341 snap 107 seq_num 341) dirty exists 2024-01-13T18:04:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:1288: finishing rollback tid 2 to smithi084102331-17 2024-01-13T18:04:56.690 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 432 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:04:56.690 INFO:tasks.rados.rados.0.smithi084.stdout:1289: finishing copy_from racing read to smithi084102331-38 2024-01-13T18:04:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:57 smithi099 ceph-mon[138788]: from='client.34233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:57 smithi099 ceph-mon[138788]: failed to encode map e316 with expected crc 2024-01-13T18:04:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:57 smithi099 ceph-mon[138788]: from='client.34239 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:57 smithi099 ceph-mon[138788]: pgmap v185: 121 pgs: 121 active+clean; 289 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-01-13T18:04:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:57 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1752906497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:57 smithi099 ceph-mon[138788]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:57 smithi099 ceph-mon[138788]: osdmap e317: 8 total, 8 up, 8 in 2024-01-13T18:04:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:57 smithi099 ceph-mon[138788]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:57 smithi099 ceph-mon[138788]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:57 smithi099 ceph-mon[138788]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[116404]: from='client.34233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:57.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[116404]: failed to encode map e316 with expected crc 2024-01-13T18:04:57.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[116404]: from='client.34239 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:57.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[116404]: pgmap v185: 121 pgs: 121 active+clean; 289 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-01-13T18:04:57.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1752906497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:57.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[116404]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[116404]: osdmap e317: 8 total, 8 up, 8 in 2024-01-13T18:04:57.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[116404]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[116404]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[116404]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[119097]: from='client.34233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:57.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[119097]: failed to encode map e316 with expected crc 2024-01-13T18:04:57.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[119097]: from='client.34239 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:04:57.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[119097]: pgmap v185: 121 pgs: 121 active+clean; 289 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-01-13T18:04:57.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1752906497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:04:57.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[119097]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[119097]: osdmap e317: 8 total, 8 up, 8 in 2024-01-13T18:04:57.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[119097]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[119097]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:57 smithi084 ceph-mon[119097]: failed to encode map e317 with expected crc 2024-01-13T18:04:57.597 INFO:tasks.rados.rados.0.smithi084.stdout:1285: done (5 left) 2024-01-13T18:04:57.597 INFO:tasks.rados.rados.0.smithi084.stdout:1286: done (4 left) 2024-01-13T18:04:57.597 INFO:tasks.rados.rados.0.smithi084.stdout:1287: done (3 left) 2024-01-13T18:04:57.598 INFO:tasks.rados.rados.0.smithi084.stdout:1288: done (2 left) 2024-01-13T18:04:57.598 INFO:tasks.rados.rados.0.smithi084.stdout:1289: done (1 left) 2024-01-13T18:04:57.598 INFO:tasks.rados.rados.0.smithi084.stdout:1290: done (0 left) 2024-01-13T18:04:57.598 INFO:tasks.rados.rados.0.smithi084.stdout:1291: read oid 31 snap 124 2024-01-13T18:04:57.598 INFO:tasks.rados.rados.0.smithi084.stdout:1291: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:04:57.598 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 130 2024-01-13T18:04:57.598 INFO:tasks.rados.rados.0.smithi084.stdout:1292: seq_num 408 ranges {5693440=442368,6135808=647168,6782976=507904,7290880=450560} 2024-01-13T18:04:57.630 INFO:tasks.rados.rados.0.smithi084.stdout:1292: writing smithi084102331-2 from 5693440 to 6135808 tid 1 2024-01-13T18:04:57.633 INFO:tasks.rados.rados.0.smithi084.stdout:1292: writing smithi084102331-2 from 6135808 to 6782976 tid 2 2024-01-13T18:04:57.636 INFO:tasks.rados.rados.0.smithi084.stdout:1292: writing smithi084102331-2 from 6782976 to 7290880 tid 3 2024-01-13T18:04:57.639 INFO:tasks.rados.rados.0.smithi084.stdout:1292: writing smithi084102331-2 from 7290880 to 7741440 tid 4 2024-01-13T18:04:57.639 INFO:tasks.rados.rados.0.smithi084.stdout:1293: rollback oid 21 current snap is 130 2024-01-13T18:04:57.639 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 111 2024-01-13T18:04:57.639 INFO:tasks.rados.rados.0.smithi084.stdout:1291: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:04:57.679 INFO:tasks.rados.rados.0.smithi084.stdout:1292: finishing write tid 1 to smithi084102331-2 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:1292: finishing write tid 2 to smithi084102331-2 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:1292: finishing write tid 3 to smithi084102331-2 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:1293: finishing rollback tid 0 to smithi084102331-21 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:1293: finishing rollback tid 1 to smithi084102331-21 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:1293: finishing rollback tid 2 to smithi084102331-21 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 435 (ObjNum 266 snap 83 seq_num 266) dirty exists 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:1292: finishing write tid 4 to smithi084102331-2 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:1291: done (2 left) 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:1293: done (1 left) 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 130 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:1292: finishing write tid 5 to smithi084102331-2 2024-01-13T18:04:57.680 INFO:tasks.rados.rados.0.smithi084.stdout:1292: finishing write tid 6 to smithi084102331-2 2024-01-13T18:04:57.681 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 571 (ObjNum 408 snap 130 seq_num 408) dirty exists 2024-01-13T18:04:57.681 INFO:tasks.rados.rados.0.smithi084.stdout:1292: left oid 2 (ObjNum 408 snap 130 seq_num 408) 2024-01-13T18:04:57.681 INFO:tasks.rados.rados.0.smithi084.stdout:1294: seq_num 409 ranges {0=458752,458752=532480,991232=720896,1712128=352256} 2024-01-13T18:04:57.682 INFO:tasks.rados.rados.0.smithi084.stdout:1294: writing smithi084102331-7 from 0 to 458752 tid 1 2024-01-13T18:04:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:1294: writing smithi084102331-7 from 458752 to 991232 tid 2 2024-01-13T18:04:57.689 INFO:tasks.rados.rados.0.smithi084.stdout:1294: writing smithi084102331-7 from 991232 to 1712128 tid 3 2024-01-13T18:04:57.692 INFO:tasks.rados.rados.0.smithi084.stdout:1294: writing smithi084102331-7 from 1712128 to 2064384 tid 4 2024-01-13T18:04:57.692 INFO:tasks.rados.rados.0.smithi084.stdout:1292: done (1 left) 2024-01-13T18:04:57.692 INFO:tasks.rados.rados.0.smithi084.stdout:1295: read oid 39 snap -1 2024-01-13T18:04:57.692 INFO:tasks.rados.rados.0.smithi084.stdout:1295: expect (ObjNum 378 snap 122 seq_num 378) 2024-01-13T18:04:57.692 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 130 2024-01-13T18:04:57.692 INFO:tasks.rados.rados.0.smithi084.stdout:1294: finishing write tid 1 to smithi084102331-7 2024-01-13T18:04:57.692 INFO:tasks.rados.rados.0.smithi084.stdout:1294: finishing write tid 2 to smithi084102331-7 2024-01-13T18:04:57.692 INFO:tasks.rados.rados.0.smithi084.stdout:1296: seq_num 410 ranges {5144576=475136,5619712=417792,6037504=475136,6512640=425984,6938624=286720} 2024-01-13T18:04:57.721 INFO:tasks.rados.rados.0.smithi084.stdout:1296: writing smithi084102331-22 from 5144576 to 5619712 tid 1 2024-01-13T18:04:57.724 INFO:tasks.rados.rados.0.smithi084.stdout:1296: writing smithi084102331-22 from 5619712 to 6037504 tid 2 2024-01-13T18:04:57.726 INFO:tasks.rados.rados.0.smithi084.stdout:1296: writing smithi084102331-22 from 6037504 to 6512640 tid 3 2024-01-13T18:04:57.729 INFO:tasks.rados.rados.0.smithi084.stdout:1296: writing smithi084102331-22 from 6512640 to 6938624 tid 4 2024-01-13T18:04:57.731 INFO:tasks.rados.rados.0.smithi084.stdout:1296: writing smithi084102331-22 from 6938624 to 7225344 tid 5 2024-01-13T18:04:57.731 INFO:tasks.rados.rados.0.smithi084.stdout:1297: rollback oid 47 current snap is 130 2024-01-13T18:04:57.731 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 93 2024-01-13T18:04:57.731 INFO:tasks.rados.rados.0.smithi084.stdout:1294: finishing write tid 3 to smithi084102331-7 2024-01-13T18:04:57.731 INFO:tasks.rados.rados.0.smithi084.stdout:1294: finishing write tid 4 to smithi084102331-7 2024-01-13T18:04:57.731 INFO:tasks.rados.rados.0.smithi084.stdout:1294: finishing write tid 5 to smithi084102331-7 2024-01-13T18:04:57.731 INFO:tasks.rados.rados.0.smithi084.stdout:1294: finishing write tid 6 to smithi084102331-7 2024-01-13T18:04:57.731 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 345 (ObjNum 409 snap 130 seq_num 409) dirty exists 2024-01-13T18:04:57.731 INFO:tasks.rados.rados.0.smithi084.stdout:1294: left oid 7 (ObjNum 409 snap 130 seq_num 409) 2024-01-13T18:04:57.731 INFO:tasks.rados.rados.0.smithi084.stdout:1295: expect (ObjNum 378 snap 122 seq_num 378) 2024-01-13T18:04:57.826 INFO:tasks.rados.rados.0.smithi084.stdout:1296: finishing write tid 1 to smithi084102331-22 2024-01-13T18:04:57.826 INFO:tasks.rados.rados.0.smithi084.stdout:1296: finishing write tid 2 to smithi084102331-22 2024-01-13T18:04:57.826 INFO:tasks.rados.rados.0.smithi084.stdout:1296: finishing write tid 3 to smithi084102331-22 2024-01-13T18:04:57.827 INFO:tasks.rados.rados.0.smithi084.stdout:1296: finishing write tid 4 to smithi084102331-22 2024-01-13T18:04:57.827 INFO:tasks.rados.rados.0.smithi084.stdout:1296: finishing write tid 5 to smithi084102331-22 2024-01-13T18:04:57.827 INFO:tasks.rados.rados.0.smithi084.stdout:1296: finishing write tid 6 to smithi084102331-22 2024-01-13T18:04:57.827 INFO:tasks.rados.rados.0.smithi084.stdout:1297: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:04:57.827 INFO:tasks.rados.rados.0.smithi084.stdout:1296: finishing write tid 7 to smithi084102331-22 2024-01-13T18:04:57.827 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 578 (ObjNum 410 snap 130 seq_num 410) dirty exists 2024-01-13T18:04:57.827 INFO:tasks.rados.rados.0.smithi084.stdout:1296: left oid 22 (ObjNum 410 snap 130 seq_num 410) 2024-01-13T18:04:57.827 INFO:tasks.rados.rados.0.smithi084.stdout:1297: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:04:57.827 INFO:tasks.rados.rados.0.smithi084.stdout:1297: finishing rollback tid 2 to smithi084102331-47 2024-01-13T18:04:57.827 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 625 (ObjNum 286 snap 89 seq_num 286) dirty exists 2024-01-13T18:04:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:1294: done (3 left) 2024-01-13T18:04:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:1295: done (2 left) 2024-01-13T18:04:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:1296: done (1 left) 2024-01-13T18:04:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:1297: done (0 left) 2024-01-13T18:04:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:1298: read oid 7 snap -1 2024-01-13T18:04:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:1298: expect (ObjNum 409 snap 130 seq_num 409) 2024-01-13T18:04:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:1299: rollback oid 20 current snap is 130 2024-01-13T18:04:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 122 2024-01-13T18:04:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:1300: read oid 15 snap -1 2024-01-13T18:04:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:1300: expect (ObjNum 286 snap 89 seq_num 286) 2024-01-13T18:04:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:1301: delete oid 29 current snap is 130 2024-01-13T18:04:57.830 INFO:tasks.rados.rados.0.smithi084.stdout:1301: done (3 left) 2024-01-13T18:04:57.830 INFO:tasks.rados.rados.0.smithi084.stdout:1302: rollback oid 45 current snap is 130 2024-01-13T18:04:57.831 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 128 2024-01-13T18:04:57.831 INFO:tasks.rados.rados.0.smithi084.stdout:1299: finishing rollback tid 0 to smithi084102331-20 2024-01-13T18:04:57.831 INFO:tasks.rados.rados.0.smithi084.stdout:1303: read oid 24 snap 126 2024-01-13T18:04:57.831 INFO:tasks.rados.rados.0.smithi084.stdout:1303: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:57.831 INFO:tasks.rados.rados.0.smithi084.stdout:1304: read oid 3 snap -1 2024-01-13T18:04:57.831 INFO:tasks.rados.rados.0.smithi084.stdout:1304: expect (ObjNum 401 snap 128 seq_num 401) 2024-01-13T18:04:57.831 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 130 2024-01-13T18:04:57.831 INFO:tasks.rados.rados.0.smithi084.stdout:1305: seq_num 412 ranges {2269184=507904,2777088=630784,3407872=491520,3899392=483328} 2024-01-13T18:04:57.847 INFO:tasks.rados.rados.0.smithi084.stdout:1305: writing smithi084102331-50 from 2269184 to 2777088 tid 1 2024-01-13T18:04:57.850 INFO:tasks.rados.rados.0.smithi084.stdout:1305: writing smithi084102331-50 from 2777088 to 3407872 tid 2 2024-01-13T18:04:57.853 INFO:tasks.rados.rados.0.smithi084.stdout:1305: writing smithi084102331-50 from 3407872 to 3899392 tid 3 2024-01-13T18:04:57.856 INFO:tasks.rados.rados.0.smithi084.stdout:1305: writing smithi084102331-50 from 3899392 to 4382720 tid 4 2024-01-13T18:04:57.857 INFO:tasks.rados.rados.0.smithi084.stdout:1306: rmattr oid 16 current snap is 130 2024-01-13T18:04:57.857 INFO:tasks.rados.rados.0.smithi084.stdout:1299: finishing rollback tid 1 to smithi084102331-20 2024-01-13T18:04:57.857 INFO:tasks.rados.rados.0.smithi084.stdout:1299: finishing rollback tid 2 to smithi084102331-20 2024-01-13T18:04:57.857 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 428 (ObjNum 324 snap 101 seq_num 324) dirty exists 2024-01-13T18:04:57.857 INFO:tasks.rados.rados.0.smithi084.stdout:1298: expect (ObjNum 409 snap 130 seq_num 409) 2024-01-13T18:04:57.910 INFO:tasks.rados.rados.0.smithi084.stdout:1302: finishing rollback tid 0 to smithi084102331-45 2024-01-13T18:04:57.910 INFO:tasks.rados.rados.0.smithi084.stdout:1302: finishing rollback tid 1 to smithi084102331-45 2024-01-13T18:04:57.910 INFO:tasks.rados.rados.0.smithi084.stdout:1302: finishing rollback tid 2 to smithi084102331-45 2024-01-13T18:04:57.910 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 684 (ObjNum 306 snap 95 seq_num 306) dirty exists 2024-01-13T18:04:57.910 INFO:tasks.rados.rados.0.smithi084.stdout:1304: expect (ObjNum 401 snap 128 seq_num 401) 2024-01-13T18:04:57.955 INFO:tasks.rados.rados.0.smithi084.stdout:1305: finishing write tid 1 to smithi084102331-50 2024-01-13T18:04:57.955 INFO:tasks.rados.rados.0.smithi084.stdout:1305: finishing write tid 2 to smithi084102331-50 2024-01-13T18:04:57.955 INFO:tasks.rados.rados.0.smithi084.stdout:1305: finishing write tid 3 to smithi084102331-50 2024-01-13T18:04:57.955 INFO:tasks.rados.rados.0.smithi084.stdout:1305: finishing write tid 4 to smithi084102331-50 2024-01-13T18:04:57.955 INFO:tasks.rados.rados.0.smithi084.stdout:1305: finishing write tid 5 to smithi084102331-50 2024-01-13T18:04:57.955 INFO:tasks.rados.rados.0.smithi084.stdout:1305: finishing write tid 6 to smithi084102331-50 2024-01-13T18:04:57.956 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 579 (ObjNum 412 snap 130 seq_num 412) dirty exists 2024-01-13T18:04:57.956 INFO:tasks.rados.rados.0.smithi084.stdout:1305: left oid 50 (ObjNum 412 snap 130 seq_num 412) 2024-01-13T18:04:57.956 INFO:tasks.rados.rados.0.smithi084.stdout:1303: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:58.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:58 smithi099 ceph-mon[138788]: failed to encode map e317 with expected crc 2024-01-13T18:04:58.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:58 smithi099 ceph-mon[138788]: osdmap e318: 8 total, 8 up, 8 in 2024-01-13T18:04:58.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:58 smithi099 ceph-mon[138788]: failed to encode map e318 with expected crc 2024-01-13T18:04:58.396 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 398 (ObjNum 379 snap 122 seq_num 379) dirty exists 2024-01-13T18:04:58.396 INFO:tasks.rados.rados.0.smithi084.stdout:1300: expect (ObjNum 286 snap 89 seq_num 286) 2024-01-13T18:04:58.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:58 smithi084 ceph-mon[116404]: failed to encode map e317 with expected crc 2024-01-13T18:04:58.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:58 smithi084 ceph-mon[116404]: osdmap e318: 8 total, 8 up, 8 in 2024-01-13T18:04:58.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:58 smithi084 ceph-mon[116404]: failed to encode map e318 with expected crc 2024-01-13T18:04:58.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:58 smithi084 ceph-mon[119097]: failed to encode map e317 with expected crc 2024-01-13T18:04:58.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:58 smithi084 ceph-mon[119097]: osdmap e318: 8 total, 8 up, 8 in 2024-01-13T18:04:58.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:58 smithi084 ceph-mon[119097]: failed to encode map e318 with expected crc 2024-01-13T18:04:58.805 INFO:tasks.rados.rados.0.smithi084.stdout:1298: done (7 left) 2024-01-13T18:04:58.805 INFO:tasks.rados.rados.0.smithi084.stdout:1299: done (6 left) 2024-01-13T18:04:58.805 INFO:tasks.rados.rados.0.smithi084.stdout:1300: done (5 left) 2024-01-13T18:04:58.805 INFO:tasks.rados.rados.0.smithi084.stdout:1302: done (4 left) 2024-01-13T18:04:58.805 INFO:tasks.rados.rados.0.smithi084.stdout:1303: done (3 left) 2024-01-13T18:04:58.805 INFO:tasks.rados.rados.0.smithi084.stdout:1304: done (2 left) 2024-01-13T18:04:58.805 INFO:tasks.rados.rados.0.smithi084.stdout:1305: done (1 left) 2024-01-13T18:04:58.806 INFO:tasks.rados.rados.0.smithi084.stdout:1306: done (0 left) 2024-01-13T18:04:58.806 INFO:tasks.rados.rados.0.smithi084.stdout:1307: rmattr oid 41 current snap is 130 2024-01-13T18:04:58.806 INFO:tasks.rados.rados.0.smithi084.stdout:1308: snap_create 2024-01-13T18:04:58.807 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 381 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:04:59.082 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:04:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:04:58.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:04:59.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:59 smithi084 ceph-mon[116404]: failed to encode map e318 with expected crc 2024-01-13T18:04:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:59 smithi084 ceph-mon[116404]: failed to encode map e318 with expected crc 2024-01-13T18:04:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:59 smithi084 ceph-mon[116404]: pgmap v188: 121 pgs: 121 active+clean; 304 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 8.9 MiB/s rd, 5.8 MiB/s wr, 19 op/s 2024-01-13T18:04:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:04:59 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:04:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:59 smithi084 ceph-mon[119097]: failed to encode map e318 with expected crc 2024-01-13T18:04:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:59 smithi084 ceph-mon[119097]: failed to encode map e318 with expected crc 2024-01-13T18:04:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:59 smithi084 ceph-mon[119097]: pgmap v188: 121 pgs: 121 active+clean; 304 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 8.9 MiB/s rd, 5.8 MiB/s wr, 19 op/s 2024-01-13T18:04:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:04:59 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:04:59.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:59 smithi099 ceph-mon[138788]: failed to encode map e318 with expected crc 2024-01-13T18:04:59.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:59 smithi099 ceph-mon[138788]: failed to encode map e318 with expected crc 2024-01-13T18:04:59.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:59 smithi099 ceph-mon[138788]: pgmap v188: 121 pgs: 121 active+clean; 304 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 8.9 MiB/s rd, 5.8 MiB/s wr, 19 op/s 2024-01-13T18:04:59.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:04:59 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:04:59.605 INFO:tasks.rados.rados.0.smithi084.stdout:1307: done (1 left) 2024-01-13T18:04:59.605 INFO:tasks.rados.rados.0.smithi084.stdout:1308: done (0 left) 2024-01-13T18:04:59.605 INFO:tasks.rados.rados.0.smithi084.stdout:1309: rollback oid 39 current snap is 131 2024-01-13T18:04:59.605 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 107 2024-01-13T18:04:59.605 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 131 2024-01-13T18:04:59.605 INFO:tasks.rados.rados.0.smithi084.stdout:1310: seq_num 413 ranges {1810432=524288,2334720=516096,2850816=696320,3547136=393216} 2024-01-13T18:04:59.618 INFO:tasks.rados.rados.0.smithi084.stdout:1310: writing smithi084102331-44 from 1810432 to 2334720 tid 1 2024-01-13T18:04:59.621 INFO:tasks.rados.rados.0.smithi084.stdout:1310: writing smithi084102331-44 from 2334720 to 2850816 tid 2 2024-01-13T18:04:59.625 INFO:tasks.rados.rados.0.smithi084.stdout:1310: writing smithi084102331-44 from 2850816 to 3547136 tid 3 2024-01-13T18:04:59.629 INFO:tasks.rados.rados.0.smithi084.stdout:1310: writing smithi084102331-44 from 3547136 to 3940352 tid 4 2024-01-13T18:04:59.629 INFO:tasks.rados.rados.0.smithi084.stdout:1311: read oid 16 snap 107 2024-01-13T18:04:59.629 INFO:tasks.rados.rados.0.smithi084.stdout:1311: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:04:59.629 INFO:tasks.rados.rados.0.smithi084.stdout:1312: snap_remove snap 112 2024-01-13T18:05:00.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:05:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[116404]: Upgrade: osd.3 is safe to restart 2024-01-13T18:05:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-13T18:05:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[116404]: failed to encode map e319 with expected crc 2024-01-13T18:05:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[116404]: osdmap e319: 8 total, 8 up, 8 in 2024-01-13T18:05:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[116404]: failed to encode map e319 with expected crc 2024-01-13T18:05:00.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:05:00.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[119097]: Upgrade: osd.3 is safe to restart 2024-01-13T18:05:00.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:00.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-13T18:05:00.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:00.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[119097]: failed to encode map e319 with expected crc 2024-01-13T18:05:00.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[119097]: osdmap e319: 8 total, 8 up, 8 in 2024-01-13T18:05:00.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-mon[119097]: failed to encode map e319 with expected crc 2024-01-13T18:05:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:00 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-01-13T18:05:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:00 smithi099 ceph-mon[138788]: Upgrade: osd.3 is safe to restart 2024-01-13T18:05:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-13T18:05:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:00 smithi099 ceph-mon[138788]: failed to encode map e319 with expected crc 2024-01-13T18:05:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:00 smithi099 ceph-mon[138788]: osdmap e319: 8 total, 8 up, 8 in 2024-01-13T18:05:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:00 smithi099 ceph-mon[138788]: failed to encode map e319 with expected crc 2024-01-13T18:05:00.566 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:05:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:05:00] "GET /metrics HTTP/1.1" 200 36141 "" "Prometheus/2.43.0" 2024-01-13T18:05:00.611 INFO:tasks.rados.rados.0.smithi084.stdout:1312: done (3 left) 2024-01-13T18:05:00.611 INFO:tasks.rados.rados.0.smithi084.stdout:1313: snap_remove snap 130 2024-01-13T18:05:01.086 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[116404]: Upgrade: Updating osd.3 2024-01-13T18:05:01.086 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[116404]: Deploying daemon osd.3 on smithi084 2024-01-13T18:05:01.086 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[116404]: pgmap v190: 121 pgs: 121 active+clean; 304 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 8.1 MiB/s rd, 5.3 MiB/s wr, 17 op/s 2024-01-13T18:05:01.086 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[116404]: failed to encode map e320 with expected crc 2024-01-13T18:05:01.087 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[116404]: osdmap e320: 8 total, 8 up, 8 in 2024-01-13T18:05:01.087 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[116404]: failed to encode map e320 with expected crc 2024-01-13T18:05:01.087 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[116404]: failed to encode map e320 with expected crc 2024-01-13T18:05:01.087 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[119097]: Upgrade: Updating osd.3 2024-01-13T18:05:01.087 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[119097]: Deploying daemon osd.3 on smithi084 2024-01-13T18:05:01.087 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[119097]: pgmap v190: 121 pgs: 121 active+clean; 304 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 8.1 MiB/s rd, 5.3 MiB/s wr, 17 op/s 2024-01-13T18:05:01.087 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[119097]: failed to encode map e320 with expected crc 2024-01-13T18:05:01.087 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[119097]: osdmap e320: 8 total, 8 up, 8 in 2024-01-13T18:05:01.087 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[119097]: failed to encode map e320 with expected crc 2024-01-13T18:05:01.088 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-mon[119097]: failed to encode map e320 with expected crc 2024-01-13T18:05:01.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:01 smithi099 ceph-mon[138788]: Upgrade: Updating osd.3 2024-01-13T18:05:01.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:01 smithi099 ceph-mon[138788]: Deploying daemon osd.3 on smithi084 2024-01-13T18:05:01.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:01 smithi099 ceph-mon[138788]: pgmap v190: 121 pgs: 121 active+clean; 304 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 8.1 MiB/s rd, 5.3 MiB/s wr, 17 op/s 2024-01-13T18:05:01.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:01 smithi099 ceph-mon[138788]: failed to encode map e320 with expected crc 2024-01-13T18:05:01.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:01 smithi099 ceph-mon[138788]: osdmap e320: 8 total, 8 up, 8 in 2024-01-13T18:05:01.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:01 smithi099 ceph-mon[138788]: failed to encode map e320 with expected crc 2024-01-13T18:05:01.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:01 smithi099 ceph-mon[138788]: failed to encode map e320 with expected crc 2024-01-13T18:05:01.620 INFO:tasks.rados.rados.0.smithi084.stdout:1313: done (3 left) 2024-01-13T18:05:01.620 INFO:tasks.rados.rados.0.smithi084.stdout:1314: snap_remove snap 117 2024-01-13T18:05:01.928 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:01 smithi084 systemd[1]: Stopping Ceph osd.3 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:05:01.929 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[80454]: 2024-01-13T18:05:01.709+0000 7f4987454700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:05:01.929 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[80454]: 2024-01-13T18:05:01.709+0000 7f4987454700 -1 osd.3 321 *** Got signal Terminated *** 2024-01-13T18:05:01.929 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:01 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[80454]: 2024-01-13T18:05:01.709+0000 7f4987454700 -1 osd.3 321 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T18:05:02.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:02 smithi099 ceph-mon[138788]: failed to encode map e320 with expected crc 2024-01-13T18:05:02.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:02 smithi099 ceph-mon[138788]: failed to encode map e321 with expected crc 2024-01-13T18:05:02.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:02 smithi099 ceph-mon[138788]: failed to encode map e321 with expected crc 2024-01-13T18:05:02.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:02 smithi099 ceph-mon[138788]: osdmap e321: 8 total, 8 up, 8 in 2024-01-13T18:05:02.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:02 smithi099 ceph-mon[138788]: osd.3 marked itself down and dead 2024-01-13T18:05:02.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:02 smithi084 ceph-mon[119097]: failed to encode map e320 with expected crc 2024-01-13T18:05:02.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:02 smithi084 ceph-mon[119097]: failed to encode map e321 with expected crc 2024-01-13T18:05:02.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:02 smithi084 ceph-mon[119097]: failed to encode map e321 with expected crc 2024-01-13T18:05:02.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:02 smithi084 ceph-mon[119097]: osdmap e321: 8 total, 8 up, 8 in 2024-01-13T18:05:02.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:02 smithi084 ceph-mon[119097]: osd.3 marked itself down and dead 2024-01-13T18:05:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:02 smithi084 ceph-mon[116404]: failed to encode map e320 with expected crc 2024-01-13T18:05:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:02 smithi084 ceph-mon[116404]: failed to encode map e321 with expected crc 2024-01-13T18:05:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:02 smithi084 ceph-mon[116404]: failed to encode map e321 with expected crc 2024-01-13T18:05:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:02 smithi084 ceph-mon[116404]: osdmap e321: 8 total, 8 up, 8 in 2024-01-13T18:05:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:02 smithi084 ceph-mon[116404]: osd.3 marked itself down and dead 2024-01-13T18:05:02.618 INFO:tasks.rados.rados.0.smithi084.stdout:1314: done (3 left) 2024-01-13T18:05:02.619 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 131 2024-01-13T18:05:02.619 INFO:tasks.rados.rados.0.smithi084.stdout:1315: seq_num 414 ranges {0=540672,540672=802816,1343488=458752,1802240=344064} 2024-01-13T18:05:02.619 INFO:tasks.rados.rados.0.smithi084.stdout:1315: writing smithi084102331-34 from 0 to 540672 tid 1 2024-01-13T18:05:02.619 INFO:tasks.rados.rados.0.smithi084.stdout:1315: writing smithi084102331-34 from 540672 to 1343488 tid 2 2024-01-13T18:05:02.619 INFO:tasks.rados.rados.0.smithi084.stdout:1315: writing smithi084102331-34 from 1343488 to 1802240 tid 3 2024-01-13T18:05:02.621 INFO:tasks.rados.rados.0.smithi084.stdout:1315: writing smithi084102331-34 from 1802240 to 2146304 tid 4 2024-01-13T18:05:02.621 INFO:tasks.rados.rados.0.smithi084.stdout:1316: snap_remove snap 93 2024-01-13T18:05:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:03 smithi099 ceph-mon[138788]: pgmap v193: 121 pgs: 121 active+clean; 338 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 3.4 MiB/s wr, 23 op/s 2024-01-13T18:05:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:03 smithi099 ceph-mon[138788]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:05:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:03 smithi099 ceph-mon[138788]: osdmap e322: 8 total, 7 up, 8 in 2024-01-13T18:05:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:03 smithi099 ceph-mon[138788]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:03 smithi099 ceph-mon[138788]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:03 smithi099 ceph-mon[138788]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:03 smithi099 ceph-mon[138788]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[116404]: pgmap v193: 121 pgs: 121 active+clean; 338 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 3.4 MiB/s wr, 23 op/s 2024-01-13T18:05:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[116404]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:05:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[116404]: osdmap e322: 8 total, 7 up, 8 in 2024-01-13T18:05:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[116404]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[116404]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[116404]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[116404]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[119097]: pgmap v193: 121 pgs: 121 active+clean; 338 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 3.4 MiB/s wr, 23 op/s 2024-01-13T18:05:03.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[119097]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:05:03.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[119097]: osdmap e322: 8 total, 7 up, 8 in 2024-01-13T18:05:03.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[119097]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[119097]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[119097]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:03 smithi084 ceph-mon[119097]: failed to encode map e322 with expected crc 2024-01-13T18:05:03.430 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:03 smithi084 bash[143531]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3 2024-01-13T18:05:03.602 INFO:tasks.rados.rados.0.smithi084.stdout:1316: done (4 left) 2024-01-13T18:05:03.602 INFO:tasks.rados.rados.0.smithi084.stdout:1317: delete oid 36 current snap is 131 2024-01-13T18:05:03.602 INFO:tasks.rados.rados.0.smithi084.stdout:1309: finishing rollback tid 0 to smithi084102331-39 2024-01-13T18:05:03.602 INFO:tasks.rados.rados.0.smithi084.stdout:1309: finishing rollback tid 1 to smithi084102331-39 2024-01-13T18:05:03.602 INFO:tasks.rados.rados.0.smithi084.stdout:1309: finishing rollback tid 2 to smithi084102331-39 2024-01-13T18:05:03.602 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 385 (ObjNum 201 snap 55 seq_num 201) dirty exists 2024-01-13T18:05:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:1310: finishing write tid 1 to smithi084102331-44 2024-01-13T18:05:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:1310: finishing write tid 2 to smithi084102331-44 2024-01-13T18:05:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:1310: finishing write tid 3 to smithi084102331-44 2024-01-13T18:05:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:1310: finishing write tid 4 to smithi084102331-44 2024-01-13T18:05:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:1310: finishing write tid 5 to smithi084102331-44 2024-01-13T18:05:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:1310: finishing write tid 6 to smithi084102331-44 2024-01-13T18:05:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 631 (ObjNum 413 snap 131 seq_num 413) dirty exists 2024-01-13T18:05:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:1310: left oid 44 (ObjNum 413 snap 131 seq_num 413) 2024-01-13T18:05:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:1311: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:05:04.079 INFO:tasks.rados.rados.0.smithi084.stdout:1315: finishing write tid 1 to smithi084102331-34 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:1315: finishing write tid 2 to smithi084102331-34 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:1315: finishing write tid 3 to smithi084102331-34 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:1315: finishing write tid 4 to smithi084102331-34 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:1315: finishing write tid 5 to smithi084102331-34 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:1315: finishing write tid 6 to smithi084102331-34 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 410 (ObjNum 414 snap 131 seq_num 414) dirty exists 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:1315: left oid 34 (ObjNum 414 snap 131 seq_num 414) 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:1309: done (4 left) 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:1310: done (3 left) 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:1311: done (2 left) 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:1315: done (1 left) 2024-01-13T18:05:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:1317: done (0 left) 2024-01-13T18:05:04.081 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 131 2024-01-13T18:05:04.081 INFO:tasks.rados.rados.0.smithi084.stdout:1318: seq_num 416 ranges {8544256=573440,9117696=573440,9691136=475136,10166272=557056} 2024-01-13T18:05:04.129 INFO:tasks.rados.rados.0.smithi084.stdout:1318: writing smithi084102331-15 from 8544256 to 9117696 tid 1 2024-01-13T18:05:04.132 INFO:tasks.rados.rados.0.smithi084.stdout:1318: writing smithi084102331-15 from 9117696 to 9691136 tid 2 2024-01-13T18:05:04.135 INFO:tasks.rados.rados.0.smithi084.stdout:1318: writing smithi084102331-15 from 9691136 to 10166272 tid 3 2024-01-13T18:05:04.138 INFO:tasks.rados.rados.0.smithi084.stdout:1318: writing smithi084102331-15 from 10166272 to 10723328 tid 4 2024-01-13T18:05:04.138 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 131 2024-01-13T18:05:04.138 INFO:tasks.rados.rados.0.smithi084.stdout:1318: finishing write tid 1 to smithi084102331-15 2024-01-13T18:05:04.138 INFO:tasks.rados.rados.0.smithi084.stdout:1318: finishing write tid 2 to smithi084102331-15 2024-01-13T18:05:04.138 INFO:tasks.rados.rados.0.smithi084.stdout:1319: seq_num 417 ranges {7225344=589824,7815168=458752,8273920=679936,8953856=466944} 2024-01-13T18:05:04.180 INFO:tasks.rados.rados.0.smithi084.stdout:1319: writing smithi084102331-22 from 7225344 to 7815168 tid 1 2024-01-13T18:05:04.183 INFO:tasks.rados.rados.0.smithi084.stdout:1319: writing smithi084102331-22 from 7815168 to 8273920 tid 2 2024-01-13T18:05:04.187 INFO:tasks.rados.rados.0.smithi084.stdout:1319: writing smithi084102331-22 from 8273920 to 8953856 tid 3 2024-01-13T18:05:04.190 INFO:tasks.rados.rados.0.smithi084.stdout:1319: writing smithi084102331-22 from 8953856 to 9420800 tid 4 2024-01-13T18:05:04.190 INFO:tasks.rados.rados.0.smithi084.stdout:1320: read oid 30 snap -1 2024-01-13T18:05:04.190 INFO:tasks.rados.rados.0.smithi084.stdout:1320: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:05:04.190 INFO:tasks.rados.rados.0.smithi084.stdout:1321: read oid 50 snap -1 2024-01-13T18:05:04.190 INFO:tasks.rados.rados.0.smithi084.stdout:1321: expect (ObjNum 412 snap 130 seq_num 412) 2024-01-13T18:05:04.191 INFO:tasks.rados.rados.0.smithi084.stdout:1322: snap_create 2024-01-13T18:05:04.191 INFO:tasks.rados.rados.0.smithi084.stdout:1318: finishing write tid 3 to smithi084102331-15 2024-01-13T18:05:04.191 INFO:tasks.rados.rados.0.smithi084.stdout:1318: finishing write tid 4 to smithi084102331-15 2024-01-13T18:05:04.191 INFO:tasks.rados.rados.0.smithi084.stdout:1318: finishing write tid 5 to smithi084102331-15 2024-01-13T18:05:04.191 INFO:tasks.rados.rados.0.smithi084.stdout:1318: finishing write tid 6 to smithi084102331-15 2024-01-13T18:05:04.191 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 649 (ObjNum 416 snap 131 seq_num 416) dirty exists 2024-01-13T18:05:04.191 INFO:tasks.rados.rados.0.smithi084.stdout:1318: left oid 15 (ObjNum 416 snap 131 seq_num 416) 2024-01-13T18:05:04.191 INFO:tasks.rados.rados.0.smithi084.stdout:1319: finishing write tid 1 to smithi084102331-22 2024-01-13T18:05:04.191 INFO:tasks.rados.rados.0.smithi084.stdout:1319: finishing write tid 2 to smithi084102331-22 2024-01-13T18:05:04.191 INFO:tasks.rados.rados.0.smithi084.stdout:1319: finishing write tid 3 to smithi084102331-22 2024-01-13T18:05:04.195 INFO:tasks.rados.rados.0.smithi084.stdout:1319: finishing write tid 4 to smithi084102331-22 2024-01-13T18:05:04.195 INFO:tasks.rados.rados.0.smithi084.stdout:1319: finishing write tid 5 to smithi084102331-22 2024-01-13T18:05:04.196 INFO:tasks.rados.rados.0.smithi084.stdout:1319: finishing write tid 6 to smithi084102331-22 2024-01-13T18:05:04.197 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 609 (ObjNum 417 snap 131 seq_num 417) dirty exists 2024-01-13T18:05:04.197 INFO:tasks.rados.rados.0.smithi084.stdout:1319: left oid 22 (ObjNum 417 snap 131 seq_num 417) 2024-01-13T18:05:04.231 INFO:tasks.rados.rados.0.smithi084.stdout:1320: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:05:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:04 smithi099 ceph-mon[138788]: failed to encode map e322 with expected crc 2024-01-13T18:05:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:04 smithi099 ceph-mon[138788]: failed to encode map e322 with expected crc 2024-01-13T18:05:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:04 smithi099 ceph-mon[138788]: failed to encode map e322 with expected crc 2024-01-13T18:05:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:04 smithi099 ceph-mon[138788]: osdmap e323: 8 total, 7 up, 8 in 2024-01-13T18:05:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:04 smithi099 ceph-mon[138788]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:04 smithi099 ceph-mon[138788]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:04 smithi099 ceph-mon[138788]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:04 smithi099 ceph-mon[138788]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.398 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[116404]: failed to encode map e322 with expected crc 2024-01-13T18:05:04.398 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[116404]: failed to encode map e322 with expected crc 2024-01-13T18:05:04.398 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[116404]: failed to encode map e322 with expected crc 2024-01-13T18:05:04.398 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[116404]: osdmap e323: 8 total, 7 up, 8 in 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[116404]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[116404]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[116404]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[116404]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[119097]: failed to encode map e322 with expected crc 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[119097]: failed to encode map e322 with expected crc 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[119097]: failed to encode map e322 with expected crc 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[119097]: osdmap e323: 8 total, 7 up, 8 in 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[119097]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[119097]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[119097]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:04 smithi084 ceph-mon[119097]: failed to encode map e323 with expected crc 2024-01-13T18:05:04.679 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:04 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.3.service: Succeeded. 2024-01-13T18:05:04.679 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:04 smithi084 systemd[1]: Stopped Ceph osd.3 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:05:04.679 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:04 smithi084 systemd[1]: Starting Ceph osd.3 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:05:04.703 INFO:tasks.rados.rados.0.smithi084.stdout:1321: expect (ObjNum 412 snap 130 seq_num 412) 2024-01-13T18:05:05.100 INFO:tasks.rados.rados.0.smithi084.stdout:1318: done (4 left) 2024-01-13T18:05:05.100 INFO:tasks.rados.rados.0.smithi084.stdout:1319: done (3 left) 2024-01-13T18:05:05.100 INFO:tasks.rados.rados.0.smithi084.stdout:1320: done (2 left) 2024-01-13T18:05:05.100 INFO:tasks.rados.rados.0.smithi084.stdout:1321: done (1 left) 2024-01-13T18:05:05.101 INFO:tasks.rados.rados.0.smithi084.stdout:1322: done (0 left) 2024-01-13T18:05:05.101 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 132 2024-01-13T18:05:05.101 INFO:tasks.rados.rados.0.smithi084.stdout:1323: seq_num 418 ranges {1425408=606208,2031616=737280,2768896=434176,3203072=434176} 2024-01-13T18:05:05.112 INFO:tasks.rados.rados.0.smithi084.stdout:1323: writing smithi084102331-17 from 1425408 to 2031616 tid 1 2024-01-13T18:05:05.116 INFO:tasks.rados.rados.0.smithi084.stdout:1323: writing smithi084102331-17 from 2031616 to 2768896 tid 2 2024-01-13T18:05:05.119 INFO:tasks.rados.rados.0.smithi084.stdout:1323: writing smithi084102331-17 from 2768896 to 3203072 tid 3 2024-01-13T18:05:05.122 INFO:tasks.rados.rados.0.smithi084.stdout:1323: writing smithi084102331-17 from 3203072 to 3637248 tid 4 2024-01-13T18:05:05.122 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 132 2024-01-13T18:05:05.122 INFO:tasks.rados.rados.0.smithi084.stdout:1323: finishing write tid 1 to smithi084102331-17 2024-01-13T18:05:05.122 INFO:tasks.rados.rados.0.smithi084.stdout:1323: finishing write tid 2 to smithi084102331-17 2024-01-13T18:05:05.122 INFO:tasks.rados.rados.0.smithi084.stdout:1323: finishing write tid 3 to smithi084102331-17 2024-01-13T18:05:05.122 INFO:tasks.rados.rados.0.smithi084.stdout:1324: seq_num 419 ranges {4276224=622592,4898816=671744,5570560=647168,6217728=286720} 2024-01-13T18:05:05.149 INFO:tasks.rados.rados.0.smithi084.stdout:1324: writing smithi084102331-35 from 4276224 to 4898816 tid 1 2024-01-13T18:05:05.153 INFO:tasks.rados.rados.0.smithi084.stdout:1324: writing smithi084102331-35 from 4898816 to 5570560 tid 2 2024-01-13T18:05:05.157 INFO:tasks.rados.rados.0.smithi084.stdout:1324: writing smithi084102331-35 from 5570560 to 6217728 tid 3 2024-01-13T18:05:05.159 INFO:tasks.rados.rados.0.smithi084.stdout:1324: writing smithi084102331-35 from 6217728 to 6504448 tid 4 2024-01-13T18:05:05.159 INFO:tasks.rados.rados.0.smithi084.stdout:1325: snap_create 2024-01-13T18:05:05.160 INFO:tasks.rados.rados.0.smithi084.stdout:1323: finishing write tid 4 to smithi084102331-17 2024-01-13T18:05:05.160 INFO:tasks.rados.rados.0.smithi084.stdout:1323: finishing write tid 5 to smithi084102331-17 2024-01-13T18:05:05.160 INFO:tasks.rados.rados.0.smithi084.stdout:1323: finishing write tid 6 to smithi084102331-17 2024-01-13T18:05:05.160 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 446 (ObjNum 418 snap 132 seq_num 418) dirty exists 2024-01-13T18:05:05.160 INFO:tasks.rados.rados.0.smithi084.stdout:1323: left oid 17 (ObjNum 418 snap 132 seq_num 418) 2024-01-13T18:05:05.160 INFO:tasks.rados.rados.0.smithi084.stdout:1324: finishing write tid 1 to smithi084102331-35 2024-01-13T18:05:05.160 INFO:tasks.rados.rados.0.smithi084.stdout:1324: finishing write tid 2 to smithi084102331-35 2024-01-13T18:05:05.161 INFO:tasks.rados.rados.0.smithi084.stdout:1324: finishing write tid 3 to smithi084102331-35 2024-01-13T18:05:05.161 INFO:tasks.rados.rados.0.smithi084.stdout:1324: finishing write tid 4 to smithi084102331-35 2024-01-13T18:05:05.162 INFO:tasks.rados.rados.0.smithi084.stdout:1324: finishing write tid 5 to smithi084102331-35 2024-01-13T18:05:05.163 INFO:tasks.rados.rados.0.smithi084.stdout:1324: finishing write tid 6 to smithi084102331-35 2024-01-13T18:05:05.163 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 459 (ObjNum 419 snap 132 seq_num 419) dirty exists 2024-01-13T18:05:05.163 INFO:tasks.rados.rados.0.smithi084.stdout:1324: left oid 35 (ObjNum 419 snap 132 seq_num 419) 2024-01-13T18:05:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:05 smithi099 ceph-mon[138788]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:05 smithi099 ceph-mon[138788]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:05 smithi099 ceph-mon[138788]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:05 smithi099 ceph-mon[138788]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:05 smithi099 ceph-mon[138788]: pgmap v196: 121 pgs: 1 active+undersized+degraded, 1 activating+undersized, 13 stale+active+clean, 7 active+undersized, 99 active+clean; 338 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 25 op/s; 15/576 objects degraded (2.604%) 2024-01-13T18:05:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:05 smithi099 ceph-mon[138788]: Health check failed: Degraded data redundancy: 15/576 objects degraded (2.604%), 1 pg degraded (PG_DEGRADED) 2024-01-13T18:05:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:05.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[116404]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[116404]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[116404]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[116404]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[116404]: pgmap v196: 121 pgs: 1 active+undersized+degraded, 1 activating+undersized, 13 stale+active+clean, 7 active+undersized, 99 active+clean; 338 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 25 op/s; 15/576 objects degraded (2.604%) 2024-01-13T18:05:05.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[116404]: Health check failed: Degraded data redundancy: 15/576 objects degraded (2.604%), 1 pg degraded (PG_DEGRADED) 2024-01-13T18:05:05.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:05.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:05.429 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:05 smithi084 bash[143798]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-13T18:05:05.429 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:05 smithi084 bash[143798]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-01-13T18:05:05.429 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:05 smithi084 bash[143798]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-01-13T18:05:05.429 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:05 smithi084 bash[143798]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-01-13T18:05:05.429 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:05 smithi084 bash[143798]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-01-13T18:05:05.430 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:05 smithi084 bash[143798]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-13T18:05:05.430 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:05 smithi084 bash[143798]: --> ceph-volume raw activate successful for osd ID: 3 2024-01-13T18:05:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[119097]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[119097]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[119097]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[119097]: failed to encode map e323 with expected crc 2024-01-13T18:05:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[119097]: pgmap v196: 121 pgs: 1 active+undersized+degraded, 1 activating+undersized, 13 stale+active+clean, 7 active+undersized, 99 active+clean; 338 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 3.7 MiB/s wr, 25 op/s; 15/576 objects degraded (2.604%) 2024-01-13T18:05:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[119097]: Health check failed: Degraded data redundancy: 15/576 objects degraded (2.604%), 1 pg degraded (PG_DEGRADED) 2024-01-13T18:05:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:06.106 INFO:tasks.rados.rados.0.smithi084.stdout:1323: done (2 left) 2024-01-13T18:05:06.106 INFO:tasks.rados.rados.0.smithi084.stdout:1324: done (1 left) 2024-01-13T18:05:06.106 INFO:tasks.rados.rados.0.smithi084.stdout:1325: done (0 left) 2024-01-13T18:05:06.106 INFO:tasks.rados.rados.0.smithi084.stdout:1326: delete oid 44 current snap is 133 2024-01-13T18:05:06.113 INFO:tasks.rados.rados.0.smithi084.stdout:1326: done (0 left) 2024-01-13T18:05:06.113 INFO:tasks.rados.rados.0.smithi084.stdout:1327: rmattr oid 21 current snap is 133 2024-01-13T18:05:06.113 INFO:tasks.rados.rados.0.smithi084.stdout:1327: done (0 left) 2024-01-13T18:05:06.113 INFO:tasks.rados.rados.0.smithi084.stdout:1328: read oid 50 snap -1 2024-01-13T18:05:06.113 INFO:tasks.rados.rados.0.smithi084.stdout:1328: expect (ObjNum 412 snap 130 seq_num 412) 2024-01-13T18:05:06.113 INFO:tasks.rados.rados.0.smithi084.stdout:1329: read oid 4 snap -1 2024-01-13T18:05:06.113 INFO:tasks.rados.rados.0.smithi084.stdout:1329: expect (ObjNum 371 snap 119 seq_num 371) 2024-01-13T18:05:06.113 INFO:tasks.rados.rados.0.smithi084.stdout:1330: snap_create 2024-01-13T18:05:06.140 INFO:tasks.rados.rados.0.smithi084.stdout:1328: expect (ObjNum 412 snap 130 seq_num 412) 2024-01-13T18:05:06.297 INFO:tasks.rados.rados.0.smithi084.stdout:1329: expect (ObjNum 371 snap 119 seq_num 371) 2024-01-13T18:05:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:06 smithi099 ceph-mon[138788]: failed to encode map e324 with expected crc 2024-01-13T18:05:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:06 smithi099 ceph-mon[138788]: osdmap e324: 8 total, 7 up, 8 in 2024-01-13T18:05:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:06 smithi099 ceph-mon[138788]: failed to encode map e324 with expected crc 2024-01-13T18:05:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[116404]: failed to encode map e324 with expected crc 2024-01-13T18:05:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[116404]: osdmap e324: 8 total, 7 up, 8 in 2024-01-13T18:05:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[116404]: failed to encode map e324 with expected crc 2024-01-13T18:05:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:06.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[119097]: failed to encode map e324 with expected crc 2024-01-13T18:05:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[119097]: osdmap e324: 8 total, 7 up, 8 in 2024-01-13T18:05:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[119097]: failed to encode map e324 with expected crc 2024-01-13T18:05:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:06.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:06.430 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:05 smithi084 ceph-osd[144086]: -- 172.21.15.84:0/4058858066 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d9c72de4e0 con 0x55d9c72aec00 2024-01-13T18:05:06.430 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:05 smithi084 bash[144047]: 0e4b8c3482a4c727d19371da1b99433ac8acea17ab0b154f17c90fba543729bc 2024-01-13T18:05:06.430 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:05 smithi084 systemd[1]: Started Ceph osd.3 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:05:06.928 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:06 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[144063]: 2024-01-13T18:05:06.463+0000 7f9fda88f640 -1 Falling back to public interface 2024-01-13T18:05:07.111 INFO:tasks.rados.rados.0.smithi084.stdout:1328: done (2 left) 2024-01-13T18:05:07.111 INFO:tasks.rados.rados.0.smithi084.stdout:1329: done (1 left) 2024-01-13T18:05:07.111 INFO:tasks.rados.rados.0.smithi084.stdout:1330: done (0 left) 2024-01-13T18:05:07.111 INFO:tasks.rados.rados.0.smithi084.stdout:1331: read oid 40 snap 124 2024-01-13T18:05:07.111 INFO:tasks.rados.rados.0.smithi084.stdout:1331: expect (ObjNum 361 snap 116 seq_num 361) 2024-01-13T18:05:07.111 INFO:tasks.rados.rados.0.smithi084.stdout:1332: snap_create 2024-01-13T18:05:07.122 INFO:tasks.rados.rados.0.smithi084.stdout:1331: expect (ObjNum 361 snap 116 seq_num 361) 2024-01-13T18:05:07.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:07 smithi099 ceph-mon[138788]: failed to encode map e324 with expected crc 2024-01-13T18:05:07.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:07 smithi099 ceph-mon[138788]: pgmap v198: 121 pgs: 3 active+undersized+degraded, 1 activating+undersized, 3 stale+active+clean, 24 active+undersized, 90 active+clean; 336 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 1.4 MiB/s wr, 13 op/s; 43/567 objects degraded (7.584%) 2024-01-13T18:05:07.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:07 smithi099 ceph-mon[138788]: failed to encode map e325 with expected crc 2024-01-13T18:05:07.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:07 smithi099 ceph-mon[138788]: failed to encode map e325 with expected crc 2024-01-13T18:05:07.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:07 smithi099 ceph-mon[138788]: osdmap e325: 8 total, 7 up, 8 in 2024-01-13T18:05:07.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:07 smithi099 ceph-mon[138788]: failed to encode map e325 with expected crc 2024-01-13T18:05:07.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[119097]: failed to encode map e324 with expected crc 2024-01-13T18:05:07.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[119097]: pgmap v198: 121 pgs: 3 active+undersized+degraded, 1 activating+undersized, 3 stale+active+clean, 24 active+undersized, 90 active+clean; 336 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 1.4 MiB/s wr, 13 op/s; 43/567 objects degraded (7.584%) 2024-01-13T18:05:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[119097]: failed to encode map e325 with expected crc 2024-01-13T18:05:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[119097]: failed to encode map e325 with expected crc 2024-01-13T18:05:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[119097]: osdmap e325: 8 total, 7 up, 8 in 2024-01-13T18:05:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[119097]: failed to encode map e325 with expected crc 2024-01-13T18:05:07.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[116404]: failed to encode map e324 with expected crc 2024-01-13T18:05:07.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[116404]: pgmap v198: 121 pgs: 3 active+undersized+degraded, 1 activating+undersized, 3 stale+active+clean, 24 active+undersized, 90 active+clean; 336 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 1.4 MiB/s wr, 13 op/s; 43/567 objects degraded (7.584%) 2024-01-13T18:05:07.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[116404]: failed to encode map e325 with expected crc 2024-01-13T18:05:07.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[116404]: failed to encode map e325 with expected crc 2024-01-13T18:05:07.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[116404]: osdmap e325: 8 total, 7 up, 8 in 2024-01-13T18:05:07.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:07 smithi084 ceph-mon[116404]: failed to encode map e325 with expected crc 2024-01-13T18:05:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:1331: done (1 left) 2024-01-13T18:05:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:1332: done (0 left) 2024-01-13T18:05:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:1333: copy_from oid 34 from oid 38 current snap is 135 2024-01-13T18:05:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:1334: rollback oid 46 current snap is 135 2024-01-13T18:05:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 98 2024-01-13T18:05:07.597 INFO:tasks.rados.rados.0.smithi084.stdout:1335: rollback oid 23 current snap is 135 2024-01-13T18:05:07.598 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 129 2024-01-13T18:05:07.598 INFO:tasks.rados.rados.0.smithi084.stdout:1336: delete oid 22 current snap is 135 2024-01-13T18:05:07.605 INFO:tasks.rados.rados.0.smithi084.stdout:1334: finishing rollback tid 0 to smithi084102331-46 2024-01-13T18:05:07.609 INFO:tasks.rados.rados.0.smithi084.stdout:1334: finishing rollback tid 1 to smithi084102331-46 2024-01-13T18:05:07.609 INFO:tasks.rados.rados.0.smithi084.stdout:1334: finishing rollback tid 2 to smithi084102331-46 2024-01-13T18:05:07.609 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 403 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:05:07.611 INFO:tasks.rados.rados.0.smithi084.stdout:1333: finishing copy_from to smithi084102331-34 2024-01-13T18:05:07.611 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 354 (ObjNum 341 snap 107 seq_num 341) dirty exists 2024-01-13T18:05:07.612 INFO:tasks.rados.rados.0.smithi084.stdout:1333: finishing copy_from racing read to smithi084102331-34 2024-01-13T18:05:07.616 INFO:tasks.rados.rados.0.smithi084.stdout:1335: finishing rollback tid 0 to smithi084102331-23 2024-01-13T18:05:07.616 INFO:tasks.rados.rados.0.smithi084.stdout:1335: finishing rollback tid 1 to smithi084102331-23 2024-01-13T18:05:07.616 INFO:tasks.rados.rados.0.smithi084.stdout:1335: finishing rollback tid 2 to smithi084102331-23 2024-01-13T18:05:07.616 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 613 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:05:07.617 INFO:tasks.rados.rados.0.smithi084.stdout:1333: done (3 left) 2024-01-13T18:05:07.617 INFO:tasks.rados.rados.0.smithi084.stdout:1334: done (2 left) 2024-01-13T18:05:07.617 INFO:tasks.rados.rados.0.smithi084.stdout:1335: done (1 left) 2024-01-13T18:05:07.617 INFO:tasks.rados.rados.0.smithi084.stdout:1336: done (0 left) 2024-01-13T18:05:07.617 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 135 2024-01-13T18:05:07.617 INFO:tasks.rados.rados.0.smithi084.stdout:1337: seq_num 422 ranges {1425408=671744,2097152=729088,2826240=417792,3244032=458752} 2024-01-13T18:05:07.628 INFO:tasks.rados.rados.0.smithi084.stdout:1337: writing smithi084102331-23 from 1425408 to 2097152 tid 1 2024-01-13T18:05:07.632 INFO:tasks.rados.rados.0.smithi084.stdout:1337: writing smithi084102331-23 from 2097152 to 2826240 tid 2 2024-01-13T18:05:07.635 INFO:tasks.rados.rados.0.smithi084.stdout:1337: writing smithi084102331-23 from 2826240 to 3244032 tid 3 2024-01-13T18:05:07.638 INFO:tasks.rados.rados.0.smithi084.stdout:1337: writing smithi084102331-23 from 3244032 to 3702784 tid 4 2024-01-13T18:05:07.638 INFO:tasks.rados.rados.0.smithi084.stdout:1338: copy_from oid 45 from oid 6 current snap is 135 2024-01-13T18:05:07.638 INFO:tasks.rados.rados.0.smithi084.stdout:1337: finishing write tid 1 to smithi084102331-23 2024-01-13T18:05:07.638 INFO:tasks.rados.rados.0.smithi084.stdout:1337: finishing write tid 2 to smithi084102331-23 2024-01-13T18:05:07.638 INFO:tasks.rados.rados.0.smithi084.stdout:1339: snap_remove snap 107 2024-01-13T18:05:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[116404]: failed to encode map e324 with expected crc 2024-01-13T18:05:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[116404]: failed to encode map e326 with expected crc 2024-01-13T18:05:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[116404]: failed to encode map e326 with expected crc 2024-01-13T18:05:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[116404]: osdmap e326: 8 total, 7 up, 8 in 2024-01-13T18:05:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[116404]: failed to encode map e326 with expected crc 2024-01-13T18:05:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[116404]: failed to encode map e327 with expected crc 2024-01-13T18:05:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[116404]: osdmap e327: 8 total, 7 up, 8 in 2024-01-13T18:05:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[119097]: failed to encode map e324 with expected crc 2024-01-13T18:05:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[119097]: failed to encode map e326 with expected crc 2024-01-13T18:05:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[119097]: failed to encode map e326 with expected crc 2024-01-13T18:05:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[119097]: osdmap e326: 8 total, 7 up, 8 in 2024-01-13T18:05:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[119097]: failed to encode map e326 with expected crc 2024-01-13T18:05:08.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[119097]: failed to encode map e327 with expected crc 2024-01-13T18:05:08.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:08 smithi084 ceph-mon[119097]: osdmap e327: 8 total, 7 up, 8 in 2024-01-13T18:05:08.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:08 smithi099 ceph-mon[138788]: failed to encode map e324 with expected crc 2024-01-13T18:05:08.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:08 smithi099 ceph-mon[138788]: failed to encode map e326 with expected crc 2024-01-13T18:05:08.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:08 smithi099 ceph-mon[138788]: failed to encode map e326 with expected crc 2024-01-13T18:05:08.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:08 smithi099 ceph-mon[138788]: osdmap e326: 8 total, 7 up, 8 in 2024-01-13T18:05:08.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:08 smithi099 ceph-mon[138788]: failed to encode map e326 with expected crc 2024-01-13T18:05:08.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:08 smithi099 ceph-mon[138788]: failed to encode map e327 with expected crc 2024-01-13T18:05:08.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:08 smithi099 ceph-mon[138788]: osdmap e327: 8 total, 7 up, 8 in 2024-01-13T18:05:08.609 INFO:tasks.rados.rados.0.smithi084.stdout:1339: done (2 left) 2024-01-13T18:05:08.609 INFO:tasks.rados.rados.0.smithi084.stdout:1340: copy_from oid 7 from oid 29 current snap is 135 2024-01-13T18:05:08.609 INFO:tasks.rados.rados.0.smithi084.stdout:1341: copy_from oid 15 from oid 46 current snap is 135 2024-01-13T18:05:08.609 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 135 2024-01-13T18:05:08.609 INFO:tasks.rados.rados.0.smithi084.stdout:1342: seq_num 423 ranges {1843200=688128,2531328=614400,3145728=622592,3768320=368640} 2024-01-13T18:05:08.623 INFO:tasks.rados.rados.0.smithi084.stdout:1342: writing smithi084102331-11 from 1843200 to 2531328 tid 1 2024-01-13T18:05:08.628 INFO:tasks.rados.rados.0.smithi084.stdout:1342: writing smithi084102331-11 from 2531328 to 3145728 tid 2 2024-01-13T18:05:08.631 INFO:tasks.rados.rados.0.smithi084.stdout:1342: writing smithi084102331-11 from 3145728 to 3768320 tid 3 2024-01-13T18:05:08.635 INFO:tasks.rados.rados.0.smithi084.stdout:1342: writing smithi084102331-11 from 3768320 to 4136960 tid 4 2024-01-13T18:05:08.636 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 135 2024-01-13T18:05:08.636 INFO:tasks.rados.rados.0.smithi084.stdout:1343: seq_num 424 ranges {7069696=704512,7774208=491520,8265728=434176,8699904=679936} 2024-01-13T18:05:08.677 INFO:tasks.rados.rados.0.smithi084.stdout:1343: writing smithi084102331-31 from 7069696 to 7774208 tid 1 2024-01-13T18:05:08.679 INFO:tasks.rados.rados.0.smithi084.stdout:1343: writing smithi084102331-31 from 7774208 to 8265728 tid 2 2024-01-13T18:05:08.681 INFO:tasks.rados.rados.0.smithi084.stdout:1343: writing smithi084102331-31 from 8265728 to 8699904 tid 3 2024-01-13T18:05:08.686 INFO:tasks.rados.rados.0.smithi084.stdout:1343: writing smithi084102331-31 from 8699904 to 9379840 tid 4 2024-01-13T18:05:08.686 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 135 2024-01-13T18:05:08.686 INFO:tasks.rados.rados.0.smithi084.stdout:1337: finishing write tid 3 to smithi084102331-23 2024-01-13T18:05:08.686 INFO:tasks.rados.rados.0.smithi084.stdout:1344: seq_num 425 ranges {917504=720896,1638400=778240,2416640=638976,3055616=188416} 2024-01-13T18:05:08.695 INFO:tasks.rados.rados.0.smithi084.stdout:1344: writing smithi084102331-18 from 917504 to 1638400 tid 1 2024-01-13T18:05:08.699 INFO:tasks.rados.rados.0.smithi084.stdout:1344: writing smithi084102331-18 from 1638400 to 2416640 tid 2 2024-01-13T18:05:08.704 INFO:tasks.rados.rados.0.smithi084.stdout:1344: writing smithi084102331-18 from 2416640 to 3055616 tid 3 2024-01-13T18:05:08.705 INFO:tasks.rados.rados.0.smithi084.stdout:1344: writing smithi084102331-18 from 3055616 to 3244032 tid 4 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1345: rmattr oid 26 current snap is 135 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1345: done (7 left) 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1346: delete oid 5 current snap is 135 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1337: finishing write tid 4 to smithi084102331-23 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1337: finishing write tid 5 to smithi084102331-23 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1337: finishing write tid 6 to smithi084102331-23 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 620 (ObjNum 422 snap 135 seq_num 422) dirty exists 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1337: left oid 23 (ObjNum 422 snap 135 seq_num 422) 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1338: finishing copy_from to smithi084102331-45 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 383 (ObjNum 387 snap 125 seq_num 387) dirty exists 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1338: finishing copy_from racing read to smithi084102331-45 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1340: finishing copy_from to smithi084102331-7 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1340: got expected ENOENT (src dne) 2024-01-13T18:05:08.706 INFO:tasks.rados.rados.0.smithi084.stdout:1340: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:1341: finishing copy_from to smithi084102331-15 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 403 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:1341: finishing copy_from racing read to smithi084102331-15 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:1342: finishing write tid 1 to smithi084102331-11 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:1342: finishing write tid 2 to smithi084102331-11 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:1342: finishing write tid 3 to smithi084102331-11 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:1342: finishing write tid 4 to smithi084102331-11 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:1342: finishing write tid 5 to smithi084102331-11 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:1342: finishing write tid 6 to smithi084102331-11 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 415 (ObjNum 423 snap 135 seq_num 423) dirty exists 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:1342: left oid 11 (ObjNum 423 snap 135 seq_num 423) 2024-01-13T18:05:08.707 INFO:tasks.rados.rados.0.smithi084.stdout:1343: finishing write tid 1 to smithi084102331-31 2024-01-13T18:05:08.708 INFO:tasks.rados.rados.0.smithi084.stdout:1343: finishing write tid 2 to smithi084102331-31 2024-01-13T18:05:08.708 INFO:tasks.rados.rados.0.smithi084.stdout:1343: finishing write tid 3 to smithi084102331-31 2024-01-13T18:05:08.708 INFO:tasks.rados.rados.0.smithi084.stdout:1343: finishing write tid 4 to smithi084102331-31 2024-01-13T18:05:08.708 INFO:tasks.rados.rados.0.smithi084.stdout:1343: finishing write tid 5 to smithi084102331-31 2024-01-13T18:05:08.708 INFO:tasks.rados.rados.0.smithi084.stdout:1343: finishing write tid 6 to smithi084102331-31 2024-01-13T18:05:08.708 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 702 (ObjNum 424 snap 135 seq_num 424) dirty exists 2024-01-13T18:05:08.708 INFO:tasks.rados.rados.0.smithi084.stdout:1343: left oid 31 (ObjNum 424 snap 135 seq_num 424) 2024-01-13T18:05:08.708 INFO:tasks.rados.rados.0.smithi084.stdout:1344: finishing write tid 1 to smithi084102331-18 2024-01-13T18:05:08.708 INFO:tasks.rados.rados.0.smithi084.stdout:1344: finishing write tid 2 to smithi084102331-18 2024-01-13T18:05:08.709 INFO:tasks.rados.rados.0.smithi084.stdout:1344: finishing write tid 3 to smithi084102331-18 2024-01-13T18:05:08.709 INFO:tasks.rados.rados.0.smithi084.stdout:1337: done (7 left) 2024-01-13T18:05:08.709 INFO:tasks.rados.rados.0.smithi084.stdout:1338: done (6 left) 2024-01-13T18:05:08.709 INFO:tasks.rados.rados.0.smithi084.stdout:1340: done (5 left) 2024-01-13T18:05:08.709 INFO:tasks.rados.rados.0.smithi084.stdout:1341: done (4 left) 2024-01-13T18:05:08.709 INFO:tasks.rados.rados.0.smithi084.stdout:1342: done (3 left) 2024-01-13T18:05:08.709 INFO:tasks.rados.rados.0.smithi084.stdout:1343: done (2 left) 2024-01-13T18:05:08.709 INFO:tasks.rados.rados.0.smithi084.stdout:1346: done (1 left) 2024-01-13T18:05:08.709 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 135 2024-01-13T18:05:08.709 INFO:tasks.rados.rados.0.smithi084.stdout:1347: seq_num 427 ranges {0=761856,761856=598016,1359872=606208,1966080=401408} 2024-01-13T18:05:08.711 INFO:tasks.rados.rados.0.smithi084.stdout:1347: writing smithi084102331-5 from 0 to 761856 tid 1 2024-01-13T18:05:08.715 INFO:tasks.rados.rados.0.smithi084.stdout:1347: writing smithi084102331-5 from 761856 to 1359872 tid 2 2024-01-13T18:05:08.718 INFO:tasks.rados.rados.0.smithi084.stdout:1347: writing smithi084102331-5 from 1359872 to 1966080 tid 3 2024-01-13T18:05:08.721 INFO:tasks.rados.rados.0.smithi084.stdout:1347: writing smithi084102331-5 from 1966080 to 2367488 tid 4 2024-01-13T18:05:08.721 INFO:tasks.rados.rados.0.smithi084.stdout:1348: delete oid 38 current snap is 135 2024-01-13T18:05:08.721 INFO:tasks.rados.rados.0.smithi084.stdout:1344: finishing write tid 4 to smithi084102331-18 2024-01-13T18:05:08.722 INFO:tasks.rados.rados.0.smithi084.stdout:1344: finishing write tid 5 to smithi084102331-18 2024-01-13T18:05:08.722 INFO:tasks.rados.rados.0.smithi084.stdout:1344: finishing write tid 6 to smithi084102331-18 2024-01-13T18:05:08.722 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 343 (ObjNum 425 snap 135 seq_num 425) dirty exists 2024-01-13T18:05:08.722 INFO:tasks.rados.rados.0.smithi084.stdout:1344: left oid 18 (ObjNum 425 snap 135 seq_num 425) 2024-01-13T18:05:08.722 INFO:tasks.rados.rados.0.smithi084.stdout:1347: finishing write tid 1 to smithi084102331-5 2024-01-13T18:05:08.722 INFO:tasks.rados.rados.0.smithi084.stdout:1347: finishing write tid 2 to smithi084102331-5 2024-01-13T18:05:08.722 INFO:tasks.rados.rados.0.smithi084.stdout:1347: finishing write tid 3 to smithi084102331-5 2024-01-13T18:05:08.723 INFO:tasks.rados.rados.0.smithi084.stdout:1344: done (2 left) 2024-01-13T18:05:08.723 INFO:tasks.rados.rados.0.smithi084.stdout:1348: done (1 left) 2024-01-13T18:05:08.723 INFO:tasks.rados.rados.0.smithi084.stdout:1349: setattr oid 17 current snap is 135 2024-01-13T18:05:08.723 INFO:tasks.rados.rados.0.smithi084.stdout:1347: finishing write tid 4 to smithi084102331-5 2024-01-13T18:05:08.723 INFO:tasks.rados.rados.0.smithi084.stdout:1347: finishing write tid 5 to smithi084102331-5 2024-01-13T18:05:08.724 INFO:tasks.rados.rados.0.smithi084.stdout:1350: read oid 21 snap -1 2024-01-13T18:05:08.724 INFO:tasks.rados.rados.0.smithi084.stdout:1350: expect (ObjNum 266 snap 83 seq_num 266) 2024-01-13T18:05:08.724 INFO:tasks.rados.rados.0.smithi084.stdout:1351: snap_remove snap 122 2024-01-13T18:05:09.115 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:05:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:05:08.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:05:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:09 smithi099 ceph-mon[138788]: failed to encode map e326 with expected crc 2024-01-13T18:05:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:09 smithi099 ceph-mon[138788]: pgmap v202: 121 pgs: 7 active+undersized+degraded, 1 activating+undersized, 33 active+undersized, 80 active+clean; 340 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 2.6 MiB/s wr, 10 op/s; 81/549 objects degraded (14.754%) 2024-01-13T18:05:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:09 smithi099 ceph-mon[138788]: osdmap e328: 8 total, 7 up, 8 in 2024-01-13T18:05:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:09 smithi099 ceph-mon[138788]: failed to encode map e328 with expected crc 2024-01-13T18:05:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:09 smithi099 ceph-mon[138788]: failed to encode map e328 with expected crc 2024-01-13T18:05:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.371 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[116404]: failed to encode map e326 with expected crc 2024-01-13T18:05:09.371 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[116404]: pgmap v202: 121 pgs: 7 active+undersized+degraded, 1 activating+undersized, 33 active+undersized, 80 active+clean; 340 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 2.6 MiB/s wr, 10 op/s; 81/549 objects degraded (14.754%) 2024-01-13T18:05:09.371 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.371 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.372 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[116404]: osdmap e328: 8 total, 7 up, 8 in 2024-01-13T18:05:09.372 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[116404]: failed to encode map e328 with expected crc 2024-01-13T18:05:09.372 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[116404]: failed to encode map e328 with expected crc 2024-01-13T18:05:09.372 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.372 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.372 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[144063]: 2024-01-13T18:05:09.270+0000 7f9fda88f640 -1 osd.3 0 read_superblock omap replica is missing. 2024-01-13T18:05:09.372 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[144063]: 2024-01-13T18:05:09.314+0000 7f9fda88f640 -1 osd.3 321 log_to_monitors true 2024-01-13T18:05:09.372 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[119097]: failed to encode map e326 with expected crc 2024-01-13T18:05:09.372 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[119097]: pgmap v202: 121 pgs: 7 active+undersized+degraded, 1 activating+undersized, 33 active+undersized, 80 active+clean; 340 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 2.6 MiB/s wr, 10 op/s; 81/549 objects degraded (14.754%) 2024-01-13T18:05:09.373 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.373 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.373 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[119097]: osdmap e328: 8 total, 7 up, 8 in 2024-01-13T18:05:09.373 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[119097]: failed to encode map e328 with expected crc 2024-01-13T18:05:09.373 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[119097]: failed to encode map e328 with expected crc 2024-01-13T18:05:09.373 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.373 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:09.609 INFO:tasks.rados.rados.0.smithi084.stdout:1351: done (3 left) 2024-01-13T18:05:09.610 INFO:tasks.rados.rados.0.smithi084.stdout:1352: snap_remove snap 129 2024-01-13T18:05:09.634 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:05:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[144063]: 2024-01-13T18:05:09.632+0000 7f9fc7ce2700 -1 osd.3 321 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T18:05:10.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:10 smithi099 ceph-mon[138788]: failed to encode map e328 with expected crc 2024-01-13T18:05:10.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:10 smithi099 ceph-mon[138788]: from='osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-13T18:05:10.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:10 smithi099 ceph-mon[138788]: failed to encode map e329 with expected crc 2024-01-13T18:05:10.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:10 smithi099 ceph-mon[138788]: from='osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-13T18:05:10.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:10 smithi099 ceph-mon[138788]: osdmap e329: 8 total, 7 up, 8 in 2024-01-13T18:05:10.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:10 smithi099 ceph-mon[138788]: from='osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:05:10.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:10 smithi099 ceph-mon[138788]: failed to encode map e329 with expected crc 2024-01-13T18:05:10.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[116404]: failed to encode map e328 with expected crc 2024-01-13T18:05:10.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[116404]: from='osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-13T18:05:10.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[116404]: failed to encode map e329 with expected crc 2024-01-13T18:05:10.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[116404]: from='osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-13T18:05:10.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[116404]: osdmap e329: 8 total, 7 up, 8 in 2024-01-13T18:05:10.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[116404]: from='osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:05:10.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[116404]: failed to encode map e329 with expected crc 2024-01-13T18:05:10.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:05:10] "GET /metrics HTTP/1.1" 200 36136 "" "Prometheus/2.43.0" 2024-01-13T18:05:10.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[119097]: failed to encode map e328 with expected crc 2024-01-13T18:05:10.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[119097]: from='osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-13T18:05:10.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[119097]: failed to encode map e329 with expected crc 2024-01-13T18:05:10.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[119097]: from='osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-13T18:05:10.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[119097]: osdmap e329: 8 total, 7 up, 8 in 2024-01-13T18:05:10.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[119097]: from='osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-01-13T18:05:10.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:10 smithi084 ceph-mon[119097]: failed to encode map e329 with expected crc 2024-01-13T18:05:10.623 INFO:tasks.rados.rados.0.smithi084.stdout:1352: done (3 left) 2024-01-13T18:05:10.623 INFO:tasks.rados.rados.0.smithi084.stdout:1353: snap_create 2024-01-13T18:05:10.623 INFO:tasks.rados.rados.0.smithi084.stdout:1347: finishing write tid 6 to smithi084102331-5 2024-01-13T18:05:10.623 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 452 (ObjNum 427 snap 135 seq_num 427) dirty exists 2024-01-13T18:05:10.623 INFO:tasks.rados.rados.0.smithi084.stdout:1347: left oid 5 (ObjNum 427 snap 135 seq_num 427) 2024-01-13T18:05:10.623 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 454 (ObjNum 418 snap 132 seq_num 418) dirty exists 2024-01-13T18:05:10.623 INFO:tasks.rados.rados.0.smithi084.stdout:1350: expect (ObjNum 266 snap 83 seq_num 266) 2024-01-13T18:05:11.344 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[119097]: pgmap v205: 121 pgs: 1 active+clean+snaptrim, 8 active+undersized+degraded, 33 active+undersized, 79 active+clean; 340 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.1 MiB/s rd, 1.6 MiB/s wr, 5 op/s; 81/549 objects degraded (14.754%) 2024-01-13T18:05:11.344 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 81/549 objects degraded (14.754%), 8 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:11.344 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[119097]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:05:11.344 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[119097]: osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987] boot 2024-01-13T18:05:11.344 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[119097]: osdmap e330: 8 total, 8 up, 8 in 2024-01-13T18:05:11.344 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:05:11.344 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[116404]: pgmap v205: 121 pgs: 1 active+clean+snaptrim, 8 active+undersized+degraded, 33 active+undersized, 79 active+clean; 340 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.1 MiB/s rd, 1.6 MiB/s wr, 5 op/s; 81/549 objects degraded (14.754%) 2024-01-13T18:05:11.344 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 81/549 objects degraded (14.754%), 8 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:11.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[116404]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:05:11.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[116404]: osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987] boot 2024-01-13T18:05:11.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[116404]: osdmap e330: 8 total, 8 up, 8 in 2024-01-13T18:05:11.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:05:11.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:11 smithi099 ceph-mon[138788]: pgmap v205: 121 pgs: 1 active+clean+snaptrim, 8 active+undersized+degraded, 33 active+undersized, 79 active+clean; 340 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.1 MiB/s rd, 1.6 MiB/s wr, 5 op/s; 81/549 objects degraded (14.754%) 2024-01-13T18:05:11.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:11 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 81/549 objects degraded (14.754%), 8 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:11.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:11 smithi099 ceph-mon[138788]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:05:11.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:11 smithi099 ceph-mon[138788]: osd.3 [v2:172.21.15.84:6826/1415184987,v1:172.21.15.84:6827/1415184987] boot 2024-01-13T18:05:11.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:11 smithi099 ceph-mon[138788]: osdmap e330: 8 total, 8 up, 8 in 2024-01-13T18:05:11.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:11 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-13T18:05:11.619 INFO:tasks.rados.rados.0.smithi084.stdout:1347: done (3 left) 2024-01-13T18:05:11.619 INFO:tasks.rados.rados.0.smithi084.stdout:1349: done (2 left) 2024-01-13T18:05:11.619 INFO:tasks.rados.rados.0.smithi084.stdout:1350: done (1 left) 2024-01-13T18:05:11.619 INFO:tasks.rados.rados.0.smithi084.stdout:1353: done (0 left) 2024-01-13T18:05:11.619 INFO:tasks.rados.rados.0.smithi084.stdout:1354: rollback oid 14 current snap is 136 2024-01-13T18:05:11.619 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 127 2024-01-13T18:05:11.619 INFO:tasks.rados.rados.0.smithi084.stdout:1355: snap_remove snap 132 2024-01-13T18:05:11.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:05:11 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:05:11.342+0000 7fcaf82a4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-01-13T18:05:12.600 INFO:tasks.rados.rados.0.smithi084.stdout:1355: done (1 left) 2024-01-13T18:05:12.600 INFO:tasks.rados.rados.0.smithi084.stdout:1356: snap_remove snap 111 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: failed to encode map e331 with expected crc 2024-01-13T18:05:12.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: osdmap e331: 8 total, 8 up, 8 in 2024-01-13T18:05:12.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:12 smithi099 ceph-mon[138788]: failed to encode map e331 with expected crc 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: failed to encode map e331 with expected crc 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: osdmap e331: 8 total, 8 up, 8 in 2024-01-13T18:05:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[116404]: failed to encode map e331 with expected crc 2024-01-13T18:05:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:05:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: failed to encode map e331 with expected crc 2024-01-13T18:05:12.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: osdmap e331: 8 total, 8 up, 8 in 2024-01-13T18:05:12.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:12 smithi084 ceph-mon[119097]: failed to encode map e331 with expected crc 2024-01-13T18:05:13.608 INFO:tasks.rados.rados.0.smithi084.stdout:1356: done (1 left) 2024-01-13T18:05:13.608 INFO:tasks.rados.rados.0.smithi084.stdout:1357: rollback oid 38 current snap is 136 2024-01-13T18:05:13.608 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 98 2024-01-13T18:05:13.608 INFO:tasks.rados.rados.0.smithi084.stdout:1354: finishing rollback tid 1 to smithi084102331-14 2024-01-13T18:05:13.608 INFO:tasks.rados.rados.0.smithi084.stdout:1354: finishing rollback tid 2 to smithi084102331-14 2024-01-13T18:05:13.608 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 494 (ObjNum 351 snap 115 seq_num 351) dirty exists 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1354: done (1 left) 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1358: read oid 30 snap -1 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1358: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1359: read oid 6 snap -1 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1359: expect (ObjNum 387 snap 125 seq_num 387) 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1360: rollback oid 22 current snap is 136 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 124 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1361: read oid 50 snap -1 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1361: expect (ObjNum 412 snap 130 seq_num 412) 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1362: rmattr oid 2 current snap is 136 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1362: done (5 left) 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1363: copy_from oid 1 from oid 19 current snap is 136 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 136 2024-01-13T18:05:13.609 INFO:tasks.rados.rados.0.smithi084.stdout:1364: seq_num 429 ranges {5595136=794624,6389760=770048,7159808=622592,7782400=212992} 2024-01-13T18:05:13.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:13 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:13.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:13 smithi099 ceph-mon[138788]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-01-13T18:05:13.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:13 smithi099 ceph-mon[138788]: failed to encode map e331 with expected crc 2024-01-13T18:05:13.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:13 smithi099 ceph-mon[138788]: failed to encode map e331 with expected crc 2024-01-13T18:05:13.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:13 smithi099 ceph-mon[138788]: pgmap v208: 121 pgs: 1 active+clean+snaptrim, 9 peering, 2 active+undersized+degraded, 2 active+recovery_wait+degraded, 20 active+undersized, 87 active+clean; 350 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 3.2 MiB/s wr, 17 op/s; 25/567 objects degraded (4.409%) 2024-01-13T18:05:13.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:13 smithi099 ceph-mon[138788]: osdmap e332: 8 total, 8 up, 8 in 2024-01-13T18:05:13.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:13 smithi099 ceph-mon[138788]: failed to encode map e332 with expected crc 2024-01-13T18:05:13.645 INFO:tasks.rados.rados.0.smithi084.stdout:1364: writing smithi084102331-4 from 5595136 to 6389760 tid 1 2024-01-13T18:05:13.650 INFO:tasks.rados.rados.0.smithi084.stdout:1364: writing smithi084102331-4 from 6389760 to 7159808 tid 2 2024-01-13T18:05:13.653 INFO:tasks.rados.rados.0.smithi084.stdout:1364: writing smithi084102331-4 from 7159808 to 7782400 tid 3 2024-01-13T18:05:13.655 INFO:tasks.rados.rados.0.smithi084.stdout:1364: writing smithi084102331-4 from 7782400 to 7995392 tid 4 2024-01-13T18:05:13.655 INFO:tasks.rados.rados.0.smithi084.stdout:1365: copy_from oid 40 from oid 34 current snap is 136 2024-01-13T18:05:13.655 INFO:tasks.rados.rados.0.smithi084.stdout:1360: finishing rollback tid 1 to smithi084102331-22 2024-01-13T18:05:13.655 INFO:tasks.rados.rados.0.smithi084.stdout:1360: finishing rollback tid 2 to smithi084102331-22 2024-01-13T18:05:13.655 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 654 (ObjNum 328 snap 103 seq_num 328) dirty exists 2024-01-13T18:05:13.655 INFO:tasks.rados.rados.0.smithi084.stdout:1359: expect (ObjNum 387 snap 125 seq_num 387) 2024-01-13T18:05:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[116404]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-01-13T18:05:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[116404]: failed to encode map e331 with expected crc 2024-01-13T18:05:13.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[116404]: failed to encode map e331 with expected crc 2024-01-13T18:05:13.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[116404]: pgmap v208: 121 pgs: 1 active+clean+snaptrim, 9 peering, 2 active+undersized+degraded, 2 active+recovery_wait+degraded, 20 active+undersized, 87 active+clean; 350 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 3.2 MiB/s wr, 17 op/s; 25/567 objects degraded (4.409%) 2024-01-13T18:05:13.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[116404]: osdmap e332: 8 total, 8 up, 8 in 2024-01-13T18:05:13.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[116404]: failed to encode map e332 with expected crc 2024-01-13T18:05:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[119097]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-01-13T18:05:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[119097]: failed to encode map e331 with expected crc 2024-01-13T18:05:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[119097]: failed to encode map e331 with expected crc 2024-01-13T18:05:13.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[119097]: pgmap v208: 121 pgs: 1 active+clean+snaptrim, 9 peering, 2 active+undersized+degraded, 2 active+recovery_wait+degraded, 20 active+undersized, 87 active+clean; 350 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 3.2 MiB/s wr, 17 op/s; 25/567 objects degraded (4.409%) 2024-01-13T18:05:13.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[119097]: osdmap e332: 8 total, 8 up, 8 in 2024-01-13T18:05:13.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:13 smithi084 ceph-mon[119097]: failed to encode map e332 with expected crc 2024-01-13T18:05:13.702 INFO:tasks.rados.rados.0.smithi084.stdout:1357: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:05:13.702 INFO:tasks.rados.rados.0.smithi084.stdout:1357: finishing rollback tid 2 to smithi084102331-38 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 740 (ObjNum 301 snap 93 seq_num 301) dirty exists 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:1363: finishing copy_from to smithi084102331-1 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:1363: got expected ENOENT (src dne) 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:1363: finishing copy_from racing read to smithi084102331-1 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:1364: finishing write tid 1 to smithi084102331-4 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:1364: finishing write tid 2 to smithi084102331-4 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:1357: done (7 left) 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:1359: done (6 left) 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:1360: done (5 left) 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:1363: done (4 left) 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:1366: read oid 35 snap -1 2024-01-13T18:05:13.703 INFO:tasks.rados.rados.0.smithi084.stdout:1366: expect (ObjNum 419 snap 132 seq_num 419) 2024-01-13T18:05:13.704 INFO:tasks.rados.rados.0.smithi084.stdout:1367: rollback oid 26 current snap is 136 2024-01-13T18:05:13.704 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 126 2024-01-13T18:05:13.704 INFO:tasks.rados.rados.0.smithi084.stdout:1364: finishing write tid 3 to smithi084102331-4 2024-01-13T18:05:13.704 INFO:tasks.rados.rados.0.smithi084.stdout:1364: finishing write tid 4 to smithi084102331-4 2024-01-13T18:05:13.704 INFO:tasks.rados.rados.0.smithi084.stdout:1364: finishing write tid 5 to smithi084102331-4 2024-01-13T18:05:13.704 INFO:tasks.rados.rados.0.smithi084.stdout:1364: finishing write tid 6 to smithi084102331-4 2024-01-13T18:05:13.704 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 484 (ObjNum 429 snap 136 seq_num 429) dirty exists 2024-01-13T18:05:13.704 INFO:tasks.rados.rados.0.smithi084.stdout:1364: left oid 4 (ObjNum 429 snap 136 seq_num 429) 2024-01-13T18:05:13.704 INFO:tasks.rados.rados.0.smithi084.stdout:1365: finishing copy_from to smithi084102331-40 2024-01-13T18:05:13.704 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 354 (ObjNum 341 snap 107 seq_num 341) dirty exists 2024-01-13T18:05:13.704 INFO:tasks.rados.rados.0.smithi084.stdout:1365: finishing copy_from racing read to smithi084102331-40 2024-01-13T18:05:13.705 INFO:tasks.rados.rados.0.smithi084.stdout:1358: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:05:14.144 INFO:tasks.rados.rados.0.smithi084.stdout:1361: expect (ObjNum 412 snap 130 seq_num 412) 2024-01-13T18:05:14.284 INFO:tasks.rados.rados.0.smithi084.stdout:1367: finishing rollback tid 1 to smithi084102331-26 2024-01-13T18:05:14.285 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 445 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-01-13T18:05:14.285 INFO:tasks.rados.rados.0.smithi084.stdout:1358: done (5 left) 2024-01-13T18:05:14.285 INFO:tasks.rados.rados.0.smithi084.stdout:1361: done (4 left) 2024-01-13T18:05:14.285 INFO:tasks.rados.rados.0.smithi084.stdout:1364: done (3 left) 2024-01-13T18:05:14.285 INFO:tasks.rados.rados.0.smithi084.stdout:1365: done (2 left) 2024-01-13T18:05:14.285 INFO:tasks.rados.rados.0.smithi084.stdout:1367: done (1 left) 2024-01-13T18:05:14.285 INFO:tasks.rados.rados.0.smithi084.stdout:1368: rollback oid 9 current snap is 136 2024-01-13T18:05:14.285 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 128 2024-01-13T18:05:14.285 INFO:tasks.rados.rados.0.smithi084.stdout:1366: expect (ObjNum 419 snap 132 seq_num 419) 2024-01-13T18:05:14.591 INFO:tasks.rados.rados.0.smithi084.stdout:1368: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:05:14.591 INFO:tasks.rados.rados.0.smithi084.stdout:1368: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:05:14.592 INFO:tasks.rados.rados.0.smithi084.stdout:1366: done (1 left) 2024-01-13T18:05:14.592 INFO:tasks.rados.rados.0.smithi084.stdout:1369: snap_create 2024-01-13T18:05:14.592 INFO:tasks.rados.rados.0.smithi084.stdout:1368: finishing rollback tid 2 to smithi084102331-9 2024-01-13T18:05:14.592 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 434 (ObjNum 341 snap 107 seq_num 341) dirty exists 2024-01-13T18:05:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:14 smithi099 ceph-mon[138788]: failed to encode map e332 with expected crc 2024-01-13T18:05:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:14 smithi099 ceph-mon[138788]: failed to encode map e333 with expected crc 2024-01-13T18:05:14.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:14 smithi099 ceph-mon[138788]: osdmap e333: 8 total, 8 up, 8 in 2024-01-13T18:05:14.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:14 smithi084 ceph-mon[116404]: failed to encode map e332 with expected crc 2024-01-13T18:05:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:14 smithi084 ceph-mon[116404]: failed to encode map e333 with expected crc 2024-01-13T18:05:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:14 smithi084 ceph-mon[116404]: osdmap e333: 8 total, 8 up, 8 in 2024-01-13T18:05:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:14 smithi084 ceph-mon[119097]: failed to encode map e332 with expected crc 2024-01-13T18:05:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:14 smithi084 ceph-mon[119097]: failed to encode map e333 with expected crc 2024-01-13T18:05:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:14 smithi084 ceph-mon[119097]: osdmap e333: 8 total, 8 up, 8 in 2024-01-13T18:05:15.204 INFO:tasks.rados.rados.0.smithi084.stdout:1368: done (1 left) 2024-01-13T18:05:15.205 INFO:tasks.rados.rados.0.smithi084.stdout:1369: done (0 left) 2024-01-13T18:05:15.205 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 137 2024-01-13T18:05:15.205 INFO:tasks.rados.rados.0.smithi084.stdout:1370: seq_num 430 ranges {2367488=8192} 2024-01-13T18:05:15.216 INFO:tasks.rados.rados.0.smithi084.stdout:1370: writing smithi084102331-5 from 2367488 to 2375680 tid 1 2024-01-13T18:05:15.216 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 137 2024-01-13T18:05:15.216 INFO:tasks.rados.rados.0.smithi084.stdout:1371: seq_num 431 ranges {2998272=24576} 2024-01-13T18:05:15.233 INFO:tasks.rados.rados.0.smithi084.stdout:1371: writing smithi084102331-10 from 2998272 to 3022848 tid 1 2024-01-13T18:05:15.233 INFO:tasks.rados.rados.0.smithi084.stdout:1372: rmattr oid 30 current snap is 137 2024-01-13T18:05:15.233 INFO:tasks.rados.rados.0.smithi084.stdout:1372: done (2 left) 2024-01-13T18:05:15.233 INFO:tasks.rados.rados.0.smithi084.stdout:1373: copy_from oid 33 from oid 50 current snap is 137 2024-01-13T18:05:15.234 INFO:tasks.rados.rados.0.smithi084.stdout:1370: finishing write tid 1 to smithi084102331-5 2024-01-13T18:05:15.234 INFO:tasks.rados.rados.0.smithi084.stdout:1370: finishing write tid 2 to smithi084102331-5 2024-01-13T18:05:15.234 INFO:tasks.rados.rados.0.smithi084.stdout:1370: finishing write tid 3 to smithi084102331-5 2024-01-13T18:05:15.234 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 487 (ObjNum 430 snap 137 seq_num 430) dirty exists 2024-01-13T18:05:15.234 INFO:tasks.rados.rados.0.smithi084.stdout:1370: left oid 5 (ObjNum 430 snap 137 seq_num 430) 2024-01-13T18:05:15.234 INFO:tasks.rados.rados.0.smithi084.stdout:1370: done (2 left) 2024-01-13T18:05:15.234 INFO:tasks.rados.rados.0.smithi084.stdout:1374: read oid 28 snap -1 2024-01-13T18:05:15.234 INFO:tasks.rados.rados.0.smithi084.stdout:1374: expect (ObjNum 370 snap 119 seq_num 370) 2024-01-13T18:05:15.234 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 137 2024-01-13T18:05:15.234 INFO:tasks.rados.rados.0.smithi084.stdout:1375: seq_num 432 ranges {630784=40960} 2024-01-13T18:05:15.237 INFO:tasks.rados.rados.0.smithi084.stdout:1375: writing smithi084102331-20 from 630784 to 671744 tid 1 2024-01-13T18:05:15.237 INFO:tasks.rados.rados.0.smithi084.stdout:1376: copy_from oid 36 from oid 38 current snap is 137 2024-01-13T18:05:15.237 INFO:tasks.rados.rados.0.smithi084.stdout:1371: finishing write tid 1 to smithi084102331-10 2024-01-13T18:05:15.237 INFO:tasks.rados.rados.0.smithi084.stdout:1377: snap_remove snap 127 2024-01-13T18:05:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:15 smithi099 ceph-mon[138788]: failed to encode map e333 with expected crc 2024-01-13T18:05:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:15 smithi099 ceph-mon[138788]: failed to encode map e333 with expected crc 2024-01-13T18:05:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:15 smithi099 ceph-mon[138788]: pgmap v211: 121 pgs: 9 peering, 1 active+undersized+degraded, 2 active+recovery_wait+degraded, 15 active+undersized, 94 active+clean; 352 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 3.7 MiB/s wr, 19 op/s; 24/570 objects degraded (4.211%) 2024-01-13T18:05:15.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:15 smithi084 ceph-mon[116404]: failed to encode map e333 with expected crc 2024-01-13T18:05:15.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:15 smithi084 ceph-mon[116404]: failed to encode map e333 with expected crc 2024-01-13T18:05:15.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:15 smithi084 ceph-mon[116404]: pgmap v211: 121 pgs: 9 peering, 1 active+undersized+degraded, 2 active+recovery_wait+degraded, 15 active+undersized, 94 active+clean; 352 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 3.7 MiB/s wr, 19 op/s; 24/570 objects degraded (4.211%) 2024-01-13T18:05:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:15 smithi084 ceph-mon[119097]: failed to encode map e333 with expected crc 2024-01-13T18:05:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:15 smithi084 ceph-mon[119097]: failed to encode map e333 with expected crc 2024-01-13T18:05:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:15 smithi084 ceph-mon[119097]: pgmap v211: 121 pgs: 9 peering, 1 active+undersized+degraded, 2 active+recovery_wait+degraded, 15 active+undersized, 94 active+clean; 352 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 8.4 MiB/s rd, 3.7 MiB/s wr, 19 op/s; 24/570 objects degraded (4.211%) 2024-01-13T18:05:16.204 INFO:tasks.rados.rados.0.smithi084.stdout:1377: done (5 left) 2024-01-13T18:05:16.204 INFO:tasks.rados.rados.0.smithi084.stdout:1378: snap_remove snap 133 2024-01-13T18:05:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:16 smithi099 ceph-mon[138788]: osdmap e334: 8 total, 8 up, 8 in 2024-01-13T18:05:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:16 smithi099 ceph-mon[138788]: failed to encode map e334 with expected crc 2024-01-13T18:05:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:16 smithi099 ceph-mon[138788]: failed to encode map e334 with expected crc 2024-01-13T18:05:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:16 smithi099 ceph-mon[138788]: failed to encode map e334 with expected crc 2024-01-13T18:05:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:16 smithi099 ceph-mon[138788]: failed to encode map e334 with expected crc 2024-01-13T18:05:16.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:16 smithi084 ceph-mon[119097]: osdmap e334: 8 total, 8 up, 8 in 2024-01-13T18:05:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:16 smithi084 ceph-mon[119097]: failed to encode map e334 with expected crc 2024-01-13T18:05:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:16 smithi084 ceph-mon[119097]: failed to encode map e334 with expected crc 2024-01-13T18:05:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:16 smithi084 ceph-mon[119097]: failed to encode map e334 with expected crc 2024-01-13T18:05:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:16 smithi084 ceph-mon[119097]: failed to encode map e334 with expected crc 2024-01-13T18:05:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:16 smithi084 ceph-mon[116404]: osdmap e334: 8 total, 8 up, 8 in 2024-01-13T18:05:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:16 smithi084 ceph-mon[116404]: failed to encode map e334 with expected crc 2024-01-13T18:05:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:16 smithi084 ceph-mon[116404]: failed to encode map e334 with expected crc 2024-01-13T18:05:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:16 smithi084 ceph-mon[116404]: failed to encode map e334 with expected crc 2024-01-13T18:05:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:16 smithi084 ceph-mon[116404]: failed to encode map e334 with expected crc 2024-01-13T18:05:17.212 INFO:tasks.rados.rados.0.smithi084.stdout:1378: done (5 left) 2024-01-13T18:05:17.212 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 137 2024-01-13T18:05:17.213 INFO:tasks.rados.rados.0.smithi084.stdout:1371: finishing write tid 2 to smithi084102331-10 2024-01-13T18:05:17.213 INFO:tasks.rados.rados.0.smithi084.stdout:1379: seq_num 433 ranges {0=57344} 2024-01-13T18:05:17.213 INFO:tasks.rados.rados.0.smithi084.stdout:1379: writing smithi084102331-29 from 0 to 57344 tid 1 2024-01-13T18:05:17.213 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 137 2024-01-13T18:05:17.213 INFO:tasks.rados.rados.0.smithi084.stdout:1380: seq_num 434 ranges {1318912=73728} 2024-01-13T18:05:17.222 INFO:tasks.rados.rados.0.smithi084.stdout:1380: writing smithi084102331-25 from 1318912 to 1392640 tid 1 2024-01-13T18:05:17.222 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 137 2024-01-13T18:05:17.222 INFO:tasks.rados.rados.0.smithi084.stdout:1381: seq_num 435 ranges {3940352=90112} 2024-01-13T18:05:17.243 INFO:tasks.rados.rados.0.smithi084.stdout:1381: writing smithi084102331-39 from 3940352 to 4030464 tid 1 2024-01-13T18:05:17.243 INFO:tasks.rados.rados.0.smithi084.stdout:1382: copy_from oid 32 from oid 42 current snap is 137 2024-01-13T18:05:17.243 INFO:tasks.rados.rados.0.smithi084.stdout:1371: finishing write tid 3 to smithi084102331-10 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 345 (ObjNum 431 snap 137 seq_num 431) dirty exists 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:1371: left oid 10 (ObjNum 431 snap 137 seq_num 431) 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:1375: finishing write tid 1 to smithi084102331-20 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:1375: finishing write tid 2 to smithi084102331-20 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:1375: finishing write tid 3 to smithi084102331-20 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 430 (ObjNum 432 snap 137 seq_num 432) dirty exists 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:1375: left oid 20 (ObjNum 432 snap 137 seq_num 432) 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:1376: finishing copy_from to smithi084102331-36 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 740 (ObjNum 301 snap 93 seq_num 301) dirty exists 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:1376: finishing copy_from racing read to smithi084102331-36 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:1371: done (8 left) 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:1375: done (7 left) 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:1376: done (6 left) 2024-01-13T18:05:17.244 INFO:tasks.rados.rados.0.smithi084.stdout:1383: copy_from oid 5 from oid 35 current snap is 137 2024-01-13T18:05:17.245 INFO:tasks.rados.rados.0.smithi084.stdout:1374: expect (ObjNum 370 snap 119 seq_num 370) 2024-01-13T18:05:17.405 INFO:tasks.rados.rados.0.smithi084.stdout:1373: finishing copy_from to smithi084102331-33 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 579 (ObjNum 412 snap 130 seq_num 412) dirty exists 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:1373: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:1373: done (6 left) 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:1374: done (5 left) 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:1384: rollback oid 38 current snap is 137 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 98 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:1379: finishing write tid 1 to smithi084102331-29 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:1379: finishing write tid 2 to smithi084102331-29 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:1379: finishing write tid 3 to smithi084102331-29 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 499 (ObjNum 433 snap 137 seq_num 433) dirty exists 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:1379: left oid 29 (ObjNum 433 snap 137 seq_num 433) 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:1380: finishing write tid 1 to smithi084102331-25 2024-01-13T18:05:17.406 INFO:tasks.rados.rados.0.smithi084.stdout:1380: finishing write tid 2 to smithi084102331-25 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1380: finishing write tid 3 to smithi084102331-25 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 624 (ObjNum 434 snap 137 seq_num 434) dirty exists 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1380: left oid 25 (ObjNum 434 snap 137 seq_num 434) 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1381: finishing write tid 1 to smithi084102331-39 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1381: finishing write tid 2 to smithi084102331-39 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1381: finishing write tid 3 to smithi084102331-39 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 450 (ObjNum 435 snap 137 seq_num 435) dirty exists 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1381: left oid 39 (ObjNum 435 snap 137 seq_num 435) 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1382: finishing copy_from to smithi084102331-32 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 326 (ObjNum 317 snap 100 seq_num 317) dirty exists 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1382: finishing copy_from racing read to smithi084102331-32 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1383: finishing copy_from to smithi084102331-5 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 459 (ObjNum 419 snap 132 seq_num 419) dirty exists 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1383: finishing copy_from racing read to smithi084102331-5 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1379: done (5 left) 2024-01-13T18:05:17.407 INFO:tasks.rados.rados.0.smithi084.stdout:1380: done (4 left) 2024-01-13T18:05:17.408 INFO:tasks.rados.rados.0.smithi084.stdout:1381: done (3 left) 2024-01-13T18:05:17.408 INFO:tasks.rados.rados.0.smithi084.stdout:1382: done (2 left) 2024-01-13T18:05:17.408 INFO:tasks.rados.rados.0.smithi084.stdout:1383: done (1 left) 2024-01-13T18:05:17.408 INFO:tasks.rados.rados.0.smithi084.stdout:1385: read oid 18 snap -1 2024-01-13T18:05:17.408 INFO:tasks.rados.rados.0.smithi084.stdout:1385: expect (ObjNum 425 snap 135 seq_num 425) 2024-01-13T18:05:17.408 INFO:tasks.rados.rados.0.smithi084.stdout:1386: snap_remove snap 106 2024-01-13T18:05:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:17 smithi099 ceph-mon[138788]: pgmap v213: 121 pgs: 2 active+recovery_wait+degraded, 119 active+clean; 357 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.1 MiB/s wr, 15 op/s; 10/543 objects degraded (1.842%); 5.6 MiB/s, 1 objects/s recovering 2024-01-13T18:05:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:17 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 10/543 objects degraded (1.842%), 2 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:17 smithi099 ceph-mon[138788]: failed to encode map e335 with expected crc 2024-01-13T18:05:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:17 smithi099 ceph-mon[138788]: failed to encode map e335 with expected crc 2024-01-13T18:05:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:17 smithi099 ceph-mon[138788]: osdmap e335: 8 total, 8 up, 8 in 2024-01-13T18:05:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:17 smithi084 ceph-mon[116404]: pgmap v213: 121 pgs: 2 active+recovery_wait+degraded, 119 active+clean; 357 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.1 MiB/s wr, 15 op/s; 10/543 objects degraded (1.842%); 5.6 MiB/s, 1 objects/s recovering 2024-01-13T18:05:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:17 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 10/543 objects degraded (1.842%), 2 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:17 smithi084 ceph-mon[116404]: failed to encode map e335 with expected crc 2024-01-13T18:05:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:17 smithi084 ceph-mon[116404]: failed to encode map e335 with expected crc 2024-01-13T18:05:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:17 smithi084 ceph-mon[116404]: osdmap e335: 8 total, 8 up, 8 in 2024-01-13T18:05:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:17 smithi084 ceph-mon[119097]: pgmap v213: 121 pgs: 2 active+recovery_wait+degraded, 119 active+clean; 357 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.1 MiB/s wr, 15 op/s; 10/543 objects degraded (1.842%); 5.6 MiB/s, 1 objects/s recovering 2024-01-13T18:05:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:17 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 10/543 objects degraded (1.842%), 2 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:17 smithi084 ceph-mon[119097]: failed to encode map e335 with expected crc 2024-01-13T18:05:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:17 smithi084 ceph-mon[119097]: failed to encode map e335 with expected crc 2024-01-13T18:05:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:17 smithi084 ceph-mon[119097]: osdmap e335: 8 total, 8 up, 8 in 2024-01-13T18:05:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:1386: done (2 left) 2024-01-13T18:05:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:1387: copy_from oid 19 from oid 10 current snap is 137 2024-01-13T18:05:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:1384: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:05:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:1384: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:05:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:1384: finishing rollback tid 2 to smithi084102331-38 2024-01-13T18:05:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 766 (ObjNum 301 snap 93 seq_num 301) dirty exists 2024-01-13T18:05:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:1385: expect (ObjNum 425 snap 135 seq_num 425) 2024-01-13T18:05:18.325 INFO:tasks.rados.rados.0.smithi084.stdout:1387: finishing copy_from to smithi084102331-19 2024-01-13T18:05:18.325 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 345 (ObjNum 431 snap 137 seq_num 431) dirty exists 2024-01-13T18:05:18.325 INFO:tasks.rados.rados.0.smithi084.stdout:1387: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:05:18.325 INFO:tasks.rados.rados.0.smithi084.stdout:1384: done (2 left) 2024-01-13T18:05:18.325 INFO:tasks.rados.rados.0.smithi084.stdout:1385: done (1 left) 2024-01-13T18:05:18.325 INFO:tasks.rados.rados.0.smithi084.stdout:1387: done (0 left) 2024-01-13T18:05:18.325 INFO:tasks.rados.rados.0.smithi084.stdout:1388: read oid 19 snap 105 2024-01-13T18:05:18.325 INFO:tasks.rados.rados.0.smithi084.stdout:1388: expect (ObjNum 326 snap 102 seq_num 326) 2024-01-13T18:05:18.325 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 137 2024-01-13T18:05:18.325 INFO:tasks.rados.rados.0.smithi084.stdout:1389: seq_num 436 ranges {4136960=106496} 2024-01-13T18:05:18.347 INFO:tasks.rados.rados.0.smithi084.stdout:1389: writing smithi084102331-11 from 4136960 to 4243456 tid 1 2024-01-13T18:05:18.347 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 137 2024-01-13T18:05:18.347 INFO:tasks.rados.rados.0.smithi084.stdout:1388: expect (ObjNum 326 snap 102 seq_num 326) 2024-01-13T18:05:18.365 INFO:tasks.rados.rados.0.smithi084.stdout:1389: finishing write tid 1 to smithi084102331-11 2024-01-13T18:05:18.365 INFO:tasks.rados.rados.0.smithi084.stdout:1389: finishing write tid 2 to smithi084102331-11 2024-01-13T18:05:18.365 INFO:tasks.rados.rados.0.smithi084.stdout:1389: finishing write tid 3 to smithi084102331-11 2024-01-13T18:05:18.365 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 459 (ObjNum 436 snap 137 seq_num 436) dirty exists 2024-01-13T18:05:18.365 INFO:tasks.rados.rados.0.smithi084.stdout:1389: left oid 11 (ObjNum 436 snap 137 seq_num 436) 2024-01-13T18:05:18.365 INFO:tasks.rados.rados.0.smithi084.stdout:1390: seq_num 437 ranges {1957888=122880} 2024-01-13T18:05:18.375 INFO:tasks.rados.rados.0.smithi084.stdout:1390: writing smithi084102331-14 from 1957888 to 2080768 tid 1 2024-01-13T18:05:18.376 INFO:tasks.rados.rados.0.smithi084.stdout:1388: done (2 left) 2024-01-13T18:05:18.376 INFO:tasks.rados.rados.0.smithi084.stdout:1389: done (1 left) 2024-01-13T18:05:18.376 INFO:tasks.rados.rados.0.smithi084.stdout:1391: setattr oid 42 current snap is 137 2024-01-13T18:05:18.377 INFO:tasks.rados.rados.0.smithi084.stdout:1392: rollback oid 47 current snap is 137 2024-01-13T18:05:18.377 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 134 2024-01-13T18:05:18.377 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 137 2024-01-13T18:05:18.377 INFO:tasks.rados.rados.0.smithi084.stdout:1393: seq_num 438 ranges {7741440=139264} 2024-01-13T18:05:18.419 INFO:tasks.rados.rados.0.smithi084.stdout:1393: writing smithi084102331-2 from 7741440 to 7880704 tid 1 2024-01-13T18:05:18.419 INFO:tasks.rados.rados.0.smithi084.stdout:1394: rmattr oid 37 current snap is 137 2024-01-13T18:05:18.419 INFO:tasks.rados.rados.0.smithi084.stdout:1390: finishing write tid 1 to smithi084102331-14 2024-01-13T18:05:18.419 INFO:tasks.rados.rados.0.smithi084.stdout:1390: finishing write tid 2 to smithi084102331-14 2024-01-13T18:05:18.419 INFO:tasks.rados.rados.0.smithi084.stdout:1395: read oid 19 snap -1 2024-01-13T18:05:18.420 INFO:tasks.rados.rados.0.smithi084.stdout:1395: expect (ObjNum 431 snap 137 seq_num 431) 2024-01-13T18:05:18.420 INFO:tasks.rados.rados.0.smithi084.stdout:1396: snap_create 2024-01-13T18:05:18.420 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 327 (ObjNum 317 snap 100 seq_num 317) dirty exists 2024-01-13T18:05:18.420 INFO:tasks.rados.rados.0.smithi084.stdout:1392: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:05:18.420 INFO:tasks.rados.rados.0.smithi084.stdout:1392: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:05:18.420 INFO:tasks.rados.rados.0.smithi084.stdout:1390: finishing write tid 3 to smithi084102331-14 2024-01-13T18:05:18.420 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 742 (ObjNum 437 snap 137 seq_num 437) dirty exists 2024-01-13T18:05:18.420 INFO:tasks.rados.rados.0.smithi084.stdout:1390: left oid 14 (ObjNum 437 snap 137 seq_num 437) 2024-01-13T18:05:18.420 INFO:tasks.rados.rados.0.smithi084.stdout:1392: finishing rollback tid 2 to smithi084102331-47 2024-01-13T18:05:18.420 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 723 (ObjNum 286 snap 89 seq_num 286) dirty exists 2024-01-13T18:05:18.422 INFO:tasks.rados.rados.0.smithi084.stdout:1393: finishing write tid 1 to smithi084102331-2 2024-01-13T18:05:18.422 INFO:tasks.rados.rados.0.smithi084.stdout:1393: finishing write tid 2 to smithi084102331-2 2024-01-13T18:05:18.422 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 632 (ObjNum 81 snap 0 seq_num 1550471760) dirty exists 2024-01-13T18:05:18.425 INFO:tasks.rados.rados.0.smithi084.stdout:1393: finishing write tid 3 to smithi084102331-2 2024-01-13T18:05:18.425 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 685 (ObjNum 438 snap 137 seq_num 438) dirty exists 2024-01-13T18:05:18.425 INFO:tasks.rados.rados.0.smithi084.stdout:1393: left oid 2 (ObjNum 438 snap 137 seq_num 438) 2024-01-13T18:05:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:1395: expect (ObjNum 431 snap 137 seq_num 431) 2024-01-13T18:05:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:18 smithi099 ceph-mon[138788]: osdmap e336: 8 total, 8 up, 8 in 2024-01-13T18:05:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:18 smithi099 ceph-mon[138788]: failed to encode map e336 with expected crc 2024-01-13T18:05:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:18 smithi099 ceph-mon[138788]: failed to encode map e336 with expected crc 2024-01-13T18:05:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:18 smithi099 ceph-mon[138788]: failed to encode map e336 with expected crc 2024-01-13T18:05:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:18 smithi084 ceph-mon[116404]: osdmap e336: 8 total, 8 up, 8 in 2024-01-13T18:05:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:18 smithi084 ceph-mon[116404]: failed to encode map e336 with expected crc 2024-01-13T18:05:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:18 smithi084 ceph-mon[116404]: failed to encode map e336 with expected crc 2024-01-13T18:05:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:18 smithi084 ceph-mon[116404]: failed to encode map e336 with expected crc 2024-01-13T18:05:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:18 smithi084 ceph-mon[119097]: osdmap e336: 8 total, 8 up, 8 in 2024-01-13T18:05:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:18 smithi084 ceph-mon[119097]: failed to encode map e336 with expected crc 2024-01-13T18:05:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:18 smithi084 ceph-mon[119097]: failed to encode map e336 with expected crc 2024-01-13T18:05:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:18 smithi084 ceph-mon[119097]: failed to encode map e336 with expected crc 2024-01-13T18:05:19.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:05:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:05:18.660Z caller=alerting.go:366 level=warn component="rule manager" alert="unsupported value type" msg="Expanding alert template failed" err="error executing template __alert_CephOSDDown: template: __alert_CephOSDDown:1:358: executing \"__alert_CephOSDDown\" at : error calling query: found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" data="unsupported value type" 2024-01-13T18:05:19.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:05:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:05:18.661Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:05:19.231 INFO:tasks.rados.rados.0.smithi084.stdout:1390: done (6 left) 2024-01-13T18:05:19.231 INFO:tasks.rados.rados.0.smithi084.stdout:1391: done (5 left) 2024-01-13T18:05:19.231 INFO:tasks.rados.rados.0.smithi084.stdout:1392: done (4 left) 2024-01-13T18:05:19.231 INFO:tasks.rados.rados.0.smithi084.stdout:1393: done (3 left) 2024-01-13T18:05:19.231 INFO:tasks.rados.rados.0.smithi084.stdout:1394: done (2 left) 2024-01-13T18:05:19.231 INFO:tasks.rados.rados.0.smithi084.stdout:1395: done (1 left) 2024-01-13T18:05:19.231 INFO:tasks.rados.rados.0.smithi084.stdout:1396: done (0 left) 2024-01-13T18:05:19.231 INFO:tasks.rados.rados.0.smithi084.stdout:1397: read oid 49 snap -1 2024-01-13T18:05:19.231 INFO:tasks.rados.rados.0.smithi084.stdout:1397: expect (ObjNum 319 snap 101 seq_num 319) 2024-01-13T18:05:19.231 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 138 2024-01-13T18:05:19.231 INFO:tasks.rados.rados.0.smithi084.stdout:1398: seq_num 439 ranges {1687552=155648} 2024-01-13T18:05:19.241 INFO:tasks.rados.rados.0.smithi084.stdout:1398: writing smithi084102331-45 from 1687552 to 1843200 tid 1 2024-01-13T18:05:19.241 INFO:tasks.rados.rados.0.smithi084.stdout:1399: read oid 26 snap -1 2024-01-13T18:05:19.241 INFO:tasks.rados.rados.0.smithi084.stdout:1399: expect deleted 2024-01-13T18:05:19.241 INFO:tasks.rados.rados.0.smithi084.stdout:1400: read oid 38 snap -1 2024-01-13T18:05:19.241 INFO:tasks.rados.rados.0.smithi084.stdout:1400: expect (ObjNum 301 snap 93 seq_num 301) 2024-01-13T18:05:19.241 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 138 2024-01-13T18:05:19.241 INFO:tasks.rados.rados.0.smithi084.stdout:1397: expect (ObjNum 319 snap 101 seq_num 319) 2024-01-13T18:05:19.259 INFO:tasks.rados.rados.0.smithi084.stdout:1401: seq_num 440 ranges {7282688=172032} 2024-01-13T18:05:19.298 INFO:tasks.rados.rados.0.smithi084.stdout:1401: writing smithi084102331-12 from 7282688 to 7454720 tid 1 2024-01-13T18:05:19.299 INFO:tasks.rados.rados.0.smithi084.stdout:1397: done (4 left) 2024-01-13T18:05:19.299 INFO:tasks.rados.rados.0.smithi084.stdout:1399: done (3 left) 2024-01-13T18:05:19.299 INFO:tasks.rados.rados.0.smithi084.stdout:1402: rollback oid 3 current snap is 138 2024-01-13T18:05:19.299 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 131 2024-01-13T18:05:19.299 INFO:tasks.rados.rados.0.smithi084.stdout:1398: finishing write tid 1 to smithi084102331-45 2024-01-13T18:05:19.299 INFO:tasks.rados.rados.0.smithi084.stdout:1398: finishing write tid 2 to smithi084102331-45 2024-01-13T18:05:19.299 INFO:tasks.rados.rados.0.smithi084.stdout:1398: finishing write tid 3 to smithi084102331-45 2024-01-13T18:05:19.299 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 779 (ObjNum 439 snap 138 seq_num 439) dirty exists 2024-01-13T18:05:19.299 INFO:tasks.rados.rados.0.smithi084.stdout:1398: left oid 45 (ObjNum 439 snap 138 seq_num 439) 2024-01-13T18:05:19.299 INFO:tasks.rados.rados.0.smithi084.stdout:1400: expect (ObjNum 301 snap 93 seq_num 301) 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:1402: finishing rollback tid 0 to smithi084102331-3 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:1402: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:1402: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 783 (ObjNum 401 snap 128 seq_num 401) dirty exists 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:1401: finishing write tid 1 to smithi084102331-12 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:1401: finishing write tid 2 to smithi084102331-12 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:1401: finishing write tid 3 to smithi084102331-12 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 688 (ObjNum 440 snap 138 seq_num 440) dirty exists 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:1401: left oid 12 (ObjNum 440 snap 138 seq_num 440) 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:1398: done (3 left) 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:1400: done (2 left) 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:1401: done (1 left) 2024-01-13T18:05:19.313 INFO:tasks.rados.rados.0.smithi084.stdout:1402: done (0 left) 2024-01-13T18:05:19.314 INFO:tasks.rados.rados.0.smithi084.stdout:1403: read oid 6 snap -1 2024-01-13T18:05:19.314 INFO:tasks.rados.rados.0.smithi084.stdout:1403: expect (ObjNum 387 snap 125 seq_num 387) 2024-01-13T18:05:19.314 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 138 2024-01-13T18:05:19.314 INFO:tasks.rados.rados.0.smithi084.stdout:1404: seq_num 441 ranges {4243456=188416} 2024-01-13T18:05:19.336 INFO:tasks.rados.rados.0.smithi084.stdout:1404: writing smithi084102331-11 from 4243456 to 4431872 tid 1 2024-01-13T18:05:19.337 INFO:tasks.rados.rados.0.smithi084.stdout:1405: snap_remove snap 134 2024-01-13T18:05:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:19 smithi099 ceph-mon[138788]: pgmap v216: 121 pgs: 121 active+clean; 351 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.2 MiB/s wr, 10 op/s; 13 MiB/s, 3 objects/s recovering 2024-01-13T18:05:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:19 smithi099 ceph-mon[138788]: failed to encode map e337 with expected crc 2024-01-13T18:05:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:19 smithi099 ceph-mon[138788]: osdmap e337: 8 total, 8 up, 8 in 2024-01-13T18:05:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:19 smithi099 ceph-mon[138788]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/543 objects degraded (1.842%), 2 pgs degraded) 2024-01-13T18:05:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:19 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:05:19.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:19 smithi084 ceph-mon[116404]: pgmap v216: 121 pgs: 121 active+clean; 351 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.2 MiB/s wr, 10 op/s; 13 MiB/s, 3 objects/s recovering 2024-01-13T18:05:19.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:19 smithi084 ceph-mon[116404]: failed to encode map e337 with expected crc 2024-01-13T18:05:19.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:19 smithi084 ceph-mon[116404]: osdmap e337: 8 total, 8 up, 8 in 2024-01-13T18:05:19.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:19 smithi084 ceph-mon[116404]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/543 objects degraded (1.842%), 2 pgs degraded) 2024-01-13T18:05:19.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:19 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:05:19.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:19 smithi084 ceph-mon[119097]: pgmap v216: 121 pgs: 121 active+clean; 351 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.2 MiB/s wr, 10 op/s; 13 MiB/s, 3 objects/s recovering 2024-01-13T18:05:19.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:19 smithi084 ceph-mon[119097]: failed to encode map e337 with expected crc 2024-01-13T18:05:19.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:19 smithi084 ceph-mon[119097]: osdmap e337: 8 total, 8 up, 8 in 2024-01-13T18:05:19.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:19 smithi084 ceph-mon[119097]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/543 objects degraded (1.842%), 2 pgs degraded) 2024-01-13T18:05:19.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:19 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:05:20.240 INFO:tasks.rados.rados.0.smithi084.stdout:1405: done (2 left) 2024-01-13T18:05:20.240 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 138 2024-01-13T18:05:20.240 INFO:tasks.rados.rados.0.smithi084.stdout:1403: expect (ObjNum 387 snap 125 seq_num 387) 2024-01-13T18:05:20.281 INFO:tasks.rados.rados.0.smithi084.stdout:1404: finishing write tid 1 to smithi084102331-11 2024-01-13T18:05:20.281 INFO:tasks.rados.rados.0.smithi084.stdout:1404: finishing write tid 2 to smithi084102331-11 2024-01-13T18:05:20.281 INFO:tasks.rados.rados.0.smithi084.stdout:1404: finishing write tid 3 to smithi084102331-11 2024-01-13T18:05:20.281 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 462 (ObjNum 441 snap 138 seq_num 441) dirty exists 2024-01-13T18:05:20.281 INFO:tasks.rados.rados.0.smithi084.stdout:1404: left oid 11 (ObjNum 441 snap 138 seq_num 441) 2024-01-13T18:05:20.281 INFO:tasks.rados.rados.0.smithi084.stdout:1406: seq_num 442 ranges {3661824=204800} 2024-01-13T18:05:20.302 INFO:tasks.rados.rados.0.smithi084.stdout:1406: writing smithi084102331-21 from 3661824 to 3866624 tid 1 2024-01-13T18:05:20.302 INFO:tasks.rados.rados.0.smithi084.stdout:1403: done (2 left) 2024-01-13T18:05:20.302 INFO:tasks.rados.rados.0.smithi084.stdout:1404: done (1 left) 2024-01-13T18:05:20.302 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 138 2024-01-13T18:05:20.302 INFO:tasks.rados.rados.0.smithi084.stdout:1407: seq_num 443 ranges {7995392=221184} 2024-01-13T18:05:20.346 INFO:tasks.rados.rados.0.smithi084.stdout:1407: writing smithi084102331-4 from 7995392 to 8216576 tid 1 2024-01-13T18:05:20.346 INFO:tasks.rados.rados.0.smithi084.stdout:1408: copy_from oid 18 from oid 49 current snap is 138 2024-01-13T18:05:20.346 INFO:tasks.rados.rados.0.smithi084.stdout:1406: finishing write tid 1 to smithi084102331-21 2024-01-13T18:05:20.346 INFO:tasks.rados.rados.0.smithi084.stdout:1406: finishing write tid 2 to smithi084102331-21 2024-01-13T18:05:20.346 INFO:tasks.rados.rados.0.smithi084.stdout:1406: finishing write tid 3 to smithi084102331-21 2024-01-13T18:05:20.347 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 512 (ObjNum 442 snap 138 seq_num 442) dirty exists 2024-01-13T18:05:20.347 INFO:tasks.rados.rados.0.smithi084.stdout:1406: left oid 21 (ObjNum 442 snap 138 seq_num 442) 2024-01-13T18:05:20.347 INFO:tasks.rados.rados.0.smithi084.stdout:1406: done (2 left) 2024-01-13T18:05:20.347 INFO:tasks.rados.rados.0.smithi084.stdout:1409: read oid 5 snap 98 2024-01-13T18:05:20.347 INFO:tasks.rados.rados.0.smithi084.stdout:1409: expect deleted 2024-01-13T18:05:20.347 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 138 2024-01-13T18:05:20.347 INFO:tasks.rados.rados.0.smithi084.stdout:1410: seq_num 444 ranges {671744=237568} 2024-01-13T18:05:20.353 INFO:tasks.rados.rados.0.smithi084.stdout:1410: writing smithi084102331-20 from 671744 to 909312 tid 1 2024-01-13T18:05:20.353 INFO:tasks.rados.rados.0.smithi084.stdout:1411: setattr oid 41 current snap is 138 2024-01-13T18:05:20.353 INFO:tasks.rados.rados.0.smithi084.stdout:1408: finishing copy_from to smithi084102331-18 2024-01-13T18:05:20.353 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 373 (ObjNum 319 snap 101 seq_num 319) dirty exists 2024-01-13T18:05:20.353 INFO:tasks.rados.rados.0.smithi084.stdout:1407: finishing write tid 1 to smithi084102331-4 2024-01-13T18:05:20.353 INFO:tasks.rados.rados.0.smithi084.stdout:1407: finishing write tid 2 to smithi084102331-4 2024-01-13T18:05:20.353 INFO:tasks.rados.rados.0.smithi084.stdout:1408: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:05:20.353 INFO:tasks.rados.rados.0.smithi084.stdout:1408: done (4 left) 2024-01-13T18:05:20.353 INFO:tasks.rados.rados.0.smithi084.stdout:1409: done (3 left) 2024-01-13T18:05:20.353 INFO:tasks.rados.rados.0.smithi084.stdout:1412: snap_create 2024-01-13T18:05:20.354 INFO:tasks.rados.rados.0.smithi084.stdout:1407: finishing write tid 3 to smithi084102331-4 2024-01-13T18:05:20.355 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 505 (ObjNum 443 snap 138 seq_num 443) dirty exists 2024-01-13T18:05:20.355 INFO:tasks.rados.rados.0.smithi084.stdout:1407: left oid 4 (ObjNum 443 snap 138 seq_num 443) 2024-01-13T18:05:20.355 INFO:tasks.rados.rados.0.smithi084.stdout:1410: finishing write tid 1 to smithi084102331-20 2024-01-13T18:05:20.355 INFO:tasks.rados.rados.0.smithi084.stdout:1410: finishing write tid 2 to smithi084102331-20 2024-01-13T18:05:20.356 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 470 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:05:20.356 INFO:tasks.rados.rados.0.smithi084.stdout:1410: finishing write tid 3 to smithi084102331-20 2024-01-13T18:05:20.356 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 432 (ObjNum 444 snap 138 seq_num 444) dirty exists 2024-01-13T18:05:20.356 INFO:tasks.rados.rados.0.smithi084.stdout:1410: left oid 20 (ObjNum 444 snap 138 seq_num 444) 2024-01-13T18:05:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:20 smithi099 ceph-mon[138788]: failed to encode map e338 with expected crc 2024-01-13T18:05:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:20 smithi099 ceph-mon[138788]: osdmap e338: 8 total, 8 up, 8 in 2024-01-13T18:05:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:20 smithi099 ceph-mon[138788]: failed to encode map e338 with expected crc 2024-01-13T18:05:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:05:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:05:20] "GET /metrics HTTP/1.1" 200 36149 "" "Prometheus/2.43.0" 2024-01-13T18:05:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:20 smithi084 ceph-mon[119097]: failed to encode map e338 with expected crc 2024-01-13T18:05:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:20 smithi084 ceph-mon[119097]: osdmap e338: 8 total, 8 up, 8 in 2024-01-13T18:05:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:20 smithi084 ceph-mon[119097]: failed to encode map e338 with expected crc 2024-01-13T18:05:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:20 smithi084 ceph-mon[116404]: failed to encode map e338 with expected crc 2024-01-13T18:05:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:20 smithi084 ceph-mon[116404]: osdmap e338: 8 total, 8 up, 8 in 2024-01-13T18:05:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:20 smithi084 ceph-mon[116404]: failed to encode map e338 with expected crc 2024-01-13T18:05:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:21.241 INFO:tasks.rados.rados.0.smithi084.stdout:1407: done (3 left) 2024-01-13T18:05:21.241 INFO:tasks.rados.rados.0.smithi084.stdout:1410: done (2 left) 2024-01-13T18:05:21.241 INFO:tasks.rados.rados.0.smithi084.stdout:1411: done (1 left) 2024-01-13T18:05:21.241 INFO:tasks.rados.rados.0.smithi084.stdout:1412: done (0 left) 2024-01-13T18:05:21.241 INFO:tasks.rados.rados.0.smithi084.stdout:1413: rmattr oid 41 current snap is 139 2024-01-13T18:05:21.241 INFO:tasks.rados.rados.0.smithi084.stdout:1414: snap_remove snap 131 2024-01-13T18:05:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:21 smithi099 ceph-mon[138788]: failed to encode map e338 with expected crc 2024-01-13T18:05:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:21 smithi099 ceph-mon[138788]: failed to encode map e338 with expected crc 2024-01-13T18:05:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:21 smithi099 ceph-mon[138788]: pgmap v219: 121 pgs: 121 active+clean; 351 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 952 KiB/s wr, 10 op/s; 7.9 MiB/s, 2 objects/s recovering 2024-01-13T18:05:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:21 smithi099 ceph-mon[138788]: failed to encode map e339 with expected crc 2024-01-13T18:05:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:21 smithi099 ceph-mon[138788]: osdmap e339: 8 total, 8 up, 8 in 2024-01-13T18:05:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:21 smithi099 ceph-mon[138788]: failed to encode map e339 with expected crc 2024-01-13T18:05:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:21 smithi099 ceph-mon[138788]: failed to encode map e339 with expected crc 2024-01-13T18:05:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:21 smithi099 ceph-mon[138788]: failed to encode map e339 with expected crc 2024-01-13T18:05:21.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[116404]: failed to encode map e338 with expected crc 2024-01-13T18:05:21.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[116404]: failed to encode map e338 with expected crc 2024-01-13T18:05:21.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[116404]: pgmap v219: 121 pgs: 121 active+clean; 351 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 952 KiB/s wr, 10 op/s; 7.9 MiB/s, 2 objects/s recovering 2024-01-13T18:05:21.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[116404]: failed to encode map e339 with expected crc 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[116404]: osdmap e339: 8 total, 8 up, 8 in 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[116404]: failed to encode map e339 with expected crc 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[116404]: failed to encode map e339 with expected crc 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[116404]: failed to encode map e339 with expected crc 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[119097]: failed to encode map e338 with expected crc 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[119097]: failed to encode map e338 with expected crc 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[119097]: pgmap v219: 121 pgs: 121 active+clean; 351 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 952 KiB/s wr, 10 op/s; 7.9 MiB/s, 2 objects/s recovering 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[119097]: failed to encode map e339 with expected crc 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[119097]: osdmap e339: 8 total, 8 up, 8 in 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[119097]: failed to encode map e339 with expected crc 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[119097]: failed to encode map e339 with expected crc 2024-01-13T18:05:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:21 smithi084 ceph-mon[119097]: failed to encode map e339 with expected crc 2024-01-13T18:05:22.246 INFO:tasks.rados.rados.0.smithi084.stdout:1414: done (1 left) 2024-01-13T18:05:22.247 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 139 2024-01-13T18:05:22.247 INFO:tasks.rados.rados.0.smithi084.stdout:1415: seq_num 445 ranges {1794048=253952} 2024-01-13T18:05:22.258 INFO:tasks.rados.rados.0.smithi084.stdout:1415: writing smithi084102331-43 from 1794048 to 2048000 tid 1 2024-01-13T18:05:22.258 INFO:tasks.rados.rados.0.smithi084.stdout:1416: delete oid 20 current snap is 139 2024-01-13T18:05:22.258 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 472 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:05:22.267 INFO:tasks.rados.rados.0.smithi084.stdout:1413: done (2 left) 2024-01-13T18:05:22.267 INFO:tasks.rados.rados.0.smithi084.stdout:1416: done (1 left) 2024-01-13T18:05:22.267 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 139 2024-01-13T18:05:22.267 INFO:tasks.rados.rados.0.smithi084.stdout:1417: seq_num 447 ranges {548864=294912} 2024-01-13T18:05:22.269 INFO:tasks.rados.rados.0.smithi084.stdout:1417: writing smithi084102331-18 from 548864 to 843776 tid 1 2024-01-13T18:05:22.269 INFO:tasks.rados.rados.0.smithi084.stdout:1418: delete oid 1 current snap is 139 2024-01-13T18:05:22.269 INFO:tasks.rados.rados.0.smithi084.stdout:1415: finishing write tid 1 to smithi084102331-43 2024-01-13T18:05:22.269 INFO:tasks.rados.rados.0.smithi084.stdout:1415: finishing write tid 2 to smithi084102331-43 2024-01-13T18:05:22.273 INFO:tasks.rados.rados.0.smithi084.stdout:1418: done (2 left) 2024-01-13T18:05:22.273 INFO:tasks.rados.rados.0.smithi084.stdout:1419: copy_from oid 22 from oid 16 current snap is 139 2024-01-13T18:05:22.273 INFO:tasks.rados.rados.0.smithi084.stdout:1420: snap_create 2024-01-13T18:05:22.274 INFO:tasks.rados.rados.0.smithi084.stdout:1415: finishing write tid 3 to smithi084102331-43 2024-01-13T18:05:22.274 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 385 (ObjNum 445 snap 139 seq_num 445) dirty exists 2024-01-13T18:05:22.274 INFO:tasks.rados.rados.0.smithi084.stdout:1415: left oid 43 (ObjNum 445 snap 139 seq_num 445) 2024-01-13T18:05:22.274 INFO:tasks.rados.rados.0.smithi084.stdout:1417: finishing write tid 1 to smithi084102331-18 2024-01-13T18:05:22.274 INFO:tasks.rados.rados.0.smithi084.stdout:1417: finishing write tid 2 to smithi084102331-18 2024-01-13T18:05:22.275 INFO:tasks.rados.rados.0.smithi084.stdout:1417: finishing write tid 3 to smithi084102331-18 2024-01-13T18:05:22.275 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 375 (ObjNum 447 snap 139 seq_num 447) dirty exists 2024-01-13T18:05:22.275 INFO:tasks.rados.rados.0.smithi084.stdout:1417: left oid 18 (ObjNum 447 snap 139 seq_num 447) 2024-01-13T18:05:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:1419: finishing copy_from to smithi084102331-22 2024-01-13T18:05:22.323 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 398 (ObjNum 379 snap 122 seq_num 379) dirty exists 2024-01-13T18:05:22.323 INFO:tasks.rados.rados.0.smithi084.stdout:1419: finishing copy_from racing read to smithi084102331-22 2024-01-13T18:05:22.602 INFO:tasks.rados.rados.0.smithi084.stdout:1415: done (3 left) 2024-01-13T18:05:22.602 INFO:tasks.rados.rados.0.smithi084.stdout:1417: done (2 left) 2024-01-13T18:05:22.603 INFO:tasks.rados.rados.0.smithi084.stdout:1419: done (1 left) 2024-01-13T18:05:22.603 INFO:tasks.rados.rados.0.smithi084.stdout:1420: done (0 left) 2024-01-13T18:05:22.603 INFO:tasks.rados.rados.0.smithi084.stdout:1421: setattr oid 25 current snap is 140 2024-01-13T18:05:22.603 INFO:tasks.rados.rados.0.smithi084.stdout:1422: setattr oid 47 current snap is 140 2024-01-13T18:05:22.604 INFO:tasks.rados.rados.0.smithi084.stdout:1423: snap_create 2024-01-13T18:05:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:22 smithi099 ceph-mon[138788]: failed to encode map e340 with expected crc 2024-01-13T18:05:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:22 smithi099 ceph-mon[138788]: osdmap e340: 8 total, 8 up, 8 in 2024-01-13T18:05:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:22 smithi099 ceph-mon[138788]: failed to encode map e340 with expected crc 2024-01-13T18:05:22.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:22 smithi099 ceph-mon[138788]: failed to encode map e340 with expected crc 2024-01-13T18:05:22.620 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 646 (ObjNum 434 snap 137 seq_num 434) dirty exists 2024-01-13T18:05:22.620 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 739 (ObjNum 286 snap 89 seq_num 286) dirty exists 2024-01-13T18:05:22.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:22 smithi084 ceph-mon[116404]: failed to encode map e340 with expected crc 2024-01-13T18:05:22.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:22 smithi084 ceph-mon[116404]: osdmap e340: 8 total, 8 up, 8 in 2024-01-13T18:05:22.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:22 smithi084 ceph-mon[116404]: failed to encode map e340 with expected crc 2024-01-13T18:05:22.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:22 smithi084 ceph-mon[116404]: failed to encode map e340 with expected crc 2024-01-13T18:05:22.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:22 smithi084 ceph-mon[119097]: failed to encode map e340 with expected crc 2024-01-13T18:05:22.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:22 smithi084 ceph-mon[119097]: osdmap e340: 8 total, 8 up, 8 in 2024-01-13T18:05:22.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:22 smithi084 ceph-mon[119097]: failed to encode map e340 with expected crc 2024-01-13T18:05:22.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:22 smithi084 ceph-mon[119097]: failed to encode map e340 with expected crc 2024-01-13T18:05:23.611 INFO:tasks.rados.rados.0.smithi084.stdout:1421: done (2 left) 2024-01-13T18:05:23.611 INFO:tasks.rados.rados.0.smithi084.stdout:1422: done (1 left) 2024-01-13T18:05:23.611 INFO:tasks.rados.rados.0.smithi084.stdout:1423: done (0 left) 2024-01-13T18:05:23.611 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 141 2024-01-13T18:05:23.611 INFO:tasks.rados.rados.0.smithi084.stdout:1424: seq_num 449 ranges {2064384=327680} 2024-01-13T18:05:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:23 smithi099 ceph-mon[138788]: pgmap v222: 121 pgs: 121 active+clean; 366 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 6.9 MiB/s rd, 3.8 MiB/s wr, 30 op/s 2024-01-13T18:05:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:23 smithi099 ceph-mon[138788]: failed to encode map e341 with expected crc 2024-01-13T18:05:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:23 smithi099 ceph-mon[138788]: osdmap e341: 8 total, 8 up, 8 in 2024-01-13T18:05:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:23 smithi099 ceph-mon[138788]: failed to encode map e341 with expected crc 2024-01-13T18:05:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:23 smithi099 ceph-mon[138788]: failed to encode map e341 with expected crc 2024-01-13T18:05:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:23 smithi099 ceph-mon[138788]: failed to encode map e342 with expected crc 2024-01-13T18:05:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:23 smithi099 ceph-mon[138788]: osdmap e342: 8 total, 8 up, 8 in 2024-01-13T18:05:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:23 smithi099 ceph-mon[138788]: failed to encode map e342 with expected crc 2024-01-13T18:05:23.624 INFO:tasks.rados.rados.0.smithi084.stdout:1424: writing smithi084102331-7 from 2064384 to 2392064 tid 1 2024-01-13T18:05:23.624 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 141 2024-01-13T18:05:23.624 INFO:tasks.rados.rados.0.smithi084.stdout:1425: seq_num 450 ranges {4276224=344064} 2024-01-13T18:05:23.649 INFO:tasks.rados.rados.0.smithi084.stdout:1425: writing smithi084102331-32 from 4276224 to 4620288 tid 1 2024-01-13T18:05:23.649 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 141 2024-01-13T18:05:23.649 INFO:tasks.rados.rados.0.smithi084.stdout:1424: finishing write tid 1 to smithi084102331-7 2024-01-13T18:05:23.649 INFO:tasks.rados.rados.0.smithi084.stdout:1426: seq_num 451 ranges {917504=360448} 2024-01-13T18:05:23.656 INFO:tasks.rados.rados.0.smithi084.stdout:1426: writing smithi084102331-34 from 917504 to 1277952 tid 1 2024-01-13T18:05:23.657 INFO:tasks.rados.rados.0.smithi084.stdout:1427: snap_create 2024-01-13T18:05:23.657 INFO:tasks.rados.rados.0.smithi084.stdout:1424: finishing write tid 2 to smithi084102331-7 2024-01-13T18:05:23.657 INFO:tasks.rados.rados.0.smithi084.stdout:1424: finishing write tid 3 to smithi084102331-7 2024-01-13T18:05:23.657 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 388 (ObjNum 449 snap 141 seq_num 449) dirty exists 2024-01-13T18:05:23.657 INFO:tasks.rados.rados.0.smithi084.stdout:1424: left oid 7 (ObjNum 449 snap 141 seq_num 449) 2024-01-13T18:05:23.657 INFO:tasks.rados.rados.0.smithi084.stdout:1425: finishing write tid 1 to smithi084102331-32 2024-01-13T18:05:23.658 INFO:tasks.rados.rados.0.smithi084.stdout:1425: finishing write tid 2 to smithi084102331-32 2024-01-13T18:05:23.658 INFO:tasks.rados.rados.0.smithi084.stdout:1425: finishing write tid 3 to smithi084102331-32 2024-01-13T18:05:23.658 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 742 (ObjNum 450 snap 141 seq_num 450) dirty exists 2024-01-13T18:05:23.658 INFO:tasks.rados.rados.0.smithi084.stdout:1425: left oid 32 (ObjNum 450 snap 141 seq_num 450) 2024-01-13T18:05:23.659 INFO:tasks.rados.rados.0.smithi084.stdout:1426: finishing write tid 1 to smithi084102331-34 2024-01-13T18:05:23.659 INFO:tasks.rados.rados.0.smithi084.stdout:1426: finishing write tid 2 to smithi084102331-34 2024-01-13T18:05:23.660 INFO:tasks.rados.rados.0.smithi084.stdout:1426: finishing write tid 3 to smithi084102331-34 2024-01-13T18:05:23.660 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 455 (ObjNum 451 snap 141 seq_num 451) dirty exists 2024-01-13T18:05:23.660 INFO:tasks.rados.rados.0.smithi084.stdout:1426: left oid 34 (ObjNum 451 snap 141 seq_num 451) 2024-01-13T18:05:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[116404]: pgmap v222: 121 pgs: 121 active+clean; 366 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 6.9 MiB/s rd, 3.8 MiB/s wr, 30 op/s 2024-01-13T18:05:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[116404]: failed to encode map e341 with expected crc 2024-01-13T18:05:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[116404]: osdmap e341: 8 total, 8 up, 8 in 2024-01-13T18:05:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[116404]: failed to encode map e341 with expected crc 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[116404]: failed to encode map e341 with expected crc 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[116404]: failed to encode map e342 with expected crc 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[116404]: osdmap e342: 8 total, 8 up, 8 in 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[116404]: failed to encode map e342 with expected crc 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[119097]: pgmap v222: 121 pgs: 121 active+clean; 366 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 6.9 MiB/s rd, 3.8 MiB/s wr, 30 op/s 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[119097]: failed to encode map e341 with expected crc 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[119097]: osdmap e341: 8 total, 8 up, 8 in 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[119097]: failed to encode map e341 with expected crc 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[119097]: failed to encode map e341 with expected crc 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[119097]: failed to encode map e342 with expected crc 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[119097]: osdmap e342: 8 total, 8 up, 8 in 2024-01-13T18:05:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:23 smithi084 ceph-mon[119097]: failed to encode map e342 with expected crc 2024-01-13T18:05:24.615 INFO:tasks.rados.rados.0.smithi084.stdout:1424: done (3 left) 2024-01-13T18:05:24.615 INFO:tasks.rados.rados.0.smithi084.stdout:1425: done (2 left) 2024-01-13T18:05:24.615 INFO:tasks.rados.rados.0.smithi084.stdout:1426: done (1 left) 2024-01-13T18:05:24.616 INFO:tasks.rados.rados.0.smithi084.stdout:1427: done (0 left) 2024-01-13T18:05:24.616 INFO:tasks.rados.rados.0.smithi084.stdout:1428: delete oid 40 current snap is 142 2024-01-13T18:05:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:24 smithi099 ceph-mon[138788]: failed to encode map e342 with expected crc 2024-01-13T18:05:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:24 smithi099 ceph-mon[138788]: osdmap e343: 8 total, 8 up, 8 in 2024-01-13T18:05:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:24 smithi099 ceph-mon[138788]: failed to encode map e343 with expected crc 2024-01-13T18:05:24.619 INFO:tasks.rados.rados.0.smithi084.stdout:1428: done (0 left) 2024-01-13T18:05:24.619 INFO:tasks.rados.rados.0.smithi084.stdout:1429: snap_remove snap 126 2024-01-13T18:05:24.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:24 smithi084 ceph-mon[116404]: failed to encode map e342 with expected crc 2024-01-13T18:05:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:24 smithi084 ceph-mon[116404]: osdmap e343: 8 total, 8 up, 8 in 2024-01-13T18:05:24.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:24 smithi084 ceph-mon[116404]: failed to encode map e343 with expected crc 2024-01-13T18:05:24.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:24 smithi084 ceph-mon[119097]: failed to encode map e342 with expected crc 2024-01-13T18:05:24.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:24 smithi084 ceph-mon[119097]: osdmap e343: 8 total, 8 up, 8 in 2024-01-13T18:05:24.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:24 smithi084 ceph-mon[119097]: failed to encode map e343 with expected crc 2024-01-13T18:05:25.617 INFO:tasks.rados.rados.0.smithi084.stdout:1429: done (0 left) 2024-01-13T18:05:25.617 INFO:tasks.rados.rados.0.smithi084.stdout:1430: snap_remove snap 136 2024-01-13T18:05:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:25 smithi099 ceph-mon[138788]: failed to encode map e343 with expected crc 2024-01-13T18:05:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:25 smithi099 ceph-mon[138788]: pgmap v226: 121 pgs: 121 active+clean; 367 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 29 op/s 2024-01-13T18:05:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:25 smithi099 ceph-mon[138788]: failed to encode map e344 with expected crc 2024-01-13T18:05:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:25 smithi099 ceph-mon[138788]: osdmap e344: 8 total, 8 up, 8 in 2024-01-13T18:05:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:25 smithi099 ceph-mon[138788]: failed to encode map e344 with expected crc 2024-01-13T18:05:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:25.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[116404]: failed to encode map e343 with expected crc 2024-01-13T18:05:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[116404]: pgmap v226: 121 pgs: 121 active+clean; 367 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 29 op/s 2024-01-13T18:05:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[116404]: failed to encode map e344 with expected crc 2024-01-13T18:05:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[116404]: osdmap e344: 8 total, 8 up, 8 in 2024-01-13T18:05:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[116404]: failed to encode map e344 with expected crc 2024-01-13T18:05:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[119097]: failed to encode map e343 with expected crc 2024-01-13T18:05:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[119097]: pgmap v226: 121 pgs: 121 active+clean; 367 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.1 MiB/s wr, 29 op/s 2024-01-13T18:05:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[119097]: failed to encode map e344 with expected crc 2024-01-13T18:05:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[119097]: osdmap e344: 8 total, 8 up, 8 in 2024-01-13T18:05:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[119097]: failed to encode map e344 with expected crc 2024-01-13T18:05:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:26.473 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:05:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:26 smithi099 ceph-mon[138788]: failed to encode map e344 with expected crc 2024-01-13T18:05:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:26 smithi099 ceph-mon[138788]: failed to encode map e344 with expected crc 2024-01-13T18:05:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:26 smithi099 ceph-mon[138788]: failed to encode map e345 with expected crc 2024-01-13T18:05:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:26 smithi099 ceph-mon[138788]: failed to encode map e345 with expected crc 2024-01-13T18:05:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:26 smithi099 ceph-mon[138788]: osdmap e345: 8 total, 8 up, 8 in 2024-01-13T18:05:26.620 INFO:tasks.rados.rados.0.smithi084.stdout:1430: done (0 left) 2024-01-13T18:05:26.620 INFO:tasks.rados.rados.0.smithi084.stdout:1431: snap_remove snap 135 2024-01-13T18:05:26.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:26 smithi084 ceph-mon[116404]: failed to encode map e344 with expected crc 2024-01-13T18:05:26.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:26 smithi084 ceph-mon[116404]: failed to encode map e344 with expected crc 2024-01-13T18:05:26.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:26 smithi084 ceph-mon[116404]: failed to encode map e345 with expected crc 2024-01-13T18:05:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:26 smithi084 ceph-mon[116404]: failed to encode map e345 with expected crc 2024-01-13T18:05:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:26 smithi084 ceph-mon[116404]: osdmap e345: 8 total, 8 up, 8 in 2024-01-13T18:05:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:26 smithi084 ceph-mon[119097]: failed to encode map e344 with expected crc 2024-01-13T18:05:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:26 smithi084 ceph-mon[119097]: failed to encode map e344 with expected crc 2024-01-13T18:05:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:26 smithi084 ceph-mon[119097]: failed to encode map e345 with expected crc 2024-01-13T18:05:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:26 smithi084 ceph-mon[119097]: failed to encode map e345 with expected crc 2024-01-13T18:05:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:26 smithi084 ceph-mon[119097]: osdmap e345: 8 total, 8 up, 8 in 2024-01-13T18:05:26.798 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:05:26.798 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (3m) 18s ago 6m 28.4M - 0.25.0 c8568f914cd2 a5cbc3e01ffb 2024-01-13T18:05:26.798 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (3m) 2m ago 5m 79.4M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:05:26.798 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (6m) 18s ago 6m 15.8M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:05:26.798 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (6m) 2m ago 6m 20.0M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:05:26.798 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (2m) 2m ago 9m 447M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:05:26.798 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (3m) 18s ago 10m 510M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:05:26.798 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (2m) 18s ago 10m 83.2M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d b64908c7a53c 2024-01-13T18:05:26.798 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (2m) 2m ago 9m 23.8M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d be7bb477ea53 2024-01-13T18:05:26.798 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (2m) 18s ago 9m 58.7M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d e13f01b852ff 2024-01-13T18:05:26.799 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (3m) 18s ago 5m 10.3M - 1.5.0 0da6a335fe13 b72e6d50f165 2024-01-13T18:05:26.799 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (3m) 2m ago 5m 8514k - 1.5.0 0da6a335fe13 e9f879b5e55b 2024-01-13T18:05:26.799 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (104s) 18s ago 9m 243M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d e18181bdb4a8 2024-01-13T18:05:26.799 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (76s) 18s ago 8m 187M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 32bdce285b36 2024-01-13T18:05:26.799 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (48s) 18s ago 8m 175M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 660c53389079 2024-01-13T18:05:26.799 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (21s) 18s ago 8m 11.8M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 0e4b8c3482a4 2024-01-13T18:05:26.799 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (8m) 2m ago 8m 272M 2488M 17.2.7-268-g6441305d c3a232f785d8 30e0722550a0 2024-01-13T18:05:26.799 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (7m) 2m ago 7m 268M 2488M 17.2.7-268-g6441305d c3a232f785d8 51be805dde78 2024-01-13T18:05:26.799 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (7m) 2m ago 7m 198M 2488M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:05:26.799 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (7m) 2m ago 7m 144M 2488M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:05:26.799 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (2m) 2m ago 6m 48.2M - 2.43.0 a07b618ecd1d cb4c11bf6eec 2024-01-13T18:05:27.184 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:05:27.184 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:05:27.184 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:05:27.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:05:27.184 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:05:27.184 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:05:27.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:05:27.184 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:05:27.184 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 4, 2024-01-13T18:05:27.184 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 4 2024-01-13T18:05:27.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:05:27.185 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:05:27.185 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:05:27.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:05:27.185 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:05:27.185 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 6, 2024-01-13T18:05:27.185 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 9 2024-01-13T18:05:27.185 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:05:27.185 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:05:27.605 INFO:tasks.rados.rados.0.smithi084.stdout:1431: done (0 left) 2024-01-13T18:05:27.605 INFO:tasks.rados.rados.0.smithi084.stdout:1432: delete oid 34 current snap is 142 2024-01-13T18:05:27.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:27 smithi099 ceph-mon[138788]: failed to encode map e345 with expected crc 2024-01-13T18:05:27.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:27 smithi099 ceph-mon[138788]: pgmap v229: 121 pgs: 121 active+clean; 369 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 544 B/s rd, 2.8 MiB/s wr, 17 op/s 2024-01-13T18:05:27.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:27.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:27 smithi099 ceph-mon[138788]: failed to encode map e346 with expected crc 2024-01-13T18:05:27.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:27 smithi099 ceph-mon[138788]: failed to encode map e346 with expected crc 2024-01-13T18:05:27.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:27 smithi099 ceph-mon[138788]: osdmap e346: 8 total, 8 up, 8 in 2024-01-13T18:05:27.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:27 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1979561345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:27.623 INFO:tasks.rados.rados.0.smithi084.stdout:1432: done (0 left) 2024-01-13T18:05:27.623 INFO:tasks.rados.rados.0.smithi084.stdout:1433: read oid 33 snap -1 2024-01-13T18:05:27.623 INFO:tasks.rados.rados.0.smithi084.stdout:1433: expect (ObjNum 412 snap 130 seq_num 412) 2024-01-13T18:05:27.623 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 142 2024-01-13T18:05:27.623 INFO:tasks.rados.rados.0.smithi084.stdout:1434: seq_num 454 ranges {2154496=409600} 2024-01-13T18:05:27.634 INFO:tasks.rados.rados.0.smithi084.stdout:1434: writing smithi084102331-48 from 2154496 to 2564096 tid 1 2024-01-13T18:05:27.634 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 142 2024-01-13T18:05:27.635 INFO:tasks.rados.rados.0.smithi084.stdout:1435: seq_num 455 ranges {6504448=425984} 2024-01-13T18:05:27.672 INFO:tasks.rados.rados.0.smithi084.stdout:1435: writing smithi084102331-5 from 6504448 to 6930432 tid 1 2024-01-13T18:05:27.672 INFO:tasks.rados.rados.0.smithi084.stdout:1436: read oid 42 snap -1 2024-01-13T18:05:27.672 INFO:tasks.rados.rados.0.smithi084.stdout:1436: expect (ObjNum 317 snap 100 seq_num 317) 2024-01-13T18:05:27.672 INFO:tasks.rados.rados.0.smithi084.stdout:1437: read oid 25 snap 140 2024-01-13T18:05:27.672 INFO:tasks.rados.rados.0.smithi084.stdout:1437: expect (ObjNum 434 snap 137 seq_num 434) 2024-01-13T18:05:27.672 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 142 2024-01-13T18:05:27.672 INFO:tasks.rados.rados.0.smithi084.stdout:1438: seq_num 456 ranges {3022848=442368} 2024-01-13T18:05:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[116404]: failed to encode map e345 with expected crc 2024-01-13T18:05:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[116404]: pgmap v229: 121 pgs: 121 active+clean; 369 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 544 B/s rd, 2.8 MiB/s wr, 17 op/s 2024-01-13T18:05:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:27.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[116404]: failed to encode map e346 with expected crc 2024-01-13T18:05:27.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[116404]: failed to encode map e346 with expected crc 2024-01-13T18:05:27.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[116404]: osdmap e346: 8 total, 8 up, 8 in 2024-01-13T18:05:27.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1979561345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[119097]: failed to encode map e345 with expected crc 2024-01-13T18:05:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[119097]: pgmap v229: 121 pgs: 121 active+clean; 369 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 544 B/s rd, 2.8 MiB/s wr, 17 op/s 2024-01-13T18:05:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[119097]: failed to encode map e346 with expected crc 2024-01-13T18:05:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[119097]: failed to encode map e346 with expected crc 2024-01-13T18:05:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[119097]: osdmap e346: 8 total, 8 up, 8 in 2024-01-13T18:05:27.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:27 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1979561345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:27.691 INFO:tasks.rados.rados.0.smithi084.stdout:1438: writing smithi084102331-10 from 3022848 to 3465216 tid 1 2024-01-13T18:05:27.691 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 142 2024-01-13T18:05:27.691 INFO:tasks.rados.rados.0.smithi084.stdout:1434: finishing write tid 1 to smithi084102331-48 2024-01-13T18:05:27.691 INFO:tasks.rados.rados.0.smithi084.stdout:1434: finishing write tid 2 to smithi084102331-48 2024-01-13T18:05:27.691 INFO:tasks.rados.rados.0.smithi084.stdout:1439: seq_num 457 ranges {1925120=458752} 2024-01-13T18:05:27.704 INFO:tasks.rados.rados.0.smithi084.stdout:1439: writing smithi084102331-3 from 1925120 to 2383872 tid 1 2024-01-13T18:05:27.704 INFO:tasks.rados.rados.0.smithi084.stdout:1440: delete oid 26 current snap is 142 2024-01-13T18:05:27.704 INFO:tasks.rados.rados.0.smithi084.stdout:1434: finishing write tid 3 to smithi084102331-48 2024-01-13T18:05:27.704 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 727 (ObjNum 454 snap 142 seq_num 454) dirty exists 2024-01-13T18:05:27.705 INFO:tasks.rados.rados.0.smithi084.stdout:1434: left oid 48 (ObjNum 454 snap 142 seq_num 454) 2024-01-13T18:05:27.705 INFO:tasks.rados.rados.0.smithi084.stdout:1433: expect (ObjNum 412 snap 130 seq_num 412) 2024-01-13T18:05:27.845 INFO:tasks.rados.rados.0.smithi084.stdout:1435: finishing write tid 1 to smithi084102331-5 2024-01-13T18:05:27.845 INFO:tasks.rados.rados.0.smithi084.stdout:1435: finishing write tid 2 to smithi084102331-5 2024-01-13T18:05:27.845 INFO:tasks.rados.rados.0.smithi084.stdout:1435: finishing write tid 3 to smithi084102331-5 2024-01-13T18:05:27.845 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 528 (ObjNum 455 snap 142 seq_num 455) dirty exists 2024-01-13T18:05:27.845 INFO:tasks.rados.rados.0.smithi084.stdout:1435: left oid 5 (ObjNum 455 snap 142 seq_num 455) 2024-01-13T18:05:27.845 INFO:tasks.rados.rados.0.smithi084.stdout:1437: expect (ObjNum 434 snap 137 seq_num 434) 2024-01-13T18:05:27.901 INFO:tasks.rados.rados.0.smithi084.stdout:1436: expect (ObjNum 317 snap 100 seq_num 317) 2024-01-13T18:05:28.088 INFO:tasks.rados.rados.0.smithi084.stdout:1438: finishing write tid 1 to smithi084102331-10 2024-01-13T18:05:28.088 INFO:tasks.rados.rados.0.smithi084.stdout:1438: finishing write tid 2 to smithi084102331-10 2024-01-13T18:05:28.088 INFO:tasks.rados.rados.0.smithi084.stdout:1438: finishing write tid 3 to smithi084102331-10 2024-01-13T18:05:28.088 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 377 (ObjNum 456 snap 142 seq_num 456) dirty exists 2024-01-13T18:05:28.089 INFO:tasks.rados.rados.0.smithi084.stdout:1438: left oid 10 (ObjNum 456 snap 142 seq_num 456) 2024-01-13T18:05:28.089 INFO:tasks.rados.rados.0.smithi084.stdout:1439: finishing write tid 1 to smithi084102331-3 2024-01-13T18:05:28.089 INFO:tasks.rados.rados.0.smithi084.stdout:1433: done (7 left) 2024-01-13T18:05:28.089 INFO:tasks.rados.rados.0.smithi084.stdout:1434: done (6 left) 2024-01-13T18:05:28.089 INFO:tasks.rados.rados.0.smithi084.stdout:1435: done (5 left) 2024-01-13T18:05:28.089 INFO:tasks.rados.rados.0.smithi084.stdout:1436: done (4 left) 2024-01-13T18:05:28.090 INFO:tasks.rados.rados.0.smithi084.stdout:1437: done (3 left) 2024-01-13T18:05:28.090 INFO:tasks.rados.rados.0.smithi084.stdout:1438: done (2 left) 2024-01-13T18:05:28.090 INFO:tasks.rados.rados.0.smithi084.stdout:1440: done (1 left) 2024-01-13T18:05:28.090 INFO:tasks.rados.rados.0.smithi084.stdout:1441: read oid 30 snap -1 2024-01-13T18:05:28.090 INFO:tasks.rados.rados.0.smithi084.stdout:1441: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:05:28.090 INFO:tasks.rados.rados.0.smithi084.stdout:1442: delete oid 13 current snap is 142 2024-01-13T18:05:28.091 INFO:tasks.rados.rados.0.smithi084.stdout:1439: finishing write tid 2 to smithi084102331-3 2024-01-13T18:05:28.091 INFO:tasks.rados.rados.0.smithi084.stdout:1439: finishing write tid 3 to smithi084102331-3 2024-01-13T18:05:28.091 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 826 (ObjNum 457 snap 142 seq_num 457) dirty exists 2024-01-13T18:05:28.091 INFO:tasks.rados.rados.0.smithi084.stdout:1439: left oid 3 (ObjNum 457 snap 142 seq_num 457) 2024-01-13T18:05:28.091 INFO:tasks.rados.rados.0.smithi084.stdout:1439: done (2 left) 2024-01-13T18:05:28.091 INFO:tasks.rados.rados.0.smithi084.stdout:1442: done (1 left) 2024-01-13T18:05:28.092 INFO:tasks.rados.rados.0.smithi084.stdout:1443: snap_remove snap 140 2024-01-13T18:05:28.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:28 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:28.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:28 smithi099 ceph-mon[138788]: Upgrade: osd.4 is safe to restart 2024-01-13T18:05:28.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:28 smithi099 ceph-mon[138788]: from='client.34257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:28.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:28 smithi099 ceph-mon[138788]: from='client.34263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:28.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:28.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-13T18:05:28.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:28.590 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:28 smithi099 ceph-mon[138788]: osdmap e347: 8 total, 8 up, 8 in 2024-01-13T18:05:28.590 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:28 smithi099 ceph-mon[138788]: failed to encode map e347 with expected crc 2024-01-13T18:05:28.621 INFO:tasks.rados.rados.0.smithi084.stdout:1443: done (1 left) 2024-01-13T18:05:28.621 INFO:tasks.rados.rados.0.smithi084.stdout:1444: read oid 34 snap -1 2024-01-13T18:05:28.621 INFO:tasks.rados.rados.0.smithi084.stdout:1444: expect deleted 2024-01-13T18:05:28.621 INFO:tasks.rados.rados.0.smithi084.stdout:1445: snap_create 2024-01-13T18:05:28.621 INFO:tasks.rados.rados.0.smithi084.stdout:1441: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:05:28.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:28.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[116404]: Upgrade: osd.4 is safe to restart 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[116404]: from='client.34257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[116404]: from='client.34263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[116404]: osdmap e347: 8 total, 8 up, 8 in 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[116404]: failed to encode map e347 with expected crc 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[119097]: Upgrade: osd.4 is safe to restart 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[119097]: from='client.34257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[119097]: from='client.34263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:28.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-13T18:05:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[119097]: osdmap e347: 8 total, 8 up, 8 in 2024-01-13T18:05:28.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:28 smithi084 ceph-mon[119097]: failed to encode map e347 with expected crc 2024-01-13T18:05:28.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:05:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:05:28.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:05:29.356 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:29 smithi099 ceph-mon[138788]: Upgrade: Updating osd.4 2024-01-13T18:05:29.356 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:29 smithi099 ceph-mon[138788]: Deploying daemon osd.4 on smithi099 2024-01-13T18:05:29.356 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:29 smithi099 ceph-mon[138788]: failed to encode map e347 with expected crc 2024-01-13T18:05:29.357 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:29 smithi099 ceph-mon[138788]: pgmap v232: 121 pgs: 121 active+clean; 364 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 2.7 MiB/s wr, 17 op/s 2024-01-13T18:05:29.357 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:29 smithi099 ceph-mon[138788]: osdmap e348: 8 total, 8 up, 8 in 2024-01-13T18:05:29.357 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:29 smithi099 ceph-mon[138788]: failed to encode map e348 with expected crc 2024-01-13T18:05:29.357 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:29 smithi099 ceph-mon[138788]: failed to encode map e348 with expected crc 2024-01-13T18:05:29.622 INFO:tasks.rados.rados.0.smithi084.stdout:1441: done (2 left) 2024-01-13T18:05:29.622 INFO:tasks.rados.rados.0.smithi084.stdout:1444: done (1 left) 2024-01-13T18:05:29.622 INFO:tasks.rados.rados.0.smithi084.stdout:1445: done (0 left) 2024-01-13T18:05:29.622 INFO:tasks.rados.rados.0.smithi084.stdout:1446: copy_from oid 45 from oid 50 current snap is 143 2024-01-13T18:05:29.622 INFO:tasks.rados.rados.0.smithi084.stdout:1447: copy_from oid 17 from oid 29 current snap is 143 2024-01-13T18:05:29.622 INFO:tasks.rados.rados.0.smithi084.stdout:1448: read oid 30 snap -1 2024-01-13T18:05:29.622 INFO:tasks.rados.rados.0.smithi084.stdout:1448: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:05:29.622 INFO:tasks.rados.rados.0.smithi084.stdout:1449: read oid 41 snap -1 2024-01-13T18:05:29.622 INFO:tasks.rados.rados.0.smithi084.stdout:1449: expect (ObjNum 252 snap 75 seq_num 252) 2024-01-13T18:05:29.623 INFO:tasks.rados.rados.0.smithi084.stdout:1450: copy_from oid 5 from oid 28 current snap is 143 2024-01-13T18:05:29.623 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 143 2024-01-13T18:05:29.623 INFO:tasks.rados.rados.0.smithi084.stdout:1451: seq_num 460 ranges {917504=507904} 2024-01-13T18:05:29.630 INFO:tasks.rados.rados.0.smithi084.stdout:1451: writing smithi084102331-9 from 917504 to 1425408 tid 1 2024-01-13T18:05:29.630 INFO:tasks.rados.rados.0.smithi084.stdout:1452: read oid 13 snap 98 2024-01-13T18:05:29.630 INFO:tasks.rados.rados.0.smithi084.stdout:1452: expect (ObjNum 300 snap 93 seq_num 300) 2024-01-13T18:05:29.630 INFO:tasks.rados.rados.0.smithi084.stdout:1453: copy_from oid 16 from oid 35 current snap is 143 2024-01-13T18:05:29.630 INFO:tasks.rados.rados.0.smithi084.stdout:1454: rmattr oid 43 current snap is 143 2024-01-13T18:05:29.630 INFO:tasks.rados.rados.0.smithi084.stdout:1454: done (8 left) 2024-01-13T18:05:29.631 INFO:tasks.rados.rados.0.smithi084.stdout:1455: setattr oid 38 current snap is 143 2024-01-13T18:05:29.632 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 143 2024-01-13T18:05:29.632 INFO:tasks.rados.rados.0.smithi084.stdout:1456: seq_num 461 ranges {4382720=524288} 2024-01-13T18:05:29.661 INFO:tasks.rados.rados.0.smithi084.stdout:1456: writing smithi084102331-33 from 4382720 to 4907008 tid 1 2024-01-13T18:05:29.661 INFO:tasks.rados.rados.0.smithi084.stdout:1457: read oid 26 snap 124 2024-01-13T18:05:29.661 INFO:tasks.rados.rados.0.smithi084.stdout:1457: expect deleted 2024-01-13T18:05:29.661 INFO:tasks.rados.rados.0.smithi084.stdout:1458: snap_create 2024-01-13T18:05:29.662 INFO:tasks.rados.rados.0.smithi084.stdout:1449: expect (ObjNum 252 snap 75 seq_num 252) 2024-01-13T18:05:29.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[116404]: Upgrade: Updating osd.4 2024-01-13T18:05:29.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[116404]: Deploying daemon osd.4 on smithi099 2024-01-13T18:05:29.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[116404]: failed to encode map e347 with expected crc 2024-01-13T18:05:29.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[116404]: pgmap v232: 121 pgs: 121 active+clean; 364 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 2.7 MiB/s wr, 17 op/s 2024-01-13T18:05:29.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[116404]: osdmap e348: 8 total, 8 up, 8 in 2024-01-13T18:05:29.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[116404]: failed to encode map e348 with expected crc 2024-01-13T18:05:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[116404]: failed to encode map e348 with expected crc 2024-01-13T18:05:29.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[119097]: Upgrade: Updating osd.4 2024-01-13T18:05:29.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[119097]: Deploying daemon osd.4 on smithi099 2024-01-13T18:05:29.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[119097]: failed to encode map e347 with expected crc 2024-01-13T18:05:29.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[119097]: pgmap v232: 121 pgs: 121 active+clean; 364 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 2.7 MiB/s wr, 17 op/s 2024-01-13T18:05:29.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[119097]: osdmap e348: 8 total, 8 up, 8 in 2024-01-13T18:05:29.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[119097]: failed to encode map e348 with expected crc 2024-01-13T18:05:29.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:29 smithi084 ceph-mon[119097]: failed to encode map e348 with expected crc 2024-01-13T18:05:29.715 INFO:tasks.rados.rados.0.smithi084.stdout:1451: finishing write tid 1 to smithi084102331-9 2024-01-13T18:05:29.715 INFO:tasks.rados.rados.0.smithi084.stdout:1451: finishing write tid 2 to smithi084102331-9 2024-01-13T18:05:29.715 INFO:tasks.rados.rados.0.smithi084.stdout:1451: finishing write tid 3 to smithi084102331-9 2024-01-13T18:05:29.715 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 470 (ObjNum 460 snap 143 seq_num 460) dirty exists 2024-01-13T18:05:29.715 INFO:tasks.rados.rados.0.smithi084.stdout:1451: left oid 9 (ObjNum 460 snap 143 seq_num 460) 2024-01-13T18:05:29.715 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 830 (ObjNum 301 snap 93 seq_num 301) dirty exists 2024-01-13T18:05:29.716 INFO:tasks.rados.rados.0.smithi084.stdout:1452: expect (ObjNum 300 snap 93 seq_num 300) 2024-01-13T18:05:29.990 INFO:tasks.rados.rados.0.smithi084.stdout:1447: finishing copy_from to smithi084102331-17 2024-01-13T18:05:29.990 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 499 (ObjNum 433 snap 137 seq_num 433) dirty exists 2024-01-13T18:05:29.990 INFO:tasks.rados.rados.0.smithi084.stdout:1447: finishing copy_from racing read to smithi084102331-17 2024-01-13T18:05:29.991 INFO:tasks.rados.rados.0.smithi084.stdout:1450: finishing copy_from to smithi084102331-5 2024-01-13T18:05:29.991 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 357 (ObjNum 370 snap 119 seq_num 370) dirty exists 2024-01-13T18:05:29.991 INFO:tasks.rados.rados.0.smithi084.stdout:1450: finishing copy_from racing read to smithi084102331-5 2024-01-13T18:05:29.991 INFO:tasks.rados.rados.0.smithi084.stdout:1446: finishing copy_from to smithi084102331-45 2024-01-13T18:05:29.991 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 579 (ObjNum 412 snap 130 seq_num 412) dirty exists 2024-01-13T18:05:29.991 INFO:tasks.rados.rados.0.smithi084.stdout:1446: finishing copy_from racing read to smithi084102331-45 2024-01-13T18:05:29.991 INFO:tasks.rados.rados.0.smithi084.stdout:1453: finishing copy_from to smithi084102331-16 2024-01-13T18:05:29.991 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 459 (ObjNum 419 snap 132 seq_num 419) dirty exists 2024-01-13T18:05:29.991 INFO:tasks.rados.rados.0.smithi084.stdout:1453: finishing copy_from racing read to smithi084102331-16 2024-01-13T18:05:29.991 INFO:tasks.rados.rados.0.smithi084.stdout:1448: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:05:30.119 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:29 smithi099 systemd[1]: Stopping Ceph osd.4 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:05:30.120 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[77165]: 2024-01-13T18:05:29.831+0000 7f852cdf5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:05:30.120 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[77165]: 2024-01-13T18:05:29.831+0000 7f852cdf5700 -1 osd.4 349 *** Got signal Terminated *** 2024-01-13T18:05:30.120 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[77165]: 2024-01-13T18:05:29.831+0000 7f852cdf5700 -1 osd.4 349 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T18:05:30.431 INFO:tasks.rados.rados.0.smithi084.stdout:1456: finishing write tid 1 to smithi084102331-33 2024-01-13T18:05:30.431 INFO:tasks.rados.rados.0.smithi084.stdout:1456: finishing write tid 2 to smithi084102331-33 2024-01-13T18:05:30.431 INFO:tasks.rados.rados.0.smithi084.stdout:1456: finishing write tid 3 to smithi084102331-33 2024-01-13T18:05:30.431 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 669 (ObjNum 461 snap 143 seq_num 461) dirty exists 2024-01-13T18:05:30.431 INFO:tasks.rados.rados.0.smithi084.stdout:1456: left oid 33 (ObjNum 461 snap 143 seq_num 461) 2024-01-13T18:05:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:30 smithi099 ceph-mon[138788]: failed to encode map e348 with expected crc 2024-01-13T18:05:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:30 smithi099 ceph-mon[138788]: failed to encode map e348 with expected crc 2024-01-13T18:05:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:30 smithi099 ceph-mon[138788]: osdmap e349: 8 total, 8 up, 8 in 2024-01-13T18:05:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:30 smithi099 ceph-mon[138788]: failed to encode map e349 with expected crc 2024-01-13T18:05:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:30 smithi099 ceph-mon[138788]: osd.4 marked itself down and dead 2024-01-13T18:05:30.637 INFO:tasks.rados.rados.0.smithi084.stdout:1446: done (11 left) 2024-01-13T18:05:30.637 INFO:tasks.rados.rados.0.smithi084.stdout:1447: done (10 left) 2024-01-13T18:05:30.637 INFO:tasks.rados.rados.0.smithi084.stdout:1448: done (9 left) 2024-01-13T18:05:30.637 INFO:tasks.rados.rados.0.smithi084.stdout:1449: done (8 left) 2024-01-13T18:05:30.637 INFO:tasks.rados.rados.0.smithi084.stdout:1450: done (7 left) 2024-01-13T18:05:30.637 INFO:tasks.rados.rados.0.smithi084.stdout:1451: done (6 left) 2024-01-13T18:05:30.637 INFO:tasks.rados.rados.0.smithi084.stdout:1452: done (5 left) 2024-01-13T18:05:30.637 INFO:tasks.rados.rados.0.smithi084.stdout:1453: done (4 left) 2024-01-13T18:05:30.638 INFO:tasks.rados.rados.0.smithi084.stdout:1455: done (3 left) 2024-01-13T18:05:30.638 INFO:tasks.rados.rados.0.smithi084.stdout:1456: done (2 left) 2024-01-13T18:05:30.638 INFO:tasks.rados.rados.0.smithi084.stdout:1457: done (1 left) 2024-01-13T18:05:30.638 INFO:tasks.rados.rados.0.smithi084.stdout:1458: done (0 left) 2024-01-13T18:05:30.638 INFO:tasks.rados.rados.0.smithi084.stdout:1459: rmattr oid 11 current snap is 144 2024-01-13T18:05:30.638 INFO:tasks.rados.rados.0.smithi084.stdout:1459: done (0 left) 2024-01-13T18:05:30.638 INFO:tasks.rados.rados.0.smithi084.stdout:1460: snap_remove snap 124 2024-01-13T18:05:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:05:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:05:30] "GET /metrics HTTP/1.1" 200 36149 "" "Prometheus/2.43.0" 2024-01-13T18:05:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:30 smithi084 ceph-mon[116404]: failed to encode map e348 with expected crc 2024-01-13T18:05:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:30 smithi084 ceph-mon[116404]: failed to encode map e348 with expected crc 2024-01-13T18:05:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:30 smithi084 ceph-mon[116404]: osdmap e349: 8 total, 8 up, 8 in 2024-01-13T18:05:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:30 smithi084 ceph-mon[116404]: failed to encode map e349 with expected crc 2024-01-13T18:05:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:30 smithi084 ceph-mon[116404]: osd.4 marked itself down and dead 2024-01-13T18:05:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:30 smithi084 ceph-mon[119097]: failed to encode map e348 with expected crc 2024-01-13T18:05:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:30 smithi084 ceph-mon[119097]: failed to encode map e348 with expected crc 2024-01-13T18:05:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:30 smithi084 ceph-mon[119097]: osdmap e349: 8 total, 8 up, 8 in 2024-01-13T18:05:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:30 smithi084 ceph-mon[119097]: failed to encode map e349 with expected crc 2024-01-13T18:05:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:30 smithi084 ceph-mon[119097]: osd.4 marked itself down and dead 2024-01-13T18:05:31.619 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:31 smithi099 bash[144977]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4 2024-01-13T18:05:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:31 smithi099 ceph-mon[138788]: failed to encode map e349 with expected crc 2024-01-13T18:05:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:31 smithi099 ceph-mon[138788]: pgmap v235: 121 pgs: 121 active+clean; 365 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 338 KiB/s wr, 3 op/s 2024-01-13T18:05:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:31 smithi099 ceph-mon[138788]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:05:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:31 smithi099 ceph-mon[138788]: osdmap e350: 8 total, 7 up, 8 in 2024-01-13T18:05:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:31 smithi099 ceph-mon[138788]: failed to encode map e350 with expected crc 2024-01-13T18:05:31.638 INFO:tasks.rados.rados.0.smithi084.stdout:1460: done (0 left) 2024-01-13T18:05:31.638 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 144 2024-01-13T18:05:31.638 INFO:tasks.rados.rados.0.smithi084.stdout:1461: seq_num 462 ranges {8282112=540672} 2024-01-13T18:05:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:31 smithi084 ceph-mon[119097]: failed to encode map e349 with expected crc 2024-01-13T18:05:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:31 smithi084 ceph-mon[119097]: pgmap v235: 121 pgs: 121 active+clean; 365 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 338 KiB/s wr, 3 op/s 2024-01-13T18:05:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:31 smithi084 ceph-mon[119097]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:05:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:31 smithi084 ceph-mon[119097]: osdmap e350: 8 total, 7 up, 8 in 2024-01-13T18:05:31.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:31 smithi084 ceph-mon[119097]: failed to encode map e350 with expected crc 2024-01-13T18:05:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:31 smithi084 ceph-mon[116404]: failed to encode map e349 with expected crc 2024-01-13T18:05:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:31 smithi084 ceph-mon[116404]: pgmap v235: 121 pgs: 121 active+clean; 365 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 338 KiB/s wr, 3 op/s 2024-01-13T18:05:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:31 smithi084 ceph-mon[116404]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:05:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:31 smithi084 ceph-mon[116404]: osdmap e350: 8 total, 7 up, 8 in 2024-01-13T18:05:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:31 smithi084 ceph-mon[116404]: failed to encode map e350 with expected crc 2024-01-13T18:05:31.686 INFO:tasks.rados.rados.0.smithi084.stdout:1461: writing smithi084102331-30 from 8282112 to 8822784 tid 1 2024-01-13T18:05:31.687 INFO:tasks.rados.rados.0.smithi084.stdout:1462: read oid 44 snap -1 2024-01-13T18:05:31.687 INFO:tasks.rados.rados.0.smithi084.stdout:1462: expect deleted 2024-01-13T18:05:31.687 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 144 2024-01-13T18:05:31.687 INFO:tasks.rados.rados.0.smithi084.stdout:1463: seq_num 463 ranges {1425408=557056} 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:1463: writing smithi084102331-9 from 1425408 to 1982464 tid 1 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:1464: read oid 42 snap -1 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:1464: expect (ObjNum 317 snap 100 seq_num 317) 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:1465: rollback oid 26 current snap is 144 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 139 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:1462: done (4 left) 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:1466: read oid 8 snap -1 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:1466: expect (ObjNum 403 snap 128 seq_num 403) 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:1467: rollback oid 35 current snap is 144 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 35 to 137 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:1461: finishing write tid 1 to smithi084102331-30 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:1461: finishing write tid 2 to smithi084102331-30 2024-01-13T18:05:31.699 INFO:tasks.rados.rados.0.smithi084.stdout:1461: finishing write tid 3 to smithi084102331-30 2024-01-13T18:05:31.700 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 680 (ObjNum 462 snap 144 seq_num 462) dirty exists 2024-01-13T18:05:31.700 INFO:tasks.rados.rados.0.smithi084.stdout:1461: left oid 30 (ObjNum 462 snap 144 seq_num 462) 2024-01-13T18:05:31.700 INFO:tasks.rados.rados.0.smithi084.stdout:1461: done (5 left) 2024-01-13T18:05:31.700 INFO:tasks.rados.rados.0.smithi084.stdout:1468: rollback oid 5 current snap is 144 2024-01-13T18:05:31.700 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 143 2024-01-13T18:05:31.700 INFO:tasks.rados.rados.0.smithi084.stdout:1469: delete oid 50 current snap is 144 2024-01-13T18:05:31.702 INFO:tasks.rados.rados.0.smithi084.stdout:1469: done (6 left) 2024-01-13T18:05:31.702 INFO:tasks.rados.rados.0.smithi084.stdout:1470: read oid 32 snap -1 2024-01-13T18:05:31.702 INFO:tasks.rados.rados.0.smithi084.stdout:1470: expect (ObjNum 450 snap 141 seq_num 450) 2024-01-13T18:05:31.702 INFO:tasks.rados.rados.0.smithi084.stdout:1471: read oid 25 snap 105 2024-01-13T18:05:31.703 INFO:tasks.rados.rados.0.smithi084.stdout:1471: expect deleted 2024-01-13T18:05:31.703 INFO:tasks.rados.rados.0.smithi084.stdout:1472: read oid 46 snap 137 2024-01-13T18:05:31.703 INFO:tasks.rados.rados.0.smithi084.stdout:1472: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:05:31.703 INFO:tasks.rados.rados.0.smithi084.stdout:1473: snap_remove snap 141 2024-01-13T18:05:32.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:32 smithi099 ceph-mon[138788]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:32 smithi099 ceph-mon[138788]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:32 smithi099 ceph-mon[138788]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:32 smithi099 ceph-mon[138788]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.548 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:32 smithi099 ceph-mon[138788]: osdmap e351: 8 total, 7 up, 8 in 2024-01-13T18:05:32.548 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:32 smithi099 ceph-mon[138788]: failed to encode map e351 with expected crc 2024-01-13T18:05:32.548 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:32 smithi099 ceph-mon[138788]: failed to encode map e351 with expected crc 2024-01-13T18:05:32.548 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:32 smithi099 ceph-mon[138788]: failed to encode map e351 with expected crc 2024-01-13T18:05:32.608 INFO:tasks.rados.rados.0.smithi084.stdout:1473: done (9 left) 2024-01-13T18:05:32.608 INFO:tasks.rados.rados.0.smithi084.stdout:1474: snap_remove snap 128 2024-01-13T18:05:32.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[119097]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[119097]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[119097]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[119097]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[119097]: osdmap e351: 8 total, 7 up, 8 in 2024-01-13T18:05:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[119097]: failed to encode map e351 with expected crc 2024-01-13T18:05:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[119097]: failed to encode map e351 with expected crc 2024-01-13T18:05:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[119097]: failed to encode map e351 with expected crc 2024-01-13T18:05:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[116404]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[116404]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[116404]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[116404]: failed to encode map e350 with expected crc 2024-01-13T18:05:32.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[116404]: osdmap e351: 8 total, 7 up, 8 in 2024-01-13T18:05:32.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[116404]: failed to encode map e351 with expected crc 2024-01-13T18:05:32.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[116404]: failed to encode map e351 with expected crc 2024-01-13T18:05:32.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:32 smithi084 ceph-mon[116404]: failed to encode map e351 with expected crc 2024-01-13T18:05:32.869 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:32 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.4.service: Succeeded. 2024-01-13T18:05:32.869 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:32 smithi099 systemd[1]: Stopped Ceph osd.4 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:05:32.869 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:32 smithi099 systemd[1]: Starting Ceph osd.4 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:05:33.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:33 smithi099 ceph-mon[138788]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:33 smithi099 ceph-mon[138788]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:33 smithi099 ceph-mon[138788]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:33 smithi099 ceph-mon[138788]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:33 smithi099 ceph-mon[138788]: pgmap v238: 121 pgs: 6 active+undersized+degraded, 23 peering, 2 stale+active+clean, 6 active+undersized, 84 active+clean; 379 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 4.2 MiB/s wr, 17 op/s; 36/600 objects degraded (6.000%) 2024-01-13T18:05:33.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:33 smithi099 ceph-mon[138788]: failed to encode map e352 with expected crc 2024-01-13T18:05:33.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:33 smithi099 ceph-mon[138788]: osdmap e352: 8 total, 7 up, 8 in 2024-01-13T18:05:33.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:33 smithi099 ceph-mon[138788]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-01-13T18:05:33.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:33 smithi099 ceph-mon[138788]: Health check failed: Degraded data redundancy: 36/600 objects degraded (6.000%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:33.555 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:33 smithi099 bash[145243]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-13T18:05:33.555 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:33 smithi099 bash[145243]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-01-13T18:05:33.555 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:33 smithi099 bash[145243]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-01-13T18:05:33.555 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:33 smithi099 bash[145243]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-01-13T18:05:33.555 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:33 smithi099 bash[145243]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-01-13T18:05:33.555 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:33 smithi099 bash[145243]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-13T18:05:33.555 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:33 smithi099 bash[145243]: --> ceph-volume raw activate successful for osd ID: 4 2024-01-13T18:05:33.608 INFO:tasks.rados.rados.0.smithi084.stdout:1474: done (9 left) 2024-01-13T18:05:33.609 INFO:tasks.rados.rados.0.smithi084.stdout:1475: snap_remove snap 98 2024-01-13T18:05:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[119097]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[119097]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[119097]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[119097]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[119097]: pgmap v238: 121 pgs: 6 active+undersized+degraded, 23 peering, 2 stale+active+clean, 6 active+undersized, 84 active+clean; 379 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 4.2 MiB/s wr, 17 op/s; 36/600 objects degraded (6.000%) 2024-01-13T18:05:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[119097]: failed to encode map e352 with expected crc 2024-01-13T18:05:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[119097]: osdmap e352: 8 total, 7 up, 8 in 2024-01-13T18:05:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[119097]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-01-13T18:05:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[119097]: Health check failed: Degraded data redundancy: 36/600 objects degraded (6.000%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[116404]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[116404]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[116404]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[116404]: failed to encode map e351 with expected crc 2024-01-13T18:05:33.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[116404]: pgmap v238: 121 pgs: 6 active+undersized+degraded, 23 peering, 2 stale+active+clean, 6 active+undersized, 84 active+clean; 379 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 4.2 MiB/s wr, 17 op/s; 36/600 objects degraded (6.000%) 2024-01-13T18:05:33.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[116404]: failed to encode map e352 with expected crc 2024-01-13T18:05:33.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[116404]: osdmap e352: 8 total, 7 up, 8 in 2024-01-13T18:05:33.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[116404]: Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2024-01-13T18:05:33.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:33 smithi084 ceph-mon[116404]: Health check failed: Degraded data redundancy: 36/600 objects degraded (6.000%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:34.259 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:34 smithi099 ceph-osd[145534]: -- 172.21.15.99:0/3553337593 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564fe94824e0 con 0x564fe9453400 2024-01-13T18:05:34.259 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:34 smithi099 bash[145496]: 76d7d19ec531578d02af7d285f2c7c5ddb55dee1685b9bc5bb5932c63a84fccf 2024-01-13T18:05:34.260 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:34 smithi099 systemd[1]: Started Ceph osd.4 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:05:34.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:34 smithi099 ceph-mon[138788]: failed to encode map e352 with expected crc 2024-01-13T18:05:34.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:34 smithi099 ceph-mon[138788]: failed to encode map e352 with expected crc 2024-01-13T18:05:34.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:34 smithi099 ceph-mon[138788]: osdmap e353: 8 total, 7 up, 8 in 2024-01-13T18:05:34.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:34 smithi099 ceph-mon[138788]: failed to encode map e353 with expected crc 2024-01-13T18:05:34.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:34.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:34.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:34.616 INFO:tasks.rados.rados.0.smithi084.stdout:1475: done (9 left) 2024-01-13T18:05:34.616 INFO:tasks.rados.rados.0.smithi084.stdout:1476: read oid 30 snap 137 2024-01-13T18:05:34.616 INFO:tasks.rados.rados.0.smithi084.stdout:1476: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:05:34.616 INFO:tasks.rados.rados.0.smithi084.stdout:1477: snap_create 2024-01-13T18:05:34.616 INFO:tasks.rados.rados.0.smithi084.stdout:1465: finishing rollback tid 1 to smithi084102331-26 2024-01-13T18:05:34.616 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 445 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-01-13T18:05:34.616 INFO:tasks.rados.rados.0.smithi084.stdout:1463: finishing write tid 1 to smithi084102331-9 2024-01-13T18:05:34.616 INFO:tasks.rados.rados.0.smithi084.stdout:1463: finishing write tid 2 to smithi084102331-9 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:1467: finishing rollback tid 0 to smithi084102331-35 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:1467: finishing rollback tid 1 to smithi084102331-35 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:1467: finishing rollback tid 2 to smithi084102331-35 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 544 (ObjNum 419 snap 132 seq_num 419) dirty exists 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:1468: finishing rollback tid 0 to smithi084102331-5 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:1468: finishing rollback tid 1 to smithi084102331-5 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:1463: finishing write tid 3 to smithi084102331-9 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 475 (ObjNum 463 snap 144 seq_num 463) dirty exists 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:1463: left oid 9 (ObjNum 463 snap 144 seq_num 463) 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:1468: finishing rollback tid 2 to smithi084102331-5 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 539 (ObjNum 370 snap 119 seq_num 370) dirty exists 2024-01-13T18:05:34.617 INFO:tasks.rados.rados.0.smithi084.stdout:1464: expect (ObjNum 317 snap 100 seq_num 317) 2024-01-13T18:05:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[116404]: failed to encode map e352 with expected crc 2024-01-13T18:05:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[116404]: failed to encode map e352 with expected crc 2024-01-13T18:05:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[116404]: osdmap e353: 8 total, 7 up, 8 in 2024-01-13T18:05:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[116404]: failed to encode map e353 with expected crc 2024-01-13T18:05:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[119097]: failed to encode map e352 with expected crc 2024-01-13T18:05:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[119097]: failed to encode map e352 with expected crc 2024-01-13T18:05:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[119097]: osdmap e353: 8 total, 7 up, 8 in 2024-01-13T18:05:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[119097]: failed to encode map e353 with expected crc 2024-01-13T18:05:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:34.812 INFO:tasks.rados.rados.0.smithi084.stdout:1472: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:05:34.850 INFO:tasks.rados.rados.0.smithi084.stdout:1466: expect (ObjNum 403 snap 128 seq_num 403) 2024-01-13T18:05:34.869 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T18:05:34.581+0000 7f5707820640 -1 Falling back to public interface 2024-01-13T18:05:35.229 INFO:tasks.rados.rados.0.smithi084.stdout:1470: expect (ObjNum 450 snap 141 seq_num 450) 2024-01-13T18:05:35.492 INFO:tasks.rados.rados.0.smithi084.stdout:1476: expect (ObjNum 251 snap 75 seq_num 251) 2024-01-13T18:05:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:35 smithi099 ceph-mon[138788]: failed to encode map e353 with expected crc 2024-01-13T18:05:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:35 smithi099 ceph-mon[138788]: failed to encode map e353 with expected crc 2024-01-13T18:05:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:35 smithi099 ceph-mon[138788]: failed to encode map e353 with expected crc 2024-01-13T18:05:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:35 smithi099 ceph-mon[138788]: pgmap v241: 121 pgs: 9 active+undersized+degraded, 23 peering, 1 stale+active+clean, 9 active+undersized, 79 active+clean; 379 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 4.1 MiB/s wr, 16 op/s; 46/600 objects degraded (7.667%) 2024-01-13T18:05:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:35 smithi099 ceph-mon[138788]: osdmap e354: 8 total, 7 up, 8 in 2024-01-13T18:05:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:35 smithi099 ceph-mon[138788]: failed to encode map e354 with expected crc 2024-01-13T18:05:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:35.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[119097]: failed to encode map e353 with expected crc 2024-01-13T18:05:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[119097]: failed to encode map e353 with expected crc 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[119097]: failed to encode map e353 with expected crc 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[119097]: pgmap v241: 121 pgs: 9 active+undersized+degraded, 23 peering, 1 stale+active+clean, 9 active+undersized, 79 active+clean; 379 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 4.1 MiB/s wr, 16 op/s; 46/600 objects degraded (7.667%) 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[119097]: osdmap e354: 8 total, 7 up, 8 in 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[119097]: failed to encode map e354 with expected crc 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[116404]: failed to encode map e353 with expected crc 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[116404]: failed to encode map e353 with expected crc 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[116404]: failed to encode map e353 with expected crc 2024-01-13T18:05:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[116404]: pgmap v241: 121 pgs: 9 active+undersized+degraded, 23 peering, 1 stale+active+clean, 9 active+undersized, 79 active+clean; 379 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 4.1 MiB/s wr, 16 op/s; 46/600 objects degraded (7.667%) 2024-01-13T18:05:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[116404]: osdmap e354: 8 total, 7 up, 8 in 2024-01-13T18:05:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[116404]: failed to encode map e354 with expected crc 2024-01-13T18:05:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:35.940 INFO:tasks.rados.rados.0.smithi084.stdout:1463: done (10 left) 2024-01-13T18:05:35.940 INFO:tasks.rados.rados.0.smithi084.stdout:1464: done (9 left) 2024-01-13T18:05:35.940 INFO:tasks.rados.rados.0.smithi084.stdout:1465: done (8 left) 2024-01-13T18:05:35.940 INFO:tasks.rados.rados.0.smithi084.stdout:1466: done (7 left) 2024-01-13T18:05:35.940 INFO:tasks.rados.rados.0.smithi084.stdout:1467: done (6 left) 2024-01-13T18:05:35.940 INFO:tasks.rados.rados.0.smithi084.stdout:1468: done (5 left) 2024-01-13T18:05:35.940 INFO:tasks.rados.rados.0.smithi084.stdout:1470: done (4 left) 2024-01-13T18:05:35.940 INFO:tasks.rados.rados.0.smithi084.stdout:1471: done (3 left) 2024-01-13T18:05:35.940 INFO:tasks.rados.rados.0.smithi084.stdout:1472: done (2 left) 2024-01-13T18:05:35.941 INFO:tasks.rados.rados.0.smithi084.stdout:1476: done (1 left) 2024-01-13T18:05:35.941 INFO:tasks.rados.rados.0.smithi084.stdout:1477: done (0 left) 2024-01-13T18:05:35.941 INFO:tasks.rados.rados.0.smithi084.stdout:1478: rollback oid 49 current snap is 145 2024-01-13T18:05:35.941 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 142 2024-01-13T18:05:35.941 INFO:tasks.rados.rados.0.smithi084.stdout:1479: rmattr oid 46 current snap is 145 2024-01-13T18:05:35.941 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 145 2024-01-13T18:05:35.941 INFO:tasks.rados.rados.0.smithi084.stdout:1480: seq_num 465 ranges {843776=598016} 2024-01-13T18:05:35.947 INFO:tasks.rados.rados.0.smithi084.stdout:1480: writing smithi084102331-18 from 843776 to 1441792 tid 1 2024-01-13T18:05:35.947 INFO:tasks.rados.rados.0.smithi084.stdout:1481: snap_create 2024-01-13T18:05:35.948 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 498 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:05:35.948 INFO:tasks.rados.rados.0.smithi084.stdout:1478: finishing rollback tid 0 to smithi084102331-49 2024-01-13T18:05:35.948 INFO:tasks.rados.rados.0.smithi084.stdout:1478: finishing rollback tid 1 to smithi084102331-49 2024-01-13T18:05:35.948 INFO:tasks.rados.rados.0.smithi084.stdout:1478: finishing rollback tid 2 to smithi084102331-49 2024-01-13T18:05:35.948 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 745 (ObjNum 319 snap 101 seq_num 319) dirty exists 2024-01-13T18:05:35.950 INFO:tasks.rados.rados.0.smithi084.stdout:1480: finishing write tid 1 to smithi084102331-18 2024-01-13T18:05:35.950 INFO:tasks.rados.rados.0.smithi084.stdout:1480: finishing write tid 2 to smithi084102331-18 2024-01-13T18:05:35.951 INFO:tasks.rados.rados.0.smithi084.stdout:1480: finishing write tid 3 to smithi084102331-18 2024-01-13T18:05:35.951 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 379 (ObjNum 465 snap 145 seq_num 465) dirty exists 2024-01-13T18:05:35.951 INFO:tasks.rados.rados.0.smithi084.stdout:1480: left oid 18 (ObjNum 465 snap 145 seq_num 465) 2024-01-13T18:05:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:36 smithi099 ceph-mon[138788]: failed to encode map e354 with expected crc 2024-01-13T18:05:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:36 smithi099 ceph-mon[138788]: failed to encode map e355 with expected crc 2024-01-13T18:05:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:36 smithi099 ceph-mon[138788]: osdmap e355: 8 total, 7 up, 8 in 2024-01-13T18:05:36.623 INFO:tasks.rados.rados.0.smithi084.stdout:1478: done (3 left) 2024-01-13T18:05:36.623 INFO:tasks.rados.rados.0.smithi084.stdout:1479: done (2 left) 2024-01-13T18:05:36.623 INFO:tasks.rados.rados.0.smithi084.stdout:1480: done (1 left) 2024-01-13T18:05:36.623 INFO:tasks.rados.rados.0.smithi084.stdout:1481: done (0 left) 2024-01-13T18:05:36.623 INFO:tasks.rados.rados.0.smithi084.stdout:1482: delete oid 24 current snap is 146 2024-01-13T18:05:36.627 INFO:tasks.rados.rados.0.smithi084.stdout:1482: done (0 left) 2024-01-13T18:05:36.627 INFO:tasks.rados.rados.0.smithi084.stdout:1483: snap_remove snap 145 2024-01-13T18:05:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:36 smithi084 ceph-mon[116404]: failed to encode map e354 with expected crc 2024-01-13T18:05:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:36 smithi084 ceph-mon[116404]: failed to encode map e355 with expected crc 2024-01-13T18:05:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:36 smithi084 ceph-mon[116404]: osdmap e355: 8 total, 7 up, 8 in 2024-01-13T18:05:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:36 smithi084 ceph-mon[119097]: failed to encode map e354 with expected crc 2024-01-13T18:05:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:36 smithi084 ceph-mon[119097]: failed to encode map e355 with expected crc 2024-01-13T18:05:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:36 smithi084 ceph-mon[119097]: osdmap e355: 8 total, 7 up, 8 in 2024-01-13T18:05:37.607 INFO:tasks.rados.rados.0.smithi084.stdout:1483: done (0 left) 2024-01-13T18:05:37.608 INFO:tasks.rados.rados.0.smithi084.stdout:1484: delete oid 24 current snap is 146 2024-01-13T18:05:37.615 INFO:tasks.rados.rados.0.smithi084.stdout:1484: done (0 left) 2024-01-13T18:05:37.616 INFO:tasks.rados.rados.0.smithi084.stdout:1485: read oid 30 snap -1 2024-01-13T18:05:37.616 INFO:tasks.rados.rados.0.smithi084.stdout:1485: expect (ObjNum 462 snap 144 seq_num 462) 2024-01-13T18:05:37.616 INFO:tasks.rados.rados.0.smithi084.stdout:1486: read oid 43 snap -1 2024-01-13T18:05:37.616 INFO:tasks.rados.rados.0.smithi084.stdout:1486: expect (ObjNum 445 snap 139 seq_num 445) 2024-01-13T18:05:37.616 INFO:tasks.rados.rados.0.smithi084.stdout:1487: delete oid 29 current snap is 146 2024-01-13T18:05:37.619 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T18:05:37.417+0000 7f5707820640 -1 osd.4 0 read_superblock omap replica is missing. 2024-01-13T18:05:37.619 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T18:05:37.483+0000 7f5707820640 -1 osd.4 349 log_to_monitors true 2024-01-13T18:05:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:37 smithi099 ceph-mon[138788]: failed to encode map e355 with expected crc 2024-01-13T18:05:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:37 smithi099 ceph-mon[138788]: failed to encode map e355 with expected crc 2024-01-13T18:05:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:37 smithi099 ceph-mon[138788]: pgmap v244: 121 pgs: 14 active+undersized+degraded, 32 active+undersized, 75 active+clean; 354 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 132 KiB/s wr, 6 op/s; 112/582 objects degraded (19.244%) 2024-01-13T18:05:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:37 smithi099 ceph-mon[138788]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2024-01-13T18:05:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:37 smithi099 ceph-mon[138788]: osdmap e356: 8 total, 7 up, 8 in 2024-01-13T18:05:37.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:37.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:37.620 INFO:tasks.rados.rados.0.smithi084.stdout:1487: done (2 left) 2024-01-13T18:05:37.620 INFO:tasks.rados.rados.0.smithi084.stdout:1488: read oid 20 snap 137 2024-01-13T18:05:37.620 INFO:tasks.rados.rados.0.smithi084.stdout:1488: expect (ObjNum 432 snap 137 seq_num 432) 2024-01-13T18:05:37.620 INFO:tasks.rados.rados.0.smithi084.stdout:1489: rollback oid 26 current snap is 146 2024-01-13T18:05:37.620 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 138 2024-01-13T18:05:37.620 INFO:tasks.rados.rados.0.smithi084.stdout:1490: snap_create 2024-01-13T18:05:37.621 INFO:tasks.rados.rados.0.smithi084.stdout:1489: finishing rollback tid 1 to smithi084102331-26 2024-01-13T18:05:37.621 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 445 (ObjNum 897 snap 0 seq_num 4037054000) dirty dne 2024-01-13T18:05:37.626 INFO:tasks.rados.rados.0.smithi084.stdout:1486: expect (ObjNum 445 snap 139 seq_num 445) 2024-01-13T18:05:37.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[119097]: failed to encode map e355 with expected crc 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[119097]: failed to encode map e355 with expected crc 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[119097]: pgmap v244: 121 pgs: 14 active+undersized+degraded, 32 active+undersized, 75 active+clean; 354 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 132 KiB/s wr, 6 op/s; 112/582 objects degraded (19.244%) 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[119097]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[119097]: osdmap e356: 8 total, 7 up, 8 in 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[116404]: failed to encode map e355 with expected crc 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[116404]: failed to encode map e355 with expected crc 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[116404]: pgmap v244: 121 pgs: 14 active+undersized+degraded, 32 active+undersized, 75 active+clean; 354 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 132 KiB/s wr, 6 op/s; 112/582 objects degraded (19.244%) 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[116404]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[116404]: osdmap e356: 8 total, 7 up, 8 in 2024-01-13T18:05:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:37.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:37.707 INFO:tasks.rados.rados.0.smithi084.stdout:1488: expect (ObjNum 432 snap 137 seq_num 432) 2024-01-13T18:05:37.733 INFO:tasks.rados.rados.0.smithi084.stdout:1485: expect (ObjNum 462 snap 144 seq_num 462) 2024-01-13T18:05:38.039 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 18:05:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T18:05:37.639+0000 7f56f8c7b700 -1 osd.4 349 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T18:05:38.353 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:38 smithi099 ceph-mon[138788]: failed to encode map e356 with expected crc 2024-01-13T18:05:38.353 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:38 smithi099 ceph-mon[138788]: from='osd.4 [v2:172.21.15.99:6800/3301222659,v1:172.21.15.99:6801/3301222659]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T18:05:38.353 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:38 smithi099 ceph-mon[138788]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T18:05:38.353 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:38.353 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:38.354 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:38 smithi099 ceph-mon[138788]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-13T18:05:38.354 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:38 smithi099 ceph-mon[138788]: osdmap e357: 8 total, 7 up, 8 in 2024-01-13T18:05:38.354 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:38 smithi099 ceph-mon[138788]: from='osd.4 [v2:172.21.15.99:6800/3301222659,v1:172.21.15.99:6801/3301222659]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:05:38.354 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:38 smithi099 ceph-mon[138788]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:05:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:1485: done (4 left) 2024-01-13T18:05:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:1486: done (3 left) 2024-01-13T18:05:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:1488: done (2 left) 2024-01-13T18:05:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:1489: done (1 left) 2024-01-13T18:05:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:1490: done (0 left) 2024-01-13T18:05:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:1491: rollback oid 29 current snap is 147 2024-01-13T18:05:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 146 2024-01-13T18:05:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:1492: read oid 47 snap -1 2024-01-13T18:05:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:1492: expect (ObjNum 286 snap 89 seq_num 286) 2024-01-13T18:05:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:1493: copy_from oid 19 from oid 8 current snap is 147 2024-01-13T18:05:38.625 INFO:tasks.rados.rados.0.smithi084.stdout:1494: rollback oid 41 current snap is 147 2024-01-13T18:05:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 143 2024-01-13T18:05:38.626 INFO:tasks.rados.rados.0.smithi084.stdout:1495: snap_remove snap 139 2024-01-13T18:05:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[116404]: failed to encode map e356 with expected crc 2024-01-13T18:05:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[116404]: from='osd.4 [v2:172.21.15.99:6800/3301222659,v1:172.21.15.99:6801/3301222659]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T18:05:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[116404]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T18:05:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[116404]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-13T18:05:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[116404]: osdmap e357: 8 total, 7 up, 8 in 2024-01-13T18:05:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[116404]: from='osd.4 [v2:172.21.15.99:6800/3301222659,v1:172.21.15.99:6801/3301222659]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:05:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[116404]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:05:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[119097]: failed to encode map e356 with expected crc 2024-01-13T18:05:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[119097]: from='osd.4 [v2:172.21.15.99:6800/3301222659,v1:172.21.15.99:6801/3301222659]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T18:05:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[119097]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-13T18:05:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[119097]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-13T18:05:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[119097]: osdmap e357: 8 total, 7 up, 8 in 2024-01-13T18:05:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[119097]: from='osd.4 [v2:172.21.15.99:6800/3301222659,v1:172.21.15.99:6801/3301222659]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:05:38.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:38 smithi084 ceph-mon[119097]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:05:39.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:05:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:05:38.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:05:39.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:39 smithi099 ceph-mon[138788]: failed to encode map e357 with expected crc 2024-01-13T18:05:39.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:39 smithi099 ceph-mon[138788]: failed to encode map e357 with expected crc 2024-01-13T18:05:39.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:39 smithi099 ceph-mon[138788]: failed to encode map e357 with expected crc 2024-01-13T18:05:39.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:39 smithi099 ceph-mon[138788]: pgmap v247: 121 pgs: 14 active+undersized+degraded, 32 active+undersized, 75 active+clean; 351 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 268 KiB/s wr, 9 op/s; 114/567 objects degraded (20.106%) 2024-01-13T18:05:39.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:39 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 114/567 objects degraded (20.106%), 14 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:39.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:39 smithi099 ceph-mon[138788]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:05:39.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:39 smithi099 ceph-mon[138788]: failed to encode map e358 with expected crc 2024-01-13T18:05:39.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:39 smithi099 ceph-mon[138788]: osd.4 [v2:172.21.15.99:6800/3301222659,v1:172.21.15.99:6801/3301222659] boot 2024-01-13T18:05:39.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:39 smithi099 ceph-mon[138788]: osdmap e358: 8 total, 8 up, 8 in 2024-01-13T18:05:39.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:39 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:05:39.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:39 smithi099 ceph-mon[138788]: failed to encode map e358 with expected crc 2024-01-13T18:05:39.631 INFO:tasks.rados.rados.0.smithi084.stdout:1495: done (4 left) 2024-01-13T18:05:39.631 INFO:tasks.rados.rados.0.smithi084.stdout:1496: copy_from oid 5 from oid 10 current snap is 147 2024-01-13T18:05:39.631 INFO:tasks.rados.rados.0.smithi084.stdout:1497: read oid 33 snap -1 2024-01-13T18:05:39.631 INFO:tasks.rados.rados.0.smithi084.stdout:1497: expect (ObjNum 461 snap 143 seq_num 461) 2024-01-13T18:05:39.631 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 147 2024-01-13T18:05:39.631 INFO:tasks.rados.rados.0.smithi084.stdout:1498: seq_num 469 ranges {548864=663552} 2024-01-13T18:05:39.631 INFO:tasks.rados.rados.0.smithi084.stdout:1498: writing smithi084102331-49 from 548864 to 1212416 tid 1 2024-01-13T18:05:39.632 INFO:tasks.rados.rados.0.smithi084.stdout:1499: read oid 18 snap -1 2024-01-13T18:05:39.632 INFO:tasks.rados.rados.0.smithi084.stdout:1499: expect (ObjNum 465 snap 145 seq_num 465) 2024-01-13T18:05:39.633 INFO:tasks.rados.rados.0.smithi084.stdout:1500: delete oid 35 current snap is 147 2024-01-13T18:05:39.650 INFO:tasks.rados.rados.0.smithi084.stdout:1494: finishing rollback tid 0 to smithi084102331-41 2024-01-13T18:05:39.651 INFO:tasks.rados.rados.0.smithi084.stdout:1494: finishing rollback tid 1 to smithi084102331-41 2024-01-13T18:05:39.653 INFO:tasks.rados.rados.0.smithi084.stdout:1494: finishing rollback tid 2 to smithi084102331-41 2024-01-13T18:05:39.653 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 502 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:05:39.655 INFO:tasks.rados.rados.0.smithi084.stdout:1498: finishing write tid 1 to smithi084102331-49 2024-01-13T18:05:39.656 INFO:tasks.rados.rados.0.smithi084.stdout:1498: finishing write tid 2 to smithi084102331-49 2024-01-13T18:05:39.658 INFO:tasks.rados.rados.0.smithi084.stdout:1499: expect (ObjNum 465 snap 145 seq_num 465) 2024-01-13T18:05:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[116404]: failed to encode map e357 with expected crc 2024-01-13T18:05:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[116404]: failed to encode map e357 with expected crc 2024-01-13T18:05:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[116404]: failed to encode map e357 with expected crc 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[116404]: pgmap v247: 121 pgs: 14 active+undersized+degraded, 32 active+undersized, 75 active+clean; 351 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 268 KiB/s wr, 9 op/s; 114/567 objects degraded (20.106%) 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 114/567 objects degraded (20.106%), 14 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[116404]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[116404]: failed to encode map e358 with expected crc 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[116404]: osd.4 [v2:172.21.15.99:6800/3301222659,v1:172.21.15.99:6801/3301222659] boot 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[116404]: osdmap e358: 8 total, 8 up, 8 in 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[116404]: failed to encode map e358 with expected crc 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[119097]: failed to encode map e357 with expected crc 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[119097]: failed to encode map e357 with expected crc 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[119097]: failed to encode map e357 with expected crc 2024-01-13T18:05:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[119097]: pgmap v247: 121 pgs: 14 active+undersized+degraded, 32 active+undersized, 75 active+clean; 351 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 268 KiB/s wr, 9 op/s; 114/567 objects degraded (20.106%) 2024-01-13T18:05:39.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 114/567 objects degraded (20.106%), 14 pgs degraded (PG_DEGRADED) 2024-01-13T18:05:39.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[119097]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:05:39.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[119097]: failed to encode map e358 with expected crc 2024-01-13T18:05:39.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[119097]: osd.4 [v2:172.21.15.99:6800/3301222659,v1:172.21.15.99:6801/3301222659] boot 2024-01-13T18:05:39.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[119097]: osdmap e358: 8 total, 8 up, 8 in 2024-01-13T18:05:39.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-13T18:05:39.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:39 smithi084 ceph-mon[119097]: failed to encode map e358 with expected crc 2024-01-13T18:05:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:1494: done (8 left) 2024-01-13T18:05:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:1499: done (7 left) 2024-01-13T18:05:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:1500: done (6 left) 2024-01-13T18:05:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 147 2024-01-13T18:05:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:1491: finishing rollback tid 1 to smithi084102331-29 2024-01-13T18:05:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 546 (ObjNum 353 snap 0 seq_num 4037520912) dirty dne 2024-01-13T18:05:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:1498: finishing write tid 3 to smithi084102331-49 2024-01-13T18:05:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 747 (ObjNum 469 snap 147 seq_num 469) dirty exists 2024-01-13T18:05:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:1498: left oid 49 (ObjNum 469 snap 147 seq_num 469) 2024-01-13T18:05:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:1497: expect (ObjNum 461 snap 143 seq_num 461) 2024-01-13T18:05:39.963 INFO:tasks.rados.rados.0.smithi084.stdout:1492: expect (ObjNum 286 snap 89 seq_num 286) 2024-01-13T18:05:40.372 INFO:tasks.rados.rados.0.smithi084.stdout:1493: finishing copy_from to smithi084102331-19 2024-01-13T18:05:40.372 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 609 (ObjNum 403 snap 128 seq_num 403) dirty exists 2024-01-13T18:05:40.373 INFO:tasks.rados.rados.0.smithi084.stdout:1493: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:05:40.373 INFO:tasks.rados.rados.0.smithi084.stdout:1496: finishing copy_from to smithi084102331-5 2024-01-13T18:05:40.373 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 377 (ObjNum 456 snap 142 seq_num 456) dirty exists 2024-01-13T18:05:40.373 INFO:tasks.rados.rados.0.smithi084.stdout:1496: finishing copy_from racing read to smithi084102331-5 2024-01-13T18:05:40.373 INFO:tasks.rados.rados.0.smithi084.stdout:1501: seq_num 471 ranges {2564096=696320} 2024-01-13T18:05:40.389 INFO:tasks.rados.rados.0.smithi084.stdout:1501: writing smithi084102331-48 from 2564096 to 3260416 tid 1 2024-01-13T18:05:40.389 INFO:tasks.rados.rados.0.smithi084.stdout:1491: done (6 left) 2024-01-13T18:05:40.390 INFO:tasks.rados.rados.0.smithi084.stdout:1492: done (5 left) 2024-01-13T18:05:40.390 INFO:tasks.rados.rados.0.smithi084.stdout:1493: done (4 left) 2024-01-13T18:05:40.390 INFO:tasks.rados.rados.0.smithi084.stdout:1496: done (3 left) 2024-01-13T18:05:40.390 INFO:tasks.rados.rados.0.smithi084.stdout:1497: done (2 left) 2024-01-13T18:05:40.390 INFO:tasks.rados.rados.0.smithi084.stdout:1498: done (1 left) 2024-01-13T18:05:40.390 INFO:tasks.rados.rados.0.smithi084.stdout:1502: snap_create 2024-01-13T18:05:40.393 INFO:tasks.rados.rados.0.smithi084.stdout:1501: finishing write tid 1 to smithi084102331-48 2024-01-13T18:05:40.394 INFO:tasks.rados.rados.0.smithi084.stdout:1501: finishing write tid 2 to smithi084102331-48 2024-01-13T18:05:40.395 INFO:tasks.rados.rados.0.smithi084.stdout:1501: finishing write tid 3 to smithi084102331-48 2024-01-13T18:05:40.395 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 756 (ObjNum 471 snap 147 seq_num 471) dirty exists 2024-01-13T18:05:40.395 INFO:tasks.rados.rados.0.smithi084.stdout:1501: left oid 48 (ObjNum 471 snap 147 seq_num 471) 2024-01-13T18:05:40.620 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:05:40.274+0000 7fcaf82a4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-01-13T18:05:40.620 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:05:40] "GET /metrics HTTP/1.1" 200 36203 "" "Prometheus/2.43.0" 2024-01-13T18:05:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: osdmap e359: 8 total, 8 up, 8 in 2024-01-13T18:05:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: pgmap v250: 121 pgs: 2 activating, 5 peering, 10 active+undersized+degraded, 1 active+recovery_wait+degraded, 27 active+undersized, 76 active+clean; 351 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 3.1 MiB/s rd, 282 KiB/s wr, 4 op/s; 97/573 objects degraded (16.928%) 2024-01-13T18:05:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:05:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:40.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:40.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: osdmap e359: 8 total, 8 up, 8 in 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: failed to encode map e359 with expected crc 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: pgmap v250: 121 pgs: 2 activating, 5 peering, 10 active+undersized+degraded, 1 active+recovery_wait+degraded, 27 active+undersized, 76 active+clean; 351 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 3.1 MiB/s rd, 282 KiB/s wr, 4 op/s; 97/573 objects degraded (16.928%) 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:40.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:40.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:40.932 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:40 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: failed to encode map e359 with expected crc 2024-01-13T18:05:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: failed to encode map e359 with expected crc 2024-01-13T18:05:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: osdmap e359: 8 total, 8 up, 8 in 2024-01-13T18:05:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: failed to encode map e359 with expected crc 2024-01-13T18:05:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: failed to encode map e359 with expected crc 2024-01-13T18:05:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: failed to encode map e359 with expected crc 2024-01-13T18:05:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: failed to encode map e359 with expected crc 2024-01-13T18:05:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: failed to encode map e359 with expected crc 2024-01-13T18:05:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: pgmap v250: 121 pgs: 2 activating, 5 peering, 10 active+undersized+degraded, 1 active+recovery_wait+degraded, 27 active+undersized, 76 active+clean; 351 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 3.1 MiB/s rd, 282 KiB/s wr, 4 op/s; 97/573 objects degraded (16.928%) 2024-01-13T18:05:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:05:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:05:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:40 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:41.130 INFO:tasks.rados.rados.0.smithi084.stdout:1501: done (1 left) 2024-01-13T18:05:41.130 INFO:tasks.rados.rados.0.smithi084.stdout:1502: done (0 left) 2024-01-13T18:05:41.130 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 148 2024-01-13T18:05:41.130 INFO:tasks.rados.rados.0.smithi084.stdout:1503: seq_num 472 ranges {1982464=712704} 2024-01-13T18:05:41.144 INFO:tasks.rados.rados.0.smithi084.stdout:1503: writing smithi084102331-9 from 1982464 to 2695168 tid 1 2024-01-13T18:05:41.144 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 148 2024-01-13T18:05:41.144 INFO:tasks.rados.rados.0.smithi084.stdout:1504: seq_num 473 ranges {3465216=729088} 2024-01-13T18:05:41.167 INFO:tasks.rados.rados.0.smithi084.stdout:1504: writing smithi084102331-10 from 3465216 to 4194304 tid 1 2024-01-13T18:05:41.167 INFO:tasks.rados.rados.0.smithi084.stdout:1505: copy_from oid 6 from oid 7 current snap is 148 2024-01-13T18:05:41.167 INFO:tasks.rados.rados.0.smithi084.stdout:1503: finishing write tid 1 to smithi084102331-9 2024-01-13T18:05:41.168 INFO:tasks.rados.rados.0.smithi084.stdout:1503: finishing write tid 2 to smithi084102331-9 2024-01-13T18:05:41.168 INFO:tasks.rados.rados.0.smithi084.stdout:1503: finishing write tid 3 to smithi084102331-9 2024-01-13T18:05:41.168 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 494 (ObjNum 472 snap 148 seq_num 472) dirty exists 2024-01-13T18:05:41.168 INFO:tasks.rados.rados.0.smithi084.stdout:1503: left oid 9 (ObjNum 472 snap 148 seq_num 472) 2024-01-13T18:05:41.168 INFO:tasks.rados.rados.0.smithi084.stdout:1503: done (2 left) 2024-01-13T18:05:41.168 INFO:tasks.rados.rados.0.smithi084.stdout:1506: rmattr oid 50 current snap is 148 2024-01-13T18:05:41.168 INFO:tasks.rados.rados.0.smithi084.stdout:1506: done (2 left) 2024-01-13T18:05:41.168 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 148 2024-01-13T18:05:41.168 INFO:tasks.rados.rados.0.smithi084.stdout:1507: seq_num 474 ranges {425984=745472} 2024-01-13T18:05:41.175 INFO:tasks.rados.rados.0.smithi084.stdout:1507: writing smithi084102331-38 from 425984 to 1171456 tid 1 2024-01-13T18:05:41.175 INFO:tasks.rados.rados.0.smithi084.stdout:1508: delete oid 18 current snap is 148 2024-01-13T18:05:41.175 INFO:tasks.rados.rados.0.smithi084.stdout:1504: finishing write tid 1 to smithi084102331-10 2024-01-13T18:05:41.175 INFO:tasks.rados.rados.0.smithi084.stdout:1504: finishing write tid 2 to smithi084102331-10 2024-01-13T18:05:41.175 INFO:tasks.rados.rados.0.smithi084.stdout:1504: finishing write tid 3 to smithi084102331-10 2024-01-13T18:05:41.175 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 381 (ObjNum 473 snap 148 seq_num 473) dirty exists 2024-01-13T18:05:41.175 INFO:tasks.rados.rados.0.smithi084.stdout:1504: left oid 10 (ObjNum 473 snap 148 seq_num 473) 2024-01-13T18:05:41.181 INFO:tasks.rados.rados.0.smithi084.stdout:1504: done (3 left) 2024-01-13T18:05:41.181 INFO:tasks.rados.rados.0.smithi084.stdout:1508: done (2 left) 2024-01-13T18:05:41.181 INFO:tasks.rados.rados.0.smithi084.stdout:1509: read oid 29 snap -1 2024-01-13T18:05:41.181 INFO:tasks.rados.rados.0.smithi084.stdout:1509: expect deleted 2024-01-13T18:05:41.181 INFO:tasks.rados.rados.0.smithi084.stdout:1510: snap_create 2024-01-13T18:05:41.181 INFO:tasks.rados.rados.0.smithi084.stdout:1505: finishing copy_from to smithi084102331-6 2024-01-13T18:05:41.181 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 388 (ObjNum 449 snap 141 seq_num 449) dirty exists 2024-01-13T18:05:41.182 INFO:tasks.rados.rados.0.smithi084.stdout:1507: finishing write tid 1 to smithi084102331-38 2024-01-13T18:05:41.182 INFO:tasks.rados.rados.0.smithi084.stdout:1505: finishing copy_from racing read to smithi084102331-6 2024-01-13T18:05:41.182 INFO:tasks.rados.rados.0.smithi084.stdout:1507: finishing write tid 2 to smithi084102331-38 2024-01-13T18:05:41.183 INFO:tasks.rados.rados.0.smithi084.stdout:1507: finishing write tid 3 to smithi084102331-38 2024-01-13T18:05:41.183 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 871 (ObjNum 474 snap 148 seq_num 474) dirty exists 2024-01-13T18:05:41.183 INFO:tasks.rados.rados.0.smithi084.stdout:1507: left oid 38 (ObjNum 474 snap 148 seq_num 474) 2024-01-13T18:05:42.136 INFO:tasks.rados.rados.0.smithi084.stdout:1505: done (3 left) 2024-01-13T18:05:42.136 INFO:tasks.rados.rados.0.smithi084.stdout:1507: done (2 left) 2024-01-13T18:05:42.136 INFO:tasks.rados.rados.0.smithi084.stdout:1509: done (1 left) 2024-01-13T18:05:42.136 INFO:tasks.rados.rados.0.smithi084.stdout:1510: done (0 left) 2024-01-13T18:05:42.136 INFO:tasks.rados.rados.0.smithi084.stdout:1511: delete oid 24 current snap is 149 2024-01-13T18:05:42.139 INFO:tasks.rados.rados.0.smithi084.stdout:1511: done (0 left) 2024-01-13T18:05:42.139 INFO:tasks.rados.rados.0.smithi084.stdout:1512: snap_create 2024-01-13T18:05:42.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:42 smithi084 ceph-mon[116404]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-01-13T18:05:42.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:42 smithi084 ceph-mon[116404]: failed to encode map e360 with expected crc 2024-01-13T18:05:42.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:42 smithi084 ceph-mon[116404]: failed to encode map e360 with expected crc 2024-01-13T18:05:42.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:42 smithi084 ceph-mon[116404]: osdmap e360: 8 total, 8 up, 8 in 2024-01-13T18:05:42.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:42 smithi084 ceph-mon[116404]: failed to encode map e360 with expected crc 2024-01-13T18:05:42.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:42 smithi084 ceph-mon[119097]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-01-13T18:05:42.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:42 smithi084 ceph-mon[119097]: failed to encode map e360 with expected crc 2024-01-13T18:05:42.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:42 smithi084 ceph-mon[119097]: failed to encode map e360 with expected crc 2024-01-13T18:05:42.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:42 smithi084 ceph-mon[119097]: osdmap e360: 8 total, 8 up, 8 in 2024-01-13T18:05:42.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:42 smithi084 ceph-mon[119097]: failed to encode map e360 with expected crc 2024-01-13T18:05:42.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:42 smithi099 ceph-mon[138788]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-01-13T18:05:42.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:42 smithi099 ceph-mon[138788]: failed to encode map e360 with expected crc 2024-01-13T18:05:42.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:42 smithi099 ceph-mon[138788]: failed to encode map e360 with expected crc 2024-01-13T18:05:42.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:42 smithi099 ceph-mon[138788]: osdmap e360: 8 total, 8 up, 8 in 2024-01-13T18:05:42.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:42 smithi099 ceph-mon[138788]: failed to encode map e360 with expected crc 2024-01-13T18:05:43.137 INFO:tasks.rados.rados.0.smithi084.stdout:1512: done (0 left) 2024-01-13T18:05:43.137 INFO:tasks.rados.rados.0.smithi084.stdout:1513: snap_remove snap 138 2024-01-13T18:05:43.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:43 smithi084 ceph-mon[119097]: pgmap v252: 121 pgs: 2 activating, 5 peering, 3 active+undersized+degraded, 1 active+recovery_wait+degraded, 6 active+undersized, 104 active+clean; 352 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.4 MiB/s wr, 8 op/s; 39/546 objects degraded (7.143%); 4.6 MiB/s, 1 objects/s recovering 2024-01-13T18:05:43.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:43 smithi084 ceph-mon[119097]: failed to encode map e361 with expected crc 2024-01-13T18:05:43.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:43 smithi084 ceph-mon[119097]: failed to encode map e361 with expected crc 2024-01-13T18:05:43.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:43 smithi084 ceph-mon[119097]: osdmap e361: 8 total, 8 up, 8 in 2024-01-13T18:05:43.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:43 smithi084 ceph-mon[116404]: pgmap v252: 121 pgs: 2 activating, 5 peering, 3 active+undersized+degraded, 1 active+recovery_wait+degraded, 6 active+undersized, 104 active+clean; 352 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.4 MiB/s wr, 8 op/s; 39/546 objects degraded (7.143%); 4.6 MiB/s, 1 objects/s recovering 2024-01-13T18:05:43.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:43 smithi084 ceph-mon[116404]: failed to encode map e361 with expected crc 2024-01-13T18:05:43.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:43 smithi084 ceph-mon[116404]: failed to encode map e361 with expected crc 2024-01-13T18:05:43.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:43 smithi084 ceph-mon[116404]: osdmap e361: 8 total, 8 up, 8 in 2024-01-13T18:05:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:43 smithi099 ceph-mon[138788]: pgmap v252: 121 pgs: 2 activating, 5 peering, 3 active+undersized+degraded, 1 active+recovery_wait+degraded, 6 active+undersized, 104 active+clean; 352 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.4 MiB/s wr, 8 op/s; 39/546 objects degraded (7.143%); 4.6 MiB/s, 1 objects/s recovering 2024-01-13T18:05:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:43 smithi099 ceph-mon[138788]: failed to encode map e361 with expected crc 2024-01-13T18:05:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:43 smithi099 ceph-mon[138788]: failed to encode map e361 with expected crc 2024-01-13T18:05:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:43 smithi099 ceph-mon[138788]: osdmap e361: 8 total, 8 up, 8 in 2024-01-13T18:05:44.140 INFO:tasks.rados.rados.0.smithi084.stdout:1513: done (0 left) 2024-01-13T18:05:44.140 INFO:tasks.rados.rados.0.smithi084.stdout:1514: snap_create 2024-01-13T18:05:44.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:44 smithi084 ceph-mon[116404]: failed to encode map e362 with expected crc 2024-01-13T18:05:44.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:44 smithi084 ceph-mon[116404]: failed to encode map e362 with expected crc 2024-01-13T18:05:44.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:44 smithi084 ceph-mon[116404]: osdmap e362: 8 total, 8 up, 8 in 2024-01-13T18:05:44.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:44 smithi084 ceph-mon[116404]: osdmap e363: 8 total, 8 up, 8 in 2024-01-13T18:05:44.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:44 smithi084 ceph-mon[119097]: failed to encode map e362 with expected crc 2024-01-13T18:05:44.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:44 smithi084 ceph-mon[119097]: failed to encode map e362 with expected crc 2024-01-13T18:05:44.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:44 smithi084 ceph-mon[119097]: osdmap e362: 8 total, 8 up, 8 in 2024-01-13T18:05:44.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:44 smithi084 ceph-mon[119097]: osdmap e363: 8 total, 8 up, 8 in 2024-01-13T18:05:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:44 smithi099 ceph-mon[138788]: failed to encode map e362 with expected crc 2024-01-13T18:05:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:44 smithi099 ceph-mon[138788]: failed to encode map e362 with expected crc 2024-01-13T18:05:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:44 smithi099 ceph-mon[138788]: osdmap e362: 8 total, 8 up, 8 in 2024-01-13T18:05:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:44 smithi099 ceph-mon[138788]: osdmap e363: 8 total, 8 up, 8 in 2024-01-13T18:05:45.141 INFO:tasks.rados.rados.0.smithi084.stdout:1514: done (0 left) 2024-01-13T18:05:45.141 INFO:tasks.rados.rados.0.smithi084.stdout:1515: read oid 11 snap -1 2024-01-13T18:05:45.141 INFO:tasks.rados.rados.0.smithi084.stdout:1515: expect (ObjNum 441 snap 138 seq_num 441) 2024-01-13T18:05:45.141 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 151 2024-01-13T18:05:45.141 INFO:tasks.rados.rados.0.smithi084.stdout:1516: seq_num 477 ranges {0=794624} 2024-01-13T18:05:45.145 INFO:tasks.rados.rados.0.smithi084.stdout:1516: writing smithi084102331-24 from 0 to 794624 tid 1 2024-01-13T18:05:45.146 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 151 2024-01-13T18:05:45.146 INFO:tasks.rados.rados.0.smithi084.stdout:1517: seq_num 478 ranges {4620288=409600,5029888=401408} 2024-01-13T18:05:45.173 INFO:tasks.rados.rados.0.smithi084.stdout:1517: writing smithi084102331-32 from 4620288 to 5029888 tid 1 2024-01-13T18:05:45.176 INFO:tasks.rados.rados.0.smithi084.stdout:1517: writing smithi084102331-32 from 5029888 to 5431296 tid 2 2024-01-13T18:05:45.176 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 151 2024-01-13T18:05:45.176 INFO:tasks.rados.rados.0.smithi084.stdout:1516: finishing write tid 1 to smithi084102331-24 2024-01-13T18:05:45.176 INFO:tasks.rados.rados.0.smithi084.stdout:1518: seq_num 479 ranges {425984=425984,851968=401408} 2024-01-13T18:05:45.180 INFO:tasks.rados.rados.0.smithi084.stdout:1518: writing smithi084102331-36 from 425984 to 851968 tid 1 2024-01-13T18:05:45.183 INFO:tasks.rados.rados.0.smithi084.stdout:1518: writing smithi084102331-36 from 851968 to 1253376 tid 2 2024-01-13T18:05:45.183 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 151 2024-01-13T18:05:45.183 INFO:tasks.rados.rados.0.smithi084.stdout:1516: finishing write tid 2 to smithi084102331-24 2024-01-13T18:05:45.183 INFO:tasks.rados.rados.0.smithi084.stdout:1516: finishing write tid 3 to smithi084102331-24 2024-01-13T18:05:45.183 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 430 (ObjNum 477 snap 151 seq_num 477) dirty exists 2024-01-13T18:05:45.183 INFO:tasks.rados.rados.0.smithi084.stdout:1516: left oid 24 (ObjNum 477 snap 151 seq_num 477) 2024-01-13T18:05:45.183 INFO:tasks.rados.rados.0.smithi084.stdout:1515: expect (ObjNum 441 snap 138 seq_num 441) 2024-01-13T18:05:45.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[116404]: pgmap v255: 121 pgs: 2 activating, 1 active+recovery_wait+degraded, 118 active+clean; 311 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 3.5 MiB/s wr, 11 op/s; 2/504 objects degraded (0.397%); 5.7 MiB/s, 2 objects/s recovering 2024-01-13T18:05:45.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[116404]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[116404]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 2/504 objects degraded (0.397%), 1 pg degraded (PG_DEGRADED) 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[116404]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[116404]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[116404]: osdmap e364: 8 total, 8 up, 8 in 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[119097]: pgmap v255: 121 pgs: 2 activating, 1 active+recovery_wait+degraded, 118 active+clean; 311 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 3.5 MiB/s wr, 11 op/s; 2/504 objects degraded (0.397%); 5.7 MiB/s, 2 objects/s recovering 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[119097]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[119097]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 2/504 objects degraded (0.397%), 1 pg degraded (PG_DEGRADED) 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[119097]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[119097]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:45 smithi084 ceph-mon[119097]: osdmap e364: 8 total, 8 up, 8 in 2024-01-13T18:05:45.449 INFO:tasks.rados.rados.0.smithi084.stdout:1517: finishing write tid 1 to smithi084102331-32 2024-01-13T18:05:45.450 INFO:tasks.rados.rados.0.smithi084.stdout:1517: finishing write tid 2 to smithi084102331-32 2024-01-13T18:05:45.450 INFO:tasks.rados.rados.0.smithi084.stdout:1517: finishing write tid 3 to smithi084102331-32 2024-01-13T18:05:45.450 INFO:tasks.rados.rados.0.smithi084.stdout:1517: finishing write tid 4 to smithi084102331-32 2024-01-13T18:05:45.450 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 796 (ObjNum 478 snap 151 seq_num 478) dirty exists 2024-01-13T18:05:45.450 INFO:tasks.rados.rados.0.smithi084.stdout:1517: left oid 32 (ObjNum 478 snap 151 seq_num 478) 2024-01-13T18:05:45.450 INFO:tasks.rados.rados.0.smithi084.stdout:1518: finishing write tid 1 to smithi084102331-36 2024-01-13T18:05:45.450 INFO:tasks.rados.rados.0.smithi084.stdout:1519: seq_num 480 ranges {9838592=442368,10280960=401408} 2024-01-13T18:05:45.503 INFO:tasks.rados.rados.0.smithi084.stdout:1519: writing smithi084102331-22 from 9838592 to 10280960 tid 1 2024-01-13T18:05:45.505 INFO:tasks.rados.rados.0.smithi084.stdout:1519: writing smithi084102331-22 from 10280960 to 10682368 tid 2 2024-01-13T18:05:45.505 INFO:tasks.rados.rados.0.smithi084.stdout:1515: done (4 left) 2024-01-13T18:05:45.505 INFO:tasks.rados.rados.0.smithi084.stdout:1516: done (3 left) 2024-01-13T18:05:45.505 INFO:tasks.rados.rados.0.smithi084.stdout:1517: done (2 left) 2024-01-13T18:05:45.505 INFO:tasks.rados.rados.0.smithi084.stdout:1520: snap_remove snap 137 2024-01-13T18:05:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:45 smithi099 ceph-mon[138788]: pgmap v255: 121 pgs: 2 activating, 1 active+recovery_wait+degraded, 118 active+clean; 311 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 3.5 MiB/s wr, 11 op/s; 2/504 objects degraded (0.397%); 5.7 MiB/s, 2 objects/s recovering 2024-01-13T18:05:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:45 smithi099 ceph-mon[138788]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:45 smithi099 ceph-mon[138788]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:45 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 2/504 objects degraded (0.397%), 1 pg degraded (PG_DEGRADED) 2024-01-13T18:05:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:45 smithi099 ceph-mon[138788]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:45 smithi099 ceph-mon[138788]: failed to encode map e363 with expected crc 2024-01-13T18:05:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:45 smithi099 ceph-mon[138788]: osdmap e364: 8 total, 8 up, 8 in 2024-01-13T18:05:46.160 INFO:tasks.rados.rados.0.smithi084.stdout:1520: done (2 left) 2024-01-13T18:05:46.161 INFO:tasks.rados.rados.0.smithi084.stdout:1521: rollback oid 46 current snap is 151 2024-01-13T18:05:46.161 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 142 2024-01-13T18:05:46.161 INFO:tasks.rados.rados.0.smithi084.stdout:1522: snap_remove snap 147 2024-01-13T18:05:46.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:46 smithi084 ceph-mon[119097]: failed to encode map e364 with expected crc 2024-01-13T18:05:46.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:46 smithi084 ceph-mon[119097]: failed to encode map e364 with expected crc 2024-01-13T18:05:46.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:46 smithi084 ceph-mon[119097]: failed to encode map e364 with expected crc 2024-01-13T18:05:46.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:46 smithi084 ceph-mon[116404]: failed to encode map e364 with expected crc 2024-01-13T18:05:46.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:46 smithi084 ceph-mon[116404]: failed to encode map e364 with expected crc 2024-01-13T18:05:46.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:46 smithi084 ceph-mon[116404]: failed to encode map e364 with expected crc 2024-01-13T18:05:46.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:46 smithi099 ceph-mon[138788]: failed to encode map e364 with expected crc 2024-01-13T18:05:46.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:46 smithi099 ceph-mon[138788]: failed to encode map e364 with expected crc 2024-01-13T18:05:46.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:46 smithi099 ceph-mon[138788]: failed to encode map e364 with expected crc 2024-01-13T18:05:47.168 INFO:tasks.rados.rados.0.smithi084.stdout:1522: done (3 left) 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 151 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:1518: finishing write tid 2 to smithi084102331-36 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:1518: finishing write tid 3 to smithi084102331-36 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:1518: finishing write tid 4 to smithi084102331-36 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 750 (ObjNum 479 snap 151 seq_num 479) dirty exists 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:1518: left oid 36 (ObjNum 479 snap 151 seq_num 479) 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:1519: finishing write tid 1 to smithi084102331-22 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:1519: finishing write tid 2 to smithi084102331-22 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:1519: finishing write tid 3 to smithi084102331-22 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:1519: finishing write tid 4 to smithi084102331-22 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 764 (ObjNum 480 snap 151 seq_num 480) dirty exists 2024-01-13T18:05:47.169 INFO:tasks.rados.rados.0.smithi084.stdout:1519: left oid 22 (ObjNum 480 snap 151 seq_num 480) 2024-01-13T18:05:47.170 INFO:tasks.rados.rados.0.smithi084.stdout:1521: finishing rollback tid 0 to smithi084102331-46 2024-01-13T18:05:47.170 INFO:tasks.rados.rados.0.smithi084.stdout:1523: seq_num 481 ranges {0=458752,458752=401408} 2024-01-13T18:05:47.171 INFO:tasks.rados.rados.0.smithi084.stdout:1523: writing smithi084102331-34 from 0 to 458752 tid 1 2024-01-13T18:05:47.174 INFO:tasks.rados.rados.0.smithi084.stdout:1523: writing smithi084102331-34 from 458752 to 860160 tid 2 2024-01-13T18:05:47.174 INFO:tasks.rados.rados.0.smithi084.stdout:1518: done (3 left) 2024-01-13T18:05:47.174 INFO:tasks.rados.rados.0.smithi084.stdout:1519: done (2 left) 2024-01-13T18:05:47.174 INFO:tasks.rados.rados.0.smithi084.stdout:1524: read oid 13 snap 105 2024-01-13T18:05:47.174 INFO:tasks.rados.rados.0.smithi084.stdout:1524: expect deleted 2024-01-13T18:05:47.174 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 151 2024-01-13T18:05:47.174 INFO:tasks.rados.rados.0.smithi084.stdout:1525: seq_num 482 ranges {3973120=475136,4448256=401408} 2024-01-13T18:05:47.198 INFO:tasks.rados.rados.0.smithi084.stdout:1525: writing smithi084102331-28 from 3973120 to 4448256 tid 1 2024-01-13T18:05:47.201 INFO:tasks.rados.rados.0.smithi084.stdout:1525: writing smithi084102331-28 from 4448256 to 4849664 tid 2 2024-01-13T18:05:47.201 INFO:tasks.rados.rados.0.smithi084.stdout:1526: copy_from oid 25 from oid 7 current snap is 151 2024-01-13T18:05:47.201 INFO:tasks.rados.rados.0.smithi084.stdout:1521: finishing rollback tid 1 to smithi084102331-46 2024-01-13T18:05:47.201 INFO:tasks.rados.rados.0.smithi084.stdout:1521: finishing rollback tid 2 to smithi084102331-46 2024-01-13T18:05:47.202 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 526 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:05:47.202 INFO:tasks.rados.rados.0.smithi084.stdout:1523: finishing write tid 1 to smithi084102331-34 2024-01-13T18:05:47.202 INFO:tasks.rados.rados.0.smithi084.stdout:1523: finishing write tid 2 to smithi084102331-34 2024-01-13T18:05:47.202 INFO:tasks.rados.rados.0.smithi084.stdout:1523: finishing write tid 3 to smithi084102331-34 2024-01-13T18:05:47.202 INFO:tasks.rados.rados.0.smithi084.stdout:1523: finishing write tid 4 to smithi084102331-34 2024-01-13T18:05:47.202 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 511 (ObjNum 481 snap 151 seq_num 481) dirty exists 2024-01-13T18:05:47.202 INFO:tasks.rados.rados.0.smithi084.stdout:1523: left oid 34 (ObjNum 481 snap 151 seq_num 481) 2024-01-13T18:05:47.202 INFO:tasks.rados.rados.0.smithi084.stdout:1521: done (4 left) 2024-01-13T18:05:47.202 INFO:tasks.rados.rados.0.smithi084.stdout:1523: done (3 left) 2024-01-13T18:05:47.202 INFO:tasks.rados.rados.0.smithi084.stdout:1524: done (2 left) 2024-01-13T18:05:47.202 INFO:tasks.rados.rados.0.smithi084.stdout:1527: snap_remove snap 142 2024-01-13T18:05:47.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[119097]: pgmap v258: 121 pgs: 121 active+clean; 310 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 546 KiB/s wr, 5 op/s; 1.5 MiB/s, 1 objects/s recovering 2024-01-13T18:05:47.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[119097]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/504 objects degraded (0.397%), 1 pg degraded) 2024-01-13T18:05:47.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:05:47.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[119097]: failed to encode map e365 with expected crc 2024-01-13T18:05:47.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[119097]: failed to encode map e365 with expected crc 2024-01-13T18:05:47.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[119097]: osdmap e365: 8 total, 8 up, 8 in 2024-01-13T18:05:47.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[116404]: pgmap v258: 121 pgs: 121 active+clean; 310 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 546 KiB/s wr, 5 op/s; 1.5 MiB/s, 1 objects/s recovering 2024-01-13T18:05:47.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[116404]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/504 objects degraded (0.397%), 1 pg degraded) 2024-01-13T18:05:47.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:05:47.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[116404]: failed to encode map e365 with expected crc 2024-01-13T18:05:47.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[116404]: failed to encode map e365 with expected crc 2024-01-13T18:05:47.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:47 smithi084 ceph-mon[116404]: osdmap e365: 8 total, 8 up, 8 in 2024-01-13T18:05:47.615 INFO:tasks.rados.rados.0.smithi084.stdout:1527: done (2 left) 2024-01-13T18:05:47.615 INFO:tasks.rados.rados.0.smithi084.stdout:1528: snap_create 2024-01-13T18:05:47.615 INFO:tasks.rados.rados.0.smithi084.stdout:1525: finishing write tid 1 to smithi084102331-28 2024-01-13T18:05:47.615 INFO:tasks.rados.rados.0.smithi084.stdout:1525: finishing write tid 2 to smithi084102331-28 2024-01-13T18:05:47.616 INFO:tasks.rados.rados.0.smithi084.stdout:1525: finishing write tid 3 to smithi084102331-28 2024-01-13T18:05:47.616 INFO:tasks.rados.rados.0.smithi084.stdout:1525: finishing write tid 4 to smithi084102331-28 2024-01-13T18:05:47.616 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 464 (ObjNum 482 snap 151 seq_num 482) dirty exists 2024-01-13T18:05:47.616 INFO:tasks.rados.rados.0.smithi084.stdout:1525: left oid 28 (ObjNum 482 snap 151 seq_num 482) 2024-01-13T18:05:47.616 INFO:tasks.rados.rados.0.smithi084.stdout:1526: finishing copy_from to smithi084102331-25 2024-01-13T18:05:47.616 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 388 (ObjNum 449 snap 141 seq_num 449) dirty exists 2024-01-13T18:05:47.616 INFO:tasks.rados.rados.0.smithi084.stdout:1526: finishing copy_from racing read to smithi084102331-25 2024-01-13T18:05:47.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:47 smithi099 ceph-mon[138788]: pgmap v258: 121 pgs: 121 active+clean; 310 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 546 KiB/s wr, 5 op/s; 1.5 MiB/s, 1 objects/s recovering 2024-01-13T18:05:47.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:47 smithi099 ceph-mon[138788]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/504 objects degraded (0.397%), 1 pg degraded) 2024-01-13T18:05:47.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:47 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:05:47.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:47 smithi099 ceph-mon[138788]: failed to encode map e365 with expected crc 2024-01-13T18:05:47.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:47 smithi099 ceph-mon[138788]: failed to encode map e365 with expected crc 2024-01-13T18:05:47.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:47 smithi099 ceph-mon[138788]: osdmap e365: 8 total, 8 up, 8 in 2024-01-13T18:05:48.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[119097]: failed to encode map e366 with expected crc 2024-01-13T18:05:48.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[119097]: failed to encode map e366 with expected crc 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[119097]: osdmap e366: 8 total, 8 up, 8 in 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[119097]: osdmap e367: 8 total, 8 up, 8 in 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[119097]: failed to encode map e367 with expected crc 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[119097]: failed to encode map e367 with expected crc 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[119097]: failed to encode map e367 with expected crc 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[116404]: failed to encode map e366 with expected crc 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[116404]: failed to encode map e366 with expected crc 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[116404]: osdmap e366: 8 total, 8 up, 8 in 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[116404]: osdmap e367: 8 total, 8 up, 8 in 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[116404]: failed to encode map e367 with expected crc 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[116404]: failed to encode map e367 with expected crc 2024-01-13T18:05:48.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:48 smithi084 ceph-mon[116404]: failed to encode map e367 with expected crc 2024-01-13T18:05:48.611 INFO:tasks.rados.rados.0.smithi084.stdout:1525: done (2 left) 2024-01-13T18:05:48.612 INFO:tasks.rados.rados.0.smithi084.stdout:1526: done (1 left) 2024-01-13T18:05:48.612 INFO:tasks.rados.rados.0.smithi084.stdout:1528: done (0 left) 2024-01-13T18:05:48.612 INFO:tasks.rados.rados.0.smithi084.stdout:1529: read oid 28 snap -1 2024-01-13T18:05:48.612 INFO:tasks.rados.rados.0.smithi084.stdout:1529: expect (ObjNum 482 snap 151 seq_num 482) 2024-01-13T18:05:48.612 INFO:tasks.rados.rados.0.smithi084.stdout:1530: read oid 11 snap -1 2024-01-13T18:05:48.612 INFO:tasks.rados.rados.0.smithi084.stdout:1530: expect (ObjNum 441 snap 138 seq_num 441) 2024-01-13T18:05:48.612 INFO:tasks.rados.rados.0.smithi084.stdout:1531: read oid 14 snap -1 2024-01-13T18:05:48.612 INFO:tasks.rados.rados.0.smithi084.stdout:1531: expect (ObjNum 437 snap 137 seq_num 437) 2024-01-13T18:05:48.612 INFO:tasks.rados.rados.0.smithi084.stdout:1532: copy_from oid 50 from oid 12 current snap is 152 2024-01-13T18:05:48.612 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 152 2024-01-13T18:05:48.612 INFO:tasks.rados.rados.0.smithi084.stdout:1533: seq_num 483 ranges {4382720=491520,4874240=401408} 2024-01-13T18:05:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:48 smithi099 ceph-mon[138788]: failed to encode map e366 with expected crc 2024-01-13T18:05:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:48 smithi099 ceph-mon[138788]: failed to encode map e366 with expected crc 2024-01-13T18:05:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:48 smithi099 ceph-mon[138788]: osdmap e366: 8 total, 8 up, 8 in 2024-01-13T18:05:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:48 smithi099 ceph-mon[138788]: osdmap e367: 8 total, 8 up, 8 in 2024-01-13T18:05:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:48 smithi099 ceph-mon[138788]: failed to encode map e367 with expected crc 2024-01-13T18:05:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:48 smithi099 ceph-mon[138788]: failed to encode map e367 with expected crc 2024-01-13T18:05:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:48 smithi099 ceph-mon[138788]: failed to encode map e367 with expected crc 2024-01-13T18:05:48.639 INFO:tasks.rados.rados.0.smithi084.stdout:1533: writing smithi084102331-45 from 4382720 to 4874240 tid 1 2024-01-13T18:05:48.642 INFO:tasks.rados.rados.0.smithi084.stdout:1533: writing smithi084102331-45 from 4874240 to 5275648 tid 2 2024-01-13T18:05:48.642 INFO:tasks.rados.rados.0.smithi084.stdout:1534: read oid 2 snap 143 2024-01-13T18:05:48.642 INFO:tasks.rados.rados.0.smithi084.stdout:1534: expect (ObjNum 438 snap 137 seq_num 438) 2024-01-13T18:05:48.643 INFO:tasks.rados.rados.0.smithi084.stdout:1535: rollback oid 37 current snap is 152 2024-01-13T18:05:48.643 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 149 2024-01-13T18:05:48.643 INFO:tasks.rados.rados.0.smithi084.stdout:1531: expect (ObjNum 437 snap 137 seq_num 437) 2024-01-13T18:05:48.739 INFO:tasks.rados.rados.0.smithi084.stdout:1529: expect (ObjNum 482 snap 151 seq_num 482) 2024-01-13T18:05:48.975 INFO:tasks.rados.rados.0.smithi084.stdout:1530: expect (ObjNum 441 snap 138 seq_num 441) 2024-01-13T18:05:49.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:05:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:05:48.661Z caller=alerting.go:366 level=warn component="rule manager" alert="unsupported value type" msg="Expanding alert template failed" err="error executing template __alert_CephOSDDown: template: __alert_CephOSDDown:1:358: executing \"__alert_CephOSDDown\" at : error calling query: found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" data="unsupported value type" 2024-01-13T18:05:49.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:05:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:05:48.664Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:05:49.240 INFO:tasks.rados.rados.0.smithi084.stdout:1533: finishing write tid 1 to smithi084102331-45 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:1533: finishing write tid 2 to smithi084102331-45 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:1533: finishing write tid 3 to smithi084102331-45 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:1532: finishing copy_from to smithi084102331-50 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 688 (ObjNum 440 snap 138 seq_num 440) dirty exists 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:1529: done (6 left) 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:1530: done (5 left) 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:1531: done (4 left) 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 152 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:1532: finishing copy_from racing read to smithi084102331-50 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:1533: finishing write tid 4 to smithi084102331-45 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 897 (ObjNum 483 snap 152 seq_num 483) dirty exists 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:1533: left oid 45 (ObjNum 483 snap 152 seq_num 483) 2024-01-13T18:05:49.241 INFO:tasks.rados.rados.0.smithi084.stdout:1535: finishing rollback tid 0 to smithi084102331-37 2024-01-13T18:05:49.242 INFO:tasks.rados.rados.0.smithi084.stdout:1535: finishing rollback tid 1 to smithi084102331-37 2024-01-13T18:05:49.242 INFO:tasks.rados.rados.0.smithi084.stdout:1536: seq_num 484 ranges {57344=507904,565248=401408} 2024-01-13T18:05:49.243 INFO:tasks.rados.rados.0.smithi084.stdout:1536: writing smithi084102331-17 from 57344 to 565248 tid 1 2024-01-13T18:05:49.246 INFO:tasks.rados.rados.0.smithi084.stdout:1536: writing smithi084102331-17 from 565248 to 966656 tid 2 2024-01-13T18:05:49.246 INFO:tasks.rados.rados.0.smithi084.stdout:1532: done (4 left) 2024-01-13T18:05:49.246 INFO:tasks.rados.rados.0.smithi084.stdout:1533: done (3 left) 2024-01-13T18:05:49.246 INFO:tasks.rados.rados.0.smithi084.stdout:1537: snap_remove snap 150 2024-01-13T18:05:49.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:49 smithi084 ceph-mon[119097]: failed to encode map e367 with expected crc 2024-01-13T18:05:49.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:49 smithi084 ceph-mon[119097]: failed to encode map e367 with expected crc 2024-01-13T18:05:49.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:49 smithi084 ceph-mon[119097]: pgmap v262: 121 pgs: 121 active+clean; 309 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 785 KiB/s wr, 5 op/s; 277 KiB/s, 0 objects/s recovering 2024-01-13T18:05:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:49 smithi084 ceph-mon[119097]: failed to encode map e368 with expected crc 2024-01-13T18:05:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:49 smithi084 ceph-mon[119097]: osdmap e368: 8 total, 8 up, 8 in 2024-01-13T18:05:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:49 smithi084 ceph-mon[116404]: failed to encode map e367 with expected crc 2024-01-13T18:05:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:49 smithi084 ceph-mon[116404]: failed to encode map e367 with expected crc 2024-01-13T18:05:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:49 smithi084 ceph-mon[116404]: pgmap v262: 121 pgs: 121 active+clean; 309 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 785 KiB/s wr, 5 op/s; 277 KiB/s, 0 objects/s recovering 2024-01-13T18:05:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:49 smithi084 ceph-mon[116404]: failed to encode map e368 with expected crc 2024-01-13T18:05:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:49 smithi084 ceph-mon[116404]: osdmap e368: 8 total, 8 up, 8 in 2024-01-13T18:05:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:49 smithi099 ceph-mon[138788]: failed to encode map e367 with expected crc 2024-01-13T18:05:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:49 smithi099 ceph-mon[138788]: failed to encode map e367 with expected crc 2024-01-13T18:05:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:49 smithi099 ceph-mon[138788]: pgmap v262: 121 pgs: 121 active+clean; 309 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 785 KiB/s wr, 5 op/s; 277 KiB/s, 0 objects/s recovering 2024-01-13T18:05:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:49 smithi099 ceph-mon[138788]: failed to encode map e368 with expected crc 2024-01-13T18:05:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:49 smithi099 ceph-mon[138788]: osdmap e368: 8 total, 8 up, 8 in 2024-01-13T18:05:50.178 INFO:tasks.rados.rados.0.smithi084.stdout:1537: done (3 left) 2024-01-13T18:05:50.179 INFO:tasks.rados.rados.0.smithi084.stdout:1538: snap_create 2024-01-13T18:05:50.179 INFO:tasks.rados.rados.0.smithi084.stdout:1535: finishing rollback tid 2 to smithi084102331-37 2024-01-13T18:05:50.179 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 743 (ObjNum 129 snap 0 seq_num 4037762928) dirty exists 2024-01-13T18:05:50.179 INFO:tasks.rados.rados.0.smithi084.stdout:1534: expect (ObjNum 438 snap 137 seq_num 438) 2024-01-13T18:05:50.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:05:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:05:50] "GET /metrics HTTP/1.1" 200 36199 "" "Prometheus/2.43.0" 2024-01-13T18:05:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:50 smithi084 ceph-mon[116404]: failed to encode map e368 with expected crc 2024-01-13T18:05:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:50 smithi084 ceph-mon[116404]: failed to encode map e368 with expected crc 2024-01-13T18:05:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:50 smithi084 ceph-mon[119097]: failed to encode map e368 with expected crc 2024-01-13T18:05:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:50 smithi084 ceph-mon[119097]: failed to encode map e368 with expected crc 2024-01-13T18:05:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:50 smithi099 ceph-mon[138788]: failed to encode map e368 with expected crc 2024-01-13T18:05:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:50 smithi099 ceph-mon[138788]: failed to encode map e368 with expected crc 2024-01-13T18:05:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:05:50.663 INFO:tasks.rados.rados.0.smithi084.stdout:1536: finishing write tid 1 to smithi084102331-17 2024-01-13T18:05:50.663 INFO:tasks.rados.rados.0.smithi084.stdout:1536: finishing write tid 2 to smithi084102331-17 2024-01-13T18:05:50.663 INFO:tasks.rados.rados.0.smithi084.stdout:1536: finishing write tid 3 to smithi084102331-17 2024-01-13T18:05:50.663 INFO:tasks.rados.rados.0.smithi084.stdout:1536: finishing write tid 4 to smithi084102331-17 2024-01-13T18:05:50.663 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 575 (ObjNum 484 snap 152 seq_num 484) dirty exists 2024-01-13T18:05:50.663 INFO:tasks.rados.rados.0.smithi084.stdout:1536: left oid 17 (ObjNum 484 snap 152 seq_num 484) 2024-01-13T18:05:51.182 INFO:tasks.rados.rados.0.smithi084.stdout:1534: done (3 left) 2024-01-13T18:05:51.183 INFO:tasks.rados.rados.0.smithi084.stdout:1535: done (2 left) 2024-01-13T18:05:51.183 INFO:tasks.rados.rados.0.smithi084.stdout:1536: done (1 left) 2024-01-13T18:05:51.183 INFO:tasks.rados.rados.0.smithi084.stdout:1538: done (0 left) 2024-01-13T18:05:51.183 INFO:tasks.rados.rados.0.smithi084.stdout:1539: delete oid 13 current snap is 153 2024-01-13T18:05:51.185 INFO:tasks.rados.rados.0.smithi084.stdout:1539: done (0 left) 2024-01-13T18:05:51.185 INFO:tasks.rados.rados.0.smithi084.stdout:1540: setattr oid 18 current snap is 153 2024-01-13T18:05:51.187 INFO:tasks.rados.rados.0.smithi084.stdout:1541: delete oid 22 current snap is 153 2024-01-13T18:05:51.192 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 383 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:05:51.196 INFO:tasks.rados.rados.0.smithi084.stdout:1540: done (1 left) 2024-01-13T18:05:51.196 INFO:tasks.rados.rados.0.smithi084.stdout:1541: done (0 left) 2024-01-13T18:05:51.196 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 153 2024-01-13T18:05:51.196 INFO:tasks.rados.rados.0.smithi084.stdout:1542: seq_num 487 ranges {0=565248,565248=401408} 2024-01-13T18:05:51.199 INFO:tasks.rados.rados.0.smithi084.stdout:1542: writing smithi084102331-29 from 0 to 565248 tid 1 2024-01-13T18:05:51.201 INFO:tasks.rados.rados.0.smithi084.stdout:1542: writing smithi084102331-29 from 565248 to 966656 tid 2 2024-01-13T18:05:51.201 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 153 2024-01-13T18:05:51.201 INFO:tasks.rados.rados.0.smithi084.stdout:1543: seq_num 488 ranges {1253376=581632,1835008=401408} 2024-01-13T18:05:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:1543: writing smithi084102331-36 from 1253376 to 1835008 tid 1 2024-01-13T18:05:51.213 INFO:tasks.rados.rados.0.smithi084.stdout:1543: writing smithi084102331-36 from 1835008 to 2236416 tid 2 2024-01-13T18:05:51.214 INFO:tasks.rados.rados.0.smithi084.stdout:1544: snap_remove snap 152 2024-01-13T18:05:51.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:51 smithi084 ceph-mon[119097]: pgmap v264: 121 pgs: 121 active+clean; 306 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 4.7 MiB/s rd, 594 KiB/s wr, 5 op/s 2024-01-13T18:05:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:51 smithi084 ceph-mon[119097]: failed to encode map e369 with expected crc 2024-01-13T18:05:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:51 smithi084 ceph-mon[119097]: osdmap e369: 8 total, 8 up, 8 in 2024-01-13T18:05:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:51 smithi084 ceph-mon[119097]: failed to encode map e369 with expected crc 2024-01-13T18:05:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:51 smithi084 ceph-mon[119097]: failed to encode map e369 with expected crc 2024-01-13T18:05:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:51 smithi084 ceph-mon[116404]: pgmap v264: 121 pgs: 121 active+clean; 306 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 4.7 MiB/s rd, 594 KiB/s wr, 5 op/s 2024-01-13T18:05:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:51 smithi084 ceph-mon[116404]: failed to encode map e369 with expected crc 2024-01-13T18:05:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:51 smithi084 ceph-mon[116404]: osdmap e369: 8 total, 8 up, 8 in 2024-01-13T18:05:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:51 smithi084 ceph-mon[116404]: failed to encode map e369 with expected crc 2024-01-13T18:05:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:51 smithi084 ceph-mon[116404]: failed to encode map e369 with expected crc 2024-01-13T18:05:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:51 smithi099 ceph-mon[138788]: pgmap v264: 121 pgs: 121 active+clean; 306 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 4.7 MiB/s rd, 594 KiB/s wr, 5 op/s 2024-01-13T18:05:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:51 smithi099 ceph-mon[138788]: failed to encode map e369 with expected crc 2024-01-13T18:05:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:51 smithi099 ceph-mon[138788]: osdmap e369: 8 total, 8 up, 8 in 2024-01-13T18:05:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:51 smithi099 ceph-mon[138788]: failed to encode map e369 with expected crc 2024-01-13T18:05:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:51 smithi099 ceph-mon[138788]: failed to encode map e369 with expected crc 2024-01-13T18:05:52.192 INFO:tasks.rados.rados.0.smithi084.stdout:1544: done (2 left) 2024-01-13T18:05:52.192 INFO:tasks.rados.rados.0.smithi084.stdout:1545: snap_remove snap 143 2024-01-13T18:05:52.613 INFO:tasks.rados.rados.0.smithi084.stdout:1545: done (2 left) 2024-01-13T18:05:52.613 INFO:tasks.rados.rados.0.smithi084.stdout:1546: snap_create 2024-01-13T18:05:52.613 INFO:tasks.rados.rados.0.smithi084.stdout:1542: finishing write tid 1 to smithi084102331-29 2024-01-13T18:05:52.613 INFO:tasks.rados.rados.0.smithi084.stdout:1542: finishing write tid 2 to smithi084102331-29 2024-01-13T18:05:52.613 INFO:tasks.rados.rados.0.smithi084.stdout:1542: finishing write tid 3 to smithi084102331-29 2024-01-13T18:05:52.613 INFO:tasks.rados.rados.0.smithi084.stdout:1542: finishing write tid 4 to smithi084102331-29 2024-01-13T18:05:52.613 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 592 (ObjNum 487 snap 153 seq_num 487) dirty exists 2024-01-13T18:05:52.613 INFO:tasks.rados.rados.0.smithi084.stdout:1542: left oid 29 (ObjNum 487 snap 153 seq_num 487) 2024-01-13T18:05:52.613 INFO:tasks.rados.rados.0.smithi084.stdout:1543: finishing write tid 1 to smithi084102331-36 2024-01-13T18:05:52.614 INFO:tasks.rados.rados.0.smithi084.stdout:1543: finishing write tid 2 to smithi084102331-36 2024-01-13T18:05:52.614 INFO:tasks.rados.rados.0.smithi084.stdout:1543: finishing write tid 3 to smithi084102331-36 2024-01-13T18:05:52.614 INFO:tasks.rados.rados.0.smithi084.stdout:1543: finishing write tid 4 to smithi084102331-36 2024-01-13T18:05:52.614 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 753 (ObjNum 488 snap 153 seq_num 488) dirty exists 2024-01-13T18:05:52.614 INFO:tasks.rados.rados.0.smithi084.stdout:1543: left oid 36 (ObjNum 488 snap 153 seq_num 488) 2024-01-13T18:05:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:52 smithi099 ceph-mon[138788]: failed to encode map e370 with expected crc 2024-01-13T18:05:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:52 smithi099 ceph-mon[138788]: osdmap e370: 8 total, 8 up, 8 in 2024-01-13T18:05:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:52 smithi099 ceph-mon[138788]: failed to encode map e370 with expected crc 2024-01-13T18:05:52.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:52 smithi084 ceph-mon[116404]: failed to encode map e370 with expected crc 2024-01-13T18:05:52.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:52 smithi084 ceph-mon[116404]: osdmap e370: 8 total, 8 up, 8 in 2024-01-13T18:05:52.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:52 smithi084 ceph-mon[116404]: failed to encode map e370 with expected crc 2024-01-13T18:05:52.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:52 smithi084 ceph-mon[119097]: failed to encode map e370 with expected crc 2024-01-13T18:05:52.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:52 smithi084 ceph-mon[119097]: osdmap e370: 8 total, 8 up, 8 in 2024-01-13T18:05:52.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:52 smithi084 ceph-mon[119097]: failed to encode map e370 with expected crc 2024-01-13T18:05:53.614 INFO:tasks.rados.rados.0.smithi084.stdout:1542: done (2 left) 2024-01-13T18:05:53.614 INFO:tasks.rados.rados.0.smithi084.stdout:1543: done (1 left) 2024-01-13T18:05:53.614 INFO:tasks.rados.rados.0.smithi084.stdout:1546: done (0 left) 2024-01-13T18:05:53.614 INFO:tasks.rados.rados.0.smithi084.stdout:1547: read oid 50 snap -1 2024-01-13T18:05:53.614 INFO:tasks.rados.rados.0.smithi084.stdout:1547: expect (ObjNum 440 snap 138 seq_num 440) 2024-01-13T18:05:53.614 INFO:tasks.rados.rados.0.smithi084.stdout:1548: setattr oid 32 current snap is 154 2024-01-13T18:05:53.615 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 154 2024-01-13T18:05:53.615 INFO:tasks.rados.rados.0.smithi084.stdout:1549: seq_num 489 ranges {966656=598016,1564672=401408} 2024-01-13T18:05:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:53 smithi099 ceph-mon[138788]: pgmap v267: 121 pgs: 121 active+clean; 302 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-01-13T18:05:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:53 smithi099 ceph-mon[138788]: osdmap e371: 8 total, 8 up, 8 in 2024-01-13T18:05:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:53 smithi099 ceph-mon[138788]: failed to encode map e371 with expected crc 2024-01-13T18:05:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:53 smithi099 ceph-mon[138788]: failed to encode map e372 with expected crc 2024-01-13T18:05:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:53 smithi099 ceph-mon[138788]: osdmap e372: 8 total, 8 up, 8 in 2024-01-13T18:05:53.626 INFO:tasks.rados.rados.0.smithi084.stdout:1549: writing smithi084102331-17 from 966656 to 1564672 tid 1 2024-01-13T18:05:53.627 INFO:tasks.rados.rados.0.smithi084.stdout:1549: writing smithi084102331-17 from 1564672 to 1966080 tid 2 2024-01-13T18:05:53.627 INFO:tasks.rados.rados.0.smithi084.stdout:1550: copy_from oid 11 from oid 9 current snap is 154 2024-01-13T18:05:53.627 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 810 (ObjNum 478 snap 151 seq_num 478) dirty exists 2024-01-13T18:05:53.627 INFO:tasks.rados.rados.0.smithi084.stdout:1548: done (3 left) 2024-01-13T18:05:53.627 INFO:tasks.rados.rados.0.smithi084.stdout:1551: read oid 6 snap 105 2024-01-13T18:05:53.627 INFO:tasks.rados.rados.0.smithi084.stdout:1551: expect (ObjNum 313 snap 98 seq_num 313) 2024-01-13T18:05:53.627 INFO:tasks.rados.rados.0.smithi084.stdout:1552: rmattr oid 15 current snap is 154 2024-01-13T18:05:53.627 INFO:tasks.rados.rados.0.smithi084.stdout:1553: snap_remove snap 151 2024-01-13T18:05:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:53 smithi084 ceph-mon[116404]: pgmap v267: 121 pgs: 121 active+clean; 302 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-01-13T18:05:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:53 smithi084 ceph-mon[116404]: osdmap e371: 8 total, 8 up, 8 in 2024-01-13T18:05:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:53 smithi084 ceph-mon[116404]: failed to encode map e371 with expected crc 2024-01-13T18:05:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:53 smithi084 ceph-mon[116404]: failed to encode map e372 with expected crc 2024-01-13T18:05:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:53 smithi084 ceph-mon[116404]: osdmap e372: 8 total, 8 up, 8 in 2024-01-13T18:05:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:53 smithi084 ceph-mon[119097]: pgmap v267: 121 pgs: 121 active+clean; 302 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-01-13T18:05:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:53 smithi084 ceph-mon[119097]: osdmap e371: 8 total, 8 up, 8 in 2024-01-13T18:05:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:53 smithi084 ceph-mon[119097]: failed to encode map e371 with expected crc 2024-01-13T18:05:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:53 smithi084 ceph-mon[119097]: failed to encode map e372 with expected crc 2024-01-13T18:05:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:53 smithi084 ceph-mon[119097]: osdmap e372: 8 total, 8 up, 8 in 2024-01-13T18:05:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:54 smithi099 ceph-mon[138788]: failed to encode map e371 with expected crc 2024-01-13T18:05:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:54 smithi099 ceph-mon[138788]: failed to encode map e372 with expected crc 2024-01-13T18:05:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:54 smithi099 ceph-mon[138788]: failed to encode map e372 with expected crc 2024-01-13T18:05:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:54 smithi099 ceph-mon[138788]: failed to encode map e373 with expected crc 2024-01-13T18:05:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:54 smithi099 ceph-mon[138788]: osdmap e373: 8 total, 8 up, 8 in 2024-01-13T18:05:54.620 INFO:tasks.rados.rados.0.smithi084.stdout:1553: done (5 left) 2024-01-13T18:05:54.621 INFO:tasks.rados.rados.0.smithi084.stdout:1554: snap_create 2024-01-13T18:05:54.621 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 812 (ObjNum 228 snap 69 seq_num 228) dirty exists 2024-01-13T18:05:54.621 INFO:tasks.rados.rados.0.smithi084.stdout:1549: finishing write tid 1 to smithi084102331-17 2024-01-13T18:05:54.621 INFO:tasks.rados.rados.0.smithi084.stdout:1549: finishing write tid 2 to smithi084102331-17 2024-01-13T18:05:54.621 INFO:tasks.rados.rados.0.smithi084.stdout:1549: finishing write tid 3 to smithi084102331-17 2024-01-13T18:05:54.621 INFO:tasks.rados.rados.0.smithi084.stdout:1549: finishing write tid 4 to smithi084102331-17 2024-01-13T18:05:54.621 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 586 (ObjNum 489 snap 154 seq_num 489) dirty exists 2024-01-13T18:05:54.621 INFO:tasks.rados.rados.0.smithi084.stdout:1549: left oid 17 (ObjNum 489 snap 154 seq_num 489) 2024-01-13T18:05:54.621 INFO:tasks.rados.rados.0.smithi084.stdout:1551: expect (ObjNum 313 snap 98 seq_num 313) 2024-01-13T18:05:54.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:54 smithi084 ceph-mon[116404]: failed to encode map e371 with expected crc 2024-01-13T18:05:54.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:54 smithi084 ceph-mon[116404]: failed to encode map e372 with expected crc 2024-01-13T18:05:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:54 smithi084 ceph-mon[116404]: failed to encode map e372 with expected crc 2024-01-13T18:05:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:54 smithi084 ceph-mon[116404]: failed to encode map e373 with expected crc 2024-01-13T18:05:54.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:54 smithi084 ceph-mon[116404]: osdmap e373: 8 total, 8 up, 8 in 2024-01-13T18:05:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:54 smithi084 ceph-mon[119097]: failed to encode map e371 with expected crc 2024-01-13T18:05:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:54 smithi084 ceph-mon[119097]: failed to encode map e372 with expected crc 2024-01-13T18:05:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:54 smithi084 ceph-mon[119097]: failed to encode map e372 with expected crc 2024-01-13T18:05:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:54 smithi084 ceph-mon[119097]: failed to encode map e373 with expected crc 2024-01-13T18:05:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:54 smithi084 ceph-mon[119097]: osdmap e373: 8 total, 8 up, 8 in 2024-01-13T18:05:54.914 INFO:tasks.rados.rados.0.smithi084.stdout:1547: expect (ObjNum 440 snap 138 seq_num 440) 2024-01-13T18:05:55.435 INFO:tasks.rados.rados.0.smithi084.stdout:1550: finishing copy_from to smithi084102331-11 2024-01-13T18:05:55.435 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 494 (ObjNum 472 snap 148 seq_num 472) dirty exists 2024-01-13T18:05:55.435 INFO:tasks.rados.rados.0.smithi084.stdout:1550: finishing copy_from racing read to smithi084102331-11 2024-01-13T18:05:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:55 smithi099 ceph-mon[138788]: failed to encode map e373 with expected crc 2024-01-13T18:05:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:55 smithi099 ceph-mon[138788]: failed to encode map e373 with expected crc 2024-01-13T18:05:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:55 smithi099 ceph-mon[138788]: pgmap v271: 121 pgs: 121 active+clean; 302 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.6 MiB/s wr, 15 op/s 2024-01-13T18:05:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:55 smithi099 ceph-mon[138788]: osdmap e374: 8 total, 8 up, 8 in 2024-01-13T18:05:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:55 smithi099 ceph-mon[138788]: failed to encode map e374 with expected crc 2024-01-13T18:05:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:55 smithi099 ceph-mon[138788]: failed to encode map e374 with expected crc 2024-01-13T18:05:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:55 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:55.623 INFO:tasks.rados.rados.0.smithi084.stdout:1547: done (5 left) 2024-01-13T18:05:55.623 INFO:tasks.rados.rados.0.smithi084.stdout:1549: done (4 left) 2024-01-13T18:05:55.623 INFO:tasks.rados.rados.0.smithi084.stdout:1550: done (3 left) 2024-01-13T18:05:55.623 INFO:tasks.rados.rados.0.smithi084.stdout:1551: done (2 left) 2024-01-13T18:05:55.623 INFO:tasks.rados.rados.0.smithi084.stdout:1552: done (1 left) 2024-01-13T18:05:55.624 INFO:tasks.rados.rados.0.smithi084.stdout:1554: done (0 left) 2024-01-13T18:05:55.624 INFO:tasks.rados.rados.0.smithi084.stdout:1555: read oid 36 snap -1 2024-01-13T18:05:55.624 INFO:tasks.rados.rados.0.smithi084.stdout:1555: expect (ObjNum 488 snap 153 seq_num 488) 2024-01-13T18:05:55.624 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 155 2024-01-13T18:05:55.624 INFO:tasks.rados.rados.0.smithi084.stdout:1556: seq_num 490 ranges {0=614400,614400=401408} 2024-01-13T18:05:55.626 INFO:tasks.rados.rados.0.smithi084.stdout:1556: writing smithi084102331-1 from 0 to 614400 tid 1 2024-01-13T18:05:55.633 INFO:tasks.rados.rados.0.smithi084.stdout:1556: writing smithi084102331-1 from 614400 to 1015808 tid 2 2024-01-13T18:05:55.634 INFO:tasks.rados.rados.0.smithi084.stdout:1557: rollback oid 8 current snap is 155 2024-01-13T18:05:55.634 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 149 2024-01-13T18:05:55.634 INFO:tasks.rados.rados.0.smithi084.stdout:1558: rollback oid 10 current snap is 155 2024-01-13T18:05:55.634 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 144 2024-01-13T18:05:55.634 INFO:tasks.rados.rados.0.smithi084.stdout:1559: rmattr oid 16 current snap is 155 2024-01-13T18:05:55.634 INFO:tasks.rados.rados.0.smithi084.stdout:1559: done (4 left) 2024-01-13T18:05:55.634 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 155 2024-01-13T18:05:55.634 INFO:tasks.rados.rados.0.smithi084.stdout:1560: seq_num 491 ranges {1425408=630784,2056192=401408} 2024-01-13T18:05:55.641 INFO:tasks.rados.rados.0.smithi084.stdout:1560: writing smithi084102331-46 from 1425408 to 2056192 tid 1 2024-01-13T18:05:55.643 INFO:tasks.rados.rados.0.smithi084.stdout:1560: writing smithi084102331-46 from 2056192 to 2457600 tid 2 2024-01-13T18:05:55.644 INFO:tasks.rados.rados.0.smithi084.stdout:1561: read oid 43 snap -1 2024-01-13T18:05:55.644 INFO:tasks.rados.rados.0.smithi084.stdout:1561: expect (ObjNum 445 snap 139 seq_num 445) 2024-01-13T18:05:55.644 INFO:tasks.rados.rados.0.smithi084.stdout:1562: rollback oid 29 current snap is 155 2024-01-13T18:05:55.644 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 154 2024-01-13T18:05:55.644 INFO:tasks.rados.rados.0.smithi084.stdout:1555: expect (ObjNum 488 snap 153 seq_num 488) 2024-01-13T18:05:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[116404]: failed to encode map e373 with expected crc 2024-01-13T18:05:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[116404]: failed to encode map e373 with expected crc 2024-01-13T18:05:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[116404]: pgmap v271: 121 pgs: 121 active+clean; 302 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.6 MiB/s wr, 15 op/s 2024-01-13T18:05:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[116404]: osdmap e374: 8 total, 8 up, 8 in 2024-01-13T18:05:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[116404]: failed to encode map e374 with expected crc 2024-01-13T18:05:55.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[116404]: failed to encode map e374 with expected crc 2024-01-13T18:05:55.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:55.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[119097]: failed to encode map e373 with expected crc 2024-01-13T18:05:55.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[119097]: failed to encode map e373 with expected crc 2024-01-13T18:05:55.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[119097]: pgmap v271: 121 pgs: 121 active+clean; 302 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.6 MiB/s wr, 15 op/s 2024-01-13T18:05:55.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[119097]: osdmap e374: 8 total, 8 up, 8 in 2024-01-13T18:05:55.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[119097]: failed to encode map e374 with expected crc 2024-01-13T18:05:55.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[119097]: failed to encode map e374 with expected crc 2024-01-13T18:05:55.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:55 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:1557: finishing rollback tid 0 to smithi084102331-8 2024-01-13T18:05:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:1557: finishing rollback tid 1 to smithi084102331-8 2024-01-13T18:05:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:1558: finishing rollback tid 0 to smithi084102331-10 2024-01-13T18:05:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:1556: finishing write tid 1 to smithi084102331-1 2024-01-13T18:05:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:1558: finishing rollback tid 1 to smithi084102331-10 2024-01-13T18:05:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:1556: finishing write tid 2 to smithi084102331-1 2024-01-13T18:05:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:1558: finishing rollback tid 2 to smithi084102331-10 2024-01-13T18:05:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 386 (ObjNum 456 snap 142 seq_num 456) dirty exists 2024-01-13T18:05:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:1557: finishing rollback tid 2 to smithi084102331-8 2024-01-13T18:05:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 820 (ObjNum 403 snap 128 seq_num 403) dirty exists 2024-01-13T18:05:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:1556: finishing write tid 3 to smithi084102331-1 2024-01-13T18:05:55.730 INFO:tasks.rados.rados.0.smithi084.stdout:1555: done (6 left) 2024-01-13T18:05:55.730 INFO:tasks.rados.rados.0.smithi084.stdout:1557: done (5 left) 2024-01-13T18:05:55.730 INFO:tasks.rados.rados.0.smithi084.stdout:1558: done (4 left) 2024-01-13T18:05:55.730 INFO:tasks.rados.rados.0.smithi084.stdout:1563: snap_remove snap 149 2024-01-13T18:05:56.244 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:56 smithi099 ceph-mon[138788]: failed to encode map e374 with expected crc 2024-01-13T18:05:56.244 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:56 smithi099 ceph-mon[138788]: failed to encode map e374 with expected crc 2024-01-13T18:05:56.244 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:56 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:56.244 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:56 smithi099 ceph-mon[138788]: osdmap e375: 8 total, 8 up, 8 in 2024-01-13T18:05:56.244 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:56 smithi099 ceph-mon[138788]: failed to encode map e375 with expected crc 2024-01-13T18:05:56.633 INFO:tasks.rados.rados.0.smithi084.stdout:1563: done (4 left) 2024-01-13T18:05:56.633 INFO:tasks.rados.rados.0.smithi084.stdout:1564: snap_create 2024-01-13T18:05:56.633 INFO:tasks.rados.rados.0.smithi084.stdout:1556: finishing write tid 4 to smithi084102331-1 2024-01-13T18:05:56.633 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 908 (ObjNum 490 snap 155 seq_num 490) dirty exists 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:1556: left oid 1 (ObjNum 490 snap 155 seq_num 490) 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:1562: finishing rollback tid 0 to smithi084102331-29 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:1560: finishing write tid 1 to smithi084102331-46 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:1560: finishing write tid 2 to smithi084102331-46 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:1560: finishing write tid 3 to smithi084102331-46 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:1562: finishing rollback tid 1 to smithi084102331-29 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:1562: finishing rollback tid 2 to smithi084102331-29 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 600 (ObjNum 487 snap 153 seq_num 487) dirty exists 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:1560: finishing write tid 4 to smithi084102331-46 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 548 (ObjNum 491 snap 155 seq_num 491) dirty exists 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:1560: left oid 46 (ObjNum 491 snap 155 seq_num 491) 2024-01-13T18:05:56.634 INFO:tasks.rados.rados.0.smithi084.stdout:1561: expect (ObjNum 445 snap 139 seq_num 445) 2024-01-13T18:05:56.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:56 smithi084 ceph-mon[119097]: failed to encode map e374 with expected crc 2024-01-13T18:05:56.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:56 smithi084 ceph-mon[119097]: failed to encode map e374 with expected crc 2024-01-13T18:05:56.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:56 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:56 smithi084 ceph-mon[119097]: osdmap e375: 8 total, 8 up, 8 in 2024-01-13T18:05:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:56 smithi084 ceph-mon[119097]: failed to encode map e375 with expected crc 2024-01-13T18:05:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:56 smithi084 ceph-mon[116404]: failed to encode map e374 with expected crc 2024-01-13T18:05:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:56 smithi084 ceph-mon[116404]: failed to encode map e374 with expected crc 2024-01-13T18:05:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:56 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:56 smithi084 ceph-mon[116404]: osdmap e375: 8 total, 8 up, 8 in 2024-01-13T18:05:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:56 smithi084 ceph-mon[116404]: failed to encode map e375 with expected crc 2024-01-13T18:05:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:57 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:57 smithi099 ceph-mon[138788]: Upgrade: osd.5 is safe to restart 2024-01-13T18:05:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:57 smithi099 ceph-mon[138788]: failed to encode map e375 with expected crc 2024-01-13T18:05:57.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:57 smithi099 ceph-mon[138788]: failed to encode map e375 with expected crc 2024-01-13T18:05:57.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:57 smithi099 ceph-mon[138788]: pgmap v274: 121 pgs: 121 active+clean; 298 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.9 MiB/s rd, 251 KiB/s wr, 8 op/s 2024-01-13T18:05:57.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:57 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:57.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:57 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-13T18:05:57.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:57 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:57.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:57 smithi099 ceph-mon[138788]: osdmap e376: 8 total, 8 up, 8 in 2024-01-13T18:05:57.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:57 smithi099 ceph-mon[138788]: failed to encode map e376 with expected crc 2024-01-13T18:05:57.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:57 smithi099 ceph-mon[138788]: failed to encode map e376 with expected crc 2024-01-13T18:05:57.530 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:05:57.613 INFO:tasks.rados.rados.0.smithi084.stdout:1556: done (4 left) 2024-01-13T18:05:57.614 INFO:tasks.rados.rados.0.smithi084.stdout:1560: done (3 left) 2024-01-13T18:05:57.614 INFO:tasks.rados.rados.0.smithi084.stdout:1561: done (2 left) 2024-01-13T18:05:57.614 INFO:tasks.rados.rados.0.smithi084.stdout:1562: done (1 left) 2024-01-13T18:05:57.614 INFO:tasks.rados.rados.0.smithi084.stdout:1564: done (0 left) 2024-01-13T18:05:57.614 INFO:tasks.rados.rados.0.smithi084.stdout:1565: delete oid 30 current snap is 156 2024-01-13T18:05:57.621 INFO:tasks.rados.rados.0.smithi084.stdout:1565: done (0 left) 2024-01-13T18:05:57.621 INFO:tasks.rados.rados.0.smithi084.stdout:1566: snap_create 2024-01-13T18:05:57.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[116404]: Upgrade: osd.5 is safe to restart 2024-01-13T18:05:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[116404]: failed to encode map e375 with expected crc 2024-01-13T18:05:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[116404]: failed to encode map e375 with expected crc 2024-01-13T18:05:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[116404]: pgmap v274: 121 pgs: 121 active+clean; 298 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.9 MiB/s rd, 251 KiB/s wr, 8 op/s 2024-01-13T18:05:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-13T18:05:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[116404]: osdmap e376: 8 total, 8 up, 8 in 2024-01-13T18:05:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[116404]: failed to encode map e376 with expected crc 2024-01-13T18:05:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[116404]: failed to encode map e376 with expected crc 2024-01-13T18:05:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-01-13T18:05:57.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[119097]: Upgrade: osd.5 is safe to restart 2024-01-13T18:05:57.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[119097]: failed to encode map e375 with expected crc 2024-01-13T18:05:57.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[119097]: failed to encode map e375 with expected crc 2024-01-13T18:05:57.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[119097]: pgmap v274: 121 pgs: 121 active+clean; 298 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.9 MiB/s rd, 251 KiB/s wr, 8 op/s 2024-01-13T18:05:57.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:05:57.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-13T18:05:57.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:05:57.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[119097]: osdmap e376: 8 total, 8 up, 8 in 2024-01-13T18:05:57.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[119097]: failed to encode map e376 with expected crc 2024-01-13T18:05:57.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:57 smithi084 ceph-mon[119097]: failed to encode map e376 with expected crc 2024-01-13T18:05:57.840 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (4m) 49s ago 6m 28.4M - 0.25.0 c8568f914cd2 a5cbc3e01ffb 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (3m) 20s ago 6m 89.8M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (7m) 49s ago 7m 15.8M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (7m) 20s ago 7m 21.1M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (3m) 20s ago 9m 448M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (3m) 49s ago 11m 510M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (3m) 49s ago 11m 83.2M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d b64908c7a53c 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (2m) 20s ago 10m 58.6M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d be7bb477ea53 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (2m) 49s ago 10m 58.7M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d e13f01b852ff 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (4m) 49s ago 6m 10.3M - 1.5.0 0da6a335fe13 b72e6d50f165 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (3m) 20s ago 6m 15.9M - 1.5.0 0da6a335fe13 e9f879b5e55b 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (2m) 49s ago 9m 243M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d e18181bdb4a8 2024-01-13T18:05:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (107s) 49s ago 9m 187M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 32bdce285b36 2024-01-13T18:05:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (79s) 49s ago 9m 175M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 660c53389079 2024-01-13T18:05:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (52s) 49s ago 8m 11.8M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 0e4b8c3482a4 2024-01-13T18:05:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (23s) 20s ago 8m 14.2M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 76d7d19ec531 2024-01-13T18:05:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (8m) 20s ago 8m 516M 2488M 17.2.7-268-g6441305d c3a232f785d8 51be805dde78 2024-01-13T18:05:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (7m) 20s ago 7m 360M 2488M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:05:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (7m) 20s ago 7m 262M 2488M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:05:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (3m) 20s ago 7m 60.2M - 2.43.0 a07b618ecd1d cb4c11bf6eec 2024-01-13T18:05:58.223 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 3, 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 5 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:05:58.224 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:05:58.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:05:58.225 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:05:58.225 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 5, 2024-01-13T18:05:58.225 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 10 2024-01-13T18:05:58.225 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:05:58.225 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:05:58.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:58 smithi099 ceph-mon[138788]: Upgrade: Updating osd.5 2024-01-13T18:05:58.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:58 smithi099 ceph-mon[138788]: Deploying daemon osd.5 on smithi099 2024-01-13T18:05:58.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:58 smithi099 ceph-mon[138788]: failed to encode map e376 with expected crc 2024-01-13T18:05:58.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:58 smithi099 ceph-mon[138788]: osdmap e377: 8 total, 8 up, 8 in 2024-01-13T18:05:58.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:58 smithi099 ceph-mon[138788]: failed to encode map e377 with expected crc 2024-01-13T18:05:58.643 INFO:tasks.rados.rados.0.smithi084.stdout:1566: done (0 left) 2024-01-13T18:05:58.643 INFO:tasks.rados.rados.0.smithi084.stdout:1567: read oid 13 snap -1 2024-01-13T18:05:58.643 INFO:tasks.rados.rados.0.smithi084.stdout:1567: expect deleted 2024-01-13T18:05:58.643 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 157 2024-01-13T18:05:58.643 INFO:tasks.rados.rados.0.smithi084.stdout:1568: seq_num 493 ranges {5431296=663552,6094848=401408} 2024-01-13T18:05:58.661 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:05:58 smithi099 systemd[1]: Stopping Ceph osd.5 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:05:58.661 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:05:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[84329]: 2024-01-13T18:05:58.604+0000 7ff8ee0c7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:05:58.661 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:05:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[84329]: 2024-01-13T18:05:58.604+0000 7ff8ee0c7700 -1 osd.5 377 *** Got signal Terminated *** 2024-01-13T18:05:58.661 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:05:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[84329]: 2024-01-13T18:05:58.604+0000 7ff8ee0c7700 -1 osd.5 377 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T18:05:58.666 INFO:tasks.rados.rados.0.smithi084.stdout:1568: writing smithi084102331-32 from 5431296 to 6094848 tid 1 2024-01-13T18:05:58.668 INFO:tasks.rados.rados.0.smithi084.stdout:1568: writing smithi084102331-32 from 6094848 to 6496256 tid 2 2024-01-13T18:05:58.669 INFO:tasks.rados.rados.0.smithi084.stdout:1569: copy_from oid 3 from oid 14 current snap is 157 2024-01-13T18:05:58.669 INFO:tasks.rados.rados.0.smithi084.stdout:1567: done (2 left) 2024-01-13T18:05:58.669 INFO:tasks.rados.rados.0.smithi084.stdout:1570: snap_create 2024-01-13T18:05:58.671 INFO:tasks.rados.rados.0.smithi084.stdout:1568: finishing write tid 1 to smithi084102331-32 2024-01-13T18:05:58.671 INFO:tasks.rados.rados.0.smithi084.stdout:1568: finishing write tid 2 to smithi084102331-32 2024-01-13T18:05:58.671 INFO:tasks.rados.rados.0.smithi084.stdout:1568: finishing write tid 3 to smithi084102331-32 2024-01-13T18:05:58.673 INFO:tasks.rados.rados.0.smithi084.stdout:1568: finishing write tid 4 to smithi084102331-32 2024-01-13T18:05:58.673 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 830 (ObjNum 493 snap 157 seq_num 493) dirty exists 2024-01-13T18:05:58.673 INFO:tasks.rados.rados.0.smithi084.stdout:1568: left oid 32 (ObjNum 493 snap 157 seq_num 493) 2024-01-13T18:05:58.676 INFO:tasks.rados.rados.0.smithi084.stdout:1569: finishing copy_from to smithi084102331-3 2024-01-13T18:05:58.677 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 742 (ObjNum 437 snap 137 seq_num 437) dirty exists 2024-01-13T18:05:58.677 INFO:tasks.rados.rados.0.smithi084.stdout:1569: finishing copy_from racing read to smithi084102331-3 2024-01-13T18:05:58.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:58 smithi084 ceph-mon[116404]: Upgrade: Updating osd.5 2024-01-13T18:05:58.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:58 smithi084 ceph-mon[116404]: Deploying daemon osd.5 on smithi099 2024-01-13T18:05:58.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:58 smithi084 ceph-mon[116404]: failed to encode map e376 with expected crc 2024-01-13T18:05:58.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:58 smithi084 ceph-mon[116404]: osdmap e377: 8 total, 8 up, 8 in 2024-01-13T18:05:58.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:58 smithi084 ceph-mon[116404]: failed to encode map e377 with expected crc 2024-01-13T18:05:58.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:58 smithi084 ceph-mon[119097]: Upgrade: Updating osd.5 2024-01-13T18:05:58.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:58 smithi084 ceph-mon[119097]: Deploying daemon osd.5 on smithi099 2024-01-13T18:05:58.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:58 smithi084 ceph-mon[119097]: failed to encode map e376 with expected crc 2024-01-13T18:05:58.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:58 smithi084 ceph-mon[119097]: osdmap e377: 8 total, 8 up, 8 in 2024-01-13T18:05:58.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:58 smithi084 ceph-mon[119097]: failed to encode map e377 with expected crc 2024-01-13T18:05:59.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:05:58 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:05:58.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:05:59.619 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:05:59 smithi099 bash[150740]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5 2024-01-13T18:05:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: from='client.44219 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: failed to encode map e377 with expected crc 2024-01-13T18:05:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: from='client.34287 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: pgmap v277: 121 pgs: 121 active+clean; 304 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2024-01-13T18:05:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4275528895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: osd.5 marked itself down and dead 2024-01-13T18:05:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:05:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: osdmap e378: 8 total, 7 up, 8 in 2024-01-13T18:05:59.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:05:59 smithi099 ceph-mon[138788]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.634 INFO:tasks.rados.rados.0.smithi084.stdout:1568: done (2 left) 2024-01-13T18:05:59.635 INFO:tasks.rados.rados.0.smithi084.stdout:1569: done (1 left) 2024-01-13T18:05:59.635 INFO:tasks.rados.rados.0.smithi084.stdout:1570: done (0 left) 2024-01-13T18:05:59.635 INFO:tasks.rados.rados.0.smithi084.stdout:1571: delete oid 33 current snap is 158 2024-01-13T18:05:59.652 INFO:tasks.rados.rados.0.smithi084.stdout:1571: done (0 left) 2024-01-13T18:05:59.652 INFO:tasks.rados.rados.0.smithi084.stdout:1572: read oid 12 snap -1 2024-01-13T18:05:59.652 INFO:tasks.rados.rados.0.smithi084.stdout:1572: expect (ObjNum 440 snap 138 seq_num 440) 2024-01-13T18:05:59.652 INFO:tasks.rados.rados.0.smithi084.stdout:1573: read oid 50 snap 148 2024-01-13T18:05:59.652 INFO:tasks.rados.rados.0.smithi084.stdout:1573: expect deleted 2024-01-13T18:05:59.653 INFO:tasks.rados.rados.0.smithi084.stdout:1574: snap_remove snap 153 2024-01-13T18:05:59.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: from='client.44219 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: failed to encode map e377 with expected crc 2024-01-13T18:05:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: from='client.34287 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: pgmap v277: 121 pgs: 121 active+clean; 304 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2024-01-13T18:05:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4275528895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: osd.5 marked itself down and dead 2024-01-13T18:05:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:05:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: osdmap e378: 8 total, 7 up, 8 in 2024-01-13T18:05:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[116404]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: from='client.44219 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:59.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: failed to encode map e377 with expected crc 2024-01-13T18:05:59.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: from='client.34287 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:05:59.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: pgmap v277: 121 pgs: 121 active+clean; 304 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2024-01-13T18:05:59.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4275528895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:05:59.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: osd.5 marked itself down and dead 2024-01-13T18:05:59.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:05:59.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: osdmap e378: 8 total, 7 up, 8 in 2024-01-13T18:05:59.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: failed to encode map e378 with expected crc 2024-01-13T18:05:59.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:05:59 smithi084 ceph-mon[119097]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.471 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:00 smithi099 ceph-mon[138788]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.471 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:00 smithi099 ceph-mon[138788]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.471 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:00 smithi099 ceph-mon[138788]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.471 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:00 smithi099 ceph-mon[138788]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.471 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:00 smithi099 ceph-mon[138788]: failed to encode map e379 with expected crc 2024-01-13T18:06:00.471 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:00 smithi099 ceph-mon[138788]: failed to encode map e379 with expected crc 2024-01-13T18:06:00.471 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:00 smithi099 ceph-mon[138788]: osdmap e379: 8 total, 7 up, 8 in 2024-01-13T18:06:00.640 INFO:tasks.rados.rados.0.smithi084.stdout:1574: done (2 left) 2024-01-13T18:06:00.640 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 158 2024-01-13T18:06:00.640 INFO:tasks.rados.rados.0.smithi084.stdout:1575: seq_num 495 ranges {0=696320,696320=401408} 2024-01-13T18:06:00.644 INFO:tasks.rados.rados.0.smithi084.stdout:1575: writing smithi084102331-22 from 0 to 696320 tid 1 2024-01-13T18:06:00.647 INFO:tasks.rados.rados.0.smithi084.stdout:1575: writing smithi084102331-22 from 696320 to 1097728 tid 2 2024-01-13T18:06:00.647 INFO:tasks.rados.rados.0.smithi084.stdout:1576: rollback oid 3 current snap is 158 2024-01-13T18:06:00.647 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 157 2024-01-13T18:06:00.647 INFO:tasks.rados.rados.0.smithi084.stdout:1572: expect (ObjNum 440 snap 138 seq_num 440) 2024-01-13T18:06:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:06:00] "GET /metrics HTTP/1.1" 200 36199 "" "Prometheus/2.43.0" 2024-01-13T18:06:00.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[119097]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[119097]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[119097]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[119097]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[119097]: failed to encode map e379 with expected crc 2024-01-13T18:06:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[119097]: failed to encode map e379 with expected crc 2024-01-13T18:06:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[119097]: osdmap e379: 8 total, 7 up, 8 in 2024-01-13T18:06:00.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[116404]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[116404]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[116404]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[116404]: failed to encode map e378 with expected crc 2024-01-13T18:06:00.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[116404]: failed to encode map e379 with expected crc 2024-01-13T18:06:00.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[116404]: failed to encode map e379 with expected crc 2024-01-13T18:06:00.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:00 smithi084 ceph-mon[116404]: osdmap e379: 8 total, 7 up, 8 in 2024-01-13T18:06:00.803 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:00 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.5.service: Succeeded. 2024-01-13T18:06:00.803 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:00 smithi099 systemd[1]: Stopped Ceph osd.5 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:06:00.803 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:00 smithi099 systemd[1]: Starting Ceph osd.5 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:06:01.170 INFO:tasks.rados.rados.0.smithi084.stdout:1575: finishing write tid 1 to smithi084102331-22 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:1575: finishing write tid 2 to smithi084102331-22 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:1575: finishing write tid 3 to smithi084102331-22 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:1575: finishing write tid 4 to smithi084102331-22 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 793 (ObjNum 495 snap 158 seq_num 495) dirty exists 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:1575: left oid 22 (ObjNum 495 snap 158 seq_num 495) 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:1572: done (3 left) 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:1573: done (2 left) 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:1575: done (1 left) 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:1577: setattr oid 45 current snap is 158 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:1576: finishing rollback tid 0 to smithi084102331-3 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:1576: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:06:01.171 INFO:tasks.rados.rados.0.smithi084.stdout:1576: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:06:01.172 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 916 (ObjNum 437 snap 137 seq_num 437) dirty exists 2024-01-13T18:06:01.173 INFO:tasks.rados.rados.0.smithi084.stdout:1576: done (1 left) 2024-01-13T18:06:01.173 INFO:tasks.rados.rados.0.smithi084.stdout:1578: rollback oid 8 current snap is 158 2024-01-13T18:06:01.173 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 146 2024-01-13T18:06:01.173 INFO:tasks.rados.rados.0.smithi084.stdout:1579: snap_remove snap 155 2024-01-13T18:06:01.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:01 smithi099 ceph-mon[138788]: failed to encode map e379 with expected crc 2024-01-13T18:06:01.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:01 smithi099 ceph-mon[138788]: failed to encode map e379 with expected crc 2024-01-13T18:06:01.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:01 smithi099 ceph-mon[138788]: pgmap v280: 121 pgs: 9 activating+undersized, 7 peering, 11 stale+active+clean, 94 active+clean; 304 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2024-01-13T18:06:01.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:01 smithi099 ceph-mon[138788]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-13T18:06:01.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:01 smithi099 ceph-mon[138788]: failed to encode map e380 with expected crc 2024-01-13T18:06:01.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:01 smithi099 ceph-mon[138788]: osdmap e380: 8 total, 7 up, 8 in 2024-01-13T18:06:01.643 INFO:tasks.rados.rados.0.smithi084.stdout:1579: done (2 left) 2024-01-13T18:06:01.644 INFO:tasks.rados.rados.0.smithi084.stdout:1580: rollback oid 34 current snap is 158 2024-01-13T18:06:01.644 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 148 2024-01-13T18:06:01.644 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 920 (ObjNum 483 snap 152 seq_num 483) dirty exists 2024-01-13T18:06:01.644 INFO:tasks.rados.rados.0.smithi084.stdout:1578: finishing rollback tid 0 to smithi084102331-8 2024-01-13T18:06:01.644 INFO:tasks.rados.rados.0.smithi084.stdout:1578: finishing rollback tid 1 to smithi084102331-8 2024-01-13T18:06:01.644 INFO:tasks.rados.rados.0.smithi084.stdout:1578: finishing rollback tid 2 to smithi084102331-8 2024-01-13T18:06:01.644 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 840 (ObjNum 403 snap 128 seq_num 403) dirty exists 2024-01-13T18:06:01.644 INFO:tasks.rados.rados.0.smithi084.stdout:1577: done (2 left) 2024-01-13T18:06:01.644 INFO:tasks.rados.rados.0.smithi084.stdout:1578: done (1 left) 2024-01-13T18:06:01.644 INFO:tasks.rados.rados.0.smithi084.stdout:1581: delete oid 30 current snap is 158 2024-01-13T18:06:01.649 INFO:tasks.rados.rados.0.smithi084.stdout:1580: finishing rollback tid 0 to smithi084102331-34 2024-01-13T18:06:01.649 INFO:tasks.rados.rados.0.smithi084.stdout:1581: done (1 left) 2024-01-13T18:06:01.649 INFO:tasks.rados.rados.0.smithi084.stdout:1582: snap_remove snap 156 2024-01-13T18:06:01.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[116404]: failed to encode map e379 with expected crc 2024-01-13T18:06:01.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[116404]: failed to encode map e379 with expected crc 2024-01-13T18:06:01.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[116404]: pgmap v280: 121 pgs: 9 activating+undersized, 7 peering, 11 stale+active+clean, 94 active+clean; 304 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2024-01-13T18:06:01.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[116404]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-13T18:06:01.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[116404]: failed to encode map e380 with expected crc 2024-01-13T18:06:01.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[116404]: osdmap e380: 8 total, 7 up, 8 in 2024-01-13T18:06:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[119097]: failed to encode map e379 with expected crc 2024-01-13T18:06:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[119097]: failed to encode map e379 with expected crc 2024-01-13T18:06:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[119097]: pgmap v280: 121 pgs: 9 activating+undersized, 7 peering, 11 stale+active+clean, 94 active+clean; 304 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2024-01-13T18:06:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[119097]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-13T18:06:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[119097]: failed to encode map e380 with expected crc 2024-01-13T18:06:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:01 smithi084 ceph-mon[119097]: osdmap e380: 8 total, 7 up, 8 in 2024-01-13T18:06:01.869 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:01 smithi099 bash[151005]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-13T18:06:01.869 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:01 smithi099 bash[151005]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-01-13T18:06:01.870 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:01 smithi099 bash[151005]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-01-13T18:06:01.870 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:01 smithi099 bash[151005]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-01-13T18:06:01.870 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:01 smithi099 bash[151005]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-01-13T18:06:01.870 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:01 smithi099 bash[151005]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-13T18:06:01.870 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:01 smithi099 bash[151005]: --> ceph-volume raw activate successful for osd ID: 5 2024-01-13T18:06:02.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:02 smithi099 ceph-mon[138788]: failed to encode map e380 with expected crc 2024-01-13T18:06:02.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:02 smithi099 ceph-mon[138788]: osdmap e381: 8 total, 7 up, 8 in 2024-01-13T18:06:02.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:02 smithi099 ceph-mon[138788]: failed to encode map e381 with expected crc 2024-01-13T18:06:02.619 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:02 smithi099 ceph-osd[151318]: -- 172.21.15.99:0/4243982727 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556256f9c4e0 con 0x556256f6d400 2024-01-13T18:06:02.619 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:02 smithi099 bash[151280]: 5cf0e9339ca9e3b63c483109016727ffbede8b3c39c21773315f8394a41b008b 2024-01-13T18:06:02.619 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:02 smithi099 systemd[1]: Started Ceph osd.5 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:06:02.620 INFO:tasks.rados.rados.0.smithi084.stdout:1582: done (1 left) 2024-01-13T18:06:02.620 INFO:tasks.rados.rados.0.smithi084.stdout:1583: read oid 22 snap 146 2024-01-13T18:06:02.620 INFO:tasks.rados.rados.0.smithi084.stdout:1583: expect (ObjNum 379 snap 122 seq_num 379) 2024-01-13T18:06:02.620 INFO:tasks.rados.rados.0.smithi084.stdout:1584: rollback oid 20 current snap is 158 2024-01-13T18:06:02.620 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 148 2024-01-13T18:06:02.620 INFO:tasks.rados.rados.0.smithi084.stdout:1585: snap_create 2024-01-13T18:06:02.621 INFO:tasks.rados.rados.0.smithi084.stdout:1580: finishing rollback tid 1 to smithi084102331-34 2024-01-13T18:06:02.621 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 526 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-01-13T18:06:02.627 INFO:tasks.rados.rados.0.smithi084.stdout:1584: finishing rollback tid 1 to smithi084102331-20 2024-01-13T18:06:02.627 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 433 (ObjNum 65 snap 0 seq_num 1649759599) dirty dne 2024-01-13T18:06:02.670 INFO:tasks.rados.rados.0.smithi084.stdout:1583: expect (ObjNum 379 snap 122 seq_num 379) 2024-01-13T18:06:02.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:02 smithi084 ceph-mon[116404]: failed to encode map e380 with expected crc 2024-01-13T18:06:02.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:02 smithi084 ceph-mon[116404]: osdmap e381: 8 total, 7 up, 8 in 2024-01-13T18:06:02.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:02 smithi084 ceph-mon[116404]: failed to encode map e381 with expected crc 2024-01-13T18:06:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:02 smithi084 ceph-mon[119097]: failed to encode map e380 with expected crc 2024-01-13T18:06:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:02 smithi084 ceph-mon[119097]: osdmap e381: 8 total, 7 up, 8 in 2024-01-13T18:06:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:02 smithi084 ceph-mon[119097]: failed to encode map e381 with expected crc 2024-01-13T18:06:03.078 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:02 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T18:06:02.748+0000 7f6d2ec0b640 -1 Falling back to public interface 2024-01-13T18:06:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:03 smithi099 ceph-mon[138788]: failed to encode map e381 with expected crc 2024-01-13T18:06:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:03 smithi099 ceph-mon[138788]: pgmap v283: 121 pgs: 9 activating+undersized, 7 active+undersized+degraded, 7 peering, 4 stale+active+clean, 20 active+undersized, 74 active+clean; 306 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.6 MiB/s rd, 508 KiB/s wr, 8 op/s; 34/453 objects degraded (7.506%) 2024-01-13T18:06:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:03 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:03 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:03 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:03 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:03 smithi099 ceph-mon[138788]: failed to encode map e382 with expected crc 2024-01-13T18:06:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:03 smithi099 ceph-mon[138788]: osdmap e382: 8 total, 7 up, 8 in 2024-01-13T18:06:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:03 smithi099 ceph-mon[138788]: failed to encode map e382 with expected crc 2024-01-13T18:06:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:03 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:03 smithi099 ceph-mon[138788]: Health check failed: Degraded data redundancy: 34/453 objects degraded (7.506%), 7 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:03.621 INFO:tasks.rados.rados.0.smithi084.stdout:1580: done (3 left) 2024-01-13T18:06:03.621 INFO:tasks.rados.rados.0.smithi084.stdout:1583: done (2 left) 2024-01-13T18:06:03.621 INFO:tasks.rados.rados.0.smithi084.stdout:1584: done (1 left) 2024-01-13T18:06:03.621 INFO:tasks.rados.rados.0.smithi084.stdout:1585: done (0 left) 2024-01-13T18:06:03.621 INFO:tasks.rados.rados.0.smithi084.stdout:1586: read oid 22 snap -1 2024-01-13T18:06:03.621 INFO:tasks.rados.rados.0.smithi084.stdout:1586: expect (ObjNum 495 snap 158 seq_num 495) 2024-01-13T18:06:03.621 INFO:tasks.rados.rados.0.smithi084.stdout:1587: snap_create 2024-01-13T18:06:03.626 INFO:tasks.rados.rados.0.smithi084.stdout:1586: expect (ObjNum 495 snap 158 seq_num 495) 2024-01-13T18:06:03.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[116404]: failed to encode map e381 with expected crc 2024-01-13T18:06:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[116404]: pgmap v283: 121 pgs: 9 activating+undersized, 7 active+undersized+degraded, 7 peering, 4 stale+active+clean, 20 active+undersized, 74 active+clean; 306 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.6 MiB/s rd, 508 KiB/s wr, 8 op/s; 34/453 objects degraded (7.506%) 2024-01-13T18:06:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[116404]: failed to encode map e382 with expected crc 2024-01-13T18:06:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[116404]: osdmap e382: 8 total, 7 up, 8 in 2024-01-13T18:06:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[116404]: failed to encode map e382 with expected crc 2024-01-13T18:06:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[116404]: Health check failed: Degraded data redundancy: 34/453 objects degraded (7.506%), 7 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[119097]: failed to encode map e381 with expected crc 2024-01-13T18:06:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[119097]: pgmap v283: 121 pgs: 9 activating+undersized, 7 active+undersized+degraded, 7 peering, 4 stale+active+clean, 20 active+undersized, 74 active+clean; 306 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.6 MiB/s rd, 508 KiB/s wr, 8 op/s; 34/453 objects degraded (7.506%) 2024-01-13T18:06:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[119097]: failed to encode map e382 with expected crc 2024-01-13T18:06:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[119097]: osdmap e382: 8 total, 7 up, 8 in 2024-01-13T18:06:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[119097]: failed to encode map e382 with expected crc 2024-01-13T18:06:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:03.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:03 smithi084 ceph-mon[119097]: Health check failed: Degraded data redundancy: 34/453 objects degraded (7.506%), 7 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:04.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:04 smithi099 ceph-mon[138788]: failed to encode map e382 with expected crc 2024-01-13T18:06:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:04 smithi099 ceph-mon[138788]: failed to encode map e382 with expected crc 2024-01-13T18:06:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:04 smithi099 ceph-mon[138788]: osdmap e383: 8 total, 7 up, 8 in 2024-01-13T18:06:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:04 smithi099 ceph-mon[138788]: failed to encode map e383 with expected crc 2024-01-13T18:06:04.624 INFO:tasks.rados.rados.0.smithi084.stdout:1586: done (1 left) 2024-01-13T18:06:04.624 INFO:tasks.rados.rados.0.smithi084.stdout:1587: done (0 left) 2024-01-13T18:06:04.624 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 160 2024-01-13T18:06:04.624 INFO:tasks.rados.rados.0.smithi084.stdout:1588: seq_num 497 ranges {2392064=729088,3121152=401408} 2024-01-13T18:06:04.640 INFO:tasks.rados.rados.0.smithi084.stdout:1588: writing smithi084102331-25 from 2392064 to 3121152 tid 1 2024-01-13T18:06:04.643 INFO:tasks.rados.rados.0.smithi084.stdout:1588: writing smithi084102331-25 from 3121152 to 3522560 tid 2 2024-01-13T18:06:04.643 INFO:tasks.rados.rados.0.smithi084.stdout:1589: copy_from oid 31 from oid 13 current snap is 160 2024-01-13T18:06:04.643 INFO:tasks.rados.rados.0.smithi084.stdout:1590: snap_remove snap 144 2024-01-13T18:06:04.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:04 smithi084 ceph-mon[116404]: failed to encode map e382 with expected crc 2024-01-13T18:06:04.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:04 smithi084 ceph-mon[116404]: failed to encode map e382 with expected crc 2024-01-13T18:06:04.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:04 smithi084 ceph-mon[116404]: osdmap e383: 8 total, 7 up, 8 in 2024-01-13T18:06:04.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:04 smithi084 ceph-mon[116404]: failed to encode map e383 with expected crc 2024-01-13T18:06:04.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:04 smithi084 ceph-mon[119097]: failed to encode map e382 with expected crc 2024-01-13T18:06:04.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:04 smithi084 ceph-mon[119097]: failed to encode map e382 with expected crc 2024-01-13T18:06:04.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:04 smithi084 ceph-mon[119097]: osdmap e383: 8 total, 7 up, 8 in 2024-01-13T18:06:04.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:04 smithi084 ceph-mon[119097]: failed to encode map e383 with expected crc 2024-01-13T18:06:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:05 smithi099 ceph-mon[138788]: failed to encode map e383 with expected crc 2024-01-13T18:06:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:05 smithi099 ceph-mon[138788]: pgmap v286: 121 pgs: 9 activating+undersized, 11 active+undersized+degraded, 29 active+undersized, 72 active+clean; 308 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 11 op/s; 65/456 objects degraded (14.254%) 2024-01-13T18:06:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:05 smithi099 ceph-mon[138788]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-01-13T18:06:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:05 smithi099 ceph-mon[138788]: failed to encode map e384 with expected crc 2024-01-13T18:06:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:05 smithi099 ceph-mon[138788]: osdmap e384: 8 total, 7 up, 8 in 2024-01-13T18:06:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:05.627 INFO:tasks.rados.rados.0.smithi084.stdout:1590: done (2 left) 2024-01-13T18:06:05.627 INFO:tasks.rados.rados.0.smithi084.stdout:1591: read oid 28 snap -1 2024-01-13T18:06:05.627 INFO:tasks.rados.rados.0.smithi084.stdout:1591: expect (ObjNum 482 snap 151 seq_num 482) 2024-01-13T18:06:05.627 INFO:tasks.rados.rados.0.smithi084.stdout:1592: read oid 45 snap -1 2024-01-13T18:06:05.627 INFO:tasks.rados.rados.0.smithi084.stdout:1592: expect (ObjNum 483 snap 152 seq_num 483) 2024-01-13T18:06:05.627 INFO:tasks.rados.rados.0.smithi084.stdout:1593: snap_create 2024-01-13T18:06:05.627 INFO:tasks.rados.rados.0.smithi084.stdout:1589: finishing copy_from to smithi084102331-31 2024-01-13T18:06:05.628 INFO:tasks.rados.rados.0.smithi084.stdout:1589: got expected ENOENT (src dne) 2024-01-13T18:06:05.628 INFO:tasks.rados.rados.0.smithi084.stdout:1589: finishing copy_from racing read to smithi084102331-31 2024-01-13T18:06:05.628 INFO:tasks.rados.rados.0.smithi084.stdout:1588: finishing write tid 1 to smithi084102331-25 2024-01-13T18:06:05.628 INFO:tasks.rados.rados.0.smithi084.stdout:1588: finishing write tid 2 to smithi084102331-25 2024-01-13T18:06:05.628 INFO:tasks.rados.rados.0.smithi084.stdout:1588: finishing write tid 3 to smithi084102331-25 2024-01-13T18:06:05.628 INFO:tasks.rados.rados.0.smithi084.stdout:1588: finishing write tid 4 to smithi084102331-25 2024-01-13T18:06:05.628 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 770 (ObjNum 497 snap 160 seq_num 497) dirty exists 2024-01-13T18:06:05.628 INFO:tasks.rados.rados.0.smithi084.stdout:1588: left oid 25 (ObjNum 497 snap 160 seq_num 497) 2024-01-13T18:06:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:1592: expect (ObjNum 483 snap 152 seq_num 483) 2024-01-13T18:06:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[119097]: failed to encode map e383 with expected crc 2024-01-13T18:06:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[119097]: pgmap v286: 121 pgs: 9 activating+undersized, 11 active+undersized+degraded, 29 active+undersized, 72 active+clean; 308 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 11 op/s; 65/456 objects degraded (14.254%) 2024-01-13T18:06:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[119097]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-01-13T18:06:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[119097]: failed to encode map e384 with expected crc 2024-01-13T18:06:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[119097]: osdmap e384: 8 total, 7 up, 8 in 2024-01-13T18:06:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[116404]: failed to encode map e383 with expected crc 2024-01-13T18:06:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[116404]: pgmap v286: 121 pgs: 9 activating+undersized, 11 active+undersized+degraded, 29 active+undersized, 72 active+clean; 308 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 11 op/s; 65/456 objects degraded (14.254%) 2024-01-13T18:06:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[116404]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-01-13T18:06:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[116404]: failed to encode map e384 with expected crc 2024-01-13T18:06:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[116404]: osdmap e384: 8 total, 7 up, 8 in 2024-01-13T18:06:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:05.897 INFO:tasks.rados.rados.0.smithi084.stdout:1591: expect (ObjNum 482 snap 151 seq_num 482) 2024-01-13T18:06:06.369 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T18:06:05.865+0000 7f6d2ec0b640 -1 osd.5 0 read_superblock omap replica is missing. 2024-01-13T18:06:06.369 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T18:06:05.929+0000 7f6d2ec0b640 -1 osd.5 377 log_to_monitors true 2024-01-13T18:06:06.635 INFO:tasks.rados.rados.0.smithi084.stdout:1588: done (4 left) 2024-01-13T18:06:06.635 INFO:tasks.rados.rados.0.smithi084.stdout:1589: done (3 left) 2024-01-13T18:06:06.635 INFO:tasks.rados.rados.0.smithi084.stdout:1591: done (2 left) 2024-01-13T18:06:06.635 INFO:tasks.rados.rados.0.smithi084.stdout:1592: done (1 left) 2024-01-13T18:06:06.635 INFO:tasks.rados.rados.0.smithi084.stdout:1593: done (0 left) 2024-01-13T18:06:06.635 INFO:tasks.rados.rados.0.smithi084.stdout:1594: snap_remove snap 105 2024-01-13T18:06:06.663 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 18:06:06 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T18:06:06.660+0000 7f6d1e062700 -1 osd.5 377 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T18:06:06.664 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:06 smithi099 ceph-mon[138788]: failed to encode map e384 with expected crc 2024-01-13T18:06:06.664 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:06.664 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:06.664 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:06 smithi099 ceph-mon[138788]: failed to encode map e385 with expected crc 2024-01-13T18:06:06.664 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:06 smithi099 ceph-mon[138788]: osdmap e385: 8 total, 7 up, 8 in 2024-01-13T18:06:06.664 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:06 smithi099 ceph-mon[138788]: from='osd.5 [v2:172.21.15.99:6808/2423841634,v1:172.21.15.99:6809/2423841634]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T18:06:06.664 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:06 smithi099 ceph-mon[138788]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T18:06:06.664 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:06 smithi099 ceph-mon[138788]: pgmap v289: 121 pgs: 11 active+undersized+degraded, 38 active+undersized, 72 active+clean; 309 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 804 KiB/s wr, 5 op/s; 66/459 objects degraded (14.379%) 2024-01-13T18:06:06.664 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:06.664 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:06.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[119097]: failed to encode map e384 with expected crc 2024-01-13T18:06:06.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:06.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[119097]: failed to encode map e385 with expected crc 2024-01-13T18:06:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[119097]: osdmap e385: 8 total, 7 up, 8 in 2024-01-13T18:06:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[119097]: from='osd.5 [v2:172.21.15.99:6808/2423841634,v1:172.21.15.99:6809/2423841634]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T18:06:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[119097]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T18:06:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[119097]: pgmap v289: 121 pgs: 11 active+undersized+degraded, 38 active+undersized, 72 active+clean; 309 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 804 KiB/s wr, 5 op/s; 66/459 objects degraded (14.379%) 2024-01-13T18:06:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:06.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[116404]: failed to encode map e384 with expected crc 2024-01-13T18:06:06.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:06.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:06.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[116404]: failed to encode map e385 with expected crc 2024-01-13T18:06:06.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[116404]: osdmap e385: 8 total, 7 up, 8 in 2024-01-13T18:06:06.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[116404]: from='osd.5 [v2:172.21.15.99:6808/2423841634,v1:172.21.15.99:6809/2423841634]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T18:06:06.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[116404]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-13T18:06:06.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[116404]: pgmap v289: 121 pgs: 11 active+undersized+degraded, 38 active+undersized, 72 active+clean; 309 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 804 KiB/s wr, 5 op/s; 66/459 objects degraded (14.379%) 2024-01-13T18:06:06.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:06.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:07.638 INFO:tasks.rados.rados.0.smithi084.stdout:1594: done (0 left) 2024-01-13T18:06:07.638 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 161 2024-01-13T18:06:07.638 INFO:tasks.rados.rados.0.smithi084.stdout:1595: seq_num 498 ranges {7880704=745472,8626176=401408} 2024-01-13T18:06:07.672 INFO:tasks.rados.rados.0.smithi084.stdout:1595: writing smithi084102331-2 from 7880704 to 8626176 tid 1 2024-01-13T18:06:07.674 INFO:tasks.rados.rados.0.smithi084.stdout:1595: writing smithi084102331-2 from 8626176 to 9027584 tid 2 2024-01-13T18:06:07.675 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 161 2024-01-13T18:06:07.675 INFO:tasks.rados.rados.0.smithi084.stdout:1596: seq_num 499 ranges {3260416=761856,4022272=401408} 2024-01-13T18:06:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[119097]: failed to encode map e385 with expected crc 2024-01-13T18:06:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[119097]: failed to encode map e386 with expected crc 2024-01-13T18:06:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[119097]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-13T18:06:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[119097]: osdmap e386: 8 total, 7 up, 8 in 2024-01-13T18:06:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[119097]: from='osd.5 [v2:172.21.15.99:6808/2423841634,v1:172.21.15.99:6809/2423841634]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:07.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[119097]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:07.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[116404]: failed to encode map e385 with expected crc 2024-01-13T18:06:07.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[116404]: failed to encode map e386 with expected crc 2024-01-13T18:06:07.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[116404]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-13T18:06:07.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[116404]: osdmap e386: 8 total, 7 up, 8 in 2024-01-13T18:06:07.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[116404]: from='osd.5 [v2:172.21.15.99:6808/2423841634,v1:172.21.15.99:6809/2423841634]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:07.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:07 smithi084 ceph-mon[116404]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:07.696 INFO:tasks.rados.rados.0.smithi084.stdout:1596: writing smithi084102331-48 from 3260416 to 4022272 tid 1 2024-01-13T18:06:07.699 INFO:tasks.rados.rados.0.smithi084.stdout:1596: writing smithi084102331-48 from 4022272 to 4423680 tid 2 2024-01-13T18:06:07.699 INFO:tasks.rados.rados.0.smithi084.stdout:1597: rmattr oid 21 current snap is 161 2024-01-13T18:06:07.699 INFO:tasks.rados.rados.0.smithi084.stdout:1597: done (2 left) 2024-01-13T18:06:07.699 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 161 2024-01-13T18:06:07.699 INFO:tasks.rados.rados.0.smithi084.stdout:1598: seq_num 500 ranges {0=778240,778240=401408} 2024-01-13T18:06:07.703 INFO:tasks.rados.rados.0.smithi084.stdout:1598: writing smithi084102331-27 from 0 to 778240 tid 1 2024-01-13T18:06:07.705 INFO:tasks.rados.rados.0.smithi084.stdout:1598: writing smithi084102331-27 from 778240 to 1179648 tid 2 2024-01-13T18:06:07.705 INFO:tasks.rados.rados.0.smithi084.stdout:1599: delete oid 23 current snap is 161 2024-01-13T18:06:07.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:07 smithi099 ceph-mon[138788]: failed to encode map e385 with expected crc 2024-01-13T18:06:07.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:07 smithi099 ceph-mon[138788]: failed to encode map e386 with expected crc 2024-01-13T18:06:07.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:07 smithi099 ceph-mon[138788]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-13T18:06:07.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:07 smithi099 ceph-mon[138788]: osdmap e386: 8 total, 7 up, 8 in 2024-01-13T18:06:07.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:07 smithi099 ceph-mon[138788]: from='osd.5 [v2:172.21.15.99:6808/2423841634,v1:172.21.15.99:6809/2423841634]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:07.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:07 smithi099 ceph-mon[138788]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:06:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: osd.5 [v2:172.21.15.99:6808/2423841634,v1:172.21.15.99:6809/2423841634] boot 2024-01-13T18:06:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: osdmap e387: 8 total, 8 up, 8 in 2024-01-13T18:06:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:06:08.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: pgmap v292: 121 pgs: 2 peering, 10 active+undersized+degraded, 37 active+undersized, 72 active+clean; 296 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 276 KiB/s wr, 3 op/s; 54/441 objects degraded (12.245%) 2024-01-13T18:06:08.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:08.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:08.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:08.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:06:08.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:08.641 INFO:tasks.rados.rados.0.smithi084.stdout:1598: finishing write tid 1 to smithi084102331-27 2024-01-13T18:06:08.644 INFO:tasks.rados.rados.0.smithi084.stdout:1598: finishing write tid 2 to smithi084102331-27 2024-01-13T18:06:08.644 INFO:tasks.rados.rados.0.smithi084.stdout:1598: finishing write tid 3 to smithi084102331-27 2024-01-13T18:06:08.647 INFO:tasks.rados.rados.0.smithi084.stdout:1598: finishing write tid 4 to smithi084102331-27 2024-01-13T18:06:08.647 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 477 (ObjNum 500 snap 161 seq_num 500) dirty exists 2024-01-13T18:06:08.648 INFO:tasks.rados.rados.0.smithi084.stdout:1598: left oid 27 (ObjNum 500 snap 161 seq_num 500) 2024-01-13T18:06:08.653 INFO:tasks.rados.rados.0.smithi084.stdout:1595: finishing write tid 1 to smithi084102331-2 2024-01-13T18:06:08.653 INFO:tasks.rados.rados.0.smithi084.stdout:1595: finishing write tid 2 to smithi084102331-2 2024-01-13T18:06:08.657 INFO:tasks.rados.rados.0.smithi084.stdout:1595: finishing write tid 3 to smithi084102331-2 2024-01-13T18:06:08.660 INFO:tasks.rados.rados.0.smithi084.stdout:1596: finishing write tid 1 to smithi084102331-48 2024-01-13T18:06:08.660 INFO:tasks.rados.rados.0.smithi084.stdout:1596: finishing write tid 2 to smithi084102331-48 2024-01-13T18:06:08.660 INFO:tasks.rados.rados.0.smithi084.stdout:1596: finishing write tid 3 to smithi084102331-48 2024-01-13T18:06:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:1595: finishing write tid 4 to smithi084102331-2 2024-01-13T18:06:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 797 (ObjNum 498 snap 161 seq_num 498) dirty exists 2024-01-13T18:06:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:1595: left oid 2 (ObjNum 498 snap 161 seq_num 498) 2024-01-13T18:06:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:1595: done (3 left) 2024-01-13T18:06:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:1598: done (2 left) 2024-01-13T18:06:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:1599: done (1 left) 2024-01-13T18:06:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:1600: snap_remove snap 159 2024-01-13T18:06:08.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:06:08.531+0000 7fcaf82a4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-01-13T18:06:08.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: osd.5 [v2:172.21.15.99:6808/2423841634,v1:172.21.15.99:6809/2423841634] boot 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: osdmap e387: 8 total, 8 up, 8 in 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: pgmap v292: 121 pgs: 2 peering, 10 active+undersized+degraded, 37 active+undersized, 72 active+clean; 296 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 276 KiB/s wr, 3 op/s; 54/441 objects degraded (12.245%) 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:06:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: osd.5 [v2:172.21.15.99:6808/2423841634,v1:172.21.15.99:6809/2423841634] boot 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: osdmap e387: 8 total, 8 up, 8 in 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: failed to encode map e387 with expected crc 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: pgmap v292: 121 pgs: 2 peering, 10 active+undersized+degraded, 37 active+undersized, 72 active+clean; 296 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 276 KiB/s wr, 3 op/s; 54/441 objects degraded (12.245%) 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:08.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:06:08.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:08 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:09.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:06:08 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:06:08.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:06:09.640 INFO:tasks.rados.rados.0.smithi084.stdout:1600: done (1 left) 2024-01-13T18:06:09.640 INFO:tasks.rados.rados.0.smithi084.stdout:1601: setattr oid 23 current snap is 161 2024-01-13T18:06:09.640 INFO:tasks.rados.rados.0.smithi084.stdout:1596: finishing write tid 4 to smithi084102331-48 2024-01-13T18:06:09.640 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 801 (ObjNum 499 snap 161 seq_num 499) dirty exists 2024-01-13T18:06:09.640 INFO:tasks.rados.rados.0.smithi084.stdout:1596: left oid 48 (ObjNum 499 snap 161 seq_num 499) 2024-01-13T18:06:09.642 INFO:tasks.rados.rados.0.smithi084.stdout:1596: done (1 left) 2024-01-13T18:06:09.642 INFO:tasks.rados.rados.0.smithi084.stdout:1602: copy_from oid 42 from oid 28 current snap is 161 2024-01-13T18:06:09.642 INFO:tasks.rados.rados.0.smithi084.stdout:1603: read oid 26 snap -1 2024-01-13T18:06:09.642 INFO:tasks.rados.rados.0.smithi084.stdout:1603: expect deleted 2024-01-13T18:06:09.643 INFO:tasks.rados.rados.0.smithi084.stdout:1604: read oid 35 snap -1 2024-01-13T18:06:09.643 INFO:tasks.rados.rados.0.smithi084.stdout:1604: expect deleted 2024-01-13T18:06:09.643 INFO:tasks.rados.rados.0.smithi084.stdout:1605: rollback oid 3 current snap is 161 2024-01-13T18:06:09.643 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 158 2024-01-13T18:06:09.643 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 161 2024-01-13T18:06:09.643 INFO:tasks.rados.rados.0.smithi084.stdout:1606: seq_num 502 ranges {1015808=409600,1425408=417792,1843200=385024} 2024-01-13T18:06:09.650 INFO:tasks.rados.rados.0.smithi084.stdout:1606: writing smithi084102331-1 from 1015808 to 1425408 tid 1 2024-01-13T18:06:09.652 INFO:tasks.rados.rados.0.smithi084.stdout:1606: writing smithi084102331-1 from 1425408 to 1843200 tid 2 2024-01-13T18:06:09.655 INFO:tasks.rados.rados.0.smithi084.stdout:1606: writing smithi084102331-1 from 1843200 to 2228224 tid 3 2024-01-13T18:06:09.655 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 161 2024-01-13T18:06:09.655 INFO:tasks.rados.rados.0.smithi084.stdout:1607: seq_num 503 ranges {2695168=425984,3121152=704512,3825664=98304} 2024-01-13T18:06:09.672 INFO:tasks.rados.rados.0.smithi084.stdout:1607: writing smithi084102331-11 from 2695168 to 3121152 tid 1 2024-01-13T18:06:09.676 INFO:tasks.rados.rados.0.smithi084.stdout:1607: writing smithi084102331-11 from 3121152 to 3825664 tid 2 2024-01-13T18:06:09.677 INFO:tasks.rados.rados.0.smithi084.stdout:1607: writing smithi084102331-11 from 3825664 to 3923968 tid 3 2024-01-13T18:06:09.677 INFO:tasks.rados.rados.0.smithi084.stdout:1608: copy_from oid 19 from oid 21 current snap is 161 2024-01-13T18:06:09.677 INFO:tasks.rados.rados.0.smithi084.stdout:1605: finishing rollback tid 0 to smithi084102331-3 2024-01-13T18:06:09.677 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 818 (ObjNum 417 snap 0 seq_num 4037472720) dirty exists 2024-01-13T18:06:09.677 INFO:tasks.rados.rados.0.smithi084.stdout:1605: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:06:09.678 INFO:tasks.rados.rados.0.smithi084.stdout:1601: done (7 left) 2024-01-13T18:06:09.678 INFO:tasks.rados.rados.0.smithi084.stdout:1603: done (6 left) 2024-01-13T18:06:09.678 INFO:tasks.rados.rados.0.smithi084.stdout:1604: done (5 left) 2024-01-13T18:06:09.678 INFO:tasks.rados.rados.0.smithi084.stdout:1609: snap_remove snap 146 2024-01-13T18:06:09.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: failed to encode map e386 with expected crc 2024-01-13T18:06:09.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: failed to encode map e386 with expected crc 2024-01-13T18:06:09.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:09.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: failed to encode map e388 with expected crc 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: osdmap e388: 8 total, 8 up, 8 in 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: failed to encode map e388 with expected crc 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: failed to encode map e388 with expected crc 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 54/441 objects degraded (12.245%), 10 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: failed to encode map e386 with expected crc 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: failed to encode map e386 with expected crc 2024-01-13T18:06:09.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:09.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:09.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:09.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:09.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:09.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:09.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-01-13T18:06:09.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: failed to encode map e388 with expected crc 2024-01-13T18:06:09.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: osdmap e388: 8 total, 8 up, 8 in 2024-01-13T18:06:09.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: failed to encode map e388 with expected crc 2024-01-13T18:06:09.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: failed to encode map e388 with expected crc 2024-01-13T18:06:09.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:09 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 54/441 objects degraded (12.245%), 10 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: failed to encode map e386 with expected crc 2024-01-13T18:06:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: failed to encode map e386 with expected crc 2024-01-13T18:06:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:09.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:09.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-01-13T18:06:09.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: failed to encode map e388 with expected crc 2024-01-13T18:06:09.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: osdmap e388: 8 total, 8 up, 8 in 2024-01-13T18:06:09.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: failed to encode map e388 with expected crc 2024-01-13T18:06:09.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: failed to encode map e388 with expected crc 2024-01-13T18:06:09.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:09 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 54/441 objects degraded (12.245%), 10 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:10.648 INFO:tasks.rados.rados.0.smithi084.stdout:1609: done (5 left) 2024-01-13T18:06:10.648 INFO:tasks.rados.rados.0.smithi084.stdout:1610: snap_create 2024-01-13T18:06:10.648 INFO:tasks.rados.rados.0.smithi084.stdout:1605: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 948 (ObjNum 437 snap 137 seq_num 437) dirty exists 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:1606: finishing write tid 1 to smithi084102331-1 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:1606: finishing write tid 2 to smithi084102331-1 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:1606: finishing write tid 3 to smithi084102331-1 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:1606: finishing write tid 4 to smithi084102331-1 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:1606: finishing write tid 5 to smithi084102331-1 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 953 (ObjNum 502 snap 161 seq_num 502) dirty exists 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:1606: left oid 1 (ObjNum 502 snap 161 seq_num 502) 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:1602: finishing copy_from to smithi084102331-42 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 464 (ObjNum 482 snap 151 seq_num 482) dirty exists 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:1602: finishing copy_from racing read to smithi084102331-42 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:1607: finishing write tid 1 to smithi084102331-11 2024-01-13T18:06:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:1607: finishing write tid 2 to smithi084102331-11 2024-01-13T18:06:10.650 INFO:tasks.rados.rados.0.smithi084.stdout:1607: finishing write tid 3 to smithi084102331-11 2024-01-13T18:06:10.650 INFO:tasks.rados.rados.0.smithi084.stdout:1607: finishing write tid 4 to smithi084102331-11 2024-01-13T18:06:10.650 INFO:tasks.rados.rados.0.smithi084.stdout:1607: finishing write tid 5 to smithi084102331-11 2024-01-13T18:06:10.650 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 571 (ObjNum 503 snap 161 seq_num 503) dirty exists 2024-01-13T18:06:10.650 INFO:tasks.rados.rados.0.smithi084.stdout:1607: left oid 11 (ObjNum 503 snap 161 seq_num 503) 2024-01-13T18:06:10.650 INFO:tasks.rados.rados.0.smithi084.stdout:1608: finishing copy_from to smithi084102331-19 2024-01-13T18:06:10.650 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 512 (ObjNum 442 snap 138 seq_num 442) dirty exists 2024-01-13T18:06:10.650 INFO:tasks.rados.rados.0.smithi084.stdout:1608: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:06:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:06:10] "GET /metrics HTTP/1.1" 200 36202 "" "Prometheus/2.43.0" 2024-01-13T18:06:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[116404]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[116404]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[116404]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[116404]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[116404]: failed to encode map e389 with expected crc 2024-01-13T18:06:10.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[116404]: osdmap e389: 8 total, 8 up, 8 in 2024-01-13T18:06:10.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[116404]: pgmap v295: 121 pgs: 2 peering, 9 active+undersized+degraded, 30 active+undersized, 80 active+clean; 293 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 2 op/s; 52/426 objects degraded (12.207%) 2024-01-13T18:06:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[119097]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[119097]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[119097]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[119097]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[119097]: failed to encode map e389 with expected crc 2024-01-13T18:06:10.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[119097]: osdmap e389: 8 total, 8 up, 8 in 2024-01-13T18:06:10.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:10 smithi084 ceph-mon[119097]: pgmap v295: 121 pgs: 2 peering, 9 active+undersized+degraded, 30 active+undersized, 80 active+clean; 293 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 2 op/s; 52/426 objects degraded (12.207%) 2024-01-13T18:06:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:10 smithi099 ceph-mon[138788]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:10 smithi099 ceph-mon[138788]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:10 smithi099 ceph-mon[138788]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:10 smithi099 ceph-mon[138788]: failed to encode map e388 with expected crc 2024-01-13T18:06:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:10 smithi099 ceph-mon[138788]: failed to encode map e389 with expected crc 2024-01-13T18:06:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:10 smithi099 ceph-mon[138788]: osdmap e389: 8 total, 8 up, 8 in 2024-01-13T18:06:10.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:10 smithi099 ceph-mon[138788]: pgmap v295: 121 pgs: 2 peering, 9 active+undersized+degraded, 30 active+undersized, 80 active+clean; 293 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 2 op/s; 52/426 objects degraded (12.207%) 2024-01-13T18:06:11.646 INFO:tasks.rados.rados.0.smithi084.stdout:1602: done (5 left) 2024-01-13T18:06:11.646 INFO:tasks.rados.rados.0.smithi084.stdout:1605: done (4 left) 2024-01-13T18:06:11.646 INFO:tasks.rados.rados.0.smithi084.stdout:1606: done (3 left) 2024-01-13T18:06:11.646 INFO:tasks.rados.rados.0.smithi084.stdout:1607: done (2 left) 2024-01-13T18:06:11.646 INFO:tasks.rados.rados.0.smithi084.stdout:1608: done (1 left) 2024-01-13T18:06:11.646 INFO:tasks.rados.rados.0.smithi084.stdout:1610: done (0 left) 2024-01-13T18:06:11.646 INFO:tasks.rados.rados.0.smithi084.stdout:1611: delete oid 39 current snap is 162 2024-01-13T18:06:11.652 INFO:tasks.rados.rados.0.smithi084.stdout:1611: done (0 left) 2024-01-13T18:06:11.652 INFO:tasks.rados.rados.0.smithi084.stdout:1612: snap_remove snap 161 2024-01-13T18:06:11.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:11 smithi084 ceph-mon[116404]: failed to encode map e389 with expected crc 2024-01-13T18:06:11.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:11 smithi084 ceph-mon[116404]: failed to encode map e390 with expected crc 2024-01-13T18:06:11.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:11 smithi084 ceph-mon[116404]: osdmap e390: 8 total, 8 up, 8 in 2024-01-13T18:06:11.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:11 smithi084 ceph-mon[119097]: failed to encode map e389 with expected crc 2024-01-13T18:06:11.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:11 smithi084 ceph-mon[119097]: failed to encode map e390 with expected crc 2024-01-13T18:06:11.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:11 smithi084 ceph-mon[119097]: osdmap e390: 8 total, 8 up, 8 in 2024-01-13T18:06:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:11 smithi099 ceph-mon[138788]: failed to encode map e389 with expected crc 2024-01-13T18:06:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:11 smithi099 ceph-mon[138788]: failed to encode map e390 with expected crc 2024-01-13T18:06:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:11 smithi099 ceph-mon[138788]: osdmap e390: 8 total, 8 up, 8 in 2024-01-13T18:06:12.652 INFO:tasks.rados.rados.0.smithi084.stdout:1612: done (0 left) 2024-01-13T18:06:12.652 INFO:tasks.rados.rados.0.smithi084.stdout:1613: snap_remove snap 157 2024-01-13T18:06:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:12 smithi084 ceph-mon[116404]: failed to encode map e390 with expected crc 2024-01-13T18:06:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:12 smithi084 ceph-mon[116404]: failed to encode map e391 with expected crc 2024-01-13T18:06:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:12 smithi084 ceph-mon[116404]: osdmap e391: 8 total, 8 up, 8 in 2024-01-13T18:06:12.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:12 smithi084 ceph-mon[116404]: pgmap v298: 121 pgs: 2 peering, 119 active+clean; 193 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 805 KiB/s rd, 3.2 MiB/s wr, 12 op/s; 2.8 MiB/s, 1 objects/s recovering 2024-01-13T18:06:12.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:12 smithi084 ceph-mon[119097]: failed to encode map e390 with expected crc 2024-01-13T18:06:12.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:12 smithi084 ceph-mon[119097]: failed to encode map e391 with expected crc 2024-01-13T18:06:12.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:12 smithi084 ceph-mon[119097]: osdmap e391: 8 total, 8 up, 8 in 2024-01-13T18:06:12.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:12 smithi084 ceph-mon[119097]: pgmap v298: 121 pgs: 2 peering, 119 active+clean; 193 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 805 KiB/s rd, 3.2 MiB/s wr, 12 op/s; 2.8 MiB/s, 1 objects/s recovering 2024-01-13T18:06:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:12 smithi099 ceph-mon[138788]: failed to encode map e390 with expected crc 2024-01-13T18:06:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:12 smithi099 ceph-mon[138788]: failed to encode map e391 with expected crc 2024-01-13T18:06:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:12 smithi099 ceph-mon[138788]: osdmap e391: 8 total, 8 up, 8 in 2024-01-13T18:06:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:12 smithi099 ceph-mon[138788]: pgmap v298: 121 pgs: 2 peering, 119 active+clean; 193 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 805 KiB/s rd, 3.2 MiB/s wr, 12 op/s; 2.8 MiB/s, 1 objects/s recovering 2024-01-13T18:06:13.653 INFO:tasks.rados.rados.0.smithi084.stdout:1613: done (0 left) 2024-01-13T18:06:13.653 INFO:tasks.rados.rados.0.smithi084.stdout:1614: rollback oid 19 current snap is 162 2024-01-13T18:06:13.653 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 19 to 160 2024-01-13T18:06:13.653 INFO:tasks.rados.rados.0.smithi084.stdout:1615: rmattr oid 33 current snap is 162 2024-01-13T18:06:13.654 INFO:tasks.rados.rados.0.smithi084.stdout:1615: done (1 left) 2024-01-13T18:06:13.654 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 162 2024-01-13T18:06:13.654 INFO:tasks.rados.rados.0.smithi084.stdout:1616: seq_num 505 ranges {0=466944,466944=475136,942080=327680} 2024-01-13T18:06:13.656 INFO:tasks.rados.rados.0.smithi084.stdout:1616: writing smithi084102331-23 from 0 to 466944 tid 1 2024-01-13T18:06:13.659 INFO:tasks.rados.rados.0.smithi084.stdout:1616: writing smithi084102331-23 from 466944 to 942080 tid 2 2024-01-13T18:06:13.662 INFO:tasks.rados.rados.0.smithi084.stdout:1616: writing smithi084102331-23 from 942080 to 1269760 tid 3 2024-01-13T18:06:13.663 INFO:tasks.rados.rados.0.smithi084.stdout:1617: rmattr oid 37 current snap is 162 2024-01-13T18:06:13.663 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 162 2024-01-13T18:06:13.663 INFO:tasks.rados.rados.0.smithi084.stdout:1618: seq_num 506 ranges {0=483328,483328=761856,1245184=40960} 2024-01-13T18:06:13.664 INFO:tasks.rados.rados.0.smithi084.stdout:1618: writing smithi084102331-30 from 0 to 483328 tid 1 2024-01-13T18:06:13.668 INFO:tasks.rados.rados.0.smithi084.stdout:1618: writing smithi084102331-30 from 483328 to 1245184 tid 2 2024-01-13T18:06:13.669 INFO:tasks.rados.rados.0.smithi084.stdout:1618: writing smithi084102331-30 from 1245184 to 1286144 tid 3 2024-01-13T18:06:13.669 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 162 2024-01-13T18:06:13.669 INFO:tasks.rados.rados.0.smithi084.stdout:1614: finishing rollback tid 0 to smithi084102331-19 2024-01-13T18:06:13.669 INFO:tasks.rados.rados.0.smithi084.stdout:1619: seq_num 507 ranges {8216576=499712,8716288=638976,9355264=163840} 2024-01-13T18:06:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:13 smithi084 ceph-mon[116404]: failed to encode map e391 with expected crc 2024-01-13T18:06:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:13 smithi084 ceph-mon[116404]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 52/426 objects degraded (12.207%), 9 pgs degraded) 2024-01-13T18:06:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:13 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:06:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:13 smithi084 ceph-mon[116404]: osdmap e392: 8 total, 8 up, 8 in 2024-01-13T18:06:13.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:13 smithi084 ceph-mon[116404]: failed to encode map e392 with expected crc 2024-01-13T18:06:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:13 smithi084 ceph-mon[119097]: failed to encode map e391 with expected crc 2024-01-13T18:06:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:13 smithi084 ceph-mon[119097]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 52/426 objects degraded (12.207%), 9 pgs degraded) 2024-01-13T18:06:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:13 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:06:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:13 smithi084 ceph-mon[119097]: osdmap e392: 8 total, 8 up, 8 in 2024-01-13T18:06:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:13 smithi084 ceph-mon[119097]: failed to encode map e392 with expected crc 2024-01-13T18:06:13.716 INFO:tasks.rados.rados.0.smithi084.stdout:1619: writing smithi084102331-4 from 8216576 to 8716288 tid 1 2024-01-13T18:06:13.719 INFO:tasks.rados.rados.0.smithi084.stdout:1619: writing smithi084102331-4 from 8716288 to 9355264 tid 2 2024-01-13T18:06:13.720 INFO:tasks.rados.rados.0.smithi084.stdout:1619: writing smithi084102331-4 from 9355264 to 9519104 tid 3 2024-01-13T18:06:13.721 INFO:tasks.rados.rados.0.smithi084.stdout:1620: read oid 15 snap -1 2024-01-13T18:06:13.722 INFO:tasks.rados.rados.0.smithi084.stdout:1620: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:06:13.722 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 162 2024-01-13T18:06:13.722 INFO:tasks.rados.rados.0.smithi084.stdout:1621: seq_num 508 ranges {3923968=516096,4440064=524288,4964352=278528} 2024-01-13T18:06:13.745 INFO:tasks.rados.rados.0.smithi084.stdout:1621: writing smithi084102331-11 from 3923968 to 4440064 tid 1 2024-01-13T18:06:13.748 INFO:tasks.rados.rados.0.smithi084.stdout:1621: writing smithi084102331-11 from 4440064 to 4964352 tid 2 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1621: writing smithi084102331-11 from 4964352 to 5242880 tid 3 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1622: delete oid 6 current snap is 162 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1614: finishing rollback tid 1 to smithi084102331-19 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1614: finishing rollback tid 2 to smithi084102331-19 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 612 (ObjNum 403 snap 128 seq_num 403) dirty exists 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1616: finishing write tid 1 to smithi084102331-23 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1616: finishing write tid 2 to smithi084102331-23 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1616: finishing write tid 3 to smithi084102331-23 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1616: finishing write tid 4 to smithi084102331-23 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1616: finishing write tid 5 to smithi084102331-23 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 836 (ObjNum 505 snap 162 seq_num 505) dirty exists 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1616: left oid 23 (ObjNum 505 snap 162 seq_num 505) 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 796 (ObjNum 65 snap 0 seq_num 1398039648) dirty exists 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1618: finishing write tid 1 to smithi084102331-30 2024-01-13T18:06:13.751 INFO:tasks.rados.rados.0.smithi084.stdout:1618: finishing write tid 2 to smithi084102331-30 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:1618: finishing write tid 3 to smithi084102331-30 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:1618: finishing write tid 4 to smithi084102331-30 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:1618: finishing write tid 5 to smithi084102331-30 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 804 (ObjNum 506 snap 162 seq_num 506) dirty exists 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:1618: left oid 30 (ObjNum 506 snap 162 seq_num 506) 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:1619: finishing write tid 1 to smithi084102331-4 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:1619: finishing write tid 2 to smithi084102331-4 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:1619: finishing write tid 3 to smithi084102331-4 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:1619: finishing write tid 4 to smithi084102331-4 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:1619: finishing write tid 5 to smithi084102331-4 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 611 (ObjNum 507 snap 162 seq_num 507) dirty exists 2024-01-13T18:06:13.752 INFO:tasks.rados.rados.0.smithi084.stdout:1619: left oid 4 (ObjNum 507 snap 162 seq_num 507) 2024-01-13T18:06:13.753 INFO:tasks.rados.rados.0.smithi084.stdout:1620: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:06:13.787 INFO:tasks.rados.rados.0.smithi084.stdout:1621: finishing write tid 1 to smithi084102331-11 2024-01-13T18:06:13.787 INFO:tasks.rados.rados.0.smithi084.stdout:1621: finishing write tid 2 to smithi084102331-11 2024-01-13T18:06:13.788 INFO:tasks.rados.rados.0.smithi084.stdout:1621: finishing write tid 3 to smithi084102331-11 2024-01-13T18:06:13.788 INFO:tasks.rados.rados.0.smithi084.stdout:1621: finishing write tid 4 to smithi084102331-11 2024-01-13T18:06:13.788 INFO:tasks.rados.rados.0.smithi084.stdout:1621: finishing write tid 5 to smithi084102331-11 2024-01-13T18:06:13.788 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 589 (ObjNum 508 snap 162 seq_num 508) dirty exists 2024-01-13T18:06:13.788 INFO:tasks.rados.rados.0.smithi084.stdout:1621: left oid 11 (ObjNum 508 snap 162 seq_num 508) 2024-01-13T18:06:13.788 INFO:tasks.rados.rados.0.smithi084.stdout:1614: done (7 left) 2024-01-13T18:06:13.788 INFO:tasks.rados.rados.0.smithi084.stdout:1616: done (6 left) 2024-01-13T18:06:13.789 INFO:tasks.rados.rados.0.smithi084.stdout:1617: done (5 left) 2024-01-13T18:06:13.789 INFO:tasks.rados.rados.0.smithi084.stdout:1618: done (4 left) 2024-01-13T18:06:13.789 INFO:tasks.rados.rados.0.smithi084.stdout:1619: done (3 left) 2024-01-13T18:06:13.789 INFO:tasks.rados.rados.0.smithi084.stdout:1620: done (2 left) 2024-01-13T18:06:13.789 INFO:tasks.rados.rados.0.smithi084.stdout:1621: done (1 left) 2024-01-13T18:06:13.789 INFO:tasks.rados.rados.0.smithi084.stdout:1622: done (0 left) 2024-01-13T18:06:13.789 INFO:tasks.rados.rados.0.smithi084.stdout:1623: setattr oid 28 current snap is 162 2024-01-13T18:06:13.789 INFO:tasks.rados.rados.0.smithi084.stdout:1624: snap_remove snap 154 2024-01-13T18:06:13.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:13 smithi099 ceph-mon[138788]: failed to encode map e391 with expected crc 2024-01-13T18:06:13.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:13 smithi099 ceph-mon[138788]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 52/426 objects degraded (12.207%), 9 pgs degraded) 2024-01-13T18:06:13.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:13 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:06:13.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:13 smithi099 ceph-mon[138788]: osdmap e392: 8 total, 8 up, 8 in 2024-01-13T18:06:13.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:13 smithi099 ceph-mon[138788]: failed to encode map e392 with expected crc 2024-01-13T18:06:14.662 INFO:tasks.rados.rados.0.smithi084.stdout:1624: done (1 left) 2024-01-13T18:06:14.662 INFO:tasks.rados.rados.0.smithi084.stdout:1625: setattr oid 50 current snap is 162 2024-01-13T18:06:14.662 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 489 (ObjNum 482 snap 151 seq_num 482) dirty exists 2024-01-13T18:06:14.664 INFO:tasks.rados.rados.0.smithi084.stdout:1623: done (1 left) 2024-01-13T18:06:14.664 INFO:tasks.rados.rados.0.smithi084.stdout:1626: rollback oid 32 current snap is 162 2024-01-13T18:06:14.664 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 32 to 158 2024-01-13T18:06:14.664 INFO:tasks.rados.rados.0.smithi084.stdout:1627: copy_from oid 19 from oid 46 current snap is 162 2024-01-13T18:06:14.664 INFO:tasks.rados.rados.0.smithi084.stdout:1628: delete oid 44 current snap is 162 2024-01-13T18:06:14.676 INFO:tasks.rados.rados.0.smithi084.stdout:1626: finishing rollback tid 0 to smithi084102331-32 2024-01-13T18:06:14.678 INFO:tasks.rados.rados.0.smithi084.stdout:1626: finishing rollback tid 1 to smithi084102331-32 2024-01-13T18:06:14.678 INFO:tasks.rados.rados.0.smithi084.stdout:1626: finishing rollback tid 2 to smithi084102331-32 2024-01-13T18:06:14.678 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 878 (ObjNum 493 snap 157 seq_num 493) dirty exists 2024-01-13T18:06:14.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:14 smithi084 ceph-mon[119097]: failed to encode map e392 with expected crc 2024-01-13T18:06:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:14 smithi084 ceph-mon[119097]: failed to encode map e393 with expected crc 2024-01-13T18:06:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:14 smithi084 ceph-mon[119097]: osdmap e393: 8 total, 8 up, 8 in 2024-01-13T18:06:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:14 smithi084 ceph-mon[119097]: failed to encode map e393 with expected crc 2024-01-13T18:06:14.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:14 smithi084 ceph-mon[119097]: pgmap v301: 121 pgs: 121 active+clean; 188 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 805 KiB/s rd, 3.5 MiB/s wr, 13 op/s; 2.8 MiB/s, 1 objects/s recovering 2024-01-13T18:06:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:14 smithi084 ceph-mon[116404]: failed to encode map e392 with expected crc 2024-01-13T18:06:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:14 smithi084 ceph-mon[116404]: failed to encode map e393 with expected crc 2024-01-13T18:06:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:14 smithi084 ceph-mon[116404]: osdmap e393: 8 total, 8 up, 8 in 2024-01-13T18:06:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:14 smithi084 ceph-mon[116404]: failed to encode map e393 with expected crc 2024-01-13T18:06:14.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:14 smithi084 ceph-mon[116404]: pgmap v301: 121 pgs: 121 active+clean; 188 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 805 KiB/s rd, 3.5 MiB/s wr, 13 op/s; 2.8 MiB/s, 1 objects/s recovering 2024-01-13T18:06:14.680 INFO:tasks.rados.rados.0.smithi084.stdout:1626: done (3 left) 2024-01-13T18:06:14.680 INFO:tasks.rados.rados.0.smithi084.stdout:1628: done (2 left) 2024-01-13T18:06:14.680 INFO:tasks.rados.rados.0.smithi084.stdout:1629: read oid 34 snap -1 2024-01-13T18:06:14.681 INFO:tasks.rados.rados.0.smithi084.stdout:1629: expect deleted 2024-01-13T18:06:14.681 INFO:tasks.rados.rados.0.smithi084.stdout:1630: copy_from oid 12 from oid 44 current snap is 162 2024-01-13T18:06:14.681 INFO:tasks.rados.rados.0.smithi084.stdout:1631: copy_from oid 42 from oid 32 current snap is 162 2024-01-13T18:06:14.681 INFO:tasks.rados.rados.0.smithi084.stdout:1632: snap_remove snap 160 2024-01-13T18:06:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:14 smithi099 ceph-mon[138788]: failed to encode map e392 with expected crc 2024-01-13T18:06:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:14 smithi099 ceph-mon[138788]: failed to encode map e393 with expected crc 2024-01-13T18:06:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:14 smithi099 ceph-mon[138788]: osdmap e393: 8 total, 8 up, 8 in 2024-01-13T18:06:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:14 smithi099 ceph-mon[138788]: failed to encode map e393 with expected crc 2024-01-13T18:06:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:14 smithi099 ceph-mon[138788]: pgmap v301: 121 pgs: 121 active+clean; 188 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 805 KiB/s rd, 3.5 MiB/s wr, 13 op/s; 2.8 MiB/s, 1 objects/s recovering 2024-01-13T18:06:15.665 INFO:tasks.rados.rados.0.smithi084.stdout:1632: done (5 left) 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:1633: copy_from oid 28 from oid 41 current snap is 162 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 810 (ObjNum 440 snap 138 seq_num 440) dirty exists 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:1630: finishing copy_from to smithi084102331-12 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:1630: got expected ENOENT (src dne) 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:1630: finishing copy_from racing read to smithi084102331-12 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:1627: finishing copy_from to smithi084102331-19 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 548 (ObjNum 491 snap 155 seq_num 491) dirty exists 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:1627: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:1631: finishing copy_from to smithi084102331-42 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 878 (ObjNum 493 snap 157 seq_num 493) dirty exists 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:1631: finishing copy_from racing read to smithi084102331-42 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:1625: done (5 left) 2024-01-13T18:06:15.666 INFO:tasks.rados.rados.0.smithi084.stdout:1627: done (4 left) 2024-01-13T18:06:15.667 INFO:tasks.rados.rados.0.smithi084.stdout:1629: done (3 left) 2024-01-13T18:06:15.667 INFO:tasks.rados.rados.0.smithi084.stdout:1630: done (2 left) 2024-01-13T18:06:15.667 INFO:tasks.rados.rados.0.smithi084.stdout:1631: done (1 left) 2024-01-13T18:06:15.667 INFO:tasks.rados.rados.0.smithi084.stdout:1634: rmattr oid 1 current snap is 162 2024-01-13T18:06:15.667 INFO:tasks.rados.rados.0.smithi084.stdout:1634: done (1 left) 2024-01-13T18:06:15.667 INFO:tasks.rados.rados.0.smithi084.stdout:1635: snap_create 2024-01-13T18:06:15.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:15 smithi084 ceph-mon[116404]: failed to encode map e393 with expected crc 2024-01-13T18:06:15.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:15 smithi084 ceph-mon[116404]: failed to encode map e393 with expected crc 2024-01-13T18:06:15.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:15 smithi084 ceph-mon[116404]: osdmap e394: 8 total, 8 up, 8 in 2024-01-13T18:06:15.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:15 smithi084 ceph-mon[116404]: failed to encode map e394 with expected crc 2024-01-13T18:06:15.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:15 smithi084 ceph-mon[116404]: failed to encode map e394 with expected crc 2024-01-13T18:06:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:15 smithi084 ceph-mon[119097]: failed to encode map e393 with expected crc 2024-01-13T18:06:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:15 smithi084 ceph-mon[119097]: failed to encode map e393 with expected crc 2024-01-13T18:06:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:15 smithi084 ceph-mon[119097]: osdmap e394: 8 total, 8 up, 8 in 2024-01-13T18:06:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:15 smithi084 ceph-mon[119097]: failed to encode map e394 with expected crc 2024-01-13T18:06:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:15 smithi084 ceph-mon[119097]: failed to encode map e394 with expected crc 2024-01-13T18:06:15.683 INFO:tasks.rados.rados.0.smithi084.stdout:1633: finishing copy_from to smithi084102331-28 2024-01-13T18:06:15.683 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 502 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:06:15.684 INFO:tasks.rados.rados.0.smithi084.stdout:1633: finishing copy_from racing read to smithi084102331-28 2024-01-13T18:06:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:15 smithi099 ceph-mon[138788]: failed to encode map e393 with expected crc 2024-01-13T18:06:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:15 smithi099 ceph-mon[138788]: failed to encode map e393 with expected crc 2024-01-13T18:06:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:15 smithi099 ceph-mon[138788]: osdmap e394: 8 total, 8 up, 8 in 2024-01-13T18:06:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:15 smithi099 ceph-mon[138788]: failed to encode map e394 with expected crc 2024-01-13T18:06:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:15 smithi099 ceph-mon[138788]: failed to encode map e394 with expected crc 2024-01-13T18:06:16.673 INFO:tasks.rados.rados.0.smithi084.stdout:1633: done (1 left) 2024-01-13T18:06:16.673 INFO:tasks.rados.rados.0.smithi084.stdout:1635: done (0 left) 2024-01-13T18:06:16.673 INFO:tasks.rados.rados.0.smithi084.stdout:1636: rollback oid 43 current snap is 163 2024-01-13T18:06:16.673 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 158 2024-01-13T18:06:16.673 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 163 2024-01-13T18:06:16.673 INFO:tasks.rados.rados.0.smithi084.stdout:1637: seq_num 511 ranges {9519104=565248,10084352=630784,10715136=172032} 2024-01-13T18:06:16.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:16 smithi084 ceph-mon[116404]: failed to encode map e394 with expected crc 2024-01-13T18:06:16.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:16 smithi084 ceph-mon[116404]: failed to encode map e395 with expected crc 2024-01-13T18:06:16.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:16 smithi084 ceph-mon[116404]: osdmap e395: 8 total, 8 up, 8 in 2024-01-13T18:06:16.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:16 smithi084 ceph-mon[116404]: failed to encode map e395 with expected crc 2024-01-13T18:06:16.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:16 smithi084 ceph-mon[116404]: pgmap v304: 121 pgs: 121 active+clean; 189 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 614 KiB/s wr, 8 op/s 2024-01-13T18:06:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:16 smithi084 ceph-mon[119097]: failed to encode map e394 with expected crc 2024-01-13T18:06:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:16 smithi084 ceph-mon[119097]: failed to encode map e395 with expected crc 2024-01-13T18:06:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:16 smithi084 ceph-mon[119097]: osdmap e395: 8 total, 8 up, 8 in 2024-01-13T18:06:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:16 smithi084 ceph-mon[119097]: failed to encode map e395 with expected crc 2024-01-13T18:06:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:16 smithi084 ceph-mon[119097]: pgmap v304: 121 pgs: 121 active+clean; 189 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 614 KiB/s wr, 8 op/s 2024-01-13T18:06:16.727 INFO:tasks.rados.rados.0.smithi084.stdout:1637: writing smithi084102331-4 from 9519104 to 10084352 tid 1 2024-01-13T18:06:16.731 INFO:tasks.rados.rados.0.smithi084.stdout:1637: writing smithi084102331-4 from 10084352 to 10715136 tid 2 2024-01-13T18:06:16.733 INFO:tasks.rados.rados.0.smithi084.stdout:1637: writing smithi084102331-4 from 10715136 to 10887168 tid 3 2024-01-13T18:06:16.733 INFO:tasks.rados.rados.0.smithi084.stdout:1636: finishing rollback tid 0 to smithi084102331-43 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:1638: read oid 18 snap -1 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:1638: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:1639: read oid 50 snap -1 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:1639: expect (ObjNum 440 snap 138 seq_num 440) 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:1640: rollback oid 38 current snap is 163 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 162 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:1636: finishing rollback tid 1 to smithi084102331-43 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:1636: finishing rollback tid 2 to smithi084102331-43 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 452 (ObjNum 445 snap 139 seq_num 445) dirty exists 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:1637: finishing write tid 1 to smithi084102331-4 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:1636: done (4 left) 2024-01-13T18:06:16.734 INFO:tasks.rados.rados.0.smithi084.stdout:1641: read oid 5 snap -1 2024-01-13T18:06:16.735 INFO:tasks.rados.rados.0.smithi084.stdout:1641: expect (ObjNum 456 snap 142 seq_num 456) 2024-01-13T18:06:16.735 INFO:tasks.rados.rados.0.smithi084.stdout:1642: setattr oid 25 current snap is 163 2024-01-13T18:06:16.735 INFO:tasks.rados.rados.0.smithi084.stdout:1638: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:06:16.738 INFO:tasks.rados.rados.0.smithi084.stdout:1640: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:06:16.738 INFO:tasks.rados.rados.0.smithi084.stdout:1640: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:06:16.738 INFO:tasks.rados.rados.0.smithi084.stdout:1638: done (5 left) 2024-01-13T18:06:16.738 INFO:tasks.rados.rados.0.smithi084.stdout:1643: snap_create 2024-01-13T18:06:16.738 INFO:tasks.rados.rados.0.smithi084.stdout:1637: finishing write tid 2 to smithi084102331-4 2024-01-13T18:06:16.738 INFO:tasks.rados.rados.0.smithi084.stdout:1637: finishing write tid 3 to smithi084102331-4 2024-01-13T18:06:16.738 INFO:tasks.rados.rados.0.smithi084.stdout:1637: finishing write tid 4 to smithi084102331-4 2024-01-13T18:06:16.738 INFO:tasks.rados.rados.0.smithi084.stdout:1640: finishing rollback tid 2 to smithi084102331-38 2024-01-13T18:06:16.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 977 (ObjNum 474 snap 148 seq_num 474) dirty exists 2024-01-13T18:06:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1637: finishing write tid 5 to smithi084102331-4 2024-01-13T18:06:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 620 (ObjNum 511 snap 163 seq_num 511) dirty exists 2024-01-13T18:06:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1637: left oid 4 (ObjNum 511 snap 163 seq_num 511) 2024-01-13T18:06:16.751 INFO:tasks.rados.rados.0.smithi084.stdout:1641: expect (ObjNum 456 snap 142 seq_num 456) 2024-01-13T18:06:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:16 smithi099 ceph-mon[138788]: failed to encode map e394 with expected crc 2024-01-13T18:06:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:16 smithi099 ceph-mon[138788]: failed to encode map e395 with expected crc 2024-01-13T18:06:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:16 smithi099 ceph-mon[138788]: osdmap e395: 8 total, 8 up, 8 in 2024-01-13T18:06:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:16 smithi099 ceph-mon[138788]: failed to encode map e395 with expected crc 2024-01-13T18:06:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:16 smithi099 ceph-mon[138788]: pgmap v304: 121 pgs: 121 active+clean; 189 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 614 KiB/s wr, 8 op/s 2024-01-13T18:06:16.954 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 820 (ObjNum 497 snap 160 seq_num 497) dirty exists 2024-01-13T18:06:16.954 INFO:tasks.rados.rados.0.smithi084.stdout:1639: expect (ObjNum 440 snap 138 seq_num 440) 2024-01-13T18:06:17.618 INFO:tasks.rados.rados.0.smithi084.stdout:1637: done (5 left) 2024-01-13T18:06:17.618 INFO:tasks.rados.rados.0.smithi084.stdout:1639: done (4 left) 2024-01-13T18:06:17.618 INFO:tasks.rados.rados.0.smithi084.stdout:1640: done (3 left) 2024-01-13T18:06:17.618 INFO:tasks.rados.rados.0.smithi084.stdout:1641: done (2 left) 2024-01-13T18:06:17.618 INFO:tasks.rados.rados.0.smithi084.stdout:1642: done (1 left) 2024-01-13T18:06:17.618 INFO:tasks.rados.rados.0.smithi084.stdout:1643: done (0 left) 2024-01-13T18:06:17.618 INFO:tasks.rados.rados.0.smithi084.stdout:1644: snap_remove snap 158 2024-01-13T18:06:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:17 smithi084 ceph-mon[116404]: failed to encode map e395 with expected crc 2024-01-13T18:06:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:17 smithi084 ceph-mon[116404]: failed to encode map e395 with expected crc 2024-01-13T18:06:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:17 smithi084 ceph-mon[116404]: osdmap e396: 8 total, 8 up, 8 in 2024-01-13T18:06:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:17 smithi084 ceph-mon[119097]: failed to encode map e395 with expected crc 2024-01-13T18:06:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:17 smithi084 ceph-mon[119097]: failed to encode map e395 with expected crc 2024-01-13T18:06:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:17 smithi084 ceph-mon[119097]: osdmap e396: 8 total, 8 up, 8 in 2024-01-13T18:06:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:17 smithi099 ceph-mon[138788]: failed to encode map e395 with expected crc 2024-01-13T18:06:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:17 smithi099 ceph-mon[138788]: failed to encode map e395 with expected crc 2024-01-13T18:06:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:17 smithi099 ceph-mon[138788]: osdmap e396: 8 total, 8 up, 8 in 2024-01-13T18:06:18.621 INFO:tasks.rados.rados.0.smithi084.stdout:1644: done (0 left) 2024-01-13T18:06:18.621 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 164 2024-01-13T18:06:18.622 INFO:tasks.rados.rados.0.smithi084.stdout:1645: seq_num 512 ranges {1269760=581632,1851392=516096,2367488=286720} 2024-01-13T18:06:18.632 INFO:tasks.rados.rados.0.smithi084.stdout:1645: writing smithi084102331-23 from 1269760 to 1851392 tid 1 2024-01-13T18:06:18.634 INFO:tasks.rados.rados.0.smithi084.stdout:1645: writing smithi084102331-23 from 1851392 to 2367488 tid 2 2024-01-13T18:06:18.636 INFO:tasks.rados.rados.0.smithi084.stdout:1645: writing smithi084102331-23 from 2367488 to 2654208 tid 3 2024-01-13T18:06:18.636 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 164 2024-01-13T18:06:18.637 INFO:tasks.rados.rados.0.smithi084.stdout:1646: seq_num 513 ranges {2228224=598016,2826240=794624,3620864=8192} 2024-01-13T18:06:18.652 INFO:tasks.rados.rados.0.smithi084.stdout:1646: writing smithi084102331-1 from 2228224 to 2826240 tid 1 2024-01-13T18:06:18.657 INFO:tasks.rados.rados.0.smithi084.stdout:1646: writing smithi084102331-1 from 2826240 to 3620864 tid 2 2024-01-13T18:06:18.657 INFO:tasks.rados.rados.0.smithi084.stdout:1646: writing smithi084102331-1 from 3620864 to 3629056 tid 3 2024-01-13T18:06:18.657 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 164 2024-01-13T18:06:18.657 INFO:tasks.rados.rados.0.smithi084.stdout:1645: finishing write tid 1 to smithi084102331-23 2024-01-13T18:06:18.657 INFO:tasks.rados.rados.0.smithi084.stdout:1647: seq_num 514 ranges {6496256=614400,7110656=679936,7790592=122880} 2024-01-13T18:06:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:18 smithi084 ceph-mon[116404]: failed to encode map e396 with expected crc 2024-01-13T18:06:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:18 smithi084 ceph-mon[116404]: failed to encode map e396 with expected crc 2024-01-13T18:06:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:18 smithi084 ceph-mon[116404]: osdmap e397: 8 total, 8 up, 8 in 2024-01-13T18:06:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:18 smithi084 ceph-mon[116404]: pgmap v307: 121 pgs: 121 active+clean; 194 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 19 op/s 2024-01-13T18:06:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:18 smithi084 ceph-mon[119097]: failed to encode map e396 with expected crc 2024-01-13T18:06:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:18 smithi084 ceph-mon[119097]: failed to encode map e396 with expected crc 2024-01-13T18:06:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:18 smithi084 ceph-mon[119097]: osdmap e397: 8 total, 8 up, 8 in 2024-01-13T18:06:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:18 smithi084 ceph-mon[119097]: pgmap v307: 121 pgs: 121 active+clean; 194 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 19 op/s 2024-01-13T18:06:18.695 INFO:tasks.rados.rados.0.smithi084.stdout:1647: writing smithi084102331-32 from 6496256 to 7110656 tid 1 2024-01-13T18:06:18.698 INFO:tasks.rados.rados.0.smithi084.stdout:1647: writing smithi084102331-32 from 7110656 to 7790592 tid 2 2024-01-13T18:06:18.699 INFO:tasks.rados.rados.0.smithi084.stdout:1647: writing smithi084102331-32 from 7790592 to 7913472 tid 3 2024-01-13T18:06:18.699 INFO:tasks.rados.rados.0.smithi084.stdout:1648: rollback oid 41 current snap is 164 2024-01-13T18:06:18.699 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 163 2024-01-13T18:06:18.699 INFO:tasks.rados.rados.0.smithi084.stdout:1645: finishing write tid 2 to smithi084102331-23 2024-01-13T18:06:18.700 INFO:tasks.rados.rados.0.smithi084.stdout:1645: finishing write tid 3 to smithi084102331-23 2024-01-13T18:06:18.700 INFO:tasks.rados.rados.0.smithi084.stdout:1649: snap_remove snap 148 2024-01-13T18:06:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:18 smithi099 ceph-mon[138788]: failed to encode map e396 with expected crc 2024-01-13T18:06:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:18 smithi099 ceph-mon[138788]: failed to encode map e396 with expected crc 2024-01-13T18:06:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:18 smithi099 ceph-mon[138788]: osdmap e397: 8 total, 8 up, 8 in 2024-01-13T18:06:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:18 smithi099 ceph-mon[138788]: pgmap v307: 121 pgs: 121 active+clean; 194 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 19 op/s 2024-01-13T18:06:18.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:06:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:06:18.659Z caller=alerting.go:366 level=warn component="rule manager" alert="unsupported value type" msg="Expanding alert template failed" err="error executing template __alert_CephOSDDown: template: __alert_CephOSDDown:1:358: executing \"__alert_CephOSDDown\" at : error calling query: found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" data="unsupported value type" 2024-01-13T18:06:18.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:06:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:06:18.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:06:19.630 INFO:tasks.rados.rados.0.smithi084.stdout:1649: done (4 left) 2024-01-13T18:06:19.630 INFO:tasks.rados.rados.0.smithi084.stdout:1650: snap_remove snap 162 2024-01-13T18:06:19.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:19 smithi084 ceph-mon[116404]: failed to encode map e397 with expected crc 2024-01-13T18:06:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:19 smithi084 ceph-mon[116404]: failed to encode map e397 with expected crc 2024-01-13T18:06:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:19 smithi084 ceph-mon[116404]: failed to encode map e398 with expected crc 2024-01-13T18:06:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:19 smithi084 ceph-mon[116404]: osdmap e398: 8 total, 8 up, 8 in 2024-01-13T18:06:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:19 smithi084 ceph-mon[119097]: failed to encode map e397 with expected crc 2024-01-13T18:06:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:19 smithi084 ceph-mon[119097]: failed to encode map e397 with expected crc 2024-01-13T18:06:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:19 smithi084 ceph-mon[119097]: failed to encode map e398 with expected crc 2024-01-13T18:06:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:19 smithi084 ceph-mon[119097]: osdmap e398: 8 total, 8 up, 8 in 2024-01-13T18:06:19.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:19 smithi099 ceph-mon[138788]: failed to encode map e397 with expected crc 2024-01-13T18:06:19.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:19 smithi099 ceph-mon[138788]: failed to encode map e397 with expected crc 2024-01-13T18:06:19.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:19 smithi099 ceph-mon[138788]: failed to encode map e398 with expected crc 2024-01-13T18:06:19.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:19 smithi099 ceph-mon[138788]: osdmap e398: 8 total, 8 up, 8 in 2024-01-13T18:06:20.639 INFO:tasks.rados.rados.0.smithi084.stdout:1650: done (4 left) 2024-01-13T18:06:20.639 INFO:tasks.rados.rados.0.smithi084.stdout:1651: read oid 30 snap 163 2024-01-13T18:06:20.639 INFO:tasks.rados.rados.0.smithi084.stdout:1651: expect (ObjNum 506 snap 162 seq_num 506) 2024-01-13T18:06:20.640 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 164 2024-01-13T18:06:20.640 INFO:tasks.rados.rados.0.smithi084.stdout:1645: finishing write tid 4 to smithi084102331-23 2024-01-13T18:06:20.640 INFO:tasks.rados.rados.0.smithi084.stdout:1645: finishing write tid 5 to smithi084102331-23 2024-01-13T18:06:20.640 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 865 (ObjNum 512 snap 164 seq_num 512) dirty exists 2024-01-13T18:06:20.640 INFO:tasks.rados.rados.0.smithi084.stdout:1645: left oid 23 (ObjNum 512 snap 164 seq_num 512) 2024-01-13T18:06:20.640 INFO:tasks.rados.rados.0.smithi084.stdout:1646: finishing write tid 1 to smithi084102331-1 2024-01-13T18:06:20.640 INFO:tasks.rados.rados.0.smithi084.stdout:1652: seq_num 515 ranges {7454720=630784,8085504=565248,8650752=237568} 2024-01-13T18:06:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:06:20] "GET /metrics HTTP/1.1" 200 36196 "" "Prometheus/2.43.0" 2024-01-13T18:06:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[116404]: failed to encode map e398 with expected crc 2024-01-13T18:06:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[116404]: failed to encode map e399 with expected crc 2024-01-13T18:06:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[116404]: osdmap e399: 8 total, 8 up, 8 in 2024-01-13T18:06:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[116404]: pgmap v310: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 194 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 14 op/s 2024-01-13T18:06:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[119097]: failed to encode map e398 with expected crc 2024-01-13T18:06:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[119097]: failed to encode map e399 with expected crc 2024-01-13T18:06:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[119097]: osdmap e399: 8 total, 8 up, 8 in 2024-01-13T18:06:20.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[119097]: pgmap v310: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 194 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 14 op/s 2024-01-13T18:06:20.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:20.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:20.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:20.682 INFO:tasks.rados.rados.0.smithi084.stdout:1652: writing smithi084102331-50 from 7454720 to 8085504 tid 1 2024-01-13T18:06:20.686 INFO:tasks.rados.rados.0.smithi084.stdout:1652: writing smithi084102331-50 from 8085504 to 8650752 tid 2 2024-01-13T18:06:20.688 INFO:tasks.rados.rados.0.smithi084.stdout:1652: writing smithi084102331-50 from 8650752 to 8888320 tid 3 2024-01-13T18:06:20.688 INFO:tasks.rados.rados.0.smithi084.stdout:1645: done (5 left) 2024-01-13T18:06:20.688 INFO:tasks.rados.rados.0.smithi084.stdout:1653: delete oid 34 current snap is 164 2024-01-13T18:06:20.688 INFO:tasks.rados.rados.0.smithi084.stdout:1646: finishing write tid 2 to smithi084102331-1 2024-01-13T18:06:20.688 INFO:tasks.rados.rados.0.smithi084.stdout:1646: finishing write tid 3 to smithi084102331-1 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1646: finishing write tid 4 to smithi084102331-1 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1646: finishing write tid 5 to smithi084102331-1 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 988 (ObjNum 513 snap 164 seq_num 513) dirty exists 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1646: left oid 1 (ObjNum 513 snap 164 seq_num 513) 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1647: finishing write tid 1 to smithi084102331-32 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1648: finishing rollback tid 0 to smithi084102331-41 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1648: finishing rollback tid 1 to smithi084102331-41 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1648: finishing rollback tid 2 to smithi084102331-41 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 607 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1647: finishing write tid 2 to smithi084102331-32 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1647: finishing write tid 3 to smithi084102331-32 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1647: finishing write tid 4 to smithi084102331-32 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1647: finishing write tid 5 to smithi084102331-32 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 888 (ObjNum 514 snap 164 seq_num 514) dirty exists 2024-01-13T18:06:20.689 INFO:tasks.rados.rados.0.smithi084.stdout:1647: left oid 32 (ObjNum 514 snap 164 seq_num 514) 2024-01-13T18:06:20.690 INFO:tasks.rados.rados.0.smithi084.stdout:1651: expect (ObjNum 506 snap 162 seq_num 506) 2024-01-13T18:06:20.722 INFO:tasks.rados.rados.0.smithi084.stdout:1652: finishing write tid 1 to smithi084102331-50 2024-01-13T18:06:20.723 INFO:tasks.rados.rados.0.smithi084.stdout:1652: finishing write tid 2 to smithi084102331-50 2024-01-13T18:06:20.723 INFO:tasks.rados.rados.0.smithi084.stdout:1646: done (5 left) 2024-01-13T18:06:20.723 INFO:tasks.rados.rados.0.smithi084.stdout:1647: done (4 left) 2024-01-13T18:06:20.723 INFO:tasks.rados.rados.0.smithi084.stdout:1648: done (3 left) 2024-01-13T18:06:20.723 INFO:tasks.rados.rados.0.smithi084.stdout:1651: done (2 left) 2024-01-13T18:06:20.723 INFO:tasks.rados.rados.0.smithi084.stdout:1653: done (1 left) 2024-01-13T18:06:20.723 INFO:tasks.rados.rados.0.smithi084.stdout:1654: read oid 15 snap -1 2024-01-13T18:06:20.723 INFO:tasks.rados.rados.0.smithi084.stdout:1654: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:06:20.723 INFO:tasks.rados.rados.0.smithi084.stdout:1655: read oid 39 snap -1 2024-01-13T18:06:20.723 INFO:tasks.rados.rados.0.smithi084.stdout:1655: expect deleted 2024-01-13T18:06:20.723 INFO:tasks.rados.rados.0.smithi084.stdout:1656: snap_remove snap 163 2024-01-13T18:06:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:20 smithi099 ceph-mon[138788]: failed to encode map e398 with expected crc 2024-01-13T18:06:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:20 smithi099 ceph-mon[138788]: failed to encode map e399 with expected crc 2024-01-13T18:06:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:20 smithi099 ceph-mon[138788]: osdmap e399: 8 total, 8 up, 8 in 2024-01-13T18:06:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:20 smithi099 ceph-mon[138788]: pgmap v310: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 194 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 14 op/s 2024-01-13T18:06:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:21.638 INFO:tasks.rados.rados.0.smithi084.stdout:1656: done (3 left) 2024-01-13T18:06:21.638 INFO:tasks.rados.rados.0.smithi084.stdout:1657: setattr oid 4 current snap is 164 2024-01-13T18:06:21.638 INFO:tasks.rados.rados.0.smithi084.stdout:1652: finishing write tid 3 to smithi084102331-50 2024-01-13T18:06:21.638 INFO:tasks.rados.rados.0.smithi084.stdout:1652: finishing write tid 4 to smithi084102331-50 2024-01-13T18:06:21.638 INFO:tasks.rados.rados.0.smithi084.stdout:1652: finishing write tid 5 to smithi084102331-50 2024-01-13T18:06:21.638 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 841 (ObjNum 515 snap 164 seq_num 515) dirty exists 2024-01-13T18:06:21.638 INFO:tasks.rados.rados.0.smithi084.stdout:1652: left oid 50 (ObjNum 515 snap 164 seq_num 515) 2024-01-13T18:06:21.638 INFO:tasks.rados.rados.0.smithi084.stdout:1654: expect (ObjNum 228 snap 69 seq_num 228) 2024-01-13T18:06:21.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:21 smithi084 ceph-mon[116404]: failed to encode map e399 with expected crc 2024-01-13T18:06:21.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:21 smithi084 ceph-mon[116404]: failed to encode map e400 with expected crc 2024-01-13T18:06:21.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:21 smithi084 ceph-mon[116404]: osdmap e400: 8 total, 8 up, 8 in 2024-01-13T18:06:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:21 smithi084 ceph-mon[119097]: failed to encode map e399 with expected crc 2024-01-13T18:06:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:21 smithi084 ceph-mon[119097]: failed to encode map e400 with expected crc 2024-01-13T18:06:21.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:21 smithi084 ceph-mon[119097]: osdmap e400: 8 total, 8 up, 8 in 2024-01-13T18:06:21.680 INFO:tasks.rados.rados.0.smithi084.stdout:1652: done (3 left) 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1654: done (2 left) 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1655: done (1 left) 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1658: rollback oid 3 current snap is 164 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1658: done (1 left) 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1659: read oid 14 snap -1 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1659: expect (ObjNum 437 snap 137 seq_num 437) 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1660: read oid 50 snap -1 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1660: expect (ObjNum 515 snap 164 seq_num 515) 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1661: read oid 8 snap -1 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1661: expect (ObjNum 403 snap 128 seq_num 403) 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1662: rmattr oid 31 current snap is 164 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1663: read oid 44 snap -1 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1663: expect deleted 2024-01-13T18:06:21.681 INFO:tasks.rados.rados.0.smithi084.stdout:1664: snap_create 2024-01-13T18:06:21.683 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1001 (ObjNum 424 snap 135 seq_num 424) dirty exists 2024-01-13T18:06:21.684 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 629 (ObjNum 511 snap 163 seq_num 511) dirty exists 2024-01-13T18:06:21.689 INFO:tasks.rados.rados.0.smithi084.stdout:1659: expect (ObjNum 437 snap 137 seq_num 437) 2024-01-13T18:06:21.789 INFO:tasks.rados.rados.0.smithi084.stdout:1661: expect (ObjNum 403 snap 128 seq_num 403) 2024-01-13T18:06:21.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:21 smithi099 ceph-mon[138788]: failed to encode map e399 with expected crc 2024-01-13T18:06:21.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:21 smithi099 ceph-mon[138788]: failed to encode map e400 with expected crc 2024-01-13T18:06:21.872 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:21 smithi099 ceph-mon[138788]: osdmap e400: 8 total, 8 up, 8 in 2024-01-13T18:06:22.165 INFO:tasks.rados.rados.0.smithi084.stdout:1660: expect (ObjNum 515 snap 164 seq_num 515) 2024-01-13T18:06:22.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:22 smithi084 ceph-mon[116404]: failed to encode map e400 with expected crc 2024-01-13T18:06:22.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:22 smithi084 ceph-mon[116404]: failed to encode map e401 with expected crc 2024-01-13T18:06:22.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:22 smithi084 ceph-mon[116404]: osdmap e401: 8 total, 8 up, 8 in 2024-01-13T18:06:22.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:22 smithi084 ceph-mon[116404]: failed to encode map e401 with expected crc 2024-01-13T18:06:22.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:22 smithi084 ceph-mon[116404]: pgmap v313: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 152 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 1.3 MiB/s wr, 21 op/s 2024-01-13T18:06:22.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:22 smithi084 ceph-mon[119097]: failed to encode map e400 with expected crc 2024-01-13T18:06:22.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:22 smithi084 ceph-mon[119097]: failed to encode map e401 with expected crc 2024-01-13T18:06:22.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:22 smithi084 ceph-mon[119097]: osdmap e401: 8 total, 8 up, 8 in 2024-01-13T18:06:22.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:22 smithi084 ceph-mon[119097]: failed to encode map e401 with expected crc 2024-01-13T18:06:22.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:22 smithi084 ceph-mon[119097]: pgmap v313: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 152 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 1.3 MiB/s wr, 21 op/s 2024-01-13T18:06:22.839 INFO:tasks.rados.rados.0.smithi084.stdout:1657: done (6 left) 2024-01-13T18:06:22.839 INFO:tasks.rados.rados.0.smithi084.stdout:1659: done (5 left) 2024-01-13T18:06:22.840 INFO:tasks.rados.rados.0.smithi084.stdout:1660: done (4 left) 2024-01-13T18:06:22.840 INFO:tasks.rados.rados.0.smithi084.stdout:1661: done (3 left) 2024-01-13T18:06:22.840 INFO:tasks.rados.rados.0.smithi084.stdout:1662: done (2 left) 2024-01-13T18:06:22.840 INFO:tasks.rados.rados.0.smithi084.stdout:1663: done (1 left) 2024-01-13T18:06:22.840 INFO:tasks.rados.rados.0.smithi084.stdout:1664: done (0 left) 2024-01-13T18:06:22.840 INFO:tasks.rados.rados.0.smithi084.stdout:1665: setattr oid 18 current snap is 165 2024-01-13T18:06:22.841 INFO:tasks.rados.rados.0.smithi084.stdout:1666: setattr oid 47 current snap is 165 2024-01-13T18:06:22.843 INFO:tasks.rados.rados.0.smithi084.stdout:1667: delete oid 41 current snap is 165 2024-01-13T18:06:22.845 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 387 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-01-13T18:06:22.847 INFO:tasks.rados.rados.0.smithi084.stdout:1665: done (2 left) 2024-01-13T18:06:22.847 INFO:tasks.rados.rados.0.smithi084.stdout:1667: done (1 left) 2024-01-13T18:06:22.847 INFO:tasks.rados.rados.0.smithi084.stdout:1668: snap_create 2024-01-13T18:06:22.848 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 900 (ObjNum 286 snap 89 seq_num 286) dirty exists 2024-01-13T18:06:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:22 smithi099 ceph-mon[138788]: failed to encode map e400 with expected crc 2024-01-13T18:06:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:22 smithi099 ceph-mon[138788]: failed to encode map e401 with expected crc 2024-01-13T18:06:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:22 smithi099 ceph-mon[138788]: osdmap e401: 8 total, 8 up, 8 in 2024-01-13T18:06:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:22 smithi099 ceph-mon[138788]: failed to encode map e401 with expected crc 2024-01-13T18:06:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:22 smithi099 ceph-mon[138788]: pgmap v313: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 152 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 1.3 MiB/s wr, 21 op/s 2024-01-13T18:06:23.643 INFO:tasks.rados.rados.0.smithi084.stdout:1666: done (1 left) 2024-01-13T18:06:23.643 INFO:tasks.rados.rados.0.smithi084.stdout:1668: done (0 left) 2024-01-13T18:06:23.644 INFO:tasks.rados.rados.0.smithi084.stdout:1669: copy_from oid 49 from oid 48 current snap is 166 2024-01-13T18:06:23.645 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 166 2024-01-13T18:06:23.645 INFO:tasks.rados.rados.0.smithi084.stdout:1670: seq_num 518 ranges {1425408=679936,2105344=671744,2777088=131072} 2024-01-13T18:06:23.655 INFO:tasks.rados.rados.0.smithi084.stdout:1670: writing smithi084102331-15 from 1425408 to 2105344 tid 1 2024-01-13T18:06:23.659 INFO:tasks.rados.rados.0.smithi084.stdout:1670: writing smithi084102331-15 from 2105344 to 2777088 tid 2 2024-01-13T18:06:23.660 INFO:tasks.rados.rados.0.smithi084.stdout:1670: writing smithi084102331-15 from 2777088 to 2908160 tid 3 2024-01-13T18:06:23.660 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 166 2024-01-13T18:06:23.660 INFO:tasks.rados.rados.0.smithi084.stdout:1671: seq_num 519 ranges {1966080=696320,2662400=548864,3211264=253952} 2024-01-13T18:06:23.675 INFO:tasks.rados.rados.0.smithi084.stdout:1671: writing smithi084102331-17 from 1966080 to 2662400 tid 1 2024-01-13T18:06:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:23 smithi084 ceph-mon[119097]: failed to encode map e401 with expected crc 2024-01-13T18:06:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:23 smithi084 ceph-mon[119097]: failed to encode map e402 with expected crc 2024-01-13T18:06:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:23 smithi084 ceph-mon[119097]: osdmap e402: 8 total, 8 up, 8 in 2024-01-13T18:06:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:23 smithi084 ceph-mon[116404]: failed to encode map e401 with expected crc 2024-01-13T18:06:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:23 smithi084 ceph-mon[116404]: failed to encode map e402 with expected crc 2024-01-13T18:06:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:23 smithi084 ceph-mon[116404]: osdmap e402: 8 total, 8 up, 8 in 2024-01-13T18:06:23.679 INFO:tasks.rados.rados.0.smithi084.stdout:1671: writing smithi084102331-17 from 2662400 to 3211264 tid 2 2024-01-13T18:06:23.681 INFO:tasks.rados.rados.0.smithi084.stdout:1671: writing smithi084102331-17 from 3211264 to 3465216 tid 3 2024-01-13T18:06:23.681 INFO:tasks.rados.rados.0.smithi084.stdout:1672: rollback oid 28 current snap is 166 2024-01-13T18:06:23.681 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 28 to 165 2024-01-13T18:06:23.681 INFO:tasks.rados.rados.0.smithi084.stdout:1670: finishing write tid 1 to smithi084102331-15 2024-01-13T18:06:23.681 INFO:tasks.rados.rados.0.smithi084.stdout:1670: finishing write tid 2 to smithi084102331-15 2024-01-13T18:06:23.681 INFO:tasks.rados.rados.0.smithi084.stdout:1670: finishing write tid 3 to smithi084102331-15 2024-01-13T18:06:23.681 INFO:tasks.rados.rados.0.smithi084.stdout:1670: finishing write tid 4 to smithi084102331-15 2024-01-13T18:06:23.682 INFO:tasks.rados.rados.0.smithi084.stdout:1670: finishing write tid 5 to smithi084102331-15 2024-01-13T18:06:23.682 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 905 (ObjNum 518 snap 166 seq_num 518) dirty exists 2024-01-13T18:06:23.682 INFO:tasks.rados.rados.0.smithi084.stdout:1670: left oid 15 (ObjNum 518 snap 166 seq_num 518) 2024-01-13T18:06:23.682 INFO:tasks.rados.rados.0.smithi084.stdout:1669: finishing copy_from to smithi084102331-49 2024-01-13T18:06:23.682 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 801 (ObjNum 499 snap 161 seq_num 499) dirty exists 2024-01-13T18:06:23.682 INFO:tasks.rados.rados.0.smithi084.stdout:1669: finishing copy_from racing read to smithi084102331-49 2024-01-13T18:06:23.682 INFO:tasks.rados.rados.0.smithi084.stdout:1671: finishing write tid 1 to smithi084102331-17 2024-01-13T18:06:23.682 INFO:tasks.rados.rados.0.smithi084.stdout:1669: done (3 left) 2024-01-13T18:06:23.682 INFO:tasks.rados.rados.0.smithi084.stdout:1670: done (2 left) 2024-01-13T18:06:23.682 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 166 2024-01-13T18:06:23.682 INFO:tasks.rados.rados.0.smithi084.stdout:1673: seq_num 520 ranges {9027584=712704,9740288=434176,10174464=368640} 2024-01-13T18:06:23.733 INFO:tasks.rados.rados.0.smithi084.stdout:1673: writing smithi084102331-2 from 9027584 to 9740288 tid 1 2024-01-13T18:06:23.735 INFO:tasks.rados.rados.0.smithi084.stdout:1673: writing smithi084102331-2 from 9740288 to 10174464 tid 2 2024-01-13T18:06:23.737 INFO:tasks.rados.rados.0.smithi084.stdout:1673: writing smithi084102331-2 from 10174464 to 10543104 tid 3 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:1674: delete oid 47 current snap is 166 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:1671: finishing write tid 2 to smithi084102331-17 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:1671: finishing write tid 3 to smithi084102331-17 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:1671: finishing write tid 4 to smithi084102331-17 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:1672: finishing rollback tid 0 to smithi084102331-28 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:1672: finishing rollback tid 1 to smithi084102331-28 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:1671: finishing write tid 5 to smithi084102331-17 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 634 (ObjNum 519 snap 166 seq_num 519) dirty exists 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:1671: left oid 17 (ObjNum 519 snap 166 seq_num 519) 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:1672: finishing rollback tid 2 to smithi084102331-28 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 505 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:1673: finishing write tid 1 to smithi084102331-2 2024-01-13T18:06:23.738 INFO:tasks.rados.rados.0.smithi084.stdout:1673: finishing write tid 2 to smithi084102331-2 2024-01-13T18:06:23.741 INFO:tasks.rados.rados.0.smithi084.stdout:1673: finishing write tid 3 to smithi084102331-2 2024-01-13T18:06:23.741 INFO:tasks.rados.rados.0.smithi084.stdout:1671: done (3 left) 2024-01-13T18:06:23.741 INFO:tasks.rados.rados.0.smithi084.stdout:1672: done (2 left) 2024-01-13T18:06:23.741 INFO:tasks.rados.rados.0.smithi084.stdout:1674: done (1 left) 2024-01-13T18:06:23.741 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 166 2024-01-13T18:06:23.741 INFO:tasks.rados.rados.0.smithi084.stdout:1673: finishing write tid 4 to smithi084102331-2 2024-01-13T18:06:23.741 INFO:tasks.rados.rados.0.smithi084.stdout:1675: seq_num 522 ranges {0=745472,745472=606208,1351680=196608} 2024-01-13T18:06:23.745 INFO:tasks.rados.rados.0.smithi084.stdout:1675: writing smithi084102331-44 from 0 to 745472 tid 1 2024-01-13T18:06:23.748 INFO:tasks.rados.rados.0.smithi084.stdout:1675: writing smithi084102331-44 from 745472 to 1351680 tid 2 2024-01-13T18:06:23.750 INFO:tasks.rados.rados.0.smithi084.stdout:1675: writing smithi084102331-44 from 1351680 to 1548288 tid 3 2024-01-13T18:06:23.750 INFO:tasks.rados.rados.0.smithi084.stdout:1676: read oid 20 snap -1 2024-01-13T18:06:23.750 INFO:tasks.rados.rados.0.smithi084.stdout:1676: expect deleted 2024-01-13T18:06:23.750 INFO:tasks.rados.rados.0.smithi084.stdout:1677: snap_create 2024-01-13T18:06:23.750 INFO:tasks.rados.rados.0.smithi084.stdout:1673: finishing write tid 5 to smithi084102331-2 2024-01-13T18:06:23.750 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 882 (ObjNum 520 snap 166 seq_num 520) dirty exists 2024-01-13T18:06:23.750 INFO:tasks.rados.rados.0.smithi084.stdout:1673: left oid 2 (ObjNum 520 snap 166 seq_num 520) 2024-01-13T18:06:23.750 INFO:tasks.rados.rados.0.smithi084.stdout:1675: finishing write tid 1 to smithi084102331-44 2024-01-13T18:06:23.752 INFO:tasks.rados.rados.0.smithi084.stdout:1675: finishing write tid 2 to smithi084102331-44 2024-01-13T18:06:23.752 INFO:tasks.rados.rados.0.smithi084.stdout:1675: finishing write tid 3 to smithi084102331-44 2024-01-13T18:06:23.752 INFO:tasks.rados.rados.0.smithi084.stdout:1675: finishing write tid 4 to smithi084102331-44 2024-01-13T18:06:23.753 INFO:tasks.rados.rados.0.smithi084.stdout:1675: finishing write tid 5 to smithi084102331-44 2024-01-13T18:06:23.753 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 911 (ObjNum 522 snap 166 seq_num 522) dirty exists 2024-01-13T18:06:23.753 INFO:tasks.rados.rados.0.smithi084.stdout:1675: left oid 44 (ObjNum 522 snap 166 seq_num 522) 2024-01-13T18:06:23.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:23 smithi099 ceph-mon[138788]: failed to encode map e401 with expected crc 2024-01-13T18:06:23.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:23 smithi099 ceph-mon[138788]: failed to encode map e402 with expected crc 2024-01-13T18:06:23.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:23 smithi099 ceph-mon[138788]: osdmap e402: 8 total, 8 up, 8 in 2024-01-13T18:06:24.487 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:24 smithi099 ceph-mon[138788]: failed to encode map e402 with expected crc 2024-01-13T18:06:24.488 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:24 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:24.488 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:24 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:24.488 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:24 smithi099 ceph-mon[138788]: Upgrade: osd.6 is safe to restart 2024-01-13T18:06:24.488 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:24 smithi099 ceph-mon[138788]: osdmap e403: 8 total, 8 up, 8 in 2024-01-13T18:06:24.488 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:24 smithi099 ceph-mon[138788]: failed to encode map e403 with expected crc 2024-01-13T18:06:24.488 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:24 smithi099 ceph-mon[138788]: pgmap v316: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2024-01-13T18:06:24.649 INFO:tasks.rados.rados.0.smithi084.stdout:1673: done (3 left) 2024-01-13T18:06:24.649 INFO:tasks.rados.rados.0.smithi084.stdout:1675: done (2 left) 2024-01-13T18:06:24.649 INFO:tasks.rados.rados.0.smithi084.stdout:1676: done (1 left) 2024-01-13T18:06:24.650 INFO:tasks.rados.rados.0.smithi084.stdout:1677: done (0 left) 2024-01-13T18:06:24.650 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 167 2024-01-13T18:06:24.650 INFO:tasks.rados.rados.0.smithi084.stdout:1678: seq_num 523 ranges {1179648=770048,1949696=491520,2441216=311296} 2024-01-13T18:06:24.659 INFO:tasks.rados.rados.0.smithi084.stdout:1678: writing smithi084102331-27 from 1179648 to 1949696 tid 1 2024-01-13T18:06:24.662 INFO:tasks.rados.rados.0.smithi084.stdout:1678: writing smithi084102331-27 from 1949696 to 2441216 tid 2 2024-01-13T18:06:24.664 INFO:tasks.rados.rados.0.smithi084.stdout:1678: writing smithi084102331-27 from 2441216 to 2752512 tid 3 2024-01-13T18:06:24.665 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 167 2024-01-13T18:06:24.665 INFO:tasks.rados.rados.0.smithi084.stdout:1679: seq_num 524 ranges {2908160=786432,3694592=778240,4472832=24576} 2024-01-13T18:06:24.685 INFO:tasks.rados.rados.0.smithi084.stdout:1679: writing smithi084102331-15 from 2908160 to 3694592 tid 1 2024-01-13T18:06:24.690 INFO:tasks.rados.rados.0.smithi084.stdout:1679: writing smithi084102331-15 from 3694592 to 4472832 tid 2 2024-01-13T18:06:24.690 INFO:tasks.rados.rados.0.smithi084.stdout:1679: writing smithi084102331-15 from 4472832 to 4497408 tid 3 2024-01-13T18:06:24.690 INFO:tasks.rados.rados.0.smithi084.stdout:1680: read oid 29 snap -1 2024-01-13T18:06:24.690 INFO:tasks.rados.rados.0.smithi084.stdout:1680: expect (ObjNum 487 snap 153 seq_num 487) 2024-01-13T18:06:24.690 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 167 2024-01-13T18:06:24.690 INFO:tasks.rados.rados.0.smithi084.stdout:1678: finishing write tid 1 to smithi084102331-27 2024-01-13T18:06:24.690 INFO:tasks.rados.rados.0.smithi084.stdout:1681: seq_num 525 ranges {9379840=802816,10182656=712704,10895360=90112} 2024-01-13T18:06:24.744 INFO:tasks.rados.rados.0.smithi084.stdout:1681: writing smithi084102331-31 from 9379840 to 10182656 tid 1 2024-01-13T18:06:24.748 INFO:tasks.rados.rados.0.smithi084.stdout:1681: writing smithi084102331-31 from 10182656 to 10895360 tid 2 2024-01-13T18:06:24.749 INFO:tasks.rados.rados.0.smithi084.stdout:1681: writing smithi084102331-31 from 10895360 to 10985472 tid 3 2024-01-13T18:06:24.749 INFO:tasks.rados.rados.0.smithi084.stdout:1682: read oid 35 snap -1 2024-01-13T18:06:24.749 INFO:tasks.rados.rados.0.smithi084.stdout:1682: expect deleted 2024-01-13T18:06:24.749 INFO:tasks.rados.rados.0.smithi084.stdout:1683: delete oid 23 current snap is 167 2024-01-13T18:06:24.749 INFO:tasks.rados.rados.0.smithi084.stdout:1678: finishing write tid 2 to smithi084102331-27 2024-01-13T18:06:24.749 INFO:tasks.rados.rados.0.smithi084.stdout:1678: finishing write tid 3 to smithi084102331-27 2024-01-13T18:06:24.749 INFO:tasks.rados.rados.0.smithi084.stdout:1678: finishing write tid 4 to smithi084102331-27 2024-01-13T18:06:24.749 INFO:tasks.rados.rados.0.smithi084.stdout:1678: finishing write tid 5 to smithi084102331-27 2024-01-13T18:06:24.749 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 509 (ObjNum 523 snap 167 seq_num 523) dirty exists 2024-01-13T18:06:24.749 INFO:tasks.rados.rados.0.smithi084.stdout:1678: left oid 27 (ObjNum 523 snap 167 seq_num 523) 2024-01-13T18:06:24.749 INFO:tasks.rados.rados.0.smithi084.stdout:1679: finishing write tid 1 to smithi084102331-15 2024-01-13T18:06:24.750 INFO:tasks.rados.rados.0.smithi084.stdout:1679: finishing write tid 2 to smithi084102331-15 2024-01-13T18:06:24.750 INFO:tasks.rados.rados.0.smithi084.stdout:1679: finishing write tid 3 to smithi084102331-15 2024-01-13T18:06:24.750 INFO:tasks.rados.rados.0.smithi084.stdout:1680: expect (ObjNum 487 snap 153 seq_num 487) 2024-01-13T18:06:24.772 INFO:tasks.rados.rados.0.smithi084.stdout:1679: finishing write tid 4 to smithi084102331-15 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:1679: finishing write tid 5 to smithi084102331-15 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 916 (ObjNum 524 snap 167 seq_num 524) dirty exists 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:1679: left oid 15 (ObjNum 524 snap 167 seq_num 524) 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:1681: finishing write tid 1 to smithi084102331-31 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:1678: done (5 left) 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:1679: done (4 left) 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:1680: done (3 left) 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:1682: done (2 left) 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:1683: done (1 left) 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 167 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:1681: finishing write tid 2 to smithi084102331-31 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:1681: finishing write tid 3 to smithi084102331-31 2024-01-13T18:06:24.773 INFO:tasks.rados.rados.0.smithi084.stdout:1681: finishing write tid 4 to smithi084102331-31 2024-01-13T18:06:24.774 INFO:tasks.rados.rados.0.smithi084.stdout:1681: finishing write tid 5 to smithi084102331-31 2024-01-13T18:06:24.774 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1006 (ObjNum 525 snap 167 seq_num 525) dirty exists 2024-01-13T18:06:24.774 INFO:tasks.rados.rados.0.smithi084.stdout:1681: left oid 31 (ObjNum 525 snap 167 seq_num 525) 2024-01-13T18:06:24.774 INFO:tasks.rados.rados.0.smithi084.stdout:1684: seq_num 527 ranges {7454720=434176,7888896=475136,8364032=565248,8929280=163840} 2024-01-13T18:06:24.813 INFO:tasks.rados.rados.0.smithi084.stdout:1684: writing smithi084102331-12 from 7454720 to 7888896 tid 1 2024-01-13T18:06:24.816 INFO:tasks.rados.rados.0.smithi084.stdout:1684: writing smithi084102331-12 from 7888896 to 8364032 tid 2 2024-01-13T18:06:24.819 INFO:tasks.rados.rados.0.smithi084.stdout:1684: writing smithi084102331-12 from 8364032 to 8929280 tid 3 2024-01-13T18:06:24.820 INFO:tasks.rados.rados.0.smithi084.stdout:1684: writing smithi084102331-12 from 8929280 to 9093120 tid 4 2024-01-13T18:06:24.821 INFO:tasks.rados.rados.0.smithi084.stdout:1681: done (1 left) 2024-01-13T18:06:24.821 INFO:tasks.rados.rados.0.smithi084.stdout:1685: snap_remove snap 164 2024-01-13T18:06:24.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[119097]: failed to encode map e402 with expected crc 2024-01-13T18:06:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[119097]: Upgrade: osd.6 is safe to restart 2024-01-13T18:06:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[119097]: osdmap e403: 8 total, 8 up, 8 in 2024-01-13T18:06:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[119097]: failed to encode map e403 with expected crc 2024-01-13T18:06:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[119097]: pgmap v316: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2024-01-13T18:06:24.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[116404]: failed to encode map e402 with expected crc 2024-01-13T18:06:24.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:24.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-01-13T18:06:24.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[116404]: Upgrade: osd.6 is safe to restart 2024-01-13T18:06:24.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[116404]: osdmap e403: 8 total, 8 up, 8 in 2024-01-13T18:06:24.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[116404]: failed to encode map e403 with expected crc 2024-01-13T18:06:24.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:24 smithi084 ceph-mon[116404]: pgmap v316: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2024-01-13T18:06:25.654 INFO:tasks.rados.rados.0.smithi084.stdout:1685: done (1 left) 2024-01-13T18:06:25.655 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 167 2024-01-13T18:06:25.655 INFO:tasks.rados.rados.0.smithi084.stdout:1684: finishing write tid 1 to smithi084102331-12 2024-01-13T18:06:25.655 INFO:tasks.rados.rados.0.smithi084.stdout:1686: seq_num 528 ranges {10543104=450560,10993664=761856,11755520=442368} 2024-01-13T18:06:25.713 INFO:tasks.rados.rados.0.smithi084.stdout:1686: writing smithi084102331-2 from 10543104 to 10993664 tid 1 2024-01-13T18:06:25.717 INFO:tasks.rados.rados.0.smithi084.stdout:1686: writing smithi084102331-2 from 10993664 to 11755520 tid 2 2024-01-13T18:06:25.722 INFO:tasks.rados.rados.0.smithi084.stdout:1686: writing smithi084102331-2 from 11755520 to 12197888 tid 3 2024-01-13T18:06:25.722 INFO:tasks.rados.rados.0.smithi084.stdout:1687: snap_create 2024-01-13T18:06:25.722 INFO:tasks.rados.rados.0.smithi084.stdout:1684: finishing write tid 2 to smithi084102331-12 2024-01-13T18:06:25.722 INFO:tasks.rados.rados.0.smithi084.stdout:1684: finishing write tid 3 to smithi084102331-12 2024-01-13T18:06:25.722 INFO:tasks.rados.rados.0.smithi084.stdout:1684: finishing write tid 4 to smithi084102331-12 2024-01-13T18:06:25.722 INFO:tasks.rados.rados.0.smithi084.stdout:1684: finishing write tid 5 to smithi084102331-12 2024-01-13T18:06:25.722 INFO:tasks.rados.rados.0.smithi084.stdout:1684: finishing write tid 6 to smithi084102331-12 2024-01-13T18:06:25.722 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 890 (ObjNum 527 snap 167 seq_num 527) dirty exists 2024-01-13T18:06:25.722 INFO:tasks.rados.rados.0.smithi084.stdout:1684: left oid 12 (ObjNum 527 snap 167 seq_num 527) 2024-01-13T18:06:25.722 INFO:tasks.rados.rados.0.smithi084.stdout:1686: finishing write tid 1 to smithi084102331-2 2024-01-13T18:06:25.722 INFO:tasks.rados.rados.0.smithi084.stdout:1686: finishing write tid 2 to smithi084102331-2 2024-01-13T18:06:25.723 INFO:tasks.rados.rados.0.smithi084.stdout:1686: finishing write tid 3 to smithi084102331-2 2024-01-13T18:06:25.723 INFO:tasks.rados.rados.0.smithi084.stdout:1686: finishing write tid 4 to smithi084102331-2 2024-01-13T18:06:25.724 INFO:tasks.rados.rados.0.smithi084.stdout:1686: finishing write tid 5 to smithi084102331-2 2024-01-13T18:06:25.724 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 901 (ObjNum 528 snap 167 seq_num 528) dirty exists 2024-01-13T18:06:25.724 INFO:tasks.rados.rados.0.smithi084.stdout:1686: left oid 2 (ObjNum 528 snap 167 seq_num 528) 2024-01-13T18:06:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:25 smithi099 ceph-mon[138788]: failed to encode map e403 with expected crc 2024-01-13T18:06:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:25 smithi099 ceph-mon[138788]: Upgrade: Updating osd.6 2024-01-13T18:06:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-13T18:06:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:25 smithi099 ceph-mon[138788]: Deploying daemon osd.6 on smithi099 2024-01-13T18:06:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:25 smithi099 ceph-mon[138788]: osdmap e404: 8 total, 8 up, 8 in 2024-01-13T18:06:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:25 smithi099 ceph-mon[138788]: failed to encode map e404 with expected crc 2024-01-13T18:06:25.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[119097]: failed to encode map e403 with expected crc 2024-01-13T18:06:25.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[119097]: Upgrade: Updating osd.6 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[119097]: Deploying daemon osd.6 on smithi099 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[119097]: osdmap e404: 8 total, 8 up, 8 in 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[119097]: failed to encode map e404 with expected crc 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[116404]: failed to encode map e403 with expected crc 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[116404]: Upgrade: Updating osd.6 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:25.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[116404]: Deploying daemon osd.6 on smithi099 2024-01-13T18:06:25.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[116404]: osdmap e404: 8 total, 8 up, 8 in 2024-01-13T18:06:25.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:25 smithi084 ceph-mon[116404]: failed to encode map e404 with expected crc 2024-01-13T18:06:26.624 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:26 smithi099 ceph-mon[138788]: failed to encode map e404 with expected crc 2024-01-13T18:06:26.624 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:26 smithi099 ceph-mon[138788]: osdmap e405: 8 total, 8 up, 8 in 2024-01-13T18:06:26.624 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:26 smithi099 ceph-mon[138788]: failed to encode map e405 with expected crc 2024-01-13T18:06:26.624 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:26 smithi099 ceph-mon[138788]: pgmap v319: 121 pgs: 121 active+clean; 149 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-01-13T18:06:26.660 INFO:tasks.rados.rados.0.smithi084.stdout:1684: done (2 left) 2024-01-13T18:06:26.660 INFO:tasks.rados.rados.0.smithi084.stdout:1686: done (1 left) 2024-01-13T18:06:26.660 INFO:tasks.rados.rados.0.smithi084.stdout:1687: done (0 left) 2024-01-13T18:06:26.660 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 168 2024-01-13T18:06:26.660 INFO:tasks.rados.rados.0.smithi084.stdout:1688: seq_num 529 ranges {2080768=466944,2547712=647168,3194880=532480,3727360=24576} 2024-01-13T18:06:26.674 INFO:tasks.rados.rados.0.smithi084.stdout:1688: writing smithi084102331-3 from 2080768 to 2547712 tid 1 2024-01-13T18:06:26.677 INFO:tasks.rados.rados.0.smithi084.stdout:1688: writing smithi084102331-3 from 2547712 to 3194880 tid 2 2024-01-13T18:06:26.681 INFO:tasks.rados.rados.0.smithi084.stdout:1688: writing smithi084102331-3 from 3194880 to 3727360 tid 3 2024-01-13T18:06:26.681 INFO:tasks.rados.rados.0.smithi084.stdout:1688: writing smithi084102331-3 from 3727360 to 3751936 tid 4 2024-01-13T18:06:26.681 INFO:tasks.rados.rados.0.smithi084.stdout:1689: read oid 23 snap -1 2024-01-13T18:06:26.681 INFO:tasks.rados.rados.0.smithi084.stdout:1689: expect deleted 2024-01-13T18:06:26.681 INFO:tasks.rados.rados.0.smithi084.stdout:1690: read oid 30 snap 166 2024-01-13T18:06:26.682 INFO:tasks.rados.rados.0.smithi084.stdout:1690: expect (ObjNum 506 snap 162 seq_num 506) 2024-01-13T18:06:26.682 INFO:tasks.rados.rados.0.smithi084.stdout:1691: rmattr oid 13 current snap is 168 2024-01-13T18:06:26.682 INFO:tasks.rados.rados.0.smithi084.stdout:1691: done (3 left) 2024-01-13T18:06:26.682 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 168 2024-01-13T18:06:26.682 INFO:tasks.rados.rados.0.smithi084.stdout:1692: seq_num 530 ranges {3866624=483328,4349952=532480,4882432=671744} 2024-01-13T18:06:26.704 INFO:tasks.rados.rados.0.smithi084.stdout:1692: writing smithi084102331-21 from 3866624 to 4349952 tid 1 2024-01-13T18:06:26.707 INFO:tasks.rados.rados.0.smithi084.stdout:1692: writing smithi084102331-21 from 4349952 to 4882432 tid 2 2024-01-13T18:06:26.712 INFO:tasks.rados.rados.0.smithi084.stdout:1692: writing smithi084102331-21 from 4882432 to 5554176 tid 3 2024-01-13T18:06:26.712 INFO:tasks.rados.rados.0.smithi084.stdout:1693: read oid 37 snap -1 2024-01-13T18:06:26.713 INFO:tasks.rados.rados.0.smithi084.stdout:1693: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:06:26.713 INFO:tasks.rados.rados.0.smithi084.stdout:1694: copy_from oid 14 from oid 10 current snap is 168 2024-01-13T18:06:26.713 INFO:tasks.rados.rados.0.smithi084.stdout:1688: finishing write tid 1 to smithi084102331-3 2024-01-13T18:06:26.713 INFO:tasks.rados.rados.0.smithi084.stdout:1688: finishing write tid 2 to smithi084102331-3 2024-01-13T18:06:26.713 INFO:tasks.rados.rados.0.smithi084.stdout:1688: finishing write tid 3 to smithi084102331-3 2024-01-13T18:06:26.713 INFO:tasks.rados.rados.0.smithi084.stdout:1688: finishing write tid 4 to smithi084102331-3 2024-01-13T18:06:26.713 INFO:tasks.rados.rados.0.smithi084.stdout:1688: finishing write tid 5 to smithi084102331-3 2024-01-13T18:06:26.713 INFO:tasks.rados.rados.0.smithi084.stdout:1689: done (5 left) 2024-01-13T18:06:26.713 INFO:tasks.rados.rados.0.smithi084.stdout:1695: snap_remove snap 167 2024-01-13T18:06:26.916 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:26 smithi099 systemd[1]: Stopping Ceph osd.6 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:06:26.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:26 smithi084 ceph-mon[119097]: failed to encode map e404 with expected crc 2024-01-13T18:06:26.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:26 smithi084 ceph-mon[119097]: osdmap e405: 8 total, 8 up, 8 in 2024-01-13T18:06:26.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:26 smithi084 ceph-mon[119097]: failed to encode map e405 with expected crc 2024-01-13T18:06:26.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:26 smithi084 ceph-mon[119097]: pgmap v319: 121 pgs: 121 active+clean; 149 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-01-13T18:06:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:26 smithi084 ceph-mon[116404]: failed to encode map e404 with expected crc 2024-01-13T18:06:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:26 smithi084 ceph-mon[116404]: osdmap e405: 8 total, 8 up, 8 in 2024-01-13T18:06:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:26 smithi084 ceph-mon[116404]: failed to encode map e405 with expected crc 2024-01-13T18:06:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:26 smithi084 ceph-mon[116404]: pgmap v319: 121 pgs: 121 active+clean; 149 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-01-13T18:06:27.369 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:26 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[91416]: 2024-01-13T18:06:26.914+0000 7f3bc4db5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:06:27.369 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:26 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[91416]: 2024-01-13T18:06:26.914+0000 7f3bc4db5700 -1 osd.6 406 *** Got signal Terminated *** 2024-01-13T18:06:27.369 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:26 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[91416]: 2024-01-13T18:06:26.914+0000 7f3bc4db5700 -1 osd.6 406 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T18:06:27.632 INFO:tasks.rados.rados.0.smithi084.stdout:1695: done (5 left) 2024-01-13T18:06:27.632 INFO:tasks.rados.rados.0.smithi084.stdout:1696: copy_from oid 18 from oid 42 current snap is 168 2024-01-13T18:06:27.632 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 168 2024-01-13T18:06:27.632 INFO:tasks.rados.rados.0.smithi084.stdout:1697: seq_num 531 ranges {2752512=499712,3252224=417792,3670016=548864,4218880=237568} 2024-01-13T18:06:27.650 INFO:tasks.rados.rados.0.smithi084.stdout:1697: writing smithi084102331-27 from 2752512 to 3252224 tid 1 2024-01-13T18:06:27.652 INFO:tasks.rados.rados.0.smithi084.stdout:1697: writing smithi084102331-27 from 3252224 to 3670016 tid 2 2024-01-13T18:06:27.656 INFO:tasks.rados.rados.0.smithi084.stdout:1697: writing smithi084102331-27 from 3670016 to 4218880 tid 3 2024-01-13T18:06:27.658 INFO:tasks.rados.rados.0.smithi084.stdout:1697: writing smithi084102331-27 from 4218880 to 4456448 tid 4 2024-01-13T18:06:27.658 INFO:tasks.rados.rados.0.smithi084.stdout:1698: snap_create 2024-01-13T18:06:27.658 INFO:tasks.rados.rados.0.smithi084.stdout:1688: finishing write tid 6 to smithi084102331-3 2024-01-13T18:06:27.658 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1014 (ObjNum 529 snap 168 seq_num 529) dirty exists 2024-01-13T18:06:27.659 INFO:tasks.rados.rados.0.smithi084.stdout:1688: left oid 3 (ObjNum 529 snap 168 seq_num 529) 2024-01-13T18:06:27.659 INFO:tasks.rados.rados.0.smithi084.stdout:1690: expect (ObjNum 506 snap 162 seq_num 506) 2024-01-13T18:06:27.692 INFO:tasks.rados.rados.0.smithi084.stdout:1692: finishing write tid 1 to smithi084102331-21 2024-01-13T18:06:27.692 INFO:tasks.rados.rados.0.smithi084.stdout:1692: finishing write tid 2 to smithi084102331-21 2024-01-13T18:06:27.693 INFO:tasks.rados.rados.0.smithi084.stdout:1693: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:06:27.694 INFO:tasks.rados.rados.0.smithi084.stdout:1692: finishing write tid 3 to smithi084102331-21 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:1692: finishing write tid 4 to smithi084102331-21 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:1692: finishing write tid 5 to smithi084102331-21 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 623 (ObjNum 530 snap 168 seq_num 530) dirty exists 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:1692: left oid 21 (ObjNum 530 snap 168 seq_num 530) 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:1694: finishing copy_from to smithi084102331-14 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 386 (ObjNum 456 snap 142 seq_num 456) dirty exists 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:1694: finishing copy_from racing read to smithi084102331-14 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:1697: finishing write tid 1 to smithi084102331-27 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:1697: finishing write tid 2 to smithi084102331-27 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:1697: finishing write tid 3 to smithi084102331-27 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:1697: finishing write tid 4 to smithi084102331-27 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:1697: finishing write tid 5 to smithi084102331-27 2024-01-13T18:06:27.695 INFO:tasks.rados.rados.0.smithi084.stdout:1697: finishing write tid 6 to smithi084102331-27 2024-01-13T18:06:27.696 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 516 (ObjNum 531 snap 168 seq_num 531) dirty exists 2024-01-13T18:06:27.696 INFO:tasks.rados.rados.0.smithi084.stdout:1697: left oid 27 (ObjNum 531 snap 168 seq_num 531) 2024-01-13T18:06:27.696 INFO:tasks.rados.rados.0.smithi084.stdout:1696: finishing copy_from to smithi084102331-18 2024-01-13T18:06:27.696 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 878 (ObjNum 493 snap 157 seq_num 493) dirty exists 2024-01-13T18:06:27.696 INFO:tasks.rados.rados.0.smithi084.stdout:1696: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:06:27.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:27 smithi099 ceph-mon[138788]: failed to encode map e405 with expected crc 2024-01-13T18:06:27.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:27 smithi099 ceph-mon[138788]: osdmap e406: 8 total, 8 up, 8 in 2024-01-13T18:06:27.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:27 smithi099 ceph-mon[138788]: failed to encode map e406 with expected crc 2024-01-13T18:06:27.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:27 smithi099 ceph-mon[138788]: osd.6 marked itself down and dead 2024-01-13T18:06:27.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:27 smithi084 ceph-mon[116404]: failed to encode map e405 with expected crc 2024-01-13T18:06:27.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:27 smithi084 ceph-mon[116404]: osdmap e406: 8 total, 8 up, 8 in 2024-01-13T18:06:27.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:27 smithi084 ceph-mon[116404]: failed to encode map e406 with expected crc 2024-01-13T18:06:27.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:27 smithi084 ceph-mon[116404]: osd.6 marked itself down and dead 2024-01-13T18:06:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:27 smithi084 ceph-mon[119097]: failed to encode map e405 with expected crc 2024-01-13T18:06:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:27 smithi084 ceph-mon[119097]: osdmap e406: 8 total, 8 up, 8 in 2024-01-13T18:06:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:27 smithi084 ceph-mon[119097]: failed to encode map e406 with expected crc 2024-01-13T18:06:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:27 smithi084 ceph-mon[119097]: osd.6 marked itself down and dead 2024-01-13T18:06:28.569 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:06:28.571 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:28 smithi099 bash[156613]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6 2024-01-13T18:06:28.627 INFO:tasks.rados.rados.0.smithi084.stdout:1688: done (7 left) 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1690: done (6 left) 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1692: done (5 left) 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1693: done (4 left) 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1694: done (3 left) 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1696: done (2 left) 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1697: done (1 left) 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1698: done (0 left) 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1699: read oid 9 snap -1 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1699: expect (ObjNum 472 snap 148 seq_num 472) 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1700: read oid 50 snap -1 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1700: expect (ObjNum 515 snap 164 seq_num 515) 2024-01-13T18:06:28.628 INFO:tasks.rados.rados.0.smithi084.stdout:1701: snap_remove snap 166 2024-01-13T18:06:28.848 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:06:28.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:06:28.848 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-mon[138788]: failed to encode map e406 with expected crc 2024-01-13T18:06:28.848 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-mon[138788]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:06:28.848 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-mon[138788]: osdmap e407: 8 total, 7 up, 8 in 2024-01-13T18:06:28.848 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-mon[138788]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.848 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-mon[138788]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.848 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-mon[138788]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.849 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-mon[138788]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.849 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-mon[138788]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.849 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-mon[138788]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.849 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-mon[138788]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.849 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:28 smithi099 ceph-mon[138788]: pgmap v322: 121 pgs: 9 peering, 9 stale+active+clean, 103 active+clean; 162 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 4.8 MiB/s wr, 23 op/s 2024-01-13T18:06:28.892 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:06:28.892 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (4m) 80s ago 7m 28.4M - 0.25.0 c8568f914cd2 a5cbc3e01ffb 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (4m) 23s ago 6m 89.9M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (7m) 80s ago 7m 15.8M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (7m) 23s ago 7m 21.4M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (3m) 23s ago 10m 448M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (4m) 80s ago 11m 510M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (3m) 80s ago 11m 83.2M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d b64908c7a53c 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (3m) 23s ago 10m 64.5M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d be7bb477ea53 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (3m) 80s ago 10m 58.7M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d e13f01b852ff 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (4m) 80s ago 6m 10.3M - 1.5.0 0da6a335fe13 b72e6d50f165 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (4m) 23s ago 6m 15.9M - 1.5.0 0da6a335fe13 e9f879b5e55b 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (2m) 80s ago 10m 243M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d e18181bdb4a8 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (2m) 80s ago 9m 187M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 32bdce285b36 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (110s) 80s ago 9m 175M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 660c53389079 2024-01-13T18:06:28.893 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (83s) 80s ago 9m 11.8M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 0e4b8c3482a4 2024-01-13T18:06:28.894 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (55s) 23s ago 9m 251M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 76d7d19ec531 2024-01-13T18:06:28.894 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (26s) 23s ago 8m 13.8M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 5cf0e9339ca9 2024-01-13T18:06:28.894 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (8m) 23s ago 8m 396M 2488M 17.2.7-268-g6441305d c3a232f785d8 532145869ce1 2024-01-13T18:06:28.894 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (8m) 23s ago 8m 286M 2488M 17.2.7-268-g6441305d c3a232f785d8 2a93d446c431 2024-01-13T18:06:28.894 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (3m) 23s ago 7m 60.7M - 2.43.0 a07b618ecd1d cb4c11bf6eec 2024-01-13T18:06:28.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[119097]: failed to encode map e406 with expected crc 2024-01-13T18:06:28.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[119097]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:06:28.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[119097]: osdmap e407: 8 total, 7 up, 8 in 2024-01-13T18:06:28.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[119097]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[119097]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[119097]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[119097]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[119097]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[119097]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[119097]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[119097]: pgmap v322: 121 pgs: 9 peering, 9 stale+active+clean, 103 active+clean; 162 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 4.8 MiB/s wr, 23 op/s 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[116404]: failed to encode map e406 with expected crc 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[116404]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[116404]: osdmap e407: 8 total, 7 up, 8 in 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[116404]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[116404]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[116404]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[116404]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[116404]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[116404]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[116404]: failed to encode map e407 with expected crc 2024-01-13T18:06:28.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:28 smithi084 ceph-mon[116404]: pgmap v322: 121 pgs: 9 peering, 9 stale+active+clean, 103 active+clean; 162 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 4.8 MiB/s wr, 23 op/s 2024-01-13T18:06:29.272 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:06:29.272 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:06:29.272 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:06:29.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:06:29.272 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 1, 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 6 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 3, 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 11 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:06:29.273 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:06:29.632 INFO:tasks.rados.rados.0.smithi084.stdout:1701: done (2 left) 2024-01-13T18:06:29.633 INFO:tasks.rados.rados.0.smithi084.stdout:1702: delete oid 22 current snap is 169 2024-01-13T18:06:29.633 INFO:tasks.rados.rados.0.smithi084.stdout:1699: expect (ObjNum 472 snap 148 seq_num 472) 2024-01-13T18:06:29.768 INFO:tasks.rados.rados.0.smithi084.stdout:1700: expect (ObjNum 515 snap 164 seq_num 515) 2024-01-13T18:06:29.869 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:29 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.6.service: Succeeded. 2024-01-13T18:06:29.869 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:29 smithi099 systemd[1]: Stopped Ceph osd.6 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:06:29.869 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:29 smithi099 systemd[1]: Starting Ceph osd.6 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:06:29.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:29 smithi099 ceph-mon[138788]: from='client.34305 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:06:29.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:29 smithi099 ceph-mon[138788]: failed to encode map e408 with expected crc 2024-01-13T18:06:29.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:29 smithi099 ceph-mon[138788]: failed to encode map e408 with expected crc 2024-01-13T18:06:29.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:29 smithi099 ceph-mon[138788]: osdmap e408: 8 total, 7 up, 8 in 2024-01-13T18:06:29.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:29 smithi099 ceph-mon[138788]: failed to encode map e408 with expected crc 2024-01-13T18:06:29.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:29 smithi099 ceph-mon[138788]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-13T18:06:29.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:29 smithi099 ceph-mon[138788]: from='client.34311 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:06:29.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:29 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4077881030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:29.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[116404]: from='client.34305 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:06:29.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[116404]: failed to encode map e408 with expected crc 2024-01-13T18:06:29.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[116404]: failed to encode map e408 with expected crc 2024-01-13T18:06:29.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[116404]: osdmap e408: 8 total, 7 up, 8 in 2024-01-13T18:06:29.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[116404]: failed to encode map e408 with expected crc 2024-01-13T18:06:29.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[116404]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-13T18:06:29.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[116404]: from='client.34311 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:06:29.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4077881030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:29.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[119097]: from='client.34305 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:06:29.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[119097]: failed to encode map e408 with expected crc 2024-01-13T18:06:29.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[119097]: failed to encode map e408 with expected crc 2024-01-13T18:06:29.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[119097]: osdmap e408: 8 total, 7 up, 8 in 2024-01-13T18:06:29.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[119097]: failed to encode map e408 with expected crc 2024-01-13T18:06:29.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[119097]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-01-13T18:06:29.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[119097]: from='client.34311 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:06:29.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:29 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4077881030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:30.441 INFO:tasks.rados.rados.0.smithi084.stdout:1699: done (2 left) 2024-01-13T18:06:30.441 INFO:tasks.rados.rados.0.smithi084.stdout:1700: done (1 left) 2024-01-13T18:06:30.441 INFO:tasks.rados.rados.0.smithi084.stdout:1702: done (0 left) 2024-01-13T18:06:30.441 INFO:tasks.rados.rados.0.smithi084.stdout:1703: rollback oid 38 current snap is 169 2024-01-13T18:06:30.441 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 168 2024-01-13T18:06:30.441 INFO:tasks.rados.rados.0.smithi084.stdout:1704: snap_create 2024-01-13T18:06:30.444 INFO:tasks.rados.rados.0.smithi084.stdout:1703: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:06:30.444 INFO:tasks.rados.rados.0.smithi084.stdout:1703: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:06:30.444 INFO:tasks.rados.rados.0.smithi084.stdout:1703: finishing rollback tid 2 to smithi084102331-38 2024-01-13T18:06:30.444 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1018 (ObjNum 474 snap 148 seq_num 474) dirty exists 2024-01-13T18:06:30.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:30 smithi084 ceph-mon[116404]: failed to encode map e409 with expected crc 2024-01-13T18:06:30.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:30 smithi084 ceph-mon[116404]: osdmap e409: 8 total, 7 up, 8 in 2024-01-13T18:06:30.636 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:06:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:06:30] "GET /metrics HTTP/1.1" 200 36196 "" "Prometheus/2.43.0" 2024-01-13T18:06:30.639 INFO:tasks.rados.rados.0.smithi084.stdout:1703: done (1 left) 2024-01-13T18:06:30.639 INFO:tasks.rados.rados.0.smithi084.stdout:1704: done (0 left) 2024-01-13T18:06:30.639 INFO:tasks.rados.rados.0.smithi084.stdout:1705: snap_create 2024-01-13T18:06:30.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:30 smithi099 ceph-mon[138788]: failed to encode map e409 with expected crc 2024-01-13T18:06:30.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:30 smithi099 ceph-mon[138788]: osdmap e409: 8 total, 7 up, 8 in 2024-01-13T18:06:30.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:30 smithi099 ceph-mon[138788]: failed to encode map e409 with expected crc 2024-01-13T18:06:30.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:30 smithi099 ceph-mon[138788]: pgmap v325: 121 pgs: 2 active+undersized+degraded, 9 peering, 6 stale+active+clean, 10 active+undersized, 94 active+clean; 172 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 711 KiB/s rd, 6.1 MiB/s wr, 21 op/s; 5/237 objects degraded (2.110%) 2024-01-13T18:06:30.870 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:30 smithi099 bash[156879]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-13T18:06:30.870 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:30 smithi099 bash[156879]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-01-13T18:06:30.870 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:30 smithi099 bash[156879]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-01-13T18:06:30.870 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:30 smithi099 bash[156879]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-01-13T18:06:30.870 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:30 smithi099 bash[156879]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-01-13T18:06:30.870 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:30 smithi099 bash[156879]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-13T18:06:30.870 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:30 smithi099 bash[156879]: --> ceph-volume raw activate successful for osd ID: 6 2024-01-13T18:06:30.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:30 smithi084 ceph-mon[116404]: failed to encode map e409 with expected crc 2024-01-13T18:06:30.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:30 smithi084 ceph-mon[116404]: pgmap v325: 121 pgs: 2 active+undersized+degraded, 9 peering, 6 stale+active+clean, 10 active+undersized, 94 active+clean; 172 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 711 KiB/s rd, 6.1 MiB/s wr, 21 op/s; 5/237 objects degraded (2.110%) 2024-01-13T18:06:30.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:30 smithi084 ceph-mon[119097]: failed to encode map e409 with expected crc 2024-01-13T18:06:30.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:30 smithi084 ceph-mon[119097]: osdmap e409: 8 total, 7 up, 8 in 2024-01-13T18:06:30.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:30 smithi084 ceph-mon[119097]: failed to encode map e409 with expected crc 2024-01-13T18:06:30.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:30 smithi084 ceph-mon[119097]: pgmap v325: 121 pgs: 2 active+undersized+degraded, 9 peering, 6 stale+active+clean, 10 active+undersized, 94 active+clean; 172 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 711 KiB/s rd, 6.1 MiB/s wr, 21 op/s; 5/237 objects degraded (2.110%) 2024-01-13T18:06:31.619 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:31 smithi099 ceph-osd[157167]: -- 172.21.15.99:0/4136344917 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5590aa7e04e0 con 0x5590aa7b1400 2024-01-13T18:06:31.619 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:31 smithi099 bash[157130]: 919ac0aa6c87c1915be6d907cffcbd014e38903fa533e7bad608387942c4c0c3 2024-01-13T18:06:31.619 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:31 smithi099 systemd[1]: Started Ceph osd.6 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:06:31.645 INFO:tasks.rados.rados.0.smithi084.stdout:1705: done (0 left) 2024-01-13T18:06:31.645 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 171 2024-01-13T18:06:31.645 INFO:tasks.rados.rados.0.smithi084.stdout:1706: seq_num 533 ranges {3465216=532480,3997696=630784,4628480=516096,5144576=57344} 2024-01-13T18:06:31.667 INFO:tasks.rados.rados.0.smithi084.stdout:1706: writing smithi084102331-14 from 3465216 to 3997696 tid 1 2024-01-13T18:06:31.671 INFO:tasks.rados.rados.0.smithi084.stdout:1706: writing smithi084102331-14 from 3997696 to 4628480 tid 2 2024-01-13T18:06:31.674 INFO:tasks.rados.rados.0.smithi084.stdout:1706: writing smithi084102331-14 from 4628480 to 5144576 tid 3 2024-01-13T18:06:31.675 INFO:tasks.rados.rados.0.smithi084.stdout:1706: writing smithi084102331-14 from 5144576 to 5201920 tid 4 2024-01-13T18:06:31.675 INFO:tasks.rados.rados.0.smithi084.stdout:1707: setattr oid 16 current snap is 171 2024-01-13T18:06:31.675 INFO:tasks.rados.rados.0.smithi084.stdout:1706: finishing write tid 1 to smithi084102331-14 2024-01-13T18:06:31.675 INFO:tasks.rados.rados.0.smithi084.stdout:1706: finishing write tid 2 to smithi084102331-14 2024-01-13T18:06:31.677 INFO:tasks.rados.rados.0.smithi084.stdout:1706: finishing write tid 3 to smithi084102331-14 2024-01-13T18:06:31.677 INFO:tasks.rados.rados.0.smithi084.stdout:1706: finishing write tid 4 to smithi084102331-14 2024-01-13T18:06:31.677 INFO:tasks.rados.rados.0.smithi084.stdout:1706: finishing write tid 5 to smithi084102331-14 2024-01-13T18:06:31.677 INFO:tasks.rados.rados.0.smithi084.stdout:1708: snap_remove snap 169 2024-01-13T18:06:31.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:31 smithi084 ceph-mon[119097]: Health check failed: Degraded data redundancy: 5/237 objects degraded (2.110%), 2 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:31.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:31 smithi084 ceph-mon[119097]: osdmap e410: 8 total, 7 up, 8 in 2024-01-13T18:06:31.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:31.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:31.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:31.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:31 smithi084 ceph-mon[116404]: Health check failed: Degraded data redundancy: 5/237 objects degraded (2.110%), 2 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:31.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:31 smithi084 ceph-mon[116404]: osdmap e410: 8 total, 7 up, 8 in 2024-01-13T18:06:31.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:31.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:31.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:32.119 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:31 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T18:06:31.714+0000 7f60a5bd5640 -1 Falling back to public interface 2024-01-13T18:06:32.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:31 smithi099 ceph-mon[138788]: Health check failed: Degraded data redundancy: 5/237 objects degraded (2.110%), 2 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:32.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:31 smithi099 ceph-mon[138788]: osdmap e410: 8 total, 7 up, 8 in 2024-01-13T18:06:32.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:32.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:32.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:32.623 INFO:tasks.rados.rados.0.smithi084.stdout:1708: done (2 left) 2024-01-13T18:06:32.623 INFO:tasks.rados.rados.0.smithi084.stdout:1709: rmattr oid 8 current snap is 171 2024-01-13T18:06:32.623 INFO:tasks.rados.rados.0.smithi084.stdout:1709: done (2 left) 2024-01-13T18:06:32.623 INFO:tasks.rados.rados.0.smithi084.stdout:1710: read oid 46 snap 165 2024-01-13T18:06:32.623 INFO:tasks.rados.rados.0.smithi084.stdout:1710: expect (ObjNum 491 snap 155 seq_num 491) 2024-01-13T18:06:32.623 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 171 2024-01-13T18:06:32.623 INFO:tasks.rados.rados.0.smithi084.stdout:1706: finishing write tid 6 to smithi084102331-14 2024-01-13T18:06:32.624 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 806 (ObjNum 533 snap 171 seq_num 533) dirty exists 2024-01-13T18:06:32.624 INFO:tasks.rados.rados.0.smithi084.stdout:1706: left oid 14 (ObjNum 533 snap 171 seq_num 533) 2024-01-13T18:06:32.624 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 520 (ObjNum 419 snap 132 seq_num 419) dirty exists 2024-01-13T18:06:32.624 INFO:tasks.rados.rados.0.smithi084.stdout:1711: seq_num 534 ranges {2236416=548864,2785280=516096,3301376=688128} 2024-01-13T18:06:32.638 INFO:tasks.rados.rados.0.smithi084.stdout:1711: writing smithi084102331-36 from 2236416 to 2785280 tid 1 2024-01-13T18:06:32.641 INFO:tasks.rados.rados.0.smithi084.stdout:1711: writing smithi084102331-36 from 2785280 to 3301376 tid 2 2024-01-13T18:06:32.645 INFO:tasks.rados.rados.0.smithi084.stdout:1711: writing smithi084102331-36 from 3301376 to 3989504 tid 3 2024-01-13T18:06:32.646 INFO:tasks.rados.rados.0.smithi084.stdout:1706: done (3 left) 2024-01-13T18:06:32.646 INFO:tasks.rados.rados.0.smithi084.stdout:1707: done (2 left) 2024-01-13T18:06:32.646 INFO:tasks.rados.rados.0.smithi084.stdout:1712: rollback oid 17 current snap is 171 2024-01-13T18:06:32.646 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 168 2024-01-13T18:06:32.646 INFO:tasks.rados.rados.0.smithi084.stdout:1710: expect (ObjNum 491 snap 155 seq_num 491) 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1711: finishing write tid 1 to smithi084102331-36 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1711: finishing write tid 2 to smithi084102331-36 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1711: finishing write tid 3 to smithi084102331-36 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1712: finishing rollback tid 0 to smithi084102331-17 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1712: finishing rollback tid 1 to smithi084102331-17 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1711: finishing write tid 4 to smithi084102331-36 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1712: finishing rollback tid 2 to smithi084102331-17 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 640 (ObjNum 519 snap 166 seq_num 519) dirty exists 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1711: finishing write tid 5 to smithi084102331-36 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 810 (ObjNum 534 snap 171 seq_num 534) dirty exists 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1711: left oid 36 (ObjNum 534 snap 171 seq_num 534) 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1710: done (2 left) 2024-01-13T18:06:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1711: done (1 left) 2024-01-13T18:06:32.738 INFO:tasks.rados.rados.0.smithi084.stdout:1712: done (0 left) 2024-01-13T18:06:32.738 INFO:tasks.rados.rados.0.smithi084.stdout:1713: snap_remove snap 168 2024-01-13T18:06:32.816 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:32 smithi099 ceph-mon[138788]: failed to encode map e410 with expected crc 2024-01-13T18:06:32.817 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:32 smithi099 ceph-mon[138788]: failed to encode map e410 with expected crc 2024-01-13T18:06:32.817 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:32 smithi099 ceph-mon[138788]: osdmap e411: 8 total, 7 up, 8 in 2024-01-13T18:06:32.817 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:32 smithi099 ceph-mon[138788]: pgmap v328: 121 pgs: 8 active+undersized+degraded, 9 peering, 26 active+undersized, 78 active+clean; 175 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 10 op/s; 31/249 objects degraded (12.450%) 2024-01-13T18:06:32.817 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:32 smithi099 ceph-mon[138788]: osdmap e412: 8 total, 7 up, 8 in 2024-01-13T18:06:32.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:32 smithi084 ceph-mon[119097]: failed to encode map e410 with expected crc 2024-01-13T18:06:32.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:32 smithi084 ceph-mon[119097]: failed to encode map e410 with expected crc 2024-01-13T18:06:32.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:32 smithi084 ceph-mon[119097]: osdmap e411: 8 total, 7 up, 8 in 2024-01-13T18:06:32.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:32 smithi084 ceph-mon[119097]: pgmap v328: 121 pgs: 8 active+undersized+degraded, 9 peering, 26 active+undersized, 78 active+clean; 175 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 10 op/s; 31/249 objects degraded (12.450%) 2024-01-13T18:06:32.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:32 smithi084 ceph-mon[119097]: osdmap e412: 8 total, 7 up, 8 in 2024-01-13T18:06:32.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:32 smithi084 ceph-mon[116404]: failed to encode map e410 with expected crc 2024-01-13T18:06:32.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:32 smithi084 ceph-mon[116404]: failed to encode map e410 with expected crc 2024-01-13T18:06:32.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:32 smithi084 ceph-mon[116404]: osdmap e411: 8 total, 7 up, 8 in 2024-01-13T18:06:32.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:32 smithi084 ceph-mon[116404]: pgmap v328: 121 pgs: 8 active+undersized+degraded, 9 peering, 26 active+undersized, 78 active+clean; 175 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 10 op/s; 31/249 objects degraded (12.450%) 2024-01-13T18:06:32.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:32 smithi084 ceph-mon[116404]: osdmap e412: 8 total, 7 up, 8 in 2024-01-13T18:06:33.671 INFO:tasks.rados.rados.0.smithi084.stdout:1713: done (0 left) 2024-01-13T18:06:33.671 INFO:tasks.rados.rados.0.smithi084.stdout:1714: rollback oid 13 current snap is 171 2024-01-13T18:06:33.672 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 13 to 170 2024-01-13T18:06:33.672 INFO:tasks.rados.rados.0.smithi084.stdout:1715: copy_from oid 7 from oid 11 current snap is 171 2024-01-13T18:06:33.672 INFO:tasks.rados.rados.0.smithi084.stdout:1716: rollback oid 31 current snap is 171 2024-01-13T18:06:33.672 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 165 2024-01-13T18:06:33.672 INFO:tasks.rados.rados.0.smithi084.stdout:1717: rollback oid 25 current snap is 171 2024-01-13T18:06:33.672 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 25 to 170 2024-01-13T18:06:33.672 INFO:tasks.rados.rados.0.smithi084.stdout:1718: setattr oid 43 current snap is 171 2024-01-13T18:06:33.672 INFO:tasks.rados.rados.0.smithi084.stdout:1719: read oid 49 snap -1 2024-01-13T18:06:33.673 INFO:tasks.rados.rados.0.smithi084.stdout:1719: expect (ObjNum 499 snap 161 seq_num 499) 2024-01-13T18:06:33.673 INFO:tasks.rados.rados.0.smithi084.stdout:1720: snap_create 2024-01-13T18:06:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:1714: finishing rollback tid 1 to smithi084102331-13 2024-01-13T18:06:33.679 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-01-13T18:06:33.685 INFO:tasks.rados.rados.0.smithi084.stdout:1717: finishing rollback tid 0 to smithi084102331-25 2024-01-13T18:06:33.686 INFO:tasks.rados.rados.0.smithi084.stdout:1717: finishing rollback tid 1 to smithi084102331-25 2024-01-13T18:06:33.686 INFO:tasks.rados.rados.0.smithi084.stdout:1717: finishing rollback tid 2 to smithi084102331-25 2024-01-13T18:06:33.686 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 847 (ObjNum 497 snap 160 seq_num 497) dirty exists 2024-01-13T18:06:33.686 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 460 (ObjNum 445 snap 139 seq_num 445) dirty exists 2024-01-13T18:06:33.687 INFO:tasks.rados.rados.0.smithi084.stdout:1716: finishing rollback tid 0 to smithi084102331-31 2024-01-13T18:06:33.687 INFO:tasks.rados.rados.0.smithi084.stdout:1716: finishing rollback tid 1 to smithi084102331-31 2024-01-13T18:06:33.687 INFO:tasks.rados.rados.0.smithi084.stdout:1716: finishing rollback tid 2 to smithi084102331-31 2024-01-13T18:06:33.687 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1022 (ObjNum 424 snap 135 seq_num 424) dirty exists 2024-01-13T18:06:33.700 INFO:tasks.rados.rados.0.smithi084.stdout:1719: expect (ObjNum 499 snap 161 seq_num 499) 2024-01-13T18:06:33.759 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:33 smithi099 ceph-mon[138788]: failed to encode map e411 with expected crc 2024-01-13T18:06:33.759 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:33 smithi099 ceph-mon[138788]: failed to encode map e412 with expected crc 2024-01-13T18:06:33.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:33 smithi084 ceph-mon[116404]: failed to encode map e411 with expected crc 2024-01-13T18:06:33.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:33 smithi084 ceph-mon[116404]: failed to encode map e412 with expected crc 2024-01-13T18:06:33.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:33 smithi084 ceph-mon[119097]: failed to encode map e411 with expected crc 2024-01-13T18:06:33.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:33 smithi084 ceph-mon[119097]: failed to encode map e412 with expected crc 2024-01-13T18:06:33.947 INFO:tasks.rados.rados.0.smithi084.stdout:1715: finishing copy_from to smithi084102331-7 2024-01-13T18:06:33.947 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 589 (ObjNum 508 snap 162 seq_num 508) dirty exists 2024-01-13T18:06:33.947 INFO:tasks.rados.rados.0.smithi084.stdout:1715: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:06:34.675 INFO:tasks.rados.rados.0.smithi084.stdout:1714: done (6 left) 2024-01-13T18:06:34.675 INFO:tasks.rados.rados.0.smithi084.stdout:1715: done (5 left) 2024-01-13T18:06:34.675 INFO:tasks.rados.rados.0.smithi084.stdout:1716: done (4 left) 2024-01-13T18:06:34.675 INFO:tasks.rados.rados.0.smithi084.stdout:1717: done (3 left) 2024-01-13T18:06:34.675 INFO:tasks.rados.rados.0.smithi084.stdout:1718: done (2 left) 2024-01-13T18:06:34.675 INFO:tasks.rados.rados.0.smithi084.stdout:1719: done (1 left) 2024-01-13T18:06:34.675 INFO:tasks.rados.rados.0.smithi084.stdout:1720: done (0 left) 2024-01-13T18:06:34.675 INFO:tasks.rados.rados.0.smithi084.stdout:1721: copy_from oid 12 from oid 38 current snap is 172 2024-01-13T18:06:34.675 INFO:tasks.rados.rados.0.smithi084.stdout:1722: read oid 23 snap 165 2024-01-13T18:06:34.676 INFO:tasks.rados.rados.0.smithi084.stdout:1722: expect (ObjNum 512 snap 164 seq_num 512) 2024-01-13T18:06:34.676 INFO:tasks.rados.rados.0.smithi084.stdout:1723: rollback oid 42 current snap is 172 2024-01-13T18:06:34.676 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 171 2024-01-13T18:06:34.676 INFO:tasks.rados.rados.0.smithi084.stdout:1724: read oid 40 snap -1 2024-01-13T18:06:34.676 INFO:tasks.rados.rados.0.smithi084.stdout:1724: expect deleted 2024-01-13T18:06:34.676 INFO:tasks.rados.rados.0.smithi084.stdout:1725: snap_create 2024-01-13T18:06:34.682 INFO:tasks.rados.rados.0.smithi084.stdout:1723: finishing rollback tid 0 to smithi084102331-42 2024-01-13T18:06:34.682 INFO:tasks.rados.rados.0.smithi084.stdout:1723: finishing rollback tid 1 to smithi084102331-42 2024-01-13T18:06:34.682 INFO:tasks.rados.rados.0.smithi084.stdout:1723: finishing rollback tid 2 to smithi084102331-42 2024-01-13T18:06:34.682 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 881 (ObjNum 493 snap 157 seq_num 493) dirty exists 2024-01-13T18:06:34.690 INFO:tasks.rados.rados.0.smithi084.stdout:1722: expect (ObjNum 512 snap 164 seq_num 512) 2024-01-13T18:06:34.777 INFO:tasks.rados.rados.0.smithi084.stdout:1721: finishing copy_from to smithi084102331-12 2024-01-13T18:06:34.778 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1018 (ObjNum 474 snap 148 seq_num 474) dirty exists 2024-01-13T18:06:34.778 INFO:tasks.rados.rados.0.smithi084.stdout:1721: finishing copy_from racing read to smithi084102331-12 2024-01-13T18:06:34.869 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T18:06:34.561+0000 7f60a5bd5640 -1 osd.6 0 read_superblock omap replica is missing. 2024-01-13T18:06:34.869 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T18:06:34.621+0000 7f60a5bd5640 -1 osd.6 406 log_to_monitors true 2024-01-13T18:06:34.869 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T18:06:34.704+0000 7f6093829700 -1 osd.6 406 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T18:06:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-mon[138788]: failed to encode map e413 with expected crc 2024-01-13T18:06:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-mon[138788]: osdmap e413: 8 total, 7 up, 8 in 2024-01-13T18:06:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-mon[138788]: pgmap v331: 121 pgs: 8 active+undersized+degraded, 35 active+undersized, 78 active+clean; 175 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.7 MiB/s rd, 828 KiB/s wr, 10 op/s; 31/246 objects degraded (12.602%) 2024-01-13T18:06:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-mon[138788]: from='osd.6 [v2:172.21.15.99:6816/972288266,v1:172.21.15.99:6817/972288266]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T18:06:34.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:34 smithi099 ceph-mon[138788]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T18:06:34.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[116404]: failed to encode map e413 with expected crc 2024-01-13T18:06:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[116404]: osdmap e413: 8 total, 7 up, 8 in 2024-01-13T18:06:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[116404]: pgmap v331: 121 pgs: 8 active+undersized+degraded, 35 active+undersized, 78 active+clean; 175 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.7 MiB/s rd, 828 KiB/s wr, 10 op/s; 31/246 objects degraded (12.602%) 2024-01-13T18:06:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[116404]: from='osd.6 [v2:172.21.15.99:6816/972288266,v1:172.21.15.99:6817/972288266]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T18:06:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[116404]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T18:06:34.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[119097]: failed to encode map e413 with expected crc 2024-01-13T18:06:34.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[119097]: osdmap e413: 8 total, 7 up, 8 in 2024-01-13T18:06:34.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[119097]: pgmap v331: 121 pgs: 8 active+undersized+degraded, 35 active+undersized, 78 active+clean; 175 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.7 MiB/s rd, 828 KiB/s wr, 10 op/s; 31/246 objects degraded (12.602%) 2024-01-13T18:06:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[119097]: from='osd.6 [v2:172.21.15.99:6816/972288266,v1:172.21.15.99:6817/972288266]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T18:06:34.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:34 smithi084 ceph-mon[119097]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-13T18:06:35.676 INFO:tasks.rados.rados.0.smithi084.stdout:1721: done (4 left) 2024-01-13T18:06:35.676 INFO:tasks.rados.rados.0.smithi084.stdout:1722: done (3 left) 2024-01-13T18:06:35.676 INFO:tasks.rados.rados.0.smithi084.stdout:1723: done (2 left) 2024-01-13T18:06:35.676 INFO:tasks.rados.rados.0.smithi084.stdout:1724: done (1 left) 2024-01-13T18:06:35.676 INFO:tasks.rados.rados.0.smithi084.stdout:1725: done (0 left) 2024-01-13T18:06:35.676 INFO:tasks.rados.rados.0.smithi084.stdout:1726: read oid 1 snap -1 2024-01-13T18:06:35.676 INFO:tasks.rados.rados.0.smithi084.stdout:1726: expect (ObjNum 513 snap 164 seq_num 513) 2024-01-13T18:06:35.676 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 173 2024-01-13T18:06:35.677 INFO:tasks.rados.rados.0.smithi084.stdout:1727: seq_num 535 ranges {5201920=565248,5767168=802816,6569984=401408} 2024-01-13T18:06:35.708 INFO:tasks.rados.rados.0.smithi084.stdout:1727: writing smithi084102331-14 from 5201920 to 5767168 tid 1 2024-01-13T18:06:35.712 INFO:tasks.rados.rados.0.smithi084.stdout:1727: writing smithi084102331-14 from 5767168 to 6569984 tid 2 2024-01-13T18:06:35.714 INFO:tasks.rados.rados.0.smithi084.stdout:1727: writing smithi084102331-14 from 6569984 to 6971392 tid 3 2024-01-13T18:06:35.715 INFO:tasks.rados.rados.0.smithi084.stdout:1728: snap_remove snap 172 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: failed to encode map e414 with expected crc 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: osdmap e414: 8 total, 7 up, 8 in 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: from='osd.6 [v2:172.21.15.99:6816/972288266,v1:172.21.15.99:6817/972288266]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: osd.6 [v2:172.21.15.99:6816/972288266,v1:172.21.15.99:6817/972288266] boot 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: osdmap e415: 8 total, 8 up, 8 in 2024-01-13T18:06:36.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:06:36.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: failed to encode map e414 with expected crc 2024-01-13T18:06:36.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-13T18:06:36.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: osdmap e414: 8 total, 7 up, 8 in 2024-01-13T18:06:36.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: from='osd.6 [v2:172.21.15.99:6816/972288266,v1:172.21.15.99:6817/972288266]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:36.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:36.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-01-13T18:06:36.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:36.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:36.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:06:36.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: osd.6 [v2:172.21.15.99:6816/972288266,v1:172.21.15.99:6817/972288266] boot 2024-01-13T18:06:36.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: osdmap e415: 8 total, 8 up, 8 in 2024-01-13T18:06:36.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: failed to encode map e414 with expected crc 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: osdmap e414: 8 total, 7 up, 8 in 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: from='osd.6 [v2:172.21.15.99:6816/972288266,v1:172.21.15.99:6817/972288266]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: osd.6 [v2:172.21.15.99:6816/972288266,v1:172.21.15.99:6817/972288266] boot 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: osdmap e415: 8 total, 8 up, 8 in 2024-01-13T18:06:36.182 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-13T18:06:36.682 INFO:tasks.rados.rados.0.smithi084.stdout:1728: done (2 left) 2024-01-13T18:06:36.682 INFO:tasks.rados.rados.0.smithi084.stdout:1729: rollback oid 30 current snap is 173 2024-01-13T18:06:36.682 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 165 2024-01-13T18:06:36.682 INFO:tasks.rados.rados.0.smithi084.stdout:1730: copy_from oid 11 from oid 46 current snap is 173 2024-01-13T18:06:36.682 INFO:tasks.rados.rados.0.smithi084.stdout:1731: setattr oid 37 current snap is 173 2024-01-13T18:06:36.682 INFO:tasks.rados.rados.0.smithi084.stdout:1727: finishing write tid 1 to smithi084102331-14 2024-01-13T18:06:36.682 INFO:tasks.rados.rados.0.smithi084.stdout:1727: finishing write tid 2 to smithi084102331-14 2024-01-13T18:06:36.682 INFO:tasks.rados.rados.0.smithi084.stdout:1727: finishing write tid 3 to smithi084102331-14 2024-01-13T18:06:36.683 INFO:tasks.rados.rados.0.smithi084.stdout:1727: finishing write tid 4 to smithi084102331-14 2024-01-13T18:06:36.683 INFO:tasks.rados.rados.0.smithi084.stdout:1727: finishing write tid 5 to smithi084102331-14 2024-01-13T18:06:36.683 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 814 (ObjNum 535 snap 173 seq_num 535) dirty exists 2024-01-13T18:06:36.683 INFO:tasks.rados.rados.0.smithi084.stdout:1727: left oid 14 (ObjNum 535 snap 173 seq_num 535) 2024-01-13T18:06:36.683 INFO:tasks.rados.rados.0.smithi084.stdout:1727: done (4 left) 2024-01-13T18:06:36.683 INFO:tasks.rados.rados.0.smithi084.stdout:1732: copy_from oid 3 from oid 19 current snap is 173 2024-01-13T18:06:36.683 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 173 2024-01-13T18:06:36.683 INFO:tasks.rados.rados.0.smithi084.stdout:1733: seq_num 536 ranges {5554176=581632,6135808=688128,6823936=516096} 2024-01-13T18:06:36.716 INFO:tasks.rados.rados.0.smithi084.stdout:1733: writing smithi084102331-21 from 5554176 to 6135808 tid 1 2024-01-13T18:06:36.720 INFO:tasks.rados.rados.0.smithi084.stdout:1733: writing smithi084102331-21 from 6135808 to 6823936 tid 2 2024-01-13T18:06:36.723 INFO:tasks.rados.rados.0.smithi084.stdout:1733: writing smithi084102331-21 from 6823936 to 7340032 tid 3 2024-01-13T18:06:36.723 INFO:tasks.rados.rados.0.smithi084.stdout:1734: snap_remove snap 170 2024-01-13T18:06:36.934 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:36 smithi099 ceph-mon[138788]: failed to encode map e415 with expected crc 2024-01-13T18:06:36.935 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:36 smithi099 ceph-mon[138788]: failed to encode map e415 with expected crc 2024-01-13T18:06:36.935 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:36 smithi099 ceph-mon[138788]: failed to encode map e415 with expected crc 2024-01-13T18:06:36.935 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:36 smithi099 ceph-mon[138788]: failed to encode map e415 with expected crc 2024-01-13T18:06:36.935 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:36 smithi099 ceph-mon[138788]: failed to encode map e415 with expected crc 2024-01-13T18:06:36.935 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:36 smithi099 ceph-mon[138788]: failed to encode map e415 with expected crc 2024-01-13T18:06:36.935 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:36 smithi099 ceph-mon[138788]: failed to encode map e415 with expected crc 2024-01-13T18:06:36.935 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:36 smithi099 ceph-mon[138788]: pgmap v334: 121 pgs: 7 peering, 6 active+undersized+degraded, 30 active+undersized, 78 active+clean; 178 MiB data, 1006 MiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 852 KiB/s wr, 4 op/s; 28/252 objects degraded (11.111%) 2024-01-13T18:06:36.935 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:36 smithi099 ceph-mon[138788]: osdmap e416: 8 total, 8 up, 8 in 2024-01-13T18:06:37.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[116404]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[116404]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[116404]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[116404]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[116404]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[116404]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[116404]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[116404]: pgmap v334: 121 pgs: 7 peering, 6 active+undersized+degraded, 30 active+undersized, 78 active+clean; 178 MiB data, 1006 MiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 852 KiB/s wr, 4 op/s; 28/252 objects degraded (11.111%) 2024-01-13T18:06:37.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[116404]: osdmap e416: 8 total, 8 up, 8 in 2024-01-13T18:06:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[119097]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[119097]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[119097]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[119097]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[119097]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[119097]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[119097]: failed to encode map e415 with expected crc 2024-01-13T18:06:37.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[119097]: pgmap v334: 121 pgs: 7 peering, 6 active+undersized+degraded, 30 active+undersized, 78 active+clean; 178 MiB data, 1006 MiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 852 KiB/s wr, 4 op/s; 28/252 objects degraded (11.111%) 2024-01-13T18:06:37.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:36 smithi084 ceph-mon[119097]: osdmap e416: 8 total, 8 up, 8 in 2024-01-13T18:06:37.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T18:06:37.201+0000 7fcaf82a4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-01-13T18:06:37.712 INFO:tasks.rados.rados.0.smithi084.stdout:1734: done (6 left) 2024-01-13T18:06:37.712 INFO:tasks.rados.rados.0.smithi084.stdout:1735: copy_from oid 48 from oid 17 current snap is 173 2024-01-13T18:06:37.712 INFO:tasks.rados.rados.0.smithi084.stdout:1736: snap_create 2024-01-13T18:06:37.712 INFO:tasks.rados.rados.0.smithi084.stdout:1726: expect (ObjNum 513 snap 164 seq_num 513) 2024-01-13T18:06:37.857 INFO:tasks.rados.rados.0.smithi084.stdout:1729: finishing rollback tid 0 to smithi084102331-30 2024-01-13T18:06:37.857 INFO:tasks.rados.rados.0.smithi084.stdout:1729: finishing rollback tid 1 to smithi084102331-30 2024-01-13T18:06:37.857 INFO:tasks.rados.rados.0.smithi084.stdout:1729: finishing rollback tid 2 to smithi084102331-30 2024-01-13T18:06:37.857 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 851 (ObjNum 506 snap 162 seq_num 506) dirty exists 2024-01-13T18:06:37.857 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 853 (ObjNum 65 snap 0 seq_num 1599427938) dirty exists 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1730: finishing copy_from to smithi084102331-11 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 548 (ObjNum 491 snap 155 seq_num 491) dirty exists 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1730: finishing copy_from racing read to smithi084102331-11 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1733: finishing write tid 1 to smithi084102331-21 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1733: finishing write tid 2 to smithi084102331-21 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1732: finishing copy_from to smithi084102331-3 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 548 (ObjNum 491 snap 155 seq_num 491) dirty exists 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1732: finishing copy_from racing read to smithi084102331-3 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1733: finishing write tid 3 to smithi084102331-21 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1733: finishing write tid 4 to smithi084102331-21 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1733: finishing write tid 5 to smithi084102331-21 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 632 (ObjNum 536 snap 173 seq_num 536) dirty exists 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1733: left oid 21 (ObjNum 536 snap 173 seq_num 536) 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1735: finishing copy_from to smithi084102331-48 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 640 (ObjNum 519 snap 166 seq_num 519) dirty exists 2024-01-13T18:06:37.858 INFO:tasks.rados.rados.0.smithi084.stdout:1735: finishing copy_from racing read to smithi084102331-48 2024-01-13T18:06:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: failed to encode map e416 with expected crc 2024-01-13T18:06:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: failed to encode map e416 with expected crc 2024-01-13T18:06:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: failed to encode map e416 with expected crc 2024-01-13T18:06:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 28/252 objects degraded (11.111%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:06:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:37 smithi099 ceph-mon[138788]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: failed to encode map e416 with expected crc 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: failed to encode map e416 with expected crc 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: failed to encode map e416 with expected crc 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 28/252 objects degraded (11.111%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[119097]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: failed to encode map e416 with expected crc 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: failed to encode map e416 with expected crc 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: failed to encode map e416 with expected crc 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 28/252 objects degraded (11.111%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:06:38.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:38.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:38.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:38.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:38.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:06:38.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:38.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:38.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:37 smithi084 ceph-mon[116404]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-01-13T18:06:38.726 INFO:tasks.rados.rados.0.smithi084.stdout:1726: done (7 left) 2024-01-13T18:06:38.726 INFO:tasks.rados.rados.0.smithi084.stdout:1729: done (6 left) 2024-01-13T18:06:38.726 INFO:tasks.rados.rados.0.smithi084.stdout:1730: done (5 left) 2024-01-13T18:06:38.726 INFO:tasks.rados.rados.0.smithi084.stdout:1731: done (4 left) 2024-01-13T18:06:38.726 INFO:tasks.rados.rados.0.smithi084.stdout:1732: done (3 left) 2024-01-13T18:06:38.726 INFO:tasks.rados.rados.0.smithi084.stdout:1733: done (2 left) 2024-01-13T18:06:38.726 INFO:tasks.rados.rados.0.smithi084.stdout:1735: done (1 left) 2024-01-13T18:06:38.726 INFO:tasks.rados.rados.0.smithi084.stdout:1736: done (0 left) 2024-01-13T18:06:38.726 INFO:tasks.rados.rados.0.smithi084.stdout:1737: delete oid 30 current snap is 174 2024-01-13T18:06:38.729 INFO:tasks.rados.rados.0.smithi084.stdout:1737: done (0 left) 2024-01-13T18:06:38.729 INFO:tasks.rados.rados.0.smithi084.stdout:1738: rollback oid 41 current snap is 174 2024-01-13T18:06:38.729 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 165 2024-01-13T18:06:38.729 INFO:tasks.rados.rados.0.smithi084.stdout:1739: read oid 42 snap -1 2024-01-13T18:06:38.730 INFO:tasks.rados.rados.0.smithi084.stdout:1739: expect (ObjNum 493 snap 157 seq_num 493) 2024-01-13T18:06:38.730 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 174 2024-01-13T18:06:38.730 INFO:tasks.rados.rados.0.smithi084.stdout:1740: seq_num 538 ranges {0=614400,614400=450560,1064960=704512,1769472=49152} 2024-01-13T18:06:38.733 INFO:tasks.rados.rados.0.smithi084.stdout:1740: writing smithi084102331-35 from 0 to 614400 tid 1 2024-01-13T18:06:38.738 INFO:tasks.rados.rados.0.smithi084.stdout:1740: writing smithi084102331-35 from 614400 to 1064960 tid 2 2024-01-13T18:06:38.740 INFO:tasks.rados.rados.0.smithi084.stdout:1740: writing smithi084102331-35 from 1064960 to 1769472 tid 3 2024-01-13T18:06:38.741 INFO:tasks.rados.rados.0.smithi084.stdout:1740: writing smithi084102331-35 from 1769472 to 1818624 tid 4 2024-01-13T18:06:38.741 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 174 2024-01-13T18:06:38.741 INFO:tasks.rados.rados.0.smithi084.stdout:1738: finishing rollback tid 1 to smithi084102331-41 2024-01-13T18:06:38.741 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-01-13T18:06:38.741 INFO:tasks.rados.rados.0.smithi084.stdout:1741: seq_num 539 ranges {966656=630784,1597440=737280,2334720=466944} 2024-01-13T18:06:38.750 INFO:tasks.rados.rados.0.smithi084.stdout:1741: writing smithi084102331-29 from 966656 to 1597440 tid 1 2024-01-13T18:06:38.754 INFO:tasks.rados.rados.0.smithi084.stdout:1741: writing smithi084102331-29 from 1597440 to 2334720 tid 2 2024-01-13T18:06:38.758 INFO:tasks.rados.rados.0.smithi084.stdout:1741: writing smithi084102331-29 from 2334720 to 2801664 tid 3 2024-01-13T18:06:38.758 INFO:tasks.rados.rados.0.smithi084.stdout:1738: done (3 left) 2024-01-13T18:06:38.758 INFO:tasks.rados.rados.0.smithi084.stdout:1742: read oid 41 snap -1 2024-01-13T18:06:38.758 INFO:tasks.rados.rados.0.smithi084.stdout:1742: expect deleted 2024-01-13T18:06:38.758 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 174 2024-01-13T18:06:38.758 INFO:tasks.rados.rados.0.smithi084.stdout:1740: finishing write tid 1 to smithi084102331-35 2024-01-13T18:06:38.758 INFO:tasks.rados.rados.0.smithi084.stdout:1740: finishing write tid 2 to smithi084102331-35 2024-01-13T18:06:38.758 INFO:tasks.rados.rados.0.smithi084.stdout:1743: seq_num 540 ranges {8888320=647168,9535488=671744,10207232=532480} 2024-01-13T18:06:38.808 INFO:tasks.rados.rados.0.smithi084.stdout:1743: writing smithi084102331-50 from 8888320 to 9535488 tid 1 2024-01-13T18:06:38.812 INFO:tasks.rados.rados.0.smithi084.stdout:1743: writing smithi084102331-50 from 9535488 to 10207232 tid 2 2024-01-13T18:06:38.815 INFO:tasks.rados.rados.0.smithi084.stdout:1743: writing smithi084102331-50 from 10207232 to 10739712 tid 3 2024-01-13T18:06:38.815 INFO:tasks.rados.rados.0.smithi084.stdout:1744: setattr oid 22 current snap is 174 2024-01-13T18:06:38.815 INFO:tasks.rados.rados.0.smithi084.stdout:1740: finishing write tid 3 to smithi084102331-35 2024-01-13T18:06:38.815 INFO:tasks.rados.rados.0.smithi084.stdout:1740: finishing write tid 4 to smithi084102331-35 2024-01-13T18:06:38.816 INFO:tasks.rados.rados.0.smithi084.stdout:1740: finishing write tid 5 to smithi084102331-35 2024-01-13T18:06:38.816 INFO:tasks.rados.rados.0.smithi084.stdout:1740: finishing write tid 6 to smithi084102331-35 2024-01-13T18:06:38.816 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 639 (ObjNum 538 snap 174 seq_num 538) dirty exists 2024-01-13T18:06:38.816 INFO:tasks.rados.rados.0.smithi084.stdout:1740: left oid 35 (ObjNum 538 snap 174 seq_num 538) 2024-01-13T18:06:38.816 INFO:tasks.rados.rados.0.smithi084.stdout:1741: finishing write tid 1 to smithi084102331-29 2024-01-13T18:06:38.816 INFO:tasks.rados.rados.0.smithi084.stdout:1739: expect (ObjNum 493 snap 157 seq_num 493) 2024-01-13T18:06:39.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:06:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:06:38.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:06:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:38 smithi099 ceph-mon[138788]: osdmap e417: 8 total, 8 up, 8 in 2024-01-13T18:06:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:38 smithi099 ceph-mon[138788]: failed to encode map e417 with expected crc 2024-01-13T18:06:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:38 smithi099 ceph-mon[138788]: pgmap v337: 121 pgs: 1 activating, 13 peering, 4 active+undersized+degraded, 1 active+recovery_wait+degraded, 19 active+undersized, 83 active+clean; 187 MiB data, 1019 MiB used, 714 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.9 MiB/s wr, 12 op/s; 14/273 objects degraded (5.128%) 2024-01-13T18:06:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:38 smithi084 ceph-mon[116404]: osdmap e417: 8 total, 8 up, 8 in 2024-01-13T18:06:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:38 smithi084 ceph-mon[116404]: failed to encode map e417 with expected crc 2024-01-13T18:06:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:38 smithi084 ceph-mon[116404]: pgmap v337: 121 pgs: 1 activating, 13 peering, 4 active+undersized+degraded, 1 active+recovery_wait+degraded, 19 active+undersized, 83 active+clean; 187 MiB data, 1019 MiB used, 714 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.9 MiB/s wr, 12 op/s; 14/273 objects degraded (5.128%) 2024-01-13T18:06:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:38 smithi084 ceph-mon[119097]: osdmap e417: 8 total, 8 up, 8 in 2024-01-13T18:06:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:38 smithi084 ceph-mon[119097]: failed to encode map e417 with expected crc 2024-01-13T18:06:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:38 smithi084 ceph-mon[119097]: pgmap v337: 121 pgs: 1 activating, 13 peering, 4 active+undersized+degraded, 1 active+recovery_wait+degraded, 19 active+undersized, 83 active+clean; 187 MiB data, 1019 MiB used, 714 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.9 MiB/s wr, 12 op/s; 14/273 objects degraded (5.128%) 2024-01-13T18:06:39.281 INFO:tasks.rados.rados.0.smithi084.stdout:1741: finishing write tid 2 to smithi084102331-29 2024-01-13T18:06:39.281 INFO:tasks.rados.rados.0.smithi084.stdout:1741: finishing write tid 3 to smithi084102331-29 2024-01-13T18:06:39.281 INFO:tasks.rados.rados.0.smithi084.stdout:1741: finishing write tid 4 to smithi084102331-29 2024-01-13T18:06:39.281 INFO:tasks.rados.rados.0.smithi084.stdout:1741: finishing write tid 5 to smithi084102331-29 2024-01-13T18:06:39.281 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 644 (ObjNum 539 snap 174 seq_num 539) dirty exists 2024-01-13T18:06:39.281 INFO:tasks.rados.rados.0.smithi084.stdout:1741: left oid 29 (ObjNum 539 snap 174 seq_num 539) 2024-01-13T18:06:39.281 INFO:tasks.rados.rados.0.smithi084.stdout:1743: finishing write tid 1 to smithi084102331-50 2024-01-13T18:06:39.281 INFO:tasks.rados.rados.0.smithi084.stdout:1743: finishing write tid 2 to smithi084102331-50 2024-01-13T18:06:39.281 INFO:tasks.rados.rados.0.smithi084.stdout:1743: finishing write tid 3 to smithi084102331-50 2024-01-13T18:06:39.281 INFO:tasks.rados.rados.0.smithi084.stdout:1743: finishing write tid 4 to smithi084102331-50 2024-01-13T18:06:39.282 INFO:tasks.rados.rados.0.smithi084.stdout:1743: finishing write tid 5 to smithi084102331-50 2024-01-13T18:06:39.282 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 866 (ObjNum 540 snap 174 seq_num 540) dirty exists 2024-01-13T18:06:39.282 INFO:tasks.rados.rados.0.smithi084.stdout:1743: left oid 50 (ObjNum 540 snap 174 seq_num 540) 2024-01-13T18:06:39.282 INFO:tasks.rados.rados.0.smithi084.stdout:1739: done (5 left) 2024-01-13T18:06:39.282 INFO:tasks.rados.rados.0.smithi084.stdout:1740: done (4 left) 2024-01-13T18:06:39.282 INFO:tasks.rados.rados.0.smithi084.stdout:1741: done (3 left) 2024-01-13T18:06:39.282 INFO:tasks.rados.rados.0.smithi084.stdout:1742: done (2 left) 2024-01-13T18:06:39.282 INFO:tasks.rados.rados.0.smithi084.stdout:1743: done (1 left) 2024-01-13T18:06:39.282 INFO:tasks.rados.rados.0.smithi084.stdout:1745: rmattr oid 38 current snap is 174 2024-01-13T18:06:39.282 INFO:tasks.rados.rados.0.smithi084.stdout:1746: snap_create 2024-01-13T18:06:39.282 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1019 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-01-13T18:06:39.283 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1036 (ObjNum 474 snap 148 seq_num 474) dirty exists 2024-01-13T18:06:39.721 INFO:tasks.rados.rados.0.smithi084.stdout:1744: done (2 left) 2024-01-13T18:06:39.721 INFO:tasks.rados.rados.0.smithi084.stdout:1745: done (1 left) 2024-01-13T18:06:39.721 INFO:tasks.rados.rados.0.smithi084.stdout:1746: done (0 left) 2024-01-13T18:06:39.721 INFO:tasks.rados.rados.0.smithi084.stdout:1747: snap_remove snap 173 2024-01-13T18:06:40.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:39 smithi099 ceph-mon[138788]: failed to encode map e418 with expected crc 2024-01-13T18:06:40.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:39 smithi099 ceph-mon[138788]: osdmap e418: 8 total, 8 up, 8 in 2024-01-13T18:06:40.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:39 smithi084 ceph-mon[116404]: failed to encode map e418 with expected crc 2024-01-13T18:06:40.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:39 smithi084 ceph-mon[116404]: osdmap e418: 8 total, 8 up, 8 in 2024-01-13T18:06:40.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:39 smithi084 ceph-mon[119097]: failed to encode map e418 with expected crc 2024-01-13T18:06:40.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:39 smithi084 ceph-mon[119097]: osdmap e418: 8 total, 8 up, 8 in 2024-01-13T18:06:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:06:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:06:40] "GET /metrics HTTP/1.1" 200 36054 "" "Prometheus/2.43.0" 2024-01-13T18:06:40.723 INFO:tasks.rados.rados.0.smithi084.stdout:1747: done (0 left) 2024-01-13T18:06:40.724 INFO:tasks.rados.rados.0.smithi084.stdout:1748: delete oid 49 current snap is 175 2024-01-13T18:06:40.728 INFO:tasks.rados.rados.0.smithi084.stdout:1748: done (0 left) 2024-01-13T18:06:40.728 INFO:tasks.rados.rados.0.smithi084.stdout:1749: delete oid 40 current snap is 175 2024-01-13T18:06:40.738 INFO:tasks.rados.rados.0.smithi084.stdout:1749: done (0 left) 2024-01-13T18:06:40.738 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 175 2024-01-13T18:06:40.738 INFO:tasks.rados.rados.0.smithi084.stdout:1750: seq_num 543 ranges {4497408=704512,5201920=729088,5931008=475136} 2024-01-13T18:06:40.766 INFO:tasks.rados.rados.0.smithi084.stdout:1750: writing smithi084102331-15 from 4497408 to 5201920 tid 1 2024-01-13T18:06:40.770 INFO:tasks.rados.rados.0.smithi084.stdout:1750: writing smithi084102331-15 from 5201920 to 5931008 tid 2 2024-01-13T18:06:40.774 INFO:tasks.rados.rados.0.smithi084.stdout:1750: writing smithi084102331-15 from 5931008 to 6406144 tid 3 2024-01-13T18:06:40.774 INFO:tasks.rados.rados.0.smithi084.stdout:1751: delete oid 41 current snap is 175 2024-01-13T18:06:40.774 INFO:tasks.rados.rados.0.smithi084.stdout:1750: finishing write tid 1 to smithi084102331-15 2024-01-13T18:06:40.774 INFO:tasks.rados.rados.0.smithi084.stdout:1750: finishing write tid 2 to smithi084102331-15 2024-01-13T18:06:40.776 INFO:tasks.rados.rados.0.smithi084.stdout:1751: done (1 left) 2024-01-13T18:06:40.776 INFO:tasks.rados.rados.0.smithi084.stdout:1752: read oid 43 snap -1 2024-01-13T18:06:40.776 INFO:tasks.rados.rados.0.smithi084.stdout:1752: expect (ObjNum 445 snap 139 seq_num 445) 2024-01-13T18:06:40.776 INFO:tasks.rados.rados.0.smithi084.stdout:1753: read oid 27 snap -1 2024-01-13T18:06:40.776 INFO:tasks.rados.rados.0.smithi084.stdout:1753: expect (ObjNum 531 snap 168 seq_num 531) 2024-01-13T18:06:40.776 INFO:tasks.rados.rados.0.smithi084.stdout:1754: snap_remove snap 174 2024-01-13T18:06:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:40 smithi099 ceph-mon[138788]: failed to encode map e419 with expected crc 2024-01-13T18:06:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:40 smithi099 ceph-mon[138788]: osdmap e419: 8 total, 8 up, 8 in 2024-01-13T18:06:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:40 smithi099 ceph-mon[138788]: pgmap v340: 121 pgs: 1 activating, 13 peering, 1 active+recovery_wait+degraded, 106 active+clean; 190 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 18 op/s; 4/288 objects degraded (1.389%); 1.7 MiB/s, 0 objects/s recovering 2024-01-13T18:06:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:40 smithi099 ceph-mon[138788]: osdmap e420: 8 total, 8 up, 8 in 2024-01-13T18:06:41.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:40 smithi084 ceph-mon[116404]: failed to encode map e419 with expected crc 2024-01-13T18:06:41.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:40 smithi084 ceph-mon[116404]: osdmap e419: 8 total, 8 up, 8 in 2024-01-13T18:06:41.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:40 smithi084 ceph-mon[116404]: pgmap v340: 121 pgs: 1 activating, 13 peering, 1 active+recovery_wait+degraded, 106 active+clean; 190 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 18 op/s; 4/288 objects degraded (1.389%); 1.7 MiB/s, 0 objects/s recovering 2024-01-13T18:06:41.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:40 smithi084 ceph-mon[116404]: osdmap e420: 8 total, 8 up, 8 in 2024-01-13T18:06:41.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:40 smithi084 ceph-mon[119097]: failed to encode map e419 with expected crc 2024-01-13T18:06:41.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:40 smithi084 ceph-mon[119097]: osdmap e419: 8 total, 8 up, 8 in 2024-01-13T18:06:41.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:40 smithi084 ceph-mon[119097]: pgmap v340: 121 pgs: 1 activating, 13 peering, 1 active+recovery_wait+degraded, 106 active+clean; 190 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 18 op/s; 4/288 objects degraded (1.389%); 1.7 MiB/s, 0 objects/s recovering 2024-01-13T18:06:41.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:40 smithi084 ceph-mon[119097]: osdmap e420: 8 total, 8 up, 8 in 2024-01-13T18:06:41.752 INFO:tasks.rados.rados.0.smithi084.stdout:1754: done (3 left) 2024-01-13T18:06:41.752 INFO:tasks.rados.rados.0.smithi084.stdout:1755: read oid 20 snap -1 2024-01-13T18:06:41.752 INFO:tasks.rados.rados.0.smithi084.stdout:1755: expect deleted 2024-01-13T18:06:41.753 INFO:tasks.rados.rados.0.smithi084.stdout:1756: read oid 50 snap -1 2024-01-13T18:06:41.754 INFO:tasks.rados.rados.0.smithi084.stdout:1756: expect (ObjNum 540 snap 174 seq_num 540) 2024-01-13T18:06:41.754 INFO:tasks.rados.rados.0.smithi084.stdout:1757: setattr oid 44 current snap is 175 2024-01-13T18:06:41.754 INFO:tasks.rados.rados.0.smithi084.stdout:1750: finishing write tid 3 to smithi084102331-15 2024-01-13T18:06:41.754 INFO:tasks.rados.rados.0.smithi084.stdout:1750: finishing write tid 4 to smithi084102331-15 2024-01-13T18:06:41.754 INFO:tasks.rados.rados.0.smithi084.stdout:1750: finishing write tid 5 to smithi084102331-15 2024-01-13T18:06:41.754 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 927 (ObjNum 543 snap 175 seq_num 543) dirty exists 2024-01-13T18:06:41.754 INFO:tasks.rados.rados.0.smithi084.stdout:1750: left oid 15 (ObjNum 543 snap 175 seq_num 543) 2024-01-13T18:06:41.754 INFO:tasks.rados.rados.0.smithi084.stdout:1752: expect (ObjNum 445 snap 139 seq_num 445) 2024-01-13T18:06:41.837 INFO:tasks.rados.rados.0.smithi084.stdout:1753: expect (ObjNum 531 snap 168 seq_num 531) 2024-01-13T18:06:42.007 INFO:tasks.rados.rados.0.smithi084.stdout:1756: expect (ObjNum 540 snap 174 seq_num 540) 2024-01-13T18:06:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:41 smithi099 ceph-mon[138788]: failed to encode map e420 with expected crc 2024-01-13T18:06:42.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:41 smithi084 ceph-mon[116404]: failed to encode map e420 with expected crc 2024-01-13T18:06:42.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:41 smithi084 ceph-mon[119097]: failed to encode map e420 with expected crc 2024-01-13T18:06:42.868 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 931 (ObjNum 522 snap 166 seq_num 522) dirty exists 2024-01-13T18:06:42.868 INFO:tasks.rados.rados.0.smithi084.stdout:1750: done (5 left) 2024-01-13T18:06:42.868 INFO:tasks.rados.rados.0.smithi084.stdout:1752: done (4 left) 2024-01-13T18:06:42.868 INFO:tasks.rados.rados.0.smithi084.stdout:1753: done (3 left) 2024-01-13T18:06:42.868 INFO:tasks.rados.rados.0.smithi084.stdout:1755: done (2 left) 2024-01-13T18:06:42.868 INFO:tasks.rados.rados.0.smithi084.stdout:1756: done (1 left) 2024-01-13T18:06:42.868 INFO:tasks.rados.rados.0.smithi084.stdout:1757: done (0 left) 2024-01-13T18:06:42.868 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 175 2024-01-13T18:06:42.868 INFO:tasks.rados.rados.0.smithi084.stdout:1758: seq_num 545 ranges {2048000=737280,2785280=491520,3276800=450560,3727360=262144} 2024-01-13T18:06:42.882 INFO:tasks.rados.rados.0.smithi084.stdout:1758: writing smithi084102331-43 from 2048000 to 2785280 tid 1 2024-01-13T18:06:42.885 INFO:tasks.rados.rados.0.smithi084.stdout:1758: writing smithi084102331-43 from 2785280 to 3276800 tid 2 2024-01-13T18:06:42.887 INFO:tasks.rados.rados.0.smithi084.stdout:1758: writing smithi084102331-43 from 3276800 to 3727360 tid 3 2024-01-13T18:06:42.889 INFO:tasks.rados.rados.0.smithi084.stdout:1758: writing smithi084102331-43 from 3727360 to 3989504 tid 4 2024-01-13T18:06:42.889 INFO:tasks.rados.rados.0.smithi084.stdout:1759: read oid 34 snap -1 2024-01-13T18:06:42.890 INFO:tasks.rados.rados.0.smithi084.stdout:1759: expect deleted 2024-01-13T18:06:42.890 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 175 2024-01-13T18:06:42.890 INFO:tasks.rados.rados.0.smithi084.stdout:1760: seq_num 546 ranges {3465216=753664,4218880=778240,4997120=425984} 2024-01-13T18:06:42.911 INFO:tasks.rados.rados.0.smithi084.stdout:1760: writing smithi084102331-5 from 3465216 to 4218880 tid 1 2024-01-13T18:06:42.916 INFO:tasks.rados.rados.0.smithi084.stdout:1760: writing smithi084102331-5 from 4218880 to 4997120 tid 2 2024-01-13T18:06:42.919 INFO:tasks.rados.rados.0.smithi084.stdout:1760: writing smithi084102331-5 from 4997120 to 5423104 tid 3 2024-01-13T18:06:42.919 INFO:tasks.rados.rados.0.smithi084.stdout:1761: read oid 17 snap -1 2024-01-13T18:06:42.919 INFO:tasks.rados.rados.0.smithi084.stdout:1761: expect (ObjNum 519 snap 166 seq_num 519) 2024-01-13T18:06:42.919 INFO:tasks.rados.rados.0.smithi084.stdout:1762: copy_from oid 33 from oid 6 current snap is 175 2024-01-13T18:06:42.919 INFO:tasks.rados.rados.0.smithi084.stdout:1758: finishing write tid 1 to smithi084102331-43 2024-01-13T18:06:42.919 INFO:tasks.rados.rados.0.smithi084.stdout:1758: finishing write tid 2 to smithi084102331-43 2024-01-13T18:06:42.920 INFO:tasks.rados.rados.0.smithi084.stdout:1758: finishing write tid 3 to smithi084102331-43 2024-01-13T18:06:42.920 INFO:tasks.rados.rados.0.smithi084.stdout:1759: done (4 left) 2024-01-13T18:06:42.920 INFO:tasks.rados.rados.0.smithi084.stdout:1763: snap_create 2024-01-13T18:06:42.920 INFO:tasks.rados.rados.0.smithi084.stdout:1758: finishing write tid 4 to smithi084102331-43 2024-01-13T18:06:42.920 INFO:tasks.rados.rados.0.smithi084.stdout:1758: finishing write tid 5 to smithi084102331-43 2024-01-13T18:06:42.920 INFO:tasks.rados.rados.0.smithi084.stdout:1758: finishing write tid 6 to smithi084102331-43 2024-01-13T18:06:42.920 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 594 (ObjNum 545 snap 175 seq_num 545) dirty exists 2024-01-13T18:06:42.920 INFO:tasks.rados.rados.0.smithi084.stdout:1758: left oid 43 (ObjNum 545 snap 175 seq_num 545) 2024-01-13T18:06:42.920 INFO:tasks.rados.rados.0.smithi084.stdout:1760: finishing write tid 1 to smithi084102331-5 2024-01-13T18:06:42.920 INFO:tasks.rados.rados.0.smithi084.stdout:1760: finishing write tid 2 to smithi084102331-5 2024-01-13T18:06:42.921 INFO:tasks.rados.rados.0.smithi084.stdout:1762: finishing copy_from to smithi084102331-33 2024-01-13T18:06:42.921 INFO:tasks.rados.rados.0.smithi084.stdout:1762: got expected ENOENT (src dne) 2024-01-13T18:06:42.921 INFO:tasks.rados.rados.0.smithi084.stdout:1762: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:06:42.921 INFO:tasks.rados.rados.0.smithi084.stdout:1760: finishing write tid 3 to smithi084102331-5 2024-01-13T18:06:42.921 INFO:tasks.rados.rados.0.smithi084.stdout:1760: finishing write tid 4 to smithi084102331-5 2024-01-13T18:06:42.928 INFO:tasks.rados.rados.0.smithi084.stdout:1760: finishing write tid 5 to smithi084102331-5 2024-01-13T18:06:42.928 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 649 (ObjNum 546 snap 175 seq_num 546) dirty exists 2024-01-13T18:06:42.928 INFO:tasks.rados.rados.0.smithi084.stdout:1760: left oid 5 (ObjNum 546 snap 175 seq_num 546) 2024-01-13T18:06:42.931 INFO:tasks.rados.rados.0.smithi084.stdout:1761: expect (ObjNum 519 snap 166 seq_num 519) 2024-01-13T18:06:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:42 smithi099 ceph-mon[138788]: failed to encode map e421 with expected crc 2024-01-13T18:06:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:42 smithi099 ceph-mon[138788]: osdmap e421: 8 total, 8 up, 8 in 2024-01-13T18:06:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:42 smithi099 ceph-mon[138788]: failed to encode map e421 with expected crc 2024-01-13T18:06:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:42 smithi099 ceph-mon[138788]: pgmap v343: 121 pgs: 121 active+clean; 199 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.6 MiB/s wr, 25 op/s; 9.8 MiB/s, 2 objects/s recovering 2024-01-13T18:06:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:42 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 4/288 objects degraded (1.389%), 1 pg degraded (PG_DEGRADED) 2024-01-13T18:06:43.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:42 smithi084 ceph-mon[116404]: failed to encode map e421 with expected crc 2024-01-13T18:06:43.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:42 smithi084 ceph-mon[116404]: osdmap e421: 8 total, 8 up, 8 in 2024-01-13T18:06:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:42 smithi084 ceph-mon[116404]: failed to encode map e421 with expected crc 2024-01-13T18:06:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:42 smithi084 ceph-mon[116404]: pgmap v343: 121 pgs: 121 active+clean; 199 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.6 MiB/s wr, 25 op/s; 9.8 MiB/s, 2 objects/s recovering 2024-01-13T18:06:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:42 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 4/288 objects degraded (1.389%), 1 pg degraded (PG_DEGRADED) 2024-01-13T18:06:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:42 smithi084 ceph-mon[119097]: failed to encode map e421 with expected crc 2024-01-13T18:06:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:42 smithi084 ceph-mon[119097]: osdmap e421: 8 total, 8 up, 8 in 2024-01-13T18:06:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:42 smithi084 ceph-mon[119097]: failed to encode map e421 with expected crc 2024-01-13T18:06:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:42 smithi084 ceph-mon[119097]: pgmap v343: 121 pgs: 121 active+clean; 199 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.6 MiB/s wr, 25 op/s; 9.8 MiB/s, 2 objects/s recovering 2024-01-13T18:06:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:42 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 4/288 objects degraded (1.389%), 1 pg degraded (PG_DEGRADED) 2024-01-13T18:06:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:1758: done (4 left) 2024-01-13T18:06:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:1760: done (3 left) 2024-01-13T18:06:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:1761: done (2 left) 2024-01-13T18:06:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:1762: done (1 left) 2024-01-13T18:06:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:1763: done (0 left) 2024-01-13T18:06:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:1764: rollback oid 1 current snap is 176 2024-01-13T18:06:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 1 to 175 2024-01-13T18:06:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:1765: read oid 38 snap -1 2024-01-13T18:06:43.769 INFO:tasks.rados.rados.0.smithi084.stdout:1765: expect (ObjNum 474 snap 148 seq_num 474) 2024-01-13T18:06:43.769 INFO:tasks.rados.rados.0.smithi084.stdout:1766: rollback oid 28 current snap is 176 2024-01-13T18:06:43.769 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 28 to 171 2024-01-13T18:06:43.769 INFO:tasks.rados.rados.0.smithi084.stdout:1767: delete oid 39 current snap is 176 2024-01-13T18:06:43.773 INFO:tasks.rados.rados.0.smithi084.stdout:1766: finishing rollback tid 0 to smithi084102331-28 2024-01-13T18:06:43.773 INFO:tasks.rados.rados.0.smithi084.stdout:1766: finishing rollback tid 1 to smithi084102331-28 2024-01-13T18:06:43.773 INFO:tasks.rados.rados.0.smithi084.stdout:1767: done (3 left) 2024-01-13T18:06:43.773 INFO:tasks.rados.rados.0.smithi084.stdout:1768: snap_create 2024-01-13T18:06:43.773 INFO:tasks.rados.rados.0.smithi084.stdout:1766: finishing rollback tid 2 to smithi084102331-28 2024-01-13T18:06:43.773 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 530 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:06:43.776 INFO:tasks.rados.rados.0.smithi084.stdout:1764: finishing rollback tid 0 to smithi084102331-1 2024-01-13T18:06:43.778 INFO:tasks.rados.rados.0.smithi084.stdout:1764: finishing rollback tid 1 to smithi084102331-1 2024-01-13T18:06:43.778 INFO:tasks.rados.rados.0.smithi084.stdout:1764: finishing rollback tid 2 to smithi084102331-1 2024-01-13T18:06:43.778 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1042 (ObjNum 513 snap 164 seq_num 513) dirty exists 2024-01-13T18:06:43.781 INFO:tasks.rados.rados.0.smithi084.stdout:1765: expect (ObjNum 474 snap 148 seq_num 474) 2024-01-13T18:06:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:43 smithi099 ceph-mon[138788]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/288 objects degraded (1.389%), 1 pg degraded) 2024-01-13T18:06:44.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:43 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:06:44.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:43 smithi084 ceph-mon[116404]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/288 objects degraded (1.389%), 1 pg degraded) 2024-01-13T18:06:44.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:43 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:06:44.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:43 smithi084 ceph-mon[119097]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/288 objects degraded (1.389%), 1 pg degraded) 2024-01-13T18:06:44.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:43 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:06:44.774 INFO:tasks.rados.rados.0.smithi084.stdout:1764: done (3 left) 2024-01-13T18:06:44.775 INFO:tasks.rados.rados.0.smithi084.stdout:1765: done (2 left) 2024-01-13T18:06:44.775 INFO:tasks.rados.rados.0.smithi084.stdout:1766: done (1 left) 2024-01-13T18:06:44.775 INFO:tasks.rados.rados.0.smithi084.stdout:1768: done (0 left) 2024-01-13T18:06:44.775 INFO:tasks.rados.rados.0.smithi084.stdout:1769: read oid 21 snap 165 2024-01-13T18:06:44.775 INFO:tasks.rados.rados.0.smithi084.stdout:1769: expect (ObjNum 442 snap 138 seq_num 442) 2024-01-13T18:06:44.775 INFO:tasks.rados.rados.0.smithi084.stdout:1770: delete oid 43 current snap is 177 2024-01-13T18:06:44.786 INFO:tasks.rados.rados.0.smithi084.stdout:1770: done (1 left) 2024-01-13T18:06:44.786 INFO:tasks.rados.rados.0.smithi084.stdout:1771: snap_remove snap 176 2024-01-13T18:06:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:44 smithi099 ceph-mon[138788]: osdmap e422: 8 total, 8 up, 8 in 2024-01-13T18:06:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:44 smithi099 ceph-mon[138788]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:44 smithi099 ceph-mon[138788]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:44 smithi099 ceph-mon[138788]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:44 smithi099 ceph-mon[138788]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:44 smithi099 ceph-mon[138788]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:44 smithi099 ceph-mon[138788]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:44 smithi099 ceph-mon[138788]: pgmap v345: 121 pgs: 121 active+clean; 201 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 21 op/s; 7.5 MiB/s, 1 objects/s recovering 2024-01-13T18:06:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[116404]: osdmap e422: 8 total, 8 up, 8 in 2024-01-13T18:06:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[116404]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[116404]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[116404]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[116404]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[116404]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[116404]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[116404]: pgmap v345: 121 pgs: 121 active+clean; 201 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 21 op/s; 7.5 MiB/s, 1 objects/s recovering 2024-01-13T18:06:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[119097]: osdmap e422: 8 total, 8 up, 8 in 2024-01-13T18:06:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[119097]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[119097]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[119097]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[119097]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[119097]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[119097]: failed to encode map e422 with expected crc 2024-01-13T18:06:45.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:44 smithi084 ceph-mon[119097]: pgmap v345: 121 pgs: 121 active+clean; 201 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 21 op/s; 7.5 MiB/s, 1 objects/s recovering 2024-01-13T18:06:45.780 INFO:tasks.rados.rados.0.smithi084.stdout:1771: done (1 left) 2024-01-13T18:06:45.780 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 177 2024-01-13T18:06:45.780 INFO:tasks.rados.rados.0.smithi084.stdout:1772: seq_num 549 ranges {0=802816,802816=483328,1286144=434176,1720320=286720} 2024-01-13T18:06:45.784 INFO:tasks.rados.rados.0.smithi084.stdout:1772: writing smithi084102331-34 from 0 to 802816 tid 1 2024-01-13T18:06:45.787 INFO:tasks.rados.rados.0.smithi084.stdout:1772: writing smithi084102331-34 from 802816 to 1286144 tid 2 2024-01-13T18:06:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:1772: writing smithi084102331-34 from 1286144 to 1720320 tid 3 2024-01-13T18:06:45.792 INFO:tasks.rados.rados.0.smithi084.stdout:1772: writing smithi084102331-34 from 1720320 to 2007040 tid 4 2024-01-13T18:06:45.792 INFO:tasks.rados.rados.0.smithi084.stdout:1773: setattr oid 32 current snap is 177 2024-01-13T18:06:45.793 INFO:tasks.rados.rados.0.smithi084.stdout:1769: expect (ObjNum 442 snap 138 seq_num 442) 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:1772: finishing write tid 1 to smithi084102331-34 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:1772: finishing write tid 2 to smithi084102331-34 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:1772: finishing write tid 3 to smithi084102331-34 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:1772: finishing write tid 4 to smithi084102331-34 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:1772: finishing write tid 5 to smithi084102331-34 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:1772: finishing write tid 6 to smithi084102331-34 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 560 (ObjNum 549 snap 177 seq_num 549) dirty exists 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:1772: left oid 34 (ObjNum 549 snap 177 seq_num 549) 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:1769: done (2 left) 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:1772: done (1 left) 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 177 2024-01-13T18:06:45.970 INFO:tasks.rados.rados.0.smithi084.stdout:1774: seq_num 550 ranges {0=417792,417792=770048,1187840=638976,1826816=196608} 2024-01-13T18:06:45.972 INFO:tasks.rados.rados.0.smithi084.stdout:1774: writing smithi084102331-20 from 0 to 417792 tid 1 2024-01-13T18:06:45.976 INFO:tasks.rados.rados.0.smithi084.stdout:1774: writing smithi084102331-20 from 417792 to 1187840 tid 2 2024-01-13T18:06:45.980 INFO:tasks.rados.rados.0.smithi084.stdout:1774: writing smithi084102331-20 from 1187840 to 1826816 tid 3 2024-01-13T18:06:45.982 INFO:tasks.rados.rados.0.smithi084.stdout:1774: writing smithi084102331-20 from 1826816 to 2023424 tid 4 2024-01-13T18:06:45.982 INFO:tasks.rados.rados.0.smithi084.stdout:1775: copy_from oid 45 from oid 28 current snap is 177 2024-01-13T18:06:45.982 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 933 (ObjNum 514 snap 164 seq_num 514) dirty exists 2024-01-13T18:06:45.982 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 1 to smithi084102331-20 2024-01-13T18:06:45.982 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 2 to smithi084102331-20 2024-01-13T18:06:45.982 INFO:tasks.rados.rados.0.smithi084.stdout:1773: done (2 left) 2024-01-13T18:06:45.982 INFO:tasks.rados.rados.0.smithi084.stdout:1776: rollback oid 3 current snap is 177 2024-01-13T18:06:45.982 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 171 2024-01-13T18:06:45.982 INFO:tasks.rados.rados.0.smithi084.stdout:1777: delete oid 29 current snap is 177 2024-01-13T18:06:45.985 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 3 to smithi084102331-20 2024-01-13T18:06:45.985 INFO:tasks.rados.rados.0.smithi084.stdout:1777: done (3 left) 2024-01-13T18:06:45.985 INFO:tasks.rados.rados.0.smithi084.stdout:1778: copy_from oid 48 from oid 22 current snap is 177 2024-01-13T18:06:45.985 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 4 to smithi084102331-20 2024-01-13T18:06:45.985 INFO:tasks.rados.rados.0.smithi084.stdout:1779: copy_from oid 35 from oid 4 current snap is 177 2024-01-13T18:06:45.985 INFO:tasks.rados.rados.0.smithi084.stdout:1780: read oid 47 snap -1 2024-01-13T18:06:45.985 INFO:tasks.rados.rados.0.smithi084.stdout:1780: expect deleted 2024-01-13T18:06:45.985 INFO:tasks.rados.rados.0.smithi084.stdout:1781: delete oid 23 current snap is 177 2024-01-13T18:06:45.986 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 5 to smithi084102331-20 2024-01-13T18:06:45.986 INFO:tasks.rados.rados.0.smithi084.stdout:1776: finishing rollback tid 0 to smithi084102331-3 2024-01-13T18:06:45.987 INFO:tasks.rados.rados.0.smithi084.stdout:1776: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:06:45.987 INFO:tasks.rados.rados.0.smithi084.stdout:1776: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:06:45.987 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1046 (ObjNum 529 snap 168 seq_num 529) dirty exists 2024-01-13T18:06:45.991 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 6 to smithi084102331-20 2024-01-13T18:06:45.991 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 617 (ObjNum 550 snap 177 seq_num 550) dirty exists 2024-01-13T18:06:45.991 INFO:tasks.rados.rados.0.smithi084.stdout:1774: left oid 20 (ObjNum 550 snap 177 seq_num 550) 2024-01-13T18:06:45.994 INFO:tasks.rados.rados.0.smithi084.stdout:1775: finishing copy_from to smithi084102331-45 2024-01-13T18:06:45.994 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 530 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:06:45.995 INFO:tasks.rados.rados.0.smithi084.stdout:1774: done (6 left) 2024-01-13T18:06:45.995 INFO:tasks.rados.rados.0.smithi084.stdout:1776: done (5 left) 2024-01-13T18:06:45.995 INFO:tasks.rados.rados.0.smithi084.stdout:1780: done (4 left) 2024-01-13T18:06:45.995 INFO:tasks.rados.rados.0.smithi084.stdout:1781: done (3 left) 2024-01-13T18:06:45.995 INFO:tasks.rados.rados.0.smithi084.stdout:1782: rmattr oid 33 current snap is 177 2024-01-13T18:06:45.995 INFO:tasks.rados.rados.0.smithi084.stdout:1782: done (3 left) 2024-01-13T18:06:45.995 INFO:tasks.rados.rados.0.smithi084.stdout:1783: read oid 7 snap -1 2024-01-13T18:06:45.995 INFO:tasks.rados.rados.0.smithi084.stdout:1783: expect (ObjNum 508 snap 162 seq_num 508) 2024-01-13T18:06:45.995 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 177 2024-01-13T18:06:45.995 INFO:tasks.rados.rados.0.smithi084.stdout:1778: finishing copy_from to smithi084102331-48 2024-01-13T18:06:45.996 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1019 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-01-13T18:06:45.996 INFO:tasks.rados.rados.0.smithi084.stdout:1784: seq_num 553 ranges {1548288=466944,2015232=417792,2433024=417792,2850816=516096,3366912=253952} 2024-01-13T18:06:46.006 INFO:tasks.rados.rados.0.smithi084.stdout:1784: writing smithi084102331-44 from 1548288 to 2015232 tid 1 2024-01-13T18:06:46.009 INFO:tasks.rados.rados.0.smithi084.stdout:1784: writing smithi084102331-44 from 2015232 to 2433024 tid 2 2024-01-13T18:06:46.012 INFO:tasks.rados.rados.0.smithi084.stdout:1784: writing smithi084102331-44 from 2433024 to 2850816 tid 3 2024-01-13T18:06:46.015 INFO:tasks.rados.rados.0.smithi084.stdout:1784: writing smithi084102331-44 from 2850816 to 3366912 tid 4 2024-01-13T18:06:46.017 INFO:tasks.rados.rados.0.smithi084.stdout:1784: writing smithi084102331-44 from 3366912 to 3620864 tid 5 2024-01-13T18:06:46.017 INFO:tasks.rados.rados.0.smithi084.stdout:1785: delete oid 42 current snap is 177 2024-01-13T18:06:46.017 INFO:tasks.rados.rados.0.smithi084.stdout:1775: finishing copy_from racing read to smithi084102331-45 2024-01-13T18:06:46.017 INFO:tasks.rados.rados.0.smithi084.stdout:1778: finishing copy_from racing read to smithi084102331-48 2024-01-13T18:06:46.017 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 1 to smithi084102331-44 2024-01-13T18:06:46.018 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 2 to smithi084102331-44 2024-01-13T18:06:46.018 INFO:tasks.rados.rados.0.smithi084.stdout:1783: expect (ObjNum 508 snap 162 seq_num 508) 2024-01-13T18:06:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:45 smithi099 ceph-mon[138788]: failed to encode map e423 with expected crc 2024-01-13T18:06:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:45 smithi099 ceph-mon[138788]: osdmap e423: 8 total, 8 up, 8 in 2024-01-13T18:06:46.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:45 smithi084 ceph-mon[116404]: failed to encode map e423 with expected crc 2024-01-13T18:06:46.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:45 smithi084 ceph-mon[116404]: osdmap e423: 8 total, 8 up, 8 in 2024-01-13T18:06:46.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:45 smithi084 ceph-mon[119097]: failed to encode map e423 with expected crc 2024-01-13T18:06:46.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:45 smithi084 ceph-mon[119097]: osdmap e423: 8 total, 8 up, 8 in 2024-01-13T18:06:46.315 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 3 to smithi084102331-44 2024-01-13T18:06:46.316 INFO:tasks.rados.rados.0.smithi084.stdout:1775: done (5 left) 2024-01-13T18:06:46.316 INFO:tasks.rados.rados.0.smithi084.stdout:1778: done (4 left) 2024-01-13T18:06:46.316 INFO:tasks.rados.rados.0.smithi084.stdout:1783: done (3 left) 2024-01-13T18:06:46.316 INFO:tasks.rados.rados.0.smithi084.stdout:1785: done (2 left) 2024-01-13T18:06:46.316 INFO:tasks.rados.rados.0.smithi084.stdout:1786: snap_remove snap 175 2024-01-13T18:06:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:1786: done (2 left) 2024-01-13T18:06:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:1787: delete oid 45 current snap is 177 2024-01-13T18:06:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 4 to smithi084102331-44 2024-01-13T18:06:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 5 to smithi084102331-44 2024-01-13T18:06:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 6 to smithi084102331-44 2024-01-13T18:06:46.789 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 7 to smithi084102331-44 2024-01-13T18:06:46.789 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 940 (ObjNum 553 snap 177 seq_num 553) dirty exists 2024-01-13T18:06:46.789 INFO:tasks.rados.rados.0.smithi084.stdout:1784: left oid 44 (ObjNum 553 snap 177 seq_num 553) 2024-01-13T18:06:46.789 INFO:tasks.rados.rados.0.smithi084.stdout:1779: finishing copy_from to smithi084102331-35 2024-01-13T18:06:46.789 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 629 (ObjNum 511 snap 163 seq_num 511) dirty exists 2024-01-13T18:06:46.789 INFO:tasks.rados.rados.0.smithi084.stdout:1779: finishing copy_from racing read to smithi084102331-35 2024-01-13T18:06:46.795 INFO:tasks.rados.rados.0.smithi084.stdout:1779: done (2 left) 2024-01-13T18:06:46.795 INFO:tasks.rados.rados.0.smithi084.stdout:1784: done (1 left) 2024-01-13T18:06:46.795 INFO:tasks.rados.rados.0.smithi084.stdout:1787: done (0 left) 2024-01-13T18:06:46.795 INFO:tasks.rados.rados.0.smithi084.stdout:1788: delete oid 23 current snap is 177 2024-01-13T18:06:46.801 INFO:tasks.rados.rados.0.smithi084.stdout:1788: done (0 left) 2024-01-13T18:06:46.801 INFO:tasks.rados.rados.0.smithi084.stdout:1789: copy_from oid 6 from oid 30 current snap is 177 2024-01-13T18:06:46.801 INFO:tasks.rados.rados.0.smithi084.stdout:1790: snap_remove snap 165 2024-01-13T18:06:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:46 smithi099 ceph-mon[138788]: osdmap e424: 8 total, 8 up, 8 in 2024-01-13T18:06:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:46 smithi099 ceph-mon[138788]: failed to encode map e424 with expected crc 2024-01-13T18:06:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:46 smithi099 ceph-mon[138788]: pgmap v348: 121 pgs: 121 active+clean; 201 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 436 KiB/s wr, 7 op/s 2024-01-13T18:06:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:46 smithi084 ceph-mon[116404]: osdmap e424: 8 total, 8 up, 8 in 2024-01-13T18:06:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:46 smithi084 ceph-mon[116404]: failed to encode map e424 with expected crc 2024-01-13T18:06:47.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:46 smithi084 ceph-mon[116404]: pgmap v348: 121 pgs: 121 active+clean; 201 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 436 KiB/s wr, 7 op/s 2024-01-13T18:06:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:46 smithi084 ceph-mon[119097]: osdmap e424: 8 total, 8 up, 8 in 2024-01-13T18:06:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:46 smithi084 ceph-mon[119097]: failed to encode map e424 with expected crc 2024-01-13T18:06:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:46 smithi084 ceph-mon[119097]: pgmap v348: 121 pgs: 121 active+clean; 201 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 436 KiB/s wr, 7 op/s 2024-01-13T18:06:47.629 INFO:tasks.rados.rados.0.smithi084.stdout:1790: done (1 left) 2024-01-13T18:06:47.629 INFO:tasks.rados.rados.0.smithi084.stdout:1791: snap_create 2024-01-13T18:06:47.629 INFO:tasks.rados.rados.0.smithi084.stdout:1789: finishing copy_from to smithi084102331-6 2024-01-13T18:06:47.629 INFO:tasks.rados.rados.0.smithi084.stdout:1789: got expected ENOENT (src dne) 2024-01-13T18:06:47.629 INFO:tasks.rados.rados.0.smithi084.stdout:1789: finishing copy_from racing read to smithi084102331-6 2024-01-13T18:06:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:47 smithi099 ceph-mon[138788]: osdmap e425: 8 total, 8 up, 8 in 2024-01-13T18:06:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:47 smithi099 ceph-mon[138788]: failed to encode map e425 with expected crc 2024-01-13T18:06:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:47 smithi099 ceph-mon[138788]: osdmap e426: 8 total, 8 up, 8 in 2024-01-13T18:06:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:47 smithi099 ceph-mon[138788]: failed to encode map e426 with expected crc 2024-01-13T18:06:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:47 smithi099 ceph-mon[138788]: failed to encode map e426 with expected crc 2024-01-13T18:06:48.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:47 smithi084 ceph-mon[116404]: osdmap e425: 8 total, 8 up, 8 in 2024-01-13T18:06:48.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:47 smithi084 ceph-mon[116404]: failed to encode map e425 with expected crc 2024-01-13T18:06:48.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:47 smithi084 ceph-mon[116404]: osdmap e426: 8 total, 8 up, 8 in 2024-01-13T18:06:48.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:47 smithi084 ceph-mon[116404]: failed to encode map e426 with expected crc 2024-01-13T18:06:48.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:47 smithi084 ceph-mon[116404]: failed to encode map e426 with expected crc 2024-01-13T18:06:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:47 smithi084 ceph-mon[119097]: osdmap e425: 8 total, 8 up, 8 in 2024-01-13T18:06:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:47 smithi084 ceph-mon[119097]: failed to encode map e425 with expected crc 2024-01-13T18:06:48.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:47 smithi084 ceph-mon[119097]: osdmap e426: 8 total, 8 up, 8 in 2024-01-13T18:06:48.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:47 smithi084 ceph-mon[119097]: failed to encode map e426 with expected crc 2024-01-13T18:06:48.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:47 smithi084 ceph-mon[119097]: failed to encode map e426 with expected crc 2024-01-13T18:06:48.630 INFO:tasks.rados.rados.0.smithi084.stdout:1789: done (1 left) 2024-01-13T18:06:48.630 INFO:tasks.rados.rados.0.smithi084.stdout:1791: done (0 left) 2024-01-13T18:06:48.630 INFO:tasks.rados.rados.0.smithi084.stdout:1792: delete oid 46 current snap is 178 2024-01-13T18:06:48.635 INFO:tasks.rados.rados.0.smithi084.stdout:1792: done (0 left) 2024-01-13T18:06:48.636 INFO:tasks.rados.rados.0.smithi084.stdout:1793: rollback oid 6 current snap is 178 2024-01-13T18:06:48.636 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 6 to 171 2024-01-13T18:06:48.636 INFO:tasks.rados.rados.0.smithi084.stdout:1794: read oid 17 snap -1 2024-01-13T18:06:48.636 INFO:tasks.rados.rados.0.smithi084.stdout:1794: expect (ObjNum 519 snap 166 seq_num 519) 2024-01-13T18:06:48.636 INFO:tasks.rados.rados.0.smithi084.stdout:1795: snap_create 2024-01-13T18:06:48.638 INFO:tasks.rados.rados.0.smithi084.stdout:1793: finishing rollback tid 1 to smithi084102331-6 2024-01-13T18:06:48.638 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 0 (ObjNum 609 snap 0 seq_num 4037476608) dirty dne 2024-01-13T18:06:48.652 INFO:tasks.rados.rados.0.smithi084.stdout:1794: expect (ObjNum 519 snap 166 seq_num 519) 2024-01-13T18:06:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:48 smithi099 ceph-mon[138788]: pgmap v351: 121 pgs: 121 active+clean; 218 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 5.4 MiB/s wr, 21 op/s 2024-01-13T18:06:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:48 smithi099 ceph-mon[138788]: osdmap e427: 8 total, 8 up, 8 in 2024-01-13T18:06:49.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:06:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:06:48.660Z caller=alerting.go:366 level=warn component="rule manager" alert="unsupported value type" msg="Expanding alert template failed" err="error executing template __alert_CephOSDDown: template: __alert_CephOSDDown:1:358: executing \"__alert_CephOSDDown\" at : error calling query: found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" data="unsupported value type" 2024-01-13T18:06:49.119 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:06:48 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:06:48.661Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi084:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)\", cluster_addr=\"172.21.15.84\", device_class=\"ssd\", hostname=\"smithi084\", instance=\"smithi099.front.sepia.ceph.com:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.84\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-01-13T18:06:49.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:48 smithi084 ceph-mon[116404]: pgmap v351: 121 pgs: 121 active+clean; 218 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 5.4 MiB/s wr, 21 op/s 2024-01-13T18:06:49.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:48 smithi084 ceph-mon[116404]: osdmap e427: 8 total, 8 up, 8 in 2024-01-13T18:06:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:48 smithi084 ceph-mon[119097]: pgmap v351: 121 pgs: 121 active+clean; 218 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 5.4 MiB/s wr, 21 op/s 2024-01-13T18:06:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:48 smithi084 ceph-mon[119097]: osdmap e427: 8 total, 8 up, 8 in 2024-01-13T18:06:49.630 INFO:tasks.rados.rados.0.smithi084.stdout:1793: done (2 left) 2024-01-13T18:06:49.630 INFO:tasks.rados.rados.0.smithi084.stdout:1794: done (1 left) 2024-01-13T18:06:49.630 INFO:tasks.rados.rados.0.smithi084.stdout:1795: done (0 left) 2024-01-13T18:06:49.631 INFO:tasks.rados.rados.0.smithi084.stdout:1796: rollback oid 5 current snap is 179 2024-01-13T18:06:49.631 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 171 2024-01-13T18:06:49.631 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 179 2024-01-13T18:06:49.631 INFO:tasks.rados.rados.0.smithi084.stdout:1797: seq_num 558 ranges {0=548864,548864=688128,1236992=606208,1843200=311296} 2024-01-13T18:06:49.633 INFO:tasks.rados.rados.0.smithi084.stdout:1797: writing smithi084102331-46 from 0 to 548864 tid 1 2024-01-13T18:06:49.637 INFO:tasks.rados.rados.0.smithi084.stdout:1797: writing smithi084102331-46 from 548864 to 1236992 tid 2 2024-01-13T18:06:49.641 INFO:tasks.rados.rados.0.smithi084.stdout:1797: writing smithi084102331-46 from 1236992 to 1843200 tid 3 2024-01-13T18:06:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:1797: writing smithi084102331-46 from 1843200 to 2154496 tid 4 2024-01-13T18:06:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:1798: snap_create 2024-01-13T18:06:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:1796: finishing rollback tid 0 to smithi084102331-5 2024-01-13T18:06:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:1796: finishing rollback tid 1 to smithi084102331-5 2024-01-13T18:06:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:1796: finishing rollback tid 2 to smithi084102331-5 2024-01-13T18:06:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 657 (ObjNum 456 snap 142 seq_num 456) dirty exists 2024-01-13T18:06:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:1797: finishing write tid 1 to smithi084102331-46 2024-01-13T18:06:49.647 INFO:tasks.rados.rados.0.smithi084.stdout:1797: finishing write tid 2 to smithi084102331-46 2024-01-13T18:06:49.647 INFO:tasks.rados.rados.0.smithi084.stdout:1797: finishing write tid 3 to smithi084102331-46 2024-01-13T18:06:49.647 INFO:tasks.rados.rados.0.smithi084.stdout:1797: finishing write tid 4 to smithi084102331-46 2024-01-13T18:06:49.648 INFO:tasks.rados.rados.0.smithi084.stdout:1797: finishing write tid 5 to smithi084102331-46 2024-01-13T18:06:49.649 INFO:tasks.rados.rados.0.smithi084.stdout:1797: finishing write tid 6 to smithi084102331-46 2024-01-13T18:06:49.649 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 638 (ObjNum 558 snap 179 seq_num 558) dirty exists 2024-01-13T18:06:49.649 INFO:tasks.rados.rados.0.smithi084.stdout:1797: left oid 46 (ObjNum 558 snap 179 seq_num 558) 2024-01-13T18:06:50.634 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:06:50] "GET /metrics HTTP/1.1" 200 36191 "" "Prometheus/2.43.0" 2024-01-13T18:06:50.639 INFO:tasks.rados.rados.0.smithi084.stdout:1796: done (2 left) 2024-01-13T18:06:50.639 INFO:tasks.rados.rados.0.smithi084.stdout:1797: done (1 left) 2024-01-13T18:06:50.639 INFO:tasks.rados.rados.0.smithi084.stdout:1798: done (0 left) 2024-01-13T18:06:50.639 INFO:tasks.rados.rados.0.smithi084.stdout:1799: snap_remove snap 179 2024-01-13T18:06:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[116404]: failed to encode map e427 with expected crc 2024-01-13T18:06:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[116404]: osdmap e428: 8 total, 8 up, 8 in 2024-01-13T18:06:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[116404]: pgmap v354: 121 pgs: 121 active+clean; 215 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 5.4 MiB/s wr, 20 op/s 2024-01-13T18:06:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[119097]: failed to encode map e427 with expected crc 2024-01-13T18:06:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[119097]: osdmap e428: 8 total, 8 up, 8 in 2024-01-13T18:06:50.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[119097]: pgmap v354: 121 pgs: 121 active+clean; 215 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 5.4 MiB/s wr, 20 op/s 2024-01-13T18:06:50.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:50.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:50.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:50 smithi099 ceph-mon[138788]: failed to encode map e427 with expected crc 2024-01-13T18:06:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:50 smithi099 ceph-mon[138788]: osdmap e428: 8 total, 8 up, 8 in 2024-01-13T18:06:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:50 smithi099 ceph-mon[138788]: pgmap v354: 121 pgs: 121 active+clean; 215 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 5.4 MiB/s wr, 20 op/s 2024-01-13T18:06:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:06:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:51.640 INFO:tasks.rados.rados.0.smithi084.stdout:1799: done (0 left) 2024-01-13T18:06:51.640 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 180 2024-01-13T18:06:51.640 INFO:tasks.rados.rados.0.smithi084.stdout:1800: seq_num 559 ranges {0=565248,565248=573440,1138688=409600,1548288=622592} 2024-01-13T18:06:51.644 INFO:tasks.rados.rados.0.smithi084.stdout:1800: writing smithi084102331-49 from 0 to 565248 tid 1 2024-01-13T18:06:51.646 INFO:tasks.rados.rados.0.smithi084.stdout:1800: writing smithi084102331-49 from 565248 to 1138688 tid 2 2024-01-13T18:06:51.649 INFO:tasks.rados.rados.0.smithi084.stdout:1800: writing smithi084102331-49 from 1138688 to 1548288 tid 3 2024-01-13T18:06:51.653 INFO:tasks.rados.rados.0.smithi084.stdout:1800: writing smithi084102331-49 from 1548288 to 2170880 tid 4 2024-01-13T18:06:51.653 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 180 2024-01-13T18:06:51.653 INFO:tasks.rados.rados.0.smithi084.stdout:1800: finishing write tid 1 to smithi084102331-49 2024-01-13T18:06:51.654 INFO:tasks.rados.rados.0.smithi084.stdout:1801: seq_num 560 ranges {3522560=581632,4104192=458752,4562944=614400,5177344=532480} 2024-01-13T18:06:51.675 INFO:tasks.rados.rados.0.smithi084.stdout:1801: writing smithi084102331-25 from 3522560 to 4104192 tid 1 2024-01-13T18:06:51.677 INFO:tasks.rados.rados.0.smithi084.stdout:1801: writing smithi084102331-25 from 4104192 to 4562944 tid 2 2024-01-13T18:06:51.681 INFO:tasks.rados.rados.0.smithi084.stdout:1801: writing smithi084102331-25 from 4562944 to 5177344 tid 3 2024-01-13T18:06:51.685 INFO:tasks.rados.rados.0.smithi084.stdout:1801: writing smithi084102331-25 from 5177344 to 5709824 tid 4 2024-01-13T18:06:51.685 INFO:tasks.rados.rados.0.smithi084.stdout:1802: copy_from oid 30 from oid 13 current snap is 180 2024-01-13T18:06:51.686 INFO:tasks.rados.rados.0.smithi084.stdout:1800: finishing write tid 2 to smithi084102331-49 2024-01-13T18:06:51.686 INFO:tasks.rados.rados.0.smithi084.stdout:1803: read oid 1 snap -1 2024-01-13T18:06:51.686 INFO:tasks.rados.rados.0.smithi084.stdout:1803: expect (ObjNum 513 snap 164 seq_num 513) 2024-01-13T18:06:51.686 INFO:tasks.rados.rados.0.smithi084.stdout:1804: setattr oid 17 current snap is 180 2024-01-13T18:06:51.686 INFO:tasks.rados.rados.0.smithi084.stdout:1800: finishing write tid 3 to smithi084102331-49 2024-01-13T18:06:51.686 INFO:tasks.rados.rados.0.smithi084.stdout:1800: finishing write tid 4 to smithi084102331-49 2024-01-13T18:06:51.686 INFO:tasks.rados.rados.0.smithi084.stdout:1800: finishing write tid 5 to smithi084102331-49 2024-01-13T18:06:51.686 INFO:tasks.rados.rados.0.smithi084.stdout:1800: finishing write tid 6 to smithi084102331-49 2024-01-13T18:06:51.686 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 820 (ObjNum 559 snap 180 seq_num 559) dirty exists 2024-01-13T18:06:51.686 INFO:tasks.rados.rados.0.smithi084.stdout:1800: left oid 49 (ObjNum 559 snap 180 seq_num 559) 2024-01-13T18:06:51.686 INFO:tasks.rados.rados.0.smithi084.stdout:1801: finishing write tid 1 to smithi084102331-25 2024-01-13T18:06:51.687 INFO:tasks.rados.rados.0.smithi084.stdout:1801: finishing write tid 2 to smithi084102331-25 2024-01-13T18:06:51.687 INFO:tasks.rados.rados.0.smithi084.stdout:1800: done (4 left) 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:1805: read oid 37 snap -1 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:1805: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:1806: read oid 26 snap -1 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:1806: expect deleted 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:1807: read oid 48 snap -1 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:1807: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:1808: copy_from oid 39 from oid 16 current snap is 180 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:1809: rollback oid 42 current snap is 180 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 177 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:1810: copy_from oid 10 from oid 29 current snap is 180 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 180 2024-01-13T18:06:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:1811: seq_num 561 ranges {10887168=598016,11485184=745472,12230656=778240,13008896=81920} 2024-01-13T18:06:51.750 INFO:tasks.rados.rados.0.smithi084.stdout:1811: writing smithi084102331-35 from 10887168 to 11485184 tid 1 2024-01-13T18:06:51.754 INFO:tasks.rados.rados.0.smithi084.stdout:1811: writing smithi084102331-35 from 11485184 to 12230656 tid 2 2024-01-13T18:06:51.758 INFO:tasks.rados.rados.0.smithi084.stdout:1811: writing smithi084102331-35 from 12230656 to 13008896 tid 3 2024-01-13T18:06:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:1811: writing smithi084102331-35 from 13008896 to 13090816 tid 4 2024-01-13T18:06:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:1812: delete oid 27 current snap is 180 2024-01-13T18:06:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:1801: finishing write tid 3 to smithi084102331-25 2024-01-13T18:06:51.759 INFO:tasks.rados.rados.0.smithi084.stdout:1807: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:06:51.760 INFO:tasks.rados.rados.0.smithi084.stdout:1810: finishing copy_from to smithi084102331-10 2024-01-13T18:06:51.760 INFO:tasks.rados.rados.0.smithi084.stdout:1810: got expected ENOENT (src dne) 2024-01-13T18:06:51.761 INFO:tasks.rados.rados.0.smithi084.stdout:1805: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:06:51.765 INFO:tasks.rados.rados.0.smithi084.stdout:1810: finishing copy_from racing read to smithi084102331-10 2024-01-13T18:06:51.765 INFO:tasks.rados.rados.0.smithi084.stdout:1801: finishing write tid 4 to smithi084102331-25 2024-01-13T18:06:51.766 INFO:tasks.rados.rados.0.smithi084.stdout:1801: finishing write tid 5 to smithi084102331-25 2024-01-13T18:06:51.766 INFO:tasks.rados.rados.0.smithi084.stdout:1801: finishing write tid 6 to smithi084102331-25 2024-01-13T18:06:51.766 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 884 (ObjNum 560 snap 180 seq_num 560) dirty exists 2024-01-13T18:06:51.766 INFO:tasks.rados.rados.0.smithi084.stdout:1801: left oid 25 (ObjNum 560 snap 180 seq_num 560) 2024-01-13T18:06:51.766 INFO:tasks.rados.rados.0.smithi084.stdout:1802: finishing copy_from to smithi084102331-30 2024-01-13T18:06:51.766 INFO:tasks.rados.rados.0.smithi084.stdout:1802: got expected ENOENT (src dne) 2024-01-13T18:06:51.766 INFO:tasks.rados.rados.0.smithi084.stdout:1802: finishing copy_from racing read to smithi084102331-30 2024-01-13T18:06:51.766 INFO:tasks.rados.rados.0.smithi084.stdout:1809: finishing rollback tid 1 to smithi084102331-42 2024-01-13T18:06:51.766 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 882 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-01-13T18:06:51.766 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 659 (ObjNum 519 snap 166 seq_num 519) dirty exists 2024-01-13T18:06:51.766 INFO:tasks.rados.rados.0.smithi084.stdout:1803: expect (ObjNum 513 snap 164 seq_num 513) 2024-01-13T18:06:51.905 INFO:tasks.rados.rados.0.smithi084.stdout:1808: finishing copy_from to smithi084102331-39 2024-01-13T18:06:51.905 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 520 (ObjNum 419 snap 132 seq_num 419) dirty exists 2024-01-13T18:06:51.905 INFO:tasks.rados.rados.0.smithi084.stdout:1808: finishing copy_from racing read to smithi084102331-39 2024-01-13T18:06:51.905 INFO:tasks.rados.rados.0.smithi084.stdout:1811: finishing write tid 1 to smithi084102331-35 2024-01-13T18:06:51.905 INFO:tasks.rados.rados.0.smithi084.stdout:1811: finishing write tid 2 to smithi084102331-35 2024-01-13T18:06:51.905 INFO:tasks.rados.rados.0.smithi084.stdout:1801: done (11 left) 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1802: done (10 left) 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1803: done (9 left) 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1804: done (8 left) 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1805: done (7 left) 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1806: done (6 left) 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1807: done (5 left) 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1808: done (4 left) 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1809: done (3 left) 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1810: done (2 left) 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1812: done (1 left) 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 180 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1811: finishing write tid 3 to smithi084102331-35 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1811: finishing write tid 4 to smithi084102331-35 2024-01-13T18:06:51.906 INFO:tasks.rados.rados.0.smithi084.stdout:1813: seq_num 563 ranges {0=638976,638976=565248,1204224=794624,1998848=245760} 2024-01-13T18:06:51.907 INFO:tasks.rados.rados.0.smithi084.stdout:1813: writing smithi084102331-47 from 0 to 638976 tid 1 2024-01-13T18:06:51.911 INFO:tasks.rados.rados.0.smithi084.stdout:1813: writing smithi084102331-47 from 638976 to 1204224 tid 2 2024-01-13T18:06:51.915 INFO:tasks.rados.rados.0.smithi084.stdout:1813: writing smithi084102331-47 from 1204224 to 1998848 tid 3 2024-01-13T18:06:51.917 INFO:tasks.rados.rados.0.smithi084.stdout:1813: writing smithi084102331-47 from 1998848 to 2244608 tid 4 2024-01-13T18:06:51.917 INFO:tasks.rados.rados.0.smithi084.stdout:1814: rollback oid 25 current snap is 180 2024-01-13T18:06:51.918 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 25 to 171 2024-01-13T18:06:51.918 INFO:tasks.rados.rados.0.smithi084.stdout:1811: finishing write tid 5 to smithi084102331-35 2024-01-13T18:06:51.918 INFO:tasks.rados.rados.0.smithi084.stdout:1811: finishing write tid 6 to smithi084102331-35 2024-01-13T18:06:51.918 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 665 (ObjNum 561 snap 180 seq_num 561) dirty exists 2024-01-13T18:06:51.918 INFO:tasks.rados.rados.0.smithi084.stdout:1811: left oid 35 (ObjNum 561 snap 180 seq_num 561) 2024-01-13T18:06:51.918 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 1 to smithi084102331-47 2024-01-13T18:06:51.918 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 2 to smithi084102331-47 2024-01-13T18:06:51.918 INFO:tasks.rados.rados.0.smithi084.stdout:1811: done (2 left) 2024-01-13T18:06:51.918 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 180 2024-01-13T18:06:51.918 INFO:tasks.rados.rados.0.smithi084.stdout:1815: seq_num 564 ranges {0=655360,655360=442368,1097728=598016,1695744=565248} 2024-01-13T18:06:51.921 INFO:tasks.rados.rados.0.smithi084.stdout:1815: writing smithi084102331-45 from 0 to 655360 tid 1 2024-01-13T18:06:51.923 INFO:tasks.rados.rados.0.smithi084.stdout:1815: writing smithi084102331-45 from 655360 to 1097728 tid 2 2024-01-13T18:06:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:1815: writing smithi084102331-45 from 1097728 to 1695744 tid 3 2024-01-13T18:06:51.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:51 smithi084 ceph-mon[119097]: failed to encode map e428 with expected crc 2024-01-13T18:06:51.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:51 smithi084 ceph-mon[119097]: osdmap e429: 8 total, 8 up, 8 in 2024-01-13T18:06:51.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:51 smithi084 ceph-mon[116404]: failed to encode map e428 with expected crc 2024-01-13T18:06:51.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:51 smithi084 ceph-mon[116404]: osdmap e429: 8 total, 8 up, 8 in 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:1815: writing smithi084102331-45 from 1695744 to 2260992 tid 4 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:1816: setattr oid 13 current snap is 180 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 3 to smithi084102331-47 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 4 to smithi084102331-47 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 5 to smithi084102331-47 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:1814: finishing rollback tid 0 to smithi084102331-25 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:1814: finishing rollback tid 1 to smithi084102331-25 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:1814: finishing rollback tid 2 to smithi084102331-25 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 887 (ObjNum 497 snap 160 seq_num 497) dirty exists 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 6 to smithi084102331-47 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 955 (ObjNum 563 snap 180 seq_num 563) dirty exists 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:1813: left oid 47 (ObjNum 563 snap 180 seq_num 563) 2024-01-13T18:06:51.931 INFO:tasks.rados.rados.0.smithi084.stdout:1815: finishing write tid 1 to smithi084102331-45 2024-01-13T18:06:51.932 INFO:tasks.rados.rados.0.smithi084.stdout:1815: finishing write tid 2 to smithi084102331-45 2024-01-13T18:06:51.932 INFO:tasks.rados.rados.0.smithi084.stdout:1815: finishing write tid 3 to smithi084102331-45 2024-01-13T18:06:51.932 INFO:tasks.rados.rados.0.smithi084.stdout:1813: done (3 left) 2024-01-13T18:06:51.932 INFO:tasks.rados.rados.0.smithi084.stdout:1814: done (2 left) 2024-01-13T18:06:51.933 INFO:tasks.rados.rados.0.smithi084.stdout:1817: setattr oid 17 current snap is 180 2024-01-13T18:06:51.933 INFO:tasks.rados.rados.0.smithi084.stdout:1815: finishing write tid 4 to smithi084102331-45 2024-01-13T18:06:51.933 INFO:tasks.rados.rados.0.smithi084.stdout:1815: finishing write tid 5 to smithi084102331-45 2024-01-13T18:06:51.935 INFO:tasks.rados.rados.0.smithi084.stdout:1818: copy_from oid 43 from oid 39 current snap is 180 2024-01-13T18:06:51.935 INFO:tasks.rados.rados.0.smithi084.stdout:1819: read oid 38 snap -1 2024-01-13T18:06:51.935 INFO:tasks.rados.rados.0.smithi084.stdout:1819: expect (ObjNum 474 snap 148 seq_num 474) 2024-01-13T18:06:51.939 INFO:tasks.rados.rados.0.smithi084.stdout:1820: read oid 5 snap -1 2024-01-13T18:06:51.939 INFO:tasks.rados.rados.0.smithi084.stdout:1820: expect (ObjNum 456 snap 142 seq_num 456) 2024-01-13T18:06:51.939 INFO:tasks.rados.rados.0.smithi084.stdout:1821: read oid 18 snap -1 2024-01-13T18:06:51.939 INFO:tasks.rados.rados.0.smithi084.stdout:1821: expect (ObjNum 493 snap 157 seq_num 493) 2024-01-13T18:06:51.939 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 180 2024-01-13T18:06:51.939 INFO:tasks.rados.rados.0.smithi084.stdout:1822: seq_num 565 ranges {0=671744,671744=729088,1400832=753664,2154496=122880} 2024-01-13T18:06:51.939 INFO:tasks.rados.rados.0.smithi084.stdout:1822: writing smithi084102331-29 from 0 to 671744 tid 1 2024-01-13T18:06:51.943 INFO:tasks.rados.rados.0.smithi084.stdout:1822: writing smithi084102331-29 from 671744 to 1400832 tid 2 2024-01-13T18:06:51.948 INFO:tasks.rados.rados.0.smithi084.stdout:1822: writing smithi084102331-29 from 1400832 to 2154496 tid 3 2024-01-13T18:06:51.949 INFO:tasks.rados.rados.0.smithi084.stdout:1822: writing smithi084102331-29 from 2154496 to 2277376 tid 4 2024-01-13T18:06:51.949 INFO:tasks.rados.rados.0.smithi084.stdout:1823: copy_from oid 48 from oid 14 current snap is 180 2024-01-13T18:06:51.949 INFO:tasks.rados.rados.0.smithi084.stdout:1815: finishing write tid 6 to smithi084102331-45 2024-01-13T18:06:51.949 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1070 (ObjNum 564 snap 180 seq_num 564) dirty exists 2024-01-13T18:06:51.949 INFO:tasks.rados.rados.0.smithi084.stdout:1815: left oid 45 (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:06:51.949 INFO:tasks.rados.rados.0.smithi084.stdout:1815: done (8 left) 2024-01-13T18:06:51.949 INFO:tasks.rados.rados.0.smithi084.stdout:1824: delete oid 20 current snap is 180 2024-01-13T18:06:51.949 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 660 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:06:51.950 INFO:tasks.rados.rados.0.smithi084.stdout:1819: expect (ObjNum 474 snap 148 seq_num 474) 2024-01-13T18:06:51.996 INFO:tasks.rados.rados.0.smithi084.stdout:1822: finishing write tid 1 to smithi084102331-29 2024-01-13T18:06:51.996 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 661 (ObjNum 519 snap 166 seq_num 519) dirty exists 2024-01-13T18:06:51.996 INFO:tasks.rados.rados.0.smithi084.stdout:1822: finishing write tid 2 to smithi084102331-29 2024-01-13T18:06:51.996 INFO:tasks.rados.rados.0.smithi084.stdout:1822: finishing write tid 3 to smithi084102331-29 2024-01-13T18:06:51.996 INFO:tasks.rados.rados.0.smithi084.stdout:1822: finishing write tid 4 to smithi084102331-29 2024-01-13T18:06:51.996 INFO:tasks.rados.rados.0.smithi084.stdout:1822: finishing write tid 5 to smithi084102331-29 2024-01-13T18:06:51.996 INFO:tasks.rados.rados.0.smithi084.stdout:1822: finishing write tid 6 to smithi084102331-29 2024-01-13T18:06:51.996 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 670 (ObjNum 565 snap 180 seq_num 565) dirty exists 2024-01-13T18:06:51.996 INFO:tasks.rados.rados.0.smithi084.stdout:1822: left oid 29 (ObjNum 565 snap 180 seq_num 565) 2024-01-13T18:06:51.996 INFO:tasks.rados.rados.0.smithi084.stdout:1821: expect (ObjNum 493 snap 157 seq_num 493) 2024-01-13T18:06:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:51 smithi099 ceph-mon[138788]: failed to encode map e428 with expected crc 2024-01-13T18:06:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:51 smithi099 ceph-mon[138788]: osdmap e429: 8 total, 8 up, 8 in 2024-01-13T18:06:52.462 INFO:tasks.rados.rados.0.smithi084.stdout:1820: expect (ObjNum 456 snap 142 seq_num 456) 2024-01-13T18:06:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:1818: finishing copy_from to smithi084102331-43 2024-01-13T18:06:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 520 (ObjNum 419 snap 132 seq_num 419) dirty exists 2024-01-13T18:06:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:1818: finishing copy_from racing read to smithi084102331-43 2024-01-13T18:06:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:1823: finishing copy_from to smithi084102331-48 2024-01-13T18:06:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 814 (ObjNum 535 snap 173 seq_num 535) dirty exists 2024-01-13T18:06:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:1823: finishing copy_from racing read to smithi084102331-48 2024-01-13T18:06:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:1816: done (8 left) 2024-01-13T18:06:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:1817: done (7 left) 2024-01-13T18:06:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:1818: done (6 left) 2024-01-13T18:06:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:1819: done (5 left) 2024-01-13T18:06:52.667 INFO:tasks.rados.rados.0.smithi084.stdout:1820: done (4 left) 2024-01-13T18:06:52.668 INFO:tasks.rados.rados.0.smithi084.stdout:1821: done (3 left) 2024-01-13T18:06:52.668 INFO:tasks.rados.rados.0.smithi084.stdout:1822: done (2 left) 2024-01-13T18:06:52.668 INFO:tasks.rados.rados.0.smithi084.stdout:1823: done (1 left) 2024-01-13T18:06:52.668 INFO:tasks.rados.rados.0.smithi084.stdout:1824: done (0 left) 2024-01-13T18:06:52.668 INFO:tasks.rados.rados.0.smithi084.stdout:1825: rollback oid 49 current snap is 180 2024-01-13T18:06:52.668 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 171 2024-01-13T18:06:52.668 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 180 2024-01-13T18:06:52.668 INFO:tasks.rados.rados.0.smithi084.stdout:1826: seq_num 567 ranges {7913472=704512,8617984=499712,9117696=770048,9887744=335872} 2024-01-13T18:06:52.713 INFO:tasks.rados.rados.0.smithi084.stdout:1826: writing smithi084102331-32 from 7913472 to 8617984 tid 1 2024-01-13T18:06:52.715 INFO:tasks.rados.rados.0.smithi084.stdout:1826: writing smithi084102331-32 from 8617984 to 9117696 tid 2 2024-01-13T18:06:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:1826: writing smithi084102331-32 from 9117696 to 9887744 tid 3 2024-01-13T18:06:52.722 INFO:tasks.rados.rados.0.smithi084.stdout:1826: writing smithi084102331-32 from 9887744 to 10223616 tid 4 2024-01-13T18:06:52.722 INFO:tasks.rados.rados.0.smithi084.stdout:1827: snap_create 2024-01-13T18:06:52.722 INFO:tasks.rados.rados.0.smithi084.stdout:1825: finishing rollback tid 0 to smithi084102331-49 2024-01-13T18:06:52.722 INFO:tasks.rados.rados.0.smithi084.stdout:1825: finishing rollback tid 1 to smithi084102331-49 2024-01-13T18:06:52.722 INFO:tasks.rados.rados.0.smithi084.stdout:1825: finishing rollback tid 2 to smithi084102331-49 2024-01-13T18:06:52.722 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 823 (ObjNum 499 snap 161 seq_num 499) dirty exists 2024-01-13T18:06:52.722 INFO:tasks.rados.rados.0.smithi084.stdout:1826: finishing write tid 1 to smithi084102331-32 2024-01-13T18:06:52.723 INFO:tasks.rados.rados.0.smithi084.stdout:1826: finishing write tid 2 to smithi084102331-32 2024-01-13T18:06:52.724 INFO:tasks.rados.rados.0.smithi084.stdout:1826: finishing write tid 3 to smithi084102331-32 2024-01-13T18:06:52.724 INFO:tasks.rados.rados.0.smithi084.stdout:1826: finishing write tid 4 to smithi084102331-32 2024-01-13T18:06:52.725 INFO:tasks.rados.rados.0.smithi084.stdout:1826: finishing write tid 5 to smithi084102331-32 2024-01-13T18:06:52.725 INFO:tasks.rados.rados.0.smithi084.stdout:1826: finishing write tid 6 to smithi084102331-32 2024-01-13T18:06:52.726 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 961 (ObjNum 567 snap 180 seq_num 567) dirty exists 2024-01-13T18:06:52.726 INFO:tasks.rados.rados.0.smithi084.stdout:1826: left oid 32 (ObjNum 567 snap 180 seq_num 567) 2024-01-13T18:06:52.835 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:52 smithi099 ceph-mon[138788]: failed to encode map e429 with expected crc 2024-01-13T18:06:52.835 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:52 smithi099 ceph-mon[138788]: osdmap e430: 8 total, 8 up, 8 in 2024-01-13T18:06:52.836 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:52 smithi099 ceph-mon[138788]: pgmap v357: 121 pgs: 121 active+clean; 197 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 0 B/s wr, 7 op/s 2024-01-13T18:06:52.836 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:52.836 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:52 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:52.836 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:52 smithi099 ceph-mon[138788]: Upgrade: osd.7 is safe to restart 2024-01-13T18:06:52.836 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:52 smithi099 ceph-mon[138788]: osdmap e431: 8 total, 8 up, 8 in 2024-01-13T18:06:52.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[116404]: failed to encode map e429 with expected crc 2024-01-13T18:06:52.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[116404]: osdmap e430: 8 total, 8 up, 8 in 2024-01-13T18:06:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[116404]: pgmap v357: 121 pgs: 121 active+clean; 197 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 0 B/s wr, 7 op/s 2024-01-13T18:06:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[116404]: Upgrade: osd.7 is safe to restart 2024-01-13T18:06:52.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[116404]: osdmap e431: 8 total, 8 up, 8 in 2024-01-13T18:06:52.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[119097]: failed to encode map e429 with expected crc 2024-01-13T18:06:52.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[119097]: osdmap e430: 8 total, 8 up, 8 in 2024-01-13T18:06:52.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[119097]: pgmap v357: 121 pgs: 121 active+clean; 197 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 0 B/s wr, 7 op/s 2024-01-13T18:06:52.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:52.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-01-13T18:06:52.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[119097]: Upgrade: osd.7 is safe to restart 2024-01-13T18:06:52.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:52 smithi084 ceph-mon[119097]: osdmap e431: 8 total, 8 up, 8 in 2024-01-13T18:06:53.663 INFO:tasks.rados.rados.0.smithi084.stdout:1825: done (2 left) 2024-01-13T18:06:53.663 INFO:tasks.rados.rados.0.smithi084.stdout:1826: done (1 left) 2024-01-13T18:06:53.663 INFO:tasks.rados.rados.0.smithi084.stdout:1827: done (0 left) 2024-01-13T18:06:53.663 INFO:tasks.rados.rados.0.smithi084.stdout:1828: read oid 25 snap -1 2024-01-13T18:06:53.663 INFO:tasks.rados.rados.0.smithi084.stdout:1828: expect (ObjNum 497 snap 160 seq_num 497) 2024-01-13T18:06:53.663 INFO:tasks.rados.rados.0.smithi084.stdout:1829: snap_remove snap 178 2024-01-13T18:06:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:53 smithi099 ceph-mon[138788]: failed to encode map e431 with expected crc 2024-01-13T18:06:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:53 smithi099 ceph-mon[138788]: Upgrade: Updating osd.7 2024-01-13T18:06:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-13T18:06:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:53 smithi099 ceph-mon[138788]: Deploying daemon osd.7 on smithi099 2024-01-13T18:06:53.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[116404]: failed to encode map e431 with expected crc 2024-01-13T18:06:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[116404]: Upgrade: Updating osd.7 2024-01-13T18:06:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-13T18:06:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:53.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[116404]: Deploying daemon osd.7 on smithi099 2024-01-13T18:06:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[119097]: failed to encode map e431 with expected crc 2024-01-13T18:06:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[119097]: Upgrade: Updating osd.7 2024-01-13T18:06:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-13T18:06:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:06:53.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:53 smithi084 ceph-mon[119097]: Deploying daemon osd.7 on smithi099 2024-01-13T18:06:54.668 INFO:tasks.rados.rados.0.smithi084.stdout:1829: done (1 left) 2024-01-13T18:06:54.669 INFO:tasks.rados.rados.0.smithi084.stdout:1830: read oid 7 snap -1 2024-01-13T18:06:54.669 INFO:tasks.rados.rados.0.smithi084.stdout:1830: expect (ObjNum 508 snap 162 seq_num 508) 2024-01-13T18:06:54.669 INFO:tasks.rados.rados.0.smithi084.stdout:1831: delete oid 39 current snap is 181 2024-01-13T18:06:54.669 INFO:tasks.rados.rados.0.smithi084.stdout:1828: expect (ObjNum 497 snap 160 seq_num 497) 2024-01-13T18:06:54.831 INFO:tasks.rados.rados.0.smithi084.stdout:1830: expect (ObjNum 508 snap 162 seq_num 508) 2024-01-13T18:06:54.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:54 smithi099 ceph-mon[138788]: failed to encode map e432 with expected crc 2024-01-13T18:06:54.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:54 smithi099 ceph-mon[138788]: osdmap e432: 8 total, 8 up, 8 in 2024-01-13T18:06:54.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:54 smithi099 ceph-mon[138788]: pgmap v360: 121 pgs: 121 active+clean; 207 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-01-13T18:06:54.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:54 smithi084 ceph-mon[116404]: failed to encode map e432 with expected crc 2024-01-13T18:06:54.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:54 smithi084 ceph-mon[116404]: osdmap e432: 8 total, 8 up, 8 in 2024-01-13T18:06:54.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:54 smithi084 ceph-mon[116404]: pgmap v360: 121 pgs: 121 active+clean; 207 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-01-13T18:06:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:54 smithi084 ceph-mon[119097]: failed to encode map e432 with expected crc 2024-01-13T18:06:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:54 smithi084 ceph-mon[119097]: osdmap e432: 8 total, 8 up, 8 in 2024-01-13T18:06:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:54 smithi084 ceph-mon[119097]: pgmap v360: 121 pgs: 121 active+clean; 207 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-01-13T18:06:55.130 INFO:tasks.rados.rados.0.smithi084.stdout:1828: done (2 left) 2024-01-13T18:06:55.130 INFO:tasks.rados.rados.0.smithi084.stdout:1830: done (1 left) 2024-01-13T18:06:55.130 INFO:tasks.rados.rados.0.smithi084.stdout:1831: done (0 left) 2024-01-13T18:06:55.130 INFO:tasks.rados.rados.0.smithi084.stdout:1832: read oid 32 snap -1 2024-01-13T18:06:55.130 INFO:tasks.rados.rados.0.smithi084.stdout:1832: expect (ObjNum 567 snap 180 seq_num 567) 2024-01-13T18:06:55.130 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 181 2024-01-13T18:06:55.130 INFO:tasks.rados.rados.0.smithi084.stdout:1833: seq_num 569 ranges {6971392=737280,7708672=671744,8380416=737280,9117696=196608} 2024-01-13T18:06:55.172 INFO:tasks.rados.rados.0.smithi084.stdout:1833: writing smithi084102331-14 from 6971392 to 7708672 tid 1 2024-01-13T18:06:55.175 INFO:tasks.rados.rados.0.smithi084.stdout:1833: writing smithi084102331-14 from 7708672 to 8380416 tid 2 2024-01-13T18:06:55.180 INFO:tasks.rados.rados.0.smithi084.stdout:1833: writing smithi084102331-14 from 8380416 to 9117696 tid 3 2024-01-13T18:06:55.181 INFO:tasks.rados.rados.0.smithi084.stdout:1833: writing smithi084102331-14 from 9117696 to 9314304 tid 4 2024-01-13T18:06:55.181 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 181 2024-01-13T18:06:55.181 INFO:tasks.rados.rados.0.smithi084.stdout:1834: seq_num 570 ranges {2457600=753664,3211264=548864,3760128=540672,4300800=516096} 2024-01-13T18:06:55.198 INFO:tasks.rados.rados.0.smithi084.stdout:1834: writing smithi084102331-19 from 2457600 to 3211264 tid 1 2024-01-13T18:06:55.201 INFO:tasks.rados.rados.0.smithi084.stdout:1834: writing smithi084102331-19 from 3211264 to 3760128 tid 2 2024-01-13T18:06:55.204 INFO:tasks.rados.rados.0.smithi084.stdout:1834: writing smithi084102331-19 from 3760128 to 4300800 tid 3 2024-01-13T18:06:55.207 INFO:tasks.rados.rados.0.smithi084.stdout:1834: writing smithi084102331-19 from 4300800 to 4816896 tid 4 2024-01-13T18:06:55.207 INFO:tasks.rados.rados.0.smithi084.stdout:1835: rollback oid 47 current snap is 181 2024-01-13T18:06:55.208 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 177 2024-01-13T18:06:55.208 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 1 to smithi084102331-14 2024-01-13T18:06:55.208 INFO:tasks.rados.rados.0.smithi084.stdout:1832: expect (ObjNum 567 snap 180 seq_num 567) 2024-01-13T18:06:55.619 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:55 smithi099 systemd[1]: Stopping Ceph osd.7 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:06:55.619 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:55 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[99404]: 2024-01-13T18:06:55.470+0000 7f1656e67700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:06:55.620 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:55 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[99404]: 2024-01-13T18:06:55.470+0000 7f1656e67700 -1 osd.7 433 *** Got signal Terminated *** 2024-01-13T18:06:55.620 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:55 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[99404]: 2024-01-13T18:06:55.470+0000 7f1656e67700 -1 osd.7 433 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T18:06:55.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:55 smithi084 ceph-mon[119097]: failed to encode map e433 with expected crc 2024-01-13T18:06:55.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:55 smithi084 ceph-mon[119097]: failed to encode map e433 with expected crc 2024-01-13T18:06:55.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:55 smithi084 ceph-mon[119097]: osdmap e433: 8 total, 8 up, 8 in 2024-01-13T18:06:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:55 smithi084 ceph-mon[119097]: osd.7 marked itself down and dead 2024-01-13T18:06:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:55 smithi084 ceph-mon[116404]: failed to encode map e433 with expected crc 2024-01-13T18:06:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:55 smithi084 ceph-mon[116404]: failed to encode map e433 with expected crc 2024-01-13T18:06:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:55 smithi084 ceph-mon[116404]: osdmap e433: 8 total, 8 up, 8 in 2024-01-13T18:06:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:55 smithi084 ceph-mon[116404]: osd.7 marked itself down and dead 2024-01-13T18:06:55.995 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 2 to smithi084102331-14 2024-01-13T18:06:55.996 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 3 to smithi084102331-14 2024-01-13T18:06:55.996 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 4 to smithi084102331-14 2024-01-13T18:06:55.996 INFO:tasks.rados.rados.0.smithi084.stdout:1832: done (3 left) 2024-01-13T18:06:55.996 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 181 2024-01-13T18:06:55.996 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 5 to smithi084102331-14 2024-01-13T18:06:55.996 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 6 to smithi084102331-14 2024-01-13T18:06:55.996 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 828 (ObjNum 569 snap 181 seq_num 569) dirty exists 2024-01-13T18:06:55.996 INFO:tasks.rados.rados.0.smithi084.stdout:1833: left oid 14 (ObjNum 569 snap 181 seq_num 569) 2024-01-13T18:06:55.996 INFO:tasks.rados.rados.0.smithi084.stdout:1835: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:06:55.996 INFO:tasks.rados.rados.0.smithi084.stdout:1836: seq_num 571 ranges {1171456=770048,1941504=483328,2424832=753664,3178496=368640} 2024-01-13T18:06:56.005 INFO:tasks.rados.rados.0.smithi084.stdout:1836: writing smithi084102331-38 from 1171456 to 1941504 tid 1 2024-01-13T18:06:56.008 INFO:tasks.rados.rados.0.smithi084.stdout:1836: writing smithi084102331-38 from 1941504 to 2424832 tid 2 2024-01-13T18:06:56.013 INFO:tasks.rados.rados.0.smithi084.stdout:1836: writing smithi084102331-38 from 2424832 to 3178496 tid 3 2024-01-13T18:06:56.016 INFO:tasks.rados.rados.0.smithi084.stdout:1836: writing smithi084102331-38 from 3178496 to 3547136 tid 4 2024-01-13T18:06:56.016 INFO:tasks.rados.rados.0.smithi084.stdout:1833: done (3 left) 2024-01-13T18:06:56.016 INFO:tasks.rados.rados.0.smithi084.stdout:1837: copy_from oid 32 from oid 13 current snap is 181 2024-01-13T18:06:56.016 INFO:tasks.rados.rados.0.smithi084.stdout:1835: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:06:56.016 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 966 (ObjNum 113 snap 0 seq_num 4036908384) dirty dne 2024-01-13T18:06:56.016 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 1 to smithi084102331-19 2024-01-13T18:06:56.016 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 2 to smithi084102331-19 2024-01-13T18:06:56.016 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 3 to smithi084102331-19 2024-01-13T18:06:56.016 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 4 to smithi084102331-19 2024-01-13T18:06:56.016 INFO:tasks.rados.rados.0.smithi084.stdout:1835: done (3 left) 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:1838: read oid 49 snap 180 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:1838: expect (ObjNum 499 snap 161 seq_num 499) 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:1839: read oid 34 snap -1 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:1839: expect (ObjNum 549 snap 177 seq_num 549) 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 181 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 5 to smithi084102331-19 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 6 to smithi084102331-19 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 623 (ObjNum 570 snap 181 seq_num 570) dirty exists 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:1834: left oid 19 (ObjNum 570 snap 181 seq_num 570) 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:1836: finishing write tid 1 to smithi084102331-38 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:1836: finishing write tid 2 to smithi084102331-38 2024-01-13T18:06:56.017 INFO:tasks.rados.rados.0.smithi084.stdout:1840: seq_num 572 ranges {3751936=786432,4538368=770048,5308416=557056,5865472=278528} 2024-01-13T18:06:56.041 INFO:tasks.rados.rados.0.smithi084.stdout:1840: writing smithi084102331-3 from 3751936 to 4538368 tid 1 2024-01-13T18:06:56.045 INFO:tasks.rados.rados.0.smithi084.stdout:1840: writing smithi084102331-3 from 4538368 to 5308416 tid 2 2024-01-13T18:06:56.048 INFO:tasks.rados.rados.0.smithi084.stdout:1840: writing smithi084102331-3 from 5308416 to 5865472 tid 3 2024-01-13T18:06:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:1840: writing smithi084102331-3 from 5865472 to 6144000 tid 4 2024-01-13T18:06:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:1834: done (5 left) 2024-01-13T18:06:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:1841: rollback oid 26 current snap is 181 2024-01-13T18:06:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 180 2024-01-13T18:06:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:1836: finishing write tid 3 to smithi084102331-38 2024-01-13T18:06:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 181 2024-01-13T18:06:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:1836: finishing write tid 4 to smithi084102331-38 2024-01-13T18:06:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:1836: finishing write tid 5 to smithi084102331-38 2024-01-13T18:06:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:1842: seq_num 573 ranges {10739712=802816,11542528=655360,12197888=720896,12918784=229376} 2024-01-13T18:06:56.111 INFO:tasks.rados.rados.0.smithi084.stdout:1842: writing smithi084102331-50 from 10739712 to 11542528 tid 1 2024-01-13T18:06:56.114 INFO:tasks.rados.rados.0.smithi084.stdout:1842: writing smithi084102331-50 from 11542528 to 12197888 tid 2 2024-01-13T18:06:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:55 smithi099 ceph-mon[138788]: failed to encode map e433 with expected crc 2024-01-13T18:06:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:55 smithi099 ceph-mon[138788]: failed to encode map e433 with expected crc 2024-01-13T18:06:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:55 smithi099 ceph-mon[138788]: osdmap e433: 8 total, 8 up, 8 in 2024-01-13T18:06:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:55 smithi099 ceph-mon[138788]: osd.7 marked itself down and dead 2024-01-13T18:06:56.119 INFO:tasks.rados.rados.0.smithi084.stdout:1842: writing smithi084102331-50 from 12197888 to 12918784 tid 3 2024-01-13T18:06:56.121 INFO:tasks.rados.rados.0.smithi084.stdout:1842: writing smithi084102331-50 from 12918784 to 13148160 tid 4 2024-01-13T18:06:56.121 INFO:tasks.rados.rados.0.smithi084.stdout:1843: snap_create 2024-01-13T18:06:56.121 INFO:tasks.rados.rados.0.smithi084.stdout:1836: finishing write tid 6 to smithi084102331-38 2024-01-13T18:06:56.121 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1076 (ObjNum 571 snap 181 seq_num 571) dirty exists 2024-01-13T18:06:56.121 INFO:tasks.rados.rados.0.smithi084.stdout:1836: left oid 38 (ObjNum 571 snap 181 seq_num 571) 2024-01-13T18:06:56.121 INFO:tasks.rados.rados.0.smithi084.stdout:1839: expect (ObjNum 549 snap 177 seq_num 549) 2024-01-13T18:06:56.169 INFO:tasks.rados.rados.0.smithi084.stdout:1838: expect (ObjNum 499 snap 161 seq_num 499) 2024-01-13T18:06:56.413 INFO:tasks.rados.rados.0.smithi084.stdout:1840: finishing write tid 1 to smithi084102331-3 2024-01-13T18:06:56.413 INFO:tasks.rados.rados.0.smithi084.stdout:1840: finishing write tid 2 to smithi084102331-3 2024-01-13T18:06:56.413 INFO:tasks.rados.rados.0.smithi084.stdout:1840: finishing write tid 3 to smithi084102331-3 2024-01-13T18:06:56.413 INFO:tasks.rados.rados.0.smithi084.stdout:1841: finishing rollback tid 1 to smithi084102331-26 2024-01-13T18:06:56.413 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 0 (ObjNum 177 snap 0 seq_num 3552013504) dirty dne 2024-01-13T18:06:56.413 INFO:tasks.rados.rados.0.smithi084.stdout:1840: finishing write tid 4 to smithi084102331-3 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:1840: finishing write tid 5 to smithi084102331-3 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:1840: finishing write tid 6 to smithi084102331-3 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1082 (ObjNum 572 snap 181 seq_num 572) dirty exists 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:1840: left oid 3 (ObjNum 572 snap 181 seq_num 572) 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 1 to smithi084102331-50 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 2 to smithi084102331-50 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 3 to smithi084102331-50 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 4 to smithi084102331-50 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 5 to smithi084102331-50 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 6 to smithi084102331-50 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 895 (ObjNum 573 snap 181 seq_num 573) dirty exists 2024-01-13T18:06:56.414 INFO:tasks.rados.rados.0.smithi084.stdout:1842: left oid 50 (ObjNum 573 snap 181 seq_num 573) 2024-01-13T18:06:56.619 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:56 smithi099 bash[163128]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7 2024-01-13T18:06:56.675 INFO:tasks.rados.rados.0.smithi084.stdout:1836: done (7 left) 2024-01-13T18:06:56.675 INFO:tasks.rados.rados.0.smithi084.stdout:1838: done (6 left) 2024-01-13T18:06:56.675 INFO:tasks.rados.rados.0.smithi084.stdout:1839: done (5 left) 2024-01-13T18:06:56.675 INFO:tasks.rados.rados.0.smithi084.stdout:1840: done (4 left) 2024-01-13T18:06:56.675 INFO:tasks.rados.rados.0.smithi084.stdout:1841: done (3 left) 2024-01-13T18:06:56.675 INFO:tasks.rados.rados.0.smithi084.stdout:1842: done (2 left) 2024-01-13T18:06:56.675 INFO:tasks.rados.rados.0.smithi084.stdout:1843: done (1 left) 2024-01-13T18:06:56.675 INFO:tasks.rados.rados.0.smithi084.stdout:1844: read oid 38 snap -1 2024-01-13T18:06:56.675 INFO:tasks.rados.rados.0.smithi084.stdout:1844: expect (ObjNum 571 snap 181 seq_num 571) 2024-01-13T18:06:56.675 INFO:tasks.rados.rados.0.smithi084.stdout:1845: snap_remove snap 171 2024-01-13T18:06:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:56 smithi099 ceph-mon[138788]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:06:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:56 smithi099 ceph-mon[138788]: osdmap e434: 8 total, 7 up, 8 in 2024-01-13T18:06:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:56 smithi099 ceph-mon[138788]: pgmap v363: 121 pgs: 19 stale+active+clean, 102 active+clean; 211 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 3.6 MiB/s wr, 11 op/s 2024-01-13T18:06:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:56 smithi099 ceph-mon[138788]: osdmap e435: 8 total, 7 up, 8 in 2024-01-13T18:06:57.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:56 smithi084 ceph-mon[116404]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:06:57.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:56 smithi084 ceph-mon[116404]: osdmap e434: 8 total, 7 up, 8 in 2024-01-13T18:06:57.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:56 smithi084 ceph-mon[116404]: pgmap v363: 121 pgs: 19 stale+active+clean, 102 active+clean; 211 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 3.6 MiB/s wr, 11 op/s 2024-01-13T18:06:57.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:56 smithi084 ceph-mon[116404]: osdmap e435: 8 total, 7 up, 8 in 2024-01-13T18:06:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:56 smithi084 ceph-mon[119097]: Health check failed: 1 osds down (OSD_DOWN) 2024-01-13T18:06:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:56 smithi084 ceph-mon[119097]: osdmap e434: 8 total, 7 up, 8 in 2024-01-13T18:06:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:56 smithi084 ceph-mon[119097]: pgmap v363: 121 pgs: 19 stale+active+clean, 102 active+clean; 211 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 3.6 MiB/s wr, 11 op/s 2024-01-13T18:06:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:56 smithi084 ceph-mon[119097]: osdmap e435: 8 total, 7 up, 8 in 2024-01-13T18:06:57.639 INFO:tasks.rados.rados.0.smithi084.stdout:1845: done (2 left) 2024-01-13T18:06:57.640 INFO:tasks.rados.rados.0.smithi084.stdout:1846: copy_from oid 2 from oid 8 current snap is 182 2024-01-13T18:06:57.640 INFO:tasks.rados.rados.0.smithi084.stdout:1837: finishing copy_from to smithi084102331-32 2024-01-13T18:06:57.640 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 660 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:06:57.640 INFO:tasks.rados.rados.0.smithi084.stdout:1837: finishing copy_from racing read to smithi084102331-32 2024-01-13T18:06:57.640 INFO:tasks.rados.rados.0.smithi084.stdout:1844: expect (ObjNum 571 snap 181 seq_num 571) 2024-01-13T18:06:57.759 INFO:tasks.rados.rados.0.smithi084.stdout:1846: finishing copy_from to smithi084102331-2 2024-01-13T18:06:57.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 840 (ObjNum 403 snap 128 seq_num 403) dirty exists 2024-01-13T18:06:57.759 INFO:tasks.rados.rados.0.smithi084.stdout:1846: finishing copy_from racing read to smithi084102331-2 2024-01-13T18:06:57.760 INFO:tasks.rados.rados.0.smithi084.stdout:1837: done (2 left) 2024-01-13T18:06:57.760 INFO:tasks.rados.rados.0.smithi084.stdout:1844: done (1 left) 2024-01-13T18:06:57.760 INFO:tasks.rados.rados.0.smithi084.stdout:1846: done (0 left) 2024-01-13T18:06:57.760 INFO:tasks.rados.rados.0.smithi084.stdout:1847: snap_remove snap 181 2024-01-13T18:06:57.869 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:57 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.7.service: Succeeded. 2024-01-13T18:06:57.869 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:57 smithi099 systemd[1]: Stopped Ceph osd.7 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:06:57.869 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:57 smithi099 systemd[1]: Starting Ceph osd.7 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:06:58.649 INFO:tasks.rados.rados.0.smithi084.stdout:1847: done (0 left) 2024-01-13T18:06:58.649 INFO:tasks.rados.rados.0.smithi084.stdout:1848: snap_remove snap 177 2024-01-13T18:06:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:58 smithi099 ceph-mon[138788]: osdmap e436: 8 total, 7 up, 8 in 2024-01-13T18:06:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:58 smithi099 ceph-mon[138788]: pgmap v366: 121 pgs: 6 active+undersized+degraded, 11 peering, 4 stale+active+clean, 17 active+undersized, 83 active+clean; 235 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 8.1 MiB/s wr, 32 op/s; 19/309 objects degraded (6.149%) 2024-01-13T18:06:58.869 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:58 smithi099 bash[163399]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-13T18:06:58.869 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:58 smithi099 bash[163399]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-01-13T18:06:58.869 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:58 smithi099 bash[163399]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-01-13T18:06:58.869 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:58 smithi099 bash[163399]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-01-13T18:06:58.869 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:58 smithi099 bash[163399]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-01-13T18:06:58.870 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:58 smithi099 bash[163399]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-13T18:06:58.870 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:58 smithi099 bash[163399]: --> ceph-volume raw activate successful for osd ID: 7 2024-01-13T18:06:58.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:58 smithi084 ceph-mon[116404]: osdmap e436: 8 total, 7 up, 8 in 2024-01-13T18:06:58.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:58 smithi084 ceph-mon[116404]: pgmap v366: 121 pgs: 6 active+undersized+degraded, 11 peering, 4 stale+active+clean, 17 active+undersized, 83 active+clean; 235 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 8.1 MiB/s wr, 32 op/s; 19/309 objects degraded (6.149%) 2024-01-13T18:06:58.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:58 smithi084 ceph-mon[119097]: osdmap e436: 8 total, 7 up, 8 in 2024-01-13T18:06:58.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:58 smithi084 ceph-mon[119097]: pgmap v366: 121 pgs: 6 active+undersized+degraded, 11 peering, 4 stale+active+clean, 17 active+undersized, 83 active+clean; 235 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 8.1 MiB/s wr, 32 op/s; 19/309 objects degraded (6.149%) 2024-01-13T18:06:59.369 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:59 smithi099 ceph-osd[163714]: -- 172.21.15.99:0/1237415565 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5595bced04e0 con 0x5595bcea1400 2024-01-13T18:06:59.369 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:59 smithi099 bash[163676]: 237ebd4a72cdcb549a36fc3e5079732066585b5fb64828e46aaf38dc4860ae4f 2024-01-13T18:06:59.369 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:59 smithi099 systemd[1]: Started Ceph osd.7 for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:06:59.618 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:06:59.652 INFO:tasks.rados.rados.0.smithi084.stdout:1848: done (0 left) 2024-01-13T18:06:59.652 INFO:tasks.rados.rados.0.smithi084.stdout:1849: read oid 25 snap -1 2024-01-13T18:06:59.652 INFO:tasks.rados.rados.0.smithi084.stdout:1849: expect (ObjNum 497 snap 160 seq_num 497) 2024-01-13T18:06:59.652 INFO:tasks.rados.rados.0.smithi084.stdout:1850: snap_create 2024-01-13T18:06:59.674 INFO:tasks.rados.rados.0.smithi084.stdout:1849: expect (ObjNum 497 snap 160 seq_num 497) 2024-01-13T18:06:59.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[116404]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-13T18:06:59.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[116404]: Health check failed: Degraded data redundancy: 19/309 objects degraded (6.149%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[116404]: osdmap e437: 8 total, 7 up, 8 in 2024-01-13T18:06:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:59.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:59.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[119097]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-13T18:06:59.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[119097]: Health check failed: Degraded data redundancy: 19/309 objects degraded (6.149%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:06:59.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[119097]: osdmap e437: 8 total, 7 up, 8 in 2024-01-13T18:06:59.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:59.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:06:59.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:06:59 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:06:59.944 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (5m) 111s ago 7m 28.4M - 0.25.0 c8568f914cd2 a5cbc3e01ffb 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (4m) 26s ago 7m 89.9M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (8m) 111s ago 8m 15.8M - 17.2.7-268-g6441305d c3a232f785d8 0aa496cb2e91 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (8m) 26s ago 8m 21.6M - 17.2.7-268-g6441305d c3a232f785d8 9c33fc8e4d16 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (4m) 26s ago 10m 449M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (4m) 111s ago 12m 510M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (4m) 111s ago 12m 83.2M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d b64908c7a53c 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (3m) 26s ago 11m 69.7M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d be7bb477ea53 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (3m) 111s ago 11m 58.7M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d e13f01b852ff 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (5m) 111s ago 7m 10.3M - 1.5.0 0da6a335fe13 b72e6d50f165 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (4m) 26s ago 7m 16.1M - 1.5.0 0da6a335fe13 e9f879b5e55b 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (3m) 111s ago 10m 243M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d e18181bdb4a8 2024-01-13T18:06:59.945 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (2m) 111s ago 10m 187M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 32bdce285b36 2024-01-13T18:06:59.946 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (2m) 111s ago 10m 175M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 660c53389079 2024-01-13T18:06:59.946 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (114s) 111s ago 9m 11.8M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 0e4b8c3482a4 2024-01-13T18:06:59.946 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (86s) 26s ago 9m 252M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 76d7d19ec531 2024-01-13T18:06:59.946 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (57s) 26s ago 9m 242M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 5cf0e9339ca9 2024-01-13T18:06:59.946 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (28s) 26s ago 8m 14.8M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 919ac0aa6c87 2024-01-13T18:06:59.946 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 starting - - - 2488M 2024-01-13T18:06:59.946 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (4m) 26s ago 8m 60.9M - 2.43.0 a07b618ecd1d cb4c11bf6eec 2024-01-13T18:07:00.119 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:06:59 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T18:06:59.623+0000 7facca750640 -1 Falling back to public interface 2024-01-13T18:07:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:59 smithi099 ceph-mon[138788]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-13T18:07:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:59 smithi099 ceph-mon[138788]: Health check failed: Degraded data redundancy: 19/309 objects degraded (6.149%), 6 pgs degraded (PG_DEGRADED) 2024-01-13T18:07:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:59 smithi099 ceph-mon[138788]: osdmap e437: 8 total, 7 up, 8 in 2024-01-13T18:07:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:59 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:00.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:59 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:00.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:06:59 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:00.324 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:07:00.324 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:07:00.324 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:07:00.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 7 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-268-g6441305d (6441305d08929b8a72c0322a5c268c64b4a99c65) quincy (stable)": 2, 2024-01-13T18:07:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 12 2024-01-13T18:07:00.326 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:07:00.326 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:07:00.652 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:07:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:07:00] "GET /metrics HTTP/1.1" 200 36191 "" "Prometheus/2.43.0" 2024-01-13T18:07:00.655 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:00 smithi084 ceph-mon[119097]: from='client.44270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:00.655 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:00 smithi084 ceph-mon[119097]: osdmap e438: 8 total, 7 up, 8 in 2024-01-13T18:07:00.655 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:00 smithi084 ceph-mon[119097]: from='client.44276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:00.655 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:00 smithi084 ceph-mon[119097]: pgmap v369: 121 pgs: 8 active+undersized+degraded, 11 peering, 30 active+undersized, 72 active+clean; 234 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 24 MiB/s rd, 8.2 MiB/s wr, 31 op/s; 21/294 objects degraded (7.143%) 2024-01-13T18:07:00.655 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:00 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1806549376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:00.657 INFO:tasks.rados.rados.0.smithi084.stdout:1849: done (1 left) 2024-01-13T18:07:00.657 INFO:tasks.rados.rados.0.smithi084.stdout:1850: done (0 left) 2024-01-13T18:07:00.657 INFO:tasks.rados.rados.0.smithi084.stdout:1851: copy_from oid 48 from oid 40 current snap is 183 2024-01-13T18:07:00.657 INFO:tasks.rados.rados.0.smithi084.stdout:1852: read oid 3 snap 182 2024-01-13T18:07:00.658 INFO:tasks.rados.rados.0.smithi084.stdout:1852: expect (ObjNum 572 snap 181 seq_num 572) 2024-01-13T18:07:00.658 INFO:tasks.rados.rados.0.smithi084.stdout:1853: snap_create 2024-01-13T18:07:00.660 INFO:tasks.rados.rados.0.smithi084.stdout:1851: finishing copy_from to smithi084102331-48 2024-01-13T18:07:00.660 INFO:tasks.rados.rados.0.smithi084.stdout:1851: got expected ENOENT (src dne) 2024-01-13T18:07:00.660 INFO:tasks.rados.rados.0.smithi084.stdout:1851: finishing copy_from racing read to smithi084102331-48 2024-01-13T18:07:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:1852: expect (ObjNum 572 snap 181 seq_num 572) 2024-01-13T18:07:00.856 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:00 smithi099 ceph-mon[138788]: from='client.44270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:00.856 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:00 smithi099 ceph-mon[138788]: osdmap e438: 8 total, 7 up, 8 in 2024-01-13T18:07:00.856 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:00 smithi099 ceph-mon[138788]: from='client.44276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:00.856 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:00 smithi099 ceph-mon[138788]: pgmap v369: 121 pgs: 8 active+undersized+degraded, 11 peering, 30 active+undersized, 72 active+clean; 234 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 24 MiB/s rd, 8.2 MiB/s wr, 31 op/s; 21/294 objects degraded (7.143%) 2024-01-13T18:07:00.856 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:00 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1806549376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:00.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:00 smithi084 ceph-mon[116404]: from='client.44270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:00.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:00 smithi084 ceph-mon[116404]: osdmap e438: 8 total, 7 up, 8 in 2024-01-13T18:07:00.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:00 smithi084 ceph-mon[116404]: from='client.44276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:00.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:00 smithi084 ceph-mon[116404]: pgmap v369: 121 pgs: 8 active+undersized+degraded, 11 peering, 30 active+undersized, 72 active+clean; 234 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 24 MiB/s rd, 8.2 MiB/s wr, 31 op/s; 21/294 objects degraded (7.143%) 2024-01-13T18:07:00.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:00 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1806549376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:01.661 INFO:tasks.rados.rados.0.smithi084.stdout:1851: done (2 left) 2024-01-13T18:07:01.661 INFO:tasks.rados.rados.0.smithi084.stdout:1852: done (1 left) 2024-01-13T18:07:01.662 INFO:tasks.rados.rados.0.smithi084.stdout:1853: done (0 left) 2024-01-13T18:07:01.662 INFO:tasks.rados.rados.0.smithi084.stdout:1854: delete oid 8 current snap is 184 2024-01-13T18:07:01.663 INFO:tasks.rados.rados.0.smithi084.stdout:1854: done (0 left) 2024-01-13T18:07:01.664 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 184 2024-01-13T18:07:01.664 INFO:tasks.rados.rados.0.smithi084.stdout:1855: seq_num 575 ranges {4816896=32768} 2024-01-13T18:07:01.689 INFO:tasks.rados.rados.0.smithi084.stdout:1855: writing smithi084102331-19 from 4816896 to 4849664 tid 1 2024-01-13T18:07:01.690 INFO:tasks.rados.rados.0.smithi084.stdout:1856: rollback oid 40 current snap is 184 2024-01-13T18:07:01.690 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 183 2024-01-13T18:07:01.690 INFO:tasks.rados.rados.0.smithi084.stdout:1857: rmattr oid 1 current snap is 184 2024-01-13T18:07:01.690 INFO:tasks.rados.rados.0.smithi084.stdout:1857: done (2 left) 2024-01-13T18:07:01.690 INFO:tasks.rados.rados.0.smithi084.stdout:1858: delete oid 46 current snap is 184 2024-01-13T18:07:01.692 INFO:tasks.rados.rados.0.smithi084.stdout:1856: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:07:01.692 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 0 (ObjNum 1201 snap 0 seq_num 4037605600) dirty dne 2024-01-13T18:07:01.692 INFO:tasks.rados.rados.0.smithi084.stdout:1856: done (2 left) 2024-01-13T18:07:01.692 INFO:tasks.rados.rados.0.smithi084.stdout:1858: done (1 left) 2024-01-13T18:07:01.692 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 184 2024-01-13T18:07:01.693 INFO:tasks.rados.rados.0.smithi084.stdout:1859: seq_num 577 ranges {6144000=65536} 2024-01-13T18:07:01.726 INFO:tasks.rados.rados.0.smithi084.stdout:1859: writing smithi084102331-3 from 6144000 to 6209536 tid 1 2024-01-13T18:07:01.726 INFO:tasks.rados.rados.0.smithi084.stdout:1860: copy_from oid 44 from oid 14 current snap is 184 2024-01-13T18:07:01.726 INFO:tasks.rados.rados.0.smithi084.stdout:1855: finishing write tid 1 to smithi084102331-19 2024-01-13T18:07:01.726 INFO:tasks.rados.rados.0.smithi084.stdout:1861: snap_create 2024-01-13T18:07:01.726 INFO:tasks.rados.rados.0.smithi084.stdout:1855: finishing write tid 2 to smithi084102331-19 2024-01-13T18:07:01.726 INFO:tasks.rados.rados.0.smithi084.stdout:1855: finishing write tid 3 to smithi084102331-19 2024-01-13T18:07:01.726 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 625 (ObjNum 575 snap 184 seq_num 575) dirty exists 2024-01-13T18:07:01.726 INFO:tasks.rados.rados.0.smithi084.stdout:1855: left oid 19 (ObjNum 575 snap 184 seq_num 575) 2024-01-13T18:07:01.729 INFO:tasks.rados.rados.0.smithi084.stdout:1859: finishing write tid 1 to smithi084102331-3 2024-01-13T18:07:01.729 INFO:tasks.rados.rados.0.smithi084.stdout:1859: finishing write tid 2 to smithi084102331-3 2024-01-13T18:07:01.730 INFO:tasks.rados.rados.0.smithi084.stdout:1859: finishing write tid 3 to smithi084102331-3 2024-01-13T18:07:01.730 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1097 (ObjNum 577 snap 184 seq_num 577) dirty exists 2024-01-13T18:07:01.730 INFO:tasks.rados.rados.0.smithi084.stdout:1859: left oid 3 (ObjNum 577 snap 184 seq_num 577) 2024-01-13T18:07:01.763 INFO:tasks.rados.rados.0.smithi084.stdout:1860: finishing copy_from to smithi084102331-44 2024-01-13T18:07:01.763 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 828 (ObjNum 569 snap 181 seq_num 569) dirty exists 2024-01-13T18:07:01.763 INFO:tasks.rados.rados.0.smithi084.stdout:1860: finishing copy_from racing read to smithi084102331-44 2024-01-13T18:07:01.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:01 smithi084 ceph-mon[116404]: osdmap e439: 8 total, 7 up, 8 in 2024-01-13T18:07:01.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:01 smithi084 ceph-mon[119097]: osdmap e439: 8 total, 7 up, 8 in 2024-01-13T18:07:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:01 smithi099 ceph-mon[138788]: osdmap e439: 8 total, 7 up, 8 in 2024-01-13T18:07:02.635 INFO:tasks.rados.rados.0.smithi084.stdout:1855: done (3 left) 2024-01-13T18:07:02.635 INFO:tasks.rados.rados.0.smithi084.stdout:1859: done (2 left) 2024-01-13T18:07:02.635 INFO:tasks.rados.rados.0.smithi084.stdout:1860: done (1 left) 2024-01-13T18:07:02.635 INFO:tasks.rados.rados.0.smithi084.stdout:1861: done (0 left) 2024-01-13T18:07:02.635 INFO:tasks.rados.rados.0.smithi084.stdout:1862: rollback oid 2 current snap is 185 2024-01-13T18:07:02.635 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 184 2024-01-13T18:07:02.636 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 185 2024-01-13T18:07:02.636 INFO:tasks.rados.rados.0.smithi084.stdout:1863: seq_num 578 ranges {2457600=81920} 2024-01-13T18:07:02.648 INFO:tasks.rados.rados.0.smithi084.stdout:1863: writing smithi084102331-11 from 2457600 to 2539520 tid 1 2024-01-13T18:07:02.648 INFO:tasks.rados.rados.0.smithi084.stdout:1864: copy_from oid 49 from oid 36 current snap is 185 2024-01-13T18:07:02.649 INFO:tasks.rados.rados.0.smithi084.stdout:1862: finishing rollback tid 0 to smithi084102331-2 2024-01-13T18:07:02.649 INFO:tasks.rados.rados.0.smithi084.stdout:1862: finishing rollback tid 1 to smithi084102331-2 2024-01-13T18:07:02.649 INFO:tasks.rados.rados.0.smithi084.stdout:1862: finishing rollback tid 2 to smithi084102331-2 2024-01-13T18:07:02.649 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1022 (ObjNum 403 snap 128 seq_num 403) dirty exists 2024-01-13T18:07:02.649 INFO:tasks.rados.rados.0.smithi084.stdout:1862: done (2 left) 2024-01-13T18:07:02.649 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 185 2024-01-13T18:07:02.649 INFO:tasks.rados.rados.0.smithi084.stdout:1865: seq_num 579 ranges {6504448=98304} 2024-01-13T18:07:02.660 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T18:07:02.398+0000 7facca750640 -1 osd.7 0 read_superblock omap replica is missing. 2024-01-13T18:07:02.660 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T18:07:02.446+0000 7facca750640 -1 osd.7 433 log_to_monitors true 2024-01-13T18:07:02.660 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: osdmap e440: 8 total, 7 up, 8 in 2024-01-13T18:07:02.660 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.660 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.660 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: pgmap v372: 121 pgs: 9 active+undersized+degraded, 40 active+undersized, 72 active+clean; 208 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 6 op/s; 22/240 objects degraded (9.167%) 2024-01-13T18:07:02.660 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: from='osd.7 [v2:172.21.15.99:6824/2512047858,v1:172.21.15.99:6825/2512047858]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T18:07:02.660 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T18:07:02.660 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.660 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.660 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-13T18:07:02.661 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: osdmap e441: 8 total, 7 up, 8 in 2024-01-13T18:07:02.661 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: from='osd.7 [v2:172.21.15.99:6824/2512047858,v1:172.21.15.99:6825/2512047858]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:07:02.661 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-mon[138788]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:07:02.685 INFO:tasks.rados.rados.0.smithi084.stdout:1865: writing smithi084102331-43 from 6504448 to 6602752 tid 1 2024-01-13T18:07:02.685 INFO:tasks.rados.rados.0.smithi084.stdout:1866: read oid 37 snap -1 2024-01-13T18:07:02.685 INFO:tasks.rados.rados.0.smithi084.stdout:1866: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:02.685 INFO:tasks.rados.rados.0.smithi084.stdout:1867: rollback oid 1 current snap is 185 2024-01-13T18:07:02.685 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 1 to 180 2024-01-13T18:07:02.685 INFO:tasks.rados.rados.0.smithi084.stdout:1863: finishing write tid 1 to smithi084102331-11 2024-01-13T18:07:02.685 INFO:tasks.rados.rados.0.smithi084.stdout:1863: finishing write tid 2 to smithi084102331-11 2024-01-13T18:07:02.685 INFO:tasks.rados.rados.0.smithi084.stdout:1863: finishing write tid 3 to smithi084102331-11 2024-01-13T18:07:02.685 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 652 (ObjNum 578 snap 185 seq_num 578) dirty exists 2024-01-13T18:07:02.685 INFO:tasks.rados.rados.0.smithi084.stdout:1863: left oid 11 (ObjNum 578 snap 185 seq_num 578) 2024-01-13T18:07:02.686 INFO:tasks.rados.rados.0.smithi084.stdout:1864: finishing copy_from to smithi084102331-49 2024-01-13T18:07:02.686 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 810 (ObjNum 534 snap 171 seq_num 534) dirty exists 2024-01-13T18:07:02.686 INFO:tasks.rados.rados.0.smithi084.stdout:1864: finishing copy_from racing read to smithi084102331-49 2024-01-13T18:07:02.686 INFO:tasks.rados.rados.0.smithi084.stdout:1863: done (4 left) 2024-01-13T18:07:02.686 INFO:tasks.rados.rados.0.smithi084.stdout:1864: done (3 left) 2024-01-13T18:07:02.686 INFO:tasks.rados.rados.0.smithi084.stdout:1868: snap_create 2024-01-13T18:07:02.686 INFO:tasks.rados.rados.0.smithi084.stdout:1866: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:02.690 INFO:tasks.rados.rados.0.smithi084.stdout:1867: finishing rollback tid 0 to smithi084102331-1 2024-01-13T18:07:02.690 INFO:tasks.rados.rados.0.smithi084.stdout:1867: finishing rollback tid 1 to smithi084102331-1 2024-01-13T18:07:02.691 INFO:tasks.rados.rados.0.smithi084.stdout:1867: finishing rollback tid 2 to smithi084102331-1 2024-01-13T18:07:02.691 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1101 (ObjNum 513 snap 164 seq_num 513) dirty exists 2024-01-13T18:07:02.691 INFO:tasks.rados.rados.0.smithi084.stdout:1865: finishing write tid 1 to smithi084102331-43 2024-01-13T18:07:02.691 INFO:tasks.rados.rados.0.smithi084.stdout:1865: finishing write tid 2 to smithi084102331-43 2024-01-13T18:07:02.691 INFO:tasks.rados.rados.0.smithi084.stdout:1865: finishing write tid 3 to smithi084102331-43 2024-01-13T18:07:02.692 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 597 (ObjNum 579 snap 185 seq_num 579) dirty exists 2024-01-13T18:07:02.692 INFO:tasks.rados.rados.0.smithi084.stdout:1865: left oid 43 (ObjNum 579 snap 185 seq_num 579) 2024-01-13T18:07:02.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: osdmap e440: 8 total, 7 up, 8 in 2024-01-13T18:07:02.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: pgmap v372: 121 pgs: 9 active+undersized+degraded, 40 active+undersized, 72 active+clean; 208 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 6 op/s; 22/240 objects degraded (9.167%) 2024-01-13T18:07:02.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: from='osd.7 [v2:172.21.15.99:6824/2512047858,v1:172.21.15.99:6825/2512047858]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T18:07:02.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T18:07:02.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-13T18:07:02.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: osdmap e441: 8 total, 7 up, 8 in 2024-01-13T18:07:02.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: from='osd.7 [v2:172.21.15.99:6824/2512047858,v1:172.21.15.99:6825/2512047858]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:07:02.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[116404]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: osdmap e440: 8 total, 7 up, 8 in 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: pgmap v372: 121 pgs: 9 active+undersized+degraded, 40 active+undersized, 72 active+clean; 208 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 6 op/s; 22/240 objects degraded (9.167%) 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: from='osd.7 [v2:172.21.15.99:6824/2512047858,v1:172.21.15.99:6825/2512047858]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: osdmap e441: 8 total, 7 up, 8 in 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: from='osd.7 [v2:172.21.15.99:6824/2512047858,v1:172.21.15.99:6825/2512047858]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:07:02.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:02 smithi084 ceph-mon[119097]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-13T18:07:02.949 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 18:07:02 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T18:07:02.658+0000 7facb7ba3700 -1 osd.7 433 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-13T18:07:03.672 INFO:tasks.rados.rados.0.smithi084.stdout:1865: done (3 left) 2024-01-13T18:07:03.673 INFO:tasks.rados.rados.0.smithi084.stdout:1866: done (2 left) 2024-01-13T18:07:03.673 INFO:tasks.rados.rados.0.smithi084.stdout:1867: done (1 left) 2024-01-13T18:07:03.673 INFO:tasks.rados.rados.0.smithi084.stdout:1868: done (0 left) 2024-01-13T18:07:03.673 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 186 2024-01-13T18:07:03.673 INFO:tasks.rados.rados.0.smithi084.stdout:1869: seq_num 580 ranges {0=114688} 2024-01-13T18:07:03.674 INFO:tasks.rados.rados.0.smithi084.stdout:1869: writing smithi084102331-8 from 0 to 114688 tid 1 2024-01-13T18:07:03.674 INFO:tasks.rados.rados.0.smithi084.stdout:1870: delete oid 12 current snap is 186 2024-01-13T18:07:03.682 INFO:tasks.rados.rados.0.smithi084.stdout:1870: done (1 left) 2024-01-13T18:07:03.682 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 186 2024-01-13T18:07:03.682 INFO:tasks.rados.rados.0.smithi084.stdout:1871: seq_num 582 ranges {13090816=155648} 2024-01-13T18:07:03.751 INFO:tasks.rados.rados.0.smithi084.stdout:1871: writing smithi084102331-35 from 13090816 to 13246464 tid 1 2024-01-13T18:07:03.752 INFO:tasks.rados.rados.0.smithi084.stdout:1872: delete oid 4 current snap is 186 2024-01-13T18:07:03.755 INFO:tasks.rados.rados.0.smithi084.stdout:1871: finishing write tid 1 to smithi084102331-35 2024-01-13T18:07:03.755 INFO:tasks.rados.rados.0.smithi084.stdout:1871: finishing write tid 2 to smithi084102331-35 2024-01-13T18:07:03.755 INFO:tasks.rados.rados.0.smithi084.stdout:1872: done (2 left) 2024-01-13T18:07:03.755 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 186 2024-01-13T18:07:03.755 INFO:tasks.rados.rados.0.smithi084.stdout:1873: seq_num 584 ranges {2695168=188416} 2024-01-13T18:07:03.771 INFO:tasks.rados.rados.0.smithi084.stdout:1873: writing smithi084102331-9 from 2695168 to 2883584 tid 1 2024-01-13T18:07:03.771 INFO:tasks.rados.rados.0.smithi084.stdout:1874: rmattr oid 25 current snap is 186 2024-01-13T18:07:03.771 INFO:tasks.rados.rados.0.smithi084.stdout:1871: finishing write tid 3 to smithi084102331-35 2024-01-13T18:07:03.771 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 681 (ObjNum 582 snap 186 seq_num 582) dirty exists 2024-01-13T18:07:03.771 INFO:tasks.rados.rados.0.smithi084.stdout:1871: left oid 35 (ObjNum 582 snap 186 seq_num 582) 2024-01-13T18:07:03.771 INFO:tasks.rados.rados.0.smithi084.stdout:1871: done (3 left) 2024-01-13T18:07:03.771 INFO:tasks.rados.rados.0.smithi084.stdout:1875: copy_from oid 37 from oid 49 current snap is 186 2024-01-13T18:07:03.771 INFO:tasks.rados.rados.0.smithi084.stdout:1876: copy_from oid 26 from oid 45 current snap is 186 2024-01-13T18:07:03.772 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 186 2024-01-13T18:07:03.772 INFO:tasks.rados.rados.0.smithi084.stdout:1877: seq_num 585 ranges {4849664=204800} 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:1877: writing smithi084102331-19 from 4849664 to 5054464 tid 1 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:1878: delete oid 17 current snap is 186 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 909 (ObjNum 497 snap 160 seq_num 497) dirty exists 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:1873: finishing write tid 1 to smithi084102331-9 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:1873: finishing write tid 2 to smithi084102331-9 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:1873: finishing write tid 3 to smithi084102331-9 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 563 (ObjNum 584 snap 186 seq_num 584) dirty exists 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:1873: left oid 9 (ObjNum 584 snap 186 seq_num 584) 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:1876: finishing copy_from to smithi084102331-26 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1070 (ObjNum 564 snap 180 seq_num 564) dirty exists 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:1876: finishing copy_from racing read to smithi084102331-26 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:1875: finishing copy_from to smithi084102331-37 2024-01-13T18:07:03.800 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 810 (ObjNum 534 snap 171 seq_num 534) dirty exists 2024-01-13T18:07:03.801 INFO:tasks.rados.rados.0.smithi084.stdout:1875: finishing copy_from racing read to smithi084102331-37 2024-01-13T18:07:03.802 INFO:tasks.rados.rados.0.smithi084.stdout:1873: done (6 left) 2024-01-13T18:07:03.802 INFO:tasks.rados.rados.0.smithi084.stdout:1874: done (5 left) 2024-01-13T18:07:03.802 INFO:tasks.rados.rados.0.smithi084.stdout:1875: done (4 left) 2024-01-13T18:07:03.802 INFO:tasks.rados.rados.0.smithi084.stdout:1876: done (3 left) 2024-01-13T18:07:03.802 INFO:tasks.rados.rados.0.smithi084.stdout:1878: done (2 left) 2024-01-13T18:07:03.802 INFO:tasks.rados.rados.0.smithi084.stdout:1879: read oid 6 snap -1 2024-01-13T18:07:03.803 INFO:tasks.rados.rados.0.smithi084.stdout:1879: expect deleted 2024-01-13T18:07:03.803 INFO:tasks.rados.rados.0.smithi084.stdout:1880: delete oid 15 current snap is 186 2024-01-13T18:07:03.803 INFO:tasks.rados.rados.0.smithi084.stdout:1877: finishing write tid 1 to smithi084102331-19 2024-01-13T18:07:03.803 INFO:tasks.rados.rados.0.smithi084.stdout:1877: finishing write tid 2 to smithi084102331-19 2024-01-13T18:07:03.803 INFO:tasks.rados.rados.0.smithi084.stdout:1877: finishing write tid 3 to smithi084102331-19 2024-01-13T18:07:03.804 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 627 (ObjNum 585 snap 186 seq_num 585) dirty exists 2024-01-13T18:07:03.804 INFO:tasks.rados.rados.0.smithi084.stdout:1877: left oid 19 (ObjNum 585 snap 186 seq_num 585) 2024-01-13T18:07:03.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:03 smithi099 ceph-mon[138788]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-01-13T18:07:03.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:03 smithi084 ceph-mon[116404]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-01-13T18:07:03.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:03 smithi084 ceph-mon[119097]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-01-13T18:07:04.693 INFO:tasks.rados.rados.0.smithi084.stdout:1877: done (3 left) 2024-01-13T18:07:04.693 INFO:tasks.rados.rados.0.smithi084.stdout:1879: done (2 left) 2024-01-13T18:07:04.693 INFO:tasks.rados.rados.0.smithi084.stdout:1880: done (1 left) 2024-01-13T18:07:04.693 INFO:tasks.rados.rados.0.smithi084.stdout:1881: snap_create 2024-01-13T18:07:04.696 INFO:tasks.rados.rados.0.smithi084.stdout:1869: finishing write tid 1 to smithi084102331-8 2024-01-13T18:07:04.697 INFO:tasks.rados.rados.0.smithi084.stdout:1869: finishing write tid 2 to smithi084102331-8 2024-01-13T18:07:04.701 INFO:tasks.rados.rados.0.smithi084.stdout:1869: finishing write tid 3 to smithi084102331-8 2024-01-13T18:07:04.701 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 976 (ObjNum 580 snap 186 seq_num 580) dirty exists 2024-01-13T18:07:04.701 INFO:tasks.rados.rados.0.smithi084.stdout:1869: left oid 8 (ObjNum 580 snap 186 seq_num 580) 2024-01-13T18:07:04.945 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:04 smithi099 ceph-mon[138788]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:07:04.945 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:04 smithi099 ceph-mon[138788]: osd.7 [v2:172.21.15.99:6824/2512047858,v1:172.21.15.99:6825/2512047858] boot 2024-01-13T18:07:04.945 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:04 smithi099 ceph-mon[138788]: osdmap e442: 8 total, 8 up, 8 in 2024-01-13T18:07:04.945 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:04 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:07:04.945 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:04 smithi099 ceph-mon[138788]: pgmap v375: 121 pgs: 9 active+undersized+degraded, 40 active+undersized, 72 active+clean; 215 MiB data, 868 MiB used, 714 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.0 MiB/s wr, 3 op/s; 24/249 objects degraded (9.639%) 2024-01-13T18:07:04.945 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:04 smithi099 ceph-mon[138788]: osdmap e443: 8 total, 8 up, 8 in 2024-01-13T18:07:05.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[119097]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:07:05.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[119097]: osd.7 [v2:172.21.15.99:6824/2512047858,v1:172.21.15.99:6825/2512047858] boot 2024-01-13T18:07:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[119097]: osdmap e442: 8 total, 8 up, 8 in 2024-01-13T18:07:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:07:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[119097]: pgmap v375: 121 pgs: 9 active+undersized+degraded, 40 active+undersized, 72 active+clean; 215 MiB data, 868 MiB used, 714 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.0 MiB/s wr, 3 op/s; 24/249 objects degraded (9.639%) 2024-01-13T18:07:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[119097]: osdmap e443: 8 total, 8 up, 8 in 2024-01-13T18:07:05.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[116404]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-01-13T18:07:05.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[116404]: osd.7 [v2:172.21.15.99:6824/2512047858,v1:172.21.15.99:6825/2512047858] boot 2024-01-13T18:07:05.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[116404]: osdmap e442: 8 total, 8 up, 8 in 2024-01-13T18:07:05.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-13T18:07:05.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[116404]: pgmap v375: 121 pgs: 9 active+undersized+degraded, 40 active+undersized, 72 active+clean; 215 MiB data, 868 MiB used, 714 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.0 MiB/s wr, 3 op/s; 24/249 objects degraded (9.639%) 2024-01-13T18:07:05.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:04 smithi084 ceph-mon[116404]: osdmap e443: 8 total, 8 up, 8 in 2024-01-13T18:07:05.702 INFO:tasks.rados.rados.0.smithi084.stdout:1869: done (1 left) 2024-01-13T18:07:05.702 INFO:tasks.rados.rados.0.smithi084.stdout:1881: done (0 left) 2024-01-13T18:07:05.702 INFO:tasks.rados.rados.0.smithi084.stdout:1882: delete oid 9 current snap is 187 2024-01-13T18:07:05.706 INFO:tasks.rados.rados.0.smithi084.stdout:1882: done (0 left) 2024-01-13T18:07:05.706 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 187 2024-01-13T18:07:05.706 INFO:tasks.rados.rados.0.smithi084.stdout:1883: seq_num 589 ranges {0=270336} 2024-01-13T18:07:05.710 INFO:tasks.rados.rados.0.smithi084.stdout:1883: writing smithi084102331-39 from 0 to 270336 tid 1 2024-01-13T18:07:05.710 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 187 2024-01-13T18:07:05.710 INFO:tasks.rados.rados.0.smithi084.stdout:1884: seq_num 590 ranges {0=286720} 2024-01-13T18:07:05.710 INFO:tasks.rados.rados.0.smithi084.stdout:1884: writing smithi084102331-47 from 0 to 286720 tid 1 2024-01-13T18:07:05.710 INFO:tasks.rados.rados.0.smithi084.stdout:1885: read oid 32 snap -1 2024-01-13T18:07:05.710 INFO:tasks.rados.rados.0.smithi084.stdout:1885: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:05.711 INFO:tasks.rados.rados.0.smithi084.stdout:1886: snap_remove snap 184 2024-01-13T18:07:06.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: Health check update: Degraded data redundancy: 24/249 objects degraded (9.639%), 9 pgs degraded (PG_DEGRADED) 2024-01-13T18:07:06.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:06.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:06.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.036 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: Upgrade: Setting container_image for all osd 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-01-13T18:07:06.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: Health check update: Degraded data redundancy: 24/249 objects degraded (9.639%), 9 pgs degraded (PG_DEGRADED) 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:06.038 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: Upgrade: Setting container_image for all osd 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-01-13T18:07:06.039 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-01-13T18:07:06.040 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-01-13T18:07:06.040 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-01-13T18:07:06.040 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-01-13T18:07:06.040 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-01-13T18:07:06.040 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-01-13T18:07:06.040 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-01-13T18:07:06.040 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-01-13T18:07:06.040 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: Upgrade: Setting require_osd_release to 18 reef 2024-01-13T18:07:06.040 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-01-13T18:07:06.040 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-01-13T18:07:06.041 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-01-13T18:07:06.041 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-01-13T18:07:06.041 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-01-13T18:07:06.041 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-01-13T18:07:06.041 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: Upgrade: Setting require_osd_release to 18 reef 2024-01-13T18:07:06.041 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-01-13T18:07:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: Health check update: Degraded data redundancy: 24/249 objects degraded (9.639%), 9 pgs degraded (PG_DEGRADED) 2024-01-13T18:07:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: Upgrade: Setting container_image for all osd 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-01-13T18:07:06.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: Upgrade: Setting require_osd_release to 18 reef 2024-01-13T18:07:06.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-01-13T18:07:06.718 INFO:tasks.rados.rados.0.smithi084.stdout:1886: done (3 left) 2024-01-13T18:07:06.718 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 187 2024-01-13T18:07:06.718 INFO:tasks.rados.rados.0.smithi084.stdout:1887: seq_num 591 ranges {794624=303104} 2024-01-13T18:07:06.718 INFO:tasks.rados.rados.0.smithi084.stdout:1887: writing smithi084102331-24 from 794624 to 1097728 tid 1 2024-01-13T18:07:06.719 INFO:tasks.rados.rados.0.smithi084.stdout:1888: copy_from oid 35 from oid 7 current snap is 187 2024-01-13T18:07:06.721 INFO:tasks.rados.rados.0.smithi084.stdout:1883: finishing write tid 1 to smithi084102331-39 2024-01-13T18:07:06.722 INFO:tasks.rados.rados.0.smithi084.stdout:1883: finishing write tid 2 to smithi084102331-39 2024-01-13T18:07:06.722 INFO:tasks.rados.rados.0.smithi084.stdout:1885: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:06.723 INFO:tasks.rados.rados.0.smithi084.stdout:1884: finishing write tid 1 to smithi084102331-47 2024-01-13T18:07:06.723 INFO:tasks.rados.rados.0.smithi084.stdout:1884: finishing write tid 2 to smithi084102331-47 2024-01-13T18:07:06.723 INFO:tasks.rados.rados.0.smithi084.stdout:1883: finishing write tid 3 to smithi084102331-39 2024-01-13T18:07:06.723 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 654 (ObjNum 589 snap 187 seq_num 589) dirty exists 2024-01-13T18:07:06.723 INFO:tasks.rados.rados.0.smithi084.stdout:1883: left oid 39 (ObjNum 589 snap 187 seq_num 589) 2024-01-13T18:07:06.723 INFO:tasks.rados.rados.0.smithi084.stdout:1884: finishing write tid 3 to smithi084102331-47 2024-01-13T18:07:06.723 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 986 (ObjNum 590 snap 187 seq_num 590) dirty exists 2024-01-13T18:07:06.723 INFO:tasks.rados.rados.0.smithi084.stdout:1884: left oid 47 (ObjNum 590 snap 187 seq_num 590) 2024-01-13T18:07:06.723 INFO:tasks.rados.rados.0.smithi084.stdout:1883: done (4 left) 2024-01-13T18:07:06.723 INFO:tasks.rados.rados.0.smithi084.stdout:1884: done (3 left) 2024-01-13T18:07:06.723 INFO:tasks.rados.rados.0.smithi084.stdout:1885: done (2 left) 2024-01-13T18:07:06.724 INFO:tasks.rados.rados.0.smithi084.stdout:1889: rollback oid 8 current snap is 187 2024-01-13T18:07:06.724 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 183 2024-01-13T18:07:06.724 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 187 2024-01-13T18:07:06.724 INFO:tasks.rados.rados.0.smithi084.stdout:1890: seq_num 592 ranges {3989504=319488} 2024-01-13T18:07:06.747 INFO:tasks.rados.rados.0.smithi084.stdout:1890: writing smithi084102331-49 from 3989504 to 4308992 tid 1 2024-01-13T18:07:06.747 INFO:tasks.rados.rados.0.smithi084.stdout:1891: read oid 6 snap -1 2024-01-13T18:07:06.747 INFO:tasks.rados.rados.0.smithi084.stdout:1891: expect deleted 2024-01-13T18:07:06.747 INFO:tasks.rados.rados.0.smithi084.stdout:1892: snap_create 2024-01-13T18:07:06.747 INFO:tasks.rados.rados.0.smithi084.stdout:1887: finishing write tid 1 to smithi084102331-24 2024-01-13T18:07:06.747 INFO:tasks.rados.rados.0.smithi084.stdout:1887: finishing write tid 2 to smithi084102331-24 2024-01-13T18:07:06.747 INFO:tasks.rados.rados.0.smithi084.stdout:1887: finishing write tid 3 to smithi084102331-24 2024-01-13T18:07:06.747 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 599 (ObjNum 591 snap 187 seq_num 591) dirty exists 2024-01-13T18:07:06.747 INFO:tasks.rados.rados.0.smithi084.stdout:1887: left oid 24 (ObjNum 591 snap 187 seq_num 591) 2024-01-13T18:07:06.748 INFO:tasks.rados.rados.0.smithi084.stdout:1889: finishing rollback tid 0 to smithi084102331-8 2024-01-13T18:07:06.748 INFO:tasks.rados.rados.0.smithi084.stdout:1889: finishing rollback tid 1 to smithi084102331-8 2024-01-13T18:07:06.748 INFO:tasks.rados.rados.0.smithi084.stdout:1889: finishing rollback tid 2 to smithi084102331-8 2024-01-13T18:07:06.748 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 992 (ObjNum 403 snap 128 seq_num 403) dirty exists 2024-01-13T18:07:06.748 INFO:tasks.rados.rados.0.smithi084.stdout:1888: finishing copy_from to smithi084102331-35 2024-01-13T18:07:06.748 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 589 (ObjNum 508 snap 162 seq_num 508) dirty exists 2024-01-13T18:07:06.748 INFO:tasks.rados.rados.0.smithi084.stdout:1888: finishing copy_from racing read to smithi084102331-35 2024-01-13T18:07:06.749 INFO:tasks.rados.rados.0.smithi084.stdout:1890: finishing write tid 1 to smithi084102331-49 2024-01-13T18:07:06.750 INFO:tasks.rados.rados.0.smithi084.stdout:1890: finishing write tid 2 to smithi084102331-49 2024-01-13T18:07:06.750 INFO:tasks.rados.rados.0.smithi084.stdout:1890: finishing write tid 3 to smithi084102331-49 2024-01-13T18:07:06.750 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1072 (ObjNum 592 snap 187 seq_num 592) dirty exists 2024-01-13T18:07:06.750 INFO:tasks.rados.rados.0.smithi084.stdout:1890: left oid 49 (ObjNum 592 snap 187 seq_num 592) 2024-01-13T18:07:06.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-01-13T18:07:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[116404]: osdmap e444: 8 total, 8 up, 8 in 2024-01-13T18:07:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["a"]}]: dispatch 2024-01-13T18:07:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[116404]: Upgrade: It appears safe to stop mds.a 2024-01-13T18:07:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[116404]: pgmap v378: 121 pgs: 4 peering, 8 active+undersized+degraded, 33 active+undersized, 76 active+clean; 225 MiB data, 880 MiB used, 714 GiB / 715 GiB avail; 28 KiB/s rd, 4.7 MiB/s wr, 5 op/s; 23/261 objects degraded (8.812%) 2024-01-13T18:07:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:07:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-01-13T18:07:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[119097]: osdmap e444: 8 total, 8 up, 8 in 2024-01-13T18:07:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["a"]}]: dispatch 2024-01-13T18:07:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[119097]: Upgrade: It appears safe to stop mds.a 2024-01-13T18:07:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[119097]: pgmap v378: 121 pgs: 4 peering, 8 active+undersized+degraded, 33 active+undersized, 76 active+clean; 225 MiB data, 880 MiB used, 714 GiB / 715 GiB avail; 28 KiB/s rd, 4.7 MiB/s wr, 5 op/s; 23/261 objects degraded (8.812%) 2024-01-13T18:07:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:07:06.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-01-13T18:07:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:06 smithi099 ceph-mon[138788]: osdmap e444: 8 total, 8 up, 8 in 2024-01-13T18:07:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["a"]}]: dispatch 2024-01-13T18:07:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:06 smithi099 ceph-mon[138788]: Upgrade: It appears safe to stop mds.a 2024-01-13T18:07:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:06 smithi099 ceph-mon[138788]: pgmap v378: 121 pgs: 4 peering, 8 active+undersized+degraded, 33 active+undersized, 76 active+clean; 225 MiB data, 880 MiB used, 714 GiB / 715 GiB avail; 28 KiB/s rd, 4.7 MiB/s wr, 5 op/s; 23/261 objects degraded (8.812%) 2024-01-13T18:07:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:07:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:07.717 INFO:tasks.rados.rados.0.smithi084.stdout:1887: done (5 left) 2024-01-13T18:07:07.717 INFO:tasks.rados.rados.0.smithi084.stdout:1888: done (4 left) 2024-01-13T18:07:07.717 INFO:tasks.rados.rados.0.smithi084.stdout:1889: done (3 left) 2024-01-13T18:07:07.717 INFO:tasks.rados.rados.0.smithi084.stdout:1890: done (2 left) 2024-01-13T18:07:07.717 INFO:tasks.rados.rados.0.smithi084.stdout:1891: done (1 left) 2024-01-13T18:07:07.717 INFO:tasks.rados.rados.0.smithi084.stdout:1892: done (0 left) 2024-01-13T18:07:07.717 INFO:tasks.rados.rados.0.smithi084.stdout:1893: setattr oid 37 current snap is 188 2024-01-13T18:07:07.719 INFO:tasks.rados.rados.0.smithi084.stdout:1894: copy_from oid 34 from oid 33 current snap is 188 2024-01-13T18:07:07.719 INFO:tasks.rados.rados.0.smithi084.stdout:1895: copy_from oid 16 from oid 43 current snap is 188 2024-01-13T18:07:07.719 INFO:tasks.rados.rados.0.smithi084.stdout:1896: rollback oid 13 current snap is 188 2024-01-13T18:07:07.719 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 13 to 183 2024-01-13T18:07:07.719 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 188 2024-01-13T18:07:07.719 INFO:tasks.rados.rados.0.smithi084.stdout:1897: seq_num 593 ranges {1097728=335872} 2024-01-13T18:07:07.727 INFO:tasks.rados.rados.0.smithi084.stdout:1897: writing smithi084102331-24 from 1097728 to 1433600 tid 1 2024-01-13T18:07:07.727 INFO:tasks.rados.rados.0.smithi084.stdout:1898: copy_from oid 38 from oid 11 current snap is 188 2024-01-13T18:07:07.727 INFO:tasks.rados.rados.0.smithi084.stdout:1899: rollback oid 47 current snap is 188 2024-01-13T18:07:07.727 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 185 2024-01-13T18:07:07.727 INFO:tasks.rados.rados.0.smithi084.stdout:1900: snap_create 2024-01-13T18:07:07.730 INFO:tasks.rados.rados.0.smithi084.stdout:1894: finishing copy_from to smithi084102331-34 2024-01-13T18:07:07.730 INFO:tasks.rados.rados.0.smithi084.stdout:1894: got expected ENOENT (src dne) 2024-01-13T18:07:07.730 INFO:tasks.rados.rados.0.smithi084.stdout:1894: finishing copy_from racing read to smithi084102331-34 2024-01-13T18:07:07.730 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 917 (ObjNum 534 snap 171 seq_num 534) dirty exists 2024-01-13T18:07:07.730 INFO:tasks.rados.rados.0.smithi084.stdout:1896: finishing rollback tid 0 to smithi084102331-13 2024-01-13T18:07:07.730 INFO:tasks.rados.rados.0.smithi084.stdout:1896: finishing rollback tid 1 to smithi084102331-13 2024-01-13T18:07:07.730 INFO:tasks.rados.rados.0.smithi084.stdout:1896: finishing rollback tid 2 to smithi084102331-13 2024-01-13T18:07:07.730 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 685 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:07:07.730 INFO:tasks.rados.rados.0.smithi084.stdout:1899: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:07:07.730 INFO:tasks.rados.rados.0.smithi084.stdout:1899: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:07:07.730 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 995 (ObjNum 33 snap 0 seq_num 2818045855) dirty dne 2024-01-13T18:07:07.736 INFO:tasks.rados.rados.0.smithi084.stdout:1897: finishing write tid 1 to smithi084102331-24 2024-01-13T18:07:07.736 INFO:tasks.rados.rados.0.smithi084.stdout:1897: finishing write tid 2 to smithi084102331-24 2024-01-13T18:07:07.736 INFO:tasks.rados.rados.0.smithi084.stdout:1897: finishing write tid 3 to smithi084102331-24 2024-01-13T18:07:07.736 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 601 (ObjNum 593 snap 188 seq_num 593) dirty exists 2024-01-13T18:07:07.736 INFO:tasks.rados.rados.0.smithi084.stdout:1897: left oid 24 (ObjNum 593 snap 188 seq_num 593) 2024-01-13T18:07:07.747 INFO:tasks.rados.rados.0.smithi084.stdout:1898: finishing copy_from to smithi084102331-38 2024-01-13T18:07:07.748 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 652 (ObjNum 578 snap 185 seq_num 578) dirty exists 2024-01-13T18:07:07.749 INFO:tasks.rados.rados.0.smithi084.stdout:1898: finishing copy_from racing read to smithi084102331-38 2024-01-13T18:07:07.762 INFO:tasks.rados.rados.0.smithi084.stdout:1895: finishing copy_from to smithi084102331-16 2024-01-13T18:07:07.763 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 597 (ObjNum 579 snap 185 seq_num 579) dirty exists 2024-01-13T18:07:07.763 INFO:tasks.rados.rados.0.smithi084.stdout:1895: finishing copy_from racing read to smithi084102331-16 2024-01-13T18:07:07.875 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:07 smithi084 ceph-mon[116404]: Upgrade: Updating mds.a 2024-01-13T18:07:07.876 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:07 smithi084 ceph-mon[116404]: Deploying daemon mds.a on smithi084 2024-01-13T18:07:07.876 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:07 smithi084 ceph-mon[116404]: osdmap e445: 8 total, 8 up, 8 in 2024-01-13T18:07:07.876 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:07 smithi084 ceph-mon[119097]: Upgrade: Updating mds.a 2024-01-13T18:07:07.876 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:07 smithi084 ceph-mon[119097]: Deploying daemon mds.a on smithi084 2024-01-13T18:07:07.876 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:07 smithi084 ceph-mon[119097]: osdmap e445: 8 total, 8 up, 8 in 2024-01-13T18:07:07.876 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 18:07:07 smithi084 systemd[1]: Stopping Ceph mds.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:07.881 INFO:tasks.rados.rados.0.smithi084.stdout:1893: done (7 left) 2024-01-13T18:07:07.881 INFO:tasks.rados.rados.0.smithi084.stdout:1894: done (6 left) 2024-01-13T18:07:07.881 INFO:tasks.rados.rados.0.smithi084.stdout:1895: done (5 left) 2024-01-13T18:07:07.881 INFO:tasks.rados.rados.0.smithi084.stdout:1896: done (4 left) 2024-01-13T18:07:07.881 INFO:tasks.rados.rados.0.smithi084.stdout:1897: done (3 left) 2024-01-13T18:07:07.882 INFO:tasks.rados.rados.0.smithi084.stdout:1898: done (2 left) 2024-01-13T18:07:07.882 INFO:tasks.rados.rados.0.smithi084.stdout:1899: done (1 left) 2024-01-13T18:07:07.882 INFO:tasks.rados.rados.0.smithi084.stdout:1900: done (0 left) 2024-01-13T18:07:07.882 INFO:tasks.rados.rados.0.smithi084.stdout:1901: rmattr oid 9 current snap is 189 2024-01-13T18:07:07.882 INFO:tasks.rados.rados.0.smithi084.stdout:1901: done (0 left) 2024-01-13T18:07:07.882 INFO:tasks.rados.rados.0.smithi084.stdout:1902: copy_from oid 8 from oid 42 current snap is 189 2024-01-13T18:07:07.882 INFO:tasks.rados.rados.0.smithi084.stdout:1903: delete oid 3 current snap is 189 2024-01-13T18:07:07.884 INFO:tasks.rados.rados.0.smithi084.stdout:1902: finishing copy_from to smithi084102331-8 2024-01-13T18:07:07.884 INFO:tasks.rados.rados.0.smithi084.stdout:1902: got expected ENOENT (src dne) 2024-01-13T18:07:07.884 INFO:tasks.rados.rados.0.smithi084.stdout:1902: finishing copy_from racing read to smithi084102331-8 2024-01-13T18:07:07.886 INFO:tasks.rados.rados.0.smithi084.stdout:1902: done (1 left) 2024-01-13T18:07:07.886 INFO:tasks.rados.rados.0.smithi084.stdout:1903: done (0 left) 2024-01-13T18:07:07.886 INFO:tasks.rados.rados.0.smithi084.stdout:1904: rollback oid 23 current snap is 189 2024-01-13T18:07:07.886 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 187 2024-01-13T18:07:07.886 INFO:tasks.rados.rados.0.smithi084.stdout:1905: snap_create 2024-01-13T18:07:07.888 INFO:tasks.rados.rados.0.smithi084.stdout:1904: finishing rollback tid 1 to smithi084102331-23 2024-01-13T18:07:07.888 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 0 (ObjNum 305 snap 0 seq_num 3552013632) dirty dne 2024-01-13T18:07:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:07 smithi099 ceph-mon[138788]: Upgrade: Updating mds.a 2024-01-13T18:07:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:07 smithi099 ceph-mon[138788]: Deploying daemon mds.a on smithi084 2024-01-13T18:07:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:07 smithi099 ceph-mon[138788]: osdmap e445: 8 total, 8 up, 8 in 2024-01-13T18:07:08.178 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 18:07:07 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-a[87361]: 2024-01-13T18:07:07.873+0000 7f23d889f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:07:08.178 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 18:07:07 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-a[87361]: 2024-01-13T18:07:07.873+0000 7f23d889f700 -1 mds.a *** got signal Terminated *** 2024-01-13T18:07:08.887 INFO:tasks.rados.rados.0.smithi084.stdout:1904: done (1 left) 2024-01-13T18:07:08.887 INFO:tasks.rados.rados.0.smithi084.stdout:1905: done (0 left) 2024-01-13T18:07:08.887 INFO:tasks.rados.rados.0.smithi084.stdout:1906: read oid 30 snap 187 2024-01-13T18:07:08.887 INFO:tasks.rados.rados.0.smithi084.stdout:1906: expect deleted 2024-01-13T18:07:08.887 INFO:tasks.rados.rados.0.smithi084.stdout:1907: rollback oid 17 current snap is 190 2024-01-13T18:07:08.887 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 188 2024-01-13T18:07:08.887 INFO:tasks.rados.rados.0.smithi084.stdout:1908: read oid 14 snap 188 2024-01-13T18:07:08.888 INFO:tasks.rados.rados.0.smithi084.stdout:1908: expect (ObjNum 569 snap 181 seq_num 569) 2024-01-13T18:07:08.888 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 190 2024-01-13T18:07:08.888 INFO:tasks.rados.rados.0.smithi084.stdout:1909: seq_num 595 ranges {0=368640} 2024-01-13T18:07:08.889 INFO:tasks.rados.rados.0.smithi084.stdout:1909: writing smithi084102331-13 from 0 to 368640 tid 1 2024-01-13T18:07:08.889 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 190 2024-01-13T18:07:08.889 INFO:tasks.rados.rados.0.smithi084.stdout:1910: seq_num 596 ranges {0=385024} 2024-01-13T18:07:08.892 INFO:tasks.rados.rados.0.smithi084.stdout:1910: writing smithi084102331-23 from 0 to 385024 tid 1 2024-01-13T18:07:08.892 INFO:tasks.rados.rados.0.smithi084.stdout:1911: rollback oid 32 current snap is 190 2024-01-13T18:07:08.892 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 32 to 183 2024-01-13T18:07:08.892 INFO:tasks.rados.rados.0.smithi084.stdout:1906: done (5 left) 2024-01-13T18:07:08.892 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 190 2024-01-13T18:07:08.893 INFO:tasks.rados.rados.0.smithi084.stdout:1912: seq_num 597 ranges {0=401408} 2024-01-13T18:07:08.895 INFO:tasks.rados.rados.0.smithi084.stdout:1912: writing smithi084102331-6 from 0 to 401408 tid 1 2024-01-13T18:07:08.895 INFO:tasks.rados.rados.0.smithi084.stdout:1913: read oid 26 snap -1 2024-01-13T18:07:08.895 INFO:tasks.rados.rados.0.smithi084.stdout:1913: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:08.895 INFO:tasks.rados.rados.0.smithi084.stdout:1914: snap_remove snap 180 2024-01-13T18:07:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:08 smithi099 ceph-mon[138788]: osdmap e446: 8 total, 8 up, 8 in 2024-01-13T18:07:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:08 smithi099 ceph-mon[138788]: osdmap e447: 8 total, 8 up, 8 in 2024-01-13T18:07:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:08 smithi099 ceph-mon[138788]: pgmap v382: 121 pgs: 4 peering, 3 active+undersized, 114 active+clean; 227 MiB data, 944 MiB used, 714 GiB / 715 GiB avail; 58 KiB/s rd, 1.5 MiB/s wr, 16 op/s; 8.6 MiB/s, 1 objects/s recovering 2024-01-13T18:07:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:08 smithi084 ceph-mon[116404]: osdmap e446: 8 total, 8 up, 8 in 2024-01-13T18:07:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:08 smithi084 ceph-mon[116404]: osdmap e447: 8 total, 8 up, 8 in 2024-01-13T18:07:09.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:08 smithi084 ceph-mon[116404]: pgmap v382: 121 pgs: 4 peering, 3 active+undersized, 114 active+clean; 227 MiB data, 944 MiB used, 714 GiB / 715 GiB avail; 58 KiB/s rd, 1.5 MiB/s wr, 16 op/s; 8.6 MiB/s, 1 objects/s recovering 2024-01-13T18:07:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:08 smithi084 ceph-mon[119097]: osdmap e446: 8 total, 8 up, 8 in 2024-01-13T18:07:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:08 smithi084 ceph-mon[119097]: osdmap e447: 8 total, 8 up, 8 in 2024-01-13T18:07:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:08 smithi084 ceph-mon[119097]: pgmap v382: 121 pgs: 4 peering, 3 active+undersized, 114 active+clean; 227 MiB data, 944 MiB used, 714 GiB / 715 GiB avail; 58 KiB/s rd, 1.5 MiB/s wr, 16 op/s; 8.6 MiB/s, 1 objects/s recovering 2024-01-13T18:07:09.895 INFO:tasks.rados.rados.0.smithi084.stdout:1914: done (7 left) 2024-01-13T18:07:09.895 INFO:tasks.rados.rados.0.smithi084.stdout:1915: rollback oid 8 current snap is 190 2024-01-13T18:07:09.895 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 189 2024-01-13T18:07:09.895 INFO:tasks.rados.rados.0.smithi084.stdout:1916: read oid 33 snap 187 2024-01-13T18:07:09.895 INFO:tasks.rados.rados.0.smithi084.stdout:1916: expect deleted 2024-01-13T18:07:09.895 INFO:tasks.rados.rados.0.smithi084.stdout:1917: read oid 47 snap 182 2024-01-13T18:07:09.895 INFO:tasks.rados.rados.0.smithi084.stdout:1917: expect deleted 2024-01-13T18:07:09.895 INFO:tasks.rados.rados.0.smithi084.stdout:1918: rmattr oid 27 current snap is 190 2024-01-13T18:07:09.895 INFO:tasks.rados.rados.0.smithi084.stdout:1918: done (10 left) 2024-01-13T18:07:09.895 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 190 2024-01-13T18:07:09.895 INFO:tasks.rados.rados.0.smithi084.stdout:1919: seq_num 598 ranges {3989504=417792} 2024-01-13T18:07:09.919 INFO:tasks.rados.rados.0.smithi084.stdout:1919: writing smithi084102331-37 from 3989504 to 4407296 tid 1 2024-01-13T18:07:09.919 INFO:tasks.rados.rados.0.smithi084.stdout:1920: read oid 4 snap 182 2024-01-13T18:07:09.919 INFO:tasks.rados.rados.0.smithi084.stdout:1920: expect (ObjNum 511 snap 163 seq_num 511) 2024-01-13T18:07:09.919 INFO:tasks.rados.rados.0.smithi084.stdout:1921: delete oid 9 current snap is 190 2024-01-13T18:07:09.919 INFO:tasks.rados.rados.0.smithi084.stdout:1907: finishing rollback tid 1 to smithi084102331-17 2024-01-13T18:07:09.919 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 677 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-01-13T18:07:09.919 INFO:tasks.rados.rados.0.smithi084.stdout:1909: finishing write tid 1 to smithi084102331-13 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:1909: finishing write tid 2 to smithi084102331-13 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:1911: finishing rollback tid 0 to smithi084102331-32 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:1911: finishing rollback tid 1 to smithi084102331-32 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:1911: finishing rollback tid 2 to smithi084102331-32 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 999 (ObjNum 65 snap 0 seq_num 1850896732) dirty exists 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:1910: finishing write tid 1 to smithi084102331-23 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:1912: finishing write tid 1 to smithi084102331-6 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:1910: finishing write tid 2 to smithi084102331-23 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:1909: finishing write tid 3 to smithi084102331-13 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 689 (ObjNum 595 snap 190 seq_num 595) dirty exists 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:1909: left oid 13 (ObjNum 595 snap 190 seq_num 595) 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:1912: finishing write tid 2 to smithi084102331-6 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:1910: finishing write tid 3 to smithi084102331-23 2024-01-13T18:07:09.920 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1025 (ObjNum 596 snap 190 seq_num 596) dirty exists 2024-01-13T18:07:09.921 INFO:tasks.rados.rados.0.smithi084.stdout:1910: left oid 23 (ObjNum 596 snap 190 seq_num 596) 2024-01-13T18:07:09.921 INFO:tasks.rados.rados.0.smithi084.stdout:1912: finishing write tid 3 to smithi084102331-6 2024-01-13T18:07:09.921 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 569 (ObjNum 597 snap 190 seq_num 597) dirty exists 2024-01-13T18:07:09.921 INFO:tasks.rados.rados.0.smithi084.stdout:1912: left oid 6 (ObjNum 597 snap 190 seq_num 597) 2024-01-13T18:07:09.921 INFO:tasks.rados.rados.0.smithi084.stdout:1908: expect (ObjNum 569 snap 181 seq_num 569) 2024-01-13T18:07:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:09 smithi099 ceph-mon[138788]: fsmap cephfs:1 {0=b=up:active} 2024-01-13T18:07:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:09 smithi099 ceph-mon[138788]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/261 objects degraded (8.812%), 8 pgs degraded) 2024-01-13T18:07:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:09 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:07:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:09 smithi099 ceph-mon[138788]: osdmap e448: 8 total, 8 up, 8 in 2024-01-13T18:07:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:09 smithi084 ceph-mon[116404]: fsmap cephfs:1 {0=b=up:active} 2024-01-13T18:07:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:09 smithi084 ceph-mon[116404]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/261 objects degraded (8.812%), 8 pgs degraded) 2024-01-13T18:07:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:09 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:07:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:09 smithi084 ceph-mon[116404]: osdmap e448: 8 total, 8 up, 8 in 2024-01-13T18:07:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:09 smithi084 ceph-mon[119097]: fsmap cephfs:1 {0=b=up:active} 2024-01-13T18:07:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:09 smithi084 ceph-mon[119097]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/261 objects degraded (8.812%), 8 pgs degraded) 2024-01-13T18:07:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:09 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:07:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:09 smithi084 ceph-mon[119097]: osdmap e448: 8 total, 8 up, 8 in 2024-01-13T18:07:10.512 INFO:tasks.rados.rados.0.smithi084.stdout:1913: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:10.566 INFO:tasks.rados.rados.0.smithi084.stdout:1915: finishing rollback tid 0 to smithi084102331-8 2024-01-13T18:07:10.566 INFO:tasks.rados.rados.0.smithi084.stdout:1915: finishing rollback tid 1 to smithi084102331-8 2024-01-13T18:07:10.566 INFO:tasks.rados.rados.0.smithi084.stdout:1915: finishing rollback tid 2 to smithi084102331-8 2024-01-13T18:07:10.566 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1007 (ObjNum 403 snap 128 seq_num 403) dirty exists 2024-01-13T18:07:10.566 INFO:tasks.rados.rados.0.smithi084.stdout:1907: done (12 left) 2024-01-13T18:07:10.566 INFO:tasks.rados.rados.0.smithi084.stdout:1908: done (11 left) 2024-01-13T18:07:10.566 INFO:tasks.rados.rados.0.smithi084.stdout:1909: done (10 left) 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:1910: done (9 left) 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:1911: done (8 left) 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:1912: done (7 left) 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:1913: done (6 left) 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:1915: done (5 left) 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:1916: done (4 left) 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:1917: done (3 left) 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:1921: done (2 left) 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 190 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:1919: finishing write tid 1 to smithi084102331-37 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:1919: finishing write tid 2 to smithi084102331-37 2024-01-13T18:07:10.567 INFO:tasks.rados.rados.0.smithi084.stdout:1922: seq_num 600 ranges {7266304=450560} 2024-01-13T18:07:10.607 INFO:tasks.rados.rados.0.smithi084.stdout:1922: writing smithi084102331-2 from 7266304 to 7716864 tid 1 2024-01-13T18:07:10.607 INFO:tasks.rados.rados.0.smithi084.stdout:1923: read oid 19 snap 185 2024-01-13T18:07:10.607 INFO:tasks.rados.rados.0.smithi084.stdout:1923: expect (ObjNum 575 snap 184 seq_num 575) 2024-01-13T18:07:10.607 INFO:tasks.rados.rados.0.smithi084.stdout:1924: rmattr oid 22 current snap is 190 2024-01-13T18:07:10.607 INFO:tasks.rados.rados.0.smithi084.stdout:1919: finishing write tid 3 to smithi084102331-37 2024-01-13T18:07:10.607 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 926 (ObjNum 598 snap 190 seq_num 598) dirty exists 2024-01-13T18:07:10.607 INFO:tasks.rados.rados.0.smithi084.stdout:1919: left oid 37 (ObjNum 598 snap 190 seq_num 598) 2024-01-13T18:07:10.607 INFO:tasks.rados.rados.0.smithi084.stdout:1920: expect (ObjNum 511 snap 163 seq_num 511) 2024-01-13T18:07:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:07:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:07:10] "GET /metrics HTTP/1.1" 200 36037 "" "Prometheus/2.43.0" 2024-01-13T18:07:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:10 smithi084 ceph-mon[119097]: osdmap e449: 8 total, 8 up, 8 in 2024-01-13T18:07:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:10 smithi084 ceph-mon[119097]: pgmap v385: 121 pgs: 121 active+clean; 227 MiB data, 954 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 356 KiB/s wr, 16 op/s; 8.7 MiB/s, 1 objects/s recovering 2024-01-13T18:07:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:10 smithi084 ceph-mon[116404]: osdmap e449: 8 total, 8 up, 8 in 2024-01-13T18:07:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:10 smithi084 ceph-mon[116404]: pgmap v385: 121 pgs: 121 active+clean; 227 MiB data, 954 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 356 KiB/s wr, 16 op/s; 8.7 MiB/s, 1 objects/s recovering 2024-01-13T18:07:11.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:10 smithi099 ceph-mon[138788]: osdmap e449: 8 total, 8 up, 8 in 2024-01-13T18:07:11.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:10 smithi099 ceph-mon[138788]: pgmap v385: 121 pgs: 121 active+clean; 227 MiB data, 954 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 356 KiB/s wr, 16 op/s; 8.7 MiB/s, 1 objects/s recovering 2024-01-13T18:07:11.508 INFO:tasks.rados.rados.0.smithi084.stdout:1922: finishing write tid 1 to smithi084102331-2 2024-01-13T18:07:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:1922: finishing write tid 2 to smithi084102331-2 2024-01-13T18:07:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:1922: finishing write tid 3 to smithi084102331-2 2024-01-13T18:07:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1027 (ObjNum 600 snap 190 seq_num 600) dirty exists 2024-01-13T18:07:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:1922: left oid 2 (ObjNum 600 snap 190 seq_num 600) 2024-01-13T18:07:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1028 (ObjNum 129 snap 0 seq_num 4037308400) dirty exists 2024-01-13T18:07:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:1923: expect (ObjNum 575 snap 184 seq_num 575) 2024-01-13T18:07:11.786 INFO:tasks.rados.rados.0.smithi084.stdout:1919: done (4 left) 2024-01-13T18:07:11.786 INFO:tasks.rados.rados.0.smithi084.stdout:1920: done (3 left) 2024-01-13T18:07:11.786 INFO:tasks.rados.rados.0.smithi084.stdout:1922: done (2 left) 2024-01-13T18:07:11.786 INFO:tasks.rados.rados.0.smithi084.stdout:1923: done (1 left) 2024-01-13T18:07:11.786 INFO:tasks.rados.rados.0.smithi084.stdout:1924: done (0 left) 2024-01-13T18:07:11.786 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 190 2024-01-13T18:07:11.786 INFO:tasks.rados.rados.0.smithi084.stdout:1925: seq_num 601 ranges {2260992=475136} 2024-01-13T18:07:11.801 INFO:tasks.rados.rados.0.smithi084.stdout:1925: writing smithi084102331-45 from 2260992 to 2736128 tid 1 2024-01-13T18:07:11.801 INFO:tasks.rados.rados.0.smithi084.stdout:1926: rmattr oid 26 current snap is 190 2024-01-13T18:07:11.801 INFO:tasks.rados.rados.0.smithi084.stdout:1926: done (1 left) 2024-01-13T18:07:11.801 INFO:tasks.rados.rados.0.smithi084.stdout:1927: copy_from oid 12 from oid 26 current snap is 190 2024-01-13T18:07:11.801 INFO:tasks.rados.rados.0.smithi084.stdout:1928: setattr oid 13 current snap is 190 2024-01-13T18:07:11.803 INFO:tasks.rados.rados.0.smithi084.stdout:1929: snap_create 2024-01-13T18:07:11.805 INFO:tasks.rados.rados.0.smithi084.stdout:1925: finishing write tid 1 to smithi084102331-45 2024-01-13T18:07:11.805 INFO:tasks.rados.rados.0.smithi084.stdout:1925: finishing write tid 2 to smithi084102331-45 2024-01-13T18:07:11.807 INFO:tasks.rados.rados.0.smithi084.stdout:1925: finishing write tid 3 to smithi084102331-45 2024-01-13T18:07:11.807 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1116 (ObjNum 601 snap 190 seq_num 601) dirty exists 2024-01-13T18:07:11.807 INFO:tasks.rados.rados.0.smithi084.stdout:1925: left oid 45 (ObjNum 601 snap 190 seq_num 601) 2024-01-13T18:07:11.807 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 696 (ObjNum 595 snap 190 seq_num 595) dirty exists 2024-01-13T18:07:11.812 INFO:tasks.rados.rados.0.smithi084.stdout:1927: finishing copy_from to smithi084102331-12 2024-01-13T18:07:11.812 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1070 (ObjNum 564 snap 180 seq_num 564) dirty exists 2024-01-13T18:07:11.813 INFO:tasks.rados.rados.0.smithi084.stdout:1927: finishing copy_from racing read to smithi084102331-12 2024-01-13T18:07:11.897 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 18:07:11 smithi084 bash[149941]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-a 2024-01-13T18:07:11.913 INFO:tasks.rados.rados.0.smithi084.stdout:1925: done (3 left) 2024-01-13T18:07:11.913 INFO:tasks.rados.rados.0.smithi084.stdout:1927: done (2 left) 2024-01-13T18:07:11.913 INFO:tasks.rados.rados.0.smithi084.stdout:1928: done (1 left) 2024-01-13T18:07:11.914 INFO:tasks.rados.rados.0.smithi084.stdout:1929: done (0 left) 2024-01-13T18:07:11.914 INFO:tasks.rados.rados.0.smithi084.stdout:1930: delete oid 24 current snap is 191 2024-01-13T18:07:11.917 INFO:tasks.rados.rados.0.smithi084.stdout:1930: done (0 left) 2024-01-13T18:07:11.917 INFO:tasks.rados.rados.0.smithi084.stdout:1931: rmattr oid 14 current snap is 191 2024-01-13T18:07:11.917 INFO:tasks.rados.rados.0.smithi084.stdout:1931: done (0 left) 2024-01-13T18:07:11.917 INFO:tasks.rados.rados.0.smithi084.stdout:1932: delete oid 15 current snap is 191 2024-01-13T18:07:11.919 INFO:tasks.rados.rados.0.smithi084.stdout:1932: done (0 left) 2024-01-13T18:07:11.919 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 191 2024-01-13T18:07:11.919 INFO:tasks.rados.rados.0.smithi084.stdout:1933: seq_num 604 ranges {0=524288} 2024-01-13T18:07:11.922 INFO:tasks.rados.rados.0.smithi084.stdout:1933: writing smithi084102331-4 from 0 to 524288 tid 1 2024-01-13T18:07:11.922 INFO:tasks.rados.rados.0.smithi084.stdout:1934: snap_create 2024-01-13T18:07:11.925 INFO:tasks.rados.rados.0.smithi084.stdout:1933: finishing write tid 1 to smithi084102331-4 2024-01-13T18:07:11.925 INFO:tasks.rados.rados.0.smithi084.stdout:1933: finishing write tid 2 to smithi084102331-4 2024-01-13T18:07:11.926 INFO:tasks.rados.rados.0.smithi084.stdout:1933: finishing write tid 3 to smithi084102331-4 2024-01-13T18:07:11.926 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 698 (ObjNum 604 snap 191 seq_num 604) dirty exists 2024-01-13T18:07:11.926 INFO:tasks.rados.rados.0.smithi084.stdout:1933: left oid 4 (ObjNum 604 snap 191 seq_num 604) 2024-01-13T18:07:12.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:11 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:07:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:11 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:07:12.179 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 18:07:11 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mds.a.service: Succeeded. 2024-01-13T18:07:12.179 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 18:07:11 smithi084 systemd[1]: Stopped Ceph mds.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:12.179 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 18:07:12 smithi084 systemd[1]: Starting Ceph mds.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:12.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:11 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:07:12.636 INFO:tasks.rados.rados.0.smithi084.stdout:1933: done (1 left) 2024-01-13T18:07:12.636 INFO:tasks.rados.rados.0.smithi084.stdout:1934: done (0 left) 2024-01-13T18:07:12.637 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 192 2024-01-13T18:07:12.637 INFO:tasks.rados.rados.0.smithi084.stdout:1935: seq_num 605 ranges {2736128=540672} 2024-01-13T18:07:12.655 INFO:tasks.rados.rados.0.smithi084.stdout:1935: writing smithi084102331-45 from 2736128 to 3276800 tid 1 2024-01-13T18:07:12.655 INFO:tasks.rados.rados.0.smithi084.stdout:1936: snap_remove snap 182 2024-01-13T18:07:12.678 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-a[150105]: starting mds.a at 2024-01-13T18:07:12.678 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 18:07:12 smithi084 bash[150090]: b6b0859480c38ff9891ca78314c1fd976a10bf13e258aaf7e27c59eed3c0eb9c 2024-01-13T18:07:12.678 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 18:07:12 smithi084 systemd[1]: Started Ceph mds.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:13.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[119097]: osdmap e450: 8 total, 8 up, 8 in 2024-01-13T18:07:13.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[119097]: pgmap v387: 121 pgs: 121 active+clean; 231 MiB data, 939 MiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 3.9 MiB/s wr, 17 op/s 2024-01-13T18:07:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[119097]: osdmap e451: 8 total, 8 up, 8 in 2024-01-13T18:07:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[116404]: osdmap e450: 8 total, 8 up, 8 in 2024-01-13T18:07:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[116404]: pgmap v387: 121 pgs: 121 active+clean; 231 MiB data, 939 MiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 3.9 MiB/s wr, 17 op/s 2024-01-13T18:07:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:12 smithi084 ceph-mon[116404]: osdmap e451: 8 total, 8 up, 8 in 2024-01-13T18:07:13.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:12 smithi099 ceph-mon[138788]: osdmap e450: 8 total, 8 up, 8 in 2024-01-13T18:07:13.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:12 smithi099 ceph-mon[138788]: pgmap v387: 121 pgs: 121 active+clean; 231 MiB data, 939 MiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 3.9 MiB/s wr, 17 op/s 2024-01-13T18:07:13.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:13.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:13.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:13.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:12 smithi099 ceph-mon[138788]: osdmap e451: 8 total, 8 up, 8 in 2024-01-13T18:07:13.645 INFO:tasks.rados.rados.0.smithi084.stdout:1936: done (1 left) 2024-01-13T18:07:13.645 INFO:tasks.rados.rados.0.smithi084.stdout:1937: copy_from oid 25 from oid 40 current snap is 192 2024-01-13T18:07:13.645 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 192 2024-01-13T18:07:13.645 INFO:tasks.rados.rados.0.smithi084.stdout:1938: seq_num 606 ranges {2277376=557056} 2024-01-13T18:07:13.663 INFO:tasks.rados.rados.0.smithi084.stdout:1938: writing smithi084102331-29 from 2277376 to 2834432 tid 1 2024-01-13T18:07:13.663 INFO:tasks.rados.rados.0.smithi084.stdout:1939: snap_remove snap 191 2024-01-13T18:07:14.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:13 smithi084 ceph-mon[119097]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:boot 2024-01-13T18:07:14.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:13 smithi084 ceph-mon[119097]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:07:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:07:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:13 smithi084 ceph-mon[119097]: osdmap e452: 8 total, 8 up, 8 in 2024-01-13T18:07:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:13 smithi084 ceph-mon[116404]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:boot 2024-01-13T18:07:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:13 smithi084 ceph-mon[116404]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:07:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:07:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:13 smithi084 ceph-mon[116404]: osdmap e452: 8 total, 8 up, 8 in 2024-01-13T18:07:14.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:13 smithi099 ceph-mon[138788]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:boot 2024-01-13T18:07:14.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:13 smithi099 ceph-mon[138788]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-01-13T18:07:14.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T18:07:14.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:13 smithi099 ceph-mon[138788]: osdmap e452: 8 total, 8 up, 8 in 2024-01-13T18:07:14.646 INFO:tasks.rados.rados.0.smithi084.stdout:1939: done (3 left) 2024-01-13T18:07:14.646 INFO:tasks.rados.rados.0.smithi084.stdout:1940: delete oid 17 current snap is 192 2024-01-13T18:07:14.646 INFO:tasks.rados.rados.0.smithi084.stdout:1935: finishing write tid 1 to smithi084102331-45 2024-01-13T18:07:14.646 INFO:tasks.rados.rados.0.smithi084.stdout:1935: finishing write tid 2 to smithi084102331-45 2024-01-13T18:07:14.646 INFO:tasks.rados.rados.0.smithi084.stdout:1935: finishing write tid 3 to smithi084102331-45 2024-01-13T18:07:14.647 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1119 (ObjNum 605 snap 192 seq_num 605) dirty exists 2024-01-13T18:07:14.647 INFO:tasks.rados.rados.0.smithi084.stdout:1935: left oid 45 (ObjNum 605 snap 192 seq_num 605) 2024-01-13T18:07:14.647 INFO:tasks.rados.rados.0.smithi084.stdout:1937: finishing copy_from to smithi084102331-25 2024-01-13T18:07:14.647 INFO:tasks.rados.rados.0.smithi084.stdout:1937: got expected ENOENT (src dne) 2024-01-13T18:07:14.647 INFO:tasks.rados.rados.0.smithi084.stdout:1937: finishing copy_from racing read to smithi084102331-25 2024-01-13T18:07:14.647 INFO:tasks.rados.rados.0.smithi084.stdout:1938: finishing write tid 1 to smithi084102331-29 2024-01-13T18:07:14.647 INFO:tasks.rados.rados.0.smithi084.stdout:1938: finishing write tid 2 to smithi084102331-29 2024-01-13T18:07:14.647 INFO:tasks.rados.rados.0.smithi084.stdout:1938: finishing write tid 3 to smithi084102331-29 2024-01-13T18:07:14.647 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 692 (ObjNum 606 snap 192 seq_num 606) dirty exists 2024-01-13T18:07:14.647 INFO:tasks.rados.rados.0.smithi084.stdout:1938: left oid 29 (ObjNum 606 snap 192 seq_num 606) 2024-01-13T18:07:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:1935: done (3 left) 2024-01-13T18:07:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:1937: done (2 left) 2024-01-13T18:07:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:1938: done (1 left) 2024-01-13T18:07:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:1940: done (0 left) 2024-01-13T18:07:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 192 2024-01-13T18:07:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:1941: seq_num 608 ranges {385024=589824} 2024-01-13T18:07:14.657 INFO:tasks.rados.rados.0.smithi084.stdout:1941: writing smithi084102331-23 from 385024 to 974848 tid 1 2024-01-13T18:07:14.658 INFO:tasks.rados.rados.0.smithi084.stdout:1942: snap_create 2024-01-13T18:07:14.665 INFO:tasks.rados.rados.0.smithi084.stdout:1941: finishing write tid 1 to smithi084102331-23 2024-01-13T18:07:14.665 INFO:tasks.rados.rados.0.smithi084.stdout:1941: finishing write tid 2 to smithi084102331-23 2024-01-13T18:07:14.666 INFO:tasks.rados.rados.0.smithi084.stdout:1941: finishing write tid 3 to smithi084102331-23 2024-01-13T18:07:14.666 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1072 (ObjNum 608 snap 192 seq_num 608) dirty exists 2024-01-13T18:07:14.666 INFO:tasks.rados.rados.0.smithi084.stdout:1941: left oid 23 (ObjNum 608 snap 192 seq_num 608) 2024-01-13T18:07:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:14 smithi084 ceph-mon[116404]: pgmap v390: 121 pgs: 121 active+clean; 213 MiB data, 924 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 12 op/s 2024-01-13T18:07:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:14 smithi084 ceph-mon[116404]: osdmap e453: 8 total, 8 up, 8 in 2024-01-13T18:07:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:14 smithi084 ceph-mon[119097]: pgmap v390: 121 pgs: 121 active+clean; 213 MiB data, 924 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 12 op/s 2024-01-13T18:07:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:14 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:14 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:14 smithi084 ceph-mon[119097]: osdmap e453: 8 total, 8 up, 8 in 2024-01-13T18:07:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:14 smithi099 ceph-mon[138788]: pgmap v390: 121 pgs: 121 active+clean; 213 MiB data, 924 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 12 op/s 2024-01-13T18:07:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:14 smithi099 ceph-mon[138788]: osdmap e453: 8 total, 8 up, 8 in 2024-01-13T18:07:15.648 INFO:tasks.rados.rados.0.smithi084.stdout:1941: done (1 left) 2024-01-13T18:07:15.648 INFO:tasks.rados.rados.0.smithi084.stdout:1942: done (0 left) 2024-01-13T18:07:15.648 INFO:tasks.rados.rados.0.smithi084.stdout:1943: read oid 33 snap -1 2024-01-13T18:07:15.648 INFO:tasks.rados.rados.0.smithi084.stdout:1943: expect deleted 2024-01-13T18:07:15.648 INFO:tasks.rados.rados.0.smithi084.stdout:1944: read oid 6 snap -1 2024-01-13T18:07:15.648 INFO:tasks.rados.rados.0.smithi084.stdout:1944: expect (ObjNum 597 snap 190 seq_num 597) 2024-01-13T18:07:15.648 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 193 2024-01-13T18:07:15.648 INFO:tasks.rados.rados.0.smithi084.stdout:1945: seq_num 609 ranges {7716864=606208} 2024-01-13T18:07:15.693 INFO:tasks.rados.rados.0.smithi084.stdout:1945: writing smithi084102331-2 from 7716864 to 8323072 tid 1 2024-01-13T18:07:15.693 INFO:tasks.rados.rados.0.smithi084.stdout:1946: delete oid 8 current snap is 193 2024-01-13T18:07:15.693 INFO:tasks.rados.rados.0.smithi084.stdout:1944: expect (ObjNum 597 snap 190 seq_num 597) 2024-01-13T18:07:15.706 INFO:tasks.rados.rados.0.smithi084.stdout:1945: finishing write tid 1 to smithi084102331-2 2024-01-13T18:07:15.706 INFO:tasks.rados.rados.0.smithi084.stdout:1945: finishing write tid 2 to smithi084102331-2 2024-01-13T18:07:15.706 INFO:tasks.rados.rados.0.smithi084.stdout:1945: finishing write tid 3 to smithi084102331-2 2024-01-13T18:07:15.706 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1074 (ObjNum 609 snap 193 seq_num 609) dirty exists 2024-01-13T18:07:15.706 INFO:tasks.rados.rados.0.smithi084.stdout:1945: left oid 2 (ObjNum 609 snap 193 seq_num 609) 2024-01-13T18:07:15.706 INFO:tasks.rados.rados.0.smithi084.stdout:1943: done (3 left) 2024-01-13T18:07:15.706 INFO:tasks.rados.rados.0.smithi084.stdout:1944: done (2 left) 2024-01-13T18:07:15.706 INFO:tasks.rados.rados.0.smithi084.stdout:1945: done (1 left) 2024-01-13T18:07:15.706 INFO:tasks.rados.rados.0.smithi084.stdout:1946: done (0 left) 2024-01-13T18:07:15.706 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 193 2024-01-13T18:07:15.707 INFO:tasks.rados.rados.0.smithi084.stdout:1947: seq_num 611 ranges {0=638976} 2024-01-13T18:07:15.709 INFO:tasks.rados.rados.0.smithi084.stdout:1947: writing smithi084102331-42 from 0 to 638976 tid 1 2024-01-13T18:07:15.709 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 193 2024-01-13T18:07:15.709 INFO:tasks.rados.rados.0.smithi084.stdout:1948: seq_num 612 ranges {270336=655360} 2024-01-13T18:07:15.715 INFO:tasks.rados.rados.0.smithi084.stdout:1948: writing smithi084102331-39 from 270336 to 925696 tid 1 2024-01-13T18:07:15.715 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 193 2024-01-13T18:07:15.715 INFO:tasks.rados.rados.0.smithi084.stdout:1947: finishing write tid 1 to smithi084102331-42 2024-01-13T18:07:15.715 INFO:tasks.rados.rados.0.smithi084.stdout:1947: finishing write tid 2 to smithi084102331-42 2024-01-13T18:07:15.715 INFO:tasks.rados.rados.0.smithi084.stdout:1949: seq_num 613 ranges {974848=671744} 2024-01-13T18:07:15.724 INFO:tasks.rados.rados.0.smithi084.stdout:1949: writing smithi084102331-23 from 974848 to 1646592 tid 1 2024-01-13T18:07:15.724 INFO:tasks.rados.rados.0.smithi084.stdout:1950: delete oid 13 current snap is 193 2024-01-13T18:07:15.724 INFO:tasks.rados.rados.0.smithi084.stdout:1947: finishing write tid 3 to smithi084102331-42 2024-01-13T18:07:15.724 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 884 (ObjNum 611 snap 193 seq_num 611) dirty exists 2024-01-13T18:07:15.724 INFO:tasks.rados.rados.0.smithi084.stdout:1947: left oid 42 (ObjNum 611 snap 193 seq_num 611) 2024-01-13T18:07:15.724 INFO:tasks.rados.rados.0.smithi084.stdout:1948: finishing write tid 1 to smithi084102331-39 2024-01-13T18:07:15.725 INFO:tasks.rados.rados.0.smithi084.stdout:1948: finishing write tid 2 to smithi084102331-39 2024-01-13T18:07:15.725 INFO:tasks.rados.rados.0.smithi084.stdout:1948: finishing write tid 3 to smithi084102331-39 2024-01-13T18:07:15.725 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 669 (ObjNum 612 snap 193 seq_num 612) dirty exists 2024-01-13T18:07:15.725 INFO:tasks.rados.rados.0.smithi084.stdout:1948: left oid 39 (ObjNum 612 snap 193 seq_num 612) 2024-01-13T18:07:15.727 INFO:tasks.rados.rados.0.smithi084.stdout:1947: done (3 left) 2024-01-13T18:07:15.727 INFO:tasks.rados.rados.0.smithi084.stdout:1948: done (2 left) 2024-01-13T18:07:15.727 INFO:tasks.rados.rados.0.smithi084.stdout:1950: done (1 left) 2024-01-13T18:07:15.727 INFO:tasks.rados.rados.0.smithi084.stdout:1951: rmattr oid 7 current snap is 193 2024-01-13T18:07:15.727 INFO:tasks.rados.rados.0.smithi084.stdout:1951: done (1 left) 2024-01-13T18:07:15.727 INFO:tasks.rados.rados.0.smithi084.stdout:1952: read oid 29 snap -1 2024-01-13T18:07:15.727 INFO:tasks.rados.rados.0.smithi084.stdout:1952: expect (ObjNum 606 snap 192 seq_num 606) 2024-01-13T18:07:15.727 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 193 2024-01-13T18:07:15.727 INFO:tasks.rados.rados.0.smithi084.stdout:1953: seq_num 615 ranges {5242880=704512} 2024-01-13T18:07:15.759 INFO:tasks.rados.rados.0.smithi084.stdout:1953: writing smithi084102331-7 from 5242880 to 5947392 tid 1 2024-01-13T18:07:15.760 INFO:tasks.rados.rados.0.smithi084.stdout:1954: read oid 13 snap -1 2024-01-13T18:07:15.760 INFO:tasks.rados.rados.0.smithi084.stdout:1954: expect deleted 2024-01-13T18:07:15.760 INFO:tasks.rados.rados.0.smithi084.stdout:1955: read oid 26 snap 192 2024-01-13T18:07:15.760 INFO:tasks.rados.rados.0.smithi084.stdout:1955: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:15.760 INFO:tasks.rados.rados.0.smithi084.stdout:1956: delete oid 43 current snap is 193 2024-01-13T18:07:15.760 INFO:tasks.rados.rados.0.smithi084.stdout:1949: finishing write tid 1 to smithi084102331-23 2024-01-13T18:07:15.760 INFO:tasks.rados.rados.0.smithi084.stdout:1949: finishing write tid 2 to smithi084102331-23 2024-01-13T18:07:15.760 INFO:tasks.rados.rados.0.smithi084.stdout:1949: finishing write tid 3 to smithi084102331-23 2024-01-13T18:07:15.760 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1076 (ObjNum 613 snap 193 seq_num 613) dirty exists 2024-01-13T18:07:15.760 INFO:tasks.rados.rados.0.smithi084.stdout:1949: left oid 23 (ObjNum 613 snap 193 seq_num 613) 2024-01-13T18:07:15.760 INFO:tasks.rados.rados.0.smithi084.stdout:1952: expect (ObjNum 606 snap 192 seq_num 606) 2024-01-13T18:07:15.875 INFO:tasks.rados.rados.0.smithi084.stdout:1955: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:15.932 INFO:tasks.rados.rados.0.smithi084.stdout:1953: finishing write tid 1 to smithi084102331-7 2024-01-13T18:07:15.932 INFO:tasks.rados.rados.0.smithi084.stdout:1953: finishing write tid 2 to smithi084102331-7 2024-01-13T18:07:15.932 INFO:tasks.rados.rados.0.smithi084.stdout:1953: finishing write tid 3 to smithi084102331-7 2024-01-13T18:07:15.932 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 604 (ObjNum 615 snap 193 seq_num 615) dirty exists 2024-01-13T18:07:15.932 INFO:tasks.rados.rados.0.smithi084.stdout:1953: left oid 7 (ObjNum 615 snap 193 seq_num 615) 2024-01-13T18:07:15.932 INFO:tasks.rados.rados.0.smithi084.stdout:1949: done (5 left) 2024-01-13T18:07:15.932 INFO:tasks.rados.rados.0.smithi084.stdout:1952: done (4 left) 2024-01-13T18:07:15.932 INFO:tasks.rados.rados.0.smithi084.stdout:1953: done (3 left) 2024-01-13T18:07:15.933 INFO:tasks.rados.rados.0.smithi084.stdout:1954: done (2 left) 2024-01-13T18:07:15.933 INFO:tasks.rados.rados.0.smithi084.stdout:1955: done (1 left) 2024-01-13T18:07:15.933 INFO:tasks.rados.rados.0.smithi084.stdout:1956: done (0 left) 2024-01-13T18:07:15.933 INFO:tasks.rados.rados.0.smithi084.stdout:1957: rollback oid 48 current snap is 193 2024-01-13T18:07:15.933 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 48 to 192 2024-01-13T18:07:15.933 INFO:tasks.rados.rados.0.smithi084.stdout:1958: snap_create 2024-01-13T18:07:15.936 INFO:tasks.rados.rados.0.smithi084.stdout:1957: finishing rollback tid 0 to smithi084102331-48 2024-01-13T18:07:15.936 INFO:tasks.rados.rados.0.smithi084.stdout:1957: finishing rollback tid 1 to smithi084102331-48 2024-01-13T18:07:15.936 INFO:tasks.rados.rados.0.smithi084.stdout:1957: finishing rollback tid 2 to smithi084102331-48 2024-01-13T18:07:15.936 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1079 (ObjNum 535 snap 173 seq_num 535) dirty exists 2024-01-13T18:07:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:16 smithi084 ceph-mon[116404]: osdmap e454: 8 total, 8 up, 8 in 2024-01-13T18:07:16.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:16.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:16.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:16.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:16 smithi084 ceph-mon[119097]: osdmap e454: 8 total, 8 up, 8 in 2024-01-13T18:07:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:16 smithi099 ceph-mon[138788]: osdmap e454: 8 total, 8 up, 8 in 2024-01-13T18:07:16.651 INFO:tasks.rados.rados.0.smithi084.stdout:1957: done (1 left) 2024-01-13T18:07:16.651 INFO:tasks.rados.rados.0.smithi084.stdout:1958: done (0 left) 2024-01-13T18:07:16.651 INFO:tasks.rados.rados.0.smithi084.stdout:1959: snap_create 2024-01-13T18:07:17.322 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:17 smithi084 ceph-mon[116404]: pgmap v393: 121 pgs: 121 active+clean; 213 MiB data, 933 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 102 KiB/s wr, 2 op/s 2024-01-13T18:07:17.322 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:17 smithi084 ceph-mon[116404]: osdmap e455: 8 total, 8 up, 8 in 2024-01-13T18:07:17.322 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:17 smithi084 ceph-mon[119097]: pgmap v393: 121 pgs: 121 active+clean; 213 MiB data, 933 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 102 KiB/s wr, 2 op/s 2024-01-13T18:07:17.322 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:17 smithi084 ceph-mon[119097]: osdmap e455: 8 total, 8 up, 8 in 2024-01-13T18:07:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:17 smithi099 ceph-mon[138788]: pgmap v393: 121 pgs: 121 active+clean; 213 MiB data, 933 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 102 KiB/s wr, 2 op/s 2024-01-13T18:07:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:17 smithi099 ceph-mon[138788]: osdmap e455: 8 total, 8 up, 8 in 2024-01-13T18:07:17.637 INFO:tasks.rados.rados.0.smithi084.stdout:1959: done (0 left) 2024-01-13T18:07:17.637 INFO:tasks.rados.rados.0.smithi084.stdout:1960: read oid 37 snap -1 2024-01-13T18:07:17.637 INFO:tasks.rados.rados.0.smithi084.stdout:1960: expect (ObjNum 598 snap 190 seq_num 598) 2024-01-13T18:07:17.637 INFO:tasks.rados.rados.0.smithi084.stdout:1961: snap_remove snap 192 2024-01-13T18:07:18.464 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: Detected new or changed devices on smithi084 2024-01-13T18:07:18.464 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:18.464 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:18.464 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:18.464 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:18.464 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:18.465 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:18.465 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.465 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.465 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.465 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.465 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["b"]}]: dispatch 2024-01-13T18:07:18.465 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: Upgrade: It appears safe to stop mds.b 2024-01-13T18:07:18.465 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: osdmap e456: 8 total, 8 up, 8 in 2024-01-13T18:07:18.465 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:18 smithi099 ceph-mon[138788]: pgmap v396: 121 pgs: 121 active+clean; 221 MiB data, 939 MiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-01-13T18:07:18.650 INFO:tasks.rados.rados.0.smithi084.stdout:1961: done (1 left) 2024-01-13T18:07:18.650 INFO:tasks.rados.rados.0.smithi084.stdout:1962: read oid 28 snap 187 2024-01-13T18:07:18.650 INFO:tasks.rados.rados.0.smithi084.stdout:1962: expect (ObjNum 252 snap 75 seq_num 252) 2024-01-13T18:07:18.650 INFO:tasks.rados.rados.0.smithi084.stdout:1963: snap_create 2024-01-13T18:07:18.650 INFO:tasks.rados.rados.0.smithi084.stdout:1960: expect (ObjNum 598 snap 190 seq_num 598) 2024-01-13T18:07:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: Detected new or changed devices on smithi084 2024-01-13T18:07:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["b"]}]: dispatch 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: Upgrade: It appears safe to stop mds.b 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: osdmap e456: 8 total, 8 up, 8 in 2024-01-13T18:07:18.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[116404]: pgmap v396: 121 pgs: 121 active+clean; 221 MiB data, 939 MiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: Detected new or changed devices on smithi084 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:18.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["b"]}]: dispatch 2024-01-13T18:07:18.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: Upgrade: It appears safe to stop mds.b 2024-01-13T18:07:18.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: osdmap e456: 8 total, 8 up, 8 in 2024-01-13T18:07:18.681 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:18 smithi084 ceph-mon[119097]: pgmap v396: 121 pgs: 121 active+clean; 221 MiB data, 939 MiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2024-01-13T18:07:18.896 INFO:tasks.rados.rados.0.smithi084.stdout:1962: expect (ObjNum 252 snap 75 seq_num 252) 2024-01-13T18:07:19.656 INFO:tasks.rados.rados.0.smithi084.stdout:1960: done (2 left) 2024-01-13T18:07:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:1962: done (1 left) 2024-01-13T18:07:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:1963: done (0 left) 2024-01-13T18:07:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:1964: rollback oid 2 current snap is 196 2024-01-13T18:07:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 185 2024-01-13T18:07:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:1965: rollback oid 12 current snap is 196 2024-01-13T18:07:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 194 2024-01-13T18:07:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:1966: rmattr oid 9 current snap is 196 2024-01-13T18:07:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:1966: done (2 left) 2024-01-13T18:07:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 196 2024-01-13T18:07:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:1967: seq_num 617 ranges {2007040=737280} 2024-01-13T18:07:19.671 INFO:tasks.rados.rados.0.smithi084.stdout:1967: writing smithi084102331-34 from 2007040 to 2744320 tid 1 2024-01-13T18:07:19.671 INFO:tasks.rados.rados.0.smithi084.stdout:1968: read oid 13 snap -1 2024-01-13T18:07:19.671 INFO:tasks.rados.rados.0.smithi084.stdout:1968: expect deleted 2024-01-13T18:07:19.672 INFO:tasks.rados.rados.0.smithi084.stdout:1969: delete oid 3 current snap is 196 2024-01-13T18:07:19.672 INFO:tasks.rados.rados.0.smithi084.stdout:1964: finishing rollback tid 0 to smithi084102331-2 2024-01-13T18:07:19.672 INFO:tasks.rados.rados.0.smithi084.stdout:1964: finishing rollback tid 1 to smithi084102331-2 2024-01-13T18:07:19.672 INFO:tasks.rados.rados.0.smithi084.stdout:1964: finishing rollback tid 2 to smithi084102331-2 2024-01-13T18:07:19.672 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1082 (ObjNum 403 snap 128 seq_num 403) dirty exists 2024-01-13T18:07:19.672 INFO:tasks.rados.rados.0.smithi084.stdout:1965: finishing rollback tid 0 to smithi084102331-12 2024-01-13T18:07:19.672 INFO:tasks.rados.rados.0.smithi084.stdout:1965: finishing rollback tid 1 to smithi084102331-12 2024-01-13T18:07:19.672 INFO:tasks.rados.rados.0.smithi084.stdout:1965: finishing rollback tid 2 to smithi084102331-12 2024-01-13T18:07:19.672 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1085 (ObjNum 564 snap 180 seq_num 564) dirty exists 2024-01-13T18:07:19.676 INFO:tasks.rados.rados.0.smithi084.stdout:1964: done (4 left) 2024-01-13T18:07:19.676 INFO:tasks.rados.rados.0.smithi084.stdout:1965: done (3 left) 2024-01-13T18:07:19.676 INFO:tasks.rados.rados.0.smithi084.stdout:1968: done (2 left) 2024-01-13T18:07:19.676 INFO:tasks.rados.rados.0.smithi084.stdout:1969: done (1 left) 2024-01-13T18:07:19.676 INFO:tasks.rados.rados.0.smithi084.stdout:1970: setattr oid 27 current snap is 196 2024-01-13T18:07:19.677 INFO:tasks.rados.rados.0.smithi084.stdout:1967: finishing write tid 1 to smithi084102331-34 2024-01-13T18:07:19.677 INFO:tasks.rados.rados.0.smithi084.stdout:1967: finishing write tid 2 to smithi084102331-34 2024-01-13T18:07:19.678 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 196 2024-01-13T18:07:19.678 INFO:tasks.rados.rados.0.smithi084.stdout:1971: seq_num 619 ranges {3629056=770048} 2024-01-13T18:07:19.702 INFO:tasks.rados.rados.0.smithi084.stdout:1971: writing smithi084102331-1 from 3629056 to 4399104 tid 1 2024-01-13T18:07:19.702 INFO:tasks.rados.rados.0.smithi084.stdout:1972: snap_create 2024-01-13T18:07:19.702 INFO:tasks.rados.rados.0.smithi084.stdout:1967: finishing write tid 3 to smithi084102331-34 2024-01-13T18:07:19.702 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 577 (ObjNum 617 snap 196 seq_num 617) dirty exists 2024-01-13T18:07:19.702 INFO:tasks.rados.rados.0.smithi084.stdout:1967: left oid 34 (ObjNum 617 snap 196 seq_num 617) 2024-01-13T18:07:19.702 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 598 (ObjNum 465 snap 0 seq_num 4036901392) dirty exists 2024-01-13T18:07:19.705 INFO:tasks.rados.rados.0.smithi084.stdout:1971: finishing write tid 1 to smithi084102331-1 2024-01-13T18:07:19.705 INFO:tasks.rados.rados.0.smithi084.stdout:1971: finishing write tid 2 to smithi084102331-1 2024-01-13T18:07:19.706 INFO:tasks.rados.rados.0.smithi084.stdout:1971: finishing write tid 3 to smithi084102331-1 2024-01-13T18:07:19.707 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1133 (ObjNum 619 snap 196 seq_num 619) dirty exists 2024-01-13T18:07:19.707 INFO:tasks.rados.rados.0.smithi084.stdout:1971: left oid 1 (ObjNum 619 snap 196 seq_num 619) 2024-01-13T18:07:19.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:19 smithi099 ceph-mon[138788]: osdmap e457: 8 total, 8 up, 8 in 2024-01-13T18:07:19.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:19 smithi099 ceph-mon[138788]: Upgrade: Updating mds.b 2024-01-13T18:07:19.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:19.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:07:19.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:19.830 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:19 smithi099 ceph-mon[138788]: Deploying daemon mds.b on smithi099 2024-01-13T18:07:19.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[116404]: osdmap e457: 8 total, 8 up, 8 in 2024-01-13T18:07:19.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[116404]: Upgrade: Updating mds.b 2024-01-13T18:07:19.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:19.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:07:19.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:19.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[116404]: Deploying daemon mds.b on smithi099 2024-01-13T18:07:19.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[119097]: osdmap e457: 8 total, 8 up, 8 in 2024-01-13T18:07:19.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[119097]: Upgrade: Updating mds.b 2024-01-13T18:07:19.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:19.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-13T18:07:19.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:19.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:19 smithi084 ceph-mon[119097]: Deploying daemon mds.b on smithi099 2024-01-13T18:07:20.119 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 18:07:19 smithi099 systemd[1]: Stopping Ceph mds.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:20.133 INFO:tasks.rados.rados.0.smithi084.stdout:1967: done (3 left) 2024-01-13T18:07:20.133 INFO:tasks.rados.rados.0.smithi084.stdout:1970: done (2 left) 2024-01-13T18:07:20.133 INFO:tasks.rados.rados.0.smithi084.stdout:1971: done (1 left) 2024-01-13T18:07:20.133 INFO:tasks.rados.rados.0.smithi084.stdout:1972: done (0 left) 2024-01-13T18:07:20.133 INFO:tasks.rados.rados.0.smithi084.stdout:1973: read oid 17 snap -1 2024-01-13T18:07:20.133 INFO:tasks.rados.rados.0.smithi084.stdout:1973: expect deleted 2024-01-13T18:07:20.134 INFO:tasks.rados.rados.0.smithi084.stdout:1974: snap_remove snap 196 2024-01-13T18:07:20.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-a[116381]: 2024-01-13T18:07:20.125+0000 7fa6b45a7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-13T18:07:20.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:07:20] "GET /metrics HTTP/1.1" 200 36186 "" "Prometheus/2.43.0" 2024-01-13T18:07:20.619 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-b[104423]: 2024-01-13T18:07:20.124+0000 7f97c9e83700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T18:07:20.619 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-b[104423]: 2024-01-13T18:07:20.124+0000 7f97c9e83700 -1 mds.b *** got signal Terminated *** 2024-01-13T18:07:20.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[116404]: osdmap e458: 8 total, 8 up, 8 in 2024-01-13T18:07:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[116404]: pgmap v399: 121 pgs: 121 active+clean; 221 MiB data, 940 MiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.0 MiB/s wr, 18 op/s 2024-01-13T18:07:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[116404]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-13T18:07:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[116404]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-13T18:07:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[116404]: osdmap e459: 8 total, 8 up, 8 in 2024-01-13T18:07:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[116404]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-01-13T18:07:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[116404]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-13T18:07:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[116404]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-01-13T18:07:20.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[116404]: fsmap cephfs:1/1 {0=a=up:replay} 2024-01-13T18:07:20.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[119097]: osdmap e458: 8 total, 8 up, 8 in 2024-01-13T18:07:20.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[119097]: pgmap v399: 121 pgs: 121 active+clean; 221 MiB data, 940 MiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.0 MiB/s wr, 18 op/s 2024-01-13T18:07:20.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:20.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:20.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[119097]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-13T18:07:20.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[119097]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-13T18:07:20.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[119097]: osdmap e459: 8 total, 8 up, 8 in 2024-01-13T18:07:20.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[119097]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-01-13T18:07:20.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[119097]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-13T18:07:20.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[119097]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-01-13T18:07:20.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:20 smithi084 ceph-mon[119097]: fsmap cephfs:1/1 {0=a=up:replay} 2024-01-13T18:07:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-mon[138788]: osdmap e458: 8 total, 8 up, 8 in 2024-01-13T18:07:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-mon[138788]: pgmap v399: 121 pgs: 121 active+clean; 221 MiB data, 940 MiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.0 MiB/s wr, 18 op/s 2024-01-13T18:07:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-mon[138788]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-13T18:07:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-mon[138788]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-13T18:07:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-mon[138788]: osdmap e459: 8 total, 8 up, 8 in 2024-01-13T18:07:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-mon[138788]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-01-13T18:07:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-mon[138788]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-13T18:07:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-mon[138788]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-01-13T18:07:21.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:20 smithi099 ceph-mon[138788]: fsmap cephfs:1/1 {0=a=up:replay} 2024-01-13T18:07:21.141 INFO:tasks.rados.rados.0.smithi084.stdout:1974: done (1 left) 2024-01-13T18:07:21.141 INFO:tasks.rados.rados.0.smithi084.stdout:1975: snap_remove snap 193 2024-01-13T18:07:21.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:07:21.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:21 smithi084 ceph-mon[116404]: osdmap e460: 8 total, 8 up, 8 in 2024-01-13T18:07:21.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:21 smithi084 ceph-mon[116404]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:reconnect 2024-01-13T18:07:21.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:21 smithi084 ceph-mon[116404]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-01-13T18:07:21.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:07:21.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:21 smithi084 ceph-mon[119097]: osdmap e460: 8 total, 8 up, 8 in 2024-01-13T18:07:21.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:21 smithi084 ceph-mon[119097]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:reconnect 2024-01-13T18:07:21.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:21 smithi084 ceph-mon[119097]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-01-13T18:07:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:07:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:21 smithi099 ceph-mon[138788]: osdmap e460: 8 total, 8 up, 8 in 2024-01-13T18:07:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:21 smithi099 ceph-mon[138788]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:reconnect 2024-01-13T18:07:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:21 smithi099 ceph-mon[138788]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-01-13T18:07:22.145 INFO:tasks.rados.rados.0.smithi084.stdout:1975: done (1 left) 2024-01-13T18:07:22.145 INFO:tasks.rados.rados.0.smithi084.stdout:1976: rmattr oid 32 current snap is 197 2024-01-13T18:07:22.145 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 197 2024-01-13T18:07:22.145 INFO:tasks.rados.rados.0.smithi084.stdout:1977: seq_num 620 ranges {0=794624} 2024-01-13T18:07:22.149 INFO:tasks.rados.rados.0.smithi084.stdout:1977: writing smithi084102331-20 from 0 to 794624 tid 1 2024-01-13T18:07:22.149 INFO:tasks.rados.rados.0.smithi084.stdout:1978: read oid 25 snap -1 2024-01-13T18:07:22.149 INFO:tasks.rados.rados.0.smithi084.stdout:1978: expect (ObjNum 497 snap 160 seq_num 497) 2024-01-13T18:07:22.149 INFO:tasks.rados.rados.0.smithi084.stdout:1979: snap_remove snap 190 2024-01-13T18:07:22.647 INFO:tasks.rados.rados.0.smithi084.stdout:1979: done (4 left) 2024-01-13T18:07:22.647 INFO:tasks.rados.rados.0.smithi084.stdout:1980: copy_from oid 41 from oid 11 current snap is 197 2024-01-13T18:07:22.647 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 197 2024-01-13T18:07:22.647 INFO:tasks.rados.rados.0.smithi084.stdout:1981: seq_num 621 ranges {4407296=409600,4816896=401408} 2024-01-13T18:07:22.671 INFO:tasks.rados.rados.0.smithi084.stdout:1981: writing smithi084102331-37 from 4407296 to 4816896 tid 1 2024-01-13T18:07:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:1981: writing smithi084102331-37 from 4816896 to 5218304 tid 2 2024-01-13T18:07:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:1982: delete oid 23 current snap is 197 2024-01-13T18:07:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1028 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:07:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:1977: finishing write tid 1 to smithi084102331-20 2024-01-13T18:07:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:1977: finishing write tid 2 to smithi084102331-20 2024-01-13T18:07:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:1977: finishing write tid 3 to smithi084102331-20 2024-01-13T18:07:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 629 (ObjNum 620 snap 197 seq_num 620) dirty exists 2024-01-13T18:07:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:1977: left oid 20 (ObjNum 620 snap 197 seq_num 620) 2024-01-13T18:07:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:1978: expect (ObjNum 497 snap 160 seq_num 497) 2024-01-13T18:07:22.829 INFO:tasks.rados.rados.0.smithi084.stdout:1980: finishing copy_from to smithi084102331-41 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 652 (ObjNum 578 snap 185 seq_num 578) dirty exists 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:1980: finishing copy_from racing read to smithi084102331-41 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:1981: finishing write tid 1 to smithi084102331-37 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:1981: finishing write tid 2 to smithi084102331-37 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:1981: finishing write tid 3 to smithi084102331-37 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:1981: finishing write tid 4 to smithi084102331-37 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 934 (ObjNum 621 snap 197 seq_num 621) dirty exists 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:1981: left oid 37 (ObjNum 621 snap 197 seq_num 621) 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:1973: done (6 left) 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:1976: done (5 left) 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:1977: done (4 left) 2024-01-13T18:07:22.830 INFO:tasks.rados.rados.0.smithi084.stdout:1978: done (3 left) 2024-01-13T18:07:22.831 INFO:tasks.rados.rados.0.smithi084.stdout:1980: done (2 left) 2024-01-13T18:07:22.831 INFO:tasks.rados.rados.0.smithi084.stdout:1981: done (1 left) 2024-01-13T18:07:22.831 INFO:tasks.rados.rados.0.smithi084.stdout:1982: done (0 left) 2024-01-13T18:07:22.831 INFO:tasks.rados.rados.0.smithi084.stdout:1983: snap_remove snap 188 2024-01-13T18:07:23.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[116404]: pgmap v402: 121 pgs: 121 active+clean; 223 MiB data, 943 MiB used, 714 GiB / 715 GiB avail; 6.1 MiB/s rd, 368 KiB/s wr, 10 op/s 2024-01-13T18:07:23.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[116404]: osdmap e461: 8 total, 8 up, 8 in 2024-01-13T18:07:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[116404]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:rejoin 2024-01-13T18:07:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[116404]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-01-13T18:07:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[116404]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-01-13T18:07:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[116404]: osdmap e462: 8 total, 8 up, 8 in 2024-01-13T18:07:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[119097]: pgmap v402: 121 pgs: 121 active+clean; 223 MiB data, 943 MiB used, 714 GiB / 715 GiB avail; 6.1 MiB/s rd, 368 KiB/s wr, 10 op/s 2024-01-13T18:07:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[119097]: osdmap e461: 8 total, 8 up, 8 in 2024-01-13T18:07:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[119097]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:rejoin 2024-01-13T18:07:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[119097]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-01-13T18:07:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[119097]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-01-13T18:07:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:23 smithi084 ceph-mon[119097]: osdmap e462: 8 total, 8 up, 8 in 2024-01-13T18:07:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:23 smithi099 ceph-mon[138788]: pgmap v402: 121 pgs: 121 active+clean; 223 MiB data, 943 MiB used, 714 GiB / 715 GiB avail; 6.1 MiB/s rd, 368 KiB/s wr, 10 op/s 2024-01-13T18:07:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:23 smithi099 ceph-mon[138788]: osdmap e461: 8 total, 8 up, 8 in 2024-01-13T18:07:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:23 smithi099 ceph-mon[138788]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:rejoin 2024-01-13T18:07:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:23 smithi099 ceph-mon[138788]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-01-13T18:07:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:23 smithi099 ceph-mon[138788]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-01-13T18:07:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:23 smithi099 ceph-mon[138788]: osdmap e462: 8 total, 8 up, 8 in 2024-01-13T18:07:23.666 INFO:tasks.rados.rados.0.smithi084.stdout:1983: done (0 left) 2024-01-13T18:07:23.666 INFO:tasks.rados.rados.0.smithi084.stdout:1984: read oid 25 snap -1 2024-01-13T18:07:23.666 INFO:tasks.rados.rados.0.smithi084.stdout:1984: expect (ObjNum 497 snap 160 seq_num 497) 2024-01-13T18:07:23.666 INFO:tasks.rados.rados.0.smithi084.stdout:1985: rmattr oid 5 current snap is 197 2024-01-13T18:07:23.666 INFO:tasks.rados.rados.0.smithi084.stdout:1985: done (1 left) 2024-01-13T18:07:23.666 INFO:tasks.rados.rados.0.smithi084.stdout:1986: delete oid 15 current snap is 197 2024-01-13T18:07:23.674 INFO:tasks.rados.rados.0.smithi084.stdout:1986: done (1 left) 2024-01-13T18:07:23.675 INFO:tasks.rados.rados.0.smithi084.stdout:1987: snap_remove snap 189 2024-01-13T18:07:24.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:24 smithi084 ceph-mon[116404]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-13T18:07:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:24 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:07:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:24 smithi084 ceph-mon[116404]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:active 2024-01-13T18:07:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:24 smithi084 ceph-mon[116404]: fsmap cephfs:1 {0=a=up:active} 2024-01-13T18:07:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:24 smithi084 ceph-mon[116404]: osdmap e463: 8 total, 8 up, 8 in 2024-01-13T18:07:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:24 smithi084 ceph-mon[119097]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-13T18:07:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:24 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:07:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:24 smithi084 ceph-mon[119097]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:active 2024-01-13T18:07:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:24 smithi084 ceph-mon[119097]: fsmap cephfs:1 {0=a=up:active} 2024-01-13T18:07:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:24 smithi084 ceph-mon[119097]: osdmap e463: 8 total, 8 up, 8 in 2024-01-13T18:07:24.442 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:24 smithi099 ceph-mon[138788]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-13T18:07:24.443 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:24 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:07:24.443 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:24 smithi099 ceph-mon[138788]: mds.? [v2:172.21.15.84:6834/1789617897,v1:172.21.15.84:6835/1789617897] up:active 2024-01-13T18:07:24.443 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:24 smithi099 ceph-mon[138788]: fsmap cephfs:1 {0=a=up:active} 2024-01-13T18:07:24.443 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:24 smithi099 ceph-mon[138788]: osdmap e463: 8 total, 8 up, 8 in 2024-01-13T18:07:24.443 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 18:07:24 smithi099 bash[169652]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-b 2024-01-13T18:07:24.675 INFO:tasks.rados.rados.0.smithi084.stdout:1987: done (1 left) 2024-01-13T18:07:24.675 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 197 2024-01-13T18:07:24.675 INFO:tasks.rados.rados.0.smithi084.stdout:1988: seq_num 624 ranges {3276800=458752,3735552=401408} 2024-01-13T18:07:24.695 INFO:tasks.rados.rados.0.smithi084.stdout:1988: writing smithi084102331-45 from 3276800 to 3735552 tid 1 2024-01-13T18:07:24.698 INFO:tasks.rados.rados.0.smithi084.stdout:1988: writing smithi084102331-45 from 3735552 to 4136960 tid 2 2024-01-13T18:07:24.698 INFO:tasks.rados.rados.0.smithi084.stdout:1989: read oid 37 snap -1 2024-01-13T18:07:24.698 INFO:tasks.rados.rados.0.smithi084.stdout:1989: expect (ObjNum 621 snap 197 seq_num 621) 2024-01-13T18:07:24.698 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 197 2024-01-13T18:07:24.698 INFO:tasks.rados.rados.0.smithi084.stdout:1990: seq_num 625 ranges {5054464=475136,5529600=401408} 2024-01-13T18:07:24.730 INFO:tasks.rados.rados.0.smithi084.stdout:1990: writing smithi084102331-19 from 5054464 to 5529600 tid 1 2024-01-13T18:07:24.733 INFO:tasks.rados.rados.0.smithi084.stdout:1990: writing smithi084102331-19 from 5529600 to 5931008 tid 2 2024-01-13T18:07:24.733 INFO:tasks.rados.rados.0.smithi084.stdout:1991: rmattr oid 44 current snap is 197 2024-01-13T18:07:24.733 INFO:tasks.rados.rados.0.smithi084.stdout:1991: done (4 left) 2024-01-13T18:07:24.733 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 197 2024-01-13T18:07:24.733 INFO:tasks.rados.rados.0.smithi084.stdout:1984: expect (ObjNum 497 snap 160 seq_num 497) 2024-01-13T18:07:24.823 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 18:07:24 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mds.b.service: Succeeded. 2024-01-13T18:07:24.823 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 18:07:24 smithi099 systemd[1]: Stopped Ceph mds.b for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:24.823 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 18:07:24 smithi099 systemd[1]: Starting Ceph mds.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:24.889 INFO:tasks.rados.rados.0.smithi084.stdout:1988: finishing write tid 1 to smithi084102331-45 2024-01-13T18:07:24.889 INFO:tasks.rados.rados.0.smithi084.stdout:1988: finishing write tid 2 to smithi084102331-45 2024-01-13T18:07:24.889 INFO:tasks.rados.rados.0.smithi084.stdout:1988: finishing write tid 3 to smithi084102331-45 2024-01-13T18:07:24.889 INFO:tasks.rados.rados.0.smithi084.stdout:1988: finishing write tid 4 to smithi084102331-45 2024-01-13T18:07:24.889 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1153 (ObjNum 624 snap 197 seq_num 624) dirty exists 2024-01-13T18:07:24.889 INFO:tasks.rados.rados.0.smithi084.stdout:1988: left oid 45 (ObjNum 624 snap 197 seq_num 624) 2024-01-13T18:07:24.889 INFO:tasks.rados.rados.0.smithi084.stdout:1992: seq_num 626 ranges {0=491520,491520=401408} 2024-01-13T18:07:24.891 INFO:tasks.rados.rados.0.smithi084.stdout:1992: writing smithi084102331-15 from 0 to 491520 tid 1 2024-01-13T18:07:24.894 INFO:tasks.rados.rados.0.smithi084.stdout:1992: writing smithi084102331-15 from 491520 to 892928 tid 2 2024-01-13T18:07:24.894 INFO:tasks.rados.rados.0.smithi084.stdout:1984: done (4 left) 2024-01-13T18:07:24.894 INFO:tasks.rados.rados.0.smithi084.stdout:1988: done (3 left) 2024-01-13T18:07:24.894 INFO:tasks.rados.rados.0.smithi084.stdout:1993: copy_from oid 20 from oid 28 current snap is 197 2024-01-13T18:07:24.894 INFO:tasks.rados.rados.0.smithi084.stdout:1989: expect (ObjNum 621 snap 197 seq_num 621) 2024-01-13T18:07:25.119 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 18:07:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-b[169815]: starting mds.b at 2024-01-13T18:07:25.119 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 18:07:24 smithi099 bash[169801]: 0af9024fe2b0210034c6af2039a02062fb3521b6b70ae43676260d4c4fee01a8 2024-01-13T18:07:25.119 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 18:07:24 smithi099 systemd[1]: Started Ceph mds.b for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:25.229 INFO:tasks.rados.rados.0.smithi084.stdout:1990: finishing write tid 1 to smithi084102331-19 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1990: finishing write tid 2 to smithi084102331-19 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1990: finishing write tid 3 to smithi084102331-19 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1990: finishing write tid 4 to smithi084102331-19 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 632 (ObjNum 625 snap 197 seq_num 625) dirty exists 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1990: left oid 19 (ObjNum 625 snap 197 seq_num 625) 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1989: done (3 left) 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1990: done (2 left) 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1994: read oid 39 snap 195 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1994: expect (ObjNum 612 snap 193 seq_num 612) 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1995: read oid 3 snap 183 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1995: expect (ObjNum 572 snap 181 seq_num 572) 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1996: copy_from oid 4 from oid 43 current snap is 197 2024-01-13T18:07:25.230 INFO:tasks.rados.rados.0.smithi084.stdout:1992: finishing write tid 1 to smithi084102331-15 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:1992: finishing write tid 2 to smithi084102331-15 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:1992: finishing write tid 3 to smithi084102331-15 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:1992: finishing write tid 4 to smithi084102331-15 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1044 (ObjNum 626 snap 197 seq_num 626) dirty exists 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:1992: left oid 15 (ObjNum 626 snap 197 seq_num 626) 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:1993: finishing copy_from to smithi084102331-20 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 530 (ObjNum 252 snap 75 seq_num 252) dirty exists 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:1993: finishing copy_from racing read to smithi084102331-20 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:1992: done (4 left) 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:1993: done (3 left) 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 197 2024-01-13T18:07:25.231 INFO:tasks.rados.rados.0.smithi084.stdout:1997: seq_num 627 ranges {3465216=507904,3973120=401408} 2024-01-13T18:07:25.250 INFO:tasks.rados.rados.0.smithi084.stdout:1997: writing smithi084102331-10 from 3465216 to 3973120 tid 1 2024-01-13T18:07:25.253 INFO:tasks.rados.rados.0.smithi084.stdout:1997: writing smithi084102331-10 from 3973120 to 4374528 tid 2 2024-01-13T18:07:25.253 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 197 2024-01-13T18:07:25.253 INFO:tasks.rados.rados.0.smithi084.stdout:1996: finishing copy_from to smithi084102331-4 2024-01-13T18:07:25.253 INFO:tasks.rados.rados.0.smithi084.stdout:1996: got expected ENOENT (src dne) 2024-01-13T18:07:25.253 INFO:tasks.rados.rados.0.smithi084.stdout:1998: seq_num 628 ranges {3522560=524288,4046848=401408} 2024-01-13T18:07:25.275 INFO:tasks.rados.rados.0.smithi084.stdout:1998: writing smithi084102331-25 from 3522560 to 4046848 tid 1 2024-01-13T18:07:25.277 INFO:tasks.rados.rados.0.smithi084.stdout:1998: writing smithi084102331-25 from 4046848 to 4448256 tid 2 2024-01-13T18:07:25.277 INFO:tasks.rados.rados.0.smithi084.stdout:1999: copy_from oid 49 from oid 29 current snap is 197 2024-01-13T18:07:25.277 INFO:tasks.rados.rados.0.smithi084.stdout:1996: finishing copy_from racing read to smithi084102331-4 2024-01-13T18:07:25.277 INFO:tasks.rados.rados.0.smithi084.stdout:1994: expect (ObjNum 612 snap 193 seq_num 612) 2024-01-13T18:07:25.306 INFO:tasks.rados.rados.0.smithi084.stdout:1995: expect (ObjNum 572 snap 181 seq_num 572) 2024-01-13T18:07:25.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:25 smithi084 ceph-mon[116404]: pgmap v406: 121 pgs: 121 active+clean; 225 MiB data, 944 MiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 1012 KiB/s wr, 14 op/s 2024-01-13T18:07:25.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:25 smithi084 ceph-mon[116404]: osdmap e464: 8 total, 8 up, 8 in 2024-01-13T18:07:25.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:25.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:25 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:25 smithi084 ceph-mon[119097]: pgmap v406: 121 pgs: 121 active+clean; 225 MiB data, 944 MiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 1012 KiB/s wr, 14 op/s 2024-01-13T18:07:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:25 smithi084 ceph-mon[119097]: osdmap e464: 8 total, 8 up, 8 in 2024-01-13T18:07:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:25 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:1997: finishing write tid 1 to smithi084102331-10 2024-01-13T18:07:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:1997: finishing write tid 2 to smithi084102331-10 2024-01-13T18:07:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:1997: finishing write tid 3 to smithi084102331-10 2024-01-13T18:07:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:1997: finishing write tid 4 to smithi084102331-10 2024-01-13T18:07:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 881 (ObjNum 627 snap 197 seq_num 627) dirty exists 2024-01-13T18:07:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:1997: left oid 10 (ObjNum 627 snap 197 seq_num 627) 2024-01-13T18:07:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:1998: finishing write tid 1 to smithi084102331-25 2024-01-13T18:07:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:1998: finishing write tid 2 to smithi084102331-25 2024-01-13T18:07:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:1998: finishing write tid 3 to smithi084102331-25 2024-01-13T18:07:25.587 INFO:tasks.rados.rados.0.smithi084.stdout:1998: finishing write tid 4 to smithi084102331-25 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 942 (ObjNum 628 snap 197 seq_num 628) dirty exists 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:1998: left oid 25 (ObjNum 628 snap 197 seq_num 628) 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:1999: finishing copy_from to smithi084102331-49 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 692 (ObjNum 606 snap 192 seq_num 606) dirty exists 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:1999: finishing copy_from racing read to smithi084102331-49 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:1994: done (5 left) 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:1995: done (4 left) 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:1996: done (3 left) 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:1997: done (2 left) 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:1998: done (1 left) 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:1999: done (0 left) 2024-01-13T18:07:25.588 INFO:tasks.rados.rados.0.smithi084.stdout:2000: delete oid 45 current snap is 197 2024-01-13T18:07:25.589 INFO:tasks.rados.rados.0.smithi084.stdout:2000: done (0 left) 2024-01-13T18:07:25.589 INFO:tasks.rados.rados.0.smithi084.stdout:2001: read oid 17 snap 195 2024-01-13T18:07:25.589 INFO:tasks.rados.rados.0.smithi084.stdout:2001: expect deleted 2024-01-13T18:07:25.589 INFO:tasks.rados.rados.0.smithi084.stdout:2002: delete oid 38 current snap is 197 2024-01-13T18:07:25.591 INFO:tasks.rados.rados.0.smithi084.stdout:2001: done (1 left) 2024-01-13T18:07:25.591 INFO:tasks.rados.rados.0.smithi084.stdout:2002: done (0 left) 2024-01-13T18:07:25.591 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 197 2024-01-13T18:07:25.591 INFO:tasks.rados.rados.0.smithi084.stdout:2003: seq_num 631 ranges {5218304=573440,5791744=401408} 2024-01-13T18:07:25.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:25 smithi099 ceph-mon[138788]: pgmap v406: 121 pgs: 121 active+clean; 225 MiB data, 944 MiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 1012 KiB/s wr, 14 op/s 2024-01-13T18:07:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:25 smithi099 ceph-mon[138788]: osdmap e464: 8 total, 8 up, 8 in 2024-01-13T18:07:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:25 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:25.621 INFO:tasks.rados.rados.0.smithi084.stdout:2003: writing smithi084102331-37 from 5218304 to 5791744 tid 1 2024-01-13T18:07:25.624 INFO:tasks.rados.rados.0.smithi084.stdout:2003: writing smithi084102331-37 from 5791744 to 6193152 tid 2 2024-01-13T18:07:25.624 INFO:tasks.rados.rados.0.smithi084.stdout:2004: snap_create 2024-01-13T18:07:25.627 INFO:tasks.rados.rados.0.smithi084.stdout:2003: finishing write tid 1 to smithi084102331-37 2024-01-13T18:07:25.627 INFO:tasks.rados.rados.0.smithi084.stdout:2003: finishing write tid 2 to smithi084102331-37 2024-01-13T18:07:25.627 INFO:tasks.rados.rados.0.smithi084.stdout:2003: finishing write tid 3 to smithi084102331-37 2024-01-13T18:07:25.628 INFO:tasks.rados.rados.0.smithi084.stdout:2003: finishing write tid 4 to smithi084102331-37 2024-01-13T18:07:25.629 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 945 (ObjNum 631 snap 197 seq_num 631) dirty exists 2024-01-13T18:07:25.629 INFO:tasks.rados.rados.0.smithi084.stdout:2003: left oid 37 (ObjNum 631 snap 197 seq_num 631) 2024-01-13T18:07:26.145 INFO:tasks.rados.rados.0.smithi084.stdout:2003: done (1 left) 2024-01-13T18:07:26.145 INFO:tasks.rados.rados.0.smithi084.stdout:2004: done (0 left) 2024-01-13T18:07:26.145 INFO:tasks.rados.rados.0.smithi084.stdout:2005: read oid 14 snap 195 2024-01-13T18:07:26.145 INFO:tasks.rados.rados.0.smithi084.stdout:2005: expect (ObjNum 569 snap 181 seq_num 569) 2024-01-13T18:07:26.145 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 198 2024-01-13T18:07:26.145 INFO:tasks.rados.rados.0.smithi084.stdout:2006: seq_num 632 ranges {0=589824,589824=401408} 2024-01-13T18:07:26.148 INFO:tasks.rados.rados.0.smithi084.stdout:2006: writing smithi084102331-30 from 0 to 589824 tid 1 2024-01-13T18:07:26.151 INFO:tasks.rados.rados.0.smithi084.stdout:2006: writing smithi084102331-30 from 589824 to 991232 tid 2 2024-01-13T18:07:26.151 INFO:tasks.rados.rados.0.smithi084.stdout:2007: read oid 12 snap -1 2024-01-13T18:07:26.151 INFO:tasks.rados.rados.0.smithi084.stdout:2007: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:26.151 INFO:tasks.rados.rados.0.smithi084.stdout:2008: snap_create 2024-01-13T18:07:26.157 INFO:tasks.rados.rados.0.smithi084.stdout:2006: finishing write tid 1 to smithi084102331-30 2024-01-13T18:07:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2006: finishing write tid 2 to smithi084102331-30 2024-01-13T18:07:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2006: finishing write tid 3 to smithi084102331-30 2024-01-13T18:07:26.161 INFO:tasks.rados.rados.0.smithi084.stdout:2006: finishing write tid 4 to smithi084102331-30 2024-01-13T18:07:26.161 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 948 (ObjNum 632 snap 198 seq_num 632) dirty exists 2024-01-13T18:07:26.161 INFO:tasks.rados.rados.0.smithi084.stdout:2006: left oid 30 (ObjNum 632 snap 198 seq_num 632) 2024-01-13T18:07:26.164 INFO:tasks.rados.rados.0.smithi084.stdout:2007: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:26.219 INFO:tasks.rados.rados.0.smithi084.stdout:2005: expect (ObjNum 569 snap 181 seq_num 569) 2024-01-13T18:07:26.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:26 smithi084 ceph-mon[116404]: mds.? [v2:172.21.15.99:6832/2771886754,v1:172.21.15.99:6833/2771886754] up:boot 2024-01-13T18:07:26.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:26 smithi084 ceph-mon[116404]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-01-13T18:07:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:07:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:26 smithi084 ceph-mon[116404]: pgmap v408: 121 pgs: 121 active+clean; 226 MiB data, 963 MiB used, 714 GiB / 715 GiB avail; 7.6 MiB/s rd, 818 KiB/s wr, 12 op/s 2024-01-13T18:07:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:26 smithi084 ceph-mon[116404]: osdmap e465: 8 total, 8 up, 8 in 2024-01-13T18:07:26.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:26 smithi084 ceph-mon[119097]: mds.? [v2:172.21.15.99:6832/2771886754,v1:172.21.15.99:6833/2771886754] up:boot 2024-01-13T18:07:26.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:26 smithi084 ceph-mon[119097]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-01-13T18:07:26.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:07:26.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:26 smithi084 ceph-mon[119097]: pgmap v408: 121 pgs: 121 active+clean; 226 MiB data, 963 MiB used, 714 GiB / 715 GiB avail; 7.6 MiB/s rd, 818 KiB/s wr, 12 op/s 2024-01-13T18:07:26.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:26 smithi084 ceph-mon[119097]: osdmap e465: 8 total, 8 up, 8 in 2024-01-13T18:07:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:26 smithi099 ceph-mon[138788]: mds.? [v2:172.21.15.99:6832/2771886754,v1:172.21.15.99:6833/2771886754] up:boot 2024-01-13T18:07:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:26 smithi099 ceph-mon[138788]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-01-13T18:07:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-13T18:07:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:26 smithi099 ceph-mon[138788]: pgmap v408: 121 pgs: 121 active+clean; 226 MiB data, 963 MiB used, 714 GiB / 715 GiB avail; 7.6 MiB/s rd, 818 KiB/s wr, 12 op/s 2024-01-13T18:07:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:26 smithi099 ceph-mon[138788]: osdmap e465: 8 total, 8 up, 8 in 2024-01-13T18:07:27.146 INFO:tasks.rados.rados.0.smithi084.stdout:2005: done (3 left) 2024-01-13T18:07:27.146 INFO:tasks.rados.rados.0.smithi084.stdout:2006: done (2 left) 2024-01-13T18:07:27.146 INFO:tasks.rados.rados.0.smithi084.stdout:2007: done (1 left) 2024-01-13T18:07:27.146 INFO:tasks.rados.rados.0.smithi084.stdout:2008: done (0 left) 2024-01-13T18:07:27.146 INFO:tasks.rados.rados.0.smithi084.stdout:2009: delete oid 43 current snap is 199 2024-01-13T18:07:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:2009: done (0 left) 2024-01-13T18:07:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:2010: read oid 30 snap -1 2024-01-13T18:07:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:2010: expect (ObjNum 632 snap 198 seq_num 632) 2024-01-13T18:07:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:2011: rollback oid 41 current snap is 199 2024-01-13T18:07:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 197 2024-01-13T18:07:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:2012: read oid 12 snap -1 2024-01-13T18:07:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:2012: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:2013: rollback oid 7 current snap is 199 2024-01-13T18:07:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 7 to 187 2024-01-13T18:07:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 199 2024-01-13T18:07:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:2014: seq_num 634 ranges {0=622592,622592=401408} 2024-01-13T18:07:27.152 INFO:tasks.rados.rados.0.smithi084.stdout:2014: writing smithi084102331-23 from 0 to 622592 tid 1 2024-01-13T18:07:27.155 INFO:tasks.rados.rados.0.smithi084.stdout:2014: writing smithi084102331-23 from 622592 to 1024000 tid 2 2024-01-13T18:07:27.155 INFO:tasks.rados.rados.0.smithi084.stdout:2015: delete oid 6 current snap is 199 2024-01-13T18:07:27.155 INFO:tasks.rados.rados.0.smithi084.stdout:2013: finishing rollback tid 0 to smithi084102331-7 2024-01-13T18:07:27.155 INFO:tasks.rados.rados.0.smithi084.stdout:2013: finishing rollback tid 1 to smithi084102331-7 2024-01-13T18:07:27.155 INFO:tasks.rados.rados.0.smithi084.stdout:2013: finishing rollback tid 2 to smithi084102331-7 2024-01-13T18:07:27.155 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 608 (ObjNum 508 snap 162 seq_num 508) dirty exists 2024-01-13T18:07:27.157 INFO:tasks.rados.rados.0.smithi084.stdout:2013: done (5 left) 2024-01-13T18:07:27.157 INFO:tasks.rados.rados.0.smithi084.stdout:2015: done (4 left) 2024-01-13T18:07:27.157 INFO:tasks.rados.rados.0.smithi084.stdout:2016: rollback oid 36 current snap is 199 2024-01-13T18:07:27.157 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 197 2024-01-13T18:07:27.157 INFO:tasks.rados.rados.0.smithi084.stdout:2011: finishing rollback tid 0 to smithi084102331-41 2024-01-13T18:07:27.158 INFO:tasks.rados.rados.0.smithi084.stdout:2011: finishing rollback tid 1 to smithi084102331-41 2024-01-13T18:07:27.158 INFO:tasks.rados.rados.0.smithi084.stdout:2017: read oid 3 snap 195 2024-01-13T18:07:27.158 INFO:tasks.rados.rados.0.smithi084.stdout:2017: expect deleted 2024-01-13T18:07:27.159 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 199 2024-01-13T18:07:27.160 INFO:tasks.rados.rados.0.smithi084.stdout:2018: seq_num 636 ranges {2834432=655360,3489792=401408} 2024-01-13T18:07:27.176 INFO:tasks.rados.rados.0.smithi084.stdout:2018: writing smithi084102331-29 from 2834432 to 3489792 tid 1 2024-01-13T18:07:27.179 INFO:tasks.rados.rados.0.smithi084.stdout:2018: writing smithi084102331-29 from 3489792 to 3891200 tid 2 2024-01-13T18:07:27.179 INFO:tasks.rados.rados.0.smithi084.stdout:2019: snap_remove snap 185 2024-01-13T18:07:27.643 INFO:tasks.rados.rados.0.smithi084.stdout:2019: done (7 left) 2024-01-13T18:07:27.643 INFO:tasks.rados.rados.0.smithi084.stdout:2020: snap_remove snap 194 2024-01-13T18:07:28.178 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 18:07:27 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-a[150105]: 2024-01-13T18:07:27.915+0000 7fa258313700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-13T18:07:28.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[116404]: osdmap e466: 8 total, 8 up, 8 in 2024-01-13T18:07:28.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[116404]: osdmap e467: 8 total, 8 up, 8 in 2024-01-13T18:07:28.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[119097]: osdmap e466: 8 total, 8 up, 8 in 2024-01-13T18:07:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[119097]: osdmap e467: 8 total, 8 up, 8 in 2024-01-13T18:07:28.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:28 smithi099 ceph-mon[138788]: osdmap e466: 8 total, 8 up, 8 in 2024-01-13T18:07:28.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:28 smithi099 ceph-mon[138788]: osdmap e467: 8 total, 8 up, 8 in 2024-01-13T18:07:28.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:28.644 INFO:tasks.rados.rados.0.smithi084.stdout:2020: done (7 left) 2024-01-13T18:07:28.644 INFO:tasks.rados.rados.0.smithi084.stdout:2021: copy_from oid 42 from oid 5 current snap is 199 2024-01-13T18:07:28.645 INFO:tasks.rados.rados.0.smithi084.stdout:2011: finishing rollback tid 2 to smithi084102331-41 2024-01-13T18:07:28.645 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 682 (ObjNum 578 snap 185 seq_num 578) dirty exists 2024-01-13T18:07:28.645 INFO:tasks.rados.rados.0.smithi084.stdout:2016: finishing rollback tid 0 to smithi084102331-36 2024-01-13T18:07:28.645 INFO:tasks.rados.rados.0.smithi084.stdout:2014: finishing write tid 1 to smithi084102331-23 2024-01-13T18:07:28.645 INFO:tasks.rados.rados.0.smithi084.stdout:2016: finishing rollback tid 1 to smithi084102331-36 2024-01-13T18:07:28.645 INFO:tasks.rados.rados.0.smithi084.stdout:2016: finishing rollback tid 2 to smithi084102331-36 2024-01-13T18:07:28.645 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1075 (ObjNum 534 snap 171 seq_num 534) dirty exists 2024-01-13T18:07:28.645 INFO:tasks.rados.rados.0.smithi084.stdout:2012: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:28.707 INFO:tasks.rados.rados.0.smithi084.stdout:2014: finishing write tid 2 to smithi084102331-23 2024-01-13T18:07:28.708 INFO:tasks.rados.rados.0.smithi084.stdout:2014: finishing write tid 3 to smithi084102331-23 2024-01-13T18:07:28.708 INFO:tasks.rados.rados.0.smithi084.stdout:2010: expect (ObjNum 632 snap 198 seq_num 632) 2024-01-13T18:07:28.732 INFO:tasks.rados.rados.0.smithi084.stdout:2014: finishing write tid 4 to smithi084102331-23 2024-01-13T18:07:28.732 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1089 (ObjNum 634 snap 199 seq_num 634) dirty exists 2024-01-13T18:07:28.732 INFO:tasks.rados.rados.0.smithi084.stdout:2014: left oid 23 (ObjNum 634 snap 199 seq_num 634) 2024-01-13T18:07:28.732 INFO:tasks.rados.rados.0.smithi084.stdout:2018: finishing write tid 1 to smithi084102331-29 2024-01-13T18:07:28.732 INFO:tasks.rados.rados.0.smithi084.stdout:2018: finishing write tid 2 to smithi084102331-29 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2018: finishing write tid 3 to smithi084102331-29 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2018: finishing write tid 4 to smithi084102331-29 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 704 (ObjNum 636 snap 199 seq_num 636) dirty exists 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2018: left oid 29 (ObjNum 636 snap 199 seq_num 636) 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2010: done (7 left) 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2011: done (6 left) 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2012: done (5 left) 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2014: done (4 left) 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2016: done (3 left) 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2017: done (2 left) 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2018: done (1 left) 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 199 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2021: finishing copy_from to smithi084102331-42 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 657 (ObjNum 456 snap 142 seq_num 456) dirty exists 2024-01-13T18:07:28.733 INFO:tasks.rados.rados.0.smithi084.stdout:2021: finishing copy_from racing read to smithi084102331-42 2024-01-13T18:07:28.734 INFO:tasks.rados.rados.0.smithi084.stdout:2022: seq_num 637 ranges {0=671744,671744=401408} 2024-01-13T18:07:28.735 INFO:tasks.rados.rados.0.smithi084.stdout:2022: writing smithi084102331-6 from 0 to 671744 tid 1 2024-01-13T18:07:28.738 INFO:tasks.rados.rados.0.smithi084.stdout:2022: writing smithi084102331-6 from 671744 to 1073152 tid 2 2024-01-13T18:07:28.738 INFO:tasks.rados.rados.0.smithi084.stdout:2021: done (1 left) 2024-01-13T18:07:28.738 INFO:tasks.rados.rados.0.smithi084.stdout:2023: read oid 27 snap -1 2024-01-13T18:07:28.738 INFO:tasks.rados.rados.0.smithi084.stdout:2023: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:28.738 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 199 2024-01-13T18:07:28.738 INFO:tasks.rados.rados.0.smithi084.stdout:2024: seq_num 638 ranges {1835008=688128,2523136=401408} 2024-01-13T18:07:28.752 INFO:tasks.rados.rados.0.smithi084.stdout:2024: writing smithi084102331-20 from 1835008 to 2523136 tid 1 2024-01-13T18:07:28.754 INFO:tasks.rados.rados.0.smithi084.stdout:2024: writing smithi084102331-20 from 2523136 to 2924544 tid 2 2024-01-13T18:07:28.754 INFO:tasks.rados.rados.0.smithi084.stdout:2025: read oid 31 snap -1 2024-01-13T18:07:28.754 INFO:tasks.rados.rados.0.smithi084.stdout:2025: expect (ObjNum 424 snap 135 seq_num 424) 2024-01-13T18:07:28.754 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 199 2024-01-13T18:07:28.755 INFO:tasks.rados.rados.0.smithi084.stdout:2026: seq_num 639 ranges {5931008=704512,6635520=401408} 2024-01-13T18:07:28.792 INFO:tasks.rados.rados.0.smithi084.stdout:2026: writing smithi084102331-19 from 5931008 to 6635520 tid 1 2024-01-13T18:07:28.794 INFO:tasks.rados.rados.0.smithi084.stdout:2026: writing smithi084102331-19 from 6635520 to 7036928 tid 2 2024-01-13T18:07:28.794 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 199 2024-01-13T18:07:28.794 INFO:tasks.rados.rados.0.smithi084.stdout:2022: finishing write tid 1 to smithi084102331-6 2024-01-13T18:07:28.794 INFO:tasks.rados.rados.0.smithi084.stdout:2027: seq_num 640 ranges {0=729088,729088=401408} 2024-01-13T18:07:28.798 INFO:tasks.rados.rados.0.smithi084.stdout:2027: writing smithi084102331-24 from 0 to 729088 tid 1 2024-01-13T18:07:28.801 INFO:tasks.rados.rados.0.smithi084.stdout:2027: writing smithi084102331-24 from 729088 to 1130496 tid 2 2024-01-13T18:07:28.801 INFO:tasks.rados.rados.0.smithi084.stdout:2028: copy_from oid 36 from oid 33 current snap is 199 2024-01-13T18:07:28.801 INFO:tasks.rados.rados.0.smithi084.stdout:2023: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:28.804 INFO:tasks.rados.rados.0.smithi084.stdout:2022: finishing write tid 2 to smithi084102331-6 2024-01-13T18:07:28.804 INFO:tasks.rados.rados.0.smithi084.stdout:2022: finishing write tid 3 to smithi084102331-6 2024-01-13T18:07:28.804 INFO:tasks.rados.rados.0.smithi084.stdout:2022: finishing write tid 4 to smithi084102331-6 2024-01-13T18:07:28.804 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 598 (ObjNum 637 snap 199 seq_num 637) dirty exists 2024-01-13T18:07:28.804 INFO:tasks.rados.rados.0.smithi084.stdout:2022: left oid 6 (ObjNum 637 snap 199 seq_num 637) 2024-01-13T18:07:28.804 INFO:tasks.rados.rados.0.smithi084.stdout:2024: finishing write tid 1 to smithi084102331-20 2024-01-13T18:07:28.804 INFO:tasks.rados.rados.0.smithi084.stdout:2024: finishing write tid 2 to smithi084102331-20 2024-01-13T18:07:28.804 INFO:tasks.rados.rados.0.smithi084.stdout:2024: finishing write tid 3 to smithi084102331-20 2024-01-13T18:07:28.804 INFO:tasks.rados.rados.0.smithi084.stdout:2024: finishing write tid 4 to smithi084102331-20 2024-01-13T18:07:28.804 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 635 (ObjNum 638 snap 199 seq_num 638) dirty exists 2024-01-13T18:07:28.805 INFO:tasks.rados.rados.0.smithi084.stdout:2024: left oid 20 (ObjNum 638 snap 199 seq_num 638) 2024-01-13T18:07:28.805 INFO:tasks.rados.rados.0.smithi084.stdout:2022: done (6 left) 2024-01-13T18:07:28.805 INFO:tasks.rados.rados.0.smithi084.stdout:2023: done (5 left) 2024-01-13T18:07:28.805 INFO:tasks.rados.rados.0.smithi084.stdout:2024: done (4 left) 2024-01-13T18:07:28.805 INFO:tasks.rados.rados.0.smithi084.stdout:2029: setattr oid 7 current snap is 199 2024-01-13T18:07:28.805 INFO:tasks.rados.rados.0.smithi084.stdout:2025: expect (ObjNum 424 snap 135 seq_num 424) 2024-01-13T18:07:29.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:29 smithi099 ceph-mon[138788]: pgmap v412: 121 pgs: 121 active+clean; 229 MiB data, 976 MiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-01-13T18:07:29.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:29 smithi099 ceph-mon[138788]: osdmap e468: 8 total, 8 up, 8 in 2024-01-13T18:07:29.370 INFO:tasks.rados.rados.0.smithi084.stdout:2026: finishing write tid 1 to smithi084102331-19 2024-01-13T18:07:29.370 INFO:tasks.rados.rados.0.smithi084.stdout:2026: finishing write tid 2 to smithi084102331-19 2024-01-13T18:07:29.370 INFO:tasks.rados.rados.0.smithi084.stdout:2026: finishing write tid 3 to smithi084102331-19 2024-01-13T18:07:29.370 INFO:tasks.rados.rados.0.smithi084.stdout:2026: finishing write tid 4 to smithi084102331-19 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 638 (ObjNum 639 snap 199 seq_num 639) dirty exists 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2026: left oid 19 (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2027: finishing write tid 1 to smithi084102331-24 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2028: finishing copy_from to smithi084102331-36 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2028: got expected ENOENT (src dne) 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2028: finishing copy_from racing read to smithi084102331-36 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2027: finishing write tid 2 to smithi084102331-24 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2027: finishing write tid 3 to smithi084102331-24 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2027: finishing write tid 4 to smithi084102331-24 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 611 (ObjNum 640 snap 199 seq_num 640) dirty exists 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2027: left oid 24 (ObjNum 640 snap 199 seq_num 640) 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2025: done (4 left) 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2026: done (3 left) 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2027: done (2 left) 2024-01-13T18:07:29.371 INFO:tasks.rados.rados.0.smithi084.stdout:2028: done (1 left) 2024-01-13T18:07:29.372 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 199 2024-01-13T18:07:29.372 INFO:tasks.rados.rados.0.smithi084.stdout:2030: seq_num 641 ranges {5242880=745472,5988352=401408} 2024-01-13T18:07:29.401 INFO:tasks.rados.rados.0.smithi084.stdout:2030: writing smithi084102331-35 from 5242880 to 5988352 tid 1 2024-01-13T18:07:29.403 INFO:tasks.rados.rados.0.smithi084.stdout:2030: writing smithi084102331-35 from 5988352 to 6389760 tid 2 2024-01-13T18:07:29.403 INFO:tasks.rados.rados.0.smithi084.stdout:2031: snap_create 2024-01-13T18:07:29.403 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 612 (ObjNum 508 snap 162 seq_num 508) dirty exists 2024-01-13T18:07:29.405 INFO:tasks.rados.rados.0.smithi084.stdout:2030: finishing write tid 1 to smithi084102331-35 2024-01-13T18:07:29.405 INFO:tasks.rados.rados.0.smithi084.stdout:2030: finishing write tid 2 to smithi084102331-35 2024-01-13T18:07:29.406 INFO:tasks.rados.rados.0.smithi084.stdout:2030: finishing write tid 3 to smithi084102331-35 2024-01-13T18:07:29.407 INFO:tasks.rados.rados.0.smithi084.stdout:2030: finishing write tid 4 to smithi084102331-35 2024-01-13T18:07:29.407 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 714 (ObjNum 641 snap 199 seq_num 641) dirty exists 2024-01-13T18:07:29.407 INFO:tasks.rados.rados.0.smithi084.stdout:2030: left oid 35 (ObjNum 641 snap 199 seq_num 641) 2024-01-13T18:07:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:29 smithi084 ceph-mon[116404]: pgmap v412: 121 pgs: 121 active+clean; 229 MiB data, 976 MiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-01-13T18:07:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:29 smithi084 ceph-mon[116404]: osdmap e468: 8 total, 8 up, 8 in 2024-01-13T18:07:29.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:29 smithi084 ceph-mon[119097]: pgmap v412: 121 pgs: 121 active+clean; 229 MiB data, 976 MiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-01-13T18:07:29.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:29 smithi084 ceph-mon[119097]: osdmap e468: 8 total, 8 up, 8 in 2024-01-13T18:07:30.157 INFO:tasks.rados.rados.0.smithi084.stdout:2029: done (2 left) 2024-01-13T18:07:30.157 INFO:tasks.rados.rados.0.smithi084.stdout:2030: done (1 left) 2024-01-13T18:07:30.157 INFO:tasks.rados.rados.0.smithi084.stdout:2031: done (0 left) 2024-01-13T18:07:30.157 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 200 2024-01-13T18:07:30.157 INFO:tasks.rados.rados.0.smithi084.stdout:2032: seq_num 642 ranges {3465216=761856,4227072=401408} 2024-01-13T18:07:30.179 INFO:tasks.rados.rados.0.smithi084.stdout:2032: writing smithi084102331-42 from 3465216 to 4227072 tid 1 2024-01-13T18:07:30.182 INFO:tasks.rados.rados.0.smithi084.stdout:2032: writing smithi084102331-42 from 4227072 to 4628480 tid 2 2024-01-13T18:07:30.182 INFO:tasks.rados.rados.0.smithi084.stdout:2033: snap_create 2024-01-13T18:07:30.186 INFO:tasks.rados.rados.0.smithi084.stdout:2032: finishing write tid 1 to smithi084102331-42 2024-01-13T18:07:30.186 INFO:tasks.rados.rados.0.smithi084.stdout:2032: finishing write tid 2 to smithi084102331-42 2024-01-13T18:07:30.186 INFO:tasks.rados.rados.0.smithi084.stdout:2032: finishing write tid 3 to smithi084102331-42 2024-01-13T18:07:30.187 INFO:tasks.rados.rados.0.smithi084.stdout:2032: finishing write tid 4 to smithi084102331-42 2024-01-13T18:07:30.187 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 887 (ObjNum 642 snap 200 seq_num 642) dirty exists 2024-01-13T18:07:30.188 INFO:tasks.rados.rados.0.smithi084.stdout:2032: left oid 42 (ObjNum 642 snap 200 seq_num 642) 2024-01-13T18:07:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:07:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:07:30] "GET /metrics HTTP/1.1" 200 36186 "" "Prometheus/2.43.0" 2024-01-13T18:07:30.694 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:07:31.033 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:07:31.033 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (5m) 16s ago 8m 28.4M - 0.25.0 c8568f914cd2 a5cbc3e01ffb 2024-01-13T18:07:31.033 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (5m) 3s ago 7m 89.9M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:07:31.033 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (18s) 16s ago 8m 12.3M - 18.2.1-242-gd2f11f33 f16b14f4c75d b6b0859480c3 2024-01-13T18:07:31.033 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (6s) 3s ago 8m 12.2M - 18.2.1-242-gd2f11f33 f16b14f4c75d 0af9024fe2b0 2024-01-13T18:07:31.033 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (4m) 3s ago 11m 449M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:07:31.033 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (5m) 16s ago 12m 518M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:07:31.033 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (4m) 16s ago 12m 109M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d b64908c7a53c 2024-01-13T18:07:31.033 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (4m) 3s ago 11m 71.9M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d be7bb477ea53 2024-01-13T18:07:31.033 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (4m) 16s ago 11m 73.3M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d e13f01b852ff 2024-01-13T18:07:31.034 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (5m) 16s ago 7m 18.6M - 1.5.0 0da6a335fe13 b72e6d50f165 2024-01-13T18:07:31.034 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (5m) 3s ago 7m 15.9M - 1.5.0 0da6a335fe13 e9f879b5e55b 2024-01-13T18:07:31.034 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (3m) 16s ago 11m 471M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d e18181bdb4a8 2024-01-13T18:07:31.034 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (3m) 16s ago 10m 284M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 32bdce285b36 2024-01-13T18:07:31.034 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (2m) 16s ago 10m 264M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 660c53389079 2024-01-13T18:07:31.034 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (2m) 16s ago 10m 249M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 0e4b8c3482a4 2024-01-13T18:07:31.034 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (117s) 3s ago 10m 308M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 76d7d19ec531 2024-01-13T18:07:31.034 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (89s) 3s ago 9m 282M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 5cf0e9339ca9 2024-01-13T18:07:31.034 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (60s) 3s ago 9m 193M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 919ac0aa6c87 2024-01-13T18:07:31.034 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (32s) 3s ago 9m 105M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 237ebd4a72cd 2024-01-13T18:07:31.034 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (5m) 3s ago 8m 63.7M - 2.43.0 a07b618ecd1d cb4c11bf6eec 2024-01-13T18:07:31.163 INFO:tasks.rados.rados.0.smithi084.stdout:2032: done (1 left) 2024-01-13T18:07:31.163 INFO:tasks.rados.rados.0.smithi084.stdout:2033: done (0 left) 2024-01-13T18:07:31.163 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 201 2024-01-13T18:07:31.163 INFO:tasks.rados.rados.0.smithi084.stdout:2034: seq_num 643 ranges {6496256=778240,7274496=401408} 2024-01-13T18:07:31.203 INFO:tasks.rados.rados.0.smithi084.stdout:2034: writing smithi084102331-18 from 6496256 to 7274496 tid 1 2024-01-13T18:07:31.205 INFO:tasks.rados.rados.0.smithi084.stdout:2034: writing smithi084102331-18 from 7274496 to 7675904 tid 2 2024-01-13T18:07:31.205 INFO:tasks.rados.rados.0.smithi084.stdout:2035: snap_create 2024-01-13T18:07:31.207 INFO:tasks.rados.rados.0.smithi084.stdout:2034: finishing write tid 1 to smithi084102331-18 2024-01-13T18:07:31.207 INFO:tasks.rados.rados.0.smithi084.stdout:2034: finishing write tid 2 to smithi084102331-18 2024-01-13T18:07:31.208 INFO:tasks.rados.rados.0.smithi084.stdout:2034: finishing write tid 3 to smithi084102331-18 2024-01-13T18:07:31.209 INFO:tasks.rados.rados.0.smithi084.stdout:2034: finishing write tid 4 to smithi084102331-18 2024-01-13T18:07:31.209 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 884 (ObjNum 643 snap 201 seq_num 643) dirty exists 2024-01-13T18:07:31.209 INFO:tasks.rados.rados.0.smithi084.stdout:2034: left oid 18 (ObjNum 643 snap 201 seq_num 643) 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: pgmap v414: 121 pgs: 121 active+clean; 235 MiB data, 991 MiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 2.8 MiB/s wr, 29 op/s 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: osdmap e469: 8 total, 8 up, 8 in 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]: dispatch 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]: dispatch 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: pgmap v414: 121 pgs: 121 active+clean; 235 MiB data, 991 MiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 2.8 MiB/s wr, 29 op/s 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: osdmap e469: 8 total, 8 up, 8 in 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]: dispatch 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]: dispatch 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.433 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:07:31.433 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:07:31.433 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:07:31.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 8 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 15 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:07:31.434 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:07:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: pgmap v414: 121 pgs: 121 active+clean; 235 MiB data, 991 MiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 2.8 MiB/s wr, 29 op/s 2024-01-13T18:07:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: osdmap e469: 8 total, 8 up, 8 in 2024-01-13T18:07:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]: dispatch 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]: dispatch 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:31.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:31.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: Detected new or changed devices on smithi099 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: Upgrade: Setting container_image for all mds 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: Upgrade: Setting container_image for all rgw 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: Upgrade: Setting container_image for all rbd-mirror 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: Upgrade: Setting container_image for all ceph-exporter 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: Upgrade: Setting container_image for all iscsi 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: Upgrade: Setting container_image for all nfs 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: Upgrade: Setting container_image for all nvmeof 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: from='client.44303 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: from='client.44309 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: osdmap e470: 8 total, 8 up, 8 in 2024-01-13T18:07:32.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/782729154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:32.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:31 smithi084 systemd[1]: Stopping Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:32.174 INFO:tasks.rados.rados.0.smithi084.stdout:2034: done (1 left) 2024-01-13T18:07:32.174 INFO:tasks.rados.rados.0.smithi084.stdout:2035: done (0 left) 2024-01-13T18:07:32.174 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 202 2024-01-13T18:07:32.174 INFO:tasks.rados.rados.0.smithi084.stdout:2036: seq_num 644 ranges {0=794624,794624=401408} 2024-01-13T18:07:32.178 INFO:tasks.rados.rados.0.smithi084.stdout:2036: writing smithi084102331-17 from 0 to 794624 tid 1 2024-01-13T18:07:32.181 INFO:tasks.rados.rados.0.smithi084.stdout:2036: writing smithi084102331-17 from 794624 to 1196032 tid 2 2024-01-13T18:07:32.181 INFO:tasks.rados.rados.0.smithi084.stdout:2037: rollback oid 22 current snap is 202 2024-01-13T18:07:32.181 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 197 2024-01-13T18:07:32.181 INFO:tasks.rados.rados.0.smithi084.stdout:2038: delete oid 39 current snap is 202 2024-01-13T18:07:32.184 INFO:tasks.rados.rados.0.smithi084.stdout:2036: finishing write tid 1 to smithi084102331-17 2024-01-13T18:07:32.185 INFO:tasks.rados.rados.0.smithi084.stdout:2036: finishing write tid 2 to smithi084102331-17 2024-01-13T18:07:32.186 INFO:tasks.rados.rados.0.smithi084.stdout:2036: finishing write tid 3 to smithi084102331-17 2024-01-13T18:07:32.187 INFO:tasks.rados.rados.0.smithi084.stdout:2038: done (2 left) 2024-01-13T18:07:32.187 INFO:tasks.rados.rados.0.smithi084.stdout:2039: snap_remove snap 183 2024-01-13T18:07:32.428 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 bash[154756]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a 2024-01-13T18:07:32.429 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-01-13T18:07:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: Detected new or changed devices on smithi099 2024-01-13T18:07:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: Upgrade: Setting container_image for all mds 2024-01-13T18:07:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: Upgrade: Setting container_image for all rgw 2024-01-13T18:07:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: Upgrade: Setting container_image for all rbd-mirror 2024-01-13T18:07:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: Upgrade: Setting container_image for all ceph-exporter 2024-01-13T18:07:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: Upgrade: Setting container_image for all iscsi 2024-01-13T18:07:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: Upgrade: Setting container_image for all nfs 2024-01-13T18:07:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: Upgrade: Setting container_image for all nvmeof 2024-01-13T18:07:32.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: from='client.44303 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:32.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: from='client.44309 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:32.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: osdmap e470: 8 total, 8 up, 8 in 2024-01-13T18:07:32.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/782729154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: Detected new or changed devices on smithi099 2024-01-13T18:07:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: Upgrade: Setting container_image for all mds 2024-01-13T18:07:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: Upgrade: Setting container_image for all rgw 2024-01-13T18:07:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: Upgrade: Setting container_image for all rbd-mirror 2024-01-13T18:07:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: Upgrade: Setting container_image for all ceph-exporter 2024-01-13T18:07:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: Upgrade: Setting container_image for all iscsi 2024-01-13T18:07:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: Upgrade: Setting container_image for all nfs 2024-01-13T18:07:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: Upgrade: Setting container_image for all nvmeof 2024-01-13T18:07:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: from='client.44303 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:32.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: from='client.44309 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:07:32.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: osdmap e470: 8 total, 8 up, 8 in 2024-01-13T18:07:32.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:32 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/782729154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:32.652 INFO:tasks.rados.rados.0.smithi084.stdout:2039: done (2 left) 2024-01-13T18:07:32.652 INFO:tasks.rados.rados.0.smithi084.stdout:2040: snap_create 2024-01-13T18:07:32.652 INFO:tasks.rados.rados.0.smithi084.stdout:2036: finishing write tid 4 to smithi084102331-17 2024-01-13T18:07:32.652 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 724 (ObjNum 644 snap 202 seq_num 644) dirty exists 2024-01-13T18:07:32.652 INFO:tasks.rados.rados.0.smithi084.stdout:2036: left oid 17 (ObjNum 644 snap 202 seq_num 644) 2024-01-13T18:07:32.653 INFO:tasks.rados.rados.0.smithi084.stdout:2037: finishing rollback tid 0 to smithi084102331-22 2024-01-13T18:07:32.653 INFO:tasks.rados.rados.0.smithi084.stdout:2037: finishing rollback tid 1 to smithi084102331-22 2024-01-13T18:07:32.653 INFO:tasks.rados.rados.0.smithi084.stdout:2037: finishing rollback tid 2 to smithi084102331-22 2024-01-13T18:07:32.653 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1092 (ObjNum 49 snap 0 seq_num 1953066355) dirty exists 2024-01-13T18:07:32.801 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-01-13T18:07:32.801 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 systemd[1]: Stopped Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:32.801 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 systemd[1]: Starting Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:33.171 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.943Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-01-13T18:07:33.171 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.943Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-01-13T18:07:33.171 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.943Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-01-13T18:07:33.171 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.943Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-01-13T18:07:33.171 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.943Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-01-13T18:07:33.171 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-01-13T18:07:33.171 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-01-13T18:07:33.171 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=arp 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=bcache 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=bonding 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=btrfs 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=conntrack 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=cpu 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=diskstats 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=dmi 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=edac 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=entropy 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=filefd 2024-01-13T18:07:33.172 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=filesystem 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=hwmon 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=infiniband 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=ipvs 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=loadavg 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=mdadm 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=meminfo 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=netclass 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=netdev 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=netstat 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=nfs 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=nfsd 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=nvme 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=os 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=pressure 2024-01-13T18:07:33.173 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=rapl 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=schedstat 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=selinux 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=sockstat 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=softnet 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=stat 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=tapestats 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=textfile 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=time 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=uname 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=vmstat 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=xfs 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=node_exporter.go:117 level=info collector=zfs 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a[154919]: ts=2024-01-13T18:07:32.944Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-01-13T18:07:33.174 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 bash[154905]: 7c868edb84c92d70a42869b4f706c0f467f18a92382b4c0aaf9ed9a63bcd0b6a 2024-01-13T18:07:33.175 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 18:07:32 smithi084 systemd[1]: Started Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:33.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[116404]: Upgrade: Updating node-exporter.a (1/2) 2024-01-13T18:07:33.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[116404]: Deploying daemon node-exporter.a on smithi084 2024-01-13T18:07:33.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[116404]: pgmap v417: 121 pgs: 121 active+clean; 247 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 4.3 MiB/s wr, 27 op/s 2024-01-13T18:07:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[116404]: osdmap e471: 8 total, 8 up, 8 in 2024-01-13T18:07:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[116404]: osdmap e472: 8 total, 8 up, 8 in 2024-01-13T18:07:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[119097]: Upgrade: Updating node-exporter.a (1/2) 2024-01-13T18:07:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[119097]: Deploying daemon node-exporter.a on smithi084 2024-01-13T18:07:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[119097]: pgmap v417: 121 pgs: 121 active+clean; 247 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 4.3 MiB/s wr, 27 op/s 2024-01-13T18:07:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[119097]: osdmap e471: 8 total, 8 up, 8 in 2024-01-13T18:07:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[119097]: osdmap e472: 8 total, 8 up, 8 in 2024-01-13T18:07:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:33.450 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:33 smithi099 ceph-mon[138788]: Upgrade: Updating node-exporter.a (1/2) 2024-01-13T18:07:33.450 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:33 smithi099 ceph-mon[138788]: Deploying daemon node-exporter.a on smithi084 2024-01-13T18:07:33.450 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:33 smithi099 ceph-mon[138788]: pgmap v417: 121 pgs: 121 active+clean; 247 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 4.3 MiB/s wr, 27 op/s 2024-01-13T18:07:33.450 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:33 smithi099 ceph-mon[138788]: osdmap e471: 8 total, 8 up, 8 in 2024-01-13T18:07:33.450 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:33 smithi099 ceph-mon[138788]: osdmap e472: 8 total, 8 up, 8 in 2024-01-13T18:07:33.451 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:33.451 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:33.656 INFO:tasks.rados.rados.0.smithi084.stdout:2036: done (2 left) 2024-01-13T18:07:33.656 INFO:tasks.rados.rados.0.smithi084.stdout:2037: done (1 left) 2024-01-13T18:07:33.657 INFO:tasks.rados.rados.0.smithi084.stdout:2040: done (0 left) 2024-01-13T18:07:33.657 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 203 2024-01-13T18:07:33.657 INFO:tasks.rados.rados.0.smithi084.stdout:2041: seq_num 646 ranges {4374528=425984,4800512=655360,5455872=147456} 2024-01-13T18:07:33.681 INFO:tasks.rados.rados.0.smithi084.stdout:2041: writing smithi084102331-10 from 4374528 to 4800512 tid 1 2024-01-13T18:07:33.685 INFO:tasks.rados.rados.0.smithi084.stdout:2041: writing smithi084102331-10 from 4800512 to 5455872 tid 2 2024-01-13T18:07:33.686 INFO:tasks.rados.rados.0.smithi084.stdout:2041: writing smithi084102331-10 from 5455872 to 5603328 tid 3 2024-01-13T18:07:33.686 INFO:tasks.rados.rados.0.smithi084.stdout:2042: snap_create 2024-01-13T18:07:33.686 INFO:tasks.rados.rados.0.smithi084.stdout:2041: finishing write tid 1 to smithi084102331-10 2024-01-13T18:07:33.689 INFO:tasks.rados.rados.0.smithi084.stdout:2041: finishing write tid 2 to smithi084102331-10 2024-01-13T18:07:33.689 INFO:tasks.rados.rados.0.smithi084.stdout:2041: finishing write tid 3 to smithi084102331-10 2024-01-13T18:07:33.689 INFO:tasks.rados.rados.0.smithi084.stdout:2041: finishing write tid 4 to smithi084102331-10 2024-01-13T18:07:33.690 INFO:tasks.rados.rados.0.smithi084.stdout:2041: finishing write tid 5 to smithi084102331-10 2024-01-13T18:07:33.690 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 888 (ObjNum 646 snap 203 seq_num 646) dirty exists 2024-01-13T18:07:33.690 INFO:tasks.rados.rados.0.smithi084.stdout:2041: left oid 10 (ObjNum 646 snap 203 seq_num 646) 2024-01-13T18:07:34.659 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:34 smithi099 systemd[1]: Stopping Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:34.662 INFO:tasks.rados.rados.0.smithi084.stdout:2041: done (1 left) 2024-01-13T18:07:34.662 INFO:tasks.rados.rados.0.smithi084.stdout:2042: done (0 left) 2024-01-13T18:07:34.662 INFO:tasks.rados.rados.0.smithi084.stdout:2043: rollback oid 27 current snap is 204 2024-01-13T18:07:34.662 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 202 2024-01-13T18:07:34.662 INFO:tasks.rados.rados.0.smithi084.stdout:2044: delete oid 39 current snap is 204 2024-01-13T18:07:34.664 INFO:tasks.rados.rados.0.smithi084.stdout:2044: done (1 left) 2024-01-13T18:07:34.665 INFO:tasks.rados.rados.0.smithi084.stdout:2045: rollback oid 5 current snap is 204 2024-01-13T18:07:34.665 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 201 2024-01-13T18:07:34.665 INFO:tasks.rados.rados.0.smithi084.stdout:2046: copy_from oid 6 from oid 24 current snap is 204 2024-01-13T18:07:34.665 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 204 2024-01-13T18:07:34.665 INFO:tasks.rados.rados.0.smithi084.stdout:2047: seq_num 648 ranges {1196032=458752,1654784=475136,2129920=327680} 2024-01-13T18:07:34.674 INFO:tasks.rados.rados.0.smithi084.stdout:2047: writing smithi084102331-17 from 1196032 to 1654784 tid 1 2024-01-13T18:07:34.677 INFO:tasks.rados.rados.0.smithi084.stdout:2047: writing smithi084102331-17 from 1654784 to 2129920 tid 2 2024-01-13T18:07:34.679 INFO:tasks.rados.rados.0.smithi084.stdout:2047: writing smithi084102331-17 from 2129920 to 2457600 tid 3 2024-01-13T18:07:34.679 INFO:tasks.rados.rados.0.smithi084.stdout:2048: snap_create 2024-01-13T18:07:34.679 INFO:tasks.rados.rados.0.smithi084.stdout:2043: finishing rollback tid 0 to smithi084102331-27 2024-01-13T18:07:34.679 INFO:tasks.rados.rados.0.smithi084.stdout:2045: finishing rollback tid 0 to smithi084102331-5 2024-01-13T18:07:34.679 INFO:tasks.rados.rados.0.smithi084.stdout:2043: finishing rollback tid 1 to smithi084102331-27 2024-01-13T18:07:34.679 INFO:tasks.rados.rados.0.smithi084.stdout:2045: finishing rollback tid 1 to smithi084102331-5 2024-01-13T18:07:34.679 INFO:tasks.rados.rados.0.smithi084.stdout:2043: finishing rollback tid 2 to smithi084102331-27 2024-01-13T18:07:34.679 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 601 (ObjNum 209 snap 0 seq_num 4037759264) dirty exists 2024-01-13T18:07:34.680 INFO:tasks.rados.rados.0.smithi084.stdout:2045: finishing rollback tid 2 to smithi084102331-5 2024-01-13T18:07:34.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 734 (ObjNum 456 snap 142 seq_num 456) dirty exists 2024-01-13T18:07:34.680 INFO:tasks.rados.rados.0.smithi084.stdout:2046: finishing copy_from to smithi084102331-6 2024-01-13T18:07:34.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 611 (ObjNum 640 snap 199 seq_num 640) dirty exists 2024-01-13T18:07:34.680 INFO:tasks.rados.rados.0.smithi084.stdout:2046: finishing copy_from racing read to smithi084102331-6 2024-01-13T18:07:34.680 INFO:tasks.rados.rados.0.smithi084.stdout:2047: finishing write tid 1 to smithi084102331-17 2024-01-13T18:07:34.681 INFO:tasks.rados.rados.0.smithi084.stdout:2047: finishing write tid 2 to smithi084102331-17 2024-01-13T18:07:34.681 INFO:tasks.rados.rados.0.smithi084.stdout:2047: finishing write tid 3 to smithi084102331-17 2024-01-13T18:07:34.681 INFO:tasks.rados.rados.0.smithi084.stdout:2047: finishing write tid 4 to smithi084102331-17 2024-01-13T18:07:34.682 INFO:tasks.rados.rados.0.smithi084.stdout:2047: finishing write tid 5 to smithi084102331-17 2024-01-13T18:07:34.682 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 739 (ObjNum 648 snap 204 seq_num 648) dirty exists 2024-01-13T18:07:34.682 INFO:tasks.rados.rados.0.smithi084.stdout:2047: left oid 17 (ObjNum 648 snap 204 seq_num 648) 2024-01-13T18:07:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:34 smithi084 ceph-mon[116404]: osdmap e473: 8 total, 8 up, 8 in 2024-01-13T18:07:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:34 smithi084 ceph-mon[116404]: pgmap v421: 121 pgs: 121 active+clean; 229 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 3.3 MiB/s wr, 19 op/s 2024-01-13T18:07:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:34 smithi084 ceph-mon[116404]: Upgrade: Updating node-exporter.b (2/2) 2024-01-13T18:07:34.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:34 smithi084 ceph-mon[116404]: Deploying daemon node-exporter.b on smithi099 2024-01-13T18:07:34.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:34 smithi084 ceph-mon[119097]: osdmap e473: 8 total, 8 up, 8 in 2024-01-13T18:07:34.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:34 smithi084 ceph-mon[119097]: pgmap v421: 121 pgs: 121 active+clean; 229 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 3.3 MiB/s wr, 19 op/s 2024-01-13T18:07:34.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:34 smithi084 ceph-mon[119097]: Upgrade: Updating node-exporter.b (2/2) 2024-01-13T18:07:34.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:34 smithi084 ceph-mon[119097]: Deploying daemon node-exporter.b on smithi099 2024-01-13T18:07:34.977 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:34 smithi099 bash[174364]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b 2024-01-13T18:07:34.977 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:34 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-01-13T18:07:34.977 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:34 smithi099 ceph-mon[138788]: osdmap e473: 8 total, 8 up, 8 in 2024-01-13T18:07:34.977 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:34 smithi099 ceph-mon[138788]: pgmap v421: 121 pgs: 121 active+clean; 229 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 3.3 MiB/s wr, 19 op/s 2024-01-13T18:07:34.977 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:34 smithi099 ceph-mon[138788]: Upgrade: Updating node-exporter.b (2/2) 2024-01-13T18:07:34.978 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:34 smithi099 ceph-mon[138788]: Deploying daemon node-exporter.b on smithi099 2024-01-13T18:07:35.369 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-13T18:07:35.369 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 systemd[1]: Stopped Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:35.369 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 systemd[1]: Starting Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:35.671 INFO:tasks.rados.rados.0.smithi084.stdout:2043: done (4 left) 2024-01-13T18:07:35.671 INFO:tasks.rados.rados.0.smithi084.stdout:2045: done (3 left) 2024-01-13T18:07:35.671 INFO:tasks.rados.rados.0.smithi084.stdout:2046: done (2 left) 2024-01-13T18:07:35.672 INFO:tasks.rados.rados.0.smithi084.stdout:2047: done (1 left) 2024-01-13T18:07:35.672 INFO:tasks.rados.rados.0.smithi084.stdout:2048: done (0 left) 2024-01-13T18:07:35.672 INFO:tasks.rados.rados.0.smithi084.stdout:2049: snap_remove snap 195 2024-01-13T18:07:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-mon[138788]: osdmap e474: 8 total, 8 up, 8 in 2024-01-13T18:07:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:35.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.525Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-01-13T18:07:35.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.525Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-01-13T18:07:35.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.525Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-01-13T18:07:35.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.525Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-01-13T18:07:35.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-01-13T18:07:35.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-01-13T18:07:35.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-01-13T18:07:35.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=arp 2024-01-13T18:07:35.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=bcache 2024-01-13T18:07:35.870 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=bonding 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=btrfs 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=conntrack 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=cpu 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=diskstats 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=dmi 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=edac 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=entropy 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=filefd 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=filesystem 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=hwmon 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=infiniband 2024-01-13T18:07:35.871 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=ipvs 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=loadavg 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=mdadm 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=meminfo 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=netclass 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=netdev 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=netstat 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=nfs 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=nfsd 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=nvme 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=os 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=pressure 2024-01-13T18:07:35.872 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=rapl 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=schedstat 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=selinux 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=sockstat 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=softnet 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=stat 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=tapestats 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=textfile 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=time 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=uname 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=vmstat 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=xfs 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.526Z caller=node_exporter.go:117 level=info collector=zfs 2024-01-13T18:07:35.873 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.527Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-01-13T18:07:35.874 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b[174527]: ts=2024-01-13T18:07:35.527Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-01-13T18:07:35.874 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 bash[174512]: de648a983ac9fed2b9cd7ee75c3c43282bcbb9170d2475042e306e1aeb43a23b 2024-01-13T18:07:35.874 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 18:07:35 smithi099 systemd[1]: Started Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:35.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:35 smithi084 ceph-mon[119097]: osdmap e474: 8 total, 8 up, 8 in 2024-01-13T18:07:35.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:35.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:35 smithi084 ceph-mon[116404]: osdmap e474: 8 total, 8 up, 8 in 2024-01-13T18:07:35.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:35.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:35.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:35.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:36.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:36 smithi084 ceph-mon[119097]: osdmap e475: 8 total, 8 up, 8 in 2024-01-13T18:07:36.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:36 smithi084 ceph-mon[119097]: pgmap v424: 121 pgs: 121 active+clean; 225 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 264 B/s rd, 298 KiB/s wr, 1 op/s 2024-01-13T18:07:36.683 INFO:tasks.rados.rados.0.smithi084.stdout:2049: done (0 left) 2024-01-13T18:07:36.683 INFO:tasks.rados.rados.0.smithi084.stdout:2050: read oid 42 snap 198 2024-01-13T18:07:36.683 INFO:tasks.rados.rados.0.smithi084.stdout:2050: expect (ObjNum 611 snap 193 seq_num 611) 2024-01-13T18:07:36.687 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 205 2024-01-13T18:07:36.688 INFO:tasks.rados.rados.0.smithi084.stdout:2051: seq_num 649 ranges {0=475136,475136=761856,1236992=40960} 2024-01-13T18:07:36.688 INFO:tasks.rados.rados.0.smithi084.stdout:2051: writing smithi084102331-33 from 0 to 475136 tid 1 2024-01-13T18:07:36.691 INFO:tasks.rados.rados.0.smithi084.stdout:2051: writing smithi084102331-33 from 475136 to 1236992 tid 2 2024-01-13T18:07:36.691 INFO:tasks.rados.rados.0.smithi084.stdout:2051: writing smithi084102331-33 from 1236992 to 1277952 tid 3 2024-01-13T18:07:36.691 INFO:tasks.rados.rados.0.smithi084.stdout:2052: delete oid 6 current snap is 205 2024-01-13T18:07:36.697 INFO:tasks.rados.rados.0.smithi084.stdout:2051: finishing write tid 1 to smithi084102331-33 2024-01-13T18:07:36.699 INFO:tasks.rados.rados.0.smithi084.stdout:2050: expect (ObjNum 611 snap 193 seq_num 611) 2024-01-13T18:07:36.719 INFO:tasks.rados.rados.0.smithi084.stdout:2051: finishing write tid 2 to smithi084102331-33 2024-01-13T18:07:36.719 INFO:tasks.rados.rados.0.smithi084.stdout:2051: finishing write tid 3 to smithi084102331-33 2024-01-13T18:07:36.719 INFO:tasks.rados.rados.0.smithi084.stdout:2051: finishing write tid 4 to smithi084102331-33 2024-01-13T18:07:36.719 INFO:tasks.rados.rados.0.smithi084.stdout:2051: finishing write tid 5 to smithi084102331-33 2024-01-13T18:07:36.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 968 (ObjNum 649 snap 205 seq_num 649) dirty exists 2024-01-13T18:07:36.719 INFO:tasks.rados.rados.0.smithi084.stdout:2051: left oid 33 (ObjNum 649 snap 205 seq_num 649) 2024-01-13T18:07:36.719 INFO:tasks.rados.rados.0.smithi084.stdout:2050: done (2 left) 2024-01-13T18:07:36.719 INFO:tasks.rados.rados.0.smithi084.stdout:2051: done (1 left) 2024-01-13T18:07:36.719 INFO:tasks.rados.rados.0.smithi084.stdout:2052: done (0 left) 2024-01-13T18:07:36.720 INFO:tasks.rados.rados.0.smithi084.stdout:2053: read oid 39 snap -1 2024-01-13T18:07:36.720 INFO:tasks.rados.rados.0.smithi084.stdout:2053: expect deleted 2024-01-13T18:07:36.720 INFO:tasks.rados.rados.0.smithi084.stdout:2054: read oid 27 snap -1 2024-01-13T18:07:36.720 INFO:tasks.rados.rados.0.smithi084.stdout:2054: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:36.720 INFO:tasks.rados.rados.0.smithi084.stdout:2055: snap_remove snap 187 2024-01-13T18:07:36.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:36 smithi084 ceph-mon[116404]: osdmap e475: 8 total, 8 up, 8 in 2024-01-13T18:07:36.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:36 smithi084 ceph-mon[116404]: pgmap v424: 121 pgs: 121 active+clean; 225 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 264 B/s rd, 298 KiB/s wr, 1 op/s 2024-01-13T18:07:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:36 smithi099 ceph-mon[138788]: osdmap e475: 8 total, 8 up, 8 in 2024-01-13T18:07:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:36 smithi099 ceph-mon[138788]: pgmap v424: 121 pgs: 121 active+clean; 225 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 264 B/s rd, 298 KiB/s wr, 1 op/s 2024-01-13T18:07:37.650 INFO:tasks.rados.rados.0.smithi084.stdout:2055: done (2 left) 2024-01-13T18:07:37.650 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 205 2024-01-13T18:07:37.650 INFO:tasks.rados.rados.0.smithi084.stdout:2056: seq_num 651 ranges {0=507904,507904=532480,1040384=270336} 2024-01-13T18:07:37.651 INFO:tasks.rados.rados.0.smithi084.stdout:2056: writing smithi084102331-9 from 0 to 507904 tid 1 2024-01-13T18:07:37.654 INFO:tasks.rados.rados.0.smithi084.stdout:2056: writing smithi084102331-9 from 507904 to 1040384 tid 2 2024-01-13T18:07:37.656 INFO:tasks.rados.rados.0.smithi084.stdout:2056: writing smithi084102331-9 from 1040384 to 1310720 tid 3 2024-01-13T18:07:37.656 INFO:tasks.rados.rados.0.smithi084.stdout:2057: snap_remove snap 202 2024-01-13T18:07:37.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:37 smithi084 ceph-mon[119097]: osdmap e476: 8 total, 8 up, 8 in 2024-01-13T18:07:37.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:37.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:37.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:37 smithi084 ceph-mon[119097]: osdmap e477: 8 total, 8 up, 8 in 2024-01-13T18:07:37.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:37 smithi084 ceph-mon[116404]: osdmap e476: 8 total, 8 up, 8 in 2024-01-13T18:07:37.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:37.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:37.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:37 smithi084 ceph-mon[116404]: osdmap e477: 8 total, 8 up, 8 in 2024-01-13T18:07:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:37 smithi099 ceph-mon[138788]: osdmap e476: 8 total, 8 up, 8 in 2024-01-13T18:07:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:37 smithi099 ceph-mon[138788]: osdmap e477: 8 total, 8 up, 8 in 2024-01-13T18:07:38.652 INFO:tasks.rados.rados.0.smithi084.stdout:2057: done (3 left) 2024-01-13T18:07:38.652 INFO:tasks.rados.rados.0.smithi084.stdout:2058: delete oid 10 current snap is 205 2024-01-13T18:07:38.652 INFO:tasks.rados.rados.0.smithi084.stdout:2054: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:38.655 INFO:tasks.rados.rados.0.smithi084.stdout:2056: finishing write tid 1 to smithi084102331-9 2024-01-13T18:07:38.655 INFO:tasks.rados.rados.0.smithi084.stdout:2056: finishing write tid 2 to smithi084102331-9 2024-01-13T18:07:38.655 INFO:tasks.rados.rados.0.smithi084.stdout:2056: finishing write tid 3 to smithi084102331-9 2024-01-13T18:07:38.655 INFO:tasks.rados.rados.0.smithi084.stdout:2056: finishing write tid 4 to smithi084102331-9 2024-01-13T18:07:38.655 INFO:tasks.rados.rados.0.smithi084.stdout:2056: finishing write tid 5 to smithi084102331-9 2024-01-13T18:07:38.656 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 616 (ObjNum 651 snap 205 seq_num 651) dirty exists 2024-01-13T18:07:38.656 INFO:tasks.rados.rados.0.smithi084.stdout:2056: left oid 9 (ObjNum 651 snap 205 seq_num 651) 2024-01-13T18:07:38.658 INFO:tasks.rados.rados.0.smithi084.stdout:2053: done (3 left) 2024-01-13T18:07:38.658 INFO:tasks.rados.rados.0.smithi084.stdout:2054: done (2 left) 2024-01-13T18:07:38.658 INFO:tasks.rados.rados.0.smithi084.stdout:2056: done (1 left) 2024-01-13T18:07:38.658 INFO:tasks.rados.rados.0.smithi084.stdout:2058: done (0 left) 2024-01-13T18:07:38.658 INFO:tasks.rados.rados.0.smithi084.stdout:2059: snap_create 2024-01-13T18:07:38.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[116404]: pgmap v427: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 203 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 469 KiB/s rd, 876 KiB/s wr, 5 op/s 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[116404]: osdmap e478: 8 total, 8 up, 8 in 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[119097]: pgmap v427: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 203 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 469 KiB/s rd, 876 KiB/s wr, 5 op/s 2024-01-13T18:07:38.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:38.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:38 smithi084 ceph-mon[119097]: osdmap e478: 8 total, 8 up, 8 in 2024-01-13T18:07:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:38 smithi099 ceph-mon[138788]: pgmap v427: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 203 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 469 KiB/s rd, 876 KiB/s wr, 5 op/s 2024-01-13T18:07:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:39.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:39.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:38 smithi099 ceph-mon[138788]: osdmap e478: 8 total, 8 up, 8 in 2024-01-13T18:07:39.653 INFO:tasks.rados.rados.0.smithi084.stdout:2059: done (0 left) 2024-01-13T18:07:39.653 INFO:tasks.rados.rados.0.smithi084.stdout:2060: read oid 15 snap 197 2024-01-13T18:07:39.653 INFO:tasks.rados.rados.0.smithi084.stdout:2060: expect (ObjNum 626 snap 197 seq_num 626) 2024-01-13T18:07:39.653 INFO:tasks.rados.rados.0.smithi084.stdout:2061: setattr oid 3 current snap is 206 2024-01-13T18:07:39.653 INFO:tasks.rados.rados.0.smithi084.stdout:2062: snap_remove snap 201 2024-01-13T18:07:40.655 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:07:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:07:40] "GET /metrics HTTP/1.1" 200 36196 "" "Prometheus/2.43.0" 2024-01-13T18:07:40.659 INFO:tasks.rados.rados.0.smithi084.stdout:2062: done (2 left) 2024-01-13T18:07:40.659 INFO:tasks.rados.rados.0.smithi084.stdout:2063: read oid 42 snap 197 2024-01-13T18:07:40.659 INFO:tasks.rados.rados.0.smithi084.stdout:2063: expect (ObjNum 611 snap 193 seq_num 611) 2024-01-13T18:07:40.659 INFO:tasks.rados.rados.0.smithi084.stdout:2064: read oid 23 snap 186 2024-01-13T18:07:40.659 INFO:tasks.rados.rados.0.smithi084.stdout:2064: expect deleted 2024-01-13T18:07:40.660 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 206 2024-01-13T18:07:40.660 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1193 (ObjNum 49 snap 0 seq_num 1953066355) dirty exists 2024-01-13T18:07:40.660 INFO:tasks.rados.rados.0.smithi084.stdout:2065: seq_num 653 ranges {2260992=540672,2801664=696320,3497984=106496} 2024-01-13T18:07:40.675 INFO:tasks.rados.rados.0.smithi084.stdout:2065: writing smithi084102331-26 from 2260992 to 2801664 tid 1 2024-01-13T18:07:40.679 INFO:tasks.rados.rados.0.smithi084.stdout:2065: writing smithi084102331-26 from 2801664 to 3497984 tid 2 2024-01-13T18:07:40.680 INFO:tasks.rados.rados.0.smithi084.stdout:2065: writing smithi084102331-26 from 3497984 to 3604480 tid 3 2024-01-13T18:07:40.680 INFO:tasks.rados.rados.0.smithi084.stdout:2061: done (4 left) 2024-01-13T18:07:40.680 INFO:tasks.rados.rados.0.smithi084.stdout:2066: delete oid 2 current snap is 206 2024-01-13T18:07:40.680 INFO:tasks.rados.rados.0.smithi084.stdout:2060: expect (ObjNum 626 snap 197 seq_num 626) 2024-01-13T18:07:40.704 INFO:tasks.rados.rados.0.smithi084.stdout:2063: expect (ObjNum 611 snap 193 seq_num 611) 2024-01-13T18:07:40.720 INFO:tasks.rados.rados.0.smithi084.stdout:2065: finishing write tid 1 to smithi084102331-26 2024-01-13T18:07:40.720 INFO:tasks.rados.rados.0.smithi084.stdout:2065: finishing write tid 2 to smithi084102331-26 2024-01-13T18:07:40.720 INFO:tasks.rados.rados.0.smithi084.stdout:2065: finishing write tid 3 to smithi084102331-26 2024-01-13T18:07:40.720 INFO:tasks.rados.rados.0.smithi084.stdout:2065: finishing write tid 4 to smithi084102331-26 2024-01-13T18:07:40.720 INFO:tasks.rados.rados.0.smithi084.stdout:2060: done (4 left) 2024-01-13T18:07:40.720 INFO:tasks.rados.rados.0.smithi084.stdout:2063: done (3 left) 2024-01-13T18:07:40.720 INFO:tasks.rados.rados.0.smithi084.stdout:2064: done (2 left) 2024-01-13T18:07:40.720 INFO:tasks.rados.rados.0.smithi084.stdout:2066: done (1 left) 2024-01-13T18:07:40.720 INFO:tasks.rados.rados.0.smithi084.stdout:2067: setattr oid 3 current snap is 206 2024-01-13T18:07:40.720 INFO:tasks.rados.rados.0.smithi084.stdout:2065: finishing write tid 5 to smithi084102331-26 2024-01-13T18:07:40.721 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1079 (ObjNum 653 snap 206 seq_num 653) dirty exists 2024-01-13T18:07:40.721 INFO:tasks.rados.rados.0.smithi084.stdout:2065: left oid 26 (ObjNum 653 snap 206 seq_num 653) 2024-01-13T18:07:40.721 INFO:tasks.rados.rados.0.smithi084.stdout:2065: done (1 left) 2024-01-13T18:07:40.721 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 206 2024-01-13T18:07:40.721 INFO:tasks.rados.rados.0.smithi084.stdout:2068: seq_num 655 ranges {0=573440,573440=516096,1089536=286720} 2024-01-13T18:07:40.724 INFO:tasks.rados.rados.0.smithi084.stdout:2068: writing smithi084102331-40 from 0 to 573440 tid 1 2024-01-13T18:07:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:2068: writing smithi084102331-40 from 573440 to 1089536 tid 2 2024-01-13T18:07:40.729 INFO:tasks.rados.rados.0.smithi084.stdout:2068: writing smithi084102331-40 from 1089536 to 1376256 tid 3 2024-01-13T18:07:40.729 INFO:tasks.rados.rados.0.smithi084.stdout:2069: rollback oid 26 current snap is 206 2024-01-13T18:07:40.729 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 198 2024-01-13T18:07:40.729 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1194 (ObjNum 49 snap 0 seq_num 1953066355) dirty exists 2024-01-13T18:07:40.729 INFO:tasks.rados.rados.0.smithi084.stdout:2068: finishing write tid 1 to smithi084102331-40 2024-01-13T18:07:40.729 INFO:tasks.rados.rados.0.smithi084.stdout:2067: done (2 left) 2024-01-13T18:07:40.729 INFO:tasks.rados.rados.0.smithi084.stdout:2070: copy_from oid 14 from oid 24 current snap is 206 2024-01-13T18:07:40.730 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 206 2024-01-13T18:07:40.731 INFO:tasks.rados.rados.0.smithi084.stdout:2071: seq_num 656 ranges {4628480=589824,5218304=802816} 2024-01-13T18:07:40.757 INFO:tasks.rados.rados.0.smithi084.stdout:2071: writing smithi084102331-42 from 4628480 to 5218304 tid 1 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:2071: writing smithi084102331-42 from 5218304 to 6021120 tid 2 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:2072: delete oid 4 current snap is 206 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:2068: finishing write tid 2 to smithi084102331-40 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:2068: finishing write tid 3 to smithi084102331-40 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:2068: finishing write tid 4 to smithi084102331-40 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:2069: finishing rollback tid 0 to smithi084102331-26 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:2069: finishing rollback tid 1 to smithi084102331-26 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:2069: finishing rollback tid 2 to smithi084102331-26 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1082 (ObjNum 564 snap 180 seq_num 564) dirty exists 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:2068: finishing write tid 5 to smithi084102331-40 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 730 (ObjNum 655 snap 206 seq_num 655) dirty exists 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:2068: left oid 40 (ObjNum 655 snap 206 seq_num 655) 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:2070: finishing copy_from to smithi084102331-14 2024-01-13T18:07:40.763 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 611 (ObjNum 640 snap 199 seq_num 640) dirty exists 2024-01-13T18:07:40.764 INFO:tasks.rados.rados.0.smithi084.stdout:2070: finishing copy_from racing read to smithi084102331-14 2024-01-13T18:07:40.764 INFO:tasks.rados.rados.0.smithi084.stdout:2071: finishing write tid 1 to smithi084102331-42 2024-01-13T18:07:40.764 INFO:tasks.rados.rados.0.smithi084.stdout:2068: done (4 left) 2024-01-13T18:07:40.765 INFO:tasks.rados.rados.0.smithi084.stdout:2069: done (3 left) 2024-01-13T18:07:40.765 INFO:tasks.rados.rados.0.smithi084.stdout:2070: done (2 left) 2024-01-13T18:07:40.765 INFO:tasks.rados.rados.0.smithi084.stdout:2072: done (1 left) 2024-01-13T18:07:40.765 INFO:tasks.rados.rados.0.smithi084.stdout:2073: read oid 26 snap -1 2024-01-13T18:07:40.765 INFO:tasks.rados.rados.0.smithi084.stdout:2073: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:40.765 INFO:tasks.rados.rados.0.smithi084.stdout:2074: read oid 29 snap -1 2024-01-13T18:07:40.765 INFO:tasks.rados.rados.0.smithi084.stdout:2074: expect (ObjNum 636 snap 199 seq_num 636) 2024-01-13T18:07:40.765 INFO:tasks.rados.rados.0.smithi084.stdout:2075: snap_create 2024-01-13T18:07:40.765 INFO:tasks.rados.rados.0.smithi084.stdout:2071: finishing write tid 2 to smithi084102331-42 2024-01-13T18:07:40.766 INFO:tasks.rados.rados.0.smithi084.stdout:2071: finishing write tid 3 to smithi084102331-42 2024-01-13T18:07:40.767 INFO:tasks.rados.rados.0.smithi084.stdout:2071: finishing write tid 4 to smithi084102331-42 2024-01-13T18:07:40.767 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 890 (ObjNum 656 snap 206 seq_num 656) dirty exists 2024-01-13T18:07:40.768 INFO:tasks.rados.rados.0.smithi084.stdout:2071: left oid 42 (ObjNum 656 snap 206 seq_num 656) 2024-01-13T18:07:40.772 INFO:tasks.rados.rados.0.smithi084.stdout:2073: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:40.828 INFO:tasks.rados.rados.0.smithi084.stdout:2074: expect (ObjNum 636 snap 199 seq_num 636) 2024-01-13T18:07:40.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:40 smithi084 ceph-mon[116404]: osdmap e479: 8 total, 8 up, 8 in 2024-01-13T18:07:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:40 smithi084 ceph-mon[116404]: pgmap v430: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 205 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 469 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-01-13T18:07:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:40.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:40 smithi084 ceph-mon[119097]: osdmap e479: 8 total, 8 up, 8 in 2024-01-13T18:07:40.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:40 smithi084 ceph-mon[119097]: pgmap v430: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 205 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 469 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-01-13T18:07:40.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:40.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.000 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:40 smithi099 ceph-mon[138788]: osdmap e479: 8 total, 8 up, 8 in 2024-01-13T18:07:41.001 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:40 smithi099 ceph-mon[138788]: pgmap v430: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 205 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 469 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-01-13T18:07:41.001 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.001 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.662 INFO:tasks.rados.rados.0.smithi084.stdout:2071: done (3 left) 2024-01-13T18:07:41.663 INFO:tasks.rados.rados.0.smithi084.stdout:2073: done (2 left) 2024-01-13T18:07:41.663 INFO:tasks.rados.rados.0.smithi084.stdout:2074: done (1 left) 2024-01-13T18:07:41.663 INFO:tasks.rados.rados.0.smithi084.stdout:2075: done (0 left) 2024-01-13T18:07:41.663 INFO:tasks.rados.rados.0.smithi084.stdout:2076: read oid 48 snap -1 2024-01-13T18:07:41.663 INFO:tasks.rados.rados.0.smithi084.stdout:2076: expect (ObjNum 535 snap 173 seq_num 535) 2024-01-13T18:07:41.663 INFO:tasks.rados.rados.0.smithi084.stdout:2077: copy_from oid 1 from oid 22 current snap is 207 2024-01-13T18:07:41.663 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 207 2024-01-13T18:07:41.663 INFO:tasks.rados.rados.0.smithi084.stdout:2078: seq_num 658 ranges {3465216=622592,4087808=565248,4653056=237568} 2024-01-13T18:07:41.685 INFO:tasks.rados.rados.0.smithi084.stdout:2078: writing smithi084102331-5 from 3465216 to 4087808 tid 1 2024-01-13T18:07:41.688 INFO:tasks.rados.rados.0.smithi084.stdout:2078: writing smithi084102331-5 from 4087808 to 4653056 tid 2 2024-01-13T18:07:41.690 INFO:tasks.rados.rados.0.smithi084.stdout:2078: writing smithi084102331-5 from 4653056 to 4890624 tid 3 2024-01-13T18:07:41.690 INFO:tasks.rados.rados.0.smithi084.stdout:2079: read oid 3 snap -1 2024-01-13T18:07:41.690 INFO:tasks.rados.rados.0.smithi084.stdout:2079: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:41.690 INFO:tasks.rados.rados.0.smithi084.stdout:2080: setattr oid 23 current snap is 207 2024-01-13T18:07:41.690 INFO:tasks.rados.rados.0.smithi084.stdout:2077: finishing copy_from to smithi084102331-1 2024-01-13T18:07:41.691 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1092 (ObjNum 33 snap 0 seq_num 4036969536) dirty exists 2024-01-13T18:07:41.691 INFO:tasks.rados.rados.0.smithi084.stdout:2077: finishing copy_from racing read to smithi084102331-1 2024-01-13T18:07:41.691 INFO:tasks.rados.rados.0.smithi084.stdout:2079: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:41.697 INFO:tasks.rados.rados.0.smithi084.stdout:2078: finishing write tid 1 to smithi084102331-5 2024-01-13T18:07:41.697 INFO:tasks.rados.rados.0.smithi084.stdout:2078: finishing write tid 2 to smithi084102331-5 2024-01-13T18:07:41.697 INFO:tasks.rados.rados.0.smithi084.stdout:2078: finishing write tid 3 to smithi084102331-5 2024-01-13T18:07:41.697 INFO:tasks.rados.rados.0.smithi084.stdout:2078: finishing write tid 4 to smithi084102331-5 2024-01-13T18:07:41.697 INFO:tasks.rados.rados.0.smithi084.stdout:2078: finishing write tid 5 to smithi084102331-5 2024-01-13T18:07:41.697 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 758 (ObjNum 658 snap 207 seq_num 658) dirty exists 2024-01-13T18:07:41.697 INFO:tasks.rados.rados.0.smithi084.stdout:2078: left oid 5 (ObjNum 658 snap 207 seq_num 658) 2024-01-13T18:07:41.697 INFO:tasks.rados.rados.0.smithi084.stdout:2077: done (4 left) 2024-01-13T18:07:41.697 INFO:tasks.rados.rados.0.smithi084.stdout:2078: done (3 left) 2024-01-13T18:07:41.697 INFO:tasks.rados.rados.0.smithi084.stdout:2079: done (2 left) 2024-01-13T18:07:41.698 INFO:tasks.rados.rados.0.smithi084.stdout:2081: rollback oid 5 current snap is 207 2024-01-13T18:07:41.698 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 200 2024-01-13T18:07:41.698 INFO:tasks.rados.rados.0.smithi084.stdout:2082: snap_remove snap 204 2024-01-13T18:07:41.923 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: osdmap e480: 8 total, 8 up, 8 in 2024-01-13T18:07:41.923 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.923 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.925 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.925 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:41 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: osdmap e480: 8 total, 8 up, 8 in 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: osdmap e480: 8 total, 8 up, 8 in 2024-01-13T18:07:41.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:41.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:41.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:41 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:42.654 INFO:tasks.rados.rados.0.smithi084.stdout:2082: done (3 left) 2024-01-13T18:07:42.654 INFO:tasks.rados.rados.0.smithi084.stdout:2083: copy_from oid 8 from oid 6 current snap is 207 2024-01-13T18:07:42.654 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 207 2024-01-13T18:07:42.654 INFO:tasks.rados.rados.0.smithi084.stdout:2084: seq_num 659 ranges {0=647168,647168=450560,1097728=352256} 2024-01-13T18:07:42.654 INFO:tasks.rados.rados.0.smithi084.stdout:2084: writing smithi084102331-10 from 0 to 647168 tid 1 2024-01-13T18:07:42.655 INFO:tasks.rados.rados.0.smithi084.stdout:2084: writing smithi084102331-10 from 647168 to 1097728 tid 2 2024-01-13T18:07:42.658 INFO:tasks.rados.rados.0.smithi084.stdout:2084: writing smithi084102331-10 from 1097728 to 1449984 tid 3 2024-01-13T18:07:42.658 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 207 2024-01-13T18:07:42.658 INFO:tasks.rados.rados.0.smithi084.stdout:2081: finishing rollback tid 0 to smithi084102331-5 2024-01-13T18:07:42.658 INFO:tasks.rados.rados.0.smithi084.stdout:2081: finishing rollback tid 1 to smithi084102331-5 2024-01-13T18:07:42.658 INFO:tasks.rados.rados.0.smithi084.stdout:2081: finishing rollback tid 2 to smithi084102331-5 2024-01-13T18:07:42.659 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 761 (ObjNum 456 snap 142 seq_num 456) dirty exists 2024-01-13T18:07:42.659 INFO:tasks.rados.rados.0.smithi084.stdout:2076: expect (ObjNum 535 snap 173 seq_num 535) 2024-01-13T18:07:42.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:42 smithi084 ceph-mon[116404]: osdmap e481: 8 total, 8 up, 8 in 2024-01-13T18:07:42.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:42 smithi084 ceph-mon[116404]: pgmap v433: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 206 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 23 op/s 2024-01-13T18:07:42.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:42 smithi084 ceph-mon[116404]: osdmap e482: 8 total, 8 up, 8 in 2024-01-13T18:07:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:42 smithi084 ceph-mon[119097]: osdmap e481: 8 total, 8 up, 8 in 2024-01-13T18:07:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:42 smithi084 ceph-mon[119097]: pgmap v433: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 206 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 23 op/s 2024-01-13T18:07:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:42 smithi084 ceph-mon[119097]: osdmap e482: 8 total, 8 up, 8 in 2024-01-13T18:07:42.935 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:42 smithi099 ceph-mon[138788]: osdmap e481: 8 total, 8 up, 8 in 2024-01-13T18:07:42.935 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:42 smithi099 ceph-mon[138788]: pgmap v433: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 206 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 23 op/s 2024-01-13T18:07:42.935 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:42 smithi099 ceph-mon[138788]: osdmap e482: 8 total, 8 up, 8 in 2024-01-13T18:07:43.082 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1094 (ObjNum 634 snap 199 seq_num 634) dirty exists 2024-01-13T18:07:43.082 INFO:tasks.rados.rados.0.smithi084.stdout:2083: finishing copy_from to smithi084102331-8 2024-01-13T18:07:43.082 INFO:tasks.rados.rados.0.smithi084.stdout:2083: got expected ENOENT (src dne) 2024-01-13T18:07:43.082 INFO:tasks.rados.rados.0.smithi084.stdout:2083: finishing copy_from racing read to smithi084102331-8 2024-01-13T18:07:43.083 INFO:tasks.rados.rados.0.smithi084.stdout:2085: seq_num 660 ranges {2834432=663552,3497984=737280,4235264=65536} 2024-01-13T18:07:43.100 INFO:tasks.rados.rados.0.smithi084.stdout:2085: writing smithi084102331-49 from 2834432 to 3497984 tid 1 2024-01-13T18:07:43.104 INFO:tasks.rados.rados.0.smithi084.stdout:2085: writing smithi084102331-49 from 3497984 to 4235264 tid 2 2024-01-13T18:07:43.105 INFO:tasks.rados.rados.0.smithi084.stdout:2085: writing smithi084102331-49 from 4235264 to 4300800 tid 3 2024-01-13T18:07:43.105 INFO:tasks.rados.rados.0.smithi084.stdout:2076: done (5 left) 2024-01-13T18:07:43.105 INFO:tasks.rados.rados.0.smithi084.stdout:2080: done (4 left) 2024-01-13T18:07:43.105 INFO:tasks.rados.rados.0.smithi084.stdout:2081: done (3 left) 2024-01-13T18:07:43.105 INFO:tasks.rados.rados.0.smithi084.stdout:2083: done (2 left) 2024-01-13T18:07:43.106 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 207 2024-01-13T18:07:43.106 INFO:tasks.rados.rados.0.smithi084.stdout:2084: finishing write tid 1 to smithi084102331-10 2024-01-13T18:07:43.106 INFO:tasks.rados.rados.0.smithi084.stdout:2084: finishing write tid 2 to smithi084102331-10 2024-01-13T18:07:43.106 INFO:tasks.rados.rados.0.smithi084.stdout:2084: finishing write tid 3 to smithi084102331-10 2024-01-13T18:07:43.106 INFO:tasks.rados.rados.0.smithi084.stdout:2084: finishing write tid 4 to smithi084102331-10 2024-01-13T18:07:43.106 INFO:tasks.rados.rados.0.smithi084.stdout:2084: finishing write tid 5 to smithi084102331-10 2024-01-13T18:07:43.106 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 893 (ObjNum 659 snap 207 seq_num 659) dirty exists 2024-01-13T18:07:43.106 INFO:tasks.rados.rados.0.smithi084.stdout:2084: left oid 10 (ObjNum 659 snap 207 seq_num 659) 2024-01-13T18:07:43.106 INFO:tasks.rados.rados.0.smithi084.stdout:2086: seq_num 661 ranges {2539520=679936,3219456=622592,3842048=180224} 2024-01-13T18:07:43.123 INFO:tasks.rados.rados.0.smithi084.stdout:2086: writing smithi084102331-41 from 2539520 to 3219456 tid 1 2024-01-13T18:07:43.126 INFO:tasks.rados.rados.0.smithi084.stdout:2086: writing smithi084102331-41 from 3219456 to 3842048 tid 2 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2086: writing smithi084102331-41 from 3842048 to 4022272 tid 3 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2084: done (2 left) 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2087: read oid 23 snap -1 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2087: expect (ObjNum 634 snap 199 seq_num 634) 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 207 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2085: finishing write tid 1 to smithi084102331-49 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2085: finishing write tid 2 to smithi084102331-49 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2085: finishing write tid 3 to smithi084102331-49 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2085: finishing write tid 4 to smithi084102331-49 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2085: finishing write tid 5 to smithi084102331-49 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1086 (ObjNum 660 snap 207 seq_num 660) dirty exists 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2085: left oid 49 (ObjNum 660 snap 207 seq_num 660) 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2086: finishing write tid 1 to smithi084102331-41 2024-01-13T18:07:43.129 INFO:tasks.rados.rados.0.smithi084.stdout:2088: seq_num 662 ranges {3891200=696320,4587520=557056,5144576=245760} 2024-01-13T18:07:43.152 INFO:tasks.rados.rados.0.smithi084.stdout:2088: writing smithi084102331-29 from 3891200 to 4587520 tid 1 2024-01-13T18:07:43.155 INFO:tasks.rados.rados.0.smithi084.stdout:2088: writing smithi084102331-29 from 4587520 to 5144576 tid 2 2024-01-13T18:07:43.157 INFO:tasks.rados.rados.0.smithi084.stdout:2088: writing smithi084102331-29 from 5144576 to 5390336 tid 3 2024-01-13T18:07:43.157 INFO:tasks.rados.rados.0.smithi084.stdout:2085: done (3 left) 2024-01-13T18:07:43.157 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 207 2024-01-13T18:07:43.157 INFO:tasks.rados.rados.0.smithi084.stdout:2086: finishing write tid 2 to smithi084102331-41 2024-01-13T18:07:43.157 INFO:tasks.rados.rados.0.smithi084.stdout:2089: seq_num 663 ranges {7340032=712704,8052736=442368,8495104=360448} 2024-01-13T18:07:43.199 INFO:tasks.rados.rados.0.smithi084.stdout:2089: writing smithi084102331-21 from 7340032 to 8052736 tid 1 2024-01-13T18:07:43.201 INFO:tasks.rados.rados.0.smithi084.stdout:2089: writing smithi084102331-21 from 8052736 to 8495104 tid 2 2024-01-13T18:07:43.203 INFO:tasks.rados.rados.0.smithi084.stdout:2089: writing smithi084102331-21 from 8495104 to 8855552 tid 3 2024-01-13T18:07:43.204 INFO:tasks.rados.rados.0.smithi084.stdout:2090: copy_from oid 5 from oid 34 current snap is 207 2024-01-13T18:07:43.204 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 207 2024-01-13T18:07:43.204 INFO:tasks.rados.rados.0.smithi084.stdout:2091: seq_num 664 ranges {5242880=729088,5971968=729088,6701056=73728} 2024-01-13T18:07:43.236 INFO:tasks.rados.rados.0.smithi084.stdout:2091: writing smithi084102331-7 from 5242880 to 5971968 tid 1 2024-01-13T18:07:43.240 INFO:tasks.rados.rados.0.smithi084.stdout:2091: writing smithi084102331-7 from 5971968 to 6701056 tid 2 2024-01-13T18:07:43.241 INFO:tasks.rados.rados.0.smithi084.stdout:2091: writing smithi084102331-7 from 6701056 to 6774784 tid 3 2024-01-13T18:07:43.241 INFO:tasks.rados.rados.0.smithi084.stdout:2092: read oid 43 snap -1 2024-01-13T18:07:43.241 INFO:tasks.rados.rados.0.smithi084.stdout:2092: expect deleted 2024-01-13T18:07:43.241 INFO:tasks.rados.rados.0.smithi084.stdout:2093: read oid 20 snap -1 2024-01-13T18:07:43.241 INFO:tasks.rados.rados.0.smithi084.stdout:2093: expect (ObjNum 638 snap 199 seq_num 638) 2024-01-13T18:07:43.242 INFO:tasks.rados.rados.0.smithi084.stdout:2094: snap_create 2024-01-13T18:07:43.242 INFO:tasks.rados.rados.0.smithi084.stdout:2086: finishing write tid 3 to smithi084102331-41 2024-01-13T18:07:43.242 INFO:tasks.rados.rados.0.smithi084.stdout:2086: finishing write tid 4 to smithi084102331-41 2024-01-13T18:07:43.242 INFO:tasks.rados.rados.0.smithi084.stdout:2086: finishing write tid 5 to smithi084102331-41 2024-01-13T18:07:43.242 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 700 (ObjNum 661 snap 207 seq_num 661) dirty exists 2024-01-13T18:07:43.242 INFO:tasks.rados.rados.0.smithi084.stdout:2086: left oid 41 (ObjNum 661 snap 207 seq_num 661) 2024-01-13T18:07:43.242 INFO:tasks.rados.rados.0.smithi084.stdout:2087: expect (ObjNum 634 snap 199 seq_num 634) 2024-01-13T18:07:43.272 INFO:tasks.rados.rados.0.smithi084.stdout:2088: finishing write tid 1 to smithi084102331-29 2024-01-13T18:07:43.272 INFO:tasks.rados.rados.0.smithi084.stdout:2088: finishing write tid 2 to smithi084102331-29 2024-01-13T18:07:43.272 INFO:tasks.rados.rados.0.smithi084.stdout:2088: finishing write tid 3 to smithi084102331-29 2024-01-13T18:07:43.272 INFO:tasks.rados.rados.0.smithi084.stdout:2088: finishing write tid 4 to smithi084102331-29 2024-01-13T18:07:43.272 INFO:tasks.rados.rados.0.smithi084.stdout:2088: finishing write tid 5 to smithi084102331-29 2024-01-13T18:07:43.272 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 735 (ObjNum 662 snap 207 seq_num 662) dirty exists 2024-01-13T18:07:43.272 INFO:tasks.rados.rados.0.smithi084.stdout:2088: left oid 29 (ObjNum 662 snap 207 seq_num 662) 2024-01-13T18:07:43.272 INFO:tasks.rados.rados.0.smithi084.stdout:2089: finishing write tid 1 to smithi084102331-21 2024-01-13T18:07:43.273 INFO:tasks.rados.rados.0.smithi084.stdout:2089: finishing write tid 2 to smithi084102331-21 2024-01-13T18:07:43.273 INFO:tasks.rados.rados.0.smithi084.stdout:2089: finishing write tid 3 to smithi084102331-21 2024-01-13T18:07:43.273 INFO:tasks.rados.rados.0.smithi084.stdout:2089: finishing write tid 4 to smithi084102331-21 2024-01-13T18:07:43.273 INFO:tasks.rados.rados.0.smithi084.stdout:2089: finishing write tid 5 to smithi084102331-21 2024-01-13T18:07:43.273 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 740 (ObjNum 663 snap 207 seq_num 663) dirty exists 2024-01-13T18:07:43.273 INFO:tasks.rados.rados.0.smithi084.stdout:2089: left oid 21 (ObjNum 663 snap 207 seq_num 663) 2024-01-13T18:07:43.273 INFO:tasks.rados.rados.0.smithi084.stdout:2090: finishing copy_from to smithi084102331-5 2024-01-13T18:07:43.273 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 577 (ObjNum 617 snap 196 seq_num 617) dirty exists 2024-01-13T18:07:43.273 INFO:tasks.rados.rados.0.smithi084.stdout:2090: finishing copy_from racing read to smithi084102331-5 2024-01-13T18:07:43.273 INFO:tasks.rados.rados.0.smithi084.stdout:2091: finishing write tid 1 to smithi084102331-7 2024-01-13T18:07:43.274 INFO:tasks.rados.rados.0.smithi084.stdout:2091: finishing write tid 2 to smithi084102331-7 2024-01-13T18:07:43.274 INFO:tasks.rados.rados.0.smithi084.stdout:2091: finishing write tid 3 to smithi084102331-7 2024-01-13T18:07:43.274 INFO:tasks.rados.rados.0.smithi084.stdout:2091: finishing write tid 4 to smithi084102331-7 2024-01-13T18:07:43.274 INFO:tasks.rados.rados.0.smithi084.stdout:2091: finishing write tid 5 to smithi084102331-7 2024-01-13T18:07:43.274 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 616 (ObjNum 664 snap 207 seq_num 664) dirty exists 2024-01-13T18:07:43.274 INFO:tasks.rados.rados.0.smithi084.stdout:2091: left oid 7 (ObjNum 664 snap 207 seq_num 664) 2024-01-13T18:07:43.274 INFO:tasks.rados.rados.0.smithi084.stdout:2093: expect (ObjNum 638 snap 199 seq_num 638) 2024-01-13T18:07:43.677 INFO:tasks.rados.rados.0.smithi084.stdout:2086: done (8 left) 2024-01-13T18:07:43.677 INFO:tasks.rados.rados.0.smithi084.stdout:2087: done (7 left) 2024-01-13T18:07:43.677 INFO:tasks.rados.rados.0.smithi084.stdout:2088: done (6 left) 2024-01-13T18:07:43.677 INFO:tasks.rados.rados.0.smithi084.stdout:2089: done (5 left) 2024-01-13T18:07:43.677 INFO:tasks.rados.rados.0.smithi084.stdout:2090: done (4 left) 2024-01-13T18:07:43.677 INFO:tasks.rados.rados.0.smithi084.stdout:2091: done (3 left) 2024-01-13T18:07:43.677 INFO:tasks.rados.rados.0.smithi084.stdout:2092: done (2 left) 2024-01-13T18:07:43.677 INFO:tasks.rados.rados.0.smithi084.stdout:2093: done (1 left) 2024-01-13T18:07:43.677 INFO:tasks.rados.rados.0.smithi084.stdout:2094: done (0 left) 2024-01-13T18:07:43.678 INFO:tasks.rados.rados.0.smithi084.stdout:2095: read oid 37 snap 207 2024-01-13T18:07:43.678 INFO:tasks.rados.rados.0.smithi084.stdout:2095: expect (ObjNum 631 snap 197 seq_num 631) 2024-01-13T18:07:43.678 INFO:tasks.rados.rados.0.smithi084.stdout:2096: snap_create 2024-01-13T18:07:43.703 INFO:tasks.rados.rados.0.smithi084.stdout:2095: expect (ObjNum 631 snap 197 seq_num 631) 2024-01-13T18:07:43.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:43 smithi084 ceph-mon[116404]: Upgrade: Updating prometheus.a 2024-01-13T18:07:43.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:43 smithi084 ceph-mon[116404]: Deploying daemon prometheus.a on smithi099 2024-01-13T18:07:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:43 smithi084 ceph-mon[119097]: Upgrade: Updating prometheus.a 2024-01-13T18:07:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:43 smithi084 ceph-mon[119097]: Deploying daemon prometheus.a on smithi099 2024-01-13T18:07:43.999 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:43 smithi099 ceph-mon[138788]: Upgrade: Updating prometheus.a 2024-01-13T18:07:44.000 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:43 smithi099 ceph-mon[138788]: Deploying daemon prometheus.a on smithi099 2024-01-13T18:07:44.557 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 systemd[1]: Stopping Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:44.686 INFO:tasks.rados.rados.0.smithi084.stdout:2095: done (1 left) 2024-01-13T18:07:44.686 INFO:tasks.rados.rados.0.smithi084.stdout:2096: done (0 left) 2024-01-13T18:07:44.686 INFO:tasks.rados.rados.0.smithi084.stdout:2097: snap_remove snap 203 2024-01-13T18:07:44.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-mon[138788]: osdmap e483: 8 total, 8 up, 8 in 2024-01-13T18:07:44.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-mon[138788]: pgmap v436: 121 pgs: 121 active+clean; 208 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2024-01-13T18:07:44.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.555Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-01-13T18:07:44.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.556Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-01-13T18:07:44.869 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.556Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-01-13T18:07:44.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.556Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-01-13T18:07:44.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.556Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-01-13T18:07:44.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.556Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-01-13T18:07:44.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.556Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-01-13T18:07:44.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.556Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-01-13T18:07:44.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.556Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-01-13T18:07:44.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.556Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-01-13T18:07:44.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.556Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-01-13T18:07:44.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[127763]: ts=2024-01-13T18:07:44.556Z caller=main.go:1147 level=info msg="See you next time!" 2024-01-13T18:07:44.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 bash[179982]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a 2024-01-13T18:07:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:44 smithi084 ceph-mon[116404]: osdmap e483: 8 total, 8 up, 8 in 2024-01-13T18:07:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:44 smithi084 ceph-mon[116404]: pgmap v436: 121 pgs: 121 active+clean; 208 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2024-01-13T18:07:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:44 smithi084 ceph-mon[119097]: osdmap e483: 8 total, 8 up, 8 in 2024-01-13T18:07:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:44 smithi084 ceph-mon[119097]: pgmap v436: 121 pgs: 121 active+clean; 208 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2024-01-13T18:07:45.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@prometheus.a.service: Succeeded. 2024-01-13T18:07:45.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:44 smithi099 systemd[1]: Stopped Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:45.369 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 systemd[1]: Starting Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:45.688 INFO:tasks.rados.rados.0.smithi084.stdout:2097: done (0 left) 2024-01-13T18:07:45.688 INFO:tasks.rados.rados.0.smithi084.stdout:2098: copy_from oid 10 from oid 48 current snap is 209 2024-01-13T18:07:45.688 INFO:tasks.rados.rados.0.smithi084.stdout:2099: snap_create 2024-01-13T18:07:45.727 INFO:tasks.rados.rados.0.smithi084.stdout:2098: finishing copy_from to smithi084102331-10 2024-01-13T18:07:45.727 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1079 (ObjNum 535 snap 173 seq_num 535) dirty exists 2024-01-13T18:07:45.727 INFO:tasks.rados.rados.0.smithi084.stdout:2098: finishing copy_from racing read to smithi084102331-10 2024-01-13T18:07:45.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-mon[138788]: osdmap e484: 8 total, 8 up, 8 in 2024-01-13T18:07:45.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:45.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:45.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:45.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.564Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-01-13T18:07:45.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.564Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-01-13T18:07:45.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.564Z caller=main.go:570 level=info host_details="(Linux 4.18.0-532.el8.x86_64 #1 SMP Thu Dec 21 12:11:59 UTC 2023 x86_64 smithi099 (none))" 2024-01-13T18:07:45.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.564Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-01-13T18:07:45.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.564Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-01-13T18:07:45.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.566Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-01-13T18:07:45.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.566Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-01-13T18:07:45.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.567Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-01-13T18:07:45.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.567Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-01-13T18:07:45.870 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.569Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.571Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.270471ms 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.571Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.571Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=4 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 bash[180131]: eaa04d6e16c509b42e30f796dcbeea7965c5652c61af7fc5be5e50618a45a005 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 systemd[1]: Started Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.588Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=4 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.588Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=4 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.594Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=4 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.594Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=4 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.594Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=54.734µs wal_replay_duration=23.025743ms wbl_replay_duration=135ns total_replay_duration=25.389098ms 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.597Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.597Z caller=main.go:1029 level=info msg="TSDB started" 2024-01-13T18:07:45.871 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.597Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-01-13T18:07:45.872 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.615Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=18.266251ms db_storage=842ns remote_storage=1.259µs web_handler=340ns query_engine=628ns scrape=398.7µs scrape_sd=69.917µs notify=16.494µs notify_sd=14.659µs rules=17.453504ms tracing=10.598µs 2024-01-13T18:07:45.872 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.615Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-01-13T18:07:45.872 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 18:07:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T18:07:45.615Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-01-13T18:07:46.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:45 smithi084 ceph-mon[119097]: osdmap e484: 8 total, 8 up, 8 in 2024-01-13T18:07:46.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:45 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:46.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:45 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:46.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:45 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:46.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:45 smithi084 ceph-mon[116404]: osdmap e484: 8 total, 8 up, 8 in 2024-01-13T18:07:46.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:45 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:46.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:45 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:46.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:45 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:2098: done (1 left) 2024-01-13T18:07:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:2099: done (0 left) 2024-01-13T18:07:46.694 INFO:tasks.rados.rados.0.smithi084.stdout:2100: read oid 11 snap -1 2024-01-13T18:07:46.694 INFO:tasks.rados.rados.0.smithi084.stdout:2100: expect (ObjNum 578 snap 185 seq_num 578) 2024-01-13T18:07:46.694 INFO:tasks.rados.rados.0.smithi084.stdout:2101: read oid 12 snap -1 2024-01-13T18:07:46.694 INFO:tasks.rados.rados.0.smithi084.stdout:2101: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:46.694 INFO:tasks.rados.rados.0.smithi084.stdout:2102: delete oid 31 current snap is 210 2024-01-13T18:07:46.698 INFO:tasks.rados.rados.0.smithi084.stdout:2102: done (2 left) 2024-01-13T18:07:46.698 INFO:tasks.rados.rados.0.smithi084.stdout:2103: read oid 2 snap -1 2024-01-13T18:07:46.698 INFO:tasks.rados.rados.0.smithi084.stdout:2103: expect deleted 2024-01-13T18:07:46.699 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 210 2024-01-13T18:07:46.699 INFO:tasks.rados.rados.0.smithi084.stdout:2104: seq_num 666 ranges {5390336=761856,6152192=491520,6643712=311296} 2024-01-13T18:07:46.732 INFO:tasks.rados.rados.0.smithi084.stdout:2104: writing smithi084102331-29 from 5390336 to 6152192 tid 1 2024-01-13T18:07:46.735 INFO:tasks.rados.rados.0.smithi084.stdout:2104: writing smithi084102331-29 from 6152192 to 6643712 tid 2 2024-01-13T18:07:46.737 INFO:tasks.rados.rados.0.smithi084.stdout:2104: writing smithi084102331-29 from 6643712 to 6955008 tid 3 2024-01-13T18:07:46.738 INFO:tasks.rados.rados.0.smithi084.stdout:2105: read oid 44 snap -1 2024-01-13T18:07:46.738 INFO:tasks.rados.rados.0.smithi084.stdout:2105: expect (ObjNum 569 snap 181 seq_num 569) 2024-01-13T18:07:46.738 INFO:tasks.rados.rados.0.smithi084.stdout:2106: rollback oid 40 current snap is 210 2024-01-13T18:07:46.738 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 205 2024-01-13T18:07:46.738 INFO:tasks.rados.rados.0.smithi084.stdout:2100: expect (ObjNum 578 snap 185 seq_num 578) 2024-01-13T18:07:46.867 INFO:tasks.rados.rados.0.smithi084.stdout:2101: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:07:46.921 INFO:tasks.rados.rados.0.smithi084.stdout:2100: done (5 left) 2024-01-13T18:07:46.921 INFO:tasks.rados.rados.0.smithi084.stdout:2101: done (4 left) 2024-01-13T18:07:46.921 INFO:tasks.rados.rados.0.smithi084.stdout:2103: done (3 left) 2024-01-13T18:07:46.921 INFO:tasks.rados.rados.0.smithi084.stdout:2107: delete oid 2 current snap is 210 2024-01-13T18:07:46.921 INFO:tasks.rados.rados.0.smithi084.stdout:2104: finishing write tid 1 to smithi084102331-29 2024-01-13T18:07:46.922 INFO:tasks.rados.rados.0.smithi084.stdout:2104: finishing write tid 2 to smithi084102331-29 2024-01-13T18:07:46.922 INFO:tasks.rados.rados.0.smithi084.stdout:2104: finishing write tid 3 to smithi084102331-29 2024-01-13T18:07:46.922 INFO:tasks.rados.rados.0.smithi084.stdout:2104: finishing write tid 4 to smithi084102331-29 2024-01-13T18:07:46.922 INFO:tasks.rados.rados.0.smithi084.stdout:2106: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:07:46.922 INFO:tasks.rados.rados.0.smithi084.stdout:2106: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:07:46.922 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 752 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-01-13T18:07:46.922 INFO:tasks.rados.rados.0.smithi084.stdout:2104: finishing write tid 5 to smithi084102331-29 2024-01-13T18:07:46.922 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 749 (ObjNum 666 snap 210 seq_num 666) dirty exists 2024-01-13T18:07:46.922 INFO:tasks.rados.rados.0.smithi084.stdout:2104: left oid 29 (ObjNum 666 snap 210 seq_num 666) 2024-01-13T18:07:46.922 INFO:tasks.rados.rados.0.smithi084.stdout:2105: expect (ObjNum 569 snap 181 seq_num 569) 2024-01-13T18:07:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:46 smithi099 ceph-mon[138788]: osdmap e485: 8 total, 8 up, 8 in 2024-01-13T18:07:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:46 smithi099 ceph-mon[138788]: pgmap v439: 121 pgs: 121 active+clean; 210 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-01-13T18:07:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:46 smithi084 ceph-mon[116404]: osdmap e485: 8 total, 8 up, 8 in 2024-01-13T18:07:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:46 smithi084 ceph-mon[116404]: pgmap v439: 121 pgs: 121 active+clean; 210 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-01-13T18:07:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:46 smithi084 ceph-mon[119097]: osdmap e485: 8 total, 8 up, 8 in 2024-01-13T18:07:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:46 smithi084 ceph-mon[119097]: pgmap v439: 121 pgs: 121 active+clean; 210 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-01-13T18:07:47.506 INFO:tasks.rados.rados.0.smithi084.stdout:2104: done (3 left) 2024-01-13T18:07:47.506 INFO:tasks.rados.rados.0.smithi084.stdout:2105: done (2 left) 2024-01-13T18:07:47.506 INFO:tasks.rados.rados.0.smithi084.stdout:2106: done (1 left) 2024-01-13T18:07:47.506 INFO:tasks.rados.rados.0.smithi084.stdout:2107: done (0 left) 2024-01-13T18:07:47.506 INFO:tasks.rados.rados.0.smithi084.stdout:2108: snap_create 2024-01-13T18:07:47.647 INFO:tasks.rados.rados.0.smithi084.stdout:2108: done (0 left) 2024-01-13T18:07:47.647 INFO:tasks.rados.rados.0.smithi084.stdout:2109: copy_from oid 25 from oid 32 current snap is 211 2024-01-13T18:07:47.647 INFO:tasks.rados.rados.0.smithi084.stdout:2110: snap_create 2024-01-13T18:07:47.657 INFO:tasks.rados.rados.0.smithi084.stdout:2109: finishing copy_from to smithi084102331-25 2024-01-13T18:07:47.657 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1028 (ObjNum 0 snap 0 seq_num 304) dirty exists 2024-01-13T18:07:47.658 INFO:tasks.rados.rados.0.smithi084.stdout:2109: finishing copy_from racing read to smithi084102331-25 2024-01-13T18:07:47.797 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:47 smithi099 ceph-mon[138788]: osdmap e486: 8 total, 8 up, 8 in 2024-01-13T18:07:47.797 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:47 smithi099 ceph-mon[138788]: osdmap e487: 8 total, 8 up, 8 in 2024-01-13T18:07:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:47 smithi084 ceph-mon[116404]: osdmap e486: 8 total, 8 up, 8 in 2024-01-13T18:07:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:47 smithi084 ceph-mon[116404]: osdmap e487: 8 total, 8 up, 8 in 2024-01-13T18:07:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:47 smithi084 ceph-mon[119097]: osdmap e486: 8 total, 8 up, 8 in 2024-01-13T18:07:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:47 smithi084 ceph-mon[119097]: osdmap e487: 8 total, 8 up, 8 in 2024-01-13T18:07:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:2109: done (1 left) 2024-01-13T18:07:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:2110: done (0 left) 2024-01-13T18:07:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:2111: delete oid 44 current snap is 212 2024-01-13T18:07:48.650 INFO:tasks.rados.rados.0.smithi084.stdout:2111: done (0 left) 2024-01-13T18:07:48.650 INFO:tasks.rados.rados.0.smithi084.stdout:2112: copy_from oid 39 from oid 22 current snap is 212 2024-01-13T18:07:48.650 INFO:tasks.rados.rados.0.smithi084.stdout:2113: snap_remove snap 199 2024-01-13T18:07:49.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:49 smithi099 ceph-mon[138788]: pgmap v442: 121 pgs: 121 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 3.0 MiB/s wr, 21 op/s 2024-01-13T18:07:49.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:49 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:49 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:49 smithi099 ceph-mon[138788]: osdmap e488: 8 total, 8 up, 8 in 2024-01-13T18:07:49.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:49 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:49 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[116404]: pgmap v442: 121 pgs: 121 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 3.0 MiB/s wr, 21 op/s 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[116404]: osdmap e488: 8 total, 8 up, 8 in 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[119097]: pgmap v442: 121 pgs: 121 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 3.0 MiB/s wr, 21 op/s 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[119097]: osdmap e488: 8 total, 8 up, 8 in 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:49 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:49.650 INFO:tasks.rados.rados.0.smithi084.stdout:2113: done (1 left) 2024-01-13T18:07:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:2114: read oid 14 snap -1 2024-01-13T18:07:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:2114: expect (ObjNum 640 snap 199 seq_num 640) 2024-01-13T18:07:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:2115: delete oid 30 current snap is 212 2024-01-13T18:07:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:2112: finishing copy_from to smithi084102331-39 2024-01-13T18:07:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1092 (ObjNum 33 snap 0 seq_num 3) dirty exists 2024-01-13T18:07:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:2112: finishing copy_from racing read to smithi084102331-39 2024-01-13T18:07:49.661 INFO:tasks.rados.rados.0.smithi084.stdout:2112: done (2 left) 2024-01-13T18:07:49.661 INFO:tasks.rados.rados.0.smithi084.stdout:2115: done (1 left) 2024-01-13T18:07:49.661 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 212 2024-01-13T18:07:49.661 INFO:tasks.rados.rados.0.smithi084.stdout:2116: seq_num 670 ranges {6021120=425984,6447104=483328,6930432=507904,7438336=212992} 2024-01-13T18:07:49.695 INFO:tasks.rados.rados.0.smithi084.stdout:2116: writing smithi084102331-42 from 6021120 to 6447104 tid 1 2024-01-13T18:07:49.699 INFO:tasks.rados.rados.0.smithi084.stdout:2116: writing smithi084102331-42 from 6447104 to 6930432 tid 2 2024-01-13T18:07:49.702 INFO:tasks.rados.rados.0.smithi084.stdout:2116: writing smithi084102331-42 from 6930432 to 7438336 tid 3 2024-01-13T18:07:49.703 INFO:tasks.rados.rados.0.smithi084.stdout:2116: writing smithi084102331-42 from 7438336 to 7651328 tid 4 2024-01-13T18:07:49.703 INFO:tasks.rados.rados.0.smithi084.stdout:2117: copy_from oid 1 from oid 8 current snap is 212 2024-01-13T18:07:49.703 INFO:tasks.rados.rados.0.smithi084.stdout:2114: expect (ObjNum 640 snap 199 seq_num 640) 2024-01-13T18:07:49.731 INFO:tasks.rados.rados.0.smithi084.stdout:2116: finishing write tid 1 to smithi084102331-42 2024-01-13T18:07:49.731 INFO:tasks.rados.rados.0.smithi084.stdout:2116: finishing write tid 2 to smithi084102331-42 2024-01-13T18:07:49.731 INFO:tasks.rados.rados.0.smithi084.stdout:2117: finishing copy_from to smithi084102331-1 2024-01-13T18:07:49.731 INFO:tasks.rados.rados.0.smithi084.stdout:2117: got expected ENOENT (src dne) 2024-01-13T18:07:49.731 INFO:tasks.rados.rados.0.smithi084.stdout:2117: finishing copy_from racing read to smithi084102331-1 2024-01-13T18:07:49.731 INFO:tasks.rados.rados.0.smithi084.stdout:2116: finishing write tid 3 to smithi084102331-42 2024-01-13T18:07:49.731 INFO:tasks.rados.rados.0.smithi084.stdout:2116: finishing write tid 4 to smithi084102331-42 2024-01-13T18:07:49.731 INFO:tasks.rados.rados.0.smithi084.stdout:2116: finishing write tid 5 to smithi084102331-42 2024-01-13T18:07:49.732 INFO:tasks.rados.rados.0.smithi084.stdout:2116: finishing write tid 6 to smithi084102331-42 2024-01-13T18:07:49.732 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 895 (ObjNum 670 snap 212 seq_num 670) dirty exists 2024-01-13T18:07:49.732 INFO:tasks.rados.rados.0.smithi084.stdout:2116: left oid 42 (ObjNum 670 snap 212 seq_num 670) 2024-01-13T18:07:49.732 INFO:tasks.rados.rados.0.smithi084.stdout:2114: done (2 left) 2024-01-13T18:07:49.732 INFO:tasks.rados.rados.0.smithi084.stdout:2116: done (1 left) 2024-01-13T18:07:49.732 INFO:tasks.rados.rados.0.smithi084.stdout:2117: done (0 left) 2024-01-13T18:07:49.732 INFO:tasks.rados.rados.0.smithi084.stdout:2118: snap_create 2024-01-13T18:07:50.654 INFO:tasks.rados.rados.0.smithi084.stdout:2118: done (0 left) 2024-01-13T18:07:50.654 INFO:tasks.rados.rados.0.smithi084.stdout:2119: delete oid 42 current snap is 213 2024-01-13T18:07:50.657 INFO:tasks.rados.rados.0.smithi084.stdout:2119: done (0 left) 2024-01-13T18:07:50.657 INFO:tasks.rados.rados.0.smithi084.stdout:2120: delete oid 48 current snap is 213 2024-01-13T18:07:50.661 INFO:tasks.rados.rados.0.smithi084.stdout:2120: done (0 left) 2024-01-13T18:07:50.661 INFO:tasks.rados.rados.0.smithi084.stdout:2121: rollback oid 47 current snap is 213 2024-01-13T18:07:50.661 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 198 2024-01-13T18:07:50.661 INFO:tasks.rados.rados.0.smithi084.stdout:2122: read oid 15 snap -1 2024-01-13T18:07:50.662 INFO:tasks.rados.rados.0.smithi084.stdout:2122: expect (ObjNum 626 snap 197 seq_num 626) 2024-01-13T18:07:50.662 INFO:tasks.rados.rados.0.smithi084.stdout:2123: setattr oid 4 current snap is 213 2024-01-13T18:07:50.662 INFO:tasks.rados.rados.0.smithi084.stdout:2121: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:07:50.662 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-01-13T18:07:50.663 INFO:tasks.rados.rados.0.smithi084.stdout:2121: done (2 left) 2024-01-13T18:07:50.663 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 213 2024-01-13T18:07:50.663 INFO:tasks.rados.rados.0.smithi084.stdout:2124: seq_num 673 ranges {7675904=475136,8151040=532480,8683520=671744} 2024-01-13T18:07:50.706 INFO:tasks.rados.rados.0.smithi084.stdout:2124: writing smithi084102331-18 from 7675904 to 8151040 tid 1 2024-01-13T18:07:50.709 INFO:tasks.rados.rados.0.smithi084.stdout:2124: writing smithi084102331-18 from 8151040 to 8683520 tid 2 2024-01-13T18:07:50.714 INFO:tasks.rados.rados.0.smithi084.stdout:2124: writing smithi084102331-18 from 8683520 to 9355264 tid 3 2024-01-13T18:07:50.714 INFO:tasks.rados.rados.0.smithi084.stdout:2125: snap_remove snap 210 2024-01-13T18:07:50.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:50 smithi099 ceph-mon[138788]: osdmap e489: 8 total, 8 up, 8 in 2024-01-13T18:07:50.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:50 smithi099 ceph-mon[138788]: pgmap v445: 121 pgs: 121 active+clean; 223 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 3.8 MiB/s wr, 16 op/s 2024-01-13T18:07:50.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:50.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:50 smithi084 ceph-mon[116404]: osdmap e489: 8 total, 8 up, 8 in 2024-01-13T18:07:50.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:50 smithi084 ceph-mon[116404]: pgmap v445: 121 pgs: 121 active+clean; 223 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 3.8 MiB/s wr, 16 op/s 2024-01-13T18:07:50.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:50 smithi084 ceph-mon[119097]: osdmap e489: 8 total, 8 up, 8 in 2024-01-13T18:07:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:50 smithi084 ceph-mon[119097]: pgmap v445: 121 pgs: 121 active+clean; 223 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 3.8 MiB/s wr, 16 op/s 2024-01-13T18:07:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:07:51.661 INFO:tasks.rados.rados.0.smithi084.stdout:2125: done (3 left) 2024-01-13T18:07:51.661 INFO:tasks.rados.rados.0.smithi084.stdout:2126: snap_create 2024-01-13T18:07:51.661 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 777 (ObjNum 81 snap 0 seq_num 4036908784) dirty exists 2024-01-13T18:07:51.661 INFO:tasks.rados.rados.0.smithi084.stdout:2122: expect (ObjNum 626 snap 197 seq_num 626) 2024-01-13T18:07:51.684 INFO:tasks.rados.rados.0.smithi084.stdout:2124: finishing write tid 1 to smithi084102331-18 2024-01-13T18:07:51.684 INFO:tasks.rados.rados.0.smithi084.stdout:2124: finishing write tid 2 to smithi084102331-18 2024-01-13T18:07:51.684 INFO:tasks.rados.rados.0.smithi084.stdout:2124: finishing write tid 3 to smithi084102331-18 2024-01-13T18:07:51.684 INFO:tasks.rados.rados.0.smithi084.stdout:2124: finishing write tid 4 to smithi084102331-18 2024-01-13T18:07:51.684 INFO:tasks.rados.rados.0.smithi084.stdout:2124: finishing write tid 5 to smithi084102331-18 2024-01-13T18:07:51.684 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1083 (ObjNum 673 snap 213 seq_num 673) dirty exists 2024-01-13T18:07:51.684 INFO:tasks.rados.rados.0.smithi084.stdout:2124: left oid 18 (ObjNum 673 snap 213 seq_num 673) 2024-01-13T18:07:51.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: osdmap e490: 8 total, 8 up, 8 in 2024-01-13T18:07:51.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:51.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.916 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: osdmap e490: 8 total, 8 up, 8 in 2024-01-13T18:07:51.916 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:51.916 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.918 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.918 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.918 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.918 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.918 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.918 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:51.918 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: osdmap e490: 8 total, 8 up, 8 in 2024-01-13T18:07:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:07:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:07:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:07:52.646 INFO:tasks.rados.rados.0.smithi084.stdout:2122: done (3 left) 2024-01-13T18:07:52.646 INFO:tasks.rados.rados.0.smithi084.stdout:2123: done (2 left) 2024-01-13T18:07:52.647 INFO:tasks.rados.rados.0.smithi084.stdout:2124: done (1 left) 2024-01-13T18:07:52.647 INFO:tasks.rados.rados.0.smithi084.stdout:2126: done (0 left) 2024-01-13T18:07:52.647 INFO:tasks.rados.rados.0.smithi084.stdout:2127: delete oid 38 current snap is 214 2024-01-13T18:07:52.650 INFO:tasks.rados.rados.0.smithi084.stdout:2127: done (0 left) 2024-01-13T18:07:52.650 INFO:tasks.rados.rados.0.smithi084.stdout:2128: snap_remove snap 212 2024-01-13T18:07:52.918 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:52 smithi084 ceph-mon[116404]: osdmap e491: 8 total, 8 up, 8 in 2024-01-13T18:07:52.919 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:52 smithi084 ceph-mon[116404]: pgmap v448: 121 pgs: 121 active+clean; 226 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-01-13T18:07:52.919 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:52 smithi084 ceph-mon[116404]: Upgrade: Updating alertmanager.a 2024-01-13T18:07:52.919 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:52 smithi084 ceph-mon[116404]: Deploying daemon alertmanager.a on smithi084 2024-01-13T18:07:52.919 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:52 smithi084 ceph-mon[116404]: osdmap e492: 8 total, 8 up, 8 in 2024-01-13T18:07:52.919 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:52 smithi084 ceph-mon[119097]: osdmap e491: 8 total, 8 up, 8 in 2024-01-13T18:07:52.919 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:52 smithi084 ceph-mon[119097]: pgmap v448: 121 pgs: 121 active+clean; 226 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-01-13T18:07:52.920 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:52 smithi084 ceph-mon[119097]: Upgrade: Updating alertmanager.a 2024-01-13T18:07:52.920 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:52 smithi084 ceph-mon[119097]: Deploying daemon alertmanager.a on smithi084 2024-01-13T18:07:52.920 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:52 smithi084 ceph-mon[119097]: osdmap e492: 8 total, 8 up, 8 in 2024-01-13T18:07:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:52 smithi099 ceph-mon[138788]: osdmap e491: 8 total, 8 up, 8 in 2024-01-13T18:07:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:52 smithi099 ceph-mon[138788]: pgmap v448: 121 pgs: 121 active+clean; 226 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-01-13T18:07:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:52 smithi099 ceph-mon[138788]: Upgrade: Updating alertmanager.a 2024-01-13T18:07:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:52 smithi099 ceph-mon[138788]: Deploying daemon alertmanager.a on smithi084 2024-01-13T18:07:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:52 smithi099 ceph-mon[138788]: osdmap e492: 8 total, 8 up, 8 in 2024-01-13T18:07:53.656 INFO:tasks.rados.rados.0.smithi084.stdout:2128: done (0 left) 2024-01-13T18:07:53.656 INFO:tasks.rados.rados.0.smithi084.stdout:2129: rmattr oid 12 current snap is 214 2024-01-13T18:07:53.656 INFO:tasks.rados.rados.0.smithi084.stdout:2129: done (0 left) 2024-01-13T18:07:53.656 INFO:tasks.rados.rados.0.smithi084.stdout:2130: snap_remove snap 209 2024-01-13T18:07:54.269 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:53 smithi084 systemd[1]: Stopping Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:54.270 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:54 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[105149]: ts=2024-01-13T18:07:54.141Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-01-13T18:07:54.569 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:54 smithi084 bash[160321]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a 2024-01-13T18:07:54.661 INFO:tasks.rados.rados.0.smithi084.stdout:2130: done (0 left) 2024-01-13T18:07:54.662 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 214 2024-01-13T18:07:54.662 INFO:tasks.rados.rados.0.smithi084.stdout:2131: seq_num 675 ranges {2744320=507904,3252224=704512,3956736=499712} 2024-01-13T18:07:54.679 INFO:tasks.rados.rados.0.smithi084.stdout:2131: writing smithi084102331-34 from 2744320 to 3252224 tid 1 2024-01-13T18:07:54.683 INFO:tasks.rados.rados.0.smithi084.stdout:2131: writing smithi084102331-34 from 3252224 to 3956736 tid 2 2024-01-13T18:07:54.687 INFO:tasks.rados.rados.0.smithi084.stdout:2131: writing smithi084102331-34 from 3956736 to 4456448 tid 3 2024-01-13T18:07:54.687 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 214 2024-01-13T18:07:54.687 INFO:tasks.rados.rados.0.smithi084.stdout:2131: finishing write tid 1 to smithi084102331-34 2024-01-13T18:07:54.687 INFO:tasks.rados.rados.0.smithi084.stdout:2131: finishing write tid 2 to smithi084102331-34 2024-01-13T18:07:54.687 INFO:tasks.rados.rados.0.smithi084.stdout:2132: seq_num 676 ranges {0=524288,524288=589824,1114112=450560,1564672=163840} 2024-01-13T18:07:54.690 INFO:tasks.rados.rados.0.smithi084.stdout:2132: writing smithi084102331-38 from 0 to 524288 tid 1 2024-01-13T18:07:54.694 INFO:tasks.rados.rados.0.smithi084.stdout:2132: writing smithi084102331-38 from 524288 to 1114112 tid 2 2024-01-13T18:07:54.697 INFO:tasks.rados.rados.0.smithi084.stdout:2132: writing smithi084102331-38 from 1114112 to 1564672 tid 3 2024-01-13T18:07:54.699 INFO:tasks.rados.rados.0.smithi084.stdout:2132: writing smithi084102331-38 from 1564672 to 1728512 tid 4 2024-01-13T18:07:54.699 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 214 2024-01-13T18:07:54.699 INFO:tasks.rados.rados.0.smithi084.stdout:2131: finishing write tid 3 to smithi084102331-34 2024-01-13T18:07:54.699 INFO:tasks.rados.rados.0.smithi084.stdout:2131: finishing write tid 4 to smithi084102331-34 2024-01-13T18:07:54.699 INFO:tasks.rados.rados.0.smithi084.stdout:2131: finishing write tid 5 to smithi084102331-34 2024-01-13T18:07:54.699 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 631 (ObjNum 675 snap 214 seq_num 675) dirty exists 2024-01-13T18:07:54.700 INFO:tasks.rados.rados.0.smithi084.stdout:2131: left oid 34 (ObjNum 675 snap 214 seq_num 675) 2024-01-13T18:07:54.700 INFO:tasks.rados.rados.0.smithi084.stdout:2132: finishing write tid 1 to smithi084102331-38 2024-01-13T18:07:54.700 INFO:tasks.rados.rados.0.smithi084.stdout:2132: finishing write tid 2 to smithi084102331-38 2024-01-13T18:07:54.700 INFO:tasks.rados.rados.0.smithi084.stdout:2133: seq_num 677 ranges {0=540672,540672=516096,1056768=655360,1712128=32768} 2024-01-13T18:07:54.703 INFO:tasks.rados.rados.0.smithi084.stdout:2133: writing smithi084102331-1 from 0 to 540672 tid 1 2024-01-13T18:07:54.706 INFO:tasks.rados.rados.0.smithi084.stdout:2133: writing smithi084102331-1 from 540672 to 1056768 tid 2 2024-01-13T18:07:54.711 INFO:tasks.rados.rados.0.smithi084.stdout:2133: writing smithi084102331-1 from 1056768 to 1712128 tid 3 2024-01-13T18:07:54.711 INFO:tasks.rados.rados.0.smithi084.stdout:2133: writing smithi084102331-1 from 1712128 to 1744896 tid 4 2024-01-13T18:07:54.711 INFO:tasks.rados.rados.0.smithi084.stdout:2131: done (2 left) 2024-01-13T18:07:54.711 INFO:tasks.rados.rados.0.smithi084.stdout:2134: rollback oid 48 current snap is 214 2024-01-13T18:07:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 48 to 208 2024-01-13T18:07:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:2132: finishing write tid 3 to smithi084102331-38 2024-01-13T18:07:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:2132: finishing write tid 4 to smithi084102331-38 2024-01-13T18:07:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:2132: finishing write tid 5 to smithi084102331-38 2024-01-13T18:07:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:2133: finishing write tid 1 to smithi084102331-1 2024-01-13T18:07:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:2132: finishing write tid 6 to smithi084102331-38 2024-01-13T18:07:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1214 (ObjNum 676 snap 214 seq_num 676) dirty exists 2024-01-13T18:07:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:2132: left oid 38 (ObjNum 676 snap 214 seq_num 676) 2024-01-13T18:07:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:2133: finishing write tid 2 to smithi084102331-1 2024-01-13T18:07:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:2132: done (2 left) 2024-01-13T18:07:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:2135: rollback oid 9 current snap is 214 2024-01-13T18:07:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 198 2024-01-13T18:07:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:2136: copy_from oid 7 from oid 34 current snap is 214 2024-01-13T18:07:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:2137: read oid 46 snap -1 2024-01-13T18:07:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:2137: expect deleted 2024-01-13T18:07:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:2138: delete oid 44 current snap is 214 2024-01-13T18:07:54.714 INFO:tasks.rados.rados.0.smithi084.stdout:2135: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:07:54.714 INFO:tasks.rados.rados.0.smithi084.stdout:2134: finishing rollback tid 1 to smithi084102331-48 2024-01-13T18:07:54.714 INFO:tasks.rados.rados.0.smithi084.stdout:2134: finishing rollback tid 2 to smithi084102331-48 2024-01-13T18:07:54.714 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1105 (ObjNum 535 snap 173 seq_num 535) dirty exists 2024-01-13T18:07:54.715 INFO:tasks.rados.rados.0.smithi084.stdout:2135: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:07:54.715 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 634 (ObjNum 161 snap 0 seq_num 4036090464) dirty dne 2024-01-13T18:07:54.716 INFO:tasks.rados.rados.0.smithi084.stdout:2134: done (5 left) 2024-01-13T18:07:54.716 INFO:tasks.rados.rados.0.smithi084.stdout:2135: done (4 left) 2024-01-13T18:07:54.716 INFO:tasks.rados.rados.0.smithi084.stdout:2137: done (3 left) 2024-01-13T18:07:54.716 INFO:tasks.rados.rados.0.smithi084.stdout:2138: done (2 left) 2024-01-13T18:07:54.716 INFO:tasks.rados.rados.0.smithi084.stdout:2139: read oid 47 snap -1 2024-01-13T18:07:54.716 INFO:tasks.rados.rados.0.smithi084.stdout:2139: expect deleted 2024-01-13T18:07:54.717 INFO:tasks.rados.rados.0.smithi084.stdout:2140: snap_create 2024-01-13T18:07:54.717 INFO:tasks.rados.rados.0.smithi084.stdout:2133: finishing write tid 3 to smithi084102331-1 2024-01-13T18:07:54.717 INFO:tasks.rados.rados.0.smithi084.stdout:2133: finishing write tid 4 to smithi084102331-1 2024-01-13T18:07:54.717 INFO:tasks.rados.rados.0.smithi084.stdout:2133: finishing write tid 5 to smithi084102331-1 2024-01-13T18:07:54.719 INFO:tasks.rados.rados.0.smithi084.stdout:2133: finishing write tid 6 to smithi084102331-1 2024-01-13T18:07:54.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1220 (ObjNum 677 snap 214 seq_num 677) dirty exists 2024-01-13T18:07:54.719 INFO:tasks.rados.rados.0.smithi084.stdout:2133: left oid 1 (ObjNum 677 snap 214 seq_num 677) 2024-01-13T18:07:54.734 INFO:tasks.rados.rados.0.smithi084.stdout:2136: finishing copy_from to smithi084102331-7 2024-01-13T18:07:54.734 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 631 (ObjNum 675 snap 214 seq_num 675) dirty exists 2024-01-13T18:07:54.734 INFO:tasks.rados.rados.0.smithi084.stdout:2136: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:07:54.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:54 smithi084 ceph-mon[116404]: osdmap e493: 8 total, 8 up, 8 in 2024-01-13T18:07:54.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:54 smithi084 ceph-mon[116404]: pgmap v451: 121 pgs: 121 active+clean; 227 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:07:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:54 smithi084 ceph-mon[119097]: osdmap e493: 8 total, 8 up, 8 in 2024-01-13T18:07:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:54 smithi084 ceph-mon[119097]: pgmap v451: 121 pgs: 121 active+clean; 227 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:07:54.929 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:54 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@alertmanager.a.service: Succeeded. 2024-01-13T18:07:54.929 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:54 smithi084 systemd[1]: Stopped Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:54.929 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:54 smithi084 systemd[1]: Starting Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:07:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:54 smithi099 ceph-mon[138788]: osdmap e493: 8 total, 8 up, 8 in 2024-01-13T18:07:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:54 smithi099 ceph-mon[138788]: pgmap v451: 121 pgs: 121 active+clean; 227 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:07:55.428 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[160493]: ts=2024-01-13T18:07:55.078Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-01-13T18:07:55.428 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[160493]: ts=2024-01-13T18:07:55.078Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-01-13T18:07:55.429 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[160493]: ts=2024-01-13T18:07:55.080Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.84 port=9094 2024-01-13T18:07:55.429 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[160493]: ts=2024-01-13T18:07:55.081Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-01-13T18:07:55.429 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:55 smithi084 bash[160477]: 9e6210ff16cf0528b993e828e5c40901a748c0aa25d39dd7cdb9e47e5a76de65 2024-01-13T18:07:55.429 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:55 smithi084 systemd[1]: Started Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:07:55.429 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[160493]: ts=2024-01-13T18:07:55.106Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-01-13T18:07:55.429 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[160493]: ts=2024-01-13T18:07:55.106Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-01-13T18:07:55.429 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[160493]: ts=2024-01-13T18:07:55.109Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-01-13T18:07:55.430 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[160493]: ts=2024-01-13T18:07:55.109Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-01-13T18:07:55.668 INFO:tasks.rados.rados.0.smithi084.stdout:2133: done (3 left) 2024-01-13T18:07:55.669 INFO:tasks.rados.rados.0.smithi084.stdout:2136: done (2 left) 2024-01-13T18:07:55.669 INFO:tasks.rados.rados.0.smithi084.stdout:2139: done (1 left) 2024-01-13T18:07:55.669 INFO:tasks.rados.rados.0.smithi084.stdout:2140: done (0 left) 2024-01-13T18:07:55.669 INFO:tasks.rados.rados.0.smithi084.stdout:2141: snap_remove snap 205 2024-01-13T18:07:55.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-mon[116404]: osdmap e494: 8 total, 8 up, 8 in 2024-01-13T18:07:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:55.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-mon[119097]: osdmap e494: 8 total, 8 up, 8 in 2024-01-13T18:07:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:55 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:55 smithi099 ceph-mon[138788]: osdmap e494: 8 total, 8 up, 8 in 2024-01-13T18:07:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:55 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:55 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:55 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:07:56.670 INFO:tasks.rados.rados.0.smithi084.stdout:2141: done (0 left) 2024-01-13T18:07:56.671 INFO:tasks.rados.rados.0.smithi084.stdout:2142: snap_remove snap 206 2024-01-13T18:07:56.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:56 smithi084 ceph-mon[116404]: osdmap e495: 8 total, 8 up, 8 in 2024-01-13T18:07:56.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:56 smithi084 ceph-mon[116404]: pgmap v454: 121 pgs: 121 active+clean; 227 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 410 KiB/s wr, 4 op/s 2024-01-13T18:07:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:56 smithi084 ceph-mon[119097]: osdmap e495: 8 total, 8 up, 8 in 2024-01-13T18:07:56.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:56 smithi084 ceph-mon[119097]: pgmap v454: 121 pgs: 121 active+clean; 227 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 410 KiB/s wr, 4 op/s 2024-01-13T18:07:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:56 smithi099 ceph-mon[138788]: osdmap e495: 8 total, 8 up, 8 in 2024-01-13T18:07:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:56 smithi099 ceph-mon[138788]: pgmap v454: 121 pgs: 121 active+clean; 227 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 410 KiB/s wr, 4 op/s 2024-01-13T18:07:57.428 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[160493]: ts=2024-01-13T18:07:57.082Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000764987s 2024-01-13T18:07:57.650 INFO:tasks.rados.rados.0.smithi084.stdout:2142: done (0 left) 2024-01-13T18:07:57.650 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 215 2024-01-13T18:07:57.650 INFO:tasks.rados.rados.0.smithi084.stdout:2143: seq_num 679 ranges {0=581632,581632=688128,1269760=516096} 2024-01-13T18:07:57.657 INFO:tasks.rados.rados.0.smithi084.stdout:2143: writing smithi084102331-8 from 0 to 581632 tid 1 2024-01-13T18:07:57.659 INFO:tasks.rados.rados.0.smithi084.stdout:2143: writing smithi084102331-8 from 581632 to 1269760 tid 2 2024-01-13T18:07:57.661 INFO:tasks.rados.rados.0.smithi084.stdout:2143: writing smithi084102331-8 from 1269760 to 1785856 tid 3 2024-01-13T18:07:57.661 INFO:tasks.rados.rados.0.smithi084.stdout:2144: rollback oid 45 current snap is 215 2024-01-13T18:07:57.661 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 197 2024-01-13T18:07:57.662 INFO:tasks.rados.rados.0.smithi084.stdout:2145: rollback oid 9 current snap is 215 2024-01-13T18:07:57.662 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 197 2024-01-13T18:07:57.662 INFO:tasks.rados.rados.0.smithi084.stdout:2146: read oid 36 snap -1 2024-01-13T18:07:57.662 INFO:tasks.rados.rados.0.smithi084.stdout:2146: expect (ObjNum 534 snap 171 seq_num 534) 2024-01-13T18:07:57.662 INFO:tasks.rados.rados.0.smithi084.stdout:2147: delete oid 30 current snap is 215 2024-01-13T18:07:57.662 INFO:tasks.rados.rados.0.smithi084.stdout:2143: finishing write tid 1 to smithi084102331-8 2024-01-13T18:07:57.668 INFO:tasks.rados.rados.0.smithi084.stdout:2147: done (4 left) 2024-01-13T18:07:57.669 INFO:tasks.rados.rados.0.smithi084.stdout:2148: read oid 14 snap -1 2024-01-13T18:07:57.669 INFO:tasks.rados.rados.0.smithi084.stdout:2148: expect (ObjNum 640 snap 199 seq_num 640) 2024-01-13T18:07:57.669 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 215 2024-01-13T18:07:57.669 INFO:tasks.rados.rados.0.smithi084.stdout:2149: seq_num 681 ranges {1130496=614400,1744896=458752,2203648=638976,2842624=106496} 2024-01-13T18:07:57.678 INFO:tasks.rados.rados.0.smithi084.stdout:2149: writing smithi084102331-24 from 1130496 to 1744896 tid 1 2024-01-13T18:07:57.679 INFO:tasks.rados.rados.0.smithi084.stdout:2149: writing smithi084102331-24 from 1744896 to 2203648 tid 2 2024-01-13T18:07:57.683 INFO:tasks.rados.rados.0.smithi084.stdout:2149: writing smithi084102331-24 from 2203648 to 2842624 tid 3 2024-01-13T18:07:57.684 INFO:tasks.rados.rados.0.smithi084.stdout:2149: writing smithi084102331-24 from 2842624 to 2949120 tid 4 2024-01-13T18:07:57.684 INFO:tasks.rados.rados.0.smithi084.stdout:2150: read oid 31 snap -1 2024-01-13T18:07:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:2150: expect deleted 2024-01-13T18:07:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:2151: copy_from oid 38 from oid 46 current snap is 215 2024-01-13T18:07:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:2152: copy_from oid 18 from oid 12 current snap is 215 2024-01-13T18:07:57.685 INFO:tasks.rados.rados.0.smithi084.stdout:2153: snap_remove snap 200 2024-01-13T18:07:57.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[116404]: osdmap e496: 8 total, 8 up, 8 in 2024-01-13T18:07:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:57.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[116404]: osdmap e497: 8 total, 8 up, 8 in 2024-01-13T18:07:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[119097]: osdmap e496: 8 total, 8 up, 8 in 2024-01-13T18:07:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:57.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:57 smithi084 ceph-mon[119097]: osdmap e497: 8 total, 8 up, 8 in 2024-01-13T18:07:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:57 smithi099 ceph-mon[138788]: osdmap e496: 8 total, 8 up, 8 in 2024-01-13T18:07:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:57 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:57 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:57 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:57 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:07:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:57 smithi099 ceph-mon[138788]: osdmap e497: 8 total, 8 up, 8 in 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:2153: done (9 left) 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:2154: copy_from oid 21 from oid 6 current snap is 215 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:2144: finishing rollback tid 1 to smithi084102331-45 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1154 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:2143: finishing write tid 2 to smithi084102331-8 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:2143: finishing write tid 3 to smithi084102331-8 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:2143: finishing write tid 4 to smithi084102331-8 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:2143: finishing write tid 5 to smithi084102331-8 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1083 (ObjNum 679 snap 215 seq_num 679) dirty exists 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:2143: left oid 8 (ObjNum 679 snap 215 seq_num 679) 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:2145: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 634 (ObjNum 593 snap 0 seq_num 4037062120) dirty dne 2024-01-13T18:07:58.686 INFO:tasks.rados.rados.0.smithi084.stdout:2149: finishing write tid 1 to smithi084102331-24 2024-01-13T18:07:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:2149: finishing write tid 2 to smithi084102331-24 2024-01-13T18:07:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:2151: finishing copy_from to smithi084102331-38 2024-01-13T18:07:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:2151: got expected ENOENT (src dne) 2024-01-13T18:07:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:2146: expect (ObjNum 534 snap 171 seq_num 534) 2024-01-13T18:07:58.856 INFO:tasks.rados.rados.0.smithi084.stdout:2151: finishing copy_from racing read to smithi084102331-38 2024-01-13T18:07:58.856 INFO:tasks.rados.rados.0.smithi084.stdout:2148: expect (ObjNum 640 snap 199 seq_num 640) 2024-01-13T18:07:58.886 INFO:tasks.rados.rados.0.smithi084.stdout:2149: finishing write tid 3 to smithi084102331-24 2024-01-13T18:07:58.886 INFO:tasks.rados.rados.0.smithi084.stdout:2149: finishing write tid 4 to smithi084102331-24 2024-01-13T18:07:58.887 INFO:tasks.rados.rados.0.smithi084.stdout:2149: finishing write tid 5 to smithi084102331-24 2024-01-13T18:07:58.887 INFO:tasks.rados.rados.0.smithi084.stdout:2149: finishing write tid 6 to smithi084102331-24 2024-01-13T18:07:58.887 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 636 (ObjNum 681 snap 215 seq_num 681) dirty exists 2024-01-13T18:07:58.887 INFO:tasks.rados.rados.0.smithi084.stdout:2149: left oid 24 (ObjNum 681 snap 215 seq_num 681) 2024-01-13T18:07:58.887 INFO:tasks.rados.rados.0.smithi084.stdout:2152: finishing copy_from to smithi084102331-18 2024-01-13T18:07:58.887 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1085 (ObjNum 564 snap 180 seq_num 564) dirty exists 2024-01-13T18:07:58.887 INFO:tasks.rados.rados.0.smithi084.stdout:2152: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:07:58.888 INFO:tasks.rados.rados.0.smithi084.stdout:2143: done (9 left) 2024-01-13T18:07:58.888 INFO:tasks.rados.rados.0.smithi084.stdout:2144: done (8 left) 2024-01-13T18:07:58.888 INFO:tasks.rados.rados.0.smithi084.stdout:2145: done (7 left) 2024-01-13T18:07:58.888 INFO:tasks.rados.rados.0.smithi084.stdout:2146: done (6 left) 2024-01-13T18:07:58.888 INFO:tasks.rados.rados.0.smithi084.stdout:2148: done (5 left) 2024-01-13T18:07:58.888 INFO:tasks.rados.rados.0.smithi084.stdout:2149: done (4 left) 2024-01-13T18:07:58.889 INFO:tasks.rados.rados.0.smithi084.stdout:2150: done (3 left) 2024-01-13T18:07:58.889 INFO:tasks.rados.rados.0.smithi084.stdout:2151: done (2 left) 2024-01-13T18:07:58.889 INFO:tasks.rados.rados.0.smithi084.stdout:2152: done (1 left) 2024-01-13T18:07:58.889 INFO:tasks.rados.rados.0.smithi084.stdout:2155: read oid 1 snap 211 2024-01-13T18:07:58.889 INFO:tasks.rados.rados.0.smithi084.stdout:2155: expect (ObjNum -257408016 snap 21877 seq_num 3293655104) 2024-01-13T18:07:58.889 INFO:tasks.rados.rados.0.smithi084.stdout:2156: delete oid 17 current snap is 215 2024-01-13T18:07:58.890 INFO:tasks.rados.rados.0.smithi084.stdout:2154: finishing copy_from to smithi084102331-21 2024-01-13T18:07:58.890 INFO:tasks.rados.rados.0.smithi084.stdout:2154: got expected ENOENT (src dne) 2024-01-13T18:07:58.890 INFO:tasks.rados.rados.0.smithi084.stdout:2154: finishing copy_from racing read to smithi084102331-21 2024-01-13T18:07:58.890 INFO:tasks.rados.rados.0.smithi084.stdout:2155: expect (ObjNum -257408016 snap 21877 seq_num 3293655104) 2024-01-13T18:07:58.891 INFO:tasks.rados.rados.0.smithi084.stdout:2154: done (2 left) 2024-01-13T18:07:58.891 INFO:tasks.rados.rados.0.smithi084.stdout:2155: done (1 left) 2024-01-13T18:07:58.891 INFO:tasks.rados.rados.0.smithi084.stdout:2156: done (0 left) 2024-01-13T18:07:58.891 INFO:tasks.rados.rados.0.smithi084.stdout:2157: snap_remove snap 211 2024-01-13T18:07:58.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:58 smithi084 ceph-mon[116404]: pgmap v457: 121 pgs: 121 active+clean; 243 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 829 KiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:07:58.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:58 smithi084 ceph-mon[119097]: pgmap v457: 121 pgs: 121 active+clean; 243 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 829 KiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:07:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:58 smithi099 ceph-mon[138788]: pgmap v457: 121 pgs: 121 active+clean; 243 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 829 KiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:07:59.688 INFO:tasks.rados.rados.0.smithi084.stdout:2157: done (0 left) 2024-01-13T18:07:59.688 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 215 2024-01-13T18:07:59.688 INFO:tasks.rados.rados.0.smithi084.stdout:2158: seq_num 683 ranges {0=647168,647168=630784,1277952=573440} 2024-01-13T18:07:59.691 INFO:tasks.rados.rados.0.smithi084.stdout:2158: writing smithi084102331-13 from 0 to 647168 tid 1 2024-01-13T18:07:59.695 INFO:tasks.rados.rados.0.smithi084.stdout:2158: writing smithi084102331-13 from 647168 to 1277952 tid 2 2024-01-13T18:07:59.700 INFO:tasks.rados.rados.0.smithi084.stdout:2158: writing smithi084102331-13 from 1277952 to 1851392 tid 3 2024-01-13T18:07:59.700 INFO:tasks.rados.rados.0.smithi084.stdout:2159: copy_from oid 28 from oid 50 current snap is 215 2024-01-13T18:07:59.700 INFO:tasks.rados.rados.0.smithi084.stdout:2160: rollback oid 38 current snap is 215 2024-01-13T18:07:59.700 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 198 2024-01-13T18:07:59.700 INFO:tasks.rados.rados.0.smithi084.stdout:2161: read oid 20 snap -1 2024-01-13T18:07:59.700 INFO:tasks.rados.rados.0.smithi084.stdout:2161: expect (ObjNum 638 snap 199 seq_num 638) 2024-01-13T18:07:59.700 INFO:tasks.rados.rados.0.smithi084.stdout:2162: read oid 10 snap 207 2024-01-13T18:07:59.700 INFO:tasks.rados.rados.0.smithi084.stdout:2162: expect (ObjNum 659 snap 207 seq_num 659) 2024-01-13T18:07:59.700 INFO:tasks.rados.rados.0.smithi084.stdout:2163: read oid 4 snap -1 2024-01-13T18:07:59.700 INFO:tasks.rados.rados.0.smithi084.stdout:2163: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:59.701 INFO:tasks.rados.rados.0.smithi084.stdout:2164: copy_from oid 43 from oid 26 current snap is 215 2024-01-13T18:07:59.701 INFO:tasks.rados.rados.0.smithi084.stdout:2165: read oid 32 snap -1 2024-01-13T18:07:59.701 INFO:tasks.rados.rados.0.smithi084.stdout:2165: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:59.701 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 215 2024-01-13T18:07:59.701 INFO:tasks.rados.rados.0.smithi084.stdout:2166: seq_num 684 ranges {6389760=663552,7053312=507904,7561216=409600,7970816=286720} 2024-01-13T18:07:59.739 INFO:tasks.rados.rados.0.smithi084.stdout:2166: writing smithi084102331-35 from 6389760 to 7053312 tid 1 2024-01-13T18:07:59.742 INFO:tasks.rados.rados.0.smithi084.stdout:2166: writing smithi084102331-35 from 7053312 to 7561216 tid 2 2024-01-13T18:07:59.745 INFO:tasks.rados.rados.0.smithi084.stdout:2166: writing smithi084102331-35 from 7561216 to 7970816 tid 3 2024-01-13T18:07:59.747 INFO:tasks.rados.rados.0.smithi084.stdout:2166: writing smithi084102331-35 from 7970816 to 8257536 tid 4 2024-01-13T18:07:59.748 INFO:tasks.rados.rados.0.smithi084.stdout:2167: read oid 49 snap -1 2024-01-13T18:07:59.748 INFO:tasks.rados.rados.0.smithi084.stdout:2167: expect (ObjNum 660 snap 207 seq_num 660) 2024-01-13T18:07:59.748 INFO:tasks.rados.rados.0.smithi084.stdout:2168: read oid 9 snap 214 2024-01-13T18:07:59.748 INFO:tasks.rados.rados.0.smithi084.stdout:2168: expect deleted 2024-01-13T18:07:59.748 INFO:tasks.rados.rados.0.smithi084.stdout:2169: rollback oid 17 current snap is 215 2024-01-13T18:07:59.748 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 186 2024-01-13T18:07:59.748 INFO:tasks.rados.rados.0.smithi084.stdout:2158: finishing write tid 1 to smithi084102331-13 2024-01-13T18:07:59.748 INFO:tasks.rados.rados.0.smithi084.stdout:2170: read oid 5 snap -1 2024-01-13T18:07:59.748 INFO:tasks.rados.rados.0.smithi084.stdout:2170: expect (ObjNum 617 snap 196 seq_num 617) 2024-01-13T18:07:59.748 INFO:tasks.rados.rados.0.smithi084.stdout:2171: copy_from oid 3 from oid 45 current snap is 215 2024-01-13T18:07:59.748 INFO:tasks.rados.rados.0.smithi084.stdout:2165: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:59.750 INFO:tasks.rados.rados.0.smithi084.stdout:2158: finishing write tid 2 to smithi084102331-13 2024-01-13T18:07:59.750 INFO:tasks.rados.rados.0.smithi084.stdout:2165: done (13 left) 2024-01-13T18:07:59.750 INFO:tasks.rados.rados.0.smithi084.stdout:2172: read oid 8 snap -1 2024-01-13T18:07:59.750 INFO:tasks.rados.rados.0.smithi084.stdout:2172: expect (ObjNum 679 snap 215 seq_num 679) 2024-01-13T18:07:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2173: setattr oid 7 current snap is 215 2024-01-13T18:07:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2160: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:07:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2160: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:07:59.753 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1238 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-01-13T18:07:59.753 INFO:tasks.rados.rados.0.smithi084.stdout:2162: expect (ObjNum 659 snap 207 seq_num 659) 2024-01-13T18:07:59.795 INFO:tasks.rados.rados.0.smithi084.stdout:2163: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:07:59.798 INFO:tasks.rados.rados.0.smithi084.stdout:2158: finishing write tid 3 to smithi084102331-13 2024-01-13T18:07:59.798 INFO:tasks.rados.rados.0.smithi084.stdout:2158: finishing write tid 4 to smithi084102331-13 2024-01-13T18:07:59.798 INFO:tasks.rados.rados.0.smithi084.stdout:2158: finishing write tid 5 to smithi084102331-13 2024-01-13T18:07:59.798 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 795 (ObjNum 683 snap 215 seq_num 683) dirty exists 2024-01-13T18:07:59.798 INFO:tasks.rados.rados.0.smithi084.stdout:2158: left oid 13 (ObjNum 683 snap 215 seq_num 683) 2024-01-13T18:07:59.798 INFO:tasks.rados.rados.0.smithi084.stdout:2164: finishing copy_from to smithi084102331-43 2024-01-13T18:07:59.798 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1082 (ObjNum 564 snap 180 seq_num 564) dirty exists 2024-01-13T18:07:59.798 INFO:tasks.rados.rados.0.smithi084.stdout:2161: expect (ObjNum 638 snap 199 seq_num 638) 2024-01-13T18:07:59.828 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:07:59 smithi084 ceph-mon[116404]: osdmap e498: 8 total, 8 up, 8 in 2024-01-13T18:07:59.828 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:07:59 smithi084 ceph-mon[119097]: osdmap e498: 8 total, 8 up, 8 in 2024-01-13T18:07:59.906 INFO:tasks.rados.rados.0.smithi084.stdout:2164: finishing copy_from racing read to smithi084102331-43 2024-01-13T18:07:59.906 INFO:tasks.rados.rados.0.smithi084.stdout:2171: finishing copy_from to smithi084102331-3 2024-01-13T18:07:59.906 INFO:tasks.rados.rados.0.smithi084.stdout:2171: got expected ENOENT (src dne) 2024-01-13T18:07:59.906 INFO:tasks.rados.rados.0.smithi084.stdout:2171: finishing copy_from racing read to smithi084102331-3 2024-01-13T18:07:59.906 INFO:tasks.rados.rados.0.smithi084.stdout:2166: finishing write tid 1 to smithi084102331-35 2024-01-13T18:07:59.907 INFO:tasks.rados.rados.0.smithi084.stdout:2166: finishing write tid 2 to smithi084102331-35 2024-01-13T18:07:59.907 INFO:tasks.rados.rados.0.smithi084.stdout:2166: finishing write tid 3 to smithi084102331-35 2024-01-13T18:07:59.907 INFO:tasks.rados.rados.0.smithi084.stdout:2166: finishing write tid 4 to smithi084102331-35 2024-01-13T18:07:59.907 INFO:tasks.rados.rados.0.smithi084.stdout:2166: finishing write tid 5 to smithi084102331-35 2024-01-13T18:07:59.907 INFO:tasks.rados.rados.0.smithi084.stdout:2166: finishing write tid 6 to smithi084102331-35 2024-01-13T18:07:59.907 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 780 (ObjNum 684 snap 215 seq_num 684) dirty exists 2024-01-13T18:07:59.907 INFO:tasks.rados.rados.0.smithi084.stdout:2166: left oid 35 (ObjNum 684 snap 215 seq_num 684) 2024-01-13T18:07:59.908 INFO:tasks.rados.rados.0.smithi084.stdout:2169: finishing rollback tid 1 to smithi084102331-17 2024-01-13T18:07:59.908 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 789 (ObjNum 33 snap 0 seq_num 0) dirty dne 2024-01-13T18:07:59.908 INFO:tasks.rados.rados.0.smithi084.stdout:2172: expect (ObjNum 679 snap 215 seq_num 679) 2024-01-13T18:07:59.950 INFO:tasks.rados.rados.0.smithi084.stdout:2170: expect (ObjNum 617 snap 196 seq_num 617) 2024-01-13T18:08:00.057 INFO:tasks.rados.rados.0.smithi084.stdout:2167: expect (ObjNum 660 snap 207 seq_num 660) 2024-01-13T18:08:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:07:59 smithi099 ceph-mon[138788]: osdmap e498: 8 total, 8 up, 8 in 2024-01-13T18:08:00.248 INFO:tasks.rados.rados.0.smithi084.stdout:2159: finishing copy_from to smithi084102331-28 2024-01-13T18:08:00.248 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 895 (ObjNum 573 snap 181 seq_num 573) dirty exists 2024-01-13T18:08:00.248 INFO:tasks.rados.rados.0.smithi084.stdout:2159: finishing copy_from racing read to smithi084102331-28 2024-01-13T18:08:00.248 INFO:tasks.rados.rados.0.smithi084.stdout:2158: done (14 left) 2024-01-13T18:08:00.248 INFO:tasks.rados.rados.0.smithi084.stdout:2159: done (13 left) 2024-01-13T18:08:00.248 INFO:tasks.rados.rados.0.smithi084.stdout:2160: done (12 left) 2024-01-13T18:08:00.248 INFO:tasks.rados.rados.0.smithi084.stdout:2161: done (11 left) 2024-01-13T18:08:00.248 INFO:tasks.rados.rados.0.smithi084.stdout:2162: done (10 left) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2163: done (9 left) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2164: done (8 left) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2166: done (7 left) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2167: done (6 left) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2168: done (5 left) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2169: done (4 left) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2170: done (3 left) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2171: done (2 left) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2172: done (1 left) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2174: copy_from oid 6 from oid 45 current snap is 215 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1083 (ObjNum 675 snap 214 seq_num 675) dirty exists 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2173: done (1 left) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2175: read oid 18 snap -1 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2175: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:08:00.249 INFO:tasks.rados.rados.0.smithi084.stdout:2176: copy_from oid 22 from oid 30 current snap is 215 2024-01-13T18:08:00.250 INFO:tasks.rados.rados.0.smithi084.stdout:2177: rmattr oid 9 current snap is 215 2024-01-13T18:08:00.250 INFO:tasks.rados.rados.0.smithi084.stdout:2177: done (3 left) 2024-01-13T18:08:00.250 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 215 2024-01-13T18:08:00.250 INFO:tasks.rados.rados.0.smithi084.stdout:2178: seq_num 685 ranges {6971392=679936,7651328=442368,8093696=622592,8716288=139264} 2024-01-13T18:08:00.288 INFO:tasks.rados.rados.0.smithi084.stdout:2178: writing smithi084102331-48 from 6971392 to 7651328 tid 1 2024-01-13T18:08:00.290 INFO:tasks.rados.rados.0.smithi084.stdout:2178: writing smithi084102331-48 from 7651328 to 8093696 tid 2 2024-01-13T18:08:00.294 INFO:tasks.rados.rados.0.smithi084.stdout:2178: writing smithi084102331-48 from 8093696 to 8716288 tid 3 2024-01-13T18:08:00.295 INFO:tasks.rados.rados.0.smithi084.stdout:2178: writing smithi084102331-48 from 8716288 to 8855552 tid 4 2024-01-13T18:08:00.295 INFO:tasks.rados.rados.0.smithi084.stdout:2179: rollback oid 10 current snap is 215 2024-01-13T18:08:00.295 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 213 2024-01-13T18:08:00.295 INFO:tasks.rados.rados.0.smithi084.stdout:2174: finishing copy_from to smithi084102331-6 2024-01-13T18:08:00.295 INFO:tasks.rados.rados.0.smithi084.stdout:2174: got expected ENOENT (src dne) 2024-01-13T18:08:00.295 INFO:tasks.rados.rados.0.smithi084.stdout:2174: finishing copy_from racing read to smithi084102331-6 2024-01-13T18:08:00.295 INFO:tasks.rados.rados.0.smithi084.stdout:2176: finishing copy_from to smithi084102331-22 2024-01-13T18:08:00.296 INFO:tasks.rados.rados.0.smithi084.stdout:2176: got expected ENOENT (src dne) 2024-01-13T18:08:00.296 INFO:tasks.rados.rados.0.smithi084.stdout:2176: finishing copy_from racing read to smithi084102331-22 2024-01-13T18:08:00.296 INFO:tasks.rados.rados.0.smithi084.stdout:2174: done (4 left) 2024-01-13T18:08:00.296 INFO:tasks.rados.rados.0.smithi084.stdout:2176: done (3 left) 2024-01-13T18:08:00.296 INFO:tasks.rados.rados.0.smithi084.stdout:2180: copy_from oid 27 from oid 39 current snap is 215 2024-01-13T18:08:00.296 INFO:tasks.rados.rados.0.smithi084.stdout:2175: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:08:00.351 INFO:tasks.rados.rados.0.smithi084.stdout:2178: finishing write tid 1 to smithi084102331-48 2024-01-13T18:08:00.351 INFO:tasks.rados.rados.0.smithi084.stdout:2178: finishing write tid 2 to smithi084102331-48 2024-01-13T18:08:00.351 INFO:tasks.rados.rados.0.smithi084.stdout:2179: finishing rollback tid 0 to smithi084102331-10 2024-01-13T18:08:00.351 INFO:tasks.rados.rados.0.smithi084.stdout:2179: finishing rollback tid 1 to smithi084102331-10 2024-01-13T18:08:00.351 INFO:tasks.rados.rados.0.smithi084.stdout:2179: finishing rollback tid 2 to smithi084102331-10 2024-01-13T18:08:00.351 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1088 (ObjNum 535 snap 173 seq_num 535) dirty exists 2024-01-13T18:08:00.351 INFO:tasks.rados.rados.0.smithi084.stdout:2180: finishing copy_from to smithi084102331-27 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1092 (ObjNum 97 snap 0 seq_num 4037098864) dirty exists 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:2180: finishing copy_from racing read to smithi084102331-27 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:2178: finishing write tid 3 to smithi084102331-48 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:2175: done (3 left) 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:2179: done (2 left) 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:2180: done (1 left) 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 215 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:2178: finishing write tid 4 to smithi084102331-48 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:2178: finishing write tid 5 to smithi084102331-48 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:2178: finishing write tid 6 to smithi084102331-48 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1131 (ObjNum 685 snap 215 seq_num 685) dirty exists 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:2178: left oid 48 (ObjNum 685 snap 215 seq_num 685) 2024-01-13T18:08:00.352 INFO:tasks.rados.rados.0.smithi084.stdout:2181: seq_num 686 ranges {1130496=696320,1826816=729088,2555904=425984,2981888=49152} 2024-01-13T18:08:00.360 INFO:tasks.rados.rados.0.smithi084.stdout:2181: writing smithi084102331-14 from 1130496 to 1826816 tid 1 2024-01-13T18:08:00.364 INFO:tasks.rados.rados.0.smithi084.stdout:2181: writing smithi084102331-14 from 1826816 to 2555904 tid 2 2024-01-13T18:08:00.367 INFO:tasks.rados.rados.0.smithi084.stdout:2181: writing smithi084102331-14 from 2555904 to 2981888 tid 3 2024-01-13T18:08:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:2181: writing smithi084102331-14 from 2981888 to 3031040 tid 4 2024-01-13T18:08:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:2178: done (1 left) 2024-01-13T18:08:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:2182: read oid 48 snap -1 2024-01-13T18:08:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:2182: expect (ObjNum 685 snap 215 seq_num 685) 2024-01-13T18:08:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:2183: rollback oid 16 current snap is 215 2024-01-13T18:08:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 16 to 214 2024-01-13T18:08:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:2181: finishing write tid 1 to smithi084102331-14 2024-01-13T18:08:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:2181: finishing write tid 2 to smithi084102331-14 2024-01-13T18:08:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 215 2024-01-13T18:08:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:2184: seq_num 687 ranges {0=712704,712704=614400,1327104=589824} 2024-01-13T18:08:00.372 INFO:tasks.rados.rados.0.smithi084.stdout:2184: writing smithi084102331-42 from 0 to 712704 tid 1 2024-01-13T18:08:00.376 INFO:tasks.rados.rados.0.smithi084.stdout:2184: writing smithi084102331-42 from 712704 to 1327104 tid 2 2024-01-13T18:08:00.379 INFO:tasks.rados.rados.0.smithi084.stdout:2184: writing smithi084102331-42 from 1327104 to 1916928 tid 3 2024-01-13T18:08:00.379 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 215 2024-01-13T18:08:00.380 INFO:tasks.rados.rados.0.smithi084.stdout:2181: finishing write tid 3 to smithi084102331-14 2024-01-13T18:08:00.380 INFO:tasks.rados.rados.0.smithi084.stdout:2185: seq_num 688 ranges {2539520=729088,3268608=499712,3768320=704512} 2024-01-13T18:08:00.397 INFO:tasks.rados.rados.0.smithi084.stdout:2185: writing smithi084102331-11 from 2539520 to 3268608 tid 1 2024-01-13T18:08:00.400 INFO:tasks.rados.rados.0.smithi084.stdout:2185: writing smithi084102331-11 from 3268608 to 3768320 tid 2 2024-01-13T18:08:00.405 INFO:tasks.rados.rados.0.smithi084.stdout:2185: writing smithi084102331-11 from 3768320 to 4472832 tid 3 2024-01-13T18:08:00.405 INFO:tasks.rados.rados.0.smithi084.stdout:2186: snap_create 2024-01-13T18:08:00.405 INFO:tasks.rados.rados.0.smithi084.stdout:2181: finishing write tid 4 to smithi084102331-14 2024-01-13T18:08:00.405 INFO:tasks.rados.rados.0.smithi084.stdout:2181: finishing write tid 5 to smithi084102331-14 2024-01-13T18:08:00.405 INFO:tasks.rados.rados.0.smithi084.stdout:2183: finishing rollback tid 0 to smithi084102331-16 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:2183: finishing rollback tid 1 to smithi084102331-16 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:2183: finishing rollback tid 2 to smithi084102331-16 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1095 (ObjNum 579 snap 185 seq_num 579) dirty exists 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:2181: finishing write tid 6 to smithi084102331-14 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1091 (ObjNum 686 snap 215 seq_num 686) dirty exists 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:2181: left oid 14 (ObjNum 686 snap 215 seq_num 686) 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:2184: finishing write tid 1 to smithi084102331-42 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:2184: finishing write tid 2 to smithi084102331-42 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:2184: finishing write tid 3 to smithi084102331-42 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:2184: finishing write tid 4 to smithi084102331-42 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:2184: finishing write tid 5 to smithi084102331-42 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 900 (ObjNum 687 snap 215 seq_num 687) dirty exists 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:2184: left oid 42 (ObjNum 687 snap 215 seq_num 687) 2024-01-13T18:08:00.406 INFO:tasks.rados.rados.0.smithi084.stdout:2185: finishing write tid 1 to smithi084102331-11 2024-01-13T18:08:00.407 INFO:tasks.rados.rados.0.smithi084.stdout:2185: finishing write tid 2 to smithi084102331-11 2024-01-13T18:08:00.408 INFO:tasks.rados.rados.0.smithi084.stdout:2185: finishing write tid 3 to smithi084102331-11 2024-01-13T18:08:00.408 INFO:tasks.rados.rados.0.smithi084.stdout:2185: finishing write tid 4 to smithi084102331-11 2024-01-13T18:08:00.409 INFO:tasks.rados.rados.0.smithi084.stdout:2185: finishing write tid 5 to smithi084102331-11 2024-01-13T18:08:00.410 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1096 (ObjNum 688 snap 215 seq_num 688) dirty exists 2024-01-13T18:08:00.410 INFO:tasks.rados.rados.0.smithi084.stdout:2185: left oid 11 (ObjNum 688 snap 215 seq_num 688) 2024-01-13T18:08:00.410 INFO:tasks.rados.rados.0.smithi084.stdout:2182: expect (ObjNum 685 snap 215 seq_num 685) 2024-01-13T18:08:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:08:00] "GET /metrics HTTP/1.1" 200 36196 "" "Prometheus/2.43.0" 2024-01-13T18:08:00.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: osdmap e499: 8 total, 8 up, 8 in 2024-01-13T18:08:00.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: pgmap v460: 121 pgs: 121 active+clean; 245 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 8 op/s 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:00 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:00.988 INFO:tasks.rados.rados.0.smithi084.stdout:2181: done (5 left) 2024-01-13T18:08:00.988 INFO:tasks.rados.rados.0.smithi084.stdout:2182: done (4 left) 2024-01-13T18:08:00.988 INFO:tasks.rados.rados.0.smithi084.stdout:2183: done (3 left) 2024-01-13T18:08:00.988 INFO:tasks.rados.rados.0.smithi084.stdout:2184: done (2 left) 2024-01-13T18:08:00.988 INFO:tasks.rados.rados.0.smithi084.stdout:2185: done (1 left) 2024-01-13T18:08:00.988 INFO:tasks.rados.rados.0.smithi084.stdout:2186: done (0 left) 2024-01-13T18:08:00.988 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 216 2024-01-13T18:08:00.988 INFO:tasks.rados.rados.0.smithi084.stdout:2187: seq_num 689 ranges {4300800=745472,5046272=786432,5832704=417792} 2024-01-13T18:08:01.014 INFO:tasks.rados.rados.0.smithi084.stdout:2187: writing smithi084102331-49 from 4300800 to 5046272 tid 1 2024-01-13T18:08:01.018 INFO:tasks.rados.rados.0.smithi084.stdout:2187: writing smithi084102331-49 from 5046272 to 5832704 tid 2 2024-01-13T18:08:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2187: writing smithi084102331-49 from 5832704 to 6250496 tid 3 2024-01-13T18:08:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2188: delete oid 40 current snap is 216 2024-01-13T18:08:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2187: finishing write tid 1 to smithi084102331-49 2024-01-13T18:08:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2187: finishing write tid 2 to smithi084102331-49 2024-01-13T18:08:01.023 INFO:tasks.rados.rados.0.smithi084.stdout:2187: finishing write tid 3 to smithi084102331-49 2024-01-13T18:08:01.024 INFO:tasks.rados.rados.0.smithi084.stdout:2187: finishing write tid 4 to smithi084102331-49 2024-01-13T18:08:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:2188: done (1 left) 2024-01-13T18:08:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:2189: read oid 6 snap 208 2024-01-13T18:08:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:2189: expect deleted 2024-01-13T18:08:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:2190: rollback oid 3 current snap is 216 2024-01-13T18:08:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 215 2024-01-13T18:08:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:2187: finishing write tid 5 to smithi084102331-49 2024-01-13T18:08:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1095 (ObjNum 689 snap 216 seq_num 689) dirty exists 2024-01-13T18:08:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:2187: left oid 49 (ObjNum 689 snap 216 seq_num 689) 2024-01-13T18:08:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:2187: done (2 left) 2024-01-13T18:08:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:2191: read oid 9 snap -1 2024-01-13T18:08:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:2191: expect deleted 2024-01-13T18:08:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 216 2024-01-13T18:08:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:2192: seq_num 691 ranges {892928=778240,1671168=548864,2220032=614400,2834432=40960} 2024-01-13T18:08:01.035 INFO:tasks.rados.rados.0.smithi084.stdout:2192: writing smithi084102331-15 from 892928 to 1671168 tid 1 2024-01-13T18:08:01.038 INFO:tasks.rados.rados.0.smithi084.stdout:2192: writing smithi084102331-15 from 1671168 to 2220032 tid 2 2024-01-13T18:08:01.041 INFO:tasks.rados.rados.0.smithi084.stdout:2192: writing smithi084102331-15 from 2220032 to 2834432 tid 3 2024-01-13T18:08:01.042 INFO:tasks.rados.rados.0.smithi084.stdout:2192: writing smithi084102331-15 from 2834432 to 2875392 tid 4 2024-01-13T18:08:01.042 INFO:tasks.rados.rados.0.smithi084.stdout:2193: read oid 5 snap -1 2024-01-13T18:08:01.042 INFO:tasks.rados.rados.0.smithi084.stdout:2193: expect (ObjNum 617 snap 196 seq_num 617) 2024-01-13T18:08:01.042 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 216 2024-01-13T18:08:01.042 INFO:tasks.rados.rados.0.smithi084.stdout:2194: seq_num 692 ranges {0=794624,794624=483328,1277952=720896} 2024-01-13T18:08:01.046 INFO:tasks.rados.rados.0.smithi084.stdout:2194: writing smithi084102331-40 from 0 to 794624 tid 1 2024-01-13T18:08:01.050 INFO:tasks.rados.rados.0.smithi084.stdout:2194: writing smithi084102331-40 from 794624 to 1277952 tid 2 2024-01-13T18:08:01.054 INFO:tasks.rados.rados.0.smithi084.stdout:2194: writing smithi084102331-40 from 1277952 to 1998848 tid 3 2024-01-13T18:08:01.054 INFO:tasks.rados.rados.0.smithi084.stdout:2189: done (5 left) 2024-01-13T18:08:01.054 INFO:tasks.rados.rados.0.smithi084.stdout:2191: done (4 left) 2024-01-13T18:08:01.054 INFO:tasks.rados.rados.0.smithi084.stdout:2195: snap_remove snap 197 2024-01-13T18:08:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: osdmap e499: 8 total, 8 up, 8 in 2024-01-13T18:08:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: pgmap v460: 121 pgs: 121 active+clean; 245 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 8 op/s 2024-01-13T18:08:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:08:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:08:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: osdmap e499: 8 total, 8 up, 8 in 2024-01-13T18:08:01.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:01.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:01.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:01.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:01.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:01.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: pgmap v460: 121 pgs: 121 active+clean; 245 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 8 op/s 2024-01-13T18:08:01.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:08:01.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-01-13T18:08:01.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:00 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:01.771 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:08:01.971 INFO:tasks.rados.rados.0.smithi084.stdout:2195: done (4 left) 2024-01-13T18:08:01.971 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 216 2024-01-13T18:08:01.971 INFO:tasks.rados.rados.0.smithi084.stdout:2196: seq_num 693 ranges {4456448=409600,4866048=770048,5636096=581632,6217728=253952} 2024-01-13T18:08:01.998 INFO:tasks.rados.rados.0.smithi084.stdout:2196: writing smithi084102331-7 from 4456448 to 4866048 tid 1 2024-01-13T18:08:02.003 INFO:tasks.rados.rados.0.smithi084.stdout:2196: writing smithi084102331-7 from 4866048 to 5636096 tid 2 2024-01-13T18:08:02.007 INFO:tasks.rados.rados.0.smithi084.stdout:2196: writing smithi084102331-7 from 5636096 to 6217728 tid 3 2024-01-13T18:08:02.009 INFO:tasks.rados.rados.0.smithi084.stdout:2196: writing smithi084102331-7 from 6217728 to 6471680 tid 4 2024-01-13T18:08:02.009 INFO:tasks.rados.rados.0.smithi084.stdout:2197: read oid 26 snap -1 2024-01-13T18:08:02.009 INFO:tasks.rados.rados.0.smithi084.stdout:2197: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:08:02.009 INFO:tasks.rados.rados.0.smithi084.stdout:2198: rollback oid 20 current snap is 216 2024-01-13T18:08:02.009 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 186 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2190: finishing rollback tid 0 to smithi084102331-3 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2190: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2190: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1242 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2192: finishing write tid 1 to smithi084102331-15 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2190: done (6 left) 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2199: read oid 11 snap 208 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2199: expect (ObjNum 578 snap 185 seq_num 578) 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2200: rollback oid 42 current snap is 216 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2192: finishing write tid 2 to smithi084102331-15 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2192: finishing write tid 3 to smithi084102331-15 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2192: finishing write tid 4 to smithi084102331-15 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2192: finishing write tid 5 to smithi084102331-15 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2192: finishing write tid 6 to smithi084102331-15 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1093 (ObjNum 691 snap 216 seq_num 691) dirty exists 2024-01-13T18:08:02.010 INFO:tasks.rados.rados.0.smithi084.stdout:2192: left oid 15 (ObjNum 691 snap 216 seq_num 691) 2024-01-13T18:08:02.011 INFO:tasks.rados.rados.0.smithi084.stdout:2194: finishing write tid 1 to smithi084102331-40 2024-01-13T18:08:02.011 INFO:tasks.rados.rados.0.smithi084.stdout:2193: expect (ObjNum 617 snap 196 seq_num 617) 2024-01-13T18:08:02.100 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:01 smithi099 ceph-mon[138788]: osdmap e500: 8 total, 8 up, 8 in 2024-01-13T18:08:02.101 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:01 smithi099 ceph-mon[138788]: Upgrade: Updating grafana.a 2024-01-13T18:08:02.101 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:01 smithi099 ceph-mon[138788]: Deploying daemon grafana.a on smithi099 2024-01-13T18:08:02.110 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:08:02.234 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (7s) 5s ago 8m 15.7M - 0.25.0 c8568f914cd2 9e6210ff16cf 2024-01-13T18:08:02.234 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (5m) 14s ago 8m 89.9M - 9.4.7 954c08fa6188 b6d642480644 2024-01-13T18:08:02.234 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (49s) 5s ago 9m 15.4M - 18.2.1-242-gd2f11f33 f16b14f4c75d b6b0859480c3 2024-01-13T18:08:02.234 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (37s) 14s ago 9m 13.5M - 18.2.1-242-gd2f11f33 f16b14f4c75d 0af9024fe2b0 2024-01-13T18:08:02.234 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (5m) 14s ago 11m 449M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:08:02.234 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (5m) 5s ago 13m 522M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:08:02.234 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (5m) 5s ago 13m 118M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d b64908c7a53c 2024-01-13T18:08:02.234 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (4m) 14s ago 12m 77.8M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d be7bb477ea53 2024-01-13T18:08:02.234 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (5m) 5s ago 12m 83.5M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d e13f01b852ff 2024-01-13T18:08:02.235 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (29s) 5s ago 8m 8476k - 1.5.0 0da6a335fe13 7c868edb84c9 2024-01-13T18:08:02.235 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (26s) 14s ago 8m 8678k - 1.5.0 0da6a335fe13 de648a983ac9 2024-01-13T18:08:02.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 5s ago 11m 534M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d e18181bdb4a8 2024-01-13T18:08:02.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (3m) 5s ago 11m 328M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 32bdce285b36 2024-01-13T18:08:02.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (3m) 5s ago 11m 296M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 660c53389079 2024-01-13T18:08:02.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (2m) 5s ago 10m 280M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 0e4b8c3482a4 2024-01-13T18:08:02.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (2m) 14s ago 10m 328M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 76d7d19ec531 2024-01-13T18:08:02.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (2m) 14s ago 10m 310M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 5cf0e9339ca9 2024-01-13T18:08:02.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (91s) 14s ago 10m 191M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 919ac0aa6c87 2024-01-13T18:08:02.235 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (63s) 14s ago 9m 110M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 237ebd4a72cd 2024-01-13T18:08:02.235 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (16s) 14s ago 9m 43.7M - 2.43.0 a07b618ecd1d eaa04d6e16c5 2024-01-13T18:08:02.236 INFO:tasks.rados.rados.0.smithi084.stdout:2194: finishing write tid 2 to smithi084102331-40 2024-01-13T18:08:02.236 INFO:tasks.rados.rados.0.smithi084.stdout:2194: finishing write tid 3 to smithi084102331-40 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:2194: finishing write tid 4 to smithi084102331-40 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:2194: finishing write tid 5 to smithi084102331-40 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 785 (ObjNum 692 snap 216 seq_num 692) dirty exists 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:2194: left oid 40 (ObjNum 692 snap 216 seq_num 692) 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:2196: finishing write tid 1 to smithi084102331-7 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 208 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:2196: finishing write tid 2 to smithi084102331-7 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:2196: finishing write tid 3 to smithi084102331-7 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:2196: finishing write tid 4 to smithi084102331-7 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:2196: finishing write tid 5 to smithi084102331-7 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:2196: finishing write tid 6 to smithi084102331-7 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1088 (ObjNum 693 snap 216 seq_num 693) dirty exists 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:2196: left oid 7 (ObjNum 693 snap 216 seq_num 693) 2024-01-13T18:08:02.237 INFO:tasks.rados.rados.0.smithi084.stdout:2198: finishing rollback tid 0 to smithi084102331-20 2024-01-13T18:08:02.238 INFO:tasks.rados.rados.0.smithi084.stdout:2198: finishing rollback tid 1 to smithi084102331-20 2024-01-13T18:08:02.238 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 640 (ObjNum 129 snap 0 seq_num 4037690264) dirty dne 2024-01-13T18:08:02.238 INFO:tasks.rados.rados.0.smithi084.stdout:2197: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:08:02.238 INFO:tasks.rados.rados.0.smithi084.stdout:2199: expect (ObjNum 578 snap 185 seq_num 578) 2024-01-13T18:08:02.302 INFO:tasks.rados.rados.0.smithi084.stdout:2200: finishing rollback tid 0 to smithi084102331-42 2024-01-13T18:08:02.302 INFO:tasks.rados.rados.0.smithi084.stdout:2192: done (7 left) 2024-01-13T18:08:02.302 INFO:tasks.rados.rados.0.smithi084.stdout:2193: done (6 left) 2024-01-13T18:08:02.302 INFO:tasks.rados.rados.0.smithi084.stdout:2194: done (5 left) 2024-01-13T18:08:02.302 INFO:tasks.rados.rados.0.smithi084.stdout:2196: done (4 left) 2024-01-13T18:08:02.302 INFO:tasks.rados.rados.0.smithi084.stdout:2197: done (3 left) 2024-01-13T18:08:02.302 INFO:tasks.rados.rados.0.smithi084.stdout:2198: done (2 left) 2024-01-13T18:08:02.302 INFO:tasks.rados.rados.0.smithi084.stdout:2199: done (1 left) 2024-01-13T18:08:02.302 INFO:tasks.rados.rados.0.smithi084.stdout:2201: snap_create 2024-01-13T18:08:02.302 INFO:tasks.rados.rados.0.smithi084.stdout:2200: finishing rollback tid 1 to smithi084102331-42 2024-01-13T18:08:02.302 INFO:tasks.rados.rados.0.smithi084.stdout:2200: finishing rollback tid 2 to smithi084102331-42 2024-01-13T18:08:02.303 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 903 (ObjNum 656 snap 206 seq_num 656) dirty exists 2024-01-13T18:08:02.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:01 smithi084 ceph-mon[116404]: osdmap e500: 8 total, 8 up, 8 in 2024-01-13T18:08:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:01 smithi084 ceph-mon[116404]: Upgrade: Updating grafana.a 2024-01-13T18:08:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:01 smithi084 ceph-mon[116404]: Deploying daemon grafana.a on smithi099 2024-01-13T18:08:02.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:01 smithi084 ceph-mon[119097]: osdmap e500: 8 total, 8 up, 8 in 2024-01-13T18:08:02.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:01 smithi084 ceph-mon[119097]: Upgrade: Updating grafana.a 2024-01-13T18:08:02.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:01 smithi084 ceph-mon[119097]: Deploying daemon grafana.a on smithi099 2024-01-13T18:08:02.498 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:08:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:08:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:08:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:08:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:08:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:08:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:08:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:08:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 8 2024-01-13T18:08:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:08:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:08:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:08:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:08:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:08:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 15 2024-01-13T18:08:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:08:02.499 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:08:02.650 INFO:tasks.rados.rados.0.smithi084.stdout:2200: done (1 left) 2024-01-13T18:08:02.650 INFO:tasks.rados.rados.0.smithi084.stdout:2201: done (0 left) 2024-01-13T18:08:02.650 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 217 2024-01-13T18:08:02.650 INFO:tasks.rados.rados.0.smithi084.stdout:2202: seq_num 694 ranges {13148160=425984,13574144=655360,14229504=786432,15015936=163840} 2024-01-13T18:08:02.719 INFO:tasks.rados.rados.0.smithi084.stdout:2202: writing smithi084102331-50 from 13148160 to 13574144 tid 1 2024-01-13T18:08:02.723 INFO:tasks.rados.rados.0.smithi084.stdout:2202: writing smithi084102331-50 from 13574144 to 14229504 tid 2 2024-01-13T18:08:02.727 INFO:tasks.rados.rados.0.smithi084.stdout:2202: writing smithi084102331-50 from 14229504 to 15015936 tid 3 2024-01-13T18:08:02.729 INFO:tasks.rados.rados.0.smithi084.stdout:2202: writing smithi084102331-50 from 15015936 to 15179776 tid 4 2024-01-13T18:08:02.729 INFO:tasks.rados.rados.0.smithi084.stdout:2203: read oid 28 snap 208 2024-01-13T18:08:02.729 INFO:tasks.rados.rados.0.smithi084.stdout:2203: expect (ObjNum 252 snap 75 seq_num 252) 2024-01-13T18:08:02.729 INFO:tasks.rados.rados.0.smithi084.stdout:2204: snap_remove snap 215 2024-01-13T18:08:03.119 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:02 smithi099 systemd[1]: Stopping Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:08:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:02 smithi099 ceph-mon[138788]: from='client.34383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:03.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:02 smithi099 ceph-mon[138788]: osdmap e501: 8 total, 8 up, 8 in 2024-01-13T18:08:03.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:02 smithi099 ceph-mon[138788]: pgmap v463: 121 pgs: 121 active+clean; 270 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 6.9 MiB/s wr, 26 op/s 2024-01-13T18:08:03.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:02 smithi099 ceph-mon[138788]: from='client.34389 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:03.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:02 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1920686526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:03.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:02 smithi099 ceph-mon[138788]: osdmap e502: 8 total, 8 up, 8 in 2024-01-13T18:08:03.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[119097]: from='client.34383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:03.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[119097]: osdmap e501: 8 total, 8 up, 8 in 2024-01-13T18:08:03.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[119097]: pgmap v463: 121 pgs: 121 active+clean; 270 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 6.9 MiB/s wr, 26 op/s 2024-01-13T18:08:03.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[119097]: from='client.34389 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:03.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1920686526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:03.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[119097]: osdmap e502: 8 total, 8 up, 8 in 2024-01-13T18:08:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[116404]: from='client.34383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[116404]: osdmap e501: 8 total, 8 up, 8 in 2024-01-13T18:08:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[116404]: pgmap v463: 121 pgs: 121 active+clean; 270 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 6.9 MiB/s wr, 26 op/s 2024-01-13T18:08:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[116404]: from='client.34389 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1920686526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:02 smithi084 ceph-mon[116404]: osdmap e502: 8 total, 8 up, 8 in 2024-01-13T18:08:03.572 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:03 smithi099 bash[185617]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a 2024-01-13T18:08:03.572 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:03 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-01-13T18:08:03.659 INFO:tasks.rados.rados.0.smithi084.stdout:2204: done (2 left) 2024-01-13T18:08:03.659 INFO:tasks.rados.rados.0.smithi084.stdout:2205: read oid 15 snap -1 2024-01-13T18:08:03.659 INFO:tasks.rados.rados.0.smithi084.stdout:2205: expect (ObjNum 691 snap 216 seq_num 691) 2024-01-13T18:08:03.661 INFO:tasks.rados.rados.0.smithi084.stdout:2206: setattr oid 48 current snap is 217 2024-01-13T18:08:03.662 INFO:tasks.rados.rados.0.smithi084.stdout:2207: rollback oid 46 current snap is 217 2024-01-13T18:08:03.662 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 216 2024-01-13T18:08:03.662 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 217 2024-01-13T18:08:03.662 INFO:tasks.rados.rados.0.smithi084.stdout:2208: seq_num 695 ranges {6471680=442368,6914048=540672,7454720=598016,8052736=466944} 2024-01-13T18:08:03.699 INFO:tasks.rados.rados.0.smithi084.stdout:2208: writing smithi084102331-7 from 6471680 to 6914048 tid 1 2024-01-13T18:08:03.702 INFO:tasks.rados.rados.0.smithi084.stdout:2208: writing smithi084102331-7 from 6914048 to 7454720 tid 2 2024-01-13T18:08:03.705 INFO:tasks.rados.rados.0.smithi084.stdout:2208: writing smithi084102331-7 from 7454720 to 8052736 tid 3 2024-01-13T18:08:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:2208: writing smithi084102331-7 from 8052736 to 8519680 tid 4 2024-01-13T18:08:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:2209: copy_from oid 18 from oid 19 current snap is 217 2024-01-13T18:08:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:2202: finishing write tid 1 to smithi084102331-50 2024-01-13T18:08:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:2202: finishing write tid 2 to smithi084102331-50 2024-01-13T18:08:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:2202: finishing write tid 3 to smithi084102331-50 2024-01-13T18:08:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:2202: finishing write tid 4 to smithi084102331-50 2024-01-13T18:08:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:2202: finishing write tid 5 to smithi084102331-50 2024-01-13T18:08:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:2202: finishing write tid 6 to smithi084102331-50 2024-01-13T18:08:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 1034 (ObjNum 694 snap 217 seq_num 694) dirty exists 2024-01-13T18:08:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:2202: left oid 50 (ObjNum 694 snap 217 seq_num 694) 2024-01-13T18:08:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:2203: expect (ObjNum 252 snap 75 seq_num 252) 2024-01-13T18:08:03.760 INFO:tasks.rados.rados.0.smithi084.stdout:2207: finishing rollback tid 1 to smithi084102331-46 2024-01-13T18:08:03.760 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 0 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-01-13T18:08:03.760 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1139 (ObjNum 685 snap 215 seq_num 685) dirty exists 2024-01-13T18:08:03.760 INFO:tasks.rados.rados.0.smithi084.stdout:2205: expect (ObjNum 691 snap 216 seq_num 691) 2024-01-13T18:08:03.843 INFO:tasks.rados.rados.0.smithi084.stdout:2208: finishing write tid 1 to smithi084102331-7 2024-01-13T18:08:03.843 INFO:tasks.rados.rados.0.smithi084.stdout:2208: finishing write tid 2 to smithi084102331-7 2024-01-13T18:08:03.843 INFO:tasks.rados.rados.0.smithi084.stdout:2208: finishing write tid 3 to smithi084102331-7 2024-01-13T18:08:03.843 INFO:tasks.rados.rados.0.smithi084.stdout:2208: finishing write tid 4 to smithi084102331-7 2024-01-13T18:08:03.843 INFO:tasks.rados.rados.0.smithi084.stdout:2208: finishing write tid 5 to smithi084102331-7 2024-01-13T18:08:03.843 INFO:tasks.rados.rados.0.smithi084.stdout:2208: finishing write tid 6 to smithi084102331-7 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1093 (ObjNum 695 snap 217 seq_num 695) dirty exists 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:2208: left oid 7 (ObjNum 695 snap 217 seq_num 695) 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:2209: finishing copy_from to smithi084102331-18 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 638 (ObjNum 639 snap 199 seq_num 639) dirty exists 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:2209: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:2202: done (6 left) 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:2203: done (5 left) 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:2205: done (4 left) 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:2206: done (3 left) 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:2207: done (2 left) 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:2208: done (1 left) 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:2209: done (0 left) 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 217 2024-01-13T18:08:03.844 INFO:tasks.rados.rados.0.smithi084.stdout:2210: seq_num 696 ranges {0=458752,458752=417792,876544=753664,1630208=434176} 2024-01-13T18:08:03.845 INFO:tasks.rados.rados.0.smithi084.stdout:2210: writing smithi084102331-25 from 0 to 458752 tid 1 2024-01-13T18:08:03.847 INFO:tasks.rados.rados.0.smithi084.stdout:2210: writing smithi084102331-25 from 458752 to 876544 tid 2 2024-01-13T18:08:03.851 INFO:tasks.rados.rados.0.smithi084.stdout:2210: writing smithi084102331-25 from 876544 to 1630208 tid 3 2024-01-13T18:08:03.854 INFO:tasks.rados.rados.0.smithi084.stdout:2210: writing smithi084102331-25 from 1630208 to 2064384 tid 4 2024-01-13T18:08:03.854 INFO:tasks.rados.rados.0.smithi084.stdout:2211: snap_remove snap 213 2024-01-13T18:08:03.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:03 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-01-13T18:08:03.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:03 smithi099 systemd[1]: Stopped Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:08:03.869 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:03 smithi099 systemd[1]: Starting Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T18:08:04.619 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 bash[185769]: 7de6e2b6a95df0a9e453dc6df3b85356b5f5ae4c268ac13541ddc9a1398ae782 2024-01-13T18:08:04.619 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 systemd[1]: Started Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T18:08:04.619 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.259800702Z level=info msg="Starting Grafana" version=9.4.7 commit=4add91f03d branch=HEAD compiled=2023-03-16T23:56:52Z 2024-01-13T18:08:04.619 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.259987291Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.26000417Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.260010489Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.260016087Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.260021884Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.260027205Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.260032624Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.260038104Z level=info msg="Path Home" path=/usr/share/grafana 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.260043489Z level=info msg="Path Data" path=/var/lib/grafana 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.260048485Z level=info msg="Path Logs" path=/var/log/grafana 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.260053503Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.26005932Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=settings t=2024-01-13T18:08:04.260064724Z level=info msg="App mode production" 2024-01-13T18:08:04.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=sqlstore t=2024-01-13T18:08:04.260126791Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-01-13T18:08:04.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=sqlstore t=2024-01-13T18:08:04.26014255Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-01-13T18:08:04.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=migrator t=2024-01-13T18:08:04.274421677Z level=info msg="Starting DB migrations" 2024-01-13T18:08:04.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=migrator t=2024-01-13T18:08:04.279089432Z level=info msg="migrations completed" performed=0 skipped=481 duration=609.759µs 2024-01-13T18:08:04.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=sqlstore t=2024-01-13T18:08:04.279476018Z level=info msg="Created default organization" 2024-01-13T18:08:04.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=plugin.loader t=2024-01-13T18:08:04.341508071Z level=info msg="Plugin registered" pluginID=input 2024-01-13T18:08:04.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=plugin.loader t=2024-01-13T18:08:04.369435549Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-01-13T18:08:04.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=plugin.loader t=2024-01-13T18:08:04.369482831Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-01-13T18:08:04.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=secrets t=2024-01-13T18:08:04.369518643Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-01-13T18:08:04.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=query_data t=2024-01-13T18:08:04.371230428Z level=info msg="Query Service initialization" 2024-01-13T18:08:04.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=live.push_http t=2024-01-13T18:08:04.37375418Z level=info msg="Live Push Gateway initialization" 2024-01-13T18:08:04.671 INFO:tasks.rados.rados.0.smithi084.stdout:2211: done (1 left) 2024-01-13T18:08:04.671 INFO:tasks.rados.rados.0.smithi084.stdout:2212: snap_remove snap 207 2024-01-13T18:08:04.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:04 smithi084 ceph-mon[116404]: osdmap e503: 8 total, 8 up, 8 in 2024-01-13T18:08:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:04 smithi084 ceph-mon[116404]: pgmap v466: 121 pgs: 121 active+clean; 274 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 7.4 MiB/s wr, 32 op/s 2024-01-13T18:08:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:04 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:04 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:04.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:04 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:04 smithi084 ceph-mon[119097]: osdmap e503: 8 total, 8 up, 8 in 2024-01-13T18:08:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:04 smithi084 ceph-mon[119097]: pgmap v466: 121 pgs: 121 active+clean; 274 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 7.4 MiB/s wr, 32 op/s 2024-01-13T18:08:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:04 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:04 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:04 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-mon[138788]: osdmap e503: 8 total, 8 up, 8 in 2024-01-13T18:08:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-mon[138788]: pgmap v466: 121 pgs: 121 active+clean; 274 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 7.4 MiB/s wr, 32 op/s 2024-01-13T18:08:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:04 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:05.428 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 18:08:05 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[160493]: ts=2024-01-13T18:08:05.084Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.00307048s 2024-01-13T18:08:05.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=infra.usagestats.collector t=2024-01-13T18:08:05.154169229Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-01-13T18:08:05.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=provisioning.datasources t=2024-01-13T18:08:05.244083405Z level=info msg="deleted correlations based on configuration" ds_name=Dashboard1 2024-01-13T18:08:05.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=provisioning.datasources t=2024-01-13T18:08:05.244131303Z level=info msg="deleted datasource based on configuration" name=Dashboard1 2024-01-13T18:08:05.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=provisioning.datasources t=2024-01-13T18:08:05.255329973Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-01-13T18:08:05.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=provisioning.alerting t=2024-01-13T18:08:05.33789669Z level=info msg="starting to provision alerting" 2024-01-13T18:08:05.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=provisioning.alerting t=2024-01-13T18:08:05.337929544Z level=info msg="finished to provision alerting" 2024-01-13T18:08:05.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=ngalert.state.manager t=2024-01-13T18:08:05.338014731Z level=info msg="Warming state cache for startup" 2024-01-13T18:08:05.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=grafanaStorageLogger t=2024-01-13T18:08:05.3380832Z level=info msg="storage starting" 2024-01-13T18:08:05.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=http.server t=2024-01-13T18:08:05.339881703Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-01-13T18:08:05.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=ngalert.state.manager t=2024-01-13T18:08:05.351450859Z level=info msg="State cache has been initialized" states=0 duration=13.43563ms 2024-01-13T18:08:05.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=ticker t=2024-01-13T18:08:05.35150416Z level=info msg=starting first_tick=2024-01-13T18:08:10Z 2024-01-13T18:08:05.453 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=ngalert.multiorg.alertmanager t=2024-01-13T18:08:05.351505807Z level=info msg="starting MultiOrg Alertmanager" 2024-01-13T18:08:05.672 INFO:tasks.rados.rados.0.smithi084.stdout:2212: done (1 left) 2024-01-13T18:08:05.672 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 217 2024-01-13T18:08:05.672 INFO:tasks.rados.rados.0.smithi084.stdout:2213: seq_num 697 ranges {0=475136,475136=704512,1179648=557056,1736704=344064} 2024-01-13T18:08:05.675 INFO:tasks.rados.rados.0.smithi084.stdout:2213: writing smithi084102331-31 from 0 to 475136 tid 1 2024-01-13T18:08:05.679 INFO:tasks.rados.rados.0.smithi084.stdout:2213: writing smithi084102331-31 from 475136 to 1179648 tid 2 2024-01-13T18:08:05.684 INFO:tasks.rados.rados.0.smithi084.stdout:2213: writing smithi084102331-31 from 1179648 to 1736704 tid 3 2024-01-13T18:08:05.686 INFO:tasks.rados.rados.0.smithi084.stdout:2213: writing smithi084102331-31 from 1736704 to 2080768 tid 4 2024-01-13T18:08:05.687 INFO:tasks.rados.rados.0.smithi084.stdout:2214: setattr oid 32 current snap is 217 2024-01-13T18:08:05.687 INFO:tasks.rados.rados.0.smithi084.stdout:2210: finishing write tid 1 to smithi084102331-25 2024-01-13T18:08:05.687 INFO:tasks.rados.rados.0.smithi084.stdout:2210: finishing write tid 2 to smithi084102331-25 2024-01-13T18:08:05.687 INFO:tasks.rados.rados.0.smithi084.stdout:2210: finishing write tid 3 to smithi084102331-25 2024-01-13T18:08:05.687 INFO:tasks.rados.rados.0.smithi084.stdout:2210: finishing write tid 4 to smithi084102331-25 2024-01-13T18:08:05.687 INFO:tasks.rados.rados.0.smithi084.stdout:2210: finishing write tid 5 to smithi084102331-25 2024-01-13T18:08:05.687 INFO:tasks.rados.rados.0.smithi084.stdout:2210: finishing write tid 6 to smithi084102331-25 2024-01-13T18:08:05.687 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1039 (ObjNum 696 snap 217 seq_num 696) dirty exists 2024-01-13T18:08:05.687 INFO:tasks.rados.rados.0.smithi084.stdout:2210: left oid 25 (ObjNum 696 snap 217 seq_num 696) 2024-01-13T18:08:05.688 INFO:tasks.rados.rados.0.smithi084.stdout:2210: done (2 left) 2024-01-13T18:08:05.688 INFO:tasks.rados.rados.0.smithi084.stdout:2215: rollback oid 11 current snap is 217 2024-01-13T18:08:05.689 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 11 to 216 2024-01-13T18:08:05.689 INFO:tasks.rados.rados.0.smithi084.stdout:2216: read oid 47 snap -1 2024-01-13T18:08:05.689 INFO:tasks.rados.rados.0.smithi084.stdout:2216: expect deleted 2024-01-13T18:08:05.689 INFO:tasks.rados.rados.0.smithi084.stdout:2217: setattr oid 23 current snap is 217 2024-01-13T18:08:05.691 INFO:tasks.rados.rados.0.smithi084.stdout:2218: read oid 6 snap 214 2024-01-13T18:08:05.691 INFO:tasks.rados.rados.0.smithi084.stdout:2218: expect deleted 2024-01-13T18:08:05.692 INFO:tasks.rados.rados.0.smithi084.stdout:2219: snap_create 2024-01-13T18:08:05.697 INFO:tasks.rados.rados.0.smithi084.stdout:2213: finishing write tid 1 to smithi084102331-31 2024-01-13T18:08:05.697 INFO:tasks.rados.rados.0.smithi084.stdout:2213: finishing write tid 2 to smithi084102331-31 2024-01-13T18:08:05.700 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1143 (ObjNum 634 snap 199 seq_num 634) dirty exists 2024-01-13T18:08:05.700 INFO:tasks.rados.rados.0.smithi084.stdout:2213: finishing write tid 3 to smithi084102331-31 2024-01-13T18:08:05.700 INFO:tasks.rados.rados.0.smithi084.stdout:2213: finishing write tid 4 to smithi084102331-31 2024-01-13T18:08:05.701 INFO:tasks.rados.rados.0.smithi084.stdout:2213: finishing write tid 5 to smithi084102331-31 2024-01-13T18:08:05.701 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1107 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:08:05.702 INFO:tasks.rados.rados.0.smithi084.stdout:2215: finishing rollback tid 0 to smithi084102331-11 2024-01-13T18:08:05.702 INFO:tasks.rados.rados.0.smithi084.stdout:2213: finishing write tid 6 to smithi084102331-31 2024-01-13T18:08:05.703 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1263 (ObjNum 697 snap 217 seq_num 697) dirty exists 2024-01-13T18:08:05.703 INFO:tasks.rados.rados.0.smithi084.stdout:2213: left oid 31 (ObjNum 697 snap 217 seq_num 697) 2024-01-13T18:08:05.703 INFO:tasks.rados.rados.0.smithi084.stdout:2215: finishing rollback tid 1 to smithi084102331-11 2024-01-13T18:08:05.703 INFO:tasks.rados.rados.0.smithi084.stdout:2215: finishing rollback tid 2 to smithi084102331-11 2024-01-13T18:08:05.703 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1099 (ObjNum 688 snap 215 seq_num 688) dirty exists 2024-01-13T18:08:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-mon[138788]: osdmap e504: 8 total, 8 up, 8 in 2024-01-13T18:08:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:05.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:05 smithi084 ceph-mon[116404]: osdmap e504: 8 total, 8 up, 8 in 2024-01-13T18:08:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:05 smithi084 ceph-mon[119097]: osdmap e504: 8 total, 8 up, 8 in 2024-01-13T18:08:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:06.677 INFO:tasks.rados.rados.0.smithi084.stdout:2213: done (6 left) 2024-01-13T18:08:06.677 INFO:tasks.rados.rados.0.smithi084.stdout:2214: done (5 left) 2024-01-13T18:08:06.677 INFO:tasks.rados.rados.0.smithi084.stdout:2215: done (4 left) 2024-01-13T18:08:06.678 INFO:tasks.rados.rados.0.smithi084.stdout:2216: done (3 left) 2024-01-13T18:08:06.678 INFO:tasks.rados.rados.0.smithi084.stdout:2217: done (2 left) 2024-01-13T18:08:06.678 INFO:tasks.rados.rados.0.smithi084.stdout:2218: done (1 left) 2024-01-13T18:08:06.678 INFO:tasks.rados.rados.0.smithi084.stdout:2219: done (0 left) 2024-01-13T18:08:06.678 INFO:tasks.rados.rados.0.smithi084.stdout:2220: read oid 24 snap -1 2024-01-13T18:08:06.678 INFO:tasks.rados.rados.0.smithi084.stdout:2220: expect (ObjNum 681 snap 215 seq_num 681) 2024-01-13T18:08:06.678 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 218 2024-01-13T18:08:06.678 INFO:tasks.rados.rados.0.smithi084.stdout:2221: seq_num 698 ranges {1024000=499712,1523712=589824,2113536=770048,2883584=245760} 2024-01-13T18:08:06.685 INFO:tasks.rados.rados.0.smithi084.stdout:2221: writing smithi084102331-23 from 1024000 to 1523712 tid 1 2024-01-13T18:08:06.689 INFO:tasks.rados.rados.0.smithi084.stdout:2221: writing smithi084102331-23 from 1523712 to 2113536 tid 2 2024-01-13T18:08:06.693 INFO:tasks.rados.rados.0.smithi084.stdout:2221: writing smithi084102331-23 from 2113536 to 2883584 tid 3 2024-01-13T18:08:06.695 INFO:tasks.rados.rados.0.smithi084.stdout:2221: writing smithi084102331-23 from 2883584 to 3129344 tid 4 2024-01-13T18:08:06.695 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 218 2024-01-13T18:08:06.695 INFO:tasks.rados.rados.0.smithi084.stdout:2222: seq_num 699 ranges {2744320=516096,3260416=475136,3735552=573440,4308992=557056} 2024-01-13T18:08:06.712 INFO:tasks.rados.rados.0.smithi084.stdout:2222: writing smithi084102331-5 from 2744320 to 3260416 tid 1 2024-01-13T18:08:06.715 INFO:tasks.rados.rados.0.smithi084.stdout:2222: writing smithi084102331-5 from 3260416 to 3735552 tid 2 2024-01-13T18:08:06.718 INFO:tasks.rados.rados.0.smithi084.stdout:2222: writing smithi084102331-5 from 3735552 to 4308992 tid 3 2024-01-13T18:08:06.721 INFO:tasks.rados.rados.0.smithi084.stdout:2222: writing smithi084102331-5 from 4308992 to 4866048 tid 4 2024-01-13T18:08:06.722 INFO:tasks.rados.rados.0.smithi084.stdout:2223: snap_remove snap 216 2024-01-13T18:08:06.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:06 smithi084 ceph-mon[116404]: osdmap e505: 8 total, 8 up, 8 in 2024-01-13T18:08:06.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:06 smithi084 ceph-mon[116404]: pgmap v469: 121 pgs: 121 active+clean; 281 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 16 op/s 2024-01-13T18:08:06.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:06 smithi084 ceph-mon[119097]: osdmap e505: 8 total, 8 up, 8 in 2024-01-13T18:08:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:06 smithi084 ceph-mon[119097]: pgmap v469: 121 pgs: 121 active+clean; 281 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 16 op/s 2024-01-13T18:08:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:06 smithi099 ceph-mon[138788]: osdmap e505: 8 total, 8 up, 8 in 2024-01-13T18:08:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:06 smithi099 ceph-mon[138788]: pgmap v469: 121 pgs: 121 active+clean; 281 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 16 op/s 2024-01-13T18:08:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:2223: done (3 left) 2024-01-13T18:08:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:2224: read oid 4 snap 186 2024-01-13T18:08:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:2224: expect deleted 2024-01-13T18:08:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:2225: rollback oid 12 current snap is 218 2024-01-13T18:08:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 208 2024-01-13T18:08:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:2226: read oid 41 snap 208 2024-01-13T18:08:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:2226: expect (ObjNum 661 snap 207 seq_num 661) 2024-01-13T18:08:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:2227: read oid 35 snap -1 2024-01-13T18:08:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:2227: expect (ObjNum 684 snap 215 seq_num 684) 2024-01-13T18:08:07.659 INFO:tasks.rados.rados.0.smithi084.stdout:2228: delete oid 14 current snap is 218 2024-01-13T18:08:07.659 INFO:tasks.rados.rados.0.smithi084.stdout:2220: expect (ObjNum 681 snap 215 seq_num 681) 2024-01-13T18:08:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2221: finishing write tid 1 to smithi084102331-23 2024-01-13T18:08:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2221: finishing write tid 2 to smithi084102331-23 2024-01-13T18:08:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2220: done (7 left) 2024-01-13T18:08:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2228: done (6 left) 2024-01-13T18:08:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2229: rmattr oid 16 current snap is 218 2024-01-13T18:08:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2221: finishing write tid 3 to smithi084102331-23 2024-01-13T18:08:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2221: finishing write tid 4 to smithi084102331-23 2024-01-13T18:08:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2221: finishing write tid 5 to smithi084102331-23 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2221: finishing write tid 6 to smithi084102331-23 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1149 (ObjNum 698 snap 218 seq_num 698) dirty exists 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2221: left oid 23 (ObjNum 698 snap 218 seq_num 698) 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 1 to smithi084102331-5 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 2 to smithi084102331-5 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 3 to smithi084102331-5 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2221: done (6 left) 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2230: rollback oid 43 current snap is 218 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 208 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 4 to smithi084102331-5 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 5 to smithi084102331-5 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 6 to smithi084102331-5 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 810 (ObjNum 699 snap 218 seq_num 699) dirty exists 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2222: left oid 5 (ObjNum 699 snap 218 seq_num 699) 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2225: finishing rollback tid 0 to smithi084102331-12 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2225: finishing rollback tid 1 to smithi084102331-12 2024-01-13T18:08:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:2225: finishing rollback tid 2 to smithi084102331-12 2024-01-13T18:08:07.760 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1157 (ObjNum 564 snap 180 seq_num 564) dirty exists 2024-01-13T18:08:07.760 INFO:tasks.rados.rados.0.smithi084.stdout:2226: expect (ObjNum 661 snap 207 seq_num 661) 2024-01-13T18:08:07.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:07 smithi099 ceph-mon[138788]: osdmap e506: 8 total, 8 up, 8 in 2024-01-13T18:08:07.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:07 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:07.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:07 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:07.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:07 smithi099 ceph-mon[138788]: osdmap e507: 8 total, 8 up, 8 in 2024-01-13T18:08:07.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:07 smithi084 ceph-mon[119097]: osdmap e506: 8 total, 8 up, 8 in 2024-01-13T18:08:07.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:07 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:07.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:07 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:07.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:07 smithi084 ceph-mon[119097]: osdmap e507: 8 total, 8 up, 8 in 2024-01-13T18:08:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:07 smithi084 ceph-mon[116404]: osdmap e506: 8 total, 8 up, 8 in 2024-01-13T18:08:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:07 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:07 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:07.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:07 smithi084 ceph-mon[116404]: osdmap e507: 8 total, 8 up, 8 in 2024-01-13T18:08:07.958 INFO:tasks.rados.rados.0.smithi084.stdout:2227: expect (ObjNum 684 snap 215 seq_num 684) 2024-01-13T18:08:08.504 INFO:tasks.rados.rados.0.smithi084.stdout:2230: finishing rollback tid 0 to smithi084102331-43 2024-01-13T18:08:08.504 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1096 (ObjNum 579 snap 185 seq_num 579) dirty exists 2024-01-13T18:08:08.504 INFO:tasks.rados.rados.0.smithi084.stdout:2230: finishing rollback tid 1 to smithi084102331-43 2024-01-13T18:08:08.504 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1095 (ObjNum 129 snap 0 seq_num 4038692640) dirty dne 2024-01-13T18:08:08.504 INFO:tasks.rados.rados.0.smithi084.stdout:2222: done (6 left) 2024-01-13T18:08:08.504 INFO:tasks.rados.rados.0.smithi084.stdout:2224: done (5 left) 2024-01-13T18:08:08.504 INFO:tasks.rados.rados.0.smithi084.stdout:2225: done (4 left) 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:2226: done (3 left) 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:2227: done (2 left) 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:2229: done (1 left) 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:2230: done (0 left) 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:2231: rmattr oid 21 current snap is 218 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:2231: done (0 left) 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:2232: rollback oid 28 current snap is 218 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 28 to 217 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:2233: read oid 12 snap -1 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:2233: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 218 2024-01-13T18:08:08.505 INFO:tasks.rados.rados.0.smithi084.stdout:2234: seq_num 701 ranges {4866048=548864,5414912=696320,6111232=540672,6651904=368640} 2024-01-13T18:08:08.532 INFO:tasks.rados.rados.0.smithi084.stdout:2234: writing smithi084102331-5 from 4866048 to 5414912 tid 1 2024-01-13T18:08:08.536 INFO:tasks.rados.rados.0.smithi084.stdout:2234: writing smithi084102331-5 from 5414912 to 6111232 tid 2 2024-01-13T18:08:08.539 INFO:tasks.rados.rados.0.smithi084.stdout:2234: writing smithi084102331-5 from 6111232 to 6651904 tid 3 2024-01-13T18:08:08.541 INFO:tasks.rados.rados.0.smithi084.stdout:2234: writing smithi084102331-5 from 6651904 to 7020544 tid 4 2024-01-13T18:08:08.541 INFO:tasks.rados.rados.0.smithi084.stdout:2235: snap_create 2024-01-13T18:08:08.542 INFO:tasks.rados.rados.0.smithi084.stdout:2232: finishing rollback tid 0 to smithi084102331-28 2024-01-13T18:08:08.542 INFO:tasks.rados.rados.0.smithi084.stdout:2232: finishing rollback tid 1 to smithi084102331-28 2024-01-13T18:08:08.542 INFO:tasks.rados.rados.0.smithi084.stdout:2232: finishing rollback tid 2 to smithi084102331-28 2024-01-13T18:08:08.542 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1099 (ObjNum 573 snap 181 seq_num 573) dirty exists 2024-01-13T18:08:08.542 INFO:tasks.rados.rados.0.smithi084.stdout:2233: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:08:08.596 INFO:tasks.rados.rados.0.smithi084.stdout:2234: finishing write tid 1 to smithi084102331-5 2024-01-13T18:08:08.596 INFO:tasks.rados.rados.0.smithi084.stdout:2234: finishing write tid 2 to smithi084102331-5 2024-01-13T18:08:08.596 INFO:tasks.rados.rados.0.smithi084.stdout:2234: finishing write tid 3 to smithi084102331-5 2024-01-13T18:08:08.596 INFO:tasks.rados.rados.0.smithi084.stdout:2234: finishing write tid 4 to smithi084102331-5 2024-01-13T18:08:08.596 INFO:tasks.rados.rados.0.smithi084.stdout:2234: finishing write tid 5 to smithi084102331-5 2024-01-13T18:08:08.596 INFO:tasks.rados.rados.0.smithi084.stdout:2234: finishing write tid 6 to smithi084102331-5 2024-01-13T18:08:08.596 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 817 (ObjNum 701 snap 218 seq_num 701) dirty exists 2024-01-13T18:08:08.596 INFO:tasks.rados.rados.0.smithi084.stdout:2234: left oid 5 (ObjNum 701 snap 218 seq_num 701) 2024-01-13T18:08:08.688 INFO:tasks.rados.rados.0.smithi084.stdout:2232: done (3 left) 2024-01-13T18:08:08.688 INFO:tasks.rados.rados.0.smithi084.stdout:2233: done (2 left) 2024-01-13T18:08:08.688 INFO:tasks.rados.rados.0.smithi084.stdout:2234: done (1 left) 2024-01-13T18:08:08.688 INFO:tasks.rados.rados.0.smithi084.stdout:2235: done (0 left) 2024-01-13T18:08:08.689 INFO:tasks.rados.rados.0.smithi084.stdout:2236: snap_create 2024-01-13T18:08:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:08 smithi099 ceph-mon[138788]: pgmap v472: 121 pgs: 121 active+clean; 291 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.4 MiB/s wr, 31 op/s 2024-01-13T18:08:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:08 smithi084 ceph-mon[116404]: pgmap v472: 121 pgs: 121 active+clean; 291 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.4 MiB/s wr, 31 op/s 2024-01-13T18:08:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:08 smithi084 ceph-mon[119097]: pgmap v472: 121 pgs: 121 active+clean; 291 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.4 MiB/s wr, 31 op/s 2024-01-13T18:08:09.693 INFO:tasks.rados.rados.0.smithi084.stdout:2236: done (0 left) 2024-01-13T18:08:09.693 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 220 2024-01-13T18:08:09.693 INFO:tasks.rados.rados.0.smithi084.stdout:2237: seq_num 702 ranges {4472832=565248,5038080=581632,5619712=745472,6365184=278528} 2024-01-13T18:08:09.720 INFO:tasks.rados.rados.0.smithi084.stdout:2237: writing smithi084102331-11 from 4472832 to 5038080 tid 1 2024-01-13T18:08:09.724 INFO:tasks.rados.rados.0.smithi084.stdout:2237: writing smithi084102331-11 from 5038080 to 5619712 tid 2 2024-01-13T18:08:09.728 INFO:tasks.rados.rados.0.smithi084.stdout:2237: writing smithi084102331-11 from 5619712 to 6365184 tid 3 2024-01-13T18:08:09.730 INFO:tasks.rados.rados.0.smithi084.stdout:2237: writing smithi084102331-11 from 6365184 to 6643712 tid 4 2024-01-13T18:08:09.730 INFO:tasks.rados.rados.0.smithi084.stdout:2238: delete oid 48 current snap is 220 2024-01-13T18:08:09.730 INFO:tasks.rados.rados.0.smithi084.stdout:2237: finishing write tid 1 to smithi084102331-11 2024-01-13T18:08:09.730 INFO:tasks.rados.rados.0.smithi084.stdout:2237: finishing write tid 2 to smithi084102331-11 2024-01-13T18:08:09.734 INFO:tasks.rados.rados.0.smithi084.stdout:2237: finishing write tid 3 to smithi084102331-11 2024-01-13T18:08:09.734 INFO:tasks.rados.rados.0.smithi084.stdout:2237: finishing write tid 4 to smithi084102331-11 2024-01-13T18:08:09.734 INFO:tasks.rados.rados.0.smithi084.stdout:2237: finishing write tid 5 to smithi084102331-11 2024-01-13T18:08:09.734 INFO:tasks.rados.rados.0.smithi084.stdout:2238: done (1 left) 2024-01-13T18:08:09.734 INFO:tasks.rados.rados.0.smithi084.stdout:2239: snap_create 2024-01-13T18:08:09.735 INFO:tasks.rados.rados.0.smithi084.stdout:2237: finishing write tid 6 to smithi084102331-11 2024-01-13T18:08:09.736 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1104 (ObjNum 702 snap 220 seq_num 702) dirty exists 2024-01-13T18:08:09.736 INFO:tasks.rados.rados.0.smithi084.stdout:2237: left oid 11 (ObjNum 702 snap 220 seq_num 702) 2024-01-13T18:08:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:09 smithi099 ceph-mon[138788]: osdmap e508: 8 total, 8 up, 8 in 2024-01-13T18:08:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:09 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[116404]: osdmap e508: 8 total, 8 up, 8 in 2024-01-13T18:08:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:10.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[119097]: osdmap e508: 8 total, 8 up, 8 in 2024-01-13T18:08:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:09 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:08:10] "GET /metrics HTTP/1.1" 200 36195 "" "Prometheus/2.43.0" 2024-01-13T18:08:10.702 INFO:tasks.rados.rados.0.smithi084.stdout:2237: done (1 left) 2024-01-13T18:08:10.702 INFO:tasks.rados.rados.0.smithi084.stdout:2239: done (0 left) 2024-01-13T18:08:10.702 INFO:tasks.rados.rados.0.smithi084.stdout:2240: read oid 1 snap -1 2024-01-13T18:08:10.702 INFO:tasks.rados.rados.0.smithi084.stdout:2240: expect (ObjNum 677 snap 214 seq_num 677) 2024-01-13T18:08:10.703 INFO:tasks.rados.rados.0.smithi084.stdout:2241: read oid 10 snap -1 2024-01-13T18:08:10.703 INFO:tasks.rados.rados.0.smithi084.stdout:2241: expect (ObjNum 535 snap 173 seq_num 535) 2024-01-13T18:08:10.703 INFO:tasks.rados.rados.0.smithi084.stdout:2242: snap_remove snap 186 2024-01-13T18:08:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: osdmap e509: 8 total, 8 up, 8 in 2024-01-13T18:08:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: Upgrade: Finalizing container_image settings 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-01-13T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-01-13T18:08:11.122 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-01-13T18:08:11.123 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: Upgrade: Complete! 2024-01-13T18:08:11.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-01-13T18:08:11.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-01-13T18:08:11.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:11.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:11.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:11.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:11.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:11.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:11.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.124 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: pgmap v475: 121 pgs: 121 active+clean; 296 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 3.1 MiB/s wr, 24 op/s 2024-01-13T18:08:11.125 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: osdmap e509: 8 total, 8 up, 8 in 2024-01-13T18:08:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:08:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:08:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: Upgrade: Finalizing container_image settings 2024-01-13T18:08:11.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-01-13T18:08:11.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-01-13T18:08:11.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-01-13T18:08:11.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: osdmap e509: 8 total, 8 up, 8 in 2024-01-13T18:08:11.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:08:11.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: Upgrade: Finalizing container_image settings 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-01-13T18:08:11.183 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-01-13T18:08:11.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-01-13T18:08:11.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-01-13T18:08:11.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-01-13T18:08:11.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-01-13T18:08:11.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-01-13T18:08:11.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-01-13T18:08:11.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-01-13T18:08:11.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-01-13T18:08:11.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-01-13T18:08:11.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-01-13T18:08:11.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-01-13T18:08:11.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-01-13T18:08:11.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-01-13T18:08:11.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.187 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.187 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.187 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.187 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-01-13T18:08:11.187 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-01-13T18:08:11.187 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: Upgrade: Complete! 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: pgmap v475: 121 pgs: 121 active+clean; 296 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 3.1 MiB/s wr, 24 op/s 2024-01-13T18:08:11.188 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: Upgrade: Complete! 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:08:11.189 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:08:11.190 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:08:11.190 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.190 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: pgmap v475: 121 pgs: 121 active+clean; 296 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 3.1 MiB/s wr, 24 op/s 2024-01-13T18:08:11.190 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:08:11.710 INFO:tasks.rados.rados.0.smithi084.stdout:2242: done (2 left) 2024-01-13T18:08:11.710 INFO:tasks.rados.rados.0.smithi084.stdout:2243: snap_remove snap 198 2024-01-13T18:08:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:11 smithi099 ceph-mon[138788]: osdmap e510: 8 total, 8 up, 8 in 2024-01-13T18:08:12.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:11 smithi084 ceph-mon[116404]: osdmap e510: 8 total, 8 up, 8 in 2024-01-13T18:08:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:11 smithi084 ceph-mon[119097]: osdmap e510: 8 total, 8 up, 8 in 2024-01-13T18:08:12.655 INFO:tasks.rados.rados.0.smithi084.stdout:2243: done (2 left) 2024-01-13T18:08:12.656 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 221 2024-01-13T18:08:12.656 INFO:tasks.rados.rados.0.smithi084.stdout:2244: seq_num 704 ranges {0=598016,598016=745472,1343488=712704,2056192=147456} 2024-01-13T18:08:12.659 INFO:tasks.rados.rados.0.smithi084.stdout:2244: writing smithi084102331-30 from 0 to 598016 tid 1 2024-01-13T18:08:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:2244: writing smithi084102331-30 from 598016 to 1343488 tid 2 2024-01-13T18:08:12.668 INFO:tasks.rados.rados.0.smithi084.stdout:2244: writing smithi084102331-30 from 1343488 to 2056192 tid 3 2024-01-13T18:08:12.670 INFO:tasks.rados.rados.0.smithi084.stdout:2244: writing smithi084102331-30 from 2056192 to 2203648 tid 4 2024-01-13T18:08:12.670 INFO:tasks.rados.rados.0.smithi084.stdout:2245: copy_from oid 33 from oid 11 current snap is 221 2024-01-13T18:08:12.670 INFO:tasks.rados.rados.0.smithi084.stdout:2246: rmattr oid 5 current snap is 221 2024-01-13T18:08:12.671 INFO:tasks.rados.rados.0.smithi084.stdout:2246: done (4 left) 2024-01-13T18:08:12.671 INFO:tasks.rados.rados.0.smithi084.stdout:2247: snap_create 2024-01-13T18:08:12.671 INFO:tasks.rados.rados.0.smithi084.stdout:2240: expect (ObjNum 677 snap 214 seq_num 677) 2024-01-13T18:08:12.722 INFO:tasks.rados.rados.0.smithi084.stdout:2241: expect (ObjNum 535 snap 173 seq_num 535) 2024-01-13T18:08:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:12 smithi099 ceph-mon[138788]: osdmap e511: 8 total, 8 up, 8 in 2024-01-13T18:08:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:12 smithi099 ceph-mon[138788]: pgmap v478: 121 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 114 active+clean; 302 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-01-13T18:08:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:12 smithi099 ceph-mon[138788]: osdmap e512: 8 total, 8 up, 8 in 2024-01-13T18:08:13.145 INFO:tasks.rados.rados.0.smithi084.stdout:2244: finishing write tid 1 to smithi084102331-30 2024-01-13T18:08:13.145 INFO:tasks.rados.rados.0.smithi084.stdout:2244: finishing write tid 2 to smithi084102331-30 2024-01-13T18:08:13.145 INFO:tasks.rados.rados.0.smithi084.stdout:2244: finishing write tid 3 to smithi084102331-30 2024-01-13T18:08:13.145 INFO:tasks.rados.rados.0.smithi084.stdout:2244: finishing write tid 4 to smithi084102331-30 2024-01-13T18:08:13.145 INFO:tasks.rados.rados.0.smithi084.stdout:2244: finishing write tid 5 to smithi084102331-30 2024-01-13T18:08:13.145 INFO:tasks.rados.rados.0.smithi084.stdout:2244: finishing write tid 6 to smithi084102331-30 2024-01-13T18:08:13.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1048 (ObjNum 704 snap 221 seq_num 704) dirty exists 2024-01-13T18:08:13.146 INFO:tasks.rados.rados.0.smithi084.stdout:2244: left oid 30 (ObjNum 704 snap 221 seq_num 704) 2024-01-13T18:08:13.146 INFO:tasks.rados.rados.0.smithi084.stdout:2245: finishing copy_from to smithi084102331-33 2024-01-13T18:08:13.146 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1104 (ObjNum 702 snap 220 seq_num 702) dirty exists 2024-01-13T18:08:13.146 INFO:tasks.rados.rados.0.smithi084.stdout:2245: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:08:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:12 smithi084 ceph-mon[116404]: osdmap e511: 8 total, 8 up, 8 in 2024-01-13T18:08:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:12 smithi084 ceph-mon[116404]: pgmap v478: 121 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 114 active+clean; 302 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-01-13T18:08:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:12 smithi084 ceph-mon[116404]: osdmap e512: 8 total, 8 up, 8 in 2024-01-13T18:08:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:12 smithi084 ceph-mon[119097]: osdmap e511: 8 total, 8 up, 8 in 2024-01-13T18:08:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:12 smithi084 ceph-mon[119097]: pgmap v478: 121 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 114 active+clean; 302 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-01-13T18:08:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:12 smithi084 ceph-mon[119097]: osdmap e512: 8 total, 8 up, 8 in 2024-01-13T18:08:13.672 INFO:tasks.rados.rados.0.smithi084.stdout:2240: done (4 left) 2024-01-13T18:08:13.672 INFO:tasks.rados.rados.0.smithi084.stdout:2241: done (3 left) 2024-01-13T18:08:13.672 INFO:tasks.rados.rados.0.smithi084.stdout:2244: done (2 left) 2024-01-13T18:08:13.672 INFO:tasks.rados.rados.0.smithi084.stdout:2245: done (1 left) 2024-01-13T18:08:13.672 INFO:tasks.rados.rados.0.smithi084.stdout:2247: done (0 left) 2024-01-13T18:08:13.672 INFO:tasks.rados.rados.0.smithi084.stdout:2248: delete oid 9 current snap is 222 2024-01-13T18:08:13.673 INFO:tasks.rados.rados.0.smithi084.stdout:2248: done (0 left) 2024-01-13T18:08:13.673 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 222 2024-01-13T18:08:13.673 INFO:tasks.rados.rados.0.smithi084.stdout:2249: seq_num 706 ranges {8257536=630784,8888320=516096,9404416=729088,10133504=360448} 2024-01-13T18:08:13.720 INFO:tasks.rados.rados.0.smithi084.stdout:2249: writing smithi084102331-35 from 8257536 to 8888320 tid 1 2024-01-13T18:08:13.723 INFO:tasks.rados.rados.0.smithi084.stdout:2249: writing smithi084102331-35 from 8888320 to 9404416 tid 2 2024-01-13T18:08:13.728 INFO:tasks.rados.rados.0.smithi084.stdout:2249: writing smithi084102331-35 from 9404416 to 10133504 tid 3 2024-01-13T18:08:13.730 INFO:tasks.rados.rados.0.smithi084.stdout:2249: writing smithi084102331-35 from 10133504 to 10493952 tid 4 2024-01-13T18:08:13.730 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 222 2024-01-13T18:08:13.730 INFO:tasks.rados.rados.0.smithi084.stdout:2249: finishing write tid 1 to smithi084102331-35 2024-01-13T18:08:13.730 INFO:tasks.rados.rados.0.smithi084.stdout:2250: seq_num 707 ranges {0=647168,647168=802816,1449984=532480,1982464=270336} 2024-01-13T18:08:13.734 INFO:tasks.rados.rados.0.smithi084.stdout:2250: writing smithi084102331-6 from 0 to 647168 tid 1 2024-01-13T18:08:13.739 INFO:tasks.rados.rados.0.smithi084.stdout:2250: writing smithi084102331-6 from 647168 to 1449984 tid 2 2024-01-13T18:08:13.742 INFO:tasks.rados.rados.0.smithi084.stdout:2250: writing smithi084102331-6 from 1449984 to 1982464 tid 3 2024-01-13T18:08:13.744 INFO:tasks.rados.rados.0.smithi084.stdout:2250: writing smithi084102331-6 from 1982464 to 2252800 tid 4 2024-01-13T18:08:13.744 INFO:tasks.rados.rados.0.smithi084.stdout:2251: delete oid 37 current snap is 222 2024-01-13T18:08:13.744 INFO:tasks.rados.rados.0.smithi084.stdout:2249: finishing write tid 2 to smithi084102331-35 2024-01-13T18:08:13.744 INFO:tasks.rados.rados.0.smithi084.stdout:2249: finishing write tid 3 to smithi084102331-35 2024-01-13T18:08:13.745 INFO:tasks.rados.rados.0.smithi084.stdout:2249: finishing write tid 4 to smithi084102331-35 2024-01-13T18:08:13.745 INFO:tasks.rados.rados.0.smithi084.stdout:2249: finishing write tid 5 to smithi084102331-35 2024-01-13T18:08:13.745 INFO:tasks.rados.rados.0.smithi084.stdout:2249: finishing write tid 6 to smithi084102331-35 2024-01-13T18:08:13.745 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 817 (ObjNum 706 snap 222 seq_num 706) dirty exists 2024-01-13T18:08:13.745 INFO:tasks.rados.rados.0.smithi084.stdout:2249: left oid 35 (ObjNum 706 snap 222 seq_num 706) 2024-01-13T18:08:13.745 INFO:tasks.rados.rados.0.smithi084.stdout:2250: finishing write tid 1 to smithi084102331-6 2024-01-13T18:08:13.745 INFO:tasks.rados.rados.0.smithi084.stdout:2250: finishing write tid 2 to smithi084102331-6 2024-01-13T18:08:13.746 INFO:tasks.rados.rados.0.smithi084.stdout:2250: finishing write tid 3 to smithi084102331-6 2024-01-13T18:08:13.746 INFO:tasks.rados.rados.0.smithi084.stdout:2250: finishing write tid 4 to smithi084102331-6 2024-01-13T18:08:13.747 INFO:tasks.rados.rados.0.smithi084.stdout:2250: finishing write tid 5 to smithi084102331-6 2024-01-13T18:08:13.748 INFO:tasks.rados.rados.0.smithi084.stdout:2250: finishing write tid 6 to smithi084102331-6 2024-01-13T18:08:13.748 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 677 (ObjNum 707 snap 222 seq_num 707) dirty exists 2024-01-13T18:08:13.748 INFO:tasks.rados.rados.0.smithi084.stdout:2250: left oid 6 (ObjNum 707 snap 222 seq_num 707) 2024-01-13T18:08:13.749 INFO:tasks.rados.rados.0.smithi084.stdout:2249: done (2 left) 2024-01-13T18:08:13.749 INFO:tasks.rados.rados.0.smithi084.stdout:2250: done (1 left) 2024-01-13T18:08:13.749 INFO:tasks.rados.rados.0.smithi084.stdout:2251: done (0 left) 2024-01-13T18:08:13.749 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 222 2024-01-13T18:08:13.749 INFO:tasks.rados.rados.0.smithi084.stdout:2252: seq_num 709 ranges {4022272=679936,4702208=614400,5316608=499712,5816320=491520} 2024-01-13T18:08:13.773 INFO:tasks.rados.rados.0.smithi084.stdout:2252: writing smithi084102331-41 from 4022272 to 4702208 tid 1 2024-01-13T18:08:13.777 INFO:tasks.rados.rados.0.smithi084.stdout:2252: writing smithi084102331-41 from 4702208 to 5316608 tid 2 2024-01-13T18:08:13.780 INFO:tasks.rados.rados.0.smithi084.stdout:2252: writing smithi084102331-41 from 5316608 to 5816320 tid 3 2024-01-13T18:08:13.783 INFO:tasks.rados.rados.0.smithi084.stdout:2252: writing smithi084102331-41 from 5816320 to 6307840 tid 4 2024-01-13T18:08:13.783 INFO:tasks.rados.rados.0.smithi084.stdout:2253: copy_from oid 33 from oid 21 current snap is 222 2024-01-13T18:08:13.783 INFO:tasks.rados.rados.0.smithi084.stdout:2252: finishing write tid 1 to smithi084102331-41 2024-01-13T18:08:13.783 INFO:tasks.rados.rados.0.smithi084.stdout:2252: finishing write tid 2 to smithi084102331-41 2024-01-13T18:08:13.783 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 222 2024-01-13T18:08:13.783 INFO:tasks.rados.rados.0.smithi084.stdout:2254: seq_num 710 ranges {6971392=696320,7667712=499712,8167424=712704,8880128=393216} 2024-01-13T18:08:13.824 INFO:tasks.rados.rados.0.smithi084.stdout:2254: writing smithi084102331-10 from 6971392 to 7667712 tid 1 2024-01-13T18:08:13.827 INFO:tasks.rados.rados.0.smithi084.stdout:2254: writing smithi084102331-10 from 7667712 to 8167424 tid 2 2024-01-13T18:08:13.831 INFO:tasks.rados.rados.0.smithi084.stdout:2254: writing smithi084102331-10 from 8167424 to 8880128 tid 3 2024-01-13T18:08:13.834 INFO:tasks.rados.rados.0.smithi084.stdout:2254: writing smithi084102331-10 from 8880128 to 9273344 tid 4 2024-01-13T18:08:13.834 INFO:tasks.rados.rados.0.smithi084.stdout:2255: copy_from oid 19 from oid 47 current snap is 222 2024-01-13T18:08:13.834 INFO:tasks.rados.rados.0.smithi084.stdout:2252: finishing write tid 3 to smithi084102331-41 2024-01-13T18:08:13.834 INFO:tasks.rados.rados.0.smithi084.stdout:2252: finishing write tid 4 to smithi084102331-41 2024-01-13T18:08:13.834 INFO:tasks.rados.rados.0.smithi084.stdout:2252: finishing write tid 5 to smithi084102331-41 2024-01-13T18:08:13.834 INFO:tasks.rados.rados.0.smithi084.stdout:2252: finishing write tid 6 to smithi084102331-41 2024-01-13T18:08:13.834 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1109 (ObjNum 709 snap 222 seq_num 709) dirty exists 2024-01-13T18:08:13.834 INFO:tasks.rados.rados.0.smithi084.stdout:2252: left oid 41 (ObjNum 709 snap 222 seq_num 709) 2024-01-13T18:08:13.835 INFO:tasks.rados.rados.0.smithi084.stdout:2253: finishing copy_from to smithi084102331-33 2024-01-13T18:08:13.835 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 740 (ObjNum 663 snap 207 seq_num 663) dirty exists 2024-01-13T18:08:13.835 INFO:tasks.rados.rados.0.smithi084.stdout:2253: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:08:13.835 INFO:tasks.rados.rados.0.smithi084.stdout:2254: finishing write tid 1 to smithi084102331-10 2024-01-13T18:08:13.835 INFO:tasks.rados.rados.0.smithi084.stdout:2254: finishing write tid 2 to smithi084102331-10 2024-01-13T18:08:13.835 INFO:tasks.rados.rados.0.smithi084.stdout:2254: finishing write tid 3 to smithi084102331-10 2024-01-13T18:08:13.835 INFO:tasks.rados.rados.0.smithi084.stdout:2252: done (3 left) 2024-01-13T18:08:13.835 INFO:tasks.rados.rados.0.smithi084.stdout:2253: done (2 left) 2024-01-13T18:08:13.835 INFO:tasks.rados.rados.0.smithi084.stdout:2256: delete oid 31 current snap is 222 2024-01-13T18:08:13.836 INFO:tasks.rados.rados.0.smithi084.stdout:2255: finishing copy_from to smithi084102331-19 2024-01-13T18:08:13.836 INFO:tasks.rados.rados.0.smithi084.stdout:2255: got expected ENOENT (src dne) 2024-01-13T18:08:13.836 INFO:tasks.rados.rados.0.smithi084.stdout:2255: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:08:13.836 INFO:tasks.rados.rados.0.smithi084.stdout:2254: finishing write tid 4 to smithi084102331-10 2024-01-13T18:08:13.836 INFO:tasks.rados.rados.0.smithi084.stdout:2254: finishing write tid 5 to smithi084102331-10 2024-01-13T18:08:13.837 INFO:tasks.rados.rados.0.smithi084.stdout:2255: done (2 left) 2024-01-13T18:08:13.837 INFO:tasks.rados.rados.0.smithi084.stdout:2256: done (1 left) 2024-01-13T18:08:13.837 INFO:tasks.rados.rados.0.smithi084.stdout:2257: snap_remove snap 208 2024-01-13T18:08:14.680 INFO:tasks.rados.rados.0.smithi084.stdout:2257: done (1 left) 2024-01-13T18:08:14.680 INFO:tasks.rados.rados.0.smithi084.stdout:2258: snap_remove snap 221 2024-01-13T18:08:14.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:14 smithi084 ceph-mon[116404]: osdmap e513: 8 total, 8 up, 8 in 2024-01-13T18:08:14.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:14 smithi084 ceph-mon[116404]: pgmap v481: 121 pgs: 3 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 112 active+clean; 299 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-01-13T18:08:14.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:14 smithi084 ceph-mon[119097]: osdmap e513: 8 total, 8 up, 8 in 2024-01-13T18:08:14.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:14 smithi084 ceph-mon[119097]: pgmap v481: 121 pgs: 3 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 112 active+clean; 299 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-01-13T18:08:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:14 smithi099 ceph-mon[138788]: osdmap e513: 8 total, 8 up, 8 in 2024-01-13T18:08:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:14 smithi099 ceph-mon[138788]: pgmap v481: 121 pgs: 3 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 112 active+clean; 299 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-01-13T18:08:15.680 INFO:tasks.rados.rados.0.smithi084.stdout:2258: done (1 left) 2024-01-13T18:08:15.680 INFO:tasks.rados.rados.0.smithi084.stdout:2259: copy_from oid 22 from oid 24 current snap is 222 2024-01-13T18:08:15.680 INFO:tasks.rados.rados.0.smithi084.stdout:2260: read oid 48 snap -1 2024-01-13T18:08:15.680 INFO:tasks.rados.rados.0.smithi084.stdout:2260: expect deleted 2024-01-13T18:08:15.680 INFO:tasks.rados.rados.0.smithi084.stdout:2261: setattr oid 32 current snap is 222 2024-01-13T18:08:15.686 INFO:tasks.rados.rados.0.smithi084.stdout:2262: snap_remove snap 214 2024-01-13T18:08:16.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:15 smithi099 ceph-mon[138788]: osdmap e514: 8 total, 8 up, 8 in 2024-01-13T18:08:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:15 smithi084 ceph-mon[116404]: osdmap e514: 8 total, 8 up, 8 in 2024-01-13T18:08:16.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:15 smithi084 ceph-mon[119097]: osdmap e514: 8 total, 8 up, 8 in 2024-01-13T18:08:16.694 INFO:tasks.rados.rados.0.smithi084.stdout:2262: done (4 left) 2024-01-13T18:08:16.694 INFO:tasks.rados.rados.0.smithi084.stdout:2263: read oid 3 snap 219 2024-01-13T18:08:16.694 INFO:tasks.rados.rados.0.smithi084.stdout:2263: expect (ObjNum -257204224 snap 21877 seq_num 4037589024) 2024-01-13T18:08:16.696 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 222 2024-01-13T18:08:16.697 INFO:tasks.rados.rados.0.smithi084.stdout:2264: seq_num 712 ranges {7036928=729088,7766016=671744,8437760=671744,9109504=262144} 2024-01-13T18:08:16.736 INFO:tasks.rados.rados.0.smithi084.stdout:2264: writing smithi084102331-18 from 7036928 to 7766016 tid 1 2024-01-13T18:08:16.740 INFO:tasks.rados.rados.0.smithi084.stdout:2264: writing smithi084102331-18 from 7766016 to 8437760 tid 2 2024-01-13T18:08:16.744 INFO:tasks.rados.rados.0.smithi084.stdout:2264: writing smithi084102331-18 from 8437760 to 9109504 tid 3 2024-01-13T18:08:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:2264: writing smithi084102331-18 from 9109504 to 9371648 tid 4 2024-01-13T18:08:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 222 2024-01-13T18:08:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:2254: finishing write tid 6 to smithi084102331-10 2024-01-13T18:08:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1093 (ObjNum 710 snap 222 seq_num 710) dirty exists 2024-01-13T18:08:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:2254: left oid 10 (ObjNum 710 snap 222 seq_num 710) 2024-01-13T18:08:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1129 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-01-13T18:08:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:2259: finishing copy_from to smithi084102331-22 2024-01-13T18:08:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 636 (ObjNum 681 snap 215 seq_num 681) dirty exists 2024-01-13T18:08:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:2259: finishing copy_from racing read to smithi084102331-22 2024-01-13T18:08:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:2263: expect (ObjNum -257204224 snap 21877 seq_num 4037589024) 2024-01-13T18:08:16.751 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 1 to smithi084102331-18 2024-01-13T18:08:16.751 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 2 to smithi084102331-18 2024-01-13T18:08:16.751 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 3 to smithi084102331-18 2024-01-13T18:08:16.751 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 4 to smithi084102331-18 2024-01-13T18:08:16.752 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 5 to smithi084102331-18 2024-01-13T18:08:16.752 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 6 to smithi084102331-18 2024-01-13T18:08:16.752 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1098 (ObjNum 712 snap 222 seq_num 712) dirty exists 2024-01-13T18:08:16.752 INFO:tasks.rados.rados.0.smithi084.stdout:2264: left oid 18 (ObjNum 712 snap 222 seq_num 712) 2024-01-13T18:08:16.752 INFO:tasks.rados.rados.0.smithi084.stdout:2265: seq_num 713 ranges {2064384=745472,2809856=557056,3366912=483328,3850240=565248} 2024-01-13T18:08:16.766 INFO:tasks.rados.rados.0.smithi084.stdout:2265: writing smithi084102331-25 from 2064384 to 2809856 tid 1 2024-01-13T18:08:16.769 INFO:tasks.rados.rados.0.smithi084.stdout:2265: writing smithi084102331-25 from 2809856 to 3366912 tid 2 2024-01-13T18:08:16.772 INFO:tasks.rados.rados.0.smithi084.stdout:2265: writing smithi084102331-25 from 3366912 to 3850240 tid 3 2024-01-13T18:08:16.776 INFO:tasks.rados.rados.0.smithi084.stdout:2265: writing smithi084102331-25 from 3850240 to 4415488 tid 4 2024-01-13T18:08:16.776 INFO:tasks.rados.rados.0.smithi084.stdout:2254: done (6 left) 2024-01-13T18:08:16.776 INFO:tasks.rados.rados.0.smithi084.stdout:2259: done (5 left) 2024-01-13T18:08:16.776 INFO:tasks.rados.rados.0.smithi084.stdout:2260: done (4 left) 2024-01-13T18:08:16.776 INFO:tasks.rados.rados.0.smithi084.stdout:2261: done (3 left) 2024-01-13T18:08:16.776 INFO:tasks.rados.rados.0.smithi084.stdout:2263: done (2 left) 2024-01-13T18:08:16.776 INFO:tasks.rados.rados.0.smithi084.stdout:2264: done (1 left) 2024-01-13T18:08:16.777 INFO:tasks.rados.rados.0.smithi084.stdout:2266: read oid 38 snap -1 2024-01-13T18:08:16.777 INFO:tasks.rados.rados.0.smithi084.stdout:2266: expect deleted 2024-01-13T18:08:16.777 INFO:tasks.rados.rados.0.smithi084.stdout:2267: read oid 36 snap 217 2024-01-13T18:08:16.777 INFO:tasks.rados.rados.0.smithi084.stdout:2267: expect (ObjNum 534 snap 171 seq_num 534) 2024-01-13T18:08:16.777 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 222 2024-01-13T18:08:16.777 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 1 to smithi084102331-25 2024-01-13T18:08:16.777 INFO:tasks.rados.rados.0.smithi084.stdout:2268: seq_num 714 ranges {2875392=761856,3637248=442368,4079616=688128,4767744=475136} 2024-01-13T18:08:16.796 INFO:tasks.rados.rados.0.smithi084.stdout:2268: writing smithi084102331-15 from 2875392 to 3637248 tid 1 2024-01-13T18:08:16.798 INFO:tasks.rados.rados.0.smithi084.stdout:2268: writing smithi084102331-15 from 3637248 to 4079616 tid 2 2024-01-13T18:08:16.802 INFO:tasks.rados.rados.0.smithi084.stdout:2268: writing smithi084102331-15 from 4079616 to 4767744 tid 3 2024-01-13T18:08:16.805 INFO:tasks.rados.rados.0.smithi084.stdout:2268: writing smithi084102331-15 from 4767744 to 5242880 tid 4 2024-01-13T18:08:16.805 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 222 2024-01-13T18:08:16.805 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 2 to smithi084102331-25 2024-01-13T18:08:16.805 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 3 to smithi084102331-25 2024-01-13T18:08:16.805 INFO:tasks.rados.rados.0.smithi084.stdout:2269: seq_num 715 ranges {2949120=778240,3727360=770048,4497408=499712,4997120=335872} 2024-01-13T18:08:16.825 INFO:tasks.rados.rados.0.smithi084.stdout:2269: writing smithi084102331-22 from 2949120 to 3727360 tid 1 2024-01-13T18:08:16.829 INFO:tasks.rados.rados.0.smithi084.stdout:2269: writing smithi084102331-22 from 3727360 to 4497408 tid 2 2024-01-13T18:08:16.832 INFO:tasks.rados.rados.0.smithi084.stdout:2269: writing smithi084102331-22 from 4497408 to 4997120 tid 3 2024-01-13T18:08:16.834 INFO:tasks.rados.rados.0.smithi084.stdout:2269: writing smithi084102331-22 from 4997120 to 5332992 tid 4 2024-01-13T18:08:16.834 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 222 2024-01-13T18:08:16.834 INFO:tasks.rados.rados.0.smithi084.stdout:2270: seq_num 716 ranges {0=794624,794624=655360,1449984=704512,2154496=245760} 2024-01-13T18:08:16.838 INFO:tasks.rados.rados.0.smithi084.stdout:2270: writing smithi084102331-48 from 0 to 794624 tid 1 2024-01-13T18:08:16.842 INFO:tasks.rados.rados.0.smithi084.stdout:2270: writing smithi084102331-48 from 794624 to 1449984 tid 2 2024-01-13T18:08:16.846 INFO:tasks.rados.rados.0.smithi084.stdout:2270: writing smithi084102331-48 from 1449984 to 2154496 tid 3 2024-01-13T18:08:16.848 INFO:tasks.rados.rados.0.smithi084.stdout:2270: writing smithi084102331-48 from 2154496 to 2400256 tid 4 2024-01-13T18:08:16.848 INFO:tasks.rados.rados.0.smithi084.stdout:2271: read oid 33 snap -1 2024-01-13T18:08:16.848 INFO:tasks.rados.rados.0.smithi084.stdout:2271: expect (ObjNum 663 snap 207 seq_num 663) 2024-01-13T18:08:16.848 INFO:tasks.rados.rados.0.smithi084.stdout:2272: snap_create 2024-01-13T18:08:16.848 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 4 to smithi084102331-25 2024-01-13T18:08:16.848 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 5 to smithi084102331-25 2024-01-13T18:08:16.848 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 6 to smithi084102331-25 2024-01-13T18:08:16.848 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1110 (ObjNum 713 snap 222 seq_num 713) dirty exists 2024-01-13T18:08:16.848 INFO:tasks.rados.rados.0.smithi084.stdout:2265: left oid 25 (ObjNum 713 snap 222 seq_num 713) 2024-01-13T18:08:16.848 INFO:tasks.rados.rados.0.smithi084.stdout:2267: expect (ObjNum 534 snap 171 seq_num 534) 2024-01-13T18:08:17.013 INFO:tasks.rados.rados.0.smithi084.stdout:2268: finishing write tid 1 to smithi084102331-15 2024-01-13T18:08:17.013 INFO:tasks.rados.rados.0.smithi084.stdout:2268: finishing write tid 2 to smithi084102331-15 2024-01-13T18:08:17.013 INFO:tasks.rados.rados.0.smithi084.stdout:2268: finishing write tid 3 to smithi084102331-15 2024-01-13T18:08:17.013 INFO:tasks.rados.rados.0.smithi084.stdout:2268: finishing write tid 4 to smithi084102331-15 2024-01-13T18:08:17.013 INFO:tasks.rados.rados.0.smithi084.stdout:2268: finishing write tid 5 to smithi084102331-15 2024-01-13T18:08:17.013 INFO:tasks.rados.rados.0.smithi084.stdout:2268: finishing write tid 6 to smithi084102331-15 2024-01-13T18:08:17.013 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1139 (ObjNum 714 snap 222 seq_num 714) dirty exists 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2268: left oid 15 (ObjNum 714 snap 222 seq_num 714) 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2269: finishing write tid 1 to smithi084102331-22 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2269: finishing write tid 2 to smithi084102331-22 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2269: finishing write tid 3 to smithi084102331-22 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2269: finishing write tid 4 to smithi084102331-22 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2269: finishing write tid 5 to smithi084102331-22 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2269: finishing write tid 6 to smithi084102331-22 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1194 (ObjNum 715 snap 222 seq_num 715) dirty exists 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2269: left oid 22 (ObjNum 715 snap 222 seq_num 715) 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2270: finishing write tid 1 to smithi084102331-48 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2270: finishing write tid 2 to smithi084102331-48 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2270: finishing write tid 3 to smithi084102331-48 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2270: finishing write tid 4 to smithi084102331-48 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2270: finishing write tid 5 to smithi084102331-48 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:2270: finishing write tid 6 to smithi084102331-48 2024-01-13T18:08:17.014 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1199 (ObjNum 716 snap 222 seq_num 716) dirty exists 2024-01-13T18:08:17.015 INFO:tasks.rados.rados.0.smithi084.stdout:2270: left oid 48 (ObjNum 716 snap 222 seq_num 716) 2024-01-13T18:08:17.015 INFO:tasks.rados.rados.0.smithi084.stdout:2271: expect (ObjNum 663 snap 207 seq_num 663) 2024-01-13T18:08:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:16 smithi099 ceph-mon[138788]: osdmap e515: 8 total, 8 up, 8 in 2024-01-13T18:08:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:16 smithi099 ceph-mon[138788]: pgmap v484: 121 pgs: 3 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 112 active+clean; 298 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 4.7 MiB/s wr, 6 op/s 2024-01-13T18:08:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:16 smithi084 ceph-mon[116404]: osdmap e515: 8 total, 8 up, 8 in 2024-01-13T18:08:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:16 smithi084 ceph-mon[116404]: pgmap v484: 121 pgs: 3 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 112 active+clean; 298 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 4.7 MiB/s wr, 6 op/s 2024-01-13T18:08:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:16 smithi084 ceph-mon[119097]: osdmap e515: 8 total, 8 up, 8 in 2024-01-13T18:08:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:16 smithi084 ceph-mon[119097]: pgmap v484: 121 pgs: 3 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 112 active+clean; 298 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 4.7 MiB/s wr, 6 op/s 2024-01-13T18:08:17.652 INFO:tasks.rados.rados.0.smithi084.stdout:2265: done (7 left) 2024-01-13T18:08:17.653 INFO:tasks.rados.rados.0.smithi084.stdout:2266: done (6 left) 2024-01-13T18:08:17.653 INFO:tasks.rados.rados.0.smithi084.stdout:2267: done (5 left) 2024-01-13T18:08:17.653 INFO:tasks.rados.rados.0.smithi084.stdout:2268: done (4 left) 2024-01-13T18:08:17.653 INFO:tasks.rados.rados.0.smithi084.stdout:2269: done (3 left) 2024-01-13T18:08:17.653 INFO:tasks.rados.rados.0.smithi084.stdout:2270: done (2 left) 2024-01-13T18:08:17.653 INFO:tasks.rados.rados.0.smithi084.stdout:2271: done (1 left) 2024-01-13T18:08:17.653 INFO:tasks.rados.rados.0.smithi084.stdout:2272: done (0 left) 2024-01-13T18:08:17.653 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 223 2024-01-13T18:08:17.653 INFO:tasks.rados.rados.0.smithi084.stdout:2273: seq_num 717 ranges {0=16384} 2024-01-13T18:08:17.653 INFO:tasks.rados.rados.0.smithi084.stdout:2273: writing smithi084102331-39 from 0 to 16384 tid 1 2024-01-13T18:08:17.654 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 223 2024-01-13T18:08:17.654 INFO:tasks.rados.rados.0.smithi084.stdout:2274: seq_num 718 ranges {0=32768} 2024-01-13T18:08:17.654 INFO:tasks.rados.rados.0.smithi084.stdout:2274: writing smithi084102331-38 from 0 to 32768 tid 1 2024-01-13T18:08:17.654 INFO:tasks.rados.rados.0.smithi084.stdout:2275: read oid 35 snap -1 2024-01-13T18:08:17.654 INFO:tasks.rados.rados.0.smithi084.stdout:2275: expect (ObjNum 706 snap 222 seq_num 706) 2024-01-13T18:08:17.654 INFO:tasks.rados.rados.0.smithi084.stdout:2276: copy_from oid 28 from oid 26 current snap is 223 2024-01-13T18:08:17.654 INFO:tasks.rados.rados.0.smithi084.stdout:2277: snap_remove snap 222 2024-01-13T18:08:18.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:17 smithi099 ceph-mon[138788]: osdmap e516: 8 total, 8 up, 8 in 2024-01-13T18:08:18.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:17 smithi099 ceph-mon[138788]: osdmap e517: 8 total, 8 up, 8 in 2024-01-13T18:08:18.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:17 smithi084 ceph-mon[119097]: osdmap e516: 8 total, 8 up, 8 in 2024-01-13T18:08:18.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:17 smithi084 ceph-mon[119097]: osdmap e517: 8 total, 8 up, 8 in 2024-01-13T18:08:18.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:17 smithi084 ceph-mon[116404]: osdmap e516: 8 total, 8 up, 8 in 2024-01-13T18:08:18.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:17 smithi084 ceph-mon[116404]: osdmap e517: 8 total, 8 up, 8 in 2024-01-13T18:08:18.655 INFO:tasks.rados.rados.0.smithi084.stdout:2277: done (4 left) 2024-01-13T18:08:18.655 INFO:tasks.rados.rados.0.smithi084.stdout:2278: read oid 15 snap -1 2024-01-13T18:08:18.655 INFO:tasks.rados.rados.0.smithi084.stdout:2278: expect (ObjNum 714 snap 222 seq_num 714) 2024-01-13T18:08:18.655 INFO:tasks.rados.rados.0.smithi084.stdout:2279: delete oid 41 current snap is 223 2024-01-13T18:08:18.655 INFO:tasks.rados.rados.0.smithi084.stdout:2273: finishing write tid 1 to smithi084102331-39 2024-01-13T18:08:18.655 INFO:tasks.rados.rados.0.smithi084.stdout:2273: finishing write tid 2 to smithi084102331-39 2024-01-13T18:08:18.655 INFO:tasks.rados.rados.0.smithi084.stdout:2273: finishing write tid 3 to smithi084102331-39 2024-01-13T18:08:18.655 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1111 (ObjNum 717 snap 223 seq_num 717) dirty exists 2024-01-13T18:08:18.655 INFO:tasks.rados.rados.0.smithi084.stdout:2273: left oid 39 (ObjNum 717 snap 223 seq_num 717) 2024-01-13T18:08:18.655 INFO:tasks.rados.rados.0.smithi084.stdout:2274: finishing write tid 1 to smithi084102331-38 2024-01-13T18:08:18.656 INFO:tasks.rados.rados.0.smithi084.stdout:2274: finishing write tid 2 to smithi084102331-38 2024-01-13T18:08:18.656 INFO:tasks.rados.rados.0.smithi084.stdout:2274: finishing write tid 3 to smithi084102331-38 2024-01-13T18:08:18.656 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1293 (ObjNum 718 snap 223 seq_num 718) dirty exists 2024-01-13T18:08:18.656 INFO:tasks.rados.rados.0.smithi084.stdout:2274: left oid 38 (ObjNum 718 snap 223 seq_num 718) 2024-01-13T18:08:18.656 INFO:tasks.rados.rados.0.smithi084.stdout:2276: finishing copy_from to smithi084102331-28 2024-01-13T18:08:18.656 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1082 (ObjNum 564 snap 180 seq_num 564) dirty exists 2024-01-13T18:08:18.656 INFO:tasks.rados.rados.0.smithi084.stdout:2276: finishing copy_from racing read to smithi084102331-28 2024-01-13T18:08:18.656 INFO:tasks.rados.rados.0.smithi084.stdout:2275: expect (ObjNum 706 snap 222 seq_num 706) 2024-01-13T18:08:19.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:18 smithi099 ceph-mon[138788]: pgmap v487: 121 pgs: 121 active+clean; 212 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 30 KiB/s rd, 7.1 MiB/s wr, 16 op/s 2024-01-13T18:08:19.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:18 smithi099 ceph-mon[138788]: osdmap e518: 8 total, 8 up, 8 in 2024-01-13T18:08:19.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:18 smithi084 ceph-mon[116404]: pgmap v487: 121 pgs: 121 active+clean; 212 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 30 KiB/s rd, 7.1 MiB/s wr, 16 op/s 2024-01-13T18:08:19.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:18 smithi084 ceph-mon[116404]: osdmap e518: 8 total, 8 up, 8 in 2024-01-13T18:08:19.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:18 smithi084 ceph-mon[119097]: pgmap v487: 121 pgs: 121 active+clean; 212 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 30 KiB/s rd, 7.1 MiB/s wr, 16 op/s 2024-01-13T18:08:19.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:18 smithi084 ceph-mon[119097]: osdmap e518: 8 total, 8 up, 8 in 2024-01-13T18:08:19.395 INFO:tasks.rados.rados.0.smithi084.stdout:2278: expect (ObjNum 714 snap 222 seq_num 714) 2024-01-13T18:08:19.577 INFO:tasks.rados.rados.0.smithi084.stdout:2273: done (5 left) 2024-01-13T18:08:19.578 INFO:tasks.rados.rados.0.smithi084.stdout:2274: done (4 left) 2024-01-13T18:08:19.578 INFO:tasks.rados.rados.0.smithi084.stdout:2275: done (3 left) 2024-01-13T18:08:19.578 INFO:tasks.rados.rados.0.smithi084.stdout:2276: done (2 left) 2024-01-13T18:08:19.578 INFO:tasks.rados.rados.0.smithi084.stdout:2278: done (1 left) 2024-01-13T18:08:19.578 INFO:tasks.rados.rados.0.smithi084.stdout:2279: done (0 left) 2024-01-13T18:08:19.578 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 223 2024-01-13T18:08:19.578 INFO:tasks.rados.rados.0.smithi084.stdout:2280: seq_num 720 ranges {2260992=65536} 2024-01-13T18:08:19.590 INFO:tasks.rados.rados.0.smithi084.stdout:2280: writing smithi084102331-26 from 2260992 to 2326528 tid 1 2024-01-13T18:08:19.590 INFO:tasks.rados.rados.0.smithi084.stdout:2281: read oid 21 snap 217 2024-01-13T18:08:19.590 INFO:tasks.rados.rados.0.smithi084.stdout:2281: expect (ObjNum 663 snap 207 seq_num 663) 2024-01-13T18:08:19.590 INFO:tasks.rados.rados.0.smithi084.stdout:2282: read oid 25 snap 217 2024-01-13T18:08:19.590 INFO:tasks.rados.rados.0.smithi084.stdout:2282: expect (ObjNum 696 snap 217 seq_num 696) 2024-01-13T18:08:19.590 INFO:tasks.rados.rados.0.smithi084.stdout:2283: setattr oid 16 current snap is 223 2024-01-13T18:08:19.592 INFO:tasks.rados.rados.0.smithi084.stdout:2284: read oid 22 snap -1 2024-01-13T18:08:19.592 INFO:tasks.rados.rados.0.smithi084.stdout:2284: expect (ObjNum 715 snap 222 seq_num 715) 2024-01-13T18:08:19.592 INFO:tasks.rados.rados.0.smithi084.stdout:2285: delete oid 31 current snap is 223 2024-01-13T18:08:19.595 INFO:tasks.rados.rados.0.smithi084.stdout:2280: finishing write tid 1 to smithi084102331-26 2024-01-13T18:08:19.595 INFO:tasks.rados.rados.0.smithi084.stdout:2280: finishing write tid 2 to smithi084102331-26 2024-01-13T18:08:19.597 INFO:tasks.rados.rados.0.smithi084.stdout:2285: done (5 left) 2024-01-13T18:08:19.597 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 223 2024-01-13T18:08:19.597 INFO:tasks.rados.rados.0.smithi084.stdout:2286: seq_num 722 ranges {10493952=98304} 2024-01-13T18:08:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:2286: writing smithi084102331-35 from 10493952 to 10592256 tid 1 2024-01-13T18:08:19.657 INFO:tasks.rados.rados.0.smithi084.stdout:2287: snap_create 2024-01-13T18:08:19.658 INFO:tasks.rados.rados.0.smithi084.stdout:2280: finishing write tid 3 to smithi084102331-26 2024-01-13T18:08:19.658 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1098 (ObjNum 720 snap 223 seq_num 720) dirty exists 2024-01-13T18:08:19.658 INFO:tasks.rados.rados.0.smithi084.stdout:2280: left oid 26 (ObjNum 720 snap 223 seq_num 720) 2024-01-13T18:08:19.658 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1100 (ObjNum 579 snap 185 seq_num 579) dirty exists 2024-01-13T18:08:19.658 INFO:tasks.rados.rados.0.smithi084.stdout:2282: expect (ObjNum 696 snap 217 seq_num 696) 2024-01-13T18:08:19.712 INFO:tasks.rados.rados.0.smithi084.stdout:2284: expect (ObjNum 715 snap 222 seq_num 715) 2024-01-13T18:08:19.902 INFO:tasks.rados.rados.0.smithi084.stdout:2281: expect (ObjNum 663 snap 207 seq_num 663) 2024-01-13T18:08:20.459 INFO:tasks.rados.rados.0.smithi084.stdout:2286: finishing write tid 1 to smithi084102331-35 2024-01-13T18:08:20.459 INFO:tasks.rados.rados.0.smithi084.stdout:2286: finishing write tid 2 to smithi084102331-35 2024-01-13T18:08:20.460 INFO:tasks.rados.rados.0.smithi084.stdout:2286: finishing write tid 3 to smithi084102331-35 2024-01-13T18:08:20.460 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 829 (ObjNum 722 snap 223 seq_num 722) dirty exists 2024-01-13T18:08:20.460 INFO:tasks.rados.rados.0.smithi084.stdout:2286: left oid 35 (ObjNum 722 snap 223 seq_num 722) 2024-01-13T18:08:20.460 INFO:tasks.rados.rados.0.smithi084.stdout:2280: done (6 left) 2024-01-13T18:08:20.460 INFO:tasks.rados.rados.0.smithi084.stdout:2281: done (5 left) 2024-01-13T18:08:20.460 INFO:tasks.rados.rados.0.smithi084.stdout:2282: done (4 left) 2024-01-13T18:08:20.460 INFO:tasks.rados.rados.0.smithi084.stdout:2283: done (3 left) 2024-01-13T18:08:20.460 INFO:tasks.rados.rados.0.smithi084.stdout:2284: done (2 left) 2024-01-13T18:08:20.460 INFO:tasks.rados.rados.0.smithi084.stdout:2286: done (1 left) 2024-01-13T18:08:20.460 INFO:tasks.rados.rados.0.smithi084.stdout:2287: done (0 left) 2024-01-13T18:08:20.460 INFO:tasks.rados.rados.0.smithi084.stdout:2288: snap_remove snap 220 2024-01-13T18:08:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:08:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:08:20] "GET /metrics HTTP/1.1" 200 36193 "" "Prometheus/2.43.0" 2024-01-13T18:08:20.707 INFO:tasks.rados.rados.0.smithi084.stdout:2288: done (0 left) 2024-01-13T18:08:20.707 INFO:tasks.rados.rados.0.smithi084.stdout:2289: rollback oid 34 current snap is 224 2024-01-13T18:08:20.707 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 218 2024-01-13T18:08:20.707 INFO:tasks.rados.rados.0.smithi084.stdout:2290: snap_remove snap 219 2024-01-13T18:08:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:20 smithi099 ceph-mon[138788]: osdmap e519: 8 total, 8 up, 8 in 2024-01-13T18:08:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:20 smithi099 ceph-mon[138788]: pgmap v490: 121 pgs: 121 active+clean; 202 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 22 op/s 2024-01-13T18:08:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:21.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:20 smithi084 ceph-mon[119097]: osdmap e519: 8 total, 8 up, 8 in 2024-01-13T18:08:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:20 smithi084 ceph-mon[119097]: pgmap v490: 121 pgs: 121 active+clean; 202 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 22 op/s 2024-01-13T18:08:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:20 smithi084 ceph-mon[116404]: osdmap e519: 8 total, 8 up, 8 in 2024-01-13T18:08:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:20 smithi084 ceph-mon[116404]: pgmap v490: 121 pgs: 121 active+clean; 202 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 22 op/s 2024-01-13T18:08:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:21.712 INFO:tasks.rados.rados.0.smithi084.stdout:2290: done (1 left) 2024-01-13T18:08:21.712 INFO:tasks.rados.rados.0.smithi084.stdout:2291: read oid 37 snap -1 2024-01-13T18:08:21.712 INFO:tasks.rados.rados.0.smithi084.stdout:2291: expect deleted 2024-01-13T18:08:21.712 INFO:tasks.rados.rados.0.smithi084.stdout:2292: snap_create 2024-01-13T18:08:21.713 INFO:tasks.rados.rados.0.smithi084.stdout:2289: finishing rollback tid 0 to smithi084102331-34 2024-01-13T18:08:21.713 INFO:tasks.rados.rados.0.smithi084.stdout:2289: finishing rollback tid 1 to smithi084102331-34 2024-01-13T18:08:21.713 INFO:tasks.rados.rados.0.smithi084.stdout:2289: finishing rollback tid 2 to smithi084102331-34 2024-01-13T18:08:21.713 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 685 (ObjNum 675 snap 214 seq_num 675) dirty exists 2024-01-13T18:08:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:21 smithi099 ceph-mon[138788]: osdmap e520: 8 total, 8 up, 8 in 2024-01-13T18:08:22.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:21 smithi084 ceph-mon[116404]: osdmap e520: 8 total, 8 up, 8 in 2024-01-13T18:08:22.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:21 smithi084 ceph-mon[119097]: osdmap e520: 8 total, 8 up, 8 in 2024-01-13T18:08:22.657 INFO:tasks.rados.rados.0.smithi084.stdout:2289: done (2 left) 2024-01-13T18:08:22.657 INFO:tasks.rados.rados.0.smithi084.stdout:2291: done (1 left) 2024-01-13T18:08:22.657 INFO:tasks.rados.rados.0.smithi084.stdout:2292: done (0 left) 2024-01-13T18:08:22.657 INFO:tasks.rados.rados.0.smithi084.stdout:2293: delete oid 6 current snap is 225 2024-01-13T18:08:22.665 INFO:tasks.rados.rados.0.smithi084.stdout:2293: done (0 left) 2024-01-13T18:08:22.665 INFO:tasks.rados.rados.0.smithi084.stdout:2294: read oid 47 snap -1 2024-01-13T18:08:22.665 INFO:tasks.rados.rados.0.smithi084.stdout:2294: expect deleted 2024-01-13T18:08:22.665 INFO:tasks.rados.rados.0.smithi084.stdout:2295: read oid 2 snap -1 2024-01-13T18:08:22.665 INFO:tasks.rados.rados.0.smithi084.stdout:2295: expect deleted 2024-01-13T18:08:22.667 INFO:tasks.rados.rados.0.smithi084.stdout:2296: read oid 42 snap -1 2024-01-13T18:08:22.667 INFO:tasks.rados.rados.0.smithi084.stdout:2296: expect (ObjNum 656 snap 206 seq_num 656) 2024-01-13T18:08:22.667 INFO:tasks.rados.rados.0.smithi084.stdout:2297: copy_from oid 7 from oid 24 current snap is 225 2024-01-13T18:08:22.667 INFO:tasks.rados.rados.0.smithi084.stdout:2298: copy_from oid 1 from oid 14 current snap is 225 2024-01-13T18:08:22.667 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 225 2024-01-13T18:08:22.667 INFO:tasks.rados.rados.0.smithi084.stdout:2299: seq_num 724 ranges {8855552=131072} 2024-01-13T18:08:22.715 INFO:tasks.rados.rados.0.smithi084.stdout:2299: writing smithi084102331-33 from 8855552 to 8986624 tid 1 2024-01-13T18:08:22.715 INFO:tasks.rados.rados.0.smithi084.stdout:2300: read oid 41 snap -1 2024-01-13T18:08:22.715 INFO:tasks.rados.rados.0.smithi084.stdout:2300: expect deleted 2024-01-13T18:08:22.715 INFO:tasks.rados.rados.0.smithi084.stdout:2301: rollback oid 17 current snap is 225 2024-01-13T18:08:22.715 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 223 2024-01-13T18:08:22.715 INFO:tasks.rados.rados.0.smithi084.stdout:2302: delete oid 37 current snap is 225 2024-01-13T18:08:22.716 INFO:tasks.rados.rados.0.smithi084.stdout:2298: finishing copy_from to smithi084102331-1 2024-01-13T18:08:22.716 INFO:tasks.rados.rados.0.smithi084.stdout:2298: got expected ENOENT (src dne) 2024-01-13T18:08:22.716 INFO:tasks.rados.rados.0.smithi084.stdout:2298: finishing copy_from racing read to smithi084102331-1 2024-01-13T18:08:22.716 INFO:tasks.rados.rados.0.smithi084.stdout:2297: finishing copy_from to smithi084102331-7 2024-01-13T18:08:22.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 636 (ObjNum 681 snap 215 seq_num 681) dirty exists 2024-01-13T18:08:22.716 INFO:tasks.rados.rados.0.smithi084.stdout:2297: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:08:22.716 INFO:tasks.rados.rados.0.smithi084.stdout:2296: expect (ObjNum 656 snap 206 seq_num 656) 2024-01-13T18:08:23.103 INFO:tasks.rados.rados.0.smithi084.stdout:2301: finishing rollback tid 1 to smithi084102331-17 2024-01-13T18:08:23.103 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 0 (ObjNum 49 snap 0 seq_num 1953066355) dirty dne 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2299: finishing write tid 1 to smithi084102331-33 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2299: finishing write tid 2 to smithi084102331-33 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2299: finishing write tid 3 to smithi084102331-33 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1112 (ObjNum 724 snap 225 seq_num 724) dirty exists 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2299: left oid 33 (ObjNum 724 snap 225 seq_num 724) 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2294: done (8 left) 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2295: done (7 left) 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2296: done (6 left) 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2297: done (5 left) 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2298: done (4 left) 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2299: done (3 left) 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2300: done (2 left) 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2301: done (1 left) 2024-01-13T18:08:23.104 INFO:tasks.rados.rados.0.smithi084.stdout:2302: done (0 left) 2024-01-13T18:08:23.105 INFO:tasks.rados.rados.0.smithi084.stdout:2303: snap_create 2024-01-13T18:08:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:22 smithi099 ceph-mon[138788]: osdmap e521: 8 total, 8 up, 8 in 2024-01-13T18:08:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:22 smithi099 ceph-mon[138788]: pgmap v493: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 202 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 28 MiB/s rd, 3.4 MiB/s wr, 21 op/s 2024-01-13T18:08:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:22 smithi099 ceph-mon[138788]: osdmap e522: 8 total, 8 up, 8 in 2024-01-13T18:08:23.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:22 smithi084 ceph-mon[119097]: osdmap e521: 8 total, 8 up, 8 in 2024-01-13T18:08:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:22 smithi084 ceph-mon[119097]: pgmap v493: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 202 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 28 MiB/s rd, 3.4 MiB/s wr, 21 op/s 2024-01-13T18:08:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:22 smithi084 ceph-mon[119097]: osdmap e522: 8 total, 8 up, 8 in 2024-01-13T18:08:23.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:22 smithi084 ceph-mon[116404]: osdmap e521: 8 total, 8 up, 8 in 2024-01-13T18:08:23.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:22 smithi084 ceph-mon[116404]: pgmap v493: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 202 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 28 MiB/s rd, 3.4 MiB/s wr, 21 op/s 2024-01-13T18:08:23.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:22 smithi084 ceph-mon[116404]: osdmap e522: 8 total, 8 up, 8 in 2024-01-13T18:08:23.726 INFO:tasks.rados.rados.0.smithi084.stdout:2303: done (0 left) 2024-01-13T18:08:23.726 INFO:tasks.rados.rados.0.smithi084.stdout:2304: snap_create 2024-01-13T18:08:24.731 INFO:tasks.rados.rados.0.smithi084.stdout:2304: done (0 left) 2024-01-13T18:08:24.732 INFO:tasks.rados.rados.0.smithi084.stdout:2305: rmattr oid 40 current snap is 227 2024-01-13T18:08:24.732 INFO:tasks.rados.rados.0.smithi084.stdout:2305: done (0 left) 2024-01-13T18:08:24.732 INFO:tasks.rados.rados.0.smithi084.stdout:2306: rmattr oid 32 current snap is 227 2024-01-13T18:08:24.732 INFO:tasks.rados.rados.0.smithi084.stdout:2307: rollback oid 27 current snap is 227 2024-01-13T18:08:24.732 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 225 2024-01-13T18:08:24.732 INFO:tasks.rados.rados.0.smithi084.stdout:2308: snap_create 2024-01-13T18:08:24.736 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1149 (ObjNum 65 snap 0 seq_num 1884582257) dirty exists 2024-01-13T18:08:24.738 INFO:tasks.rados.rados.0.smithi084.stdout:2307: finishing rollback tid 0 to smithi084102331-27 2024-01-13T18:08:24.738 INFO:tasks.rados.rados.0.smithi084.stdout:2307: finishing rollback tid 1 to smithi084102331-27 2024-01-13T18:08:24.738 INFO:tasks.rados.rados.0.smithi084.stdout:2307: finishing rollback tid 2 to smithi084102331-27 2024-01-13T18:08:24.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1103 (ObjNum 65 snap 0 seq_num 1868395370) dirty exists 2024-01-13T18:08:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:24 smithi099 ceph-mon[138788]: osdmap e523: 8 total, 8 up, 8 in 2024-01-13T18:08:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:24 smithi099 ceph-mon[138788]: pgmap v496: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 200 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2024-01-13T18:08:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:24 smithi084 ceph-mon[116404]: osdmap e523: 8 total, 8 up, 8 in 2024-01-13T18:08:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:24 smithi084 ceph-mon[116404]: pgmap v496: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 200 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2024-01-13T18:08:25.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:24 smithi084 ceph-mon[119097]: osdmap e523: 8 total, 8 up, 8 in 2024-01-13T18:08:25.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:24 smithi084 ceph-mon[119097]: pgmap v496: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 200 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2024-01-13T18:08:25.736 INFO:tasks.rados.rados.0.smithi084.stdout:2306: done (2 left) 2024-01-13T18:08:25.736 INFO:tasks.rados.rados.0.smithi084.stdout:2307: done (1 left) 2024-01-13T18:08:25.736 INFO:tasks.rados.rados.0.smithi084.stdout:2308: done (0 left) 2024-01-13T18:08:25.737 INFO:tasks.rados.rados.0.smithi084.stdout:2309: rollback oid 31 current snap is 228 2024-01-13T18:08:25.737 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 223 2024-01-13T18:08:25.737 INFO:tasks.rados.rados.0.smithi084.stdout:2310: snap_remove snap 217 2024-01-13T18:08:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:25 smithi099 ceph-mon[138788]: osdmap e524: 8 total, 8 up, 8 in 2024-01-13T18:08:26.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:25 smithi084 ceph-mon[116404]: osdmap e524: 8 total, 8 up, 8 in 2024-01-13T18:08:26.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:25 smithi084 ceph-mon[119097]: osdmap e524: 8 total, 8 up, 8 in 2024-01-13T18:08:26.747 INFO:tasks.rados.rados.0.smithi084.stdout:2310: done (1 left) 2024-01-13T18:08:26.747 INFO:tasks.rados.rados.0.smithi084.stdout:2311: rmattr oid 21 current snap is 228 2024-01-13T18:08:26.748 INFO:tasks.rados.rados.0.smithi084.stdout:2311: done (1 left) 2024-01-13T18:08:26.748 INFO:tasks.rados.rados.0.smithi084.stdout:2312: snap_remove snap 226 2024-01-13T18:08:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:26 smithi099 ceph-mon[138788]: osdmap e525: 8 total, 8 up, 8 in 2024-01-13T18:08:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:26 smithi099 ceph-mon[138788]: pgmap v499: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 200 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.7 MiB/s rd, 32 KiB/s wr, 2 op/s 2024-01-13T18:08:27.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:26 smithi084 ceph-mon[116404]: osdmap e525: 8 total, 8 up, 8 in 2024-01-13T18:08:27.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:26 smithi084 ceph-mon[116404]: pgmap v499: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 200 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.7 MiB/s rd, 32 KiB/s wr, 2 op/s 2024-01-13T18:08:27.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:26 smithi084 ceph-mon[119097]: osdmap e525: 8 total, 8 up, 8 in 2024-01-13T18:08:27.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:26 smithi084 ceph-mon[119097]: pgmap v499: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 200 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.7 MiB/s rd, 32 KiB/s wr, 2 op/s 2024-01-13T18:08:27.657 INFO:tasks.rados.rados.0.smithi084.stdout:2312: done (1 left) 2024-01-13T18:08:27.657 INFO:tasks.rados.rados.0.smithi084.stdout:2313: delete oid 46 current snap is 228 2024-01-13T18:08:27.657 INFO:tasks.rados.rados.0.smithi084.stdout:2309: finishing rollback tid 1 to smithi084102331-31 2024-01-13T18:08:27.658 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1279 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-01-13T18:08:27.662 INFO:tasks.rados.rados.0.smithi084.stdout:2309: done (1 left) 2024-01-13T18:08:27.662 INFO:tasks.rados.rados.0.smithi084.stdout:2313: done (0 left) 2024-01-13T18:08:27.662 INFO:tasks.rados.rados.0.smithi084.stdout:2314: copy_from oid 42 from oid 16 current snap is 228 2024-01-13T18:08:27.662 INFO:tasks.rados.rados.0.smithi084.stdout:2315: copy_from oid 49 from oid 20 current snap is 228 2024-01-13T18:08:27.662 INFO:tasks.rados.rados.0.smithi084.stdout:2316: read oid 23 snap -1 2024-01-13T18:08:27.662 INFO:tasks.rados.rados.0.smithi084.stdout:2316: expect (ObjNum 698 snap 218 seq_num 698) 2024-01-13T18:08:27.662 INFO:tasks.rados.rados.0.smithi084.stdout:2317: copy_from oid 34 from oid 8 current snap is 228 2024-01-13T18:08:27.662 INFO:tasks.rados.rados.0.smithi084.stdout:2318: delete oid 2 current snap is 228 2024-01-13T18:08:27.671 INFO:tasks.rados.rados.0.smithi084.stdout:2315: finishing copy_from to smithi084102331-49 2024-01-13T18:08:27.671 INFO:tasks.rados.rados.0.smithi084.stdout:2315: got expected ENOENT (src dne) 2024-01-13T18:08:27.671 INFO:tasks.rados.rados.0.smithi084.stdout:2315: finishing copy_from racing read to smithi084102331-49 2024-01-13T18:08:27.676 INFO:tasks.rados.rados.0.smithi084.stdout:2317: finishing copy_from to smithi084102331-34 2024-01-13T18:08:27.676 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 1083 (ObjNum 679 snap 215 seq_num 679) dirty exists 2024-01-13T18:08:27.679 INFO:tasks.rados.rados.0.smithi084.stdout:2317: finishing copy_from racing read to smithi084102331-34 2024-01-13T18:08:27.684 INFO:tasks.rados.rados.0.smithi084.stdout:2316: expect (ObjNum 698 snap 218 seq_num 698) 2024-01-13T18:08:27.785 INFO:tasks.rados.rados.0.smithi084.stdout:2314: finishing copy_from to smithi084102331-42 2024-01-13T18:08:27.785 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1100 (ObjNum 579 snap 185 seq_num 579) dirty exists 2024-01-13T18:08:27.785 INFO:tasks.rados.rados.0.smithi084.stdout:2314: finishing copy_from racing read to smithi084102331-42 2024-01-13T18:08:27.786 INFO:tasks.rados.rados.0.smithi084.stdout:2314: done (4 left) 2024-01-13T18:08:27.786 INFO:tasks.rados.rados.0.smithi084.stdout:2315: done (3 left) 2024-01-13T18:08:27.786 INFO:tasks.rados.rados.0.smithi084.stdout:2316: done (2 left) 2024-01-13T18:08:27.786 INFO:tasks.rados.rados.0.smithi084.stdout:2317: done (1 left) 2024-01-13T18:08:27.786 INFO:tasks.rados.rados.0.smithi084.stdout:2318: done (0 left) 2024-01-13T18:08:27.786 INFO:tasks.rados.rados.0.smithi084.stdout:2319: rollback oid 21 current snap is 228 2024-01-13T18:08:27.786 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 227 2024-01-13T18:08:27.786 INFO:tasks.rados.rados.0.smithi084.stdout:2320: read oid 9 snap -1 2024-01-13T18:08:27.786 INFO:tasks.rados.rados.0.smithi084.stdout:2320: expect deleted 2024-01-13T18:08:27.786 INFO:tasks.rados.rados.0.smithi084.stdout:2321: setattr oid 38 current snap is 228 2024-01-13T18:08:27.787 INFO:tasks.rados.rados.0.smithi084.stdout:2320: done (2 left) 2024-01-13T18:08:27.787 INFO:tasks.rados.rados.0.smithi084.stdout:2322: snap_remove snap 225 2024-01-13T18:08:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:27 smithi099 ceph-mon[138788]: osdmap e526: 8 total, 8 up, 8 in 2024-01-13T18:08:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:27 smithi099 ceph-mon[138788]: osdmap e527: 8 total, 8 up, 8 in 2024-01-13T18:08:28.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:27 smithi084 ceph-mon[116404]: osdmap e526: 8 total, 8 up, 8 in 2024-01-13T18:08:28.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:27 smithi084 ceph-mon[116404]: osdmap e527: 8 total, 8 up, 8 in 2024-01-13T18:08:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:27 smithi084 ceph-mon[119097]: osdmap e526: 8 total, 8 up, 8 in 2024-01-13T18:08:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:27 smithi084 ceph-mon[119097]: osdmap e527: 8 total, 8 up, 8 in 2024-01-13T18:08:28.750 INFO:tasks.rados.rados.0.smithi084.stdout:2322: done (2 left) 2024-01-13T18:08:28.750 INFO:tasks.rados.rados.0.smithi084.stdout:2323: delete oid 12 current snap is 228 2024-01-13T18:08:28.750 INFO:tasks.rados.rados.0.smithi084.stdout:2319: finishing rollback tid 0 to smithi084102331-21 2024-01-13T18:08:28.750 INFO:tasks.rados.rados.0.smithi084.stdout:2319: finishing rollback tid 1 to smithi084102331-21 2024-01-13T18:08:28.750 INFO:tasks.rados.rados.0.smithi084.stdout:2319: finishing rollback tid 2 to smithi084102331-21 2024-01-13T18:08:28.750 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 839 (ObjNum 663 snap 207 seq_num 663) dirty exists 2024-01-13T18:08:28.750 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1303 (ObjNum 718 snap 223 seq_num 718) dirty exists 2024-01-13T18:08:28.757 INFO:tasks.rados.rados.0.smithi084.stdout:2319: done (2 left) 2024-01-13T18:08:28.757 INFO:tasks.rados.rados.0.smithi084.stdout:2321: done (1 left) 2024-01-13T18:08:28.757 INFO:tasks.rados.rados.0.smithi084.stdout:2323: done (0 left) 2024-01-13T18:08:28.758 INFO:tasks.rados.rados.0.smithi084.stdout:2324: delete oid 13 current snap is 228 2024-01-13T18:08:28.759 INFO:tasks.rados.rados.0.smithi084.stdout:2324: done (0 left) 2024-01-13T18:08:28.759 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 228 2024-01-13T18:08:28.759 INFO:tasks.rados.rados.0.smithi084.stdout:2325: seq_num 730 ranges {16384=229376} 2024-01-13T18:08:28.761 INFO:tasks.rados.rados.0.smithi084.stdout:2325: writing smithi084102331-39 from 16384 to 245760 tid 1 2024-01-13T18:08:28.761 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 228 2024-01-13T18:08:28.761 INFO:tasks.rados.rados.0.smithi084.stdout:2326: seq_num 731 ranges {0=245760} 2024-01-13T18:08:28.762 INFO:tasks.rados.rados.0.smithi084.stdout:2326: writing smithi084102331-41 from 0 to 245760 tid 1 2024-01-13T18:08:28.762 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 228 2024-01-13T18:08:28.762 INFO:tasks.rados.rados.0.smithi084.stdout:2327: seq_num 732 ranges {0=262144} 2024-01-13T18:08:28.764 INFO:tasks.rados.rados.0.smithi084.stdout:2327: writing smithi084102331-20 from 0 to 262144 tid 1 2024-01-13T18:08:28.764 INFO:tasks.rados.rados.0.smithi084.stdout:2328: setattr oid 19 current snap is 228 2024-01-13T18:08:28.764 INFO:tasks.rados.rados.0.smithi084.stdout:2325: finishing write tid 1 to smithi084102331-39 2024-01-13T18:08:28.765 INFO:tasks.rados.rados.0.smithi084.stdout:2329: delete oid 40 current snap is 228 2024-01-13T18:08:28.766 INFO:tasks.rados.rados.0.smithi084.stdout:2325: finishing write tid 2 to smithi084102331-39 2024-01-13T18:08:28.766 INFO:tasks.rados.rados.0.smithi084.stdout:2326: finishing write tid 1 to smithi084102331-41 2024-01-13T18:08:28.766 INFO:tasks.rados.rados.0.smithi084.stdout:2326: finishing write tid 2 to smithi084102331-41 2024-01-13T18:08:28.768 INFO:tasks.rados.rados.0.smithi084.stdout:2325: finishing write tid 3 to smithi084102331-39 2024-01-13T18:08:28.768 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1114 (ObjNum 730 snap 228 seq_num 730) dirty exists 2024-01-13T18:08:28.768 INFO:tasks.rados.rados.0.smithi084.stdout:2325: left oid 39 (ObjNum 730 snap 228 seq_num 730) 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2325: done (4 left) 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2329: done (3 left) 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2330: read oid 14 snap -1 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2330: expect deleted 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2331: read oid 7 snap 227 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2331: expect (ObjNum 681 snap 215 seq_num 681) 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2332: rmattr oid 32 current snap is 228 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2333: snap_create 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2327: finishing write tid 1 to smithi084102331-20 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2326: finishing write tid 3 to smithi084102331-41 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1116 (ObjNum 731 snap 228 seq_num 731) dirty exists 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2326: left oid 41 (ObjNum 731 snap 228 seq_num 731) 2024-01-13T18:08:28.769 INFO:tasks.rados.rados.0.smithi084.stdout:2327: finishing write tid 2 to smithi084102331-20 2024-01-13T18:08:28.770 INFO:tasks.rados.rados.0.smithi084.stdout:2327: finishing write tid 3 to smithi084102331-20 2024-01-13T18:08:28.770 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 642 (ObjNum 732 snap 228 seq_num 732) dirty exists 2024-01-13T18:08:28.770 INFO:tasks.rados.rados.0.smithi084.stdout:2327: left oid 20 (ObjNum 732 snap 228 seq_num 732) 2024-01-13T18:08:28.770 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 643 (ObjNum 639 snap 199 seq_num 639) dirty exists 2024-01-13T18:08:28.773 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1159 (ObjNum 65 snap 0 seq_num 1701210986) dirty exists 2024-01-13T18:08:28.780 INFO:tasks.rados.rados.0.smithi084.stdout:2331: expect (ObjNum 681 snap 215 seq_num 681) 2024-01-13T18:08:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:28 smithi099 ceph-mon[138788]: pgmap v502: 121 pgs: 121 active+clean; 203 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 752 KiB/s wr, 5 op/s 2024-01-13T18:08:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:28 smithi084 ceph-mon[116404]: pgmap v502: 121 pgs: 121 active+clean; 203 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 752 KiB/s wr, 5 op/s 2024-01-13T18:08:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:28 smithi084 ceph-mon[119097]: pgmap v502: 121 pgs: 121 active+clean; 203 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 752 KiB/s wr, 5 op/s 2024-01-13T18:08:29.755 INFO:tasks.rados.rados.0.smithi084.stdout:2326: done (6 left) 2024-01-13T18:08:29.755 INFO:tasks.rados.rados.0.smithi084.stdout:2327: done (5 left) 2024-01-13T18:08:29.755 INFO:tasks.rados.rados.0.smithi084.stdout:2328: done (4 left) 2024-01-13T18:08:29.755 INFO:tasks.rados.rados.0.smithi084.stdout:2330: done (3 left) 2024-01-13T18:08:29.755 INFO:tasks.rados.rados.0.smithi084.stdout:2331: done (2 left) 2024-01-13T18:08:29.755 INFO:tasks.rados.rados.0.smithi084.stdout:2332: done (1 left) 2024-01-13T18:08:29.756 INFO:tasks.rados.rados.0.smithi084.stdout:2333: done (0 left) 2024-01-13T18:08:29.756 INFO:tasks.rados.rados.0.smithi084.stdout:2334: read oid 32 snap 218 2024-01-13T18:08:29.756 INFO:tasks.rados.rados.0.smithi084.stdout:2334: expect (ObjNum -935489536 snap 32747 seq_num 4037118560) 2024-01-13T18:08:29.756 INFO:tasks.rados.rados.0.smithi084.stdout:2335: read oid 38 snap -1 2024-01-13T18:08:29.756 INFO:tasks.rados.rados.0.smithi084.stdout:2335: expect (ObjNum 718 snap 223 seq_num 718) 2024-01-13T18:08:29.756 INFO:tasks.rados.rados.0.smithi084.stdout:2336: copy_from oid 7 from oid 42 current snap is 229 2024-01-13T18:08:29.756 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 229 2024-01-13T18:08:29.756 INFO:tasks.rados.rados.0.smithi084.stdout:2337: seq_num 734 ranges {6955008=294912} 2024-01-13T18:08:29.795 INFO:tasks.rados.rados.0.smithi084.stdout:2337: writing smithi084102331-29 from 6955008 to 7249920 tid 1 2024-01-13T18:08:29.796 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 229 2024-01-13T18:08:29.796 INFO:tasks.rados.rados.0.smithi084.stdout:2334: expect (ObjNum -935489536 snap 32747 seq_num 4037118560) 2024-01-13T18:08:29.800 INFO:tasks.rados.rados.0.smithi084.stdout:2335: expect (ObjNum 718 snap 223 seq_num 718) 2024-01-13T18:08:29.803 INFO:tasks.rados.rados.0.smithi084.stdout:2336: finishing copy_from to smithi084102331-7 2024-01-13T18:08:29.804 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1100 (ObjNum 579 snap 185 seq_num 579) dirty exists 2024-01-13T18:08:29.804 INFO:tasks.rados.rados.0.smithi084.stdout:2336: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:08:29.804 INFO:tasks.rados.rados.0.smithi084.stdout:2337: finishing write tid 1 to smithi084102331-29 2024-01-13T18:08:29.804 INFO:tasks.rados.rados.0.smithi084.stdout:2337: finishing write tid 2 to smithi084102331-29 2024-01-13T18:08:29.804 INFO:tasks.rados.rados.0.smithi084.stdout:2338: seq_num 735 ranges {0=311296} 2024-01-13T18:08:29.806 INFO:tasks.rados.rados.0.smithi084.stdout:2338: writing smithi084102331-31 from 0 to 311296 tid 1 2024-01-13T18:08:29.806 INFO:tasks.rados.rados.0.smithi084.stdout:2334: done (4 left) 2024-01-13T18:08:29.806 INFO:tasks.rados.rados.0.smithi084.stdout:2335: done (3 left) 2024-01-13T18:08:29.806 INFO:tasks.rados.rados.0.smithi084.stdout:2336: done (2 left) 2024-01-13T18:08:29.806 INFO:tasks.rados.rados.0.smithi084.stdout:2339: snap_create 2024-01-13T18:08:29.806 INFO:tasks.rados.rados.0.smithi084.stdout:2337: finishing write tid 3 to smithi084102331-29 2024-01-13T18:08:29.806 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 846 (ObjNum 734 snap 229 seq_num 734) dirty exists 2024-01-13T18:08:29.806 INFO:tasks.rados.rados.0.smithi084.stdout:2337: left oid 29 (ObjNum 734 snap 229 seq_num 734) 2024-01-13T18:08:29.808 INFO:tasks.rados.rados.0.smithi084.stdout:2338: finishing write tid 1 to smithi084102331-31 2024-01-13T18:08:29.808 INFO:tasks.rados.rados.0.smithi084.stdout:2338: finishing write tid 2 to smithi084102331-31 2024-01-13T18:08:29.809 INFO:tasks.rados.rados.0.smithi084.stdout:2338: finishing write tid 3 to smithi084102331-31 2024-01-13T18:08:29.809 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1307 (ObjNum 735 snap 229 seq_num 735) dirty exists 2024-01-13T18:08:29.809 INFO:tasks.rados.rados.0.smithi084.stdout:2338: left oid 31 (ObjNum 735 snap 229 seq_num 735) 2024-01-13T18:08:30.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:29 smithi099 ceph-mon[138788]: osdmap e528: 8 total, 8 up, 8 in 2024-01-13T18:08:30.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:29 smithi084 ceph-mon[116404]: osdmap e528: 8 total, 8 up, 8 in 2024-01-13T18:08:30.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:29 smithi084 ceph-mon[119097]: osdmap e528: 8 total, 8 up, 8 in 2024-01-13T18:08:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:08:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:08:30] "GET /metrics HTTP/1.1" 200 36193 "" "Prometheus/2.43.0" 2024-01-13T18:08:30.762 INFO:tasks.rados.rados.0.smithi084.stdout:2337: done (2 left) 2024-01-13T18:08:30.762 INFO:tasks.rados.rados.0.smithi084.stdout:2338: done (1 left) 2024-01-13T18:08:30.762 INFO:tasks.rados.rados.0.smithi084.stdout:2339: done (0 left) 2024-01-13T18:08:30.762 INFO:tasks.rados.rados.0.smithi084.stdout:2340: copy_from oid 45 from oid 2 current snap is 230 2024-01-13T18:08:30.762 INFO:tasks.rados.rados.0.smithi084.stdout:2341: read oid 19 snap 228 2024-01-13T18:08:30.762 INFO:tasks.rados.rados.0.smithi084.stdout:2341: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:08:30.762 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 230 2024-01-13T18:08:30.762 INFO:tasks.rados.rados.0.smithi084.stdout:2342: seq_num 736 ranges {0=335872} 2024-01-13T18:08:30.764 INFO:tasks.rados.rados.0.smithi084.stdout:2342: writing smithi084102331-13 from 0 to 335872 tid 1 2024-01-13T18:08:30.764 INFO:tasks.rados.rados.0.smithi084.stdout:2343: read oid 24 snap 227 2024-01-13T18:08:30.764 INFO:tasks.rados.rados.0.smithi084.stdout:2343: expect (ObjNum 681 snap 215 seq_num 681) 2024-01-13T18:08:30.764 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 230 2024-01-13T18:08:30.764 INFO:tasks.rados.rados.0.smithi084.stdout:2344: seq_num 737 ranges {0=352256} 2024-01-13T18:08:30.766 INFO:tasks.rados.rados.0.smithi084.stdout:2344: writing smithi084102331-12 from 0 to 352256 tid 1 2024-01-13T18:08:30.766 INFO:tasks.rados.rados.0.smithi084.stdout:2345: read oid 11 snap -1 2024-01-13T18:08:30.766 INFO:tasks.rados.rados.0.smithi084.stdout:2345: expect (ObjNum 702 snap 220 seq_num 702) 2024-01-13T18:08:30.766 INFO:tasks.rados.rados.0.smithi084.stdout:2346: read oid 42 snap -1 2024-01-13T18:08:30.766 INFO:tasks.rados.rados.0.smithi084.stdout:2346: expect (ObjNum 579 snap 185 seq_num 579) 2024-01-13T18:08:30.767 INFO:tasks.rados.rados.0.smithi084.stdout:2347: delete oid 1 current snap is 230 2024-01-13T18:08:30.771 INFO:tasks.rados.rados.0.smithi084.stdout:2340: finishing copy_from to smithi084102331-45 2024-01-13T18:08:30.772 INFO:tasks.rados.rados.0.smithi084.stdout:2340: got expected ENOENT (src dne) 2024-01-13T18:08:30.772 INFO:tasks.rados.rados.0.smithi084.stdout:2342: finishing write tid 1 to smithi084102331-13 2024-01-13T18:08:30.772 INFO:tasks.rados.rados.0.smithi084.stdout:2340: finishing copy_from racing read to smithi084102331-45 2024-01-13T18:08:30.772 INFO:tasks.rados.rados.0.smithi084.stdout:2342: finishing write tid 2 to smithi084102331-13 2024-01-13T18:08:30.776 INFO:tasks.rados.rados.0.smithi084.stdout:2340: done (7 left) 2024-01-13T18:08:30.776 INFO:tasks.rados.rados.0.smithi084.stdout:2347: done (6 left) 2024-01-13T18:08:30.776 INFO:tasks.rados.rados.0.smithi084.stdout:2348: delete oid 41 current snap is 230 2024-01-13T18:08:30.779 INFO:tasks.rados.rados.0.smithi084.stdout:2344: finishing write tid 1 to smithi084102331-12 2024-01-13T18:08:30.779 INFO:tasks.rados.rados.0.smithi084.stdout:2344: finishing write tid 2 to smithi084102331-12 2024-01-13T18:08:30.782 INFO:tasks.rados.rados.0.smithi084.stdout:2344: finishing write tid 3 to smithi084102331-12 2024-01-13T18:08:30.782 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1218 (ObjNum 737 snap 230 seq_num 737) dirty exists 2024-01-13T18:08:30.782 INFO:tasks.rados.rados.0.smithi084.stdout:2344: left oid 12 (ObjNum 737 snap 230 seq_num 737) 2024-01-13T18:08:30.784 INFO:tasks.rados.rados.0.smithi084.stdout:2343: expect (ObjNum 681 snap 215 seq_num 681) 2024-01-13T18:08:30.881 INFO:tasks.rados.rados.0.smithi084.stdout:2342: finishing write tid 3 to smithi084102331-13 2024-01-13T18:08:30.881 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 839 (ObjNum 736 snap 230 seq_num 736) dirty exists 2024-01-13T18:08:30.881 INFO:tasks.rados.rados.0.smithi084.stdout:2342: left oid 13 (ObjNum 736 snap 230 seq_num 736) 2024-01-13T18:08:30.881 INFO:tasks.rados.rados.0.smithi084.stdout:2342: done (6 left) 2024-01-13T18:08:30.881 INFO:tasks.rados.rados.0.smithi084.stdout:2343: done (5 left) 2024-01-13T18:08:30.881 INFO:tasks.rados.rados.0.smithi084.stdout:2344: done (4 left) 2024-01-13T18:08:30.881 INFO:tasks.rados.rados.0.smithi084.stdout:2348: done (3 left) 2024-01-13T18:08:30.882 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 230 2024-01-13T18:08:30.882 INFO:tasks.rados.rados.0.smithi084.stdout:2346: expect (ObjNum 579 snap 185 seq_num 579) 2024-01-13T18:08:31.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:30 smithi099 ceph-mon[138788]: osdmap e529: 8 total, 8 up, 8 in 2024-01-13T18:08:31.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:30 smithi099 ceph-mon[138788]: pgmap v505: 121 pgs: 121 active+clean; 200 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 720 KiB/s wr, 5 op/s 2024-01-13T18:08:31.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:30 smithi084 ceph-mon[116404]: osdmap e529: 8 total, 8 up, 8 in 2024-01-13T18:08:31.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:30 smithi084 ceph-mon[116404]: pgmap v505: 121 pgs: 121 active+clean; 200 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 720 KiB/s wr, 5 op/s 2024-01-13T18:08:31.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:30 smithi084 ceph-mon[119097]: osdmap e529: 8 total, 8 up, 8 in 2024-01-13T18:08:31.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:30 smithi084 ceph-mon[119097]: pgmap v505: 121 pgs: 121 active+clean; 200 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 720 KiB/s wr, 5 op/s 2024-01-13T18:08:31.298 INFO:tasks.rados.rados.0.smithi084.stdout:2345: expect (ObjNum 702 snap 220 seq_num 702) 2024-01-13T18:08:31.632 INFO:tasks.rados.rados.0.smithi084.stdout:2341: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:08:32.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:31 smithi099 ceph-mon[138788]: osdmap e530: 8 total, 8 up, 8 in 2024-01-13T18:08:32.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:31 smithi084 ceph-mon[116404]: osdmap e530: 8 total, 8 up, 8 in 2024-01-13T18:08:32.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:31 smithi084 ceph-mon[119097]: osdmap e530: 8 total, 8 up, 8 in 2024-01-13T18:08:32.190 INFO:tasks.rados.rados.0.smithi084.stdout:2349: seq_num 740 ranges {0=401408} 2024-01-13T18:08:32.192 INFO:tasks.rados.rados.0.smithi084.stdout:2349: writing smithi084102331-4 from 0 to 401408 tid 1 2024-01-13T18:08:32.192 INFO:tasks.rados.rados.0.smithi084.stdout:2341: done (3 left) 2024-01-13T18:08:32.193 INFO:tasks.rados.rados.0.smithi084.stdout:2345: done (2 left) 2024-01-13T18:08:32.193 INFO:tasks.rados.rados.0.smithi084.stdout:2346: done (1 left) 2024-01-13T18:08:32.193 INFO:tasks.rados.rados.0.smithi084.stdout:2350: rmattr oid 35 current snap is 230 2024-01-13T18:08:32.193 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 230 2024-01-13T18:08:32.193 INFO:tasks.rados.rados.0.smithi084.stdout:2351: seq_num 741 ranges {0=417792} 2024-01-13T18:08:32.195 INFO:tasks.rados.rados.0.smithi084.stdout:2351: writing smithi084102331-45 from 0 to 417792 tid 1 2024-01-13T18:08:32.195 INFO:tasks.rados.rados.0.smithi084.stdout:2352: delete oid 19 current snap is 230 2024-01-13T18:08:32.195 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 0 (ObjNum 722 snap 223 seq_num 722) dirty exists 2024-01-13T18:08:32.195 INFO:tasks.rados.rados.0.smithi084.stdout:2349: finishing write tid 1 to smithi084102331-4 2024-01-13T18:08:32.196 INFO:tasks.rados.rados.0.smithi084.stdout:2349: finishing write tid 2 to smithi084102331-4 2024-01-13T18:08:32.199 INFO:tasks.rados.rados.0.smithi084.stdout:2349: finishing write tid 3 to smithi084102331-4 2024-01-13T18:08:32.199 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 842 (ObjNum 740 snap 230 seq_num 740) dirty exists 2024-01-13T18:08:32.199 INFO:tasks.rados.rados.0.smithi084.stdout:2349: left oid 4 (ObjNum 740 snap 230 seq_num 740) 2024-01-13T18:08:32.199 INFO:tasks.rados.rados.0.smithi084.stdout:2351: finishing write tid 1 to smithi084102331-45 2024-01-13T18:08:32.200 INFO:tasks.rados.rados.0.smithi084.stdout:2349: done (3 left) 2024-01-13T18:08:32.200 INFO:tasks.rados.rados.0.smithi084.stdout:2350: done (2 left) 2024-01-13T18:08:32.200 INFO:tasks.rados.rados.0.smithi084.stdout:2352: done (1 left) 2024-01-13T18:08:32.200 INFO:tasks.rados.rados.0.smithi084.stdout:2353: setattr oid 46 current snap is 230 2024-01-13T18:08:32.200 INFO:tasks.rados.rados.0.smithi084.stdout:2351: finishing write tid 2 to smithi084102331-45 2024-01-13T18:08:32.201 INFO:tasks.rados.rados.0.smithi084.stdout:2351: finishing write tid 3 to smithi084102331-45 2024-01-13T18:08:32.201 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1311 (ObjNum 741 snap 230 seq_num 741) dirty exists 2024-01-13T18:08:32.201 INFO:tasks.rados.rados.0.smithi084.stdout:2351: left oid 45 (ObjNum 741 snap 230 seq_num 741) 2024-01-13T18:08:32.201 INFO:tasks.rados.rados.0.smithi084.stdout:2351: done (1 left) 2024-01-13T18:08:32.201 INFO:tasks.rados.rados.0.smithi084.stdout:2354: read oid 50 snap -1 2024-01-13T18:08:32.201 INFO:tasks.rados.rados.0.smithi084.stdout:2354: expect (ObjNum 694 snap 217 seq_num 694) 2024-01-13T18:08:32.201 INFO:tasks.rados.rados.0.smithi084.stdout:2355: rmattr oid 6 current snap is 230 2024-01-13T18:08:32.201 INFO:tasks.rados.rados.0.smithi084.stdout:2355: done (2 left) 2024-01-13T18:08:32.201 INFO:tasks.rados.rados.0.smithi084.stdout:2356: snap_create 2024-01-13T18:08:32.205 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1118 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:08:32.272 INFO:tasks.rados.rados.0.smithi084.stdout:2354: expect (ObjNum 694 snap 217 seq_num 694) 2024-01-13T18:08:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:32 smithi099 ceph-mon[138788]: pgmap v507: 121 pgs: 121 active+clean; 213 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.6 MiB/s wr, 24 op/s 2024-01-13T18:08:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:32 smithi099 ceph-mon[138788]: osdmap e531: 8 total, 8 up, 8 in 2024-01-13T18:08:33.160 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:32 smithi084 ceph-mon[116404]: pgmap v507: 121 pgs: 121 active+clean; 213 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.6 MiB/s wr, 24 op/s 2024-01-13T18:08:33.160 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:32 smithi084 ceph-mon[116404]: osdmap e531: 8 total, 8 up, 8 in 2024-01-13T18:08:33.160 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:32 smithi084 ceph-mon[119097]: pgmap v507: 121 pgs: 121 active+clean; 213 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.6 MiB/s wr, 24 op/s 2024-01-13T18:08:33.160 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:32 smithi084 ceph-mon[119097]: osdmap e531: 8 total, 8 up, 8 in 2024-01-13T18:08:33.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -e sha1=d2f11f33b7063c2c1bc47b2b4e9350f48064868f -- bash -c 'ceph orch ps' 2024-01-13T18:08:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:08:33.669 INFO:tasks.rados.rados.0.smithi084.stdout:2353: done (2 left) 2024-01-13T18:08:33.670 INFO:tasks.rados.rados.0.smithi084.stdout:2354: done (1 left) 2024-01-13T18:08:33.670 INFO:tasks.rados.rados.0.smithi084.stdout:2356: done (0 left) 2024-01-13T18:08:33.670 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 231 2024-01-13T18:08:33.670 INFO:tasks.rados.rados.0.smithi084.stdout:2357: seq_num 743 ranges {0=450560} 2024-01-13T18:08:33.671 INFO:tasks.rados.rados.0.smithi084.stdout:2357: writing smithi084102331-41 from 0 to 450560 tid 1 2024-01-13T18:08:33.672 INFO:tasks.rados.rados.0.smithi084.stdout:2358: snap_remove snap 227 2024-01-13T18:08:33.769 INFO:tasks.rados.rados.0.smithi084.stdout:2358: done (1 left) 2024-01-13T18:08:33.769 INFO:tasks.rados.rados.0.smithi084.stdout:2359: delete oid 10 current snap is 231 2024-01-13T18:08:33.769 INFO:tasks.rados.rados.0.smithi084.stdout:2357: finishing write tid 1 to smithi084102331-41 2024-01-13T18:08:33.769 INFO:tasks.rados.rados.0.smithi084.stdout:2357: finishing write tid 2 to smithi084102331-41 2024-01-13T18:08:33.769 INFO:tasks.rados.rados.0.smithi084.stdout:2357: finishing write tid 3 to smithi084102331-41 2024-01-13T18:08:33.769 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1120 (ObjNum 743 snap 231 seq_num 743) dirty exists 2024-01-13T18:08:33.769 INFO:tasks.rados.rados.0.smithi084.stdout:2357: left oid 41 (ObjNum 743 snap 231 seq_num 743) 2024-01-13T18:08:33.775 INFO:tasks.rados.rados.0.smithi084.stdout:2357: done (1 left) 2024-01-13T18:08:33.776 INFO:tasks.rados.rados.0.smithi084.stdout:2359: done (0 left) 2024-01-13T18:08:33.776 INFO:tasks.rados.rados.0.smithi084.stdout:2360: setattr oid 9 current snap is 231 2024-01-13T18:08:33.776 INFO:tasks.rados.rados.0.smithi084.stdout:2361: rollback oid 23 current snap is 231 2024-01-13T18:08:33.777 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 229 2024-01-13T18:08:33.777 INFO:tasks.rados.rados.0.smithi084.stdout:2362: rollback oid 5 current snap is 231 2024-01-13T18:08:33.777 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 218 2024-01-13T18:08:33.777 INFO:tasks.rados.rados.0.smithi084.stdout:2363: rmattr oid 22 current snap is 231 2024-01-13T18:08:33.777 INFO:tasks.rados.rados.0.smithi084.stdout:2363: done (3 left) 2024-01-13T18:08:33.777 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 231 2024-01-13T18:08:33.777 INFO:tasks.rados.rados.0.smithi084.stdout:2364: seq_num 745 ranges {0=483328} 2024-01-13T18:08:33.780 INFO:tasks.rados.rados.0.smithi084.stdout:2364: writing smithi084102331-27 from 0 to 483328 tid 1 2024-01-13T18:08:33.780 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 231 2024-01-13T18:08:33.780 INFO:tasks.rados.rados.0.smithi084.stdout:2365: seq_num 746 ranges {2326528=499712} 2024-01-13T18:08:33.796 INFO:tasks.rados.rados.0.smithi084.stdout:2365: writing smithi084102331-26 from 2326528 to 2826240 tid 1 2024-01-13T18:08:33.796 INFO:tasks.rados.rados.0.smithi084.stdout:2366: read oid 31 snap -1 2024-01-13T18:08:33.796 INFO:tasks.rados.rados.0.smithi084.stdout:2366: expect (ObjNum 735 snap 229 seq_num 735) 2024-01-13T18:08:33.796 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 231 2024-01-13T18:08:33.797 INFO:tasks.rados.rados.0.smithi084.stdout:2361: finishing rollback tid 0 to smithi084102331-23 2024-01-13T18:08:33.797 INFO:tasks.rados.rados.0.smithi084.stdout:2367: seq_num 747 ranges {4415488=516096} 2024-01-13T18:08:33.824 INFO:tasks.rados.rados.0.smithi084.stdout:2367: writing smithi084102331-25 from 4415488 to 4931584 tid 1 2024-01-13T18:08:33.824 INFO:tasks.rados.rados.0.smithi084.stdout:2368: copy_from oid 44 from oid 21 current snap is 231 2024-01-13T18:08:33.824 INFO:tasks.rados.rados.0.smithi084.stdout:2361: finishing rollback tid 1 to smithi084102331-23 2024-01-13T18:08:33.824 INFO:tasks.rados.rados.0.smithi084.stdout:2361: finishing rollback tid 2 to smithi084102331-23 2024-01-13T18:08:33.824 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1224 (ObjNum 698 snap 218 seq_num 698) dirty exists 2024-01-13T18:08:33.824 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1084 (ObjNum 65 snap 0 seq_num 1868395370) dirty exists 2024-01-13T18:08:33.824 INFO:tasks.rados.rados.0.smithi084.stdout:2362: finishing rollback tid 0 to smithi084102331-5 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2360: done (7 left) 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2361: done (6 left) 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2369: read oid 28 snap -1 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2369: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2370: snap_create 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2362: finishing rollback tid 1 to smithi084102331-5 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2362: finishing rollback tid 2 to smithi084102331-5 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 846 (ObjNum 701 snap 218 seq_num 701) dirty exists 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2364: finishing write tid 1 to smithi084102331-27 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2364: finishing write tid 2 to smithi084102331-27 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2364: finishing write tid 3 to smithi084102331-27 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1105 (ObjNum 745 snap 231 seq_num 745) dirty exists 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2364: left oid 27 (ObjNum 745 snap 231 seq_num 745) 2024-01-13T18:08:33.825 INFO:tasks.rados.rados.0.smithi084.stdout:2366: expect (ObjNum 735 snap 229 seq_num 735) 2024-01-13T18:08:33.834 INFO:tasks.rados.rados.0.smithi084.stdout:2365: finishing write tid 1 to smithi084102331-26 2024-01-13T18:08:33.834 INFO:tasks.rados.rados.0.smithi084.stdout:2365: finishing write tid 2 to smithi084102331-26 2024-01-13T18:08:33.834 INFO:tasks.rados.rados.0.smithi084.stdout:2365: finishing write tid 3 to smithi084102331-26 2024-01-13T18:08:33.834 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1100 (ObjNum 746 snap 231 seq_num 746) dirty exists 2024-01-13T18:08:33.834 INFO:tasks.rados.rados.0.smithi084.stdout:2365: left oid 26 (ObjNum 746 snap 231 seq_num 746) 2024-01-13T18:08:33.834 INFO:tasks.rados.rados.0.smithi084.stdout:2367: finishing write tid 1 to smithi084102331-25 2024-01-13T18:08:33.834 INFO:tasks.rados.rados.0.smithi084.stdout:2367: finishing write tid 2 to smithi084102331-25 2024-01-13T18:08:33.834 INFO:tasks.rados.rados.0.smithi084.stdout:2367: finishing write tid 3 to smithi084102331-25 2024-01-13T18:08:33.835 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1114 (ObjNum 747 snap 231 seq_num 747) dirty exists 2024-01-13T18:08:33.835 INFO:tasks.rados.rados.0.smithi084.stdout:2367: left oid 25 (ObjNum 747 snap 231 seq_num 747) 2024-01-13T18:08:33.835 INFO:tasks.rados.rados.0.smithi084.stdout:2369: expect (ObjNum 564 snap 180 seq_num 564) 2024-01-13T18:08:33.900 INFO:tasks.rados.rados.0.smithi084.stdout:2368: finishing copy_from to smithi084102331-44 2024-01-13T18:08:33.900 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 839 (ObjNum 663 snap 207 seq_num 663) dirty exists 2024-01-13T18:08:33.900 INFO:tasks.rados.rados.0.smithi084.stdout:2368: finishing copy_from racing read to smithi084102331-44 2024-01-13T18:08:33.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:33 smithi084 ceph-mon[116404]: from='client.44339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:33.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:33 smithi084 ceph-mon[119097]: from='client.44339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:34.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:33 smithi099 ceph-mon[138788]: from='client.44339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:34.694 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-13T18:08:34.694 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (39s) 37s ago 9m 15.7M - 0.25.0 c8568f914cd2 9e6210ff16cf 2024-01-13T18:08:34.694 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi099 *:3000 running (30s) 28s ago 9m 44.9M - 9.4.7 954c08fa6188 7de6e2b6a95d 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (82s) 37s ago 10m 15.4M - 18.2.1-242-gd2f11f33 f16b14f4c75d b6b0859480c3 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi099 running (69s) 28s ago 10m 13.6M - 18.2.1-242-gd2f11f33 f16b14f4c75d 0af9024fe2b0 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi099 *:8443,9283,8765 running (6m) 28s ago 12m 449M - 18.2.1-242-gd2f11f33 f16b14f4c75d db4708bdfc11 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (6m) 37s ago 13m 522M - 18.2.1-242-gd2f11f33 f16b14f4c75d 90286ff5aeaa 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (5m) 37s ago 13m 118M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d b64908c7a53c 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi099 running (5m) 28s ago 12m 77.1M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d be7bb477ea53 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (5m) 37s ago 12m 83.5M 2048M 18.2.1-242-gd2f11f33 f16b14f4c75d e13f01b852ff 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (61s) 37s ago 8m 8476k - 1.5.0 0da6a335fe13 7c868edb84c9 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi099 *:9100 running (59s) 28s ago 8m 9357k - 1.5.0 0da6a335fe13 de648a983ac9 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 37s ago 12m 534M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d e18181bdb4a8 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (4m) 37s ago 11m 328M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 32bdce285b36 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (3m) 37s ago 11m 296M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 660c53389079 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (3m) 37s ago 11m 280M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 0e4b8c3482a4 2024-01-13T18:08:34.695 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi099 running (3m) 28s ago 11m 354M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 76d7d19ec531 2024-01-13T18:08:34.696 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi099 running (2m) 28s ago 10m 335M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 5cf0e9339ca9 2024-01-13T18:08:34.696 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi099 running (2m) 28s ago 10m 206M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 919ac0aa6c87 2024-01-13T18:08:34.696 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi099 running (95s) 28s ago 10m 115M 2488M 18.2.1-242-gd2f11f33 f16b14f4c75d 237ebd4a72cd 2024-01-13T18:08:34.696 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi099 *:9095 running (49s) 28s ago 9m 44.6M - 2.43.0 a07b618ecd1d eaa04d6e16c5 2024-01-13T18:08:34.779 INFO:tasks.rados.rados.0.smithi084.stdout:2362: done (7 left) 2024-01-13T18:08:34.779 INFO:tasks.rados.rados.0.smithi084.stdout:2364: done (6 left) 2024-01-13T18:08:34.779 INFO:tasks.rados.rados.0.smithi084.stdout:2365: done (5 left) 2024-01-13T18:08:34.780 INFO:tasks.rados.rados.0.smithi084.stdout:2366: done (4 left) 2024-01-13T18:08:34.780 INFO:tasks.rados.rados.0.smithi084.stdout:2367: done (3 left) 2024-01-13T18:08:34.780 INFO:tasks.rados.rados.0.smithi084.stdout:2368: done (2 left) 2024-01-13T18:08:34.780 INFO:tasks.rados.rados.0.smithi084.stdout:2369: done (1 left) 2024-01-13T18:08:34.780 INFO:tasks.rados.rados.0.smithi084.stdout:2370: done (0 left) 2024-01-13T18:08:34.780 INFO:tasks.rados.rados.0.smithi084.stdout:2371: delete oid 16 current snap is 232 2024-01-13T18:08:34.783 INFO:tasks.rados.rados.0.smithi084.stdout:2371: done (0 left) 2024-01-13T18:08:34.783 INFO:tasks.rados.rados.0.smithi084.stdout:2372: rollback oid 28 current snap is 232 2024-01-13T18:08:34.783 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 28 to 231 2024-01-13T18:08:34.783 INFO:tasks.rados.rados.0.smithi084.stdout:2373: copy_from oid 35 from oid 21 current snap is 232 2024-01-13T18:08:34.783 INFO:tasks.rados.rados.0.smithi084.stdout:2374: delete oid 50 current snap is 232 2024-01-13T18:08:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:2372: finishing rollback tid 0 to smithi084102331-28 2024-01-13T18:08:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:2372: finishing rollback tid 1 to smithi084102331-28 2024-01-13T18:08:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:2372: finishing rollback tid 2 to smithi084102331-28 2024-01-13T18:08:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1109 (ObjNum 564 snap 180 seq_num 564) dirty exists 2024-01-13T18:08:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:2372: done (2 left) 2024-01-13T18:08:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:2374: done (1 left) 2024-01-13T18:08:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:2375: setattr oid 39 current snap is 232 2024-01-13T18:08:34.790 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 232 2024-01-13T18:08:34.790 INFO:tasks.rados.rados.0.smithi084.stdout:2376: seq_num 750 ranges {0=565248} 2024-01-13T18:08:34.793 INFO:tasks.rados.rados.0.smithi084.stdout:2376: writing smithi084102331-1 from 0 to 565248 tid 1 2024-01-13T18:08:34.793 INFO:tasks.rados.rados.0.smithi084.stdout:2377: read oid 12 snap -1 2024-01-13T18:08:34.793 INFO:tasks.rados.rados.0.smithi084.stdout:2377: expect (ObjNum 737 snap 230 seq_num 737) 2024-01-13T18:08:34.794 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 232 2024-01-13T18:08:34.794 INFO:tasks.rados.rados.0.smithi084.stdout:2378: seq_num 751 ranges {0=581632} 2024-01-13T18:08:34.797 INFO:tasks.rados.rados.0.smithi084.stdout:2378: writing smithi084102331-32 from 0 to 581632 tid 1 2024-01-13T18:08:34.797 INFO:tasks.rados.rados.0.smithi084.stdout:2379: snap_create 2024-01-13T18:08:34.797 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1121 (ObjNum 730 snap 228 seq_num 730) dirty exists 2024-01-13T18:08:34.797 INFO:tasks.rados.rados.0.smithi084.stdout:2376: finishing write tid 1 to smithi084102331-1 2024-01-13T18:08:34.797 INFO:tasks.rados.rados.0.smithi084.stdout:2376: finishing write tid 2 to smithi084102331-1 2024-01-13T18:08:34.798 INFO:tasks.rados.rados.0.smithi084.stdout:2377: expect (ObjNum 737 snap 230 seq_num 737) 2024-01-13T18:08:34.808 INFO:tasks.rados.rados.0.smithi084.stdout:2376: finishing write tid 3 to smithi084102331-1 2024-01-13T18:08:34.808 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1317 (ObjNum 750 snap 232 seq_num 750) dirty exists 2024-01-13T18:08:34.808 INFO:tasks.rados.rados.0.smithi084.stdout:2376: left oid 1 (ObjNum 750 snap 232 seq_num 750) 2024-01-13T18:08:34.808 INFO:tasks.rados.rados.0.smithi084.stdout:2378: finishing write tid 1 to smithi084102331-32 2024-01-13T18:08:34.808 INFO:tasks.rados.rados.0.smithi084.stdout:2378: finishing write tid 2 to smithi084102331-32 2024-01-13T18:08:34.808 INFO:tasks.rados.rados.0.smithi084.stdout:2378: finishing write tid 3 to smithi084102331-32 2024-01-13T18:08:34.808 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1165 (ObjNum 751 snap 232 seq_num 751) dirty exists 2024-01-13T18:08:34.808 INFO:tasks.rados.rados.0.smithi084.stdout:2378: left oid 32 (ObjNum 751 snap 232 seq_num 751) 2024-01-13T18:08:34.814 INFO:tasks.rados.rados.0.smithi084.stdout:2373: finishing copy_from to smithi084102331-35 2024-01-13T18:08:34.814 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 839 (ObjNum 663 snap 207 seq_num 663) dirty exists 2024-01-13T18:08:34.815 INFO:tasks.rados.rados.0.smithi084.stdout:2373: finishing copy_from racing read to smithi084102331-35 2024-01-13T18:08:34.987 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:34 smithi084 ceph-mon[116404]: osdmap e532: 8 total, 8 up, 8 in 2024-01-13T18:08:34.987 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:34 smithi084 ceph-mon[116404]: pgmap v510: 121 pgs: 121 active+clean; 214 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 3.8 MiB/s wr, 33 op/s 2024-01-13T18:08:34.987 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:34 smithi084 ceph-mon[119097]: osdmap e532: 8 total, 8 up, 8 in 2024-01-13T18:08:34.987 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:34 smithi084 ceph-mon[119097]: pgmap v510: 121 pgs: 121 active+clean; 214 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 3.8 MiB/s wr, 33 op/s 2024-01-13T18:08:35.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -e sha1=d2f11f33b7063c2c1bc47b2b4e9350f48064868f -- bash -c 'ceph versions' 2024-01-13T18:08:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:34 smithi099 ceph-mon[138788]: osdmap e532: 8 total, 8 up, 8 in 2024-01-13T18:08:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:34 smithi099 ceph-mon[138788]: pgmap v510: 121 pgs: 121 active+clean; 214 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 3.8 MiB/s wr, 33 op/s 2024-01-13T18:08:35.326 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:08:35.782 INFO:tasks.rados.rados.0.smithi084.stdout:2373: done (5 left) 2024-01-13T18:08:35.782 INFO:tasks.rados.rados.0.smithi084.stdout:2375: done (4 left) 2024-01-13T18:08:35.782 INFO:tasks.rados.rados.0.smithi084.stdout:2376: done (3 left) 2024-01-13T18:08:35.782 INFO:tasks.rados.rados.0.smithi084.stdout:2377: done (2 left) 2024-01-13T18:08:35.782 INFO:tasks.rados.rados.0.smithi084.stdout:2378: done (1 left) 2024-01-13T18:08:35.782 INFO:tasks.rados.rados.0.smithi084.stdout:2379: done (0 left) 2024-01-13T18:08:35.782 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 233 2024-01-13T18:08:35.782 INFO:tasks.rados.rados.0.smithi084.stdout:2380: seq_num 752 ranges {0=598016} 2024-01-13T18:08:35.785 INFO:tasks.rados.rados.0.smithi084.stdout:2380: writing smithi084102331-6 from 0 to 598016 tid 1 2024-01-13T18:08:35.785 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 233 2024-01-13T18:08:35.785 INFO:tasks.rados.rados.0.smithi084.stdout:2381: seq_num 753 ranges {3989504=614400} 2024-01-13T18:08:35.810 INFO:tasks.rados.rados.0.smithi084.stdout:2381: writing smithi084102331-36 from 3989504 to 4603904 tid 1 2024-01-13T18:08:35.810 INFO:tasks.rados.rados.0.smithi084.stdout:2382: snap_create 2024-01-13T18:08:35.810 INFO:tasks.rados.rados.0.smithi084.stdout:2380: finishing write tid 1 to smithi084102331-6 2024-01-13T18:08:35.810 INFO:tasks.rados.rados.0.smithi084.stdout:2380: finishing write tid 2 to smithi084102331-6 2024-01-13T18:08:35.810 INFO:tasks.rados.rados.0.smithi084.stdout:2380: finishing write tid 3 to smithi084102331-6 2024-01-13T18:08:35.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 1086 (ObjNum 752 snap 233 seq_num 752) dirty exists 2024-01-13T18:08:35.810 INFO:tasks.rados.rados.0.smithi084.stdout:2380: left oid 6 (ObjNum 752 snap 233 seq_num 752) 2024-01-13T18:08:35.814 INFO:tasks.rados.rados.0.smithi084.stdout:2381: finishing write tid 1 to smithi084102331-36 2024-01-13T18:08:35.814 INFO:tasks.rados.rados.0.smithi084.stdout:2381: finishing write tid 2 to smithi084102331-36 2024-01-13T18:08:35.814 INFO:tasks.rados.rados.0.smithi084.stdout:2381: finishing write tid 3 to smithi084102331-36 2024-01-13T18:08:35.815 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1102 (ObjNum 753 snap 233 seq_num 753) dirty exists 2024-01-13T18:08:35.815 INFO:tasks.rados.rados.0.smithi084.stdout:2381: left oid 36 (ObjNum 753 snap 233 seq_num 753) 2024-01-13T18:08:36.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:35 smithi084 ceph-mon[116404]: from='client.34407 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:36.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:35 smithi084 ceph-mon[116404]: osdmap e533: 8 total, 8 up, 8 in 2024-01-13T18:08:36.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:36.059 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:35 smithi084 ceph-mon[119097]: from='client.34407 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:36.060 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:35 smithi084 ceph-mon[119097]: osdmap e533: 8 total, 8 up, 8 in 2024-01-13T18:08:36.060 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:35 smithi099 ceph-mon[138788]: from='client.34407 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-13T18:08:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:35 smithi099 ceph-mon[138788]: osdmap e533: 8 total, 8 up, 8 in 2024-01-13T18:08:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:36.509 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 3 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 8 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 2 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-01-13T18:08:36.510 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-01-13T18:08:36.511 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)": 15 2024-01-13T18:08:36.511 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-01-13T18:08:36.511 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-01-13T18:08:36.786 INFO:tasks.rados.rados.0.smithi084.stdout:2380: done (2 left) 2024-01-13T18:08:36.786 INFO:tasks.rados.rados.0.smithi084.stdout:2381: done (1 left) 2024-01-13T18:08:36.786 INFO:tasks.rados.rados.0.smithi084.stdout:2382: done (0 left) 2024-01-13T18:08:36.786 INFO:tasks.rados.rados.0.smithi084.stdout:2383: rmattr oid 11 current snap is 234 2024-01-13T18:08:36.786 INFO:tasks.rados.rados.0.smithi084.stdout:2384: read oid 20 snap -1 2024-01-13T18:08:36.786 INFO:tasks.rados.rados.0.smithi084.stdout:2384: expect (ObjNum 732 snap 228 seq_num 732) 2024-01-13T18:08:36.786 INFO:tasks.rados.rados.0.smithi084.stdout:2385: copy_from oid 23 from oid 37 current snap is 234 2024-01-13T18:08:36.786 INFO:tasks.rados.rados.0.smithi084.stdout:2386: snap_create 2024-01-13T18:08:36.789 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1122 (ObjNum 702 snap 220 seq_num 702) dirty exists 2024-01-13T18:08:36.789 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:36 smithi084 ceph-mon[119097]: osdmap e534: 8 total, 8 up, 8 in 2024-01-13T18:08:36.792 INFO:tasks.rados.rados.0.smithi084.stdout:2384: expect (ObjNum 732 snap 228 seq_num 732) 2024-01-13T18:08:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:2385: finishing copy_from to smithi084102331-23 2024-01-13T18:08:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:2385: got expected ENOENT (src dne) 2024-01-13T18:08:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:2385: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:08:36.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -e sha1=d2f11f33b7063c2c1bc47b2b4e9350f48064868f -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-01-13T18:08:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:36 smithi099 ceph-mon[138788]: osdmap e534: 8 total, 8 up, 8 in 2024-01-13T18:08:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:36 smithi099 ceph-mon[138788]: pgmap v513: 121 pgs: 121 active+clean; 215 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 364 KiB/s wr, 14 op/s 2024-01-13T18:08:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:36 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3996124047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:37.141 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:08:37.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:36 smithi084 ceph-mon[116404]: osdmap e534: 8 total, 8 up, 8 in 2024-01-13T18:08:37.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:36 smithi084 ceph-mon[116404]: pgmap v513: 121 pgs: 121 active+clean; 215 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 364 KiB/s wr, 14 op/s 2024-01-13T18:08:37.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:36 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3996124047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:36 smithi084 ceph-mon[119097]: pgmap v513: 121 pgs: 121 active+clean; 215 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 364 KiB/s wr, 14 op/s 2024-01-13T18:08:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:36 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3996124047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:2383: done (3 left) 2024-01-13T18:08:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:2384: done (2 left) 2024-01-13T18:08:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:2385: done (1 left) 2024-01-13T18:08:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:2386: done (0 left) 2024-01-13T18:08:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:2387: rollback oid 30 current snap is 235 2024-01-13T18:08:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 218 2024-01-13T18:08:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:2388: rollback oid 36 current snap is 235 2024-01-13T18:08:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 232 2024-01-13T18:08:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:2389: read oid 1 snap -1 2024-01-13T18:08:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:2389: expect (ObjNum 750 snap 232 seq_num 750) 2024-01-13T18:08:37.661 INFO:tasks.rados.rados.0.smithi084.stdout:2390: snap_remove snap 233 2024-01-13T18:08:37.909 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:37 smithi084 ceph-mon[116404]: osdmap e535: 8 total, 8 up, 8 in 2024-01-13T18:08:37.909 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:37 smithi084 ceph-mon[116404]: osdmap e536: 8 total, 8 up, 8 in 2024-01-13T18:08:37.909 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:37 smithi084 ceph-mon[119097]: osdmap e535: 8 total, 8 up, 8 in 2024-01-13T18:08:37.910 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:37 smithi084 ceph-mon[119097]: osdmap e536: 8 total, 8 up, 8 in 2024-01-13T18:08:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:37 smithi099 ceph-mon[138788]: osdmap e535: 8 total, 8 up, 8 in 2024-01-13T18:08:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:37 smithi099 ceph-mon[138788]: osdmap e536: 8 total, 8 up, 8 in 2024-01-13T18:08:38.379 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-01-13T18:08:38.664 INFO:tasks.rados.rados.0.smithi084.stdout:2390: done (3 left) 2024-01-13T18:08:38.664 INFO:tasks.rados.rados.0.smithi084.stdout:2391: snap_create 2024-01-13T18:08:38.664 INFO:tasks.rados.rados.0.smithi084.stdout:2388: finishing rollback tid 0 to smithi084102331-36 2024-01-13T18:08:38.664 INFO:tasks.rados.rados.0.smithi084.stdout:2388: finishing rollback tid 1 to smithi084102331-36 2024-01-13T18:08:38.664 INFO:tasks.rados.rados.0.smithi084.stdout:2388: finishing rollback tid 2 to smithi084102331-36 2024-01-13T18:08:38.664 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1105 (ObjNum 534 snap 171 seq_num 534) dirty exists 2024-01-13T18:08:38.664 INFO:tasks.rados.rados.0.smithi084.stdout:2389: expect (ObjNum 750 snap 232 seq_num 750) 2024-01-13T18:08:38.680 INFO:tasks.rados.rados.0.smithi084.stdout:2387: finishing rollback tid 0 to smithi084102331-30 2024-01-13T18:08:38.680 INFO:tasks.rados.rados.0.smithi084.stdout:2387: finishing rollback tid 1 to smithi084102331-30 2024-01-13T18:08:38.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1117 (ObjNum -695319069 snap 32747 seq_num 304) dirty dne 2024-01-13T18:08:38.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid be08b996-b23c-11ee-95ac-87774f69a715 -e sha1=d2f11f33b7063c2c1bc47b2b4e9350f48064868f -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-01-13T18:08:38.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:38 smithi084 ceph-mon[116404]: pgmap v516: 121 pgs: 121 active+clean; 235 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 5.3 MiB/s wr, 25 op/s 2024-01-13T18:08:38.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:38 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/917511478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:38.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:38 smithi084 ceph-mon[116404]: osdmap e537: 8 total, 8 up, 8 in 2024-01-13T18:08:38.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:38 smithi084 ceph-mon[119097]: pgmap v516: 121 pgs: 121 active+clean; 235 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 5.3 MiB/s wr, 25 op/s 2024-01-13T18:08:38.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:38 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/917511478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:38.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:38 smithi084 ceph-mon[119097]: osdmap e537: 8 total, 8 up, 8 in 2024-01-13T18:08:38.991 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:08:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:38 smithi099 ceph-mon[138788]: pgmap v516: 121 pgs: 121 active+clean; 235 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 5.3 MiB/s wr, 25 op/s 2024-01-13T18:08:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:38 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/917511478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:38 smithi099 ceph-mon[138788]: osdmap e537: 8 total, 8 up, 8 in 2024-01-13T18:08:39.669 INFO:tasks.rados.rados.0.smithi084.stdout:2387: done (3 left) 2024-01-13T18:08:39.669 INFO:tasks.rados.rados.0.smithi084.stdout:2388: done (2 left) 2024-01-13T18:08:39.669 INFO:tasks.rados.rados.0.smithi084.stdout:2389: done (1 left) 2024-01-13T18:08:39.669 INFO:tasks.rados.rados.0.smithi084.stdout:2391: done (0 left) 2024-01-13T18:08:39.669 INFO:tasks.rados.rados.0.smithi084.stdout:2392: snap_create 2024-01-13T18:08:40.240 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.1-242-gd2f11f33 (d2f11f33b7063c2c1bc47b2b4e9350f48064868f) reef (stable)" 2024-01-13T18:08:40.544 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:08:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:08:40] "GET /metrics HTTP/1.1" 200 36194 "" "Prometheus/2.43.0" 2024-01-13T18:08:40.594 INFO:teuthology.task.sequential:In sequential, running task print... 2024-01-13T18:08:40.595 INFO:teuthology.task.print:**** done end upgrade, wait... 2024-01-13T18:08:40.595 DEBUG:teuthology.parallel:result is None 2024-01-13T18:08:40.673 INFO:tasks.rados.rados.0.smithi084.stdout:2392: done (0 left) 2024-01-13T18:08:40.674 INFO:tasks.rados.rados.0.smithi084.stdout:2393: setattr oid 22 current snap is 237 2024-01-13T18:08:40.675 INFO:tasks.rados.rados.0.smithi084.stdout:2394: snap_remove snap 235 2024-01-13T18:08:40.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:40 smithi084 ceph-mon[119097]: osdmap e538: 8 total, 8 up, 8 in 2024-01-13T18:08:40.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:40 smithi084 ceph-mon[119097]: pgmap v519: 121 pgs: 121 active+clean; 236 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 25 op/s 2024-01-13T18:08:40.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:40 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3262718644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:40 smithi084 ceph-mon[116404]: osdmap e538: 8 total, 8 up, 8 in 2024-01-13T18:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:40 smithi084 ceph-mon[116404]: pgmap v519: 121 pgs: 121 active+clean; 236 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 25 op/s 2024-01-13T18:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:40 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3262718644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:40 smithi099 ceph-mon[138788]: osdmap e538: 8 total, 8 up, 8 in 2024-01-13T18:08:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:40 smithi099 ceph-mon[138788]: pgmap v519: 121 pgs: 121 active+clean; 236 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 25 op/s 2024-01-13T18:08:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:40 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3262718644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-01-13T18:08:41.679 INFO:tasks.rados.rados.0.smithi084.stdout:2394: done (1 left) 2024-01-13T18:08:41.680 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 237 2024-01-13T18:08:41.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1226 (ObjNum 715 snap 222 seq_num 715) dirty exists 2024-01-13T18:08:41.680 INFO:tasks.rados.rados.0.smithi084.stdout:2395: seq_num 754 ranges {6643712=630784} 2024-01-13T18:08:41.718 INFO:tasks.rados.rados.0.smithi084.stdout:2395: writing smithi084102331-11 from 6643712 to 7274496 tid 1 2024-01-13T18:08:41.718 INFO:tasks.rados.rados.0.smithi084.stdout:2393: done (1 left) 2024-01-13T18:08:41.718 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 237 2024-01-13T18:08:41.718 INFO:tasks.rados.rados.0.smithi084.stdout:2396: seq_num 755 ranges {8855552=647168} 2024-01-13T18:08:41.768 INFO:tasks.rados.rados.0.smithi084.stdout:2396: writing smithi084102331-44 from 8855552 to 9502720 tid 1 2024-01-13T18:08:41.769 INFO:tasks.rados.rados.0.smithi084.stdout:2397: setattr oid 23 current snap is 237 2024-01-13T18:08:41.769 INFO:tasks.rados.rados.0.smithi084.stdout:2395: finishing write tid 1 to smithi084102331-11 2024-01-13T18:08:41.769 INFO:tasks.rados.rados.0.smithi084.stdout:2395: finishing write tid 2 to smithi084102331-11 2024-01-13T18:08:41.769 INFO:tasks.rados.rados.0.smithi084.stdout:2395: finishing write tid 3 to smithi084102331-11 2024-01-13T18:08:41.769 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1124 (ObjNum 754 snap 237 seq_num 754) dirty exists 2024-01-13T18:08:41.769 INFO:tasks.rados.rados.0.smithi084.stdout:2395: left oid 11 (ObjNum 754 snap 237 seq_num 754) 2024-01-13T18:08:41.769 INFO:tasks.rados.rados.0.smithi084.stdout:2395: done (2 left) 2024-01-13T18:08:41.769 INFO:tasks.rados.rados.0.smithi084.stdout:2398: snap_remove snap 230 2024-01-13T18:08:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:41 smithi099 ceph-mon[138788]: osdmap e539: 8 total, 8 up, 8 in 2024-01-13T18:08:42.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:41 smithi084 ceph-mon[116404]: osdmap e539: 8 total, 8 up, 8 in 2024-01-13T18:08:42.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:41 smithi084 ceph-mon[119097]: osdmap e539: 8 total, 8 up, 8 in 2024-01-13T18:08:42.663 INFO:tasks.rados.rados.0.smithi084.stdout:2398: done (2 left) 2024-01-13T18:08:42.663 INFO:tasks.rados.rados.0.smithi084.stdout:2399: read oid 25 snap -1 2024-01-13T18:08:42.663 INFO:tasks.rados.rados.0.smithi084.stdout:2399: expect (ObjNum 747 snap 231 seq_num 747) 2024-01-13T18:08:42.664 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 237 2024-01-13T18:08:42.664 INFO:tasks.rados.rados.0.smithi084.stdout:2400: seq_num 756 ranges {0=671744} 2024-01-13T18:08:42.667 INFO:tasks.rados.rados.0.smithi084.stdout:2400: writing smithi084102331-2 from 0 to 671744 tid 1 2024-01-13T18:08:42.668 INFO:tasks.rados.rados.0.smithi084.stdout:2401: copy_from oid 37 from oid 38 current snap is 237 2024-01-13T18:08:42.668 INFO:tasks.rados.rados.0.smithi084.stdout:2402: snap_remove snap 232 2024-01-13T18:08:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:42 smithi099 ceph-mon[138788]: osdmap e540: 8 total, 8 up, 8 in 2024-01-13T18:08:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:42 smithi099 ceph-mon[138788]: pgmap v522: 121 pgs: 121 active+clean; 236 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 607 KiB/s rd, 150 KiB/s wr, 9 op/s 2024-01-13T18:08:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:42 smithi099 ceph-mon[138788]: osdmap e541: 8 total, 8 up, 8 in 2024-01-13T18:08:43.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:42 smithi084 ceph-mon[116404]: osdmap e540: 8 total, 8 up, 8 in 2024-01-13T18:08:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:42 smithi084 ceph-mon[116404]: pgmap v522: 121 pgs: 121 active+clean; 236 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 607 KiB/s rd, 150 KiB/s wr, 9 op/s 2024-01-13T18:08:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:42 smithi084 ceph-mon[116404]: osdmap e541: 8 total, 8 up, 8 in 2024-01-13T18:08:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:42 smithi084 ceph-mon[119097]: osdmap e540: 8 total, 8 up, 8 in 2024-01-13T18:08:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:42 smithi084 ceph-mon[119097]: pgmap v522: 121 pgs: 121 active+clean; 236 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 607 KiB/s rd, 150 KiB/s wr, 9 op/s 2024-01-13T18:08:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:42 smithi084 ceph-mon[119097]: osdmap e541: 8 total, 8 up, 8 in 2024-01-13T18:08:43.672 INFO:tasks.rados.rados.0.smithi084.stdout:2402: done (5 left) 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:2403: copy_from oid 33 from oid 30 current snap is 237 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1230 (ObjNum 698 snap 218 seq_num 698) dirty exists 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:2396: finishing write tid 1 to smithi084102331-44 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:2396: finishing write tid 2 to smithi084102331-44 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:2396: finishing write tid 3 to smithi084102331-44 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1168 (ObjNum 755 snap 237 seq_num 755) dirty exists 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:2396: left oid 44 (ObjNum 755 snap 237 seq_num 755) 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:2400: finishing write tid 1 to smithi084102331-2 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:2400: finishing write tid 2 to smithi084102331-2 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:2400: finishing write tid 3 to smithi084102331-2 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1236 (ObjNum 756 snap 237 seq_num 756) dirty exists 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:2400: left oid 2 (ObjNum 756 snap 237 seq_num 756) 2024-01-13T18:08:43.673 INFO:tasks.rados.rados.0.smithi084.stdout:2399: expect (ObjNum 747 snap 231 seq_num 747) 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2401: finishing copy_from to smithi084102331-37 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1303 (ObjNum 718 snap 223 seq_num 718) dirty exists 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2401: finishing copy_from racing read to smithi084102331-37 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2403: finishing copy_from to smithi084102331-33 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2403: got expected ENOENT (src dne) 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2403: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2396: done (5 left) 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2397: done (4 left) 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2399: done (3 left) 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2400: done (2 left) 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2401: done (1 left) 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2403: done (0 left) 2024-01-13T18:08:43.898 INFO:tasks.rados.rados.0.smithi084.stdout:2404: rmattr oid 28 current snap is 237 2024-01-13T18:08:43.899 INFO:tasks.rados.rados.0.smithi084.stdout:2404: done (0 left) 2024-01-13T18:08:43.899 INFO:tasks.rados.rados.0.smithi084.stdout:2405: copy_from oid 11 from oid 22 current snap is 237 2024-01-13T18:08:43.899 INFO:tasks.rados.rados.0.smithi084.stdout:2406: snap_create 2024-01-13T18:08:43.920 INFO:tasks.rados.rados.0.smithi084.stdout:2405: finishing copy_from to smithi084102331-11 2024-01-13T18:08:43.920 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1226 (ObjNum 715 snap 222 seq_num 715) dirty exists 2024-01-13T18:08:43.920 INFO:tasks.rados.rados.0.smithi084.stdout:2405: finishing copy_from racing read to smithi084102331-11 2024-01-13T18:08:44.680 INFO:tasks.rados.rados.0.smithi084.stdout:2405: done (1 left) 2024-01-13T18:08:44.680 INFO:tasks.rados.rados.0.smithi084.stdout:2406: done (0 left) 2024-01-13T18:08:44.681 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 238 2024-01-13T18:08:44.681 INFO:tasks.rados.rados.0.smithi084.stdout:2407: seq_num 757 ranges {0=688128} 2024-01-13T18:08:44.684 INFO:tasks.rados.rados.0.smithi084.stdout:2407: writing smithi084102331-40 from 0 to 688128 tid 1 2024-01-13T18:08:44.684 INFO:tasks.rados.rados.0.smithi084.stdout:2408: setattr oid 23 current snap is 238 2024-01-13T18:08:44.685 INFO:tasks.rados.rados.0.smithi084.stdout:2409: delete oid 21 current snap is 238 2024-01-13T18:08:44.689 INFO:tasks.rados.rados.0.smithi084.stdout:2407: finishing write tid 1 to smithi084102331-40 2024-01-13T18:08:44.689 INFO:tasks.rados.rados.0.smithi084.stdout:2407: finishing write tid 2 to smithi084102331-40 2024-01-13T18:08:44.690 INFO:tasks.rados.rados.0.smithi084.stdout:2407: finishing write tid 3 to smithi084102331-40 2024-01-13T18:08:44.690 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 858 (ObjNum 757 snap 238 seq_num 757) dirty exists 2024-01-13T18:08:44.690 INFO:tasks.rados.rados.0.smithi084.stdout:2407: left oid 40 (ObjNum 757 snap 238 seq_num 757) 2024-01-13T18:08:44.691 INFO:tasks.rados.rados.0.smithi084.stdout:2407: done (2 left) 2024-01-13T18:08:44.691 INFO:tasks.rados.rados.0.smithi084.stdout:2409: done (1 left) 2024-01-13T18:08:44.691 INFO:tasks.rados.rados.0.smithi084.stdout:2410: read oid 18 snap -1 2024-01-13T18:08:44.691 INFO:tasks.rados.rados.0.smithi084.stdout:2410: expect (ObjNum 712 snap 222 seq_num 712) 2024-01-13T18:08:44.691 INFO:tasks.rados.rados.0.smithi084.stdout:2411: copy_from oid 25 from oid 38 current snap is 238 2024-01-13T18:08:44.691 INFO:tasks.rados.rados.0.smithi084.stdout:2412: copy_from oid 11 from oid 50 current snap is 238 2024-01-13T18:08:44.691 INFO:tasks.rados.rados.0.smithi084.stdout:2413: snap_remove snap 237 2024-01-13T18:08:44.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:44 smithi084 ceph-mon[119097]: osdmap e542: 8 total, 8 up, 8 in 2024-01-13T18:08:44.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:44 smithi084 ceph-mon[119097]: pgmap v525: 121 pgs: 121 active+clean; 237 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 607 KiB/s rd, 312 KiB/s wr, 8 op/s 2024-01-13T18:08:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:44 smithi084 ceph-mon[116404]: osdmap e542: 8 total, 8 up, 8 in 2024-01-13T18:08:44.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:44 smithi084 ceph-mon[116404]: pgmap v525: 121 pgs: 121 active+clean; 237 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 607 KiB/s rd, 312 KiB/s wr, 8 op/s 2024-01-13T18:08:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:44 smithi099 ceph-mon[138788]: osdmap e542: 8 total, 8 up, 8 in 2024-01-13T18:08:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:44 smithi099 ceph-mon[138788]: pgmap v525: 121 pgs: 121 active+clean; 237 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 607 KiB/s rd, 312 KiB/s wr, 8 op/s 2024-01-13T18:08:45.687 INFO:tasks.rados.rados.0.smithi084.stdout:2413: done (4 left) 2024-01-13T18:08:45.687 INFO:tasks.rados.rados.0.smithi084.stdout:2414: rollback oid 1 current snap is 238 2024-01-13T18:08:45.687 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 1 to 218 2024-01-13T18:08:45.687 INFO:tasks.rados.rados.0.smithi084.stdout:2415: rollback oid 44 current snap is 238 2024-01-13T18:08:45.687 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 234 2024-01-13T18:08:45.687 INFO:tasks.rados.rados.0.smithi084.stdout:2416: read oid 48 snap -1 2024-01-13T18:08:45.687 INFO:tasks.rados.rados.0.smithi084.stdout:2416: expect (ObjNum 716 snap 222 seq_num 716) 2024-01-13T18:08:45.687 INFO:tasks.rados.rados.0.smithi084.stdout:2417: rollback oid 5 current snap is 238 2024-01-13T18:08:45.687 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 231 2024-01-13T18:08:45.688 INFO:tasks.rados.rados.0.smithi084.stdout:2418: snap_remove snap 223 2024-01-13T18:08:45.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:45 smithi084 ceph-mon[116404]: osdmap e543: 8 total, 8 up, 8 in 2024-01-13T18:08:45.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:45 smithi084 ceph-mon[119097]: osdmap e543: 8 total, 8 up, 8 in 2024-01-13T18:08:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:45 smithi099 ceph-mon[138788]: osdmap e543: 8 total, 8 up, 8 in 2024-01-13T18:08:46.692 INFO:tasks.rados.rados.0.smithi084.stdout:2418: done (8 left) 2024-01-13T18:08:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:2419: rollback oid 43 current snap is 238 2024-01-13T18:08:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 229 2024-01-13T18:08:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1242 (ObjNum 698 snap 218 seq_num 698) dirty exists 2024-01-13T18:08:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:2412: finishing copy_from to smithi084102331-11 2024-01-13T18:08:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:2412: got expected ENOENT (src dne) 2024-01-13T18:08:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:2412: finishing copy_from racing read to smithi084102331-11 2024-01-13T18:08:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:2411: finishing copy_from to smithi084102331-25 2024-01-13T18:08:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1303 (ObjNum 718 snap 223 seq_num 718) dirty exists 2024-01-13T18:08:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:2411: finishing copy_from racing read to smithi084102331-25 2024-01-13T18:08:46.693 INFO:tasks.rados.rados.0.smithi084.stdout:2410: expect (ObjNum 712 snap 222 seq_num 712) 2024-01-13T18:08:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:46 smithi099 ceph-mon[138788]: osdmap e544: 8 total, 8 up, 8 in 2024-01-13T18:08:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:46 smithi099 ceph-mon[138788]: pgmap v528: 121 pgs: 121 active+clean; 237 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 328 KiB/s wr, 3 op/s 2024-01-13T18:08:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:46 smithi084 ceph-mon[116404]: osdmap e544: 8 total, 8 up, 8 in 2024-01-13T18:08:47.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:46 smithi084 ceph-mon[116404]: pgmap v528: 121 pgs: 121 active+clean; 237 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 328 KiB/s wr, 3 op/s 2024-01-13T18:08:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:46 smithi084 ceph-mon[119097]: osdmap e544: 8 total, 8 up, 8 in 2024-01-13T18:08:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:46 smithi084 ceph-mon[119097]: pgmap v528: 121 pgs: 121 active+clean; 237 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 328 KiB/s wr, 3 op/s 2024-01-13T18:08:47.424 INFO:tasks.rados.rados.0.smithi084.stdout:2415: finishing rollback tid 0 to smithi084102331-44 2024-01-13T18:08:47.424 INFO:tasks.rados.rados.0.smithi084.stdout:2415: finishing rollback tid 1 to smithi084102331-44 2024-01-13T18:08:47.424 INFO:tasks.rados.rados.0.smithi084.stdout:2415: finishing rollback tid 2 to smithi084102331-44 2024-01-13T18:08:47.424 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1175 (ObjNum 663 snap 207 seq_num 663) dirty exists 2024-01-13T18:08:47.424 INFO:tasks.rados.rados.0.smithi084.stdout:2417: finishing rollback tid 0 to smithi084102331-5 2024-01-13T18:08:47.424 INFO:tasks.rados.rados.0.smithi084.stdout:2414: finishing rollback tid 0 to smithi084102331-1 2024-01-13T18:08:47.424 INFO:tasks.rados.rados.0.smithi084.stdout:2417: finishing rollback tid 1 to smithi084102331-5 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2414: finishing rollback tid 1 to smithi084102331-1 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2417: finishing rollback tid 2 to smithi084102331-5 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 856 (ObjNum 701 snap 218 seq_num 701) dirty exists 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2414: finishing rollback tid 2 to smithi084102331-1 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1321 (ObjNum 677 snap 214 seq_num 677) dirty exists 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2408: done (8 left) 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2410: done (7 left) 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2411: done (6 left) 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2412: done (5 left) 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2414: done (4 left) 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2415: done (3 left) 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2417: done (2 left) 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2420: delete oid 5 current snap is 238 2024-01-13T18:08:47.425 INFO:tasks.rados.rados.0.smithi084.stdout:2416: expect (ObjNum 716 snap 222 seq_num 716) 2024-01-13T18:08:47.481 INFO:tasks.rados.rados.0.smithi084.stdout:2419: finishing rollback tid 1 to smithi084102331-43 2024-01-13T18:08:47.481 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 0 (ObjNum 33 snap 0 seq_num 4038029728) dirty dne 2024-01-13T18:08:47.481 INFO:tasks.rados.rados.0.smithi084.stdout:2416: done (2 left) 2024-01-13T18:08:47.481 INFO:tasks.rados.rados.0.smithi084.stdout:2419: done (1 left) 2024-01-13T18:08:47.481 INFO:tasks.rados.rados.0.smithi084.stdout:2420: done (0 left) 2024-01-13T18:08:47.481 INFO:tasks.rados.rados.0.smithi084.stdout:2421: rollback oid 11 current snap is 238 2024-01-13T18:08:47.481 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 11 to 224 2024-01-13T18:08:47.481 INFO:tasks.rados.rados.0.smithi084.stdout:2422: snap_create 2024-01-13T18:08:47.484 INFO:tasks.rados.rados.0.smithi084.stdout:2421: finishing rollback tid 0 to smithi084102331-11 2024-01-13T18:08:47.484 INFO:tasks.rados.rados.0.smithi084.stdout:2421: finishing rollback tid 1 to smithi084102331-11 2024-01-13T18:08:47.484 INFO:tasks.rados.rados.0.smithi084.stdout:2421: finishing rollback tid 2 to smithi084102331-11 2024-01-13T18:08:47.484 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1229 (ObjNum 702 snap 220 seq_num 702) dirty exists 2024-01-13T18:08:47.662 INFO:tasks.rados.rados.0.smithi084.stdout:2421: done (1 left) 2024-01-13T18:08:47.662 INFO:tasks.rados.rados.0.smithi084.stdout:2422: done (0 left) 2024-01-13T18:08:47.662 INFO:tasks.rados.rados.0.smithi084.stdout:2423: snap_create 2024-01-13T18:08:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:47 smithi099 ceph-mon[138788]: osdmap e545: 8 total, 8 up, 8 in 2024-01-13T18:08:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:47 smithi099 ceph-mon[138788]: osdmap e546: 8 total, 8 up, 8 in 2024-01-13T18:08:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:47 smithi084 ceph-mon[116404]: osdmap e545: 8 total, 8 up, 8 in 2024-01-13T18:08:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:47 smithi084 ceph-mon[116404]: osdmap e546: 8 total, 8 up, 8 in 2024-01-13T18:08:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:47 smithi084 ceph-mon[119097]: osdmap e545: 8 total, 8 up, 8 in 2024-01-13T18:08:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:47 smithi084 ceph-mon[119097]: osdmap e546: 8 total, 8 up, 8 in 2024-01-13T18:08:48.664 INFO:tasks.rados.rados.0.smithi084.stdout:2423: done (0 left) 2024-01-13T18:08:48.664 INFO:tasks.rados.rados.0.smithi084.stdout:2424: snap_create 2024-01-13T18:08:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:48 smithi099 ceph-mon[138788]: pgmap v531: 121 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 118 active+clean; 245 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.3 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2024-01-13T18:08:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:48 smithi099 ceph-mon[138788]: osdmap e547: 8 total, 8 up, 8 in 2024-01-13T18:08:49.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:48 smithi084 ceph-mon[116404]: pgmap v531: 121 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 118 active+clean; 245 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.3 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2024-01-13T18:08:49.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:48 smithi084 ceph-mon[116404]: osdmap e547: 8 total, 8 up, 8 in 2024-01-13T18:08:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:48 smithi084 ceph-mon[119097]: pgmap v531: 121 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 118 active+clean; 245 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.3 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2024-01-13T18:08:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:48 smithi084 ceph-mon[119097]: osdmap e547: 8 total, 8 up, 8 in 2024-01-13T18:08:49.665 INFO:tasks.rados.rados.0.smithi084.stdout:2424: done (0 left) 2024-01-13T18:08:49.665 INFO:tasks.rados.rados.0.smithi084.stdout:2425: read oid 21 snap -1 2024-01-13T18:08:49.665 INFO:tasks.rados.rados.0.smithi084.stdout:2425: expect deleted 2024-01-13T18:08:49.665 INFO:tasks.rados.rados.0.smithi084.stdout:2426: delete oid 10 current snap is 241 2024-01-13T18:08:49.669 INFO:tasks.rados.rados.0.smithi084.stdout:2425: done (1 left) 2024-01-13T18:08:49.669 INFO:tasks.rados.rados.0.smithi084.stdout:2426: done (0 left) 2024-01-13T18:08:49.669 INFO:tasks.rados.rados.0.smithi084.stdout:2427: rollback oid 38 current snap is 241 2024-01-13T18:08:49.669 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 218 2024-01-13T18:08:49.669 INFO:tasks.rados.rados.0.smithi084.stdout:2428: snap_remove snap 229 2024-01-13T18:08:50.662 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:08:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:08:50] "GET /metrics HTTP/1.1" 200 36193 "" "Prometheus/2.43.0" 2024-01-13T18:08:50.681 INFO:tasks.rados.rados.0.smithi084.stdout:2428: done (1 left) 2024-01-13T18:08:50.681 INFO:tasks.rados.rados.0.smithi084.stdout:2429: snap_create 2024-01-13T18:08:50.681 INFO:tasks.rados.rados.0.smithi084.stdout:2427: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:08:50.681 INFO:tasks.rados.rados.0.smithi084.stdout:2427: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:08:50.681 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1328 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-01-13T18:08:50.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:50 smithi084 ceph-mon[116404]: osdmap e548: 8 total, 8 up, 8 in 2024-01-13T18:08:50.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:50.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:50 smithi084 ceph-mon[116404]: pgmap v534: 121 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 118 active+clean; 245 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.4 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2024-01-13T18:08:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:50 smithi084 ceph-mon[119097]: osdmap e548: 8 total, 8 up, 8 in 2024-01-13T18:08:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:50.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:50 smithi084 ceph-mon[119097]: pgmap v534: 121 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 118 active+clean; 245 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.4 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2024-01-13T18:08:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:50 smithi099 ceph-mon[138788]: osdmap e548: 8 total, 8 up, 8 in 2024-01-13T18:08:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:08:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:50 smithi099 ceph-mon[138788]: pgmap v534: 121 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 118 active+clean; 245 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.4 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2024-01-13T18:08:51.680 INFO:tasks.rados.rados.0.smithi084.stdout:2427: done (1 left) 2024-01-13T18:08:51.681 INFO:tasks.rados.rados.0.smithi084.stdout:2429: done (0 left) 2024-01-13T18:08:51.681 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 242 2024-01-13T18:08:51.681 INFO:tasks.rados.rados.0.smithi084.stdout:2430: seq_num 761 ranges {688128=753664} 2024-01-13T18:08:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:2430: writing smithi084102331-40 from 688128 to 1441792 tid 1 2024-01-13T18:08:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:2431: setattr oid 18 current snap is 242 2024-01-13T18:08:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:2432: setattr oid 7 current snap is 242 2024-01-13T18:08:51.691 INFO:tasks.rados.rados.0.smithi084.stdout:2433: rollback oid 12 current snap is 242 2024-01-13T18:08:51.691 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 238 2024-01-13T18:08:51.691 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 242 2024-01-13T18:08:51.691 INFO:tasks.rados.rados.0.smithi084.stdout:2434: seq_num 762 ranges {401408=770048} 2024-01-13T18:08:51.698 INFO:tasks.rados.rados.0.smithi084.stdout:2434: writing smithi084102331-4 from 401408 to 1171456 tid 1 2024-01-13T18:08:51.698 INFO:tasks.rados.rados.0.smithi084.stdout:2435: read oid 32 snap 224 2024-01-13T18:08:51.698 INFO:tasks.rados.rados.0.smithi084.stdout:2435: expect (ObjNum -258194432 snap 21877 seq_num 4037519952) 2024-01-13T18:08:51.698 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 242 2024-01-13T18:08:51.699 INFO:tasks.rados.rados.0.smithi084.stdout:2436: seq_num 763 ranges {245760=786432} 2024-01-13T18:08:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:2436: writing smithi084102331-39 from 245760 to 1032192 tid 1 2024-01-13T18:08:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1100 (ObjNum 712 snap 222 seq_num 712) dirty exists 2024-01-13T18:08:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:2437: read oid 14 snap -1 2024-01-13T18:08:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:2437: expect deleted 2024-01-13T18:08:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:2431: done (7 left) 2024-01-13T18:08:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:2438: rollback oid 47 current snap is 242 2024-01-13T18:08:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 224 2024-01-13T18:08:51.706 INFO:tasks.rados.rados.0.smithi084.stdout:2433: finishing rollback tid 0 to smithi084102331-12 2024-01-13T18:08:51.706 INFO:tasks.rados.rados.0.smithi084.stdout:2430: finishing write tid 1 to smithi084102331-40 2024-01-13T18:08:51.706 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1101 (ObjNum 579 snap 185 seq_num 579) dirty exists 2024-01-13T18:08:51.706 INFO:tasks.rados.rados.0.smithi084.stdout:2432: done (7 left) 2024-01-13T18:08:51.706 INFO:tasks.rados.rados.0.smithi084.stdout:2439: snap_remove snap 239 2024-01-13T18:08:51.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:51 smithi084 ceph-mon[116404]: osdmap e549: 8 total, 8 up, 8 in 2024-01-13T18:08:51.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:51 smithi084 ceph-mon[119097]: osdmap e549: 8 total, 8 up, 8 in 2024-01-13T18:08:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:51 smithi099 ceph-mon[138788]: osdmap e549: 8 total, 8 up, 8 in 2024-01-13T18:08:52.666 INFO:tasks.rados.rados.0.smithi084.stdout:2439: done (7 left) 2024-01-13T18:08:52.666 INFO:tasks.rados.rados.0.smithi084.stdout:2440: snap_create 2024-01-13T18:08:52.666 INFO:tasks.rados.rados.0.smithi084.stdout:2433: finishing rollback tid 1 to smithi084102331-12 2024-01-13T18:08:52.666 INFO:tasks.rados.rados.0.smithi084.stdout:2435: expect (ObjNum -258194432 snap 21877 seq_num 4037519952) 2024-01-13T18:08:52.677 INFO:tasks.rados.rados.0.smithi084.stdout:2433: finishing rollback tid 2 to smithi084102331-12 2024-01-13T18:08:52.677 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1258 (ObjNum 737 snap 230 seq_num 737) dirty exists 2024-01-13T18:08:52.677 INFO:tasks.rados.rados.0.smithi084.stdout:2430: finishing write tid 2 to smithi084102331-40 2024-01-13T18:08:52.677 INFO:tasks.rados.rados.0.smithi084.stdout:2430: finishing write tid 3 to smithi084102331-40 2024-01-13T18:08:52.677 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 877 (ObjNum 761 snap 242 seq_num 761) dirty exists 2024-01-13T18:08:52.677 INFO:tasks.rados.rados.0.smithi084.stdout:2430: left oid 40 (ObjNum 761 snap 242 seq_num 761) 2024-01-13T18:08:52.677 INFO:tasks.rados.rados.0.smithi084.stdout:2434: finishing write tid 1 to smithi084102331-4 2024-01-13T18:08:52.677 INFO:tasks.rados.rados.0.smithi084.stdout:2434: finishing write tid 2 to smithi084102331-4 2024-01-13T18:08:52.677 INFO:tasks.rados.rados.0.smithi084.stdout:2434: finishing write tid 3 to smithi084102331-4 2024-01-13T18:08:52.678 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 870 (ObjNum 762 snap 242 seq_num 762) dirty exists 2024-01-13T18:08:52.678 INFO:tasks.rados.rados.0.smithi084.stdout:2434: left oid 4 (ObjNum 762 snap 242 seq_num 762) 2024-01-13T18:08:52.678 INFO:tasks.rados.rados.0.smithi084.stdout:2438: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:08:52.678 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 0 (ObjNum 33 snap 0 seq_num 2462050945) dirty dne 2024-01-13T18:08:52.678 INFO:tasks.rados.rados.0.smithi084.stdout:2436: finishing write tid 1 to smithi084102331-39 2024-01-13T18:08:52.678 INFO:tasks.rados.rados.0.smithi084.stdout:2436: finishing write tid 2 to smithi084102331-39 2024-01-13T18:08:52.678 INFO:tasks.rados.rados.0.smithi084.stdout:2436: finishing write tid 3 to smithi084102331-39 2024-01-13T18:08:52.678 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1231 (ObjNum 763 snap 242 seq_num 763) dirty exists 2024-01-13T18:08:52.678 INFO:tasks.rados.rados.0.smithi084.stdout:2436: left oid 39 (ObjNum 763 snap 242 seq_num 763) 2024-01-13T18:08:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:52 smithi099 ceph-mon[138788]: osdmap e550: 8 total, 8 up, 8 in 2024-01-13T18:08:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:52 smithi099 ceph-mon[138788]: pgmap v537: 121 pgs: 121 active+clean; 246 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 372 KiB/s wr, 8 op/s 2024-01-13T18:08:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:52 smithi099 ceph-mon[138788]: osdmap e551: 8 total, 8 up, 8 in 2024-01-13T18:08:53.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:52 smithi084 ceph-mon[116404]: osdmap e550: 8 total, 8 up, 8 in 2024-01-13T18:08:53.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:52 smithi084 ceph-mon[116404]: pgmap v537: 121 pgs: 121 active+clean; 246 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 372 KiB/s wr, 8 op/s 2024-01-13T18:08:53.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:52 smithi084 ceph-mon[116404]: osdmap e551: 8 total, 8 up, 8 in 2024-01-13T18:08:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:52 smithi084 ceph-mon[119097]: osdmap e550: 8 total, 8 up, 8 in 2024-01-13T18:08:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:52 smithi084 ceph-mon[119097]: pgmap v537: 121 pgs: 121 active+clean; 246 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 372 KiB/s wr, 8 op/s 2024-01-13T18:08:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:52 smithi084 ceph-mon[119097]: osdmap e551: 8 total, 8 up, 8 in 2024-01-13T18:08:53.671 INFO:tasks.rados.rados.0.smithi084.stdout:2430: done (7 left) 2024-01-13T18:08:53.671 INFO:tasks.rados.rados.0.smithi084.stdout:2433: done (6 left) 2024-01-13T18:08:53.671 INFO:tasks.rados.rados.0.smithi084.stdout:2434: done (5 left) 2024-01-13T18:08:53.671 INFO:tasks.rados.rados.0.smithi084.stdout:2435: done (4 left) 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2436: done (3 left) 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2437: done (2 left) 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2438: done (1 left) 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2440: done (0 left) 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2441: rmattr oid 43 current snap is 243 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2441: done (0 left) 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2442: read oid 11 snap -1 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2442: expect (ObjNum 702 snap 220 seq_num 702) 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2443: rollback oid 8 current snap is 243 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 242 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2444: read oid 45 snap -1 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2444: expect (ObjNum 741 snap 230 seq_num 741) 2024-01-13T18:08:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:2445: copy_from oid 23 from oid 16 current snap is 243 2024-01-13T18:08:53.673 INFO:tasks.rados.rados.0.smithi084.stdout:2446: read oid 2 snap -1 2024-01-13T18:08:53.673 INFO:tasks.rados.rados.0.smithi084.stdout:2446: expect (ObjNum 756 snap 237 seq_num 756) 2024-01-13T18:08:53.673 INFO:tasks.rados.rados.0.smithi084.stdout:2447: setattr oid 24 current snap is 243 2024-01-13T18:08:53.673 INFO:tasks.rados.rados.0.smithi084.stdout:2448: setattr oid 15 current snap is 243 2024-01-13T18:08:53.673 INFO:tasks.rados.rados.0.smithi084.stdout:2449: rmattr oid 31 current snap is 243 2024-01-13T18:08:53.673 INFO:tasks.rados.rados.0.smithi084.stdout:2449: done (7 left) 2024-01-13T18:08:53.673 INFO:tasks.rados.rados.0.smithi084.stdout:2450: read oid 37 snap -1 2024-01-13T18:08:53.673 INFO:tasks.rados.rados.0.smithi084.stdout:2450: expect (ObjNum 718 snap 223 seq_num 718) 2024-01-13T18:08:53.673 INFO:tasks.rados.rados.0.smithi084.stdout:2451: rollback oid 10 current snap is 243 2024-01-13T18:08:53.673 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 234 2024-01-13T18:08:53.674 INFO:tasks.rados.rados.0.smithi084.stdout:2452: rollback oid 17 current snap is 243 2024-01-13T18:08:53.674 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 231 2024-01-13T18:08:53.674 INFO:tasks.rados.rados.0.smithi084.stdout:2453: snap_remove snap 228 2024-01-13T18:08:54.675 INFO:tasks.rados.rados.0.smithi084.stdout:2453: done (10 left) 2024-01-13T18:08:54.675 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 243 2024-01-13T18:08:54.675 INFO:tasks.rados.rados.0.smithi084.stdout:2454: seq_num 764 ranges {450560=802816} 2024-01-13T18:08:54.686 INFO:tasks.rados.rados.0.smithi084.stdout:2454: writing smithi084102331-41 from 450560 to 1253376 tid 1 2024-01-13T18:08:54.687 INFO:tasks.rados.rados.0.smithi084.stdout:2455: rollback oid 6 current snap is 243 2024-01-13T18:08:54.687 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 6 to 224 2024-01-13T18:08:54.687 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 243 2024-01-13T18:08:54.687 INFO:tasks.rados.rados.0.smithi084.stdout:2456: seq_num 765 ranges {3989504=417792,4407296=401408} 2024-01-13T18:08:54.707 INFO:tasks.rados.rados.0.smithi084.stdout:2456: writing smithi084102331-36 from 3989504 to 4407296 tid 1 2024-01-13T18:08:54.710 INFO:tasks.rados.rados.0.smithi084.stdout:2456: writing smithi084102331-36 from 4407296 to 4808704 tid 2 2024-01-13T18:08:54.710 INFO:tasks.rados.rados.0.smithi084.stdout:2457: snap_create 2024-01-13T18:08:54.710 INFO:tasks.rados.rados.0.smithi084.stdout:2444: expect (ObjNum 741 snap 230 seq_num 741) 2024-01-13T18:08:54.721 INFO:tasks.rados.rados.0.smithi084.stdout:2451: finishing rollback tid 1 to smithi084102331-10 2024-01-13T18:08:54.721 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1099 (ObjNum 81 snap 0 seq_num 1902408028) dirty dne 2024-01-13T18:08:54.721 INFO:tasks.rados.rados.0.smithi084.stdout:2443: finishing rollback tid 0 to smithi084102331-8 2024-01-13T18:08:54.721 INFO:tasks.rados.rados.0.smithi084.stdout:2443: finishing rollback tid 1 to smithi084102331-8 2024-01-13T18:08:54.721 INFO:tasks.rados.rados.0.smithi084.stdout:2443: finishing rollback tid 2 to smithi084102331-8 2024-01-13T18:08:54.721 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1184 (ObjNum 679 snap 215 seq_num 679) dirty exists 2024-01-13T18:08:54.721 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1186 (ObjNum 714 snap 222 seq_num 714) dirty exists 2024-01-13T18:08:54.721 INFO:tasks.rados.rados.0.smithi084.stdout:2452: finishing rollback tid 1 to smithi084102331-17 2024-01-13T18:08:54.722 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 0 (ObjNum 33 snap 0 seq_num 4032368952) dirty dne 2024-01-13T18:08:54.722 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1102 (ObjNum 681 snap 215 seq_num 681) dirty exists 2024-01-13T18:08:54.722 INFO:tasks.rados.rados.0.smithi084.stdout:2450: expect (ObjNum 718 snap 223 seq_num 718) 2024-01-13T18:08:54.724 INFO:tasks.rados.rados.0.smithi084.stdout:2445: finishing copy_from to smithi084102331-23 2024-01-13T18:08:54.724 INFO:tasks.rados.rados.0.smithi084.stdout:2445: got expected ENOENT (src dne) 2024-01-13T18:08:54.724 INFO:tasks.rados.rados.0.smithi084.stdout:2445: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:08:54.724 INFO:tasks.rados.rados.0.smithi084.stdout:2446: expect (ObjNum 756 snap 237 seq_num 756) 2024-01-13T18:08:54.740 INFO:tasks.rados.rados.0.smithi084.stdout:2442: expect (ObjNum 702 snap 220 seq_num 702) 2024-01-13T18:08:54.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:54 smithi084 ceph-mon[116404]: osdmap e552: 8 total, 8 up, 8 in 2024-01-13T18:08:54.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:54 smithi084 ceph-mon[116404]: pgmap v540: 121 pgs: 121 active+clean; 247 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 52 KiB/s rd, 564 KiB/s wr, 13 op/s 2024-01-13T18:08:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:54 smithi084 ceph-mon[119097]: osdmap e552: 8 total, 8 up, 8 in 2024-01-13T18:08:54.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:54 smithi084 ceph-mon[119097]: pgmap v540: 121 pgs: 121 active+clean; 247 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 52 KiB/s rd, 564 KiB/s wr, 13 op/s 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:2455: finishing rollback tid 0 to smithi084102331-6 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:2455: finishing rollback tid 1 to smithi084102331-6 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:2455: finishing rollback tid 2 to smithi084102331-6 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 1089 (ObjNum 707 snap 222 seq_num 707) dirty exists 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:2454: finishing write tid 1 to smithi084102331-41 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:2454: finishing write tid 2 to smithi084102331-41 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:2454: finishing write tid 3 to smithi084102331-41 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1233 (ObjNum 764 snap 243 seq_num 764) dirty exists 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:2454: left oid 41 (ObjNum 764 snap 243 seq_num 764) 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:2456: finishing write tid 1 to smithi084102331-36 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:2456: finishing write tid 2 to smithi084102331-36 2024-01-13T18:08:55.072 INFO:tasks.rados.rados.0.smithi084.stdout:2456: finishing write tid 3 to smithi084102331-36 2024-01-13T18:08:55.073 INFO:tasks.rados.rados.0.smithi084.stdout:2456: finishing write tid 4 to smithi084102331-36 2024-01-13T18:08:55.073 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1108 (ObjNum 765 snap 243 seq_num 765) dirty exists 2024-01-13T18:08:55.073 INFO:tasks.rados.rados.0.smithi084.stdout:2456: left oid 36 (ObjNum 765 snap 243 seq_num 765) 2024-01-13T18:08:55.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:54 smithi099 ceph-mon[138788]: osdmap e552: 8 total, 8 up, 8 in 2024-01-13T18:08:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:54 smithi099 ceph-mon[138788]: pgmap v540: 121 pgs: 121 active+clean; 247 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 52 KiB/s rd, 564 KiB/s wr, 13 op/s 2024-01-13T18:08:55.675 INFO:tasks.rados.rados.0.smithi084.stdout:2442: done (13 left) 2024-01-13T18:08:55.675 INFO:tasks.rados.rados.0.smithi084.stdout:2443: done (12 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2444: done (11 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2445: done (10 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2446: done (9 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2447: done (8 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2448: done (7 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2450: done (6 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2451: done (5 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2452: done (4 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2454: done (3 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2455: done (2 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2456: done (1 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2457: done (0 left) 2024-01-13T18:08:55.676 INFO:tasks.rados.rados.0.smithi084.stdout:2458: snap_remove snap 243 2024-01-13T18:08:55.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:55 smithi084 ceph-mon[116404]: osdmap e553: 8 total, 8 up, 8 in 2024-01-13T18:08:55.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:55 smithi084 ceph-mon[119097]: osdmap e553: 8 total, 8 up, 8 in 2024-01-13T18:08:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:55 smithi099 ceph-mon[138788]: osdmap e553: 8 total, 8 up, 8 in 2024-01-13T18:08:56.676 INFO:tasks.rados.rados.0.smithi084.stdout:2458: done (0 left) 2024-01-13T18:08:56.676 INFO:tasks.rados.rados.0.smithi084.stdout:2459: read oid 16 snap -1 2024-01-13T18:08:56.676 INFO:tasks.rados.rados.0.smithi084.stdout:2459: expect deleted 2024-01-13T18:08:56.676 INFO:tasks.rados.rados.0.smithi084.stdout:2460: read oid 15 snap -1 2024-01-13T18:08:56.676 INFO:tasks.rados.rados.0.smithi084.stdout:2460: expect (ObjNum 714 snap 222 seq_num 714) 2024-01-13T18:08:56.676 INFO:tasks.rados.rados.0.smithi084.stdout:2461: rollback oid 36 current snap is 244 2024-01-13T18:08:56.676 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 241 2024-01-13T18:08:56.676 INFO:tasks.rados.rados.0.smithi084.stdout:2462: rollback oid 29 current snap is 244 2024-01-13T18:08:56.676 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 242 2024-01-13T18:08:56.676 INFO:tasks.rados.rados.0.smithi084.stdout:2463: snap_create 2024-01-13T18:08:56.684 INFO:tasks.rados.rados.0.smithi084.stdout:2462: finishing rollback tid 0 to smithi084102331-29 2024-01-13T18:08:56.688 INFO:tasks.rados.rados.0.smithi084.stdout:2462: finishing rollback tid 1 to smithi084102331-29 2024-01-13T18:08:56.688 INFO:tasks.rados.rados.0.smithi084.stdout:2462: finishing rollback tid 2 to smithi084102331-29 2024-01-13T18:08:56.688 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 889 (ObjNum 734 snap 229 seq_num 734) dirty exists 2024-01-13T18:08:56.688 INFO:tasks.rados.rados.0.smithi084.stdout:2461: finishing rollback tid 0 to smithi084102331-36 2024-01-13T18:08:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:2461: finishing rollback tid 1 to smithi084102331-36 2024-01-13T18:08:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:2461: finishing rollback tid 2 to smithi084102331-36 2024-01-13T18:08:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1111 (ObjNum 534 snap 171 seq_num 534) dirty exists 2024-01-13T18:08:56.701 INFO:tasks.rados.rados.0.smithi084.stdout:2460: expect (ObjNum 714 snap 222 seq_num 714) 2024-01-13T18:08:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:56 smithi099 ceph-mon[138788]: osdmap e554: 8 total, 8 up, 8 in 2024-01-13T18:08:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:56 smithi099 ceph-mon[138788]: pgmap v543: 121 pgs: 121 active+clean; 247 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 93 KiB/s rd, 192 KiB/s wr, 7 op/s 2024-01-13T18:08:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:56 smithi099 ceph-mon[138788]: osdmap e555: 8 total, 8 up, 8 in 2024-01-13T18:08:57.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:56 smithi084 ceph-mon[116404]: osdmap e554: 8 total, 8 up, 8 in 2024-01-13T18:08:57.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:56 smithi084 ceph-mon[116404]: pgmap v543: 121 pgs: 121 active+clean; 247 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 93 KiB/s rd, 192 KiB/s wr, 7 op/s 2024-01-13T18:08:57.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:56 smithi084 ceph-mon[116404]: osdmap e555: 8 total, 8 up, 8 in 2024-01-13T18:08:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:56 smithi084 ceph-mon[119097]: osdmap e554: 8 total, 8 up, 8 in 2024-01-13T18:08:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:56 smithi084 ceph-mon[119097]: pgmap v543: 121 pgs: 121 active+clean; 247 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 93 KiB/s rd, 192 KiB/s wr, 7 op/s 2024-01-13T18:08:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:56 smithi084 ceph-mon[119097]: osdmap e555: 8 total, 8 up, 8 in 2024-01-13T18:08:57.667 INFO:tasks.rados.rados.0.smithi084.stdout:2459: done (4 left) 2024-01-13T18:08:57.667 INFO:tasks.rados.rados.0.smithi084.stdout:2460: done (3 left) 2024-01-13T18:08:57.667 INFO:tasks.rados.rados.0.smithi084.stdout:2461: done (2 left) 2024-01-13T18:08:57.667 INFO:tasks.rados.rados.0.smithi084.stdout:2462: done (1 left) 2024-01-13T18:08:57.667 INFO:tasks.rados.rados.0.smithi084.stdout:2463: done (0 left) 2024-01-13T18:08:57.667 INFO:tasks.rados.rados.0.smithi084.stdout:2464: rollback oid 20 current snap is 245 2024-01-13T18:08:57.667 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 224 2024-01-13T18:08:57.667 INFO:tasks.rados.rados.0.smithi084.stdout:2465: copy_from oid 33 from oid 28 current snap is 245 2024-01-13T18:08:57.667 INFO:tasks.rados.rados.0.smithi084.stdout:2466: read oid 50 snap 241 2024-01-13T18:08:57.668 INFO:tasks.rados.rados.0.smithi084.stdout:2466: expect deleted 2024-01-13T18:08:57.668 INFO:tasks.rados.rados.0.smithi084.stdout:2467: delete oid 29 current snap is 245 2024-01-13T18:08:57.672 INFO:tasks.rados.rados.0.smithi084.stdout:2466: done (3 left) 2024-01-13T18:08:57.672 INFO:tasks.rados.rados.0.smithi084.stdout:2467: done (2 left) 2024-01-13T18:08:57.672 INFO:tasks.rados.rados.0.smithi084.stdout:2468: rmattr oid 24 current snap is 245 2024-01-13T18:08:57.672 INFO:tasks.rados.rados.0.smithi084.stdout:2469: delete oid 8 current snap is 245 2024-01-13T18:08:57.676 INFO:tasks.rados.rados.0.smithi084.stdout:2469: done (3 left) 2024-01-13T18:08:57.676 INFO:tasks.rados.rados.0.smithi084.stdout:2470: copy_from oid 1 from oid 43 current snap is 245 2024-01-13T18:08:57.676 INFO:tasks.rados.rados.0.smithi084.stdout:2471: read oid 27 snap 241 2024-01-13T18:08:57.676 INFO:tasks.rados.rados.0.smithi084.stdout:2471: expect (ObjNum 745 snap 231 seq_num 745) 2024-01-13T18:08:57.676 INFO:tasks.rados.rados.0.smithi084.stdout:2472: snap_remove snap 234 2024-01-13T18:08:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:2472: done (5 left) 2024-01-13T18:08:58.687 INFO:tasks.rados.rados.0.smithi084.stdout:2473: setattr oid 34 current snap is 245 2024-01-13T18:08:58.694 INFO:tasks.rados.rados.0.smithi084.stdout:2464: finishing rollback tid 0 to smithi084102331-20 2024-01-13T18:08:58.694 INFO:tasks.rados.rados.0.smithi084.stdout:2464: finishing rollback tid 1 to smithi084102331-20 2024-01-13T18:08:58.694 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 646 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-01-13T18:08:58.694 INFO:tasks.rados.rados.0.smithi084.stdout:2470: finishing copy_from to smithi084102331-1 2024-01-13T18:08:58.694 INFO:tasks.rados.rados.0.smithi084.stdout:2470: got expected ENOENT (src dne) 2024-01-13T18:08:58.694 INFO:tasks.rados.rados.0.smithi084.stdout:2470: finishing copy_from racing read to smithi084102331-1 2024-01-13T18:08:58.694 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1103 (ObjNum 681 snap 215 seq_num 681) dirty exists 2024-01-13T18:08:58.694 INFO:tasks.rados.rados.0.smithi084.stdout:2471: expect (ObjNum 745 snap 231 seq_num 745) 2024-01-13T18:08:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2465: finishing copy_from to smithi084102331-33 2024-01-13T18:08:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1109 (ObjNum 564 snap 180 seq_num 564) dirty exists 2024-01-13T18:08:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2465: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:08:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2464: done (5 left) 2024-01-13T18:08:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2465: done (4 left) 2024-01-13T18:08:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2468: done (3 left) 2024-01-13T18:08:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2470: done (2 left) 2024-01-13T18:08:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2471: done (1 left) 2024-01-13T18:08:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2474: read oid 47 snap -1 2024-01-13T18:08:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2474: expect deleted 2024-01-13T18:08:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2475: delete oid 33 current snap is 245 2024-01-13T18:08:58.705 INFO:tasks.rados.rados.0.smithi084.stdout:2474: done (2 left) 2024-01-13T18:08:58.705 INFO:tasks.rados.rados.0.smithi084.stdout:2475: done (1 left) 2024-01-13T18:08:58.705 INFO:tasks.rados.rados.0.smithi084.stdout:2476: read oid 3 snap -1 2024-01-13T18:08:58.706 INFO:tasks.rados.rados.0.smithi084.stdout:2476: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:08:58.706 INFO:tasks.rados.rados.0.smithi084.stdout:2477: rollback oid 29 current snap is 245 2024-01-13T18:08:58.706 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 236 2024-01-13T18:08:58.706 INFO:tasks.rados.rados.0.smithi084.stdout:2478: rollback oid 18 current snap is 245 2024-01-13T18:08:58.706 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 218 2024-01-13T18:08:58.706 INFO:tasks.rados.rados.0.smithi084.stdout:2479: delete oid 7 current snap is 245 2024-01-13T18:08:58.709 INFO:tasks.rados.rados.0.smithi084.stdout:2476: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:08:58.717 INFO:tasks.rados.rados.0.smithi084.stdout:2476: done (4 left) 2024-01-13T18:08:58.718 INFO:tasks.rados.rados.0.smithi084.stdout:2479: done (3 left) 2024-01-13T18:08:58.718 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 245 2024-01-13T18:08:58.718 INFO:tasks.rados.rados.0.smithi084.stdout:2478: finishing rollback tid 0 to smithi084102331-18 2024-01-13T18:08:58.718 INFO:tasks.rados.rados.0.smithi084.stdout:2478: finishing rollback tid 1 to smithi084102331-18 2024-01-13T18:08:58.718 INFO:tasks.rados.rados.0.smithi084.stdout:2478: finishing rollback tid 2 to smithi084102331-18 2024-01-13T18:08:58.718 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1103 (ObjNum 639 snap 199 seq_num 639) dirty exists 2024-01-13T18:08:58.718 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 1090 (ObjNum 679 snap 215 seq_num 679) dirty exists 2024-01-13T18:08:58.718 INFO:tasks.rados.rados.0.smithi084.stdout:2480: seq_num 770 ranges {5242880=499712,5742592=401408} 2024-01-13T18:08:58.747 INFO:tasks.rados.rados.0.smithi084.stdout:2480: writing smithi084102331-15 from 5242880 to 5742592 tid 1 2024-01-13T18:08:58.750 INFO:tasks.rados.rados.0.smithi084.stdout:2480: writing smithi084102331-15 from 5742592 to 6144000 tid 2 2024-01-13T18:08:58.750 INFO:tasks.rados.rados.0.smithi084.stdout:2473: done (3 left) 2024-01-13T18:08:58.750 INFO:tasks.rados.rados.0.smithi084.stdout:2478: done (2 left) 2024-01-13T18:08:58.750 INFO:tasks.rados.rados.0.smithi084.stdout:2481: snap_create 2024-01-13T18:08:58.750 INFO:tasks.rados.rados.0.smithi084.stdout:2477: finishing rollback tid 1 to smithi084102331-29 2024-01-13T18:08:58.750 INFO:tasks.rados.rados.0.smithi084.stdout:2477: finishing rollback tid 2 to smithi084102331-29 2024-01-13T18:08:58.750 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 897 (ObjNum 734 snap 229 seq_num 734) dirty exists 2024-01-13T18:08:58.753 INFO:tasks.rados.rados.0.smithi084.stdout:2480: finishing write tid 1 to smithi084102331-15 2024-01-13T18:08:58.753 INFO:tasks.rados.rados.0.smithi084.stdout:2480: finishing write tid 2 to smithi084102331-15 2024-01-13T18:08:58.753 INFO:tasks.rados.rados.0.smithi084.stdout:2480: finishing write tid 3 to smithi084102331-15 2024-01-13T18:08:58.754 INFO:tasks.rados.rados.0.smithi084.stdout:2480: finishing write tid 4 to smithi084102331-15 2024-01-13T18:08:58.754 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1204 (ObjNum 770 snap 245 seq_num 770) dirty exists 2024-01-13T18:08:58.754 INFO:tasks.rados.rados.0.smithi084.stdout:2480: left oid 15 (ObjNum 770 snap 245 seq_num 770) 2024-01-13T18:08:58.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:58 smithi084 ceph-mon[119097]: osdmap e556: 8 total, 8 up, 8 in 2024-01-13T18:08:58.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:58 smithi084 ceph-mon[119097]: pgmap v546: 121 pgs: 121 active+clean; 247 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.4 MiB/s rd, 196 KiB/s wr, 18 op/s 2024-01-13T18:08:58.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:58 smithi084 ceph-mon[116404]: osdmap e556: 8 total, 8 up, 8 in 2024-01-13T18:08:58.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:58 smithi084 ceph-mon[116404]: pgmap v546: 121 pgs: 121 active+clean; 247 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.4 MiB/s rd, 196 KiB/s wr, 18 op/s 2024-01-13T18:08:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:58 smithi099 ceph-mon[138788]: osdmap e556: 8 total, 8 up, 8 in 2024-01-13T18:08:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:58 smithi099 ceph-mon[138788]: pgmap v546: 121 pgs: 121 active+clean; 247 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.4 MiB/s rd, 196 KiB/s wr, 18 op/s 2024-01-13T18:08:59.690 INFO:tasks.rados.rados.0.smithi084.stdout:2477: done (2 left) 2024-01-13T18:08:59.690 INFO:tasks.rados.rados.0.smithi084.stdout:2480: done (1 left) 2024-01-13T18:08:59.690 INFO:tasks.rados.rados.0.smithi084.stdout:2481: done (0 left) 2024-01-13T18:08:59.690 INFO:tasks.rados.rados.0.smithi084.stdout:2482: rmattr oid 36 current snap is 246 2024-01-13T18:08:59.690 INFO:tasks.rados.rados.0.smithi084.stdout:2482: done (0 left) 2024-01-13T18:08:59.691 INFO:tasks.rados.rados.0.smithi084.stdout:2483: delete oid 24 current snap is 246 2024-01-13T18:08:59.698 INFO:tasks.rados.rados.0.smithi084.stdout:2483: done (0 left) 2024-01-13T18:08:59.698 INFO:tasks.rados.rados.0.smithi084.stdout:2484: read oid 46 snap -1 2024-01-13T18:08:59.698 INFO:tasks.rados.rados.0.smithi084.stdout:2484: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:08:59.698 INFO:tasks.rados.rados.0.smithi084.stdout:2485: read oid 23 snap -1 2024-01-13T18:08:59.698 INFO:tasks.rados.rados.0.smithi084.stdout:2485: expect (ObjNum 698 snap 218 seq_num 698) 2024-01-13T18:08:59.698 INFO:tasks.rados.rados.0.smithi084.stdout:2486: snap_create 2024-01-13T18:08:59.699 INFO:tasks.rados.rados.0.smithi084.stdout:2484: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:08:59.713 INFO:tasks.rados.rados.0.smithi084.stdout:2485: expect (ObjNum 698 snap 218 seq_num 698) 2024-01-13T18:09:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:08:59 smithi099 ceph-mon[138788]: osdmap e557: 8 total, 8 up, 8 in 2024-01-13T18:09:00.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:08:59 smithi084 ceph-mon[116404]: osdmap e557: 8 total, 8 up, 8 in 2024-01-13T18:09:00.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:08:59 smithi084 ceph-mon[119097]: osdmap e557: 8 total, 8 up, 8 in 2024-01-13T18:09:00.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:09:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:09:00] "GET /metrics HTTP/1.1" 200 36193 "" "Prometheus/2.43.0" 2024-01-13T18:09:00.696 INFO:tasks.rados.rados.0.smithi084.stdout:2484: done (2 left) 2024-01-13T18:09:00.696 INFO:tasks.rados.rados.0.smithi084.stdout:2485: done (1 left) 2024-01-13T18:09:00.696 INFO:tasks.rados.rados.0.smithi084.stdout:2486: done (0 left) 2024-01-13T18:09:00.696 INFO:tasks.rados.rados.0.smithi084.stdout:2487: read oid 43 snap 242 2024-01-13T18:09:00.696 INFO:tasks.rados.rados.0.smithi084.stdout:2487: expect deleted 2024-01-13T18:09:00.696 INFO:tasks.rados.rados.0.smithi084.stdout:2488: delete oid 40 current snap is 247 2024-01-13T18:09:00.702 INFO:tasks.rados.rados.0.smithi084.stdout:2487: done (1 left) 2024-01-13T18:09:00.702 INFO:tasks.rados.rados.0.smithi084.stdout:2488: done (0 left) 2024-01-13T18:09:00.702 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 247 2024-01-13T18:09:00.702 INFO:tasks.rados.rados.0.smithi084.stdout:2489: seq_num 773 ranges {0=548864,548864=401408} 2024-01-13T18:09:00.705 INFO:tasks.rados.rados.0.smithi084.stdout:2489: writing smithi084102331-24 from 0 to 548864 tid 1 2024-01-13T18:09:00.707 INFO:tasks.rados.rados.0.smithi084.stdout:2489: writing smithi084102331-24 from 548864 to 950272 tid 2 2024-01-13T18:09:00.707 INFO:tasks.rados.rados.0.smithi084.stdout:2490: delete oid 29 current snap is 247 2024-01-13T18:09:00.710 INFO:tasks.rados.rados.0.smithi084.stdout:2490: done (1 left) 2024-01-13T18:09:00.710 INFO:tasks.rados.rados.0.smithi084.stdout:2491: snap_create 2024-01-13T18:09:00.710 INFO:tasks.rados.rados.0.smithi084.stdout:2489: finishing write tid 1 to smithi084102331-24 2024-01-13T18:09:00.710 INFO:tasks.rados.rados.0.smithi084.stdout:2489: finishing write tid 2 to smithi084102331-24 2024-01-13T18:09:00.711 INFO:tasks.rados.rados.0.smithi084.stdout:2489: finishing write tid 3 to smithi084102331-24 2024-01-13T18:09:00.712 INFO:tasks.rados.rados.0.smithi084.stdout:2489: finishing write tid 4 to smithi084102331-24 2024-01-13T18:09:00.712 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1108 (ObjNum 773 snap 247 seq_num 773) dirty exists 2024-01-13T18:09:00.712 INFO:tasks.rados.rados.0.smithi084.stdout:2489: left oid 24 (ObjNum 773 snap 247 seq_num 773) 2024-01-13T18:09:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:00 smithi099 ceph-mon[138788]: osdmap e558: 8 total, 8 up, 8 in 2024-01-13T18:09:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:00 smithi099 ceph-mon[138788]: pgmap v549: 121 pgs: 121 active+clean; 246 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.3 MiB/s rd, 948 KiB/s wr, 19 op/s 2024-01-13T18:09:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:00 smithi084 ceph-mon[116404]: osdmap e558: 8 total, 8 up, 8 in 2024-01-13T18:09:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:00 smithi084 ceph-mon[116404]: pgmap v549: 121 pgs: 121 active+clean; 246 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.3 MiB/s rd, 948 KiB/s wr, 19 op/s 2024-01-13T18:09:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:00 smithi084 ceph-mon[119097]: osdmap e558: 8 total, 8 up, 8 in 2024-01-13T18:09:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:00 smithi084 ceph-mon[119097]: pgmap v549: 121 pgs: 121 active+clean; 246 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.3 MiB/s rd, 948 KiB/s wr, 19 op/s 2024-01-13T18:09:01.703 INFO:tasks.rados.rados.0.smithi084.stdout:2489: done (1 left) 2024-01-13T18:09:01.703 INFO:tasks.rados.rados.0.smithi084.stdout:2491: done (0 left) 2024-01-13T18:09:01.704 INFO:tasks.rados.rados.0.smithi084.stdout:2492: snap_remove snap 241 2024-01-13T18:09:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:01 smithi099 ceph-mon[138788]: osdmap e559: 8 total, 8 up, 8 in 2024-01-13T18:09:02.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:01 smithi084 ceph-mon[116404]: osdmap e559: 8 total, 8 up, 8 in 2024-01-13T18:09:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:01 smithi084 ceph-mon[119097]: osdmap e559: 8 total, 8 up, 8 in 2024-01-13T18:09:02.666 INFO:tasks.rados.rados.0.smithi084.stdout:2492: done (0 left) 2024-01-13T18:09:02.666 INFO:tasks.rados.rados.0.smithi084.stdout:2493: copy_from oid 33 from oid 14 current snap is 248 2024-01-13T18:09:02.666 INFO:tasks.rados.rados.0.smithi084.stdout:2494: rmattr oid 20 current snap is 248 2024-01-13T18:09:02.666 INFO:tasks.rados.rados.0.smithi084.stdout:2494: done (1 left) 2024-01-13T18:09:02.666 INFO:tasks.rados.rados.0.smithi084.stdout:2495: snap_remove snap 240 2024-01-13T18:09:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:02 smithi099 ceph-mon[138788]: osdmap e560: 8 total, 8 up, 8 in 2024-01-13T18:09:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:02 smithi099 ceph-mon[138788]: pgmap v552: 121 pgs: 121 active+clean; 254 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.7 MiB/s rd, 984 KiB/s wr, 15 op/s 2024-01-13T18:09:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:02 smithi099 ceph-mon[138788]: osdmap e561: 8 total, 8 up, 8 in 2024-01-13T18:09:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:02 smithi084 ceph-mon[116404]: osdmap e560: 8 total, 8 up, 8 in 2024-01-13T18:09:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:02 smithi084 ceph-mon[116404]: pgmap v552: 121 pgs: 121 active+clean; 254 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.7 MiB/s rd, 984 KiB/s wr, 15 op/s 2024-01-13T18:09:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:02 smithi084 ceph-mon[116404]: osdmap e561: 8 total, 8 up, 8 in 2024-01-13T18:09:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:02 smithi084 ceph-mon[119097]: osdmap e560: 8 total, 8 up, 8 in 2024-01-13T18:09:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:02 smithi084 ceph-mon[119097]: pgmap v552: 121 pgs: 121 active+clean; 254 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.7 MiB/s rd, 984 KiB/s wr, 15 op/s 2024-01-13T18:09:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:02 smithi084 ceph-mon[119097]: osdmap e561: 8 total, 8 up, 8 in 2024-01-13T18:09:03.669 INFO:tasks.rados.rados.0.smithi084.stdout:2495: done (1 left) 2024-01-13T18:09:03.669 INFO:tasks.rados.rados.0.smithi084.stdout:2496: snap_create 2024-01-13T18:09:03.669 INFO:tasks.rados.rados.0.smithi084.stdout:2493: finishing copy_from to smithi084102331-33 2024-01-13T18:09:03.669 INFO:tasks.rados.rados.0.smithi084.stdout:2493: got expected ENOENT (src dne) 2024-01-13T18:09:03.670 INFO:tasks.rados.rados.0.smithi084.stdout:2493: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:09:04.674 INFO:tasks.rados.rados.0.smithi084.stdout:2493: done (1 left) 2024-01-13T18:09:04.674 INFO:tasks.rados.rados.0.smithi084.stdout:2496: done (0 left) 2024-01-13T18:09:04.674 INFO:tasks.rados.rados.0.smithi084.stdout:2497: read oid 47 snap -1 2024-01-13T18:09:04.674 INFO:tasks.rados.rados.0.smithi084.stdout:2497: expect deleted 2024-01-13T18:09:04.674 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 249 2024-01-13T18:09:04.674 INFO:tasks.rados.rados.0.smithi084.stdout:2498: seq_num 775 ranges {352256=589824,942080=401408} 2024-01-13T18:09:04.679 INFO:tasks.rados.rados.0.smithi084.stdout:2498: writing smithi084102331-12 from 352256 to 942080 tid 1 2024-01-13T18:09:04.681 INFO:tasks.rados.rados.0.smithi084.stdout:2498: writing smithi084102331-12 from 942080 to 1343488 tid 2 2024-01-13T18:09:04.681 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 249 2024-01-13T18:09:04.682 INFO:tasks.rados.rados.0.smithi084.stdout:2499: seq_num 776 ranges {0=606208,606208=401408} 2024-01-13T18:09:04.685 INFO:tasks.rados.rados.0.smithi084.stdout:2499: writing smithi084102331-8 from 0 to 606208 tid 1 2024-01-13T18:09:04.687 INFO:tasks.rados.rados.0.smithi084.stdout:2499: writing smithi084102331-8 from 606208 to 1007616 tid 2 2024-01-13T18:09:04.687 INFO:tasks.rados.rados.0.smithi084.stdout:2500: delete oid 31 current snap is 249 2024-01-13T18:09:04.689 INFO:tasks.rados.rados.0.smithi084.stdout:2498: finishing write tid 1 to smithi084102331-12 2024-01-13T18:09:04.689 INFO:tasks.rados.rados.0.smithi084.stdout:2498: finishing write tid 2 to smithi084102331-12 2024-01-13T18:09:04.693 INFO:tasks.rados.rados.0.smithi084.stdout:2497: done (3 left) 2024-01-13T18:09:04.693 INFO:tasks.rados.rados.0.smithi084.stdout:2500: done (2 left) 2024-01-13T18:09:04.693 INFO:tasks.rados.rados.0.smithi084.stdout:2501: delete oid 10 current snap is 249 2024-01-13T18:09:04.693 INFO:tasks.rados.rados.0.smithi084.stdout:2498: finishing write tid 3 to smithi084102331-12 2024-01-13T18:09:04.695 INFO:tasks.rados.rados.0.smithi084.stdout:2499: finishing write tid 1 to smithi084102331-8 2024-01-13T18:09:04.697 INFO:tasks.rados.rados.0.smithi084.stdout:2499: finishing write tid 2 to smithi084102331-8 2024-01-13T18:09:04.697 INFO:tasks.rados.rados.0.smithi084.stdout:2501: done (2 left) 2024-01-13T18:09:04.697 INFO:tasks.rados.rados.0.smithi084.stdout:2502: read oid 16 snap -1 2024-01-13T18:09:04.697 INFO:tasks.rados.rados.0.smithi084.stdout:2502: expect deleted 2024-01-13T18:09:04.697 INFO:tasks.rados.rados.0.smithi084.stdout:2498: finishing write tid 4 to smithi084102331-12 2024-01-13T18:09:04.698 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1278 (ObjNum 775 snap 249 seq_num 775) dirty exists 2024-01-13T18:09:04.698 INFO:tasks.rados.rados.0.smithi084.stdout:2498: left oid 12 (ObjNum 775 snap 249 seq_num 775) 2024-01-13T18:09:04.698 INFO:tasks.rados.rados.0.smithi084.stdout:2503: read oid 11 snap -1 2024-01-13T18:09:04.698 INFO:tasks.rados.rados.0.smithi084.stdout:2503: expect (ObjNum 702 snap 220 seq_num 702) 2024-01-13T18:09:04.698 INFO:tasks.rados.rados.0.smithi084.stdout:2498: done (3 left) 2024-01-13T18:09:04.698 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 249 2024-01-13T18:09:04.698 INFO:tasks.rados.rados.0.smithi084.stdout:2499: finishing write tid 3 to smithi084102331-8 2024-01-13T18:09:04.699 INFO:tasks.rados.rados.0.smithi084.stdout:2504: seq_num 779 ranges {1253376=655360,1908736=401408} 2024-01-13T18:09:04.708 INFO:tasks.rados.rados.0.smithi084.stdout:2504: writing smithi084102331-41 from 1253376 to 1908736 tid 1 2024-01-13T18:09:04.710 INFO:tasks.rados.rados.0.smithi084.stdout:2504: writing smithi084102331-41 from 1908736 to 2310144 tid 2 2024-01-13T18:09:04.710 INFO:tasks.rados.rados.0.smithi084.stdout:2505: snap_create 2024-01-13T18:09:04.710 INFO:tasks.rados.rados.0.smithi084.stdout:2499: finishing write tid 4 to smithi084102331-8 2024-01-13T18:09:04.711 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1215 (ObjNum 776 snap 249 seq_num 776) dirty exists 2024-01-13T18:09:04.711 INFO:tasks.rados.rados.0.smithi084.stdout:2499: left oid 8 (ObjNum 776 snap 249 seq_num 776) 2024-01-13T18:09:04.724 INFO:tasks.rados.rados.0.smithi084.stdout:2503: expect (ObjNum 702 snap 220 seq_num 702) 2024-01-13T18:09:04.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:04 smithi084 ceph-mon[116404]: osdmap e562: 8 total, 8 up, 8 in 2024-01-13T18:09:04.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:04 smithi084 ceph-mon[116404]: pgmap v555: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 255 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.7 MiB/s rd, 452 KiB/s wr, 16 op/s 2024-01-13T18:09:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:04 smithi084 ceph-mon[119097]: osdmap e562: 8 total, 8 up, 8 in 2024-01-13T18:09:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:04 smithi084 ceph-mon[119097]: pgmap v555: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 255 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.7 MiB/s rd, 452 KiB/s wr, 16 op/s 2024-01-13T18:09:05.065 INFO:tasks.rados.rados.0.smithi084.stdout:2504: finishing write tid 1 to smithi084102331-41 2024-01-13T18:09:05.065 INFO:tasks.rados.rados.0.smithi084.stdout:2504: finishing write tid 2 to smithi084102331-41 2024-01-13T18:09:05.065 INFO:tasks.rados.rados.0.smithi084.stdout:2504: finishing write tid 3 to smithi084102331-41 2024-01-13T18:09:05.065 INFO:tasks.rados.rados.0.smithi084.stdout:2504: finishing write tid 4 to smithi084102331-41 2024-01-13T18:09:05.065 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1236 (ObjNum 779 snap 249 seq_num 779) dirty exists 2024-01-13T18:09:05.065 INFO:tasks.rados.rados.0.smithi084.stdout:2504: left oid 41 (ObjNum 779 snap 249 seq_num 779) 2024-01-13T18:09:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:04 smithi099 ceph-mon[138788]: osdmap e562: 8 total, 8 up, 8 in 2024-01-13T18:09:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:04 smithi099 ceph-mon[138788]: pgmap v555: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 255 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.7 MiB/s rd, 452 KiB/s wr, 16 op/s 2024-01-13T18:09:05.678 INFO:tasks.rados.rados.0.smithi084.stdout:2499: done (4 left) 2024-01-13T18:09:05.678 INFO:tasks.rados.rados.0.smithi084.stdout:2502: done (3 left) 2024-01-13T18:09:05.678 INFO:tasks.rados.rados.0.smithi084.stdout:2503: done (2 left) 2024-01-13T18:09:05.678 INFO:tasks.rados.rados.0.smithi084.stdout:2504: done (1 left) 2024-01-13T18:09:05.678 INFO:tasks.rados.rados.0.smithi084.stdout:2505: done (0 left) 2024-01-13T18:09:05.679 INFO:tasks.rados.rados.0.smithi084.stdout:2506: delete oid 46 current snap is 250 2024-01-13T18:09:05.682 INFO:tasks.rados.rados.0.smithi084.stdout:2506: done (0 left) 2024-01-13T18:09:05.682 INFO:tasks.rados.rados.0.smithi084.stdout:2507: delete oid 40 current snap is 250 2024-01-13T18:09:05.684 INFO:tasks.rados.rados.0.smithi084.stdout:2507: done (0 left) 2024-01-13T18:09:05.684 INFO:tasks.rados.rados.0.smithi084.stdout:2508: snap_create 2024-01-13T18:09:05.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:05 smithi084 ceph-mon[119097]: osdmap e563: 8 total, 8 up, 8 in 2024-01-13T18:09:05.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:05 smithi084 ceph-mon[116404]: osdmap e563: 8 total, 8 up, 8 in 2024-01-13T18:09:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:05 smithi099 ceph-mon[138788]: osdmap e563: 8 total, 8 up, 8 in 2024-01-13T18:09:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:06.684 INFO:tasks.rados.rados.0.smithi084.stdout:2508: done (0 left) 2024-01-13T18:09:06.684 INFO:tasks.rados.rados.0.smithi084.stdout:2509: read oid 50 snap -1 2024-01-13T18:09:06.684 INFO:tasks.rados.rados.0.smithi084.stdout:2509: expect deleted 2024-01-13T18:09:06.684 INFO:tasks.rados.rados.0.smithi084.stdout:2510: read oid 18 snap -1 2024-01-13T18:09:06.684 INFO:tasks.rados.rados.0.smithi084.stdout:2510: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:09:06.685 INFO:tasks.rados.rados.0.smithi084.stdout:2511: setattr oid 7 current snap is 251 2024-01-13T18:09:06.686 INFO:tasks.rados.rados.0.smithi084.stdout:2512: snap_create 2024-01-13T18:09:06.692 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1109 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-01-13T18:09:06.706 INFO:tasks.rados.rados.0.smithi084.stdout:2510: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:09:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:06 smithi099 ceph-mon[138788]: osdmap e564: 8 total, 8 up, 8 in 2024-01-13T18:09:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:06 smithi099 ceph-mon[138788]: pgmap v558: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 255 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 19 KiB/s rd, 220 KiB/s wr, 2 op/s 2024-01-13T18:09:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:06 smithi084 ceph-mon[116404]: osdmap e564: 8 total, 8 up, 8 in 2024-01-13T18:09:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:06 smithi084 ceph-mon[116404]: pgmap v558: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 255 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 19 KiB/s rd, 220 KiB/s wr, 2 op/s 2024-01-13T18:09:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:06 smithi084 ceph-mon[119097]: osdmap e564: 8 total, 8 up, 8 in 2024-01-13T18:09:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:06 smithi084 ceph-mon[119097]: pgmap v558: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 255 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 19 KiB/s rd, 220 KiB/s wr, 2 op/s 2024-01-13T18:09:07.668 INFO:tasks.rados.rados.0.smithi084.stdout:2509: done (3 left) 2024-01-13T18:09:07.668 INFO:tasks.rados.rados.0.smithi084.stdout:2510: done (2 left) 2024-01-13T18:09:07.668 INFO:tasks.rados.rados.0.smithi084.stdout:2511: done (1 left) 2024-01-13T18:09:07.668 INFO:tasks.rados.rados.0.smithi084.stdout:2512: done (0 left) 2024-01-13T18:09:07.668 INFO:tasks.rados.rados.0.smithi084.stdout:2513: read oid 21 snap -1 2024-01-13T18:09:07.668 INFO:tasks.rados.rados.0.smithi084.stdout:2513: expect deleted 2024-01-13T18:09:07.668 INFO:tasks.rados.rados.0.smithi084.stdout:2514: read oid 16 snap -1 2024-01-13T18:09:07.668 INFO:tasks.rados.rados.0.smithi084.stdout:2514: expect deleted 2024-01-13T18:09:07.668 INFO:tasks.rados.rados.0.smithi084.stdout:2515: read oid 33 snap -1 2024-01-13T18:09:07.669 INFO:tasks.rados.rados.0.smithi084.stdout:2515: expect deleted 2024-01-13T18:09:07.669 INFO:tasks.rados.rados.0.smithi084.stdout:2516: snap_create 2024-01-13T18:09:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:07 smithi099 ceph-mon[138788]: osdmap e565: 8 total, 8 up, 8 in 2024-01-13T18:09:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:07 smithi099 ceph-mon[138788]: osdmap e566: 8 total, 8 up, 8 in 2024-01-13T18:09:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:07 smithi084 ceph-mon[116404]: osdmap e565: 8 total, 8 up, 8 in 2024-01-13T18:09:08.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:07 smithi084 ceph-mon[116404]: osdmap e566: 8 total, 8 up, 8 in 2024-01-13T18:09:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:07 smithi084 ceph-mon[119097]: osdmap e565: 8 total, 8 up, 8 in 2024-01-13T18:09:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:07 smithi084 ceph-mon[119097]: osdmap e566: 8 total, 8 up, 8 in 2024-01-13T18:09:08.670 INFO:tasks.rados.rados.0.smithi084.stdout:2513: done (3 left) 2024-01-13T18:09:08.670 INFO:tasks.rados.rados.0.smithi084.stdout:2514: done (2 left) 2024-01-13T18:09:08.670 INFO:tasks.rados.rados.0.smithi084.stdout:2515: done (1 left) 2024-01-13T18:09:08.670 INFO:tasks.rados.rados.0.smithi084.stdout:2516: done (0 left) 2024-01-13T18:09:08.670 INFO:tasks.rados.rados.0.smithi084.stdout:2517: copy_from oid 22 from oid 19 current snap is 253 2024-01-13T18:09:08.670 INFO:tasks.rados.rados.0.smithi084.stdout:2518: read oid 11 snap -1 2024-01-13T18:09:08.670 INFO:tasks.rados.rados.0.smithi084.stdout:2518: expect (ObjNum 702 snap 220 seq_num 702) 2024-01-13T18:09:08.670 INFO:tasks.rados.rados.0.smithi084.stdout:2519: snap_create 2024-01-13T18:09:08.675 INFO:tasks.rados.rados.0.smithi084.stdout:2517: finishing copy_from to smithi084102331-22 2024-01-13T18:09:08.675 INFO:tasks.rados.rados.0.smithi084.stdout:2517: got expected ENOENT (src dne) 2024-01-13T18:09:08.675 INFO:tasks.rados.rados.0.smithi084.stdout:2517: finishing copy_from racing read to smithi084102331-22 2024-01-13T18:09:08.697 INFO:tasks.rados.rados.0.smithi084.stdout:2518: expect (ObjNum 702 snap 220 seq_num 702) 2024-01-13T18:09:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:08 smithi099 ceph-mon[138788]: pgmap v561: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 258 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 746 KiB/s wr, 9 op/s 2024-01-13T18:09:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:08 smithi099 ceph-mon[138788]: osdmap e567: 8 total, 8 up, 8 in 2024-01-13T18:09:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:08 smithi084 ceph-mon[116404]: pgmap v561: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 258 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 746 KiB/s wr, 9 op/s 2024-01-13T18:09:09.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:08 smithi084 ceph-mon[116404]: osdmap e567: 8 total, 8 up, 8 in 2024-01-13T18:09:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:08 smithi084 ceph-mon[119097]: pgmap v561: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 258 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 746 KiB/s wr, 9 op/s 2024-01-13T18:09:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:08 smithi084 ceph-mon[119097]: osdmap e567: 8 total, 8 up, 8 in 2024-01-13T18:09:09.671 INFO:tasks.rados.rados.0.smithi084.stdout:2517: done (2 left) 2024-01-13T18:09:09.672 INFO:tasks.rados.rados.0.smithi084.stdout:2518: done (1 left) 2024-01-13T18:09:09.672 INFO:tasks.rados.rados.0.smithi084.stdout:2519: done (0 left) 2024-01-13T18:09:09.672 INFO:tasks.rados.rados.0.smithi084.stdout:2520: rmattr oid 33 current snap is 254 2024-01-13T18:09:09.672 INFO:tasks.rados.rados.0.smithi084.stdout:2520: done (0 left) 2024-01-13T18:09:09.672 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 254 2024-01-13T18:09:09.672 INFO:tasks.rados.rados.0.smithi084.stdout:2521: seq_num 782 ranges {1171456=704512,1875968=401408} 2024-01-13T18:09:09.681 INFO:tasks.rados.rados.0.smithi084.stdout:2521: writing smithi084102331-4 from 1171456 to 1875968 tid 1 2024-01-13T18:09:09.684 INFO:tasks.rados.rados.0.smithi084.stdout:2521: writing smithi084102331-4 from 1875968 to 2277376 tid 2 2024-01-13T18:09:09.684 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 254 2024-01-13T18:09:09.684 INFO:tasks.rados.rados.0.smithi084.stdout:2522: seq_num 783 ranges {0=720896,720896=401408} 2024-01-13T18:09:09.688 INFO:tasks.rados.rados.0.smithi084.stdout:2522: writing smithi084102331-40 from 0 to 720896 tid 1 2024-01-13T18:09:09.691 INFO:tasks.rados.rados.0.smithi084.stdout:2522: writing smithi084102331-40 from 720896 to 1122304 tid 2 2024-01-13T18:09:09.691 INFO:tasks.rados.rados.0.smithi084.stdout:2523: copy_from oid 23 from oid 2 current snap is 254 2024-01-13T18:09:09.691 INFO:tasks.rados.rados.0.smithi084.stdout:2521: finishing write tid 1 to smithi084102331-4 2024-01-13T18:09:09.691 INFO:tasks.rados.rados.0.smithi084.stdout:2521: finishing write tid 2 to smithi084102331-4 2024-01-13T18:09:09.691 INFO:tasks.rados.rados.0.smithi084.stdout:2521: finishing write tid 3 to smithi084102331-4 2024-01-13T18:09:09.691 INFO:tasks.rados.rados.0.smithi084.stdout:2521: finishing write tid 4 to smithi084102331-4 2024-01-13T18:09:09.691 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 889 (ObjNum 782 snap 254 seq_num 782) dirty exists 2024-01-13T18:09:09.691 INFO:tasks.rados.rados.0.smithi084.stdout:2521: left oid 4 (ObjNum 782 snap 254 seq_num 782) 2024-01-13T18:09:09.691 INFO:tasks.rados.rados.0.smithi084.stdout:2521: done (2 left) 2024-01-13T18:09:09.691 INFO:tasks.rados.rados.0.smithi084.stdout:2524: rmattr oid 10 current snap is 254 2024-01-13T18:09:09.692 INFO:tasks.rados.rados.0.smithi084.stdout:2524: done (2 left) 2024-01-13T18:09:09.692 INFO:tasks.rados.rados.0.smithi084.stdout:2525: rollback oid 14 current snap is 254 2024-01-13T18:09:09.692 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 224 2024-01-13T18:09:09.692 INFO:tasks.rados.rados.0.smithi084.stdout:2526: setattr oid 21 current snap is 254 2024-01-13T18:09:09.692 INFO:tasks.rados.rados.0.smithi084.stdout:2525: finishing rollback tid 1 to smithi084102331-14 2024-01-13T18:09:09.692 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 0 (ObjNum 177 snap 0 seq_num 4037553024) dirty dne 2024-01-13T18:09:09.692 INFO:tasks.rados.rados.0.smithi084.stdout:2525: done (3 left) 2024-01-13T18:09:09.693 INFO:tasks.rados.rados.0.smithi084.stdout:2527: copy_from oid 14 from oid 18 current snap is 254 2024-01-13T18:09:09.693 INFO:tasks.rados.rados.0.smithi084.stdout:2528: rmattr oid 9 current snap is 254 2024-01-13T18:09:09.693 INFO:tasks.rados.rados.0.smithi084.stdout:2529: copy_from oid 5 from oid 8 current snap is 254 2024-01-13T18:09:09.693 INFO:tasks.rados.rados.0.smithi084.stdout:2530: read oid 3 snap -1 2024-01-13T18:09:09.693 INFO:tasks.rados.rados.0.smithi084.stdout:2530: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:09:09.693 INFO:tasks.rados.rados.0.smithi084.stdout:2531: rmattr oid 42 current snap is 254 2024-01-13T18:09:09.693 INFO:tasks.rados.rados.0.smithi084.stdout:2532: delete oid 31 current snap is 254 2024-01-13T18:09:09.699 INFO:tasks.rados.rados.0.smithi084.stdout:2530: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:09:09.703 INFO:tasks.rados.rados.0.smithi084.stdout:2522: finishing write tid 1 to smithi084102331-40 2024-01-13T18:09:09.703 INFO:tasks.rados.rados.0.smithi084.stdout:2522: finishing write tid 2 to smithi084102331-40 2024-01-13T18:09:09.703 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1101 (ObjNum 579 snap 185 seq_num 579) dirty exists 2024-01-13T18:09:09.703 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1091 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:09:09.703 INFO:tasks.rados.rados.0.smithi084.stdout:2522: finishing write tid 3 to smithi084102331-40 2024-01-13T18:09:09.703 INFO:tasks.rados.rados.0.smithi084.stdout:2522: finishing write tid 4 to smithi084102331-40 2024-01-13T18:09:09.704 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 913 (ObjNum 783 snap 254 seq_num 783) dirty exists 2024-01-13T18:09:09.704 INFO:tasks.rados.rados.0.smithi084.stdout:2522: left oid 40 (ObjNum 783 snap 254 seq_num 783) 2024-01-13T18:09:09.704 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 914 (ObjNum 129 snap 0 seq_num 4037443112) dirty exists 2024-01-13T18:09:09.704 INFO:tasks.rados.rados.0.smithi084.stdout:2522: done (8 left) 2024-01-13T18:09:09.704 INFO:tasks.rados.rados.0.smithi084.stdout:2526: done (7 left) 2024-01-13T18:09:09.704 INFO:tasks.rados.rados.0.smithi084.stdout:2528: done (6 left) 2024-01-13T18:09:09.704 INFO:tasks.rados.rados.0.smithi084.stdout:2530: done (5 left) 2024-01-13T18:09:09.704 INFO:tasks.rados.rados.0.smithi084.stdout:2531: done (4 left) 2024-01-13T18:09:09.704 INFO:tasks.rados.rados.0.smithi084.stdout:2532: done (3 left) 2024-01-13T18:09:09.704 INFO:tasks.rados.rados.0.smithi084.stdout:2533: snap_remove snap 251 2024-01-13T18:09:10.674 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:09:10] "GET /metrics HTTP/1.1" 200 36194 "" "Prometheus/2.43.0" 2024-01-13T18:09:10.680 INFO:tasks.rados.rados.0.smithi084.stdout:2533: done (3 left) 2024-01-13T18:09:10.680 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 254 2024-01-13T18:09:10.680 INFO:tasks.rados.rados.0.smithi084.stdout:2523: finishing copy_from to smithi084102331-23 2024-01-13T18:09:10.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1236 (ObjNum 756 snap 237 seq_num 756) dirty exists 2024-01-13T18:09:10.680 INFO:tasks.rados.rados.0.smithi084.stdout:2534: seq_num 785 ranges {6144000=753664,6897664=401408} 2024-01-13T18:09:10.717 INFO:tasks.rados.rados.0.smithi084.stdout:2534: writing smithi084102331-15 from 6144000 to 6897664 tid 1 2024-01-13T18:09:10.720 INFO:tasks.rados.rados.0.smithi084.stdout:2534: writing smithi084102331-15 from 6897664 to 7299072 tid 2 2024-01-13T18:09:10.720 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 254 2024-01-13T18:09:10.720 INFO:tasks.rados.rados.0.smithi084.stdout:2523: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:09:10.720 INFO:tasks.rados.rados.0.smithi084.stdout:2529: finishing copy_from to smithi084102331-5 2024-01-13T18:09:10.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 1215 (ObjNum 776 snap 249 seq_num 776) dirty exists 2024-01-13T18:09:10.720 INFO:tasks.rados.rados.0.smithi084.stdout:2529: finishing copy_from racing read to smithi084102331-5 2024-01-13T18:09:10.720 INFO:tasks.rados.rados.0.smithi084.stdout:2527: finishing copy_from to smithi084102331-14 2024-01-13T18:09:10.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1103 (ObjNum 639 snap 199 seq_num 639) dirty exists 2024-01-13T18:09:10.721 INFO:tasks.rados.rados.0.smithi084.stdout:2527: finishing copy_from racing read to smithi084102331-14 2024-01-13T18:09:10.721 INFO:tasks.rados.rados.0.smithi084.stdout:2535: seq_num 786 ranges {2400256=770048,3170304=401408} 2024-01-13T18:09:10.736 INFO:tasks.rados.rados.0.smithi084.stdout:2535: writing smithi084102331-48 from 2400256 to 3170304 tid 1 2024-01-13T18:09:10.739 INFO:tasks.rados.rados.0.smithi084.stdout:2535: writing smithi084102331-48 from 3170304 to 3571712 tid 2 2024-01-13T18:09:10.739 INFO:tasks.rados.rados.0.smithi084.stdout:2523: done (4 left) 2024-01-13T18:09:10.739 INFO:tasks.rados.rados.0.smithi084.stdout:2527: done (3 left) 2024-01-13T18:09:10.739 INFO:tasks.rados.rados.0.smithi084.stdout:2529: done (2 left) 2024-01-13T18:09:10.739 INFO:tasks.rados.rados.0.smithi084.stdout:2536: snap_remove snap 224 2024-01-13T18:09:10.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[116404]: osdmap e568: 8 total, 8 up, 8 in 2024-01-13T18:09:10.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[116404]: pgmap v564: 121 pgs: 121 active+clean; 258 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 746 KiB/s wr, 10 op/s 2024-01-13T18:09:10.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:09:10.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:09:10.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:09:10.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:09:10.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[119097]: osdmap e568: 8 total, 8 up, 8 in 2024-01-13T18:09:10.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[119097]: pgmap v564: 121 pgs: 121 active+clean; 258 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 746 KiB/s wr, 10 op/s 2024-01-13T18:09:10.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:09:10.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:09:10.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:09:10.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:10 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:09:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:10 smithi099 ceph-mon[138788]: osdmap e568: 8 total, 8 up, 8 in 2024-01-13T18:09:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:10 smithi099 ceph-mon[138788]: pgmap v564: 121 pgs: 121 active+clean; 258 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 746 KiB/s wr, 10 op/s 2024-01-13T18:09:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:09:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:09:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:09:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:10 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:09:11.682 INFO:tasks.rados.rados.0.smithi084.stdout:2536: done (2 left) 2024-01-13T18:09:11.682 INFO:tasks.rados.rados.0.smithi084.stdout:2537: setattr oid 10 current snap is 254 2024-01-13T18:09:11.682 INFO:tasks.rados.rados.0.smithi084.stdout:2534: finishing write tid 1 to smithi084102331-15 2024-01-13T18:09:11.682 INFO:tasks.rados.rados.0.smithi084.stdout:2534: finishing write tid 2 to smithi084102331-15 2024-01-13T18:09:11.682 INFO:tasks.rados.rados.0.smithi084.stdout:2534: finishing write tid 3 to smithi084102331-15 2024-01-13T18:09:11.682 INFO:tasks.rados.rados.0.smithi084.stdout:2534: finishing write tid 4 to smithi084102331-15 2024-01-13T18:09:11.683 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1219 (ObjNum 785 snap 254 seq_num 785) dirty exists 2024-01-13T18:09:11.683 INFO:tasks.rados.rados.0.smithi084.stdout:2534: left oid 15 (ObjNum 785 snap 254 seq_num 785) 2024-01-13T18:09:11.683 INFO:tasks.rados.rados.0.smithi084.stdout:2535: finishing write tid 1 to smithi084102331-48 2024-01-13T18:09:11.683 INFO:tasks.rados.rados.0.smithi084.stdout:2535: finishing write tid 2 to smithi084102331-48 2024-01-13T18:09:11.683 INFO:tasks.rados.rados.0.smithi084.stdout:2535: finishing write tid 3 to smithi084102331-48 2024-01-13T18:09:11.683 INFO:tasks.rados.rados.0.smithi084.stdout:2535: finishing write tid 4 to smithi084102331-48 2024-01-13T18:09:11.683 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1284 (ObjNum 786 snap 254 seq_num 786) dirty exists 2024-01-13T18:09:11.683 INFO:tasks.rados.rados.0.smithi084.stdout:2535: left oid 48 (ObjNum 786 snap 254 seq_num 786) 2024-01-13T18:09:11.684 INFO:tasks.rados.rados.0.smithi084.stdout:2534: done (2 left) 2024-01-13T18:09:11.685 INFO:tasks.rados.rados.0.smithi084.stdout:2535: done (1 left) 2024-01-13T18:09:11.685 INFO:tasks.rados.rados.0.smithi084.stdout:2538: rmattr oid 39 current snap is 254 2024-01-13T18:09:11.685 INFO:tasks.rados.rados.0.smithi084.stdout:2539: rollback oid 7 current snap is 254 2024-01-13T18:09:11.685 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 7 to 236 2024-01-13T18:09:11.685 INFO:tasks.rados.rados.0.smithi084.stdout:2540: snap_remove snap 231 2024-01-13T18:09:11.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:11 smithi084 ceph-mon[116404]: osdmap e569: 8 total, 8 up, 8 in 2024-01-13T18:09:11.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:11 smithi084 ceph-mon[119097]: osdmap e569: 8 total, 8 up, 8 in 2024-01-13T18:09:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:11 smithi099 ceph-mon[138788]: osdmap e569: 8 total, 8 up, 8 in 2024-01-13T18:09:12.672 INFO:tasks.rados.rados.0.smithi084.stdout:2540: done (3 left) 2024-01-13T18:09:12.673 INFO:tasks.rados.rados.0.smithi084.stdout:2541: delete oid 43 current snap is 254 2024-01-13T18:09:12.673 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1104 (ObjNum 129 snap 0 seq_num 2508360352) dirty exists 2024-01-13T18:09:12.673 INFO:tasks.rados.rados.0.smithi084.stdout:2539: finishing rollback tid 0 to smithi084102331-7 2024-01-13T18:09:12.673 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1238 (ObjNum 763 snap 242 seq_num 763) dirty exists 2024-01-13T18:09:12.673 INFO:tasks.rados.rados.0.smithi084.stdout:2539: finishing rollback tid 1 to smithi084102331-7 2024-01-13T18:09:12.673 INFO:tasks.rados.rados.0.smithi084.stdout:2539: finishing rollback tid 2 to smithi084102331-7 2024-01-13T18:09:12.673 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1112 (ObjNum 579 snap 185 seq_num 579) dirty exists 2024-01-13T18:09:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:2537: done (3 left) 2024-01-13T18:09:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:2538: done (2 left) 2024-01-13T18:09:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:2539: done (1 left) 2024-01-13T18:09:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:2541: done (0 left) 2024-01-13T18:09:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:2542: read oid 50 snap -1 2024-01-13T18:09:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:2542: expect deleted 2024-01-13T18:09:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:2543: rollback oid 21 current snap is 254 2024-01-13T18:09:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 252 2024-01-13T18:09:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:2544: delete oid 35 current snap is 254 2024-01-13T18:09:12.694 INFO:tasks.rados.rados.0.smithi084.stdout:2543: finishing rollback tid 0 to smithi084102331-21 2024-01-13T18:09:12.696 INFO:tasks.rados.rados.0.smithi084.stdout:2543: finishing rollback tid 1 to smithi084102331-21 2024-01-13T18:09:12.697 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 928 (ObjNum 129 snap 0 seq_num 4037443112) dirty dne 2024-01-13T18:09:12.697 INFO:tasks.rados.rados.0.smithi084.stdout:2542: done (2 left) 2024-01-13T18:09:12.697 INFO:tasks.rados.rados.0.smithi084.stdout:2543: done (1 left) 2024-01-13T18:09:12.697 INFO:tasks.rados.rados.0.smithi084.stdout:2544: done (0 left) 2024-01-13T18:09:12.697 INFO:tasks.rados.rados.0.smithi084.stdout:2545: delete oid 50 current snap is 254 2024-01-13T18:09:12.701 INFO:tasks.rados.rados.0.smithi084.stdout:2545: done (0 left) 2024-01-13T18:09:12.701 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 254 2024-01-13T18:09:12.701 INFO:tasks.rados.rados.0.smithi084.stdout:2546: seq_num 790 ranges {0=434176,434176=548864,983040=253952} 2024-01-13T18:09:12.703 INFO:tasks.rados.rados.0.smithi084.stdout:2546: writing smithi084102331-35 from 0 to 434176 tid 1 2024-01-13T18:09:12.706 INFO:tasks.rados.rados.0.smithi084.stdout:2546: writing smithi084102331-35 from 434176 to 983040 tid 2 2024-01-13T18:09:12.708 INFO:tasks.rados.rados.0.smithi084.stdout:2546: writing smithi084102331-35 from 983040 to 1236992 tid 3 2024-01-13T18:09:12.708 INFO:tasks.rados.rados.0.smithi084.stdout:2547: delete oid 17 current snap is 254 2024-01-13T18:09:12.708 INFO:tasks.rados.rados.0.smithi084.stdout:2546: finishing write tid 1 to smithi084102331-35 2024-01-13T18:09:12.710 INFO:tasks.rados.rados.0.smithi084.stdout:2547: done (1 left) 2024-01-13T18:09:12.710 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 254 2024-01-13T18:09:12.710 INFO:tasks.rados.rados.0.smithi084.stdout:2548: seq_num 792 ranges {0=466944,466944=761856,1228800=40960} 2024-01-13T18:09:12.713 INFO:tasks.rados.rados.0.smithi084.stdout:2548: writing smithi084102331-3 from 0 to 466944 tid 1 2024-01-13T18:09:12.718 INFO:tasks.rados.rados.0.smithi084.stdout:2548: writing smithi084102331-3 from 466944 to 1228800 tid 2 2024-01-13T18:09:12.718 INFO:tasks.rados.rados.0.smithi084.stdout:2548: writing smithi084102331-3 from 1228800 to 1269760 tid 3 2024-01-13T18:09:12.718 INFO:tasks.rados.rados.0.smithi084.stdout:2549: snap_create 2024-01-13T18:09:12.718 INFO:tasks.rados.rados.0.smithi084.stdout:2546: finishing write tid 2 to smithi084102331-35 2024-01-13T18:09:12.718 INFO:tasks.rados.rados.0.smithi084.stdout:2546: finishing write tid 3 to smithi084102331-35 2024-01-13T18:09:12.718 INFO:tasks.rados.rados.0.smithi084.stdout:2546: finishing write tid 4 to smithi084102331-35 2024-01-13T18:09:12.719 INFO:tasks.rados.rados.0.smithi084.stdout:2546: finishing write tid 5 to smithi084102331-35 2024-01-13T18:09:12.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 936 (ObjNum 790 snap 254 seq_num 790) dirty exists 2024-01-13T18:09:12.719 INFO:tasks.rados.rados.0.smithi084.stdout:2546: left oid 35 (ObjNum 790 snap 254 seq_num 790) 2024-01-13T18:09:12.719 INFO:tasks.rados.rados.0.smithi084.stdout:2548: finishing write tid 1 to smithi084102331-3 2024-01-13T18:09:12.722 INFO:tasks.rados.rados.0.smithi084.stdout:2548: finishing write tid 2 to smithi084102331-3 2024-01-13T18:09:12.723 INFO:tasks.rados.rados.0.smithi084.stdout:2548: finishing write tid 3 to smithi084102331-3 2024-01-13T18:09:12.723 INFO:tasks.rados.rados.0.smithi084.stdout:2548: finishing write tid 4 to smithi084102331-3 2024-01-13T18:09:12.725 INFO:tasks.rados.rados.0.smithi084.stdout:2548: finishing write tid 5 to smithi084102331-3 2024-01-13T18:09:12.725 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1360 (ObjNum 792 snap 254 seq_num 792) dirty exists 2024-01-13T18:09:12.726 INFO:tasks.rados.rados.0.smithi084.stdout:2548: left oid 3 (ObjNum 792 snap 254 seq_num 792) 2024-01-13T18:09:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:12 smithi099 ceph-mon[138788]: osdmap e570: 8 total, 8 up, 8 in 2024-01-13T18:09:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:12 smithi099 ceph-mon[138788]: pgmap v567: 121 pgs: 121 active+clean; 267 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-01-13T18:09:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:12 smithi099 ceph-mon[138788]: osdmap e571: 8 total, 8 up, 8 in 2024-01-13T18:09:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:12 smithi084 ceph-mon[116404]: osdmap e570: 8 total, 8 up, 8 in 2024-01-13T18:09:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:12 smithi084 ceph-mon[116404]: pgmap v567: 121 pgs: 121 active+clean; 267 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-01-13T18:09:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:12 smithi084 ceph-mon[116404]: osdmap e571: 8 total, 8 up, 8 in 2024-01-13T18:09:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:12 smithi084 ceph-mon[119097]: osdmap e570: 8 total, 8 up, 8 in 2024-01-13T18:09:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:12 smithi084 ceph-mon[119097]: pgmap v567: 121 pgs: 121 active+clean; 267 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-01-13T18:09:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:12 smithi084 ceph-mon[119097]: osdmap e571: 8 total, 8 up, 8 in 2024-01-13T18:09:13.709 INFO:tasks.rados.rados.0.smithi084.stdout:2546: done (2 left) 2024-01-13T18:09:13.709 INFO:tasks.rados.rados.0.smithi084.stdout:2548: done (1 left) 2024-01-13T18:09:13.709 INFO:tasks.rados.rados.0.smithi084.stdout:2549: done (0 left) 2024-01-13T18:09:13.709 INFO:tasks.rados.rados.0.smithi084.stdout:2550: delete oid 47 current snap is 255 2024-01-13T18:09:13.711 INFO:tasks.rados.rados.0.smithi084.stdout:2550: done (0 left) 2024-01-13T18:09:13.711 INFO:tasks.rados.rados.0.smithi084.stdout:2551: copy_from oid 37 from oid 34 current snap is 255 2024-01-13T18:09:13.712 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 255 2024-01-13T18:09:13.712 INFO:tasks.rados.rados.0.smithi084.stdout:2552: seq_num 794 ranges {0=499712,499712=532480,1032192=270336} 2024-01-13T18:09:13.714 INFO:tasks.rados.rados.0.smithi084.stdout:2552: writing smithi084102331-9 from 0 to 499712 tid 1 2024-01-13T18:09:13.717 INFO:tasks.rados.rados.0.smithi084.stdout:2552: writing smithi084102331-9 from 499712 to 1032192 tid 2 2024-01-13T18:09:13.719 INFO:tasks.rados.rados.0.smithi084.stdout:2552: writing smithi084102331-9 from 1032192 to 1302528 tid 3 2024-01-13T18:09:13.719 INFO:tasks.rados.rados.0.smithi084.stdout:2553: rollback oid 27 current snap is 255 2024-01-13T18:09:13.719 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 238 2024-01-13T18:09:13.719 INFO:tasks.rados.rados.0.smithi084.stdout:2554: delete oid 28 current snap is 255 2024-01-13T18:09:13.723 INFO:tasks.rados.rados.0.smithi084.stdout:2553: finishing rollback tid 0 to smithi084102331-27 2024-01-13T18:09:13.723 INFO:tasks.rados.rados.0.smithi084.stdout:2552: finishing write tid 1 to smithi084102331-9 2024-01-13T18:09:13.723 INFO:tasks.rados.rados.0.smithi084.stdout:2552: finishing write tid 2 to smithi084102331-9 2024-01-13T18:09:13.724 INFO:tasks.rados.rados.0.smithi084.stdout:2553: finishing rollback tid 1 to smithi084102331-27 2024-01-13T18:09:13.724 INFO:tasks.rados.rados.0.smithi084.stdout:2553: finishing rollback tid 2 to smithi084102331-27 2024-01-13T18:09:13.724 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1112 (ObjNum 745 snap 231 seq_num 745) dirty exists 2024-01-13T18:09:13.725 INFO:tasks.rados.rados.0.smithi084.stdout:2553: done (3 left) 2024-01-13T18:09:13.725 INFO:tasks.rados.rados.0.smithi084.stdout:2554: done (2 left) 2024-01-13T18:09:13.725 INFO:tasks.rados.rados.0.smithi084.stdout:2555: delete oid 28 current snap is 255 2024-01-13T18:09:13.727 INFO:tasks.rados.rados.0.smithi084.stdout:2555: done (2 left) 2024-01-13T18:09:13.727 INFO:tasks.rados.rados.0.smithi084.stdout:2556: snap_create 2024-01-13T18:09:13.728 INFO:tasks.rados.rados.0.smithi084.stdout:2552: finishing write tid 3 to smithi084102331-9 2024-01-13T18:09:13.728 INFO:tasks.rados.rados.0.smithi084.stdout:2552: finishing write tid 4 to smithi084102331-9 2024-01-13T18:09:13.729 INFO:tasks.rados.rados.0.smithi084.stdout:2552: finishing write tid 5 to smithi084102331-9 2024-01-13T18:09:13.729 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1095 (ObjNum 794 snap 255 seq_num 794) dirty exists 2024-01-13T18:09:13.729 INFO:tasks.rados.rados.0.smithi084.stdout:2552: left oid 9 (ObjNum 794 snap 255 seq_num 794) 2024-01-13T18:09:13.733 INFO:tasks.rados.rados.0.smithi084.stdout:2551: finishing copy_from to smithi084102331-37 2024-01-13T18:09:13.733 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1090 (ObjNum 679 snap 215 seq_num 679) dirty exists 2024-01-13T18:09:13.734 INFO:tasks.rados.rados.0.smithi084.stdout:2551: finishing copy_from racing read to smithi084102331-37 2024-01-13T18:09:14.711 INFO:tasks.rados.rados.0.smithi084.stdout:2551: done (2 left) 2024-01-13T18:09:14.711 INFO:tasks.rados.rados.0.smithi084.stdout:2552: done (1 left) 2024-01-13T18:09:14.711 INFO:tasks.rados.rados.0.smithi084.stdout:2556: done (0 left) 2024-01-13T18:09:14.711 INFO:tasks.rados.rados.0.smithi084.stdout:2557: snap_remove snap 246 2024-01-13T18:09:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:14 smithi099 ceph-mon[138788]: osdmap e572: 8 total, 8 up, 8 in 2024-01-13T18:09:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:14 smithi099 ceph-mon[138788]: pgmap v570: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 266 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2024-01-13T18:09:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:14 smithi084 ceph-mon[116404]: osdmap e572: 8 total, 8 up, 8 in 2024-01-13T18:09:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:14 smithi084 ceph-mon[116404]: pgmap v570: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 266 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2024-01-13T18:09:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:14 smithi084 ceph-mon[119097]: osdmap e572: 8 total, 8 up, 8 in 2024-01-13T18:09:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:14 smithi084 ceph-mon[119097]: pgmap v570: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 266 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2024-01-13T18:09:15.711 INFO:tasks.rados.rados.0.smithi084.stdout:2557: done (0 left) 2024-01-13T18:09:15.711 INFO:tasks.rados.rados.0.smithi084.stdout:2558: snap_create 2024-01-13T18:09:16.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:15 smithi099 ceph-mon[138788]: osdmap e573: 8 total, 8 up, 8 in 2024-01-13T18:09:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:15 smithi084 ceph-mon[116404]: osdmap e573: 8 total, 8 up, 8 in 2024-01-13T18:09:16.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:15 smithi084 ceph-mon[119097]: osdmap e573: 8 total, 8 up, 8 in 2024-01-13T18:09:16.713 INFO:tasks.rados.rados.0.smithi084.stdout:2558: done (0 left) 2024-01-13T18:09:16.713 INFO:tasks.rados.rados.0.smithi084.stdout:2559: snap_remove snap 218 2024-01-13T18:09:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:16 smithi099 ceph-mon[138788]: osdmap e574: 8 total, 8 up, 8 in 2024-01-13T18:09:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:16 smithi099 ceph-mon[138788]: pgmap v573: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 272 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 10 op/s 2024-01-13T18:09:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:16 smithi099 ceph-mon[138788]: osdmap e575: 8 total, 8 up, 8 in 2024-01-13T18:09:17.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:16 smithi084 ceph-mon[119097]: osdmap e574: 8 total, 8 up, 8 in 2024-01-13T18:09:17.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:16 smithi084 ceph-mon[119097]: pgmap v573: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 272 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 10 op/s 2024-01-13T18:09:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:16 smithi084 ceph-mon[119097]: osdmap e575: 8 total, 8 up, 8 in 2024-01-13T18:09:17.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:16 smithi084 ceph-mon[116404]: osdmap e574: 8 total, 8 up, 8 in 2024-01-13T18:09:17.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:16 smithi084 ceph-mon[116404]: pgmap v573: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 272 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 10 op/s 2024-01-13T18:09:17.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:16 smithi084 ceph-mon[116404]: osdmap e575: 8 total, 8 up, 8 in 2024-01-13T18:09:17.672 INFO:tasks.rados.rados.0.smithi084.stdout:2559: done (0 left) 2024-01-13T18:09:17.672 INFO:tasks.rados.rados.0.smithi084.stdout:2560: setattr oid 43 current snap is 257 2024-01-13T18:09:17.673 INFO:tasks.rados.rados.0.smithi084.stdout:2561: setattr oid 29 current snap is 257 2024-01-13T18:09:17.676 INFO:tasks.rados.rados.0.smithi084.stdout:2562: rmattr oid 12 current snap is 257 2024-01-13T18:09:17.676 INFO:tasks.rados.rados.0.smithi084.stdout:2562: done (2 left) 2024-01-13T18:09:17.676 INFO:tasks.rados.rados.0.smithi084.stdout:2563: read oid 3 snap -1 2024-01-13T18:09:17.676 INFO:tasks.rados.rados.0.smithi084.stdout:2563: expect (ObjNum 792 snap 254 seq_num 792) 2024-01-13T18:09:17.676 INFO:tasks.rados.rados.0.smithi084.stdout:2564: read oid 38 snap -1 2024-01-13T18:09:17.676 INFO:tasks.rados.rados.0.smithi084.stdout:2564: expect deleted 2024-01-13T18:09:17.676 INFO:tasks.rados.rados.0.smithi084.stdout:2565: setattr oid 28 current snap is 257 2024-01-13T18:09:17.687 INFO:tasks.rados.rados.0.smithi084.stdout:2566: read oid 16 snap 236 2024-01-13T18:09:17.687 INFO:tasks.rados.rados.0.smithi084.stdout:2566: expect deleted 2024-01-13T18:09:17.687 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 257 2024-01-13T18:09:17.687 INFO:tasks.rados.rados.0.smithi084.stdout:2567: seq_num 797 ranges {0=557056,557056=589824,1146880=212992} 2024-01-13T18:09:17.687 INFO:tasks.rados.rados.0.smithi084.stdout:2567: writing smithi084102331-50 from 0 to 557056 tid 1 2024-01-13T18:09:17.687 INFO:tasks.rados.rados.0.smithi084.stdout:2567: writing smithi084102331-50 from 557056 to 1146880 tid 2 2024-01-13T18:09:17.687 INFO:tasks.rados.rados.0.smithi084.stdout:2567: writing smithi084102331-50 from 1146880 to 1359872 tid 3 2024-01-13T18:09:17.688 INFO:tasks.rados.rados.0.smithi084.stdout:2568: snap_create 2024-01-13T18:09:17.698 INFO:tasks.rados.rados.0.smithi084.stdout:2563: expect (ObjNum 792 snap 254 seq_num 792) 2024-01-13T18:09:17.734 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 947 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-01-13T18:09:17.734 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1114 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-01-13T18:09:17.735 INFO:tasks.rados.rados.0.smithi084.stdout:2567: finishing write tid 1 to smithi084102331-50 2024-01-13T18:09:17.735 INFO:tasks.rados.rados.0.smithi084.stdout:2567: finishing write tid 2 to smithi084102331-50 2024-01-13T18:09:17.735 INFO:tasks.rados.rados.0.smithi084.stdout:2567: finishing write tid 3 to smithi084102331-50 2024-01-13T18:09:17.735 INFO:tasks.rados.rados.0.smithi084.stdout:2567: finishing write tid 4 to smithi084102331-50 2024-01-13T18:09:17.735 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1113 (ObjNum 129 snap 0 seq_num 2817432120) dirty exists 2024-01-13T18:09:17.735 INFO:tasks.rados.rados.0.smithi084.stdout:2567: finishing write tid 5 to smithi084102331-50 2024-01-13T18:09:17.735 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 1308 (ObjNum 797 snap 257 seq_num 797) dirty exists 2024-01-13T18:09:17.735 INFO:tasks.rados.rados.0.smithi084.stdout:2567: left oid 50 (ObjNum 797 snap 257 seq_num 797) 2024-01-13T18:09:18.697 INFO:tasks.rados.rados.0.smithi084.stdout:2560: done (7 left) 2024-01-13T18:09:18.697 INFO:tasks.rados.rados.0.smithi084.stdout:2561: done (6 left) 2024-01-13T18:09:18.697 INFO:tasks.rados.rados.0.smithi084.stdout:2563: done (5 left) 2024-01-13T18:09:18.697 INFO:tasks.rados.rados.0.smithi084.stdout:2564: done (4 left) 2024-01-13T18:09:18.697 INFO:tasks.rados.rados.0.smithi084.stdout:2565: done (3 left) 2024-01-13T18:09:18.697 INFO:tasks.rados.rados.0.smithi084.stdout:2566: done (2 left) 2024-01-13T18:09:18.697 INFO:tasks.rados.rados.0.smithi084.stdout:2567: done (1 left) 2024-01-13T18:09:18.698 INFO:tasks.rados.rados.0.smithi084.stdout:2568: done (0 left) 2024-01-13T18:09:18.698 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 258 2024-01-13T18:09:18.698 INFO:tasks.rados.rados.0.smithi084.stdout:2569: seq_num 798 ranges {1302528=573440,1875968=466944,2342912=335872} 2024-01-13T18:09:18.706 INFO:tasks.rados.rados.0.smithi084.stdout:2569: writing smithi084102331-9 from 1302528 to 1875968 tid 1 2024-01-13T18:09:18.709 INFO:tasks.rados.rados.0.smithi084.stdout:2569: writing smithi084102331-9 from 1875968 to 2342912 tid 2 2024-01-13T18:09:18.712 INFO:tasks.rados.rados.0.smithi084.stdout:2569: writing smithi084102331-9 from 2342912 to 2678784 tid 3 2024-01-13T18:09:18.712 INFO:tasks.rados.rados.0.smithi084.stdout:2570: read oid 18 snap -1 2024-01-13T18:09:18.712 INFO:tasks.rados.rados.0.smithi084.stdout:2570: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:09:18.712 INFO:tasks.rados.rados.0.smithi084.stdout:2571: snap_remove snap 244 2024-01-13T18:09:18.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:18 smithi084 ceph-mon[119097]: osdmap e576: 8 total, 8 up, 8 in 2024-01-13T18:09:18.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:18 smithi084 ceph-mon[119097]: pgmap v576: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 270 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 3.0 MiB/s wr, 6 op/s 2024-01-13T18:09:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:18 smithi084 ceph-mon[116404]: osdmap e576: 8 total, 8 up, 8 in 2024-01-13T18:09:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:18 smithi084 ceph-mon[116404]: pgmap v576: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 270 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 3.0 MiB/s wr, 6 op/s 2024-01-13T18:09:19.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:18 smithi099 ceph-mon[138788]: osdmap e576: 8 total, 8 up, 8 in 2024-01-13T18:09:19.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:18 smithi099 ceph-mon[138788]: pgmap v576: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 270 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 3.0 MiB/s wr, 6 op/s 2024-01-13T18:09:19.707 INFO:tasks.rados.rados.0.smithi084.stdout:2571: done (2 left) 2024-01-13T18:09:19.707 INFO:tasks.rados.rados.0.smithi084.stdout:2572: copy_from oid 19 from oid 12 current snap is 258 2024-01-13T18:09:19.707 INFO:tasks.rados.rados.0.smithi084.stdout:2573: read oid 20 snap -1 2024-01-13T18:09:19.707 INFO:tasks.rados.rados.0.smithi084.stdout:2573: expect deleted 2024-01-13T18:09:19.707 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 258 2024-01-13T18:09:19.707 INFO:tasks.rados.rados.0.smithi084.stdout:2574: seq_num 799 ranges {1359872=589824,1949696=802816} 2024-01-13T18:09:19.716 INFO:tasks.rados.rados.0.smithi084.stdout:2574: writing smithi084102331-50 from 1359872 to 1949696 tid 1 2024-01-13T18:09:19.721 INFO:tasks.rados.rados.0.smithi084.stdout:2574: writing smithi084102331-50 from 1949696 to 2752512 tid 2 2024-01-13T18:09:19.722 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 258 2024-01-13T18:09:19.722 INFO:tasks.rados.rados.0.smithi084.stdout:2575: seq_num 800 ranges {6602752=606208,7208960=688128,7897088=114688} 2024-01-13T18:09:19.761 INFO:tasks.rados.rados.0.smithi084.stdout:2575: writing smithi084102331-7 from 6602752 to 7208960 tid 1 2024-01-13T18:09:19.764 INFO:tasks.rados.rados.0.smithi084.stdout:2575: writing smithi084102331-7 from 7208960 to 7897088 tid 2 2024-01-13T18:09:19.765 INFO:tasks.rados.rados.0.smithi084.stdout:2575: writing smithi084102331-7 from 7897088 to 8011776 tid 3 2024-01-13T18:09:19.765 INFO:tasks.rados.rados.0.smithi084.stdout:2576: delete oid 43 current snap is 258 2024-01-13T18:09:19.766 INFO:tasks.rados.rados.0.smithi084.stdout:2569: finishing write tid 1 to smithi084102331-9 2024-01-13T18:09:19.766 INFO:tasks.rados.rados.0.smithi084.stdout:2569: finishing write tid 2 to smithi084102331-9 2024-01-13T18:09:19.766 INFO:tasks.rados.rados.0.smithi084.stdout:2569: finishing write tid 3 to smithi084102331-9 2024-01-13T18:09:19.766 INFO:tasks.rados.rados.0.smithi084.stdout:2569: finishing write tid 4 to smithi084102331-9 2024-01-13T18:09:19.766 INFO:tasks.rados.rados.0.smithi084.stdout:2569: finishing write tid 5 to smithi084102331-9 2024-01-13T18:09:19.766 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1099 (ObjNum 798 snap 258 seq_num 798) dirty exists 2024-01-13T18:09:19.766 INFO:tasks.rados.rados.0.smithi084.stdout:2569: left oid 9 (ObjNum 798 snap 258 seq_num 798) 2024-01-13T18:09:19.766 INFO:tasks.rados.rados.0.smithi084.stdout:2570: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:09:20.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:19 smithi099 ceph-mon[138788]: osdmap e577: 8 total, 8 up, 8 in 2024-01-13T18:09:20.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:19 smithi084 ceph-mon[116404]: osdmap e577: 8 total, 8 up, 8 in 2024-01-13T18:09:20.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:19 smithi084 ceph-mon[119097]: osdmap e577: 8 total, 8 up, 8 in 2024-01-13T18:09:20.325 INFO:tasks.rados.rados.0.smithi084.stdout:2574: finishing write tid 1 to smithi084102331-50 2024-01-13T18:09:20.325 INFO:tasks.rados.rados.0.smithi084.stdout:2574: finishing write tid 2 to smithi084102331-50 2024-01-13T18:09:20.325 INFO:tasks.rados.rados.0.smithi084.stdout:2574: finishing write tid 3 to smithi084102331-50 2024-01-13T18:09:20.325 INFO:tasks.rados.rados.0.smithi084.stdout:2572: finishing copy_from to smithi084102331-19 2024-01-13T18:09:20.325 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 1278 (ObjNum 775 snap 249 seq_num 775) dirty exists 2024-01-13T18:09:20.325 INFO:tasks.rados.rados.0.smithi084.stdout:2574: finishing write tid 4 to smithi084102331-50 2024-01-13T18:09:20.325 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 1311 (ObjNum 799 snap 258 seq_num 799) dirty exists 2024-01-13T18:09:20.325 INFO:tasks.rados.rados.0.smithi084.stdout:2574: left oid 50 (ObjNum 799 snap 258 seq_num 799) 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2572: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2575: finishing write tid 1 to smithi084102331-7 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2569: done (6 left) 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2570: done (5 left) 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2572: done (4 left) 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2573: done (3 left) 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2574: done (2 left) 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2576: done (1 left) 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2577: setattr oid 4 current snap is 258 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2575: finishing write tid 2 to smithi084102331-7 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2575: finishing write tid 3 to smithi084102331-7 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2575: finishing write tid 4 to smithi084102331-7 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2575: finishing write tid 5 to smithi084102331-7 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1117 (ObjNum 800 snap 258 seq_num 800) dirty exists 2024-01-13T18:09:20.326 INFO:tasks.rados.rados.0.smithi084.stdout:2575: left oid 7 (ObjNum 800 snap 258 seq_num 800) 2024-01-13T18:09:20.327 INFO:tasks.rados.rados.0.smithi084.stdout:2575: done (1 left) 2024-01-13T18:09:20.327 INFO:tasks.rados.rados.0.smithi084.stdout:2578: read oid 1 snap -1 2024-01-13T18:09:20.327 INFO:tasks.rados.rados.0.smithi084.stdout:2578: expect (ObjNum 677 snap 214 seq_num 677) 2024-01-13T18:09:20.327 INFO:tasks.rados.rados.0.smithi084.stdout:2579: read oid 5 snap -1 2024-01-13T18:09:20.327 INFO:tasks.rados.rados.0.smithi084.stdout:2579: expect (ObjNum 776 snap 249 seq_num 776) 2024-01-13T18:09:20.327 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 258 2024-01-13T18:09:20.328 INFO:tasks.rados.rados.0.smithi084.stdout:2580: seq_num 802 ranges {5332992=638976,5971968=458752,6430720=344064} 2024-01-13T18:09:20.359 INFO:tasks.rados.rados.0.smithi084.stdout:2580: writing smithi084102331-22 from 5332992 to 5971968 tid 1 2024-01-13T18:09:20.361 INFO:tasks.rados.rados.0.smithi084.stdout:2580: writing smithi084102331-22 from 5971968 to 6430720 tid 2 2024-01-13T18:09:20.363 INFO:tasks.rados.rados.0.smithi084.stdout:2580: writing smithi084102331-22 from 6430720 to 6774784 tid 3 2024-01-13T18:09:20.363 INFO:tasks.rados.rados.0.smithi084.stdout:2581: rollback oid 41 current snap is 258 2024-01-13T18:09:20.363 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 238 2024-01-13T18:09:20.363 INFO:tasks.rados.rados.0.smithi084.stdout:2578: expect (ObjNum 677 snap 214 seq_num 677) 2024-01-13T18:09:20.405 INFO:tasks.rados.rados.0.smithi084.stdout:2579: expect (ObjNum 776 snap 249 seq_num 776) 2024-01-13T18:09:20.430 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 1216 (ObjNum 782 snap 254 seq_num 782) dirty exists 2024-01-13T18:09:20.431 INFO:tasks.rados.rados.0.smithi084.stdout:2580: finishing write tid 1 to smithi084102331-22 2024-01-13T18:09:20.431 INFO:tasks.rados.rados.0.smithi084.stdout:2580: finishing write tid 2 to smithi084102331-22 2024-01-13T18:09:20.431 INFO:tasks.rados.rados.0.smithi084.stdout:2581: finishing rollback tid 0 to smithi084102331-41 2024-01-13T18:09:20.431 INFO:tasks.rados.rados.0.smithi084.stdout:2580: finishing write tid 3 to smithi084102331-22 2024-01-13T18:09:20.431 INFO:tasks.rados.rados.0.smithi084.stdout:2581: finishing rollback tid 1 to smithi084102331-41 2024-01-13T18:09:20.432 INFO:tasks.rados.rados.0.smithi084.stdout:2581: finishing rollback tid 2 to smithi084102331-41 2024-01-13T18:09:20.432 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1241 (ObjNum 743 snap 231 seq_num 743) dirty exists 2024-01-13T18:09:20.432 INFO:tasks.rados.rados.0.smithi084.stdout:2580: finishing write tid 4 to smithi084102331-22 2024-01-13T18:09:20.432 INFO:tasks.rados.rados.0.smithi084.stdout:2580: finishing write tid 5 to smithi084102331-22 2024-01-13T18:09:20.432 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1327 (ObjNum 802 snap 258 seq_num 802) dirty exists 2024-01-13T18:09:20.432 INFO:tasks.rados.rados.0.smithi084.stdout:2580: left oid 22 (ObjNum 802 snap 258 seq_num 802) 2024-01-13T18:09:20.432 INFO:tasks.rados.rados.0.smithi084.stdout:2577: done (4 left) 2024-01-13T18:09:20.432 INFO:tasks.rados.rados.0.smithi084.stdout:2578: done (3 left) 2024-01-13T18:09:20.432 INFO:tasks.rados.rados.0.smithi084.stdout:2579: done (2 left) 2024-01-13T18:09:20.432 INFO:tasks.rados.rados.0.smithi084.stdout:2580: done (1 left) 2024-01-13T18:09:20.433 INFO:tasks.rados.rados.0.smithi084.stdout:2581: done (0 left) 2024-01-13T18:09:20.433 INFO:tasks.rados.rados.0.smithi084.stdout:2582: read oid 46 snap -1 2024-01-13T18:09:20.433 INFO:tasks.rados.rados.0.smithi084.stdout:2582: expect deleted 2024-01-13T18:09:20.433 INFO:tasks.rados.rados.0.smithi084.stdout:2583: read oid 49 snap -1 2024-01-13T18:09:20.433 INFO:tasks.rados.rados.0.smithi084.stdout:2583: expect (ObjNum 689 snap 216 seq_num 689) 2024-01-13T18:09:20.433 INFO:tasks.rados.rados.0.smithi084.stdout:2584: setattr oid 44 current snap is 258 2024-01-13T18:09:20.433 INFO:tasks.rados.rados.0.smithi084.stdout:2582: done (2 left) 2024-01-13T18:09:20.434 INFO:tasks.rados.rados.0.smithi084.stdout:2585: rollback oid 40 current snap is 258 2024-01-13T18:09:20.434 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 247 2024-01-13T18:09:20.434 INFO:tasks.rados.rados.0.smithi084.stdout:2586: snap_create 2024-01-13T18:09:20.434 INFO:tasks.rados.rados.0.smithi084.stdout:2585: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:09:20.434 INFO:tasks.rados.rados.0.smithi084.stdout:2585: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:09:20.434 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 960 (ObjNum 65 snap 0 seq_num 0) dirty dne 2024-01-13T18:09:20.434 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1248 (ObjNum 663 snap 207 seq_num 663) dirty exists 2024-01-13T18:09:20.449 INFO:tasks.rados.rados.0.smithi084.stdout:2583: expect (ObjNum 689 snap 216 seq_num 689) 2024-01-13T18:09:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:09:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:09:20] "GET /metrics HTTP/1.1" 200 36194 "" "Prometheus/2.43.0" 2024-01-13T18:09:20.751 INFO:tasks.rados.rados.0.smithi084.stdout:2583: done (3 left) 2024-01-13T18:09:20.751 INFO:tasks.rados.rados.0.smithi084.stdout:2584: done (2 left) 2024-01-13T18:09:20.752 INFO:tasks.rados.rados.0.smithi084.stdout:2585: done (1 left) 2024-01-13T18:09:20.752 INFO:tasks.rados.rados.0.smithi084.stdout:2586: done (0 left) 2024-01-13T18:09:20.752 INFO:tasks.rados.rados.0.smithi084.stdout:2587: copy_from oid 16 from oid 7 current snap is 259 2024-01-13T18:09:20.752 INFO:tasks.rados.rados.0.smithi084.stdout:2588: read oid 14 snap -1 2024-01-13T18:09:20.752 INFO:tasks.rados.rados.0.smithi084.stdout:2588: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:09:20.752 INFO:tasks.rados.rados.0.smithi084.stdout:2589: snap_remove snap 254 2024-01-13T18:09:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:20 smithi099 ceph-mon[138788]: osdmap e578: 8 total, 8 up, 8 in 2024-01-13T18:09:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:20 smithi099 ceph-mon[138788]: pgmap v579: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 243 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.4 MiB/s wr, 6 op/s 2024-01-13T18:09:21.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:20 smithi084 ceph-mon[116404]: osdmap e578: 8 total, 8 up, 8 in 2024-01-13T18:09:21.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:20 smithi084 ceph-mon[116404]: pgmap v579: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 243 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.4 MiB/s wr, 6 op/s 2024-01-13T18:09:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:20 smithi084 ceph-mon[119097]: osdmap e578: 8 total, 8 up, 8 in 2024-01-13T18:09:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:20 smithi084 ceph-mon[119097]: pgmap v579: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 243 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.4 MiB/s wr, 6 op/s 2024-01-13T18:09:21.713 INFO:tasks.rados.rados.0.smithi084.stdout:2589: done (2 left) 2024-01-13T18:09:21.714 INFO:tasks.rados.rados.0.smithi084.stdout:2590: rollback oid 30 current snap is 259 2024-01-13T18:09:21.714 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 245 2024-01-13T18:09:21.714 INFO:tasks.rados.rados.0.smithi084.stdout:2591: read oid 17 snap 253 2024-01-13T18:09:21.714 INFO:tasks.rados.rados.0.smithi084.stdout:2591: expect deleted 2024-01-13T18:09:21.714 INFO:tasks.rados.rados.0.smithi084.stdout:2592: snap_create 2024-01-13T18:09:21.714 INFO:tasks.rados.rados.0.smithi084.stdout:2588: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:09:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:21 smithi099 ceph-mon[138788]: osdmap e579: 8 total, 8 up, 8 in 2024-01-13T18:09:22.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:21 smithi084 ceph-mon[116404]: osdmap e579: 8 total, 8 up, 8 in 2024-01-13T18:09:22.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:21 smithi084 ceph-mon[119097]: osdmap e579: 8 total, 8 up, 8 in 2024-01-13T18:09:22.277 INFO:tasks.rados.rados.0.smithi084.stdout:2587: finishing copy_from to smithi084102331-16 2024-01-13T18:09:22.277 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1117 (ObjNum 800 snap 258 seq_num 800) dirty exists 2024-01-13T18:09:22.277 INFO:tasks.rados.rados.0.smithi084.stdout:2587: finishing copy_from racing read to smithi084102331-16 2024-01-13T18:09:22.277 INFO:tasks.rados.rados.0.smithi084.stdout:2590: finishing rollback tid 1 to smithi084102331-30 2024-01-13T18:09:22.277 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 0 (ObjNum 2801 snap 0 seq_num 4038763808) dirty dne 2024-01-13T18:09:22.673 INFO:tasks.rados.rados.0.smithi084.stdout:2587: done (4 left) 2024-01-13T18:09:22.673 INFO:tasks.rados.rados.0.smithi084.stdout:2588: done (3 left) 2024-01-13T18:09:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:2590: done (2 left) 2024-01-13T18:09:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:2591: done (1 left) 2024-01-13T18:09:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:2592: done (0 left) 2024-01-13T18:09:22.674 INFO:tasks.rados.rados.0.smithi084.stdout:2593: setattr oid 9 current snap is 260 2024-01-13T18:09:22.675 INFO:tasks.rados.rados.0.smithi084.stdout:2594: read oid 10 snap -1 2024-01-13T18:09:22.675 INFO:tasks.rados.rados.0.smithi084.stdout:2594: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:09:22.675 INFO:tasks.rados.rados.0.smithi084.stdout:2595: snap_create 2024-01-13T18:09:22.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1100 (ObjNum 798 snap 258 seq_num 798) dirty exists 2024-01-13T18:09:22.682 INFO:tasks.rados.rados.0.smithi084.stdout:2594: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:09:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:22 smithi099 ceph-mon[138788]: osdmap e580: 8 total, 8 up, 8 in 2024-01-13T18:09:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:22 smithi099 ceph-mon[138788]: pgmap v582: 121 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 114 active+clean; 187 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 30 op/s 2024-01-13T18:09:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:22 smithi099 ceph-mon[138788]: osdmap e581: 8 total, 8 up, 8 in 2024-01-13T18:09:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:22 smithi084 ceph-mon[116404]: osdmap e580: 8 total, 8 up, 8 in 2024-01-13T18:09:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:22 smithi084 ceph-mon[116404]: pgmap v582: 121 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 114 active+clean; 187 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 30 op/s 2024-01-13T18:09:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:22 smithi084 ceph-mon[116404]: osdmap e581: 8 total, 8 up, 8 in 2024-01-13T18:09:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:22 smithi084 ceph-mon[119097]: osdmap e580: 8 total, 8 up, 8 in 2024-01-13T18:09:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:22 smithi084 ceph-mon[119097]: pgmap v582: 121 pgs: 3 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 114 active+clean; 187 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 30 op/s 2024-01-13T18:09:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:22 smithi084 ceph-mon[119097]: osdmap e581: 8 total, 8 up, 8 in 2024-01-13T18:09:23.685 INFO:tasks.rados.rados.0.smithi084.stdout:2593: done (2 left) 2024-01-13T18:09:23.685 INFO:tasks.rados.rados.0.smithi084.stdout:2594: done (1 left) 2024-01-13T18:09:23.685 INFO:tasks.rados.rados.0.smithi084.stdout:2595: done (0 left) 2024-01-13T18:09:23.685 INFO:tasks.rados.rados.0.smithi084.stdout:2596: delete oid 42 current snap is 261 2024-01-13T18:09:23.691 INFO:tasks.rados.rados.0.smithi084.stdout:2596: done (0 left) 2024-01-13T18:09:23.691 INFO:tasks.rados.rados.0.smithi084.stdout:2597: snap_remove snap 260 2024-01-13T18:09:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:2597: done (0 left) 2024-01-13T18:09:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:2598: read oid 23 snap -1 2024-01-13T18:09:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:2598: expect (ObjNum 756 snap 237 seq_num 756) 2024-01-13T18:09:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:2599: read oid 13 snap -1 2024-01-13T18:09:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:2599: expect (ObjNum 736 snap 230 seq_num 736) 2024-01-13T18:09:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:2600: snap_create 2024-01-13T18:09:24.699 INFO:tasks.rados.rados.0.smithi084.stdout:2599: expect (ObjNum 736 snap 230 seq_num 736) 2024-01-13T18:09:24.708 INFO:tasks.rados.rados.0.smithi084.stdout:2598: expect (ObjNum 756 snap 237 seq_num 756) 2024-01-13T18:09:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:24 smithi099 ceph-mon[138788]: osdmap e582: 8 total, 8 up, 8 in 2024-01-13T18:09:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:24 smithi099 ceph-mon[138788]: pgmap v585: 121 pgs: 3 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 116 active+clean; 187 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.0 MiB/s rd, 3.2 MiB/s wr, 36 op/s 2024-01-13T18:09:25.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:24 smithi084 ceph-mon[116404]: osdmap e582: 8 total, 8 up, 8 in 2024-01-13T18:09:25.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:24 smithi084 ceph-mon[116404]: pgmap v585: 121 pgs: 3 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 116 active+clean; 187 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.0 MiB/s rd, 3.2 MiB/s wr, 36 op/s 2024-01-13T18:09:25.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:24 smithi084 ceph-mon[119097]: osdmap e582: 8 total, 8 up, 8 in 2024-01-13T18:09:25.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:24 smithi084 ceph-mon[119097]: pgmap v585: 121 pgs: 3 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 116 active+clean; 187 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.0 MiB/s rd, 3.2 MiB/s wr, 36 op/s 2024-01-13T18:09:25.701 INFO:tasks.rados.rados.0.smithi084.stdout:2598: done (2 left) 2024-01-13T18:09:25.701 INFO:tasks.rados.rados.0.smithi084.stdout:2599: done (1 left) 2024-01-13T18:09:25.701 INFO:tasks.rados.rados.0.smithi084.stdout:2600: done (0 left) 2024-01-13T18:09:25.701 INFO:tasks.rados.rados.0.smithi084.stdout:2601: copy_from oid 44 from oid 8 current snap is 262 2024-01-13T18:09:25.701 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 262 2024-01-13T18:09:25.701 INFO:tasks.rados.rados.0.smithi084.stdout:2602: seq_num 804 ranges {1236992=671744,1908736=622592,2531328=180224} 2024-01-13T18:09:25.711 INFO:tasks.rados.rados.0.smithi084.stdout:2602: writing smithi084102331-35 from 1236992 to 1908736 tid 1 2024-01-13T18:09:25.715 INFO:tasks.rados.rados.0.smithi084.stdout:2602: writing smithi084102331-35 from 1908736 to 2531328 tid 2 2024-01-13T18:09:25.717 INFO:tasks.rados.rados.0.smithi084.stdout:2602: writing smithi084102331-35 from 2531328 to 2711552 tid 3 2024-01-13T18:09:25.717 INFO:tasks.rados.rados.0.smithi084.stdout:2603: read oid 11 snap -1 2024-01-13T18:09:25.717 INFO:tasks.rados.rados.0.smithi084.stdout:2603: expect (ObjNum 702 snap 220 seq_num 702) 2024-01-13T18:09:25.717 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 262 2024-01-13T18:09:25.717 INFO:tasks.rados.rados.0.smithi084.stdout:2601: finishing copy_from to smithi084102331-44 2024-01-13T18:09:25.717 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1215 (ObjNum 776 snap 249 seq_num 776) dirty exists 2024-01-13T18:09:25.717 INFO:tasks.rados.rados.0.smithi084.stdout:2604: seq_num 805 ranges {1785856=688128,2473984=507904,2981888=294912} 2024-01-13T18:09:25.730 INFO:tasks.rados.rados.0.smithi084.stdout:2604: writing smithi084102331-34 from 1785856 to 2473984 tid 1 2024-01-13T18:09:25.733 INFO:tasks.rados.rados.0.smithi084.stdout:2604: writing smithi084102331-34 from 2473984 to 2981888 tid 2 2024-01-13T18:09:25.736 INFO:tasks.rados.rados.0.smithi084.stdout:2604: writing smithi084102331-34 from 2981888 to 3276800 tid 3 2024-01-13T18:09:25.736 INFO:tasks.rados.rados.0.smithi084.stdout:2605: read oid 15 snap -1 2024-01-13T18:09:25.736 INFO:tasks.rados.rados.0.smithi084.stdout:2605: expect (ObjNum 785 snap 254 seq_num 785) 2024-01-13T18:09:25.736 INFO:tasks.rados.rados.0.smithi084.stdout:2601: finishing copy_from racing read to smithi084102331-44 2024-01-13T18:09:25.736 INFO:tasks.rados.rados.0.smithi084.stdout:2601: done (4 left) 2024-01-13T18:09:25.736 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 262 2024-01-13T18:09:25.736 INFO:tasks.rados.rados.0.smithi084.stdout:2602: finishing write tid 1 to smithi084102331-35 2024-01-13T18:09:25.736 INFO:tasks.rados.rados.0.smithi084.stdout:2602: finishing write tid 2 to smithi084102331-35 2024-01-13T18:09:25.737 INFO:tasks.rados.rados.0.smithi084.stdout:2602: finishing write tid 3 to smithi084102331-35 2024-01-13T18:09:25.737 INFO:tasks.rados.rados.0.smithi084.stdout:2602: finishing write tid 4 to smithi084102331-35 2024-01-13T18:09:25.737 INFO:tasks.rados.rados.0.smithi084.stdout:2602: finishing write tid 5 to smithi084102331-35 2024-01-13T18:09:25.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 967 (ObjNum 804 snap 262 seq_num 804) dirty exists 2024-01-13T18:09:25.737 INFO:tasks.rados.rados.0.smithi084.stdout:2602: left oid 35 (ObjNum 804 snap 262 seq_num 804) 2024-01-13T18:09:25.737 INFO:tasks.rados.rados.0.smithi084.stdout:2606: seq_num 806 ranges {1785856=704512,2490368=442368,2932736=360448} 2024-01-13T18:09:25.750 INFO:tasks.rados.rados.0.smithi084.stdout:2606: writing smithi084102331-37 from 1785856 to 2490368 tid 1 2024-01-13T18:09:25.752 INFO:tasks.rados.rados.0.smithi084.stdout:2606: writing smithi084102331-37 from 2490368 to 2932736 tid 2 2024-01-13T18:09:25.755 INFO:tasks.rados.rados.0.smithi084.stdout:2606: writing smithi084102331-37 from 2932736 to 3293184 tid 3 2024-01-13T18:09:25.755 INFO:tasks.rados.rados.0.smithi084.stdout:2602: done (4 left) 2024-01-13T18:09:25.755 INFO:tasks.rados.rados.0.smithi084.stdout:2607: delete oid 17 current snap is 262 2024-01-13T18:09:25.755 INFO:tasks.rados.rados.0.smithi084.stdout:2604: finishing write tid 1 to smithi084102331-34 2024-01-13T18:09:25.755 INFO:tasks.rados.rados.0.smithi084.stdout:2604: finishing write tid 2 to smithi084102331-34 2024-01-13T18:09:25.755 INFO:tasks.rados.rados.0.smithi084.stdout:2604: finishing write tid 3 to smithi084102331-34 2024-01-13T18:09:25.755 INFO:tasks.rados.rados.0.smithi084.stdout:2604: finishing write tid 4 to smithi084102331-34 2024-01-13T18:09:25.755 INFO:tasks.rados.rados.0.smithi084.stdout:2604: finishing write tid 5 to smithi084102331-34 2024-01-13T18:09:25.756 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 1104 (ObjNum 805 snap 262 seq_num 805) dirty exists 2024-01-13T18:09:25.756 INFO:tasks.rados.rados.0.smithi084.stdout:2604: left oid 34 (ObjNum 805 snap 262 seq_num 805) 2024-01-13T18:09:25.756 INFO:tasks.rados.rados.0.smithi084.stdout:2603: expect (ObjNum 702 snap 220 seq_num 702) 2024-01-13T18:09:26.091 INFO:tasks.rados.rados.0.smithi084.stdout:2606: finishing write tid 1 to smithi084102331-37 2024-01-13T18:09:26.091 INFO:tasks.rados.rados.0.smithi084.stdout:2606: finishing write tid 2 to smithi084102331-37 2024-01-13T18:09:26.091 INFO:tasks.rados.rados.0.smithi084.stdout:2606: finishing write tid 3 to smithi084102331-37 2024-01-13T18:09:26.092 INFO:tasks.rados.rados.0.smithi084.stdout:2606: finishing write tid 4 to smithi084102331-37 2024-01-13T18:09:26.092 INFO:tasks.rados.rados.0.smithi084.stdout:2606: finishing write tid 5 to smithi084102331-37 2024-01-13T18:09:26.092 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1315 (ObjNum 806 snap 262 seq_num 806) dirty exists 2024-01-13T18:09:26.092 INFO:tasks.rados.rados.0.smithi084.stdout:2606: left oid 37 (ObjNum 806 snap 262 seq_num 806) 2024-01-13T18:09:26.092 INFO:tasks.rados.rados.0.smithi084.stdout:2605: expect (ObjNum 785 snap 254 seq_num 785) 2024-01-13T18:09:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:25 smithi099 ceph-mon[138788]: osdmap e583: 8 total, 8 up, 8 in 2024-01-13T18:09:26.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:25 smithi084 ceph-mon[116404]: osdmap e583: 8 total, 8 up, 8 in 2024-01-13T18:09:26.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:25 smithi084 ceph-mon[119097]: osdmap e583: 8 total, 8 up, 8 in 2024-01-13T18:09:26.500 INFO:tasks.rados.rados.0.smithi084.stdout:2603: done (4 left) 2024-01-13T18:09:26.500 INFO:tasks.rados.rados.0.smithi084.stdout:2604: done (3 left) 2024-01-13T18:09:26.500 INFO:tasks.rados.rados.0.smithi084.stdout:2605: done (2 left) 2024-01-13T18:09:26.501 INFO:tasks.rados.rados.0.smithi084.stdout:2606: done (1 left) 2024-01-13T18:09:26.501 INFO:tasks.rados.rados.0.smithi084.stdout:2607: done (0 left) 2024-01-13T18:09:26.501 INFO:tasks.rados.rados.0.smithi084.stdout:2608: setattr oid 7 current snap is 262 2024-01-13T18:09:26.502 INFO:tasks.rados.rados.0.smithi084.stdout:2609: copy_from oid 43 from oid 12 current snap is 262 2024-01-13T18:09:26.502 INFO:tasks.rados.rados.0.smithi084.stdout:2610: read oid 28 snap -1 2024-01-13T18:09:26.502 INFO:tasks.rados.rados.0.smithi084.stdout:2610: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:09:26.502 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 262 2024-01-13T18:09:26.502 INFO:tasks.rados.rados.0.smithi084.stdout:2611: seq_num 808 ranges {950272=737280,1687552=614400,2301952=188416} 2024-01-13T18:09:26.511 INFO:tasks.rados.rados.0.smithi084.stdout:2611: writing smithi084102331-24 from 950272 to 1687552 tid 1 2024-01-13T18:09:26.514 INFO:tasks.rados.rados.0.smithi084.stdout:2611: writing smithi084102331-24 from 1687552 to 2301952 tid 2 2024-01-13T18:09:26.516 INFO:tasks.rados.rados.0.smithi084.stdout:2611: writing smithi084102331-24 from 2301952 to 2490368 tid 3 2024-01-13T18:09:26.516 INFO:tasks.rados.rados.0.smithi084.stdout:2612: delete oid 4 current snap is 262 2024-01-13T18:09:26.516 INFO:tasks.rados.rados.0.smithi084.stdout:2610: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:09:26.518 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1119 (ObjNum 800 snap 258 seq_num 800) dirty exists 2024-01-13T18:09:26.518 INFO:tasks.rados.rados.0.smithi084.stdout:2609: finishing copy_from to smithi084102331-43 2024-01-13T18:09:26.518 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1278 (ObjNum 775 snap 249 seq_num 775) dirty exists 2024-01-13T18:09:26.519 INFO:tasks.rados.rados.0.smithi084.stdout:2609: finishing copy_from racing read to smithi084102331-43 2024-01-13T18:09:26.519 INFO:tasks.rados.rados.0.smithi084.stdout:2611: finishing write tid 1 to smithi084102331-24 2024-01-13T18:09:26.519 INFO:tasks.rados.rados.0.smithi084.stdout:2608: done (4 left) 2024-01-13T18:09:26.520 INFO:tasks.rados.rados.0.smithi084.stdout:2609: done (3 left) 2024-01-13T18:09:26.520 INFO:tasks.rados.rados.0.smithi084.stdout:2610: done (2 left) 2024-01-13T18:09:26.520 INFO:tasks.rados.rados.0.smithi084.stdout:2612: done (1 left) 2024-01-13T18:09:26.520 INFO:tasks.rados.rados.0.smithi084.stdout:2613: delete oid 8 current snap is 262 2024-01-13T18:09:26.520 INFO:tasks.rados.rados.0.smithi084.stdout:2611: finishing write tid 2 to smithi084102331-24 2024-01-13T18:09:26.520 INFO:tasks.rados.rados.0.smithi084.stdout:2611: finishing write tid 3 to smithi084102331-24 2024-01-13T18:09:26.520 INFO:tasks.rados.rados.0.smithi084.stdout:2611: finishing write tid 4 to smithi084102331-24 2024-01-13T18:09:26.521 INFO:tasks.rados.rados.0.smithi084.stdout:2611: finishing write tid 5 to smithi084102331-24 2024-01-13T18:09:26.521 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1282 (ObjNum 808 snap 262 seq_num 808) dirty exists 2024-01-13T18:09:26.521 INFO:tasks.rados.rados.0.smithi084.stdout:2611: left oid 24 (ObjNum 808 snap 262 seq_num 808) 2024-01-13T18:09:26.521 INFO:tasks.rados.rados.0.smithi084.stdout:2611: done (1 left) 2024-01-13T18:09:26.521 INFO:tasks.rados.rados.0.smithi084.stdout:2613: done (0 left) 2024-01-13T18:09:26.521 INFO:tasks.rados.rados.0.smithi084.stdout:2614: read oid 40 snap -1 2024-01-13T18:09:26.521 INFO:tasks.rados.rados.0.smithi084.stdout:2614: expect deleted 2024-01-13T18:09:26.521 INFO:tasks.rados.rados.0.smithi084.stdout:2615: snap_create 2024-01-13T18:09:26.703 INFO:tasks.rados.rados.0.smithi084.stdout:2614: done (1 left) 2024-01-13T18:09:26.704 INFO:tasks.rados.rados.0.smithi084.stdout:2615: done (0 left) 2024-01-13T18:09:26.704 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 263 2024-01-13T18:09:26.704 INFO:tasks.rados.rados.0.smithi084.stdout:2616: seq_num 811 ranges {2711552=786432,3497984=663552,4161536=139264} 2024-01-13T18:09:26.722 INFO:tasks.rados.rados.0.smithi084.stdout:2616: writing smithi084102331-35 from 2711552 to 3497984 tid 1 2024-01-13T18:09:26.726 INFO:tasks.rados.rados.0.smithi084.stdout:2616: writing smithi084102331-35 from 3497984 to 4161536 tid 2 2024-01-13T18:09:26.727 INFO:tasks.rados.rados.0.smithi084.stdout:2616: writing smithi084102331-35 from 4161536 to 4300800 tid 3 2024-01-13T18:09:26.727 INFO:tasks.rados.rados.0.smithi084.stdout:2617: snap_create 2024-01-13T18:09:26.752 INFO:tasks.rados.rados.0.smithi084.stdout:2616: finishing write tid 1 to smithi084102331-35 2024-01-13T18:09:26.752 INFO:tasks.rados.rados.0.smithi084.stdout:2616: finishing write tid 2 to smithi084102331-35 2024-01-13T18:09:26.752 INFO:tasks.rados.rados.0.smithi084.stdout:2616: finishing write tid 3 to smithi084102331-35 2024-01-13T18:09:26.752 INFO:tasks.rados.rados.0.smithi084.stdout:2616: finishing write tid 4 to smithi084102331-35 2024-01-13T18:09:26.753 INFO:tasks.rados.rados.0.smithi084.stdout:2616: finishing write tid 5 to smithi084102331-35 2024-01-13T18:09:26.753 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 972 (ObjNum 811 snap 263 seq_num 811) dirty exists 2024-01-13T18:09:26.753 INFO:tasks.rados.rados.0.smithi084.stdout:2616: left oid 35 (ObjNum 811 snap 263 seq_num 811) 2024-01-13T18:09:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:26 smithi099 ceph-mon[138788]: osdmap e584: 8 total, 8 up, 8 in 2024-01-13T18:09:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:26 smithi099 ceph-mon[138788]: pgmap v588: 121 pgs: 3 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 116 active+clean; 188 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 196 KiB/s wr, 10 op/s 2024-01-13T18:09:27.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:26 smithi084 ceph-mon[116404]: osdmap e584: 8 total, 8 up, 8 in 2024-01-13T18:09:27.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:26 smithi084 ceph-mon[116404]: pgmap v588: 121 pgs: 3 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 116 active+clean; 188 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 196 KiB/s wr, 10 op/s 2024-01-13T18:09:27.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:26 smithi084 ceph-mon[119097]: osdmap e584: 8 total, 8 up, 8 in 2024-01-13T18:09:27.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:26 smithi084 ceph-mon[119097]: pgmap v588: 121 pgs: 3 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 116 active+clean; 188 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 196 KiB/s wr, 10 op/s 2024-01-13T18:09:27.677 INFO:tasks.rados.rados.0.smithi084.stdout:2616: done (1 left) 2024-01-13T18:09:27.677 INFO:tasks.rados.rados.0.smithi084.stdout:2617: done (0 left) 2024-01-13T18:09:27.677 INFO:tasks.rados.rados.0.smithi084.stdout:2618: read oid 2 snap -1 2024-01-13T18:09:27.677 INFO:tasks.rados.rados.0.smithi084.stdout:2618: expect (ObjNum 756 snap 237 seq_num 756) 2024-01-13T18:09:27.677 INFO:tasks.rados.rados.0.smithi084.stdout:2619: snap_create 2024-01-13T18:09:27.685 INFO:tasks.rados.rados.0.smithi084.stdout:2618: expect (ObjNum 756 snap 237 seq_num 756) 2024-01-13T18:09:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:27 smithi099 ceph-mon[138788]: osdmap e585: 8 total, 8 up, 8 in 2024-01-13T18:09:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:27 smithi099 ceph-mon[138788]: osdmap e586: 8 total, 8 up, 8 in 2024-01-13T18:09:28.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:27 smithi084 ceph-mon[116404]: osdmap e585: 8 total, 8 up, 8 in 2024-01-13T18:09:28.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:27 smithi084 ceph-mon[116404]: osdmap e586: 8 total, 8 up, 8 in 2024-01-13T18:09:28.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:27 smithi084 ceph-mon[119097]: osdmap e585: 8 total, 8 up, 8 in 2024-01-13T18:09:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:27 smithi084 ceph-mon[119097]: osdmap e586: 8 total, 8 up, 8 in 2024-01-13T18:09:28.684 INFO:tasks.rados.rados.0.smithi084.stdout:2618: done (1 left) 2024-01-13T18:09:28.684 INFO:tasks.rados.rados.0.smithi084.stdout:2619: done (0 left) 2024-01-13T18:09:28.685 INFO:tasks.rados.rados.0.smithi084.stdout:2620: snap_create 2024-01-13T18:09:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:28 smithi099 ceph-mon[138788]: pgmap v591: 121 pgs: 121 active+clean; 194 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 1.8 MiB/s wr, 23 op/s 2024-01-13T18:09:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:28 smithi099 ceph-mon[138788]: osdmap e587: 8 total, 8 up, 8 in 2024-01-13T18:09:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:28 smithi084 ceph-mon[116404]: pgmap v591: 121 pgs: 121 active+clean; 194 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 1.8 MiB/s wr, 23 op/s 2024-01-13T18:09:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:28 smithi084 ceph-mon[116404]: osdmap e587: 8 total, 8 up, 8 in 2024-01-13T18:09:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:28 smithi084 ceph-mon[119097]: pgmap v591: 121 pgs: 121 active+clean; 194 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 1.8 MiB/s wr, 23 op/s 2024-01-13T18:09:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:28 smithi084 ceph-mon[119097]: osdmap e587: 8 total, 8 up, 8 in 2024-01-13T18:09:29.685 INFO:tasks.rados.rados.0.smithi084.stdout:2620: done (0 left) 2024-01-13T18:09:29.685 INFO:tasks.rados.rados.0.smithi084.stdout:2621: copy_from oid 41 from oid 34 current snap is 266 2024-01-13T18:09:29.685 INFO:tasks.rados.rados.0.smithi084.stdout:2622: read oid 14 snap 261 2024-01-13T18:09:29.685 INFO:tasks.rados.rados.0.smithi084.stdout:2622: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:09:29.685 INFO:tasks.rados.rados.0.smithi084.stdout:2623: snap_remove snap 263 2024-01-13T18:09:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:09:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:09:30] "GET /metrics HTTP/1.1" 200 36194 "" "Prometheus/2.43.0" 2024-01-13T18:09:30.693 INFO:tasks.rados.rados.0.smithi084.stdout:2623: done (2 left) 2024-01-13T18:09:30.693 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 266 2024-01-13T18:09:30.693 INFO:tasks.rados.rados.0.smithi084.stdout:2624: seq_num 812 ranges {335872=802816,1138688=548864,1687552=253952} 2024-01-13T18:09:30.700 INFO:tasks.rados.rados.0.smithi084.stdout:2624: writing smithi084102331-13 from 335872 to 1138688 tid 1 2024-01-13T18:09:30.703 INFO:tasks.rados.rados.0.smithi084.stdout:2624: writing smithi084102331-13 from 1138688 to 1687552 tid 2 2024-01-13T18:09:30.705 INFO:tasks.rados.rados.0.smithi084.stdout:2624: writing smithi084102331-13 from 1687552 to 1941504 tid 3 2024-01-13T18:09:30.705 INFO:tasks.rados.rados.0.smithi084.stdout:2625: delete oid 38 current snap is 266 2024-01-13T18:09:30.705 INFO:tasks.rados.rados.0.smithi084.stdout:2622: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:09:31.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:30 smithi099 ceph-mon[138788]: osdmap e588: 8 total, 8 up, 8 in 2024-01-13T18:09:31.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:30 smithi099 ceph-mon[138788]: pgmap v594: 121 pgs: 121 active+clean; 196 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.0 MiB/s wr, 21 op/s 2024-01-13T18:09:31.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:30 smithi084 ceph-mon[116404]: osdmap e588: 8 total, 8 up, 8 in 2024-01-13T18:09:31.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:30 smithi084 ceph-mon[116404]: pgmap v594: 121 pgs: 121 active+clean; 196 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.0 MiB/s wr, 21 op/s 2024-01-13T18:09:31.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:30 smithi084 ceph-mon[119097]: osdmap e588: 8 total, 8 up, 8 in 2024-01-13T18:09:31.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:30 smithi084 ceph-mon[119097]: pgmap v594: 121 pgs: 121 active+clean; 196 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.0 MiB/s wr, 21 op/s 2024-01-13T18:09:31.263 INFO:tasks.rados.rados.0.smithi084.stdout:2621: finishing copy_from to smithi084102331-41 2024-01-13T18:09:31.263 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1104 (ObjNum 805 snap 262 seq_num 805) dirty exists 2024-01-13T18:09:31.263 INFO:tasks.rados.rados.0.smithi084.stdout:2621: finishing copy_from racing read to smithi084102331-41 2024-01-13T18:09:31.263 INFO:tasks.rados.rados.0.smithi084.stdout:2624: finishing write tid 1 to smithi084102331-13 2024-01-13T18:09:31.263 INFO:tasks.rados.rados.0.smithi084.stdout:2624: finishing write tid 2 to smithi084102331-13 2024-01-13T18:09:31.263 INFO:tasks.rados.rados.0.smithi084.stdout:2624: finishing write tid 3 to smithi084102331-13 2024-01-13T18:09:31.263 INFO:tasks.rados.rados.0.smithi084.stdout:2624: finishing write tid 4 to smithi084102331-13 2024-01-13T18:09:31.263 INFO:tasks.rados.rados.0.smithi084.stdout:2624: finishing write tid 5 to smithi084102331-13 2024-01-13T18:09:31.263 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 1221 (ObjNum 812 snap 266 seq_num 812) dirty exists 2024-01-13T18:09:31.263 INFO:tasks.rados.rados.0.smithi084.stdout:2624: left oid 13 (ObjNum 812 snap 266 seq_num 812) 2024-01-13T18:09:31.263 INFO:tasks.rados.rados.0.smithi084.stdout:2621: done (3 left) 2024-01-13T18:09:31.264 INFO:tasks.rados.rados.0.smithi084.stdout:2622: done (2 left) 2024-01-13T18:09:31.264 INFO:tasks.rados.rados.0.smithi084.stdout:2624: done (1 left) 2024-01-13T18:09:31.264 INFO:tasks.rados.rados.0.smithi084.stdout:2625: done (0 left) 2024-01-13T18:09:31.264 INFO:tasks.rados.rados.0.smithi084.stdout:2626: snap_remove snap 247 2024-01-13T18:09:31.700 INFO:tasks.rados.rados.0.smithi084.stdout:2626: done (0 left) 2024-01-13T18:09:31.700 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 266 2024-01-13T18:09:31.700 INFO:tasks.rados.rados.0.smithi084.stdout:2627: seq_num 814 ranges {581632=442368,1024000=770048,1794048=434176} 2024-01-13T18:09:31.706 INFO:tasks.rados.rados.0.smithi084.stdout:2627: writing smithi084102331-32 from 581632 to 1024000 tid 1 2024-01-13T18:09:31.711 INFO:tasks.rados.rados.0.smithi084.stdout:2627: writing smithi084102331-32 from 1024000 to 1794048 tid 2 2024-01-13T18:09:31.714 INFO:tasks.rados.rados.0.smithi084.stdout:2627: writing smithi084102331-32 from 1794048 to 2228224 tid 3 2024-01-13T18:09:31.714 INFO:tasks.rados.rados.0.smithi084.stdout:2628: snap_remove snap 238 2024-01-13T18:09:32.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:31 smithi099 ceph-mon[138788]: osdmap e589: 8 total, 8 up, 8 in 2024-01-13T18:09:32.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:31 smithi084 ceph-mon[116404]: osdmap e589: 8 total, 8 up, 8 in 2024-01-13T18:09:32.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:31 smithi084 ceph-mon[119097]: osdmap e589: 8 total, 8 up, 8 in 2024-01-13T18:09:32.680 INFO:tasks.rados.rados.0.smithi084.stdout:2628: done (1 left) 2024-01-13T18:09:32.680 INFO:tasks.rados.rados.0.smithi084.stdout:2629: copy_from oid 8 from oid 42 current snap is 266 2024-01-13T18:09:32.680 INFO:tasks.rados.rados.0.smithi084.stdout:2630: read oid 9 snap 259 2024-01-13T18:09:32.680 INFO:tasks.rados.rados.0.smithi084.stdout:2630: expect (ObjNum 798 snap 258 seq_num 798) 2024-01-13T18:09:32.680 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 266 2024-01-13T18:09:32.680 INFO:tasks.rados.rados.0.smithi084.stdout:2631: seq_num 815 ranges {1269760=458752,1728512=655360,2383872=409600,2793472=139264} 2024-01-13T18:09:32.696 INFO:tasks.rados.rados.0.smithi084.stdout:2631: writing smithi084102331-3 from 1269760 to 1728512 tid 1 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:2631: writing smithi084102331-3 from 1728512 to 2383872 tid 2 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:2631: writing smithi084102331-3 from 2383872 to 2793472 tid 3 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:2631: writing smithi084102331-3 from 2793472 to 2932736 tid 4 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:2632: rollback oid 48 current snap is 266 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 48 to 264 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:2627: finishing write tid 1 to smithi084102331-32 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:2627: finishing write tid 2 to smithi084102331-32 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:2627: finishing write tid 3 to smithi084102331-32 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:2627: finishing write tid 4 to smithi084102331-32 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:2627: finishing write tid 5 to smithi084102331-32 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1263 (ObjNum 814 snap 266 seq_num 814) dirty exists 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:2627: left oid 32 (ObjNum 814 snap 266 seq_num 814) 2024-01-13T18:09:32.697 INFO:tasks.rados.rados.0.smithi084.stdout:2627: done (4 left) 2024-01-13T18:09:32.698 INFO:tasks.rados.rados.0.smithi084.stdout:2633: copy_from oid 2 from oid 35 current snap is 266 2024-01-13T18:09:32.698 INFO:tasks.rados.rados.0.smithi084.stdout:2634: read oid 41 snap -1 2024-01-13T18:09:32.698 INFO:tasks.rados.rados.0.smithi084.stdout:2634: expect (ObjNum 805 snap 262 seq_num 805) 2024-01-13T18:09:32.698 INFO:tasks.rados.rados.0.smithi084.stdout:2635: delete oid 25 current snap is 266 2024-01-13T18:09:32.706 INFO:tasks.rados.rados.0.smithi084.stdout:2632: finishing rollback tid 0 to smithi084102331-48 2024-01-13T18:09:32.709 INFO:tasks.rados.rados.0.smithi084.stdout:2635: done (6 left) 2024-01-13T18:09:32.709 INFO:tasks.rados.rados.0.smithi084.stdout:2636: copy_from oid 26 from oid 46 current snap is 266 2024-01-13T18:09:32.709 INFO:tasks.rados.rados.0.smithi084.stdout:2637: read oid 34 snap -1 2024-01-13T18:09:32.709 INFO:tasks.rados.rados.0.smithi084.stdout:2637: expect (ObjNum 805 snap 262 seq_num 805) 2024-01-13T18:09:32.709 INFO:tasks.rados.rados.0.smithi084.stdout:2638: snap_remove snap 249 2024-01-13T18:09:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:32 smithi099 ceph-mon[138788]: osdmap e590: 8 total, 8 up, 8 in 2024-01-13T18:09:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:32 smithi099 ceph-mon[138788]: pgmap v597: 121 pgs: 121 active+clean; 199 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 493 KiB/s rd, 1.1 MiB/s wr, 4 op/s 2024-01-13T18:09:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:32 smithi099 ceph-mon[138788]: osdmap e591: 8 total, 8 up, 8 in 2024-01-13T18:09:33.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:32 smithi084 ceph-mon[116404]: osdmap e590: 8 total, 8 up, 8 in 2024-01-13T18:09:33.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:32 smithi084 ceph-mon[116404]: pgmap v597: 121 pgs: 121 active+clean; 199 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 493 KiB/s rd, 1.1 MiB/s wr, 4 op/s 2024-01-13T18:09:33.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:32 smithi084 ceph-mon[116404]: osdmap e591: 8 total, 8 up, 8 in 2024-01-13T18:09:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:32 smithi084 ceph-mon[119097]: osdmap e590: 8 total, 8 up, 8 in 2024-01-13T18:09:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:32 smithi084 ceph-mon[119097]: pgmap v597: 121 pgs: 121 active+clean; 199 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 493 KiB/s rd, 1.1 MiB/s wr, 4 op/s 2024-01-13T18:09:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:32 smithi084 ceph-mon[119097]: osdmap e591: 8 total, 8 up, 8 in 2024-01-13T18:09:33.708 INFO:tasks.rados.rados.0.smithi084.stdout:2638: done (8 left) 2024-01-13T18:09:33.708 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 266 2024-01-13T18:09:33.708 INFO:tasks.rados.rados.0.smithi084.stdout:2632: finishing rollback tid 1 to smithi084102331-48 2024-01-13T18:09:33.708 INFO:tasks.rados.rados.0.smithi084.stdout:2632: finishing rollback tid 2 to smithi084102331-48 2024-01-13T18:09:33.708 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1349 (ObjNum 786 snap 254 seq_num 786) dirty exists 2024-01-13T18:09:33.708 INFO:tasks.rados.rados.0.smithi084.stdout:2629: finishing copy_from to smithi084102331-8 2024-01-13T18:09:33.708 INFO:tasks.rados.rados.0.smithi084.stdout:2629: got expected ENOENT (src dne) 2024-01-13T18:09:33.708 INFO:tasks.rados.rados.0.smithi084.stdout:2630: expect (ObjNum 798 snap 258 seq_num 798) 2024-01-13T18:09:33.801 INFO:tasks.rados.rados.0.smithi084.stdout:2636: finishing copy_from to smithi084102331-26 2024-01-13T18:09:33.801 INFO:tasks.rados.rados.0.smithi084.stdout:2636: got expected ENOENT (src dne) 2024-01-13T18:09:33.801 INFO:tasks.rados.rados.0.smithi084.stdout:2636: finishing copy_from racing read to smithi084102331-26 2024-01-13T18:09:33.801 INFO:tasks.rados.rados.0.smithi084.stdout:2629: finishing copy_from racing read to smithi084102331-8 2024-01-13T18:09:33.801 INFO:tasks.rados.rados.0.smithi084.stdout:2637: expect (ObjNum 805 snap 262 seq_num 805) 2024-01-13T18:09:33.911 INFO:tasks.rados.rados.0.smithi084.stdout:2634: expect (ObjNum 805 snap 262 seq_num 805) 2024-01-13T18:09:34.019 INFO:tasks.rados.rados.0.smithi084.stdout:2631: finishing write tid 1 to smithi084102331-3 2024-01-13T18:09:34.019 INFO:tasks.rados.rados.0.smithi084.stdout:2631: finishing write tid 2 to smithi084102331-3 2024-01-13T18:09:34.020 INFO:tasks.rados.rados.0.smithi084.stdout:2631: finishing write tid 3 to smithi084102331-3 2024-01-13T18:09:34.020 INFO:tasks.rados.rados.0.smithi084.stdout:2631: finishing write tid 4 to smithi084102331-3 2024-01-13T18:09:34.020 INFO:tasks.rados.rados.0.smithi084.stdout:2631: finishing write tid 5 to smithi084102331-3 2024-01-13T18:09:34.020 INFO:tasks.rados.rados.0.smithi084.stdout:2631: finishing write tid 6 to smithi084102331-3 2024-01-13T18:09:34.020 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1389 (ObjNum 815 snap 266 seq_num 815) dirty exists 2024-01-13T18:09:34.020 INFO:tasks.rados.rados.0.smithi084.stdout:2631: left oid 3 (ObjNum 815 snap 266 seq_num 815) 2024-01-13T18:09:34.020 INFO:tasks.rados.rados.0.smithi084.stdout:2633: finishing copy_from to smithi084102331-2 2024-01-13T18:09:34.020 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 972 (ObjNum 811 snap 263 seq_num 811) dirty exists 2024-01-13T18:09:34.020 INFO:tasks.rados.rados.0.smithi084.stdout:2633: finishing copy_from racing read to smithi084102331-2 2024-01-13T18:09:34.020 INFO:tasks.rados.rados.0.smithi084.stdout:2639: seq_num 817 ranges {671744=491520,1163264=417792,1581056=425984,2007040=360448} 2024-01-13T18:09:34.025 INFO:tasks.rados.rados.0.smithi084.stdout:2639: writing smithi084102331-23 from 671744 to 1163264 tid 1 2024-01-13T18:09:34.028 INFO:tasks.rados.rados.0.smithi084.stdout:2639: writing smithi084102331-23 from 1163264 to 1581056 tid 2 2024-01-13T18:09:34.030 INFO:tasks.rados.rados.0.smithi084.stdout:2639: writing smithi084102331-23 from 1581056 to 2007040 tid 3 2024-01-13T18:09:34.032 INFO:tasks.rados.rados.0.smithi084.stdout:2639: writing smithi084102331-23 from 2007040 to 2367488 tid 4 2024-01-13T18:09:34.032 INFO:tasks.rados.rados.0.smithi084.stdout:2629: done (8 left) 2024-01-13T18:09:34.032 INFO:tasks.rados.rados.0.smithi084.stdout:2630: done (7 left) 2024-01-13T18:09:34.032 INFO:tasks.rados.rados.0.smithi084.stdout:2631: done (6 left) 2024-01-13T18:09:34.032 INFO:tasks.rados.rados.0.smithi084.stdout:2632: done (5 left) 2024-01-13T18:09:34.033 INFO:tasks.rados.rados.0.smithi084.stdout:2633: done (4 left) 2024-01-13T18:09:34.033 INFO:tasks.rados.rados.0.smithi084.stdout:2634: done (3 left) 2024-01-13T18:09:34.033 INFO:tasks.rados.rados.0.smithi084.stdout:2636: done (2 left) 2024-01-13T18:09:34.033 INFO:tasks.rados.rados.0.smithi084.stdout:2637: done (1 left) 2024-01-13T18:09:34.033 INFO:tasks.rados.rados.0.smithi084.stdout:2640: snap_remove snap 258 2024-01-13T18:09:34.714 INFO:tasks.rados.rados.0.smithi084.stdout:2640: done (1 left) 2024-01-13T18:09:34.714 INFO:tasks.rados.rados.0.smithi084.stdout:2641: snap_remove snap 264 2024-01-13T18:09:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:34 smithi099 ceph-mon[138788]: osdmap e592: 8 total, 8 up, 8 in 2024-01-13T18:09:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:34 smithi099 ceph-mon[138788]: pgmap v600: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 493 KiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:09:35.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:34 smithi084 ceph-mon[116404]: osdmap e592: 8 total, 8 up, 8 in 2024-01-13T18:09:35.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:34 smithi084 ceph-mon[116404]: pgmap v600: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 493 KiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:09:35.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:34 smithi084 ceph-mon[119097]: osdmap e592: 8 total, 8 up, 8 in 2024-01-13T18:09:35.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:34 smithi084 ceph-mon[119097]: pgmap v600: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 493 KiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:09:35.719 INFO:tasks.rados.rados.0.smithi084.stdout:2641: done (1 left) 2024-01-13T18:09:35.719 INFO:tasks.rados.rados.0.smithi084.stdout:2642: read oid 1 snap 242 2024-01-13T18:09:35.719 INFO:tasks.rados.rados.0.smithi084.stdout:2642: expect (ObjNum 677 snap 214 seq_num 677) 2024-01-13T18:09:35.719 INFO:tasks.rados.rados.0.smithi084.stdout:2643: rmattr oid 19 current snap is 266 2024-01-13T18:09:35.719 INFO:tasks.rados.rados.0.smithi084.stdout:2643: done (2 left) 2024-01-13T18:09:35.719 INFO:tasks.rados.rados.0.smithi084.stdout:2644: read oid 37 snap -1 2024-01-13T18:09:35.720 INFO:tasks.rados.rados.0.smithi084.stdout:2644: expect (ObjNum 806 snap 262 seq_num 806) 2024-01-13T18:09:35.720 INFO:tasks.rados.rados.0.smithi084.stdout:2645: delete oid 46 current snap is 266 2024-01-13T18:09:35.720 INFO:tasks.rados.rados.0.smithi084.stdout:2639: finishing write tid 1 to smithi084102331-23 2024-01-13T18:09:35.720 INFO:tasks.rados.rados.0.smithi084.stdout:2639: finishing write tid 2 to smithi084102331-23 2024-01-13T18:09:35.720 INFO:tasks.rados.rados.0.smithi084.stdout:2639: finishing write tid 3 to smithi084102331-23 2024-01-13T18:09:35.720 INFO:tasks.rados.rados.0.smithi084.stdout:2639: finishing write tid 4 to smithi084102331-23 2024-01-13T18:09:35.720 INFO:tasks.rados.rados.0.smithi084.stdout:2639: finishing write tid 5 to smithi084102331-23 2024-01-13T18:09:35.720 INFO:tasks.rados.rados.0.smithi084.stdout:2639: finishing write tid 6 to smithi084102331-23 2024-01-13T18:09:35.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1365 (ObjNum 817 snap 266 seq_num 817) dirty exists 2024-01-13T18:09:35.720 INFO:tasks.rados.rados.0.smithi084.stdout:2639: left oid 23 (ObjNum 817 snap 266 seq_num 817) 2024-01-13T18:09:35.726 INFO:tasks.rados.rados.0.smithi084.stdout:2639: done (3 left) 2024-01-13T18:09:35.726 INFO:tasks.rados.rados.0.smithi084.stdout:2645: done (2 left) 2024-01-13T18:09:35.727 INFO:tasks.rados.rados.0.smithi084.stdout:2646: snap_create 2024-01-13T18:09:35.727 INFO:tasks.rados.rados.0.smithi084.stdout:2642: expect (ObjNum 677 snap 214 seq_num 677) 2024-01-13T18:09:35.770 INFO:tasks.rados.rados.0.smithi084.stdout:2644: expect (ObjNum 806 snap 262 seq_num 806) 2024-01-13T18:09:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:35 smithi099 ceph-mon[138788]: osdmap e593: 8 total, 8 up, 8 in 2024-01-13T18:09:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:36.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:35 smithi084 ceph-mon[116404]: osdmap e593: 8 total, 8 up, 8 in 2024-01-13T18:09:36.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:35 smithi084 ceph-mon[119097]: osdmap e593: 8 total, 8 up, 8 in 2024-01-13T18:09:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:36.732 INFO:tasks.rados.rados.0.smithi084.stdout:2642: done (2 left) 2024-01-13T18:09:36.732 INFO:tasks.rados.rados.0.smithi084.stdout:2644: done (1 left) 2024-01-13T18:09:36.732 INFO:tasks.rados.rados.0.smithi084.stdout:2646: done (0 left) 2024-01-13T18:09:36.732 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 267 2024-01-13T18:09:36.732 INFO:tasks.rados.rados.0.smithi084.stdout:2647: seq_num 819 ranges {3571712=524288,4096000=589824,4685824=614400} 2024-01-13T18:09:36.753 INFO:tasks.rados.rados.0.smithi084.stdout:2647: writing smithi084102331-48 from 3571712 to 4096000 tid 1 2024-01-13T18:09:36.757 INFO:tasks.rados.rados.0.smithi084.stdout:2647: writing smithi084102331-48 from 4096000 to 4685824 tid 2 2024-01-13T18:09:36.760 INFO:tasks.rados.rados.0.smithi084.stdout:2647: writing smithi084102331-48 from 4685824 to 5300224 tid 3 2024-01-13T18:09:36.760 INFO:tasks.rados.rados.0.smithi084.stdout:2648: delete oid 9 current snap is 267 2024-01-13T18:09:36.762 INFO:tasks.rados.rados.0.smithi084.stdout:2647: finishing write tid 1 to smithi084102331-48 2024-01-13T18:09:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:2648: done (1 left) 2024-01-13T18:09:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:2649: read oid 25 snap -1 2024-01-13T18:09:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:2649: expect deleted 2024-01-13T18:09:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:2650: read oid 18 snap -1 2024-01-13T18:09:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:2650: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:09:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:2651: snap_remove snap 259 2024-01-13T18:09:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:36 smithi099 ceph-mon[138788]: osdmap e594: 8 total, 8 up, 8 in 2024-01-13T18:09:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:36 smithi099 ceph-mon[138788]: pgmap v603: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.2 MiB/s wr, 3 op/s 2024-01-13T18:09:37.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:36 smithi084 ceph-mon[116404]: osdmap e594: 8 total, 8 up, 8 in 2024-01-13T18:09:37.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:36 smithi084 ceph-mon[116404]: pgmap v603: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.2 MiB/s wr, 3 op/s 2024-01-13T18:09:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:36 smithi084 ceph-mon[119097]: osdmap e594: 8 total, 8 up, 8 in 2024-01-13T18:09:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:36 smithi084 ceph-mon[119097]: pgmap v603: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.2 MiB/s wr, 3 op/s 2024-01-13T18:09:37.681 INFO:tasks.rados.rados.0.smithi084.stdout:2651: done (3 left) 2024-01-13T18:09:37.682 INFO:tasks.rados.rados.0.smithi084.stdout:2652: snap_remove snap 262 2024-01-13T18:09:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:37 smithi099 ceph-mon[138788]: osdmap e595: 8 total, 8 up, 8 in 2024-01-13T18:09:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:37 smithi099 ceph-mon[138788]: osdmap e596: 8 total, 8 up, 8 in 2024-01-13T18:09:38.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:37 smithi084 ceph-mon[116404]: osdmap e595: 8 total, 8 up, 8 in 2024-01-13T18:09:38.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:37 smithi084 ceph-mon[116404]: osdmap e596: 8 total, 8 up, 8 in 2024-01-13T18:09:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:37 smithi084 ceph-mon[119097]: osdmap e595: 8 total, 8 up, 8 in 2024-01-13T18:09:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:37 smithi084 ceph-mon[119097]: osdmap e596: 8 total, 8 up, 8 in 2024-01-13T18:09:38.688 INFO:tasks.rados.rados.0.smithi084.stdout:2652: done (3 left) 2024-01-13T18:09:38.688 INFO:tasks.rados.rados.0.smithi084.stdout:2653: copy_from oid 49 from oid 29 current snap is 267 2024-01-13T18:09:38.691 INFO:tasks.rados.rados.0.smithi084.stdout:2647: finishing write tid 2 to smithi084102331-48 2024-01-13T18:09:38.692 INFO:tasks.rados.rados.0.smithi084.stdout:2647: finishing write tid 3 to smithi084102331-48 2024-01-13T18:09:38.692 INFO:tasks.rados.rados.0.smithi084.stdout:2647: finishing write tid 4 to smithi084102331-48 2024-01-13T18:09:38.692 INFO:tasks.rados.rados.0.smithi084.stdout:2647: finishing write tid 5 to smithi084102331-48 2024-01-13T18:09:38.692 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1382 (ObjNum 819 snap 267 seq_num 819) dirty exists 2024-01-13T18:09:38.692 INFO:tasks.rados.rados.0.smithi084.stdout:2647: left oid 48 (ObjNum 819 snap 267 seq_num 819) 2024-01-13T18:09:38.692 INFO:tasks.rados.rados.0.smithi084.stdout:2650: expect (ObjNum 639 snap 199 seq_num 639) 2024-01-13T18:09:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:38 smithi099 ceph-mon[138788]: pgmap v606: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 211 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-01-13T18:09:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:38 smithi099 ceph-mon[138788]: osdmap e597: 8 total, 8 up, 8 in 2024-01-13T18:09:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:38 smithi084 ceph-mon[116404]: pgmap v606: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 211 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-01-13T18:09:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:38 smithi084 ceph-mon[116404]: osdmap e597: 8 total, 8 up, 8 in 2024-01-13T18:09:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:38 smithi084 ceph-mon[119097]: pgmap v606: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 211 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-01-13T18:09:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:38 smithi084 ceph-mon[119097]: osdmap e597: 8 total, 8 up, 8 in 2024-01-13T18:09:39.248 INFO:tasks.rados.rados.0.smithi084.stdout:2653: finishing copy_from to smithi084102331-49 2024-01-13T18:09:39.248 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 947 (ObjNum 737 snap 0 seq_num 2816904349) dirty exists 2024-01-13T18:09:39.248 INFO:tasks.rados.rados.0.smithi084.stdout:2653: finishing copy_from racing read to smithi084102331-49 2024-01-13T18:09:39.248 INFO:tasks.rados.rados.0.smithi084.stdout:2647: done (3 left) 2024-01-13T18:09:39.248 INFO:tasks.rados.rados.0.smithi084.stdout:2649: done (2 left) 2024-01-13T18:09:39.248 INFO:tasks.rados.rados.0.smithi084.stdout:2650: done (1 left) 2024-01-13T18:09:39.248 INFO:tasks.rados.rados.0.smithi084.stdout:2653: done (0 left) 2024-01-13T18:09:39.248 INFO:tasks.rados.rados.0.smithi084.stdout:2654: rollback oid 40 current snap is 267 2024-01-13T18:09:39.248 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 257 2024-01-13T18:09:39.249 INFO:tasks.rados.rados.0.smithi084.stdout:2655: delete oid 23 current snap is 267 2024-01-13T18:09:39.250 INFO:tasks.rados.rados.0.smithi084.stdout:2654: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:09:39.250 INFO:tasks.rados.rados.0.smithi084.stdout:2654: finishing rollback tid 2 to smithi084102331-40 2024-01-13T18:09:39.250 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 990 (ObjNum 783 snap 254 seq_num 783) dirty exists 2024-01-13T18:09:39.250 INFO:tasks.rados.rados.0.smithi084.stdout:2654: done (1 left) 2024-01-13T18:09:39.250 INFO:tasks.rados.rados.0.smithi084.stdout:2655: done (0 left) 2024-01-13T18:09:39.251 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 267 2024-01-13T18:09:39.251 INFO:tasks.rados.rados.0.smithi084.stdout:2656: seq_num 822 ranges {0=573440,573440=696320,1269760=507904} 2024-01-13T18:09:39.253 INFO:tasks.rados.rados.0.smithi084.stdout:2656: writing smithi084102331-46 from 0 to 573440 tid 1 2024-01-13T18:09:39.257 INFO:tasks.rados.rados.0.smithi084.stdout:2656: writing smithi084102331-46 from 573440 to 1269760 tid 2 2024-01-13T18:09:39.260 INFO:tasks.rados.rados.0.smithi084.stdout:2656: writing smithi084102331-46 from 1269760 to 1777664 tid 3 2024-01-13T18:09:39.260 INFO:tasks.rados.rados.0.smithi084.stdout:2657: setattr oid 11 current snap is 267 2024-01-13T18:09:39.260 INFO:tasks.rados.rados.0.smithi084.stdout:2656: finishing write tid 1 to smithi084102331-46 2024-01-13T18:09:39.261 INFO:tasks.rados.rados.0.smithi084.stdout:2656: finishing write tid 2 to smithi084102331-46 2024-01-13T18:09:39.262 INFO:tasks.rados.rados.0.smithi084.stdout:2658: read oid 33 snap -1 2024-01-13T18:09:39.262 INFO:tasks.rados.rados.0.smithi084.stdout:2658: expect deleted 2024-01-13T18:09:39.262 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 267 2024-01-13T18:09:39.262 INFO:tasks.rados.rados.0.smithi084.stdout:2659: seq_num 823 ranges {7036928=589824,7626752=573440,8200192=630784} 2024-01-13T18:09:39.302 INFO:tasks.rados.rados.0.smithi084.stdout:2659: writing smithi084102331-18 from 7036928 to 7626752 tid 1 2024-01-13T18:09:39.305 INFO:tasks.rados.rados.0.smithi084.stdout:2659: writing smithi084102331-18 from 7626752 to 8200192 tid 2 2024-01-13T18:09:39.309 INFO:tasks.rados.rados.0.smithi084.stdout:2659: writing smithi084102331-18 from 8200192 to 8830976 tid 3 2024-01-13T18:09:39.309 INFO:tasks.rados.rados.0.smithi084.stdout:2660: setattr oid 36 current snap is 267 2024-01-13T18:09:39.310 INFO:tasks.rados.rados.0.smithi084.stdout:2656: finishing write tid 3 to smithi084102331-46 2024-01-13T18:09:39.310 INFO:tasks.rados.rados.0.smithi084.stdout:2656: finishing write tid 4 to smithi084102331-46 2024-01-13T18:09:39.310 INFO:tasks.rados.rados.0.smithi084.stdout:2656: finishing write tid 5 to smithi084102331-46 2024-01-13T18:09:39.310 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1245 (ObjNum 822 snap 267 seq_num 822) dirty exists 2024-01-13T18:09:39.310 INFO:tasks.rados.rados.0.smithi084.stdout:2656: left oid 46 (ObjNum 822 snap 267 seq_num 822) 2024-01-13T18:09:39.310 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1246 (ObjNum 702 snap 220 seq_num 702) dirty exists 2024-01-13T18:09:39.310 INFO:tasks.rados.rados.0.smithi084.stdout:2659: finishing write tid 1 to smithi084102331-18 2024-01-13T18:09:39.310 INFO:tasks.rados.rados.0.smithi084.stdout:2659: finishing write tid 2 to smithi084102331-18 2024-01-13T18:09:39.312 INFO:tasks.rados.rados.0.smithi084.stdout:2659: finishing write tid 3 to smithi084102331-18 2024-01-13T18:09:39.313 INFO:tasks.rados.rados.0.smithi084.stdout:2656: done (4 left) 2024-01-13T18:09:39.313 INFO:tasks.rados.rados.0.smithi084.stdout:2657: done (3 left) 2024-01-13T18:09:39.313 INFO:tasks.rados.rados.0.smithi084.stdout:2658: done (2 left) 2024-01-13T18:09:39.313 INFO:tasks.rados.rados.0.smithi084.stdout:2661: read oid 47 snap 236 2024-01-13T18:09:39.313 INFO:tasks.rados.rados.0.smithi084.stdout:2661: expect deleted 2024-01-13T18:09:39.313 INFO:tasks.rados.rados.0.smithi084.stdout:2662: rmattr oid 38 current snap is 267 2024-01-13T18:09:39.313 INFO:tasks.rados.rados.0.smithi084.stdout:2662: done (3 left) 2024-01-13T18:09:39.313 INFO:tasks.rados.rados.0.smithi084.stdout:2663: copy_from oid 23 from oid 49 current snap is 267 2024-01-13T18:09:39.313 INFO:tasks.rados.rados.0.smithi084.stdout:2659: finishing write tid 4 to smithi084102331-18 2024-01-13T18:09:39.313 INFO:tasks.rados.rados.0.smithi084.stdout:2664: delete oid 17 current snap is 267 2024-01-13T18:09:39.314 INFO:tasks.rados.rados.0.smithi084.stdout:2659: finishing write tid 5 to smithi084102331-18 2024-01-13T18:09:39.314 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1108 (ObjNum 823 snap 267 seq_num 823) dirty exists 2024-01-13T18:09:39.314 INFO:tasks.rados.rados.0.smithi084.stdout:2659: left oid 18 (ObjNum 823 snap 267 seq_num 823) 2024-01-13T18:09:39.314 INFO:tasks.rados.rados.0.smithi084.stdout:2659: done (4 left) 2024-01-13T18:09:39.315 INFO:tasks.rados.rados.0.smithi084.stdout:2661: done (3 left) 2024-01-13T18:09:39.315 INFO:tasks.rados.rados.0.smithi084.stdout:2664: done (2 left) 2024-01-13T18:09:39.315 INFO:tasks.rados.rados.0.smithi084.stdout:2665: setattr oid 25 current snap is 267 2024-01-13T18:09:39.315 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1112 (ObjNum 534 snap 171 seq_num 534) dirty exists 2024-01-13T18:09:39.316 INFO:tasks.rados.rados.0.smithi084.stdout:2660: done (2 left) 2024-01-13T18:09:39.316 INFO:tasks.rados.rados.0.smithi084.stdout:2666: read oid 16 snap -1 2024-01-13T18:09:39.316 INFO:tasks.rados.rados.0.smithi084.stdout:2666: expect (ObjNum 800 snap 258 seq_num 800) 2024-01-13T18:09:39.316 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 267 2024-01-13T18:09:39.316 INFO:tasks.rados.rados.0.smithi084.stdout:2667: seq_num 825 ranges {2252800=622592,2875392=745472,3620864=458752} 2024-01-13T18:09:39.332 INFO:tasks.rados.rados.0.smithi084.stdout:2667: writing smithi084102331-6 from 2252800 to 2875392 tid 1 2024-01-13T18:09:39.337 INFO:tasks.rados.rados.0.smithi084.stdout:2667: writing smithi084102331-6 from 2875392 to 3620864 tid 2 2024-01-13T18:09:39.340 INFO:tasks.rados.rados.0.smithi084.stdout:2667: writing smithi084102331-6 from 3620864 to 4079616 tid 3 2024-01-13T18:09:39.340 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 267 2024-01-13T18:09:39.340 INFO:tasks.rados.rados.0.smithi084.stdout:2668: seq_num 826 ranges {0=638976,638976=630784,1269760=573440} 2024-01-13T18:09:39.344 INFO:tasks.rados.rados.0.smithi084.stdout:2668: writing smithi084102331-30 from 0 to 638976 tid 1 2024-01-13T18:09:39.348 INFO:tasks.rados.rados.0.smithi084.stdout:2668: writing smithi084102331-30 from 638976 to 1269760 tid 2 2024-01-13T18:09:39.351 INFO:tasks.rados.rados.0.smithi084.stdout:2668: writing smithi084102331-30 from 1269760 to 1843200 tid 3 2024-01-13T18:09:39.351 INFO:tasks.rados.rados.0.smithi084.stdout:2669: snap_create 2024-01-13T18:09:39.352 INFO:tasks.rados.rados.0.smithi084.stdout:2663: finishing copy_from to smithi084102331-23 2024-01-13T18:09:39.352 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 947 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-01-13T18:09:39.352 INFO:tasks.rados.rados.0.smithi084.stdout:2663: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:09:39.352 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1317 (ObjNum 33 snap 0 seq_num 4037824144) dirty exists 2024-01-13T18:09:39.352 INFO:tasks.rados.rados.0.smithi084.stdout:2667: finishing write tid 1 to smithi084102331-6 2024-01-13T18:09:39.352 INFO:tasks.rados.rados.0.smithi084.stdout:2666: expect (ObjNum 800 snap 258 seq_num 800) 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:2667: finishing write tid 2 to smithi084102331-6 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:2667: finishing write tid 3 to smithi084102331-6 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:2667: finishing write tid 4 to smithi084102331-6 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:2668: finishing write tid 1 to smithi084102331-30 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:2667: finishing write tid 5 to smithi084102331-6 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 1109 (ObjNum 825 snap 267 seq_num 825) dirty exists 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:2667: left oid 6 (ObjNum 825 snap 267 seq_num 825) 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:2668: finishing write tid 2 to smithi084102331-30 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:2663: done (5 left) 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:2665: done (4 left) 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:2666: done (3 left) 2024-01-13T18:09:39.906 INFO:tasks.rados.rados.0.smithi084.stdout:2667: done (2 left) 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:2669: done (1 left) 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:2670: read oid 16 snap -1 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:2670: expect (ObjNum 800 snap 258 seq_num 800) 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:2671: read oid 35 snap 261 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:2671: expect (ObjNum 790 snap 254 seq_num 790) 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:2672: rmattr oid 14 current snap is 268 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:2668: finishing write tid 3 to smithi084102331-30 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:2668: finishing write tid 4 to smithi084102331-30 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:2668: finishing write tid 5 to smithi084102331-30 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1321 (ObjNum 826 snap 267 seq_num 826) dirty exists 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:2668: left oid 30 (ObjNum 826 snap 267 seq_num 826) 2024-01-13T18:09:39.907 INFO:tasks.rados.rados.0.smithi084.stdout:2668: done (3 left) 2024-01-13T18:09:39.908 INFO:tasks.rados.rados.0.smithi084.stdout:2673: snap_remove snap 236 2024-01-13T18:09:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:09:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:09:40] "GET /metrics HTTP/1.1" 200 36193 "" "Prometheus/2.43.0" 2024-01-13T18:09:40.748 INFO:tasks.rados.rados.0.smithi084.stdout:2673: done (3 left) 2024-01-13T18:09:40.748 INFO:tasks.rados.rados.0.smithi084.stdout:2674: copy_from oid 5 from oid 38 current snap is 268 2024-01-13T18:09:40.748 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 268 2024-01-13T18:09:40.748 INFO:tasks.rados.rados.0.smithi084.stdout:2675: seq_num 827 ranges {2490368=655360,3145728=516096,3661824=688128} 2024-01-13T18:09:40.767 INFO:tasks.rados.rados.0.smithi084.stdout:2675: writing smithi084102331-24 from 2490368 to 3145728 tid 1 2024-01-13T18:09:40.770 INFO:tasks.rados.rados.0.smithi084.stdout:2675: writing smithi084102331-24 from 3145728 to 3661824 tid 2 2024-01-13T18:09:40.774 INFO:tasks.rados.rados.0.smithi084.stdout:2675: writing smithi084102331-24 from 3661824 to 4349952 tid 3 2024-01-13T18:09:40.774 INFO:tasks.rados.rados.0.smithi084.stdout:2676: delete oid 13 current snap is 268 2024-01-13T18:09:40.775 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1113 (ObjNum 639 snap 199 seq_num 639) dirty exists 2024-01-13T18:09:40.775 INFO:tasks.rados.rados.0.smithi084.stdout:2671: expect (ObjNum 790 snap 254 seq_num 790) 2024-01-13T18:09:40.808 INFO:tasks.rados.rados.0.smithi084.stdout:2670: expect (ObjNum 800 snap 258 seq_num 800) 2024-01-13T18:09:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:40 smithi099 ceph-mon[138788]: osdmap e598: 8 total, 8 up, 8 in 2024-01-13T18:09:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:40 smithi099 ceph-mon[138788]: pgmap v609: 121 pgs: 121 active+clean; 212 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 2.3 MiB/s wr, 21 op/s 2024-01-13T18:09:41.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:40 smithi084 ceph-mon[116404]: osdmap e598: 8 total, 8 up, 8 in 2024-01-13T18:09:41.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:40 smithi084 ceph-mon[116404]: pgmap v609: 121 pgs: 121 active+clean; 212 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 2.3 MiB/s wr, 21 op/s 2024-01-13T18:09:41.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:40 smithi084 ceph-mon[119097]: osdmap e598: 8 total, 8 up, 8 in 2024-01-13T18:09:41.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:40 smithi084 ceph-mon[119097]: pgmap v609: 121 pgs: 121 active+clean; 212 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 2.3 MiB/s wr, 21 op/s 2024-01-13T18:09:41.360 INFO:tasks.rados.rados.0.smithi084.stdout:2674: finishing copy_from to smithi084102331-5 2024-01-13T18:09:41.360 INFO:tasks.rados.rados.0.smithi084.stdout:2674: got expected ENOENT (src dne) 2024-01-13T18:09:41.360 INFO:tasks.rados.rados.0.smithi084.stdout:2674: finishing copy_from racing read to smithi084102331-5 2024-01-13T18:09:41.360 INFO:tasks.rados.rados.0.smithi084.stdout:2675: finishing write tid 1 to smithi084102331-24 2024-01-13T18:09:41.360 INFO:tasks.rados.rados.0.smithi084.stdout:2675: finishing write tid 2 to smithi084102331-24 2024-01-13T18:09:41.360 INFO:tasks.rados.rados.0.smithi084.stdout:2675: finishing write tid 3 to smithi084102331-24 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:2675: finishing write tid 4 to smithi084102331-24 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:2675: finishing write tid 5 to smithi084102331-24 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1286 (ObjNum 827 snap 268 seq_num 827) dirty exists 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:2675: left oid 24 (ObjNum 827 snap 268 seq_num 827) 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:2670: done (5 left) 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:2671: done (4 left) 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:2672: done (3 left) 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:2674: done (2 left) 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:2675: done (1 left) 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:2676: done (0 left) 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 268 2024-01-13T18:09:41.361 INFO:tasks.rados.rados.0.smithi084.stdout:2677: seq_num 829 ranges {1843200=688128,2531328=729088,3260416=475136} 2024-01-13T18:09:41.372 INFO:tasks.rados.rados.0.smithi084.stdout:2677: writing smithi084102331-30 from 1843200 to 2531328 tid 1 2024-01-13T18:09:41.376 INFO:tasks.rados.rados.0.smithi084.stdout:2677: writing smithi084102331-30 from 2531328 to 3260416 tid 2 2024-01-13T18:09:41.379 INFO:tasks.rados.rados.0.smithi084.stdout:2677: writing smithi084102331-30 from 3260416 to 3735552 tid 3 2024-01-13T18:09:41.379 INFO:tasks.rados.rados.0.smithi084.stdout:2678: delete oid 35 current snap is 268 2024-01-13T18:09:41.380 INFO:tasks.rados.rados.0.smithi084.stdout:2677: finishing write tid 1 to smithi084102331-30 2024-01-13T18:09:41.380 INFO:tasks.rados.rados.0.smithi084.stdout:2677: finishing write tid 2 to smithi084102331-30 2024-01-13T18:09:41.382 INFO:tasks.rados.rados.0.smithi084.stdout:2678: done (1 left) 2024-01-13T18:09:41.382 INFO:tasks.rados.rados.0.smithi084.stdout:2679: rollback oid 39 current snap is 268 2024-01-13T18:09:41.382 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 248 2024-01-13T18:09:41.383 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 268 2024-01-13T18:09:41.384 INFO:tasks.rados.rados.0.smithi084.stdout:2680: seq_num 831 ranges {0=720896,720896=499712,1220608=704512} 2024-01-13T18:09:41.386 INFO:tasks.rados.rados.0.smithi084.stdout:2680: writing smithi084102331-47 from 0 to 720896 tid 1 2024-01-13T18:09:41.389 INFO:tasks.rados.rados.0.smithi084.stdout:2680: writing smithi084102331-47 from 720896 to 1220608 tid 2 2024-01-13T18:09:41.393 INFO:tasks.rados.rados.0.smithi084.stdout:2680: writing smithi084102331-47 from 1220608 to 1925120 tid 3 2024-01-13T18:09:41.393 INFO:tasks.rados.rados.0.smithi084.stdout:2681: read oid 7 snap -1 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:2681: expect (ObjNum 800 snap 258 seq_num 800) 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:2682: snap_create 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:2677: finishing write tid 3 to smithi084102331-30 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:2677: finishing write tid 4 to smithi084102331-30 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:2679: finishing rollback tid 0 to smithi084102331-39 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:2679: finishing rollback tid 1 to smithi084102331-39 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:2679: finishing rollback tid 2 to smithi084102331-39 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1249 (ObjNum 763 snap 242 seq_num 763) dirty exists 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:2677: finishing write tid 5 to smithi084102331-30 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1325 (ObjNum 829 snap 268 seq_num 829) dirty exists 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:2677: left oid 30 (ObjNum 829 snap 268 seq_num 829) 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:2680: finishing write tid 1 to smithi084102331-47 2024-01-13T18:09:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:2680: finishing write tid 2 to smithi084102331-47 2024-01-13T18:09:41.397 INFO:tasks.rados.rados.0.smithi084.stdout:2680: finishing write tid 3 to smithi084102331-47 2024-01-13T18:09:41.397 INFO:tasks.rados.rados.0.smithi084.stdout:2680: finishing write tid 4 to smithi084102331-47 2024-01-13T18:09:41.399 INFO:tasks.rados.rados.0.smithi084.stdout:2680: finishing write tid 5 to smithi084102331-47 2024-01-13T18:09:41.399 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1307 (ObjNum 831 snap 268 seq_num 831) dirty exists 2024-01-13T18:09:41.399 INFO:tasks.rados.rados.0.smithi084.stdout:2680: left oid 47 (ObjNum 831 snap 268 seq_num 831) 2024-01-13T18:09:41.413 INFO:tasks.rados.rados.0.smithi084.stdout:2681: expect (ObjNum 800 snap 258 seq_num 800) 2024-01-13T18:09:41.969 INFO:tasks.rados.rados.0.smithi084.stdout:2677: done (4 left) 2024-01-13T18:09:41.970 INFO:tasks.rados.rados.0.smithi084.stdout:2679: done (3 left) 2024-01-13T18:09:41.970 INFO:tasks.rados.rados.0.smithi084.stdout:2680: done (2 left) 2024-01-13T18:09:41.970 INFO:tasks.rados.rados.0.smithi084.stdout:2681: done (1 left) 2024-01-13T18:09:41.970 INFO:tasks.rados.rados.0.smithi084.stdout:2682: done (0 left) 2024-01-13T18:09:41.970 INFO:tasks.rados.rados.0.smithi084.stdout:2683: copy_from oid 14 from oid 16 current snap is 269 2024-01-13T18:09:41.970 INFO:tasks.rados.rados.0.smithi084.stdout:2684: snap_create 2024-01-13T18:09:42.004 INFO:tasks.rados.rados.0.smithi084.stdout:2683: finishing copy_from to smithi084102331-14 2024-01-13T18:09:42.004 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1117 (ObjNum 800 snap 258 seq_num 800) dirty exists 2024-01-13T18:09:42.005 INFO:tasks.rados.rados.0.smithi084.stdout:2683: finishing copy_from racing read to smithi084102331-14 2024-01-13T18:09:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:41 smithi099 ceph-mon[138788]: osdmap e599: 8 total, 8 up, 8 in 2024-01-13T18:09:42.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:41 smithi084 ceph-mon[116404]: osdmap e599: 8 total, 8 up, 8 in 2024-01-13T18:09:42.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:41 smithi084 ceph-mon[119097]: osdmap e599: 8 total, 8 up, 8 in 2024-01-13T18:09:42.681 INFO:tasks.rados.rados.0.smithi084.stdout:2683: done (1 left) 2024-01-13T18:09:42.682 INFO:tasks.rados.rados.0.smithi084.stdout:2684: done (0 left) 2024-01-13T18:09:42.682 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 270 2024-01-13T18:09:42.682 INFO:tasks.rados.rados.0.smithi084.stdout:2685: seq_num 832 ranges {1343488=737280,2080768=786432,2867200=417792} 2024-01-13T18:09:42.692 INFO:tasks.rados.rados.0.smithi084.stdout:2685: writing smithi084102331-12 from 1343488 to 2080768 tid 1 2024-01-13T18:09:42.697 INFO:tasks.rados.rados.0.smithi084.stdout:2685: writing smithi084102331-12 from 2080768 to 2867200 tid 2 2024-01-13T18:09:42.700 INFO:tasks.rados.rados.0.smithi084.stdout:2685: writing smithi084102331-12 from 2867200 to 3284992 tid 3 2024-01-13T18:09:42.700 INFO:tasks.rados.rados.0.smithi084.stdout:2686: read oid 33 snap -1 2024-01-13T18:09:42.700 INFO:tasks.rados.rados.0.smithi084.stdout:2686: expect deleted 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:2687: rmattr oid 38 current snap is 270 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:2687: done (2 left) 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:2688: rollback oid 44 current snap is 270 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 250 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:2689: rollback oid 4 current snap is 270 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 256 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:2690: rollback oid 41 current snap is 270 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 267 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:2691: read oid 29 snap -1 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:2691: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:2692: rollback oid 40 current snap is 270 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 261 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 270 2024-01-13T18:09:42.701 INFO:tasks.rados.rados.0.smithi084.stdout:2693: seq_num 833 ranges {3276800=761856,4038656=671744,4710400=532480} 2024-01-13T18:09:42.721 INFO:tasks.rados.rados.0.smithi084.stdout:2693: writing smithi084102331-34 from 3276800 to 4038656 tid 1 2024-01-13T18:09:42.726 INFO:tasks.rados.rados.0.smithi084.stdout:2693: writing smithi084102331-34 from 4038656 to 4710400 tid 2 2024-01-13T18:09:42.729 INFO:tasks.rados.rados.0.smithi084.stdout:2693: writing smithi084102331-34 from 4710400 to 5242880 tid 3 2024-01-13T18:09:42.729 INFO:tasks.rados.rados.0.smithi084.stdout:2694: read oid 22 snap -1 2024-01-13T18:09:42.730 INFO:tasks.rados.rados.0.smithi084.stdout:2694: expect (ObjNum 802 snap 258 seq_num 802) 2024-01-13T18:09:42.730 INFO:tasks.rados.rados.0.smithi084.stdout:2695: snap_create 2024-01-13T18:09:42.730 INFO:tasks.rados.rados.0.smithi084.stdout:2691: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:2689: finishing rollback tid 1 to smithi084102331-4 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:2692: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:2689: finishing rollback tid 2 to smithi084102331-4 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 1224 (ObjNum 782 snap 254 seq_num 782) dirty exists 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:2690: finishing rollback tid 0 to smithi084102331-41 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:2685: finishing write tid 1 to smithi084102331-12 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:2688: finishing rollback tid 0 to smithi084102331-44 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:2685: finishing write tid 2 to smithi084102331-12 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:2690: finishing rollback tid 1 to smithi084102331-41 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:2688: finishing rollback tid 1 to smithi084102331-44 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:2690: finishing rollback tid 2 to smithi084102331-41 2024-01-13T18:09:42.732 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1252 (ObjNum 805 snap 262 seq_num 805) dirty exists 2024-01-13T18:09:42.733 INFO:tasks.rados.rados.0.smithi084.stdout:2692: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:09:42.733 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1001 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-01-13T18:09:42.733 INFO:tasks.rados.rados.0.smithi084.stdout:2688: finishing rollback tid 2 to smithi084102331-44 2024-01-13T18:09:42.733 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1311 (ObjNum 663 snap 207 seq_num 663) dirty exists 2024-01-13T18:09:42.733 INFO:tasks.rados.rados.0.smithi084.stdout:2685: finishing write tid 3 to smithi084102331-12 2024-01-13T18:09:42.733 INFO:tasks.rados.rados.0.smithi084.stdout:2685: finishing write tid 4 to smithi084102331-12 2024-01-13T18:09:42.733 INFO:tasks.rados.rados.0.smithi084.stdout:2685: finishing write tid 5 to smithi084102331-12 2024-01-13T18:09:42.733 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1410 (ObjNum 832 snap 270 seq_num 832) dirty exists 2024-01-13T18:09:42.733 INFO:tasks.rados.rados.0.smithi084.stdout:2685: left oid 12 (ObjNum 832 snap 270 seq_num 832) 2024-01-13T18:09:42.733 INFO:tasks.rados.rados.0.smithi084.stdout:2693: finishing write tid 1 to smithi084102331-34 2024-01-13T18:09:42.733 INFO:tasks.rados.rados.0.smithi084.stdout:2693: finishing write tid 2 to smithi084102331-34 2024-01-13T18:09:42.734 INFO:tasks.rados.rados.0.smithi084.stdout:2693: finishing write tid 3 to smithi084102331-34 2024-01-13T18:09:42.734 INFO:tasks.rados.rados.0.smithi084.stdout:2693: finishing write tid 4 to smithi084102331-34 2024-01-13T18:09:42.734 INFO:tasks.rados.rados.0.smithi084.stdout:2693: finishing write tid 5 to smithi084102331-34 2024-01-13T18:09:42.734 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 1113 (ObjNum 833 snap 270 seq_num 833) dirty exists 2024-01-13T18:09:42.734 INFO:tasks.rados.rados.0.smithi084.stdout:2693: left oid 34 (ObjNum 833 snap 270 seq_num 833) 2024-01-13T18:09:42.760 INFO:tasks.rados.rados.0.smithi084.stdout:2694: expect (ObjNum 802 snap 258 seq_num 802) 2024-01-13T18:09:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:42 smithi099 ceph-mon[138788]: osdmap e600: 8 total, 8 up, 8 in 2024-01-13T18:09:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:42 smithi099 ceph-mon[138788]: pgmap v612: 121 pgs: 121 active+clean; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2024-01-13T18:09:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:42 smithi099 ceph-mon[138788]: osdmap e601: 8 total, 8 up, 8 in 2024-01-13T18:09:43.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:42 smithi084 ceph-mon[116404]: osdmap e600: 8 total, 8 up, 8 in 2024-01-13T18:09:43.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:42 smithi084 ceph-mon[116404]: pgmap v612: 121 pgs: 121 active+clean; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2024-01-13T18:09:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:42 smithi084 ceph-mon[116404]: osdmap e601: 8 total, 8 up, 8 in 2024-01-13T18:09:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:42 smithi084 ceph-mon[119097]: osdmap e600: 8 total, 8 up, 8 in 2024-01-13T18:09:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:42 smithi084 ceph-mon[119097]: pgmap v612: 121 pgs: 121 active+clean; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2024-01-13T18:09:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:42 smithi084 ceph-mon[119097]: osdmap e601: 8 total, 8 up, 8 in 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:2685: done (9 left) 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:2686: done (8 left) 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:2688: done (7 left) 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:2689: done (6 left) 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:2690: done (5 left) 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:2691: done (4 left) 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:2692: done (3 left) 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:2693: done (2 left) 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:2694: done (1 left) 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:2695: done (0 left) 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:2696: rollback oid 6 current snap is 271 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 6 to 269 2024-01-13T18:09:43.695 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 271 2024-01-13T18:09:43.696 INFO:tasks.rados.rados.0.smithi084.stdout:2697: seq_num 834 ranges {0=778240,778240=557056,1335296=548864,1884160=98304} 2024-01-13T18:09:43.696 INFO:tasks.rados.rados.0.smithi084.stdout:2697: writing smithi084102331-9 from 0 to 778240 tid 1 2024-01-13T18:09:43.697 INFO:tasks.rados.rados.0.smithi084.stdout:2697: writing smithi084102331-9 from 778240 to 1335296 tid 2 2024-01-13T18:09:43.700 INFO:tasks.rados.rados.0.smithi084.stdout:2697: writing smithi084102331-9 from 1335296 to 1884160 tid 3 2024-01-13T18:09:43.701 INFO:tasks.rados.rados.0.smithi084.stdout:2697: writing smithi084102331-9 from 1884160 to 1982464 tid 4 2024-01-13T18:09:43.701 INFO:tasks.rados.rados.0.smithi084.stdout:2698: copy_from oid 19 from oid 31 current snap is 271 2024-01-13T18:09:43.701 INFO:tasks.rados.rados.0.smithi084.stdout:2696: finishing rollback tid 0 to smithi084102331-6 2024-01-13T18:09:43.701 INFO:tasks.rados.rados.0.smithi084.stdout:2696: finishing rollback tid 1 to smithi084102331-6 2024-01-13T18:09:43.701 INFO:tasks.rados.rados.0.smithi084.stdout:2696: finishing rollback tid 2 to smithi084102331-6 2024-01-13T18:09:43.701 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 1116 (ObjNum 825 snap 267 seq_num 825) dirty exists 2024-01-13T18:09:43.702 INFO:tasks.rados.rados.0.smithi084.stdout:2697: finishing write tid 1 to smithi084102331-9 2024-01-13T18:09:43.702 INFO:tasks.rados.rados.0.smithi084.stdout:2697: finishing write tid 2 to smithi084102331-9 2024-01-13T18:09:43.702 INFO:tasks.rados.rados.0.smithi084.stdout:2696: done (2 left) 2024-01-13T18:09:43.702 INFO:tasks.rados.rados.0.smithi084.stdout:2699: rollback oid 34 current snap is 271 2024-01-13T18:09:43.702 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 268 2024-01-13T18:09:43.702 INFO:tasks.rados.rados.0.smithi084.stdout:2700: delete oid 7 current snap is 271 2024-01-13T18:09:43.703 INFO:tasks.rados.rados.0.smithi084.stdout:2697: finishing write tid 3 to smithi084102331-9 2024-01-13T18:09:43.704 INFO:tasks.rados.rados.0.smithi084.stdout:2697: finishing write tid 4 to smithi084102331-9 2024-01-13T18:09:43.704 INFO:tasks.rados.rados.0.smithi084.stdout:2698: finishing copy_from to smithi084102331-19 2024-01-13T18:09:43.705 INFO:tasks.rados.rados.0.smithi084.stdout:2698: got expected ENOENT (src dne) 2024-01-13T18:09:43.705 INFO:tasks.rados.rados.0.smithi084.stdout:2698: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:09:43.710 INFO:tasks.rados.rados.0.smithi084.stdout:2698: done (3 left) 2024-01-13T18:09:43.710 INFO:tasks.rados.rados.0.smithi084.stdout:2700: done (2 left) 2024-01-13T18:09:43.710 INFO:tasks.rados.rados.0.smithi084.stdout:2701: read oid 14 snap -1 2024-01-13T18:09:43.710 INFO:tasks.rados.rados.0.smithi084.stdout:2701: expect (ObjNum 800 snap 258 seq_num 800) 2024-01-13T18:09:43.710 INFO:tasks.rados.rados.0.smithi084.stdout:2702: copy_from oid 37 from oid 30 current snap is 271 2024-01-13T18:09:43.710 INFO:tasks.rados.rados.0.smithi084.stdout:2703: read oid 31 snap 255 2024-01-13T18:09:43.710 INFO:tasks.rados.rados.0.smithi084.stdout:2703: expect deleted 2024-01-13T18:09:43.710 INFO:tasks.rados.rados.0.smithi084.stdout:2704: copy_from oid 1 from oid 47 current snap is 271 2024-01-13T18:09:43.710 INFO:tasks.rados.rados.0.smithi084.stdout:2705: rmattr oid 24 current snap is 271 2024-01-13T18:09:43.710 INFO:tasks.rados.rados.0.smithi084.stdout:2705: done (6 left) 2024-01-13T18:09:43.710 INFO:tasks.rados.rados.0.smithi084.stdout:2706: setattr oid 33 current snap is 271 2024-01-13T18:09:43.711 INFO:tasks.rados.rados.0.smithi084.stdout:2697: finishing write tid 5 to smithi084102331-9 2024-01-13T18:09:43.711 INFO:tasks.rados.rados.0.smithi084.stdout:2703: done (6 left) 2024-01-13T18:09:43.711 INFO:tasks.rados.rados.0.smithi084.stdout:2707: rollback oid 24 current snap is 271 2024-01-13T18:09:43.711 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 269 2024-01-13T18:09:43.711 INFO:tasks.rados.rados.0.smithi084.stdout:2708: read oid 42 snap -1 2024-01-13T18:09:43.711 INFO:tasks.rados.rados.0.smithi084.stdout:2708: expect deleted 2024-01-13T18:09:43.711 INFO:tasks.rados.rados.0.smithi084.stdout:2709: read oid 8 snap -1 2024-01-13T18:09:43.711 INFO:tasks.rados.rados.0.smithi084.stdout:2709: expect deleted 2024-01-13T18:09:43.711 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 271 2024-01-13T18:09:43.711 INFO:tasks.rados.rados.0.smithi084.stdout:2710: seq_num 836 ranges {3989504=409600,4399104=720896,5120000=516096,5636096=368640} 2024-01-13T18:09:43.733 INFO:tasks.rados.rados.0.smithi084.stdout:2710: writing smithi084102331-36 from 3989504 to 4399104 tid 1 2024-01-13T18:09:43.737 INFO:tasks.rados.rados.0.smithi084.stdout:2710: writing smithi084102331-36 from 4399104 to 5120000 tid 2 2024-01-13T18:09:43.740 INFO:tasks.rados.rados.0.smithi084.stdout:2710: writing smithi084102331-36 from 5120000 to 5636096 tid 3 2024-01-13T18:09:43.743 INFO:tasks.rados.rados.0.smithi084.stdout:2710: writing smithi084102331-36 from 5636096 to 6004736 tid 4 2024-01-13T18:09:43.743 INFO:tasks.rados.rados.0.smithi084.stdout:2711: copy_from oid 32 from oid 11 current snap is 271 2024-01-13T18:09:43.743 INFO:tasks.rados.rados.0.smithi084.stdout:2697: finishing write tid 6 to smithi084102331-9 2024-01-13T18:09:43.743 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1121 (ObjNum 834 snap 271 seq_num 834) dirty exists 2024-01-13T18:09:43.743 INFO:tasks.rados.rados.0.smithi084.stdout:2697: left oid 9 (ObjNum 834 snap 271 seq_num 834) 2024-01-13T18:09:43.743 INFO:tasks.rados.rados.0.smithi084.stdout:2699: finishing rollback tid 0 to smithi084102331-34 2024-01-13T18:09:43.743 INFO:tasks.rados.rados.0.smithi084.stdout:2707: finishing rollback tid 0 to smithi084102331-24 2024-01-13T18:09:43.743 INFO:tasks.rados.rados.0.smithi084.stdout:2699: finishing rollback tid 1 to smithi084102331-34 2024-01-13T18:09:43.743 INFO:tasks.rados.rados.0.smithi084.stdout:2699: finishing rollback tid 2 to smithi084102331-34 2024-01-13T18:09:43.743 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 1124 (ObjNum 805 snap 262 seq_num 805) dirty exists 2024-01-13T18:09:43.743 INFO:tasks.rados.rados.0.smithi084.stdout:2707: finishing rollback tid 1 to smithi084102331-24 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:2707: finishing rollback tid 2 to smithi084102331-24 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1290 (ObjNum 827 snap 268 seq_num 827) dirty exists 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1326 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:2704: finishing copy_from to smithi084102331-1 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1307 (ObjNum 831 snap 268 seq_num 831) dirty exists 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:2704: finishing copy_from racing read to smithi084102331-1 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:2702: finishing copy_from to smithi084102331-37 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1325 (ObjNum 829 snap 268 seq_num 829) dirty exists 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:2702: finishing copy_from racing read to smithi084102331-37 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:2697: done (10 left) 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:2699: done (9 left) 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:2702: done (8 left) 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:2704: done (7 left) 2024-01-13T18:09:43.744 INFO:tasks.rados.rados.0.smithi084.stdout:2706: done (6 left) 2024-01-13T18:09:43.745 INFO:tasks.rados.rados.0.smithi084.stdout:2707: done (5 left) 2024-01-13T18:09:43.745 INFO:tasks.rados.rados.0.smithi084.stdout:2708: done (4 left) 2024-01-13T18:09:43.745 INFO:tasks.rados.rados.0.smithi084.stdout:2709: done (3 left) 2024-01-13T18:09:43.745 INFO:tasks.rados.rados.0.smithi084.stdout:2712: snap_remove snap 255 2024-01-13T18:09:44.698 INFO:tasks.rados.rados.0.smithi084.stdout:2712: done (3 left) 2024-01-13T18:09:44.698 INFO:tasks.rados.rados.0.smithi084.stdout:2713: snap_remove snap 269 2024-01-13T18:09:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:44 smithi099 ceph-mon[138788]: osdmap e602: 8 total, 8 up, 8 in 2024-01-13T18:09:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:44 smithi099 ceph-mon[138788]: pgmap v615: 121 pgs: 121 active+clean; 202 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-01-13T18:09:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:44 smithi084 ceph-mon[116404]: osdmap e602: 8 total, 8 up, 8 in 2024-01-13T18:09:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:44 smithi084 ceph-mon[116404]: pgmap v615: 121 pgs: 121 active+clean; 202 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-01-13T18:09:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:44 smithi084 ceph-mon[119097]: osdmap e602: 8 total, 8 up, 8 in 2024-01-13T18:09:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:44 smithi084 ceph-mon[119097]: pgmap v615: 121 pgs: 121 active+clean; 202 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 20 op/s 2024-01-13T18:09:45.701 INFO:tasks.rados.rados.0.smithi084.stdout:2713: done (3 left) 2024-01-13T18:09:45.702 INFO:tasks.rados.rados.0.smithi084.stdout:2714: rollback oid 2 current snap is 271 2024-01-13T18:09:45.702 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 248 2024-01-13T18:09:45.702 INFO:tasks.rados.rados.0.smithi084.stdout:2701: expect (ObjNum 800 snap 258 seq_num 800) 2024-01-13T18:09:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:45 smithi099 ceph-mon[138788]: osdmap e603: 8 total, 8 up, 8 in 2024-01-13T18:09:46.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:45 smithi084 ceph-mon[116404]: osdmap e603: 8 total, 8 up, 8 in 2024-01-13T18:09:46.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:45 smithi084 ceph-mon[119097]: osdmap e603: 8 total, 8 up, 8 in 2024-01-13T18:09:46.263 INFO:tasks.rados.rados.0.smithi084.stdout:2710: finishing write tid 1 to smithi084102331-36 2024-01-13T18:09:46.263 INFO:tasks.rados.rados.0.smithi084.stdout:2701: done (3 left) 2024-01-13T18:09:46.263 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 271 2024-01-13T18:09:46.264 INFO:tasks.rados.rados.0.smithi084.stdout:2710: finishing write tid 2 to smithi084102331-36 2024-01-13T18:09:46.264 INFO:tasks.rados.rados.0.smithi084.stdout:2710: finishing write tid 3 to smithi084102331-36 2024-01-13T18:09:46.264 INFO:tasks.rados.rados.0.smithi084.stdout:2710: finishing write tid 4 to smithi084102331-36 2024-01-13T18:09:46.264 INFO:tasks.rados.rados.0.smithi084.stdout:2715: seq_num 837 ranges {1007616=425984,1433600=655360,2088960=729088,2818048=221184} 2024-01-13T18:09:46.271 INFO:tasks.rados.rados.0.smithi084.stdout:2715: writing smithi084102331-5 from 1007616 to 1433600 tid 1 2024-01-13T18:09:46.274 INFO:tasks.rados.rados.0.smithi084.stdout:2715: writing smithi084102331-5 from 1433600 to 2088960 tid 2 2024-01-13T18:09:46.279 INFO:tasks.rados.rados.0.smithi084.stdout:2715: writing smithi084102331-5 from 2088960 to 2818048 tid 3 2024-01-13T18:09:46.280 INFO:tasks.rados.rados.0.smithi084.stdout:2715: writing smithi084102331-5 from 2818048 to 3039232 tid 4 2024-01-13T18:09:46.280 INFO:tasks.rados.rados.0.smithi084.stdout:2716: rollback oid 42 current snap is 271 2024-01-13T18:09:46.280 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 261 2024-01-13T18:09:46.280 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 271 2024-01-13T18:09:46.281 INFO:tasks.rados.rados.0.smithi084.stdout:2717: seq_num 838 ranges {2932736=442368,3375104=540672,3915776=532480,4448256=442368,4890624=90112} 2024-01-13T18:09:46.298 INFO:tasks.rados.rados.0.smithi084.stdout:2717: writing smithi084102331-3 from 2932736 to 3375104 tid 1 2024-01-13T18:09:46.301 INFO:tasks.rados.rados.0.smithi084.stdout:2717: writing smithi084102331-3 from 3375104 to 3915776 tid 2 2024-01-13T18:09:46.304 INFO:tasks.rados.rados.0.smithi084.stdout:2717: writing smithi084102331-3 from 3915776 to 4448256 tid 3 2024-01-13T18:09:46.307 INFO:tasks.rados.rados.0.smithi084.stdout:2717: writing smithi084102331-3 from 4448256 to 4890624 tid 4 2024-01-13T18:09:46.308 INFO:tasks.rados.rados.0.smithi084.stdout:2717: writing smithi084102331-3 from 4890624 to 4980736 tid 5 2024-01-13T18:09:46.308 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 271 2024-01-13T18:09:46.308 INFO:tasks.rados.rados.0.smithi084.stdout:2710: finishing write tid 5 to smithi084102331-36 2024-01-13T18:09:46.308 INFO:tasks.rados.rados.0.smithi084.stdout:2710: finishing write tid 6 to smithi084102331-36 2024-01-13T18:09:46.308 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1122 (ObjNum 836 snap 271 seq_num 836) dirty exists 2024-01-13T18:09:46.308 INFO:tasks.rados.rados.0.smithi084.stdout:2710: left oid 36 (ObjNum 836 snap 271 seq_num 836) 2024-01-13T18:09:46.308 INFO:tasks.rados.rados.0.smithi084.stdout:2711: finishing copy_from to smithi084102331-32 2024-01-13T18:09:46.309 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1246 (ObjNum 702 snap 220 seq_num 702) dirty exists 2024-01-13T18:09:46.309 INFO:tasks.rados.rados.0.smithi084.stdout:2711: finishing copy_from racing read to smithi084102331-32 2024-01-13T18:09:46.309 INFO:tasks.rados.rados.0.smithi084.stdout:2714: finishing rollback tid 0 to smithi084102331-2 2024-01-13T18:09:46.309 INFO:tasks.rados.rados.0.smithi084.stdout:2714: finishing rollback tid 1 to smithi084102331-2 2024-01-13T18:09:46.309 INFO:tasks.rados.rados.0.smithi084.stdout:2714: finishing rollback tid 2 to smithi084102331-2 2024-01-13T18:09:46.309 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1426 (ObjNum 756 snap 237 seq_num 756) dirty exists 2024-01-13T18:09:46.309 INFO:tasks.rados.rados.0.smithi084.stdout:2718: seq_num 839 ranges {3735552=458752,4194304=425984,4620288=688128,5308416=491520} 2024-01-13T18:09:46.330 INFO:tasks.rados.rados.0.smithi084.stdout:2718: writing smithi084102331-37 from 3735552 to 4194304 tid 1 2024-01-13T18:09:46.332 INFO:tasks.rados.rados.0.smithi084.stdout:2718: writing smithi084102331-37 from 4194304 to 4620288 tid 2 2024-01-13T18:09:46.336 INFO:tasks.rados.rados.0.smithi084.stdout:2718: writing smithi084102331-37 from 4620288 to 5308416 tid 3 2024-01-13T18:09:46.339 INFO:tasks.rados.rados.0.smithi084.stdout:2718: writing smithi084102331-37 from 5308416 to 5799936 tid 4 2024-01-13T18:09:46.340 INFO:tasks.rados.rados.0.smithi084.stdout:2710: done (6 left) 2024-01-13T18:09:46.340 INFO:tasks.rados.rados.0.smithi084.stdout:2711: done (5 left) 2024-01-13T18:09:46.340 INFO:tasks.rados.rados.0.smithi084.stdout:2714: done (4 left) 2024-01-13T18:09:46.340 INFO:tasks.rados.rados.0.smithi084.stdout:2719: read oid 36 snap -1 2024-01-13T18:09:46.340 INFO:tasks.rados.rados.0.smithi084.stdout:2719: expect (ObjNum 836 snap 271 seq_num 836) 2024-01-13T18:09:46.340 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 271 2024-01-13T18:09:46.340 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 1 to smithi084102331-5 2024-01-13T18:09:46.340 INFO:tasks.rados.rados.0.smithi084.stdout:2720: seq_num 840 ranges {0=475136,475136=712704,1187840=499712,1687552=393216} 2024-01-13T18:09:46.342 INFO:tasks.rados.rados.0.smithi084.stdout:2720: writing smithi084102331-35 from 0 to 475136 tid 1 2024-01-13T18:09:46.346 INFO:tasks.rados.rados.0.smithi084.stdout:2720: writing smithi084102331-35 from 475136 to 1187840 tid 2 2024-01-13T18:09:46.349 INFO:tasks.rados.rados.0.smithi084.stdout:2720: writing smithi084102331-35 from 1187840 to 1687552 tid 3 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:2720: writing smithi084102331-35 from 1687552 to 2080768 tid 4 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:2721: copy_from oid 24 from oid 1 current snap is 271 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 2 to smithi084102331-5 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:2716: finishing rollback tid 1 to smithi084102331-42 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1102 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 3 to smithi084102331-5 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 4 to smithi084102331-5 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 5 to smithi084102331-5 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 6 to smithi084102331-5 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 1229 (ObjNum 837 snap 271 seq_num 837) dirty exists 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:2715: left oid 5 (ObjNum 837 snap 271 seq_num 837) 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:2717: finishing write tid 1 to smithi084102331-3 2024-01-13T18:09:46.353 INFO:tasks.rados.rados.0.smithi084.stdout:2717: finishing write tid 2 to smithi084102331-3 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:2717: finishing write tid 3 to smithi084102331-3 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:2717: finishing write tid 4 to smithi084102331-3 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:2717: finishing write tid 5 to smithi084102331-3 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:2717: finishing write tid 6 to smithi084102331-3 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:2717: finishing write tid 7 to smithi084102331-3 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1424 (ObjNum 838 snap 271 seq_num 838) dirty exists 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:2717: left oid 3 (ObjNum 838 snap 271 seq_num 838) 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 1 to smithi084102331-37 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 2 to smithi084102331-37 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 3 to smithi084102331-37 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 4 to smithi084102331-37 2024-01-13T18:09:46.354 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 5 to smithi084102331-37 2024-01-13T18:09:46.355 INFO:tasks.rados.rados.0.smithi084.stdout:2720: finishing write tid 1 to smithi084102331-35 2024-01-13T18:09:46.355 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 6 to smithi084102331-37 2024-01-13T18:09:46.355 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1331 (ObjNum 839 snap 271 seq_num 839) dirty exists 2024-01-13T18:09:46.355 INFO:tasks.rados.rados.0.smithi084.stdout:2718: left oid 37 (ObjNum 839 snap 271 seq_num 839) 2024-01-13T18:09:46.355 INFO:tasks.rados.rados.0.smithi084.stdout:2720: finishing write tid 2 to smithi084102331-35 2024-01-13T18:09:46.355 INFO:tasks.rados.rados.0.smithi084.stdout:2715: done (6 left) 2024-01-13T18:09:46.355 INFO:tasks.rados.rados.0.smithi084.stdout:2716: done (5 left) 2024-01-13T18:09:46.355 INFO:tasks.rados.rados.0.smithi084.stdout:2717: done (4 left) 2024-01-13T18:09:46.355 INFO:tasks.rados.rados.0.smithi084.stdout:2718: done (3 left) 2024-01-13T18:09:46.356 INFO:tasks.rados.rados.0.smithi084.stdout:2722: setattr oid 22 current snap is 271 2024-01-13T18:09:46.356 INFO:tasks.rados.rados.0.smithi084.stdout:2723: snap_remove snap 253 2024-01-13T18:09:46.719 INFO:tasks.rados.rados.0.smithi084.stdout:2723: done (4 left) 2024-01-13T18:09:46.720 INFO:tasks.rados.rados.0.smithi084.stdout:2724: snap_create 2024-01-13T18:09:46.720 INFO:tasks.rados.rados.0.smithi084.stdout:2720: finishing write tid 3 to smithi084102331-35 2024-01-13T18:09:46.720 INFO:tasks.rados.rados.0.smithi084.stdout:2720: finishing write tid 4 to smithi084102331-35 2024-01-13T18:09:46.720 INFO:tasks.rados.rados.0.smithi084.stdout:2720: finishing write tid 5 to smithi084102331-35 2024-01-13T18:09:46.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1428 (ObjNum 802 snap 258 seq_num 802) dirty exists 2024-01-13T18:09:46.720 INFO:tasks.rados.rados.0.smithi084.stdout:2720: finishing write tid 6 to smithi084102331-35 2024-01-13T18:09:46.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1012 (ObjNum 840 snap 271 seq_num 840) dirty exists 2024-01-13T18:09:46.720 INFO:tasks.rados.rados.0.smithi084.stdout:2720: left oid 35 (ObjNum 840 snap 271 seq_num 840) 2024-01-13T18:09:46.720 INFO:tasks.rados.rados.0.smithi084.stdout:2719: expect (ObjNum 836 snap 271 seq_num 836) 2024-01-13T18:09:46.998 INFO:tasks.rados.rados.0.smithi084.stdout:2721: finishing copy_from to smithi084102331-24 2024-01-13T18:09:46.998 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1307 (ObjNum 831 snap 268 seq_num 831) dirty exists 2024-01-13T18:09:46.998 INFO:tasks.rados.rados.0.smithi084.stdout:2721: finishing copy_from racing read to smithi084102331-24 2024-01-13T18:09:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:46 smithi099 ceph-mon[138788]: osdmap e604: 8 total, 8 up, 8 in 2024-01-13T18:09:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:46 smithi099 ceph-mon[138788]: pgmap v618: 121 pgs: 121 active+clean; 212 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.0 MiB/s wr, 24 op/s 2024-01-13T18:09:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:46 smithi084 ceph-mon[116404]: osdmap e604: 8 total, 8 up, 8 in 2024-01-13T18:09:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:46 smithi084 ceph-mon[116404]: pgmap v618: 121 pgs: 121 active+clean; 212 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.0 MiB/s wr, 24 op/s 2024-01-13T18:09:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:46 smithi084 ceph-mon[119097]: osdmap e604: 8 total, 8 up, 8 in 2024-01-13T18:09:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:46 smithi084 ceph-mon[119097]: pgmap v618: 121 pgs: 121 active+clean; 212 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.0 MiB/s wr, 24 op/s 2024-01-13T18:09:47.684 INFO:tasks.rados.rados.0.smithi084.stdout:2719: done (4 left) 2024-01-13T18:09:47.684 INFO:tasks.rados.rados.0.smithi084.stdout:2720: done (3 left) 2024-01-13T18:09:47.684 INFO:tasks.rados.rados.0.smithi084.stdout:2721: done (2 left) 2024-01-13T18:09:47.684 INFO:tasks.rados.rados.0.smithi084.stdout:2722: done (1 left) 2024-01-13T18:09:47.684 INFO:tasks.rados.rados.0.smithi084.stdout:2724: done (0 left) 2024-01-13T18:09:47.684 INFO:tasks.rados.rados.0.smithi084.stdout:2725: rmattr oid 49 current snap is 272 2024-01-13T18:09:47.684 INFO:tasks.rados.rados.0.smithi084.stdout:2726: snap_remove snap 245 2024-01-13T18:09:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:47 smithi099 ceph-mon[138788]: osdmap e605: 8 total, 8 up, 8 in 2024-01-13T18:09:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:47 smithi099 ceph-mon[138788]: osdmap e606: 8 total, 8 up, 8 in 2024-01-13T18:09:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:47 smithi084 ceph-mon[116404]: osdmap e605: 8 total, 8 up, 8 in 2024-01-13T18:09:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:47 smithi084 ceph-mon[116404]: osdmap e606: 8 total, 8 up, 8 in 2024-01-13T18:09:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:47 smithi084 ceph-mon[119097]: osdmap e605: 8 total, 8 up, 8 in 2024-01-13T18:09:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:47 smithi084 ceph-mon[119097]: osdmap e606: 8 total, 8 up, 8 in 2024-01-13T18:09:48.695 INFO:tasks.rados.rados.0.smithi084.stdout:2726: done (1 left) 2024-01-13T18:09:48.695 INFO:tasks.rados.rados.0.smithi084.stdout:2727: rollback oid 14 current snap is 272 2024-01-13T18:09:48.695 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 250 2024-01-13T18:09:48.696 INFO:tasks.rados.rados.0.smithi084.stdout:2728: delete oid 47 current snap is 272 2024-01-13T18:09:48.696 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1123 (ObjNum 65 snap 0 seq_num 1735676267) dirty exists 2024-01-13T18:09:48.705 INFO:tasks.rados.rados.0.smithi084.stdout:2727: finishing rollback tid 0 to smithi084102331-14 2024-01-13T18:09:48.705 INFO:tasks.rados.rados.0.smithi084.stdout:2727: finishing rollback tid 1 to smithi084102331-14 2024-01-13T18:09:48.705 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1125 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-01-13T18:09:48.706 INFO:tasks.rados.rados.0.smithi084.stdout:2725: done (2 left) 2024-01-13T18:09:48.706 INFO:tasks.rados.rados.0.smithi084.stdout:2727: done (1 left) 2024-01-13T18:09:48.706 INFO:tasks.rados.rados.0.smithi084.stdout:2728: done (0 left) 2024-01-13T18:09:48.706 INFO:tasks.rados.rados.0.smithi084.stdout:2729: copy_from oid 45 from oid 47 current snap is 272 2024-01-13T18:09:48.706 INFO:tasks.rados.rados.0.smithi084.stdout:2730: snap_remove snap 271 2024-01-13T18:09:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:48 smithi099 ceph-mon[138788]: pgmap v621: 121 pgs: 121 active+clean; 245 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 9.1 MiB/s wr, 35 op/s 2024-01-13T18:09:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:48 smithi099 ceph-mon[138788]: osdmap e607: 8 total, 8 up, 8 in 2024-01-13T18:09:49.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:48 smithi084 ceph-mon[116404]: pgmap v621: 121 pgs: 121 active+clean; 245 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 9.1 MiB/s wr, 35 op/s 2024-01-13T18:09:49.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:48 smithi084 ceph-mon[116404]: osdmap e607: 8 total, 8 up, 8 in 2024-01-13T18:09:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:48 smithi084 ceph-mon[119097]: pgmap v621: 121 pgs: 121 active+clean; 245 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 9.1 MiB/s wr, 35 op/s 2024-01-13T18:09:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:48 smithi084 ceph-mon[119097]: osdmap e607: 8 total, 8 up, 8 in 2024-01-13T18:09:49.692 INFO:tasks.rados.rados.0.smithi084.stdout:2730: done (1 left) 2024-01-13T18:09:49.865 INFO:tasks.rados.rados.0.smithi084.stdout:2731: setattr oid 1 current snap is 272 2024-01-13T18:09:49.866 INFO:tasks.rados.rados.0.smithi084.stdout:2729: finishing copy_from to smithi084102331-45 2024-01-13T18:09:49.866 INFO:tasks.rados.rados.0.smithi084.stdout:2729: got expected ENOENT (src dne) 2024-01-13T18:09:49.866 INFO:tasks.rados.rados.0.smithi084.stdout:2729: finishing copy_from racing read to smithi084102331-45 2024-01-13T18:09:49.867 INFO:tasks.rados.rados.0.smithi084.stdout:2729: done (1 left) 2024-01-13T18:09:49.867 INFO:tasks.rados.rados.0.smithi084.stdout:2732: snap_create 2024-01-13T18:09:49.868 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1435 (ObjNum 831 snap 268 seq_num 831) dirty exists 2024-01-13T18:09:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:09:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:09:50] "GET /metrics HTTP/1.1" 200 36193 "" "Prometheus/2.43.0" 2024-01-13T18:09:50.702 INFO:tasks.rados.rados.0.smithi084.stdout:2731: done (1 left) 2024-01-13T18:09:50.702 INFO:tasks.rados.rados.0.smithi084.stdout:2732: done (0 left) 2024-01-13T18:09:50.702 INFO:tasks.rados.rados.0.smithi084.stdout:2733: snap_remove snap 267 2024-01-13T18:09:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:50 smithi099 ceph-mon[138788]: osdmap e608: 8 total, 8 up, 8 in 2024-01-13T18:09:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:50 smithi099 ceph-mon[138788]: pgmap v624: 121 pgs: 121 active+clean; 247 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 9.2 MiB/s rd, 5.9 MiB/s wr, 25 op/s 2024-01-13T18:09:51.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:50 smithi084 ceph-mon[119097]: osdmap e608: 8 total, 8 up, 8 in 2024-01-13T18:09:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:50 smithi084 ceph-mon[119097]: pgmap v624: 121 pgs: 121 active+clean; 247 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 9.2 MiB/s rd, 5.9 MiB/s wr, 25 op/s 2024-01-13T18:09:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:50 smithi084 ceph-mon[116404]: osdmap e608: 8 total, 8 up, 8 in 2024-01-13T18:09:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:09:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:50 smithi084 ceph-mon[116404]: pgmap v624: 121 pgs: 121 active+clean; 247 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 9.2 MiB/s rd, 5.9 MiB/s wr, 25 op/s 2024-01-13T18:09:51.717 INFO:tasks.rados.rados.0.smithi084.stdout:2733: done (0 left) 2024-01-13T18:09:51.717 INFO:tasks.rados.rados.0.smithi084.stdout:2734: delete oid 29 current snap is 273 2024-01-13T18:09:51.724 INFO:tasks.rados.rados.0.smithi084.stdout:2734: done (0 left) 2024-01-13T18:09:51.724 INFO:tasks.rados.rados.0.smithi084.stdout:2735: copy_from oid 14 from oid 22 current snap is 273 2024-01-13T18:09:51.724 INFO:tasks.rados.rados.0.smithi084.stdout:2736: delete oid 40 current snap is 273 2024-01-13T18:09:51.728 INFO:tasks.rados.rados.0.smithi084.stdout:2736: done (1 left) 2024-01-13T18:09:51.728 INFO:tasks.rados.rados.0.smithi084.stdout:2737: delete oid 21 current snap is 273 2024-01-13T18:09:51.730 INFO:tasks.rados.rados.0.smithi084.stdout:2737: done (1 left) 2024-01-13T18:09:51.730 INFO:tasks.rados.rados.0.smithi084.stdout:2738: rmattr oid 28 current snap is 273 2024-01-13T18:09:51.730 INFO:tasks.rados.rados.0.smithi084.stdout:2739: read oid 49 snap 266 2024-01-13T18:09:51.730 INFO:tasks.rados.rados.0.smithi084.stdout:2739: expect (ObjNum 689 snap 216 seq_num 689) 2024-01-13T18:09:51.730 INFO:tasks.rados.rados.0.smithi084.stdout:2740: copy_from oid 29 from oid 45 current snap is 273 2024-01-13T18:09:51.730 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 273 2024-01-13T18:09:51.730 INFO:tasks.rados.rados.0.smithi084.stdout:2741: seq_num 845 ranges {1982464=557056,2539520=581632,3121152=688128,3809280=335872} 2024-01-13T18:09:51.746 INFO:tasks.rados.rados.0.smithi084.stdout:2741: writing smithi084102331-9 from 1982464 to 2539520 tid 1 2024-01-13T18:09:51.749 INFO:tasks.rados.rados.0.smithi084.stdout:2741: writing smithi084102331-9 from 2539520 to 3121152 tid 2 2024-01-13T18:09:51.755 INFO:tasks.rados.rados.0.smithi084.stdout:2741: writing smithi084102331-9 from 3121152 to 3809280 tid 3 2024-01-13T18:09:51.755 INFO:tasks.rados.rados.0.smithi084.stdout:2741: writing smithi084102331-9 from 3809280 to 4145152 tid 4 2024-01-13T18:09:51.755 INFO:tasks.rados.rados.0.smithi084.stdout:2742: read oid 37 snap -1 2024-01-13T18:09:51.755 INFO:tasks.rados.rados.0.smithi084.stdout:2742: expect (ObjNum 839 snap 271 seq_num 839) 2024-01-13T18:09:51.756 INFO:tasks.rados.rados.0.smithi084.stdout:2743: snap_remove snap 242 2024-01-13T18:09:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:51 smithi099 ceph-mon[138788]: osdmap e609: 8 total, 8 up, 8 in 2024-01-13T18:09:52.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:51 smithi084 ceph-mon[116404]: osdmap e609: 8 total, 8 up, 8 in 2024-01-13T18:09:52.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:51 smithi084 ceph-mon[119097]: osdmap e609: 8 total, 8 up, 8 in 2024-01-13T18:09:52.691 INFO:tasks.rados.rados.0.smithi084.stdout:2743: done (6 left) 2024-01-13T18:09:52.692 INFO:tasks.rados.rados.0.smithi084.stdout:2744: copy_from oid 41 from oid 11 current snap is 273 2024-01-13T18:09:52.692 INFO:tasks.rados.rados.0.smithi084.stdout:2740: finishing copy_from to smithi084102331-29 2024-01-13T18:09:52.692 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1311 (ObjNum 741 snap 230 seq_num 741) dirty exists 2024-01-13T18:09:52.692 INFO:tasks.rados.rados.0.smithi084.stdout:2740: finishing copy_from racing read to smithi084102331-29 2024-01-13T18:09:52.692 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1118 (ObjNum 737 snap 0 seq_num 2816904349) dirty exists 2024-01-13T18:09:52.692 INFO:tasks.rados.rados.0.smithi084.stdout:2741: finishing write tid 1 to smithi084102331-9 2024-01-13T18:09:52.692 INFO:tasks.rados.rados.0.smithi084.stdout:2741: finishing write tid 2 to smithi084102331-9 2024-01-13T18:09:52.692 INFO:tasks.rados.rados.0.smithi084.stdout:2741: finishing write tid 3 to smithi084102331-9 2024-01-13T18:09:52.693 INFO:tasks.rados.rados.0.smithi084.stdout:2741: finishing write tid 4 to smithi084102331-9 2024-01-13T18:09:52.693 INFO:tasks.rados.rados.0.smithi084.stdout:2741: finishing write tid 5 to smithi084102331-9 2024-01-13T18:09:52.693 INFO:tasks.rados.rados.0.smithi084.stdout:2741: finishing write tid 6 to smithi084102331-9 2024-01-13T18:09:52.693 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1129 (ObjNum 845 snap 273 seq_num 845) dirty exists 2024-01-13T18:09:52.693 INFO:tasks.rados.rados.0.smithi084.stdout:2741: left oid 9 (ObjNum 845 snap 273 seq_num 845) 2024-01-13T18:09:52.693 INFO:tasks.rados.rados.0.smithi084.stdout:2739: expect (ObjNum 689 snap 216 seq_num 689) 2024-01-13T18:09:53.001 INFO:tasks.rados.rados.0.smithi084.stdout:2735: finishing copy_from to smithi084102331-14 2024-01-13T18:09:53.001 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1428 (ObjNum 802 snap 258 seq_num 802) dirty exists 2024-01-13T18:09:53.001 INFO:tasks.rados.rados.0.smithi084.stdout:2735: finishing copy_from racing read to smithi084102331-14 2024-01-13T18:09:53.001 INFO:tasks.rados.rados.0.smithi084.stdout:2735: done (6 left) 2024-01-13T18:09:53.001 INFO:tasks.rados.rados.0.smithi084.stdout:2738: done (5 left) 2024-01-13T18:09:53.001 INFO:tasks.rados.rados.0.smithi084.stdout:2739: done (4 left) 2024-01-13T18:09:53.001 INFO:tasks.rados.rados.0.smithi084.stdout:2740: done (3 left) 2024-01-13T18:09:53.002 INFO:tasks.rados.rados.0.smithi084.stdout:2741: done (2 left) 2024-01-13T18:09:53.002 INFO:tasks.rados.rados.0.smithi084.stdout:2745: read oid 46 snap 248 2024-01-13T18:09:53.002 INFO:tasks.rados.rados.0.smithi084.stdout:2745: expect (ObjNum -257509072 snap 21877 seq_num 4036837808) 2024-01-13T18:09:53.002 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 273 2024-01-13T18:09:53.002 INFO:tasks.rados.rados.0.smithi084.stdout:2746: seq_num 846 ranges {0=573440,573440=466944,1040384=491520,1531904=548864,2080768=98304} 2024-01-13T18:09:53.004 INFO:tasks.rados.rados.0.smithi084.stdout:2746: writing smithi084102331-28 from 0 to 573440 tid 1 2024-01-13T18:09:53.006 INFO:tasks.rados.rados.0.smithi084.stdout:2746: writing smithi084102331-28 from 573440 to 1040384 tid 2 2024-01-13T18:09:53.009 INFO:tasks.rados.rados.0.smithi084.stdout:2746: writing smithi084102331-28 from 1040384 to 1531904 tid 3 2024-01-13T18:09:53.012 INFO:tasks.rados.rados.0.smithi084.stdout:2746: writing smithi084102331-28 from 1531904 to 2080768 tid 4 2024-01-13T18:09:53.014 INFO:tasks.rados.rados.0.smithi084.stdout:2746: writing smithi084102331-28 from 2080768 to 2179072 tid 5 2024-01-13T18:09:53.014 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 273 2024-01-13T18:09:53.014 INFO:tasks.rados.rados.0.smithi084.stdout:2742: expect (ObjNum 839 snap 271 seq_num 839) 2024-01-13T18:09:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:52 smithi099 ceph-mon[138788]: osdmap e610: 8 total, 8 up, 8 in 2024-01-13T18:09:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:52 smithi099 ceph-mon[138788]: pgmap v627: 121 pgs: 121 active+clean; 240 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 504 KiB/s wr, 10 op/s 2024-01-13T18:09:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:52 smithi099 ceph-mon[138788]: osdmap e611: 8 total, 8 up, 8 in 2024-01-13T18:09:53.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:52 smithi084 ceph-mon[116404]: osdmap e610: 8 total, 8 up, 8 in 2024-01-13T18:09:53.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:52 smithi084 ceph-mon[116404]: pgmap v627: 121 pgs: 121 active+clean; 240 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 504 KiB/s wr, 10 op/s 2024-01-13T18:09:53.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:52 smithi084 ceph-mon[116404]: osdmap e611: 8 total, 8 up, 8 in 2024-01-13T18:09:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:52 smithi084 ceph-mon[119097]: osdmap e610: 8 total, 8 up, 8 in 2024-01-13T18:09:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:52 smithi084 ceph-mon[119097]: pgmap v627: 121 pgs: 121 active+clean; 240 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 504 KiB/s wr, 10 op/s 2024-01-13T18:09:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:52 smithi084 ceph-mon[119097]: osdmap e611: 8 total, 8 up, 8 in 2024-01-13T18:09:53.240 INFO:tasks.rados.rados.0.smithi084.stdout:2744: finishing copy_from to smithi084102331-41 2024-01-13T18:09:53.240 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1246 (ObjNum 702 snap 220 seq_num 702) dirty exists 2024-01-13T18:09:53.240 INFO:tasks.rados.rados.0.smithi084.stdout:2744: finishing copy_from racing read to smithi084102331-41 2024-01-13T18:09:53.240 INFO:tasks.rados.rados.0.smithi084.stdout:2745: expect (ObjNum -257509072 snap 21877 seq_num 4036837808) 2024-01-13T18:09:53.243 INFO:tasks.rados.rados.0.smithi084.stdout:2746: finishing write tid 1 to smithi084102331-28 2024-01-13T18:09:53.243 INFO:tasks.rados.rados.0.smithi084.stdout:2746: finishing write tid 2 to smithi084102331-28 2024-01-13T18:09:53.243 INFO:tasks.rados.rados.0.smithi084.stdout:2746: finishing write tid 3 to smithi084102331-28 2024-01-13T18:09:53.243 INFO:tasks.rados.rados.0.smithi084.stdout:2746: finishing write tid 4 to smithi084102331-28 2024-01-13T18:09:53.243 INFO:tasks.rados.rados.0.smithi084.stdout:2746: finishing write tid 5 to smithi084102331-28 2024-01-13T18:09:53.243 INFO:tasks.rados.rados.0.smithi084.stdout:2746: finishing write tid 6 to smithi084102331-28 2024-01-13T18:09:53.243 INFO:tasks.rados.rados.0.smithi084.stdout:2746: finishing write tid 7 to smithi084102331-28 2024-01-13T18:09:53.243 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1124 (ObjNum 846 snap 273 seq_num 846) dirty exists 2024-01-13T18:09:53.243 INFO:tasks.rados.rados.0.smithi084.stdout:2746: left oid 28 (ObjNum 846 snap 273 seq_num 846) 2024-01-13T18:09:53.243 INFO:tasks.rados.rados.0.smithi084.stdout:2747: seq_num 847 ranges {1343488=589824,1933312=753664,2686976=655360,3342336=196608} 2024-01-13T18:09:53.253 INFO:tasks.rados.rados.0.smithi084.stdout:2747: writing smithi084102331-43 from 1343488 to 1933312 tid 1 2024-01-13T18:09:53.259 INFO:tasks.rados.rados.0.smithi084.stdout:2747: writing smithi084102331-43 from 1933312 to 2686976 tid 2 2024-01-13T18:09:53.261 INFO:tasks.rados.rados.0.smithi084.stdout:2747: writing smithi084102331-43 from 2686976 to 3342336 tid 3 2024-01-13T18:09:53.263 INFO:tasks.rados.rados.0.smithi084.stdout:2747: writing smithi084102331-43 from 3342336 to 3538944 tid 4 2024-01-13T18:09:53.263 INFO:tasks.rados.rados.0.smithi084.stdout:2742: done (4 left) 2024-01-13T18:09:53.263 INFO:tasks.rados.rados.0.smithi084.stdout:2744: done (3 left) 2024-01-13T18:09:53.264 INFO:tasks.rados.rados.0.smithi084.stdout:2745: done (2 left) 2024-01-13T18:09:53.264 INFO:tasks.rados.rados.0.smithi084.stdout:2746: done (1 left) 2024-01-13T18:09:53.264 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 273 2024-01-13T18:09:53.264 INFO:tasks.rados.rados.0.smithi084.stdout:2747: finishing write tid 1 to smithi084102331-43 2024-01-13T18:09:53.264 INFO:tasks.rados.rados.0.smithi084.stdout:2747: finishing write tid 2 to smithi084102331-43 2024-01-13T18:09:53.264 INFO:tasks.rados.rados.0.smithi084.stdout:2748: seq_num 848 ranges {7299072=606208,7905280=630784,8536064=458752,8994816=516096} 2024-01-13T18:09:53.305 INFO:tasks.rados.rados.0.smithi084.stdout:2748: writing smithi084102331-15 from 7299072 to 7905280 tid 1 2024-01-13T18:09:53.308 INFO:tasks.rados.rados.0.smithi084.stdout:2748: writing smithi084102331-15 from 7905280 to 8536064 tid 2 2024-01-13T18:09:53.310 INFO:tasks.rados.rados.0.smithi084.stdout:2748: writing smithi084102331-15 from 8536064 to 8994816 tid 3 2024-01-13T18:09:53.314 INFO:tasks.rados.rados.0.smithi084.stdout:2748: writing smithi084102331-15 from 8994816 to 9510912 tid 4 2024-01-13T18:09:53.314 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 273 2024-01-13T18:09:53.314 INFO:tasks.rados.rados.0.smithi084.stdout:2747: finishing write tid 3 to smithi084102331-43 2024-01-13T18:09:53.314 INFO:tasks.rados.rados.0.smithi084.stdout:2749: seq_num 849 ranges {8830976=622592,9453568=516096,9969664=663552,10633216=425984} 2024-01-13T18:09:53.364 INFO:tasks.rados.rados.0.smithi084.stdout:2749: writing smithi084102331-18 from 8830976 to 9453568 tid 1 2024-01-13T18:09:53.366 INFO:tasks.rados.rados.0.smithi084.stdout:2749: writing smithi084102331-18 from 9453568 to 9969664 tid 2 2024-01-13T18:09:53.370 INFO:tasks.rados.rados.0.smithi084.stdout:2749: writing smithi084102331-18 from 9969664 to 10633216 tid 3 2024-01-13T18:09:53.373 INFO:tasks.rados.rados.0.smithi084.stdout:2749: writing smithi084102331-18 from 10633216 to 11059200 tid 4 2024-01-13T18:09:53.373 INFO:tasks.rados.rados.0.smithi084.stdout:2750: read oid 42 snap -1 2024-01-13T18:09:53.373 INFO:tasks.rados.rados.0.smithi084.stdout:2750: expect deleted 2024-01-13T18:09:53.373 INFO:tasks.rados.rados.0.smithi084.stdout:2751: snap_remove snap 257 2024-01-13T18:09:53.718 INFO:tasks.rados.rados.0.smithi084.stdout:2751: done (4 left) 2024-01-13T18:09:53.718 INFO:tasks.rados.rados.0.smithi084.stdout:2752: delete oid 3 current snap is 273 2024-01-13T18:09:53.718 INFO:tasks.rados.rados.0.smithi084.stdout:2747: finishing write tid 4 to smithi084102331-43 2024-01-13T18:09:53.718 INFO:tasks.rados.rados.0.smithi084.stdout:2747: finishing write tid 5 to smithi084102331-43 2024-01-13T18:09:53.718 INFO:tasks.rados.rados.0.smithi084.stdout:2747: finishing write tid 6 to smithi084102331-43 2024-01-13T18:09:53.718 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1312 (ObjNum 847 snap 273 seq_num 847) dirty exists 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2747: left oid 43 (ObjNum 847 snap 273 seq_num 847) 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2748: finishing write tid 1 to smithi084102331-15 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2748: finishing write tid 2 to smithi084102331-15 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2748: finishing write tid 3 to smithi084102331-15 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2748: finishing write tid 4 to smithi084102331-15 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2748: finishing write tid 5 to smithi084102331-15 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2748: finishing write tid 6 to smithi084102331-15 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1359 (ObjNum 848 snap 273 seq_num 848) dirty exists 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2748: left oid 15 (ObjNum 848 snap 273 seq_num 848) 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 1 to smithi084102331-18 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 2 to smithi084102331-18 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 3 to smithi084102331-18 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 4 to smithi084102331-18 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 5 to smithi084102331-18 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 6 to smithi084102331-18 2024-01-13T18:09:53.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1113 (ObjNum 849 snap 273 seq_num 849) dirty exists 2024-01-13T18:09:53.720 INFO:tasks.rados.rados.0.smithi084.stdout:2749: left oid 18 (ObjNum 849 snap 273 seq_num 849) 2024-01-13T18:09:53.733 INFO:tasks.rados.rados.0.smithi084.stdout:2747: done (4 left) 2024-01-13T18:09:53.733 INFO:tasks.rados.rados.0.smithi084.stdout:2748: done (3 left) 2024-01-13T18:09:53.733 INFO:tasks.rados.rados.0.smithi084.stdout:2749: done (2 left) 2024-01-13T18:09:53.733 INFO:tasks.rados.rados.0.smithi084.stdout:2750: done (1 left) 2024-01-13T18:09:53.733 INFO:tasks.rados.rados.0.smithi084.stdout:2752: done (0 left) 2024-01-13T18:09:53.733 INFO:tasks.rados.rados.0.smithi084.stdout:2753: delete oid 39 current snap is 273 2024-01-13T18:09:53.740 INFO:tasks.rados.rados.0.smithi084.stdout:2753: done (0 left) 2024-01-13T18:09:53.740 INFO:tasks.rados.rados.0.smithi084.stdout:2754: copy_from oid 18 from oid 48 current snap is 273 2024-01-13T18:09:53.740 INFO:tasks.rados.rados.0.smithi084.stdout:2755: read oid 29 snap -1 2024-01-13T18:09:53.740 INFO:tasks.rados.rados.0.smithi084.stdout:2755: expect (ObjNum 741 snap 230 seq_num 741) 2024-01-13T18:09:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:2756: read oid 12 snap -1 2024-01-13T18:09:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:2756: expect (ObjNum 832 snap 270 seq_num 832) 2024-01-13T18:09:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 273 2024-01-13T18:09:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:2757: seq_num 852 ranges {0=671744,671744=622592,1294336=442368,1736704=540672} 2024-01-13T18:09:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:2757: writing smithi084102331-21 from 0 to 671744 tid 1 2024-01-13T18:09:53.748 INFO:tasks.rados.rados.0.smithi084.stdout:2757: writing smithi084102331-21 from 671744 to 1294336 tid 2 2024-01-13T18:09:53.750 INFO:tasks.rados.rados.0.smithi084.stdout:2757: writing smithi084102331-21 from 1294336 to 1736704 tid 3 2024-01-13T18:09:53.754 INFO:tasks.rados.rados.0.smithi084.stdout:2757: writing smithi084102331-21 from 1736704 to 2277376 tid 4 2024-01-13T18:09:53.754 INFO:tasks.rados.rados.0.smithi084.stdout:2758: read oid 17 snap -1 2024-01-13T18:09:53.754 INFO:tasks.rados.rados.0.smithi084.stdout:2758: expect deleted 2024-01-13T18:09:53.754 INFO:tasks.rados.rados.0.smithi084.stdout:2759: rollback oid 3 current snap is 273 2024-01-13T18:09:53.754 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 252 2024-01-13T18:09:53.754 INFO:tasks.rados.rados.0.smithi084.stdout:2755: expect (ObjNum 741 snap 230 seq_num 741) 2024-01-13T18:09:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:2757: finishing write tid 1 to smithi084102331-21 2024-01-13T18:09:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:2757: finishing write tid 2 to smithi084102331-21 2024-01-13T18:09:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:2755: done (5 left) 2024-01-13T18:09:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:2760: snap_remove snap 266 2024-01-13T18:09:54.734 INFO:tasks.rados.rados.0.smithi084.stdout:2760: done (5 left) 2024-01-13T18:09:54.734 INFO:tasks.rados.rados.0.smithi084.stdout:2761: snap_remove snap 272 2024-01-13T18:09:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:54 smithi099 ceph-mon[138788]: osdmap e612: 8 total, 8 up, 8 in 2024-01-13T18:09:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:54 smithi099 ceph-mon[138788]: pgmap v630: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 238 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 544 KiB/s wr, 7 op/s 2024-01-13T18:09:55.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:54 smithi084 ceph-mon[116404]: osdmap e612: 8 total, 8 up, 8 in 2024-01-13T18:09:55.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:54 smithi084 ceph-mon[116404]: pgmap v630: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 238 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 544 KiB/s wr, 7 op/s 2024-01-13T18:09:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:54 smithi084 ceph-mon[119097]: osdmap e612: 8 total, 8 up, 8 in 2024-01-13T18:09:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:54 smithi084 ceph-mon[119097]: pgmap v630: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 238 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 544 KiB/s wr, 7 op/s 2024-01-13T18:09:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:2761: done (5 left) 2024-01-13T18:09:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:2762: rmattr oid 2 current snap is 273 2024-01-13T18:09:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:2762: done (5 left) 2024-01-13T18:09:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 273 2024-01-13T18:09:55.729 INFO:tasks.rados.rados.0.smithi084.stdout:2763: seq_num 853 ranges {3276800=696320,3973120=507904,4481024=647168,5128192=450560} 2024-01-13T18:09:55.750 INFO:tasks.rados.rados.0.smithi084.stdout:2763: writing smithi084102331-34 from 3276800 to 3973120 tid 1 2024-01-13T18:09:55.753 INFO:tasks.rados.rados.0.smithi084.stdout:2763: writing smithi084102331-34 from 3973120 to 4481024 tid 2 2024-01-13T18:09:55.757 INFO:tasks.rados.rados.0.smithi084.stdout:2763: writing smithi084102331-34 from 4481024 to 5128192 tid 3 2024-01-13T18:09:55.761 INFO:tasks.rados.rados.0.smithi084.stdout:2763: writing smithi084102331-34 from 5128192 to 5578752 tid 4 2024-01-13T18:09:55.761 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 273 2024-01-13T18:09:55.762 INFO:tasks.rados.rados.0.smithi084.stdout:2764: seq_num 854 ranges {417792=712704,1130496=794624,1925120=450560,2375680=360448} 2024-01-13T18:09:55.767 INFO:tasks.rados.rados.0.smithi084.stdout:2764: writing smithi084102331-45 from 417792 to 1130496 tid 1 2024-01-13T18:09:55.772 INFO:tasks.rados.rados.0.smithi084.stdout:2764: writing smithi084102331-45 from 1130496 to 1925120 tid 2 2024-01-13T18:09:55.775 INFO:tasks.rados.rados.0.smithi084.stdout:2764: writing smithi084102331-45 from 1925120 to 2375680 tid 3 2024-01-13T18:09:55.777 INFO:tasks.rados.rados.0.smithi084.stdout:2764: writing smithi084102331-45 from 2375680 to 2736128 tid 4 2024-01-13T18:09:55.777 INFO:tasks.rados.rados.0.smithi084.stdout:2765: read oid 40 snap -1 2024-01-13T18:09:55.777 INFO:tasks.rados.rados.0.smithi084.stdout:2765: expect deleted 2024-01-13T18:09:55.777 INFO:tasks.rados.rados.0.smithi084.stdout:2766: snap_remove snap 256 2024-01-13T18:09:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:55 smithi099 ceph-mon[138788]: osdmap e613: 8 total, 8 up, 8 in 2024-01-13T18:09:56.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:55 smithi084 ceph-mon[116404]: osdmap e613: 8 total, 8 up, 8 in 2024-01-13T18:09:56.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:55 smithi084 ceph-mon[119097]: osdmap e613: 8 total, 8 up, 8 in 2024-01-13T18:09:56.748 INFO:tasks.rados.rados.0.smithi084.stdout:2766: done (8 left) 2024-01-13T18:09:56.748 INFO:tasks.rados.rados.0.smithi084.stdout:2767: setattr oid 6 current snap is 273 2024-01-13T18:09:56.751 INFO:tasks.rados.rados.0.smithi084.stdout:2757: finishing write tid 3 to smithi084102331-21 2024-01-13T18:09:56.751 INFO:tasks.rados.rados.0.smithi084.stdout:2759: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:09:56.751 INFO:tasks.rados.rados.0.smithi084.stdout:2759: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:09:56.751 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1453 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:09:56.751 INFO:tasks.rados.rados.0.smithi084.stdout:2757: finishing write tid 4 to smithi084102331-21 2024-01-13T18:09:56.751 INFO:tasks.rados.rados.0.smithi084.stdout:2757: finishing write tid 5 to smithi084102331-21 2024-01-13T18:09:56.752 INFO:tasks.rados.rados.0.smithi084.stdout:2757: finishing write tid 6 to smithi084102331-21 2024-01-13T18:09:56.752 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 1316 (ObjNum 852 snap 273 seq_num 852) dirty exists 2024-01-13T18:09:56.752 INFO:tasks.rados.rados.0.smithi084.stdout:2757: left oid 21 (ObjNum 852 snap 273 seq_num 852) 2024-01-13T18:09:56.752 INFO:tasks.rados.rados.0.smithi084.stdout:2756: expect (ObjNum 832 snap 270 seq_num 832) 2024-01-13T18:09:56.861 INFO:tasks.rados.rados.0.smithi084.stdout:2754: finishing copy_from to smithi084102331-18 2024-01-13T18:09:56.861 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1382 (ObjNum 819 snap 267 seq_num 819) dirty exists 2024-01-13T18:09:56.861 INFO:tasks.rados.rados.0.smithi084.stdout:2754: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:09:56.861 INFO:tasks.rados.rados.0.smithi084.stdout:2763: finishing write tid 1 to smithi084102331-34 2024-01-13T18:09:56.861 INFO:tasks.rados.rados.0.smithi084.stdout:2763: finishing write tid 2 to smithi084102331-34 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:2763: finishing write tid 3 to smithi084102331-34 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:2763: finishing write tid 4 to smithi084102331-34 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:2763: finishing write tid 5 to smithi084102331-34 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:2763: finishing write tid 6 to smithi084102331-34 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 1134 (ObjNum 853 snap 273 seq_num 853) dirty exists 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:2763: left oid 34 (ObjNum 853 snap 273 seq_num 853) 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:2764: finishing write tid 1 to smithi084102331-45 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:2764: finishing write tid 2 to smithi084102331-45 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:2764: finishing write tid 3 to smithi084102331-45 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:2764: finishing write tid 4 to smithi084102331-45 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:2764: finishing write tid 5 to smithi084102331-45 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:2764: finishing write tid 6 to smithi084102331-45 2024-01-13T18:09:56.862 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1465 (ObjNum 854 snap 273 seq_num 854) dirty exists 2024-01-13T18:09:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:2764: left oid 45 (ObjNum 854 snap 273 seq_num 854) 2024-01-13T18:09:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:2754: done (8 left) 2024-01-13T18:09:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:2756: done (7 left) 2024-01-13T18:09:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:2757: done (6 left) 2024-01-13T18:09:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:2758: done (5 left) 2024-01-13T18:09:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:2759: done (4 left) 2024-01-13T18:09:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:2763: done (3 left) 2024-01-13T18:09:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:2764: done (2 left) 2024-01-13T18:09:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:2765: done (1 left) 2024-01-13T18:09:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 273 2024-01-13T18:09:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:2768: seq_num 855 ranges {5300224=729088,6029312=671744,6701056=663552,7364608=270336} 2024-01-13T18:09:56.893 INFO:tasks.rados.rados.0.smithi084.stdout:2768: writing smithi084102331-48 from 5300224 to 6029312 tid 1 2024-01-13T18:09:56.896 INFO:tasks.rados.rados.0.smithi084.stdout:2768: writing smithi084102331-48 from 6029312 to 6701056 tid 2 2024-01-13T18:09:56.900 INFO:tasks.rados.rados.0.smithi084.stdout:2768: writing smithi084102331-48 from 6701056 to 7364608 tid 3 2024-01-13T18:09:56.902 INFO:tasks.rados.rados.0.smithi084.stdout:2768: writing smithi084102331-48 from 7364608 to 7634944 tid 4 2024-01-13T18:09:56.902 INFO:tasks.rados.rados.0.smithi084.stdout:2769: snap_remove snap 252 2024-01-13T18:09:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:56 smithi099 ceph-mon[138788]: osdmap e614: 8 total, 8 up, 8 in 2024-01-13T18:09:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:56 smithi099 ceph-mon[138788]: pgmap v633: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 236 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:09:57.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:56 smithi084 ceph-mon[116404]: osdmap e614: 8 total, 8 up, 8 in 2024-01-13T18:09:57.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:56 smithi084 ceph-mon[116404]: pgmap v633: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 236 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:09:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:56 smithi084 ceph-mon[119097]: osdmap e614: 8 total, 8 up, 8 in 2024-01-13T18:09:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:56 smithi084 ceph-mon[119097]: pgmap v633: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 236 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:09:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:2769: done (2 left) 2024-01-13T18:09:57.696 INFO:tasks.rados.rados.0.smithi084.stdout:2770: snap_remove snap 268 2024-01-13T18:09:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:57 smithi099 ceph-mon[138788]: osdmap e615: 8 total, 8 up, 8 in 2024-01-13T18:09:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:57 smithi099 ceph-mon[138788]: osdmap e616: 8 total, 8 up, 8 in 2024-01-13T18:09:58.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:57 smithi084 ceph-mon[116404]: osdmap e615: 8 total, 8 up, 8 in 2024-01-13T18:09:58.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:57 smithi084 ceph-mon[116404]: osdmap e616: 8 total, 8 up, 8 in 2024-01-13T18:09:58.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:57 smithi084 ceph-mon[119097]: osdmap e615: 8 total, 8 up, 8 in 2024-01-13T18:09:58.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:57 smithi084 ceph-mon[119097]: osdmap e616: 8 total, 8 up, 8 in 2024-01-13T18:09:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2770: done (2 left) 2024-01-13T18:09:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2771: delete oid 31 current snap is 273 2024-01-13T18:09:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 1135 (ObjNum 825 snap 267 seq_num 825) dirty exists 2024-01-13T18:09:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2768: finishing write tid 1 to smithi084102331-48 2024-01-13T18:09:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2768: finishing write tid 2 to smithi084102331-48 2024-01-13T18:09:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2768: finishing write tid 3 to smithi084102331-48 2024-01-13T18:09:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2768: finishing write tid 4 to smithi084102331-48 2024-01-13T18:09:58.704 INFO:tasks.rados.rados.0.smithi084.stdout:2768: finishing write tid 5 to smithi084102331-48 2024-01-13T18:09:58.705 INFO:tasks.rados.rados.0.smithi084.stdout:2768: finishing write tid 6 to smithi084102331-48 2024-01-13T18:09:58.705 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1500 (ObjNum 855 snap 273 seq_num 855) dirty exists 2024-01-13T18:09:58.705 INFO:tasks.rados.rados.0.smithi084.stdout:2768: left oid 48 (ObjNum 855 snap 273 seq_num 855) 2024-01-13T18:09:58.713 INFO:tasks.rados.rados.0.smithi084.stdout:2767: done (2 left) 2024-01-13T18:09:58.713 INFO:tasks.rados.rados.0.smithi084.stdout:2768: done (1 left) 2024-01-13T18:09:58.713 INFO:tasks.rados.rados.0.smithi084.stdout:2771: done (0 left) 2024-01-13T18:09:58.713 INFO:tasks.rados.rados.0.smithi084.stdout:2772: delete oid 19 current snap is 273 2024-01-13T18:09:58.716 INFO:tasks.rados.rados.0.smithi084.stdout:2772: done (0 left) 2024-01-13T18:09:58.716 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 273 2024-01-13T18:09:58.716 INFO:tasks.rados.rados.0.smithi084.stdout:2773: seq_num 858 ranges {5300224=778240,6078464=729088,6807552=434176,7241728=442368} 2024-01-13T18:09:58.750 INFO:tasks.rados.rados.0.smithi084.stdout:2773: writing smithi084102331-18 from 5300224 to 6078464 tid 1 2024-01-13T18:09:58.754 INFO:tasks.rados.rados.0.smithi084.stdout:2773: writing smithi084102331-18 from 6078464 to 6807552 tid 2 2024-01-13T18:09:58.757 INFO:tasks.rados.rados.0.smithi084.stdout:2773: writing smithi084102331-18 from 6807552 to 7241728 tid 3 2024-01-13T18:09:58.760 INFO:tasks.rados.rados.0.smithi084.stdout:2773: writing smithi084102331-18 from 7241728 to 7684096 tid 4 2024-01-13T18:09:58.760 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 273 2024-01-13T18:09:58.760 INFO:tasks.rados.rados.0.smithi084.stdout:2773: finishing write tid 1 to smithi084102331-18 2024-01-13T18:09:58.760 INFO:tasks.rados.rados.0.smithi084.stdout:2773: finishing write tid 2 to smithi084102331-18 2024-01-13T18:09:58.760 INFO:tasks.rados.rados.0.smithi084.stdout:2773: finishing write tid 3 to smithi084102331-18 2024-01-13T18:09:58.760 INFO:tasks.rados.rados.0.smithi084.stdout:2774: seq_num 859 ranges {6774784=794624,7569408=614400,8183808=638976,8822784=352256} 2024-01-13T18:09:58.800 INFO:tasks.rados.rados.0.smithi084.stdout:2774: writing smithi084102331-14 from 6774784 to 7569408 tid 1 2024-01-13T18:09:58.803 INFO:tasks.rados.rados.0.smithi084.stdout:2774: writing smithi084102331-14 from 7569408 to 8183808 tid 2 2024-01-13T18:09:58.807 INFO:tasks.rados.rados.0.smithi084.stdout:2774: writing smithi084102331-14 from 8183808 to 8822784 tid 3 2024-01-13T18:09:58.809 INFO:tasks.rados.rados.0.smithi084.stdout:2774: writing smithi084102331-14 from 8822784 to 9175040 tid 4 2024-01-13T18:09:58.809 INFO:tasks.rados.rados.0.smithi084.stdout:2775: delete oid 35 current snap is 273 2024-01-13T18:09:58.809 INFO:tasks.rados.rados.0.smithi084.stdout:2773: finishing write tid 4 to smithi084102331-18 2024-01-13T18:09:58.809 INFO:tasks.rados.rados.0.smithi084.stdout:2773: finishing write tid 5 to smithi084102331-18 2024-01-13T18:09:58.810 INFO:tasks.rados.rados.0.smithi084.stdout:2773: finishing write tid 6 to smithi084102331-18 2024-01-13T18:09:58.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1387 (ObjNum 858 snap 273 seq_num 858) dirty exists 2024-01-13T18:09:58.810 INFO:tasks.rados.rados.0.smithi084.stdout:2773: left oid 18 (ObjNum 858 snap 273 seq_num 858) 2024-01-13T18:09:58.810 INFO:tasks.rados.rados.0.smithi084.stdout:2774: finishing write tid 1 to smithi084102331-14 2024-01-13T18:09:58.810 INFO:tasks.rados.rados.0.smithi084.stdout:2774: finishing write tid 2 to smithi084102331-14 2024-01-13T18:09:58.811 INFO:tasks.rados.rados.0.smithi084.stdout:2773: done (2 left) 2024-01-13T18:09:58.811 INFO:tasks.rados.rados.0.smithi084.stdout:2775: done (1 left) 2024-01-13T18:09:58.811 INFO:tasks.rados.rados.0.smithi084.stdout:2776: setattr oid 35 current snap is 273 2024-01-13T18:09:58.812 INFO:tasks.rados.rados.0.smithi084.stdout:2774: finishing write tid 3 to smithi084102331-14 2024-01-13T18:09:58.812 INFO:tasks.rados.rados.0.smithi084.stdout:2774: finishing write tid 4 to smithi084102331-14 2024-01-13T18:09:58.813 INFO:tasks.rados.rados.0.smithi084.stdout:2774: finishing write tid 5 to smithi084102331-14 2024-01-13T18:09:58.813 INFO:tasks.rados.rados.0.smithi084.stdout:2777: copy_from oid 26 from oid 1 current snap is 273 2024-01-13T18:09:58.813 INFO:tasks.rados.rados.0.smithi084.stdout:2778: copy_from oid 17 from oid 29 current snap is 273 2024-01-13T18:09:58.813 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 273 2024-01-13T18:09:58.813 INFO:tasks.rados.rados.0.smithi084.stdout:2779: seq_num 861 ranges {483328=24576} 2024-01-13T18:09:58.816 INFO:tasks.rados.rados.0.smithi084.stdout:2779: writing smithi084102331-27 from 483328 to 507904 tid 1 2024-01-13T18:09:58.816 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 273 2024-01-13T18:09:58.816 INFO:tasks.rados.rados.0.smithi084.stdout:2780: seq_num 862 ranges {671744=40960} 2024-01-13T18:09:58.820 INFO:tasks.rados.rados.0.smithi084.stdout:2780: writing smithi084102331-2 from 671744 to 712704 tid 1 2024-01-13T18:09:58.821 INFO:tasks.rados.rados.0.smithi084.stdout:2781: read oid 9 snap -1 2024-01-13T18:09:58.821 INFO:tasks.rados.rados.0.smithi084.stdout:2781: expect (ObjNum 845 snap 273 seq_num 845) 2024-01-13T18:09:58.821 INFO:tasks.rados.rados.0.smithi084.stdout:2782: rmattr oid 28 current snap is 273 2024-01-13T18:09:58.821 INFO:tasks.rados.rados.0.smithi084.stdout:2783: rollback oid 47 current snap is 273 2024-01-13T18:09:58.821 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 265 2024-01-13T18:09:58.821 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 273 2024-01-13T18:09:58.821 INFO:tasks.rados.rados.0.smithi084.stdout:2784: seq_num 863 ranges {8011776=57344} 2024-01-13T18:09:58.864 INFO:tasks.rados.rados.0.smithi084.stdout:2784: writing smithi084102331-16 from 8011776 to 8069120 tid 1 2024-01-13T18:09:58.864 INFO:tasks.rados.rados.0.smithi084.stdout:2785: read oid 37 snap -1 2024-01-13T18:09:58.864 INFO:tasks.rados.rados.0.smithi084.stdout:2785: expect (ObjNum 839 snap 271 seq_num 839) 2024-01-13T18:09:58.864 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 273 2024-01-13T18:09:58.864 INFO:tasks.rados.rados.0.smithi084.stdout:2774: finishing write tid 6 to smithi084102331-14 2024-01-13T18:09:58.865 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1433 (ObjNum 859 snap 273 seq_num 859) dirty exists 2024-01-13T18:09:58.865 INFO:tasks.rados.rados.0.smithi084.stdout:2774: left oid 14 (ObjNum 859 snap 273 seq_num 859) 2024-01-13T18:09:58.865 INFO:tasks.rados.rados.0.smithi084.stdout:2786: seq_num 864 ranges {6643712=73728} 2024-01-13T18:09:58.902 INFO:tasks.rados.rados.0.smithi084.stdout:2786: writing smithi084102331-11 from 6643712 to 6717440 tid 1 2024-01-13T18:09:58.902 INFO:tasks.rados.rados.0.smithi084.stdout:2774: done (11 left) 2024-01-13T18:09:58.902 INFO:tasks.rados.rados.0.smithi084.stdout:2787: copy_from oid 42 from oid 20 current snap is 273 2024-01-13T18:09:58.902 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1318 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:09:58.902 INFO:tasks.rados.rados.0.smithi084.stdout:2778: finishing copy_from to smithi084102331-17 2024-01-13T18:09:58.902 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1311 (ObjNum 741 snap 230 seq_num 741) dirty exists 2024-01-13T18:09:58.902 INFO:tasks.rados.rados.0.smithi084.stdout:2778: finishing copy_from racing read to smithi084102331-17 2024-01-13T18:09:58.902 INFO:tasks.rados.rados.0.smithi084.stdout:2779: finishing write tid 1 to smithi084102331-27 2024-01-13T18:09:58.902 INFO:tasks.rados.rados.0.smithi084.stdout:2779: finishing write tid 2 to smithi084102331-27 2024-01-13T18:09:58.902 INFO:tasks.rados.rados.0.smithi084.stdout:2776: done (11 left) 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:2778: done (10 left) 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:2788: snap_create 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:2780: finishing write tid 1 to smithi084102331-2 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:2780: finishing write tid 2 to smithi084102331-2 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:2780: finishing write tid 3 to smithi084102331-2 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1520 (ObjNum 862 snap 273 seq_num 862) dirty exists 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:2780: left oid 2 (ObjNum 862 snap 273 seq_num 862) 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:2777: finishing copy_from to smithi084102331-26 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1435 (ObjNum 831 snap 268 seq_num 831) dirty exists 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:2783: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1337 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:2777: finishing copy_from racing read to smithi084102331-26 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:2779: finishing write tid 3 to smithi084102331-27 2024-01-13T18:09:58.903 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1126 (ObjNum 861 snap 273 seq_num 861) dirty exists 2024-01-13T18:09:58.904 INFO:tasks.rados.rados.0.smithi084.stdout:2779: left oid 27 (ObjNum 861 snap 273 seq_num 861) 2024-01-13T18:09:58.904 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1127 (ObjNum 846 snap 273 seq_num 846) dirty exists 2024-01-13T18:09:58.904 INFO:tasks.rados.rados.0.smithi084.stdout:2781: expect (ObjNum 845 snap 273 seq_num 845) 2024-01-13T18:09:59.031 INFO:tasks.rados.rados.0.smithi084.stdout:2784: finishing write tid 1 to smithi084102331-16 2024-01-13T18:09:59.031 INFO:tasks.rados.rados.0.smithi084.stdout:2784: finishing write tid 2 to smithi084102331-16 2024-01-13T18:09:59.031 INFO:tasks.rados.rados.0.smithi084.stdout:2784: finishing write tid 3 to smithi084102331-16 2024-01-13T18:09:59.031 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1129 (ObjNum 863 snap 273 seq_num 863) dirty exists 2024-01-13T18:09:59.031 INFO:tasks.rados.rados.0.smithi084.stdout:2784: left oid 16 (ObjNum 863 snap 273 seq_num 863) 2024-01-13T18:09:59.031 INFO:tasks.rados.rados.0.smithi084.stdout:2785: expect (ObjNum 839 snap 271 seq_num 839) 2024-01-13T18:09:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:58 smithi099 ceph-mon[138788]: pgmap v636: 121 pgs: 121 active+clean; 234 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-01-13T18:09:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:09:58 smithi099 ceph-mon[138788]: osdmap e617: 8 total, 8 up, 8 in 2024-01-13T18:09:59.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:58 smithi084 ceph-mon[119097]: pgmap v636: 121 pgs: 121 active+clean; 234 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-01-13T18:09:59.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:09:58 smithi084 ceph-mon[119097]: osdmap e617: 8 total, 8 up, 8 in 2024-01-13T18:09:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:58 smithi084 ceph-mon[116404]: pgmap v636: 121 pgs: 121 active+clean; 234 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-01-13T18:09:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:09:58 smithi084 ceph-mon[116404]: osdmap e617: 8 total, 8 up, 8 in 2024-01-13T18:09:59.256 INFO:tasks.rados.rados.0.smithi084.stdout:2787: finishing copy_from to smithi084102331-42 2024-01-13T18:09:59.256 INFO:tasks.rados.rados.0.smithi084.stdout:2787: got expected ENOENT (src dne) 2024-01-13T18:09:59.256 INFO:tasks.rados.rados.0.smithi084.stdout:2787: finishing copy_from racing read to smithi084102331-42 2024-01-13T18:09:59.256 INFO:tasks.rados.rados.0.smithi084.stdout:2786: finishing write tid 1 to smithi084102331-11 2024-01-13T18:09:59.256 INFO:tasks.rados.rados.0.smithi084.stdout:2786: finishing write tid 2 to smithi084102331-11 2024-01-13T18:09:59.256 INFO:tasks.rados.rados.0.smithi084.stdout:2786: finishing write tid 3 to smithi084102331-11 2024-01-13T18:09:59.256 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1255 (ObjNum 864 snap 273 seq_num 864) dirty exists 2024-01-13T18:09:59.257 INFO:tasks.rados.rados.0.smithi084.stdout:2786: left oid 11 (ObjNum 864 snap 273 seq_num 864) 2024-01-13T18:09:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2777: done (10 left) 2024-01-13T18:09:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2779: done (9 left) 2024-01-13T18:09:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2780: done (8 left) 2024-01-13T18:09:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2781: done (7 left) 2024-01-13T18:09:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2782: done (6 left) 2024-01-13T18:09:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2783: done (5 left) 2024-01-13T18:09:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2784: done (4 left) 2024-01-13T18:09:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2785: done (3 left) 2024-01-13T18:09:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2786: done (2 left) 2024-01-13T18:09:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2787: done (1 left) 2024-01-13T18:09:59.752 INFO:tasks.rados.rados.0.smithi084.stdout:2788: done (0 left) 2024-01-13T18:09:59.753 INFO:tasks.rados.rados.0.smithi084.stdout:2789: snap_create 2024-01-13T18:10:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:10:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:10:00] "GET /metrics HTTP/1.1" 200 36193 "" "Prometheus/2.43.0" 2024-01-13T18:10:00.756 INFO:tasks.rados.rados.0.smithi084.stdout:2789: done (0 left) 2024-01-13T18:10:00.756 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 275 2024-01-13T18:10:00.756 INFO:tasks.rados.rados.0.smithi084.stdout:2790: seq_num 865 ranges {0=90112} 2024-01-13T18:10:00.756 INFO:tasks.rados.rados.0.smithi084.stdout:2790: writing smithi084102331-42 from 0 to 90112 tid 1 2024-01-13T18:10:00.756 INFO:tasks.rados.rados.0.smithi084.stdout:2791: read oid 35 snap 265 2024-01-13T18:10:00.756 INFO:tasks.rados.rados.0.smithi084.stdout:2791: expect (ObjNum 811 snap 263 seq_num 811) 2024-01-13T18:10:00.756 INFO:tasks.rados.rados.0.smithi084.stdout:2792: read oid 9 snap -1 2024-01-13T18:10:00.756 INFO:tasks.rados.rados.0.smithi084.stdout:2792: expect (ObjNum 845 snap 273 seq_num 845) 2024-01-13T18:10:00.756 INFO:tasks.rados.rados.0.smithi084.stdout:2793: snap_remove snap 248 2024-01-13T18:10:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:00 smithi099 ceph-mon[138788]: osdmap e618: 8 total, 8 up, 8 in 2024-01-13T18:10:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:00 smithi099 ceph-mon[138788]: overall HEALTH_OK 2024-01-13T18:10:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:00 smithi099 ceph-mon[138788]: pgmap v639: 121 pgs: 121 active+clean; 241 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 6.8 MiB/s rd, 7.7 MiB/s wr, 19 op/s 2024-01-13T18:10:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:00 smithi084 ceph-mon[116404]: osdmap e618: 8 total, 8 up, 8 in 2024-01-13T18:10:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:00 smithi084 ceph-mon[116404]: overall HEALTH_OK 2024-01-13T18:10:01.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:00 smithi084 ceph-mon[116404]: pgmap v639: 121 pgs: 121 active+clean; 241 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 6.8 MiB/s rd, 7.7 MiB/s wr, 19 op/s 2024-01-13T18:10:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:00 smithi084 ceph-mon[119097]: osdmap e618: 8 total, 8 up, 8 in 2024-01-13T18:10:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:00 smithi084 ceph-mon[119097]: overall HEALTH_OK 2024-01-13T18:10:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:00 smithi084 ceph-mon[119097]: pgmap v639: 121 pgs: 121 active+clean; 241 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 6.8 MiB/s rd, 7.7 MiB/s wr, 19 op/s 2024-01-13T18:10:01.758 INFO:tasks.rados.rados.0.smithi084.stdout:2793: done (3 left) 2024-01-13T18:10:01.758 INFO:tasks.rados.rados.0.smithi084.stdout:2794: copy_from oid 38 from oid 29 current snap is 275 2024-01-13T18:10:01.758 INFO:tasks.rados.rados.0.smithi084.stdout:2790: finishing write tid 1 to smithi084102331-42 2024-01-13T18:10:01.758 INFO:tasks.rados.rados.0.smithi084.stdout:2790: finishing write tid 2 to smithi084102331-42 2024-01-13T18:10:01.759 INFO:tasks.rados.rados.0.smithi084.stdout:2790: finishing write tid 3 to smithi084102331-42 2024-01-13T18:10:01.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1104 (ObjNum 865 snap 275 seq_num 865) dirty exists 2024-01-13T18:10:01.759 INFO:tasks.rados.rados.0.smithi084.stdout:2790: left oid 42 (ObjNum 865 snap 275 seq_num 865) 2024-01-13T18:10:01.759 INFO:tasks.rados.rados.0.smithi084.stdout:2791: expect (ObjNum 811 snap 263 seq_num 811) 2024-01-13T18:10:01.929 INFO:tasks.rados.rados.0.smithi084.stdout:2792: expect (ObjNum 845 snap 273 seq_num 845) 2024-01-13T18:10:02.058 INFO:tasks.rados.rados.0.smithi084.stdout:2794: finishing copy_from to smithi084102331-38 2024-01-13T18:10:02.058 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1311 (ObjNum 741 snap 230 seq_num 741) dirty exists 2024-01-13T18:10:02.058 INFO:tasks.rados.rados.0.smithi084.stdout:2794: finishing copy_from racing read to smithi084102331-38 2024-01-13T18:10:02.058 INFO:tasks.rados.rados.0.smithi084.stdout:2790: done (3 left) 2024-01-13T18:10:02.058 INFO:tasks.rados.rados.0.smithi084.stdout:2791: done (2 left) 2024-01-13T18:10:02.058 INFO:tasks.rados.rados.0.smithi084.stdout:2792: done (1 left) 2024-01-13T18:10:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:2794: done (0 left) 2024-01-13T18:10:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 275 2024-01-13T18:10:02.059 INFO:tasks.rados.rados.0.smithi084.stdout:2795: seq_num 866 ranges {3538944=106496} 2024-01-13T18:10:02.077 INFO:tasks.rados.rados.0.smithi084.stdout:2795: writing smithi084102331-43 from 3538944 to 3645440 tid 1 2024-01-13T18:10:02.078 INFO:tasks.rados.rados.0.smithi084.stdout:2796: rollback oid 2 current snap is 275 2024-01-13T18:10:02.078 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 273 2024-01-13T18:10:02.078 INFO:tasks.rados.rados.0.smithi084.stdout:2797: snap_create 2024-01-13T18:10:02.082 INFO:tasks.rados.rados.0.smithi084.stdout:2796: finishing rollback tid 0 to smithi084102331-2 2024-01-13T18:10:02.082 INFO:tasks.rados.rados.0.smithi084.stdout:2796: finishing rollback tid 1 to smithi084102331-2 2024-01-13T18:10:02.082 INFO:tasks.rados.rados.0.smithi084.stdout:2796: finishing rollback tid 2 to smithi084102331-2 2024-01-13T18:10:02.082 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1534 (ObjNum 862 snap 273 seq_num 862) dirty exists 2024-01-13T18:10:02.082 INFO:tasks.rados.rados.0.smithi084.stdout:2795: finishing write tid 1 to smithi084102331-43 2024-01-13T18:10:02.083 INFO:tasks.rados.rados.0.smithi084.stdout:2795: finishing write tid 2 to smithi084102331-43 2024-01-13T18:10:02.085 INFO:tasks.rados.rados.0.smithi084.stdout:2795: finishing write tid 3 to smithi084102331-43 2024-01-13T18:10:02.085 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1314 (ObjNum 866 snap 275 seq_num 866) dirty exists 2024-01-13T18:10:02.085 INFO:tasks.rados.rados.0.smithi084.stdout:2795: left oid 43 (ObjNum 866 snap 275 seq_num 866) 2024-01-13T18:10:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:01 smithi099 ceph-mon[138788]: osdmap e619: 8 total, 8 up, 8 in 2024-01-13T18:10:02.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:01 smithi084 ceph-mon[116404]: osdmap e619: 8 total, 8 up, 8 in 2024-01-13T18:10:02.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:01 smithi084 ceph-mon[119097]: osdmap e619: 8 total, 8 up, 8 in 2024-01-13T18:10:02.688 INFO:tasks.rados.rados.0.smithi084.stdout:2795: done (2 left) 2024-01-13T18:10:02.688 INFO:tasks.rados.rados.0.smithi084.stdout:2796: done (1 left) 2024-01-13T18:10:02.688 INFO:tasks.rados.rados.0.smithi084.stdout:2797: done (0 left) 2024-01-13T18:10:02.688 INFO:tasks.rados.rados.0.smithi084.stdout:2798: snap_create 2024-01-13T18:10:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:02 smithi099 ceph-mon[138788]: osdmap e620: 8 total, 8 up, 8 in 2024-01-13T18:10:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:02 smithi099 ceph-mon[138788]: pgmap v642: 121 pgs: 121 active+clean; 240 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.0 MiB/s wr, 24 op/s 2024-01-13T18:10:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:02 smithi099 ceph-mon[138788]: osdmap e621: 8 total, 8 up, 8 in 2024-01-13T18:10:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:02 smithi084 ceph-mon[116404]: osdmap e620: 8 total, 8 up, 8 in 2024-01-13T18:10:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:02 smithi084 ceph-mon[116404]: pgmap v642: 121 pgs: 121 active+clean; 240 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.0 MiB/s wr, 24 op/s 2024-01-13T18:10:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:02 smithi084 ceph-mon[116404]: osdmap e621: 8 total, 8 up, 8 in 2024-01-13T18:10:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:02 smithi084 ceph-mon[119097]: osdmap e620: 8 total, 8 up, 8 in 2024-01-13T18:10:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:02 smithi084 ceph-mon[119097]: pgmap v642: 121 pgs: 121 active+clean; 240 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.0 MiB/s wr, 24 op/s 2024-01-13T18:10:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:02 smithi084 ceph-mon[119097]: osdmap e621: 8 total, 8 up, 8 in 2024-01-13T18:10:03.688 INFO:tasks.rados.rados.0.smithi084.stdout:2798: done (0 left) 2024-01-13T18:10:03.688 INFO:tasks.rados.rados.0.smithi084.stdout:2799: rollback oid 2 current snap is 277 2024-01-13T18:10:03.689 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 275 2024-01-13T18:10:03.689 INFO:tasks.rados.rados.0.smithi084.stdout:2800: read oid 40 snap -1 2024-01-13T18:10:03.689 INFO:tasks.rados.rados.0.smithi084.stdout:2800: expect deleted 2024-01-13T18:10:03.689 INFO:tasks.rados.rados.0.smithi084.stdout:2801: read oid 24 snap -1 2024-01-13T18:10:03.689 INFO:tasks.rados.rados.0.smithi084.stdout:2801: expect (ObjNum 831 snap 268 seq_num 831) 2024-01-13T18:10:03.689 INFO:tasks.rados.rados.0.smithi084.stdout:2802: read oid 50 snap -1 2024-01-13T18:10:03.689 INFO:tasks.rados.rados.0.smithi084.stdout:2802: expect (ObjNum 799 snap 258 seq_num 799) 2024-01-13T18:10:03.689 INFO:tasks.rados.rados.0.smithi084.stdout:2803: delete oid 17 current snap is 277 2024-01-13T18:10:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:2800: done (4 left) 2024-01-13T18:10:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:2803: done (3 left) 2024-01-13T18:10:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:2804: copy_from oid 38 from oid 23 current snap is 277 2024-01-13T18:10:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:2799: finishing rollback tid 0 to smithi084102331-2 2024-01-13T18:10:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 277 2024-01-13T18:10:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:2805: seq_num 868 ranges {6774784=139264} 2024-01-13T18:10:03.733 INFO:tasks.rados.rados.0.smithi084.stdout:2805: writing smithi084102331-22 from 6774784 to 6914048 tid 1 2024-01-13T18:10:03.733 INFO:tasks.rados.rados.0.smithi084.stdout:2806: delete oid 36 current snap is 277 2024-01-13T18:10:03.734 INFO:tasks.rados.rados.0.smithi084.stdout:2799: finishing rollback tid 1 to smithi084102331-2 2024-01-13T18:10:03.734 INFO:tasks.rados.rados.0.smithi084.stdout:2799: finishing rollback tid 2 to smithi084102331-2 2024-01-13T18:10:03.734 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1538 (ObjNum 862 snap 273 seq_num 862) dirty exists 2024-01-13T18:10:03.734 INFO:tasks.rados.rados.0.smithi084.stdout:2801: expect (ObjNum 831 snap 268 seq_num 831) 2024-01-13T18:10:03.781 INFO:tasks.rados.rados.0.smithi084.stdout:2804: finishing copy_from to smithi084102331-38 2024-01-13T18:10:03.781 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 947 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:10:03.781 INFO:tasks.rados.rados.0.smithi084.stdout:2804: finishing copy_from racing read to smithi084102331-38 2024-01-13T18:10:03.781 INFO:tasks.rados.rados.0.smithi084.stdout:2802: expect (ObjNum 799 snap 258 seq_num 799) 2024-01-13T18:10:03.867 INFO:tasks.rados.rados.0.smithi084.stdout:2805: finishing write tid 1 to smithi084102331-22 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:2805: finishing write tid 2 to smithi084102331-22 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:2805: finishing write tid 3 to smithi084102331-22 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1541 (ObjNum 868 snap 277 seq_num 868) dirty exists 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:2805: left oid 22 (ObjNum 868 snap 277 seq_num 868) 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:2799: done (5 left) 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:2801: done (4 left) 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:2802: done (3 left) 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:2804: done (2 left) 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:2805: done (1 left) 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:2806: done (0 left) 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:2807: read oid 33 snap 273 2024-01-13T18:10:03.868 INFO:tasks.rados.rados.0.smithi084.stdout:2807: expect (ObjNum -257680592 snap 21877 seq_num 4037783776) 2024-01-13T18:10:03.869 INFO:tasks.rados.rados.0.smithi084.stdout:2808: delete oid 18 current snap is 277 2024-01-13T18:10:03.869 INFO:tasks.rados.rados.0.smithi084.stdout:2807: expect (ObjNum -257680592 snap 21877 seq_num 4037783776) 2024-01-13T18:10:03.871 INFO:tasks.rados.rados.0.smithi084.stdout:2807: done (1 left) 2024-01-13T18:10:03.871 INFO:tasks.rados.rados.0.smithi084.stdout:2808: done (0 left) 2024-01-13T18:10:03.871 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 277 2024-01-13T18:10:03.871 INFO:tasks.rados.rados.0.smithi084.stdout:2809: seq_num 871 ranges {8855552=188416} 2024-01-13T18:10:03.919 INFO:tasks.rados.rados.0.smithi084.stdout:2809: writing smithi084102331-44 from 8855552 to 9043968 tid 1 2024-01-13T18:10:03.920 INFO:tasks.rados.rados.0.smithi084.stdout:2810: copy_from oid 10 from oid 41 current snap is 277 2024-01-13T18:10:03.920 INFO:tasks.rados.rados.0.smithi084.stdout:2811: read oid 9 snap 273 2024-01-13T18:10:03.920 INFO:tasks.rados.rados.0.smithi084.stdout:2811: expect (ObjNum 845 snap 273 seq_num 845) 2024-01-13T18:10:03.920 INFO:tasks.rados.rados.0.smithi084.stdout:2812: rmattr oid 37 current snap is 277 2024-01-13T18:10:03.920 INFO:tasks.rados.rados.0.smithi084.stdout:2812: done (3 left) 2024-01-13T18:10:03.920 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 277 2024-01-13T18:10:03.920 INFO:tasks.rados.rados.0.smithi084.stdout:2813: seq_num 872 ranges {1777664=212992} 2024-01-13T18:10:03.930 INFO:tasks.rados.rados.0.smithi084.stdout:2813: writing smithi084102331-46 from 1777664 to 1990656 tid 1 2024-01-13T18:10:03.930 INFO:tasks.rados.rados.0.smithi084.stdout:2814: copy_from oid 47 from oid 15 current snap is 277 2024-01-13T18:10:03.930 INFO:tasks.rados.rados.0.smithi084.stdout:2809: finishing write tid 1 to smithi084102331-44 2024-01-13T18:10:03.931 INFO:tasks.rados.rados.0.smithi084.stdout:2809: finishing write tid 2 to smithi084102331-44 2024-01-13T18:10:03.931 INFO:tasks.rados.rados.0.smithi084.stdout:2809: finishing write tid 3 to smithi084102331-44 2024-01-13T18:10:03.931 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1409 (ObjNum 871 snap 277 seq_num 871) dirty exists 2024-01-13T18:10:03.931 INFO:tasks.rados.rados.0.smithi084.stdout:2809: left oid 44 (ObjNum 871 snap 277 seq_num 871) 2024-01-13T18:10:03.931 INFO:tasks.rados.rados.0.smithi084.stdout:2811: expect (ObjNum 845 snap 273 seq_num 845) 2024-01-13T18:10:04.064 INFO:tasks.rados.rados.0.smithi084.stdout:2813: finishing write tid 1 to smithi084102331-46 2024-01-13T18:10:04.064 INFO:tasks.rados.rados.0.smithi084.stdout:2813: finishing write tid 2 to smithi084102331-46 2024-01-13T18:10:04.064 INFO:tasks.rados.rados.0.smithi084.stdout:2809: done (4 left) 2024-01-13T18:10:04.064 INFO:tasks.rados.rados.0.smithi084.stdout:2811: done (3 left) 2024-01-13T18:10:04.064 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 277 2024-01-13T18:10:04.064 INFO:tasks.rados.rados.0.smithi084.stdout:2813: finishing write tid 3 to smithi084102331-46 2024-01-13T18:10:04.064 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1257 (ObjNum 872 snap 277 seq_num 872) dirty exists 2024-01-13T18:10:04.065 INFO:tasks.rados.rados.0.smithi084.stdout:2813: left oid 46 (ObjNum 872 snap 277 seq_num 872) 2024-01-13T18:10:04.065 INFO:tasks.rados.rados.0.smithi084.stdout:2810: finishing copy_from to smithi084102331-10 2024-01-13T18:10:04.065 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1246 (ObjNum 702 snap 220 seq_num 702) dirty exists 2024-01-13T18:10:04.065 INFO:tasks.rados.rados.0.smithi084.stdout:2810: finishing copy_from racing read to smithi084102331-10 2024-01-13T18:10:04.065 INFO:tasks.rados.rados.0.smithi084.stdout:2814: finishing copy_from to smithi084102331-47 2024-01-13T18:10:04.065 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1359 (ObjNum 848 snap 273 seq_num 848) dirty exists 2024-01-13T18:10:04.065 INFO:tasks.rados.rados.0.smithi084.stdout:2814: finishing copy_from racing read to smithi084102331-47 2024-01-13T18:10:04.065 INFO:tasks.rados.rados.0.smithi084.stdout:2815: seq_num 873 ranges {3284992=229376} 2024-01-13T18:10:04.082 INFO:tasks.rados.rados.0.smithi084.stdout:2815: writing smithi084102331-12 from 3284992 to 3514368 tid 1 2024-01-13T18:10:04.083 INFO:tasks.rados.rados.0.smithi084.stdout:2810: done (3 left) 2024-01-13T18:10:04.083 INFO:tasks.rados.rados.0.smithi084.stdout:2813: done (2 left) 2024-01-13T18:10:04.083 INFO:tasks.rados.rados.0.smithi084.stdout:2814: done (1 left) 2024-01-13T18:10:04.083 INFO:tasks.rados.rados.0.smithi084.stdout:2816: snap_remove snap 273 2024-01-13T18:10:04.690 INFO:tasks.rados.rados.0.smithi084.stdout:2816: done (1 left) 2024-01-13T18:10:04.690 INFO:tasks.rados.rados.0.smithi084.stdout:2817: delete oid 10 current snap is 277 2024-01-13T18:10:04.690 INFO:tasks.rados.rados.0.smithi084.stdout:2815: finishing write tid 1 to smithi084102331-12 2024-01-13T18:10:04.690 INFO:tasks.rados.rados.0.smithi084.stdout:2815: finishing write tid 2 to smithi084102331-12 2024-01-13T18:10:04.690 INFO:tasks.rados.rados.0.smithi084.stdout:2815: finishing write tid 3 to smithi084102331-12 2024-01-13T18:10:04.691 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1544 (ObjNum 873 snap 277 seq_num 873) dirty exists 2024-01-13T18:10:04.691 INFO:tasks.rados.rados.0.smithi084.stdout:2815: left oid 12 (ObjNum 873 snap 277 seq_num 873) 2024-01-13T18:10:04.699 INFO:tasks.rados.rados.0.smithi084.stdout:2815: done (1 left) 2024-01-13T18:10:04.700 INFO:tasks.rados.rados.0.smithi084.stdout:2817: done (0 left) 2024-01-13T18:10:04.700 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 277 2024-01-13T18:10:04.700 INFO:tasks.rados.rados.0.smithi084.stdout:2818: seq_num 875 ranges {3645440=262144} 2024-01-13T18:10:04.719 INFO:tasks.rados.rados.0.smithi084.stdout:2818: writing smithi084102331-43 from 3645440 to 3907584 tid 1 2024-01-13T18:10:04.720 INFO:tasks.rados.rados.0.smithi084.stdout:2819: snap_remove snap 261 2024-01-13T18:10:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:04 smithi099 ceph-mon[138788]: osdmap e622: 8 total, 8 up, 8 in 2024-01-13T18:10:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:04 smithi099 ceph-mon[138788]: pgmap v645: 121 pgs: 121 active+clean; 242 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2024-01-13T18:10:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:04 smithi084 ceph-mon[116404]: osdmap e622: 8 total, 8 up, 8 in 2024-01-13T18:10:05.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:04 smithi084 ceph-mon[116404]: pgmap v645: 121 pgs: 121 active+clean; 242 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2024-01-13T18:10:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:04 smithi084 ceph-mon[119097]: osdmap e622: 8 total, 8 up, 8 in 2024-01-13T18:10:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:04 smithi084 ceph-mon[119097]: pgmap v645: 121 pgs: 121 active+clean; 242 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2024-01-13T18:10:05.711 INFO:tasks.rados.rados.0.smithi084.stdout:2819: done (1 left) 2024-01-13T18:10:05.711 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 277 2024-01-13T18:10:05.712 INFO:tasks.rados.rados.0.smithi084.stdout:2820: seq_num 876 ranges {2277376=278528} 2024-01-13T18:10:05.726 INFO:tasks.rados.rados.0.smithi084.stdout:2820: writing smithi084102331-21 from 2277376 to 2555904 tid 1 2024-01-13T18:10:05.726 INFO:tasks.rados.rados.0.smithi084.stdout:2821: rmattr oid 39 current snap is 277 2024-01-13T18:10:05.726 INFO:tasks.rados.rados.0.smithi084.stdout:2821: done (2 left) 2024-01-13T18:10:05.726 INFO:tasks.rados.rados.0.smithi084.stdout:2822: snap_remove snap 265 2024-01-13T18:10:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:05 smithi099 ceph-mon[138788]: osdmap e623: 8 total, 8 up, 8 in 2024-01-13T18:10:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:06.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:05 smithi084 ceph-mon[116404]: osdmap e623: 8 total, 8 up, 8 in 2024-01-13T18:10:06.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:06.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:05 smithi084 ceph-mon[119097]: osdmap e623: 8 total, 8 up, 8 in 2024-01-13T18:10:06.182 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:06.717 INFO:tasks.rados.rados.0.smithi084.stdout:2822: done (2 left) 2024-01-13T18:10:06.717 INFO:tasks.rados.rados.0.smithi084.stdout:2823: snap_remove snap 250 2024-01-13T18:10:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:06 smithi099 ceph-mon[138788]: osdmap e624: 8 total, 8 up, 8 in 2024-01-13T18:10:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:06 smithi099 ceph-mon[138788]: pgmap v648: 121 pgs: 121 active+clean; 242 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 600 KiB/s wr, 4 op/s 2024-01-13T18:10:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:06 smithi084 ceph-mon[116404]: osdmap e624: 8 total, 8 up, 8 in 2024-01-13T18:10:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:06 smithi084 ceph-mon[116404]: pgmap v648: 121 pgs: 121 active+clean; 242 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 600 KiB/s wr, 4 op/s 2024-01-13T18:10:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:06 smithi084 ceph-mon[119097]: osdmap e624: 8 total, 8 up, 8 in 2024-01-13T18:10:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:06 smithi084 ceph-mon[119097]: pgmap v648: 121 pgs: 121 active+clean; 242 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 600 KiB/s wr, 4 op/s 2024-01-13T18:10:07.694 INFO:tasks.rados.rados.0.smithi084.stdout:2823: done (2 left) 2024-01-13T18:10:07.694 INFO:tasks.rados.rados.0.smithi084.stdout:2824: rmattr oid 29 current snap is 277 2024-01-13T18:10:07.694 INFO:tasks.rados.rados.0.smithi084.stdout:2824: done (2 left) 2024-01-13T18:10:07.694 INFO:tasks.rados.rados.0.smithi084.stdout:2825: read oid 11 snap -1 2024-01-13T18:10:07.694 INFO:tasks.rados.rados.0.smithi084.stdout:2825: expect (ObjNum 864 snap 273 seq_num 864) 2024-01-13T18:10:07.694 INFO:tasks.rados.rados.0.smithi084.stdout:2826: snap_create 2024-01-13T18:10:07.694 INFO:tasks.rados.rados.0.smithi084.stdout:2818: finishing write tid 1 to smithi084102331-43 2024-01-13T18:10:07.694 INFO:tasks.rados.rados.0.smithi084.stdout:2818: finishing write tid 2 to smithi084102331-43 2024-01-13T18:10:07.694 INFO:tasks.rados.rados.0.smithi084.stdout:2818: finishing write tid 3 to smithi084102331-43 2024-01-13T18:10:07.694 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1316 (ObjNum 875 snap 277 seq_num 875) dirty exists 2024-01-13T18:10:07.695 INFO:tasks.rados.rados.0.smithi084.stdout:2818: left oid 43 (ObjNum 875 snap 277 seq_num 875) 2024-01-13T18:10:07.695 INFO:tasks.rados.rados.0.smithi084.stdout:2820: finishing write tid 1 to smithi084102331-21 2024-01-13T18:10:07.695 INFO:tasks.rados.rados.0.smithi084.stdout:2820: finishing write tid 2 to smithi084102331-21 2024-01-13T18:10:07.695 INFO:tasks.rados.rados.0.smithi084.stdout:2820: finishing write tid 3 to smithi084102331-21 2024-01-13T18:10:07.695 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 1320 (ObjNum 876 snap 277 seq_num 876) dirty exists 2024-01-13T18:10:07.695 INFO:tasks.rados.rados.0.smithi084.stdout:2820: left oid 21 (ObjNum 876 snap 277 seq_num 876) 2024-01-13T18:10:07.735 INFO:tasks.rados.rados.0.smithi084.stdout:2825: expect (ObjNum 864 snap 273 seq_num 864) 2024-01-13T18:10:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:07 smithi099 ceph-mon[138788]: osdmap e625: 8 total, 8 up, 8 in 2024-01-13T18:10:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:07 smithi099 ceph-mon[138788]: osdmap e626: 8 total, 8 up, 8 in 2024-01-13T18:10:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:07 smithi084 ceph-mon[116404]: osdmap e625: 8 total, 8 up, 8 in 2024-01-13T18:10:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:07 smithi084 ceph-mon[116404]: osdmap e626: 8 total, 8 up, 8 in 2024-01-13T18:10:08.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:07 smithi084 ceph-mon[119097]: osdmap e625: 8 total, 8 up, 8 in 2024-01-13T18:10:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:07 smithi084 ceph-mon[119097]: osdmap e626: 8 total, 8 up, 8 in 2024-01-13T18:10:08.689 INFO:tasks.rados.rados.0.smithi084.stdout:2818: done (3 left) 2024-01-13T18:10:08.689 INFO:tasks.rados.rados.0.smithi084.stdout:2820: done (2 left) 2024-01-13T18:10:08.689 INFO:tasks.rados.rados.0.smithi084.stdout:2825: done (1 left) 2024-01-13T18:10:08.689 INFO:tasks.rados.rados.0.smithi084.stdout:2826: done (0 left) 2024-01-13T18:10:08.689 INFO:tasks.rados.rados.0.smithi084.stdout:2827: snap_remove snap 275 2024-01-13T18:10:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:08 smithi099 ceph-mon[138788]: pgmap v651: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 235 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-01-13T18:10:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:08 smithi099 ceph-mon[138788]: osdmap e627: 8 total, 8 up, 8 in 2024-01-13T18:10:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:08 smithi084 ceph-mon[116404]: pgmap v651: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 235 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-01-13T18:10:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:08 smithi084 ceph-mon[116404]: osdmap e627: 8 total, 8 up, 8 in 2024-01-13T18:10:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:08 smithi084 ceph-mon[119097]: pgmap v651: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 235 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-01-13T18:10:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:08 smithi084 ceph-mon[119097]: osdmap e627: 8 total, 8 up, 8 in 2024-01-13T18:10:09.695 INFO:tasks.rados.rados.0.smithi084.stdout:2827: done (0 left) 2024-01-13T18:10:09.695 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 278 2024-01-13T18:10:09.695 INFO:tasks.rados.rados.0.smithi084.stdout:2828: seq_num 877 ranges {2736128=294912} 2024-01-13T18:10:09.711 INFO:tasks.rados.rados.0.smithi084.stdout:2828: writing smithi084102331-45 from 2736128 to 3031040 tid 1 2024-01-13T18:10:09.711 INFO:tasks.rados.rados.0.smithi084.stdout:2829: read oid 30 snap -1 2024-01-13T18:10:09.711 INFO:tasks.rados.rados.0.smithi084.stdout:2829: expect (ObjNum 829 snap 268 seq_num 829) 2024-01-13T18:10:09.711 INFO:tasks.rados.rados.0.smithi084.stdout:2830: rmattr oid 41 current snap is 278 2024-01-13T18:10:09.712 INFO:tasks.rados.rados.0.smithi084.stdout:2831: snap_remove snap 276 2024-01-13T18:10:10.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:10:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:10:10] "GET /metrics HTTP/1.1" 200 36192 "" "Prometheus/2.43.0" 2024-01-13T18:10:10.700 INFO:tasks.rados.rados.0.smithi084.stdout:2831: done (3 left) 2024-01-13T18:10:10.700 INFO:tasks.rados.rados.0.smithi084.stdout:2832: snap_create 2024-01-13T18:10:10.708 INFO:tasks.rados.rados.0.smithi084.stdout:2828: finishing write tid 1 to smithi084102331-45 2024-01-13T18:10:10.709 INFO:tasks.rados.rados.0.smithi084.stdout:2828: finishing write tid 2 to smithi084102331-45 2024-01-13T18:10:10.709 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1258 (ObjNum 702 snap 220 seq_num 702) dirty exists 2024-01-13T18:10:10.709 INFO:tasks.rados.rados.0.smithi084.stdout:2828: finishing write tid 3 to smithi084102331-45 2024-01-13T18:10:10.709 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1518 (ObjNum 877 snap 278 seq_num 877) dirty exists 2024-01-13T18:10:10.709 INFO:tasks.rados.rados.0.smithi084.stdout:2828: left oid 45 (ObjNum 877 snap 278 seq_num 877) 2024-01-13T18:10:10.709 INFO:tasks.rados.rados.0.smithi084.stdout:2829: expect (ObjNum 829 snap 268 seq_num 829) 2024-01-13T18:10:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:10 smithi099 ceph-mon[138788]: osdmap e628: 8 total, 8 up, 8 in 2024-01-13T18:10:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:10 smithi099 ceph-mon[138788]: pgmap v654: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 222 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-01-13T18:10:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:10 smithi084 ceph-mon[116404]: osdmap e628: 8 total, 8 up, 8 in 2024-01-13T18:10:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:10 smithi084 ceph-mon[116404]: pgmap v654: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 222 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-01-13T18:10:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:10 smithi084 ceph-mon[119097]: osdmap e628: 8 total, 8 up, 8 in 2024-01-13T18:10:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:10 smithi084 ceph-mon[119097]: pgmap v654: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 222 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-01-13T18:10:11.701 INFO:tasks.rados.rados.0.smithi084.stdout:2828: done (3 left) 2024-01-13T18:10:11.701 INFO:tasks.rados.rados.0.smithi084.stdout:2829: done (2 left) 2024-01-13T18:10:11.701 INFO:tasks.rados.rados.0.smithi084.stdout:2830: done (1 left) 2024-01-13T18:10:11.701 INFO:tasks.rados.rados.0.smithi084.stdout:2832: done (0 left) 2024-01-13T18:10:11.701 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 279 2024-01-13T18:10:11.701 INFO:tasks.rados.rados.0.smithi084.stdout:2833: seq_num 878 ranges {0=311296} 2024-01-13T18:10:11.704 INFO:tasks.rados.rados.0.smithi084.stdout:2833: writing smithi084102331-20 from 0 to 311296 tid 1 2024-01-13T18:10:11.704 INFO:tasks.rados.rados.0.smithi084.stdout:2834: read oid 9 snap 277 2024-01-13T18:10:11.705 INFO:tasks.rados.rados.0.smithi084.stdout:2834: expect (ObjNum 845 snap 273 seq_num 845) 2024-01-13T18:10:11.705 INFO:tasks.rados.rados.0.smithi084.stdout:2835: read oid 30 snap -1 2024-01-13T18:10:11.705 INFO:tasks.rados.rados.0.smithi084.stdout:2835: expect (ObjNum 829 snap 268 seq_num 829) 2024-01-13T18:10:11.705 INFO:tasks.rados.rados.0.smithi084.stdout:2836: rollback oid 50 current snap is 279 2024-01-13T18:10:11.705 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 50 to 277 2024-01-13T18:10:11.705 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 279 2024-01-13T18:10:11.705 INFO:tasks.rados.rados.0.smithi084.stdout:2837: seq_num 879 ranges {1925120=327680} 2024-01-13T18:10:11.715 INFO:tasks.rados.rados.0.smithi084.stdout:2837: writing smithi084102331-24 from 1925120 to 2252800 tid 1 2024-01-13T18:10:11.716 INFO:tasks.rados.rados.0.smithi084.stdout:2838: snap_remove snap 274 2024-01-13T18:10:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:11 smithi099 ceph-mon[138788]: osdmap e629: 8 total, 8 up, 8 in 2024-01-13T18:10:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:11 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:10:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:11 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:10:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:11 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:10:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:11 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:10:12.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:11 smithi084 ceph-mon[116404]: osdmap e629: 8 total, 8 up, 8 in 2024-01-13T18:10:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:11 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:10:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:11 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:10:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:11 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:10:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:11 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:10:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:11 smithi084 ceph-mon[119097]: osdmap e629: 8 total, 8 up, 8 in 2024-01-13T18:10:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:11 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:10:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:11 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:10:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:11 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:10:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:11 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:10:12.693 INFO:tasks.rados.rados.0.smithi084.stdout:2838: done (5 left) 2024-01-13T18:10:12.693 INFO:tasks.rados.rados.0.smithi084.stdout:2839: rollback oid 43 current snap is 279 2024-01-13T18:10:12.693 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 278 2024-01-13T18:10:12.693 INFO:tasks.rados.rados.0.smithi084.stdout:2833: finishing write tid 1 to smithi084102331-20 2024-01-13T18:10:12.693 INFO:tasks.rados.rados.0.smithi084.stdout:2833: finishing write tid 2 to smithi084102331-20 2024-01-13T18:10:12.694 INFO:tasks.rados.rados.0.smithi084.stdout:2833: finishing write tid 3 to smithi084102331-20 2024-01-13T18:10:12.694 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1281 (ObjNum 878 snap 279 seq_num 878) dirty exists 2024-01-13T18:10:12.694 INFO:tasks.rados.rados.0.smithi084.stdout:2833: left oid 20 (ObjNum 878 snap 279 seq_num 878) 2024-01-13T18:10:12.694 INFO:tasks.rados.rados.0.smithi084.stdout:2834: expect (ObjNum 845 snap 273 seq_num 845) 2024-01-13T18:10:12.831 INFO:tasks.rados.rados.0.smithi084.stdout:2837: finishing write tid 1 to smithi084102331-24 2024-01-13T18:10:12.831 INFO:tasks.rados.rados.0.smithi084.stdout:2837: finishing write tid 2 to smithi084102331-24 2024-01-13T18:10:12.832 INFO:tasks.rados.rados.0.smithi084.stdout:2835: expect (ObjNum 829 snap 268 seq_num 829) 2024-01-13T18:10:12.949 INFO:tasks.rados.rados.0.smithi084.stdout:2837: finishing write tid 3 to smithi084102331-24 2024-01-13T18:10:12.949 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1318 (ObjNum 879 snap 279 seq_num 879) dirty exists 2024-01-13T18:10:12.949 INFO:tasks.rados.rados.0.smithi084.stdout:2837: left oid 24 (ObjNum 879 snap 279 seq_num 879) 2024-01-13T18:10:12.949 INFO:tasks.rados.rados.0.smithi084.stdout:2836: finishing rollback tid 0 to smithi084102331-50 2024-01-13T18:10:12.949 INFO:tasks.rados.rados.0.smithi084.stdout:2836: finishing rollback tid 1 to smithi084102331-50 2024-01-13T18:10:12.949 INFO:tasks.rados.rados.0.smithi084.stdout:2836: finishing rollback tid 2 to smithi084102331-50 2024-01-13T18:10:12.949 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 1334 (ObjNum 799 snap 258 seq_num 799) dirty exists 2024-01-13T18:10:12.949 INFO:tasks.rados.rados.0.smithi084.stdout:2833: done (5 left) 2024-01-13T18:10:12.950 INFO:tasks.rados.rados.0.smithi084.stdout:2834: done (4 left) 2024-01-13T18:10:12.950 INFO:tasks.rados.rados.0.smithi084.stdout:2835: done (3 left) 2024-01-13T18:10:12.950 INFO:tasks.rados.rados.0.smithi084.stdout:2836: done (2 left) 2024-01-13T18:10:12.950 INFO:tasks.rados.rados.0.smithi084.stdout:2837: done (1 left) 2024-01-13T18:10:12.950 INFO:tasks.rados.rados.0.smithi084.stdout:2840: snap_remove snap 270 2024-01-13T18:10:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:12 smithi099 ceph-mon[138788]: osdmap e630: 8 total, 8 up, 8 in 2024-01-13T18:10:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:12 smithi099 ceph-mon[138788]: pgmap v657: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 197 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:10:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:12 smithi099 ceph-mon[138788]: osdmap e631: 8 total, 8 up, 8 in 2024-01-13T18:10:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:12 smithi084 ceph-mon[116404]: osdmap e630: 8 total, 8 up, 8 in 2024-01-13T18:10:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:12 smithi084 ceph-mon[116404]: pgmap v657: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 197 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:10:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:12 smithi084 ceph-mon[116404]: osdmap e631: 8 total, 8 up, 8 in 2024-01-13T18:10:13.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:12 smithi084 ceph-mon[119097]: osdmap e630: 8 total, 8 up, 8 in 2024-01-13T18:10:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:12 smithi084 ceph-mon[119097]: pgmap v657: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 197 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:10:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:12 smithi084 ceph-mon[119097]: osdmap e631: 8 total, 8 up, 8 in 2024-01-13T18:10:13.716 INFO:tasks.rados.rados.0.smithi084.stdout:2840: done (1 left) 2024-01-13T18:10:13.717 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 279 2024-01-13T18:10:13.717 INFO:tasks.rados.rados.0.smithi084.stdout:2839: finishing rollback tid 0 to smithi084102331-43 2024-01-13T18:10:13.717 INFO:tasks.rados.rados.0.smithi084.stdout:2841: seq_num 880 ranges {1925120=344064} 2024-01-13T18:10:13.729 INFO:tasks.rados.rados.0.smithi084.stdout:2841: writing smithi084102331-26 from 1925120 to 2269184 tid 1 2024-01-13T18:10:13.730 INFO:tasks.rados.rados.0.smithi084.stdout:2842: snap_remove snap 277 2024-01-13T18:10:14.724 INFO:tasks.rados.rados.0.smithi084.stdout:2842: done (2 left) 2024-01-13T18:10:14.724 INFO:tasks.rados.rados.0.smithi084.stdout:2843: read oid 33 snap -1 2024-01-13T18:10:14.724 INFO:tasks.rados.rados.0.smithi084.stdout:2843: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:14.725 INFO:tasks.rados.rados.0.smithi084.stdout:2839: finishing rollback tid 1 to smithi084102331-43 2024-01-13T18:10:14.725 INFO:tasks.rados.rados.0.smithi084.stdout:2839: finishing rollback tid 2 to smithi084102331-43 2024-01-13T18:10:14.725 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1321 (ObjNum 875 snap 277 seq_num 875) dirty exists 2024-01-13T18:10:14.725 INFO:tasks.rados.rados.0.smithi084.stdout:2841: finishing write tid 1 to smithi084102331-26 2024-01-13T18:10:14.725 INFO:tasks.rados.rados.0.smithi084.stdout:2841: finishing write tid 2 to smithi084102331-26 2024-01-13T18:10:14.725 INFO:tasks.rados.rados.0.smithi084.stdout:2841: finishing write tid 3 to smithi084102331-26 2024-01-13T18:10:14.725 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1438 (ObjNum 880 snap 279 seq_num 880) dirty exists 2024-01-13T18:10:14.725 INFO:tasks.rados.rados.0.smithi084.stdout:2841: left oid 26 (ObjNum 880 snap 279 seq_num 880) 2024-01-13T18:10:14.725 INFO:tasks.rados.rados.0.smithi084.stdout:2839: done (2 left) 2024-01-13T18:10:14.725 INFO:tasks.rados.rados.0.smithi084.stdout:2841: done (1 left) 2024-01-13T18:10:14.725 INFO:tasks.rados.rados.0.smithi084.stdout:2844: delete oid 47 current snap is 279 2024-01-13T18:10:14.730 INFO:tasks.rados.rados.0.smithi084.stdout:2844: done (1 left) 2024-01-13T18:10:14.730 INFO:tasks.rados.rados.0.smithi084.stdout:2845: setattr oid 28 current snap is 279 2024-01-13T18:10:14.731 INFO:tasks.rados.rados.0.smithi084.stdout:2846: read oid 30 snap 278 2024-01-13T18:10:14.731 INFO:tasks.rados.rados.0.smithi084.stdout:2846: expect (ObjNum 829 snap 268 seq_num 829) 2024-01-13T18:10:14.731 INFO:tasks.rados.rados.0.smithi084.stdout:2847: copy_from oid 7 from oid 16 current snap is 279 2024-01-13T18:10:14.732 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 279 2024-01-13T18:10:14.732 INFO:tasks.rados.rados.0.smithi084.stdout:2848: seq_num 882 ranges {712704=376832} 2024-01-13T18:10:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:2848: writing smithi084102331-2 from 712704 to 1089536 tid 1 2024-01-13T18:10:14.740 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 279 2024-01-13T18:10:14.740 INFO:tasks.rados.rados.0.smithi084.stdout:2849: seq_num 883 ranges {9510912=393216} 2024-01-13T18:10:14.792 INFO:tasks.rados.rados.0.smithi084.stdout:2849: writing smithi084102331-15 from 9510912 to 9904128 tid 1 2024-01-13T18:10:14.792 INFO:tasks.rados.rados.0.smithi084.stdout:2850: setattr oid 21 current snap is 279 2024-01-13T18:10:14.793 INFO:tasks.rados.rados.0.smithi084.stdout:2843: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:14.796 INFO:tasks.rados.rados.0.smithi084.stdout:2848: finishing write tid 1 to smithi084102331-2 2024-01-13T18:10:14.796 INFO:tasks.rados.rados.0.smithi084.stdout:2848: finishing write tid 2 to smithi084102331-2 2024-01-13T18:10:14.796 INFO:tasks.rados.rados.0.smithi084.stdout:2848: finishing write tid 3 to smithi084102331-2 2024-01-13T18:10:14.796 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1609 (ObjNum 882 snap 279 seq_num 882) dirty exists 2024-01-13T18:10:14.796 INFO:tasks.rados.rados.0.smithi084.stdout:2848: left oid 2 (ObjNum 882 snap 279 seq_num 882) 2024-01-13T18:10:14.796 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1130 (ObjNum 846 snap 273 seq_num 846) dirty exists 2024-01-13T18:10:14.796 INFO:tasks.rados.rados.0.smithi084.stdout:2846: expect (ObjNum 829 snap 268 seq_num 829) 2024-01-13T18:10:14.913 INFO:tasks.rados.rados.0.smithi084.stdout:2847: finishing copy_from to smithi084102331-7 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1129 (ObjNum 863 snap 273 seq_num 863) dirty exists 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:2847: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:2849: finishing write tid 1 to smithi084102331-15 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:2849: finishing write tid 2 to smithi084102331-15 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:2849: finishing write tid 3 to smithi084102331-15 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1453 (ObjNum 883 snap 279 seq_num 883) dirty exists 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:2849: left oid 15 (ObjNum 883 snap 279 seq_num 883) 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:2843: done (6 left) 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:2845: done (5 left) 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:2846: done (4 left) 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:2847: done (3 left) 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:2848: done (2 left) 2024-01-13T18:10:14.914 INFO:tasks.rados.rados.0.smithi084.stdout:2849: done (1 left) 2024-01-13T18:10:14.915 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 279 2024-01-13T18:10:14.915 INFO:tasks.rados.rados.0.smithi084.stdout:2851: seq_num 884 ranges {0=409600} 2024-01-13T18:10:14.916 INFO:tasks.rados.rados.0.smithi084.stdout:2851: writing smithi084102331-10 from 0 to 409600 tid 1 2024-01-13T18:10:14.916 INFO:tasks.rados.rados.0.smithi084.stdout:2852: read oid 22 snap -1 2024-01-13T18:10:14.916 INFO:tasks.rados.rados.0.smithi084.stdout:2852: expect (ObjNum 868 snap 277 seq_num 868) 2024-01-13T18:10:14.916 INFO:tasks.rados.rados.0.smithi084.stdout:2853: snap_remove snap 278 2024-01-13T18:10:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:14 smithi099 ceph-mon[138788]: osdmap e632: 8 total, 8 up, 8 in 2024-01-13T18:10:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:14 smithi099 ceph-mon[138788]: pgmap v660: 121 pgs: 121 active+clean; 190 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 152 KiB/s wr, 5 op/s 2024-01-13T18:10:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:14 smithi084 ceph-mon[116404]: osdmap e632: 8 total, 8 up, 8 in 2024-01-13T18:10:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:14 smithi084 ceph-mon[116404]: pgmap v660: 121 pgs: 121 active+clean; 190 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 152 KiB/s wr, 5 op/s 2024-01-13T18:10:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:14 smithi084 ceph-mon[119097]: osdmap e632: 8 total, 8 up, 8 in 2024-01-13T18:10:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:14 smithi084 ceph-mon[119097]: pgmap v660: 121 pgs: 121 active+clean; 190 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 152 KiB/s wr, 5 op/s 2024-01-13T18:10:15.729 INFO:tasks.rados.rados.0.smithi084.stdout:2853: done (3 left) 2024-01-13T18:10:15.729 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 279 2024-01-13T18:10:15.729 INFO:tasks.rados.rados.0.smithi084.stdout:2854: seq_num 885 ranges {0=425984} 2024-01-13T18:10:15.731 INFO:tasks.rados.rados.0.smithi084.stdout:2854: writing smithi084102331-19 from 0 to 425984 tid 1 2024-01-13T18:10:15.731 INFO:tasks.rados.rados.0.smithi084.stdout:2855: setattr oid 7 current snap is 279 2024-01-13T18:10:15.731 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 1321 (ObjNum 876 snap 277 seq_num 876) dirty exists 2024-01-13T18:10:15.731 INFO:tasks.rados.rados.0.smithi084.stdout:2851: finishing write tid 1 to smithi084102331-10 2024-01-13T18:10:15.732 INFO:tasks.rados.rados.0.smithi084.stdout:2851: finishing write tid 2 to smithi084102331-10 2024-01-13T18:10:15.732 INFO:tasks.rados.rados.0.smithi084.stdout:2851: finishing write tid 3 to smithi084102331-10 2024-01-13T18:10:15.732 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1391 (ObjNum 884 snap 279 seq_num 884) dirty exists 2024-01-13T18:10:15.732 INFO:tasks.rados.rados.0.smithi084.stdout:2851: left oid 10 (ObjNum 884 snap 279 seq_num 884) 2024-01-13T18:10:15.732 INFO:tasks.rados.rados.0.smithi084.stdout:2852: expect (ObjNum 868 snap 277 seq_num 868) 2024-01-13T18:10:16.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:15 smithi099 ceph-mon[138788]: osdmap e633: 8 total, 8 up, 8 in 2024-01-13T18:10:16.159 INFO:tasks.rados.rados.0.smithi084.stdout:2854: finishing write tid 1 to smithi084102331-19 2024-01-13T18:10:16.159 INFO:tasks.rados.rados.0.smithi084.stdout:2854: finishing write tid 2 to smithi084102331-19 2024-01-13T18:10:16.159 INFO:tasks.rados.rados.0.smithi084.stdout:2854: finishing write tid 3 to smithi084102331-19 2024-01-13T18:10:16.159 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 1283 (ObjNum 885 snap 279 seq_num 885) dirty exists 2024-01-13T18:10:16.159 INFO:tasks.rados.rados.0.smithi084.stdout:2854: left oid 19 (ObjNum 885 snap 279 seq_num 885) 2024-01-13T18:10:16.159 INFO:tasks.rados.rados.0.smithi084.stdout:2850: done (4 left) 2024-01-13T18:10:16.160 INFO:tasks.rados.rados.0.smithi084.stdout:2851: done (3 left) 2024-01-13T18:10:16.160 INFO:tasks.rados.rados.0.smithi084.stdout:2852: done (2 left) 2024-01-13T18:10:16.160 INFO:tasks.rados.rados.0.smithi084.stdout:2854: done (1 left) 2024-01-13T18:10:16.160 INFO:tasks.rados.rados.0.smithi084.stdout:2856: read oid 12 snap -1 2024-01-13T18:10:16.160 INFO:tasks.rados.rados.0.smithi084.stdout:2856: expect (ObjNum 873 snap 277 seq_num 873) 2024-01-13T18:10:16.160 INFO:tasks.rados.rados.0.smithi084.stdout:2857: rollback oid 31 current snap is 279 2024-01-13T18:10:16.160 INFO:tasks.rados.rados.0.smithi084.stdout:2857: done (2 left) 2024-01-13T18:10:16.160 INFO:tasks.rados.rados.0.smithi084.stdout:2858: rollback oid 50 current snap is 279 2024-01-13T18:10:16.160 INFO:tasks.rados.rados.0.smithi084.stdout:2858: done (2 left) 2024-01-13T18:10:16.160 INFO:tasks.rados.rados.0.smithi084.stdout:2859: delete oid 48 current snap is 279 2024-01-13T18:10:16.161 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1322 (ObjNum 863 snap 273 seq_num 863) dirty exists 2024-01-13T18:10:16.175 INFO:tasks.rados.rados.0.smithi084.stdout:2856: expect (ObjNum 873 snap 277 seq_num 873) 2024-01-13T18:10:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:15 smithi084 ceph-mon[116404]: osdmap e633: 8 total, 8 up, 8 in 2024-01-13T18:10:16.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:15 smithi084 ceph-mon[119097]: osdmap e633: 8 total, 8 up, 8 in 2024-01-13T18:10:16.336 INFO:tasks.rados.rados.0.smithi084.stdout:2855: done (2 left) 2024-01-13T18:10:16.336 INFO:tasks.rados.rados.0.smithi084.stdout:2856: done (1 left) 2024-01-13T18:10:16.336 INFO:tasks.rados.rados.0.smithi084.stdout:2859: done (0 left) 2024-01-13T18:10:16.336 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 279 2024-01-13T18:10:16.336 INFO:tasks.rados.rados.0.smithi084.stdout:2860: seq_num 887 ranges {8069120=458752} 2024-01-13T18:10:16.380 INFO:tasks.rados.rados.0.smithi084.stdout:2860: writing smithi084102331-7 from 8069120 to 8527872 tid 1 2024-01-13T18:10:16.380 INFO:tasks.rados.rados.0.smithi084.stdout:2861: read oid 50 snap -1 2024-01-13T18:10:16.381 INFO:tasks.rados.rados.0.smithi084.stdout:2861: expect (ObjNum 799 snap 258 seq_num 799) 2024-01-13T18:10:16.381 INFO:tasks.rados.rados.0.smithi084.stdout:2862: delete oid 16 current snap is 279 2024-01-13T18:10:16.383 INFO:tasks.rados.rados.0.smithi084.stdout:2862: done (2 left) 2024-01-13T18:10:16.383 INFO:tasks.rados.rados.0.smithi084.stdout:2863: read oid 3 snap -1 2024-01-13T18:10:16.383 INFO:tasks.rados.rados.0.smithi084.stdout:2863: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:16.384 INFO:tasks.rados.rados.0.smithi084.stdout:2864: delete oid 8 current snap is 279 2024-01-13T18:10:16.384 INFO:tasks.rados.rados.0.smithi084.stdout:2860: finishing write tid 1 to smithi084102331-7 2024-01-13T18:10:16.384 INFO:tasks.rados.rados.0.smithi084.stdout:2863: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:16.390 INFO:tasks.rados.rados.0.smithi084.stdout:2860: finishing write tid 2 to smithi084102331-7 2024-01-13T18:10:16.390 INFO:tasks.rados.rados.0.smithi084.stdout:2860: finishing write tid 3 to smithi084102331-7 2024-01-13T18:10:16.390 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1324 (ObjNum 887 snap 279 seq_num 887) dirty exists 2024-01-13T18:10:16.390 INFO:tasks.rados.rados.0.smithi084.stdout:2860: left oid 7 (ObjNum 887 snap 279 seq_num 887) 2024-01-13T18:10:16.390 INFO:tasks.rados.rados.0.smithi084.stdout:2860: done (3 left) 2024-01-13T18:10:16.390 INFO:tasks.rados.rados.0.smithi084.stdout:2863: done (2 left) 2024-01-13T18:10:16.390 INFO:tasks.rados.rados.0.smithi084.stdout:2864: done (1 left) 2024-01-13T18:10:16.390 INFO:tasks.rados.rados.0.smithi084.stdout:2865: read oid 8 snap -1 2024-01-13T18:10:16.390 INFO:tasks.rados.rados.0.smithi084.stdout:2865: expect deleted 2024-01-13T18:10:16.391 INFO:tasks.rados.rados.0.smithi084.stdout:2866: copy_from oid 49 from oid 42 current snap is 279 2024-01-13T18:10:16.391 INFO:tasks.rados.rados.0.smithi084.stdout:2867: rollback oid 17 current snap is 279 2024-01-13T18:10:16.391 INFO:tasks.rados.rados.0.smithi084.stdout:2867: done (3 left) 2024-01-13T18:10:16.391 INFO:tasks.rados.rados.0.smithi084.stdout:2868: rmattr oid 21 current snap is 279 2024-01-13T18:10:16.391 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 279 2024-01-13T18:10:16.391 INFO:tasks.rados.rados.0.smithi084.stdout:2869: seq_num 890 ranges {3907584=507904} 2024-01-13T18:10:16.413 INFO:tasks.rados.rados.0.smithi084.stdout:2869: writing smithi084102331-43 from 3907584 to 4415488 tid 1 2024-01-13T18:10:16.414 INFO:tasks.rados.rados.0.smithi084.stdout:2870: copy_from oid 10 from oid 16 current snap is 279 2024-01-13T18:10:16.414 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 1322 (ObjNum 876 snap 277 seq_num 876) dirty exists 2024-01-13T18:10:16.414 INFO:tasks.rados.rados.0.smithi084.stdout:2861: expect (ObjNum 799 snap 258 seq_num 799) 2024-01-13T18:10:16.502 INFO:tasks.rados.rados.0.smithi084.stdout:2866: finishing copy_from to smithi084102331-49 2024-01-13T18:10:16.502 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1104 (ObjNum 865 snap 275 seq_num 865) dirty exists 2024-01-13T18:10:16.502 INFO:tasks.rados.rados.0.smithi084.stdout:2866: finishing copy_from racing read to smithi084102331-49 2024-01-13T18:10:16.502 INFO:tasks.rados.rados.0.smithi084.stdout:2870: finishing copy_from to smithi084102331-10 2024-01-13T18:10:16.502 INFO:tasks.rados.rados.0.smithi084.stdout:2870: got expected ENOENT (src dne) 2024-01-13T18:10:16.502 INFO:tasks.rados.rados.0.smithi084.stdout:2870: finishing copy_from racing read to smithi084102331-10 2024-01-13T18:10:16.502 INFO:tasks.rados.rados.0.smithi084.stdout:2869: finishing write tid 1 to smithi084102331-43 2024-01-13T18:10:16.502 INFO:tasks.rados.rados.0.smithi084.stdout:2869: finishing write tid 2 to smithi084102331-43 2024-01-13T18:10:16.502 INFO:tasks.rados.rados.0.smithi084.stdout:2869: finishing write tid 3 to smithi084102331-43 2024-01-13T18:10:16.502 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1326 (ObjNum 890 snap 279 seq_num 890) dirty exists 2024-01-13T18:10:16.502 INFO:tasks.rados.rados.0.smithi084.stdout:2869: left oid 43 (ObjNum 890 snap 279 seq_num 890) 2024-01-13T18:10:16.503 INFO:tasks.rados.rados.0.smithi084.stdout:2861: done (5 left) 2024-01-13T18:10:16.503 INFO:tasks.rados.rados.0.smithi084.stdout:2865: done (4 left) 2024-01-13T18:10:16.503 INFO:tasks.rados.rados.0.smithi084.stdout:2866: done (3 left) 2024-01-13T18:10:16.503 INFO:tasks.rados.rados.0.smithi084.stdout:2868: done (2 left) 2024-01-13T18:10:16.503 INFO:tasks.rados.rados.0.smithi084.stdout:2869: done (1 left) 2024-01-13T18:10:16.503 INFO:tasks.rados.rados.0.smithi084.stdout:2870: done (0 left) 2024-01-13T18:10:16.503 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 279 2024-01-13T18:10:16.503 INFO:tasks.rados.rados.0.smithi084.stdout:2871: seq_num 891 ranges {0=532480} 2024-01-13T18:10:16.504 INFO:tasks.rados.rados.0.smithi084.stdout:2871: writing smithi084102331-39 from 0 to 532480 tid 1 2024-01-13T18:10:16.505 INFO:tasks.rados.rados.0.smithi084.stdout:2872: read oid 42 snap -1 2024-01-13T18:10:16.505 INFO:tasks.rados.rados.0.smithi084.stdout:2872: expect (ObjNum 865 snap 275 seq_num 865) 2024-01-13T18:10:16.505 INFO:tasks.rados.rados.0.smithi084.stdout:2873: copy_from oid 27 from oid 32 current snap is 279 2024-01-13T18:10:16.505 INFO:tasks.rados.rados.0.smithi084.stdout:2874: read oid 7 snap -1 2024-01-13T18:10:16.505 INFO:tasks.rados.rados.0.smithi084.stdout:2874: expect (ObjNum 887 snap 279 seq_num 887) 2024-01-13T18:10:16.505 INFO:tasks.rados.rados.0.smithi084.stdout:2875: delete oid 18 current snap is 279 2024-01-13T18:10:16.507 INFO:tasks.rados.rados.0.smithi084.stdout:2875: done (4 left) 2024-01-13T18:10:16.507 INFO:tasks.rados.rados.0.smithi084.stdout:2876: rollback oid 37 current snap is 279 2024-01-13T18:10:16.508 INFO:tasks.rados.rados.0.smithi084.stdout:2876: done (4 left) 2024-01-13T18:10:16.508 INFO:tasks.rados.rados.0.smithi084.stdout:2877: read oid 46 snap -1 2024-01-13T18:10:16.508 INFO:tasks.rados.rados.0.smithi084.stdout:2877: expect (ObjNum 872 snap 277 seq_num 872) 2024-01-13T18:10:16.508 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 279 2024-01-13T18:10:16.508 INFO:tasks.rados.rados.0.smithi084.stdout:2878: seq_num 893 ranges {5799936=565248} 2024-01-13T18:10:16.544 INFO:tasks.rados.rados.0.smithi084.stdout:2878: writing smithi084102331-37 from 5799936 to 6365184 tid 1 2024-01-13T18:10:16.544 INFO:tasks.rados.rados.0.smithi084.stdout:2879: read oid 22 snap -1 2024-01-13T18:10:16.544 INFO:tasks.rados.rados.0.smithi084.stdout:2879: expect (ObjNum 868 snap 277 seq_num 868) 2024-01-13T18:10:16.544 INFO:tasks.rados.rados.0.smithi084.stdout:2880: snap_create 2024-01-13T18:10:16.544 INFO:tasks.rados.rados.0.smithi084.stdout:2872: expect (ObjNum 865 snap 275 seq_num 865) 2024-01-13T18:10:16.546 INFO:tasks.rados.rados.0.smithi084.stdout:2871: finishing write tid 1 to smithi084102331-39 2024-01-13T18:10:16.546 INFO:tasks.rados.rados.0.smithi084.stdout:2871: finishing write tid 2 to smithi084102331-39 2024-01-13T18:10:16.546 INFO:tasks.rados.rados.0.smithi084.stdout:2871: finishing write tid 3 to smithi084102331-39 2024-01-13T18:10:16.546 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1260 (ObjNum 891 snap 279 seq_num 891) dirty exists 2024-01-13T18:10:16.546 INFO:tasks.rados.rados.0.smithi084.stdout:2871: left oid 39 (ObjNum 891 snap 279 seq_num 891) 2024-01-13T18:10:16.547 INFO:tasks.rados.rados.0.smithi084.stdout:2877: expect (ObjNum 872 snap 277 seq_num 872) 2024-01-13T18:10:16.629 INFO:tasks.rados.rados.0.smithi084.stdout:2874: expect (ObjNum 887 snap 279 seq_num 887) 2024-01-13T18:10:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:16 smithi099 ceph-mon[138788]: osdmap e634: 8 total, 8 up, 8 in 2024-01-13T18:10:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:16 smithi099 ceph-mon[138788]: pgmap v663: 121 pgs: 121 active+clean; 171 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 84 KiB/s wr, 5 op/s 2024-01-13T18:10:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:16 smithi084 ceph-mon[116404]: osdmap e634: 8 total, 8 up, 8 in 2024-01-13T18:10:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:16 smithi084 ceph-mon[116404]: pgmap v663: 121 pgs: 121 active+clean; 171 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 84 KiB/s wr, 5 op/s 2024-01-13T18:10:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:16 smithi084 ceph-mon[119097]: osdmap e634: 8 total, 8 up, 8 in 2024-01-13T18:10:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:16 smithi084 ceph-mon[119097]: pgmap v663: 121 pgs: 121 active+clean; 171 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 84 KiB/s wr, 5 op/s 2024-01-13T18:10:17.453 INFO:tasks.rados.rados.0.smithi084.stdout:2873: finishing copy_from to smithi084102331-27 2024-01-13T18:10:17.454 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1246 (ObjNum 702 snap 220 seq_num 702) dirty exists 2024-01-13T18:10:17.454 INFO:tasks.rados.rados.0.smithi084.stdout:2878: finishing write tid 1 to smithi084102331-37 2024-01-13T18:10:17.454 INFO:tasks.rados.rados.0.smithi084.stdout:2878: finishing write tid 2 to smithi084102331-37 2024-01-13T18:10:17.454 INFO:tasks.rados.rados.0.smithi084.stdout:2873: finishing copy_from racing read to smithi084102331-27 2024-01-13T18:10:17.454 INFO:tasks.rados.rados.0.smithi084.stdout:2878: finishing write tid 3 to smithi084102331-37 2024-01-13T18:10:17.454 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1336 (ObjNum 893 snap 279 seq_num 893) dirty exists 2024-01-13T18:10:17.454 INFO:tasks.rados.rados.0.smithi084.stdout:2878: left oid 37 (ObjNum 893 snap 279 seq_num 893) 2024-01-13T18:10:17.454 INFO:tasks.rados.rados.0.smithi084.stdout:2879: expect (ObjNum 868 snap 277 seq_num 868) 2024-01-13T18:10:17.878 INFO:tasks.rados.rados.0.smithi084.stdout:2871: done (7 left) 2024-01-13T18:10:17.878 INFO:tasks.rados.rados.0.smithi084.stdout:2872: done (6 left) 2024-01-13T18:10:17.878 INFO:tasks.rados.rados.0.smithi084.stdout:2873: done (5 left) 2024-01-13T18:10:17.878 INFO:tasks.rados.rados.0.smithi084.stdout:2874: done (4 left) 2024-01-13T18:10:17.878 INFO:tasks.rados.rados.0.smithi084.stdout:2877: done (3 left) 2024-01-13T18:10:17.878 INFO:tasks.rados.rados.0.smithi084.stdout:2878: done (2 left) 2024-01-13T18:10:17.878 INFO:tasks.rados.rados.0.smithi084.stdout:2879: done (1 left) 2024-01-13T18:10:17.878 INFO:tasks.rados.rados.0.smithi084.stdout:2880: done (0 left) 2024-01-13T18:10:17.878 INFO:tasks.rados.rados.0.smithi084.stdout:2881: read oid 11 snap -1 2024-01-13T18:10:17.878 INFO:tasks.rados.rados.0.smithi084.stdout:2881: expect (ObjNum 864 snap 273 seq_num 864) 2024-01-13T18:10:17.878 INFO:tasks.rados.rados.0.smithi084.stdout:2882: snap_remove snap 279 2024-01-13T18:10:18.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:17 smithi099 ceph-mon[138788]: osdmap e635: 8 total, 8 up, 8 in 2024-01-13T18:10:18.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:17 smithi099 ceph-mon[138788]: osdmap e636: 8 total, 8 up, 8 in 2024-01-13T18:10:18.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:17 smithi084 ceph-mon[116404]: osdmap e635: 8 total, 8 up, 8 in 2024-01-13T18:10:18.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:17 smithi084 ceph-mon[116404]: osdmap e636: 8 total, 8 up, 8 in 2024-01-13T18:10:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:17 smithi084 ceph-mon[119097]: osdmap e635: 8 total, 8 up, 8 in 2024-01-13T18:10:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:17 smithi084 ceph-mon[119097]: osdmap e636: 8 total, 8 up, 8 in 2024-01-13T18:10:18.739 INFO:tasks.rados.rados.0.smithi084.stdout:2882: done (1 left) 2024-01-13T18:10:18.739 INFO:tasks.rados.rados.0.smithi084.stdout:2883: read oid 48 snap -1 2024-01-13T18:10:18.739 INFO:tasks.rados.rados.0.smithi084.stdout:2883: expect deleted 2024-01-13T18:10:18.739 INFO:tasks.rados.rados.0.smithi084.stdout:2884: rollback oid 2 current snap is 280 2024-01-13T18:10:18.740 INFO:tasks.rados.rados.0.smithi084.stdout:2884: done (2 left) 2024-01-13T18:10:18.740 INFO:tasks.rados.rados.0.smithi084.stdout:2885: read oid 43 snap -1 2024-01-13T18:10:18.740 INFO:tasks.rados.rados.0.smithi084.stdout:2885: expect (ObjNum 890 snap 279 seq_num 890) 2024-01-13T18:10:18.740 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 280 2024-01-13T18:10:18.740 INFO:tasks.rados.rados.0.smithi084.stdout:2886: seq_num 894 ranges {1925120=581632} 2024-01-13T18:10:18.753 INFO:tasks.rados.rados.0.smithi084.stdout:2886: writing smithi084102331-1 from 1925120 to 2506752 tid 1 2024-01-13T18:10:18.754 INFO:tasks.rados.rados.0.smithi084.stdout:2887: snap_create 2024-01-13T18:10:18.754 INFO:tasks.rados.rados.0.smithi084.stdout:2881: expect (ObjNum 864 snap 273 seq_num 864) 2024-01-13T18:10:19.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:18 smithi099 ceph-mon[138788]: pgmap v666: 121 pgs: 121 active+clean; 132 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 4.3 MiB/s wr, 33 op/s 2024-01-13T18:10:19.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:18 smithi084 ceph-mon[116404]: pgmap v666: 121 pgs: 121 active+clean; 132 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 4.3 MiB/s wr, 33 op/s 2024-01-13T18:10:19.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:18 smithi084 ceph-mon[119097]: pgmap v666: 121 pgs: 121 active+clean; 132 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 4.3 MiB/s wr, 33 op/s 2024-01-13T18:10:19.196 INFO:tasks.rados.rados.0.smithi084.stdout:2885: expect (ObjNum 890 snap 279 seq_num 890) 2024-01-13T18:10:19.500 INFO:tasks.rados.rados.0.smithi084.stdout:2886: finishing write tid 1 to smithi084102331-1 2024-01-13T18:10:19.500 INFO:tasks.rados.rados.0.smithi084.stdout:2886: finishing write tid 2 to smithi084102331-1 2024-01-13T18:10:19.500 INFO:tasks.rados.rados.0.smithi084.stdout:2886: finishing write tid 3 to smithi084102331-1 2024-01-13T18:10:19.500 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1534 (ObjNum 894 snap 280 seq_num 894) dirty exists 2024-01-13T18:10:19.500 INFO:tasks.rados.rados.0.smithi084.stdout:2886: left oid 1 (ObjNum 894 snap 280 seq_num 894) 2024-01-13T18:10:19.743 INFO:tasks.rados.rados.0.smithi084.stdout:2881: done (4 left) 2024-01-13T18:10:19.743 INFO:tasks.rados.rados.0.smithi084.stdout:2883: done (3 left) 2024-01-13T18:10:19.743 INFO:tasks.rados.rados.0.smithi084.stdout:2885: done (2 left) 2024-01-13T18:10:19.743 INFO:tasks.rados.rados.0.smithi084.stdout:2886: done (1 left) 2024-01-13T18:10:19.744 INFO:tasks.rados.rados.0.smithi084.stdout:2887: done (0 left) 2024-01-13T18:10:19.744 INFO:tasks.rados.rados.0.smithi084.stdout:2888: delete oid 35 current snap is 281 2024-01-13T18:10:19.746 INFO:tasks.rados.rados.0.smithi084.stdout:2888: done (0 left) 2024-01-13T18:10:19.747 INFO:tasks.rados.rados.0.smithi084.stdout:2889: snap_create 2024-01-13T18:10:20.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:19 smithi099 ceph-mon[138788]: osdmap e637: 8 total, 8 up, 8 in 2024-01-13T18:10:20.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:19 smithi084 ceph-mon[116404]: osdmap e637: 8 total, 8 up, 8 in 2024-01-13T18:10:20.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:19 smithi084 ceph-mon[119097]: osdmap e637: 8 total, 8 up, 8 in 2024-01-13T18:10:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:10:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:10:20] "GET /metrics HTTP/1.1" 200 36188 "" "Prometheus/2.43.0" 2024-01-13T18:10:20.751 INFO:tasks.rados.rados.0.smithi084.stdout:2889: done (0 left) 2024-01-13T18:10:20.751 INFO:tasks.rados.rados.0.smithi084.stdout:2890: read oid 43 snap 280 2024-01-13T18:10:20.751 INFO:tasks.rados.rados.0.smithi084.stdout:2890: expect (ObjNum 890 snap 279 seq_num 890) 2024-01-13T18:10:20.752 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 282 2024-01-13T18:10:20.752 INFO:tasks.rados.rados.0.smithi084.stdout:2891: seq_num 896 ranges {0=614400} 2024-01-13T18:10:20.755 INFO:tasks.rados.rados.0.smithi084.stdout:2891: writing smithi084102331-8 from 0 to 614400 tid 1 2024-01-13T18:10:20.755 INFO:tasks.rados.rados.0.smithi084.stdout:2892: rollback oid 29 current snap is 282 2024-01-13T18:10:20.755 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 281 2024-01-13T18:10:20.755 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 282 2024-01-13T18:10:20.755 INFO:tasks.rados.rados.0.smithi084.stdout:2893: seq_num 897 ranges {3031040=630784} 2024-01-13T18:10:20.775 INFO:tasks.rados.rados.0.smithi084.stdout:2893: writing smithi084102331-45 from 3031040 to 3661824 tid 1 2024-01-13T18:10:20.775 INFO:tasks.rados.rados.0.smithi084.stdout:2894: delete oid 23 current snap is 282 2024-01-13T18:10:20.775 INFO:tasks.rados.rados.0.smithi084.stdout:2892: finishing rollback tid 0 to smithi084102331-29 2024-01-13T18:10:20.776 INFO:tasks.rados.rados.0.smithi084.stdout:2892: finishing rollback tid 1 to smithi084102331-29 2024-01-13T18:10:20.776 INFO:tasks.rados.rados.0.smithi084.stdout:2891: finishing write tid 1 to smithi084102331-8 2024-01-13T18:10:20.776 INFO:tasks.rados.rados.0.smithi084.stdout:2891: finishing write tid 2 to smithi084102331-8 2024-01-13T18:10:20.776 INFO:tasks.rados.rados.0.smithi084.stdout:2892: finishing rollback tid 2 to smithi084102331-29 2024-01-13T18:10:20.776 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1326 (ObjNum 741 snap 230 seq_num 741) dirty exists 2024-01-13T18:10:20.776 INFO:tasks.rados.rados.0.smithi084.stdout:2891: finishing write tid 3 to smithi084102331-8 2024-01-13T18:10:20.776 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1460 (ObjNum 896 snap 282 seq_num 896) dirty exists 2024-01-13T18:10:20.776 INFO:tasks.rados.rados.0.smithi084.stdout:2891: left oid 8 (ObjNum 896 snap 282 seq_num 896) 2024-01-13T18:10:20.776 INFO:tasks.rados.rados.0.smithi084.stdout:2890: expect (ObjNum 890 snap 279 seq_num 890) 2024-01-13T18:10:21.080 INFO:tasks.rados.rados.0.smithi084.stdout:2893: finishing write tid 1 to smithi084102331-45 2024-01-13T18:10:21.080 INFO:tasks.rados.rados.0.smithi084.stdout:2893: finishing write tid 2 to smithi084102331-45 2024-01-13T18:10:21.080 INFO:tasks.rados.rados.0.smithi084.stdout:2893: finishing write tid 3 to smithi084102331-45 2024-01-13T18:10:21.080 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1537 (ObjNum 897 snap 282 seq_num 897) dirty exists 2024-01-13T18:10:21.080 INFO:tasks.rados.rados.0.smithi084.stdout:2893: left oid 45 (ObjNum 897 snap 282 seq_num 897) 2024-01-13T18:10:21.080 INFO:tasks.rados.rados.0.smithi084.stdout:2890: done (4 left) 2024-01-13T18:10:21.081 INFO:tasks.rados.rados.0.smithi084.stdout:2891: done (3 left) 2024-01-13T18:10:21.081 INFO:tasks.rados.rados.0.smithi084.stdout:2892: done (2 left) 2024-01-13T18:10:21.081 INFO:tasks.rados.rados.0.smithi084.stdout:2893: done (1 left) 2024-01-13T18:10:21.081 INFO:tasks.rados.rados.0.smithi084.stdout:2894: done (0 left) 2024-01-13T18:10:21.081 INFO:tasks.rados.rados.0.smithi084.stdout:2895: setattr oid 39 current snap is 282 2024-01-13T18:10:21.082 INFO:tasks.rados.rados.0.smithi084.stdout:2896: read oid 22 snap -1 2024-01-13T18:10:21.082 INFO:tasks.rados.rados.0.smithi084.stdout:2896: expect (ObjNum 868 snap 277 seq_num 868) 2024-01-13T18:10:21.082 INFO:tasks.rados.rados.0.smithi084.stdout:2897: copy_from oid 30 from oid 5 current snap is 282 2024-01-13T18:10:21.082 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 282 2024-01-13T18:10:21.082 INFO:tasks.rados.rados.0.smithi084.stdout:2898: seq_num 899 ranges {6717440=663552} 2024-01-13T18:10:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:20 smithi099 ceph-mon[138788]: osdmap e638: 8 total, 8 up, 8 in 2024-01-13T18:10:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:20 smithi099 ceph-mon[138788]: pgmap v669: 121 pgs: 121 active+clean; 124 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 25 MiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-01-13T18:10:21.121 INFO:tasks.rados.rados.0.smithi084.stdout:2898: writing smithi084102331-11 from 6717440 to 7380992 tid 1 2024-01-13T18:10:21.121 INFO:tasks.rados.rados.0.smithi084.stdout:2899: snap_remove snap 280 2024-01-13T18:10:21.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:20 smithi084 ceph-mon[119097]: osdmap e638: 8 total, 8 up, 8 in 2024-01-13T18:10:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:20 smithi084 ceph-mon[119097]: pgmap v669: 121 pgs: 121 active+clean; 124 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 25 MiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-01-13T18:10:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:20 smithi084 ceph-mon[116404]: osdmap e638: 8 total, 8 up, 8 in 2024-01-13T18:10:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:20 smithi084 ceph-mon[116404]: pgmap v669: 121 pgs: 121 active+clean; 124 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 25 MiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-01-13T18:10:21.760 INFO:tasks.rados.rados.0.smithi084.stdout:2899: done (4 left) 2024-01-13T18:10:21.760 INFO:tasks.rados.rados.0.smithi084.stdout:2900: delete oid 7 current snap is 282 2024-01-13T18:10:21.763 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1261 (ObjNum 891 snap 279 seq_num 891) dirty exists 2024-01-13T18:10:21.763 INFO:tasks.rados.rados.0.smithi084.stdout:2897: finishing copy_from to smithi084102331-30 2024-01-13T18:10:21.763 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1229 (ObjNum 837 snap 271 seq_num 837) dirty exists 2024-01-13T18:10:21.763 INFO:tasks.rados.rados.0.smithi084.stdout:2897: finishing copy_from racing read to smithi084102331-30 2024-01-13T18:10:21.763 INFO:tasks.rados.rados.0.smithi084.stdout:2896: expect (ObjNum 868 snap 277 seq_num 868) 2024-01-13T18:10:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:21 smithi099 ceph-mon[138788]: osdmap e639: 8 total, 8 up, 8 in 2024-01-13T18:10:22.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:21 smithi084 ceph-mon[116404]: osdmap e639: 8 total, 8 up, 8 in 2024-01-13T18:10:22.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:21 smithi084 ceph-mon[119097]: osdmap e639: 8 total, 8 up, 8 in 2024-01-13T18:10:22.187 INFO:tasks.rados.rados.0.smithi084.stdout:2898: finishing write tid 1 to smithi084102331-11 2024-01-13T18:10:22.187 INFO:tasks.rados.rados.0.smithi084.stdout:2895: done (4 left) 2024-01-13T18:10:22.187 INFO:tasks.rados.rados.0.smithi084.stdout:2896: done (3 left) 2024-01-13T18:10:22.187 INFO:tasks.rados.rados.0.smithi084.stdout:2897: done (2 left) 2024-01-13T18:10:22.187 INFO:tasks.rados.rados.0.smithi084.stdout:2900: done (1 left) 2024-01-13T18:10:22.188 INFO:tasks.rados.rados.0.smithi084.stdout:2901: rollback oid 4 current snap is 282 2024-01-13T18:10:22.188 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 281 2024-01-13T18:10:22.188 INFO:tasks.rados.rados.0.smithi084.stdout:2898: finishing write tid 2 to smithi084102331-11 2024-01-13T18:10:22.188 INFO:tasks.rados.rados.0.smithi084.stdout:2898: finishing write tid 3 to smithi084102331-11 2024-01-13T18:10:22.188 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1263 (ObjNum 899 snap 282 seq_num 899) dirty exists 2024-01-13T18:10:22.188 INFO:tasks.rados.rados.0.smithi084.stdout:2898: left oid 11 (ObjNum 899 snap 282 seq_num 899) 2024-01-13T18:10:22.188 INFO:tasks.rados.rados.0.smithi084.stdout:2898: done (1 left) 2024-01-13T18:10:22.188 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 282 2024-01-13T18:10:22.188 INFO:tasks.rados.rados.0.smithi084.stdout:2902: seq_num 901 ranges {417792=696320} 2024-01-13T18:10:22.193 INFO:tasks.rados.rados.0.smithi084.stdout:2902: writing smithi084102331-29 from 417792 to 1114112 tid 1 2024-01-13T18:10:22.193 INFO:tasks.rados.rados.0.smithi084.stdout:2903: read oid 48 snap 281 2024-01-13T18:10:22.194 INFO:tasks.rados.rados.0.smithi084.stdout:2903: expect deleted 2024-01-13T18:10:22.194 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 282 2024-01-13T18:10:22.194 INFO:tasks.rados.rados.0.smithi084.stdout:2901: finishing rollback tid 0 to smithi084102331-4 2024-01-13T18:10:22.194 INFO:tasks.rados.rados.0.smithi084.stdout:2901: finishing rollback tid 1 to smithi084102331-4 2024-01-13T18:10:22.194 INFO:tasks.rados.rados.0.smithi084.stdout:2901: finishing rollback tid 2 to smithi084102331-4 2024-01-13T18:10:22.194 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 1315 (ObjNum 782 snap 254 seq_num 782) dirty exists 2024-01-13T18:10:22.194 INFO:tasks.rados.rados.0.smithi084.stdout:2904: seq_num 902 ranges {3514368=712704} 2024-01-13T18:10:22.217 INFO:tasks.rados.rados.0.smithi084.stdout:2904: writing smithi084102331-12 from 3514368 to 4227072 tid 1 2024-01-13T18:10:22.217 INFO:tasks.rados.rados.0.smithi084.stdout:2901: done (3 left) 2024-01-13T18:10:22.217 INFO:tasks.rados.rados.0.smithi084.stdout:2905: copy_from oid 41 from oid 37 current snap is 282 2024-01-13T18:10:22.217 INFO:tasks.rados.rados.0.smithi084.stdout:2902: finishing write tid 1 to smithi084102331-29 2024-01-13T18:10:22.217 INFO:tasks.rados.rados.0.smithi084.stdout:2902: finishing write tid 2 to smithi084102331-29 2024-01-13T18:10:22.217 INFO:tasks.rados.rados.0.smithi084.stdout:2902: finishing write tid 3 to smithi084102331-29 2024-01-13T18:10:22.217 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1328 (ObjNum 901 snap 282 seq_num 901) dirty exists 2024-01-13T18:10:22.217 INFO:tasks.rados.rados.0.smithi084.stdout:2902: left oid 29 (ObjNum 901 snap 282 seq_num 901) 2024-01-13T18:10:22.217 INFO:tasks.rados.rados.0.smithi084.stdout:2902: done (3 left) 2024-01-13T18:10:22.217 INFO:tasks.rados.rados.0.smithi084.stdout:2903: done (2 left) 2024-01-13T18:10:22.217 INFO:tasks.rados.rados.0.smithi084.stdout:2906: delete oid 14 current snap is 282 2024-01-13T18:10:22.219 INFO:tasks.rados.rados.0.smithi084.stdout:2906: done (2 left) 2024-01-13T18:10:22.219 INFO:tasks.rados.rados.0.smithi084.stdout:2907: read oid 5 snap -1 2024-01-13T18:10:22.219 INFO:tasks.rados.rados.0.smithi084.stdout:2907: expect (ObjNum 837 snap 271 seq_num 837) 2024-01-13T18:10:22.220 INFO:tasks.rados.rados.0.smithi084.stdout:2908: copy_from oid 44 from oid 3 current snap is 282 2024-01-13T18:10:22.221 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 282 2024-01-13T18:10:22.221 INFO:tasks.rados.rados.0.smithi084.stdout:2909: seq_num 904 ranges {311296=745472} 2024-01-13T18:10:22.226 INFO:tasks.rados.rados.0.smithi084.stdout:2909: writing smithi084102331-20 from 311296 to 1056768 tid 1 2024-01-13T18:10:22.226 INFO:tasks.rados.rados.0.smithi084.stdout:2910: delete oid 21 current snap is 282 2024-01-13T18:10:22.226 INFO:tasks.rados.rados.0.smithi084.stdout:2904: finishing write tid 1 to smithi084102331-12 2024-01-13T18:10:22.227 INFO:tasks.rados.rados.0.smithi084.stdout:2904: finishing write tid 2 to smithi084102331-12 2024-01-13T18:10:22.227 INFO:tasks.rados.rados.0.smithi084.stdout:2904: finishing write tid 3 to smithi084102331-12 2024-01-13T18:10:22.227 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1619 (ObjNum 902 snap 282 seq_num 902) dirty exists 2024-01-13T18:10:22.227 INFO:tasks.rados.rados.0.smithi084.stdout:2904: left oid 12 (ObjNum 902 snap 282 seq_num 902) 2024-01-13T18:10:22.227 INFO:tasks.rados.rados.0.smithi084.stdout:2908: finishing copy_from to smithi084102331-44 2024-01-13T18:10:22.227 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1453 (ObjNum 257 snap 0 seq_num 4038131936) dirty exists 2024-01-13T18:10:22.227 INFO:tasks.rados.rados.0.smithi084.stdout:2908: finishing copy_from racing read to smithi084102331-44 2024-01-13T18:10:22.232 INFO:tasks.rados.rados.0.smithi084.stdout:2907: expect (ObjNum 837 snap 271 seq_num 837) 2024-01-13T18:10:22.321 INFO:tasks.rados.rados.0.smithi084.stdout:2909: finishing write tid 1 to smithi084102331-20 2024-01-13T18:10:22.321 INFO:tasks.rados.rados.0.smithi084.stdout:2909: finishing write tid 2 to smithi084102331-20 2024-01-13T18:10:22.321 INFO:tasks.rados.rados.0.smithi084.stdout:2909: finishing write tid 3 to smithi084102331-20 2024-01-13T18:10:22.321 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1285 (ObjNum 904 snap 282 seq_num 904) dirty exists 2024-01-13T18:10:22.321 INFO:tasks.rados.rados.0.smithi084.stdout:2909: left oid 20 (ObjNum 904 snap 282 seq_num 904) 2024-01-13T18:10:22.321 INFO:tasks.rados.rados.0.smithi084.stdout:2905: finishing copy_from to smithi084102331-41 2024-01-13T18:10:22.321 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1336 (ObjNum 893 snap 279 seq_num 893) dirty exists 2024-01-13T18:10:22.321 INFO:tasks.rados.rados.0.smithi084.stdout:2905: finishing copy_from racing read to smithi084102331-41 2024-01-13T18:10:22.321 INFO:tasks.rados.rados.0.smithi084.stdout:2904: done (5 left) 2024-01-13T18:10:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:2905: done (4 left) 2024-01-13T18:10:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:2907: done (3 left) 2024-01-13T18:10:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:2908: done (2 left) 2024-01-13T18:10:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:2909: done (1 left) 2024-01-13T18:10:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:2910: done (0 left) 2024-01-13T18:10:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:2911: rollback oid 8 current snap is 282 2024-01-13T18:10:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 281 2024-01-13T18:10:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:2912: copy_from oid 10 from oid 47 current snap is 282 2024-01-13T18:10:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:2913: rollback oid 12 current snap is 282 2024-01-13T18:10:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 281 2024-01-13T18:10:22.322 INFO:tasks.rados.rados.0.smithi084.stdout:2914: delete oid 43 current snap is 282 2024-01-13T18:10:22.323 INFO:tasks.rados.rados.0.smithi084.stdout:2912: finishing copy_from to smithi084102331-10 2024-01-13T18:10:22.323 INFO:tasks.rados.rados.0.smithi084.stdout:2912: got expected ENOENT (src dne) 2024-01-13T18:10:22.323 INFO:tasks.rados.rados.0.smithi084.stdout:2911: finishing rollback tid 0 to smithi084102331-8 2024-01-13T18:10:22.323 INFO:tasks.rados.rados.0.smithi084.stdout:2912: finishing copy_from racing read to smithi084102331-10 2024-01-13T18:10:22.323 INFO:tasks.rados.rados.0.smithi084.stdout:2911: finishing rollback tid 1 to smithi084102331-8 2024-01-13T18:10:22.323 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1464 (ObjNum 65 snap 0 seq_num 1533109852) dirty dne 2024-01-13T18:10:22.324 INFO:tasks.rados.rados.0.smithi084.stdout:2911: done (3 left) 2024-01-13T18:10:22.324 INFO:tasks.rados.rados.0.smithi084.stdout:2912: done (2 left) 2024-01-13T18:10:22.324 INFO:tasks.rados.rados.0.smithi084.stdout:2914: done (1 left) 2024-01-13T18:10:22.324 INFO:tasks.rados.rados.0.smithi084.stdout:2915: read oid 6 snap -1 2024-01-13T18:10:22.324 INFO:tasks.rados.rados.0.smithi084.stdout:2915: expect (ObjNum 825 snap 267 seq_num 825) 2024-01-13T18:10:22.324 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 282 2024-01-13T18:10:22.324 INFO:tasks.rados.rados.0.smithi084.stdout:2916: seq_num 907 ranges {0=794624} 2024-01-13T18:10:22.329 INFO:tasks.rados.rados.0.smithi084.stdout:2916: writing smithi084102331-18 from 0 to 794624 tid 1 2024-01-13T18:10:22.329 INFO:tasks.rados.rados.0.smithi084.stdout:2917: rmattr oid 39 current snap is 282 2024-01-13T18:10:22.329 INFO:tasks.rados.rados.0.smithi084.stdout:2913: finishing rollback tid 0 to smithi084102331-12 2024-01-13T18:10:22.329 INFO:tasks.rados.rados.0.smithi084.stdout:2913: finishing rollback tid 1 to smithi084102331-12 2024-01-13T18:10:22.329 INFO:tasks.rados.rados.0.smithi084.stdout:2913: finishing rollback tid 2 to smithi084102331-12 2024-01-13T18:10:22.329 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1622 (ObjNum 873 snap 277 seq_num 873) dirty exists 2024-01-13T18:10:22.329 INFO:tasks.rados.rados.0.smithi084.stdout:2913: done (3 left) 2024-01-13T18:10:22.329 INFO:tasks.rados.rados.0.smithi084.stdout:2918: snap_remove snap 281 2024-01-13T18:10:22.699 INFO:tasks.rados.rados.0.smithi084.stdout:2918: done (3 left) 2024-01-13T18:10:22.699 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 282 2024-01-13T18:10:22.699 INFO:tasks.rados.rados.0.smithi084.stdout:2919: seq_num 908 ranges {2179072=409600,2588672=401408} 2024-01-13T18:10:22.714 INFO:tasks.rados.rados.0.smithi084.stdout:2919: writing smithi084102331-28 from 2179072 to 2588672 tid 1 2024-01-13T18:10:22.717 INFO:tasks.rados.rados.0.smithi084.stdout:2919: writing smithi084102331-28 from 2588672 to 2990080 tid 2 2024-01-13T18:10:22.717 INFO:tasks.rados.rados.0.smithi084.stdout:2920: snap_create 2024-01-13T18:10:22.717 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1337 (ObjNum 891 snap 279 seq_num 891) dirty exists 2024-01-13T18:10:22.717 INFO:tasks.rados.rados.0.smithi084.stdout:2916: finishing write tid 1 to smithi084102331-18 2024-01-13T18:10:22.717 INFO:tasks.rados.rados.0.smithi084.stdout:2916: finishing write tid 2 to smithi084102331-18 2024-01-13T18:10:22.717 INFO:tasks.rados.rados.0.smithi084.stdout:2916: finishing write tid 3 to smithi084102331-18 2024-01-13T18:10:22.717 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1393 (ObjNum 907 snap 282 seq_num 907) dirty exists 2024-01-13T18:10:22.717 INFO:tasks.rados.rados.0.smithi084.stdout:2916: left oid 18 (ObjNum 907 snap 282 seq_num 907) 2024-01-13T18:10:22.717 INFO:tasks.rados.rados.0.smithi084.stdout:2915: expect (ObjNum 825 snap 267 seq_num 825) 2024-01-13T18:10:22.853 INFO:tasks.rados.rados.0.smithi084.stdout:2919: finishing write tid 1 to smithi084102331-28 2024-01-13T18:10:22.854 INFO:tasks.rados.rados.0.smithi084.stdout:2919: finishing write tid 2 to smithi084102331-28 2024-01-13T18:10:22.854 INFO:tasks.rados.rados.0.smithi084.stdout:2919: finishing write tid 3 to smithi084102331-28 2024-01-13T18:10:22.854 INFO:tasks.rados.rados.0.smithi084.stdout:2919: finishing write tid 4 to smithi084102331-28 2024-01-13T18:10:22.854 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1249 (ObjNum 908 snap 282 seq_num 908) dirty exists 2024-01-13T18:10:22.854 INFO:tasks.rados.rados.0.smithi084.stdout:2919: left oid 28 (ObjNum 908 snap 282 seq_num 908) 2024-01-13T18:10:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:22 smithi099 ceph-mon[138788]: osdmap e640: 8 total, 8 up, 8 in 2024-01-13T18:10:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:22 smithi099 ceph-mon[138788]: pgmap v672: 121 pgs: 121 active+clean; 125 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 556 KiB/s wr, 10 op/s 2024-01-13T18:10:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:22 smithi099 ceph-mon[138788]: osdmap e641: 8 total, 8 up, 8 in 2024-01-13T18:10:23.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:22 smithi084 ceph-mon[119097]: osdmap e640: 8 total, 8 up, 8 in 2024-01-13T18:10:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:22 smithi084 ceph-mon[119097]: pgmap v672: 121 pgs: 121 active+clean; 125 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 556 KiB/s wr, 10 op/s 2024-01-13T18:10:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:22 smithi084 ceph-mon[119097]: osdmap e641: 8 total, 8 up, 8 in 2024-01-13T18:10:23.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:22 smithi084 ceph-mon[116404]: osdmap e640: 8 total, 8 up, 8 in 2024-01-13T18:10:23.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:22 smithi084 ceph-mon[116404]: pgmap v672: 121 pgs: 121 active+clean; 125 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 556 KiB/s wr, 10 op/s 2024-01-13T18:10:23.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:22 smithi084 ceph-mon[116404]: osdmap e641: 8 total, 8 up, 8 in 2024-01-13T18:10:23.712 INFO:tasks.rados.rados.0.smithi084.stdout:2915: done (4 left) 2024-01-13T18:10:23.712 INFO:tasks.rados.rados.0.smithi084.stdout:2916: done (3 left) 2024-01-13T18:10:23.712 INFO:tasks.rados.rados.0.smithi084.stdout:2917: done (2 left) 2024-01-13T18:10:23.712 INFO:tasks.rados.rados.0.smithi084.stdout:2919: done (1 left) 2024-01-13T18:10:23.712 INFO:tasks.rados.rados.0.smithi084.stdout:2920: done (0 left) 2024-01-13T18:10:23.713 INFO:tasks.rados.rados.0.smithi084.stdout:2921: rollback oid 12 current snap is 283 2024-01-13T18:10:23.713 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 282 2024-01-13T18:10:23.713 INFO:tasks.rados.rados.0.smithi084.stdout:2922: rmattr oid 23 current snap is 283 2024-01-13T18:10:23.713 INFO:tasks.rados.rados.0.smithi084.stdout:2922: done (1 left) 2024-01-13T18:10:23.713 INFO:tasks.rados.rados.0.smithi084.stdout:2923: read oid 2 snap -1 2024-01-13T18:10:23.713 INFO:tasks.rados.rados.0.smithi084.stdout:2923: expect (ObjNum 882 snap 279 seq_num 882) 2024-01-13T18:10:23.713 INFO:tasks.rados.rados.0.smithi084.stdout:2924: read oid 34 snap -1 2024-01-13T18:10:23.713 INFO:tasks.rados.rados.0.smithi084.stdout:2924: expect (ObjNum 853 snap 273 seq_num 853) 2024-01-13T18:10:23.713 INFO:tasks.rados.rados.0.smithi084.stdout:2925: setattr oid 30 current snap is 283 2024-01-13T18:10:23.714 INFO:tasks.rados.rados.0.smithi084.stdout:2926: rollback oid 9 current snap is 283 2024-01-13T18:10:23.714 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 282 2024-01-13T18:10:23.714 INFO:tasks.rados.rados.0.smithi084.stdout:2927: rmattr oid 44 current snap is 283 2024-01-13T18:10:23.714 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 283 2024-01-13T18:10:23.714 INFO:tasks.rados.rados.0.smithi084.stdout:2928: seq_num 909 ranges {7380992=425984,7806976=401408} 2024-01-13T18:10:23.756 INFO:tasks.rados.rados.0.smithi084.stdout:2928: writing smithi084102331-11 from 7380992 to 7806976 tid 1 2024-01-13T18:10:23.758 INFO:tasks.rados.rados.0.smithi084.stdout:2928: writing smithi084102331-11 from 7806976 to 8208384 tid 2 2024-01-13T18:10:23.758 INFO:tasks.rados.rados.0.smithi084.stdout:2929: delete oid 38 current snap is 283 2024-01-13T18:10:23.758 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1337 (ObjNum 837 snap 271 seq_num 837) dirty exists 2024-01-13T18:10:23.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1468 (ObjNum 337 snap 0 seq_num 4037739904) dirty exists 2024-01-13T18:10:23.759 INFO:tasks.rados.rados.0.smithi084.stdout:2921: finishing rollback tid 0 to smithi084102331-12 2024-01-13T18:10:23.759 INFO:tasks.rados.rados.0.smithi084.stdout:2921: finishing rollback tid 1 to smithi084102331-12 2024-01-13T18:10:23.759 INFO:tasks.rados.rados.0.smithi084.stdout:2921: finishing rollback tid 2 to smithi084102331-12 2024-01-13T18:10:23.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1630 (ObjNum 873 snap 277 seq_num 873) dirty exists 2024-01-13T18:10:23.759 INFO:tasks.rados.rados.0.smithi084.stdout:2926: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:10:23.759 INFO:tasks.rados.rados.0.smithi084.stdout:2926: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:10:23.759 INFO:tasks.rados.rados.0.smithi084.stdout:2926: finishing rollback tid 2 to smithi084102331-9 2024-01-13T18:10:23.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1138 (ObjNum 845 snap 273 seq_num 845) dirty exists 2024-01-13T18:10:23.759 INFO:tasks.rados.rados.0.smithi084.stdout:2923: expect (ObjNum 882 snap 279 seq_num 882) 2024-01-13T18:10:23.807 INFO:tasks.rados.rados.0.smithi084.stdout:2924: expect (ObjNum 853 snap 273 seq_num 853) 2024-01-13T18:10:24.022 INFO:tasks.rados.rados.0.smithi084.stdout:2928: finishing write tid 1 to smithi084102331-11 2024-01-13T18:10:24.022 INFO:tasks.rados.rados.0.smithi084.stdout:2928: finishing write tid 2 to smithi084102331-11 2024-01-13T18:10:24.022 INFO:tasks.rados.rados.0.smithi084.stdout:2921: done (7 left) 2024-01-13T18:10:24.022 INFO:tasks.rados.rados.0.smithi084.stdout:2923: done (6 left) 2024-01-13T18:10:24.022 INFO:tasks.rados.rados.0.smithi084.stdout:2924: done (5 left) 2024-01-13T18:10:24.022 INFO:tasks.rados.rados.0.smithi084.stdout:2925: done (4 left) 2024-01-13T18:10:24.022 INFO:tasks.rados.rados.0.smithi084.stdout:2926: done (3 left) 2024-01-13T18:10:24.023 INFO:tasks.rados.rados.0.smithi084.stdout:2927: done (2 left) 2024-01-13T18:10:24.023 INFO:tasks.rados.rados.0.smithi084.stdout:2929: done (1 left) 2024-01-13T18:10:24.023 INFO:tasks.rados.rados.0.smithi084.stdout:2930: copy_from oid 23 from oid 33 current snap is 283 2024-01-13T18:10:24.023 INFO:tasks.rados.rados.0.smithi084.stdout:2928: finishing write tid 3 to smithi084102331-11 2024-01-13T18:10:24.023 INFO:tasks.rados.rados.0.smithi084.stdout:2928: finishing write tid 4 to smithi084102331-11 2024-01-13T18:10:24.023 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1340 (ObjNum 909 snap 283 seq_num 909) dirty exists 2024-01-13T18:10:24.023 INFO:tasks.rados.rados.0.smithi084.stdout:2928: left oid 11 (ObjNum 909 snap 283 seq_num 909) 2024-01-13T18:10:24.023 INFO:tasks.rados.rados.0.smithi084.stdout:2928: done (1 left) 2024-01-13T18:10:24.023 INFO:tasks.rados.rados.0.smithi084.stdout:2931: delete oid 14 current snap is 283 2024-01-13T18:10:24.023 INFO:tasks.rados.rados.0.smithi084.stdout:2931: done (1 left) 2024-01-13T18:10:24.023 INFO:tasks.rados.rados.0.smithi084.stdout:2932: setattr oid 36 current snap is 283 2024-01-13T18:10:24.026 INFO:tasks.rados.rados.0.smithi084.stdout:2930: finishing copy_from to smithi084102331-23 2024-01-13T18:10:24.026 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1326 (ObjNum 945 snap 0 seq_num 4037421040) dirty exists 2024-01-13T18:10:24.026 INFO:tasks.rados.rados.0.smithi084.stdout:2933: rollback oid 10 current snap is 283 2024-01-13T18:10:24.026 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 282 2024-01-13T18:10:24.026 INFO:tasks.rados.rados.0.smithi084.stdout:2934: copy_from oid 46 from oid 49 current snap is 283 2024-01-13T18:10:24.026 INFO:tasks.rados.rados.0.smithi084.stdout:2935: rollback oid 25 current snap is 283 2024-01-13T18:10:24.026 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 25 to 282 2024-01-13T18:10:24.026 INFO:tasks.rados.rados.0.smithi084.stdout:2936: read oid 15 snap -1 2024-01-13T18:10:24.026 INFO:tasks.rados.rados.0.smithi084.stdout:2936: expect (ObjNum 883 snap 279 seq_num 883) 2024-01-13T18:10:24.027 INFO:tasks.rados.rados.0.smithi084.stdout:2937: read oid 40 snap -1 2024-01-13T18:10:24.027 INFO:tasks.rados.rados.0.smithi084.stdout:2937: expect deleted 2024-01-13T18:10:24.027 INFO:tasks.rados.rados.0.smithi084.stdout:2938: rollback oid 8 current snap is 283 2024-01-13T18:10:24.027 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 282 2024-01-13T18:10:24.027 INFO:tasks.rados.rados.0.smithi084.stdout:2939: copy_from oid 21 from oid 14 current snap is 283 2024-01-13T18:10:24.027 INFO:tasks.rados.rados.0.smithi084.stdout:2940: setattr oid 7 current snap is 283 2024-01-13T18:10:24.028 INFO:tasks.rados.rados.0.smithi084.stdout:2930: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:10:24.029 INFO:tasks.rados.rados.0.smithi084.stdout:2930: done (9 left) 2024-01-13T18:10:24.029 INFO:tasks.rados.rados.0.smithi084.stdout:2937: done (8 left) 2024-01-13T18:10:24.029 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 283 2024-01-13T18:10:24.029 INFO:tasks.rados.rados.0.smithi084.stdout:2941: seq_num 912 ranges {0=483328,483328=401408} 2024-01-13T18:10:24.032 INFO:tasks.rados.rados.0.smithi084.stdout:2941: writing smithi084102331-40 from 0 to 483328 tid 1 2024-01-13T18:10:24.035 INFO:tasks.rados.rados.0.smithi084.stdout:2941: writing smithi084102331-40 from 483328 to 884736 tid 2 2024-01-13T18:10:24.035 INFO:tasks.rados.rados.0.smithi084.stdout:2942: read oid 43 snap 282 2024-01-13T18:10:24.035 INFO:tasks.rados.rados.0.smithi084.stdout:2942: expect deleted 2024-01-13T18:10:24.035 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 283 2024-01-13T18:10:24.035 INFO:tasks.rados.rados.0.smithi084.stdout:2933: finishing rollback tid 0 to smithi084102331-10 2024-01-13T18:10:24.035 INFO:tasks.rados.rados.0.smithi084.stdout:2939: finishing copy_from to smithi084102331-21 2024-01-13T18:10:24.035 INFO:tasks.rados.rados.0.smithi084.stdout:2939: got expected ENOENT (src dne) 2024-01-13T18:10:24.035 INFO:tasks.rados.rados.0.smithi084.stdout:2933: finishing rollback tid 1 to smithi084102331-10 2024-01-13T18:10:24.035 INFO:tasks.rados.rados.0.smithi084.stdout:2933: finishing rollback tid 2 to smithi084102331-10 2024-01-13T18:10:24.036 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1396 (ObjNum 884 snap 279 seq_num 884) dirty exists 2024-01-13T18:10:24.036 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1440 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-01-13T18:10:24.036 INFO:tasks.rados.rados.0.smithi084.stdout:2935: finishing rollback tid 0 to smithi084102331-25 2024-01-13T18:10:24.036 INFO:tasks.rados.rados.0.smithi084.stdout:2935: finishing rollback tid 1 to smithi084102331-25 2024-01-13T18:10:24.036 INFO:tasks.rados.rados.0.smithi084.stdout:2939: finishing copy_from racing read to smithi084102331-21 2024-01-13T18:10:24.036 INFO:tasks.rados.rados.0.smithi084.stdout:2935: finishing rollback tid 2 to smithi084102331-25 2024-01-13T18:10:24.036 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1340 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:10:24.036 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1329 (ObjNum 65 snap 0 seq_num 1448105561) dirty exists 2024-01-13T18:10:24.036 INFO:tasks.rados.rados.0.smithi084.stdout:2943: seq_num 913 ranges {0=499712,499712=401408} 2024-01-13T18:10:24.038 INFO:tasks.rados.rados.0.smithi084.stdout:2943: writing smithi084102331-3 from 0 to 499712 tid 1 2024-01-13T18:10:24.041 INFO:tasks.rados.rados.0.smithi084.stdout:2943: writing smithi084102331-3 from 499712 to 901120 tid 2 2024-01-13T18:10:24.041 INFO:tasks.rados.rados.0.smithi084.stdout:2932: done (10 left) 2024-01-13T18:10:24.041 INFO:tasks.rados.rados.0.smithi084.stdout:2933: done (9 left) 2024-01-13T18:10:24.041 INFO:tasks.rados.rados.0.smithi084.stdout:2935: done (8 left) 2024-01-13T18:10:24.041 INFO:tasks.rados.rados.0.smithi084.stdout:2939: done (7 left) 2024-01-13T18:10:24.041 INFO:tasks.rados.rados.0.smithi084.stdout:2940: done (6 left) 2024-01-13T18:10:24.041 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 283 2024-01-13T18:10:24.041 INFO:tasks.rados.rados.0.smithi084.stdout:2944: seq_num 914 ranges {0=516096,516096=401408} 2024-01-13T18:10:24.044 INFO:tasks.rados.rados.0.smithi084.stdout:2944: writing smithi084102331-35 from 0 to 516096 tid 1 2024-01-13T18:10:24.046 INFO:tasks.rados.rados.0.smithi084.stdout:2944: writing smithi084102331-35 from 516096 to 917504 tid 2 2024-01-13T18:10:24.047 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 283 2024-01-13T18:10:24.047 INFO:tasks.rados.rados.0.smithi084.stdout:2941: finishing write tid 1 to smithi084102331-40 2024-01-13T18:10:24.047 INFO:tasks.rados.rados.0.smithi084.stdout:2941: finishing write tid 2 to smithi084102331-40 2024-01-13T18:10:24.047 INFO:tasks.rados.rados.0.smithi084.stdout:2934: finishing copy_from to smithi084102331-46 2024-01-13T18:10:24.047 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1104 (ObjNum 865 snap 275 seq_num 865) dirty exists 2024-01-13T18:10:24.047 INFO:tasks.rados.rados.0.smithi084.stdout:2941: finishing write tid 3 to smithi084102331-40 2024-01-13T18:10:24.047 INFO:tasks.rados.rados.0.smithi084.stdout:2945: seq_num 915 ranges {3039232=532480,3571712=401408} 2024-01-13T18:10:24.066 INFO:tasks.rados.rados.0.smithi084.stdout:2945: writing smithi084102331-30 from 3039232 to 3571712 tid 1 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:2945: writing smithi084102331-30 from 3571712 to 3973120 tid 2 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:2942: done (7 left) 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 283 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:2934: finishing copy_from racing read to smithi084102331-46 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:2941: finishing write tid 4 to smithi084102331-40 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1332 (ObjNum 912 snap 283 seq_num 912) dirty exists 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:2941: left oid 40 (ObjNum 912 snap 283 seq_num 912) 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:2943: finishing write tid 1 to smithi084102331-3 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:2943: finishing write tid 2 to smithi084102331-3 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:2943: finishing write tid 3 to smithi084102331-3 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:2943: finishing write tid 4 to smithi084102331-3 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1547 (ObjNum 913 snap 283 seq_num 913) dirty exists 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:2943: left oid 3 (ObjNum 913 snap 283 seq_num 913) 2024-01-13T18:10:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:2944: finishing write tid 1 to smithi084102331-35 2024-01-13T18:10:24.071 INFO:tasks.rados.rados.0.smithi084.stdout:2944: finishing write tid 2 to smithi084102331-35 2024-01-13T18:10:24.071 INFO:tasks.rados.rados.0.smithi084.stdout:2944: finishing write tid 3 to smithi084102331-35 2024-01-13T18:10:24.071 INFO:tasks.rados.rados.0.smithi084.stdout:2944: finishing write tid 4 to smithi084102331-35 2024-01-13T18:10:24.071 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1335 (ObjNum 914 snap 283 seq_num 914) dirty exists 2024-01-13T18:10:24.071 INFO:tasks.rados.rados.0.smithi084.stdout:2944: left oid 35 (ObjNum 914 snap 283 seq_num 914) 2024-01-13T18:10:24.071 INFO:tasks.rados.rados.0.smithi084.stdout:2938: finishing rollback tid 1 to smithi084102331-8 2024-01-13T18:10:24.071 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 0 (ObjNum 33 snap 0 seq_num 4037341936) dirty dne 2024-01-13T18:10:24.071 INFO:tasks.rados.rados.0.smithi084.stdout:2946: seq_num 916 ranges {409600=548864,958464=401408} 2024-01-13T18:10:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:2946: writing smithi084102331-10 from 409600 to 958464 tid 1 2024-01-13T18:10:24.077 INFO:tasks.rados.rados.0.smithi084.stdout:2946: writing smithi084102331-10 from 958464 to 1359872 tid 2 2024-01-13T18:10:24.077 INFO:tasks.rados.rados.0.smithi084.stdout:2934: done (7 left) 2024-01-13T18:10:24.077 INFO:tasks.rados.rados.0.smithi084.stdout:2938: done (6 left) 2024-01-13T18:10:24.077 INFO:tasks.rados.rados.0.smithi084.stdout:2941: done (5 left) 2024-01-13T18:10:24.077 INFO:tasks.rados.rados.0.smithi084.stdout:2943: done (4 left) 2024-01-13T18:10:24.077 INFO:tasks.rados.rados.0.smithi084.stdout:2944: done (3 left) 2024-01-13T18:10:24.078 INFO:tasks.rados.rados.0.smithi084.stdout:2947: snap_create 2024-01-13T18:10:24.078 INFO:tasks.rados.rados.0.smithi084.stdout:2936: expect (ObjNum 883 snap 279 seq_num 883) 2024-01-13T18:10:24.818 INFO:tasks.rados.rados.0.smithi084.stdout:2945: finishing write tid 1 to smithi084102331-30 2024-01-13T18:10:24.818 INFO:tasks.rados.rados.0.smithi084.stdout:2945: finishing write tid 2 to smithi084102331-30 2024-01-13T18:10:24.818 INFO:tasks.rados.rados.0.smithi084.stdout:2945: finishing write tid 3 to smithi084102331-30 2024-01-13T18:10:24.818 INFO:tasks.rados.rados.0.smithi084.stdout:2945: finishing write tid 4 to smithi084102331-30 2024-01-13T18:10:24.818 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1343 (ObjNum 915 snap 283 seq_num 915) dirty exists 2024-01-13T18:10:24.818 INFO:tasks.rados.rados.0.smithi084.stdout:2945: left oid 30 (ObjNum 915 snap 283 seq_num 915) 2024-01-13T18:10:24.818 INFO:tasks.rados.rados.0.smithi084.stdout:2946: finishing write tid 1 to smithi084102331-10 2024-01-13T18:10:24.818 INFO:tasks.rados.rados.0.smithi084.stdout:2946: finishing write tid 2 to smithi084102331-10 2024-01-13T18:10:24.818 INFO:tasks.rados.rados.0.smithi084.stdout:2946: finishing write tid 3 to smithi084102331-10 2024-01-13T18:10:24.818 INFO:tasks.rados.rados.0.smithi084.stdout:2946: finishing write tid 4 to smithi084102331-10 2024-01-13T18:10:24.819 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1399 (ObjNum 916 snap 283 seq_num 916) dirty exists 2024-01-13T18:10:24.819 INFO:tasks.rados.rados.0.smithi084.stdout:2946: left oid 10 (ObjNum 916 snap 283 seq_num 916) 2024-01-13T18:10:24.819 INFO:tasks.rados.rados.0.smithi084.stdout:2936: done (3 left) 2024-01-13T18:10:24.819 INFO:tasks.rados.rados.0.smithi084.stdout:2945: done (2 left) 2024-01-13T18:10:24.819 INFO:tasks.rados.rados.0.smithi084.stdout:2946: done (1 left) 2024-01-13T18:10:24.819 INFO:tasks.rados.rados.0.smithi084.stdout:2947: done (0 left) 2024-01-13T18:10:24.819 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 284 2024-01-13T18:10:24.819 INFO:tasks.rados.rados.0.smithi084.stdout:2948: seq_num 917 ranges {0=565248,565248=401408} 2024-01-13T18:10:24.820 INFO:tasks.rados.rados.0.smithi084.stdout:2948: writing smithi084102331-25 from 0 to 565248 tid 1 2024-01-13T18:10:24.824 INFO:tasks.rados.rados.0.smithi084.stdout:2948: writing smithi084102331-25 from 565248 to 966656 tid 2 2024-01-13T18:10:24.824 INFO:tasks.rados.rados.0.smithi084.stdout:2949: rmattr oid 5 current snap is 284 2024-01-13T18:10:24.824 INFO:tasks.rados.rados.0.smithi084.stdout:2949: done (1 left) 2024-01-13T18:10:24.824 INFO:tasks.rados.rados.0.smithi084.stdout:2950: snap_create 2024-01-13T18:10:24.829 INFO:tasks.rados.rados.0.smithi084.stdout:2948: finishing write tid 1 to smithi084102331-25 2024-01-13T18:10:24.829 INFO:tasks.rados.rados.0.smithi084.stdout:2948: finishing write tid 2 to smithi084102331-25 2024-01-13T18:10:24.829 INFO:tasks.rados.rados.0.smithi084.stdout:2948: finishing write tid 3 to smithi084102331-25 2024-01-13T18:10:24.831 INFO:tasks.rados.rados.0.smithi084.stdout:2948: finishing write tid 4 to smithi084102331-25 2024-01-13T18:10:24.831 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1347 (ObjNum 917 snap 284 seq_num 917) dirty exists 2024-01-13T18:10:24.831 INFO:tasks.rados.rados.0.smithi084.stdout:2948: left oid 25 (ObjNum 917 snap 284 seq_num 917) 2024-01-13T18:10:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:24 smithi099 ceph-mon[138788]: osdmap e642: 8 total, 8 up, 8 in 2024-01-13T18:10:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:24 smithi099 ceph-mon[138788]: pgmap v675: 121 pgs: 121 active+clean; 118 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2024-01-13T18:10:25.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:24 smithi084 ceph-mon[116404]: osdmap e642: 8 total, 8 up, 8 in 2024-01-13T18:10:25.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:24 smithi084 ceph-mon[116404]: pgmap v675: 121 pgs: 121 active+clean; 118 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2024-01-13T18:10:25.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:24 smithi084 ceph-mon[119097]: osdmap e642: 8 total, 8 up, 8 in 2024-01-13T18:10:25.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:24 smithi084 ceph-mon[119097]: pgmap v675: 121 pgs: 121 active+clean; 118 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2024-01-13T18:10:25.725 INFO:tasks.rados.rados.0.smithi084.stdout:2948: done (1 left) 2024-01-13T18:10:25.725 INFO:tasks.rados.rados.0.smithi084.stdout:2950: done (0 left) 2024-01-13T18:10:25.725 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 285 2024-01-13T18:10:25.725 INFO:tasks.rados.rados.0.smithi084.stdout:2951: seq_num 918 ranges {884736=581632,1466368=401408} 2024-01-13T18:10:25.733 INFO:tasks.rados.rados.0.smithi084.stdout:2951: writing smithi084102331-40 from 884736 to 1466368 tid 1 2024-01-13T18:10:25.735 INFO:tasks.rados.rados.0.smithi084.stdout:2951: writing smithi084102331-40 from 1466368 to 1867776 tid 2 2024-01-13T18:10:25.735 INFO:tasks.rados.rados.0.smithi084.stdout:2952: snap_create 2024-01-13T18:10:25.740 INFO:tasks.rados.rados.0.smithi084.stdout:2951: finishing write tid 1 to smithi084102331-40 2024-01-13T18:10:25.740 INFO:tasks.rados.rados.0.smithi084.stdout:2951: finishing write tid 2 to smithi084102331-40 2024-01-13T18:10:25.740 INFO:tasks.rados.rados.0.smithi084.stdout:2951: finishing write tid 3 to smithi084102331-40 2024-01-13T18:10:25.741 INFO:tasks.rados.rados.0.smithi084.stdout:2951: finishing write tid 4 to smithi084102331-40 2024-01-13T18:10:25.741 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1338 (ObjNum 918 snap 285 seq_num 918) dirty exists 2024-01-13T18:10:25.742 INFO:tasks.rados.rados.0.smithi084.stdout:2951: left oid 40 (ObjNum 918 snap 285 seq_num 918) 2024-01-13T18:10:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:25 smithi099 ceph-mon[138788]: osdmap e643: 8 total, 8 up, 8 in 2024-01-13T18:10:26.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:25 smithi084 ceph-mon[116404]: osdmap e643: 8 total, 8 up, 8 in 2024-01-13T18:10:26.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:25 smithi084 ceph-mon[119097]: osdmap e643: 8 total, 8 up, 8 in 2024-01-13T18:10:26.735 INFO:tasks.rados.rados.0.smithi084.stdout:2951: done (1 left) 2024-01-13T18:10:26.735 INFO:tasks.rados.rados.0.smithi084.stdout:2952: done (0 left) 2024-01-13T18:10:26.735 INFO:tasks.rados.rados.0.smithi084.stdout:2953: snap_create 2024-01-13T18:10:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:26 smithi099 ceph-mon[138788]: osdmap e644: 8 total, 8 up, 8 in 2024-01-13T18:10:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:26 smithi099 ceph-mon[138788]: pgmap v678: 121 pgs: 121 active+clean; 109 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 3.0 MiB/s wr, 27 op/s 2024-01-13T18:10:27.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:26 smithi084 ceph-mon[116404]: osdmap e644: 8 total, 8 up, 8 in 2024-01-13T18:10:27.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:26 smithi084 ceph-mon[116404]: pgmap v678: 121 pgs: 121 active+clean; 109 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 3.0 MiB/s wr, 27 op/s 2024-01-13T18:10:27.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:26 smithi084 ceph-mon[119097]: osdmap e644: 8 total, 8 up, 8 in 2024-01-13T18:10:27.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:26 smithi084 ceph-mon[119097]: pgmap v678: 121 pgs: 121 active+clean; 109 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 3.0 MiB/s wr, 27 op/s 2024-01-13T18:10:27.699 INFO:tasks.rados.rados.0.smithi084.stdout:2953: done (0 left) 2024-01-13T18:10:27.699 INFO:tasks.rados.rados.0.smithi084.stdout:2954: setattr oid 37 current snap is 287 2024-01-13T18:10:27.701 INFO:tasks.rados.rados.0.smithi084.stdout:2955: copy_from oid 13 from oid 1 current snap is 287 2024-01-13T18:10:27.701 INFO:tasks.rados.rados.0.smithi084.stdout:2956: delete oid 27 current snap is 287 2024-01-13T18:10:27.708 INFO:tasks.rados.rados.0.smithi084.stdout:2956: done (2 left) 2024-01-13T18:10:27.708 INFO:tasks.rados.rados.0.smithi084.stdout:2957: copy_from oid 26 from oid 36 current snap is 287 2024-01-13T18:10:27.708 INFO:tasks.rados.rados.0.smithi084.stdout:2958: snap_remove snap 286 2024-01-13T18:10:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:27 smithi099 ceph-mon[138788]: osdmap e645: 8 total, 8 up, 8 in 2024-01-13T18:10:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:27 smithi099 ceph-mon[138788]: osdmap e646: 8 total, 8 up, 8 in 2024-01-13T18:10:28.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:27 smithi084 ceph-mon[116404]: osdmap e645: 8 total, 8 up, 8 in 2024-01-13T18:10:28.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:27 smithi084 ceph-mon[116404]: osdmap e646: 8 total, 8 up, 8 in 2024-01-13T18:10:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:27 smithi084 ceph-mon[119097]: osdmap e645: 8 total, 8 up, 8 in 2024-01-13T18:10:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:27 smithi084 ceph-mon[119097]: osdmap e646: 8 total, 8 up, 8 in 2024-01-13T18:10:28.708 INFO:tasks.rados.rados.0.smithi084.stdout:2958: done (3 left) 2024-01-13T18:10:28.709 INFO:tasks.rados.rados.0.smithi084.stdout:2959: rmattr oid 3 current snap is 287 2024-01-13T18:10:28.713 INFO:tasks.rados.rados.0.smithi084.stdout:2960: setattr oid 39 current snap is 287 2024-01-13T18:10:28.714 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 287 2024-01-13T18:10:28.714 INFO:tasks.rados.rados.0.smithi084.stdout:2961: seq_num 920 ranges {4079616=614400,4694016=401408} 2024-01-13T18:10:28.736 INFO:tasks.rados.rados.0.smithi084.stdout:2961: writing smithi084102331-6 from 4079616 to 4694016 tid 1 2024-01-13T18:10:28.738 INFO:tasks.rados.rados.0.smithi084.stdout:2961: writing smithi084102331-6 from 4694016 to 5095424 tid 2 2024-01-13T18:10:28.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1349 (ObjNum 893 snap 279 seq_num 893) dirty exists 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:2957: finishing copy_from to smithi084102331-26 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1440 (ObjNum 737 snap 0 seq_num 2538032056) dirty exists 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:2957: finishing copy_from racing read to smithi084102331-26 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:2955: finishing copy_from to smithi084102331-13 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 1534 (ObjNum 894 snap 280 seq_num 894) dirty exists 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:2955: finishing copy_from racing read to smithi084102331-13 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1549 (ObjNum 913 snap 283 seq_num 913) dirty exists 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1341 (ObjNum 891 snap 279 seq_num 891) dirty exists 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:2962: read oid 10 snap -1 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:2962: expect (ObjNum 916 snap 283 seq_num 916) 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:2954: done (6 left) 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:2955: done (5 left) 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:2957: done (4 left) 2024-01-13T18:10:28.739 INFO:tasks.rados.rados.0.smithi084.stdout:2959: done (3 left) 2024-01-13T18:10:28.740 INFO:tasks.rados.rados.0.smithi084.stdout:2960: done (2 left) 2024-01-13T18:10:28.740 INFO:tasks.rados.rados.0.smithi084.stdout:2963: snap_remove snap 285 2024-01-13T18:10:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:28 smithi099 ceph-mon[138788]: pgmap v681: 121 pgs: 121 active+clean; 101 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 2.8 MiB/s wr, 38 op/s 2024-01-13T18:10:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:28 smithi099 ceph-mon[138788]: osdmap e647: 8 total, 8 up, 8 in 2024-01-13T18:10:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:28 smithi084 ceph-mon[116404]: pgmap v681: 121 pgs: 121 active+clean; 101 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 2.8 MiB/s wr, 38 op/s 2024-01-13T18:10:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:28 smithi084 ceph-mon[116404]: osdmap e647: 8 total, 8 up, 8 in 2024-01-13T18:10:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:28 smithi084 ceph-mon[119097]: pgmap v681: 121 pgs: 121 active+clean; 101 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 2.8 MiB/s wr, 38 op/s 2024-01-13T18:10:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:28 smithi084 ceph-mon[119097]: osdmap e647: 8 total, 8 up, 8 in 2024-01-13T18:10:29.742 INFO:tasks.rados.rados.0.smithi084.stdout:2963: done (2 left) 2024-01-13T18:10:29.742 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 287 2024-01-13T18:10:29.742 INFO:tasks.rados.rados.0.smithi084.stdout:2961: finishing write tid 1 to smithi084102331-6 2024-01-13T18:10:29.743 INFO:tasks.rados.rados.0.smithi084.stdout:2964: seq_num 921 ranges {0=630784,630784=401408} 2024-01-13T18:10:29.746 INFO:tasks.rados.rados.0.smithi084.stdout:2964: writing smithi084102331-48 from 0 to 630784 tid 1 2024-01-13T18:10:29.749 INFO:tasks.rados.rados.0.smithi084.stdout:2964: writing smithi084102331-48 from 630784 to 1032192 tid 2 2024-01-13T18:10:29.749 INFO:tasks.rados.rados.0.smithi084.stdout:2965: snap_remove snap 284 2024-01-13T18:10:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:10:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:10:30] "GET /metrics HTTP/1.1" 200 36188 "" "Prometheus/2.43.0" 2024-01-13T18:10:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:2965: done (3 left) 2024-01-13T18:10:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 287 2024-01-13T18:10:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:2966: seq_num 922 ranges {0=647168,647168=401408} 2024-01-13T18:10:30.756 INFO:tasks.rados.rados.0.smithi084.stdout:2966: writing smithi084102331-8 from 0 to 647168 tid 1 2024-01-13T18:10:30.756 INFO:tasks.rados.rados.0.smithi084.stdout:2966: writing smithi084102331-8 from 647168 to 1048576 tid 2 2024-01-13T18:10:30.756 INFO:tasks.rados.rados.0.smithi084.stdout:2967: snap_create 2024-01-13T18:10:30.756 INFO:tasks.rados.rados.0.smithi084.stdout:2961: finishing write tid 2 to smithi084102331-6 2024-01-13T18:10:30.756 INFO:tasks.rados.rados.0.smithi084.stdout:2961: finishing write tid 3 to smithi084102331-6 2024-01-13T18:10:30.757 INFO:tasks.rados.rados.0.smithi084.stdout:2961: finishing write tid 4 to smithi084102331-6 2024-01-13T18:10:30.757 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 1141 (ObjNum 920 snap 287 seq_num 920) dirty exists 2024-01-13T18:10:30.757 INFO:tasks.rados.rados.0.smithi084.stdout:2961: left oid 6 (ObjNum 920 snap 287 seq_num 920) 2024-01-13T18:10:30.757 INFO:tasks.rados.rados.0.smithi084.stdout:2962: expect (ObjNum 916 snap 283 seq_num 916) 2024-01-13T18:10:30.796 INFO:tasks.rados.rados.0.smithi084.stdout:2964: finishing write tid 1 to smithi084102331-48 2024-01-13T18:10:30.797 INFO:tasks.rados.rados.0.smithi084.stdout:2964: finishing write tid 2 to smithi084102331-48 2024-01-13T18:10:30.797 INFO:tasks.rados.rados.0.smithi084.stdout:2964: finishing write tid 3 to smithi084102331-48 2024-01-13T18:10:30.797 INFO:tasks.rados.rados.0.smithi084.stdout:2964: finishing write tid 4 to smithi084102331-48 2024-01-13T18:10:30.797 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1634 (ObjNum 921 snap 287 seq_num 921) dirty exists 2024-01-13T18:10:30.797 INFO:tasks.rados.rados.0.smithi084.stdout:2964: left oid 48 (ObjNum 921 snap 287 seq_num 921) 2024-01-13T18:10:30.797 INFO:tasks.rados.rados.0.smithi084.stdout:2966: finishing write tid 1 to smithi084102331-8 2024-01-13T18:10:30.797 INFO:tasks.rados.rados.0.smithi084.stdout:2966: finishing write tid 2 to smithi084102331-8 2024-01-13T18:10:30.797 INFO:tasks.rados.rados.0.smithi084.stdout:2966: finishing write tid 3 to smithi084102331-8 2024-01-13T18:10:30.797 INFO:tasks.rados.rados.0.smithi084.stdout:2966: finishing write tid 4 to smithi084102331-8 2024-01-13T18:10:30.797 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1472 (ObjNum 922 snap 287 seq_num 922) dirty exists 2024-01-13T18:10:30.797 INFO:tasks.rados.rados.0.smithi084.stdout:2966: left oid 8 (ObjNum 922 snap 287 seq_num 922) 2024-01-13T18:10:31.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:30 smithi099 ceph-mon[138788]: osdmap e648: 8 total, 8 up, 8 in 2024-01-13T18:10:31.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:30 smithi099 ceph-mon[138788]: pgmap v684: 121 pgs: 121 active+clean; 103 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 2.3 MiB/s wr, 34 op/s 2024-01-13T18:10:31.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:30 smithi084 ceph-mon[116404]: osdmap e648: 8 total, 8 up, 8 in 2024-01-13T18:10:31.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:30 smithi084 ceph-mon[116404]: pgmap v684: 121 pgs: 121 active+clean; 103 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 2.3 MiB/s wr, 34 op/s 2024-01-13T18:10:31.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:30 smithi084 ceph-mon[119097]: osdmap e648: 8 total, 8 up, 8 in 2024-01-13T18:10:31.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:30 smithi084 ceph-mon[119097]: pgmap v684: 121 pgs: 121 active+clean; 103 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 2.3 MiB/s wr, 34 op/s 2024-01-13T18:10:31.755 INFO:tasks.rados.rados.0.smithi084.stdout:2961: done (4 left) 2024-01-13T18:10:31.755 INFO:tasks.rados.rados.0.smithi084.stdout:2962: done (3 left) 2024-01-13T18:10:31.755 INFO:tasks.rados.rados.0.smithi084.stdout:2964: done (2 left) 2024-01-13T18:10:31.755 INFO:tasks.rados.rados.0.smithi084.stdout:2966: done (1 left) 2024-01-13T18:10:31.755 INFO:tasks.rados.rados.0.smithi084.stdout:2967: done (0 left) 2024-01-13T18:10:31.756 INFO:tasks.rados.rados.0.smithi084.stdout:2968: read oid 30 snap -1 2024-01-13T18:10:31.756 INFO:tasks.rados.rados.0.smithi084.stdout:2968: expect (ObjNum 915 snap 283 seq_num 915) 2024-01-13T18:10:31.756 INFO:tasks.rados.rados.0.smithi084.stdout:2969: snap_remove snap 287 2024-01-13T18:10:32.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:31 smithi099 ceph-mon[138788]: osdmap e649: 8 total, 8 up, 8 in 2024-01-13T18:10:32.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:31 smithi084 ceph-mon[116404]: osdmap e649: 8 total, 8 up, 8 in 2024-01-13T18:10:32.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:31 smithi084 ceph-mon[119097]: osdmap e649: 8 total, 8 up, 8 in 2024-01-13T18:10:32.696 INFO:tasks.rados.rados.0.smithi084.stdout:2969: done (1 left) 2024-01-13T18:10:32.696 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 288 2024-01-13T18:10:32.696 INFO:tasks.rados.rados.0.smithi084.stdout:2970: seq_num 923 ranges {0=663552,663552=401408} 2024-01-13T18:10:32.700 INFO:tasks.rados.rados.0.smithi084.stdout:2970: writing smithi084102331-33 from 0 to 663552 tid 1 2024-01-13T18:10:32.702 INFO:tasks.rados.rados.0.smithi084.stdout:2970: writing smithi084102331-33 from 663552 to 1064960 tid 2 2024-01-13T18:10:32.702 INFO:tasks.rados.rados.0.smithi084.stdout:2971: delete oid 16 current snap is 288 2024-01-13T18:10:32.703 INFO:tasks.rados.rados.0.smithi084.stdout:2968: expect (ObjNum 915 snap 283 seq_num 915) 2024-01-13T18:10:32.866 INFO:tasks.rados.rados.0.smithi084.stdout:2970: finishing write tid 1 to smithi084102331-33 2024-01-13T18:10:32.866 INFO:tasks.rados.rados.0.smithi084.stdout:2970: finishing write tid 2 to smithi084102331-33 2024-01-13T18:10:32.866 INFO:tasks.rados.rados.0.smithi084.stdout:2970: finishing write tid 3 to smithi084102331-33 2024-01-13T18:10:32.867 INFO:tasks.rados.rados.0.smithi084.stdout:2970: finishing write tid 4 to smithi084102331-33 2024-01-13T18:10:32.867 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1359 (ObjNum 923 snap 288 seq_num 923) dirty exists 2024-01-13T18:10:32.867 INFO:tasks.rados.rados.0.smithi084.stdout:2970: left oid 33 (ObjNum 923 snap 288 seq_num 923) 2024-01-13T18:10:32.867 INFO:tasks.rados.rados.0.smithi084.stdout:2968: done (2 left) 2024-01-13T18:10:32.867 INFO:tasks.rados.rados.0.smithi084.stdout:2970: done (1 left) 2024-01-13T18:10:32.867 INFO:tasks.rados.rados.0.smithi084.stdout:2971: done (0 left) 2024-01-13T18:10:32.867 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 288 2024-01-13T18:10:32.867 INFO:tasks.rados.rados.0.smithi084.stdout:2972: seq_num 925 ranges {4145152=696320,4841472=401408} 2024-01-13T18:10:32.891 INFO:tasks.rados.rados.0.smithi084.stdout:2972: writing smithi084102331-9 from 4145152 to 4841472 tid 1 2024-01-13T18:10:32.894 INFO:tasks.rados.rados.0.smithi084.stdout:2972: writing smithi084102331-9 from 4841472 to 5242880 tid 2 2024-01-13T18:10:32.894 INFO:tasks.rados.rados.0.smithi084.stdout:2973: snap_remove snap 283 2024-01-13T18:10:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:32 smithi099 ceph-mon[138788]: osdmap e650: 8 total, 8 up, 8 in 2024-01-13T18:10:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:32 smithi099 ceph-mon[138788]: pgmap v687: 121 pgs: 121 active+clean; 107 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.5 MiB/s wr, 13 op/s 2024-01-13T18:10:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:32 smithi099 ceph-mon[138788]: osdmap e651: 8 total, 8 up, 8 in 2024-01-13T18:10:33.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:32 smithi084 ceph-mon[116404]: osdmap e650: 8 total, 8 up, 8 in 2024-01-13T18:10:33.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:32 smithi084 ceph-mon[116404]: pgmap v687: 121 pgs: 121 active+clean; 107 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.5 MiB/s wr, 13 op/s 2024-01-13T18:10:33.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:32 smithi084 ceph-mon[116404]: osdmap e651: 8 total, 8 up, 8 in 2024-01-13T18:10:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:32 smithi084 ceph-mon[119097]: osdmap e650: 8 total, 8 up, 8 in 2024-01-13T18:10:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:32 smithi084 ceph-mon[119097]: pgmap v687: 121 pgs: 121 active+clean; 107 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.5 MiB/s wr, 13 op/s 2024-01-13T18:10:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:32 smithi084 ceph-mon[119097]: osdmap e651: 8 total, 8 up, 8 in 2024-01-13T18:10:33.767 INFO:tasks.rados.rados.0.smithi084.stdout:2973: done (1 left) 2024-01-13T18:10:33.767 INFO:tasks.rados.rados.0.smithi084.stdout:2974: rmattr oid 26 current snap is 288 2024-01-13T18:10:33.767 INFO:tasks.rados.rados.0.smithi084.stdout:2972: finishing write tid 1 to smithi084102331-9 2024-01-13T18:10:33.767 INFO:tasks.rados.rados.0.smithi084.stdout:2972: finishing write tid 2 to smithi084102331-9 2024-01-13T18:10:33.767 INFO:tasks.rados.rados.0.smithi084.stdout:2972: finishing write tid 3 to smithi084102331-9 2024-01-13T18:10:33.767 INFO:tasks.rados.rados.0.smithi084.stdout:2972: finishing write tid 4 to smithi084102331-9 2024-01-13T18:10:33.767 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1144 (ObjNum 925 snap 288 seq_num 925) dirty exists 2024-01-13T18:10:33.767 INFO:tasks.rados.rados.0.smithi084.stdout:2972: left oid 9 (ObjNum 925 snap 288 seq_num 925) 2024-01-13T18:10:33.767 INFO:tasks.rados.rados.0.smithi084.stdout:2972: done (1 left) 2024-01-13T18:10:33.767 INFO:tasks.rados.rados.0.smithi084.stdout:2975: delete oid 37 current snap is 288 2024-01-13T18:10:33.771 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1441 (ObjNum 33 snap 0 seq_num 4036849488) dirty exists 2024-01-13T18:10:33.775 INFO:tasks.rados.rados.0.smithi084.stdout:2974: done (1 left) 2024-01-13T18:10:33.775 INFO:tasks.rados.rados.0.smithi084.stdout:2975: done (0 left) 2024-01-13T18:10:33.775 INFO:tasks.rados.rados.0.smithi084.stdout:2976: rollback oid 41 current snap is 288 2024-01-13T18:10:33.775 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 282 2024-01-13T18:10:33.775 INFO:tasks.rados.rados.0.smithi084.stdout:2977: read oid 26 snap -1 2024-01-13T18:10:33.775 INFO:tasks.rados.rados.0.smithi084.stdout:2977: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:33.775 INFO:tasks.rados.rados.0.smithi084.stdout:2978: snap_create 2024-01-13T18:10:33.776 INFO:tasks.rados.rados.0.smithi084.stdout:2977: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:33.779 INFO:tasks.rados.rados.0.smithi084.stdout:2976: finishing rollback tid 0 to smithi084102331-41 2024-01-13T18:10:33.779 INFO:tasks.rados.rados.0.smithi084.stdout:2976: finishing rollback tid 1 to smithi084102331-41 2024-01-13T18:10:33.779 INFO:tasks.rados.rados.0.smithi084.stdout:2976: finishing rollback tid 2 to smithi084102331-41 2024-01-13T18:10:33.779 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1344 (ObjNum 893 snap 279 seq_num 893) dirty exists 2024-01-13T18:10:34.770 INFO:tasks.rados.rados.0.smithi084.stdout:2976: done (2 left) 2024-01-13T18:10:34.770 INFO:tasks.rados.rados.0.smithi084.stdout:2977: done (1 left) 2024-01-13T18:10:34.770 INFO:tasks.rados.rados.0.smithi084.stdout:2978: done (0 left) 2024-01-13T18:10:34.771 INFO:tasks.rados.rados.0.smithi084.stdout:2979: snap_remove snap 288 2024-01-13T18:10:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:34 smithi099 ceph-mon[138788]: osdmap e652: 8 total, 8 up, 8 in 2024-01-13T18:10:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:34 smithi099 ceph-mon[138788]: pgmap v690: 121 pgs: 121 active+clean; 108 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 997 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-01-13T18:10:35.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:34 smithi084 ceph-mon[119097]: osdmap e652: 8 total, 8 up, 8 in 2024-01-13T18:10:35.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:34 smithi084 ceph-mon[119097]: pgmap v690: 121 pgs: 121 active+clean; 108 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 997 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-01-13T18:10:35.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:34 smithi084 ceph-mon[116404]: osdmap e652: 8 total, 8 up, 8 in 2024-01-13T18:10:35.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:34 smithi084 ceph-mon[116404]: pgmap v690: 121 pgs: 121 active+clean; 108 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 997 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-01-13T18:10:35.770 INFO:tasks.rados.rados.0.smithi084.stdout:2979: done (0 left) 2024-01-13T18:10:35.771 INFO:tasks.rados.rados.0.smithi084.stdout:2980: setattr oid 32 current snap is 289 2024-01-13T18:10:35.771 INFO:tasks.rados.rados.0.smithi084.stdout:2981: copy_from oid 38 from oid 50 current snap is 289 2024-01-13T18:10:35.771 INFO:tasks.rados.rados.0.smithi084.stdout:2982: read oid 1 snap 282 2024-01-13T18:10:35.771 INFO:tasks.rados.rados.0.smithi084.stdout:2982: expect (ObjNum 894 snap 280 seq_num 894) 2024-01-13T18:10:35.771 INFO:tasks.rados.rados.0.smithi084.stdout:2983: snap_create 2024-01-13T18:10:35.777 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1474 (ObjNum 702 snap 220 seq_num 702) dirty exists 2024-01-13T18:10:35.780 INFO:tasks.rados.rados.0.smithi084.stdout:2982: expect (ObjNum 894 snap 280 seq_num 894) 2024-01-13T18:10:35.875 INFO:tasks.rados.rados.0.smithi084.stdout:2981: finishing copy_from to smithi084102331-38 2024-01-13T18:10:35.875 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1334 (ObjNum 799 snap 258 seq_num 799) dirty exists 2024-01-13T18:10:35.875 INFO:tasks.rados.rados.0.smithi084.stdout:2981: finishing copy_from racing read to smithi084102331-38 2024-01-13T18:10:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:35 smithi099 ceph-mon[138788]: osdmap e653: 8 total, 8 up, 8 in 2024-01-13T18:10:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:36.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:35 smithi084 ceph-mon[116404]: osdmap e653: 8 total, 8 up, 8 in 2024-01-13T18:10:36.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:35 smithi084 ceph-mon[119097]: osdmap e653: 8 total, 8 up, 8 in 2024-01-13T18:10:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:36.790 INFO:tasks.rados.rados.0.smithi084.stdout:2980: done (3 left) 2024-01-13T18:10:36.790 INFO:tasks.rados.rados.0.smithi084.stdout:2981: done (2 left) 2024-01-13T18:10:36.791 INFO:tasks.rados.rados.0.smithi084.stdout:2982: done (1 left) 2024-01-13T18:10:36.791 INFO:tasks.rados.rados.0.smithi084.stdout:2983: done (0 left) 2024-01-13T18:10:36.791 INFO:tasks.rados.rados.0.smithi084.stdout:2984: read oid 27 snap -1 2024-01-13T18:10:36.791 INFO:tasks.rados.rados.0.smithi084.stdout:2984: expect deleted 2024-01-13T18:10:36.791 INFO:tasks.rados.rados.0.smithi084.stdout:2985: snap_remove snap 289 2024-01-13T18:10:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:36 smithi099 ceph-mon[138788]: osdmap e654: 8 total, 8 up, 8 in 2024-01-13T18:10:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:36 smithi099 ceph-mon[138788]: pgmap v693: 121 pgs: 121 active+clean; 109 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.8 MiB/s rd, 516 KiB/s wr, 12 op/s 2024-01-13T18:10:37.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:36 smithi084 ceph-mon[116404]: osdmap e654: 8 total, 8 up, 8 in 2024-01-13T18:10:37.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:36 smithi084 ceph-mon[116404]: pgmap v693: 121 pgs: 121 active+clean; 109 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.8 MiB/s rd, 516 KiB/s wr, 12 op/s 2024-01-13T18:10:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:36 smithi084 ceph-mon[119097]: osdmap e654: 8 total, 8 up, 8 in 2024-01-13T18:10:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:36 smithi084 ceph-mon[119097]: pgmap v693: 121 pgs: 121 active+clean; 109 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.8 MiB/s rd, 516 KiB/s wr, 12 op/s 2024-01-13T18:10:37.700 INFO:tasks.rados.rados.0.smithi084.stdout:2985: done (1 left) 2024-01-13T18:10:37.700 INFO:tasks.rados.rados.0.smithi084.stdout:2986: copy_from oid 5 from oid 47 current snap is 290 2024-01-13T18:10:37.701 INFO:tasks.rados.rados.0.smithi084.stdout:2987: snap_remove snap 282 2024-01-13T18:10:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:37 smithi099 ceph-mon[138788]: osdmap e655: 8 total, 8 up, 8 in 2024-01-13T18:10:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:37 smithi099 ceph-mon[138788]: osdmap e656: 8 total, 8 up, 8 in 2024-01-13T18:10:38.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:37 smithi084 ceph-mon[116404]: osdmap e655: 8 total, 8 up, 8 in 2024-01-13T18:10:38.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:37 smithi084 ceph-mon[116404]: osdmap e656: 8 total, 8 up, 8 in 2024-01-13T18:10:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:37 smithi084 ceph-mon[119097]: osdmap e655: 8 total, 8 up, 8 in 2024-01-13T18:10:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:37 smithi084 ceph-mon[119097]: osdmap e656: 8 total, 8 up, 8 in 2024-01-13T18:10:38.702 INFO:tasks.rados.rados.0.smithi084.stdout:2987: done (2 left) 2024-01-13T18:10:38.702 INFO:tasks.rados.rados.0.smithi084.stdout:2988: read oid 46 snap -1 2024-01-13T18:10:38.702 INFO:tasks.rados.rados.0.smithi084.stdout:2988: expect (ObjNum 865 snap 275 seq_num 865) 2024-01-13T18:10:38.702 INFO:tasks.rados.rados.0.smithi084.stdout:2989: setattr oid 14 current snap is 290 2024-01-13T18:10:38.703 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 290 2024-01-13T18:10:38.703 INFO:tasks.rados.rados.0.smithi084.stdout:2990: seq_num 927 ranges {90112=729088,819200=401408} 2024-01-13T18:10:38.707 INFO:tasks.rados.rados.0.smithi084.stdout:2990: writing smithi084102331-49 from 90112 to 819200 tid 1 2024-01-13T18:10:38.710 INFO:tasks.rados.rados.0.smithi084.stdout:2990: writing smithi084102331-49 from 819200 to 1220608 tid 2 2024-01-13T18:10:38.710 INFO:tasks.rados.rados.0.smithi084.stdout:2991: read oid 17 snap -1 2024-01-13T18:10:38.710 INFO:tasks.rados.rados.0.smithi084.stdout:2991: expect deleted 2024-01-13T18:10:38.710 INFO:tasks.rados.rados.0.smithi084.stdout:2992: snap_create 2024-01-13T18:10:38.710 INFO:tasks.rados.rados.0.smithi084.stdout:2986: finishing copy_from to smithi084102331-5 2024-01-13T18:10:38.710 INFO:tasks.rados.rados.0.smithi084.stdout:2986: got expected ENOENT (src dne) 2024-01-13T18:10:38.710 INFO:tasks.rados.rados.0.smithi084.stdout:2986: finishing copy_from racing read to smithi084102331-5 2024-01-13T18:10:38.713 INFO:tasks.rados.rados.0.smithi084.stdout:2988: expect (ObjNum 865 snap 275 seq_num 865) 2024-01-13T18:10:38.717 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1442 (ObjNum 225 snap 0 seq_num 4037095232) dirty exists 2024-01-13T18:10:38.717 INFO:tasks.rados.rados.0.smithi084.stdout:2990: finishing write tid 1 to smithi084102331-49 2024-01-13T18:10:38.717 INFO:tasks.rados.rados.0.smithi084.stdout:2990: finishing write tid 2 to smithi084102331-49 2024-01-13T18:10:38.717 INFO:tasks.rados.rados.0.smithi084.stdout:2990: finishing write tid 3 to smithi084102331-49 2024-01-13T18:10:38.723 INFO:tasks.rados.rados.0.smithi084.stdout:2990: finishing write tid 4 to smithi084102331-49 2024-01-13T18:10:38.724 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1445 (ObjNum 927 snap 290 seq_num 927) dirty exists 2024-01-13T18:10:38.724 INFO:tasks.rados.rados.0.smithi084.stdout:2990: left oid 49 (ObjNum 927 snap 290 seq_num 927) 2024-01-13T18:10:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:38 smithi099 ceph-mon[138788]: pgmap v696: 121 pgs: 121 active+clean; 113 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:10:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:38 smithi099 ceph-mon[138788]: osdmap e657: 8 total, 8 up, 8 in 2024-01-13T18:10:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:38 smithi084 ceph-mon[116404]: pgmap v696: 121 pgs: 121 active+clean; 113 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:10:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:38 smithi084 ceph-mon[116404]: osdmap e657: 8 total, 8 up, 8 in 2024-01-13T18:10:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:38 smithi084 ceph-mon[119097]: pgmap v696: 121 pgs: 121 active+clean; 113 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:10:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:38 smithi084 ceph-mon[119097]: osdmap e657: 8 total, 8 up, 8 in 2024-01-13T18:10:39.705 INFO:tasks.rados.rados.0.smithi084.stdout:2984: done (6 left) 2024-01-13T18:10:39.706 INFO:tasks.rados.rados.0.smithi084.stdout:2986: done (5 left) 2024-01-13T18:10:39.706 INFO:tasks.rados.rados.0.smithi084.stdout:2988: done (4 left) 2024-01-13T18:10:39.706 INFO:tasks.rados.rados.0.smithi084.stdout:2989: done (3 left) 2024-01-13T18:10:39.706 INFO:tasks.rados.rados.0.smithi084.stdout:2990: done (2 left) 2024-01-13T18:10:39.706 INFO:tasks.rados.rados.0.smithi084.stdout:2991: done (1 left) 2024-01-13T18:10:39.707 INFO:tasks.rados.rados.0.smithi084.stdout:2992: done (0 left) 2024-01-13T18:10:39.707 INFO:tasks.rados.rados.0.smithi084.stdout:2993: read oid 10 snap -1 2024-01-13T18:10:39.707 INFO:tasks.rados.rados.0.smithi084.stdout:2993: expect (ObjNum 916 snap 283 seq_num 916) 2024-01-13T18:10:39.707 INFO:tasks.rados.rados.0.smithi084.stdout:2994: snap_create 2024-01-13T18:10:39.711 INFO:tasks.rados.rados.0.smithi084.stdout:2993: expect (ObjNum 916 snap 283 seq_num 916) 2024-01-13T18:10:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:10:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:10:40] "GET /metrics HTTP/1.1" 200 36191 "" "Prometheus/2.43.0" 2024-01-13T18:10:40.705 INFO:tasks.rados.rados.0.smithi084.stdout:2993: done (1 left) 2024-01-13T18:10:40.705 INFO:tasks.rados.rados.0.smithi084.stdout:2994: done (0 left) 2024-01-13T18:10:40.705 INFO:tasks.rados.rados.0.smithi084.stdout:2995: read oid 20 snap -1 2024-01-13T18:10:40.705 INFO:tasks.rados.rados.0.smithi084.stdout:2995: expect (ObjNum 904 snap 282 seq_num 904) 2024-01-13T18:10:40.705 INFO:tasks.rados.rados.0.smithi084.stdout:2996: snap_create 2024-01-13T18:10:40.714 INFO:tasks.rados.rados.0.smithi084.stdout:2995: expect (ObjNum 904 snap 282 seq_num 904) 2024-01-13T18:10:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:40 smithi099 ceph-mon[138788]: osdmap e658: 8 total, 8 up, 8 in 2024-01-13T18:10:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:40 smithi099 ceph-mon[138788]: pgmap v699: 121 pgs: 121 active+clean; 106 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:10:41.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:40 smithi084 ceph-mon[119097]: osdmap e658: 8 total, 8 up, 8 in 2024-01-13T18:10:41.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:40 smithi084 ceph-mon[119097]: pgmap v699: 121 pgs: 121 active+clean; 106 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:10:41.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:40 smithi084 ceph-mon[116404]: osdmap e658: 8 total, 8 up, 8 in 2024-01-13T18:10:41.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:40 smithi084 ceph-mon[116404]: pgmap v699: 121 pgs: 121 active+clean; 106 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-01-13T18:10:41.708 INFO:tasks.rados.rados.0.smithi084.stdout:2995: done (1 left) 2024-01-13T18:10:41.708 INFO:tasks.rados.rados.0.smithi084.stdout:2996: done (0 left) 2024-01-13T18:10:41.708 INFO:tasks.rados.rados.0.smithi084.stdout:2997: read oid 14 snap 290 2024-01-13T18:10:41.708 INFO:tasks.rados.rados.0.smithi084.stdout:2997: expect (ObjNum -256258352 snap 21877 seq_num 4037475472) 2024-01-13T18:10:41.708 INFO:tasks.rados.rados.0.smithi084.stdout:2998: rmattr oid 43 current snap is 293 2024-01-13T18:10:41.708 INFO:tasks.rados.rados.0.smithi084.stdout:2998: done (1 left) 2024-01-13T18:10:41.708 INFO:tasks.rados.rados.0.smithi084.stdout:2999: rollback oid 37 current snap is 293 2024-01-13T18:10:41.708 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 290 2024-01-13T18:10:41.708 INFO:tasks.rados.rados.0.smithi084.stdout:3000: snap_remove snap 292 2024-01-13T18:10:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:41 smithi099 ceph-mon[138788]: osdmap e659: 8 total, 8 up, 8 in 2024-01-13T18:10:42.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:41 smithi084 ceph-mon[116404]: osdmap e659: 8 total, 8 up, 8 in 2024-01-13T18:10:42.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:41 smithi084 ceph-mon[119097]: osdmap e659: 8 total, 8 up, 8 in 2024-01-13T18:10:42.699 INFO:tasks.rados.rados.0.smithi084.stdout:3000: done (2 left) 2024-01-13T18:10:42.699 INFO:tasks.rados.rados.0.smithi084.stdout:3001: rollback oid 44 current snap is 293 2024-01-13T18:10:42.699 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 290 2024-01-13T18:10:42.700 INFO:tasks.rados.rados.0.smithi084.stdout:3002: setattr oid 25 current snap is 293 2024-01-13T18:10:42.702 INFO:tasks.rados.rados.0.smithi084.stdout:2999: finishing rollback tid 1 to smithi084102331-37 2024-01-13T18:10:42.702 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 0 (ObjNum 257 snap 0 seq_num 4038195328) dirty dne 2024-01-13T18:10:42.702 INFO:tasks.rados.rados.0.smithi084.stdout:2997: expect (ObjNum -256258352 snap 21877 seq_num 4037475472) 2024-01-13T18:10:42.702 INFO:tasks.rados.rados.0.smithi084.stdout:2997: done (3 left) 2024-01-13T18:10:42.702 INFO:tasks.rados.rados.0.smithi084.stdout:2999: done (2 left) 2024-01-13T18:10:42.702 INFO:tasks.rados.rados.0.smithi084.stdout:3003: delete oid 10 current snap is 293 2024-01-13T18:10:42.708 INFO:tasks.rados.rados.0.smithi084.stdout:3001: finishing rollback tid 0 to smithi084102331-44 2024-01-13T18:10:42.713 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1376 (ObjNum 917 snap 284 seq_num 917) dirty exists 2024-01-13T18:10:42.713 INFO:tasks.rados.rados.0.smithi084.stdout:3001: finishing rollback tid 1 to smithi084102331-44 2024-01-13T18:10:42.713 INFO:tasks.rados.rados.0.smithi084.stdout:3002: done (2 left) 2024-01-13T18:10:42.713 INFO:tasks.rados.rados.0.smithi084.stdout:3003: done (1 left) 2024-01-13T18:10:42.713 INFO:tasks.rados.rados.0.smithi084.stdout:3004: copy_from oid 8 from oid 40 current snap is 293 2024-01-13T18:10:42.713 INFO:tasks.rados.rados.0.smithi084.stdout:3005: snap_remove snap 291 2024-01-13T18:10:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:42 smithi099 ceph-mon[138788]: osdmap e660: 8 total, 8 up, 8 in 2024-01-13T18:10:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:42 smithi099 ceph-mon[138788]: pgmap v702: 121 pgs: 121 active+clean; 100 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 774 KiB/s rd, 276 KiB/s wr, 7 op/s 2024-01-13T18:10:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:42 smithi099 ceph-mon[138788]: osdmap e661: 8 total, 8 up, 8 in 2024-01-13T18:10:43.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:42 smithi084 ceph-mon[116404]: osdmap e660: 8 total, 8 up, 8 in 2024-01-13T18:10:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:42 smithi084 ceph-mon[116404]: pgmap v702: 121 pgs: 121 active+clean; 100 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 774 KiB/s rd, 276 KiB/s wr, 7 op/s 2024-01-13T18:10:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:42 smithi084 ceph-mon[116404]: osdmap e661: 8 total, 8 up, 8 in 2024-01-13T18:10:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:42 smithi084 ceph-mon[119097]: osdmap e660: 8 total, 8 up, 8 in 2024-01-13T18:10:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:42 smithi084 ceph-mon[119097]: pgmap v702: 121 pgs: 121 active+clean; 100 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 774 KiB/s rd, 276 KiB/s wr, 7 op/s 2024-01-13T18:10:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:42 smithi084 ceph-mon[119097]: osdmap e661: 8 total, 8 up, 8 in 2024-01-13T18:10:43.716 INFO:tasks.rados.rados.0.smithi084.stdout:3005: done (2 left) 2024-01-13T18:10:43.716 INFO:tasks.rados.rados.0.smithi084.stdout:3006: read oid 49 snap 290 2024-01-13T18:10:43.717 INFO:tasks.rados.rados.0.smithi084.stdout:3006: expect (ObjNum 927 snap 290 seq_num 927) 2024-01-13T18:10:43.717 INFO:tasks.rados.rados.0.smithi084.stdout:3007: snap_create 2024-01-13T18:10:43.717 INFO:tasks.rados.rados.0.smithi084.stdout:3001: finishing rollback tid 2 to smithi084102331-44 2024-01-13T18:10:43.717 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1482 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-01-13T18:10:43.717 INFO:tasks.rados.rados.0.smithi084.stdout:3004: finishing copy_from to smithi084102331-8 2024-01-13T18:10:43.717 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1338 (ObjNum 918 snap 285 seq_num 918) dirty exists 2024-01-13T18:10:43.717 INFO:tasks.rados.rados.0.smithi084.stdout:3004: finishing copy_from racing read to smithi084102331-8 2024-01-13T18:10:43.723 INFO:tasks.rados.rados.0.smithi084.stdout:3006: expect (ObjNum 927 snap 290 seq_num 927) 2024-01-13T18:10:44.722 INFO:tasks.rados.rados.0.smithi084.stdout:3001: done (3 left) 2024-01-13T18:10:44.723 INFO:tasks.rados.rados.0.smithi084.stdout:3004: done (2 left) 2024-01-13T18:10:44.723 INFO:tasks.rados.rados.0.smithi084.stdout:3006: done (1 left) 2024-01-13T18:10:44.723 INFO:tasks.rados.rados.0.smithi084.stdout:3007: done (0 left) 2024-01-13T18:10:44.723 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 294 2024-01-13T18:10:44.723 INFO:tasks.rados.rados.0.smithi084.stdout:3008: seq_num 929 ranges {9904128=761856,10665984=401408} 2024-01-13T18:10:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:3008: writing smithi084102331-15 from 9904128 to 10665984 tid 1 2024-01-13T18:10:44.780 INFO:tasks.rados.rados.0.smithi084.stdout:3008: writing smithi084102331-15 from 10665984 to 11067392 tid 2 2024-01-13T18:10:44.780 INFO:tasks.rados.rados.0.smithi084.stdout:3009: copy_from oid 32 from oid 45 current snap is 294 2024-01-13T18:10:44.781 INFO:tasks.rados.rados.0.smithi084.stdout:3010: snap_create 2024-01-13T18:10:44.788 INFO:tasks.rados.rados.0.smithi084.stdout:3008: finishing write tid 1 to smithi084102331-15 2024-01-13T18:10:44.788 INFO:tasks.rados.rados.0.smithi084.stdout:3008: finishing write tid 2 to smithi084102331-15 2024-01-13T18:10:44.788 INFO:tasks.rados.rados.0.smithi084.stdout:3008: finishing write tid 3 to smithi084102331-15 2024-01-13T18:10:44.789 INFO:tasks.rados.rados.0.smithi084.stdout:3008: finishing write tid 4 to smithi084102331-15 2024-01-13T18:10:44.789 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1492 (ObjNum 929 snap 294 seq_num 929) dirty exists 2024-01-13T18:10:44.790 INFO:tasks.rados.rados.0.smithi084.stdout:3008: left oid 15 (ObjNum 929 snap 294 seq_num 929) 2024-01-13T18:10:44.812 INFO:tasks.rados.rados.0.smithi084.stdout:3009: finishing copy_from to smithi084102331-32 2024-01-13T18:10:44.812 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1537 (ObjNum 897 snap 282 seq_num 897) dirty exists 2024-01-13T18:10:44.812 INFO:tasks.rados.rados.0.smithi084.stdout:3009: finishing copy_from racing read to smithi084102331-32 2024-01-13T18:10:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:44 smithi099 ceph-mon[138788]: osdmap e662: 8 total, 8 up, 8 in 2024-01-13T18:10:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:44 smithi099 ceph-mon[138788]: pgmap v705: 121 pgs: 121 active+clean; 99 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 456 KiB/s wr, 4 op/s 2024-01-13T18:10:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:44 smithi084 ceph-mon[116404]: osdmap e662: 8 total, 8 up, 8 in 2024-01-13T18:10:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:44 smithi084 ceph-mon[116404]: pgmap v705: 121 pgs: 121 active+clean; 99 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 456 KiB/s wr, 4 op/s 2024-01-13T18:10:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:44 smithi084 ceph-mon[119097]: osdmap e662: 8 total, 8 up, 8 in 2024-01-13T18:10:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:44 smithi084 ceph-mon[119097]: pgmap v705: 121 pgs: 121 active+clean; 99 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 456 KiB/s wr, 4 op/s 2024-01-13T18:10:45.724 INFO:tasks.rados.rados.0.smithi084.stdout:3008: done (2 left) 2024-01-13T18:10:45.724 INFO:tasks.rados.rados.0.smithi084.stdout:3009: done (1 left) 2024-01-13T18:10:45.724 INFO:tasks.rados.rados.0.smithi084.stdout:3010: done (0 left) 2024-01-13T18:10:45.725 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 295 2024-01-13T18:10:45.725 INFO:tasks.rados.rados.0.smithi084.stdout:3011: seq_num 930 ranges {2506752=786432,3293184=401408} 2024-01-13T18:10:45.742 INFO:tasks.rados.rados.0.smithi084.stdout:3011: writing smithi084102331-13 from 2506752 to 3293184 tid 1 2024-01-13T18:10:45.744 INFO:tasks.rados.rados.0.smithi084.stdout:3011: writing smithi084102331-13 from 3293184 to 3694592 tid 2 2024-01-13T18:10:45.745 INFO:tasks.rados.rados.0.smithi084.stdout:3012: rollback oid 43 current snap is 295 2024-01-13T18:10:45.745 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 294 2024-01-13T18:10:45.745 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 295 2024-01-13T18:10:45.745 INFO:tasks.rados.rados.0.smithi084.stdout:3013: seq_num 931 ranges {3973120=802816,4775936=401408} 2024-01-13T18:10:45.770 INFO:tasks.rados.rados.0.smithi084.stdout:3013: writing smithi084102331-30 from 3973120 to 4775936 tid 1 2024-01-13T18:10:45.773 INFO:tasks.rados.rados.0.smithi084.stdout:3013: writing smithi084102331-30 from 4775936 to 5177344 tid 2 2024-01-13T18:10:45.773 INFO:tasks.rados.rados.0.smithi084.stdout:3014: snap_create 2024-01-13T18:10:45.773 INFO:tasks.rados.rados.0.smithi084.stdout:3012: finishing rollback tid 1 to smithi084102331-43 2024-01-13T18:10:45.773 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 0 (ObjNum 49 snap 0 seq_num 4037553584) dirty dne 2024-01-13T18:10:45.773 INFO:tasks.rados.rados.0.smithi084.stdout:3011: finishing write tid 1 to smithi084102331-13 2024-01-13T18:10:45.773 INFO:tasks.rados.rados.0.smithi084.stdout:3011: finishing write tid 2 to smithi084102331-13 2024-01-13T18:10:45.773 INFO:tasks.rados.rados.0.smithi084.stdout:3011: finishing write tid 3 to smithi084102331-13 2024-01-13T18:10:45.773 INFO:tasks.rados.rados.0.smithi084.stdout:3011: finishing write tid 4 to smithi084102331-13 2024-01-13T18:10:45.773 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 1537 (ObjNum 930 snap 295 seq_num 930) dirty exists 2024-01-13T18:10:45.773 INFO:tasks.rados.rados.0.smithi084.stdout:3011: left oid 13 (ObjNum 930 snap 295 seq_num 930) 2024-01-13T18:10:45.779 INFO:tasks.rados.rados.0.smithi084.stdout:3013: finishing write tid 1 to smithi084102331-30 2024-01-13T18:10:45.780 INFO:tasks.rados.rados.0.smithi084.stdout:3013: finishing write tid 2 to smithi084102331-30 2024-01-13T18:10:45.780 INFO:tasks.rados.rados.0.smithi084.stdout:3013: finishing write tid 3 to smithi084102331-30 2024-01-13T18:10:45.783 INFO:tasks.rados.rados.0.smithi084.stdout:3013: finishing write tid 4 to smithi084102331-30 2024-01-13T18:10:45.783 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1382 (ObjNum 931 snap 295 seq_num 931) dirty exists 2024-01-13T18:10:45.783 INFO:tasks.rados.rados.0.smithi084.stdout:3013: left oid 30 (ObjNum 931 snap 295 seq_num 931) 2024-01-13T18:10:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:45 smithi099 ceph-mon[138788]: osdmap e663: 8 total, 8 up, 8 in 2024-01-13T18:10:46.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:45 smithi084 ceph-mon[119097]: osdmap e663: 8 total, 8 up, 8 in 2024-01-13T18:10:46.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:45 smithi084 ceph-mon[116404]: osdmap e663: 8 total, 8 up, 8 in 2024-01-13T18:10:46.737 INFO:tasks.rados.rados.0.smithi084.stdout:3011: done (3 left) 2024-01-13T18:10:46.737 INFO:tasks.rados.rados.0.smithi084.stdout:3012: done (2 left) 2024-01-13T18:10:46.737 INFO:tasks.rados.rados.0.smithi084.stdout:3013: done (1 left) 2024-01-13T18:10:46.737 INFO:tasks.rados.rados.0.smithi084.stdout:3014: done (0 left) 2024-01-13T18:10:46.737 INFO:tasks.rados.rados.0.smithi084.stdout:3015: snap_remove snap 294 2024-01-13T18:10:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:46 smithi099 ceph-mon[138788]: osdmap e664: 8 total, 8 up, 8 in 2024-01-13T18:10:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:46 smithi099 ceph-mon[138788]: pgmap v708: 121 pgs: 121 active+clean; 99 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 456 KiB/s wr, 10 op/s 2024-01-13T18:10:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:46 smithi084 ceph-mon[116404]: osdmap e664: 8 total, 8 up, 8 in 2024-01-13T18:10:47.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:46 smithi084 ceph-mon[116404]: pgmap v708: 121 pgs: 121 active+clean; 99 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 456 KiB/s wr, 10 op/s 2024-01-13T18:10:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:46 smithi084 ceph-mon[119097]: osdmap e664: 8 total, 8 up, 8 in 2024-01-13T18:10:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:46 smithi084 ceph-mon[119097]: pgmap v708: 121 pgs: 121 active+clean; 99 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 456 KiB/s wr, 10 op/s 2024-01-13T18:10:47.702 INFO:tasks.rados.rados.0.smithi084.stdout:3015: done (0 left) 2024-01-13T18:10:47.703 INFO:tasks.rados.rados.0.smithi084.stdout:3016: setattr oid 40 current snap is 296 2024-01-13T18:10:47.705 INFO:tasks.rados.rados.0.smithi084.stdout:3017: read oid 41 snap 295 2024-01-13T18:10:47.705 INFO:tasks.rados.rados.0.smithi084.stdout:3017: expect (ObjNum 893 snap 279 seq_num 893) 2024-01-13T18:10:47.705 INFO:tasks.rados.rados.0.smithi084.stdout:3018: snap_remove snap 293 2024-01-13T18:10:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:47 smithi099 ceph-mon[138788]: osdmap e665: 8 total, 8 up, 8 in 2024-01-13T18:10:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:47 smithi099 ceph-mon[138788]: osdmap e666: 8 total, 8 up, 8 in 2024-01-13T18:10:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:47 smithi084 ceph-mon[116404]: osdmap e665: 8 total, 8 up, 8 in 2024-01-13T18:10:48.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:47 smithi084 ceph-mon[116404]: osdmap e666: 8 total, 8 up, 8 in 2024-01-13T18:10:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:47 smithi084 ceph-mon[119097]: osdmap e665: 8 total, 8 up, 8 in 2024-01-13T18:10:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:47 smithi084 ceph-mon[119097]: osdmap e666: 8 total, 8 up, 8 in 2024-01-13T18:10:48.711 INFO:tasks.rados.rados.0.smithi084.stdout:3018: done (2 left) 2024-01-13T18:10:48.712 INFO:tasks.rados.rados.0.smithi084.stdout:3019: copy_from oid 27 from oid 44 current snap is 296 2024-01-13T18:10:48.712 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1339 (ObjNum 918 snap 285 seq_num 918) dirty exists 2024-01-13T18:10:48.712 INFO:tasks.rados.rados.0.smithi084.stdout:3017: expect (ObjNum 893 snap 279 seq_num 893) 2024-01-13T18:10:49.046 INFO:tasks.rados.rados.0.smithi084.stdout:3019: finishing copy_from to smithi084102331-27 2024-01-13T18:10:49.046 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1482 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:10:49.047 INFO:tasks.rados.rados.0.smithi084.stdout:3019: finishing copy_from racing read to smithi084102331-27 2024-01-13T18:10:49.047 INFO:tasks.rados.rados.0.smithi084.stdout:3016: done (2 left) 2024-01-13T18:10:49.047 INFO:tasks.rados.rados.0.smithi084.stdout:3017: done (1 left) 2024-01-13T18:10:49.047 INFO:tasks.rados.rados.0.smithi084.stdout:3019: done (0 left) 2024-01-13T18:10:49.047 INFO:tasks.rados.rados.0.smithi084.stdout:3020: rmattr oid 1 current snap is 296 2024-01-13T18:10:49.047 INFO:tasks.rados.rados.0.smithi084.stdout:3021: rmattr oid 26 current snap is 296 2024-01-13T18:10:49.047 INFO:tasks.rados.rados.0.smithi084.stdout:3022: read oid 41 snap 290 2024-01-13T18:10:49.047 INFO:tasks.rados.rados.0.smithi084.stdout:3022: expect (ObjNum 893 snap 279 seq_num 893) 2024-01-13T18:10:49.047 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 296 2024-01-13T18:10:49.047 INFO:tasks.rados.rados.0.smithi084.stdout:3023: seq_num 932 ranges {0=417792,417792=663552,1081344=139264} 2024-01-13T18:10:49.048 INFO:tasks.rados.rados.0.smithi084.stdout:3023: writing smithi084102331-17 from 0 to 417792 tid 1 2024-01-13T18:10:49.052 INFO:tasks.rados.rados.0.smithi084.stdout:3023: writing smithi084102331-17 from 417792 to 1081344 tid 2 2024-01-13T18:10:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:3023: writing smithi084102331-17 from 1081344 to 1220608 tid 3 2024-01-13T18:10:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:3024: copy_from oid 33 from oid 5 current snap is 296 2024-01-13T18:10:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1446 (ObjNum 257 snap 0 seq_num 4038195328) dirty exists 2024-01-13T18:10:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1562 (ObjNum 894 snap 280 seq_num 894) dirty exists 2024-01-13T18:10:49.054 INFO:tasks.rados.rados.0.smithi084.stdout:3020: done (4 left) 2024-01-13T18:10:49.054 INFO:tasks.rados.rados.0.smithi084.stdout:3021: done (3 left) 2024-01-13T18:10:49.054 INFO:tasks.rados.rados.0.smithi084.stdout:3025: delete oid 21 current snap is 296 2024-01-13T18:10:49.054 INFO:tasks.rados.rados.0.smithi084.stdout:3023: finishing write tid 1 to smithi084102331-17 2024-01-13T18:10:49.055 INFO:tasks.rados.rados.0.smithi084.stdout:3025: done (3 left) 2024-01-13T18:10:49.055 INFO:tasks.rados.rados.0.smithi084.stdout:3026: copy_from oid 49 from oid 11 current snap is 296 2024-01-13T18:10:49.055 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 296 2024-01-13T18:10:49.055 INFO:tasks.rados.rados.0.smithi084.stdout:3027: seq_num 934 ranges {1032192=450560,1482752=434176,1916928=368640} 2024-01-13T18:10:49.063 INFO:tasks.rados.rados.0.smithi084.stdout:3027: writing smithi084102331-48 from 1032192 to 1482752 tid 1 2024-01-13T18:10:49.066 INFO:tasks.rados.rados.0.smithi084.stdout:3027: writing smithi084102331-48 from 1482752 to 1916928 tid 2 2024-01-13T18:10:49.069 INFO:tasks.rados.rados.0.smithi084.stdout:3027: writing smithi084102331-48 from 1916928 to 2285568 tid 3 2024-01-13T18:10:49.069 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 296 2024-01-13T18:10:49.069 INFO:tasks.rados.rados.0.smithi084.stdout:3028: seq_num 935 ranges {1056768=466944,1523712=720896,2244608=81920} 2024-01-13T18:10:49.077 INFO:tasks.rados.rados.0.smithi084.stdout:3028: writing smithi084102331-20 from 1056768 to 1523712 tid 1 2024-01-13T18:10:49.081 INFO:tasks.rados.rados.0.smithi084.stdout:3028: writing smithi084102331-20 from 1523712 to 2244608 tid 2 2024-01-13T18:10:49.082 INFO:tasks.rados.rados.0.smithi084.stdout:3028: writing smithi084102331-20 from 2244608 to 2326528 tid 3 2024-01-13T18:10:49.082 INFO:tasks.rados.rados.0.smithi084.stdout:3029: copy_from oid 9 from oid 7 current snap is 296 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:3023: finishing write tid 2 to smithi084102331-17 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:3023: finishing write tid 3 to smithi084102331-17 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:3023: finishing write tid 4 to smithi084102331-17 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:3023: finishing write tid 5 to smithi084102331-17 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1541 (ObjNum 932 snap 296 seq_num 932) dirty exists 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:3023: left oid 17 (ObjNum 932 snap 296 seq_num 932) 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:3023: done (6 left) 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:3030: rollback oid 38 current snap is 296 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 295 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:3027: finishing write tid 1 to smithi084102331-48 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:3027: finishing write tid 2 to smithi084102331-48 2024-01-13T18:10:49.083 INFO:tasks.rados.rados.0.smithi084.stdout:3022: expect (ObjNum 893 snap 279 seq_num 893) 2024-01-13T18:10:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:48 smithi099 ceph-mon[138788]: pgmap v711: 121 pgs: 121 active+clean; 105 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-01-13T18:10:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:48 smithi099 ceph-mon[138788]: osdmap e667: 8 total, 8 up, 8 in 2024-01-13T18:10:49.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:48 smithi084 ceph-mon[116404]: pgmap v711: 121 pgs: 121 active+clean; 105 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-01-13T18:10:49.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:48 smithi084 ceph-mon[116404]: osdmap e667: 8 total, 8 up, 8 in 2024-01-13T18:10:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:48 smithi084 ceph-mon[119097]: pgmap v711: 121 pgs: 121 active+clean; 105 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-01-13T18:10:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:48 smithi084 ceph-mon[119097]: osdmap e667: 8 total, 8 up, 8 in 2024-01-13T18:10:49.417 INFO:tasks.rados.rados.0.smithi084.stdout:3027: finishing write tid 3 to smithi084102331-48 2024-01-13T18:10:49.417 INFO:tasks.rados.rados.0.smithi084.stdout:3027: finishing write tid 4 to smithi084102331-48 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:3024: finishing copy_from to smithi084102331-33 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1229 (ObjNum 837 snap 271 seq_num 837) dirty exists 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:3024: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:3027: finishing write tid 5 to smithi084102331-48 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1641 (ObjNum 934 snap 296 seq_num 934) dirty exists 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:3027: left oid 48 (ObjNum 934 snap 296 seq_num 934) 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:3022: done (6 left) 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:3024: done (5 left) 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:3027: done (4 left) 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:3031: read oid 24 snap -1 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:3031: expect (ObjNum 879 snap 279 seq_num 879) 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:3032: rollback oid 17 current snap is 296 2024-01-13T18:10:49.418 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 290 2024-01-13T18:10:49.419 INFO:tasks.rados.rados.0.smithi084.stdout:3028: finishing write tid 1 to smithi084102331-20 2024-01-13T18:10:49.419 INFO:tasks.rados.rados.0.smithi084.stdout:3029: finishing copy_from to smithi084102331-9 2024-01-13T18:10:49.419 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1329 (ObjNum 49 snap 0 seq_num 4037197744) dirty exists 2024-01-13T18:10:49.419 INFO:tasks.rados.rados.0.smithi084.stdout:3029: finishing copy_from racing read to smithi084102331-9 2024-01-13T18:10:49.419 INFO:tasks.rados.rados.0.smithi084.stdout:3028: finishing write tid 2 to smithi084102331-20 2024-01-13T18:10:49.419 INFO:tasks.rados.rados.0.smithi084.stdout:3029: done (5 left) 2024-01-13T18:10:49.419 INFO:tasks.rados.rados.0.smithi084.stdout:3033: copy_from oid 21 from oid 4 current snap is 296 2024-01-13T18:10:49.420 INFO:tasks.rados.rados.0.smithi084.stdout:3028: finishing write tid 3 to smithi084102331-20 2024-01-13T18:10:49.420 INFO:tasks.rados.rados.0.smithi084.stdout:3028: finishing write tid 4 to smithi084102331-20 2024-01-13T18:10:49.420 INFO:tasks.rados.rados.0.smithi084.stdout:3028: finishing write tid 5 to smithi084102331-20 2024-01-13T18:10:49.420 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1289 (ObjNum 935 snap 296 seq_num 935) dirty exists 2024-01-13T18:10:49.420 INFO:tasks.rados.rados.0.smithi084.stdout:3028: left oid 20 (ObjNum 935 snap 296 seq_num 935) 2024-01-13T18:10:49.420 INFO:tasks.rados.rados.0.smithi084.stdout:3030: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:10:49.420 INFO:tasks.rados.rados.0.smithi084.stdout:3028: done (5 left) 2024-01-13T18:10:49.420 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 296 2024-01-13T18:10:49.420 INFO:tasks.rados.rados.0.smithi084.stdout:3030: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:10:49.420 INFO:tasks.rados.rados.0.smithi084.stdout:3030: finishing rollback tid 2 to smithi084102331-38 2024-01-13T18:10:49.420 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1566 (ObjNum 799 snap 258 seq_num 799) dirty exists 2024-01-13T18:10:49.421 INFO:tasks.rados.rados.0.smithi084.stdout:3026: finishing copy_from to smithi084102331-49 2024-01-13T18:10:49.421 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1340 (ObjNum 909 snap 283 seq_num 909) dirty exists 2024-01-13T18:10:49.421 INFO:tasks.rados.rados.0.smithi084.stdout:3026: finishing copy_from racing read to smithi084102331-49 2024-01-13T18:10:49.421 INFO:tasks.rados.rados.0.smithi084.stdout:3034: seq_num 936 ranges {0=483328,483328=655360,1138688=147456} 2024-01-13T18:10:49.421 INFO:tasks.rados.rados.0.smithi084.stdout:3034: writing smithi084102331-10 from 0 to 483328 tid 1 2024-01-13T18:10:49.423 INFO:tasks.rados.rados.0.smithi084.stdout:3034: writing smithi084102331-10 from 483328 to 1138688 tid 2 2024-01-13T18:10:49.424 INFO:tasks.rados.rados.0.smithi084.stdout:3034: writing smithi084102331-10 from 1138688 to 1286144 tid 3 2024-01-13T18:10:49.424 INFO:tasks.rados.rados.0.smithi084.stdout:3026: done (5 left) 2024-01-13T18:10:49.424 INFO:tasks.rados.rados.0.smithi084.stdout:3030: done (4 left) 2024-01-13T18:10:49.424 INFO:tasks.rados.rados.0.smithi084.stdout:3035: snap_remove snap 295 2024-01-13T18:10:49.745 INFO:tasks.rados.rados.0.smithi084.stdout:3035: done (4 left) 2024-01-13T18:10:49.745 INFO:tasks.rados.rados.0.smithi084.stdout:3036: rmattr oid 18 current snap is 296 2024-01-13T18:10:49.745 INFO:tasks.rados.rados.0.smithi084.stdout:3036: done (4 left) 2024-01-13T18:10:49.745 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 296 2024-01-13T18:10:49.745 INFO:tasks.rados.rados.0.smithi084.stdout:3037: seq_num 937 ranges {901120=499712,1400832=532480,1933312=270336} 2024-01-13T18:10:49.755 INFO:tasks.rados.rados.0.smithi084.stdout:3037: writing smithi084102331-3 from 901120 to 1400832 tid 1 2024-01-13T18:10:49.756 INFO:tasks.rados.rados.0.smithi084.stdout:3037: writing smithi084102331-3 from 1400832 to 1933312 tid 2 2024-01-13T18:10:49.758 INFO:tasks.rados.rados.0.smithi084.stdout:3037: writing smithi084102331-3 from 1933312 to 2203648 tid 3 2024-01-13T18:10:49.758 INFO:tasks.rados.rados.0.smithi084.stdout:3038: read oid 25 snap -1 2024-01-13T18:10:49.758 INFO:tasks.rados.rados.0.smithi084.stdout:3038: expect (ObjNum 917 snap 284 seq_num 917) 2024-01-13T18:10:49.759 INFO:tasks.rados.rados.0.smithi084.stdout:3039: rollback oid 28 current snap is 296 2024-01-13T18:10:49.759 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 28 to 290 2024-01-13T18:10:49.759 INFO:tasks.rados.rados.0.smithi084.stdout:3040: read oid 12 snap 290 2024-01-13T18:10:49.759 INFO:tasks.rados.rados.0.smithi084.stdout:3040: expect (ObjNum 873 snap 277 seq_num 873) 2024-01-13T18:10:49.759 INFO:tasks.rados.rados.0.smithi084.stdout:3032: finishing rollback tid 0 to smithi084102331-17 2024-01-13T18:10:49.759 INFO:tasks.rados.rados.0.smithi084.stdout:3034: finishing write tid 1 to smithi084102331-10 2024-01-13T18:10:49.759 INFO:tasks.rados.rados.0.smithi084.stdout:3031: expect (ObjNum 879 snap 279 seq_num 879) 2024-01-13T18:10:49.849 INFO:tasks.rados.rados.0.smithi084.stdout:3032: finishing rollback tid 1 to smithi084102331-17 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1543 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:3034: finishing write tid 2 to smithi084102331-10 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:3041: read oid 14 snap -1 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:3041: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:3031: done (8 left) 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:3032: done (7 left) 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:3042: setattr oid 35 current snap is 296 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:3034: finishing write tid 3 to smithi084102331-10 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:3034: finishing write tid 4 to smithi084102331-10 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:3034: finishing write tid 5 to smithi084102331-10 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1404 (ObjNum 936 snap 296 seq_num 936) dirty exists 2024-01-13T18:10:49.850 INFO:tasks.rados.rados.0.smithi084.stdout:3034: left oid 10 (ObjNum 936 snap 296 seq_num 936) 2024-01-13T18:10:49.851 INFO:tasks.rados.rados.0.smithi084.stdout:3033: finishing copy_from to smithi084102331-21 2024-01-13T18:10:49.851 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 1315 (ObjNum 782 snap 254 seq_num 782) dirty exists 2024-01-13T18:10:49.851 INFO:tasks.rados.rados.0.smithi084.stdout:3033: finishing copy_from racing read to smithi084102331-21 2024-01-13T18:10:49.851 INFO:tasks.rados.rados.0.smithi084.stdout:3039: finishing rollback tid 0 to smithi084102331-28 2024-01-13T18:10:49.851 INFO:tasks.rados.rados.0.smithi084.stdout:3037: finishing write tid 1 to smithi084102331-3 2024-01-13T18:10:49.851 INFO:tasks.rados.rados.0.smithi084.stdout:3037: finishing write tid 2 to smithi084102331-3 2024-01-13T18:10:49.851 INFO:tasks.rados.rados.0.smithi084.stdout:3039: finishing rollback tid 1 to smithi084102331-28 2024-01-13T18:10:49.851 INFO:tasks.rados.rados.0.smithi084.stdout:3037: finishing write tid 3 to smithi084102331-3 2024-01-13T18:10:49.851 INFO:tasks.rados.rados.0.smithi084.stdout:3039: finishing rollback tid 2 to smithi084102331-28 2024-01-13T18:10:49.851 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1485 (ObjNum 908 snap 282 seq_num 908) dirty exists 2024-01-13T18:10:49.851 INFO:tasks.rados.rados.0.smithi084.stdout:3038: expect (ObjNum 917 snap 284 seq_num 917) 2024-01-13T18:10:49.877 INFO:tasks.rados.rados.0.smithi084.stdout:3037: finishing write tid 4 to smithi084102331-3 2024-01-13T18:10:49.878 INFO:tasks.rados.rados.0.smithi084.stdout:3037: finishing write tid 5 to smithi084102331-3 2024-01-13T18:10:49.878 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1575 (ObjNum 937 snap 296 seq_num 937) dirty exists 2024-01-13T18:10:49.878 INFO:tasks.rados.rados.0.smithi084.stdout:3037: left oid 3 (ObjNum 937 snap 296 seq_num 937) 2024-01-13T18:10:49.878 INFO:tasks.rados.rados.0.smithi084.stdout:3040: expect (ObjNum 873 snap 277 seq_num 873) 2024-01-13T18:10:50.039 INFO:tasks.rados.rados.0.smithi084.stdout:3041: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:50.040 INFO:tasks.rados.rados.0.smithi084.stdout:3033: done (7 left) 2024-01-13T18:10:50.040 INFO:tasks.rados.rados.0.smithi084.stdout:3034: done (6 left) 2024-01-13T18:10:50.040 INFO:tasks.rados.rados.0.smithi084.stdout:3037: done (5 left) 2024-01-13T18:10:50.040 INFO:tasks.rados.rados.0.smithi084.stdout:3038: done (4 left) 2024-01-13T18:10:50.040 INFO:tasks.rados.rados.0.smithi084.stdout:3039: done (3 left) 2024-01-13T18:10:50.040 INFO:tasks.rados.rados.0.smithi084.stdout:3040: done (2 left) 2024-01-13T18:10:50.040 INFO:tasks.rados.rados.0.smithi084.stdout:3041: done (1 left) 2024-01-13T18:10:50.041 INFO:tasks.rados.rados.0.smithi084.stdout:3043: setattr oid 7 current snap is 296 2024-01-13T18:10:50.042 INFO:tasks.rados.rados.0.smithi084.stdout:3044: read oid 40 snap 290 2024-01-13T18:10:50.042 INFO:tasks.rados.rados.0.smithi084.stdout:3044: expect (ObjNum 918 snap 285 seq_num 918) 2024-01-13T18:10:50.042 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 296 2024-01-13T18:10:50.042 INFO:tasks.rados.rados.0.smithi084.stdout:3045: seq_num 938 ranges {0=516096,516096=417792,933888=385024} 2024-01-13T18:10:50.045 INFO:tasks.rados.rados.0.smithi084.stdout:3045: writing smithi084102331-27 from 0 to 516096 tid 1 2024-01-13T18:10:50.047 INFO:tasks.rados.rados.0.smithi084.stdout:3045: writing smithi084102331-27 from 516096 to 933888 tid 2 2024-01-13T18:10:50.050 INFO:tasks.rados.rados.0.smithi084.stdout:3045: writing smithi084102331-27 from 933888 to 1318912 tid 3 2024-01-13T18:10:50.050 INFO:tasks.rados.rados.0.smithi084.stdout:3046: read oid 37 snap -1 2024-01-13T18:10:50.051 INFO:tasks.rados.rados.0.smithi084.stdout:3046: expect deleted 2024-01-13T18:10:50.051 INFO:tasks.rados.rados.0.smithi084.stdout:3047: rollback oid 21 current snap is 296 2024-01-13T18:10:50.051 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 290 2024-01-13T18:10:50.051 INFO:tasks.rados.rados.0.smithi084.stdout:3048: read oid 26 snap -1 2024-01-13T18:10:50.051 INFO:tasks.rados.rados.0.smithi084.stdout:3048: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:50.051 INFO:tasks.rados.rados.0.smithi084.stdout:3049: copy_from oid 17 from oid 25 current snap is 296 2024-01-13T18:10:50.051 INFO:tasks.rados.rados.0.smithi084.stdout:3050: read oid 14 snap -1 2024-01-13T18:10:50.051 INFO:tasks.rados.rados.0.smithi084.stdout:3050: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:50.051 INFO:tasks.rados.rados.0.smithi084.stdout:3051: read oid 44 snap -1 2024-01-13T18:10:50.052 INFO:tasks.rados.rados.0.smithi084.stdout:3051: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:50.052 INFO:tasks.rados.rados.0.smithi084.stdout:3052: copy_from oid 2 from oid 11 current snap is 296 2024-01-13T18:10:50.052 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 296 2024-01-13T18:10:50.052 INFO:tasks.rados.rados.0.smithi084.stdout:3053: seq_num 939 ranges {6365184=532480,6897664=704512,7602176=98304} 2024-01-13T18:10:50.088 INFO:tasks.rados.rados.0.smithi084.stdout:3053: writing smithi084102331-41 from 6365184 to 6897664 tid 1 2024-01-13T18:10:50.092 INFO:tasks.rados.rados.0.smithi084.stdout:3053: writing smithi084102331-41 from 6897664 to 7602176 tid 2 2024-01-13T18:10:50.093 INFO:tasks.rados.rados.0.smithi084.stdout:3053: writing smithi084102331-41 from 7602176 to 7700480 tid 3 2024-01-13T18:10:50.094 INFO:tasks.rados.rados.0.smithi084.stdout:3054: snap_create 2024-01-13T18:10:50.094 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1340 (ObjNum 914 snap 283 seq_num 914) dirty exists 2024-01-13T18:10:50.094 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1330 (ObjNum 81 snap 0 seq_num 4035634624) dirty exists 2024-01-13T18:10:50.094 INFO:tasks.rados.rados.0.smithi084.stdout:3045: finishing write tid 1 to smithi084102331-27 2024-01-13T18:10:50.094 INFO:tasks.rados.rados.0.smithi084.stdout:3044: expect (ObjNum 918 snap 285 seq_num 918) 2024-01-13T18:10:50.154 INFO:tasks.rados.rados.0.smithi084.stdout:3051: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:50.158 INFO:tasks.rados.rados.0.smithi084.stdout:3048: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:50.158 INFO:tasks.rados.rados.0.smithi084.stdout:3047: finishing rollback tid 0 to smithi084102331-21 2024-01-13T18:10:50.158 INFO:tasks.rados.rados.0.smithi084.stdout:3050: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:50.159 INFO:tasks.rados.rados.0.smithi084.stdout:3045: finishing write tid 2 to smithi084102331-27 2024-01-13T18:10:50.159 INFO:tasks.rados.rados.0.smithi084.stdout:3045: finishing write tid 3 to smithi084102331-27 2024-01-13T18:10:50.159 INFO:tasks.rados.rados.0.smithi084.stdout:3045: finishing write tid 4 to smithi084102331-27 2024-01-13T18:10:50.159 INFO:tasks.rados.rados.0.smithi084.stdout:3047: finishing rollback tid 1 to smithi084102331-21 2024-01-13T18:10:50.159 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 1342 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-01-13T18:10:50.159 INFO:tasks.rados.rados.0.smithi084.stdout:3045: finishing write tid 5 to smithi084102331-27 2024-01-13T18:10:50.160 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1489 (ObjNum 938 snap 296 seq_num 938) dirty exists 2024-01-13T18:10:50.160 INFO:tasks.rados.rados.0.smithi084.stdout:3045: left oid 27 (ObjNum 938 snap 296 seq_num 938) 2024-01-13T18:10:50.160 INFO:tasks.rados.rados.0.smithi084.stdout:3049: finishing copy_from to smithi084102331-17 2024-01-13T18:10:50.160 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1376 (ObjNum 917 snap 284 seq_num 917) dirty exists 2024-01-13T18:10:50.160 INFO:tasks.rados.rados.0.smithi084.stdout:3049: finishing copy_from racing read to smithi084102331-17 2024-01-13T18:10:50.160 INFO:tasks.rados.rados.0.smithi084.stdout:3052: finishing copy_from to smithi084102331-2 2024-01-13T18:10:50.161 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1340 (ObjNum 909 snap 283 seq_num 909) dirty exists 2024-01-13T18:10:50.161 INFO:tasks.rados.rados.0.smithi084.stdout:3052: finishing copy_from racing read to smithi084102331-2 2024-01-13T18:10:50.161 INFO:tasks.rados.rados.0.smithi084.stdout:3053: finishing write tid 1 to smithi084102331-41 2024-01-13T18:10:50.161 INFO:tasks.rados.rados.0.smithi084.stdout:3053: finishing write tid 2 to smithi084102331-41 2024-01-13T18:10:50.161 INFO:tasks.rados.rados.0.smithi084.stdout:3053: finishing write tid 3 to smithi084102331-41 2024-01-13T18:10:50.161 INFO:tasks.rados.rados.0.smithi084.stdout:3053: finishing write tid 4 to smithi084102331-41 2024-01-13T18:10:50.161 INFO:tasks.rados.rados.0.smithi084.stdout:3053: finishing write tid 5 to smithi084102331-41 2024-01-13T18:10:50.161 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1348 (ObjNum 939 snap 296 seq_num 939) dirty exists 2024-01-13T18:10:50.161 INFO:tasks.rados.rados.0.smithi084.stdout:3053: left oid 41 (ObjNum 939 snap 296 seq_num 939) 2024-01-13T18:10:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:10:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:10:50] "GET /metrics HTTP/1.1" 200 36190 "" "Prometheus/2.43.0" 2024-01-13T18:10:50.752 INFO:tasks.rados.rados.0.smithi084.stdout:3042: done (12 left) 2024-01-13T18:10:50.752 INFO:tasks.rados.rados.0.smithi084.stdout:3043: done (11 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3044: done (10 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3045: done (9 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3046: done (8 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3047: done (7 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3048: done (6 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3049: done (5 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3050: done (4 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3051: done (3 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3052: done (2 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3053: done (1 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3054: done (0 left) 2024-01-13T18:10:50.753 INFO:tasks.rados.rados.0.smithi084.stdout:3055: snap_remove snap 296 2024-01-13T18:10:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:50 smithi099 ceph-mon[138788]: osdmap e668: 8 total, 8 up, 8 in 2024-01-13T18:10:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:50 smithi099 ceph-mon[138788]: pgmap v714: 121 pgs: 121 active+clean; 117 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 6 op/s 2024-01-13T18:10:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:50 smithi084 ceph-mon[116404]: osdmap e668: 8 total, 8 up, 8 in 2024-01-13T18:10:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:50 smithi084 ceph-mon[116404]: pgmap v714: 121 pgs: 121 active+clean; 117 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 6 op/s 2024-01-13T18:10:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:50 smithi084 ceph-mon[119097]: osdmap e668: 8 total, 8 up, 8 in 2024-01-13T18:10:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:10:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:50 smithi084 ceph-mon[119097]: pgmap v714: 121 pgs: 121 active+clean; 117 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 6 op/s 2024-01-13T18:10:51.755 INFO:tasks.rados.rados.0.smithi084.stdout:3055: done (0 left) 2024-01-13T18:10:51.755 INFO:tasks.rados.rados.0.smithi084.stdout:3056: copy_from oid 16 from oid 21 current snap is 297 2024-01-13T18:10:51.755 INFO:tasks.rados.rados.0.smithi084.stdout:3057: rmattr oid 13 current snap is 297 2024-01-13T18:10:51.755 INFO:tasks.rados.rados.0.smithi084.stdout:3058: delete oid 42 current snap is 297 2024-01-13T18:10:51.762 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 1544 (ObjNum 930 snap 295 seq_num 930) dirty exists 2024-01-13T18:10:51.762 INFO:tasks.rados.rados.0.smithi084.stdout:3057: done (2 left) 2024-01-13T18:10:51.763 INFO:tasks.rados.rados.0.smithi084.stdout:3058: done (1 left) 2024-01-13T18:10:51.763 INFO:tasks.rados.rados.0.smithi084.stdout:3059: snap_remove snap 290 2024-01-13T18:10:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:51 smithi099 ceph-mon[138788]: osdmap e669: 8 total, 8 up, 8 in 2024-01-13T18:10:52.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:51 smithi084 ceph-mon[116404]: osdmap e669: 8 total, 8 up, 8 in 2024-01-13T18:10:52.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:51 smithi084 ceph-mon[119097]: osdmap e669: 8 total, 8 up, 8 in 2024-01-13T18:10:52.702 INFO:tasks.rados.rados.0.smithi084.stdout:3059: done (1 left) 2024-01-13T18:10:52.702 INFO:tasks.rados.rados.0.smithi084.stdout:3060: rollback oid 50 current snap is 297 2024-01-13T18:10:52.702 INFO:tasks.rados.rados.0.smithi084.stdout:3060: done (1 left) 2024-01-13T18:10:52.702 INFO:tasks.rados.rados.0.smithi084.stdout:3061: snap_create 2024-01-13T18:10:52.702 INFO:tasks.rados.rados.0.smithi084.stdout:3056: finishing copy_from to smithi084102331-16 2024-01-13T18:10:52.702 INFO:tasks.rados.rados.0.smithi084.stdout:3056: got expected ENOENT (src dne) 2024-01-13T18:10:52.702 INFO:tasks.rados.rados.0.smithi084.stdout:3056: finishing copy_from racing read to smithi084102331-16 2024-01-13T18:10:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:52 smithi099 ceph-mon[138788]: osdmap e670: 8 total, 8 up, 8 in 2024-01-13T18:10:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:52 smithi099 ceph-mon[138788]: pgmap v717: 121 pgs: 121 active+clean; 131 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 5.5 MiB/s rd, 7.2 MiB/s wr, 33 op/s 2024-01-13T18:10:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:52 smithi099 ceph-mon[138788]: osdmap e671: 8 total, 8 up, 8 in 2024-01-13T18:10:53.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:52 smithi084 ceph-mon[119097]: osdmap e670: 8 total, 8 up, 8 in 2024-01-13T18:10:53.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:52 smithi084 ceph-mon[119097]: pgmap v717: 121 pgs: 121 active+clean; 131 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 5.5 MiB/s rd, 7.2 MiB/s wr, 33 op/s 2024-01-13T18:10:53.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:52 smithi084 ceph-mon[119097]: osdmap e671: 8 total, 8 up, 8 in 2024-01-13T18:10:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:52 smithi084 ceph-mon[116404]: osdmap e670: 8 total, 8 up, 8 in 2024-01-13T18:10:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:52 smithi084 ceph-mon[116404]: pgmap v717: 121 pgs: 121 active+clean; 131 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 5.5 MiB/s rd, 7.2 MiB/s wr, 33 op/s 2024-01-13T18:10:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:52 smithi084 ceph-mon[116404]: osdmap e671: 8 total, 8 up, 8 in 2024-01-13T18:10:53.704 INFO:tasks.rados.rados.0.smithi084.stdout:3056: done (1 left) 2024-01-13T18:10:53.704 INFO:tasks.rados.rados.0.smithi084.stdout:3061: done (0 left) 2024-01-13T18:10:53.704 INFO:tasks.rados.rados.0.smithi084.stdout:3062: setattr oid 38 current snap is 298 2024-01-13T18:10:53.705 INFO:tasks.rados.rados.0.smithi084.stdout:3063: copy_from oid 31 from oid 29 current snap is 298 2024-01-13T18:10:53.705 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 298 2024-01-13T18:10:53.705 INFO:tasks.rados.rados.0.smithi084.stdout:3064: seq_num 941 ranges {5177344=565248,5742592=475136,6217728=327680} 2024-01-13T18:10:53.736 INFO:tasks.rados.rados.0.smithi084.stdout:3064: writing smithi084102331-30 from 5177344 to 5742592 tid 1 2024-01-13T18:10:53.738 INFO:tasks.rados.rados.0.smithi084.stdout:3064: writing smithi084102331-30 from 5742592 to 6217728 tid 2 2024-01-13T18:10:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:3064: writing smithi084102331-30 from 6217728 to 6545408 tid 3 2024-01-13T18:10:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:3065: copy_from oid 22 from oid 7 current snap is 298 2024-01-13T18:10:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1583 (ObjNum 799 snap 258 seq_num 799) dirty exists 2024-01-13T18:10:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:3063: finishing copy_from to smithi084102331-31 2024-01-13T18:10:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1328 (ObjNum 901 snap 282 seq_num 901) dirty exists 2024-01-13T18:10:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:3063: finishing copy_from racing read to smithi084102331-31 2024-01-13T18:10:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:3062: done (3 left) 2024-01-13T18:10:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:3063: done (2 left) 2024-01-13T18:10:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 298 2024-01-13T18:10:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:3066: seq_num 942 ranges {0=581632,581632=761856,1343488=40960} 2024-01-13T18:10:53.744 INFO:tasks.rados.rados.0.smithi084.stdout:3066: writing smithi084102331-37 from 0 to 581632 tid 1 2024-01-13T18:10:53.748 INFO:tasks.rados.rados.0.smithi084.stdout:3066: writing smithi084102331-37 from 581632 to 1343488 tid 2 2024-01-13T18:10:53.749 INFO:tasks.rados.rados.0.smithi084.stdout:3066: writing smithi084102331-37 from 1343488 to 1384448 tid 3 2024-01-13T18:10:53.749 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 298 2024-01-13T18:10:53.749 INFO:tasks.rados.rados.0.smithi084.stdout:3064: finishing write tid 1 to smithi084102331-30 2024-01-13T18:10:53.749 INFO:tasks.rados.rados.0.smithi084.stdout:3064: finishing write tid 2 to smithi084102331-30 2024-01-13T18:10:53.749 INFO:tasks.rados.rados.0.smithi084.stdout:3067: seq_num 943 ranges {0=598016,598016=688128,1286144=114688} 2024-01-13T18:10:53.752 INFO:tasks.rados.rados.0.smithi084.stdout:3067: writing smithi084102331-21 from 0 to 598016 tid 1 2024-01-13T18:10:53.756 INFO:tasks.rados.rados.0.smithi084.stdout:3067: writing smithi084102331-21 from 598016 to 1286144 tid 2 2024-01-13T18:10:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:3067: writing smithi084102331-21 from 1286144 to 1400832 tid 3 2024-01-13T18:10:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:3068: read oid 27 snap -1 2024-01-13T18:10:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:3068: expect (ObjNum 938 snap 296 seq_num 938) 2024-01-13T18:10:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 298 2024-01-13T18:10:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:3064: finishing write tid 3 to smithi084102331-30 2024-01-13T18:10:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:3064: finishing write tid 4 to smithi084102331-30 2024-01-13T18:10:53.758 INFO:tasks.rados.rados.0.smithi084.stdout:3064: finishing write tid 5 to smithi084102331-30 2024-01-13T18:10:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1401 (ObjNum 941 snap 298 seq_num 941) dirty exists 2024-01-13T18:10:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:3064: left oid 30 (ObjNum 941 snap 298 seq_num 941) 2024-01-13T18:10:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:3065: finishing copy_from to smithi084102331-22 2024-01-13T18:10:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1330 (ObjNum 1281 snap 0 seq_num 3601426120) dirty exists 2024-01-13T18:10:53.759 INFO:tasks.rados.rados.0.smithi084.stdout:3069: seq_num 944 ranges {0=614400,614400=573440,1187840=229376} 2024-01-13T18:10:53.761 INFO:tasks.rados.rados.0.smithi084.stdout:3069: writing smithi084102331-9 from 0 to 614400 tid 1 2024-01-13T18:10:53.765 INFO:tasks.rados.rados.0.smithi084.stdout:3069: writing smithi084102331-9 from 614400 to 1187840 tid 2 2024-01-13T18:10:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:3069: writing smithi084102331-9 from 1187840 to 1417216 tid 3 2024-01-13T18:10:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:3064: done (5 left) 2024-01-13T18:10:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:3070: rmattr oid 5 current snap is 298 2024-01-13T18:10:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:3070: done (5 left) 2024-01-13T18:10:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:3071: snap_create 2024-01-13T18:10:53.768 INFO:tasks.rados.rados.0.smithi084.stdout:3066: finishing write tid 1 to smithi084102331-37 2024-01-13T18:10:53.768 INFO:tasks.rados.rados.0.smithi084.stdout:3065: finishing copy_from racing read to smithi084102331-22 2024-01-13T18:10:53.768 INFO:tasks.rados.rados.0.smithi084.stdout:3066: finishing write tid 2 to smithi084102331-37 2024-01-13T18:10:53.768 INFO:tasks.rados.rados.0.smithi084.stdout:3066: finishing write tid 3 to smithi084102331-37 2024-01-13T18:10:53.768 INFO:tasks.rados.rados.0.smithi084.stdout:3066: finishing write tid 4 to smithi084102331-37 2024-01-13T18:10:53.768 INFO:tasks.rados.rados.0.smithi084.stdout:3067: finishing write tid 1 to smithi084102331-21 2024-01-13T18:10:53.768 INFO:tasks.rados.rados.0.smithi084.stdout:3066: finishing write tid 5 to smithi084102331-37 2024-01-13T18:10:53.768 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1405 (ObjNum 942 snap 298 seq_num 942) dirty exists 2024-01-13T18:10:53.768 INFO:tasks.rados.rados.0.smithi084.stdout:3066: left oid 37 (ObjNum 942 snap 298 seq_num 942) 2024-01-13T18:10:53.768 INFO:tasks.rados.rados.0.smithi084.stdout:3068: expect (ObjNum 938 snap 296 seq_num 938) 2024-01-13T18:10:53.803 INFO:tasks.rados.rados.0.smithi084.stdout:3067: finishing write tid 2 to smithi084102331-21 2024-01-13T18:10:53.804 INFO:tasks.rados.rados.0.smithi084.stdout:3067: finishing write tid 3 to smithi084102331-21 2024-01-13T18:10:53.804 INFO:tasks.rados.rados.0.smithi084.stdout:3067: finishing write tid 4 to smithi084102331-21 2024-01-13T18:10:53.804 INFO:tasks.rados.rados.0.smithi084.stdout:3067: finishing write tid 5 to smithi084102331-21 2024-01-13T18:10:53.804 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 1346 (ObjNum 943 snap 298 seq_num 943) dirty exists 2024-01-13T18:10:53.804 INFO:tasks.rados.rados.0.smithi084.stdout:3067: left oid 21 (ObjNum 943 snap 298 seq_num 943) 2024-01-13T18:10:53.805 INFO:tasks.rados.rados.0.smithi084.stdout:3069: finishing write tid 1 to smithi084102331-9 2024-01-13T18:10:53.805 INFO:tasks.rados.rados.0.smithi084.stdout:3069: finishing write tid 2 to smithi084102331-9 2024-01-13T18:10:53.805 INFO:tasks.rados.rados.0.smithi084.stdout:3069: finishing write tid 3 to smithi084102331-9 2024-01-13T18:10:53.805 INFO:tasks.rados.rados.0.smithi084.stdout:3069: finishing write tid 4 to smithi084102331-9 2024-01-13T18:10:53.805 INFO:tasks.rados.rados.0.smithi084.stdout:3069: finishing write tid 5 to smithi084102331-9 2024-01-13T18:10:53.805 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1333 (ObjNum 944 snap 298 seq_num 944) dirty exists 2024-01-13T18:10:53.806 INFO:tasks.rados.rados.0.smithi084.stdout:3069: left oid 9 (ObjNum 944 snap 298 seq_num 944) 2024-01-13T18:10:54.710 INFO:tasks.rados.rados.0.smithi084.stdout:3065: done (5 left) 2024-01-13T18:10:54.711 INFO:tasks.rados.rados.0.smithi084.stdout:3066: done (4 left) 2024-01-13T18:10:54.711 INFO:tasks.rados.rados.0.smithi084.stdout:3067: done (3 left) 2024-01-13T18:10:54.711 INFO:tasks.rados.rados.0.smithi084.stdout:3068: done (2 left) 2024-01-13T18:10:54.711 INFO:tasks.rados.rados.0.smithi084.stdout:3069: done (1 left) 2024-01-13T18:10:54.711 INFO:tasks.rados.rados.0.smithi084.stdout:3071: done (0 left) 2024-01-13T18:10:54.711 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 299 2024-01-13T18:10:54.711 INFO:tasks.rados.rados.0.smithi084.stdout:3072: seq_num 945 ranges {0=630784,630784=458752,1089536=344064} 2024-01-13T18:10:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:3072: writing smithi084102331-7 from 0 to 630784 tid 1 2024-01-13T18:10:54.716 INFO:tasks.rados.rados.0.smithi084.stdout:3072: writing smithi084102331-7 from 630784 to 1089536 tid 2 2024-01-13T18:10:54.719 INFO:tasks.rados.rados.0.smithi084.stdout:3072: writing smithi084102331-7 from 1089536 to 1433600 tid 3 2024-01-13T18:10:54.720 INFO:tasks.rados.rados.0.smithi084.stdout:3073: rollback oid 44 current snap is 299 2024-01-13T18:10:54.720 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 297 2024-01-13T18:10:54.720 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 299 2024-01-13T18:10:54.720 INFO:tasks.rados.rados.0.smithi084.stdout:3074: seq_num 946 ranges {0=647168,647168=745472,1392640=57344} 2024-01-13T18:10:54.722 INFO:tasks.rados.rados.0.smithi084.stdout:3074: writing smithi084102331-42 from 0 to 647168 tid 1 2024-01-13T18:10:54.728 INFO:tasks.rados.rados.0.smithi084.stdout:3074: writing smithi084102331-42 from 647168 to 1392640 tid 2 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:3074: writing smithi084102331-42 from 1392640 to 1449984 tid 3 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:3075: rollback oid 9 current snap is 299 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 297 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:3072: finishing write tid 1 to smithi084102331-7 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:3072: finishing write tid 2 to smithi084102331-7 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:3072: finishing write tid 3 to smithi084102331-7 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:3073: finishing rollback tid 0 to smithi084102331-44 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:3072: finishing write tid 4 to smithi084102331-7 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:3073: finishing rollback tid 1 to smithi084102331-44 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:3073: finishing rollback tid 2 to smithi084102331-44 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1540 (ObjNum 625 snap 0 seq_num 2817838183) dirty exists 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:3072: finishing write tid 5 to smithi084102331-7 2024-01-13T18:10:54.729 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1334 (ObjNum 945 snap 299 seq_num 945) dirty exists 2024-01-13T18:10:54.730 INFO:tasks.rados.rados.0.smithi084.stdout:3072: left oid 7 (ObjNum 945 snap 299 seq_num 945) 2024-01-13T18:10:54.730 INFO:tasks.rados.rados.0.smithi084.stdout:3074: finishing write tid 1 to smithi084102331-42 2024-01-13T18:10:54.730 INFO:tasks.rados.rados.0.smithi084.stdout:3072: done (3 left) 2024-01-13T18:10:54.730 INFO:tasks.rados.rados.0.smithi084.stdout:3073: done (2 left) 2024-01-13T18:10:54.730 INFO:tasks.rados.rados.0.smithi084.stdout:3076: read oid 14 snap -1 2024-01-13T18:10:54.730 INFO:tasks.rados.rados.0.smithi084.stdout:3076: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:54.730 INFO:tasks.rados.rados.0.smithi084.stdout:3077: read oid 25 snap -1 2024-01-13T18:10:54.730 INFO:tasks.rados.rados.0.smithi084.stdout:3077: expect (ObjNum 917 snap 284 seq_num 917) 2024-01-13T18:10:54.730 INFO:tasks.rados.rados.0.smithi084.stdout:3078: snap_remove snap 298 2024-01-13T18:10:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:54 smithi099 ceph-mon[138788]: osdmap e672: 8 total, 8 up, 8 in 2024-01-13T18:10:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:54 smithi099 ceph-mon[138788]: pgmap v720: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 125 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 4.9 MiB/s wr, 35 op/s 2024-01-13T18:10:55.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:54 smithi084 ceph-mon[116404]: osdmap e672: 8 total, 8 up, 8 in 2024-01-13T18:10:55.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:54 smithi084 ceph-mon[116404]: pgmap v720: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 125 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 4.9 MiB/s wr, 35 op/s 2024-01-13T18:10:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:54 smithi084 ceph-mon[119097]: osdmap e672: 8 total, 8 up, 8 in 2024-01-13T18:10:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:54 smithi084 ceph-mon[119097]: pgmap v720: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 125 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 4.9 MiB/s wr, 35 op/s 2024-01-13T18:10:55.718 INFO:tasks.rados.rados.0.smithi084.stdout:3078: done (4 left) 2024-01-13T18:10:55.718 INFO:tasks.rados.rados.0.smithi084.stdout:3079: snap_create 2024-01-13T18:10:55.718 INFO:tasks.rados.rados.0.smithi084.stdout:3076: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:10:55.719 INFO:tasks.rados.rados.0.smithi084.stdout:3074: finishing write tid 2 to smithi084102331-42 2024-01-13T18:10:55.719 INFO:tasks.rados.rados.0.smithi084.stdout:3074: finishing write tid 3 to smithi084102331-42 2024-01-13T18:10:55.719 INFO:tasks.rados.rados.0.smithi084.stdout:3074: finishing write tid 4 to smithi084102331-42 2024-01-13T18:10:55.719 INFO:tasks.rados.rados.0.smithi084.stdout:3075: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:10:55.719 INFO:tasks.rados.rados.0.smithi084.stdout:3074: finishing write tid 5 to smithi084102331-42 2024-01-13T18:10:55.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1109 (ObjNum 946 snap 299 seq_num 946) dirty exists 2024-01-13T18:10:55.719 INFO:tasks.rados.rados.0.smithi084.stdout:3074: left oid 42 (ObjNum 946 snap 299 seq_num 946) 2024-01-13T18:10:55.719 INFO:tasks.rados.rados.0.smithi084.stdout:3075: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:10:55.719 INFO:tasks.rados.rados.0.smithi084.stdout:3075: finishing rollback tid 2 to smithi084102331-9 2024-01-13T18:10:55.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1336 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:10:55.719 INFO:tasks.rados.rados.0.smithi084.stdout:3077: expect (ObjNum 917 snap 284 seq_num 917) 2024-01-13T18:10:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:55 smithi099 ceph-mon[138788]: osdmap e673: 8 total, 8 up, 8 in 2024-01-13T18:10:56.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:55 smithi084 ceph-mon[116404]: osdmap e673: 8 total, 8 up, 8 in 2024-01-13T18:10:56.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:55 smithi084 ceph-mon[119097]: osdmap e673: 8 total, 8 up, 8 in 2024-01-13T18:10:56.721 INFO:tasks.rados.rados.0.smithi084.stdout:3074: done (4 left) 2024-01-13T18:10:56.722 INFO:tasks.rados.rados.0.smithi084.stdout:3075: done (3 left) 2024-01-13T18:10:56.722 INFO:tasks.rados.rados.0.smithi084.stdout:3076: done (2 left) 2024-01-13T18:10:56.722 INFO:tasks.rados.rados.0.smithi084.stdout:3077: done (1 left) 2024-01-13T18:10:56.722 INFO:tasks.rados.rados.0.smithi084.stdout:3079: done (0 left) 2024-01-13T18:10:56.722 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 300 2024-01-13T18:10:56.722 INFO:tasks.rados.rados.0.smithi084.stdout:3080: seq_num 947 ranges {5578752=663552,6242304=630784,6873088=172032} 2024-01-13T18:10:56.754 INFO:tasks.rados.rados.0.smithi084.stdout:3080: writing smithi084102331-34 from 5578752 to 6242304 tid 1 2024-01-13T18:10:56.758 INFO:tasks.rados.rados.0.smithi084.stdout:3080: writing smithi084102331-34 from 6242304 to 6873088 tid 2 2024-01-13T18:10:56.759 INFO:tasks.rados.rados.0.smithi084.stdout:3080: writing smithi084102331-34 from 6873088 to 7045120 tid 3 2024-01-13T18:10:56.759 INFO:tasks.rados.rados.0.smithi084.stdout:3081: setattr oid 41 current snap is 300 2024-01-13T18:10:56.763 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 300 2024-01-13T18:10:56.763 INFO:tasks.rados.rados.0.smithi084.stdout:3082: seq_num 948 ranges {1867776=679936,2547712=516096,3063808=286720} 2024-01-13T18:10:56.776 INFO:tasks.rados.rados.0.smithi084.stdout:3082: writing smithi084102331-40 from 1867776 to 2547712 tid 1 2024-01-13T18:10:56.780 INFO:tasks.rados.rados.0.smithi084.stdout:3082: writing smithi084102331-40 from 2547712 to 3063808 tid 2 2024-01-13T18:10:56.782 INFO:tasks.rados.rados.0.smithi084.stdout:3082: writing smithi084102331-40 from 3063808 to 3350528 tid 3 2024-01-13T18:10:56.782 INFO:tasks.rados.rados.0.smithi084.stdout:3083: read oid 47 snap 299 2024-01-13T18:10:56.782 INFO:tasks.rados.rados.0.smithi084.stdout:3083: expect deleted 2024-01-13T18:10:56.782 INFO:tasks.rados.rados.0.smithi084.stdout:3084: read oid 12 snap -1 2024-01-13T18:10:56.782 INFO:tasks.rados.rados.0.smithi084.stdout:3084: expect (ObjNum 873 snap 277 seq_num 873) 2024-01-13T18:10:56.782 INFO:tasks.rados.rados.0.smithi084.stdout:3085: snap_remove snap 297 2024-01-13T18:10:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:56 smithi099 ceph-mon[138788]: osdmap e674: 8 total, 8 up, 8 in 2024-01-13T18:10:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:56 smithi099 ceph-mon[138788]: pgmap v723: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 125 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-01-13T18:10:57.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:56 smithi084 ceph-mon[116404]: osdmap e674: 8 total, 8 up, 8 in 2024-01-13T18:10:57.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:56 smithi084 ceph-mon[116404]: pgmap v723: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 125 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-01-13T18:10:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:56 smithi084 ceph-mon[119097]: osdmap e674: 8 total, 8 up, 8 in 2024-01-13T18:10:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:56 smithi084 ceph-mon[119097]: pgmap v723: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 125 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 6.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-01-13T18:10:57.705 INFO:tasks.rados.rados.0.smithi084.stdout:3085: done (5 left) 2024-01-13T18:10:57.705 INFO:tasks.rados.rados.0.smithi084.stdout:3086: rollback oid 24 current snap is 300 2024-01-13T18:10:57.705 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 299 2024-01-13T18:10:57.705 INFO:tasks.rados.rados.0.smithi084.stdout:3080: finishing write tid 1 to smithi084102331-34 2024-01-13T18:10:57.706 INFO:tasks.rados.rados.0.smithi084.stdout:3080: finishing write tid 2 to smithi084102331-34 2024-01-13T18:10:57.706 INFO:tasks.rados.rados.0.smithi084.stdout:3080: finishing write tid 3 to smithi084102331-34 2024-01-13T18:10:57.706 INFO:tasks.rados.rados.0.smithi084.stdout:3080: finishing write tid 4 to smithi084102331-34 2024-01-13T18:10:57.706 INFO:tasks.rados.rados.0.smithi084.stdout:3080: finishing write tid 5 to smithi084102331-34 2024-01-13T18:10:57.706 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 1340 (ObjNum 947 snap 300 seq_num 947) dirty exists 2024-01-13T18:10:57.706 INFO:tasks.rados.rados.0.smithi084.stdout:3080: left oid 34 (ObjNum 947 snap 300 seq_num 947) 2024-01-13T18:10:57.706 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1349 (ObjNum 939 snap 296 seq_num 939) dirty exists 2024-01-13T18:10:57.706 INFO:tasks.rados.rados.0.smithi084.stdout:3082: finishing write tid 1 to smithi084102331-40 2024-01-13T18:10:57.711 INFO:tasks.rados.rados.0.smithi084.stdout:3082: finishing write tid 2 to smithi084102331-40 2024-01-13T18:10:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:3082: finishing write tid 3 to smithi084102331-40 2024-01-13T18:10:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:3082: finishing write tid 4 to smithi084102331-40 2024-01-13T18:10:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:3082: finishing write tid 5 to smithi084102331-40 2024-01-13T18:10:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1350 (ObjNum 948 snap 300 seq_num 948) dirty exists 2024-01-13T18:10:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:3082: left oid 40 (ObjNum 948 snap 300 seq_num 948) 2024-01-13T18:10:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:3084: expect (ObjNum 873 snap 277 seq_num 873) 2024-01-13T18:10:57.876 INFO:tasks.rados.rados.0.smithi084.stdout:3086: finishing rollback tid 0 to smithi084102331-24 2024-01-13T18:10:57.876 INFO:tasks.rados.rados.0.smithi084.stdout:3086: finishing rollback tid 1 to smithi084102331-24 2024-01-13T18:10:57.876 INFO:tasks.rados.rados.0.smithi084.stdout:3086: finishing rollback tid 2 to smithi084102331-24 2024-01-13T18:10:57.876 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1337 (ObjNum 879 snap 279 seq_num 879) dirty exists 2024-01-13T18:10:57.876 INFO:tasks.rados.rados.0.smithi084.stdout:3080: done (5 left) 2024-01-13T18:10:57.876 INFO:tasks.rados.rados.0.smithi084.stdout:3081: done (4 left) 2024-01-13T18:10:57.876 INFO:tasks.rados.rados.0.smithi084.stdout:3082: done (3 left) 2024-01-13T18:10:57.876 INFO:tasks.rados.rados.0.smithi084.stdout:3083: done (2 left) 2024-01-13T18:10:57.876 INFO:tasks.rados.rados.0.smithi084.stdout:3084: done (1 left) 2024-01-13T18:10:57.877 INFO:tasks.rados.rados.0.smithi084.stdout:3086: done (0 left) 2024-01-13T18:10:57.877 INFO:tasks.rados.rados.0.smithi084.stdout:3087: read oid 13 snap -1 2024-01-13T18:10:57.877 INFO:tasks.rados.rados.0.smithi084.stdout:3087: expect (ObjNum 930 snap 295 seq_num 930) 2024-01-13T18:10:57.877 INFO:tasks.rados.rados.0.smithi084.stdout:3088: read oid 35 snap -1 2024-01-13T18:10:57.877 INFO:tasks.rados.rados.0.smithi084.stdout:3088: expect (ObjNum 914 snap 283 seq_num 914) 2024-01-13T18:10:57.877 INFO:tasks.rados.rados.0.smithi084.stdout:3089: rollback oid 10 current snap is 300 2024-01-13T18:10:57.877 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 299 2024-01-13T18:10:57.877 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 300 2024-01-13T18:10:57.877 INFO:tasks.rados.rados.0.smithi084.stdout:3090: seq_num 949 ranges {3039232=704512,3743744=794624,4538368=8192} 2024-01-13T18:10:57.896 INFO:tasks.rados.rados.0.smithi084.stdout:3090: writing smithi084102331-33 from 3039232 to 3743744 tid 1 2024-01-13T18:10:57.901 INFO:tasks.rados.rados.0.smithi084.stdout:3090: writing smithi084102331-33 from 3743744 to 4538368 tid 2 2024-01-13T18:10:57.901 INFO:tasks.rados.rados.0.smithi084.stdout:3090: writing smithi084102331-33 from 4538368 to 4546560 tid 3 2024-01-13T18:10:57.901 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 300 2024-01-13T18:10:57.901 INFO:tasks.rados.rados.0.smithi084.stdout:3089: finishing rollback tid 0 to smithi084102331-10 2024-01-13T18:10:57.901 INFO:tasks.rados.rados.0.smithi084.stdout:3089: finishing rollback tid 1 to smithi084102331-10 2024-01-13T18:10:57.901 INFO:tasks.rados.rados.0.smithi084.stdout:3089: finishing rollback tid 2 to smithi084102331-10 2024-01-13T18:10:57.901 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1407 (ObjNum 936 snap 296 seq_num 936) dirty exists 2024-01-13T18:10:57.901 INFO:tasks.rados.rados.0.smithi084.stdout:3088: expect (ObjNum 914 snap 283 seq_num 914) 2024-01-13T18:10:57.926 INFO:tasks.rados.rados.0.smithi084.stdout:3087: expect (ObjNum 930 snap 295 seq_num 930) 2024-01-13T18:10:58.084 INFO:tasks.rados.rados.0.smithi084.stdout:3090: finishing write tid 1 to smithi084102331-33 2024-01-13T18:10:58.084 INFO:tasks.rados.rados.0.smithi084.stdout:3090: finishing write tid 2 to smithi084102331-33 2024-01-13T18:10:58.084 INFO:tasks.rados.rados.0.smithi084.stdout:3090: finishing write tid 3 to smithi084102331-33 2024-01-13T18:10:58.084 INFO:tasks.rados.rados.0.smithi084.stdout:3090: finishing write tid 4 to smithi084102331-33 2024-01-13T18:10:58.084 INFO:tasks.rados.rados.0.smithi084.stdout:3090: finishing write tid 5 to smithi084102331-33 2024-01-13T18:10:58.084 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1412 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:10:58.084 INFO:tasks.rados.rados.0.smithi084.stdout:3090: left oid 33 (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:10:58.084 INFO:tasks.rados.rados.0.smithi084.stdout:3091: seq_num 950 ranges {0=720896,720896=679936,1400832=122880} 2024-01-13T18:10:58.087 INFO:tasks.rados.rados.0.smithi084.stdout:3091: writing smithi084102331-47 from 0 to 720896 tid 1 2024-01-13T18:10:58.091 INFO:tasks.rados.rados.0.smithi084.stdout:3091: writing smithi084102331-47 from 720896 to 1400832 tid 2 2024-01-13T18:10:58.093 INFO:tasks.rados.rados.0.smithi084.stdout:3091: writing smithi084102331-47 from 1400832 to 1523712 tid 3 2024-01-13T18:10:58.093 INFO:tasks.rados.rados.0.smithi084.stdout:3087: done (4 left) 2024-01-13T18:10:58.093 INFO:tasks.rados.rados.0.smithi084.stdout:3088: done (3 left) 2024-01-13T18:10:58.093 INFO:tasks.rados.rados.0.smithi084.stdout:3089: done (2 left) 2024-01-13T18:10:58.093 INFO:tasks.rados.rados.0.smithi084.stdout:3090: done (1 left) 2024-01-13T18:10:58.093 INFO:tasks.rados.rados.0.smithi084.stdout:3092: rmattr oid 48 current snap is 300 2024-01-13T18:10:58.093 INFO:tasks.rados.rados.0.smithi084.stdout:3092: done (1 left) 2024-01-13T18:10:58.094 INFO:tasks.rados.rados.0.smithi084.stdout:3093: snap_remove snap 299 2024-01-13T18:10:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:57 smithi099 ceph-mon[138788]: osdmap e675: 8 total, 8 up, 8 in 2024-01-13T18:10:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:57 smithi099 ceph-mon[138788]: osdmap e676: 8 total, 8 up, 8 in 2024-01-13T18:10:58.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:57 smithi084 ceph-mon[116404]: osdmap e675: 8 total, 8 up, 8 in 2024-01-13T18:10:58.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:57 smithi084 ceph-mon[116404]: osdmap e676: 8 total, 8 up, 8 in 2024-01-13T18:10:58.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:57 smithi084 ceph-mon[119097]: osdmap e675: 8 total, 8 up, 8 in 2024-01-13T18:10:58.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:57 smithi084 ceph-mon[119097]: osdmap e676: 8 total, 8 up, 8 in 2024-01-13T18:10:58.739 INFO:tasks.rados.rados.0.smithi084.stdout:3093: done (1 left) 2024-01-13T18:10:58.740 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 300 2024-01-13T18:10:58.740 INFO:tasks.rados.rados.0.smithi084.stdout:3091: finishing write tid 1 to smithi084102331-47 2024-01-13T18:10:58.740 INFO:tasks.rados.rados.0.smithi084.stdout:3091: finishing write tid 2 to smithi084102331-47 2024-01-13T18:10:58.740 INFO:tasks.rados.rados.0.smithi084.stdout:3091: finishing write tid 3 to smithi084102331-47 2024-01-13T18:10:58.740 INFO:tasks.rados.rados.0.smithi084.stdout:3091: finishing write tid 4 to smithi084102331-47 2024-01-13T18:10:58.740 INFO:tasks.rados.rados.0.smithi084.stdout:3091: finishing write tid 5 to smithi084102331-47 2024-01-13T18:10:58.740 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1544 (ObjNum 950 snap 300 seq_num 950) dirty exists 2024-01-13T18:10:58.740 INFO:tasks.rados.rados.0.smithi084.stdout:3091: left oid 47 (ObjNum 950 snap 300 seq_num 950) 2024-01-13T18:10:58.740 INFO:tasks.rados.rados.0.smithi084.stdout:3094: seq_num 951 ranges {966656=737280,1703936=614400,2318336=188416} 2024-01-13T18:10:58.749 INFO:tasks.rados.rados.0.smithi084.stdout:3094: writing smithi084102331-25 from 966656 to 1703936 tid 1 2024-01-13T18:10:58.753 INFO:tasks.rados.rados.0.smithi084.stdout:3094: writing smithi084102331-25 from 1703936 to 2318336 tid 2 2024-01-13T18:10:58.754 INFO:tasks.rados.rados.0.smithi084.stdout:3094: writing smithi084102331-25 from 2318336 to 2506752 tid 3 2024-01-13T18:10:58.754 INFO:tasks.rados.rados.0.smithi084.stdout:3091: done (1 left) 2024-01-13T18:10:58.754 INFO:tasks.rados.rados.0.smithi084.stdout:3095: read oid 37 snap -1 2024-01-13T18:10:58.754 INFO:tasks.rados.rados.0.smithi084.stdout:3095: expect (ObjNum 942 snap 298 seq_num 942) 2024-01-13T18:10:58.755 INFO:tasks.rados.rados.0.smithi084.stdout:3096: rollback oid 23 current snap is 300 2024-01-13T18:10:58.755 INFO:tasks.rados.rados.0.smithi084.stdout:3096: done (2 left) 2024-01-13T18:10:58.755 INFO:tasks.rados.rados.0.smithi084.stdout:3097: snap_create 2024-01-13T18:10:58.756 INFO:tasks.rados.rados.0.smithi084.stdout:3094: finishing write tid 1 to smithi084102331-25 2024-01-13T18:10:58.758 INFO:tasks.rados.rados.0.smithi084.stdout:3094: finishing write tid 2 to smithi084102331-25 2024-01-13T18:10:58.758 INFO:tasks.rados.rados.0.smithi084.stdout:3094: finishing write tid 3 to smithi084102331-25 2024-01-13T18:10:58.759 INFO:tasks.rados.rados.0.smithi084.stdout:3094: finishing write tid 4 to smithi084102331-25 2024-01-13T18:10:58.764 INFO:tasks.rados.rados.0.smithi084.stdout:3094: finishing write tid 5 to smithi084102331-25 2024-01-13T18:10:58.764 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1418 (ObjNum 951 snap 300 seq_num 951) dirty exists 2024-01-13T18:10:58.764 INFO:tasks.rados.rados.0.smithi084.stdout:3094: left oid 25 (ObjNum 951 snap 300 seq_num 951) 2024-01-13T18:10:58.767 INFO:tasks.rados.rados.0.smithi084.stdout:3095: expect (ObjNum 942 snap 298 seq_num 942) 2024-01-13T18:10:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:58 smithi099 ceph-mon[138788]: pgmap v726: 121 pgs: 121 active+clean; 124 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 26 op/s 2024-01-13T18:10:59.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:58 smithi084 ceph-mon[116404]: pgmap v726: 121 pgs: 121 active+clean; 124 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 26 op/s 2024-01-13T18:10:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:58 smithi084 ceph-mon[119097]: pgmap v726: 121 pgs: 121 active+clean; 124 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 26 op/s 2024-01-13T18:10:59.741 INFO:tasks.rados.rados.0.smithi084.stdout:3094: done (2 left) 2024-01-13T18:10:59.741 INFO:tasks.rados.rados.0.smithi084.stdout:3095: done (1 left) 2024-01-13T18:10:59.742 INFO:tasks.rados.rados.0.smithi084.stdout:3097: done (0 left) 2024-01-13T18:10:59.742 INFO:tasks.rados.rados.0.smithi084.stdout:3098: read oid 13 snap -1 2024-01-13T18:10:59.742 INFO:tasks.rados.rados.0.smithi084.stdout:3098: expect (ObjNum 930 snap 295 seq_num 930) 2024-01-13T18:10:59.742 INFO:tasks.rados.rados.0.smithi084.stdout:3099: rmattr oid 10 current snap is 301 2024-01-13T18:10:59.742 INFO:tasks.rados.rados.0.smithi084.stdout:3099: done (1 left) 2024-01-13T18:10:59.742 INFO:tasks.rados.rados.0.smithi084.stdout:3100: snap_remove snap 300 2024-01-13T18:11:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:10:59 smithi099 ceph-mon[138788]: osdmap e677: 8 total, 8 up, 8 in 2024-01-13T18:11:00.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:10:59 smithi084 ceph-mon[116404]: osdmap e677: 8 total, 8 up, 8 in 2024-01-13T18:11:00.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:10:59 smithi084 ceph-mon[119097]: osdmap e677: 8 total, 8 up, 8 in 2024-01-13T18:11:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:11:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:11:00] "GET /metrics HTTP/1.1" 200 36190 "" "Prometheus/2.43.0" 2024-01-13T18:11:00.749 INFO:tasks.rados.rados.0.smithi084.stdout:3100: done (1 left) 2024-01-13T18:11:00.749 INFO:tasks.rados.rados.0.smithi084.stdout:3101: rollback oid 27 current snap is 301 2024-01-13T18:11:00.749 INFO:tasks.rados.rados.0.smithi084.stdout:3101: done (1 left) 2024-01-13T18:11:00.749 INFO:tasks.rados.rados.0.smithi084.stdout:3102: read oid 8 snap -1 2024-01-13T18:11:00.750 INFO:tasks.rados.rados.0.smithi084.stdout:3102: expect (ObjNum 918 snap 285 seq_num 918) 2024-01-13T18:11:00.750 INFO:tasks.rados.rados.0.smithi084.stdout:3103: rmattr oid 44 current snap is 301 2024-01-13T18:11:00.750 INFO:tasks.rados.rados.0.smithi084.stdout:3098: expect (ObjNum 930 snap 295 seq_num 930) 2024-01-13T18:11:00.912 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1545 (ObjNum 49 snap 0 seq_num 1953066355) dirty exists 2024-01-13T18:11:00.912 INFO:tasks.rados.rados.0.smithi084.stdout:3102: expect (ObjNum 918 snap 285 seq_num 918) 2024-01-13T18:11:00.970 INFO:tasks.rados.rados.0.smithi084.stdout:3098: done (2 left) 2024-01-13T18:11:00.970 INFO:tasks.rados.rados.0.smithi084.stdout:3102: done (1 left) 2024-01-13T18:11:00.970 INFO:tasks.rados.rados.0.smithi084.stdout:3103: done (0 left) 2024-01-13T18:11:00.970 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 301 2024-01-13T18:11:00.970 INFO:tasks.rados.rados.0.smithi084.stdout:3104: seq_num 952 ranges {1867776=753664,2621440=499712,3121152=303104} 2024-01-13T18:11:00.983 INFO:tasks.rados.rados.0.smithi084.stdout:3104: writing smithi084102331-8 from 1867776 to 2621440 tid 1 2024-01-13T18:11:00.986 INFO:tasks.rados.rados.0.smithi084.stdout:3104: writing smithi084102331-8 from 2621440 to 3121152 tid 2 2024-01-13T18:11:00.988 INFO:tasks.rados.rados.0.smithi084.stdout:3104: writing smithi084102331-8 from 3121152 to 3424256 tid 3 2024-01-13T18:11:00.988 INFO:tasks.rados.rados.0.smithi084.stdout:3105: rmattr oid 43 current snap is 301 2024-01-13T18:11:00.989 INFO:tasks.rados.rados.0.smithi084.stdout:3105: done (1 left) 2024-01-13T18:11:00.989 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 301 2024-01-13T18:11:00.989 INFO:tasks.rados.rados.0.smithi084.stdout:3106: seq_num 953 ranges {3514368=770048,4284416=786432,5070848=16384} 2024-01-13T18:11:01.011 INFO:tasks.rados.rados.0.smithi084.stdout:3106: writing smithi084102331-12 from 3514368 to 4284416 tid 1 2024-01-13T18:11:01.015 INFO:tasks.rados.rados.0.smithi084.stdout:3106: writing smithi084102331-12 from 4284416 to 5070848 tid 2 2024-01-13T18:11:01.016 INFO:tasks.rados.rados.0.smithi084.stdout:3106: writing smithi084102331-12 from 5070848 to 5087232 tid 3 2024-01-13T18:11:01.016 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 301 2024-01-13T18:11:01.016 INFO:tasks.rados.rados.0.smithi084.stdout:3107: seq_num 954 ranges {0=786432,786432=671744,1458176=131072} 2024-01-13T18:11:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:3107: writing smithi084102331-23 from 0 to 786432 tid 1 2024-01-13T18:11:01.023 INFO:tasks.rados.rados.0.smithi084.stdout:3107: writing smithi084102331-23 from 786432 to 1458176 tid 2 2024-01-13T18:11:01.024 INFO:tasks.rados.rados.0.smithi084.stdout:3107: writing smithi084102331-23 from 1458176 to 1589248 tid 3 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3108: delete oid 14 current snap is 301 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3104: finishing write tid 1 to smithi084102331-8 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3104: finishing write tid 2 to smithi084102331-8 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3104: finishing write tid 3 to smithi084102331-8 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3104: finishing write tid 4 to smithi084102331-8 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3104: finishing write tid 5 to smithi084102331-8 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1549 (ObjNum 952 snap 301 seq_num 952) dirty exists 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3104: left oid 8 (ObjNum 952 snap 301 seq_num 952) 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3106: finishing write tid 1 to smithi084102331-12 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3106: finishing write tid 2 to smithi084102331-12 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3106: finishing write tid 3 to smithi084102331-12 2024-01-13T18:11:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3106: finishing write tid 4 to smithi084102331-12 2024-01-13T18:11:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:3106: finishing write tid 5 to smithi084102331-12 2024-01-13T18:11:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1657 (ObjNum 953 snap 301 seq_num 953) dirty exists 2024-01-13T18:11:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:3106: left oid 12 (ObjNum 953 snap 301 seq_num 953) 2024-01-13T18:11:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:3104: done (3 left) 2024-01-13T18:11:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:3106: done (2 left) 2024-01-13T18:11:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:3108: done (1 left) 2024-01-13T18:11:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:3109: read oid 9 snap -1 2024-01-13T18:11:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:3109: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:11:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:3110: rollback oid 38 current snap is 301 2024-01-13T18:11:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:3110: done (2 left) 2024-01-13T18:11:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:3111: delete oid 16 current snap is 301 2024-01-13T18:11:01.028 INFO:tasks.rados.rados.0.smithi084.stdout:3109: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:11:01.032 INFO:tasks.rados.rados.0.smithi084.stdout:3107: finishing write tid 1 to smithi084102331-23 2024-01-13T18:11:01.032 INFO:tasks.rados.rados.0.smithi084.stdout:3107: finishing write tid 2 to smithi084102331-23 2024-01-13T18:11:01.032 INFO:tasks.rados.rados.0.smithi084.stdout:3107: finishing write tid 3 to smithi084102331-23 2024-01-13T18:11:01.032 INFO:tasks.rados.rados.0.smithi084.stdout:3109: done (2 left) 2024-01-13T18:11:01.032 INFO:tasks.rados.rados.0.smithi084.stdout:3111: done (1 left) 2024-01-13T18:11:01.032 INFO:tasks.rados.rados.0.smithi084.stdout:3112: rmattr oid 36 current snap is 301 2024-01-13T18:11:01.032 INFO:tasks.rados.rados.0.smithi084.stdout:3107: finishing write tid 4 to smithi084102331-23 2024-01-13T18:11:01.033 INFO:tasks.rados.rados.0.smithi084.stdout:3113: rmattr oid 3 current snap is 301 2024-01-13T18:11:01.033 INFO:tasks.rados.rados.0.smithi084.stdout:3114: copy_from oid 12 from oid 42 current snap is 301 2024-01-13T18:11:01.033 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 301 2024-01-13T18:11:01.033 INFO:tasks.rados.rados.0.smithi084.stdout:3115: seq_num 957 ranges {2326528=434176,2760704=720896,3481600=483328} 2024-01-13T18:11:01.047 INFO:tasks.rados.rados.0.smithi084.stdout:3115: writing smithi084102331-20 from 2326528 to 2760704 tid 1 2024-01-13T18:11:01.051 INFO:tasks.rados.rados.0.smithi084.stdout:3115: writing smithi084102331-20 from 2760704 to 3481600 tid 2 2024-01-13T18:11:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:3115: writing smithi084102331-20 from 3481600 to 3964928 tid 3 2024-01-13T18:11:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:3116: read oid 35 snap -1 2024-01-13T18:11:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:3116: expect (ObjNum 914 snap 283 seq_num 914) 2024-01-13T18:11:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:3117: delete oid 50 current snap is 301 2024-01-13T18:11:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:3107: finishing write tid 5 to smithi084102331-23 2024-01-13T18:11:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1661 (ObjNum 954 snap 301 seq_num 954) dirty exists 2024-01-13T18:11:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:3107: left oid 23 (ObjNum 954 snap 301 seq_num 954) 2024-01-13T18:11:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1587 (ObjNum 937 snap 296 seq_num 937) dirty exists 2024-01-13T18:11:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1448 (ObjNum 129 snap 0 seq_num 4037738296) dirty exists 2024-01-13T18:11:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:3114: finishing copy_from to smithi084102331-12 2024-01-13T18:11:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1109 (ObjNum 946 snap 299 seq_num 946) dirty exists 2024-01-13T18:11:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:3114: finishing copy_from racing read to smithi084102331-12 2024-01-13T18:11:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:3115: finishing write tid 1 to smithi084102331-20 2024-01-13T18:11:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:3115: finishing write tid 2 to smithi084102331-20 2024-01-13T18:11:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:3107: done (6 left) 2024-01-13T18:11:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:3112: done (5 left) 2024-01-13T18:11:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:3113: done (4 left) 2024-01-13T18:11:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:3114: done (3 left) 2024-01-13T18:11:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:3117: done (2 left) 2024-01-13T18:11:01.057 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 301 2024-01-13T18:11:01.057 INFO:tasks.rados.rados.0.smithi084.stdout:3118: seq_num 959 ranges {7700480=466944,8167424=540672,8708096=557056,9265152=106496} 2024-01-13T18:11:01.100 INFO:tasks.rados.rados.0.smithi084.stdout:3118: writing smithi084102331-41 from 7700480 to 8167424 tid 1 2024-01-13T18:11:01.103 INFO:tasks.rados.rados.0.smithi084.stdout:3118: writing smithi084102331-41 from 8167424 to 8708096 tid 2 2024-01-13T18:11:01.106 INFO:tasks.rados.rados.0.smithi084.stdout:3118: writing smithi084102331-41 from 8708096 to 9265152 tid 3 2024-01-13T18:11:01.107 INFO:tasks.rados.rados.0.smithi084.stdout:3118: writing smithi084102331-41 from 9265152 to 9371648 tid 4 2024-01-13T18:11:01.107 INFO:tasks.rados.rados.0.smithi084.stdout:3119: copy_from oid 36 from oid 28 current snap is 301 2024-01-13T18:11:01.107 INFO:tasks.rados.rados.0.smithi084.stdout:3116: expect (ObjNum 914 snap 283 seq_num 914) 2024-01-13T18:11:01.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:00 smithi099 ceph-mon[138788]: osdmap e678: 8 total, 8 up, 8 in 2024-01-13T18:11:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:00 smithi099 ceph-mon[138788]: pgmap v729: 121 pgs: 121 active+clean; 127 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 24 op/s 2024-01-13T18:11:01.135 INFO:tasks.rados.rados.0.smithi084.stdout:3115: finishing write tid 3 to smithi084102331-20 2024-01-13T18:11:01.135 INFO:tasks.rados.rados.0.smithi084.stdout:3115: finishing write tid 4 to smithi084102331-20 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3115: finishing write tid 5 to smithi084102331-20 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1293 (ObjNum 957 snap 301 seq_num 957) dirty exists 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3115: left oid 20 (ObjNum 957 snap 301 seq_num 957) 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3118: finishing write tid 1 to smithi084102331-41 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3118: finishing write tid 2 to smithi084102331-41 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3115: done (3 left) 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3116: done (2 left) 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3120: copy_from oid 38 from oid 7 current snap is 301 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3118: finishing write tid 3 to smithi084102331-41 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3118: finishing write tid 4 to smithi084102331-41 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3118: finishing write tid 5 to smithi084102331-41 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3118: finishing write tid 6 to smithi084102331-41 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1354 (ObjNum 959 snap 301 seq_num 959) dirty exists 2024-01-13T18:11:01.136 INFO:tasks.rados.rados.0.smithi084.stdout:3118: left oid 41 (ObjNum 959 snap 301 seq_num 959) 2024-01-13T18:11:01.137 INFO:tasks.rados.rados.0.smithi084.stdout:3119: finishing copy_from to smithi084102331-36 2024-01-13T18:11:01.137 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1485 (ObjNum 908 snap 282 seq_num 908) dirty exists 2024-01-13T18:11:01.137 INFO:tasks.rados.rados.0.smithi084.stdout:3119: finishing copy_from racing read to smithi084102331-36 2024-01-13T18:11:01.137 INFO:tasks.rados.rados.0.smithi084.stdout:3118: done (2 left) 2024-01-13T18:11:01.137 INFO:tasks.rados.rados.0.smithi084.stdout:3119: done (1 left) 2024-01-13T18:11:01.137 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 301 2024-01-13T18:11:01.137 INFO:tasks.rados.rados.0.smithi084.stdout:3121: seq_num 960 ranges {794624=483328,1277952=425984,1703936=761856,2465792=16384} 2024-01-13T18:11:01.142 INFO:tasks.rados.rados.0.smithi084.stdout:3121: writing smithi084102331-18 from 794624 to 1277952 tid 1 2024-01-13T18:11:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:3121: writing smithi084102331-18 from 1277952 to 1703936 tid 2 2024-01-13T18:11:01.149 INFO:tasks.rados.rados.0.smithi084.stdout:3121: writing smithi084102331-18 from 1703936 to 2465792 tid 3 2024-01-13T18:11:01.150 INFO:tasks.rados.rados.0.smithi084.stdout:3121: writing smithi084102331-18 from 2465792 to 2482176 tid 4 2024-01-13T18:11:01.150 INFO:tasks.rados.rados.0.smithi084.stdout:3122: delete oid 10 current snap is 301 2024-01-13T18:11:01.150 INFO:tasks.rados.rados.0.smithi084.stdout:3120: finishing copy_from to smithi084102331-38 2024-01-13T18:11:01.150 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1334 (ObjNum 945 snap 299 seq_num 945) dirty exists 2024-01-13T18:11:01.150 INFO:tasks.rados.rados.0.smithi084.stdout:3120: finishing copy_from racing read to smithi084102331-38 2024-01-13T18:11:01.150 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 1 to smithi084102331-18 2024-01-13T18:11:01.150 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 2 to smithi084102331-18 2024-01-13T18:11:01.152 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 3 to smithi084102331-18 2024-01-13T18:11:01.152 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 4 to smithi084102331-18 2024-01-13T18:11:01.152 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 5 to smithi084102331-18 2024-01-13T18:11:01.155 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 6 to smithi084102331-18 2024-01-13T18:11:01.155 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1412 (ObjNum 960 snap 301 seq_num 960) dirty exists 2024-01-13T18:11:01.155 INFO:tasks.rados.rados.0.smithi084.stdout:3121: left oid 18 (ObjNum 960 snap 301 seq_num 960) 2024-01-13T18:11:01.155 INFO:tasks.rados.rados.0.smithi084.stdout:3120: done (2 left) 2024-01-13T18:11:01.155 INFO:tasks.rados.rados.0.smithi084.stdout:3121: done (1 left) 2024-01-13T18:11:01.155 INFO:tasks.rados.rados.0.smithi084.stdout:3122: done (0 left) 2024-01-13T18:11:01.155 INFO:tasks.rados.rados.0.smithi084.stdout:3123: copy_from oid 18 from oid 15 current snap is 301 2024-01-13T18:11:01.155 INFO:tasks.rados.rados.0.smithi084.stdout:3124: snap_create 2024-01-13T18:11:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:00 smithi084 ceph-mon[116404]: osdmap e678: 8 total, 8 up, 8 in 2024-01-13T18:11:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:00 smithi084 ceph-mon[116404]: pgmap v729: 121 pgs: 121 active+clean; 127 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 24 op/s 2024-01-13T18:11:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:00 smithi084 ceph-mon[119097]: osdmap e678: 8 total, 8 up, 8 in 2024-01-13T18:11:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:00 smithi084 ceph-mon[119097]: pgmap v729: 121 pgs: 121 active+clean; 127 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 24 op/s 2024-01-13T18:11:01.199 INFO:tasks.rados.rados.0.smithi084.stdout:3123: finishing copy_from to smithi084102331-18 2024-01-13T18:11:01.199 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1492 (ObjNum 929 snap 294 seq_num 929) dirty exists 2024-01-13T18:11:01.200 INFO:tasks.rados.rados.0.smithi084.stdout:3123: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:11:01.753 INFO:tasks.rados.rados.0.smithi084.stdout:3123: done (1 left) 2024-01-13T18:11:01.754 INFO:tasks.rados.rados.0.smithi084.stdout:3124: done (0 left) 2024-01-13T18:11:01.754 INFO:tasks.rados.rados.0.smithi084.stdout:3125: copy_from oid 46 from oid 15 current snap is 302 2024-01-13T18:11:01.754 INFO:tasks.rados.rados.0.smithi084.stdout:3126: read oid 25 snap -1 2024-01-13T18:11:01.754 INFO:tasks.rados.rados.0.smithi084.stdout:3126: expect (ObjNum 951 snap 300 seq_num 951) 2024-01-13T18:11:01.754 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 302 2024-01-13T18:11:01.754 INFO:tasks.rados.rados.0.smithi084.stdout:3127: seq_num 962 ranges {3661824=516096,4177920=589824,4767744=614400} 2024-01-13T18:11:01.776 INFO:tasks.rados.rados.0.smithi084.stdout:3127: writing smithi084102331-45 from 3661824 to 4177920 tid 1 2024-01-13T18:11:01.780 INFO:tasks.rados.rados.0.smithi084.stdout:3127: writing smithi084102331-45 from 4177920 to 4767744 tid 2 2024-01-13T18:11:01.784 INFO:tasks.rados.rados.0.smithi084.stdout:3127: writing smithi084102331-45 from 4767744 to 5382144 tid 3 2024-01-13T18:11:01.784 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 302 2024-01-13T18:11:01.784 INFO:tasks.rados.rados.0.smithi084.stdout:3126: expect (ObjNum 951 snap 300 seq_num 951) 2024-01-13T18:11:01.866 INFO:tasks.rados.rados.0.smithi084.stdout:3127: finishing write tid 1 to smithi084102331-45 2024-01-13T18:11:01.867 INFO:tasks.rados.rados.0.smithi084.stdout:3127: finishing write tid 2 to smithi084102331-45 2024-01-13T18:11:01.867 INFO:tasks.rados.rados.0.smithi084.stdout:3128: seq_num 963 ranges {1114112=532480,1646592=475136,2121728=532480,2654208=196608} 2024-01-13T18:11:01.876 INFO:tasks.rados.rados.0.smithi084.stdout:3128: writing smithi084102331-31 from 1114112 to 1646592 tid 1 2024-01-13T18:11:01.878 INFO:tasks.rados.rados.0.smithi084.stdout:3128: writing smithi084102331-31 from 1646592 to 2121728 tid 2 2024-01-13T18:11:01.881 INFO:tasks.rados.rados.0.smithi084.stdout:3128: writing smithi084102331-31 from 2121728 to 2654208 tid 3 2024-01-13T18:11:01.884 INFO:tasks.rados.rados.0.smithi084.stdout:3128: writing smithi084102331-31 from 2654208 to 2850816 tid 4 2024-01-13T18:11:01.884 INFO:tasks.rados.rados.0.smithi084.stdout:3126: done (3 left) 2024-01-13T18:11:01.884 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 302 2024-01-13T18:11:01.884 INFO:tasks.rados.rados.0.smithi084.stdout:3127: finishing write tid 3 to smithi084102331-45 2024-01-13T18:11:01.884 INFO:tasks.rados.rados.0.smithi084.stdout:3127: finishing write tid 4 to smithi084102331-45 2024-01-13T18:11:01.884 INFO:tasks.rados.rados.0.smithi084.stdout:3127: finishing write tid 5 to smithi084102331-45 2024-01-13T18:11:01.885 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1593 (ObjNum 962 snap 302 seq_num 962) dirty exists 2024-01-13T18:11:01.885 INFO:tasks.rados.rados.0.smithi084.stdout:3127: left oid 45 (ObjNum 962 snap 302 seq_num 962) 2024-01-13T18:11:01.886 INFO:tasks.rados.rados.0.smithi084.stdout:3125: finishing copy_from to smithi084102331-46 2024-01-13T18:11:01.886 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1492 (ObjNum 929 snap 294 seq_num 929) dirty exists 2024-01-13T18:11:01.886 INFO:tasks.rados.rados.0.smithi084.stdout:3125: finishing copy_from racing read to smithi084102331-46 2024-01-13T18:11:01.886 INFO:tasks.rados.rados.0.smithi084.stdout:3128: finishing write tid 1 to smithi084102331-31 2024-01-13T18:11:01.886 INFO:tasks.rados.rados.0.smithi084.stdout:3128: finishing write tid 2 to smithi084102331-31 2024-01-13T18:11:01.886 INFO:tasks.rados.rados.0.smithi084.stdout:3129: seq_num 964 ranges {1114112=548864,1662976=761856,2424832=442368} 2024-01-13T18:11:01.893 INFO:tasks.rados.rados.0.smithi084.stdout:3129: writing smithi084102331-29 from 1114112 to 1662976 tid 1 2024-01-13T18:11:01.896 INFO:tasks.rados.rados.0.smithi084.stdout:3129: writing smithi084102331-29 from 1662976 to 2424832 tid 2 2024-01-13T18:11:01.899 INFO:tasks.rados.rados.0.smithi084.stdout:3129: writing smithi084102331-29 from 2424832 to 2867200 tid 3 2024-01-13T18:11:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3125: done (3 left) 2024-01-13T18:11:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3127: done (2 left) 2024-01-13T18:11:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3130: delete oid 48 current snap is 302 2024-01-13T18:11:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3128: finishing write tid 3 to smithi084102331-31 2024-01-13T18:11:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3128: finishing write tid 4 to smithi084102331-31 2024-01-13T18:11:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3128: finishing write tid 5 to smithi084102331-31 2024-01-13T18:11:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3128: finishing write tid 6 to smithi084102331-31 2024-01-13T18:11:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1599 (ObjNum 963 snap 302 seq_num 963) dirty exists 2024-01-13T18:11:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3128: left oid 31 (ObjNum 963 snap 302 seq_num 963) 2024-01-13T18:11:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3129: finishing write tid 1 to smithi084102331-29 2024-01-13T18:11:01.902 INFO:tasks.rados.rados.0.smithi084.stdout:3129: finishing write tid 2 to smithi084102331-29 2024-01-13T18:11:01.903 INFO:tasks.rados.rados.0.smithi084.stdout:3128: done (2 left) 2024-01-13T18:11:01.904 INFO:tasks.rados.rados.0.smithi084.stdout:3130: done (1 left) 2024-01-13T18:11:01.904 INFO:tasks.rados.rados.0.smithi084.stdout:3131: snap_create 2024-01-13T18:11:01.904 INFO:tasks.rados.rados.0.smithi084.stdout:3129: finishing write tid 3 to smithi084102331-29 2024-01-13T18:11:01.904 INFO:tasks.rados.rados.0.smithi084.stdout:3129: finishing write tid 4 to smithi084102331-29 2024-01-13T18:11:01.904 INFO:tasks.rados.rados.0.smithi084.stdout:3129: finishing write tid 5 to smithi084102331-29 2024-01-13T18:11:01.904 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1354 (ObjNum 964 snap 302 seq_num 964) dirty exists 2024-01-13T18:11:01.905 INFO:tasks.rados.rados.0.smithi084.stdout:3129: left oid 29 (ObjNum 964 snap 302 seq_num 964) 2024-01-13T18:11:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:01 smithi099 ceph-mon[138788]: osdmap e679: 8 total, 8 up, 8 in 2024-01-13T18:11:02.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:01 smithi084 ceph-mon[119097]: osdmap e679: 8 total, 8 up, 8 in 2024-01-13T18:11:02.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:01 smithi084 ceph-mon[116404]: osdmap e679: 8 total, 8 up, 8 in 2024-01-13T18:11:02.704 INFO:tasks.rados.rados.0.smithi084.stdout:3129: done (1 left) 2024-01-13T18:11:02.704 INFO:tasks.rados.rados.0.smithi084.stdout:3131: done (0 left) 2024-01-13T18:11:02.704 INFO:tasks.rados.rados.0.smithi084.stdout:3132: snap_create 2024-01-13T18:11:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:02 smithi099 ceph-mon[138788]: osdmap e680: 8 total, 8 up, 8 in 2024-01-13T18:11:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:02 smithi099 ceph-mon[138788]: pgmap v732: 121 pgs: 121 active+clean; 123 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 3.3 MiB/s wr, 22 op/s 2024-01-13T18:11:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:02 smithi099 ceph-mon[138788]: osdmap e681: 8 total, 8 up, 8 in 2024-01-13T18:11:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:02 smithi084 ceph-mon[116404]: osdmap e680: 8 total, 8 up, 8 in 2024-01-13T18:11:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:02 smithi084 ceph-mon[116404]: pgmap v732: 121 pgs: 121 active+clean; 123 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 3.3 MiB/s wr, 22 op/s 2024-01-13T18:11:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:02 smithi084 ceph-mon[116404]: osdmap e681: 8 total, 8 up, 8 in 2024-01-13T18:11:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:02 smithi084 ceph-mon[119097]: osdmap e680: 8 total, 8 up, 8 in 2024-01-13T18:11:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:02 smithi084 ceph-mon[119097]: pgmap v732: 121 pgs: 121 active+clean; 123 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 3.3 MiB/s wr, 22 op/s 2024-01-13T18:11:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:02 smithi084 ceph-mon[119097]: osdmap e681: 8 total, 8 up, 8 in 2024-01-13T18:11:03.708 INFO:tasks.rados.rados.0.smithi084.stdout:3132: done (0 left) 2024-01-13T18:11:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:3133: snap_create 2024-01-13T18:11:04.717 INFO:tasks.rados.rados.0.smithi084.stdout:3133: done (0 left) 2024-01-13T18:11:04.717 INFO:tasks.rados.rados.0.smithi084.stdout:3134: snap_create 2024-01-13T18:11:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:04 smithi099 ceph-mon[138788]: osdmap e682: 8 total, 8 up, 8 in 2024-01-13T18:11:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:04 smithi099 ceph-mon[138788]: pgmap v735: 121 pgs: 121 active+clean; 147 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 9.3 MiB/s wr, 28 op/s 2024-01-13T18:11:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:04 smithi084 ceph-mon[116404]: osdmap e682: 8 total, 8 up, 8 in 2024-01-13T18:11:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:04 smithi084 ceph-mon[116404]: pgmap v735: 121 pgs: 121 active+clean; 147 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 9.3 MiB/s wr, 28 op/s 2024-01-13T18:11:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:04 smithi084 ceph-mon[119097]: osdmap e682: 8 total, 8 up, 8 in 2024-01-13T18:11:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:04 smithi084 ceph-mon[119097]: pgmap v735: 121 pgs: 121 active+clean; 147 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 9.3 MiB/s wr, 28 op/s 2024-01-13T18:11:05.718 INFO:tasks.rados.rados.0.smithi084.stdout:3134: done (0 left) 2024-01-13T18:11:05.718 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 306 2024-01-13T18:11:05.718 INFO:tasks.rados.rados.0.smithi084.stdout:3135: seq_num 966 ranges {966656=581632,1548288=581632,2129920=622592} 2024-01-13T18:11:05.727 INFO:tasks.rados.rados.0.smithi084.stdout:3135: writing smithi084102331-17 from 966656 to 1548288 tid 1 2024-01-13T18:11:05.730 INFO:tasks.rados.rados.0.smithi084.stdout:3135: writing smithi084102331-17 from 1548288 to 2129920 tid 2 2024-01-13T18:11:05.735 INFO:tasks.rados.rados.0.smithi084.stdout:3135: writing smithi084102331-17 from 2129920 to 2752512 tid 3 2024-01-13T18:11:05.735 INFO:tasks.rados.rados.0.smithi084.stdout:3136: rollback oid 40 current snap is 306 2024-01-13T18:11:05.735 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 303 2024-01-13T18:11:05.735 INFO:tasks.rados.rados.0.smithi084.stdout:3135: finishing write tid 1 to smithi084102331-17 2024-01-13T18:11:05.735 INFO:tasks.rados.rados.0.smithi084.stdout:3137: snap_remove snap 301 2024-01-13T18:11:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:05 smithi099 ceph-mon[138788]: osdmap e683: 8 total, 8 up, 8 in 2024-01-13T18:11:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:06.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:05 smithi084 ceph-mon[116404]: osdmap e683: 8 total, 8 up, 8 in 2024-01-13T18:11:06.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:06.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:05 smithi084 ceph-mon[119097]: osdmap e683: 8 total, 8 up, 8 in 2024-01-13T18:11:06.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:06.739 INFO:tasks.rados.rados.0.smithi084.stdout:3137: done (2 left) 2024-01-13T18:11:06.739 INFO:tasks.rados.rados.0.smithi084.stdout:3138: read oid 29 snap 305 2024-01-13T18:11:06.739 INFO:tasks.rados.rados.0.smithi084.stdout:3138: expect (ObjNum 964 snap 302 seq_num 964) 2024-01-13T18:11:06.739 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 306 2024-01-13T18:11:06.739 INFO:tasks.rados.rados.0.smithi084.stdout:3139: seq_num 967 ranges {425984=598016,1024000=466944,1490944=516096,2007040=221184} 2024-01-13T18:11:06.744 INFO:tasks.rados.rados.0.smithi084.stdout:3139: writing smithi084102331-19 from 425984 to 1024000 tid 1 2024-01-13T18:11:06.747 INFO:tasks.rados.rados.0.smithi084.stdout:3139: writing smithi084102331-19 from 1024000 to 1490944 tid 2 2024-01-13T18:11:06.750 INFO:tasks.rados.rados.0.smithi084.stdout:3139: writing smithi084102331-19 from 1490944 to 2007040 tid 3 2024-01-13T18:11:06.753 INFO:tasks.rados.rados.0.smithi084.stdout:3139: writing smithi084102331-19 from 2007040 to 2228224 tid 4 2024-01-13T18:11:06.753 INFO:tasks.rados.rados.0.smithi084.stdout:3140: rollback oid 11 current snap is 306 2024-01-13T18:11:06.753 INFO:tasks.rados.rados.0.smithi084.stdout:3135: finishing write tid 2 to smithi084102331-17 2024-01-13T18:11:06.753 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 11 to 304 2024-01-13T18:11:06.753 INFO:tasks.rados.rados.0.smithi084.stdout:3135: finishing write tid 3 to smithi084102331-17 2024-01-13T18:11:06.753 INFO:tasks.rados.rados.0.smithi084.stdout:3135: finishing write tid 4 to smithi084102331-17 2024-01-13T18:11:06.753 INFO:tasks.rados.rados.0.smithi084.stdout:3135: finishing write tid 5 to smithi084102331-17 2024-01-13T18:11:06.753 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1548 (ObjNum 966 snap 306 seq_num 966) dirty exists 2024-01-13T18:11:06.753 INFO:tasks.rados.rados.0.smithi084.stdout:3135: left oid 17 (ObjNum 966 snap 306 seq_num 966) 2024-01-13T18:11:06.754 INFO:tasks.rados.rados.0.smithi084.stdout:3136: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:11:06.754 INFO:tasks.rados.rados.0.smithi084.stdout:3136: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:11:06.754 INFO:tasks.rados.rados.0.smithi084.stdout:3136: finishing rollback tid 2 to smithi084102331-40 2024-01-13T18:11:06.754 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1357 (ObjNum 948 snap 300 seq_num 948) dirty exists 2024-01-13T18:11:06.754 INFO:tasks.rados.rados.0.smithi084.stdout:3139: finishing write tid 1 to smithi084102331-19 2024-01-13T18:11:06.754 INFO:tasks.rados.rados.0.smithi084.stdout:3139: finishing write tid 2 to smithi084102331-19 2024-01-13T18:11:06.755 INFO:tasks.rados.rados.0.smithi084.stdout:3135: done (4 left) 2024-01-13T18:11:06.755 INFO:tasks.rados.rados.0.smithi084.stdout:3136: done (3 left) 2024-01-13T18:11:06.755 INFO:tasks.rados.rados.0.smithi084.stdout:3141: rollback oid 23 current snap is 306 2024-01-13T18:11:06.755 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 303 2024-01-13T18:11:06.755 INFO:tasks.rados.rados.0.smithi084.stdout:3142: snap_create 2024-01-13T18:11:06.755 INFO:tasks.rados.rados.0.smithi084.stdout:3139: finishing write tid 3 to smithi084102331-19 2024-01-13T18:11:06.756 INFO:tasks.rados.rados.0.smithi084.stdout:3138: expect (ObjNum 964 snap 302 seq_num 964) 2024-01-13T18:11:06.851 INFO:tasks.rados.rados.0.smithi084.stdout:3139: finishing write tid 4 to smithi084102331-19 2024-01-13T18:11:06.851 INFO:tasks.rados.rados.0.smithi084.stdout:3139: finishing write tid 5 to smithi084102331-19 2024-01-13T18:11:06.851 INFO:tasks.rados.rados.0.smithi084.stdout:3140: finishing rollback tid 0 to smithi084102331-11 2024-01-13T18:11:06.851 INFO:tasks.rados.rados.0.smithi084.stdout:3140: finishing rollback tid 1 to smithi084102331-11 2024-01-13T18:11:06.851 INFO:tasks.rados.rados.0.smithi084.stdout:3141: finishing rollback tid 0 to smithi084102331-23 2024-01-13T18:11:06.851 INFO:tasks.rados.rados.0.smithi084.stdout:3141: finishing rollback tid 1 to smithi084102331-23 2024-01-13T18:11:06.851 INFO:tasks.rados.rados.0.smithi084.stdout:3139: finishing write tid 6 to smithi084102331-19 2024-01-13T18:11:06.851 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 1298 (ObjNum 967 snap 306 seq_num 967) dirty exists 2024-01-13T18:11:06.851 INFO:tasks.rados.rados.0.smithi084.stdout:3139: left oid 19 (ObjNum 967 snap 306 seq_num 967) 2024-01-13T18:11:06.852 INFO:tasks.rados.rados.0.smithi084.stdout:3140: finishing rollback tid 2 to smithi084102331-11 2024-01-13T18:11:06.852 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1495 (ObjNum 909 snap 283 seq_num 909) dirty exists 2024-01-13T18:11:06.852 INFO:tasks.rados.rados.0.smithi084.stdout:3141: finishing rollback tid 2 to smithi084102331-23 2024-01-13T18:11:06.852 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1670 (ObjNum 954 snap 301 seq_num 954) dirty exists 2024-01-13T18:11:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:06 smithi099 ceph-mon[138788]: osdmap e684: 8 total, 8 up, 8 in 2024-01-13T18:11:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:06 smithi099 ceph-mon[138788]: pgmap v738: 121 pgs: 121 active+clean; 147 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 7.5 MiB/s wr, 14 op/s 2024-01-13T18:11:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:06 smithi084 ceph-mon[116404]: osdmap e684: 8 total, 8 up, 8 in 2024-01-13T18:11:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:06 smithi084 ceph-mon[116404]: pgmap v738: 121 pgs: 121 active+clean; 147 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 7.5 MiB/s wr, 14 op/s 2024-01-13T18:11:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:06 smithi084 ceph-mon[119097]: osdmap e684: 8 total, 8 up, 8 in 2024-01-13T18:11:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:06 smithi084 ceph-mon[119097]: pgmap v738: 121 pgs: 121 active+clean; 147 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 7.5 MiB/s wr, 14 op/s 2024-01-13T18:11:07.707 INFO:tasks.rados.rados.0.smithi084.stdout:3138: done (4 left) 2024-01-13T18:11:07.707 INFO:tasks.rados.rados.0.smithi084.stdout:3139: done (3 left) 2024-01-13T18:11:07.707 INFO:tasks.rados.rados.0.smithi084.stdout:3140: done (2 left) 2024-01-13T18:11:07.707 INFO:tasks.rados.rados.0.smithi084.stdout:3141: done (1 left) 2024-01-13T18:11:07.708 INFO:tasks.rados.rados.0.smithi084.stdout:3142: done (0 left) 2024-01-13T18:11:07.708 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 307 2024-01-13T18:11:07.708 INFO:tasks.rados.rados.0.smithi084.stdout:3143: seq_num 968 ranges {6545408=614400,7159808=745472,7905280=458752} 2024-01-13T18:11:07.745 INFO:tasks.rados.rados.0.smithi084.stdout:3143: writing smithi084102331-30 from 6545408 to 7159808 tid 1 2024-01-13T18:11:07.749 INFO:tasks.rados.rados.0.smithi084.stdout:3143: writing smithi084102331-30 from 7159808 to 7905280 tid 2 2024-01-13T18:11:07.752 INFO:tasks.rados.rados.0.smithi084.stdout:3143: writing smithi084102331-30 from 7905280 to 8364032 tid 3 2024-01-13T18:11:07.753 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 307 2024-01-13T18:11:07.753 INFO:tasks.rados.rados.0.smithi084.stdout:3144: seq_num 969 ranges {1433600=638976,2072576=630784,2703360=532480,3235840=40960} 2024-01-13T18:11:07.764 INFO:tasks.rados.rados.0.smithi084.stdout:3144: writing smithi084102331-38 from 1433600 to 2072576 tid 1 2024-01-13T18:11:07.768 INFO:tasks.rados.rados.0.smithi084.stdout:3144: writing smithi084102331-38 from 2072576 to 2703360 tid 2 2024-01-13T18:11:07.771 INFO:tasks.rados.rados.0.smithi084.stdout:3144: writing smithi084102331-38 from 2703360 to 3235840 tid 3 2024-01-13T18:11:07.772 INFO:tasks.rados.rados.0.smithi084.stdout:3144: writing smithi084102331-38 from 3235840 to 3276800 tid 4 2024-01-13T18:11:07.772 INFO:tasks.rados.rados.0.smithi084.stdout:3145: snap_create 2024-01-13T18:11:07.772 INFO:tasks.rados.rados.0.smithi084.stdout:3143: finishing write tid 1 to smithi084102331-30 2024-01-13T18:11:07.772 INFO:tasks.rados.rados.0.smithi084.stdout:3143: finishing write tid 2 to smithi084102331-30 2024-01-13T18:11:07.772 INFO:tasks.rados.rados.0.smithi084.stdout:3143: finishing write tid 3 to smithi084102331-30 2024-01-13T18:11:07.772 INFO:tasks.rados.rados.0.smithi084.stdout:3143: finishing write tid 4 to smithi084102331-30 2024-01-13T18:11:07.772 INFO:tasks.rados.rados.0.smithi084.stdout:3143: finishing write tid 5 to smithi084102331-30 2024-01-13T18:11:07.772 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1424 (ObjNum 968 snap 307 seq_num 968) dirty exists 2024-01-13T18:11:07.773 INFO:tasks.rados.rados.0.smithi084.stdout:3143: left oid 30 (ObjNum 968 snap 307 seq_num 968) 2024-01-13T18:11:07.773 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 1 to smithi084102331-38 2024-01-13T18:11:07.773 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 2 to smithi084102331-38 2024-01-13T18:11:07.775 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 3 to smithi084102331-38 2024-01-13T18:11:07.776 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 4 to smithi084102331-38 2024-01-13T18:11:07.776 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 5 to smithi084102331-38 2024-01-13T18:11:07.779 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 6 to smithi084102331-38 2024-01-13T18:11:07.779 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1609 (ObjNum 969 snap 307 seq_num 969) dirty exists 2024-01-13T18:11:07.780 INFO:tasks.rados.rados.0.smithi084.stdout:3144: left oid 38 (ObjNum 969 snap 307 seq_num 969) 2024-01-13T18:11:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:07 smithi099 ceph-mon[138788]: osdmap e685: 8 total, 8 up, 8 in 2024-01-13T18:11:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:07 smithi099 ceph-mon[138788]: osdmap e686: 8 total, 8 up, 8 in 2024-01-13T18:11:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:07 smithi084 ceph-mon[116404]: osdmap e685: 8 total, 8 up, 8 in 2024-01-13T18:11:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:07 smithi084 ceph-mon[116404]: osdmap e686: 8 total, 8 up, 8 in 2024-01-13T18:11:08.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:07 smithi084 ceph-mon[119097]: osdmap e685: 8 total, 8 up, 8 in 2024-01-13T18:11:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:07 smithi084 ceph-mon[119097]: osdmap e686: 8 total, 8 up, 8 in 2024-01-13T18:11:08.739 INFO:tasks.rados.rados.0.smithi084.stdout:3143: done (2 left) 2024-01-13T18:11:08.739 INFO:tasks.rados.rados.0.smithi084.stdout:3144: done (1 left) 2024-01-13T18:11:08.739 INFO:tasks.rados.rados.0.smithi084.stdout:3145: done (0 left) 2024-01-13T18:11:08.739 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 308 2024-01-13T18:11:08.739 INFO:tasks.rados.rados.0.smithi084.stdout:3146: seq_num 970 ranges {2850816=655360,3506176=516096,4022272=688128} 2024-01-13T18:11:08.757 INFO:tasks.rados.rados.0.smithi084.stdout:3146: writing smithi084102331-31 from 2850816 to 3506176 tid 1 2024-01-13T18:11:08.760 INFO:tasks.rados.rados.0.smithi084.stdout:3146: writing smithi084102331-31 from 3506176 to 4022272 tid 2 2024-01-13T18:11:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3146: writing smithi084102331-31 from 4022272 to 4710400 tid 3 2024-01-13T18:11:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3147: rmattr oid 35 current snap is 308 2024-01-13T18:11:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3148: read oid 46 snap 307 2024-01-13T18:11:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3148: expect (ObjNum 929 snap 294 seq_num 929) 2024-01-13T18:11:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 308 2024-01-13T18:11:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3149: seq_num 971 ranges {2252800=671744,2924544=802816,3727360=401408} 2024-01-13T18:11:08.781 INFO:tasks.rados.rados.0.smithi084.stdout:3149: writing smithi084102331-24 from 2252800 to 2924544 tid 1 2024-01-13T18:11:08.786 INFO:tasks.rados.rados.0.smithi084.stdout:3149: writing smithi084102331-24 from 2924544 to 3727360 tid 2 2024-01-13T18:11:08.789 INFO:tasks.rados.rados.0.smithi084.stdout:3149: writing smithi084102331-24 from 3727360 to 4128768 tid 3 2024-01-13T18:11:08.789 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 308 2024-01-13T18:11:08.789 INFO:tasks.rados.rados.0.smithi084.stdout:3146: finishing write tid 1 to smithi084102331-31 2024-01-13T18:11:08.789 INFO:tasks.rados.rados.0.smithi084.stdout:3146: finishing write tid 2 to smithi084102331-31 2024-01-13T18:11:08.789 INFO:tasks.rados.rados.0.smithi084.stdout:3150: seq_num 972 ranges {0=688128,688128=688128,1376256=516096} 2024-01-13T18:11:08.793 INFO:tasks.rados.rados.0.smithi084.stdout:3150: writing smithi084102331-43 from 0 to 688128 tid 1 2024-01-13T18:11:08.797 INFO:tasks.rados.rados.0.smithi084.stdout:3150: writing smithi084102331-43 from 688128 to 1376256 tid 2 2024-01-13T18:11:08.801 INFO:tasks.rados.rados.0.smithi084.stdout:3150: writing smithi084102331-43 from 1376256 to 1892352 tid 3 2024-01-13T18:11:08.801 INFO:tasks.rados.rados.0.smithi084.stdout:3151: copy_from oid 9 from oid 15 current snap is 308 2024-01-13T18:11:08.801 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1358 (ObjNum 914 snap 283 seq_num 914) dirty exists 2024-01-13T18:11:08.801 INFO:tasks.rados.rados.0.smithi084.stdout:3146: finishing write tid 3 to smithi084102331-31 2024-01-13T18:11:08.801 INFO:tasks.rados.rados.0.smithi084.stdout:3146: finishing write tid 4 to smithi084102331-31 2024-01-13T18:11:08.801 INFO:tasks.rados.rados.0.smithi084.stdout:3146: finishing write tid 5 to smithi084102331-31 2024-01-13T18:11:08.801 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1614 (ObjNum 970 snap 308 seq_num 970) dirty exists 2024-01-13T18:11:08.801 INFO:tasks.rados.rados.0.smithi084.stdout:3146: left oid 31 (ObjNum 970 snap 308 seq_num 970) 2024-01-13T18:11:08.801 INFO:tasks.rados.rados.0.smithi084.stdout:3149: finishing write tid 1 to smithi084102331-24 2024-01-13T18:11:08.801 INFO:tasks.rados.rados.0.smithi084.stdout:3149: finishing write tid 2 to smithi084102331-24 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3146: done (5 left) 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3147: done (4 left) 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3152: copy_from oid 23 from oid 14 current snap is 308 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3153: copy_from oid 2 from oid 33 current snap is 308 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3154: read oid 37 snap -1 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3154: expect (ObjNum 942 snap 298 seq_num 942) 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3155: rollback oid 29 current snap is 308 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3149: finishing write tid 3 to smithi084102331-24 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3149: finishing write tid 4 to smithi084102331-24 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3149: finishing write tid 5 to smithi084102331-24 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1341 (ObjNum 971 snap 308 seq_num 971) dirty exists 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3149: left oid 24 (ObjNum 971 snap 308 seq_num 971) 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3150: finishing write tid 1 to smithi084102331-43 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3150: finishing write tid 2 to smithi084102331-43 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 306 2024-01-13T18:11:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3149: done (7 left) 2024-01-13T18:11:08.803 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 308 2024-01-13T18:11:08.811 INFO:tasks.rados.rados.0.smithi084.stdout:3156: seq_num 973 ranges {2990080=704512,3694592=573440,4268032=507904,4775936=122880} 2024-01-13T18:11:08.823 INFO:tasks.rados.rados.0.smithi084.stdout:3156: writing smithi084102331-36 from 2990080 to 3694592 tid 1 2024-01-13T18:11:08.827 INFO:tasks.rados.rados.0.smithi084.stdout:3156: writing smithi084102331-36 from 3694592 to 4268032 tid 2 2024-01-13T18:11:08.830 INFO:tasks.rados.rados.0.smithi084.stdout:3156: writing smithi084102331-36 from 4268032 to 4775936 tid 3 2024-01-13T18:11:08.832 INFO:tasks.rados.rados.0.smithi084.stdout:3156: writing smithi084102331-36 from 4775936 to 4898816 tid 4 2024-01-13T18:11:08.832 INFO:tasks.rados.rados.0.smithi084.stdout:3157: read oid 30 snap -1 2024-01-13T18:11:08.832 INFO:tasks.rados.rados.0.smithi084.stdout:3157: expect (ObjNum 968 snap 307 seq_num 968) 2024-01-13T18:11:08.832 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 308 2024-01-13T18:11:08.832 INFO:tasks.rados.rados.0.smithi084.stdout:3158: seq_num 974 ranges {3964928=720896,4685824=507904,5193728=671744,5865472=24576} 2024-01-13T18:11:08.859 INFO:tasks.rados.rados.0.smithi084.stdout:3158: writing smithi084102331-20 from 3964928 to 4685824 tid 1 2024-01-13T18:11:08.862 INFO:tasks.rados.rados.0.smithi084.stdout:3158: writing smithi084102331-20 from 4685824 to 5193728 tid 2 2024-01-13T18:11:08.867 INFO:tasks.rados.rados.0.smithi084.stdout:3158: writing smithi084102331-20 from 5193728 to 5865472 tid 3 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:3158: writing smithi084102331-20 from 5865472 to 5890048 tid 4 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:3159: copy_from oid 21 from oid 31 current snap is 308 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:3152: finishing copy_from to smithi084102331-23 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:3152: got expected ENOENT (src dne) 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:3152: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:3155: finishing rollback tid 0 to smithi084102331-29 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:3155: finishing rollback tid 1 to smithi084102331-29 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:3152: done (10 left) 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:3160: rmattr oid 18 current snap is 308 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:3155: finishing rollback tid 2 to smithi084102331-29 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1361 (ObjNum 964 snap 302 seq_num 964) dirty exists 2024-01-13T18:11:08.868 INFO:tasks.rados.rados.0.smithi084.stdout:3150: finishing write tid 3 to smithi084102331-43 2024-01-13T18:11:08.869 INFO:tasks.rados.rados.0.smithi084.stdout:3150: finishing write tid 4 to smithi084102331-43 2024-01-13T18:11:08.869 INFO:tasks.rados.rados.0.smithi084.stdout:3150: finishing write tid 5 to smithi084102331-43 2024-01-13T18:11:08.869 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1345 (ObjNum 972 snap 308 seq_num 972) dirty exists 2024-01-13T18:11:08.869 INFO:tasks.rados.rados.0.smithi084.stdout:3150: left oid 43 (ObjNum 972 snap 308 seq_num 972) 2024-01-13T18:11:08.869 INFO:tasks.rados.rados.0.smithi084.stdout:3154: expect (ObjNum 942 snap 298 seq_num 942) 2024-01-13T18:11:08.906 INFO:tasks.rados.rados.0.smithi084.stdout:3148: expect (ObjNum 929 snap 294 seq_num 929) 2024-01-13T18:11:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:08 smithi099 ceph-mon[138788]: pgmap v741: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 153 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-01-13T18:11:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:08 smithi084 ceph-mon[116404]: pgmap v741: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 153 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-01-13T18:11:09.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:08 smithi084 ceph-mon[119097]: pgmap v741: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 153 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-01-13T18:11:09.826 INFO:tasks.rados.rados.0.smithi084.stdout:3156: finishing write tid 1 to smithi084102331-36 2024-01-13T18:11:09.826 INFO:tasks.rados.rados.0.smithi084.stdout:3153: finishing copy_from to smithi084102331-2 2024-01-13T18:11:09.826 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1412 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:11:09.826 INFO:tasks.rados.rados.0.smithi084.stdout:3156: finishing write tid 2 to smithi084102331-36 2024-01-13T18:11:09.826 INFO:tasks.rados.rados.0.smithi084.stdout:3156: finishing write tid 3 to smithi084102331-36 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:3156: finishing write tid 4 to smithi084102331-36 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:3148: done (10 left) 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:3150: done (9 left) 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:3154: done (8 left) 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:3155: done (7 left) 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 308 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:3153: finishing copy_from racing read to smithi084102331-2 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:3156: finishing write tid 5 to smithi084102331-36 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:3156: finishing write tid 6 to smithi084102331-36 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1490 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:3156: left oid 36 (ObjNum 973 snap 308 seq_num 973) 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 1 to smithi084102331-20 2024-01-13T18:11:09.827 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 2 to smithi084102331-20 2024-01-13T18:11:09.828 INFO:tasks.rados.rados.0.smithi084.stdout:3161: seq_num 975 ranges {2867200=737280,3604480=786432,4390912=417792} 2024-01-13T18:11:09.844 INFO:tasks.rados.rados.0.smithi084.stdout:3161: writing smithi084102331-29 from 2867200 to 3604480 tid 1 2024-01-13T18:11:09.849 INFO:tasks.rados.rados.0.smithi084.stdout:3161: writing smithi084102331-29 from 3604480 to 4390912 tid 2 2024-01-13T18:11:09.851 INFO:tasks.rados.rados.0.smithi084.stdout:3161: writing smithi084102331-29 from 4390912 to 4808704 tid 3 2024-01-13T18:11:09.852 INFO:tasks.rados.rados.0.smithi084.stdout:3153: done (7 left) 2024-01-13T18:11:09.852 INFO:tasks.rados.rados.0.smithi084.stdout:3156: done (6 left) 2024-01-13T18:11:09.852 INFO:tasks.rados.rados.0.smithi084.stdout:3162: snap_create 2024-01-13T18:11:09.852 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1493 (ObjNum 929 snap 294 seq_num 929) dirty exists 2024-01-13T18:11:09.852 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 3 to smithi084102331-20 2024-01-13T18:11:09.852 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 4 to smithi084102331-20 2024-01-13T18:11:09.852 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 5 to smithi084102331-20 2024-01-13T18:11:09.852 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 6 to smithi084102331-20 2024-01-13T18:11:09.852 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1303 (ObjNum 974 snap 308 seq_num 974) dirty exists 2024-01-13T18:11:09.852 INFO:tasks.rados.rados.0.smithi084.stdout:3158: left oid 20 (ObjNum 974 snap 308 seq_num 974) 2024-01-13T18:11:09.852 INFO:tasks.rados.rados.0.smithi084.stdout:3157: expect (ObjNum 968 snap 307 seq_num 968) 2024-01-13T18:11:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:09 smithi099 ceph-mon[138788]: osdmap e687: 8 total, 8 up, 8 in 2024-01-13T18:11:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:09 smithi084 ceph-mon[116404]: osdmap e687: 8 total, 8 up, 8 in 2024-01-13T18:11:10.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:09 smithi084 ceph-mon[119097]: osdmap e687: 8 total, 8 up, 8 in 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:3151: finishing copy_from to smithi084102331-9 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1492 (ObjNum 929 snap 294 seq_num 929) dirty exists 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:3151: finishing copy_from racing read to smithi084102331-9 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:3159: finishing copy_from to smithi084102331-21 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 1614 (ObjNum 970 snap 308 seq_num 970) dirty exists 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:3159: finishing copy_from racing read to smithi084102331-21 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:3161: finishing write tid 1 to smithi084102331-29 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:3161: finishing write tid 2 to smithi084102331-29 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:3161: finishing write tid 3 to smithi084102331-29 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:3161: finishing write tid 4 to smithi084102331-29 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:3161: finishing write tid 5 to smithi084102331-29 2024-01-13T18:11:10.362 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1618 (ObjNum 975 snap 308 seq_num 975) dirty exists 2024-01-13T18:11:10.363 INFO:tasks.rados.rados.0.smithi084.stdout:3161: left oid 29 (ObjNum 975 snap 308 seq_num 975) 2024-01-13T18:11:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:11:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:11:10] "GET /metrics HTTP/1.1" 200 36189 "" "Prometheus/2.43.0" 2024-01-13T18:11:10.748 INFO:tasks.rados.rados.0.smithi084.stdout:3151: done (6 left) 2024-01-13T18:11:10.748 INFO:tasks.rados.rados.0.smithi084.stdout:3157: done (5 left) 2024-01-13T18:11:10.748 INFO:tasks.rados.rados.0.smithi084.stdout:3158: done (4 left) 2024-01-13T18:11:10.748 INFO:tasks.rados.rados.0.smithi084.stdout:3159: done (3 left) 2024-01-13T18:11:10.748 INFO:tasks.rados.rados.0.smithi084.stdout:3160: done (2 left) 2024-01-13T18:11:10.748 INFO:tasks.rados.rados.0.smithi084.stdout:3161: done (1 left) 2024-01-13T18:11:10.748 INFO:tasks.rados.rados.0.smithi084.stdout:3162: done (0 left) 2024-01-13T18:11:10.748 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 309 2024-01-13T18:11:10.748 INFO:tasks.rados.rados.0.smithi084.stdout:3163: seq_num 976 ranges {532480=753664,1286144=671744,1957888=532480} 2024-01-13T18:11:10.754 INFO:tasks.rados.rados.0.smithi084.stdout:3163: writing smithi084102331-39 from 532480 to 1286144 tid 1 2024-01-13T18:11:10.758 INFO:tasks.rados.rados.0.smithi084.stdout:3163: writing smithi084102331-39 from 1286144 to 1957888 tid 2 2024-01-13T18:11:10.762 INFO:tasks.rados.rados.0.smithi084.stdout:3163: writing smithi084102331-39 from 1957888 to 2490368 tid 3 2024-01-13T18:11:10.762 INFO:tasks.rados.rados.0.smithi084.stdout:3164: read oid 17 snap -1 2024-01-13T18:11:10.762 INFO:tasks.rados.rados.0.smithi084.stdout:3164: expect (ObjNum 966 snap 306 seq_num 966) 2024-01-13T18:11:10.762 INFO:tasks.rados.rados.0.smithi084.stdout:3165: rollback oid 47 current snap is 309 2024-01-13T18:11:10.762 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 305 2024-01-13T18:11:10.762 INFO:tasks.rados.rados.0.smithi084.stdout:3166: read oid 8 snap -1 2024-01-13T18:11:10.762 INFO:tasks.rados.rados.0.smithi084.stdout:3166: expect (ObjNum 952 snap 301 seq_num 952) 2024-01-13T18:11:10.762 INFO:tasks.rados.rados.0.smithi084.stdout:3167: snap_remove snap 308 2024-01-13T18:11:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:10 smithi099 ceph-mon[138788]: pgmap v743: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 157 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-01-13T18:11:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:10 smithi084 ceph-mon[116404]: pgmap v743: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 157 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-01-13T18:11:11.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:10 smithi084 ceph-mon[119097]: pgmap v743: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 157 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-01-13T18:11:11.756 INFO:tasks.rados.rados.0.smithi084.stdout:3167: done (4 left) 2024-01-13T18:11:11.756 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 309 2024-01-13T18:11:11.756 INFO:tasks.rados.rados.0.smithi084.stdout:3163: finishing write tid 1 to smithi084102331-39 2024-01-13T18:11:11.756 INFO:tasks.rados.rados.0.smithi084.stdout:3163: finishing write tid 2 to smithi084102331-39 2024-01-13T18:11:11.756 INFO:tasks.rados.rados.0.smithi084.stdout:3163: finishing write tid 3 to smithi084102331-39 2024-01-13T18:11:11.756 INFO:tasks.rados.rados.0.smithi084.stdout:3163: finishing write tid 4 to smithi084102331-39 2024-01-13T18:11:11.756 INFO:tasks.rados.rados.0.smithi084.stdout:3163: finishing write tid 5 to smithi084102331-39 2024-01-13T18:11:11.756 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1499 (ObjNum 976 snap 309 seq_num 976) dirty exists 2024-01-13T18:11:11.756 INFO:tasks.rados.rados.0.smithi084.stdout:3163: left oid 39 (ObjNum 976 snap 309 seq_num 976) 2024-01-13T18:11:11.756 INFO:tasks.rados.rados.0.smithi084.stdout:3165: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:11:11.757 INFO:tasks.rados.rados.0.smithi084.stdout:3165: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:11:11.757 INFO:tasks.rados.rados.0.smithi084.stdout:3165: finishing rollback tid 2 to smithi084102331-47 2024-01-13T18:11:11.757 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1552 (ObjNum 950 snap 300 seq_num 950) dirty exists 2024-01-13T18:11:11.757 INFO:tasks.rados.rados.0.smithi084.stdout:3164: expect (ObjNum 966 snap 306 seq_num 966) 2024-01-13T18:11:11.844 INFO:tasks.rados.rados.0.smithi084.stdout:3166: expect (ObjNum 952 snap 301 seq_num 952) 2024-01-13T18:11:11.968 INFO:tasks.rados.rados.0.smithi084.stdout:3168: seq_num 977 ranges {1892352=770048,2662400=557056,3219456=491520,3710976=155648} 2024-01-13T18:11:11.981 INFO:tasks.rados.rados.0.smithi084.stdout:3168: writing smithi084102331-43 from 1892352 to 2662400 tid 1 2024-01-13T18:11:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:3168: writing smithi084102331-43 from 2662400 to 3219456 tid 2 2024-01-13T18:11:11.988 INFO:tasks.rados.rados.0.smithi084.stdout:3168: writing smithi084102331-43 from 3219456 to 3710976 tid 3 2024-01-13T18:11:11.989 INFO:tasks.rados.rados.0.smithi084.stdout:3168: writing smithi084102331-43 from 3710976 to 3866624 tid 4 2024-01-13T18:11:11.989 INFO:tasks.rados.rados.0.smithi084.stdout:3163: done (4 left) 2024-01-13T18:11:11.989 INFO:tasks.rados.rados.0.smithi084.stdout:3164: done (3 left) 2024-01-13T18:11:11.989 INFO:tasks.rados.rados.0.smithi084.stdout:3165: done (2 left) 2024-01-13T18:11:11.990 INFO:tasks.rados.rados.0.smithi084.stdout:3166: done (1 left) 2024-01-13T18:11:11.990 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 309 2024-01-13T18:11:11.990 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 1 to smithi084102331-43 2024-01-13T18:11:11.990 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 2 to smithi084102331-43 2024-01-13T18:11:11.990 INFO:tasks.rados.rados.0.smithi084.stdout:3169: seq_num 978 ranges {0=786432,786432=442368,1228800=647168,1875968=114688} 2024-01-13T18:11:11.994 INFO:tasks.rados.rados.0.smithi084.stdout:3169: writing smithi084102331-44 from 0 to 786432 tid 1 2024-01-13T18:11:11.996 INFO:tasks.rados.rados.0.smithi084.stdout:3169: writing smithi084102331-44 from 786432 to 1228800 tid 2 2024-01-13T18:11:12.000 INFO:tasks.rados.rados.0.smithi084.stdout:3169: writing smithi084102331-44 from 1228800 to 1875968 tid 3 2024-01-13T18:11:12.001 INFO:tasks.rados.rados.0.smithi084.stdout:3169: writing smithi084102331-44 from 1875968 to 1990656 tid 4 2024-01-13T18:11:12.001 INFO:tasks.rados.rados.0.smithi084.stdout:3170: snap_remove snap 304 2024-01-13T18:11:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:11 smithi099 ceph-mon[138788]: osdmap e688: 8 total, 8 up, 8 in 2024-01-13T18:11:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:11 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:11:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:11 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:11:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:11 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:11:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:11 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:11:12.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:11 smithi084 ceph-mon[116404]: osdmap e688: 8 total, 8 up, 8 in 2024-01-13T18:11:12.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:11 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:11:12.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:11 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:11:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:11 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:11:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:11 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:11:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:11 smithi084 ceph-mon[119097]: osdmap e688: 8 total, 8 up, 8 in 2024-01-13T18:11:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:11 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:11:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:11 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:11:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:11 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:11:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:11 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:11:12.761 INFO:tasks.rados.rados.0.smithi084.stdout:3170: done (2 left) 2024-01-13T18:11:12.761 INFO:tasks.rados.rados.0.smithi084.stdout:3171: read oid 42 snap -1 2024-01-13T18:11:12.761 INFO:tasks.rados.rados.0.smithi084.stdout:3171: expect (ObjNum 946 snap 299 seq_num 946) 2024-01-13T18:11:12.761 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 309 2024-01-13T18:11:12.761 INFO:tasks.rados.rados.0.smithi084.stdout:3172: seq_num 979 ranges {0=802816,802816=729088,1531904=458752,1990656=16384} 2024-01-13T18:11:12.766 INFO:tasks.rados.rados.0.smithi084.stdout:3172: writing smithi084102331-16 from 0 to 802816 tid 1 2024-01-13T18:11:12.771 INFO:tasks.rados.rados.0.smithi084.stdout:3172: writing smithi084102331-16 from 802816 to 1531904 tid 2 2024-01-13T18:11:12.774 INFO:tasks.rados.rados.0.smithi084.stdout:3172: writing smithi084102331-16 from 1531904 to 1990656 tid 3 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3172: writing smithi084102331-16 from 1990656 to 2007040 tid 4 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3173: copy_from oid 4 from oid 2 current snap is 309 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 3 to smithi084102331-43 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 4 to smithi084102331-43 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 5 to smithi084102331-43 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 6 to smithi084102331-43 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1350 (ObjNum 977 snap 309 seq_num 977) dirty exists 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3168: left oid 43 (ObjNum 977 snap 309 seq_num 977) 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 1 to smithi084102331-44 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 2 to smithi084102331-44 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 3 to smithi084102331-44 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 4 to smithi084102331-44 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 5 to smithi084102331-44 2024-01-13T18:11:12.775 INFO:tasks.rados.rados.0.smithi084.stdout:3168: done (4 left) 2024-01-13T18:11:12.776 INFO:tasks.rados.rados.0.smithi084.stdout:3174: read oid 33 snap -1 2024-01-13T18:11:12.776 INFO:tasks.rados.rados.0.smithi084.stdout:3174: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:11:12.776 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 309 2024-01-13T18:11:12.776 INFO:tasks.rados.rados.0.smithi084.stdout:3175: seq_num 980 ranges {2506752=417792,2924544=614400,3538944=663552,4202496=327680} 2024-01-13T18:11:12.791 INFO:tasks.rados.rados.0.smithi084.stdout:3175: writing smithi084102331-25 from 2506752 to 2924544 tid 1 2024-01-13T18:11:12.795 INFO:tasks.rados.rados.0.smithi084.stdout:3175: writing smithi084102331-25 from 2924544 to 3538944 tid 2 2024-01-13T18:11:12.799 INFO:tasks.rados.rados.0.smithi084.stdout:3175: writing smithi084102331-25 from 3538944 to 4202496 tid 3 2024-01-13T18:11:12.801 INFO:tasks.rados.rados.0.smithi084.stdout:3175: writing smithi084102331-25 from 4202496 to 4530176 tid 4 2024-01-13T18:11:12.801 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 309 2024-01-13T18:11:12.801 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 6 to smithi084102331-44 2024-01-13T18:11:12.802 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1557 (ObjNum 978 snap 309 seq_num 978) dirty exists 2024-01-13T18:11:12.802 INFO:tasks.rados.rados.0.smithi084.stdout:3169: left oid 44 (ObjNum 978 snap 309 seq_num 978) 2024-01-13T18:11:12.802 INFO:tasks.rados.rados.0.smithi084.stdout:3171: expect (ObjNum 946 snap 299 seq_num 946) 2024-01-13T18:11:12.839 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 1 to smithi084102331-16 2024-01-13T18:11:12.839 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 2 to smithi084102331-16 2024-01-13T18:11:12.839 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 3 to smithi084102331-16 2024-01-13T18:11:12.839 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 4 to smithi084102331-16 2024-01-13T18:11:12.839 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 5 to smithi084102331-16 2024-01-13T18:11:12.839 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 6 to smithi084102331-16 2024-01-13T18:11:12.840 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1494 (ObjNum 979 snap 309 seq_num 979) dirty exists 2024-01-13T18:11:12.840 INFO:tasks.rados.rados.0.smithi084.stdout:3172: left oid 16 (ObjNum 979 snap 309 seq_num 979) 2024-01-13T18:11:12.840 INFO:tasks.rados.rados.0.smithi084.stdout:3176: seq_num 981 ranges {1589248=434176,2023424=540672,2564096=466944,3031040=524288,3555328=73728} 2024-01-13T18:11:12.850 INFO:tasks.rados.rados.0.smithi084.stdout:3176: writing smithi084102331-23 from 1589248 to 2023424 tid 1 2024-01-13T18:11:12.853 INFO:tasks.rados.rados.0.smithi084.stdout:3176: writing smithi084102331-23 from 2023424 to 2564096 tid 2 2024-01-13T18:11:12.855 INFO:tasks.rados.rados.0.smithi084.stdout:3176: writing smithi084102331-23 from 2564096 to 3031040 tid 3 2024-01-13T18:11:12.858 INFO:tasks.rados.rados.0.smithi084.stdout:3176: writing smithi084102331-23 from 3031040 to 3555328 tid 4 2024-01-13T18:11:12.859 INFO:tasks.rados.rados.0.smithi084.stdout:3176: writing smithi084102331-23 from 3555328 to 3629056 tid 5 2024-01-13T18:11:12.859 INFO:tasks.rados.rados.0.smithi084.stdout:3169: done (6 left) 2024-01-13T18:11:12.859 INFO:tasks.rados.rados.0.smithi084.stdout:3171: done (5 left) 2024-01-13T18:11:12.859 INFO:tasks.rados.rados.0.smithi084.stdout:3172: done (4 left) 2024-01-13T18:11:12.859 INFO:tasks.rados.rados.0.smithi084.stdout:3177: rollback oid 24 current snap is 309 2024-01-13T18:11:12.859 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 303 2024-01-13T18:11:12.859 INFO:tasks.rados.rados.0.smithi084.stdout:3174: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:3175: finishing write tid 1 to smithi084102331-25 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:3175: finishing write tid 2 to smithi084102331-25 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:3174: done (4 left) 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:3178: read oid 5 snap -1 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:3178: expect (ObjNum 837 snap 271 seq_num 837) 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:3175: finishing write tid 3 to smithi084102331-25 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:3175: finishing write tid 4 to smithi084102331-25 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:3175: finishing write tid 5 to smithi084102331-25 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:3175: finishing write tid 6 to smithi084102331-25 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1432 (ObjNum 980 snap 309 seq_num 980) dirty exists 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:3175: left oid 25 (ObjNum 980 snap 309 seq_num 980) 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:3173: finishing copy_from to smithi084102331-4 2024-01-13T18:11:13.033 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 1412 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3173: finishing copy_from racing read to smithi084102331-4 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3179: read oid 27 snap 307 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3179: expect (ObjNum 938 snap 296 seq_num 938) 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3173: done (5 left) 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3175: done (4 left) 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3180: rollback oid 47 current snap is 309 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 305 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3176: finishing write tid 1 to smithi084102331-23 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3176: finishing write tid 2 to smithi084102331-23 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3176: finishing write tid 3 to smithi084102331-23 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3177: finishing rollback tid 0 to smithi084102331-24 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3177: finishing rollback tid 1 to smithi084102331-24 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3177: finishing rollback tid 2 to smithi084102331-24 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1353 (ObjNum 879 snap 279 seq_num 879) dirty exists 2024-01-13T18:11:13.034 INFO:tasks.rados.rados.0.smithi084.stdout:3176: finishing write tid 4 to smithi084102331-23 2024-01-13T18:11:13.035 INFO:tasks.rados.rados.0.smithi084.stdout:3176: finishing write tid 5 to smithi084102331-23 2024-01-13T18:11:13.035 INFO:tasks.rados.rados.0.smithi084.stdout:3176: finishing write tid 6 to smithi084102331-23 2024-01-13T18:11:13.035 INFO:tasks.rados.rados.0.smithi084.stdout:3176: finishing write tid 7 to smithi084102331-23 2024-01-13T18:11:13.035 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1683 (ObjNum 981 snap 309 seq_num 981) dirty exists 2024-01-13T18:11:13.035 INFO:tasks.rados.rados.0.smithi084.stdout:3176: left oid 23 (ObjNum 981 snap 309 seq_num 981) 2024-01-13T18:11:13.035 INFO:tasks.rados.rados.0.smithi084.stdout:3176: done (4 left) 2024-01-13T18:11:13.035 INFO:tasks.rados.rados.0.smithi084.stdout:3177: done (3 left) 2024-01-13T18:11:13.035 INFO:tasks.rados.rados.0.smithi084.stdout:3181: snap_remove snap 303 2024-01-13T18:11:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:12 smithi099 ceph-mon[138788]: osdmap e689: 8 total, 8 up, 8 in 2024-01-13T18:11:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:12 smithi099 ceph-mon[138788]: pgmap v746: 121 pgs: 121 active+clean; 187 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 8.8 MiB/s rd, 8.1 MiB/s wr, 19 op/s 2024-01-13T18:11:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:12 smithi084 ceph-mon[116404]: osdmap e689: 8 total, 8 up, 8 in 2024-01-13T18:11:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:12 smithi084 ceph-mon[116404]: pgmap v746: 121 pgs: 121 active+clean; 187 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 8.8 MiB/s rd, 8.1 MiB/s wr, 19 op/s 2024-01-13T18:11:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:12 smithi084 ceph-mon[119097]: osdmap e689: 8 total, 8 up, 8 in 2024-01-13T18:11:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:12 smithi084 ceph-mon[119097]: pgmap v746: 121 pgs: 121 active+clean; 187 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 8.8 MiB/s rd, 8.1 MiB/s wr, 19 op/s 2024-01-13T18:11:13.768 INFO:tasks.rados.rados.0.smithi084.stdout:3181: done (3 left) 2024-01-13T18:11:13.768 INFO:tasks.rados.rados.0.smithi084.stdout:3182: snap_remove snap 306 2024-01-13T18:11:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:13 smithi099 ceph-mon[138788]: osdmap e690: 8 total, 8 up, 8 in 2024-01-13T18:11:14.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:13 smithi084 ceph-mon[116404]: osdmap e690: 8 total, 8 up, 8 in 2024-01-13T18:11:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:13 smithi084 ceph-mon[119097]: osdmap e690: 8 total, 8 up, 8 in 2024-01-13T18:11:14.776 INFO:tasks.rados.rados.0.smithi084.stdout:3182: done (3 left) 2024-01-13T18:11:14.776 INFO:tasks.rados.rados.0.smithi084.stdout:3183: setattr oid 35 current snap is 309 2024-01-13T18:11:14.776 INFO:tasks.rados.rados.0.smithi084.stdout:3179: expect (ObjNum 938 snap 296 seq_num 938) 2024-01-13T18:11:14.816 INFO:tasks.rados.rados.0.smithi084.stdout:3180: finishing rollback tid 0 to smithi084102331-47 2024-01-13T18:11:14.816 INFO:tasks.rados.rados.0.smithi084.stdout:3180: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:11:14.816 INFO:tasks.rados.rados.0.smithi084.stdout:3180: finishing rollback tid 2 to smithi084102331-47 2024-01-13T18:11:14.816 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1560 (ObjNum 950 snap 300 seq_num 950) dirty exists 2024-01-13T18:11:14.816 INFO:tasks.rados.rados.0.smithi084.stdout:3178: expect (ObjNum 837 snap 271 seq_num 837) 2024-01-13T18:11:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1619 (ObjNum 914 snap 283 seq_num 914) dirty exists 2024-01-13T18:11:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:3178: done (3 left) 2024-01-13T18:11:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:3179: done (2 left) 2024-01-13T18:11:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:3180: done (1 left) 2024-01-13T18:11:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:3183: done (0 left) 2024-01-13T18:11:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 309 2024-01-13T18:11:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:3184: seq_num 982 ranges {0=450560,450560=425984,876544=679936,1556480=466944,2023424=32768} 2024-01-13T18:11:14.911 INFO:tasks.rados.rados.0.smithi084.stdout:3184: writing smithi084102331-22 from 0 to 450560 tid 1 2024-01-13T18:11:14.913 INFO:tasks.rados.rados.0.smithi084.stdout:3184: writing smithi084102331-22 from 450560 to 876544 tid 2 2024-01-13T18:11:14.917 INFO:tasks.rados.rados.0.smithi084.stdout:3184: writing smithi084102331-22 from 876544 to 1556480 tid 3 2024-01-13T18:11:14.920 INFO:tasks.rados.rados.0.smithi084.stdout:3184: writing smithi084102331-22 from 1556480 to 2023424 tid 4 2024-01-13T18:11:14.920 INFO:tasks.rados.rados.0.smithi084.stdout:3184: writing smithi084102331-22 from 2023424 to 2056192 tid 5 2024-01-13T18:11:14.920 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 309 2024-01-13T18:11:14.920 INFO:tasks.rados.rados.0.smithi084.stdout:3185: seq_num 983 ranges {4808704=466944,5275648=712704,5988352=434176,6422528=458752} 2024-01-13T18:11:14.947 INFO:tasks.rados.rados.0.smithi084.stdout:3185: writing smithi084102331-29 from 4808704 to 5275648 tid 1 2024-01-13T18:11:14.952 INFO:tasks.rados.rados.0.smithi084.stdout:3185: writing smithi084102331-29 from 5275648 to 5988352 tid 2 2024-01-13T18:11:14.954 INFO:tasks.rados.rados.0.smithi084.stdout:3185: writing smithi084102331-29 from 5988352 to 6422528 tid 3 2024-01-13T18:11:14.957 INFO:tasks.rados.rados.0.smithi084.stdout:3185: writing smithi084102331-29 from 6422528 to 6881280 tid 4 2024-01-13T18:11:14.957 INFO:tasks.rados.rados.0.smithi084.stdout:3186: delete oid 23 current snap is 309 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:3184: finishing write tid 1 to smithi084102331-22 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:3184: finishing write tid 2 to smithi084102331-22 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:3184: finishing write tid 3 to smithi084102331-22 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:3184: finishing write tid 4 to smithi084102331-22 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:3184: finishing write tid 5 to smithi084102331-22 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:3184: finishing write tid 6 to smithi084102331-22 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:3184: finishing write tid 7 to smithi084102331-22 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1698 (ObjNum 982 snap 309 seq_num 982) dirty exists 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:3184: left oid 22 (ObjNum 982 snap 309 seq_num 982) 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 1 to smithi084102331-29 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 2 to smithi084102331-29 2024-01-13T18:11:14.958 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 3 to smithi084102331-29 2024-01-13T18:11:14.959 INFO:tasks.rados.rados.0.smithi084.stdout:3184: done (2 left) 2024-01-13T18:11:14.959 INFO:tasks.rados.rados.0.smithi084.stdout:3186: done (1 left) 2024-01-13T18:11:14.959 INFO:tasks.rados.rados.0.smithi084.stdout:3187: snap_remove snap 307 2024-01-13T18:11:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:14 smithi099 ceph-mon[138788]: osdmap e691: 8 total, 8 up, 8 in 2024-01-13T18:11:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:14 smithi099 ceph-mon[138788]: pgmap v749: 121 pgs: 121 active+clean; 190 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 8.9 MiB/s wr, 24 op/s 2024-01-13T18:11:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:14 smithi084 ceph-mon[116404]: osdmap e691: 8 total, 8 up, 8 in 2024-01-13T18:11:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:14 smithi084 ceph-mon[116404]: pgmap v749: 121 pgs: 121 active+clean; 190 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 8.9 MiB/s wr, 24 op/s 2024-01-13T18:11:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:14 smithi084 ceph-mon[119097]: osdmap e691: 8 total, 8 up, 8 in 2024-01-13T18:11:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:14 smithi084 ceph-mon[119097]: pgmap v749: 121 pgs: 121 active+clean; 190 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 8.9 MiB/s wr, 24 op/s 2024-01-13T18:11:15.781 INFO:tasks.rados.rados.0.smithi084.stdout:3187: done (1 left) 2024-01-13T18:11:15.782 INFO:tasks.rados.rados.0.smithi084.stdout:3188: copy_from oid 42 from oid 16 current snap is 309 2024-01-13T18:11:15.782 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 4 to smithi084102331-29 2024-01-13T18:11:15.782 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 5 to smithi084102331-29 2024-01-13T18:11:15.782 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 6 to smithi084102331-29 2024-01-13T18:11:15.782 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1624 (ObjNum 983 snap 309 seq_num 983) dirty exists 2024-01-13T18:11:15.782 INFO:tasks.rados.rados.0.smithi084.stdout:3185: left oid 29 (ObjNum 983 snap 309 seq_num 983) 2024-01-13T18:11:15.782 INFO:tasks.rados.rados.0.smithi084.stdout:3185: done (1 left) 2024-01-13T18:11:15.782 INFO:tasks.rados.rados.0.smithi084.stdout:3189: snap_remove snap 302 2024-01-13T18:11:16.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:15 smithi099 ceph-mon[138788]: osdmap e692: 8 total, 8 up, 8 in 2024-01-13T18:11:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:15 smithi084 ceph-mon[116404]: osdmap e692: 8 total, 8 up, 8 in 2024-01-13T18:11:16.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:15 smithi084 ceph-mon[119097]: osdmap e692: 8 total, 8 up, 8 in 2024-01-13T18:11:16.787 INFO:tasks.rados.rados.0.smithi084.stdout:3189: done (1 left) 2024-01-13T18:11:16.787 INFO:tasks.rados.rados.0.smithi084.stdout:3188: finishing copy_from to smithi084102331-42 2024-01-13T18:11:16.787 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1494 (ObjNum 979 snap 309 seq_num 979) dirty exists 2024-01-13T18:11:16.787 INFO:tasks.rados.rados.0.smithi084.stdout:3188: finishing copy_from racing read to smithi084102331-42 2024-01-13T18:11:16.787 INFO:tasks.rados.rados.0.smithi084.stdout:3190: read oid 1 snap -1 2024-01-13T18:11:16.788 INFO:tasks.rados.rados.0.smithi084.stdout:3190: expect (ObjNum 894 snap 280 seq_num 894) 2024-01-13T18:11:16.788 INFO:tasks.rados.rados.0.smithi084.stdout:3188: done (1 left) 2024-01-13T18:11:16.788 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 309 2024-01-13T18:11:16.788 INFO:tasks.rados.rados.0.smithi084.stdout:3191: seq_num 985 ranges {4898816=499712,5398528=483328,5881856=450560,6332416=581632,6914048=90112} 2024-01-13T18:11:16.817 INFO:tasks.rados.rados.0.smithi084.stdout:3191: writing smithi084102331-36 from 4898816 to 5398528 tid 1 2024-01-13T18:11:16.820 INFO:tasks.rados.rados.0.smithi084.stdout:3191: writing smithi084102331-36 from 5398528 to 5881856 tid 2 2024-01-13T18:11:16.822 INFO:tasks.rados.rados.0.smithi084.stdout:3191: writing smithi084102331-36 from 5881856 to 6332416 tid 3 2024-01-13T18:11:16.826 INFO:tasks.rados.rados.0.smithi084.stdout:3191: writing smithi084102331-36 from 6332416 to 6914048 tid 4 2024-01-13T18:11:16.827 INFO:tasks.rados.rados.0.smithi084.stdout:3191: writing smithi084102331-36 from 6914048 to 7004160 tid 5 2024-01-13T18:11:16.827 INFO:tasks.rados.rados.0.smithi084.stdout:3192: read oid 30 snap -1 2024-01-13T18:11:16.827 INFO:tasks.rados.rados.0.smithi084.stdout:3192: expect (ObjNum 968 snap 307 seq_num 968) 2024-01-13T18:11:16.827 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 309 2024-01-13T18:11:16.827 INFO:tasks.rados.rados.0.smithi084.stdout:3193: seq_num 986 ranges {2203648=516096,2719744=770048,3489792=655360,4145152=180224} 2024-01-13T18:11:16.843 INFO:tasks.rados.rados.0.smithi084.stdout:3193: writing smithi084102331-3 from 2203648 to 2719744 tid 1 2024-01-13T18:11:16.846 INFO:tasks.rados.rados.0.smithi084.stdout:3193: writing smithi084102331-3 from 2719744 to 3489792 tid 2 2024-01-13T18:11:16.850 INFO:tasks.rados.rados.0.smithi084.stdout:3193: writing smithi084102331-3 from 3489792 to 4145152 tid 3 2024-01-13T18:11:16.851 INFO:tasks.rados.rados.0.smithi084.stdout:3193: writing smithi084102331-3 from 4145152 to 4325376 tid 4 2024-01-13T18:11:16.852 INFO:tasks.rados.rados.0.smithi084.stdout:3194: copy_from oid 15 from oid 22 current snap is 309 2024-01-13T18:11:16.852 INFO:tasks.rados.rados.0.smithi084.stdout:3190: expect (ObjNum 894 snap 280 seq_num 894) 2024-01-13T18:11:16.946 INFO:tasks.rados.rados.0.smithi084.stdout:3191: finishing write tid 1 to smithi084102331-36 2024-01-13T18:11:16.946 INFO:tasks.rados.rados.0.smithi084.stdout:3191: finishing write tid 2 to smithi084102331-36 2024-01-13T18:11:16.946 INFO:tasks.rados.rados.0.smithi084.stdout:3191: finishing write tid 3 to smithi084102331-36 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:3191: finishing write tid 4 to smithi084102331-36 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:3191: finishing write tid 5 to smithi084102331-36 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:3191: finishing write tid 6 to smithi084102331-36 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:3191: finishing write tid 7 to smithi084102331-36 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1496 (ObjNum 985 snap 309 seq_num 985) dirty exists 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:3191: left oid 36 (ObjNum 985 snap 309 seq_num 985) 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:3193: finishing write tid 1 to smithi084102331-3 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:3193: finishing write tid 2 to smithi084102331-3 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:3190: done (4 left) 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:3191: done (3 left) 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 309 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:3193: finishing write tid 3 to smithi084102331-3 2024-01-13T18:11:16.947 INFO:tasks.rados.rados.0.smithi084.stdout:3193: finishing write tid 4 to smithi084102331-3 2024-01-13T18:11:16.948 INFO:tasks.rados.rados.0.smithi084.stdout:3193: finishing write tid 5 to smithi084102331-3 2024-01-13T18:11:16.948 INFO:tasks.rados.rados.0.smithi084.stdout:3193: finishing write tid 6 to smithi084102331-3 2024-01-13T18:11:16.948 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1638 (ObjNum 986 snap 309 seq_num 986) dirty exists 2024-01-13T18:11:16.948 INFO:tasks.rados.rados.0.smithi084.stdout:3193: left oid 3 (ObjNum 986 snap 309 seq_num 986) 2024-01-13T18:11:16.948 INFO:tasks.rados.rados.0.smithi084.stdout:3194: finishing copy_from to smithi084102331-15 2024-01-13T18:11:16.948 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1698 (ObjNum 982 snap 309 seq_num 982) dirty exists 2024-01-13T18:11:16.948 INFO:tasks.rados.rados.0.smithi084.stdout:3194: finishing copy_from racing read to smithi084102331-15 2024-01-13T18:11:16.948 INFO:tasks.rados.rados.0.smithi084.stdout:3192: expect (ObjNum 968 snap 307 seq_num 968) 2024-01-13T18:11:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:16 smithi099 ceph-mon[138788]: osdmap e693: 8 total, 8 up, 8 in 2024-01-13T18:11:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:16 smithi099 ceph-mon[138788]: pgmap v752: 121 pgs: 121 active+clean; 192 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-01-13T18:11:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:16 smithi084 ceph-mon[116404]: osdmap e693: 8 total, 8 up, 8 in 2024-01-13T18:11:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:16 smithi084 ceph-mon[116404]: pgmap v752: 121 pgs: 121 active+clean; 192 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-01-13T18:11:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:16 smithi084 ceph-mon[119097]: osdmap e693: 8 total, 8 up, 8 in 2024-01-13T18:11:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:16 smithi084 ceph-mon[119097]: pgmap v752: 121 pgs: 121 active+clean; 192 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-01-13T18:11:17.457 INFO:tasks.rados.rados.0.smithi084.stdout:3195: seq_num 987 ranges {7045120=532480,7577600=647168,8224768=417792,8642560=409600,9052160=131072} 2024-01-13T18:11:17.497 INFO:tasks.rados.rados.0.smithi084.stdout:3195: writing smithi084102331-34 from 7045120 to 7577600 tid 1 2024-01-13T18:11:17.500 INFO:tasks.rados.rados.0.smithi084.stdout:3195: writing smithi084102331-34 from 7577600 to 8224768 tid 2 2024-01-13T18:11:17.502 INFO:tasks.rados.rados.0.smithi084.stdout:3195: writing smithi084102331-34 from 8224768 to 8642560 tid 3 2024-01-13T18:11:17.505 INFO:tasks.rados.rados.0.smithi084.stdout:3195: writing smithi084102331-34 from 8642560 to 9052160 tid 4 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3195: writing smithi084102331-34 from 9052160 to 9183232 tid 5 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3192: done (3 left) 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3193: done (2 left) 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3194: done (1 left) 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3196: copy_from oid 2 from oid 43 current snap is 309 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3195: finishing write tid 1 to smithi084102331-34 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3195: finishing write tid 2 to smithi084102331-34 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3195: finishing write tid 3 to smithi084102331-34 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3197: read oid 19 snap -1 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3197: expect (ObjNum 967 snap 306 seq_num 967) 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3198: read oid 31 snap -1 2024-01-13T18:11:17.507 INFO:tasks.rados.rados.0.smithi084.stdout:3198: expect (ObjNum 970 snap 308 seq_num 970) 2024-01-13T18:11:17.508 INFO:tasks.rados.rados.0.smithi084.stdout:3199: rollback oid 10 current snap is 309 2024-01-13T18:11:17.508 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 305 2024-01-13T18:11:17.508 INFO:tasks.rados.rados.0.smithi084.stdout:3200: snap_create 2024-01-13T18:11:17.513 INFO:tasks.rados.rados.0.smithi084.stdout:3195: finishing write tid 4 to smithi084102331-34 2024-01-13T18:11:17.513 INFO:tasks.rados.rados.0.smithi084.stdout:3195: finishing write tid 5 to smithi084102331-34 2024-01-13T18:11:17.513 INFO:tasks.rados.rados.0.smithi084.stdout:3195: finishing write tid 6 to smithi084102331-34 2024-01-13T18:11:17.515 INFO:tasks.rados.rados.0.smithi084.stdout:3199: finishing rollback tid 1 to smithi084102331-10 2024-01-13T18:11:17.516 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 0 (ObjNum 1265 snap 0 seq_num 3601426120) dirty dne 2024-01-13T18:11:17.519 INFO:tasks.rados.rados.0.smithi084.stdout:3195: finishing write tid 7 to smithi084102331-34 2024-01-13T18:11:17.519 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 1498 (ObjNum 987 snap 309 seq_num 987) dirty exists 2024-01-13T18:11:17.519 INFO:tasks.rados.rados.0.smithi084.stdout:3195: left oid 34 (ObjNum 987 snap 309 seq_num 987) 2024-01-13T18:11:17.521 INFO:tasks.rados.rados.0.smithi084.stdout:3197: expect (ObjNum 967 snap 306 seq_num 967) 2024-01-13T18:11:17.580 INFO:tasks.rados.rados.0.smithi084.stdout:3198: expect (ObjNum 970 snap 308 seq_num 970) 2024-01-13T18:11:17.765 INFO:tasks.rados.rados.0.smithi084.stdout:3196: finishing copy_from to smithi084102331-2 2024-01-13T18:11:17.765 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1350 (ObjNum 977 snap 309 seq_num 977) dirty exists 2024-01-13T18:11:17.765 INFO:tasks.rados.rados.0.smithi084.stdout:3196: finishing copy_from racing read to smithi084102331-2 2024-01-13T18:11:17.765 INFO:tasks.rados.rados.0.smithi084.stdout:3195: done (5 left) 2024-01-13T18:11:17.765 INFO:tasks.rados.rados.0.smithi084.stdout:3196: done (4 left) 2024-01-13T18:11:17.765 INFO:tasks.rados.rados.0.smithi084.stdout:3197: done (3 left) 2024-01-13T18:11:17.765 INFO:tasks.rados.rados.0.smithi084.stdout:3198: done (2 left) 2024-01-13T18:11:17.765 INFO:tasks.rados.rados.0.smithi084.stdout:3199: done (1 left) 2024-01-13T18:11:17.766 INFO:tasks.rados.rados.0.smithi084.stdout:3200: done (0 left) 2024-01-13T18:11:17.766 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 310 2024-01-13T18:11:17.766 INFO:tasks.rados.rados.0.smithi084.stdout:3201: seq_num 988 ranges {1990656=557056,2547712=532480,3080192=622592,3702784=450560} 2024-01-13T18:11:17.778 INFO:tasks.rados.rados.0.smithi084.stdout:3201: writing smithi084102331-44 from 1990656 to 2547712 tid 1 2024-01-13T18:11:17.781 INFO:tasks.rados.rados.0.smithi084.stdout:3201: writing smithi084102331-44 from 2547712 to 3080192 tid 2 2024-01-13T18:11:17.784 INFO:tasks.rados.rados.0.smithi084.stdout:3201: writing smithi084102331-44 from 3080192 to 3702784 tid 3 2024-01-13T18:11:17.788 INFO:tasks.rados.rados.0.smithi084.stdout:3201: writing smithi084102331-44 from 3702784 to 4153344 tid 4 2024-01-13T18:11:17.788 INFO:tasks.rados.rados.0.smithi084.stdout:3202: read oid 50 snap -1 2024-01-13T18:11:17.788 INFO:tasks.rados.rados.0.smithi084.stdout:3202: expect deleted 2024-01-13T18:11:17.788 INFO:tasks.rados.rados.0.smithi084.stdout:3203: read oid 39 snap 305 2024-01-13T18:11:17.788 INFO:tasks.rados.rados.0.smithi084.stdout:3203: expect (ObjNum 891 snap 279 seq_num 891) 2024-01-13T18:11:17.788 INFO:tasks.rados.rados.0.smithi084.stdout:3204: read oid 9 snap -1 2024-01-13T18:11:17.788 INFO:tasks.rados.rados.0.smithi084.stdout:3204: expect (ObjNum 929 snap 294 seq_num 929) 2024-01-13T18:11:17.788 INFO:tasks.rados.rados.0.smithi084.stdout:3205: delete oid 22 current snap is 310 2024-01-13T18:11:17.788 INFO:tasks.rados.rados.0.smithi084.stdout:3201: finishing write tid 1 to smithi084102331-44 2024-01-13T18:11:17.789 INFO:tasks.rados.rados.0.smithi084.stdout:3201: finishing write tid 2 to smithi084102331-44 2024-01-13T18:11:17.789 INFO:tasks.rados.rados.0.smithi084.stdout:3201: finishing write tid 3 to smithi084102331-44 2024-01-13T18:11:17.791 INFO:tasks.rados.rados.0.smithi084.stdout:3202: done (4 left) 2024-01-13T18:11:17.792 INFO:tasks.rados.rados.0.smithi084.stdout:3205: done (3 left) 2024-01-13T18:11:17.792 INFO:tasks.rados.rados.0.smithi084.stdout:3206: snap_create 2024-01-13T18:11:17.794 INFO:tasks.rados.rados.0.smithi084.stdout:3203: expect (ObjNum 891 snap 279 seq_num 891) 2024-01-13T18:11:17.810 INFO:tasks.rados.rados.0.smithi084.stdout:3201: finishing write tid 4 to smithi084102331-44 2024-01-13T18:11:17.810 INFO:tasks.rados.rados.0.smithi084.stdout:3201: finishing write tid 5 to smithi084102331-44 2024-01-13T18:11:17.810 INFO:tasks.rados.rados.0.smithi084.stdout:3201: finishing write tid 6 to smithi084102331-44 2024-01-13T18:11:17.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1703 (ObjNum 988 snap 310 seq_num 988) dirty exists 2024-01-13T18:11:17.811 INFO:tasks.rados.rados.0.smithi084.stdout:3201: left oid 44 (ObjNum 988 snap 310 seq_num 988) 2024-01-13T18:11:17.826 INFO:tasks.rados.rados.0.smithi084.stdout:3204: expect (ObjNum 929 snap 294 seq_num 929) 2024-01-13T18:11:18.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:17 smithi099 ceph-mon[138788]: osdmap e694: 8 total, 8 up, 8 in 2024-01-13T18:11:18.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:17 smithi099 ceph-mon[138788]: osdmap e695: 8 total, 8 up, 8 in 2024-01-13T18:11:18.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:17 smithi084 ceph-mon[116404]: osdmap e694: 8 total, 8 up, 8 in 2024-01-13T18:11:18.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:17 smithi084 ceph-mon[116404]: osdmap e695: 8 total, 8 up, 8 in 2024-01-13T18:11:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:17 smithi084 ceph-mon[119097]: osdmap e694: 8 total, 8 up, 8 in 2024-01-13T18:11:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:17 smithi084 ceph-mon[119097]: osdmap e695: 8 total, 8 up, 8 in 2024-01-13T18:11:18.799 INFO:tasks.rados.rados.0.smithi084.stdout:3201: done (3 left) 2024-01-13T18:11:18.799 INFO:tasks.rados.rados.0.smithi084.stdout:3203: done (2 left) 2024-01-13T18:11:18.799 INFO:tasks.rados.rados.0.smithi084.stdout:3204: done (1 left) 2024-01-13T18:11:18.799 INFO:tasks.rados.rados.0.smithi084.stdout:3206: done (0 left) 2024-01-13T18:11:18.799 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 311 2024-01-13T18:11:18.799 INFO:tasks.rados.rados.0.smithi084.stdout:3207: seq_num 990 ranges {5382144=589824,5971968=753664,6725632=638976,7364608=212992} 2024-01-13T18:11:18.830 INFO:tasks.rados.rados.0.smithi084.stdout:3207: writing smithi084102331-45 from 5382144 to 5971968 tid 1 2024-01-13T18:11:18.834 INFO:tasks.rados.rados.0.smithi084.stdout:3207: writing smithi084102331-45 from 5971968 to 6725632 tid 2 2024-01-13T18:11:18.838 INFO:tasks.rados.rados.0.smithi084.stdout:3207: writing smithi084102331-45 from 6725632 to 7364608 tid 3 2024-01-13T18:11:18.840 INFO:tasks.rados.rados.0.smithi084.stdout:3207: writing smithi084102331-45 from 7364608 to 7577600 tid 4 2024-01-13T18:11:18.840 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 311 2024-01-13T18:11:18.840 INFO:tasks.rados.rados.0.smithi084.stdout:3207: finishing write tid 1 to smithi084102331-45 2024-01-13T18:11:18.840 INFO:tasks.rados.rados.0.smithi084.stdout:3207: finishing write tid 2 to smithi084102331-45 2024-01-13T18:11:18.840 INFO:tasks.rados.rados.0.smithi084.stdout:3208: seq_num 991 ranges {2506752=606208,3112960=638976,3751936=794624,4546560=172032} 2024-01-13T18:11:18.856 INFO:tasks.rados.rados.0.smithi084.stdout:3208: writing smithi084102331-1 from 2506752 to 3112960 tid 1 2024-01-13T18:11:18.859 INFO:tasks.rados.rados.0.smithi084.stdout:3208: writing smithi084102331-1 from 3112960 to 3751936 tid 2 2024-01-13T18:11:18.864 INFO:tasks.rados.rados.0.smithi084.stdout:3208: writing smithi084102331-1 from 3751936 to 4546560 tid 3 2024-01-13T18:11:18.865 INFO:tasks.rados.rados.0.smithi084.stdout:3208: writing smithi084102331-1 from 4546560 to 4718592 tid 4 2024-01-13T18:11:18.865 INFO:tasks.rados.rados.0.smithi084.stdout:3209: snap_remove snap 305 2024-01-13T18:11:19.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:18 smithi099 ceph-mon[138788]: pgmap v755: 121 pgs: 121 active+clean; 207 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 7.4 MiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-01-13T18:11:19.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:18 smithi084 ceph-mon[116404]: pgmap v755: 121 pgs: 121 active+clean; 207 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 7.4 MiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-01-13T18:11:19.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:18 smithi084 ceph-mon[119097]: pgmap v755: 121 pgs: 121 active+clean; 207 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 7.4 MiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-01-13T18:11:19.802 INFO:tasks.rados.rados.0.smithi084.stdout:3209: done (2 left) 2024-01-13T18:11:19.802 INFO:tasks.rados.rados.0.smithi084.stdout:3210: read oid 9 snap 310 2024-01-13T18:11:19.803 INFO:tasks.rados.rados.0.smithi084.stdout:3210: expect (ObjNum 929 snap 294 seq_num 929) 2024-01-13T18:11:19.803 INFO:tasks.rados.rados.0.smithi084.stdout:3211: read oid 10 snap 310 2024-01-13T18:11:19.803 INFO:tasks.rados.rados.0.smithi084.stdout:3211: expect deleted 2024-01-13T18:11:19.803 INFO:tasks.rados.rados.0.smithi084.stdout:3212: delete oid 16 current snap is 311 2024-01-13T18:11:19.803 INFO:tasks.rados.rados.0.smithi084.stdout:3207: finishing write tid 3 to smithi084102331-45 2024-01-13T18:11:19.803 INFO:tasks.rados.rados.0.smithi084.stdout:3207: finishing write tid 4 to smithi084102331-45 2024-01-13T18:11:19.803 INFO:tasks.rados.rados.0.smithi084.stdout:3207: finishing write tid 5 to smithi084102331-45 2024-01-13T18:11:19.803 INFO:tasks.rados.rados.0.smithi084.stdout:3207: finishing write tid 6 to smithi084102331-45 2024-01-13T18:11:19.803 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1644 (ObjNum 990 snap 311 seq_num 990) dirty exists 2024-01-13T18:11:19.804 INFO:tasks.rados.rados.0.smithi084.stdout:3207: left oid 45 (ObjNum 990 snap 311 seq_num 990) 2024-01-13T18:11:19.804 INFO:tasks.rados.rados.0.smithi084.stdout:3208: finishing write tid 1 to smithi084102331-1 2024-01-13T18:11:19.804 INFO:tasks.rados.rados.0.smithi084.stdout:3208: finishing write tid 2 to smithi084102331-1 2024-01-13T18:11:19.804 INFO:tasks.rados.rados.0.smithi084.stdout:3208: finishing write tid 3 to smithi084102331-1 2024-01-13T18:11:19.804 INFO:tasks.rados.rados.0.smithi084.stdout:3208: finishing write tid 4 to smithi084102331-1 2024-01-13T18:11:19.804 INFO:tasks.rados.rados.0.smithi084.stdout:3208: finishing write tid 5 to smithi084102331-1 2024-01-13T18:11:19.804 INFO:tasks.rados.rados.0.smithi084.stdout:3208: finishing write tid 6 to smithi084102331-1 2024-01-13T18:11:19.804 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1650 (ObjNum 991 snap 311 seq_num 991) dirty exists 2024-01-13T18:11:19.804 INFO:tasks.rados.rados.0.smithi084.stdout:3208: left oid 1 (ObjNum 991 snap 311 seq_num 991) 2024-01-13T18:11:19.814 INFO:tasks.rados.rados.0.smithi084.stdout:3207: done (4 left) 2024-01-13T18:11:19.814 INFO:tasks.rados.rados.0.smithi084.stdout:3208: done (3 left) 2024-01-13T18:11:19.814 INFO:tasks.rados.rados.0.smithi084.stdout:3211: done (2 left) 2024-01-13T18:11:19.814 INFO:tasks.rados.rados.0.smithi084.stdout:3212: done (1 left) 2024-01-13T18:11:19.814 INFO:tasks.rados.rados.0.smithi084.stdout:3213: read oid 16 snap 310 2024-01-13T18:11:19.814 INFO:tasks.rados.rados.0.smithi084.stdout:3213: expect (ObjNum 979 snap 309 seq_num 979) 2024-01-13T18:11:19.814 INFO:tasks.rados.rados.0.smithi084.stdout:3214: setattr oid 40 current snap is 311 2024-01-13T18:11:19.816 INFO:tasks.rados.rados.0.smithi084.stdout:3215: copy_from oid 32 from oid 4 current snap is 311 2024-01-13T18:11:19.816 INFO:tasks.rados.rados.0.smithi084.stdout:3216: delete oid 47 current snap is 311 2024-01-13T18:11:19.823 INFO:tasks.rados.rados.0.smithi084.stdout:3216: done (4 left) 2024-01-13T18:11:19.823 INFO:tasks.rados.rados.0.smithi084.stdout:3217: snap_create 2024-01-13T18:11:19.832 INFO:tasks.rados.rados.0.smithi084.stdout:3213: expect (ObjNum 979 snap 309 seq_num 979) 2024-01-13T18:11:19.887 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1625 (ObjNum 948 snap 300 seq_num 948) dirty exists 2024-01-13T18:11:19.887 INFO:tasks.rados.rados.0.smithi084.stdout:3215: finishing copy_from to smithi084102331-32 2024-01-13T18:11:19.887 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1412 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:11:19.887 INFO:tasks.rados.rados.0.smithi084.stdout:3215: finishing copy_from racing read to smithi084102331-32 2024-01-13T18:11:19.887 INFO:tasks.rados.rados.0.smithi084.stdout:3210: expect (ObjNum 929 snap 294 seq_num 929) 2024-01-13T18:11:20.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:19 smithi099 ceph-mon[138788]: osdmap e696: 8 total, 8 up, 8 in 2024-01-13T18:11:20.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:19 smithi084 ceph-mon[116404]: osdmap e696: 8 total, 8 up, 8 in 2024-01-13T18:11:20.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:19 smithi084 ceph-mon[119097]: osdmap e696: 8 total, 8 up, 8 in 2024-01-13T18:11:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:11:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:11:20] "GET /metrics HTTP/1.1" 200 36191 "" "Prometheus/2.43.0" 2024-01-13T18:11:20.814 INFO:tasks.rados.rados.0.smithi084.stdout:3210: done (4 left) 2024-01-13T18:11:20.815 INFO:tasks.rados.rados.0.smithi084.stdout:3213: done (3 left) 2024-01-13T18:11:20.815 INFO:tasks.rados.rados.0.smithi084.stdout:3214: done (2 left) 2024-01-13T18:11:20.815 INFO:tasks.rados.rados.0.smithi084.stdout:3215: done (1 left) 2024-01-13T18:11:20.815 INFO:tasks.rados.rados.0.smithi084.stdout:3217: done (0 left) 2024-01-13T18:11:20.815 INFO:tasks.rados.rados.0.smithi084.stdout:3218: copy_from oid 14 from oid 19 current snap is 312 2024-01-13T18:11:20.815 INFO:tasks.rados.rados.0.smithi084.stdout:3219: rmattr oid 49 current snap is 312 2024-01-13T18:11:20.815 INFO:tasks.rados.rados.0.smithi084.stdout:3220: delete oid 31 current snap is 312 2024-01-13T18:11:20.820 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1497 (ObjNum 909 snap 283 seq_num 909) dirty exists 2024-01-13T18:11:20.823 INFO:tasks.rados.rados.0.smithi084.stdout:3219: done (2 left) 2024-01-13T18:11:20.823 INFO:tasks.rados.rados.0.smithi084.stdout:3220: done (1 left) 2024-01-13T18:11:20.823 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 312 2024-01-13T18:11:20.823 INFO:tasks.rados.rados.0.smithi084.stdout:3221: seq_num 995 ranges {2490368=671744,3162112=573440,3735552=778240,4513792=253952} 2024-01-13T18:11:20.840 INFO:tasks.rados.rados.0.smithi084.stdout:3221: writing smithi084102331-39 from 2490368 to 3162112 tid 1 2024-01-13T18:11:20.843 INFO:tasks.rados.rados.0.smithi084.stdout:3221: writing smithi084102331-39 from 3162112 to 3735552 tid 2 2024-01-13T18:11:20.848 INFO:tasks.rados.rados.0.smithi084.stdout:3221: writing smithi084102331-39 from 3735552 to 4513792 tid 3 2024-01-13T18:11:20.849 INFO:tasks.rados.rados.0.smithi084.stdout:3221: writing smithi084102331-39 from 4513792 to 4767744 tid 4 2024-01-13T18:11:20.849 INFO:tasks.rados.rados.0.smithi084.stdout:3222: delete oid 5 current snap is 312 2024-01-13T18:11:20.850 INFO:tasks.rados.rados.0.smithi084.stdout:3218: finishing copy_from to smithi084102331-14 2024-01-13T18:11:20.850 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1298 (ObjNum 967 snap 306 seq_num 967) dirty exists 2024-01-13T18:11:20.850 INFO:tasks.rados.rados.0.smithi084.stdout:3218: finishing copy_from racing read to smithi084102331-14 2024-01-13T18:11:20.864 INFO:tasks.rados.rados.0.smithi084.stdout:3221: finishing write tid 1 to smithi084102331-39 2024-01-13T18:11:20.865 INFO:tasks.rados.rados.0.smithi084.stdout:3221: finishing write tid 2 to smithi084102331-39 2024-01-13T18:11:20.866 INFO:tasks.rados.rados.0.smithi084.stdout:3221: finishing write tid 3 to smithi084102331-39 2024-01-13T18:11:20.866 INFO:tasks.rados.rados.0.smithi084.stdout:3221: finishing write tid 4 to smithi084102331-39 2024-01-13T18:11:20.866 INFO:tasks.rados.rados.0.smithi084.stdout:3221: finishing write tid 5 to smithi084102331-39 2024-01-13T18:11:20.866 INFO:tasks.rados.rados.0.smithi084.stdout:3218: done (2 left) 2024-01-13T18:11:20.866 INFO:tasks.rados.rados.0.smithi084.stdout:3222: done (1 left) 2024-01-13T18:11:20.866 INFO:tasks.rados.rados.0.smithi084.stdout:3223: rmattr oid 47 current snap is 312 2024-01-13T18:11:20.867 INFO:tasks.rados.rados.0.smithi084.stdout:3223: done (1 left) 2024-01-13T18:11:20.867 INFO:tasks.rados.rados.0.smithi084.stdout:3224: read oid 47 snap 311 2024-01-13T18:11:20.867 INFO:tasks.rados.rados.0.smithi084.stdout:3224: expect deleted 2024-01-13T18:11:20.867 INFO:tasks.rados.rados.0.smithi084.stdout:3225: read oid 15 snap -1 2024-01-13T18:11:20.867 INFO:tasks.rados.rados.0.smithi084.stdout:3225: expect (ObjNum 982 snap 309 seq_num 982) 2024-01-13T18:11:20.867 INFO:tasks.rados.rados.0.smithi084.stdout:3226: read oid 28 snap -1 2024-01-13T18:11:20.867 INFO:tasks.rados.rados.0.smithi084.stdout:3226: expect (ObjNum 908 snap 282 seq_num 908) 2024-01-13T18:11:20.867 INFO:tasks.rados.rados.0.smithi084.stdout:3227: delete oid 7 current snap is 312 2024-01-13T18:11:20.867 INFO:tasks.rados.rados.0.smithi084.stdout:3221: finishing write tid 6 to smithi084102331-39 2024-01-13T18:11:20.867 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1504 (ObjNum 995 snap 312 seq_num 995) dirty exists 2024-01-13T18:11:20.868 INFO:tasks.rados.rados.0.smithi084.stdout:3221: left oid 39 (ObjNum 995 snap 312 seq_num 995) 2024-01-13T18:11:20.873 INFO:tasks.rados.rados.0.smithi084.stdout:3221: done (4 left) 2024-01-13T18:11:20.873 INFO:tasks.rados.rados.0.smithi084.stdout:3224: done (3 left) 2024-01-13T18:11:20.873 INFO:tasks.rados.rados.0.smithi084.stdout:3227: done (2 left) 2024-01-13T18:11:20.873 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 312 2024-01-13T18:11:20.873 INFO:tasks.rados.rados.0.smithi084.stdout:3228: seq_num 998 ranges {0=720896,720896=679936,1400832=598016,1998848=327680} 2024-01-13T18:11:20.877 INFO:tasks.rados.rados.0.smithi084.stdout:3228: writing smithi084102331-47 from 0 to 720896 tid 1 2024-01-13T18:11:20.881 INFO:tasks.rados.rados.0.smithi084.stdout:3228: writing smithi084102331-47 from 720896 to 1400832 tid 2 2024-01-13T18:11:20.884 INFO:tasks.rados.rados.0.smithi084.stdout:3228: writing smithi084102331-47 from 1400832 to 1998848 tid 3 2024-01-13T18:11:20.887 INFO:tasks.rados.rados.0.smithi084.stdout:3228: writing smithi084102331-47 from 1998848 to 2326528 tid 4 2024-01-13T18:11:20.887 INFO:tasks.rados.rados.0.smithi084.stdout:3229: read oid 25 snap -1 2024-01-13T18:11:20.887 INFO:tasks.rados.rados.0.smithi084.stdout:3229: expect (ObjNum 980 snap 309 seq_num 980) 2024-01-13T18:11:20.887 INFO:tasks.rados.rados.0.smithi084.stdout:3230: snap_create 2024-01-13T18:11:20.887 INFO:tasks.rados.rados.0.smithi084.stdout:3226: expect (ObjNum 908 snap 282 seq_num 908) 2024-01-13T18:11:20.996 INFO:tasks.rados.rados.0.smithi084.stdout:3225: expect (ObjNum 982 snap 309 seq_num 982) 2024-01-13T18:11:21.051 INFO:tasks.rados.rados.0.smithi084.stdout:3228: finishing write tid 1 to smithi084102331-47 2024-01-13T18:11:21.051 INFO:tasks.rados.rados.0.smithi084.stdout:3228: finishing write tid 2 to smithi084102331-47 2024-01-13T18:11:21.051 INFO:tasks.rados.rados.0.smithi084.stdout:3228: finishing write tid 3 to smithi084102331-47 2024-01-13T18:11:21.051 INFO:tasks.rados.rados.0.smithi084.stdout:3228: finishing write tid 4 to smithi084102331-47 2024-01-13T18:11:21.051 INFO:tasks.rados.rados.0.smithi084.stdout:3228: finishing write tid 5 to smithi084102331-47 2024-01-13T18:11:21.052 INFO:tasks.rados.rados.0.smithi084.stdout:3228: finishing write tid 6 to smithi084102331-47 2024-01-13T18:11:21.052 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1709 (ObjNum 998 snap 312 seq_num 998) dirty exists 2024-01-13T18:11:21.052 INFO:tasks.rados.rados.0.smithi084.stdout:3228: left oid 47 (ObjNum 998 snap 312 seq_num 998) 2024-01-13T18:11:21.052 INFO:tasks.rados.rados.0.smithi084.stdout:3229: expect (ObjNum 980 snap 309 seq_num 980) 2024-01-13T18:11:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:20 smithi099 ceph-mon[138788]: osdmap e697: 8 total, 8 up, 8 in 2024-01-13T18:11:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:20 smithi099 ceph-mon[138788]: pgmap v758: 121 pgs: 121 active+clean; 209 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-01-13T18:11:21.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:20 smithi084 ceph-mon[116404]: osdmap e697: 8 total, 8 up, 8 in 2024-01-13T18:11:21.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:21.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:20 smithi084 ceph-mon[116404]: pgmap v758: 121 pgs: 121 active+clean; 209 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-01-13T18:11:21.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:20 smithi084 ceph-mon[119097]: osdmap e697: 8 total, 8 up, 8 in 2024-01-13T18:11:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:20 smithi084 ceph-mon[119097]: pgmap v758: 121 pgs: 121 active+clean; 209 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-01-13T18:11:21.817 INFO:tasks.rados.rados.0.smithi084.stdout:3225: done (4 left) 2024-01-13T18:11:21.818 INFO:tasks.rados.rados.0.smithi084.stdout:3226: done (3 left) 2024-01-13T18:11:21.818 INFO:tasks.rados.rados.0.smithi084.stdout:3228: done (2 left) 2024-01-13T18:11:21.818 INFO:tasks.rados.rados.0.smithi084.stdout:3229: done (1 left) 2024-01-13T18:11:21.818 INFO:tasks.rados.rados.0.smithi084.stdout:3230: done (0 left) 2024-01-13T18:11:21.818 INFO:tasks.rados.rados.0.smithi084.stdout:3231: delete oid 41 current snap is 313 2024-01-13T18:11:21.823 INFO:tasks.rados.rados.0.smithi084.stdout:3231: done (0 left) 2024-01-13T18:11:21.823 INFO:tasks.rados.rados.0.smithi084.stdout:3232: read oid 36 snap -1 2024-01-13T18:11:21.823 INFO:tasks.rados.rados.0.smithi084.stdout:3232: expect (ObjNum 985 snap 309 seq_num 985) 2024-01-13T18:11:21.823 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 313 2024-01-13T18:11:21.823 INFO:tasks.rados.rados.0.smithi084.stdout:3233: seq_num 1000 ranges {917504=753664,1671168=442368,2113536=565248,2678784=458752,3137536=139264} 2024-01-13T18:11:21.832 INFO:tasks.rados.rados.0.smithi084.stdout:3233: writing smithi084102331-35 from 917504 to 1671168 tid 1 2024-01-13T18:11:21.835 INFO:tasks.rados.rados.0.smithi084.stdout:3233: writing smithi084102331-35 from 1671168 to 2113536 tid 2 2024-01-13T18:11:21.839 INFO:tasks.rados.rados.0.smithi084.stdout:3233: writing smithi084102331-35 from 2113536 to 2678784 tid 3 2024-01-13T18:11:21.841 INFO:tasks.rados.rados.0.smithi084.stdout:3233: writing smithi084102331-35 from 2678784 to 3137536 tid 4 2024-01-13T18:11:21.843 INFO:tasks.rados.rados.0.smithi084.stdout:3233: writing smithi084102331-35 from 3137536 to 3276800 tid 5 2024-01-13T18:11:21.843 INFO:tasks.rados.rados.0.smithi084.stdout:3234: read oid 4 snap -1 2024-01-13T18:11:21.844 INFO:tasks.rados.rados.0.smithi084.stdout:3234: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:11:21.844 INFO:tasks.rados.rados.0.smithi084.stdout:3235: read oid 8 snap -1 2024-01-13T18:11:21.844 INFO:tasks.rados.rados.0.smithi084.stdout:3235: expect (ObjNum 952 snap 301 seq_num 952) 2024-01-13T18:11:21.844 INFO:tasks.rados.rados.0.smithi084.stdout:3236: read oid 18 snap 312 2024-01-13T18:11:21.844 INFO:tasks.rados.rados.0.smithi084.stdout:3236: expect (ObjNum 929 snap 294 seq_num 929) 2024-01-13T18:11:21.844 INFO:tasks.rados.rados.0.smithi084.stdout:3237: rollback oid 19 current snap is 313 2024-01-13T18:11:21.844 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 19 to 310 2024-01-13T18:11:21.844 INFO:tasks.rados.rados.0.smithi084.stdout:3233: finishing write tid 1 to smithi084102331-35 2024-01-13T18:11:21.844 INFO:tasks.rados.rados.0.smithi084.stdout:3233: finishing write tid 2 to smithi084102331-35 2024-01-13T18:11:21.844 INFO:tasks.rados.rados.0.smithi084.stdout:3238: delete oid 27 current snap is 313 2024-01-13T18:11:21.850 INFO:tasks.rados.rados.0.smithi084.stdout:3233: finishing write tid 3 to smithi084102331-35 2024-01-13T18:11:21.852 INFO:tasks.rados.rados.0.smithi084.stdout:3237: finishing rollback tid 0 to smithi084102331-19 2024-01-13T18:11:21.852 INFO:tasks.rados.rados.0.smithi084.stdout:3237: finishing rollback tid 1 to smithi084102331-19 2024-01-13T18:11:21.852 INFO:tasks.rados.rados.0.smithi084.stdout:3233: finishing write tid 4 to smithi084102331-35 2024-01-13T18:11:21.852 INFO:tasks.rados.rados.0.smithi084.stdout:3233: finishing write tid 5 to smithi084102331-35 2024-01-13T18:11:21.852 INFO:tasks.rados.rados.0.smithi084.stdout:3237: finishing rollback tid 2 to smithi084102331-19 2024-01-13T18:11:21.852 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 1306 (ObjNum 967 snap 306 seq_num 967) dirty exists 2024-01-13T18:11:21.853 INFO:tasks.rados.rados.0.smithi084.stdout:3233: finishing write tid 6 to smithi084102331-35 2024-01-13T18:11:21.856 INFO:tasks.rados.rados.0.smithi084.stdout:3233: finishing write tid 7 to smithi084102331-35 2024-01-13T18:11:21.856 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1631 (ObjNum 1000 snap 313 seq_num 1000) dirty exists 2024-01-13T18:11:21.856 INFO:tasks.rados.rados.0.smithi084.stdout:3233: left oid 35 (ObjNum 1000 snap 313 seq_num 1000) 2024-01-13T18:11:21.856 INFO:tasks.rados.rados.0.smithi084.stdout:3232: expect (ObjNum 985 snap 309 seq_num 985) 2024-01-13T18:11:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:21 smithi099 ceph-mon[138788]: osdmap e698: 8 total, 8 up, 8 in 2024-01-13T18:11:22.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:21 smithi084 ceph-mon[116404]: osdmap e698: 8 total, 8 up, 8 in 2024-01-13T18:11:22.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:21 smithi084 ceph-mon[119097]: osdmap e698: 8 total, 8 up, 8 in 2024-01-13T18:11:22.188 INFO:tasks.rados.rados.0.smithi084.stdout:3235: expect (ObjNum 952 snap 301 seq_num 952) 2024-01-13T18:11:22.311 INFO:tasks.rados.rados.0.smithi084.stdout:3234: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:11:22.481 INFO:tasks.rados.rados.0.smithi084.stdout:3236: expect (ObjNum 929 snap 294 seq_num 929) 2024-01-13T18:11:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:22 smithi099 ceph-mon[138788]: osdmap e699: 8 total, 8 up, 8 in 2024-01-13T18:11:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:22 smithi099 ceph-mon[138788]: pgmap v761: 121 pgs: 121 active+clean; 202 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 32 MiB/s rd, 3.5 MiB/s wr, 23 op/s 2024-01-13T18:11:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:22 smithi099 ceph-mon[138788]: osdmap e700: 8 total, 8 up, 8 in 2024-01-13T18:11:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:22 smithi084 ceph-mon[116404]: osdmap e699: 8 total, 8 up, 8 in 2024-01-13T18:11:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:22 smithi084 ceph-mon[116404]: pgmap v761: 121 pgs: 121 active+clean; 202 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 32 MiB/s rd, 3.5 MiB/s wr, 23 op/s 2024-01-13T18:11:23.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:22 smithi084 ceph-mon[116404]: osdmap e700: 8 total, 8 up, 8 in 2024-01-13T18:11:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:22 smithi084 ceph-mon[119097]: osdmap e699: 8 total, 8 up, 8 in 2024-01-13T18:11:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:22 smithi084 ceph-mon[119097]: pgmap v761: 121 pgs: 121 active+clean; 202 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 32 MiB/s rd, 3.5 MiB/s wr, 23 op/s 2024-01-13T18:11:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:22 smithi084 ceph-mon[119097]: osdmap e700: 8 total, 8 up, 8 in 2024-01-13T18:11:23.399 INFO:tasks.rados.rados.0.smithi084.stdout:3232: done (6 left) 2024-01-13T18:11:23.399 INFO:tasks.rados.rados.0.smithi084.stdout:3233: done (5 left) 2024-01-13T18:11:23.399 INFO:tasks.rados.rados.0.smithi084.stdout:3234: done (4 left) 2024-01-13T18:11:23.399 INFO:tasks.rados.rados.0.smithi084.stdout:3235: done (3 left) 2024-01-13T18:11:23.399 INFO:tasks.rados.rados.0.smithi084.stdout:3236: done (2 left) 2024-01-13T18:11:23.399 INFO:tasks.rados.rados.0.smithi084.stdout:3237: done (1 left) 2024-01-13T18:11:23.399 INFO:tasks.rados.rados.0.smithi084.stdout:3238: done (0 left) 2024-01-13T18:11:23.399 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 313 2024-01-13T18:11:23.399 INFO:tasks.rados.rados.0.smithi084.stdout:3239: seq_num 1002 ranges {8208384=786432,8994816=614400,9609216=581632,10190848=409600} 2024-01-13T18:11:23.446 INFO:tasks.rados.rados.0.smithi084.stdout:3239: writing smithi084102331-49 from 8208384 to 8994816 tid 1 2024-01-13T18:11:23.449 INFO:tasks.rados.rados.0.smithi084.stdout:3239: writing smithi084102331-49 from 8994816 to 9609216 tid 2 2024-01-13T18:11:23.453 INFO:tasks.rados.rados.0.smithi084.stdout:3239: writing smithi084102331-49 from 9609216 to 10190848 tid 3 2024-01-13T18:11:23.456 INFO:tasks.rados.rados.0.smithi084.stdout:3239: writing smithi084102331-49 from 10190848 to 10600448 tid 4 2024-01-13T18:11:23.456 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 313 2024-01-13T18:11:23.456 INFO:tasks.rados.rados.0.smithi084.stdout:3239: finishing write tid 1 to smithi084102331-49 2024-01-13T18:11:23.456 INFO:tasks.rados.rados.0.smithi084.stdout:3239: finishing write tid 2 to smithi084102331-49 2024-01-13T18:11:23.456 INFO:tasks.rados.rados.0.smithi084.stdout:3240: seq_num 1003 ranges {2228224=802816,3031040=499712,3530752=737280,4268032=368640} 2024-01-13T18:11:23.472 INFO:tasks.rados.rados.0.smithi084.stdout:3240: writing smithi084102331-14 from 2228224 to 3031040 tid 1 2024-01-13T18:11:23.475 INFO:tasks.rados.rados.0.smithi084.stdout:3240: writing smithi084102331-14 from 3031040 to 3530752 tid 2 2024-01-13T18:11:23.479 INFO:tasks.rados.rados.0.smithi084.stdout:3240: writing smithi084102331-14 from 3530752 to 4268032 tid 3 2024-01-13T18:11:23.482 INFO:tasks.rados.rados.0.smithi084.stdout:3240: writing smithi084102331-14 from 4268032 to 4636672 tid 4 2024-01-13T18:11:23.482 INFO:tasks.rados.rados.0.smithi084.stdout:3241: rollback oid 26 current snap is 313 2024-01-13T18:11:23.482 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 311 2024-01-13T18:11:23.483 INFO:tasks.rados.rados.0.smithi084.stdout:3239: finishing write tid 3 to smithi084102331-49 2024-01-13T18:11:23.483 INFO:tasks.rados.rados.0.smithi084.stdout:3239: finishing write tid 4 to smithi084102331-49 2024-01-13T18:11:23.483 INFO:tasks.rados.rados.0.smithi084.stdout:3239: finishing write tid 5 to smithi084102331-49 2024-01-13T18:11:23.483 INFO:tasks.rados.rados.0.smithi084.stdout:3239: finishing write tid 6 to smithi084102331-49 2024-01-13T18:11:23.483 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1502 (ObjNum 1002 snap 313 seq_num 1002) dirty exists 2024-01-13T18:11:23.483 INFO:tasks.rados.rados.0.smithi084.stdout:3239: left oid 49 (ObjNum 1002 snap 313 seq_num 1002) 2024-01-13T18:11:23.483 INFO:tasks.rados.rados.0.smithi084.stdout:3240: finishing write tid 1 to smithi084102331-14 2024-01-13T18:11:23.483 INFO:tasks.rados.rados.0.smithi084.stdout:3240: finishing write tid 2 to smithi084102331-14 2024-01-13T18:11:23.483 INFO:tasks.rados.rados.0.smithi084.stdout:3239: done (2 left) 2024-01-13T18:11:23.483 INFO:tasks.rados.rados.0.smithi084.stdout:3242: delete oid 33 current snap is 313 2024-01-13T18:11:23.483 INFO:tasks.rados.rados.0.smithi084.stdout:3240: finishing write tid 3 to smithi084102331-14 2024-01-13T18:11:23.484 INFO:tasks.rados.rados.0.smithi084.stdout:3240: finishing write tid 4 to smithi084102331-14 2024-01-13T18:11:23.484 INFO:tasks.rados.rados.0.smithi084.stdout:3242: done (2 left) 2024-01-13T18:11:23.484 INFO:tasks.rados.rados.0.smithi084.stdout:3243: delete oid 34 current snap is 313 2024-01-13T18:11:23.484 INFO:tasks.rados.rados.0.smithi084.stdout:3240: finishing write tid 5 to smithi084102331-14 2024-01-13T18:11:23.488 INFO:tasks.rados.rados.0.smithi084.stdout:3240: finishing write tid 6 to smithi084102331-14 2024-01-13T18:11:23.488 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1507 (ObjNum 1003 snap 313 seq_num 1003) dirty exists 2024-01-13T18:11:23.488 INFO:tasks.rados.rados.0.smithi084.stdout:3240: left oid 14 (ObjNum 1003 snap 313 seq_num 1003) 2024-01-13T18:11:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:3240: done (2 left) 2024-01-13T18:11:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:3243: done (1 left) 2024-01-13T18:11:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:3244: read oid 23 snap 309 2024-01-13T18:11:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:3244: expect deleted 2024-01-13T18:11:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:3245: snap_remove snap 310 2024-01-13T18:11:23.835 INFO:tasks.rados.rados.0.smithi084.stdout:3245: done (2 left) 2024-01-13T18:11:23.836 INFO:tasks.rados.rados.0.smithi084.stdout:3246: delete oid 8 current snap is 313 2024-01-13T18:11:23.836 INFO:tasks.rados.rados.0.smithi084.stdout:3241: finishing rollback tid 0 to smithi084102331-26 2024-01-13T18:11:23.836 INFO:tasks.rados.rados.0.smithi084.stdout:3241: finishing rollback tid 1 to smithi084102331-26 2024-01-13T18:11:23.836 INFO:tasks.rados.rados.0.smithi084.stdout:3241: finishing rollback tid 2 to smithi084102331-26 2024-01-13T18:11:23.836 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1510 (ObjNum 33 snap 0 seq_num 4038011312) dirty exists 2024-01-13T18:11:23.840 INFO:tasks.rados.rados.0.smithi084.stdout:3241: done (2 left) 2024-01-13T18:11:23.841 INFO:tasks.rados.rados.0.smithi084.stdout:3244: done (1 left) 2024-01-13T18:11:23.841 INFO:tasks.rados.rados.0.smithi084.stdout:3246: done (0 left) 2024-01-13T18:11:23.841 INFO:tasks.rados.rados.0.smithi084.stdout:3247: rollback oid 41 current snap is 313 2024-01-13T18:11:23.841 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 311 2024-01-13T18:11:23.841 INFO:tasks.rados.rados.0.smithi084.stdout:3248: rollback oid 19 current snap is 313 2024-01-13T18:11:23.841 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 19 to 312 2024-01-13T18:11:23.841 INFO:tasks.rados.rados.0.smithi084.stdout:3249: rollback oid 24 current snap is 313 2024-01-13T18:11:23.841 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 312 2024-01-13T18:11:23.841 INFO:tasks.rados.rados.0.smithi084.stdout:3250: snap_create 2024-01-13T18:11:23.845 INFO:tasks.rados.rados.0.smithi084.stdout:3247: finishing rollback tid 1 to smithi084102331-41 2024-01-13T18:11:23.846 INFO:tasks.rados.rados.0.smithi084.stdout:3248: finishing rollback tid 0 to smithi084102331-19 2024-01-13T18:11:23.846 INFO:tasks.rados.rados.0.smithi084.stdout:3248: finishing rollback tid 1 to smithi084102331-19 2024-01-13T18:11:23.846 INFO:tasks.rados.rados.0.smithi084.stdout:3247: finishing rollback tid 2 to smithi084102331-41 2024-01-13T18:11:23.846 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1507 (ObjNum 959 snap 301 seq_num 959) dirty exists 2024-01-13T18:11:23.846 INFO:tasks.rados.rados.0.smithi084.stdout:3248: finishing rollback tid 2 to smithi084102331-19 2024-01-13T18:11:23.846 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 1309 (ObjNum 967 snap 306 seq_num 967) dirty exists 2024-01-13T18:11:23.847 INFO:tasks.rados.rados.0.smithi084.stdout:3249: finishing rollback tid 0 to smithi084102331-24 2024-01-13T18:11:23.847 INFO:tasks.rados.rados.0.smithi084.stdout:3249: finishing rollback tid 1 to smithi084102331-24 2024-01-13T18:11:23.847 INFO:tasks.rados.rados.0.smithi084.stdout:3249: finishing rollback tid 2 to smithi084102331-24 2024-01-13T18:11:23.847 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1357 (ObjNum 879 snap 279 seq_num 879) dirty exists 2024-01-13T18:11:24.838 INFO:tasks.rados.rados.0.smithi084.stdout:3247: done (3 left) 2024-01-13T18:11:24.839 INFO:tasks.rados.rados.0.smithi084.stdout:3248: done (2 left) 2024-01-13T18:11:24.839 INFO:tasks.rados.rados.0.smithi084.stdout:3249: done (1 left) 2024-01-13T18:11:24.839 INFO:tasks.rados.rados.0.smithi084.stdout:3250: done (0 left) 2024-01-13T18:11:24.839 INFO:tasks.rados.rados.0.smithi084.stdout:3251: read oid 49 snap -1 2024-01-13T18:11:24.839 INFO:tasks.rados.rados.0.smithi084.stdout:3251: expect (ObjNum 1002 snap 313 seq_num 1002) 2024-01-13T18:11:24.839 INFO:tasks.rados.rados.0.smithi084.stdout:3252: snap_create 2024-01-13T18:11:24.875 INFO:tasks.rados.rados.0.smithi084.stdout:3251: expect (ObjNum 1002 snap 313 seq_num 1002) 2024-01-13T18:11:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:24 smithi099 ceph-mon[138788]: osdmap e701: 8 total, 8 up, 8 in 2024-01-13T18:11:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:24 smithi099 ceph-mon[138788]: pgmap v764: 121 pgs: 121 active+clean; 202 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 38 MiB/s rd, 5.7 MiB/s wr, 29 op/s 2024-01-13T18:11:25.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:24 smithi084 ceph-mon[119097]: osdmap e701: 8 total, 8 up, 8 in 2024-01-13T18:11:25.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:24 smithi084 ceph-mon[119097]: pgmap v764: 121 pgs: 121 active+clean; 202 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 38 MiB/s rd, 5.7 MiB/s wr, 29 op/s 2024-01-13T18:11:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:24 smithi084 ceph-mon[116404]: osdmap e701: 8 total, 8 up, 8 in 2024-01-13T18:11:25.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:24 smithi084 ceph-mon[116404]: pgmap v764: 121 pgs: 121 active+clean; 202 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 38 MiB/s rd, 5.7 MiB/s wr, 29 op/s 2024-01-13T18:11:25.839 INFO:tasks.rados.rados.0.smithi084.stdout:3251: done (1 left) 2024-01-13T18:11:25.839 INFO:tasks.rados.rados.0.smithi084.stdout:3252: done (0 left) 2024-01-13T18:11:25.839 INFO:tasks.rados.rados.0.smithi084.stdout:3253: delete oid 3 current snap is 315 2024-01-13T18:11:25.846 INFO:tasks.rados.rados.0.smithi084.stdout:3253: done (0 left) 2024-01-13T18:11:25.846 INFO:tasks.rados.rados.0.smithi084.stdout:3254: copy_from oid 15 from oid 27 current snap is 315 2024-01-13T18:11:25.846 INFO:tasks.rados.rados.0.smithi084.stdout:3255: setattr oid 44 current snap is 315 2024-01-13T18:11:25.847 INFO:tasks.rados.rados.0.smithi084.stdout:3256: read oid 16 snap 314 2024-01-13T18:11:25.847 INFO:tasks.rados.rados.0.smithi084.stdout:3256: expect deleted 2024-01-13T18:11:25.847 INFO:tasks.rados.rados.0.smithi084.stdout:3257: setattr oid 25 current snap is 315 2024-01-13T18:11:25.848 INFO:tasks.rados.rados.0.smithi084.stdout:3256: done (3 left) 2024-01-13T18:11:25.848 INFO:tasks.rados.rados.0.smithi084.stdout:3258: read oid 45 snap 314 2024-01-13T18:11:25.848 INFO:tasks.rados.rados.0.smithi084.stdout:3258: expect (ObjNum 990 snap 311 seq_num 990) 2024-01-13T18:11:25.848 INFO:tasks.rados.rados.0.smithi084.stdout:3259: delete oid 19 current snap is 315 2024-01-13T18:11:25.854 INFO:tasks.rados.rados.0.smithi084.stdout:3254: finishing copy_from to smithi084102331-15 2024-01-13T18:11:25.854 INFO:tasks.rados.rados.0.smithi084.stdout:3254: got expected ENOENT (src dne) 2024-01-13T18:11:25.854 INFO:tasks.rados.rados.0.smithi084.stdout:3254: finishing copy_from racing read to smithi084102331-15 2024-01-13T18:11:25.855 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1456 (ObjNum 980 snap 309 seq_num 980) dirty exists 2024-01-13T18:11:25.855 INFO:tasks.rados.rados.0.smithi084.stdout:3254: done (4 left) 2024-01-13T18:11:25.855 INFO:tasks.rados.rados.0.smithi084.stdout:3257: done (3 left) 2024-01-13T18:11:25.855 INFO:tasks.rados.rados.0.smithi084.stdout:3259: done (2 left) 2024-01-13T18:11:25.856 INFO:tasks.rados.rados.0.smithi084.stdout:3260: read oid 48 snap -1 2024-01-13T18:11:25.856 INFO:tasks.rados.rados.0.smithi084.stdout:3260: expect deleted 2024-01-13T18:11:25.856 INFO:tasks.rados.rados.0.smithi084.stdout:3261: rollback oid 29 current snap is 315 2024-01-13T18:11:25.856 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 313 2024-01-13T18:11:25.856 INFO:tasks.rados.rados.0.smithi084.stdout:3262: snap_create 2024-01-13T18:11:25.856 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1711 (ObjNum 988 snap 310 seq_num 988) dirty exists 2024-01-13T18:11:25.860 INFO:tasks.rados.rados.0.smithi084.stdout:3261: finishing rollback tid 0 to smithi084102331-29 2024-01-13T18:11:25.865 INFO:tasks.rados.rados.0.smithi084.stdout:3261: finishing rollback tid 1 to smithi084102331-29 2024-01-13T18:11:25.865 INFO:tasks.rados.rados.0.smithi084.stdout:3261: finishing rollback tid 2 to smithi084102331-29 2024-01-13T18:11:25.866 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1634 (ObjNum 983 snap 309 seq_num 983) dirty exists 2024-01-13T18:11:25.875 INFO:tasks.rados.rados.0.smithi084.stdout:3258: expect (ObjNum 990 snap 311 seq_num 990) 2024-01-13T18:11:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:25 smithi099 ceph-mon[138788]: osdmap e702: 8 total, 8 up, 8 in 2024-01-13T18:11:26.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:25 smithi084 ceph-mon[116404]: osdmap e702: 8 total, 8 up, 8 in 2024-01-13T18:11:26.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:25 smithi084 ceph-mon[119097]: osdmap e702: 8 total, 8 up, 8 in 2024-01-13T18:11:26.857 INFO:tasks.rados.rados.0.smithi084.stdout:3255: done (4 left) 2024-01-13T18:11:26.857 INFO:tasks.rados.rados.0.smithi084.stdout:3258: done (3 left) 2024-01-13T18:11:26.857 INFO:tasks.rados.rados.0.smithi084.stdout:3260: done (2 left) 2024-01-13T18:11:26.857 INFO:tasks.rados.rados.0.smithi084.stdout:3261: done (1 left) 2024-01-13T18:11:26.857 INFO:tasks.rados.rados.0.smithi084.stdout:3262: done (0 left) 2024-01-13T18:11:26.857 INFO:tasks.rados.rados.0.smithi084.stdout:3263: rollback oid 24 current snap is 316 2024-01-13T18:11:26.857 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 312 2024-01-13T18:11:26.857 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 316 2024-01-13T18:11:26.857 INFO:tasks.rados.rados.0.smithi084.stdout:3264: seq_num 1009 ranges {0=106496} 2024-01-13T18:11:26.857 INFO:tasks.rados.rados.0.smithi084.stdout:3264: writing smithi084102331-22 from 0 to 106496 tid 1 2024-01-13T18:11:26.858 INFO:tasks.rados.rados.0.smithi084.stdout:3265: delete oid 47 current snap is 316 2024-01-13T18:11:26.864 INFO:tasks.rados.rados.0.smithi084.stdout:3265: done (2 left) 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:3266: copy_from oid 10 from oid 50 current snap is 316 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:3267: setattr oid 28 current snap is 316 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:3263: finishing rollback tid 0 to smithi084102331-24 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:3268: rollback oid 33 current snap is 316 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 33 to 314 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:3269: rmattr oid 35 current snap is 316 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:3270: rollback oid 7 current snap is 316 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 7 to 313 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:3271: copy_from oid 46 from oid 4 current snap is 316 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:3272: rollback oid 9 current snap is 316 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 313 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 316 2024-01-13T18:11:26.865 INFO:tasks.rados.rados.0.smithi084.stdout:3273: seq_num 1011 ranges {7577600=139264} 2024-01-13T18:11:26.907 INFO:tasks.rados.rados.0.smithi084.stdout:3273: writing smithi084102331-45 from 7577600 to 7716864 tid 1 2024-01-13T18:11:26.907 INFO:tasks.rados.rados.0.smithi084.stdout:3274: read oid 25 snap 313 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:3274: expect (ObjNum 980 snap 309 seq_num 980) 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:3275: rmattr oid 29 current snap is 316 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:3263: finishing rollback tid 1 to smithi084102331-24 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:3276: delete oid 21 current snap is 316 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:3263: finishing rollback tid 2 to smithi084102331-24 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1360 (ObjNum 879 snap 279 seq_num 879) dirty exists 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:3264: finishing write tid 1 to smithi084102331-22 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:3264: finishing write tid 2 to smithi084102331-22 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:3266: finishing copy_from to smithi084102331-10 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:3266: got expected ENOENT (src dne) 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:3266: finishing copy_from racing read to smithi084102331-10 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:3264: finishing write tid 3 to smithi084102331-22 2024-01-13T18:11:26.908 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1722 (ObjNum 1009 snap 316 seq_num 1009) dirty exists 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:3264: left oid 22 (ObjNum 1009 snap 316 seq_num 1009) 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:3268: finishing rollback tid 1 to smithi084102331-33 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1452 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:3270: finishing rollback tid 1 to smithi084102331-7 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1354 (ObjNum 33 snap 0 seq_num 4036987040) dirty dne 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:3272: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1635 (ObjNum 1000 snap 313 seq_num 1000) dirty exists 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1497 (ObjNum 908 snap 282 seq_num 908) dirty exists 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:3272: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:3272: finishing rollback tid 2 to smithi084102331-9 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1502 (ObjNum 929 snap 294 seq_num 929) dirty exists 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:3271: finishing copy_from to smithi084102331-46 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1412 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:3271: finishing copy_from racing read to smithi084102331-46 2024-01-13T18:11:26.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 0 (ObjNum 983 snap 309 seq_num 983) dirty exists 2024-01-13T18:11:26.910 INFO:tasks.rados.rados.0.smithi084.stdout:3263: done (12 left) 2024-01-13T18:11:26.910 INFO:tasks.rados.rados.0.smithi084.stdout:3264: done (11 left) 2024-01-13T18:11:26.910 INFO:tasks.rados.rados.0.smithi084.stdout:3266: done (10 left) 2024-01-13T18:11:26.910 INFO:tasks.rados.rados.0.smithi084.stdout:3267: done (9 left) 2024-01-13T18:11:26.910 INFO:tasks.rados.rados.0.smithi084.stdout:3268: done (8 left) 2024-01-13T18:11:26.910 INFO:tasks.rados.rados.0.smithi084.stdout:3269: done (7 left) 2024-01-13T18:11:26.910 INFO:tasks.rados.rados.0.smithi084.stdout:3270: done (6 left) 2024-01-13T18:11:26.910 INFO:tasks.rados.rados.0.smithi084.stdout:3271: done (5 left) 2024-01-13T18:11:26.910 INFO:tasks.rados.rados.0.smithi084.stdout:3272: done (4 left) 2024-01-13T18:11:26.911 INFO:tasks.rados.rados.0.smithi084.stdout:3275: done (3 left) 2024-01-13T18:11:26.911 INFO:tasks.rados.rados.0.smithi084.stdout:3276: done (2 left) 2024-01-13T18:11:26.911 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 316 2024-01-13T18:11:26.911 INFO:tasks.rados.rados.0.smithi084.stdout:3277: seq_num 1013 ranges {4153344=172032} 2024-01-13T18:11:26.935 INFO:tasks.rados.rados.0.smithi084.stdout:3277: writing smithi084102331-44 from 4153344 to 4325376 tid 1 2024-01-13T18:11:26.935 INFO:tasks.rados.rados.0.smithi084.stdout:3278: read oid 14 snap -1 2024-01-13T18:11:26.935 INFO:tasks.rados.rados.0.smithi084.stdout:3278: expect (ObjNum 1003 snap 313 seq_num 1003) 2024-01-13T18:11:26.935 INFO:tasks.rados.rados.0.smithi084.stdout:3279: read oid 21 snap -1 2024-01-13T18:11:26.935 INFO:tasks.rados.rados.0.smithi084.stdout:3279: expect deleted 2024-01-13T18:11:26.935 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 316 2024-01-13T18:11:26.935 INFO:tasks.rados.rados.0.smithi084.stdout:3273: finishing write tid 1 to smithi084102331-45 2024-01-13T18:11:26.935 INFO:tasks.rados.rados.0.smithi084.stdout:3280: seq_num 1014 ranges {11067392=188416} 2024-01-13T18:11:26.995 INFO:tasks.rados.rados.0.smithi084.stdout:3280: writing smithi084102331-18 from 11067392 to 11255808 tid 1 2024-01-13T18:11:26.995 INFO:tasks.rados.rados.0.smithi084.stdout:3281: rollback oid 8 current snap is 316 2024-01-13T18:11:26.995 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 314 2024-01-13T18:11:26.995 INFO:tasks.rados.rados.0.smithi084.stdout:3273: finishing write tid 2 to smithi084102331-45 2024-01-13T18:11:26.995 INFO:tasks.rados.rados.0.smithi084.stdout:3273: finishing write tid 3 to smithi084102331-45 2024-01-13T18:11:26.995 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1673 (ObjNum 1011 snap 316 seq_num 1011) dirty exists 2024-01-13T18:11:26.995 INFO:tasks.rados.rados.0.smithi084.stdout:3273: left oid 45 (ObjNum 1011 snap 316 seq_num 1011) 2024-01-13T18:11:26.995 INFO:tasks.rados.rados.0.smithi084.stdout:3274: expect (ObjNum 980 snap 309 seq_num 980) 2024-01-13T18:11:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:26 smithi099 ceph-mon[138788]: osdmap e703: 8 total, 8 up, 8 in 2024-01-13T18:11:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:26 smithi099 ceph-mon[138788]: pgmap v767: 121 pgs: 121 active+clean; 209 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 4.4 MiB/s wr, 18 op/s 2024-01-13T18:11:27.163 INFO:tasks.rados.rados.0.smithi084.stdout:3277: finishing write tid 1 to smithi084102331-44 2024-01-13T18:11:27.163 INFO:tasks.rados.rados.0.smithi084.stdout:3277: finishing write tid 2 to smithi084102331-44 2024-01-13T18:11:27.163 INFO:tasks.rados.rados.0.smithi084.stdout:3277: finishing write tid 3 to smithi084102331-44 2024-01-13T18:11:27.163 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1714 (ObjNum 1013 snap 316 seq_num 1013) dirty exists 2024-01-13T18:11:27.163 INFO:tasks.rados.rados.0.smithi084.stdout:3277: left oid 44 (ObjNum 1013 snap 316 seq_num 1013) 2024-01-13T18:11:27.163 INFO:tasks.rados.rados.0.smithi084.stdout:3278: expect (ObjNum 1003 snap 313 seq_num 1003) 2024-01-13T18:11:27.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:26 smithi084 ceph-mon[116404]: osdmap e703: 8 total, 8 up, 8 in 2024-01-13T18:11:27.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:26 smithi084 ceph-mon[116404]: pgmap v767: 121 pgs: 121 active+clean; 209 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 4.4 MiB/s wr, 18 op/s 2024-01-13T18:11:27.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:26 smithi084 ceph-mon[119097]: osdmap e703: 8 total, 8 up, 8 in 2024-01-13T18:11:27.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:26 smithi084 ceph-mon[119097]: pgmap v767: 121 pgs: 121 active+clean; 209 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 4.4 MiB/s wr, 18 op/s 2024-01-13T18:11:27.315 INFO:tasks.rados.rados.0.smithi084.stdout:3281: finishing rollback tid 1 to smithi084102331-8 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1710 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:3280: finishing write tid 1 to smithi084102331-18 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:3280: finishing write tid 2 to smithi084102331-18 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:3280: finishing write tid 3 to smithi084102331-18 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1495 (ObjNum 1014 snap 316 seq_num 1014) dirty exists 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:3280: left oid 18 (ObjNum 1014 snap 316 seq_num 1014) 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:3273: done (6 left) 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:3274: done (5 left) 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:3277: done (4 left) 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:3278: done (3 left) 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:3279: done (2 left) 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:3280: done (1 left) 2024-01-13T18:11:27.316 INFO:tasks.rados.rados.0.smithi084.stdout:3281: done (0 left) 2024-01-13T18:11:27.317 INFO:tasks.rados.rados.0.smithi084.stdout:3282: rollback oid 39 current snap is 316 2024-01-13T18:11:27.317 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 311 2024-01-13T18:11:27.317 INFO:tasks.rados.rados.0.smithi084.stdout:3283: snap_create 2024-01-13T18:11:27.319 INFO:tasks.rados.rados.0.smithi084.stdout:3282: finishing rollback tid 0 to smithi084102331-39 2024-01-13T18:11:27.319 INFO:tasks.rados.rados.0.smithi084.stdout:3282: finishing rollback tid 1 to smithi084102331-39 2024-01-13T18:11:27.319 INFO:tasks.rados.rados.0.smithi084.stdout:3282: finishing rollback tid 2 to smithi084102331-39 2024-01-13T18:11:27.319 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1510 (ObjNum 976 snap 309 seq_num 976) dirty exists 2024-01-13T18:11:27.714 INFO:tasks.rados.rados.0.smithi084.stdout:3282: done (1 left) 2024-01-13T18:11:27.714 INFO:tasks.rados.rados.0.smithi084.stdout:3283: done (0 left) 2024-01-13T18:11:27.714 INFO:tasks.rados.rados.0.smithi084.stdout:3284: read oid 15 snap -1 2024-01-13T18:11:27.714 INFO:tasks.rados.rados.0.smithi084.stdout:3284: expect (ObjNum 982 snap 309 seq_num 982) 2024-01-13T18:11:27.714 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 317 2024-01-13T18:11:27.714 INFO:tasks.rados.rados.0.smithi084.stdout:3285: seq_num 1015 ranges {4546560=204800} 2024-01-13T18:11:27.740 INFO:tasks.rados.rados.0.smithi084.stdout:3285: writing smithi084102331-32 from 4546560 to 4751360 tid 1 2024-01-13T18:11:27.740 INFO:tasks.rados.rados.0.smithi084.stdout:3286: setattr oid 23 current snap is 317 2024-01-13T18:11:27.740 INFO:tasks.rados.rados.0.smithi084.stdout:3284: expect (ObjNum 982 snap 309 seq_num 982) 2024-01-13T18:11:27.797 INFO:tasks.rados.rados.0.smithi084.stdout:3285: finishing write tid 1 to smithi084102331-32 2024-01-13T18:11:27.797 INFO:tasks.rados.rados.0.smithi084.stdout:3285: finishing write tid 2 to smithi084102331-32 2024-01-13T18:11:27.798 INFO:tasks.rados.rados.0.smithi084.stdout:3285: finishing write tid 3 to smithi084102331-32 2024-01-13T18:11:27.798 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1716 (ObjNum 1015 snap 317 seq_num 1015) dirty exists 2024-01-13T18:11:27.798 INFO:tasks.rados.rados.0.smithi084.stdout:3285: left oid 32 (ObjNum 1015 snap 317 seq_num 1015) 2024-01-13T18:11:27.798 INFO:tasks.rados.rados.0.smithi084.stdout:3284: done (2 left) 2024-01-13T18:11:27.798 INFO:tasks.rados.rados.0.smithi084.stdout:3285: done (1 left) 2024-01-13T18:11:27.798 INFO:tasks.rados.rados.0.smithi084.stdout:3287: rmattr oid 24 current snap is 317 2024-01-13T18:11:27.798 INFO:tasks.rados.rados.0.smithi084.stdout:3287: done (1 left) 2024-01-13T18:11:27.798 INFO:tasks.rados.rados.0.smithi084.stdout:3288: copy_from oid 17 from oid 40 current snap is 317 2024-01-13T18:11:27.798 INFO:tasks.rados.rados.0.smithi084.stdout:3289: read oid 49 snap -1 2024-01-13T18:11:27.798 INFO:tasks.rados.rados.0.smithi084.stdout:3289: expect (ObjNum 1002 snap 313 seq_num 1002) 2024-01-13T18:11:27.798 INFO:tasks.rados.rados.0.smithi084.stdout:3290: snap_create 2024-01-13T18:11:27.804 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1723 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-01-13T18:11:27.819 INFO:tasks.rados.rados.0.smithi084.stdout:3288: finishing copy_from to smithi084102331-17 2024-01-13T18:11:27.819 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1625 (ObjNum 948 snap 300 seq_num 948) dirty exists 2024-01-13T18:11:27.819 INFO:tasks.rados.rados.0.smithi084.stdout:3288: finishing copy_from racing read to smithi084102331-17 2024-01-13T18:11:27.830 INFO:tasks.rados.rados.0.smithi084.stdout:3289: expect (ObjNum 1002 snap 313 seq_num 1002) 2024-01-13T18:11:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:27 smithi099 ceph-mon[138788]: osdmap e704: 8 total, 8 up, 8 in 2024-01-13T18:11:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:27 smithi099 ceph-mon[138788]: osdmap e705: 8 total, 8 up, 8 in 2024-01-13T18:11:28.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:27 smithi084 ceph-mon[116404]: osdmap e704: 8 total, 8 up, 8 in 2024-01-13T18:11:28.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:27 smithi084 ceph-mon[116404]: osdmap e705: 8 total, 8 up, 8 in 2024-01-13T18:11:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:27 smithi084 ceph-mon[119097]: osdmap e704: 8 total, 8 up, 8 in 2024-01-13T18:11:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:27 smithi084 ceph-mon[119097]: osdmap e705: 8 total, 8 up, 8 in 2024-01-13T18:11:28.734 INFO:tasks.rados.rados.0.smithi084.stdout:3286: done (3 left) 2024-01-13T18:11:28.734 INFO:tasks.rados.rados.0.smithi084.stdout:3288: done (2 left) 2024-01-13T18:11:28.734 INFO:tasks.rados.rados.0.smithi084.stdout:3289: done (1 left) 2024-01-13T18:11:28.734 INFO:tasks.rados.rados.0.smithi084.stdout:3290: done (0 left) 2024-01-13T18:11:28.734 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 318 2024-01-13T18:11:28.735 INFO:tasks.rados.rados.0.smithi084.stdout:3291: seq_num 1016 ranges {11255808=221184} 2024-01-13T18:11:28.794 INFO:tasks.rados.rados.0.smithi084.stdout:3291: writing smithi084102331-18 from 11255808 to 11476992 tid 1 2024-01-13T18:11:28.794 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 318 2024-01-13T18:11:28.794 INFO:tasks.rados.rados.0.smithi084.stdout:3292: seq_num 1017 ranges {0=237568} 2024-01-13T18:11:28.795 INFO:tasks.rados.rados.0.smithi084.stdout:3292: writing smithi084102331-5 from 0 to 237568 tid 1 2024-01-13T18:11:28.795 INFO:tasks.rados.rados.0.smithi084.stdout:3293: delete oid 35 current snap is 318 2024-01-13T18:11:28.797 INFO:tasks.rados.rados.0.smithi084.stdout:3291: finishing write tid 1 to smithi084102331-18 2024-01-13T18:11:28.797 INFO:tasks.rados.rados.0.smithi084.stdout:3291: finishing write tid 2 to smithi084102331-18 2024-01-13T18:11:28.799 INFO:tasks.rados.rados.0.smithi084.stdout:3292: finishing write tid 1 to smithi084102331-5 2024-01-13T18:11:28.799 INFO:tasks.rados.rados.0.smithi084.stdout:3292: finishing write tid 2 to smithi084102331-5 2024-01-13T18:11:28.799 INFO:tasks.rados.rados.0.smithi084.stdout:3291: finishing write tid 3 to smithi084102331-18 2024-01-13T18:11:28.799 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1497 (ObjNum 1016 snap 318 seq_num 1016) dirty exists 2024-01-13T18:11:28.799 INFO:tasks.rados.rados.0.smithi084.stdout:3291: left oid 18 (ObjNum 1016 snap 318 seq_num 1016) 2024-01-13T18:11:28.799 INFO:tasks.rados.rados.0.smithi084.stdout:3291: done (2 left) 2024-01-13T18:11:28.799 INFO:tasks.rados.rados.0.smithi084.stdout:3293: done (1 left) 2024-01-13T18:11:28.799 INFO:tasks.rados.rados.0.smithi084.stdout:3294: delete oid 33 current snap is 318 2024-01-13T18:11:28.800 INFO:tasks.rados.rados.0.smithi084.stdout:3292: finishing write tid 3 to smithi084102331-5 2024-01-13T18:11:28.800 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 1627 (ObjNum 1017 snap 318 seq_num 1017) dirty exists 2024-01-13T18:11:28.800 INFO:tasks.rados.rados.0.smithi084.stdout:3292: left oid 5 (ObjNum 1017 snap 318 seq_num 1017) 2024-01-13T18:11:28.801 INFO:tasks.rados.rados.0.smithi084.stdout:3292: done (1 left) 2024-01-13T18:11:28.801 INFO:tasks.rados.rados.0.smithi084.stdout:3294: done (0 left) 2024-01-13T18:11:28.801 INFO:tasks.rados.rados.0.smithi084.stdout:3295: snap_create 2024-01-13T18:11:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:28 smithi099 ceph-mon[138788]: pgmap v770: 121 pgs: 121 active+clean; 225 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 3.4 MiB/s wr, 25 op/s 2024-01-13T18:11:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:28 smithi099 ceph-mon[138788]: osdmap e706: 8 total, 8 up, 8 in 2024-01-13T18:11:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:28 smithi084 ceph-mon[116404]: pgmap v770: 121 pgs: 121 active+clean; 225 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 3.4 MiB/s wr, 25 op/s 2024-01-13T18:11:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:28 smithi084 ceph-mon[116404]: osdmap e706: 8 total, 8 up, 8 in 2024-01-13T18:11:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:28 smithi084 ceph-mon[119097]: pgmap v770: 121 pgs: 121 active+clean; 225 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 3.4 MiB/s wr, 25 op/s 2024-01-13T18:11:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:28 smithi084 ceph-mon[119097]: osdmap e706: 8 total, 8 up, 8 in 2024-01-13T18:11:29.735 INFO:tasks.rados.rados.0.smithi084.stdout:3295: done (0 left) 2024-01-13T18:11:29.736 INFO:tasks.rados.rados.0.smithi084.stdout:3296: copy_from oid 23 from oid 22 current snap is 319 2024-01-13T18:11:29.736 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 319 2024-01-13T18:11:29.736 INFO:tasks.rados.rados.0.smithi084.stdout:3297: seq_num 1020 ranges {0=286720} 2024-01-13T18:11:29.737 INFO:tasks.rados.rados.0.smithi084.stdout:3297: writing smithi084102331-33 from 0 to 286720 tid 1 2024-01-13T18:11:29.737 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 319 2024-01-13T18:11:29.737 INFO:tasks.rados.rados.0.smithi084.stdout:3298: seq_num 1021 ranges {3694592=303104} 2024-01-13T18:11:29.759 INFO:tasks.rados.rados.0.smithi084.stdout:3298: writing smithi084102331-13 from 3694592 to 3997696 tid 1 2024-01-13T18:11:29.759 INFO:tasks.rados.rados.0.smithi084.stdout:3299: rmattr oid 16 current snap is 319 2024-01-13T18:11:29.759 INFO:tasks.rados.rados.0.smithi084.stdout:3299: done (3 left) 2024-01-13T18:11:29.759 INFO:tasks.rados.rados.0.smithi084.stdout:3300: snap_create 2024-01-13T18:11:29.759 INFO:tasks.rados.rados.0.smithi084.stdout:3297: finishing write tid 1 to smithi084102331-33 2024-01-13T18:11:29.759 INFO:tasks.rados.rados.0.smithi084.stdout:3296: finishing copy_from to smithi084102331-23 2024-01-13T18:11:29.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1722 (ObjNum 1009 snap 316 seq_num 1009) dirty exists 2024-01-13T18:11:29.760 INFO:tasks.rados.rados.0.smithi084.stdout:3297: finishing write tid 2 to smithi084102331-33 2024-01-13T18:11:29.760 INFO:tasks.rados.rados.0.smithi084.stdout:3296: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:11:29.760 INFO:tasks.rados.rados.0.smithi084.stdout:3297: finishing write tid 3 to smithi084102331-33 2024-01-13T18:11:29.760 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1460 (ObjNum 1020 snap 319 seq_num 1020) dirty exists 2024-01-13T18:11:29.760 INFO:tasks.rados.rados.0.smithi084.stdout:3297: left oid 33 (ObjNum 1020 snap 319 seq_num 1020) 2024-01-13T18:11:29.762 INFO:tasks.rados.rados.0.smithi084.stdout:3298: finishing write tid 1 to smithi084102331-13 2024-01-13T18:11:29.763 INFO:tasks.rados.rados.0.smithi084.stdout:3298: finishing write tid 2 to smithi084102331-13 2024-01-13T18:11:29.765 INFO:tasks.rados.rados.0.smithi084.stdout:3298: finishing write tid 3 to smithi084102331-13 2024-01-13T18:11:29.765 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 1629 (ObjNum 1021 snap 319 seq_num 1021) dirty exists 2024-01-13T18:11:29.765 INFO:tasks.rados.rados.0.smithi084.stdout:3298: left oid 13 (ObjNum 1021 snap 319 seq_num 1021) 2024-01-13T18:11:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:11:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:11:30] "GET /metrics HTTP/1.1" 200 36191 "" "Prometheus/2.43.0" 2024-01-13T18:11:30.740 INFO:tasks.rados.rados.0.smithi084.stdout:3296: done (3 left) 2024-01-13T18:11:30.740 INFO:tasks.rados.rados.0.smithi084.stdout:3297: done (2 left) 2024-01-13T18:11:30.740 INFO:tasks.rados.rados.0.smithi084.stdout:3298: done (1 left) 2024-01-13T18:11:30.740 INFO:tasks.rados.rados.0.smithi084.stdout:3300: done (0 left) 2024-01-13T18:11:30.740 INFO:tasks.rados.rados.0.smithi084.stdout:3301: delete oid 7 current snap is 320 2024-01-13T18:11:30.744 INFO:tasks.rados.rados.0.smithi084.stdout:3301: done (0 left) 2024-01-13T18:11:30.744 INFO:tasks.rados.rados.0.smithi084.stdout:3302: snap_remove snap 319 2024-01-13T18:11:31.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:30 smithi099 ceph-mon[138788]: osdmap e707: 8 total, 8 up, 8 in 2024-01-13T18:11:31.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:30 smithi099 ceph-mon[138788]: pgmap v773: 121 pgs: 121 active+clean; 225 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 32 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2024-01-13T18:11:31.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:30 smithi084 ceph-mon[116404]: osdmap e707: 8 total, 8 up, 8 in 2024-01-13T18:11:31.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:30 smithi084 ceph-mon[116404]: pgmap v773: 121 pgs: 121 active+clean; 225 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 32 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2024-01-13T18:11:31.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:30 smithi084 ceph-mon[119097]: osdmap e707: 8 total, 8 up, 8 in 2024-01-13T18:11:31.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:30 smithi084 ceph-mon[119097]: pgmap v773: 121 pgs: 121 active+clean; 225 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 32 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2024-01-13T18:11:31.741 INFO:tasks.rados.rados.0.smithi084.stdout:3302: done (0 left) 2024-01-13T18:11:31.742 INFO:tasks.rados.rados.0.smithi084.stdout:3303: read oid 20 snap -1 2024-01-13T18:11:31.742 INFO:tasks.rados.rados.0.smithi084.stdout:3303: expect (ObjNum 974 snap 308 seq_num 974) 2024-01-13T18:11:31.742 INFO:tasks.rados.rados.0.smithi084.stdout:3304: read oid 12 snap -1 2024-01-13T18:11:31.742 INFO:tasks.rados.rados.0.smithi084.stdout:3304: expect (ObjNum 946 snap 299 seq_num 946) 2024-01-13T18:11:31.742 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 320 2024-01-13T18:11:31.742 INFO:tasks.rados.rados.0.smithi084.stdout:3305: seq_num 1023 ranges {0=335872} 2024-01-13T18:11:31.744 INFO:tasks.rados.rados.0.smithi084.stdout:3305: writing smithi084102331-3 from 0 to 335872 tid 1 2024-01-13T18:11:31.744 INFO:tasks.rados.rados.0.smithi084.stdout:3306: read oid 24 snap 318 2024-01-13T18:11:31.744 INFO:tasks.rados.rados.0.smithi084.stdout:3306: expect (ObjNum 879 snap 279 seq_num 879) 2024-01-13T18:11:31.744 INFO:tasks.rados.rados.0.smithi084.stdout:3307: copy_from oid 22 from oid 49 current snap is 320 2024-01-13T18:11:31.744 INFO:tasks.rados.rados.0.smithi084.stdout:3308: read oid 36 snap -1 2024-01-13T18:11:31.744 INFO:tasks.rados.rados.0.smithi084.stdout:3308: expect (ObjNum 985 snap 309 seq_num 985) 2024-01-13T18:11:31.744 INFO:tasks.rados.rados.0.smithi084.stdout:3309: rollback oid 40 current snap is 320 2024-01-13T18:11:31.744 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 312 2024-01-13T18:11:31.745 INFO:tasks.rados.rados.0.smithi084.stdout:3310: read oid 23 snap -1 2024-01-13T18:11:31.745 INFO:tasks.rados.rados.0.smithi084.stdout:3310: expect (ObjNum 1009 snap 316 seq_num 1009) 2024-01-13T18:11:31.746 INFO:tasks.rados.rados.0.smithi084.stdout:3311: copy_from oid 27 from oid 38 current snap is 320 2024-01-13T18:11:31.746 INFO:tasks.rados.rados.0.smithi084.stdout:3312: rollback oid 18 current snap is 320 2024-01-13T18:11:31.746 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 309 2024-01-13T18:11:31.746 INFO:tasks.rados.rados.0.smithi084.stdout:3313: setattr oid 9 current snap is 320 2024-01-13T18:11:31.747 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 320 2024-01-13T18:11:31.747 INFO:tasks.rados.rados.0.smithi084.stdout:3314: seq_num 1024 ranges {0=352256} 2024-01-13T18:11:31.749 INFO:tasks.rados.rados.0.smithi084.stdout:3314: writing smithi084102331-47 from 0 to 352256 tid 1 2024-01-13T18:11:31.749 INFO:tasks.rados.rados.0.smithi084.stdout:3315: read oid 42 snap -1 2024-01-13T18:11:31.749 INFO:tasks.rados.rados.0.smithi084.stdout:3315: expect (ObjNum 979 snap 309 seq_num 979) 2024-01-13T18:11:31.749 INFO:tasks.rados.rados.0.smithi084.stdout:3316: copy_from oid 8 from oid 17 current snap is 320 2024-01-13T18:11:31.750 INFO:tasks.rados.rados.0.smithi084.stdout:3317: read oid 31 snap -1 2024-01-13T18:11:31.750 INFO:tasks.rados.rados.0.smithi084.stdout:3317: expect deleted 2024-01-13T18:11:31.750 INFO:tasks.rados.rados.0.smithi084.stdout:3318: copy_from oid 34 from oid 1 current snap is 320 2024-01-13T18:11:31.750 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-01-13T18:11:31.762 INFO:tasks.rados.rados.0.smithi084.stdout:3312: finishing rollback tid 0 to smithi084102331-18 2024-01-13T18:11:31.762 INFO:tasks.rados.rados.0.smithi084.stdout:3314: finishing write tid 1 to smithi084102331-47 2024-01-13T18:11:31.762 INFO:tasks.rados.rados.0.smithi084.stdout:3314: finishing write tid 2 to smithi084102331-47 2024-01-13T18:11:31.762 INFO:tasks.rados.rados.0.smithi084.stdout:3314: finishing write tid 3 to smithi084102331-47 2024-01-13T18:11:31.762 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1718 (ObjNum 1024 snap 320 seq_num 1024) dirty exists 2024-01-13T18:11:31.762 INFO:tasks.rados.rados.0.smithi084.stdout:3314: left oid 47 (ObjNum 1024 snap 320 seq_num 1024) 2024-01-13T18:11:31.762 INFO:tasks.rados.rados.0.smithi084.stdout:3304: expect (ObjNum 946 snap 299 seq_num 946) 2024-01-13T18:11:31.816 INFO:tasks.rados.rados.0.smithi084.stdout:3310: expect (ObjNum 1009 snap 316 seq_num 1009) 2024-01-13T18:11:31.820 INFO:tasks.rados.rados.0.smithi084.stdout:3312: finishing rollback tid 1 to smithi084102331-18 2024-01-13T18:11:31.820 INFO:tasks.rados.rados.0.smithi084.stdout:3312: finishing rollback tid 2 to smithi084102331-18 2024-01-13T18:11:31.820 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1500 (ObjNum 929 snap 294 seq_num 929) dirty exists 2024-01-13T18:11:31.820 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1503 (ObjNum 929 snap 294 seq_num 929) dirty exists 2024-01-13T18:11:31.820 INFO:tasks.rados.rados.0.smithi084.stdout:3309: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:11:31.820 INFO:tasks.rados.rados.0.smithi084.stdout:3309: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:11:31.820 INFO:tasks.rados.rados.0.smithi084.stdout:3305: finishing write tid 1 to smithi084102331-3 2024-01-13T18:11:31.820 INFO:tasks.rados.rados.0.smithi084.stdout:3305: finishing write tid 2 to smithi084102331-3 2024-01-13T18:11:31.820 INFO:tasks.rados.rados.0.smithi084.stdout:3304: done (15 left) 2024-01-13T18:11:31.820 INFO:tasks.rados.rados.0.smithi084.stdout:3310: done (14 left) 2024-01-13T18:11:31.820 INFO:tasks.rados.rados.0.smithi084.stdout:3312: done (13 left) 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:3313: done (12 left) 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:3314: done (11 left) 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:3317: done (10 left) 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:3319: read oid 48 snap 311 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:3319: expect deleted 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:3320: setattr oid 44 current snap is 320 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:3309: finishing rollback tid 2 to smithi084102331-40 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1640 (ObjNum 948 snap 300 seq_num 948) dirty exists 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:3305: finishing write tid 3 to smithi084102331-3 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1675 (ObjNum 1023 snap 320 seq_num 1023) dirty exists 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:3305: left oid 3 (ObjNum 1023 snap 320 seq_num 1023) 2024-01-13T18:11:31.821 INFO:tasks.rados.rados.0.smithi084.stdout:3315: expect (ObjNum 979 snap 309 seq_num 979) 2024-01-13T18:11:31.867 INFO:tasks.rados.rados.0.smithi084.stdout:3308: expect (ObjNum 985 snap 309 seq_num 985) 2024-01-13T18:11:32.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:31 smithi099 ceph-mon[138788]: osdmap e708: 8 total, 8 up, 8 in 2024-01-13T18:11:32.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:31 smithi084 ceph-mon[116404]: osdmap e708: 8 total, 8 up, 8 in 2024-01-13T18:11:32.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:31 smithi084 ceph-mon[119097]: osdmap e708: 8 total, 8 up, 8 in 2024-01-13T18:11:32.193 INFO:tasks.rados.rados.0.smithi084.stdout:3303: expect (ObjNum 974 snap 308 seq_num 974) 2024-01-13T18:11:32.451 INFO:tasks.rados.rados.0.smithi084.stdout:3306: expect (ObjNum 879 snap 279 seq_num 879) 2024-01-13T18:11:32.535 INFO:tasks.rados.rados.0.smithi084.stdout:3316: finishing copy_from to smithi084102331-8 2024-01-13T18:11:32.535 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1625 (ObjNum 948 snap 300 seq_num 948) dirty exists 2024-01-13T18:11:32.535 INFO:tasks.rados.rados.0.smithi084.stdout:3311: finishing copy_from to smithi084102331-27 2024-01-13T18:11:32.535 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1609 (ObjNum 969 snap 307 seq_num 969) dirty exists 2024-01-13T18:11:32.535 INFO:tasks.rados.rados.0.smithi084.stdout:3316: finishing copy_from racing read to smithi084102331-8 2024-01-13T18:11:32.535 INFO:tasks.rados.rados.0.smithi084.stdout:3311: finishing copy_from racing read to smithi084102331-27 2024-01-13T18:11:32.535 INFO:tasks.rados.rados.0.smithi084.stdout:3318: finishing copy_from to smithi084102331-34 2024-01-13T18:11:32.535 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 1650 (ObjNum 991 snap 311 seq_num 991) dirty exists 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3318: finishing copy_from racing read to smithi084102331-34 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3307: finishing copy_from to smithi084102331-22 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1502 (ObjNum 1002 snap 313 seq_num 1002) dirty exists 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3307: finishing copy_from racing read to smithi084102331-22 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3303: done (11 left) 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3305: done (10 left) 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3306: done (9 left) 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3307: done (8 left) 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3308: done (7 left) 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3309: done (6 left) 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3311: done (5 left) 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3315: done (4 left) 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3316: done (3 left) 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3318: done (2 left) 2024-01-13T18:11:32.536 INFO:tasks.rados.rados.0.smithi084.stdout:3319: done (1 left) 2024-01-13T18:11:32.537 INFO:tasks.rados.rados.0.smithi084.stdout:3321: snap_remove snap 314 2024-01-13T18:11:32.715 INFO:tasks.rados.rados.0.smithi084.stdout:3321: done (1 left) 2024-01-13T18:11:32.715 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 320 2024-01-13T18:11:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3322: seq_num 1025 ranges {0=368640} 2024-01-13T18:11:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3322: writing smithi084102331-10 from 0 to 368640 tid 1 2024-01-13T18:11:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3323: copy_from oid 14 from oid 38 current snap is 320 2024-01-13T18:11:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3324: snap_remove snap 316 2024-01-13T18:11:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:32 smithi099 ceph-mon[138788]: osdmap e709: 8 total, 8 up, 8 in 2024-01-13T18:11:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:32 smithi099 ceph-mon[138788]: pgmap v776: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 229 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2024-01-13T18:11:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:32 smithi099 ceph-mon[138788]: osdmap e710: 8 total, 8 up, 8 in 2024-01-13T18:11:33.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:32 smithi084 ceph-mon[116404]: osdmap e709: 8 total, 8 up, 8 in 2024-01-13T18:11:33.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:32 smithi084 ceph-mon[116404]: pgmap v776: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 229 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2024-01-13T18:11:33.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:32 smithi084 ceph-mon[116404]: osdmap e710: 8 total, 8 up, 8 in 2024-01-13T18:11:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:32 smithi084 ceph-mon[119097]: osdmap e709: 8 total, 8 up, 8 in 2024-01-13T18:11:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:32 smithi084 ceph-mon[119097]: pgmap v776: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 229 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2024-01-13T18:11:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:32 smithi084 ceph-mon[119097]: osdmap e710: 8 total, 8 up, 8 in 2024-01-13T18:11:33.717 INFO:tasks.rados.rados.0.smithi084.stdout:3324: done (3 left) 2024-01-13T18:11:33.717 INFO:tasks.rados.rados.0.smithi084.stdout:3325: read oid 6 snap 318 2024-01-13T18:11:33.717 INFO:tasks.rados.rados.0.smithi084.stdout:3325: expect (ObjNum 920 snap 287 seq_num 920) 2024-01-13T18:11:33.718 INFO:tasks.rados.rados.0.smithi084.stdout:3326: delete oid 15 current snap is 320 2024-01-13T18:11:33.718 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1719 (ObjNum 1013 snap 316 seq_num 1013) dirty exists 2024-01-13T18:11:33.718 INFO:tasks.rados.rados.0.smithi084.stdout:3322: finishing write tid 1 to smithi084102331-10 2024-01-13T18:11:33.718 INFO:tasks.rados.rados.0.smithi084.stdout:3322: finishing write tid 2 to smithi084102331-10 2024-01-13T18:11:33.718 INFO:tasks.rados.rados.0.smithi084.stdout:3322: finishing write tid 3 to smithi084102331-10 2024-01-13T18:11:33.718 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1502 (ObjNum 1025 snap 320 seq_num 1025) dirty exists 2024-01-13T18:11:33.718 INFO:tasks.rados.rados.0.smithi084.stdout:3322: left oid 10 (ObjNum 1025 snap 320 seq_num 1025) 2024-01-13T18:11:33.718 INFO:tasks.rados.rados.0.smithi084.stdout:3323: finishing copy_from to smithi084102331-14 2024-01-13T18:11:33.718 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1609 (ObjNum 969 snap 307 seq_num 969) dirty exists 2024-01-13T18:11:33.718 INFO:tasks.rados.rados.0.smithi084.stdout:3323: finishing copy_from racing read to smithi084102331-14 2024-01-13T18:11:33.726 INFO:tasks.rados.rados.0.smithi084.stdout:3320: done (4 left) 2024-01-13T18:11:33.726 INFO:tasks.rados.rados.0.smithi084.stdout:3322: done (3 left) 2024-01-13T18:11:33.726 INFO:tasks.rados.rados.0.smithi084.stdout:3323: done (2 left) 2024-01-13T18:11:33.726 INFO:tasks.rados.rados.0.smithi084.stdout:3326: done (1 left) 2024-01-13T18:11:33.726 INFO:tasks.rados.rados.0.smithi084.stdout:3327: copy_from oid 22 from oid 49 current snap is 320 2024-01-13T18:11:33.726 INFO:tasks.rados.rados.0.smithi084.stdout:3328: snap_create 2024-01-13T18:11:33.749 INFO:tasks.rados.rados.0.smithi084.stdout:3325: expect (ObjNum 920 snap 287 seq_num 920) 2024-01-13T18:11:33.972 INFO:tasks.rados.rados.0.smithi084.stdout:3327: finishing copy_from to smithi084102331-22 2024-01-13T18:11:33.972 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1502 (ObjNum 1002 snap 313 seq_num 1002) dirty exists 2024-01-13T18:11:33.972 INFO:tasks.rados.rados.0.smithi084.stdout:3327: finishing copy_from racing read to smithi084102331-22 2024-01-13T18:11:34.724 INFO:tasks.rados.rados.0.smithi084.stdout:3325: done (2 left) 2024-01-13T18:11:34.724 INFO:tasks.rados.rados.0.smithi084.stdout:3327: done (1 left) 2024-01-13T18:11:34.724 INFO:tasks.rados.rados.0.smithi084.stdout:3328: done (0 left) 2024-01-13T18:11:34.724 INFO:tasks.rados.rados.0.smithi084.stdout:3329: delete oid 41 current snap is 321 2024-01-13T18:11:34.728 INFO:tasks.rados.rados.0.smithi084.stdout:3329: done (0 left) 2024-01-13T18:11:34.728 INFO:tasks.rados.rados.0.smithi084.stdout:3330: read oid 12 snap 318 2024-01-13T18:11:34.728 INFO:tasks.rados.rados.0.smithi084.stdout:3330: expect (ObjNum 946 snap 299 seq_num 946) 2024-01-13T18:11:34.728 INFO:tasks.rados.rados.0.smithi084.stdout:3331: snap_remove snap 320 2024-01-13T18:11:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:34 smithi099 ceph-mon[138788]: osdmap e711: 8 total, 8 up, 8 in 2024-01-13T18:11:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:34 smithi099 ceph-mon[138788]: pgmap v779: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 233 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 MiB/s wr, 27 op/s 2024-01-13T18:11:35.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:34 smithi084 ceph-mon[116404]: osdmap e711: 8 total, 8 up, 8 in 2024-01-13T18:11:35.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:34 smithi084 ceph-mon[116404]: pgmap v779: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 233 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 MiB/s wr, 27 op/s 2024-01-13T18:11:35.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:34 smithi084 ceph-mon[119097]: osdmap e711: 8 total, 8 up, 8 in 2024-01-13T18:11:35.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:34 smithi084 ceph-mon[119097]: pgmap v779: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 233 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 MiB/s wr, 27 op/s 2024-01-13T18:11:35.728 INFO:tasks.rados.rados.0.smithi084.stdout:3331: done (1 left) 2024-01-13T18:11:35.729 INFO:tasks.rados.rados.0.smithi084.stdout:3332: snap_create 2024-01-13T18:11:35.729 INFO:tasks.rados.rados.0.smithi084.stdout:3330: expect (ObjNum 946 snap 299 seq_num 946) 2024-01-13T18:11:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:35 smithi099 ceph-mon[138788]: osdmap e712: 8 total, 8 up, 8 in 2024-01-13T18:11:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:36.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:35 smithi084 ceph-mon[116404]: osdmap e712: 8 total, 8 up, 8 in 2024-01-13T18:11:36.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:35 smithi084 ceph-mon[119097]: osdmap e712: 8 total, 8 up, 8 in 2024-01-13T18:11:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:36.735 INFO:tasks.rados.rados.0.smithi084.stdout:3330: done (1 left) 2024-01-13T18:11:36.735 INFO:tasks.rados.rados.0.smithi084.stdout:3332: done (0 left) 2024-01-13T18:11:36.735 INFO:tasks.rados.rados.0.smithi084.stdout:3333: read oid 37 snap -1 2024-01-13T18:11:36.735 INFO:tasks.rados.rados.0.smithi084.stdout:3333: expect (ObjNum 942 snap 298 seq_num 942) 2024-01-13T18:11:36.735 INFO:tasks.rados.rados.0.smithi084.stdout:3334: rmattr oid 21 current snap is 322 2024-01-13T18:11:36.735 INFO:tasks.rados.rados.0.smithi084.stdout:3334: done (1 left) 2024-01-13T18:11:36.735 INFO:tasks.rados.rados.0.smithi084.stdout:3335: snap_create 2024-01-13T18:11:36.747 INFO:tasks.rados.rados.0.smithi084.stdout:3333: expect (ObjNum 942 snap 298 seq_num 942) 2024-01-13T18:11:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:36 smithi099 ceph-mon[138788]: osdmap e713: 8 total, 8 up, 8 in 2024-01-13T18:11:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:36 smithi099 ceph-mon[138788]: pgmap v782: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 237 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-01-13T18:11:37.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:36 smithi084 ceph-mon[116404]: osdmap e713: 8 total, 8 up, 8 in 2024-01-13T18:11:37.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:36 smithi084 ceph-mon[116404]: pgmap v782: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 237 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-01-13T18:11:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:36 smithi084 ceph-mon[119097]: osdmap e713: 8 total, 8 up, 8 in 2024-01-13T18:11:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:36 smithi084 ceph-mon[119097]: pgmap v782: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 237 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-01-13T18:11:37.743 INFO:tasks.rados.rados.0.smithi084.stdout:3333: done (1 left) 2024-01-13T18:11:37.743 INFO:tasks.rados.rados.0.smithi084.stdout:3335: done (0 left) 2024-01-13T18:11:37.743 INFO:tasks.rados.rados.0.smithi084.stdout:3336: read oid 43 snap -1 2024-01-13T18:11:37.743 INFO:tasks.rados.rados.0.smithi084.stdout:3336: expect (ObjNum 977 snap 309 seq_num 977) 2024-01-13T18:11:37.744 INFO:tasks.rados.rados.0.smithi084.stdout:3337: snap_create 2024-01-13T18:11:37.754 INFO:tasks.rados.rados.0.smithi084.stdout:3336: expect (ObjNum 977 snap 309 seq_num 977) 2024-01-13T18:11:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:37 smithi099 ceph-mon[138788]: osdmap e714: 8 total, 8 up, 8 in 2024-01-13T18:11:38.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:37 smithi084 ceph-mon[116404]: osdmap e714: 8 total, 8 up, 8 in 2024-01-13T18:11:38.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:37 smithi084 ceph-mon[119097]: osdmap e714: 8 total, 8 up, 8 in 2024-01-13T18:11:38.748 INFO:tasks.rados.rados.0.smithi084.stdout:3336: done (1 left) 2024-01-13T18:11:38.748 INFO:tasks.rados.rados.0.smithi084.stdout:3337: done (0 left) 2024-01-13T18:11:38.748 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 324 2024-01-13T18:11:38.748 INFO:tasks.rados.rados.0.smithi084.stdout:3338: seq_num 1028 ranges {0=425984} 2024-01-13T18:11:38.750 INFO:tasks.rados.rados.0.smithi084.stdout:3338: writing smithi084102331-7 from 0 to 425984 tid 1 2024-01-13T18:11:38.750 INFO:tasks.rados.rados.0.smithi084.stdout:3339: delete oid 47 current snap is 324 2024-01-13T18:11:38.755 INFO:tasks.rados.rados.0.smithi084.stdout:3338: finishing write tid 1 to smithi084102331-7 2024-01-13T18:11:38.757 INFO:tasks.rados.rados.0.smithi084.stdout:3338: finishing write tid 2 to smithi084102331-7 2024-01-13T18:11:38.757 INFO:tasks.rados.rados.0.smithi084.stdout:3339: done (1 left) 2024-01-13T18:11:38.757 INFO:tasks.rados.rados.0.smithi084.stdout:3340: read oid 21 snap -1 2024-01-13T18:11:38.757 INFO:tasks.rados.rados.0.smithi084.stdout:3340: expect deleted 2024-01-13T18:11:38.757 INFO:tasks.rados.rados.0.smithi084.stdout:3341: rollback oid 4 current snap is 324 2024-01-13T18:11:38.757 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 309 2024-01-13T18:11:38.757 INFO:tasks.rados.rados.0.smithi084.stdout:3342: read oid 11 snap -1 2024-01-13T18:11:38.757 INFO:tasks.rados.rados.0.smithi084.stdout:3342: expect (ObjNum 909 snap 283 seq_num 909) 2024-01-13T18:11:38.757 INFO:tasks.rados.rados.0.smithi084.stdout:3343: rollback oid 3 current snap is 324 2024-01-13T18:11:38.757 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 313 2024-01-13T18:11:38.757 INFO:tasks.rados.rados.0.smithi084.stdout:3344: copy_from oid 22 from oid 34 current snap is 324 2024-01-13T18:11:38.758 INFO:tasks.rados.rados.0.smithi084.stdout:3345: snap_create 2024-01-13T18:11:38.762 INFO:tasks.rados.rados.0.smithi084.stdout:3338: finishing write tid 3 to smithi084102331-7 2024-01-13T18:11:38.762 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1362 (ObjNum 1028 snap 324 seq_num 1028) dirty exists 2024-01-13T18:11:38.762 INFO:tasks.rados.rados.0.smithi084.stdout:3338: left oid 7 (ObjNum 1028 snap 324 seq_num 1028) 2024-01-13T18:11:38.763 INFO:tasks.rados.rados.0.smithi084.stdout:3343: finishing rollback tid 0 to smithi084102331-3 2024-01-13T18:11:38.763 INFO:tasks.rados.rados.0.smithi084.stdout:3343: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:11:38.763 INFO:tasks.rados.rados.0.smithi084.stdout:3343: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:11:38.763 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1683 (ObjNum 986 snap 309 seq_num 986) dirty exists 2024-01-13T18:11:38.763 INFO:tasks.rados.rados.0.smithi084.stdout:3341: finishing rollback tid 0 to smithi084102331-4 2024-01-13T18:11:38.764 INFO:tasks.rados.rados.0.smithi084.stdout:3341: finishing rollback tid 1 to smithi084102331-4 2024-01-13T18:11:38.764 INFO:tasks.rados.rados.0.smithi084.stdout:3341: finishing rollback tid 2 to smithi084102331-4 2024-01-13T18:11:38.764 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 1632 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:11:38.789 INFO:tasks.rados.rados.0.smithi084.stdout:3344: finishing copy_from to smithi084102331-22 2024-01-13T18:11:38.789 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1650 (ObjNum 991 snap 311 seq_num 991) dirty exists 2024-01-13T18:11:38.790 INFO:tasks.rados.rados.0.smithi084.stdout:3344: finishing copy_from racing read to smithi084102331-22 2024-01-13T18:11:38.800 INFO:tasks.rados.rados.0.smithi084.stdout:3342: expect (ObjNum 909 snap 283 seq_num 909) 2024-01-13T18:11:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:38 smithi099 ceph-mon[138788]: osdmap e715: 8 total, 8 up, 8 in 2024-01-13T18:11:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:38 smithi099 ceph-mon[138788]: pgmap v785: 121 pgs: 121 active+clean; 255 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 7.8 MiB/s wr, 16 op/s 2024-01-13T18:11:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:38 smithi084 ceph-mon[116404]: osdmap e715: 8 total, 8 up, 8 in 2024-01-13T18:11:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:38 smithi084 ceph-mon[116404]: pgmap v785: 121 pgs: 121 active+clean; 255 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 7.8 MiB/s wr, 16 op/s 2024-01-13T18:11:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:38 smithi084 ceph-mon[119097]: osdmap e715: 8 total, 8 up, 8 in 2024-01-13T18:11:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:38 smithi084 ceph-mon[119097]: pgmap v785: 121 pgs: 121 active+clean; 255 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 7.8 MiB/s wr, 16 op/s 2024-01-13T18:11:39.757 INFO:tasks.rados.rados.0.smithi084.stdout:3338: done (6 left) 2024-01-13T18:11:39.757 INFO:tasks.rados.rados.0.smithi084.stdout:3340: done (5 left) 2024-01-13T18:11:39.758 INFO:tasks.rados.rados.0.smithi084.stdout:3341: done (4 left) 2024-01-13T18:11:39.758 INFO:tasks.rados.rados.0.smithi084.stdout:3342: done (3 left) 2024-01-13T18:11:39.758 INFO:tasks.rados.rados.0.smithi084.stdout:3343: done (2 left) 2024-01-13T18:11:39.758 INFO:tasks.rados.rados.0.smithi084.stdout:3344: done (1 left) 2024-01-13T18:11:39.758 INFO:tasks.rados.rados.0.smithi084.stdout:3345: done (0 left) 2024-01-13T18:11:39.758 INFO:tasks.rados.rados.0.smithi084.stdout:3346: read oid 2 snap 322 2024-01-13T18:11:39.758 INFO:tasks.rados.rados.0.smithi084.stdout:3346: expect (ObjNum 977 snap 309 seq_num 977) 2024-01-13T18:11:39.758 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 325 2024-01-13T18:11:39.758 INFO:tasks.rados.rados.0.smithi084.stdout:3347: seq_num 1030 ranges {1449984=458752} 2024-01-13T18:11:39.767 INFO:tasks.rados.rados.0.smithi084.stdout:3347: writing smithi084102331-12 from 1449984 to 1908736 tid 1 2024-01-13T18:11:39.767 INFO:tasks.rados.rados.0.smithi084.stdout:3348: read oid 18 snap -1 2024-01-13T18:11:39.767 INFO:tasks.rados.rados.0.smithi084.stdout:3348: expect (ObjNum 929 snap 294 seq_num 929) 2024-01-13T18:11:39.767 INFO:tasks.rados.rados.0.smithi084.stdout:3349: snap_remove snap 317 2024-01-13T18:11:40.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:39 smithi099 ceph-mon[138788]: osdmap e716: 8 total, 8 up, 8 in 2024-01-13T18:11:40.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:39 smithi084 ceph-mon[116404]: osdmap e716: 8 total, 8 up, 8 in 2024-01-13T18:11:40.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:39 smithi084 ceph-mon[119097]: osdmap e716: 8 total, 8 up, 8 in 2024-01-13T18:11:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:11:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:11:40] "GET /metrics HTTP/1.1" 200 36189 "" "Prometheus/2.43.0" 2024-01-13T18:11:40.765 INFO:tasks.rados.rados.0.smithi084.stdout:3349: done (3 left) 2024-01-13T18:11:40.765 INFO:tasks.rados.rados.0.smithi084.stdout:3350: snap_remove snap 309 2024-01-13T18:11:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:40 smithi099 ceph-mon[138788]: osdmap e717: 8 total, 8 up, 8 in 2024-01-13T18:11:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:40 smithi099 ceph-mon[138788]: pgmap v788: 121 pgs: 121 active+clean; 255 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 7.0 MiB/s wr, 15 op/s 2024-01-13T18:11:41.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:40 smithi084 ceph-mon[116404]: osdmap e717: 8 total, 8 up, 8 in 2024-01-13T18:11:41.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:40 smithi084 ceph-mon[116404]: pgmap v788: 121 pgs: 121 active+clean; 255 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 7.0 MiB/s wr, 15 op/s 2024-01-13T18:11:41.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:40 smithi084 ceph-mon[119097]: osdmap e717: 8 total, 8 up, 8 in 2024-01-13T18:11:41.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:40 smithi084 ceph-mon[119097]: pgmap v788: 121 pgs: 121 active+clean; 255 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 7.0 MiB/s wr, 15 op/s 2024-01-13T18:11:41.772 INFO:tasks.rados.rados.0.smithi084.stdout:3350: done (3 left) 2024-01-13T18:11:41.772 INFO:tasks.rados.rados.0.smithi084.stdout:3351: read oid 16 snap -1 2024-01-13T18:11:41.772 INFO:tasks.rados.rados.0.smithi084.stdout:3351: expect deleted 2024-01-13T18:11:41.773 INFO:tasks.rados.rados.0.smithi084.stdout:3352: snap_remove snap 324 2024-01-13T18:11:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:41 smithi099 ceph-mon[138788]: osdmap e718: 8 total, 8 up, 8 in 2024-01-13T18:11:42.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:41 smithi084 ceph-mon[116404]: osdmap e718: 8 total, 8 up, 8 in 2024-01-13T18:11:42.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:41 smithi084 ceph-mon[119097]: osdmap e718: 8 total, 8 up, 8 in 2024-01-13T18:11:42.714 INFO:tasks.rados.rados.0.smithi084.stdout:3352: done (4 left) 2024-01-13T18:11:42.715 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 325 2024-01-13T18:11:42.715 INFO:tasks.rados.rados.0.smithi084.stdout:3353: seq_num 1031 ranges {5095424=475136} 2024-01-13T18:11:42.744 INFO:tasks.rados.rados.0.smithi084.stdout:3353: writing smithi084102331-6 from 5095424 to 5570560 tid 1 2024-01-13T18:11:42.744 INFO:tasks.rados.rados.0.smithi084.stdout:3354: copy_from oid 25 from oid 1 current snap is 325 2024-01-13T18:11:42.745 INFO:tasks.rados.rados.0.smithi084.stdout:3346: expect (ObjNum 977 snap 309 seq_num 977) 2024-01-13T18:11:42.873 INFO:tasks.rados.rados.0.smithi084.stdout:3347: finishing write tid 1 to smithi084102331-12 2024-01-13T18:11:42.873 INFO:tasks.rados.rados.0.smithi084.stdout:3347: finishing write tid 2 to smithi084102331-12 2024-01-13T18:11:42.873 INFO:tasks.rados.rados.0.smithi084.stdout:3347: finishing write tid 3 to smithi084102331-12 2024-01-13T18:11:42.873 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1735 (ObjNum 1030 snap 325 seq_num 1030) dirty exists 2024-01-13T18:11:42.873 INFO:tasks.rados.rados.0.smithi084.stdout:3347: left oid 12 (ObjNum 1030 snap 325 seq_num 1030) 2024-01-13T18:11:42.873 INFO:tasks.rados.rados.0.smithi084.stdout:3346: done (5 left) 2024-01-13T18:11:42.873 INFO:tasks.rados.rados.0.smithi084.stdout:3347: done (4 left) 2024-01-13T18:11:42.873 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 325 2024-01-13T18:11:42.874 INFO:tasks.rados.rados.0.smithi084.stdout:3355: seq_num 1032 ranges {3350528=491520} 2024-01-13T18:11:42.893 INFO:tasks.rados.rados.0.smithi084.stdout:3355: writing smithi084102331-8 from 3350528 to 3842048 tid 1 2024-01-13T18:11:42.893 INFO:tasks.rados.rados.0.smithi084.stdout:3356: snap_create 2024-01-13T18:11:42.893 INFO:tasks.rados.rados.0.smithi084.stdout:3348: expect (ObjNum 929 snap 294 seq_num 929) 2024-01-13T18:11:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:42 smithi099 ceph-mon[138788]: osdmap e719: 8 total, 8 up, 8 in 2024-01-13T18:11:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:42 smithi099 ceph-mon[138788]: pgmap v791: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 264 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-01-13T18:11:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:42 smithi099 ceph-mon[138788]: osdmap e720: 8 total, 8 up, 8 in 2024-01-13T18:11:43.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:42 smithi084 ceph-mon[119097]: osdmap e719: 8 total, 8 up, 8 in 2024-01-13T18:11:43.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:42 smithi084 ceph-mon[119097]: pgmap v791: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 264 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-01-13T18:11:43.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:42 smithi084 ceph-mon[119097]: osdmap e720: 8 total, 8 up, 8 in 2024-01-13T18:11:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:42 smithi084 ceph-mon[116404]: osdmap e719: 8 total, 8 up, 8 in 2024-01-13T18:11:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:42 smithi084 ceph-mon[116404]: pgmap v791: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 264 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-01-13T18:11:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:42 smithi084 ceph-mon[116404]: osdmap e720: 8 total, 8 up, 8 in 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3353: finishing write tid 1 to smithi084102331-6 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3353: finishing write tid 2 to smithi084102331-6 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3353: finishing write tid 3 to smithi084102331-6 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 1652 (ObjNum 1031 snap 325 seq_num 1031) dirty exists 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3353: left oid 6 (ObjNum 1031 snap 325 seq_num 1031) 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3354: finishing copy_from to smithi084102331-25 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1650 (ObjNum 991 snap 311 seq_num 991) dirty exists 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3354: finishing copy_from racing read to smithi084102331-25 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3355: finishing write tid 1 to smithi084102331-8 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3348: done (5 left) 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3351: done (4 left) 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3353: done (3 left) 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3354: done (2 left) 2024-01-13T18:11:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3356: done (1 left) 2024-01-13T18:11:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 326 2024-01-13T18:11:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:3357: seq_num 1033 ranges {3276800=507904} 2024-01-13T18:11:43.828 INFO:tasks.rados.rados.0.smithi084.stdout:3357: writing smithi084102331-27 from 3276800 to 3784704 tid 1 2024-01-13T18:11:43.828 INFO:tasks.rados.rados.0.smithi084.stdout:3358: snap_create 2024-01-13T18:11:43.829 INFO:tasks.rados.rados.0.smithi084.stdout:3355: finishing write tid 2 to smithi084102331-8 2024-01-13T18:11:43.829 INFO:tasks.rados.rados.0.smithi084.stdout:3355: finishing write tid 3 to smithi084102331-8 2024-01-13T18:11:43.829 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1723 (ObjNum 1032 snap 325 seq_num 1032) dirty exists 2024-01-13T18:11:43.829 INFO:tasks.rados.rados.0.smithi084.stdout:3355: left oid 8 (ObjNum 1032 snap 325 seq_num 1032) 2024-01-13T18:11:43.835 INFO:tasks.rados.rados.0.smithi084.stdout:3357: finishing write tid 1 to smithi084102331-27 2024-01-13T18:11:43.835 INFO:tasks.rados.rados.0.smithi084.stdout:3357: finishing write tid 2 to smithi084102331-27 2024-01-13T18:11:43.837 INFO:tasks.rados.rados.0.smithi084.stdout:3357: finishing write tid 3 to smithi084102331-27 2024-01-13T18:11:43.837 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1611 (ObjNum 1033 snap 326 seq_num 1033) dirty exists 2024-01-13T18:11:43.837 INFO:tasks.rados.rados.0.smithi084.stdout:3357: left oid 27 (ObjNum 1033 snap 326 seq_num 1033) 2024-01-13T18:11:44.789 INFO:tasks.rados.rados.0.smithi084.stdout:3355: done (2 left) 2024-01-13T18:11:44.789 INFO:tasks.rados.rados.0.smithi084.stdout:3357: done (1 left) 2024-01-13T18:11:44.790 INFO:tasks.rados.rados.0.smithi084.stdout:3358: done (0 left) 2024-01-13T18:11:44.790 INFO:tasks.rados.rados.0.smithi084.stdout:3359: read oid 10 snap -1 2024-01-13T18:11:44.790 INFO:tasks.rados.rados.0.smithi084.stdout:3359: expect (ObjNum 1025 snap 320 seq_num 1025) 2024-01-13T18:11:44.790 INFO:tasks.rados.rados.0.smithi084.stdout:3360: snap_remove snap 322 2024-01-13T18:11:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:44 smithi099 ceph-mon[138788]: osdmap e721: 8 total, 8 up, 8 in 2024-01-13T18:11:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:44 smithi099 ceph-mon[138788]: pgmap v794: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 259 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-01-13T18:11:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:44 smithi084 ceph-mon[116404]: osdmap e721: 8 total, 8 up, 8 in 2024-01-13T18:11:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:44 smithi084 ceph-mon[116404]: pgmap v794: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 259 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-01-13T18:11:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:44 smithi084 ceph-mon[119097]: osdmap e721: 8 total, 8 up, 8 in 2024-01-13T18:11:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:44 smithi084 ceph-mon[119097]: pgmap v794: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 259 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-01-13T18:11:45.789 INFO:tasks.rados.rados.0.smithi084.stdout:3360: done (1 left) 2024-01-13T18:11:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:3361: copy_from oid 4 from oid 16 current snap is 327 2024-01-13T18:11:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:3359: expect (ObjNum 1025 snap 320 seq_num 1025) 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:3361: finishing copy_from to smithi084102331-4 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:3361: got expected ENOENT (src dne) 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:3361: finishing copy_from racing read to smithi084102331-4 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:3359: done (1 left) 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:3361: done (0 left) 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:3362: read oid 20 snap 326 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:3362: expect (ObjNum 974 snap 308 seq_num 974) 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:3363: rollback oid 43 current snap is 327 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 326 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:3364: rmattr oid 17 current snap is 327 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 327 2024-01-13T18:11:45.803 INFO:tasks.rados.rados.0.smithi084.stdout:3365: seq_num 1034 ranges {0=524288} 2024-01-13T18:11:45.806 INFO:tasks.rados.rados.0.smithi084.stdout:3365: writing smithi084102331-50 from 0 to 524288 tid 1 2024-01-13T18:11:45.806 INFO:tasks.rados.rados.0.smithi084.stdout:3366: snap_create 2024-01-13T18:11:45.809 INFO:tasks.rados.rados.0.smithi084.stdout:3363: finishing rollback tid 0 to smithi084102331-43 2024-01-13T18:11:45.809 INFO:tasks.rados.rados.0.smithi084.stdout:3363: finishing rollback tid 1 to smithi084102331-43 2024-01-13T18:11:45.810 INFO:tasks.rados.rados.0.smithi084.stdout:3363: finishing rollback tid 2 to smithi084102331-43 2024-01-13T18:11:45.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1365 (ObjNum 977 snap 309 seq_num 977) dirty exists 2024-01-13T18:11:45.811 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1633 (ObjNum 948 snap 300 seq_num 948) dirty exists 2024-01-13T18:11:45.811 INFO:tasks.rados.rados.0.smithi084.stdout:3365: finishing write tid 1 to smithi084102331-50 2024-01-13T18:11:45.814 INFO:tasks.rados.rados.0.smithi084.stdout:3365: finishing write tid 2 to smithi084102331-50 2024-01-13T18:11:45.817 INFO:tasks.rados.rados.0.smithi084.stdout:3365: finishing write tid 3 to smithi084102331-50 2024-01-13T18:11:45.817 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 1652 (ObjNum 1034 snap 327 seq_num 1034) dirty exists 2024-01-13T18:11:45.817 INFO:tasks.rados.rados.0.smithi084.stdout:3365: left oid 50 (ObjNum 1034 snap 327 seq_num 1034) 2024-01-13T18:11:45.832 INFO:tasks.rados.rados.0.smithi084.stdout:3362: expect (ObjNum 974 snap 308 seq_num 974) 2024-01-13T18:11:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:45 smithi099 ceph-mon[138788]: osdmap e722: 8 total, 8 up, 8 in 2024-01-13T18:11:46.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:45 smithi084 ceph-mon[116404]: osdmap e722: 8 total, 8 up, 8 in 2024-01-13T18:11:46.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:45 smithi084 ceph-mon[119097]: osdmap e722: 8 total, 8 up, 8 in 2024-01-13T18:11:46.805 INFO:tasks.rados.rados.0.smithi084.stdout:3362: done (4 left) 2024-01-13T18:11:46.805 INFO:tasks.rados.rados.0.smithi084.stdout:3363: done (3 left) 2024-01-13T18:11:46.805 INFO:tasks.rados.rados.0.smithi084.stdout:3364: done (2 left) 2024-01-13T18:11:46.805 INFO:tasks.rados.rados.0.smithi084.stdout:3365: done (1 left) 2024-01-13T18:11:46.806 INFO:tasks.rados.rados.0.smithi084.stdout:3366: done (0 left) 2024-01-13T18:11:46.806 INFO:tasks.rados.rados.0.smithi084.stdout:3367: copy_from oid 19 from oid 27 current snap is 328 2024-01-13T18:11:46.806 INFO:tasks.rados.rados.0.smithi084.stdout:3368: snap_remove snap 311 2024-01-13T18:11:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:46 smithi099 ceph-mon[138788]: osdmap e723: 8 total, 8 up, 8 in 2024-01-13T18:11:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:46 smithi099 ceph-mon[138788]: pgmap v797: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 264 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.1 MiB/s wr, 2 op/s 2024-01-13T18:11:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:46 smithi084 ceph-mon[116404]: osdmap e723: 8 total, 8 up, 8 in 2024-01-13T18:11:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:46 smithi084 ceph-mon[116404]: pgmap v797: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 264 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.1 MiB/s wr, 2 op/s 2024-01-13T18:11:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:46 smithi084 ceph-mon[119097]: osdmap e723: 8 total, 8 up, 8 in 2024-01-13T18:11:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:46 smithi084 ceph-mon[119097]: pgmap v797: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 264 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.1 MiB/s wr, 2 op/s 2024-01-13T18:11:47.720 INFO:tasks.rados.rados.0.smithi084.stdout:3368: done (1 left) 2024-01-13T18:11:47.720 INFO:tasks.rados.rados.0.smithi084.stdout:3369: read oid 21 snap 313 2024-01-13T18:11:47.720 INFO:tasks.rados.rados.0.smithi084.stdout:3369: expect (ObjNum 970 snap 308 seq_num 970) 2024-01-13T18:11:47.720 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 328 2024-01-13T18:11:47.720 INFO:tasks.rados.rados.0.smithi084.stdout:3370: seq_num 1035 ranges {425984=540672} 2024-01-13T18:11:47.725 INFO:tasks.rados.rados.0.smithi084.stdout:3370: writing smithi084102331-7 from 425984 to 966656 tid 1 2024-01-13T18:11:47.725 INFO:tasks.rados.rados.0.smithi084.stdout:3371: read oid 38 snap 312 2024-01-13T18:11:47.725 INFO:tasks.rados.rados.0.smithi084.stdout:3371: expect (ObjNum 969 snap 307 seq_num 969) 2024-01-13T18:11:47.725 INFO:tasks.rados.rados.0.smithi084.stdout:3372: snap_remove snap 327 2024-01-13T18:11:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:47 smithi099 ceph-mon[138788]: osdmap e724: 8 total, 8 up, 8 in 2024-01-13T18:11:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:47 smithi099 ceph-mon[138788]: osdmap e725: 8 total, 8 up, 8 in 2024-01-13T18:11:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:47 smithi084 ceph-mon[116404]: osdmap e724: 8 total, 8 up, 8 in 2024-01-13T18:11:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:47 smithi084 ceph-mon[116404]: osdmap e725: 8 total, 8 up, 8 in 2024-01-13T18:11:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:47 smithi084 ceph-mon[119097]: osdmap e724: 8 total, 8 up, 8 in 2024-01-13T18:11:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:47 smithi084 ceph-mon[119097]: osdmap e725: 8 total, 8 up, 8 in 2024-01-13T18:11:48.719 INFO:tasks.rados.rados.0.smithi084.stdout:3372: done (4 left) 2024-01-13T18:11:48.719 INFO:tasks.rados.rados.0.smithi084.stdout:3373: copy_from oid 33 from oid 24 current snap is 328 2024-01-13T18:11:48.719 INFO:tasks.rados.rados.0.smithi084.stdout:3367: finishing copy_from to smithi084102331-19 2024-01-13T18:11:48.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 1611 (ObjNum 1033 snap 326 seq_num 1033) dirty exists 2024-01-13T18:11:48.719 INFO:tasks.rados.rados.0.smithi084.stdout:3367: finishing copy_from racing read to smithi084102331-19 2024-01-13T18:11:48.719 INFO:tasks.rados.rados.0.smithi084.stdout:3371: expect (ObjNum 969 snap 307 seq_num 969) 2024-01-13T18:11:48.832 INFO:tasks.rados.rados.0.smithi084.stdout:3369: expect (ObjNum 970 snap 308 seq_num 970) 2024-01-13T18:11:49.012 INFO:tasks.rados.rados.0.smithi084.stdout:3370: finishing write tid 1 to smithi084102331-7 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:3370: finishing write tid 2 to smithi084102331-7 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:3370: finishing write tid 3 to smithi084102331-7 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1367 (ObjNum 1035 snap 328 seq_num 1035) dirty exists 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:3370: left oid 7 (ObjNum 1035 snap 328 seq_num 1035) 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:3373: finishing copy_from to smithi084102331-33 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1360 (ObjNum 879 snap 279 seq_num 879) dirty exists 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:3373: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:3367: done (4 left) 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:3369: done (3 left) 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:3370: done (2 left) 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:3371: done (1 left) 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:3373: done (0 left) 2024-01-13T18:11:49.013 INFO:tasks.rados.rados.0.smithi084.stdout:3374: snap_create 2024-01-13T18:11:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:48 smithi099 ceph-mon[138788]: pgmap v800: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 261 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.2 MiB/s rd, 1.5 MiB/s wr, 7 op/s 2024-01-13T18:11:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:48 smithi099 ceph-mon[138788]: osdmap e726: 8 total, 8 up, 8 in 2024-01-13T18:11:49.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:48 smithi084 ceph-mon[119097]: pgmap v800: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 261 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.2 MiB/s rd, 1.5 MiB/s wr, 7 op/s 2024-01-13T18:11:49.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:48 smithi084 ceph-mon[119097]: osdmap e726: 8 total, 8 up, 8 in 2024-01-13T18:11:49.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:48 smithi084 ceph-mon[116404]: pgmap v800: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 261 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.2 MiB/s rd, 1.5 MiB/s wr, 7 op/s 2024-01-13T18:11:49.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:48 smithi084 ceph-mon[116404]: osdmap e726: 8 total, 8 up, 8 in 2024-01-13T18:11:49.815 INFO:tasks.rados.rados.0.smithi084.stdout:3374: done (0 left) 2024-01-13T18:11:49.815 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 329 2024-01-13T18:11:49.815 INFO:tasks.rados.rados.0.smithi084.stdout:3375: seq_num 1036 ranges {966656=557056} 2024-01-13T18:11:49.823 INFO:tasks.rados.rados.0.smithi084.stdout:3375: writing smithi084102331-7 from 966656 to 1523712 tid 1 2024-01-13T18:11:49.823 INFO:tasks.rados.rados.0.smithi084.stdout:3376: copy_from oid 48 from oid 38 current snap is 329 2024-01-13T18:11:49.823 INFO:tasks.rados.rados.0.smithi084.stdout:3377: copy_from oid 29 from oid 8 current snap is 329 2024-01-13T18:11:49.823 INFO:tasks.rados.rados.0.smithi084.stdout:3378: read oid 14 snap 312 2024-01-13T18:11:49.824 INFO:tasks.rados.rados.0.smithi084.stdout:3378: expect (ObjNum 967 snap 306 seq_num 967) 2024-01-13T18:11:49.824 INFO:tasks.rados.rados.0.smithi084.stdout:3379: snap_remove snap 328 2024-01-13T18:11:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:11:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:11:50] "GET /metrics HTTP/1.1" 200 36192 "" "Prometheus/2.43.0" 2024-01-13T18:11:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:3379: done (4 left) 2024-01-13T18:11:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:3380: copy_from oid 43 from oid 18 current snap is 329 2024-01-13T18:11:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:3375: finishing write tid 1 to smithi084102331-7 2024-01-13T18:11:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:3375: finishing write tid 2 to smithi084102331-7 2024-01-13T18:11:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:3375: finishing write tid 3 to smithi084102331-7 2024-01-13T18:11:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1369 (ObjNum 1036 snap 329 seq_num 1036) dirty exists 2024-01-13T18:11:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:3375: left oid 7 (ObjNum 1036 snap 329 seq_num 1036) 2024-01-13T18:11:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:3378: expect (ObjNum 967 snap 306 seq_num 967) 2024-01-13T18:11:50.886 INFO:tasks.rados.rados.0.smithi084.stdout:3376: finishing copy_from to smithi084102331-48 2024-01-13T18:11:50.886 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1609 (ObjNum 969 snap 307 seq_num 969) dirty exists 2024-01-13T18:11:50.886 INFO:tasks.rados.rados.0.smithi084.stdout:3377: finishing copy_from to smithi084102331-29 2024-01-13T18:11:50.886 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1723 (ObjNum 1032 snap 325 seq_num 1032) dirty exists 2024-01-13T18:11:50.886 INFO:tasks.rados.rados.0.smithi084.stdout:3377: finishing copy_from racing read to smithi084102331-29 2024-01-13T18:11:50.886 INFO:tasks.rados.rados.0.smithi084.stdout:3376: finishing copy_from racing read to smithi084102331-48 2024-01-13T18:11:50.886 INFO:tasks.rados.rados.0.smithi084.stdout:3380: finishing copy_from to smithi084102331-43 2024-01-13T18:11:50.886 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1500 (ObjNum 929 snap 294 seq_num 929) dirty exists 2024-01-13T18:11:50.886 INFO:tasks.rados.rados.0.smithi084.stdout:3380: finishing copy_from racing read to smithi084102331-43 2024-01-13T18:11:50.886 INFO:tasks.rados.rados.0.smithi084.stdout:3375: done (4 left) 2024-01-13T18:11:50.886 INFO:tasks.rados.rados.0.smithi084.stdout:3376: done (3 left) 2024-01-13T18:11:50.887 INFO:tasks.rados.rados.0.smithi084.stdout:3377: done (2 left) 2024-01-13T18:11:50.887 INFO:tasks.rados.rados.0.smithi084.stdout:3378: done (1 left) 2024-01-13T18:11:50.887 INFO:tasks.rados.rados.0.smithi084.stdout:3380: done (0 left) 2024-01-13T18:11:50.887 INFO:tasks.rados.rados.0.smithi084.stdout:3381: read oid 32 snap -1 2024-01-13T18:11:50.887 INFO:tasks.rados.rados.0.smithi084.stdout:3381: expect (ObjNum 1015 snap 317 seq_num 1015) 2024-01-13T18:11:50.887 INFO:tasks.rados.rados.0.smithi084.stdout:3382: copy_from oid 30 from oid 22 current snap is 329 2024-01-13T18:11:50.887 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 329 2024-01-13T18:11:50.887 INFO:tasks.rados.rados.0.smithi084.stdout:3383: seq_num 1037 ranges {3997696=573440} 2024-01-13T18:11:50.911 INFO:tasks.rados.rados.0.smithi084.stdout:3383: writing smithi084102331-13 from 3997696 to 4571136 tid 1 2024-01-13T18:11:50.911 INFO:tasks.rados.rados.0.smithi084.stdout:3384: rollback oid 48 current snap is 329 2024-01-13T18:11:50.911 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 48 to 321 2024-01-13T18:11:50.911 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 329 2024-01-13T18:11:50.912 INFO:tasks.rados.rados.0.smithi084.stdout:3385: seq_num 1038 ranges {0=589824} 2024-01-13T18:11:50.914 INFO:tasks.rados.rados.0.smithi084.stdout:3385: writing smithi084102331-15 from 0 to 589824 tid 1 2024-01-13T18:11:50.915 INFO:tasks.rados.rados.0.smithi084.stdout:3386: snap_create 2024-01-13T18:11:50.915 INFO:tasks.rados.rados.0.smithi084.stdout:3381: expect (ObjNum 1015 snap 317 seq_num 1015) 2024-01-13T18:11:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:50 smithi099 ceph-mon[138788]: osdmap e727: 8 total, 8 up, 8 in 2024-01-13T18:11:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:50 smithi099 ceph-mon[138788]: pgmap v803: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 264 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2024-01-13T18:11:51.163 INFO:tasks.rados.rados.0.smithi084.stdout:3382: finishing copy_from to smithi084102331-30 2024-01-13T18:11:51.163 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1650 (ObjNum 991 snap 311 seq_num 991) dirty exists 2024-01-13T18:11:51.163 INFO:tasks.rados.rados.0.smithi084.stdout:3384: finishing rollback tid 0 to smithi084102331-48 2024-01-13T18:11:51.163 INFO:tasks.rados.rados.0.smithi084.stdout:3384: finishing rollback tid 1 to smithi084102331-48 2024-01-13T18:11:51.163 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 1756 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-01-13T18:11:51.163 INFO:tasks.rados.rados.0.smithi084.stdout:3383: finishing write tid 1 to smithi084102331-13 2024-01-13T18:11:51.163 INFO:tasks.rados.rados.0.smithi084.stdout:3382: finishing copy_from racing read to smithi084102331-30 2024-01-13T18:11:51.163 INFO:tasks.rados.rados.0.smithi084.stdout:3383: finishing write tid 2 to smithi084102331-13 2024-01-13T18:11:51.163 INFO:tasks.rados.rados.0.smithi084.stdout:3383: finishing write tid 3 to smithi084102331-13 2024-01-13T18:11:51.163 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 1635 (ObjNum 1037 snap 329 seq_num 1037) dirty exists 2024-01-13T18:11:51.164 INFO:tasks.rados.rados.0.smithi084.stdout:3383: left oid 13 (ObjNum 1037 snap 329 seq_num 1037) 2024-01-13T18:11:51.164 INFO:tasks.rados.rados.0.smithi084.stdout:3385: finishing write tid 1 to smithi084102331-15 2024-01-13T18:11:51.164 INFO:tasks.rados.rados.0.smithi084.stdout:3385: finishing write tid 2 to smithi084102331-15 2024-01-13T18:11:51.164 INFO:tasks.rados.rados.0.smithi084.stdout:3385: finishing write tid 3 to smithi084102331-15 2024-01-13T18:11:51.164 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1725 (ObjNum 1038 snap 329 seq_num 1038) dirty exists 2024-01-13T18:11:51.164 INFO:tasks.rados.rados.0.smithi084.stdout:3385: left oid 15 (ObjNum 1038 snap 329 seq_num 1038) 2024-01-13T18:11:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:50 smithi084 ceph-mon[116404]: osdmap e727: 8 total, 8 up, 8 in 2024-01-13T18:11:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:50 smithi084 ceph-mon[116404]: pgmap v803: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 264 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2024-01-13T18:11:51.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:50 smithi084 ceph-mon[119097]: osdmap e727: 8 total, 8 up, 8 in 2024-01-13T18:11:51.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:11:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:50 smithi084 ceph-mon[119097]: pgmap v803: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 264 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2024-01-13T18:11:51.823 INFO:tasks.rados.rados.0.smithi084.stdout:3381: done (5 left) 2024-01-13T18:11:51.823 INFO:tasks.rados.rados.0.smithi084.stdout:3382: done (4 left) 2024-01-13T18:11:51.823 INFO:tasks.rados.rados.0.smithi084.stdout:3383: done (3 left) 2024-01-13T18:11:51.823 INFO:tasks.rados.rados.0.smithi084.stdout:3384: done (2 left) 2024-01-13T18:11:51.823 INFO:tasks.rados.rados.0.smithi084.stdout:3385: done (1 left) 2024-01-13T18:11:51.823 INFO:tasks.rados.rados.0.smithi084.stdout:3386: done (0 left) 2024-01-13T18:11:51.823 INFO:tasks.rados.rados.0.smithi084.stdout:3387: rmattr oid 26 current snap is 330 2024-01-13T18:11:51.823 INFO:tasks.rados.rados.0.smithi084.stdout:3388: rollback oid 10 current snap is 330 2024-01-13T18:11:51.823 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 326 2024-01-13T18:11:51.824 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 330 2024-01-13T18:11:51.824 INFO:tasks.rados.rados.0.smithi084.stdout:3389: seq_num 1039 ranges {2252800=606208} 2024-01-13T18:11:51.838 INFO:tasks.rados.rados.0.smithi084.stdout:3389: writing smithi084102331-33 from 2252800 to 2859008 tid 1 2024-01-13T18:11:51.838 INFO:tasks.rados.rados.0.smithi084.stdout:3390: snap_remove snap 325 2024-01-13T18:11:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:51 smithi099 ceph-mon[138788]: osdmap e728: 8 total, 8 up, 8 in 2024-01-13T18:11:52.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:51 smithi084 ceph-mon[116404]: osdmap e728: 8 total, 8 up, 8 in 2024-01-13T18:11:52.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:51 smithi084 ceph-mon[119097]: osdmap e728: 8 total, 8 up, 8 in 2024-01-13T18:11:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:3390: done (3 left) 2024-01-13T18:11:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:3391: delete oid 11 current snap is 330 2024-01-13T18:11:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1610 (ObjNum 4113 snap 0 seq_num 3552013344) dirty exists 2024-01-13T18:11:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:3388: finishing rollback tid 0 to smithi084102331-10 2024-01-13T18:11:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:3388: finishing rollback tid 1 to smithi084102331-10 2024-01-13T18:11:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:3388: finishing rollback tid 2 to smithi084102331-10 2024-01-13T18:11:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1505 (ObjNum 1025 snap 320 seq_num 1025) dirty exists 2024-01-13T18:11:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:3389: finishing write tid 1 to smithi084102331-33 2024-01-13T18:11:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:3389: finishing write tid 2 to smithi084102331-33 2024-01-13T18:11:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:3389: finishing write tid 3 to smithi084102331-33 2024-01-13T18:11:52.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1654 (ObjNum 1039 snap 330 seq_num 1039) dirty exists 2024-01-13T18:11:52.721 INFO:tasks.rados.rados.0.smithi084.stdout:3389: left oid 33 (ObjNum 1039 snap 330 seq_num 1039) 2024-01-13T18:11:52.725 INFO:tasks.rados.rados.0.smithi084.stdout:3387: done (3 left) 2024-01-13T18:11:52.725 INFO:tasks.rados.rados.0.smithi084.stdout:3388: done (2 left) 2024-01-13T18:11:52.725 INFO:tasks.rados.rados.0.smithi084.stdout:3389: done (1 left) 2024-01-13T18:11:52.725 INFO:tasks.rados.rados.0.smithi084.stdout:3391: done (0 left) 2024-01-13T18:11:52.725 INFO:tasks.rados.rados.0.smithi084.stdout:3392: copy_from oid 26 from oid 30 current snap is 330 2024-01-13T18:11:52.725 INFO:tasks.rados.rados.0.smithi084.stdout:3393: snap_remove snap 321 2024-01-13T18:11:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:52 smithi099 ceph-mon[138788]: osdmap e729: 8 total, 8 up, 8 in 2024-01-13T18:11:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:52 smithi099 ceph-mon[138788]: pgmap v806: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 274 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 8 op/s 2024-01-13T18:11:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:52 smithi099 ceph-mon[138788]: osdmap e730: 8 total, 8 up, 8 in 2024-01-13T18:11:53.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:52 smithi084 ceph-mon[116404]: osdmap e729: 8 total, 8 up, 8 in 2024-01-13T18:11:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:52 smithi084 ceph-mon[116404]: pgmap v806: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 274 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 8 op/s 2024-01-13T18:11:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:52 smithi084 ceph-mon[116404]: osdmap e730: 8 total, 8 up, 8 in 2024-01-13T18:11:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:52 smithi084 ceph-mon[119097]: osdmap e729: 8 total, 8 up, 8 in 2024-01-13T18:11:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:52 smithi084 ceph-mon[119097]: pgmap v806: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 274 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 8 op/s 2024-01-13T18:11:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:52 smithi084 ceph-mon[119097]: osdmap e730: 8 total, 8 up, 8 in 2024-01-13T18:11:53.725 INFO:tasks.rados.rados.0.smithi084.stdout:3393: done (1 left) 2024-01-13T18:11:53.725 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 330 2024-01-13T18:11:53.725 INFO:tasks.rados.rados.0.smithi084.stdout:3392: finishing copy_from to smithi084102331-26 2024-01-13T18:11:53.725 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1650 (ObjNum 991 snap 311 seq_num 991) dirty exists 2024-01-13T18:11:53.725 INFO:tasks.rados.rados.0.smithi084.stdout:3392: finishing copy_from racing read to smithi084102331-26 2024-01-13T18:11:53.725 INFO:tasks.rados.rados.0.smithi084.stdout:3394: seq_num 1041 ranges {106496=638976} 2024-01-13T18:11:53.731 INFO:tasks.rados.rados.0.smithi084.stdout:3394: writing smithi084102331-23 from 106496 to 745472 tid 1 2024-01-13T18:11:53.731 INFO:tasks.rados.rados.0.smithi084.stdout:3392: done (1 left) 2024-01-13T18:11:53.732 INFO:tasks.rados.rados.0.smithi084.stdout:3395: rmattr oid 47 current snap is 330 2024-01-13T18:11:53.732 INFO:tasks.rados.rados.0.smithi084.stdout:3395: done (1 left) 2024-01-13T18:11:53.732 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 330 2024-01-13T18:11:53.732 INFO:tasks.rados.rados.0.smithi084.stdout:3396: seq_num 1042 ranges {524288=655360} 2024-01-13T18:11:53.736 INFO:tasks.rados.rados.0.smithi084.stdout:3396: writing smithi084102331-50 from 524288 to 1179648 tid 1 2024-01-13T18:11:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 330 2024-01-13T18:11:53.741 INFO:tasks.rados.rados.0.smithi084.stdout:3397: seq_num 1043 ranges {368640=671744} 2024-01-13T18:11:53.742 INFO:tasks.rados.rados.0.smithi084.stdout:3397: writing smithi084102331-10 from 368640 to 1040384 tid 1 2024-01-13T18:11:53.743 INFO:tasks.rados.rados.0.smithi084.stdout:3398: snap_remove snap 318 2024-01-13T18:11:54.736 INFO:tasks.rados.rados.0.smithi084.stdout:3398: done (3 left) 2024-01-13T18:11:54.736 INFO:tasks.rados.rados.0.smithi084.stdout:3399: snap_create 2024-01-13T18:11:54.736 INFO:tasks.rados.rados.0.smithi084.stdout:3396: finishing write tid 1 to smithi084102331-50 2024-01-13T18:11:54.736 INFO:tasks.rados.rados.0.smithi084.stdout:3394: finishing write tid 1 to smithi084102331-23 2024-01-13T18:11:54.736 INFO:tasks.rados.rados.0.smithi084.stdout:3394: finishing write tid 2 to smithi084102331-23 2024-01-13T18:11:54.736 INFO:tasks.rados.rados.0.smithi084.stdout:3396: finishing write tid 2 to smithi084102331-50 2024-01-13T18:11:54.736 INFO:tasks.rados.rados.0.smithi084.stdout:3394: finishing write tid 3 to smithi084102331-23 2024-01-13T18:11:54.736 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1763 (ObjNum 1041 snap 330 seq_num 1041) dirty exists 2024-01-13T18:11:54.736 INFO:tasks.rados.rados.0.smithi084.stdout:3394: left oid 23 (ObjNum 1041 snap 330 seq_num 1041) 2024-01-13T18:11:54.736 INFO:tasks.rados.rados.0.smithi084.stdout:3396: finishing write tid 3 to smithi084102331-50 2024-01-13T18:11:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 1656 (ObjNum 1042 snap 330 seq_num 1042) dirty exists 2024-01-13T18:11:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:3396: left oid 50 (ObjNum 1042 snap 330 seq_num 1042) 2024-01-13T18:11:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:3397: finishing write tid 1 to smithi084102331-10 2024-01-13T18:11:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:3397: finishing write tid 2 to smithi084102331-10 2024-01-13T18:11:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:3397: finishing write tid 3 to smithi084102331-10 2024-01-13T18:11:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1507 (ObjNum 1043 snap 330 seq_num 1043) dirty exists 2024-01-13T18:11:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:3397: left oid 10 (ObjNum 1043 snap 330 seq_num 1043) 2024-01-13T18:11:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:54 smithi099 ceph-mon[138788]: osdmap e731: 8 total, 8 up, 8 in 2024-01-13T18:11:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:54 smithi099 ceph-mon[138788]: pgmap v809: 121 pgs: 121 active+clean; 275 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.2 MiB/s rd, 5.8 MiB/s wr, 9 op/s 2024-01-13T18:11:55.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:54 smithi084 ceph-mon[116404]: osdmap e731: 8 total, 8 up, 8 in 2024-01-13T18:11:55.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:54 smithi084 ceph-mon[116404]: pgmap v809: 121 pgs: 121 active+clean; 275 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.2 MiB/s rd, 5.8 MiB/s wr, 9 op/s 2024-01-13T18:11:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:54 smithi084 ceph-mon[119097]: osdmap e731: 8 total, 8 up, 8 in 2024-01-13T18:11:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:54 smithi084 ceph-mon[119097]: pgmap v809: 121 pgs: 121 active+clean; 275 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.2 MiB/s rd, 5.8 MiB/s wr, 9 op/s 2024-01-13T18:11:55.739 INFO:tasks.rados.rados.0.smithi084.stdout:3394: done (3 left) 2024-01-13T18:11:55.739 INFO:tasks.rados.rados.0.smithi084.stdout:3396: done (2 left) 2024-01-13T18:11:55.740 INFO:tasks.rados.rados.0.smithi084.stdout:3397: done (1 left) 2024-01-13T18:11:55.740 INFO:tasks.rados.rados.0.smithi084.stdout:3399: done (0 left) 2024-01-13T18:11:55.740 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 331 2024-01-13T18:11:55.740 INFO:tasks.rados.rados.0.smithi084.stdout:3400: seq_num 1044 ranges {3350528=688128} 2024-01-13T18:11:55.761 INFO:tasks.rados.rados.0.smithi084.stdout:3400: writing smithi084102331-17 from 3350528 to 4038656 tid 1 2024-01-13T18:11:55.761 INFO:tasks.rados.rados.0.smithi084.stdout:3401: read oid 7 snap -1 2024-01-13T18:11:55.761 INFO:tasks.rados.rados.0.smithi084.stdout:3401: expect (ObjNum 1036 snap 329 seq_num 1036) 2024-01-13T18:11:55.761 INFO:tasks.rados.rados.0.smithi084.stdout:3402: snap_remove snap 330 2024-01-13T18:11:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:55 smithi099 ceph-mon[138788]: osdmap e732: 8 total, 8 up, 8 in 2024-01-13T18:11:56.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:55 smithi084 ceph-mon[116404]: osdmap e732: 8 total, 8 up, 8 in 2024-01-13T18:11:56.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:55 smithi084 ceph-mon[119097]: osdmap e732: 8 total, 8 up, 8 in 2024-01-13T18:11:56.744 INFO:tasks.rados.rados.0.smithi084.stdout:3402: done (2 left) 2024-01-13T18:11:56.744 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 331 2024-01-13T18:11:56.744 INFO:tasks.rados.rados.0.smithi084.stdout:3400: finishing write tid 1 to smithi084102331-17 2024-01-13T18:11:56.744 INFO:tasks.rados.rados.0.smithi084.stdout:3400: finishing write tid 2 to smithi084102331-17 2024-01-13T18:11:56.744 INFO:tasks.rados.rados.0.smithi084.stdout:3401: expect (ObjNum 1036 snap 329 seq_num 1036) 2024-01-13T18:11:56.806 INFO:tasks.rados.rados.0.smithi084.stdout:3400: finishing write tid 3 to smithi084102331-17 2024-01-13T18:11:56.806 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1637 (ObjNum 1044 snap 331 seq_num 1044) dirty exists 2024-01-13T18:11:56.806 INFO:tasks.rados.rados.0.smithi084.stdout:3400: left oid 17 (ObjNum 1044 snap 331 seq_num 1044) 2024-01-13T18:11:56.806 INFO:tasks.rados.rados.0.smithi084.stdout:3403: seq_num 1045 ranges {0=704512} 2024-01-13T18:11:56.810 INFO:tasks.rados.rados.0.smithi084.stdout:3403: writing smithi084102331-16 from 0 to 704512 tid 1 2024-01-13T18:11:56.810 INFO:tasks.rados.rados.0.smithi084.stdout:3400: done (2 left) 2024-01-13T18:11:56.810 INFO:tasks.rados.rados.0.smithi084.stdout:3401: done (1 left) 2024-01-13T18:11:56.810 INFO:tasks.rados.rados.0.smithi084.stdout:3404: rmattr oid 4 current snap is 331 2024-01-13T18:11:56.810 INFO:tasks.rados.rados.0.smithi084.stdout:3404: done (1 left) 2024-01-13T18:11:56.810 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 331 2024-01-13T18:11:56.810 INFO:tasks.rados.rados.0.smithi084.stdout:3405: seq_num 1046 ranges {2859008=729088} 2024-01-13T18:11:56.829 INFO:tasks.rados.rados.0.smithi084.stdout:3405: writing smithi084102331-33 from 2859008 to 3588096 tid 1 2024-01-13T18:11:56.829 INFO:tasks.rados.rados.0.smithi084.stdout:3406: delete oid 50 current snap is 331 2024-01-13T18:11:56.829 INFO:tasks.rados.rados.0.smithi084.stdout:3403: finishing write tid 1 to smithi084102331-16 2024-01-13T18:11:56.830 INFO:tasks.rados.rados.0.smithi084.stdout:3403: finishing write tid 2 to smithi084102331-16 2024-01-13T18:11:56.830 INFO:tasks.rados.rados.0.smithi084.stdout:3403: finishing write tid 3 to smithi084102331-16 2024-01-13T18:11:56.830 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1613 (ObjNum 1045 snap 331 seq_num 1045) dirty exists 2024-01-13T18:11:56.830 INFO:tasks.rados.rados.0.smithi084.stdout:3403: left oid 16 (ObjNum 1045 snap 331 seq_num 1045) 2024-01-13T18:11:56.836 INFO:tasks.rados.rados.0.smithi084.stdout:3405: finishing write tid 1 to smithi084102331-33 2024-01-13T18:11:56.836 INFO:tasks.rados.rados.0.smithi084.stdout:3405: finishing write tid 2 to smithi084102331-33 2024-01-13T18:11:56.839 INFO:tasks.rados.rados.0.smithi084.stdout:3405: finishing write tid 3 to smithi084102331-33 2024-01-13T18:11:56.839 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1658 (ObjNum 1046 snap 331 seq_num 1046) dirty exists 2024-01-13T18:11:56.840 INFO:tasks.rados.rados.0.smithi084.stdout:3405: left oid 33 (ObjNum 1046 snap 331 seq_num 1046) 2024-01-13T18:11:56.840 INFO:tasks.rados.rados.0.smithi084.stdout:3403: done (2 left) 2024-01-13T18:11:56.840 INFO:tasks.rados.rados.0.smithi084.stdout:3405: done (1 left) 2024-01-13T18:11:56.840 INFO:tasks.rados.rados.0.smithi084.stdout:3406: done (0 left) 2024-01-13T18:11:56.840 INFO:tasks.rados.rados.0.smithi084.stdout:3407: copy_from oid 7 from oid 15 current snap is 331 2024-01-13T18:11:56.840 INFO:tasks.rados.rados.0.smithi084.stdout:3408: rmattr oid 5 current snap is 331 2024-01-13T18:11:56.840 INFO:tasks.rados.rados.0.smithi084.stdout:3408: done (1 left) 2024-01-13T18:11:56.840 INFO:tasks.rados.rados.0.smithi084.stdout:3409: snap_remove snap 315 2024-01-13T18:11:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:56 smithi099 ceph-mon[138788]: osdmap e733: 8 total, 8 up, 8 in 2024-01-13T18:11:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:56 smithi099 ceph-mon[138788]: pgmap v812: 121 pgs: 121 active+clean; 285 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.7 MiB/s wr, 6 op/s 2024-01-13T18:11:57.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:56 smithi084 ceph-mon[116404]: osdmap e733: 8 total, 8 up, 8 in 2024-01-13T18:11:57.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:56 smithi084 ceph-mon[116404]: pgmap v812: 121 pgs: 121 active+clean; 285 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.7 MiB/s wr, 6 op/s 2024-01-13T18:11:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:56 smithi084 ceph-mon[119097]: osdmap e733: 8 total, 8 up, 8 in 2024-01-13T18:11:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:56 smithi084 ceph-mon[119097]: pgmap v812: 121 pgs: 121 active+clean; 285 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.7 MiB/s wr, 6 op/s 2024-01-13T18:11:57.725 INFO:tasks.rados.rados.0.smithi084.stdout:3409: done (1 left) 2024-01-13T18:11:57.725 INFO:tasks.rados.rados.0.smithi084.stdout:3410: setattr oid 41 current snap is 331 2024-01-13T18:11:57.729 INFO:tasks.rados.rados.0.smithi084.stdout:3411: copy_from oid 35 from oid 45 current snap is 331 2024-01-13T18:11:57.729 INFO:tasks.rados.rados.0.smithi084.stdout:3412: read oid 22 snap -1 2024-01-13T18:11:57.729 INFO:tasks.rados.rados.0.smithi084.stdout:3412: expect (ObjNum 991 snap 311 seq_num 991) 2024-01-13T18:11:57.730 INFO:tasks.rados.rados.0.smithi084.stdout:3413: read oid 16 snap 323 2024-01-13T18:11:57.730 INFO:tasks.rados.rados.0.smithi084.stdout:3413: expect deleted 2024-01-13T18:11:57.730 INFO:tasks.rados.rados.0.smithi084.stdout:3414: read oid 27 snap -1 2024-01-13T18:11:57.730 INFO:tasks.rados.rados.0.smithi084.stdout:3414: expect (ObjNum 1033 snap 326 seq_num 1033) 2024-01-13T18:11:57.730 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 331 2024-01-13T18:11:57.730 INFO:tasks.rados.rados.0.smithi084.stdout:3415: seq_num 1048 ranges {3866624=761856} 2024-01-13T18:11:57.763 INFO:tasks.rados.rados.0.smithi084.stdout:3415: writing smithi084102331-2 from 3866624 to 4628480 tid 1 2024-01-13T18:11:57.763 INFO:tasks.rados.rados.0.smithi084.stdout:3416: read oid 49 snap -1 2024-01-13T18:11:57.763 INFO:tasks.rados.rados.0.smithi084.stdout:3416: expect (ObjNum 1002 snap 313 seq_num 1002) 2024-01-13T18:11:57.763 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 331 2024-01-13T18:11:57.763 INFO:tasks.rados.rados.0.smithi084.stdout:3417: seq_num 1049 ranges {11067392=778240} 2024-01-13T18:11:57.822 INFO:tasks.rados.rados.0.smithi084.stdout:3417: writing smithi084102331-43 from 11067392 to 11845632 tid 1 2024-01-13T18:11:57.822 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 331 2024-01-13T18:11:57.822 INFO:tasks.rados.rados.0.smithi084.stdout:3407: finishing copy_from to smithi084102331-7 2024-01-13T18:11:57.823 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1725 (ObjNum 1038 snap 329 seq_num 1038) dirty exists 2024-01-13T18:11:57.823 INFO:tasks.rados.rados.0.smithi084.stdout:3407: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:11:57.823 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1513 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-01-13T18:11:57.823 INFO:tasks.rados.rados.0.smithi084.stdout:3414: expect (ObjNum 1033 snap 326 seq_num 1033) 2024-01-13T18:11:57.993 INFO:tasks.rados.rados.0.smithi084.stdout:3412: expect (ObjNum 991 snap 311 seq_num 991) 2024-01-13T18:11:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:57 smithi099 ceph-mon[138788]: osdmap e734: 8 total, 8 up, 8 in 2024-01-13T18:11:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:57 smithi099 ceph-mon[138788]: osdmap e735: 8 total, 8 up, 8 in 2024-01-13T18:11:58.175 INFO:tasks.rados.rados.0.smithi084.stdout:3415: finishing write tid 1 to smithi084102331-2 2024-01-13T18:11:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:3415: finishing write tid 2 to smithi084102331-2 2024-01-13T18:11:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:3415: finishing write tid 3 to smithi084102331-2 2024-01-13T18:11:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1774 (ObjNum 1048 snap 331 seq_num 1048) dirty exists 2024-01-13T18:11:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:3415: left oid 2 (ObjNum 1048 snap 331 seq_num 1048) 2024-01-13T18:11:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:3411: finishing copy_from to smithi084102331-35 2024-01-13T18:11:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1673 (ObjNum 1011 snap 316 seq_num 1011) dirty exists 2024-01-13T18:11:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:3411: finishing copy_from racing read to smithi084102331-35 2024-01-13T18:11:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:3416: expect (ObjNum 1002 snap 313 seq_num 1002) 2024-01-13T18:11:58.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:57 smithi084 ceph-mon[116404]: osdmap e734: 8 total, 8 up, 8 in 2024-01-13T18:11:58.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:57 smithi084 ceph-mon[116404]: osdmap e735: 8 total, 8 up, 8 in 2024-01-13T18:11:58.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:57 smithi084 ceph-mon[119097]: osdmap e734: 8 total, 8 up, 8 in 2024-01-13T18:11:58.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:57 smithi084 ceph-mon[119097]: osdmap e735: 8 total, 8 up, 8 in 2024-01-13T18:11:59.056 INFO:tasks.rados.rados.0.smithi084.stdout:3417: finishing write tid 1 to smithi084102331-43 2024-01-13T18:11:59.057 INFO:tasks.rados.rados.0.smithi084.stdout:3417: finishing write tid 2 to smithi084102331-43 2024-01-13T18:11:59.057 INFO:tasks.rados.rados.0.smithi084.stdout:3417: finishing write tid 3 to smithi084102331-43 2024-01-13T18:11:59.057 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1727 (ObjNum 1049 snap 331 seq_num 1049) dirty exists 2024-01-13T18:11:59.057 INFO:tasks.rados.rados.0.smithi084.stdout:3417: left oid 43 (ObjNum 1049 snap 331 seq_num 1049) 2024-01-13T18:11:59.057 INFO:tasks.rados.rados.0.smithi084.stdout:3418: seq_num 1050 ranges {11067392=794624} 2024-01-13T18:11:59.119 INFO:tasks.rados.rados.0.smithi084.stdout:3418: writing smithi084102331-18 from 11067392 to 11862016 tid 1 2024-01-13T18:11:59.119 INFO:tasks.rados.rados.0.smithi084.stdout:3407: done (9 left) 2024-01-13T18:11:59.119 INFO:tasks.rados.rados.0.smithi084.stdout:3410: done (8 left) 2024-01-13T18:11:59.119 INFO:tasks.rados.rados.0.smithi084.stdout:3411: done (7 left) 2024-01-13T18:11:59.119 INFO:tasks.rados.rados.0.smithi084.stdout:3412: done (6 left) 2024-01-13T18:11:59.119 INFO:tasks.rados.rados.0.smithi084.stdout:3413: done (5 left) 2024-01-13T18:11:59.119 INFO:tasks.rados.rados.0.smithi084.stdout:3414: done (4 left) 2024-01-13T18:11:59.119 INFO:tasks.rados.rados.0.smithi084.stdout:3415: done (3 left) 2024-01-13T18:11:59.119 INFO:tasks.rados.rados.0.smithi084.stdout:3416: done (2 left) 2024-01-13T18:11:59.119 INFO:tasks.rados.rados.0.smithi084.stdout:3417: done (1 left) 2024-01-13T18:11:59.119 INFO:tasks.rados.rados.0.smithi084.stdout:3419: delete oid 26 current snap is 331 2024-01-13T18:11:59.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:11:58 smithi099 ceph-mon[138788]: pgmap v815: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 286 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 11 op/s 2024-01-13T18:11:59.120 INFO:tasks.rados.rados.0.smithi084.stdout:3419: done (1 left) 2024-01-13T18:11:59.121 INFO:tasks.rados.rados.0.smithi084.stdout:3420: snap_create 2024-01-13T18:11:59.122 INFO:tasks.rados.rados.0.smithi084.stdout:3418: finishing write tid 1 to smithi084102331-18 2024-01-13T18:11:59.122 INFO:tasks.rados.rados.0.smithi084.stdout:3418: finishing write tid 2 to smithi084102331-18 2024-01-13T18:11:59.126 INFO:tasks.rados.rados.0.smithi084.stdout:3418: finishing write tid 3 to smithi084102331-18 2024-01-13T18:11:59.127 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1509 (ObjNum 1050 snap 331 seq_num 1050) dirty exists 2024-01-13T18:11:59.127 INFO:tasks.rados.rados.0.smithi084.stdout:3418: left oid 18 (ObjNum 1050 snap 331 seq_num 1050) 2024-01-13T18:11:59.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:11:58 smithi084 ceph-mon[116404]: pgmap v815: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 286 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 11 op/s 2024-01-13T18:11:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:11:58 smithi084 ceph-mon[119097]: pgmap v815: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 286 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 11 op/s 2024-01-13T18:11:59.774 INFO:tasks.rados.rados.0.smithi084.stdout:3418: done (1 left) 2024-01-13T18:11:59.774 INFO:tasks.rados.rados.0.smithi084.stdout:3420: done (0 left) 2024-01-13T18:11:59.774 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 332 2024-01-13T18:11:59.774 INFO:tasks.rados.rados.0.smithi084.stdout:3421: seq_num 1052 ranges {5890048=425984,6316032=401408} 2024-01-13T18:11:59.807 INFO:tasks.rados.rados.0.smithi084.stdout:3421: writing smithi084102331-20 from 5890048 to 6316032 tid 1 2024-01-13T18:11:59.809 INFO:tasks.rados.rados.0.smithi084.stdout:3421: writing smithi084102331-20 from 6316032 to 6717440 tid 2 2024-01-13T18:11:59.809 INFO:tasks.rados.rados.0.smithi084.stdout:3422: read oid 7 snap -1 2024-01-13T18:11:59.809 INFO:tasks.rados.rados.0.smithi084.stdout:3422: expect (ObjNum 1038 snap 329 seq_num 1038) 2024-01-13T18:11:59.809 INFO:tasks.rados.rados.0.smithi084.stdout:3423: rollback oid 37 current snap is 332 2024-01-13T18:11:59.809 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 312 2024-01-13T18:11:59.809 INFO:tasks.rados.rados.0.smithi084.stdout:3424: snap_create 2024-01-13T18:11:59.812 INFO:tasks.rados.rados.0.smithi084.stdout:3422: expect (ObjNum 1038 snap 329 seq_num 1038) 2024-01-13T18:11:59.827 INFO:tasks.rados.rados.0.smithi084.stdout:3423: finishing rollback tid 0 to smithi084102331-37 2024-01-13T18:11:59.827 INFO:tasks.rados.rados.0.smithi084.stdout:3423: finishing rollback tid 1 to smithi084102331-37 2024-01-13T18:11:59.828 INFO:tasks.rados.rados.0.smithi084.stdout:3423: finishing rollback tid 2 to smithi084102331-37 2024-01-13T18:11:59.828 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1662 (ObjNum 942 snap 298 seq_num 942) dirty exists 2024-01-13T18:11:59.828 INFO:tasks.rados.rados.0.smithi084.stdout:3421: finishing write tid 1 to smithi084102331-20 2024-01-13T18:11:59.828 INFO:tasks.rados.rados.0.smithi084.stdout:3421: finishing write tid 2 to smithi084102331-20 2024-01-13T18:11:59.828 INFO:tasks.rados.rados.0.smithi084.stdout:3421: finishing write tid 3 to smithi084102331-20 2024-01-13T18:11:59.828 INFO:tasks.rados.rados.0.smithi084.stdout:3421: finishing write tid 4 to smithi084102331-20 2024-01-13T18:11:59.828 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1614 (ObjNum 1052 snap 332 seq_num 1052) dirty exists 2024-01-13T18:11:59.828 INFO:tasks.rados.rados.0.smithi084.stdout:3421: left oid 20 (ObjNum 1052 snap 332 seq_num 1052) 2024-01-13T18:12:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:12:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:12:00] "GET /metrics HTTP/1.1" 200 36192 "" "Prometheus/2.43.0" 2024-01-13T18:12:00.779 INFO:tasks.rados.rados.0.smithi084.stdout:3421: done (3 left) 2024-01-13T18:12:00.779 INFO:tasks.rados.rados.0.smithi084.stdout:3422: done (2 left) 2024-01-13T18:12:00.779 INFO:tasks.rados.rados.0.smithi084.stdout:3423: done (1 left) 2024-01-13T18:12:00.779 INFO:tasks.rados.rados.0.smithi084.stdout:3424: done (0 left) 2024-01-13T18:12:00.779 INFO:tasks.rados.rados.0.smithi084.stdout:3425: snap_create 2024-01-13T18:12:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:00 smithi099 ceph-mon[138788]: osdmap e736: 8 total, 8 up, 8 in 2024-01-13T18:12:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:00 smithi099 ceph-mon[138788]: pgmap v817: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 282 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 610 KiB/s wr, 9 op/s 2024-01-13T18:12:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:00 smithi084 ceph-mon[116404]: osdmap e736: 8 total, 8 up, 8 in 2024-01-13T18:12:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:00 smithi084 ceph-mon[116404]: pgmap v817: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 282 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 610 KiB/s wr, 9 op/s 2024-01-13T18:12:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:00 smithi084 ceph-mon[119097]: osdmap e736: 8 total, 8 up, 8 in 2024-01-13T18:12:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:00 smithi084 ceph-mon[119097]: pgmap v817: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 282 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 610 KiB/s wr, 9 op/s 2024-01-13T18:12:01.780 INFO:tasks.rados.rados.0.smithi084.stdout:3425: done (0 left) 2024-01-13T18:12:01.780 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 334 2024-01-13T18:12:01.780 INFO:tasks.rados.rados.0.smithi084.stdout:3426: seq_num 1053 ranges {3842048=442368,4284416=401408} 2024-01-13T18:12:01.803 INFO:tasks.rados.rados.0.smithi084.stdout:3426: writing smithi084102331-8 from 3842048 to 4284416 tid 1 2024-01-13T18:12:01.805 INFO:tasks.rados.rados.0.smithi084.stdout:3426: writing smithi084102331-8 from 4284416 to 4685824 tid 2 2024-01-13T18:12:01.805 INFO:tasks.rados.rados.0.smithi084.stdout:3427: rollback oid 37 current snap is 334 2024-01-13T18:12:01.805 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 326 2024-01-13T18:12:01.805 INFO:tasks.rados.rados.0.smithi084.stdout:3428: snap_create 2024-01-13T18:12:01.810 INFO:tasks.rados.rados.0.smithi084.stdout:3426: finishing write tid 1 to smithi084102331-8 2024-01-13T18:12:01.810 INFO:tasks.rados.rados.0.smithi084.stdout:3426: finishing write tid 2 to smithi084102331-8 2024-01-13T18:12:01.811 INFO:tasks.rados.rados.0.smithi084.stdout:3426: finishing write tid 3 to smithi084102331-8 2024-01-13T18:12:01.814 INFO:tasks.rados.rados.0.smithi084.stdout:3427: finishing rollback tid 0 to smithi084102331-37 2024-01-13T18:12:01.815 INFO:tasks.rados.rados.0.smithi084.stdout:3427: finishing rollback tid 1 to smithi084102331-37 2024-01-13T18:12:01.815 INFO:tasks.rados.rados.0.smithi084.stdout:3426: finishing write tid 4 to smithi084102331-8 2024-01-13T18:12:01.815 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1728 (ObjNum 1053 snap 334 seq_num 1053) dirty exists 2024-01-13T18:12:01.815 INFO:tasks.rados.rados.0.smithi084.stdout:3426: left oid 8 (ObjNum 1053 snap 334 seq_num 1053) 2024-01-13T18:12:01.815 INFO:tasks.rados.rados.0.smithi084.stdout:3427: finishing rollback tid 2 to smithi084102331-37 2024-01-13T18:12:01.815 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1665 (ObjNum 942 snap 298 seq_num 942) dirty exists 2024-01-13T18:12:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:01 smithi099 ceph-mon[138788]: osdmap e737: 8 total, 8 up, 8 in 2024-01-13T18:12:02.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:01 smithi084 ceph-mon[116404]: osdmap e737: 8 total, 8 up, 8 in 2024-01-13T18:12:02.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:01 smithi084 ceph-mon[119097]: osdmap e737: 8 total, 8 up, 8 in 2024-01-13T18:12:02.723 INFO:tasks.rados.rados.0.smithi084.stdout:3426: done (2 left) 2024-01-13T18:12:02.723 INFO:tasks.rados.rados.0.smithi084.stdout:3427: done (1 left) 2024-01-13T18:12:02.723 INFO:tasks.rados.rados.0.smithi084.stdout:3428: done (0 left) 2024-01-13T18:12:02.723 INFO:tasks.rados.rados.0.smithi084.stdout:3429: setattr oid 17 current snap is 335 2024-01-13T18:12:02.725 INFO:tasks.rados.rados.0.smithi084.stdout:3430: snap_create 2024-01-13T18:12:02.729 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1638 (ObjNum 1044 snap 331 seq_num 1044) dirty exists 2024-01-13T18:12:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:02 smithi099 ceph-mon[138788]: osdmap e738: 8 total, 8 up, 8 in 2024-01-13T18:12:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:02 smithi099 ceph-mon[138788]: pgmap v820: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 293 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 2.8 MiB/s wr, 13 op/s 2024-01-13T18:12:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:02 smithi099 ceph-mon[138788]: osdmap e739: 8 total, 8 up, 8 in 2024-01-13T18:12:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:02 smithi084 ceph-mon[116404]: osdmap e738: 8 total, 8 up, 8 in 2024-01-13T18:12:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:02 smithi084 ceph-mon[116404]: pgmap v820: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 293 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 2.8 MiB/s wr, 13 op/s 2024-01-13T18:12:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:02 smithi084 ceph-mon[116404]: osdmap e739: 8 total, 8 up, 8 in 2024-01-13T18:12:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:02 smithi084 ceph-mon[119097]: osdmap e738: 8 total, 8 up, 8 in 2024-01-13T18:12:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:02 smithi084 ceph-mon[119097]: pgmap v820: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 293 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 2.8 MiB/s wr, 13 op/s 2024-01-13T18:12:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:02 smithi084 ceph-mon[119097]: osdmap e739: 8 total, 8 up, 8 in 2024-01-13T18:12:03.730 INFO:tasks.rados.rados.0.smithi084.stdout:3429: done (1 left) 2024-01-13T18:12:03.730 INFO:tasks.rados.rados.0.smithi084.stdout:3430: done (0 left) 2024-01-13T18:12:03.730 INFO:tasks.rados.rados.0.smithi084.stdout:3431: snap_create 2024-01-13T18:12:04.741 INFO:tasks.rados.rados.0.smithi084.stdout:3431: done (0 left) 2024-01-13T18:12:04.741 INFO:tasks.rados.rados.0.smithi084.stdout:3432: read oid 29 snap -1 2024-01-13T18:12:04.741 INFO:tasks.rados.rados.0.smithi084.stdout:3432: expect (ObjNum 1032 snap 325 seq_num 1032) 2024-01-13T18:12:04.741 INFO:tasks.rados.rados.0.smithi084.stdout:3433: rollback oid 31 current snap is 337 2024-01-13T18:12:04.741 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 336 2024-01-13T18:12:04.741 INFO:tasks.rados.rados.0.smithi084.stdout:3434: read oid 43 snap -1 2024-01-13T18:12:04.741 INFO:tasks.rados.rados.0.smithi084.stdout:3434: expect (ObjNum 1049 snap 331 seq_num 1049) 2024-01-13T18:12:04.742 INFO:tasks.rados.rados.0.smithi084.stdout:3435: delete oid 5 current snap is 337 2024-01-13T18:12:04.749 INFO:tasks.rados.rados.0.smithi084.stdout:3435: done (3 left) 2024-01-13T18:12:04.749 INFO:tasks.rados.rados.0.smithi084.stdout:3436: snap_remove snap 323 2024-01-13T18:12:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:04 smithi099 ceph-mon[138788]: osdmap e740: 8 total, 8 up, 8 in 2024-01-13T18:12:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:04 smithi099 ceph-mon[138788]: pgmap v823: 121 pgs: 121 active+clean; 295 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.6 MiB/s rd, 3.1 MiB/s wr, 8 op/s 2024-01-13T18:12:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:04 smithi084 ceph-mon[116404]: osdmap e740: 8 total, 8 up, 8 in 2024-01-13T18:12:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:04 smithi084 ceph-mon[116404]: pgmap v823: 121 pgs: 121 active+clean; 295 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.6 MiB/s rd, 3.1 MiB/s wr, 8 op/s 2024-01-13T18:12:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:04 smithi084 ceph-mon[119097]: osdmap e740: 8 total, 8 up, 8 in 2024-01-13T18:12:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:04 smithi084 ceph-mon[119097]: pgmap v823: 121 pgs: 121 active+clean; 295 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.6 MiB/s rd, 3.1 MiB/s wr, 8 op/s 2024-01-13T18:12:05.752 INFO:tasks.rados.rados.0.smithi084.stdout:3436: done (3 left) 2024-01-13T18:12:05.752 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 337 2024-01-13T18:12:05.752 INFO:tasks.rados.rados.0.smithi084.stdout:3437: seq_num 1055 ranges {3276800=475136,3751936=401408} 2024-01-13T18:12:05.773 INFO:tasks.rados.rados.0.smithi084.stdout:3437: writing smithi084102331-14 from 3276800 to 3751936 tid 1 2024-01-13T18:12:05.775 INFO:tasks.rados.rados.0.smithi084.stdout:3437: writing smithi084102331-14 from 3751936 to 4153344 tid 2 2024-01-13T18:12:05.775 INFO:tasks.rados.rados.0.smithi084.stdout:3438: snap_remove snap 335 2024-01-13T18:12:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:05 smithi099 ceph-mon[138788]: osdmap e741: 8 total, 8 up, 8 in 2024-01-13T18:12:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:06.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:05 smithi084 ceph-mon[116404]: osdmap e741: 8 total, 8 up, 8 in 2024-01-13T18:12:06.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:06.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:05 smithi084 ceph-mon[119097]: osdmap e741: 8 total, 8 up, 8 in 2024-01-13T18:12:06.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:06.758 INFO:tasks.rados.rados.0.smithi084.stdout:3438: done (4 left) 2024-01-13T18:12:06.758 INFO:tasks.rados.rados.0.smithi084.stdout:3439: read oid 5 snap 336 2024-01-13T18:12:06.758 INFO:tasks.rados.rados.0.smithi084.stdout:3439: expect (ObjNum 1017 snap 318 seq_num 1017) 2024-01-13T18:12:06.758 INFO:tasks.rados.rados.0.smithi084.stdout:3440: copy_from oid 20 from oid 16 current snap is 337 2024-01-13T18:12:06.758 INFO:tasks.rados.rados.0.smithi084.stdout:3433: finishing rollback tid 1 to smithi084102331-31 2024-01-13T18:12:06.758 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 0 (ObjNum 65 snap 0 seq_num 1467045467) dirty dne 2024-01-13T18:12:06.758 INFO:tasks.rados.rados.0.smithi084.stdout:3432: expect (ObjNum 1032 snap 325 seq_num 1032) 2024-01-13T18:12:06.953 INFO:tasks.rados.rados.0.smithi084.stdout:3434: expect (ObjNum 1049 snap 331 seq_num 1049) 2024-01-13T18:12:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:06 smithi099 ceph-mon[138788]: osdmap e742: 8 total, 8 up, 8 in 2024-01-13T18:12:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:06 smithi099 ceph-mon[138788]: pgmap v826: 121 pgs: 121 active+clean; 295 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 400 KiB/s wr, 2 op/s 2024-01-13T18:12:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:06 smithi084 ceph-mon[116404]: osdmap e742: 8 total, 8 up, 8 in 2024-01-13T18:12:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:06 smithi084 ceph-mon[116404]: pgmap v826: 121 pgs: 121 active+clean; 295 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 400 KiB/s wr, 2 op/s 2024-01-13T18:12:07.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:06 smithi084 ceph-mon[119097]: osdmap e742: 8 total, 8 up, 8 in 2024-01-13T18:12:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:06 smithi084 ceph-mon[119097]: pgmap v826: 121 pgs: 121 active+clean; 295 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 400 KiB/s wr, 2 op/s 2024-01-13T18:12:08.060 INFO:tasks.rados.rados.0.smithi084.stdout:3437: finishing write tid 1 to smithi084102331-14 2024-01-13T18:12:08.060 INFO:tasks.rados.rados.0.smithi084.stdout:3437: finishing write tid 2 to smithi084102331-14 2024-01-13T18:12:08.060 INFO:tasks.rados.rados.0.smithi084.stdout:3437: finishing write tid 3 to smithi084102331-14 2024-01-13T18:12:08.060 INFO:tasks.rados.rados.0.smithi084.stdout:3437: finishing write tid 4 to smithi084102331-14 2024-01-13T18:12:08.061 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1654 (ObjNum 1055 snap 337 seq_num 1055) dirty exists 2024-01-13T18:12:08.061 INFO:tasks.rados.rados.0.smithi084.stdout:3437: left oid 14 (ObjNum 1055 snap 337 seq_num 1055) 2024-01-13T18:12:08.061 INFO:tasks.rados.rados.0.smithi084.stdout:3432: done (5 left) 2024-01-13T18:12:08.061 INFO:tasks.rados.rados.0.smithi084.stdout:3433: done (4 left) 2024-01-13T18:12:08.061 INFO:tasks.rados.rados.0.smithi084.stdout:3434: done (3 left) 2024-01-13T18:12:08.061 INFO:tasks.rados.rados.0.smithi084.stdout:3437: done (2 left) 2024-01-13T18:12:08.061 INFO:tasks.rados.rados.0.smithi084.stdout:3441: setattr oid 47 current snap is 337 2024-01-13T18:12:08.061 INFO:tasks.rados.rados.0.smithi084.stdout:3439: expect (ObjNum 1017 snap 318 seq_num 1017) 2024-01-13T18:12:08.066 INFO:tasks.rados.rados.0.smithi084.stdout:3440: finishing copy_from to smithi084102331-20 2024-01-13T18:12:08.066 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1613 (ObjNum 1045 snap 331 seq_num 1045) dirty exists 2024-01-13T18:12:08.066 INFO:tasks.rados.rados.0.smithi084.stdout:3440: finishing copy_from racing read to smithi084102331-20 2024-01-13T18:12:08.066 INFO:tasks.rados.rados.0.smithi084.stdout:3439: done (2 left) 2024-01-13T18:12:08.066 INFO:tasks.rados.rados.0.smithi084.stdout:3440: done (1 left) 2024-01-13T18:12:08.066 INFO:tasks.rados.rados.0.smithi084.stdout:3442: snap_create 2024-01-13T18:12:08.069 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1729 (ObjNum 289 snap 0 seq_num 2814499203) dirty exists 2024-01-13T18:12:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:07 smithi099 ceph-mon[138788]: osdmap e743: 8 total, 8 up, 8 in 2024-01-13T18:12:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:07 smithi099 ceph-mon[138788]: osdmap e744: 8 total, 8 up, 8 in 2024-01-13T18:12:08.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:07 smithi084 ceph-mon[119097]: osdmap e743: 8 total, 8 up, 8 in 2024-01-13T18:12:08.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:07 smithi084 ceph-mon[119097]: osdmap e744: 8 total, 8 up, 8 in 2024-01-13T18:12:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:07 smithi084 ceph-mon[116404]: osdmap e743: 8 total, 8 up, 8 in 2024-01-13T18:12:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:07 smithi084 ceph-mon[116404]: osdmap e744: 8 total, 8 up, 8 in 2024-01-13T18:12:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3441: done (1 left) 2024-01-13T18:12:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3442: done (0 left) 2024-01-13T18:12:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3443: delete oid 34 current snap is 338 2024-01-13T18:12:08.767 INFO:tasks.rados.rados.0.smithi084.stdout:3443: done (0 left) 2024-01-13T18:12:08.767 INFO:tasks.rados.rados.0.smithi084.stdout:3444: rmattr oid 6 current snap is 338 2024-01-13T18:12:08.767 INFO:tasks.rados.rados.0.smithi084.stdout:3445: read oid 37 snap -1 2024-01-13T18:12:08.768 INFO:tasks.rados.rados.0.smithi084.stdout:3445: expect (ObjNum 942 snap 298 seq_num 942) 2024-01-13T18:12:08.768 INFO:tasks.rados.rados.0.smithi084.stdout:3446: delete oid 32 current snap is 338 2024-01-13T18:12:08.770 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 1654 (ObjNum 1031 snap 325 seq_num 1031) dirty exists 2024-01-13T18:12:08.772 INFO:tasks.rados.rados.0.smithi084.stdout:3444: done (2 left) 2024-01-13T18:12:08.772 INFO:tasks.rados.rados.0.smithi084.stdout:3446: done (1 left) 2024-01-13T18:12:08.772 INFO:tasks.rados.rados.0.smithi084.stdout:3447: rollback oid 25 current snap is 338 2024-01-13T18:12:08.772 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 25 to 337 2024-01-13T18:12:08.772 INFO:tasks.rados.rados.0.smithi084.stdout:3448: read oid 20 snap 329 2024-01-13T18:12:08.772 INFO:tasks.rados.rados.0.smithi084.stdout:3448: expect (ObjNum 974 snap 308 seq_num 974) 2024-01-13T18:12:08.772 INFO:tasks.rados.rados.0.smithi084.stdout:3449: snap_remove snap 313 2024-01-13T18:12:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:08 smithi099 ceph-mon[138788]: pgmap v829: 121 pgs: 121 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 0 B/s wr, 8 op/s 2024-01-13T18:12:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:08 smithi084 ceph-mon[116404]: pgmap v829: 121 pgs: 121 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 0 B/s wr, 8 op/s 2024-01-13T18:12:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:08 smithi084 ceph-mon[119097]: pgmap v829: 121 pgs: 121 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 0 B/s wr, 8 op/s 2024-01-13T18:12:09.771 INFO:tasks.rados.rados.0.smithi084.stdout:3449: done (3 left) 2024-01-13T18:12:09.771 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 338 2024-01-13T18:12:09.771 INFO:tasks.rados.rados.0.smithi084.stdout:3450: seq_num 1058 ranges {704512=524288,1228800=401408} 2024-01-13T18:12:09.776 INFO:tasks.rados.rados.0.smithi084.stdout:3450: writing smithi084102331-16 from 704512 to 1228800 tid 1 2024-01-13T18:12:09.780 INFO:tasks.rados.rados.0.smithi084.stdout:3450: writing smithi084102331-16 from 1228800 to 1630208 tid 2 2024-01-13T18:12:09.781 INFO:tasks.rados.rados.0.smithi084.stdout:3451: copy_from oid 41 from oid 44 current snap is 338 2024-01-13T18:12:09.781 INFO:tasks.rados.rados.0.smithi084.stdout:3445: expect (ObjNum 942 snap 298 seq_num 942) 2024-01-13T18:12:09.822 INFO:tasks.rados.rados.0.smithi084.stdout:3447: finishing rollback tid 0 to smithi084102331-25 2024-01-13T18:12:09.822 INFO:tasks.rados.rados.0.smithi084.stdout:3447: finishing rollback tid 1 to smithi084102331-25 2024-01-13T18:12:09.823 INFO:tasks.rados.rados.0.smithi084.stdout:3447: finishing rollback tid 2 to smithi084102331-25 2024-01-13T18:12:09.823 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1668 (ObjNum 991 snap 311 seq_num 991) dirty exists 2024-01-13T18:12:09.823 INFO:tasks.rados.rados.0.smithi084.stdout:3445: done (4 left) 2024-01-13T18:12:09.823 INFO:tasks.rados.rados.0.smithi084.stdout:3447: done (3 left) 2024-01-13T18:12:09.823 INFO:tasks.rados.rados.0.smithi084.stdout:3452: read oid 32 snap -1 2024-01-13T18:12:09.823 INFO:tasks.rados.rados.0.smithi084.stdout:3452: expect deleted 2024-01-13T18:12:09.824 INFO:tasks.rados.rados.0.smithi084.stdout:3453: snap_remove snap 337 2024-01-13T18:12:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:09 smithi099 ceph-mon[138788]: osdmap e745: 8 total, 8 up, 8 in 2024-01-13T18:12:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:09 smithi084 ceph-mon[116404]: osdmap e745: 8 total, 8 up, 8 in 2024-01-13T18:12:10.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:09 smithi084 ceph-mon[119097]: osdmap e745: 8 total, 8 up, 8 in 2024-01-13T18:12:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:12:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:12:10] "GET /metrics HTTP/1.1" 200 36195 "" "Prometheus/2.43.0" 2024-01-13T18:12:10.773 INFO:tasks.rados.rados.0.smithi084.stdout:3453: done (4 left) 2024-01-13T18:12:10.773 INFO:tasks.rados.rados.0.smithi084.stdout:3454: snap_remove snap 334 2024-01-13T18:12:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:10 smithi099 ceph-mon[138788]: osdmap e746: 8 total, 8 up, 8 in 2024-01-13T18:12:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:10 smithi099 ceph-mon[138788]: pgmap v832: 121 pgs: 121 active+clean; 285 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 214 KiB/s wr, 9 op/s 2024-01-13T18:12:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:10 smithi084 ceph-mon[116404]: osdmap e746: 8 total, 8 up, 8 in 2024-01-13T18:12:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:10 smithi084 ceph-mon[116404]: pgmap v832: 121 pgs: 121 active+clean; 285 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 214 KiB/s wr, 9 op/s 2024-01-13T18:12:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:10 smithi084 ceph-mon[119097]: osdmap e746: 8 total, 8 up, 8 in 2024-01-13T18:12:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:10 smithi084 ceph-mon[119097]: pgmap v832: 121 pgs: 121 active+clean; 285 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 214 KiB/s wr, 9 op/s 2024-01-13T18:12:11.776 INFO:tasks.rados.rados.0.smithi084.stdout:3454: done (4 left) 2024-01-13T18:12:11.776 INFO:tasks.rados.rados.0.smithi084.stdout:3455: copy_from oid 9 from oid 23 current snap is 338 2024-01-13T18:12:11.777 INFO:tasks.rados.rados.0.smithi084.stdout:3448: expect (ObjNum 974 snap 308 seq_num 974) 2024-01-13T18:12:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:3450: finishing write tid 1 to smithi084102331-16 2024-01-13T18:12:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:3450: finishing write tid 2 to smithi084102331-16 2024-01-13T18:12:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:3450: finishing write tid 3 to smithi084102331-16 2024-01-13T18:12:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:3450: finishing write tid 4 to smithi084102331-16 2024-01-13T18:12:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1616 (ObjNum 1058 snap 338 seq_num 1058) dirty exists 2024-01-13T18:12:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:3450: left oid 16 (ObjNum 1058 snap 338 seq_num 1058) 2024-01-13T18:12:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:3451: finishing copy_from to smithi084102331-41 2024-01-13T18:12:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1719 (ObjNum 1013 snap 316 seq_num 1013) dirty exists 2024-01-13T18:12:12.061 INFO:tasks.rados.rados.0.smithi084.stdout:3451: finishing copy_from racing read to smithi084102331-41 2024-01-13T18:12:12.061 INFO:tasks.rados.rados.0.smithi084.stdout:3448: done (4 left) 2024-01-13T18:12:12.061 INFO:tasks.rados.rados.0.smithi084.stdout:3450: done (3 left) 2024-01-13T18:12:12.061 INFO:tasks.rados.rados.0.smithi084.stdout:3451: done (2 left) 2024-01-13T18:12:12.061 INFO:tasks.rados.rados.0.smithi084.stdout:3456: read oid 14 snap -1 2024-01-13T18:12:12.061 INFO:tasks.rados.rados.0.smithi084.stdout:3456: expect (ObjNum 1055 snap 337 seq_num 1055) 2024-01-13T18:12:12.061 INFO:tasks.rados.rados.0.smithi084.stdout:3457: delete oid 13 current snap is 338 2024-01-13T18:12:12.061 INFO:tasks.rados.rados.0.smithi084.stdout:3455: finishing copy_from to smithi084102331-9 2024-01-13T18:12:12.061 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1763 (ObjNum 1041 snap 330 seq_num 1041) dirty exists 2024-01-13T18:12:12.061 INFO:tasks.rados.rados.0.smithi084.stdout:3455: finishing copy_from racing read to smithi084102331-9 2024-01-13T18:12:12.062 INFO:tasks.rados.rados.0.smithi084.stdout:3452: done (3 left) 2024-01-13T18:12:12.062 INFO:tasks.rados.rados.0.smithi084.stdout:3455: done (2 left) 2024-01-13T18:12:12.062 INFO:tasks.rados.rados.0.smithi084.stdout:3457: done (1 left) 2024-01-13T18:12:12.062 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 338 2024-01-13T18:12:12.062 INFO:tasks.rados.rados.0.smithi084.stdout:3458: seq_num 1060 ranges {2252800=557056,2809856=401408} 2024-01-13T18:12:12.078 INFO:tasks.rados.rados.0.smithi084.stdout:3458: writing smithi084102331-24 from 2252800 to 2809856 tid 1 2024-01-13T18:12:12.081 INFO:tasks.rados.rados.0.smithi084.stdout:3458: writing smithi084102331-24 from 2809856 to 3211264 tid 2 2024-01-13T18:12:12.081 INFO:tasks.rados.rados.0.smithi084.stdout:3459: read oid 8 snap -1 2024-01-13T18:12:12.081 INFO:tasks.rados.rados.0.smithi084.stdout:3459: expect (ObjNum 1053 snap 334 seq_num 1053) 2024-01-13T18:12:12.081 INFO:tasks.rados.rados.0.smithi084.stdout:3460: delete oid 29 current snap is 338 2024-01-13T18:12:12.081 INFO:tasks.rados.rados.0.smithi084.stdout:3456: expect (ObjNum 1055 snap 337 seq_num 1055) 2024-01-13T18:12:12.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:11 smithi099 ceph-mon[138788]: osdmap e747: 8 total, 8 up, 8 in 2024-01-13T18:12:12.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:11 smithi084 ceph-mon[116404]: osdmap e747: 8 total, 8 up, 8 in 2024-01-13T18:12:12.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:11 smithi084 ceph-mon[119097]: osdmap e747: 8 total, 8 up, 8 in 2024-01-13T18:12:12.277 INFO:tasks.rados.rados.0.smithi084.stdout:3458: finishing write tid 1 to smithi084102331-24 2024-01-13T18:12:12.277 INFO:tasks.rados.rados.0.smithi084.stdout:3458: finishing write tid 2 to smithi084102331-24 2024-01-13T18:12:12.277 INFO:tasks.rados.rados.0.smithi084.stdout:3458: finishing write tid 3 to smithi084102331-24 2024-01-13T18:12:12.277 INFO:tasks.rados.rados.0.smithi084.stdout:3456: done (3 left) 2024-01-13T18:12:12.277 INFO:tasks.rados.rados.0.smithi084.stdout:3460: done (2 left) 2024-01-13T18:12:12.278 INFO:tasks.rados.rados.0.smithi084.stdout:3461: copy_from oid 20 from oid 34 current snap is 338 2024-01-13T18:12:12.278 INFO:tasks.rados.rados.0.smithi084.stdout:3458: finishing write tid 4 to smithi084102331-24 2024-01-13T18:12:12.278 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1730 (ObjNum 1060 snap 338 seq_num 1060) dirty exists 2024-01-13T18:12:12.278 INFO:tasks.rados.rados.0.smithi084.stdout:3458: left oid 24 (ObjNum 1060 snap 338 seq_num 1060) 2024-01-13T18:12:12.278 INFO:tasks.rados.rados.0.smithi084.stdout:3459: expect (ObjNum 1053 snap 334 seq_num 1053) 2024-01-13T18:12:12.548 INFO:tasks.rados.rados.0.smithi084.stdout:3461: finishing copy_from to smithi084102331-20 2024-01-13T18:12:12.548 INFO:tasks.rados.rados.0.smithi084.stdout:3461: got expected ENOENT (src dne) 2024-01-13T18:12:12.548 INFO:tasks.rados.rados.0.smithi084.stdout:3461: finishing copy_from racing read to smithi084102331-20 2024-01-13T18:12:12.548 INFO:tasks.rados.rados.0.smithi084.stdout:3458: done (2 left) 2024-01-13T18:12:12.549 INFO:tasks.rados.rados.0.smithi084.stdout:3459: done (1 left) 2024-01-13T18:12:12.549 INFO:tasks.rados.rados.0.smithi084.stdout:3461: done (0 left) 2024-01-13T18:12:12.549 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 338 2024-01-13T18:12:12.549 INFO:tasks.rados.rados.0.smithi084.stdout:3462: seq_num 1062 ranges {4718592=589824,5308416=401408} 2024-01-13T18:12:12.575 INFO:tasks.rados.rados.0.smithi084.stdout:3462: writing smithi084102331-25 from 4718592 to 5308416 tid 1 2024-01-13T18:12:12.578 INFO:tasks.rados.rados.0.smithi084.stdout:3462: writing smithi084102331-25 from 5308416 to 5709824 tid 2 2024-01-13T18:12:12.578 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 338 2024-01-13T18:12:12.578 INFO:tasks.rados.rados.0.smithi084.stdout:3463: seq_num 1063 ranges {11862016=606208,12468224=401408} 2024-01-13T18:12:12.643 INFO:tasks.rados.rados.0.smithi084.stdout:3463: writing smithi084102331-18 from 11862016 to 12468224 tid 1 2024-01-13T18:12:12.645 INFO:tasks.rados.rados.0.smithi084.stdout:3463: writing smithi084102331-18 from 12468224 to 12869632 tid 2 2024-01-13T18:12:12.645 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 338 2024-01-13T18:12:12.645 INFO:tasks.rados.rados.0.smithi084.stdout:3462: finishing write tid 1 to smithi084102331-25 2024-01-13T18:12:12.646 INFO:tasks.rados.rados.0.smithi084.stdout:3464: seq_num 1064 ranges {745472=622592,1368064=401408} 2024-01-13T18:12:12.653 INFO:tasks.rados.rados.0.smithi084.stdout:3464: writing smithi084102331-23 from 745472 to 1368064 tid 1 2024-01-13T18:12:12.655 INFO:tasks.rados.rados.0.smithi084.stdout:3464: writing smithi084102331-23 from 1368064 to 1769472 tid 2 2024-01-13T18:12:12.655 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 338 2024-01-13T18:12:12.655 INFO:tasks.rados.rados.0.smithi084.stdout:3465: seq_num 1065 ranges {0=638976,638976=401408} 2024-01-13T18:12:12.658 INFO:tasks.rados.rados.0.smithi084.stdout:3465: writing smithi084102331-31 from 0 to 638976 tid 1 2024-01-13T18:12:12.663 INFO:tasks.rados.rados.0.smithi084.stdout:3465: writing smithi084102331-31 from 638976 to 1040384 tid 2 2024-01-13T18:12:12.663 INFO:tasks.rados.rados.0.smithi084.stdout:3466: rmattr oid 3 current snap is 338 2024-01-13T18:12:12.663 INFO:tasks.rados.rados.0.smithi084.stdout:3462: finishing write tid 2 to smithi084102331-25 2024-01-13T18:12:12.663 INFO:tasks.rados.rados.0.smithi084.stdout:3462: finishing write tid 3 to smithi084102331-25 2024-01-13T18:12:12.663 INFO:tasks.rados.rados.0.smithi084.stdout:3467: rollback oid 27 current snap is 338 2024-01-13T18:12:12.663 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 312 2024-01-13T18:12:12.663 INFO:tasks.rados.rados.0.smithi084.stdout:3462: finishing write tid 4 to smithi084102331-25 2024-01-13T18:12:12.663 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1671 (ObjNum 1062 snap 338 seq_num 1062) dirty exists 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3462: left oid 25 (ObjNum 1062 snap 338 seq_num 1062) 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3463: finishing write tid 1 to smithi084102331-18 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3463: finishing write tid 2 to smithi084102331-18 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3463: finishing write tid 3 to smithi084102331-18 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3463: finishing write tid 4 to smithi084102331-18 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1512 (ObjNum 1063 snap 338 seq_num 1063) dirty exists 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3463: left oid 18 (ObjNum 1063 snap 338 seq_num 1063) 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3464: finishing write tid 1 to smithi084102331-23 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3464: finishing write tid 2 to smithi084102331-23 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3464: finishing write tid 3 to smithi084102331-23 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3464: finishing write tid 4 to smithi084102331-23 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1790 (ObjNum 1064 snap 338 seq_num 1064) dirty exists 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3464: left oid 23 (ObjNum 1064 snap 338 seq_num 1064) 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3462: done (5 left) 2024-01-13T18:12:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:3463: done (4 left) 2024-01-13T18:12:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:3464: done (3 left) 2024-01-13T18:12:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:3468: rmattr oid 2 current snap is 338 2024-01-13T18:12:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:3468: done (3 left) 2024-01-13T18:12:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:3469: rmattr oid 42 current snap is 338 2024-01-13T18:12:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:3469: done (3 left) 2024-01-13T18:12:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:3470: read oid 23 snap -1 2024-01-13T18:12:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:3470: expect (ObjNum 1064 snap 338 seq_num 1064) 2024-01-13T18:12:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:3471: rollback oid 37 current snap is 338 2024-01-13T18:12:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 329 2024-01-13T18:12:12.666 INFO:tasks.rados.rados.0.smithi084.stdout:3472: read oid 33 snap -1 2024-01-13T18:12:12.666 INFO:tasks.rados.rados.0.smithi084.stdout:3472: expect (ObjNum 1046 snap 331 seq_num 1046) 2024-01-13T18:12:12.666 INFO:tasks.rados.rados.0.smithi084.stdout:3473: setattr oid 26 current snap is 338 2024-01-13T18:12:12.666 INFO:tasks.rados.rados.0.smithi084.stdout:3474: rmattr oid 42 current snap is 338 2024-01-13T18:12:12.666 INFO:tasks.rados.rados.0.smithi084.stdout:3474: done (7 left) 2024-01-13T18:12:12.666 INFO:tasks.rados.rados.0.smithi084.stdout:3475: read oid 20 snap -1 2024-01-13T18:12:12.666 INFO:tasks.rados.rados.0.smithi084.stdout:3475: expect (ObjNum 1045 snap 331 seq_num 1045) 2024-01-13T18:12:12.666 INFO:tasks.rados.rados.0.smithi084.stdout:3476: read oid 25 snap -1 2024-01-13T18:12:12.666 INFO:tasks.rados.rados.0.smithi084.stdout:3476: expect (ObjNum 1062 snap 338 seq_num 1062) 2024-01-13T18:12:12.666 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 338 2024-01-13T18:12:12.666 INFO:tasks.rados.rados.0.smithi084.stdout:3477: seq_num 1066 ranges {1630208=663552,2293760=401408} 2024-01-13T18:12:12.676 INFO:tasks.rados.rados.0.smithi084.stdout:3477: writing smithi084102331-16 from 1630208 to 2293760 tid 1 2024-01-13T18:12:12.678 INFO:tasks.rados.rados.0.smithi084.stdout:3477: writing smithi084102331-16 from 2293760 to 2695168 tid 2 2024-01-13T18:12:12.679 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 338 2024-01-13T18:12:12.679 INFO:tasks.rados.rados.0.smithi084.stdout:3467: finishing rollback tid 0 to smithi084102331-27 2024-01-13T18:12:12.679 INFO:tasks.rados.rados.0.smithi084.stdout:3465: finishing write tid 1 to smithi084102331-31 2024-01-13T18:12:12.679 INFO:tasks.rados.rados.0.smithi084.stdout:3465: finishing write tid 2 to smithi084102331-31 2024-01-13T18:12:12.679 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1655 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-01-13T18:12:12.679 INFO:tasks.rados.rados.0.smithi084.stdout:3467: finishing rollback tid 1 to smithi084102331-27 2024-01-13T18:12:12.679 INFO:tasks.rados.rados.0.smithi084.stdout:3465: finishing write tid 3 to smithi084102331-31 2024-01-13T18:12:12.679 INFO:tasks.rados.rados.0.smithi084.stdout:3478: seq_num 1067 ranges {0=679936,679936=401408} 2024-01-13T18:12:12.682 INFO:tasks.rados.rados.0.smithi084.stdout:3478: writing smithi084102331-5 from 0 to 679936 tid 1 2024-01-13T18:12:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:3478: writing smithi084102331-5 from 679936 to 1081344 tid 2 2024-01-13T18:12:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:3473: done (10 left) 2024-01-13T18:12:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 338 2024-01-13T18:12:12.685 INFO:tasks.rados.rados.0.smithi084.stdout:3479: seq_num 1068 ranges {2490368=696320,3186688=401408} 2024-01-13T18:12:12.702 INFO:tasks.rados.rados.0.smithi084.stdout:3479: writing smithi084102331-39 from 2490368 to 3186688 tid 1 2024-01-13T18:12:12.705 INFO:tasks.rados.rados.0.smithi084.stdout:3479: writing smithi084102331-39 from 3186688 to 3588096 tid 2 2024-01-13T18:12:12.705 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 338 2024-01-13T18:12:12.705 INFO:tasks.rados.rados.0.smithi084.stdout:3467: finishing rollback tid 2 to smithi084102331-27 2024-01-13T18:12:12.706 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1619 (ObjNum 938 snap 296 seq_num 938) dirty exists 2024-01-13T18:12:12.706 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1714 (ObjNum 986 snap 309 seq_num 986) dirty exists 2024-01-13T18:12:12.706 INFO:tasks.rados.rados.0.smithi084.stdout:3465: finishing write tid 4 to smithi084102331-31 2024-01-13T18:12:12.706 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1712 (ObjNum 1065 snap 338 seq_num 1065) dirty exists 2024-01-13T18:12:12.706 INFO:tasks.rados.rados.0.smithi084.stdout:3465: left oid 31 (ObjNum 1065 snap 338 seq_num 1065) 2024-01-13T18:12:12.706 INFO:tasks.rados.rados.0.smithi084.stdout:3470: expect (ObjNum 1064 snap 338 seq_num 1064) 2024-01-13T18:12:12.766 INFO:tasks.rados.rados.0.smithi084.stdout:3471: finishing rollback tid 0 to smithi084102331-37 2024-01-13T18:12:12.766 INFO:tasks.rados.rados.0.smithi084.stdout:3475: expect (ObjNum 1045 snap 331 seq_num 1045) 2024-01-13T18:12:12.783 INFO:tasks.rados.rados.0.smithi084.stdout:3471: finishing rollback tid 1 to smithi084102331-37 2024-01-13T18:12:12.784 INFO:tasks.rados.rados.0.smithi084.stdout:3477: finishing write tid 1 to smithi084102331-16 2024-01-13T18:12:12.784 INFO:tasks.rados.rados.0.smithi084.stdout:3477: finishing write tid 2 to smithi084102331-16 2024-01-13T18:12:12.784 INFO:tasks.rados.rados.0.smithi084.stdout:3480: seq_num 1069 ranges {3350528=712704,4063232=401408} 2024-01-13T18:12:12.805 INFO:tasks.rados.rados.0.smithi084.stdout:3480: writing smithi084102331-40 from 3350528 to 4063232 tid 1 2024-01-13T18:12:12.808 INFO:tasks.rados.rados.0.smithi084.stdout:3480: writing smithi084102331-40 from 4063232 to 4464640 tid 2 2024-01-13T18:12:12.808 INFO:tasks.rados.rados.0.smithi084.stdout:3465: done (11 left) 2024-01-13T18:12:12.808 INFO:tasks.rados.rados.0.smithi084.stdout:3466: done (10 left) 2024-01-13T18:12:12.808 INFO:tasks.rados.rados.0.smithi084.stdout:3467: done (9 left) 2024-01-13T18:12:12.808 INFO:tasks.rados.rados.0.smithi084.stdout:3470: done (8 left) 2024-01-13T18:12:12.808 INFO:tasks.rados.rados.0.smithi084.stdout:3475: done (7 left) 2024-01-13T18:12:12.808 INFO:tasks.rados.rados.0.smithi084.stdout:3481: snap_remove snap 333 2024-01-13T18:12:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:12 smithi099 ceph-mon[138788]: osdmap e748: 8 total, 8 up, 8 in 2024-01-13T18:12:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:12:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:12 smithi099 ceph-mon[138788]: pgmap v835: 121 pgs: 121 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 612 KiB/s wr, 8 op/s 2024-01-13T18:12:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:12:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:12:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:12:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:12 smithi099 ceph-mon[138788]: osdmap e749: 8 total, 8 up, 8 in 2024-01-13T18:12:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[116404]: osdmap e748: 8 total, 8 up, 8 in 2024-01-13T18:12:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:12:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[116404]: pgmap v835: 121 pgs: 121 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 612 KiB/s wr, 8 op/s 2024-01-13T18:12:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:12:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:12:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:12:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[116404]: osdmap e749: 8 total, 8 up, 8 in 2024-01-13T18:12:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[119097]: osdmap e748: 8 total, 8 up, 8 in 2024-01-13T18:12:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:12:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[119097]: pgmap v835: 121 pgs: 121 active+clean; 284 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.4 MiB/s rd, 612 KiB/s wr, 8 op/s 2024-01-13T18:12:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:12:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:12:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:12:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:12 smithi084 ceph-mon[119097]: osdmap e749: 8 total, 8 up, 8 in 2024-01-13T18:12:13.790 INFO:tasks.rados.rados.0.smithi084.stdout:3481: done (7 left) 2024-01-13T18:12:13.791 INFO:tasks.rados.rados.0.smithi084.stdout:3482: snap_remove snap 331 2024-01-13T18:12:14.799 INFO:tasks.rados.rados.0.smithi084.stdout:3482: done (7 left) 2024-01-13T18:12:14.799 INFO:tasks.rados.rados.0.smithi084.stdout:3483: rollback oid 32 current snap is 338 2024-01-13T18:12:14.799 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 32 to 329 2024-01-13T18:12:14.799 INFO:tasks.rados.rados.0.smithi084.stdout:3484: rollback oid 20 current snap is 338 2024-01-13T18:12:14.799 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 336 2024-01-13T18:12:14.799 INFO:tasks.rados.rados.0.smithi084.stdout:3485: read oid 38 snap -1 2024-01-13T18:12:14.799 INFO:tasks.rados.rados.0.smithi084.stdout:3485: expect (ObjNum 969 snap 307 seq_num 969) 2024-01-13T18:12:14.799 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 338 2024-01-13T18:12:14.799 INFO:tasks.rados.rados.0.smithi084.stdout:3486: seq_num 1070 ranges {2007040=729088,2736128=401408} 2024-01-13T18:12:14.815 INFO:tasks.rados.rados.0.smithi084.stdout:3486: writing smithi084102331-42 from 2007040 to 2736128 tid 1 2024-01-13T18:12:14.818 INFO:tasks.rados.rados.0.smithi084.stdout:3486: writing smithi084102331-42 from 2736128 to 3137536 tid 2 2024-01-13T18:12:14.818 INFO:tasks.rados.rados.0.smithi084.stdout:3487: copy_from oid 21 from oid 50 current snap is 338 2024-01-13T18:12:14.818 INFO:tasks.rados.rados.0.smithi084.stdout:3488: read oid 1 snap 329 2024-01-13T18:12:14.818 INFO:tasks.rados.rados.0.smithi084.stdout:3488: expect (ObjNum 991 snap 311 seq_num 991) 2024-01-13T18:12:14.818 INFO:tasks.rados.rados.0.smithi084.stdout:3489: snap_remove snap 332 2024-01-13T18:12:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:14 smithi099 ceph-mon[138788]: osdmap e750: 8 total, 8 up, 8 in 2024-01-13T18:12:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:14 smithi099 ceph-mon[138788]: pgmap v838: 121 pgs: 121 active+clean; 281 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2024-01-13T18:12:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:14 smithi084 ceph-mon[116404]: osdmap e750: 8 total, 8 up, 8 in 2024-01-13T18:12:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:14 smithi084 ceph-mon[116404]: pgmap v838: 121 pgs: 121 active+clean; 281 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2024-01-13T18:12:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:14 smithi084 ceph-mon[119097]: osdmap e750: 8 total, 8 up, 8 in 2024-01-13T18:12:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:14 smithi084 ceph-mon[119097]: pgmap v838: 121 pgs: 121 active+clean; 281 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2024-01-13T18:12:15.809 INFO:tasks.rados.rados.0.smithi084.stdout:3489: done (13 left) 2024-01-13T18:12:15.809 INFO:tasks.rados.rados.0.smithi084.stdout:3490: rollback oid 36 current snap is 338 2024-01-13T18:12:15.809 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 329 2024-01-13T18:12:15.809 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 338 2024-01-13T18:12:15.809 INFO:tasks.rados.rados.0.smithi084.stdout:3491: seq_num 1071 ranges {4718592=745472,5464064=401408} 2024-01-13T18:12:15.834 INFO:tasks.rados.rados.0.smithi084.stdout:3491: writing smithi084102331-22 from 4718592 to 5464064 tid 1 2024-01-13T18:12:15.837 INFO:tasks.rados.rados.0.smithi084.stdout:3491: writing smithi084102331-22 from 5464064 to 5865472 tid 2 2024-01-13T18:12:15.837 INFO:tasks.rados.rados.0.smithi084.stdout:3492: read oid 30 snap 329 2024-01-13T18:12:15.837 INFO:tasks.rados.rados.0.smithi084.stdout:3492: expect (ObjNum 991 snap 311 seq_num 991) 2024-01-13T18:12:15.837 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-01-13T18:12:15.837 INFO:tasks.rados.rados.0.smithi084.stdout:3477: finishing write tid 3 to smithi084102331-16 2024-01-13T18:12:15.837 INFO:tasks.rados.rados.0.smithi084.stdout:3477: finishing write tid 4 to smithi084102331-16 2024-01-13T18:12:15.837 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1622 (ObjNum 1066 snap 338 seq_num 1066) dirty exists 2024-01-13T18:12:15.837 INFO:tasks.rados.rados.0.smithi084.stdout:3477: left oid 16 (ObjNum 1066 snap 338 seq_num 1066) 2024-01-13T18:12:15.837 INFO:tasks.rados.rados.0.smithi084.stdout:3472: expect (ObjNum 1046 snap 331 seq_num 1046) 2024-01-13T18:12:16.033 INFO:tasks.rados.rados.0.smithi084.stdout:3478: finishing write tid 1 to smithi084102331-5 2024-01-13T18:12:16.033 INFO:tasks.rados.rados.0.smithi084.stdout:3478: finishing write tid 2 to smithi084102331-5 2024-01-13T18:12:16.033 INFO:tasks.rados.rados.0.smithi084.stdout:3472: done (15 left) 2024-01-13T18:12:16.033 INFO:tasks.rados.rados.0.smithi084.stdout:3477: done (14 left) 2024-01-13T18:12:16.033 INFO:tasks.rados.rados.0.smithi084.stdout:3493: snap_create 2024-01-13T18:12:16.034 INFO:tasks.rados.rados.0.smithi084.stdout:3478: finishing write tid 3 to smithi084102331-5 2024-01-13T18:12:16.034 INFO:tasks.rados.rados.0.smithi084.stdout:3478: finishing write tid 4 to smithi084102331-5 2024-01-13T18:12:16.034 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 1643 (ObjNum 1067 snap 338 seq_num 1067) dirty exists 2024-01-13T18:12:16.034 INFO:tasks.rados.rados.0.smithi084.stdout:3478: left oid 5 (ObjNum 1067 snap 338 seq_num 1067) 2024-01-13T18:12:16.034 INFO:tasks.rados.rados.0.smithi084.stdout:3471: finishing rollback tid 2 to smithi084102331-37 2024-01-13T18:12:16.034 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1674 (ObjNum 942 snap 298 seq_num 942) dirty exists 2024-01-13T18:12:16.034 INFO:tasks.rados.rados.0.smithi084.stdout:3476: expect (ObjNum 1062 snap 338 seq_num 1062) 2024-01-13T18:12:16.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:15 smithi099 ceph-mon[138788]: osdmap e751: 8 total, 8 up, 8 in 2024-01-13T18:12:16.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:15 smithi084 ceph-mon[116404]: osdmap e751: 8 total, 8 up, 8 in 2024-01-13T18:12:16.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:15 smithi084 ceph-mon[119097]: osdmap e751: 8 total, 8 up, 8 in 2024-01-13T18:12:16.319 INFO:tasks.rados.rados.0.smithi084.stdout:3479: finishing write tid 1 to smithi084102331-39 2024-01-13T18:12:16.320 INFO:tasks.rados.rados.0.smithi084.stdout:3479: finishing write tid 2 to smithi084102331-39 2024-01-13T18:12:16.320 INFO:tasks.rados.rados.0.smithi084.stdout:3479: finishing write tid 3 to smithi084102331-39 2024-01-13T18:12:16.320 INFO:tasks.rados.rados.0.smithi084.stdout:3479: finishing write tid 4 to smithi084102331-39 2024-01-13T18:12:16.320 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1722 (ObjNum 1068 snap 338 seq_num 1068) dirty exists 2024-01-13T18:12:16.320 INFO:tasks.rados.rados.0.smithi084.stdout:3479: left oid 39 (ObjNum 1068 snap 338 seq_num 1068) 2024-01-13T18:12:16.320 INFO:tasks.rados.rados.0.smithi084.stdout:3480: finishing write tid 1 to smithi084102331-40 2024-01-13T18:12:16.321 INFO:tasks.rados.rados.0.smithi084.stdout:3480: finishing write tid 2 to smithi084102331-40 2024-01-13T18:12:16.321 INFO:tasks.rados.rados.0.smithi084.stdout:3480: finishing write tid 3 to smithi084102331-40 2024-01-13T18:12:16.321 INFO:tasks.rados.rados.0.smithi084.stdout:3480: finishing write tid 4 to smithi084102331-40 2024-01-13T18:12:16.321 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1727 (ObjNum 1069 snap 338 seq_num 1069) dirty exists 2024-01-13T18:12:16.321 INFO:tasks.rados.rados.0.smithi084.stdout:3480: left oid 40 (ObjNum 1069 snap 338 seq_num 1069) 2024-01-13T18:12:16.321 INFO:tasks.rados.rados.0.smithi084.stdout:3484: finishing rollback tid 0 to smithi084102331-20 2024-01-13T18:12:16.321 INFO:tasks.rados.rados.0.smithi084.stdout:3484: finishing rollback tid 1 to smithi084102331-20 2024-01-13T18:12:16.321 INFO:tasks.rados.rados.0.smithi084.stdout:3484: finishing rollback tid 2 to smithi084102331-20 2024-01-13T18:12:16.321 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1617 (ObjNum 1052 snap 332 seq_num 1052) dirty exists 2024-01-13T18:12:16.322 INFO:tasks.rados.rados.0.smithi084.stdout:3486: finishing write tid 1 to smithi084102331-42 2024-01-13T18:12:16.322 INFO:tasks.rados.rados.0.smithi084.stdout:3485: expect (ObjNum 969 snap 307 seq_num 969) 2024-01-13T18:12:16.426 INFO:tasks.rados.rados.0.smithi084.stdout:3487: finishing copy_from to smithi084102331-21 2024-01-13T18:12:16.426 INFO:tasks.rados.rados.0.smithi084.stdout:3487: got expected ENOENT (src dne) 2024-01-13T18:12:16.426 INFO:tasks.rados.rados.0.smithi084.stdout:3487: finishing copy_from racing read to smithi084102331-21 2024-01-13T18:12:16.426 INFO:tasks.rados.rados.0.smithi084.stdout:3483: finishing rollback tid 1 to smithi084102331-32 2024-01-13T18:12:16.426 INFO:tasks.rados.rados.0.smithi084.stdout:3483: finishing rollback tid 2 to smithi084102331-32 2024-01-13T18:12:16.426 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1732 (ObjNum 1015 snap 317 seq_num 1015) dirty exists 2024-01-13T18:12:16.426 INFO:tasks.rados.rados.0.smithi084.stdout:3486: finishing write tid 2 to smithi084102331-42 2024-01-13T18:12:16.426 INFO:tasks.rados.rados.0.smithi084.stdout:3486: finishing write tid 3 to smithi084102331-42 2024-01-13T18:12:16.426 INFO:tasks.rados.rados.0.smithi084.stdout:3486: finishing write tid 4 to smithi084102331-42 2024-01-13T18:12:16.426 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1497 (ObjNum 1070 snap 338 seq_num 1070) dirty exists 2024-01-13T18:12:16.427 INFO:tasks.rados.rados.0.smithi084.stdout:3486: left oid 42 (ObjNum 1070 snap 338 seq_num 1070) 2024-01-13T18:12:16.427 INFO:tasks.rados.rados.0.smithi084.stdout:3488: expect (ObjNum 991 snap 311 seq_num 991) 2024-01-13T18:12:16.608 INFO:tasks.rados.rados.0.smithi084.stdout:3490: finishing rollback tid 0 to smithi084102331-36 2024-01-13T18:12:16.608 INFO:tasks.rados.rados.0.smithi084.stdout:3490: finishing rollback tid 1 to smithi084102331-36 2024-01-13T18:12:16.608 INFO:tasks.rados.rados.0.smithi084.stdout:3490: finishing rollback tid 2 to smithi084102331-36 2024-01-13T18:12:16.608 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1658 (ObjNum 985 snap 309 seq_num 985) dirty exists 2024-01-13T18:12:16.608 INFO:tasks.rados.rados.0.smithi084.stdout:3491: finishing write tid 1 to smithi084102331-22 2024-01-13T18:12:16.609 INFO:tasks.rados.rados.0.smithi084.stdout:3491: finishing write tid 2 to smithi084102331-22 2024-01-13T18:12:16.609 INFO:tasks.rados.rados.0.smithi084.stdout:3491: finishing write tid 3 to smithi084102331-22 2024-01-13T18:12:16.609 INFO:tasks.rados.rados.0.smithi084.stdout:3491: finishing write tid 4 to smithi084102331-22 2024-01-13T18:12:16.609 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1800 (ObjNum 1071 snap 338 seq_num 1071) dirty exists 2024-01-13T18:12:16.609 INFO:tasks.rados.rados.0.smithi084.stdout:3491: left oid 22 (ObjNum 1071 snap 338 seq_num 1071) 2024-01-13T18:12:16.609 INFO:tasks.rados.rados.0.smithi084.stdout:3492: expect (ObjNum 991 snap 311 seq_num 991) 2024-01-13T18:12:16.811 INFO:tasks.rados.rados.0.smithi084.stdout:3471: done (14 left) 2024-01-13T18:12:16.811 INFO:tasks.rados.rados.0.smithi084.stdout:3476: done (13 left) 2024-01-13T18:12:16.811 INFO:tasks.rados.rados.0.smithi084.stdout:3478: done (12 left) 2024-01-13T18:12:16.811 INFO:tasks.rados.rados.0.smithi084.stdout:3479: done (11 left) 2024-01-13T18:12:16.812 INFO:tasks.rados.rados.0.smithi084.stdout:3480: done (10 left) 2024-01-13T18:12:16.812 INFO:tasks.rados.rados.0.smithi084.stdout:3483: done (9 left) 2024-01-13T18:12:16.812 INFO:tasks.rados.rados.0.smithi084.stdout:3484: done (8 left) 2024-01-13T18:12:16.812 INFO:tasks.rados.rados.0.smithi084.stdout:3485: done (7 left) 2024-01-13T18:12:16.812 INFO:tasks.rados.rados.0.smithi084.stdout:3486: done (6 left) 2024-01-13T18:12:16.812 INFO:tasks.rados.rados.0.smithi084.stdout:3487: done (5 left) 2024-01-13T18:12:16.813 INFO:tasks.rados.rados.0.smithi084.stdout:3488: done (4 left) 2024-01-13T18:12:16.813 INFO:tasks.rados.rados.0.smithi084.stdout:3490: done (3 left) 2024-01-13T18:12:16.813 INFO:tasks.rados.rados.0.smithi084.stdout:3491: done (2 left) 2024-01-13T18:12:16.813 INFO:tasks.rados.rados.0.smithi084.stdout:3492: done (1 left) 2024-01-13T18:12:16.813 INFO:tasks.rados.rados.0.smithi084.stdout:3493: done (0 left) 2024-01-13T18:12:16.813 INFO:tasks.rados.rados.0.smithi084.stdout:3494: snap_create 2024-01-13T18:12:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:16 smithi099 ceph-mon[138788]: osdmap e752: 8 total, 8 up, 8 in 2024-01-13T18:12:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:16 smithi099 ceph-mon[138788]: pgmap v841: 121 pgs: 121 active+clean; 280 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 1.8 MiB/s wr, 18 op/s 2024-01-13T18:12:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:16 smithi084 ceph-mon[116404]: osdmap e752: 8 total, 8 up, 8 in 2024-01-13T18:12:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:16 smithi084 ceph-mon[116404]: pgmap v841: 121 pgs: 121 active+clean; 280 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 1.8 MiB/s wr, 18 op/s 2024-01-13T18:12:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:16 smithi084 ceph-mon[119097]: osdmap e752: 8 total, 8 up, 8 in 2024-01-13T18:12:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:16 smithi084 ceph-mon[119097]: pgmap v841: 121 pgs: 121 active+clean; 280 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 1.8 MiB/s wr, 18 op/s 2024-01-13T18:12:17.729 INFO:tasks.rados.rados.0.smithi084.stdout:3494: done (0 left) 2024-01-13T18:12:17.729 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 340 2024-01-13T18:12:17.729 INFO:tasks.rados.rados.0.smithi084.stdout:3495: seq_num 1072 ranges {0=761856,761856=401408} 2024-01-13T18:12:17.733 INFO:tasks.rados.rados.0.smithi084.stdout:3495: writing smithi084102331-13 from 0 to 761856 tid 1 2024-01-13T18:12:17.735 INFO:tasks.rados.rados.0.smithi084.stdout:3495: writing smithi084102331-13 from 761856 to 1163264 tid 2 2024-01-13T18:12:17.736 INFO:tasks.rados.rados.0.smithi084.stdout:3496: read oid 26 snap -1 2024-01-13T18:12:17.736 INFO:tasks.rados.rados.0.smithi084.stdout:3496: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:12:17.736 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 340 2024-01-13T18:12:17.736 INFO:tasks.rados.rados.0.smithi084.stdout:3497: seq_num 1073 ranges {7004160=778240,7782400=401408} 2024-01-13T18:12:17.777 INFO:tasks.rados.rados.0.smithi084.stdout:3497: writing smithi084102331-36 from 7004160 to 7782400 tid 1 2024-01-13T18:12:17.779 INFO:tasks.rados.rados.0.smithi084.stdout:3497: writing smithi084102331-36 from 7782400 to 8183808 tid 2 2024-01-13T18:12:17.779 INFO:tasks.rados.rados.0.smithi084.stdout:3498: rmattr oid 17 current snap is 340 2024-01-13T18:12:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:3496: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:12:17.781 INFO:tasks.rados.rados.0.smithi084.stdout:3495: finishing write tid 1 to smithi084102331-13 2024-01-13T18:12:17.782 INFO:tasks.rados.rados.0.smithi084.stdout:3495: finishing write tid 2 to smithi084102331-13 2024-01-13T18:12:17.782 INFO:tasks.rados.rados.0.smithi084.stdout:3495: finishing write tid 3 to smithi084102331-13 2024-01-13T18:12:17.782 INFO:tasks.rados.rados.0.smithi084.stdout:3495: finishing write tid 4 to smithi084102331-13 2024-01-13T18:12:17.782 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 1646 (ObjNum 1072 snap 340 seq_num 1072) dirty exists 2024-01-13T18:12:17.782 INFO:tasks.rados.rados.0.smithi084.stdout:3495: left oid 13 (ObjNum 1072 snap 340 seq_num 1072) 2024-01-13T18:12:17.782 INFO:tasks.rados.rados.0.smithi084.stdout:3495: done (3 left) 2024-01-13T18:12:17.782 INFO:tasks.rados.rados.0.smithi084.stdout:3496: done (2 left) 2024-01-13T18:12:17.782 INFO:tasks.rados.rados.0.smithi084.stdout:3499: read oid 27 snap -1 2024-01-13T18:12:17.782 INFO:tasks.rados.rados.0.smithi084.stdout:3499: expect (ObjNum 938 snap 296 seq_num 938) 2024-01-13T18:12:17.784 INFO:tasks.rados.rados.0.smithi084.stdout:3500: read oid 12 snap 339 2024-01-13T18:12:17.785 INFO:tasks.rados.rados.0.smithi084.stdout:3500: expect (ObjNum 1030 snap 325 seq_num 1030) 2024-01-13T18:12:17.785 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 340 2024-01-13T18:12:17.785 INFO:tasks.rados.rados.0.smithi084.stdout:3501: seq_num 1074 ranges {7716864=794624,8511488=401408} 2024-01-13T18:12:17.828 INFO:tasks.rados.rados.0.smithi084.stdout:3501: writing smithi084102331-35 from 7716864 to 8511488 tid 1 2024-01-13T18:12:17.830 INFO:tasks.rados.rados.0.smithi084.stdout:3501: writing smithi084102331-35 from 8511488 to 8912896 tid 2 2024-01-13T18:12:17.830 INFO:tasks.rados.rados.0.smithi084.stdout:3502: copy_from oid 11 from oid 9 current snap is 340 2024-01-13T18:12:17.830 INFO:tasks.rados.rados.0.smithi084.stdout:3497: finishing write tid 1 to smithi084102331-36 2024-01-13T18:12:17.830 INFO:tasks.rados.rados.0.smithi084.stdout:3497: finishing write tid 2 to smithi084102331-36 2024-01-13T18:12:17.830 INFO:tasks.rados.rados.0.smithi084.stdout:3497: finishing write tid 3 to smithi084102331-36 2024-01-13T18:12:17.831 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1647 (ObjNum 1044 snap 331 seq_num 1044) dirty exists 2024-01-13T18:12:17.831 INFO:tasks.rados.rados.0.smithi084.stdout:3499: expect (ObjNum 938 snap 296 seq_num 938) 2024-01-13T18:12:17.866 INFO:tasks.rados.rados.0.smithi084.stdout:3497: finishing write tid 4 to smithi084102331-36 2024-01-13T18:12:17.866 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1661 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:12:17.867 INFO:tasks.rados.rados.0.smithi084.stdout:3497: left oid 36 (ObjNum 1073 snap 340 seq_num 1073) 2024-01-13T18:12:17.867 INFO:tasks.rados.rados.0.smithi084.stdout:3500: expect (ObjNum 1030 snap 325 seq_num 1030) 2024-01-13T18:12:17.935 INFO:tasks.rados.rados.0.smithi084.stdout:3501: finishing write tid 1 to smithi084102331-35 2024-01-13T18:12:17.935 INFO:tasks.rados.rados.0.smithi084.stdout:3501: finishing write tid 2 to smithi084102331-35 2024-01-13T18:12:17.935 INFO:tasks.rados.rados.0.smithi084.stdout:3501: finishing write tid 3 to smithi084102331-35 2024-01-13T18:12:17.935 INFO:tasks.rados.rados.0.smithi084.stdout:3501: finishing write tid 4 to smithi084102331-35 2024-01-13T18:12:17.935 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1730 (ObjNum 1074 snap 340 seq_num 1074) dirty exists 2024-01-13T18:12:17.935 INFO:tasks.rados.rados.0.smithi084.stdout:3501: left oid 35 (ObjNum 1074 snap 340 seq_num 1074) 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:3502: finishing copy_from to smithi084102331-11 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1763 (ObjNum 1041 snap 330 seq_num 1041) dirty exists 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:3502: finishing copy_from racing read to smithi084102331-11 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:3497: done (5 left) 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:3498: done (4 left) 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:3499: done (3 left) 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:3500: done (2 left) 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:3501: done (1 left) 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:3502: done (0 left) 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:3503: read oid 21 snap -1 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:3503: expect deleted 2024-01-13T18:12:17.936 INFO:tasks.rados.rados.0.smithi084.stdout:3504: snap_create 2024-01-13T18:12:18.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:17 smithi099 ceph-mon[138788]: osdmap e753: 8 total, 8 up, 8 in 2024-01-13T18:12:18.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:17 smithi099 ceph-mon[138788]: osdmap e754: 8 total, 8 up, 8 in 2024-01-13T18:12:18.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:17 smithi084 ceph-mon[119097]: osdmap e753: 8 total, 8 up, 8 in 2024-01-13T18:12:18.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:17 smithi084 ceph-mon[119097]: osdmap e754: 8 total, 8 up, 8 in 2024-01-13T18:12:18.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:17 smithi084 ceph-mon[116404]: osdmap e753: 8 total, 8 up, 8 in 2024-01-13T18:12:18.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:17 smithi084 ceph-mon[116404]: osdmap e754: 8 total, 8 up, 8 in 2024-01-13T18:12:18.815 INFO:tasks.rados.rados.0.smithi084.stdout:3503: done (1 left) 2024-01-13T18:12:18.815 INFO:tasks.rados.rados.0.smithi084.stdout:3504: done (0 left) 2024-01-13T18:12:18.815 INFO:tasks.rados.rados.0.smithi084.stdout:3505: rollback oid 20 current snap is 341 2024-01-13T18:12:18.815 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 336 2024-01-13T18:12:18.815 INFO:tasks.rados.rados.0.smithi084.stdout:3506: rmattr oid 23 current snap is 341 2024-01-13T18:12:18.815 INFO:tasks.rados.rados.0.smithi084.stdout:3506: done (1 left) 2024-01-13T18:12:18.815 INFO:tasks.rados.rados.0.smithi084.stdout:3507: rollback oid 31 current snap is 341 2024-01-13T18:12:18.815 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 326 2024-01-13T18:12:18.815 INFO:tasks.rados.rados.0.smithi084.stdout:3508: delete oid 39 current snap is 341 2024-01-13T18:12:18.818 INFO:tasks.rados.rados.0.smithi084.stdout:3508: done (2 left) 2024-01-13T18:12:18.818 INFO:tasks.rados.rados.0.smithi084.stdout:3509: delete oid 11 current snap is 341 2024-01-13T18:12:18.820 INFO:tasks.rados.rados.0.smithi084.stdout:3507: finishing rollback tid 0 to smithi084102331-31 2024-01-13T18:12:18.821 INFO:tasks.rados.rados.0.smithi084.stdout:3505: finishing rollback tid 0 to smithi084102331-20 2024-01-13T18:12:18.821 INFO:tasks.rados.rados.0.smithi084.stdout:3505: finishing rollback tid 1 to smithi084102331-20 2024-01-13T18:12:18.822 INFO:tasks.rados.rados.0.smithi084.stdout:3505: finishing rollback tid 2 to smithi084102331-20 2024-01-13T18:12:18.822 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1620 (ObjNum 1052 snap 332 seq_num 1052) dirty exists 2024-01-13T18:12:18.822 INFO:tasks.rados.rados.0.smithi084.stdout:3505: done (2 left) 2024-01-13T18:12:18.822 INFO:tasks.rados.rados.0.smithi084.stdout:3509: done (1 left) 2024-01-13T18:12:18.822 INFO:tasks.rados.rados.0.smithi084.stdout:3510: snap_remove snap 312 2024-01-13T18:12:19.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:18 smithi099 ceph-mon[138788]: pgmap v844: 121 pgs: 121 active+clean; 300 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 2.5 MiB/s wr, 25 op/s 2024-01-13T18:12:19.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:18 smithi084 ceph-mon[116404]: pgmap v844: 121 pgs: 121 active+clean; 300 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 2.5 MiB/s wr, 25 op/s 2024-01-13T18:12:19.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:18 smithi084 ceph-mon[119097]: pgmap v844: 121 pgs: 121 active+clean; 300 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 17 MiB/s rd, 2.5 MiB/s wr, 25 op/s 2024-01-13T18:12:19.827 INFO:tasks.rados.rados.0.smithi084.stdout:3510: done (1 left) 2024-01-13T18:12:19.827 INFO:tasks.rados.rados.0.smithi084.stdout:3511: delete oid 14 current snap is 341 2024-01-13T18:12:19.827 INFO:tasks.rados.rados.0.smithi084.stdout:3507: finishing rollback tid 1 to smithi084102331-31 2024-01-13T18:12:19.827 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1723 (ObjNum 97 snap 0 seq_num 4038020224) dirty dne 2024-01-13T18:12:19.843 INFO:tasks.rados.rados.0.smithi084.stdout:3507: done (1 left) 2024-01-13T18:12:19.843 INFO:tasks.rados.rados.0.smithi084.stdout:3511: done (0 left) 2024-01-13T18:12:19.843 INFO:tasks.rados.rados.0.smithi084.stdout:3512: snap_create 2024-01-13T18:12:20.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:19 smithi099 ceph-mon[138788]: osdmap e755: 8 total, 8 up, 8 in 2024-01-13T18:12:20.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:19 smithi084 ceph-mon[116404]: osdmap e755: 8 total, 8 up, 8 in 2024-01-13T18:12:20.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:19 smithi084 ceph-mon[119097]: osdmap e755: 8 total, 8 up, 8 in 2024-01-13T18:12:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:12:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:12:20] "GET /metrics HTTP/1.1" 200 36192 "" "Prometheus/2.43.0" 2024-01-13T18:12:20.834 INFO:tasks.rados.rados.0.smithi084.stdout:3512: done (0 left) 2024-01-13T18:12:20.834 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 342 2024-01-13T18:12:20.834 INFO:tasks.rados.rados.0.smithi084.stdout:3513: seq_num 1078 ranges {4685824=458752,5144576=720896,5865472=81920} 2024-01-13T18:12:20.862 INFO:tasks.rados.rados.0.smithi084.stdout:3513: writing smithi084102331-8 from 4685824 to 5144576 tid 1 2024-01-13T18:12:20.865 INFO:tasks.rados.rados.0.smithi084.stdout:3513: writing smithi084102331-8 from 5144576 to 5865472 tid 2 2024-01-13T18:12:20.866 INFO:tasks.rados.rados.0.smithi084.stdout:3513: writing smithi084102331-8 from 5865472 to 5947392 tid 3 2024-01-13T18:12:20.866 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 342 2024-01-13T18:12:20.866 INFO:tasks.rados.rados.0.smithi084.stdout:3514: seq_num 1079 ranges {0=475136,475136=606208,1081344=196608} 2024-01-13T18:12:20.869 INFO:tasks.rados.rados.0.smithi084.stdout:3514: writing smithi084102331-29 from 0 to 475136 tid 1 2024-01-13T18:12:20.873 INFO:tasks.rados.rados.0.smithi084.stdout:3514: writing smithi084102331-29 from 475136 to 1081344 tid 2 2024-01-13T18:12:20.875 INFO:tasks.rados.rados.0.smithi084.stdout:3514: writing smithi084102331-29 from 1081344 to 1277952 tid 3 2024-01-13T18:12:20.875 INFO:tasks.rados.rados.0.smithi084.stdout:3515: copy_from oid 12 from oid 17 current snap is 342 2024-01-13T18:12:20.875 INFO:tasks.rados.rados.0.smithi084.stdout:3513: finishing write tid 1 to smithi084102331-8 2024-01-13T18:12:20.875 INFO:tasks.rados.rados.0.smithi084.stdout:3513: finishing write tid 2 to smithi084102331-8 2024-01-13T18:12:20.875 INFO:tasks.rados.rados.0.smithi084.stdout:3513: finishing write tid 3 to smithi084102331-8 2024-01-13T18:12:20.875 INFO:tasks.rados.rados.0.smithi084.stdout:3513: finishing write tid 4 to smithi084102331-8 2024-01-13T18:12:20.875 INFO:tasks.rados.rados.0.smithi084.stdout:3513: finishing write tid 5 to smithi084102331-8 2024-01-13T18:12:20.875 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1736 (ObjNum 1078 snap 342 seq_num 1078) dirty exists 2024-01-13T18:12:20.875 INFO:tasks.rados.rados.0.smithi084.stdout:3513: left oid 8 (ObjNum 1078 snap 342 seq_num 1078) 2024-01-13T18:12:20.875 INFO:tasks.rados.rados.0.smithi084.stdout:3513: done (2 left) 2024-01-13T18:12:20.876 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 342 2024-01-13T18:12:20.876 INFO:tasks.rados.rados.0.smithi084.stdout:3516: seq_num 1080 ranges {5865472=491520,6356992=540672,6897664=262144} 2024-01-13T18:12:20.909 INFO:tasks.rados.rados.0.smithi084.stdout:3516: writing smithi084102331-22 from 5865472 to 6356992 tid 1 2024-01-13T18:12:20.912 INFO:tasks.rados.rados.0.smithi084.stdout:3516: writing smithi084102331-22 from 6356992 to 6897664 tid 2 2024-01-13T18:12:20.913 INFO:tasks.rados.rados.0.smithi084.stdout:3516: writing smithi084102331-22 from 6897664 to 7159808 tid 3 2024-01-13T18:12:20.913 INFO:tasks.rados.rados.0.smithi084.stdout:3517: snap_remove snap 338 2024-01-13T18:12:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:20 smithi099 ceph-mon[138788]: osdmap e756: 8 total, 8 up, 8 in 2024-01-13T18:12:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:20 smithi099 ceph-mon[138788]: pgmap v847: 121 pgs: 121 active+clean; 301 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 19 op/s 2024-01-13T18:12:21.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:20 smithi084 ceph-mon[116404]: osdmap e756: 8 total, 8 up, 8 in 2024-01-13T18:12:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:20 smithi084 ceph-mon[116404]: pgmap v847: 121 pgs: 121 active+clean; 301 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 19 op/s 2024-01-13T18:12:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:20 smithi084 ceph-mon[119097]: osdmap e756: 8 total, 8 up, 8 in 2024-01-13T18:12:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:20 smithi084 ceph-mon[119097]: pgmap v847: 121 pgs: 121 active+clean; 301 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 19 op/s 2024-01-13T18:12:21.838 INFO:tasks.rados.rados.0.smithi084.stdout:3517: done (3 left) 2024-01-13T18:12:21.838 INFO:tasks.rados.rados.0.smithi084.stdout:3518: rollback oid 40 current snap is 342 2024-01-13T18:12:21.838 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 340 2024-01-13T18:12:21.838 INFO:tasks.rados.rados.0.smithi084.stdout:3519: snap_remove snap 336 2024-01-13T18:12:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:21 smithi099 ceph-mon[138788]: osdmap e757: 8 total, 8 up, 8 in 2024-01-13T18:12:22.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:21 smithi084 ceph-mon[116404]: osdmap e757: 8 total, 8 up, 8 in 2024-01-13T18:12:22.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:21 smithi084 ceph-mon[119097]: osdmap e757: 8 total, 8 up, 8 in 2024-01-13T18:12:22.732 INFO:tasks.rados.rados.0.smithi084.stdout:3519: done (4 left) 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 342 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3514: finishing write tid 1 to smithi084102331-29 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3514: finishing write tid 2 to smithi084102331-29 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3514: finishing write tid 3 to smithi084102331-29 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3514: finishing write tid 4 to smithi084102331-29 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3514: finishing write tid 5 to smithi084102331-29 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1734 (ObjNum 1079 snap 342 seq_num 1079) dirty exists 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3514: left oid 29 (ObjNum 1079 snap 342 seq_num 1079) 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3515: finishing copy_from to smithi084102331-12 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1647 (ObjNum 1044 snap 331 seq_num 1044) dirty exists 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3515: finishing copy_from racing read to smithi084102331-12 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3516: finishing write tid 1 to smithi084102331-22 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3516: finishing write tid 2 to smithi084102331-22 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3516: finishing write tid 3 to smithi084102331-22 2024-01-13T18:12:22.733 INFO:tasks.rados.rados.0.smithi084.stdout:3516: finishing write tid 4 to smithi084102331-22 2024-01-13T18:12:22.734 INFO:tasks.rados.rados.0.smithi084.stdout:3516: finishing write tid 5 to smithi084102331-22 2024-01-13T18:12:22.734 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1811 (ObjNum 1080 snap 342 seq_num 1080) dirty exists 2024-01-13T18:12:22.734 INFO:tasks.rados.rados.0.smithi084.stdout:3516: left oid 22 (ObjNum 1080 snap 342 seq_num 1080) 2024-01-13T18:12:22.734 INFO:tasks.rados.rados.0.smithi084.stdout:3518: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:12:22.734 INFO:tasks.rados.rados.0.smithi084.stdout:3518: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:12:22.734 INFO:tasks.rados.rados.0.smithi084.stdout:3518: finishing rollback tid 2 to smithi084102331-40 2024-01-13T18:12:22.734 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1737 (ObjNum 1069 snap 338 seq_num 1069) dirty exists 2024-01-13T18:12:22.734 INFO:tasks.rados.rados.0.smithi084.stdout:3520: seq_num 1081 ranges {589824=507904,1097728=425984,1523712=376832} 2024-01-13T18:12:22.739 INFO:tasks.rados.rados.0.smithi084.stdout:3520: writing smithi084102331-7 from 589824 to 1097728 tid 1 2024-01-13T18:12:22.743 INFO:tasks.rados.rados.0.smithi084.stdout:3520: writing smithi084102331-7 from 1097728 to 1523712 tid 2 2024-01-13T18:12:22.744 INFO:tasks.rados.rados.0.smithi084.stdout:3520: writing smithi084102331-7 from 1523712 to 1900544 tid 3 2024-01-13T18:12:22.745 INFO:tasks.rados.rados.0.smithi084.stdout:3514: done (4 left) 2024-01-13T18:12:22.745 INFO:tasks.rados.rados.0.smithi084.stdout:3515: done (3 left) 2024-01-13T18:12:22.745 INFO:tasks.rados.rados.0.smithi084.stdout:3516: done (2 left) 2024-01-13T18:12:22.745 INFO:tasks.rados.rados.0.smithi084.stdout:3518: done (1 left) 2024-01-13T18:12:22.745 INFO:tasks.rados.rados.0.smithi084.stdout:3521: snap_create 2024-01-13T18:12:22.747 INFO:tasks.rados.rados.0.smithi084.stdout:3520: finishing write tid 1 to smithi084102331-7 2024-01-13T18:12:22.754 INFO:tasks.rados.rados.0.smithi084.stdout:3520: finishing write tid 2 to smithi084102331-7 2024-01-13T18:12:22.755 INFO:tasks.rados.rados.0.smithi084.stdout:3520: finishing write tid 3 to smithi084102331-7 2024-01-13T18:12:22.755 INFO:tasks.rados.rados.0.smithi084.stdout:3520: finishing write tid 4 to smithi084102331-7 2024-01-13T18:12:22.757 INFO:tasks.rados.rados.0.smithi084.stdout:3520: finishing write tid 5 to smithi084102331-7 2024-01-13T18:12:22.757 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1734 (ObjNum 1081 snap 342 seq_num 1081) dirty exists 2024-01-13T18:12:22.757 INFO:tasks.rados.rados.0.smithi084.stdout:3520: left oid 7 (ObjNum 1081 snap 342 seq_num 1081) 2024-01-13T18:12:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:22 smithi099 ceph-mon[138788]: osdmap e758: 8 total, 8 up, 8 in 2024-01-13T18:12:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:22 smithi099 ceph-mon[138788]: pgmap v850: 121 pgs: 121 active+clean; 292 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2024-01-13T18:12:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:22 smithi099 ceph-mon[138788]: osdmap e759: 8 total, 8 up, 8 in 2024-01-13T18:12:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:22 smithi084 ceph-mon[116404]: osdmap e758: 8 total, 8 up, 8 in 2024-01-13T18:12:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:22 smithi084 ceph-mon[116404]: pgmap v850: 121 pgs: 121 active+clean; 292 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2024-01-13T18:12:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:22 smithi084 ceph-mon[116404]: osdmap e759: 8 total, 8 up, 8 in 2024-01-13T18:12:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:22 smithi084 ceph-mon[119097]: osdmap e758: 8 total, 8 up, 8 in 2024-01-13T18:12:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:22 smithi084 ceph-mon[119097]: pgmap v850: 121 pgs: 121 active+clean; 292 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2024-01-13T18:12:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:22 smithi084 ceph-mon[119097]: osdmap e759: 8 total, 8 up, 8 in 2024-01-13T18:12:23.739 INFO:tasks.rados.rados.0.smithi084.stdout:3520: done (1 left) 2024-01-13T18:12:23.739 INFO:tasks.rados.rados.0.smithi084.stdout:3521: done (0 left) 2024-01-13T18:12:23.739 INFO:tasks.rados.rados.0.smithi084.stdout:3522: read oid 31 snap -1 2024-01-13T18:12:23.739 INFO:tasks.rados.rados.0.smithi084.stdout:3522: expect deleted 2024-01-13T18:12:23.739 INFO:tasks.rados.rados.0.smithi084.stdout:3523: read oid 45 snap -1 2024-01-13T18:12:23.739 INFO:tasks.rados.rados.0.smithi084.stdout:3523: expect (ObjNum 1011 snap 316 seq_num 1011) 2024-01-13T18:12:23.739 INFO:tasks.rados.rados.0.smithi084.stdout:3524: read oid 38 snap 342 2024-01-13T18:12:23.739 INFO:tasks.rados.rados.0.smithi084.stdout:3524: expect (ObjNum 969 snap 307 seq_num 969) 2024-01-13T18:12:23.740 INFO:tasks.rados.rados.0.smithi084.stdout:3525: read oid 22 snap -1 2024-01-13T18:12:23.740 INFO:tasks.rados.rados.0.smithi084.stdout:3525: expect (ObjNum 1080 snap 342 seq_num 1080) 2024-01-13T18:12:23.740 INFO:tasks.rados.rados.0.smithi084.stdout:3526: read oid 46 snap -1 2024-01-13T18:12:23.740 INFO:tasks.rados.rados.0.smithi084.stdout:3526: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:12:23.740 INFO:tasks.rados.rados.0.smithi084.stdout:3527: snap_create 2024-01-13T18:12:23.774 INFO:tasks.rados.rados.0.smithi084.stdout:3523: expect (ObjNum 1011 snap 316 seq_num 1011) 2024-01-13T18:12:24.312 INFO:tasks.rados.rados.0.smithi084.stdout:3526: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:12:24.482 INFO:tasks.rados.rados.0.smithi084.stdout:3524: expect (ObjNum 969 snap 307 seq_num 969) 2024-01-13T18:12:24.589 INFO:tasks.rados.rados.0.smithi084.stdout:3525: expect (ObjNum 1080 snap 342 seq_num 1080) 2024-01-13T18:12:25.001 INFO:tasks.rados.rados.0.smithi084.stdout:3522: done (5 left) 2024-01-13T18:12:25.001 INFO:tasks.rados.rados.0.smithi084.stdout:3523: done (4 left) 2024-01-13T18:12:25.001 INFO:tasks.rados.rados.0.smithi084.stdout:3524: done (3 left) 2024-01-13T18:12:25.001 INFO:tasks.rados.rados.0.smithi084.stdout:3525: done (2 left) 2024-01-13T18:12:25.001 INFO:tasks.rados.rados.0.smithi084.stdout:3526: done (1 left) 2024-01-13T18:12:25.001 INFO:tasks.rados.rados.0.smithi084.stdout:3527: done (0 left) 2024-01-13T18:12:25.001 INFO:tasks.rados.rados.0.smithi084.stdout:3528: snap_remove snap 339 2024-01-13T18:12:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:24 smithi099 ceph-mon[138788]: osdmap e760: 8 total, 8 up, 8 in 2024-01-13T18:12:25.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:24 smithi099 ceph-mon[138788]: pgmap v853: 121 pgs: 121 active+clean; 265 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 15 op/s 2024-01-13T18:12:25.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:24 smithi084 ceph-mon[116404]: osdmap e760: 8 total, 8 up, 8 in 2024-01-13T18:12:25.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:24 smithi084 ceph-mon[116404]: pgmap v853: 121 pgs: 121 active+clean; 265 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 15 op/s 2024-01-13T18:12:25.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:24 smithi084 ceph-mon[119097]: osdmap e760: 8 total, 8 up, 8 in 2024-01-13T18:12:25.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:24 smithi084 ceph-mon[119097]: pgmap v853: 121 pgs: 121 active+clean; 265 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 15 op/s 2024-01-13T18:12:25.750 INFO:tasks.rados.rados.0.smithi084.stdout:3528: done (0 left) 2024-01-13T18:12:25.750 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 344 2024-01-13T18:12:25.750 INFO:tasks.rados.rados.0.smithi084.stdout:3529: seq_num 1082 ranges {0=524288,524288=704512,1228800=98304} 2024-01-13T18:12:25.753 INFO:tasks.rados.rados.0.smithi084.stdout:3529: writing smithi084102331-50 from 0 to 524288 tid 1 2024-01-13T18:12:25.758 INFO:tasks.rados.rados.0.smithi084.stdout:3529: writing smithi084102331-50 from 524288 to 1228800 tid 2 2024-01-13T18:12:25.758 INFO:tasks.rados.rados.0.smithi084.stdout:3529: writing smithi084102331-50 from 1228800 to 1327104 tid 3 2024-01-13T18:12:25.758 INFO:tasks.rados.rados.0.smithi084.stdout:3530: delete oid 42 current snap is 344 2024-01-13T18:12:25.765 INFO:tasks.rados.rados.0.smithi084.stdout:3529: finishing write tid 1 to smithi084102331-50 2024-01-13T18:12:25.765 INFO:tasks.rados.rados.0.smithi084.stdout:3529: finishing write tid 2 to smithi084102331-50 2024-01-13T18:12:25.766 INFO:tasks.rados.rados.0.smithi084.stdout:3530: done (1 left) 2024-01-13T18:12:25.766 INFO:tasks.rados.rados.0.smithi084.stdout:3531: snap_create 2024-01-13T18:12:25.767 INFO:tasks.rados.rados.0.smithi084.stdout:3529: finishing write tid 3 to smithi084102331-50 2024-01-13T18:12:25.767 INFO:tasks.rados.rados.0.smithi084.stdout:3529: finishing write tid 4 to smithi084102331-50 2024-01-13T18:12:25.769 INFO:tasks.rados.rados.0.smithi084.stdout:3529: finishing write tid 5 to smithi084102331-50 2024-01-13T18:12:25.769 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 1678 (ObjNum 1082 snap 344 seq_num 1082) dirty exists 2024-01-13T18:12:25.769 INFO:tasks.rados.rados.0.smithi084.stdout:3529: left oid 50 (ObjNum 1082 snap 344 seq_num 1082) 2024-01-13T18:12:26.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:25 smithi099 ceph-mon[138788]: osdmap e761: 8 total, 8 up, 8 in 2024-01-13T18:12:26.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:25 smithi084 ceph-mon[119097]: osdmap e761: 8 total, 8 up, 8 in 2024-01-13T18:12:26.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:25 smithi084 ceph-mon[116404]: osdmap e761: 8 total, 8 up, 8 in 2024-01-13T18:12:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3529: done (1 left) 2024-01-13T18:12:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3531: done (0 left) 2024-01-13T18:12:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3532: snap_create 2024-01-13T18:12:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:26 smithi099 ceph-mon[138788]: osdmap e762: 8 total, 8 up, 8 in 2024-01-13T18:12:27.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:26 smithi099 ceph-mon[138788]: pgmap v856: 121 pgs: 121 active+clean; 254 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 490 KiB/s wr, 3 op/s 2024-01-13T18:12:27.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:26 smithi084 ceph-mon[116404]: osdmap e762: 8 total, 8 up, 8 in 2024-01-13T18:12:27.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:26 smithi084 ceph-mon[116404]: pgmap v856: 121 pgs: 121 active+clean; 254 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 490 KiB/s wr, 3 op/s 2024-01-13T18:12:27.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:26 smithi084 ceph-mon[119097]: osdmap e762: 8 total, 8 up, 8 in 2024-01-13T18:12:27.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:26 smithi084 ceph-mon[119097]: pgmap v856: 121 pgs: 121 active+clean; 254 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 490 KiB/s wr, 3 op/s 2024-01-13T18:12:27.727 INFO:tasks.rados.rados.0.smithi084.stdout:3532: done (0 left) 2024-01-13T18:12:27.728 INFO:tasks.rados.rados.0.smithi084.stdout:3533: rollback oid 11 current snap is 346 2024-01-13T18:12:27.728 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 11 to 343 2024-01-13T18:12:27.728 INFO:tasks.rados.rados.0.smithi084.stdout:3534: rollback oid 32 current snap is 346 2024-01-13T18:12:27.728 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 32 to 340 2024-01-13T18:12:27.728 INFO:tasks.rados.rados.0.smithi084.stdout:3535: delete oid 15 current snap is 346 2024-01-13T18:12:27.734 INFO:tasks.rados.rados.0.smithi084.stdout:3533: finishing rollback tid 1 to smithi084102331-11 2024-01-13T18:12:27.734 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1765 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-01-13T18:12:27.735 INFO:tasks.rados.rados.0.smithi084.stdout:3534: finishing rollback tid 0 to smithi084102331-32 2024-01-13T18:12:27.736 INFO:tasks.rados.rados.0.smithi084.stdout:3534: finishing rollback tid 1 to smithi084102331-32 2024-01-13T18:12:27.736 INFO:tasks.rados.rados.0.smithi084.stdout:3534: finishing rollback tid 2 to smithi084102331-32 2024-01-13T18:12:27.736 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1739 (ObjNum 1015 snap 317 seq_num 1015) dirty exists 2024-01-13T18:12:27.737 INFO:tasks.rados.rados.0.smithi084.stdout:3533: done (2 left) 2024-01-13T18:12:27.737 INFO:tasks.rados.rados.0.smithi084.stdout:3534: done (1 left) 2024-01-13T18:12:27.737 INFO:tasks.rados.rados.0.smithi084.stdout:3535: done (0 left) 2024-01-13T18:12:27.737 INFO:tasks.rados.rados.0.smithi084.stdout:3536: rollback oid 45 current snap is 346 2024-01-13T18:12:27.737 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 342 2024-01-13T18:12:27.737 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 346 2024-01-13T18:12:27.737 INFO:tasks.rados.rados.0.smithi084.stdout:3537: seq_num 1085 ranges {4464640=581632,5046272=761856,5808128=40960} 2024-01-13T18:12:27.764 INFO:tasks.rados.rados.0.smithi084.stdout:3537: writing smithi084102331-40 from 4464640 to 5046272 tid 1 2024-01-13T18:12:27.769 INFO:tasks.rados.rados.0.smithi084.stdout:3537: writing smithi084102331-40 from 5046272 to 5808128 tid 2 2024-01-13T18:12:27.769 INFO:tasks.rados.rados.0.smithi084.stdout:3537: writing smithi084102331-40 from 5808128 to 5849088 tid 3 2024-01-13T18:12:27.769 INFO:tasks.rados.rados.0.smithi084.stdout:3538: snap_create 2024-01-13T18:12:27.770 INFO:tasks.rados.rados.0.smithi084.stdout:3536: finishing rollback tid 0 to smithi084102331-45 2024-01-13T18:12:27.770 INFO:tasks.rados.rados.0.smithi084.stdout:3536: finishing rollback tid 1 to smithi084102331-45 2024-01-13T18:12:27.770 INFO:tasks.rados.rados.0.smithi084.stdout:3536: finishing rollback tid 2 to smithi084102331-45 2024-01-13T18:12:27.770 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1737 (ObjNum 1011 snap 316 seq_num 1011) dirty exists 2024-01-13T18:12:27.770 INFO:tasks.rados.rados.0.smithi084.stdout:3537: finishing write tid 1 to smithi084102331-40 2024-01-13T18:12:27.774 INFO:tasks.rados.rados.0.smithi084.stdout:3537: finishing write tid 2 to smithi084102331-40 2024-01-13T18:12:27.774 INFO:tasks.rados.rados.0.smithi084.stdout:3537: finishing write tid 3 to smithi084102331-40 2024-01-13T18:12:27.774 INFO:tasks.rados.rados.0.smithi084.stdout:3537: finishing write tid 4 to smithi084102331-40 2024-01-13T18:12:27.776 INFO:tasks.rados.rados.0.smithi084.stdout:3537: finishing write tid 5 to smithi084102331-40 2024-01-13T18:12:27.776 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1741 (ObjNum 1085 snap 346 seq_num 1085) dirty exists 2024-01-13T18:12:27.776 INFO:tasks.rados.rados.0.smithi084.stdout:3537: left oid 40 (ObjNum 1085 snap 346 seq_num 1085) 2024-01-13T18:12:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:27 smithi099 ceph-mon[138788]: osdmap e763: 8 total, 8 up, 8 in 2024-01-13T18:12:28.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:27 smithi099 ceph-mon[138788]: osdmap e764: 8 total, 8 up, 8 in 2024-01-13T18:12:28.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:27 smithi084 ceph-mon[116404]: osdmap e763: 8 total, 8 up, 8 in 2024-01-13T18:12:28.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:27 smithi084 ceph-mon[116404]: osdmap e764: 8 total, 8 up, 8 in 2024-01-13T18:12:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:27 smithi084 ceph-mon[119097]: osdmap e763: 8 total, 8 up, 8 in 2024-01-13T18:12:28.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:27 smithi084 ceph-mon[119097]: osdmap e764: 8 total, 8 up, 8 in 2024-01-13T18:12:28.762 INFO:tasks.rados.rados.0.smithi084.stdout:3536: done (2 left) 2024-01-13T18:12:28.762 INFO:tasks.rados.rados.0.smithi084.stdout:3537: done (1 left) 2024-01-13T18:12:28.762 INFO:tasks.rados.rados.0.smithi084.stdout:3538: done (0 left) 2024-01-13T18:12:28.762 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 347 2024-01-13T18:12:28.762 INFO:tasks.rados.rados.0.smithi084.stdout:3539: seq_num 1086 ranges {1163264=598016,1761280=647168,2408448=155648} 2024-01-13T18:12:28.771 INFO:tasks.rados.rados.0.smithi084.stdout:3539: writing smithi084102331-13 from 1163264 to 1761280 tid 1 2024-01-13T18:12:28.775 INFO:tasks.rados.rados.0.smithi084.stdout:3539: writing smithi084102331-13 from 1761280 to 2408448 tid 2 2024-01-13T18:12:28.776 INFO:tasks.rados.rados.0.smithi084.stdout:3539: writing smithi084102331-13 from 2408448 to 2564096 tid 3 2024-01-13T18:12:28.776 INFO:tasks.rados.rados.0.smithi084.stdout:3540: rollback oid 30 current snap is 347 2024-01-13T18:12:28.776 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 340 2024-01-13T18:12:28.776 INFO:tasks.rados.rados.0.smithi084.stdout:3541: snap_create 2024-01-13T18:12:28.780 INFO:tasks.rados.rados.0.smithi084.stdout:3539: finishing write tid 1 to smithi084102331-13 2024-01-13T18:12:28.783 INFO:tasks.rados.rados.0.smithi084.stdout:3539: finishing write tid 2 to smithi084102331-13 2024-01-13T18:12:28.783 INFO:tasks.rados.rados.0.smithi084.stdout:3539: finishing write tid 3 to smithi084102331-13 2024-01-13T18:12:28.783 INFO:tasks.rados.rados.0.smithi084.stdout:3539: finishing write tid 4 to smithi084102331-13 2024-01-13T18:12:28.783 INFO:tasks.rados.rados.0.smithi084.stdout:3540: finishing rollback tid 0 to smithi084102331-30 2024-01-13T18:12:28.784 INFO:tasks.rados.rados.0.smithi084.stdout:3540: finishing rollback tid 1 to smithi084102331-30 2024-01-13T18:12:28.784 INFO:tasks.rados.rados.0.smithi084.stdout:3540: finishing rollback tid 2 to smithi084102331-30 2024-01-13T18:12:28.784 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1681 (ObjNum 991 snap 311 seq_num 991) dirty exists 2024-01-13T18:12:28.785 INFO:tasks.rados.rados.0.smithi084.stdout:3539: finishing write tid 5 to smithi084102331-13 2024-01-13T18:12:28.785 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 1651 (ObjNum 1086 snap 347 seq_num 1086) dirty exists 2024-01-13T18:12:28.785 INFO:tasks.rados.rados.0.smithi084.stdout:3539: left oid 13 (ObjNum 1086 snap 347 seq_num 1086) 2024-01-13T18:12:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:28 smithi099 ceph-mon[138788]: pgmap v859: 121 pgs: 121 active+clean; 255 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 320 KiB/s wr, 7 op/s 2024-01-13T18:12:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:28 smithi084 ceph-mon[116404]: pgmap v859: 121 pgs: 121 active+clean; 255 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 320 KiB/s wr, 7 op/s 2024-01-13T18:12:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:28 smithi084 ceph-mon[119097]: pgmap v859: 121 pgs: 121 active+clean; 255 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 320 KiB/s wr, 7 op/s 2024-01-13T18:12:29.768 INFO:tasks.rados.rados.0.smithi084.stdout:3539: done (2 left) 2024-01-13T18:12:29.768 INFO:tasks.rados.rados.0.smithi084.stdout:3540: done (1 left) 2024-01-13T18:12:29.768 INFO:tasks.rados.rados.0.smithi084.stdout:3541: done (0 left) 2024-01-13T18:12:29.768 INFO:tasks.rados.rados.0.smithi084.stdout:3542: read oid 41 snap -1 2024-01-13T18:12:29.768 INFO:tasks.rados.rados.0.smithi084.stdout:3542: expect (ObjNum 1013 snap 316 seq_num 1013) 2024-01-13T18:12:29.768 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 348 2024-01-13T18:12:29.768 INFO:tasks.rados.rados.0.smithi084.stdout:3543: seq_num 1087 ranges {1900544=614400,2514944=532480,3047424=270336} 2024-01-13T18:12:29.781 INFO:tasks.rados.rados.0.smithi084.stdout:3543: writing smithi084102331-7 from 1900544 to 2514944 tid 1 2024-01-13T18:12:29.784 INFO:tasks.rados.rados.0.smithi084.stdout:3543: writing smithi084102331-7 from 2514944 to 3047424 tid 2 2024-01-13T18:12:29.786 INFO:tasks.rados.rados.0.smithi084.stdout:3543: writing smithi084102331-7 from 3047424 to 3317760 tid 3 2024-01-13T18:12:29.786 INFO:tasks.rados.rados.0.smithi084.stdout:3544: snap_remove snap 340 2024-01-13T18:12:30.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:29 smithi099 ceph-mon[138788]: osdmap e765: 8 total, 8 up, 8 in 2024-01-13T18:12:30.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:29 smithi084 ceph-mon[116404]: osdmap e765: 8 total, 8 up, 8 in 2024-01-13T18:12:30.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:29 smithi084 ceph-mon[119097]: osdmap e765: 8 total, 8 up, 8 in 2024-01-13T18:12:30.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:12:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:12:30] "GET /metrics HTTP/1.1" 200 36192 "" "Prometheus/2.43.0" 2024-01-13T18:12:30.775 INFO:tasks.rados.rados.0.smithi084.stdout:3544: done (2 left) 2024-01-13T18:12:30.775 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 348 2024-01-13T18:12:30.775 INFO:tasks.rados.rados.0.smithi084.stdout:3545: seq_num 1088 ranges {2695168=630784,3325952=466944,3792896=335872} 2024-01-13T18:12:30.793 INFO:tasks.rados.rados.0.smithi084.stdout:3545: writing smithi084102331-16 from 2695168 to 3325952 tid 1 2024-01-13T18:12:30.796 INFO:tasks.rados.rados.0.smithi084.stdout:3545: writing smithi084102331-16 from 3325952 to 3792896 tid 2 2024-01-13T18:12:30.798 INFO:tasks.rados.rados.0.smithi084.stdout:3545: writing smithi084102331-16 from 3792896 to 4128768 tid 3 2024-01-13T18:12:30.799 INFO:tasks.rados.rados.0.smithi084.stdout:3546: rollback oid 9 current snap is 348 2024-01-13T18:12:30.799 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 344 2024-01-13T18:12:30.799 INFO:tasks.rados.rados.0.smithi084.stdout:3542: expect (ObjNum 1013 snap 316 seq_num 1013) 2024-01-13T18:12:31.006 INFO:tasks.rados.rados.0.smithi084.stdout:3543: finishing write tid 1 to smithi084102331-7 2024-01-13T18:12:31.006 INFO:tasks.rados.rados.0.smithi084.stdout:3542: done (3 left) 2024-01-13T18:12:31.006 INFO:tasks.rados.rados.0.smithi084.stdout:3547: setattr oid 39 current snap is 348 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3543: finishing write tid 2 to smithi084102331-7 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3543: finishing write tid 3 to smithi084102331-7 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3543: finishing write tid 4 to smithi084102331-7 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3543: finishing write tid 5 to smithi084102331-7 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1738 (ObjNum 1087 snap 348 seq_num 1087) dirty exists 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3543: left oid 7 (ObjNum 1087 snap 348 seq_num 1087) 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3545: finishing write tid 1 to smithi084102331-16 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3545: finishing write tid 2 to smithi084102331-16 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3545: finishing write tid 3 to smithi084102331-16 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3546: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3545: finishing write tid 4 to smithi084102331-16 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3546: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3545: finishing write tid 5 to smithi084102331-16 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1626 (ObjNum 1088 snap 348 seq_num 1088) dirty exists 2024-01-13T18:12:31.007 INFO:tasks.rados.rados.0.smithi084.stdout:3545: left oid 16 (ObjNum 1088 snap 348 seq_num 1088) 2024-01-13T18:12:31.008 INFO:tasks.rados.rados.0.smithi084.stdout:3546: finishing rollback tid 2 to smithi084102331-9 2024-01-13T18:12:31.008 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1766 (ObjNum 1041 snap 330 seq_num 1041) dirty exists 2024-01-13T18:12:31.008 INFO:tasks.rados.rados.0.smithi084.stdout:3543: done (3 left) 2024-01-13T18:12:31.008 INFO:tasks.rados.rados.0.smithi084.stdout:3545: done (2 left) 2024-01-13T18:12:31.008 INFO:tasks.rados.rados.0.smithi084.stdout:3546: done (1 left) 2024-01-13T18:12:31.008 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 348 2024-01-13T18:12:31.008 INFO:tasks.rados.rados.0.smithi084.stdout:3548: seq_num 1089 ranges {0=647168,647168=745472,1392640=57344} 2024-01-13T18:12:31.010 INFO:tasks.rados.rados.0.smithi084.stdout:3548: writing smithi084102331-14 from 0 to 647168 tid 1 2024-01-13T18:12:31.014 INFO:tasks.rados.rados.0.smithi084.stdout:3548: writing smithi084102331-14 from 647168 to 1392640 tid 2 2024-01-13T18:12:31.015 INFO:tasks.rados.rados.0.smithi084.stdout:3548: writing smithi084102331-14 from 1392640 to 1449984 tid 3 2024-01-13T18:12:31.015 INFO:tasks.rados.rados.0.smithi084.stdout:3549: snap_create 2024-01-13T18:12:31.015 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1766 (ObjNum 321 snap 0 seq_num 4038010512) dirty exists 2024-01-13T18:12:31.015 INFO:tasks.rados.rados.0.smithi084.stdout:3548: finishing write tid 1 to smithi084102331-14 2024-01-13T18:12:31.019 INFO:tasks.rados.rados.0.smithi084.stdout:3548: finishing write tid 2 to smithi084102331-14 2024-01-13T18:12:31.019 INFO:tasks.rados.rados.0.smithi084.stdout:3548: finishing write tid 3 to smithi084102331-14 2024-01-13T18:12:31.019 INFO:tasks.rados.rados.0.smithi084.stdout:3548: finishing write tid 4 to smithi084102331-14 2024-01-13T18:12:31.019 INFO:tasks.rados.rados.0.smithi084.stdout:3548: finishing write tid 5 to smithi084102331-14 2024-01-13T18:12:31.020 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1666 (ObjNum 1089 snap 348 seq_num 1089) dirty exists 2024-01-13T18:12:31.020 INFO:tasks.rados.rados.0.smithi084.stdout:3548: left oid 14 (ObjNum 1089 snap 348 seq_num 1089) 2024-01-13T18:12:31.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:30 smithi099 ceph-mon[138788]: osdmap e766: 8 total, 8 up, 8 in 2024-01-13T18:12:31.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:30 smithi099 ceph-mon[138788]: pgmap v862: 121 pgs: 121 active+clean; 256 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 644 KiB/s wr, 8 op/s 2024-01-13T18:12:31.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:30 smithi084 ceph-mon[116404]: osdmap e766: 8 total, 8 up, 8 in 2024-01-13T18:12:31.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:30 smithi084 ceph-mon[116404]: pgmap v862: 121 pgs: 121 active+clean; 256 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 644 KiB/s wr, 8 op/s 2024-01-13T18:12:31.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:30 smithi084 ceph-mon[119097]: osdmap e766: 8 total, 8 up, 8 in 2024-01-13T18:12:31.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:30 smithi084 ceph-mon[119097]: pgmap v862: 121 pgs: 121 active+clean; 256 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 644 KiB/s wr, 8 op/s 2024-01-13T18:12:31.778 INFO:tasks.rados.rados.0.smithi084.stdout:3547: done (2 left) 2024-01-13T18:12:31.778 INFO:tasks.rados.rados.0.smithi084.stdout:3548: done (1 left) 2024-01-13T18:12:31.779 INFO:tasks.rados.rados.0.smithi084.stdout:3549: done (0 left) 2024-01-13T18:12:31.779 INFO:tasks.rados.rados.0.smithi084.stdout:3550: read oid 48 snap -1 2024-01-13T18:12:31.779 INFO:tasks.rados.rados.0.smithi084.stdout:3550: expect deleted 2024-01-13T18:12:31.779 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 349 2024-01-13T18:12:31.779 INFO:tasks.rados.rados.0.smithi084.stdout:3551: seq_num 1090 ranges {0=663552,663552=630784,1294336=172032} 2024-01-13T18:12:31.782 INFO:tasks.rados.rados.0.smithi084.stdout:3551: writing smithi084102331-31 from 0 to 663552 tid 1 2024-01-13T18:12:31.786 INFO:tasks.rados.rados.0.smithi084.stdout:3551: writing smithi084102331-31 from 663552 to 1294336 tid 2 2024-01-13T18:12:31.788 INFO:tasks.rados.rados.0.smithi084.stdout:3551: writing smithi084102331-31 from 1294336 to 1466368 tid 3 2024-01-13T18:12:31.788 INFO:tasks.rados.rados.0.smithi084.stdout:3552: read oid 49 snap -1 2024-01-13T18:12:31.788 INFO:tasks.rados.rados.0.smithi084.stdout:3552: expect (ObjNum 1002 snap 313 seq_num 1002) 2024-01-13T18:12:31.788 INFO:tasks.rados.rados.0.smithi084.stdout:3553: rollback oid 42 current snap is 349 2024-01-13T18:12:31.788 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 329 2024-01-13T18:12:31.788 INFO:tasks.rados.rados.0.smithi084.stdout:3550: done (3 left) 2024-01-13T18:12:31.788 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 349 2024-01-13T18:12:31.789 INFO:tasks.rados.rados.0.smithi084.stdout:3554: seq_num 1091 ranges {6717440=679936,7397376=516096,7913472=286720} 2024-01-13T18:12:31.828 INFO:tasks.rados.rados.0.smithi084.stdout:3554: writing smithi084102331-20 from 6717440 to 7397376 tid 1 2024-01-13T18:12:31.832 INFO:tasks.rados.rados.0.smithi084.stdout:3554: writing smithi084102331-20 from 7397376 to 7913472 tid 2 2024-01-13T18:12:31.834 INFO:tasks.rados.rados.0.smithi084.stdout:3554: writing smithi084102331-20 from 7913472 to 8200192 tid 3 2024-01-13T18:12:31.834 INFO:tasks.rados.rados.0.smithi084.stdout:3555: rollback oid 4 current snap is 349 2024-01-13T18:12:31.834 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 326 2024-01-13T18:12:31.834 INFO:tasks.rados.rados.0.smithi084.stdout:3551: finishing write tid 1 to smithi084102331-31 2024-01-13T18:12:31.834 INFO:tasks.rados.rados.0.smithi084.stdout:3551: finishing write tid 2 to smithi084102331-31 2024-01-13T18:12:31.834 INFO:tasks.rados.rados.0.smithi084.stdout:3551: finishing write tid 3 to smithi084102331-31 2024-01-13T18:12:31.835 INFO:tasks.rados.rados.0.smithi084.stdout:3551: finishing write tid 4 to smithi084102331-31 2024-01-13T18:12:31.835 INFO:tasks.rados.rados.0.smithi084.stdout:3553: finishing rollback tid 1 to smithi084102331-42 2024-01-13T18:12:31.835 INFO:tasks.rados.rados.0.smithi084.stdout:3553: finishing rollback tid 2 to smithi084102331-42 2024-01-13T18:12:31.835 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1500 (ObjNum 979 snap 309 seq_num 979) dirty exists 2024-01-13T18:12:31.835 INFO:tasks.rados.rados.0.smithi084.stdout:3551: finishing write tid 5 to smithi084102331-31 2024-01-13T18:12:31.835 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1745 (ObjNum 1090 snap 349 seq_num 1090) dirty exists 2024-01-13T18:12:31.835 INFO:tasks.rados.rados.0.smithi084.stdout:3551: left oid 31 (ObjNum 1090 snap 349 seq_num 1090) 2024-01-13T18:12:31.835 INFO:tasks.rados.rados.0.smithi084.stdout:3552: expect (ObjNum 1002 snap 313 seq_num 1002) 2024-01-13T18:12:32.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:31 smithi099 ceph-mon[138788]: osdmap e767: 8 total, 8 up, 8 in 2024-01-13T18:12:32.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:31 smithi084 ceph-mon[116404]: osdmap e767: 8 total, 8 up, 8 in 2024-01-13T18:12:32.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:31 smithi084 ceph-mon[119097]: osdmap e767: 8 total, 8 up, 8 in 2024-01-13T18:12:32.715 INFO:tasks.rados.rados.0.smithi084.stdout:3554: finishing write tid 1 to smithi084102331-20 2024-01-13T18:12:32.715 INFO:tasks.rados.rados.0.smithi084.stdout:3554: finishing write tid 2 to smithi084102331-20 2024-01-13T18:12:32.715 INFO:tasks.rados.rados.0.smithi084.stdout:3555: finishing rollback tid 0 to smithi084102331-4 2024-01-13T18:12:32.715 INFO:tasks.rados.rados.0.smithi084.stdout:3555: finishing rollback tid 1 to smithi084102331-4 2024-01-13T18:12:32.715 INFO:tasks.rados.rados.0.smithi084.stdout:3555: finishing rollback tid 2 to smithi084102331-4 2024-01-13T18:12:32.715 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 1654 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:12:32.715 INFO:tasks.rados.rados.0.smithi084.stdout:3554: finishing write tid 3 to smithi084102331-20 2024-01-13T18:12:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3554: finishing write tid 4 to smithi084102331-20 2024-01-13T18:12:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3551: done (4 left) 2024-01-13T18:12:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3552: done (3 left) 2024-01-13T18:12:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3553: done (2 left) 2024-01-13T18:12:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3555: done (1 left) 2024-01-13T18:12:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 349 2024-01-13T18:12:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3554: finishing write tid 5 to smithi084102331-20 2024-01-13T18:12:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1624 (ObjNum 1091 snap 349 seq_num 1091) dirty exists 2024-01-13T18:12:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3554: left oid 20 (ObjNum 1091 snap 349 seq_num 1091) 2024-01-13T18:12:32.716 INFO:tasks.rados.rados.0.smithi084.stdout:3556: seq_num 1092 ranges {4751360=696320,5447680=802816} 2024-01-13T18:12:32.744 INFO:tasks.rados.rados.0.smithi084.stdout:3556: writing smithi084102331-32 from 4751360 to 5447680 tid 1 2024-01-13T18:12:32.749 INFO:tasks.rados.rados.0.smithi084.stdout:3556: writing smithi084102331-32 from 5447680 to 6250496 tid 2 2024-01-13T18:12:32.749 INFO:tasks.rados.rados.0.smithi084.stdout:3554: done (1 left) 2024-01-13T18:12:32.749 INFO:tasks.rados.rados.0.smithi084.stdout:3557: snap_create 2024-01-13T18:12:32.750 INFO:tasks.rados.rados.0.smithi084.stdout:3556: finishing write tid 1 to smithi084102331-32 2024-01-13T18:12:32.755 INFO:tasks.rados.rados.0.smithi084.stdout:3556: finishing write tid 2 to smithi084102331-32 2024-01-13T18:12:32.755 INFO:tasks.rados.rados.0.smithi084.stdout:3556: finishing write tid 3 to smithi084102331-32 2024-01-13T18:12:32.756 INFO:tasks.rados.rados.0.smithi084.stdout:3556: finishing write tid 4 to smithi084102331-32 2024-01-13T18:12:32.756 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1743 (ObjNum 1092 snap 349 seq_num 1092) dirty exists 2024-01-13T18:12:32.756 INFO:tasks.rados.rados.0.smithi084.stdout:3556: left oid 32 (ObjNum 1092 snap 349 seq_num 1092) 2024-01-13T18:12:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:32 smithi099 ceph-mon[138788]: osdmap e768: 8 total, 8 up, 8 in 2024-01-13T18:12:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:32 smithi099 ceph-mon[138788]: pgmap v865: 121 pgs: 121 active+clean; 255 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-01-13T18:12:33.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:32 smithi099 ceph-mon[138788]: osdmap e769: 8 total, 8 up, 8 in 2024-01-13T18:12:33.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:32 smithi084 ceph-mon[116404]: osdmap e768: 8 total, 8 up, 8 in 2024-01-13T18:12:33.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:32 smithi084 ceph-mon[116404]: pgmap v865: 121 pgs: 121 active+clean; 255 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-01-13T18:12:33.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:32 smithi084 ceph-mon[116404]: osdmap e769: 8 total, 8 up, 8 in 2024-01-13T18:12:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:32 smithi084 ceph-mon[119097]: osdmap e768: 8 total, 8 up, 8 in 2024-01-13T18:12:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:32 smithi084 ceph-mon[119097]: pgmap v865: 121 pgs: 121 active+clean; 255 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-01-13T18:12:33.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:32 smithi084 ceph-mon[119097]: osdmap e769: 8 total, 8 up, 8 in 2024-01-13T18:12:33.739 INFO:tasks.rados.rados.0.smithi084.stdout:3556: done (1 left) 2024-01-13T18:12:33.739 INFO:tasks.rados.rados.0.smithi084.stdout:3557: done (0 left) 2024-01-13T18:12:33.739 INFO:tasks.rados.rados.0.smithi084.stdout:3558: delete oid 49 current snap is 350 2024-01-13T18:12:33.743 INFO:tasks.rados.rados.0.smithi084.stdout:3558: done (0 left) 2024-01-13T18:12:33.743 INFO:tasks.rados.rados.0.smithi084.stdout:3559: snap_remove snap 326 2024-01-13T18:12:34.751 INFO:tasks.rados.rados.0.smithi084.stdout:3559: done (0 left) 2024-01-13T18:12:34.751 INFO:tasks.rados.rados.0.smithi084.stdout:3560: rollback oid 20 current snap is 350 2024-01-13T18:12:34.751 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 342 2024-01-13T18:12:34.751 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 350 2024-01-13T18:12:34.751 INFO:tasks.rados.rados.0.smithi084.stdout:3561: seq_num 1094 ranges {1040384=729088,1769472=573440,2342912=229376} 2024-01-13T18:12:34.761 INFO:tasks.rados.rados.0.smithi084.stdout:3561: writing smithi084102331-10 from 1040384 to 1769472 tid 1 2024-01-13T18:12:34.765 INFO:tasks.rados.rados.0.smithi084.stdout:3561: writing smithi084102331-10 from 1769472 to 2342912 tid 2 2024-01-13T18:12:34.767 INFO:tasks.rados.rados.0.smithi084.stdout:3561: writing smithi084102331-10 from 2342912 to 2572288 tid 3 2024-01-13T18:12:34.767 INFO:tasks.rados.rados.0.smithi084.stdout:3562: copy_from oid 24 from oid 49 current snap is 350 2024-01-13T18:12:34.767 INFO:tasks.rados.rados.0.smithi084.stdout:3563: rollback oid 36 current snap is 350 2024-01-13T18:12:34.767 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 341 2024-01-13T18:12:34.767 INFO:tasks.rados.rados.0.smithi084.stdout:3564: snap_remove snap 348 2024-01-13T18:12:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:34 smithi099 ceph-mon[138788]: osdmap e770: 8 total, 8 up, 8 in 2024-01-13T18:12:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:34 smithi099 ceph-mon[138788]: pgmap v868: 121 pgs: 121 active+clean; 253 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-01-13T18:12:35.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:34 smithi084 ceph-mon[116404]: osdmap e770: 8 total, 8 up, 8 in 2024-01-13T18:12:35.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:34 smithi084 ceph-mon[116404]: pgmap v868: 121 pgs: 121 active+clean; 253 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-01-13T18:12:35.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:34 smithi084 ceph-mon[119097]: osdmap e770: 8 total, 8 up, 8 in 2024-01-13T18:12:35.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:34 smithi084 ceph-mon[119097]: pgmap v868: 121 pgs: 121 active+clean; 253 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-01-13T18:12:35.745 INFO:tasks.rados.rados.0.smithi084.stdout:3564: done (4 left) 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3565: delete oid 43 current snap is 350 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3561: finishing write tid 1 to smithi084102331-10 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3561: finishing write tid 2 to smithi084102331-10 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3561: finishing write tid 3 to smithi084102331-10 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3561: finishing write tid 4 to smithi084102331-10 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3562: finishing copy_from to smithi084102331-24 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3562: got expected ENOENT (src dne) 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3562: finishing copy_from racing read to smithi084102331-24 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3560: finishing rollback tid 0 to smithi084102331-20 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3560: finishing rollback tid 1 to smithi084102331-20 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3563: finishing rollback tid 0 to smithi084102331-36 2024-01-13T18:12:35.746 INFO:tasks.rados.rados.0.smithi084.stdout:3563: finishing rollback tid 1 to smithi084102331-36 2024-01-13T18:12:35.747 INFO:tasks.rados.rados.0.smithi084.stdout:3560: finishing rollback tid 2 to smithi084102331-20 2024-01-13T18:12:35.747 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1627 (ObjNum 1052 snap 332 seq_num 1052) dirty exists 2024-01-13T18:12:35.747 INFO:tasks.rados.rados.0.smithi084.stdout:3563: finishing rollback tid 2 to smithi084102331-36 2024-01-13T18:12:35.747 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1670 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:12:35.747 INFO:tasks.rados.rados.0.smithi084.stdout:3561: finishing write tid 5 to smithi084102331-10 2024-01-13T18:12:35.747 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1516 (ObjNum 1094 snap 350 seq_num 1094) dirty exists 2024-01-13T18:12:35.747 INFO:tasks.rados.rados.0.smithi084.stdout:3561: left oid 10 (ObjNum 1094 snap 350 seq_num 1094) 2024-01-13T18:12:35.756 INFO:tasks.rados.rados.0.smithi084.stdout:3560: done (4 left) 2024-01-13T18:12:35.756 INFO:tasks.rados.rados.0.smithi084.stdout:3561: done (3 left) 2024-01-13T18:12:35.757 INFO:tasks.rados.rados.0.smithi084.stdout:3562: done (2 left) 2024-01-13T18:12:35.757 INFO:tasks.rados.rados.0.smithi084.stdout:3563: done (1 left) 2024-01-13T18:12:35.757 INFO:tasks.rados.rados.0.smithi084.stdout:3565: done (0 left) 2024-01-13T18:12:35.757 INFO:tasks.rados.rados.0.smithi084.stdout:3566: read oid 27 snap -1 2024-01-13T18:12:35.757 INFO:tasks.rados.rados.0.smithi084.stdout:3566: expect (ObjNum 938 snap 296 seq_num 938) 2024-01-13T18:12:35.757 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 350 2024-01-13T18:12:35.757 INFO:tasks.rados.rados.0.smithi084.stdout:3567: seq_num 1096 ranges {4325376=761856,5087232=786432,5873664=16384} 2024-01-13T18:12:35.783 INFO:tasks.rados.rados.0.smithi084.stdout:3567: writing smithi084102331-41 from 4325376 to 5087232 tid 1 2024-01-13T18:12:35.788 INFO:tasks.rados.rados.0.smithi084.stdout:3567: writing smithi084102331-41 from 5087232 to 5873664 tid 2 2024-01-13T18:12:35.789 INFO:tasks.rados.rados.0.smithi084.stdout:3567: writing smithi084102331-41 from 5873664 to 5890048 tid 3 2024-01-13T18:12:35.789 INFO:tasks.rados.rados.0.smithi084.stdout:3568: read oid 4 snap -1 2024-01-13T18:12:35.789 INFO:tasks.rados.rados.0.smithi084.stdout:3568: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:12:35.789 INFO:tasks.rados.rados.0.smithi084.stdout:3569: read oid 40 snap -1 2024-01-13T18:12:35.789 INFO:tasks.rados.rados.0.smithi084.stdout:3569: expect (ObjNum 1085 snap 346 seq_num 1085) 2024-01-13T18:12:35.789 INFO:tasks.rados.rados.0.smithi084.stdout:3570: snap_create 2024-01-13T18:12:35.789 INFO:tasks.rados.rados.0.smithi084.stdout:3566: expect (ObjNum 938 snap 296 seq_num 938) 2024-01-13T18:12:35.830 INFO:tasks.rados.rados.0.smithi084.stdout:3567: finishing write tid 1 to smithi084102331-41 2024-01-13T18:12:35.830 INFO:tasks.rados.rados.0.smithi084.stdout:3567: finishing write tid 2 to smithi084102331-41 2024-01-13T18:12:35.830 INFO:tasks.rados.rados.0.smithi084.stdout:3567: finishing write tid 3 to smithi084102331-41 2024-01-13T18:12:35.830 INFO:tasks.rados.rados.0.smithi084.stdout:3567: finishing write tid 4 to smithi084102331-41 2024-01-13T18:12:35.830 INFO:tasks.rados.rados.0.smithi084.stdout:3567: finishing write tid 5 to smithi084102331-41 2024-01-13T18:12:35.830 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1770 (ObjNum 1096 snap 350 seq_num 1096) dirty exists 2024-01-13T18:12:35.830 INFO:tasks.rados.rados.0.smithi084.stdout:3567: left oid 41 (ObjNum 1096 snap 350 seq_num 1096) 2024-01-13T18:12:35.830 INFO:tasks.rados.rados.0.smithi084.stdout:3568: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:12:36.001 INFO:tasks.rados.rados.0.smithi084.stdout:3569: expect (ObjNum 1085 snap 346 seq_num 1085) 2024-01-13T18:12:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:35 smithi099 ceph-mon[138788]: osdmap e771: 8 total, 8 up, 8 in 2024-01-13T18:12:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:36.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:35 smithi084 ceph-mon[116404]: osdmap e771: 8 total, 8 up, 8 in 2024-01-13T18:12:36.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:35 smithi084 ceph-mon[119097]: osdmap e771: 8 total, 8 up, 8 in 2024-01-13T18:12:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:3566: done (4 left) 2024-01-13T18:12:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:3567: done (3 left) 2024-01-13T18:12:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:3568: done (2 left) 2024-01-13T18:12:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:3569: done (1 left) 2024-01-13T18:12:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:3570: done (0 left) 2024-01-13T18:12:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 351 2024-01-13T18:12:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:3571: seq_num 1097 ranges {745472=778240,1523712=671744,2195456=131072} 2024-01-13T18:12:36.773 INFO:tasks.rados.rados.0.smithi084.stdout:3571: writing smithi084102331-9 from 745472 to 1523712 tid 1 2024-01-13T18:12:36.777 INFO:tasks.rados.rados.0.smithi084.stdout:3571: writing smithi084102331-9 from 1523712 to 2195456 tid 2 2024-01-13T18:12:36.778 INFO:tasks.rados.rados.0.smithi084.stdout:3571: writing smithi084102331-9 from 2195456 to 2326528 tid 3 2024-01-13T18:12:36.778 INFO:tasks.rados.rados.0.smithi084.stdout:3572: delete oid 20 current snap is 351 2024-01-13T18:12:36.781 INFO:tasks.rados.rados.0.smithi084.stdout:3571: finishing write tid 1 to smithi084102331-9 2024-01-13T18:12:36.782 INFO:tasks.rados.rados.0.smithi084.stdout:3571: finishing write tid 2 to smithi084102331-9 2024-01-13T18:12:36.783 INFO:tasks.rados.rados.0.smithi084.stdout:3572: done (1 left) 2024-01-13T18:12:36.783 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 351 2024-01-13T18:12:36.783 INFO:tasks.rados.rados.0.smithi084.stdout:3573: seq_num 1099 ranges {1449984=409600,1859584=442368,2301952=720896,3022848=40960} 2024-01-13T18:12:36.793 INFO:tasks.rados.rados.0.smithi084.stdout:3573: writing smithi084102331-14 from 1449984 to 1859584 tid 1 2024-01-13T18:12:36.796 INFO:tasks.rados.rados.0.smithi084.stdout:3573: writing smithi084102331-14 from 1859584 to 2301952 tid 2 2024-01-13T18:12:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:3573: writing smithi084102331-14 from 2301952 to 3022848 tid 3 2024-01-13T18:12:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:3573: writing smithi084102331-14 from 3022848 to 3063808 tid 4 2024-01-13T18:12:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:3574: read oid 44 snap -1 2024-01-13T18:12:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:3574: expect (ObjNum 1013 snap 316 seq_num 1013) 2024-01-13T18:12:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 351 2024-01-13T18:12:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:3571: finishing write tid 3 to smithi084102331-9 2024-01-13T18:12:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:3571: finishing write tid 4 to smithi084102331-9 2024-01-13T18:12:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:3571: finishing write tid 5 to smithi084102331-9 2024-01-13T18:12:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1770 (ObjNum 1097 snap 351 seq_num 1097) dirty exists 2024-01-13T18:12:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:3571: left oid 9 (ObjNum 1097 snap 351 seq_num 1097) 2024-01-13T18:12:36.801 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 1 to smithi084102331-14 2024-01-13T18:12:36.802 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 2 to smithi084102331-14 2024-01-13T18:12:36.802 INFO:tasks.rados.rados.0.smithi084.stdout:3575: seq_num 1100 ranges {4038656=425984,4464640=729088,5193728=475136} 2024-01-13T18:12:36.825 INFO:tasks.rados.rados.0.smithi084.stdout:3575: writing smithi084102331-17 from 4038656 to 4464640 tid 1 2024-01-13T18:12:36.829 INFO:tasks.rados.rados.0.smithi084.stdout:3575: writing smithi084102331-17 from 4464640 to 5193728 tid 2 2024-01-13T18:12:36.833 INFO:tasks.rados.rados.0.smithi084.stdout:3575: writing smithi084102331-17 from 5193728 to 5668864 tid 3 2024-01-13T18:12:36.833 INFO:tasks.rados.rados.0.smithi084.stdout:3571: done (3 left) 2024-01-13T18:12:36.833 INFO:tasks.rados.rados.0.smithi084.stdout:3576: rollback oid 42 current snap is 351 2024-01-13T18:12:36.833 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 346 2024-01-13T18:12:36.833 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 3 to smithi084102331-14 2024-01-13T18:12:36.833 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 4 to smithi084102331-14 2024-01-13T18:12:36.833 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 5 to smithi084102331-14 2024-01-13T18:12:36.833 INFO:tasks.rados.rados.0.smithi084.stdout:3577: setattr oid 2 current snap is 351 2024-01-13T18:12:36.834 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 6 to smithi084102331-14 2024-01-13T18:12:36.834 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1675 (ObjNum 1099 snap 351 seq_num 1099) dirty exists 2024-01-13T18:12:36.834 INFO:tasks.rados.rados.0.smithi084.stdout:3573: left oid 14 (ObjNum 1099 snap 351 seq_num 1099) 2024-01-13T18:12:36.834 INFO:tasks.rados.rados.0.smithi084.stdout:3574: expect (ObjNum 1013 snap 316 seq_num 1013) 2024-01-13T18:12:37.040 INFO:tasks.rados.rados.0.smithi084.stdout:3575: finishing write tid 1 to smithi084102331-17 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3576: finishing rollback tid 0 to smithi084102331-42 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3576: finishing rollback tid 1 to smithi084102331-42 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1502 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3575: finishing write tid 2 to smithi084102331-17 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3575: finishing write tid 3 to smithi084102331-17 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3575: finishing write tid 4 to smithi084102331-17 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3575: finishing write tid 5 to smithi084102331-17 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1658 (ObjNum 1100 snap 351 seq_num 1100) dirty exists 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3575: left oid 17 (ObjNum 1100 snap 351 seq_num 1100) 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3573: done (4 left) 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3574: done (3 left) 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3575: done (2 left) 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3576: done (1 left) 2024-01-13T18:12:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:3578: snap_create 2024-01-13T18:12:37.043 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1839 (ObjNum 1048 snap 331 seq_num 1048) dirty exists 2024-01-13T18:12:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:36 smithi099 ceph-mon[138788]: osdmap e772: 8 total, 8 up, 8 in 2024-01-13T18:12:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:36 smithi099 ceph-mon[138788]: pgmap v871: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 254 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 354 KiB/s wr, 8 op/s 2024-01-13T18:12:37.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:36 smithi084 ceph-mon[116404]: osdmap e772: 8 total, 8 up, 8 in 2024-01-13T18:12:37.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:36 smithi084 ceph-mon[116404]: pgmap v871: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 254 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 354 KiB/s wr, 8 op/s 2024-01-13T18:12:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:36 smithi084 ceph-mon[119097]: osdmap e772: 8 total, 8 up, 8 in 2024-01-13T18:12:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:36 smithi084 ceph-mon[119097]: pgmap v871: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 254 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 354 KiB/s wr, 8 op/s 2024-01-13T18:12:37.731 INFO:tasks.rados.rados.0.smithi084.stdout:3577: done (1 left) 2024-01-13T18:12:37.731 INFO:tasks.rados.rados.0.smithi084.stdout:3578: done (0 left) 2024-01-13T18:12:37.731 INFO:tasks.rados.rados.0.smithi084.stdout:3579: read oid 20 snap -1 2024-01-13T18:12:37.731 INFO:tasks.rados.rados.0.smithi084.stdout:3579: expect deleted 2024-01-13T18:12:37.732 INFO:tasks.rados.rados.0.smithi084.stdout:3580: snap_create 2024-01-13T18:12:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:37 smithi099 ceph-mon[138788]: osdmap e773: 8 total, 8 up, 8 in 2024-01-13T18:12:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:37 smithi099 ceph-mon[138788]: osdmap e774: 8 total, 8 up, 8 in 2024-01-13T18:12:38.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:37 smithi084 ceph-mon[116404]: osdmap e773: 8 total, 8 up, 8 in 2024-01-13T18:12:38.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:37 smithi084 ceph-mon[116404]: osdmap e774: 8 total, 8 up, 8 in 2024-01-13T18:12:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:37 smithi084 ceph-mon[119097]: osdmap e773: 8 total, 8 up, 8 in 2024-01-13T18:12:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:37 smithi084 ceph-mon[119097]: osdmap e774: 8 total, 8 up, 8 in 2024-01-13T18:12:38.737 INFO:tasks.rados.rados.0.smithi084.stdout:3579: done (1 left) 2024-01-13T18:12:38.737 INFO:tasks.rados.rados.0.smithi084.stdout:3580: done (0 left) 2024-01-13T18:12:38.737 INFO:tasks.rados.rados.0.smithi084.stdout:3581: snap_create 2024-01-13T18:12:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:38 smithi099 ceph-mon[138788]: pgmap v874: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 250 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2024-01-13T18:12:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:38 smithi099 ceph-mon[138788]: osdmap e775: 8 total, 8 up, 8 in 2024-01-13T18:12:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:38 smithi084 ceph-mon[116404]: pgmap v874: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 250 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2024-01-13T18:12:39.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:38 smithi084 ceph-mon[116404]: osdmap e775: 8 total, 8 up, 8 in 2024-01-13T18:12:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:38 smithi084 ceph-mon[119097]: pgmap v874: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 250 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2024-01-13T18:12:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:38 smithi084 ceph-mon[119097]: osdmap e775: 8 total, 8 up, 8 in 2024-01-13T18:12:39.740 INFO:tasks.rados.rados.0.smithi084.stdout:3581: done (0 left) 2024-01-13T18:12:39.740 INFO:tasks.rados.rados.0.smithi084.stdout:3582: rmattr oid 8 current snap is 354 2024-01-13T18:12:39.740 INFO:tasks.rados.rados.0.smithi084.stdout:3583: copy_from oid 30 from oid 7 current snap is 354 2024-01-13T18:12:39.740 INFO:tasks.rados.rados.0.smithi084.stdout:3584: setattr oid 47 current snap is 354 2024-01-13T18:12:39.741 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 354 2024-01-13T18:12:39.741 INFO:tasks.rados.rados.0.smithi084.stdout:3585: seq_num 1101 ranges {0=442368,442368=606208,1048576=598016} 2024-01-13T18:12:39.743 INFO:tasks.rados.rados.0.smithi084.stdout:3585: writing smithi084102331-20 from 0 to 442368 tid 1 2024-01-13T18:12:39.748 INFO:tasks.rados.rados.0.smithi084.stdout:3585: writing smithi084102331-20 from 442368 to 1048576 tid 2 2024-01-13T18:12:39.751 INFO:tasks.rados.rados.0.smithi084.stdout:3585: writing smithi084102331-20 from 1048576 to 1646592 tid 3 2024-01-13T18:12:39.751 INFO:tasks.rados.rados.0.smithi084.stdout:3586: snap_remove snap 343 2024-01-13T18:12:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:12:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:12:40] "GET /metrics HTTP/1.1" 200 36190 "" "Prometheus/2.43.0" 2024-01-13T18:12:40.747 INFO:tasks.rados.rados.0.smithi084.stdout:3586: done (4 left) 2024-01-13T18:12:40.747 INFO:tasks.rados.rados.0.smithi084.stdout:3587: read oid 16 snap 350 2024-01-13T18:12:40.747 INFO:tasks.rados.rados.0.smithi084.stdout:3587: expect (ObjNum 1088 snap 348 seq_num 1088) 2024-01-13T18:12:40.748 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 354 2024-01-13T18:12:40.748 INFO:tasks.rados.rados.0.smithi084.stdout:3588: seq_num 1102 ranges {0=458752,458752=491520,950272=491520,1441792=221184} 2024-01-13T18:12:40.753 INFO:tasks.rados.rados.0.smithi084.stdout:3588: writing smithi084102331-11 from 0 to 458752 tid 1 2024-01-13T18:12:40.758 INFO:tasks.rados.rados.0.smithi084.stdout:3588: writing smithi084102331-11 from 458752 to 950272 tid 2 2024-01-13T18:12:40.758 INFO:tasks.rados.rados.0.smithi084.stdout:3588: writing smithi084102331-11 from 950272 to 1441792 tid 3 2024-01-13T18:12:40.759 INFO:tasks.rados.rados.0.smithi084.stdout:3588: writing smithi084102331-11 from 1441792 to 1662976 tid 4 2024-01-13T18:12:40.759 INFO:tasks.rados.rados.0.smithi084.stdout:3589: snap_remove snap 341 2024-01-13T18:12:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:40 smithi099 ceph-mon[138788]: osdmap e776: 8 total, 8 up, 8 in 2024-01-13T18:12:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:40 smithi099 ceph-mon[138788]: pgmap v877: 121 pgs: 121 active+clean; 245 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-01-13T18:12:41.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:40 smithi084 ceph-mon[119097]: osdmap e776: 8 total, 8 up, 8 in 2024-01-13T18:12:41.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:40 smithi084 ceph-mon[119097]: pgmap v877: 121 pgs: 121 active+clean; 245 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-01-13T18:12:41.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:40 smithi084 ceph-mon[116404]: osdmap e776: 8 total, 8 up, 8 in 2024-01-13T18:12:41.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:40 smithi084 ceph-mon[116404]: pgmap v877: 121 pgs: 121 active+clean; 245 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-01-13T18:12:41.755 INFO:tasks.rados.rados.0.smithi084.stdout:3589: done (6 left) 2024-01-13T18:12:41.755 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 354 2024-01-13T18:12:41.755 INFO:tasks.rados.rados.0.smithi084.stdout:3590: seq_num 1103 ranges {4325376=475136,4800512=425984,5226496=696320,5922816=81920} 2024-01-13T18:12:41.778 INFO:tasks.rados.rados.0.smithi084.stdout:3590: writing smithi084102331-44 from 4325376 to 4800512 tid 1 2024-01-13T18:12:41.780 INFO:tasks.rados.rados.0.smithi084.stdout:3590: writing smithi084102331-44 from 4800512 to 5226496 tid 2 2024-01-13T18:12:41.785 INFO:tasks.rados.rados.0.smithi084.stdout:3590: writing smithi084102331-44 from 5226496 to 5922816 tid 3 2024-01-13T18:12:41.785 INFO:tasks.rados.rados.0.smithi084.stdout:3590: writing smithi084102331-44 from 5922816 to 6004736 tid 4 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:3591: snap_create 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1748 (ObjNum 1078 snap 342 seq_num 1078) dirty exists 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1750 (ObjNum 33 snap 0 seq_num 4038014416) dirty exists 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:3585: finishing write tid 1 to smithi084102331-20 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:3585: finishing write tid 2 to smithi084102331-20 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:3585: finishing write tid 3 to smithi084102331-20 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:3585: finishing write tid 4 to smithi084102331-20 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:3585: finishing write tid 5 to smithi084102331-20 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1632 (ObjNum 1101 snap 354 seq_num 1101) dirty exists 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:3585: left oid 20 (ObjNum 1101 snap 354 seq_num 1101) 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:3583: finishing copy_from to smithi084102331-30 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1738 (ObjNum 1087 snap 348 seq_num 1087) dirty exists 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:3583: finishing copy_from racing read to smithi084102331-30 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:3588: finishing write tid 1 to smithi084102331-11 2024-01-13T18:12:41.786 INFO:tasks.rados.rados.0.smithi084.stdout:3588: finishing write tid 2 to smithi084102331-11 2024-01-13T18:12:41.787 INFO:tasks.rados.rados.0.smithi084.stdout:3588: finishing write tid 3 to smithi084102331-11 2024-01-13T18:12:41.787 INFO:tasks.rados.rados.0.smithi084.stdout:3588: finishing write tid 4 to smithi084102331-11 2024-01-13T18:12:41.787 INFO:tasks.rados.rados.0.smithi084.stdout:3588: finishing write tid 5 to smithi084102331-11 2024-01-13T18:12:41.787 INFO:tasks.rados.rados.0.smithi084.stdout:3588: finishing write tid 6 to smithi084102331-11 2024-01-13T18:12:41.787 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1775 (ObjNum 1102 snap 354 seq_num 1102) dirty exists 2024-01-13T18:12:41.787 INFO:tasks.rados.rados.0.smithi084.stdout:3588: left oid 11 (ObjNum 1102 snap 354 seq_num 1102) 2024-01-13T18:12:41.787 INFO:tasks.rados.rados.0.smithi084.stdout:3587: expect (ObjNum 1088 snap 348 seq_num 1088) 2024-01-13T18:12:41.968 INFO:tasks.rados.rados.0.smithi084.stdout:3590: finishing write tid 1 to smithi084102331-44 2024-01-13T18:12:41.968 INFO:tasks.rados.rados.0.smithi084.stdout:3590: finishing write tid 2 to smithi084102331-44 2024-01-13T18:12:41.968 INFO:tasks.rados.rados.0.smithi084.stdout:3590: finishing write tid 3 to smithi084102331-44 2024-01-13T18:12:41.968 INFO:tasks.rados.rados.0.smithi084.stdout:3590: finishing write tid 4 to smithi084102331-44 2024-01-13T18:12:41.969 INFO:tasks.rados.rados.0.smithi084.stdout:3590: finishing write tid 5 to smithi084102331-44 2024-01-13T18:12:41.969 INFO:tasks.rados.rados.0.smithi084.stdout:3590: finishing write tid 6 to smithi084102331-44 2024-01-13T18:12:41.969 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1772 (ObjNum 1103 snap 354 seq_num 1103) dirty exists 2024-01-13T18:12:41.969 INFO:tasks.rados.rados.0.smithi084.stdout:3590: left oid 44 (ObjNum 1103 snap 354 seq_num 1103) 2024-01-13T18:12:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:41 smithi099 ceph-mon[138788]: osdmap e777: 8 total, 8 up, 8 in 2024-01-13T18:12:42.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:41 smithi084 ceph-mon[116404]: osdmap e777: 8 total, 8 up, 8 in 2024-01-13T18:12:42.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:41 smithi084 ceph-mon[119097]: osdmap e777: 8 total, 8 up, 8 in 2024-01-13T18:12:42.737 INFO:tasks.rados.rados.0.smithi084.stdout:3582: done (7 left) 2024-01-13T18:12:42.738 INFO:tasks.rados.rados.0.smithi084.stdout:3583: done (6 left) 2024-01-13T18:12:42.738 INFO:tasks.rados.rados.0.smithi084.stdout:3584: done (5 left) 2024-01-13T18:12:42.738 INFO:tasks.rados.rados.0.smithi084.stdout:3585: done (4 left) 2024-01-13T18:12:42.738 INFO:tasks.rados.rados.0.smithi084.stdout:3587: done (3 left) 2024-01-13T18:12:42.738 INFO:tasks.rados.rados.0.smithi084.stdout:3588: done (2 left) 2024-01-13T18:12:42.738 INFO:tasks.rados.rados.0.smithi084.stdout:3590: done (1 left) 2024-01-13T18:12:42.738 INFO:tasks.rados.rados.0.smithi084.stdout:3591: done (0 left) 2024-01-13T18:12:42.738 INFO:tasks.rados.rados.0.smithi084.stdout:3592: snap_create 2024-01-13T18:12:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:42 smithi099 ceph-mon[138788]: osdmap e778: 8 total, 8 up, 8 in 2024-01-13T18:12:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:42 smithi099 ceph-mon[138788]: pgmap v880: 121 pgs: 121 active+clean; 249 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-01-13T18:12:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:42 smithi099 ceph-mon[138788]: osdmap e779: 8 total, 8 up, 8 in 2024-01-13T18:12:43.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:42 smithi084 ceph-mon[119097]: osdmap e778: 8 total, 8 up, 8 in 2024-01-13T18:12:43.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:42 smithi084 ceph-mon[119097]: pgmap v880: 121 pgs: 121 active+clean; 249 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-01-13T18:12:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:42 smithi084 ceph-mon[119097]: osdmap e779: 8 total, 8 up, 8 in 2024-01-13T18:12:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:42 smithi084 ceph-mon[116404]: osdmap e778: 8 total, 8 up, 8 in 2024-01-13T18:12:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:42 smithi084 ceph-mon[116404]: pgmap v880: 121 pgs: 121 active+clean; 249 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-01-13T18:12:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:42 smithi084 ceph-mon[116404]: osdmap e779: 8 total, 8 up, 8 in 2024-01-13T18:12:43.739 INFO:tasks.rados.rados.0.smithi084.stdout:3592: done (0 left) 2024-01-13T18:12:43.739 INFO:tasks.rados.rados.0.smithi084.stdout:3593: rollback oid 29 current snap is 356 2024-01-13T18:12:43.739 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 353 2024-01-13T18:12:43.739 INFO:tasks.rados.rados.0.smithi084.stdout:3594: rmattr oid 15 current snap is 356 2024-01-13T18:12:43.740 INFO:tasks.rados.rados.0.smithi084.stdout:3594: done (1 left) 2024-01-13T18:12:43.740 INFO:tasks.rados.rados.0.smithi084.stdout:3595: rmattr oid 40 current snap is 356 2024-01-13T18:12:43.740 INFO:tasks.rados.rados.0.smithi084.stdout:3596: snap_remove snap 345 2024-01-13T18:12:44.747 INFO:tasks.rados.rados.0.smithi084.stdout:3593: finishing rollback tid 0 to smithi084102331-29 2024-01-13T18:12:44.748 INFO:tasks.rados.rados.0.smithi084.stdout:3593: finishing rollback tid 1 to smithi084102331-29 2024-01-13T18:12:44.748 INFO:tasks.rados.rados.0.smithi084.stdout:3593: finishing rollback tid 2 to smithi084102331-29 2024-01-13T18:12:44.748 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1744 (ObjNum 1079 snap 342 seq_num 1079) dirty exists 2024-01-13T18:12:44.748 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1745 (ObjNum 1085 snap 346 seq_num 1085) dirty exists 2024-01-13T18:12:44.748 INFO:tasks.rados.rados.0.smithi084.stdout:3593: done (2 left) 2024-01-13T18:12:44.748 INFO:tasks.rados.rados.0.smithi084.stdout:3595: done (1 left) 2024-01-13T18:12:44.748 INFO:tasks.rados.rados.0.smithi084.stdout:3596: done (0 left) 2024-01-13T18:12:44.748 INFO:tasks.rados.rados.0.smithi084.stdout:3597: delete oid 27 current snap is 356 2024-01-13T18:12:44.756 INFO:tasks.rados.rados.0.smithi084.stdout:3597: done (0 left) 2024-01-13T18:12:44.756 INFO:tasks.rados.rados.0.smithi084.stdout:3598: snap_create 2024-01-13T18:12:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:44 smithi099 ceph-mon[138788]: osdmap e780: 8 total, 8 up, 8 in 2024-01-13T18:12:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:44 smithi099 ceph-mon[138788]: pgmap v883: 121 pgs: 121 active+clean; 253 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2024-01-13T18:12:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:44 smithi084 ceph-mon[116404]: osdmap e780: 8 total, 8 up, 8 in 2024-01-13T18:12:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:44 smithi084 ceph-mon[116404]: pgmap v883: 121 pgs: 121 active+clean; 253 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2024-01-13T18:12:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:44 smithi084 ceph-mon[119097]: osdmap e780: 8 total, 8 up, 8 in 2024-01-13T18:12:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:44 smithi084 ceph-mon[119097]: pgmap v883: 121 pgs: 121 active+clean; 253 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2024-01-13T18:12:45.745 INFO:tasks.rados.rados.0.smithi084.stdout:3598: done (0 left) 2024-01-13T18:12:45.745 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 357 2024-01-13T18:12:45.745 INFO:tasks.rados.rados.0.smithi084.stdout:3599: seq_num 1105 ranges {3784704=516096,4300800=598016,4898816=606208} 2024-01-13T18:12:45.767 INFO:tasks.rados.rados.0.smithi084.stdout:3599: writing smithi084102331-19 from 3784704 to 4300800 tid 1 2024-01-13T18:12:45.770 INFO:tasks.rados.rados.0.smithi084.stdout:3599: writing smithi084102331-19 from 4300800 to 4898816 tid 2 2024-01-13T18:12:45.774 INFO:tasks.rados.rados.0.smithi084.stdout:3599: writing smithi084102331-19 from 4898816 to 5505024 tid 3 2024-01-13T18:12:45.774 INFO:tasks.rados.rados.0.smithi084.stdout:3600: copy_from oid 20 from oid 49 current snap is 357 2024-01-13T18:12:45.774 INFO:tasks.rados.rados.0.smithi084.stdout:3601: snap_remove snap 351 2024-01-13T18:12:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:45 smithi099 ceph-mon[138788]: osdmap e781: 8 total, 8 up, 8 in 2024-01-13T18:12:46.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:45 smithi084 ceph-mon[116404]: osdmap e781: 8 total, 8 up, 8 in 2024-01-13T18:12:46.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:45 smithi084 ceph-mon[119097]: osdmap e781: 8 total, 8 up, 8 in 2024-01-13T18:12:46.759 INFO:tasks.rados.rados.0.smithi084.stdout:3601: done (2 left) 2024-01-13T18:12:46.759 INFO:tasks.rados.rados.0.smithi084.stdout:3602: rollback oid 39 current snap is 357 2024-01-13T18:12:46.759 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 352 2024-01-13T18:12:46.759 INFO:tasks.rados.rados.0.smithi084.stdout:3599: finishing write tid 1 to smithi084102331-19 2024-01-13T18:12:46.759 INFO:tasks.rados.rados.0.smithi084.stdout:3599: finishing write tid 2 to smithi084102331-19 2024-01-13T18:12:46.759 INFO:tasks.rados.rados.0.smithi084.stdout:3599: finishing write tid 3 to smithi084102331-19 2024-01-13T18:12:46.759 INFO:tasks.rados.rados.0.smithi084.stdout:3599: finishing write tid 4 to smithi084102331-19 2024-01-13T18:12:46.759 INFO:tasks.rados.rados.0.smithi084.stdout:3600: finishing copy_from to smithi084102331-20 2024-01-13T18:12:46.760 INFO:tasks.rados.rados.0.smithi084.stdout:3600: got expected ENOENT (src dne) 2024-01-13T18:12:46.760 INFO:tasks.rados.rados.0.smithi084.stdout:3600: finishing copy_from racing read to smithi084102331-20 2024-01-13T18:12:46.760 INFO:tasks.rados.rados.0.smithi084.stdout:3599: finishing write tid 5 to smithi084102331-19 2024-01-13T18:12:46.760 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 1636 (ObjNum 1105 snap 357 seq_num 1105) dirty exists 2024-01-13T18:12:46.760 INFO:tasks.rados.rados.0.smithi084.stdout:3599: left oid 19 (ObjNum 1105 snap 357 seq_num 1105) 2024-01-13T18:12:46.760 INFO:tasks.rados.rados.0.smithi084.stdout:3599: done (2 left) 2024-01-13T18:12:46.760 INFO:tasks.rados.rados.0.smithi084.stdout:3600: done (1 left) 2024-01-13T18:12:46.760 INFO:tasks.rados.rados.0.smithi084.stdout:3603: copy_from oid 27 from oid 46 current snap is 357 2024-01-13T18:12:46.760 INFO:tasks.rados.rados.0.smithi084.stdout:3604: delete oid 4 current snap is 357 2024-01-13T18:12:46.767 INFO:tasks.rados.rados.0.smithi084.stdout:3604: done (2 left) 2024-01-13T18:12:46.767 INFO:tasks.rados.rados.0.smithi084.stdout:3605: rollback oid 38 current snap is 357 2024-01-13T18:12:46.767 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 342 2024-01-13T18:12:46.767 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 357 2024-01-13T18:12:46.767 INFO:tasks.rados.rados.0.smithi084.stdout:3606: seq_num 1107 ranges {1769472=548864,2318336=770048,3088384=434176} 2024-01-13T18:12:46.780 INFO:tasks.rados.rados.0.smithi084.stdout:3606: writing smithi084102331-23 from 1769472 to 2318336 tid 1 2024-01-13T18:12:46.785 INFO:tasks.rados.rados.0.smithi084.stdout:3606: writing smithi084102331-23 from 2318336 to 3088384 tid 2 2024-01-13T18:12:46.787 INFO:tasks.rados.rados.0.smithi084.stdout:3606: writing smithi084102331-23 from 3088384 to 3522560 tid 3 2024-01-13T18:12:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 357 2024-01-13T18:12:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:3602: finishing rollback tid 0 to smithi084102331-39 2024-01-13T18:12:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:3602: finishing rollback tid 1 to smithi084102331-39 2024-01-13T18:12:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:3602: finishing rollback tid 2 to smithi084102331-39 2024-01-13T18:12:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1778 (ObjNum 289 snap 0 seq_num 1465846559) dirty exists 2024-01-13T18:12:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:3605: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:12:46.788 INFO:tasks.rados.rados.0.smithi084.stdout:3607: seq_num 1108 ranges {0=565248,565248=647168,1212416=483328,1695744=73728} 2024-01-13T18:12:46.791 INFO:tasks.rados.rados.0.smithi084.stdout:3607: writing smithi084102331-43 from 0 to 565248 tid 1 2024-01-13T18:12:46.795 INFO:tasks.rados.rados.0.smithi084.stdout:3607: writing smithi084102331-43 from 565248 to 1212416 tid 2 2024-01-13T18:12:46.798 INFO:tasks.rados.rados.0.smithi084.stdout:3607: writing smithi084102331-43 from 1212416 to 1695744 tid 3 2024-01-13T18:12:46.798 INFO:tasks.rados.rados.0.smithi084.stdout:3607: writing smithi084102331-43 from 1695744 to 1769472 tid 4 2024-01-13T18:12:46.798 INFO:tasks.rados.rados.0.smithi084.stdout:3602: done (4 left) 2024-01-13T18:12:46.798 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 357 2024-01-13T18:12:46.798 INFO:tasks.rados.rados.0.smithi084.stdout:3608: seq_num 1109 ranges {0=581632,581632=532480,1114112=647168,1761280=24576} 2024-01-13T18:12:46.802 INFO:tasks.rados.rados.0.smithi084.stdout:3608: writing smithi084102331-34 from 0 to 581632 tid 1 2024-01-13T18:12:46.805 INFO:tasks.rados.rados.0.smithi084.stdout:3608: writing smithi084102331-34 from 581632 to 1114112 tid 2 2024-01-13T18:12:46.809 INFO:tasks.rados.rados.0.smithi084.stdout:3608: writing smithi084102331-34 from 1114112 to 1761280 tid 3 2024-01-13T18:12:46.809 INFO:tasks.rados.rados.0.smithi084.stdout:3608: writing smithi084102331-34 from 1761280 to 1785856 tid 4 2024-01-13T18:12:46.809 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 357 2024-01-13T18:12:46.809 INFO:tasks.rados.rados.0.smithi084.stdout:3605: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:12:46.809 INFO:tasks.rados.rados.0.smithi084.stdout:3605: finishing rollback tid 2 to smithi084102331-38 2024-01-13T18:12:46.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1759 (ObjNum 969 snap 307 seq_num 969) dirty exists 2024-01-13T18:12:46.810 INFO:tasks.rados.rados.0.smithi084.stdout:3606: finishing write tid 1 to smithi084102331-23 2024-01-13T18:12:46.810 INFO:tasks.rados.rados.0.smithi084.stdout:3609: seq_num 1110 ranges {5570560=598016,6168576=466944,6635520=450560,7086080=286720} 2024-01-13T18:12:46.842 INFO:tasks.rados.rados.0.smithi084.stdout:3609: writing smithi084102331-6 from 5570560 to 6168576 tid 1 2024-01-13T18:12:46.844 INFO:tasks.rados.rados.0.smithi084.stdout:3609: writing smithi084102331-6 from 6168576 to 6635520 tid 2 2024-01-13T18:12:46.847 INFO:tasks.rados.rados.0.smithi084.stdout:3609: writing smithi084102331-6 from 6635520 to 7086080 tid 3 2024-01-13T18:12:46.850 INFO:tasks.rados.rados.0.smithi084.stdout:3609: writing smithi084102331-6 from 7086080 to 7372800 tid 4 2024-01-13T18:12:46.850 INFO:tasks.rados.rados.0.smithi084.stdout:3605: done (5 left) 2024-01-13T18:12:46.850 INFO:tasks.rados.rados.0.smithi084.stdout:3610: delete oid 26 current snap is 357 2024-01-13T18:12:46.850 INFO:tasks.rados.rados.0.smithi084.stdout:3606: finishing write tid 2 to smithi084102331-23 2024-01-13T18:12:46.850 INFO:tasks.rados.rados.0.smithi084.stdout:3606: finishing write tid 3 to smithi084102331-23 2024-01-13T18:12:46.850 INFO:tasks.rados.rados.0.smithi084.stdout:3606: finishing write tid 4 to smithi084102331-23 2024-01-13T18:12:46.850 INFO:tasks.rados.rados.0.smithi084.stdout:3607: finishing write tid 1 to smithi084102331-43 2024-01-13T18:12:46.850 INFO:tasks.rados.rados.0.smithi084.stdout:3603: finishing copy_from to smithi084102331-27 2024-01-13T18:12:46.850 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1412 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:12:46.850 INFO:tasks.rados.rados.0.smithi084.stdout:3606: finishing write tid 5 to smithi084102331-23 2024-01-13T18:12:46.850 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1854 (ObjNum 1107 snap 357 seq_num 1107) dirty exists 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3606: left oid 23 (ObjNum 1107 snap 357 seq_num 1107) 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3603: finishing copy_from racing read to smithi084102331-27 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3607: finishing write tid 2 to smithi084102331-43 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3607: finishing write tid 3 to smithi084102331-43 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3607: finishing write tid 4 to smithi084102331-43 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3607: finishing write tid 5 to smithi084102331-43 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3607: finishing write tid 6 to smithi084102331-43 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1744 (ObjNum 1108 snap 357 seq_num 1108) dirty exists 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3607: left oid 43 (ObjNum 1108 snap 357 seq_num 1108) 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3608: finishing write tid 1 to smithi084102331-34 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3608: finishing write tid 2 to smithi084102331-34 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3608: finishing write tid 3 to smithi084102331-34 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3608: finishing write tid 4 to smithi084102331-34 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3608: finishing write tid 5 to smithi084102331-34 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3608: finishing write tid 6 to smithi084102331-34 2024-01-13T18:12:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 1775 (ObjNum 1109 snap 357 seq_num 1109) dirty exists 2024-01-13T18:12:46.852 INFO:tasks.rados.rados.0.smithi084.stdout:3608: left oid 34 (ObjNum 1109 snap 357 seq_num 1109) 2024-01-13T18:12:46.852 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 1 to smithi084102331-6 2024-01-13T18:12:46.852 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 2 to smithi084102331-6 2024-01-13T18:12:46.852 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 3 to smithi084102331-6 2024-01-13T18:12:46.852 INFO:tasks.rados.rados.0.smithi084.stdout:3603: done (5 left) 2024-01-13T18:12:46.852 INFO:tasks.rados.rados.0.smithi084.stdout:3606: done (4 left) 2024-01-13T18:12:46.852 INFO:tasks.rados.rados.0.smithi084.stdout:3607: done (3 left) 2024-01-13T18:12:46.852 INFO:tasks.rados.rados.0.smithi084.stdout:3608: done (2 left) 2024-01-13T18:12:46.853 INFO:tasks.rados.rados.0.smithi084.stdout:3610: done (1 left) 2024-01-13T18:12:46.853 INFO:tasks.rados.rados.0.smithi084.stdout:3611: delete oid 1 current snap is 357 2024-01-13T18:12:46.853 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 4 to smithi084102331-6 2024-01-13T18:12:46.853 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 5 to smithi084102331-6 2024-01-13T18:12:46.855 INFO:tasks.rados.rados.0.smithi084.stdout:3611: done (1 left) 2024-01-13T18:12:46.855 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 357 2024-01-13T18:12:46.855 INFO:tasks.rados.rados.0.smithi084.stdout:3612: seq_num 1113 ranges {4628480=647168,5275648=524288,5799936=622592,6422528=57344} 2024-01-13T18:12:46.882 INFO:tasks.rados.rados.0.smithi084.stdout:3612: writing smithi084102331-2 from 4628480 to 5275648 tid 1 2024-01-13T18:12:46.885 INFO:tasks.rados.rados.0.smithi084.stdout:3612: writing smithi084102331-2 from 5275648 to 5799936 tid 2 2024-01-13T18:12:46.889 INFO:tasks.rados.rados.0.smithi084.stdout:3612: writing smithi084102331-2 from 5799936 to 6422528 tid 3 2024-01-13T18:12:46.890 INFO:tasks.rados.rados.0.smithi084.stdout:3612: writing smithi084102331-2 from 6422528 to 6479872 tid 4 2024-01-13T18:12:46.890 INFO:tasks.rados.rados.0.smithi084.stdout:3613: snap_create 2024-01-13T18:12:46.890 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 6 to smithi084102331-6 2024-01-13T18:12:46.890 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 1780 (ObjNum 1110 snap 357 seq_num 1110) dirty exists 2024-01-13T18:12:46.890 INFO:tasks.rados.rados.0.smithi084.stdout:3609: left oid 6 (ObjNum 1110 snap 357 seq_num 1110) 2024-01-13T18:12:46.890 INFO:tasks.rados.rados.0.smithi084.stdout:3612: finishing write tid 1 to smithi084102331-2 2024-01-13T18:12:46.890 INFO:tasks.rados.rados.0.smithi084.stdout:3612: finishing write tid 2 to smithi084102331-2 2024-01-13T18:12:46.894 INFO:tasks.rados.rados.0.smithi084.stdout:3612: finishing write tid 3 to smithi084102331-2 2024-01-13T18:12:46.894 INFO:tasks.rados.rados.0.smithi084.stdout:3612: finishing write tid 4 to smithi084102331-2 2024-01-13T18:12:46.894 INFO:tasks.rados.rados.0.smithi084.stdout:3612: finishing write tid 5 to smithi084102331-2 2024-01-13T18:12:46.895 INFO:tasks.rados.rados.0.smithi084.stdout:3612: finishing write tid 6 to smithi084102331-2 2024-01-13T18:12:46.896 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1860 (ObjNum 1113 snap 357 seq_num 1113) dirty exists 2024-01-13T18:12:46.896 INFO:tasks.rados.rados.0.smithi084.stdout:3612: left oid 2 (ObjNum 1113 snap 357 seq_num 1113) 2024-01-13T18:12:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:46 smithi099 ceph-mon[138788]: osdmap e782: 8 total, 8 up, 8 in 2024-01-13T18:12:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:46 smithi099 ceph-mon[138788]: pgmap v886: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 256 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 1.6 MiB/s wr, 18 op/s 2024-01-13T18:12:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:46 smithi084 ceph-mon[116404]: osdmap e782: 8 total, 8 up, 8 in 2024-01-13T18:12:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:46 smithi084 ceph-mon[116404]: pgmap v886: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 256 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 1.6 MiB/s wr, 18 op/s 2024-01-13T18:12:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:46 smithi084 ceph-mon[119097]: osdmap e782: 8 total, 8 up, 8 in 2024-01-13T18:12:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:46 smithi084 ceph-mon[119097]: pgmap v886: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 256 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 1.6 MiB/s wr, 18 op/s 2024-01-13T18:12:47.735 INFO:tasks.rados.rados.0.smithi084.stdout:3609: done (2 left) 2024-01-13T18:12:47.736 INFO:tasks.rados.rados.0.smithi084.stdout:3612: done (1 left) 2024-01-13T18:12:47.736 INFO:tasks.rados.rados.0.smithi084.stdout:3613: done (0 left) 2024-01-13T18:12:47.736 INFO:tasks.rados.rados.0.smithi084.stdout:3614: read oid 25 snap -1 2024-01-13T18:12:47.736 INFO:tasks.rados.rados.0.smithi084.stdout:3614: expect (ObjNum 1062 snap 338 seq_num 1062) 2024-01-13T18:12:47.736 INFO:tasks.rados.rados.0.smithi084.stdout:3615: rmattr oid 24 current snap is 358 2024-01-13T18:12:47.736 INFO:tasks.rados.rados.0.smithi084.stdout:3615: done (1 left) 2024-01-13T18:12:47.736 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 358 2024-01-13T18:12:47.736 INFO:tasks.rados.rados.0.smithi084.stdout:3616: seq_num 1114 ranges {5849088=663552,6512640=802816,7315456=401408} 2024-01-13T18:12:47.774 INFO:tasks.rados.rados.0.smithi084.stdout:3616: writing smithi084102331-40 from 5849088 to 6512640 tid 1 2024-01-13T18:12:47.779 INFO:tasks.rados.rados.0.smithi084.stdout:3616: writing smithi084102331-40 from 6512640 to 7315456 tid 2 2024-01-13T18:12:47.782 INFO:tasks.rados.rados.0.smithi084.stdout:3616: writing smithi084102331-40 from 7315456 to 7716864 tid 3 2024-01-13T18:12:47.782 INFO:tasks.rados.rados.0.smithi084.stdout:3617: read oid 23 snap -1 2024-01-13T18:12:47.782 INFO:tasks.rados.rados.0.smithi084.stdout:3617: expect (ObjNum 1107 snap 357 seq_num 1107) 2024-01-13T18:12:47.782 INFO:tasks.rados.rados.0.smithi084.stdout:3618: copy_from oid 11 from oid 37 current snap is 358 2024-01-13T18:12:47.782 INFO:tasks.rados.rados.0.smithi084.stdout:3614: expect (ObjNum 1062 snap 338 seq_num 1062) 2024-01-13T18:12:48.065 INFO:tasks.rados.rados.0.smithi084.stdout:3616: finishing write tid 1 to smithi084102331-40 2024-01-13T18:12:48.065 INFO:tasks.rados.rados.0.smithi084.stdout:3616: finishing write tid 2 to smithi084102331-40 2024-01-13T18:12:48.065 INFO:tasks.rados.rados.0.smithi084.stdout:3616: finishing write tid 3 to smithi084102331-40 2024-01-13T18:12:48.065 INFO:tasks.rados.rados.0.smithi084.stdout:3616: finishing write tid 4 to smithi084102331-40 2024-01-13T18:12:48.065 INFO:tasks.rados.rados.0.smithi084.stdout:3616: finishing write tid 5 to smithi084102331-40 2024-01-13T18:12:48.066 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1749 (ObjNum 1114 snap 358 seq_num 1114) dirty exists 2024-01-13T18:12:48.066 INFO:tasks.rados.rados.0.smithi084.stdout:3616: left oid 40 (ObjNum 1114 snap 358 seq_num 1114) 2024-01-13T18:12:48.066 INFO:tasks.rados.rados.0.smithi084.stdout:3618: finishing copy_from to smithi084102331-11 2024-01-13T18:12:48.066 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1674 (ObjNum 942 snap 298 seq_num 942) dirty exists 2024-01-13T18:12:48.066 INFO:tasks.rados.rados.0.smithi084.stdout:3618: finishing copy_from racing read to smithi084102331-11 2024-01-13T18:12:48.066 INFO:tasks.rados.rados.0.smithi084.stdout:3614: done (3 left) 2024-01-13T18:12:48.066 INFO:tasks.rados.rados.0.smithi084.stdout:3616: done (2 left) 2024-01-13T18:12:48.066 INFO:tasks.rados.rados.0.smithi084.stdout:3618: done (1 left) 2024-01-13T18:12:48.066 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 358 2024-01-13T18:12:48.066 INFO:tasks.rados.rados.0.smithi084.stdout:3617: expect (ObjNum 1107 snap 357 seq_num 1107) 2024-01-13T18:12:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:47 smithi099 ceph-mon[138788]: osdmap e783: 8 total, 8 up, 8 in 2024-01-13T18:12:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:47 smithi099 ceph-mon[138788]: osdmap e784: 8 total, 8 up, 8 in 2024-01-13T18:12:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:47 smithi084 ceph-mon[116404]: osdmap e783: 8 total, 8 up, 8 in 2024-01-13T18:12:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:47 smithi084 ceph-mon[116404]: osdmap e784: 8 total, 8 up, 8 in 2024-01-13T18:12:48.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:47 smithi084 ceph-mon[119097]: osdmap e783: 8 total, 8 up, 8 in 2024-01-13T18:12:48.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:47 smithi084 ceph-mon[119097]: osdmap e784: 8 total, 8 up, 8 in 2024-01-13T18:12:48.190 INFO:tasks.rados.rados.0.smithi084.stdout:3619: seq_num 1115 ranges {0=679936,679936=688128,1368064=516096} 2024-01-13T18:12:48.194 INFO:tasks.rados.rados.0.smithi084.stdout:3619: writing smithi084102331-4 from 0 to 679936 tid 1 2024-01-13T18:12:48.198 INFO:tasks.rados.rados.0.smithi084.stdout:3619: writing smithi084102331-4 from 679936 to 1368064 tid 2 2024-01-13T18:12:48.202 INFO:tasks.rados.rados.0.smithi084.stdout:3619: writing smithi084102331-4 from 1368064 to 1884160 tid 3 2024-01-13T18:12:48.202 INFO:tasks.rados.rados.0.smithi084.stdout:3617: done (1 left) 2024-01-13T18:12:48.202 INFO:tasks.rados.rados.0.smithi084.stdout:3620: copy_from oid 47 from oid 36 current snap is 358 2024-01-13T18:12:48.202 INFO:tasks.rados.rados.0.smithi084.stdout:3619: finishing write tid 1 to smithi084102331-4 2024-01-13T18:12:48.202 INFO:tasks.rados.rados.0.smithi084.stdout:3619: finishing write tid 2 to smithi084102331-4 2024-01-13T18:12:48.202 INFO:tasks.rados.rados.0.smithi084.stdout:3621: read oid 44 snap -1 2024-01-13T18:12:48.202 INFO:tasks.rados.rados.0.smithi084.stdout:3621: expect (ObjNum 1103 snap 354 seq_num 1103) 2024-01-13T18:12:48.202 INFO:tasks.rados.rados.0.smithi084.stdout:3622: rmattr oid 33 current snap is 358 2024-01-13T18:12:48.202 INFO:tasks.rados.rados.0.smithi084.stdout:3622: done (3 left) 2024-01-13T18:12:48.202 INFO:tasks.rados.rados.0.smithi084.stdout:3623: snap_create 2024-01-13T18:12:48.207 INFO:tasks.rados.rados.0.smithi084.stdout:3619: finishing write tid 3 to smithi084102331-4 2024-01-13T18:12:48.207 INFO:tasks.rados.rados.0.smithi084.stdout:3619: finishing write tid 4 to smithi084102331-4 2024-01-13T18:12:48.209 INFO:tasks.rados.rados.0.smithi084.stdout:3619: finishing write tid 5 to smithi084102331-4 2024-01-13T18:12:48.209 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 1663 (ObjNum 1115 snap 358 seq_num 1115) dirty exists 2024-01-13T18:12:48.209 INFO:tasks.rados.rados.0.smithi084.stdout:3619: left oid 4 (ObjNum 1115 snap 358 seq_num 1115) 2024-01-13T18:12:48.228 INFO:tasks.rados.rados.0.smithi084.stdout:3621: expect (ObjNum 1103 snap 354 seq_num 1103) 2024-01-13T18:12:48.540 INFO:tasks.rados.rados.0.smithi084.stdout:3620: finishing copy_from to smithi084102331-47 2024-01-13T18:12:48.540 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1670 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:12:48.540 INFO:tasks.rados.rados.0.smithi084.stdout:3620: finishing copy_from racing read to smithi084102331-47 2024-01-13T18:12:48.765 INFO:tasks.rados.rados.0.smithi084.stdout:3619: done (3 left) 2024-01-13T18:12:48.765 INFO:tasks.rados.rados.0.smithi084.stdout:3620: done (2 left) 2024-01-13T18:12:48.765 INFO:tasks.rados.rados.0.smithi084.stdout:3621: done (1 left) 2024-01-13T18:12:48.765 INFO:tasks.rados.rados.0.smithi084.stdout:3623: done (0 left) 2024-01-13T18:12:48.765 INFO:tasks.rados.rados.0.smithi084.stdout:3624: copy_from oid 10 from oid 36 current snap is 359 2024-01-13T18:12:48.765 INFO:tasks.rados.rados.0.smithi084.stdout:3625: read oid 26 snap -1 2024-01-13T18:12:48.765 INFO:tasks.rados.rados.0.smithi084.stdout:3625: expect deleted 2024-01-13T18:12:48.765 INFO:tasks.rados.rados.0.smithi084.stdout:3626: read oid 1 snap -1 2024-01-13T18:12:48.765 INFO:tasks.rados.rados.0.smithi084.stdout:3626: expect deleted 2024-01-13T18:12:48.765 INFO:tasks.rados.rados.0.smithi084.stdout:3627: copy_from oid 7 from oid 37 current snap is 359 2024-01-13T18:12:48.765 INFO:tasks.rados.rados.0.smithi084.stdout:3628: delete oid 3 current snap is 359 2024-01-13T18:12:48.771 INFO:tasks.rados.rados.0.smithi084.stdout:3625: done (4 left) 2024-01-13T18:12:48.771 INFO:tasks.rados.rados.0.smithi084.stdout:3626: done (3 left) 2024-01-13T18:12:48.771 INFO:tasks.rados.rados.0.smithi084.stdout:3628: done (2 left) 2024-01-13T18:12:48.771 INFO:tasks.rados.rados.0.smithi084.stdout:3629: snap_create 2024-01-13T18:12:48.778 INFO:tasks.rados.rados.0.smithi084.stdout:3627: finishing copy_from to smithi084102331-7 2024-01-13T18:12:48.778 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1674 (ObjNum 942 snap 298 seq_num 942) dirty exists 2024-01-13T18:12:48.779 INFO:tasks.rados.rados.0.smithi084.stdout:3627: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:12:48.797 INFO:tasks.rados.rados.0.smithi084.stdout:3624: finishing copy_from to smithi084102331-10 2024-01-13T18:12:48.797 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1670 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:12:48.798 INFO:tasks.rados.rados.0.smithi084.stdout:3624: finishing copy_from racing read to smithi084102331-10 2024-01-13T18:12:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:48 smithi099 ceph-mon[138788]: pgmap v889: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 257 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 1.2 MiB/s wr, 6 op/s 2024-01-13T18:12:49.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:48 smithi084 ceph-mon[116404]: pgmap v889: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 257 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 1.2 MiB/s wr, 6 op/s 2024-01-13T18:12:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:48 smithi084 ceph-mon[119097]: pgmap v889: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 257 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 1.2 MiB/s wr, 6 op/s 2024-01-13T18:12:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:3624: done (2 left) 2024-01-13T18:12:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:3627: done (1 left) 2024-01-13T18:12:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:3629: done (0 left) 2024-01-13T18:12:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:3630: read oid 47 snap 346 2024-01-13T18:12:49.772 INFO:tasks.rados.rados.0.smithi084.stdout:3630: expect (ObjNum -257385344 snap 21877 seq_num 4037260912) 2024-01-13T18:12:49.772 INFO:tasks.rados.rados.0.smithi084.stdout:3631: copy_from oid 43 from oid 38 current snap is 360 2024-01-13T18:12:49.772 INFO:tasks.rados.rados.0.smithi084.stdout:3632: read oid 2 snap -1 2024-01-13T18:12:49.772 INFO:tasks.rados.rados.0.smithi084.stdout:3632: expect (ObjNum 1113 snap 357 seq_num 1113) 2024-01-13T18:12:49.772 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 360 2024-01-13T18:12:49.772 INFO:tasks.rados.rados.0.smithi084.stdout:3633: seq_num 1117 ranges {0=712704,712704=458752,1171456=655360,1826816=90112} 2024-01-13T18:12:49.775 INFO:tasks.rados.rados.0.smithi084.stdout:3633: writing smithi084102331-1 from 0 to 712704 tid 1 2024-01-13T18:12:49.778 INFO:tasks.rados.rados.0.smithi084.stdout:3633: writing smithi084102331-1 from 712704 to 1171456 tid 2 2024-01-13T18:12:49.782 INFO:tasks.rados.rados.0.smithi084.stdout:3633: writing smithi084102331-1 from 1171456 to 1826816 tid 3 2024-01-13T18:12:49.782 INFO:tasks.rados.rados.0.smithi084.stdout:3633: writing smithi084102331-1 from 1826816 to 1916928 tid 4 2024-01-13T18:12:49.782 INFO:tasks.rados.rados.0.smithi084.stdout:3634: read oid 24 snap 354 2024-01-13T18:12:49.783 INFO:tasks.rados.rados.0.smithi084.stdout:3634: expect (ObjNum 1060 snap 338 seq_num 1060) 2024-01-13T18:12:49.783 INFO:tasks.rados.rados.0.smithi084.stdout:3635: delete oid 21 current snap is 360 2024-01-13T18:12:49.783 INFO:tasks.rados.rados.0.smithi084.stdout:3630: expect (ObjNum -257385344 snap 21877 seq_num 4037260912) 2024-01-13T18:12:49.786 INFO:tasks.rados.rados.0.smithi084.stdout:3633: finishing write tid 1 to smithi084102331-1 2024-01-13T18:12:49.786 INFO:tasks.rados.rados.0.smithi084.stdout:3633: finishing write tid 2 to smithi084102331-1 2024-01-13T18:12:49.788 INFO:tasks.rados.rados.0.smithi084.stdout:3633: finishing write tid 3 to smithi084102331-1 2024-01-13T18:12:49.789 INFO:tasks.rados.rados.0.smithi084.stdout:3630: done (5 left) 2024-01-13T18:12:49.790 INFO:tasks.rados.rados.0.smithi084.stdout:3635: done (4 left) 2024-01-13T18:12:49.790 INFO:tasks.rados.rados.0.smithi084.stdout:3636: snap_create 2024-01-13T18:12:49.790 INFO:tasks.rados.rados.0.smithi084.stdout:3633: finishing write tid 4 to smithi084102331-1 2024-01-13T18:12:49.791 INFO:tasks.rados.rados.0.smithi084.stdout:3633: finishing write tid 5 to smithi084102331-1 2024-01-13T18:12:49.799 INFO:tasks.rados.rados.0.smithi084.stdout:3633: finishing write tid 6 to smithi084102331-1 2024-01-13T18:12:49.799 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1768 (ObjNum 1117 snap 360 seq_num 1117) dirty exists 2024-01-13T18:12:49.799 INFO:tasks.rados.rados.0.smithi084.stdout:3633: left oid 1 (ObjNum 1117 snap 360 seq_num 1117) 2024-01-13T18:12:49.804 INFO:tasks.rados.rados.0.smithi084.stdout:3631: finishing copy_from to smithi084102331-43 2024-01-13T18:12:49.805 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1759 (ObjNum 969 snap 307 seq_num 969) dirty exists 2024-01-13T18:12:49.805 INFO:tasks.rados.rados.0.smithi084.stdout:3631: finishing copy_from racing read to smithi084102331-43 2024-01-13T18:12:49.807 INFO:tasks.rados.rados.0.smithi084.stdout:3634: expect (ObjNum 1060 snap 338 seq_num 1060) 2024-01-13T18:12:49.949 INFO:tasks.rados.rados.0.smithi084.stdout:3632: expect (ObjNum 1113 snap 357 seq_num 1113) 2024-01-13T18:12:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:49 smithi099 ceph-mon[138788]: osdmap e785: 8 total, 8 up, 8 in 2024-01-13T18:12:50.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:49 smithi084 ceph-mon[116404]: osdmap e785: 8 total, 8 up, 8 in 2024-01-13T18:12:50.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:49 smithi084 ceph-mon[119097]: osdmap e785: 8 total, 8 up, 8 in 2024-01-13T18:12:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:12:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:12:50] "GET /metrics HTTP/1.1" 200 36192 "" "Prometheus/2.43.0" 2024-01-13T18:12:50.777 INFO:tasks.rados.rados.0.smithi084.stdout:3631: done (4 left) 2024-01-13T18:12:50.777 INFO:tasks.rados.rados.0.smithi084.stdout:3632: done (3 left) 2024-01-13T18:12:50.777 INFO:tasks.rados.rados.0.smithi084.stdout:3633: done (2 left) 2024-01-13T18:12:50.777 INFO:tasks.rados.rados.0.smithi084.stdout:3634: done (1 left) 2024-01-13T18:12:50.777 INFO:tasks.rados.rados.0.smithi084.stdout:3636: done (0 left) 2024-01-13T18:12:50.777 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 361 2024-01-13T18:12:50.777 INFO:tasks.rados.rados.0.smithi084.stdout:3637: seq_num 1119 ranges {1466368=745472,2211840=679936,2891776=524288} 2024-01-13T18:12:50.788 INFO:tasks.rados.rados.0.smithi084.stdout:3637: writing smithi084102331-31 from 1466368 to 2211840 tid 1 2024-01-13T18:12:50.792 INFO:tasks.rados.rados.0.smithi084.stdout:3637: writing smithi084102331-31 from 2211840 to 2891776 tid 2 2024-01-13T18:12:50.796 INFO:tasks.rados.rados.0.smithi084.stdout:3637: writing smithi084102331-31 from 2891776 to 3416064 tid 3 2024-01-13T18:12:50.796 INFO:tasks.rados.rados.0.smithi084.stdout:3638: delete oid 30 current snap is 361 2024-01-13T18:12:50.796 INFO:tasks.rados.rados.0.smithi084.stdout:3637: finishing write tid 1 to smithi084102331-31 2024-01-13T18:12:50.799 INFO:tasks.rados.rados.0.smithi084.stdout:3638: done (1 left) 2024-01-13T18:12:50.799 INFO:tasks.rados.rados.0.smithi084.stdout:3639: delete oid 22 current snap is 361 2024-01-13T18:12:50.799 INFO:tasks.rados.rados.0.smithi084.stdout:3637: finishing write tid 2 to smithi084102331-31 2024-01-13T18:12:50.799 INFO:tasks.rados.rados.0.smithi084.stdout:3637: finishing write tid 3 to smithi084102331-31 2024-01-13T18:12:50.799 INFO:tasks.rados.rados.0.smithi084.stdout:3637: finishing write tid 4 to smithi084102331-31 2024-01-13T18:12:50.800 INFO:tasks.rados.rados.0.smithi084.stdout:3637: finishing write tid 5 to smithi084102331-31 2024-01-13T18:12:50.801 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 1773 (ObjNum 1119 snap 361 seq_num 1119) dirty exists 2024-01-13T18:12:50.801 INFO:tasks.rados.rados.0.smithi084.stdout:3637: left oid 31 (ObjNum 1119 snap 361 seq_num 1119) 2024-01-13T18:12:50.804 INFO:tasks.rados.rados.0.smithi084.stdout:3637: done (1 left) 2024-01-13T18:12:50.804 INFO:tasks.rados.rados.0.smithi084.stdout:3639: done (0 left) 2024-01-13T18:12:50.804 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 361 2024-01-13T18:12:50.804 INFO:tasks.rados.rados.0.smithi084.stdout:3640: seq_num 1122 ranges {6004736=794624,6799360=729088,7528448=475136} 2024-01-13T18:12:50.840 INFO:tasks.rados.rados.0.smithi084.stdout:3640: writing smithi084102331-44 from 6004736 to 6799360 tid 1 2024-01-13T18:12:50.844 INFO:tasks.rados.rados.0.smithi084.stdout:3640: writing smithi084102331-44 from 6799360 to 7528448 tid 2 2024-01-13T18:12:50.847 INFO:tasks.rados.rados.0.smithi084.stdout:3640: writing smithi084102331-44 from 7528448 to 8003584 tid 3 2024-01-13T18:12:50.847 INFO:tasks.rados.rados.0.smithi084.stdout:3641: snap_remove snap 346 2024-01-13T18:12:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:50 smithi099 ceph-mon[138788]: osdmap e786: 8 total, 8 up, 8 in 2024-01-13T18:12:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:50 smithi099 ceph-mon[138788]: pgmap v892: 121 pgs: 121 active+clean; 257 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.1 MiB/s rd, 420 KiB/s wr, 7 op/s 2024-01-13T18:12:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:50 smithi084 ceph-mon[116404]: osdmap e786: 8 total, 8 up, 8 in 2024-01-13T18:12:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:50 smithi084 ceph-mon[116404]: pgmap v892: 121 pgs: 121 active+clean; 257 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.1 MiB/s rd, 420 KiB/s wr, 7 op/s 2024-01-13T18:12:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:50 smithi084 ceph-mon[119097]: osdmap e786: 8 total, 8 up, 8 in 2024-01-13T18:12:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:12:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:50 smithi084 ceph-mon[119097]: pgmap v892: 121 pgs: 121 active+clean; 257 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 4.1 MiB/s rd, 420 KiB/s wr, 7 op/s 2024-01-13T18:12:51.785 INFO:tasks.rados.rados.0.smithi084.stdout:3641: done (1 left) 2024-01-13T18:12:51.785 INFO:tasks.rados.rados.0.smithi084.stdout:3642: snap_create 2024-01-13T18:12:51.786 INFO:tasks.rados.rados.0.smithi084.stdout:3640: finishing write tid 1 to smithi084102331-44 2024-01-13T18:12:51.786 INFO:tasks.rados.rados.0.smithi084.stdout:3640: finishing write tid 2 to smithi084102331-44 2024-01-13T18:12:51.786 INFO:tasks.rados.rados.0.smithi084.stdout:3640: finishing write tid 3 to smithi084102331-44 2024-01-13T18:12:51.786 INFO:tasks.rados.rados.0.smithi084.stdout:3640: finishing write tid 4 to smithi084102331-44 2024-01-13T18:12:51.786 INFO:tasks.rados.rados.0.smithi084.stdout:3640: finishing write tid 5 to smithi084102331-44 2024-01-13T18:12:51.786 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1795 (ObjNum 1122 snap 361 seq_num 1122) dirty exists 2024-01-13T18:12:51.786 INFO:tasks.rados.rados.0.smithi084.stdout:3640: left oid 44 (ObjNum 1122 snap 361 seq_num 1122) 2024-01-13T18:12:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:51 smithi099 ceph-mon[138788]: osdmap e787: 8 total, 8 up, 8 in 2024-01-13T18:12:52.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:51 smithi084 ceph-mon[119097]: osdmap e787: 8 total, 8 up, 8 in 2024-01-13T18:12:52.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:51 smithi084 ceph-mon[116404]: osdmap e787: 8 total, 8 up, 8 in 2024-01-13T18:12:52.739 INFO:tasks.rados.rados.0.smithi084.stdout:3640: done (1 left) 2024-01-13T18:12:52.739 INFO:tasks.rados.rados.0.smithi084.stdout:3642: done (0 left) 2024-01-13T18:12:52.739 INFO:tasks.rados.rados.0.smithi084.stdout:3643: rollback oid 21 current snap is 362 2024-01-13T18:12:52.739 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 354 2024-01-13T18:12:52.739 INFO:tasks.rados.rados.0.smithi084.stdout:3644: rollback oid 38 current snap is 362 2024-01-13T18:12:52.739 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 347 2024-01-13T18:12:52.739 INFO:tasks.rados.rados.0.smithi084.stdout:3645: snap_create 2024-01-13T18:12:52.742 INFO:tasks.rados.rados.0.smithi084.stdout:3643: finishing rollback tid 1 to smithi084102331-21 2024-01-13T18:12:52.742 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-01-13T18:12:52.747 INFO:tasks.rados.rados.0.smithi084.stdout:3644: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:12:52.747 INFO:tasks.rados.rados.0.smithi084.stdout:3644: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:12:52.747 INFO:tasks.rados.rados.0.smithi084.stdout:3644: finishing rollback tid 2 to smithi084102331-38 2024-01-13T18:12:52.747 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1783 (ObjNum 969 snap 307 seq_num 969) dirty exists 2024-01-13T18:12:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:52 smithi099 ceph-mon[138788]: osdmap e788: 8 total, 8 up, 8 in 2024-01-13T18:12:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:52 smithi099 ceph-mon[138788]: pgmap v895: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 282 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-01-13T18:12:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:52 smithi099 ceph-mon[138788]: osdmap e789: 8 total, 8 up, 8 in 2024-01-13T18:12:53.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:52 smithi084 ceph-mon[116404]: osdmap e788: 8 total, 8 up, 8 in 2024-01-13T18:12:53.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:52 smithi084 ceph-mon[116404]: pgmap v895: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 282 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-01-13T18:12:53.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:52 smithi084 ceph-mon[116404]: osdmap e789: 8 total, 8 up, 8 in 2024-01-13T18:12:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:52 smithi084 ceph-mon[119097]: osdmap e788: 8 total, 8 up, 8 in 2024-01-13T18:12:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:52 smithi084 ceph-mon[119097]: pgmap v895: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 282 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-01-13T18:12:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:52 smithi084 ceph-mon[119097]: osdmap e789: 8 total, 8 up, 8 in 2024-01-13T18:12:53.738 INFO:tasks.rados.rados.0.smithi084.stdout:3643: done (2 left) 2024-01-13T18:12:53.738 INFO:tasks.rados.rados.0.smithi084.stdout:3644: done (1 left) 2024-01-13T18:12:53.738 INFO:tasks.rados.rados.0.smithi084.stdout:3645: done (0 left) 2024-01-13T18:12:53.738 INFO:tasks.rados.rados.0.smithi084.stdout:3646: read oid 9 snap 350 2024-01-13T18:12:53.738 INFO:tasks.rados.rados.0.smithi084.stdout:3646: expect (ObjNum 1041 snap 330 seq_num 1041) 2024-01-13T18:12:53.739 INFO:tasks.rados.rados.0.smithi084.stdout:3647: delete oid 37 current snap is 363 2024-01-13T18:12:53.743 INFO:tasks.rados.rados.0.smithi084.stdout:3646: expect (ObjNum 1041 snap 330 seq_num 1041) 2024-01-13T18:12:53.763 INFO:tasks.rados.rados.0.smithi084.stdout:3646: done (1 left) 2024-01-13T18:12:53.763 INFO:tasks.rados.rados.0.smithi084.stdout:3647: done (0 left) 2024-01-13T18:12:53.763 INFO:tasks.rados.rados.0.smithi084.stdout:3648: rollback oid 10 current snap is 363 2024-01-13T18:12:53.763 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 362 2024-01-13T18:12:53.763 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 363 2024-01-13T18:12:53.763 INFO:tasks.rados.rados.0.smithi084.stdout:3649: seq_num 1124 ranges {1916928=434176,2351104=499712,2850816=409600,3260416=663552,3923968=32768} 2024-01-13T18:12:53.776 INFO:tasks.rados.rados.0.smithi084.stdout:3649: writing smithi084102331-1 from 1916928 to 2351104 tid 1 2024-01-13T18:12:53.779 INFO:tasks.rados.rados.0.smithi084.stdout:3649: writing smithi084102331-1 from 2351104 to 2850816 tid 2 2024-01-13T18:12:53.782 INFO:tasks.rados.rados.0.smithi084.stdout:3649: writing smithi084102331-1 from 2850816 to 3260416 tid 3 2024-01-13T18:12:53.786 INFO:tasks.rados.rados.0.smithi084.stdout:3649: writing smithi084102331-1 from 3260416 to 3923968 tid 4 2024-01-13T18:12:53.786 INFO:tasks.rados.rados.0.smithi084.stdout:3649: writing smithi084102331-1 from 3923968 to 3956736 tid 5 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:3650: rmattr oid 15 current snap is 363 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:3650: done (2 left) 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:3651: copy_from oid 35 from oid 3 current snap is 363 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:3648: finishing rollback tid 0 to smithi084102331-10 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:3648: finishing rollback tid 1 to smithi084102331-10 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:3648: finishing rollback tid 2 to smithi084102331-10 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1673 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:3649: finishing write tid 1 to smithi084102331-1 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:3649: finishing write tid 2 to smithi084102331-1 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:3649: finishing write tid 3 to smithi084102331-1 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:3648: done (2 left) 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 363 2024-01-13T18:12:53.787 INFO:tasks.rados.rados.0.smithi084.stdout:3652: seq_num 1125 ranges {1646592=450560,2097152=786432,2883584=614400,3497984=204800} 2024-01-13T18:12:53.797 INFO:tasks.rados.rados.0.smithi084.stdout:3652: writing smithi084102331-20 from 1646592 to 2097152 tid 1 2024-01-13T18:12:53.802 INFO:tasks.rados.rados.0.smithi084.stdout:3652: writing smithi084102331-20 from 2097152 to 2883584 tid 2 2024-01-13T18:12:53.805 INFO:tasks.rados.rados.0.smithi084.stdout:3652: writing smithi084102331-20 from 2883584 to 3497984 tid 3 2024-01-13T18:12:53.807 INFO:tasks.rados.rados.0.smithi084.stdout:3652: writing smithi084102331-20 from 3497984 to 3702784 tid 4 2024-01-13T18:12:53.807 INFO:tasks.rados.rados.0.smithi084.stdout:3653: read oid 30 snap -1 2024-01-13T18:12:53.807 INFO:tasks.rados.rados.0.smithi084.stdout:3653: expect deleted 2024-01-13T18:12:53.807 INFO:tasks.rados.rados.0.smithi084.stdout:3654: rmattr oid 16 current snap is 363 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:3654: done (4 left) 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 363 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:3649: finishing write tid 4 to smithi084102331-1 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:3649: finishing write tid 5 to smithi084102331-1 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:3649: finishing write tid 6 to smithi084102331-1 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:3651: finishing copy_from to smithi084102331-35 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:3651: got expected ENOENT (src dne) 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:3649: finishing write tid 7 to smithi084102331-1 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1790 (ObjNum 1124 snap 363 seq_num 1124) dirty exists 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:3649: left oid 1 (ObjNum 1124 snap 363 seq_num 1124) 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:3651: finishing copy_from racing read to smithi084102331-35 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:3652: finishing write tid 1 to smithi084102331-20 2024-01-13T18:12:53.808 INFO:tasks.rados.rados.0.smithi084.stdout:3655: seq_num 1126 ranges {0=466944,466944=720896,1187840=778240,1966080=106496} 2024-01-13T18:12:53.809 INFO:tasks.rados.rados.0.smithi084.stdout:3655: writing smithi084102331-42 from 0 to 466944 tid 1 2024-01-13T18:12:53.814 INFO:tasks.rados.rados.0.smithi084.stdout:3655: writing smithi084102331-42 from 466944 to 1187840 tid 2 2024-01-13T18:12:53.818 INFO:tasks.rados.rados.0.smithi084.stdout:3655: writing smithi084102331-42 from 1187840 to 1966080 tid 3 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3655: writing smithi084102331-42 from 1966080 to 2072576 tid 4 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3649: done (4 left) 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3651: done (3 left) 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3656: rmattr oid 2 current snap is 363 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3652: finishing write tid 2 to smithi084102331-20 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3652: finishing write tid 3 to smithi084102331-20 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3652: finishing write tid 4 to smithi084102331-20 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3652: finishing write tid 5 to smithi084102331-20 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3652: finishing write tid 6 to smithi084102331-20 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1641 (ObjNum 1125 snap 363 seq_num 1125) dirty exists 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3652: left oid 20 (ObjNum 1125 snap 363 seq_num 1125) 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3655: finishing write tid 1 to smithi084102331-42 2024-01-13T18:12:53.820 INFO:tasks.rados.rados.0.smithi084.stdout:3655: finishing write tid 2 to smithi084102331-42 2024-01-13T18:12:53.821 INFO:tasks.rados.rados.0.smithi084.stdout:3652: done (3 left) 2024-01-13T18:12:53.821 INFO:tasks.rados.rados.0.smithi084.stdout:3653: done (2 left) 2024-01-13T18:12:53.821 INFO:tasks.rados.rados.0.smithi084.stdout:3657: snap_create 2024-01-13T18:12:53.822 INFO:tasks.rados.rados.0.smithi084.stdout:3655: finishing write tid 3 to smithi084102331-42 2024-01-13T18:12:53.822 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1870 (ObjNum 1113 snap 357 seq_num 1113) dirty exists 2024-01-13T18:12:53.823 INFO:tasks.rados.rados.0.smithi084.stdout:3655: finishing write tid 4 to smithi084102331-42 2024-01-13T18:12:53.823 INFO:tasks.rados.rados.0.smithi084.stdout:3655: finishing write tid 5 to smithi084102331-42 2024-01-13T18:12:53.826 INFO:tasks.rados.rados.0.smithi084.stdout:3655: finishing write tid 6 to smithi084102331-42 2024-01-13T18:12:53.826 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1507 (ObjNum 1126 snap 363 seq_num 1126) dirty exists 2024-01-13T18:12:53.826 INFO:tasks.rados.rados.0.smithi084.stdout:3655: left oid 42 (ObjNum 1126 snap 363 seq_num 1126) 2024-01-13T18:12:54.744 INFO:tasks.rados.rados.0.smithi084.stdout:3655: done (2 left) 2024-01-13T18:12:54.744 INFO:tasks.rados.rados.0.smithi084.stdout:3656: done (1 left) 2024-01-13T18:12:54.744 INFO:tasks.rados.rados.0.smithi084.stdout:3657: done (0 left) 2024-01-13T18:12:54.744 INFO:tasks.rados.rados.0.smithi084.stdout:3658: rmattr oid 16 current snap is 364 2024-01-13T18:12:54.744 INFO:tasks.rados.rados.0.smithi084.stdout:3658: done (0 left) 2024-01-13T18:12:54.744 INFO:tasks.rados.rados.0.smithi084.stdout:3659: read oid 23 snap 356 2024-01-13T18:12:54.744 INFO:tasks.rados.rados.0.smithi084.stdout:3659: expect (ObjNum 1064 snap 338 seq_num 1064) 2024-01-13T18:12:54.744 INFO:tasks.rados.rados.0.smithi084.stdout:3660: delete oid 47 current snap is 364 2024-01-13T18:12:54.751 INFO:tasks.rados.rados.0.smithi084.stdout:3660: done (1 left) 2024-01-13T18:12:54.751 INFO:tasks.rados.rados.0.smithi084.stdout:3661: setattr oid 10 current snap is 364 2024-01-13T18:12:54.752 INFO:tasks.rados.rados.0.smithi084.stdout:3662: rollback oid 18 current snap is 364 2024-01-13T18:12:54.753 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 349 2024-01-13T18:12:54.753 INFO:tasks.rados.rados.0.smithi084.stdout:3663: snap_create 2024-01-13T18:12:54.760 INFO:tasks.rados.rados.0.smithi084.stdout:3659: expect (ObjNum 1064 snap 338 seq_num 1064) 2024-01-13T18:12:54.818 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1674 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:12:54.818 INFO:tasks.rados.rados.0.smithi084.stdout:3662: finishing rollback tid 0 to smithi084102331-18 2024-01-13T18:12:54.818 INFO:tasks.rados.rados.0.smithi084.stdout:3662: finishing rollback tid 1 to smithi084102331-18 2024-01-13T18:12:54.818 INFO:tasks.rados.rados.0.smithi084.stdout:3662: finishing rollback tid 2 to smithi084102331-18 2024-01-13T18:12:54.818 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1677 (ObjNum 1063 snap 338 seq_num 1063) dirty exists 2024-01-13T18:12:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:54 smithi099 ceph-mon[138788]: osdmap e790: 8 total, 8 up, 8 in 2024-01-13T18:12:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:54 smithi099 ceph-mon[138788]: pgmap v898: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 301 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 11 MiB/s wr, 23 op/s 2024-01-13T18:12:55.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:54 smithi084 ceph-mon[116404]: osdmap e790: 8 total, 8 up, 8 in 2024-01-13T18:12:55.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:54 smithi084 ceph-mon[116404]: pgmap v898: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 301 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 11 MiB/s wr, 23 op/s 2024-01-13T18:12:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:54 smithi084 ceph-mon[119097]: osdmap e790: 8 total, 8 up, 8 in 2024-01-13T18:12:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:54 smithi084 ceph-mon[119097]: pgmap v898: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 301 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 11 MiB/s wr, 23 op/s 2024-01-13T18:12:55.744 INFO:tasks.rados.rados.0.smithi084.stdout:3659: done (3 left) 2024-01-13T18:12:55.744 INFO:tasks.rados.rados.0.smithi084.stdout:3661: done (2 left) 2024-01-13T18:12:55.744 INFO:tasks.rados.rados.0.smithi084.stdout:3662: done (1 left) 2024-01-13T18:12:55.744 INFO:tasks.rados.rados.0.smithi084.stdout:3663: done (0 left) 2024-01-13T18:12:55.744 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 365 2024-01-13T18:12:55.744 INFO:tasks.rados.rados.0.smithi084.stdout:3664: seq_num 1128 ranges {3522560=499712,4022272=483328,4505600=786432,5292032=335872} 2024-01-13T18:12:55.765 INFO:tasks.rados.rados.0.smithi084.stdout:3664: writing smithi084102331-23 from 3522560 to 4022272 tid 1 2024-01-13T18:12:55.768 INFO:tasks.rados.rados.0.smithi084.stdout:3664: writing smithi084102331-23 from 4022272 to 4505600 tid 2 2024-01-13T18:12:55.772 INFO:tasks.rados.rados.0.smithi084.stdout:3664: writing smithi084102331-23 from 4505600 to 5292032 tid 3 2024-01-13T18:12:55.774 INFO:tasks.rados.rados.0.smithi084.stdout:3664: writing smithi084102331-23 from 5292032 to 5627904 tid 4 2024-01-13T18:12:55.774 INFO:tasks.rados.rados.0.smithi084.stdout:3665: delete oid 13 current snap is 365 2024-01-13T18:12:55.776 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 1 to smithi084102331-23 2024-01-13T18:12:55.778 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 2 to smithi084102331-23 2024-01-13T18:12:55.779 INFO:tasks.rados.rados.0.smithi084.stdout:3665: done (1 left) 2024-01-13T18:12:55.779 INFO:tasks.rados.rados.0.smithi084.stdout:3666: copy_from oid 14 from oid 37 current snap is 365 2024-01-13T18:12:55.779 INFO:tasks.rados.rados.0.smithi084.stdout:3667: snap_remove snap 358 2024-01-13T18:12:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:55 smithi099 ceph-mon[138788]: osdmap e791: 8 total, 8 up, 8 in 2024-01-13T18:12:56.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:55 smithi084 ceph-mon[116404]: osdmap e791: 8 total, 8 up, 8 in 2024-01-13T18:12:56.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:55 smithi084 ceph-mon[119097]: osdmap e791: 8 total, 8 up, 8 in 2024-01-13T18:12:56.757 INFO:tasks.rados.rados.0.smithi084.stdout:3667: done (2 left) 2024-01-13T18:12:56.758 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 365 2024-01-13T18:12:56.758 INFO:tasks.rados.rados.0.smithi084.stdout:3666: finishing copy_from to smithi084102331-14 2024-01-13T18:12:56.758 INFO:tasks.rados.rados.0.smithi084.stdout:3666: got expected ENOENT (src dne) 2024-01-13T18:12:56.758 INFO:tasks.rados.rados.0.smithi084.stdout:3668: seq_num 1130 ranges {5505024=532480,6037504=655360,6692864=753664,7446528=196608} 2024-01-13T18:12:56.791 INFO:tasks.rados.rados.0.smithi084.stdout:3668: writing smithi084102331-19 from 5505024 to 6037504 tid 1 2024-01-13T18:12:56.794 INFO:tasks.rados.rados.0.smithi084.stdout:3668: writing smithi084102331-19 from 6037504 to 6692864 tid 2 2024-01-13T18:12:56.799 INFO:tasks.rados.rados.0.smithi084.stdout:3668: writing smithi084102331-19 from 6692864 to 7446528 tid 3 2024-01-13T18:12:56.800 INFO:tasks.rados.rados.0.smithi084.stdout:3668: writing smithi084102331-19 from 7446528 to 7643136 tid 4 2024-01-13T18:12:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:3669: snap_create 2024-01-13T18:12:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:3666: finishing copy_from racing read to smithi084102331-14 2024-01-13T18:12:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 3 to smithi084102331-23 2024-01-13T18:12:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 4 to smithi084102331-23 2024-01-13T18:12:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 5 to smithi084102331-23 2024-01-13T18:12:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 6 to smithi084102331-23 2024-01-13T18:12:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1876 (ObjNum 1128 snap 365 seq_num 1128) dirty exists 2024-01-13T18:12:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:3664: left oid 23 (ObjNum 1128 snap 365 seq_num 1128) 2024-01-13T18:12:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:3668: finishing write tid 1 to smithi084102331-19 2024-01-13T18:12:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:3668: finishing write tid 2 to smithi084102331-19 2024-01-13T18:12:56.803 INFO:tasks.rados.rados.0.smithi084.stdout:3668: finishing write tid 3 to smithi084102331-19 2024-01-13T18:12:56.803 INFO:tasks.rados.rados.0.smithi084.stdout:3668: finishing write tid 4 to smithi084102331-19 2024-01-13T18:12:56.804 INFO:tasks.rados.rados.0.smithi084.stdout:3668: finishing write tid 5 to smithi084102331-19 2024-01-13T18:12:56.805 INFO:tasks.rados.rados.0.smithi084.stdout:3668: finishing write tid 6 to smithi084102331-19 2024-01-13T18:12:56.805 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 1646 (ObjNum 1130 snap 365 seq_num 1130) dirty exists 2024-01-13T18:12:56.805 INFO:tasks.rados.rados.0.smithi084.stdout:3668: left oid 19 (ObjNum 1130 snap 365 seq_num 1130) 2024-01-13T18:12:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:56 smithi099 ceph-mon[138788]: osdmap e792: 8 total, 8 up, 8 in 2024-01-13T18:12:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:56 smithi099 ceph-mon[138788]: pgmap v901: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 301 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 5 op/s 2024-01-13T18:12:57.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:56 smithi084 ceph-mon[116404]: osdmap e792: 8 total, 8 up, 8 in 2024-01-13T18:12:57.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:56 smithi084 ceph-mon[116404]: pgmap v901: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 301 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 5 op/s 2024-01-13T18:12:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:56 smithi084 ceph-mon[119097]: osdmap e792: 8 total, 8 up, 8 in 2024-01-13T18:12:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:56 smithi084 ceph-mon[119097]: pgmap v901: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 301 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 5 op/s 2024-01-13T18:12:57.739 INFO:tasks.rados.rados.0.smithi084.stdout:3664: done (3 left) 2024-01-13T18:12:57.739 INFO:tasks.rados.rados.0.smithi084.stdout:3666: done (2 left) 2024-01-13T18:12:57.739 INFO:tasks.rados.rados.0.smithi084.stdout:3668: done (1 left) 2024-01-13T18:12:57.739 INFO:tasks.rados.rados.0.smithi084.stdout:3669: done (0 left) 2024-01-13T18:12:57.739 INFO:tasks.rados.rados.0.smithi084.stdout:3670: copy_from oid 7 from oid 49 current snap is 366 2024-01-13T18:12:57.739 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 366 2024-01-13T18:12:57.739 INFO:tasks.rados.rados.0.smithi084.stdout:3671: seq_num 1131 ranges {0=548864,548864=540672,1089536=565248,1654784=425984,2080768=73728} 2024-01-13T18:12:57.742 INFO:tasks.rados.rados.0.smithi084.stdout:3671: writing smithi084102331-37 from 0 to 548864 tid 1 2024-01-13T18:12:57.745 INFO:tasks.rados.rados.0.smithi084.stdout:3671: writing smithi084102331-37 from 548864 to 1089536 tid 2 2024-01-13T18:12:57.749 INFO:tasks.rados.rados.0.smithi084.stdout:3671: writing smithi084102331-37 from 1089536 to 1654784 tid 3 2024-01-13T18:12:57.751 INFO:tasks.rados.rados.0.smithi084.stdout:3671: writing smithi084102331-37 from 1654784 to 2080768 tid 4 2024-01-13T18:12:57.752 INFO:tasks.rados.rados.0.smithi084.stdout:3671: writing smithi084102331-37 from 2080768 to 2154496 tid 5 2024-01-13T18:12:57.752 INFO:tasks.rados.rados.0.smithi084.stdout:3672: copy_from oid 5 from oid 6 current snap is 366 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:3670: finishing copy_from to smithi084102331-7 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:3670: got expected ENOENT (src dne) 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:3670: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:3671: finishing write tid 1 to smithi084102331-37 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:3671: finishing write tid 2 to smithi084102331-37 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:3670: done (2 left) 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:3673: rollback oid 46 current snap is 366 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 364 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:3674: rollback oid 33 current snap is 366 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 33 to 355 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:3675: copy_from oid 34 from oid 48 current snap is 366 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 366 2024-01-13T18:12:57.753 INFO:tasks.rados.rados.0.smithi084.stdout:3676: seq_num 1132 ranges {0=565248,565248=425984,991232=770048,1761280=409600} 2024-01-13T18:12:57.755 INFO:tasks.rados.rados.0.smithi084.stdout:3676: writing smithi084102331-26 from 0 to 565248 tid 1 2024-01-13T18:12:57.758 INFO:tasks.rados.rados.0.smithi084.stdout:3676: writing smithi084102331-26 from 565248 to 991232 tid 2 2024-01-13T18:12:57.766 INFO:tasks.rados.rados.0.smithi084.stdout:3676: writing smithi084102331-26 from 991232 to 1761280 tid 3 2024-01-13T18:12:57.766 INFO:tasks.rados.rados.0.smithi084.stdout:3676: writing smithi084102331-26 from 1761280 to 2170880 tid 4 2024-01-13T18:12:57.766 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 366 2024-01-13T18:12:57.767 INFO:tasks.rados.rados.0.smithi084.stdout:3675: finishing copy_from to smithi084102331-34 2024-01-13T18:12:57.767 INFO:tasks.rados.rados.0.smithi084.stdout:3675: got expected ENOENT (src dne) 2024-01-13T18:12:57.767 INFO:tasks.rados.rados.0.smithi084.stdout:3675: finishing copy_from racing read to smithi084102331-34 2024-01-13T18:12:57.767 INFO:tasks.rados.rados.0.smithi084.stdout:3671: finishing write tid 3 to smithi084102331-37 2024-01-13T18:12:57.767 INFO:tasks.rados.rados.0.smithi084.stdout:3673: finishing rollback tid 0 to smithi084102331-46 2024-01-13T18:12:57.767 INFO:tasks.rados.rados.0.smithi084.stdout:3671: finishing write tid 4 to smithi084102331-37 2024-01-13T18:12:57.767 INFO:tasks.rados.rados.0.smithi084.stdout:3671: finishing write tid 5 to smithi084102331-37 2024-01-13T18:12:57.767 INFO:tasks.rados.rados.0.smithi084.stdout:3671: finishing write tid 6 to smithi084102331-37 2024-01-13T18:12:57.767 INFO:tasks.rados.rados.0.smithi084.stdout:3677: seq_num 1133 ranges {3276800=581632,3858432=753664,4612096=573440,5185536=278528} 2024-01-13T18:12:57.788 INFO:tasks.rados.rados.0.smithi084.stdout:3677: writing smithi084102331-43 from 3276800 to 3858432 tid 1 2024-01-13T18:12:57.792 INFO:tasks.rados.rados.0.smithi084.stdout:3677: writing smithi084102331-43 from 3858432 to 4612096 tid 2 2024-01-13T18:12:57.796 INFO:tasks.rados.rados.0.smithi084.stdout:3677: writing smithi084102331-43 from 4612096 to 5185536 tid 3 2024-01-13T18:12:57.797 INFO:tasks.rados.rados.0.smithi084.stdout:3677: writing smithi084102331-43 from 5185536 to 5464064 tid 4 2024-01-13T18:12:57.798 INFO:tasks.rados.rados.0.smithi084.stdout:3675: done (6 left) 2024-01-13T18:12:57.798 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 366 2024-01-13T18:12:57.798 INFO:tasks.rados.rados.0.smithi084.stdout:3674: finishing rollback tid 0 to smithi084102331-33 2024-01-13T18:12:57.798 INFO:tasks.rados.rados.0.smithi084.stdout:3678: seq_num 1134 ranges {3211264=598016,3809280=638976,4448256=737280,5185536=229376} 2024-01-13T18:12:57.819 INFO:tasks.rados.rados.0.smithi084.stdout:3678: writing smithi084102331-24 from 3211264 to 3809280 tid 1 2024-01-13T18:12:57.822 INFO:tasks.rados.rados.0.smithi084.stdout:3678: writing smithi084102331-24 from 3809280 to 4448256 tid 2 2024-01-13T18:12:57.826 INFO:tasks.rados.rados.0.smithi084.stdout:3678: writing smithi084102331-24 from 4448256 to 5185536 tid 3 2024-01-13T18:12:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:3678: writing smithi084102331-24 from 5185536 to 5414912 tid 4 2024-01-13T18:12:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 366 2024-01-13T18:12:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:3676: finishing write tid 1 to smithi084102331-26 2024-01-13T18:12:57.828 INFO:tasks.rados.rados.0.smithi084.stdout:3679: seq_num 1135 ranges {2326528=614400,2940928=524288,3465216=540672,4005888=483328,4489216=57344} 2024-01-13T18:12:57.843 INFO:tasks.rados.rados.0.smithi084.stdout:3679: writing smithi084102331-9 from 2326528 to 2940928 tid 1 2024-01-13T18:12:57.846 INFO:tasks.rados.rados.0.smithi084.stdout:3679: writing smithi084102331-9 from 2940928 to 3465216 tid 2 2024-01-13T18:12:57.850 INFO:tasks.rados.rados.0.smithi084.stdout:3679: writing smithi084102331-9 from 3465216 to 4005888 tid 3 2024-01-13T18:12:57.852 INFO:tasks.rados.rados.0.smithi084.stdout:3679: writing smithi084102331-9 from 4005888 to 4489216 tid 4 2024-01-13T18:12:57.853 INFO:tasks.rados.rados.0.smithi084.stdout:3679: writing smithi084102331-9 from 4489216 to 4546560 tid 5 2024-01-13T18:12:57.853 INFO:tasks.rados.rados.0.smithi084.stdout:3680: read oid 3 snap -1 2024-01-13T18:12:57.853 INFO:tasks.rados.rados.0.smithi084.stdout:3680: expect deleted 2024-01-13T18:12:57.853 INFO:tasks.rados.rados.0.smithi084.stdout:3681: copy_from oid 35 from oid 16 current snap is 366 2024-01-13T18:12:57.853 INFO:tasks.rados.rados.0.smithi084.stdout:3671: finishing write tid 7 to smithi084102331-37 2024-01-13T18:12:57.854 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1746 (ObjNum 1131 snap 366 seq_num 1131) dirty exists 2024-01-13T18:12:57.854 INFO:tasks.rados.rados.0.smithi084.stdout:3671: left oid 37 (ObjNum 1131 snap 366 seq_num 1131) 2024-01-13T18:12:57.854 INFO:tasks.rados.rados.0.smithi084.stdout:3674: finishing rollback tid 1 to smithi084102331-33 2024-01-13T18:12:57.854 INFO:tasks.rados.rados.0.smithi084.stdout:3671: done (9 left) 2024-01-13T18:12:57.854 INFO:tasks.rados.rados.0.smithi084.stdout:3682: snap_remove snap 359 2024-01-13T18:12:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:57 smithi099 ceph-mon[138788]: osdmap e793: 8 total, 8 up, 8 in 2024-01-13T18:12:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:57 smithi099 ceph-mon[138788]: osdmap e794: 8 total, 8 up, 8 in 2024-01-13T18:12:58.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:57 smithi084 ceph-mon[119097]: osdmap e793: 8 total, 8 up, 8 in 2024-01-13T18:12:58.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:57 smithi084 ceph-mon[119097]: osdmap e794: 8 total, 8 up, 8 in 2024-01-13T18:12:58.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:57 smithi084 ceph-mon[116404]: osdmap e793: 8 total, 8 up, 8 in 2024-01-13T18:12:58.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:57 smithi084 ceph-mon[116404]: osdmap e794: 8 total, 8 up, 8 in 2024-01-13T18:12:58.768 INFO:tasks.rados.rados.0.smithi084.stdout:3682: done (9 left) 2024-01-13T18:12:58.768 INFO:tasks.rados.rados.0.smithi084.stdout:3683: copy_from oid 44 from oid 29 current snap is 366 2024-01-13T18:12:58.768 INFO:tasks.rados.rados.0.smithi084.stdout:3684: rollback oid 18 current snap is 366 2024-01-13T18:12:58.768 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 365 2024-01-13T18:12:58.769 INFO:tasks.rados.rados.0.smithi084.stdout:3685: copy_from oid 23 from oid 10 current snap is 366 2024-01-13T18:12:58.769 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 366 2024-01-13T18:12:58.769 INFO:tasks.rados.rados.0.smithi084.stdout:3686: seq_num 1136 ranges {7716864=630784,8347648=409600,8757248=753664,9510912=417792,9928704=24576} 2024-01-13T18:12:58.815 INFO:tasks.rados.rados.0.smithi084.stdout:3686: writing smithi084102331-45 from 7716864 to 8347648 tid 1 2024-01-13T18:12:58.817 INFO:tasks.rados.rados.0.smithi084.stdout:3686: writing smithi084102331-45 from 8347648 to 8757248 tid 2 2024-01-13T18:12:58.821 INFO:tasks.rados.rados.0.smithi084.stdout:3686: writing smithi084102331-45 from 8757248 to 9510912 tid 3 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:3686: writing smithi084102331-45 from 9510912 to 9928704 tid 4 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:3686: writing smithi084102331-45 from 9928704 to 9953280 tid 5 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:3687: copy_from oid 1 from oid 39 current snap is 366 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:3674: finishing rollback tid 2 to smithi084102331-33 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1749 (ObjNum 1046 snap 331 seq_num 1046) dirty exists 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:3673: finishing rollback tid 1 to smithi084102331-46 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:3673: finishing rollback tid 2 to smithi084102331-46 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1781 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:3676: finishing write tid 2 to smithi084102331-26 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:3673: done (13 left) 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:3674: done (12 left) 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:3688: rollback oid 11 current snap is 366 2024-01-13T18:12:58.826 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 11 to 363 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:3676: finishing write tid 3 to smithi084102331-26 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:3676: finishing write tid 4 to smithi084102331-26 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:3676: finishing write tid 5 to smithi084102331-26 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:3676: finishing write tid 6 to smithi084102331-26 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1681 (ObjNum 1132 snap 366 seq_num 1132) dirty exists 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:3676: left oid 26 (ObjNum 1132 snap 366 seq_num 1132) 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:3672: finishing copy_from to smithi084102331-5 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 1780 (ObjNum 1110 snap 357 seq_num 1110) dirty exists 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:3672: finishing copy_from racing read to smithi084102331-5 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:3677: finishing write tid 1 to smithi084102331-43 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:3677: finishing write tid 2 to smithi084102331-43 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:3677: finishing write tid 3 to smithi084102331-43 2024-01-13T18:12:58.827 INFO:tasks.rados.rados.0.smithi084.stdout:3677: finishing write tid 4 to smithi084102331-43 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3672: done (12 left) 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3676: done (11 left) 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3689: snap_create 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3677: finishing write tid 5 to smithi084102331-43 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3677: finishing write tid 6 to smithi084102331-43 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1764 (ObjNum 1133 snap 366 seq_num 1133) dirty exists 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3677: left oid 43 (ObjNum 1133 snap 366 seq_num 1133) 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3678: finishing write tid 1 to smithi084102331-24 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3678: finishing write tid 2 to smithi084102331-24 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3678: finishing write tid 3 to smithi084102331-24 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3678: finishing write tid 4 to smithi084102331-24 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3678: finishing write tid 5 to smithi084102331-24 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3678: finishing write tid 6 to smithi084102331-24 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1769 (ObjNum 1134 snap 366 seq_num 1134) dirty exists 2024-01-13T18:12:58.828 INFO:tasks.rados.rados.0.smithi084.stdout:3678: left oid 24 (ObjNum 1134 snap 366 seq_num 1134) 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3679: finishing write tid 1 to smithi084102331-9 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3679: finishing write tid 2 to smithi084102331-9 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3679: finishing write tid 3 to smithi084102331-9 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3679: finishing write tid 4 to smithi084102331-9 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3679: finishing write tid 5 to smithi084102331-9 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3679: finishing write tid 6 to smithi084102331-9 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3679: finishing write tid 7 to smithi084102331-9 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1786 (ObjNum 1135 snap 366 seq_num 1135) dirty exists 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3679: left oid 9 (ObjNum 1135 snap 366 seq_num 1135) 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3681: finishing copy_from to smithi084102331-35 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1626 (ObjNum 1088 snap 348 seq_num 1088) dirty exists 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3681: finishing copy_from racing read to smithi084102331-35 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3684: finishing rollback tid 0 to smithi084102331-18 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3684: finishing rollback tid 1 to smithi084102331-18 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3684: finishing rollback tid 2 to smithi084102331-18 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1680 (ObjNum 1063 snap 338 seq_num 1063) dirty exists 2024-01-13T18:12:58.829 INFO:tasks.rados.rados.0.smithi084.stdout:3683: finishing copy_from to smithi084102331-44 2024-01-13T18:12:58.830 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1744 (ObjNum 1079 snap 342 seq_num 1079) dirty exists 2024-01-13T18:12:58.830 INFO:tasks.rados.rados.0.smithi084.stdout:3683: finishing copy_from racing read to smithi084102331-44 2024-01-13T18:12:58.830 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 1 to smithi084102331-45 2024-01-13T18:12:58.830 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 2 to smithi084102331-45 2024-01-13T18:12:58.830 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 3 to smithi084102331-45 2024-01-13T18:12:58.837 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 4 to smithi084102331-45 2024-01-13T18:12:58.837 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 5 to smithi084102331-45 2024-01-13T18:12:58.837 INFO:tasks.rados.rados.0.smithi084.stdout:3688: finishing rollback tid 0 to smithi084102331-11 2024-01-13T18:12:58.838 INFO:tasks.rados.rados.0.smithi084.stdout:3688: finishing rollback tid 1 to smithi084102331-11 2024-01-13T18:12:58.838 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 6 to smithi084102331-45 2024-01-13T18:12:58.838 INFO:tasks.rados.rados.0.smithi084.stdout:3685: finishing copy_from to smithi084102331-23 2024-01-13T18:12:58.838 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 1674 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:12:58.838 INFO:tasks.rados.rados.0.smithi084.stdout:3688: finishing rollback tid 2 to smithi084102331-11 2024-01-13T18:12:58.838 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1784 (ObjNum 942 snap 298 seq_num 942) dirty exists 2024-01-13T18:12:58.839 INFO:tasks.rados.rados.0.smithi084.stdout:3685: finishing copy_from racing read to smithi084102331-23 2024-01-13T18:12:58.840 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 7 to smithi084102331-45 2024-01-13T18:12:58.840 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1807 (ObjNum 1136 snap 366 seq_num 1136) dirty exists 2024-01-13T18:12:58.840 INFO:tasks.rados.rados.0.smithi084.stdout:3686: left oid 45 (ObjNum 1136 snap 366 seq_num 1136) 2024-01-13T18:12:58.840 INFO:tasks.rados.rados.0.smithi084.stdout:3687: finishing copy_from to smithi084102331-1 2024-01-13T18:12:58.841 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1778 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-01-13T18:12:58.841 INFO:tasks.rados.rados.0.smithi084.stdout:3687: finishing copy_from racing read to smithi084102331-1 2024-01-13T18:12:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:58 smithi099 ceph-mon[138788]: pgmap v904: 121 pgs: 121 active+clean; 309 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-01-13T18:12:59.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:58 smithi084 ceph-mon[116404]: pgmap v904: 121 pgs: 121 active+clean; 309 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-01-13T18:12:59.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:58 smithi084 ceph-mon[119097]: pgmap v904: 121 pgs: 121 active+clean; 309 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-01-13T18:12:59.776 INFO:tasks.rados.rados.0.smithi084.stdout:3677: done (11 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3678: done (10 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3679: done (9 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3680: done (8 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3681: done (7 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3683: done (6 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3684: done (5 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3685: done (4 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3686: done (3 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3687: done (2 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3688: done (1 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3689: done (0 left) 2024-01-13T18:12:59.777 INFO:tasks.rados.rados.0.smithi084.stdout:3690: rollback oid 42 current snap is 367 2024-01-13T18:12:59.778 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 350 2024-01-13T18:12:59.778 INFO:tasks.rados.rados.0.smithi084.stdout:3691: read oid 27 snap -1 2024-01-13T18:12:59.778 INFO:tasks.rados.rados.0.smithi084.stdout:3691: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:12:59.778 INFO:tasks.rados.rados.0.smithi084.stdout:3692: read oid 29 snap -1 2024-01-13T18:12:59.778 INFO:tasks.rados.rados.0.smithi084.stdout:3692: expect (ObjNum 1079 snap 342 seq_num 1079) 2024-01-13T18:12:59.778 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 367 2024-01-13T18:12:59.778 INFO:tasks.rados.rados.0.smithi084.stdout:3693: seq_num 1137 ranges {8183808=647168,8830976=696320,9527296=557056,10084352=352256} 2024-01-13T18:12:59.824 INFO:tasks.rados.rados.0.smithi084.stdout:3693: writing smithi084102331-36 from 8183808 to 8830976 tid 1 2024-01-13T18:12:59.829 INFO:tasks.rados.rados.0.smithi084.stdout:3693: writing smithi084102331-36 from 8830976 to 9527296 tid 2 2024-01-13T18:12:59.832 INFO:tasks.rados.rados.0.smithi084.stdout:3693: writing smithi084102331-36 from 9527296 to 10084352 tid 3 2024-01-13T18:12:59.834 INFO:tasks.rados.rados.0.smithi084.stdout:3693: writing smithi084102331-36 from 10084352 to 10436608 tid 4 2024-01-13T18:12:59.834 INFO:tasks.rados.rados.0.smithi084.stdout:3694: read oid 47 snap -1 2024-01-13T18:12:59.834 INFO:tasks.rados.rados.0.smithi084.stdout:3694: expect deleted 2024-01-13T18:12:59.834 INFO:tasks.rados.rados.0.smithi084.stdout:3695: snap_remove snap 355 2024-01-13T18:13:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:12:59 smithi099 ceph-mon[138788]: osdmap e795: 8 total, 8 up, 8 in 2024-01-13T18:13:00.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:12:59 smithi084 ceph-mon[119097]: osdmap e795: 8 total, 8 up, 8 in 2024-01-13T18:13:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:12:59 smithi084 ceph-mon[116404]: osdmap e795: 8 total, 8 up, 8 in 2024-01-13T18:13:00.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:13:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:13:00] "GET /metrics HTTP/1.1" 200 36192 "" "Prometheus/2.43.0" 2024-01-13T18:13:00.780 INFO:tasks.rados.rados.0.smithi084.stdout:3695: done (5 left) 2024-01-13T18:13:00.780 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 367 2024-01-13T18:13:00.780 INFO:tasks.rados.rados.0.smithi084.stdout:3690: finishing rollback tid 0 to smithi084102331-42 2024-01-13T18:13:00.780 INFO:tasks.rados.rados.0.smithi084.stdout:3696: seq_num 1138 ranges {1277952=663552,1941504=581632,2523136=712704,3235840=311296} 2024-01-13T18:13:00.791 INFO:tasks.rados.rados.0.smithi084.stdout:3696: writing smithi084102331-44 from 1277952 to 1941504 tid 1 2024-01-13T18:13:00.795 INFO:tasks.rados.rados.0.smithi084.stdout:3696: writing smithi084102331-44 from 1941504 to 2523136 tid 2 2024-01-13T18:13:00.799 INFO:tasks.rados.rados.0.smithi084.stdout:3696: writing smithi084102331-44 from 2523136 to 3235840 tid 3 2024-01-13T18:13:00.802 INFO:tasks.rados.rados.0.smithi084.stdout:3696: writing smithi084102331-44 from 3235840 to 3547136 tid 4 2024-01-13T18:13:00.802 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 367 2024-01-13T18:13:00.802 INFO:tasks.rados.rados.0.smithi084.stdout:3690: finishing rollback tid 1 to smithi084102331-42 2024-01-13T18:13:00.802 INFO:tasks.rados.rados.0.smithi084.stdout:3690: finishing rollback tid 2 to smithi084102331-42 2024-01-13T18:13:00.802 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1510 (ObjNum 979 snap 309 seq_num 979) dirty exists 2024-01-13T18:13:00.802 INFO:tasks.rados.rados.0.smithi084.stdout:3692: expect (ObjNum 1079 snap 342 seq_num 1079) 2024-01-13T18:13:00.834 INFO:tasks.rados.rados.0.smithi084.stdout:3691: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:13:01.010 INFO:tasks.rados.rados.0.smithi084.stdout:3693: finishing write tid 1 to smithi084102331-36 2024-01-13T18:13:01.011 INFO:tasks.rados.rados.0.smithi084.stdout:3693: finishing write tid 2 to smithi084102331-36 2024-01-13T18:13:01.011 INFO:tasks.rados.rados.0.smithi084.stdout:3697: seq_num 1139 ranges {7643136=679936,8323072=458752,8781824=524288,9306112=540672,9846784=81920} 2024-01-13T18:13:01.054 INFO:tasks.rados.rados.0.smithi084.stdout:3697: writing smithi084102331-19 from 7643136 to 8323072 tid 1 2024-01-13T18:13:01.057 INFO:tasks.rados.rados.0.smithi084.stdout:3697: writing smithi084102331-19 from 8323072 to 8781824 tid 2 2024-01-13T18:13:01.060 INFO:tasks.rados.rados.0.smithi084.stdout:3697: writing smithi084102331-19 from 8781824 to 9306112 tid 3 2024-01-13T18:13:01.063 INFO:tasks.rados.rados.0.smithi084.stdout:3697: writing smithi084102331-19 from 9306112 to 9846784 tid 4 2024-01-13T18:13:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3697: writing smithi084102331-19 from 9846784 to 9928704 tid 5 2024-01-13T18:13:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3690: done (6 left) 2024-01-13T18:13:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3691: done (5 left) 2024-01-13T18:13:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3692: done (4 left) 2024-01-13T18:13:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3698: rmattr oid 20 current snap is 367 2024-01-13T18:13:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3698: done (4 left) 2024-01-13T18:13:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3699: read oid 28 snap -1 2024-01-13T18:13:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3699: expect (ObjNum 908 snap 282 seq_num 908) 2024-01-13T18:13:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3700: rmattr oid 32 current snap is 367 2024-01-13T18:13:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3700: done (5 left) 2024-01-13T18:13:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3701: read oid 33 snap -1 2024-01-13T18:13:01.066 INFO:tasks.rados.rados.0.smithi084.stdout:3701: expect (ObjNum 1046 snap 331 seq_num 1046) 2024-01-13T18:13:01.066 INFO:tasks.rados.rados.0.smithi084.stdout:3702: rollback oid 3 current snap is 367 2024-01-13T18:13:01.066 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 354 2024-01-13T18:13:01.067 INFO:tasks.rados.rados.0.smithi084.stdout:3693: finishing write tid 3 to smithi084102331-36 2024-01-13T18:13:01.067 INFO:tasks.rados.rados.0.smithi084.stdout:3693: finishing write tid 4 to smithi084102331-36 2024-01-13T18:13:01.067 INFO:tasks.rados.rados.0.smithi084.stdout:3693: finishing write tid 5 to smithi084102331-36 2024-01-13T18:13:01.067 INFO:tasks.rados.rados.0.smithi084.stdout:3693: finishing write tid 6 to smithi084102331-36 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1686 (ObjNum 1137 snap 367 seq_num 1137) dirty exists 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3693: left oid 36 (ObjNum 1137 snap 367 seq_num 1137) 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3696: finishing write tid 1 to smithi084102331-44 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3696: finishing write tid 2 to smithi084102331-44 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3693: done (6 left) 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3694: done (5 left) 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3703: copy_from oid 18 from oid 22 current snap is 367 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3696: finishing write tid 3 to smithi084102331-44 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3696: finishing write tid 4 to smithi084102331-44 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3696: finishing write tid 5 to smithi084102331-44 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3696: finishing write tid 6 to smithi084102331-44 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1825 (ObjNum 1138 snap 367 seq_num 1138) dirty exists 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3696: left oid 44 (ObjNum 1138 snap 367 seq_num 1138) 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3697: finishing write tid 1 to smithi084102331-19 2024-01-13T18:13:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3697: finishing write tid 2 to smithi084102331-19 2024-01-13T18:13:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3696: done (5 left) 2024-01-13T18:13:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3704: copy_from oid 38 from oid 27 current snap is 367 2024-01-13T18:13:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3705: snap_create 2024-01-13T18:13:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3697: finishing write tid 3 to smithi084102331-19 2024-01-13T18:13:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3703: finishing copy_from to smithi084102331-18 2024-01-13T18:13:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3703: got expected ENOENT (src dne) 2024-01-13T18:13:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3703: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:13:01.070 INFO:tasks.rados.rados.0.smithi084.stdout:3702: finishing rollback tid 1 to smithi084102331-3 2024-01-13T18:13:01.070 INFO:tasks.rados.rados.0.smithi084.stdout:3702: finishing rollback tid 2 to smithi084102331-3 2024-01-13T18:13:01.070 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1821 (ObjNum 986 snap 309 seq_num 986) dirty exists 2024-01-13T18:13:01.070 INFO:tasks.rados.rados.0.smithi084.stdout:3697: finishing write tid 4 to smithi084102331-19 2024-01-13T18:13:01.070 INFO:tasks.rados.rados.0.smithi084.stdout:3697: finishing write tid 5 to smithi084102331-19 2024-01-13T18:13:01.070 INFO:tasks.rados.rados.0.smithi084.stdout:3697: finishing write tid 6 to smithi084102331-19 2024-01-13T18:13:01.072 INFO:tasks.rados.rados.0.smithi084.stdout:3697: finishing write tid 7 to smithi084102331-19 2024-01-13T18:13:01.072 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 1652 (ObjNum 1139 snap 367 seq_num 1139) dirty exists 2024-01-13T18:13:01.072 INFO:tasks.rados.rados.0.smithi084.stdout:3697: left oid 19 (ObjNum 1139 snap 367 seq_num 1139) 2024-01-13T18:13:01.077 INFO:tasks.rados.rados.0.smithi084.stdout:3699: expect (ObjNum 908 snap 282 seq_num 908) 2024-01-13T18:13:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:00 smithi099 ceph-mon[138788]: osdmap e796: 8 total, 8 up, 8 in 2024-01-13T18:13:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:00 smithi099 ceph-mon[138788]: pgmap v907: 121 pgs: 121 active+clean; 313 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 20 op/s 2024-01-13T18:13:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:00 smithi084 ceph-mon[116404]: osdmap e796: 8 total, 8 up, 8 in 2024-01-13T18:13:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:00 smithi084 ceph-mon[116404]: pgmap v907: 121 pgs: 121 active+clean; 313 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 20 op/s 2024-01-13T18:13:01.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:00 smithi084 ceph-mon[119097]: osdmap e796: 8 total, 8 up, 8 in 2024-01-13T18:13:01.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:00 smithi084 ceph-mon[119097]: pgmap v907: 121 pgs: 121 active+clean; 313 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 20 op/s 2024-01-13T18:13:01.190 INFO:tasks.rados.rados.0.smithi084.stdout:3701: expect (ObjNum 1046 snap 331 seq_num 1046) 2024-01-13T18:13:01.385 INFO:tasks.rados.rados.0.smithi084.stdout:3704: finishing copy_from to smithi084102331-38 2024-01-13T18:13:01.385 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1412 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:13:01.385 INFO:tasks.rados.rados.0.smithi084.stdout:3704: finishing copy_from racing read to smithi084102331-38 2024-01-13T18:13:01.784 INFO:tasks.rados.rados.0.smithi084.stdout:3697: done (6 left) 2024-01-13T18:13:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:3699: done (5 left) 2024-01-13T18:13:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:3701: done (4 left) 2024-01-13T18:13:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:3702: done (3 left) 2024-01-13T18:13:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:3703: done (2 left) 2024-01-13T18:13:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:3704: done (1 left) 2024-01-13T18:13:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:3705: done (0 left) 2024-01-13T18:13:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 368 2024-01-13T18:13:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:3706: seq_num 1140 ranges {4038656=696320,4734976=745472,5480448=729088,6209536=131072} 2024-01-13T18:13:01.809 INFO:tasks.rados.rados.0.smithi084.stdout:3706: writing smithi084102331-12 from 4038656 to 4734976 tid 1 2024-01-13T18:13:01.813 INFO:tasks.rados.rados.0.smithi084.stdout:3706: writing smithi084102331-12 from 4734976 to 5480448 tid 2 2024-01-13T18:13:01.817 INFO:tasks.rados.rados.0.smithi084.stdout:3706: writing smithi084102331-12 from 5480448 to 6209536 tid 3 2024-01-13T18:13:01.818 INFO:tasks.rados.rados.0.smithi084.stdout:3706: writing smithi084102331-12 from 6209536 to 6340608 tid 4 2024-01-13T18:13:01.818 INFO:tasks.rados.rados.0.smithi084.stdout:3707: copy_from oid 6 from oid 39 current snap is 368 2024-01-13T18:13:01.818 INFO:tasks.rados.rados.0.smithi084.stdout:3708: copy_from oid 15 from oid 41 current snap is 368 2024-01-13T18:13:01.818 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 368 2024-01-13T18:13:01.819 INFO:tasks.rados.rados.0.smithi084.stdout:3709: seq_num 1141 ranges {0=712704,712704=679936,1392640=540672,1933312=385024} 2024-01-13T18:13:01.822 INFO:tasks.rados.rados.0.smithi084.stdout:3709: writing smithi084102331-21 from 0 to 712704 tid 1 2024-01-13T18:13:01.826 INFO:tasks.rados.rados.0.smithi084.stdout:3709: writing smithi084102331-21 from 712704 to 1392640 tid 2 2024-01-13T18:13:01.830 INFO:tasks.rados.rados.0.smithi084.stdout:3709: writing smithi084102331-21 from 1392640 to 1933312 tid 3 2024-01-13T18:13:01.833 INFO:tasks.rados.rados.0.smithi084.stdout:3709: writing smithi084102331-21 from 1933312 to 2318336 tid 4 2024-01-13T18:13:01.833 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 368 2024-01-13T18:13:01.833 INFO:tasks.rados.rados.0.smithi084.stdout:3706: finishing write tid 1 to smithi084102331-12 2024-01-13T18:13:01.833 INFO:tasks.rados.rados.0.smithi084.stdout:3706: finishing write tid 2 to smithi084102331-12 2024-01-13T18:13:01.833 INFO:tasks.rados.rados.0.smithi084.stdout:3706: finishing write tid 3 to smithi084102331-12 2024-01-13T18:13:01.833 INFO:tasks.rados.rados.0.smithi084.stdout:3706: finishing write tid 4 to smithi084102331-12 2024-01-13T18:13:01.833 INFO:tasks.rados.rados.0.smithi084.stdout:3710: seq_num 1142 ranges {9953280=729088,10682368=565248,11247616=696320,11943936=344064} 2024-01-13T18:13:01.889 INFO:tasks.rados.rados.0.smithi084.stdout:3710: writing smithi084102331-45 from 9953280 to 10682368 tid 1 2024-01-13T18:13:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:3710: writing smithi084102331-45 from 10682368 to 11247616 tid 2 2024-01-13T18:13:01.896 INFO:tasks.rados.rados.0.smithi084.stdout:3710: writing smithi084102331-45 from 11247616 to 11943936 tid 3 2024-01-13T18:13:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3710: writing smithi084102331-45 from 11943936 to 12288000 tid 4 2024-01-13T18:13:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3711: rollback oid 30 current snap is 368 2024-01-13T18:13:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 356 2024-01-13T18:13:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3706: finishing write tid 5 to smithi084102331-12 2024-01-13T18:13:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3706: finishing write tid 6 to smithi084102331-12 2024-01-13T18:13:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1902 (ObjNum 1140 snap 368 seq_num 1140) dirty exists 2024-01-13T18:13:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3706: left oid 12 (ObjNum 1140 snap 368 seq_num 1140) 2024-01-13T18:13:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3707: finishing copy_from to smithi084102331-6 2024-01-13T18:13:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 1778 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-01-13T18:13:01.900 INFO:tasks.rados.rados.0.smithi084.stdout:3709: finishing write tid 1 to smithi084102331-21 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3709: finishing write tid 2 to smithi084102331-21 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3707: finishing copy_from racing read to smithi084102331-6 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3706: done (5 left) 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3707: done (4 left) 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 368 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3709: finishing write tid 3 to smithi084102331-21 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3709: finishing write tid 4 to smithi084102331-21 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3709: finishing write tid 5 to smithi084102331-21 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3709: finishing write tid 6 to smithi084102331-21 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 1754 (ObjNum 1141 snap 368 seq_num 1141) dirty exists 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3709: left oid 21 (ObjNum 1141 snap 368 seq_num 1141) 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3708: finishing copy_from to smithi084102331-15 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1770 (ObjNum 1096 snap 350 seq_num 1096) dirty exists 2024-01-13T18:13:01.901 INFO:tasks.rados.rados.0.smithi084.stdout:3708: finishing copy_from racing read to smithi084102331-15 2024-01-13T18:13:01.902 INFO:tasks.rados.rados.0.smithi084.stdout:3710: finishing write tid 1 to smithi084102331-45 2024-01-13T18:13:01.902 INFO:tasks.rados.rados.0.smithi084.stdout:3710: finishing write tid 2 to smithi084102331-45 2024-01-13T18:13:01.902 INFO:tasks.rados.rados.0.smithi084.stdout:3712: seq_num 1143 ranges {6250496=753664,7004160=450560,7454720=507904,7962624=589824,8552448=57344} 2024-01-13T18:13:01.936 INFO:tasks.rados.rados.0.smithi084.stdout:3712: writing smithi084102331-32 from 6250496 to 7004160 tid 1 2024-01-13T18:13:01.938 INFO:tasks.rados.rados.0.smithi084.stdout:3712: writing smithi084102331-32 from 7004160 to 7454720 tid 2 2024-01-13T18:13:01.941 INFO:tasks.rados.rados.0.smithi084.stdout:3712: writing smithi084102331-32 from 7454720 to 7962624 tid 3 2024-01-13T18:13:01.944 INFO:tasks.rados.rados.0.smithi084.stdout:3712: writing smithi084102331-32 from 7962624 to 8552448 tid 4 2024-01-13T18:13:01.945 INFO:tasks.rados.rados.0.smithi084.stdout:3712: writing smithi084102331-32 from 8552448 to 8609792 tid 5 2024-01-13T18:13:01.945 INFO:tasks.rados.rados.0.smithi084.stdout:3708: done (4 left) 2024-01-13T18:13:01.945 INFO:tasks.rados.rados.0.smithi084.stdout:3709: done (3 left) 2024-01-13T18:13:01.946 INFO:tasks.rados.rados.0.smithi084.stdout:3713: read oid 20 snap 349 2024-01-13T18:13:01.946 INFO:tasks.rados.rados.0.smithi084.stdout:3713: expect (ObjNum 1091 snap 349 seq_num 1091) 2024-01-13T18:13:01.946 INFO:tasks.rados.rados.0.smithi084.stdout:3714: snap_create 2024-01-13T18:13:01.946 INFO:tasks.rados.rados.0.smithi084.stdout:3711: finishing rollback tid 1 to smithi084102331-30 2024-01-13T18:13:01.946 INFO:tasks.rados.rados.0.smithi084.stdout:3711: finishing rollback tid 2 to smithi084102331-30 2024-01-13T18:13:01.946 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1751 (ObjNum 1087 snap 348 seq_num 1087) dirty exists 2024-01-13T18:13:01.946 INFO:tasks.rados.rados.0.smithi084.stdout:3710: finishing write tid 3 to smithi084102331-45 2024-01-13T18:13:01.946 INFO:tasks.rados.rados.0.smithi084.stdout:3710: finishing write tid 4 to smithi084102331-45 2024-01-13T18:13:01.946 INFO:tasks.rados.rados.0.smithi084.stdout:3710: finishing write tid 5 to smithi084102331-45 2024-01-13T18:13:01.946 INFO:tasks.rados.rados.0.smithi084.stdout:3710: finishing write tid 6 to smithi084102331-45 2024-01-13T18:13:01.946 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1829 (ObjNum 1142 snap 368 seq_num 1142) dirty exists 2024-01-13T18:13:01.947 INFO:tasks.rados.rados.0.smithi084.stdout:3710: left oid 45 (ObjNum 1142 snap 368 seq_num 1142) 2024-01-13T18:13:01.947 INFO:tasks.rados.rados.0.smithi084.stdout:3712: finishing write tid 1 to smithi084102331-32 2024-01-13T18:13:01.947 INFO:tasks.rados.rados.0.smithi084.stdout:3712: finishing write tid 2 to smithi084102331-32 2024-01-13T18:13:01.947 INFO:tasks.rados.rados.0.smithi084.stdout:3712: finishing write tid 3 to smithi084102331-32 2024-01-13T18:13:01.949 INFO:tasks.rados.rados.0.smithi084.stdout:3712: finishing write tid 4 to smithi084102331-32 2024-01-13T18:13:01.949 INFO:tasks.rados.rados.0.smithi084.stdout:3712: finishing write tid 5 to smithi084102331-32 2024-01-13T18:13:01.950 INFO:tasks.rados.rados.0.smithi084.stdout:3712: finishing write tid 6 to smithi084102331-32 2024-01-13T18:13:01.951 INFO:tasks.rados.rados.0.smithi084.stdout:3712: finishing write tid 7 to smithi084102331-32 2024-01-13T18:13:01.951 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1833 (ObjNum 1143 snap 368 seq_num 1143) dirty exists 2024-01-13T18:13:01.951 INFO:tasks.rados.rados.0.smithi084.stdout:3712: left oid 32 (ObjNum 1143 snap 368 seq_num 1143) 2024-01-13T18:13:01.980 INFO:tasks.rados.rados.0.smithi084.stdout:3713: expect (ObjNum 1091 snap 349 seq_num 1091) 2024-01-13T18:13:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:01 smithi099 ceph-mon[138788]: osdmap e797: 8 total, 8 up, 8 in 2024-01-13T18:13:02.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:01 smithi084 ceph-mon[116404]: osdmap e797: 8 total, 8 up, 8 in 2024-01-13T18:13:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:01 smithi084 ceph-mon[119097]: osdmap e797: 8 total, 8 up, 8 in 2024-01-13T18:13:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:3710: done (4 left) 2024-01-13T18:13:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:3711: done (3 left) 2024-01-13T18:13:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:3712: done (2 left) 2024-01-13T18:13:02.740 INFO:tasks.rados.rados.0.smithi084.stdout:3713: done (1 left) 2024-01-13T18:13:02.740 INFO:tasks.rados.rados.0.smithi084.stdout:3714: done (0 left) 2024-01-13T18:13:02.740 INFO:tasks.rados.rados.0.smithi084.stdout:3715: setattr oid 35 current snap is 369 2024-01-13T18:13:02.740 INFO:tasks.rados.rados.0.smithi084.stdout:3716: copy_from oid 3 from oid 19 current snap is 369 2024-01-13T18:13:02.741 INFO:tasks.rados.rados.0.smithi084.stdout:3717: read oid 44 snap -1 2024-01-13T18:13:02.741 INFO:tasks.rados.rados.0.smithi084.stdout:3717: expect (ObjNum 1138 snap 367 seq_num 1138) 2024-01-13T18:13:02.741 INFO:tasks.rados.rados.0.smithi084.stdout:3718: snap_remove snap 366 2024-01-13T18:13:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:02 smithi099 ceph-mon[138788]: osdmap e798: 8 total, 8 up, 8 in 2024-01-13T18:13:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:02 smithi099 ceph-mon[138788]: pgmap v910: 121 pgs: 121 active+clean; 355 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 10 MiB/s wr, 26 op/s 2024-01-13T18:13:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:02 smithi099 ceph-mon[138788]: osdmap e799: 8 total, 8 up, 8 in 2024-01-13T18:13:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:02 smithi084 ceph-mon[116404]: osdmap e798: 8 total, 8 up, 8 in 2024-01-13T18:13:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:02 smithi084 ceph-mon[116404]: pgmap v910: 121 pgs: 121 active+clean; 355 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 10 MiB/s wr, 26 op/s 2024-01-13T18:13:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:02 smithi084 ceph-mon[116404]: osdmap e799: 8 total, 8 up, 8 in 2024-01-13T18:13:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:02 smithi084 ceph-mon[119097]: osdmap e798: 8 total, 8 up, 8 in 2024-01-13T18:13:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:02 smithi084 ceph-mon[119097]: pgmap v910: 121 pgs: 121 active+clean; 355 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 10 MiB/s wr, 26 op/s 2024-01-13T18:13:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:02 smithi084 ceph-mon[119097]: osdmap e799: 8 total, 8 up, 8 in 2024-01-13T18:13:03.747 INFO:tasks.rados.rados.0.smithi084.stdout:3718: done (3 left) 2024-01-13T18:13:03.747 INFO:tasks.rados.rados.0.smithi084.stdout:3719: rollback oid 38 current snap is 369 2024-01-13T18:13:03.748 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 350 2024-01-13T18:13:03.748 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1755 (ObjNum 1088 snap 348 seq_num 1088) dirty exists 2024-01-13T18:13:03.748 INFO:tasks.rados.rados.0.smithi084.stdout:3717: expect (ObjNum 1138 snap 367 seq_num 1138) 2024-01-13T18:13:03.856 INFO:tasks.rados.rados.0.smithi084.stdout:3716: finishing copy_from to smithi084102331-3 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1652 (ObjNum 1139 snap 367 seq_num 1139) dirty exists 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:3716: finishing copy_from racing read to smithi084102331-3 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:3715: done (3 left) 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:3716: done (2 left) 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:3717: done (1 left) 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:3720: rollback oid 21 current snap is 369 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 353 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:3719: finishing rollback tid 0 to smithi084102331-38 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:3719: finishing rollback tid 1 to smithi084102331-38 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:3719: finishing rollback tid 2 to smithi084102331-38 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1835 (ObjNum 969 snap 307 seq_num 969) dirty exists 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:3719: done (1 left) 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:3721: copy_from oid 17 from oid 49 current snap is 369 2024-01-13T18:13:03.857 INFO:tasks.rados.rados.0.smithi084.stdout:3722: setattr oid 33 current snap is 369 2024-01-13T18:13:03.858 INFO:tasks.rados.rados.0.smithi084.stdout:3723: rollback oid 28 current snap is 369 2024-01-13T18:13:03.858 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 28 to 344 2024-01-13T18:13:03.858 INFO:tasks.rados.rados.0.smithi084.stdout:3724: read oid 15 snap -1 2024-01-13T18:13:03.858 INFO:tasks.rados.rados.0.smithi084.stdout:3724: expect (ObjNum 1096 snap 350 seq_num 1096) 2024-01-13T18:13:03.858 INFO:tasks.rados.rados.0.smithi084.stdout:3725: snap_create 2024-01-13T18:13:03.861 INFO:tasks.rados.rados.0.smithi084.stdout:3721: finishing copy_from to smithi084102331-17 2024-01-13T18:13:03.861 INFO:tasks.rados.rados.0.smithi084.stdout:3721: got expected ENOENT (src dne) 2024-01-13T18:13:03.861 INFO:tasks.rados.rados.0.smithi084.stdout:3721: finishing copy_from racing read to smithi084102331-17 2024-01-13T18:13:03.862 INFO:tasks.rados.rados.0.smithi084.stdout:3720: finishing rollback tid 0 to smithi084102331-21 2024-01-13T18:13:03.862 INFO:tasks.rados.rados.0.smithi084.stdout:3720: finishing rollback tid 1 to smithi084102331-21 2024-01-13T18:13:03.862 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 1757 (ObjNum 1265 snap 0 seq_num 4037844384) dirty dne 2024-01-13T18:13:03.863 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1752 (ObjNum 1046 snap 331 seq_num 1046) dirty exists 2024-01-13T18:13:03.867 INFO:tasks.rados.rados.0.smithi084.stdout:3723: finishing rollback tid 0 to smithi084102331-28 2024-01-13T18:13:03.869 INFO:tasks.rados.rados.0.smithi084.stdout:3723: finishing rollback tid 1 to smithi084102331-28 2024-01-13T18:13:03.869 INFO:tasks.rados.rados.0.smithi084.stdout:3723: finishing rollback tid 2 to smithi084102331-28 2024-01-13T18:13:03.869 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1630 (ObjNum 908 snap 282 seq_num 908) dirty exists 2024-01-13T18:13:03.889 INFO:tasks.rados.rados.0.smithi084.stdout:3724: expect (ObjNum 1096 snap 350 seq_num 1096) 2024-01-13T18:13:04.751 INFO:tasks.rados.rados.0.smithi084.stdout:3720: done (5 left) 2024-01-13T18:13:04.751 INFO:tasks.rados.rados.0.smithi084.stdout:3721: done (4 left) 2024-01-13T18:13:04.751 INFO:tasks.rados.rados.0.smithi084.stdout:3722: done (3 left) 2024-01-13T18:13:04.751 INFO:tasks.rados.rados.0.smithi084.stdout:3723: done (2 left) 2024-01-13T18:13:04.752 INFO:tasks.rados.rados.0.smithi084.stdout:3724: done (1 left) 2024-01-13T18:13:04.752 INFO:tasks.rados.rados.0.smithi084.stdout:3725: done (0 left) 2024-01-13T18:13:04.752 INFO:tasks.rados.rados.0.smithi084.stdout:3726: rollback oid 41 current snap is 370 2024-01-13T18:13:04.752 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 352 2024-01-13T18:13:04.752 INFO:tasks.rados.rados.0.smithi084.stdout:3727: rmattr oid 38 current snap is 370 2024-01-13T18:13:04.752 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 370 2024-01-13T18:13:04.752 INFO:tasks.rados.rados.0.smithi084.stdout:3728: seq_num 1144 ranges {0=770048,770048=737280,1507328=712704,2220032=155648} 2024-01-13T18:13:04.755 INFO:tasks.rados.rados.0.smithi084.stdout:3728: writing smithi084102331-13 from 0 to 770048 tid 1 2024-01-13T18:13:04.760 INFO:tasks.rados.rados.0.smithi084.stdout:3728: writing smithi084102331-13 from 770048 to 1507328 tid 2 2024-01-13T18:13:04.764 INFO:tasks.rados.rados.0.smithi084.stdout:3728: writing smithi084102331-13 from 1507328 to 2220032 tid 3 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3728: writing smithi084102331-13 from 2220032 to 2375680 tid 4 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3729: rmattr oid 19 current snap is 370 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1841 (ObjNum 969 snap 307 seq_num 969) dirty exists 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3726: finishing rollback tid 0 to smithi084102331-41 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3726: finishing rollback tid 1 to smithi084102331-41 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3726: finishing rollback tid 2 to smithi084102331-41 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1787 (ObjNum 1096 snap 350 seq_num 1096) dirty exists 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3728: finishing write tid 1 to smithi084102331-13 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3728: finishing write tid 2 to smithi084102331-13 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3726: done (3 left) 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3727: done (2 left) 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3730: read oid 43 snap -1 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3730: expect (ObjNum 1133 snap 366 seq_num 1133) 2024-01-13T18:13:04.766 INFO:tasks.rados.rados.0.smithi084.stdout:3731: snap_create 2024-01-13T18:13:04.770 INFO:tasks.rados.rados.0.smithi084.stdout:3728: finishing write tid 3 to smithi084102331-13 2024-01-13T18:13:04.770 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 1653 (ObjNum 1139 snap 367 seq_num 1139) dirty exists 2024-01-13T18:13:04.770 INFO:tasks.rados.rados.0.smithi084.stdout:3728: finishing write tid 4 to smithi084102331-13 2024-01-13T18:13:04.771 INFO:tasks.rados.rados.0.smithi084.stdout:3728: finishing write tid 5 to smithi084102331-13 2024-01-13T18:13:04.772 INFO:tasks.rados.rados.0.smithi084.stdout:3728: finishing write tid 6 to smithi084102331-13 2024-01-13T18:13:04.772 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 1785 (ObjNum 1144 snap 370 seq_num 1144) dirty exists 2024-01-13T18:13:04.773 INFO:tasks.rados.rados.0.smithi084.stdout:3728: left oid 13 (ObjNum 1144 snap 370 seq_num 1144) 2024-01-13T18:13:04.786 INFO:tasks.rados.rados.0.smithi084.stdout:3730: expect (ObjNum 1133 snap 366 seq_num 1133) 2024-01-13T18:13:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:04 smithi099 ceph-mon[138788]: osdmap e800: 8 total, 8 up, 8 in 2024-01-13T18:13:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:04 smithi099 ceph-mon[138788]: pgmap v913: 121 pgs: 121 active+clean; 366 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 12 MiB/s wr, 23 op/s 2024-01-13T18:13:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:04 smithi084 ceph-mon[116404]: osdmap e800: 8 total, 8 up, 8 in 2024-01-13T18:13:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:04 smithi084 ceph-mon[116404]: pgmap v913: 121 pgs: 121 active+clean; 366 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 12 MiB/s wr, 23 op/s 2024-01-13T18:13:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:04 smithi084 ceph-mon[119097]: osdmap e800: 8 total, 8 up, 8 in 2024-01-13T18:13:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:04 smithi084 ceph-mon[119097]: pgmap v913: 121 pgs: 121 active+clean; 366 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 12 MiB/s wr, 23 op/s 2024-01-13T18:13:05.759 INFO:tasks.rados.rados.0.smithi084.stdout:3728: done (3 left) 2024-01-13T18:13:05.759 INFO:tasks.rados.rados.0.smithi084.stdout:3729: done (2 left) 2024-01-13T18:13:05.759 INFO:tasks.rados.rados.0.smithi084.stdout:3730: done (1 left) 2024-01-13T18:13:05.759 INFO:tasks.rados.rados.0.smithi084.stdout:3731: done (0 left) 2024-01-13T18:13:05.759 INFO:tasks.rados.rados.0.smithi084.stdout:3732: snap_remove snap 357 2024-01-13T18:13:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:05 smithi099 ceph-mon[138788]: osdmap e801: 8 total, 8 up, 8 in 2024-01-13T18:13:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:06.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:05 smithi084 ceph-mon[116404]: osdmap e801: 8 total, 8 up, 8 in 2024-01-13T18:13:06.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:06.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:05 smithi084 ceph-mon[119097]: osdmap e801: 8 total, 8 up, 8 in 2024-01-13T18:13:06.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:06.769 INFO:tasks.rados.rados.0.smithi084.stdout:3732: done (0 left) 2024-01-13T18:13:06.769 INFO:tasks.rados.rados.0.smithi084.stdout:3733: read oid 42 snap 367 2024-01-13T18:13:06.769 INFO:tasks.rados.rados.0.smithi084.stdout:3733: expect (ObjNum 979 snap 309 seq_num 979) 2024-01-13T18:13:06.769 INFO:tasks.rados.rados.0.smithi084.stdout:3734: snap_remove snap 342 2024-01-13T18:13:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:06 smithi099 ceph-mon[138788]: osdmap e802: 8 total, 8 up, 8 in 2024-01-13T18:13:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:06 smithi099 ceph-mon[138788]: pgmap v916: 121 pgs: 121 active+clean; 371 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-01-13T18:13:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:06 smithi084 ceph-mon[116404]: osdmap e802: 8 total, 8 up, 8 in 2024-01-13T18:13:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:06 smithi084 ceph-mon[116404]: pgmap v916: 121 pgs: 121 active+clean; 371 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-01-13T18:13:07.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:06 smithi084 ceph-mon[119097]: osdmap e802: 8 total, 8 up, 8 in 2024-01-13T18:13:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:06 smithi084 ceph-mon[119097]: pgmap v916: 121 pgs: 121 active+clean; 371 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-01-13T18:13:07.743 INFO:tasks.rados.rados.0.smithi084.stdout:3734: done (1 left) 2024-01-13T18:13:07.743 INFO:tasks.rados.rados.0.smithi084.stdout:3735: rollback oid 46 current snap is 371 2024-01-13T18:13:07.743 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 368 2024-01-13T18:13:07.743 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 371 2024-01-13T18:13:07.743 INFO:tasks.rados.rados.0.smithi084.stdout:3736: seq_num 1145 ranges {6479872=786432,7266304=622592,7888896=516096,8404992=417792,8822784=49152} 2024-01-13T18:13:07.782 INFO:tasks.rados.rados.0.smithi084.stdout:3736: writing smithi084102331-2 from 6479872 to 7266304 tid 1 2024-01-13T18:13:07.785 INFO:tasks.rados.rados.0.smithi084.stdout:3736: writing smithi084102331-2 from 7266304 to 7888896 tid 2 2024-01-13T18:13:07.788 INFO:tasks.rados.rados.0.smithi084.stdout:3736: writing smithi084102331-2 from 7888896 to 8404992 tid 3 2024-01-13T18:13:07.791 INFO:tasks.rados.rados.0.smithi084.stdout:3736: writing smithi084102331-2 from 8404992 to 8822784 tid 4 2024-01-13T18:13:07.792 INFO:tasks.rados.rados.0.smithi084.stdout:3736: writing smithi084102331-2 from 8822784 to 8871936 tid 5 2024-01-13T18:13:07.792 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 371 2024-01-13T18:13:07.792 INFO:tasks.rados.rados.0.smithi084.stdout:3737: seq_num 1146 ranges {0=802816,802816=499712,1302528=679936,1982464=425984} 2024-01-13T18:13:07.797 INFO:tasks.rados.rados.0.smithi084.stdout:3737: writing smithi084102331-1 from 0 to 802816 tid 1 2024-01-13T18:13:07.801 INFO:tasks.rados.rados.0.smithi084.stdout:3737: writing smithi084102331-1 from 802816 to 1302528 tid 2 2024-01-13T18:13:07.804 INFO:tasks.rados.rados.0.smithi084.stdout:3737: writing smithi084102331-1 from 1302528 to 1982464 tid 3 2024-01-13T18:13:07.807 INFO:tasks.rados.rados.0.smithi084.stdout:3737: writing smithi084102331-1 from 1982464 to 2408448 tid 4 2024-01-13T18:13:07.807 INFO:tasks.rados.rados.0.smithi084.stdout:3738: read oid 6 snap -1 2024-01-13T18:13:07.807 INFO:tasks.rados.rados.0.smithi084.stdout:3738: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:13:07.807 INFO:tasks.rados.rados.0.smithi084.stdout:3739: snap_create 2024-01-13T18:13:07.808 INFO:tasks.rados.rados.0.smithi084.stdout:3733: expect (ObjNum 979 snap 309 seq_num 979) 2024-01-13T18:13:07.858 INFO:tasks.rados.rados.0.smithi084.stdout:3735: finishing rollback tid 0 to smithi084102331-46 2024-01-13T18:13:07.858 INFO:tasks.rados.rados.0.smithi084.stdout:3735: finishing rollback tid 1 to smithi084102331-46 2024-01-13T18:13:07.858 INFO:tasks.rados.rados.0.smithi084.stdout:3735: finishing rollback tid 2 to smithi084102331-46 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1790 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:3736: finishing write tid 1 to smithi084102331-2 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:3736: finishing write tid 2 to smithi084102331-2 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:3736: finishing write tid 3 to smithi084102331-2 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:3736: finishing write tid 4 to smithi084102331-2 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:3736: finishing write tid 5 to smithi084102331-2 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:3736: finishing write tid 6 to smithi084102331-2 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:3736: finishing write tid 7 to smithi084102331-2 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1927 (ObjNum 1145 snap 371 seq_num 1145) dirty exists 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:3736: left oid 2 (ObjNum 1145 snap 371 seq_num 1145) 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:3737: finishing write tid 1 to smithi084102331-1 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:3737: finishing write tid 2 to smithi084102331-1 2024-01-13T18:13:07.859 INFO:tasks.rados.rados.0.smithi084.stdout:3738: expect (ObjNum 0 snap 0 seq_num 0) 2024-01-13T18:13:07.860 INFO:tasks.rados.rados.0.smithi084.stdout:3737: finishing write tid 3 to smithi084102331-1 2024-01-13T18:13:07.861 INFO:tasks.rados.rados.0.smithi084.stdout:3737: finishing write tid 4 to smithi084102331-1 2024-01-13T18:13:07.861 INFO:tasks.rados.rados.0.smithi084.stdout:3737: finishing write tid 5 to smithi084102331-1 2024-01-13T18:13:07.861 INFO:tasks.rados.rados.0.smithi084.stdout:3737: finishing write tid 6 to smithi084102331-1 2024-01-13T18:13:07.861 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1863 (ObjNum 1146 snap 371 seq_num 1146) dirty exists 2024-01-13T18:13:07.861 INFO:tasks.rados.rados.0.smithi084.stdout:3737: left oid 1 (ObjNum 1146 snap 371 seq_num 1146) 2024-01-13T18:13:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:07 smithi099 ceph-mon[138788]: osdmap e803: 8 total, 8 up, 8 in 2024-01-13T18:13:08.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:07 smithi099 ceph-mon[138788]: osdmap e804: 8 total, 8 up, 8 in 2024-01-13T18:13:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:07 smithi084 ceph-mon[116404]: osdmap e803: 8 total, 8 up, 8 in 2024-01-13T18:13:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:07 smithi084 ceph-mon[116404]: osdmap e804: 8 total, 8 up, 8 in 2024-01-13T18:13:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:07 smithi084 ceph-mon[119097]: osdmap e803: 8 total, 8 up, 8 in 2024-01-13T18:13:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:07 smithi084 ceph-mon[119097]: osdmap e804: 8 total, 8 up, 8 in 2024-01-13T18:13:08.777 INFO:tasks.rados.rados.0.smithi084.stdout:3733: done (5 left) 2024-01-13T18:13:08.778 INFO:tasks.rados.rados.0.smithi084.stdout:3735: done (4 left) 2024-01-13T18:13:08.778 INFO:tasks.rados.rados.0.smithi084.stdout:3736: done (3 left) 2024-01-13T18:13:08.778 INFO:tasks.rados.rados.0.smithi084.stdout:3737: done (2 left) 2024-01-13T18:13:08.778 INFO:tasks.rados.rados.0.smithi084.stdout:3738: done (1 left) 2024-01-13T18:13:08.778 INFO:tasks.rados.rados.0.smithi084.stdout:3739: done (0 left) 2024-01-13T18:13:08.778 INFO:tasks.rados.rados.0.smithi084.stdout:3740: delete oid 8 current snap is 372 2024-01-13T18:13:08.781 INFO:tasks.rados.rados.0.smithi084.stdout:3740: done (0 left) 2024-01-13T18:13:08.781 INFO:tasks.rados.rados.0.smithi084.stdout:3741: snap_remove snap 350 2024-01-13T18:13:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:08 smithi099 ceph-mon[138788]: pgmap v919: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 393 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 5.1 MiB/s wr, 33 op/s 2024-01-13T18:13:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:08 smithi084 ceph-mon[116404]: pgmap v919: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 393 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 5.1 MiB/s wr, 33 op/s 2024-01-13T18:13:09.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:08 smithi084 ceph-mon[119097]: pgmap v919: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 393 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 5.1 MiB/s wr, 33 op/s 2024-01-13T18:13:09.775 INFO:tasks.rados.rados.0.smithi084.stdout:3741: done (0 left) 2024-01-13T18:13:09.775 INFO:tasks.rados.rados.0.smithi084.stdout:3742: snap_remove snap 371 2024-01-13T18:13:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:09 smithi099 ceph-mon[138788]: osdmap e805: 8 total, 8 up, 8 in 2024-01-13T18:13:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:09 smithi084 ceph-mon[116404]: osdmap e805: 8 total, 8 up, 8 in 2024-01-13T18:13:10.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:09 smithi084 ceph-mon[119097]: osdmap e805: 8 total, 8 up, 8 in 2024-01-13T18:13:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:13:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:13:10] "GET /metrics HTTP/1.1" 200 36193 "" "Prometheus/2.43.0" 2024-01-13T18:13:10.779 INFO:tasks.rados.rados.0.smithi084.stdout:3742: done (0 left) 2024-01-13T18:13:10.779 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 372 2024-01-13T18:13:10.779 INFO:tasks.rados.rados.0.smithi084.stdout:3743: seq_num 1148 ranges {0=32768} 2024-01-13T18:13:10.779 INFO:tasks.rados.rados.0.smithi084.stdout:3743: writing smithi084102331-21 from 0 to 32768 tid 1 2024-01-13T18:13:10.779 INFO:tasks.rados.rados.0.smithi084.stdout:3744: setattr oid 11 current snap is 372 2024-01-13T18:13:10.787 INFO:tasks.rados.rados.0.smithi084.stdout:3745: read oid 22 snap -1 2024-01-13T18:13:10.788 INFO:tasks.rados.rados.0.smithi084.stdout:3745: expect deleted 2024-01-13T18:13:10.788 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 372 2024-01-13T18:13:10.788 INFO:tasks.rados.rados.0.smithi084.stdout:3746: seq_num 1149 ranges {5890048=49152} 2024-01-13T18:13:10.813 INFO:tasks.rados.rados.0.smithi084.stdout:3746: writing smithi084102331-15 from 5890048 to 5939200 tid 1 2024-01-13T18:13:10.813 INFO:tasks.rados.rados.0.smithi084.stdout:3747: snap_create 2024-01-13T18:13:10.813 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1791 (ObjNum 942 snap 298 seq_num 942) dirty exists 2024-01-13T18:13:10.813 INFO:tasks.rados.rados.0.smithi084.stdout:3743: finishing write tid 1 to smithi084102331-21 2024-01-13T18:13:10.813 INFO:tasks.rados.rados.0.smithi084.stdout:3743: finishing write tid 2 to smithi084102331-21 2024-01-13T18:13:10.813 INFO:tasks.rados.rados.0.smithi084.stdout:3743: finishing write tid 3 to smithi084102331-21 2024-01-13T18:13:10.813 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 1759 (ObjNum 1148 snap 372 seq_num 1148) dirty exists 2024-01-13T18:13:10.813 INFO:tasks.rados.rados.0.smithi084.stdout:3743: left oid 21 (ObjNum 1148 snap 372 seq_num 1148) 2024-01-13T18:13:10.817 INFO:tasks.rados.rados.0.smithi084.stdout:3746: finishing write tid 1 to smithi084102331-15 2024-01-13T18:13:10.817 INFO:tasks.rados.rados.0.smithi084.stdout:3746: finishing write tid 2 to smithi084102331-15 2024-01-13T18:13:10.818 INFO:tasks.rados.rados.0.smithi084.stdout:3746: finishing write tid 3 to smithi084102331-15 2024-01-13T18:13:10.819 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1868 (ObjNum 1149 snap 372 seq_num 1149) dirty exists 2024-01-13T18:13:10.819 INFO:tasks.rados.rados.0.smithi084.stdout:3746: left oid 15 (ObjNum 1149 snap 372 seq_num 1149) 2024-01-13T18:13:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:10 smithi099 ceph-mon[138788]: osdmap e806: 8 total, 8 up, 8 in 2024-01-13T18:13:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:10 smithi099 ceph-mon[138788]: pgmap v922: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 393 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 4.6 MiB/s wr, 25 op/s 2024-01-13T18:13:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:10 smithi099 ceph-mon[138788]: osdmap e807: 8 total, 8 up, 8 in 2024-01-13T18:13:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:10 smithi084 ceph-mon[116404]: osdmap e806: 8 total, 8 up, 8 in 2024-01-13T18:13:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:10 smithi084 ceph-mon[116404]: pgmap v922: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 393 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 4.6 MiB/s wr, 25 op/s 2024-01-13T18:13:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:10 smithi084 ceph-mon[116404]: osdmap e807: 8 total, 8 up, 8 in 2024-01-13T18:13:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:10 smithi084 ceph-mon[119097]: osdmap e806: 8 total, 8 up, 8 in 2024-01-13T18:13:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:10 smithi084 ceph-mon[119097]: pgmap v922: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 393 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 4.6 MiB/s wr, 25 op/s 2024-01-13T18:13:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:10 smithi084 ceph-mon[119097]: osdmap e807: 8 total, 8 up, 8 in 2024-01-13T18:13:11.799 INFO:tasks.rados.rados.0.smithi084.stdout:3743: done (4 left) 2024-01-13T18:13:11.799 INFO:tasks.rados.rados.0.smithi084.stdout:3744: done (3 left) 2024-01-13T18:13:11.799 INFO:tasks.rados.rados.0.smithi084.stdout:3745: done (2 left) 2024-01-13T18:13:11.799 INFO:tasks.rados.rados.0.smithi084.stdout:3746: done (1 left) 2024-01-13T18:13:11.799 INFO:tasks.rados.rados.0.smithi084.stdout:3747: done (0 left) 2024-01-13T18:13:11.799 INFO:tasks.rados.rados.0.smithi084.stdout:3748: setattr oid 16 current snap is 373 2024-01-13T18:13:11.800 INFO:tasks.rados.rados.0.smithi084.stdout:3749: read oid 45 snap -1 2024-01-13T18:13:11.800 INFO:tasks.rados.rados.0.smithi084.stdout:3749: expect (ObjNum 1142 snap 368 seq_num 1142) 2024-01-13T18:13:11.800 INFO:tasks.rados.rados.0.smithi084.stdout:3750: snap_create 2024-01-13T18:13:11.808 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1631 (ObjNum 1088 snap 348 seq_num 1088) dirty exists 2024-01-13T18:13:11.843 INFO:tasks.rados.rados.0.smithi084.stdout:3749: expect (ObjNum 1142 snap 368 seq_num 1142) 2024-01-13T18:13:12.790 INFO:tasks.rados.rados.0.smithi084.stdout:3748: done (2 left) 2024-01-13T18:13:12.790 INFO:tasks.rados.rados.0.smithi084.stdout:3749: done (1 left) 2024-01-13T18:13:12.790 INFO:tasks.rados.rados.0.smithi084.stdout:3750: done (0 left) 2024-01-13T18:13:12.790 INFO:tasks.rados.rados.0.smithi084.stdout:3751: setattr oid 41 current snap is 374 2024-01-13T18:13:12.791 INFO:tasks.rados.rados.0.smithi084.stdout:3752: rollback oid 2 current snap is 374 2024-01-13T18:13:12.791 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 362 2024-01-13T18:13:12.791 INFO:tasks.rados.rados.0.smithi084.stdout:3753: snap_remove snap 369 2024-01-13T18:13:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:12 smithi099 ceph-mon[138788]: osdmap e808: 8 total, 8 up, 8 in 2024-01-13T18:13:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:12 smithi099 ceph-mon[138788]: pgmap v925: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 394 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 5 op/s 2024-01-13T18:13:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:12 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:13:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:12 smithi099 ceph-mon[138788]: osdmap e809: 8 total, 8 up, 8 in 2024-01-13T18:13:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:12 smithi084 ceph-mon[116404]: osdmap e808: 8 total, 8 up, 8 in 2024-01-13T18:13:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:12 smithi084 ceph-mon[116404]: pgmap v925: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 394 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 5 op/s 2024-01-13T18:13:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:12 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:13:13.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:12 smithi084 ceph-mon[116404]: osdmap e809: 8 total, 8 up, 8 in 2024-01-13T18:13:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:12 smithi084 ceph-mon[119097]: osdmap e808: 8 total, 8 up, 8 in 2024-01-13T18:13:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:12 smithi084 ceph-mon[119097]: pgmap v925: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 394 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 5 op/s 2024-01-13T18:13:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:12 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:13:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:12 smithi084 ceph-mon[119097]: osdmap e809: 8 total, 8 up, 8 in 2024-01-13T18:13:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:3753: done (2 left) 2024-01-13T18:13:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:3754: rmattr oid 1 current snap is 374 2024-01-13T18:13:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:3755: snap_remove snap 347 2024-01-13T18:13:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:13:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:13:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:13:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:13 smithi099 ceph-mon[138788]: osdmap e810: 8 total, 8 up, 8 in 2024-01-13T18:13:14.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:13:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:13:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:13:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:13 smithi084 ceph-mon[116404]: osdmap e810: 8 total, 8 up, 8 in 2024-01-13T18:13:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:13:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:13:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:13:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:13 smithi084 ceph-mon[119097]: osdmap e810: 8 total, 8 up, 8 in 2024-01-13T18:13:14.757 INFO:tasks.rados.rados.0.smithi084.stdout:3755: done (3 left) 2024-01-13T18:13:14.758 INFO:tasks.rados.rados.0.smithi084.stdout:3756: snap_create 2024-01-13T18:13:14.758 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 1792 (ObjNum 1096 snap 350 seq_num 1096) dirty exists 2024-01-13T18:13:14.758 INFO:tasks.rados.rados.0.smithi084.stdout:3752: finishing rollback tid 0 to smithi084102331-2 2024-01-13T18:13:14.758 INFO:tasks.rados.rados.0.smithi084.stdout:3752: finishing rollback tid 1 to smithi084102331-2 2024-01-13T18:13:14.758 INFO:tasks.rados.rados.0.smithi084.stdout:3752: finishing rollback tid 2 to smithi084102331-2 2024-01-13T18:13:14.758 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1939 (ObjNum 1113 snap 357 seq_num 1113) dirty exists 2024-01-13T18:13:14.758 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 1875 (ObjNum 1146 snap 371 seq_num 1146) dirty exists 2024-01-13T18:13:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:14 smithi099 ceph-mon[138788]: pgmap v928: 121 pgs: 121 active+clean; 395 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-01-13T18:13:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:14 smithi099 ceph-mon[138788]: osdmap e811: 8 total, 8 up, 8 in 2024-01-13T18:13:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:14 smithi084 ceph-mon[116404]: pgmap v928: 121 pgs: 121 active+clean; 395 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-01-13T18:13:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:14 smithi084 ceph-mon[116404]: osdmap e811: 8 total, 8 up, 8 in 2024-01-13T18:13:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:14 smithi084 ceph-mon[119097]: pgmap v928: 121 pgs: 121 active+clean; 395 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-01-13T18:13:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:14 smithi084 ceph-mon[119097]: osdmap e811: 8 total, 8 up, 8 in 2024-01-13T18:13:15.756 INFO:tasks.rados.rados.0.smithi084.stdout:3751: done (3 left) 2024-01-13T18:13:15.756 INFO:tasks.rados.rados.0.smithi084.stdout:3752: done (2 left) 2024-01-13T18:13:15.756 INFO:tasks.rados.rados.0.smithi084.stdout:3754: done (1 left) 2024-01-13T18:13:15.756 INFO:tasks.rados.rados.0.smithi084.stdout:3756: done (0 left) 2024-01-13T18:13:15.756 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 375 2024-01-13T18:13:15.756 INFO:tasks.rados.rados.0.smithi084.stdout:3757: seq_num 1150 ranges {1277952=65536} 2024-01-13T18:13:15.763 INFO:tasks.rados.rados.0.smithi084.stdout:3757: writing smithi084102331-29 from 1277952 to 1343488 tid 1 2024-01-13T18:13:15.763 INFO:tasks.rados.rados.0.smithi084.stdout:3758: delete oid 37 current snap is 375 2024-01-13T18:13:15.769 INFO:tasks.rados.rados.0.smithi084.stdout:3757: finishing write tid 1 to smithi084102331-29 2024-01-13T18:13:15.770 INFO:tasks.rados.rados.0.smithi084.stdout:3758: done (1 left) 2024-01-13T18:13:15.770 INFO:tasks.rados.rados.0.smithi084.stdout:3759: copy_from oid 33 from oid 15 current snap is 375 2024-01-13T18:13:15.770 INFO:tasks.rados.rados.0.smithi084.stdout:3760: read oid 20 snap 362 2024-01-13T18:13:15.770 INFO:tasks.rados.rados.0.smithi084.stdout:3760: expect (ObjNum 1101 snap 354 seq_num 1101) 2024-01-13T18:13:15.770 INFO:tasks.rados.rados.0.smithi084.stdout:3761: copy_from oid 39 from oid 7 current snap is 375 2024-01-13T18:13:15.770 INFO:tasks.rados.rados.0.smithi084.stdout:3762: snap_create 2024-01-13T18:13:15.770 INFO:tasks.rados.rados.0.smithi084.stdout:3757: finishing write tid 2 to smithi084102331-29 2024-01-13T18:13:15.771 INFO:tasks.rados.rados.0.smithi084.stdout:3757: finishing write tid 3 to smithi084102331-29 2024-01-13T18:13:15.771 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1761 (ObjNum 1150 snap 375 seq_num 1150) dirty exists 2024-01-13T18:13:15.771 INFO:tasks.rados.rados.0.smithi084.stdout:3757: left oid 29 (ObjNum 1150 snap 375 seq_num 1150) 2024-01-13T18:13:15.780 INFO:tasks.rados.rados.0.smithi084.stdout:3760: expect (ObjNum 1101 snap 354 seq_num 1101) 2024-01-13T18:13:15.821 INFO:tasks.rados.rados.0.smithi084.stdout:3761: finishing copy_from to smithi084102331-39 2024-01-13T18:13:15.821 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1674 (ObjNum 942 snap 298 seq_num 942) dirty exists 2024-01-13T18:13:15.821 INFO:tasks.rados.rados.0.smithi084.stdout:3761: finishing copy_from racing read to smithi084102331-39 2024-01-13T18:13:15.821 INFO:tasks.rados.rados.0.smithi084.stdout:3759: finishing copy_from to smithi084102331-33 2024-01-13T18:13:15.821 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1868 (ObjNum 1149 snap 372 seq_num 1149) dirty exists 2024-01-13T18:13:15.821 INFO:tasks.rados.rados.0.smithi084.stdout:3759: finishing copy_from racing read to smithi084102331-33 2024-01-13T18:13:16.766 INFO:tasks.rados.rados.0.smithi084.stdout:3757: done (4 left) 2024-01-13T18:13:16.766 INFO:tasks.rados.rados.0.smithi084.stdout:3759: done (3 left) 2024-01-13T18:13:16.767 INFO:tasks.rados.rados.0.smithi084.stdout:3760: done (2 left) 2024-01-13T18:13:16.767 INFO:tasks.rados.rados.0.smithi084.stdout:3761: done (1 left) 2024-01-13T18:13:16.767 INFO:tasks.rados.rados.0.smithi084.stdout:3762: done (0 left) 2024-01-13T18:13:16.767 INFO:tasks.rados.rados.0.smithi084.stdout:3763: delete oid 8 current snap is 376 2024-01-13T18:13:16.771 INFO:tasks.rados.rados.0.smithi084.stdout:3763: done (0 left) 2024-01-13T18:13:16.771 INFO:tasks.rados.rados.0.smithi084.stdout:3764: snap_remove snap 329 2024-01-13T18:13:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:16 smithi099 ceph-mon[138788]: osdmap e812: 8 total, 8 up, 8 in 2024-01-13T18:13:17.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:16 smithi099 ceph-mon[138788]: pgmap v931: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 395 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 12 KiB/s wr, 5 op/s 2024-01-13T18:13:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:16 smithi084 ceph-mon[116404]: osdmap e812: 8 total, 8 up, 8 in 2024-01-13T18:13:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:16 smithi084 ceph-mon[116404]: pgmap v931: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 395 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 12 KiB/s wr, 5 op/s 2024-01-13T18:13:17.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:16 smithi084 ceph-mon[119097]: osdmap e812: 8 total, 8 up, 8 in 2024-01-13T18:13:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:16 smithi084 ceph-mon[119097]: pgmap v931: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 395 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 12 KiB/s wr, 5 op/s 2024-01-13T18:13:17.747 INFO:tasks.rados.rados.0.smithi084.stdout:3764: done (0 left) 2024-01-13T18:13:17.747 INFO:tasks.rados.rados.0.smithi084.stdout:3765: rmattr oid 5 current snap is 376 2024-01-13T18:13:17.747 INFO:tasks.rados.rados.0.smithi084.stdout:3766: snap_create 2024-01-13T18:13:17.773 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 1786 (ObjNum 1110 snap 357 seq_num 1110) dirty exists 2024-01-13T18:13:18.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:17 smithi099 ceph-mon[138788]: osdmap e813: 8 total, 8 up, 8 in 2024-01-13T18:13:18.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:17 smithi099 ceph-mon[138788]: osdmap e814: 8 total, 8 up, 8 in 2024-01-13T18:13:18.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:17 smithi084 ceph-mon[116404]: osdmap e813: 8 total, 8 up, 8 in 2024-01-13T18:13:18.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:17 smithi084 ceph-mon[116404]: osdmap e814: 8 total, 8 up, 8 in 2024-01-13T18:13:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:17 smithi084 ceph-mon[119097]: osdmap e813: 8 total, 8 up, 8 in 2024-01-13T18:13:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:17 smithi084 ceph-mon[119097]: osdmap e814: 8 total, 8 up, 8 in 2024-01-13T18:13:18.746 INFO:tasks.rados.rados.0.smithi084.stdout:3765: done (1 left) 2024-01-13T18:13:18.746 INFO:tasks.rados.rados.0.smithi084.stdout:3766: done (0 left) 2024-01-13T18:13:18.747 INFO:tasks.rados.rados.0.smithi084.stdout:3767: snap_remove snap 344 2024-01-13T18:13:19.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:18 smithi099 ceph-mon[138788]: pgmap v934: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 389 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 354 KiB/s wr, 15 op/s 2024-01-13T18:13:19.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:18 smithi099 ceph-mon[138788]: osdmap e815: 8 total, 8 up, 8 in 2024-01-13T18:13:19.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:18 smithi084 ceph-mon[116404]: pgmap v934: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 389 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 354 KiB/s wr, 15 op/s 2024-01-13T18:13:19.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:18 smithi084 ceph-mon[116404]: osdmap e815: 8 total, 8 up, 8 in 2024-01-13T18:13:19.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:18 smithi084 ceph-mon[119097]: pgmap v934: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 389 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 354 KiB/s wr, 15 op/s 2024-01-13T18:13:19.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:18 smithi084 ceph-mon[119097]: osdmap e815: 8 total, 8 up, 8 in 2024-01-13T18:13:19.748 INFO:tasks.rados.rados.0.smithi084.stdout:3767: done (0 left) 2024-01-13T18:13:19.748 INFO:tasks.rados.rados.0.smithi084.stdout:3768: snap_remove snap 368 2024-01-13T18:13:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:13:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:13:20] "GET /metrics HTTP/1.1" 200 36192 "" "Prometheus/2.43.0" 2024-01-13T18:13:20.753 INFO:tasks.rados.rados.0.smithi084.stdout:3768: done (0 left) 2024-01-13T18:13:20.753 INFO:tasks.rados.rados.0.smithi084.stdout:3769: snap_create 2024-01-13T18:13:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:20 smithi099 ceph-mon[138788]: osdmap e816: 8 total, 8 up, 8 in 2024-01-13T18:13:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:21.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:20 smithi099 ceph-mon[138788]: pgmap v937: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 391 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2024-01-13T18:13:21.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:20 smithi084 ceph-mon[116404]: osdmap e816: 8 total, 8 up, 8 in 2024-01-13T18:13:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:20 smithi084 ceph-mon[116404]: pgmap v937: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 391 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2024-01-13T18:13:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:20 smithi084 ceph-mon[119097]: osdmap e816: 8 total, 8 up, 8 in 2024-01-13T18:13:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:20 smithi084 ceph-mon[119097]: pgmap v937: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 391 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2024-01-13T18:13:21.768 INFO:tasks.rados.rados.0.smithi084.stdout:3769: done (0 left) 2024-01-13T18:13:21.769 INFO:tasks.rados.rados.0.smithi084.stdout:3770: read oid 36 snap 360 2024-01-13T18:13:21.769 INFO:tasks.rados.rados.0.smithi084.stdout:3770: expect (ObjNum 1073 snap 340 seq_num 1073) 2024-01-13T18:13:21.769 INFO:tasks.rados.rados.0.smithi084.stdout:3771: read oid 16 snap -1 2024-01-13T18:13:21.769 INFO:tasks.rados.rados.0.smithi084.stdout:3771: expect (ObjNum 1088 snap 348 seq_num 1088) 2024-01-13T18:13:21.769 INFO:tasks.rados.rados.0.smithi084.stdout:3772: copy_from oid 17 from oid 1 current snap is 378 2024-01-13T18:13:21.769 INFO:tasks.rados.rados.0.smithi084.stdout:3773: read oid 23 snap -1 2024-01-13T18:13:21.769 INFO:tasks.rados.rados.0.smithi084.stdout:3773: expect (ObjNum 1073 snap 340 seq_num 1073) 2024-01-13T18:13:21.769 INFO:tasks.rados.rados.0.smithi084.stdout:3774: copy_from oid 12 from oid 4 current snap is 378 2024-01-13T18:13:21.769 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 378 2024-01-13T18:13:21.769 INFO:tasks.rados.rados.0.smithi084.stdout:3775: seq_num 1153 ranges {12869632=114688} 2024-01-13T18:13:21.839 INFO:tasks.rados.rados.0.smithi084.stdout:3775: writing smithi084102331-18 from 12869632 to 12984320 tid 1 2024-01-13T18:13:21.839 INFO:tasks.rados.rados.0.smithi084.stdout:3776: copy_from oid 24 from oid 30 current snap is 378 2024-01-13T18:13:21.839 INFO:tasks.rados.rados.0.smithi084.stdout:3772: finishing copy_from to smithi084102331-17 2024-01-13T18:13:21.839 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1875 (ObjNum 1146 snap 371 seq_num 1146) dirty exists 2024-01-13T18:13:21.839 INFO:tasks.rados.rados.0.smithi084.stdout:3777: snap_remove snap 362 2024-01-13T18:13:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:21 smithi099 ceph-mon[138788]: osdmap e817: 8 total, 8 up, 8 in 2024-01-13T18:13:22.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:21 smithi084 ceph-mon[116404]: osdmap e817: 8 total, 8 up, 8 in 2024-01-13T18:13:22.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:21 smithi084 ceph-mon[119097]: osdmap e817: 8 total, 8 up, 8 in 2024-01-13T18:13:22.747 INFO:tasks.rados.rados.0.smithi084.stdout:3777: done (7 left) 2024-01-13T18:13:22.747 INFO:tasks.rados.rados.0.smithi084.stdout:3778: rollback oid 34 current snap is 378 2024-01-13T18:13:22.747 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 349 2024-01-13T18:13:22.747 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 378 2024-01-13T18:13:22.747 INFO:tasks.rados.rados.0.smithi084.stdout:3779: seq_num 1154 ranges {8609792=131072} 2024-01-13T18:13:22.795 INFO:tasks.rados.rados.0.smithi084.stdout:3779: writing smithi084102331-32 from 8609792 to 8740864 tid 1 2024-01-13T18:13:22.795 INFO:tasks.rados.rados.0.smithi084.stdout:3780: read oid 41 snap 364 2024-01-13T18:13:22.796 INFO:tasks.rados.rados.0.smithi084.stdout:3780: expect (ObjNum 1096 snap 350 seq_num 1096) 2024-01-13T18:13:22.796 INFO:tasks.rados.rados.0.smithi084.stdout:3781: copy_from oid 25 from oid 42 current snap is 378 2024-01-13T18:13:22.796 INFO:tasks.rados.rados.0.smithi084.stdout:3771: expect (ObjNum 1088 snap 348 seq_num 1088) 2024-01-13T18:13:22.980 INFO:tasks.rados.rados.0.smithi084.stdout:3772: finishing copy_from racing read to smithi084102331-17 2024-01-13T18:13:22.980 INFO:tasks.rados.rados.0.smithi084.stdout:3770: expect (ObjNum 1073 snap 340 seq_num 1073) 2024-01-13T18:13:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:22 smithi099 ceph-mon[138788]: osdmap e818: 8 total, 8 up, 8 in 2024-01-13T18:13:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:22 smithi099 ceph-mon[138788]: pgmap v940: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 351 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 1 op/s 2024-01-13T18:13:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:22 smithi099 ceph-mon[138788]: osdmap e819: 8 total, 8 up, 8 in 2024-01-13T18:13:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:22 smithi084 ceph-mon[116404]: osdmap e818: 8 total, 8 up, 8 in 2024-01-13T18:13:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:22 smithi084 ceph-mon[116404]: pgmap v940: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 351 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 1 op/s 2024-01-13T18:13:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:22 smithi084 ceph-mon[116404]: osdmap e819: 8 total, 8 up, 8 in 2024-01-13T18:13:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:22 smithi084 ceph-mon[119097]: osdmap e818: 8 total, 8 up, 8 in 2024-01-13T18:13:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:22 smithi084 ceph-mon[119097]: pgmap v940: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 351 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 1 op/s 2024-01-13T18:13:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:22 smithi084 ceph-mon[119097]: osdmap e819: 8 total, 8 up, 8 in 2024-01-13T18:13:23.444 INFO:tasks.rados.rados.0.smithi084.stdout:3773: expect (ObjNum 1073 snap 340 seq_num 1073) 2024-01-13T18:13:23.913 INFO:tasks.rados.rados.0.smithi084.stdout:3774: finishing copy_from to smithi084102331-12 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1663 (ObjNum 1115 snap 358 seq_num 1115) dirty exists 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:3774: finishing copy_from racing read to smithi084102331-12 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:3770: done (10 left) 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:3771: done (9 left) 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:3772: done (8 left) 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:3773: done (7 left) 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:3774: done (6 left) 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 378 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:3775: finishing write tid 1 to smithi084102331-18 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:3775: finishing write tid 2 to smithi084102331-18 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:3775: finishing write tid 3 to smithi084102331-18 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1682 (ObjNum 1153 snap 378 seq_num 1153) dirty exists 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:3775: left oid 18 (ObjNum 1153 snap 378 seq_num 1153) 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:3776: finishing copy_from to smithi084102331-24 2024-01-13T18:13:23.914 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1751 (ObjNum 1087 snap 348 seq_num 1087) dirty exists 2024-01-13T18:13:23.915 INFO:tasks.rados.rados.0.smithi084.stdout:3776: finishing copy_from racing read to smithi084102331-24 2024-01-13T18:13:23.915 INFO:tasks.rados.rados.0.smithi084.stdout:3778: finishing rollback tid 0 to smithi084102331-34 2024-01-13T18:13:23.915 INFO:tasks.rados.rados.0.smithi084.stdout:3782: seq_num 1155 ranges {4128768=147456} 2024-01-13T18:13:23.935 INFO:tasks.rados.rados.0.smithi084.stdout:3782: writing smithi084102331-16 from 4128768 to 4276224 tid 1 2024-01-13T18:13:23.935 INFO:tasks.rados.rados.0.smithi084.stdout:3775: done (6 left) 2024-01-13T18:13:23.935 INFO:tasks.rados.rados.0.smithi084.stdout:3776: done (5 left) 2024-01-13T18:13:23.935 INFO:tasks.rados.rados.0.smithi084.stdout:3783: delete oid 14 current snap is 378 2024-01-13T18:13:23.936 INFO:tasks.rados.rados.0.smithi084.stdout:3778: finishing rollback tid 1 to smithi084102331-34 2024-01-13T18:13:23.936 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 1788 (ObjNum 3361 snap 0 seq_num 4038324592) dirty dne 2024-01-13T18:13:23.936 INFO:tasks.rados.rados.0.smithi084.stdout:3779: finishing write tid 1 to smithi084102331-32 2024-01-13T18:13:23.936 INFO:tasks.rados.rados.0.smithi084.stdout:3779: finishing write tid 2 to smithi084102331-32 2024-01-13T18:13:23.936 INFO:tasks.rados.rados.0.smithi084.stdout:3779: finishing write tid 3 to smithi084102331-32 2024-01-13T18:13:23.936 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 1914 (ObjNum 1154 snap 378 seq_num 1154) dirty exists 2024-01-13T18:13:23.936 INFO:tasks.rados.rados.0.smithi084.stdout:3779: left oid 32 (ObjNum 1154 snap 378 seq_num 1154) 2024-01-13T18:13:23.936 INFO:tasks.rados.rados.0.smithi084.stdout:3781: finishing copy_from to smithi084102331-25 2024-01-13T18:13:23.936 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1510 (ObjNum 979 snap 309 seq_num 979) dirty exists 2024-01-13T18:13:23.936 INFO:tasks.rados.rados.0.smithi084.stdout:3781: finishing copy_from racing read to smithi084102331-25 2024-01-13T18:13:23.936 INFO:tasks.rados.rados.0.smithi084.stdout:3780: expect (ObjNum 1096 snap 350 seq_num 1096) 2024-01-13T18:13:24.246 INFO:tasks.rados.rados.0.smithi084.stdout:3782: finishing write tid 1 to smithi084102331-16 2024-01-13T18:13:24.246 INFO:tasks.rados.rados.0.smithi084.stdout:3782: finishing write tid 2 to smithi084102331-16 2024-01-13T18:13:24.246 INFO:tasks.rados.rados.0.smithi084.stdout:3778: done (5 left) 2024-01-13T18:13:24.246 INFO:tasks.rados.rados.0.smithi084.stdout:3779: done (4 left) 2024-01-13T18:13:24.246 INFO:tasks.rados.rados.0.smithi084.stdout:3780: done (3 left) 2024-01-13T18:13:24.246 INFO:tasks.rados.rados.0.smithi084.stdout:3781: done (2 left) 2024-01-13T18:13:24.246 INFO:tasks.rados.rados.0.smithi084.stdout:3783: done (1 left) 2024-01-13T18:13:24.246 INFO:tasks.rados.rados.0.smithi084.stdout:3784: copy_from oid 43 from oid 10 current snap is 378 2024-01-13T18:13:24.246 INFO:tasks.rados.rados.0.smithi084.stdout:3782: finishing write tid 3 to smithi084102331-16 2024-01-13T18:13:24.246 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1633 (ObjNum 1155 snap 378 seq_num 1155) dirty exists 2024-01-13T18:13:24.246 INFO:tasks.rados.rados.0.smithi084.stdout:3782: left oid 16 (ObjNum 1155 snap 378 seq_num 1155) 2024-01-13T18:13:24.247 INFO:tasks.rados.rados.0.smithi084.stdout:3782: done (1 left) 2024-01-13T18:13:24.247 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 378 2024-01-13T18:13:24.247 INFO:tasks.rados.rados.0.smithi084.stdout:3785: seq_num 1157 ranges {3276800=180224} 2024-01-13T18:13:24.264 INFO:tasks.rados.rados.0.smithi084.stdout:3785: writing smithi084102331-38 from 3276800 to 3457024 tid 1 2024-01-13T18:13:24.265 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 378 2024-01-13T18:13:24.265 INFO:tasks.rados.rados.0.smithi084.stdout:3786: seq_num 1158 ranges {0=196608} 2024-01-13T18:13:24.266 INFO:tasks.rados.rados.0.smithi084.stdout:3786: writing smithi084102331-14 from 0 to 196608 tid 1 2024-01-13T18:13:24.266 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 378 2024-01-13T18:13:24.267 INFO:tasks.rados.rados.0.smithi084.stdout:3787: seq_num 1159 ranges {5939200=212992} 2024-01-13T18:13:24.299 INFO:tasks.rados.rados.0.smithi084.stdout:3787: writing smithi084102331-15 from 5939200 to 6152192 tid 1 2024-01-13T18:13:24.299 INFO:tasks.rados.rados.0.smithi084.stdout:3788: snap_remove snap 377 2024-01-13T18:13:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:3788: done (4 left) 2024-01-13T18:13:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:3789: rollback oid 40 current snap is 378 2024-01-13T18:13:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 370 2024-01-13T18:13:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:3785: finishing write tid 1 to smithi084102331-38 2024-01-13T18:13:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:3786: finishing write tid 1 to smithi084102331-14 2024-01-13T18:13:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:3786: finishing write tid 2 to smithi084102331-14 2024-01-13T18:13:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:3785: finishing write tid 2 to smithi084102331-38 2024-01-13T18:13:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:3786: finishing write tid 3 to smithi084102331-14 2024-01-13T18:13:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1689 (ObjNum 1158 snap 378 seq_num 1158) dirty exists 2024-01-13T18:13:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:3786: left oid 14 (ObjNum 1158 snap 378 seq_num 1158) 2024-01-13T18:13:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:3785: finishing write tid 3 to smithi084102331-38 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1918 (ObjNum 1157 snap 378 seq_num 1157) dirty exists 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:3785: left oid 38 (ObjNum 1157 snap 378 seq_num 1157) 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:3784: finishing copy_from to smithi084102331-43 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1674 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:3784: finishing copy_from racing read to smithi084102331-43 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:3787: finishing write tid 1 to smithi084102331-15 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:3787: finishing write tid 2 to smithi084102331-15 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:3787: finishing write tid 3 to smithi084102331-15 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1917 (ObjNum 1159 snap 378 seq_num 1159) dirty exists 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:3787: left oid 15 (ObjNum 1159 snap 378 seq_num 1159) 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:3784: done (4 left) 2024-01-13T18:13:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:3785: done (3 left) 2024-01-13T18:13:25.184 INFO:tasks.rados.rados.0.smithi084.stdout:3786: done (2 left) 2024-01-13T18:13:25.184 INFO:tasks.rados.rados.0.smithi084.stdout:3787: done (1 left) 2024-01-13T18:13:25.184 INFO:tasks.rados.rados.0.smithi084.stdout:3790: rollback oid 22 current snap is 378 2024-01-13T18:13:25.184 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 356 2024-01-13T18:13:25.184 INFO:tasks.rados.rados.0.smithi084.stdout:3791: delete oid 11 current snap is 378 2024-01-13T18:13:25.190 INFO:tasks.rados.rados.0.smithi084.stdout:3791: done (2 left) 2024-01-13T18:13:25.190 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 378 2024-01-13T18:13:25.190 INFO:tasks.rados.rados.0.smithi084.stdout:3792: seq_num 1161 ranges {1884160=245760} 2024-01-13T18:13:25.202 INFO:tasks.rados.rados.0.smithi084.stdout:3792: writing smithi084102331-4 from 1884160 to 2129920 tid 1 2024-01-13T18:13:25.202 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 378 2024-01-13T18:13:25.202 INFO:tasks.rados.rados.0.smithi084.stdout:3793: seq_num 1162 ranges {1384448=270336} 2024-01-13T18:13:25.211 INFO:tasks.rados.rados.0.smithi084.stdout:3793: writing smithi084102331-39 from 1384448 to 1654784 tid 1 2024-01-13T18:13:25.212 INFO:tasks.rados.rados.0.smithi084.stdout:3794: snap_remove snap 367 2024-01-13T18:13:25.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:25 smithi084 ceph-mon[116404]: pgmap v942: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 343 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 234 B/s rd, 1.3 MiB/s wr, 2 op/s 2024-01-13T18:13:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:25 smithi084 ceph-mon[119097]: pgmap v942: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 343 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 234 B/s rd, 1.3 MiB/s wr, 2 op/s 2024-01-13T18:13:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:25 smithi099 ceph-mon[138788]: pgmap v942: 121 pgs: 3 active+clean+snaptrim, 118 active+clean; 343 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 234 B/s rd, 1.3 MiB/s wr, 2 op/s 2024-01-13T18:13:26.190 INFO:tasks.rados.rados.0.smithi084.stdout:3794: done (4 left) 2024-01-13T18:13:26.190 INFO:tasks.rados.rados.0.smithi084.stdout:3795: delete oid 24 current snap is 378 2024-01-13T18:13:26.190 INFO:tasks.rados.rados.0.smithi084.stdout:3789: finishing rollback tid 0 to smithi084102331-40 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:3789: finishing rollback tid 1 to smithi084102331-40 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:3789: finishing rollback tid 2 to smithi084102331-40 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1764 (ObjNum 1114 snap 358 seq_num 1114) dirty exists 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:3790: finishing rollback tid 1 to smithi084102331-22 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:3790: finishing rollback tid 2 to smithi084102331-22 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 1977 (ObjNum 1080 snap 342 seq_num 1080) dirty exists 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:3792: finishing write tid 1 to smithi084102331-4 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:3792: finishing write tid 2 to smithi084102331-4 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:3792: finishing write tid 3 to smithi084102331-4 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 1877 (ObjNum 1161 snap 378 seq_num 1161) dirty exists 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:3792: left oid 4 (ObjNum 1161 snap 378 seq_num 1161) 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:3793: finishing write tid 1 to smithi084102331-39 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:3793: finishing write tid 2 to smithi084102331-39 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:3793: finishing write tid 3 to smithi084102331-39 2024-01-13T18:13:26.191 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 1795 (ObjNum 1162 snap 378 seq_num 1162) dirty exists 2024-01-13T18:13:26.192 INFO:tasks.rados.rados.0.smithi084.stdout:3793: left oid 39 (ObjNum 1162 snap 378 seq_num 1162) 2024-01-13T18:13:26.203 INFO:tasks.rados.rados.0.smithi084.stdout:3789: done (4 left) 2024-01-13T18:13:26.203 INFO:tasks.rados.rados.0.smithi084.stdout:3790: done (3 left) 2024-01-13T18:13:26.203 INFO:tasks.rados.rados.0.smithi084.stdout:3792: done (2 left) 2024-01-13T18:13:26.203 INFO:tasks.rados.rados.0.smithi084.stdout:3793: done (1 left) 2024-01-13T18:13:26.203 INFO:tasks.rados.rados.0.smithi084.stdout:3795: done (0 left) 2024-01-13T18:13:26.203 INFO:tasks.rados.rados.0.smithi084.stdout:3796: read oid 22 snap -1 2024-01-13T18:13:26.203 INFO:tasks.rados.rados.0.smithi084.stdout:3796: expect (ObjNum 1080 snap 342 seq_num 1080) 2024-01-13T18:13:26.203 INFO:tasks.rados.rados.0.smithi084.stdout:3797: snap_remove snap 376 2024-01-13T18:13:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:26 smithi099 ceph-mon[138788]: osdmap e820: 8 total, 8 up, 8 in 2024-01-13T18:13:26.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:26 smithi084 ceph-mon[116404]: osdmap e820: 8 total, 8 up, 8 in 2024-01-13T18:13:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:26 smithi084 ceph-mon[119097]: osdmap e820: 8 total, 8 up, 8 in 2024-01-13T18:13:27.201 INFO:tasks.rados.rados.0.smithi084.stdout:3797: done (1 left) 2024-01-13T18:13:27.201 INFO:tasks.rados.rados.0.smithi084.stdout:3798: read oid 19 snap -1 2024-01-13T18:13:27.201 INFO:tasks.rados.rados.0.smithi084.stdout:3798: expect (ObjNum 1139 snap 367 seq_num 1139) 2024-01-13T18:13:27.201 INFO:tasks.rados.rados.0.smithi084.stdout:3799: delete oid 32 current snap is 378 2024-01-13T18:13:27.201 INFO:tasks.rados.rados.0.smithi084.stdout:3796: expect (ObjNum 1080 snap 342 seq_num 1080) 2024-01-13T18:13:27.615 INFO:tasks.rados.rados.0.smithi084.stdout:3798: expect (ObjNum 1139 snap 367 seq_num 1139) 2024-01-13T18:13:27.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:27 smithi099 ceph-mon[138788]: pgmap v944: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 345 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.4 MiB/s rd, 421 KiB/s wr, 3 op/s 2024-01-13T18:13:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:27 smithi099 ceph-mon[138788]: osdmap e821: 8 total, 8 up, 8 in 2024-01-13T18:13:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:27 smithi084 ceph-mon[116404]: pgmap v944: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 345 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.4 MiB/s rd, 421 KiB/s wr, 3 op/s 2024-01-13T18:13:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:27 smithi084 ceph-mon[116404]: osdmap e821: 8 total, 8 up, 8 in 2024-01-13T18:13:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:27 smithi084 ceph-mon[119097]: pgmap v944: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 345 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 4.4 MiB/s rd, 421 KiB/s wr, 3 op/s 2024-01-13T18:13:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:27 smithi084 ceph-mon[119097]: osdmap e821: 8 total, 8 up, 8 in 2024-01-13T18:13:28.197 INFO:tasks.rados.rados.0.smithi084.stdout:3796: done (2 left) 2024-01-13T18:13:28.197 INFO:tasks.rados.rados.0.smithi084.stdout:3798: done (1 left) 2024-01-13T18:13:28.197 INFO:tasks.rados.rados.0.smithi084.stdout:3799: done (0 left) 2024-01-13T18:13:28.197 INFO:tasks.rados.rados.0.smithi084.stdout:3800: snap_remove snap 361 2024-01-13T18:13:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:28 smithi099 ceph-mon[138788]: osdmap e822: 8 total, 8 up, 8 in 2024-01-13T18:13:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:28 smithi099 ceph-mon[138788]: osdmap e823: 8 total, 8 up, 8 in 2024-01-13T18:13:28.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:28 smithi084 ceph-mon[116404]: osdmap e822: 8 total, 8 up, 8 in 2024-01-13T18:13:28.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:28 smithi084 ceph-mon[116404]: osdmap e823: 8 total, 8 up, 8 in 2024-01-13T18:13:28.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:28 smithi084 ceph-mon[119097]: osdmap e822: 8 total, 8 up, 8 in 2024-01-13T18:13:28.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:28 smithi084 ceph-mon[119097]: osdmap e823: 8 total, 8 up, 8 in 2024-01-13T18:13:29.215 INFO:tasks.rados.rados.0.smithi084.stdout:3800: done (0 left) 2024-01-13T18:13:29.215 INFO:tasks.rados.rados.0.smithi084.stdout:3801: delete oid 2 current snap is 378 2024-01-13T18:13:29.227 INFO:tasks.rados.rados.0.smithi084.stdout:3801: done (0 left) 2024-01-13T18:13:29.227 INFO:tasks.rados.rados.0.smithi084.stdout:3802: rollback oid 12 current snap is 378 2024-01-13T18:13:29.228 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 370 2024-01-13T18:13:29.228 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 378 2024-01-13T18:13:29.229 INFO:tasks.rados.rados.0.smithi084.stdout:3803: seq_num 1166 ranges {0=335872} 2024-01-13T18:13:29.230 INFO:tasks.rados.rados.0.smithi084.stdout:3803: writing smithi084102331-37 from 0 to 335872 tid 1 2024-01-13T18:13:29.230 INFO:tasks.rados.rados.0.smithi084.stdout:3804: copy_from oid 8 from oid 27 current snap is 378 2024-01-13T18:13:29.231 INFO:tasks.rados.rados.0.smithi084.stdout:3805: snap_remove snap 360 2024-01-13T18:13:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:29 smithi099 ceph-mon[138788]: pgmap v948: 121 pgs: 121 active+clean; 356 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 24 MiB/s rd, 4.6 MiB/s wr, 15 op/s 2024-01-13T18:13:29.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:29 smithi084 ceph-mon[116404]: pgmap v948: 121 pgs: 121 active+clean; 356 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 24 MiB/s rd, 4.6 MiB/s wr, 15 op/s 2024-01-13T18:13:29.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:29 smithi084 ceph-mon[119097]: pgmap v948: 121 pgs: 121 active+clean; 356 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 24 MiB/s rd, 4.6 MiB/s wr, 15 op/s 2024-01-13T18:13:30.223 INFO:tasks.rados.rados.0.smithi084.stdout:3805: done (3 left) 2024-01-13T18:13:30.223 INFO:tasks.rados.rados.0.smithi084.stdout:3806: snap_create 2024-01-13T18:13:30.223 INFO:tasks.rados.rados.0.smithi084.stdout:3803: finishing write tid 1 to smithi084102331-37 2024-01-13T18:13:30.223 INFO:tasks.rados.rados.0.smithi084.stdout:3802: finishing rollback tid 0 to smithi084102331-12 2024-01-13T18:13:30.223 INFO:tasks.rados.rados.0.smithi084.stdout:3802: finishing rollback tid 1 to smithi084102331-12 2024-01-13T18:13:30.223 INFO:tasks.rados.rados.0.smithi084.stdout:3803: finishing write tid 2 to smithi084102331-37 2024-01-13T18:13:30.223 INFO:tasks.rados.rados.0.smithi084.stdout:3802: finishing rollback tid 2 to smithi084102331-12 2024-01-13T18:13:30.223 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 1996 (ObjNum 1140 snap 368 seq_num 1140) dirty exists 2024-01-13T18:13:30.224 INFO:tasks.rados.rados.0.smithi084.stdout:3803: finishing write tid 3 to smithi084102331-37 2024-01-13T18:13:30.224 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1870 (ObjNum 1166 snap 378 seq_num 1166) dirty exists 2024-01-13T18:13:30.224 INFO:tasks.rados.rados.0.smithi084.stdout:3803: left oid 37 (ObjNum 1166 snap 378 seq_num 1166) 2024-01-13T18:13:30.224 INFO:tasks.rados.rados.0.smithi084.stdout:3804: finishing copy_from to smithi084102331-8 2024-01-13T18:13:30.224 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1412 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:13:30.224 INFO:tasks.rados.rados.0.smithi084.stdout:3804: finishing copy_from racing read to smithi084102331-8 2024-01-13T18:13:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:30 smithi099 ceph-mon[138788]: osdmap e824: 8 total, 8 up, 8 in 2024-01-13T18:13:30.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:30 smithi084 ceph-mon[116404]: osdmap e824: 8 total, 8 up, 8 in 2024-01-13T18:13:30.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:13:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:13:30] "GET /metrics HTTP/1.1" 200 36192 "" "Prometheus/2.43.0" 2024-01-13T18:13:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:30 smithi084 ceph-mon[119097]: osdmap e824: 8 total, 8 up, 8 in 2024-01-13T18:13:31.222 INFO:tasks.rados.rados.0.smithi084.stdout:3802: done (3 left) 2024-01-13T18:13:31.222 INFO:tasks.rados.rados.0.smithi084.stdout:3803: done (2 left) 2024-01-13T18:13:31.222 INFO:tasks.rados.rados.0.smithi084.stdout:3804: done (1 left) 2024-01-13T18:13:31.222 INFO:tasks.rados.rados.0.smithi084.stdout:3806: done (0 left) 2024-01-13T18:13:31.222 INFO:tasks.rados.rados.0.smithi084.stdout:3807: read oid 29 snap -1 2024-01-13T18:13:31.222 INFO:tasks.rados.rados.0.smithi084.stdout:3807: expect (ObjNum 1150 snap 375 seq_num 1150) 2024-01-13T18:13:31.222 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 379 2024-01-13T18:13:31.222 INFO:tasks.rados.rados.0.smithi084.stdout:3808: seq_num 1167 ranges {335872=352256} 2024-01-13T18:13:31.226 INFO:tasks.rados.rados.0.smithi084.stdout:3808: writing smithi084102331-37 from 335872 to 688128 tid 1 2024-01-13T18:13:31.226 INFO:tasks.rados.rados.0.smithi084.stdout:3809: snap_create 2024-01-13T18:13:31.229 INFO:tasks.rados.rados.0.smithi084.stdout:3807: expect (ObjNum 1150 snap 375 seq_num 1150) 2024-01-13T18:13:31.282 INFO:tasks.rados.rados.0.smithi084.stdout:3808: finishing write tid 1 to smithi084102331-37 2024-01-13T18:13:31.282 INFO:tasks.rados.rados.0.smithi084.stdout:3808: finishing write tid 2 to smithi084102331-37 2024-01-13T18:13:31.282 INFO:tasks.rados.rados.0.smithi084.stdout:3808: finishing write tid 3 to smithi084102331-37 2024-01-13T18:13:31.282 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1872 (ObjNum 1167 snap 379 seq_num 1167) dirty exists 2024-01-13T18:13:31.282 INFO:tasks.rados.rados.0.smithi084.stdout:3808: left oid 37 (ObjNum 1167 snap 379 seq_num 1167) 2024-01-13T18:13:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:31 smithi099 ceph-mon[138788]: pgmap v950: 121 pgs: 121 active+clean; 357 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 4.1 MiB/s wr, 13 op/s 2024-01-13T18:13:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:31 smithi099 ceph-mon[138788]: osdmap e825: 8 total, 8 up, 8 in 2024-01-13T18:13:31.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:31 smithi084 ceph-mon[116404]: pgmap v950: 121 pgs: 121 active+clean; 357 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 4.1 MiB/s wr, 13 op/s 2024-01-13T18:13:31.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:31 smithi084 ceph-mon[116404]: osdmap e825: 8 total, 8 up, 8 in 2024-01-13T18:13:31.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:31 smithi084 ceph-mon[119097]: pgmap v950: 121 pgs: 121 active+clean; 357 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 4.1 MiB/s wr, 13 op/s 2024-01-13T18:13:31.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:31 smithi084 ceph-mon[119097]: osdmap e825: 8 total, 8 up, 8 in 2024-01-13T18:13:32.227 INFO:tasks.rados.rados.0.smithi084.stdout:3807: done (2 left) 2024-01-13T18:13:32.227 INFO:tasks.rados.rados.0.smithi084.stdout:3808: done (1 left) 2024-01-13T18:13:32.227 INFO:tasks.rados.rados.0.smithi084.stdout:3809: done (0 left) 2024-01-13T18:13:32.227 INFO:tasks.rados.rados.0.smithi084.stdout:3810: read oid 20 snap -1 2024-01-13T18:13:32.227 INFO:tasks.rados.rados.0.smithi084.stdout:3810: expect (ObjNum 1125 snap 363 seq_num 1125) 2024-01-13T18:13:32.227 INFO:tasks.rados.rados.0.smithi084.stdout:3811: rollback oid 45 current snap is 380 2024-01-13T18:13:32.227 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 378 2024-01-13T18:13:32.228 INFO:tasks.rados.rados.0.smithi084.stdout:3812: snap_remove snap 364 2024-01-13T18:13:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:32 smithi099 ceph-mon[138788]: osdmap e826: 8 total, 8 up, 8 in 2024-01-13T18:13:32.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:32 smithi084 ceph-mon[116404]: osdmap e826: 8 total, 8 up, 8 in 2024-01-13T18:13:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:32 smithi084 ceph-mon[119097]: osdmap e826: 8 total, 8 up, 8 in 2024-01-13T18:13:32.751 INFO:tasks.rados.rados.0.smithi084.stdout:3812: done (2 left) 2024-01-13T18:13:32.751 INFO:tasks.rados.rados.0.smithi084.stdout:3813: delete oid 34 current snap is 380 2024-01-13T18:13:32.751 INFO:tasks.rados.rados.0.smithi084.stdout:3811: finishing rollback tid 0 to smithi084102331-45 2024-01-13T18:13:32.751 INFO:tasks.rados.rados.0.smithi084.stdout:3811: finishing rollback tid 1 to smithi084102331-45 2024-01-13T18:13:32.751 INFO:tasks.rados.rados.0.smithi084.stdout:3811: finishing rollback tid 2 to smithi084102331-45 2024-01-13T18:13:32.751 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1948 (ObjNum 1142 snap 368 seq_num 1142) dirty exists 2024-01-13T18:13:32.751 INFO:tasks.rados.rados.0.smithi084.stdout:3810: expect (ObjNum 1125 snap 363 seq_num 1125) 2024-01-13T18:13:32.877 INFO:tasks.rados.rados.0.smithi084.stdout:3810: done (2 left) 2024-01-13T18:13:32.878 INFO:tasks.rados.rados.0.smithi084.stdout:3811: done (1 left) 2024-01-13T18:13:32.878 INFO:tasks.rados.rados.0.smithi084.stdout:3813: done (0 left) 2024-01-13T18:13:32.878 INFO:tasks.rados.rados.0.smithi084.stdout:3814: read oid 17 snap -1 2024-01-13T18:13:32.878 INFO:tasks.rados.rados.0.smithi084.stdout:3814: expect (ObjNum 1146 snap 371 seq_num 1146) 2024-01-13T18:13:32.878 INFO:tasks.rados.rados.0.smithi084.stdout:3815: delete oid 25 current snap is 380 2024-01-13T18:13:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:3815: done (1 left) 2024-01-13T18:13:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:3816: copy_from oid 2 from oid 16 current snap is 380 2024-01-13T18:13:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:3817: snap_remove snap 363 2024-01-13T18:13:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:33 smithi099 ceph-mon[138788]: pgmap v953: 121 pgs: 121 active+clean; 361 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 212 KiB/s wr, 7 op/s 2024-01-13T18:13:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:33 smithi099 ceph-mon[138788]: osdmap e827: 8 total, 8 up, 8 in 2024-01-13T18:13:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:33 smithi099 ceph-mon[138788]: osdmap e828: 8 total, 8 up, 8 in 2024-01-13T18:13:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:33 smithi084 ceph-mon[116404]: pgmap v953: 121 pgs: 121 active+clean; 361 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 212 KiB/s wr, 7 op/s 2024-01-13T18:13:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:33 smithi084 ceph-mon[116404]: osdmap e827: 8 total, 8 up, 8 in 2024-01-13T18:13:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:33 smithi084 ceph-mon[116404]: osdmap e828: 8 total, 8 up, 8 in 2024-01-13T18:13:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:33 smithi084 ceph-mon[119097]: pgmap v953: 121 pgs: 121 active+clean; 361 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 212 KiB/s wr, 7 op/s 2024-01-13T18:13:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:33 smithi084 ceph-mon[119097]: osdmap e827: 8 total, 8 up, 8 in 2024-01-13T18:13:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:33 smithi084 ceph-mon[119097]: osdmap e828: 8 total, 8 up, 8 in 2024-01-13T18:13:33.757 INFO:tasks.rados.rados.0.smithi084.stdout:3817: done (2 left) 2024-01-13T18:13:33.757 INFO:tasks.rados.rados.0.smithi084.stdout:3818: read oid 47 snap 370 2024-01-13T18:13:33.758 INFO:tasks.rados.rados.0.smithi084.stdout:3818: expect deleted 2024-01-13T18:13:33.758 INFO:tasks.rados.rados.0.smithi084.stdout:3819: snap_create 2024-01-13T18:13:33.759 INFO:tasks.rados.rados.0.smithi084.stdout:3814: expect (ObjNum 1146 snap 371 seq_num 1146) 2024-01-13T18:13:33.823 INFO:tasks.rados.rados.0.smithi084.stdout:3816: finishing copy_from to smithi084102331-2 2024-01-13T18:13:33.823 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 1633 (ObjNum 1155 snap 378 seq_num 1155) dirty exists 2024-01-13T18:13:33.823 INFO:tasks.rados.rados.0.smithi084.stdout:3816: finishing copy_from racing read to smithi084102331-2 2024-01-13T18:13:34.761 INFO:tasks.rados.rados.0.smithi084.stdout:3814: done (3 left) 2024-01-13T18:13:34.762 INFO:tasks.rados.rados.0.smithi084.stdout:3816: done (2 left) 2024-01-13T18:13:34.762 INFO:tasks.rados.rados.0.smithi084.stdout:3818: done (1 left) 2024-01-13T18:13:34.762 INFO:tasks.rados.rados.0.smithi084.stdout:3819: done (0 left) 2024-01-13T18:13:34.762 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 381 2024-01-13T18:13:34.762 INFO:tasks.rados.rados.0.smithi084.stdout:3820: seq_num 1170 ranges {8183808=401408} 2024-01-13T18:13:34.806 INFO:tasks.rados.rados.0.smithi084.stdout:3820: writing smithi084102331-43 from 8183808 to 8585216 tid 1 2024-01-13T18:13:34.806 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 381 2024-01-13T18:13:34.806 INFO:tasks.rados.rados.0.smithi084.stdout:3821: seq_num 1171 ranges {3547136=417792} 2024-01-13T18:13:34.828 INFO:tasks.rados.rados.0.smithi084.stdout:3821: writing smithi084102331-44 from 3547136 to 3964928 tid 1 2024-01-13T18:13:34.828 INFO:tasks.rados.rados.0.smithi084.stdout:3822: copy_from oid 11 from oid 13 current snap is 381 2024-01-13T18:13:34.828 INFO:tasks.rados.rados.0.smithi084.stdout:3820: finishing write tid 1 to smithi084102331-43 2024-01-13T18:13:34.828 INFO:tasks.rados.rados.0.smithi084.stdout:3820: finishing write tid 2 to smithi084102331-43 2024-01-13T18:13:34.828 INFO:tasks.rados.rados.0.smithi084.stdout:3820: finishing write tid 3 to smithi084102331-43 2024-01-13T18:13:34.828 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1772 (ObjNum 1170 snap 381 seq_num 1170) dirty exists 2024-01-13T18:13:34.828 INFO:tasks.rados.rados.0.smithi084.stdout:3820: left oid 43 (ObjNum 1170 snap 381 seq_num 1170) 2024-01-13T18:13:34.828 INFO:tasks.rados.rados.0.smithi084.stdout:3820: done (2 left) 2024-01-13T18:13:34.828 INFO:tasks.rados.rados.0.smithi084.stdout:3823: delete oid 33 current snap is 381 2024-01-13T18:13:34.836 INFO:tasks.rados.rados.0.smithi084.stdout:3823: done (2 left) 2024-01-13T18:13:34.836 INFO:tasks.rados.rados.0.smithi084.stdout:3824: copy_from oid 14 from oid 18 current snap is 381 2024-01-13T18:13:34.836 INFO:tasks.rados.rados.0.smithi084.stdout:3825: copy_from oid 36 from oid 42 current snap is 381 2024-01-13T18:13:34.836 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 381 2024-01-13T18:13:34.836 INFO:tasks.rados.rados.0.smithi084.stdout:3826: seq_num 1173 ranges {8585216=450560} 2024-01-13T18:13:34.887 INFO:tasks.rados.rados.0.smithi084.stdout:3826: writing smithi084102331-43 from 8585216 to 9035776 tid 1 2024-01-13T18:13:34.887 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 381 2024-01-13T18:13:34.887 INFO:tasks.rados.rados.0.smithi084.stdout:3821: finishing write tid 1 to smithi084102331-44 2024-01-13T18:13:34.887 INFO:tasks.rados.rados.0.smithi084.stdout:3827: seq_num 1174 ranges {4276224=466944} 2024-01-13T18:13:34.912 INFO:tasks.rados.rados.0.smithi084.stdout:3827: writing smithi084102331-2 from 4276224 to 4743168 tid 1 2024-01-13T18:13:34.912 INFO:tasks.rados.rados.0.smithi084.stdout:3828: snap_remove snap 378 2024-01-13T18:13:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:34 smithi099 ceph-mon[138788]: osdmap e829: 8 total, 8 up, 8 in 2024-01-13T18:13:35.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:34 smithi099 ceph-mon[138788]: pgmap v957: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 365 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 8.3 MiB/s rd, 1.1 MiB/s wr, 3 op/s 2024-01-13T18:13:35.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:34 smithi084 ceph-mon[116404]: osdmap e829: 8 total, 8 up, 8 in 2024-01-13T18:13:35.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:34 smithi084 ceph-mon[116404]: pgmap v957: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 365 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 8.3 MiB/s rd, 1.1 MiB/s wr, 3 op/s 2024-01-13T18:13:35.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:34 smithi084 ceph-mon[119097]: osdmap e829: 8 total, 8 up, 8 in 2024-01-13T18:13:35.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:34 smithi084 ceph-mon[119097]: pgmap v957: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 365 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 8.3 MiB/s rd, 1.1 MiB/s wr, 3 op/s 2024-01-13T18:13:35.771 INFO:tasks.rados.rados.0.smithi084.stdout:3828: done (6 left) 2024-01-13T18:13:35.771 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 381 2024-01-13T18:13:35.771 INFO:tasks.rados.rados.0.smithi084.stdout:3829: seq_num 1175 ranges {4546560=483328} 2024-01-13T18:13:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:3829: writing smithi084102331-27 from 4546560 to 5029888 tid 1 2024-01-13T18:13:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 381 2024-01-13T18:13:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:3830: seq_num 1176 ranges {0=499712} 2024-01-13T18:13:35.801 INFO:tasks.rados.rados.0.smithi084.stdout:3830: writing smithi084102331-25 from 0 to 499712 tid 1 2024-01-13T18:13:35.801 INFO:tasks.rados.rados.0.smithi084.stdout:3831: rollback oid 46 current snap is 381 2024-01-13T18:13:35.801 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 353 2024-01-13T18:13:35.801 INFO:tasks.rados.rados.0.smithi084.stdout:3821: finishing write tid 2 to smithi084102331-44 2024-01-13T18:13:35.801 INFO:tasks.rados.rados.0.smithi084.stdout:3821: finishing write tid 3 to smithi084102331-44 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1964 (ObjNum 1171 snap 381 seq_num 1171) dirty exists 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:3821: left oid 44 (ObjNum 1171 snap 381 seq_num 1171) 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:3821: done (8 left) 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:3832: read oid 35 snap -1 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:3832: expect (ObjNum 1088 snap 348 seq_num 1088) 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:3833: delete oid 6 current snap is 381 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:3822: finishing copy_from to smithi084102331-11 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1785 (ObjNum 1144 snap 370 seq_num 1144) dirty exists 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:3822: finishing copy_from racing read to smithi084102331-11 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:3825: finishing copy_from to smithi084102331-36 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1510 (ObjNum 979 snap 309 seq_num 979) dirty exists 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:3825: finishing copy_from racing read to smithi084102331-36 2024-01-13T18:13:35.802 INFO:tasks.rados.rados.0.smithi084.stdout:3824: finishing copy_from to smithi084102331-14 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1682 (ObjNum 1153 snap 378 seq_num 1153) dirty exists 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:3824: finishing copy_from racing read to smithi084102331-14 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:3826: finishing write tid 1 to smithi084102331-43 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:3826: finishing write tid 2 to smithi084102331-43 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:3826: finishing write tid 3 to smithi084102331-43 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1774 (ObjNum 1173 snap 381 seq_num 1173) dirty exists 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:3826: left oid 43 (ObjNum 1173 snap 381 seq_num 1173) 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:3827: finishing write tid 1 to smithi084102331-2 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:3827: finishing write tid 2 to smithi084102331-2 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:3827: finishing write tid 3 to smithi084102331-2 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 2020 (ObjNum 1174 snap 381 seq_num 1174) dirty exists 2024-01-13T18:13:35.803 INFO:tasks.rados.rados.0.smithi084.stdout:3827: left oid 2 (ObjNum 1174 snap 381 seq_num 1174) 2024-01-13T18:13:35.804 INFO:tasks.rados.rados.0.smithi084.stdout:3829: finishing write tid 1 to smithi084102331-27 2024-01-13T18:13:35.804 INFO:tasks.rados.rados.0.smithi084.stdout:3829: finishing write tid 2 to smithi084102331-27 2024-01-13T18:13:35.804 INFO:tasks.rados.rados.0.smithi084.stdout:3822: done (9 left) 2024-01-13T18:13:35.804 INFO:tasks.rados.rados.0.smithi084.stdout:3824: done (8 left) 2024-01-13T18:13:35.805 INFO:tasks.rados.rados.0.smithi084.stdout:3825: done (7 left) 2024-01-13T18:13:35.805 INFO:tasks.rados.rados.0.smithi084.stdout:3826: done (6 left) 2024-01-13T18:13:35.805 INFO:tasks.rados.rados.0.smithi084.stdout:3827: done (5 left) 2024-01-13T18:13:35.805 INFO:tasks.rados.rados.0.smithi084.stdout:3833: done (4 left) 2024-01-13T18:13:35.805 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 381 2024-01-13T18:13:35.805 INFO:tasks.rados.rados.0.smithi084.stdout:3834: seq_num 1178 ranges {0=532480} 2024-01-13T18:13:35.807 INFO:tasks.rados.rados.0.smithi084.stdout:3834: writing smithi084102331-49 from 0 to 532480 tid 1 2024-01-13T18:13:35.807 INFO:tasks.rados.rados.0.smithi084.stdout:3835: read oid 5 snap -1 2024-01-13T18:13:35.807 INFO:tasks.rados.rados.0.smithi084.stdout:3835: expect (ObjNum 1110 snap 357 seq_num 1110) 2024-01-13T18:13:35.807 INFO:tasks.rados.rados.0.smithi084.stdout:3836: snap_remove snap 379 2024-01-13T18:13:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:35 smithi099 ceph-mon[138788]: osdmap e830: 8 total, 8 up, 8 in 2024-01-13T18:13:36.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:36.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:35 smithi084 ceph-mon[116404]: osdmap e830: 8 total, 8 up, 8 in 2024-01-13T18:13:36.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:35 smithi084 ceph-mon[119097]: osdmap e830: 8 total, 8 up, 8 in 2024-01-13T18:13:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:36.778 INFO:tasks.rados.rados.0.smithi084.stdout:3836: done (6 left) 2024-01-13T18:13:36.778 INFO:tasks.rados.rados.0.smithi084.stdout:3837: rmattr oid 30 current snap is 381 2024-01-13T18:13:36.778 INFO:tasks.rados.rados.0.smithi084.stdout:3837: done (6 left) 2024-01-13T18:13:36.778 INFO:tasks.rados.rados.0.smithi084.stdout:3838: snap_remove snap 372 2024-01-13T18:13:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:36 smithi099 ceph-mon[138788]: osdmap e831: 8 total, 8 up, 8 in 2024-01-13T18:13:37.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:36 smithi099 ceph-mon[138788]: pgmap v960: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 365 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 262 B/s rd, 1.2 MiB/s wr, 1 op/s 2024-01-13T18:13:37.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:36 smithi084 ceph-mon[116404]: osdmap e831: 8 total, 8 up, 8 in 2024-01-13T18:13:37.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:36 smithi084 ceph-mon[116404]: pgmap v960: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 365 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 262 B/s rd, 1.2 MiB/s wr, 1 op/s 2024-01-13T18:13:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:36 smithi084 ceph-mon[119097]: osdmap e831: 8 total, 8 up, 8 in 2024-01-13T18:13:37.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:36 smithi084 ceph-mon[119097]: pgmap v960: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 365 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 262 B/s rd, 1.2 MiB/s wr, 1 op/s 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:3838: done (6 left) 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:3839: copy_from oid 37 from oid 32 current snap is 381 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:3830: finishing write tid 1 to smithi084102331-25 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:3830: finishing write tid 2 to smithi084102331-25 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:3829: finishing write tid 3 to smithi084102331-27 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 1635 (ObjNum 1175 snap 381 seq_num 1175) dirty exists 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:3829: left oid 27 (ObjNum 1175 snap 381 seq_num 1175) 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:3831: finishing rollback tid 0 to smithi084102331-46 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:3831: finishing rollback tid 1 to smithi084102331-46 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:3831: finishing rollback tid 2 to smithi084102331-46 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1798 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:13:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:3830: finishing write tid 3 to smithi084102331-25 2024-01-13T18:13:37.758 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1876 (ObjNum 1176 snap 381 seq_num 1176) dirty exists 2024-01-13T18:13:37.758 INFO:tasks.rados.rados.0.smithi084.stdout:3830: left oid 25 (ObjNum 1176 snap 381 seq_num 1176) 2024-01-13T18:13:37.758 INFO:tasks.rados.rados.0.smithi084.stdout:3834: finishing write tid 1 to smithi084102331-49 2024-01-13T18:13:37.758 INFO:tasks.rados.rados.0.smithi084.stdout:3834: finishing write tid 2 to smithi084102331-49 2024-01-13T18:13:37.758 INFO:tasks.rados.rados.0.smithi084.stdout:3834: finishing write tid 3 to smithi084102331-49 2024-01-13T18:13:37.758 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1691 (ObjNum 1178 snap 381 seq_num 1178) dirty exists 2024-01-13T18:13:37.758 INFO:tasks.rados.rados.0.smithi084.stdout:3834: left oid 49 (ObjNum 1178 snap 381 seq_num 1178) 2024-01-13T18:13:37.758 INFO:tasks.rados.rados.0.smithi084.stdout:3832: expect (ObjNum 1088 snap 348 seq_num 1088) 2024-01-13T18:13:37.944 INFO:tasks.rados.rados.0.smithi084.stdout:3835: expect (ObjNum 1110 snap 357 seq_num 1110) 2024-01-13T18:13:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:37 smithi099 ceph-mon[138788]: osdmap e832: 8 total, 8 up, 8 in 2024-01-13T18:13:38.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:37 smithi099 ceph-mon[138788]: osdmap e833: 8 total, 8 up, 8 in 2024-01-13T18:13:38.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:37 smithi084 ceph-mon[116404]: osdmap e832: 8 total, 8 up, 8 in 2024-01-13T18:13:38.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:37 smithi084 ceph-mon[116404]: osdmap e833: 8 total, 8 up, 8 in 2024-01-13T18:13:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:37 smithi084 ceph-mon[119097]: osdmap e832: 8 total, 8 up, 8 in 2024-01-13T18:13:38.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:37 smithi084 ceph-mon[119097]: osdmap e833: 8 total, 8 up, 8 in 2024-01-13T18:13:38.384 INFO:tasks.rados.rados.0.smithi084.stdout:3839: finishing copy_from to smithi084102331-37 2024-01-13T18:13:38.384 INFO:tasks.rados.rados.0.smithi084.stdout:3839: got expected ENOENT (src dne) 2024-01-13T18:13:38.384 INFO:tasks.rados.rados.0.smithi084.stdout:3839: finishing copy_from racing read to smithi084102331-37 2024-01-13T18:13:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:3829: done (6 left) 2024-01-13T18:13:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:3830: done (5 left) 2024-01-13T18:13:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:3831: done (4 left) 2024-01-13T18:13:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:3832: done (3 left) 2024-01-13T18:13:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:3834: done (2 left) 2024-01-13T18:13:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:3835: done (1 left) 2024-01-13T18:13:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:3839: done (0 left) 2024-01-13T18:13:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 381 2024-01-13T18:13:38.385 INFO:tasks.rados.rados.0.smithi084.stdout:3840: seq_num 1179 ranges {3457024=548864} 2024-01-13T18:13:38.405 INFO:tasks.rados.rados.0.smithi084.stdout:3840: writing smithi084102331-38 from 3457024 to 4005888 tid 1 2024-01-13T18:13:38.405 INFO:tasks.rados.rados.0.smithi084.stdout:3841: copy_from oid 50 from oid 31 current snap is 381 2024-01-13T18:13:38.405 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 381 2024-01-13T18:13:38.405 INFO:tasks.rados.rados.0.smithi084.stdout:3842: seq_num 1180 ranges {2129920=565248} 2024-01-13T18:13:38.420 INFO:tasks.rados.rados.0.smithi084.stdout:3842: writing smithi084102331-4 from 2129920 to 2695168 tid 1 2024-01-13T18:13:38.420 INFO:tasks.rados.rados.0.smithi084.stdout:3843: snap_remove snap 370 2024-01-13T18:13:38.786 INFO:tasks.rados.rados.0.smithi084.stdout:3843: done (3 left) 2024-01-13T18:13:38.786 INFO:tasks.rados.rados.0.smithi084.stdout:3844: delete oid 44 current snap is 381 2024-01-13T18:13:38.786 INFO:tasks.rados.rados.0.smithi084.stdout:3840: finishing write tid 1 to smithi084102331-38 2024-01-13T18:13:38.786 INFO:tasks.rados.rados.0.smithi084.stdout:3840: finishing write tid 2 to smithi084102331-38 2024-01-13T18:13:38.786 INFO:tasks.rados.rados.0.smithi084.stdout:3840: finishing write tid 3 to smithi084102331-38 2024-01-13T18:13:38.786 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1973 (ObjNum 1179 snap 381 seq_num 1179) dirty exists 2024-01-13T18:13:38.786 INFO:tasks.rados.rados.0.smithi084.stdout:3840: left oid 38 (ObjNum 1179 snap 381 seq_num 1179) 2024-01-13T18:13:38.786 INFO:tasks.rados.rados.0.smithi084.stdout:3842: finishing write tid 1 to smithi084102331-4 2024-01-13T18:13:38.786 INFO:tasks.rados.rados.0.smithi084.stdout:3842: finishing write tid 2 to smithi084102331-4 2024-01-13T18:13:38.786 INFO:tasks.rados.rados.0.smithi084.stdout:3841: finishing copy_from to smithi084102331-50 2024-01-13T18:13:38.786 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 1773 (ObjNum 1119 snap 361 seq_num 1119) dirty exists 2024-01-13T18:13:38.787 INFO:tasks.rados.rados.0.smithi084.stdout:3841: finishing copy_from racing read to smithi084102331-50 2024-01-13T18:13:38.787 INFO:tasks.rados.rados.0.smithi084.stdout:3842: finishing write tid 3 to smithi084102331-4 2024-01-13T18:13:38.787 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 1879 (ObjNum 1180 snap 381 seq_num 1180) dirty exists 2024-01-13T18:13:38.787 INFO:tasks.rados.rados.0.smithi084.stdout:3842: left oid 4 (ObjNum 1180 snap 381 seq_num 1180) 2024-01-13T18:13:38.797 INFO:tasks.rados.rados.0.smithi084.stdout:3840: done (3 left) 2024-01-13T18:13:38.797 INFO:tasks.rados.rados.0.smithi084.stdout:3841: done (2 left) 2024-01-13T18:13:38.797 INFO:tasks.rados.rados.0.smithi084.stdout:3842: done (1 left) 2024-01-13T18:13:38.797 INFO:tasks.rados.rados.0.smithi084.stdout:3844: done (0 left) 2024-01-13T18:13:38.797 INFO:tasks.rados.rados.0.smithi084.stdout:3845: rollback oid 47 current snap is 381 2024-01-13T18:13:38.798 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 380 2024-01-13T18:13:38.798 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 381 2024-01-13T18:13:38.798 INFO:tasks.rados.rados.0.smithi084.stdout:3846: seq_num 1182 ranges {499712=606208} 2024-01-13T18:13:38.804 INFO:tasks.rados.rados.0.smithi084.stdout:3846: writing smithi084102331-25 from 499712 to 1105920 tid 1 2024-01-13T18:13:38.804 INFO:tasks.rados.rados.0.smithi084.stdout:3847: read oid 6 snap -1 2024-01-13T18:13:38.804 INFO:tasks.rados.rados.0.smithi084.stdout:3847: expect deleted 2024-01-13T18:13:38.804 INFO:tasks.rados.rados.0.smithi084.stdout:3848: delete oid 40 current snap is 381 2024-01-13T18:13:38.811 INFO:tasks.rados.rados.0.smithi084.stdout:3845: finishing rollback tid 1 to smithi084102331-47 2024-01-13T18:13:38.811 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1805 (ObjNum 49 snap 0 seq_num 2817408947) dirty dne 2024-01-13T18:13:38.811 INFO:tasks.rados.rados.0.smithi084.stdout:3845: done (3 left) 2024-01-13T18:13:38.811 INFO:tasks.rados.rados.0.smithi084.stdout:3847: done (2 left) 2024-01-13T18:13:38.811 INFO:tasks.rados.rados.0.smithi084.stdout:3848: done (1 left) 2024-01-13T18:13:38.811 INFO:tasks.rados.rados.0.smithi084.stdout:3849: setattr oid 13 current snap is 381 2024-01-13T18:13:38.814 INFO:tasks.rados.rados.0.smithi084.stdout:3850: snap_create 2024-01-13T18:13:38.814 INFO:tasks.rados.rados.0.smithi084.stdout:3846: finishing write tid 1 to smithi084102331-25 2024-01-13T18:13:38.814 INFO:tasks.rados.rados.0.smithi084.stdout:3846: finishing write tid 2 to smithi084102331-25 2024-01-13T18:13:38.814 INFO:tasks.rados.rados.0.smithi084.stdout:3846: finishing write tid 3 to smithi084102331-25 2024-01-13T18:13:38.814 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1878 (ObjNum 1182 snap 381 seq_num 1182) dirty exists 2024-01-13T18:13:38.814 INFO:tasks.rados.rados.0.smithi084.stdout:3846: left oid 25 (ObjNum 1182 snap 381 seq_num 1182) 2024-01-13T18:13:38.820 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 1880 (ObjNum 1144 snap 370 seq_num 1144) dirty exists 2024-01-13T18:13:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:38 smithi099 ceph-mon[138788]: pgmap v963: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 366 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2024-01-13T18:13:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:38 smithi084 ceph-mon[116404]: pgmap v963: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 366 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2024-01-13T18:13:39.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:38 smithi084 ceph-mon[119097]: pgmap v963: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 366 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2024-01-13T18:13:39.790 INFO:tasks.rados.rados.0.smithi084.stdout:3846: done (2 left) 2024-01-13T18:13:39.790 INFO:tasks.rados.rados.0.smithi084.stdout:3849: done (1 left) 2024-01-13T18:13:39.790 INFO:tasks.rados.rados.0.smithi084.stdout:3850: done (0 left) 2024-01-13T18:13:39.790 INFO:tasks.rados.rados.0.smithi084.stdout:3851: copy_from oid 15 from oid 17 current snap is 382 2024-01-13T18:13:39.790 INFO:tasks.rados.rados.0.smithi084.stdout:3852: snap_remove snap 365 2024-01-13T18:13:40.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:39 smithi099 ceph-mon[138788]: osdmap e834: 8 total, 8 up, 8 in 2024-01-13T18:13:40.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:39 smithi084 ceph-mon[116404]: osdmap e834: 8 total, 8 up, 8 in 2024-01-13T18:13:40.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:39 smithi084 ceph-mon[119097]: osdmap e834: 8 total, 8 up, 8 in 2024-01-13T18:13:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:13:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:13:40] "GET /metrics HTTP/1.1" 200 36186 "" "Prometheus/2.43.0" 2024-01-13T18:13:40.804 INFO:tasks.rados.rados.0.smithi084.stdout:3852: done (1 left) 2024-01-13T18:13:40.805 INFO:tasks.rados.rados.0.smithi084.stdout:3853: copy_from oid 18 from oid 46 current snap is 382 2024-01-13T18:13:40.805 INFO:tasks.rados.rados.0.smithi084.stdout:3854: snap_create 2024-01-13T18:13:40.805 INFO:tasks.rados.rados.0.smithi084.stdout:3851: finishing copy_from to smithi084102331-15 2024-01-13T18:13:40.805 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 1875 (ObjNum 1146 snap 371 seq_num 1146) dirty exists 2024-01-13T18:13:40.806 INFO:tasks.rados.rados.0.smithi084.stdout:3851: finishing copy_from racing read to smithi084102331-15 2024-01-13T18:13:40.836 INFO:tasks.rados.rados.0.smithi084.stdout:3853: finishing copy_from to smithi084102331-18 2024-01-13T18:13:40.837 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1798 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:13:40.837 INFO:tasks.rados.rados.0.smithi084.stdout:3853: finishing copy_from racing read to smithi084102331-18 2024-01-13T18:13:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:40 smithi099 ceph-mon[138788]: osdmap e835: 8 total, 8 up, 8 in 2024-01-13T18:13:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:40 smithi099 ceph-mon[138788]: pgmap v966: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 383 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.9 MiB/s wr, 14 op/s 2024-01-13T18:13:41.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:40 smithi084 ceph-mon[116404]: osdmap e835: 8 total, 8 up, 8 in 2024-01-13T18:13:41.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:40 smithi084 ceph-mon[116404]: pgmap v966: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 383 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.9 MiB/s wr, 14 op/s 2024-01-13T18:13:41.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:40 smithi084 ceph-mon[119097]: osdmap e835: 8 total, 8 up, 8 in 2024-01-13T18:13:41.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:40 smithi084 ceph-mon[119097]: pgmap v966: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 383 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.9 MiB/s wr, 14 op/s 2024-01-13T18:13:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:3851: done (2 left) 2024-01-13T18:13:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:3853: done (1 left) 2024-01-13T18:13:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:3854: done (0 left) 2024-01-13T18:13:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:3855: read oid 18 snap -1 2024-01-13T18:13:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:3855: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:13:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:3856: read oid 24 snap 354 2024-01-13T18:13:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:3856: expect (ObjNum 1060 snap 338 seq_num 1060) 2024-01-13T18:13:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:3857: rollback oid 45 current snap is 383 2024-01-13T18:13:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 374 2024-01-13T18:13:41.804 INFO:tasks.rados.rados.0.smithi084.stdout:3858: snap_remove snap 382 2024-01-13T18:13:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:41 smithi099 ceph-mon[138788]: osdmap e836: 8 total, 8 up, 8 in 2024-01-13T18:13:42.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:41 smithi084 ceph-mon[116404]: osdmap e836: 8 total, 8 up, 8 in 2024-01-13T18:13:42.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:41 smithi084 ceph-mon[119097]: osdmap e836: 8 total, 8 up, 8 in 2024-01-13T18:13:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3858: done (3 left) 2024-01-13T18:13:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3859: rmattr oid 29 current snap is 383 2024-01-13T18:13:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3859: done (3 left) 2024-01-13T18:13:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3860: copy_from oid 44 from oid 17 current snap is 383 2024-01-13T18:13:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3861: setattr oid 13 current snap is 383 2024-01-13T18:13:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3857: finishing rollback tid 0 to smithi084102331-45 2024-01-13T18:13:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3857: finishing rollback tid 1 to smithi084102331-45 2024-01-13T18:13:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3857: finishing rollback tid 2 to smithi084102331-45 2024-01-13T18:13:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 1989 (ObjNum 1142 snap 368 seq_num 1142) dirty exists 2024-01-13T18:13:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3856: expect (ObjNum 1060 snap 338 seq_num 1060) 2024-01-13T18:13:42.900 INFO:tasks.rados.rados.0.smithi084.stdout:3855: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:13:43.071 INFO:tasks.rados.rados.0.smithi084.stdout:3860: finishing copy_from to smithi084102331-44 2024-01-13T18:13:43.071 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 1875 (ObjNum 1146 snap 371 seq_num 1146) dirty exists 2024-01-13T18:13:43.071 INFO:tasks.rados.rados.0.smithi084.stdout:3860: finishing copy_from racing read to smithi084102331-44 2024-01-13T18:13:43.071 INFO:tasks.rados.rados.0.smithi084.stdout:3855: done (4 left) 2024-01-13T18:13:43.071 INFO:tasks.rados.rados.0.smithi084.stdout:3856: done (3 left) 2024-01-13T18:13:43.072 INFO:tasks.rados.rados.0.smithi084.stdout:3857: done (2 left) 2024-01-13T18:13:43.072 INFO:tasks.rados.rados.0.smithi084.stdout:3860: done (1 left) 2024-01-13T18:13:43.072 INFO:tasks.rados.rados.0.smithi084.stdout:3862: delete oid 42 current snap is 383 2024-01-13T18:13:43.073 INFO:tasks.rados.rados.0.smithi084.stdout:3862: done (1 left) 2024-01-13T18:13:43.073 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 383 2024-01-13T18:13:43.073 INFO:tasks.rados.rados.0.smithi084.stdout:3863: seq_num 1185 ranges {2990080=655360} 2024-01-13T18:13:43.093 INFO:tasks.rados.rados.0.smithi084.stdout:3863: writing smithi084102331-28 from 2990080 to 3645440 tid 1 2024-01-13T18:13:43.093 INFO:tasks.rados.rados.0.smithi084.stdout:3864: copy_from oid 8 from oid 37 current snap is 383 2024-01-13T18:13:43.093 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 1881 (ObjNum 1144 snap 370 seq_num 1144) dirty exists 2024-01-13T18:13:43.093 INFO:tasks.rados.rados.0.smithi084.stdout:3861: done (2 left) 2024-01-13T18:13:43.093 INFO:tasks.rados.rados.0.smithi084.stdout:3865: copy_from oid 46 from oid 11 current snap is 383 2024-01-13T18:13:43.093 INFO:tasks.rados.rados.0.smithi084.stdout:3866: rollback oid 9 current snap is 383 2024-01-13T18:13:43.094 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 381 2024-01-13T18:13:43.094 INFO:tasks.rados.rados.0.smithi084.stdout:3867: snap_remove snap 380 2024-01-13T18:13:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:42 smithi099 ceph-mon[138788]: osdmap e837: 8 total, 8 up, 8 in 2024-01-13T18:13:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:42 smithi099 ceph-mon[138788]: pgmap v969: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 373 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-01-13T18:13:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:42 smithi099 ceph-mon[138788]: osdmap e838: 8 total, 8 up, 8 in 2024-01-13T18:13:43.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:42 smithi084 ceph-mon[116404]: osdmap e837: 8 total, 8 up, 8 in 2024-01-13T18:13:43.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:42 smithi084 ceph-mon[116404]: pgmap v969: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 373 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-01-13T18:13:43.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:42 smithi084 ceph-mon[116404]: osdmap e838: 8 total, 8 up, 8 in 2024-01-13T18:13:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:42 smithi084 ceph-mon[119097]: osdmap e837: 8 total, 8 up, 8 in 2024-01-13T18:13:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:42 smithi084 ceph-mon[119097]: pgmap v969: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 373 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-01-13T18:13:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:42 smithi084 ceph-mon[119097]: osdmap e838: 8 total, 8 up, 8 in 2024-01-13T18:13:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3867: done (4 left) 2024-01-13T18:13:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3868: snap_create 2024-01-13T18:13:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3866: finishing rollback tid 0 to smithi084102331-9 2024-01-13T18:13:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3866: finishing rollback tid 1 to smithi084102331-9 2024-01-13T18:13:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:3863: finishing write tid 1 to smithi084102331-28 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:3863: finishing write tid 2 to smithi084102331-28 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:3866: finishing rollback tid 2 to smithi084102331-9 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1792 (ObjNum 1135 snap 366 seq_num 1135) dirty exists 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:3863: finishing write tid 3 to smithi084102331-28 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 1637 (ObjNum 1185 snap 383 seq_num 1185) dirty exists 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:3863: left oid 28 (ObjNum 1185 snap 383 seq_num 1185) 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:3864: finishing copy_from to smithi084102331-8 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 1872 (ObjNum 1167 snap 379 seq_num 1167) dirty exists 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:3864: finishing copy_from racing read to smithi084102331-8 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:3865: finishing copy_from to smithi084102331-46 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1785 (ObjNum 1144 snap 370 seq_num 1144) dirty exists 2024-01-13T18:13:43.810 INFO:tasks.rados.rados.0.smithi084.stdout:3865: finishing copy_from racing read to smithi084102331-46 2024-01-13T18:13:44.819 INFO:tasks.rados.rados.0.smithi084.stdout:3863: done (4 left) 2024-01-13T18:13:44.819 INFO:tasks.rados.rados.0.smithi084.stdout:3864: done (3 left) 2024-01-13T18:13:44.819 INFO:tasks.rados.rados.0.smithi084.stdout:3865: done (2 left) 2024-01-13T18:13:44.819 INFO:tasks.rados.rados.0.smithi084.stdout:3866: done (1 left) 2024-01-13T18:13:44.820 INFO:tasks.rados.rados.0.smithi084.stdout:3868: done (0 left) 2024-01-13T18:13:44.820 INFO:tasks.rados.rados.0.smithi084.stdout:3869: setattr oid 5 current snap is 384 2024-01-13T18:13:44.821 INFO:tasks.rados.rados.0.smithi084.stdout:3870: snap_remove snap 354 2024-01-13T18:13:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:44 smithi099 ceph-mon[138788]: osdmap e839: 8 total, 8 up, 8 in 2024-01-13T18:13:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:44 smithi099 ceph-mon[138788]: pgmap v972: 121 pgs: 121 active+clean; 378 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-01-13T18:13:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:44 smithi084 ceph-mon[116404]: osdmap e839: 8 total, 8 up, 8 in 2024-01-13T18:13:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:44 smithi084 ceph-mon[116404]: pgmap v972: 121 pgs: 121 active+clean; 378 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-01-13T18:13:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:44 smithi084 ceph-mon[119097]: osdmap e839: 8 total, 8 up, 8 in 2024-01-13T18:13:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:44 smithi084 ceph-mon[119097]: pgmap v972: 121 pgs: 121 active+clean; 378 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-01-13T18:13:45.824 INFO:tasks.rados.rados.0.smithi084.stdout:3870: done (1 left) 2024-01-13T18:13:45.824 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 384 2024-01-13T18:13:45.824 INFO:tasks.rados.rados.0.smithi084.stdout:3871: seq_num 1186 ranges {2007040=671744} 2024-01-13T18:13:45.832 INFO:tasks.rados.rados.0.smithi084.stdout:3871: writing smithi084102331-36 from 2007040 to 2678784 tid 1 2024-01-13T18:13:45.832 INFO:tasks.rados.rados.0.smithi084.stdout:3872: setattr oid 31 current snap is 384 2024-01-13T18:13:45.832 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 1882 (ObjNum 1110 snap 357 seq_num 1110) dirty exists 2024-01-13T18:13:45.833 INFO:tasks.rados.rados.0.smithi084.stdout:3869: done (2 left) 2024-01-13T18:13:45.833 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 384 2024-01-13T18:13:45.833 INFO:tasks.rados.rados.0.smithi084.stdout:3873: seq_num 1187 ranges {2170880=688128} 2024-01-13T18:13:45.850 INFO:tasks.rados.rados.0.smithi084.stdout:3873: writing smithi084102331-26 from 2170880 to 2859008 tid 1 2024-01-13T18:13:45.850 INFO:tasks.rados.rados.0.smithi084.stdout:3874: snap_create 2024-01-13T18:13:45.850 INFO:tasks.rados.rados.0.smithi084.stdout:3871: finishing write tid 1 to smithi084102331-36 2024-01-13T18:13:45.850 INFO:tasks.rados.rados.0.smithi084.stdout:3871: finishing write tid 2 to smithi084102331-36 2024-01-13T18:13:45.850 INFO:tasks.rados.rados.0.smithi084.stdout:3871: finishing write tid 3 to smithi084102331-36 2024-01-13T18:13:45.850 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 1693 (ObjNum 1186 snap 384 seq_num 1186) dirty exists 2024-01-13T18:13:45.850 INFO:tasks.rados.rados.0.smithi084.stdout:3871: left oid 36 (ObjNum 1186 snap 384 seq_num 1186) 2024-01-13T18:13:45.850 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 2001 (ObjNum 1119 snap 361 seq_num 1119) dirty exists 2024-01-13T18:13:45.853 INFO:tasks.rados.rados.0.smithi084.stdout:3873: finishing write tid 1 to smithi084102331-26 2024-01-13T18:13:45.853 INFO:tasks.rados.rados.0.smithi084.stdout:3873: finishing write tid 2 to smithi084102331-26 2024-01-13T18:13:45.854 INFO:tasks.rados.rados.0.smithi084.stdout:3873: finishing write tid 3 to smithi084102331-26 2024-01-13T18:13:45.854 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 1695 (ObjNum 1187 snap 384 seq_num 1187) dirty exists 2024-01-13T18:13:45.855 INFO:tasks.rados.rados.0.smithi084.stdout:3873: left oid 26 (ObjNum 1187 snap 384 seq_num 1187) 2024-01-13T18:13:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:45 smithi099 ceph-mon[138788]: osdmap e840: 8 total, 8 up, 8 in 2024-01-13T18:13:46.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:45 smithi084 ceph-mon[116404]: osdmap e840: 8 total, 8 up, 8 in 2024-01-13T18:13:46.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:45 smithi084 ceph-mon[119097]: osdmap e840: 8 total, 8 up, 8 in 2024-01-13T18:13:46.839 INFO:tasks.rados.rados.0.smithi084.stdout:3871: done (3 left) 2024-01-13T18:13:46.839 INFO:tasks.rados.rados.0.smithi084.stdout:3872: done (2 left) 2024-01-13T18:13:46.839 INFO:tasks.rados.rados.0.smithi084.stdout:3873: done (1 left) 2024-01-13T18:13:46.839 INFO:tasks.rados.rados.0.smithi084.stdout:3874: done (0 left) 2024-01-13T18:13:46.839 INFO:tasks.rados.rados.0.smithi084.stdout:3875: rollback oid 46 current snap is 385 2024-01-13T18:13:46.839 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 375 2024-01-13T18:13:46.839 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 385 2024-01-13T18:13:46.840 INFO:tasks.rados.rados.0.smithi084.stdout:3876: seq_num 1188 ranges {0=704512} 2024-01-13T18:13:46.843 INFO:tasks.rados.rados.0.smithi084.stdout:3876: writing smithi084102331-48 from 0 to 704512 tid 1 2024-01-13T18:13:46.843 INFO:tasks.rados.rados.0.smithi084.stdout:3877: read oid 33 snap -1 2024-01-13T18:13:46.843 INFO:tasks.rados.rados.0.smithi084.stdout:3877: expect deleted 2024-01-13T18:13:46.843 INFO:tasks.rados.rados.0.smithi084.stdout:3878: setattr oid 14 current snap is 385 2024-01-13T18:13:46.844 INFO:tasks.rados.rados.0.smithi084.stdout:3875: finishing rollback tid 0 to smithi084102331-46 2024-01-13T18:13:46.844 INFO:tasks.rados.rados.0.smithi084.stdout:3875: finishing rollback tid 1 to smithi084102331-46 2024-01-13T18:13:46.844 INFO:tasks.rados.rados.0.smithi084.stdout:3875: finishing rollback tid 2 to smithi084102331-46 2024-01-13T18:13:46.844 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1801 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:13:46.845 INFO:tasks.rados.rados.0.smithi084.stdout:3875: done (3 left) 2024-01-13T18:13:46.845 INFO:tasks.rados.rados.0.smithi084.stdout:3879: read oid 3 snap -1 2024-01-13T18:13:46.845 INFO:tasks.rados.rados.0.smithi084.stdout:3879: expect (ObjNum 1139 snap 367 seq_num 1139) 2024-01-13T18:13:46.845 INFO:tasks.rados.rados.0.smithi084.stdout:3880: read oid 12 snap -1 2024-01-13T18:13:46.846 INFO:tasks.rados.rados.0.smithi084.stdout:3880: expect (ObjNum 1140 snap 368 seq_num 1140) 2024-01-13T18:13:46.846 INFO:tasks.rados.rados.0.smithi084.stdout:3881: read oid 13 snap 349 2024-01-13T18:13:46.846 INFO:tasks.rados.rados.0.smithi084.stdout:3881: expect (ObjNum 1086 snap 347 seq_num 1086) 2024-01-13T18:13:46.846 INFO:tasks.rados.rados.0.smithi084.stdout:3882: copy_from oid 7 from oid 25 current snap is 385 2024-01-13T18:13:46.846 INFO:tasks.rados.rados.0.smithi084.stdout:3883: snap_create 2024-01-13T18:13:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3876: finishing write tid 1 to smithi084102331-48 2024-01-13T18:13:46.851 INFO:tasks.rados.rados.0.smithi084.stdout:3876: finishing write tid 2 to smithi084102331-48 2024-01-13T18:13:46.856 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1696 (ObjNum 1153 snap 378 seq_num 1153) dirty exists 2024-01-13T18:13:46.868 INFO:tasks.rados.rados.0.smithi084.stdout:3881: expect (ObjNum 1086 snap 347 seq_num 1086) 2024-01-13T18:13:46.954 INFO:tasks.rados.rados.0.smithi084.stdout:3876: finishing write tid 3 to smithi084102331-48 2024-01-13T18:13:46.954 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 2046 (ObjNum 1188 snap 385 seq_num 1188) dirty exists 2024-01-13T18:13:46.954 INFO:tasks.rados.rados.0.smithi084.stdout:3876: left oid 48 (ObjNum 1188 snap 385 seq_num 1188) 2024-01-13T18:13:46.954 INFO:tasks.rados.rados.0.smithi084.stdout:3880: expect (ObjNum 1140 snap 368 seq_num 1140) 2024-01-13T18:13:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:46 smithi099 ceph-mon[138788]: osdmap e841: 8 total, 8 up, 8 in 2024-01-13T18:13:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:46 smithi099 ceph-mon[138788]: pgmap v975: 121 pgs: 121 active+clean; 377 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.7 MiB/s wr, 2 op/s 2024-01-13T18:13:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:46 smithi084 ceph-mon[116404]: osdmap e841: 8 total, 8 up, 8 in 2024-01-13T18:13:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:46 smithi084 ceph-mon[116404]: pgmap v975: 121 pgs: 121 active+clean; 377 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.7 MiB/s wr, 2 op/s 2024-01-13T18:13:47.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:46 smithi084 ceph-mon[119097]: osdmap e841: 8 total, 8 up, 8 in 2024-01-13T18:13:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:46 smithi084 ceph-mon[119097]: pgmap v975: 121 pgs: 121 active+clean; 377 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.7 MiB/s wr, 2 op/s 2024-01-13T18:13:47.265 INFO:tasks.rados.rados.0.smithi084.stdout:3882: finishing copy_from to smithi084102331-7 2024-01-13T18:13:47.265 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1878 (ObjNum 1182 snap 381 seq_num 1182) dirty exists 2024-01-13T18:13:47.265 INFO:tasks.rados.rados.0.smithi084.stdout:3879: expect (ObjNum 1139 snap 367 seq_num 1139) 2024-01-13T18:13:47.849 INFO:tasks.rados.rados.0.smithi084.stdout:3882: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:13:47.849 INFO:tasks.rados.rados.0.smithi084.stdout:3876: done (7 left) 2024-01-13T18:13:47.849 INFO:tasks.rados.rados.0.smithi084.stdout:3877: done (6 left) 2024-01-13T18:13:47.849 INFO:tasks.rados.rados.0.smithi084.stdout:3878: done (5 left) 2024-01-13T18:13:47.850 INFO:tasks.rados.rados.0.smithi084.stdout:3879: done (4 left) 2024-01-13T18:13:47.850 INFO:tasks.rados.rados.0.smithi084.stdout:3880: done (3 left) 2024-01-13T18:13:47.850 INFO:tasks.rados.rados.0.smithi084.stdout:3881: done (2 left) 2024-01-13T18:13:47.850 INFO:tasks.rados.rados.0.smithi084.stdout:3882: done (1 left) 2024-01-13T18:13:47.850 INFO:tasks.rados.rados.0.smithi084.stdout:3883: done (0 left) 2024-01-13T18:13:47.850 INFO:tasks.rados.rados.0.smithi084.stdout:3884: read oid 6 snap -1 2024-01-13T18:13:47.850 INFO:tasks.rados.rados.0.smithi084.stdout:3884: expect deleted 2024-01-13T18:13:47.850 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 386 2024-01-13T18:13:47.850 INFO:tasks.rados.rados.0.smithi084.stdout:3885: seq_num 1189 ranges {9035776=720896} 2024-01-13T18:13:47.900 INFO:tasks.rados.rados.0.smithi084.stdout:3885: writing smithi084102331-43 from 9035776 to 9756672 tid 1 2024-01-13T18:13:47.900 INFO:tasks.rados.rados.0.smithi084.stdout:3886: read oid 10 snap -1 2024-01-13T18:13:47.900 INFO:tasks.rados.rados.0.smithi084.stdout:3886: expect (ObjNum 1073 snap 340 seq_num 1073) 2024-01-13T18:13:47.901 INFO:tasks.rados.rados.0.smithi084.stdout:3887: rollback oid 17 current snap is 386 2024-01-13T18:13:47.901 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 353 2024-01-13T18:13:47.901 INFO:tasks.rados.rados.0.smithi084.stdout:3884: done (3 left) 2024-01-13T18:13:47.901 INFO:tasks.rados.rados.0.smithi084.stdout:3888: read oid 22 snap 352 2024-01-13T18:13:47.901 INFO:tasks.rados.rados.0.smithi084.stdout:3888: expect (ObjNum 1080 snap 342 seq_num 1080) 2024-01-13T18:13:47.901 INFO:tasks.rados.rados.0.smithi084.stdout:3889: read oid 41 snap 381 2024-01-13T18:13:47.901 INFO:tasks.rados.rados.0.smithi084.stdout:3889: expect (ObjNum 1096 snap 350 seq_num 1096) 2024-01-13T18:13:47.901 INFO:tasks.rados.rados.0.smithi084.stdout:3890: copy_from oid 16 from oid 23 current snap is 386 2024-01-13T18:13:47.901 INFO:tasks.rados.rados.0.smithi084.stdout:3891: snap_remove snap 384 2024-01-13T18:13:48.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:47 smithi099 ceph-mon[138788]: osdmap e842: 8 total, 8 up, 8 in 2024-01-13T18:13:48.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:47 smithi099 ceph-mon[138788]: osdmap e843: 8 total, 8 up, 8 in 2024-01-13T18:13:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:47 smithi084 ceph-mon[116404]: osdmap e842: 8 total, 8 up, 8 in 2024-01-13T18:13:48.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:47 smithi084 ceph-mon[116404]: osdmap e843: 8 total, 8 up, 8 in 2024-01-13T18:13:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:47 smithi084 ceph-mon[119097]: osdmap e842: 8 total, 8 up, 8 in 2024-01-13T18:13:48.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:47 smithi084 ceph-mon[119097]: osdmap e843: 8 total, 8 up, 8 in 2024-01-13T18:13:48.851 INFO:tasks.rados.rados.0.smithi084.stdout:3891: done (6 left) 2024-01-13T18:13:48.851 INFO:tasks.rados.rados.0.smithi084.stdout:3892: copy_from oid 4 from oid 35 current snap is 386 2024-01-13T18:13:48.851 INFO:tasks.rados.rados.0.smithi084.stdout:3893: read oid 20 snap 385 2024-01-13T18:13:48.851 INFO:tasks.rados.rados.0.smithi084.stdout:3893: expect (ObjNum 1125 snap 363 seq_num 1125) 2024-01-13T18:13:48.851 INFO:tasks.rados.rados.0.smithi084.stdout:3894: read oid 6 snap 349 2024-01-13T18:13:48.851 INFO:tasks.rados.rados.0.smithi084.stdout:3894: expect (ObjNum 1031 snap 325 seq_num 1031) 2024-01-13T18:13:48.851 INFO:tasks.rados.rados.0.smithi084.stdout:3895: rmattr oid 37 current snap is 386 2024-01-13T18:13:48.851 INFO:tasks.rados.rados.0.smithi084.stdout:3895: done (9 left) 2024-01-13T18:13:48.852 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 386 2024-01-13T18:13:48.852 INFO:tasks.rados.rados.0.smithi084.stdout:3896: seq_num 1190 ranges {12984320=737280} 2024-01-13T18:13:48.923 INFO:tasks.rados.rados.0.smithi084.stdout:3896: writing smithi084102331-14 from 12984320 to 13721600 tid 1 2024-01-13T18:13:48.923 INFO:tasks.rados.rados.0.smithi084.stdout:3897: copy_from oid 7 from oid 24 current snap is 386 2024-01-13T18:13:48.923 INFO:tasks.rados.rados.0.smithi084.stdout:3887: finishing rollback tid 0 to smithi084102331-17 2024-01-13T18:13:48.923 INFO:tasks.rados.rados.0.smithi084.stdout:3887: finishing rollback tid 1 to smithi084102331-17 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:3898: rollback oid 37 current snap is 386 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 383 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:3885: finishing write tid 1 to smithi084102331-43 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:3885: finishing write tid 2 to smithi084102331-43 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:3885: finishing write tid 3 to smithi084102331-43 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 1880 (ObjNum 1189 snap 386 seq_num 1189) dirty exists 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:3885: left oid 43 (ObjNum 1189 snap 386 seq_num 1189) 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:3887: finishing rollback tid 2 to smithi084102331-17 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1885 (ObjNum 1100 snap 351 seq_num 1100) dirty exists 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:3885: done (11 left) 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:3887: done (10 left) 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 386 2024-01-13T18:13:48.924 INFO:tasks.rados.rados.0.smithi084.stdout:3889: expect (ObjNum 1096 snap 350 seq_num 1096) 2024-01-13T18:13:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:48 smithi099 ceph-mon[138788]: pgmap v978: 121 pgs: 121 active+clean; 388 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 19 op/s 2024-01-13T18:13:49.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:48 smithi084 ceph-mon[116404]: pgmap v978: 121 pgs: 121 active+clean; 388 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 19 op/s 2024-01-13T18:13:49.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:48 smithi084 ceph-mon[119097]: pgmap v978: 121 pgs: 121 active+clean; 388 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 19 op/s 2024-01-13T18:13:49.235 INFO:tasks.rados.rados.0.smithi084.stdout:3886: expect (ObjNum 1073 snap 340 seq_num 1073) 2024-01-13T18:13:49.700 INFO:tasks.rados.rados.0.smithi084.stdout:3888: expect (ObjNum 1080 snap 342 seq_num 1080) 2024-01-13T18:13:50.117 INFO:tasks.rados.rados.0.smithi084.stdout:3890: finishing copy_from to smithi084102331-16 2024-01-13T18:13:50.117 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1674 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:13:50.117 INFO:tasks.rados.rados.0.smithi084.stdout:3890: finishing copy_from racing read to smithi084102331-16 2024-01-13T18:13:50.117 INFO:tasks.rados.rados.0.smithi084.stdout:3899: seq_num 1191 ranges {2408448=753664} 2024-01-13T18:13:50.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:49 smithi099 ceph-mon[138788]: osdmap e844: 8 total, 8 up, 8 in 2024-01-13T18:13:50.134 INFO:tasks.rados.rados.0.smithi084.stdout:3899: writing smithi084102331-15 from 2408448 to 3162112 tid 1 2024-01-13T18:13:50.134 INFO:tasks.rados.rados.0.smithi084.stdout:3886: done (10 left) 2024-01-13T18:13:50.134 INFO:tasks.rados.rados.0.smithi084.stdout:3888: done (9 left) 2024-01-13T18:13:50.134 INFO:tasks.rados.rados.0.smithi084.stdout:3889: done (8 left) 2024-01-13T18:13:50.134 INFO:tasks.rados.rados.0.smithi084.stdout:3890: done (7 left) 2024-01-13T18:13:50.134 INFO:tasks.rados.rados.0.smithi084.stdout:3900: read oid 28 snap -1 2024-01-13T18:13:50.134 INFO:tasks.rados.rados.0.smithi084.stdout:3900: expect (ObjNum 1185 snap 383 seq_num 1185) 2024-01-13T18:13:50.135 INFO:tasks.rados.rados.0.smithi084.stdout:3901: rollback oid 18 current snap is 386 2024-01-13T18:13:50.135 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 352 2024-01-13T18:13:50.135 INFO:tasks.rados.rados.0.smithi084.stdout:3893: expect (ObjNum 1125 snap 363 seq_num 1125) 2024-01-13T18:13:50.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:49 smithi084 ceph-mon[116404]: osdmap e844: 8 total, 8 up, 8 in 2024-01-13T18:13:50.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:49 smithi084 ceph-mon[119097]: osdmap e844: 8 total, 8 up, 8 in 2024-01-13T18:13:50.254 INFO:tasks.rados.rados.0.smithi084.stdout:3894: expect (ObjNum 1031 snap 325 seq_num 1031) 2024-01-13T18:13:50.569 INFO:tasks.rados.rados.0.smithi084.stdout:3892: finishing copy_from to smithi084102331-4 2024-01-13T18:13:50.569 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 1755 (ObjNum 1088 snap 348 seq_num 1088) dirty exists 2024-01-13T18:13:50.569 INFO:tasks.rados.rados.0.smithi084.stdout:3892: finishing copy_from racing read to smithi084102331-4 2024-01-13T18:13:50.569 INFO:tasks.rados.rados.0.smithi084.stdout:3897: finishing copy_from to smithi084102331-7 2024-01-13T18:13:50.569 INFO:tasks.rados.rados.0.smithi084.stdout:3897: got expected ENOENT (src dne) 2024-01-13T18:13:50.569 INFO:tasks.rados.rados.0.smithi084.stdout:3897: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:13:50.569 INFO:tasks.rados.rados.0.smithi084.stdout:3892: done (8 left) 2024-01-13T18:13:50.569 INFO:tasks.rados.rados.0.smithi084.stdout:3893: done (7 left) 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3894: done (6 left) 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3897: done (5 left) 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3902: read oid 27 snap -1 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3902: expect (ObjNum 1175 snap 381 seq_num 1175) 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3903: rollback oid 23 current snap is 386 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 374 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3896: finishing write tid 1 to smithi084102331-14 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3896: finishing write tid 2 to smithi084102331-14 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3896: finishing write tid 3 to smithi084102331-14 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 1698 (ObjNum 1190 snap 386 seq_num 1190) dirty exists 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3896: left oid 14 (ObjNum 1190 snap 386 seq_num 1190) 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3898: finishing rollback tid 0 to smithi084102331-37 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3898: finishing rollback tid 1 to smithi084102331-37 2024-01-13T18:13:50.570 INFO:tasks.rados.rados.0.smithi084.stdout:3898: finishing rollback tid 2 to smithi084102331-37 2024-01-13T18:13:50.571 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 1881 (ObjNum 1167 snap 379 seq_num 1167) dirty exists 2024-01-13T18:13:50.571 INFO:tasks.rados.rados.0.smithi084.stdout:3901: finishing rollback tid 0 to smithi084102331-18 2024-01-13T18:13:50.571 INFO:tasks.rados.rados.0.smithi084.stdout:3901: finishing rollback tid 1 to smithi084102331-18 2024-01-13T18:13:50.571 INFO:tasks.rados.rados.0.smithi084.stdout:3901: finishing rollback tid 2 to smithi084102331-18 2024-01-13T18:13:50.571 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1801 (ObjNum 1063 snap 338 seq_num 1063) dirty exists 2024-01-13T18:13:50.571 INFO:tasks.rados.rados.0.smithi084.stdout:3899: finishing write tid 1 to smithi084102331-15 2024-01-13T18:13:50.571 INFO:tasks.rados.rados.0.smithi084.stdout:3899: finishing write tid 2 to smithi084102331-15 2024-01-13T18:13:50.571 INFO:tasks.rados.rados.0.smithi084.stdout:3899: finishing write tid 3 to smithi084102331-15 2024-01-13T18:13:50.571 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 2012 (ObjNum 1191 snap 386 seq_num 1191) dirty exists 2024-01-13T18:13:50.571 INFO:tasks.rados.rados.0.smithi084.stdout:3899: left oid 15 (ObjNum 1191 snap 386 seq_num 1191) 2024-01-13T18:13:50.571 INFO:tasks.rados.rados.0.smithi084.stdout:3900: expect (ObjNum 1185 snap 383 seq_num 1185) 2024-01-13T18:13:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:13:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:13:50] "GET /metrics HTTP/1.1" 200 36190 "" "Prometheus/2.43.0" 2024-01-13T18:13:50.742 INFO:tasks.rados.rados.0.smithi084.stdout:3903: finishing rollback tid 0 to smithi084102331-23 2024-01-13T18:13:50.742 INFO:tasks.rados.rados.0.smithi084.stdout:3903: finishing rollback tid 1 to smithi084102331-23 2024-01-13T18:13:50.743 INFO:tasks.rados.rados.0.smithi084.stdout:3903: finishing rollback tid 2 to smithi084102331-23 2024-01-13T18:13:50.743 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 2050 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:13:50.743 INFO:tasks.rados.rados.0.smithi084.stdout:3902: expect (ObjNum 1175 snap 381 seq_num 1175) 2024-01-13T18:13:50.997 INFO:tasks.rados.rados.0.smithi084.stdout:3896: done (6 left) 2024-01-13T18:13:50.997 INFO:tasks.rados.rados.0.smithi084.stdout:3898: done (5 left) 2024-01-13T18:13:50.998 INFO:tasks.rados.rados.0.smithi084.stdout:3899: done (4 left) 2024-01-13T18:13:50.998 INFO:tasks.rados.rados.0.smithi084.stdout:3900: done (3 left) 2024-01-13T18:13:50.998 INFO:tasks.rados.rados.0.smithi084.stdout:3901: done (2 left) 2024-01-13T18:13:50.998 INFO:tasks.rados.rados.0.smithi084.stdout:3902: done (1 left) 2024-01-13T18:13:50.998 INFO:tasks.rados.rados.0.smithi084.stdout:3903: done (0 left) 2024-01-13T18:13:50.998 INFO:tasks.rados.rados.0.smithi084.stdout:3904: rmattr oid 23 current snap is 386 2024-01-13T18:13:50.999 INFO:tasks.rados.rados.0.smithi084.stdout:3905: rollback oid 4 current snap is 386 2024-01-13T18:13:50.999 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 375 2024-01-13T18:13:50.999 INFO:tasks.rados.rados.0.smithi084.stdout:3906: snap_create 2024-01-13T18:13:51.000 INFO:tasks.rados.rados.0.smithi084.stdout:3905: finishing rollback tid 0 to smithi084102331-4 2024-01-13T18:13:51.000 INFO:tasks.rados.rados.0.smithi084.stdout:3905: finishing rollback tid 1 to smithi084102331-4 2024-01-13T18:13:51.000 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 2051 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:13:51.001 INFO:tasks.rados.rados.0.smithi084.stdout:3905: finishing rollback tid 2 to smithi084102331-4 2024-01-13T18:13:51.001 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 1888 (ObjNum 1115 snap 358 seq_num 1115) dirty exists 2024-01-13T18:13:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:50 smithi099 ceph-mon[138788]: pgmap v980: 121 pgs: 121 active+clean; 390 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 1.8 MiB/s wr, 26 op/s 2024-01-13T18:13:51.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:51.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:50 smithi084 ceph-mon[119097]: pgmap v980: 121 pgs: 121 active+clean; 390 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 1.8 MiB/s wr, 26 op/s 2024-01-13T18:13:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:13:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:50 smithi084 ceph-mon[116404]: pgmap v980: 121 pgs: 121 active+clean; 390 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 1.8 MiB/s wr, 26 op/s 2024-01-13T18:13:51.854 INFO:tasks.rados.rados.0.smithi084.stdout:3904: done (2 left) 2024-01-13T18:13:51.854 INFO:tasks.rados.rados.0.smithi084.stdout:3905: done (1 left) 2024-01-13T18:13:51.854 INFO:tasks.rados.rados.0.smithi084.stdout:3906: done (0 left) 2024-01-13T18:13:51.855 INFO:tasks.rados.rados.0.smithi084.stdout:3907: delete oid 27 current snap is 387 2024-01-13T18:13:51.859 INFO:tasks.rados.rados.0.smithi084.stdout:3907: done (0 left) 2024-01-13T18:13:51.859 INFO:tasks.rados.rados.0.smithi084.stdout:3908: copy_from oid 7 from oid 11 current snap is 387 2024-01-13T18:13:51.859 INFO:tasks.rados.rados.0.smithi084.stdout:3909: snap_create 2024-01-13T18:13:51.871 INFO:tasks.rados.rados.0.smithi084.stdout:3908: finishing copy_from to smithi084102331-7 2024-01-13T18:13:51.871 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1785 (ObjNum 1144 snap 370 seq_num 1144) dirty exists 2024-01-13T18:13:51.872 INFO:tasks.rados.rados.0.smithi084.stdout:3908: finishing copy_from racing read to smithi084102331-7 2024-01-13T18:13:52.759 INFO:tasks.rados.rados.0.smithi084.stdout:3908: done (1 left) 2024-01-13T18:13:52.759 INFO:tasks.rados.rados.0.smithi084.stdout:3909: done (0 left) 2024-01-13T18:13:52.759 INFO:tasks.rados.rados.0.smithi084.stdout:3910: rmattr oid 22 current snap is 388 2024-01-13T18:13:52.759 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 388 2024-01-13T18:13:52.759 INFO:tasks.rados.rados.0.smithi084.stdout:3911: seq_num 1193 ranges {0=786432} 2024-01-13T18:13:52.764 INFO:tasks.rados.rados.0.smithi084.stdout:3911: writing smithi084102331-6 from 0 to 786432 tid 1 2024-01-13T18:13:52.764 INFO:tasks.rados.rados.0.smithi084.stdout:3912: copy_from oid 24 from oid 7 current snap is 388 2024-01-13T18:13:52.764 INFO:tasks.rados.rados.0.smithi084.stdout:3913: snap_create 2024-01-13T18:13:52.768 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 2053 (ObjNum 1080 snap 342 seq_num 1080) dirty exists 2024-01-13T18:13:52.768 INFO:tasks.rados.rados.0.smithi084.stdout:3911: finishing write tid 1 to smithi084102331-6 2024-01-13T18:13:52.768 INFO:tasks.rados.rados.0.smithi084.stdout:3911: finishing write tid 2 to smithi084102331-6 2024-01-13T18:13:52.771 INFO:tasks.rados.rados.0.smithi084.stdout:3911: finishing write tid 3 to smithi084102331-6 2024-01-13T18:13:52.771 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 1794 (ObjNum 1193 snap 388 seq_num 1193) dirty exists 2024-01-13T18:13:52.771 INFO:tasks.rados.rados.0.smithi084.stdout:3911: left oid 6 (ObjNum 1193 snap 388 seq_num 1193) 2024-01-13T18:13:52.777 INFO:tasks.rados.rados.0.smithi084.stdout:3912: finishing copy_from to smithi084102331-24 2024-01-13T18:13:52.777 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 1785 (ObjNum 1144 snap 370 seq_num 1144) dirty exists 2024-01-13T18:13:52.778 INFO:tasks.rados.rados.0.smithi084.stdout:3912: finishing copy_from racing read to smithi084102331-24 2024-01-13T18:13:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:52 smithi099 ceph-mon[138788]: osdmap e845: 8 total, 8 up, 8 in 2024-01-13T18:13:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:52 smithi099 ceph-mon[138788]: pgmap v982: 121 pgs: 121 active+clean; 407 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 4.0 MiB/s wr, 21 op/s 2024-01-13T18:13:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:52 smithi099 ceph-mon[138788]: osdmap e846: 8 total, 8 up, 8 in 2024-01-13T18:13:53.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:52 smithi084 ceph-mon[119097]: osdmap e845: 8 total, 8 up, 8 in 2024-01-13T18:13:53.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:52 smithi084 ceph-mon[119097]: pgmap v982: 121 pgs: 121 active+clean; 407 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 4.0 MiB/s wr, 21 op/s 2024-01-13T18:13:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:52 smithi084 ceph-mon[119097]: osdmap e846: 8 total, 8 up, 8 in 2024-01-13T18:13:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:52 smithi084 ceph-mon[116404]: osdmap e845: 8 total, 8 up, 8 in 2024-01-13T18:13:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:52 smithi084 ceph-mon[116404]: pgmap v982: 121 pgs: 121 active+clean; 407 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 4.0 MiB/s wr, 21 op/s 2024-01-13T18:13:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:52 smithi084 ceph-mon[116404]: osdmap e846: 8 total, 8 up, 8 in 2024-01-13T18:13:53.766 INFO:tasks.rados.rados.0.smithi084.stdout:3910: done (3 left) 2024-01-13T18:13:53.766 INFO:tasks.rados.rados.0.smithi084.stdout:3911: done (2 left) 2024-01-13T18:13:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:3912: done (1 left) 2024-01-13T18:13:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:3913: done (0 left) 2024-01-13T18:13:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 389 2024-01-13T18:13:53.767 INFO:tasks.rados.rados.0.smithi084.stdout:3914: seq_num 1194 ranges {3702784=802816} 2024-01-13T18:13:53.790 INFO:tasks.rados.rados.0.smithi084.stdout:3914: writing smithi084102331-20 from 3702784 to 4505600 tid 1 2024-01-13T18:13:53.790 INFO:tasks.rados.rados.0.smithi084.stdout:3915: read oid 30 snap -1 2024-01-13T18:13:53.790 INFO:tasks.rados.rados.0.smithi084.stdout:3915: expect (ObjNum 1087 snap 348 seq_num 1087) 2024-01-13T18:13:53.790 INFO:tasks.rados.rados.0.smithi084.stdout:3916: snap_remove snap 385 2024-01-13T18:13:54.771 INFO:tasks.rados.rados.0.smithi084.stdout:3916: done (2 left) 2024-01-13T18:13:54.771 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 389 2024-01-13T18:13:54.771 INFO:tasks.rados.rados.0.smithi084.stdout:3914: finishing write tid 1 to smithi084102331-20 2024-01-13T18:13:54.771 INFO:tasks.rados.rados.0.smithi084.stdout:3917: seq_num 1195 ranges {1343488=417792,1761280=401408} 2024-01-13T18:13:54.781 INFO:tasks.rados.rados.0.smithi084.stdout:3917: writing smithi084102331-29 from 1343488 to 1761280 tid 1 2024-01-13T18:13:54.784 INFO:tasks.rados.rados.0.smithi084.stdout:3917: writing smithi084102331-29 from 1761280 to 2162688 tid 2 2024-01-13T18:13:54.784 INFO:tasks.rados.rados.0.smithi084.stdout:3918: read oid 18 snap -1 2024-01-13T18:13:54.784 INFO:tasks.rados.rados.0.smithi084.stdout:3918: expect (ObjNum 1063 snap 338 seq_num 1063) 2024-01-13T18:13:54.784 INFO:tasks.rados.rados.0.smithi084.stdout:3919: snap_create 2024-01-13T18:13:54.788 INFO:tasks.rados.rados.0.smithi084.stdout:3914: finishing write tid 2 to smithi084102331-20 2024-01-13T18:13:54.789 INFO:tasks.rados.rados.0.smithi084.stdout:3914: finishing write tid 3 to smithi084102331-20 2024-01-13T18:13:54.789 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 1655 (ObjNum 1194 snap 389 seq_num 1194) dirty exists 2024-01-13T18:13:54.789 INFO:tasks.rados.rados.0.smithi084.stdout:3914: left oid 20 (ObjNum 1194 snap 389 seq_num 1194) 2024-01-13T18:13:54.789 INFO:tasks.rados.rados.0.smithi084.stdout:3915: expect (ObjNum 1087 snap 348 seq_num 1087) 2024-01-13T18:13:54.910 INFO:tasks.rados.rados.0.smithi084.stdout:3917: finishing write tid 1 to smithi084102331-29 2024-01-13T18:13:54.910 INFO:tasks.rados.rados.0.smithi084.stdout:3917: finishing write tid 2 to smithi084102331-29 2024-01-13T18:13:54.910 INFO:tasks.rados.rados.0.smithi084.stdout:3917: finishing write tid 3 to smithi084102331-29 2024-01-13T18:13:54.910 INFO:tasks.rados.rados.0.smithi084.stdout:3917: finishing write tid 4 to smithi084102331-29 2024-01-13T18:13:54.910 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 1768 (ObjNum 1195 snap 389 seq_num 1195) dirty exists 2024-01-13T18:13:54.910 INFO:tasks.rados.rados.0.smithi084.stdout:3917: left oid 29 (ObjNum 1195 snap 389 seq_num 1195) 2024-01-13T18:13:54.910 INFO:tasks.rados.rados.0.smithi084.stdout:3918: expect (ObjNum 1063 snap 338 seq_num 1063) 2024-01-13T18:13:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:54 smithi099 ceph-mon[138788]: osdmap e847: 8 total, 8 up, 8 in 2024-01-13T18:13:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:54 smithi099 ceph-mon[138788]: pgmap v985: 121 pgs: 121 active+clean; 420 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 27 MiB/s rd, 3.2 MiB/s wr, 20 op/s 2024-01-13T18:13:55.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:54 smithi084 ceph-mon[119097]: osdmap e847: 8 total, 8 up, 8 in 2024-01-13T18:13:55.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:54 smithi084 ceph-mon[119097]: pgmap v985: 121 pgs: 121 active+clean; 420 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 27 MiB/s rd, 3.2 MiB/s wr, 20 op/s 2024-01-13T18:13:55.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:54 smithi084 ceph-mon[116404]: osdmap e847: 8 total, 8 up, 8 in 2024-01-13T18:13:55.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:54 smithi084 ceph-mon[116404]: pgmap v985: 121 pgs: 121 active+clean; 420 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 27 MiB/s rd, 3.2 MiB/s wr, 20 op/s 2024-01-13T18:13:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:55 smithi099 ceph-mon[138788]: osdmap e848: 8 total, 8 up, 8 in 2024-01-13T18:13:56.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:55 smithi084 ceph-mon[116404]: osdmap e848: 8 total, 8 up, 8 in 2024-01-13T18:13:56.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:55 smithi084 ceph-mon[119097]: osdmap e848: 8 total, 8 up, 8 in 2024-01-13T18:13:56.230 INFO:tasks.rados.rados.0.smithi084.stdout:3914: done (4 left) 2024-01-13T18:13:56.230 INFO:tasks.rados.rados.0.smithi084.stdout:3915: done (3 left) 2024-01-13T18:13:56.230 INFO:tasks.rados.rados.0.smithi084.stdout:3917: done (2 left) 2024-01-13T18:13:56.230 INFO:tasks.rados.rados.0.smithi084.stdout:3918: done (1 left) 2024-01-13T18:13:56.230 INFO:tasks.rados.rados.0.smithi084.stdout:3919: done (0 left) 2024-01-13T18:13:56.230 INFO:tasks.rados.rados.0.smithi084.stdout:3920: snap_create 2024-01-13T18:13:56.786 INFO:tasks.rados.rados.0.smithi084.stdout:3920: done (0 left) 2024-01-13T18:13:56.786 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 391 2024-01-13T18:13:56.786 INFO:tasks.rados.rados.0.smithi084.stdout:3921: seq_num 1196 ranges {532480=434176,966656=401408} 2024-01-13T18:13:56.791 INFO:tasks.rados.rados.0.smithi084.stdout:3921: writing smithi084102331-49 from 532480 to 966656 tid 1 2024-01-13T18:13:56.794 INFO:tasks.rados.rados.0.smithi084.stdout:3921: writing smithi084102331-49 from 966656 to 1368064 tid 2 2024-01-13T18:13:56.794 INFO:tasks.rados.rados.0.smithi084.stdout:3922: rollback oid 45 current snap is 391 2024-01-13T18:13:56.794 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 381 2024-01-13T18:13:56.794 INFO:tasks.rados.rados.0.smithi084.stdout:3923: setattr oid 5 current snap is 391 2024-01-13T18:13:56.795 INFO:tasks.rados.rados.0.smithi084.stdout:3924: copy_from oid 3 from oid 46 current snap is 391 2024-01-13T18:13:56.795 INFO:tasks.rados.rados.0.smithi084.stdout:3925: copy_from oid 47 from oid 50 current snap is 391 2024-01-13T18:13:56.795 INFO:tasks.rados.rados.0.smithi084.stdout:3926: read oid 38 snap -1 2024-01-13T18:13:56.795 INFO:tasks.rados.rados.0.smithi084.stdout:3926: expect (ObjNum 1179 snap 381 seq_num 1179) 2024-01-13T18:13:56.795 INFO:tasks.rados.rados.0.smithi084.stdout:3927: snap_create 2024-01-13T18:13:56.798 INFO:tasks.rados.rados.0.smithi084.stdout:3921: finishing write tid 1 to smithi084102331-49 2024-01-13T18:13:56.798 INFO:tasks.rados.rados.0.smithi084.stdout:3921: finishing write tid 2 to smithi084102331-49 2024-01-13T18:13:56.798 INFO:tasks.rados.rados.0.smithi084.stdout:3921: finishing write tid 3 to smithi084102331-49 2024-01-13T18:13:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 1889 (ObjNum 1110 snap 357 seq_num 1110) dirty exists 2024-01-13T18:13:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:3921: finishing write tid 4 to smithi084102331-49 2024-01-13T18:13:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1701 (ObjNum 1196 snap 391 seq_num 1196) dirty exists 2024-01-13T18:13:56.801 INFO:tasks.rados.rados.0.smithi084.stdout:3921: left oid 49 (ObjNum 1196 snap 391 seq_num 1196) 2024-01-13T18:13:56.806 INFO:tasks.rados.rados.0.smithi084.stdout:3922: finishing rollback tid 0 to smithi084102331-45 2024-01-13T18:13:56.809 INFO:tasks.rados.rados.0.smithi084.stdout:3922: finishing rollback tid 1 to smithi084102331-45 2024-01-13T18:13:56.810 INFO:tasks.rados.rados.0.smithi084.stdout:3922: finishing rollback tid 2 to smithi084102331-45 2024-01-13T18:13:56.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 2011 (ObjNum 1142 snap 368 seq_num 1142) dirty exists 2024-01-13T18:13:56.815 INFO:tasks.rados.rados.0.smithi084.stdout:3925: finishing copy_from to smithi084102331-47 2024-01-13T18:13:56.815 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 1773 (ObjNum 1119 snap 361 seq_num 1119) dirty exists 2024-01-13T18:13:56.816 INFO:tasks.rados.rados.0.smithi084.stdout:3925: finishing copy_from racing read to smithi084102331-47 2024-01-13T18:13:56.822 INFO:tasks.rados.rados.0.smithi084.stdout:3926: expect (ObjNum 1179 snap 381 seq_num 1179) 2024-01-13T18:13:57.048 INFO:tasks.rados.rados.0.smithi084.stdout:3924: finishing copy_from to smithi084102331-3 2024-01-13T18:13:57.048 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 1801 (ObjNum 949 snap 300 seq_num 949) dirty exists 2024-01-13T18:13:57.048 INFO:tasks.rados.rados.0.smithi084.stdout:3924: finishing copy_from racing read to smithi084102331-3 2024-01-13T18:13:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:56 smithi099 ceph-mon[138788]: osdmap e849: 8 total, 8 up, 8 in 2024-01-13T18:13:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:56 smithi099 ceph-mon[138788]: pgmap v988: 121 pgs: 121 active+clean; 420 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 184 KiB/s wr, 3 op/s 2024-01-13T18:13:57.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:56 smithi084 ceph-mon[116404]: osdmap e849: 8 total, 8 up, 8 in 2024-01-13T18:13:57.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:56 smithi084 ceph-mon[116404]: pgmap v988: 121 pgs: 121 active+clean; 420 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 184 KiB/s wr, 3 op/s 2024-01-13T18:13:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:56 smithi084 ceph-mon[119097]: osdmap e849: 8 total, 8 up, 8 in 2024-01-13T18:13:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:56 smithi084 ceph-mon[119097]: pgmap v988: 121 pgs: 121 active+clean; 420 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 184 KiB/s wr, 3 op/s 2024-01-13T18:13:57.756 INFO:tasks.rados.rados.0.smithi084.stdout:3921: done (6 left) 2024-01-13T18:13:57.756 INFO:tasks.rados.rados.0.smithi084.stdout:3922: done (5 left) 2024-01-13T18:13:57.756 INFO:tasks.rados.rados.0.smithi084.stdout:3923: done (4 left) 2024-01-13T18:13:57.756 INFO:tasks.rados.rados.0.smithi084.stdout:3924: done (3 left) 2024-01-13T18:13:57.757 INFO:tasks.rados.rados.0.smithi084.stdout:3925: done (2 left) 2024-01-13T18:13:57.757 INFO:tasks.rados.rados.0.smithi084.stdout:3926: done (1 left) 2024-01-13T18:13:57.757 INFO:tasks.rados.rados.0.smithi084.stdout:3927: done (0 left) 2024-01-13T18:13:57.757 INFO:tasks.rados.rados.0.smithi084.stdout:3928: delete oid 7 current snap is 392 2024-01-13T18:13:57.763 INFO:tasks.rados.rados.0.smithi084.stdout:3928: done (0 left) 2024-01-13T18:13:57.763 INFO:tasks.rados.rados.0.smithi084.stdout:3929: snap_remove snap 387 2024-01-13T18:13:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:57 smithi099 ceph-mon[138788]: osdmap e850: 8 total, 8 up, 8 in 2024-01-13T18:13:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:57 smithi099 ceph-mon[138788]: osdmap e851: 8 total, 8 up, 8 in 2024-01-13T18:13:58.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:57 smithi084 ceph-mon[116404]: osdmap e850: 8 total, 8 up, 8 in 2024-01-13T18:13:58.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:57 smithi084 ceph-mon[116404]: osdmap e851: 8 total, 8 up, 8 in 2024-01-13T18:13:58.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:57 smithi084 ceph-mon[119097]: osdmap e850: 8 total, 8 up, 8 in 2024-01-13T18:13:58.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:57 smithi084 ceph-mon[119097]: osdmap e851: 8 total, 8 up, 8 in 2024-01-13T18:13:58.763 INFO:tasks.rados.rados.0.smithi084.stdout:3929: done (0 left) 2024-01-13T18:13:58.763 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 392 2024-01-13T18:13:58.763 INFO:tasks.rados.rados.0.smithi084.stdout:3930: seq_num 1198 ranges {3162112=466944,3629056=401408} 2024-01-13T18:13:58.782 INFO:tasks.rados.rados.0.smithi084.stdout:3930: writing smithi084102331-15 from 3162112 to 3629056 tid 1 2024-01-13T18:13:58.785 INFO:tasks.rados.rados.0.smithi084.stdout:3930: writing smithi084102331-15 from 3629056 to 4030464 tid 2 2024-01-13T18:13:58.785 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 392 2024-01-13T18:13:58.785 INFO:tasks.rados.rados.0.smithi084.stdout:3931: seq_num 1199 ranges {2408448=483328,2891776=401408} 2024-01-13T18:13:58.800 INFO:tasks.rados.rados.0.smithi084.stdout:3931: writing smithi084102331-44 from 2408448 to 2891776 tid 1 2024-01-13T18:13:58.803 INFO:tasks.rados.rados.0.smithi084.stdout:3931: writing smithi084102331-44 from 2891776 to 3293184 tid 2 2024-01-13T18:13:58.803 INFO:tasks.rados.rados.0.smithi084.stdout:3932: read oid 31 snap 390 2024-01-13T18:13:58.803 INFO:tasks.rados.rados.0.smithi084.stdout:3932: expect (ObjNum 1119 snap 361 seq_num 1119) 2024-01-13T18:13:58.803 INFO:tasks.rados.rados.0.smithi084.stdout:3933: read oid 36 snap 375 2024-01-13T18:13:58.803 INFO:tasks.rados.rados.0.smithi084.stdout:3933: expect (ObjNum 1137 snap 367 seq_num 1137) 2024-01-13T18:13:58.803 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 392 2024-01-13T18:13:58.803 INFO:tasks.rados.rados.0.smithi084.stdout:3930: finishing write tid 1 to smithi084102331-15 2024-01-13T18:13:58.804 INFO:tasks.rados.rados.0.smithi084.stdout:3930: finishing write tid 2 to smithi084102331-15 2024-01-13T18:13:58.804 INFO:tasks.rados.rados.0.smithi084.stdout:3930: finishing write tid 3 to smithi084102331-15 2024-01-13T18:13:58.804 INFO:tasks.rados.rados.0.smithi084.stdout:3930: finishing write tid 4 to smithi084102331-15 2024-01-13T18:13:58.804 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 2019 (ObjNum 1198 snap 392 seq_num 1198) dirty exists 2024-01-13T18:13:58.804 INFO:tasks.rados.rados.0.smithi084.stdout:3930: left oid 15 (ObjNum 1198 snap 392 seq_num 1198) 2024-01-13T18:13:58.804 INFO:tasks.rados.rados.0.smithi084.stdout:3934: seq_num 1200 ranges {1368064=499712,1867776=401408} 2024-01-13T18:13:58.815 INFO:tasks.rados.rados.0.smithi084.stdout:3934: writing smithi084102331-49 from 1368064 to 1867776 tid 1 2024-01-13T18:13:58.817 INFO:tasks.rados.rados.0.smithi084.stdout:3934: writing smithi084102331-49 from 1867776 to 2269184 tid 2 2024-01-13T18:13:58.817 INFO:tasks.rados.rados.0.smithi084.stdout:3930: done (4 left) 2024-01-13T18:13:58.817 INFO:tasks.rados.rados.0.smithi084.stdout:3935: snap_remove snap 356 2024-01-13T18:13:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:58 smithi099 ceph-mon[138788]: pgmap v991: 121 pgs: 121 active+clean; 430 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 6 op/s 2024-01-13T18:13:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:13:58 smithi099 ceph-mon[138788]: osdmap e852: 8 total, 8 up, 8 in 2024-01-13T18:13:59.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:58 smithi084 ceph-mon[116404]: pgmap v991: 121 pgs: 121 active+clean; 430 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 6 op/s 2024-01-13T18:13:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:13:58 smithi084 ceph-mon[116404]: osdmap e852: 8 total, 8 up, 8 in 2024-01-13T18:13:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:58 smithi084 ceph-mon[119097]: pgmap v991: 121 pgs: 121 active+clean; 430 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 6 op/s 2024-01-13T18:13:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:13:58 smithi084 ceph-mon[119097]: osdmap e852: 8 total, 8 up, 8 in 2024-01-13T18:13:59.795 INFO:tasks.rados.rados.0.smithi084.stdout:3935: done (4 left) 2024-01-13T18:13:59.795 INFO:tasks.rados.rados.0.smithi084.stdout:3936: read oid 17 snap -1 2024-01-13T18:13:59.796 INFO:tasks.rados.rados.0.smithi084.stdout:3936: expect (ObjNum 1100 snap 351 seq_num 1100) 2024-01-13T18:13:59.796 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 392 2024-01-13T18:13:59.796 INFO:tasks.rados.rados.0.smithi084.stdout:3931: finishing write tid 1 to smithi084102331-44 2024-01-13T18:13:59.796 INFO:tasks.rados.rados.0.smithi084.stdout:3931: finishing write tid 2 to smithi084102331-44 2024-01-13T18:13:59.796 INFO:tasks.rados.rados.0.smithi084.stdout:3931: finishing write tid 3 to smithi084102331-44 2024-01-13T18:13:59.796 INFO:tasks.rados.rados.0.smithi084.stdout:3937: seq_num 1201 ranges {1105920=524288,1630208=401408} 2024-01-13T18:13:59.805 INFO:tasks.rados.rados.0.smithi084.stdout:3937: writing smithi084102331-25 from 1105920 to 1630208 tid 1 2024-01-13T18:13:59.808 INFO:tasks.rados.rados.0.smithi084.stdout:3937: writing smithi084102331-25 from 1630208 to 2031616 tid 2 2024-01-13T18:13:59.808 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 392 2024-01-13T18:13:59.808 INFO:tasks.rados.rados.0.smithi084.stdout:3931: finishing write tid 4 to smithi084102331-44 2024-01-13T18:13:59.808 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 2023 (ObjNum 1199 snap 392 seq_num 1199) dirty exists 2024-01-13T18:13:59.808 INFO:tasks.rados.rados.0.smithi084.stdout:3931: left oid 44 (ObjNum 1199 snap 392 seq_num 1199) 2024-01-13T18:13:59.808 INFO:tasks.rados.rados.0.smithi084.stdout:3932: expect (ObjNum 1119 snap 361 seq_num 1119) 2024-01-13T18:13:59.925 INFO:tasks.rados.rados.0.smithi084.stdout:3933: expect (ObjNum 1137 snap 367 seq_num 1137) 2024-01-13T18:14:00.573 INFO:tasks.rados.rados.0.smithi084.stdout:3934: finishing write tid 1 to smithi084102331-49 2024-01-13T18:14:00.573 INFO:tasks.rados.rados.0.smithi084.stdout:3934: finishing write tid 2 to smithi084102331-49 2024-01-13T18:14:00.574 INFO:tasks.rados.rados.0.smithi084.stdout:3934: finishing write tid 3 to smithi084102331-49 2024-01-13T18:14:00.574 INFO:tasks.rados.rados.0.smithi084.stdout:3934: finishing write tid 4 to smithi084102331-49 2024-01-13T18:14:00.574 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 1704 (ObjNum 1200 snap 392 seq_num 1200) dirty exists 2024-01-13T18:14:00.574 INFO:tasks.rados.rados.0.smithi084.stdout:3934: left oid 49 (ObjNum 1200 snap 392 seq_num 1200) 2024-01-13T18:14:00.574 INFO:tasks.rados.rados.0.smithi084.stdout:3938: seq_num 1202 ranges {12288000=540672,12828672=401408} 2024-01-13T18:14:00.640 INFO:tasks.rados.rados.0.smithi084.stdout:3938: writing smithi084102331-45 from 12288000 to 12828672 tid 1 2024-01-13T18:14:00.642 INFO:tasks.rados.rados.0.smithi084.stdout:3938: writing smithi084102331-45 from 12828672 to 13230080 tid 2 2024-01-13T18:14:00.643 INFO:tasks.rados.rados.0.smithi084.stdout:3931: done (6 left) 2024-01-13T18:14:00.643 INFO:tasks.rados.rados.0.smithi084.stdout:3932: done (5 left) 2024-01-13T18:14:00.643 INFO:tasks.rados.rados.0.smithi084.stdout:3933: done (4 left) 2024-01-13T18:14:00.643 INFO:tasks.rados.rados.0.smithi084.stdout:3934: done (3 left) 2024-01-13T18:14:00.643 INFO:tasks.rados.rados.0.smithi084.stdout:3939: copy_from oid 49 from oid 42 current snap is 392 2024-01-13T18:14:00.643 INFO:tasks.rados.rados.0.smithi084.stdout:3940: snap_create 2024-01-13T18:14:00.643 INFO:tasks.rados.rados.0.smithi084.stdout:3936: expect (ObjNum 1100 snap 351 seq_num 1100) 2024-01-13T18:14:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:14:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:14:00] "GET /metrics HTTP/1.1" 200 36190 "" "Prometheus/2.43.0" 2024-01-13T18:14:00.949 INFO:tasks.rados.rados.0.smithi084.stdout:3937: finishing write tid 1 to smithi084102331-25 2024-01-13T18:14:00.949 INFO:tasks.rados.rados.0.smithi084.stdout:3937: finishing write tid 2 to smithi084102331-25 2024-01-13T18:14:00.949 INFO:tasks.rados.rados.0.smithi084.stdout:3937: finishing write tid 3 to smithi084102331-25 2024-01-13T18:14:00.949 INFO:tasks.rados.rados.0.smithi084.stdout:3937: finishing write tid 4 to smithi084102331-25 2024-01-13T18:14:00.949 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 1884 (ObjNum 1201 snap 392 seq_num 1201) dirty exists 2024-01-13T18:14:00.949 INFO:tasks.rados.rados.0.smithi084.stdout:3937: left oid 25 (ObjNum 1201 snap 392 seq_num 1201) 2024-01-13T18:14:00.949 INFO:tasks.rados.rados.0.smithi084.stdout:3939: finishing copy_from to smithi084102331-49 2024-01-13T18:14:00.949 INFO:tasks.rados.rados.0.smithi084.stdout:3939: got expected ENOENT (src dne) 2024-01-13T18:14:00.949 INFO:tasks.rados.rados.0.smithi084.stdout:3939: finishing copy_from racing read to smithi084102331-49 2024-01-13T18:14:00.949 INFO:tasks.rados.rados.0.smithi084.stdout:3938: finishing write tid 1 to smithi084102331-45 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:3938: finishing write tid 2 to smithi084102331-45 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:3938: finishing write tid 3 to smithi084102331-45 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:3936: done (4 left) 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:3937: done (3 left) 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:3939: done (2 left) 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:3940: done (1 left) 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:3941: read oid 39 snap -1 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:3941: expect (ObjNum 1162 snap 378 seq_num 1162) 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:3942: setattr oid 31 current snap is 393 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:3938: finishing write tid 4 to smithi084102331-45 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 2031 (ObjNum 1202 snap 392 seq_num 1202) dirty exists 2024-01-13T18:14:00.950 INFO:tasks.rados.rados.0.smithi084.stdout:3938: left oid 45 (ObjNum 1202 snap 392 seq_num 1202) 2024-01-13T18:14:00.951 INFO:tasks.rados.rados.0.smithi084.stdout:3938: done (2 left) 2024-01-13T18:14:00.951 INFO:tasks.rados.rados.0.smithi084.stdout:3943: read oid 26 snap -1 2024-01-13T18:14:00.951 INFO:tasks.rados.rados.0.smithi084.stdout:3943: expect (ObjNum 1187 snap 384 seq_num 1187) 2024-01-13T18:14:00.951 INFO:tasks.rados.rados.0.smithi084.stdout:3944: copy_from oid 16 from oid 20 current snap is 393 2024-01-13T18:14:00.951 INFO:tasks.rados.rados.0.smithi084.stdout:3945: setattr oid 7 current snap is 393 2024-01-13T18:14:00.951 INFO:tasks.rados.rados.0.smithi084.stdout:3946: delete oid 29 current snap is 393 2024-01-13T18:14:00.953 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 2033 (ObjNum 1119 snap 361 seq_num 1119) dirty exists 2024-01-13T18:14:00.955 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 1882 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-01-13T18:14:00.956 INFO:tasks.rados.rados.0.smithi084.stdout:3942: done (5 left) 2024-01-13T18:14:00.956 INFO:tasks.rados.rados.0.smithi084.stdout:3945: done (4 left) 2024-01-13T18:14:00.956 INFO:tasks.rados.rados.0.smithi084.stdout:3946: done (3 left) 2024-01-13T18:14:00.956 INFO:tasks.rados.rados.0.smithi084.stdout:3947: rmattr oid 5 current snap is 393 2024-01-13T18:14:00.957 INFO:tasks.rados.rados.0.smithi084.stdout:3948: snap_create 2024-01-13T18:14:00.961 INFO:tasks.rados.rados.0.smithi084.stdout:3943: expect (ObjNum 1187 snap 384 seq_num 1187) 2024-01-13T18:14:01.068 INFO:tasks.rados.rados.0.smithi084.stdout:3941: expect (ObjNum 1162 snap 378 seq_num 1162) 2024-01-13T18:14:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:00 smithi099 ceph-mon[138788]: osdmap e853: 8 total, 8 up, 8 in 2024-01-13T18:14:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:00 smithi099 ceph-mon[138788]: pgmap v994: 121 pgs: 121 active+clean; 432 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-01-13T18:14:01.128 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 1890 (ObjNum 1110 snap 357 seq_num 1110) dirty exists 2024-01-13T18:14:01.128 INFO:tasks.rados.rados.0.smithi084.stdout:3944: finishing copy_from to smithi084102331-16 2024-01-13T18:14:01.128 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1655 (ObjNum 1194 snap 389 seq_num 1194) dirty exists 2024-01-13T18:14:01.129 INFO:tasks.rados.rados.0.smithi084.stdout:3944: finishing copy_from racing read to smithi084102331-16 2024-01-13T18:14:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:00 smithi084 ceph-mon[116404]: osdmap e853: 8 total, 8 up, 8 in 2024-01-13T18:14:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:00 smithi084 ceph-mon[116404]: pgmap v994: 121 pgs: 121 active+clean; 432 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-01-13T18:14:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:00 smithi084 ceph-mon[119097]: osdmap e853: 8 total, 8 up, 8 in 2024-01-13T18:14:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:00 smithi084 ceph-mon[119097]: pgmap v994: 121 pgs: 121 active+clean; 432 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-01-13T18:14:01.807 INFO:tasks.rados.rados.0.smithi084.stdout:3941: done (4 left) 2024-01-13T18:14:01.807 INFO:tasks.rados.rados.0.smithi084.stdout:3943: done (3 left) 2024-01-13T18:14:01.807 INFO:tasks.rados.rados.0.smithi084.stdout:3944: done (2 left) 2024-01-13T18:14:01.807 INFO:tasks.rados.rados.0.smithi084.stdout:3947: done (1 left) 2024-01-13T18:14:01.807 INFO:tasks.rados.rados.0.smithi084.stdout:3948: done (0 left) 2024-01-13T18:14:01.807 INFO:tasks.rados.rados.0.smithi084.stdout:3949: snap_remove snap 386 2024-01-13T18:14:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:01 smithi099 ceph-mon[138788]: osdmap e854: 8 total, 8 up, 8 in 2024-01-13T18:14:02.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:01 smithi084 ceph-mon[116404]: osdmap e854: 8 total, 8 up, 8 in 2024-01-13T18:14:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:01 smithi084 ceph-mon[119097]: osdmap e854: 8 total, 8 up, 8 in 2024-01-13T18:14:02.761 INFO:tasks.rados.rados.0.smithi084.stdout:3949: done (0 left) 2024-01-13T18:14:02.761 INFO:tasks.rados.rados.0.smithi084.stdout:3950: read oid 49 snap -1 2024-01-13T18:14:02.761 INFO:tasks.rados.rados.0.smithi084.stdout:3950: expect (ObjNum 1200 snap 392 seq_num 1200) 2024-01-13T18:14:02.761 INFO:tasks.rados.rados.0.smithi084.stdout:3951: read oid 48 snap -1 2024-01-13T18:14:02.761 INFO:tasks.rados.rados.0.smithi084.stdout:3951: expect (ObjNum 1188 snap 385 seq_num 1188) 2024-01-13T18:14:02.761 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 394 2024-01-13T18:14:02.761 INFO:tasks.rados.rados.0.smithi084.stdout:3952: seq_num 1204 ranges {2375680=573440,2949120=401408} 2024-01-13T18:14:02.777 INFO:tasks.rados.rados.0.smithi084.stdout:3952: writing smithi084102331-11 from 2375680 to 2949120 tid 1 2024-01-13T18:14:02.780 INFO:tasks.rados.rados.0.smithi084.stdout:3952: writing smithi084102331-11 from 2949120 to 3350528 tid 2 2024-01-13T18:14:02.780 INFO:tasks.rados.rados.0.smithi084.stdout:3953: snap_create 2024-01-13T18:14:02.780 INFO:tasks.rados.rados.0.smithi084.stdout:3951: expect (ObjNum 1188 snap 385 seq_num 1188) 2024-01-13T18:14:02.798 INFO:tasks.rados.rados.0.smithi084.stdout:3950: expect (ObjNum 1200 snap 392 seq_num 1200) 2024-01-13T18:14:02.883 INFO:tasks.rados.rados.0.smithi084.stdout:3952: finishing write tid 1 to smithi084102331-11 2024-01-13T18:14:02.883 INFO:tasks.rados.rados.0.smithi084.stdout:3952: finishing write tid 2 to smithi084102331-11 2024-01-13T18:14:02.883 INFO:tasks.rados.rados.0.smithi084.stdout:3952: finishing write tid 3 to smithi084102331-11 2024-01-13T18:14:02.883 INFO:tasks.rados.rados.0.smithi084.stdout:3952: finishing write tid 4 to smithi084102331-11 2024-01-13T18:14:02.883 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1804 (ObjNum 1204 snap 394 seq_num 1204) dirty exists 2024-01-13T18:14:02.883 INFO:tasks.rados.rados.0.smithi084.stdout:3952: left oid 11 (ObjNum 1204 snap 394 seq_num 1204) 2024-01-13T18:14:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:02 smithi099 ceph-mon[138788]: osdmap e855: 8 total, 8 up, 8 in 2024-01-13T18:14:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:02 smithi099 ceph-mon[138788]: pgmap v997: 121 pgs: 121 active+clean; 441 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 2.8 MiB/s wr, 30 op/s 2024-01-13T18:14:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:02 smithi099 ceph-mon[138788]: osdmap e856: 8 total, 8 up, 8 in 2024-01-13T18:14:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:02 smithi084 ceph-mon[116404]: osdmap e855: 8 total, 8 up, 8 in 2024-01-13T18:14:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:02 smithi084 ceph-mon[116404]: pgmap v997: 121 pgs: 121 active+clean; 441 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 2.8 MiB/s wr, 30 op/s 2024-01-13T18:14:03.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:02 smithi084 ceph-mon[116404]: osdmap e856: 8 total, 8 up, 8 in 2024-01-13T18:14:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:02 smithi084 ceph-mon[119097]: osdmap e855: 8 total, 8 up, 8 in 2024-01-13T18:14:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:02 smithi084 ceph-mon[119097]: pgmap v997: 121 pgs: 121 active+clean; 441 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 2.8 MiB/s wr, 30 op/s 2024-01-13T18:14:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:02 smithi084 ceph-mon[119097]: osdmap e856: 8 total, 8 up, 8 in 2024-01-13T18:14:03.771 INFO:tasks.rados.rados.0.smithi084.stdout:3950: done (3 left) 2024-01-13T18:14:03.772 INFO:tasks.rados.rados.0.smithi084.stdout:3951: done (2 left) 2024-01-13T18:14:03.772 INFO:tasks.rados.rados.0.smithi084.stdout:3952: done (1 left) 2024-01-13T18:14:03.772 INFO:tasks.rados.rados.0.smithi084.stdout:3953: done (0 left) 2024-01-13T18:14:03.772 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 395 2024-01-13T18:14:03.772 INFO:tasks.rados.rados.0.smithi084.stdout:3954: seq_num 1205 ranges {4128768=589824,4718592=401408} 2024-01-13T18:14:03.796 INFO:tasks.rados.rados.0.smithi084.stdout:3954: writing smithi084102331-35 from 4128768 to 4718592 tid 1 2024-01-13T18:14:03.799 INFO:tasks.rados.rados.0.smithi084.stdout:3954: writing smithi084102331-35 from 4718592 to 5120000 tid 2 2024-01-13T18:14:03.799 INFO:tasks.rados.rados.0.smithi084.stdout:3955: read oid 20 snap 391 2024-01-13T18:14:03.799 INFO:tasks.rados.rados.0.smithi084.stdout:3955: expect (ObjNum 1194 snap 389 seq_num 1194) 2024-01-13T18:14:03.799 INFO:tasks.rados.rados.0.smithi084.stdout:3956: snap_create 2024-01-13T18:14:03.805 INFO:tasks.rados.rados.0.smithi084.stdout:3954: finishing write tid 1 to smithi084102331-35 2024-01-13T18:14:03.805 INFO:tasks.rados.rados.0.smithi084.stdout:3954: finishing write tid 2 to smithi084102331-35 2024-01-13T18:14:03.806 INFO:tasks.rados.rados.0.smithi084.stdout:3954: finishing write tid 3 to smithi084102331-35 2024-01-13T18:14:03.807 INFO:tasks.rados.rados.0.smithi084.stdout:3954: finishing write tid 4 to smithi084102331-35 2024-01-13T18:14:03.807 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 1772 (ObjNum 1205 snap 395 seq_num 1205) dirty exists 2024-01-13T18:14:03.807 INFO:tasks.rados.rados.0.smithi084.stdout:3954: left oid 35 (ObjNum 1205 snap 395 seq_num 1205) 2024-01-13T18:14:03.819 INFO:tasks.rados.rados.0.smithi084.stdout:3955: expect (ObjNum 1194 snap 389 seq_num 1194) 2024-01-13T18:14:04.774 INFO:tasks.rados.rados.0.smithi084.stdout:3954: done (2 left) 2024-01-13T18:14:04.774 INFO:tasks.rados.rados.0.smithi084.stdout:3955: done (1 left) 2024-01-13T18:14:04.774 INFO:tasks.rados.rados.0.smithi084.stdout:3956: done (0 left) 2024-01-13T18:14:04.774 INFO:tasks.rados.rados.0.smithi084.stdout:3957: read oid 2 snap -1 2024-01-13T18:14:04.775 INFO:tasks.rados.rados.0.smithi084.stdout:3957: expect (ObjNum 1174 snap 381 seq_num 1174) 2024-01-13T18:14:04.775 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 396 2024-01-13T18:14:04.775 INFO:tasks.rados.rados.0.smithi084.stdout:3958: seq_num 1206 ranges {688128=606208,1294336=401408} 2024-01-13T18:14:04.781 INFO:tasks.rados.rados.0.smithi084.stdout:3958: writing smithi084102331-8 from 688128 to 1294336 tid 1 2024-01-13T18:14:04.783 INFO:tasks.rados.rados.0.smithi084.stdout:3958: writing smithi084102331-8 from 1294336 to 1695744 tid 2 2024-01-13T18:14:04.783 INFO:tasks.rados.rados.0.smithi084.stdout:3959: read oid 32 snap 393 2024-01-13T18:14:04.784 INFO:tasks.rados.rados.0.smithi084.stdout:3959: expect deleted 2024-01-13T18:14:04.784 INFO:tasks.rados.rados.0.smithi084.stdout:3960: read oid 49 snap -1 2024-01-13T18:14:04.784 INFO:tasks.rados.rados.0.smithi084.stdout:3960: expect (ObjNum 1200 snap 392 seq_num 1200) 2024-01-13T18:14:04.784 INFO:tasks.rados.rados.0.smithi084.stdout:3961: read oid 46 snap -1 2024-01-13T18:14:04.784 INFO:tasks.rados.rados.0.smithi084.stdout:3961: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:14:04.784 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 396 2024-01-13T18:14:04.784 INFO:tasks.rados.rados.0.smithi084.stdout:3962: seq_num 1207 ranges {8183808=622592,8806400=401408} 2024-01-13T18:14:04.831 INFO:tasks.rados.rados.0.smithi084.stdout:3962: writing smithi084102331-10 from 8183808 to 8806400 tid 1 2024-01-13T18:14:04.833 INFO:tasks.rados.rados.0.smithi084.stdout:3962: writing smithi084102331-10 from 8806400 to 9207808 tid 2 2024-01-13T18:14:04.833 INFO:tasks.rados.rados.0.smithi084.stdout:3963: read oid 45 snap -1 2024-01-13T18:14:04.834 INFO:tasks.rados.rados.0.smithi084.stdout:3963: expect (ObjNum 1202 snap 392 seq_num 1202) 2024-01-13T18:14:04.834 INFO:tasks.rados.rados.0.smithi084.stdout:3964: snap_remove snap 394 2024-01-13T18:14:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:04 smithi099 ceph-mon[138788]: osdmap e857: 8 total, 8 up, 8 in 2024-01-13T18:14:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:04 smithi099 ceph-mon[138788]: pgmap v1000: 121 pgs: 121 active+clean; 440 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.8 MiB/s wr, 29 op/s 2024-01-13T18:14:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:04 smithi084 ceph-mon[116404]: osdmap e857: 8 total, 8 up, 8 in 2024-01-13T18:14:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:04 smithi084 ceph-mon[116404]: pgmap v1000: 121 pgs: 121 active+clean; 440 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.8 MiB/s wr, 29 op/s 2024-01-13T18:14:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:04 smithi084 ceph-mon[119097]: osdmap e857: 8 total, 8 up, 8 in 2024-01-13T18:14:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:04 smithi084 ceph-mon[119097]: pgmap v1000: 121 pgs: 121 active+clean; 440 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.8 MiB/s wr, 29 op/s 2024-01-13T18:14:05.780 INFO:tasks.rados.rados.0.smithi084.stdout:3964: done (7 left) 2024-01-13T18:14:05.780 INFO:tasks.rados.rados.0.smithi084.stdout:3965: copy_from oid 30 from oid 5 current snap is 396 2024-01-13T18:14:05.780 INFO:tasks.rados.rados.0.smithi084.stdout:3958: finishing write tid 1 to smithi084102331-8 2024-01-13T18:14:05.780 INFO:tasks.rados.rados.0.smithi084.stdout:3960: expect (ObjNum 1200 snap 392 seq_num 1200) 2024-01-13T18:14:05.869 INFO:tasks.rados.rados.0.smithi084.stdout:3958: finishing write tid 2 to smithi084102331-8 2024-01-13T18:14:05.869 INFO:tasks.rados.rados.0.smithi084.stdout:3958: finishing write tid 3 to smithi084102331-8 2024-01-13T18:14:05.870 INFO:tasks.rados.rados.0.smithi084.stdout:3958: finishing write tid 4 to smithi084102331-8 2024-01-13T18:14:05.870 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 2039 (ObjNum 1206 snap 396 seq_num 1206) dirty exists 2024-01-13T18:14:05.870 INFO:tasks.rados.rados.0.smithi084.stdout:3958: left oid 8 (ObjNum 1206 snap 396 seq_num 1206) 2024-01-13T18:14:05.870 INFO:tasks.rados.rados.0.smithi084.stdout:3957: expect (ObjNum 1174 snap 381 seq_num 1174) 2024-01-13T18:14:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:05 smithi099 ceph-mon[138788]: osdmap e858: 8 total, 8 up, 8 in 2024-01-13T18:14:06.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:06.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:05 smithi084 ceph-mon[116404]: osdmap e858: 8 total, 8 up, 8 in 2024-01-13T18:14:06.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:06.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:05 smithi084 ceph-mon[119097]: osdmap e858: 8 total, 8 up, 8 in 2024-01-13T18:14:06.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:06.195 INFO:tasks.rados.rados.0.smithi084.stdout:3961: expect (ObjNum 949 snap 300 seq_num 949) 2024-01-13T18:14:06.367 INFO:tasks.rados.rados.0.smithi084.stdout:3962: finishing write tid 1 to smithi084102331-10 2024-01-13T18:14:06.367 INFO:tasks.rados.rados.0.smithi084.stdout:3962: finishing write tid 2 to smithi084102331-10 2024-01-13T18:14:06.367 INFO:tasks.rados.rados.0.smithi084.stdout:3962: finishing write tid 3 to smithi084102331-10 2024-01-13T18:14:06.367 INFO:tasks.rados.rados.0.smithi084.stdout:3962: finishing write tid 4 to smithi084102331-10 2024-01-13T18:14:06.367 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 1804 (ObjNum 1207 snap 396 seq_num 1207) dirty exists 2024-01-13T18:14:06.367 INFO:tasks.rados.rados.0.smithi084.stdout:3962: left oid 10 (ObjNum 1207 snap 396 seq_num 1207) 2024-01-13T18:14:06.367 INFO:tasks.rados.rados.0.smithi084.stdout:3963: expect (ObjNum 1202 snap 392 seq_num 1202) 2024-01-13T18:14:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:06 smithi099 ceph-mon[138788]: osdmap e859: 8 total, 8 up, 8 in 2024-01-13T18:14:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:06 smithi099 ceph-mon[138788]: pgmap v1003: 121 pgs: 121 active+clean; 437 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.9 MiB/s rd, 654 KiB/s wr, 6 op/s 2024-01-13T18:14:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:06 smithi084 ceph-mon[116404]: osdmap e859: 8 total, 8 up, 8 in 2024-01-13T18:14:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:06 smithi084 ceph-mon[116404]: pgmap v1003: 121 pgs: 121 active+clean; 437 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.9 MiB/s rd, 654 KiB/s wr, 6 op/s 2024-01-13T18:14:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:06 smithi084 ceph-mon[119097]: osdmap e859: 8 total, 8 up, 8 in 2024-01-13T18:14:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:06 smithi084 ceph-mon[119097]: pgmap v1003: 121 pgs: 121 active+clean; 437 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.9 MiB/s rd, 654 KiB/s wr, 6 op/s 2024-01-13T18:14:07.503 INFO:tasks.rados.rados.0.smithi084.stdout:3965: finishing copy_from to smithi084102331-30 2024-01-13T18:14:07.503 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1890 (ObjNum 1110 snap 357 seq_num 1110) dirty exists 2024-01-13T18:14:07.503 INFO:tasks.rados.rados.0.smithi084.stdout:3965: finishing copy_from racing read to smithi084102331-30 2024-01-13T18:14:07.503 INFO:tasks.rados.rados.0.smithi084.stdout:3957: done (7 left) 2024-01-13T18:14:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:3958: done (6 left) 2024-01-13T18:14:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:3959: done (5 left) 2024-01-13T18:14:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:3960: done (4 left) 2024-01-13T18:14:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:3961: done (3 left) 2024-01-13T18:14:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:3962: done (2 left) 2024-01-13T18:14:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:3963: done (1 left) 2024-01-13T18:14:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:3965: done (0 left) 2024-01-13T18:14:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:3966: rollback oid 8 current snap is 396 2024-01-13T18:14:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 388 2024-01-13T18:14:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 396 2024-01-13T18:14:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:3967: seq_num 1208 ranges {5668864=638976,6307840=401408} 2024-01-13T18:14:07.535 INFO:tasks.rados.rados.0.smithi084.stdout:3967: writing smithi084102331-17 from 5668864 to 6307840 tid 1 2024-01-13T18:14:07.538 INFO:tasks.rados.rados.0.smithi084.stdout:3967: writing smithi084102331-17 from 6307840 to 6709248 tid 2 2024-01-13T18:14:07.538 INFO:tasks.rados.rados.0.smithi084.stdout:3968: snap_create 2024-01-13T18:14:07.538 INFO:tasks.rados.rados.0.smithi084.stdout:3966: finishing rollback tid 0 to smithi084102331-8 2024-01-13T18:14:07.538 INFO:tasks.rados.rados.0.smithi084.stdout:3966: finishing rollback tid 1 to smithi084102331-8 2024-01-13T18:14:07.538 INFO:tasks.rados.rados.0.smithi084.stdout:3966: finishing rollback tid 2 to smithi084102331-8 2024-01-13T18:14:07.538 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 2044 (ObjNum 1167 snap 379 seq_num 1167) dirty exists 2024-01-13T18:14:07.541 INFO:tasks.rados.rados.0.smithi084.stdout:3967: finishing write tid 1 to smithi084102331-17 2024-01-13T18:14:07.542 INFO:tasks.rados.rados.0.smithi084.stdout:3967: finishing write tid 2 to smithi084102331-17 2024-01-13T18:14:07.542 INFO:tasks.rados.rados.0.smithi084.stdout:3967: finishing write tid 3 to smithi084102331-17 2024-01-13T18:14:07.543 INFO:tasks.rados.rados.0.smithi084.stdout:3967: finishing write tid 4 to smithi084102331-17 2024-01-13T18:14:07.543 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 1893 (ObjNum 1208 snap 396 seq_num 1208) dirty exists 2024-01-13T18:14:07.543 INFO:tasks.rados.rados.0.smithi084.stdout:3967: left oid 17 (ObjNum 1208 snap 396 seq_num 1208) 2024-01-13T18:14:07.760 INFO:tasks.rados.rados.0.smithi084.stdout:3966: done (2 left) 2024-01-13T18:14:07.760 INFO:tasks.rados.rados.0.smithi084.stdout:3967: done (1 left) 2024-01-13T18:14:07.760 INFO:tasks.rados.rados.0.smithi084.stdout:3968: done (0 left) 2024-01-13T18:14:07.760 INFO:tasks.rados.rados.0.smithi084.stdout:3969: snap_remove snap 396 2024-01-13T18:14:08.777 INFO:tasks.rados.rados.0.smithi084.stdout:3969: done (0 left) 2024-01-13T18:14:08.777 INFO:tasks.rados.rados.0.smithi084.stdout:3970: read oid 22 snap 389 2024-01-13T18:14:08.777 INFO:tasks.rados.rados.0.smithi084.stdout:3970: expect (ObjNum 1080 snap 342 seq_num 1080) 2024-01-13T18:14:08.777 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 397 2024-01-13T18:14:08.778 INFO:tasks.rados.rados.0.smithi084.stdout:3971: seq_num 1209 ranges {3416064=655360,4071424=401408} 2024-01-13T18:14:08.800 INFO:tasks.rados.rados.0.smithi084.stdout:3971: writing smithi084102331-50 from 3416064 to 4071424 tid 1 2024-01-13T18:14:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3971: writing smithi084102331-50 from 4071424 to 4472832 tid 2 2024-01-13T18:14:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 397 2024-01-13T18:14:08.802 INFO:tasks.rados.rados.0.smithi084.stdout:3972: seq_num 1210 ranges {2408448=671744,3080192=401408} 2024-01-13T18:14:08.820 INFO:tasks.rados.rados.0.smithi084.stdout:3972: writing smithi084102331-1 from 2408448 to 3080192 tid 1 2024-01-13T18:14:08.823 INFO:tasks.rados.rados.0.smithi084.stdout:3972: writing smithi084102331-1 from 3080192 to 3481600 tid 2 2024-01-13T18:14:08.823 INFO:tasks.rados.rados.0.smithi084.stdout:3973: copy_from oid 12 from oid 23 current snap is 397 2024-01-13T18:14:08.823 INFO:tasks.rados.rados.0.smithi084.stdout:3971: finishing write tid 1 to smithi084102331-50 2024-01-13T18:14:08.823 INFO:tasks.rados.rados.0.smithi084.stdout:3971: finishing write tid 2 to smithi084102331-50 2024-01-13T18:14:08.823 INFO:tasks.rados.rados.0.smithi084.stdout:3971: finishing write tid 3 to smithi084102331-50 2024-01-13T18:14:08.823 INFO:tasks.rados.rados.0.smithi084.stdout:3971: finishing write tid 4 to smithi084102331-50 2024-01-13T18:14:08.823 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 1893 (ObjNum 1209 snap 397 seq_num 1209) dirty exists 2024-01-13T18:14:08.823 INFO:tasks.rados.rados.0.smithi084.stdout:3971: left oid 50 (ObjNum 1209 snap 397 seq_num 1209) 2024-01-13T18:14:08.823 INFO:tasks.rados.rados.0.smithi084.stdout:3970: expect (ObjNum 1080 snap 342 seq_num 1080) 2024-01-13T18:14:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:08 smithi099 ceph-mon[138788]: osdmap e860: 8 total, 8 up, 8 in 2024-01-13T18:14:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:08 smithi099 ceph-mon[138788]: pgmap v1005: 121 pgs: 121 active+clean; 438 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 873 KiB/s wr, 10 op/s 2024-01-13T18:14:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:08 smithi084 ceph-mon[116404]: osdmap e860: 8 total, 8 up, 8 in 2024-01-13T18:14:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:08 smithi084 ceph-mon[116404]: pgmap v1005: 121 pgs: 121 active+clean; 438 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 873 KiB/s wr, 10 op/s 2024-01-13T18:14:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:08 smithi084 ceph-mon[119097]: osdmap e860: 8 total, 8 up, 8 in 2024-01-13T18:14:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:08 smithi084 ceph-mon[119097]: pgmap v1005: 121 pgs: 121 active+clean; 438 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 873 KiB/s wr, 10 op/s 2024-01-13T18:14:09.230 INFO:tasks.rados.rados.0.smithi084.stdout:3972: finishing write tid 1 to smithi084102331-1 2024-01-13T18:14:09.230 INFO:tasks.rados.rados.0.smithi084.stdout:3972: finishing write tid 2 to smithi084102331-1 2024-01-13T18:14:09.230 INFO:tasks.rados.rados.0.smithi084.stdout:3972: finishing write tid 3 to smithi084102331-1 2024-01-13T18:14:09.230 INFO:tasks.rados.rados.0.smithi084.stdout:3972: finishing write tid 4 to smithi084102331-1 2024-01-13T18:14:09.230 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 2043 (ObjNum 1210 snap 397 seq_num 1210) dirty exists 2024-01-13T18:14:09.230 INFO:tasks.rados.rados.0.smithi084.stdout:3972: left oid 1 (ObjNum 1210 snap 397 seq_num 1210) 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:3973: finishing copy_from to smithi084102331-12 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 2051 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:3973: finishing copy_from racing read to smithi084102331-12 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:3970: done (3 left) 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:3971: done (2 left) 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:3972: done (1 left) 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:3973: done (0 left) 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:3974: read oid 22 snap -1 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:3974: expect (ObjNum 1080 snap 342 seq_num 1080) 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:3975: read oid 23 snap 349 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:3975: expect (ObjNum 1064 snap 338 seq_num 1064) 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 397 2024-01-13T18:14:09.231 INFO:tasks.rados.rados.0.smithi084.stdout:3976: seq_num 1211 ranges {3350528=688128,4038656=401408} 2024-01-13T18:14:09.251 INFO:tasks.rados.rados.0.smithi084.stdout:3976: writing smithi084102331-11 from 3350528 to 4038656 tid 1 2024-01-13T18:14:09.254 INFO:tasks.rados.rados.0.smithi084.stdout:3976: writing smithi084102331-11 from 4038656 to 4440064 tid 2 2024-01-13T18:14:09.254 INFO:tasks.rados.rados.0.smithi084.stdout:3977: snap_create 2024-01-13T18:14:09.259 INFO:tasks.rados.rados.0.smithi084.stdout:3976: finishing write tid 1 to smithi084102331-11 2024-01-13T18:14:09.259 INFO:tasks.rados.rados.0.smithi084.stdout:3976: finishing write tid 2 to smithi084102331-11 2024-01-13T18:14:09.260 INFO:tasks.rados.rados.0.smithi084.stdout:3976: finishing write tid 3 to smithi084102331-11 2024-01-13T18:14:09.261 INFO:tasks.rados.rados.0.smithi084.stdout:3976: finishing write tid 4 to smithi084102331-11 2024-01-13T18:14:09.261 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 1807 (ObjNum 1211 snap 397 seq_num 1211) dirty exists 2024-01-13T18:14:09.261 INFO:tasks.rados.rados.0.smithi084.stdout:3976: left oid 11 (ObjNum 1211 snap 397 seq_num 1211) 2024-01-13T18:14:09.261 INFO:tasks.rados.rados.0.smithi084.stdout:3974: expect (ObjNum 1080 snap 342 seq_num 1080) 2024-01-13T18:14:09.666 INFO:tasks.rados.rados.0.smithi084.stdout:3975: expect (ObjNum 1064 snap 338 seq_num 1064) 2024-01-13T18:14:09.780 INFO:tasks.rados.rados.0.smithi084.stdout:3974: done (3 left) 2024-01-13T18:14:09.780 INFO:tasks.rados.rados.0.smithi084.stdout:3975: done (2 left) 2024-01-13T18:14:09.780 INFO:tasks.rados.rados.0.smithi084.stdout:3976: done (1 left) 2024-01-13T18:14:09.780 INFO:tasks.rados.rados.0.smithi084.stdout:3977: done (0 left) 2024-01-13T18:14:09.780 INFO:tasks.rados.rados.0.smithi084.stdout:3978: setattr oid 33 current snap is 398 2024-01-13T18:14:09.782 INFO:tasks.rados.rados.0.smithi084.stdout:3979: read oid 41 snap 397 2024-01-13T18:14:09.782 INFO:tasks.rados.rados.0.smithi084.stdout:3979: expect (ObjNum 1096 snap 350 seq_num 1096) 2024-01-13T18:14:09.782 INFO:tasks.rados.rados.0.smithi084.stdout:3980: read oid 18 snap -1 2024-01-13T18:14:09.782 INFO:tasks.rados.rados.0.smithi084.stdout:3980: expect (ObjNum 1063 snap 338 seq_num 1063) 2024-01-13T18:14:09.782 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 398 2024-01-13T18:14:09.782 INFO:tasks.rados.rados.0.smithi084.stdout:3981: seq_num 1212 ranges {3416064=704512,4120576=401408} 2024-01-13T18:14:09.805 INFO:tasks.rados.rados.0.smithi084.stdout:3981: writing smithi084102331-31 from 3416064 to 4120576 tid 1 2024-01-13T18:14:09.807 INFO:tasks.rados.rados.0.smithi084.stdout:3981: writing smithi084102331-31 from 4120576 to 4521984 tid 2 2024-01-13T18:14:09.807 INFO:tasks.rados.rados.0.smithi084.stdout:3982: rollback oid 23 current snap is 398 2024-01-13T18:14:09.808 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 373 2024-01-13T18:14:09.808 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 1894 (ObjNum -742953952 snap 32747 seq_num 304) dirty exists 2024-01-13T18:14:09.808 INFO:tasks.rados.rados.0.smithi084.stdout:3978: done (4 left) 2024-01-13T18:14:09.808 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 398 2024-01-13T18:14:09.808 INFO:tasks.rados.rados.0.smithi084.stdout:3983: seq_num 1213 ranges {4472832=720896,5193728=401408} 2024-01-13T18:14:09.837 INFO:tasks.rados.rados.0.smithi084.stdout:3983: writing smithi084102331-50 from 4472832 to 5193728 tid 1 2024-01-13T18:14:09.839 INFO:tasks.rados.rados.0.smithi084.stdout:3983: writing smithi084102331-50 from 5193728 to 5595136 tid 2 2024-01-13T18:14:09.839 INFO:tasks.rados.rados.0.smithi084.stdout:3984: snap_remove snap 383 2024-01-13T18:14:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:09 smithi099 ceph-mon[138788]: osdmap e861: 8 total, 8 up, 8 in 2024-01-13T18:14:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:09 smithi084 ceph-mon[116404]: osdmap e861: 8 total, 8 up, 8 in 2024-01-13T18:14:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:09 smithi084 ceph-mon[119097]: osdmap e861: 8 total, 8 up, 8 in 2024-01-13T18:14:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:14:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:14:10] "GET /metrics HTTP/1.1" 200 36191 "" "Prometheus/2.43.0" 2024-01-13T18:14:10.787 INFO:tasks.rados.rados.0.smithi084.stdout:3984: done (5 left) 2024-01-13T18:14:10.788 INFO:tasks.rados.rados.0.smithi084.stdout:3985: read oid 28 snap -1 2024-01-13T18:14:10.788 INFO:tasks.rados.rados.0.smithi084.stdout:3985: expect (ObjNum 1185 snap 383 seq_num 1185) 2024-01-13T18:14:10.788 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 398 2024-01-13T18:14:10.788 INFO:tasks.rados.rados.0.smithi084.stdout:3986: seq_num 1214 ranges {4546560=737280,5283840=401408} 2024-01-13T18:14:10.822 INFO:tasks.rados.rados.0.smithi084.stdout:3986: writing smithi084102331-9 from 4546560 to 5283840 tid 1 2024-01-13T18:14:10.822 INFO:tasks.rados.rados.0.smithi084.stdout:3986: writing smithi084102331-9 from 5283840 to 5685248 tid 2 2024-01-13T18:14:10.822 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 398 2024-01-13T18:14:10.822 INFO:tasks.rados.rados.0.smithi084.stdout:3987: seq_num 1215 ranges {3416064=753664,4169728=401408} 2024-01-13T18:14:10.844 INFO:tasks.rados.rados.0.smithi084.stdout:3987: writing smithi084102331-47 from 3416064 to 4169728 tid 1 2024-01-13T18:14:10.847 INFO:tasks.rados.rados.0.smithi084.stdout:3987: writing smithi084102331-47 from 4169728 to 4571136 tid 2 2024-01-13T18:14:10.847 INFO:tasks.rados.rados.0.smithi084.stdout:3988: delete oid 36 current snap is 398 2024-01-13T18:14:10.847 INFO:tasks.rados.rados.0.smithi084.stdout:3981: finishing write tid 1 to smithi084102331-31 2024-01-13T18:14:10.847 INFO:tasks.rados.rados.0.smithi084.stdout:3981: finishing write tid 2 to smithi084102331-31 2024-01-13T18:14:10.847 INFO:tasks.rados.rados.0.smithi084.stdout:3981: finishing write tid 3 to smithi084102331-31 2024-01-13T18:14:10.847 INFO:tasks.rados.rados.0.smithi084.stdout:3982: finishing rollback tid 0 to smithi084102331-23 2024-01-13T18:14:10.847 INFO:tasks.rados.rados.0.smithi084.stdout:3982: finishing rollback tid 1 to smithi084102331-23 2024-01-13T18:14:10.847 INFO:tasks.rados.rados.0.smithi084.stdout:3982: finishing rollback tid 2 to smithi084102331-23 2024-01-13T18:14:10.847 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 2075 (ObjNum 1073 snap 340 seq_num 1073) dirty exists 2024-01-13T18:14:10.848 INFO:tasks.rados.rados.0.smithi084.stdout:3981: finishing write tid 4 to smithi084102331-31 2024-01-13T18:14:10.848 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 2047 (ObjNum 1212 snap 398 seq_num 1212) dirty exists 2024-01-13T18:14:10.848 INFO:tasks.rados.rados.0.smithi084.stdout:3981: left oid 31 (ObjNum 1212 snap 398 seq_num 1212) 2024-01-13T18:14:10.848 INFO:tasks.rados.rados.0.smithi084.stdout:3979: expect (ObjNum 1096 snap 350 seq_num 1096) 2024-01-13T18:14:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:10 smithi099 ceph-mon[138788]: osdmap e862: 8 total, 8 up, 8 in 2024-01-13T18:14:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:10 smithi099 ceph-mon[138788]: pgmap v1008: 121 pgs: 121 active+clean; 447 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-01-13T18:14:11.157 INFO:tasks.rados.rados.0.smithi084.stdout:3980: expect (ObjNum 1063 snap 338 seq_num 1063) 2024-01-13T18:14:11.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:10 smithi084 ceph-mon[119097]: osdmap e862: 8 total, 8 up, 8 in 2024-01-13T18:14:11.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:10 smithi084 ceph-mon[119097]: pgmap v1008: 121 pgs: 121 active+clean; 447 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-01-13T18:14:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:10 smithi084 ceph-mon[116404]: osdmap e862: 8 total, 8 up, 8 in 2024-01-13T18:14:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:10 smithi084 ceph-mon[116404]: pgmap v1008: 121 pgs: 121 active+clean; 447 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-01-13T18:14:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:11 smithi099 ceph-mon[138788]: osdmap e863: 8 total, 8 up, 8 in 2024-01-13T18:14:12.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:11 smithi084 ceph-mon[116404]: osdmap e863: 8 total, 8 up, 8 in 2024-01-13T18:14:12.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:11 smithi084 ceph-mon[119097]: osdmap e863: 8 total, 8 up, 8 in 2024-01-13T18:14:12.479 INFO:tasks.rados.rados.0.smithi084.stdout:3983: finishing write tid 1 to smithi084102331-50 2024-01-13T18:14:12.479 INFO:tasks.rados.rados.0.smithi084.stdout:3983: finishing write tid 2 to smithi084102331-50 2024-01-13T18:14:12.479 INFO:tasks.rados.rados.0.smithi084.stdout:3983: finishing write tid 3 to smithi084102331-50 2024-01-13T18:14:12.479 INFO:tasks.rados.rados.0.smithi084.stdout:3983: finishing write tid 4 to smithi084102331-50 2024-01-13T18:14:12.479 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 1897 (ObjNum 1213 snap 398 seq_num 1213) dirty exists 2024-01-13T18:14:12.479 INFO:tasks.rados.rados.0.smithi084.stdout:3983: left oid 50 (ObjNum 1213 snap 398 seq_num 1213) 2024-01-13T18:14:12.480 INFO:tasks.rados.rados.0.smithi084.stdout:3979: done (8 left) 2024-01-13T18:14:12.480 INFO:tasks.rados.rados.0.smithi084.stdout:3980: done (7 left) 2024-01-13T18:14:12.480 INFO:tasks.rados.rados.0.smithi084.stdout:3981: done (6 left) 2024-01-13T18:14:12.480 INFO:tasks.rados.rados.0.smithi084.stdout:3982: done (5 left) 2024-01-13T18:14:12.480 INFO:tasks.rados.rados.0.smithi084.stdout:3983: done (4 left) 2024-01-13T18:14:12.480 INFO:tasks.rados.rados.0.smithi084.stdout:3988: done (3 left) 2024-01-13T18:14:12.481 INFO:tasks.rados.rados.0.smithi084.stdout:3989: snap_create 2024-01-13T18:14:12.481 INFO:tasks.rados.rados.0.smithi084.stdout:3985: expect (ObjNum 1185 snap 383 seq_num 1185) 2024-01-13T18:14:12.648 INFO:tasks.rados.rados.0.smithi084.stdout:3986: finishing write tid 1 to smithi084102331-9 2024-01-13T18:14:12.649 INFO:tasks.rados.rados.0.smithi084.stdout:3986: finishing write tid 2 to smithi084102331-9 2024-01-13T18:14:12.649 INFO:tasks.rados.rados.0.smithi084.stdout:3986: finishing write tid 3 to smithi084102331-9 2024-01-13T18:14:12.649 INFO:tasks.rados.rados.0.smithi084.stdout:3986: finishing write tid 4 to smithi084102331-9 2024-01-13T18:14:12.649 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 1797 (ObjNum 1214 snap 398 seq_num 1214) dirty exists 2024-01-13T18:14:12.649 INFO:tasks.rados.rados.0.smithi084.stdout:3986: left oid 9 (ObjNum 1214 snap 398 seq_num 1214) 2024-01-13T18:14:12.650 INFO:tasks.rados.rados.0.smithi084.stdout:3987: finishing write tid 1 to smithi084102331-47 2024-01-13T18:14:12.650 INFO:tasks.rados.rados.0.smithi084.stdout:3987: finishing write tid 2 to smithi084102331-47 2024-01-13T18:14:12.650 INFO:tasks.rados.rados.0.smithi084.stdout:3987: finishing write tid 3 to smithi084102331-47 2024-01-13T18:14:12.650 INFO:tasks.rados.rados.0.smithi084.stdout:3987: finishing write tid 4 to smithi084102331-47 2024-01-13T18:14:12.650 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 2054 (ObjNum 1215 snap 398 seq_num 1215) dirty exists 2024-01-13T18:14:12.650 INFO:tasks.rados.rados.0.smithi084.stdout:3987: left oid 47 (ObjNum 1215 snap 398 seq_num 1215) 2024-01-13T18:14:12.761 INFO:tasks.rados.rados.0.smithi084.stdout:3985: done (3 left) 2024-01-13T18:14:12.761 INFO:tasks.rados.rados.0.smithi084.stdout:3986: done (2 left) 2024-01-13T18:14:12.761 INFO:tasks.rados.rados.0.smithi084.stdout:3987: done (1 left) 2024-01-13T18:14:12.762 INFO:tasks.rados.rados.0.smithi084.stdout:3989: done (0 left) 2024-01-13T18:14:12.762 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 399 2024-01-13T18:14:12.762 INFO:tasks.rados.rados.0.smithi084.stdout:3990: seq_num 1217 ranges {0=786432,786432=401408} 2024-01-13T18:14:12.765 INFO:tasks.rados.rados.0.smithi084.stdout:3990: writing smithi084102331-42 from 0 to 786432 tid 1 2024-01-13T18:14:12.768 INFO:tasks.rados.rados.0.smithi084.stdout:3990: writing smithi084102331-42 from 786432 to 1187840 tid 2 2024-01-13T18:14:12.768 INFO:tasks.rados.rados.0.smithi084.stdout:3991: rmattr oid 22 current snap is 399 2024-01-13T18:14:12.768 INFO:tasks.rados.rados.0.smithi084.stdout:3992: read oid 45 snap 390 2024-01-13T18:14:12.768 INFO:tasks.rados.rados.0.smithi084.stdout:3992: expect (ObjNum 1142 snap 368 seq_num 1142) 2024-01-13T18:14:12.769 INFO:tasks.rados.rados.0.smithi084.stdout:3993: delete oid 10 current snap is 399 2024-01-13T18:14:12.772 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 2083 (ObjNum 1080 snap 342 seq_num 1080) dirty exists 2024-01-13T18:14:12.774 INFO:tasks.rados.rados.0.smithi084.stdout:3991: done (3 left) 2024-01-13T18:14:12.774 INFO:tasks.rados.rados.0.smithi084.stdout:3993: done (2 left) 2024-01-13T18:14:12.774 INFO:tasks.rados.rados.0.smithi084.stdout:3994: read oid 17 snap -1 2024-01-13T18:14:12.774 INFO:tasks.rados.rados.0.smithi084.stdout:3994: expect (ObjNum 1208 snap 396 seq_num 1208) 2024-01-13T18:14:12.774 INFO:tasks.rados.rados.0.smithi084.stdout:3995: snap_remove snap 349 2024-01-13T18:14:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:12 smithi099 ceph-mon[138788]: pgmap v1010: 121 pgs: 121 active+clean; 459 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 5.2 MiB/s wr, 14 op/s 2024-01-13T18:14:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:12 smithi099 ceph-mon[138788]: osdmap e864: 8 total, 8 up, 8 in 2024-01-13T18:14:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:12 smithi084 ceph-mon[116404]: pgmap v1010: 121 pgs: 121 active+clean; 459 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 5.2 MiB/s wr, 14 op/s 2024-01-13T18:14:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:12 smithi084 ceph-mon[116404]: osdmap e864: 8 total, 8 up, 8 in 2024-01-13T18:14:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:12 smithi084 ceph-mon[119097]: pgmap v1010: 121 pgs: 121 active+clean; 459 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 5.2 MiB/s wr, 14 op/s 2024-01-13T18:14:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:12 smithi084 ceph-mon[119097]: osdmap e864: 8 total, 8 up, 8 in 2024-01-13T18:14:13.775 INFO:tasks.rados.rados.0.smithi084.stdout:3995: done (3 left) 2024-01-13T18:14:13.776 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 399 2024-01-13T18:14:13.776 INFO:tasks.rados.rados.0.smithi084.stdout:3996: seq_num 1219 ranges {7372800=417792,7790592=557056,8347648=245760} 2024-01-13T18:14:13.818 INFO:tasks.rados.rados.0.smithi084.stdout:3996: writing smithi084102331-30 from 7372800 to 7790592 tid 1 2024-01-13T18:14:13.822 INFO:tasks.rados.rados.0.smithi084.stdout:3996: writing smithi084102331-30 from 7790592 to 8347648 tid 2 2024-01-13T18:14:13.824 INFO:tasks.rados.rados.0.smithi084.stdout:3996: writing smithi084102331-30 from 8347648 to 8593408 tid 3 2024-01-13T18:14:13.824 INFO:tasks.rados.rados.0.smithi084.stdout:3997: read oid 39 snap -1 2024-01-13T18:14:13.824 INFO:tasks.rados.rados.0.smithi084.stdout:3997: expect (ObjNum 1162 snap 378 seq_num 1162) 2024-01-13T18:14:13.824 INFO:tasks.rados.rados.0.smithi084.stdout:3998: read oid 28 snap 373 2024-01-13T18:14:13.824 INFO:tasks.rados.rados.0.smithi084.stdout:3998: expect (ObjNum 908 snap 282 seq_num 908) 2024-01-13T18:14:13.825 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 399 2024-01-13T18:14:13.825 INFO:tasks.rados.rados.0.smithi084.stdout:3990: finishing write tid 1 to smithi084102331-42 2024-01-13T18:14:13.825 INFO:tasks.rados.rados.0.smithi084.stdout:3990: finishing write tid 2 to smithi084102331-42 2024-01-13T18:14:13.825 INFO:tasks.rados.rados.0.smithi084.stdout:3990: finishing write tid 3 to smithi084102331-42 2024-01-13T18:14:13.825 INFO:tasks.rados.rados.0.smithi084.stdout:3990: finishing write tid 4 to smithi084102331-42 2024-01-13T18:14:13.825 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 1514 (ObjNum 1217 snap 399 seq_num 1217) dirty exists 2024-01-13T18:14:13.825 INFO:tasks.rados.rados.0.smithi084.stdout:3990: left oid 42 (ObjNum 1217 snap 399 seq_num 1217) 2024-01-13T18:14:13.825 INFO:tasks.rados.rados.0.smithi084.stdout:3999: seq_num 1220 ranges {4030464=434176,4464640=442368,4907008=360448} 2024-01-13T18:14:13.849 INFO:tasks.rados.rados.0.smithi084.stdout:3999: writing smithi084102331-15 from 4030464 to 4464640 tid 1 2024-01-13T18:14:13.852 INFO:tasks.rados.rados.0.smithi084.stdout:3999: writing smithi084102331-15 from 4464640 to 4907008 tid 2 2024-01-13T18:14:13.854 INFO:tasks.rados.rados.0.smithi084.stdout:3999: writing smithi084102331-15 from 4907008 to 5267456 tid 3 2024-01-13T18:14:13.854 INFO:tasks.rados.rados.0.smithi084.stdout:3990: done (6 left) 2024-01-13T18:14:13.854 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 6 2024-01-13T18:14:13.854 INFO:tasks.rados.rados.0.smithi084.stdout:3994: expect (ObjNum 1208 snap 396 seq_num 1208) 2024-01-13T18:14:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:14:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:14:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:14:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:13 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:14:14.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:13 smithi099 ceph-mon[138788]: osdmap e865: 8 total, 8 up, 8 in 2024-01-13T18:14:14.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:14:14.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:14:14.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:14:14.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:13 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:14:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:13 smithi084 ceph-mon[119097]: osdmap e865: 8 total, 8 up, 8 in 2024-01-13T18:14:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:14:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:14:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:14:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:13 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:14:14.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:13 smithi084 ceph-mon[116404]: osdmap e865: 8 total, 8 up, 8 in 2024-01-13T18:14:14.264 INFO:tasks.rados.rados.0.smithi084.stdout:3992: expect (ObjNum 1142 snap 368 seq_num 1142) 2024-01-13T18:14:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:14 smithi099 ceph-mon[138788]: pgmap v1013: 121 pgs: 121 active+clean; 455 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-01-13T18:14:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:14 smithi084 ceph-mon[116404]: pgmap v1013: 121 pgs: 121 active+clean; 455 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-01-13T18:14:15.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:14 smithi084 ceph-mon[119097]: pgmap v1013: 121 pgs: 121 active+clean; 455 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-01-13T18:14:15.189 INFO:tasks.rados.rados.0.smithi084.stdout:3996: finishing write tid 1 to smithi084102331-30 2024-01-13T18:14:15.189 INFO:tasks.rados.rados.0.smithi084.stdout:3992: done (5 left) 2024-01-13T18:14:15.189 INFO:tasks.rados.rados.0.smithi084.stdout:3994: done (4 left) 2024-01-13T18:14:15.189 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 4 2024-01-13T18:14:15.189 INFO:tasks.rados.rados.0.smithi084.stdout:3996: finishing write tid 2 to smithi084102331-30 2024-01-13T18:14:15.189 INFO:tasks.rados.rados.0.smithi084.stdout:3996: finishing write tid 3 to smithi084102331-30 2024-01-13T18:14:15.189 INFO:tasks.rados.rados.0.smithi084.stdout:3996: finishing write tid 4 to smithi084102331-30 2024-01-13T18:14:15.189 INFO:tasks.rados.rados.0.smithi084.stdout:3997: expect (ObjNum 1162 snap 378 seq_num 1162) 2024-01-13T18:14:15.251 INFO:tasks.rados.rados.0.smithi084.stdout:3996: finishing write tid 5 to smithi084102331-30 2024-01-13T18:14:15.251 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1901 (ObjNum 1219 snap 399 seq_num 1219) dirty exists 2024-01-13T18:14:15.252 INFO:tasks.rados.rados.0.smithi084.stdout:3996: left oid 30 (ObjNum 1219 snap 399 seq_num 1219) 2024-01-13T18:14:15.252 INFO:tasks.rados.rados.0.smithi084.stdout:3996: done (3 left) 2024-01-13T18:14:15.252 INFO:tasks.rados.rados.0.smithi084.stdout:3997: done (2 left) 2024-01-13T18:14:15.252 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 2 2024-01-13T18:14:15.252 INFO:tasks.rados.rados.0.smithi084.stdout:3998: expect (ObjNum 908 snap 282 seq_num 908) 2024-01-13T18:14:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:3999: finishing write tid 1 to smithi084102331-15 2024-01-13T18:14:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:3999: finishing write tid 2 to smithi084102331-15 2024-01-13T18:14:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:3999: finishing write tid 3 to smithi084102331-15 2024-01-13T18:14:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:3999: finishing write tid 4 to smithi084102331-15 2024-01-13T18:14:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:3999: finishing write tid 5 to smithi084102331-15 2024-01-13T18:14:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 2067 (ObjNum 1220 snap 399 seq_num 1220) dirty exists 2024-01-13T18:14:15.362 INFO:tasks.rados.rados.0.smithi084.stdout:3999: left oid 15 (ObjNum 1220 snap 399 seq_num 1220) 2024-01-13T18:14:15.362 INFO:tasks.rados.rados.0.smithi084.stdout:3998: done (1 left) 2024-01-13T18:14:15.362 INFO:tasks.rados.rados.0.smithi084.stdout:3999: done (0 left) 2024-01-13T18:14:15.363 INFO:tasks.rados.rados.0.smithi084.stderr:0 errors. 2024-01-13T18:14:15.363 INFO:tasks.rados.rados.0.smithi084.stderr: 2024-01-13T18:14:15.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd dump --format=json 2024-01-13T18:14:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:14:17.010 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T18:14:17.011 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":865,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T18:14:13.762651+0000","last_up_change":"2024-01-13T18:07:03.657711+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-13T17:58:35.312354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-13T17:58:36.379223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-01-13T17:59:04.296556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"unique_pool_0","create_time":"2024-01-13T18:00:41.646135+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"865","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":784,"snap_epoch":865,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"teuthologyprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":239,"up_from":248,"up_thru":442,"down_at":240,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3732569474},{"type":"v1","addr":"172.21.15.84:6803","nonce":3732569474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3732569474},{"type":"v1","addr":"172.21.15.84:6805","nonce":3732569474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3732569474},{"type":"v1","addr":"172.21.15.84:6809","nonce":3732569474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3732569474},{"type":"v1","addr":"172.21.15.84:6807","nonce":3732569474}]},"public_addr":"172.21.15.84:6803/3732569474","cluster_addr":"172.21.15.84:6805/3732569474","heartbeat_back_addr":"172.21.15.84:6809/3732569474","heartbeat_front_addr":"172.21.15.84:6807/3732569474","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":266,"up_from":275,"up_thru":442,"down_at":267,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":217168835},{"type":"v1","addr":"172.21.15.84:6811","nonce":217168835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":217168835},{"type":"v1","addr":"172.21.15.84:6813","nonce":217168835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":217168835},{"type":"v1","addr":"172.21.15.84:6817","nonce":217168835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":217168835},{"type":"v1","addr":"172.21.15.84:6815","nonce":217168835}]},"public_addr":"172.21.15.84:6811/217168835","cluster_addr":"172.21.15.84:6813/217168835","heartbeat_back_addr":"172.21.15.84:6817/217168835","heartbeat_front_addr":"172.21.15.84:6815/217168835","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":294,"up_from":303,"up_thru":442,"down_at":295,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":454646549},{"type":"v1","addr":"172.21.15.84:6819","nonce":454646549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":454646549},{"type":"v1","addr":"172.21.15.84:6821","nonce":454646549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":454646549},{"type":"v1","addr":"172.21.15.84:6825","nonce":454646549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":454646549},{"type":"v1","addr":"172.21.15.84:6823","nonce":454646549}]},"public_addr":"172.21.15.84:6819/454646549","cluster_addr":"172.21.15.84:6821/454646549","heartbeat_back_addr":"172.21.15.84:6825/454646549","heartbeat_front_addr":"172.21.15.84:6823/454646549","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":321,"up_from":330,"up_thru":442,"down_at":322,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1415184987},{"type":"v1","addr":"172.21.15.84:6827","nonce":1415184987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1415184987},{"type":"v1","addr":"172.21.15.84:6829","nonce":1415184987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":1415184987},{"type":"v1","addr":"172.21.15.84:6833","nonce":1415184987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1415184987},{"type":"v1","addr":"172.21.15.84:6831","nonce":1415184987}]},"public_addr":"172.21.15.84:6827/1415184987","cluster_addr":"172.21.15.84:6829/1415184987","heartbeat_back_addr":"172.21.15.84:6833/1415184987","heartbeat_front_addr":"172.21.15.84:6831/1415184987","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":30,"last_clean_end":349,"up_from":358,"up_thru":442,"down_at":350,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3301222659},{"type":"v1","addr":"172.21.15.99:6801","nonce":3301222659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3301222659},{"type":"v1","addr":"172.21.15.99:6803","nonce":3301222659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3301222659},{"type":"v1","addr":"172.21.15.99:6807","nonce":3301222659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3301222659},{"type":"v1","addr":"172.21.15.99:6805","nonce":3301222659}]},"public_addr":"172.21.15.99:6801/3301222659","cluster_addr":"172.21.15.99:6803/3301222659","heartbeat_back_addr":"172.21.15.99:6807/3301222659","heartbeat_front_addr":"172.21.15.99:6805/3301222659","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":377,"up_from":387,"up_thru":442,"down_at":378,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2423841634},{"type":"v1","addr":"172.21.15.99:6809","nonce":2423841634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2423841634},{"type":"v1","addr":"172.21.15.99:6811","nonce":2423841634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2423841634},{"type":"v1","addr":"172.21.15.99:6815","nonce":2423841634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2423841634},{"type":"v1","addr":"172.21.15.99:6813","nonce":2423841634}]},"public_addr":"172.21.15.99:6809/2423841634","cluster_addr":"172.21.15.99:6811/2423841634","heartbeat_back_addr":"172.21.15.99:6815/2423841634","heartbeat_front_addr":"172.21.15.99:6813/2423841634","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":44,"last_clean_end":406,"up_from":415,"up_thru":442,"down_at":407,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":972288266},{"type":"v1","addr":"172.21.15.99:6817","nonce":972288266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":972288266},{"type":"v1","addr":"172.21.15.99:6819","nonce":972288266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":972288266},{"type":"v1","addr":"172.21.15.99:6823","nonce":972288266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":972288266},{"type":"v1","addr":"172.21.15.99:6821","nonce":972288266}]},"public_addr":"172.21.15.99:6817/972288266","cluster_addr":"172.21.15.99:6819/972288266","heartbeat_back_addr":"172.21.15.99:6823/972288266","heartbeat_front_addr":"172.21.15.99:6821/972288266","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":52,"last_clean_end":433,"up_from":442,"up_thru":442,"down_at":434,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2512047858},{"type":"v1","addr":"172.21.15.99:6825","nonce":2512047858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2512047858},{"type":"v1","addr":"172.21.15.99:6827","nonce":2512047858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2512047858},{"type":"v1","addr":"172.21.15.99:6831","nonce":2512047858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2512047858},{"type":"v1","addr":"172.21.15.99:6829","nonce":2512047858}]},"public_addr":"172.21.15.99:6825/2512047858","cluster_addr":"172.21.15.99:6827/2512047858","heartbeat_back_addr":"172.21.15.99:6831/2512047858","heartbeat_front_addr":"172.21.15.99:6829/2512047858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":239},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":266},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":294},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":321},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":349},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":377},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":406},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":433}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":7,"to":4}]},{"pgid":"3.10","mappings":[{"from":0,"to":1}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":0,"to":2},{"from":4,"to":1}]},{"pgid":"3.27","mappings":[{"from":4,"to":1}]},{"pgid":"3.31","mappings":[{"from":4,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/3017219834":"2024-01-14T18:02:49.940058+0000","172.21.15.99:0/2746817904":"2024-01-14T18:02:17.631776+0000","172.21.15.99:6833/2558131725":"2024-01-14T18:07:20.125757+0000","172.21.15.99:0/2326576577":"2024-01-14T18:02:17.631776+0000","172.21.15.84:0/2821226797":"2024-01-14T18:01:40.454289+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/2521317593":"2024-01-14T18:02:49.940058+0000","172.21.15.84:0/3637866512":"2024-01-14T18:01:40.454289+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/1542179962":"2024-01-14T18:01:40.454289+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/1542179962":"2024-01-14T18:01:40.454289+0000","172.21.15.84:0/2306273623":"2024-01-14T18:02:49.940058+0000","172.21.15.84:0/3916505137":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6801/2893470920":"2024-01-14T18:02:49.940058+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.99:0/3072500759":"2024-01-14T18:02:17.631776+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.99:6834/3030115055":"2024-01-14T18:02:17.631776+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/172129685":"2024-01-14T18:01:40.454289+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/1455901095":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/1247513276":"2024-01-14T18:01:40.454289+0000","172.21.15.99:0/1169866212":"2024-01-14T18:02:17.631776+0000","172.21.15.84:0/3513905448":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/1020358368":"2024-01-14T18:01:40.454289+0000","172.21.15.84:6800/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/3218728167":"2024-01-14T18:02:49.940058+0000","172.21.15.99:0/74069489":"2024-01-14T18:02:17.631776+0000","172.21.15.99:0/3989741424":"2024-01-14T18:02:17.631776+0000","172.21.15.84:6801/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/1946108910":"2024-01-14T17:59:05.164416+0000","172.21.15.99:6835/3030115055":"2024-01-14T18:02:17.631776+0000","172.21.15.84:0/1327997714":"2024-01-14T18:02:49.940058+0000","172.21.15.99:6832/2558131725":"2024-01-14T18:07:20.125757+0000","172.21.15.84:0/3763304315":"2024-01-14T18:02:49.940058+0000","172.21.15.84:6800/2893470920":"2024-01-14T18:02:49.940058+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"teuthologyprofile":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":690,"length":1},{"begin":759,"length":1},{"begin":779,"length":1}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":690,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T18:14:17.377 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:17 smithi084 ceph-mon[119097]: pgmap v1014: 121 pgs: 121 active+clean; 447 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-01-13T18:14:17.377 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:17 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4116037689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T18:14:17.377 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:17 smithi084 ceph-mon[116404]: pgmap v1014: 121 pgs: 121 active+clean; 447 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-01-13T18:14:17.377 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:17 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4116037689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T18:14:17.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph pg dump --format=json 2024-01-13T18:14:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:17 smithi099 ceph-mon[138788]: pgmap v1014: 121 pgs: 121 active+clean; 447 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-01-13T18:14:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:17 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4116037689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T18:14:17.641 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:14:18.871 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T18:14:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-01-13T18:14:19.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:18 smithi084 ceph-mon[116404]: osdmap e866: 8 total, 8 up, 8 in 2024-01-13T18:14:19.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:18 smithi084 ceph-mon[116404]: pgmap v1016: 121 pgs: 121 active+clean; 428 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2024-01-13T18:14:19.024 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:18 smithi084 ceph-mon[119097]: osdmap e866: 8 total, 8 up, 8 in 2024-01-13T18:14:19.024 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:18 smithi084 ceph-mon[119097]: pgmap v1016: 121 pgs: 121 active+clean; 428 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2024-01-13T18:14:19.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:18 smithi099 ceph-mon[138788]: osdmap e866: 8 total, 8 up, 8 in 2024-01-13T18:14:19.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:18 smithi099 ceph-mon[138788]: pgmap v1016: 121 pgs: 121 active+clean; 428 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2024-01-13T18:14:19.228 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1016,"stamp":"2024-01-13T18:14:18.131618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":448969678,"num_objects":205,"num_object_clones":131,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205,"num_whiteouts":7,"num_read":4887,"num_read_kb":6586807,"num_write":8741,"num_write_kb":1992939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":319424096,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19809,"ondisk_log_size":19809,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":3600404,"kb_used_data":705892,"kb_used_omap":624,"kb_used_meta":2893775,"kb_avail":746360812,"statfs":{"total":767960285184,"available":764273471488,"internally_reserved":0,"allocated":722833408,"data_stored":1295936757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":639226,"internal_metadata":2963226374},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-32563200,"num_objects":-5,"num_object_clones":-5,"num_object_copies":-15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":31,"num_read_kb":124665,"num_write":46,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001453"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":819,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.775424+0000","last_change":"2024-01-13T18:07:04.676993+0000","last_active":"2024-01-13T18:14:12.775424+0000","last_peered":"2024-01-13T18:14:12.775424+0000","last_clean":"2024-01-13T18:14:12.775424+0000","last_became_active":"2024-01-13T18:07:04.676567+0000","last_became_peered":"2024-01-13T18:07:04.676567+0000","last_unstale":"2024-01-13T18:14:12.775424+0000","last_undegraded":"2024-01-13T18:14:12.775424+0000","last_fullsized":"2024-01-13T18:14:12.775424+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:01:22.349104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":827,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.784072+0000","last_change":"2024-01-13T18:06:36.689987+0000","last_active":"2024-01-13T18:14:10.784072+0000","last_peered":"2024-01-13T18:14:10.784072+0000","last_clean":"2024-01-13T18:14:10.784072+0000","last_became_active":"2024-01-13T18:06:36.689022+0000","last_became_peered":"2024-01-13T18:06:36.689022+0000","last_unstale":"2024-01-13T18:14:10.784072+0000","last_undegraded":"2024-01-13T18:14:10.784072+0000","last_fullsized":"2024-01-13T18:14:10.784072+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:53:58.813166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":824,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769337+0000","last_change":"2024-01-13T18:04:43.614778+0000","last_active":"2024-01-13T18:14:12.769337+0000","last_peered":"2024-01-13T18:14:12.769337+0000","last_clean":"2024-01-13T18:14:12.769337+0000","last_became_active":"2024-01-13T18:04:43.614507+0000","last_became_peered":"2024-01-13T18:04:43.614507+0000","last_unstale":"2024-01-13T18:14:12.769337+0000","last_undegraded":"2024-01-13T18:14:12.769337+0000","last_fullsized":"2024-01-13T18:14:12.769337+0000","mapping_epoch":303,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":304,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:22:16.554556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":832,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759754+0000","last_change":"2024-01-13T18:07:04.685496+0000","last_active":"2024-01-13T18:14:12.759754+0000","last_peered":"2024-01-13T18:14:12.759754+0000","last_clean":"2024-01-13T18:14:12.759754+0000","last_became_active":"2024-01-13T18:07:04.685104+0000","last_became_peered":"2024-01-13T18:07:04.685104+0000","last_unstale":"2024-01-13T18:14:12.759754+0000","last_undegraded":"2024-01-13T18:14:12.759754+0000","last_fullsized":"2024-01-13T18:14:12.759754+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:23:45.428499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":803,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.774996+0000","last_change":"2024-01-13T18:07:04.685700+0000","last_active":"2024-01-13T18:14:12.774996+0000","last_peered":"2024-01-13T18:14:12.774996+0000","last_clean":"2024-01-13T18:14:12.774996+0000","last_became_active":"2024-01-13T18:07:04.684750+0000","last_became_peered":"2024-01-13T18:07:04.684750+0000","last_unstale":"2024-01-13T18:14:12.774996+0000","last_undegraded":"2024-01-13T18:14:12.774996+0000","last_fullsized":"2024-01-13T18:14:12.774996+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:20:04.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":819,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759396+0000","last_change":"2024-01-13T18:06:08.634204+0000","last_active":"2024-01-13T18:14:12.759396+0000","last_peered":"2024-01-13T18:14:12.759396+0000","last_clean":"2024-01-13T18:14:12.759396+0000","last_became_active":"2024-01-13T18:06:08.633781+0000","last_became_peered":"2024-01-13T18:06:08.633781+0000","last_unstale":"2024-01-13T18:14:12.759396+0000","last_undegraded":"2024-01-13T18:14:12.759396+0000","last_fullsized":"2024-01-13T18:14:12.759396+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:12:17.057375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":803,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.774335+0000","last_change":"2024-01-13T18:07:04.685649+0000","last_active":"2024-01-13T18:14:12.774335+0000","last_peered":"2024-01-13T18:14:12.774335+0000","last_clean":"2024-01-13T18:14:12.774335+0000","last_became_active":"2024-01-13T18:07:04.684123+0000","last_became_peered":"2024-01-13T18:07:04.684123+0000","last_unstale":"2024-01-13T18:14:12.774335+0000","last_undegraded":"2024-01-13T18:14:12.774335+0000","last_fullsized":"2024-01-13T18:14:12.774335+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:56:48.144697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":830,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.757667+0000","last_change":"2024-01-13T18:06:36.691091+0000","last_active":"2024-01-13T18:14:12.757667+0000","last_peered":"2024-01-13T18:14:12.757667+0000","last_clean":"2024-01-13T18:14:12.757667+0000","last_became_active":"2024-01-13T18:06:36.689749+0000","last_became_peered":"2024-01-13T18:06:36.689749+0000","last_unstale":"2024-01-13T18:14:12.757667+0000","last_undegraded":"2024-01-13T18:14:12.757667+0000","last_fullsized":"2024-01-13T18:14:12.757667+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:27:05.059097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":833,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.780751+0000","last_change":"2024-01-13T18:07:04.684673+0000","last_active":"2024-01-13T18:14:13.780751+0000","last_peered":"2024-01-13T18:14:13.780751+0000","last_clean":"2024-01-13T18:14:13.780751+0000","last_became_active":"2024-01-13T18:07:04.684357+0000","last_became_peered":"2024-01-13T18:07:04.684357+0000","last_unstale":"2024-01-13T18:14:13.780751+0000","last_undegraded":"2024-01-13T18:14:13.780751+0000","last_fullsized":"2024-01-13T18:14:13.780751+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:49:44.826600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":819,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770053+0000","last_change":"2024-01-13T18:06:36.699067+0000","last_active":"2024-01-13T18:14:12.770053+0000","last_peered":"2024-01-13T18:14:12.770053+0000","last_clean":"2024-01-13T18:14:12.770053+0000","last_became_active":"2024-01-13T18:06:36.698719+0000","last_became_peered":"2024-01-13T18:06:36.698719+0000","last_unstale":"2024-01-13T18:14:12.770053+0000","last_undegraded":"2024-01-13T18:14:12.770053+0000","last_fullsized":"2024-01-13T18:14:12.770053+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:43:24.940058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":815,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770208+0000","last_change":"2024-01-13T18:06:36.690181+0000","last_active":"2024-01-13T18:14:12.770208+0000","last_peered":"2024-01-13T18:14:12.770208+0000","last_clean":"2024-01-13T18:14:12.770208+0000","last_became_active":"2024-01-13T18:06:36.689651+0000","last_became_peered":"2024-01-13T18:06:36.689651+0000","last_unstale":"2024-01-13T18:14:12.770208+0000","last_undegraded":"2024-01-13T18:14:12.770208+0000","last_fullsized":"2024-01-13T18:14:12.770208+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:12:07.539702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":831,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.773465+0000","last_change":"2024-01-13T18:06:36.696168+0000","last_active":"2024-01-13T18:14:13.773465+0000","last_peered":"2024-01-13T18:14:13.773465+0000","last_clean":"2024-01-13T18:14:13.773465+0000","last_became_active":"2024-01-13T18:06:36.695435+0000","last_became_peered":"2024-01-13T18:06:36.695435+0000","last_unstale":"2024-01-13T18:14:13.773465+0000","last_undegraded":"2024-01-13T18:14:13.773465+0000","last_fullsized":"2024-01-13T18:14:13.773465+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:50:16.115554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":843,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759287+0000","last_change":"2024-01-13T18:06:36.690247+0000","last_active":"2024-01-13T18:14:12.759287+0000","last_peered":"2024-01-13T18:14:12.759287+0000","last_clean":"2024-01-13T18:14:12.759287+0000","last_became_active":"2024-01-13T18:06:36.689124+0000","last_became_peered":"2024-01-13T18:06:36.689124+0000","last_unstale":"2024-01-13T18:14:12.759287+0000","last_undegraded":"2024-01-13T18:14:12.759287+0000","last_fullsized":"2024-01-13T18:14:12.759287+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:04:27.422063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":823,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770667+0000","last_change":"2024-01-13T18:06:08.624789+0000","last_active":"2024-01-13T18:14:12.770667+0000","last_peered":"2024-01-13T18:14:12.770667+0000","last_clean":"2024-01-13T18:14:12.770667+0000","last_became_active":"2024-01-13T18:06:08.624492+0000","last_became_peered":"2024-01-13T18:06:08.624492+0000","last_unstale":"2024-01-13T18:14:12.770667+0000","last_undegraded":"2024-01-13T18:14:12.770667+0000","last_fullsized":"2024-01-13T18:14:12.770667+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:00:18.388310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":816,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.783308+0000","last_change":"2024-01-13T18:06:08.624990+0000","last_active":"2024-01-13T18:14:10.783308+0000","last_peered":"2024-01-13T18:14:10.783308+0000","last_clean":"2024-01-13T18:14:10.783308+0000","last_became_active":"2024-01-13T18:06:08.624634+0000","last_became_peered":"2024-01-13T18:06:08.624634+0000","last_unstale":"2024-01-13T18:14:10.783308+0000","last_undegraded":"2024-01-13T18:14:10.783308+0000","last_fullsized":"2024-01-13T18:14:10.783308+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:51:36.087045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":831,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.758934+0000","last_change":"2024-01-13T18:07:04.690773+0000","last_active":"2024-01-13T18:14:12.758934+0000","last_peered":"2024-01-13T18:14:12.758934+0000","last_clean":"2024-01-13T18:14:12.758934+0000","last_became_active":"2024-01-13T18:07:04.690479+0000","last_became_peered":"2024-01-13T18:07:04.690479+0000","last_unstale":"2024-01-13T18:14:12.758934+0000","last_undegraded":"2024-01-13T18:14:12.758934+0000","last_fullsized":"2024-01-13T18:14:12.758934+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:57:09.193740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":817,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.760576+0000","last_change":"2024-01-13T18:07:04.686314+0000","last_active":"2024-01-13T18:14:12.760576+0000","last_peered":"2024-01-13T18:14:12.760576+0000","last_clean":"2024-01-13T18:14:12.760576+0000","last_became_active":"2024-01-13T18:07:04.686051+0000","last_became_peered":"2024-01-13T18:07:04.686051+0000","last_unstale":"2024-01-13T18:14:12.760576+0000","last_undegraded":"2024-01-13T18:14:12.760576+0000","last_fullsized":"2024-01-13T18:14:12.760576+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:20:11.065991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":806,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769488+0000","last_change":"2024-01-13T18:07:04.676689+0000","last_active":"2024-01-13T18:14:12.769488+0000","last_peered":"2024-01-13T18:14:12.769488+0000","last_clean":"2024-01-13T18:14:12.769488+0000","last_became_active":"2024-01-13T18:07:04.676367+0000","last_became_peered":"2024-01-13T18:07:04.676367+0000","last_unstale":"2024-01-13T18:14:12.769488+0000","last_undegraded":"2024-01-13T18:14:12.769488+0000","last_fullsized":"2024-01-13T18:14:12.769488+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:53:27.526440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":819,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.776021+0000","last_change":"2024-01-13T18:07:04.683017+0000","last_active":"2024-01-13T18:14:12.776021+0000","last_peered":"2024-01-13T18:14:12.776021+0000","last_clean":"2024-01-13T18:14:12.776021+0000","last_became_active":"2024-01-13T18:07:04.681732+0000","last_became_peered":"2024-01-13T18:07:04.681732+0000","last_unstale":"2024-01-13T18:14:12.776021+0000","last_undegraded":"2024-01-13T18:14:12.776021+0000","last_fullsized":"2024-01-13T18:14:12.776021+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:02:36.454858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"459'5","reported_seq":832,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770312+0000","last_change":"2024-01-13T18:07:04.677935+0000","last_active":"2024-01-13T18:14:12.770312+0000","last_peered":"2024-01-13T18:14:12.770312+0000","last_clean":"2024-01-13T18:14:12.770312+0000","last_became_active":"2024-01-13T18:07:04.677371+0000","last_became_peered":"2024-01-13T18:07:04.677371+0000","last_unstale":"2024-01-13T18:14:12.770312+0000","last_undegraded":"2024-01-13T18:14:12.770312+0000","last_fullsized":"2024-01-13T18:14:12.770312+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:54:35.867596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":831,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.757923+0000","last_change":"2024-01-13T18:06:36.690848+0000","last_active":"2024-01-13T18:14:12.757923+0000","last_peered":"2024-01-13T18:14:12.757923+0000","last_clean":"2024-01-13T18:14:12.757923+0000","last_became_active":"2024-01-13T18:06:36.689455+0000","last_became_peered":"2024-01-13T18:06:36.689455+0000","last_unstale":"2024-01-13T18:14:12.757923+0000","last_undegraded":"2024-01-13T18:14:12.757923+0000","last_fullsized":"2024-01-13T18:14:12.757923+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:53:25.518748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"459'2","reported_seq":821,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.758081+0000","last_change":"2024-01-13T18:06:08.624633+0000","last_active":"2024-01-13T18:14:12.758081+0000","last_peered":"2024-01-13T18:14:12.758081+0000","last_clean":"2024-01-13T18:14:12.758081+0000","last_became_active":"2024-01-13T18:06:08.624237+0000","last_became_peered":"2024-01-13T18:06:08.624237+0000","last_unstale":"2024-01-13T18:14:12.758081+0000","last_undegraded":"2024-01-13T18:14:12.758081+0000","last_fullsized":"2024-01-13T18:14:12.758081+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:47:50.492433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":824,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770020+0000","last_change":"2024-01-13T18:06:08.627262+0000","last_active":"2024-01-13T18:14:12.770020+0000","last_peered":"2024-01-13T18:14:12.770020+0000","last_clean":"2024-01-13T18:14:12.770020+0000","last_became_active":"2024-01-13T18:06:08.626946+0000","last_became_peered":"2024-01-13T18:06:08.626946+0000","last_unstale":"2024-01-13T18:14:12.770020+0000","last_undegraded":"2024-01-13T18:14:12.770020+0000","last_fullsized":"2024-01-13T18:14:12.770020+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:02:01.703459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"59'2","reported_seq":823,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.776241+0000","last_change":"2024-01-13T18:07:04.681439+0000","last_active":"2024-01-13T18:14:12.776241+0000","last_peered":"2024-01-13T18:14:12.776241+0000","last_clean":"2024-01-13T18:14:12.776241+0000","last_became_active":"2024-01-13T18:07:04.676787+0000","last_became_peered":"2024-01-13T18:07:04.676787+0000","last_unstale":"2024-01-13T18:14:12.776241+0000","last_undegraded":"2024-01-13T18:14:12.776241+0000","last_fullsized":"2024-01-13T18:14:12.776241+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:02:19.066646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":819,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759606+0000","last_change":"2024-01-13T18:06:08.634465+0000","last_active":"2024-01-13T18:14:12.759606+0000","last_peered":"2024-01-13T18:14:12.759606+0000","last_clean":"2024-01-13T18:14:12.759606+0000","last_became_active":"2024-01-13T18:06:08.633912+0000","last_became_peered":"2024-01-13T18:06:08.633912+0000","last_unstale":"2024-01-13T18:14:12.759606+0000","last_undegraded":"2024-01-13T18:14:12.759606+0000","last_fullsized":"2024-01-13T18:14:12.759606+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:45:26.836943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"59'2","reported_seq":837,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.774619+0000","last_change":"2024-01-13T18:07:04.684742+0000","last_active":"2024-01-13T18:14:12.774619+0000","last_peered":"2024-01-13T18:14:12.774619+0000","last_clean":"2024-01-13T18:14:12.774619+0000","last_became_active":"2024-01-13T18:07:04.683735+0000","last_became_peered":"2024-01-13T18:07:04.683735+0000","last_unstale":"2024-01-13T18:14:12.774619+0000","last_undegraded":"2024-01-13T18:14:12.774619+0000","last_fullsized":"2024-01-13T18:14:12.774619+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:41:07.507501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":817,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759654+0000","last_change":"2024-01-13T18:06:36.704959+0000","last_active":"2024-01-13T18:14:12.759654+0000","last_peered":"2024-01-13T18:14:12.759654+0000","last_clean":"2024-01-13T18:14:12.759654+0000","last_became_active":"2024-01-13T18:06:36.704695+0000","last_became_peered":"2024-01-13T18:06:36.704695+0000","last_unstale":"2024-01-13T18:14:12.759654+0000","last_undegraded":"2024-01-13T18:14:12.759654+0000","last_fullsized":"2024-01-13T18:14:12.759654+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:51:03.451220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"459'2","reported_seq":833,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759606+0000","last_change":"2024-01-13T18:07:04.679157+0000","last_active":"2024-01-13T18:14:12.759606+0000","last_peered":"2024-01-13T18:14:12.759606+0000","last_clean":"2024-01-13T18:14:12.759606+0000","last_became_active":"2024-01-13T18:07:04.678767+0000","last_became_peered":"2024-01-13T18:07:04.678767+0000","last_unstale":"2024-01-13T18:14:12.759606+0000","last_undegraded":"2024-01-13T18:14:12.759606+0000","last_fullsized":"2024-01-13T18:14:12.759606+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:14:29.725122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":847,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.773986+0000","last_change":"2024-01-13T18:05:39.635905+0000","last_active":"2024-01-13T18:14:13.773986+0000","last_peered":"2024-01-13T18:14:13.773986+0000","last_clean":"2024-01-13T18:14:13.773986+0000","last_became_active":"2024-01-13T18:05:39.635621+0000","last_became_peered":"2024-01-13T18:05:39.635621+0000","last_unstale":"2024-01-13T18:14:13.773986+0000","last_undegraded":"2024-01-13T18:14:13.773986+0000","last_fullsized":"2024-01-13T18:14:13.773986+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:32:23.389683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"459'2","reported_seq":833,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770011+0000","last_change":"2024-01-13T18:07:04.677736+0000","last_active":"2024-01-13T18:14:12.770011+0000","last_peered":"2024-01-13T18:14:12.770011+0000","last_clean":"2024-01-13T18:14:12.770011+0000","last_became_active":"2024-01-13T18:07:04.677429+0000","last_became_peered":"2024-01-13T18:07:04.677429+0000","last_unstale":"2024-01-13T18:14:12.770011+0000","last_undegraded":"2024-01-13T18:14:12.770011+0000","last_fullsized":"2024-01-13T18:14:12.770011+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:19:22.477918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":823,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.771265+0000","last_change":"2024-01-13T18:07:04.680203+0000","last_active":"2024-01-13T18:14:12.771265+0000","last_peered":"2024-01-13T18:14:12.771265+0000","last_clean":"2024-01-13T18:14:12.771265+0000","last_became_active":"2024-01-13T18:07:04.679814+0000","last_became_peered":"2024-01-13T18:07:04.679814+0000","last_unstale":"2024-01-13T18:14:12.771265+0000","last_undegraded":"2024-01-13T18:14:12.771265+0000","last_fullsized":"2024-01-13T18:14:12.771265+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:29:17.383302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":818,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.757707+0000","last_change":"2024-01-13T18:06:36.690067+0000","last_active":"2024-01-13T18:14:12.757707+0000","last_peered":"2024-01-13T18:14:12.757707+0000","last_clean":"2024-01-13T18:14:12.757707+0000","last_became_active":"2024-01-13T18:06:36.689676+0000","last_became_peered":"2024-01-13T18:06:36.689676+0000","last_unstale":"2024-01-13T18:14:12.757707+0000","last_undegraded":"2024-01-13T18:14:12.757707+0000","last_fullsized":"2024-01-13T18:14:12.757707+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:27:41.681642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":845,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.757736+0000","last_change":"2024-01-13T18:05:11.640528+0000","last_active":"2024-01-13T18:14:12.757736+0000","last_peered":"2024-01-13T18:14:12.757736+0000","last_clean":"2024-01-13T18:14:12.757736+0000","last_became_active":"2024-01-13T18:05:11.638797+0000","last_became_peered":"2024-01-13T18:05:11.638797+0000","last_unstale":"2024-01-13T18:14:12.757736+0000","last_undegraded":"2024-01-13T18:14:12.757736+0000","last_fullsized":"2024-01-13T18:14:12.757736+0000","mapping_epoch":330,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:26:08.465858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":818,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759146+0000","last_change":"2024-01-13T18:07:04.690603+0000","last_active":"2024-01-13T18:14:12.759146+0000","last_peered":"2024-01-13T18:14:12.759146+0000","last_clean":"2024-01-13T18:14:12.759146+0000","last_became_active":"2024-01-13T18:07:04.690172+0000","last_became_peered":"2024-01-13T18:07:04.690172+0000","last_unstale":"2024-01-13T18:14:12.759146+0000","last_undegraded":"2024-01-13T18:14:12.759146+0000","last_fullsized":"2024-01-13T18:14:12.759146+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:12:06.077533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":840,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.783511+0000","last_change":"2024-01-13T18:05:39.634770+0000","last_active":"2024-01-13T18:14:10.783511+0000","last_peered":"2024-01-13T18:14:10.783511+0000","last_clean":"2024-01-13T18:14:10.783511+0000","last_became_active":"2024-01-13T18:05:39.634391+0000","last_became_peered":"2024-01-13T18:05:39.634391+0000","last_unstale":"2024-01-13T18:14:10.783511+0000","last_undegraded":"2024-01-13T18:14:10.783511+0000","last_fullsized":"2024-01-13T18:14:10.783511+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:42:09.133792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":820,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770079+0000","last_change":"2024-01-13T18:06:36.699377+0000","last_active":"2024-01-13T18:14:12.770079+0000","last_peered":"2024-01-13T18:14:12.770079+0000","last_clean":"2024-01-13T18:14:12.770079+0000","last_became_active":"2024-01-13T18:06:36.699093+0000","last_became_peered":"2024-01-13T18:06:36.699093+0000","last_unstale":"2024-01-13T18:14:12.770079+0000","last_undegraded":"2024-01-13T18:14:12.770079+0000","last_fullsized":"2024-01-13T18:14:12.770079+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:50:05.789920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":817,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759752+0000","last_change":"2024-01-13T18:07:04.690445+0000","last_active":"2024-01-13T18:14:12.759752+0000","last_peered":"2024-01-13T18:14:12.759752+0000","last_clean":"2024-01-13T18:14:12.759752+0000","last_became_active":"2024-01-13T18:07:04.690237+0000","last_became_peered":"2024-01-13T18:07:04.690237+0000","last_unstale":"2024-01-13T18:14:12.759752+0000","last_undegraded":"2024-01-13T18:14:12.759752+0000","last_fullsized":"2024-01-13T18:14:12.759752+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:12:36.690616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":805,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759644+0000","last_change":"2024-01-13T18:06:36.706633+0000","last_active":"2024-01-13T18:14:12.759644+0000","last_peered":"2024-01-13T18:14:12.759644+0000","last_clean":"2024-01-13T18:14:12.759644+0000","last_became_active":"2024-01-13T18:06:36.706322+0000","last_became_peered":"2024-01-13T18:06:36.706322+0000","last_unstale":"2024-01-13T18:14:12.759644+0000","last_undegraded":"2024-01-13T18:14:12.759644+0000","last_fullsized":"2024-01-13T18:14:12.759644+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:26:07.627029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":823,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770138+0000","last_change":"2024-01-13T18:06:08.626625+0000","last_active":"2024-01-13T18:14:12.770138+0000","last_peered":"2024-01-13T18:14:12.770138+0000","last_clean":"2024-01-13T18:14:12.770138+0000","last_became_active":"2024-01-13T18:06:08.626313+0000","last_became_peered":"2024-01-13T18:06:08.626313+0000","last_unstale":"2024-01-13T18:14:12.770138+0000","last_undegraded":"2024-01-13T18:14:12.770138+0000","last_fullsized":"2024-01-13T18:14:12.770138+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:23:42.335966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"59'3","reported_seq":834,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.784464+0000","last_change":"2024-01-13T18:06:08.625204+0000","last_active":"2024-01-13T18:14:10.784464+0000","last_peered":"2024-01-13T18:14:10.784464+0000","last_clean":"2024-01-13T18:14:10.784464+0000","last_became_active":"2024-01-13T18:06:08.624780+0000","last_became_peered":"2024-01-13T18:06:08.624780+0000","last_unstale":"2024-01-13T18:14:10.784464+0000","last_undegraded":"2024-01-13T18:14:10.784464+0000","last_fullsized":"2024-01-13T18:14:10.784464+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:04:18.091943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":844,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.773709+0000","last_change":"2024-01-13T18:07:04.675044+0000","last_active":"2024-01-13T18:14:13.773709+0000","last_peered":"2024-01-13T18:14:13.773709+0000","last_clean":"2024-01-13T18:14:13.773709+0000","last_became_active":"2024-01-13T18:07:04.674762+0000","last_became_peered":"2024-01-13T18:07:04.674762+0000","last_unstale":"2024-01-13T18:14:13.773709+0000","last_undegraded":"2024-01-13T18:14:13.773709+0000","last_fullsized":"2024-01-13T18:14:13.773709+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:44:00.661069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"459'29","reported_seq":855,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770411+0000","last_change":"2024-01-13T18:06:36.698407+0000","last_active":"2024-01-13T18:14:12.770411+0000","last_peered":"2024-01-13T18:14:12.770411+0000","last_clean":"2024-01-13T18:14:12.770411+0000","last_became_active":"2024-01-13T18:06:36.698062+0000","last_became_peered":"2024-01-13T18:06:36.698062+0000","last_unstale":"2024-01-13T18:14:12.770411+0000","last_undegraded":"2024-01-13T18:14:12.770411+0000","last_fullsized":"2024-01-13T18:14:12.770411+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:08:17.545474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5804,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":806,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769689+0000","last_change":"2024-01-13T18:05:39.638532+0000","last_active":"2024-01-13T18:14:12.769689+0000","last_peered":"2024-01-13T18:14:12.769689+0000","last_clean":"2024-01-13T18:14:12.769689+0000","last_became_active":"2024-01-13T18:05:39.638211+0000","last_became_peered":"2024-01-13T18:05:39.638211+0000","last_unstale":"2024-01-13T18:14:12.769689+0000","last_undegraded":"2024-01-13T18:14:12.769689+0000","last_fullsized":"2024-01-13T18:14:12.769689+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:25:37.721401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"59'2","reported_seq":828,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.771337+0000","last_change":"2024-01-13T18:05:39.638116+0000","last_active":"2024-01-13T18:14:12.771337+0000","last_peered":"2024-01-13T18:14:12.771337+0000","last_clean":"2024-01-13T18:14:12.771337+0000","last_became_active":"2024-01-13T18:05:39.637285+0000","last_became_peered":"2024-01-13T18:05:39.637285+0000","last_unstale":"2024-01-13T18:14:12.771337+0000","last_undegraded":"2024-01-13T18:14:12.771337+0000","last_fullsized":"2024-01-13T18:14:12.771337+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:12:20.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":823,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770843+0000","last_change":"2024-01-13T18:07:04.677717+0000","last_active":"2024-01-13T18:14:12.770843+0000","last_peered":"2024-01-13T18:14:12.770843+0000","last_clean":"2024-01-13T18:14:12.770843+0000","last_became_active":"2024-01-13T18:07:04.677432+0000","last_became_peered":"2024-01-13T18:07:04.677432+0000","last_unstale":"2024-01-13T18:14:12.770843+0000","last_undegraded":"2024-01-13T18:14:12.770843+0000","last_fullsized":"2024-01-13T18:14:12.770843+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:26:51.926794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":832,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759294+0000","last_change":"2024-01-13T18:07:04.685739+0000","last_active":"2024-01-13T18:14:12.759294+0000","last_peered":"2024-01-13T18:14:12.759294+0000","last_clean":"2024-01-13T18:14:12.759294+0000","last_became_active":"2024-01-13T18:07:04.684979+0000","last_became_peered":"2024-01-13T18:07:04.684979+0000","last_unstale":"2024-01-13T18:14:12.759294+0000","last_undegraded":"2024-01-13T18:14:12.759294+0000","last_fullsized":"2024-01-13T18:14:12.759294+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:53:58.018804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":804,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.775134+0000","last_change":"2024-01-13T18:07:04.685530+0000","last_active":"2024-01-13T18:14:12.775134+0000","last_peered":"2024-01-13T18:14:12.775134+0000","last_clean":"2024-01-13T18:14:12.775134+0000","last_became_active":"2024-01-13T18:07:04.684301+0000","last_became_peered":"2024-01-13T18:07:04.684301+0000","last_unstale":"2024-01-13T18:14:12.775134+0000","last_undegraded":"2024-01-13T18:14:12.775134+0000","last_fullsized":"2024-01-13T18:14:12.775134+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:39:56.412771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":833,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770110+0000","last_change":"2024-01-13T18:06:36.694343+0000","last_active":"2024-01-13T18:14:12.770110+0000","last_peered":"2024-01-13T18:14:12.770110+0000","last_clean":"2024-01-13T18:14:12.770110+0000","last_became_active":"2024-01-13T18:06:36.693964+0000","last_became_peered":"2024-01-13T18:06:36.693964+0000","last_unstale":"2024-01-13T18:14:12.770110+0000","last_undegraded":"2024-01-13T18:14:12.770110+0000","last_fullsized":"2024-01-13T18:14:12.770110+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:33:48.780070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":829,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769494+0000","last_change":"2024-01-13T18:06:36.697830+0000","last_active":"2024-01-13T18:14:12.769494+0000","last_peered":"2024-01-13T18:14:12.769494+0000","last_clean":"2024-01-13T18:14:12.769494+0000","last_became_active":"2024-01-13T18:06:36.697360+0000","last_became_peered":"2024-01-13T18:06:36.697360+0000","last_unstale":"2024-01-13T18:14:12.769494+0000","last_undegraded":"2024-01-13T18:14:12.769494+0000","last_fullsized":"2024-01-13T18:14:12.769494+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:22:53.142670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5],"acting":[6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"59'8","reported_seq":838,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.768993+0000","last_change":"2024-01-13T18:04:43.613600+0000","last_active":"2024-01-13T18:14:12.768993+0000","last_peered":"2024-01-13T18:14:12.768993+0000","last_clean":"2024-01-13T18:14:12.768993+0000","last_became_active":"2024-01-13T18:04:43.612929+0000","last_became_peered":"2024-01-13T18:04:43.612929+0000","last_unstale":"2024-01-13T18:14:12.768993+0000","last_undegraded":"2024-01-13T18:14:12.768993+0000","last_fullsized":"2024-01-13T18:14:12.768993+0000","mapping_epoch":303,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":304,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:52:34.778583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":819,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.774450+0000","last_change":"2024-01-13T18:07:04.685636+0000","last_active":"2024-01-13T18:14:12.774450+0000","last_peered":"2024-01-13T18:14:12.774450+0000","last_clean":"2024-01-13T18:14:12.774450+0000","last_became_active":"2024-01-13T18:07:04.683739+0000","last_became_peered":"2024-01-13T18:07:04.683739+0000","last_unstale":"2024-01-13T18:14:12.774450+0000","last_undegraded":"2024-01-13T18:14:12.774450+0000","last_fullsized":"2024-01-13T18:14:12.774450+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:58:44.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"865'1246","reported_seq":3736,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.829690+0000","last_change":"2024-01-13T18:14:13.830772+0000","last_active":"2024-01-13T18:14:13.829690+0000","last_peered":"2024-01-13T18:14:13.829690+0000","last_clean":"2024-01-13T18:14:13.829690+0000","last_became_active":"2024-01-13T18:04:43.613647+0000","last_became_peered":"2024-01-13T18:04:43.613647+0000","last_unstale":"2024-01-13T18:14:13.829690+0000","last_undegraded":"2024-01-13T18:14:13.829690+0000","last_fullsized":"2024-01-13T18:14:13.829690+0000","mapping_epoch":303,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":304,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":1246,"log_dups_size":0,"ondisk_log_size":1246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:55:34.136457+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0061760160000000003,"stat_sum":{"num_bytes":13828096,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":221,"num_read_kb":341760,"num_write":436,"num_write_kb":98720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":38707200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"2.f","version":"59'1","reported_seq":834,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.774224+0000","last_change":"2024-01-13T18:07:04.673425+0000","last_active":"2024-01-13T18:14:13.774224+0000","last_peered":"2024-01-13T18:14:13.774224+0000","last_clean":"2024-01-13T18:14:13.774224+0000","last_became_active":"2024-01-13T18:07:04.673076+0000","last_became_peered":"2024-01-13T18:07:04.673076+0000","last_unstale":"2024-01-13T18:14:13.774224+0000","last_undegraded":"2024-01-13T18:14:13.774224+0000","last_fullsized":"2024-01-13T18:14:13.774224+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:00:12.739720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":804,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.775368+0000","last_change":"2024-01-13T18:07:04.689155+0000","last_active":"2024-01-13T18:14:12.775368+0000","last_peered":"2024-01-13T18:14:12.775368+0000","last_clean":"2024-01-13T18:14:12.775368+0000","last_became_active":"2024-01-13T18:07:04.685186+0000","last_became_peered":"2024-01-13T18:07:04.685186+0000","last_unstale":"2024-01-13T18:14:12.775368+0000","last_undegraded":"2024-01-13T18:14:12.775368+0000","last_fullsized":"2024-01-13T18:14:12.775368+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:09:43.127831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'2065","reported_seq":4511,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.793708+0000","last_change":"2024-01-13T18:14:13.794777+0000","last_active":"2024-01-13T18:14:13.793708+0000","last_peered":"2024-01-13T18:14:13.793708+0000","last_clean":"2024-01-13T18:14:13.793708+0000","last_became_active":"2024-01-13T18:06:36.685323+0000","last_became_peered":"2024-01-13T18:06:36.685323+0000","last_unstale":"2024-01-13T18:14:13.793708+0000","last_undegraded":"2024-01-13T18:14:13.793708+0000","last_fullsized":"2024-01-13T18:14:13.793708+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:55:57.943380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024143235999999998,"stat_sum":{"num_bytes":52035584,"num_objects":21,"num_object_clones":16,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":391,"num_read_kb":533436,"num_write":832,"num_write_kb":180696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":58073088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":800,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.784350+0000","last_change":"2024-01-13T18:06:08.635483+0000","last_active":"2024-01-13T18:14:10.784350+0000","last_peered":"2024-01-13T18:14:10.784350+0000","last_clean":"2024-01-13T18:14:10.784350+0000","last_became_active":"2024-01-13T18:06:08.635039+0000","last_became_peered":"2024-01-13T18:06:08.635039+0000","last_unstale":"2024-01-13T18:14:10.784350+0000","last_undegraded":"2024-01-13T18:14:10.784350+0000","last_fullsized":"2024-01-13T18:14:10.784350+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:11:16.691117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":828,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.785450+0000","last_change":"2024-01-13T18:07:04.677625+0000","last_active":"2024-01-13T18:14:10.785450+0000","last_peered":"2024-01-13T18:14:10.785450+0000","last_clean":"2024-01-13T18:14:10.785450+0000","last_became_active":"2024-01-13T18:07:04.677282+0000","last_became_peered":"2024-01-13T18:07:04.677282+0000","last_unstale":"2024-01-13T18:14:10.785450+0000","last_undegraded":"2024-01-13T18:14:10.785450+0000","last_fullsized":"2024-01-13T18:14:10.785450+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:14:05.856040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":833,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759557+0000","last_change":"2024-01-13T18:06:08.633137+0000","last_active":"2024-01-13T18:14:12.759557+0000","last_peered":"2024-01-13T18:14:12.759557+0000","last_clean":"2024-01-13T18:14:12.759557+0000","last_became_active":"2024-01-13T18:06:08.632832+0000","last_became_peered":"2024-01-13T18:06:08.632832+0000","last_unstale":"2024-01-13T18:14:12.759557+0000","last_undegraded":"2024-01-13T18:14:12.759557+0000","last_fullsized":"2024-01-13T18:14:12.759557+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:39:32.559326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'1568","reported_seq":4031,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.788029+0000","last_change":"2024-01-13T18:14:13.789119+0000","last_active":"2024-01-13T18:14:13.788029+0000","last_peered":"2024-01-13T18:14:13.788029+0000","last_clean":"2024-01-13T18:14:13.788029+0000","last_became_active":"2024-01-13T18:05:39.638005+0000","last_became_peered":"2024-01-13T18:05:39.638005+0000","last_unstale":"2024-01-13T18:14:13.788029+0000","last_undegraded":"2024-01-13T18:14:13.788029+0000","last_fullsized":"2024-01-13T18:14:13.788029+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":1568,"log_dups_size":0,"ondisk_log_size":1568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:17:21.428451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018150171,"stat_sum":{"num_bytes":23945216,"num_objects":12,"num_object_clones":8,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":267,"num_read_kb":317952,"num_write":669,"num_write_kb":143256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":19947520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":800,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.785883+0000","last_change":"2024-01-13T18:05:11.634329+0000","last_active":"2024-01-13T18:14:10.785883+0000","last_peered":"2024-01-13T18:14:10.785883+0000","last_clean":"2024-01-13T18:14:10.785883+0000","last_became_active":"2024-01-13T18:05:11.634093+0000","last_became_peered":"2024-01-13T18:05:11.634093+0000","last_unstale":"2024-01-13T18:14:10.785883+0000","last_undegraded":"2024-01-13T18:14:10.785883+0000","last_fullsized":"2024-01-13T18:14:10.785883+0000","mapping_epoch":330,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:54:38.445869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":818,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759046+0000","last_change":"2024-01-13T18:06:36.708789+0000","last_active":"2024-01-13T18:14:12.759046+0000","last_peered":"2024-01-13T18:14:12.759046+0000","last_clean":"2024-01-13T18:14:12.759046+0000","last_became_active":"2024-01-13T18:06:36.708500+0000","last_became_peered":"2024-01-13T18:06:36.708500+0000","last_unstale":"2024-01-13T18:14:12.759046+0000","last_undegraded":"2024-01-13T18:14:12.759046+0000","last_fullsized":"2024-01-13T18:14:12.759046+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:03:02.399212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":832,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.773799+0000","last_change":"2024-01-13T18:06:36.703571+0000","last_active":"2024-01-13T18:14:13.773799+0000","last_peered":"2024-01-13T18:14:13.773799+0000","last_clean":"2024-01-13T18:14:13.773799+0000","last_became_active":"2024-01-13T18:06:36.703264+0000","last_became_peered":"2024-01-13T18:06:36.703264+0000","last_unstale":"2024-01-13T18:14:13.773799+0000","last_undegraded":"2024-01-13T18:14:13.773799+0000","last_fullsized":"2024-01-13T18:14:13.773799+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:17:25.903754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"865'1079","reported_seq":3609,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.846345+0000","last_change":"2024-01-13T18:14:13.846864+0000","last_active":"2024-01-13T18:14:13.846345+0000","last_peered":"2024-01-13T18:14:13.846345+0000","last_clean":"2024-01-13T18:14:13.846345+0000","last_became_active":"2024-01-13T18:06:08.627428+0000","last_became_peered":"2024-01-13T18:06:08.627428+0000","last_unstale":"2024-01-13T18:14:13.846345+0000","last_undegraded":"2024-01-13T18:14:13.846345+0000","last_fullsized":"2024-01-13T18:14:13.846345+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:47:06.357743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020396102999999999,"stat_sum":{"num_bytes":26959872,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":249,"num_read_kb":443606,"num_write":503,"num_write_kb":115712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":38600704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":824,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.784565+0000","last_change":"2024-01-13T18:06:08.627738+0000","last_active":"2024-01-13T18:14:10.784565+0000","last_peered":"2024-01-13T18:14:10.784565+0000","last_clean":"2024-01-13T18:14:10.784565+0000","last_became_active":"2024-01-13T18:06:08.627110+0000","last_became_peered":"2024-01-13T18:06:08.627110+0000","last_unstale":"2024-01-13T18:14:10.784565+0000","last_undegraded":"2024-01-13T18:14:10.784565+0000","last_fullsized":"2024-01-13T18:14:10.784565+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:13:50.087880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":841,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.758600+0000","last_change":"2024-01-13T18:06:36.689336+0000","last_active":"2024-01-13T18:14:12.758600+0000","last_peered":"2024-01-13T18:14:12.758600+0000","last_clean":"2024-01-13T18:14:12.758600+0000","last_became_active":"2024-01-13T18:06:36.689063+0000","last_became_peered":"2024-01-13T18:06:36.689063+0000","last_unstale":"2024-01-13T18:14:12.758600+0000","last_undegraded":"2024-01-13T18:14:12.758600+0000","last_fullsized":"2024-01-13T18:14:12.758600+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:23:07.449935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":835,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769221+0000","last_change":"2024-01-13T18:05:11.635312+0000","last_active":"2024-01-13T18:14:12.769221+0000","last_peered":"2024-01-13T18:14:12.769221+0000","last_clean":"2024-01-13T18:14:12.769221+0000","last_became_active":"2024-01-13T18:05:11.635028+0000","last_became_peered":"2024-01-13T18:05:11.635028+0000","last_unstale":"2024-01-13T18:14:12.769221+0000","last_undegraded":"2024-01-13T18:14:12.769221+0000","last_fullsized":"2024-01-13T18:14:12.769221+0000","mapping_epoch":330,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:41:50.623570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":2494,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.780319+0000","last_change":"2024-01-13T18:14:13.780578+0000","last_active":"2024-01-13T18:14:13.780319+0000","last_peered":"2024-01-13T18:14:13.780319+0000","last_clean":"2024-01-13T18:14:13.780319+0000","last_became_active":"2024-01-13T18:07:04.684347+0000","last_became_peered":"2024-01-13T18:07:04.684347+0000","last_unstale":"2024-01-13T18:14:13.780319+0000","last_undegraded":"2024-01-13T18:14:13.780319+0000","last_fullsized":"2024-01-13T18:14:13.780319+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T19:12:58.621862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045292900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"4.5","version":"0'0","reported_seq":827,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770440+0000","last_change":"2024-01-13T18:07:04.687428+0000","last_active":"2024-01-13T18:14:12.770440+0000","last_peered":"2024-01-13T18:14:12.770440+0000","last_clean":"2024-01-13T18:14:12.770440+0000","last_became_active":"2024-01-13T18:07:04.687135+0000","last_became_peered":"2024-01-13T18:07:04.687135+0000","last_unstale":"2024-01-13T18:14:12.770440+0000","last_undegraded":"2024-01-13T18:14:12.770440+0000","last_fullsized":"2024-01-13T18:14:12.770440+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:50:04.302717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":831,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759076+0000","last_change":"2024-01-13T18:06:36.690782+0000","last_active":"2024-01-13T18:14:12.759076+0000","last_peered":"2024-01-13T18:14:12.759076+0000","last_clean":"2024-01-13T18:14:12.759076+0000","last_became_active":"2024-01-13T18:06:36.690484+0000","last_became_peered":"2024-01-13T18:06:36.690484+0000","last_unstale":"2024-01-13T18:14:12.759076+0000","last_undegraded":"2024-01-13T18:14:12.759076+0000","last_fullsized":"2024-01-13T18:14:12.759076+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:07:44.139121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":805,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759304+0000","last_change":"2024-01-13T18:07:04.685460+0000","last_active":"2024-01-13T18:14:12.759304+0000","last_peered":"2024-01-13T18:14:12.759304+0000","last_clean":"2024-01-13T18:14:12.759304+0000","last_became_active":"2024-01-13T18:07:04.685131+0000","last_became_peered":"2024-01-13T18:07:04.685131+0000","last_unstale":"2024-01-13T18:14:12.759304+0000","last_undegraded":"2024-01-13T18:14:12.759304+0000","last_fullsized":"2024-01-13T18:14:12.759304+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:13:27.530315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"199'197","reported_seq":1325,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.774333+0000","last_change":"2024-01-13T18:07:04.685013+0000","last_active":"2024-01-13T18:14:12.774333+0000","last_peered":"2024-01-13T18:14:12.774333+0000","last_clean":"2024-01-13T18:14:12.774333+0000","last_became_active":"2024-01-13T18:07:04.682737+0000","last_became_peered":"2024-01-13T18:07:04.682737+0000","last_unstale":"2024-01-13T18:14:12.774333+0000","last_undegraded":"2024-01-13T18:14:12.774333+0000","last_fullsized":"2024-01-13T18:14:12.774333+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:56:59.530229+0000","last_clean_scrub_stamp":"2024-01-13T17:56:59.530229+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:03:05.677430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'697","reported_seq":3243,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.777354+0000","last_change":"2024-01-13T18:14:13.778409+0000","last_active":"2024-01-13T18:14:13.777354+0000","last_peered":"2024-01-13T18:14:13.777354+0000","last_clean":"2024-01-13T18:14:13.777354+0000","last_became_active":"2024-01-13T18:06:08.628894+0000","last_became_peered":"2024-01-13T18:06:08.628894+0000","last_unstale":"2024-01-13T18:14:13.777354+0000","last_undegraded":"2024-01-13T18:14:13.777354+0000","last_fullsized":"2024-01-13T18:14:13.777354+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:21:56.550259+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0075920550000000003,"stat_sum":{"num_bytes":14434304,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":239973,"num_write":278,"num_write_kb":72008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2031616,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":823,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770724+0000","last_change":"2024-01-13T18:04:43.611579+0000","last_active":"2024-01-13T18:14:12.770724+0000","last_peered":"2024-01-13T18:14:12.770724+0000","last_clean":"2024-01-13T18:14:12.770724+0000","last_became_active":"2024-01-13T18:04:43.611259+0000","last_became_peered":"2024-01-13T18:04:43.611259+0000","last_unstale":"2024-01-13T18:14:12.770724+0000","last_undegraded":"2024-01-13T18:14:12.770724+0000","last_fullsized":"2024-01-13T18:14:12.770724+0000","mapping_epoch":303,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":304,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:29:40.451970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":824,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769240+0000","last_change":"2024-01-13T18:05:39.636828+0000","last_active":"2024-01-13T18:14:12.769240+0000","last_peered":"2024-01-13T18:14:12.769240+0000","last_clean":"2024-01-13T18:14:12.769240+0000","last_became_active":"2024-01-13T18:05:39.636062+0000","last_became_peered":"2024-01-13T18:05:39.636062+0000","last_unstale":"2024-01-13T18:14:12.769240+0000","last_undegraded":"2024-01-13T18:14:12.769240+0000","last_fullsized":"2024-01-13T18:14:12.769240+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:37:08.711295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":804,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.774211+0000","last_change":"2024-01-13T18:07:04.675073+0000","last_active":"2024-01-13T18:14:12.774211+0000","last_peered":"2024-01-13T18:14:12.774211+0000","last_clean":"2024-01-13T18:14:12.774211+0000","last_became_active":"2024-01-13T18:07:04.674588+0000","last_became_peered":"2024-01-13T18:07:04.674588+0000","last_unstale":"2024-01-13T18:14:12.774211+0000","last_undegraded":"2024-01-13T18:14:12.774211+0000","last_fullsized":"2024-01-13T18:14:12.774211+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:44:25.619759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"865'1833","reported_seq":4364,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.830725+0000","last_change":"2024-01-13T18:14:13.789274+0000","last_active":"2024-01-13T18:14:13.830725+0000","last_peered":"2024-01-13T18:14:13.830725+0000","last_clean":"2024-01-13T18:14:13.830725+0000","last_became_active":"2024-01-13T18:06:36.700440+0000","last_became_peered":"2024-01-13T18:06:36.700440+0000","last_unstale":"2024-01-13T18:14:13.830725+0000","last_undegraded":"2024-01-13T18:14:13.830725+0000","last_fullsized":"2024-01-13T18:14:13.830725+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":1833,"log_dups_size":0,"ondisk_log_size":1833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T06:00:01.286097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021035394999999998,"stat_sum":{"num_bytes":45047808,"num_objects":19,"num_object_clones":14,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":458,"num_read_kb":908631,"num_write":767,"num_write_kb":202296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":28860416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":824,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.771221+0000","last_change":"2024-01-13T18:07:04.678226+0000","last_active":"2024-01-13T18:14:12.771221+0000","last_peered":"2024-01-13T18:14:12.771221+0000","last_clean":"2024-01-13T18:14:12.771221+0000","last_became_active":"2024-01-13T18:07:04.677728+0000","last_became_peered":"2024-01-13T18:07:04.677728+0000","last_unstale":"2024-01-13T18:14:12.771221+0000","last_undegraded":"2024-01-13T18:14:12.771221+0000","last_fullsized":"2024-01-13T18:14:12.771221+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:27:27.640119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":805,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.776307+0000","last_change":"2024-01-13T18:07:04.685988+0000","last_active":"2024-01-13T18:14:12.776307+0000","last_peered":"2024-01-13T18:14:12.776307+0000","last_clean":"2024-01-13T18:14:12.776307+0000","last_became_active":"2024-01-13T18:07:04.682568+0000","last_became_peered":"2024-01-13T18:07:04.682568+0000","last_unstale":"2024-01-13T18:14:12.776307+0000","last_undegraded":"2024-01-13T18:14:12.776307+0000","last_fullsized":"2024-01-13T18:14:12.776307+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:44:07.843833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":840,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.785796+0000","last_change":"2024-01-13T18:06:08.625082+0000","last_active":"2024-01-13T18:14:10.785796+0000","last_peered":"2024-01-13T18:14:10.785796+0000","last_clean":"2024-01-13T18:14:10.785796+0000","last_became_active":"2024-01-13T18:06:08.624718+0000","last_became_peered":"2024-01-13T18:06:08.624718+0000","last_unstale":"2024-01-13T18:14:10.785796+0000","last_undegraded":"2024-01-13T18:14:10.785796+0000","last_fullsized":"2024-01-13T18:14:10.785796+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:46:45.725843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"865'2067","reported_seq":4472,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-01-13T18:14:17.759097+0000","last_change":"2024-01-13T18:14:13.793297+0000","last_active":"2024-01-13T18:14:17.759097+0000","last_peered":"2024-01-13T18:14:17.759097+0000","last_clean":"2024-01-13T18:14:17.759097+0000","last_became_active":"2024-01-13T18:07:04.678023+0000","last_became_peered":"2024-01-13T18:07:04.678023+0000","last_unstale":"2024-01-13T18:14:17.759097+0000","last_undegraded":"2024-01-13T18:14:17.759097+0000","last_fullsized":"2024-01-13T18:14:17.759097+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:11:58.679511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018198807000000001,"stat_sum":{"num_bytes":46948352,"num_objects":19,"num_object_clones":14,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":332,"num_read_kb":514236,"num_write":963,"num_write_kb":213344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":55058432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2b2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":815,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.757859+0000","last_change":"2024-01-13T18:07:04.674197+0000","last_active":"2024-01-13T18:14:12.757859+0000","last_peered":"2024-01-13T18:14:12.757859+0000","last_clean":"2024-01-13T18:14:12.757859+0000","last_became_active":"2024-01-13T18:07:04.673834+0000","last_became_peered":"2024-01-13T18:07:04.673834+0000","last_unstale":"2024-01-13T18:14:12.757859+0000","last_undegraded":"2024-01-13T18:14:12.757859+0000","last_fullsized":"2024-01-13T18:14:12.757859+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:40:13.164029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"466'2","reported_seq":845,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.784250+0000","last_change":"2024-01-13T18:06:36.690212+0000","last_active":"2024-01-13T18:14:10.784250+0000","last_peered":"2024-01-13T18:14:10.784250+0000","last_clean":"2024-01-13T18:14:10.784250+0000","last_became_active":"2024-01-13T18:06:36.689580+0000","last_became_peered":"2024-01-13T18:06:36.689580+0000","last_unstale":"2024-01-13T18:14:10.784250+0000","last_undegraded":"2024-01-13T18:14:10.784250+0000","last_fullsized":"2024-01-13T18:14:10.784250+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:31:32.989170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":818,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.758045+0000","last_change":"2024-01-13T18:07:04.673453+0000","last_active":"2024-01-13T18:14:12.758045+0000","last_peered":"2024-01-13T18:14:12.758045+0000","last_clean":"2024-01-13T18:14:12.758045+0000","last_became_active":"2024-01-13T18:07:04.673052+0000","last_became_peered":"2024-01-13T18:07:04.673052+0000","last_unstale":"2024-01-13T18:14:12.758045+0000","last_undegraded":"2024-01-13T18:14:12.758045+0000","last_fullsized":"2024-01-13T18:14:12.758045+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:55:19.269046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"865'1401","reported_seq":3944,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.792492+0000","last_change":"2024-01-13T18:14:13.793711+0000","last_active":"2024-01-13T18:14:13.792492+0000","last_peered":"2024-01-13T18:14:13.792492+0000","last_clean":"2024-01-13T18:14:13.792492+0000","last_became_active":"2024-01-13T18:05:39.629861+0000","last_became_peered":"2024-01-13T18:05:39.629861+0000","last_unstale":"2024-01-13T18:14:13.792492+0000","last_undegraded":"2024-01-13T18:14:13.792492+0000","last_fullsized":"2024-01-13T18:14:13.792492+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":1401,"log_dups_size":0,"ondisk_log_size":1401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:59:56.083841+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.015326111,"stat_sum":{"num_bytes":35028992,"num_objects":14,"num_object_clones":10,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":323,"num_read_kb":588606,"num_write":650,"num_write_kb":149448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":10362880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":844,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.774772+0000","last_change":"2024-01-13T18:06:36.695634+0000","last_active":"2024-01-13T18:14:13.774772+0000","last_peered":"2024-01-13T18:14:13.774772+0000","last_clean":"2024-01-13T18:14:13.774772+0000","last_became_active":"2024-01-13T18:06:36.695350+0000","last_became_peered":"2024-01-13T18:06:36.695350+0000","last_unstale":"2024-01-13T18:14:13.774772+0000","last_undegraded":"2024-01-13T18:14:13.774772+0000","last_fullsized":"2024-01-13T18:14:13.774772+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:59:04.346729+0000","last_clean_scrub_stamp":"2024-01-13T17:59:04.346729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:43:45.111271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"59'2","reported_seq":822,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769978+0000","last_change":"2024-01-13T18:07:04.678499+0000","last_active":"2024-01-13T18:14:12.769978+0000","last_peered":"2024-01-13T18:14:12.769978+0000","last_clean":"2024-01-13T18:14:12.769978+0000","last_became_active":"2024-01-13T18:07:04.678192+0000","last_became_peered":"2024-01-13T18:07:04.678192+0000","last_unstale":"2024-01-13T18:14:12.769978+0000","last_undegraded":"2024-01-13T18:14:12.769978+0000","last_fullsized":"2024-01-13T18:14:12.769978+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T04:17:31.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":823,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770577+0000","last_change":"2024-01-13T18:05:39.635685+0000","last_active":"2024-01-13T18:14:12.770577+0000","last_peered":"2024-01-13T18:14:12.770577+0000","last_clean":"2024-01-13T18:14:12.770577+0000","last_became_active":"2024-01-13T18:05:39.635346+0000","last_became_peered":"2024-01-13T18:05:39.635346+0000","last_unstale":"2024-01-13T18:14:12.770577+0000","last_undegraded":"2024-01-13T18:14:12.770577+0000","last_fullsized":"2024-01-13T18:14:12.770577+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:00:00.350357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"865'2091","reported_seq":4572,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.791568+0000","last_change":"2024-01-13T18:14:13.793073+0000","last_active":"2024-01-13T18:14:13.791568+0000","last_peered":"2024-01-13T18:14:13.791568+0000","last_clean":"2024-01-13T18:14:13.791568+0000","last_became_active":"2024-01-13T18:06:36.707079+0000","last_became_peered":"2024-01-13T18:06:36.707079+0000","last_unstale":"2024-01-13T18:14:13.791568+0000","last_undegraded":"2024-01-13T18:14:13.791568+0000","last_fullsized":"2024-01-13T18:14:13.791568+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":2091,"log_dups_size":0,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:27:33.830871+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.022023777000000001,"stat_sum":{"num_bytes":59457536,"num_objects":17,"num_object_clones":12,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":468,"num_read_kb":805021,"num_write":799,"num_write_kb":239360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":12460032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":804,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.774685+0000","last_change":"2024-01-13T18:07:04.676037+0000","last_active":"2024-01-13T18:14:12.774685+0000","last_peered":"2024-01-13T18:14:12.774685+0000","last_clean":"2024-01-13T18:14:12.774685+0000","last_became_active":"2024-01-13T18:07:04.675753+0000","last_became_peered":"2024-01-13T18:07:04.675753+0000","last_unstale":"2024-01-13T18:14:12.774685+0000","last_undegraded":"2024-01-13T18:14:12.774685+0000","last_fullsized":"2024-01-13T18:14:12.774685+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:08:46.303155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":846,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-01-13T18:14:17.758611+0000","last_change":"2024-01-13T18:07:04.679014+0000","last_active":"2024-01-13T18:14:17.758611+0000","last_peered":"2024-01-13T18:14:17.758611+0000","last_clean":"2024-01-13T18:14:17.758611+0000","last_became_active":"2024-01-13T18:07:04.677458+0000","last_became_peered":"2024-01-13T18:07:04.677458+0000","last_unstale":"2024-01-13T18:14:17.758611+0000","last_undegraded":"2024-01-13T18:14:17.758611+0000","last_fullsized":"2024-01-13T18:14:17.758611+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:40:41.930165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"865'1532","reported_seq":4019,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-01-13T18:14:17.759344+0000","last_change":"2024-01-13T18:14:13.791052+0000","last_active":"2024-01-13T18:14:17.759344+0000","last_peered":"2024-01-13T18:14:17.759344+0000","last_clean":"2024-01-13T18:14:17.759344+0000","last_became_active":"2024-01-13T18:06:08.624662+0000","last_became_peered":"2024-01-13T18:06:08.624662+0000","last_unstale":"2024-01-13T18:14:17.759344+0000","last_undegraded":"2024-01-13T18:14:17.759344+0000","last_fullsized":"2024-01-13T18:14:17.759344+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":1532,"log_dups_size":0,"ondisk_log_size":1532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:00:49.291210+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.016798232,"stat_sum":{"num_bytes":22462464,"num_objects":15,"num_object_clones":11,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":324,"num_read_kb":520145,"num_write":692,"num_write_kb":125392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":2850816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2b2","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":840,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.783677+0000","last_change":"2024-01-13T18:07:04.677722+0000","last_active":"2024-01-13T18:14:10.783677+0000","last_peered":"2024-01-13T18:14:10.783677+0000","last_clean":"2024-01-13T18:14:10.783677+0000","last_became_active":"2024-01-13T18:07:04.677429+0000","last_became_peered":"2024-01-13T18:07:04.677429+0000","last_unstale":"2024-01-13T18:14:10.783677+0000","last_undegraded":"2024-01-13T18:14:10.783677+0000","last_fullsized":"2024-01-13T18:14:10.783677+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T02:29:33.323861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":844,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.757940+0000","last_change":"2024-01-13T18:07:04.678780+0000","last_active":"2024-01-13T18:14:12.757940+0000","last_peered":"2024-01-13T18:14:12.757940+0000","last_clean":"2024-01-13T18:14:12.757940+0000","last_became_active":"2024-01-13T18:07:04.678469+0000","last_became_peered":"2024-01-13T18:07:04.678469+0000","last_unstale":"2024-01-13T18:14:12.757940+0000","last_undegraded":"2024-01-13T18:14:12.757940+0000","last_fullsized":"2024-01-13T18:14:12.757940+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:58:40.222637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"865'389","reported_seq":2939,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.841464+0000","last_change":"2024-01-13T18:14:13.841927+0000","last_active":"2024-01-13T18:14:13.841464+0000","last_peered":"2024-01-13T18:14:13.841464+0000","last_clean":"2024-01-13T18:14:13.841464+0000","last_became_active":"2024-01-13T18:07:04.683100+0000","last_became_peered":"2024-01-13T18:07:04.683100+0000","last_unstale":"2024-01-13T18:14:13.841464+0000","last_undegraded":"2024-01-13T18:14:13.841464+0000","last_fullsized":"2024-01-13T18:14:13.841464+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:22:11.299663+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.016328466999999999,"stat_sum":{"num_bytes":3194880,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":122555,"num_write":142,"num_write_kb":43232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":840,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.783549+0000","last_change":"2024-01-13T18:07:04.674304+0000","last_active":"2024-01-13T18:14:10.783549+0000","last_peered":"2024-01-13T18:14:10.783549+0000","last_clean":"2024-01-13T18:14:10.783549+0000","last_became_active":"2024-01-13T18:07:04.674010+0000","last_became_peered":"2024-01-13T18:07:04.674010+0000","last_unstale":"2024-01-13T18:14:10.783549+0000","last_undegraded":"2024-01-13T18:14:10.783549+0000","last_fullsized":"2024-01-13T18:14:10.783549+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:26:52.552352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":818,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759213+0000","last_change":"2024-01-13T18:05:39.633610+0000","last_active":"2024-01-13T18:14:12.759213+0000","last_peered":"2024-01-13T18:14:12.759213+0000","last_clean":"2024-01-13T18:14:12.759213+0000","last_became_active":"2024-01-13T18:05:39.632724+0000","last_became_peered":"2024-01-13T18:05:39.632724+0000","last_unstale":"2024-01-13T18:14:12.759213+0000","last_undegraded":"2024-01-13T18:14:12.759213+0000","last_fullsized":"2024-01-13T18:14:12.759213+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:31:10.418458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'858","reported_seq":3399,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759703+0000","last_change":"2024-01-13T18:14:10.801205+0000","last_active":"2024-01-13T18:14:12.759703+0000","last_peered":"2024-01-13T18:14:12.759703+0000","last_clean":"2024-01-13T18:14:12.759703+0000","last_became_active":"2024-01-13T18:05:39.639559+0000","last_became_peered":"2024-01-13T18:05:39.639559+0000","last_unstale":"2024-01-13T18:14:12.759703+0000","last_undegraded":"2024-01-13T18:14:12.759703+0000","last_fullsized":"2024-01-13T18:14:12.759703+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:06:58.015658+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.015582711000000001,"stat_sum":{"num_bytes":37634048,"num_objects":9,"num_object_clones":7,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":205,"num_read_kb":469062,"num_write":341,"num_write_kb":119960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2285568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"2.b","version":"459'3","reported_seq":838,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.775088+0000","last_change":"2024-01-13T18:07:04.685921+0000","last_active":"2024-01-13T18:14:12.775088+0000","last_peered":"2024-01-13T18:14:12.775088+0000","last_clean":"2024-01-13T18:14:12.775088+0000","last_became_active":"2024-01-13T18:07:04.685203+0000","last_became_peered":"2024-01-13T18:07:04.685203+0000","last_unstale":"2024-01-13T18:14:12.775088+0000","last_undegraded":"2024-01-13T18:14:12.775088+0000","last_fullsized":"2024-01-13T18:14:12.775088+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:49:17.194896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":832,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769896+0000","last_change":"2024-01-13T18:06:36.691496+0000","last_active":"2024-01-13T18:14:12.769896+0000","last_peered":"2024-01-13T18:14:12.769896+0000","last_clean":"2024-01-13T18:14:12.769896+0000","last_became_active":"2024-01-13T18:06:36.691205+0000","last_became_peered":"2024-01-13T18:06:36.691205+0000","last_unstale":"2024-01-13T18:14:12.769896+0000","last_undegraded":"2024-01-13T18:14:12.769896+0000","last_fullsized":"2024-01-13T18:14:12.769896+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:05:27.348889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"865'1214","reported_seq":3709,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.839047+0000","last_change":"2024-01-13T18:14:13.839989+0000","last_active":"2024-01-13T18:14:13.839047+0000","last_peered":"2024-01-13T18:14:13.839047+0000","last_clean":"2024-01-13T18:14:13.839047+0000","last_became_active":"2024-01-13T18:06:08.627095+0000","last_became_peered":"2024-01-13T18:06:08.627095+0000","last_unstale":"2024-01-13T18:14:13.839047+0000","last_undegraded":"2024-01-13T18:14:13.839047+0000","last_fullsized":"2024-01-13T18:14:13.839047+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:12:04.260194+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.015316316,"stat_sum":{"num_bytes":30089216,"num_objects":10,"num_object_clones":7,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":246,"num_read_kb":429345,"num_write":606,"num_write_kb":152192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":12247040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":835,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.768948+0000","last_change":"2024-01-13T18:06:08.629194+0000","last_active":"2024-01-13T18:14:12.768948+0000","last_peered":"2024-01-13T18:14:12.768948+0000","last_clean":"2024-01-13T18:14:12.768948+0000","last_became_active":"2024-01-13T18:06:08.628957+0000","last_became_peered":"2024-01-13T18:06:08.628957+0000","last_unstale":"2024-01-13T18:14:12.768948+0000","last_undegraded":"2024-01-13T18:14:12.768948+0000","last_fullsized":"2024-01-13T18:14:12.768948+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:20:06.592304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":819,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.776307+0000","last_change":"2024-01-13T18:07:04.683257+0000","last_active":"2024-01-13T18:14:12.776307+0000","last_peered":"2024-01-13T18:14:12.776307+0000","last_clean":"2024-01-13T18:14:12.776307+0000","last_became_active":"2024-01-13T18:07:04.682153+0000","last_became_peered":"2024-01-13T18:07:04.682153+0000","last_unstale":"2024-01-13T18:14:12.776307+0000","last_undegraded":"2024-01-13T18:14:12.776307+0000","last_fullsized":"2024-01-13T18:14:12.776307+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:47:56.157798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"865'1504","reported_seq":3972,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.840787+0000","last_change":"2024-01-13T18:14:13.841858+0000","last_active":"2024-01-13T18:14:13.840787+0000","last_peered":"2024-01-13T18:14:13.840787+0000","last_clean":"2024-01-13T18:14:13.840787+0000","last_became_active":"2024-01-13T18:05:39.642403+0000","last_became_peered":"2024-01-13T18:05:39.642403+0000","last_unstale":"2024-01-13T18:14:13.840787+0000","last_undegraded":"2024-01-13T18:14:13.840787+0000","last_fullsized":"2024-01-13T18:14:13.840787+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:59:59.512981+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.016380039999999998,"stat_sum":{"num_bytes":37306368,"num_objects":18,"num_object_clones":14,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":247,"num_read_kb":351083,"num_write":684,"num_write_kb":134872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":36167680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"2.d","version":"59'1","reported_seq":843,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.784190+0000","last_change":"2024-01-13T18:05:39.644321+0000","last_active":"2024-01-13T18:14:10.784190+0000","last_peered":"2024-01-13T18:14:10.784190+0000","last_clean":"2024-01-13T18:14:10.784190+0000","last_became_active":"2024-01-13T18:05:39.643931+0000","last_became_peered":"2024-01-13T18:05:39.643931+0000","last_unstale":"2024-01-13T18:14:10.784190+0000","last_undegraded":"2024-01-13T18:14:10.784190+0000","last_fullsized":"2024-01-13T18:14:10.784190+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T22:29:16.366949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":831,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759343+0000","last_change":"2024-01-13T18:06:36.702889+0000","last_active":"2024-01-13T18:14:12.759343+0000","last_peered":"2024-01-13T18:14:12.759343+0000","last_clean":"2024-01-13T18:14:12.759343+0000","last_became_active":"2024-01-13T18:06:36.702544+0000","last_became_peered":"2024-01-13T18:06:36.702544+0000","last_unstale":"2024-01-13T18:14:12.759343+0000","last_undegraded":"2024-01-13T18:14:12.759343+0000","last_fullsized":"2024-01-13T18:14:12.759343+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:39:39.165562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":2494,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-01-13T18:14:13.781183+0000","last_change":"2024-01-13T18:14:13.782302+0000","last_active":"2024-01-13T18:14:13.781183+0000","last_peered":"2024-01-13T18:14:13.781183+0000","last_clean":"2024-01-13T18:14:13.781183+0000","last_became_active":"2024-01-13T18:07:04.683033+0000","last_became_peered":"2024-01-13T18:07:04.683033+0000","last_unstale":"2024-01-13T18:14:13.781183+0000","last_undegraded":"2024-01-13T18:14:13.781183+0000","last_fullsized":"2024-01-13T18:14:13.781183+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T18:00:42.377365+0000","last_clean_scrub_stamp":"2024-01-13T18:00:42.377365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:32:51.356639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012286109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2b2","length":"1"},{"start":"2f7","length":"1"},{"start":"30b","length":"1"}]},{"pgid":"2.e","version":"59'2","reported_seq":831,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769773+0000","last_change":"2024-01-13T18:05:39.641405+0000","last_active":"2024-01-13T18:14:12.769773+0000","last_peered":"2024-01-13T18:14:12.769773+0000","last_clean":"2024-01-13T18:14:12.769773+0000","last_became_active":"2024-01-13T18:05:39.640893+0000","last_became_peered":"2024-01-13T18:05:39.640893+0000","last_unstale":"2024-01-13T18:14:12.769773+0000","last_undegraded":"2024-01-13T18:14:12.769773+0000","last_fullsized":"2024-01-13T18:14:12.769773+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:35.811841+0000","last_clean_scrub_stamp":"2024-01-13T17:58:35.811841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:48:18.529834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":804,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.775706+0000","last_change":"2024-01-13T18:07:04.684101+0000","last_active":"2024-01-13T18:14:12.775706+0000","last_peered":"2024-01-13T18:14:12.775706+0000","last_clean":"2024-01-13T18:14:12.775706+0000","last_became_active":"2024-01-13T18:07:04.683545+0000","last_became_peered":"2024-01-13T18:07:04.683545+0000","last_unstale":"2024-01-13T18:14:12.775706+0000","last_undegraded":"2024-01-13T18:14:12.775706+0000","last_fullsized":"2024-01-13T18:14:12.775706+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:30:16.558895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":819,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769500+0000","last_change":"2024-01-13T18:06:36.697643+0000","last_active":"2024-01-13T18:14:12.769500+0000","last_peered":"2024-01-13T18:14:12.769500+0000","last_clean":"2024-01-13T18:14:12.769500+0000","last_became_active":"2024-01-13T18:06:36.697080+0000","last_became_peered":"2024-01-13T18:06:36.697080+0000","last_unstale":"2024-01-13T18:14:12.769500+0000","last_undegraded":"2024-01-13T18:14:12.769500+0000","last_fullsized":"2024-01-13T18:14:12.769500+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T00:36:21.383966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":806,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769143+0000","last_change":"2024-01-13T18:06:36.688558+0000","last_active":"2024-01-13T18:14:12.769143+0000","last_peered":"2024-01-13T18:14:12.769143+0000","last_clean":"2024-01-13T18:14:12.769143+0000","last_became_active":"2024-01-13T18:06:36.688250+0000","last_became_peered":"2024-01-13T18:06:36.688250+0000","last_unstale":"2024-01-13T18:14:12.769143+0000","last_undegraded":"2024-01-13T18:14:12.769143+0000","last_fullsized":"2024-01-13T18:14:12.769143+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T23:13:50.750326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":833,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759274+0000","last_change":"2024-01-13T18:06:08.625378+0000","last_active":"2024-01-13T18:14:12.759274+0000","last_peered":"2024-01-13T18:14:12.759274+0000","last_clean":"2024-01-13T18:14:12.759274+0000","last_became_active":"2024-01-13T18:06:08.624037+0000","last_became_peered":"2024-01-13T18:06:08.624037+0000","last_unstale":"2024-01-13T18:14:12.759274+0000","last_undegraded":"2024-01-13T18:14:12.759274+0000","last_fullsized":"2024-01-13T18:14:12.759274+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:19:13.484195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":814,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769492+0000","last_change":"2024-01-13T18:05:11.636127+0000","last_active":"2024-01-13T18:14:12.769492+0000","last_peered":"2024-01-13T18:14:12.769492+0000","last_clean":"2024-01-13T18:14:12.769492+0000","last_became_active":"2024-01-13T18:05:11.635870+0000","last_became_peered":"2024-01-13T18:05:11.635870+0000","last_unstale":"2024-01-13T18:14:12.769492+0000","last_undegraded":"2024-01-13T18:14:12.769492+0000","last_fullsized":"2024-01-13T18:14:12.769492+0000","mapping_epoch":330,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T20:51:29.742515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":818,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.758462+0000","last_change":"2024-01-13T18:05:39.632439+0000","last_active":"2024-01-13T18:14:12.758462+0000","last_peered":"2024-01-13T18:14:12.758462+0000","last_clean":"2024-01-13T18:14:12.758462+0000","last_became_active":"2024-01-13T18:05:39.632125+0000","last_became_peered":"2024-01-13T18:05:39.632125+0000","last_unstale":"2024-01-13T18:14:12.758462+0000","last_undegraded":"2024-01-13T18:14:12.758462+0000","last_fullsized":"2024-01-13T18:14:12.758462+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T18:59:57.120917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":840,"reported_epoch":863,"state":"active+clean","last_fresh":"2024-01-13T18:14:10.784346+0000","last_change":"2024-01-13T18:05:11.632093+0000","last_active":"2024-01-13T18:14:10.784346+0000","last_peered":"2024-01-13T18:14:10.784346+0000","last_clean":"2024-01-13T18:14:10.784346+0000","last_became_active":"2024-01-13T18:05:11.631790+0000","last_became_peered":"2024-01-13T18:05:11.631790+0000","last_unstale":"2024-01-13T18:14:10.784346+0000","last_undegraded":"2024-01-13T18:14:10.784346+0000","last_fullsized":"2024-01-13T18:14:10.784346+0000","mapping_epoch":330,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:13:20.293373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":830,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770290+0000","last_change":"2024-01-13T18:07:04.680075+0000","last_active":"2024-01-13T18:14:12.770290+0000","last_peered":"2024-01-13T18:14:12.770290+0000","last_clean":"2024-01-13T18:14:12.770290+0000","last_became_active":"2024-01-13T18:07:04.679813+0000","last_became_peered":"2024-01-13T18:07:04.679813+0000","last_unstale":"2024-01-13T18:14:12.770290+0000","last_undegraded":"2024-01-13T18:14:12.770290+0000","last_fullsized":"2024-01-13T18:14:12.770290+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:29:45.810770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":843,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.758179+0000","last_change":"2024-01-13T18:05:11.642826+0000","last_active":"2024-01-13T18:14:12.758179+0000","last_peered":"2024-01-13T18:14:12.758179+0000","last_clean":"2024-01-13T18:14:12.758179+0000","last_became_active":"2024-01-13T18:05:11.642545+0000","last_became_peered":"2024-01-13T18:05:11.642545+0000","last_unstale":"2024-01-13T18:14:12.758179+0000","last_undegraded":"2024-01-13T18:14:12.758179+0000","last_fullsized":"2024-01-13T18:14:12.758179+0000","mapping_epoch":330,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:41:30.049470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":833,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759056+0000","last_change":"2024-01-13T18:06:08.633157+0000","last_active":"2024-01-13T18:14:12.759056+0000","last_peered":"2024-01-13T18:14:12.759056+0000","last_clean":"2024-01-13T18:14:12.759056+0000","last_became_active":"2024-01-13T18:06:08.632873+0000","last_became_peered":"2024-01-13T18:06:08.632873+0000","last_unstale":"2024-01-13T18:14:12.759056+0000","last_undegraded":"2024-01-13T18:14:12.759056+0000","last_fullsized":"2024-01-13T18:14:12.759056+0000","mapping_epoch":387,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":388,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T03:20:47.684228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":844,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.758142+0000","last_change":"2024-01-13T18:05:39.629951+0000","last_active":"2024-01-13T18:14:12.758142+0000","last_peered":"2024-01-13T18:14:12.758142+0000","last_clean":"2024-01-13T18:14:12.758142+0000","last_became_active":"2024-01-13T18:05:39.629533+0000","last_became_peered":"2024-01-13T18:05:39.629533+0000","last_unstale":"2024-01-13T18:14:12.758142+0000","last_undegraded":"2024-01-13T18:14:12.758142+0000","last_fullsized":"2024-01-13T18:14:12.758142+0000","mapping_epoch":358,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":359,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:50:06.976688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":803,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.759047+0000","last_change":"2024-01-13T18:07:04.686697+0000","last_active":"2024-01-13T18:14:12.759047+0000","last_peered":"2024-01-13T18:14:12.759047+0000","last_clean":"2024-01-13T18:14:12.759047+0000","last_became_active":"2024-01-13T18:07:04.686399+0000","last_became_peered":"2024-01-13T18:07:04.686399+0000","last_unstale":"2024-01-13T18:14:12.759047+0000","last_undegraded":"2024-01-13T18:14:12.759047+0000","last_fullsized":"2024-01-13T18:14:12.759047+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-14T21:11:31.692403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":823,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.770928+0000","last_change":"2024-01-13T18:07:04.678036+0000","last_active":"2024-01-13T18:14:12.770928+0000","last_peered":"2024-01-13T18:14:12.770928+0000","last_clean":"2024-01-13T18:14:12.770928+0000","last_became_active":"2024-01-13T18:07:04.677254+0000","last_became_peered":"2024-01-13T18:07:04.677254+0000","last_unstale":"2024-01-13T18:14:12.770928+0000","last_undegraded":"2024-01-13T18:14:12.770928+0000","last_fullsized":"2024-01-13T18:14:12.770928+0000","mapping_epoch":442,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":443,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T01:45:03.626043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":832,"reported_epoch":864,"state":"active+clean","last_fresh":"2024-01-13T18:14:12.769623+0000","last_change":"2024-01-13T18:06:36.693260+0000","last_active":"2024-01-13T18:14:12.769623+0000","last_peered":"2024-01-13T18:14:12.769623+0000","last_clean":"2024-01-13T18:14:12.769623+0000","last_became_active":"2024-01-13T18:06:36.692992+0000","last_became_peered":"2024-01-13T18:06:36.692992+0000","last_unstale":"2024-01-13T18:14:12.769623+0000","last_undegraded":"2024-01-13T18:14:12.769623+0000","last_fullsized":"2024-01-13T18:14:12.769623+0000","mapping_epoch":415,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":416,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-13T17:58:36.813499+0000","last_clean_scrub_stamp":"2024-01-13T17:58:36.813499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-15T05:10:42.443170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":448372736,"num_objects":181,"num_object_clones":131,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":7,"num_read":3996,"num_read_kb":6585411,"num_write":8362,"num_write_kb":1990488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":317652992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":619339776,"data_stored":1233391616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19544,"ondisk_log_size":19544,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":812,"num_read_kb":1310,"num_write":311,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6574,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":86,"num_write":68,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":82553,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":442,"seq":1898375544920,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":164772,"kb_used_data":37140,"kb_used_omap":37,"kb_used_meta":127578,"kb_avail":93580380,"statfs":{"total":95995035648,"available":95826309120,"internally_reserved":0,"allocated":38031360,"data_stored":46142397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38811,"internal_metadata":130639973},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 18:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53600000000000003,"15min":0.503},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.315},"max":{"1min":0.63900000000000001,"5min":0.76000000000000001,"15min":0.76200000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56200000000000006,"15min":0.53100000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Sat Jan 13 18:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.51900000000000002},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77200000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.52300000000000002},"min":{"1min":0.39600000000000002,"5min":0.30399999999999999,"15min":0.30099999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Jan 13 18:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55600000000000005,"15min":0.52100000000000002},"min":{"1min":0.40400000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57699999999999996,"15min":0.54800000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76400000000000001,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Jan 13 18:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58499999999999996,"15min":0.56499999999999995},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76600000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.70399999999999996}]},{"osd":4,"last update":"Sat Jan 13 18:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.311,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.66500000000000004}]},{"osd":5,"last update":"Sat Jan 13 18:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.50700000000000001},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.34100000000000003},"max":{"1min":0.68400000000000005,"5min":0.78400000000000003,"15min":0.79900000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.50800000000000001},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80800000000000005},"last":0.73399999999999999}]},{"osd":6,"last update":"Sat Jan 13 18:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.41099999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.82199999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.38600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65800000000000003,"5min":0.76400000000000001,"15min":0.84099999999999997},"last":0.71599999999999997}]}]},{"osd":3,"up_from":330,"seq":1417339207790,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":419392,"kb_used_data":90868,"kb_used_omap":84,"kb_used_meta":328427,"kb_avail":93325760,"statfs":{"total":95995035648,"available":95565578240,"internally_reserved":0,"allocated":93048832,"data_stored":179082450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87033,"internal_metadata":336309255},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 18:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.41699999999999998},"min":{"1min":0.255,"5min":0.224,"15min":0.21199999999999999},"max":{"1min":0.51100000000000001,"5min":0.80400000000000005,"15min":1.903},"last":0.378},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.40300000000000002},"min":{"1min":0.27900000000000003,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.60599999999999998,"5min":0.68400000000000005,"15min":1.0680000000000001},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Jan 13 18:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.47499999999999998},"min":{"1min":0.25700000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.48199999999999998,"5min":0.745,"15min":4.2789999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41299999999999998,"15min":0.46200000000000002},"min":{"1min":0.28100000000000003,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.505,"5min":0.69899999999999995,"15min":1.8480000000000001},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Jan 13 18:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.499},"min":{"1min":0.30499999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54800000000000004,"5min":0.63500000000000001,"15min":2.6600000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.45000000000000001,"15min":0.46999999999999997},"min":{"1min":0.314,"5min":0.27000000000000002,"15min":0.25},"max":{"1min":0.57299999999999995,"5min":3.2650000000000001,"15min":3.2650000000000001},"last":0.38900000000000001}]},{"osd":4,"last update":"Sat Jan 13 18:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59299999999999997,"15min":0.56699999999999995},"min":{"1min":0.38200000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.90300000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.39800000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.44900000000000001}]},{"osd":5,"last update":"Sat Jan 13 18:13:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66000000000000003,"15min":0.63500000000000001},"min":{"1min":0.46200000000000002,"5min":0.40400000000000003,"15min":0.377},"max":{"1min":0.89100000000000001,"5min":3.238,"15min":3.238},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.40799999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.7310000000000001},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Jan 13 18:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64500000000000002,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.92600000000000005,"5min":0.94199999999999995,"15min":0.97699999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66300000000000003,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.0249999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Sat Jan 13 18:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66700000000000004,"15min":0.59699999999999998},"min":{"1min":0.48499999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.76800000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67700000000000005,"15min":0.63300000000000001},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93400000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.49399999999999999}]}]},{"osd":4,"up_from":358,"seq":1537598292073,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":648560,"kb_used_data":121952,"kb_used_omap":119,"kb_used_meta":526472,"kb_avail":93096592,"statfs":{"total":95995035648,"available":95330910208,"internally_reserved":0,"allocated":124878848,"data_stored":247265019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":122351,"internal_metadata":539107857},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 18:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.58499999999999996,"15min":0.55400000000000005},"min":{"1min":0.40100000000000002,"5min":0.23699999999999999,"15min":0.19700000000000001},"max":{"1min":2.9700000000000002,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61099999999999999,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.52200000000000002}]},{"osd":1,"last update":"Sat Jan 13 18:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.40899999999999997,"5min":0.33100000000000002,"15min":0.23699999999999999},"max":{"1min":0.70099999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.30099999999999999,"15min":0.25700000000000001},"max":{"1min":0.73899999999999999,"5min":0.752,"15min":0.78500000000000003},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Jan 13 18:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.28699999999999998,"15min":0.27500000000000002},"max":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.32700000000000001,"15min":0.29599999999999999},"max":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.83499999999999996},"last":0.45500000000000002}]},{"osd":3,"last update":"Sat Jan 13 18:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33400000000000002},"max":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.442}]},{"osd":5,"last update":"Sat Jan 13 18:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48399999999999999,"15min":0.495},"min":{"1min":0.32700000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83199999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.443,"5min":0.33700000000000002,"15min":0.29099999999999998},"max":{"1min":0.75600000000000001,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Jan 13 18:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.48699999999999999},"min":{"1min":0.312,"5min":0.30199999999999999,"15min":0.27800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.52300000000000002,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.34599999999999997,"15min":0.316},"max":{"1min":0.76400000000000001,"5min":1.121,"15min":1.121},"last":0.56599999999999995}]},{"osd":7,"last update":"Sat Jan 13 18:13:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55500000000000005,"15min":0.51400000000000001},"min":{"1min":0.38700000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77600000000000002,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56399999999999995,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.35999999999999999,"15min":0.32900000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.60099999999999998}]}]},{"osd":1,"up_from":275,"seq":1181116006521,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":440108,"kb_used_data":89632,"kb_used_omap":63,"kb_used_meta":350400,"kb_avail":93305044,"statfs":{"total":95995035648,"available":95544365056,"internally_reserved":0,"allocated":91783168,"data_stored":155020865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65508,"internal_metadata":358809628},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 18:13:34 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.378,"15min":0.34399999999999997},"min":{"1min":0.217,"5min":0.19800000000000001,"15min":0.188},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.434,"15min":0.51300000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":3.347},"last":0.32600000000000001}]},{"osd":2,"last update":"Sat Jan 13 18:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41599999999999998,"15min":0.44800000000000001},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.64000000000000001,"5min":0.79600000000000004,"15min":10.390000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38600000000000001,"15min":0.36199999999999999},"min":{"1min":0.25600000000000001,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.79000000000000004},"last":0.27400000000000002}]},{"osd":3,"last update":"Sat Jan 13 18:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.41899999999999998},"min":{"1min":0.25,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.57299999999999995,"5min":0.70099999999999996,"15min":2.476},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.23899999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.54700000000000004,"5min":0.65200000000000002,"15min":2.21},"last":0.33600000000000002}]},{"osd":4,"last update":"Sat Jan 13 18:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.38200000000000001},"max":{"1min":0.93799999999999994,"5min":0.95799999999999996,"15min":2.4060000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.36199999999999999},"max":{"1min":0.90500000000000003,"5min":0.94699999999999995,"15min":2.1379999999999999},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Jan 13 18:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.78200000000000003},"min":{"1min":0.46500000000000002,"5min":0.36499999999999999,"15min":0.317},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":6.9859999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66900000000000004,"15min":0.59199999999999997},"min":{"1min":0.47699999999999998,"5min":0.42399999999999999,"15min":0.32600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55900000000000005}]},{"osd":6,"last update":"Sat Jan 13 18:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64200000000000002,"15min":0.60599999999999998},"min":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.35799999999999998},"max":{"1min":0.88,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.498},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63300000000000001,"15min":0.58099999999999996},"min":{"1min":0.41999999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86699999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Jan 13 18:13:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68000000000000005,"15min":0.60299999999999998},"min":{"1min":0.48699999999999999,"5min":0.42499999999999999,"15min":0.35299999999999998},"max":{"1min":0.94899999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.60499999999999998},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.58699999999999997}]}]},{"osd":5,"up_from":387,"seq":1662152343651,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":549844,"kb_used_data":101960,"kb_used_omap":97,"kb_used_meta":447774,"kb_avail":93195308,"statfs":{"total":95995035648,"available":95431995392,"internally_reserved":0,"allocated":104407040,"data_stored":174892681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":100066,"internal_metadata":458520862},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 18:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.27100000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0529999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.435},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.69899999999999995,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":0.35599999999999998}]},{"osd":1,"last update":"Sat Jan 13 18:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.90100000000000002,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.311},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.64600000000000002,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.74299999999999999,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":0.39700000000000002}]},{"osd":2,"last update":"Sat Jan 13 18:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":1.036,"15min":1.2849999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1080000000000001,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Jan 13 18:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95699999999999996,"5min":1.274,"15min":1.274},"last":0.37},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.753,"5min":1.141,"15min":1.321},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Jan 13 18:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45400000000000001,"15min":0.439},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.27500000000000002},"max":{"1min":1.145,"5min":1.482,"15min":1.482},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.47099999999999997},"min":{"1min":0.34300000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.99199999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Sat Jan 13 18:13:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.34399999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.81799999999999995,"5min":1.099,"15min":1.3620000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0269999999999999,"5min":1.224,"15min":1.224},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Jan 13 18:13:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.58399999999999996},"min":{"1min":0.438,"5min":0.38900000000000001,"15min":0.38600000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.499}]}]},{"osd":6,"up_from":415,"seq":1782411427933,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":329224,"kb_used_data":81016,"kb_used_omap":72,"kb_used_meta":248119,"kb_avail":93415928,"statfs":{"total":95995035648,"available":95657910272,"internally_reserved":0,"allocated":82960384,"data_stored":157996542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74048,"internal_metadata":254074560},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 18:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55000000000000004,"15min":0.501},"min":{"1min":0.42499999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76500000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60499999999999998,"15min":0.52800000000000002},"min":{"1min":0.32000000000000001,"5min":0.31,"15min":0.27300000000000002},"max":{"1min":0.76700000000000002,"5min":5.6509999999999998,"15min":5.6509999999999998},"last":0.61299999999999999}]},{"osd":1,"last update":"Sat Jan 13 18:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57599999999999996,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.307},"max":{"1min":0.78700000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.53300000000000003},"min":{"1min":0.45800000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72199999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.34999999999999998}]},{"osd":2,"last update":"Sat Jan 13 18:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57499999999999996,"15min":0.52300000000000002},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":0.77200000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60099999999999998,"15min":0.54700000000000004},"min":{"1min":0.47999999999999998,"5min":0.35499999999999998,"15min":0.34899999999999998},"max":{"1min":0.873,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Jan 13 18:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.751,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63800000000000001,"15min":0.56499999999999995},"min":{"1min":0.47899999999999998,"5min":0.36399999999999999,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":2.903,"15min":2.903},"last":0.41599999999999998}]},{"osd":4,"last update":"Sat Jan 13 18:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.29999999999999999,"5min":0.28699999999999998,"15min":0.24399999999999999},"max":{"1min":0.64400000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.26700000000000002},"max":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.81499999999999995},"last":0.55700000000000005}]},{"osd":5,"last update":"Sat Jan 13 18:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51200000000000001,"15min":0.48499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32400000000000001,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":0.74299999999999999,"15min":0.748},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.34300000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69299999999999995,"5min":0.76200000000000001,"15min":0.79700000000000004},"last":0.56999999999999995}]},{"osd":7,"last update":"Sat Jan 13 18:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54100000000000004,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.443},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59899999999999998,"15min":0.55700000000000005},"min":{"1min":0.434,"5min":0.375,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54400000000000004}]}]},{"osd":0,"up_from":248,"seq":1065151889535,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":727900,"kb_used_data":120076,"kb_used_omap":88,"kb_used_meta":607719,"kb_avail":93017252,"statfs":{"total":95995035648,"available":95249666048,"internally_reserved":0,"allocated":122957824,"data_stored":230100204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":90920,"internal_metadata":622304472},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 13 18:13:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.376,"15min":0.35499999999999998},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.51700000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.376},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.20999999999999999},"max":{"1min":0.58899999999999997,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Jan 13 18:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.36799999999999999},"min":{"1min":0.30299999999999999,"5min":0.23999999999999999,"15min":0.21099999999999999},"max":{"1min":0.58899999999999997,"5min":1.865,"15min":1.865},"last":0.314},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.42299999999999999,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.68100000000000005,"5min":2.1019999999999999,"15min":2.968},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Jan 13 18:13:33 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.44400000000000001,"15min":0.40600000000000003},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55800000000000005,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.374},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.222},"max":{"1min":0.57299999999999995,"5min":2.238,"15min":2.238},"last":0.41199999999999998}]},{"osd":4,"last update":"Sat Jan 13 18:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.627},"min":{"1min":0.48399999999999999,"5min":0.41399999999999998,"15min":0.317},"max":{"1min":1.4390000000000001,"5min":1.849,"15min":1.849},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67200000000000004,"15min":0.626},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.35099999999999998},"max":{"1min":1.258,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.79000000000000004}]},{"osd":5,"last update":"Sat Jan 13 18:13:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.49399999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92700000000000005,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.60899999999999999},"min":{"1min":0.498,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":3.2200000000000002,"15min":3.2200000000000002},"last":0.73999999999999999}]},{"osd":6,"last update":"Sat Jan 13 18:13:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65900000000000003,"15min":0.60099999999999998},"min":{"1min":0.54800000000000004,"5min":0.38700000000000001,"15min":0.36399999999999999},"max":{"1min":0.87,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70199999999999996,"15min":0.61699999999999999},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.41299999999999998},"max":{"1min":1.0960000000000001,"5min":3.29,"15min":3.29},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Jan 13 18:13:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.66800000000000004,"15min":0.59699999999999998},"min":{"1min":0.54400000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.266,"5min":1.946,"15min":1.946},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67600000000000005,"15min":0.61399999999999999},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":0.70499999999999996}]}]},{"osd":2,"up_from":303,"seq":1301375090804,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":320604,"kb_used_data":63248,"kb_used_omap":59,"kb_used_meta":257284,"kb_avail":93424548,"statfs":{"total":95995035648,"available":95666737152,"internally_reserved":0,"allocated":64765952,"data_stored":105436599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60489,"internal_metadata":263459767},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 13 18:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38700000000000001,"15min":0.378},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.95699999999999996,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.39000000000000001,"15min":0.38700000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56999999999999995,"5min":1.653,"15min":1.653},"last":0.311}]},{"osd":1,"last update":"Sat Jan 13 18:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41899999999999998,"15min":0.39500000000000002},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.27600000000000002,"5min":0.218,"15min":0.218},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.29599999999999999}]},{"osd":3,"last update":"Sat Jan 13 18:13:27 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.42399999999999999},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.58299999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.442,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.32500000000000001}]},{"osd":4,"last update":"Sat Jan 13 18:13:52 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.67000000000000004,"15min":0.59799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35299999999999998},"max":{"1min":8.5050000000000008,"5min":8.5050000000000008,"15min":8.5050000000000008},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.38800000000000001,"15min":0.36299999999999999},"max":{"1min":0.86799999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.42899999999999999}]},{"osd":5,"last update":"Sat Jan 13 18:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63900000000000001,"15min":0.60299999999999998},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.376},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63500000000000001,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.39800000000000002,"15min":0.38100000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Sat Jan 13 18:13:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66600000000000004,"15min":0.61599999999999999},"min":{"1min":0.438,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":1.0229999999999999,"5min":1.056,"15min":1.056},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.63500000000000001},"min":{"1min":0.47299999999999998,"5min":0.46999999999999997,"15min":0.372},"max":{"1min":0.93500000000000005,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Jan 13 18:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63300000000000001,"15min":0.57999999999999996},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65900000000000003,"15min":0.59799999999999998},"min":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":1.004,"15min":1.004},"last":0.46200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13813,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6040,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8495,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14194,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15136,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8648,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6915,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":109391872,"data_stored":221868032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":147394560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51912704,"data_stored":97812480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":80244736,"data_stored":171466752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":112156672,"data_stored":239669248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":91799552,"data_stored":167313408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69881856,"data_stored":149848064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25071616,"data_stored":38019072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-13T18:14:19.235 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2024-01-13T18:14:19.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid be08b996-b23c-11ee-95ac-87774f69a715 -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-01-13T18:14:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/mon.a/config 2024-01-13T18:14:19.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:19 smithi084 ceph-mon[116404]: from='client.44375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T18:14:19.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:19 smithi084 ceph-mon[119097]: from='client.44375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T18:14:20.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:19 smithi099 ceph-mon[138788]: from='client.44375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-13T18:14:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:14:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:14:20] "GET /metrics HTTP/1.1" 200 36194 "" "Prometheus/2.43.0" 2024-01-13T18:14:20.793 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'unique_pool_0' removed 2024-01-13T18:14:21.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:21.310 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:20 smithi084 ceph-mon[116404]: pgmap v1017: 121 pgs: 121 active+clean; 428 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 928 KiB/s wr, 10 op/s 2024-01-13T18:14:21.310 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:20 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/960342362' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T18:14:21.311 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:21.311 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:20 smithi084 ceph-mon[119097]: pgmap v1017: 121 pgs: 121 active+clean; 428 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 928 KiB/s wr, 10 op/s 2024-01-13T18:14:21.311 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:20 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/960342362' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T18:14:21.312 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-01-13T18:14:21.312 INFO:teuthology.task.print:**** done end ec-rados-default.yaml 2024-01-13T18:14:21.312 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-01-13T18:14:21.312 INFO:teuthology.task.print:**** done start rados_api.yaml 2024-01-13T18:14:21.312 INFO:teuthology.task.full_sequential:In full_sequential, running task workunit... 2024-01-13T18:14:21.313 INFO:tasks.workunit:Pulling workunits from ref quincy 2024-01-13T18:14:21.313 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-13T18:14:21.313 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:14:21.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:21.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:20 smithi099 ceph-mon[138788]: pgmap v1017: 121 pgs: 121 active+clean; 428 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 928 KiB/s wr, 10 op/s 2024-01-13T18:14:21.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:20 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/960342362' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T18:14:21.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T18:14:21.334 INFO:teuthology.orchestra.run.smithi084.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-01-13T18:14:21.334 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:14:21.394 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-01-13T18:14:21.395 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-01-13T18:14:21.455 INFO:tasks.workunit:timeout=3h 2024-01-13T18:14:21.455 INFO:tasks.workunit:cleanup=True 2024-01-13T18:14:21.456 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch quincy https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 2024-01-13T18:14:21.515 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-13T18:14:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:21 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/960342362' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-01-13T18:14:22.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:21 smithi099 ceph-mon[138788]: osdmap e867: 8 total, 8 up, 8 in 2024-01-13T18:14:22.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:21 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/960342362' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-01-13T18:14:22.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:21 smithi084 ceph-mon[119097]: osdmap e867: 8 total, 8 up, 8 in 2024-01-13T18:14:22.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:21 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/960342362' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-01-13T18:14:22.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:21 smithi084 ceph-mon[116404]: osdmap e867: 8 total, 8 up, 8 in 2024-01-13T18:14:23.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:22 smithi099 ceph-mon[138788]: pgmap v1019: 105 pgs: 105 active+clean; 583 KiB data, 3.4 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:23.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:22 smithi084 ceph-mon[116404]: pgmap v1019: 105 pgs: 105 active+clean; 583 KiB data, 3.4 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:23.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:22 smithi084 ceph-mon[119097]: pgmap v1019: 105 pgs: 105 active+clean; 583 KiB data, 3.4 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:25 smithi099 ceph-mon[138788]: pgmap v1020: 105 pgs: 105 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:25.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:25 smithi084 ceph-mon[116404]: pgmap v1020: 105 pgs: 105 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:25.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:25 smithi084 ceph-mon[119097]: pgmap v1020: 105 pgs: 105 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:27.192 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-13T18:14:27.253 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-13T18:14:27.255 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-13T18:14:27.255 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-13T18:14:27.301 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-13T18:14:27.347 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-13T18:14:27.384 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-13T18:14:27.385 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-13T18:14:27.386 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-13T18:14:27.422 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-13T18:14:27.425 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T18:14:27.425 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-13T18:14:27.484 INFO:tasks.workunit:Running workunits matching cls on client.0... 2024-01-13T18:14:27.485 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-01-13T18:14:27.485 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-01-13T18:14:27.554 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:14:27.554 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 22 tests from 1 test suite. 2024-01-13T18:14:27.554 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:14:27.554 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 22 tests from TestCls2PCQueue 2024-01-13T18:14:27.554 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-01-13T18:14:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:27 smithi099 ceph-mon[138788]: pgmap v1021: 105 pgs: 105 active+clean; 583 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:27 smithi084 ceph-mon[116404]: pgmap v1021: 105 pgs: 105 active+clean; 583 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:27.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:27 smithi084 ceph-mon[119097]: pgmap v1021: 105 pgs: 105 active+clean; 583 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:29 smithi099 ceph-mon[138788]: pgmap v1022: 105 pgs: 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:29 smithi099 ceph-mon[138788]: osdmap e868: 8 total, 8 up, 8 in 2024-01-13T18:14:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:29 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1223748108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:29.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:29 smithi084 ceph-mon[119097]: pgmap v1022: 105 pgs: 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:29.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:29 smithi084 ceph-mon[119097]: osdmap e868: 8 total, 8 up, 8 in 2024-01-13T18:14:29.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:29 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1223748108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:29 smithi084 ceph-mon[116404]: pgmap v1022: 105 pgs: 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:29 smithi084 ceph-mon[116404]: osdmap e868: 8 total, 8 up, 8 in 2024-01-13T18:14:29.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:29 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1223748108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:30.224 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2670 ms) 2024-01-13T18:14:30.224 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-01-13T18:14:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:30 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1223748108' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:30 smithi099 ceph-mon[138788]: osdmap e869: 8 total, 8 up, 8 in 2024-01-13T18:14:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:14:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:14:30] "GET /metrics HTTP/1.1" 200 36194 "" "Prometheus/2.43.0" 2024-01-13T18:14:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:30 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1223748108' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:30.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:30 smithi084 ceph-mon[119097]: osdmap e869: 8 total, 8 up, 8 in 2024-01-13T18:14:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:30 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1223748108' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:30.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:30 smithi084 ceph-mon[116404]: osdmap e869: 8 total, 8 up, 8 in 2024-01-13T18:14:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:31 smithi099 ceph-mon[138788]: pgmap v1025: 137 pgs: 3 creating+peering, 22 unknown, 112 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 127 B/s rd, 127 B/s wr, 0 op/s 2024-01-13T18:14:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:31 smithi099 ceph-mon[138788]: osdmap e870: 8 total, 8 up, 8 in 2024-01-13T18:14:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:31 smithi084 ceph-mon[119097]: pgmap v1025: 137 pgs: 3 creating+peering, 22 unknown, 112 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 127 B/s rd, 127 B/s wr, 0 op/s 2024-01-13T18:14:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:31 smithi084 ceph-mon[119097]: osdmap e870: 8 total, 8 up, 8 in 2024-01-13T18:14:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:31 smithi084 ceph-mon[116404]: pgmap v1025: 137 pgs: 3 creating+peering, 22 unknown, 112 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 127 B/s rd, 127 B/s wr, 0 op/s 2024-01-13T18:14:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:31 smithi084 ceph-mon[116404]: osdmap e870: 8 total, 8 up, 8 in 2024-01-13T18:14:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:32 smithi099 ceph-mon[138788]: osdmap e871: 8 total, 8 up, 8 in 2024-01-13T18:14:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:32 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2206727041' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:32.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:32 smithi084 ceph-mon[116404]: osdmap e871: 8 total, 8 up, 8 in 2024-01-13T18:14:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:32 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2206727041' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:32 smithi084 ceph-mon[119097]: osdmap e871: 8 total, 8 up, 8 in 2024-01-13T18:14:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:32 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2206727041' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:33.244 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3020 ms) 2024-01-13T18:14:33.244 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-01-13T18:14:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:33 smithi099 ceph-mon[138788]: pgmap v1028: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:33 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:33 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2206727041' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:33 smithi099 ceph-mon[138788]: osdmap e872: 8 total, 8 up, 8 in 2024-01-13T18:14:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:33 smithi084 ceph-mon[116404]: pgmap v1028: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:33 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:33 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2206727041' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:33 smithi084 ceph-mon[116404]: osdmap e872: 8 total, 8 up, 8 in 2024-01-13T18:14:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:33 smithi084 ceph-mon[119097]: pgmap v1028: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:33 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:33 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2206727041' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:33 smithi084 ceph-mon[119097]: osdmap e872: 8 total, 8 up, 8 in 2024-01-13T18:14:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:34 smithi099 ceph-mon[138788]: osdmap e873: 8 total, 8 up, 8 in 2024-01-13T18:14:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:34 smithi084 ceph-mon[116404]: osdmap e873: 8 total, 8 up, 8 in 2024-01-13T18:14:34.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:34 smithi084 ceph-mon[119097]: osdmap e873: 8 total, 8 up, 8 in 2024-01-13T18:14:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:35 smithi099 ceph-mon[138788]: pgmap v1031: 105 pgs: 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:35 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:35 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:14:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:35 smithi099 ceph-mon[138788]: osdmap e874: 8 total, 8 up, 8 in 2024-01-13T18:14:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:35 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4096617334' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:35 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[119097]: pgmap v1031: 105 pgs: 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:14:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[119097]: osdmap e874: 8 total, 8 up, 8 in 2024-01-13T18:14:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4096617334' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[116404]: pgmap v1031: 105 pgs: 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:14:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[116404]: osdmap e874: 8 total, 8 up, 8 in 2024-01-13T18:14:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4096617334' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:36.262 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.Reserve (3019 ms) 2024-01-13T18:14:36.262 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-01-13T18:14:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:36 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:36 smithi099 ceph-mon[138788]: osdmap e875: 8 total, 8 up, 8 in 2024-01-13T18:14:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:36 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:36 smithi084 ceph-mon[116404]: osdmap e875: 8 total, 8 up, 8 in 2024-01-13T18:14:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:36 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:36 smithi084 ceph-mon[119097]: osdmap e875: 8 total, 8 up, 8 in 2024-01-13T18:14:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:37 smithi099 ceph-mon[138788]: pgmap v1034: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:37 smithi099 ceph-mon[138788]: osdmap e876: 8 total, 8 up, 8 in 2024-01-13T18:14:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:37 smithi084 ceph-mon[116404]: pgmap v1034: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:37 smithi084 ceph-mon[116404]: osdmap e876: 8 total, 8 up, 8 in 2024-01-13T18:14:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:37 smithi084 ceph-mon[119097]: pgmap v1034: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:37 smithi084 ceph-mon[119097]: osdmap e876: 8 total, 8 up, 8 in 2024-01-13T18:14:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:38 smithi099 ceph-mon[138788]: osdmap e877: 8 total, 8 up, 8 in 2024-01-13T18:14:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:38 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1424632072' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:38 smithi084 ceph-mon[116404]: osdmap e877: 8 total, 8 up, 8 in 2024-01-13T18:14:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:38 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1424632072' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:38 smithi084 ceph-mon[119097]: osdmap e877: 8 total, 8 up, 8 in 2024-01-13T18:14:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:38 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1424632072' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:39.286 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3020 ms) 2024-01-13T18:14:39.287 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-01-13T18:14:39.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:39 smithi099 ceph-mon[138788]: pgmap v1037: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:39.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1424632072' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:39.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:39 smithi099 ceph-mon[138788]: osdmap e878: 8 total, 8 up, 8 in 2024-01-13T18:14:39.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:39 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:39 smithi084 ceph-mon[116404]: pgmap v1037: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1424632072' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:39 smithi084 ceph-mon[116404]: osdmap e878: 8 total, 8 up, 8 in 2024-01-13T18:14:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:39 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:39 smithi084 ceph-mon[119097]: pgmap v1037: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1424632072' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:39 smithi084 ceph-mon[119097]: osdmap e878: 8 total, 8 up, 8 in 2024-01-13T18:14:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:39 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:40.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:40 smithi099 ceph-mon[138788]: osdmap e879: 8 total, 8 up, 8 in 2024-01-13T18:14:40.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:40 smithi084 ceph-mon[116404]: osdmap e879: 8 total, 8 up, 8 in 2024-01-13T18:14:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:40 smithi084 ceph-mon[119097]: osdmap e879: 8 total, 8 up, 8 in 2024-01-13T18:14:40.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:14:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:14:40] "GET /metrics HTTP/1.1" 200 36149 "" "Prometheus/2.43.0" 2024-01-13T18:14:41.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:41 smithi099 ceph-mon[138788]: pgmap v1040: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:41.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:41 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:41.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:41 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:14:41.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:41 smithi099 ceph-mon[138788]: osdmap e880: 8 total, 8 up, 8 in 2024-01-13T18:14:41.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:41 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4269769395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:41 smithi084 ceph-mon[116404]: pgmap v1040: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:41 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:41 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:14:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:41 smithi084 ceph-mon[116404]: osdmap e880: 8 total, 8 up, 8 in 2024-01-13T18:14:41.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:41 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4269769395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:41 smithi084 ceph-mon[119097]: pgmap v1040: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:41 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:41 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:14:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:41 smithi084 ceph-mon[119097]: osdmap e880: 8 total, 8 up, 8 in 2024-01-13T18:14:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:41 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4269769395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:42.313 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.Commit (3027 ms) 2024-01-13T18:14:42.313 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-01-13T18:14:42.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:42 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4269769395' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:42.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:42 smithi099 ceph-mon[138788]: osdmap e881: 8 total, 8 up, 8 in 2024-01-13T18:14:42.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:42 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4269769395' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:42.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:42 smithi084 ceph-mon[116404]: osdmap e881: 8 total, 8 up, 8 in 2024-01-13T18:14:42.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:42 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4269769395' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:42.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:42 smithi084 ceph-mon[119097]: osdmap e881: 8 total, 8 up, 8 in 2024-01-13T18:14:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:43 smithi099 ceph-mon[138788]: pgmap v1043: 137 pgs: 23 unknown, 114 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:43 smithi099 ceph-mon[138788]: osdmap e882: 8 total, 8 up, 8 in 2024-01-13T18:14:43.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:43 smithi084 ceph-mon[116404]: pgmap v1043: 137 pgs: 23 unknown, 114 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:43.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:43 smithi084 ceph-mon[116404]: osdmap e882: 8 total, 8 up, 8 in 2024-01-13T18:14:43.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:43 smithi084 ceph-mon[119097]: pgmap v1043: 137 pgs: 23 unknown, 114 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:43.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:43 smithi084 ceph-mon[119097]: osdmap e882: 8 total, 8 up, 8 in 2024-01-13T18:14:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:44 smithi099 ceph-mon[138788]: osdmap e883: 8 total, 8 up, 8 in 2024-01-13T18:14:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:44 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544161198' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:44.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:44 smithi084 ceph-mon[116404]: osdmap e883: 8 total, 8 up, 8 in 2024-01-13T18:14:44.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:44 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544161198' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:44.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:44 smithi084 ceph-mon[119097]: osdmap e883: 8 total, 8 up, 8 in 2024-01-13T18:14:44.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:44 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544161198' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:45.327 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.Abort (3017 ms) 2024-01-13T18:14:45.327 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-01-13T18:14:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:45 smithi099 ceph-mon[138788]: pgmap v1046: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:45 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:45 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544161198' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:45 smithi099 ceph-mon[138788]: osdmap e884: 8 total, 8 up, 8 in 2024-01-13T18:14:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:45 smithi084 ceph-mon[116404]: pgmap v1046: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:45 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:45 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544161198' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:45.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:45 smithi084 ceph-mon[116404]: osdmap e884: 8 total, 8 up, 8 in 2024-01-13T18:14:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:45 smithi084 ceph-mon[119097]: pgmap v1046: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:45 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:45 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544161198' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:45 smithi084 ceph-mon[119097]: osdmap e884: 8 total, 8 up, 8 in 2024-01-13T18:14:46.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:46 smithi099 ceph-mon[138788]: osdmap e885: 8 total, 8 up, 8 in 2024-01-13T18:14:46.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:46 smithi084 ceph-mon[116404]: osdmap e885: 8 total, 8 up, 8 in 2024-01-13T18:14:46.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:46 smithi084 ceph-mon[119097]: osdmap e885: 8 total, 8 up, 8 in 2024-01-13T18:14:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:47 smithi099 ceph-mon[138788]: pgmap v1049: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:47 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:47 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:14:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:47 smithi099 ceph-mon[138788]: osdmap e886: 8 total, 8 up, 8 in 2024-01-13T18:14:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:47 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4136997719' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:47 smithi084 ceph-mon[116404]: pgmap v1049: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:47 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:47 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:14:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:47 smithi084 ceph-mon[116404]: osdmap e886: 8 total, 8 up, 8 in 2024-01-13T18:14:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:47 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4136997719' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:47.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:47 smithi084 ceph-mon[119097]: pgmap v1049: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:47.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:47 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:47.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:47 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:14:47.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:47 smithi084 ceph-mon[119097]: osdmap e886: 8 total, 8 up, 8 in 2024-01-13T18:14:47.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:47 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4136997719' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:48.345 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.ReserveError (3019 ms) 2024-01-13T18:14:48.345 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-01-13T18:14:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:48 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4136997719' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:48 smithi099 ceph-mon[138788]: osdmap e887: 8 total, 8 up, 8 in 2024-01-13T18:14:48.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:48 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4136997719' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:48.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:48 smithi084 ceph-mon[116404]: osdmap e887: 8 total, 8 up, 8 in 2024-01-13T18:14:48.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:48 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4136997719' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:48.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:48 smithi084 ceph-mon[119097]: osdmap e887: 8 total, 8 up, 8 in 2024-01-13T18:14:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:49 smithi099 ceph-mon[138788]: pgmap v1052: 137 pgs: 11 creating+peering, 15 unknown, 111 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:49 smithi099 ceph-mon[138788]: osdmap e888: 8 total, 8 up, 8 in 2024-01-13T18:14:49.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:49 smithi084 ceph-mon[116404]: pgmap v1052: 137 pgs: 11 creating+peering, 15 unknown, 111 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:49.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:49 smithi084 ceph-mon[116404]: osdmap e888: 8 total, 8 up, 8 in 2024-01-13T18:14:49.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:49 smithi084 ceph-mon[119097]: pgmap v1052: 137 pgs: 11 creating+peering, 15 unknown, 111 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:49.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:49 smithi084 ceph-mon[119097]: osdmap e888: 8 total, 8 up, 8 in 2024-01-13T18:14:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:50 smithi099 ceph-mon[138788]: osdmap e889: 8 total, 8 up, 8 in 2024-01-13T18:14:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:50 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3792231769' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:50 smithi084 ceph-mon[119097]: osdmap e889: 8 total, 8 up, 8 in 2024-01-13T18:14:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:50 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3792231769' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:50 smithi084 ceph-mon[116404]: osdmap e889: 8 total, 8 up, 8 in 2024-01-13T18:14:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:50 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3792231769' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:14:50.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:14:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:14:50] "GET /metrics HTTP/1.1" 200 36207 "" "Prometheus/2.43.0" 2024-01-13T18:14:51.379 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.CommitError (3033 ms) 2024-01-13T18:14:51.379 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-01-13T18:14:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:51 smithi099 ceph-mon[138788]: pgmap v1055: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:51 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:51 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3792231769' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:51 smithi099 ceph-mon[138788]: osdmap e890: 8 total, 8 up, 8 in 2024-01-13T18:14:51.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:51 smithi084 ceph-mon[116404]: pgmap v1055: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:51.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:51 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:51.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:51 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3792231769' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:51.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:51 smithi084 ceph-mon[116404]: osdmap e890: 8 total, 8 up, 8 in 2024-01-13T18:14:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:51 smithi084 ceph-mon[119097]: pgmap v1055: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:51 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:51 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3792231769' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:51 smithi084 ceph-mon[119097]: osdmap e890: 8 total, 8 up, 8 in 2024-01-13T18:14:52.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:52 smithi084 ceph-mon[116404]: osdmap e891: 8 total, 8 up, 8 in 2024-01-13T18:14:52.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:52 smithi084 ceph-mon[116404]: pgmap v1058: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:52.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:52 smithi084 ceph-mon[119097]: osdmap e891: 8 total, 8 up, 8 in 2024-01-13T18:14:52.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:52 smithi084 ceph-mon[119097]: pgmap v1058: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:52.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:52 smithi099 ceph-mon[138788]: osdmap e891: 8 total, 8 up, 8 in 2024-01-13T18:14:52.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:52 smithi099 ceph-mon[138788]: pgmap v1058: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:53 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:53 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:14:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:53 smithi084 ceph-mon[116404]: osdmap e892: 8 total, 8 up, 8 in 2024-01-13T18:14:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:53 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4248277930' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:53 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:53 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:53 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:14:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:53 smithi084 ceph-mon[119097]: osdmap e892: 8 total, 8 up, 8 in 2024-01-13T18:14:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:53 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4248277930' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:53 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:53 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:14:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:53 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:14:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:53 smithi099 ceph-mon[138788]: osdmap e892: 8 total, 8 up, 8 in 2024-01-13T18:14:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:53 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4248277930' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:53.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:53 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:54.401 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.AbortError (3023 ms) 2024-01-13T18:14:54.401 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-01-13T18:14:54.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:54 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:54.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:54 smithi084 ceph-mon[116404]: osdmap e893: 8 total, 8 up, 8 in 2024-01-13T18:14:54.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:54 smithi084 ceph-mon[116404]: pgmap v1061: 137 pgs: 6 creating+peering, 22 unknown, 109 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:54 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:54 smithi084 ceph-mon[119097]: osdmap e893: 8 total, 8 up, 8 in 2024-01-13T18:14:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:54 smithi084 ceph-mon[119097]: pgmap v1061: 137 pgs: 6 creating+peering, 22 unknown, 109 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:54.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:54 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:54.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:54 smithi099 ceph-mon[138788]: osdmap e893: 8 total, 8 up, 8 in 2024-01-13T18:14:54.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:54 smithi099 ceph-mon[138788]: pgmap v1061: 137 pgs: 6 creating+peering, 22 unknown, 109 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:55.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:55 smithi084 ceph-mon[116404]: osdmap e894: 8 total, 8 up, 8 in 2024-01-13T18:14:55.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:55 smithi084 ceph-mon[119097]: osdmap e894: 8 total, 8 up, 8 in 2024-01-13T18:14:55.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:55 smithi099 ceph-mon[138788]: osdmap e894: 8 total, 8 up, 8 in 2024-01-13T18:14:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[116404]: osdmap e895: 8 total, 8 up, 8 in 2024-01-13T18:14:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2888444932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[116404]: pgmap v1064: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[116404]: osdmap e896: 8 total, 8 up, 8 in 2024-01-13T18:14:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[119097]: osdmap e895: 8 total, 8 up, 8 in 2024-01-13T18:14:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2888444932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[119097]: pgmap v1064: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:56.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:56 smithi084 ceph-mon[119097]: osdmap e896: 8 total, 8 up, 8 in 2024-01-13T18:14:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:56 smithi099 ceph-mon[138788]: osdmap e895: 8 total, 8 up, 8 in 2024-01-13T18:14:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:56 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2888444932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:56 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:56 smithi099 ceph-mon[138788]: pgmap v1064: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:56 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:14:56.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:56 smithi099 ceph-mon[138788]: osdmap e896: 8 total, 8 up, 8 in 2024-01-13T18:14:57.403 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3001 ms) 2024-01-13T18:14:57.403 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-01-13T18:14:57.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:57 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:57 smithi084 ceph-mon[116404]: osdmap e897: 8 total, 8 up, 8 in 2024-01-13T18:14:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:57 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:57 smithi084 ceph-mon[119097]: osdmap e897: 8 total, 8 up, 8 in 2024-01-13T18:14:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:57 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:14:57.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:57 smithi099 ceph-mon[138788]: osdmap e897: 8 total, 8 up, 8 in 2024-01-13T18:14:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:58 smithi099 ceph-mon[138788]: pgmap v1067: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:58 smithi099 ceph-mon[138788]: osdmap e898: 8 total, 8 up, 8 in 2024-01-13T18:14:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:58 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/985001318' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:58 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:59.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:58 smithi084 ceph-mon[116404]: pgmap v1067: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:59.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:58 smithi084 ceph-mon[116404]: osdmap e898: 8 total, 8 up, 8 in 2024-01-13T18:14:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:58 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/985001318' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:59.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:58 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:58 smithi084 ceph-mon[119097]: pgmap v1067: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:14:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:58 smithi084 ceph-mon[119097]: osdmap e898: 8 total, 8 up, 8 in 2024-01-13T18:14:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:58 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/985001318' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:14:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:58 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:59 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:59 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:15:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:59 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:14:59 smithi099 ceph-mon[138788]: osdmap e899: 8 total, 8 up, 8 in 2024-01-13T18:15:00.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:59 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:00.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:59 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:15:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:59 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:00.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:14:59 smithi084 ceph-mon[116404]: osdmap e899: 8 total, 8 up, 8 in 2024-01-13T18:15:00.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:59 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:00.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:59 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:15:00.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:59 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:00.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:14:59 smithi084 ceph-mon[119097]: osdmap e899: 8 total, 8 up, 8 in 2024-01-13T18:15:00.433 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3025 ms) 2024-01-13T18:15:00.433 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-01-13T18:15:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:15:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:15:00] "GET /metrics HTTP/1.1" 200 36207 "" "Prometheus/2.43.0" 2024-01-13T18:15:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:00 smithi099 ceph-mon[138788]: pgmap v1070: 137 pgs: 3 creating+peering, 22 unknown, 112 active+clean; 668 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 213 KiB/s rd, 688 KiB/s wr, 743 op/s 2024-01-13T18:15:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:00 smithi099 ceph-mon[138788]: osdmap e900: 8 total, 8 up, 8 in 2024-01-13T18:15:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:00 smithi084 ceph-mon[116404]: pgmap v1070: 137 pgs: 3 creating+peering, 22 unknown, 112 active+clean; 668 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 213 KiB/s rd, 688 KiB/s wr, 743 op/s 2024-01-13T18:15:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:00 smithi084 ceph-mon[116404]: osdmap e900: 8 total, 8 up, 8 in 2024-01-13T18:15:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:00 smithi084 ceph-mon[119097]: pgmap v1070: 137 pgs: 3 creating+peering, 22 unknown, 112 active+clean; 668 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 213 KiB/s rd, 688 KiB/s wr, 743 op/s 2024-01-13T18:15:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:00 smithi084 ceph-mon[119097]: osdmap e900: 8 total, 8 up, 8 in 2024-01-13T18:15:02.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:02 smithi099 ceph-mon[138788]: osdmap e901: 8 total, 8 up, 8 in 2024-01-13T18:15:02.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:02 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2000992431' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:02.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:02 smithi099 ceph-mon[138788]: pgmap v1073: 137 pgs: 10 creating+peering, 22 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:02.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:02 smithi084 ceph-mon[116404]: osdmap e901: 8 total, 8 up, 8 in 2024-01-13T18:15:02.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:02 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2000992431' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:02.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:02 smithi084 ceph-mon[116404]: pgmap v1073: 137 pgs: 10 creating+peering, 22 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:02.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:02 smithi084 ceph-mon[119097]: osdmap e901: 8 total, 8 up, 8 in 2024-01-13T18:15:02.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:02 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2000992431' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:02.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:02 smithi084 ceph-mon[119097]: pgmap v1073: 137 pgs: 10 creating+peering, 22 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:03.445 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3016 ms) 2024-01-13T18:15:03.445 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-01-13T18:15:03.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:03 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:03.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:03 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2000992431' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:03.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:03 smithi099 ceph-mon[138788]: osdmap e902: 8 total, 8 up, 8 in 2024-01-13T18:15:03.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:03 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:03.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:03 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2000992431' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:03.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:03 smithi084 ceph-mon[116404]: osdmap e902: 8 total, 8 up, 8 in 2024-01-13T18:15:03.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:03 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:03.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:03 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2000992431' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:03.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:03 smithi084 ceph-mon[119097]: osdmap e902: 8 total, 8 up, 8 in 2024-01-13T18:15:04.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:04 smithi099 ceph-mon[138788]: osdmap e903: 8 total, 8 up, 8 in 2024-01-13T18:15:04.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:04 smithi099 ceph-mon[138788]: pgmap v1076: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:04.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:04 smithi084 ceph-mon[116404]: osdmap e903: 8 total, 8 up, 8 in 2024-01-13T18:15:04.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:04 smithi084 ceph-mon[116404]: pgmap v1076: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:04 smithi084 ceph-mon[119097]: osdmap e903: 8 total, 8 up, 8 in 2024-01-13T18:15:04.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:04 smithi084 ceph-mon[119097]: pgmap v1076: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:05 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:05 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:15:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:05 smithi099 ceph-mon[138788]: osdmap e904: 8 total, 8 up, 8 in 2024-01-13T18:15:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:05 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/192994559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:05 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:05.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:05.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:15:05.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[116404]: osdmap e904: 8 total, 8 up, 8 in 2024-01-13T18:15:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/192994559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:05.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:15:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[119097]: osdmap e904: 8 total, 8 up, 8 in 2024-01-13T18:15:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/192994559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:05.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:06.459 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3015 ms) 2024-01-13T18:15:06.460 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-01-13T18:15:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:06 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:06 smithi099 ceph-mon[138788]: osdmap e905: 8 total, 8 up, 8 in 2024-01-13T18:15:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:06 smithi099 ceph-mon[138788]: pgmap v1079: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:06.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:06 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:06.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:06 smithi084 ceph-mon[116404]: osdmap e905: 8 total, 8 up, 8 in 2024-01-13T18:15:06.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:06 smithi084 ceph-mon[116404]: pgmap v1079: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:06 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:06 smithi084 ceph-mon[119097]: osdmap e905: 8 total, 8 up, 8 in 2024-01-13T18:15:06.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:06 smithi084 ceph-mon[119097]: pgmap v1079: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:07.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:07 smithi099 ceph-mon[138788]: osdmap e906: 8 total, 8 up, 8 in 2024-01-13T18:15:07.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:07 smithi084 ceph-mon[116404]: osdmap e906: 8 total, 8 up, 8 in 2024-01-13T18:15:07.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:07 smithi084 ceph-mon[119097]: osdmap e906: 8 total, 8 up, 8 in 2024-01-13T18:15:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:08 smithi099 ceph-mon[138788]: osdmap e907: 8 total, 8 up, 8 in 2024-01-13T18:15:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:08 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2975187069' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:08 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:08 smithi099 ceph-mon[138788]: pgmap v1082: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:08.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:08 smithi084 ceph-mon[119097]: osdmap e907: 8 total, 8 up, 8 in 2024-01-13T18:15:08.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:08 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2975187069' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:08.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:08 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:08.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:08 smithi084 ceph-mon[119097]: pgmap v1082: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:08 smithi084 ceph-mon[116404]: osdmap e907: 8 total, 8 up, 8 in 2024-01-13T18:15:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:08 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2975187069' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:08 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:08 smithi084 ceph-mon[116404]: pgmap v1082: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:09.490 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3031 ms) 2024-01-13T18:15:09.490 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-01-13T18:15:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:09 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:09 smithi099 ceph-mon[138788]: osdmap e908: 8 total, 8 up, 8 in 2024-01-13T18:15:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:09 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:09.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:09 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:09.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:09 smithi084 ceph-mon[116404]: osdmap e908: 8 total, 8 up, 8 in 2024-01-13T18:15:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:09 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:09 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:09 smithi084 ceph-mon[119097]: osdmap e908: 8 total, 8 up, 8 in 2024-01-13T18:15:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:09 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:15:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:15:10] "GET /metrics HTTP/1.1" 200 36200 "" "Prometheus/2.43.0" 2024-01-13T18:15:10.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:10 smithi084 ceph-mon[119097]: osdmap e909: 8 total, 8 up, 8 in 2024-01-13T18:15:10.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:10 smithi084 ceph-mon[119097]: pgmap v1085: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:10 smithi084 ceph-mon[116404]: osdmap e909: 8 total, 8 up, 8 in 2024-01-13T18:15:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:10 smithi084 ceph-mon[116404]: pgmap v1085: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:10 smithi099 ceph-mon[138788]: osdmap e909: 8 total, 8 up, 8 in 2024-01-13T18:15:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:10 smithi099 ceph-mon[138788]: pgmap v1085: 105 pgs: 105 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:11 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:11 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:15:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:11 smithi099 ceph-mon[138788]: osdmap e910: 8 total, 8 up, 8 in 2024-01-13T18:15:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:11 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2556309936' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:11 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:11.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:11 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:11.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:11 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:15:11.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:11 smithi084 ceph-mon[116404]: osdmap e910: 8 total, 8 up, 8 in 2024-01-13T18:15:11.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:11 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2556309936' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:11.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:11 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:11 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:11 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:15:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:11 smithi084 ceph-mon[119097]: osdmap e910: 8 total, 8 up, 8 in 2024-01-13T18:15:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:11 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2556309936' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:11 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:12.510 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3019 ms) 2024-01-13T18:15:12.510 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-01-13T18:15:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:12 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:12 smithi099 ceph-mon[138788]: osdmap e911: 8 total, 8 up, 8 in 2024-01-13T18:15:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:12 smithi099 ceph-mon[138788]: pgmap v1088: 137 pgs: 23 unknown, 114 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:12.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:12 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:12.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:12 smithi084 ceph-mon[116404]: osdmap e911: 8 total, 8 up, 8 in 2024-01-13T18:15:12.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:12 smithi084 ceph-mon[116404]: pgmap v1088: 137 pgs: 23 unknown, 114 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:12.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:12 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:12.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:12 smithi084 ceph-mon[119097]: osdmap e911: 8 total, 8 up, 8 in 2024-01-13T18:15:12.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:12 smithi084 ceph-mon[119097]: pgmap v1088: 137 pgs: 23 unknown, 114 active+clean; 583 KiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:13.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:13 smithi099 ceph-mon[138788]: osdmap e912: 8 total, 8 up, 8 in 2024-01-13T18:15:13.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:13 smithi084 ceph-mon[116404]: osdmap e912: 8 total, 8 up, 8 in 2024-01-13T18:15:13.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:13 smithi084 ceph-mon[119097]: osdmap e912: 8 total, 8 up, 8 in 2024-01-13T18:15:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:14 smithi099 ceph-mon[138788]: osdmap e913: 8 total, 8 up, 8 in 2024-01-13T18:15:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:14 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2331363522' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:15:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:15:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:15:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:15:14.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:14 smithi099 ceph-mon[138788]: pgmap v1091: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:14.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:14 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2331363522' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:14.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:14 smithi099 ceph-mon[138788]: osdmap e914: 8 total, 8 up, 8 in 2024-01-13T18:15:14.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[116404]: osdmap e913: 8 total, 8 up, 8 in 2024-01-13T18:15:14.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2331363522' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:14.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:15:14.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:15:14.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:15:14.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:15:14.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[116404]: pgmap v1091: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:14.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2331363522' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:14.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[116404]: osdmap e914: 8 total, 8 up, 8 in 2024-01-13T18:15:14.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[119097]: osdmap e913: 8 total, 8 up, 8 in 2024-01-13T18:15:14.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2331363522' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:14.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:15:14.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:15:14.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:15:14.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:15:14.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[119097]: pgmap v1091: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:14.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2331363522' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:14.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:14 smithi084 ceph-mon[119097]: osdmap e914: 8 total, 8 up, 8 in 2024-01-13T18:15:15.513 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.Cleanup (3002 ms) 2024-01-13T18:15:15.513 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-01-13T18:15:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:15 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:15 smithi099 ceph-mon[138788]: osdmap e915: 8 total, 8 up, 8 in 2024-01-13T18:15:15.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:15 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:15.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:15 smithi084 ceph-mon[116404]: osdmap e915: 8 total, 8 up, 8 in 2024-01-13T18:15:15.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:15 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:15.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:15 smithi084 ceph-mon[119097]: osdmap e915: 8 total, 8 up, 8 in 2024-01-13T18:15:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:16 smithi099 ceph-mon[138788]: pgmap v1094: 105 pgs: 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:16.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:16 smithi084 ceph-mon[116404]: pgmap v1094: 105 pgs: 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:16.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:16 smithi084 ceph-mon[119097]: pgmap v1094: 105 pgs: 105 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:17 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:17 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:15:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:17 smithi099 ceph-mon[138788]: osdmap e916: 8 total, 8 up, 8 in 2024-01-13T18:15:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:17 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1133276883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:17 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:17.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:17 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:17.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:17 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:15:17.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:17 smithi084 ceph-mon[119097]: osdmap e916: 8 total, 8 up, 8 in 2024-01-13T18:15:17.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:17 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1133276883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:17.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:17 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:17.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:17 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:17.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:17 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:15:17.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:17 smithi084 ceph-mon[116404]: osdmap e916: 8 total, 8 up, 8 in 2024-01-13T18:15:17.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:17 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1133276883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:17.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:17 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:18 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:18 smithi099 ceph-mon[138788]: osdmap e917: 8 total, 8 up, 8 in 2024-01-13T18:15:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:18 smithi099 ceph-mon[138788]: pgmap v1097: 137 pgs: 7 creating+peering, 14 unknown, 116 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:18.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:18 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:18.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:18 smithi084 ceph-mon[116404]: osdmap e917: 8 total, 8 up, 8 in 2024-01-13T18:15:18.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:18 smithi084 ceph-mon[116404]: pgmap v1097: 137 pgs: 7 creating+peering, 14 unknown, 116 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:18.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:18 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:18.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:18 smithi084 ceph-mon[119097]: osdmap e917: 8 total, 8 up, 8 in 2024-01-13T18:15:18.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:18 smithi084 ceph-mon[119097]: pgmap v1097: 137 pgs: 7 creating+peering, 14 unknown, 116 active+clean; 583 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:19.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:19 smithi099 ceph-mon[138788]: osdmap e918: 8 total, 8 up, 8 in 2024-01-13T18:15:19.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:19 smithi084 ceph-mon[116404]: osdmap e918: 8 total, 8 up, 8 in 2024-01-13T18:15:19.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:19 smithi084 ceph-mon[119097]: osdmap e918: 8 total, 8 up, 8 in 2024-01-13T18:15:20.549 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:15:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:15:20] "GET /metrics HTTP/1.1" 200 36237 "" "Prometheus/2.43.0" 2024-01-13T18:15:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:20 smithi099 ceph-mon[138788]: pgmap v1099: 137 pgs: 7 creating+peering, 130 active+clean; 864 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 2.67k op/s 2024-01-13T18:15:20.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:20.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:20 smithi084 ceph-mon[116404]: pgmap v1099: 137 pgs: 7 creating+peering, 130 active+clean; 864 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 2.67k op/s 2024-01-13T18:15:20.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:20.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:20 smithi084 ceph-mon[119097]: pgmap v1099: 137 pgs: 7 creating+peering, 130 active+clean; 864 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 2.67k op/s 2024-01-13T18:15:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:23 smithi099 ceph-mon[138788]: pgmap v1100: 137 pgs: 137 active+clean; 864 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 2.07k op/s 2024-01-13T18:15:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:23 smithi084 ceph-mon[116404]: pgmap v1100: 137 pgs: 137 active+clean; 864 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 2.07k op/s 2024-01-13T18:15:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:23 smithi084 ceph-mon[119097]: pgmap v1100: 137 pgs: 137 active+clean; 864 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 2.07k op/s 2024-01-13T18:15:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:25 smithi099 ceph-mon[138788]: pgmap v1101: 137 pgs: 137 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.2 MiB/s wr, 6.97k op/s 2024-01-13T18:15:25.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:25 smithi084 ceph-mon[116404]: pgmap v1101: 137 pgs: 137 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.2 MiB/s wr, 6.97k op/s 2024-01-13T18:15:25.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:25 smithi084 ceph-mon[119097]: pgmap v1101: 137 pgs: 137 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.2 MiB/s wr, 6.97k op/s 2024-01-13T18:15:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:27 smithi099 ceph-mon[138788]: pgmap v1102: 137 pgs: 137 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 5.5 MiB/s wr, 6.16k op/s 2024-01-13T18:15:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:27 smithi084 ceph-mon[116404]: pgmap v1102: 137 pgs: 137 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 5.5 MiB/s wr, 6.16k op/s 2024-01-13T18:15:27.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:27 smithi084 ceph-mon[119097]: pgmap v1102: 137 pgs: 137 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 5.5 MiB/s wr, 6.16k op/s 2024-01-13T18:15:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:28 smithi099 ceph-mon[138788]: pgmap v1103: 137 pgs: 137 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 5.31k op/s 2024-01-13T18:15:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:28 smithi084 ceph-mon[116404]: pgmap v1103: 137 pgs: 137 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 5.31k op/s 2024-01-13T18:15:29.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:28 smithi084 ceph-mon[119097]: pgmap v1103: 137 pgs: 137 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 5.31k op/s 2024-01-13T18:15:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:15:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:15:30] "GET /metrics HTTP/1.1" 200 36237 "" "Prometheus/2.43.0" 2024-01-13T18:15:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:31 smithi099 ceph-mon[138788]: pgmap v1104: 137 pgs: 137 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 30 MiB/s rd, 6.3 MiB/s wr, 7.15k op/s 2024-01-13T18:15:31.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:31 smithi084 ceph-mon[116404]: pgmap v1104: 137 pgs: 137 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 30 MiB/s rd, 6.3 MiB/s wr, 7.15k op/s 2024-01-13T18:15:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:31 smithi084 ceph-mon[119097]: pgmap v1104: 137 pgs: 137 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 30 MiB/s rd, 6.3 MiB/s wr, 7.15k op/s 2024-01-13T18:15:32.216 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.MultiProducer (16703 ms) 2024-01-13T18:15:32.216 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-01-13T18:15:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:33 smithi099 ceph-mon[138788]: pgmap v1105: 137 pgs: 137 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 5.2 MiB/s wr, 5.87k op/s 2024-01-13T18:15:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:33 smithi099 ceph-mon[138788]: osdmap e919: 8 total, 8 up, 8 in 2024-01-13T18:15:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:33 smithi084 ceph-mon[116404]: pgmap v1105: 137 pgs: 137 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 5.2 MiB/s wr, 5.87k op/s 2024-01-13T18:15:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:33 smithi084 ceph-mon[116404]: osdmap e919: 8 total, 8 up, 8 in 2024-01-13T18:15:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:33 smithi084 ceph-mon[119097]: pgmap v1105: 137 pgs: 137 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 5.2 MiB/s wr, 5.87k op/s 2024-01-13T18:15:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:33 smithi084 ceph-mon[119097]: osdmap e919: 8 total, 8 up, 8 in 2024-01-13T18:15:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:34 smithi099 ceph-mon[138788]: osdmap e920: 8 total, 8 up, 8 in 2024-01-13T18:15:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:34 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3817288332' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:34 smithi084 ceph-mon[116404]: osdmap e920: 8 total, 8 up, 8 in 2024-01-13T18:15:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:34 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3817288332' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:34.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:34 smithi084 ceph-mon[119097]: osdmap e920: 8 total, 8 up, 8 in 2024-01-13T18:15:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:34 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3817288332' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:35.240 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3018 ms) 2024-01-13T18:15:35.240 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-01-13T18:15:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:35 smithi099 ceph-mon[138788]: pgmap v1108: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:35 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:35 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3817288332' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:35 smithi099 ceph-mon[138788]: osdmap e921: 8 total, 8 up, 8 in 2024-01-13T18:15:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:15:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[116404]: pgmap v1108: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3817288332' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[116404]: osdmap e921: 8 total, 8 up, 8 in 2024-01-13T18:15:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:15:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[119097]: pgmap v1108: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:15:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3817288332' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[119097]: osdmap e921: 8 total, 8 up, 8 in 2024-01-13T18:15:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:15:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:36 smithi099 ceph-mon[138788]: osdmap e922: 8 total, 8 up, 8 in 2024-01-13T18:15:36.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:36 smithi084 ceph-mon[116404]: osdmap e922: 8 total, 8 up, 8 in 2024-01-13T18:15:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:36 smithi084 ceph-mon[119097]: osdmap e922: 8 total, 8 up, 8 in 2024-01-13T18:15:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:37 smithi099 ceph-mon[138788]: pgmap v1111: 105 pgs: 105 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:37 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:37 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:15:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:37 smithi099 ceph-mon[138788]: osdmap e923: 8 total, 8 up, 8 in 2024-01-13T18:15:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:37 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/864919914' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:37 smithi084 ceph-mon[116404]: pgmap v1111: 105 pgs: 105 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:37 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:37 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:15:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:37 smithi084 ceph-mon[116404]: osdmap e923: 8 total, 8 up, 8 in 2024-01-13T18:15:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:37 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/864919914' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:37 smithi084 ceph-mon[119097]: pgmap v1111: 105 pgs: 105 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:37 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:15:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:37 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:15:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:37 smithi084 ceph-mon[119097]: osdmap e923: 8 total, 8 up, 8 in 2024-01-13T18:15:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:37 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/864919914' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:15:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:38 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/864919914' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:38 smithi099 ceph-mon[138788]: osdmap e924: 8 total, 8 up, 8 in 2024-01-13T18:15:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:38 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/864919914' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:38.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:38 smithi084 ceph-mon[116404]: osdmap e924: 8 total, 8 up, 8 in 2024-01-13T18:15:38.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:38 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/864919914' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:15:38.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:38 smithi084 ceph-mon[119097]: osdmap e924: 8 total, 8 up, 8 in 2024-01-13T18:15:39.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:39 smithi099 ceph-mon[138788]: pgmap v1114: 137 pgs: 13 creating+peering, 11 unknown, 113 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:39.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:39 smithi099 ceph-mon[138788]: osdmap e925: 8 total, 8 up, 8 in 2024-01-13T18:15:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:39 smithi084 ceph-mon[116404]: pgmap v1114: 137 pgs: 13 creating+peering, 11 unknown, 113 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:39.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:39 smithi084 ceph-mon[116404]: osdmap e925: 8 total, 8 up, 8 in 2024-01-13T18:15:39.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:39 smithi084 ceph-mon[119097]: pgmap v1114: 137 pgs: 13 creating+peering, 11 unknown, 113 active+clean; 583 KiB data, 3.2 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:15:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:39 smithi084 ceph-mon[119097]: osdmap e925: 8 total, 8 up, 8 in 2024-01-13T18:15:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:15:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:15:40] "GET /metrics HTTP/1.1" 200 36278 "" "Prometheus/2.43.0" 2024-01-13T18:15:41.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:41 smithi099 ceph-mon[138788]: pgmap v1116: 137 pgs: 13 creating+peering, 124 active+clean; 989 KiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 3.4 MiB/s wr, 3.94k op/s 2024-01-13T18:15:41.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:41 smithi084 ceph-mon[119097]: pgmap v1116: 137 pgs: 13 creating+peering, 124 active+clean; 989 KiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 3.4 MiB/s wr, 3.94k op/s 2024-01-13T18:15:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:41 smithi084 ceph-mon[116404]: pgmap v1116: 137 pgs: 13 creating+peering, 124 active+clean; 989 KiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 3.4 MiB/s wr, 3.94k op/s 2024-01-13T18:15:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:43 smithi099 ceph-mon[138788]: pgmap v1117: 137 pgs: 137 active+clean; 989 KiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 2.8 MiB/s wr, 3.24k op/s 2024-01-13T18:15:43.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:43 smithi084 ceph-mon[116404]: pgmap v1117: 137 pgs: 137 active+clean; 989 KiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 2.8 MiB/s wr, 3.24k op/s 2024-01-13T18:15:43.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:43 smithi084 ceph-mon[119097]: pgmap v1117: 137 pgs: 137 active+clean; 989 KiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 2.8 MiB/s wr, 3.24k op/s 2024-01-13T18:15:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:45 smithi099 ceph-mon[138788]: pgmap v1118: 137 pgs: 137 active+clean; 989 KiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.1 MiB/s rd, 2.1 MiB/s wr, 2.45k op/s 2024-01-13T18:15:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:45 smithi084 ceph-mon[116404]: pgmap v1118: 137 pgs: 137 active+clean; 989 KiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.1 MiB/s rd, 2.1 MiB/s wr, 2.45k op/s 2024-01-13T18:15:45.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:45 smithi084 ceph-mon[119097]: pgmap v1118: 137 pgs: 137 active+clean; 989 KiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.1 MiB/s rd, 2.1 MiB/s wr, 2.45k op/s 2024-01-13T18:15:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:47 smithi099 ceph-mon[138788]: pgmap v1119: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 4.9 MiB/s wr, 5.69k op/s 2024-01-13T18:15:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:47 smithi084 ceph-mon[116404]: pgmap v1119: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 4.9 MiB/s wr, 5.69k op/s 2024-01-13T18:15:47.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:47 smithi084 ceph-mon[119097]: pgmap v1119: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 4.9 MiB/s wr, 5.69k op/s 2024-01-13T18:15:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:48 smithi099 ceph-mon[138788]: pgmap v1120: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 23 MiB/s rd, 4.3 MiB/s wr, 5.07k op/s 2024-01-13T18:15:49.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:48 smithi084 ceph-mon[116404]: pgmap v1120: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 23 MiB/s rd, 4.3 MiB/s wr, 5.07k op/s 2024-01-13T18:15:49.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:48 smithi084 ceph-mon[119097]: pgmap v1120: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 23 MiB/s rd, 4.3 MiB/s wr, 5.07k op/s 2024-01-13T18:15:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:15:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:15:50] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-01-13T18:15:51.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:15:51.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:51.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:51 smithi099 ceph-mon[138788]: pgmap v1121: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 33 MiB/s rd, 5.0 MiB/s wr, 5.84k op/s 2024-01-13T18:15:51.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:15:51.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:51 smithi084 ceph-mon[116404]: pgmap v1121: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 33 MiB/s rd, 5.0 MiB/s wr, 5.84k op/s 2024-01-13T18:15:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:15:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:15:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:51 smithi084 ceph-mon[119097]: pgmap v1121: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 33 MiB/s rd, 5.0 MiB/s wr, 5.84k op/s 2024-01-13T18:15:53.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:53 smithi099 ceph-mon[138788]: pgmap v1122: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 29 MiB/s rd, 3.5 MiB/s wr, 4.18k op/s 2024-01-13T18:15:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:53 smithi084 ceph-mon[116404]: pgmap v1122: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 29 MiB/s rd, 3.5 MiB/s wr, 4.18k op/s 2024-01-13T18:15:53.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:53 smithi084 ceph-mon[119097]: pgmap v1122: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 29 MiB/s rd, 3.5 MiB/s wr, 4.18k op/s 2024-01-13T18:15:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:55 smithi099 ceph-mon[138788]: pgmap v1123: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 29 MiB/s rd, 3.5 MiB/s wr, 4.18k op/s 2024-01-13T18:15:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:55 smithi084 ceph-mon[116404]: pgmap v1123: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 29 MiB/s rd, 3.5 MiB/s wr, 4.18k op/s 2024-01-13T18:15:55.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:55 smithi084 ceph-mon[119097]: pgmap v1123: 137 pgs: 137 active+clean; 1.6 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 29 MiB/s rd, 3.5 MiB/s wr, 4.18k op/s 2024-01-13T18:15:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:57 smithi099 ceph-mon[138788]: pgmap v1124: 137 pgs: 137 active+clean; 1.6 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 43 MiB/s rd, 4.5 MiB/s wr, 5.34k op/s 2024-01-13T18:15:57.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:57 smithi084 ceph-mon[116404]: pgmap v1124: 137 pgs: 137 active+clean; 1.6 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 43 MiB/s rd, 4.5 MiB/s wr, 5.34k op/s 2024-01-13T18:15:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:57 smithi084 ceph-mon[119097]: pgmap v1124: 137 pgs: 137 active+clean; 1.6 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 43 MiB/s rd, 4.5 MiB/s wr, 5.34k op/s 2024-01-13T18:15:58.851 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (23617 ms) 2024-01-13T18:15:58.851 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-01-13T18:15:59.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:58 smithi099 ceph-mon[138788]: pgmap v1125: 137 pgs: 137 active+clean; 1.6 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 2.2 MiB/s wr, 2.73k op/s 2024-01-13T18:15:59.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:58 smithi084 ceph-mon[116404]: pgmap v1125: 137 pgs: 137 active+clean; 1.6 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 2.2 MiB/s wr, 2.73k op/s 2024-01-13T18:15:59.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:58 smithi084 ceph-mon[119097]: pgmap v1125: 137 pgs: 137 active+clean; 1.6 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 2.2 MiB/s wr, 2.73k op/s 2024-01-13T18:16:00.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:15:59 smithi099 ceph-mon[138788]: osdmap e926: 8 total, 8 up, 8 in 2024-01-13T18:16:00.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:15:59 smithi084 ceph-mon[116404]: osdmap e926: 8 total, 8 up, 8 in 2024-01-13T18:16:00.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:15:59 smithi084 ceph-mon[119097]: osdmap e926: 8 total, 8 up, 8 in 2024-01-13T18:16:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:16:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:16:00] "GET /metrics HTTP/1.1" 200 36339 "" "Prometheus/2.43.0" 2024-01-13T18:16:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:00 smithi099 ceph-mon[138788]: osdmap e927: 8 total, 8 up, 8 in 2024-01-13T18:16:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:00 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2983805477' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:00 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:01.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:00 smithi099 ceph-mon[138788]: pgmap v1128: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:00 smithi084 ceph-mon[116404]: osdmap e927: 8 total, 8 up, 8 in 2024-01-13T18:16:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:00 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2983805477' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:00 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:01.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:00 smithi084 ceph-mon[116404]: pgmap v1128: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:00 smithi084 ceph-mon[119097]: osdmap e927: 8 total, 8 up, 8 in 2024-01-13T18:16:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:00 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2983805477' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:00 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:01.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:00 smithi084 ceph-mon[119097]: pgmap v1128: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:01 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:01 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:02.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:01 smithi099 ceph-mon[138788]: osdmap e928: 8 total, 8 up, 8 in 2024-01-13T18:16:02.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:01 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:02.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:01 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:02.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:01 smithi084 ceph-mon[116404]: osdmap e928: 8 total, 8 up, 8 in 2024-01-13T18:16:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:01 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:01 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:02.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:01 smithi084 ceph-mon[119097]: osdmap e928: 8 total, 8 up, 8 in 2024-01-13T18:16:02.870 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4019 ms) 2024-01-13T18:16:02.870 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-01-13T18:16:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:02 smithi099 ceph-mon[138788]: osdmap e929: 8 total, 8 up, 8 in 2024-01-13T18:16:03.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:02 smithi099 ceph-mon[138788]: pgmap v1131: 137 pgs: 17 unknown, 120 active+clean; 583 KiB data, 3.5 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:02 smithi084 ceph-mon[116404]: osdmap e929: 8 total, 8 up, 8 in 2024-01-13T18:16:03.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:02 smithi084 ceph-mon[116404]: pgmap v1131: 137 pgs: 17 unknown, 120 active+clean; 583 KiB data, 3.5 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:02 smithi084 ceph-mon[119097]: osdmap e929: 8 total, 8 up, 8 in 2024-01-13T18:16:03.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:02 smithi084 ceph-mon[119097]: pgmap v1131: 137 pgs: 17 unknown, 120 active+clean; 583 KiB data, 3.5 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:04.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:03 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:04.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:03 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:16:04.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:03 smithi084 ceph-mon[116404]: osdmap e930: 8 total, 8 up, 8 in 2024-01-13T18:16:04.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:03 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:04.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:03 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:16:04.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:03 smithi084 ceph-mon[119097]: osdmap e930: 8 total, 8 up, 8 in 2024-01-13T18:16:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:03 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:03 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:16:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:03 smithi099 ceph-mon[138788]: osdmap e930: 8 total, 8 up, 8 in 2024-01-13T18:16:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:04 smithi084 ceph-mon[116404]: osdmap e931: 8 total, 8 up, 8 in 2024-01-13T18:16:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:04 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1781634771' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:04 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:05.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:04 smithi084 ceph-mon[116404]: pgmap v1134: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:04 smithi084 ceph-mon[119097]: osdmap e931: 8 total, 8 up, 8 in 2024-01-13T18:16:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:04 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1781634771' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:04 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:05.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:04 smithi084 ceph-mon[119097]: pgmap v1134: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:04 smithi099 ceph-mon[138788]: osdmap e931: 8 total, 8 up, 8 in 2024-01-13T18:16:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:04 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1781634771' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:04 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:04 smithi099 ceph-mon[138788]: pgmap v1134: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:06.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:06.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[116404]: osdmap e932: 8 total, 8 up, 8 in 2024-01-13T18:16:06.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:06.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:06.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:06.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[116404]: osdmap e933: 8 total, 8 up, 8 in 2024-01-13T18:16:06.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:06.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[119097]: osdmap e932: 8 total, 8 up, 8 in 2024-01-13T18:16:06.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:06.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:06.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:06.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:05 smithi084 ceph-mon[119097]: osdmap e933: 8 total, 8 up, 8 in 2024-01-13T18:16:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:05 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:05 smithi099 ceph-mon[138788]: osdmap e932: 8 total, 8 up, 8 in 2024-01-13T18:16:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:05 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:05 smithi099 ceph-mon[138788]: osdmap e933: 8 total, 8 up, 8 in 2024-01-13T18:16:07.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:06 smithi084 ceph-mon[119097]: pgmap v1137: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:06 smithi084 ceph-mon[116404]: pgmap v1137: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:07.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:06 smithi099 ceph-mon[138788]: pgmap v1137: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:07 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:08.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:07 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:16:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:07 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:08.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:07 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:16:08.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:07 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:08.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:07 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:16:08.843 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5974 ms) 2024-01-13T18:16:08.844 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-01-13T18:16:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:09 smithi099 ceph-mon[138788]: pgmap v1138: 137 pgs: 7 creating+peering, 7 unknown, 123 active+clean; 625 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 1.02k op/s 2024-01-13T18:16:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:09 smithi099 ceph-mon[138788]: osdmap e934: 8 total, 8 up, 8 in 2024-01-13T18:16:09.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:09 smithi084 ceph-mon[116404]: pgmap v1138: 137 pgs: 7 creating+peering, 7 unknown, 123 active+clean; 625 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 1.02k op/s 2024-01-13T18:16:09.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:09 smithi084 ceph-mon[116404]: osdmap e934: 8 total, 8 up, 8 in 2024-01-13T18:16:09.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:09 smithi084 ceph-mon[119097]: pgmap v1138: 137 pgs: 7 creating+peering, 7 unknown, 123 active+clean; 625 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 1.02k op/s 2024-01-13T18:16:09.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:09 smithi084 ceph-mon[119097]: osdmap e934: 8 total, 8 up, 8 in 2024-01-13T18:16:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:16:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:16:10] "GET /metrics HTTP/1.1" 200 36281 "" "Prometheus/2.43.0" 2024-01-13T18:16:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:10 smithi099 ceph-mon[138788]: osdmap e935: 8 total, 8 up, 8 in 2024-01-13T18:16:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:10 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3150415255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:10 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:10 smithi099 ceph-mon[138788]: pgmap v1141: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:10 smithi084 ceph-mon[116404]: osdmap e935: 8 total, 8 up, 8 in 2024-01-13T18:16:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:10 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3150415255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:10 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:10 smithi084 ceph-mon[116404]: pgmap v1141: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:10 smithi084 ceph-mon[119097]: osdmap e935: 8 total, 8 up, 8 in 2024-01-13T18:16:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:10 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3150415255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:10 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:10 smithi084 ceph-mon[119097]: pgmap v1141: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:11 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:11 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:11 smithi099 ceph-mon[138788]: osdmap e936: 8 total, 8 up, 8 in 2024-01-13T18:16:12.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:11 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:12.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:11 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:12.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:11 smithi084 ceph-mon[119097]: osdmap e936: 8 total, 8 up, 8 in 2024-01-13T18:16:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:11 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:11 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-168355-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:11 smithi084 ceph-mon[116404]: osdmap e936: 8 total, 8 up, 8 in 2024-01-13T18:16:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:12 smithi099 ceph-mon[138788]: osdmap e937: 8 total, 8 up, 8 in 2024-01-13T18:16:13.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:12 smithi099 ceph-mon[138788]: pgmap v1144: 137 pgs: 15 unknown, 122 active+clean; 605 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:12 smithi084 ceph-mon[116404]: osdmap e937: 8 total, 8 up, 8 in 2024-01-13T18:16:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:12 smithi084 ceph-mon[116404]: pgmap v1144: 137 pgs: 15 unknown, 122 active+clean; 605 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:12 smithi084 ceph-mon[119097]: osdmap e937: 8 total, 8 up, 8 in 2024-01-13T18:16:13.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:12 smithi084 ceph-mon[119097]: pgmap v1144: 137 pgs: 15 unknown, 122 active+clean; 605 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:13.865 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5022 ms) 2024-01-13T18:16:13.865 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 22 tests from TestCls2PCQueue (106312 ms total) 2024-01-13T18:16:13.866 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:16:13.866 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:16:13.866 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 22 tests from 1 test suite ran. (106312 ms total) 2024-01-13T18:16:13.866 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 22 tests. 2024-01-13T18:16:13.868 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:16:13.868 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:16:13.940 INFO:tasks.workunit:Running workunit cls/test_cls_cas.sh... 2024-01-13T18:16:13.961 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_cas.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cas.sh 2024-01-13T18:16:14.010 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:16:14.010 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 6 tests from 2 test suites. 2024-01-13T18:16:14.010 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:16:14.010 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 5 tests from cls_cas 2024-01-13T18:16:14.010 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_cas.get_put 2024-01-13T18:16:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:13 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:14.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:13 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:16:14.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:13 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:14.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:13 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:16:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:13 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:14.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:13 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:16:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:14 smithi099 ceph-mon[138788]: osdmap e938: 8 total, 8 up, 8 in 2024-01-13T18:16:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:14 smithi099 ceph-mon[138788]: pgmap v1146: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:16:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:15.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:14 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[116404]: osdmap e938: 8 total, 8 up, 8 in 2024-01-13T18:16:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[116404]: pgmap v1146: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:15.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:16:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:15.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[119097]: osdmap e938: 8 total, 8 up, 8 in 2024-01-13T18:16:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[119097]: pgmap v1146: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:16:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:15.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:14 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:16.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[116404]: osdmap e939: 8 total, 8 up, 8 in 2024-01-13T18:16:16.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/216753464' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:16.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:16.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:16:16.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:16:16.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:16.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[119097]: osdmap e939: 8 total, 8 up, 8 in 2024-01-13T18:16:16.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/216753464' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:16.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:16.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:16:16.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:16:16.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:15 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:15 smithi099 ceph-mon[138788]: osdmap e939: 8 total, 8 up, 8 in 2024-01-13T18:16:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:15 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/216753464' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:15 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:15 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:16:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:15 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:16:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:15 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:16.892 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_cas.get_put (2882 ms) 2024-01-13T18:16:16.892 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_cas.wrong_put 2024-01-13T18:16:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:16 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:16 smithi084 ceph-mon[116404]: osdmap e940: 8 total, 8 up, 8 in 2024-01-13T18:16:17.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:16 smithi084 ceph-mon[116404]: pgmap v1149: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:16 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:16 smithi084 ceph-mon[119097]: osdmap e940: 8 total, 8 up, 8 in 2024-01-13T18:16:17.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:16 smithi084 ceph-mon[119097]: pgmap v1149: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:16 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:16 smithi099 ceph-mon[138788]: osdmap e940: 8 total, 8 up, 8 in 2024-01-13T18:16:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:16 smithi099 ceph-mon[138788]: pgmap v1149: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:18.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:17 smithi084 ceph-mon[116404]: osdmap e941: 8 total, 8 up, 8 in 2024-01-13T18:16:18.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:17 smithi084 ceph-mon[119097]: osdmap e941: 8 total, 8 up, 8 in 2024-01-13T18:16:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:17 smithi099 ceph-mon[138788]: osdmap e941: 8 total, 8 up, 8 in 2024-01-13T18:16:19.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:18 smithi084 ceph-mon[116404]: osdmap e942: 8 total, 8 up, 8 in 2024-01-13T18:16:19.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:18 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3593420147' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:19.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:18 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:19.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:18 smithi084 ceph-mon[116404]: pgmap v1152: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:19.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:18 smithi084 ceph-mon[119097]: osdmap e942: 8 total, 8 up, 8 in 2024-01-13T18:16:19.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:18 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3593420147' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:19.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:18 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:19.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:18 smithi084 ceph-mon[119097]: pgmap v1152: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:18 smithi099 ceph-mon[138788]: osdmap e942: 8 total, 8 up, 8 in 2024-01-13T18:16:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:18 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3593420147' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:18 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:18 smithi099 ceph-mon[138788]: pgmap v1152: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:19.918 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_cas.wrong_put (3026 ms) 2024-01-13T18:16:19.918 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_cas.dup_get 2024-01-13T18:16:20.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:19 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:20.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:19 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:20.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:19 smithi084 ceph-mon[119097]: osdmap e943: 8 total, 8 up, 8 in 2024-01-13T18:16:20.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:19 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:20.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:19 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:20.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:19 smithi084 ceph-mon[116404]: osdmap e943: 8 total, 8 up, 8 in 2024-01-13T18:16:20.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:19 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:20.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:19 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:20.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:19 smithi099 ceph-mon[138788]: osdmap e943: 8 total, 8 up, 8 in 2024-01-13T18:16:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:16:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:16:20] "GET /metrics HTTP/1.1" 200 33910 "" "Prometheus/2.43.0" 2024-01-13T18:16:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:20 smithi084 ceph-mon[116404]: osdmap e944: 8 total, 8 up, 8 in 2024-01-13T18:16:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:20 smithi084 ceph-mon[116404]: pgmap v1155: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:21.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:20 smithi084 ceph-mon[119097]: osdmap e944: 8 total, 8 up, 8 in 2024-01-13T18:16:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:20 smithi084 ceph-mon[119097]: pgmap v1155: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:21.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:21.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:20 smithi099 ceph-mon[138788]: osdmap e944: 8 total, 8 up, 8 in 2024-01-13T18:16:21.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:20 smithi099 ceph-mon[138788]: pgmap v1155: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:21.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:22.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:21 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:22.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:21 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:16:22.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:21 smithi084 ceph-mon[116404]: osdmap e945: 8 total, 8 up, 8 in 2024-01-13T18:16:22.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:21 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1858022725' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:22.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:21 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:22.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:21 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:22.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:21 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:16:22.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:21 smithi084 ceph-mon[119097]: osdmap e945: 8 total, 8 up, 8 in 2024-01-13T18:16:22.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:21 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1858022725' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:22.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:21 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:22.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:21 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:22.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:21 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:16:22.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:21 smithi099 ceph-mon[138788]: osdmap e945: 8 total, 8 up, 8 in 2024-01-13T18:16:22.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:21 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1858022725' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:22.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:21 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:22.940 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_cas.dup_get (3023 ms) 2024-01-13T18:16:22.941 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_cas.dup_put 2024-01-13T18:16:23.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:22 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:23.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:22 smithi099 ceph-mon[138788]: osdmap e946: 8 total, 8 up, 8 in 2024-01-13T18:16:23.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:22 smithi099 ceph-mon[138788]: pgmap v1158: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:23.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:22 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:23.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:22 smithi084 ceph-mon[116404]: osdmap e946: 8 total, 8 up, 8 in 2024-01-13T18:16:23.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:22 smithi084 ceph-mon[116404]: pgmap v1158: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:22 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:22 smithi084 ceph-mon[119097]: osdmap e946: 8 total, 8 up, 8 in 2024-01-13T18:16:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:22 smithi084 ceph-mon[119097]: pgmap v1158: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:24.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:23 smithi099 ceph-mon[138788]: osdmap e947: 8 total, 8 up, 8 in 2024-01-13T18:16:24.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:23 smithi084 ceph-mon[116404]: osdmap e947: 8 total, 8 up, 8 in 2024-01-13T18:16:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:23 smithi084 ceph-mon[119097]: osdmap e947: 8 total, 8 up, 8 in 2024-01-13T18:16:25.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:24 smithi099 ceph-mon[138788]: osdmap e948: 8 total, 8 up, 8 in 2024-01-13T18:16:25.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:24 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1100342427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:25.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:24 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:25.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:24 smithi099 ceph-mon[138788]: pgmap v1161: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:25.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:24 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:25.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:24 smithi099 ceph-mon[138788]: osdmap e949: 8 total, 8 up, 8 in 2024-01-13T18:16:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[116404]: osdmap e948: 8 total, 8 up, 8 in 2024-01-13T18:16:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1100342427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[116404]: pgmap v1161: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[116404]: osdmap e949: 8 total, 8 up, 8 in 2024-01-13T18:16:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[119097]: osdmap e948: 8 total, 8 up, 8 in 2024-01-13T18:16:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1100342427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[119097]: pgmap v1161: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:25.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:24 smithi084 ceph-mon[119097]: osdmap e949: 8 total, 8 up, 8 in 2024-01-13T18:16:25.950 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_cas.dup_put (3010 ms) 2024-01-13T18:16:25.951 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_cas.get_wrong_data 2024-01-13T18:16:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:25 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:26.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:25 smithi099 ceph-mon[138788]: osdmap e950: 8 total, 8 up, 8 in 2024-01-13T18:16:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:25 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:25 smithi084 ceph-mon[116404]: osdmap e950: 8 total, 8 up, 8 in 2024-01-13T18:16:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:25 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:25 smithi084 ceph-mon[119097]: osdmap e950: 8 total, 8 up, 8 in 2024-01-13T18:16:27.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:26 smithi099 ceph-mon[138788]: pgmap v1164: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:27.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:26 smithi084 ceph-mon[116404]: pgmap v1164: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:27.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:26 smithi084 ceph-mon[119097]: pgmap v1164: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:27 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:27 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:16:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:27 smithi099 ceph-mon[138788]: osdmap e951: 8 total, 8 up, 8 in 2024-01-13T18:16:28.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:27 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3013779032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:28.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:27 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:28.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:27 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:16:28.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:27 smithi084 ceph-mon[116404]: osdmap e951: 8 total, 8 up, 8 in 2024-01-13T18:16:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:27 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3013779032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:27 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:27 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:16:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:27 smithi084 ceph-mon[119097]: osdmap e951: 8 total, 8 up, 8 in 2024-01-13T18:16:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:27 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3013779032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:28.998 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_cas.get_wrong_data (3045 ms) 2024-01-13T18:16:28.998 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 5 tests from cls_cas (14986 ms total) 2024-01-13T18:16:28.998 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:16:28.998 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 1 test from chunk_refs_t 2024-01-13T18:16:28.998 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] chunk_refs_t.size 2024-01-13T18:16:28.998 INFO:tasks.workunit.client.0.smithi084.stdout:1 60 by_object 2024-01-13T18:16:28.998 INFO:tasks.workunit.client.0.smithi084.stdout:2 103 by_object 2024-01-13T18:16:28.998 INFO:tasks.workunit.client.0.smithi084.stdout:4 189 by_object 2024-01-13T18:16:28.998 INFO:tasks.workunit.client.0.smithi084.stdout:8 361 by_object 2024-01-13T18:16:28.998 INFO:tasks.workunit.client.0.smithi084.stdout:16 112 by_hash(32 bits) 2024-01-13T18:16:28.999 INFO:tasks.workunit.client.0.smithi084.stdout:32 208 by_hash(32 bits) 2024-01-13T18:16:28.999 INFO:tasks.workunit.client.0.smithi084.stdout:64 400 by_hash(32 bits) 2024-01-13T18:16:28.999 INFO:tasks.workunit.client.0.smithi084.stdout:128 509 by_hash(10 bits) 2024-01-13T18:16:28.999 INFO:tasks.workunit.client.0.smithi084.stdout:256 499 by_hash(7 bits) 2024-01-13T18:16:28.999 INFO:tasks.workunit.client.0.smithi084.stdout:512 462 by_hash(5 bits) 2024-01-13T18:16:29.004 INFO:tasks.workunit.client.0.smithi084.stdout:1024 466 by_hash(5 bits) 2024-01-13T18:16:29.004 INFO:tasks.workunit.client.0.smithi084.stdout:2048 466 by_hash(5 bits) 2024-01-13T18:16:29.004 INFO:tasks.workunit.client.0.smithi084.stdout:4096 470 by_hash(5 bits) 2024-01-13T18:16:29.004 INFO:tasks.workunit.client.0.smithi084.stdout:8192 498 by_hash(4 bits) 2024-01-13T18:16:29.004 INFO:tasks.workunit.client.0.smithi084.stdout:16384 278 by_hash(3 bits) 2024-01-13T18:16:29.006 INFO:tasks.workunit.client.0.smithi084.stdout:32768 337 by_hash(2 bits) 2024-01-13T18:16:29.011 INFO:tasks.workunit.client.0.smithi084.stdout:65536 367 by_hash(2 bits) 2024-01-13T18:16:29.023 INFO:tasks.workunit.client.0.smithi084.stdout:131072 387 by_hash(1 bits) 2024-01-13T18:16:29.043 INFO:tasks.workunit.client.0.smithi084.stdout:262144 331 by_pool 2024-01-13T18:16:29.079 INFO:tasks.workunit.client.0.smithi084.stdout:524288 21 count 2024-01-13T18:16:29.143 INFO:tasks.workunit.client.0.smithi084.stdout:1048576 21 count 2024-01-13T18:16:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] chunk_refs_t.size (254 ms) 2024-01-13T18:16:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 1 test from chunk_refs_t (254 ms total) 2024-01-13T18:16:29.250 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:16:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:16:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 6 tests from 2 test suites ran. (15240 ms total) 2024-01-13T18:16:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 6 tests. 2024-01-13T18:16:29.251 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:16:29.252 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:16:29.316 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:28 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3013779032' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:29.316 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:28 smithi084 ceph-mon[116404]: osdmap e952: 8 total, 8 up, 8 in 2024-01-13T18:16:29.317 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:28 smithi084 ceph-mon[116404]: pgmap v1167: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:29.317 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:28 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3013779032' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:29.317 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:28 smithi084 ceph-mon[119097]: osdmap e952: 8 total, 8 up, 8 in 2024-01-13T18:16:29.317 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:28 smithi084 ceph-mon[119097]: pgmap v1167: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:29.320 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-01-13T18:16:29.320 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-01-13T18:16:29.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:28 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3013779032' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169037-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:29.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:28 smithi099 ceph-mon[138788]: osdmap e952: 8 total, 8 up, 8 in 2024-01-13T18:16:29.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:28 smithi099 ceph-mon[138788]: pgmap v1167: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:29.389 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:16:29.389 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 31 tests from 1 test suite. 2024-01-13T18:16:29.389 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:16:30.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:29 smithi084 ceph-mon[116404]: osdmap e953: 8 total, 8 up, 8 in 2024-01-13T18:16:30.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:29 smithi084 ceph-mon[119097]: osdmap e953: 8 total, 8 up, 8 in 2024-01-13T18:16:30.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:29 smithi099 ceph-mon[138788]: osdmap e953: 8 total, 8 up, 8 in 2024-01-13T18:16:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:16:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:16:30] "GET /metrics HTTP/1.1" 200 33910 "" "Prometheus/2.43.0" 2024-01-13T18:16:31.014 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 31 tests from CmpOmap 2024-01-13T18:16:31.015 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-01-13T18:16:31.025 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (10 ms) 2024-01-13T18:16:31.025 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-01-13T18:16:31.028 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (3 ms) 2024-01-13T18:16:31.028 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-01-13T18:16:31.031 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (4 ms) 2024-01-13T18:16:31.031 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-01-13T18:16:31.034 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (2 ms) 2024-01-13T18:16:31.034 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-01-13T18:16:31.039 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-01-13T18:16:31.039 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-01-13T18:16:31.046 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2024-01-13T18:16:31.046 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-01-13T18:16:31.049 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-01-13T18:16:31.049 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-01-13T18:16:31.052 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-01-13T18:16:31.052 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-01-13T18:16:31.055 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (2 ms) 2024-01-13T18:16:31.055 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-01-13T18:16:31.058 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-01-13T18:16:31.058 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-01-13T18:16:31.059 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (0 ms) 2024-01-13T18:16:31.059 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-01-13T18:16:31.059 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-01-13T18:16:31.059 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-01-13T18:16:31.065 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (5 ms) 2024-01-13T18:16:31.065 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-01-13T18:16:31.071 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (6 ms) 2024-01-13T18:16:31.071 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-01-13T18:16:31.076 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-01-13T18:16:31.076 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-01-13T18:16:31.084 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-01-13T18:16:31.084 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-01-13T18:16:31.091 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_set_vals_str (7 ms) 2024-01-13T18:16:31.091 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-01-13T18:16:31.098 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-01-13T18:16:31.098 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-01-13T18:16:31.100 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (2 ms) 2024-01-13T18:16:31.100 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-01-13T18:16:31.102 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-01-13T18:16:31.102 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-01-13T18:16:31.103 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-01-13T18:16:31.103 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-01-13T18:16:31.104 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-01-13T18:16:31.104 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-01-13T18:16:31.110 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-01-13T18:16:31.110 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-01-13T18:16:31.116 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (5 ms) 2024-01-13T18:16:31.116 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-01-13T18:16:31.127 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (11 ms) 2024-01-13T18:16:31.127 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-01-13T18:16:31.134 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-01-13T18:16:31.134 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-01-13T18:16:31.136 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-01-13T18:16:31.136 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-01-13T18:16:31.139 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (2 ms) 2024-01-13T18:16:31.139 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-01-13T18:16:31.139 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-01-13T18:16:31.140 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-01-13T18:16:31.140 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-01-13T18:16:31.140 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-01-13T18:16:31.147 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (8 ms) 2024-01-13T18:16:31.148 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 31 tests from CmpOmap (133 ms total) 2024-01-13T18:16:31.148 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:16:31.148 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:16:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:30 smithi099 ceph-mon[138788]: osdmap e954: 8 total, 8 up, 8 in 2024-01-13T18:16:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:30 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3867969777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169412-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:30 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169412-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:31.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:30 smithi099 ceph-mon[138788]: pgmap v1170: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:30 smithi084 ceph-mon[116404]: osdmap e954: 8 total, 8 up, 8 in 2024-01-13T18:16:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:30 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3867969777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169412-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:30 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169412-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:30 smithi084 ceph-mon[116404]: pgmap v1170: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:30 smithi084 ceph-mon[119097]: osdmap e954: 8 total, 8 up, 8 in 2024-01-13T18:16:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:30 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3867969777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169412-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:30 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169412-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:30 smithi084 ceph-mon[119097]: pgmap v1170: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:32.011 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 31 tests from 1 test suite ran. (2622 ms total) 2024-01-13T18:16:32.012 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 31 tests. 2024-01-13T18:16:32.014 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:16:32.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:16:32.085 INFO:tasks.workunit:Running workunit cls/test_cls_hello.sh... 2024-01-13T18:16:32.085 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_hello.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_hello.sh 2024-01-13T18:16:32.156 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:16:32.156 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 6 tests from 1 test suite. 2024-01-13T18:16:32.156 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:16:32.156 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 6 tests from ClsHello 2024-01-13T18:16:32.156 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsHello.SayHello 2024-01-13T18:16:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:31 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169412-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:32.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:31 smithi099 ceph-mon[138788]: osdmap e955: 8 total, 8 up, 8 in 2024-01-13T18:16:32.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:31 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:32.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169412-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:31 smithi084 ceph-mon[116404]: osdmap e955: 8 total, 8 up, 8 in 2024-01-13T18:16:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:31 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169412-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:31 smithi084 ceph-mon[119097]: osdmap e955: 8 total, 8 up, 8 in 2024-01-13T18:16:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:33 smithi099 ceph-mon[138788]: osdmap e956: 8 total, 8 up, 8 in 2024-01-13T18:16:33.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:33 smithi099 ceph-mon[138788]: pgmap v1173: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:33.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:33 smithi084 ceph-mon[116404]: osdmap e956: 8 total, 8 up, 8 in 2024-01-13T18:16:33.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:33 smithi084 ceph-mon[116404]: pgmap v1173: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:33 smithi084 ceph-mon[119097]: osdmap e956: 8 total, 8 up, 8 in 2024-01-13T18:16:33.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:33 smithi084 ceph-mon[119097]: pgmap v1173: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:34 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:34 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:16:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:34 smithi099 ceph-mon[138788]: osdmap e957: 8 total, 8 up, 8 in 2024-01-13T18:16:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:34 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3944444089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:34.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:34 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:34.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:34 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:34.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:34 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:16:34.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:34 smithi084 ceph-mon[116404]: osdmap e957: 8 total, 8 up, 8 in 2024-01-13T18:16:34.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:34 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3944444089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:34.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:34 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:34 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:34 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:16:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:34 smithi084 ceph-mon[119097]: osdmap e957: 8 total, 8 up, 8 in 2024-01-13T18:16:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:34 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3944444089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:34.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:34 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:35.049 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsHello.SayHello (2893 ms) 2024-01-13T18:16:35.049 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsHello.RecordHello 2024-01-13T18:16:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:35 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:35 smithi099 ceph-mon[138788]: osdmap e958: 8 total, 8 up, 8 in 2024-01-13T18:16:35.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:35 smithi099 ceph-mon[138788]: pgmap v1176: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:35.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:35 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:35.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:35 smithi084 ceph-mon[116404]: osdmap e958: 8 total, 8 up, 8 in 2024-01-13T18:16:35.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:35 smithi084 ceph-mon[116404]: pgmap v1176: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:35.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:35 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:35.432 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:35 smithi084 ceph-mon[119097]: osdmap e958: 8 total, 8 up, 8 in 2024-01-13T18:16:35.432 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:35 smithi084 ceph-mon[119097]: pgmap v1176: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:36.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:36 smithi099 ceph-mon[138788]: osdmap e959: 8 total, 8 up, 8 in 2024-01-13T18:16:36.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:36.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:36.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:36 smithi084 ceph-mon[119097]: osdmap e959: 8 total, 8 up, 8 in 2024-01-13T18:16:36.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:36.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:36.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:36 smithi084 ceph-mon[116404]: osdmap e959: 8 total, 8 up, 8 in 2024-01-13T18:16:36.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:16:36.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:37.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:37 smithi099 ceph-mon[138788]: osdmap e960: 8 total, 8 up, 8 in 2024-01-13T18:16:37.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:37 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1057446932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:37.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:37 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:37.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:37 smithi099 ceph-mon[138788]: pgmap v1179: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:37.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:37 smithi084 ceph-mon[116404]: osdmap e960: 8 total, 8 up, 8 in 2024-01-13T18:16:37.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:37 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1057446932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:37.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:37 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:37.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:37 smithi084 ceph-mon[116404]: pgmap v1179: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:37.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:37 smithi084 ceph-mon[119097]: osdmap e960: 8 total, 8 up, 8 in 2024-01-13T18:16:37.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:37 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1057446932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:37.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:37 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:37.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:37 smithi084 ceph-mon[119097]: pgmap v1179: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:38.082 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsHello.RecordHello (3033 ms) 2024-01-13T18:16:38.082 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsHello.WriteReturnData 2024-01-13T18:16:38.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:38 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:38.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:38 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:38.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:38 smithi099 ceph-mon[138788]: osdmap e961: 8 total, 8 up, 8 in 2024-01-13T18:16:38.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:38 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:38.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:38 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:38.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:38 smithi084 ceph-mon[116404]: osdmap e961: 8 total, 8 up, 8 in 2024-01-13T18:16:38.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:38 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:38.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:38 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:38.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:38 smithi084 ceph-mon[119097]: osdmap e961: 8 total, 8 up, 8 in 2024-01-13T18:16:39.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:39 smithi099 ceph-mon[138788]: osdmap e962: 8 total, 8 up, 8 in 2024-01-13T18:16:39.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:39 smithi099 ceph-mon[138788]: pgmap v1182: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:39.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:39 smithi084 ceph-mon[116404]: osdmap e962: 8 total, 8 up, 8 in 2024-01-13T18:16:39.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:39 smithi084 ceph-mon[116404]: pgmap v1182: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:39.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:39 smithi084 ceph-mon[119097]: osdmap e962: 8 total, 8 up, 8 in 2024-01-13T18:16:39.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:39 smithi084 ceph-mon[119097]: pgmap v1182: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:40.102 INFO:tasks.workunit.client.0.smithi084.stdout:require_osd_release = reef 2024-01-13T18:16:40.111 INFO:tasks.workunit.client.0.smithi084.stdout:0 2024-01-13T18:16:40.294 INFO:tasks.workunit.client.0.smithi084.stdout:1 2024-01-13T18:16:40.295 INFO:tasks.workunit.client.0.smithi084.stdout:2 2024-01-13T18:16:40.296 INFO:tasks.workunit.client.0.smithi084.stdout:3 2024-01-13T18:16:40.297 INFO:tasks.workunit.client.0.smithi084.stdout:4 2024-01-13T18:16:40.298 INFO:tasks.workunit.client.0.smithi084.stdout:5 2024-01-13T18:16:40.299 INFO:tasks.workunit.client.0.smithi084.stdout:6 2024-01-13T18:16:40.300 INFO:tasks.workunit.client.0.smithi084.stdout:7 2024-01-13T18:16:40.301 INFO:tasks.workunit.client.0.smithi084.stdout:8 2024-01-13T18:16:40.301 INFO:tasks.workunit.client.0.smithi084.stdout:9 2024-01-13T18:16:40.302 INFO:tasks.workunit.client.0.smithi084.stdout:10 2024-01-13T18:16:40.303 INFO:tasks.workunit.client.0.smithi084.stdout:11 2024-01-13T18:16:40.304 INFO:tasks.workunit.client.0.smithi084.stdout:12 2024-01-13T18:16:40.305 INFO:tasks.workunit.client.0.smithi084.stdout:13 2024-01-13T18:16:40.306 INFO:tasks.workunit.client.0.smithi084.stdout:14 2024-01-13T18:16:40.307 INFO:tasks.workunit.client.0.smithi084.stdout:15 2024-01-13T18:16:40.308 INFO:tasks.workunit.client.0.smithi084.stdout:16 2024-01-13T18:16:40.309 INFO:tasks.workunit.client.0.smithi084.stdout:17 2024-01-13T18:16:40.309 INFO:tasks.workunit.client.0.smithi084.stdout:18 2024-01-13T18:16:40.310 INFO:tasks.workunit.client.0.smithi084.stdout:19 2024-01-13T18:16:40.311 INFO:tasks.workunit.client.0.smithi084.stdout:20 2024-01-13T18:16:40.312 INFO:tasks.workunit.client.0.smithi084.stdout:21 2024-01-13T18:16:40.313 INFO:tasks.workunit.client.0.smithi084.stdout:22 2024-01-13T18:16:40.314 INFO:tasks.workunit.client.0.smithi084.stdout:23 2024-01-13T18:16:40.315 INFO:tasks.workunit.client.0.smithi084.stdout:24 2024-01-13T18:16:40.315 INFO:tasks.workunit.client.0.smithi084.stdout:25 2024-01-13T18:16:40.316 INFO:tasks.workunit.client.0.smithi084.stdout:26 2024-01-13T18:16:40.317 INFO:tasks.workunit.client.0.smithi084.stdout:27 2024-01-13T18:16:40.318 INFO:tasks.workunit.client.0.smithi084.stdout:28 2024-01-13T18:16:40.319 INFO:tasks.workunit.client.0.smithi084.stdout:29 2024-01-13T18:16:40.320 INFO:tasks.workunit.client.0.smithi084.stdout:30 2024-01-13T18:16:40.320 INFO:tasks.workunit.client.0.smithi084.stdout:31 2024-01-13T18:16:40.321 INFO:tasks.workunit.client.0.smithi084.stdout:32 2024-01-13T18:16:40.322 INFO:tasks.workunit.client.0.smithi084.stdout:33 2024-01-13T18:16:40.323 INFO:tasks.workunit.client.0.smithi084.stdout:34 2024-01-13T18:16:40.324 INFO:tasks.workunit.client.0.smithi084.stdout:35 2024-01-13T18:16:40.325 INFO:tasks.workunit.client.0.smithi084.stdout:36 2024-01-13T18:16:40.326 INFO:tasks.workunit.client.0.smithi084.stdout:37 2024-01-13T18:16:40.326 INFO:tasks.workunit.client.0.smithi084.stdout:38 2024-01-13T18:16:40.327 INFO:tasks.workunit.client.0.smithi084.stdout:39 2024-01-13T18:16:40.328 INFO:tasks.workunit.client.0.smithi084.stdout:40 2024-01-13T18:16:40.329 INFO:tasks.workunit.client.0.smithi084.stdout:41 2024-01-13T18:16:40.330 INFO:tasks.workunit.client.0.smithi084.stdout:42 2024-01-13T18:16:40.331 INFO:tasks.workunit.client.0.smithi084.stdout:43 2024-01-13T18:16:40.331 INFO:tasks.workunit.client.0.smithi084.stdout:44 2024-01-13T18:16:40.332 INFO:tasks.workunit.client.0.smithi084.stdout:45 2024-01-13T18:16:40.333 INFO:tasks.workunit.client.0.smithi084.stdout:46 2024-01-13T18:16:40.334 INFO:tasks.workunit.client.0.smithi084.stdout:47 2024-01-13T18:16:40.335 INFO:tasks.workunit.client.0.smithi084.stdout:48 2024-01-13T18:16:40.335 INFO:tasks.workunit.client.0.smithi084.stdout:49 2024-01-13T18:16:40.336 INFO:tasks.workunit.client.0.smithi084.stdout:50 2024-01-13T18:16:40.337 INFO:tasks.workunit.client.0.smithi084.stdout:51 2024-01-13T18:16:40.338 INFO:tasks.workunit.client.0.smithi084.stdout:52 2024-01-13T18:16:40.339 INFO:tasks.workunit.client.0.smithi084.stdout:53 2024-01-13T18:16:40.339 INFO:tasks.workunit.client.0.smithi084.stdout:54 2024-01-13T18:16:40.340 INFO:tasks.workunit.client.0.smithi084.stdout:55 2024-01-13T18:16:40.341 INFO:tasks.workunit.client.0.smithi084.stdout:56 2024-01-13T18:16:40.342 INFO:tasks.workunit.client.0.smithi084.stdout:57 2024-01-13T18:16:40.343 INFO:tasks.workunit.client.0.smithi084.stdout:58 2024-01-13T18:16:40.343 INFO:tasks.workunit.client.0.smithi084.stdout:59 2024-01-13T18:16:40.348 INFO:tasks.workunit.client.0.smithi084.stdout:60 2024-01-13T18:16:40.348 INFO:tasks.workunit.client.0.smithi084.stdout:61 2024-01-13T18:16:40.348 INFO:tasks.workunit.client.0.smithi084.stdout:62 2024-01-13T18:16:40.348 INFO:tasks.workunit.client.0.smithi084.stdout:63 2024-01-13T18:16:40.348 INFO:tasks.workunit.client.0.smithi084.stdout:64 2024-01-13T18:16:40.348 INFO:tasks.workunit.client.0.smithi084.stdout:65 2024-01-13T18:16:40.349 INFO:tasks.workunit.client.0.smithi084.stdout:66 2024-01-13T18:16:40.350 INFO:tasks.workunit.client.0.smithi084.stdout:67 2024-01-13T18:16:40.351 INFO:tasks.workunit.client.0.smithi084.stdout:68 2024-01-13T18:16:40.351 INFO:tasks.workunit.client.0.smithi084.stdout:69 2024-01-13T18:16:40.352 INFO:tasks.workunit.client.0.smithi084.stdout:70 2024-01-13T18:16:40.353 INFO:tasks.workunit.client.0.smithi084.stdout:71 2024-01-13T18:16:40.354 INFO:tasks.workunit.client.0.smithi084.stdout:72 2024-01-13T18:16:40.355 INFO:tasks.workunit.client.0.smithi084.stdout:73 2024-01-13T18:16:40.356 INFO:tasks.workunit.client.0.smithi084.stdout:74 2024-01-13T18:16:40.356 INFO:tasks.workunit.client.0.smithi084.stdout:75 2024-01-13T18:16:40.357 INFO:tasks.workunit.client.0.smithi084.stdout:76 2024-01-13T18:16:40.358 INFO:tasks.workunit.client.0.smithi084.stdout:77 2024-01-13T18:16:40.359 INFO:tasks.workunit.client.0.smithi084.stdout:78 2024-01-13T18:16:40.360 INFO:tasks.workunit.client.0.smithi084.stdout:79 2024-01-13T18:16:40.360 INFO:tasks.workunit.client.0.smithi084.stdout:80 2024-01-13T18:16:40.361 INFO:tasks.workunit.client.0.smithi084.stdout:81 2024-01-13T18:16:40.362 INFO:tasks.workunit.client.0.smithi084.stdout:82 2024-01-13T18:16:40.363 INFO:tasks.workunit.client.0.smithi084.stdout:83 2024-01-13T18:16:40.364 INFO:tasks.workunit.client.0.smithi084.stdout:84 2024-01-13T18:16:40.364 INFO:tasks.workunit.client.0.smithi084.stdout:85 2024-01-13T18:16:40.365 INFO:tasks.workunit.client.0.smithi084.stdout:86 2024-01-13T18:16:40.366 INFO:tasks.workunit.client.0.smithi084.stdout:87 2024-01-13T18:16:40.367 INFO:tasks.workunit.client.0.smithi084.stdout:88 2024-01-13T18:16:40.367 INFO:tasks.workunit.client.0.smithi084.stdout:89 2024-01-13T18:16:40.368 INFO:tasks.workunit.client.0.smithi084.stdout:90 2024-01-13T18:16:40.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:40 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:40.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:40 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:16:40.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:40 smithi099 ceph-mon[138788]: osdmap e963: 8 total, 8 up, 8 in 2024-01-13T18:16:40.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:40 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2959097420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:40.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:40 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:40.369 INFO:tasks.workunit.client.0.smithi084.stdout:91 2024-01-13T18:16:40.370 INFO:tasks.workunit.client.0.smithi084.stdout:92 2024-01-13T18:16:40.371 INFO:tasks.workunit.client.0.smithi084.stdout:93 2024-01-13T18:16:40.371 INFO:tasks.workunit.client.0.smithi084.stdout:94 2024-01-13T18:16:40.372 INFO:tasks.workunit.client.0.smithi084.stdout:95 2024-01-13T18:16:40.373 INFO:tasks.workunit.client.0.smithi084.stdout:96 2024-01-13T18:16:40.374 INFO:tasks.workunit.client.0.smithi084.stdout:97 2024-01-13T18:16:40.374 INFO:tasks.workunit.client.0.smithi084.stdout:98 2024-01-13T18:16:40.375 INFO:tasks.workunit.client.0.smithi084.stdout:99 2024-01-13T18:16:40.376 INFO:tasks.workunit.client.0.smithi084.stdout:100 2024-01-13T18:16:40.377 INFO:tasks.workunit.client.0.smithi084.stdout:101 2024-01-13T18:16:40.378 INFO:tasks.workunit.client.0.smithi084.stdout:102 2024-01-13T18:16:40.378 INFO:tasks.workunit.client.0.smithi084.stdout:103 2024-01-13T18:16:40.379 INFO:tasks.workunit.client.0.smithi084.stdout:104 2024-01-13T18:16:40.380 INFO:tasks.workunit.client.0.smithi084.stdout:105 2024-01-13T18:16:40.381 INFO:tasks.workunit.client.0.smithi084.stdout:106 2024-01-13T18:16:40.382 INFO:tasks.workunit.client.0.smithi084.stdout:107 2024-01-13T18:16:40.382 INFO:tasks.workunit.client.0.smithi084.stdout:108 2024-01-13T18:16:40.383 INFO:tasks.workunit.client.0.smithi084.stdout:109 2024-01-13T18:16:40.384 INFO:tasks.workunit.client.0.smithi084.stdout:110 2024-01-13T18:16:40.385 INFO:tasks.workunit.client.0.smithi084.stdout:111 2024-01-13T18:16:40.386 INFO:tasks.workunit.client.0.smithi084.stdout:112 2024-01-13T18:16:40.387 INFO:tasks.workunit.client.0.smithi084.stdout:113 2024-01-13T18:16:40.387 INFO:tasks.workunit.client.0.smithi084.stdout:114 2024-01-13T18:16:40.388 INFO:tasks.workunit.client.0.smithi084.stdout:115 2024-01-13T18:16:40.389 INFO:tasks.workunit.client.0.smithi084.stdout:116 2024-01-13T18:16:40.390 INFO:tasks.workunit.client.0.smithi084.stdout:117 2024-01-13T18:16:40.391 INFO:tasks.workunit.client.0.smithi084.stdout:118 2024-01-13T18:16:40.391 INFO:tasks.workunit.client.0.smithi084.stdout:119 2024-01-13T18:16:40.392 INFO:tasks.workunit.client.0.smithi084.stdout:120 2024-01-13T18:16:40.393 INFO:tasks.workunit.client.0.smithi084.stdout:121 2024-01-13T18:16:40.394 INFO:tasks.workunit.client.0.smithi084.stdout:122 2024-01-13T18:16:40.395 INFO:tasks.workunit.client.0.smithi084.stdout:123 2024-01-13T18:16:40.395 INFO:tasks.workunit.client.0.smithi084.stdout:124 2024-01-13T18:16:40.396 INFO:tasks.workunit.client.0.smithi084.stdout:125 2024-01-13T18:16:40.397 INFO:tasks.workunit.client.0.smithi084.stdout:126 2024-01-13T18:16:40.398 INFO:tasks.workunit.client.0.smithi084.stdout:127 2024-01-13T18:16:40.399 INFO:tasks.workunit.client.0.smithi084.stdout:128 2024-01-13T18:16:40.399 INFO:tasks.workunit.client.0.smithi084.stdout:129 2024-01-13T18:16:40.400 INFO:tasks.workunit.client.0.smithi084.stdout:130 2024-01-13T18:16:40.401 INFO:tasks.workunit.client.0.smithi084.stdout:131 2024-01-13T18:16:40.402 INFO:tasks.workunit.client.0.smithi084.stdout:132 2024-01-13T18:16:40.403 INFO:tasks.workunit.client.0.smithi084.stdout:133 2024-01-13T18:16:40.404 INFO:tasks.workunit.client.0.smithi084.stdout:134 2024-01-13T18:16:40.404 INFO:tasks.workunit.client.0.smithi084.stdout:135 2024-01-13T18:16:40.405 INFO:tasks.workunit.client.0.smithi084.stdout:136 2024-01-13T18:16:40.406 INFO:tasks.workunit.client.0.smithi084.stdout:137 2024-01-13T18:16:40.407 INFO:tasks.workunit.client.0.smithi084.stdout:138 2024-01-13T18:16:40.408 INFO:tasks.workunit.client.0.smithi084.stdout:139 2024-01-13T18:16:40.409 INFO:tasks.workunit.client.0.smithi084.stdout:140 2024-01-13T18:16:40.409 INFO:tasks.workunit.client.0.smithi084.stdout:141 2024-01-13T18:16:40.410 INFO:tasks.workunit.client.0.smithi084.stdout:142 2024-01-13T18:16:40.411 INFO:tasks.workunit.client.0.smithi084.stdout:143 2024-01-13T18:16:40.412 INFO:tasks.workunit.client.0.smithi084.stdout:144 2024-01-13T18:16:40.413 INFO:tasks.workunit.client.0.smithi084.stdout:145 2024-01-13T18:16:40.413 INFO:tasks.workunit.client.0.smithi084.stdout:146 2024-01-13T18:16:40.414 INFO:tasks.workunit.client.0.smithi084.stdout:147 2024-01-13T18:16:40.415 INFO:tasks.workunit.client.0.smithi084.stdout:148 2024-01-13T18:16:40.416 INFO:tasks.workunit.client.0.smithi084.stdout:149 2024-01-13T18:16:40.416 INFO:tasks.workunit.client.0.smithi084.stdout:150 2024-01-13T18:16:40.417 INFO:tasks.workunit.client.0.smithi084.stdout:151 2024-01-13T18:16:40.418 INFO:tasks.workunit.client.0.smithi084.stdout:152 2024-01-13T18:16:40.419 INFO:tasks.workunit.client.0.smithi084.stdout:153 2024-01-13T18:16:40.420 INFO:tasks.workunit.client.0.smithi084.stdout:154 2024-01-13T18:16:40.420 INFO:tasks.workunit.client.0.smithi084.stdout:155 2024-01-13T18:16:40.421 INFO:tasks.workunit.client.0.smithi084.stdout:156 2024-01-13T18:16:40.422 INFO:tasks.workunit.client.0.smithi084.stdout:157 2024-01-13T18:16:40.422 INFO:tasks.workunit.client.0.smithi084.stdout:158 2024-01-13T18:16:40.423 INFO:tasks.workunit.client.0.smithi084.stdout:159 2024-01-13T18:16:40.424 INFO:tasks.workunit.client.0.smithi084.stdout:160 2024-01-13T18:16:40.425 INFO:tasks.workunit.client.0.smithi084.stdout:161 2024-01-13T18:16:40.426 INFO:tasks.workunit.client.0.smithi084.stdout:162 2024-01-13T18:16:40.427 INFO:tasks.workunit.client.0.smithi084.stdout:163 2024-01-13T18:16:40.427 INFO:tasks.workunit.client.0.smithi084.stdout:164 2024-01-13T18:16:40.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:16:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:16:40] "GET /metrics HTTP/1.1" 200 33913 "" "Prometheus/2.43.0" 2024-01-13T18:16:40.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:40 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:40.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:40 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:16:40.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:40 smithi084 ceph-mon[119097]: osdmap e963: 8 total, 8 up, 8 in 2024-01-13T18:16:40.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:40 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2959097420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:40.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:40 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:40.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:40 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:40.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:40 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:16:40.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:40 smithi084 ceph-mon[116404]: osdmap e963: 8 total, 8 up, 8 in 2024-01-13T18:16:40.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:40 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2959097420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:40.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:40 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:40.430 INFO:tasks.workunit.client.0.smithi084.stdout:165 2024-01-13T18:16:40.430 INFO:tasks.workunit.client.0.smithi084.stdout:166 2024-01-13T18:16:40.430 INFO:tasks.workunit.client.0.smithi084.stdout:167 2024-01-13T18:16:40.430 INFO:tasks.workunit.client.0.smithi084.stdout:168 2024-01-13T18:16:40.431 INFO:tasks.workunit.client.0.smithi084.stdout:169 2024-01-13T18:16:40.432 INFO:tasks.workunit.client.0.smithi084.stdout:170 2024-01-13T18:16:40.433 INFO:tasks.workunit.client.0.smithi084.stdout:171 2024-01-13T18:16:40.434 INFO:tasks.workunit.client.0.smithi084.stdout:172 2024-01-13T18:16:40.434 INFO:tasks.workunit.client.0.smithi084.stdout:173 2024-01-13T18:16:40.435 INFO:tasks.workunit.client.0.smithi084.stdout:174 2024-01-13T18:16:40.436 INFO:tasks.workunit.client.0.smithi084.stdout:175 2024-01-13T18:16:40.437 INFO:tasks.workunit.client.0.smithi084.stdout:176 2024-01-13T18:16:40.438 INFO:tasks.workunit.client.0.smithi084.stdout:177 2024-01-13T18:16:40.438 INFO:tasks.workunit.client.0.smithi084.stdout:178 2024-01-13T18:16:40.439 INFO:tasks.workunit.client.0.smithi084.stdout:179 2024-01-13T18:16:40.440 INFO:tasks.workunit.client.0.smithi084.stdout:180 2024-01-13T18:16:40.441 INFO:tasks.workunit.client.0.smithi084.stdout:181 2024-01-13T18:16:40.441 INFO:tasks.workunit.client.0.smithi084.stdout:182 2024-01-13T18:16:40.442 INFO:tasks.workunit.client.0.smithi084.stdout:183 2024-01-13T18:16:40.443 INFO:tasks.workunit.client.0.smithi084.stdout:184 2024-01-13T18:16:40.444 INFO:tasks.workunit.client.0.smithi084.stdout:185 2024-01-13T18:16:40.445 INFO:tasks.workunit.client.0.smithi084.stdout:186 2024-01-13T18:16:40.445 INFO:tasks.workunit.client.0.smithi084.stdout:187 2024-01-13T18:16:40.446 INFO:tasks.workunit.client.0.smithi084.stdout:188 2024-01-13T18:16:40.447 INFO:tasks.workunit.client.0.smithi084.stdout:189 2024-01-13T18:16:40.448 INFO:tasks.workunit.client.0.smithi084.stdout:190 2024-01-13T18:16:40.449 INFO:tasks.workunit.client.0.smithi084.stdout:191 2024-01-13T18:16:40.449 INFO:tasks.workunit.client.0.smithi084.stdout:192 2024-01-13T18:16:40.450 INFO:tasks.workunit.client.0.smithi084.stdout:193 2024-01-13T18:16:40.451 INFO:tasks.workunit.client.0.smithi084.stdout:194 2024-01-13T18:16:40.452 INFO:tasks.workunit.client.0.smithi084.stdout:195 2024-01-13T18:16:40.453 INFO:tasks.workunit.client.0.smithi084.stdout:196 2024-01-13T18:16:40.453 INFO:tasks.workunit.client.0.smithi084.stdout:197 2024-01-13T18:16:40.454 INFO:tasks.workunit.client.0.smithi084.stdout:198 2024-01-13T18:16:40.455 INFO:tasks.workunit.client.0.smithi084.stdout:199 2024-01-13T18:16:40.456 INFO:tasks.workunit.client.0.smithi084.stdout:200 2024-01-13T18:16:40.456 INFO:tasks.workunit.client.0.smithi084.stdout:201 2024-01-13T18:16:40.457 INFO:tasks.workunit.client.0.smithi084.stdout:202 2024-01-13T18:16:40.458 INFO:tasks.workunit.client.0.smithi084.stdout:203 2024-01-13T18:16:40.459 INFO:tasks.workunit.client.0.smithi084.stdout:204 2024-01-13T18:16:40.460 INFO:tasks.workunit.client.0.smithi084.stdout:205 2024-01-13T18:16:40.461 INFO:tasks.workunit.client.0.smithi084.stdout:206 2024-01-13T18:16:40.461 INFO:tasks.workunit.client.0.smithi084.stdout:207 2024-01-13T18:16:40.462 INFO:tasks.workunit.client.0.smithi084.stdout:208 2024-01-13T18:16:40.463 INFO:tasks.workunit.client.0.smithi084.stdout:209 2024-01-13T18:16:40.463 INFO:tasks.workunit.client.0.smithi084.stdout:210 2024-01-13T18:16:40.464 INFO:tasks.workunit.client.0.smithi084.stdout:211 2024-01-13T18:16:40.465 INFO:tasks.workunit.client.0.smithi084.stdout:212 2024-01-13T18:16:40.466 INFO:tasks.workunit.client.0.smithi084.stdout:213 2024-01-13T18:16:40.467 INFO:tasks.workunit.client.0.smithi084.stdout:214 2024-01-13T18:16:40.467 INFO:tasks.workunit.client.0.smithi084.stdout:215 2024-01-13T18:16:40.468 INFO:tasks.workunit.client.0.smithi084.stdout:216 2024-01-13T18:16:40.469 INFO:tasks.workunit.client.0.smithi084.stdout:217 2024-01-13T18:16:40.470 INFO:tasks.workunit.client.0.smithi084.stdout:218 2024-01-13T18:16:40.471 INFO:tasks.workunit.client.0.smithi084.stdout:219 2024-01-13T18:16:40.471 INFO:tasks.workunit.client.0.smithi084.stdout:220 2024-01-13T18:16:40.472 INFO:tasks.workunit.client.0.smithi084.stdout:221 2024-01-13T18:16:40.473 INFO:tasks.workunit.client.0.smithi084.stdout:222 2024-01-13T18:16:40.474 INFO:tasks.workunit.client.0.smithi084.stdout:223 2024-01-13T18:16:40.475 INFO:tasks.workunit.client.0.smithi084.stdout:224 2024-01-13T18:16:40.475 INFO:tasks.workunit.client.0.smithi084.stdout:225 2024-01-13T18:16:40.476 INFO:tasks.workunit.client.0.smithi084.stdout:226 2024-01-13T18:16:40.477 INFO:tasks.workunit.client.0.smithi084.stdout:227 2024-01-13T18:16:40.478 INFO:tasks.workunit.client.0.smithi084.stdout:228 2024-01-13T18:16:40.478 INFO:tasks.workunit.client.0.smithi084.stdout:229 2024-01-13T18:16:40.479 INFO:tasks.workunit.client.0.smithi084.stdout:230 2024-01-13T18:16:40.480 INFO:tasks.workunit.client.0.smithi084.stdout:231 2024-01-13T18:16:40.481 INFO:tasks.workunit.client.0.smithi084.stdout:232 2024-01-13T18:16:40.481 INFO:tasks.workunit.client.0.smithi084.stdout:233 2024-01-13T18:16:40.482 INFO:tasks.workunit.client.0.smithi084.stdout:234 2024-01-13T18:16:40.483 INFO:tasks.workunit.client.0.smithi084.stdout:235 2024-01-13T18:16:40.484 INFO:tasks.workunit.client.0.smithi084.stdout:236 2024-01-13T18:16:40.485 INFO:tasks.workunit.client.0.smithi084.stdout:237 2024-01-13T18:16:40.485 INFO:tasks.workunit.client.0.smithi084.stdout:238 2024-01-13T18:16:40.486 INFO:tasks.workunit.client.0.smithi084.stdout:239 2024-01-13T18:16:40.487 INFO:tasks.workunit.client.0.smithi084.stdout:240 2024-01-13T18:16:40.488 INFO:tasks.workunit.client.0.smithi084.stdout:241 2024-01-13T18:16:40.489 INFO:tasks.workunit.client.0.smithi084.stdout:242 2024-01-13T18:16:40.490 INFO:tasks.workunit.client.0.smithi084.stdout:243 2024-01-13T18:16:40.490 INFO:tasks.workunit.client.0.smithi084.stdout:244 2024-01-13T18:16:40.491 INFO:tasks.workunit.client.0.smithi084.stdout:245 2024-01-13T18:16:40.492 INFO:tasks.workunit.client.0.smithi084.stdout:246 2024-01-13T18:16:40.493 INFO:tasks.workunit.client.0.smithi084.stdout:247 2024-01-13T18:16:40.494 INFO:tasks.workunit.client.0.smithi084.stdout:248 2024-01-13T18:16:40.495 INFO:tasks.workunit.client.0.smithi084.stdout:249 2024-01-13T18:16:40.495 INFO:tasks.workunit.client.0.smithi084.stdout:250 2024-01-13T18:16:40.496 INFO:tasks.workunit.client.0.smithi084.stdout:251 2024-01-13T18:16:40.497 INFO:tasks.workunit.client.0.smithi084.stdout:252 2024-01-13T18:16:40.498 INFO:tasks.workunit.client.0.smithi084.stdout:253 2024-01-13T18:16:40.499 INFO:tasks.workunit.client.0.smithi084.stdout:254 2024-01-13T18:16:40.499 INFO:tasks.workunit.client.0.smithi084.stdout:255 2024-01-13T18:16:40.500 INFO:tasks.workunit.client.0.smithi084.stdout:256 2024-01-13T18:16:40.501 INFO:tasks.workunit.client.0.smithi084.stdout:257 2024-01-13T18:16:40.502 INFO:tasks.workunit.client.0.smithi084.stdout:258 2024-01-13T18:16:40.503 INFO:tasks.workunit.client.0.smithi084.stdout:259 2024-01-13T18:16:40.504 INFO:tasks.workunit.client.0.smithi084.stdout:260 2024-01-13T18:16:40.504 INFO:tasks.workunit.client.0.smithi084.stdout:261 2024-01-13T18:16:40.505 INFO:tasks.workunit.client.0.smithi084.stdout:262 2024-01-13T18:16:40.506 INFO:tasks.workunit.client.0.smithi084.stdout:263 2024-01-13T18:16:40.507 INFO:tasks.workunit.client.0.smithi084.stdout:264 2024-01-13T18:16:40.507 INFO:tasks.workunit.client.0.smithi084.stdout:265 2024-01-13T18:16:40.508 INFO:tasks.workunit.client.0.smithi084.stdout:266 2024-01-13T18:16:40.509 INFO:tasks.workunit.client.0.smithi084.stdout:267 2024-01-13T18:16:40.510 INFO:tasks.workunit.client.0.smithi084.stdout:268 2024-01-13T18:16:40.510 INFO:tasks.workunit.client.0.smithi084.stdout:269 2024-01-13T18:16:40.511 INFO:tasks.workunit.client.0.smithi084.stdout:270 2024-01-13T18:16:40.512 INFO:tasks.workunit.client.0.smithi084.stdout:271 2024-01-13T18:16:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:272 2024-01-13T18:16:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:273 2024-01-13T18:16:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:274 2024-01-13T18:16:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:275 2024-01-13T18:16:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:276 2024-01-13T18:16:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:277 2024-01-13T18:16:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:278 2024-01-13T18:16:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:279 2024-01-13T18:16:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:280 2024-01-13T18:16:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:281 2024-01-13T18:16:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:282 2024-01-13T18:16:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:283 2024-01-13T18:16:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:284 2024-01-13T18:16:40.524 INFO:tasks.workunit.client.0.smithi084.stdout:285 2024-01-13T18:16:40.524 INFO:tasks.workunit.client.0.smithi084.stdout:286 2024-01-13T18:16:40.525 INFO:tasks.workunit.client.0.smithi084.stdout:287 2024-01-13T18:16:40.526 INFO:tasks.workunit.client.0.smithi084.stdout:288 2024-01-13T18:16:40.527 INFO:tasks.workunit.client.0.smithi084.stdout:289 2024-01-13T18:16:40.528 INFO:tasks.workunit.client.0.smithi084.stdout:290 2024-01-13T18:16:40.528 INFO:tasks.workunit.client.0.smithi084.stdout:291 2024-01-13T18:16:40.529 INFO:tasks.workunit.client.0.smithi084.stdout:292 2024-01-13T18:16:40.530 INFO:tasks.workunit.client.0.smithi084.stdout:293 2024-01-13T18:16:40.531 INFO:tasks.workunit.client.0.smithi084.stdout:294 2024-01-13T18:16:40.532 INFO:tasks.workunit.client.0.smithi084.stdout:295 2024-01-13T18:16:40.532 INFO:tasks.workunit.client.0.smithi084.stdout:296 2024-01-13T18:16:40.533 INFO:tasks.workunit.client.0.smithi084.stdout:297 2024-01-13T18:16:40.534 INFO:tasks.workunit.client.0.smithi084.stdout:298 2024-01-13T18:16:40.535 INFO:tasks.workunit.client.0.smithi084.stdout:299 2024-01-13T18:16:40.536 INFO:tasks.workunit.client.0.smithi084.stdout:300 2024-01-13T18:16:40.537 INFO:tasks.workunit.client.0.smithi084.stdout:301 2024-01-13T18:16:40.538 INFO:tasks.workunit.client.0.smithi084.stdout:302 2024-01-13T18:16:40.538 INFO:tasks.workunit.client.0.smithi084.stdout:303 2024-01-13T18:16:40.539 INFO:tasks.workunit.client.0.smithi084.stdout:304 2024-01-13T18:16:40.540 INFO:tasks.workunit.client.0.smithi084.stdout:305 2024-01-13T18:16:40.541 INFO:tasks.workunit.client.0.smithi084.stdout:306 2024-01-13T18:16:40.542 INFO:tasks.workunit.client.0.smithi084.stdout:307 2024-01-13T18:16:40.542 INFO:tasks.workunit.client.0.smithi084.stdout:308 2024-01-13T18:16:40.543 INFO:tasks.workunit.client.0.smithi084.stdout:309 2024-01-13T18:16:40.544 INFO:tasks.workunit.client.0.smithi084.stdout:310 2024-01-13T18:16:40.545 INFO:tasks.workunit.client.0.smithi084.stdout:311 2024-01-13T18:16:40.546 INFO:tasks.workunit.client.0.smithi084.stdout:312 2024-01-13T18:16:40.546 INFO:tasks.workunit.client.0.smithi084.stdout:313 2024-01-13T18:16:40.547 INFO:tasks.workunit.client.0.smithi084.stdout:314 2024-01-13T18:16:40.548 INFO:tasks.workunit.client.0.smithi084.stdout:315 2024-01-13T18:16:40.551 INFO:tasks.workunit.client.0.smithi084.stdout:316 2024-01-13T18:16:40.551 INFO:tasks.workunit.client.0.smithi084.stdout:317 2024-01-13T18:16:40.551 INFO:tasks.workunit.client.0.smithi084.stdout:318 2024-01-13T18:16:40.552 INFO:tasks.workunit.client.0.smithi084.stdout:319 2024-01-13T18:16:40.553 INFO:tasks.workunit.client.0.smithi084.stdout:320 2024-01-13T18:16:40.556 INFO:tasks.workunit.client.0.smithi084.stdout:321 2024-01-13T18:16:40.556 INFO:tasks.workunit.client.0.smithi084.stdout:322 2024-01-13T18:16:40.556 INFO:tasks.workunit.client.0.smithi084.stdout:323 2024-01-13T18:16:40.556 INFO:tasks.workunit.client.0.smithi084.stdout:324 2024-01-13T18:16:40.559 INFO:tasks.workunit.client.0.smithi084.stdout:325 2024-01-13T18:16:40.559 INFO:tasks.workunit.client.0.smithi084.stdout:326 2024-01-13T18:16:40.559 INFO:tasks.workunit.client.0.smithi084.stdout:327 2024-01-13T18:16:40.559 INFO:tasks.workunit.client.0.smithi084.stdout:328 2024-01-13T18:16:40.560 INFO:tasks.workunit.client.0.smithi084.stdout:329 2024-01-13T18:16:40.561 INFO:tasks.workunit.client.0.smithi084.stdout:330 2024-01-13T18:16:40.562 INFO:tasks.workunit.client.0.smithi084.stdout:331 2024-01-13T18:16:40.563 INFO:tasks.workunit.client.0.smithi084.stdout:332 2024-01-13T18:16:40.563 INFO:tasks.workunit.client.0.smithi084.stdout:333 2024-01-13T18:16:40.564 INFO:tasks.workunit.client.0.smithi084.stdout:334 2024-01-13T18:16:40.565 INFO:tasks.workunit.client.0.smithi084.stdout:335 2024-01-13T18:16:40.566 INFO:tasks.workunit.client.0.smithi084.stdout:336 2024-01-13T18:16:40.567 INFO:tasks.workunit.client.0.smithi084.stdout:337 2024-01-13T18:16:40.568 INFO:tasks.workunit.client.0.smithi084.stdout:338 2024-01-13T18:16:40.568 INFO:tasks.workunit.client.0.smithi084.stdout:339 2024-01-13T18:16:40.569 INFO:tasks.workunit.client.0.smithi084.stdout:340 2024-01-13T18:16:40.570 INFO:tasks.workunit.client.0.smithi084.stdout:341 2024-01-13T18:16:40.571 INFO:tasks.workunit.client.0.smithi084.stdout:342 2024-01-13T18:16:40.572 INFO:tasks.workunit.client.0.smithi084.stdout:343 2024-01-13T18:16:40.573 INFO:tasks.workunit.client.0.smithi084.stdout:344 2024-01-13T18:16:40.573 INFO:tasks.workunit.client.0.smithi084.stdout:345 2024-01-13T18:16:40.574 INFO:tasks.workunit.client.0.smithi084.stdout:346 2024-01-13T18:16:40.575 INFO:tasks.workunit.client.0.smithi084.stdout:347 2024-01-13T18:16:40.576 INFO:tasks.workunit.client.0.smithi084.stdout:348 2024-01-13T18:16:40.577 INFO:tasks.workunit.client.0.smithi084.stdout:349 2024-01-13T18:16:40.578 INFO:tasks.workunit.client.0.smithi084.stdout:350 2024-01-13T18:16:40.579 INFO:tasks.workunit.client.0.smithi084.stdout:351 2024-01-13T18:16:40.580 INFO:tasks.workunit.client.0.smithi084.stdout:352 2024-01-13T18:16:40.580 INFO:tasks.workunit.client.0.smithi084.stdout:353 2024-01-13T18:16:40.581 INFO:tasks.workunit.client.0.smithi084.stdout:354 2024-01-13T18:16:40.582 INFO:tasks.workunit.client.0.smithi084.stdout:355 2024-01-13T18:16:40.583 INFO:tasks.workunit.client.0.smithi084.stdout:356 2024-01-13T18:16:40.584 INFO:tasks.workunit.client.0.smithi084.stdout:357 2024-01-13T18:16:40.584 INFO:tasks.workunit.client.0.smithi084.stdout:358 2024-01-13T18:16:40.585 INFO:tasks.workunit.client.0.smithi084.stdout:359 2024-01-13T18:16:40.586 INFO:tasks.workunit.client.0.smithi084.stdout:360 2024-01-13T18:16:40.587 INFO:tasks.workunit.client.0.smithi084.stdout:361 2024-01-13T18:16:40.588 INFO:tasks.workunit.client.0.smithi084.stdout:362 2024-01-13T18:16:40.588 INFO:tasks.workunit.client.0.smithi084.stdout:363 2024-01-13T18:16:40.590 INFO:tasks.workunit.client.0.smithi084.stdout:364 2024-01-13T18:16:40.590 INFO:tasks.workunit.client.0.smithi084.stdout:365 2024-01-13T18:16:40.591 INFO:tasks.workunit.client.0.smithi084.stdout:366 2024-01-13T18:16:40.592 INFO:tasks.workunit.client.0.smithi084.stdout:367 2024-01-13T18:16:40.593 INFO:tasks.workunit.client.0.smithi084.stdout:368 2024-01-13T18:16:40.594 INFO:tasks.workunit.client.0.smithi084.stdout:369 2024-01-13T18:16:40.595 INFO:tasks.workunit.client.0.smithi084.stdout:370 2024-01-13T18:16:40.596 INFO:tasks.workunit.client.0.smithi084.stdout:371 2024-01-13T18:16:40.596 INFO:tasks.workunit.client.0.smithi084.stdout:372 2024-01-13T18:16:40.597 INFO:tasks.workunit.client.0.smithi084.stdout:373 2024-01-13T18:16:40.598 INFO:tasks.workunit.client.0.smithi084.stdout:374 2024-01-13T18:16:40.599 INFO:tasks.workunit.client.0.smithi084.stdout:375 2024-01-13T18:16:40.600 INFO:tasks.workunit.client.0.smithi084.stdout:376 2024-01-13T18:16:40.601 INFO:tasks.workunit.client.0.smithi084.stdout:377 2024-01-13T18:16:40.602 INFO:tasks.workunit.client.0.smithi084.stdout:378 2024-01-13T18:16:40.603 INFO:tasks.workunit.client.0.smithi084.stdout:379 2024-01-13T18:16:40.603 INFO:tasks.workunit.client.0.smithi084.stdout:380 2024-01-13T18:16:40.604 INFO:tasks.workunit.client.0.smithi084.stdout:381 2024-01-13T18:16:40.605 INFO:tasks.workunit.client.0.smithi084.stdout:382 2024-01-13T18:16:40.606 INFO:tasks.workunit.client.0.smithi084.stdout:383 2024-01-13T18:16:40.607 INFO:tasks.workunit.client.0.smithi084.stdout:384 2024-01-13T18:16:40.608 INFO:tasks.workunit.client.0.smithi084.stdout:385 2024-01-13T18:16:40.609 INFO:tasks.workunit.client.0.smithi084.stdout:386 2024-01-13T18:16:40.610 INFO:tasks.workunit.client.0.smithi084.stdout:387 2024-01-13T18:16:40.611 INFO:tasks.workunit.client.0.smithi084.stdout:388 2024-01-13T18:16:40.611 INFO:tasks.workunit.client.0.smithi084.stdout:389 2024-01-13T18:16:40.612 INFO:tasks.workunit.client.0.smithi084.stdout:390 2024-01-13T18:16:40.613 INFO:tasks.workunit.client.0.smithi084.stdout:391 2024-01-13T18:16:40.614 INFO:tasks.workunit.client.0.smithi084.stdout:392 2024-01-13T18:16:40.615 INFO:tasks.workunit.client.0.smithi084.stdout:393 2024-01-13T18:16:40.616 INFO:tasks.workunit.client.0.smithi084.stdout:394 2024-01-13T18:16:40.617 INFO:tasks.workunit.client.0.smithi084.stdout:395 2024-01-13T18:16:40.617 INFO:tasks.workunit.client.0.smithi084.stdout:396 2024-01-13T18:16:40.618 INFO:tasks.workunit.client.0.smithi084.stdout:397 2024-01-13T18:16:40.619 INFO:tasks.workunit.client.0.smithi084.stdout:398 2024-01-13T18:16:40.620 INFO:tasks.workunit.client.0.smithi084.stdout:399 2024-01-13T18:16:40.621 INFO:tasks.workunit.client.0.smithi084.stdout:400 2024-01-13T18:16:40.622 INFO:tasks.workunit.client.0.smithi084.stdout:401 2024-01-13T18:16:40.623 INFO:tasks.workunit.client.0.smithi084.stdout:402 2024-01-13T18:16:40.623 INFO:tasks.workunit.client.0.smithi084.stdout:403 2024-01-13T18:16:40.624 INFO:tasks.workunit.client.0.smithi084.stdout:404 2024-01-13T18:16:40.625 INFO:tasks.workunit.client.0.smithi084.stdout:405 2024-01-13T18:16:40.626 INFO:tasks.workunit.client.0.smithi084.stdout:406 2024-01-13T18:16:40.627 INFO:tasks.workunit.client.0.smithi084.stdout:407 2024-01-13T18:16:40.628 INFO:tasks.workunit.client.0.smithi084.stdout:408 2024-01-13T18:16:40.629 INFO:tasks.workunit.client.0.smithi084.stdout:409 2024-01-13T18:16:40.629 INFO:tasks.workunit.client.0.smithi084.stdout:410 2024-01-13T18:16:40.630 INFO:tasks.workunit.client.0.smithi084.stdout:411 2024-01-13T18:16:40.631 INFO:tasks.workunit.client.0.smithi084.stdout:412 2024-01-13T18:16:40.632 INFO:tasks.workunit.client.0.smithi084.stdout:413 2024-01-13T18:16:40.633 INFO:tasks.workunit.client.0.smithi084.stdout:414 2024-01-13T18:16:40.634 INFO:tasks.workunit.client.0.smithi084.stdout:415 2024-01-13T18:16:40.635 INFO:tasks.workunit.client.0.smithi084.stdout:416 2024-01-13T18:16:40.635 INFO:tasks.workunit.client.0.smithi084.stdout:417 2024-01-13T18:16:40.636 INFO:tasks.workunit.client.0.smithi084.stdout:418 2024-01-13T18:16:40.637 INFO:tasks.workunit.client.0.smithi084.stdout:419 2024-01-13T18:16:40.638 INFO:tasks.workunit.client.0.smithi084.stdout:420 2024-01-13T18:16:40.639 INFO:tasks.workunit.client.0.smithi084.stdout:421 2024-01-13T18:16:40.640 INFO:tasks.workunit.client.0.smithi084.stdout:422 2024-01-13T18:16:40.641 INFO:tasks.workunit.client.0.smithi084.stdout:423 2024-01-13T18:16:40.642 INFO:tasks.workunit.client.0.smithi084.stdout:424 2024-01-13T18:16:40.643 INFO:tasks.workunit.client.0.smithi084.stdout:425 2024-01-13T18:16:40.644 INFO:tasks.workunit.client.0.smithi084.stdout:426 2024-01-13T18:16:40.644 INFO:tasks.workunit.client.0.smithi084.stdout:427 2024-01-13T18:16:40.645 INFO:tasks.workunit.client.0.smithi084.stdout:428 2024-01-13T18:16:40.647 INFO:tasks.workunit.client.0.smithi084.stdout:429 2024-01-13T18:16:40.647 INFO:tasks.workunit.client.0.smithi084.stdout:430 2024-01-13T18:16:40.648 INFO:tasks.workunit.client.0.smithi084.stdout:431 2024-01-13T18:16:40.650 INFO:tasks.workunit.client.0.smithi084.stdout:432 2024-01-13T18:16:40.650 INFO:tasks.workunit.client.0.smithi084.stdout:433 2024-01-13T18:16:40.651 INFO:tasks.workunit.client.0.smithi084.stdout:434 2024-01-13T18:16:40.652 INFO:tasks.workunit.client.0.smithi084.stdout:435 2024-01-13T18:16:40.653 INFO:tasks.workunit.client.0.smithi084.stdout:436 2024-01-13T18:16:40.654 INFO:tasks.workunit.client.0.smithi084.stdout:437 2024-01-13T18:16:40.655 INFO:tasks.workunit.client.0.smithi084.stdout:438 2024-01-13T18:16:40.656 INFO:tasks.workunit.client.0.smithi084.stdout:439 2024-01-13T18:16:40.657 INFO:tasks.workunit.client.0.smithi084.stdout:440 2024-01-13T18:16:40.658 INFO:tasks.workunit.client.0.smithi084.stdout:441 2024-01-13T18:16:40.658 INFO:tasks.workunit.client.0.smithi084.stdout:442 2024-01-13T18:16:40.659 INFO:tasks.workunit.client.0.smithi084.stdout:443 2024-01-13T18:16:40.660 INFO:tasks.workunit.client.0.smithi084.stdout:444 2024-01-13T18:16:40.661 INFO:tasks.workunit.client.0.smithi084.stdout:445 2024-01-13T18:16:40.662 INFO:tasks.workunit.client.0.smithi084.stdout:446 2024-01-13T18:16:40.663 INFO:tasks.workunit.client.0.smithi084.stdout:447 2024-01-13T18:16:40.664 INFO:tasks.workunit.client.0.smithi084.stdout:448 2024-01-13T18:16:40.665 INFO:tasks.workunit.client.0.smithi084.stdout:449 2024-01-13T18:16:40.666 INFO:tasks.workunit.client.0.smithi084.stdout:450 2024-01-13T18:16:40.667 INFO:tasks.workunit.client.0.smithi084.stdout:451 2024-01-13T18:16:40.667 INFO:tasks.workunit.client.0.smithi084.stdout:452 2024-01-13T18:16:40.668 INFO:tasks.workunit.client.0.smithi084.stdout:453 2024-01-13T18:16:40.669 INFO:tasks.workunit.client.0.smithi084.stdout:454 2024-01-13T18:16:40.670 INFO:tasks.workunit.client.0.smithi084.stdout:455 2024-01-13T18:16:40.671 INFO:tasks.workunit.client.0.smithi084.stdout:456 2024-01-13T18:16:40.672 INFO:tasks.workunit.client.0.smithi084.stdout:457 2024-01-13T18:16:40.672 INFO:tasks.workunit.client.0.smithi084.stdout:458 2024-01-13T18:16:40.673 INFO:tasks.workunit.client.0.smithi084.stdout:459 2024-01-13T18:16:40.674 INFO:tasks.workunit.client.0.smithi084.stdout:460 2024-01-13T18:16:40.675 INFO:tasks.workunit.client.0.smithi084.stdout:461 2024-01-13T18:16:40.676 INFO:tasks.workunit.client.0.smithi084.stdout:462 2024-01-13T18:16:40.677 INFO:tasks.workunit.client.0.smithi084.stdout:463 2024-01-13T18:16:40.677 INFO:tasks.workunit.client.0.smithi084.stdout:464 2024-01-13T18:16:40.678 INFO:tasks.workunit.client.0.smithi084.stdout:465 2024-01-13T18:16:40.679 INFO:tasks.workunit.client.0.smithi084.stdout:466 2024-01-13T18:16:40.680 INFO:tasks.workunit.client.0.smithi084.stdout:467 2024-01-13T18:16:40.681 INFO:tasks.workunit.client.0.smithi084.stdout:468 2024-01-13T18:16:40.682 INFO:tasks.workunit.client.0.smithi084.stdout:469 2024-01-13T18:16:40.683 INFO:tasks.workunit.client.0.smithi084.stdout:470 2024-01-13T18:16:40.683 INFO:tasks.workunit.client.0.smithi084.stdout:471 2024-01-13T18:16:40.684 INFO:tasks.workunit.client.0.smithi084.stdout:472 2024-01-13T18:16:40.685 INFO:tasks.workunit.client.0.smithi084.stdout:473 2024-01-13T18:16:40.686 INFO:tasks.workunit.client.0.smithi084.stdout:474 2024-01-13T18:16:40.687 INFO:tasks.workunit.client.0.smithi084.stdout:475 2024-01-13T18:16:40.688 INFO:tasks.workunit.client.0.smithi084.stdout:476 2024-01-13T18:16:40.689 INFO:tasks.workunit.client.0.smithi084.stdout:477 2024-01-13T18:16:40.690 INFO:tasks.workunit.client.0.smithi084.stdout:478 2024-01-13T18:16:40.691 INFO:tasks.workunit.client.0.smithi084.stdout:479 2024-01-13T18:16:40.691 INFO:tasks.workunit.client.0.smithi084.stdout:480 2024-01-13T18:16:40.693 INFO:tasks.workunit.client.0.smithi084.stdout:481 2024-01-13T18:16:40.694 INFO:tasks.workunit.client.0.smithi084.stdout:482 2024-01-13T18:16:40.695 INFO:tasks.workunit.client.0.smithi084.stdout:483 2024-01-13T18:16:40.696 INFO:tasks.workunit.client.0.smithi084.stdout:484 2024-01-13T18:16:40.697 INFO:tasks.workunit.client.0.smithi084.stdout:485 2024-01-13T18:16:40.698 INFO:tasks.workunit.client.0.smithi084.stdout:486 2024-01-13T18:16:40.699 INFO:tasks.workunit.client.0.smithi084.stdout:487 2024-01-13T18:16:40.700 INFO:tasks.workunit.client.0.smithi084.stdout:488 2024-01-13T18:16:40.701 INFO:tasks.workunit.client.0.smithi084.stdout:489 2024-01-13T18:16:40.702 INFO:tasks.workunit.client.0.smithi084.stdout:490 2024-01-13T18:16:40.703 INFO:tasks.workunit.client.0.smithi084.stdout:491 2024-01-13T18:16:40.704 INFO:tasks.workunit.client.0.smithi084.stdout:492 2024-01-13T18:16:40.705 INFO:tasks.workunit.client.0.smithi084.stdout:493 2024-01-13T18:16:40.706 INFO:tasks.workunit.client.0.smithi084.stdout:494 2024-01-13T18:16:40.707 INFO:tasks.workunit.client.0.smithi084.stdout:495 2024-01-13T18:16:40.708 INFO:tasks.workunit.client.0.smithi084.stdout:496 2024-01-13T18:16:40.709 INFO:tasks.workunit.client.0.smithi084.stdout:497 2024-01-13T18:16:40.710 INFO:tasks.workunit.client.0.smithi084.stdout:498 2024-01-13T18:16:40.711 INFO:tasks.workunit.client.0.smithi084.stdout:499 2024-01-13T18:16:40.712 INFO:tasks.workunit.client.0.smithi084.stdout:500 2024-01-13T18:16:40.713 INFO:tasks.workunit.client.0.smithi084.stdout:501 2024-01-13T18:16:40.714 INFO:tasks.workunit.client.0.smithi084.stdout:502 2024-01-13T18:16:40.715 INFO:tasks.workunit.client.0.smithi084.stdout:503 2024-01-13T18:16:40.716 INFO:tasks.workunit.client.0.smithi084.stdout:504 2024-01-13T18:16:40.717 INFO:tasks.workunit.client.0.smithi084.stdout:505 2024-01-13T18:16:40.717 INFO:tasks.workunit.client.0.smithi084.stdout:506 2024-01-13T18:16:40.718 INFO:tasks.workunit.client.0.smithi084.stdout:507 2024-01-13T18:16:40.719 INFO:tasks.workunit.client.0.smithi084.stdout:508 2024-01-13T18:16:40.720 INFO:tasks.workunit.client.0.smithi084.stdout:509 2024-01-13T18:16:40.721 INFO:tasks.workunit.client.0.smithi084.stdout:510 2024-01-13T18:16:40.722 INFO:tasks.workunit.client.0.smithi084.stdout:511 2024-01-13T18:16:40.723 INFO:tasks.workunit.client.0.smithi084.stdout:512 2024-01-13T18:16:40.724 INFO:tasks.workunit.client.0.smithi084.stdout:513 2024-01-13T18:16:40.725 INFO:tasks.workunit.client.0.smithi084.stdout:514 2024-01-13T18:16:40.726 INFO:tasks.workunit.client.0.smithi084.stdout:515 2024-01-13T18:16:40.727 INFO:tasks.workunit.client.0.smithi084.stdout:516 2024-01-13T18:16:40.727 INFO:tasks.workunit.client.0.smithi084.stdout:517 2024-01-13T18:16:40.728 INFO:tasks.workunit.client.0.smithi084.stdout:518 2024-01-13T18:16:40.729 INFO:tasks.workunit.client.0.smithi084.stdout:519 2024-01-13T18:16:40.730 INFO:tasks.workunit.client.0.smithi084.stdout:520 2024-01-13T18:16:40.731 INFO:tasks.workunit.client.0.smithi084.stdout:521 2024-01-13T18:16:40.732 INFO:tasks.workunit.client.0.smithi084.stdout:522 2024-01-13T18:16:40.733 INFO:tasks.workunit.client.0.smithi084.stdout:523 2024-01-13T18:16:40.734 INFO:tasks.workunit.client.0.smithi084.stdout:524 2024-01-13T18:16:40.735 INFO:tasks.workunit.client.0.smithi084.stdout:525 2024-01-13T18:16:40.736 INFO:tasks.workunit.client.0.smithi084.stdout:526 2024-01-13T18:16:40.736 INFO:tasks.workunit.client.0.smithi084.stdout:527 2024-01-13T18:16:40.737 INFO:tasks.workunit.client.0.smithi084.stdout:528 2024-01-13T18:16:40.738 INFO:tasks.workunit.client.0.smithi084.stdout:529 2024-01-13T18:16:40.739 INFO:tasks.workunit.client.0.smithi084.stdout:530 2024-01-13T18:16:40.740 INFO:tasks.workunit.client.0.smithi084.stdout:531 2024-01-13T18:16:40.741 INFO:tasks.workunit.client.0.smithi084.stdout:532 2024-01-13T18:16:40.742 INFO:tasks.workunit.client.0.smithi084.stdout:533 2024-01-13T18:16:40.743 INFO:tasks.workunit.client.0.smithi084.stdout:534 2024-01-13T18:16:40.744 INFO:tasks.workunit.client.0.smithi084.stdout:535 2024-01-13T18:16:40.744 INFO:tasks.workunit.client.0.smithi084.stdout:536 2024-01-13T18:16:40.745 INFO:tasks.workunit.client.0.smithi084.stdout:537 2024-01-13T18:16:40.746 INFO:tasks.workunit.client.0.smithi084.stdout:538 2024-01-13T18:16:40.747 INFO:tasks.workunit.client.0.smithi084.stdout:539 2024-01-13T18:16:40.748 INFO:tasks.workunit.client.0.smithi084.stdout:540 2024-01-13T18:16:40.749 INFO:tasks.workunit.client.0.smithi084.stdout:541 2024-01-13T18:16:40.750 INFO:tasks.workunit.client.0.smithi084.stdout:542 2024-01-13T18:16:40.751 INFO:tasks.workunit.client.0.smithi084.stdout:543 2024-01-13T18:16:40.752 INFO:tasks.workunit.client.0.smithi084.stdout:544 2024-01-13T18:16:40.755 INFO:tasks.workunit.client.0.smithi084.stdout:545 2024-01-13T18:16:40.755 INFO:tasks.workunit.client.0.smithi084.stdout:546 2024-01-13T18:16:40.755 INFO:tasks.workunit.client.0.smithi084.stdout:547 2024-01-13T18:16:40.756 INFO:tasks.workunit.client.0.smithi084.stdout:548 2024-01-13T18:16:40.757 INFO:tasks.workunit.client.0.smithi084.stdout:549 2024-01-13T18:16:40.758 INFO:tasks.workunit.client.0.smithi084.stdout:550 2024-01-13T18:16:40.758 INFO:tasks.workunit.client.0.smithi084.stdout:551 2024-01-13T18:16:40.759 INFO:tasks.workunit.client.0.smithi084.stdout:552 2024-01-13T18:16:40.760 INFO:tasks.workunit.client.0.smithi084.stdout:553 2024-01-13T18:16:40.761 INFO:tasks.workunit.client.0.smithi084.stdout:554 2024-01-13T18:16:40.762 INFO:tasks.workunit.client.0.smithi084.stdout:555 2024-01-13T18:16:40.763 INFO:tasks.workunit.client.0.smithi084.stdout:556 2024-01-13T18:16:40.764 INFO:tasks.workunit.client.0.smithi084.stdout:557 2024-01-13T18:16:40.765 INFO:tasks.workunit.client.0.smithi084.stdout:558 2024-01-13T18:16:40.766 INFO:tasks.workunit.client.0.smithi084.stdout:559 2024-01-13T18:16:40.767 INFO:tasks.workunit.client.0.smithi084.stdout:560 2024-01-13T18:16:40.768 INFO:tasks.workunit.client.0.smithi084.stdout:561 2024-01-13T18:16:40.769 INFO:tasks.workunit.client.0.smithi084.stdout:562 2024-01-13T18:16:40.770 INFO:tasks.workunit.client.0.smithi084.stdout:563 2024-01-13T18:16:40.771 INFO:tasks.workunit.client.0.smithi084.stdout:564 2024-01-13T18:16:40.771 INFO:tasks.workunit.client.0.smithi084.stdout:565 2024-01-13T18:16:40.772 INFO:tasks.workunit.client.0.smithi084.stdout:566 2024-01-13T18:16:40.773 INFO:tasks.workunit.client.0.smithi084.stdout:567 2024-01-13T18:16:40.774 INFO:tasks.workunit.client.0.smithi084.stdout:568 2024-01-13T18:16:40.775 INFO:tasks.workunit.client.0.smithi084.stdout:569 2024-01-13T18:16:40.776 INFO:tasks.workunit.client.0.smithi084.stdout:570 2024-01-13T18:16:40.778 INFO:tasks.workunit.client.0.smithi084.stdout:571 2024-01-13T18:16:40.779 INFO:tasks.workunit.client.0.smithi084.stdout:572 2024-01-13T18:16:40.779 INFO:tasks.workunit.client.0.smithi084.stdout:573 2024-01-13T18:16:40.781 INFO:tasks.workunit.client.0.smithi084.stdout:574 2024-01-13T18:16:40.781 INFO:tasks.workunit.client.0.smithi084.stdout:575 2024-01-13T18:16:40.782 INFO:tasks.workunit.client.0.smithi084.stdout:576 2024-01-13T18:16:40.783 INFO:tasks.workunit.client.0.smithi084.stdout:577 2024-01-13T18:16:40.784 INFO:tasks.workunit.client.0.smithi084.stdout:578 2024-01-13T18:16:40.785 INFO:tasks.workunit.client.0.smithi084.stdout:579 2024-01-13T18:16:40.786 INFO:tasks.workunit.client.0.smithi084.stdout:580 2024-01-13T18:16:40.787 INFO:tasks.workunit.client.0.smithi084.stdout:581 2024-01-13T18:16:40.788 INFO:tasks.workunit.client.0.smithi084.stdout:582 2024-01-13T18:16:40.789 INFO:tasks.workunit.client.0.smithi084.stdout:583 2024-01-13T18:16:40.790 INFO:tasks.workunit.client.0.smithi084.stdout:584 2024-01-13T18:16:40.791 INFO:tasks.workunit.client.0.smithi084.stdout:585 2024-01-13T18:16:40.792 INFO:tasks.workunit.client.0.smithi084.stdout:586 2024-01-13T18:16:40.793 INFO:tasks.workunit.client.0.smithi084.stdout:587 2024-01-13T18:16:40.794 INFO:tasks.workunit.client.0.smithi084.stdout:588 2024-01-13T18:16:40.795 INFO:tasks.workunit.client.0.smithi084.stdout:589 2024-01-13T18:16:40.796 INFO:tasks.workunit.client.0.smithi084.stdout:590 2024-01-13T18:16:40.797 INFO:tasks.workunit.client.0.smithi084.stdout:591 2024-01-13T18:16:40.798 INFO:tasks.workunit.client.0.smithi084.stdout:592 2024-01-13T18:16:40.798 INFO:tasks.workunit.client.0.smithi084.stdout:593 2024-01-13T18:16:40.799 INFO:tasks.workunit.client.0.smithi084.stdout:594 2024-01-13T18:16:40.800 INFO:tasks.workunit.client.0.smithi084.stdout:595 2024-01-13T18:16:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:596 2024-01-13T18:16:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:597 2024-01-13T18:16:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:598 2024-01-13T18:16:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:599 2024-01-13T18:16:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:600 2024-01-13T18:16:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:601 2024-01-13T18:16:40.807 INFO:tasks.workunit.client.0.smithi084.stdout:602 2024-01-13T18:16:40.808 INFO:tasks.workunit.client.0.smithi084.stdout:603 2024-01-13T18:16:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:604 2024-01-13T18:16:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:605 2024-01-13T18:16:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:606 2024-01-13T18:16:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:607 2024-01-13T18:16:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:608 2024-01-13T18:16:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:609 2024-01-13T18:16:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:610 2024-01-13T18:16:40.816 INFO:tasks.workunit.client.0.smithi084.stdout:611 2024-01-13T18:16:40.817 INFO:tasks.workunit.client.0.smithi084.stdout:612 2024-01-13T18:16:40.818 INFO:tasks.workunit.client.0.smithi084.stdout:613 2024-01-13T18:16:40.819 INFO:tasks.workunit.client.0.smithi084.stdout:614 2024-01-13T18:16:40.820 INFO:tasks.workunit.client.0.smithi084.stdout:615 2024-01-13T18:16:40.821 INFO:tasks.workunit.client.0.smithi084.stdout:616 2024-01-13T18:16:40.822 INFO:tasks.workunit.client.0.smithi084.stdout:617 2024-01-13T18:16:40.823 INFO:tasks.workunit.client.0.smithi084.stdout:618 2024-01-13T18:16:40.824 INFO:tasks.workunit.client.0.smithi084.stdout:619 2024-01-13T18:16:40.825 INFO:tasks.workunit.client.0.smithi084.stdout:620 2024-01-13T18:16:40.826 INFO:tasks.workunit.client.0.smithi084.stdout:621 2024-01-13T18:16:40.827 INFO:tasks.workunit.client.0.smithi084.stdout:622 2024-01-13T18:16:40.828 INFO:tasks.workunit.client.0.smithi084.stdout:623 2024-01-13T18:16:40.829 INFO:tasks.workunit.client.0.smithi084.stdout:624 2024-01-13T18:16:40.830 INFO:tasks.workunit.client.0.smithi084.stdout:625 2024-01-13T18:16:40.831 INFO:tasks.workunit.client.0.smithi084.stdout:626 2024-01-13T18:16:40.832 INFO:tasks.workunit.client.0.smithi084.stdout:627 2024-01-13T18:16:40.833 INFO:tasks.workunit.client.0.smithi084.stdout:628 2024-01-13T18:16:40.833 INFO:tasks.workunit.client.0.smithi084.stdout:629 2024-01-13T18:16:40.835 INFO:tasks.workunit.client.0.smithi084.stdout:630 2024-01-13T18:16:40.836 INFO:tasks.workunit.client.0.smithi084.stdout:631 2024-01-13T18:16:40.836 INFO:tasks.workunit.client.0.smithi084.stdout:632 2024-01-13T18:16:40.838 INFO:tasks.workunit.client.0.smithi084.stdout:633 2024-01-13T18:16:40.839 INFO:tasks.workunit.client.0.smithi084.stdout:634 2024-01-13T18:16:40.840 INFO:tasks.workunit.client.0.smithi084.stdout:635 2024-01-13T18:16:40.841 INFO:tasks.workunit.client.0.smithi084.stdout:636 2024-01-13T18:16:40.842 INFO:tasks.workunit.client.0.smithi084.stdout:637 2024-01-13T18:16:40.843 INFO:tasks.workunit.client.0.smithi084.stdout:638 2024-01-13T18:16:40.844 INFO:tasks.workunit.client.0.smithi084.stdout:639 2024-01-13T18:16:40.845 INFO:tasks.workunit.client.0.smithi084.stdout:640 2024-01-13T18:16:40.846 INFO:tasks.workunit.client.0.smithi084.stdout:641 2024-01-13T18:16:40.847 INFO:tasks.workunit.client.0.smithi084.stdout:642 2024-01-13T18:16:40.848 INFO:tasks.workunit.client.0.smithi084.stdout:643 2024-01-13T18:16:40.849 INFO:tasks.workunit.client.0.smithi084.stdout:644 2024-01-13T18:16:40.850 INFO:tasks.workunit.client.0.smithi084.stdout:645 2024-01-13T18:16:40.851 INFO:tasks.workunit.client.0.smithi084.stdout:646 2024-01-13T18:16:40.852 INFO:tasks.workunit.client.0.smithi084.stdout:647 2024-01-13T18:16:40.853 INFO:tasks.workunit.client.0.smithi084.stdout:648 2024-01-13T18:16:40.854 INFO:tasks.workunit.client.0.smithi084.stdout:649 2024-01-13T18:16:40.855 INFO:tasks.workunit.client.0.smithi084.stdout:650 2024-01-13T18:16:40.856 INFO:tasks.workunit.client.0.smithi084.stdout:651 2024-01-13T18:16:40.857 INFO:tasks.workunit.client.0.smithi084.stdout:652 2024-01-13T18:16:40.858 INFO:tasks.workunit.client.0.smithi084.stdout:653 2024-01-13T18:16:40.859 INFO:tasks.workunit.client.0.smithi084.stdout:654 2024-01-13T18:16:40.860 INFO:tasks.workunit.client.0.smithi084.stdout:655 2024-01-13T18:16:40.861 INFO:tasks.workunit.client.0.smithi084.stdout:656 2024-01-13T18:16:40.862 INFO:tasks.workunit.client.0.smithi084.stdout:657 2024-01-13T18:16:40.863 INFO:tasks.workunit.client.0.smithi084.stdout:658 2024-01-13T18:16:40.864 INFO:tasks.workunit.client.0.smithi084.stdout:659 2024-01-13T18:16:40.865 INFO:tasks.workunit.client.0.smithi084.stdout:660 2024-01-13T18:16:40.866 INFO:tasks.workunit.client.0.smithi084.stdout:661 2024-01-13T18:16:40.867 INFO:tasks.workunit.client.0.smithi084.stdout:662 2024-01-13T18:16:40.869 INFO:tasks.workunit.client.0.smithi084.stdout:663 2024-01-13T18:16:40.870 INFO:tasks.workunit.client.0.smithi084.stdout:664 2024-01-13T18:16:40.871 INFO:tasks.workunit.client.0.smithi084.stdout:665 2024-01-13T18:16:40.872 INFO:tasks.workunit.client.0.smithi084.stdout:666 2024-01-13T18:16:40.873 INFO:tasks.workunit.client.0.smithi084.stdout:667 2024-01-13T18:16:40.874 INFO:tasks.workunit.client.0.smithi084.stdout:668 2024-01-13T18:16:40.875 INFO:tasks.workunit.client.0.smithi084.stdout:669 2024-01-13T18:16:40.876 INFO:tasks.workunit.client.0.smithi084.stdout:670 2024-01-13T18:16:40.877 INFO:tasks.workunit.client.0.smithi084.stdout:671 2024-01-13T18:16:40.878 INFO:tasks.workunit.client.0.smithi084.stdout:672 2024-01-13T18:16:40.879 INFO:tasks.workunit.client.0.smithi084.stdout:673 2024-01-13T18:16:40.880 INFO:tasks.workunit.client.0.smithi084.stdout:674 2024-01-13T18:16:40.881 INFO:tasks.workunit.client.0.smithi084.stdout:675 2024-01-13T18:16:40.882 INFO:tasks.workunit.client.0.smithi084.stdout:676 2024-01-13T18:16:40.883 INFO:tasks.workunit.client.0.smithi084.stdout:677 2024-01-13T18:16:40.884 INFO:tasks.workunit.client.0.smithi084.stdout:678 2024-01-13T18:16:40.885 INFO:tasks.workunit.client.0.smithi084.stdout:679 2024-01-13T18:16:40.886 INFO:tasks.workunit.client.0.smithi084.stdout:680 2024-01-13T18:16:40.887 INFO:tasks.workunit.client.0.smithi084.stdout:681 2024-01-13T18:16:40.888 INFO:tasks.workunit.client.0.smithi084.stdout:682 2024-01-13T18:16:40.889 INFO:tasks.workunit.client.0.smithi084.stdout:683 2024-01-13T18:16:40.890 INFO:tasks.workunit.client.0.smithi084.stdout:684 2024-01-13T18:16:40.892 INFO:tasks.workunit.client.0.smithi084.stdout:685 2024-01-13T18:16:40.893 INFO:tasks.workunit.client.0.smithi084.stdout:686 2024-01-13T18:16:40.894 INFO:tasks.workunit.client.0.smithi084.stdout:687 2024-01-13T18:16:40.895 INFO:tasks.workunit.client.0.smithi084.stdout:688 2024-01-13T18:16:40.896 INFO:tasks.workunit.client.0.smithi084.stdout:689 2024-01-13T18:16:40.896 INFO:tasks.workunit.client.0.smithi084.stdout:690 2024-01-13T18:16:40.898 INFO:tasks.workunit.client.0.smithi084.stdout:691 2024-01-13T18:16:40.898 INFO:tasks.workunit.client.0.smithi084.stdout:692 2024-01-13T18:16:40.900 INFO:tasks.workunit.client.0.smithi084.stdout:693 2024-01-13T18:16:40.901 INFO:tasks.workunit.client.0.smithi084.stdout:694 2024-01-13T18:16:40.902 INFO:tasks.workunit.client.0.smithi084.stdout:695 2024-01-13T18:16:40.902 INFO:tasks.workunit.client.0.smithi084.stdout:696 2024-01-13T18:16:40.903 INFO:tasks.workunit.client.0.smithi084.stdout:697 2024-01-13T18:16:40.904 INFO:tasks.workunit.client.0.smithi084.stdout:698 2024-01-13T18:16:40.905 INFO:tasks.workunit.client.0.smithi084.stdout:699 2024-01-13T18:16:40.906 INFO:tasks.workunit.client.0.smithi084.stdout:700 2024-01-13T18:16:40.907 INFO:tasks.workunit.client.0.smithi084.stdout:701 2024-01-13T18:16:40.908 INFO:tasks.workunit.client.0.smithi084.stdout:702 2024-01-13T18:16:40.909 INFO:tasks.workunit.client.0.smithi084.stdout:703 2024-01-13T18:16:40.910 INFO:tasks.workunit.client.0.smithi084.stdout:704 2024-01-13T18:16:40.911 INFO:tasks.workunit.client.0.smithi084.stdout:705 2024-01-13T18:16:40.912 INFO:tasks.workunit.client.0.smithi084.stdout:706 2024-01-13T18:16:40.913 INFO:tasks.workunit.client.0.smithi084.stdout:707 2024-01-13T18:16:40.914 INFO:tasks.workunit.client.0.smithi084.stdout:708 2024-01-13T18:16:40.915 INFO:tasks.workunit.client.0.smithi084.stdout:709 2024-01-13T18:16:40.916 INFO:tasks.workunit.client.0.smithi084.stdout:710 2024-01-13T18:16:40.917 INFO:tasks.workunit.client.0.smithi084.stdout:711 2024-01-13T18:16:40.918 INFO:tasks.workunit.client.0.smithi084.stdout:712 2024-01-13T18:16:40.918 INFO:tasks.workunit.client.0.smithi084.stdout:713 2024-01-13T18:16:40.919 INFO:tasks.workunit.client.0.smithi084.stdout:714 2024-01-13T18:16:40.920 INFO:tasks.workunit.client.0.smithi084.stdout:715 2024-01-13T18:16:40.921 INFO:tasks.workunit.client.0.smithi084.stdout:716 2024-01-13T18:16:40.922 INFO:tasks.workunit.client.0.smithi084.stdout:717 2024-01-13T18:16:40.923 INFO:tasks.workunit.client.0.smithi084.stdout:718 2024-01-13T18:16:40.924 INFO:tasks.workunit.client.0.smithi084.stdout:719 2024-01-13T18:16:40.926 INFO:tasks.workunit.client.0.smithi084.stdout:720 2024-01-13T18:16:40.926 INFO:tasks.workunit.client.0.smithi084.stdout:721 2024-01-13T18:16:40.927 INFO:tasks.workunit.client.0.smithi084.stdout:722 2024-01-13T18:16:40.928 INFO:tasks.workunit.client.0.smithi084.stdout:723 2024-01-13T18:16:40.929 INFO:tasks.workunit.client.0.smithi084.stdout:724 2024-01-13T18:16:40.930 INFO:tasks.workunit.client.0.smithi084.stdout:725 2024-01-13T18:16:40.931 INFO:tasks.workunit.client.0.smithi084.stdout:726 2024-01-13T18:16:40.932 INFO:tasks.workunit.client.0.smithi084.stdout:727 2024-01-13T18:16:40.933 INFO:tasks.workunit.client.0.smithi084.stdout:728 2024-01-13T18:16:40.934 INFO:tasks.workunit.client.0.smithi084.stdout:729 2024-01-13T18:16:40.935 INFO:tasks.workunit.client.0.smithi084.stdout:730 2024-01-13T18:16:40.936 INFO:tasks.workunit.client.0.smithi084.stdout:731 2024-01-13T18:16:40.937 INFO:tasks.workunit.client.0.smithi084.stdout:732 2024-01-13T18:16:40.938 INFO:tasks.workunit.client.0.smithi084.stdout:733 2024-01-13T18:16:40.939 INFO:tasks.workunit.client.0.smithi084.stdout:734 2024-01-13T18:16:40.940 INFO:tasks.workunit.client.0.smithi084.stdout:735 2024-01-13T18:16:40.941 INFO:tasks.workunit.client.0.smithi084.stdout:736 2024-01-13T18:16:40.942 INFO:tasks.workunit.client.0.smithi084.stdout:737 2024-01-13T18:16:40.943 INFO:tasks.workunit.client.0.smithi084.stdout:738 2024-01-13T18:16:40.944 INFO:tasks.workunit.client.0.smithi084.stdout:739 2024-01-13T18:16:40.946 INFO:tasks.workunit.client.0.smithi084.stdout:740 2024-01-13T18:16:40.947 INFO:tasks.workunit.client.0.smithi084.stdout:741 2024-01-13T18:16:40.948 INFO:tasks.workunit.client.0.smithi084.stdout:742 2024-01-13T18:16:40.949 INFO:tasks.workunit.client.0.smithi084.stdout:743 2024-01-13T18:16:40.950 INFO:tasks.workunit.client.0.smithi084.stdout:744 2024-01-13T18:16:40.951 INFO:tasks.workunit.client.0.smithi084.stdout:745 2024-01-13T18:16:40.952 INFO:tasks.workunit.client.0.smithi084.stdout:746 2024-01-13T18:16:40.953 INFO:tasks.workunit.client.0.smithi084.stdout:747 2024-01-13T18:16:40.954 INFO:tasks.workunit.client.0.smithi084.stdout:748 2024-01-13T18:16:40.955 INFO:tasks.workunit.client.0.smithi084.stdout:749 2024-01-13T18:16:40.959 INFO:tasks.workunit.client.0.smithi084.stdout:750 2024-01-13T18:16:40.960 INFO:tasks.workunit.client.0.smithi084.stdout:751 2024-01-13T18:16:40.960 INFO:tasks.workunit.client.0.smithi084.stdout:752 2024-01-13T18:16:40.960 INFO:tasks.workunit.client.0.smithi084.stdout:753 2024-01-13T18:16:40.960 INFO:tasks.workunit.client.0.smithi084.stdout:754 2024-01-13T18:16:40.961 INFO:tasks.workunit.client.0.smithi084.stdout:755 2024-01-13T18:16:40.962 INFO:tasks.workunit.client.0.smithi084.stdout:756 2024-01-13T18:16:40.964 INFO:tasks.workunit.client.0.smithi084.stdout:757 2024-01-13T18:16:40.965 INFO:tasks.workunit.client.0.smithi084.stdout:758 2024-01-13T18:16:40.966 INFO:tasks.workunit.client.0.smithi084.stdout:759 2024-01-13T18:16:40.967 INFO:tasks.workunit.client.0.smithi084.stdout:760 2024-01-13T18:16:40.968 INFO:tasks.workunit.client.0.smithi084.stdout:761 2024-01-13T18:16:40.969 INFO:tasks.workunit.client.0.smithi084.stdout:762 2024-01-13T18:16:40.970 INFO:tasks.workunit.client.0.smithi084.stdout:763 2024-01-13T18:16:40.971 INFO:tasks.workunit.client.0.smithi084.stdout:764 2024-01-13T18:16:40.972 INFO:tasks.workunit.client.0.smithi084.stdout:765 2024-01-13T18:16:40.974 INFO:tasks.workunit.client.0.smithi084.stdout:766 2024-01-13T18:16:40.975 INFO:tasks.workunit.client.0.smithi084.stdout:767 2024-01-13T18:16:40.976 INFO:tasks.workunit.client.0.smithi084.stdout:768 2024-01-13T18:16:40.977 INFO:tasks.workunit.client.0.smithi084.stdout:769 2024-01-13T18:16:40.978 INFO:tasks.workunit.client.0.smithi084.stdout:770 2024-01-13T18:16:40.979 INFO:tasks.workunit.client.0.smithi084.stdout:771 2024-01-13T18:16:40.980 INFO:tasks.workunit.client.0.smithi084.stdout:772 2024-01-13T18:16:40.980 INFO:tasks.workunit.client.0.smithi084.stdout:773 2024-01-13T18:16:40.981 INFO:tasks.workunit.client.0.smithi084.stdout:774 2024-01-13T18:16:40.982 INFO:tasks.workunit.client.0.smithi084.stdout:775 2024-01-13T18:16:40.984 INFO:tasks.workunit.client.0.smithi084.stdout:776 2024-01-13T18:16:40.985 INFO:tasks.workunit.client.0.smithi084.stdout:777 2024-01-13T18:16:40.986 INFO:tasks.workunit.client.0.smithi084.stdout:778 2024-01-13T18:16:40.987 INFO:tasks.workunit.client.0.smithi084.stdout:779 2024-01-13T18:16:40.988 INFO:tasks.workunit.client.0.smithi084.stdout:780 2024-01-13T18:16:40.989 INFO:tasks.workunit.client.0.smithi084.stdout:781 2024-01-13T18:16:40.990 INFO:tasks.workunit.client.0.smithi084.stdout:782 2024-01-13T18:16:40.991 INFO:tasks.workunit.client.0.smithi084.stdout:783 2024-01-13T18:16:40.992 INFO:tasks.workunit.client.0.smithi084.stdout:784 2024-01-13T18:16:40.993 INFO:tasks.workunit.client.0.smithi084.stdout:785 2024-01-13T18:16:40.994 INFO:tasks.workunit.client.0.smithi084.stdout:786 2024-01-13T18:16:40.995 INFO:tasks.workunit.client.0.smithi084.stdout:787 2024-01-13T18:16:40.996 INFO:tasks.workunit.client.0.smithi084.stdout:788 2024-01-13T18:16:40.997 INFO:tasks.workunit.client.0.smithi084.stdout:789 2024-01-13T18:16:40.998 INFO:tasks.workunit.client.0.smithi084.stdout:790 2024-01-13T18:16:40.999 INFO:tasks.workunit.client.0.smithi084.stdout:791 2024-01-13T18:16:41.000 INFO:tasks.workunit.client.0.smithi084.stdout:792 2024-01-13T18:16:41.001 INFO:tasks.workunit.client.0.smithi084.stdout:793 2024-01-13T18:16:41.002 INFO:tasks.workunit.client.0.smithi084.stdout:794 2024-01-13T18:16:41.003 INFO:tasks.workunit.client.0.smithi084.stdout:795 2024-01-13T18:16:41.004 INFO:tasks.workunit.client.0.smithi084.stdout:796 2024-01-13T18:16:41.006 INFO:tasks.workunit.client.0.smithi084.stdout:797 2024-01-13T18:16:41.006 INFO:tasks.workunit.client.0.smithi084.stdout:798 2024-01-13T18:16:41.008 INFO:tasks.workunit.client.0.smithi084.stdout:799 2024-01-13T18:16:41.009 INFO:tasks.workunit.client.0.smithi084.stdout:800 2024-01-13T18:16:41.010 INFO:tasks.workunit.client.0.smithi084.stdout:801 2024-01-13T18:16:41.011 INFO:tasks.workunit.client.0.smithi084.stdout:802 2024-01-13T18:16:41.012 INFO:tasks.workunit.client.0.smithi084.stdout:803 2024-01-13T18:16:41.013 INFO:tasks.workunit.client.0.smithi084.stdout:804 2024-01-13T18:16:41.014 INFO:tasks.workunit.client.0.smithi084.stdout:805 2024-01-13T18:16:41.015 INFO:tasks.workunit.client.0.smithi084.stdout:806 2024-01-13T18:16:41.016 INFO:tasks.workunit.client.0.smithi084.stdout:807 2024-01-13T18:16:41.017 INFO:tasks.workunit.client.0.smithi084.stdout:808 2024-01-13T18:16:41.018 INFO:tasks.workunit.client.0.smithi084.stdout:809 2024-01-13T18:16:41.019 INFO:tasks.workunit.client.0.smithi084.stdout:810 2024-01-13T18:16:41.020 INFO:tasks.workunit.client.0.smithi084.stdout:811 2024-01-13T18:16:41.021 INFO:tasks.workunit.client.0.smithi084.stdout:812 2024-01-13T18:16:41.023 INFO:tasks.workunit.client.0.smithi084.stdout:813 2024-01-13T18:16:41.023 INFO:tasks.workunit.client.0.smithi084.stdout:814 2024-01-13T18:16:41.024 INFO:tasks.workunit.client.0.smithi084.stdout:815 2024-01-13T18:16:41.025 INFO:tasks.workunit.client.0.smithi084.stdout:816 2024-01-13T18:16:41.027 INFO:tasks.workunit.client.0.smithi084.stdout:817 2024-01-13T18:16:41.028 INFO:tasks.workunit.client.0.smithi084.stdout:818 2024-01-13T18:16:41.028 INFO:tasks.workunit.client.0.smithi084.stdout:819 2024-01-13T18:16:41.030 INFO:tasks.workunit.client.0.smithi084.stdout:820 2024-01-13T18:16:41.031 INFO:tasks.workunit.client.0.smithi084.stdout:821 2024-01-13T18:16:41.032 INFO:tasks.workunit.client.0.smithi084.stdout:822 2024-01-13T18:16:41.033 INFO:tasks.workunit.client.0.smithi084.stdout:823 2024-01-13T18:16:41.034 INFO:tasks.workunit.client.0.smithi084.stdout:824 2024-01-13T18:16:41.035 INFO:tasks.workunit.client.0.smithi084.stdout:825 2024-01-13T18:16:41.035 INFO:tasks.workunit.client.0.smithi084.stdout:826 2024-01-13T18:16:41.037 INFO:tasks.workunit.client.0.smithi084.stdout:827 2024-01-13T18:16:41.038 INFO:tasks.workunit.client.0.smithi084.stdout:828 2024-01-13T18:16:41.039 INFO:tasks.workunit.client.0.smithi084.stdout:829 2024-01-13T18:16:41.040 INFO:tasks.workunit.client.0.smithi084.stdout:830 2024-01-13T18:16:41.041 INFO:tasks.workunit.client.0.smithi084.stdout:831 2024-01-13T18:16:41.042 INFO:tasks.workunit.client.0.smithi084.stdout:832 2024-01-13T18:16:41.043 INFO:tasks.workunit.client.0.smithi084.stdout:833 2024-01-13T18:16:41.044 INFO:tasks.workunit.client.0.smithi084.stdout:834 2024-01-13T18:16:41.045 INFO:tasks.workunit.client.0.smithi084.stdout:835 2024-01-13T18:16:41.046 INFO:tasks.workunit.client.0.smithi084.stdout:836 2024-01-13T18:16:41.047 INFO:tasks.workunit.client.0.smithi084.stdout:837 2024-01-13T18:16:41.048 INFO:tasks.workunit.client.0.smithi084.stdout:838 2024-01-13T18:16:41.049 INFO:tasks.workunit.client.0.smithi084.stdout:839 2024-01-13T18:16:41.050 INFO:tasks.workunit.client.0.smithi084.stdout:840 2024-01-13T18:16:41.051 INFO:tasks.workunit.client.0.smithi084.stdout:841 2024-01-13T18:16:41.052 INFO:tasks.workunit.client.0.smithi084.stdout:842 2024-01-13T18:16:41.053 INFO:tasks.workunit.client.0.smithi084.stdout:843 2024-01-13T18:16:41.054 INFO:tasks.workunit.client.0.smithi084.stdout:844 2024-01-13T18:16:41.055 INFO:tasks.workunit.client.0.smithi084.stdout:845 2024-01-13T18:16:41.056 INFO:tasks.workunit.client.0.smithi084.stdout:846 2024-01-13T18:16:41.057 INFO:tasks.workunit.client.0.smithi084.stdout:847 2024-01-13T18:16:41.058 INFO:tasks.workunit.client.0.smithi084.stdout:848 2024-01-13T18:16:41.059 INFO:tasks.workunit.client.0.smithi084.stdout:849 2024-01-13T18:16:41.060 INFO:tasks.workunit.client.0.smithi084.stdout:850 2024-01-13T18:16:41.061 INFO:tasks.workunit.client.0.smithi084.stdout:851 2024-01-13T18:16:41.062 INFO:tasks.workunit.client.0.smithi084.stdout:852 2024-01-13T18:16:41.063 INFO:tasks.workunit.client.0.smithi084.stdout:853 2024-01-13T18:16:41.064 INFO:tasks.workunit.client.0.smithi084.stdout:854 2024-01-13T18:16:41.065 INFO:tasks.workunit.client.0.smithi084.stdout:855 2024-01-13T18:16:41.066 INFO:tasks.workunit.client.0.smithi084.stdout:856 2024-01-13T18:16:41.067 INFO:tasks.workunit.client.0.smithi084.stdout:857 2024-01-13T18:16:41.068 INFO:tasks.workunit.client.0.smithi084.stdout:858 2024-01-13T18:16:41.069 INFO:tasks.workunit.client.0.smithi084.stdout:859 2024-01-13T18:16:41.070 INFO:tasks.workunit.client.0.smithi084.stdout:860 2024-01-13T18:16:41.071 INFO:tasks.workunit.client.0.smithi084.stdout:861 2024-01-13T18:16:41.073 INFO:tasks.workunit.client.0.smithi084.stdout:862 2024-01-13T18:16:41.074 INFO:tasks.workunit.client.0.smithi084.stdout:863 2024-01-13T18:16:41.075 INFO:tasks.workunit.client.0.smithi084.stdout:864 2024-01-13T18:16:41.076 INFO:tasks.workunit.client.0.smithi084.stdout:865 2024-01-13T18:16:41.077 INFO:tasks.workunit.client.0.smithi084.stdout:866 2024-01-13T18:16:41.078 INFO:tasks.workunit.client.0.smithi084.stdout:867 2024-01-13T18:16:41.079 INFO:tasks.workunit.client.0.smithi084.stdout:868 2024-01-13T18:16:41.080 INFO:tasks.workunit.client.0.smithi084.stdout:869 2024-01-13T18:16:41.081 INFO:tasks.workunit.client.0.smithi084.stdout:870 2024-01-13T18:16:41.082 INFO:tasks.workunit.client.0.smithi084.stdout:871 2024-01-13T18:16:41.083 INFO:tasks.workunit.client.0.smithi084.stdout:872 2024-01-13T18:16:41.084 INFO:tasks.workunit.client.0.smithi084.stdout:873 2024-01-13T18:16:41.085 INFO:tasks.workunit.client.0.smithi084.stdout:874 2024-01-13T18:16:41.086 INFO:tasks.workunit.client.0.smithi084.stdout:875 2024-01-13T18:16:41.087 INFO:tasks.workunit.client.0.smithi084.stdout:876 2024-01-13T18:16:41.088 INFO:tasks.workunit.client.0.smithi084.stdout:877 2024-01-13T18:16:41.089 INFO:tasks.workunit.client.0.smithi084.stdout:878 2024-01-13T18:16:41.090 INFO:tasks.workunit.client.0.smithi084.stdout:879 2024-01-13T18:16:41.092 INFO:tasks.workunit.client.0.smithi084.stdout:880 2024-01-13T18:16:41.093 INFO:tasks.workunit.client.0.smithi084.stdout:881 2024-01-13T18:16:41.095 INFO:tasks.workunit.client.0.smithi084.stdout:882 2024-01-13T18:16:41.098 INFO:tasks.workunit.client.0.smithi084.stdout:883 2024-01-13T18:16:41.100 INFO:tasks.workunit.client.0.smithi084.stdout:884 2024-01-13T18:16:41.104 INFO:tasks.workunit.client.0.smithi084.stdout:885 2024-01-13T18:16:41.106 INFO:tasks.workunit.client.0.smithi084.stdout:886 2024-01-13T18:16:41.107 INFO:tasks.workunit.client.0.smithi084.stdout:887 2024-01-13T18:16:41.108 INFO:tasks.workunit.client.0.smithi084.stdout:888 2024-01-13T18:16:41.109 INFO:tasks.workunit.client.0.smithi084.stdout:889 2024-01-13T18:16:41.110 INFO:tasks.workunit.client.0.smithi084.stdout:890 2024-01-13T18:16:41.111 INFO:tasks.workunit.client.0.smithi084.stdout:891 2024-01-13T18:16:41.112 INFO:tasks.workunit.client.0.smithi084.stdout:892 2024-01-13T18:16:41.114 INFO:tasks.workunit.client.0.smithi084.stdout:893 2024-01-13T18:16:41.115 INFO:tasks.workunit.client.0.smithi084.stdout:894 2024-01-13T18:16:41.116 INFO:tasks.workunit.client.0.smithi084.stdout:895 2024-01-13T18:16:41.117 INFO:tasks.workunit.client.0.smithi084.stdout:896 2024-01-13T18:16:41.118 INFO:tasks.workunit.client.0.smithi084.stdout:897 2024-01-13T18:16:41.119 INFO:tasks.workunit.client.0.smithi084.stdout:898 2024-01-13T18:16:41.120 INFO:tasks.workunit.client.0.smithi084.stdout:899 2024-01-13T18:16:41.121 INFO:tasks.workunit.client.0.smithi084.stdout:900 2024-01-13T18:16:41.122 INFO:tasks.workunit.client.0.smithi084.stdout:901 2024-01-13T18:16:41.123 INFO:tasks.workunit.client.0.smithi084.stdout:902 2024-01-13T18:16:41.124 INFO:tasks.workunit.client.0.smithi084.stdout:903 2024-01-13T18:16:41.126 INFO:tasks.workunit.client.0.smithi084.stdout:904 2024-01-13T18:16:41.127 INFO:tasks.workunit.client.0.smithi084.stdout:905 2024-01-13T18:16:41.128 INFO:tasks.workunit.client.0.smithi084.stdout:906 2024-01-13T18:16:41.129 INFO:tasks.workunit.client.0.smithi084.stdout:907 2024-01-13T18:16:41.130 INFO:tasks.workunit.client.0.smithi084.stdout:908 2024-01-13T18:16:41.131 INFO:tasks.workunit.client.0.smithi084.stdout:909 2024-01-13T18:16:41.132 INFO:tasks.workunit.client.0.smithi084.stdout:910 2024-01-13T18:16:41.133 INFO:tasks.workunit.client.0.smithi084.stdout:911 2024-01-13T18:16:41.134 INFO:tasks.workunit.client.0.smithi084.stdout:912 2024-01-13T18:16:41.135 INFO:tasks.workunit.client.0.smithi084.stdout:913 2024-01-13T18:16:41.136 INFO:tasks.workunit.client.0.smithi084.stdout:914 2024-01-13T18:16:41.137 INFO:tasks.workunit.client.0.smithi084.stdout:915 2024-01-13T18:16:41.138 INFO:tasks.workunit.client.0.smithi084.stdout:916 2024-01-13T18:16:41.139 INFO:tasks.workunit.client.0.smithi084.stdout:917 2024-01-13T18:16:41.140 INFO:tasks.workunit.client.0.smithi084.stdout:918 2024-01-13T18:16:41.141 INFO:tasks.workunit.client.0.smithi084.stdout:919 2024-01-13T18:16:41.142 INFO:tasks.workunit.client.0.smithi084.stdout:920 2024-01-13T18:16:41.143 INFO:tasks.workunit.client.0.smithi084.stdout:921 2024-01-13T18:16:41.144 INFO:tasks.workunit.client.0.smithi084.stdout:922 2024-01-13T18:16:41.145 INFO:tasks.workunit.client.0.smithi084.stdout:923 2024-01-13T18:16:41.146 INFO:tasks.workunit.client.0.smithi084.stdout:924 2024-01-13T18:16:41.147 INFO:tasks.workunit.client.0.smithi084.stdout:925 2024-01-13T18:16:41.148 INFO:tasks.workunit.client.0.smithi084.stdout:926 2024-01-13T18:16:41.150 INFO:tasks.workunit.client.0.smithi084.stdout:927 2024-01-13T18:16:41.151 INFO:tasks.workunit.client.0.smithi084.stdout:928 2024-01-13T18:16:41.152 INFO:tasks.workunit.client.0.smithi084.stdout:929 2024-01-13T18:16:41.153 INFO:tasks.workunit.client.0.smithi084.stdout:930 2024-01-13T18:16:41.154 INFO:tasks.workunit.client.0.smithi084.stdout:931 2024-01-13T18:16:41.155 INFO:tasks.workunit.client.0.smithi084.stdout:932 2024-01-13T18:16:41.156 INFO:tasks.workunit.client.0.smithi084.stdout:933 2024-01-13T18:16:41.157 INFO:tasks.workunit.client.0.smithi084.stdout:934 2024-01-13T18:16:41.158 INFO:tasks.workunit.client.0.smithi084.stdout:935 2024-01-13T18:16:41.159 INFO:tasks.workunit.client.0.smithi084.stdout:936 2024-01-13T18:16:41.160 INFO:tasks.workunit.client.0.smithi084.stdout:937 2024-01-13T18:16:41.163 INFO:tasks.workunit.client.0.smithi084.stdout:938 2024-01-13T18:16:41.164 INFO:tasks.workunit.client.0.smithi084.stdout:939 2024-01-13T18:16:41.164 INFO:tasks.workunit.client.0.smithi084.stdout:940 2024-01-13T18:16:41.164 INFO:tasks.workunit.client.0.smithi084.stdout:941 2024-01-13T18:16:41.165 INFO:tasks.workunit.client.0.smithi084.stdout:942 2024-01-13T18:16:41.166 INFO:tasks.workunit.client.0.smithi084.stdout:943 2024-01-13T18:16:41.168 INFO:tasks.workunit.client.0.smithi084.stdout:944 2024-01-13T18:16:41.168 INFO:tasks.workunit.client.0.smithi084.stdout:945 2024-01-13T18:16:41.170 INFO:tasks.workunit.client.0.smithi084.stdout:946 2024-01-13T18:16:41.170 INFO:tasks.workunit.client.0.smithi084.stdout:947 2024-01-13T18:16:41.171 INFO:tasks.workunit.client.0.smithi084.stdout:948 2024-01-13T18:16:41.172 INFO:tasks.workunit.client.0.smithi084.stdout:949 2024-01-13T18:16:41.173 INFO:tasks.workunit.client.0.smithi084.stdout:950 2024-01-13T18:16:41.174 INFO:tasks.workunit.client.0.smithi084.stdout:951 2024-01-13T18:16:41.175 INFO:tasks.workunit.client.0.smithi084.stdout:952 2024-01-13T18:16:41.176 INFO:tasks.workunit.client.0.smithi084.stdout:953 2024-01-13T18:16:41.177 INFO:tasks.workunit.client.0.smithi084.stdout:954 2024-01-13T18:16:41.179 INFO:tasks.workunit.client.0.smithi084.stdout:955 2024-01-13T18:16:41.180 INFO:tasks.workunit.client.0.smithi084.stdout:956 2024-01-13T18:16:41.181 INFO:tasks.workunit.client.0.smithi084.stdout:957 2024-01-13T18:16:41.182 INFO:tasks.workunit.client.0.smithi084.stdout:958 2024-01-13T18:16:41.183 INFO:tasks.workunit.client.0.smithi084.stdout:959 2024-01-13T18:16:41.184 INFO:tasks.workunit.client.0.smithi084.stdout:960 2024-01-13T18:16:41.185 INFO:tasks.workunit.client.0.smithi084.stdout:961 2024-01-13T18:16:41.186 INFO:tasks.workunit.client.0.smithi084.stdout:962 2024-01-13T18:16:41.187 INFO:tasks.workunit.client.0.smithi084.stdout:963 2024-01-13T18:16:41.188 INFO:tasks.workunit.client.0.smithi084.stdout:964 2024-01-13T18:16:41.189 INFO:tasks.workunit.client.0.smithi084.stdout:965 2024-01-13T18:16:41.190 INFO:tasks.workunit.client.0.smithi084.stdout:966 2024-01-13T18:16:41.191 INFO:tasks.workunit.client.0.smithi084.stdout:967 2024-01-13T18:16:41.193 INFO:tasks.workunit.client.0.smithi084.stdout:968 2024-01-13T18:16:41.194 INFO:tasks.workunit.client.0.smithi084.stdout:969 2024-01-13T18:16:41.195 INFO:tasks.workunit.client.0.smithi084.stdout:970 2024-01-13T18:16:41.196 INFO:tasks.workunit.client.0.smithi084.stdout:971 2024-01-13T18:16:41.197 INFO:tasks.workunit.client.0.smithi084.stdout:972 2024-01-13T18:16:41.198 INFO:tasks.workunit.client.0.smithi084.stdout:973 2024-01-13T18:16:41.199 INFO:tasks.workunit.client.0.smithi084.stdout:974 2024-01-13T18:16:41.200 INFO:tasks.workunit.client.0.smithi084.stdout:975 2024-01-13T18:16:41.201 INFO:tasks.workunit.client.0.smithi084.stdout:976 2024-01-13T18:16:41.202 INFO:tasks.workunit.client.0.smithi084.stdout:977 2024-01-13T18:16:41.203 INFO:tasks.workunit.client.0.smithi084.stdout:978 2024-01-13T18:16:41.204 INFO:tasks.workunit.client.0.smithi084.stdout:979 2024-01-13T18:16:41.205 INFO:tasks.workunit.client.0.smithi084.stdout:980 2024-01-13T18:16:41.206 INFO:tasks.workunit.client.0.smithi084.stdout:981 2024-01-13T18:16:41.207 INFO:tasks.workunit.client.0.smithi084.stdout:982 2024-01-13T18:16:41.208 INFO:tasks.workunit.client.0.smithi084.stdout:983 2024-01-13T18:16:41.209 INFO:tasks.workunit.client.0.smithi084.stdout:984 2024-01-13T18:16:41.210 INFO:tasks.workunit.client.0.smithi084.stdout:985 2024-01-13T18:16:41.211 INFO:tasks.workunit.client.0.smithi084.stdout:986 2024-01-13T18:16:41.212 INFO:tasks.workunit.client.0.smithi084.stdout:987 2024-01-13T18:16:41.213 INFO:tasks.workunit.client.0.smithi084.stdout:988 2024-01-13T18:16:41.214 INFO:tasks.workunit.client.0.smithi084.stdout:989 2024-01-13T18:16:41.215 INFO:tasks.workunit.client.0.smithi084.stdout:990 2024-01-13T18:16:41.216 INFO:tasks.workunit.client.0.smithi084.stdout:991 2024-01-13T18:16:41.217 INFO:tasks.workunit.client.0.smithi084.stdout:992 2024-01-13T18:16:41.218 INFO:tasks.workunit.client.0.smithi084.stdout:993 2024-01-13T18:16:41.219 INFO:tasks.workunit.client.0.smithi084.stdout:994 2024-01-13T18:16:41.221 INFO:tasks.workunit.client.0.smithi084.stdout:995 2024-01-13T18:16:41.222 INFO:tasks.workunit.client.0.smithi084.stdout:996 2024-01-13T18:16:41.223 INFO:tasks.workunit.client.0.smithi084.stdout:997 2024-01-13T18:16:41.224 INFO:tasks.workunit.client.0.smithi084.stdout:998 2024-01-13T18:16:41.226 INFO:tasks.workunit.client.0.smithi084.stdout:999 2024-01-13T18:16:41.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:41 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:41.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:41 smithi099 ceph-mon[138788]: osdmap e964: 8 total, 8 up, 8 in 2024-01-13T18:16:41.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:41 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2959097420' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-01-13T18:16:41.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:41 smithi099 ceph-mon[138788]: pgmap v1185: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:41.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:41 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:41.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:41 smithi084 ceph-mon[116404]: osdmap e964: 8 total, 8 up, 8 in 2024-01-13T18:16:41.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:41 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2959097420' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-01-13T18:16:41.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:41 smithi084 ceph-mon[116404]: pgmap v1185: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:41.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:41 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:41.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:41 smithi084 ceph-mon[119097]: osdmap e964: 8 total, 8 up, 8 in 2024-01-13T18:16:41.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:41 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2959097420' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-01-13T18:16:41.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:41 smithi084 ceph-mon[119097]: pgmap v1185: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:42.115 INFO:tasks.workunit.client.0.smithi084.stdout:00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-01-13T18:16:42.115 INFO:tasks.workunit.client.0.smithi084.stdout:00000010 69 73 |is| 2024-01-13T18:16:42.115 INFO:tasks.workunit.client.0.smithi084.stdout:00000012 2024-01-13T18:16:42.115 INFO:tasks.workunit.client.0.smithi084.stdout:00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-01-13T18:16:42.115 INFO:tasks.workunit.client.0.smithi084.stdout:00000010 69 73 |is| 2024-01-13T18:16:42.115 INFO:tasks.workunit.client.0.smithi084.stdout:00000012 2024-01-13T18:16:42.115 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsHello.WriteReturnData (4033 ms) 2024-01-13T18:16:42.116 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsHello.Loud 2024-01-13T18:16:42.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:42 smithi084 ceph-mon[116404]: osdmap e965: 8 total, 8 up, 8 in 2024-01-13T18:16:42.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:42 smithi084 ceph-mon[119097]: osdmap e965: 8 total, 8 up, 8 in 2024-01-13T18:16:42.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:42 smithi099 ceph-mon[138788]: osdmap e965: 8 total, 8 up, 8 in 2024-01-13T18:16:43.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:43 smithi084 ceph-mon[116404]: osdmap e966: 8 total, 8 up, 8 in 2024-01-13T18:16:43.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:43 smithi084 ceph-mon[116404]: pgmap v1188: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:43.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:43 smithi084 ceph-mon[119097]: osdmap e966: 8 total, 8 up, 8 in 2024-01-13T18:16:43.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:43 smithi084 ceph-mon[119097]: pgmap v1188: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:43 smithi099 ceph-mon[138788]: osdmap e966: 8 total, 8 up, 8 in 2024-01-13T18:16:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:43 smithi099 ceph-mon[138788]: pgmap v1188: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:16:44.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:44 smithi084 ceph-mon[116404]: osdmap e967: 8 total, 8 up, 8 in 2024-01-13T18:16:44.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:44 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/75153999' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:44.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:44 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:44.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:44 smithi084 ceph-mon[119097]: osdmap e967: 8 total, 8 up, 8 in 2024-01-13T18:16:44.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:44 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/75153999' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:44.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:44 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:44 smithi099 ceph-mon[138788]: osdmap e967: 8 total, 8 up, 8 in 2024-01-13T18:16:44.665 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:44 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/75153999' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:44.665 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:44 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:45.166 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsHello.Loud (3051 ms) 2024-01-13T18:16:45.166 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsHello.BadMethods 2024-01-13T18:16:45.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:45 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:45.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:45 smithi084 ceph-mon[116404]: osdmap e968: 8 total, 8 up, 8 in 2024-01-13T18:16:45.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:45 smithi084 ceph-mon[116404]: pgmap v1191: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:45 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:45 smithi084 ceph-mon[119097]: osdmap e968: 8 total, 8 up, 8 in 2024-01-13T18:16:45.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:45 smithi084 ceph-mon[119097]: pgmap v1191: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:45 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:45 smithi099 ceph-mon[138788]: osdmap e968: 8 total, 8 up, 8 in 2024-01-13T18:16:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:45 smithi099 ceph-mon[138788]: pgmap v1191: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:46.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:46 smithi084 ceph-mon[116404]: osdmap e969: 8 total, 8 up, 8 in 2024-01-13T18:16:46.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:46 smithi084 ceph-mon[119097]: osdmap e969: 8 total, 8 up, 8 in 2024-01-13T18:16:46.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:46 smithi099 ceph-mon[138788]: osdmap e969: 8 total, 8 up, 8 in 2024-01-13T18:16:47.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:47 smithi084 ceph-mon[119097]: osdmap e970: 8 total, 8 up, 8 in 2024-01-13T18:16:47.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:47 smithi084 ceph-mon[119097]: pgmap v1193: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:47.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:47 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2953962948' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:47.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:47 smithi084 ceph-mon[116404]: osdmap e970: 8 total, 8 up, 8 in 2024-01-13T18:16:47.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:47 smithi084 ceph-mon[116404]: pgmap v1193: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:47.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:47 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2953962948' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:47.429 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:16:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[144063]: 2024-01-13T18:16:47.188+0000 7f9fb0cb4700 -1 osd.3 pg_epoch: 971 pg[38.2( v 971'1 (0'0,971'1] local-lis/les=970/971 n=1 ec=970/970 lis/c=970/970 les/c/f=971/971/0 sis=970) [3,7,5] r=0 lpr=970 crt=971'1 lcod 0'0 mlcod 0'0 active+clean] method hello.bad_reader tried to read object but is not marked RD 2024-01-13T18:16:47.429 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 18:16:47 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[144063]: 2024-01-13T18:16:47.189+0000 7f9fb0cb4700 -1 osd.3 pg_epoch: 971 pg[38.2( v 971'2 (0'0,971'2] local-lis/les=970/971 n=1 ec=970/970 lis/c=970/970 les/c/f=971/971/0 sis=970) [3,7,5] r=0 lpr=970 crt=971'1 lcod 971'1 mlcod 971'1 active+clean] method hello.bad_writer tried to update object but is not marked WR 2024-01-13T18:16:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:47 smithi099 ceph-mon[138788]: osdmap e970: 8 total, 8 up, 8 in 2024-01-13T18:16:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:47 smithi099 ceph-mon[138788]: pgmap v1193: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:47 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2953962948' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:48.183 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsHello.BadMethods (3017 ms) 2024-01-13T18:16:48.183 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsHello.Filter 2024-01-13T18:16:48.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:48 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2953962948' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:48.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:48 smithi084 ceph-mon[116404]: osdmap e971: 8 total, 8 up, 8 in 2024-01-13T18:16:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:48 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2953962948' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:48.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:48 smithi084 ceph-mon[119097]: osdmap e971: 8 total, 8 up, 8 in 2024-01-13T18:16:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:48 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2953962948' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:48.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:48 smithi099 ceph-mon[138788]: osdmap e971: 8 total, 8 up, 8 in 2024-01-13T18:16:49.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:49 smithi084 ceph-mon[116404]: pgmap v1196: 137 pgs: 12 creating+peering, 9 unknown, 116 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:49.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:49 smithi084 ceph-mon[116404]: osdmap e972: 8 total, 8 up, 8 in 2024-01-13T18:16:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:49 smithi084 ceph-mon[119097]: pgmap v1196: 137 pgs: 12 creating+peering, 9 unknown, 116 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:49 smithi084 ceph-mon[119097]: osdmap e972: 8 total, 8 up, 8 in 2024-01-13T18:16:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:49 smithi099 ceph-mon[138788]: pgmap v1196: 137 pgs: 12 creating+peering, 9 unknown, 116 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:49 smithi099 ceph-mon[138788]: osdmap e972: 8 total, 8 up, 8 in 2024-01-13T18:16:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:50 smithi099 ceph-mon[138788]: osdmap e973: 8 total, 8 up, 8 in 2024-01-13T18:16:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:50 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1953988563' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:50 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:16:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:16:50] "GET /metrics HTTP/1.1" 200 36280 "" "Prometheus/2.43.0" 2024-01-13T18:16:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:50 smithi084 ceph-mon[116404]: osdmap e973: 8 total, 8 up, 8 in 2024-01-13T18:16:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:50 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1953988563' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:50 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:50 smithi084 ceph-mon[119097]: osdmap e973: 8 total, 8 up, 8 in 2024-01-13T18:16:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:50 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1953988563' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:50 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:16:51.207 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsHello.Filter (3021 ms) 2024-01-13T18:16:51.207 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 6 tests from ClsHello (19049 ms total) 2024-01-13T18:16:51.207 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:16:51.207 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:16:51.207 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 6 tests from 1 test suite ran. (19049 ms total) 2024-01-13T18:16:51.207 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 6 tests. 2024-01-13T18:16:51.209 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:16:51.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:16:51.277 INFO:tasks.workunit:Running workunit cls/test_cls_journal.sh... 2024-01-13T18:16:51.277 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_journal.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_journal.sh 2024-01-13T18:16:51.347 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:16:51.348 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 27 tests from 1 test suite. 2024-01-13T18:16:51.348 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:16:51.348 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 27 tests from TestClsJournal 2024-01-13T18:16:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:51 smithi099 ceph-mon[138788]: pgmap v1199: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:51 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:51 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:51 smithi099 ceph-mon[138788]: osdmap e974: 8 total, 8 up, 8 in 2024-01-13T18:16:51.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:51 smithi084 ceph-mon[116404]: pgmap v1199: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:51.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:51 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:51.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:51 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:51.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:51 smithi084 ceph-mon[116404]: osdmap e974: 8 total, 8 up, 8 in 2024-01-13T18:16:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:51 smithi084 ceph-mon[119097]: pgmap v1199: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:51 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:51 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169479-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:51 smithi084 ceph-mon[119097]: osdmap e974: 8 total, 8 up, 8 in 2024-01-13T18:16:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:52 smithi099 ceph-mon[138788]: osdmap e975: 8 total, 8 up, 8 in 2024-01-13T18:16:52.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:52 smithi084 ceph-mon[116404]: osdmap e975: 8 total, 8 up, 8 in 2024-01-13T18:16:52.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:52 smithi084 ceph-mon[119097]: osdmap e975: 8 total, 8 up, 8 in 2024-01-13T18:16:53.218 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.Create 2024-01-13T18:16:53.224 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.Create (7 ms) 2024-01-13T18:16:53.224 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.MinimumSet 2024-01-13T18:16:53.229 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.MinimumSet (4 ms) 2024-01-13T18:16:53.229 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.MinimumSetStale 2024-01-13T18:16:53.233 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.MinimumSetStale (5 ms) 2024-01-13T18:16:53.233 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.MinimumSetOrderConstraint 2024-01-13T18:16:53.236 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.MinimumSetOrderConstraint (3 ms) 2024-01-13T18:16:53.236 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ActiveSet 2024-01-13T18:16:53.239 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ActiveSet (3 ms) 2024-01-13T18:16:53.239 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ActiveSetStale 2024-01-13T18:16:53.242 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ActiveSetStale (3 ms) 2024-01-13T18:16:53.242 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.CreateDuplicate 2024-01-13T18:16:53.245 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.CreateDuplicate (2 ms) 2024-01-13T18:16:53.245 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.GetClient 2024-01-13T18:16:53.247 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.GetClient (3 ms) 2024-01-13T18:16:53.247 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ClientRegister 2024-01-13T18:16:53.249 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ClientRegister (2 ms) 2024-01-13T18:16:53.249 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ClientRegisterDuplicate 2024-01-13T18:16:53.253 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ClientRegisterDuplicate (3 ms) 2024-01-13T18:16:53.253 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ClientUpdateData 2024-01-13T18:16:53.257 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ClientUpdateData (5 ms) 2024-01-13T18:16:53.257 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ClientUpdateState 2024-01-13T18:16:53.262 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ClientUpdateState (4 ms) 2024-01-13T18:16:53.262 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ClientUnregister 2024-01-13T18:16:53.265 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ClientUnregister (3 ms) 2024-01-13T18:16:53.265 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ClientUnregisterDNE 2024-01-13T18:16:53.269 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ClientUnregisterDNE (4 ms) 2024-01-13T18:16:53.269 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ClientUnregisterPruneTags 2024-01-13T18:16:53.368 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ClientUnregisterPruneTags (99 ms) 2024-01-13T18:16:53.368 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ClientCommit 2024-01-13T18:16:53.372 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ClientCommit (4 ms) 2024-01-13T18:16:53.372 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ClientCommitInvalid 2024-01-13T18:16:53.375 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ClientCommitInvalid (3 ms) 2024-01-13T18:16:53.375 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ClientCommitDNE 2024-01-13T18:16:53.376 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ClientCommitDNE (1 ms) 2024-01-13T18:16:53.376 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.ClientList 2024-01-13T18:16:53.413 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.ClientList (37 ms) 2024-01-13T18:16:53.413 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.GetNextTagTid 2024-01-13T18:16:53.417 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.GetNextTagTid (4 ms) 2024-01-13T18:16:53.417 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.TagCreate 2024-01-13T18:16:53.425 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.TagCreate (8 ms) 2024-01-13T18:16:53.425 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.TagCreatePrunesTags 2024-01-13T18:16:53.432 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.TagCreatePrunesTags (7 ms) 2024-01-13T18:16:53.432 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.TagList 2024-01-13T18:16:53.518 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.TagList (86 ms) 2024-01-13T18:16:53.518 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.GuardAppend 2024-01-13T18:16:53.519 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.GuardAppend (2 ms) 2024-01-13T18:16:53.519 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.GuardAppendDNE 2024-01-13T18:16:53.520 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.GuardAppendDNE (1 ms) 2024-01-13T18:16:53.520 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.GuardAppendOverflow 2024-01-13T18:16:53.522 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.GuardAppendOverflow (1 ms) 2024-01-13T18:16:53.522 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsJournal.Append 2024-01-13T18:16:53.532 INFO:tasks.workunit.client.0.smithi084.stdout:padding is not enabled 2024-01-13T18:16:53.532 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsJournal.Append (10 ms) 2024-01-13T18:16:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:53 smithi099 ceph-mon[138788]: pgmap v1202: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:53 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:53 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:16:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:53 smithi099 ceph-mon[138788]: osdmap e976: 8 total, 8 up, 8 in 2024-01-13T18:16:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:53 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1334434558' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169631-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:53 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169631-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[116404]: pgmap v1202: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:16:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[116404]: osdmap e976: 8 total, 8 up, 8 in 2024-01-13T18:16:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1334434558' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169631-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169631-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[119097]: pgmap v1202: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:16:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[119097]: osdmap e976: 8 total, 8 up, 8 in 2024-01-13T18:16:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1334434558' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169631-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:53 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169631-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:54.227 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 27 tests from TestClsJournal (314 ms total) 2024-01-13T18:16:54.228 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:16:54.228 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:16:54.228 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 27 tests from 1 test suite ran. (2879 ms total) 2024-01-13T18:16:54.228 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 27 tests. 2024-01-13T18:16:54.229 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:16:54.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:16:54.300 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-01-13T18:16:54.301 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-01-13T18:16:54.374 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:16:54.374 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 11 tests from 1 test suite. 2024-01-13T18:16:54.374 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:16:54.374 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 11 tests from ClsLock 2024-01-13T18:16:54.374 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-01-13T18:16:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:54 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169631-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:54 smithi099 ceph-mon[138788]: osdmap e977: 8 total, 8 up, 8 in 2024-01-13T18:16:54.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:54 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169631-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:54.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:54 smithi084 ceph-mon[116404]: osdmap e977: 8 total, 8 up, 8 in 2024-01-13T18:16:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:54 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169631-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:54.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:54 smithi084 ceph-mon[119097]: osdmap e977: 8 total, 8 up, 8 in 2024-01-13T18:16:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:55 smithi099 ceph-mon[138788]: pgmap v1205: 137 pgs: 7 creating+peering, 22 unknown, 108 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-01-13T18:16:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:55 smithi099 ceph-mon[138788]: osdmap e978: 8 total, 8 up, 8 in 2024-01-13T18:16:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:55 smithi084 ceph-mon[116404]: pgmap v1205: 137 pgs: 7 creating+peering, 22 unknown, 108 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-01-13T18:16:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:55 smithi084 ceph-mon[116404]: osdmap e978: 8 total, 8 up, 8 in 2024-01-13T18:16:55.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:55 smithi084 ceph-mon[119097]: pgmap v1205: 137 pgs: 7 creating+peering, 22 unknown, 108 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-01-13T18:16:55.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:55 smithi084 ceph-mon[119097]: osdmap e978: 8 total, 8 up, 8 in 2024-01-13T18:16:56.277 INFO:tasks.workunit.client.0.smithi084.stdout:lock: mylock 2024-01-13T18:16:56.277 INFO:tasks.workunit.client.0.smithi084.stdout: lock_type: exclusive 2024-01-13T18:16:56.277 INFO:tasks.workunit.client.0.smithi084.stdout: tag: 2024-01-13T18:16:56.277 INFO:tasks.workunit.client.0.smithi084.stdout: lockers: 2024-01-13T18:16:56.277 INFO:tasks.workunit.client.0.smithi084.stdout: client.44585 expiration=2024-01-13T18:18:56.273067+0000 addr=v1:172.21.15.84:0/396323224 cookie= 2024-01-13T18:16:56.280 INFO:tasks.workunit.client.0.smithi084.stdout:lock: mylock 2024-01-13T18:16:56.280 INFO:tasks.workunit.client.0.smithi084.stdout: lock_type: shared 2024-01-13T18:16:56.281 INFO:tasks.workunit.client.0.smithi084.stdout: tag: 2024-01-13T18:16:56.281 INFO:tasks.workunit.client.0.smithi084.stdout: lockers: 2024-01-13T18:16:56.281 INFO:tasks.workunit.client.0.smithi084.stdout: client.34656 expiration=0.000000 addr=v1:172.21.15.84:0/1756980219 cookie= 2024-01-13T18:16:56.281 INFO:tasks.workunit.client.0.smithi084.stdout: client.44585 expiration=2024-01-13T18:18:56.278976+0000 addr=v1:172.21.15.84:0/396323224 cookie= 2024-01-13T18:16:56.281 INFO:tasks.workunit.client.0.smithi084.stdout:lock: mylock 2024-01-13T18:16:56.281 INFO:tasks.workunit.client.0.smithi084.stdout: lock_type: shared 2024-01-13T18:16:56.282 INFO:tasks.workunit.client.0.smithi084.stdout: tag: 2024-01-13T18:16:56.282 INFO:tasks.workunit.client.0.smithi084.stdout: lockers: 2024-01-13T18:16:56.282 INFO:tasks.workunit.client.0.smithi084.stdout: client.34656 expiration=0.000000 addr=v1:172.21.15.84:0/1756980219 cookie= 2024-01-13T18:16:56.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:56 smithi099 ceph-mon[138788]: osdmap e979: 8 total, 8 up, 8 in 2024-01-13T18:16:56.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:56 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/396323224' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:56.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:56 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:56.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:56 smithi084 ceph-mon[116404]: osdmap e979: 8 total, 8 up, 8 in 2024-01-13T18:16:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:56 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/396323224' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:56.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:56 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:56 smithi084 ceph-mon[119097]: osdmap e979: 8 total, 8 up, 8 in 2024-01-13T18:16:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:56 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/396323224' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:56 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:57.252 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsLock.TestMultiLocking (2878 ms) 2024-01-13T18:16:57.252 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsLock.TestMeta 2024-01-13T18:16:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:57 smithi099 ceph-mon[138788]: pgmap v1208: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:57 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:57 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:57 smithi099 ceph-mon[138788]: osdmap e980: 8 total, 8 up, 8 in 2024-01-13T18:16:57.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:57 smithi084 ceph-mon[116404]: pgmap v1208: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:57 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:57 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:57 smithi084 ceph-mon[116404]: osdmap e980: 8 total, 8 up, 8 in 2024-01-13T18:16:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:57 smithi084 ceph-mon[119097]: pgmap v1208: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:57 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:16:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:57 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:16:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:57 smithi084 ceph-mon[119097]: osdmap e980: 8 total, 8 up, 8 in 2024-01-13T18:16:58.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:58 smithi099 ceph-mon[138788]: osdmap e981: 8 total, 8 up, 8 in 2024-01-13T18:16:58.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:58 smithi084 ceph-mon[116404]: osdmap e981: 8 total, 8 up, 8 in 2024-01-13T18:16:58.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:58 smithi084 ceph-mon[119097]: osdmap e981: 8 total, 8 up, 8 in 2024-01-13T18:16:59.316 INFO:tasks.workunit.client.0.smithi084.stdout:lock: mylock 2024-01-13T18:16:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: lock_type: shared 2024-01-13T18:16:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: tag: 2024-01-13T18:16:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: lockers: 2024-01-13T18:16:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: client.44603 expiration=0.000000 addr=v1:172.21.15.84:0/1266781668 cookie= 2024-01-13T18:16:59.318 INFO:tasks.workunit.client.0.smithi084.stdout:lock: mylock 2024-01-13T18:16:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: lock_type: exclusive 2024-01-13T18:16:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: tag: new_tag 2024-01-13T18:16:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: lockers: 2024-01-13T18:16:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: client.44597 expiration=0.000000 addr=v1:172.21.15.84:0/3199562588 cookie= 2024-01-13T18:16:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:59 smithi099 ceph-mon[138788]: pgmap v1211: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:59 smithi099 ceph-mon[138788]: osdmap e982: 8 total, 8 up, 8 in 2024-01-13T18:16:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:59 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3199562588' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:59 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:59 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:16:59 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:16:59.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[116404]: pgmap v1211: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[116404]: osdmap e982: 8 total, 8 up, 8 in 2024-01-13T18:16:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3199562588' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:59.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:16:59.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[119097]: pgmap v1211: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:16:59.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[119097]: osdmap e982: 8 total, 8 up, 8 in 2024-01-13T18:16:59.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3199562588' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:59.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:16:59.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:16:59.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:16:59 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:17:00.281 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsLock.TestMeta (3029 ms) 2024-01-13T18:17:00.281 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsLock.TestCookie 2024-01-13T18:17:00.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:00 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:00.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:00 smithi099 ceph-mon[138788]: osdmap e983: 8 total, 8 up, 8 in 2024-01-13T18:17:00.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:00 smithi099 ceph-mon[138788]: osdmap e984: 8 total, 8 up, 8 in 2024-01-13T18:17:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:17:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:17:00] "GET /metrics HTTP/1.1" 200 36280 "" "Prometheus/2.43.0" 2024-01-13T18:17:00.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:00 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:00.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:00 smithi084 ceph-mon[116404]: osdmap e983: 8 total, 8 up, 8 in 2024-01-13T18:17:00.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:00 smithi084 ceph-mon[116404]: osdmap e984: 8 total, 8 up, 8 in 2024-01-13T18:17:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:00 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:00 smithi084 ceph-mon[119097]: osdmap e983: 8 total, 8 up, 8 in 2024-01-13T18:17:00.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:00 smithi084 ceph-mon[119097]: osdmap e984: 8 total, 8 up, 8 in 2024-01-13T18:17:01.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:01 smithi099 ceph-mon[138788]: pgmap v1214: 137 pgs: 5 creating+peering, 21 unknown, 111 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:01.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:01 smithi084 ceph-mon[116404]: pgmap v1214: 137 pgs: 5 creating+peering, 21 unknown, 111 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:01 smithi084 ceph-mon[119097]: pgmap v1214: 137 pgs: 5 creating+peering, 21 unknown, 111 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:02.450 INFO:tasks.workunit.client.0.smithi084.stdout:lock: mylock 2024-01-13T18:17:02.450 INFO:tasks.workunit.client.0.smithi084.stdout: lock_type: exclusive 2024-01-13T18:17:02.450 INFO:tasks.workunit.client.0.smithi084.stdout: tag: 2024-01-13T18:17:02.450 INFO:tasks.workunit.client.0.smithi084.stdout: lockers: 2024-01-13T18:17:02.452 INFO:tasks.workunit.client.0.smithi084.stdout:lock: mylock 2024-01-13T18:17:02.452 INFO:tasks.workunit.client.0.smithi084.stdout: lock_type: shared 2024-01-13T18:17:02.452 INFO:tasks.workunit.client.0.smithi084.stdout: tag: 2024-01-13T18:17:02.453 INFO:tasks.workunit.client.0.smithi084.stdout: lockers: 2024-01-13T18:17:02.453 INFO:tasks.workunit.client.0.smithi084.stdout: client.34668 expiration=0.000000 addr=v1:172.21.15.84:0/4020239806 cookie= 2024-01-13T18:17:02.453 INFO:tasks.workunit.client.0.smithi084.stdout: client.34668 expiration=0.000000 addr=v1:172.21.15.84:0/4020239806 cookie=new cookie 2024-01-13T18:17:02.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:02 smithi099 ceph-mon[138788]: osdmap e985: 8 total, 8 up, 8 in 2024-01-13T18:17:02.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:02 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4020239806' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:02.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:02 smithi084 ceph-mon[116404]: osdmap e985: 8 total, 8 up, 8 in 2024-01-13T18:17:02.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:02 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4020239806' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:02 smithi084 ceph-mon[119097]: osdmap e985: 8 total, 8 up, 8 in 2024-01-13T18:17:02.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:02 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4020239806' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:03.349 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsLock.TestCookie (3062 ms) 2024-01-13T18:17:03.349 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-01-13T18:17:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:03 smithi099 ceph-mon[138788]: pgmap v1217: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:03 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:03 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4020239806' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:03 smithi099 ceph-mon[138788]: osdmap e986: 8 total, 8 up, 8 in 2024-01-13T18:17:03.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:03 smithi084 ceph-mon[116404]: pgmap v1217: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:03.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:03 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:03 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4020239806' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:03 smithi084 ceph-mon[116404]: osdmap e986: 8 total, 8 up, 8 in 2024-01-13T18:17:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:03 smithi084 ceph-mon[119097]: pgmap v1217: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:03 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:03 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4020239806' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:03 smithi084 ceph-mon[119097]: osdmap e986: 8 total, 8 up, 8 in 2024-01-13T18:17:04.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:04 smithi099 ceph-mon[138788]: osdmap e987: 8 total, 8 up, 8 in 2024-01-13T18:17:04.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:04 smithi084 ceph-mon[116404]: osdmap e987: 8 total, 8 up, 8 in 2024-01-13T18:17:04.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:04 smithi084 ceph-mon[119097]: osdmap e987: 8 total, 8 up, 8 in 2024-01-13T18:17:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:05 smithi099 ceph-mon[138788]: pgmap v1220: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:05 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:05 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:17:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:05 smithi099 ceph-mon[138788]: osdmap e988: 8 total, 8 up, 8 in 2024-01-13T18:17:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:05 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1345049738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[116404]: pgmap v1220: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:17:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[116404]: osdmap e988: 8 total, 8 up, 8 in 2024-01-13T18:17:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1345049738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[119097]: pgmap v1220: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:17:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[119097]: osdmap e988: 8 total, 8 up, 8 in 2024-01-13T18:17:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1345049738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:06.363 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsLock.TestMultipleLocks (3020 ms) 2024-01-13T18:17:06.363 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsLock.TestLockDuration 2024-01-13T18:17:06.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:06 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1345049738' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:06.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:06 smithi099 ceph-mon[138788]: osdmap e989: 8 total, 8 up, 8 in 2024-01-13T18:17:06.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:06 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1345049738' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:06.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:06 smithi084 ceph-mon[116404]: osdmap e989: 8 total, 8 up, 8 in 2024-01-13T18:17:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:06 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1345049738' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:06 smithi084 ceph-mon[119097]: osdmap e989: 8 total, 8 up, 8 in 2024-01-13T18:17:07.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:07 smithi099 ceph-mon[138788]: pgmap v1223: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:07.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:07 smithi099 ceph-mon[138788]: osdmap e990: 8 total, 8 up, 8 in 2024-01-13T18:17:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:07 smithi084 ceph-mon[119097]: pgmap v1223: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:07 smithi084 ceph-mon[119097]: osdmap e990: 8 total, 8 up, 8 in 2024-01-13T18:17:07.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:07 smithi084 ceph-mon[116404]: pgmap v1223: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:07.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:07 smithi084 ceph-mon[116404]: osdmap e990: 8 total, 8 up, 8 in 2024-01-13T18:17:08.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:08 smithi084 ceph-mon[116404]: osdmap e991: 8 total, 8 up, 8 in 2024-01-13T18:17:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:08 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2129429261' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:08 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2129429261' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:08.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:08 smithi084 ceph-mon[116404]: osdmap e992: 8 total, 8 up, 8 in 2024-01-13T18:17:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:08 smithi084 ceph-mon[119097]: osdmap e991: 8 total, 8 up, 8 in 2024-01-13T18:17:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:08 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2129429261' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:08 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2129429261' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:08.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:08 smithi084 ceph-mon[119097]: osdmap e992: 8 total, 8 up, 8 in 2024-01-13T18:17:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:08 smithi099 ceph-mon[138788]: osdmap e991: 8 total, 8 up, 8 in 2024-01-13T18:17:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:08 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2129429261' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:08 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2129429261' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:08 smithi099 ceph-mon[138788]: osdmap e992: 8 total, 8 up, 8 in 2024-01-13T18:17:09.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:09 smithi084 ceph-mon[116404]: pgmap v1226: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:09.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:09 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:09.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:09 smithi084 ceph-mon[116404]: osdmap e993: 8 total, 8 up, 8 in 2024-01-13T18:17:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:09 smithi084 ceph-mon[119097]: pgmap v1226: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:09 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:09.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:09 smithi084 ceph-mon[119097]: osdmap e993: 8 total, 8 up, 8 in 2024-01-13T18:17:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:09 smithi099 ceph-mon[138788]: pgmap v1226: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail 2024-01-13T18:17:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:09 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:09 smithi099 ceph-mon[138788]: osdmap e993: 8 total, 8 up, 8 in 2024-01-13T18:17:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:17:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:17:10] "GET /metrics HTTP/1.1" 200 36277 "" "Prometheus/2.43.0" 2024-01-13T18:17:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:10 smithi084 ceph-mon[116404]: pgmap v1229: 137 pgs: 4 creating+peering, 10 unknown, 123 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:10 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:10.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:10 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:17:10.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:10 smithi084 ceph-mon[119097]: pgmap v1229: 137 pgs: 4 creating+peering, 10 unknown, 123 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:10.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:10 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:10.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:10 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:17:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:10 smithi099 ceph-mon[138788]: pgmap v1229: 137 pgs: 4 creating+peering, 10 unknown, 123 active+clean; 583 KiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:10 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:10 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:17:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:13 smithi099 ceph-mon[138788]: pgmap v1230: 137 pgs: 4 creating+peering, 133 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:13 smithi084 ceph-mon[116404]: pgmap v1230: 137 pgs: 4 creating+peering, 133 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:13 smithi084 ceph-mon[119097]: pgmap v1230: 137 pgs: 4 creating+peering, 133 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:14.240 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsLock.TestLockDuration (7875 ms) 2024-01-13T18:17:14.240 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-01-13T18:17:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:15 smithi099 ceph-mon[138788]: pgmap v1231: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:15 smithi099 ceph-mon[138788]: osdmap e994: 8 total, 8 up, 8 in 2024-01-13T18:17:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:15 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:17:15.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:15 smithi084 ceph-mon[116404]: pgmap v1231: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:15.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:15 smithi084 ceph-mon[116404]: osdmap e994: 8 total, 8 up, 8 in 2024-01-13T18:17:15.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:15 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:17:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:15 smithi084 ceph-mon[119097]: pgmap v1231: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:15 smithi084 ceph-mon[119097]: osdmap e994: 8 total, 8 up, 8 in 2024-01-13T18:17:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:15 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:17:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:16 smithi099 ceph-mon[138788]: osdmap e995: 8 total, 8 up, 8 in 2024-01-13T18:17:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:16 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3596840067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:16 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:17:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:17:16.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:17:16.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[116404]: osdmap e995: 8 total, 8 up, 8 in 2024-01-13T18:17:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3596840067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:17:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:17:16.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:17:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[119097]: osdmap e995: 8 total, 8 up, 8 in 2024-01-13T18:17:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3596840067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:17:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:17:16.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:17:17.277 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsLock.TestAssertLocked (3040 ms) 2024-01-13T18:17:17.278 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsLock.TestSetCookie 2024-01-13T18:17:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:17 smithi099 ceph-mon[138788]: pgmap v1234: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:17 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:17 smithi099 ceph-mon[138788]: osdmap e996: 8 total, 8 up, 8 in 2024-01-13T18:17:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:17 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:17 smithi084 ceph-mon[116404]: pgmap v1234: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:17 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:17 smithi084 ceph-mon[116404]: osdmap e996: 8 total, 8 up, 8 in 2024-01-13T18:17:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:17 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:17 smithi084 ceph-mon[119097]: pgmap v1234: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:17 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:17 smithi084 ceph-mon[119097]: osdmap e996: 8 total, 8 up, 8 in 2024-01-13T18:17:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:17 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:18.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:18 smithi099 ceph-mon[138788]: osdmap e997: 8 total, 8 up, 8 in 2024-01-13T18:17:18.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:18 smithi084 ceph-mon[116404]: osdmap e997: 8 total, 8 up, 8 in 2024-01-13T18:17:18.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:18 smithi084 ceph-mon[119097]: osdmap e997: 8 total, 8 up, 8 in 2024-01-13T18:17:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:19 smithi099 ceph-mon[138788]: pgmap v1237: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:19 smithi099 ceph-mon[138788]: osdmap e998: 8 total, 8 up, 8 in 2024-01-13T18:17:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:19 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3791847139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:19 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:19 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:17:19.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:19 smithi084 ceph-mon[116404]: pgmap v1237: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:19.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:19 smithi084 ceph-mon[116404]: osdmap e998: 8 total, 8 up, 8 in 2024-01-13T18:17:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:19 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3791847139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:19 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:19.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:19 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:17:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:19 smithi084 ceph-mon[119097]: pgmap v1237: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:19 smithi084 ceph-mon[119097]: osdmap e998: 8 total, 8 up, 8 in 2024-01-13T18:17:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:19 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3791847139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:19 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:19.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:19 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:17:20.292 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsLock.TestSetCookie (3008 ms) 2024-01-13T18:17:20.293 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsLock.TestRenew 2024-01-13T18:17:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:20 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3791847139' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:20 smithi099 ceph-mon[138788]: osdmap e999: 8 total, 8 up, 8 in 2024-01-13T18:17:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:20 smithi099 ceph-mon[138788]: osdmap e1000: 8 total, 8 up, 8 in 2024-01-13T18:17:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:17:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:17:20] "GET /metrics HTTP/1.1" 200 36277 "" "Prometheus/2.43.0" 2024-01-13T18:17:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:20 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3791847139' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:20 smithi084 ceph-mon[116404]: osdmap e999: 8 total, 8 up, 8 in 2024-01-13T18:17:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:20 smithi084 ceph-mon[116404]: osdmap e1000: 8 total, 8 up, 8 in 2024-01-13T18:17:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:20 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3791847139' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:20 smithi084 ceph-mon[119097]: osdmap e999: 8 total, 8 up, 8 in 2024-01-13T18:17:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:20 smithi084 ceph-mon[119097]: osdmap e1000: 8 total, 8 up, 8 in 2024-01-13T18:17:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:21 smithi099 ceph-mon[138788]: pgmap v1240: 137 pgs: 7 creating+peering, 19 unknown, 111 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:21.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:21 smithi084 ceph-mon[119097]: pgmap v1240: 137 pgs: 7 creating+peering, 19 unknown, 111 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:21.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:21 smithi084 ceph-mon[116404]: pgmap v1240: 137 pgs: 7 creating+peering, 19 unknown, 111 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:22 smithi099 ceph-mon[138788]: osdmap e1001: 8 total, 8 up, 8 in 2024-01-13T18:17:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:22 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4190920658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:22 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:22.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:22 smithi084 ceph-mon[116404]: osdmap e1001: 8 total, 8 up, 8 in 2024-01-13T18:17:22.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:22 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4190920658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:22.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:22 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:22.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:22 smithi084 ceph-mon[119097]: osdmap e1001: 8 total, 8 up, 8 in 2024-01-13T18:17:22.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:22 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4190920658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:22.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:22 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:23 smithi099 ceph-mon[138788]: pgmap v1243: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:23 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:23 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:23 smithi099 ceph-mon[138788]: osdmap e1002: 8 total, 8 up, 8 in 2024-01-13T18:17:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:23 smithi084 ceph-mon[116404]: pgmap v1243: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:23 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:23 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:23 smithi084 ceph-mon[116404]: osdmap e1002: 8 total, 8 up, 8 in 2024-01-13T18:17:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:23 smithi084 ceph-mon[119097]: pgmap v1243: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:23 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:23 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:23 smithi084 ceph-mon[119097]: osdmap e1002: 8 total, 8 up, 8 in 2024-01-13T18:17:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:24 smithi099 ceph-mon[138788]: osdmap e1003: 8 total, 8 up, 8 in 2024-01-13T18:17:24.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:24 smithi084 ceph-mon[116404]: osdmap e1003: 8 total, 8 up, 8 in 2024-01-13T18:17:24.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:24 smithi084 ceph-mon[119097]: osdmap e1003: 8 total, 8 up, 8 in 2024-01-13T18:17:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:25 smithi099 ceph-mon[138788]: pgmap v1246: 137 pgs: 11 creating+peering, 10 unknown, 116 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:25 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:25 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:17:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:25 smithi084 ceph-mon[116404]: pgmap v1246: 137 pgs: 11 creating+peering, 10 unknown, 116 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:25 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:25 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:17:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:25 smithi084 ceph-mon[119097]: pgmap v1246: 137 pgs: 11 creating+peering, 10 unknown, 116 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:25 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:25 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:17:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:27 smithi099 ceph-mon[138788]: pgmap v1247: 137 pgs: 11 creating+peering, 126 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:27 smithi084 ceph-mon[116404]: pgmap v1247: 137 pgs: 11 creating+peering, 126 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:27 smithi084 ceph-mon[119097]: pgmap v1247: 137 pgs: 11 creating+peering, 126 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:29.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:28 smithi099 ceph-mon[138788]: pgmap v1248: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 148 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:28 smithi084 ceph-mon[116404]: pgmap v1248: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 148 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:28 smithi084 ceph-mon[119097]: pgmap v1248: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 148 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:30.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:17:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:17:30] "GET /metrics HTTP/1.1" 200 36277 "" "Prometheus/2.43.0" 2024-01-13T18:17:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:31 smithi099 ceph-mon[138788]: pgmap v1249: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 127 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:31 smithi084 ceph-mon[116404]: pgmap v1249: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 127 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:31.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:31 smithi084 ceph-mon[119097]: pgmap v1249: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 127 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:33 smithi099 ceph-mon[138788]: pgmap v1250: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 311 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:33 smithi084 ceph-mon[116404]: pgmap v1250: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 311 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:33 smithi084 ceph-mon[119097]: pgmap v1250: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 311 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:35 smithi099 ceph-mon[138788]: pgmap v1251: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 282 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:35 smithi084 ceph-mon[116404]: pgmap v1251: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 282 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:35 smithi084 ceph-mon[119097]: pgmap v1251: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 282 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:37 smithi099 ceph-mon[138788]: pgmap v1252: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:37 smithi084 ceph-mon[116404]: pgmap v1252: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:37 smithi084 ceph-mon[119097]: pgmap v1252: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:38 smithi099 ceph-mon[138788]: pgmap v1253: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:39.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:38 smithi084 ceph-mon[116404]: pgmap v1253: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:39.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:38 smithi084 ceph-mon[119097]: pgmap v1253: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:17:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:17:40] "GET /metrics HTTP/1.1" 200 36284 "" "Prometheus/2.43.0" 2024-01-13T18:17:41.255 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsLock.TestRenew (20969 ms) 2024-01-13T18:17:41.255 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-01-13T18:17:41.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:41 smithi099 ceph-mon[138788]: pgmap v1254: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:41.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:41 smithi084 ceph-mon[119097]: pgmap v1254: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:41.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:41 smithi084 ceph-mon[116404]: pgmap v1254: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:42.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:42 smithi099 ceph-mon[138788]: osdmap e1004: 8 total, 8 up, 8 in 2024-01-13T18:17:42.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:42 smithi084 ceph-mon[116404]: osdmap e1004: 8 total, 8 up, 8 in 2024-01-13T18:17:42.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:42 smithi084 ceph-mon[119097]: osdmap e1004: 8 total, 8 up, 8 in 2024-01-13T18:17:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:43 smithi099 ceph-mon[138788]: pgmap v1256: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:43 smithi099 ceph-mon[138788]: osdmap e1005: 8 total, 8 up, 8 in 2024-01-13T18:17:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/525609184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:43.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:43 smithi084 ceph-mon[116404]: pgmap v1256: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:43.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:43 smithi084 ceph-mon[116404]: osdmap e1005: 8 total, 8 up, 8 in 2024-01-13T18:17:43.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/525609184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:43.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:43.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:43 smithi084 ceph-mon[119097]: pgmap v1256: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:43.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:43 smithi084 ceph-mon[119097]: osdmap e1005: 8 total, 8 up, 8 in 2024-01-13T18:17:43.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/525609184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:43.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:44 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:44 smithi099 ceph-mon[138788]: osdmap e1006: 8 total, 8 up, 8 in 2024-01-13T18:17:44.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:44 smithi099 ceph-mon[138788]: osdmap e1007: 8 total, 8 up, 8 in 2024-01-13T18:17:44.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:44 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:44.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:44 smithi084 ceph-mon[116404]: osdmap e1006: 8 total, 8 up, 8 in 2024-01-13T18:17:44.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:44 smithi084 ceph-mon[116404]: osdmap e1007: 8 total, 8 up, 8 in 2024-01-13T18:17:44.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:44 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:44.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:44 smithi084 ceph-mon[119097]: osdmap e1006: 8 total, 8 up, 8 in 2024-01-13T18:17:44.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:44 smithi084 ceph-mon[119097]: osdmap e1007: 8 total, 8 up, 8 in 2024-01-13T18:17:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:45 smithi099 ceph-mon[138788]: pgmap v1259: 137 pgs: 11 creating+peering, 16 unknown, 110 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:45.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:45 smithi084 ceph-mon[116404]: pgmap v1259: 137 pgs: 11 creating+peering, 16 unknown, 110 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:45 smithi084 ceph-mon[119097]: pgmap v1259: 137 pgs: 11 creating+peering, 16 unknown, 110 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:47 smithi099 ceph-mon[138788]: pgmap v1261: 137 pgs: 11 creating+peering, 9 unknown, 117 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:47 smithi084 ceph-mon[116404]: pgmap v1261: 137 pgs: 11 creating+peering, 9 unknown, 117 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:47.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:47 smithi084 ceph-mon[119097]: pgmap v1261: 137 pgs: 11 creating+peering, 9 unknown, 117 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:48.303 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7048 ms) 2024-01-13T18:17:48.304 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-01-13T18:17:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:49 smithi099 ceph-mon[138788]: pgmap v1262: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 170 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:49 smithi099 ceph-mon[138788]: osdmap e1008: 8 total, 8 up, 8 in 2024-01-13T18:17:49.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:49 smithi084 ceph-mon[119097]: pgmap v1262: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 170 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:49.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:49 smithi084 ceph-mon[119097]: osdmap e1008: 8 total, 8 up, 8 in 2024-01-13T18:17:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:49 smithi084 ceph-mon[116404]: pgmap v1262: 137 pgs: 137 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 170 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T18:17:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:49 smithi084 ceph-mon[116404]: osdmap e1008: 8 total, 8 up, 8 in 2024-01-13T18:17:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:50 smithi099 ceph-mon[138788]: osdmap e1009: 8 total, 8 up, 8 in 2024-01-13T18:17:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:50 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3432396056' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:50 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:50 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:50 smithi099 ceph-mon[138788]: osdmap e1010: 8 total, 8 up, 8 in 2024-01-13T18:17:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:17:50] "GET /metrics HTTP/1.1" 200 36281 "" "Prometheus/2.43.0" 2024-01-13T18:17:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[119097]: osdmap e1009: 8 total, 8 up, 8 in 2024-01-13T18:17:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3432396056' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:50.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[119097]: osdmap e1010: 8 total, 8 up, 8 in 2024-01-13T18:17:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[116404]: osdmap e1009: 8 total, 8 up, 8 in 2024-01-13T18:17:50.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3432396056' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:17:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:50.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:50 smithi084 ceph-mon[116404]: osdmap e1010: 8 total, 8 up, 8 in 2024-01-13T18:17:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:51 smithi099 ceph-mon[138788]: pgmap v1265: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:51 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:51.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:51 smithi084 ceph-mon[116404]: pgmap v1265: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:51.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:51 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:51 smithi084 ceph-mon[119097]: pgmap v1265: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:51.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:51 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:17:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:52 smithi099 ceph-mon[138788]: osdmap e1011: 8 total, 8 up, 8 in 2024-01-13T18:17:52.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:52 smithi084 ceph-mon[116404]: osdmap e1011: 8 total, 8 up, 8 in 2024-01-13T18:17:52.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:52 smithi084 ceph-mon[119097]: osdmap e1011: 8 total, 8 up, 8 in 2024-01-13T18:17:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:53 smithi099 ceph-mon[138788]: pgmap v1268: 137 pgs: 9 creating+peering, 10 unknown, 118 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:53 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:53 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:17:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:53 smithi084 ceph-mon[116404]: pgmap v1268: 137 pgs: 9 creating+peering, 10 unknown, 118 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:53 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:53.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:53 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:17:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:53 smithi084 ceph-mon[119097]: pgmap v1268: 137 pgs: 9 creating+peering, 10 unknown, 118 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:53 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:17:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:53 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:17:55.349 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7046 ms) 2024-01-13T18:17:55.349 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-01-13T18:17:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:55 smithi099 ceph-mon[138788]: pgmap v1269: 137 pgs: 9 creating+peering, 128 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:55 smithi084 ceph-mon[116404]: pgmap v1269: 137 pgs: 9 creating+peering, 128 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:55.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:55 smithi084 ceph-mon[119097]: pgmap v1269: 137 pgs: 9 creating+peering, 128 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:17:56.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:56 smithi099 ceph-mon[138788]: osdmap e1012: 8 total, 8 up, 8 in 2024-01-13T18:17:56.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:56 smithi084 ceph-mon[116404]: osdmap e1012: 8 total, 8 up, 8 in 2024-01-13T18:17:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:56 smithi084 ceph-mon[119097]: osdmap e1012: 8 total, 8 up, 8 in 2024-01-13T18:17:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:57 smithi099 ceph-mon[138788]: pgmap v1271: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:57 smithi099 ceph-mon[138788]: osdmap e1013: 8 total, 8 up, 8 in 2024-01-13T18:17:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:57 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1502767157' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:57 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:57.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:57 smithi084 ceph-mon[116404]: pgmap v1271: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:57.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:57 smithi084 ceph-mon[116404]: osdmap e1013: 8 total, 8 up, 8 in 2024-01-13T18:17:57.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:57 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1502767157' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:57 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:57 smithi084 ceph-mon[119097]: pgmap v1271: 105 pgs: 105 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:57 smithi084 ceph-mon[119097]: osdmap e1013: 8 total, 8 up, 8 in 2024-01-13T18:17:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:57 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1502767157' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:57 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:17:58.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:58 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:58.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:58 smithi084 ceph-mon[116404]: osdmap e1014: 8 total, 8 up, 8 in 2024-01-13T18:17:58.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:58 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:58.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:58 smithi084 ceph-mon[119097]: osdmap e1014: 8 total, 8 up, 8 in 2024-01-13T18:17:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:58 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-169706-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:17:58.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:58 smithi099 ceph-mon[138788]: osdmap e1014: 8 total, 8 up, 8 in 2024-01-13T18:17:59.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:59 smithi084 ceph-mon[116404]: pgmap v1274: 137 pgs: 10 creating+peering, 12 unknown, 115 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:59.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:17:59 smithi084 ceph-mon[116404]: osdmap e1015: 8 total, 8 up, 8 in 2024-01-13T18:17:59.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:59 smithi084 ceph-mon[119097]: pgmap v1274: 137 pgs: 10 creating+peering, 12 unknown, 115 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:59.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:17:59 smithi084 ceph-mon[119097]: osdmap e1015: 8 total, 8 up, 8 in 2024-01-13T18:17:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:59 smithi099 ceph-mon[138788]: pgmap v1274: 137 pgs: 10 creating+peering, 12 unknown, 115 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:17:59.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:17:59 smithi099 ceph-mon[138788]: osdmap e1015: 8 total, 8 up, 8 in 2024-01-13T18:18:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:18:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:18:00] "GET /metrics HTTP/1.1" 200 36281 "" "Prometheus/2.43.0" 2024-01-13T18:18:01.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:01 smithi084 ceph-mon[116404]: pgmap v1276: 137 pgs: 10 creating+peering, 127 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:01 smithi084 ceph-mon[119097]: pgmap v1276: 137 pgs: 10 creating+peering, 127 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:01.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:01 smithi099 ceph-mon[138788]: pgmap v1276: 137 pgs: 10 creating+peering, 127 active+clean; 583 KiB data, 3.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:03.396 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8047 ms) 2024-01-13T18:18:03.396 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 11 tests from ClsLock (69022 ms total) 2024-01-13T18:18:03.396 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:18:03.396 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:18:03.396 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 11 tests from 1 test suite ran. (69022 ms total) 2024-01-13T18:18:03.396 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 11 tests. 2024-01-13T18:18:03.400 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:18:03.400 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:18:03.470 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-01-13T18:18:03.470 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-01-13T18:18:03.542 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:18:03.542 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 4 tests from 1 test suite. 2024-01-13T18:18:03.542 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:18:03.542 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 4 tests from cls_log 2024-01-13T18:18:03.542 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-01-13T18:18:03.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:03 smithi084 ceph-mon[116404]: pgmap v1277: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 170 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:18:03.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:03 smithi084 ceph-mon[119097]: pgmap v1277: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 170 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:18:03.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:03 smithi099 ceph-mon[138788]: pgmap v1277: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 170 B/s rd, 0 B/s wr, 0 op/s 2024-01-13T18:18:04.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:04 smithi084 ceph-mon[116404]: osdmap e1016: 8 total, 8 up, 8 in 2024-01-13T18:18:04.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:04 smithi084 ceph-mon[119097]: osdmap e1016: 8 total, 8 up, 8 in 2024-01-13T18:18:04.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:04 smithi099 ceph-mon[138788]: osdmap e1016: 8 total, 8 up, 8 in 2024-01-13T18:18:05.619 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:18:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=sqlstore.transactions t=2024-01-13T18:18:05.348611196Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-01-13T18:18:05.619 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:18:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=cleanup t=2024-01-13T18:18:05.351051121Z level=info msg="Completed cleanup jobs" duration=12.825033ms 2024-01-13T18:18:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:05 smithi099 ceph-mon[138788]: pgmap v1279: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:05 smithi099 ceph-mon[138788]: osdmap e1017: 8 total, 8 up, 8 in 2024-01-13T18:18:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:05 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3641973424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:05 smithi084 ceph-mon[116404]: pgmap v1279: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:05 smithi084 ceph-mon[116404]: osdmap e1017: 8 total, 8 up, 8 in 2024-01-13T18:18:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:05 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3641973424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:05 smithi084 ceph-mon[119097]: pgmap v1279: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:05 smithi084 ceph-mon[119097]: osdmap e1017: 8 total, 8 up, 8 in 2024-01-13T18:18:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:05 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3641973424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:06.436 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_log.test_log_add_same_time (2894 ms) 2024-01-13T18:18:06.436 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-01-13T18:18:06.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:06 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3641973424' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:06.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:06 smithi084 ceph-mon[116404]: osdmap e1018: 8 total, 8 up, 8 in 2024-01-13T18:18:06.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:06 smithi084 ceph-mon[116404]: pgmap v1282: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:06 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3641973424' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:06 smithi084 ceph-mon[119097]: osdmap e1018: 8 total, 8 up, 8 in 2024-01-13T18:18:06.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:06 smithi084 ceph-mon[119097]: pgmap v1282: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:06 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3641973424' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:06 smithi099 ceph-mon[138788]: osdmap e1018: 8 total, 8 up, 8 in 2024-01-13T18:18:06.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:06 smithi099 ceph-mon[138788]: pgmap v1282: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:07.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:07 smithi084 ceph-mon[116404]: osdmap e1019: 8 total, 8 up, 8 in 2024-01-13T18:18:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:07 smithi084 ceph-mon[119097]: osdmap e1019: 8 total, 8 up, 8 in 2024-01-13T18:18:07.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:07 smithi099 ceph-mon[138788]: osdmap e1019: 8 total, 8 up, 8 in 2024-01-13T18:18:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:08 smithi099 ceph-mon[138788]: osdmap e1020: 8 total, 8 up, 8 in 2024-01-13T18:18:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:08 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3379385731' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:08 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:08.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:08 smithi099 ceph-mon[138788]: pgmap v1285: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:08.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:08 smithi084 ceph-mon[116404]: osdmap e1020: 8 total, 8 up, 8 in 2024-01-13T18:18:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:08 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3379385731' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:08 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:08.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:08 smithi084 ceph-mon[116404]: pgmap v1285: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:08.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:08 smithi084 ceph-mon[119097]: osdmap e1020: 8 total, 8 up, 8 in 2024-01-13T18:18:08.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:08 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3379385731' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:08.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:08 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:08.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:08 smithi084 ceph-mon[119097]: pgmap v1285: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:09.442 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_log.test_log_add_different_time (3002 ms) 2024-01-13T18:18:09.442 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_log.trim_by_time 2024-01-13T18:18:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:09 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:09 smithi099 ceph-mon[138788]: osdmap e1021: 8 total, 8 up, 8 in 2024-01-13T18:18:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:09 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:09.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:09 smithi099 ceph-mon[138788]: osdmap e1022: 8 total, 8 up, 8 in 2024-01-13T18:18:09.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:09 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:09 smithi084 ceph-mon[119097]: osdmap e1021: 8 total, 8 up, 8 in 2024-01-13T18:18:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:09 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:09.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:09 smithi084 ceph-mon[119097]: osdmap e1022: 8 total, 8 up, 8 in 2024-01-13T18:18:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:09 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:09 smithi084 ceph-mon[116404]: osdmap e1021: 8 total, 8 up, 8 in 2024-01-13T18:18:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:09 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:09.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:09 smithi084 ceph-mon[116404]: osdmap e1022: 8 total, 8 up, 8 in 2024-01-13T18:18:10.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:10 smithi084 ceph-mon[116404]: pgmap v1288: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:10.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:18:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:18:10] "GET /metrics HTTP/1.1" 200 36277 "" "Prometheus/2.43.0" 2024-01-13T18:18:10.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:10 smithi084 ceph-mon[119097]: pgmap v1288: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:10.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:10 smithi099 ceph-mon[138788]: pgmap v1288: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:11 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:11 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:18:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:11 smithi099 ceph-mon[138788]: osdmap e1023: 8 total, 8 up, 8 in 2024-01-13T18:18:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:11 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3243989742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:11.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:11 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:11.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:11 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:11.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:11 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:18:11.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:11 smithi084 ceph-mon[116404]: osdmap e1023: 8 total, 8 up, 8 in 2024-01-13T18:18:11.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:11 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3243989742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:11.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:11 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:11 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:11 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:18:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:11 smithi084 ceph-mon[119097]: osdmap e1023: 8 total, 8 up, 8 in 2024-01-13T18:18:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:11 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3243989742' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:11.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:11 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:12.478 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_log.trim_by_time (3041 ms) 2024-01-13T18:18:12.479 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_log.trim_by_marker 2024-01-13T18:18:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:12 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:12 smithi099 ceph-mon[138788]: osdmap e1024: 8 total, 8 up, 8 in 2024-01-13T18:18:12.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:12 smithi099 ceph-mon[138788]: pgmap v1291: 137 pgs: 24 unknown, 113 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.0 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-01-13T18:18:12.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:12 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:12.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:12 smithi084 ceph-mon[116404]: osdmap e1024: 8 total, 8 up, 8 in 2024-01-13T18:18:12.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:12 smithi084 ceph-mon[116404]: pgmap v1291: 137 pgs: 24 unknown, 113 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.0 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-01-13T18:18:12.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:12 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:12.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:12 smithi084 ceph-mon[119097]: osdmap e1024: 8 total, 8 up, 8 in 2024-01-13T18:18:12.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:12 smithi084 ceph-mon[119097]: pgmap v1291: 137 pgs: 24 unknown, 113 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.0 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-01-13T18:18:13.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:13 smithi099 ceph-mon[138788]: osdmap e1025: 8 total, 8 up, 8 in 2024-01-13T18:18:13.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:13 smithi084 ceph-mon[116404]: osdmap e1025: 8 total, 8 up, 8 in 2024-01-13T18:18:13.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:13 smithi084 ceph-mon[119097]: osdmap e1025: 8 total, 8 up, 8 in 2024-01-13T18:18:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:14 smithi099 ceph-mon[138788]: osdmap e1026: 8 total, 8 up, 8 in 2024-01-13T18:18:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:14 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2014154708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:14 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:14.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:14 smithi099 ceph-mon[138788]: pgmap v1294: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:14.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:14 smithi084 ceph-mon[116404]: osdmap e1026: 8 total, 8 up, 8 in 2024-01-13T18:18:14.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:14 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2014154708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:14.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:14 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:14.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:14 smithi084 ceph-mon[116404]: pgmap v1294: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:14.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:14 smithi084 ceph-mon[119097]: osdmap e1026: 8 total, 8 up, 8 in 2024-01-13T18:18:14.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:14 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2014154708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:14.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:14 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:14.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:14 smithi084 ceph-mon[119097]: pgmap v1294: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:15.499 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_log.trim_by_marker (3020 ms) 2024-01-13T18:18:15.499 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 4 tests from cls_log (11957 ms total) 2024-01-13T18:18:15.499 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:18:15.499 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:18:15.499 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 4 tests from 1 test suite ran. (11957 ms total) 2024-01-13T18:18:15.499 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 4 tests. 2024-01-13T18:18:15.501 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:18:15.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:18:15.570 INFO:tasks.workunit:Running workunit cls/test_cls_numops.sh... 2024-01-13T18:18:15.570 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_numops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_numops.sh 2024-01-13T18:18:15.642 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:18:15.642 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 4 tests from 1 test suite. 2024-01-13T18:18:15.642 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:18:15.642 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 4 tests from ClsNumOps 2024-01-13T18:18:15.642 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsNumOps.Add 2024-01-13T18:18:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:15 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:15 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:15.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:15 smithi099 ceph-mon[138788]: osdmap e1027: 8 total, 8 up, 8 in 2024-01-13T18:18:15.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:15 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:15.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:15 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:15.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:15 smithi084 ceph-mon[119097]: osdmap e1027: 8 total, 8 up, 8 in 2024-01-13T18:18:15.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:15 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:15.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:15 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170125-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:15.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:15 smithi084 ceph-mon[116404]: osdmap e1027: 8 total, 8 up, 8 in 2024-01-13T18:18:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:16 smithi099 ceph-mon[138788]: osdmap e1028: 8 total, 8 up, 8 in 2024-01-13T18:18:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:16 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:18:16.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:16 smithi099 ceph-mon[138788]: pgmap v1297: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:16.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:16 smithi084 ceph-mon[116404]: osdmap e1028: 8 total, 8 up, 8 in 2024-01-13T18:18:16.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:16 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:18:16.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:16 smithi084 ceph-mon[116404]: pgmap v1297: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:16.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:16 smithi084 ceph-mon[119097]: osdmap e1028: 8 total, 8 up, 8 in 2024-01-13T18:18:16.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:16 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:18:16.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:16 smithi084 ceph-mon[119097]: pgmap v1297: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:17 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:17 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:18:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:17 smithi084 ceph-mon[116404]: osdmap e1029: 8 total, 8 up, 8 in 2024-01-13T18:18:17.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:17 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3818548858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:17 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:17 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:18:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:17 smithi084 ceph-mon[119097]: osdmap e1029: 8 total, 8 up, 8 in 2024-01-13T18:18:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:17 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3818548858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:17 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:17 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:18:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:17 smithi099 ceph-mon[138788]: osdmap e1029: 8 total, 8 up, 8 in 2024-01-13T18:18:17.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:17 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3818548858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:18.523 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsNumOps.Add (2881 ms) 2024-01-13T18:18:18.523 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsNumOps.Sub 2024-01-13T18:18:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:18 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3818548858' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:18 smithi099 ceph-mon[138788]: osdmap e1030: 8 total, 8 up, 8 in 2024-01-13T18:18:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:18 smithi099 ceph-mon[138788]: pgmap v1300: 137 pgs: 16 creating+peering, 9 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:18:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:18:18.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3818548858' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[116404]: osdmap e1030: 8 total, 8 up, 8 in 2024-01-13T18:18:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[116404]: pgmap v1300: 137 pgs: 16 creating+peering, 9 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:18:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:18:18.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3818548858' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:18.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[119097]: osdmap e1030: 8 total, 8 up, 8 in 2024-01-13T18:18:18.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:18.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[119097]: pgmap v1300: 137 pgs: 16 creating+peering, 9 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:18.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:18:18.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:18:18.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:18:19.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:19 smithi099 ceph-mon[138788]: osdmap e1031: 8 total, 8 up, 8 in 2024-01-13T18:18:19.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:19 smithi084 ceph-mon[116404]: osdmap e1031: 8 total, 8 up, 8 in 2024-01-13T18:18:19.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:19 smithi084 ceph-mon[119097]: osdmap e1031: 8 total, 8 up, 8 in 2024-01-13T18:18:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:18:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:18:20] "GET /metrics HTTP/1.1" 200 36277 "" "Prometheus/2.43.0" 2024-01-13T18:18:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:20 smithi084 ceph-mon[116404]: osdmap e1032: 8 total, 8 up, 8 in 2024-01-13T18:18:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:20 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/638701408' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:20 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:20.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:20 smithi084 ceph-mon[116404]: pgmap v1303: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:20 smithi084 ceph-mon[119097]: osdmap e1032: 8 total, 8 up, 8 in 2024-01-13T18:18:20.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:20 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/638701408' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:20.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:20 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:20.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:20.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:20 smithi084 ceph-mon[119097]: pgmap v1303: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:20 smithi099 ceph-mon[138788]: osdmap e1032: 8 total, 8 up, 8 in 2024-01-13T18:18:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:20 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/638701408' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:20 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:20.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:20 smithi099 ceph-mon[138788]: pgmap v1303: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:21.539 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsNumOps.Sub (3015 ms) 2024-01-13T18:18:21.539 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsNumOps.Mul 2024-01-13T18:18:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:21 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:21 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:21.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:21 smithi099 ceph-mon[138788]: osdmap e1033: 8 total, 8 up, 8 in 2024-01-13T18:18:21.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:21 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:22.079 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:21 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:22.079 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:21 smithi084 ceph-mon[116404]: osdmap e1033: 8 total, 8 up, 8 in 2024-01-13T18:18:22.080 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:21 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:22.080 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:21 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:22.080 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:21 smithi084 ceph-mon[119097]: osdmap e1033: 8 total, 8 up, 8 in 2024-01-13T18:18:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:22 smithi099 ceph-mon[138788]: osdmap e1034: 8 total, 8 up, 8 in 2024-01-13T18:18:22.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:22 smithi099 ceph-mon[138788]: pgmap v1306: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:22.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:22 smithi084 ceph-mon[116404]: osdmap e1034: 8 total, 8 up, 8 in 2024-01-13T18:18:22.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:22 smithi084 ceph-mon[116404]: pgmap v1306: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:22 smithi084 ceph-mon[119097]: osdmap e1034: 8 total, 8 up, 8 in 2024-01-13T18:18:22.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:22 smithi084 ceph-mon[119097]: pgmap v1306: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:23.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:23 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:23.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:23 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:18:23.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:23 smithi099 ceph-mon[138788]: osdmap e1035: 8 total, 8 up, 8 in 2024-01-13T18:18:23.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:23 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/149403353' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:23.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:23 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:23.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:23 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:23.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:23 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:18:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:23 smithi084 ceph-mon[116404]: osdmap e1035: 8 total, 8 up, 8 in 2024-01-13T18:18:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:23 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/149403353' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:23.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:23 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:23 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:23 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:18:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:23 smithi084 ceph-mon[119097]: osdmap e1035: 8 total, 8 up, 8 in 2024-01-13T18:18:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:23 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/149403353' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:23.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:23 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:24.559 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsNumOps.Mul (3021 ms) 2024-01-13T18:18:24.559 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsNumOps.Div 2024-01-13T18:18:24.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:24 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:24.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:24 smithi099 ceph-mon[138788]: osdmap e1036: 8 total, 8 up, 8 in 2024-01-13T18:18:24.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:24 smithi099 ceph-mon[138788]: pgmap v1309: 137 pgs: 10 creating+peering, 15 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:24.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:24 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:24.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:24 smithi084 ceph-mon[116404]: osdmap e1036: 8 total, 8 up, 8 in 2024-01-13T18:18:24.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:24 smithi084 ceph-mon[116404]: pgmap v1309: 137 pgs: 10 creating+peering, 15 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:24 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:24 smithi084 ceph-mon[119097]: osdmap e1036: 8 total, 8 up, 8 in 2024-01-13T18:18:24.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:24 smithi084 ceph-mon[119097]: pgmap v1309: 137 pgs: 10 creating+peering, 15 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:25 smithi099 ceph-mon[138788]: osdmap e1037: 8 total, 8 up, 8 in 2024-01-13T18:18:25.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:25 smithi084 ceph-mon[116404]: osdmap e1037: 8 total, 8 up, 8 in 2024-01-13T18:18:25.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:25 smithi084 ceph-mon[119097]: osdmap e1037: 8 total, 8 up, 8 in 2024-01-13T18:18:26.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:26 smithi099 ceph-mon[138788]: osdmap e1038: 8 total, 8 up, 8 in 2024-01-13T18:18:26.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:26 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1164236459' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:26.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:26 smithi099 ceph-mon[138788]: pgmap v1312: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:26 smithi084 ceph-mon[116404]: osdmap e1038: 8 total, 8 up, 8 in 2024-01-13T18:18:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:26 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1164236459' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:26 smithi084 ceph-mon[116404]: pgmap v1312: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:26.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:26 smithi084 ceph-mon[119097]: osdmap e1038: 8 total, 8 up, 8 in 2024-01-13T18:18:26.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:26 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1164236459' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:26.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:26 smithi084 ceph-mon[119097]: pgmap v1312: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:27.572 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsNumOps.Div (3013 ms) 2024-01-13T18:18:27.573 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 4 tests from ClsNumOps (11930 ms total) 2024-01-13T18:18:27.573 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:18:27.573 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:18:27.573 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 4 tests from 1 test suite ran. (11930 ms total) 2024-01-13T18:18:27.573 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 4 tests. 2024-01-13T18:18:27.575 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:18:27.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:18:27.648 INFO:tasks.workunit:Running workunit cls/test_cls_rbd.sh... 2024-01-13T18:18:27.648 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_rbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh 2024-01-13T18:18:27.720 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:18:27.720 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 70 tests from 1 test suite. 2024-01-13T18:18:27.720 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:18:27.720 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 70 tests from TestClsRbd 2024-01-13T18:18:27.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:27 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:27.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:27 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1164236459' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:27.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:27 smithi099 ceph-mon[138788]: osdmap e1039: 8 total, 8 up, 8 in 2024-01-13T18:18:27.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:27 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:27.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:27 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1164236459' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:27.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:27 smithi084 ceph-mon[116404]: osdmap e1039: 8 total, 8 up, 8 in 2024-01-13T18:18:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:27 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:27 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1164236459' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170243-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:27.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:27 smithi084 ceph-mon[119097]: osdmap e1039: 8 total, 8 up, 8 in 2024-01-13T18:18:28.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:28 smithi099 ceph-mon[138788]: osdmap e1040: 8 total, 8 up, 8 in 2024-01-13T18:18:28.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:28 smithi099 ceph-mon[138788]: pgmap v1315: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:28.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:28 smithi084 ceph-mon[116404]: osdmap e1040: 8 total, 8 up, 8 in 2024-01-13T18:18:28.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:28 smithi084 ceph-mon[116404]: pgmap v1315: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:28.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:28 smithi084 ceph-mon[119097]: osdmap e1040: 8 total, 8 up, 8 in 2024-01-13T18:18:28.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:28 smithi084 ceph-mon[119097]: pgmap v1315: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:29.597 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.get_all_features 2024-01-13T18:18:29.599 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.get_all_features (3 ms) 2024-01-13T18:18:29.600 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.copyup 2024-01-13T18:18:29.776 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.copyup (176 ms) 2024-01-13T18:18:29.776 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.sparse_copyup 2024-01-13T18:18:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.sparse_copyup (13 ms) 2024-01-13T18:18:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.get_and_set_id 2024-01-13T18:18:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.get_and_set_id (7 ms) 2024-01-13T18:18:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.add_remove_child 2024-01-13T18:18:29.807 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.add_remove_child (11 ms) 2024-01-13T18:18:29.807 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.directory_methods 2024-01-13T18:18:29.832 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.directory_methods (25 ms) 2024-01-13T18:18:29.832 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.create 2024-01-13T18:18:29.845 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.create (13 ms) 2024-01-13T18:18:29.845 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.get_features 2024-01-13T18:18:29.846 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.get_features (2 ms) 2024-01-13T18:18:29.846 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.get_object_prefix 2024-01-13T18:18:29.847 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.get_object_prefix (1 ms) 2024-01-13T18:18:29.848 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.get_create_timestamp 2024-01-13T18:18:29.849 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.get_create_timestamp (2 ms) 2024-01-13T18:18:29.849 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.get_access_timestamp 2024-01-13T18:18:29.851 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.get_access_timestamp (1 ms) 2024-01-13T18:18:29.851 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.get_modify_timestamp 2024-01-13T18:18:29.852 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.get_modify_timestamp (2 ms) 2024-01-13T18:18:29.852 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.get_data_pool 2024-01-13T18:18:29.856 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.get_data_pool (3 ms) 2024-01-13T18:18:29.856 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.get_size 2024-01-13T18:18:29.866 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.get_size (10 ms) 2024-01-13T18:18:29.866 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.set_size 2024-01-13T18:18:29.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:29 smithi099 ceph-mon[138788]: osdmap e1041: 8 total, 8 up, 8 in 2024-01-13T18:18:29.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:29 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/584688934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170994-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:29.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:29 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170994-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:29.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:29 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:29.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:29 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:18:29.870 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.set_size (4 ms) 2024-01-13T18:18:29.870 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.protection_status 2024-01-13T18:18:29.888 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.protection_status (18 ms) 2024-01-13T18:18:29.888 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.snapshot_limits 2024-01-13T18:18:29.894 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.snapshot_limits (7 ms) 2024-01-13T18:18:29.895 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.parents_v1 2024-01-13T18:18:29.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:29 smithi084 ceph-mon[116404]: osdmap e1041: 8 total, 8 up, 8 in 2024-01-13T18:18:29.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:29 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/584688934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170994-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:29.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:29 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170994-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:29.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:29 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:29.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:29 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:18:29.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:29 smithi084 ceph-mon[119097]: osdmap e1041: 8 total, 8 up, 8 in 2024-01-13T18:18:29.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:29 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/584688934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170994-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:29.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:29 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170994-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:29.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:29 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:29.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:29 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:18:29.932 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.parents_v1 (38 ms) 2024-01-13T18:18:29.933 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.parents_v2 2024-01-13T18:18:29.959 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.parents_v2 (26 ms) 2024-01-13T18:18:29.959 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.snapshots 2024-01-13T18:18:29.978 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.snapshots (20 ms) 2024-01-13T18:18:29.979 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.snapid_race 2024-01-13T18:18:29.985 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.snapid_race (7 ms) 2024-01-13T18:18:29.985 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.stripingv2 2024-01-13T18:18:29.994 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.stripingv2 (8 ms) 2024-01-13T18:18:29.994 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.object_map_save 2024-01-13T18:18:29.997 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.object_map_save (4 ms) 2024-01-13T18:18:29.998 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.object_map_resize 2024-01-13T18:18:30.005 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.object_map_resize (7 ms) 2024-01-13T18:18:30.005 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.object_map_update 2024-01-13T18:18:30.012 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.object_map_update (8 ms) 2024-01-13T18:18:30.012 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.object_map_load_enoent 2024-01-13T18:18:30.012 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.object_map_load_enoent (0 ms) 2024-01-13T18:18:30.013 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.object_map_snap_add 2024-01-13T18:18:30.018 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.object_map_snap_add (5 ms) 2024-01-13T18:18:30.018 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.object_map_snap_remove 2024-01-13T18:18:30.023 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.object_map_snap_remove (6 ms) 2024-01-13T18:18:30.023 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.flags 2024-01-13T18:18:30.027 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.flags (4 ms) 2024-01-13T18:18:30.028 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.metadata 2024-01-13T18:18:30.050 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.metadata (22 ms) 2024-01-13T18:18:30.050 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.set_features 2024-01-13T18:18:30.056 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.set_features (6 ms) 2024-01-13T18:18:30.056 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.mirror 2024-01-13T18:18:30.085 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.mirror (29 ms) 2024-01-13T18:18:30.085 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.mirror_image 2024-01-13T18:18:30.098 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.mirror_image (14 ms) 2024-01-13T18:18:30.099 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.mirror_image_status 2024-01-13T18:18:30.594 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:18:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:18:30] "GET /metrics HTTP/1.1" 200 36277 "" "Prometheus/2.43.0" 2024-01-13T18:18:30.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:30 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170994-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:30.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:30 smithi099 ceph-mon[138788]: osdmap e1042: 8 total, 8 up, 8 in 2024-01-13T18:18:30.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:30 smithi099 ceph-mon[138788]: pgmap v1318: 137 pgs: 3 creating+peering, 26 unknown, 108 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 1024 KiB/s wr, 2 op/s 2024-01-13T18:18:30.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:30 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170994-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:30.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:30 smithi084 ceph-mon[116404]: osdmap e1042: 8 total, 8 up, 8 in 2024-01-13T18:18:30.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:30 smithi084 ceph-mon[116404]: pgmap v1318: 137 pgs: 3 creating+peering, 26 unknown, 108 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 1024 KiB/s wr, 2 op/s 2024-01-13T18:18:30.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:30 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-170994-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:30.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:30 smithi084 ceph-mon[119097]: osdmap e1042: 8 total, 8 up, 8 in 2024-01-13T18:18:30.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:30 smithi084 ceph-mon[119097]: pgmap v1318: 137 pgs: 3 creating+peering, 26 unknown, 108 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 1024 KiB/s wr, 2 op/s 2024-01-13T18:18:31.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:31 smithi099 ceph-mon[138788]: osdmap e1043: 8 total, 8 up, 8 in 2024-01-13T18:18:31.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:31 smithi084 ceph-mon[116404]: osdmap e1043: 8 total, 8 up, 8 in 2024-01-13T18:18:31.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:31 smithi084 ceph-mon[119097]: osdmap e1043: 8 total, 8 up, 8 in 2024-01-13T18:18:32.283 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.mirror_image_status (2184 ms) 2024-01-13T18:18:32.283 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.mirror_image_map 2024-01-13T18:18:32.357 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.mirror_image_map (74 ms) 2024-01-13T18:18:32.357 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.mirror_instances 2024-01-13T18:18:32.363 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.mirror_instances (7 ms) 2024-01-13T18:18:32.363 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.mirror_snapshot 2024-01-13T18:18:32.374 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.mirror_snapshot (10 ms) 2024-01-13T18:18:32.374 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_dir_list 2024-01-13T18:18:32.376 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_dir_list (3 ms) 2024-01-13T18:18:32.376 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_dir_add 2024-01-13T18:18:32.379 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_dir_add (2 ms) 2024-01-13T18:18:32.379 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.dir_add_already_existing 2024-01-13T18:18:32.383 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.dir_add_already_existing (3 ms) 2024-01-13T18:18:32.383 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_dir_rename 2024-01-13T18:18:32.387 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_dir_rename (5 ms) 2024-01-13T18:18:32.387 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_dir_remove 2024-01-13T18:18:32.390 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_dir_remove (3 ms) 2024-01-13T18:18:32.390 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_dir_remove_missing 2024-01-13T18:18:32.394 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_dir_remove_missing (4 ms) 2024-01-13T18:18:32.394 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_image_add 2024-01-13T18:18:32.396 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_image_add (2 ms) 2024-01-13T18:18:32.396 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_image_remove 2024-01-13T18:18:32.398 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_image_remove (3 ms) 2024-01-13T18:18:32.398 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_image_list 2024-01-13T18:18:32.408 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_image_list (9 ms) 2024-01-13T18:18:32.408 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_image_clean 2024-01-13T18:18:32.412 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_image_clean (4 ms) 2024-01-13T18:18:32.412 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.image_group_add 2024-01-13T18:18:32.414 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.image_group_add (2 ms) 2024-01-13T18:18:32.414 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.image_group_remove 2024-01-13T18:18:32.416 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.image_group_remove (3 ms) 2024-01-13T18:18:32.417 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.image_group_get 2024-01-13T18:18:32.419 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.image_group_get (2 ms) 2024-01-13T18:18:32.419 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_snap_set_empty_name 2024-01-13T18:18:32.420 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_snap_set_empty_name (2 ms) 2024-01-13T18:18:32.420 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_snap_set_empty_id 2024-01-13T18:18:32.422 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_snap_set_empty_id (1 ms) 2024-01-13T18:18:32.422 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_snap_set_duplicate_id 2024-01-13T18:18:32.425 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_snap_set_duplicate_id (3 ms) 2024-01-13T18:18:32.425 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_snap_set_duplicate_name 2024-01-13T18:18:32.428 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_snap_set_duplicate_name (3 ms) 2024-01-13T18:18:32.428 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_snap_set 2024-01-13T18:18:32.430 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_snap_set (2 ms) 2024-01-13T18:18:32.430 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_snap_list 2024-01-13T18:18:32.432 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_snap_list (3 ms) 2024-01-13T18:18:32.433 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_snap_list_max_return 2024-01-13T18:18:32.448 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_snap_list_max_return (15 ms) 2024-01-13T18:18:32.448 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_snap_list_max_read 2024-01-13T18:18:32.630 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_snap_list_max_read (182 ms) 2024-01-13T18:18:32.630 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_snap_remove 2024-01-13T18:18:32.633 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_snap_remove (3 ms) 2024-01-13T18:18:32.633 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.group_snap_get_by_id 2024-01-13T18:18:32.635 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.group_snap_get_by_id (2 ms) 2024-01-13T18:18:32.635 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.trash_methods 2024-01-13T18:18:32.642 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.trash_methods (7 ms) 2024-01-13T18:18:32.642 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.op_features 2024-01-13T18:18:32.649 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.op_features (7 ms) 2024-01-13T18:18:32.649 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.clone_parent 2024-01-13T18:18:32.667 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.clone_parent (19 ms) 2024-01-13T18:18:32.668 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.clone_parent_ns 2024-01-13T18:18:32.675 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.clone_parent_ns (8 ms) 2024-01-13T18:18:32.675 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.clone_child 2024-01-13T18:18:32.686 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.clone_child (11 ms) 2024-01-13T18:18:32.687 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.namespace_methods 2024-01-13T18:18:32.692 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.namespace_methods (6 ms) 2024-01-13T18:18:32.692 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.migration 2024-01-13T18:18:32.702 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.migration (9 ms) 2024-01-13T18:18:32.702 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.migration_v1 2024-01-13T18:18:32.715 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.migration_v1 (13 ms) 2024-01-13T18:18:32.715 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.assert_snapc_seq 2024-01-13T18:18:32.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:32 smithi099 ceph-mon[138788]: pgmap v1320: 137 pgs: 3 creating+peering, 10 unknown, 124 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 1.46k op/s 2024-01-13T18:18:32.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:32 smithi084 ceph-mon[116404]: pgmap v1320: 137 pgs: 3 creating+peering, 10 unknown, 124 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 1.46k op/s 2024-01-13T18:18:32.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:32 smithi084 ceph-mon[119097]: pgmap v1320: 137 pgs: 3 creating+peering, 10 unknown, 124 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 1.46k op/s 2024-01-13T18:18:34.614 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.assert_snapc_seq (1899 ms) 2024-01-13T18:18:34.615 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestClsRbd.sparsify 2024-01-13T18:18:34.654 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestClsRbd.sparsify (39 ms) 2024-01-13T18:18:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:34 smithi099 ceph-mon[138788]: osdmap e1044: 8 total, 8 up, 8 in 2024-01-13T18:18:34.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:34 smithi099 ceph-mon[138788]: pgmap v1322: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.2 MiB/s wr, 1.24k op/s 2024-01-13T18:18:34.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:34 smithi084 ceph-mon[116404]: osdmap e1044: 8 total, 8 up, 8 in 2024-01-13T18:18:34.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:34 smithi084 ceph-mon[116404]: pgmap v1322: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.2 MiB/s wr, 1.24k op/s 2024-01-13T18:18:34.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:34 smithi084 ceph-mon[119097]: osdmap e1044: 8 total, 8 up, 8 in 2024-01-13T18:18:34.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:34 smithi084 ceph-mon[119097]: pgmap v1322: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.2 MiB/s wr, 1.24k op/s 2024-01-13T18:18:35.621 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 70 tests from TestClsRbd (5057 ms total) 2024-01-13T18:18:35.621 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:18:35.621 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:18:35.622 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 70 tests from 1 test suite ran. (7901 ms total) 2024-01-13T18:18:35.622 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 70 tests. 2024-01-13T18:18:35.623 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:18:35.623 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:18:35.694 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-01-13T18:18:35.694 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-01-13T18:18:35.766 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:18:35.766 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 10 tests from 1 test suite. 2024-01-13T18:18:35.766 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:18:35.766 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 10 tests from cls_rgw 2024-01-13T18:18:35.766 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.test_implicit 2024-01-13T18:18:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:35 smithi099 ceph-mon[138788]: osdmap e1045: 8 total, 8 up, 8 in 2024-01-13T18:18:35.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:35.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:35 smithi084 ceph-mon[116404]: osdmap e1045: 8 total, 8 up, 8 in 2024-01-13T18:18:35.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:35 smithi084 ceph-mon[119097]: osdmap e1045: 8 total, 8 up, 8 in 2024-01-13T18:18:35.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:36.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:36 smithi099 ceph-mon[138788]: osdmap e1046: 8 total, 8 up, 8 in 2024-01-13T18:18:36.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:36 smithi099 ceph-mon[138788]: pgmap v1325: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:36.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:36 smithi084 ceph-mon[116404]: osdmap e1046: 8 total, 8 up, 8 in 2024-01-13T18:18:36.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:36 smithi084 ceph-mon[116404]: pgmap v1325: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:36.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:36 smithi084 ceph-mon[119097]: osdmap e1046: 8 total, 8 up, 8 in 2024-01-13T18:18:36.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:36 smithi084 ceph-mon[119097]: pgmap v1325: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:37.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:37 smithi084 ceph-mon[116404]: osdmap e1047: 8 total, 8 up, 8 in 2024-01-13T18:18:37.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:37 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/620387164' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:37.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:37 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:37.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:37 smithi084 ceph-mon[119097]: osdmap e1047: 8 total, 8 up, 8 in 2024-01-13T18:18:37.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:37 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/620387164' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:37.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:37 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:37 smithi099 ceph-mon[138788]: osdmap e1047: 8 total, 8 up, 8 in 2024-01-13T18:18:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:37 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/620387164' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:38.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:37 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:38.654 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.test_implicit (2888 ms) 2024-01-13T18:18:38.654 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2024-01-13T18:18:38.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:38 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:38.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:38 smithi084 ceph-mon[116404]: osdmap e1048: 8 total, 8 up, 8 in 2024-01-13T18:18:38.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:38 smithi084 ceph-mon[116404]: pgmap v1328: 137 pgs: 14 creating+peering, 11 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:38.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:38 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:38.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:38 smithi084 ceph-mon[119097]: osdmap e1048: 8 total, 8 up, 8 in 2024-01-13T18:18:38.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:38 smithi084 ceph-mon[119097]: pgmap v1328: 137 pgs: 14 creating+peering, 11 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:38 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:38 smithi099 ceph-mon[138788]: osdmap e1048: 8 total, 8 up, 8 in 2024-01-13T18:18:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:38 smithi099 ceph-mon[138788]: pgmap v1328: 137 pgs: 14 creating+peering, 11 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:39.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:39 smithi084 ceph-mon[116404]: osdmap e1049: 8 total, 8 up, 8 in 2024-01-13T18:18:39.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:39 smithi084 ceph-mon[119097]: osdmap e1049: 8 total, 8 up, 8 in 2024-01-13T18:18:40.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:39 smithi099 ceph-mon[138788]: osdmap e1049: 8 total, 8 up, 8 in 2024-01-13T18:18:40.672 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:40 smithi084 ceph-mon[116404]: osdmap e1050: 8 total, 8 up, 8 in 2024-01-13T18:18:40.672 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:40 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2906498326' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:40.672 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:40 smithi084 ceph-mon[116404]: pgmap v1331: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:40.672 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:18:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:18:40] "GET /metrics HTTP/1.1" 200 36323 "" "Prometheus/2.43.0" 2024-01-13T18:18:40.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:40 smithi084 ceph-mon[119097]: osdmap e1050: 8 total, 8 up, 8 in 2024-01-13T18:18:40.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:40 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2906498326' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:40.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:40 smithi084 ceph-mon[119097]: pgmap v1331: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:40 smithi099 ceph-mon[138788]: osdmap e1050: 8 total, 8 up, 8 in 2024-01-13T18:18:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:40 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2906498326' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:40 smithi099 ceph-mon[138788]: pgmap v1331: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:41.685 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3031 ms) 2024-01-13T18:18:41.685 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.test_put_snap 2024-01-13T18:18:41.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:41 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:41.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:41 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2906498326' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:41.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:41 smithi084 ceph-mon[116404]: osdmap e1051: 8 total, 8 up, 8 in 2024-01-13T18:18:41.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:41 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:41.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:41 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2906498326' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:41.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:41 smithi084 ceph-mon[119097]: osdmap e1051: 8 total, 8 up, 8 in 2024-01-13T18:18:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:41 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:41 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2906498326' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:42.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:41 smithi099 ceph-mon[138788]: osdmap e1051: 8 total, 8 up, 8 in 2024-01-13T18:18:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:42 smithi099 ceph-mon[138788]: osdmap e1052: 8 total, 8 up, 8 in 2024-01-13T18:18:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:42 smithi099 ceph-mon[138788]: pgmap v1334: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:43.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:42 smithi084 ceph-mon[116404]: osdmap e1052: 8 total, 8 up, 8 in 2024-01-13T18:18:43.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:42 smithi084 ceph-mon[116404]: pgmap v1334: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:42 smithi084 ceph-mon[119097]: osdmap e1052: 8 total, 8 up, 8 in 2024-01-13T18:18:43.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:42 smithi084 ceph-mon[119097]: pgmap v1334: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:43 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:43 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:18:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:43 smithi099 ceph-mon[138788]: osdmap e1053: 8 total, 8 up, 8 in 2024-01-13T18:18:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/453466013' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:44.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:44.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:43 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:44.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:43 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:18:44.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:43 smithi084 ceph-mon[116404]: osdmap e1053: 8 total, 8 up, 8 in 2024-01-13T18:18:44.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/453466013' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:44.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:44.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:43 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:44.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:43 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:18:44.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:43 smithi084 ceph-mon[119097]: osdmap e1053: 8 total, 8 up, 8 in 2024-01-13T18:18:44.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/453466013' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:44.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:44 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:44 smithi099 ceph-mon[138788]: osdmap e1054: 8 total, 8 up, 8 in 2024-01-13T18:18:45.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:44 smithi099 ceph-mon[138788]: pgmap v1337: 137 pgs: 3 creating+activating, 8 creating+peering, 16 unknown, 110 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:44 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:45.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:44 smithi084 ceph-mon[116404]: osdmap e1054: 8 total, 8 up, 8 in 2024-01-13T18:18:45.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:44 smithi084 ceph-mon[116404]: pgmap v1337: 137 pgs: 3 creating+activating, 8 creating+peering, 16 unknown, 110 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:44 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:44 smithi084 ceph-mon[119097]: osdmap e1054: 8 total, 8 up, 8 in 2024-01-13T18:18:45.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:44 smithi084 ceph-mon[119097]: pgmap v1337: 137 pgs: 3 creating+activating, 8 creating+peering, 16 unknown, 110 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:46.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:45 smithi099 ceph-mon[138788]: osdmap e1055: 8 total, 8 up, 8 in 2024-01-13T18:18:46.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:45 smithi084 ceph-mon[116404]: osdmap e1055: 8 total, 8 up, 8 in 2024-01-13T18:18:46.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:45 smithi084 ceph-mon[119097]: osdmap e1055: 8 total, 8 up, 8 in 2024-01-13T18:18:47.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:46 smithi099 ceph-mon[138788]: pgmap v1339: 137 pgs: 3 creating+activating, 8 creating+peering, 11 unknown, 115 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:47.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:46 smithi084 ceph-mon[116404]: pgmap v1339: 137 pgs: 3 creating+activating, 8 creating+peering, 11 unknown, 115 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:47.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:46 smithi084 ceph-mon[119097]: pgmap v1339: 137 pgs: 3 creating+activating, 8 creating+peering, 11 unknown, 115 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:48 smithi099 ceph-mon[138788]: osdmap e1056: 8 total, 8 up, 8 in 2024-01-13T18:18:49.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:48 smithi099 ceph-mon[138788]: pgmap v1341: 137 pgs: 3 creating+activating, 134 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 185 B/s wr, 0 op/s 2024-01-13T18:18:49.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:48 smithi084 ceph-mon[116404]: osdmap e1056: 8 total, 8 up, 8 in 2024-01-13T18:18:49.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:48 smithi084 ceph-mon[116404]: pgmap v1341: 137 pgs: 3 creating+activating, 134 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 185 B/s wr, 0 op/s 2024-01-13T18:18:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:48 smithi084 ceph-mon[119097]: osdmap e1056: 8 total, 8 up, 8 in 2024-01-13T18:18:49.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:48 smithi084 ceph-mon[119097]: pgmap v1341: 137 pgs: 3 creating+activating, 134 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 185 B/s wr, 0 op/s 2024-01-13T18:18:50.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:49 smithi099 ceph-mon[138788]: osdmap e1057: 8 total, 8 up, 8 in 2024-01-13T18:18:50.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:49 smithi084 ceph-mon[116404]: osdmap e1057: 8 total, 8 up, 8 in 2024-01-13T18:18:50.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:49 smithi084 ceph-mon[119097]: osdmap e1057: 8 total, 8 up, 8 in 2024-01-13T18:18:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:18:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:18:50] "GET /metrics HTTP/1.1" 200 36307 "" "Prometheus/2.43.0" 2024-01-13T18:18:50.733 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.test_put_snap (9048 ms) 2024-01-13T18:18:50.733 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.test_explicit 2024-01-13T18:18:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:50 smithi099 ceph-mon[138788]: osdmap e1058: 8 total, 8 up, 8 in 2024-01-13T18:18:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.1", "id": [1, 3]}]: dispatch 2024-01-13T18:18:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.8", "id": [1, 7]}]: dispatch 2024-01-13T18:18:51.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:51.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:50 smithi099 ceph-mon[138788]: pgmap v1344: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 185 B/s wr, 0 op/s 2024-01-13T18:18:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:50 smithi084 ceph-mon[116404]: osdmap e1058: 8 total, 8 up, 8 in 2024-01-13T18:18:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.1", "id": [1, 3]}]: dispatch 2024-01-13T18:18:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.8", "id": [1, 7]}]: dispatch 2024-01-13T18:18:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:51.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:50 smithi084 ceph-mon[116404]: pgmap v1344: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 185 B/s wr, 0 op/s 2024-01-13T18:18:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:50 smithi084 ceph-mon[119097]: osdmap e1058: 8 total, 8 up, 8 in 2024-01-13T18:18:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.1", "id": [1, 3]}]: dispatch 2024-01-13T18:18:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.8", "id": [1, 7]}]: dispatch 2024-01-13T18:18:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:18:51.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:50 smithi084 ceph-mon[119097]: pgmap v1344: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 185 B/s wr, 0 op/s 2024-01-13T18:18:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.1", "id": [1, 3]}]': finished 2024-01-13T18:18:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.8", "id": [1, 7]}]': finished 2024-01-13T18:18:52.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:51 smithi099 ceph-mon[138788]: osdmap e1059: 8 total, 8 up, 8 in 2024-01-13T18:18:52.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.1", "id": [1, 3]}]': finished 2024-01-13T18:18:52.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.8", "id": [1, 7]}]': finished 2024-01-13T18:18:52.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:51 smithi084 ceph-mon[116404]: osdmap e1059: 8 total, 8 up, 8 in 2024-01-13T18:18:52.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.1", "id": [1, 3]}]': finished 2024-01-13T18:18:52.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "63.8", "id": [1, 7]}]': finished 2024-01-13T18:18:52.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:51 smithi084 ceph-mon[119097]: osdmap e1059: 8 total, 8 up, 8 in 2024-01-13T18:18:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:52 smithi099 ceph-mon[138788]: osdmap e1060: 8 total, 8 up, 8 in 2024-01-13T18:18:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:52 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/622227335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:52 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:52 smithi099 ceph-mon[138788]: pgmap v1347: 137 pgs: 14 creating+peering, 18 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:52 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:53.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:52 smithi099 ceph-mon[138788]: osdmap e1061: 8 total, 8 up, 8 in 2024-01-13T18:18:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[116404]: osdmap e1060: 8 total, 8 up, 8 in 2024-01-13T18:18:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/622227335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[116404]: pgmap v1347: 137 pgs: 14 creating+peering, 18 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:53.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[116404]: osdmap e1061: 8 total, 8 up, 8 in 2024-01-13T18:18:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[119097]: osdmap e1060: 8 total, 8 up, 8 in 2024-01-13T18:18:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/622227335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:53.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:53.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[119097]: pgmap v1347: 137 pgs: 14 creating+peering, 18 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:53.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:53.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:52 smithi084 ceph-mon[119097]: osdmap e1061: 8 total, 8 up, 8 in 2024-01-13T18:18:53.766 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.test_explicit (3023 ms) 2024-01-13T18:18:53.766 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.set 2024-01-13T18:18:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:53 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:54.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:53 smithi099 ceph-mon[138788]: osdmap e1062: 8 total, 8 up, 8 in 2024-01-13T18:18:54.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:53 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:54.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:53 smithi084 ceph-mon[116404]: osdmap e1062: 8 total, 8 up, 8 in 2024-01-13T18:18:54.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:53 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:18:54.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:53 smithi084 ceph-mon[119097]: osdmap e1062: 8 total, 8 up, 8 in 2024-01-13T18:18:55.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:54 smithi099 ceph-mon[138788]: pgmap v1350: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:55.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:54 smithi084 ceph-mon[116404]: pgmap v1350: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:55.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:54 smithi084 ceph-mon[119097]: pgmap v1350: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:55 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:55 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:18:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:55 smithi099 ceph-mon[138788]: osdmap e1063: 8 total, 8 up, 8 in 2024-01-13T18:18:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:55 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1747743484' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:56.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:55 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:56.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:55 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:56.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:55 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:18:56.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:55 smithi084 ceph-mon[116404]: osdmap e1063: 8 total, 8 up, 8 in 2024-01-13T18:18:56.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:55 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1747743484' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:56.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:55 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:56.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:55 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:18:56.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:55 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:18:56.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:55 smithi084 ceph-mon[119097]: osdmap e1063: 8 total, 8 up, 8 in 2024-01-13T18:18:56.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:55 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1747743484' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:56.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:55 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:18:56.793 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.set (3038 ms) 2024-01-13T18:18:56.793 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.test_implicit_ec 2024-01-13T18:18:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:56 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:56 smithi099 ceph-mon[138788]: osdmap e1064: 8 total, 8 up, 8 in 2024-01-13T18:18:57.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:56 smithi099 ceph-mon[138788]: pgmap v1353: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:57.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:56 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:57.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:56 smithi084 ceph-mon[116404]: osdmap e1064: 8 total, 8 up, 8 in 2024-01-13T18:18:57.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:56 smithi084 ceph-mon[116404]: pgmap v1353: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:56 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:18:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:56 smithi084 ceph-mon[119097]: osdmap e1064: 8 total, 8 up, 8 in 2024-01-13T18:18:57.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:56 smithi084 ceph-mon[119097]: pgmap v1353: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:57 smithi099 ceph-mon[138788]: osdmap e1065: 8 total, 8 up, 8 in 2024-01-13T18:18:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:57 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:18:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:57 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:18:58.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:57 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:18:58.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:57 smithi084 ceph-mon[116404]: osdmap e1065: 8 total, 8 up, 8 in 2024-01-13T18:18:58.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:57 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:18:58.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:57 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:18:58.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:57 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:18:58.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:57 smithi084 ceph-mon[119097]: osdmap e1065: 8 total, 8 up, 8 in 2024-01-13T18:18:58.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:57 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:18:58.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:57 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:18:58.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:57 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:18:59.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:59 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:18:59.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:59 smithi099 ceph-mon[138788]: osdmap e1066: 8 total, 8 up, 8 in 2024-01-13T18:18:59.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:59 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:18:59.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:18:59 smithi099 ceph-mon[138788]: pgmap v1356: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:59.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:59 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:18:59.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:59 smithi084 ceph-mon[116404]: osdmap e1066: 8 total, 8 up, 8 in 2024-01-13T18:18:59.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:59 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:18:59.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:18:59 smithi084 ceph-mon[116404]: pgmap v1356: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:18:59.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:59 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:18:59.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:59 smithi084 ceph-mon[119097]: osdmap e1066: 8 total, 8 up, 8 in 2024-01-13T18:18:59.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:59 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:18:59.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:18:59 smithi084 ceph-mon[119097]: pgmap v1356: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:00.298 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:00 smithi084 ceph-mon[119097]: osdmap e1067: 8 total, 8 up, 8 in 2024-01-13T18:19:00.299 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:00 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-6"}]': finished 2024-01-13T18:19:00.299 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:00 smithi084 ceph-mon[119097]: osdmap e1068: 8 total, 8 up, 8 in 2024-01-13T18:19:00.299 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:00 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:00.299 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:00 smithi084 ceph-mon[116404]: osdmap e1067: 8 total, 8 up, 8 in 2024-01-13T18:19:00.299 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:00 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-6"}]': finished 2024-01-13T18:19:00.299 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:00 smithi084 ceph-mon[116404]: osdmap e1068: 8 total, 8 up, 8 in 2024-01-13T18:19:00.299 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:00 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:00 smithi099 ceph-mon[138788]: osdmap e1067: 8 total, 8 up, 8 in 2024-01-13T18:19:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:00 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-6"}]': finished 2024-01-13T18:19:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:00 smithi099 ceph-mon[138788]: osdmap e1068: 8 total, 8 up, 8 in 2024-01-13T18:19:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:00 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:19:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:19:00] "GET /metrics HTTP/1.1" 200 36307 "" "Prometheus/2.43.0" 2024-01-13T18:19:01.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:01 smithi099 ceph-mon[138788]: pgmap v1359: 113 pgs: 1 creating+peering, 7 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:01.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:01 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:01.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:01 smithi099 ceph-mon[138788]: osdmap e1069: 8 total, 8 up, 8 in 2024-01-13T18:19:01.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:01 smithi084 ceph-mon[119097]: pgmap v1359: 113 pgs: 1 creating+peering, 7 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:01.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:01 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:01.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:01 smithi084 ceph-mon[119097]: osdmap e1069: 8 total, 8 up, 8 in 2024-01-13T18:19:01.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:01 smithi084 ceph-mon[116404]: pgmap v1359: 113 pgs: 1 creating+peering, 7 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:01.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:01 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:01.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:01 smithi084 ceph-mon[116404]: osdmap e1069: 8 total, 8 up, 8 in 2024-01-13T18:19:02.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:02 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:19:02.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:02 smithi099 ceph-mon[138788]: osdmap e1070: 8 total, 8 up, 8 in 2024-01-13T18:19:02.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:02 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:19:02.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:02 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:19:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:02 smithi084 ceph-mon[116404]: osdmap e1070: 8 total, 8 up, 8 in 2024-01-13T18:19:02.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:02 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:19:02.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:02 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:19:02.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:02 smithi084 ceph-mon[119097]: osdmap e1070: 8 total, 8 up, 8 in 2024-01-13T18:19:02.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:02 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:19:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:03 smithi099 ceph-mon[138788]: pgmap v1362: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:03 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-6"}]': finished 2024-01-13T18:19:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:03 smithi099 ceph-mon[138788]: osdmap e1071: 8 total, 8 up, 8 in 2024-01-13T18:19:03.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:03 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:19:03.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:03 smithi084 ceph-mon[116404]: pgmap v1362: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:03 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-6"}]': finished 2024-01-13T18:19:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:03 smithi084 ceph-mon[116404]: osdmap e1071: 8 total, 8 up, 8 in 2024-01-13T18:19:03.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:03 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:19:03.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:03 smithi084 ceph-mon[119097]: pgmap v1362: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:03.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:03 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-6"}]': finished 2024-01-13T18:19:03.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:03 smithi084 ceph-mon[119097]: osdmap e1071: 8 total, 8 up, 8 in 2024-01-13T18:19:03.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:03 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-6"}]: dispatch 2024-01-13T18:19:03.801 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.test_implicit_ec (7007 ms) 2024-01-13T18:19:03.801 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.test_implicit_idempotent_ec 2024-01-13T18:19:04.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:04 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:19:04.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:04 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:19:04.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:04 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-6"}]': finished 2024-01-13T18:19:04.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:04 smithi099 ceph-mon[138788]: osdmap e1072: 8 total, 8 up, 8 in 2024-01-13T18:19:04.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:04 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:04.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:04 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:04.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:04 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:04.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:19:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:19:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-6"}]': finished 2024-01-13T18:19:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[116404]: osdmap e1072: 8 total, 8 up, 8 in 2024-01-13T18:19:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:04.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:04.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:19:04.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:19:04.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1832032648' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-6"}]': finished 2024-01-13T18:19:04.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[119097]: osdmap e1072: 8 total, 8 up, 8 in 2024-01-13T18:19:04.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:04.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:04.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:04 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:05 smithi099 ceph-mon[138788]: pgmap v1365: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:05 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:05 smithi099 ceph-mon[138788]: osdmap e1073: 8 total, 8 up, 8 in 2024-01-13T18:19:05.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:05 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:05.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:05 smithi084 ceph-mon[116404]: pgmap v1365: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:05.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:05 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:05.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:05 smithi084 ceph-mon[116404]: osdmap e1073: 8 total, 8 up, 8 in 2024-01-13T18:19:05.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:05 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:05 smithi084 ceph-mon[119097]: pgmap v1365: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:05 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:05 smithi084 ceph-mon[119097]: osdmap e1073: 8 total, 8 up, 8 in 2024-01-13T18:19:05.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:05 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:06.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:06 smithi099 ceph-mon[138788]: osdmap e1074: 8 total, 8 up, 8 in 2024-01-13T18:19:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:06.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:06 smithi084 ceph-mon[116404]: osdmap e1074: 8 total, 8 up, 8 in 2024-01-13T18:19:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:06.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:06 smithi084 ceph-mon[119097]: osdmap e1074: 8 total, 8 up, 8 in 2024-01-13T18:19:07.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:07 smithi099 ceph-mon[138788]: pgmap v1368: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:07.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:07 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-7"}]': finished 2024-01-13T18:19:07.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:07 smithi099 ceph-mon[138788]: osdmap e1075: 8 total, 8 up, 8 in 2024-01-13T18:19:07.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:07 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:07.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:07 smithi084 ceph-mon[116404]: pgmap v1368: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:07.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:07 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-7"}]': finished 2024-01-13T18:19:07.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:07 smithi084 ceph-mon[116404]: osdmap e1075: 8 total, 8 up, 8 in 2024-01-13T18:19:07.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:07 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:07 smithi084 ceph-mon[119097]: pgmap v1368: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:07 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-7"}]': finished 2024-01-13T18:19:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:07 smithi084 ceph-mon[119097]: osdmap e1075: 8 total, 8 up, 8 in 2024-01-13T18:19:07.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:07 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:08 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:08 smithi099 ceph-mon[138788]: osdmap e1076: 8 total, 8 up, 8 in 2024-01-13T18:19:09.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:08 smithi099 ceph-mon[138788]: pgmap v1371: 113 pgs: 1 creating+activating, 3 creating+peering, 3 unknown, 106 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:08 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:09.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:08 smithi084 ceph-mon[116404]: osdmap e1076: 8 total, 8 up, 8 in 2024-01-13T18:19:09.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:08 smithi084 ceph-mon[116404]: pgmap v1371: 113 pgs: 1 creating+activating, 3 creating+peering, 3 unknown, 106 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:08 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:08 smithi084 ceph-mon[119097]: osdmap e1076: 8 total, 8 up, 8 in 2024-01-13T18:19:09.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:08 smithi084 ceph-mon[119097]: pgmap v1371: 113 pgs: 1 creating+activating, 3 creating+peering, 3 unknown, 106 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:09 smithi099 ceph-mon[138788]: osdmap e1077: 8 total, 8 up, 8 in 2024-01-13T18:19:10.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:09 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:09 smithi084 ceph-mon[116404]: osdmap e1077: 8 total, 8 up, 8 in 2024-01-13T18:19:10.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:09 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:09 smithi084 ceph-mon[119097]: osdmap e1077: 8 total, 8 up, 8 in 2024-01-13T18:19:10.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:09 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:19:10] "GET /metrics HTTP/1.1" 200 33911 "" "Prometheus/2.43.0" 2024-01-13T18:19:10.828 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.test_implicit_idempotent_ec (7027 ms) 2024-01-13T18:19:10.828 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.test_put_snap_ec 2024-01-13T18:19:11.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:10 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-7"}]': finished 2024-01-13T18:19:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:10 smithi099 ceph-mon[138788]: osdmap e1078: 8 total, 8 up, 8 in 2024-01-13T18:19:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:10 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:10 smithi099 ceph-mon[138788]: pgmap v1374: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:10 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-7"}]': finished 2024-01-13T18:19:11.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:10 smithi099 ceph-mon[138788]: osdmap e1079: 8 total, 8 up, 8 in 2024-01-13T18:19:11.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-7"}]': finished 2024-01-13T18:19:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[116404]: osdmap e1078: 8 total, 8 up, 8 in 2024-01-13T18:19:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[116404]: pgmap v1374: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-7"}]': finished 2024-01-13T18:19:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[116404]: osdmap e1079: 8 total, 8 up, 8 in 2024-01-13T18:19:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-7"}]': finished 2024-01-13T18:19:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[119097]: osdmap e1078: 8 total, 8 up, 8 in 2024-01-13T18:19:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-7"}]: dispatch 2024-01-13T18:19:11.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[119097]: pgmap v1374: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:11.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3640126271' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-7"}]': finished 2024-01-13T18:19:11.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:10 smithi084 ceph-mon[119097]: osdmap e1079: 8 total, 8 up, 8 in 2024-01-13T18:19:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:11 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:11 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:12.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:11 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-8", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:12.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:11 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:11 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:12.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:11 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-8", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:11 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:11 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:12.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:11 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-8", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:13.372 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:13 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-8", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:13.372 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:13 smithi099 ceph-mon[138788]: osdmap e1080: 8 total, 8 up, 8 in 2024-01-13T18:19:13.372 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:13 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-8", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:13.373 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:13 smithi099 ceph-mon[138788]: pgmap v1377: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:13.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:13 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-8", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:13.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:13 smithi084 ceph-mon[116404]: osdmap e1080: 8 total, 8 up, 8 in 2024-01-13T18:19:13.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:13 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-8", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:13.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:13 smithi084 ceph-mon[116404]: pgmap v1377: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:13.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:13 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-8", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:13.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:13 smithi084 ceph-mon[119097]: osdmap e1080: 8 total, 8 up, 8 in 2024-01-13T18:19:13.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:13 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-8", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:13.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:13 smithi084 ceph-mon[119097]: pgmap v1377: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:14.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:14 smithi099 ceph-mon[138788]: osdmap e1081: 8 total, 8 up, 8 in 2024-01-13T18:19:14.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:14 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-8", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-8"}]': finished 2024-01-13T18:19:14.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:14 smithi099 ceph-mon[138788]: osdmap e1082: 8 total, 8 up, 8 in 2024-01-13T18:19:14.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:14 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:14.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:14 smithi084 ceph-mon[116404]: osdmap e1081: 8 total, 8 up, 8 in 2024-01-13T18:19:14.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:14 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-8", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-8"}]': finished 2024-01-13T18:19:14.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:14 smithi084 ceph-mon[116404]: osdmap e1082: 8 total, 8 up, 8 in 2024-01-13T18:19:14.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:14 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:14.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:14 smithi084 ceph-mon[119097]: osdmap e1081: 8 total, 8 up, 8 in 2024-01-13T18:19:14.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:14 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-8", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-8"}]': finished 2024-01-13T18:19:14.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:14 smithi084 ceph-mon[119097]: osdmap e1082: 8 total, 8 up, 8 in 2024-01-13T18:19:14.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:14 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:15 smithi099 ceph-mon[138788]: pgmap v1380: 113 pgs: 8 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:15 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:15.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:15 smithi099 ceph-mon[138788]: osdmap e1083: 8 total, 8 up, 8 in 2024-01-13T18:19:15.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:15 smithi084 ceph-mon[116404]: pgmap v1380: 113 pgs: 8 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:15 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:15.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:15 smithi084 ceph-mon[116404]: osdmap e1083: 8 total, 8 up, 8 in 2024-01-13T18:19:15.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:15 smithi084 ceph-mon[119097]: pgmap v1380: 113 pgs: 8 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:15.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:15 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:15.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:15 smithi084 ceph-mon[119097]: osdmap e1083: 8 total, 8 up, 8 in 2024-01-13T18:19:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:16 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:19:16.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:16 smithi099 ceph-mon[138788]: osdmap e1084: 8 total, 8 up, 8 in 2024-01-13T18:19:16.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:16 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:19:16.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:16 smithi084 ceph-mon[116404]: osdmap e1084: 8 total, 8 up, 8 in 2024-01-13T18:19:16.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:16 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:19:16.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:16 smithi084 ceph-mon[119097]: osdmap e1084: 8 total, 8 up, 8 in 2024-01-13T18:19:17.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:17 smithi099 ceph-mon[138788]: pgmap v1383: 113 pgs: 8 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:17.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:17 smithi084 ceph-mon[116404]: pgmap v1383: 113 pgs: 8 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:17.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:17 smithi084 ceph-mon[119097]: pgmap v1383: 113 pgs: 8 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:18 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:19:18.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:18 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:19:18.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:18 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:19:18.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:18 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:19:18.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:18 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:19:18.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:18 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:19:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:19 smithi099 ceph-mon[138788]: osdmap e1085: 8 total, 8 up, 8 in 2024-01-13T18:19:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:19 smithi099 ceph-mon[138788]: pgmap v1385: 113 pgs: 1 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 234 B/s wr, 0 op/s 2024-01-13T18:19:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:19:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:19:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:19:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:19:19.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[116404]: osdmap e1085: 8 total, 8 up, 8 in 2024-01-13T18:19:19.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[116404]: pgmap v1385: 113 pgs: 1 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 234 B/s wr, 0 op/s 2024-01-13T18:19:19.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:19:19.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:19:19.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:19:19.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:19:19.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[119097]: osdmap e1085: 8 total, 8 up, 8 in 2024-01-13T18:19:19.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[119097]: pgmap v1385: 113 pgs: 1 unknown, 112 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 234 B/s wr, 0 op/s 2024-01-13T18:19:19.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:19:19.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:19:19.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:19:19.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:19:20.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:20 smithi084 ceph-mon[116404]: osdmap e1086: 8 total, 8 up, 8 in 2024-01-13T18:19:20.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:20.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:19:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:19:20] "GET /metrics HTTP/1.1" 200 36305 "" "Prometheus/2.43.0" 2024-01-13T18:19:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:20 smithi084 ceph-mon[119097]: osdmap e1086: 8 total, 8 up, 8 in 2024-01-13T18:19:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:20 smithi099 ceph-mon[138788]: osdmap e1086: 8 total, 8 up, 8 in 2024-01-13T18:19:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:21.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:21 smithi084 ceph-mon[116404]: osdmap e1087: 8 total, 8 up, 8 in 2024-01-13T18:19:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:21 smithi084 ceph-mon[116404]: pgmap v1388: 113 pgs: 113 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 234 B/s wr, 0 op/s 2024-01-13T18:19:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:21 smithi084 ceph-mon[116404]: osdmap e1088: 8 total, 8 up, 8 in 2024-01-13T18:19:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:21 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:21 smithi084 ceph-mon[119097]: osdmap e1087: 8 total, 8 up, 8 in 2024-01-13T18:19:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:21 smithi084 ceph-mon[119097]: pgmap v1388: 113 pgs: 113 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 234 B/s wr, 0 op/s 2024-01-13T18:19:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:21 smithi084 ceph-mon[119097]: osdmap e1088: 8 total, 8 up, 8 in 2024-01-13T18:19:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:21 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:21 smithi099 ceph-mon[138788]: osdmap e1087: 8 total, 8 up, 8 in 2024-01-13T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:21 smithi099 ceph-mon[138788]: pgmap v1388: 113 pgs: 113 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 234 B/s wr, 0 op/s 2024-01-13T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:21 smithi099 ceph-mon[138788]: osdmap e1088: 8 total, 8 up, 8 in 2024-01-13T18:19:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:21 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:23.155 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.test_put_snap_ec (12326 ms) 2024-01-13T18:19:23.155 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.test_explicit_ec 2024-01-13T18:19:23.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:23 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-8"}]': finished 2024-01-13T18:19:23.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:23 smithi084 ceph-mon[116404]: osdmap e1089: 8 total, 8 up, 8 in 2024-01-13T18:19:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:23 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:23 smithi084 ceph-mon[116404]: pgmap v1391: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:23 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-8"}]': finished 2024-01-13T18:19:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:23 smithi084 ceph-mon[119097]: osdmap e1089: 8 total, 8 up, 8 in 2024-01-13T18:19:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:23 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:23 smithi084 ceph-mon[119097]: pgmap v1391: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:23 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-8"}]': finished 2024-01-13T18:19:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:23 smithi099 ceph-mon[138788]: osdmap e1089: 8 total, 8 up, 8 in 2024-01-13T18:19:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:23 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-8"}]: dispatch 2024-01-13T18:19:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:23 smithi099 ceph-mon[138788]: pgmap v1391: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-8"}]': finished 2024-01-13T18:19:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[119097]: osdmap e1090: 8 total, 8 up, 8 in 2024-01-13T18:19:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:24.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-8"}]': finished 2024-01-13T18:19:24.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[116404]: osdmap e1090: 8 total, 8 up, 8 in 2024-01-13T18:19:24.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:24.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:24 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:24 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603460842' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-8"}]': finished 2024-01-13T18:19:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:24 smithi099 ceph-mon[138788]: osdmap e1090: 8 total, 8 up, 8 in 2024-01-13T18:19:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:24 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:24 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:24 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:24 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:24 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:24 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:25.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:25 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:25 smithi084 ceph-mon[119097]: osdmap e1091: 8 total, 8 up, 8 in 2024-01-13T18:19:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:25 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:25 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:25 smithi084 ceph-mon[119097]: pgmap v1394: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:25 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:25 smithi084 ceph-mon[116404]: osdmap e1091: 8 total, 8 up, 8 in 2024-01-13T18:19:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:25 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:25.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:25 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:25.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:25 smithi084 ceph-mon[116404]: pgmap v1394: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:25 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:25 smithi099 ceph-mon[138788]: osdmap e1091: 8 total, 8 up, 8 in 2024-01-13T18:19:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:25 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:25 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:25.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:25 smithi099 ceph-mon[138788]: pgmap v1394: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:26.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:26 smithi084 ceph-mon[119097]: osdmap e1092: 8 total, 8 up, 8 in 2024-01-13T18:19:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:26 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-9"}]': finished 2024-01-13T18:19:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:26 smithi084 ceph-mon[119097]: osdmap e1093: 8 total, 8 up, 8 in 2024-01-13T18:19:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:26 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:26.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:26 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:26 smithi084 ceph-mon[116404]: osdmap e1092: 8 total, 8 up, 8 in 2024-01-13T18:19:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:26 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-9"}]': finished 2024-01-13T18:19:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:26 smithi084 ceph-mon[116404]: osdmap e1093: 8 total, 8 up, 8 in 2024-01-13T18:19:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:26 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:26.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:26 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:26.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:26 smithi099 ceph-mon[138788]: osdmap e1092: 8 total, 8 up, 8 in 2024-01-13T18:19:26.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:26 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-9"}]': finished 2024-01-13T18:19:26.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:26 smithi099 ceph-mon[138788]: osdmap e1093: 8 total, 8 up, 8 in 2024-01-13T18:19:26.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:26 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:26.870 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:26 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:27.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:27 smithi084 ceph-mon[119097]: pgmap v1397: 113 pgs: 8 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:27 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:19:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:27 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:27 smithi084 ceph-mon[119097]: osdmap e1094: 8 total, 8 up, 8 in 2024-01-13T18:19:27.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:27 smithi084 ceph-mon[116404]: pgmap v1397: 113 pgs: 8 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:27.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:27 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:19:27.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:27 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:27.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:27 smithi084 ceph-mon[116404]: osdmap e1094: 8 total, 8 up, 8 in 2024-01-13T18:19:27.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:27 smithi099 ceph-mon[138788]: pgmap v1397: 113 pgs: 8 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:27.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:27 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:19:27.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:27 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:27.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:27 smithi099 ceph-mon[138788]: osdmap e1094: 8 total, 8 up, 8 in 2024-01-13T18:19:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:29 smithi084 ceph-mon[116404]: osdmap e1095: 8 total, 8 up, 8 in 2024-01-13T18:19:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:29 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:29 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:29 smithi084 ceph-mon[116404]: pgmap v1400: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:29.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:29 smithi084 ceph-mon[119097]: osdmap e1095: 8 total, 8 up, 8 in 2024-01-13T18:19:29.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:29 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:29.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:29 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:29.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:29 smithi084 ceph-mon[119097]: pgmap v1400: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:29 smithi099 ceph-mon[138788]: osdmap e1095: 8 total, 8 up, 8 in 2024-01-13T18:19:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:29 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:29 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:29 smithi099 ceph-mon[138788]: pgmap v1400: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:30.184 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.test_explicit_ec (7028 ms) 2024-01-13T18:19:30.184 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.set_ec 2024-01-13T18:19:30.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:19:30] "GET /metrics HTTP/1.1" 200 36305 "" "Prometheus/2.43.0" 2024-01-13T18:19:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:19:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:19:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]': finished 2024-01-13T18:19:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[116404]: osdmap e1096: 8 total, 8 up, 8 in 2024-01-13T18:19:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:30.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:19:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:19:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]': finished 2024-01-13T18:19:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[119097]: osdmap e1096: 8 total, 8 up, 8 in 2024-01-13T18:19:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:30.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:30 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:30 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:19:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:30 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:19:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:30 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-9"}]': finished 2024-01-13T18:19:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:30 smithi099 ceph-mon[138788]: osdmap e1096: 8 total, 8 up, 8 in 2024-01-13T18:19:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:30 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/851994882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:30.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:30 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]: dispatch 2024-01-13T18:19:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]': finished 2024-01-13T18:19:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:31 smithi099 ceph-mon[138788]: osdmap e1097: 8 total, 8 up, 8 in 2024-01-13T18:19:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:31.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:31 smithi099 ceph-mon[138788]: pgmap v1403: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:31.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]': finished 2024-01-13T18:19:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[116404]: osdmap e1097: 8 total, 8 up, 8 in 2024-01-13T18:19:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:31.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[116404]: pgmap v1403: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:31.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-9"}]': finished 2024-01-13T18:19:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[119097]: osdmap e1097: 8 total, 8 up, 8 in 2024-01-13T18:19:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-13T18:19:31.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:31 smithi084 ceph-mon[119097]: pgmap v1403: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:32 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:32 smithi099 ceph-mon[138788]: osdmap e1098: 8 total, 8 up, 8 in 2024-01-13T18:19:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:32 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:32 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:32.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:32 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:32.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:32 smithi084 ceph-mon[116404]: osdmap e1098: 8 total, 8 up, 8 in 2024-01-13T18:19:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:32 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:32.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:32 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:32 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi084-171061-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-13T18:19:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:32 smithi084 ceph-mon[119097]: osdmap e1098: 8 total, 8 up, 8 in 2024-01-13T18:19:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:32 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:32.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:32 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:33 smithi099 ceph-mon[138788]: pgmap v1406: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:33 smithi099 ceph-mon[138788]: osdmap e1099: 8 total, 8 up, 8 in 2024-01-13T18:19:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:33 smithi084 ceph-mon[116404]: pgmap v1406: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:33.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:33 smithi084 ceph-mon[116404]: osdmap e1099: 8 total, 8 up, 8 in 2024-01-13T18:19:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:33 smithi084 ceph-mon[119097]: pgmap v1406: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:33 smithi084 ceph-mon[119097]: osdmap e1099: 8 total, 8 up, 8 in 2024-01-13T18:19:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:34 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-10"}]': finished 2024-01-13T18:19:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:34 smithi099 ceph-mon[138788]: osdmap e1100: 8 total, 8 up, 8 in 2024-01-13T18:19:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:34 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:34.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:34 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:34.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:34 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-10"}]': finished 2024-01-13T18:19:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:34 smithi084 ceph-mon[116404]: osdmap e1100: 8 total, 8 up, 8 in 2024-01-13T18:19:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:34 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:34.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:34 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:34 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi084-171061-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi084-171061-10"}]': finished 2024-01-13T18:19:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:34 smithi084 ceph-mon[119097]: osdmap e1100: 8 total, 8 up, 8 in 2024-01-13T18:19:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:34 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:34.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:34 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:35 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:35 smithi099 ceph-mon[138788]: osdmap e1101: 8 total, 8 up, 8 in 2024-01-13T18:19:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:35 smithi099 ceph-mon[138788]: pgmap v1409: 113 pgs: 1 creating+peering, 7 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:35 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:35 smithi084 ceph-mon[116404]: osdmap e1101: 8 total, 8 up, 8 in 2024-01-13T18:19:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:35 smithi084 ceph-mon[116404]: pgmap v1409: 113 pgs: 1 creating+peering, 7 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:35 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171061-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:35 smithi084 ceph-mon[119097]: osdmap e1101: 8 total, 8 up, 8 in 2024-01-13T18:19:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:35 smithi084 ceph-mon[119097]: pgmap v1409: 113 pgs: 1 creating+peering, 7 unknown, 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:35.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:36 smithi099 ceph-mon[138788]: osdmap e1102: 8 total, 8 up, 8 in 2024-01-13T18:19:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:36 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:36 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:36.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:36 smithi084 ceph-mon[116404]: osdmap e1102: 8 total, 8 up, 8 in 2024-01-13T18:19:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:36 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:36.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:36 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:36 smithi084 ceph-mon[119097]: osdmap e1102: 8 total, 8 up, 8 in 2024-01-13T18:19:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:36 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:36.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:36 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:37.236 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.set_ec (7053 ms) 2024-01-13T18:19:37.236 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 10 tests from cls_rgw (61470 ms total) 2024-01-13T18:19:37.236 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:19:37.236 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:19:37.236 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 10 tests from 1 test suite ran. (61470 ms total) 2024-01-13T18:19:37.236 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 10 tests. 2024-01-13T18:19:37.238 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:19:37.238 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:19:37.310 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-01-13T18:19:37.311 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-01-13T18:19:37.384 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:19:37.385 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 16 tests from 1 test suite. 2024-01-13T18:19:37.385 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:19:37.385 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 16 tests from cls_rgw 2024-01-13T18:19:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:37 smithi099 ceph-mon[138788]: pgmap v1411: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:37 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]': finished 2024-01-13T18:19:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:37 smithi099 ceph-mon[138788]: osdmap e1103: 8 total, 8 up, 8 in 2024-01-13T18:19:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:37 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:37 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:37 smithi084 ceph-mon[116404]: pgmap v1411: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:37 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]': finished 2024-01-13T18:19:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:37 smithi084 ceph-mon[116404]: osdmap e1103: 8 total, 8 up, 8 in 2024-01-13T18:19:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:37 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:37 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:37 smithi084 ceph-mon[119097]: pgmap v1411: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:37 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi084-171061-10"}]': finished 2024-01-13T18:19:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:37 smithi084 ceph-mon[119097]: osdmap e1103: 8 total, 8 up, 8 in 2024-01-13T18:19:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:37 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2094196716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:37.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:37 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]: dispatch 2024-01-13T18:19:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:38 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]': finished 2024-01-13T18:19:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:38 smithi099 ceph-mon[138788]: osdmap e1104: 8 total, 8 up, 8 in 2024-01-13T18:19:38.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:38 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]': finished 2024-01-13T18:19:38.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:38 smithi084 ceph-mon[119097]: osdmap e1104: 8 total, 8 up, 8 in 2024-01-13T18:19:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:38 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi084-171061-10"}]': finished 2024-01-13T18:19:38.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:38 smithi084 ceph-mon[116404]: osdmap e1104: 8 total, 8 up, 8 in 2024-01-13T18:19:39.260 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.index_basic 2024-01-13T18:19:39.297 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.index_basic (37 ms) 2024-01-13T18:19:39.297 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-01-13T18:19:39.322 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (25 ms) 2024-01-13T18:19:39.322 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.index_remove_object 2024-01-13T18:19:39.356 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.index_remove_object (34 ms) 2024-01-13T18:19:39.356 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.index_suggest 2024-01-13T18:19:39.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:39 smithi099 ceph-mon[138788]: pgmap v1414: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:39.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:39 smithi099 ceph-mon[138788]: osdmap e1105: 8 total, 8 up, 8 in 2024-01-13T18:19:39.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3063066373' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:39.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:39 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:39.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:39 smithi084 ceph-mon[119097]: pgmap v1414: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:39.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:39 smithi084 ceph-mon[119097]: osdmap e1105: 8 total, 8 up, 8 in 2024-01-13T18:19:39.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3063066373' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:39 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:39 smithi084 ceph-mon[116404]: pgmap v1414: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:19:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:39 smithi084 ceph-mon[116404]: osdmap e1105: 8 total, 8 up, 8 in 2024-01-13T18:19:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3063066373' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:39 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:19:40.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:40 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:40.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:40 smithi099 ceph-mon[138788]: osdmap e1106: 8 total, 8 up, 8 in 2024-01-13T18:19:40.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:40 smithi099 ceph-mon[138788]: osdmap e1107: 8 total, 8 up, 8 in 2024-01-13T18:19:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:19:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:19:40] "GET /metrics HTTP/1.1" 200 36272 "" "Prometheus/2.43.0" 2024-01-13T18:19:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:40 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:40 smithi084 ceph-mon[116404]: osdmap e1106: 8 total, 8 up, 8 in 2024-01-13T18:19:40.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:40 smithi084 ceph-mon[116404]: osdmap e1107: 8 total, 8 up, 8 in 2024-01-13T18:19:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:40 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:19:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:40 smithi084 ceph-mon[119097]: osdmap e1106: 8 total, 8 up, 8 in 2024-01-13T18:19:40.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:40 smithi084 ceph-mon[119097]: osdmap e1107: 8 total, 8 up, 8 in 2024-01-13T18:19:40.766 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.index_suggest (1410 ms) 2024-01-13T18:19:40.766 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-01-13T18:19:40.772 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-01-13T18:19:40.772 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.index_list 2024-01-13T18:19:40.793 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.index_list (20 ms) 2024-01-13T18:19:40.793 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-01-13T18:19:41.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:41 smithi099 ceph-mon[138788]: pgmap v1417: 137 pgs: 4 creating+peering, 19 unknown, 114 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 10 KiB/s wr, 30 op/s 2024-01-13T18:19:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:41 smithi084 ceph-mon[116404]: pgmap v1417: 137 pgs: 4 creating+peering, 19 unknown, 114 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 10 KiB/s wr, 30 op/s 2024-01-13T18:19:41.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:41 smithi084 ceph-mon[119097]: pgmap v1417: 137 pgs: 4 creating+peering, 19 unknown, 114 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 10 KiB/s wr, 30 op/s 2024-01-13T18:19:43.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:43 smithi099 ceph-mon[138788]: pgmap v1419: 137 pgs: 4 creating+peering, 8 unknown, 125 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 291 KiB/s rd, 191 KiB/s wr, 575 op/s 2024-01-13T18:19:43.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:43 smithi084 ceph-mon[116404]: pgmap v1419: 137 pgs: 4 creating+peering, 8 unknown, 125 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 291 KiB/s rd, 191 KiB/s wr, 575 op/s 2024-01-13T18:19:43.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:43 smithi084 ceph-mon[119097]: pgmap v1419: 137 pgs: 4 creating+peering, 8 unknown, 125 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 291 KiB/s rd, 191 KiB/s wr, 575 op/s 2024-01-13T18:19:45.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:45 smithi099 ceph-mon[138788]: pgmap v1420: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 400 KiB/s rd, 238 KiB/s wr, 745 op/s 2024-01-13T18:19:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:45 smithi084 ceph-mon[116404]: pgmap v1420: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 400 KiB/s rd, 238 KiB/s wr, 745 op/s 2024-01-13T18:19:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:45 smithi084 ceph-mon[119097]: pgmap v1420: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 400 KiB/s rd, 238 KiB/s wr, 745 op/s 2024-01-13T18:19:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:47 smithi099 ceph-mon[138788]: pgmap v1421: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 307 KiB/s rd, 183 KiB/s wr, 567 op/s 2024-01-13T18:19:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:47 smithi084 ceph-mon[116404]: pgmap v1421: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 307 KiB/s rd, 183 KiB/s wr, 567 op/s 2024-01-13T18:19:47.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:47 smithi084 ceph-mon[119097]: pgmap v1421: 137 pgs: 137 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 307 KiB/s rd, 183 KiB/s wr, 567 op/s 2024-01-13T18:19:49.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:49 smithi099 ceph-mon[138788]: pgmap v1422: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 895 KiB/s rd, 577 KiB/s wr, 1.75k op/s 2024-01-13T18:19:49.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:49 smithi084 ceph-mon[116404]: pgmap v1422: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 895 KiB/s rd, 577 KiB/s wr, 1.75k op/s 2024-01-13T18:19:49.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:49 smithi084 ceph-mon[119097]: pgmap v1422: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 895 KiB/s rd, 577 KiB/s wr, 1.75k op/s 2024-01-13T18:19:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:50.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:50.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:19:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:19:50] "GET /metrics HTTP/1.1" 200 36296 "" "Prometheus/2.43.0" 2024-01-13T18:19:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:19:51.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:51 smithi099 ceph-mon[138788]: pgmap v1423: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 796 KiB/s rd, 514 KiB/s wr, 1.55k op/s 2024-01-13T18:19:51.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:51 smithi084 ceph-mon[116404]: pgmap v1423: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 796 KiB/s rd, 514 KiB/s wr, 1.55k op/s 2024-01-13T18:19:51.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:51 smithi084 ceph-mon[119097]: pgmap v1423: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 796 KiB/s rd, 514 KiB/s wr, 1.55k op/s 2024-01-13T18:19:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:53 smithi099 ceph-mon[138788]: pgmap v1424: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 990 KiB/s rd, 646 KiB/s wr, 1.95k op/s 2024-01-13T18:19:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:53 smithi084 ceph-mon[116404]: pgmap v1424: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 990 KiB/s rd, 646 KiB/s wr, 1.95k op/s 2024-01-13T18:19:53.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:53 smithi084 ceph-mon[119097]: pgmap v1424: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 990 KiB/s rd, 646 KiB/s wr, 1.95k op/s 2024-01-13T18:19:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:55 smithi099 ceph-mon[138788]: pgmap v1425: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 872 KiB/s rd, 568 KiB/s wr, 1.72k op/s 2024-01-13T18:19:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:55 smithi084 ceph-mon[116404]: pgmap v1425: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 872 KiB/s rd, 568 KiB/s wr, 1.72k op/s 2024-01-13T18:19:55.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:55 smithi084 ceph-mon[119097]: pgmap v1425: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 872 KiB/s rd, 568 KiB/s wr, 1.72k op/s 2024-01-13T18:19:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:57 smithi099 ceph-mon[138788]: pgmap v1426: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 792 KiB/s rd, 528 KiB/s wr, 1.58k op/s 2024-01-13T18:19:57.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:57 smithi084 ceph-mon[116404]: pgmap v1426: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 792 KiB/s rd, 528 KiB/s wr, 1.58k op/s 2024-01-13T18:19:57.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:57 smithi084 ceph-mon[119097]: pgmap v1426: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 792 KiB/s rd, 528 KiB/s wr, 1.58k op/s 2024-01-13T18:19:59.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:19:59 smithi099 ceph-mon[138788]: pgmap v1427: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 715 KiB/s wr, 2.15k op/s 2024-01-13T18:19:59.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:19:59 smithi084 ceph-mon[116404]: pgmap v1427: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 715 KiB/s wr, 2.15k op/s 2024-01-13T18:19:59.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:19:59 smithi084 ceph-mon[119097]: pgmap v1427: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 715 KiB/s wr, 2.15k op/s 2024-01-13T18:20:00.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:00 smithi099 ceph-mon[138788]: overall HEALTH_OK 2024-01-13T18:20:00.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:00 smithi084 ceph-mon[116404]: overall HEALTH_OK 2024-01-13T18:20:00.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:20:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:20:00] "GET /metrics HTTP/1.1" 200 36296 "" "Prometheus/2.43.0" 2024-01-13T18:20:00.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:00 smithi084 ceph-mon[119097]: overall HEALTH_OK 2024-01-13T18:20:01.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:01 smithi099 ceph-mon[138788]: pgmap v1428: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 608 KiB/s rd, 405 KiB/s wr, 1.22k op/s 2024-01-13T18:20:01.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:01 smithi084 ceph-mon[116404]: pgmap v1428: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 608 KiB/s rd, 405 KiB/s wr, 1.22k op/s 2024-01-13T18:20:01.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:01 smithi084 ceph-mon[119097]: pgmap v1428: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 608 KiB/s rd, 405 KiB/s wr, 1.22k op/s 2024-01-13T18:20:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:03 smithi099 ceph-mon[138788]: pgmap v1429: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 888 KiB/s rd, 592 KiB/s wr, 1.78k op/s 2024-01-13T18:20:03.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:03 smithi084 ceph-mon[116404]: pgmap v1429: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 888 KiB/s rd, 592 KiB/s wr, 1.78k op/s 2024-01-13T18:20:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:03 smithi084 ceph-mon[119097]: pgmap v1429: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 888 KiB/s rd, 592 KiB/s wr, 1.78k op/s 2024-01-13T18:20:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:05 smithi099 ceph-mon[138788]: pgmap v1430: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 564 KiB/s rd, 376 KiB/s wr, 1.13k op/s 2024-01-13T18:20:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:05 smithi084 ceph-mon[116404]: pgmap v1430: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 564 KiB/s rd, 376 KiB/s wr, 1.13k op/s 2024-01-13T18:20:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:05 smithi084 ceph-mon[119097]: pgmap v1430: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 564 KiB/s rd, 376 KiB/s wr, 1.13k op/s 2024-01-13T18:20:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:07.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:07 smithi099 ceph-mon[138788]: pgmap v1431: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 564 KiB/s rd, 376 KiB/s wr, 1.13k op/s 2024-01-13T18:20:07.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:07 smithi084 ceph-mon[116404]: pgmap v1431: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 564 KiB/s rd, 376 KiB/s wr, 1.13k op/s 2024-01-13T18:20:07.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:07 smithi084 ceph-mon[119097]: pgmap v1431: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 564 KiB/s rd, 376 KiB/s wr, 1.13k op/s 2024-01-13T18:20:09.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:09 smithi099 ceph-mon[138788]: pgmap v1432: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 843 KiB/s rd, 562 KiB/s wr, 1.69k op/s 2024-01-13T18:20:09.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:09 smithi084 ceph-mon[116404]: pgmap v1432: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 843 KiB/s rd, 562 KiB/s wr, 1.69k op/s 2024-01-13T18:20:09.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:09 smithi084 ceph-mon[119097]: pgmap v1432: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 843 KiB/s rd, 562 KiB/s wr, 1.69k op/s 2024-01-13T18:20:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:20:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:20:10] "GET /metrics HTTP/1.1" 200 36301 "" "Prometheus/2.43.0" 2024-01-13T18:20:11.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:11 smithi099 ceph-mon[138788]: pgmap v1433: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 559 KiB/s rd, 373 KiB/s wr, 1.12k op/s 2024-01-13T18:20:11.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:11 smithi084 ceph-mon[116404]: pgmap v1433: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 559 KiB/s rd, 373 KiB/s wr, 1.12k op/s 2024-01-13T18:20:11.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:11 smithi084 ceph-mon[119097]: pgmap v1433: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 559 KiB/s rd, 373 KiB/s wr, 1.12k op/s 2024-01-13T18:20:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:13 smithi099 ceph-mon[138788]: pgmap v1434: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 838 KiB/s rd, 558 KiB/s wr, 1.68k op/s 2024-01-13T18:20:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:13 smithi084 ceph-mon[116404]: pgmap v1434: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 838 KiB/s rd, 558 KiB/s wr, 1.68k op/s 2024-01-13T18:20:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:13 smithi084 ceph-mon[119097]: pgmap v1434: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 838 KiB/s rd, 558 KiB/s wr, 1.68k op/s 2024-01-13T18:20:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:15 smithi099 ceph-mon[138788]: pgmap v1435: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 557 KiB/s rd, 371 KiB/s wr, 1.11k op/s 2024-01-13T18:20:15.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:15 smithi084 ceph-mon[116404]: pgmap v1435: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 557 KiB/s rd, 371 KiB/s wr, 1.11k op/s 2024-01-13T18:20:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:15 smithi084 ceph-mon[119097]: pgmap v1435: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 557 KiB/s rd, 371 KiB/s wr, 1.11k op/s 2024-01-13T18:20:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:17 smithi099 ceph-mon[138788]: pgmap v1436: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 557 KiB/s rd, 371 KiB/s wr, 1.11k op/s 2024-01-13T18:20:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:17 smithi084 ceph-mon[116404]: pgmap v1436: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 557 KiB/s rd, 371 KiB/s wr, 1.11k op/s 2024-01-13T18:20:17.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:17 smithi084 ceph-mon[119097]: pgmap v1436: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 557 KiB/s rd, 371 KiB/s wr, 1.11k op/s 2024-01-13T18:20:19.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:19 smithi099 ceph-mon[138788]: pgmap v1437: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 834 KiB/s rd, 556 KiB/s wr, 1.67k op/s 2024-01-13T18:20:19.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:19 smithi084 ceph-mon[116404]: pgmap v1437: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 834 KiB/s rd, 556 KiB/s wr, 1.67k op/s 2024-01-13T18:20:19.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:19 smithi084 ceph-mon[119097]: pgmap v1437: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 834 KiB/s rd, 556 KiB/s wr, 1.67k op/s 2024-01-13T18:20:20.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:20:20.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:20:20.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:20:20.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:20:20.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:20.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:20:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:20:20] "GET /metrics HTTP/1.1" 200 36302 "" "Prometheus/2.43.0" 2024-01-13T18:20:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:20:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:20:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:20:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:20:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:20:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:20:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:20:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:20:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:21.002 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.index_list_delimited (40209 ms) 2024-01-13T18:20:21.002 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.bi_list 2024-01-13T18:20:21.066 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.bi_list (64 ms) 2024-01-13T18:20:21.067 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.gc_set 2024-01-13T18:20:21.093 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.gc_set (27 ms) 2024-01-13T18:20:21.093 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.gc_list 2024-01-13T18:20:21.123 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.gc_list (29 ms) 2024-01-13T18:20:21.123 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.gc_defer 2024-01-13T18:20:21.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:21 smithi099 ceph-mon[138788]: pgmap v1438: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 555 KiB/s rd, 370 KiB/s wr, 1.11k op/s 2024-01-13T18:20:21.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:21 smithi084 ceph-mon[116404]: pgmap v1438: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 555 KiB/s rd, 370 KiB/s wr, 1.11k op/s 2024-01-13T18:20:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:21 smithi084 ceph-mon[119097]: pgmap v1438: 137 pgs: 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 555 KiB/s rd, 370 KiB/s wr, 1.11k op/s 2024-01-13T18:20:23.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:23 smithi099 ceph-mon[138788]: osdmap e1108: 8 total, 8 up, 8 in 2024-01-13T18:20:23.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:23 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/40629325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:23.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:23 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:23.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:23 smithi099 ceph-mon[138788]: pgmap v1440: 169 pgs: 32 unknown, 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 774 KiB/s rd, 421 KiB/s wr, 1.26k op/s 2024-01-13T18:20:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:23 smithi084 ceph-mon[119097]: osdmap e1108: 8 total, 8 up, 8 in 2024-01-13T18:20:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:23 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/40629325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:23 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:23.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:23 smithi084 ceph-mon[119097]: pgmap v1440: 169 pgs: 32 unknown, 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 774 KiB/s rd, 421 KiB/s wr, 1.26k op/s 2024-01-13T18:20:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:23 smithi084 ceph-mon[116404]: osdmap e1108: 8 total, 8 up, 8 in 2024-01-13T18:20:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:23 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/40629325' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:23 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:23.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:23 smithi084 ceph-mon[116404]: pgmap v1440: 169 pgs: 32 unknown, 137 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 774 KiB/s rd, 421 KiB/s wr, 1.26k op/s 2024-01-13T18:20:24.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:24 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:20:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:24 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:24.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:24 smithi084 ceph-mon[116404]: osdmap e1109: 8 total, 8 up, 8 in 2024-01-13T18:20:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:24 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:20:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:24 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:24.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:24 smithi084 ceph-mon[119097]: osdmap e1109: 8 total, 8 up, 8 in 2024-01-13T18:20:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:24 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:20:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:24 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171432-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:24.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:24 smithi099 ceph-mon[138788]: osdmap e1109: 8 total, 8 up, 8 in 2024-01-13T18:20:25.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:25 smithi084 ceph-mon[119097]: osdmap e1110: 8 total, 8 up, 8 in 2024-01-13T18:20:25.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:25 smithi084 ceph-mon[119097]: pgmap v1443: 169 pgs: 9 creating+peering, 19 unknown, 141 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 736 KiB/s rd, 332 KiB/s wr, 989 op/s 2024-01-13T18:20:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:25 smithi084 ceph-mon[116404]: osdmap e1110: 8 total, 8 up, 8 in 2024-01-13T18:20:25.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:25 smithi084 ceph-mon[116404]: pgmap v1443: 169 pgs: 9 creating+peering, 19 unknown, 141 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 736 KiB/s rd, 332 KiB/s wr, 989 op/s 2024-01-13T18:20:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:25 smithi099 ceph-mon[138788]: osdmap e1110: 8 total, 8 up, 8 in 2024-01-13T18:20:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:25 smithi099 ceph-mon[138788]: pgmap v1443: 169 pgs: 9 creating+peering, 19 unknown, 141 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 736 KiB/s rd, 332 KiB/s wr, 989 op/s 2024-01-13T18:20:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:26 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:20:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:26 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:20:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:26 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:20:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:26 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:20:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:26 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:20:26.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:26 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:20:27.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:27 smithi084 ceph-mon[116404]: pgmap v1444: 169 pgs: 9 creating+peering, 8 unknown, 152 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 736 KiB/s rd, 332 KiB/s wr, 989 op/s 2024-01-13T18:20:27.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:27 smithi084 ceph-mon[119097]: pgmap v1444: 169 pgs: 9 creating+peering, 8 unknown, 152 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 736 KiB/s rd, 332 KiB/s wr, 989 op/s 2024-01-13T18:20:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:27 smithi099 ceph-mon[138788]: pgmap v1444: 169 pgs: 9 creating+peering, 8 unknown, 152 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 736 KiB/s rd, 332 KiB/s wr, 989 op/s 2024-01-13T18:20:29.122 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.gc_defer (7999 ms) 2024-01-13T18:20:29.122 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.usage_basic 2024-01-13T18:20:29.189 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.usage_basic (67 ms) 2024-01-13T18:20:29.189 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-01-13T18:20:29.190 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2024-01-13T18:20:29.190 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.usage_clear 2024-01-13T18:20:29.286 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.usage_clear (95 ms) 2024-01-13T18:20:29.286 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-01-13T18:20:29.324 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.bi_log_trim (38 ms) 2024-01-13T18:20:29.324 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-01-13T18:20:29.336 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw.index_racing_removes (12 ms) 2024-01-13T18:20:29.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:29 smithi099 ceph-mon[138788]: pgmap v1445: 169 pgs: 169 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 837 B/s rd, 669 B/s wr, 1 op/s 2024-01-13T18:20:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:29 smithi084 ceph-mon[116404]: pgmap v1445: 169 pgs: 169 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 837 B/s rd, 669 B/s wr, 1 op/s 2024-01-13T18:20:29.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:29 smithi084 ceph-mon[119097]: pgmap v1445: 169 pgs: 169 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 837 B/s rd, 669 B/s wr, 1 op/s 2024-01-13T18:20:30.126 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 16 tests from cls_rgw (50076 ms total) 2024-01-13T18:20:30.127 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:20:30.127 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:20:30.127 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 16 tests from 1 test suite ran. (52742 ms total) 2024-01-13T18:20:30.127 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 16 tests. 2024-01-13T18:20:30.129 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:20:30.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:20:30.199 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-01-13T18:20:30.224 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-01-13T18:20:30.276 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:20:30.277 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 9 tests from 1 test suite. 2024-01-13T18:20:30.277 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:20:30.277 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 9 tests from cls_rgw_gc 2024-01-13T18:20:30.278 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw_gc.init 2024-01-13T18:20:30.370 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:30 smithi099 ceph-mon[138788]: osdmap e1111: 8 total, 8 up, 8 in 2024-01-13T18:20:30.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:30 smithi084 ceph-mon[116404]: osdmap e1111: 8 total, 8 up, 8 in 2024-01-13T18:20:30.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:20:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:20:30] "GET /metrics HTTP/1.1" 200 36302 "" "Prometheus/2.43.0" 2024-01-13T18:20:30.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:30 smithi084 ceph-mon[119097]: osdmap e1111: 8 total, 8 up, 8 in 2024-01-13T18:20:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:31 smithi084 ceph-mon[116404]: osdmap e1112: 8 total, 8 up, 8 in 2024-01-13T18:20:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:31 smithi084 ceph-mon[116404]: pgmap v1448: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:31 smithi084 ceph-mon[119097]: osdmap e1112: 8 total, 8 up, 8 in 2024-01-13T18:20:31.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:31 smithi084 ceph-mon[119097]: pgmap v1448: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:31 smithi099 ceph-mon[138788]: osdmap e1112: 8 total, 8 up, 8 in 2024-01-13T18:20:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:31 smithi099 ceph-mon[138788]: pgmap v1448: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:32.125 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw_gc.init (1849 ms) 2024-01-13T18:20:32.125 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-01-13T18:20:32.150 INFO:tasks.workunit.client.0.smithi084.stderr:[ ] list info tag = chain-0 2024-01-13T18:20:32.150 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (25 ms) 2024-01-13T18:20:32.150 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-01-13T18:20:32.155 INFO:tasks.workunit.client.0.smithi084.stderr:[ ] next_marker is: = 0/4263 2024-01-13T18:20:32.156 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (6 ms) 2024-01-13T18:20:32.156 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-01-13T18:20:32.163 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (7 ms) 2024-01-13T18:20:32.163 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-01-13T18:20:32.171 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (8 ms) 2024-01-13T18:20:32.171 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-01-13T18:20:32.178 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (7 ms) 2024-01-13T18:20:32.178 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-01-13T18:20:32.184 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (7 ms) 2024-01-13T18:20:32.184 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-01-13T18:20:32.190 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (5 ms) 2024-01-13T18:20:32.190 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw_gc.finalize 2024-01-13T18:20:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:32 smithi084 ceph-mon[119097]: osdmap e1113: 8 total, 8 up, 8 in 2024-01-13T18:20:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:32 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/390873340' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171671-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:32.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:32 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171671-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:32 smithi084 ceph-mon[116404]: osdmap e1113: 8 total, 8 up, 8 in 2024-01-13T18:20:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:32 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/390873340' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171671-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:32.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:32 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171671-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:32 smithi099 ceph-mon[138788]: osdmap e1113: 8 total, 8 up, 8 in 2024-01-13T18:20:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:32 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/390873340' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171671-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:32.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:32 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171671-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:33.133 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw_gc.finalize (943 ms) 2024-01-13T18:20:33.133 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 9 tests from cls_rgw_gc (2857 ms total) 2024-01-13T18:20:33.133 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:20:33.133 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:20:33.133 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 9 tests from 1 test suite ran. (2857 ms total) 2024-01-13T18:20:33.133 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 9 tests. 2024-01-13T18:20:33.135 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:20:33.135 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:20:33.205 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-01-13T18:20:33.205 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-01-13T18:20:33.284 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 1 test from 1 test suite. 2024-01-13T18:20:33.284 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:20:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:33 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171671-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:33 smithi084 ceph-mon[116404]: osdmap e1114: 8 total, 8 up, 8 in 2024-01-13T18:20:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:33 smithi084 ceph-mon[116404]: pgmap v1451: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:33.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:33 smithi084 ceph-mon[116404]: osdmap e1115: 8 total, 8 up, 8 in 2024-01-13T18:20:33.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:33 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171671-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:33.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:33 smithi084 ceph-mon[119097]: osdmap e1114: 8 total, 8 up, 8 in 2024-01-13T18:20:33.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:33 smithi084 ceph-mon[119097]: pgmap v1451: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:33.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:33 smithi084 ceph-mon[119097]: osdmap e1115: 8 total, 8 up, 8 in 2024-01-13T18:20:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:33 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171671-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:33 smithi099 ceph-mon[138788]: osdmap e1114: 8 total, 8 up, 8 in 2024-01-13T18:20:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:33 smithi099 ceph-mon[138788]: pgmap v1451: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:33 smithi099 ceph-mon[138788]: osdmap e1115: 8 total, 8 up, 8 in 2024-01-13T18:20:35.167 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 1 test from cls_rgw_stats 2024-01-13T18:20:35.167 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] cls_rgw_stats.simulate 2024-01-13T18:20:35.180 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.179+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=NQS8TI4901WW type=del size=2353494 2024-01-13T18:20:35.181 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.180+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=1QA5LRZNEJ9P type=del size=4159916 2024-01-13T18:20:35.182 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.181+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=X2A4OPRF21U9 type=del size=2021019 2024-01-13T18:20:35.185 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.184+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~8H1T2BRDE7HN.0 size=1048576 2024-01-13T18:20:35.186 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.185+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~8H1T2BRDE7HN.1 size=653064 2024-01-13T18:20:35.186 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.185+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=8H1T2BRDE7HN tag=FFE6YZCZRXMA type=write size=2750216 2024-01-13T18:20:35.188 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.187+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=KB83UI56PUPP type=write size=165804 2024-01-13T18:20:35.190 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.189+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~CC0J05XHFDV3.0 size=1048576 2024-01-13T18:20:35.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.190+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~CC0J05XHFDV3.1 size=1048576 2024-01-13T18:20:35.192 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.191+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~CC0J05XHFDV3.2 size=459706 2024-01-13T18:20:35.193 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.191+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=CC0J05XHFDV3 tag=T9KTFEXUA7AR type=write size=3605434 2024-01-13T18:20:35.195 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.194+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~NHPY3G62AUJ8.0 size=1048576 2024-01-13T18:20:35.196 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.195+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~NHPY3G62AUJ8.1 size=1048576 2024-01-13T18:20:35.197 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.196+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~NHPY3G62AUJ8.2 size=817652 2024-01-13T18:20:35.197 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.196+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=NHPY3G62AUJ8 tag=HH0INBLMU5BC type=write size=3963380 2024-01-13T18:20:35.200 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.199+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~J7SOC69S69VS.0 size=495786 2024-01-13T18:20:35.200 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.199+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=J7SOC69S69VS tag=C9VITPJ307KZ type=write size=1544362 2024-01-13T18:20:35.202 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.201+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~4JUPO8HKCZFA.0 size=1048576 2024-01-13T18:20:35.203 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.202+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~4JUPO8HKCZFA.1 size=1048576 2024-01-13T18:20:35.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.203+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~4JUPO8HKCZFA.2 size=736972 2024-01-13T18:20:35.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.203+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=4JUPO8HKCZFA tag=YALWXUR5Y0D0 type=write size=3882700 2024-01-13T18:20:35.205 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.204+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=1OTBHQXGVOOF type=del size=2678138 2024-01-13T18:20:35.208 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.207+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~UDXKWU519HIF.0 size=1048576 2024-01-13T18:20:35.209 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.208+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~UDXKWU519HIF.1 size=63657 2024-01-13T18:20:35.209 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.208+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=UDXKWU519HIF tag=GKFTTBK7MO2U type=write size=2160809 2024-01-13T18:20:35.210 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.209+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=VPG2RFUCLOXV type=del size=679628 2024-01-13T18:20:35.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.212+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~26TX2ZNE8O70.0 size=1048576 2024-01-13T18:20:35.214 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.213+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~26TX2ZNE8O70.1 size=823156 2024-01-13T18:20:35.214 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.213+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=26TX2ZNE8O70 tag=CVSCH8QKXVKC type=write size=2920308 2024-01-13T18:20:35.216 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.215+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~L5VW9NGR2XQ1.0 size=719072 2024-01-13T18:20:35.216 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.215+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=L5VW9NGR2XQ1 tag=78PV131FJ2W2 type=write size=1767648 2024-01-13T18:20:35.217 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.216+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=UG30A6GSRD4P type=del size=4137853 2024-01-13T18:20:35.220 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.219+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~J5VWFM64Y53V.0 size=1048576 2024-01-13T18:20:35.221 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.220+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~J5VWFM64Y53V.1 size=437723 2024-01-13T18:20:35.221 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.220+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=J5VWFM64Y53V tag=BAVK2HI02CVO type=write size=2534875 2024-01-13T18:20:35.223 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.222+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=NQS8TI4901WW type=del 2024-01-13T18:20:35.225 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.224+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~YVEW9Y8HX9RP.0 size=1048576 2024-01-13T18:20:35.226 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.225+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~YVEW9Y8HX9RP.1 size=836816 2024-01-13T18:20:35.226 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.225+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=YVEW9Y8HX9RP tag=5IICL48GQ7L1 type=write size=2933968 2024-01-13T18:20:35.228 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.227+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=1QA5LRZNEJ9P type=del 2024-01-13T18:20:35.229 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.228+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=ITUAQEFJTVJP type=del size=3841607 2024-01-13T18:20:35.231 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.230+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=X2A4OPRF21U9 type=del 2024-01-13T18:20:35.232 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.231+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=S2GEBKJ261N9 type=del size=1359059 2024-01-13T18:20:35.234 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.233+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~8H1T2BRDE7HN.0 size=1048576 2024-01-13T18:20:35.234 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.233+0000 7f759fd04880 1 < canceled part key=_multipart_7WRTM9ANJRT4.2~8H1T2BRDE7HN.1 size=653064 2024-01-13T18:20:35.236 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.235+0000 7f759fd04880 1 < canceled multipart upload key=7WRTM9ANJRT4 upload=8H1T2BRDE7HN tag=FFE6YZCZRXMA type=write size=2750216 2024-01-13T18:20:35.237 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.236+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=HYRY2C2OOIG3 type=del size=1617345 2024-01-13T18:20:35.241 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.240+0000 7f759fd04880 1 < suggested remove operation key=1YNH6QHP354U tag=KB83UI56PUPP type=write 2024-01-13T18:20:35.242 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.241+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=S6QYI0G07913 type=del size=3047168 2024-01-13T18:20:35.244 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.243+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~CC0J05XHFDV3.0 size=1048576 2024-01-13T18:20:35.245 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.244+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~CC0J05XHFDV3.1 size=1048576 2024-01-13T18:20:35.246 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.245+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~CC0J05XHFDV3.2 size=459706 2024-01-13T18:20:35.248 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.247+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=CC0J05XHFDV3 tag=T9KTFEXUA7AR type=write size=3605434 2024-01-13T18:20:35.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.248+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=ROT1X5HZ24VU type=del size=2781149 2024-01-13T18:20:35.251 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.250+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~NHPY3G62AUJ8.0 size=1048576 2024-01-13T18:20:35.252 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.251+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~NHPY3G62AUJ8.1 size=1048576 2024-01-13T18:20:35.253 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.252+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~NHPY3G62AUJ8.2 size=817652 2024-01-13T18:20:35.255 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.254+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=NHPY3G62AUJ8 tag=HH0INBLMU5BC type=write size=3963380 2024-01-13T18:20:35.256 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.255+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=PBDFH5JTNNZX type=del size=1050655 2024-01-13T18:20:35.257 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.256+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~J7SOC69S69VS.0 size=495786 2024-01-13T18:20:35.259 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.258+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=J7SOC69S69VS tag=C9VITPJ307KZ type=write size=1544362 2024-01-13T18:20:35.261 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.260+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~XW1D14BZ3B5R.0 size=1048576 2024-01-13T18:20:35.262 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.261+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~XW1D14BZ3B5R.1 size=942011 2024-01-13T18:20:35.262 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.261+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=XW1D14BZ3B5R tag=26PEXPYYTZYS type=write size=3039163 2024-01-13T18:20:35.263 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.262+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~4JUPO8HKCZFA.0 size=1048576 2024-01-13T18:20:35.264 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.263+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~4JUPO8HKCZFA.1 size=1048576 2024-01-13T18:20:35.265 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.264+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~4JUPO8HKCZFA.2 size=736972 2024-01-13T18:20:35.267 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.266+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=4JUPO8HKCZFA tag=YALWXUR5Y0D0 type=write size=3882700 2024-01-13T18:20:35.268 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.267+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=HMDQIVCXCU98 type=del size=4154333 2024-01-13T18:20:35.269 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.268+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=1OTBHQXGVOOF type=del 2024-01-13T18:20:35.270 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.269+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=7DUY8U2NMSMO type=del size=637688 2024-01-13T18:20:35.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.271+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~UDXKWU519HIF.0 size=1048576 2024-01-13T18:20:35.273 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.272+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~UDXKWU519HIF.1 size=63657 2024-01-13T18:20:35.275 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.274+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=UDXKWU519HIF tag=GKFTTBK7MO2U type=write size=2160809 2024-01-13T18:20:35.276 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.275+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=VZV7C5TNTJPG type=write size=539506 2024-01-13T18:20:35.277 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.276+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=VPG2RFUCLOXV type=del 2024-01-13T18:20:35.279 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.278+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~PVI3JA1NCUY4.0 size=1048576 2024-01-13T18:20:35.280 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.279+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~PVI3JA1NCUY4.1 size=163365 2024-01-13T18:20:35.281 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.279+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=PVI3JA1NCUY4 tag=09Z7QCKZ23G4 type=write size=2260517 2024-01-13T18:20:35.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.280+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~26TX2ZNE8O70.0 size=1048576 2024-01-13T18:20:35.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.281+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~26TX2ZNE8O70.1 size=823156 2024-01-13T18:20:35.284 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.283+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=26TX2ZNE8O70 tag=CVSCH8QKXVKC type=write size=2920308 2024-01-13T18:20:35.286 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.285+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~663CXJ0PHNIX.0 size=130494 2024-01-13T18:20:35.286 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.285+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=663CXJ0PHNIX tag=MS12K3R36L4M type=write size=1179070 2024-01-13T18:20:35.287 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.286+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~L5VW9NGR2XQ1.0 size=719072 2024-01-13T18:20:35.289 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.288+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=L5VW9NGR2XQ1 tag=78PV131FJ2W2 type=write size=1767648 2024-01-13T18:20:35.290 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.289+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=W4A037BBXOHO type=del size=46982 2024-01-13T18:20:35.292 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.291+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=UG30A6GSRD4P type=del 2024-01-13T18:20:35.293 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.292+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=02OZ2AEG3J6O type=del size=750324 2024-01-13T18:20:35.294 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.293+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~J5VWFM64Y53V.0 size=1048576 2024-01-13T18:20:35.295 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.294+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~J5VWFM64Y53V.1 size=437723 2024-01-13T18:20:35.297 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.296+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=J5VWFM64Y53V tag=BAVK2HI02CVO type=write size=2534875 2024-01-13T18:20:35.298 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.297+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=CO5CKAQ4E67W type=del size=2406980 2024-01-13T18:20:35.299 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.298+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~YVEW9Y8HX9RP.0 size=1048576 2024-01-13T18:20:35.301 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.300+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~YVEW9Y8HX9RP.1 size=836816 2024-01-13T18:20:35.303 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.301+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=YVEW9Y8HX9RP tag=5IICL48GQ7L1 type=write size=2933968 2024-01-13T18:20:35.306 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.304+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~843Z6P3E0NZW.0 size=130435 2024-01-13T18:20:35.306 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.304+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=843Z6P3E0NZW tag=BC2MTCIBV6QI type=write size=1179011 2024-01-13T18:20:35.308 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.307+0000 7f759fd04880 1 < suggested update operation key=JN46AMLYHN8E tag=ITUAQEFJTVJP type=del size=3841607 2024-01-13T18:20:35.309 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.308+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=X76T05EZ92Z6 type=del size=2131606 2024-01-13T18:20:35.311 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.310+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=S2GEBKJ261N9 type=del 2024-01-13T18:20:35.313 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.311+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=848WI38ZQ2O8 type=write size=996145 2024-01-13T18:20:35.314 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.313+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=HYRY2C2OOIG3 type=del 2024-01-13T18:20:35.315 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.314+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=TEA9XBJS00XF type=del size=754790 2024-01-13T18:20:35.316 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.315+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=S6QYI0G07913 type=del 2024-01-13T18:20:35.317 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.316+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=674XBZTARWDB type=del size=3581031 2024-01-13T18:20:35.319 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.318+0000 7f759fd04880 1 < completed delete operation key=1YNH6QHP354U tag=ROT1X5HZ24VU type=del 2024-01-13T18:20:35.320 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.319+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=13RK05IWXS3L type=del size=2121118 2024-01-13T18:20:35.322 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.320+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=PBDFH5JTNNZX type=del 2024-01-13T18:20:35.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.322+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=8XHQTBC44JY8 type=del size=3816781 2024-01-13T18:20:35.325 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.323+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~XW1D14BZ3B5R.0 size=1048576 2024-01-13T18:20:35.326 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.324+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~XW1D14BZ3B5R.1 size=942011 2024-01-13T18:20:35.327 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.326+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=XW1D14BZ3B5R tag=26PEXPYYTZYS type=write size=3039163 2024-01-13T18:20:35.328 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.327+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=CZ9CEZ7BXGXP type=del size=2719359 2024-01-13T18:20:35.333 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.328+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=HMDQIVCXCU98 type=del 2024-01-13T18:20:35.333 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.331+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~D25VJHF5FNXJ.0 size=437423 2024-01-13T18:20:35.333 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.331+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=D25VJHF5FNXJ tag=NEEL2WHJ6VLC type=write size=1485999 2024-01-13T18:20:35.334 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.332+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=7DUY8U2NMSMO type=del 2024-01-13T18:20:35.335 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.334+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~3PMO0EFNJTJY.0 size=1048576 2024-01-13T18:20:35.336 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.335+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~3PMO0EFNJTJY.1 size=263824 2024-01-13T18:20:35.336 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.335+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=3PMO0EFNJTJY tag=NSNW32GCLFS1 type=write size=2360976 2024-01-13T18:20:35.340 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.338+0000 7f759fd04880 1 < suggested update operation key=EW3ZFDVIQZ7G tag=VZV7C5TNTJPG type=write size=539506 2024-01-13T18:20:35.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.340+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~3UD8RJXY8ZLS.0 size=678338 2024-01-13T18:20:35.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.340+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=3UD8RJXY8ZLS tag=30LDFAXFFB9W type=write size=1726914 2024-01-13T18:20:35.342 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.341+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~PVI3JA1NCUY4.0 size=1048576 2024-01-13T18:20:35.343 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.342+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~PVI3JA1NCUY4.1 size=163365 2024-01-13T18:20:35.345 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.344+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=PVI3JA1NCUY4 tag=09Z7QCKZ23G4 type=write size=2260517 2024-01-13T18:20:35.346 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.345+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=3V99WNEOKXMG type=write size=850306 2024-01-13T18:20:35.347 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.346+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~663CXJ0PHNIX.0 size=130494 2024-01-13T18:20:35.349 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.348+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=663CXJ0PHNIX tag=MS12K3R36L4M type=write size=1179070 2024-01-13T18:20:35.350 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.349+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=IQZS2M7MKVMG type=del size=3050181 2024-01-13T18:20:35.351 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.350+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=W4A037BBXOHO type=del 2024-01-13T18:20:35.352 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.351+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=4OK4DIDQY0R4 type=del size=432732 2024-01-13T18:20:35.353 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.352+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=02OZ2AEG3J6O type=del 2024-01-13T18:20:35.355 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.354+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~0E61UCGRJJEC.0 size=956580 2024-01-13T18:20:35.355 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.354+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=0E61UCGRJJEC tag=LHJO8A3KFGHE type=write size=2005156 2024-01-13T18:20:35.358 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.357+0000 7f759fd04880 1 < suggested update operation key=7R5YIO7UFSDZ tag=CO5CKAQ4E67W type=del size=2406980 2024-01-13T18:20:35.359 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.358+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=GO43V1BOWO68 type=del size=49658 2024-01-13T18:20:35.361 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.360+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~843Z6P3E0NZW.0 size=130435 2024-01-13T18:20:35.363 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.362+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=843Z6P3E0NZW tag=BC2MTCIBV6QI type=write size=1179011 2024-01-13T18:20:35.365 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.364+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~X9AHLZLUERFL.0 size=1048576 2024-01-13T18:20:35.366 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.365+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~X9AHLZLUERFL.1 size=1048576 2024-01-13T18:20:35.367 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.366+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~X9AHLZLUERFL.2 size=835583 2024-01-13T18:20:35.367 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.366+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=X9AHLZLUERFL tag=RNXSOE75AKCX type=write size=3981311 2024-01-13T18:20:35.368 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.367+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=X76T05EZ92Z6 type=del 2024-01-13T18:20:35.369 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.368+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=73PQFNL54KMY type=del size=2065530 2024-01-13T18:20:35.370 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.369+0000 7f759fd04880 1 < completed write operation key=QS9PLJKINY4R tag=848WI38ZQ2O8 type=write size=996145 2024-01-13T18:20:35.372 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.372+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~NVZE1MA71TUD.0 size=846235 2024-01-13T18:20:35.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.372+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=NVZE1MA71TUD tag=E8DC8F6FCWBI type=write size=1894811 2024-01-13T18:20:35.374 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.373+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=TEA9XBJS00XF type=del 2024-01-13T18:20:35.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.374+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=U6ON6CJL94L5 type=del size=3993605 2024-01-13T18:20:35.376 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.375+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=674XBZTARWDB type=del 2024-01-13T18:20:35.379 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.378+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~UHMX4UPJGPG6.0 size=13945 2024-01-13T18:20:35.379 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.378+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=UHMX4UPJGPG6 tag=30680H24X2OK type=write size=1062521 2024-01-13T18:20:35.380 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.379+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=13RK05IWXS3L type=del 2024-01-13T18:20:35.381 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.380+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=EK5G51YQS82Z type=del size=1834045 2024-01-13T18:20:35.382 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.381+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=8XHQTBC44JY8 type=del 2024-01-13T18:20:35.384 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.382+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=78YBLA4JWY98 type=del size=2824591 2024-01-13T18:20:35.385 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.384+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=CZ9CEZ7BXGXP type=del 2024-01-13T18:20:35.387 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.386+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~BP6YP16N6Q4U.0 size=1048576 2024-01-13T18:20:35.387 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.387+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~BP6YP16N6Q4U.1 size=1048576 2024-01-13T18:20:35.389 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.387+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~BP6YP16N6Q4U.2 size=600042 2024-01-13T18:20:35.389 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.387+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=BP6YP16N6Q4U tag=M7XRTHHLI0WD type=write size=3745770 2024-01-13T18:20:35.389 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.388+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~D25VJHF5FNXJ.0 size=437423 2024-01-13T18:20:35.392 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.391+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=D25VJHF5FNXJ tag=NEEL2WHJ6VLC type=write size=1485999 2024-01-13T18:20:35.394 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.393+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~3D2ZDS4CANHR.0 size=1048576 2024-01-13T18:20:35.395 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.394+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~3D2ZDS4CANHR.1 size=240412 2024-01-13T18:20:35.395 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.394+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=3D2ZDS4CANHR tag=8KA7U3Q9DFHO type=write size=2337564 2024-01-13T18:20:35.396 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.395+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~3PMO0EFNJTJY.0 size=1048576 2024-01-13T18:20:35.397 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.396+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~3PMO0EFNJTJY.1 size=263824 2024-01-13T18:20:35.399 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.398+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=3PMO0EFNJTJY tag=NSNW32GCLFS1 type=write size=2360976 2024-01-13T18:20:35.400 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.399+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=90LRTCK3W2KF type=del size=2387585 2024-01-13T18:20:35.403 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.400+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~3UD8RJXY8ZLS.0 size=678338 2024-01-13T18:20:35.404 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.402+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=3UD8RJXY8ZLS tag=30LDFAXFFB9W type=write size=1726914 2024-01-13T18:20:35.406 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.404+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~LR639XSI7WSD.0 size=1048576 2024-01-13T18:20:35.408 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.405+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~LR639XSI7WSD.1 size=900657 2024-01-13T18:20:35.408 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.405+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=LR639XSI7WSD tag=GQ8V0F1ZI1NO type=write size=2997809 2024-01-13T18:20:35.409 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.406+0000 7f759fd04880 -1 < failed to complete operation key=7R5YIO7UFSDZ tag=3V99WNEOKXMG type=write size=850306: (22) Invalid argument 2024-01-13T18:20:35.409 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.408+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~NWE4O9O03T1K.0 size=1048576 2024-01-13T18:20:35.410 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.409+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~NWE4O9O03T1K.1 size=372074 2024-01-13T18:20:35.411 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.409+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=NWE4O9O03T1K tag=AQE48P17UB03 type=write size=2469226 2024-01-13T18:20:35.413 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.411+0000 7f759fd04880 1 < suggested update operation key=XBTWSUA3D7U3 tag=IQZS2M7MKVMG type=del size=3050181 2024-01-13T18:20:35.414 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.413+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~QYMMBSFFUT1V.0 size=1048576 2024-01-13T18:20:35.415 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.414+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~QYMMBSFFUT1V.1 size=503662 2024-01-13T18:20:35.416 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.414+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=QYMMBSFFUT1V tag=1AQSWVHD1S7J type=write size=2600814 2024-01-13T18:20:35.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.415+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=4OK4DIDQY0R4 type=del 2024-01-13T18:20:35.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.416+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=XRR1DJTDV23N type=del size=3752168 2024-01-13T18:20:35.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.417+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~0E61UCGRJJEC.0 size=956580 2024-01-13T18:20:35.420 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.419+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=0E61UCGRJJEC tag=LHJO8A3KFGHE type=write size=2005156 2024-01-13T18:20:35.421 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.421+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=NV7EBKQI9TLJ type=del size=1092621 2024-01-13T18:20:35.423 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.422+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=GO43V1BOWO68 type=del 2024-01-13T18:20:35.428 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.424+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~RLPJ8PSW4GMJ.0 size=1048576 2024-01-13T18:20:35.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.425+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~RLPJ8PSW4GMJ.1 size=1048576 2024-01-13T18:20:35.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.426+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~RLPJ8PSW4GMJ.2 size=627474 2024-01-13T18:20:35.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.426+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=RLPJ8PSW4GMJ tag=Q1B9G943C3PC type=write size=3773202 2024-01-13T18:20:35.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.426+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~X9AHLZLUERFL.0 size=1048576 2024-01-13T18:20:35.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:35 smithi084 ceph-mon[116404]: osdmap e1116: 8 total, 8 up, 8 in 2024-01-13T18:20:35.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:35 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2048264131' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171738-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:35.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:35 smithi084 ceph-mon[116404]: pgmap v1454: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:35.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:35.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:35 smithi084 ceph-mon[119097]: osdmap e1116: 8 total, 8 up, 8 in 2024-01-13T18:20:35.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:35 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2048264131' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171738-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:35.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:35 smithi084 ceph-mon[119097]: pgmap v1454: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:35.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:35.430 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.427+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~X9AHLZLUERFL.1 size=1048576 2024-01-13T18:20:35.430 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.428+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~X9AHLZLUERFL.2 size=835583 2024-01-13T18:20:35.431 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.430+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=X9AHLZLUERFL tag=RNXSOE75AKCX type=write size=3981311 2024-01-13T18:20:35.432 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.431+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=GLYKXLFM3QRB type=del size=2383178 2024-01-13T18:20:35.433 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.432+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=73PQFNL54KMY type=del 2024-01-13T18:20:35.435 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.435+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~ZQWNI4TDCD42.0 size=1048576 2024-01-13T18:20:35.436 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.435+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~ZQWNI4TDCD42.1 size=684343 2024-01-13T18:20:35.436 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.435+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=ZQWNI4TDCD42 tag=KI7US24ROTKD type=write size=2781495 2024-01-13T18:20:35.438 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.437+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~NVZE1MA71TUD.0 size=846235 2024-01-13T18:20:35.439 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.439+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=NVZE1MA71TUD tag=E8DC8F6FCWBI type=write size=1894811 2024-01-13T18:20:35.441 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.440+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=OY682MWJOT96 type=del size=7108 2024-01-13T18:20:35.442 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.441+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=U6ON6CJL94L5 type=del 2024-01-13T18:20:35.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.442+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=NO5U6RMKSH8S type=del size=3130585 2024-01-13T18:20:35.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.442+0000 7f759fd04880 1 < canceled part key=_multipart_H7C1UAGAUR7D.2~UHMX4UPJGPG6.0 size=13945 2024-01-13T18:20:35.445 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.444+0000 7f759fd04880 1 < canceled multipart upload key=H7C1UAGAUR7D upload=UHMX4UPJGPG6 tag=30680H24X2OK type=write size=1062521 2024-01-13T18:20:35.446 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.445+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=PI1NOE8GKYCK type=del size=1404801 2024-01-13T18:20:35.449 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.448+0000 7f759fd04880 1 < suggested update operation key=DOXP3EJ03EBY tag=EK5G51YQS82Z type=del size=1834045 2024-01-13T18:20:35.450 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.449+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=Y24CIV8XT71X type=write size=699225 2024-01-13T18:20:35.451 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.450+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=78YBLA4JWY98 type=del 2024-01-13T18:20:35.452 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.451+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=ZRKEJJIN28LR type=del size=3759452 2024-01-13T18:20:35.453 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.452+0000 7f759fd04880 1 < canceled part key=_multipart_JGALONWJXLQY.2~BP6YP16N6Q4U.0 size=1048576 2024-01-13T18:20:35.453 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.452+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~BP6YP16N6Q4U.1 size=1048576 2024-01-13T18:20:35.454 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.453+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~BP6YP16N6Q4U.2 size=600042 2024-01-13T18:20:35.456 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.455+0000 7f759fd04880 1 < canceled multipart upload key=JGALONWJXLQY upload=BP6YP16N6Q4U tag=M7XRTHHLI0WD type=write size=3745770 2024-01-13T18:20:35.457 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.456+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=L4QVDIC0EK75 type=del size=1344134 2024-01-13T18:20:35.458 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.458+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~3D2ZDS4CANHR.0 size=1048576 2024-01-13T18:20:35.460 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.459+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~3D2ZDS4CANHR.1 size=240412 2024-01-13T18:20:35.461 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.461+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=3D2ZDS4CANHR tag=8KA7U3Q9DFHO type=write size=2337564 2024-01-13T18:20:35.464 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.463+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~GRCLWQ73HB65.0 size=1048576 2024-01-13T18:20:35.464 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.464+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~GRCLWQ73HB65.1 size=218530 2024-01-13T18:20:35.465 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.464+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=GRCLWQ73HB65 tag=LJUW92CFFYO8 type=write size=2315682 2024-01-13T18:20:35.466 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.465+0000 7f759fd04880 1 < canceled operation key=JN46AMLYHN8E tag=90LRTCK3W2KF type=del size=2387585 2024-01-13T18:20:35.467 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.466+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=8B21K4LH8IG6 type=del size=3957459 2024-01-13T18:20:35.468 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.467+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~LR639XSI7WSD.0 size=1048576 2024-01-13T18:20:35.469 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.468+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~LR639XSI7WSD.1 size=900657 2024-01-13T18:20:35.471 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.470+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=LR639XSI7WSD tag=GQ8V0F1ZI1NO type=write size=2997809 2024-01-13T18:20:35.472 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.472+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=A82CZ25VPSFY type=del size=1092687 2024-01-13T18:20:35.474 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.473+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~NWE4O9O03T1K.0 size=1048576 2024-01-13T18:20:35.475 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.474+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~NWE4O9O03T1K.1 size=372074 2024-01-13T18:20:35.477 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.476+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=NWE4O9O03T1K tag=AQE48P17UB03 type=write size=2469226 2024-01-13T18:20:35.478 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.477+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=SRTXX9L2X5RV type=del size=2321052 2024-01-13T18:20:35.479 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.478+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~QYMMBSFFUT1V.0 size=1048576 2024-01-13T18:20:35.480 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.479+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~QYMMBSFFUT1V.1 size=503662 2024-01-13T18:20:35.482 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.481+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=QYMMBSFFUT1V tag=1AQSWVHD1S7J type=write size=2600814 2024-01-13T18:20:35.484 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.483+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~SL6J65REHOLO.0 size=114655 2024-01-13T18:20:35.484 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.483+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=SL6J65REHOLO tag=QIME4XI7PFFD type=write size=1163231 2024-01-13T18:20:35.486 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.485+0000 7f759fd04880 1 < canceled operation key=1WSQNY2NDY3K tag=XRR1DJTDV23N type=del size=3752168 2024-01-13T18:20:35.487 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.486+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=FORFV2YT8S2S type=write size=390384 2024-01-13T18:20:35.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.488+0000 7f759fd04880 1 < suggested remove operation key=1YNH6QHP354U tag=NV7EBKQI9TLJ type=del 2024-01-13T18:20:35.492 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.491+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~99W34097GE95.0 size=1048576 2024-01-13T18:20:35.493 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.492+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~99W34097GE95.1 size=1048576 2024-01-13T18:20:35.494 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.493+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~99W34097GE95.2 size=863651 2024-01-13T18:20:35.494 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.493+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=99W34097GE95 tag=SYC9JMOVDQGC type=write size=4009379 2024-01-13T18:20:35.495 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.494+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~RLPJ8PSW4GMJ.0 size=1048576 2024-01-13T18:20:35.496 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.495+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~RLPJ8PSW4GMJ.1 size=1048576 2024-01-13T18:20:35.496 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.495+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~RLPJ8PSW4GMJ.2 size=627474 2024-01-13T18:20:35.498 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.497+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=RLPJ8PSW4GMJ tag=Q1B9G943C3PC type=write size=3773202 2024-01-13T18:20:35.500 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.499+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=0VYJTKZ7FYK3 type=del size=406406 2024-01-13T18:20:35.501 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.500+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=GLYKXLFM3QRB type=del 2024-01-13T18:20:35.502 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.501+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=PIQRCUHFMBXO type=del size=784791 2024-01-13T18:20:35.503 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.502+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~ZQWNI4TDCD42.0 size=1048576 2024-01-13T18:20:35.504 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.503+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~ZQWNI4TDCD42.1 size=684343 2024-01-13T18:20:35.506 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.505+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=ZQWNI4TDCD42 tag=KI7US24ROTKD type=write size=2781495 2024-01-13T18:20:35.508 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.507+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~HXUS0TAQAQYK.0 size=621146 2024-01-13T18:20:35.508 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.507+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=HXUS0TAQAQYK tag=54BZ65YHWDDK type=write size=1669722 2024-01-13T18:20:35.509 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.508+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=OY682MWJOT96 type=del 2024-01-13T18:20:35.510 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.509+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=7H7P6L01I717 type=del size=730447 2024-01-13T18:20:35.513 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.512+0000 7f759fd04880 1 < suggested remove operation key=6GOU0WSHKUQ0 tag=NO5U6RMKSH8S type=del 2024-01-13T18:20:35.515 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.514+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~WOE6Q6XLZI1N.0 size=1048576 2024-01-13T18:20:35.516 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.515+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~WOE6Q6XLZI1N.1 size=283435 2024-01-13T18:20:35.516 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.515+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=WOE6Q6XLZI1N tag=8G4X4273U6UL type=write size=2380587 2024-01-13T18:20:35.517 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.516+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=PI1NOE8GKYCK type=del 2024-01-13T18:20:35.519 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.518+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=YCBP379VMKL5 type=del size=127150 2024-01-13T18:20:35.520 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.519+0000 7f759fd04880 1 < completed write operation key=H972TC5DOMHL tag=Y24CIV8XT71X type=write size=699225 2024-01-13T18:20:35.523 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.522+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~UMWSOOE8MBCM.0 size=1048576 2024-01-13T18:20:35.523 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.523+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~UMWSOOE8MBCM.1 size=1048576 2024-01-13T18:20:35.524 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.523+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~UMWSOOE8MBCM.2 size=266067 2024-01-13T18:20:35.525 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.523+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=UMWSOOE8MBCM tag=DPB3RVL3S1GV type=write size=3411795 2024-01-13T18:20:35.526 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.525+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=ZRKEJJIN28LR type=del 2024-01-13T18:20:35.527 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.526+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=0ZTFW90SAF18 type=write size=315386 2024-01-13T18:20:35.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.527+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=L4QVDIC0EK75 type=del 2024-01-13T18:20:35.529 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.528+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=TP6FOQ3GWTJQ type=del size=1980273 2024-01-13T18:20:35.531 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.530+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~GRCLWQ73HB65.0 size=1048576 2024-01-13T18:20:35.532 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.531+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~GRCLWQ73HB65.1 size=218530 2024-01-13T18:20:35.533 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.533+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=GRCLWQ73HB65 tag=LJUW92CFFYO8 type=write size=2315682 2024-01-13T18:20:35.535 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.534+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=KLT9CGMUNBSF type=del size=3191141 2024-01-13T18:20:35.538 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.537+0000 7f759fd04880 1 < suggested remove operation key=7LXXSKLOM1JZ tag=8B21K4LH8IG6 type=del 2024-01-13T18:20:35.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.539+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~2Q8Y4NAFAZ66.0 size=411018 2024-01-13T18:20:35.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.539+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=2Q8Y4NAFAZ66 tag=V9IP0UBE3XFD type=write size=1459594 2024-01-13T18:20:35.541 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.540+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=A82CZ25VPSFY type=del 2024-01-13T18:20:35.543 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.542+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~0VANIJ0IZ06L.0 size=1048576 2024-01-13T18:20:35.544 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.543+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~0VANIJ0IZ06L.1 size=147991 2024-01-13T18:20:35.544 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.543+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=0VANIJ0IZ06L tag=3JXBWC6LFQBZ type=write size=2245143 2024-01-13T18:20:35.545 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.544+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=SRTXX9L2X5RV type=del 2024-01-13T18:20:35.547 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.546+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~I9C8DN1HYG9J.0 size=1048576 2024-01-13T18:20:35.549 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.547+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~I9C8DN1HYG9J.1 size=1048576 2024-01-13T18:20:35.549 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.548+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~I9C8DN1HYG9J.2 size=874027 2024-01-13T18:20:35.550 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.548+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=I9C8DN1HYG9J tag=RIIM1B0ED89Y type=write size=4019755 2024-01-13T18:20:35.551 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.550+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~SL6J65REHOLO.0 size=114655 2024-01-13T18:20:35.553 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.552+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=SL6J65REHOLO tag=QIME4XI7PFFD type=write size=1163231 2024-01-13T18:20:35.554 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.553+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=X4HULEY5T56J type=del size=1398040 2024-01-13T18:20:35.555 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.554+0000 7f759fd04880 -1 < no bi entry to suggest for operation key=7LXXSKLOM1JZ tag=FORFV2YT8S2S type=write size=390384: (2) No such file or directory 2024-01-13T18:20:35.557 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.556+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~I639HN9N603U.0 size=1048576 2024-01-13T18:20:35.564 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.563+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~I639HN9N603U.1 size=108102 2024-01-13T18:20:35.564 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.563+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=I639HN9N603U tag=0HLNSCSCVNJ1 type=write size=2205254 2024-01-13T18:20:35.566 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.565+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~99W34097GE95.0 size=1048576 2024-01-13T18:20:35.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.566+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~99W34097GE95.1 size=1048576 2024-01-13T18:20:35.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.566+0000 7f759fd04880 1 < canceled part key=_multipart_AJZB1PXB1NB5.2~99W34097GE95.2 size=863651 2024-01-13T18:20:35.568 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.567+0000 7f759fd04880 1 < canceled multipart upload key=AJZB1PXB1NB5 upload=99W34097GE95 tag=SYC9JMOVDQGC type=write size=4009379 2024-01-13T18:20:35.571 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.570+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~VWMRSUHKO4AN.0 size=584667 2024-01-13T18:20:35.571 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.570+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=VWMRSUHKO4AN tag=7LUP9WUWVHN7 type=write size=1633243 2024-01-13T18:20:35.572 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.571+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=0VYJTKZ7FYK3 type=del 2024-01-13T18:20:35.573 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.573+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=ZM3YH7EO0IJN type=del size=557203 2024-01-13T18:20:35.575 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.574+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=PIQRCUHFMBXO type=del 2024-01-13T18:20:35.577 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.576+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~7HNSPXFQX9BD.0 size=1048576 2024-01-13T18:20:35.578 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.577+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~7HNSPXFQX9BD.1 size=950076 2024-01-13T18:20:35.578 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.577+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=7HNSPXFQX9BD tag=E56ZXSVAGT3J type=write size=3047228 2024-01-13T18:20:35.579 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.578+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~HXUS0TAQAQYK.0 size=621146 2024-01-13T18:20:35.581 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.580+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=HXUS0TAQAQYK tag=54BZ65YHWDDK type=write size=1669722 2024-01-13T18:20:35.583 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.582+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~LOW42IJXCHYJ.0 size=1048576 2024-01-13T18:20:35.584 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.583+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~LOW42IJXCHYJ.1 size=214632 2024-01-13T18:20:35.584 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.583+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=LOW42IJXCHYJ tag=FMWHCFF37AAJ type=write size=2311784 2024-01-13T18:20:35.585 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.584+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=7H7P6L01I717 type=del 2024-01-13T18:20:35.587 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.586+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~B36HS2PYVWAT.0 size=939220 2024-01-13T18:20:35.587 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.586+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=B36HS2PYVWAT tag=KB88LVB70G0P type=write size=1987796 2024-01-13T18:20:35.588 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.587+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~WOE6Q6XLZI1N.0 size=1048576 2024-01-13T18:20:35.589 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.588+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~WOE6Q6XLZI1N.1 size=283435 2024-01-13T18:20:35.591 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.590+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=WOE6Q6XLZI1N tag=8G4X4273U6UL type=write size=2380587 2024-01-13T18:20:35.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.593+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~CMBVTCKJ7QGN.0 size=1048576 2024-01-13T18:20:35.594 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.593+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~CMBVTCKJ7QGN.1 size=1048576 2024-01-13T18:20:35.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.594+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~CMBVTCKJ7QGN.2 size=702341 2024-01-13T18:20:35.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.594+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=CMBVTCKJ7QGN tag=M2DUULWZQMDM type=write size=3848069 2024-01-13T18:20:35.596 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.595+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=YCBP379VMKL5 type=del 2024-01-13T18:20:35.598 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.597+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=I5HXT08OI2BC type=del size=3693441 2024-01-13T18:20:35.598 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.597+0000 7f759fd04880 1 < canceled part key=_multipart_QD5GBLNCY707.2~UMWSOOE8MBCM.0 size=1048576 2024-01-13T18:20:35.599 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.598+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~UMWSOOE8MBCM.1 size=1048576 2024-01-13T18:20:35.600 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.599+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~UMWSOOE8MBCM.2 size=266067 2024-01-13T18:20:35.601 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.600+0000 7f759fd04880 1 < canceled multipart upload key=QD5GBLNCY707 upload=UMWSOOE8MBCM tag=DPB3RVL3S1GV type=write size=3411795 2024-01-13T18:20:35.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.602+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=4JAU2XI59D23 type=del size=1414661 2024-01-13T18:20:35.604 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.603+0000 7f759fd04880 1 < completed write operation key=P8FMRQR7GXN7 tag=0ZTFW90SAF18 type=write size=315386 2024-01-13T18:20:35.606 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.605+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~ZBNJ10CNR8SQ.0 size=1048576 2024-01-13T18:20:35.607 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.606+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~ZBNJ10CNR8SQ.1 size=615688 2024-01-13T18:20:35.607 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.606+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=ZBNJ10CNR8SQ tag=DTN19KM2ZGUJ type=write size=2712840 2024-01-13T18:20:35.608 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.607+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=TP6FOQ3GWTJQ type=del 2024-01-13T18:20:35.609 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.608+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=OL4QP2R31UEM type=del size=77581 2024-01-13T18:20:35.612 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.611+0000 7f759fd04880 1 < suggested remove operation key=H4VHC37BOZJ3 tag=KLT9CGMUNBSF type=del 2024-01-13T18:20:35.613 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.612+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=NL6RT320386I type=del size=2279676 2024-01-13T18:20:35.613 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.612+0000 7f759fd04880 1 < canceled part key=_multipart_2OO7S2NBZ7M6.2~2Q8Y4NAFAZ66.0 size=411018 2024-01-13T18:20:35.616 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.615+0000 7f759fd04880 1 < canceled multipart upload key=2OO7S2NBZ7M6 upload=2Q8Y4NAFAZ66 tag=V9IP0UBE3XFD type=write size=1459594 2024-01-13T18:20:35.617 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.616+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=ZUFTVEYVW2MW type=del size=2428749 2024-01-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.617+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~0VANIJ0IZ06L.0 size=1048576 2024-01-13T18:20:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:35 smithi099 ceph-mon[138788]: osdmap e1116: 8 total, 8 up, 8 in 2024-01-13T18:20:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:35 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2048264131' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171738-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:35 smithi099 ceph-mon[138788]: pgmap v1454: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.618+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~0VANIJ0IZ06L.1 size=147991 2024-01-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.620+0000 7f759fd04880 1 < completed multipart upload key=OMA1B74S8FXS upload=0VANIJ0IZ06L tag=3JXBWC6LFQBZ type=write size=2245143 2024-01-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.623+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~LAXRKBSDQ9O1.0 size=1048576 2024-01-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.624+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~LAXRKBSDQ9O1.1 size=1048576 2024-01-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.625+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~LAXRKBSDQ9O1.2 size=619959 2024-01-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.625+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=LAXRKBSDQ9O1 tag=P5TTEY3JI25Q type=write size=3765687 2024-01-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.625+0000 7f759fd04880 1 < canceled part key=_multipart_H4VHC37BOZJ3.2~I9C8DN1HYG9J.0 size=1048576 2024-01-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.626+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~I9C8DN1HYG9J.1 size=1048576 2024-01-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.627+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~I9C8DN1HYG9J.2 size=874027 2024-01-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.629+0000 7f759fd04880 1 < canceled multipart upload key=H4VHC37BOZJ3 upload=I9C8DN1HYG9J tag=RIIM1B0ED89Y type=write size=4019755 2024-01-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.630+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=QQJT7N6E61DH type=del size=1539373 2024-01-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.631+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=X4HULEY5T56J type=del 2024-01-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.634+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~60IE8ER4YOS4.0 size=1048576 2024-01-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.634+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~60IE8ER4YOS4.1 size=1048576 2024-01-13T18:20:35.636 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.635+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~60IE8ER4YOS4.2 size=570967 2024-01-13T18:20:35.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.635+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=60IE8ER4YOS4 tag=GRH10KI2824C type=write size=3716695 2024-01-13T18:20:35.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.636+0000 7f759fd04880 1 < canceled part key=_multipart_P8FMRQR7GXN7.2~I639HN9N603U.0 size=1048576 2024-01-13T18:20:35.638 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.637+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~I639HN9N603U.1 size=108102 2024-01-13T18:20:35.640 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.639+0000 7f759fd04880 1 < canceled multipart upload key=P8FMRQR7GXN7 upload=I639HN9N603U tag=0HLNSCSCVNJ1 type=write size=2205254 2024-01-13T18:20:35.641 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.640+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=G0PHQ308A63G type=del size=3702196 2024-01-13T18:20:35.641 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.640+0000 7f759fd04880 1 < canceled part key=_multipart_1O3XX67RKHNW.2~VWMRSUHKO4AN.0 size=584667 2024-01-13T18:20:35.643 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.642+0000 7f759fd04880 1 < canceled multipart upload key=1O3XX67RKHNW upload=VWMRSUHKO4AN tag=7LUP9WUWVHN7 type=write size=1633243 2024-01-13T18:20:35.644 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.643+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=U536DF7C31IY type=write size=326520 2024-01-13T18:20:35.645 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.644+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=ZM3YH7EO0IJN type=del 2024-01-13T18:20:35.647 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.646+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=CP4FSEZG3ERU type=del size=1162172 2024-01-13T18:20:35.648 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.647+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~7HNSPXFQX9BD.0 size=1048576 2024-01-13T18:20:35.649 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.648+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~7HNSPXFQX9BD.1 size=950076 2024-01-13T18:20:35.651 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.650+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=7HNSPXFQX9BD tag=E56ZXSVAGT3J type=write size=3047228 2024-01-13T18:20:35.652 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.651+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=RPS37B4C604T type=del size=3571273 2024-01-13T18:20:35.654 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.653+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~LOW42IJXCHYJ.0 size=1048576 2024-01-13T18:20:35.655 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.654+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~LOW42IJXCHYJ.1 size=214632 2024-01-13T18:20:35.656 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.656+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=LOW42IJXCHYJ tag=FMWHCFF37AAJ type=write size=2311784 2024-01-13T18:20:35.659 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.658+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~P76WAAK28P39.0 size=1048576 2024-01-13T18:20:35.660 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.659+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~P76WAAK28P39.1 size=1048576 2024-01-13T18:20:35.660 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.660+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~P76WAAK28P39.2 size=450609 2024-01-13T18:20:35.661 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.660+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=P76WAAK28P39 tag=SY3RSZQV45HG type=write size=3596337 2024-01-13T18:20:35.662 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.661+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~B36HS2PYVWAT.0 size=939220 2024-01-13T18:20:35.664 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.663+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=B36HS2PYVWAT tag=KB88LVB70G0P type=write size=1987796 2024-01-13T18:20:35.666 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.665+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~V076NK5ZADB8.0 size=1048576 2024-01-13T18:20:35.667 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.666+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~V076NK5ZADB8.1 size=1048576 2024-01-13T18:20:35.668 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.667+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~V076NK5ZADB8.2 size=580139 2024-01-13T18:20:35.668 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.667+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=V076NK5ZADB8 tag=QNYGKI70Z63F type=write size=3725867 2024-01-13T18:20:35.669 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.668+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~CMBVTCKJ7QGN.0 size=1048576 2024-01-13T18:20:35.669 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.668+0000 7f759fd04880 1 < canceled part key=_multipart_7R5YIO7UFSDZ.2~CMBVTCKJ7QGN.1 size=1048576 2024-01-13T18:20:35.670 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.669+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~CMBVTCKJ7QGN.2 size=702341 2024-01-13T18:20:35.672 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.671+0000 7f759fd04880 1 < canceled multipart upload key=7R5YIO7UFSDZ upload=CMBVTCKJ7QGN tag=M2DUULWZQMDM type=write size=3848069 2024-01-13T18:20:35.674 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.672+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=YK199S0JDD88 type=del size=147414 2024-01-13T18:20:35.674 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.674+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=I5HXT08OI2BC type=del 2024-01-13T18:20:35.676 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.675+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=VSI3LQNOUU7K type=del size=553877 2024-01-13T18:20:35.678 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.678+0000 7f759fd04880 1 < suggested update operation key=RY0W5S41XK3F tag=4JAU2XI59D23 type=del size=1414661 2024-01-13T18:20:35.680 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.679+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=ARFGYMQ95I3I type=del size=1073881 2024-01-13T18:20:35.681 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.680+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~ZBNJ10CNR8SQ.0 size=1048576 2024-01-13T18:20:35.682 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.681+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~ZBNJ10CNR8SQ.1 size=615688 2024-01-13T18:20:35.684 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.683+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=ZBNJ10CNR8SQ tag=DTN19KM2ZGUJ type=write size=2712840 2024-01-13T18:20:35.686 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.685+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~J8WQ4YYU9X7D.0 size=1048576 2024-01-13T18:20:35.687 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.686+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~J8WQ4YYU9X7D.1 size=938525 2024-01-13T18:20:35.687 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.686+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=J8WQ4YYU9X7D tag=3M8404SJ7L3F type=write size=3035677 2024-01-13T18:20:35.688 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.687+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=OL4QP2R31UEM type=del 2024-01-13T18:20:35.690 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.689+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~WR6SIAXNYUDJ.0 size=1048576 2024-01-13T18:20:35.691 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.690+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~WR6SIAXNYUDJ.1 size=1044889 2024-01-13T18:20:35.691 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.690+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=WR6SIAXNYUDJ tag=4QGKZU88MHYI type=write size=3142041 2024-01-13T18:20:35.692 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.691+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=NL6RT320386I type=del 2024-01-13T18:20:35.694 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.693+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~0UO6BNLDEQ69.0 size=1048576 2024-01-13T18:20:35.695 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.694+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~0UO6BNLDEQ69.1 size=284970 2024-01-13T18:20:35.695 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.694+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=0UO6BNLDEQ69 tag=D2L5E1M6VM2Q type=write size=2382122 2024-01-13T18:20:35.696 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.695+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=ZUFTVEYVW2MW type=del 2024-01-13T18:20:35.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.696+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=7V7IFKAA7CL5 type=del size=1601200 2024-01-13T18:20:35.698 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.697+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~LAXRKBSDQ9O1.0 size=1048576 2024-01-13T18:20:35.698 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.697+0000 7f759fd04880 1 < canceled part key=_multipart_7WRTM9ANJRT4.2~LAXRKBSDQ9O1.1 size=1048576 2024-01-13T18:20:35.699 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.698+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~LAXRKBSDQ9O1.2 size=619959 2024-01-13T18:20:35.701 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.700+0000 7f759fd04880 1 < canceled multipart upload key=7WRTM9ANJRT4 upload=LAXRKBSDQ9O1 tag=P5TTEY3JI25Q type=write size=3765687 2024-01-13T18:20:35.703 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.702+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~XWO26W1RRJYF.0 size=1048576 2024-01-13T18:20:35.704 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.703+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~XWO26W1RRJYF.1 size=1048576 2024-01-13T18:20:35.705 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.704+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~XWO26W1RRJYF.2 size=897538 2024-01-13T18:20:35.705 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.704+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=XWO26W1RRJYF tag=6KMJD093SOS5 type=write size=4043266 2024-01-13T18:20:35.707 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.706+0000 7f759fd04880 1 < suggested update operation key=H7C1UAGAUR7D tag=QQJT7N6E61DH type=del size=1539373 2024-01-13T18:20:35.709 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.708+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=SBC0FQ9GBN14 type=write size=553233 2024-01-13T18:20:35.711 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.710+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~60IE8ER4YOS4.0 size=1048576 2024-01-13T18:20:35.712 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.711+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~60IE8ER4YOS4.1 size=1048576 2024-01-13T18:20:35.713 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.712+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~60IE8ER4YOS4.2 size=570967 2024-01-13T18:20:35.715 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.714+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=60IE8ER4YOS4 tag=GRH10KI2824C type=write size=3716695 2024-01-13T18:20:35.716 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.715+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=W1ZJN3R2TRGL type=del size=2816785 2024-01-13T18:20:35.717 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.716+0000 7f759fd04880 1 < canceled operation key=WSRJB811XCVL tag=G0PHQ308A63G type=del size=3702196 2024-01-13T18:20:35.719 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.718+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=SZ32BKP8HOBT type=write size=716409 2024-01-13T18:20:35.721 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.720+0000 7f759fd04880 1 < suggested update operation key=JN46AMLYHN8E tag=U536DF7C31IY type=write size=326520 2024-01-13T18:20:35.723 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.722+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~P7GV9FDVJOJU.0 size=1048576 2024-01-13T18:20:35.724 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.723+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~P7GV9FDVJOJU.1 size=1048576 2024-01-13T18:20:35.725 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.724+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~P7GV9FDVJOJU.2 size=691484 2024-01-13T18:20:35.725 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.724+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=P7GV9FDVJOJU tag=AKQ8K455WXXA type=write size=3837212 2024-01-13T18:20:35.726 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.725+0000 7f759fd04880 1 < canceled operation key=QKNPXHB99KVP tag=CP4FSEZG3ERU type=del size=1162172 2024-01-13T18:20:35.729 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.728+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~D32S1AOJLA4R.0 size=336455 2024-01-13T18:20:35.729 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.728+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=D32S1AOJLA4R tag=3JF226EEMQA9 type=write size=1385031 2024-01-13T18:20:35.731 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.730+0000 7f759fd04880 1 < suggested update operation key=7R5YIO7UFSDZ tag=RPS37B4C604T type=del size=3571273 2024-01-13T18:20:35.732 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.731+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=LDD705E6DW68 type=del size=2430632 2024-01-13T18:20:35.733 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.732+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~P76WAAK28P39.0 size=1048576 2024-01-13T18:20:35.734 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.733+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~P76WAAK28P39.1 size=1048576 2024-01-13T18:20:35.735 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.734+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~P76WAAK28P39.2 size=450609 2024-01-13T18:20:35.740 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.736+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=P76WAAK28P39 tag=SY3RSZQV45HG type=write size=3596337 2024-01-13T18:20:35.740 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.738+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=I436NQHSMO5K type=del size=1317855 2024-01-13T18:20:35.740 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.739+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~V076NK5ZADB8.0 size=1048576 2024-01-13T18:20:35.741 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.740+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~V076NK5ZADB8.1 size=1048576 2024-01-13T18:20:35.742 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.741+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~V076NK5ZADB8.2 size=580139 2024-01-13T18:20:35.746 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.743+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=V076NK5ZADB8 tag=QNYGKI70Z63F type=write size=3725867 2024-01-13T18:20:35.746 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.744+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=N7KK7Q2L8O5A type=del size=3720126 2024-01-13T18:20:35.747 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.746+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=YK199S0JDD88 type=del 2024-01-13T18:20:35.748 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.747+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=4O23IYZHUSAR type=del size=2562087 2024-01-13T18:20:35.749 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.748+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=VSI3LQNOUU7K type=del 2024-01-13T18:20:35.752 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.751+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~IDK2FBJR9P2H.0 size=1048576 2024-01-13T18:20:35.753 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.752+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~IDK2FBJR9P2H.1 size=1048576 2024-01-13T18:20:35.754 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.753+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~IDK2FBJR9P2H.2 size=971711 2024-01-13T18:20:35.754 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.753+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=IDK2FBJR9P2H tag=7UIPRZY4KSFV type=write size=4117439 2024-01-13T18:20:35.755 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.754+0000 7f759fd04880 1 < completed delete operation key=QKNPXHB99KVP tag=ARFGYMQ95I3I type=del 2024-01-13T18:20:35.756 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.755+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=UWV26SDJ0KTO type=write size=524270 2024-01-13T18:20:35.757 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.756+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~J8WQ4YYU9X7D.0 size=1048576 2024-01-13T18:20:35.758 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.757+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~J8WQ4YYU9X7D.1 size=938525 2024-01-13T18:20:35.760 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.759+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=J8WQ4YYU9X7D tag=3M8404SJ7L3F type=write size=3035677 2024-01-13T18:20:35.763 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.762+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~Q9ZN4B5OP2KN.0 size=594776 2024-01-13T18:20:35.763 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.762+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=Q9ZN4B5OP2KN tag=O7A51LFI7643 type=write size=1643352 2024-01-13T18:20:35.764 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.763+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~WR6SIAXNYUDJ.0 size=1048576 2024-01-13T18:20:35.765 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.764+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~WR6SIAXNYUDJ.1 size=1044889 2024-01-13T18:20:35.767 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.766+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=WR6SIAXNYUDJ tag=4QGKZU88MHYI type=write size=3142041 2024-01-13T18:20:35.769 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.768+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~UAWLS2XAANVW.0 size=67753 2024-01-13T18:20:35.769 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.768+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=UAWLS2XAANVW tag=ACCBY14IDVW9 type=write size=1116329 2024-01-13T18:20:35.771 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.770+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~0UO6BNLDEQ69.0 size=1048576 2024-01-13T18:20:35.772 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.771+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~0UO6BNLDEQ69.1 size=284970 2024-01-13T18:20:35.775 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.773+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=0UO6BNLDEQ69 tag=D2L5E1M6VM2Q type=write size=2382122 2024-01-13T18:20:35.776 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.775+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~I8KV75HMLIA1.0 size=1048576 2024-01-13T18:20:35.777 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.776+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~I8KV75HMLIA1.1 size=922801 2024-01-13T18:20:35.777 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.776+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=I8KV75HMLIA1 tag=36UTY9I7VL0F type=write size=3019953 2024-01-13T18:20:35.778 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.777+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=7V7IFKAA7CL5 type=del 2024-01-13T18:20:35.781 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.780+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~2ALO0IRKPQ7A.0 size=1048576 2024-01-13T18:20:35.782 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.781+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~2ALO0IRKPQ7A.1 size=519028 2024-01-13T18:20:35.782 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.781+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=2ALO0IRKPQ7A tag=YG4MRBJIWQ8Z type=write size=2616180 2024-01-13T18:20:35.783 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.782+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~XWO26W1RRJYF.0 size=1048576 2024-01-13T18:20:35.784 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.783+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~XWO26W1RRJYF.1 size=1048576 2024-01-13T18:20:35.785 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.784+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~XWO26W1RRJYF.2 size=897538 2024-01-13T18:20:35.788 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.787+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=XWO26W1RRJYF tag=6KMJD093SOS5 type=write size=4043266 2024-01-13T18:20:35.789 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.788+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=AK93CDDQ2CQ9 type=del size=4166062 2024-01-13T18:20:35.791 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.790+0000 7f759fd04880 1 < suggested remove operation key=0TIZPXX8CMHA tag=SBC0FQ9GBN14 type=write 2024-01-13T18:20:35.794 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.793+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~FNXXLDS2CDYJ.0 size=1048576 2024-01-13T18:20:35.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.794+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~FNXXLDS2CDYJ.1 size=572245 2024-01-13T18:20:35.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.794+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=FNXXLDS2CDYJ tag=SW4XJUOHMUW3 type=write size=2669397 2024-01-13T18:20:35.796 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.795+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=W1ZJN3R2TRGL type=del 2024-01-13T18:20:35.798 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.797+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=OP716F3E9TFV type=del size=2062835 2024-01-13T18:20:35.799 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.798+0000 7f759fd04880 1 < completed write operation key=QD5GBLNCY707 tag=SZ32BKP8HOBT type=write size=716409 2024-01-13T18:20:35.800 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.799+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=W33YH48CTUEW type=write size=789524 2024-01-13T18:20:35.801 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.800+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~P7GV9FDVJOJU.0 size=1048576 2024-01-13T18:20:35.801 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.800+0000 7f759fd04880 1 < canceled part key=_multipart_P8FMRQR7GXN7.2~P7GV9FDVJOJU.1 size=1048576 2024-01-13T18:20:35.802 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.801+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~P7GV9FDVJOJU.2 size=691484 2024-01-13T18:20:35.804 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.803+0000 7f759fd04880 1 < canceled multipart upload key=P8FMRQR7GXN7 upload=P7GV9FDVJOJU tag=AKQ8K455WXXA type=write size=3837212 2024-01-13T18:20:35.806 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.805+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~DRLUBBNNU1Q0.0 size=627700 2024-01-13T18:20:35.806 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.805+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=DRLUBBNNU1Q0 tag=E77JP435960I type=write size=1676276 2024-01-13T18:20:35.808 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.807+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~D32S1AOJLA4R.0 size=336455 2024-01-13T18:20:35.810 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.809+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=D32S1AOJLA4R tag=3JF226EEMQA9 type=write size=1385031 2024-01-13T18:20:35.812 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.811+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~KW3YFX2OR45T.0 size=1048576 2024-01-13T18:20:35.813 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.812+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~KW3YFX2OR45T.1 size=1048576 2024-01-13T18:20:35.814 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.813+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~KW3YFX2OR45T.2 size=960246 2024-01-13T18:20:35.814 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.813+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=KW3YFX2OR45T tag=LI4F20GO1DIN type=write size=4105974 2024-01-13T18:20:35.815 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.814+0000 7f759fd04880 1 < completed delete operation key=1YNH6QHP354U tag=LDD705E6DW68 type=del 2024-01-13T18:20:35.817 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.816+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~ZMBJY0M24FVQ.0 size=1048576 2024-01-13T18:20:35.818 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.817+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~ZMBJY0M24FVQ.1 size=1048576 2024-01-13T18:20:35.819 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.818+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~ZMBJY0M24FVQ.2 size=814675 2024-01-13T18:20:35.819 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.818+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=ZMBJY0M24FVQ tag=AA81WS6V2BAC type=write size=3960403 2024-01-13T18:20:35.821 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.820+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=I436NQHSMO5K type=del 2024-01-13T18:20:35.822 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.821+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=4P8ULGCM5COF type=del size=669463 2024-01-13T18:20:35.823 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.822+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=N7KK7Q2L8O5A type=del 2024-01-13T18:20:35.826 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.825+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~BJ9T6UYWLHFI.0 size=1048576 2024-01-13T18:20:35.827 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.826+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~BJ9T6UYWLHFI.1 size=1048576 2024-01-13T18:20:35.828 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.827+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~BJ9T6UYWLHFI.2 size=336192 2024-01-13T18:20:35.828 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.827+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=BJ9T6UYWLHFI tag=MK3MVIF9FPXF type=write size=3481920 2024-01-13T18:20:35.830 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.829+0000 7f759fd04880 1 < suggested update operation key=2OO7S2NBZ7M6 tag=4O23IYZHUSAR type=del size=2562087 2024-01-13T18:20:35.832 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.831+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=V9ZUG3ARU1OQ type=del size=566571 2024-01-13T18:20:35.833 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.832+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~IDK2FBJR9P2H.0 size=1048576 2024-01-13T18:20:35.834 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.833+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~IDK2FBJR9P2H.1 size=1048576 2024-01-13T18:20:35.835 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.834+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~IDK2FBJR9P2H.2 size=971711 2024-01-13T18:20:35.837 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.836+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=IDK2FBJR9P2H tag=7UIPRZY4KSFV type=write size=4117439 2024-01-13T18:20:35.839 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.838+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=4BI6RM803C2C type=write size=575952 2024-01-13T18:20:35.840 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.839+0000 7f759fd04880 1 < completed write operation key=JN46AMLYHN8E tag=UWV26SDJ0KTO type=write size=524270 2024-01-13T18:20:35.841 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.840+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=DZ5KGS0G3HOY type=del size=3320756 2024-01-13T18:20:35.842 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.842+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~Q9ZN4B5OP2KN.0 size=594776 2024-01-13T18:20:35.845 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.844+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=Q9ZN4B5OP2KN tag=O7A51LFI7643 type=write size=1643352 2024-01-13T18:20:35.846 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.845+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=BH2AJ8GYQUX2 type=del size=2855441 2024-01-13T18:20:35.847 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.846+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~UAWLS2XAANVW.0 size=67753 2024-01-13T18:20:35.850 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.849+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=UAWLS2XAANVW tag=ACCBY14IDVW9 type=write size=1116329 2024-01-13T18:20:35.851 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.850+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=EXZF8IPS6ZDT type=del size=3735565 2024-01-13T18:20:35.852 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.851+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~I8KV75HMLIA1.0 size=1048576 2024-01-13T18:20:35.853 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.852+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~I8KV75HMLIA1.1 size=922801 2024-01-13T18:20:35.855 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.854+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=I8KV75HMLIA1 tag=36UTY9I7VL0F type=write size=3019953 2024-01-13T18:20:35.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.856+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~QJV275WKKF2T.0 size=1048576 2024-01-13T18:20:35.858 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.857+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~QJV275WKKF2T.1 size=1048576 2024-01-13T18:20:35.859 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.858+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~QJV275WKKF2T.2 size=176238 2024-01-13T18:20:35.859 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.858+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=QJV275WKKF2T tag=6B732XI059SJ type=write size=3321966 2024-01-13T18:20:35.860 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.859+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~2ALO0IRKPQ7A.0 size=1048576 2024-01-13T18:20:35.861 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.860+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~2ALO0IRKPQ7A.1 size=519028 2024-01-13T18:20:35.863 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.862+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=2ALO0IRKPQ7A tag=YG4MRBJIWQ8Z type=write size=2616180 2024-01-13T18:20:35.866 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.865+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~O9OIBIYRBT1P.0 size=674742 2024-01-13T18:20:35.866 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.865+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=O9OIBIYRBT1P tag=A1A6II0YMAHO type=write size=1723318 2024-01-13T18:20:35.867 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.866+0000 7f759fd04880 1 < canceled operation key=1YNH6QHP354U tag=AK93CDDQ2CQ9 type=del size=4166062 2024-01-13T18:20:35.870 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.869+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~Q1F1ZYL14HT8.0 size=1048576 2024-01-13T18:20:35.871 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.870+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~Q1F1ZYL14HT8.1 size=1048576 2024-01-13T18:20:35.872 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.871+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~Q1F1ZYL14HT8.2 size=868159 2024-01-13T18:20:35.872 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.871+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=Q1F1ZYL14HT8 tag=T9INYYJFEZ7T type=write size=4013887 2024-01-13T18:20:35.873 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.872+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~FNXXLDS2CDYJ.0 size=1048576 2024-01-13T18:20:35.874 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.873+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~FNXXLDS2CDYJ.1 size=572245 2024-01-13T18:20:35.876 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.875+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=FNXXLDS2CDYJ tag=SW4XJUOHMUW3 type=write size=2669397 2024-01-13T18:20:35.879 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.877+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~J3X95D1RB7A5.0 size=342906 2024-01-13T18:20:35.879 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.877+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=J3X95D1RB7A5 tag=PT91IHT7RHJ1 type=write size=1391482 2024-01-13T18:20:35.880 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.879+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=OP716F3E9TFV type=del 2024-01-13T18:20:35.881 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.880+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=76BIGA7VU7DZ type=del size=320215 2024-01-13T18:20:35.882 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.881+0000 7f759fd04880 1 < completed write operation key=7R5YIO7UFSDZ tag=W33YH48CTUEW type=write size=789524 2024-01-13T18:20:35.883 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.882+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=STMCKO1ZIQG9 type=del size=3426131 2024-01-13T18:20:35.883 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.882+0000 7f759fd04880 1 < canceled part key=_multipart_1O3XX67RKHNW.2~DRLUBBNNU1Q0.0 size=627700 2024-01-13T18:20:35.886 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.885+0000 7f759fd04880 1 < canceled multipart upload key=1O3XX67RKHNW upload=DRLUBBNNU1Q0 tag=E77JP435960I type=write size=1676276 2024-01-13T18:20:35.888 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.887+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~Y3D08PFKAQTG.0 size=1048576 2024-01-13T18:20:35.889 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.888+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~Y3D08PFKAQTG.1 size=117927 2024-01-13T18:20:35.889 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.888+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=Y3D08PFKAQTG tag=J9BUZAWCQN5Q type=write size=2215079 2024-01-13T18:20:35.890 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.889+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~KW3YFX2OR45T.0 size=1048576 2024-01-13T18:20:35.891 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.890+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~KW3YFX2OR45T.1 size=1048576 2024-01-13T18:20:35.892 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.891+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~KW3YFX2OR45T.2 size=960246 2024-01-13T18:20:35.894 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.893+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=KW3YFX2OR45T tag=LI4F20GO1DIN type=write size=4105974 2024-01-13T18:20:35.896 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.895+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~V6OZPM6ORVK0.0 size=1048576 2024-01-13T18:20:35.897 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.896+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~V6OZPM6ORVK0.1 size=280455 2024-01-13T18:20:35.897 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.896+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=V6OZPM6ORVK0 tag=NG4RB45S81O8 type=write size=2377607 2024-01-13T18:20:35.898 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.897+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~ZMBJY0M24FVQ.0 size=1048576 2024-01-13T18:20:35.899 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.898+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~ZMBJY0M24FVQ.1 size=1048576 2024-01-13T18:20:35.900 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.899+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~ZMBJY0M24FVQ.2 size=814675 2024-01-13T18:20:35.902 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.901+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=ZMBJY0M24FVQ tag=AA81WS6V2BAC type=write size=3960403 2024-01-13T18:20:35.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.903+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=MGLR6GBG578M type=del size=98999 2024-01-13T18:20:35.905 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.904+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=4P8ULGCM5COF type=del 2024-01-13T18:20:35.906 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.905+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=IE5BSI9B50W2 type=del size=1998089 2024-01-13T18:20:35.908 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.907+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~BJ9T6UYWLHFI.0 size=1048576 2024-01-13T18:20:35.908 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.907+0000 7f759fd04880 1 < canceled part key=_multipart_QS9PLJKINY4R.2~BJ9T6UYWLHFI.1 size=1048576 2024-01-13T18:20:35.909 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.908+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~BJ9T6UYWLHFI.2 size=336192 2024-01-13T18:20:35.911 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.910+0000 7f759fd04880 1 < canceled multipart upload key=QS9PLJKINY4R upload=BJ9T6UYWLHFI tag=MK3MVIF9FPXF type=write size=3481920 2024-01-13T18:20:35.912 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.911+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=UMQI702MYAPG type=del size=1815665 2024-01-13T18:20:35.913 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.912+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=V9ZUG3ARU1OQ type=del 2024-01-13T18:20:35.916 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.915+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~K2PHS2YZLGYR.0 size=1048576 2024-01-13T18:20:35.917 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.916+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~K2PHS2YZLGYR.1 size=1048576 2024-01-13T18:20:35.918 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.917+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~K2PHS2YZLGYR.2 size=773307 2024-01-13T18:20:35.918 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.917+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=K2PHS2YZLGYR tag=GZZF6IQ2EN0I type=write size=3919035 2024-01-13T18:20:35.921 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.920+0000 7f759fd04880 1 < suggested remove operation key=JGALONWJXLQY tag=4BI6RM803C2C type=write 2024-01-13T18:20:35.922 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.921+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=2NMAU3AF551E type=del size=1221017 2024-01-13T18:20:35.924 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.924+0000 7f759fd04880 1 < suggested update operation key=1QEZO616DBC3 tag=DZ5KGS0G3HOY type=del size=3320756 2024-01-13T18:20:35.926 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.925+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=FQAWSDSDVGG8 type=del size=3386007 2024-01-13T18:20:35.928 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.927+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=BH2AJ8GYQUX2 type=del 2024-01-13T18:20:35.930 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.929+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=I3RTUUO4B1YR type=del size=2363486 2024-01-13T18:20:35.932 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.931+0000 7f759fd04880 1 < suggested remove operation key=7WRTM9ANJRT4 tag=EXZF8IPS6ZDT type=del 2024-01-13T18:20:35.933 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.932+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=XB3KAYMV6SHB type=del size=1936595 2024-01-13T18:20:35.935 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.934+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~QJV275WKKF2T.0 size=1048576 2024-01-13T18:20:35.936 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.935+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~QJV275WKKF2T.1 size=1048576 2024-01-13T18:20:35.937 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.936+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~QJV275WKKF2T.2 size=176238 2024-01-13T18:20:35.939 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.938+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=QJV275WKKF2T tag=6B732XI059SJ type=write size=3321966 2024-01-13T18:20:35.940 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.939+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=EFY5892FPOAS type=write size=290194 2024-01-13T18:20:35.941 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.940+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~O9OIBIYRBT1P.0 size=674742 2024-01-13T18:20:35.944 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.942+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=O9OIBIYRBT1P tag=A1A6II0YMAHO type=write size=1723318 2024-01-13T18:20:35.948 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.943+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=UJYJCI8CEI7V type=del size=3632277 2024-01-13T18:20:35.948 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.945+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~Q1F1ZYL14HT8.0 size=1048576 2024-01-13T18:20:35.948 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.946+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~Q1F1ZYL14HT8.1 size=1048576 2024-01-13T18:20:35.948 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.947+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~Q1F1ZYL14HT8.2 size=868159 2024-01-13T18:20:35.950 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.949+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=Q1F1ZYL14HT8 tag=T9INYYJFEZ7T type=write size=4013887 2024-01-13T18:20:35.952 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.951+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~UGBK4XK8FDZZ.0 size=1048576 2024-01-13T18:20:35.953 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.952+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~UGBK4XK8FDZZ.1 size=686542 2024-01-13T18:20:35.953 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.952+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=UGBK4XK8FDZZ tag=2R1SN7OGDREF type=write size=2783694 2024-01-13T18:20:35.954 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.953+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~J3X95D1RB7A5.0 size=342906 2024-01-13T18:20:35.957 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.956+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=J3X95D1RB7A5 tag=PT91IHT7RHJ1 type=write size=1391482 2024-01-13T18:20:35.958 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.957+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=CYV66OQNJF3V type=del size=2105202 2024-01-13T18:20:35.959 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.958+0000 7f759fd04880 -1 < no bi entry to suggest for operation key=JGALONWJXLQY tag=76BIGA7VU7DZ type=del size=320215: (2) No such file or directory 2024-01-13T18:20:35.960 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.959+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=95CEBSLYNGOQ type=del size=764292 2024-01-13T18:20:35.961 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.960+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=STMCKO1ZIQG9 type=del 2024-01-13T18:20:35.963 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.962+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=77WA0REU6YMM type=del size=1211265 2024-01-13T18:20:35.964 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.963+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~Y3D08PFKAQTG.0 size=1048576 2024-01-13T18:20:35.965 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.964+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~Y3D08PFKAQTG.1 size=117927 2024-01-13T18:20:35.967 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.966+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=Y3D08PFKAQTG tag=J9BUZAWCQN5Q type=write size=2215079 2024-01-13T18:20:35.969 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.968+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~J5Y6O5P5OHJH.0 size=1048576 2024-01-13T18:20:35.970 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.969+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~J5Y6O5P5OHJH.1 size=1048576 2024-01-13T18:20:35.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.970+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~J5Y6O5P5OHJH.2 size=223366 2024-01-13T18:20:35.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.970+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=J5Y6O5P5OHJH tag=NFXIJOCJFVAV type=write size=3369094 2024-01-13T18:20:35.972 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.971+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~V6OZPM6ORVK0.0 size=1048576 2024-01-13T18:20:35.973 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.972+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~V6OZPM6ORVK0.1 size=280455 2024-01-13T18:20:35.976 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.974+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=V6OZPM6ORVK0 tag=NG4RB45S81O8 type=write size=2377607 2024-01-13T18:20:35.976 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.975+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=0W84Z2I1XK9P type=del size=3986935 2024-01-13T18:20:35.978 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.977+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=MGLR6GBG578M type=del 2024-01-13T18:20:35.979 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.978+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=QQVQZ98930B2 type=del size=1110998 2024-01-13T18:20:35.982 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.981+0000 7f759fd04880 1 < suggested update operation key=RY0W5S41XK3F tag=IE5BSI9B50W2 type=del size=1998089 2024-01-13T18:20:35.983 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.982+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=O5WQVJJ58VYR type=del size=1388873 2024-01-13T18:20:35.984 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.983+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=UMQI702MYAPG type=del 2024-01-13T18:20:35.986 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.985+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=WCCMWQKGJOB0 type=del size=1189616 2024-01-13T18:20:35.987 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.986+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~K2PHS2YZLGYR.0 size=1048576 2024-01-13T18:20:35.988 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.987+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~K2PHS2YZLGYR.1 size=1048576 2024-01-13T18:20:35.989 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.988+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~K2PHS2YZLGYR.2 size=773307 2024-01-13T18:20:35.991 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.990+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=K2PHS2YZLGYR tag=GZZF6IQ2EN0I type=write size=3919035 2024-01-13T18:20:35.994 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.993+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~LUP5E1WOJ0OO.0 size=1048576 2024-01-13T18:20:35.995 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.994+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~LUP5E1WOJ0OO.1 size=1048576 2024-01-13T18:20:35.996 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.995+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~LUP5E1WOJ0OO.2 size=795595 2024-01-13T18:20:35.996 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.995+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=LUP5E1WOJ0OO tag=UD2ZJ3S1LU61 type=write size=3941323 2024-01-13T18:20:35.997 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.996+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=2NMAU3AF551E type=del 2024-01-13T18:20:35.999 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.998+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~NMI8152MWBGG.0 size=1048576 2024-01-13T18:20:36.000 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.999+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~NMI8152MWBGG.1 size=766877 2024-01-13T18:20:36.000 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:35.999+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=NMI8152MWBGG tag=W65ACBBKO2ND type=write size=2864029 2024-01-13T18:20:36.002 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.001+0000 7f759fd04880 1 < canceled operation key=1QEZO616DBC3 tag=FQAWSDSDVGG8 type=del size=3386007 2024-01-13T18:20:36.003 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.002+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=CN7VOXKXXB4X type=del size=3441424 2024-01-13T18:20:36.005 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.004+0000 7f759fd04880 1 < suggested update operation key=VZHGQM6ZNJYQ tag=I3RTUUO4B1YR type=del size=2363486 2024-01-13T18:20:36.006 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.006+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=0Q410MY15JOK type=del size=152225 2024-01-13T18:20:36.008 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.007+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=XB3KAYMV6SHB type=del 2024-01-13T18:20:36.009 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.008+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=XJAR1XK16N4P type=del size=4105272 2024-01-13T18:20:36.011 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.010+0000 7f759fd04880 1 < suggested update operation key=EW3ZFDVIQZ7G tag=EFY5892FPOAS type=write size=290194 2024-01-13T18:20:36.014 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.013+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~CH6BD7OQMBX8.0 size=1048576 2024-01-13T18:20:36.015 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.014+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~CH6BD7OQMBX8.1 size=956266 2024-01-13T18:20:36.015 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.014+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=CH6BD7OQMBX8 tag=1TPXMQ5B85LQ type=write size=3053418 2024-01-13T18:20:36.016 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.015+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=UJYJCI8CEI7V type=del 2024-01-13T18:20:36.019 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.016+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=6ARCYRQ58KI1 type=del size=731267 2024-01-13T18:20:36.019 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.018+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~UGBK4XK8FDZZ.0 size=1048576 2024-01-13T18:20:36.019 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.018+0000 7f759fd04880 1 < canceled part key=_multipart_H4VHC37BOZJ3.2~UGBK4XK8FDZZ.1 size=686542 2024-01-13T18:20:36.021 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.020+0000 7f759fd04880 1 < canceled multipart upload key=H4VHC37BOZJ3 upload=UGBK4XK8FDZZ tag=2R1SN7OGDREF type=write size=2783694 2024-01-13T18:20:36.022 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.021+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=5K2R9S1995LC type=write size=805836 2024-01-13T18:20:36.023 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.022+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=CYV66OQNJF3V type=del 2024-01-13T18:20:36.025 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.024+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=WQLX1UI35JPV type=del size=1258951 2024-01-13T18:20:36.026 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.025+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=95CEBSLYNGOQ type=del 2024-01-13T18:20:36.029 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.028+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~HDZM75H3V3IP.0 size=1048576 2024-01-13T18:20:36.030 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.029+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~HDZM75H3V3IP.1 size=1048576 2024-01-13T18:20:36.031 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.030+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~HDZM75H3V3IP.2 size=1002683 2024-01-13T18:20:36.031 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.030+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=HDZM75H3V3IP tag=Y2IKR5TN9B5F type=write size=4148411 2024-01-13T18:20:36.032 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.031+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=77WA0REU6YMM type=del 2024-01-13T18:20:36.034 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.032+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=KM7XSCYT6QEP type=del size=4116174 2024-01-13T18:20:36.035 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.034+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~J5Y6O5P5OHJH.0 size=1048576 2024-01-13T18:20:36.036 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.035+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~J5Y6O5P5OHJH.1 size=1048576 2024-01-13T18:20:36.037 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.036+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~J5Y6O5P5OHJH.2 size=223366 2024-01-13T18:20:36.039 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.038+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=J5Y6O5P5OHJH tag=NFXIJOCJFVAV type=write size=3369094 2024-01-13T18:20:36.040 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.039+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=W2JE9A3G34EL type=del size=2996489 2024-01-13T18:20:36.042 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.041+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=0W84Z2I1XK9P type=del 2024-01-13T18:20:36.043 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.042+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=T1SMINIJ51ZP type=del size=1413789 2024-01-13T18:20:36.046 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.045+0000 7f759fd04880 1 < suggested update operation key=1O3XX67RKHNW tag=QQVQZ98930B2 type=del size=1110998 2024-01-13T18:20:36.047 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.046+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=AVJN8ALFYBIT type=del size=2482232 2024-01-13T18:20:36.049 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.048+0000 7f759fd04880 1 < suggested update operation key=QD5GBLNCY707 tag=O5WQVJJ58VYR type=del size=1388873 2024-01-13T18:20:36.051 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.050+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=K5Z7CKKPLCRK type=del size=1189268 2024-01-13T18:20:36.053 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.052+0000 7f759fd04880 1 < suggested remove operation key=1O3XX67RKHNW tag=WCCMWQKGJOB0 type=del 2024-01-13T18:20:36.055 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.054+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~WUW6FIGP463B.0 size=114974 2024-01-13T18:20:36.055 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.054+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=WUW6FIGP463B tag=9BMDNIEGXPE7 type=write size=1163550 2024-01-13T18:20:36.057 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.056+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~LUP5E1WOJ0OO.0 size=1048576 2024-01-13T18:20:36.058 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.057+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~LUP5E1WOJ0OO.1 size=1048576 2024-01-13T18:20:36.059 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.058+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~LUP5E1WOJ0OO.2 size=795595 2024-01-13T18:20:36.061 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.060+0000 7f759fd04880 1 < completed multipart upload key=7R5YIO7UFSDZ upload=LUP5E1WOJ0OO tag=UD2ZJ3S1LU61 type=write size=3941323 2024-01-13T18:20:36.062 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.061+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=NT2EV55P9LOK type=del size=81911 2024-01-13T18:20:36.064 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.063+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~NMI8152MWBGG.0 size=1048576 2024-01-13T18:20:36.064 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.063+0000 7f759fd04880 1 < canceled part key=_multipart_RY0W5S41XK3F.2~NMI8152MWBGG.1 size=766877 2024-01-13T18:20:36.066 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.065+0000 7f759fd04880 1 < canceled multipart upload key=RY0W5S41XK3F upload=NMI8152MWBGG tag=W65ACBBKO2ND type=write size=2864029 2024-01-13T18:20:36.068 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.068+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~7GWEM113E9A4.0 size=186209 2024-01-13T18:20:36.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.068+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=7GWEM113E9A4 tag=U6U6XOEEW6S6 type=write size=1234785 2024-01-13T18:20:36.071 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.070+0000 7f759fd04880 1 < suggested remove operation key=1WSQNY2NDY3K tag=CN7VOXKXXB4X type=del 2024-01-13T18:20:36.072 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.071+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=7E5EB9U3ZN85 type=del size=3025630 2024-01-13T18:20:36.073 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.072+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=0Q410MY15JOK type=del 2024-01-13T18:20:36.075 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.074+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=Z4GD3DGDMKFE type=del size=882207 2024-01-13T18:20:36.077 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.076+0000 7f759fd04880 1 < suggested update operation key=H7C1UAGAUR7D tag=XJAR1XK16N4P type=del size=4105272 2024-01-13T18:20:36.079 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.078+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=SYKLLO1QL8UJ type=write size=699612 2024-01-13T18:20:36.080 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.079+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~CH6BD7OQMBX8.0 size=1048576 2024-01-13T18:20:36.081 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.080+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~CH6BD7OQMBX8.1 size=956266 2024-01-13T18:20:36.083 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.082+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=CH6BD7OQMBX8 tag=1TPXMQ5B85LQ type=write size=3053418 2024-01-13T18:20:36.084 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.083+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=C8MR0X9V5LVX type=del size=2459086 2024-01-13T18:20:36.085 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.084+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=6ARCYRQ58KI1 type=del 2024-01-13T18:20:36.088 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.087+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~AEKA7MYW1GED.0 size=1048576 2024-01-13T18:20:36.088 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.088+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~AEKA7MYW1GED.1 size=865935 2024-01-13T18:20:36.089 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.088+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=AEKA7MYW1GED tag=6IQ01ST2GO7X type=write size=2963087 2024-01-13T18:20:36.091 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.090+0000 7f759fd04880 1 < suggested update operation key=H7C1UAGAUR7D tag=5K2R9S1995LC type=write size=805836 2024-01-13T18:20:36.092 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.091+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=2LT9MABJO7D8 type=del size=1814765 2024-01-13T18:20:36.094 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.093+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=WQLX1UI35JPV type=del 2024-01-13T18:20:36.095 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.094+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=SBLGN1FRQK3Q type=write size=256374 2024-01-13T18:20:36.096 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.095+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~HDZM75H3V3IP.0 size=1048576 2024-01-13T18:20:36.096 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.095+0000 7f759fd04880 1 < canceled part key=_multipart_0TIZPXX8CMHA.2~HDZM75H3V3IP.1 size=1048576 2024-01-13T18:20:36.097 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.096+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~HDZM75H3V3IP.2 size=1002683 2024-01-13T18:20:36.099 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.098+0000 7f759fd04880 1 < canceled multipart upload key=0TIZPXX8CMHA upload=HDZM75H3V3IP tag=Y2IKR5TN9B5F type=write size=4148411 2024-01-13T18:20:36.100 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.099+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=KOQUZBPRD1EL type=del size=1864795 2024-01-13T18:20:36.101 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.100+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=KM7XSCYT6QEP type=del 2024-01-13T18:20:36.103 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.102+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~CYNWVCEYWKGX.0 size=1048576 2024-01-13T18:20:36.104 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.103+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~CYNWVCEYWKGX.1 size=999470 2024-01-13T18:20:36.105 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.103+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=CYNWVCEYWKGX tag=1IFAWIXVL6FL type=write size=3096622 2024-01-13T18:20:36.107 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.106+0000 7f759fd04880 1 < suggested remove operation key=6GOU0WSHKUQ0 tag=W2JE9A3G34EL type=del 2024-01-13T18:20:36.108 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.107+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=2ENINMHJZJ49 type=del size=3351972 2024-01-13T18:20:36.109 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.108+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=T1SMINIJ51ZP type=del 2024-01-13T18:20:36.110 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.109+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=4BELFSUNMHBE type=del size=2410120 2024-01-13T18:20:36.112 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.111+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=AVJN8ALFYBIT type=del 2024-01-13T18:20:36.114 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.113+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=SMWEXDGL7BXE type=del size=3469488 2024-01-13T18:20:36.115 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.114+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=K5Z7CKKPLCRK type=del 2024-01-13T18:20:36.117 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.116+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=VJOSXD4M6996 type=del size=1632781 2024-01-13T18:20:36.118 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.117+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~WUW6FIGP463B.0 size=114974 2024-01-13T18:20:36.121 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.119+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=WUW6FIGP463B tag=9BMDNIEGXPE7 type=write size=1163550 2024-01-13T18:20:36.122 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.121+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=WB6F08XM1VTA type=del size=3579058 2024-01-13T18:20:36.123 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.123+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=NT2EV55P9LOK type=del 2024-01-13T18:20:36.126 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.125+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~LE681FEOYNXA.0 size=426298 2024-01-13T18:20:36.127 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.125+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=LE681FEOYNXA tag=OLC8P46OTX0I type=write size=1474874 2024-01-13T18:20:36.129 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.127+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~7GWEM113E9A4.0 size=186209 2024-01-13T18:20:36.131 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.130+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=7GWEM113E9A4 tag=U6U6XOEEW6S6 type=write size=1234785 2024-01-13T18:20:36.133 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.132+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=12427A5197PJ type=del size=1162568 2024-01-13T18:20:36.134 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.133+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=7E5EB9U3ZN85 type=del 2024-01-13T18:20:36.135 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.134+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=CWUYHJWEC9IR type=del size=2870167 2024-01-13T18:20:36.137 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.136+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=Z4GD3DGDMKFE type=del 2024-01-13T18:20:36.138 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.137+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=XL4GXLTY0YFW type=del size=964555 2024-01-13T18:20:36.139 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.138+0000 7f759fd04880 1 < completed write operation key=H972TC5DOMHL tag=SYKLLO1QL8UJ type=write size=699612 2024-01-13T18:20:36.141 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.140+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=LGXOLH2HGF42 type=del size=2537334 2024-01-13T18:20:36.142 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.141+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=C8MR0X9V5LVX type=del 2024-01-13T18:20:36.145 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.144+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~1TPNS3DDYLMQ.0 size=1048576 2024-01-13T18:20:36.146 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.145+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~1TPNS3DDYLMQ.1 size=1048576 2024-01-13T18:20:36.147 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.146+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~1TPNS3DDYLMQ.2 size=527638 2024-01-13T18:20:36.147 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.146+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=1TPNS3DDYLMQ tag=QM1XZH8SNFBY type=write size=3673366 2024-01-13T18:20:36.148 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.147+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~AEKA7MYW1GED.0 size=1048576 2024-01-13T18:20:36.149 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.148+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~AEKA7MYW1GED.1 size=865935 2024-01-13T18:20:36.151 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.150+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=AEKA7MYW1GED tag=6IQ01ST2GO7X type=write size=2963087 2024-01-13T18:20:36.155 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.153+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~EF6XETGXG4ZH.0 size=304460 2024-01-13T18:20:36.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.153+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=EF6XETGXG4ZH tag=CXU2RLWFZK1S type=write size=1353036 2024-01-13T18:20:36.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.155+0000 7f759fd04880 1 < suggested update operation key=7R5YIO7UFSDZ tag=2LT9MABJO7D8 type=del size=1814765 2024-01-13T18:20:36.162 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.161+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~ZPWRYOD5YZ86.0 size=1048576 2024-01-13T18:20:36.165 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.163+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~ZPWRYOD5YZ86.1 size=1048576 2024-01-13T18:20:36.167 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.166+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~ZPWRYOD5YZ86.2 size=636620 2024-01-13T18:20:36.167 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.166+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=ZPWRYOD5YZ86 tag=FVXYZ4T2MJDO type=write size=3782348 2024-01-13T18:20:36.169 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.168+0000 7f759fd04880 1 < completed write operation key=BPUBFFWB9D3C tag=SBLGN1FRQK3Q type=write size=256374 2024-01-13T18:20:36.174 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.173+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~C3UYIYYHEUDU.0 size=1048576 2024-01-13T18:20:36.175 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.174+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~C3UYIYYHEUDU.1 size=303486 2024-01-13T18:20:36.175 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.174+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=C3UYIYYHEUDU tag=RLWSO0ZXT69H type=write size=2400638 2024-01-13T18:20:36.176 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.175+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=KOQUZBPRD1EL type=del 2024-01-13T18:20:36.177 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.176+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=KRP33XALNHVM type=del size=1656297 2024-01-13T18:20:36.179 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.178+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~CYNWVCEYWKGX.0 size=1048576 2024-01-13T18:20:36.180 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.179+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~CYNWVCEYWKGX.1 size=999470 2024-01-13T18:20:36.182 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.181+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=CYNWVCEYWKGX tag=1IFAWIXVL6FL type=write size=3096622 2024-01-13T18:20:36.183 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.182+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=K5TS81OULOU3 type=del size=3523031 2024-01-13T18:20:36.184 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.183+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=2ENINMHJZJ49 type=del 2024-01-13T18:20:36.185 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.184+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=311QNVNJOKA6 type=del size=1363376 2024-01-13T18:20:36.188 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.186+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=4BELFSUNMHBE type=del 2024-01-13T18:20:36.188 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.187+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=2T90M58Z09RE type=del size=3381109 2024-01-13T18:20:36.189 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.188+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=SMWEXDGL7BXE type=del 2024-01-13T18:20:36.190 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.189+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=P1DNCEG1N2D1 type=del size=1034021 2024-01-13T18:20:36.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.190+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=VJOSXD4M6996 type=del 2024-01-13T18:20:36.194 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.193+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~IOOX408AE1YT.0 size=1048576 2024-01-13T18:20:36.195 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.194+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~IOOX408AE1YT.1 size=1048576 2024-01-13T18:20:36.196 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.195+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~IOOX408AE1YT.2 size=76591 2024-01-13T18:20:36.196 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.195+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=IOOX408AE1YT tag=LSW9LBVLS6EA type=write size=3222319 2024-01-13T18:20:36.197 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.196+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=WB6F08XM1VTA type=del 2024-01-13T18:20:36.198 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.197+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=MN804ZGYTA32 type=del size=1650091 2024-01-13T18:20:36.199 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.198+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~LE681FEOYNXA.0 size=426298 2024-01-13T18:20:36.201 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.200+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=LE681FEOYNXA tag=OLC8P46OTX0I type=write size=1474874 2024-01-13T18:20:36.203 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.202+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=IVUHE296W0OM type=write size=788730 2024-01-13T18:20:36.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.203+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=12427A5197PJ type=del 2024-01-13T18:20:36.207 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.206+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~4S2UBNUNW8OM.0 size=150862 2024-01-13T18:20:36.207 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.206+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=4S2UBNUNW8OM tag=3BKLNN2Y0MOG type=write size=1199438 2024-01-13T18:20:36.208 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.207+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=CWUYHJWEC9IR type=del 2024-01-13T18:20:36.209 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.208+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=ZRXSCX6L7WE2 type=del size=1916010 2024-01-13T18:20:36.210 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.210+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=XL4GXLTY0YFW type=del 2024-01-13T18:20:36.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.212+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~Z8K9TQWDHD01.0 size=1048576 2024-01-13T18:20:36.214 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.213+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~Z8K9TQWDHD01.1 size=1048576 2024-01-13T18:20:36.215 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.214+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~Z8K9TQWDHD01.2 size=18417 2024-01-13T18:20:36.215 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.214+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=Z8K9TQWDHD01 tag=CUJ0RXTQ81SD type=write size=3164145 2024-01-13T18:20:36.217 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.216+0000 7f759fd04880 1 < suggested remove operation key=0TIZPXX8CMHA tag=LGXOLH2HGF42 type=del 2024-01-13T18:20:36.219 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.218+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=EMX3QIWSW4BP type=del size=2160617 2024-01-13T18:20:36.220 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.219+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~1TPNS3DDYLMQ.0 size=1048576 2024-01-13T18:20:36.221 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.220+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~1TPNS3DDYLMQ.1 size=1048576 2024-01-13T18:20:36.222 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.221+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~1TPNS3DDYLMQ.2 size=527638 2024-01-13T18:20:36.224 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.223+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=1TPNS3DDYLMQ tag=QM1XZH8SNFBY type=write size=3673366 2024-01-13T18:20:36.227 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.226+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~BZRFX47USGNM.0 size=1048576 2024-01-13T18:20:36.228 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.227+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~BZRFX47USGNM.1 size=1048576 2024-01-13T18:20:36.229 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.228+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~BZRFX47USGNM.2 size=676425 2024-01-13T18:20:36.229 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.228+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=BZRFX47USGNM tag=UGOCLXLNLW4R type=write size=3822153 2024-01-13T18:20:36.230 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.229+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~EF6XETGXG4ZH.0 size=304460 2024-01-13T18:20:36.232 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.231+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=EF6XETGXG4ZH tag=CXU2RLWFZK1S type=write size=1353036 2024-01-13T18:20:36.234 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.233+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~HW0QWZGQ5LGP.0 size=530496 2024-01-13T18:20:36.234 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.233+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=HW0QWZGQ5LGP tag=WNJDHILGY5CU type=write size=1579072 2024-01-13T18:20:36.236 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.235+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~ZPWRYOD5YZ86.0 size=1048576 2024-01-13T18:20:36.237 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.236+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~ZPWRYOD5YZ86.1 size=1048576 2024-01-13T18:20:36.238 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.237+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~ZPWRYOD5YZ86.2 size=636620 2024-01-13T18:20:36.240 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.239+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=ZPWRYOD5YZ86 tag=FVXYZ4T2MJDO type=write size=3782348 2024-01-13T18:20:36.241 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.240+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=P6M606ODT776 type=write size=213505 2024-01-13T18:20:36.244 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.242+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~C3UYIYYHEUDU.0 size=1048576 2024-01-13T18:20:36.244 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.243+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~C3UYIYYHEUDU.1 size=303486 2024-01-13T18:20:36.246 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.245+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=C3UYIYYHEUDU tag=RLWSO0ZXT69H type=write size=2400638 2024-01-13T18:20:36.247 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.246+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=07K2KQF6T75K type=del size=1820273 2024-01-13T18:20:36.248 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.247+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=KRP33XALNHVM type=del 2024-01-13T18:20:36.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.248+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=3IJ7W1MPF98K type=del size=414934 2024-01-13T18:20:36.251 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.250+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=K5TS81OULOU3 type=del 2024-01-13T18:20:36.252 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.251+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=0GYDTHSPKXJB type=write size=921609 2024-01-13T18:20:36.254 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.253+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=311QNVNJOKA6 type=del 2024-01-13T18:20:36.255 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.254+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=ABT2LA3IBKII type=del size=3030332 2024-01-13T18:20:36.258 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.257+0000 7f759fd04880 1 < suggested update operation key=3K20F802EFEQ tag=2T90M58Z09RE type=del size=3381109 2024-01-13T18:20:36.260 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.259+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=UO1LSB8HLQPV type=del size=2507707 2024-01-13T18:20:36.262 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.261+0000 7f759fd04880 1 < canceled operation key=1O3XX67RKHNW tag=P1DNCEG1N2D1 type=del size=1034021 2024-01-13T18:20:36.264 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.263+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~GKA3FL98VEVN.0 size=1048576 2024-01-13T18:20:36.265 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.264+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~GKA3FL98VEVN.1 size=462729 2024-01-13T18:20:36.265 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.264+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=GKA3FL98VEVN tag=TRGNRJDPAIOG type=write size=2559881 2024-01-13T18:20:36.266 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.265+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~IOOX408AE1YT.0 size=1048576 2024-01-13T18:20:36.267 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.266+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~IOOX408AE1YT.1 size=1048576 2024-01-13T18:20:36.268 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.267+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~IOOX408AE1YT.2 size=76591 2024-01-13T18:20:36.270 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.269+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=IOOX408AE1YT tag=LSW9LBVLS6EA type=write size=3222319 2024-01-13T18:20:36.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.271+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=S2VYWLC2KPUQ type=write size=946752 2024-01-13T18:20:36.273 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.272+0000 7f759fd04880 -1 < failed to complete operation key=0TIZPXX8CMHA tag=MN804ZGYTA32 type=del size=1650091: (22) Invalid argument 2024-01-13T18:20:36.275 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.274+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~2K4ZKYZ1XZWS.0 size=1048576 2024-01-13T18:20:36.276 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.275+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~2K4ZKYZ1XZWS.1 size=1048576 2024-01-13T18:20:36.277 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.276+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~2K4ZKYZ1XZWS.2 size=206068 2024-01-13T18:20:36.277 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.276+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=2K4ZKYZ1XZWS tag=8L1KC1JRRWK3 type=write size=3351796 2024-01-13T18:20:36.278 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.277+0000 7f759fd04880 1 < completed write operation key=8EWIOXN5H9KU tag=IVUHE296W0OM type=write size=788730 2024-01-13T18:20:36.281 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.280+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~OQOKO0D4NR3V.0 size=1048576 2024-01-13T18:20:36.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.281+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~OQOKO0D4NR3V.1 size=1048576 2024-01-13T18:20:36.283 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.282+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~OQOKO0D4NR3V.2 size=750432 2024-01-13T18:20:36.283 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.282+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=OQOKO0D4NR3V tag=YBARLDRP4I0M type=write size=3896160 2024-01-13T18:20:36.284 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.283+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~4S2UBNUNW8OM.0 size=150862 2024-01-13T18:20:36.286 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.285+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=4S2UBNUNW8OM tag=3BKLNN2Y0MOG type=write size=1199438 2024-01-13T18:20:36.287 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.286+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=KQKIDH737LP5 type=del size=741893 2024-01-13T18:20:36.288 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.287+0000 7f759fd04880 -1 < failed to complete operation key=3K20F802EFEQ tag=ZRXSCX6L7WE2 type=del size=1916010: (22) Invalid argument 2024-01-13T18:20:36.291 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.290+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~FF0VWKEAWUEC.0 size=1048576 2024-01-13T18:20:36.292 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.291+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~FF0VWKEAWUEC.1 size=1048576 2024-01-13T18:20:36.293 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.292+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~FF0VWKEAWUEC.2 size=800656 2024-01-13T18:20:36.293 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.292+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=FF0VWKEAWUEC tag=2S0X2ZL1A044 type=write size=3946384 2024-01-13T18:20:36.294 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.293+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~Z8K9TQWDHD01.0 size=1048576 2024-01-13T18:20:36.295 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.294+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~Z8K9TQWDHD01.1 size=1048576 2024-01-13T18:20:36.296 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.295+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~Z8K9TQWDHD01.2 size=18417 2024-01-13T18:20:36.298 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.297+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=Z8K9TQWDHD01 tag=CUJ0RXTQ81SD type=write size=3164145 2024-01-13T18:20:36.299 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.298+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=NGAACK0AP74O type=del size=2124446 2024-01-13T18:20:36.302 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.301+0000 7f759fd04880 1 < suggested remove operation key=ZI9WAZQHVPAR tag=EMX3QIWSW4BP type=del 2024-01-13T18:20:36.303 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.302+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=6TJNXO0E8JPO type=del size=880219 2024-01-13T18:20:36.304 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.303+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~BZRFX47USGNM.0 size=1048576 2024-01-13T18:20:36.308 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.304+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~BZRFX47USGNM.1 size=1048576 2024-01-13T18:20:36.308 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.306+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~BZRFX47USGNM.2 size=676425 2024-01-13T18:20:36.309 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.308+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=BZRFX47USGNM tag=UGOCLXLNLW4R type=write size=3822153 2024-01-13T18:20:36.311 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.310+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~FUAINVZ6GVTL.0 size=378076 2024-01-13T18:20:36.311 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.310+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=FUAINVZ6GVTL tag=F2R95LLW1TXP type=write size=1426652 2024-01-13T18:20:36.313 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.312+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~HW0QWZGQ5LGP.0 size=530496 2024-01-13T18:20:36.315 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.314+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=HW0QWZGQ5LGP tag=WNJDHILGY5CU type=write size=1579072 2024-01-13T18:20:36.316 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.315+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=W37VALXATTD9 type=del size=3776101 2024-01-13T18:20:36.318 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.317+0000 7f759fd04880 1 < completed write operation key=WSRJB811XCVL tag=P6M606ODT776 type=write size=213505 2024-01-13T18:20:36.320 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.319+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~IBD66MS0XABL.0 size=740447 2024-01-13T18:20:36.320 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.319+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=IBD66MS0XABL tag=K8Z8OX51Y0B9 type=write size=1789023 2024-01-13T18:20:36.321 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.320+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=07K2KQF6T75K type=del 2024-01-13T18:20:36.323 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.322+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=DNVD1N6ZOZQO type=del size=3599038 2024-01-13T18:20:36.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.323+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=3IJ7W1MPF98K type=del 2024-01-13T18:20:36.325 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.324+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=PHXJ66JGVT6E type=del size=1908188 2024-01-13T18:20:36.327 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.326+0000 7f759fd04880 1 < completed write operation key=8EWIOXN5H9KU tag=0GYDTHSPKXJB type=write size=921609 2024-01-13T18:20:36.328 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.327+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=ZR5FZWMD7P2H type=del size=2287991 2024-01-13T18:20:36.330 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.329+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=ABT2LA3IBKII type=del 2024-01-13T18:20:36.331 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.330+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=F3IYOS771MPT type=del size=1150020 2024-01-13T18:20:36.333 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.332+0000 7f759fd04880 1 < suggested remove operation key=BPUBFFWB9D3C tag=UO1LSB8HLQPV type=del 2024-01-13T18:20:36.335 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.334+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=8GRZ39ZQGKQF type=write size=790912 2024-01-13T18:20:36.335 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.334+0000 7f759fd04880 1 < canceled part key=_multipart_AJZB1PXB1NB5.2~GKA3FL98VEVN.0 size=1048576 2024-01-13T18:20:36.335 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.334+0000 7f759fd04880 1 < canceled part key=_multipart_AJZB1PXB1NB5.2~GKA3FL98VEVN.1 size=462729 2024-01-13T18:20:36.337 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.336+0000 7f759fd04880 1 < canceled multipart upload key=AJZB1PXB1NB5 upload=GKA3FL98VEVN tag=TRGNRJDPAIOG type=write size=2559881 2024-01-13T18:20:36.339 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.338+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=7WUG5GLRS8ED type=del size=1393650 2024-01-13T18:20:36.340 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.339+0000 7f759fd04880 1 < completed write operation key=H972TC5DOMHL tag=S2VYWLC2KPUQ type=write size=946752 2024-01-13T18:20:36.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.340+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=7E5HUKSSS22O type=del size=2182526 2024-01-13T18:20:36.343 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.342+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~2K4ZKYZ1XZWS.0 size=1048576 2024-01-13T18:20:36.344 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.343+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~2K4ZKYZ1XZWS.1 size=1048576 2024-01-13T18:20:36.345 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.344+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~2K4ZKYZ1XZWS.2 size=206068 2024-01-13T18:20:36.347 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.346+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=2K4ZKYZ1XZWS tag=8L1KC1JRRWK3 type=write size=3351796 2024-01-13T18:20:36.348 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.347+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=T5MXSHYNBL2G type=write size=765920 2024-01-13T18:20:36.350 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.349+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~OQOKO0D4NR3V.0 size=1048576 2024-01-13T18:20:36.351 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.350+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~OQOKO0D4NR3V.1 size=1048576 2024-01-13T18:20:36.352 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.351+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~OQOKO0D4NR3V.2 size=750432 2024-01-13T18:20:36.354 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.353+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=OQOKO0D4NR3V tag=YBARLDRP4I0M type=write size=3896160 2024-01-13T18:20:36.356 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.355+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~R8N73TY8IUKF.0 size=1048576 2024-01-13T18:20:36.357 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.356+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~R8N73TY8IUKF.1 size=1048576 2024-01-13T18:20:36.358 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.357+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~R8N73TY8IUKF.2 size=543213 2024-01-13T18:20:36.358 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.357+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=R8N73TY8IUKF tag=FZ7EFNM3EJCI type=write size=3688941 2024-01-13T18:20:36.360 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.359+0000 7f759fd04880 1 < canceled operation key=XBTWSUA3D7U3 tag=KQKIDH737LP5 type=del size=741893 2024-01-13T18:20:36.361 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.360+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=2Z3K1UAQGRAB type=del size=3021491 2024-01-13T18:20:36.362 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.361+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~FF0VWKEAWUEC.0 size=1048576 2024-01-13T18:20:36.363 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.362+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~FF0VWKEAWUEC.1 size=1048576 2024-01-13T18:20:36.364 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.363+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~FF0VWKEAWUEC.2 size=800656 2024-01-13T18:20:36.366 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.365+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=FF0VWKEAWUEC tag=2S0X2ZL1A044 type=write size=3946384 2024-01-13T18:20:36.367 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.367+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=I4QU38CYJE3Q type=del size=1752501 2024-01-13T18:20:36.369 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.368+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=NGAACK0AP74O type=del 2024-01-13T18:20:36.370 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.369+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=85XH1JP1Y1XB type=del size=3926458 2024-01-13T18:20:36.371 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.370+0000 7f759fd04880 -1 < failed to complete operation key=BPUBFFWB9D3C tag=6TJNXO0E8JPO type=del size=880219: (22) Invalid argument 2024-01-13T18:20:36.374 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.373+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~JKH0WN54R1NC.0 size=1048576 2024-01-13T18:20:36.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.374+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~JKH0WN54R1NC.1 size=722892 2024-01-13T18:20:36.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.374+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=JKH0WN54R1NC tag=3UXRPE6GXEUM type=write size=2820044 2024-01-13T18:20:36.376 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.375+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~FUAINVZ6GVTL.0 size=378076 2024-01-13T18:20:36.378 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.377+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=FUAINVZ6GVTL tag=F2R95LLW1TXP type=write size=1426652 2024-01-13T18:20:36.381 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.380+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~SUN62IF60XPE.0 size=383106 2024-01-13T18:20:36.381 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.380+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=SUN62IF60XPE tag=O0YL2FFURLD7 type=write size=1431682 2024-01-13T18:20:36.382 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.381+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=W37VALXATTD9 type=del 2024-01-13T18:20:36.383 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.382+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=E6VXQ4WSDWVK type=del size=3557875 2024-01-13T18:20:36.384 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.383+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~IBD66MS0XABL.0 size=740447 2024-01-13T18:20:36.386 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.385+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=IBD66MS0XABL tag=K8Z8OX51Y0B9 type=write size=1789023 2024-01-13T18:20:36.388 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.387+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=WMRBUTQ1MF9D type=del size=3249059 2024-01-13T18:20:36.389 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.388+0000 7f759fd04880 1 < completed delete operation key=QKNPXHB99KVP tag=DNVD1N6ZOZQO type=del 2024-01-13T18:20:36.391 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.390+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~OC8H1IU14ECV.0 size=587674 2024-01-13T18:20:36.391 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.390+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=OC8H1IU14ECV tag=ABHCKHC6NLGZ type=write size=1636250 2024-01-13T18:20:36.392 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.391+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=PHXJ66JGVT6E type=del 2024-01-13T18:20:36.395 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.394+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~TNIO3A9RPMR9.0 size=1048576 2024-01-13T18:20:36.396 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.395+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~TNIO3A9RPMR9.1 size=1048576 2024-01-13T18:20:36.397 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.396+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~TNIO3A9RPMR9.2 size=49734 2024-01-13T18:20:36.397 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.396+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=TNIO3A9RPMR9 tag=IZBZMU58ZK6P type=write size=3195462 2024-01-13T18:20:36.398 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.397+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=ZR5FZWMD7P2H type=del 2024-01-13T18:20:36.400 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.399+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~EK6DQ2COO1DB.0 size=16773 2024-01-13T18:20:36.400 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.399+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=EK6DQ2COO1DB tag=YXKV2GT5EHDB type=write size=1065349 2024-01-13T18:20:36.401 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.401+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=F3IYOS771MPT type=del 2024-01-13T18:20:36.404 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.403+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~WLYBBO6DN1DC.0 size=1048576 2024-01-13T18:20:36.405 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.404+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~WLYBBO6DN1DC.1 size=1048576 2024-01-13T18:20:36.406 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.405+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~WLYBBO6DN1DC.2 size=667877 2024-01-13T18:20:36.406 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.405+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=WLYBBO6DN1DC tag=EIXE0DW4IUUL type=write size=3813605 2024-01-13T18:20:36.407 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.406+0000 7f759fd04880 1 < completed write operation key=1QEZO616DBC3 tag=8GRZ39ZQGKQF type=write size=790912 2024-01-13T18:20:36.409 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.407+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=SK3JPYQ0GID1 type=del size=1508732 2024-01-13T18:20:36.410 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.409+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=7WUG5GLRS8ED type=del 2024-01-13T18:20:36.411 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.410+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=KAE11LI6WU1P type=del size=1735330 2024-01-13T18:20:36.412 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.411+0000 7f759fd04880 1 < canceled operation key=7LXXSKLOM1JZ tag=7E5HUKSSS22O type=del size=2182526 2024-01-13T18:20:36.413 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.412+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=YYTD75ODIR9G type=write size=785105 2024-01-13T18:20:36.414 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.413+0000 7f759fd04880 1 < completed write operation key=EW3ZFDVIQZ7G tag=T5MXSHYNBL2G type=write size=765920 2024-01-13T18:20:36.416 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.415+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=UR2QRKS9Y0OG type=del size=913386 2024-01-13T18:20:36.417 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.416+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~R8N73TY8IUKF.0 size=1048576 2024-01-13T18:20:36.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.417+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~R8N73TY8IUKF.1 size=1048576 2024-01-13T18:20:36.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.417+0000 7f759fd04880 1 < canceled part key=_multipart_1YNH6QHP354U.2~R8N73TY8IUKF.2 size=543213 2024-01-13T18:20:36.420 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.419+0000 7f759fd04880 1 < canceled multipart upload key=1YNH6QHP354U upload=R8N73TY8IUKF tag=FZ7EFNM3EJCI type=write size=3688941 2024-01-13T18:20:36.422 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.421+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~8BP13D41JI7N.0 size=1048576 2024-01-13T18:20:36.423 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.422+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~8BP13D41JI7N.1 size=963382 2024-01-13T18:20:36.423 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.422+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=8BP13D41JI7N tag=FBH7AS3LG3TI type=write size=3060534 2024-01-13T18:20:36.424 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.423+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=2Z3K1UAQGRAB type=del 2024-01-13T18:20:36.426 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.425+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=VNWAEKUGUQM6 type=del size=3509346 2024-01-13T18:20:36.427 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.426+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=I4QU38CYJE3Q type=del 2024-01-13T18:20:36.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:36 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:20:36.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:36 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2048264131' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171738-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:36.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:36 smithi084 ceph-mon[119097]: osdmap e1117: 8 total, 8 up, 8 in 2024-01-13T18:20:36.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:36 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:20:36.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:36 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2048264131' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171738-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:36.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:36 smithi084 ceph-mon[116404]: osdmap e1117: 8 total, 8 up, 8 in 2024-01-13T18:20:36.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.428+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=B9EE48YAGNRM type=write size=616742 2024-01-13T18:20:36.430 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.429+0000 7f759fd04880 1 < completed delete operation key=QKNPXHB99KVP tag=85XH1JP1Y1XB type=del 2024-01-13T18:20:36.432 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.431+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~HBPBA3VG3NJ8.0 size=1048576 2024-01-13T18:20:36.433 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.432+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~HBPBA3VG3NJ8.1 size=916150 2024-01-13T18:20:36.433 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.432+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=HBPBA3VG3NJ8 tag=WFZTX2LXW5M8 type=write size=3013302 2024-01-13T18:20:36.433 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.432+0000 7f759fd04880 1 < canceled part key=_multipart_0TIZPXX8CMHA.2~JKH0WN54R1NC.0 size=1048576 2024-01-13T18:20:36.434 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.433+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~JKH0WN54R1NC.1 size=722892 2024-01-13T18:20:36.436 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.435+0000 7f759fd04880 1 < canceled multipart upload key=0TIZPXX8CMHA upload=JKH0WN54R1NC tag=3UXRPE6GXEUM type=write size=2820044 2024-01-13T18:20:36.438 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.437+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=2YRPYGX7096F type=write size=332555 2024-01-13T18:20:36.439 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.438+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~SUN62IF60XPE.0 size=383106 2024-01-13T18:20:36.441 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.440+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=SUN62IF60XPE tag=O0YL2FFURLD7 type=write size=1431682 2024-01-13T18:20:36.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.443+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~HI36ROZSGUT0.0 size=1048576 2024-01-13T18:20:36.444 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.443+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~HI36ROZSGUT0.1 size=66655 2024-01-13T18:20:36.445 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.443+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=HI36ROZSGUT0 tag=A71ILIMTY6H5 type=write size=2163807 2024-01-13T18:20:36.446 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.445+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=E6VXQ4WSDWVK type=del 2024-01-13T18:20:36.447 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.446+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=A6BXGSL6WCST type=del size=439641 2024-01-13T18:20:36.450 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.449+0000 7f759fd04880 1 < suggested remove operation key=3K20F802EFEQ tag=WMRBUTQ1MF9D type=del 2024-01-13T18:20:36.451 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.450+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=UY17QB7RRULG type=del size=194998 2024-01-13T18:20:36.452 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.451+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~OC8H1IU14ECV.0 size=587674 2024-01-13T18:20:36.454 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.453+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=OC8H1IU14ECV tag=ABHCKHC6NLGZ type=write size=1636250 2024-01-13T18:20:36.457 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.456+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~L2KCBX3S6XQH.0 size=1048576 2024-01-13T18:20:36.458 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.457+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~L2KCBX3S6XQH.1 size=1048576 2024-01-13T18:20:36.459 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.458+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~L2KCBX3S6XQH.2 size=1025452 2024-01-13T18:20:36.459 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.458+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=L2KCBX3S6XQH tag=HSAFAJMRUTNH type=write size=4171180 2024-01-13T18:20:36.460 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.459+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~TNIO3A9RPMR9.0 size=1048576 2024-01-13T18:20:36.461 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.460+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~TNIO3A9RPMR9.1 size=1048576 2024-01-13T18:20:36.462 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.461+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~TNIO3A9RPMR9.2 size=49734 2024-01-13T18:20:36.465 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.464+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=TNIO3A9RPMR9 tag=IZBZMU58ZK6P type=write size=3195462 2024-01-13T18:20:36.469 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.468+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~1KJKDA119V1K.0 size=1048576 2024-01-13T18:20:36.470 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.469+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~1KJKDA119V1K.1 size=788546 2024-01-13T18:20:36.470 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.469+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=1KJKDA119V1K tag=U0H1GK7ENNSE type=write size=2885698 2024-01-13T18:20:36.472 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.471+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~EK6DQ2COO1DB.0 size=16773 2024-01-13T18:20:36.474 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.473+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=EK6DQ2COO1DB tag=YXKV2GT5EHDB type=write size=1065349 2024-01-13T18:20:36.476 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.475+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=ZRRW3GITDHWN type=del size=4109151 2024-01-13T18:20:36.477 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.476+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~WLYBBO6DN1DC.0 size=1048576 2024-01-13T18:20:36.478 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.477+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~WLYBBO6DN1DC.1 size=1048576 2024-01-13T18:20:36.479 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.478+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~WLYBBO6DN1DC.2 size=667877 2024-01-13T18:20:36.481 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.481+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=WLYBBO6DN1DC tag=EIXE0DW4IUUL type=write size=3813605 2024-01-13T18:20:36.483 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.482+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=POHEOXFBIMG9 type=del size=3085531 2024-01-13T18:20:36.485 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.484+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=SK3JPYQ0GID1 type=del 2024-01-13T18:20:36.486 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.485+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=ZUMP6UGZC1JP type=write size=8122 2024-01-13T18:20:36.487 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.486+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=KAE11LI6WU1P type=del 2024-01-13T18:20:36.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.488+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=IZD4L9W3JN56 type=del size=896604 2024-01-13T18:20:36.490 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.489+0000 7f759fd04880 -1 < failed to complete operation key=3K20F802EFEQ tag=YYTD75ODIR9G type=write size=785105: (22) Invalid argument 2024-01-13T18:20:36.492 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.491+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=H8YC7T1JCG0K type=write size=624292 2024-01-13T18:20:36.493 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.492+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=UR2QRKS9Y0OG type=del 2024-01-13T18:20:36.496 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.495+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~US6IUCX3J4VX.0 size=1048576 2024-01-13T18:20:36.497 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.496+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~US6IUCX3J4VX.1 size=1048576 2024-01-13T18:20:36.498 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.497+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~US6IUCX3J4VX.2 size=841591 2024-01-13T18:20:36.498 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.497+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=US6IUCX3J4VX tag=KPE4BE7PHHTG type=write size=3987319 2024-01-13T18:20:36.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.498+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~8BP13D41JI7N.0 size=1048576 2024-01-13T18:20:36.500 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.499+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~8BP13D41JI7N.1 size=963382 2024-01-13T18:20:36.502 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.501+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=8BP13D41JI7N tag=FBH7AS3LG3TI type=write size=3060534 2024-01-13T18:20:36.504 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.504+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~F3B2IOD0JRF0.0 size=1048576 2024-01-13T18:20:36.506 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.505+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~F3B2IOD0JRF0.1 size=97363 2024-01-13T18:20:36.506 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.505+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=F3B2IOD0JRF0 tag=SZA29O54HDXS type=write size=2194515 2024-01-13T18:20:36.507 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.506+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=VNWAEKUGUQM6 type=del 2024-01-13T18:20:36.508 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.507+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=V8MCYL2WXSSR type=del size=2730333 2024-01-13T18:20:36.510 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.509+0000 7f759fd04880 1 < completed write operation key=7R5YIO7UFSDZ tag=B9EE48YAGNRM type=write size=616742 2024-01-13T18:20:36.513 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.512+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~38E6X56DBGTT.0 size=1048576 2024-01-13T18:20:36.514 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.513+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~38E6X56DBGTT.1 size=1048576 2024-01-13T18:20:36.515 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.514+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~38E6X56DBGTT.2 size=10945 2024-01-13T18:20:36.515 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.514+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=38E6X56DBGTT tag=YE5E5C42LOXJ type=write size=3156673 2024-01-13T18:20:36.517 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.516+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~HBPBA3VG3NJ8.0 size=1048576 2024-01-13T18:20:36.518 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.517+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~HBPBA3VG3NJ8.1 size=916150 2024-01-13T18:20:36.521 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.520+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=HBPBA3VG3NJ8 tag=WFZTX2LXW5M8 type=write size=3013302 2024-01-13T18:20:36.522 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.521+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=P8JSNIWSPYFV type=del size=1767290 2024-01-13T18:20:36.524 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.523+0000 7f759fd04880 1 < completed write operation key=AJZB1PXB1NB5 tag=2YRPYGX7096F type=write size=332555 2024-01-13T18:20:36.525 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.524+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=4HHHFEZIGG22 type=del size=3592346 2024-01-13T18:20:36.526 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.525+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~HI36ROZSGUT0.0 size=1048576 2024-01-13T18:20:36.527 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.526+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~HI36ROZSGUT0.1 size=66655 2024-01-13T18:20:36.530 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.529+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=HI36ROZSGUT0 tag=A71ILIMTY6H5 type=write size=2163807 2024-01-13T18:20:36.532 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.531+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~IX8ESNYHRHHX.0 size=1048576 2024-01-13T18:20:36.533 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.532+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~IX8ESNYHRHHX.1 size=1048576 2024-01-13T18:20:36.534 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.533+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~IX8ESNYHRHHX.2 size=1030683 2024-01-13T18:20:36.534 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.533+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=IX8ESNYHRHHX tag=O7ZJ2FR2CI9K type=write size=4176411 2024-01-13T18:20:36.536 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.535+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=A6BXGSL6WCST type=del 2024-01-13T18:20:36.538 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.537+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~NB5WNLE7453Q.0 size=1048576 2024-01-13T18:20:36.539 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.538+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~NB5WNLE7453Q.1 size=1048576 2024-01-13T18:20:36.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.539+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~NB5WNLE7453Q.2 size=579422 2024-01-13T18:20:36.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.539+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=NB5WNLE7453Q tag=PCIPMH37VA51 type=write size=3725150 2024-01-13T18:20:36.541 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.540+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=UY17QB7RRULG type=del 2024-01-13T18:20:36.543 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.542+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=MQKXWD2O3FMS type=del size=2357606 2024-01-13T18:20:36.545 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.544+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~L2KCBX3S6XQH.0 size=1048576 2024-01-13T18:20:36.546 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.545+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~L2KCBX3S6XQH.1 size=1048576 2024-01-13T18:20:36.547 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.546+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~L2KCBX3S6XQH.2 size=1025452 2024-01-13T18:20:36.549 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.548+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=L2KCBX3S6XQH tag=HSAFAJMRUTNH type=write size=4171180 2024-01-13T18:20:36.551 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.550+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~KUY0PZNY6YMK.0 size=1048576 2024-01-13T18:20:36.552 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.552+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~KUY0PZNY6YMK.1 size=309497 2024-01-13T18:20:36.553 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.552+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=KUY0PZNY6YMK tag=43940K9NA2BC type=write size=2406649 2024-01-13T18:20:36.554 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.553+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~1KJKDA119V1K.0 size=1048576 2024-01-13T18:20:36.554 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.553+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~1KJKDA119V1K.1 size=788546 2024-01-13T18:20:36.557 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.556+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=1KJKDA119V1K tag=U0H1GK7ENNSE type=write size=2885698 2024-01-13T18:20:36.558 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.557+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=SXDRGL9P3FI4 type=del size=1625773 2024-01-13T18:20:36.560 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.559+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=ZRRW3GITDHWN type=del 2024-01-13T18:20:36.562 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.561+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=WJLKI966SKZ4 type=write size=406137 2024-01-13T18:20:36.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.564+0000 7f759fd04880 1 < suggested remove operation key=1QEZO616DBC3 tag=POHEOXFBIMG9 type=del 2024-01-13T18:20:36.568 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.567+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~VIV4AIZG93AH.0 size=1048576 2024-01-13T18:20:36.569 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.568+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~VIV4AIZG93AH.1 size=1048576 2024-01-13T18:20:36.571 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.570+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~VIV4AIZG93AH.2 size=912518 2024-01-13T18:20:36.571 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.570+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=VIV4AIZG93AH tag=79G3SMDLHGFC type=write size=4058246 2024-01-13T18:20:36.572 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.571+0000 7f759fd04880 1 < canceled operation key=VZHGQM6ZNJYQ tag=ZUMP6UGZC1JP type=write size=8122 2024-01-13T18:20:36.574 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.573+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=PV2NCZY6AB02 type=del size=738643 2024-01-13T18:20:36.575 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.574+0000 7f759fd04880 1 < canceled operation key=JGALONWJXLQY tag=IZD4L9W3JN56 type=del size=896604 2024-01-13T18:20:36.578 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.577+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~1CF7ULVA9AO9.0 size=72133 2024-01-13T18:20:36.578 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.577+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=1CF7ULVA9AO9 tag=2H63LS7LA7DX type=write size=1120709 2024-01-13T18:20:36.580 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.579+0000 7f759fd04880 1 < canceled operation key=1YNH6QHP354U tag=H8YC7T1JCG0K type=write size=624292 2024-01-13T18:20:36.582 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.581+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~WLZ5I2WMQEQY.0 size=1048576 2024-01-13T18:20:36.583 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.582+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~WLZ5I2WMQEQY.1 size=1048576 2024-01-13T18:20:36.584 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.583+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~WLZ5I2WMQEQY.2 size=1028385 2024-01-13T18:20:36.585 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.583+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=WLZ5I2WMQEQY tag=BBZBWQWPMWNX type=write size=4174113 2024-01-13T18:20:36.586 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.585+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~US6IUCX3J4VX.0 size=1048576 2024-01-13T18:20:36.587 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.586+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~US6IUCX3J4VX.1 size=1048576 2024-01-13T18:20:36.588 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.587+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~US6IUCX3J4VX.2 size=841591 2024-01-13T18:20:36.590 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.589+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=US6IUCX3J4VX tag=KPE4BE7PHHTG type=write size=3987319 2024-01-13T18:20:36.592 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.591+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~YTRVHF52SDCN.0 size=257061 2024-01-13T18:20:36.592 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.591+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=YTRVHF52SDCN tag=GZ1D2JYBSGUB type=write size=1305637 2024-01-13T18:20:36.594 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.593+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~F3B2IOD0JRF0.0 size=1048576 2024-01-13T18:20:36.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.594+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~F3B2IOD0JRF0.1 size=97363 2024-01-13T18:20:36.597 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.596+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=F3B2IOD0JRF0 tag=SZA29O54HDXS type=write size=2194515 2024-01-13T18:20:36.598 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.597+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=X46T8XKV771Q type=write size=537426 2024-01-13T18:20:36.600 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.599+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=V8MCYL2WXSSR type=del 2024-01-13T18:20:36.602 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.601+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~OIVY36XV0QNR.0 size=1048576 2024-01-13T18:20:36.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.602+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~OIVY36XV0QNR.1 size=257545 2024-01-13T18:20:36.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.602+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=OIVY36XV0QNR tag=LBKHLYU1N2AU type=write size=2354697 2024-01-13T18:20:36.604 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.602+0000 7f759fd04880 1 < canceled part key=_multipart_6GOU0WSHKUQ0.2~38E6X56DBGTT.0 size=1048576 2024-01-13T18:20:36.605 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.604+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~38E6X56DBGTT.1 size=1048576 2024-01-13T18:20:36.606 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.605+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~38E6X56DBGTT.2 size=10945 2024-01-13T18:20:36.608 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.607+0000 7f759fd04880 1 < canceled multipart upload key=6GOU0WSHKUQ0 upload=38E6X56DBGTT tag=YE5E5C42LOXJ type=write size=3156673 2024-01-13T18:20:36.609 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.608+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=EVFPY2G6PT19 type=del size=1772382 2024-01-13T18:20:36.612 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.611+0000 7f759fd04880 1 < suggested remove operation key=6GOU0WSHKUQ0 tag=P8JSNIWSPYFV type=del 2024-01-13T18:20:36.615 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.614+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~8LTDZT5GSP30.0 size=599217 2024-01-13T18:20:36.615 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.614+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=8LTDZT5GSP30 tag=774RS5LPJM30 type=write size=1647793 2024-01-13T18:20:36.616 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.615+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=4HHHFEZIGG22 type=del 2024-01-13T18:20:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:36 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:20:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:36 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2048264131' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171738-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:36.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:36 smithi099 ceph-mon[138788]: osdmap e1117: 8 total, 8 up, 8 in 2024-01-13T18:20:36.619 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.618+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~BE3M7GCWR122.0 size=117222 2024-01-13T18:20:36.619 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.618+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=BE3M7GCWR122 tag=Z5MISTJ33NTA type=write size=1165798 2024-01-13T18:20:36.620 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.620+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~IX8ESNYHRHHX.0 size=1048576 2024-01-13T18:20:36.622 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.621+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~IX8ESNYHRHHX.1 size=1048576 2024-01-13T18:20:36.623 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.622+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~IX8ESNYHRHHX.2 size=1030683 2024-01-13T18:20:36.625 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.624+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=IX8ESNYHRHHX tag=O7ZJ2FR2CI9K type=write size=4176411 2024-01-13T18:20:36.627 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.626+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~XWB8N4XPOWE3.0 size=1048576 2024-01-13T18:20:36.628 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.627+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~XWB8N4XPOWE3.1 size=52602 2024-01-13T18:20:36.628 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.627+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=XWB8N4XPOWE3 tag=BG5VFL7CHK5T type=write size=2149754 2024-01-13T18:20:36.630 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.629+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~NB5WNLE7453Q.0 size=1048576 2024-01-13T18:20:36.631 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.630+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~NB5WNLE7453Q.1 size=1048576 2024-01-13T18:20:36.631 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.630+0000 7f759fd04880 1 < canceled part key=_multipart_XBTWSUA3D7U3.2~NB5WNLE7453Q.2 size=579422 2024-01-13T18:20:36.633 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.632+0000 7f759fd04880 1 < canceled multipart upload key=XBTWSUA3D7U3 upload=NB5WNLE7453Q tag=PCIPMH37VA51 type=write size=3725150 2024-01-13T18:20:36.636 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.635+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~287G4KOID8ZO.0 size=1048576 2024-01-13T18:20:36.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.636+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~287G4KOID8ZO.1 size=271268 2024-01-13T18:20:36.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.636+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=287G4KOID8ZO tag=5YH38BJUAWBX type=write size=2368420 2024-01-13T18:20:36.638 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.637+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=MQKXWD2O3FMS type=del 2024-01-13T18:20:36.641 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.640+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~U0HJJ04M02DK.0 size=1048576 2024-01-13T18:20:36.642 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.641+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~U0HJJ04M02DK.1 size=974527 2024-01-13T18:20:36.642 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.641+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=U0HJJ04M02DK tag=CSHFHHKAD0Y6 type=write size=3071679 2024-01-13T18:20:36.643 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.642+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~KUY0PZNY6YMK.0 size=1048576 2024-01-13T18:20:36.643 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.642+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~KUY0PZNY6YMK.1 size=309497 2024-01-13T18:20:36.646 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.645+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=KUY0PZNY6YMK tag=43940K9NA2BC type=write size=2406649 2024-01-13T18:20:36.647 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.646+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=ZR5WTFI8JUS4 type=del size=3312941 2024-01-13T18:20:36.649 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.648+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=SXDRGL9P3FI4 type=del 2024-01-13T18:20:36.650 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.649+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=089GJ8OLKKVX type=del size=2783478 2024-01-13T18:20:36.652 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.651+0000 7f759fd04880 1 < completed write operation key=QD5GBLNCY707 tag=WJLKI966SKZ4 type=write size=406137 2024-01-13T18:20:36.653 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.653+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=B90ET5F4YUKH type=del size=696065 2024-01-13T18:20:36.655 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.654+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~VIV4AIZG93AH.0 size=1048576 2024-01-13T18:20:36.656 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.655+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~VIV4AIZG93AH.1 size=1048576 2024-01-13T18:20:36.657 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.656+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~VIV4AIZG93AH.2 size=912518 2024-01-13T18:20:36.659 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.658+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=VIV4AIZG93AH tag=79G3SMDLHGFC type=write size=4058246 2024-01-13T18:20:36.660 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.660+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=VXT3RMC7CP30 type=del size=3687724 2024-01-13T18:20:36.663 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.662+0000 7f759fd04880 1 < suggested remove operation key=JN46AMLYHN8E tag=PV2NCZY6AB02 type=del 2024-01-13T18:20:36.665 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.664+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=4I4X6UR39EYD type=del size=2140975 2024-01-13T18:20:36.666 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.665+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~1CF7ULVA9AO9.0 size=72133 2024-01-13T18:20:36.668 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.668+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=1CF7ULVA9AO9 tag=2H63LS7LA7DX type=write size=1120709 2024-01-13T18:20:36.671 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.670+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~WF8PYMCQI8GO.0 size=624366 2024-01-13T18:20:36.671 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.670+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=WF8PYMCQI8GO tag=T4NX5NIGGFUH type=write size=1672942 2024-01-13T18:20:36.673 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.672+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~WLZ5I2WMQEQY.0 size=1048576 2024-01-13T18:20:36.674 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.673+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~WLZ5I2WMQEQY.1 size=1048576 2024-01-13T18:20:36.675 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.674+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~WLZ5I2WMQEQY.2 size=1028385 2024-01-13T18:20:36.677 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.676+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=WLZ5I2WMQEQY tag=BBZBWQWPMWNX type=write size=4174113 2024-01-13T18:20:36.678 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.677+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=IK5RJTRUDJLO type=write size=735085 2024-01-13T18:20:36.680 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.679+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~YTRVHF52SDCN.0 size=257061 2024-01-13T18:20:36.682 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.681+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=YTRVHF52SDCN tag=GZ1D2JYBSGUB type=write size=1305637 2024-01-13T18:20:36.684 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.683+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~3PAW3PPEJ7GW.0 size=1048576 2024-01-13T18:20:36.685 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.684+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~3PAW3PPEJ7GW.1 size=127319 2024-01-13T18:20:36.685 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.684+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=3PAW3PPEJ7GW tag=CLSQQZPCSXX4 type=write size=2224471 2024-01-13T18:20:36.688 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.687+0000 7f759fd04880 1 < suggested remove operation key=7R5YIO7UFSDZ tag=X46T8XKV771Q type=write 2024-01-13T18:20:36.689 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.688+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=YG6T9JSD32EH type=write size=454999 2024-01-13T18:20:36.691 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.690+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~OIVY36XV0QNR.0 size=1048576 2024-01-13T18:20:36.692 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.691+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~OIVY36XV0QNR.1 size=257545 2024-01-13T18:20:36.694 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.693+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=OIVY36XV0QNR tag=LBKHLYU1N2AU type=write size=2354697 2024-01-13T18:20:36.696 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.695+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=7YZ23TZF7M78 type=del size=1526284 2024-01-13T18:20:36.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.696+0000 7f759fd04880 1 < canceled operation key=VZHGQM6ZNJYQ tag=EVFPY2G6PT19 type=del size=1772382 2024-01-13T18:20:36.699 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.698+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=M2FWHIGQG0FD type=del size=1910826 2024-01-13T18:20:36.700 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.699+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~8LTDZT5GSP30.0 size=599217 2024-01-13T18:20:36.702 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.701+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=8LTDZT5GSP30 tag=774RS5LPJM30 type=write size=1647793 2024-01-13T18:20:36.705 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.704+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~FP5UR1WNCCYV.0 size=1048576 2024-01-13T18:20:36.706 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.705+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~FP5UR1WNCCYV.1 size=857961 2024-01-13T18:20:36.706 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.705+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=FP5UR1WNCCYV tag=EC3ITWNI711V type=write size=2955113 2024-01-13T18:20:36.708 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.707+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~BE3M7GCWR122.0 size=117222 2024-01-13T18:20:36.710 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.709+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=BE3M7GCWR122 tag=Z5MISTJ33NTA type=write size=1165798 2024-01-13T18:20:36.711 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.710+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=BQ0PV97ARD2R type=del size=1215233 2024-01-13T18:20:36.712 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.711+0000 7f759fd04880 1 < canceled part key=_multipart_2OO7S2NBZ7M6.2~XWB8N4XPOWE3.0 size=1048576 2024-01-13T18:20:36.713 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.712+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~XWB8N4XPOWE3.1 size=52602 2024-01-13T18:20:36.715 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.714+0000 7f759fd04880 1 < canceled multipart upload key=2OO7S2NBZ7M6 upload=XWB8N4XPOWE3 tag=BG5VFL7CHK5T type=write size=2149754 2024-01-13T18:20:36.718 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.717+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~PPD4KVPRRB4O.0 size=1048576 2024-01-13T18:20:36.719 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.718+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~PPD4KVPRRB4O.1 size=261524 2024-01-13T18:20:36.719 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.718+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=PPD4KVPRRB4O tag=S7T8X8WZUWY0 type=write size=2358676 2024-01-13T18:20:36.721 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.720+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~287G4KOID8ZO.0 size=1048576 2024-01-13T18:20:36.721 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.720+0000 7f759fd04880 1 < canceled part key=_multipart_QKNPXHB99KVP.2~287G4KOID8ZO.1 size=271268 2024-01-13T18:20:36.723 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.722+0000 7f759fd04880 1 < canceled multipart upload key=QKNPXHB99KVP upload=287G4KOID8ZO tag=5YH38BJUAWBX type=write size=2368420 2024-01-13T18:20:36.726 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.725+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~OS2BZINHX7FY.0 size=869060 2024-01-13T18:20:36.726 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.725+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=OS2BZINHX7FY tag=OOC9M22O1MOY type=write size=1917636 2024-01-13T18:20:36.727 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.726+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~U0HJJ04M02DK.0 size=1048576 2024-01-13T18:20:36.728 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.728+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~U0HJJ04M02DK.1 size=974527 2024-01-13T18:20:36.731 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.730+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=U0HJJ04M02DK tag=CSHFHHKAD0Y6 type=write size=3071679 2024-01-13T18:20:36.733 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.732+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~BVT5HD1A3X8F.0 size=186060 2024-01-13T18:20:36.733 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.732+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=BVT5HD1A3X8F tag=5A8G1SAOJYQO type=write size=1234636 2024-01-13T18:20:36.735 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.734+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=ZR5WTFI8JUS4 type=del 2024-01-13T18:20:36.736 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.735+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=OQ2UFEJ86SBN type=del size=2275330 2024-01-13T18:20:36.738 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.737+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=089GJ8OLKKVX type=del 2024-01-13T18:20:36.740 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.739+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~2EZL1E22277N.0 size=1048576 2024-01-13T18:20:36.741 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.740+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~2EZL1E22277N.1 size=1048576 2024-01-13T18:20:36.743 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.742+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~2EZL1E22277N.2 size=912743 2024-01-13T18:20:36.743 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.742+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=2EZL1E22277N tag=SE377ZI4HOTP type=write size=4058471 2024-01-13T18:20:36.744 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.743+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=B90ET5F4YUKH type=del 2024-01-13T18:20:36.746 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.745+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=WYX9NF26LMR2 type=write size=952209 2024-01-13T18:20:36.749 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.748+0000 7f759fd04880 1 < suggested update operation key=ZI9WAZQHVPAR tag=VXT3RMC7CP30 type=del size=3687724 2024-01-13T18:20:36.752 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.751+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~224A5O0BKX9A.0 size=1048576 2024-01-13T18:20:36.753 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.752+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~224A5O0BKX9A.1 size=1048576 2024-01-13T18:20:36.754 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.754+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~224A5O0BKX9A.2 size=261191 2024-01-13T18:20:36.755 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.754+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=224A5O0BKX9A tag=NM29VWIXJLUT type=write size=3406919 2024-01-13T18:20:36.758 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.757+0000 7f759fd04880 1 < suggested remove operation key=BPUBFFWB9D3C tag=4I4X6UR39EYD type=del 2024-01-13T18:20:36.759 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.758+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=QIUNZZWBN603 type=del size=29918 2024-01-13T18:20:36.761 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.760+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~WF8PYMCQI8GO.0 size=624366 2024-01-13T18:20:36.764 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.763+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=WF8PYMCQI8GO tag=T4NX5NIGGFUH type=write size=1672942 2024-01-13T18:20:36.766 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.765+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=F4008WLOWCEM type=del size=3945325 2024-01-13T18:20:36.767 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.766+0000 7f759fd04880 1 < completed write operation key=WSRJB811XCVL tag=IK5RJTRUDJLO type=write size=735085 2024-01-13T18:20:36.772 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.769+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~YABLY5NUR84S.0 size=1048576 2024-01-13T18:20:36.773 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.770+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~YABLY5NUR84S.1 size=1048576 2024-01-13T18:20:36.773 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.771+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~YABLY5NUR84S.2 size=983937 2024-01-13T18:20:36.773 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.771+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=YABLY5NUR84S tag=19M3NF2F69R3 type=write size=4129665 2024-01-13T18:20:36.773 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.772+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~3PAW3PPEJ7GW.0 size=1048576 2024-01-13T18:20:36.774 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.773+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~3PAW3PPEJ7GW.1 size=127319 2024-01-13T18:20:36.776 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.775+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=3PAW3PPEJ7GW tag=CLSQQZPCSXX4 type=write size=2224471 2024-01-13T18:20:36.778 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.777+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=23GMY6SS7O4D type=del size=3962447 2024-01-13T18:20:36.779 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.778+0000 7f759fd04880 1 < completed write operation key=TNC2YDZYGM6G tag=YG6T9JSD32EH type=write size=454999 2024-01-13T18:20:36.782 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.781+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~TBQY9W8MODYH.0 size=1048576 2024-01-13T18:20:36.783 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.782+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~TBQY9W8MODYH.1 size=605889 2024-01-13T18:20:36.783 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.782+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=TBQY9W8MODYH tag=SHTNKPQYV7KI type=write size=2703041 2024-01-13T18:20:36.786 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.785+0000 7f759fd04880 1 < suggested remove operation key=DOXP3EJ03EBY tag=7YZ23TZF7M78 type=del 2024-01-13T18:20:36.789 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.788+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~1GVV02T0TTK3.0 size=1048576 2024-01-13T18:20:36.790 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.789+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~1GVV02T0TTK3.1 size=127691 2024-01-13T18:20:36.790 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.789+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=1GVV02T0TTK3 tag=ZPWCZXGZNW3S type=write size=2224843 2024-01-13T18:20:36.791 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.790+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=M2FWHIGQG0FD type=del 2024-01-13T18:20:36.793 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.792+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~8H47OKFB2A5P.0 size=1048576 2024-01-13T18:20:36.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.794+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~8H47OKFB2A5P.1 size=1048576 2024-01-13T18:20:36.796 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.795+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~8H47OKFB2A5P.2 size=246840 2024-01-13T18:20:36.796 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.795+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=8H47OKFB2A5P tag=PXVJSN72SCED type=write size=3392568 2024-01-13T18:20:36.797 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.796+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~FP5UR1WNCCYV.0 size=1048576 2024-01-13T18:20:36.798 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.797+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~FP5UR1WNCCYV.1 size=857961 2024-01-13T18:20:36.800 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.799+0000 7f759fd04880 1 < completed multipart upload key=OMA1B74S8FXS upload=FP5UR1WNCCYV tag=EC3ITWNI711V type=write size=2955113 2024-01-13T18:20:36.803 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.802+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~0R38ZG15WIB7.0 size=1048576 2024-01-13T18:20:36.804 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.803+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~0R38ZG15WIB7.1 size=1048576 2024-01-13T18:20:36.805 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.804+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~0R38ZG15WIB7.2 size=884753 2024-01-13T18:20:36.805 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.804+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=0R38ZG15WIB7 tag=8J7C8FLYX58H type=write size=4030481 2024-01-13T18:20:36.806 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.805+0000 7f759fd04880 1 < canceled operation key=H4VHC37BOZJ3 tag=BQ0PV97ARD2R type=del size=1215233 2024-01-13T18:20:36.807 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.806+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=TMQXNQDR77QX type=del size=2212778 2024-01-13T18:20:36.809 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.808+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~PPD4KVPRRB4O.0 size=1048576 2024-01-13T18:20:36.810 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.809+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~PPD4KVPRRB4O.1 size=261524 2024-01-13T18:20:36.812 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.811+0000 7f759fd04880 1 < completed multipart upload key=OMA1B74S8FXS upload=PPD4KVPRRB4O tag=S7T8X8WZUWY0 type=write size=2358676 2024-01-13T18:20:36.814 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.813+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=DCES6A09CGGX type=write size=691953 2024-01-13T18:20:36.816 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.815+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~OS2BZINHX7FY.0 size=869060 2024-01-13T18:20:36.819 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.818+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=OS2BZINHX7FY tag=OOC9M22O1MOY type=write size=1917636 2024-01-13T18:20:36.821 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.820+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~LG5DTN4GIMR7.0 size=134239 2024-01-13T18:20:36.821 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.820+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=LG5DTN4GIMR7 tag=53ZFT4YHZMS7 type=write size=1182815 2024-01-13T18:20:36.823 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.822+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~BVT5HD1A3X8F.0 size=186060 2024-01-13T18:20:36.825 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.824+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=BVT5HD1A3X8F tag=5A8G1SAOJYQO type=write size=1234636 2024-01-13T18:20:36.827 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.826+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=4J0YK0KD00K4 type=del size=3070463 2024-01-13T18:20:36.828 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.827+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=OQ2UFEJ86SBN type=del 2024-01-13T18:20:36.830 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.829+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=9Y7D59MRL502 type=write size=518786 2024-01-13T18:20:36.831 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.830+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~2EZL1E22277N.0 size=1048576 2024-01-13T18:20:36.832 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.831+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~2EZL1E22277N.1 size=1048576 2024-01-13T18:20:36.833 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.832+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~2EZL1E22277N.2 size=912743 2024-01-13T18:20:36.835 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.834+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=2EZL1E22277N tag=SE377ZI4HOTP type=write size=4058471 2024-01-13T18:20:36.838 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.837+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~UDSN5X2NBMBS.0 size=1048576 2024-01-13T18:20:36.839 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.838+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~UDSN5X2NBMBS.1 size=725837 2024-01-13T18:20:36.839 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.838+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=UDSN5X2NBMBS tag=LD7AZBDCBU50 type=write size=2822989 2024-01-13T18:20:36.840 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.839+0000 7f759fd04880 1 < completed write operation key=EW3ZFDVIQZ7G tag=WYX9NF26LMR2 type=write size=952209 2024-01-13T18:20:36.843 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.842+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~4N4LR4QHXVQP.0 size=530388 2024-01-13T18:20:36.843 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.842+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=4N4LR4QHXVQP tag=D7AJQWI8NZRI type=write size=1578964 2024-01-13T18:20:36.844 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.843+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~224A5O0BKX9A.0 size=1048576 2024-01-13T18:20:36.846 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.845+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~224A5O0BKX9A.1 size=1048576 2024-01-13T18:20:36.847 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.846+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~224A5O0BKX9A.2 size=261191 2024-01-13T18:20:36.850 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.849+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=224A5O0BKX9A tag=NM29VWIXJLUT type=write size=3406919 2024-01-13T18:20:36.851 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.850+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=PRH32VMFP812 type=del size=2818361 2024-01-13T18:20:36.852 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.851+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=QIUNZZWBN603 type=del 2024-01-13T18:20:36.855 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.854+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~QIKGCUU5639H.0 size=1048576 2024-01-13T18:20:36.856 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.855+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~QIKGCUU5639H.1 size=405722 2024-01-13T18:20:36.856 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.855+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=QIKGCUU5639H tag=NS04IH2YPK4A type=write size=2502874 2024-01-13T18:20:36.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.856+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=F4008WLOWCEM type=del 2024-01-13T18:20:36.860 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.859+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~CF7JDZELL65E.0 size=1048576 2024-01-13T18:20:36.861 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.860+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~CF7JDZELL65E.1 size=1048576 2024-01-13T18:20:36.862 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.861+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~CF7JDZELL65E.2 size=779170 2024-01-13T18:20:36.862 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.861+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=CF7JDZELL65E tag=G1MUBVFHN2LW type=write size=3924898 2024-01-13T18:20:36.863 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.862+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~YABLY5NUR84S.0 size=1048576 2024-01-13T18:20:36.864 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.863+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~YABLY5NUR84S.1 size=1048576 2024-01-13T18:20:36.865 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.863+0000 7f759fd04880 1 < canceled part key=_multipart_TNC2YDZYGM6G.2~YABLY5NUR84S.2 size=983937 2024-01-13T18:20:36.867 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.866+0000 7f759fd04880 1 < canceled multipart upload key=TNC2YDZYGM6G upload=YABLY5NUR84S tag=19M3NF2F69R3 type=write size=4129665 2024-01-13T18:20:36.869 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.868+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~ZAB4WWDAIFBI.0 size=978855 2024-01-13T18:20:36.869 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.868+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=ZAB4WWDAIFBI tag=H70A34Y8TBUQ type=write size=2027431 2024-01-13T18:20:36.872 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.871+0000 7f759fd04880 1 < suggested remove operation key=RY0W5S41XK3F tag=23GMY6SS7O4D type=del 2024-01-13T18:20:36.875 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.873+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~XDL4EBI9SITC.0 size=989255 2024-01-13T18:20:36.875 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.873+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=XDL4EBI9SITC tag=L9QFSFJMRKA7 type=write size=2037831 2024-01-13T18:20:36.876 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.875+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~TBQY9W8MODYH.0 size=1048576 2024-01-13T18:20:36.876 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.875+0000 7f759fd04880 1 < canceled part key=_multipart_QD5GBLNCY707.2~TBQY9W8MODYH.1 size=605889 2024-01-13T18:20:36.878 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.877+0000 7f759fd04880 1 < canceled multipart upload key=QD5GBLNCY707 upload=TBQY9W8MODYH tag=SHTNKPQYV7KI type=write size=2703041 2024-01-13T18:20:36.880 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.879+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=IV3VBXFD950W type=write size=886493 2024-01-13T18:20:36.881 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.880+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~1GVV02T0TTK3.0 size=1048576 2024-01-13T18:20:36.882 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.881+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~1GVV02T0TTK3.1 size=127691 2024-01-13T18:20:36.884 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.883+0000 7f759fd04880 1 < completed multipart upload key=OMA1B74S8FXS upload=1GVV02T0TTK3 tag=ZPWCZXGZNW3S type=write size=2224843 2024-01-13T18:20:36.887 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.886+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~O3CNSVMJC680.0 size=1048576 2024-01-13T18:20:36.888 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.887+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~O3CNSVMJC680.1 size=1048576 2024-01-13T18:20:36.889 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.888+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~O3CNSVMJC680.2 size=500301 2024-01-13T18:20:36.889 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.888+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=O3CNSVMJC680 tag=H1AUR2Z5LGY8 type=write size=3646029 2024-01-13T18:20:36.890 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.889+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~8H47OKFB2A5P.0 size=1048576 2024-01-13T18:20:36.891 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.890+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~8H47OKFB2A5P.1 size=1048576 2024-01-13T18:20:36.892 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.891+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~8H47OKFB2A5P.2 size=246840 2024-01-13T18:20:36.894 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.893+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=8H47OKFB2A5P tag=PXVJSN72SCED type=write size=3392568 2024-01-13T18:20:36.896 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.895+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=ICYPZBM3H38Y type=del size=1187428 2024-01-13T18:20:36.897 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.896+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~0R38ZG15WIB7.0 size=1048576 2024-01-13T18:20:36.897 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.896+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~0R38ZG15WIB7.1 size=1048576 2024-01-13T18:20:36.898 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.897+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~0R38ZG15WIB7.2 size=884753 2024-01-13T18:20:36.901 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.900+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=0R38ZG15WIB7 tag=8J7C8FLYX58H type=write size=4030481 2024-01-13T18:20:36.903 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.902+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~B8Z2IU7ZJC3L.0 size=35176 2024-01-13T18:20:36.903 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.902+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=B8Z2IU7ZJC3L tag=AV7A13GJDL51 type=write size=1083752 2024-01-13T18:20:36.905 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.904+0000 7f759fd04880 1 < suggested remove operation key=2OO7S2NBZ7M6 tag=TMQXNQDR77QX type=del 2024-01-13T18:20:36.908 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.907+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~U4L187FXYLEC.0 size=543269 2024-01-13T18:20:36.908 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.907+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=U4L187FXYLEC tag=FMAV0F73ZF7A type=write size=1591845 2024-01-13T18:20:36.910 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.909+0000 7f759fd04880 1 < suggested remove operation key=H972TC5DOMHL tag=DCES6A09CGGX type=write 2024-01-13T18:20:36.912 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.911+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=LX1VL83P51S7 type=del size=3507337 2024-01-13T18:20:36.913 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.912+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~LG5DTN4GIMR7.0 size=134239 2024-01-13T18:20:36.916 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.915+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=LG5DTN4GIMR7 tag=53ZFT4YHZMS7 type=write size=1182815 2024-01-13T18:20:36.918 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.917+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~M30J3K5SSN3U.0 size=1048576 2024-01-13T18:20:36.919 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.919+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~M30J3K5SSN3U.1 size=923793 2024-01-13T18:20:36.920 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.919+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=M30J3K5SSN3U tag=V6K35ZOY9H8T type=write size=3020945 2024-01-13T18:20:36.921 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.920+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=4J0YK0KD00K4 type=del 2024-01-13T18:20:36.922 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.921+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=SXEJ6BQNT160 type=write size=119328 2024-01-13T18:20:36.925 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.924+0000 7f759fd04880 1 < suggested remove operation key=7R5YIO7UFSDZ tag=9Y7D59MRL502 type=write 2024-01-13T18:20:36.926 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.925+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=L1VEG6N7GR5V type=write size=1019610 2024-01-13T18:20:36.927 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.926+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~UDSN5X2NBMBS.0 size=1048576 2024-01-13T18:20:36.929 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.928+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~UDSN5X2NBMBS.1 size=725837 2024-01-13T18:20:36.931 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.930+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=UDSN5X2NBMBS tag=LD7AZBDCBU50 type=write size=2822989 2024-01-13T18:20:36.932 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.931+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=C2QIU3K1JLKM type=write size=964889 2024-01-13T18:20:36.933 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.932+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~4N4LR4QHXVQP.0 size=530388 2024-01-13T18:20:36.935 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.934+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=4N4LR4QHXVQP tag=D7AJQWI8NZRI type=write size=1578964 2024-01-13T18:20:36.937 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.936+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=TRCRZ96T7806 type=del size=2631326 2024-01-13T18:20:36.938 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.937+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=PRH32VMFP812 type=del 2024-01-13T18:20:36.939 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.938+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=CQ6MUAOC4XP4 type=write size=174983 2024-01-13T18:20:36.941 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.940+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~QIKGCUU5639H.0 size=1048576 2024-01-13T18:20:36.941 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.941+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~QIKGCUU5639H.1 size=405722 2024-01-13T18:20:36.944 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.943+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=QIKGCUU5639H tag=NS04IH2YPK4A type=write size=2502874 2024-01-13T18:20:36.946 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.945+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~7MA1CFRCIYBE.0 size=1048576 2024-01-13T18:20:36.947 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.946+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~7MA1CFRCIYBE.1 size=451008 2024-01-13T18:20:36.947 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.946+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=7MA1CFRCIYBE tag=BHOIG54HZ1B8 type=write size=2548160 2024-01-13T18:20:36.949 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.948+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~CF7JDZELL65E.0 size=1048576 2024-01-13T18:20:36.950 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.949+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~CF7JDZELL65E.1 size=1048576 2024-01-13T18:20:36.951 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.950+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~CF7JDZELL65E.2 size=779170 2024-01-13T18:20:36.953 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.952+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=CF7JDZELL65E tag=G1MUBVFHN2LW type=write size=3924898 2024-01-13T18:20:36.955 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.954+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~RIABLM0TCZTU.0 size=1048576 2024-01-13T18:20:36.956 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.955+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~RIABLM0TCZTU.1 size=741323 2024-01-13T18:20:36.956 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.955+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=RIABLM0TCZTU tag=XT5FQONK5D23 type=write size=2838475 2024-01-13T18:20:36.957 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.956+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~ZAB4WWDAIFBI.0 size=978855 2024-01-13T18:20:36.960 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.959+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=ZAB4WWDAIFBI tag=H70A34Y8TBUQ type=write size=2027431 2024-01-13T18:20:36.961 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.960+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=7W29YRFSPD8J type=del size=3119297 2024-01-13T18:20:36.962 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.961+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~XDL4EBI9SITC.0 size=989255 2024-01-13T18:20:36.964 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.964+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=XDL4EBI9SITC tag=L9QFSFJMRKA7 type=write size=2037831 2024-01-13T18:20:36.967 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.966+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~RFPPVUT30V72.0 size=1048576 2024-01-13T18:20:36.968 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.967+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~RFPPVUT30V72.1 size=920019 2024-01-13T18:20:36.968 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.967+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=RFPPVUT30V72 tag=HWOTOKVO04LA type=write size=3017171 2024-01-13T18:20:36.969 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.968+0000 7f759fd04880 1 < completed write operation key=QKNPXHB99KVP tag=IV3VBXFD950W type=write size=886493 2024-01-13T18:20:36.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.970+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=F20UM0M74FMM type=del size=3223549 2024-01-13T18:20:36.972 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.971+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~O3CNSVMJC680.0 size=1048576 2024-01-13T18:20:36.976 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.972+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~O3CNSVMJC680.1 size=1048576 2024-01-13T18:20:36.976 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.973+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~O3CNSVMJC680.2 size=500301 2024-01-13T18:20:36.977 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.975+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=O3CNSVMJC680 tag=H1AUR2Z5LGY8 type=write size=3646029 2024-01-13T18:20:36.978 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.977+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=J3FE26PCBN14 type=del size=2672818 2024-01-13T18:20:36.979 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.978+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=ICYPZBM3H38Y type=del 2024-01-13T18:20:36.982 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.981+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~4KL47DUE7QCP.0 size=708603 2024-01-13T18:20:36.982 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.981+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=4KL47DUE7QCP tag=G1ISIT7RM7F3 type=write size=1757179 2024-01-13T18:20:36.984 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.983+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~B8Z2IU7ZJC3L.0 size=35176 2024-01-13T18:20:36.987 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.986+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=B8Z2IU7ZJC3L tag=AV7A13GJDL51 type=write size=1083752 2024-01-13T18:20:36.988 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.987+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=IBOMBPY1JHV3 type=del size=3595611 2024-01-13T18:20:36.990 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.989+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~U4L187FXYLEC.0 size=543269 2024-01-13T18:20:36.992 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.991+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=U4L187FXYLEC tag=FMAV0F73ZF7A type=write size=1591845 2024-01-13T18:20:36.993 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.992+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=5L0U3VB09M7C type=write size=646727 2024-01-13T18:20:36.995 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.994+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=LX1VL83P51S7 type=del 2024-01-13T18:20:36.997 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.996+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~4C4XASUVOVBI.0 size=1048576 2024-01-13T18:20:36.998 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.997+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~4C4XASUVOVBI.1 size=1048576 2024-01-13T18:20:36.999 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.998+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~4C4XASUVOVBI.2 size=684605 2024-01-13T18:20:36.999 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:36.998+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=4C4XASUVOVBI tag=OHU3GBGUUE3E type=write size=3830333 2024-01-13T18:20:37.001 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.000+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~M30J3K5SSN3U.0 size=1048576 2024-01-13T18:20:37.002 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.001+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~M30J3K5SSN3U.1 size=923793 2024-01-13T18:20:37.004 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.003+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=M30J3K5SSN3U tag=V6K35ZOY9H8T type=write size=3020945 2024-01-13T18:20:37.005 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.004+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=6DSU0YPRCT5R type=del size=792330 2024-01-13T18:20:37.007 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.006+0000 7f759fd04880 1 < completed write operation key=AJZB1PXB1NB5 tag=SXEJ6BQNT160 type=write size=119328 2024-01-13T18:20:37.008 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.007+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=4NUV3864QPQ2 type=write size=445937 2024-01-13T18:20:37.010 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.009+0000 7f759fd04880 1 < completed write operation key=H7C1UAGAUR7D tag=L1VEG6N7GR5V type=write size=1019610 2024-01-13T18:20:37.012 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.011+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~35YGWUWC4YSY.0 size=854477 2024-01-13T18:20:37.012 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.011+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=35YGWUWC4YSY tag=1J30811619NX type=write size=1903053 2024-01-13T18:20:37.013 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.012+0000 7f759fd04880 1 < completed write operation key=ZI9WAZQHVPAR tag=C2QIU3K1JLKM type=write size=964889 2024-01-13T18:20:37.015 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.014+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=OKA3GZ594Z7K type=del size=1853049 2024-01-13T18:20:37.016 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.015+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=TRCRZ96T7806 type=del 2024-01-13T18:20:37.018 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.018+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~UBFOMTM5Q2NW.0 size=1048576 2024-01-13T18:20:37.020 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.019+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~UBFOMTM5Q2NW.1 size=230231 2024-01-13T18:20:37.020 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.019+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=UBFOMTM5Q2NW tag=UX89AYR0CBL4 type=write size=2327383 2024-01-13T18:20:37.021 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.020+0000 7f759fd04880 1 < completed write operation key=H7C1UAGAUR7D tag=CQ6MUAOC4XP4 type=write size=174983 2024-01-13T18:20:37.024 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.023+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~A6ISJGRTT55L.0 size=18565 2024-01-13T18:20:37.024 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.023+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=A6ISJGRTT55L tag=D2T339WTZ90Q type=write size=1067141 2024-01-13T18:20:37.025 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.024+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~7MA1CFRCIYBE.0 size=1048576 2024-01-13T18:20:37.026 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.025+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~7MA1CFRCIYBE.1 size=451008 2024-01-13T18:20:37.029 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.028+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=7MA1CFRCIYBE tag=BHOIG54HZ1B8 type=write size=2548160 2024-01-13T18:20:37.030 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.029+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=3QKFZQSISHOY type=del size=1693004 2024-01-13T18:20:37.031 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.030+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~RIABLM0TCZTU.0 size=1048576 2024-01-13T18:20:37.032 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.031+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~RIABLM0TCZTU.1 size=741323 2024-01-13T18:20:37.034 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.033+0000 7f759fd04880 1 < completed multipart upload key=VZHGQM6ZNJYQ upload=RIABLM0TCZTU tag=XT5FQONK5D23 type=write size=2838475 2024-01-13T18:20:37.036 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.035+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=PNEESECKF6ZM type=del size=2062079 2024-01-13T18:20:37.037 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.036+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=7W29YRFSPD8J type=del 2024-01-13T18:20:37.039 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.038+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=Z2ZE446QNN3A type=del size=3079088 2024-01-13T18:20:37.040 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.039+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~RFPPVUT30V72.0 size=1048576 2024-01-13T18:20:37.040 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.039+0000 7f759fd04880 1 < canceled part key=_multipart_P8FMRQR7GXN7.2~RFPPVUT30V72.1 size=920019 2024-01-13T18:20:37.043 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.042+0000 7f759fd04880 1 < canceled multipart upload key=P8FMRQR7GXN7 upload=RFPPVUT30V72 tag=HWOTOKVO04LA type=write size=3017171 2024-01-13T18:20:37.045 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.044+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~JE3HHXHFPKH1.0 size=1048576 2024-01-13T18:20:37.046 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.045+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~JE3HHXHFPKH1.1 size=230873 2024-01-13T18:20:37.047 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.045+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=JE3HHXHFPKH1 tag=D436NHH6VWMV type=write size=2328025 2024-01-13T18:20:37.047 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.046+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=F20UM0M74FMM type=del 2024-01-13T18:20:37.049 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.048+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=PDNADMP3S3KF type=del size=447614 2024-01-13T18:20:37.051 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.050+0000 7f759fd04880 1 < suggested update operation key=JGALONWJXLQY tag=J3FE26PCBN14 type=del size=2672818 2024-01-13T18:20:37.053 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.052+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=HU91V6VB0TR7 type=write size=884492 2024-01-13T18:20:37.054 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.053+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~4KL47DUE7QCP.0 size=708603 2024-01-13T18:20:37.056 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.055+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=4KL47DUE7QCP tag=G1ISIT7RM7F3 type=write size=1757179 2024-01-13T18:20:37.058 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.057+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=8H8FPW28DPQS type=del size=3671744 2024-01-13T18:20:37.059 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.058+0000 7f759fd04880 1 < completed delete operation key=QKNPXHB99KVP tag=IBOMBPY1JHV3 type=del 2024-01-13T18:20:37.060 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.059+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=C6Q5J7BF7I55 type=del size=534576 2024-01-13T18:20:37.062 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.061+0000 7f759fd04880 1 < completed write operation key=8EWIOXN5H9KU tag=5L0U3VB09M7C type=write size=646727 2024-01-13T18:20:37.063 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.062+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=2TAJEQLXCTG0 type=del size=3276068 2024-01-13T18:20:37.065 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.064+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~4C4XASUVOVBI.0 size=1048576 2024-01-13T18:20:37.065 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.064+0000 7f759fd04880 1 < canceled part key=_multipart_H972TC5DOMHL.2~4C4XASUVOVBI.1 size=1048576 2024-01-13T18:20:37.066 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.065+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~4C4XASUVOVBI.2 size=684605 2024-01-13T18:20:37.068 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.067+0000 7f759fd04880 1 < canceled multipart upload key=H972TC5DOMHL upload=4C4XASUVOVBI tag=OHU3GBGUUE3E type=write size=3830333 2024-01-13T18:20:37.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.068+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=AB055J62VDFS type=del size=2908061 2024-01-13T18:20:37.072 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.071+0000 7f759fd04880 1 < suggested update operation key=1YNH6QHP354U tag=6DSU0YPRCT5R type=del size=792330 2024-01-13T18:20:37.073 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.072+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=A13HLJGINP9W type=del size=1891866 2024-01-13T18:20:37.075 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.074+0000 7f759fd04880 1 < canceled operation key=AJZB1PXB1NB5 tag=4NUV3864QPQ2 type=write size=445937 2024-01-13T18:20:37.076 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.075+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=D009RUC80JQP type=del size=718403 2024-01-13T18:20:37.076 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.075+0000 7f759fd04880 1 < canceled part key=_multipart_BPUBFFWB9D3C.2~35YGWUWC4YSY.0 size=854477 2024-01-13T18:20:37.079 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.078+0000 7f759fd04880 1 < canceled multipart upload key=BPUBFFWB9D3C upload=35YGWUWC4YSY tag=1J30811619NX type=write size=1903053 2024-01-13T18:20:37.081 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.080+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~PZ8MKA1PJ92V.0 size=148555 2024-01-13T18:20:37.081 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.080+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=PZ8MKA1PJ92V tag=8BWQ17GCAYCX type=write size=1197131 2024-01-13T18:20:37.082 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.081+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=OKA3GZ594Z7K type=del 2024-01-13T18:20:37.085 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.084+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~P4FR31CJ413H.0 size=1048576 2024-01-13T18:20:37.086 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.085+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~P4FR31CJ413H.1 size=1048576 2024-01-13T18:20:37.087 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.086+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~P4FR31CJ413H.2 size=854160 2024-01-13T18:20:37.087 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.086+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=P4FR31CJ413H tag=AX572LJTMTRQ type=write size=3999888 2024-01-13T18:20:37.088 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.087+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~UBFOMTM5Q2NW.0 size=1048576 2024-01-13T18:20:37.089 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.088+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~UBFOMTM5Q2NW.1 size=230231 2024-01-13T18:20:37.092 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.091+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=UBFOMTM5Q2NW tag=UX89AYR0CBL4 type=write size=2327383 2024-01-13T18:20:37.095 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.094+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~UV6R93915XSB.0 size=1048576 2024-01-13T18:20:37.095 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.095+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~UV6R93915XSB.1 size=1048576 2024-01-13T18:20:37.097 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.096+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~UV6R93915XSB.2 size=460948 2024-01-13T18:20:37.097 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.096+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=UV6R93915XSB tag=QSLE7SAAS78S type=write size=3606676 2024-01-13T18:20:37.097 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.096+0000 7f759fd04880 1 < canceled part key=_multipart_DOXP3EJ03EBY.2~A6ISJGRTT55L.0 size=18565 2024-01-13T18:20:37.099 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.098+0000 7f759fd04880 1 < canceled multipart upload key=DOXP3EJ03EBY upload=A6ISJGRTT55L tag=D2T339WTZ90Q type=write size=1067141 2024-01-13T18:20:37.100 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.100+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=Q0JTDVT1OXC1 type=del size=1303253 2024-01-13T18:20:37.102 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.101+0000 7f759fd04880 1 < canceled operation key=OMA1B74S8FXS tag=3QKFZQSISHOY type=del size=1693004 2024-01-13T18:20:37.104 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.103+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=OL53N8QTID29 type=write size=657575 2024-01-13T18:20:37.105 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.105+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=PNEESECKF6ZM type=del 2024-01-13T18:20:37.107 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.106+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=J6922UAKYP7T type=del size=3631251 2024-01-13T18:20:37.108 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.107+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=Z2ZE446QNN3A type=del 2024-01-13T18:20:37.110 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.109+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=GGJD243KFAV0 type=del size=241631 2024-01-13T18:20:37.111 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.110+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~JE3HHXHFPKH1.0 size=1048576 2024-01-13T18:20:37.113 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.112+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~JE3HHXHFPKH1.1 size=230873 2024-01-13T18:20:37.115 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.114+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=JE3HHXHFPKH1 tag=D436NHH6VWMV type=write size=2328025 2024-01-13T18:20:37.117 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.116+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=9OGZFPMQ3WHU type=del size=1604169 2024-01-13T18:20:37.118 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.117+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=PDNADMP3S3KF type=del 2024-01-13T18:20:37.119 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.118+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=9BIC5N6JZN8H type=write size=199639 2024-01-13T18:20:37.121 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.120+0000 7f759fd04880 1 < completed write operation key=1QEZO616DBC3 tag=HU91V6VB0TR7 type=write size=884492 2024-01-13T18:20:37.122 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.121+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=2JF63ZMBVI7H type=del size=1164377 2024-01-13T18:20:37.124 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.123+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=8H8FPW28DPQS type=del 2024-01-13T18:20:37.125 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.124+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=S4P4IJS32Q1W type=del size=63491 2024-01-13T18:20:37.126 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.126+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=C6Q5J7BF7I55 type=del 2024-01-13T18:20:37.129 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.128+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~E0BX1297YEIV.0 size=938482 2024-01-13T18:20:37.129 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.128+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=E0BX1297YEIV tag=Z2FK8I80GOOY type=write size=1987058 2024-01-13T18:20:37.130 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.129+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=2TAJEQLXCTG0 type=del 2024-01-13T18:20:37.132 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.131+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=PAIP3WF2N7SR type=write size=371730 2024-01-13T18:20:37.133 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.132+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=AB055J62VDFS type=del 2024-01-13T18:20:37.135 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.134+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=69FRBS4CV8XT type=write size=791741 2024-01-13T18:20:37.136 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.135+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=A13HLJGINP9W type=del 2024-01-13T18:20:37.138 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.137+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=R1XKMNVWALIA type=del size=3076220 2024-01-13T18:20:37.139 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.138+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=D009RUC80JQP type=del 2024-01-13T18:20:37.140 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.139+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=NTMWPBH7X6R3 type=write size=658263 2024-01-13T18:20:37.142 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.141+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~PZ8MKA1PJ92V.0 size=148555 2024-01-13T18:20:37.144 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.143+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=PZ8MKA1PJ92V tag=8BWQ17GCAYCX type=write size=1197131 2024-01-13T18:20:37.146 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.145+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=SP9L3P3BOQ44 type=write size=107706 2024-01-13T18:20:37.147 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.146+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~P4FR31CJ413H.0 size=1048576 2024-01-13T18:20:37.149 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.148+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~P4FR31CJ413H.1 size=1048576 2024-01-13T18:20:37.150 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.149+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~P4FR31CJ413H.2 size=854160 2024-01-13T18:20:37.152 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.151+0000 7f759fd04880 1 < completed multipart upload key=OMA1B74S8FXS upload=P4FR31CJ413H tag=AX572LJTMTRQ type=write size=3999888 2024-01-13T18:20:37.155 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.154+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~6CWKBQUC8X71.0 size=1048576 2024-01-13T18:20:37.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.155+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~6CWKBQUC8X71.1 size=893330 2024-01-13T18:20:37.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.155+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=6CWKBQUC8X71 tag=KDE38IKMBSP3 type=write size=2990482 2024-01-13T18:20:37.157 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.156+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~UV6R93915XSB.0 size=1048576 2024-01-13T18:20:37.158 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.157+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~UV6R93915XSB.1 size=1048576 2024-01-13T18:20:37.159 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.159+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~UV6R93915XSB.2 size=460948 2024-01-13T18:20:37.162 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.161+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=UV6R93915XSB tag=QSLE7SAAS78S type=write size=3606676 2024-01-13T18:20:37.165 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.164+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=3A1O4USBYAPT type=del size=1794772 2024-01-13T18:20:37.167 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.166+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=Q0JTDVT1OXC1 type=del 2024-01-13T18:20:37.172 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.171+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~IPVI1OUD333H.0 size=987152 2024-01-13T18:20:37.172 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.171+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=IPVI1OUD333H tag=CY4W7B0CR1H8 type=write size=2035728 2024-01-13T18:20:37.173 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.172+0000 7f759fd04880 1 < completed write operation key=OMA1B74S8FXS tag=OL53N8QTID29 type=write size=657575 2024-01-13T18:20:37.176 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.175+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~D81CJHE985YQ.0 size=1048576 2024-01-13T18:20:37.177 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.176+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~D81CJHE985YQ.1 size=993118 2024-01-13T18:20:37.177 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.176+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=D81CJHE985YQ tag=8C0OWVT7NO2E type=write size=3090270 2024-01-13T18:20:37.179 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.178+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=J6922UAKYP7T type=del 2024-01-13T18:20:37.181 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.180+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=BVL2H706A55H type=write size=678279 2024-01-13T18:20:37.184 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.181+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=GGJD243KFAV0 type=del 2024-01-13T18:20:37.184 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.183+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=9VUKC5U1OITS type=del size=49244 2024-01-13T18:20:37.185 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.184+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=9OGZFPMQ3WHU type=del 2024-01-13T18:20:37.187 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.186+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=7FFCQ2WIUJ53 type=del size=3509736 2024-01-13T18:20:37.188 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.187+0000 7f759fd04880 1 < completed write operation key=7WRTM9ANJRT4 tag=9BIC5N6JZN8H type=write size=199639 2024-01-13T18:20:37.189 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.188+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=RXSO66BMLN2I type=del size=3937647 2024-01-13T18:20:37.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.190+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=2JF63ZMBVI7H type=del 2024-01-13T18:20:37.194 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.193+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~FA50HQ1PSITS.0 size=195540 2024-01-13T18:20:37.194 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.193+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=FA50HQ1PSITS tag=J7BZ8NLD0UQ6 type=write size=1244116 2024-01-13T18:20:37.195 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.194+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=S4P4IJS32Q1W type=del 2024-01-13T18:20:37.198 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.197+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~E1AKUTP4OLG6.0 size=1048576 2024-01-13T18:20:37.199 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.198+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~E1AKUTP4OLG6.1 size=1048576 2024-01-13T18:20:37.200 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.199+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~E1AKUTP4OLG6.2 size=737325 2024-01-13T18:20:37.200 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.199+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=E1AKUTP4OLG6 tag=S4BV9M22AQBY type=write size=3883053 2024-01-13T18:20:37.202 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.201+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~E0BX1297YEIV.0 size=938482 2024-01-13T18:20:37.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.203+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=E0BX1297YEIV tag=Z2FK8I80GOOY type=write size=1987058 2024-01-13T18:20:37.207 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.206+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~9O38OXJ78LZE.0 size=1048576 2024-01-13T18:20:37.208 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.207+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~9O38OXJ78LZE.1 size=586284 2024-01-13T18:20:37.208 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.207+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=9O38OXJ78LZE tag=FC3LYDICWMMK type=write size=2683436 2024-01-13T18:20:37.209 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.208+0000 7f759fd04880 1 < completed write operation key=P8FMRQR7GXN7 tag=PAIP3WF2N7SR type=write size=371730 2024-01-13T18:20:37.212 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.211+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~7DJKCX7DQVRP.0 size=1048576 2024-01-13T18:20:37.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.212+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~7DJKCX7DQVRP.1 size=1048576 2024-01-13T18:20:37.214 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.213+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~7DJKCX7DQVRP.2 size=308690 2024-01-13T18:20:37.214 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.213+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=7DJKCX7DQVRP tag=A47KEZ3TYKFU type=write size=3454418 2024-01-13T18:20:37.217 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.216+0000 7f759fd04880 1 < suggested update operation key=WSRJB811XCVL tag=69FRBS4CV8XT type=write size=791741 2024-01-13T18:20:37.219 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.218+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=T9QLYM5WQVTD type=del size=799480 2024-01-13T18:20:37.220 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.219+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=R1XKMNVWALIA type=del 2024-01-13T18:20:37.222 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.221+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=QKE6QX4N2241 type=del size=2125144 2024-01-13T18:20:37.224 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.223+0000 7f759fd04880 -1 < failed to complete operation key=WSRJB811XCVL tag=NTMWPBH7X6R3 type=write size=658263: (22) Invalid argument 2024-01-13T18:20:37.225 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.224+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=FXW1HE8LSAWD type=write size=429484 2024-01-13T18:20:37.227 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.226+0000 7f759fd04880 1 < completed write operation key=JN46AMLYHN8E tag=SP9L3P3BOQ44 type=write size=107706 2024-01-13T18:20:37.228 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.227+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=Z3CW1DE3DNI0 type=del size=2860416 2024-01-13T18:20:37.230 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.229+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~6CWKBQUC8X71.0 size=1048576 2024-01-13T18:20:37.231 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.230+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~6CWKBQUC8X71.1 size=893330 2024-01-13T18:20:37.234 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.233+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=6CWKBQUC8X71 tag=KDE38IKMBSP3 type=write size=2990482 2024-01-13T18:20:37.235 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.234+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=ISV6VHCHC1O6 type=del size=463343 2024-01-13T18:20:37.237 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.236+0000 7f759fd04880 1 < canceled operation key=VZHGQM6ZNJYQ tag=3A1O4USBYAPT type=del size=1794772 2024-01-13T18:20:37.239 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.237+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=31H22KIXAYK4 type=write size=283130 2024-01-13T18:20:37.240 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.239+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~IPVI1OUD333H.0 size=987152 2024-01-13T18:20:37.242 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.241+0000 7f759fd04880 1 < completed multipart upload key=7R5YIO7UFSDZ upload=IPVI1OUD333H tag=CY4W7B0CR1H8 type=write size=2035728 2024-01-13T18:20:37.244 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.243+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=GT6UKZ1RE072 type=del size=3482389 2024-01-13T18:20:37.244 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.243+0000 7f759fd04880 1 < canceled part key=_multipart_1YNH6QHP354U.2~D81CJHE985YQ.0 size=1048576 2024-01-13T18:20:37.246 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.245+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~D81CJHE985YQ.1 size=993118 2024-01-13T18:20:37.248 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.247+0000 7f759fd04880 1 < canceled multipart upload key=1YNH6QHP354U upload=D81CJHE985YQ tag=8C0OWVT7NO2E type=write size=3090270 2024-01-13T18:20:37.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.248+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=SP2I9FLBXX0W type=del size=155476 2024-01-13T18:20:37.251 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.250+0000 7f759fd04880 1 < completed write operation key=RY0W5S41XK3F tag=BVL2H706A55H type=write size=678279 2024-01-13T18:20:37.252 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.251+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=BKK74RYR6GET type=del size=3051888 2024-01-13T18:20:37.253 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.252+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=9VUKC5U1OITS type=del 2024-01-13T18:20:37.256 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.255+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~B7TAYLPHOQ5F.0 size=1024381 2024-01-13T18:20:37.256 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.255+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=B7TAYLPHOQ5F tag=FC8CCU0AAF5I type=write size=2072957 2024-01-13T18:20:37.258 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.257+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=7FFCQ2WIUJ53 type=del 2024-01-13T18:20:37.261 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.260+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~E7AGRR4DI4PV.0 size=1048576 2024-01-13T18:20:37.262 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.261+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~E7AGRR4DI4PV.1 size=599327 2024-01-13T18:20:37.262 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.261+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=E7AGRR4DI4PV tag=PASCZ3LF3R0V type=write size=2696479 2024-01-13T18:20:37.263 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.263+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=RXSO66BMLN2I type=del 2024-01-13T18:20:37.265 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.264+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=L6OBMA3OZW7B type=del size=3306512 2024-01-13T18:20:37.266 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.265+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~FA50HQ1PSITS.0 size=195540 2024-01-13T18:20:37.269 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.268+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=FA50HQ1PSITS tag=J7BZ8NLD0UQ6 type=write size=1244116 2024-01-13T18:20:37.270 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.269+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=AT0WVZD4R8VJ type=del size=3452949 2024-01-13T18:20:37.271 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.270+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~E1AKUTP4OLG6.0 size=1048576 2024-01-13T18:20:37.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.270+0000 7f759fd04880 1 < canceled part key=_multipart_RY0W5S41XK3F.2~E1AKUTP4OLG6.1 size=1048576 2024-01-13T18:20:37.273 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.272+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~E1AKUTP4OLG6.2 size=737325 2024-01-13T18:20:37.275 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.274+0000 7f759fd04880 1 < canceled multipart upload key=RY0W5S41XK3F upload=E1AKUTP4OLG6 tag=S4BV9M22AQBY type=write size=3883053 2024-01-13T18:20:37.277 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.276+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~2Q711AJHH7DO.0 size=287330 2024-01-13T18:20:37.277 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.276+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=2Q711AJHH7DO tag=IM0BYFUDUVRT type=write size=1335906 2024-01-13T18:20:37.279 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.278+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~9O38OXJ78LZE.0 size=1048576 2024-01-13T18:20:37.280 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.279+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~9O38OXJ78LZE.1 size=586284 2024-01-13T18:20:37.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.281+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=9O38OXJ78LZE tag=FC3LYDICWMMK type=write size=2683436 2024-01-13T18:20:37.285 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.284+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~EE5QD4B7WGC5.0 size=440255 2024-01-13T18:20:37.285 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.284+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=EE5QD4B7WGC5 tag=T5H75ZLXP24B type=write size=1488831 2024-01-13T18:20:37.286 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.285+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~7DJKCX7DQVRP.0 size=1048576 2024-01-13T18:20:37.288 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.286+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~7DJKCX7DQVRP.1 size=1048576 2024-01-13T18:20:37.288 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.287+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~7DJKCX7DQVRP.2 size=308690 2024-01-13T18:20:37.291 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.290+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=7DJKCX7DQVRP tag=A47KEZ3TYKFU type=write size=3454418 2024-01-13T18:20:37.293 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.292+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~3LJ60YBQCP6W.0 size=1048576 2024-01-13T18:20:37.294 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.293+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~3LJ60YBQCP6W.1 size=1048576 2024-01-13T18:20:37.296 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.295+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~3LJ60YBQCP6W.2 size=638861 2024-01-13T18:20:37.296 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.295+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=3LJ60YBQCP6W tag=M0YCKSTNY36K type=write size=3784589 2024-01-13T18:20:37.297 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.296+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=T9QLYM5WQVTD type=del 2024-01-13T18:20:37.299 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.298+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=B4TAHAW2JTHT type=del size=422814 2024-01-13T18:20:37.300 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.299+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=QKE6QX4N2241 type=del 2024-01-13T18:20:37.302 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.301+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=TTYML6Z4YJFO type=del size=3755889 2024-01-13T18:20:37.303 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.302+0000 7f759fd04880 1 < completed write operation key=1YNH6QHP354U tag=FXW1HE8LSAWD type=write size=429484 2024-01-13T18:20:37.305 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.304+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=TB94Q6M1LXNY type=del size=1846124 2024-01-13T18:20:37.307 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.306+0000 7f759fd04880 1 < suggested update operation key=EW3ZFDVIQZ7G tag=Z3CW1DE3DNI0 type=del size=2860416 2024-01-13T18:20:37.309 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.308+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=0A6IRVCURMW2 type=del size=3456295 2024-01-13T18:20:37.311 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.309+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=ISV6VHCHC1O6 type=del 2024-01-13T18:20:37.312 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.311+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=CQDFL9M7PMM4 type=del size=1669435 2024-01-13T18:20:37.313 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.312+0000 7f759fd04880 1 < completed write operation key=RY0W5S41XK3F tag=31H22KIXAYK4 type=write size=283130 2024-01-13T18:20:37.316 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.315+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~Q5TXS2MLZPXD.0 size=1048576 2024-01-13T18:20:37.317 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.316+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~Q5TXS2MLZPXD.1 size=1048576 2024-01-13T18:20:37.318 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.317+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~Q5TXS2MLZPXD.2 size=347029 2024-01-13T18:20:37.318 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.317+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=Q5TXS2MLZPXD tag=1XQ0Z34OW255 type=write size=3492757 2024-01-13T18:20:37.319 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.318+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=GT6UKZ1RE072 type=del 2024-01-13T18:20:37.321 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.320+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=DC1CNSQOQTQ9 type=del size=1549307 2024-01-13T18:20:37.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.323+0000 7f759fd04880 1 < suggested update operation key=OMA1B74S8FXS tag=SP2I9FLBXX0W type=del size=155476 2024-01-13T18:20:37.327 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.326+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~ZSHDO837E410.0 size=1048576 2024-01-13T18:20:37.328 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.327+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~ZSHDO837E410.1 size=240357 2024-01-13T18:20:37.328 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.327+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=ZSHDO837E410 tag=KI0584TKATK0 type=write size=2337509 2024-01-13T18:20:37.331 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.330+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=BKK74RYR6GET type=del 2024-01-13T18:20:37.332 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.331+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=44SBZA28GYH2 type=del size=3854495 2024-01-13T18:20:37.333 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.332+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~B7TAYLPHOQ5F.0 size=1024381 2024-01-13T18:20:37.336 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.335+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=B7TAYLPHOQ5F tag=FC8CCU0AAF5I type=write size=2072957 2024-01-13T18:20:37.339 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.338+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~SBJQ5K1AZRIY.0 size=1048576 2024-01-13T18:20:37.340 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.339+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~SBJQ5K1AZRIY.1 size=939121 2024-01-13T18:20:37.340 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.339+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=SBJQ5K1AZRIY tag=456I1EVIEV5K type=write size=3036273 2024-01-13T18:20:37.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.340+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~E7AGRR4DI4PV.0 size=1048576 2024-01-13T18:20:37.342 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.341+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~E7AGRR4DI4PV.1 size=599327 2024-01-13T18:20:37.345 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.344+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=E7AGRR4DI4PV tag=PASCZ3LF3R0V type=write size=2696479 2024-01-13T18:20:37.346 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.345+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=G5D2TV5B6EP0 type=del size=3108390 2024-01-13T18:20:37.348 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.347+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=L6OBMA3OZW7B type=del 2024-01-13T18:20:37.349 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.348+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=3QIG0J56MP1L type=del size=1637625 2024-01-13T18:20:37.351 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.350+0000 7f759fd04880 -1 < failed to complete operation key=EW3ZFDVIQZ7G tag=AT0WVZD4R8VJ type=del size=3452949: (22) Invalid argument 2024-01-13T18:20:37.352 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.351+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=DTUXGKXLT00Z type=del size=19571 2024-01-13T18:20:37.354 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.353+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~2Q711AJHH7DO.0 size=287330 2024-01-13T18:20:37.356 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.355+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=2Q711AJHH7DO tag=IM0BYFUDUVRT type=write size=1335906 2024-01-13T18:20:37.359 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.358+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~1QQMYAFSZ5Z6.0 size=1048576 2024-01-13T18:20:37.360 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.359+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~1QQMYAFSZ5Z6.1 size=1020015 2024-01-13T18:20:37.360 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.359+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=1QQMYAFSZ5Z6 tag=5C7TB5HYNUJS type=write size=3117167 2024-01-13T18:20:37.361 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.360+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~EE5QD4B7WGC5.0 size=440255 2024-01-13T18:20:37.364 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.363+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=EE5QD4B7WGC5 tag=T5H75ZLXP24B type=write size=1488831 2024-01-13T18:20:37.366 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.365+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=0C60BC62U8BD type=del size=2268564 2024-01-13T18:20:37.367 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.366+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~3LJ60YBQCP6W.0 size=1048576 2024-01-13T18:20:37.369 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.368+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~3LJ60YBQCP6W.1 size=1048576 2024-01-13T18:20:37.370 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.369+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~3LJ60YBQCP6W.2 size=638861 2024-01-13T18:20:37.372 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.371+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=3LJ60YBQCP6W tag=M0YCKSTNY36K type=write size=3784589 2024-01-13T18:20:37.374 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.373+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=CQ5Z4WR2T8DO type=del size=1611900 2024-01-13T18:20:37.376 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.375+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=B4TAHAW2JTHT type=del 2024-01-13T18:20:37.377 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.376+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=PAIW3ZS08FWY type=write size=174247 2024-01-13T18:20:37.379 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.378+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=TTYML6Z4YJFO type=del 2024-01-13T18:20:37.382 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.381+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~FH4LKPEJLIR1.0 size=1048576 2024-01-13T18:20:37.383 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.382+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~FH4LKPEJLIR1.1 size=1048576 2024-01-13T18:20:37.384 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.383+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~FH4LKPEJLIR1.2 size=51271 2024-01-13T18:20:37.384 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.383+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=FH4LKPEJLIR1 tag=XJZ05GAA3TZO type=write size=3196999 2024-01-13T18:20:37.385 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.384+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=TB94Q6M1LXNY type=del 2024-01-13T18:20:37.388 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.387+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~RNGTGV9PRL3T.0 size=621700 2024-01-13T18:20:37.388 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.387+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=RNGTGV9PRL3T tag=9XGVX5J43YIK type=write size=1670276 2024-01-13T18:20:37.391 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.388+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=0A6IRVCURMW2 type=del 2024-01-13T18:20:37.392 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.391+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~GGJEC3LTB0AA.0 size=1048576 2024-01-13T18:20:37.393 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.392+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~GGJEC3LTB0AA.1 size=156074 2024-01-13T18:20:37.394 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.392+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=GGJEC3LTB0AA tag=FMZ44QRYDVIZ type=write size=2253226 2024-01-13T18:20:37.396 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.396+0000 7f759fd04880 1 < suggested remove operation key=QS9PLJKINY4R tag=CQDFL9M7PMM4 type=del 2024-01-13T18:20:37.399 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.398+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~C0MOOPP2AZ72.0 size=1048576 2024-01-13T18:20:37.400 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.399+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~C0MOOPP2AZ72.1 size=1012374 2024-01-13T18:20:37.400 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.399+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=C0MOOPP2AZ72 tag=N2WHNM0D163E type=write size=3109526 2024-01-13T18:20:37.402 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.401+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~Q5TXS2MLZPXD.0 size=1048576 2024-01-13T18:20:37.403 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.402+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~Q5TXS2MLZPXD.1 size=1048576 2024-01-13T18:20:37.404 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.403+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~Q5TXS2MLZPXD.2 size=347029 2024-01-13T18:20:37.407 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.406+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=Q5TXS2MLZPXD tag=1XQ0Z34OW255 type=write size=3492757 2024-01-13T18:20:37.410 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.409+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~1VC95ZUCXPJ0.0 size=1048576 2024-01-13T18:20:37.411 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.410+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~1VC95ZUCXPJ0.1 size=391270 2024-01-13T18:20:37.411 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.410+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=1VC95ZUCXPJ0 tag=8V9LVLS0YXZC type=write size=2488422 2024-01-13T18:20:37.413 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.412+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=DC1CNSQOQTQ9 type=del 2024-01-13T18:20:37.416 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.415+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~3ZMZGBC24RLM.0 size=993001 2024-01-13T18:20:37.416 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.415+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=3ZMZGBC24RLM tag=AZ23EDTD2Y1L type=write size=2041577 2024-01-13T18:20:37.417 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.416+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~ZSHDO837E410.0 size=1048576 2024-01-13T18:20:37.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.417+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~ZSHDO837E410.1 size=240357 2024-01-13T18:20:37.420 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.419+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=ZSHDO837E410 tag=KI0584TKATK0 type=write size=2337509 2024-01-13T18:20:37.422 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.421+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=GRT0TYK3FICT type=del size=1247550 2024-01-13T18:20:37.425 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.424+0000 7f759fd04880 1 < suggested remove operation key=QD5GBLNCY707 tag=44SBZA28GYH2 type=del 2024-01-13T18:20:37.426 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.425+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=BD9IHMP5CA9Z type=del size=2259395 2024-01-13T18:20:37.428 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.427+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~SBJQ5K1AZRIY.0 size=1048576 2024-01-13T18:20:37.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:37 smithi084 ceph-mon[119097]: osdmap e1118: 8 total, 8 up, 8 in 2024-01-13T18:20:37.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:37 smithi084 ceph-mon[119097]: pgmap v1457: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:37.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:37 smithi084 ceph-mon[116404]: osdmap e1118: 8 total, 8 up, 8 in 2024-01-13T18:20:37.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:37 smithi084 ceph-mon[116404]: pgmap v1457: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:37.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.428+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~SBJQ5K1AZRIY.1 size=939121 2024-01-13T18:20:37.431 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.430+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=SBJQ5K1AZRIY tag=456I1EVIEV5K type=write size=3036273 2024-01-13T18:20:37.433 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.432+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=VXGYX60ODRH5 type=del size=2511336 2024-01-13T18:20:37.434 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.433+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=G5D2TV5B6EP0 type=del 2024-01-13T18:20:37.435 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.434+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=O9G1AO6VU4U6 type=del size=1325457 2024-01-13T18:20:37.437 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.436+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=3QIG0J56MP1L type=del 2024-01-13T18:20:37.438 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.438+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=1JYH9MZOJNV2 type=del size=3623405 2024-01-13T18:20:37.440 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.440+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=DTUXGKXLT00Z type=del 2024-01-13T18:20:37.442 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.441+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=FXFNBC7VPZTC type=del size=884596 2024-01-13T18:20:37.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.442+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~1QQMYAFSZ5Z6.0 size=1048576 2024-01-13T18:20:37.444 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.444+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~1QQMYAFSZ5Z6.1 size=1020015 2024-01-13T18:20:37.447 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.446+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=1QQMYAFSZ5Z6 tag=5C7TB5HYNUJS type=write size=3117167 2024-01-13T18:20:37.449 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.448+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=UN43KYVE0T0D type=del size=3036818 2024-01-13T18:20:37.450 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.449+0000 7f759fd04880 1 < canceled operation key=DOXP3EJ03EBY tag=0C60BC62U8BD type=del size=2268564 2024-01-13T18:20:37.452 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.451+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=DSIHY7335FPB type=del size=534738 2024-01-13T18:20:37.453 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.452+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=CQ5Z4WR2T8DO type=del 2024-01-13T18:20:37.455 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.454+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=VYYYHVOR5414 type=del size=2379018 2024-01-13T18:20:37.456 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.455+0000 7f759fd04880 1 < completed write operation key=7R5YIO7UFSDZ tag=PAIW3ZS08FWY type=write size=174247 2024-01-13T18:20:37.458 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.457+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=TLEPDI3YCBKM type=write size=856551 2024-01-13T18:20:37.459 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.458+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~FH4LKPEJLIR1.0 size=1048576 2024-01-13T18:20:37.461 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.460+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~FH4LKPEJLIR1.1 size=1048576 2024-01-13T18:20:37.462 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.461+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~FH4LKPEJLIR1.2 size=51271 2024-01-13T18:20:37.465 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.464+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=FH4LKPEJLIR1 tag=XJZ05GAA3TZO type=write size=3196999 2024-01-13T18:20:37.467 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.466+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=N6TNT2009445 type=del size=1889594 2024-01-13T18:20:37.467 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.466+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~RNGTGV9PRL3T.0 size=621700 2024-01-13T18:20:37.469 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.468+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=RNGTGV9PRL3T tag=9XGVX5J43YIK type=write size=1670276 2024-01-13T18:20:37.471 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.470+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=6K4ALW5YV2CN type=del size=3760667 2024-01-13T18:20:37.473 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.472+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~GGJEC3LTB0AA.0 size=1048576 2024-01-13T18:20:37.474 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.473+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~GGJEC3LTB0AA.1 size=156074 2024-01-13T18:20:37.477 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.476+0000 7f759fd04880 1 < completed multipart upload key=7R5YIO7UFSDZ upload=GGJEC3LTB0AA tag=FMZ44QRYDVIZ type=write size=2253226 2024-01-13T18:20:37.478 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.477+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=3I3PM3Y65EWP type=del size=3928796 2024-01-13T18:20:37.480 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.479+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~C0MOOPP2AZ72.0 size=1048576 2024-01-13T18:20:37.482 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.481+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~C0MOOPP2AZ72.1 size=1012374 2024-01-13T18:20:37.485 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.484+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=C0MOOPP2AZ72 tag=N2WHNM0D163E type=write size=3109526 2024-01-13T18:20:37.487 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.487+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~CPX4T3FNM2BI.0 size=1048576 2024-01-13T18:20:37.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.488+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~CPX4T3FNM2BI.1 size=691653 2024-01-13T18:20:37.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.488+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=CPX4T3FNM2BI tag=HUKQOZG2RQKR type=write size=2788805 2024-01-13T18:20:37.490 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.489+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~1VC95ZUCXPJ0.0 size=1048576 2024-01-13T18:20:37.492 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.491+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~1VC95ZUCXPJ0.1 size=391270 2024-01-13T18:20:37.494 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.493+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=1VC95ZUCXPJ0 tag=8V9LVLS0YXZC type=write size=2488422 2024-01-13T18:20:37.498 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.497+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~M29JNWSDUPV1.0 size=1048576 2024-01-13T18:20:37.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.498+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~M29JNWSDUPV1.1 size=230902 2024-01-13T18:20:37.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.498+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=M29JNWSDUPV1 tag=LMA8BUQD0M66 type=write size=2328054 2024-01-13T18:20:37.501 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.500+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~3ZMZGBC24RLM.0 size=993001 2024-01-13T18:20:37.504 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.503+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=3ZMZGBC24RLM tag=AZ23EDTD2Y1L type=write size=2041577 2024-01-13T18:20:37.505 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.504+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=FLHSINKRDTWS type=del size=3729729 2024-01-13T18:20:37.508 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.507+0000 7f759fd04880 1 < suggested remove operation key=6GOU0WSHKUQ0 tag=GRT0TYK3FICT type=del 2024-01-13T18:20:37.510 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.509+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=HF14LAYVNCMR type=del size=2039107 2024-01-13T18:20:37.511 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.510+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=BD9IHMP5CA9Z type=del 2024-01-13T18:20:37.514 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.513+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~1GFI9E5X0NFC.0 size=1048576 2024-01-13T18:20:37.516 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.515+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~1GFI9E5X0NFC.1 size=996411 2024-01-13T18:20:37.516 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.515+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=1GFI9E5X0NFC tag=1EUY6J606PYT type=write size=3093563 2024-01-13T18:20:37.517 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.516+0000 7f759fd04880 1 < canceled operation key=QD5GBLNCY707 tag=VXGYX60ODRH5 type=del size=2511336 2024-01-13T18:20:37.519 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.518+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=J4HCZOJT7IJV type=write size=550300 2024-01-13T18:20:37.520 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.519+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=O9G1AO6VU4U6 type=del 2024-01-13T18:20:37.522 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.521+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=RVMPQZLOSJGQ type=del size=672043 2024-01-13T18:20:37.524 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.523+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=1JYH9MZOJNV2 type=del 2024-01-13T18:20:37.527 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.526+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~6W2LT58PTTWF.0 size=1048576 2024-01-13T18:20:37.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.527+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~6W2LT58PTTWF.1 size=11660 2024-01-13T18:20:37.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.527+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=6W2LT58PTTWF tag=YR26Y4BQARUA type=write size=2108812 2024-01-13T18:20:37.530 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.529+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=FXFNBC7VPZTC type=del 2024-01-13T18:20:37.532 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.531+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=7ASFAQK7OFKK type=del size=3435077 2024-01-13T18:20:37.533 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.532+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=UN43KYVE0T0D type=del 2024-01-13T18:20:37.536 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.536+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~MKNQIQC82SUY.0 size=1048576 2024-01-13T18:20:37.538 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.537+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~MKNQIQC82SUY.1 size=1048576 2024-01-13T18:20:37.539 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.538+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~MKNQIQC82SUY.2 size=250407 2024-01-13T18:20:37.539 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.538+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=MKNQIQC82SUY tag=MCGKPB0V7K11 type=write size=3396135 2024-01-13T18:20:37.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.539+0000 7f759fd04880 1 < canceled operation key=AJZB1PXB1NB5 tag=DSIHY7335FPB type=del size=534738 2024-01-13T18:20:37.542 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.541+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=01X7BAPC1S7Y type=write size=462633 2024-01-13T18:20:37.545 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.544+0000 7f759fd04880 1 < suggested update operation key=H7C1UAGAUR7D tag=VYYYHVOR5414 type=del size=2379018 2024-01-13T18:20:37.547 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.546+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=4A18USLKD0B5 type=del size=1428537 2024-01-13T18:20:37.550 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.549+0000 7f759fd04880 1 < suggested update operation key=H7C1UAGAUR7D tag=TLEPDI3YCBKM type=write size=856551 2024-01-13T18:20:37.552 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.551+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=A5AUBCC0IKN7 type=del size=1901575 2024-01-13T18:20:37.553 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.552+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=N6TNT2009445 type=del 2024-01-13T18:20:37.554 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.554+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=VBI3O9T3RGFC type=del size=2638964 2024-01-13T18:20:37.556 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.555+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=6K4ALW5YV2CN type=del 2024-01-13T18:20:37.559 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.558+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~54G37H6S4ZL8.0 size=167278 2024-01-13T18:20:37.559 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.558+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=54G37H6S4ZL8 tag=3B1MT3LL0GO3 type=write size=1215854 2024-01-13T18:20:37.561 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.560+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=3I3PM3Y65EWP type=del 2024-01-13T18:20:37.564 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.563+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~IVNBKYF8YDLI.0 size=1048576 2024-01-13T18:20:37.565 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.564+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~IVNBKYF8YDLI.1 size=1048576 2024-01-13T18:20:37.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.566+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~IVNBKYF8YDLI.2 size=955294 2024-01-13T18:20:37.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.566+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=IVNBKYF8YDLI tag=3ECT0MMJTVEZ type=write size=4101022 2024-01-13T18:20:37.568 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.567+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~CPX4T3FNM2BI.0 size=1048576 2024-01-13T18:20:37.569 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.568+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~CPX4T3FNM2BI.1 size=691653 2024-01-13T18:20:37.572 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.571+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=CPX4T3FNM2BI tag=HUKQOZG2RQKR type=write size=2788805 2024-01-13T18:20:37.574 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.574+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~W2M4IVMTX8EZ.0 size=494581 2024-01-13T18:20:37.575 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.574+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=W2M4IVMTX8EZ tag=XWFHQANQUB2N type=write size=1543157 2024-01-13T18:20:37.576 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.575+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~M29JNWSDUPV1.0 size=1048576 2024-01-13T18:20:37.576 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.575+0000 7f759fd04880 1 < canceled part key=_multipart_ZI9WAZQHVPAR.2~M29JNWSDUPV1.1 size=230902 2024-01-13T18:20:37.579 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.578+0000 7f759fd04880 1 < canceled multipart upload key=ZI9WAZQHVPAR upload=M29JNWSDUPV1 tag=LMA8BUQD0M66 type=write size=2328054 2024-01-13T18:20:37.582 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.581+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~3XU85773BD40.0 size=982325 2024-01-13T18:20:37.582 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.581+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=3XU85773BD40 tag=QWXUM7UU2EGK type=write size=2030901 2024-01-13T18:20:37.585 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.584+0000 7f759fd04880 1 < suggested update operation key=7R5YIO7UFSDZ tag=FLHSINKRDTWS type=del size=3729729 2024-01-13T18:20:37.586 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.585+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=FYCQ440M6KBU type=del size=2069617 2024-01-13T18:20:37.588 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.587+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=HF14LAYVNCMR type=del 2024-01-13T18:20:37.590 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.589+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=X70WYZPVGHIJ type=del size=3105901 2024-01-13T18:20:37.591 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.590+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~1GFI9E5X0NFC.0 size=1048576 2024-01-13T18:20:37.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.591+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~1GFI9E5X0NFC.1 size=996411 2024-01-13T18:20:37.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.594+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=1GFI9E5X0NFC tag=1EUY6J606PYT type=write size=3093563 2024-01-13T18:20:37.597 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.596+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=S7CJLTC9S23W type=del size=3852877 2024-01-13T18:20:37.598 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.597+0000 7f759fd04880 1 < completed write operation key=ZI9WAZQHVPAR tag=J4HCZOJT7IJV type=write size=550300 2024-01-13T18:20:37.601 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.600+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~RE12DMKPVHPG.0 size=989469 2024-01-13T18:20:37.601 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.600+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=RE12DMKPVHPG tag=Z0BHQ0MTZPM0 type=write size=2038045 2024-01-13T18:20:37.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.602+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=RVMPQZLOSJGQ type=del 2024-01-13T18:20:37.606 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.605+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~EVO9OR2OORYD.0 size=1048576 2024-01-13T18:20:37.607 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.606+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~EVO9OR2OORYD.1 size=629710 2024-01-13T18:20:37.608 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.606+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=EVO9OR2OORYD tag=9HKDEUV6NYQI type=write size=2726862 2024-01-13T18:20:37.609 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.608+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~6W2LT58PTTWF.0 size=1048576 2024-01-13T18:20:37.610 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.609+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~6W2LT58PTTWF.1 size=11660 2024-01-13T18:20:37.613 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.612+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=6W2LT58PTTWF tag=YR26Y4BQARUA type=write size=2108812 2024-01-13T18:20:37.615 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.614+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=7W1PE0GE503D type=del size=841968 2024-01-13T18:20:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:37 smithi099 ceph-mon[138788]: osdmap e1118: 8 total, 8 up, 8 in 2024-01-13T18:20:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:37 smithi099 ceph-mon[138788]: pgmap v1457: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:37.619 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.618+0000 7f759fd04880 1 < suggested remove operation key=OMA1B74S8FXS tag=7ASFAQK7OFKK type=del 2024-01-13T18:20:37.621 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.620+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=M69INWRN2GJF type=write size=516844 2024-01-13T18:20:37.622 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.621+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~MKNQIQC82SUY.0 size=1048576 2024-01-13T18:20:37.623 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.623+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~MKNQIQC82SUY.1 size=1048576 2024-01-13T18:20:37.625 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.624+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~MKNQIQC82SUY.2 size=250407 2024-01-13T18:20:37.627 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.626+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=MKNQIQC82SUY tag=MCGKPB0V7K11 type=write size=3396135 2024-01-13T18:20:37.629 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.628+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=VTW86J04NSG0 type=write size=795741 2024-01-13T18:20:37.630 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.630+0000 7f759fd04880 1 < completed write operation key=QD5GBLNCY707 tag=01X7BAPC1S7Y type=write size=462633 2024-01-13T18:20:37.632 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.631+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=6L0YQS4LVGEZ type=del size=2276740 2024-01-13T18:20:37.634 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.633+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=4A18USLKD0B5 type=del 2024-01-13T18:20:37.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.636+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~4C9YS74G0I1A.0 size=1048576 2024-01-13T18:20:37.638 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.637+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~4C9YS74G0I1A.1 size=1048576 2024-01-13T18:20:37.639 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.638+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~4C9YS74G0I1A.2 size=526862 2024-01-13T18:20:37.639 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.638+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=4C9YS74G0I1A tag=YWGRDRTD4QWR type=write size=3672590 2024-01-13T18:20:37.640 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.639+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=A5AUBCC0IKN7 type=del 2024-01-13T18:20:37.642 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.641+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=Z1600Q9LEKA3 type=del size=2214503 2024-01-13T18:20:37.643 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.642+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=VBI3O9T3RGFC type=del 2024-01-13T18:20:37.645 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.644+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=00D1416EB9LO type=del size=2207976 2024-01-13T18:20:37.647 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.646+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~54G37H6S4ZL8.0 size=167278 2024-01-13T18:20:37.650 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.649+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=54G37H6S4ZL8 tag=3B1MT3LL0GO3 type=write size=1215854 2024-01-13T18:20:37.652 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.651+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=MVSVOYHX6JHQ type=del size=2004953 2024-01-13T18:20:37.654 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.653+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~IVNBKYF8YDLI.0 size=1048576 2024-01-13T18:20:37.655 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.654+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~IVNBKYF8YDLI.1 size=1048576 2024-01-13T18:20:37.656 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.655+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~IVNBKYF8YDLI.2 size=955294 2024-01-13T18:20:37.658 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.657+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=IVNBKYF8YDLI tag=3ECT0MMJTVEZ type=write size=4101022 2024-01-13T18:20:37.660 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.659+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=9OV3373LXODF type=del size=548412 2024-01-13T18:20:37.662 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.661+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~W2M4IVMTX8EZ.0 size=494581 2024-01-13T18:20:37.665 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.664+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=W2M4IVMTX8EZ tag=XWFHQANQUB2N type=write size=1543157 2024-01-13T18:20:37.666 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.665+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=LXQ1IYR1KNIU type=del size=1337346 2024-01-13T18:20:37.668 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.667+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~3XU85773BD40.0 size=982325 2024-01-13T18:20:37.671 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.670+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=3XU85773BD40 tag=QWXUM7UU2EGK type=write size=2030901 2024-01-13T18:20:37.672 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.671+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=9AF5UUP8AJ8Q type=write size=985202 2024-01-13T18:20:37.674 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.673+0000 7f759fd04880 1 < canceled operation key=H7C1UAGAUR7D tag=FYCQ440M6KBU type=del size=2069617 2024-01-13T18:20:37.675 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.674+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=53ZM6GX0Z7FJ type=del size=1523166 2024-01-13T18:20:37.677 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.676+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=X70WYZPVGHIJ type=del 2024-01-13T18:20:37.679 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.678+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=NP9YQSC13IYI type=del size=2855817 2024-01-13T18:20:37.682 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.681+0000 7f759fd04880 1 < suggested update operation key=XBTWSUA3D7U3 tag=S7CJLTC9S23W type=del size=3852877 2024-01-13T18:20:37.683 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.682+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=L319T2DD0O30 type=del size=1008157 2024-01-13T18:20:37.685 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.684+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~RE12DMKPVHPG.0 size=989469 2024-01-13T18:20:37.688 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.687+0000 7f759fd04880 1 < completed multipart upload key=VZHGQM6ZNJYQ upload=RE12DMKPVHPG tag=Z0BHQ0MTZPM0 type=write size=2038045 2024-01-13T18:20:37.690 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.689+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~I8HU1BC0JGEQ.0 size=1048576 2024-01-13T18:20:37.692 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.691+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~I8HU1BC0JGEQ.1 size=1048576 2024-01-13T18:20:37.693 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.692+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~I8HU1BC0JGEQ.2 size=442440 2024-01-13T18:20:37.693 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.692+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=I8HU1BC0JGEQ tag=M4JBVUWK0RLR type=write size=3588168 2024-01-13T18:20:37.693 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.692+0000 7f759fd04880 1 < canceled part key=_multipart_0TIZPXX8CMHA.2~EVO9OR2OORYD.0 size=1048576 2024-01-13T18:20:37.695 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.694+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~EVO9OR2OORYD.1 size=629710 2024-01-13T18:20:37.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.696+0000 7f759fd04880 1 < canceled multipart upload key=0TIZPXX8CMHA upload=EVO9OR2OORYD tag=9HKDEUV6NYQI type=write size=2726862 2024-01-13T18:20:37.701 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.700+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~CZPSTMVW2FLA.0 size=854760 2024-01-13T18:20:37.701 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.700+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=CZPSTMVW2FLA tag=0AAED5JRCZYO type=write size=1903336 2024-01-13T18:20:37.702 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.701+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=7W1PE0GE503D type=del 2024-01-13T18:20:37.704 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.703+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=Y5WCSMMK8QVW type=del size=3641312 2024-01-13T18:20:37.705 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.704+0000 7f759fd04880 1 < completed write operation key=3K20F802EFEQ tag=M69INWRN2GJF type=write size=516844 2024-01-13T18:20:37.707 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.706+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=3MNVIJ7ZRQGM type=del size=262739 2024-01-13T18:20:37.709 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.708+0000 7f759fd04880 1 < completed write operation key=JN46AMLYHN8E tag=VTW86J04NSG0 type=write size=795741 2024-01-13T18:20:37.711 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.710+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~HR0NB3B9BX07.0 size=1048576 2024-01-13T18:20:37.713 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.712+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~HR0NB3B9BX07.1 size=1048576 2024-01-13T18:20:37.714 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.713+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~HR0NB3B9BX07.2 size=372146 2024-01-13T18:20:37.714 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.713+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=HR0NB3B9BX07 tag=X760BDSIGUGM type=write size=3517874 2024-01-13T18:20:37.715 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.714+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=6L0YQS4LVGEZ type=del 2024-01-13T18:20:37.718 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.717+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~HLWKJ0ZVZ5G4.0 size=54495 2024-01-13T18:20:37.718 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.717+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=HLWKJ0ZVZ5G4 tag=SXMAZNS1E89N type=write size=1103071 2024-01-13T18:20:37.720 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.719+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~4C9YS74G0I1A.0 size=1048576 2024-01-13T18:20:37.721 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.720+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~4C9YS74G0I1A.1 size=1048576 2024-01-13T18:20:37.722 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.721+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~4C9YS74G0I1A.2 size=526862 2024-01-13T18:20:37.725 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.724+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=4C9YS74G0I1A tag=YWGRDRTD4QWR type=write size=3672590 2024-01-13T18:20:37.726 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.725+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=XNLXDUSSB6C3 type=del size=1185200 2024-01-13T18:20:37.728 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.727+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=Z1600Q9LEKA3 type=del 2024-01-13T18:20:37.730 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.729+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=EKJ9L1JSZ1TI type=del size=1709749 2024-01-13T18:20:37.731 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.730+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=00D1416EB9LO type=del 2024-01-13T18:20:37.733 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.732+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=UUXRKZO2SOEL type=del size=2092222 2024-01-13T18:20:37.734 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.733+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=MVSVOYHX6JHQ type=del 2024-01-13T18:20:37.738 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.737+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~FREV5FDOUBN8.0 size=1048576 2024-01-13T18:20:37.739 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.738+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~FREV5FDOUBN8.1 size=1048576 2024-01-13T18:20:37.740 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.740+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~FREV5FDOUBN8.2 size=770651 2024-01-13T18:20:37.741 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.740+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=FREV5FDOUBN8 tag=2T39811UUTAA type=write size=3916379 2024-01-13T18:20:37.742 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.741+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=9OV3373LXODF type=del 2024-01-13T18:20:37.744 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.743+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~N8Y3ADL3UV57.0 size=1048576 2024-01-13T18:20:37.746 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.745+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~N8Y3ADL3UV57.1 size=1048576 2024-01-13T18:20:37.748 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.747+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~N8Y3ADL3UV57.2 size=933877 2024-01-13T18:20:37.748 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.747+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=N8Y3ADL3UV57 tag=QTNBA3IVX99J type=write size=4079605 2024-01-13T18:20:37.749 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.749+0000 7f759fd04880 -1 < failed to complete operation key=XBTWSUA3D7U3 tag=LXQ1IYR1KNIU type=del size=1337346: (22) Invalid argument 2024-01-13T18:20:37.751 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.750+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=0OOBCQJNYTJ2 type=del size=676137 2024-01-13T18:20:37.753 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.752+0000 7f759fd04880 1 < canceled operation key=P8FMRQR7GXN7 tag=9AF5UUP8AJ8Q type=write size=985202 2024-01-13T18:20:37.754 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.753+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=P2OEJ3TJVFK5 type=del size=151141 2024-01-13T18:20:37.756 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.755+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=53ZM6GX0Z7FJ type=del 2024-01-13T18:20:37.757 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.756+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=59TNM3SVM6MZ type=del size=819206 2024-01-13T18:20:37.760 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.759+0000 7f759fd04880 1 < suggested remove operation key=DOXP3EJ03EBY tag=NP9YQSC13IYI type=del 2024-01-13T18:20:37.762 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.761+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=1A43U168D2NM type=del size=1241949 2024-01-13T18:20:37.764 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.763+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=L319T2DD0O30 type=del 2024-01-13T18:20:37.765 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.764+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=6CJQYBCKPAGA type=del size=4177786 2024-01-13T18:20:37.767 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.766+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~I8HU1BC0JGEQ.0 size=1048576 2024-01-13T18:20:37.768 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.767+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~I8HU1BC0JGEQ.1 size=1048576 2024-01-13T18:20:37.769 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.768+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~I8HU1BC0JGEQ.2 size=442440 2024-01-13T18:20:37.772 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.771+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=I8HU1BC0JGEQ tag=M4JBVUWK0RLR type=write size=3588168 2024-01-13T18:20:37.774 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.773+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=L4SD3XJQ876T type=del size=1486015 2024-01-13T18:20:37.775 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.774+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~CZPSTMVW2FLA.0 size=854760 2024-01-13T18:20:37.777 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.776+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=CZPSTMVW2FLA tag=0AAED5JRCZYO type=write size=1903336 2024-01-13T18:20:37.780 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.779+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~ID9XJGH9K2V7.0 size=1048576 2024-01-13T18:20:37.781 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.780+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~ID9XJGH9K2V7.1 size=1048576 2024-01-13T18:20:37.782 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.781+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~ID9XJGH9K2V7.2 size=347757 2024-01-13T18:20:37.783 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.781+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=ID9XJGH9K2V7 tag=5I4B6N008DRR type=write size=3493485 2024-01-13T18:20:37.784 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.783+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=Y5WCSMMK8QVW type=del 2024-01-13T18:20:37.785 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.785+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=UZWMISXNWV5I type=del size=4048859 2024-01-13T18:20:37.787 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.786+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=3MNVIJ7ZRQGM type=del 2024-01-13T18:20:37.788 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.787+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=5AWFL480AOEL type=del size=3691273 2024-01-13T18:20:37.790 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.789+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~HR0NB3B9BX07.0 size=1048576 2024-01-13T18:20:37.791 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.790+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~HR0NB3B9BX07.1 size=1048576 2024-01-13T18:20:37.793 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.792+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~HR0NB3B9BX07.2 size=372146 2024-01-13T18:20:37.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.794+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=HR0NB3B9BX07 tag=X760BDSIGUGM type=write size=3517874 2024-01-13T18:20:37.796 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.795+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=TF8O01ZZN2VO type=del size=3187855 2024-01-13T18:20:37.798 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.797+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~HLWKJ0ZVZ5G4.0 size=54495 2024-01-13T18:20:37.804 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.800+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=HLWKJ0ZVZ5G4 tag=SXMAZNS1E89N type=write size=1103071 2024-01-13T18:20:37.804 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.801+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=I9G1119M889W type=write size=575856 2024-01-13T18:20:37.804 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.803+0000 7f759fd04880 -1 < failed to complete operation key=DOXP3EJ03EBY tag=XNLXDUSSB6C3 type=del size=1185200: (22) Invalid argument 2024-01-13T18:20:37.805 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.804+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=RSBK3X4LBY0F type=del size=1742830 2024-01-13T18:20:37.807 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.806+0000 7f759fd04880 1 < canceled operation key=QS9PLJKINY4R tag=EKJ9L1JSZ1TI type=del size=1709749 2024-01-13T18:20:37.808 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.807+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=CGB77TRB1IBY type=del size=2422542 2024-01-13T18:20:37.810 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.809+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=UUXRKZO2SOEL type=del 2024-01-13T18:20:37.813 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.812+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~7C9F9OVNM5CZ.0 size=303267 2024-01-13T18:20:37.813 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.812+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=7C9F9OVNM5CZ tag=9RCTEW4EPLO2 type=write size=1351843 2024-01-13T18:20:37.814 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.813+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~FREV5FDOUBN8.0 size=1048576 2024-01-13T18:20:37.816 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.815+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~FREV5FDOUBN8.1 size=1048576 2024-01-13T18:20:37.817 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.816+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~FREV5FDOUBN8.2 size=770651 2024-01-13T18:20:37.819 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.818+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=FREV5FDOUBN8 tag=2T39811UUTAA type=write size=3916379 2024-01-13T18:20:37.822 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.821+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~BH3FYG7GSUZV.0 size=1048576 2024-01-13T18:20:37.823 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.822+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~BH3FYG7GSUZV.1 size=1048576 2024-01-13T18:20:37.825 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.824+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~BH3FYG7GSUZV.2 size=136148 2024-01-13T18:20:37.825 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.824+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=BH3FYG7GSUZV tag=JY4H0DCFSFVS type=write size=3281876 2024-01-13T18:20:37.826 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.825+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~N8Y3ADL3UV57.0 size=1048576 2024-01-13T18:20:37.827 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.826+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~N8Y3ADL3UV57.1 size=1048576 2024-01-13T18:20:37.829 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.828+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~N8Y3ADL3UV57.2 size=933877 2024-01-13T18:20:37.831 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.830+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=N8Y3ADL3UV57 tag=QTNBA3IVX99J type=write size=4079605 2024-01-13T18:20:37.833 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.832+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=OTVULSPD6BHS type=del size=2975137 2024-01-13T18:20:37.834 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.833+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=0OOBCQJNYTJ2 type=del 2024-01-13T18:20:37.836 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.835+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=MBMIRJEVYX2J type=del size=3644614 2024-01-13T18:20:37.837 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.836+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=P2OEJ3TJVFK5 type=del 2024-01-13T18:20:37.839 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.838+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=NJIBLDRF80S0 type=del size=2025331 2024-01-13T18:20:37.840 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.839+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=59TNM3SVM6MZ type=del 2024-01-13T18:20:37.842 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.841+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=S9QSAQWKVX2U type=del size=1916810 2024-01-13T18:20:37.843 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.842+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=1A43U168D2NM type=del 2024-01-13T18:20:37.844 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.844+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=6NX3S3A7FHU4 type=del size=2193238 2024-01-13T18:20:37.846 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.845+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=6CJQYBCKPAGA type=del 2024-01-13T18:20:37.847 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.846+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=69EBF6A2HJWJ type=del size=293318 2024-01-13T18:20:37.849 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.848+0000 7f759fd04880 1 < canceled operation key=1O3XX67RKHNW tag=L4SD3XJQ876T type=del size=1486015 2024-01-13T18:20:37.850 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.849+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=CGE9UCDCSRLT type=del size=2061478 2024-01-13T18:20:37.852 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.851+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~ID9XJGH9K2V7.0 size=1048576 2024-01-13T18:20:37.853 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.852+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~ID9XJGH9K2V7.1 size=1048576 2024-01-13T18:20:37.854 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.853+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~ID9XJGH9K2V7.2 size=347757 2024-01-13T18:20:37.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.856+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=ID9XJGH9K2V7 tag=5I4B6N008DRR type=write size=3493485 2024-01-13T18:20:37.859 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.858+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~6PABQ8ALTUWV.0 size=1048576 2024-01-13T18:20:37.861 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.860+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~6PABQ8ALTUWV.1 size=860256 2024-01-13T18:20:37.861 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.860+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=6PABQ8ALTUWV tag=C8CVUQWUE45L type=write size=2957408 2024-01-13T18:20:37.862 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.861+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=UZWMISXNWV5I type=del 2024-01-13T18:20:37.864 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.863+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=WOZ0ESV0Y9RE type=del size=3559077 2024-01-13T18:20:37.865 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.864+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=5AWFL480AOEL type=del 2024-01-13T18:20:37.867 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.866+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=ISB202GEYH1R type=del size=3700018 2024-01-13T18:20:37.869 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.868+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=TF8O01ZZN2VO type=del 2024-01-13T18:20:37.871 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.870+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=YT6LSQLZ5WL6 type=del size=3542770 2024-01-13T18:20:37.872 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.871+0000 7f759fd04880 1 < completed write operation key=QS9PLJKINY4R tag=I9G1119M889W type=write size=575856 2024-01-13T18:20:37.874 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.873+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=QTKGFB3XF2UU type=del size=692479 2024-01-13T18:20:37.875 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.874+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=RSBK3X4LBY0F type=del 2024-01-13T18:20:37.877 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.876+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=VIOB1WBWV1HW type=del size=1238870 2024-01-13T18:20:37.878 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.877+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=CGB77TRB1IBY type=del 2024-01-13T18:20:37.881 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.880+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~BQ7OLHDCYXOP.0 size=839385 2024-01-13T18:20:37.881 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.880+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=BQ7OLHDCYXOP tag=HIKX8KI37VEP type=write size=1887961 2024-01-13T18:20:37.882 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.881+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~7C9F9OVNM5CZ.0 size=303267 2024-01-13T18:20:37.885 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.884+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=7C9F9OVNM5CZ tag=9RCTEW4EPLO2 type=write size=1351843 2024-01-13T18:20:37.886 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.885+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=97P1RTIESSFL type=del size=3371593 2024-01-13T18:20:37.888 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.887+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~BH3FYG7GSUZV.0 size=1048576 2024-01-13T18:20:37.889 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.888+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~BH3FYG7GSUZV.1 size=1048576 2024-01-13T18:20:37.890 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.889+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~BH3FYG7GSUZV.2 size=136148 2024-01-13T18:20:37.893 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.892+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=BH3FYG7GSUZV tag=JY4H0DCFSFVS type=write size=3281876 2024-01-13T18:20:37.895 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.894+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~MZ95RFDHKHZG.0 size=1048576 2024-01-13T18:20:37.897 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.896+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~MZ95RFDHKHZG.1 size=227312 2024-01-13T18:20:37.897 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.896+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=MZ95RFDHKHZG tag=CGJDQBGEF2IX type=write size=2324464 2024-01-13T18:20:37.900 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.899+0000 7f759fd04880 1 < suggested update operation key=8EWIOXN5H9KU tag=OTVULSPD6BHS type=del size=2975137 2024-01-13T18:20:37.901 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.900+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=1NUCVOOA8561 type=del size=1749499 2024-01-13T18:20:37.903 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.902+0000 7f759fd04880 1 < completed delete operation key=QKNPXHB99KVP tag=MBMIRJEVYX2J type=del 2024-01-13T18:20:37.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.903+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=GZLEJX1MW97W type=del size=2595767 2024-01-13T18:20:37.907 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.906+0000 7f759fd04880 1 < suggested update operation key=1QEZO616DBC3 tag=NJIBLDRF80S0 type=del size=2025331 2024-01-13T18:20:37.909 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.908+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=XNA0NTOB1AM5 type=del size=789526 2024-01-13T18:20:37.910 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.909+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=S9QSAQWKVX2U type=del 2024-01-13T18:20:37.912 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.911+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=I5DOF1RF3CXI type=del size=3608655 2024-01-13T18:20:37.913 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.913+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=6NX3S3A7FHU4 type=del 2024-01-13T18:20:37.915 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.914+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=3QXD9767D1CD type=write size=944190 2024-01-13T18:20:37.917 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.916+0000 7f759fd04880 1 < canceled operation key=RY0W5S41XK3F tag=69EBF6A2HJWJ type=del size=293318 2024-01-13T18:20:37.918 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.917+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=5EG0DYTT77RT type=del size=1480870 2024-01-13T18:20:37.920 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.919+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=CGE9UCDCSRLT type=del 2024-01-13T18:20:37.923 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.920+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=OF79723KH2RQ type=del size=2696306 2024-01-13T18:20:37.923 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.922+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~6PABQ8ALTUWV.0 size=1048576 2024-01-13T18:20:37.924 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.923+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~6PABQ8ALTUWV.1 size=860256 2024-01-13T18:20:37.926 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.925+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=6PABQ8ALTUWV tag=C8CVUQWUE45L type=write size=2957408 2024-01-13T18:20:37.930 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.927+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=MGBB3DRATFUG type=del size=860025 2024-01-13T18:20:37.930 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.928+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=WOZ0ESV0Y9RE type=del 2024-01-13T18:20:37.931 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.930+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=RN19BN9QS2P8 type=del size=3964920 2024-01-13T18:20:37.933 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.932+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=ISB202GEYH1R type=del 2024-01-13T18:20:37.934 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.933+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=MMAKZGQ47BZ0 type=write size=13100 2024-01-13T18:20:37.936 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.935+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=YT6LSQLZ5WL6 type=del 2024-01-13T18:20:37.937 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.936+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=IVHNH05WC8A1 type=write size=146732 2024-01-13T18:20:37.939 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.938+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=QTKGFB3XF2UU type=del 2024-01-13T18:20:37.940 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.939+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=UJB21ZBF0JW2 type=del size=2508761 2024-01-13T18:20:37.943 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.942+0000 7f759fd04880 1 < suggested remove operation key=OMA1B74S8FXS tag=VIOB1WBWV1HW type=del 2024-01-13T18:20:37.945 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.944+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=NGR9R4MXXXV4 type=write size=880179 2024-01-13T18:20:37.945 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.944+0000 7f759fd04880 1 < canceled part key=_multipart_1QEZO616DBC3.2~BQ7OLHDCYXOP.0 size=839385 2024-01-13T18:20:37.948 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.947+0000 7f759fd04880 1 < canceled multipart upload key=1QEZO616DBC3 upload=BQ7OLHDCYXOP tag=HIKX8KI37VEP type=write size=1887961 2024-01-13T18:20:37.949 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.948+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=VW1A63TZ47R9 type=del size=3082295 2024-01-13T18:20:37.951 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.950+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=97P1RTIESSFL type=del 2024-01-13T18:20:37.953 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.952+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=YE1JJ7P5QO2D type=del size=2090298 2024-01-13T18:20:37.955 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.954+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~MZ95RFDHKHZG.0 size=1048576 2024-01-13T18:20:37.956 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.955+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~MZ95RFDHKHZG.1 size=227312 2024-01-13T18:20:37.958 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.957+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=MZ95RFDHKHZG tag=CGJDQBGEF2IX type=write size=2324464 2024-01-13T18:20:37.960 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.959+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=IC2VSTSBKK84 type=del size=2943913 2024-01-13T18:20:37.962 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.961+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=1NUCVOOA8561 type=del 2024-01-13T18:20:37.965 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.964+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~NZZJCXIQ84N8.0 size=1048576 2024-01-13T18:20:37.966 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.965+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~NZZJCXIQ84N8.1 size=419771 2024-01-13T18:20:37.966 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.965+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=NZZJCXIQ84N8 tag=HULZWFZ1VBLL type=write size=2516923 2024-01-13T18:20:37.968 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.967+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=GZLEJX1MW97W type=del 2024-01-13T18:20:37.970 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.969+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=HB580LP240JK type=del size=2996166 2024-01-13T18:20:37.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.970+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=XNA0NTOB1AM5 type=del 2024-01-13T18:20:37.974 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.973+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~W2FQ2WFNBV4D.0 size=775021 2024-01-13T18:20:37.974 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.973+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=W2FQ2WFNBV4D tag=DGZ322JFB0AY type=write size=1823597 2024-01-13T18:20:37.975 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.974+0000 7f759fd04880 1 < canceled operation key=7LXXSKLOM1JZ tag=I5DOF1RF3CXI type=del size=3608655 2024-01-13T18:20:37.977 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.976+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=TRGIYSJK10O5 type=del size=984341 2024-01-13T18:20:37.978 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.977+0000 7f759fd04880 1 < completed write operation key=H7C1UAGAUR7D tag=3QXD9767D1CD type=write size=944190 2024-01-13T18:20:37.980 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.979+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=0S0A9ITK1ZVB type=del size=3524267 2024-01-13T18:20:37.981 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.980+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=5EG0DYTT77RT type=del 2024-01-13T18:20:37.984 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.983+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~U21GN1U2SQMN.0 size=1048576 2024-01-13T18:20:37.985 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.984+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~U21GN1U2SQMN.1 size=94531 2024-01-13T18:20:37.985 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.984+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=U21GN1U2SQMN tag=5Y7XDBD8ORFU type=write size=2191683 2024-01-13T18:20:37.988 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.987+0000 7f759fd04880 1 < suggested update operation key=7WRTM9ANJRT4 tag=OF79723KH2RQ type=del size=2696306 2024-01-13T18:20:37.990 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.989+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=K9S6X2IOGYUS type=write size=559573 2024-01-13T18:20:37.991 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.990+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=MGBB3DRATFUG type=del 2024-01-13T18:20:37.993 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.992+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=OP1HJ0AVXU18 type=del size=4103200 2024-01-13T18:20:37.994 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.993+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=RN19BN9QS2P8 type=del 2024-01-13T18:20:37.996 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.995+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=Q2V3SVO9MX54 type=del size=3468058 2024-01-13T18:20:37.997 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.996+0000 7f759fd04880 1 < completed write operation key=QS9PLJKINY4R tag=MMAKZGQ47BZ0 type=write size=13100 2024-01-13T18:20:37.999 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.998+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=TX6PXJ9IQVVZ type=del size=1611748 2024-01-13T18:20:38.000 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:37.999+0000 7f759fd04880 1 < completed write operation key=EW3ZFDVIQZ7G tag=IVHNH05WC8A1 type=write size=146732 2024-01-13T18:20:38.003 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.002+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~NJV0Y49TWZ0J.0 size=1048576 2024-01-13T18:20:38.005 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.004+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~NJV0Y49TWZ0J.1 size=1048576 2024-01-13T18:20:38.006 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.005+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~NJV0Y49TWZ0J.2 size=870569 2024-01-13T18:20:38.006 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.005+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=NJV0Y49TWZ0J tag=4TUGR9084QW8 type=write size=4016297 2024-01-13T18:20:38.014 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.009+0000 7f759fd04880 1 < suggested remove operation key=JN46AMLYHN8E tag=UJB21ZBF0JW2 type=del 2024-01-13T18:20:38.014 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.011+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=SQKG7JFZDB22 type=del size=2375397 2024-01-13T18:20:38.014 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.013+0000 7f759fd04880 1 < completed write operation key=8EWIOXN5H9KU tag=NGR9R4MXXXV4 type=write size=880179 2024-01-13T18:20:38.017 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.016+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~IAXVG0KV6SRT.0 size=819668 2024-01-13T18:20:38.018 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.016+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=IAXVG0KV6SRT tag=TXYWT3V7JFRF type=write size=1868244 2024-01-13T18:20:38.019 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.018+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=VW1A63TZ47R9 type=del 2024-01-13T18:20:38.023 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.021+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~S6CNC5FW1I8Q.0 size=1048576 2024-01-13T18:20:38.024 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.023+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~S6CNC5FW1I8Q.1 size=1048576 2024-01-13T18:20:38.025 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.024+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~S6CNC5FW1I8Q.2 size=141085 2024-01-13T18:20:38.025 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.024+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=S6CNC5FW1I8Q tag=QWR35468KD6I type=write size=3286813 2024-01-13T18:20:38.027 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.026+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=YE1JJ7P5QO2D type=del 2024-01-13T18:20:38.028 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.027+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=CGMXB7IC4LM8 type=del size=3088364 2024-01-13T18:20:38.031 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.030+0000 7f759fd04880 1 < suggested remove operation key=EW3ZFDVIQZ7G tag=IC2VSTSBKK84 type=del 2024-01-13T18:20:38.033 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.032+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=THQEZ6Q6EFA9 type=write size=702662 2024-01-13T18:20:38.034 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.033+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~NZZJCXIQ84N8.0 size=1048576 2024-01-13T18:20:38.036 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.035+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~NZZJCXIQ84N8.1 size=419771 2024-01-13T18:20:38.038 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.037+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=NZZJCXIQ84N8 tag=HULZWFZ1VBLL type=write size=2516923 2024-01-13T18:20:38.040 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.039+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=WYJP9EQ4PW8F type=del size=2507149 2024-01-13T18:20:38.042 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.041+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=HB580LP240JK type=del 2024-01-13T18:20:38.045 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.044+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~B8RQ2ZWK8YOS.0 size=1048576 2024-01-13T18:20:38.047 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.046+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~B8RQ2ZWK8YOS.1 size=1048576 2024-01-13T18:20:38.048 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.047+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~B8RQ2ZWK8YOS.2 size=348808 2024-01-13T18:20:38.048 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.047+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=B8RQ2ZWK8YOS tag=JEOXEF6YGQGN type=write size=3494536 2024-01-13T18:20:38.050 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.049+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~W2FQ2WFNBV4D.0 size=775021 2024-01-13T18:20:38.052 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.052+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=W2FQ2WFNBV4D tag=DGZ322JFB0AY type=write size=1823597 2024-01-13T18:20:38.054 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.053+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=WO1VB2OTG3A2 type=del size=3260409 2024-01-13T18:20:38.057 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.056+0000 7f759fd04880 1 < suggested remove operation key=8EWIOXN5H9KU tag=TRGIYSJK10O5 type=del 2024-01-13T18:20:38.060 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.059+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~S2CDH932QN2S.0 size=8261 2024-01-13T18:20:38.060 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.059+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=S2CDH932QN2S tag=EM19QABCNZ3L type=write size=1056837 2024-01-13T18:20:38.062 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.061+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=0S0A9ITK1ZVB type=del 2024-01-13T18:20:38.064 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.063+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=BMWCKA93RAH2 type=del size=3227395 2024-01-13T18:20:38.065 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.064+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~U21GN1U2SQMN.0 size=1048576 2024-01-13T18:20:38.067 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.066+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~U21GN1U2SQMN.1 size=94531 2024-01-13T18:20:38.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.068+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=U21GN1U2SQMN tag=5Y7XDBD8ORFU type=write size=2191683 2024-01-13T18:20:38.071 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.070+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=FPF26JV74QMS type=del size=3429536 2024-01-13T18:20:38.073 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.072+0000 7f759fd04880 1 < completed write operation key=1QEZO616DBC3 tag=K9S6X2IOGYUS type=write size=559573 2024-01-13T18:20:38.076 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.075+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~C876543UJBA7.0 size=740990 2024-01-13T18:20:38.076 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.075+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=C876543UJBA7 tag=T8OYSV1O8EF3 type=write size=1789566 2024-01-13T18:20:38.077 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.076+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=OP1HJ0AVXU18 type=del 2024-01-13T18:20:38.079 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.078+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=4P86TX0MLFJR type=del size=2672336 2024-01-13T18:20:38.081 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.080+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=Q2V3SVO9MX54 type=del 2024-01-13T18:20:38.083 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.082+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~J7Q30ENZA7LE.0 size=1048576 2024-01-13T18:20:38.085 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.084+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~J7Q30ENZA7LE.1 size=1048576 2024-01-13T18:20:38.086 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.085+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~J7Q30ENZA7LE.2 size=501311 2024-01-13T18:20:38.086 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.085+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=J7Q30ENZA7LE tag=0NXIUPFKE0FQ type=write size=3647039 2024-01-13T18:20:38.087 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.086+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=TX6PXJ9IQVVZ type=del 2024-01-13T18:20:38.090 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.089+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~N0KVIMVRBJGW.0 size=1048576 2024-01-13T18:20:38.091 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.090+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~N0KVIMVRBJGW.1 size=414108 2024-01-13T18:20:38.091 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.090+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=N0KVIMVRBJGW tag=HWCYVH2YHJ4D type=write size=2511260 2024-01-13T18:20:38.093 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.092+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~NJV0Y49TWZ0J.0 size=1048576 2024-01-13T18:20:38.094 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.093+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~NJV0Y49TWZ0J.1 size=1048576 2024-01-13T18:20:38.095 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.094+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~NJV0Y49TWZ0J.2 size=870569 2024-01-13T18:20:38.098 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.097+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=NJV0Y49TWZ0J tag=4TUGR9084QW8 type=write size=4016297 2024-01-13T18:20:38.101 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.100+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=OYL0K82IZFD2 type=del size=131485 2024-01-13T18:20:38.104 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.103+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=SQKG7JFZDB22 type=del 2024-01-13T18:20:38.107 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.106+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~HO2EK87BMLX3.0 size=1048576 2024-01-13T18:20:38.108 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.107+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~HO2EK87BMLX3.1 size=930644 2024-01-13T18:20:38.108 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.107+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=HO2EK87BMLX3 tag=YD1EX65GAM4G type=write size=3027796 2024-01-13T18:20:38.110 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.109+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~IAXVG0KV6SRT.0 size=819668 2024-01-13T18:20:38.113 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.112+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=IAXVG0KV6SRT tag=TXYWT3V7JFRF type=write size=1868244 2024-01-13T18:20:38.114 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.113+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=H6Q0DXT8SE9K type=write size=741340 2024-01-13T18:20:38.116 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.115+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~S6CNC5FW1I8Q.0 size=1048576 2024-01-13T18:20:38.117 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.116+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~S6CNC5FW1I8Q.1 size=1048576 2024-01-13T18:20:38.118 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.117+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~S6CNC5FW1I8Q.2 size=141085 2024-01-13T18:20:38.121 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.120+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=S6CNC5FW1I8Q tag=QWR35468KD6I type=write size=3286813 2024-01-13T18:20:38.123 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.122+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=HDCGULBPW0NG type=del size=705093 2024-01-13T18:20:38.124 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.123+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=CGMXB7IC4LM8 type=del 2024-01-13T18:20:38.126 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.125+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=CD5S7SWJP11T type=del size=2397028 2024-01-13T18:20:38.128 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.127+0000 7f759fd04880 1 < completed write operation key=QKNPXHB99KVP tag=THQEZ6Q6EFA9 type=write size=702662 2024-01-13T18:20:38.131 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.130+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~JAR05TO3QP2N.0 size=1048576 2024-01-13T18:20:38.133 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.132+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~JAR05TO3QP2N.1 size=305815 2024-01-13T18:20:38.133 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.132+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=JAR05TO3QP2N tag=ZZLHIZZS4J5E type=write size=2402967 2024-01-13T18:20:38.135 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.135+0000 7f759fd04880 1 < suggested update operation key=EW3ZFDVIQZ7G tag=WYJP9EQ4PW8F type=del size=2507149 2024-01-13T18:20:38.137 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.136+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=CKM73GHN1IXO type=write size=506290 2024-01-13T18:20:38.138 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.137+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~B8RQ2ZWK8YOS.0 size=1048576 2024-01-13T18:20:38.140 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.139+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~B8RQ2ZWK8YOS.1 size=1048576 2024-01-13T18:20:38.141 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.140+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~B8RQ2ZWK8YOS.2 size=348808 2024-01-13T18:20:38.143 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.143+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=B8RQ2ZWK8YOS tag=JEOXEF6YGQGN type=write size=3494536 2024-01-13T18:20:38.145 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.144+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=F0YSJWD43F1R type=del size=2674905 2024-01-13T18:20:38.147 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.146+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=WO1VB2OTG3A2 type=del 2024-01-13T18:20:38.149 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.148+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=5JCJCIOFF4RK type=del size=4146912 2024-01-13T18:20:38.150 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.150+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~S2CDH932QN2S.0 size=8261 2024-01-13T18:20:38.153 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.152+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=S2CDH932QN2S tag=EM19QABCNZ3L type=write size=1056837 2024-01-13T18:20:38.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.155+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~WYPPD0KGWO4G.0 size=1048576 2024-01-13T18:20:38.157 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.156+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~WYPPD0KGWO4G.1 size=152982 2024-01-13T18:20:38.157 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.156+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=WYPPD0KGWO4G tag=TBN25H6T010I type=write size=2250134 2024-01-13T18:20:38.159 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.158+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=BMWCKA93RAH2 type=del 2024-01-13T18:20:38.162 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.161+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=0SXWV2LIWZS5 type=del size=3717638 2024-01-13T18:20:38.164 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.163+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=FPF26JV74QMS type=del 2024-01-13T18:20:38.166 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.165+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=AQPLIS7VDI8O type=write size=683865 2024-01-13T18:20:38.167 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.166+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~C876543UJBA7.0 size=740990 2024-01-13T18:20:38.171 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.170+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=C876543UJBA7 tag=T8OYSV1O8EF3 type=write size=1789566 2024-01-13T18:20:38.174 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.173+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~XAV3S4WMES0A.0 size=1048576 2024-01-13T18:20:38.176 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.175+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~XAV3S4WMES0A.1 size=1048576 2024-01-13T18:20:38.177 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.176+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~XAV3S4WMES0A.2 size=837466 2024-01-13T18:20:38.177 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.176+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=XAV3S4WMES0A tag=W06YYLI93XIM type=write size=3983194 2024-01-13T18:20:38.179 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.177+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=4P86TX0MLFJR type=del 2024-01-13T18:20:38.180 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.179+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=FBCH3GVBI6UF type=del size=4177185 2024-01-13T18:20:38.181 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.180+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~J7Q30ENZA7LE.0 size=1048576 2024-01-13T18:20:38.181 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.180+0000 7f759fd04880 1 < canceled part key=_multipart_H4VHC37BOZJ3.2~J7Q30ENZA7LE.1 size=1048576 2024-01-13T18:20:38.182 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.181+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~J7Q30ENZA7LE.2 size=501311 2024-01-13T18:20:38.187 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.184+0000 7f759fd04880 1 < canceled multipart upload key=H4VHC37BOZJ3 upload=J7Q30ENZA7LE tag=0NXIUPFKE0FQ type=write size=3647039 2024-01-13T18:20:38.187 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.185+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=SGEDAJX4CSUB type=del size=2859470 2024-01-13T18:20:38.188 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.187+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~N0KVIMVRBJGW.0 size=1048576 2024-01-13T18:20:38.188 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.187+0000 7f759fd04880 1 < canceled part key=_multipart_0TIZPXX8CMHA.2~N0KVIMVRBJGW.1 size=414108 2024-01-13T18:20:38.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.190+0000 7f759fd04880 1 < canceled multipart upload key=0TIZPXX8CMHA upload=N0KVIMVRBJGW tag=HWCYVH2YHJ4D type=write size=2511260 2024-01-13T18:20:38.192 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.191+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=L9UHKFNI2T3W type=del size=3735307 2024-01-13T18:20:38.194 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.193+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=OYL0K82IZFD2 type=del 2024-01-13T18:20:38.195 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.194+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=W30D6IZBJ3BT type=del size=3449331 2024-01-13T18:20:38.197 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.196+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~HO2EK87BMLX3.0 size=1048576 2024-01-13T18:20:38.197 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.196+0000 7f759fd04880 1 < canceled part key=_multipart_7WRTM9ANJRT4.2~HO2EK87BMLX3.1 size=930644 2024-01-13T18:20:38.199 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.198+0000 7f759fd04880 1 < canceled multipart upload key=7WRTM9ANJRT4 upload=HO2EK87BMLX3 tag=YD1EX65GAM4G type=write size=3027796 2024-01-13T18:20:38.201 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.200+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=UDQLDSM2EOOX type=write size=574705 2024-01-13T18:20:38.203 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.202+0000 7f759fd04880 1 < completed write operation key=JGALONWJXLQY tag=H6Q0DXT8SE9K type=write size=741340 2024-01-13T18:20:38.205 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.204+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~HCT1C0K3QER5.0 size=1048576 2024-01-13T18:20:38.207 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.206+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~HCT1C0K3QER5.1 size=1048576 2024-01-13T18:20:38.208 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.207+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~HCT1C0K3QER5.2 size=646524 2024-01-13T18:20:38.208 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.207+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=HCT1C0K3QER5 tag=UM2L8X38PN2U type=write size=3792252 2024-01-13T18:20:38.211 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.210+0000 7f759fd04880 1 < suggested remove operation key=P8FMRQR7GXN7 tag=HDCGULBPW0NG type=del 2024-01-13T18:20:38.215 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.213+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~T4DDJH501G2Z.0 size=1048576 2024-01-13T18:20:38.216 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.215+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~T4DDJH501G2Z.1 size=531930 2024-01-13T18:20:38.216 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.215+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=T4DDJH501G2Z tag=PUTARNO231S4 type=write size=2629082 2024-01-13T18:20:38.222 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.216+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=CD5S7SWJP11T type=del 2024-01-13T18:20:38.222 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.218+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=ZCK0YX3N45RJ type=del size=898804 2024-01-13T18:20:38.222 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.219+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~JAR05TO3QP2N.0 size=1048576 2024-01-13T18:20:38.222 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.220+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~JAR05TO3QP2N.1 size=305815 2024-01-13T18:20:38.224 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.223+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=JAR05TO3QP2N tag=ZZLHIZZS4J5E type=write size=2402967 2024-01-13T18:20:38.227 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.226+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~VQSNQB93UFQU.0 size=1048576 2024-01-13T18:20:38.228 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.227+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~VQSNQB93UFQU.1 size=232913 2024-01-13T18:20:38.228 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.227+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=VQSNQB93UFQU tag=HUZW2PKIJWTL type=write size=2330065 2024-01-13T18:20:38.230 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.229+0000 7f759fd04880 1 < completed write operation key=1O3XX67RKHNW tag=CKM73GHN1IXO type=write size=506290 2024-01-13T18:20:38.231 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.230+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=199UFP61N3ME type=write size=710056 2024-01-13T18:20:38.233 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.232+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=F0YSJWD43F1R type=del 2024-01-13T18:20:38.236 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.235+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~OZV8MEKB1VOT.0 size=1048576 2024-01-13T18:20:38.237 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.236+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~OZV8MEKB1VOT.1 size=1048576 2024-01-13T18:20:38.238 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.237+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~OZV8MEKB1VOT.2 size=161081 2024-01-13T18:20:38.238 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.237+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=OZV8MEKB1VOT tag=VF04VVWG2KPX type=write size=3306809 2024-01-13T18:20:38.240 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.239+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=5JCJCIOFF4RK type=del 2024-01-13T18:20:38.242 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.240+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=98R697E7VKM0 type=del size=1428446 2024-01-13T18:20:38.243 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.242+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~WYPPD0KGWO4G.0 size=1048576 2024-01-13T18:20:38.244 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.243+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~WYPPD0KGWO4G.1 size=152982 2024-01-13T18:20:38.247 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.246+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=WYPPD0KGWO4G tag=TBN25H6T010I type=write size=2250134 2024-01-13T18:20:38.248 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.247+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=1G9G3AK9OH0P type=write size=362292 2024-01-13T18:20:38.250 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.249+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=0SXWV2LIWZS5 type=del 2024-01-13T18:20:38.251 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.250+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=SPUYCXTL2QEN type=del size=323265 2024-01-13T18:20:38.253 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.252+0000 7f759fd04880 1 < completed write operation key=JN46AMLYHN8E tag=AQPLIS7VDI8O type=write size=683865 2024-01-13T18:20:38.254 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.253+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=OTOVICRRM4CB type=write size=188800 2024-01-13T18:20:38.255 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.254+0000 7f759fd04880 1 < canceled part key=_multipart_8EWIOXN5H9KU.2~XAV3S4WMES0A.0 size=1048576 2024-01-13T18:20:38.256 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.255+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~XAV3S4WMES0A.1 size=1048576 2024-01-13T18:20:38.257 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.256+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~XAV3S4WMES0A.2 size=837466 2024-01-13T18:20:38.260 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.259+0000 7f759fd04880 1 < canceled multipart upload key=8EWIOXN5H9KU upload=XAV3S4WMES0A tag=W06YYLI93XIM type=write size=3983194 2024-01-13T18:20:38.263 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.262+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~BGI6QDXFVKFY.0 size=1048576 2024-01-13T18:20:38.264 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.263+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~BGI6QDXFVKFY.1 size=1048576 2024-01-13T18:20:38.265 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.265+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~BGI6QDXFVKFY.2 size=253789 2024-01-13T18:20:38.266 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.265+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=BGI6QDXFVKFY tag=UIJVOBIXDPJ7 type=write size=3399517 2024-01-13T18:20:38.267 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.266+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=FBCH3GVBI6UF type=del 2024-01-13T18:20:38.269 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.268+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=Y3KVLY3VESCX type=del size=16114 2024-01-13T18:20:38.271 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.270+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=SGEDAJX4CSUB type=del 2024-01-13T18:20:38.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.271+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=4Q6C9BXVY2VG type=del size=1064428 2024-01-13T18:20:38.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.273+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=L9UHKFNI2T3W type=del 2024-01-13T18:20:38.275 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.274+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=7TCXNSREQ164 type=del size=3557219 2024-01-13T18:20:38.278 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.277+0000 7f759fd04880 1 < suggested remove operation key=QKNPXHB99KVP tag=W30D6IZBJ3BT type=del 2024-01-13T18:20:38.280 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.279+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=ED3K555BJK22 type=del size=1489419 2024-01-13T18:20:38.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.281+0000 7f759fd04880 1 < completed write operation key=OMA1B74S8FXS tag=UDQLDSM2EOOX type=write size=574705 2024-01-13T18:20:38.285 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.284+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~GH44LNNGOI3V.0 size=871075 2024-01-13T18:20:38.285 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.284+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=GH44LNNGOI3V tag=0EKCC8OYB6MC type=write size=1919651 2024-01-13T18:20:38.287 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.286+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~HCT1C0K3QER5.0 size=1048576 2024-01-13T18:20:38.288 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.287+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~HCT1C0K3QER5.1 size=1048576 2024-01-13T18:20:38.290 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.289+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~HCT1C0K3QER5.2 size=646524 2024-01-13T18:20:38.292 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.291+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=HCT1C0K3QER5 tag=UM2L8X38PN2U type=write size=3792252 2024-01-13T18:20:38.295 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.294+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~BD2J67JUEG92.0 size=1048576 2024-01-13T18:20:38.297 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.296+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~BD2J67JUEG92.1 size=1048576 2024-01-13T18:20:38.298 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.297+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~BD2J67JUEG92.2 size=359882 2024-01-13T18:20:38.298 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.297+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=BD2J67JUEG92 tag=K1CE2Z9EVV2X type=write size=3505610 2024-01-13T18:20:38.300 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.299+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~T4DDJH501G2Z.0 size=1048576 2024-01-13T18:20:38.301 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.300+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~T4DDJH501G2Z.1 size=531930 2024-01-13T18:20:38.304 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.303+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=T4DDJH501G2Z tag=PUTARNO231S4 type=write size=2629082 2024-01-13T18:20:38.306 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.305+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=ZG1S3GGY62BA type=write size=340079 2024-01-13T18:20:38.307 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.306+0000 7f759fd04880 1 < canceled operation key=VZHGQM6ZNJYQ tag=ZCK0YX3N45RJ type=del size=898804 2024-01-13T18:20:38.308 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.308+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=VX3EDZ6WRXBF type=write size=544393 2024-01-13T18:20:38.310 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.309+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~VQSNQB93UFQU.0 size=1048576 2024-01-13T18:20:38.312 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.311+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~VQSNQB93UFQU.1 size=232913 2024-01-13T18:20:38.314 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.313+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=VQSNQB93UFQU tag=HUZW2PKIJWTL type=write size=2330065 2024-01-13T18:20:38.316 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.315+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=1VC0N4N0IT8T type=del size=2315969 2024-01-13T18:20:38.319 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.318+0000 7f759fd04880 1 < suggested update operation key=TNC2YDZYGM6G tag=199UFP61N3ME type=write size=710056 2024-01-13T18:20:38.321 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.321+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~V6ZUKB6WALO4.0 size=1048576 2024-01-13T18:20:38.323 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.322+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~V6ZUKB6WALO4.1 size=1048576 2024-01-13T18:20:38.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.323+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~V6ZUKB6WALO4.2 size=38844 2024-01-13T18:20:38.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.323+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=V6ZUKB6WALO4 tag=0P8SOS9PCVWK type=write size=3184572 2024-01-13T18:20:38.326 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.325+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~OZV8MEKB1VOT.0 size=1048576 2024-01-13T18:20:38.327 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.326+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~OZV8MEKB1VOT.1 size=1048576 2024-01-13T18:20:38.329 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.327+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~OZV8MEKB1VOT.2 size=161081 2024-01-13T18:20:38.331 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.330+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=OZV8MEKB1VOT tag=VF04VVWG2KPX type=write size=3306809 2024-01-13T18:20:38.332 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.331+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=5HD7L5CRVLLJ type=del size=1087118 2024-01-13T18:20:38.334 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.333+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=98R697E7VKM0 type=del 2024-01-13T18:20:38.336 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.335+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=KEZ0KW4938HW type=del size=2735180 2024-01-13T18:20:38.338 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.337+0000 7f759fd04880 1 < completed write operation key=7R5YIO7UFSDZ tag=1G9G3AK9OH0P type=write size=362292 2024-01-13T18:20:38.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.340+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~V1X43BQFWPTX.0 size=1048576 2024-01-13T18:20:38.343 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.342+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~V1X43BQFWPTX.1 size=487841 2024-01-13T18:20:38.343 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.342+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=V1X43BQFWPTX tag=VEJ62VAKB0OI type=write size=2584993 2024-01-13T18:20:38.344 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.343+0000 7f759fd04880 -1 < failed to complete operation key=QKNPXHB99KVP tag=SPUYCXTL2QEN type=del size=323265: (22) Invalid argument 2024-01-13T18:20:38.347 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.346+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~PXCQUZRDYDAB.0 size=1048576 2024-01-13T18:20:38.349 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.348+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~PXCQUZRDYDAB.1 size=392331 2024-01-13T18:20:38.349 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.348+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=PXCQUZRDYDAB tag=RN05J3J7WCU1 type=write size=2489483 2024-01-13T18:20:38.351 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.350+0000 7f759fd04880 1 < suggested update operation key=QD5GBLNCY707 tag=OTOVICRRM4CB type=write size=188800 2024-01-13T18:20:38.353 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.352+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=ZTHC8CBNZZ69 type=write size=788530 2024-01-13T18:20:38.354 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.353+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~BGI6QDXFVKFY.0 size=1048576 2024-01-13T18:20:38.355 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.355+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~BGI6QDXFVKFY.1 size=1048576 2024-01-13T18:20:38.357 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.356+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~BGI6QDXFVKFY.2 size=253789 2024-01-13T18:20:38.359 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.358+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=BGI6QDXFVKFY tag=UIJVOBIXDPJ7 type=write size=3399517 2024-01-13T18:20:38.361 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.360+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=7VPCADBAQH97 type=write size=219889 2024-01-13T18:20:38.362 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.361+0000 7f759fd04880 1 < completed delete operation key=1YNH6QHP354U tag=Y3KVLY3VESCX type=del 2024-01-13T18:20:38.364 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.363+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=GT4WVAT9HZ4C type=del size=625323 2024-01-13T18:20:38.365 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.365+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=4Q6C9BXVY2VG type=del 2024-01-13T18:20:38.369 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.368+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~NRWVW6K7DLOC.0 size=1048576 2024-01-13T18:20:38.370 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.369+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~NRWVW6K7DLOC.1 size=1048576 2024-01-13T18:20:38.371 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.370+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~NRWVW6K7DLOC.2 size=758666 2024-01-13T18:20:38.371 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.370+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=NRWVW6K7DLOC tag=BX29T1K4PZI0 type=write size=3904394 2024-01-13T18:20:38.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.372+0000 7f759fd04880 1 < completed delete operation key=1YNH6QHP354U tag=7TCXNSREQ164 type=del 2024-01-13T18:20:38.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.374+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~Q47KLAK53VPT.0 size=172436 2024-01-13T18:20:38.376 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.374+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=Q47KLAK53VPT tag=BQ2Y7EFRTJ9Y type=write size=1221012 2024-01-13T18:20:38.378 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.377+0000 7f759fd04880 1 < suggested update operation key=RY0W5S41XK3F tag=ED3K555BJK22 type=del size=1489419 2024-01-13T18:20:38.380 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.379+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=D545HHETCIXM type=del size=4045733 2024-01-13T18:20:38.381 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.381+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~GH44LNNGOI3V.0 size=871075 2024-01-13T18:20:38.384 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.383+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=GH44LNNGOI3V tag=0EKCC8OYB6MC type=write size=1919651 2024-01-13T18:20:38.386 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.385+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=B5PW32Y4TR56 type=del size=2709811 2024-01-13T18:20:38.387 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.386+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~BD2J67JUEG92.0 size=1048576 2024-01-13T18:20:38.389 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.388+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~BD2J67JUEG92.1 size=1048576 2024-01-13T18:20:38.390 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.389+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~BD2J67JUEG92.2 size=359882 2024-01-13T18:20:38.393 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.392+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=BD2J67JUEG92 tag=K1CE2Z9EVV2X type=write size=3505610 2024-01-13T18:20:38.396 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.394+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~F1U9H3A3BPPT.0 size=1048576 2024-01-13T18:20:38.397 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.396+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~F1U9H3A3BPPT.1 size=992425 2024-01-13T18:20:38.397 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.396+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=F1U9H3A3BPPT tag=360Z42MAUKO0 type=write size=3089577 2024-01-13T18:20:38.398 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.397+0000 7f759fd04880 1 < canceled operation key=8EWIOXN5H9KU tag=ZG1S3GGY62BA type=write size=340079 2024-01-13T18:20:38.400 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.399+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=8LSUFDG786YU type=del size=2558498 2024-01-13T18:20:38.403 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.402+0000 7f759fd04880 1 < suggested update operation key=EW3ZFDVIQZ7G tag=VX3EDZ6WRXBF type=write size=544393 2024-01-13T18:20:38.405 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.404+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=BCJG37G08GRU type=del size=4132527 2024-01-13T18:20:38.408 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.407+0000 7f759fd04880 1 < suggested update operation key=BPUBFFWB9D3C tag=1VC0N4N0IT8T type=del size=2315969 2024-01-13T18:20:38.409 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.408+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=DQMRYFFJGVVK type=write size=418555 2024-01-13T18:20:38.411 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.410+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~V6ZUKB6WALO4.0 size=1048576 2024-01-13T18:20:38.412 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.411+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~V6ZUKB6WALO4.1 size=1048576 2024-01-13T18:20:38.414 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.413+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~V6ZUKB6WALO4.2 size=38844 2024-01-13T18:20:38.417 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.416+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=V6ZUKB6WALO4 tag=0P8SOS9PCVWK type=write size=3184572 2024-01-13T18:20:38.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.417+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=TVZZ8ID0G54D type=del size=3152051 2024-01-13T18:20:38.420 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.419+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=5HD7L5CRVLLJ type=del 2024-01-13T18:20:38.421 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.420+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=1U70CQFPJ6PO type=del size=320194 2024-01-13T18:20:38.423 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.422+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=KEZ0KW4938HW type=del 2024-01-13T18:20:38.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.424+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=B3A896FXPNRK type=write size=866103 2024-01-13T18:20:38.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.425+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~V1X43BQFWPTX.0 size=1048576 2024-01-13T18:20:38.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.427+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~V1X43BQFWPTX.1 size=487841 2024-01-13T18:20:38.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:38 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:20:38.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:38 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:20:38.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:38 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:20:38.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:38 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:20:38.431 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.430+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=V1X43BQFWPTX tag=VEJ62VAKB0OI type=write size=2584993 2024-01-13T18:20:38.433 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.432+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=CKZA5Q3L1LH9 type=del size=1933759 2024-01-13T18:20:38.434 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.433+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~PXCQUZRDYDAB.0 size=1048576 2024-01-13T18:20:38.436 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.435+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~PXCQUZRDYDAB.1 size=392331 2024-01-13T18:20:38.438 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.437+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=PXCQUZRDYDAB tag=RN05J3J7WCU1 type=write size=2489483 2024-01-13T18:20:38.440 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.439+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=40P9PFCNUYOH type=del size=1824530 2024-01-13T18:20:38.442 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.441+0000 7f759fd04880 -1 < failed to complete operation key=EW3ZFDVIQZ7G tag=ZTHC8CBNZZ69 type=write size=788530: (22) Invalid argument 2024-01-13T18:20:38.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.442+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=8UXWUQFD3W1I type=write size=158696 2024-01-13T18:20:38.445 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.444+0000 7f759fd04880 1 < completed write operation key=H972TC5DOMHL tag=7VPCADBAQH97 type=write size=219889 2024-01-13T18:20:38.447 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.446+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~SK8STX0FH6WA.0 size=1048576 2024-01-13T18:20:38.449 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.448+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~SK8STX0FH6WA.1 size=1048576 2024-01-13T18:20:38.450 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.449+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~SK8STX0FH6WA.2 size=9145 2024-01-13T18:20:38.450 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.449+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=SK8STX0FH6WA tag=GWDUJM6ENQJD type=write size=3154873 2024-01-13T18:20:38.453 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.452+0000 7f759fd04880 1 < suggested remove operation key=2OO7S2NBZ7M6 tag=GT4WVAT9HZ4C type=del 2024-01-13T18:20:38.456 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.455+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~CD3LBLZ816LA.0 size=788640 2024-01-13T18:20:38.456 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.455+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=CD3LBLZ816LA tag=6I748G73TLD7 type=write size=1837216 2024-01-13T18:20:38.458 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.457+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~NRWVW6K7DLOC.0 size=1048576 2024-01-13T18:20:38.459 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.458+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~NRWVW6K7DLOC.1 size=1048576 2024-01-13T18:20:38.460 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.460+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~NRWVW6K7DLOC.2 size=758666 2024-01-13T18:20:38.464 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.463+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=NRWVW6K7DLOC tag=BX29T1K4PZI0 type=write size=3904394 2024-01-13T18:20:38.467 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.466+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~RWO8GKYKHVMC.0 size=465872 2024-01-13T18:20:38.467 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.466+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=RWO8GKYKHVMC tag=V8C2PSNF61J6 type=write size=1514448 2024-01-13T18:20:38.468 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.467+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~Q47KLAK53VPT.0 size=172436 2024-01-13T18:20:38.472 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.470+0000 7f759fd04880 1 < completed multipart upload key=VZHGQM6ZNJYQ upload=Q47KLAK53VPT tag=BQ2Y7EFRTJ9Y type=write size=1221012 2024-01-13T18:20:38.474 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.473+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~FG7VVOW2ZU8J.0 size=1048576 2024-01-13T18:20:38.475 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.474+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~FG7VVOW2ZU8J.1 size=40384 2024-01-13T18:20:38.475 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.474+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=FG7VVOW2ZU8J tag=UCA5YA3YC1TP type=write size=2137536 2024-01-13T18:20:38.477 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.476+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=D545HHETCIXM type=del 2024-01-13T18:20:38.478 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.477+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=RU3O3M1KIYTY type=write size=326992 2024-01-13T18:20:38.480 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.479+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=B5PW32Y4TR56 type=del 2024-01-13T18:20:38.481 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.480+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=98L5FUCR6FZM type=del size=360237 2024-01-13T18:20:38.483 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.482+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~F1U9H3A3BPPT.0 size=1048576 2024-01-13T18:20:38.484 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.483+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~F1U9H3A3BPPT.1 size=992425 2024-01-13T18:20:38.487 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.486+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=F1U9H3A3BPPT tag=360Z42MAUKO0 type=write size=3089577 2024-01-13T18:20:38.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.488+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=LD51QI51AIY4 type=write size=213685 2024-01-13T18:20:38.490 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.489+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=8LSUFDG786YU type=del 2024-01-13T18:20:38.493 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.492+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~67KO9M56E920.0 size=1048576 2024-01-13T18:20:38.494 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.493+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~67KO9M56E920.1 size=1048576 2024-01-13T18:20:38.495 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.494+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~67KO9M56E920.2 size=36461 2024-01-13T18:20:38.495 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.494+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=67KO9M56E920 tag=3HOZU3YX1IUE type=write size=3182189 2024-01-13T18:20:38.497 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.496+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=BCJG37G08GRU type=del 2024-01-13T18:20:38.498 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.497+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=B6HU9KVNJ9OP type=del size=3367160 2024-01-13T18:20:38.501 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.500+0000 7f759fd04880 1 < suggested update operation key=H4VHC37BOZJ3 tag=DQMRYFFJGVVK type=write size=418555 2024-01-13T18:20:38.503 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.502+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=2668S0TJ12SC type=del size=92721 2024-01-13T18:20:38.504 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.503+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=TVZZ8ID0G54D type=del 2024-01-13T18:20:38.506 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.505+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=TD7NTLMROBRT type=del size=3549600 2024-01-13T18:20:38.507 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.506+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=1U70CQFPJ6PO type=del 2024-01-13T18:20:38.509 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.508+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=45U3304GQQ0K type=del size=1540731 2024-01-13T18:20:38.511 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.510+0000 7f759fd04880 1 < completed write operation key=6GOU0WSHKUQ0 tag=B3A896FXPNRK type=write size=866103 2024-01-13T18:20:38.513 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.512+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~GSPZKR8EOP47.0 size=501043 2024-01-13T18:20:38.513 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.512+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=GSPZKR8EOP47 tag=HPVLDWWVMP8P type=write size=1549619 2024-01-13T18:20:38.515 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.514+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=CKZA5Q3L1LH9 type=del 2024-01-13T18:20:38.516 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.515+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=Z8VEI9YYGZPQ type=write size=714539 2024-01-13T18:20:38.518 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.517+0000 7f759fd04880 -1 < failed to complete operation key=H4VHC37BOZJ3 tag=40P9PFCNUYOH type=del size=1824530: (22) Invalid argument 2024-01-13T18:20:38.520 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.519+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=RYRDQDZDUYYH type=del size=2043537 2024-01-13T18:20:38.522 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.521+0000 7f759fd04880 1 < completed write operation key=H7C1UAGAUR7D tag=8UXWUQFD3W1I type=write size=158696 2024-01-13T18:20:38.525 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.524+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~U5U9S0YBAXHU.0 size=1048576 2024-01-13T18:20:38.526 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.525+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~U5U9S0YBAXHU.1 size=1048576 2024-01-13T18:20:38.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.527+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~U5U9S0YBAXHU.2 size=27358 2024-01-13T18:20:38.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.527+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=U5U9S0YBAXHU tag=H2UZ5LGKAE0X type=write size=3173086 2024-01-13T18:20:38.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.527+0000 7f759fd04880 1 < canceled part key=_multipart_1O3XX67RKHNW.2~SK8STX0FH6WA.0 size=1048576 2024-01-13T18:20:38.529 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.528+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~SK8STX0FH6WA.1 size=1048576 2024-01-13T18:20:38.531 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.530+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~SK8STX0FH6WA.2 size=9145 2024-01-13T18:20:38.533 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.532+0000 7f759fd04880 1 < canceled multipart upload key=1O3XX67RKHNW upload=SK8STX0FH6WA tag=GWDUJM6ENQJD type=write size=3154873 2024-01-13T18:20:38.535 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.534+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=Q7FZXXXPB9QZ type=del size=862632 2024-01-13T18:20:38.536 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.535+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~CD3LBLZ816LA.0 size=788640 2024-01-13T18:20:38.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.539+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=CD3LBLZ816LA tag=6I748G73TLD7 type=write size=1837216 2024-01-13T18:20:38.541 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.540+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=T2UROP93EK6N type=del size=1148388 2024-01-13T18:20:38.543 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.542+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~RWO8GKYKHVMC.0 size=465872 2024-01-13T18:20:38.546 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.545+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=RWO8GKYKHVMC tag=V8C2PSNF61J6 type=write size=1514448 2024-01-13T18:20:38.548 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.547+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=U90WD0RJXZJT type=del size=2279169 2024-01-13T18:20:38.548 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.547+0000 7f759fd04880 1 < canceled part key=_multipart_2OO7S2NBZ7M6.2~FG7VVOW2ZU8J.0 size=1048576 2024-01-13T18:20:38.550 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.549+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~FG7VVOW2ZU8J.1 size=40384 2024-01-13T18:20:38.552 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.551+0000 7f759fd04880 1 < canceled multipart upload key=2OO7S2NBZ7M6 upload=FG7VVOW2ZU8J tag=UCA5YA3YC1TP type=write size=2137536 2024-01-13T18:20:38.554 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.553+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=3OFJSJ6JOR9M type=del size=1509543 2024-01-13T18:20:38.556 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.555+0000 7f759fd04880 1 < canceled operation key=XBTWSUA3D7U3 tag=RU3O3M1KIYTY type=write size=326992 2024-01-13T18:20:38.557 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.556+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=FM6S63EXC8RY type=del size=1761778 2024-01-13T18:20:38.559 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.558+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=98L5FUCR6FZM type=del 2024-01-13T18:20:38.562 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.561+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~O24M21PF8YOJ.0 size=1048576 2024-01-13T18:20:38.563 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.562+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~O24M21PF8YOJ.1 size=578151 2024-01-13T18:20:38.563 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.562+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=O24M21PF8YOJ tag=GU6YE8GE629G type=write size=2675303 2024-01-13T18:20:38.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.566+0000 7f759fd04880 1 < suggested remove operation key=H972TC5DOMHL tag=LD51QI51AIY4 type=write 2024-01-13T18:20:38.570 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.569+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~5P0TY9PRBA2G.0 size=1048576 2024-01-13T18:20:38.572 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.571+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~5P0TY9PRBA2G.1 size=1048576 2024-01-13T18:20:38.573 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.572+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~5P0TY9PRBA2G.2 size=781689 2024-01-13T18:20:38.573 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.572+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=5P0TY9PRBA2G tag=WL4KNYSLN4BS type=write size=3927417 2024-01-13T18:20:38.575 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.574+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~67KO9M56E920.0 size=1048576 2024-01-13T18:20:38.576 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.575+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~67KO9M56E920.1 size=1048576 2024-01-13T18:20:38.577 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.576+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~67KO9M56E920.2 size=36461 2024-01-13T18:20:38.580 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.579+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=67KO9M56E920 tag=3HOZU3YX1IUE type=write size=3182189 2024-01-13T18:20:38.581 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.581+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=IUK3PCWV5381 type=del size=1147685 2024-01-13T18:20:38.583 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.582+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=B6HU9KVNJ9OP type=del 2024-01-13T18:20:38.585 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.584+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=L627AKEG8SMZ type=del size=3417653 2024-01-13T18:20:38.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.593+0000 7f759fd04880 1 < suggested update operation key=2OO7S2NBZ7M6 tag=2668S0TJ12SC type=del size=92721 2024-01-13T18:20:38.596 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.595+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=T9QLJBCIZTCM type=del size=1626718 2024-01-13T18:20:38.597 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.596+0000 7f759fd04880 1 < completed delete operation key=1YNH6QHP354U tag=TD7NTLMROBRT type=del 2024-01-13T18:20:38.599 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.598+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=GUNMJ9T6HWOR type=write size=497708 2024-01-13T18:20:38.601 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.600+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=45U3304GQQ0K type=del 2024-01-13T18:20:38.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.602+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=1ZDLTNNUPWGX type=del size=864370 2024-01-13T18:20:38.605 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.604+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~GSPZKR8EOP47.0 size=501043 2024-01-13T18:20:38.608 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.607+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=GSPZKR8EOP47 tag=HPVLDWWVMP8P type=write size=1549619 2024-01-13T18:20:38.609 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.609+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=34PM3AIWQ2SR type=del size=3495824 2024-01-13T18:20:38.611 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.610+0000 7f759fd04880 1 < completed write operation key=QD5GBLNCY707 tag=Z8VEI9YYGZPQ type=write size=714539 2024-01-13T18:20:38.613 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.612+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=OL0IGKD1D7NZ type=del size=2618111 2024-01-13T18:20:38.614 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.613+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=RYRDQDZDUYYH type=del 2024-01-13T18:20:38.617 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.616+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~A0HIJ4J489G1.0 size=162568 2024-01-13T18:20:38.617 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.616+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=A0HIJ4J489G1 tag=1KY19U02TBGJ type=write size=1211144 2024-01-13T18:20:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:38 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:20:38.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:38 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:20:38.619 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.618+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~U5U9S0YBAXHU.0 size=1048576 2024-01-13T18:20:38.621 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.620+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~U5U9S0YBAXHU.1 size=1048576 2024-01-13T18:20:38.622 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.621+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~U5U9S0YBAXHU.2 size=27358 2024-01-13T18:20:38.625 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.624+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=U5U9S0YBAXHU tag=H2UZ5LGKAE0X type=write size=3173086 2024-01-13T18:20:38.628 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.627+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~KGV4VCNRKQIT.0 size=1048576 2024-01-13T18:20:38.633 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.628+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~KGV4VCNRKQIT.1 size=584355 2024-01-13T18:20:38.633 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.628+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=KGV4VCNRKQIT tag=W5Q60OKC1E6Y type=write size=2681507 2024-01-13T18:20:38.633 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.630+0000 7f759fd04880 1 < canceled operation key=H4VHC37BOZJ3 tag=Q7FZXXXPB9QZ type=del size=862632 2024-01-13T18:20:38.633 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.632+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=2UTHAXVYGFNX type=del size=2167396 2024-01-13T18:20:38.634 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.633+0000 7f759fd04880 1 < canceled operation key=6GOU0WSHKUQ0 tag=T2UROP93EK6N type=del size=1148388 2024-01-13T18:20:38.636 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.635+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=BC26RKHWKBUD type=del size=3894125 2024-01-13T18:20:38.638 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.637+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=U90WD0RJXZJT type=del 2024-01-13T18:20:38.641 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.640+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~YBHS1VNPX4BV.0 size=1048576 2024-01-13T18:20:38.643 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.642+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~YBHS1VNPX4BV.1 size=538828 2024-01-13T18:20:38.643 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.642+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=YBHS1VNPX4BV tag=DQL3QNJDDK9N type=write size=2635980 2024-01-13T18:20:38.645 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.644+0000 7f759fd04880 1 < canceled operation key=JGALONWJXLQY tag=3OFJSJ6JOR9M type=del size=1509543 2024-01-13T18:20:38.646 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.645+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=7X9YDV3K5Q3F type=del size=1215281 2024-01-13T18:20:38.650 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.649+0000 7f759fd04880 1 < suggested remove operation key=XBTWSUA3D7U3 tag=FM6S63EXC8RY type=del 2024-01-13T18:20:38.653 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.652+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~KFYHF1QWMH4X.0 size=1048576 2024-01-13T18:20:38.655 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.653+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~KFYHF1QWMH4X.1 size=713226 2024-01-13T18:20:38.655 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.653+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=KFYHF1QWMH4X tag=FKNI1V0WFG40 type=write size=2810378 2024-01-13T18:20:38.656 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.655+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~O24M21PF8YOJ.0 size=1048576 2024-01-13T18:20:38.658 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.657+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~O24M21PF8YOJ.1 size=578151 2024-01-13T18:20:38.660 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.659+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=O24M21PF8YOJ tag=GU6YE8GE629G type=write size=2675303 2024-01-13T18:20:38.662 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.661+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=OU2KR1Q0JM70 type=del size=429389 2024-01-13T18:20:38.664 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.663+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~5P0TY9PRBA2G.0 size=1048576 2024-01-13T18:20:38.666 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.665+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~5P0TY9PRBA2G.1 size=1048576 2024-01-13T18:20:38.667 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.667+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~5P0TY9PRBA2G.2 size=781689 2024-01-13T18:20:38.670 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.669+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=5P0TY9PRBA2G tag=WL4KNYSLN4BS type=write size=3927417 2024-01-13T18:20:38.672 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.671+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=KANUUSQYEW97 type=del size=1865322 2024-01-13T18:20:38.674 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.672+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=IUK3PCWV5381 type=del 2024-01-13T18:20:38.675 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.674+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=PB75CL0W9PW8 type=write size=158462 2024-01-13T18:20:38.677 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.675+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=L627AKEG8SMZ type=del 2024-01-13T18:20:38.680 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.679+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~P2503EHX4IR1.0 size=1048576 2024-01-13T18:20:38.682 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.680+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~P2503EHX4IR1.1 size=1048576 2024-01-13T18:20:38.683 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.682+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~P2503EHX4IR1.2 size=106307 2024-01-13T18:20:38.683 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.682+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=P2503EHX4IR1 tag=Y5KT5FLWQ8H5 type=write size=3252035 2024-01-13T18:20:38.684 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.683+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=T9QLJBCIZTCM type=del 2024-01-13T18:20:38.688 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.687+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~AHGD16C7VCWE.0 size=1048576 2024-01-13T18:20:38.689 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.688+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~AHGD16C7VCWE.1 size=898934 2024-01-13T18:20:38.689 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.688+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=AHGD16C7VCWE tag=0DWJ41BK4BYB type=write size=2996086 2024-01-13T18:20:38.693 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.692+0000 7f759fd04880 1 < suggested update operation key=AJZB1PXB1NB5 tag=GUNMJ9T6HWOR type=write size=497708 2024-01-13T18:20:38.696 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.695+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~WN3REVL4RZLC.0 size=1048576 2024-01-13T18:20:38.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.696+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~WN3REVL4RZLC.1 size=765107 2024-01-13T18:20:38.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.696+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=WN3REVL4RZLC tag=MLPWYF1ETJ9D type=write size=2862259 2024-01-13T18:20:38.699 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.698+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=1ZDLTNNUPWGX type=del 2024-01-13T18:20:38.700 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.699+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=Z0I1LC16LOZ5 type=del size=3538790 2024-01-13T18:20:38.702 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.701+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=34PM3AIWQ2SR type=del 2024-01-13T18:20:38.703 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.702+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=U9PDUW57ODM2 type=del size=4020036 2024-01-13T18:20:38.704 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.703+0000 7f759fd04880 -1 < no bi entry to suggest for operation key=XBTWSUA3D7U3 tag=OL0IGKD1D7NZ type=del size=2618111: (2) No such file or directory 2024-01-13T18:20:38.705 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.705+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=4M9E1ILNT87U type=del size=3771785 2024-01-13T18:20:38.708 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.706+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~A0HIJ4J489G1.0 size=162568 2024-01-13T18:20:38.711 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.710+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=A0HIJ4J489G1 tag=1KY19U02TBGJ type=write size=1211144 2024-01-13T18:20:38.714 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.713+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~6I021CHJ6QYW.0 size=702562 2024-01-13T18:20:38.714 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.713+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=6I021CHJ6QYW tag=3FET8766T04X type=write size=1751138 2024-01-13T18:20:38.715 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.715+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~KGV4VCNRKQIT.0 size=1048576 2024-01-13T18:20:38.717 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.716+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~KGV4VCNRKQIT.1 size=584355 2024-01-13T18:20:38.720 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.719+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=KGV4VCNRKQIT tag=W5Q60OKC1E6Y type=write size=2681507 2024-01-13T18:20:38.723 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.722+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~PWXGTDT05I9I.0 size=1048576 2024-01-13T18:20:38.724 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.723+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~PWXGTDT05I9I.1 size=414246 2024-01-13T18:20:38.724 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.723+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=PWXGTDT05I9I tag=MTDE21AN0SQ7 type=write size=2511398 2024-01-13T18:20:38.726 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.725+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=2UTHAXVYGFNX type=del 2024-01-13T18:20:38.729 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.729+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~NDAEZ0BC48EF.0 size=1048576 2024-01-13T18:20:38.731 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.730+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~NDAEZ0BC48EF.1 size=1048576 2024-01-13T18:20:38.732 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.731+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~NDAEZ0BC48EF.2 size=766565 2024-01-13T18:20:38.732 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.731+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=NDAEZ0BC48EF tag=VZUKR75ZKME7 type=write size=3912293 2024-01-13T18:20:38.734 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.733+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=BC26RKHWKBUD type=del 2024-01-13T18:20:38.735 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.734+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=E9VSRK1I1Z3Z type=del size=341797 2024-01-13T18:20:38.737 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.736+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~YBHS1VNPX4BV.0 size=1048576 2024-01-13T18:20:38.738 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.737+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~YBHS1VNPX4BV.1 size=538828 2024-01-13T18:20:38.741 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.740+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=YBHS1VNPX4BV tag=DQL3QNJDDK9N type=write size=2635980 2024-01-13T18:20:38.744 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.743+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~556FZL8M7D47.0 size=1048576 2024-01-13T18:20:38.745 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.744+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~556FZL8M7D47.1 size=453683 2024-01-13T18:20:38.745 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.744+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=556FZL8M7D47 tag=R1WYFC06WNXE type=write size=2550835 2024-01-13T18:20:38.747 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.746+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=7X9YDV3K5Q3F type=del 2024-01-13T18:20:38.749 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.748+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=UOZVT888WCWS type=del size=2529424 2024-01-13T18:20:38.751 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.750+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~KFYHF1QWMH4X.0 size=1048576 2024-01-13T18:20:38.752 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.751+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~KFYHF1QWMH4X.1 size=713226 2024-01-13T18:20:38.755 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.754+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=KFYHF1QWMH4X tag=FKNI1V0WFG40 type=write size=2810378 2024-01-13T18:20:38.757 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.756+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=WSS35O0HX3Q2 type=del size=1040129 2024-01-13T18:20:38.759 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.758+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=OU2KR1Q0JM70 type=del 2024-01-13T18:20:38.761 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.760+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=PX4GEBOJJ2NY type=del size=639440 2024-01-13T18:20:38.764 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.763+0000 7f759fd04880 1 < suggested remove operation key=H7C1UAGAUR7D tag=KANUUSQYEW97 type=del 2024-01-13T18:20:38.766 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.765+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=99G5UGREI4CH type=del size=3107028 2024-01-13T18:20:38.768 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.766+0000 7f759fd04880 1 < completed write operation key=ZI9WAZQHVPAR tag=PB75CL0W9PW8 type=write size=158462 2024-01-13T18:20:38.769 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.768+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=ZCACJVWH8OXB type=del size=613391 2024-01-13T18:20:38.770 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.769+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~P2503EHX4IR1.0 size=1048576 2024-01-13T18:20:38.772 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.771+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~P2503EHX4IR1.1 size=1048576 2024-01-13T18:20:38.773 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.772+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~P2503EHX4IR1.2 size=106307 2024-01-13T18:20:38.776 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.775+0000 7f759fd04880 1 < completed multipart upload key=7R5YIO7UFSDZ upload=P2503EHX4IR1 tag=Y5KT5FLWQ8H5 type=write size=3252035 2024-01-13T18:20:38.778 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.776+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=PVEMNTWUSPTK type=del size=1440647 2024-01-13T18:20:38.779 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.778+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~AHGD16C7VCWE.0 size=1048576 2024-01-13T18:20:38.780 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.779+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~AHGD16C7VCWE.1 size=898934 2024-01-13T18:20:38.783 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.782+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=AHGD16C7VCWE tag=0DWJ41BK4BYB type=write size=2996086 2024-01-13T18:20:38.785 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.784+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=JY0CMHTHUG20 type=del size=4088249 2024-01-13T18:20:38.785 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.784+0000 7f759fd04880 1 < canceled part key=_multipart_1O3XX67RKHNW.2~WN3REVL4RZLC.0 size=1048576 2024-01-13T18:20:38.787 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.785+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~WN3REVL4RZLC.1 size=765107 2024-01-13T18:20:38.789 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.788+0000 7f759fd04880 1 < canceled multipart upload key=1O3XX67RKHNW upload=WN3REVL4RZLC tag=MLPWYF1ETJ9D type=write size=2862259 2024-01-13T18:20:38.791 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.790+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=J5WOPA3BAXO0 type=del size=2694966 2024-01-13T18:20:38.792 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.791+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=Z0I1LC16LOZ5 type=del 2024-01-13T18:20:38.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.794+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~M82NBH45HHLB.0 size=281864 2024-01-13T18:20:38.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.794+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=M82NBH45HHLB tag=KY6T3S3OXWEY type=write size=1330440 2024-01-13T18:20:38.797 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.796+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=U9PDUW57ODM2 type=del 2024-01-13T18:20:38.798 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.797+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=JU8A8IZXSNU3 type=del size=1932130 2024-01-13T18:20:38.801 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.800+0000 7f759fd04880 1 < suggested update operation key=TNC2YDZYGM6G tag=4M9E1ILNT87U type=del size=3771785 2024-01-13T18:20:38.803 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.802+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=Q8YMF17CIDWC type=del size=3398745 2024-01-13T18:20:38.804 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.804+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~6I021CHJ6QYW.0 size=702562 2024-01-13T18:20:38.807 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.806+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=6I021CHJ6QYW tag=3FET8766T04X type=write size=1751138 2024-01-13T18:20:38.810 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.809+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~EFOA7URYIVHT.0 size=1048576 2024-01-13T18:20:38.812 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.811+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~EFOA7URYIVHT.1 size=847667 2024-01-13T18:20:38.812 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.811+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=EFOA7URYIVHT tag=3RIY5CSE2CY8 type=write size=2944819 2024-01-13T18:20:38.813 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.812+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~PWXGTDT05I9I.0 size=1048576 2024-01-13T18:20:38.815 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.814+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~PWXGTDT05I9I.1 size=414246 2024-01-13T18:20:38.818 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.816+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=PWXGTDT05I9I tag=MTDE21AN0SQ7 type=write size=2511398 2024-01-13T18:20:38.820 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.820+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~62TJAZHS4WF6.0 size=1048576 2024-01-13T18:20:38.822 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.821+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~62TJAZHS4WF6.1 size=1048576 2024-01-13T18:20:38.824 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.823+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~62TJAZHS4WF6.2 size=145331 2024-01-13T18:20:38.824 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.823+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=62TJAZHS4WF6 tag=N94FJJUR0JD3 type=write size=3291059 2024-01-13T18:20:38.825 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.824+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~NDAEZ0BC48EF.0 size=1048576 2024-01-13T18:20:38.827 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.826+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~NDAEZ0BC48EF.1 size=1048576 2024-01-13T18:20:38.828 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.827+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~NDAEZ0BC48EF.2 size=766565 2024-01-13T18:20:38.831 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.830+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=NDAEZ0BC48EF tag=VZUKR75ZKME7 type=write size=3912293 2024-01-13T18:20:38.835 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.833+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~RK8ZBQUNJ9E4.0 size=1048576 2024-01-13T18:20:38.835 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.834+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~RK8ZBQUNJ9E4.1 size=425086 2024-01-13T18:20:38.835 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.834+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=RK8ZBQUNJ9E4 tag=J4313OZC4315 type=write size=2522238 2024-01-13T18:20:38.838 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.837+0000 7f759fd04880 1 < suggested update operation key=1YNH6QHP354U tag=E9VSRK1I1Z3Z type=del size=341797 2024-01-13T18:20:38.840 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.839+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=STUOVMMBDH5N type=del size=2110211 2024-01-13T18:20:38.841 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.840+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~556FZL8M7D47.0 size=1048576 2024-01-13T18:20:38.843 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.842+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~556FZL8M7D47.1 size=453683 2024-01-13T18:20:38.846 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.845+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=556FZL8M7D47 tag=R1WYFC06WNXE type=write size=2550835 2024-01-13T18:20:38.849 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.848+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~KOO8R8RGOJY0.0 size=1048576 2024-01-13T18:20:38.850 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.849+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~KOO8R8RGOJY0.1 size=673421 2024-01-13T18:20:38.850 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.849+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=KOO8R8RGOJY0 tag=NMNXV661WI20 type=write size=2770573 2024-01-13T18:20:38.853 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.852+0000 7f759fd04880 1 < suggested remove operation key=TNC2YDZYGM6G tag=UOZVT888WCWS type=del 2024-01-13T18:20:38.856 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.855+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~27H5NZ1KZ80H.0 size=1048576 2024-01-13T18:20:38.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.856+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~27H5NZ1KZ80H.1 size=1048576 2024-01-13T18:20:38.859 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.858+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~27H5NZ1KZ80H.2 size=291535 2024-01-13T18:20:38.859 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.858+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=27H5NZ1KZ80H tag=UT5VJF3WUOV6 type=write size=3437263 2024-01-13T18:20:38.861 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.859+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=WSS35O0HX3Q2 type=del 2024-01-13T18:20:38.862 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.861+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=VCMOMY508R3U type=del size=3909942 2024-01-13T18:20:38.864 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.863+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=PX4GEBOJJ2NY type=del 2024-01-13T18:20:38.867 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.866+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~NJO3A6ZU0ZPZ.0 size=1048576 2024-01-13T18:20:38.868 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.867+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~NJO3A6ZU0ZPZ.1 size=631578 2024-01-13T18:20:38.868 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.867+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=NJO3A6ZU0ZPZ tag=1YKHBO49E119 type=write size=2728730 2024-01-13T18:20:38.870 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.869+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=99G5UGREI4CH type=del 2024-01-13T18:20:38.872 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.871+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=PBM02U6674BE type=del size=3918213 2024-01-13T18:20:38.873 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.872+0000 7f759fd04880 1 < canceled operation key=RY0W5S41XK3F tag=ZCACJVWH8OXB type=del size=613391 2024-01-13T18:20:38.875 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.874+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=H1W1GX2APYGO type=del size=1431568 2024-01-13T18:20:38.879 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.878+0000 7f759fd04880 1 < suggested remove operation key=ZI9WAZQHVPAR tag=PVEMNTWUSPTK type=del 2024-01-13T18:20:38.880 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.879+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=0I3NUFWQ9JRN type=write size=610019 2024-01-13T18:20:38.882 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.881+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=JY0CMHTHUG20 type=del 2024-01-13T18:20:38.884 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.883+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=BQORYDYEIDA4 type=del size=190272 2024-01-13T18:20:38.886 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.885+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=J5WOPA3BAXO0 type=del 2024-01-13T18:20:38.889 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.888+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~GFPJA9NLUOTN.0 size=878827 2024-01-13T18:20:38.889 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.888+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=GFPJA9NLUOTN tag=3A9WX1VA3DEH type=write size=1927403 2024-01-13T18:20:38.891 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.890+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~M82NBH45HHLB.0 size=281864 2024-01-13T18:20:38.893 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.892+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=M82NBH45HHLB tag=KY6T3S3OXWEY type=write size=1330440 2024-01-13T18:20:38.895 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.894+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=O5O4PQVP5JGO type=del size=2149937 2024-01-13T18:20:38.899 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.898+0000 7f759fd04880 1 < suggested update operation key=TNC2YDZYGM6G tag=JU8A8IZXSNU3 type=del size=1932130 2024-01-13T18:20:38.900 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.899+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=YWEJ2ZG09CB5 type=del size=1419977 2024-01-13T18:20:38.902 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.901+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=Q8YMF17CIDWC type=del 2024-01-13T18:20:38.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.903+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=WS7ELY5V32VF type=del size=2845431 2024-01-13T18:20:38.906 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.905+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~EFOA7URYIVHT.0 size=1048576 2024-01-13T18:20:38.907 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.906+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~EFOA7URYIVHT.1 size=847667 2024-01-13T18:20:38.911 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.910+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=EFOA7URYIVHT tag=3RIY5CSE2CY8 type=write size=2944819 2024-01-13T18:20:38.912 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.911+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=B1GE5CUEF4S4 type=del size=3649852 2024-01-13T18:20:38.914 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.913+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~62TJAZHS4WF6.0 size=1048576 2024-01-13T18:20:38.916 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.915+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~62TJAZHS4WF6.1 size=1048576 2024-01-13T18:20:38.917 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.916+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~62TJAZHS4WF6.2 size=145331 2024-01-13T18:20:38.920 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.919+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=62TJAZHS4WF6 tag=N94FJJUR0JD3 type=write size=3291059 2024-01-13T18:20:38.923 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.921+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=ZYD2HLYL34IF type=del size=2154020 2024-01-13T18:20:38.924 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.923+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~RK8ZBQUNJ9E4.0 size=1048576 2024-01-13T18:20:38.926 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.925+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~RK8ZBQUNJ9E4.1 size=425086 2024-01-13T18:20:38.928 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.927+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=RK8ZBQUNJ9E4 tag=J4313OZC4315 type=write size=2522238 2024-01-13T18:20:38.930 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.929+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=EVS1GER5334Y type=del size=2405683 2024-01-13T18:20:38.932 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.931+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=STUOVMMBDH5N type=del 2024-01-13T18:20:38.934 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.933+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=543V6UKQQ36J type=del size=1668979 2024-01-13T18:20:38.935 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.935+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~KOO8R8RGOJY0.0 size=1048576 2024-01-13T18:20:38.938 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.936+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~KOO8R8RGOJY0.1 size=673421 2024-01-13T18:20:38.940 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.939+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=KOO8R8RGOJY0 tag=NMNXV661WI20 type=write size=2770573 2024-01-13T18:20:38.941 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.940+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=CWXNGR5OZQD1 type=write size=629694 2024-01-13T18:20:38.943 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.942+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~27H5NZ1KZ80H.0 size=1048576 2024-01-13T18:20:38.945 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.944+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~27H5NZ1KZ80H.1 size=1048576 2024-01-13T18:20:38.946 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.945+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~27H5NZ1KZ80H.2 size=291535 2024-01-13T18:20:38.949 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.948+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=27H5NZ1KZ80H tag=UT5VJF3WUOV6 type=write size=3437263 2024-01-13T18:20:38.952 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.951+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~H1UDBE529CS0.0 size=739993 2024-01-13T18:20:38.952 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.951+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=H1UDBE529CS0 tag=1YEQDNI5990M type=write size=1788569 2024-01-13T18:20:38.954 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.953+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=VCMOMY508R3U type=del 2024-01-13T18:20:38.956 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.956+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~XODGQH73G8WD.0 size=1048576 2024-01-13T18:20:38.958 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.957+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~XODGQH73G8WD.1 size=1048576 2024-01-13T18:20:38.959 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.958+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~XODGQH73G8WD.2 size=1043275 2024-01-13T18:20:38.960 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.958+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=XODGQH73G8WD tag=MMMMQ113ENGF type=write size=4189003 2024-01-13T18:20:38.961 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.960+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~NJO3A6ZU0ZPZ.0 size=1048576 2024-01-13T18:20:38.961 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.960+0000 7f759fd04880 1 < canceled part key=_multipart_1YNH6QHP354U.2~NJO3A6ZU0ZPZ.1 size=631578 2024-01-13T18:20:38.964 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.963+0000 7f759fd04880 1 < canceled multipart upload key=1YNH6QHP354U upload=NJO3A6ZU0ZPZ tag=1YKHBO49E119 type=write size=2728730 2024-01-13T18:20:38.966 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.965+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=W9XBT9JBQ4CB type=del size=1796464 2024-01-13T18:20:38.968 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.967+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=PBM02U6674BE type=del 2024-01-13T18:20:38.970 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.969+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=5KAJN4QW09EK type=write size=527964 2024-01-13T18:20:38.972 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.971+0000 7f759fd04880 -1 < failed to complete operation key=TNC2YDZYGM6G tag=H1W1GX2APYGO type=del size=1431568: (22) Invalid argument 2024-01-13T18:20:38.975 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.974+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~CT4MWZ910579.0 size=1048576 2024-01-13T18:20:38.976 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.975+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~CT4MWZ910579.1 size=1048576 2024-01-13T18:20:38.978 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.977+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~CT4MWZ910579.2 size=830824 2024-01-13T18:20:38.978 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.977+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=CT4MWZ910579 tag=O3SC67LSXNR7 type=write size=3976552 2024-01-13T18:20:38.980 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.979+0000 7f759fd04880 -1 < failed to complete operation key=TNC2YDZYGM6G tag=0I3NUFWQ9JRN type=write size=610019: (22) Invalid argument 2024-01-13T18:20:38.984 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.983+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~15GEAMVPJYHG.0 size=1048576 2024-01-13T18:20:38.985 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.984+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~15GEAMVPJYHG.1 size=1048576 2024-01-13T18:20:38.987 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.986+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~15GEAMVPJYHG.2 size=315370 2024-01-13T18:20:38.987 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.986+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=15GEAMVPJYHG tag=E601LLA0FC8P type=write size=3461098 2024-01-13T18:20:38.988 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.987+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=BQORYDYEIDA4 type=del 2024-01-13T18:20:38.990 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.989+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=IPPSGF76IX0Z type=del size=6694 2024-01-13T18:20:38.991 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.990+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~GFPJA9NLUOTN.0 size=878827 2024-01-13T18:20:38.994 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.993+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=GFPJA9NLUOTN tag=3A9WX1VA3DEH type=write size=1927403 2024-01-13T18:20:38.996 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.995+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=2WD8MNKHMPV7 type=del size=3010486 2024-01-13T18:20:38.997 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.996+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=O5O4PQVP5JGO type=del 2024-01-13T18:20:38.999 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:38.998+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=97CYQZ2ZKGO0 type=del size=157 2024-01-13T18:20:39.001 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.000+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=YWEJ2ZG09CB5 type=del 2024-01-13T18:20:39.003 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.002+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=HUBUIEWUW8RX type=write size=577720 2024-01-13T18:20:39.005 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.004+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=WS7ELY5V32VF type=del 2024-01-13T18:20:39.008 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.007+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~R9DZ5T381039.0 size=1048576 2024-01-13T18:20:39.009 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.008+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~R9DZ5T381039.1 size=882922 2024-01-13T18:20:39.009 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.008+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=R9DZ5T381039 tag=EIEBD0V04EBK type=write size=2980074 2024-01-13T18:20:39.012 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.011+0000 7f759fd04880 1 < suggested update operation key=0TIZPXX8CMHA tag=B1GE5CUEF4S4 type=del size=3649852 2024-01-13T18:20:39.014 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.013+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=870BF53CAOAG type=del size=3445043 2024-01-13T18:20:39.016 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.015+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=ZYD2HLYL34IF type=del 2024-01-13T18:20:39.019 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.018+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~70RFOZ1LIE59.0 size=1048576 2024-01-13T18:20:39.020 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.019+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~70RFOZ1LIE59.1 size=1048576 2024-01-13T18:20:39.022 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.021+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~70RFOZ1LIE59.2 size=563061 2024-01-13T18:20:39.022 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.021+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=70RFOZ1LIE59 tag=9XXJGLJHA9WT type=write size=3708789 2024-01-13T18:20:39.024 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.023+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=EVS1GER5334Y type=del 2024-01-13T18:20:39.025 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.024+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=BTAPKPXP84PH type=del size=842799 2024-01-13T18:20:39.027 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.026+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=543V6UKQQ36J type=del 2024-01-13T18:20:39.030 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.029+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=T7FBZQ8UNHTM type=del size=3351080 2024-01-13T18:20:39.032 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.031+0000 7f759fd04880 1 < completed write operation key=XBTWSUA3D7U3 tag=CWXNGR5OZQD1 type=write size=629694 2024-01-13T18:20:39.034 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.033+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=9VSHOF2YZPZQ type=del size=1932360 2024-01-13T18:20:39.034 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.033+0000 7f759fd04880 1 < canceled part key=_multipart_DOXP3EJ03EBY.2~H1UDBE529CS0.0 size=739993 2024-01-13T18:20:39.037 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.036+0000 7f759fd04880 1 < canceled multipart upload key=DOXP3EJ03EBY upload=H1UDBE529CS0 tag=1YEQDNI5990M type=write size=1788569 2024-01-13T18:20:39.039 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.038+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=NPFQOAPRVFJ5 type=del size=4027178 2024-01-13T18:20:39.041 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.040+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~XODGQH73G8WD.0 size=1048576 2024-01-13T18:20:39.043 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.042+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~XODGQH73G8WD.1 size=1048576 2024-01-13T18:20:39.044 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.044+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~XODGQH73G8WD.2 size=1043275 2024-01-13T18:20:39.048 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.047+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=XODGQH73G8WD tag=MMMMQ113ENGF type=write size=4189003 2024-01-13T18:20:39.052 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.051+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~RQX2XLG3QYIB.0 size=806334 2024-01-13T18:20:39.052 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.051+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=RQX2XLG3QYIB tag=DM1ZU51TW0SU type=write size=1854910 2024-01-13T18:20:39.055 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.054+0000 7f759fd04880 1 < suggested remove operation key=H972TC5DOMHL tag=W9XBT9JBQ4CB type=del 2024-01-13T18:20:39.057 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.056+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=M1HYS8G1HXDO type=del size=2132664 2024-01-13T18:20:39.061 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.060+0000 7f759fd04880 1 < suggested update operation key=RY0W5S41XK3F tag=5KAJN4QW09EK type=write size=527964 2024-01-13T18:20:39.063 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.062+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=U8YXHN3TIHTB type=write size=800007 2024-01-13T18:20:39.064 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.064+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~CT4MWZ910579.0 size=1048576 2024-01-13T18:20:39.066 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.065+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~CT4MWZ910579.1 size=1048576 2024-01-13T18:20:39.067 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.066+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~CT4MWZ910579.2 size=830824 2024-01-13T18:20:39.070 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.069+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=CT4MWZ910579 tag=O3SC67LSXNR7 type=write size=3976552 2024-01-13T18:20:39.072 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.071+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=5N1D0TQVUYA2 type=del size=3211294 2024-01-13T18:20:39.074 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.073+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~15GEAMVPJYHG.0 size=1048576 2024-01-13T18:20:39.075 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.074+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~15GEAMVPJYHG.1 size=1048576 2024-01-13T18:20:39.077 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.076+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~15GEAMVPJYHG.2 size=315370 2024-01-13T18:20:39.080 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.079+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=15GEAMVPJYHG tag=E601LLA0FC8P type=write size=3461098 2024-01-13T18:20:39.082 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.082+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~BW9EV4HTUXOG.0 size=1048576 2024-01-13T18:20:39.084 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.083+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~BW9EV4HTUXOG.1 size=1048576 2024-01-13T18:20:39.085 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.084+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~BW9EV4HTUXOG.2 size=238382 2024-01-13T18:20:39.085 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.084+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=BW9EV4HTUXOG tag=SOKLJQYKP0EA type=write size=3384110 2024-01-13T18:20:39.087 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.086+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=IPPSGF76IX0Z type=del 2024-01-13T18:20:39.089 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.088+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=Z7W4TZ8T0XUR type=del size=711047 2024-01-13T18:20:39.090 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.089+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=2WD8MNKHMPV7 type=del 2024-01-13T18:20:39.092 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.091+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=J1T1PLJLY777 type=del size=768180 2024-01-13T18:20:39.096 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.095+0000 7f759fd04880 1 < suggested update operation key=BPUBFFWB9D3C tag=97CYQZ2ZKGO0 type=del size=157 2024-01-13T18:20:39.097 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.096+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=GLMIBAPO4ANR type=del size=4086963 2024-01-13T18:20:39.099 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.098+0000 7f759fd04880 1 < completed write operation key=JN46AMLYHN8E tag=HUBUIEWUW8RX type=write size=577720 2024-01-13T18:20:39.102 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.101+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~650IVC6CKF7I.0 size=1048576 2024-01-13T18:20:39.104 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.103+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~650IVC6CKF7I.1 size=190175 2024-01-13T18:20:39.104 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.103+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=650IVC6CKF7I tag=JH9SRFG41WMB type=write size=2287327 2024-01-13T18:20:39.106 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.105+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~R9DZ5T381039.0 size=1048576 2024-01-13T18:20:39.108 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.107+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~R9DZ5T381039.1 size=882922 2024-01-13T18:20:39.110 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.110+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=R9DZ5T381039 tag=EIEBD0V04EBK type=write size=2980074 2024-01-13T18:20:39.112 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.111+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=9GO56HZZ0XAK type=del size=1814685 2024-01-13T18:20:39.114 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.113+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=870BF53CAOAG type=del 2024-01-13T18:20:39.117 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.116+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~66GSNIQT35W3.0 size=372305 2024-01-13T18:20:39.117 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.116+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=66GSNIQT35W3 tag=Y6CONP337RZ5 type=write size=1420881 2024-01-13T18:20:39.118 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.118+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~70RFOZ1LIE59.0 size=1048576 2024-01-13T18:20:39.120 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.119+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~70RFOZ1LIE59.1 size=1048576 2024-01-13T18:20:39.121 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.120+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~70RFOZ1LIE59.2 size=563061 2024-01-13T18:20:39.124 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.123+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=70RFOZ1LIE59 tag=9XXJGLJHA9WT type=write size=3708789 2024-01-13T18:20:39.126 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.125+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=NU2JRD22ZUGK type=del size=3234440 2024-01-13T18:20:39.128 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.127+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=BTAPKPXP84PH type=del 2024-01-13T18:20:39.129 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.128+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=88XW1GDWFDEY type=write size=37504 2024-01-13T18:20:39.131 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.130+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=T7FBZQ8UNHTM type=del 2024-01-13T18:20:39.134 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.133+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~A6C501EDFNFX.0 size=1048576 2024-01-13T18:20:39.135 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.135+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~A6C501EDFNFX.1 size=243169 2024-01-13T18:20:39.136 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.135+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=A6C501EDFNFX tag=QUZSSIG3OU23 type=write size=2340321 2024-01-13T18:20:39.137 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.136+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=9VSHOF2YZPZQ type=del 2024-01-13T18:20:39.139 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.138+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=664CKH6GGE8R type=del size=970460 2024-01-13T18:20:39.142 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.141+0000 7f759fd04880 1 < suggested update operation key=6GOU0WSHKUQ0 tag=NPFQOAPRVFJ5 type=del size=4027178 2024-01-13T18:20:39.144 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.143+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=L33B4ZOHEXMH type=write size=387188 2024-01-13T18:20:39.145 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.144+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~RQX2XLG3QYIB.0 size=806334 2024-01-13T18:20:39.150 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.148+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=RQX2XLG3QYIB tag=DM1ZU51TW0SU type=write size=1854910 2024-01-13T18:20:39.151 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.150+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=2X7MBTE0I3E2 type=del size=2663058 2024-01-13T18:20:39.153 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.151+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=M1HYS8G1HXDO type=del 2024-01-13T18:20:39.154 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.153+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=9D19V5ZKAKR3 type=write size=755657 2024-01-13T18:20:39.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.155+0000 7f759fd04880 1 < canceled operation key=1YNH6QHP354U tag=U8YXHN3TIHTB type=write size=800007 2024-01-13T18:20:39.157 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.156+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=W348I47B6MKH type=del size=1435372 2024-01-13T18:20:39.159 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.158+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=5N1D0TQVUYA2 type=del 2024-01-13T18:20:39.161 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.160+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=MWR5NFZ72NL0 type=del size=3540263 2024-01-13T18:20:39.162 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.161+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~BW9EV4HTUXOG.0 size=1048576 2024-01-13T18:20:39.164 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.163+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~BW9EV4HTUXOG.1 size=1048576 2024-01-13T18:20:39.165 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.164+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~BW9EV4HTUXOG.2 size=238382 2024-01-13T18:20:39.168 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.167+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=BW9EV4HTUXOG tag=SOKLJQYKP0EA type=write size=3384110 2024-01-13T18:20:39.173 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.172+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~HQ72P4AUX267.0 size=1048576 2024-01-13T18:20:39.176 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.175+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~HQ72P4AUX267.1 size=1030968 2024-01-13T18:20:39.176 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.175+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=HQ72P4AUX267 tag=59DQ7HPOFK33 type=write size=3128120 2024-01-13T18:20:39.180 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.179+0000 7f759fd04880 1 < suggested remove operation key=EW3ZFDVIQZ7G tag=Z7W4TZ8T0XUR type=del 2024-01-13T18:20:39.181 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.180+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=2IP6MS3X8U0F type=del size=1245505 2024-01-13T18:20:39.184 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.183+0000 7f759fd04880 1 < suggested update operation key=H972TC5DOMHL tag=J1T1PLJLY777 type=del size=768180 2024-01-13T18:20:39.186 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.185+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=PUGASKKX0MLZ type=del size=92113 2024-01-13T18:20:39.188 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.187+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=GLMIBAPO4ANR type=del 2024-01-13T18:20:39.189 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.188+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=IDM7KLCVB87W type=del size=96203 2024-01-13T18:20:39.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.190+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~650IVC6CKF7I.0 size=1048576 2024-01-13T18:20:39.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.190+0000 7f759fd04880 1 < canceled part key=_multipart_H972TC5DOMHL.2~650IVC6CKF7I.1 size=190175 2024-01-13T18:20:39.194 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.193+0000 7f759fd04880 1 < canceled multipart upload key=H972TC5DOMHL upload=650IVC6CKF7I tag=JH9SRFG41WMB type=write size=2287327 2024-01-13T18:20:39.195 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.194+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=YGM2D9BZ0SUM type=del size=210213 2024-01-13T18:20:39.198 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.197+0000 7f759fd04880 -1 < failed to complete operation key=EW3ZFDVIQZ7G tag=9GO56HZZ0XAK type=del size=1814685: (22) Invalid argument 2024-01-13T18:20:39.202 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.200+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~KWY53L5U2T7I.0 size=1048576 2024-01-13T18:20:39.202 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.201+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~KWY53L5U2T7I.1 size=909723 2024-01-13T18:20:39.202 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.201+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=KWY53L5U2T7I tag=OE7L3U3B0RO0 type=write size=3006875 2024-01-13T18:20:39.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.203+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~66GSNIQT35W3.0 size=372305 2024-01-13T18:20:39.206 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.206+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=66GSNIQT35W3 tag=Y6CONP337RZ5 type=write size=1420881 2024-01-13T18:20:39.210 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.209+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~UX67KU24B5ZI.0 size=1048576 2024-01-13T18:20:39.211 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.210+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~UX67KU24B5ZI.1 size=465582 2024-01-13T18:20:39.211 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.210+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=UX67KU24B5ZI tag=PGRZM90QHD1N type=write size=2562734 2024-01-13T18:20:39.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.212+0000 7f759fd04880 1 < canceled operation key=QD5GBLNCY707 tag=NU2JRD22ZUGK type=del size=3234440 2024-01-13T18:20:39.214 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.213+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=M12ZG59UUBM0 type=del size=3405470 2024-01-13T18:20:39.216 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.215+0000 7f759fd04880 1 < completed write operation key=H4VHC37BOZJ3 tag=88XW1GDWFDEY type=write size=37504 2024-01-13T18:20:39.217 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.216+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=0ZJDM5XLP25H type=del size=1890755 2024-01-13T18:20:39.219 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.218+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~A6C501EDFNFX.0 size=1048576 2024-01-13T18:20:39.221 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.220+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~A6C501EDFNFX.1 size=243169 2024-01-13T18:20:39.223 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.222+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=A6C501EDFNFX tag=QUZSSIG3OU23 type=write size=2340321 2024-01-13T18:20:39.225 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.224+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=BA950FOVGNTM type=del size=3034588 2024-01-13T18:20:39.229 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.228+0000 7f759fd04880 1 < suggested update operation key=AJZB1PXB1NB5 tag=664CKH6GGE8R type=del size=970460 2024-01-13T18:20:39.232 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.231+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~CSG8RS0TLN44.0 size=793407 2024-01-13T18:20:39.232 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.231+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=CSG8RS0TLN44 tag=QNG3YBL1H9A0 type=write size=1841983 2024-01-13T18:20:39.234 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.233+0000 7f759fd04880 -1 < failed to complete operation key=AJZB1PXB1NB5 tag=L33B4ZOHEXMH type=write size=387188: (22) Invalid argument 2024-01-13T18:20:39.236 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.235+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=JIWPPRRK1V9D type=write size=847954 2024-01-13T18:20:39.239 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.238+0000 7f759fd04880 1 < suggested update operation key=XBTWSUA3D7U3 tag=2X7MBTE0I3E2 type=del size=2663058 2024-01-13T18:20:39.242 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.241+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~DNKCSSB14SZR.0 size=1048576 2024-01-13T18:20:39.243 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.242+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~DNKCSSB14SZR.1 size=228277 2024-01-13T18:20:39.243 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.242+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=DNKCSSB14SZR tag=PK1YBSWDSDBK type=write size=2325429 2024-01-13T18:20:39.245 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.244+0000 7f759fd04880 1 < canceled operation key=8EWIOXN5H9KU tag=9D19V5ZKAKR3 type=write size=755657 2024-01-13T18:20:39.247 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.246+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=1Z4C1E1CQYCB type=del size=436523 2024-01-13T18:20:39.248 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.247+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=W348I47B6MKH type=del 2024-01-13T18:20:39.250 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.249+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=2KN937POMV0F type=del size=888300 2024-01-13T18:20:39.251 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.250+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=MWR5NFZ72NL0 type=del 2024-01-13T18:20:39.255 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.254+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~7UF9Q0YEJI9M.0 size=1048576 2024-01-13T18:20:39.256 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.255+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~7UF9Q0YEJI9M.1 size=1048576 2024-01-13T18:20:39.257 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.257+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~7UF9Q0YEJI9M.2 size=70242 2024-01-13T18:20:39.258 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.257+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=7UF9Q0YEJI9M tag=9C0DHV4HJS5T type=write size=3215970 2024-01-13T18:20:39.259 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.258+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~HQ72P4AUX267.0 size=1048576 2024-01-13T18:20:39.261 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.260+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~HQ72P4AUX267.1 size=1030968 2024-01-13T18:20:39.263 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.262+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=HQ72P4AUX267 tag=59DQ7HPOFK33 type=write size=3128120 2024-01-13T18:20:39.266 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.265+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~T7DLT4CA3E9T.0 size=1048576 2024-01-13T18:20:39.268 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.267+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~T7DLT4CA3E9T.1 size=1048576 2024-01-13T18:20:39.269 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.268+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~T7DLT4CA3E9T.2 size=238694 2024-01-13T18:20:39.269 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.268+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=T7DLT4CA3E9T tag=56TYKRYM5EFW type=write size=3384422 2024-01-13T18:20:39.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.272+0000 7f759fd04880 1 < suggested remove operation key=AJZB1PXB1NB5 tag=2IP6MS3X8U0F type=del 2024-01-13T18:20:39.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.273+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=12EXEBQX0L9U type=del size=2026247 2024-01-13T18:20:39.276 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.275+0000 7f759fd04880 -1 < failed to complete operation key=AJZB1PXB1NB5 tag=PUGASKKX0MLZ type=del size=92113: (22) Invalid argument 2024-01-13T18:20:39.278 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.277+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=3VKJWLRHHY0N type=write size=272286 2024-01-13T18:20:39.279 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.278+0000 7f759fd04880 1 < completed delete operation key=1YNH6QHP354U tag=IDM7KLCVB87W type=del 2024-01-13T18:20:39.281 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.280+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=N0CVR0RMYRAZ type=del size=3958704 2024-01-13T18:20:39.283 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.282+0000 7f759fd04880 -1 < failed to complete operation key=AJZB1PXB1NB5 tag=YGM2D9BZ0SUM type=del size=210213: (22) Invalid argument 2024-01-13T18:20:39.286 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.285+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~4YKXRYKR4EY9.0 size=1048576 2024-01-13T18:20:39.287 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.286+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~4YKXRYKR4EY9.1 size=1048576 2024-01-13T18:20:39.288 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.287+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~4YKXRYKR4EY9.2 size=524467 2024-01-13T18:20:39.288 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.287+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=4YKXRYKR4EY9 tag=YVA4UZRO9MO0 type=write size=3670195 2024-01-13T18:20:39.290 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.289+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~KWY53L5U2T7I.0 size=1048576 2024-01-13T18:20:39.291 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.290+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~KWY53L5U2T7I.1 size=909723 2024-01-13T18:20:39.294 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.293+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=KWY53L5U2T7I tag=OE7L3U3B0RO0 type=write size=3006875 2024-01-13T18:20:39.297 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.296+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~JN6EOH4A3A7G.0 size=1048576 2024-01-13T18:20:39.299 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.298+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~JN6EOH4A3A7G.1 size=837247 2024-01-13T18:20:39.299 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.298+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=JN6EOH4A3A7G tag=A0JFJJEKQB8K type=write size=2934399 2024-01-13T18:20:39.301 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.300+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~UX67KU24B5ZI.0 size=1048576 2024-01-13T18:20:39.302 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.301+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~UX67KU24B5ZI.1 size=465582 2024-01-13T18:20:39.305 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.304+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=UX67KU24B5ZI tag=PGRZM90QHD1N type=write size=2562734 2024-01-13T18:20:39.306 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.306+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=52YV1LAUK9WE type=del size=2040565 2024-01-13T18:20:39.309 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.308+0000 7f759fd04880 -1 < failed to complete operation key=XBTWSUA3D7U3 tag=M12ZG59UUBM0 type=del size=3405470: (22) Invalid argument 2024-01-13T18:20:39.310 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.309+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=U5LYMSGIJOOS type=del size=3172935 2024-01-13T18:20:39.312 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.311+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=0ZJDM5XLP25H type=del 2024-01-13T18:20:39.314 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.313+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=J4YTP58OYOAT type=del size=2702014 2024-01-13T18:20:39.315 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.315+0000 7f759fd04880 1 < canceled operation key=ZI9WAZQHVPAR tag=BA950FOVGNTM type=del size=3034588 2024-01-13T18:20:39.318 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.317+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~CITX4JFLXE9S.0 size=1048576 2024-01-13T18:20:39.320 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.319+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~CITX4JFLXE9S.1 size=1048576 2024-01-13T18:20:39.321 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.321+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~CITX4JFLXE9S.2 size=46369 2024-01-13T18:20:39.322 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.321+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=CITX4JFLXE9S tag=NF7RWL2EXEZP type=write size=3192097 2024-01-13T18:20:39.322 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.321+0000 7f759fd04880 1 < canceled part key=_multipart_AJZB1PXB1NB5.2~CSG8RS0TLN44.0 size=793407 2024-01-13T18:20:39.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.324+0000 7f759fd04880 1 < canceled multipart upload key=AJZB1PXB1NB5 upload=CSG8RS0TLN44 tag=QNG3YBL1H9A0 type=write size=1841983 2024-01-13T18:20:39.327 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.326+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~RZ45F25HYNF1.0 size=1048576 2024-01-13T18:20:39.329 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.328+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~RZ45F25HYNF1.1 size=986699 2024-01-13T18:20:39.329 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.328+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=RZ45F25HYNF1 tag=6MQBZPQVNX6B type=write size=3083851 2024-01-13T18:20:39.332 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.331+0000 7f759fd04880 1 < suggested update operation key=VZHGQM6ZNJYQ tag=JIWPPRRK1V9D type=write size=847954 2024-01-13T18:20:39.335 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.334+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~KRFKYDM3KE1R.0 size=1006993 2024-01-13T18:20:39.335 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.334+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=KRFKYDM3KE1R tag=X3WBG523GIGA type=write size=2055569 2024-01-13T18:20:39.337 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.336+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~DNKCSSB14SZR.0 size=1048576 2024-01-13T18:20:39.337 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.336+0000 7f759fd04880 1 < canceled part key=_multipart_QKNPXHB99KVP.2~DNKCSSB14SZR.1 size=228277 2024-01-13T18:20:39.340 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.339+0000 7f759fd04880 1 < canceled multipart upload key=QKNPXHB99KVP upload=DNKCSSB14SZR tag=PK1YBSWDSDBK type=write size=2325429 2024-01-13T18:20:39.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.341+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=2X0ADWDDKC8U type=del size=3358649 2024-01-13T18:20:39.345 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.344+0000 7f759fd04880 1 < suggested update operation key=1QEZO616DBC3 tag=1Z4C1E1CQYCB type=del size=436523 2024-01-13T18:20:39.346 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.345+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=S2AMNA2MJDGO type=del size=109677 2024-01-13T18:20:39.348 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.347+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=2KN937POMV0F type=del 2024-01-13T18:20:39.351 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.350+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~UV44YVINGON1.0 size=673705 2024-01-13T18:20:39.351 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.350+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=UV44YVINGON1 tag=Q55M0OZRIGTX type=write size=1722281 2024-01-13T18:20:39.353 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.352+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~7UF9Q0YEJI9M.0 size=1048576 2024-01-13T18:20:39.355 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.354+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~7UF9Q0YEJI9M.1 size=1048576 2024-01-13T18:20:39.357 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.356+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~7UF9Q0YEJI9M.2 size=70242 2024-01-13T18:20:39.360 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.359+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=7UF9Q0YEJI9M tag=9C0DHV4HJS5T type=write size=3215970 2024-01-13T18:20:39.362 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.361+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=YVV85FZDXECQ type=write size=832559 2024-01-13T18:20:39.363 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.363+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~T7DLT4CA3E9T.0 size=1048576 2024-01-13T18:20:39.365 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.364+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~T7DLT4CA3E9T.1 size=1048576 2024-01-13T18:20:39.367 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.366+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~T7DLT4CA3E9T.2 size=238694 2024-01-13T18:20:39.370 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.369+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=T7DLT4CA3E9T tag=56TYKRYM5EFW type=write size=3384422 2024-01-13T18:20:39.371 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.370+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=UH7XKEIRO2Z8 type=write size=164017 2024-01-13T18:20:39.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.372+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=12EXEBQX0L9U type=del 2024-01-13T18:20:39.374 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.373+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=GG0GQTDAO2QO type=del size=131007 2024-01-13T18:20:39.376 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.375+0000 7f759fd04880 1 < completed write operation key=QKNPXHB99KVP tag=3VKJWLRHHY0N type=write size=272286 2024-01-13T18:20:39.378 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.377+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=1JJK3AXOBB6H type=write size=397070 2024-01-13T18:20:39.379 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.378+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=N0CVR0RMYRAZ type=del 2024-01-13T18:20:39.381 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.380+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=3XJHBXYYJ77L type=del size=2568657 2024-01-13T18:20:39.382 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.381+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~4YKXRYKR4EY9.0 size=1048576 2024-01-13T18:20:39.384 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.383+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~4YKXRYKR4EY9.1 size=1048576 2024-01-13T18:20:39.385 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.384+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~4YKXRYKR4EY9.2 size=524467 2024-01-13T18:20:39.388 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.387+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=4YKXRYKR4EY9 tag=YVA4UZRO9MO0 type=write size=3670195 2024-01-13T18:20:39.391 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.390+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~1SAVRS71T32O.0 size=1048576 2024-01-13T18:20:39.392 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.392+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~1SAVRS71T32O.1 size=459105 2024-01-13T18:20:39.393 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.392+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=1SAVRS71T32O tag=SU06SWWMSWKQ type=write size=2556257 2024-01-13T18:20:39.394 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.393+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~JN6EOH4A3A7G.0 size=1048576 2024-01-13T18:20:39.396 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.395+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~JN6EOH4A3A7G.1 size=837247 2024-01-13T18:20:39.398 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.397+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=JN6EOH4A3A7G tag=A0JFJJEKQB8K type=write size=2934399 2024-01-13T18:20:39.400 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.399+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=ANCG1DY08I26 type=write size=724219 2024-01-13T18:20:39.401 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.400+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=52YV1LAUK9WE type=del 2024-01-13T18:20:39.405 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.404+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~RIMV2YMMCGXS.0 size=1048576 2024-01-13T18:20:39.406 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.405+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~RIMV2YMMCGXS.1 size=1048576 2024-01-13T18:20:39.407 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.406+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~RIMV2YMMCGXS.2 size=878017 2024-01-13T18:20:39.407 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.406+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=RIMV2YMMCGXS tag=Q1N6Z3FQ4OX6 type=write size=4023745 2024-01-13T18:20:39.409 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.408+0000 7f759fd04880 1 < canceled operation key=ZI9WAZQHVPAR tag=U5LYMSGIJOOS type=del size=3172935 2024-01-13T18:20:39.411 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.410+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=GG96YLR1XY1I type=del size=3653779 2024-01-13T18:20:39.412 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.411+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=J4YTP58OYOAT type=del 2024-01-13T18:20:39.415 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.414+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=3TWK3P16AANJ type=del size=1383374 2024-01-13T18:20:39.417 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.416+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~CITX4JFLXE9S.0 size=1048576 2024-01-13T18:20:39.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.417+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~CITX4JFLXE9S.1 size=1048576 2024-01-13T18:20:39.420 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.419+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~CITX4JFLXE9S.2 size=46369 2024-01-13T18:20:39.423 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.422+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=CITX4JFLXE9S tag=NF7RWL2EXEZP type=write size=3192097 2024-01-13T18:20:39.424 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.423+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=8S0V4W72TFUS type=del size=2476269 2024-01-13T18:20:39.427 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.426+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~RZ45F25HYNF1.0 size=1048576 2024-01-13T18:20:39.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:39 smithi084 ceph-mon[116404]: pgmap v1458: 137 pgs: 8 creating+peering, 3 unknown, 126 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 935 KiB/s rd, 325 KiB/s wr, 1.65k op/s 2024-01-13T18:20:39.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:39 smithi084 ceph-mon[119097]: pgmap v1458: 137 pgs: 8 creating+peering, 3 unknown, 126 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 935 KiB/s rd, 325 KiB/s wr, 1.65k op/s 2024-01-13T18:20:39.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.427+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~RZ45F25HYNF1.1 size=986699 2024-01-13T18:20:39.431 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.430+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=RZ45F25HYNF1 tag=6MQBZPQVNX6B type=write size=3083851 2024-01-13T18:20:39.433 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.432+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=AC61E8RCNM0M type=del size=2845429 2024-01-13T18:20:39.435 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.434+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~KRFKYDM3KE1R.0 size=1006993 2024-01-13T18:20:39.438 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.437+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=KRFKYDM3KE1R tag=X3WBG523GIGA type=write size=2055569 2024-01-13T18:20:39.439 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.439+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=24VM0BQ2QBDV type=del size=2466069 2024-01-13T18:20:39.441 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.440+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=2X0ADWDDKC8U type=del 2024-01-13T18:20:39.444 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.443+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~MV41OARAZQ73.0 size=151136 2024-01-13T18:20:39.444 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.443+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=MV41OARAZQ73 tag=JCJ8ZZSKLL2W type=write size=1199712 2024-01-13T18:20:39.446 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.445+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=S2AMNA2MJDGO type=del 2024-01-13T18:20:39.447 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.447+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=DB6DL0ZXOKO0 type=del size=3389708 2024-01-13T18:20:39.449 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.448+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~UV44YVINGON1.0 size=673705 2024-01-13T18:20:39.452 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.451+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=UV44YVINGON1 tag=Q55M0OZRIGTX type=write size=1722281 2024-01-13T18:20:39.453 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.453+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=ME9QJKHNBFJ3 type=write size=1048036 2024-01-13T18:20:39.456 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.454+0000 7f759fd04880 1 < completed write operation key=WSRJB811XCVL tag=YVV85FZDXECQ type=write size=832559 2024-01-13T18:20:39.458 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.457+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~5ZPFUXXFLKFC.0 size=1048576 2024-01-13T18:20:39.460 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.459+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~5ZPFUXXFLKFC.1 size=1048576 2024-01-13T18:20:39.461 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.460+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~5ZPFUXXFLKFC.2 size=628195 2024-01-13T18:20:39.461 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.460+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=5ZPFUXXFLKFC tag=F5OFSB03MA30 type=write size=3773923 2024-01-13T18:20:39.463 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.462+0000 7f759fd04880 1 < completed write operation key=7WRTM9ANJRT4 tag=UH7XKEIRO2Z8 type=write size=164017 2024-01-13T18:20:39.466 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.465+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~NB1UWA3JICU6.0 size=601180 2024-01-13T18:20:39.466 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.465+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=NB1UWA3JICU6 tag=8JR72NDB0PRY type=write size=1649756 2024-01-13T18:20:39.468 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.466+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=GG0GQTDAO2QO type=del 2024-01-13T18:20:39.469 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.468+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=UOMB1I3XIZU7 type=del size=1415888 2024-01-13T18:20:39.471 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.469+0000 7f759fd04880 1 < completed write operation key=ZI9WAZQHVPAR tag=1JJK3AXOBB6H type=write size=397070 2024-01-13T18:20:39.474 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.473+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~O3ONTD1V5DCL.0 size=1048576 2024-01-13T18:20:39.475 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.474+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~O3ONTD1V5DCL.1 size=1048576 2024-01-13T18:20:39.476 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.475+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~O3ONTD1V5DCL.2 size=334508 2024-01-13T18:20:39.476 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.475+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=O3ONTD1V5DCL tag=MOQM4EC7VNIZ type=write size=3480236 2024-01-13T18:20:39.478 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.477+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=3XJHBXYYJ77L type=del 2024-01-13T18:20:39.481 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.480+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~5G7NBOVG69IE.0 size=581327 2024-01-13T18:20:39.481 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.480+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=5G7NBOVG69IE tag=QX7B6EX1ZDOZ type=write size=1629903 2024-01-13T18:20:39.483 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.482+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~1SAVRS71T32O.0 size=1048576 2024-01-13T18:20:39.484 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.483+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~1SAVRS71T32O.1 size=459105 2024-01-13T18:20:39.488 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.486+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=1SAVRS71T32O tag=SU06SWWMSWKQ type=write size=2556257 2024-01-13T18:20:39.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.488+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=LDDNHLI1JL75 type=del size=1980950 2024-01-13T18:20:39.492 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.490+0000 7f759fd04880 1 < completed write operation key=0TIZPXX8CMHA tag=ANCG1DY08I26 type=write size=724219 2024-01-13T18:20:39.493 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.492+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=SMH1NARJU7YV type=del size=3613820 2024-01-13T18:20:39.495 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.494+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~RIMV2YMMCGXS.0 size=1048576 2024-01-13T18:20:39.495 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.494+0000 7f759fd04880 1 < canceled part key=_multipart_1QEZO616DBC3.2~RIMV2YMMCGXS.1 size=1048576 2024-01-13T18:20:39.496 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.495+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~RIMV2YMMCGXS.2 size=878017 2024-01-13T18:20:39.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.498+0000 7f759fd04880 1 < canceled multipart upload key=1QEZO616DBC3 upload=RIMV2YMMCGXS tag=Q1N6Z3FQ4OX6 type=write size=4023745 2024-01-13T18:20:39.501 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.500+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=MR52YBVJ7H6I type=del size=853982 2024-01-13T18:20:39.503 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.502+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=GG96YLR1XY1I type=del 2024-01-13T18:20:39.504 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.504+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=KZAPCEC11EPE type=del size=3911096 2024-01-13T18:20:39.506 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.505+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=3TWK3P16AANJ type=del 2024-01-13T18:20:39.508 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.507+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=GTR0A417II0M type=write size=537230 2024-01-13T18:20:39.510 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.509+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=8S0V4W72TFUS type=del 2024-01-13T18:20:39.512 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.511+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=A3N4586Q50RL type=write size=86166 2024-01-13T18:20:39.514 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.513+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=AC61E8RCNM0M type=del 2024-01-13T18:20:39.517 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.516+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~MT6D78S45BUO.0 size=1048576 2024-01-13T18:20:39.518 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.517+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~MT6D78S45BUO.1 size=1048576 2024-01-13T18:20:39.520 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.519+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~MT6D78S45BUO.2 size=467930 2024-01-13T18:20:39.520 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.519+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=MT6D78S45BUO tag=UCXEJ1AFPXHE type=write size=3613658 2024-01-13T18:20:39.521 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.521+0000 7f759fd04880 1 < canceled operation key=1WSQNY2NDY3K tag=24VM0BQ2QBDV type=del size=2466069 2024-01-13T18:20:39.524 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.522+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=Q9BPHQ3LM7EN type=del size=2280440 2024-01-13T18:20:39.525 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.524+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~MV41OARAZQ73.0 size=151136 2024-01-13T18:20:39.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.527+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=MV41OARAZQ73 tag=JCJ8ZZSKLL2W type=write size=1199712 2024-01-13T18:20:39.530 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.529+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=Q22OEB5WPHY1 type=write size=927142 2024-01-13T18:20:39.531 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.530+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=DB6DL0ZXOKO0 type=del 2024-01-13T18:20:39.534 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.532+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=1UWHF3VRN9FT type=del size=3976755 2024-01-13T18:20:39.537 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.536+0000 7f759fd04880 1 < suggested update operation key=JGALONWJXLQY tag=ME9QJKHNBFJ3 type=write size=1048036 2024-01-13T18:20:39.539 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.537+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=454W6E6AFMF1 type=del size=2964459 2024-01-13T18:20:39.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.539+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~5ZPFUXXFLKFC.0 size=1048576 2024-01-13T18:20:39.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.539+0000 7f759fd04880 1 < canceled part key=_multipart_1WSQNY2NDY3K.2~5ZPFUXXFLKFC.1 size=1048576 2024-01-13T18:20:39.542 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.541+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~5ZPFUXXFLKFC.2 size=628195 2024-01-13T18:20:39.545 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.544+0000 7f759fd04880 1 < canceled multipart upload key=1WSQNY2NDY3K upload=5ZPFUXXFLKFC tag=F5OFSB03MA30 type=write size=3773923 2024-01-13T18:20:39.548 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.547+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~1VVTJLYRXFID.0 size=1048576 2024-01-13T18:20:39.549 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.548+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~1VVTJLYRXFID.1 size=441662 2024-01-13T18:20:39.549 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.548+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=1VVTJLYRXFID tag=JK4DT5IH9RNW type=write size=2538814 2024-01-13T18:20:39.551 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.550+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~NB1UWA3JICU6.0 size=601180 2024-01-13T18:20:39.555 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.554+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=NB1UWA3JICU6 tag=8JR72NDB0PRY type=write size=1649756 2024-01-13T18:20:39.557 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.556+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=6KRLTY7Z8EP8 type=del size=1229340 2024-01-13T18:20:39.558 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.557+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=UOMB1I3XIZU7 type=del 2024-01-13T18:20:39.560 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.559+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=CVSVBI0VRW8D type=del size=815849 2024-01-13T18:20:39.561 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.561+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~O3ONTD1V5DCL.0 size=1048576 2024-01-13T18:20:39.563 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.562+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~O3ONTD1V5DCL.1 size=1048576 2024-01-13T18:20:39.564 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.563+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~O3ONTD1V5DCL.2 size=334508 2024-01-13T18:20:39.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.566+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=O3ONTD1V5DCL tag=MOQM4EC7VNIZ type=write size=3480236 2024-01-13T18:20:39.569 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.568+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=BJS88OUR2GF2 type=del size=105294 2024-01-13T18:20:39.569 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.568+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~5G7NBOVG69IE.0 size=581327 2024-01-13T18:20:39.572 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.571+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=5G7NBOVG69IE tag=QX7B6EX1ZDOZ type=write size=1629903 2024-01-13T18:20:39.574 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.573+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=ILSW4GP1CW6V type=del size=3039074 2024-01-13T18:20:39.576 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.575+0000 7f759fd04880 1 < canceled operation key=2OO7S2NBZ7M6 tag=LDDNHLI1JL75 type=del size=1980950 2024-01-13T18:20:39.579 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.578+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~UKFHTMKZ0ZJ0.0 size=1048576 2024-01-13T18:20:39.581 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.580+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~UKFHTMKZ0ZJ0.1 size=212883 2024-01-13T18:20:39.581 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.580+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=UKFHTMKZ0ZJ0 tag=G9C50AGCLWUV type=write size=2310035 2024-01-13T18:20:39.582 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.581+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=SMH1NARJU7YV type=del 2024-01-13T18:20:39.586 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.585+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~Y9OA91AWPZB3.0 size=181123 2024-01-13T18:20:39.586 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.585+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=Y9OA91AWPZB3 tag=QVQM5JPAN08R type=write size=1229699 2024-01-13T18:20:39.587 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.586+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=MR52YBVJ7H6I type=del 2024-01-13T18:20:39.591 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.590+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~V2XBVX5TMXIX.0 size=1048576 2024-01-13T18:20:39.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.592+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~V2XBVX5TMXIX.1 size=387574 2024-01-13T18:20:39.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.592+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=V2XBVX5TMXIX tag=DNNTG9VYZ0YI type=write size=2484726 2024-01-13T18:20:39.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.594+0000 7f759fd04880 1 < canceled operation key=ZI9WAZQHVPAR tag=KZAPCEC11EPE type=del size=3911096 2024-01-13T18:20:39.596 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.595+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=0WSPBBDCBV27 type=write size=42772 2024-01-13T18:20:39.598 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.597+0000 7f759fd04880 1 < canceled operation key=7WRTM9ANJRT4 tag=GTR0A417II0M type=write size=537230 2024-01-13T18:20:39.602 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.601+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~26U503L62TWF.0 size=1048576 2024-01-13T18:20:39.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.602+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~26U503L62TWF.1 size=1048576 2024-01-13T18:20:39.605 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.604+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~26U503L62TWF.2 size=611454 2024-01-13T18:20:39.605 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.604+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=26U503L62TWF tag=94V18JV1BK61 type=write size=3757182 2024-01-13T18:20:39.606 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.605+0000 7f759fd04880 1 < canceled operation key=1QEZO616DBC3 tag=A3N4586Q50RL type=write size=86166 2024-01-13T18:20:39.608 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.607+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=W6CLXZSZAQPV type=del size=3302346 2024-01-13T18:20:39.610 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.609+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~MT6D78S45BUO.0 size=1048576 2024-01-13T18:20:39.611 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.610+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~MT6D78S45BUO.1 size=1048576 2024-01-13T18:20:39.613 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.612+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~MT6D78S45BUO.2 size=467930 2024-01-13T18:20:39.616 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.615+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=MT6D78S45BUO tag=UCXEJ1AFPXHE type=write size=3613658 2024-01-13T18:20:39.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:39 smithi099 ceph-mon[138788]: pgmap v1458: 137 pgs: 8 creating+peering, 3 unknown, 126 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 935 KiB/s rd, 325 KiB/s wr, 1.65k op/s 2024-01-13T18:20:39.619 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.618+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~M6Z1XKK9PISV.0 size=1048576 2024-01-13T18:20:39.620 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.619+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~M6Z1XKK9PISV.1 size=747417 2024-01-13T18:20:39.620 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.619+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=M6Z1XKK9PISV tag=1XX9K7E3ROMI type=write size=2844569 2024-01-13T18:20:39.623 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.622+0000 7f759fd04880 1 < suggested remove operation key=7WRTM9ANJRT4 tag=Q9BPHQ3LM7EN type=del 2024-01-13T18:20:39.625 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.624+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=RV576WYATOZ5 type=del size=1095421 2024-01-13T18:20:39.627 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.626+0000 7f759fd04880 1 < completed write operation key=RY0W5S41XK3F tag=Q22OEB5WPHY1 type=write size=927142 2024-01-13T18:20:39.630 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.629+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~ZKPE2W37BKHL.0 size=1048576 2024-01-13T18:20:39.631 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.630+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~ZKPE2W37BKHL.1 size=1008613 2024-01-13T18:20:39.632 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.630+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=ZKPE2W37BKHL tag=ZNU93BPE1NUN type=write size=3105765 2024-01-13T18:20:39.634 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.633+0000 7f759fd04880 -1 < failed to complete operation key=JGALONWJXLQY tag=1UWHF3VRN9FT type=del size=3976755: (22) Invalid argument 2024-01-13T18:20:39.635 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.634+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=1B2B66W8F9T0 type=del size=3427844 2024-01-13T18:20:39.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.636+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=454W6E6AFMF1 type=del 2024-01-13T18:20:39.641 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.640+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~TE6V9KCTHMXW.0 size=1048576 2024-01-13T18:20:39.642 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.641+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~TE6V9KCTHMXW.1 size=1048576 2024-01-13T18:20:39.644 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.643+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~TE6V9KCTHMXW.2 size=656946 2024-01-13T18:20:39.644 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.643+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=TE6V9KCTHMXW tag=26WI9Z1OE2I2 type=write size=3802674 2024-01-13T18:20:39.645 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.644+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~1VVTJLYRXFID.0 size=1048576 2024-01-13T18:20:39.647 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.646+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~1VVTJLYRXFID.1 size=441662 2024-01-13T18:20:39.650 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.649+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=1VVTJLYRXFID tag=JK4DT5IH9RNW type=write size=2538814 2024-01-13T18:20:39.653 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.652+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~WZ44BGZSKSLT.0 size=1048576 2024-01-13T18:20:39.654 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.653+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~WZ44BGZSKSLT.1 size=949183 2024-01-13T18:20:39.654 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.653+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=WZ44BGZSKSLT tag=X8RS3GDU5M51 type=write size=3046335 2024-01-13T18:20:39.658 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.657+0000 7f759fd04880 1 < suggested update operation key=JGALONWJXLQY tag=6KRLTY7Z8EP8 type=del size=1229340 2024-01-13T18:20:39.662 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.661+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~EJL7JG5IYWF6.0 size=1048576 2024-01-13T18:20:39.663 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.662+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~EJL7JG5IYWF6.1 size=1048576 2024-01-13T18:20:39.665 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.664+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~EJL7JG5IYWF6.2 size=162551 2024-01-13T18:20:39.665 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.664+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=EJL7JG5IYWF6 tag=SYSVOJHA2M6M type=write size=3308279 2024-01-13T18:20:39.667 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.666+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=CVSVBI0VRW8D type=del 2024-01-13T18:20:39.668 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.667+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=NR2D5W6OP9EH type=del size=1340617 2024-01-13T18:20:39.670 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.669+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=BJS88OUR2GF2 type=del 2024-01-13T18:20:39.672 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.671+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=EV23S3HFMRZ5 type=del size=904051 2024-01-13T18:20:39.673 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.672+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=ILSW4GP1CW6V type=del 2024-01-13T18:20:39.675 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.674+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=AJHG03J8U8F5 type=del size=2308230 2024-01-13T18:20:39.677 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.676+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~UKFHTMKZ0ZJ0.0 size=1048576 2024-01-13T18:20:39.678 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.677+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~UKFHTMKZ0ZJ0.1 size=212883 2024-01-13T18:20:39.681 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.681+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=UKFHTMKZ0ZJ0 tag=G9C50AGCLWUV type=write size=2310035 2024-01-13T18:20:39.685 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.684+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~DK95J3FJ887R.0 size=894011 2024-01-13T18:20:39.685 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.684+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=DK95J3FJ887R tag=WYFXDUODEOLD type=write size=1942587 2024-01-13T18:20:39.686 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.685+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~Y9OA91AWPZB3.0 size=181123 2024-01-13T18:20:39.690 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.689+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=Y9OA91AWPZB3 tag=QVQM5JPAN08R type=write size=1229699 2024-01-13T18:20:39.691 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.690+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=8M0IZ904TOA7 type=del size=312338 2024-01-13T18:20:39.694 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.693+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~V2XBVX5TMXIX.0 size=1048576 2024-01-13T18:20:39.694 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.693+0000 7f759fd04880 1 < canceled part key=_multipart_8EWIOXN5H9KU.2~V2XBVX5TMXIX.1 size=387574 2024-01-13T18:20:39.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.696+0000 7f759fd04880 1 < canceled multipart upload key=8EWIOXN5H9KU upload=V2XBVX5TMXIX tag=DNNTG9VYZ0YI type=write size=2484726 2024-01-13T18:20:39.700 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.699+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~YDMHKFX5YNKM.0 size=1048576 2024-01-13T18:20:39.702 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.701+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~YDMHKFX5YNKM.1 size=319794 2024-01-13T18:20:39.702 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.701+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=YDMHKFX5YNKM tag=QI1B4YL74Q8C type=write size=2416946 2024-01-13T18:20:39.703 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.702+0000 7f759fd04880 1 < canceled operation key=H7C1UAGAUR7D tag=0WSPBBDCBV27 type=write size=42772 2024-01-13T18:20:39.705 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.704+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=5X1NQG3KA6BO type=del size=1352061 2024-01-13T18:20:39.707 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.706+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~26U503L62TWF.0 size=1048576 2024-01-13T18:20:39.708 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.707+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~26U503L62TWF.1 size=1048576 2024-01-13T18:20:39.710 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.709+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~26U503L62TWF.2 size=611454 2024-01-13T18:20:39.713 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.712+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=26U503L62TWF tag=94V18JV1BK61 type=write size=3757182 2024-01-13T18:20:39.714 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.713+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=BUG7BA4R9C16 type=del size=3551482 2024-01-13T18:20:39.716 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.715+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=W6CLXZSZAQPV type=del 2024-01-13T18:20:39.718 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.717+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=OZ822H9K9MPP type=del size=11263 2024-01-13T18:20:39.718 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.717+0000 7f759fd04880 1 < canceled part key=_multipart_ZI9WAZQHVPAR.2~M6Z1XKK9PISV.0 size=1048576 2024-01-13T18:20:39.718 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.717+0000 7f759fd04880 1 < canceled part key=_multipart_ZI9WAZQHVPAR.2~M6Z1XKK9PISV.1 size=747417 2024-01-13T18:20:39.721 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.720+0000 7f759fd04880 1 < canceled multipart upload key=ZI9WAZQHVPAR upload=M6Z1XKK9PISV tag=1XX9K7E3ROMI type=write size=2844569 2024-01-13T18:20:39.722 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.721+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=1YDU1M6O8DFC type=write size=881895 2024-01-13T18:20:39.724 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.723+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=RV576WYATOZ5 type=del 2024-01-13T18:20:39.727 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.726+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~7T9D5KL0VWU5.0 size=1048576 2024-01-13T18:20:39.728 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.727+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~7T9D5KL0VWU5.1 size=261312 2024-01-13T18:20:39.729 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.727+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=7T9D5KL0VWU5 tag=X70K7Y6I3EXG type=write size=2358464 2024-01-13T18:20:39.730 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.729+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~ZKPE2W37BKHL.0 size=1048576 2024-01-13T18:20:39.731 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.731+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~ZKPE2W37BKHL.1 size=1008613 2024-01-13T18:20:39.735 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.734+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=ZKPE2W37BKHL tag=ZNU93BPE1NUN type=write size=3105765 2024-01-13T18:20:39.737 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.736+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=U9V230FQJL3T type=write size=417556 2024-01-13T18:20:39.739 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.738+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=1B2B66W8F9T0 type=del 2024-01-13T18:20:39.740 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.739+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=M938V2QN8OVS type=del size=2235732 2024-01-13T18:20:39.742 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.741+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~TE6V9KCTHMXW.0 size=1048576 2024-01-13T18:20:39.743 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.742+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~TE6V9KCTHMXW.1 size=1048576 2024-01-13T18:20:39.745 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.744+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~TE6V9KCTHMXW.2 size=656946 2024-01-13T18:20:39.747 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.746+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=TE6V9KCTHMXW tag=26WI9Z1OE2I2 type=write size=3802674 2024-01-13T18:20:39.750 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.750+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~17W3AWGCSNZK.0 size=1048576 2024-01-13T18:20:39.752 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.751+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~17W3AWGCSNZK.1 size=1014931 2024-01-13T18:20:39.752 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.751+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=17W3AWGCSNZK tag=M6TM9JMF6876 type=write size=3112083 2024-01-13T18:20:39.752 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.751+0000 7f759fd04880 1 < canceled part key=_multipart_1YNH6QHP354U.2~WZ44BGZSKSLT.0 size=1048576 2024-01-13T18:20:39.754 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.753+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~WZ44BGZSKSLT.1 size=949183 2024-01-13T18:20:39.757 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.756+0000 7f759fd04880 1 < canceled multipart upload key=1YNH6QHP354U upload=WZ44BGZSKSLT tag=X8RS3GDU5M51 type=write size=3046335 2024-01-13T18:20:39.758 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.757+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=7RS8P7YIGTNM type=del size=3171025 2024-01-13T18:20:39.760 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.759+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~EJL7JG5IYWF6.0 size=1048576 2024-01-13T18:20:39.761 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.760+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~EJL7JG5IYWF6.1 size=1048576 2024-01-13T18:20:39.763 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.762+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~EJL7JG5IYWF6.2 size=162551 2024-01-13T18:20:39.766 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.765+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=EJL7JG5IYWF6 tag=SYSVOJHA2M6M type=write size=3308279 2024-01-13T18:20:39.769 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.768+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~Y3GBI2YDW307.0 size=1048576 2024-01-13T18:20:39.770 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.769+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~Y3GBI2YDW307.1 size=1048576 2024-01-13T18:20:39.771 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.770+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~Y3GBI2YDW307.2 size=373577 2024-01-13T18:20:39.771 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.770+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=Y3GBI2YDW307 tag=M8VB13RX5NYC type=write size=3519305 2024-01-13T18:20:39.773 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.772+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=NR2D5W6OP9EH type=del 2024-01-13T18:20:39.774 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.774+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=IVG9Z9FCP10E type=del size=1857045 2024-01-13T18:20:39.776 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.775+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=EV23S3HFMRZ5 type=del 2024-01-13T18:20:39.778 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.777+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=ISC4XVQS6R8O type=del size=2666914 2024-01-13T18:20:39.779 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.778+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=AJHG03J8U8F5 type=del 2024-01-13T18:20:39.783 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.782+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~SOQ13W7ZKYFU.0 size=821140 2024-01-13T18:20:39.783 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.782+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=SOQ13W7ZKYFU tag=ZOSQD9FYD5H3 type=write size=1869716 2024-01-13T18:20:39.784 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.783+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~DK95J3FJ887R.0 size=894011 2024-01-13T18:20:39.787 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.786+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=DK95J3FJ887R tag=WYFXDUODEOLD type=write size=1942587 2024-01-13T18:20:39.789 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.788+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=IUKXZWA796WC type=del size=3560285 2024-01-13T18:20:39.790 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.790+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=8M0IZ904TOA7 type=del 2024-01-13T18:20:39.793 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.792+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~HZDEC1XE9RYH.0 size=1048576 2024-01-13T18:20:39.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.794+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~HZDEC1XE9RYH.1 size=321472 2024-01-13T18:20:39.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.794+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=HZDEC1XE9RYH tag=KPXZ68RIN1A6 type=write size=2418624 2024-01-13T18:20:39.797 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.796+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~YDMHKFX5YNKM.0 size=1048576 2024-01-13T18:20:39.798 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.797+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~YDMHKFX5YNKM.1 size=319794 2024-01-13T18:20:39.801 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.800+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=YDMHKFX5YNKM tag=QI1B4YL74Q8C type=write size=2416946 2024-01-13T18:20:39.804 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.803+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~SIPFED09SSLO.0 size=97966 2024-01-13T18:20:39.804 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.803+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=SIPFED09SSLO tag=M84XTNA91E1J type=write size=1146542 2024-01-13T18:20:39.805 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.805+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=5X1NQG3KA6BO type=del 2024-01-13T18:20:39.807 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.806+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=6O6LWSXYVTCP type=del size=2150341 2024-01-13T18:20:39.809 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.808+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=BUG7BA4R9C16 type=del 2024-01-13T18:20:39.811 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.810+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=XXSVC4G2B876 type=write size=588428 2024-01-13T18:20:39.814 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.813+0000 7f759fd04880 1 < suggested remove operation key=1O3XX67RKHNW tag=OZ822H9K9MPP type=del 2024-01-13T18:20:39.815 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.814+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=4A8AOWKFHQUT type=del size=1819751 2024-01-13T18:20:39.817 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.816+0000 7f759fd04880 1 < completed write operation key=OMA1B74S8FXS tag=1YDU1M6O8DFC type=write size=881895 2024-01-13T18:20:39.820 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.819+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~SZ4QE89R70G4.0 size=765844 2024-01-13T18:20:39.820 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.819+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=SZ4QE89R70G4 tag=BT8GD7D340X0 type=write size=1814420 2024-01-13T18:20:39.822 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.821+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~7T9D5KL0VWU5.0 size=1048576 2024-01-13T18:20:39.824 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.823+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~7T9D5KL0VWU5.1 size=261312 2024-01-13T18:20:39.827 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.826+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=7T9D5KL0VWU5 tag=X70K7Y6I3EXG type=write size=2358464 2024-01-13T18:20:39.831 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.830+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~774N84DX3YYZ.0 size=1048576 2024-01-13T18:20:39.832 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.831+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~774N84DX3YYZ.1 size=744034 2024-01-13T18:20:39.832 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.831+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=774N84DX3YYZ tag=TP9Q227B3827 type=write size=2841186 2024-01-13T18:20:39.834 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.833+0000 7f759fd04880 1 < completed write operation key=0TIZPXX8CMHA tag=U9V230FQJL3T type=write size=417556 2024-01-13T18:20:39.835 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.834+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=V4JCZE1PX5M1 type=del size=329713 2024-01-13T18:20:39.837 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.836+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=M938V2QN8OVS type=del 2024-01-13T18:20:39.840 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.838+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=5A3SW9M6O4MR type=del size=4160707 2024-01-13T18:20:39.841 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.840+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~17W3AWGCSNZK.0 size=1048576 2024-01-13T18:20:39.841 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.840+0000 7f759fd04880 1 < canceled part key=_multipart_WSRJB811XCVL.2~17W3AWGCSNZK.1 size=1014931 2024-01-13T18:20:39.844 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.843+0000 7f759fd04880 1 < canceled multipart upload key=WSRJB811XCVL upload=17W3AWGCSNZK tag=M6TM9JMF6876 type=write size=3112083 2024-01-13T18:20:39.846 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.845+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=04WOVZGXABJ9 type=del size=805539 2024-01-13T18:20:39.847 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.846+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=7RS8P7YIGTNM type=del 2024-01-13T18:20:39.849 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.848+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=50OAY6EEMFVD type=del size=1927185 2024-01-13T18:20:39.851 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.850+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~Y3GBI2YDW307.0 size=1048576 2024-01-13T18:20:39.853 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.852+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~Y3GBI2YDW307.1 size=1048576 2024-01-13T18:20:39.853 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.852+0000 7f759fd04880 1 < canceled part key=_multipart_BPUBFFWB9D3C.2~Y3GBI2YDW307.2 size=373577 2024-01-13T18:20:39.856 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.855+0000 7f759fd04880 1 < canceled multipart upload key=BPUBFFWB9D3C upload=Y3GBI2YDW307 tag=M8VB13RX5NYC type=write size=3519305 2024-01-13T18:20:39.859 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.858+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~QT2F5Z85LO8R.0 size=1048576 2024-01-13T18:20:39.861 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.860+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~QT2F5Z85LO8R.1 size=1048576 2024-01-13T18:20:39.862 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.861+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~QT2F5Z85LO8R.2 size=1042989 2024-01-13T18:20:39.862 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.861+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=QT2F5Z85LO8R tag=1V2SZQVNHULX type=write size=4188717 2024-01-13T18:20:39.864 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.863+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=IVG9Z9FCP10E type=del 2024-01-13T18:20:39.867 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.866+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~2ZDTXCJF89NW.0 size=1048576 2024-01-13T18:20:39.869 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.868+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~2ZDTXCJF89NW.1 size=717338 2024-01-13T18:20:39.869 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.868+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=2ZDTXCJF89NW tag=QFXVR9UYL6LM type=write size=2814490 2024-01-13T18:20:39.870 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.870+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=ISC4XVQS6R8O type=del 2024-01-13T18:20:39.872 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.871+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=ENECFIC2AKMK type=del size=545843 2024-01-13T18:20:39.874 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.873+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~SOQ13W7ZKYFU.0 size=821140 2024-01-13T18:20:39.878 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.877+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=SOQ13W7ZKYFU tag=ZOSQD9FYD5H3 type=write size=1869716 2024-01-13T18:20:39.881 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.880+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~C1ICBIKQJF8B.0 size=1048576 2024-01-13T18:20:39.883 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.882+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~C1ICBIKQJF8B.1 size=1048576 2024-01-13T18:20:39.884 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.883+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~C1ICBIKQJF8B.2 size=214534 2024-01-13T18:20:39.884 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.883+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=C1ICBIKQJF8B tag=9CS4E1H3O2S7 type=write size=3360262 2024-01-13T18:20:39.886 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.885+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=IUKXZWA796WC type=del 2024-01-13T18:20:39.890 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.889+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~KQP8Q9C3LWCI.0 size=1048576 2024-01-13T18:20:39.891 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.890+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~KQP8Q9C3LWCI.1 size=1048576 2024-01-13T18:20:39.893 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.891+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~KQP8Q9C3LWCI.2 size=231827 2024-01-13T18:20:39.893 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.891+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=KQP8Q9C3LWCI tag=GKJ8ND0NHXDP type=write size=3377555 2024-01-13T18:20:39.894 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.893+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~HZDEC1XE9RYH.0 size=1048576 2024-01-13T18:20:39.896 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.895+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~HZDEC1XE9RYH.1 size=321472 2024-01-13T18:20:39.899 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.898+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=HZDEC1XE9RYH tag=KPXZ68RIN1A6 type=write size=2418624 2024-01-13T18:20:39.901 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.900+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=MXUZIGP57GTU type=del size=785726 2024-01-13T18:20:39.903 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.902+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~SIPFED09SSLO.0 size=97966 2024-01-13T18:20:39.906 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.905+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=SIPFED09SSLO tag=M84XTNA91E1J type=write size=1146542 2024-01-13T18:20:39.907 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.906+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=NYDXL79FKGPR type=del size=2128057 2024-01-13T18:20:39.909 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.908+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=6O6LWSXYVTCP type=del 2024-01-13T18:20:39.912 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.911+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~LKZ1OK0RVJYN.0 size=1048576 2024-01-13T18:20:39.914 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.913+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~LKZ1OK0RVJYN.1 size=1048576 2024-01-13T18:20:39.916 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.915+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~LKZ1OK0RVJYN.2 size=980420 2024-01-13T18:20:39.916 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.915+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=LKZ1OK0RVJYN tag=8DV6ZKP15VL6 type=write size=4126148 2024-01-13T18:20:39.918 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.917+0000 7f759fd04880 1 < completed write operation key=AJZB1PXB1NB5 tag=XXSVC4G2B876 type=write size=588428 2024-01-13T18:20:39.919 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.918+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=2MJDQWX9C208 type=write size=388724 2024-01-13T18:20:39.921 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.920+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=4A8AOWKFHQUT type=del 2024-01-13T18:20:39.924 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.924+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~62YCU03QJJC4.0 size=1048576 2024-01-13T18:20:39.926 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.925+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~62YCU03QJJC4.1 size=1048576 2024-01-13T18:20:39.927 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.926+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~62YCU03QJJC4.2 size=54423 2024-01-13T18:20:39.927 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.926+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=62YCU03QJJC4 tag=M1QEZEGTHZW6 type=write size=3200151 2024-01-13T18:20:39.929 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.928+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~SZ4QE89R70G4.0 size=765844 2024-01-13T18:20:39.933 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.931+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=SZ4QE89R70G4 tag=BT8GD7D340X0 type=write size=1814420 2024-01-13T18:20:39.934 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.933+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=A18ICIXH3XVV type=del size=2710591 2024-01-13T18:20:39.936 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.935+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~774N84DX3YYZ.0 size=1048576 2024-01-13T18:20:39.938 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.937+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~774N84DX3YYZ.1 size=744034 2024-01-13T18:20:39.941 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.940+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=774N84DX3YYZ tag=TP9Q227B3827 type=write size=2841186 2024-01-13T18:20:39.943 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.942+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=9O1CIV3RR2GS type=del size=2259491 2024-01-13T18:20:39.945 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.944+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=V4JCZE1PX5M1 type=del 2024-01-13T18:20:39.948 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.947+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~AD4L3B1V21HA.0 size=1048576 2024-01-13T18:20:39.949 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.948+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~AD4L3B1V21HA.1 size=1048576 2024-01-13T18:20:39.951 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.950+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~AD4L3B1V21HA.2 size=367372 2024-01-13T18:20:39.951 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.950+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=AD4L3B1V21HA tag=3NA0FY7J5XVD type=write size=3513100 2024-01-13T18:20:39.952 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.952+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=5A3SW9M6O4MR type=del 2024-01-13T18:20:39.954 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.953+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=XO2A8815U6XO type=del size=2824150 2024-01-13T18:20:39.957 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.955+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=04WOVZGXABJ9 type=del 2024-01-13T18:20:39.958 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.957+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=XAJH1B2XFVC7 type=del size=105621 2024-01-13T18:20:39.959 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.958+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=50OAY6EEMFVD type=del 2024-01-13T18:20:39.961 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.960+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=P8KLZPSWJ63M type=del size=866926 2024-01-13T18:20:39.961 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.960+0000 7f759fd04880 1 < canceled part key=_multipart_QKNPXHB99KVP.2~QT2F5Z85LO8R.0 size=1048576 2024-01-13T18:20:39.963 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.962+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~QT2F5Z85LO8R.1 size=1048576 2024-01-13T18:20:39.964 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.963+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~QT2F5Z85LO8R.2 size=1042989 2024-01-13T18:20:39.967 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.967+0000 7f759fd04880 1 < canceled multipart upload key=QKNPXHB99KVP upload=QT2F5Z85LO8R tag=1V2SZQVNHULX type=write size=4188717 2024-01-13T18:20:39.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.970+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~DOWWXRQL4E84.0 size=1048576 2024-01-13T18:20:39.972 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.971+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~DOWWXRQL4E84.1 size=149967 2024-01-13T18:20:39.972 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.971+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=DOWWXRQL4E84 tag=14ZTRL6HU50L type=write size=2247119 2024-01-13T18:20:39.974 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.973+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~2ZDTXCJF89NW.0 size=1048576 2024-01-13T18:20:39.976 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.975+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~2ZDTXCJF89NW.1 size=717338 2024-01-13T18:20:39.979 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.978+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=2ZDTXCJF89NW tag=QFXVR9UYL6LM type=write size=2814490 2024-01-13T18:20:39.980 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.979+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=R9QNSNJ68HHV type=del size=1938407 2024-01-13T18:20:39.984 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.983+0000 7f759fd04880 1 < suggested remove operation key=DOXP3EJ03EBY tag=ENECFIC2AKMK type=del 2024-01-13T18:20:39.986 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.985+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=F3MYI3C2DSN5 type=write size=890628 2024-01-13T18:20:39.988 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.987+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~C1ICBIKQJF8B.0 size=1048576 2024-01-13T18:20:39.989 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.988+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~C1ICBIKQJF8B.1 size=1048576 2024-01-13T18:20:39.991 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.990+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~C1ICBIKQJF8B.2 size=214534 2024-01-13T18:20:39.993 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.992+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=C1ICBIKQJF8B tag=9CS4E1H3O2S7 type=write size=3360262 2024-01-13T18:20:39.995 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.994+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=B6EZU6KI0110 type=del size=3687933 2024-01-13T18:20:39.995 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.994+0000 7f759fd04880 1 < canceled part key=_multipart_7WRTM9ANJRT4.2~KQP8Q9C3LWCI.0 size=1048576 2024-01-13T18:20:39.997 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.996+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~KQP8Q9C3LWCI.1 size=1048576 2024-01-13T18:20:39.999 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:39.998+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~KQP8Q9C3LWCI.2 size=231827 2024-01-13T18:20:40.002 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.001+0000 7f759fd04880 1 < canceled multipart upload key=7WRTM9ANJRT4 upload=KQP8Q9C3LWCI tag=GKJ8ND0NHXDP type=write size=3377555 2024-01-13T18:20:40.004 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.003+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=79G0U6BC5EF3 type=del size=2688610 2024-01-13T18:20:40.006 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.005+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=MXUZIGP57GTU type=del 2024-01-13T18:20:40.009 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.008+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~UF4OYH6CJSU8.0 size=582738 2024-01-13T18:20:40.009 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.008+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=UF4OYH6CJSU8 tag=S7A3Q3PW3XKD type=write size=1631314 2024-01-13T18:20:40.011 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.010+0000 7f759fd04880 1 < canceled operation key=BPUBFFWB9D3C tag=NYDXL79FKGPR type=del size=2128057 2024-01-13T18:20:40.013 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.012+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=FCDQHOYCSL7O type=del size=3153169 2024-01-13T18:20:40.015 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.014+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~LKZ1OK0RVJYN.0 size=1048576 2024-01-13T18:20:40.017 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.016+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~LKZ1OK0RVJYN.1 size=1048576 2024-01-13T18:20:40.017 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.016+0000 7f759fd04880 1 < canceled part key=_multipart_H4VHC37BOZJ3.2~LKZ1OK0RVJYN.2 size=980420 2024-01-13T18:20:40.019 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.018+0000 7f759fd04880 1 < canceled multipart upload key=H4VHC37BOZJ3 upload=LKZ1OK0RVJYN tag=8DV6ZKP15VL6 type=write size=4126148 2024-01-13T18:20:40.023 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.022+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~89H3JDS0U49G.0 size=1048576 2024-01-13T18:20:40.025 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.024+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~89H3JDS0U49G.1 size=1048576 2024-01-13T18:20:40.027 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.026+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~89H3JDS0U49G.2 size=173064 2024-01-13T18:20:40.027 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.026+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=89H3JDS0U49G tag=A00HECQG2OH6 type=write size=3318792 2024-01-13T18:20:40.029 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.028+0000 7f759fd04880 -1 < failed to complete operation key=DOXP3EJ03EBY tag=2MJDQWX9C208 type=write size=388724: (22) Invalid argument 2024-01-13T18:20:40.032 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.031+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~71NXRDSFM2E7.0 size=696025 2024-01-13T18:20:40.032 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.031+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=71NXRDSFM2E7 tag=XCV3HZ5G97H7 type=write size=1744601 2024-01-13T18:20:40.034 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.033+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~62YCU03QJJC4.0 size=1048576 2024-01-13T18:20:40.035 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.035+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~62YCU03QJJC4.1 size=1048576 2024-01-13T18:20:40.037 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.036+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~62YCU03QJJC4.2 size=54423 2024-01-13T18:20:40.040 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.039+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=62YCU03QJJC4 tag=M1QEZEGTHZW6 type=write size=3200151 2024-01-13T18:20:40.043 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.043+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~7ZSGZWINR9Q4.0 size=713645 2024-01-13T18:20:40.044 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.043+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=7ZSGZWINR9Q4 tag=1W7HTDWKR4JN type=write size=1762221 2024-01-13T18:20:40.045 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.044+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=A18ICIXH3XVV type=del 2024-01-13T18:20:40.048 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.047+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~6BJU7X8EEBMD.0 size=261110 2024-01-13T18:20:40.049 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.047+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=6BJU7X8EEBMD tag=7NFITGEIVQS0 type=write size=1309686 2024-01-13T18:20:40.050 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.049+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=9O1CIV3RR2GS type=del 2024-01-13T18:20:40.053 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.052+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~M33MTLPK49MR.0 size=1048576 2024-01-13T18:20:40.055 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.054+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~M33MTLPK49MR.1 size=924464 2024-01-13T18:20:40.055 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.054+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=M33MTLPK49MR tag=42A7YZJDB8LS type=write size=3021616 2024-01-13T18:20:40.056 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.056+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~AD4L3B1V21HA.0 size=1048576 2024-01-13T18:20:40.058 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.057+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~AD4L3B1V21HA.1 size=1048576 2024-01-13T18:20:40.060 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.059+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~AD4L3B1V21HA.2 size=367372 2024-01-13T18:20:40.063 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.062+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=AD4L3B1V21HA tag=3NA0FY7J5XVD type=write size=3513100 2024-01-13T18:20:40.065 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.064+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=B840TTW96OXG type=write size=604984 2024-01-13T18:20:40.067 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.066+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=XO2A8815U6XO type=del 2024-01-13T18:20:40.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.068+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=1Q46IX4SL7IY type=del size=2153679 2024-01-13T18:20:40.073 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.072+0000 7f759fd04880 1 < suggested update operation key=1O3XX67RKHNW tag=XAJH1B2XFVC7 type=del size=105621 2024-01-13T18:20:40.076 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.075+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~9U6DNI0LN3JS.0 size=379053 2024-01-13T18:20:40.076 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.075+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=9U6DNI0LN3JS tag=BV80OY31J4H0 type=write size=1427629 2024-01-13T18:20:40.078 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.077+0000 7f759fd04880 -1 < failed to complete operation key=1O3XX67RKHNW tag=P8KLZPSWJ63M type=del size=866926: (22) Invalid argument 2024-01-13T18:20:40.080 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.079+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=F5D0FU1G4DQL type=del size=2943870 2024-01-13T18:20:40.082 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.081+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~DOWWXRQL4E84.0 size=1048576 2024-01-13T18:20:40.083 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.082+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~DOWWXRQL4E84.1 size=149967 2024-01-13T18:20:40.086 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.085+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=DOWWXRQL4E84 tag=14ZTRL6HU50L type=write size=2247119 2024-01-13T18:20:40.088 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.087+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=H1GZJG97QVW4 type=write size=497695 2024-01-13T18:20:40.090 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.089+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=R9QNSNJ68HHV type=del 2024-01-13T18:20:40.092 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.091+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=IMX3M6K5VQBY type=del size=3414760 2024-01-13T18:20:40.094 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.093+0000 7f759fd04880 1 < completed write operation key=ZI9WAZQHVPAR tag=F3MYI3C2DSN5 type=write size=890628 2024-01-13T18:20:40.096 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.095+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=GAHNJP9MZSB1 type=del size=3238504 2024-01-13T18:20:40.097 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.097+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=B6EZU6KI0110 type=del 2024-01-13T18:20:40.100 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.098+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=U75S9S793Y56 type=write size=692256 2024-01-13T18:20:40.101 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.100+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=79G0U6BC5EF3 type=del 2024-01-13T18:20:40.105 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.104+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~IN2P2GK8BOJF.0 size=1048576 2024-01-13T18:20:40.106 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.105+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~IN2P2GK8BOJF.1 size=236236 2024-01-13T18:20:40.106 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.105+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=IN2P2GK8BOJF tag=9EYPSYGVDG5K type=write size=2333388 2024-01-13T18:20:40.108 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.107+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~UF4OYH6CJSU8.0 size=582738 2024-01-13T18:20:40.111 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.110+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=UF4OYH6CJSU8 tag=S7A3Q3PW3XKD type=write size=1631314 2024-01-13T18:20:40.115 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.114+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~KKN51GJ6R0P2.0 size=1048576 2024-01-13T18:20:40.116 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.115+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~KKN51GJ6R0P2.1 size=504663 2024-01-13T18:20:40.116 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.115+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=KKN51GJ6R0P2 tag=FKLAGXNQOYMM type=write size=2601815 2024-01-13T18:20:40.118 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.117+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=FCDQHOYCSL7O type=del 2024-01-13T18:20:40.120 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.119+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=PB8JYMPLVUAA type=del size=3411331 2024-01-13T18:20:40.122 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.121+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~89H3JDS0U49G.0 size=1048576 2024-01-13T18:20:40.123 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.122+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~89H3JDS0U49G.1 size=1048576 2024-01-13T18:20:40.124 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.123+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~89H3JDS0U49G.2 size=173064 2024-01-13T18:20:40.127 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.126+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=89H3JDS0U49G tag=A00HECQG2OH6 type=write size=3318792 2024-01-13T18:20:40.131 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.130+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~DXUAKZ324GUR.0 size=1048576 2024-01-13T18:20:40.132 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.131+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~DXUAKZ324GUR.1 size=1048576 2024-01-13T18:20:40.133 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.132+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~DXUAKZ324GUR.2 size=884989 2024-01-13T18:20:40.133 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.132+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=DXUAKZ324GUR tag=KYS45U9ZYA2C type=write size=4030717 2024-01-13T18:20:40.135 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.134+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~71NXRDSFM2E7.0 size=696025 2024-01-13T18:20:40.138 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.137+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=71NXRDSFM2E7 tag=XCV3HZ5G97H7 type=write size=1744601 2024-01-13T18:20:40.140 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.139+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=74TJ2OYCDPOD type=del size=195992 2024-01-13T18:20:40.142 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.141+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~7ZSGZWINR9Q4.0 size=713645 2024-01-13T18:20:40.145 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.144+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=7ZSGZWINR9Q4 tag=1W7HTDWKR4JN type=write size=1762221 2024-01-13T18:20:40.147 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.146+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=MTKYPSAI0CSU type=del size=992988 2024-01-13T18:20:40.149 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.148+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~6BJU7X8EEBMD.0 size=261110 2024-01-13T18:20:40.152 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.151+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=6BJU7X8EEBMD tag=7NFITGEIVQS0 type=write size=1309686 2024-01-13T18:20:40.154 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.153+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=5DB2SFGLF03Y type=del size=1283136 2024-01-13T18:20:40.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.155+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~M33MTLPK49MR.0 size=1048576 2024-01-13T18:20:40.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.155+0000 7f759fd04880 1 < canceled part key=_multipart_QKNPXHB99KVP.2~M33MTLPK49MR.1 size=924464 2024-01-13T18:20:40.159 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.158+0000 7f759fd04880 1 < canceled multipart upload key=QKNPXHB99KVP upload=M33MTLPK49MR tag=42A7YZJDB8LS type=write size=3021616 2024-01-13T18:20:40.161 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.160+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=NVYF9BDE4GUE type=del size=4090623 2024-01-13T18:20:40.162 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.161+0000 7f759fd04880 1 < completed write operation key=H4VHC37BOZJ3 tag=B840TTW96OXG type=write size=604984 2024-01-13T18:20:40.166 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.165+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~K6PZOVBIL3TT.0 size=1048576 2024-01-13T18:20:40.167 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.166+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~K6PZOVBIL3TT.1 size=1048576 2024-01-13T18:20:40.168 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.168+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~K6PZOVBIL3TT.2 size=955284 2024-01-13T18:20:40.169 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.168+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=K6PZOVBIL3TT tag=IUR19X966OJR type=write size=4101012 2024-01-13T18:20:40.170 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.169+0000 7f759fd04880 1 < canceled operation key=2OO7S2NBZ7M6 tag=1Q46IX4SL7IY type=del size=2153679 2024-01-13T18:20:40.172 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.171+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=ASG469LB3UZO type=del size=727407 2024-01-13T18:20:40.173 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.171+0000 7f759fd04880 1 < canceled part key=_multipart_7LXXSKLOM1JZ.2~9U6DNI0LN3JS.0 size=379053 2024-01-13T18:20:40.175 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.174+0000 7f759fd04880 1 < canceled multipart upload key=7LXXSKLOM1JZ upload=9U6DNI0LN3JS tag=BV80OY31J4H0 type=write size=1427629 2024-01-13T18:20:40.179 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.178+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~W0USZOTMQ554.0 size=1048576 2024-01-13T18:20:40.181 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.180+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~W0USZOTMQ554.1 size=1048576 2024-01-13T18:20:40.182 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.181+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~W0USZOTMQ554.2 size=202026 2024-01-13T18:20:40.182 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.181+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=W0USZOTMQ554 tag=GRUHDKKF0A6Q type=write size=3347754 2024-01-13T18:20:40.184 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.183+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=F5D0FU1G4DQL type=del 2024-01-13T18:20:40.185 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.185+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=1BLZ3DM8LBE6 type=del size=654106 2024-01-13T18:20:40.187 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.187+0000 7f759fd04880 1 < completed write operation key=1QEZO616DBC3 tag=H1GZJG97QVW4 type=write size=497695 2024-01-13T18:20:40.189 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.188+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=IN5QMXTHSA0A type=del size=131858 2024-01-13T18:20:40.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.190+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=IMX3M6K5VQBY type=del 2024-01-13T18:20:40.193 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.192+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=9DZ4VDUMW2IH type=del size=346609 2024-01-13T18:20:40.196 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.195+0000 7f759fd04880 1 < suggested update operation key=JGALONWJXLQY tag=GAHNJP9MZSB1 type=del size=3238504 2024-01-13T18:20:40.199 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.198+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~2H5E5Y0A8Q1H.0 size=1048576 2024-01-13T18:20:40.201 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.200+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~2H5E5Y0A8Q1H.1 size=563478 2024-01-13T18:20:40.201 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.200+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=2H5E5Y0A8Q1H tag=EKFNIDPTZ09K type=write size=2660630 2024-01-13T18:20:40.203 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.202+0000 7f759fd04880 1 < completed write operation key=JN46AMLYHN8E tag=U75S9S793Y56 type=write size=692256 2024-01-13T18:20:40.206 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.205+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~A3ZUEHJNQ3U9.0 size=1048576 2024-01-13T18:20:40.208 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.207+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~A3ZUEHJNQ3U9.1 size=106468 2024-01-13T18:20:40.208 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.207+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=A3ZUEHJNQ3U9 tag=LHCH43B89DH7 type=write size=2203620 2024-01-13T18:20:40.210 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.209+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~IN2P2GK8BOJF.0 size=1048576 2024-01-13T18:20:40.211 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.210+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~IN2P2GK8BOJF.1 size=236236 2024-01-13T18:20:40.214 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.214+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=IN2P2GK8BOJF tag=9EYPSYGVDG5K type=write size=2333388 2024-01-13T18:20:40.217 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.216+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=2FPL6JTHRAHD type=del size=3910554 2024-01-13T18:20:40.219 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.218+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~KKN51GJ6R0P2.0 size=1048576 2024-01-13T18:20:40.220 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.219+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~KKN51GJ6R0P2.1 size=504663 2024-01-13T18:20:40.223 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.222+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=KKN51GJ6R0P2 tag=FKLAGXNQOYMM type=write size=2601815 2024-01-13T18:20:40.225 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.224+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=HO7VZV2H7NWL type=del size=3522067 2024-01-13T18:20:40.227 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.226+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=PB8JYMPLVUAA type=del 2024-01-13T18:20:40.228 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.227+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=V18O55D5OWL8 type=write size=435240 2024-01-13T18:20:40.230 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.229+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~DXUAKZ324GUR.0 size=1048576 2024-01-13T18:20:40.232 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.231+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~DXUAKZ324GUR.1 size=1048576 2024-01-13T18:20:40.233 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.232+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~DXUAKZ324GUR.2 size=884989 2024-01-13T18:20:40.236 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.235+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=DXUAKZ324GUR tag=KYS45U9ZYA2C type=write size=4030717 2024-01-13T18:20:40.238 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.237+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=XJ1LQ38693W3 type=del size=733465 2024-01-13T18:20:40.240 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.239+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=74TJ2OYCDPOD type=del 2024-01-13T18:20:40.243 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.242+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=MTAB66ISSYWR type=del size=329611 2024-01-13T18:20:40.246 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.245+0000 7f759fd04880 1 < suggested remove operation key=QKNPXHB99KVP tag=MTKYPSAI0CSU type=del 2024-01-13T18:20:40.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.248+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~BUJXOPOLJBUX.0 size=188788 2024-01-13T18:20:40.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.248+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=BUJXOPOLJBUX tag=QDK7FJ1MP274 type=write size=1237364 2024-01-13T18:20:40.251 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.250+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=5DB2SFGLF03Y type=del 2024-01-13T18:20:40.252 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.251+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=6FD3MGOBIOYR type=del size=2052184 2024-01-13T18:20:40.255 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.254+0000 7f759fd04880 1 < suggested remove operation key=WSRJB811XCVL tag=NVYF9BDE4GUE type=del 2024-01-13T18:20:40.258 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.258+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~WH8WSZVRS2AW.0 size=574543 2024-01-13T18:20:40.259 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.258+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=WH8WSZVRS2AW tag=13WFZW85Y066 type=write size=1623119 2024-01-13T18:20:40.260 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.259+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~K6PZOVBIL3TT.0 size=1048576 2024-01-13T18:20:40.262 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.261+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~K6PZOVBIL3TT.1 size=1048576 2024-01-13T18:20:40.263 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.262+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~K6PZOVBIL3TT.2 size=955284 2024-01-13T18:20:40.266 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.265+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=K6PZOVBIL3TT tag=IUR19X966OJR type=write size=4101012 2024-01-13T18:20:40.269 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.268+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~R8RNMNPZVFVN.0 size=540074 2024-01-13T18:20:40.269 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.268+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=R8RNMNPZVFVN tag=0P0GRBQN8ON2 type=write size=1588650 2024-01-13T18:20:40.270 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.270+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=ASG469LB3UZO type=del 2024-01-13T18:20:40.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.271+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=FCCGG7WN921U type=write size=970405 2024-01-13T18:20:40.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.273+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~W0USZOTMQ554.0 size=1048576 2024-01-13T18:20:40.276 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.275+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~W0USZOTMQ554.1 size=1048576 2024-01-13T18:20:40.277 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.276+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~W0USZOTMQ554.2 size=202026 2024-01-13T18:20:40.280 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.279+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=W0USZOTMQ554 tag=GRUHDKKF0A6Q type=write size=3347754 2024-01-13T18:20:40.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.281+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=9XLMFECM2ZYY type=del size=3234377 2024-01-13T18:20:40.286 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.285+0000 7f759fd04880 1 < suggested update operation key=1YNH6QHP354U tag=1BLZ3DM8LBE6 type=del size=654106 2024-01-13T18:20:40.289 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.288+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~YZ8E3TYCO6RN.0 size=914304 2024-01-13T18:20:40.289 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.288+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=YZ8E3TYCO6RN tag=90UU04Y8S7P5 type=write size=1962880 2024-01-13T18:20:40.291 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.290+0000 7f759fd04880 1 < canceled operation key=EW3ZFDVIQZ7G tag=IN5QMXTHSA0A type=del size=131858 2024-01-13T18:20:40.295 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.294+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~REA3BNTDZIFH.0 size=1048576 2024-01-13T18:20:40.296 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.295+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~REA3BNTDZIFH.1 size=1048576 2024-01-13T18:20:40.298 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.297+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~REA3BNTDZIFH.2 size=301381 2024-01-13T18:20:40.298 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.297+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=REA3BNTDZIFH tag=2HDSWUBBNWH4 type=write size=3447109 2024-01-13T18:20:40.301 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.300+0000 7f759fd04880 -1 < failed to complete operation key=JGALONWJXLQY tag=9DZ4VDUMW2IH type=del size=346609: (22) Invalid argument 2024-01-13T18:20:40.303 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.302+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=6VV5SFEP1RK0 type=del size=2343952 2024-01-13T18:20:40.305 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.304+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~2H5E5Y0A8Q1H.0 size=1048576 2024-01-13T18:20:40.306 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.305+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~2H5E5Y0A8Q1H.1 size=563478 2024-01-13T18:20:40.310 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.309+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=2H5E5Y0A8Q1H tag=EKFNIDPTZ09K type=write size=2660630 2024-01-13T18:20:40.314 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.313+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~I9PLNAN55WA5.0 size=429986 2024-01-13T18:20:40.314 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.313+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=I9PLNAN55WA5 tag=0RNK0XQ3WO58 type=write size=1478562 2024-01-13T18:20:40.316 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.315+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~A3ZUEHJNQ3U9.0 size=1048576 2024-01-13T18:20:40.318 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.317+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~A3ZUEHJNQ3U9.1 size=106468 2024-01-13T18:20:40.321 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.320+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=A3ZUEHJNQ3U9 tag=LHCH43B89DH7 type=write size=2203620 2024-01-13T18:20:40.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.323+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~UMO2T7OCKFKN.0 size=1048576 2024-01-13T18:20:40.326 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.325+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~UMO2T7OCKFKN.1 size=1048576 2024-01-13T18:20:40.327 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.326+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~UMO2T7OCKFKN.2 size=86838 2024-01-13T18:20:40.327 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.326+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=UMO2T7OCKFKN tag=SB0CUFC3DZPG type=write size=3232566 2024-01-13T18:20:40.329 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.328+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=2FPL6JTHRAHD type=del 2024-01-13T18:20:40.332 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.331+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~TJCGDQ1UBVY2.0 size=1048576 2024-01-13T18:20:40.334 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.333+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~TJCGDQ1UBVY2.1 size=441631 2024-01-13T18:20:40.334 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.333+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=TJCGDQ1UBVY2 tag=ZIMX3EZF08PH type=write size=2538783 2024-01-13T18:20:40.338 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.337+0000 7f759fd04880 1 < suggested remove operation key=H4VHC37BOZJ3 tag=HO7VZV2H7NWL type=del 2024-01-13T18:20:40.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.341+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~NMLK43Z65UWK.0 size=1048576 2024-01-13T18:20:40.343 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.342+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~NMLK43Z65UWK.1 size=1048576 2024-01-13T18:20:40.345 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.344+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~NMLK43Z65UWK.2 size=851868 2024-01-13T18:20:40.345 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.344+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=NMLK43Z65UWK tag=E3J3IOE4P7YO type=write size=3997596 2024-01-13T18:20:40.347 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.346+0000 7f759fd04880 -1 < failed to complete operation key=1YNH6QHP354U tag=V18O55D5OWL8 type=write size=435240: (22) Invalid argument 2024-01-13T18:20:40.351 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.350+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~PC70MI7MZ49V.0 size=1048576 2024-01-13T18:20:40.352 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.351+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~PC70MI7MZ49V.1 size=847504 2024-01-13T18:20:40.352 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.351+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=PC70MI7MZ49V tag=4QGZC6BVRH30 type=write size=2944656 2024-01-13T18:20:40.354 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.353+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=XJ1LQ38693W3 type=del 2024-01-13T18:20:40.356 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.355+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=KKK1K6VERAUC type=del size=726387 2024-01-13T18:20:40.358 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.357+0000 7f759fd04880 1 < canceled operation key=7LXXSKLOM1JZ tag=MTAB66ISSYWR type=del size=329611 2024-01-13T18:20:40.361 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.359+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=8W089R2O7PBX type=del size=2504481 2024-01-13T18:20:40.362 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.361+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~BUJXOPOLJBUX.0 size=188788 2024-01-13T18:20:40.365 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.364+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=BUJXOPOLJBUX tag=QDK7FJ1MP274 type=write size=1237364 2024-01-13T18:20:40.369 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.368+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~04PKC8LLZ1D7.0 size=1048576 2024-01-13T18:20:40.371 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.370+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~04PKC8LLZ1D7.1 size=1048576 2024-01-13T18:20:40.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.372+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~04PKC8LLZ1D7.2 size=182772 2024-01-13T18:20:40.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.372+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=04PKC8LLZ1D7 tag=DRLPU5NIHE4C type=write size=3328500 2024-01-13T18:20:40.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.374+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=6FD3MGOBIOYR type=del 2024-01-13T18:20:40.377 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.376+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=M6NUDM5S5DHA type=del size=427631 2024-01-13T18:20:40.379 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.378+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~WH8WSZVRS2AW.0 size=574543 2024-01-13T18:20:40.382 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.381+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=WH8WSZVRS2AW tag=13WFZW85Y066 type=write size=1623119 2024-01-13T18:20:40.384 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.383+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=OGFB0Y60F2L2 type=write size=687149 2024-01-13T18:20:40.384 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.383+0000 7f759fd04880 1 < canceled part key=_multipart_EW3ZFDVIQZ7G.2~R8RNMNPZVFVN.0 size=540074 2024-01-13T18:20:40.388 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.387+0000 7f759fd04880 1 < canceled multipart upload key=EW3ZFDVIQZ7G upload=R8RNMNPZVFVN tag=0P0GRBQN8ON2 type=write size=1588650 2024-01-13T18:20:40.390 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.389+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=O5HZMYIREMZO type=del size=243143 2024-01-13T18:20:40.392 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.390+0000 7f759fd04880 1 < completed write operation key=QD5GBLNCY707 tag=FCCGG7WN921U type=write size=970405 2024-01-13T18:20:40.395 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.394+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~SJDG2N6JBO7S.0 size=803415 2024-01-13T18:20:40.395 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.394+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=SJDG2N6JBO7S tag=WNXA7KBX5U4D type=write size=1851991 2024-01-13T18:20:40.396 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.395+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=9XLMFECM2ZYY type=del 2024-01-13T18:20:40.398 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.397+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=2FEMW75OFJ99 type=del size=92660 2024-01-13T18:20:40.400 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.399+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~YZ8E3TYCO6RN.0 size=914304 2024-01-13T18:20:40.404 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.403+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=YZ8E3TYCO6RN tag=90UU04Y8S7P5 type=write size=1962880 2024-01-13T18:20:40.407 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.406+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~8NDJSLEZC4N6.0 size=934700 2024-01-13T18:20:40.407 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.406+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=8NDJSLEZC4N6 tag=UD5CNWA9QHQ5 type=write size=1983276 2024-01-13T18:20:40.409 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.408+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~REA3BNTDZIFH.0 size=1048576 2024-01-13T18:20:40.409 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.408+0000 7f759fd04880 1 < canceled part key=_multipart_0TIZPXX8CMHA.2~REA3BNTDZIFH.1 size=1048576 2024-01-13T18:20:40.411 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.410+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~REA3BNTDZIFH.2 size=301381 2024-01-13T18:20:40.414 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.413+0000 7f759fd04880 1 < canceled multipart upload key=0TIZPXX8CMHA upload=REA3BNTDZIFH tag=2HDSWUBBNWH4 type=write size=3447109 2024-01-13T18:20:40.417 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.417+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~9YP6YZ089IKH.0 size=715747 2024-01-13T18:20:40.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.417+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=9YP6YZ089IKH tag=RPZOYROGTFLB type=write size=1764323 2024-01-13T18:20:40.419 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.418+0000 7f759fd04880 1 < canceled operation key=7WRTM9ANJRT4 tag=6VV5SFEP1RK0 type=del size=2343952 2024-01-13T18:20:40.423 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.422+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~3HSCN6QAWEZF.0 size=493706 2024-01-13T18:20:40.424 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.422+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=3HSCN6QAWEZF tag=103GYDWWULBF type=write size=1542282 2024-01-13T18:20:40.424 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.423+0000 7f759fd04880 1 < canceled part key=_multipart_H972TC5DOMHL.2~I9PLNAN55WA5.0 size=429986 2024-01-13T18:20:40.427 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.426+0000 7f759fd04880 1 < canceled multipart upload key=H972TC5DOMHL upload=I9PLNAN55WA5 tag=0RNK0XQ3WO58 type=write size=1478562 2024-01-13T18:20:40.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.428+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=AVY5CQSRDPAO type=del size=1757270 2024-01-13T18:20:40.430 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.429+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~UMO2T7OCKFKN.0 size=1048576 2024-01-13T18:20:40.432 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.431+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~UMO2T7OCKFKN.1 size=1048576 2024-01-13T18:20:40.434 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.433+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~UMO2T7OCKFKN.2 size=86838 2024-01-13T18:20:40.437 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.436+0000 7f759fd04880 1 < completed multipart upload key=7R5YIO7UFSDZ upload=UMO2T7OCKFKN tag=SB0CUFC3DZPG type=write size=3232566 2024-01-13T18:20:40.441 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.440+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~T6JY3BFWUI0V.0 size=1048576 2024-01-13T18:20:40.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.441+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~T6JY3BFWUI0V.1 size=559354 2024-01-13T18:20:40.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.441+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=T6JY3BFWUI0V tag=LFZ1667NADDL type=write size=2656506 2024-01-13T18:20:40.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.442+0000 7f759fd04880 1 < canceled part key=_multipart_JGALONWJXLQY.2~TJCGDQ1UBVY2.0 size=1048576 2024-01-13T18:20:40.444 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.443+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~TJCGDQ1UBVY2.1 size=441631 2024-01-13T18:20:40.448 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.447+0000 7f759fd04880 1 < canceled multipart upload key=JGALONWJXLQY upload=TJCGDQ1UBVY2 tag=ZIMX3EZF08PH type=write size=2538783 2024-01-13T18:20:40.450 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.449+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=1S4M63RMF5DD type=del size=1965182 2024-01-13T18:20:40.451 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.451+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~NMLK43Z65UWK.0 size=1048576 2024-01-13T18:20:40.453 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.452+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~NMLK43Z65UWK.1 size=1048576 2024-01-13T18:20:40.455 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.454+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~NMLK43Z65UWK.2 size=851868 2024-01-13T18:20:40.458 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.457+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=NMLK43Z65UWK tag=E3J3IOE4P7YO type=write size=3997596 2024-01-13T18:20:40.462 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.461+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~48JPK7QPM47A.0 size=895453 2024-01-13T18:20:40.462 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.461+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=48JPK7QPM47A tag=4CZ5UB7FZQRD type=write size=1944029 2024-01-13T18:20:40.463 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.462+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~PC70MI7MZ49V.0 size=1048576 2024-01-13T18:20:40.465 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.464+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~PC70MI7MZ49V.1 size=847504 2024-01-13T18:20:40.468 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.467+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=PC70MI7MZ49V tag=4QGZC6BVRH30 type=write size=2944656 2024-01-13T18:20:40.471 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.470+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=IKQJWPP91VG0 type=write size=950443 2024-01-13T18:20:40.473 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.472+0000 7f759fd04880 1 < canceled operation key=AJZB1PXB1NB5 tag=KKK1K6VERAUC type=del size=726387 2024-01-13T18:20:40.477 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.476+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~VRX2STWDKCWG.0 size=1029126 2024-01-13T18:20:40.477 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.476+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=VRX2STWDKCWG tag=Z0K3DF1J95G2 type=write size=2077702 2024-01-13T18:20:40.481 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.480+0000 7f759fd04880 1 < suggested remove operation key=3K20F802EFEQ tag=8W089R2O7PBX type=del 2024-01-13T18:20:40.485 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.483+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~U6GFJZR7L9N1.0 size=1048576 2024-01-13T18:20:40.486 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.485+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~U6GFJZR7L9N1.1 size=1048576 2024-01-13T18:20:40.488 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.487+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~U6GFJZR7L9N1.2 size=296088 2024-01-13T18:20:40.488 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.487+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=U6GFJZR7L9N1 tag=5ZWMPU1OD7Y0 type=write size=3441816 2024-01-13T18:20:40.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.489+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~04PKC8LLZ1D7.0 size=1048576 2024-01-13T18:20:40.491 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.490+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~04PKC8LLZ1D7.1 size=1048576 2024-01-13T18:20:40.493 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.492+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~04PKC8LLZ1D7.2 size=182772 2024-01-13T18:20:40.497 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.495+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=04PKC8LLZ1D7 tag=DRLPU5NIHE4C type=write size=3328500 2024-01-13T18:20:40.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.498+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=ZXURTNIU3QGB type=del size=1023886 2024-01-13T18:20:40.501 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.500+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=M6NUDM5S5DHA type=del 2024-01-13T18:20:40.504 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.503+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~WQ1CY10GL16E.0 size=1048576 2024-01-13T18:20:40.506 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.505+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~WQ1CY10GL16E.1 size=1048576 2024-01-13T18:20:40.507 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.506+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~WQ1CY10GL16E.2 size=286447 2024-01-13T18:20:40.507 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.506+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=WQ1CY10GL16E tag=R0L2X1SL4ME8 type=write size=3432175 2024-01-13T18:20:40.511 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.510+0000 7f759fd04880 1 < suggested remove operation key=7WRTM9ANJRT4 tag=OGFB0Y60F2L2 type=write 2024-01-13T18:20:40.513 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.512+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=UTANDKE9JV6I type=del size=4014496 2024-01-13T18:20:40.515 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.514+0000 7f759fd04880 1 < canceled operation key=AJZB1PXB1NB5 tag=O5HZMYIREMZO type=del size=243143 2024-01-13T18:20:40.518 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.517+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~CJIAWNYHZD9G.0 size=1048576 2024-01-13T18:20:40.519 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.518+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~CJIAWNYHZD9G.1 size=1048576 2024-01-13T18:20:40.521 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.520+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~CJIAWNYHZD9G.2 size=385581 2024-01-13T18:20:40.521 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.520+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=CJIAWNYHZD9G tag=Q7KT17IFNETC type=write size=3531309 2024-01-13T18:20:40.522 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.521+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~SJDG2N6JBO7S.0 size=803415 2024-01-13T18:20:40.525 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.524+0000 7f759fd04880 1 < completed multipart upload key=7R5YIO7UFSDZ upload=SJDG2N6JBO7S tag=WNXA7KBX5U4D type=write size=1851991 2024-01-13T18:20:40.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.527+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~1PEUUTQZO2WC.0 size=526745 2024-01-13T18:20:40.529 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.527+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=1PEUUTQZO2WC tag=2Y7NKBEK85SS type=write size=1575321 2024-01-13T18:20:40.532 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.531+0000 7f759fd04880 1 < suggested update operation key=1WSQNY2NDY3K tag=2FEMW75OFJ99 type=del size=92660 2024-01-13T18:20:40.535 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.534+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~MK13W0P9VV8T.0 size=61495 2024-01-13T18:20:40.535 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.534+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=MK13W0P9VV8T tag=LURZOXVV01QI type=write size=1110071 2024-01-13T18:20:40.537 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.536+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~8NDJSLEZC4N6.0 size=934700 2024-01-13T18:20:40.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.539+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=8NDJSLEZC4N6 tag=UD5CNWA9QHQ5 type=write size=1983276 2024-01-13T18:20:40.542 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.541+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=PVHPB4G9D2BJ type=del size=142477 2024-01-13T18:20:40.544 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.543+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~9YP6YZ089IKH.0 size=715747 2024-01-13T18:20:40.547 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.546+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=9YP6YZ089IKH tag=RPZOYROGTFLB type=write size=1764323 2024-01-13T18:20:40.549 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.547+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=270WD2QSP7XU type=del size=3663596 2024-01-13T18:20:40.550 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.549+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~3HSCN6QAWEZF.0 size=493706 2024-01-13T18:20:40.553 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.552+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=3HSCN6QAWEZF tag=103GYDWWULBF type=write size=1542282 2024-01-13T18:20:40.555 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.554+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=AJG195S4KO61 type=del size=1904301 2024-01-13T18:20:40.557 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.556+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=AVY5CQSRDPAO type=del 2024-01-13T18:20:40.559 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.558+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=91WFYPWN4MXO type=write size=966172 2024-01-13T18:20:40.561 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.560+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~T6JY3BFWUI0V.0 size=1048576 2024-01-13T18:20:40.562 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.561+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~T6JY3BFWUI0V.1 size=559354 2024-01-13T18:20:40.565 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.564+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=T6JY3BFWUI0V tag=LFZ1667NADDL type=write size=2656506 2024-01-13T18:20:40.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.566+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=ZG1BAKNXBJ0D type=del size=732861 2024-01-13T18:20:40.569 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.568+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=1S4M63RMF5DD type=del 2024-01-13T18:20:40.570 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.569+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=7GOXCROKVSVX type=del size=2152804 2024-01-13T18:20:40.572 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.571+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~48JPK7QPM47A.0 size=895453 2024-01-13T18:20:40.575 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.574+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=48JPK7QPM47A tag=4CZ5UB7FZQRD type=write size=1944029 2024-01-13T18:20:40.577 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.576+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=8BO7MDAVZYCG type=del size=1009751 2024-01-13T18:20:40.581 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.579+0000 7f759fd04880 1 < suggested remove operation key=QD5GBLNCY707 tag=IKQJWPP91VG0 type=write 2024-01-13T18:20:40.584 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.582+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~UMJGQ5FRAY4D.0 size=864251 2024-01-13T18:20:40.584 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.582+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=UMJGQ5FRAY4D tag=D1IB2GV21433 type=write size=1912827 2024-01-13T18:20:40.585 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.584+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~VRX2STWDKCWG.0 size=1029126 2024-01-13T18:20:40.592 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.587+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=VRX2STWDKCWG tag=Z0K3DF1J95G2 type=write size=2077702 2024-01-13T18:20:40.592 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.591+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~AC82ON6STYUB.0 size=743612 2024-01-13T18:20:40.592 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.591+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=AC82ON6STYUB tag=WDW0LD0IKAG9 type=write size=1792188 2024-01-13T18:20:40.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.592+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~U6GFJZR7L9N1.0 size=1048576 2024-01-13T18:20:40.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.594+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~U6GFJZR7L9N1.1 size=1048576 2024-01-13T18:20:40.596 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.595+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~U6GFJZR7L9N1.2 size=296088 2024-01-13T18:20:40.599 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.598+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=U6GFJZR7L9N1 tag=5ZWMPU1OD7Y0 type=write size=3441816 2024-01-13T18:20:40.602 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.601+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~8IOYY7N36M31.0 size=1048576 2024-01-13T18:20:40.604 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.603+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~8IOYY7N36M31.1 size=657553 2024-01-13T18:20:40.604 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.603+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=8IOYY7N36M31 tag=UK650FDB82IK type=write size=2754705 2024-01-13T18:20:40.605 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.605+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=ZXURTNIU3QGB type=del 2024-01-13T18:20:40.609 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.608+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~I7RZG7B79JSX.0 size=1048576 2024-01-13T18:20:40.610 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.609+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~I7RZG7B79JSX.1 size=514700 2024-01-13T18:20:40.610 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.609+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=I7RZG7B79JSX tag=IIP2ZJTU87RF type=write size=2611852 2024-01-13T18:20:40.613 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.612+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~WQ1CY10GL16E.0 size=1048576 2024-01-13T18:20:40.614 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.613+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~WQ1CY10GL16E.1 size=1048576 2024-01-13T18:20:40.617 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.615+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~WQ1CY10GL16E.2 size=286447 2024-01-13T18:20:40.619 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.618+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=WQ1CY10GL16E tag=R0L2X1SL4ME8 type=write size=3432175 2024-01-13T18:20:40.621 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.620+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=T290BPNNTUJF type=del size=1269357 2024-01-13T18:20:40.623 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.622+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=UTANDKE9JV6I type=del 2024-01-13T18:20:40.626 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.625+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~7SPF1MOR6HRI.0 size=1048576 2024-01-13T18:20:40.629 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.628+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~7SPF1MOR6HRI.1 size=227509 2024-01-13T18:20:40.629 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.628+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=7SPF1MOR6HRI tag=2KK0FSAML94N type=write size=2324661 2024-01-13T18:20:40.630 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.630+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~CJIAWNYHZD9G.0 size=1048576 2024-01-13T18:20:40.632 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.631+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~CJIAWNYHZD9G.1 size=1048576 2024-01-13T18:20:40.634 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.633+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~CJIAWNYHZD9G.2 size=385581 2024-01-13T18:20:40.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.636+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=CJIAWNYHZD9G tag=Q7KT17IFNETC type=write size=3531309 2024-01-13T18:20:40.639 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.638+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=4F1WK593P9D2 type=del size=760137 2024-01-13T18:20:40.640 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.639+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~1PEUUTQZO2WC.0 size=526745 2024-01-13T18:20:40.643 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.642+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=1PEUUTQZO2WC tag=2Y7NKBEK85SS type=write size=1575321 2024-01-13T18:20:40.645 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.644+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=XNNOBPOMC2JL type=del size=3623988 2024-01-13T18:20:40.647 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.646+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~MK13W0P9VV8T.0 size=61495 2024-01-13T18:20:40.650 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.649+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=MK13W0P9VV8T tag=LURZOXVV01QI type=write size=1110071 2024-01-13T18:20:40.652 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.651+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=0XTOUI3QODKD type=write size=891671 2024-01-13T18:20:40.654 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.653+0000 7f759fd04880 1 < canceled operation key=1QEZO616DBC3 tag=PVHPB4G9D2BJ type=del size=142477 2024-01-13T18:20:40.657 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.656+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~CNDBZX5KFN13.0 size=827237 2024-01-13T18:20:40.657 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.656+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=CNDBZX5KFN13 tag=E05J7ATXS1QP type=write size=1875813 2024-01-13T18:20:40.659 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.658+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=270WD2QSP7XU type=del 2024-01-13T18:20:40.661 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.660+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=3Z6TLPY5ZU2M type=del size=1056608 2024-01-13T18:20:40.663 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.662+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=AJG195S4KO61 type=del 2024-01-13T18:20:40.666 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.665+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~E0CJ3T3EB7EO.0 size=1048576 2024-01-13T18:20:40.668 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.667+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~E0CJ3T3EB7EO.1 size=158194 2024-01-13T18:20:40.668 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.667+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=E0CJ3T3EB7EO tag=PWZ2834TBOXK type=write size=2255346 2024-01-13T18:20:40.669 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.668+0000 7f759fd04880 1 < completed write operation key=0TIZPXX8CMHA tag=91WFYPWN4MXO type=write size=966172 2024-01-13T18:20:40.671 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.670+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=M7QT2GS50NRQ type=del size=817276 2024-01-13T18:20:40.673 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.672+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=ZG1BAKNXBJ0D type=del 2024-01-13T18:20:40.675 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.674+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=R36ZZQKXI4SL type=del size=3254912 2024-01-13T18:20:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:20:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:20:40] "GET /metrics HTTP/1.1" 200 36276 "" "Prometheus/2.43.0" 2024-01-13T18:20:40.678 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.678+0000 7f759fd04880 1 < suggested remove operation key=QKNPXHB99KVP tag=7GOXCROKVSVX type=del 2024-01-13T18:20:40.682 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.681+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~E1E779FNIID2.0 size=537357 2024-01-13T18:20:40.682 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.681+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=E1E779FNIID2 tag=JT0VGNXTKNO4 type=write size=1585933 2024-01-13T18:20:40.684 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.683+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=8BO7MDAVZYCG type=del 2024-01-13T18:20:40.685 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.685+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=VFQRAJI3GZKH type=del size=932458 2024-01-13T18:20:40.687 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.686+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~UMJGQ5FRAY4D.0 size=864251 2024-01-13T18:20:40.690 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.689+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=UMJGQ5FRAY4D tag=D1IB2GV21433 type=write size=1912827 2024-01-13T18:20:40.692 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.691+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=MQ07EPLG4P6X type=write size=881639 2024-01-13T18:20:40.694 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.693+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~AC82ON6STYUB.0 size=743612 2024-01-13T18:20:40.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.696+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=AC82ON6STYUB tag=WDW0LD0IKAG9 type=write size=1792188 2024-01-13T18:20:40.701 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.699+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~AHU29RTN5S2B.0 size=169374 2024-01-13T18:20:40.701 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.699+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=AHU29RTN5S2B tag=YR103S4K9X37 type=write size=1217950 2024-01-13T18:20:40.704 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.703+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~8IOYY7N36M31.0 size=1048576 2024-01-13T18:20:40.704 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.703+0000 7f759fd04880 1 < canceled part key=_multipart_1YNH6QHP354U.2~8IOYY7N36M31.1 size=657553 2024-01-13T18:20:40.708 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.707+0000 7f759fd04880 1 < canceled multipart upload key=1YNH6QHP354U upload=8IOYY7N36M31 tag=UK650FDB82IK type=write size=2754705 2024-01-13T18:20:40.711 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.710+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~H0U43IIOPGGL.0 size=1048576 2024-01-13T18:20:40.713 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.712+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~H0U43IIOPGGL.1 size=1048576 2024-01-13T18:20:40.715 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.714+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~H0U43IIOPGGL.2 size=42767 2024-01-13T18:20:40.715 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.714+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=H0U43IIOPGGL tag=2AHI6GYSAQVA type=write size=3188495 2024-01-13T18:20:40.718 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.717+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~I7RZG7B79JSX.0 size=1048576 2024-01-13T18:20:40.720 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.719+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~I7RZG7B79JSX.1 size=514700 2024-01-13T18:20:40.723 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.722+0000 7f759fd04880 1 < completed multipart upload key=VZHGQM6ZNJYQ upload=I7RZG7B79JSX tag=IIP2ZJTU87RF type=write size=2611852 2024-01-13T18:20:40.727 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.726+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~WUVNGLISJ8NH.0 size=1048576 2024-01-13T18:20:40.728 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.727+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~WUVNGLISJ8NH.1 size=971645 2024-01-13T18:20:40.729 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.727+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=WUVNGLISJ8NH tag=Z07M7SSHUQJS type=write size=3068797 2024-01-13T18:20:40.730 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.729+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=T290BPNNTUJF type=del 2024-01-13T18:20:40.732 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.731+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=9OTV37GHVYGJ type=write size=607219 2024-01-13T18:20:40.735 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.733+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~7SPF1MOR6HRI.0 size=1048576 2024-01-13T18:20:40.736 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.735+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~7SPF1MOR6HRI.1 size=227509 2024-01-13T18:20:40.739 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.738+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=7SPF1MOR6HRI tag=2KK0FSAML94N type=write size=2324661 2024-01-13T18:20:40.742 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.741+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~YE3A4R5R52ST.0 size=462870 2024-01-13T18:20:40.742 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.741+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=YE3A4R5R52ST tag=H4T9MB6VR7QS type=write size=1511446 2024-01-13T18:20:40.744 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.743+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=4F1WK593P9D2 type=del 2024-01-13T18:20:40.746 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.745+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=OD094QXUP2OP type=del size=647083 2024-01-13T18:20:40.748 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.747+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=XNNOBPOMC2JL type=del 2024-01-13T18:20:40.749 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.748+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=LRWKMH9IHJHV type=del size=550003 2024-01-13T18:20:40.751 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.750+0000 7f759fd04880 1 < completed write operation key=JN46AMLYHN8E tag=0XTOUI3QODKD type=write size=891671 2024-01-13T18:20:40.755 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.754+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~398G8XKJJDDO.0 size=101952 2024-01-13T18:20:40.755 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.754+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=398G8XKJJDDO tag=58XP3LS74WD6 type=write size=1150528 2024-01-13T18:20:40.756 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.755+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~CNDBZX5KFN13.0 size=827237 2024-01-13T18:20:40.760 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.759+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=CNDBZX5KFN13 tag=E05J7ATXS1QP type=write size=1875813 2024-01-13T18:20:40.761 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.760+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=156JMW6SG11J type=del size=3677584 2024-01-13T18:20:40.763 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.762+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=3Z6TLPY5ZU2M type=del 2024-01-13T18:20:40.765 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.764+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=6PFC4337V58G type=del size=3138366 2024-01-13T18:20:40.767 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.766+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~E0CJ3T3EB7EO.0 size=1048576 2024-01-13T18:20:40.768 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.767+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~E0CJ3T3EB7EO.1 size=158194 2024-01-13T18:20:40.771 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.770+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=E0CJ3T3EB7EO tag=PWZ2834TBOXK type=write size=2255346 2024-01-13T18:20:40.775 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.774+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~C4NOGG9HB9GS.0 size=1048576 2024-01-13T18:20:40.776 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.775+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~C4NOGG9HB9GS.1 size=909916 2024-01-13T18:20:40.776 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.775+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=C4NOGG9HB9GS tag=IGP06IC3UEB4 type=write size=3007068 2024-01-13T18:20:40.778 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.777+0000 7f759fd04880 1 < canceled operation key=H4VHC37BOZJ3 tag=M7QT2GS50NRQ type=del size=817276 2024-01-13T18:20:40.782 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.781+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~BYWBL4QTSSP0.0 size=1048576 2024-01-13T18:20:40.784 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.783+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~BYWBL4QTSSP0.1 size=1048576 2024-01-13T18:20:40.785 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.784+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~BYWBL4QTSSP0.2 size=117904 2024-01-13T18:20:40.785 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.784+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=BYWBL4QTSSP0 tag=1ODRG63DUZLK type=write size=3263632 2024-01-13T18:20:40.788 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.787+0000 7f759fd04880 1 < suggested update operation key=QS9PLJKINY4R tag=R36ZZQKXI4SL type=del size=3254912 2024-01-13T18:20:40.790 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.789+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=T14O5YG6SWTS type=del size=2827241 2024-01-13T18:20:40.792 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.791+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~E1E779FNIID2.0 size=537357 2024-01-13T18:20:40.796 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.794+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=E1E779FNIID2 tag=JT0VGNXTKNO4 type=write size=1585933 2024-01-13T18:20:40.799 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.798+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~G0CCF0437FNW.0 size=1048576 2024-01-13T18:20:40.801 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.800+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~G0CCF0437FNW.1 size=1048576 2024-01-13T18:20:40.802 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.801+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~G0CCF0437FNW.2 size=224946 2024-01-13T18:20:40.803 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.801+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=G0CCF0437FNW tag=J2YOK5HAP9D4 type=write size=3370674 2024-01-13T18:20:40.806 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.805+0000 7f759fd04880 1 < suggested remove operation key=7LXXSKLOM1JZ tag=VFQRAJI3GZKH type=del 2024-01-13T18:20:40.809 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.808+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=4P5US1LRRK2I type=del size=3900083 2024-01-13T18:20:40.811 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.810+0000 7f759fd04880 1 < completed write operation key=3K20F802EFEQ tag=MQ07EPLG4P6X type=write size=881639 2024-01-13T18:20:40.814 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.813+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~EGZBIPSI0VJZ.0 size=1048576 2024-01-13T18:20:40.816 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.815+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~EGZBIPSI0VJZ.1 size=109903 2024-01-13T18:20:40.816 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.815+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=EGZBIPSI0VJZ tag=IK1ZWRCAHI2C type=write size=2207055 2024-01-13T18:20:40.818 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.817+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~AHU29RTN5S2B.0 size=169374 2024-01-13T18:20:40.821 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.820+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=AHU29RTN5S2B tag=YR103S4K9X37 type=write size=1217950 2024-01-13T18:20:40.823 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.822+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=XBZ5FDKSL0AM type=del size=516178 2024-01-13T18:20:40.825 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.824+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~H0U43IIOPGGL.0 size=1048576 2024-01-13T18:20:40.826 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.825+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~H0U43IIOPGGL.1 size=1048576 2024-01-13T18:20:40.828 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.827+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~H0U43IIOPGGL.2 size=42767 2024-01-13T18:20:40.832 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.831+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=H0U43IIOPGGL tag=2AHI6GYSAQVA type=write size=3188495 2024-01-13T18:20:40.834 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.833+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=APRU9QEXFXQB type=del size=535078 2024-01-13T18:20:40.836 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.835+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~WUVNGLISJ8NH.0 size=1048576 2024-01-13T18:20:40.838 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.837+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~WUVNGLISJ8NH.1 size=971645 2024-01-13T18:20:40.841 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.840+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=WUVNGLISJ8NH tag=Z07M7SSHUQJS type=write size=3068797 2024-01-13T18:20:40.843 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.842+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=U6HS6114I741 type=write size=657081 2024-01-13T18:20:40.845 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.844+0000 7f759fd04880 1 < completed write operation key=ZI9WAZQHVPAR tag=9OTV37GHVYGJ type=write size=607219 2024-01-13T18:20:40.847 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.846+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=O085MKJIB6SA type=del size=1899216 2024-01-13T18:20:40.849 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.848+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~YE3A4R5R52ST.0 size=462870 2024-01-13T18:20:40.852 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.851+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=YE3A4R5R52ST tag=H4T9MB6VR7QS type=write size=1511446 2024-01-13T18:20:40.853 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.853+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=NMV5NUIZNCO5 type=del size=2744039 2024-01-13T18:20:40.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.856+0000 7f759fd04880 1 < suggested update operation key=8EWIOXN5H9KU tag=OD094QXUP2OP type=del size=647083 2024-01-13T18:20:40.861 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.860+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~YUDV9CK9YH0W.0 size=1048576 2024-01-13T18:20:40.863 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.862+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~YUDV9CK9YH0W.1 size=1048576 2024-01-13T18:20:40.865 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.864+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~YUDV9CK9YH0W.2 size=846933 2024-01-13T18:20:40.865 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.864+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=YUDV9CK9YH0W tag=ZR4Z2UA6YEZ5 type=write size=3992661 2024-01-13T18:20:40.867 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.865+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=LRWKMH9IHJHV type=del 2024-01-13T18:20:40.868 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.867+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=OJ3QRKDH1IS4 type=write size=165730 2024-01-13T18:20:40.870 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.869+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~398G8XKJJDDO.0 size=101952 2024-01-13T18:20:40.873 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.872+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=398G8XKJJDDO tag=58XP3LS74WD6 type=write size=1150528 2024-01-13T18:20:40.875 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.874+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=OTQWI11H7QLN type=del size=1436925 2024-01-13T18:20:40.876 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.875+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=156JMW6SG11J type=del 2024-01-13T18:20:40.878 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.877+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=9WPD7XXDYXYU type=del size=4081192 2024-01-13T18:20:40.881 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.880+0000 7f759fd04880 -1 < failed to complete operation key=8EWIOXN5H9KU tag=6PFC4337V58G type=del size=3138366: (22) Invalid argument 2024-01-13T18:20:40.884 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.883+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~3SQSQIP29CKR.0 size=1048576 2024-01-13T18:20:40.886 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.884+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~3SQSQIP29CKR.1 size=1048576 2024-01-13T18:20:40.887 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.886+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~3SQSQIP29CKR.2 size=442038 2024-01-13T18:20:40.887 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.886+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=3SQSQIP29CKR tag=CZL4UDR52O67 type=write size=3587766 2024-01-13T18:20:40.889 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.888+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~C4NOGG9HB9GS.0 size=1048576 2024-01-13T18:20:40.891 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.889+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~C4NOGG9HB9GS.1 size=909916 2024-01-13T18:20:40.894 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.893+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=C4NOGG9HB9GS tag=IGP06IC3UEB4 type=write size=3007068 2024-01-13T18:20:40.898 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.897+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~5P19AQ5LUH5A.0 size=1048576 2024-01-13T18:20:40.900 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.899+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~5P19AQ5LUH5A.1 size=459626 2024-01-13T18:20:40.900 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.899+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=5P19AQ5LUH5A tag=VYNJGKK3UE8T type=write size=2556778 2024-01-13T18:20:40.902 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.901+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~BYWBL4QTSSP0.0 size=1048576 2024-01-13T18:20:40.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.903+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~BYWBL4QTSSP0.1 size=1048576 2024-01-13T18:20:40.905 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.904+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~BYWBL4QTSSP0.2 size=117904 2024-01-13T18:20:40.909 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.908+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=BYWBL4QTSSP0 tag=1ODRG63DUZLK type=write size=3263632 2024-01-13T18:20:40.911 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.910+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=U7BH08EWX5TR type=del size=1632682 2024-01-13T18:20:40.913 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.912+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=T14O5YG6SWTS type=del 2024-01-13T18:20:40.915 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.914+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=HF98VLNBJYBJ type=del size=3529466 2024-01-13T18:20:40.916 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.916+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~G0CCF0437FNW.0 size=1048576 2024-01-13T18:20:40.918 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.917+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~G0CCF0437FNW.1 size=1048576 2024-01-13T18:20:40.920 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.919+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~G0CCF0437FNW.2 size=224946 2024-01-13T18:20:40.923 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.922+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=G0CCF0437FNW tag=J2YOK5HAP9D4 type=write size=3370674 2024-01-13T18:20:40.926 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.925+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~OL1NAH1H6FX1.0 size=1048576 2024-01-13T18:20:40.928 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.927+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~OL1NAH1H6FX1.1 size=1048576 2024-01-13T18:20:40.930 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.929+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~OL1NAH1H6FX1.2 size=770778 2024-01-13T18:20:40.930 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.929+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=OL1NAH1H6FX1 tag=ZER43AB9CZOL type=write size=3916506 2024-01-13T18:20:40.933 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.933+0000 7f759fd04880 1 < suggested update operation key=OMA1B74S8FXS tag=4P5US1LRRK2I type=del size=3900083 2024-01-13T18:20:40.937 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.936+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=KHR51KAW7859 type=del size=1277387 2024-01-13T18:20:40.938 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.937+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~EGZBIPSI0VJZ.0 size=1048576 2024-01-13T18:20:40.940 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.939+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~EGZBIPSI0VJZ.1 size=109903 2024-01-13T18:20:40.943 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.942+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=EGZBIPSI0VJZ tag=IK1ZWRCAHI2C type=write size=2207055 2024-01-13T18:20:40.947 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.946+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~SQZQ0L83RADM.0 size=271325 2024-01-13T18:20:40.947 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.946+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=SQZQ0L83RADM tag=G35ZPPEGZ2O4 type=write size=1319901 2024-01-13T18:20:40.949 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.948+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=XBZ5FDKSL0AM type=del 2024-01-13T18:20:40.951 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.950+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=RESIGHMQTS70 type=del size=324902 2024-01-13T18:20:40.953 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.952+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=APRU9QEXFXQB type=del 2024-01-13T18:20:40.955 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.954+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=Z8Y12D3X68HX type=write size=950964 2024-01-13T18:20:40.958 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.958+0000 7f759fd04880 1 < suggested update operation key=H7C1UAGAUR7D tag=U6HS6114I741 type=write size=657081 2024-01-13T18:20:40.960 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.959+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=9HQ8S4GXGEI4 type=write size=422597 2024-01-13T18:20:40.962 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.961+0000 7f759fd04880 1 < canceled operation key=ZI9WAZQHVPAR tag=O085MKJIB6SA type=del size=1899216 2024-01-13T18:20:40.965 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.965+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~2LZ7WZ2K90DB.0 size=719102 2024-01-13T18:20:40.966 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.965+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=2LZ7WZ2K90DB tag=S7N1XT7X2JZJ type=write size=1767678 2024-01-13T18:20:40.967 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.966+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=NMV5NUIZNCO5 type=del 2024-01-13T18:20:40.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.970+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~AXCWHT6DYIJA.0 size=951350 2024-01-13T18:20:40.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.970+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=AXCWHT6DYIJA tag=7UGWWHEUC71Y type=write size=1999926 2024-01-13T18:20:40.972 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.971+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~YUDV9CK9YH0W.0 size=1048576 2024-01-13T18:20:40.972 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.971+0000 7f759fd04880 1 < canceled part key=_multipart_OMA1B74S8FXS.2~YUDV9CK9YH0W.1 size=1048576 2024-01-13T18:20:40.974 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.973+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~YUDV9CK9YH0W.2 size=846933 2024-01-13T18:20:40.978 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.977+0000 7f759fd04880 1 < canceled multipart upload key=OMA1B74S8FXS upload=YUDV9CK9YH0W tag=ZR4Z2UA6YEZ5 type=write size=3992661 2024-01-13T18:20:40.981 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.980+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~4DB1KQSODY4I.0 size=1048576 2024-01-13T18:20:40.983 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.982+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~4DB1KQSODY4I.1 size=807829 2024-01-13T18:20:40.983 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.982+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=4DB1KQSODY4I tag=18X2UCCHN0IG type=write size=2904981 2024-01-13T18:20:40.985 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.984+0000 7f759fd04880 1 < completed write operation key=QKNPXHB99KVP tag=OJ3QRKDH1IS4 type=write size=165730 2024-01-13T18:20:40.989 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.987+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~YG8I3TIOOZ1S.0 size=439170 2024-01-13T18:20:40.990 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.987+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=YG8I3TIOOZ1S tag=MD2PU9E7NO41 type=write size=1487746 2024-01-13T18:20:40.990 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.989+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=OTQWI11H7QLN type=del 2024-01-13T18:20:40.994 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.993+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~OBJ0TDNXF1UH.0 size=786506 2024-01-13T18:20:40.994 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.993+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=OBJ0TDNXF1UH tag=BRBGRTCZFRZG type=write size=1835082 2024-01-13T18:20:40.995 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.994+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=9WPD7XXDYXYU type=del 2024-01-13T18:20:40.997 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.996+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=V4Q2BLGH39QW type=del size=3008559 2024-01-13T18:20:40.998 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.997+0000 7f759fd04880 1 < canceled part key=_multipart_XBTWSUA3D7U3.2~3SQSQIP29CKR.0 size=1048576 2024-01-13T18:20:41.000 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:40.999+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~3SQSQIP29CKR.1 size=1048576 2024-01-13T18:20:41.002 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.000+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~3SQSQIP29CKR.2 size=442038 2024-01-13T18:20:41.006 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.005+0000 7f759fd04880 1 < canceled multipart upload key=XBTWSUA3D7U3 upload=3SQSQIP29CKR tag=CZL4UDR52O67 type=write size=3587766 2024-01-13T18:20:41.007 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.006+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=FLDP89SZ8ESN type=del size=2262158 2024-01-13T18:20:41.009 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.008+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~5P19AQ5LUH5A.0 size=1048576 2024-01-13T18:20:41.011 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.010+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~5P19AQ5LUH5A.1 size=459626 2024-01-13T18:20:41.015 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.014+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=5P19AQ5LUH5A tag=VYNJGKK3UE8T type=write size=2556778 2024-01-13T18:20:41.019 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.018+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~0O30MMX3FPYU.0 size=960495 2024-01-13T18:20:41.019 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.018+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=0O30MMX3FPYU tag=NC38U164SUOZ type=write size=2009071 2024-01-13T18:20:41.020 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.019+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=U7BH08EWX5TR type=del 2024-01-13T18:20:41.024 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.023+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~0RVIZ8SFCYD0.0 size=339463 2024-01-13T18:20:41.024 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.023+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=0RVIZ8SFCYD0 tag=C19PNU4LKA02 type=write size=1388039 2024-01-13T18:20:41.027 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.026+0000 7f759fd04880 1 < suggested update operation key=2OO7S2NBZ7M6 tag=HF98VLNBJYBJ type=del size=3529466 2024-01-13T18:20:41.031 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.030+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~IQR2PODT7Z75.0 size=201233 2024-01-13T18:20:41.031 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.030+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=IQR2PODT7Z75 tag=EOBY3AAW0NNC type=write size=1249809 2024-01-13T18:20:41.032 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.032+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~OL1NAH1H6FX1.0 size=1048576 2024-01-13T18:20:41.034 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.033+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~OL1NAH1H6FX1.1 size=1048576 2024-01-13T18:20:41.036 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.035+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~OL1NAH1H6FX1.2 size=770778 2024-01-13T18:20:41.039 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.038+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=OL1NAH1H6FX1 tag=ZER43AB9CZOL type=write size=3916506 2024-01-13T18:20:41.042 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.042+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~07NJMTN2R898.0 size=1048576 2024-01-13T18:20:41.044 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.043+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~07NJMTN2R898.1 size=684788 2024-01-13T18:20:41.044 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.043+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=07NJMTN2R898 tag=5CCKXLN3JBLY type=write size=2781940 2024-01-13T18:20:41.046 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.045+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=KHR51KAW7859 type=del 2024-01-13T18:20:41.049 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.048+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~8K7SZUHVY25O.0 size=1048576 2024-01-13T18:20:41.051 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.050+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~8K7SZUHVY25O.1 size=1048576 2024-01-13T18:20:41.052 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.051+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~8K7SZUHVY25O.2 size=383029 2024-01-13T18:20:41.052 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.051+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=8K7SZUHVY25O tag=BT3PXN4V7V6J type=write size=3528757 2024-01-13T18:20:41.054 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.053+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~SQZQ0L83RADM.0 size=271325 2024-01-13T18:20:41.057 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.056+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=SQZQ0L83RADM tag=G35ZPPEGZ2O4 type=write size=1319901 2024-01-13T18:20:41.061 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.060+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~FIIT2VUNJZV9.0 size=1048576 2024-01-13T18:20:41.063 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.062+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~FIIT2VUNJZV9.1 size=845710 2024-01-13T18:20:41.063 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.062+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=FIIT2VUNJZV9 tag=8WYRMO2NOGCT type=write size=2942862 2024-01-13T18:20:41.065 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.064+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=RESIGHMQTS70 type=del 2024-01-13T18:20:41.067 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.066+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=IJ00L5C03XCN type=del size=2572433 2024-01-13T18:20:41.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.068+0000 7f759fd04880 1 < completed write operation key=VZHGQM6ZNJYQ tag=Z8Y12D3X68HX type=write size=950964 2024-01-13T18:20:41.072 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.071+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~1S2JROKOSBUB.0 size=1048576 2024-01-13T18:20:41.074 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.073+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~1S2JROKOSBUB.1 size=1048576 2024-01-13T18:20:41.075 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.074+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~1S2JROKOSBUB.2 size=617629 2024-01-13T18:20:41.076 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.074+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=1S2JROKOSBUB tag=4JB3KDCYM1UW type=write size=3763357 2024-01-13T18:20:41.077 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.076+0000 7f759fd04880 1 < completed write operation key=1YNH6QHP354U tag=9HQ8S4GXGEI4 type=write size=422597 2024-01-13T18:20:41.080 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.079+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~90R5P0ZS0A4E.0 size=1048576 2024-01-13T18:20:41.082 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.081+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~90R5P0ZS0A4E.1 size=994794 2024-01-13T18:20:41.082 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.081+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=90R5P0ZS0A4E tag=1NBTLAEGDR8Q type=write size=3091946 2024-01-13T18:20:41.084 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.083+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~2LZ7WZ2K90DB.0 size=719102 2024-01-13T18:20:41.088 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.087+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=2LZ7WZ2K90DB tag=S7N1XT7X2JZJ type=write size=1767678 2024-01-13T18:20:41.092 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.091+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~IGOYA6FCXTOJ.0 size=464896 2024-01-13T18:20:41.092 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.091+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=IGOYA6FCXTOJ tag=GZBHTEP5IYX1 type=write size=1513472 2024-01-13T18:20:41.094 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.093+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~AXCWHT6DYIJA.0 size=951350 2024-01-13T18:20:41.097 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.096+0000 7f759fd04880 1 < completed multipart upload key=OMA1B74S8FXS upload=AXCWHT6DYIJA tag=7UGWWHEUC71Y type=write size=1999926 2024-01-13T18:20:41.099 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.098+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=IPWRFV5WRH15 type=write size=390007 2024-01-13T18:20:41.101 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.099+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~4DB1KQSODY4I.0 size=1048576 2024-01-13T18:20:41.102 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.101+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~4DB1KQSODY4I.1 size=807829 2024-01-13T18:20:41.106 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.105+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=4DB1KQSODY4I tag=18X2UCCHN0IG type=write size=2904981 2024-01-13T18:20:41.107 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.106+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=VW8Q43I3V5DE type=del size=3450720 2024-01-13T18:20:41.110 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.109+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~YG8I3TIOOZ1S.0 size=439170 2024-01-13T18:20:41.113 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.112+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=YG8I3TIOOZ1S tag=MD2PU9E7NO41 type=write size=1487746 2024-01-13T18:20:41.116 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.115+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~A13QFPF3QG0F.0 size=1048576 2024-01-13T18:20:41.118 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.117+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~A13QFPF3QG0F.1 size=1048576 2024-01-13T18:20:41.119 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.118+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~A13QFPF3QG0F.2 size=952215 2024-01-13T18:20:41.119 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.118+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=A13QFPF3QG0F tag=ENC2SKPWSNS4 type=write size=4097943 2024-01-13T18:20:41.121 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.120+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~OBJ0TDNXF1UH.0 size=786506 2024-01-13T18:20:41.124 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.123+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=OBJ0TDNXF1UH tag=BRBGRTCZFRZG type=write size=1835082 2024-01-13T18:20:41.126 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.125+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=ODA0HPOIXRSP type=del size=2135685 2024-01-13T18:20:41.131 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.130+0000 7f759fd04880 1 < suggested update operation key=7WRTM9ANJRT4 tag=V4Q2BLGH39QW type=del size=3008559 2024-01-13T18:20:41.132 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.132+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=I0QX35NZQ3MF type=del size=1075662 2024-01-13T18:20:41.135 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.134+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=FLDP89SZ8ESN type=del 2024-01-13T18:20:41.137 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.136+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=YMUTDNNC2CAA type=del size=2197333 2024-01-13T18:20:41.139 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.138+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~0O30MMX3FPYU.0 size=960495 2024-01-13T18:20:41.142 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.141+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=0O30MMX3FPYU tag=NC38U164SUOZ type=write size=2009071 2024-01-13T18:20:41.146 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.144+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~E455U33KXM0I.0 size=392863 2024-01-13T18:20:41.146 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.144+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=E455U33KXM0I tag=9D5PTRXZPADR type=write size=1441439 2024-01-13T18:20:41.148 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.147+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~0RVIZ8SFCYD0.0 size=339463 2024-01-13T18:20:41.151 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.150+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=0RVIZ8SFCYD0 tag=C19PNU4LKA02 type=write size=1388039 2024-01-13T18:20:41.155 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.154+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~4MENIISEI257.0 size=1048576 2024-01-13T18:20:41.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.155+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~4MENIISEI257.1 size=1048576 2024-01-13T18:20:41.158 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.157+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~4MENIISEI257.2 size=219640 2024-01-13T18:20:41.158 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.157+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=4MENIISEI257 tag=QKL8N27NPHSP type=write size=3365368 2024-01-13T18:20:41.159 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.158+0000 7f759fd04880 1 < canceled part key=_multipart_7LXXSKLOM1JZ.2~IQR2PODT7Z75.0 size=201233 2024-01-13T18:20:41.162 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.161+0000 7f759fd04880 1 < canceled multipart upload key=7LXXSKLOM1JZ upload=IQR2PODT7Z75 tag=EOBY3AAW0NNC type=write size=1249809 2024-01-13T18:20:41.164 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.163+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=U57W4ZPTNP31 type=del size=3031043 2024-01-13T18:20:41.165 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.165+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~07NJMTN2R898.0 size=1048576 2024-01-13T18:20:41.167 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.166+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~07NJMTN2R898.1 size=684788 2024-01-13T18:20:41.171 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.170+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=07NJMTN2R898 tag=5CCKXLN3JBLY type=write size=2781940 2024-01-13T18:20:41.173 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.172+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=OPUVNW18E9QS type=del size=3188887 2024-01-13T18:20:41.175 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.174+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~8K7SZUHVY25O.0 size=1048576 2024-01-13T18:20:41.177 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.176+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~8K7SZUHVY25O.1 size=1048576 2024-01-13T18:20:41.178 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.177+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~8K7SZUHVY25O.2 size=383029 2024-01-13T18:20:41.182 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.181+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=8K7SZUHVY25O tag=BT3PXN4V7V6J type=write size=3528757 2024-01-13T18:20:41.184 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.183+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=X71T6PQORBZY type=del size=2991096 2024-01-13T18:20:41.186 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.185+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~FIIT2VUNJZV9.0 size=1048576 2024-01-13T18:20:41.187 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.186+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~FIIT2VUNJZV9.1 size=845710 2024-01-13T18:20:41.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.190+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=FIIT2VUNJZV9 tag=8WYRMO2NOGCT type=write size=2942862 2024-01-13T18:20:41.195 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.194+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~TFMIK7M46KOW.0 size=265295 2024-01-13T18:20:41.195 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.194+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=TFMIK7M46KOW tag=3R6ZBKXHFEA0 type=write size=1313871 2024-01-13T18:20:41.197 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.196+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=IJ00L5C03XCN type=del 2024-01-13T18:20:41.199 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.198+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=VN8XH1XIY3VM type=del size=2071172 2024-01-13T18:20:41.201 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.200+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~1S2JROKOSBUB.0 size=1048576 2024-01-13T18:20:41.203 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.202+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~1S2JROKOSBUB.1 size=1048576 2024-01-13T18:20:41.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.203+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~1S2JROKOSBUB.2 size=617629 2024-01-13T18:20:41.207 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.207+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=1S2JROKOSBUB tag=4JB3KDCYM1UW type=write size=3763357 2024-01-13T18:20:41.209 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.208+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=J7B3EUSF410S type=del size=2451765 2024-01-13T18:20:41.211 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.210+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~90R5P0ZS0A4E.0 size=1048576 2024-01-13T18:20:41.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.212+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~90R5P0ZS0A4E.1 size=994794 2024-01-13T18:20:41.216 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.215+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=90R5P0ZS0A4E tag=1NBTLAEGDR8Q type=write size=3091946 2024-01-13T18:20:41.220 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.219+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~S9I4ILOO6QJW.0 size=242979 2024-01-13T18:20:41.221 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.219+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=S9I4ILOO6QJW tag=NI34XHNZYXBG type=write size=1291555 2024-01-13T18:20:41.222 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.221+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~IGOYA6FCXTOJ.0 size=464896 2024-01-13T18:20:41.225 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.224+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=IGOYA6FCXTOJ tag=GZBHTEP5IYX1 type=write size=1513472 2024-01-13T18:20:41.229 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.228+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~PAD0FL2DB092.0 size=747314 2024-01-13T18:20:41.229 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.228+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=PAD0FL2DB092 tag=U5XX1PZF7KQ5 type=write size=1795890 2024-01-13T18:20:41.233 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.232+0000 7f759fd04880 1 < suggested remove operation key=6GOU0WSHKUQ0 tag=IPWRFV5WRH15 type=write 2024-01-13T18:20:41.235 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.234+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=TIXOEQ5GIXC6 type=del size=4003185 2024-01-13T18:20:41.237 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.236+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=VW8Q43I3V5DE type=del 2024-01-13T18:20:41.240 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.239+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=AUVD6FHGMYG5 type=del size=2386042 2024-01-13T18:20:41.241 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.241+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~A13QFPF3QG0F.0 size=1048576 2024-01-13T18:20:41.243 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.242+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~A13QFPF3QG0F.1 size=1048576 2024-01-13T18:20:41.245 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.244+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~A13QFPF3QG0F.2 size=952215 2024-01-13T18:20:41.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.248+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=A13QFPF3QG0F tag=ENC2SKPWSNS4 type=write size=4097943 2024-01-13T18:20:41.253 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.252+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~MAROF2QN7R9X.0 size=1048576 2024-01-13T18:20:41.254 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.253+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~MAROF2QN7R9X.1 size=1048576 2024-01-13T18:20:41.256 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.255+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~MAROF2QN7R9X.2 size=986108 2024-01-13T18:20:41.256 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.255+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=MAROF2QN7R9X tag=Z3W47KUKE6IO type=write size=4131836 2024-01-13T18:20:41.258 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.257+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=ODA0HPOIXRSP type=del 2024-01-13T18:20:41.262 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.261+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~BE1OT74D22FT.0 size=1048576 2024-01-13T18:20:41.263 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.262+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~BE1OT74D22FT.1 size=1006327 2024-01-13T18:20:41.263 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.262+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=BE1OT74D22FT tag=6W790XNCDOAL type=write size=3103479 2024-01-13T18:20:41.265 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.264+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=I0QX35NZQ3MF type=del 2024-01-13T18:20:41.267 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.266+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=3TUR31CSS1W3 type=del size=991043 2024-01-13T18:20:41.269 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.268+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=YMUTDNNC2CAA type=del 2024-01-13T18:20:41.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.271+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~0Y2GV5MF8CNN.0 size=1048576 2024-01-13T18:20:41.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.273+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~0Y2GV5MF8CNN.1 size=331882 2024-01-13T18:20:41.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.273+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=0Y2GV5MF8CNN tag=YMS40OD0I8Y1 type=write size=2429034 2024-01-13T18:20:41.276 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.274+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~E455U33KXM0I.0 size=392863 2024-01-13T18:20:41.279 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.278+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=E455U33KXM0I tag=9D5PTRXZPADR type=write size=1441439 2024-01-13T18:20:41.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.281+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~3D7JLUY0H49I.0 size=428817 2024-01-13T18:20:41.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.281+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=3D7JLUY0H49I tag=51TI7YEN42EI type=write size=1477393 2024-01-13T18:20:41.284 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.283+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~4MENIISEI257.0 size=1048576 2024-01-13T18:20:41.284 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.283+0000 7f759fd04880 1 < canceled part key=_multipart_QD5GBLNCY707.2~4MENIISEI257.1 size=1048576 2024-01-13T18:20:41.287 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.286+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~4MENIISEI257.2 size=219640 2024-01-13T18:20:41.291 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.290+0000 7f759fd04880 1 < canceled multipart upload key=QD5GBLNCY707 upload=4MENIISEI257 tag=QKL8N27NPHSP type=write size=3365368 2024-01-13T18:20:41.295 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.294+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~R5TPHROGGDZ2.0 size=1048576 2024-01-13T18:20:41.297 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.296+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~R5TPHROGGDZ2.1 size=1048576 2024-01-13T18:20:41.299 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.298+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~R5TPHROGGDZ2.2 size=259925 2024-01-13T18:20:41.299 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.298+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=R5TPHROGGDZ2 tag=7ICIX886XAQV type=write size=3405653 2024-01-13T18:20:41.303 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.302+0000 7f759fd04880 1 < suggested update operation key=QKNPXHB99KVP tag=U57W4ZPTNP31 type=del size=3031043 2024-01-13T18:20:41.305 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.304+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=F2P25PJ4LG8D type=del size=811207 2024-01-13T18:20:41.309 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.308+0000 7f759fd04880 1 < suggested remove operation key=1O3XX67RKHNW tag=OPUVNW18E9QS type=del 2024-01-13T18:20:41.310 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.310+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=TSC02IGWXNO3 type=del size=3164363 2024-01-13T18:20:41.314 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.313+0000 7f759fd04880 1 < suggested update operation key=2OO7S2NBZ7M6 tag=X71T6PQORBZY type=del size=2991096 2024-01-13T18:20:41.316 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.315+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=U5NF6GU28CHY type=write size=273699 2024-01-13T18:20:41.319 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.318+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~TFMIK7M46KOW.0 size=265295 2024-01-13T18:20:41.322 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.321+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=TFMIK7M46KOW tag=3R6ZBKXHFEA0 type=write size=1313871 2024-01-13T18:20:41.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.323+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=Q5618J2AS39J type=del size=1259432 2024-01-13T18:20:41.325 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.325+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=VN8XH1XIY3VM type=del 2024-01-13T18:20:41.328 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.327+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=AZ2R1LCSO7HJ type=del size=101507 2024-01-13T18:20:41.330 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.329+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=J7B3EUSF410S type=del 2024-01-13T18:20:41.333 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.332+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~ANSK8UXR0HYX.0 size=1048576 2024-01-13T18:20:41.335 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.334+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~ANSK8UXR0HYX.1 size=602208 2024-01-13T18:20:41.335 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.334+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=ANSK8UXR0HYX tag=MCDNJU8VTGN7 type=write size=2699360 2024-01-13T18:20:41.336 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.335+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~S9I4ILOO6QJW.0 size=242979 2024-01-13T18:20:41.340 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.338+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=S9I4ILOO6QJW tag=NI34XHNZYXBG type=write size=1291555 2024-01-13T18:20:41.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.340+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=4V2FOFVHRSZ9 type=del size=2874580 2024-01-13T18:20:41.343 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.342+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~PAD0FL2DB092.0 size=747314 2024-01-13T18:20:41.346 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.345+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=PAD0FL2DB092 tag=U5XX1PZF7KQ5 type=write size=1795890 2024-01-13T18:20:41.349 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.348+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=RN32ZBG81EL6 type=del size=147539 2024-01-13T18:20:41.350 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.349+0000 7f759fd04880 1 < canceled operation key=8EWIOXN5H9KU tag=TIXOEQ5GIXC6 type=del size=4003185 2024-01-13T18:20:41.352 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.351+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=VHV0K75E1CZ6 type=write size=164837 2024-01-13T18:20:41.356 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.355+0000 7f759fd04880 1 < suggested remove operation key=EW3ZFDVIQZ7G tag=AUVD6FHGMYG5 type=del 2024-01-13T18:20:41.358 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.357+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=3CHPQXO5AOZW type=del size=539855 2024-01-13T18:20:41.358 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.357+0000 7f759fd04880 1 < canceled part key=_multipart_7LXXSKLOM1JZ.2~MAROF2QN7R9X.0 size=1048576 2024-01-13T18:20:41.360 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.359+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~MAROF2QN7R9X.1 size=1048576 2024-01-13T18:20:41.362 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.360+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~MAROF2QN7R9X.2 size=986108 2024-01-13T18:20:41.365 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.364+0000 7f759fd04880 1 < canceled multipart upload key=7LXXSKLOM1JZ upload=MAROF2QN7R9X tag=Z3W47KUKE6IO type=write size=4131836 2024-01-13T18:20:41.367 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.366+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=22GMEM7Z8EBY type=del size=3066771 2024-01-13T18:20:41.368 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.367+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~BE1OT74D22FT.0 size=1048576 2024-01-13T18:20:41.370 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.369+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~BE1OT74D22FT.1 size=1006327 2024-01-13T18:20:41.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.372+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=BE1OT74D22FT tag=6W790XNCDOAL type=write size=3103479 2024-01-13T18:20:41.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.374+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=NP087WU0LKE7 type=del size=2768579 2024-01-13T18:20:41.377 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.376+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=3TUR31CSS1W3 type=del 2024-01-13T18:20:41.379 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.378+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=FPESRY3VBZEJ type=del size=13219 2024-01-13T18:20:41.381 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.380+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~0Y2GV5MF8CNN.0 size=1048576 2024-01-13T18:20:41.383 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.382+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~0Y2GV5MF8CNN.1 size=331882 2024-01-13T18:20:41.386 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.385+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=0Y2GV5MF8CNN tag=YMS40OD0I8Y1 type=write size=2429034 2024-01-13T18:20:41.388 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.387+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=K85GR0KS3WO2 type=del size=2837663 2024-01-13T18:20:41.390 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.389+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~3D7JLUY0H49I.0 size=428817 2024-01-13T18:20:41.397 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.396+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=3D7JLUY0H49I tag=51TI7YEN42EI type=write size=1477393 2024-01-13T18:20:41.400 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.399+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=SZ3EFO3P2G1V type=del size=1760672 2024-01-13T18:20:41.403 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.402+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~R5TPHROGGDZ2.0 size=1048576 2024-01-13T18:20:41.404 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.404+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~R5TPHROGGDZ2.1 size=1048576 2024-01-13T18:20:41.406 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.405+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~R5TPHROGGDZ2.2 size=259925 2024-01-13T18:20:41.410 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.409+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=R5TPHROGGDZ2 tag=7ICIX886XAQV type=write size=3405653 2024-01-13T18:20:41.412 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.411+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=TMHKEFDYNEMZ type=write size=583738 2024-01-13T18:20:41.414 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.413+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=F2P25PJ4LG8D type=del 2024-01-13T18:20:41.416 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.415+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=W16YYVQZ5750 type=del size=382457 2024-01-13T18:20:41.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.417+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=TSC02IGWXNO3 type=del 2024-01-13T18:20:41.420 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.419+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=BY0P24IVF138 type=del size=1894050 2024-01-13T18:20:41.422 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.421+0000 7f759fd04880 1 < completed write operation key=DOXP3EJ03EBY tag=U5NF6GU28CHY type=write size=273699 2024-01-13T18:20:41.425 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.424+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~025OYFVKJAXG.0 size=1048576 2024-01-13T18:20:41.427 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.426+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~025OYFVKJAXG.1 size=1048576 2024-01-13T18:20:41.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.428+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~025OYFVKJAXG.2 size=539472 2024-01-13T18:20:41.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.428+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=025OYFVKJAXG tag=831WOHKBG79X type=write size=3685200 2024-01-13T18:20:41.433 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.432+0000 7f759fd04880 1 < suggested update operation key=H7C1UAGAUR7D tag=Q5618J2AS39J type=del size=1259432 2024-01-13T18:20:41.437 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.435+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~7C7CFVZZ2FT2.0 size=1048576 2024-01-13T18:20:41.438 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.437+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~7C7CFVZZ2FT2.1 size=1048576 2024-01-13T18:20:41.439 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.439+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~7C7CFVZZ2FT2.2 size=546971 2024-01-13T18:20:41.440 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.439+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=7C7CFVZZ2FT2 tag=EGKVE43IPU90 type=write size=3692699 2024-01-13T18:20:41.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.442+0000 7f759fd04880 1 < suggested update operation key=OMA1B74S8FXS tag=AZ2R1LCSO7HJ type=del size=101507 2024-01-13T18:20:41.445 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.445+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=T3F498LUYQGD type=del size=1025873 2024-01-13T18:20:41.448 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.447+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~ANSK8UXR0HYX.0 size=1048576 2024-01-13T18:20:41.448 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.447+0000 7f759fd04880 1 < canceled part key=_multipart_2OO7S2NBZ7M6.2~ANSK8UXR0HYX.1 size=602208 2024-01-13T18:20:41.451 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.450+0000 7f759fd04880 1 < canceled multipart upload key=2OO7S2NBZ7M6 upload=ANSK8UXR0HYX tag=MCDNJU8VTGN7 type=write size=2699360 2024-01-13T18:20:41.453 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.452+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=57H5TFA6QU0Z type=del size=1279256 2024-01-13T18:20:41.455 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.454+0000 7f759fd04880 1 < canceled operation key=1QEZO616DBC3 tag=4V2FOFVHRSZ9 type=del size=2874580 2024-01-13T18:20:41.457 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.456+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=RVT8SZOM9P44 type=del size=80981 2024-01-13T18:20:41.459 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.458+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=RN32ZBG81EL6 type=del 2024-01-13T18:20:41.461 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.460+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=JOBHQXS5YVVY type=del size=3336792 2024-01-13T18:20:41.464 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.463+0000 7f759fd04880 -1 < failed to complete operation key=EW3ZFDVIQZ7G tag=VHV0K75E1CZ6 type=write size=164837: (22) Invalid argument 2024-01-13T18:20:41.466 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.465+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=9JQ6GLFYHBG9 type=write size=647857 2024-01-13T18:20:41.468 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.467+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=3CHPQXO5AOZW type=del 2024-01-13T18:20:41.470 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.469+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=STZAFF1ZUB35 type=del size=261558 2024-01-13T18:20:41.472 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.471+0000 7f759fd04880 1 < canceled operation key=7LXXSKLOM1JZ tag=22GMEM7Z8EBY type=del size=3066771 2024-01-13T18:20:41.475 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.475+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~J980YV9OAOJ5.0 size=1048576 2024-01-13T18:20:41.477 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.476+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~J980YV9OAOJ5.1 size=1048576 2024-01-13T18:20:41.479 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.478+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~J980YV9OAOJ5.2 size=274020 2024-01-13T18:20:41.479 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.478+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=J980YV9OAOJ5 tag=GWI4PN1KC4TQ type=write size=3419748 2024-01-13T18:20:41.480 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.480+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=NP087WU0LKE7 type=del 2024-01-13T18:20:41.483 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.482+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=XK8B6I192DCM type=del size=1109205 2024-01-13T18:20:41.485 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.484+0000 7f759fd04880 1 < canceled operation key=H4VHC37BOZJ3 tag=FPESRY3VBZEJ type=del size=13219 2024-01-13T18:20:41.487 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.486+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=0AVGMY2K28LP type=del size=1852592 2024-01-13T18:20:41.488 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.487+0000 7f759fd04880 1 < canceled operation key=6GOU0WSHKUQ0 tag=K85GR0KS3WO2 type=del size=2837663 2024-01-13T18:20:41.491 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.490+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=PKGN79NOIW75 type=del size=712632 2024-01-13T18:20:41.493 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.492+0000 7f759fd04880 1 < canceled operation key=JGALONWJXLQY tag=SZ3EFO3P2G1V type=del size=1760672 2024-01-13T18:20:41.495 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.494+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=4IQWQ7I81AL8 type=write size=570087 2024-01-13T18:20:41.497 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.496+0000 7f759fd04880 1 < completed write operation key=0TIZPXX8CMHA tag=TMHKEFDYNEMZ type=write size=583738 2024-01-13T18:20:41.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.498+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=J86RWYQB4JJD type=del size=2301955 2024-01-13T18:20:41.503 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.501+0000 7f759fd04880 1 < suggested update operation key=H7C1UAGAUR7D tag=W16YYVQZ5750 type=del size=382457 2024-01-13T18:20:41.506 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.505+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~B19ED5DG5R51.0 size=1048576 2024-01-13T18:20:41.508 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.507+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~B19ED5DG5R51.1 size=349996 2024-01-13T18:20:41.508 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.507+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=B19ED5DG5R51 tag=SVMD031ODAXW type=write size=2447148 2024-01-13T18:20:41.511 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.510+0000 7f759fd04880 -1 < failed to complete operation key=H7C1UAGAUR7D tag=BY0P24IVF138 type=del size=1894050: (22) Invalid argument 2024-01-13T18:20:41.512 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.511+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=485G5ZGBNU0P type=del size=805716 2024-01-13T18:20:41.514 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.514+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~025OYFVKJAXG.0 size=1048576 2024-01-13T18:20:41.516 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.515+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~025OYFVKJAXG.1 size=1048576 2024-01-13T18:20:41.518 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.517+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~025OYFVKJAXG.2 size=539472 2024-01-13T18:20:41.521 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.520+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=025OYFVKJAXG tag=831WOHKBG79X type=write size=3685200 2024-01-13T18:20:41.524 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.522+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=9QC5BHIL07UH type=del size=3609973 2024-01-13T18:20:41.525 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.524+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~7C7CFVZZ2FT2.0 size=1048576 2024-01-13T18:20:41.527 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.526+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~7C7CFVZZ2FT2.1 size=1048576 2024-01-13T18:20:41.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.527+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~7C7CFVZZ2FT2.2 size=546971 2024-01-13T18:20:41.532 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.531+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=7C7CFVZZ2FT2 tag=EGKVE43IPU90 type=write size=3692699 2024-01-13T18:20:41.535 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.534+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~QWZZTQ94QHWC.0 size=1048576 2024-01-13T18:20:41.536 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.536+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~QWZZTQ94QHWC.1 size=1048576 2024-01-13T18:20:41.538 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.537+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~QWZZTQ94QHWC.2 size=763676 2024-01-13T18:20:41.538 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.537+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=QWZZTQ94QHWC tag=JBJ2ZSEN1LSE type=write size=3909404 2024-01-13T18:20:41.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.539+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=T3F498LUYQGD type=del 2024-01-13T18:20:41.544 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.543+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~LW4F2NPJTOGO.0 size=1048576 2024-01-13T18:20:41.545 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.544+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~LW4F2NPJTOGO.1 size=1048576 2024-01-13T18:20:41.547 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.546+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~LW4F2NPJTOGO.2 size=573095 2024-01-13T18:20:41.547 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.546+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=LW4F2NPJTOGO tag=60FNX1O53A4C type=write size=3718823 2024-01-13T18:20:41.549 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.548+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=57H5TFA6QU0Z type=del 2024-01-13T18:20:41.552 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.551+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~A0RG2T3TH6OL.0 size=781435 2024-01-13T18:20:41.552 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.551+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=A0RG2T3TH6OL tag=6Z60HWWYTMXA type=write size=1830011 2024-01-13T18:20:41.554 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.553+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=RVT8SZOM9P44 type=del 2024-01-13T18:20:41.556 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.555+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=HNOGSN292UE1 type=write size=300694 2024-01-13T18:20:41.558 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.557+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=JOBHQXS5YVVY type=del 2024-01-13T18:20:41.560 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.559+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=8FENW5N6B5FE type=del size=3488720 2024-01-13T18:20:41.562 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.561+0000 7f759fd04880 1 < completed write operation key=1O3XX67RKHNW tag=9JQ6GLFYHBG9 type=write size=647857 2024-01-13T18:20:41.566 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.565+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~J2HJL7ZDBINC.0 size=895356 2024-01-13T18:20:41.566 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.565+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=J2HJL7ZDBINC tag=6A4CBKH86MAZ type=write size=1943932 2024-01-13T18:20:41.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.566+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=STZAFF1ZUB35 type=del 2024-01-13T18:20:41.569 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.568+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=FFHDJN6KF4PW type=del size=3857490 2024-01-13T18:20:41.571 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.570+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~J980YV9OAOJ5.0 size=1048576 2024-01-13T18:20:41.573 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.572+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~J980YV9OAOJ5.1 size=1048576 2024-01-13T18:20:41.574 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.573+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~J980YV9OAOJ5.2 size=274020 2024-01-13T18:20:41.578 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.577+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=J980YV9OAOJ5 tag=GWI4PN1KC4TQ type=write size=3419748 2024-01-13T18:20:41.580 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.579+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=5CRCW05TSRE3 type=del size=670315 2024-01-13T18:20:41.581 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.580+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=XK8B6I192DCM type=del 2024-01-13T18:20:41.585 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.584+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~9OK4AQSYX7ZX.0 size=1048576 2024-01-13T18:20:41.587 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.586+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~9OK4AQSYX7ZX.1 size=900727 2024-01-13T18:20:41.587 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.586+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=9OK4AQSYX7ZX tag=I2ILVMU3262N type=write size=2997879 2024-01-13T18:20:41.589 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.588+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=0AVGMY2K28LP type=del 2024-01-13T18:20:41.591 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.590+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=JESXV0VR22P9 type=write size=341282 2024-01-13T18:20:41.592 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.591+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=PKGN79NOIW75 type=del 2024-01-13T18:20:41.596 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.595+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~2VHGO9LRF9JU.0 size=1048576 2024-01-13T18:20:41.597 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.597+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~2VHGO9LRF9JU.1 size=1048576 2024-01-13T18:20:41.599 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.598+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~2VHGO9LRF9JU.2 size=286381 2024-01-13T18:20:41.599 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.598+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=2VHGO9LRF9JU tag=CWC8C631HPVV type=write size=3432109 2024-01-13T18:20:41.601 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.600+0000 7f759fd04880 1 < completed write operation key=3K20F802EFEQ tag=4IQWQ7I81AL8 type=write size=570087 2024-01-13T18:20:41.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.602+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=97OKP6T8N5GN type=write size=261655 2024-01-13T18:20:41.604 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.603+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=J86RWYQB4JJD type=del 2024-01-13T18:20:41.608 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.607+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~P4K1626WR58F.0 size=1048576 2024-01-13T18:20:41.610 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.609+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~P4K1626WR58F.1 size=1048576 2024-01-13T18:20:41.613 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.612+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~P4K1626WR58F.2 size=90120 2024-01-13T18:20:41.613 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.612+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=P4K1626WR58F tag=L5BBB2BTARL0 type=write size=3235848 2024-01-13T18:20:41.613 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.612+0000 7f759fd04880 1 < canceled part key=_multipart_RY0W5S41XK3F.2~B19ED5DG5R51.0 size=1048576 2024-01-13T18:20:41.614 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.613+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~B19ED5DG5R51.1 size=349996 2024-01-13T18:20:41.618 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.617+0000 7f759fd04880 1 < canceled multipart upload key=RY0W5S41XK3F upload=B19ED5DG5R51 tag=SVMD031ODAXW type=write size=2447148 2024-01-13T18:20:41.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:41 smithi099 ceph-mon[138788]: pgmap v1459: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 785 KiB/s rd, 273 KiB/s wr, 1.39k op/s 2024-01-13T18:20:41.620 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.619+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=25RH5IBCWII5 type=write size=719035 2024-01-13T18:20:41.621 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.621+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=485G5ZGBNU0P type=del 2024-01-13T18:20:41.625 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.624+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~FUV7BVW7KCN6.0 size=1048576 2024-01-13T18:20:41.627 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.626+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~FUV7BVW7KCN6.1 size=515160 2024-01-13T18:20:41.627 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.626+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=FUV7BVW7KCN6 tag=H3R31JP30IUY type=write size=2612312 2024-01-13T18:20:41.628 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.627+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=9QC5BHIL07UH type=del 2024-01-13T18:20:41.630 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.629+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=MKBE47RQ5O8G type=del size=1066988 2024-01-13T18:20:41.632 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.631+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~QWZZTQ94QHWC.0 size=1048576 2024-01-13T18:20:41.634 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.633+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~QWZZTQ94QHWC.1 size=1048576 2024-01-13T18:20:41.634 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.633+0000 7f759fd04880 1 < canceled part key=_multipart_P8FMRQR7GXN7.2~QWZZTQ94QHWC.2 size=763676 2024-01-13T18:20:41.638 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.637+0000 7f759fd04880 1 < canceled multipart upload key=P8FMRQR7GXN7 upload=QWZZTQ94QHWC tag=JBJ2ZSEN1LSE type=write size=3909404 2024-01-13T18:20:41.639 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.638+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=ZV8X2MLO0BJX type=del size=3654095 2024-01-13T18:20:41.641 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.640+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~LW4F2NPJTOGO.0 size=1048576 2024-01-13T18:20:41.643 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.642+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~LW4F2NPJTOGO.1 size=1048576 2024-01-13T18:20:41.645 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.644+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~LW4F2NPJTOGO.2 size=573095 2024-01-13T18:20:41.648 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.647+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=LW4F2NPJTOGO tag=60FNX1O53A4C type=write size=3718823 2024-01-13T18:20:41.650 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.649+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=AFOJ397MS1A1 type=del size=972858 2024-01-13T18:20:41.653 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.651+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~A0RG2T3TH6OL.0 size=781435 2024-01-13T18:20:41.656 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.654+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=A0RG2T3TH6OL tag=6Z60HWWYTMXA type=write size=1830011 2024-01-13T18:20:41.658 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.656+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=DO2F5M69A9Q4 type=write size=728747 2024-01-13T18:20:41.660 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.658+0000 7f759fd04880 1 < completed write operation key=EW3ZFDVIQZ7G tag=HNOGSN292UE1 type=write size=300694 2024-01-13T18:20:41.663 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.662+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~EDRGK57AOFJ4.0 size=1048576 2024-01-13T18:20:41.664 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.663+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~EDRGK57AOFJ4.1 size=557874 2024-01-13T18:20:41.664 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.663+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=EDRGK57AOFJ4 tag=VLYOVPIBIFII type=write size=2655026 2024-01-13T18:20:41.668 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.667+0000 7f759fd04880 1 < suggested update operation key=0TIZPXX8CMHA tag=8FENW5N6B5FE type=del size=3488720 2024-01-13T18:20:41.672 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.671+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~2LOH8Y2GH5CX.0 size=940484 2024-01-13T18:20:41.672 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.671+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=2LOH8Y2GH5CX tag=0DUS2TQWZPCT type=write size=1989060 2024-01-13T18:20:41.674 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.673+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~J2HJL7ZDBINC.0 size=895356 2024-01-13T18:20:41.677 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.676+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=J2HJL7ZDBINC tag=6A4CBKH86MAZ type=write size=1943932 2024-01-13T18:20:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:41 smithi084 ceph-mon[116404]: pgmap v1459: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 785 KiB/s rd, 273 KiB/s wr, 1.39k op/s 2024-01-13T18:20:41.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:41 smithi084 ceph-mon[119097]: pgmap v1459: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 785 KiB/s rd, 273 KiB/s wr, 1.39k op/s 2024-01-13T18:20:41.679 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.678+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=7CTJM2EX61UF type=del size=3219602 2024-01-13T18:20:41.681 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.680+0000 7f759fd04880 1 < canceled operation key=JGALONWJXLQY tag=FFHDJN6KF4PW type=del size=3857490 2024-01-13T18:20:41.683 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.682+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=H6GMF1ODRRC0 type=del size=34173 2024-01-13T18:20:41.685 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.684+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=5CRCW05TSRE3 type=del 2024-01-13T18:20:41.687 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.686+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=SC7VKG84IF7Z type=write size=393545 2024-01-13T18:20:41.689 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.688+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~9OK4AQSYX7ZX.0 size=1048576 2024-01-13T18:20:41.690 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.689+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~9OK4AQSYX7ZX.1 size=900727 2024-01-13T18:20:41.693 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.692+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=9OK4AQSYX7ZX tag=I2ILVMU3262N type=write size=2997879 2024-01-13T18:20:41.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.696+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~C30FJFNL8AN3.0 size=730408 2024-01-13T18:20:41.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.696+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=C30FJFNL8AN3 tag=X92HL8VR0LDO type=write size=1778984 2024-01-13T18:20:41.699 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.698+0000 7f759fd04880 1 < completed write operation key=EW3ZFDVIQZ7G tag=JESXV0VR22P9 type=write size=341282 2024-01-13T18:20:41.702 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.702+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~FL52LNL9L8AY.0 size=1048576 2024-01-13T18:20:41.704 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.703+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~FL52LNL9L8AY.1 size=63926 2024-01-13T18:20:41.704 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.703+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=FL52LNL9L8AY tag=HQ2PT4YOEC1W type=write size=2161078 2024-01-13T18:20:41.706 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.705+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~2VHGO9LRF9JU.0 size=1048576 2024-01-13T18:20:41.709 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.707+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~2VHGO9LRF9JU.1 size=1048576 2024-01-13T18:20:41.709 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.707+0000 7f759fd04880 1 < canceled part key=_multipart_QKNPXHB99KVP.2~2VHGO9LRF9JU.2 size=286381 2024-01-13T18:20:41.712 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.710+0000 7f759fd04880 1 < canceled multipart upload key=QKNPXHB99KVP upload=2VHGO9LRF9JU tag=CWC8C631HPVV type=write size=3432109 2024-01-13T18:20:41.713 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.712+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=K00HK89GZ1Z0 type=del size=1148813 2024-01-13T18:20:41.716 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.715+0000 7f759fd04880 1 < completed write operation key=BPUBFFWB9D3C tag=97OKP6T8N5GN type=write size=261655 2024-01-13T18:20:41.719 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.718+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~0V56LEF1P0VO.0 size=1048576 2024-01-13T18:20:41.721 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.720+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~0V56LEF1P0VO.1 size=1048576 2024-01-13T18:20:41.723 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.721+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~0V56LEF1P0VO.2 size=788191 2024-01-13T18:20:41.723 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.721+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=0V56LEF1P0VO tag=3HVX1I5HR3P2 type=write size=3933919 2024-01-13T18:20:41.725 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.724+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~P4K1626WR58F.0 size=1048576 2024-01-13T18:20:41.727 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.726+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~P4K1626WR58F.1 size=1048576 2024-01-13T18:20:41.729 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.728+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~P4K1626WR58F.2 size=90120 2024-01-13T18:20:41.733 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.732+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=P4K1626WR58F tag=L5BBB2BTARL0 type=write size=3235848 2024-01-13T18:20:41.737 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.736+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~ICBD4A0Z9KBO.0 size=1048576 2024-01-13T18:20:41.738 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.737+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~ICBD4A0Z9KBO.1 size=1048576 2024-01-13T18:20:41.740 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.739+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~ICBD4A0Z9KBO.2 size=120038 2024-01-13T18:20:41.740 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.739+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=ICBD4A0Z9KBO tag=1F6Y1P3KPQWP type=write size=3265766 2024-01-13T18:20:41.742 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.741+0000 7f759fd04880 1 < completed write operation key=H7C1UAGAUR7D tag=25RH5IBCWII5 type=write size=719035 2024-01-13T18:20:41.744 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.743+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=SSYU1Z4P288N type=del size=1873482 2024-01-13T18:20:41.746 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.745+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~FUV7BVW7KCN6.0 size=1048576 2024-01-13T18:20:41.746 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.745+0000 7f759fd04880 1 < canceled part key=_multipart_6GOU0WSHKUQ0.2~FUV7BVW7KCN6.1 size=515160 2024-01-13T18:20:41.750 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.749+0000 7f759fd04880 1 < canceled multipart upload key=6GOU0WSHKUQ0 upload=FUV7BVW7KCN6 tag=H3R31JP30IUY type=write size=2612312 2024-01-13T18:20:41.754 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.753+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~5BUVZH4HTYNO.0 size=979936 2024-01-13T18:20:41.754 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.753+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=5BUVZH4HTYNO tag=5PK93HIQQMLC type=write size=2028512 2024-01-13T18:20:41.756 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.755+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=MKBE47RQ5O8G type=del 2024-01-13T18:20:41.759 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.758+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=J4R1AIWD9Y88 type=del size=3209143 2024-01-13T18:20:41.762 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.762+0000 7f759fd04880 1 < suggested remove operation key=6GOU0WSHKUQ0 tag=ZV8X2MLO0BJX type=del 2024-01-13T18:20:41.765 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.764+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=3ORJLF3XH97Q type=del size=1147391 2024-01-13T18:20:41.767 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.766+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=AFOJ397MS1A1 type=del 2024-01-13T18:20:41.771 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.770+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~Y36IJJ5NR57L.0 size=560228 2024-01-13T18:20:41.771 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.770+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=Y36IJJ5NR57L tag=8HUR2LIWXB1S type=write size=1608804 2024-01-13T18:20:41.773 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.772+0000 7f759fd04880 1 < canceled operation key=3K20F802EFEQ tag=DO2F5M69A9Q4 type=write size=728747 2024-01-13T18:20:41.775 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.774+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=6EB534WJP9Z8 type=write size=153649 2024-01-13T18:20:41.777 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.776+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~EDRGK57AOFJ4.0 size=1048576 2024-01-13T18:20:41.779 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.778+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~EDRGK57AOFJ4.1 size=557874 2024-01-13T18:20:41.783 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.782+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=EDRGK57AOFJ4 tag=VLYOVPIBIFII type=write size=2655026 2024-01-13T18:20:41.785 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.784+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=M92LE0Q2N6I0 type=del size=3838765 2024-01-13T18:20:41.788 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.787+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~2LOH8Y2GH5CX.0 size=940484 2024-01-13T18:20:41.791 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.790+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=2LOH8Y2GH5CX tag=0DUS2TQWZPCT type=write size=1989060 2024-01-13T18:20:41.793 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.792+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=OB3BPDSJXR7E type=del size=2870778 2024-01-13T18:20:41.796 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.795+0000 7f759fd04880 1 < canceled operation key=ZI9WAZQHVPAR tag=7CTJM2EX61UF type=del size=3219602 2024-01-13T18:20:41.800 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.799+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~2F6CLYOR1ZLO.0 size=1048576 2024-01-13T18:20:41.801 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.800+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~2F6CLYOR1ZLO.1 size=1048576 2024-01-13T18:20:41.803 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.802+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~2F6CLYOR1ZLO.2 size=1038218 2024-01-13T18:20:41.803 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.802+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=2F6CLYOR1ZLO tag=IDECPF557QWG type=write size=4183946 2024-01-13T18:20:41.805 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.804+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=H6GMF1ODRRC0 type=del 2024-01-13T18:20:41.807 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.807+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=2PVXX0FEEK7B type=write size=192944 2024-01-13T18:20:41.810 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.809+0000 7f759fd04880 1 < completed write operation key=7WRTM9ANJRT4 tag=SC7VKG84IF7Z type=write size=393545 2024-01-13T18:20:41.812 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.811+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=HS5QOX0JLLHC type=del size=1206116 2024-01-13T18:20:41.814 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.813+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~C30FJFNL8AN3.0 size=730408 2024-01-13T18:20:41.818 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.817+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=C30FJFNL8AN3 tag=X92HL8VR0LDO type=write size=1778984 2024-01-13T18:20:41.820 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.819+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=PHNXLSUT4JVK type=del size=2000208 2024-01-13T18:20:41.823 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.821+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~FL52LNL9L8AY.0 size=1048576 2024-01-13T18:20:41.824 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.823+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~FL52LNL9L8AY.1 size=63926 2024-01-13T18:20:41.828 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.827+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=FL52LNL9L8AY tag=HQ2PT4YOEC1W type=write size=2161078 2024-01-13T18:20:41.830 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.829+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=LLOD5WM6OLC5 type=del size=1591436 2024-01-13T18:20:41.831 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.831+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=K00HK89GZ1Z0 type=del 2024-01-13T18:20:41.834 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.833+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=PCUV5H01BWN5 type=del size=2695561 2024-01-13T18:20:41.836 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.835+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~0V56LEF1P0VO.0 size=1048576 2024-01-13T18:20:41.838 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.837+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~0V56LEF1P0VO.1 size=1048576 2024-01-13T18:20:41.840 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.839+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~0V56LEF1P0VO.2 size=788191 2024-01-13T18:20:41.843 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.842+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=0V56LEF1P0VO tag=3HVX1I5HR3P2 type=write size=3933919 2024-01-13T18:20:41.845 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.844+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=1HKBMDAILX4O type=del size=2970777 2024-01-13T18:20:41.847 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.846+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~ICBD4A0Z9KBO.0 size=1048576 2024-01-13T18:20:41.848 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.846+0000 7f759fd04880 1 < canceled part key=_multipart_DOXP3EJ03EBY.2~ICBD4A0Z9KBO.1 size=1048576 2024-01-13T18:20:41.848 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.846+0000 7f759fd04880 1 < canceled part key=_multipart_DOXP3EJ03EBY.2~ICBD4A0Z9KBO.2 size=120038 2024-01-13T18:20:41.851 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.850+0000 7f759fd04880 1 < canceled multipart upload key=DOXP3EJ03EBY upload=ICBD4A0Z9KBO tag=1F6Y1P3KPQWP type=write size=3265766 2024-01-13T18:20:41.853 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.852+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=2IVKBU8SZMDN type=del size=2376197 2024-01-13T18:20:41.855 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.854+0000 7f759fd04880 1 < canceled operation key=JGALONWJXLQY tag=SSYU1Z4P288N type=del size=1873482 2024-01-13T18:20:41.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.856+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=BLWM2KHSJNBL type=del size=416086 2024-01-13T18:20:41.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.856+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~5BUVZH4HTYNO.0 size=979936 2024-01-13T18:20:41.861 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.860+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=5BUVZH4HTYNO tag=5PK93HIQQMLC type=write size=2028512 2024-01-13T18:20:41.864 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.863+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~VYXZS3FC8RRC.0 size=1048576 2024-01-13T18:20:41.866 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.865+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~VYXZS3FC8RRC.1 size=665882 2024-01-13T18:20:41.866 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.865+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=VYXZS3FC8RRC tag=V235RZARP91Z type=write size=2763034 2024-01-13T18:20:41.871 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.870+0000 7f759fd04880 1 < suggested update operation key=1O3XX67RKHNW tag=J4R1AIWD9Y88 type=del size=3209143 2024-01-13T18:20:41.874 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.873+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~5BNPNWUQCOOS.0 size=1048576 2024-01-13T18:20:41.876 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.875+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~5BNPNWUQCOOS.1 size=1048576 2024-01-13T18:20:41.878 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.877+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~5BNPNWUQCOOS.2 size=638327 2024-01-13T18:20:41.878 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.877+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=5BNPNWUQCOOS tag=PA6LPY2MHCZD type=write size=3784055 2024-01-13T18:20:41.880 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.879+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=3ORJLF3XH97Q type=del 2024-01-13T18:20:41.884 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.883+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~Y5KT3H95F3WX.0 size=523578 2024-01-13T18:20:41.884 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.883+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=Y5KT3H95F3WX tag=1WVVWV0P2JG7 type=write size=1572154 2024-01-13T18:20:41.886 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.885+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~Y36IJJ5NR57L.0 size=560228 2024-01-13T18:20:41.889 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.888+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=Y36IJJ5NR57L tag=8HUR2LIWXB1S type=write size=1608804 2024-01-13T18:20:41.891 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.890+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=A9BNYS72WQ3R type=del size=806719 2024-01-13T18:20:41.895 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.894+0000 7f759fd04880 1 < suggested remove operation key=1O3XX67RKHNW tag=6EB534WJP9Z8 type=write 2024-01-13T18:20:41.898 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.897+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~ZNSPS1VXVD36.0 size=431579 2024-01-13T18:20:41.898 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.897+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=ZNSPS1VXVD36 tag=LV0OM6DBN17Q type=write size=1480155 2024-01-13T18:20:41.900 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.899+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=M92LE0Q2N6I0 type=del 2024-01-13T18:20:41.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.903+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~WKSX4JRXOMGH.0 size=1048576 2024-01-13T18:20:41.905 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.904+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~WKSX4JRXOMGH.1 size=259032 2024-01-13T18:20:41.905 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.904+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=WKSX4JRXOMGH tag=TOQPCMWL57HA type=write size=2356184 2024-01-13T18:20:41.907 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.906+0000 7f759fd04880 1 < canceled operation key=H4VHC37BOZJ3 tag=OB3BPDSJXR7E type=del size=2870778 2024-01-13T18:20:41.909 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.908+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=77RXY5PYDXW9 type=del size=1982205 2024-01-13T18:20:41.912 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.911+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~2F6CLYOR1ZLO.0 size=1048576 2024-01-13T18:20:41.915 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.912+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~2F6CLYOR1ZLO.1 size=1048576 2024-01-13T18:20:41.915 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.914+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~2F6CLYOR1ZLO.2 size=1038218 2024-01-13T18:20:41.919 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.918+0000 7f759fd04880 1 < completed multipart upload key=7R5YIO7UFSDZ upload=2F6CLYOR1ZLO tag=IDECPF557QWG type=write size=4183946 2024-01-13T18:20:41.923 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.922+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~A90AJC3SGZK3.0 size=1048576 2024-01-13T18:20:41.924 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.923+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~A90AJC3SGZK3.1 size=1048576 2024-01-13T18:20:41.926 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.925+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~A90AJC3SGZK3.2 size=461167 2024-01-13T18:20:41.926 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.925+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=A90AJC3SGZK3 tag=DK8ZOS5H1UU9 type=write size=3606895 2024-01-13T18:20:41.928 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.927+0000 7f759fd04880 1 < completed write operation key=VZHGQM6ZNJYQ tag=2PVXX0FEEK7B type=write size=192944 2024-01-13T18:20:41.930 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.929+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=3LH882HD5UBX type=del size=3113503 2024-01-13T18:20:41.933 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.931+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=HS5QOX0JLLHC type=del 2024-01-13T18:20:41.934 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.933+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=QL0RV7SHTEBC type=del size=1623877 2024-01-13T18:20:41.936 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.935+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=PHNXLSUT4JVK type=del 2024-01-13T18:20:41.938 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.937+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=0M8V77HMVRP7 type=del size=1643682 2024-01-13T18:20:41.940 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.939+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=LLOD5WM6OLC5 type=del 2024-01-13T18:20:41.942 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.941+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=SO67J1WIA1ST type=del size=3055728 2024-01-13T18:20:41.944 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.943+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=PCUV5H01BWN5 type=del 2024-01-13T18:20:41.945 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.944+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=FJIKMYYXY7P7 type=del size=1007937 2024-01-13T18:20:41.947 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.946+0000 7f759fd04880 1 < canceled operation key=QS9PLJKINY4R tag=1HKBMDAILX4O type=del size=2970777 2024-01-13T18:20:41.949 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.948+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=MVKZQM0OV0D4 type=del size=377907 2024-01-13T18:20:41.951 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.950+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=2IVKBU8SZMDN type=del 2024-01-13T18:20:41.953 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.952+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=PO3PP98653MP type=del size=3978633 2024-01-13T18:20:41.955 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.954+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=BLWM2KHSJNBL type=del 2024-01-13T18:20:41.957 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.956+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=3PTYPN9KCT3A type=write size=716320 2024-01-13T18:20:41.959 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.958+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~VYXZS3FC8RRC.0 size=1048576 2024-01-13T18:20:41.961 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.960+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~VYXZS3FC8RRC.1 size=665882 2024-01-13T18:20:41.965 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.964+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=VYXZS3FC8RRC tag=V235RZARP91Z type=write size=2763034 2024-01-13T18:20:41.967 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.966+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=JEAV3C33S619 type=del size=3237022 2024-01-13T18:20:41.969 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.968+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~5BNPNWUQCOOS.0 size=1048576 2024-01-13T18:20:41.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.970+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~5BNPNWUQCOOS.1 size=1048576 2024-01-13T18:20:41.972 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.971+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~5BNPNWUQCOOS.2 size=638327 2024-01-13T18:20:41.976 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.975+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=5BNPNWUQCOOS tag=PA6LPY2MHCZD type=write size=3784055 2024-01-13T18:20:41.979 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.978+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~1IQI3WPCWAN0.0 size=1019985 2024-01-13T18:20:41.979 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.978+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=1IQI3WPCWAN0 tag=OB9GZQR1MOQU type=write size=2068561 2024-01-13T18:20:41.981 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.980+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~Y5KT3H95F3WX.0 size=523578 2024-01-13T18:20:41.985 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.984+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=Y5KT3H95F3WX tag=1WVVWV0P2JG7 type=write size=1572154 2024-01-13T18:20:41.987 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.986+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=DL6QM1ELWVFN type=del size=4042838 2024-01-13T18:20:41.988 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.988+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=A9BNYS72WQ3R type=del 2024-01-13T18:20:41.990 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.989+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=RJ2QXBHPQIDE type=del size=3864438 2024-01-13T18:20:41.992 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.991+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~ZNSPS1VXVD36.0 size=431579 2024-01-13T18:20:41.995 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.994+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=ZNSPS1VXVD36 tag=LV0OM6DBN17Q type=write size=1480155 2024-01-13T18:20:41.999 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.998+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~YG8G23NJYFCZ.0 size=645329 2024-01-13T18:20:41.999 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.998+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=YG8G23NJYFCZ tag=TXQY6YOU8RNC type=write size=1693905 2024-01-13T18:20:42.000 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:41.999+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~WKSX4JRXOMGH.0 size=1048576 2024-01-13T18:20:42.002 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.001+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~WKSX4JRXOMGH.1 size=259032 2024-01-13T18:20:42.006 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.005+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=WKSX4JRXOMGH tag=TOQPCMWL57HA type=write size=2356184 2024-01-13T18:20:42.008 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.007+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=4KTOZH7SD12W type=del size=3626542 2024-01-13T18:20:42.010 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.009+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=77RXY5PYDXW9 type=del 2024-01-13T18:20:42.012 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.011+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=QTY48NPADK4D type=del size=1687069 2024-01-13T18:20:42.012 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.011+0000 7f759fd04880 1 < canceled part key=_multipart_EW3ZFDVIQZ7G.2~A90AJC3SGZK3.0 size=1048576 2024-01-13T18:20:42.014 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.013+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~A90AJC3SGZK3.1 size=1048576 2024-01-13T18:20:42.016 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.015+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~A90AJC3SGZK3.2 size=461167 2024-01-13T18:20:42.019 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.018+0000 7f759fd04880 1 < canceled multipart upload key=EW3ZFDVIQZ7G upload=A90AJC3SGZK3 tag=DK8ZOS5H1UU9 type=write size=3606895 2024-01-13T18:20:42.024 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.023+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~Q32X4M3H9HQP.0 size=1048576 2024-01-13T18:20:42.026 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.025+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~Q32X4M3H9HQP.1 size=1048576 2024-01-13T18:20:42.028 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.026+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~Q32X4M3H9HQP.2 size=552643 2024-01-13T18:20:42.028 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.026+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=Q32X4M3H9HQP tag=6IRR62UUKSJS type=write size=3698371 2024-01-13T18:20:42.029 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.028+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=3LH882HD5UBX type=del 2024-01-13T18:20:42.033 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.032+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~LWD68NQSENU3.0 size=1048576 2024-01-13T18:20:42.034 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.034+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~LWD68NQSENU3.1 size=1048576 2024-01-13T18:20:42.036 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.035+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~LWD68NQSENU3.2 size=123566 2024-01-13T18:20:42.036 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.035+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=LWD68NQSENU3 tag=3WLKY582XQDE type=write size=3269294 2024-01-13T18:20:42.038 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.037+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=QL0RV7SHTEBC type=del 2024-01-13T18:20:42.041 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.039+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=U75T23RDUY13 type=del size=957177 2024-01-13T18:20:42.042 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.041+0000 7f759fd04880 1 < canceled operation key=QKNPXHB99KVP tag=0M8V77HMVRP7 type=del size=1643682 2024-01-13T18:20:42.046 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.045+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~RCOSFEQIJLEL.0 size=994545 2024-01-13T18:20:42.046 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.045+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=RCOSFEQIJLEL tag=4FNXN9TIIWKY type=write size=2043121 2024-01-13T18:20:42.048 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.047+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=SO67J1WIA1ST type=del 2024-01-13T18:20:42.050 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.049+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=LBOSWHCNDMQQ type=del size=312941 2024-01-13T18:20:42.052 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.051+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=FJIKMYYXY7P7 type=del 2024-01-13T18:20:42.055 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.054+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~LTTJWZQS1Y66.0 size=262520 2024-01-13T18:20:42.056 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.054+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=LTTJWZQS1Y66 tag=35PZIE8CPNOG type=write size=1311096 2024-01-13T18:20:42.058 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.057+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=MVKZQM0OV0D4 type=del 2024-01-13T18:20:42.061 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.060+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~WTS82J1TBLWQ.0 size=45070 2024-01-13T18:20:42.061 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.060+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=WTS82J1TBLWQ tag=IXJRHAJ89JN5 type=write size=1093646 2024-01-13T18:20:42.064 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.063+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=PO3PP98653MP type=del 2024-01-13T18:20:42.066 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.065+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=V3XIU4SB792R type=write size=453260 2024-01-13T18:20:42.068 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.067+0000 7f759fd04880 1 < completed write operation key=QKNPXHB99KVP tag=3PTYPN9KCT3A type=write size=716320 2024-01-13T18:20:42.072 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.071+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~HC1QU0PGPHKD.0 size=87108 2024-01-13T18:20:42.072 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.071+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=HC1QU0PGPHKD tag=Z5UP7X8FHIKA type=write size=1135684 2024-01-13T18:20:42.073 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.072+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=JEAV3C33S619 type=del 2024-01-13T18:20:42.076 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.075+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=JRB8BCQ7RMXM type=del size=2806160 2024-01-13T18:20:42.078 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.077+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~1IQI3WPCWAN0.0 size=1019985 2024-01-13T18:20:42.081 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.080+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=1IQI3WPCWAN0 tag=OB9GZQR1MOQU type=write size=2068561 2024-01-13T18:20:42.083 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.082+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=2OV0DIY52A8Y type=del size=759897 2024-01-13T18:20:42.085 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.084+0000 7f759fd04880 1 < canceled operation key=QS9PLJKINY4R tag=DL6QM1ELWVFN type=del size=4042838 2024-01-13T18:20:42.087 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.086+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=PR03VETWJK5M type=del size=1748476 2024-01-13T18:20:42.088 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.088+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=RJ2QXBHPQIDE type=del 2024-01-13T18:20:42.091 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.089+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=THPVC9QXFMPF type=del size=680381 2024-01-13T18:20:42.091 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.090+0000 7f759fd04880 1 < canceled part key=_multipart_1YNH6QHP354U.2~YG8G23NJYFCZ.0 size=645329 2024-01-13T18:20:42.094 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.093+0000 7f759fd04880 1 < canceled multipart upload key=1YNH6QHP354U upload=YG8G23NJYFCZ tag=TXQY6YOU8RNC type=write size=1693905 2024-01-13T18:20:42.098 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.097+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~9AYO283NT1MI.0 size=1048576 2024-01-13T18:20:42.100 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.099+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~9AYO283NT1MI.1 size=266039 2024-01-13T18:20:42.100 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.099+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=9AYO283NT1MI tag=GL1ZFTB7841A type=write size=2363191 2024-01-13T18:20:42.102 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.101+0000 7f759fd04880 1 < canceled operation key=7WRTM9ANJRT4 tag=4KTOZH7SD12W type=del size=3626542 2024-01-13T18:20:42.104 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.103+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=94PI6YGH3TKS type=del size=3403639 2024-01-13T18:20:42.106 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.105+0000 7f759fd04880 1 < canceled operation key=WSRJB811XCVL tag=QTY48NPADK4D type=del size=1687069 2024-01-13T18:20:42.110 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.109+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~3EKY9ANGWKGV.0 size=1048576 2024-01-13T18:20:42.111 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.110+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~3EKY9ANGWKGV.1 size=979174 2024-01-13T18:20:42.111 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.110+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=3EKY9ANGWKGV tag=SEPMQ1593S3W type=write size=3076326 2024-01-13T18:20:42.111 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.110+0000 7f759fd04880 1 < canceled part key=_multipart_1WSQNY2NDY3K.2~Q32X4M3H9HQP.0 size=1048576 2024-01-13T18:20:42.113 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.112+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~Q32X4M3H9HQP.1 size=1048576 2024-01-13T18:20:42.115 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.114+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~Q32X4M3H9HQP.2 size=552643 2024-01-13T18:20:42.118 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.117+0000 7f759fd04880 1 < canceled multipart upload key=1WSQNY2NDY3K upload=Q32X4M3H9HQP tag=6IRR62UUKSJS type=write size=3698371 2024-01-13T18:20:42.120 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.119+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=CUH707GEK58W type=del size=2311163 2024-01-13T18:20:42.122 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.121+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~LWD68NQSENU3.0 size=1048576 2024-01-13T18:20:42.124 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.123+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~LWD68NQSENU3.1 size=1048576 2024-01-13T18:20:42.125 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.124+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~LWD68NQSENU3.2 size=123566 2024-01-13T18:20:42.129 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.128+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=LWD68NQSENU3 tag=3WLKY582XQDE type=write size=3269294 2024-01-13T18:20:42.131 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.130+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=AFHG5H8D4XMR type=del size=2080483 2024-01-13T18:20:42.133 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.132+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=U75T23RDUY13 type=del 2024-01-13T18:20:42.136 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.135+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~DA9UG8OL5ML6.0 size=701454 2024-01-13T18:20:42.136 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.135+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=DA9UG8OL5ML6 tag=FRXJPJUU9KW1 type=write size=1750030 2024-01-13T18:20:42.139 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.138+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~RCOSFEQIJLEL.0 size=994545 2024-01-13T18:20:42.142 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.141+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=RCOSFEQIJLEL tag=4FNXN9TIIWKY type=write size=2043121 2024-01-13T18:20:42.144 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.143+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=LUNT5BJ1E1BS type=del size=2747166 2024-01-13T18:20:42.146 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.145+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=LBOSWHCNDMQQ type=del 2024-01-13T18:20:42.149 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.148+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=TXCCMUGIEL21 type=del size=487970 2024-01-13T18:20:42.151 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.150+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~LTTJWZQS1Y66.0 size=262520 2024-01-13T18:20:42.154 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.153+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=LTTJWZQS1Y66 tag=35PZIE8CPNOG type=write size=1311096 2024-01-13T18:20:42.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.155+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=31HEH0ZN34VX type=del size=3309685 2024-01-13T18:20:42.159 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.158+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~WTS82J1TBLWQ.0 size=45070 2024-01-13T18:20:42.162 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.161+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=WTS82J1TBLWQ tag=IXJRHAJ89JN5 type=write size=1093646 2024-01-13T18:20:42.166 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.165+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~X9AQ1X5RJUZT.0 size=1048576 2024-01-13T18:20:42.168 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.167+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~X9AQ1X5RJUZT.1 size=1048576 2024-01-13T18:20:42.170 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.169+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~X9AQ1X5RJUZT.2 size=937442 2024-01-13T18:20:42.170 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.169+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=X9AQ1X5RJUZT tag=JWZWZZN9SN16 type=write size=4083170 2024-01-13T18:20:42.172 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.171+0000 7f759fd04880 1 < completed write operation key=7WRTM9ANJRT4 tag=V3XIU4SB792R type=write size=453260 2024-01-13T18:20:42.176 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.175+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~RBE1HG2U54TZ.0 size=1048576 2024-01-13T18:20:42.178 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.177+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~RBE1HG2U54TZ.1 size=1048576 2024-01-13T18:20:42.179 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.178+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~RBE1HG2U54TZ.2 size=907842 2024-01-13T18:20:42.179 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.178+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=RBE1HG2U54TZ tag=I6T8MATWUKHV type=write size=4053570 2024-01-13T18:20:42.181 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.180+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~HC1QU0PGPHKD.0 size=87108 2024-01-13T18:20:42.184 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.184+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=HC1QU0PGPHKD tag=Z5UP7X8FHIKA type=write size=1135684 2024-01-13T18:20:42.187 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.185+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=BV73JAJN6FR7 type=write size=262307 2024-01-13T18:20:42.189 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.188+0000 7f759fd04880 1 < canceled operation key=2OO7S2NBZ7M6 tag=JRB8BCQ7RMXM type=del size=2806160 2024-01-13T18:20:42.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.190+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=C84EK3JH76JW type=del size=2690986 2024-01-13T18:20:42.193 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.192+0000 7f759fd04880 1 < completed delete operation key=QKNPXHB99KVP tag=2OV0DIY52A8Y type=del 2024-01-13T18:20:42.196 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.195+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~EFPGZNRZ7B6Y.0 size=191964 2024-01-13T18:20:42.196 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.195+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=EFPGZNRZ7B6Y tag=9LXIH9C3X3II type=write size=1240540 2024-01-13T18:20:42.200 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.199+0000 7f759fd04880 1 < suggested remove operation key=QKNPXHB99KVP tag=PR03VETWJK5M type=del 2024-01-13T18:20:42.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.203+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~5JGP3GNAM5Y6.0 size=456971 2024-01-13T18:20:42.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.203+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=5JGP3GNAM5Y6 tag=GJXIVAHMO0Q6 type=write size=1505547 2024-01-13T18:20:42.206 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.205+0000 7f759fd04880 1 < canceled operation key=7WRTM9ANJRT4 tag=THPVC9QXFMPF type=del size=680381 2024-01-13T18:20:42.210 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.209+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~3IWDZK429821.0 size=1048576 2024-01-13T18:20:42.212 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.211+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~3IWDZK429821.1 size=1048576 2024-01-13T18:20:42.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.212+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~3IWDZK429821.2 size=423739 2024-01-13T18:20:42.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.212+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=3IWDZK429821 tag=WBI9A5NL7QBM type=write size=3569467 2024-01-13T18:20:42.215 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.214+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~9AYO283NT1MI.0 size=1048576 2024-01-13T18:20:42.217 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.216+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~9AYO283NT1MI.1 size=266039 2024-01-13T18:20:42.220 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.219+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=9AYO283NT1MI tag=GL1ZFTB7841A type=write size=2363191 2024-01-13T18:20:42.222 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.221+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=PNJ24X3E5KY9 type=del size=2780641 2024-01-13T18:20:42.224 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.223+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=94PI6YGH3TKS type=del 2024-01-13T18:20:42.226 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.225+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=Y6R6BFS0FAE2 type=del size=259623 2024-01-13T18:20:42.228 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.227+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~3EKY9ANGWKGV.0 size=1048576 2024-01-13T18:20:42.230 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.229+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~3EKY9ANGWKGV.1 size=979174 2024-01-13T18:20:42.234 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.233+0000 7f759fd04880 1 < completed multipart upload key=OMA1B74S8FXS upload=3EKY9ANGWKGV tag=SEPMQ1593S3W type=write size=3076326 2024-01-13T18:20:42.236 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.235+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=IB6GE2DTIHLQ type=del size=2323960 2024-01-13T18:20:42.236 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.235+0000 7f759fd04880 -1 < no bi entry to suggest for operation key=QKNPXHB99KVP tag=CUH707GEK58W type=del size=2311163: (2) No such file or directory 2024-01-13T18:20:42.238 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.237+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=LUPUK5L7NXBV type=del size=2495576 2024-01-13T18:20:42.240 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.239+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=AFHG5H8D4XMR type=del 2024-01-13T18:20:42.243 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.243+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~GM7H4O5R8OCR.0 size=1048576 2024-01-13T18:20:42.246 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.245+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~GM7H4O5R8OCR.1 size=1019952 2024-01-13T18:20:42.246 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.245+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=GM7H4O5R8OCR tag=I8AUL580069A type=write size=3117104 2024-01-13T18:20:42.248 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.247+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~DA9UG8OL5ML6.0 size=701454 2024-01-13T18:20:42.251 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.250+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=DA9UG8OL5ML6 tag=FRXJPJUU9KW1 type=write size=1750030 2024-01-13T18:20:42.255 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.254+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~75S4LHX4F4ZY.0 size=1048576 2024-01-13T18:20:42.257 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.256+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~75S4LHX4F4ZY.1 size=702672 2024-01-13T18:20:42.257 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.256+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=75S4LHX4F4ZY tag=MC3NS3PT6IN5 type=write size=2799824 2024-01-13T18:20:42.260 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.259+0000 7f759fd04880 1 < suggested remove operation key=7WRTM9ANJRT4 tag=LUNT5BJ1E1BS type=del 2024-01-13T18:20:42.264 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.263+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~20FIKUIJ6LRU.0 size=447132 2024-01-13T18:20:42.264 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.263+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=20FIKUIJ6LRU tag=ZHQMSBNCSDVM type=write size=1495708 2024-01-13T18:20:42.266 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.265+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=TXCCMUGIEL21 type=del 2024-01-13T18:20:42.268 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.267+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=4YLLPBHDRX2M type=del size=71166 2024-01-13T18:20:42.270 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.269+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=31HEH0ZN34VX type=del 2024-01-13T18:20:42.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.273+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~Y3F27Z51UGJX.0 size=41345 2024-01-13T18:20:42.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.273+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=Y3F27Z51UGJX tag=RJUC8PG3O4GU type=write size=1089921 2024-01-13T18:20:42.276 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.275+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~X9AQ1X5RJUZT.0 size=1048576 2024-01-13T18:20:42.278 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.277+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~X9AQ1X5RJUZT.1 size=1048576 2024-01-13T18:20:42.280 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.279+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~X9AQ1X5RJUZT.2 size=937442 2024-01-13T18:20:42.284 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.283+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=X9AQ1X5RJUZT tag=JWZWZZN9SN16 type=write size=4083170 2024-01-13T18:20:42.286 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.285+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=P5D9A7Y3EJLO type=del size=2715680 2024-01-13T18:20:42.288 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.287+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~RBE1HG2U54TZ.0 size=1048576 2024-01-13T18:20:42.290 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.289+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~RBE1HG2U54TZ.1 size=1048576 2024-01-13T18:20:42.292 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.291+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~RBE1HG2U54TZ.2 size=907842 2024-01-13T18:20:42.296 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.295+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=RBE1HG2U54TZ tag=I6T8MATWUKHV type=write size=4053570 2024-01-13T18:20:42.300 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.299+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~7EU1FPD7MS0H.0 size=1048576 2024-01-13T18:20:42.302 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.301+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~7EU1FPD7MS0H.1 size=377757 2024-01-13T18:20:42.302 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.301+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=7EU1FPD7MS0H tag=9IO2NCKET2J1 type=write size=2474909 2024-01-13T18:20:42.304 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.303+0000 7f759fd04880 1 < completed write operation key=6GOU0WSHKUQ0 tag=BV73JAJN6FR7 type=write size=262307 2024-01-13T18:20:42.307 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.306+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=TO8GKIZQAJ9Q type=del size=442571 2024-01-13T18:20:42.309 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.308+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=C84EK3JH76JW type=del 2024-01-13T18:20:42.311 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.310+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=YPXOWRFVDQRL type=del size=3731806 2024-01-13T18:20:42.313 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.312+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~EFPGZNRZ7B6Y.0 size=191964 2024-01-13T18:20:42.317 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.316+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=EFPGZNRZ7B6Y tag=9LXIH9C3X3II type=write size=1240540 2024-01-13T18:20:42.319 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.318+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=3SR0DL23XV10 type=del size=2332800 2024-01-13T18:20:42.321 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.320+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~5JGP3GNAM5Y6.0 size=456971 2024-01-13T18:20:42.325 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.324+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=5JGP3GNAM5Y6 tag=GJXIVAHMO0Q6 type=write size=1505547 2024-01-13T18:20:42.327 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.326+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=KRBVDU1DPH2S type=del size=695794 2024-01-13T18:20:42.328 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.327+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~3IWDZK429821.0 size=1048576 2024-01-13T18:20:42.330 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.329+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~3IWDZK429821.1 size=1048576 2024-01-13T18:20:42.332 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.331+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~3IWDZK429821.2 size=423739 2024-01-13T18:20:42.336 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.334+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=3IWDZK429821 tag=WBI9A5NL7QBM type=write size=3569467 2024-01-13T18:20:42.339 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.338+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~V1GRXJ0Z00U1.0 size=734469 2024-01-13T18:20:42.339 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.338+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=V1GRXJ0Z00U1 tag=02YDS77X0PNM type=write size=1783045 2024-01-13T18:20:42.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.340+0000 7f759fd04880 1 < completed delete operation key=1YNH6QHP354U tag=PNJ24X3E5KY9 type=del 2024-01-13T18:20:42.344 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.343+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=A65073XSF982 type=write size=309275 2024-01-13T18:20:42.346 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.345+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=Y6R6BFS0FAE2 type=del 2024-01-13T18:20:42.350 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.349+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~3U3EYINU27NQ.0 size=1048576 2024-01-13T18:20:42.352 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.351+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~3U3EYINU27NQ.1 size=608831 2024-01-13T18:20:42.352 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.351+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=3U3EYINU27NQ tag=L4TXG5VQ8O3X type=write size=2705983 2024-01-13T18:20:42.354 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.353+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=IB6GE2DTIHLQ type=del 2024-01-13T18:20:42.356 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.355+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=B4QUUQ8KW9F6 type=del size=3990423 2024-01-13T18:20:42.358 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.357+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=LUPUK5L7NXBV type=del 2024-01-13T18:20:42.360 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.359+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=EKJ69NZW8QQU type=del size=3613364 2024-01-13T18:20:42.362 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.361+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~GM7H4O5R8OCR.0 size=1048576 2024-01-13T18:20:42.363 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.362+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~GM7H4O5R8OCR.1 size=1019952 2024-01-13T18:20:42.367 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.366+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=GM7H4O5R8OCR tag=I8AUL580069A type=write size=3117104 2024-01-13T18:20:42.371 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.370+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~MVAU6DW3MVZS.0 size=1048576 2024-01-13T18:20:42.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.372+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~MVAU6DW3MVZS.1 size=1048576 2024-01-13T18:20:42.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.374+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~MVAU6DW3MVZS.2 size=26188 2024-01-13T18:20:42.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.374+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=MVAU6DW3MVZS tag=EDA2EUKC1YUB type=write size=3171916 2024-01-13T18:20:42.377 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.376+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~75S4LHX4F4ZY.0 size=1048576 2024-01-13T18:20:42.378 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.377+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~75S4LHX4F4ZY.1 size=702672 2024-01-13T18:20:42.382 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.381+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=75S4LHX4F4ZY tag=MC3NS3PT6IN5 type=write size=2799824 2024-01-13T18:20:42.384 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.383+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=2VUQSFWHPH4B type=del size=1818575 2024-01-13T18:20:42.386 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.385+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~20FIKUIJ6LRU.0 size=447132 2024-01-13T18:20:42.390 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.388+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=20FIKUIJ6LRU tag=ZHQMSBNCSDVM type=write size=1495708 2024-01-13T18:20:42.393 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.392+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~EXYSDTLRFD6M.0 size=1048576 2024-01-13T18:20:42.395 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.394+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~EXYSDTLRFD6M.1 size=255711 2024-01-13T18:20:42.395 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.394+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=EXYSDTLRFD6M tag=1VE62PY9I06B type=write size=2352863 2024-01-13T18:20:42.397 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.396+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=4YLLPBHDRX2M type=del 2024-01-13T18:20:42.399 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.398+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=HFIN5MMQEHG2 type=del size=733424 2024-01-13T18:20:42.401 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.400+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~Y3F27Z51UGJX.0 size=41345 2024-01-13T18:20:42.405 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.404+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=Y3F27Z51UGJX tag=RJUC8PG3O4GU type=write size=1089921 2024-01-13T18:20:42.409 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.408+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~4N69ZV0JTADO.0 size=1048576 2024-01-13T18:20:42.411 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.410+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~4N69ZV0JTADO.1 size=1048576 2024-01-13T18:20:42.412 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.411+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~4N69ZV0JTADO.2 size=1012041 2024-01-13T18:20:42.412 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.411+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=4N69ZV0JTADO tag=FJK9EW7TOGL8 type=write size=4157769 2024-01-13T18:20:42.415 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.413+0000 7f759fd04880 1 < canceled operation key=6GOU0WSHKUQ0 tag=P5D9A7Y3EJLO type=del size=2715680 2024-01-13T18:20:42.416 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.415+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=Y67IH64JNN0L type=write size=192340 2024-01-13T18:20:42.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.417+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~7EU1FPD7MS0H.0 size=1048576 2024-01-13T18:20:42.420 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.419+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~7EU1FPD7MS0H.1 size=377757 2024-01-13T18:20:42.423 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.422+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=7EU1FPD7MS0H tag=9IO2NCKET2J1 type=write size=2474909 2024-01-13T18:20:42.426 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.425+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=BN08HDSSA26G type=del size=1910594 2024-01-13T18:20:42.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.427+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=TO8GKIZQAJ9Q type=del 2024-01-13T18:20:42.430 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.429+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=EIVW4LZL7O70 type=del size=2308997 2024-01-13T18:20:42.432 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.431+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=YPXOWRFVDQRL type=del 2024-01-13T18:20:42.434 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.433+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=4SI1GCG1WHS9 type=del size=29149 2024-01-13T18:20:42.436 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.435+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=3SR0DL23XV10 type=del 2024-01-13T18:20:42.438 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.437+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=9E8TGB7SC6R3 type=del size=2209915 2024-01-13T18:20:42.440 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.439+0000 7f759fd04880 1 < canceled operation key=H972TC5DOMHL tag=KRBVDU1DPH2S type=del size=695794 2024-01-13T18:20:42.442 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.441+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=2WS1CMSJIE2W type=del size=911686 2024-01-13T18:20:42.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.442+0000 7f759fd04880 1 < canceled part key=_multipart_H7C1UAGAUR7D.2~V1GRXJ0Z00U1.0 size=734469 2024-01-13T18:20:42.448 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.447+0000 7f759fd04880 1 < canceled multipart upload key=H7C1UAGAUR7D upload=V1GRXJ0Z00U1 tag=02YDS77X0PNM type=write size=1783045 2024-01-13T18:20:42.452 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.451+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~RI40K6J2F8PT.0 size=535284 2024-01-13T18:20:42.452 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.451+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=RI40K6J2F8PT tag=GYPRLYY1C20N type=write size=1583860 2024-01-13T18:20:42.455 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.455+0000 7f759fd04880 1 < suggested remove operation key=ZI9WAZQHVPAR tag=A65073XSF982 type=write 2024-01-13T18:20:42.460 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.459+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~9QFA00K0C833.0 size=884003 2024-01-13T18:20:42.460 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.459+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=9QFA00K0C833 tag=P6ADMGNNZ3QO type=write size=1932579 2024-01-13T18:20:42.462 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.461+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~3U3EYINU27NQ.0 size=1048576 2024-01-13T18:20:42.464 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.463+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~3U3EYINU27NQ.1 size=608831 2024-01-13T18:20:42.468 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.467+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=3U3EYINU27NQ tag=L4TXG5VQ8O3X type=write size=2705983 2024-01-13T18:20:42.470 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.469+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=75ZQGG9YI9JT type=del size=627156 2024-01-13T18:20:42.474 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.473+0000 7f759fd04880 1 < suggested update operation key=P8FMRQR7GXN7 tag=B4QUUQ8KW9F6 type=del size=3990423 2024-01-13T18:20:42.476 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.475+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=R42FEWV9UA9N type=del size=900951 2024-01-13T18:20:42.480 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.479+0000 7f759fd04880 1 < suggested update operation key=EW3ZFDVIQZ7G tag=EKJ69NZW8QQU type=del size=3613364 2024-01-13T18:20:42.482 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.481+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=SSSENB2SMRV9 type=del size=2002540 2024-01-13T18:20:42.485 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.484+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~MVAU6DW3MVZS.0 size=1048576 2024-01-13T18:20:42.487 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.486+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~MVAU6DW3MVZS.1 size=1048576 2024-01-13T18:20:42.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.488+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~MVAU6DW3MVZS.2 size=26188 2024-01-13T18:20:42.492 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.491+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=MVAU6DW3MVZS tag=EDA2EUKC1YUB type=write size=3171916 2024-01-13T18:20:42.496 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.495+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~1LNKW1PXYE45.0 size=1048576 2024-01-13T18:20:42.498 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.497+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~1LNKW1PXYE45.1 size=1048576 2024-01-13T18:20:42.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.498+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~1LNKW1PXYE45.2 size=298439 2024-01-13T18:20:42.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.498+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=1LNKW1PXYE45 tag=WO8X3DWSBLA0 type=write size=3444167 2024-01-13T18:20:42.503 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.502+0000 7f759fd04880 1 < suggested update operation key=H7C1UAGAUR7D tag=2VUQSFWHPH4B type=del size=1818575 2024-01-13T18:20:42.505 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.504+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=Y2RP2AE20AXD type=del size=3576518 2024-01-13T18:20:42.507 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.506+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~EXYSDTLRFD6M.0 size=1048576 2024-01-13T18:20:42.509 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.509+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~EXYSDTLRFD6M.1 size=255711 2024-01-13T18:20:42.513 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.512+0000 7f759fd04880 1 < completed multipart upload key=7R5YIO7UFSDZ upload=EXYSDTLRFD6M tag=1VE62PY9I06B type=write size=2352863 2024-01-13T18:20:42.518 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.517+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~EUPZ00QJJ3IT.0 size=1048576 2024-01-13T18:20:42.520 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.519+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~EUPZ00QJJ3IT.1 size=177402 2024-01-13T18:20:42.520 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.519+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=EUPZ00QJJ3IT tag=DKGYM6R8DYG1 type=write size=2274554 2024-01-13T18:20:42.522 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.521+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=HFIN5MMQEHG2 type=del 2024-01-13T18:20:42.524 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.523+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=8Q73BV2YO0QX type=write size=789861 2024-01-13T18:20:42.526 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.525+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~4N69ZV0JTADO.0 size=1048576 2024-01-13T18:20:42.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.527+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~4N69ZV0JTADO.1 size=1048576 2024-01-13T18:20:42.531 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.529+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~4N69ZV0JTADO.2 size=1012041 2024-01-13T18:20:42.534 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.533+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=4N69ZV0JTADO tag=FJK9EW7TOGL8 type=write size=4157769 2024-01-13T18:20:42.536 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.535+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=GLG2S2A0JF0O type=del size=2384651 2024-01-13T18:20:42.538 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.537+0000 7f759fd04880 1 < completed write operation key=2OO7S2NBZ7M6 tag=Y67IH64JNN0L type=write size=192340 2024-01-13T18:20:42.541 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.540+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=525ZZ3C1KS2Z type=del size=2399685 2024-01-13T18:20:42.543 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.542+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=BN08HDSSA26G type=del 2024-01-13T18:20:42.545 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.544+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=V3ZKJNR34X13 type=del size=27595 2024-01-13T18:20:42.547 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.546+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=EIVW4LZL7O70 type=del 2024-01-13T18:20:42.549 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.548+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=KUOX2WD55FIX type=del size=3087196 2024-01-13T18:20:42.551 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.550+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=4SI1GCG1WHS9 type=del 2024-01-13T18:20:42.553 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.552+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=DYD5XLTFFLEQ type=del size=3543128 2024-01-13T18:20:42.556 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.555+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=9E8TGB7SC6R3 type=del 2024-01-13T18:20:42.558 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.557+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=W9U9UVXWRW1F type=del size=2451318 2024-01-13T18:20:42.560 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.559+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=2WS1CMSJIE2W type=del 2024-01-13T18:20:42.563 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.561+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=E41QPMUSCFKZ type=write size=879807 2024-01-13T18:20:42.564 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.563+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~RI40K6J2F8PT.0 size=535284 2024-01-13T18:20:42.568 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.567+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=RI40K6J2F8PT tag=GYPRLYY1C20N type=write size=1583860 2024-01-13T18:20:42.572 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.571+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~IQDKRXWGFOZ3.0 size=622005 2024-01-13T18:20:42.572 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.571+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=IQDKRXWGFOZ3 tag=SDB7YF0041X4 type=write size=1670581 2024-01-13T18:20:42.574 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.573+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~9QFA00K0C833.0 size=884003 2024-01-13T18:20:42.578 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.577+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=9QFA00K0C833 tag=P6ADMGNNZ3QO type=write size=1932579 2024-01-13T18:20:42.581 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.580+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~WO05UQ8KF5G6.0 size=1048576 2024-01-13T18:20:42.583 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.582+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~WO05UQ8KF5G6.1 size=1048576 2024-01-13T18:20:42.585 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.584+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~WO05UQ8KF5G6.2 size=813051 2024-01-13T18:20:42.585 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.584+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=WO05UQ8KF5G6 tag=K42LUKF25MOX type=write size=3958779 2024-01-13T18:20:42.588 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.588+0000 7f759fd04880 1 < suggested remove operation key=6GOU0WSHKUQ0 tag=75ZQGG9YI9JT type=del 2024-01-13T18:20:42.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.592+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~TT67FJ825ZR9.0 size=377140 2024-01-13T18:20:42.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.592+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=TT67FJ825ZR9 tag=6M1M62MMRHJP type=write size=1425716 2024-01-13T18:20:42.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.594+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=R42FEWV9UA9N type=del 2024-01-13T18:20:42.597 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.596+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=KJ332PYHZXXV type=del size=1519121 2024-01-13T18:20:42.599 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.598+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=SSSENB2SMRV9 type=del 2024-01-13T18:20:42.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.602+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~OU9XIN5EM35P.0 size=1048576 2024-01-13T18:20:42.604 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.603+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~OU9XIN5EM35P.1 size=1048576 2024-01-13T18:20:42.606 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.605+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~OU9XIN5EM35P.2 size=678921 2024-01-13T18:20:42.606 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.605+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=OU9XIN5EM35P tag=MG6EZ1CHORDG type=write size=3824649 2024-01-13T18:20:42.608 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.607+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~1LNKW1PXYE45.0 size=1048576 2024-01-13T18:20:42.608 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.607+0000 7f759fd04880 1 < canceled part key=_multipart_H4VHC37BOZJ3.2~1LNKW1PXYE45.1 size=1048576 2024-01-13T18:20:42.610 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.609+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~1LNKW1PXYE45.2 size=298439 2024-01-13T18:20:42.614 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.613+0000 7f759fd04880 1 < canceled multipart upload key=H4VHC37BOZJ3 upload=1LNKW1PXYE45 tag=WO8X3DWSBLA0 type=write size=3444167 2024-01-13T18:20:42.618 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.617+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~RKI427LW4IF3.0 size=1048576 2024-01-13T18:20:42.619 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.619+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~RKI427LW4IF3.1 size=376476 2024-01-13T18:20:42.620 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.619+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=RKI427LW4IF3 tag=QLHFQXKNB2X1 type=write size=2473628 2024-01-13T18:20:42.622 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.621+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=Y2RP2AE20AXD type=del 2024-01-13T18:20:42.626 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.625+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~S35KZTI3YKR8.0 size=1048576 2024-01-13T18:20:42.627 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.626+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~S35KZTI3YKR8.1 size=556799 2024-01-13T18:20:42.627 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.626+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=S35KZTI3YKR8 tag=HHL8D4VB3RX9 type=write size=2653951 2024-01-13T18:20:42.629 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.628+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~EUPZ00QJJ3IT.0 size=1048576 2024-01-13T18:20:42.631 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.630+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~EUPZ00QJJ3IT.1 size=177402 2024-01-13T18:20:42.635 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.634+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=EUPZ00QJJ3IT tag=DKGYM6R8DYG1 type=write size=2274554 2024-01-13T18:20:42.636 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.635+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=32MXJJMVX3YY type=write size=792714 2024-01-13T18:20:42.640 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.639+0000 7f759fd04880 1 < suggested remove operation key=OMA1B74S8FXS tag=8Q73BV2YO0QX type=write 2024-01-13T18:20:42.642 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.641+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=IWDJZCGNHK1G type=del size=3723614 2024-01-13T18:20:42.644 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.643+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=GLG2S2A0JF0O type=del 2024-01-13T18:20:42.647 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.645+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=O66C4KADVRLK type=del size=2831201 2024-01-13T18:20:42.649 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.647+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=525ZZ3C1KS2Z type=del 2024-01-13T18:20:42.650 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.649+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=LXGKEXFM7BBZ type=del size=1575475 2024-01-13T18:20:42.652 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.651+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=V3ZKJNR34X13 type=del 2024-01-13T18:20:42.654 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.653+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=TMKS8W1GT6EP type=write size=599444 2024-01-13T18:20:42.656 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.655+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=KUOX2WD55FIX type=del 2024-01-13T18:20:42.659 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.658+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~976R4PX3Y4QA.0 size=1048576 2024-01-13T18:20:42.661 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.660+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~976R4PX3Y4QA.1 size=5801 2024-01-13T18:20:42.661 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.660+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=976R4PX3Y4QA tag=0ZG8YE08FKA8 type=write size=2102953 2024-01-13T18:20:42.664 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.663+0000 7f759fd04880 1 < suggested remove operation key=AJZB1PXB1NB5 tag=DYD5XLTFFLEQ type=del 2024-01-13T18:20:42.668 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.667+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~H12T5ILOQLW0.0 size=1048576 2024-01-13T18:20:42.670 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.669+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~H12T5ILOQLW0.1 size=1048576 2024-01-13T18:20:42.671 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.670+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~H12T5ILOQLW0.2 size=70808 2024-01-13T18:20:42.671 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.670+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=H12T5ILOQLW0 tag=AQ6XZ81P76TO type=write size=3216536 2024-01-13T18:20:42.673 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.672+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=W9U9UVXWRW1F type=del 2024-01-13T18:20:42.678 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.677+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~E0V76UQSEETW.0 size=1048576 2024-01-13T18:20:42.680 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.679+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~E0V76UQSEETW.1 size=635185 2024-01-13T18:20:42.680 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.679+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=E0V76UQSEETW tag=Q8E1H91RUC2B type=write size=2732337 2024-01-13T18:20:42.682 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.681+0000 7f759fd04880 1 < completed write operation key=TNC2YDZYGM6G tag=E41QPMUSCFKZ type=write size=879807 2024-01-13T18:20:42.686 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.685+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~VV0JHNN1CKI1.0 size=1048576 2024-01-13T18:20:42.688 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.687+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~VV0JHNN1CKI1.1 size=1048576 2024-01-13T18:20:42.690 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.689+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~VV0JHNN1CKI1.2 size=1044876 2024-01-13T18:20:42.690 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.689+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=VV0JHNN1CKI1 tag=7UQQU8A7QU0A type=write size=4190604 2024-01-13T18:20:42.692 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.691+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~IQDKRXWGFOZ3.0 size=622005 2024-01-13T18:20:42.695 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.694+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=IQDKRXWGFOZ3 tag=SDB7YF0041X4 type=write size=1670581 2024-01-13T18:20:42.699 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.698+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~VUZ7DYEZSHXS.0 size=1048576 2024-01-13T18:20:42.701 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.700+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~VUZ7DYEZSHXS.1 size=487579 2024-01-13T18:20:42.701 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.700+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=VUZ7DYEZSHXS tag=SW330VORQNIW type=write size=2584731 2024-01-13T18:20:42.701 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.700+0000 7f759fd04880 1 < canceled part key=_multipart_QD5GBLNCY707.2~WO05UQ8KF5G6.0 size=1048576 2024-01-13T18:20:42.703 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.702+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~WO05UQ8KF5G6.1 size=1048576 2024-01-13T18:20:42.704 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.703+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~WO05UQ8KF5G6.2 size=813051 2024-01-13T18:20:42.708 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.707+0000 7f759fd04880 1 < canceled multipart upload key=QD5GBLNCY707 upload=WO05UQ8KF5G6 tag=K42LUKF25MOX type=write size=3958779 2024-01-13T18:20:42.711 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.710+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=HWF20D7P4JTL type=del size=1106428 2024-01-13T18:20:42.713 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.712+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~TT67FJ825ZR9.0 size=377140 2024-01-13T18:20:42.717 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.716+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=TT67FJ825ZR9 tag=6M1M62MMRHJP type=write size=1425716 2024-01-13T18:20:42.719 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.718+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=4CNL2DFCONQR type=del size=797407 2024-01-13T18:20:42.721 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.720+0000 7f759fd04880 1 < canceled operation key=VZHGQM6ZNJYQ tag=KJ332PYHZXXV type=del size=1519121 2024-01-13T18:20:42.723 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.722+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=S9XW5BV3PNRQ type=del size=2214364 2024-01-13T18:20:42.725 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.724+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~OU9XIN5EM35P.0 size=1048576 2024-01-13T18:20:42.727 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.726+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~OU9XIN5EM35P.1 size=1048576 2024-01-13T18:20:42.729 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.728+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~OU9XIN5EM35P.2 size=678921 2024-01-13T18:20:42.735 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.732+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=OU9XIN5EM35P tag=MG6EZ1CHORDG type=write size=3824649 2024-01-13T18:20:42.735 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.734+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=WBPC7XJGADSO type=del size=541754 2024-01-13T18:20:42.738 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.737+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~RKI427LW4IF3.0 size=1048576 2024-01-13T18:20:42.739 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.738+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~RKI427LW4IF3.1 size=376476 2024-01-13T18:20:42.744 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.743+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=RKI427LW4IF3 tag=QLHFQXKNB2X1 type=write size=2473628 2024-01-13T18:20:42.748 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.747+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~KZVCX7R5CXPM.0 size=34888 2024-01-13T18:20:42.748 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.747+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=KZVCX7R5CXPM tag=QV27F5NPNGQ8 type=write size=1083464 2024-01-13T18:20:42.748 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.747+0000 7f759fd04880 1 < canceled part key=_multipart_1O3XX67RKHNW.2~S35KZTI3YKR8.0 size=1048576 2024-01-13T18:20:42.750 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.749+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~S35KZTI3YKR8.1 size=556799 2024-01-13T18:20:42.754 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.753+0000 7f759fd04880 1 < canceled multipart upload key=1O3XX67RKHNW upload=S35KZTI3YKR8 tag=HHL8D4VB3RX9 type=write size=2653951 2024-01-13T18:20:42.756 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.755+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=F7FDIR3SVS5Y type=del size=3679149 2024-01-13T18:20:42.758 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.757+0000 7f759fd04880 1 < completed write operation key=0TIZPXX8CMHA tag=32MXJJMVX3YY type=write size=792714 2024-01-13T18:20:42.760 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.759+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=09YN76RJTH7D type=del size=1834336 2024-01-13T18:20:42.762 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.761+0000 7f759fd04880 1 < canceled operation key=1O3XX67RKHNW tag=IWDJZCGNHK1G type=del size=3723614 2024-01-13T18:20:42.764 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.763+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=L1PHD0E8V0EW type=del size=1391978 2024-01-13T18:20:42.766 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.765+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=O66C4KADVRLK type=del 2024-01-13T18:20:42.768 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.767+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=13Z9I4FPG6OL type=del size=4127192 2024-01-13T18:20:42.770 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.769+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=LXGKEXFM7BBZ type=del 2024-01-13T18:20:42.774 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.773+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~8DUFR7O3C05W.0 size=1048576 2024-01-13T18:20:42.776 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.775+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~8DUFR7O3C05W.1 size=1048576 2024-01-13T18:20:42.777 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.776+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~8DUFR7O3C05W.2 size=887648 2024-01-13T18:20:42.777 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.776+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=8DUFR7O3C05W tag=0HUTZWBWDNM8 type=write size=4033376 2024-01-13T18:20:42.779 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.778+0000 7f759fd04880 1 < completed write operation key=QS9PLJKINY4R tag=TMKS8W1GT6EP type=write size=599444 2024-01-13T18:20:42.781 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.780+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=B3PLR61AXUG0 type=del size=1631328 2024-01-13T18:20:42.783 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.782+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~976R4PX3Y4QA.0 size=1048576 2024-01-13T18:20:42.785 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.784+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~976R4PX3Y4QA.1 size=5801 2024-01-13T18:20:42.789 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.788+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=976R4PX3Y4QA tag=0ZG8YE08FKA8 type=write size=2102953 2024-01-13T18:20:42.791 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.790+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=DSE2EC9K1BZC type=del size=845250 2024-01-13T18:20:42.793 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.792+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~H12T5ILOQLW0.0 size=1048576 2024-01-13T18:20:42.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.794+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~H12T5ILOQLW0.1 size=1048576 2024-01-13T18:20:42.796 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.795+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~H12T5ILOQLW0.2 size=70808 2024-01-13T18:20:42.800 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.799+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=H12T5ILOQLW0 tag=AQ6XZ81P76TO type=write size=3216536 2024-01-13T18:20:42.802 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.801+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=KYMDD3KSJUSM type=del size=4081922 2024-01-13T18:20:42.805 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.804+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~E0V76UQSEETW.0 size=1048576 2024-01-13T18:20:42.806 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.805+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~E0V76UQSEETW.1 size=635185 2024-01-13T18:20:42.810 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.809+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=E0V76UQSEETW tag=Q8E1H91RUC2B type=write size=2732337 2024-01-13T18:20:42.812 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.811+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=U8ZASWSRF9A5 type=del size=174170 2024-01-13T18:20:42.815 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.813+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~VV0JHNN1CKI1.0 size=1048576 2024-01-13T18:20:42.817 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.816+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~VV0JHNN1CKI1.1 size=1048576 2024-01-13T18:20:42.819 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.818+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~VV0JHNN1CKI1.2 size=1044876 2024-01-13T18:20:42.822 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.821+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=VV0JHNN1CKI1 tag=7UQQU8A7QU0A type=write size=4190604 2024-01-13T18:20:42.824 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.823+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=OE6DPSCRLQNK type=del size=2340189 2024-01-13T18:20:42.825 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.824+0000 7f759fd04880 1 < canceled part key=_multipart_WSRJB811XCVL.2~VUZ7DYEZSHXS.0 size=1048576 2024-01-13T18:20:42.826 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.825+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~VUZ7DYEZSHXS.1 size=487579 2024-01-13T18:20:42.830 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.829+0000 7f759fd04880 1 < canceled multipart upload key=WSRJB811XCVL upload=VUZ7DYEZSHXS tag=SW330VORQNIW type=write size=2584731 2024-01-13T18:20:42.832 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.831+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=BELT6QMGL7VL type=write size=215958 2024-01-13T18:20:42.834 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.833+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=HWF20D7P4JTL type=del 2024-01-13T18:20:42.837 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.836+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~J6EPHOMBR34C.0 size=1048576 2024-01-13T18:20:42.839 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.838+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~J6EPHOMBR34C.1 size=922934 2024-01-13T18:20:42.840 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.838+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=J6EPHOMBR34C tag=E8GGPN6TA2SX type=write size=3020086 2024-01-13T18:20:42.844 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.843+0000 7f759fd04880 1 < suggested update operation key=DOXP3EJ03EBY tag=4CNL2DFCONQR type=del size=797407 2024-01-13T18:20:42.845 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.845+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=Q5VS7J4FTI2L type=write size=76926 2024-01-13T18:20:42.847 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.846+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=S9XW5BV3PNRQ type=del 2024-01-13T18:20:42.849 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.848+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=JQMJTNEQVKTL type=del size=4071197 2024-01-13T18:20:42.851 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.850+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=WBPC7XJGADSO type=del 2024-01-13T18:20:42.855 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.854+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~O0NZT5091FMP.0 size=580402 2024-01-13T18:20:42.855 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.854+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=O0NZT5091FMP tag=E765W5XNP24P type=write size=1628978 2024-01-13T18:20:42.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.856+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~KZVCX7R5CXPM.0 size=34888 2024-01-13T18:20:42.861 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.860+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=KZVCX7R5CXPM tag=QV27F5NPNGQ8 type=write size=1083464 2024-01-13T18:20:42.863 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.862+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=D9N0DDO0XAZM type=write size=936385 2024-01-13T18:20:42.865 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.864+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=F7FDIR3SVS5Y type=del 2024-01-13T18:20:42.869 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.868+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~11E0DI3ZJURG.0 size=1048576 2024-01-13T18:20:42.871 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.869+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~11E0DI3ZJURG.1 size=1048576 2024-01-13T18:20:42.872 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.871+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~11E0DI3ZJURG.2 size=363149 2024-01-13T18:20:42.872 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.871+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=11E0DI3ZJURG tag=PHFJ3WGGGV4J type=write size=3508877 2024-01-13T18:20:42.875 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.874+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=09YN76RJTH7D type=del 2024-01-13T18:20:42.877 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.876+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=78X8C3OK1SM3 type=del size=3138212 2024-01-13T18:20:42.879 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.878+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=L1PHD0E8V0EW type=del 2024-01-13T18:20:42.881 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.880+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=Y0HKI6PC0JD5 type=del size=1853874 2024-01-13T18:20:42.885 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.884+0000 7f759fd04880 1 < suggested update operation key=AJZB1PXB1NB5 tag=13Z9I4FPG6OL type=del size=4127192 2024-01-13T18:20:42.887 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.886+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=QO35LIIVCJ8A type=del size=656331 2024-01-13T18:20:42.889 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.888+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~8DUFR7O3C05W.0 size=1048576 2024-01-13T18:20:42.891 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.890+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~8DUFR7O3C05W.1 size=1048576 2024-01-13T18:20:42.892 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.891+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~8DUFR7O3C05W.2 size=887648 2024-01-13T18:20:42.896 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.895+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=8DUFR7O3C05W tag=0HUTZWBWDNM8 type=write size=4033376 2024-01-13T18:20:42.898 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.897+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=0KKZXWDSI5RJ type=del size=1073071 2024-01-13T18:20:42.900 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.899+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=B3PLR61AXUG0 type=del 2024-01-13T18:20:42.902 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.901+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=3U5TQF4RM5XA type=write size=905152 2024-01-13T18:20:42.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.903+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=DSE2EC9K1BZC type=del 2024-01-13T18:20:42.906 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.905+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=50MC9R7IF4Y2 type=del size=31491 2024-01-13T18:20:42.908 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.907+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=KYMDD3KSJUSM type=del 2024-01-13T18:20:42.910 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.909+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=WCDYZHN02GBA type=del size=2833945 2024-01-13T18:20:42.912 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.911+0000 7f759fd04880 1 < completed delete operation key=1YNH6QHP354U tag=U8ZASWSRF9A5 type=del 2024-01-13T18:20:42.914 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.913+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=AOGFKTTLT0D2 type=del size=3395739 2024-01-13T18:20:42.916 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.915+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=OE6DPSCRLQNK type=del 2024-01-13T18:20:42.918 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.917+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=OKMS8G8M0UQD type=del size=1233178 2024-01-13T18:20:42.920 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.919+0000 7f759fd04880 1 < completed write operation key=OMA1B74S8FXS tag=BELT6QMGL7VL type=write size=215958 2024-01-13T18:20:42.922 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.921+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=2CKWFN0ZGWCM type=del size=1005346 2024-01-13T18:20:42.924 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.923+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~J6EPHOMBR34C.0 size=1048576 2024-01-13T18:20:42.926 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.925+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~J6EPHOMBR34C.1 size=922934 2024-01-13T18:20:42.930 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.929+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=J6EPHOMBR34C tag=E8GGPN6TA2SX type=write size=3020086 2024-01-13T18:20:42.932 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.931+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=P40LU2K9QO6H type=del size=1177781 2024-01-13T18:20:42.935 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.934+0000 7f759fd04880 1 < suggested remove operation key=OMA1B74S8FXS tag=Q5VS7J4FTI2L type=write 2024-01-13T18:20:42.937 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.936+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=H2AFFREUWIYD type=del size=583599 2024-01-13T18:20:42.939 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.938+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=JQMJTNEQVKTL type=del 2024-01-13T18:20:42.942 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.941+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=MDAMES4KR4MU type=del size=3439873 2024-01-13T18:20:42.943 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.943+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~O0NZT5091FMP.0 size=580402 2024-01-13T18:20:42.948 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.947+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=O0NZT5091FMP tag=E765W5XNP24P type=write size=1628978 2024-01-13T18:20:42.950 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.949+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=D6O9F60MM10M type=write size=1019167 2024-01-13T18:20:42.952 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.950+0000 7f759fd04880 1 < completed write operation key=BPUBFFWB9D3C tag=D9N0DDO0XAZM type=write size=936385 2024-01-13T18:20:42.955 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.954+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~R4KI61RNO0V0.0 size=1007916 2024-01-13T18:20:42.955 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.954+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=R4KI61RNO0V0 tag=RLIUVUHK61Q2 type=write size=2056492 2024-01-13T18:20:42.957 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.956+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~11E0DI3ZJURG.0 size=1048576 2024-01-13T18:20:42.958 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.957+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~11E0DI3ZJURG.1 size=1048576 2024-01-13T18:20:42.960 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.959+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~11E0DI3ZJURG.2 size=363149 2024-01-13T18:20:42.964 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.963+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=11E0DI3ZJURG tag=PHFJ3WGGGV4J type=write size=3508877 2024-01-13T18:20:42.967 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.966+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~TWZ2YE16AKMH.0 size=596328 2024-01-13T18:20:42.967 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.966+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=TWZ2YE16AKMH tag=LEYT520AI0JG type=write size=1644904 2024-01-13T18:20:42.969 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.968+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=78X8C3OK1SM3 type=del 2024-01-13T18:20:42.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.970+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=FD97P81SGUA1 type=del size=2799197 2024-01-13T18:20:42.973 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.972+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=Y0HKI6PC0JD5 type=del 2024-01-13T18:20:42.975 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.974+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=W6BON1CK1ST5 type=del size=2608696 2024-01-13T18:20:42.977 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.976+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=QO35LIIVCJ8A type=del 2024-01-13T18:20:42.979 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.978+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=MI7LZA9Q5D0R type=del size=1766501 2024-01-13T18:20:42.981 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.980+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=0KKZXWDSI5RJ type=del 2024-01-13T18:20:42.983 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.982+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=NDXM8ING8YRW type=del size=1270098 2024-01-13T18:20:42.985 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.984+0000 7f759fd04880 1 < completed write operation key=RY0W5S41XK3F tag=3U5TQF4RM5XA type=write size=905152 2024-01-13T18:20:42.990 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.989+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~MPHNFNQ8ZH48.0 size=1048576 2024-01-13T18:20:42.992 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.991+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~MPHNFNQ8ZH48.1 size=886032 2024-01-13T18:20:42.992 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.991+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=MPHNFNQ8ZH48 tag=AKMO2HZDKQDW type=write size=2983184 2024-01-13T18:20:42.993 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.992+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=50MC9R7IF4Y2 type=del 2024-01-13T18:20:42.998 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.997+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~LDQDNROL8PNR.0 size=1048576 2024-01-13T18:20:42.999 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.998+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~LDQDNROL8PNR.1 size=465869 2024-01-13T18:20:42.999 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:42.998+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=LDQDNROL8PNR tag=HCWY10X0I05K type=write size=2563021 2024-01-13T18:20:43.003 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.002+0000 7f759fd04880 1 < suggested remove operation key=2OO7S2NBZ7M6 tag=WCDYZHN02GBA type=del 2024-01-13T18:20:43.005 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.004+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=86BPSYCY9NL3 type=del size=4116662 2024-01-13T18:20:43.007 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.006+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=AOGFKTTLT0D2 type=del 2024-01-13T18:20:43.010 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.009+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~8WYIJOZSCRBM.0 size=1048576 2024-01-13T18:20:43.012 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.011+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~8WYIJOZSCRBM.1 size=1048576 2024-01-13T18:20:43.013 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.012+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~8WYIJOZSCRBM.2 size=138176 2024-01-13T18:20:43.013 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.012+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=8WYIJOZSCRBM tag=SLYBF2L0BQ8R type=write size=3283904 2024-01-13T18:20:43.014 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.013+0000 7f759fd04880 -1 < no bi entry to suggest for operation key=2OO7S2NBZ7M6 tag=OKMS8G8M0UQD type=del size=1233178: (2) No such file or directory 2024-01-13T18:20:43.018 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.017+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~IIEZCLSG5SF0.0 size=1048576 2024-01-13T18:20:43.020 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.019+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~IIEZCLSG5SF0.1 size=1048576 2024-01-13T18:20:43.021 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.020+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~IIEZCLSG5SF0.2 size=194316 2024-01-13T18:20:43.022 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.020+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=IIEZCLSG5SF0 tag=G59MGMRMU1TN type=write size=3340044 2024-01-13T18:20:43.023 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.022+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=2CKWFN0ZGWCM type=del 2024-01-13T18:20:43.025 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.024+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=80SWH09Z96Z3 type=del size=141594 2024-01-13T18:20:43.030 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.028+0000 7f759fd04880 1 < suggested remove operation key=OMA1B74S8FXS tag=P40LU2K9QO6H type=del 2024-01-13T18:20:43.031 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.030+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=DPX257LI268M type=del size=1612731 2024-01-13T18:20:43.033 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.032+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=H2AFFREUWIYD type=del 2024-01-13T18:20:43.037 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.036+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~09WIFHQ6PW19.0 size=497956 2024-01-13T18:20:43.037 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.036+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=09WIFHQ6PW19 tag=K9GTUO93P7R7 type=write size=1546532 2024-01-13T18:20:43.039 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.038+0000 7f759fd04880 1 < canceled operation key=8EWIOXN5H9KU tag=MDAMES4KR4MU type=del size=3439873 2024-01-13T18:20:43.043 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.042+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~CW0S0QMDNHGM.0 size=1048576 2024-01-13T18:20:43.045 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.044+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~CW0S0QMDNHGM.1 size=838837 2024-01-13T18:20:43.045 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.044+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=CW0S0QMDNHGM tag=WJZIRRM7PADJ type=write size=2935989 2024-01-13T18:20:43.047 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.046+0000 7f759fd04880 1 < completed write operation key=JN46AMLYHN8E tag=D6O9F60MM10M type=write size=1019167 2024-01-13T18:20:43.050 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.049+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~0SUU0LIDRCA1.0 size=387285 2024-01-13T18:20:43.051 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.049+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=0SUU0LIDRCA1 tag=NMDX05RTG8DC type=write size=1435861 2024-01-13T18:20:43.052 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.051+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~R4KI61RNO0V0.0 size=1007916 2024-01-13T18:20:43.056 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.055+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=R4KI61RNO0V0 tag=RLIUVUHK61Q2 type=write size=2056492 2024-01-13T18:20:43.058 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.057+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=Q3E23QIKEKTN type=del size=25696 2024-01-13T18:20:43.060 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.059+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~TWZ2YE16AKMH.0 size=596328 2024-01-13T18:20:43.063 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.062+0000 7f759fd04880 1 < completed multipart upload key=VZHGQM6ZNJYQ upload=TWZ2YE16AKMH tag=LEYT520AI0JG type=write size=1644904 2024-01-13T18:20:43.065 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.064+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=BBIJLJ32D1GU type=del size=224496 2024-01-13T18:20:43.067 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.066+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=FD97P81SGUA1 type=del 2024-01-13T18:20:43.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.068+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=NE9E1N4TYRKA type=del size=77591 2024-01-13T18:20:43.071 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.070+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=W6BON1CK1ST5 type=del 2024-01-13T18:20:43.077 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.075+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~ZDAMO026GM7U.0 size=802387 2024-01-13T18:20:43.077 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.075+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=ZDAMO026GM7U tag=YHN4MOA9XORL type=write size=1850963 2024-01-13T18:20:43.078 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.077+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=MI7LZA9Q5D0R type=del 2024-01-13T18:20:43.080 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.079+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=TLLQSL2AQBUA type=write size=135258 2024-01-13T18:20:43.083 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.082+0000 7f759fd04880 -1 < failed to complete operation key=OMA1B74S8FXS tag=NDXM8ING8YRW type=del size=1270098: (22) Invalid argument 2024-01-13T18:20:43.085 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.084+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=6M2U9ICNO4AH type=del size=830546 2024-01-13T18:20:43.086 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.086+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~MPHNFNQ8ZH48.0 size=1048576 2024-01-13T18:20:43.089 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.088+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~MPHNFNQ8ZH48.1 size=886032 2024-01-13T18:20:43.093 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.092+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=MPHNFNQ8ZH48 tag=AKMO2HZDKQDW type=write size=2983184 2024-01-13T18:20:43.095 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.094+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=N134Y5TY3ISS type=write size=848152 2024-01-13T18:20:43.097 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.096+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~LDQDNROL8PNR.0 size=1048576 2024-01-13T18:20:43.098 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.097+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~LDQDNROL8PNR.1 size=465869 2024-01-13T18:20:43.103 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.102+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=LDQDNROL8PNR tag=HCWY10X0I05K type=write size=2563021 2024-01-13T18:20:43.105 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.104+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=NNGGJWXZFLQM type=del size=2883209 2024-01-13T18:20:43.108 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.107+0000 7f759fd04880 -1 < failed to complete operation key=OMA1B74S8FXS tag=86BPSYCY9NL3 type=del size=4116662: (22) Invalid argument 2024-01-13T18:20:43.110 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.109+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=4H9VU5UTO8BU type=del size=956762 2024-01-13T18:20:43.112 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.111+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~8WYIJOZSCRBM.0 size=1048576 2024-01-13T18:20:43.114 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.113+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~8WYIJOZSCRBM.1 size=1048576 2024-01-13T18:20:43.116 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.115+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~8WYIJOZSCRBM.2 size=138176 2024-01-13T18:20:43.119 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.118+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=8WYIJOZSCRBM tag=SLYBF2L0BQ8R type=write size=3283904 2024-01-13T18:20:43.121 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.120+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=BX34BHJ5RT3W type=write size=134056 2024-01-13T18:20:43.123 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.122+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~IIEZCLSG5SF0.0 size=1048576 2024-01-13T18:20:43.124 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.124+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~IIEZCLSG5SF0.1 size=1048576 2024-01-13T18:20:43.126 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.125+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~IIEZCLSG5SF0.2 size=194316 2024-01-13T18:20:43.130 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.129+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=IIEZCLSG5SF0 tag=G59MGMRMU1TN type=write size=3340044 2024-01-13T18:20:43.132 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.131+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=8DKX68B6UX1R type=del size=478359 2024-01-13T18:20:43.134 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.133+0000 7f759fd04880 1 < canceled operation key=1YNH6QHP354U tag=80SWH09Z96Z3 type=del size=141594 2024-01-13T18:20:43.136 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.135+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=PRFIHGKDJVU6 type=del size=3046674 2024-01-13T18:20:43.138 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.137+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=DPX257LI268M type=del 2024-01-13T18:20:43.144 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.141+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~FVGE7V4SBVIN.0 size=1048576 2024-01-13T18:20:43.144 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.143+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~FVGE7V4SBVIN.1 size=1048576 2024-01-13T18:20:43.145 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.144+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~FVGE7V4SBVIN.2 size=921135 2024-01-13T18:20:43.145 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.144+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=FVGE7V4SBVIN tag=SHQ0YOBRB3VK type=write size=4066863 2024-01-13T18:20:43.147 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.146+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~09WIFHQ6PW19.0 size=497956 2024-01-13T18:20:43.151 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.150+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=09WIFHQ6PW19 tag=K9GTUO93P7R7 type=write size=1546532 2024-01-13T18:20:43.153 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.152+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=M6N50LTYZVK1 type=del size=414843 2024-01-13T18:20:43.154 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.152+0000 7f759fd04880 1 < canceled part key=_multipart_JGALONWJXLQY.2~CW0S0QMDNHGM.0 size=1048576 2024-01-13T18:20:43.155 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.154+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~CW0S0QMDNHGM.1 size=838837 2024-01-13T18:20:43.159 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.158+0000 7f759fd04880 1 < canceled multipart upload key=JGALONWJXLQY upload=CW0S0QMDNHGM tag=WJZIRRM7PADJ type=write size=2935989 2024-01-13T18:20:43.161 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.160+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=107KO3WLMRS6 type=del size=1820132 2024-01-13T18:20:43.163 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.162+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~0SUU0LIDRCA1.0 size=387285 2024-01-13T18:20:43.166 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.165+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=0SUU0LIDRCA1 tag=NMDX05RTG8DC type=write size=1435861 2024-01-13T18:20:43.168 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.167+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=2TTD32R1ZVNY type=del size=1085744 2024-01-13T18:20:43.173 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.172+0000 7f759fd04880 1 < suggested update operation key=8EWIOXN5H9KU tag=Q3E23QIKEKTN type=del size=25696 2024-01-13T18:20:43.177 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.176+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~2WHFG4ABD4EL.0 size=1048576 2024-01-13T18:20:43.179 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.178+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~2WHFG4ABD4EL.1 size=2695 2024-01-13T18:20:43.179 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.178+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=2WHFG4ABD4EL tag=V6TXMH56J52U type=write size=2099847 2024-01-13T18:20:43.181 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.180+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=BBIJLJ32D1GU type=del 2024-01-13T18:20:43.183 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.182+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=X2J5W4BYZ6RV type=del size=3344940 2024-01-13T18:20:43.185 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.184+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=NE9E1N4TYRKA type=del 2024-01-13T18:20:43.189 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.188+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~PT6O0D1D1MXT.0 size=1048576 2024-01-13T18:20:43.190 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.189+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~PT6O0D1D1MXT.1 size=1048576 2024-01-13T18:20:43.192 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.191+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~PT6O0D1D1MXT.2 size=558584 2024-01-13T18:20:43.192 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.191+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=PT6O0D1D1MXT tag=BQ5613N3J6Y1 type=write size=3704312 2024-01-13T18:20:43.194 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.193+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~ZDAMO026GM7U.0 size=802387 2024-01-13T18:20:43.197 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.196+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=ZDAMO026GM7U tag=YHN4MOA9XORL type=write size=1850963 2024-01-13T18:20:43.199 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.198+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=MYTZSAFEUL3J type=del size=2778522 2024-01-13T18:20:43.202 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.201+0000 7f759fd04880 1 < canceled operation key=H4VHC37BOZJ3 tag=TLLQSL2AQBUA type=write size=135258 2024-01-13T18:20:43.203 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.202+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=OSPVNA88427D type=write size=632250 2024-01-13T18:20:43.205 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.204+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=6M2U9ICNO4AH type=del 2024-01-13T18:20:43.207 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.206+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=RZTBFRVND9V0 type=del size=2323704 2024-01-13T18:20:43.211 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.210+0000 7f759fd04880 1 < suggested update operation key=7LXXSKLOM1JZ tag=N134Y5TY3ISS type=write size=848152 2024-01-13T18:20:43.215 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.214+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~C3EM28X5DT5Y.0 size=1048576 2024-01-13T18:20:43.217 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.216+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~C3EM28X5DT5Y.1 size=1048576 2024-01-13T18:20:43.219 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.218+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~C3EM28X5DT5Y.2 size=224814 2024-01-13T18:20:43.219 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.218+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=C3EM28X5DT5Y tag=78MB6CKXWODP type=write size=3370542 2024-01-13T18:20:43.221 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.220+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=NNGGJWXZFLQM type=del 2024-01-13T18:20:43.223 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.222+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=3PUDK54MS86F type=write size=888415 2024-01-13T18:20:43.225 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.224+0000 7f759fd04880 1 < canceled operation key=JN46AMLYHN8E tag=4H9VU5UTO8BU type=del size=956762 2024-01-13T18:20:43.229 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.228+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~FO6E2HO73SYG.0 size=1048576 2024-01-13T18:20:43.231 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.230+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~FO6E2HO73SYG.1 size=413248 2024-01-13T18:20:43.231 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.230+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=FO6E2HO73SYG tag=FNSHSATNN9O8 type=write size=2510400 2024-01-13T18:20:43.233 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.232+0000 7f759fd04880 1 < completed write operation key=JGALONWJXLQY tag=BX34BHJ5RT3W type=write size=134056 2024-01-13T18:20:43.235 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.234+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=8CO3QDNT1YYB type=del size=3234068 2024-01-13T18:20:43.237 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.236+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=8DKX68B6UX1R type=del 2024-01-13T18:20:43.241 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.240+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~0SIHYJM6FIO0.0 size=1048576 2024-01-13T18:20:43.242 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.241+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~0SIHYJM6FIO0.1 size=1048576 2024-01-13T18:20:43.244 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.243+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~0SIHYJM6FIO0.2 size=1032949 2024-01-13T18:20:43.244 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.243+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=0SIHYJM6FIO0 tag=HANUEN3SYF1Q type=write size=4178677 2024-01-13T18:20:43.247 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.246+0000 7f759fd04880 -1 < failed to complete operation key=8EWIOXN5H9KU tag=PRFIHGKDJVU6 type=del size=3046674: (22) Invalid argument 2024-01-13T18:20:43.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.248+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=VH7E375E5Z0X type=del size=511850 2024-01-13T18:20:43.250 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.249+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~FVGE7V4SBVIN.0 size=1048576 2024-01-13T18:20:43.252 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.250+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~FVGE7V4SBVIN.1 size=1048576 2024-01-13T18:20:43.253 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.252+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~FVGE7V4SBVIN.2 size=921135 2024-01-13T18:20:43.257 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.256+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=FVGE7V4SBVIN tag=SHQ0YOBRB3VK type=write size=4066863 2024-01-13T18:20:43.259 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.258+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=K56O8K3JLQMH type=del size=2200244 2024-01-13T18:20:43.261 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.260+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=M6N50LTYZVK1 type=del 2024-01-13T18:20:43.263 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.262+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=7IT5GFESZ9HG type=del size=3420532 2024-01-13T18:20:43.265 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.264+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=107KO3WLMRS6 type=del 2024-01-13T18:20:43.267 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.265+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=XVAUZSNEDLNC type=del size=2353446 2024-01-13T18:20:43.268 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.267+0000 7f759fd04880 1 < canceled operation key=0TIZPXX8CMHA tag=2TTD32R1ZVNY type=del size=1085744 2024-01-13T18:20:43.271 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.270+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=9LJT7S4CEN9C type=del size=2923602 2024-01-13T18:20:43.273 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.272+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~2WHFG4ABD4EL.0 size=1048576 2024-01-13T18:20:43.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.273+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~2WHFG4ABD4EL.1 size=2695 2024-01-13T18:20:43.278 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.277+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=2WHFG4ABD4EL tag=V6TXMH56J52U type=write size=2099847 2024-01-13T18:20:43.280 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.279+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=UQ930HL66K7R type=del size=1384979 2024-01-13T18:20:43.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.281+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=X2J5W4BYZ6RV type=del 2024-01-13T18:20:43.284 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.283+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=4A7B91H3UIFA type=write size=549650 2024-01-13T18:20:43.286 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.285+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~PT6O0D1D1MXT.0 size=1048576 2024-01-13T18:20:43.288 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.287+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~PT6O0D1D1MXT.1 size=1048576 2024-01-13T18:20:43.290 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.289+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~PT6O0D1D1MXT.2 size=558584 2024-01-13T18:20:43.294 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.293+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=PT6O0D1D1MXT tag=BQ5613N3J6Y1 type=write size=3704312 2024-01-13T18:20:43.296 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.295+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=1S1SX2LNCYNG type=del size=1462705 2024-01-13T18:20:43.298 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.297+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=MYTZSAFEUL3J type=del 2024-01-13T18:20:43.300 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.299+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=ZP7KPWRUUTP7 type=write size=893659 2024-01-13T18:20:43.302 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.301+0000 7f759fd04880 1 < completed write operation key=1WSQNY2NDY3K tag=OSPVNA88427D type=write size=632250 2024-01-13T18:20:43.304 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.303+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=4C6W75S4RL91 type=write size=450953 2024-01-13T18:20:43.306 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.305+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=RZTBFRVND9V0 type=del 2024-01-13T18:20:43.310 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.309+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~D69DHYC6I5H3.0 size=361489 2024-01-13T18:20:43.310 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.309+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=D69DHYC6I5H3 tag=TAWY7NYLBW45 type=write size=1410065 2024-01-13T18:20:43.312 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.311+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~C3EM28X5DT5Y.0 size=1048576 2024-01-13T18:20:43.313 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.311+0000 7f759fd04880 1 < canceled part key=_multipart_3K20F802EFEQ.2~C3EM28X5DT5Y.1 size=1048576 2024-01-13T18:20:43.313 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.311+0000 7f759fd04880 1 < canceled part key=_multipart_3K20F802EFEQ.2~C3EM28X5DT5Y.2 size=224814 2024-01-13T18:20:43.316 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.315+0000 7f759fd04880 1 < canceled multipart upload key=3K20F802EFEQ upload=C3EM28X5DT5Y tag=78MB6CKXWODP type=write size=3370542 2024-01-13T18:20:43.318 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.317+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=HIRK54X3RIYK type=del size=245086 2024-01-13T18:20:43.322 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.321+0000 7f759fd04880 1 < suggested update operation key=7WRTM9ANJRT4 tag=3PUDK54MS86F type=write size=888415 2024-01-13T18:20:43.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.323+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=93A52NX7F69M type=del size=1637157 2024-01-13T18:20:43.326 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.325+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~FO6E2HO73SYG.0 size=1048576 2024-01-13T18:20:43.328 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.327+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~FO6E2HO73SYG.1 size=413248 2024-01-13T18:20:43.332 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.331+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=FO6E2HO73SYG tag=FNSHSATNN9O8 type=write size=2510400 2024-01-13T18:20:43.337 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.336+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~YOQ3BSHXHNYT.0 size=166328 2024-01-13T18:20:43.337 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.336+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=YOQ3BSHXHNYT tag=GWJYY7CICIVJ type=write size=1214904 2024-01-13T18:20:43.339 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.338+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=8CO3QDNT1YYB type=del 2024-01-13T18:20:43.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.340+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=EAZXK5SSMBG3 type=del size=1195675 2024-01-13T18:20:43.343 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.342+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~0SIHYJM6FIO0.0 size=1048576 2024-01-13T18:20:43.345 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.344+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~0SIHYJM6FIO0.1 size=1048576 2024-01-13T18:20:43.346 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.345+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~0SIHYJM6FIO0.2 size=1032949 2024-01-13T18:20:43.354 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.349+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=0SIHYJM6FIO0 tag=HANUEN3SYF1Q type=write size=4178677 2024-01-13T18:20:43.354 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.351+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=1LII2885IR2Z type=del size=2971121 2024-01-13T18:20:43.354 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.353+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=VH7E375E5Z0X type=del 2024-01-13T18:20:43.356 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.355+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=XFEQSO0E61PS type=del size=469272 2024-01-13T18:20:43.358 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.357+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=K56O8K3JLQMH type=del 2024-01-13T18:20:43.360 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.359+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=3AQV8N6Z6GZ0 type=del size=3267403 2024-01-13T18:20:43.364 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.363+0000 7f759fd04880 1 < suggested remove operation key=XBTWSUA3D7U3 tag=7IT5GFESZ9HG type=del 2024-01-13T18:20:43.368 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.367+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~ROLP4FADBACD.0 size=1048576 2024-01-13T18:20:43.370 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.369+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~ROLP4FADBACD.1 size=1048576 2024-01-13T18:20:43.371 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.370+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~ROLP4FADBACD.2 size=598428 2024-01-13T18:20:43.371 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.370+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=ROLP4FADBACD tag=B0AI351HMIW0 type=write size=3744156 2024-01-13T18:20:43.374 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.373+0000 7f759fd04880 -1 < failed to complete operation key=XBTWSUA3D7U3 tag=XVAUZSNEDLNC type=del size=2353446: (22) Invalid argument 2024-01-13T18:20:43.379 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.378+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~GHGNY7I9C9V4.0 size=1048576 2024-01-13T18:20:43.380 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.379+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~GHGNY7I9C9V4.1 size=474058 2024-01-13T18:20:43.380 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.379+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=GHGNY7I9C9V4 tag=AAQ7UDXYJR4U type=write size=2571210 2024-01-13T18:20:43.384 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.383+0000 7f759fd04880 -1 < failed to complete operation key=XBTWSUA3D7U3 tag=9LJT7S4CEN9C type=del size=2923602: (22) Invalid argument 2024-01-13T18:20:43.386 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.385+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=OESTUX1C8UU7 type=write size=694360 2024-01-13T18:20:43.388 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.387+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=UQ930HL66K7R type=del 2024-01-13T18:20:43.392 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.391+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~TVDA7PMHS2PF.0 size=1048576 2024-01-13T18:20:43.393 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.392+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~TVDA7PMHS2PF.1 size=1048576 2024-01-13T18:20:43.395 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.394+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~TVDA7PMHS2PF.2 size=850255 2024-01-13T18:20:43.395 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.394+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=TVDA7PMHS2PF tag=5D7HGGHVTXA6 type=write size=3995983 2024-01-13T18:20:43.397 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.396+0000 7f759fd04880 1 < canceled operation key=6GOU0WSHKUQ0 tag=4A7B91H3UIFA type=write size=549650 2024-01-13T18:20:43.399 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.398+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=J2HABHALKTKH type=del size=1412547 2024-01-13T18:20:43.403 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.402+0000 7f759fd04880 1 < suggested update operation key=AJZB1PXB1NB5 tag=1S1SX2LNCYNG type=del size=1462705 2024-01-13T18:20:43.407 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.406+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~6MSHTE1Y7EZE.0 size=1048576 2024-01-13T18:20:43.409 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.408+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~6MSHTE1Y7EZE.1 size=612231 2024-01-13T18:20:43.409 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.408+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=6MSHTE1Y7EZE tag=964X6WPFTL6S type=write size=2709383 2024-01-13T18:20:43.411 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.410+0000 7f759fd04880 1 < completed write operation key=0TIZPXX8CMHA tag=ZP7KPWRUUTP7 type=write size=893659 2024-01-13T18:20:43.413 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.412+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=QL9GPELYPPJ1 type=del size=4002933 2024-01-13T18:20:43.415 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.414+0000 7f759fd04880 1 < completed write operation key=3K20F802EFEQ tag=4C6W75S4RL91 type=write size=450953 2024-01-13T18:20:43.417 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.416+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=89VOFG8PF6CP type=write size=925490 2024-01-13T18:20:43.419 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.418+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~D69DHYC6I5H3.0 size=361489 2024-01-13T18:20:43.423 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.421+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=D69DHYC6I5H3 tag=TAWY7NYLBW45 type=write size=1410065 2024-01-13T18:20:43.425 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.424+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=U4PJX44AGDH1 type=del size=889503 2024-01-13T18:20:43.427 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.426+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=HIRK54X3RIYK type=del 2024-01-13T18:20:43.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.428+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=O7EG67H82ANE type=del size=3013613 2024-01-13T18:20:43.433 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.432+0000 7f759fd04880 1 < suggested remove operation key=TNC2YDZYGM6G tag=93A52NX7F69M type=del 2024-01-13T18:20:43.435 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.434+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=1FYMNI18NU1O type=write size=440393 2024-01-13T18:20:43.438 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.437+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~YOQ3BSHXHNYT.0 size=166328 2024-01-13T18:20:43.442 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.441+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=YOQ3BSHXHNYT tag=GWJYY7CICIVJ type=write size=1214904 2024-01-13T18:20:43.444 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.443+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=7RYC62RTBB69 type=del size=1069750 2024-01-13T18:20:43.447 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.447+0000 7f759fd04880 1 < suggested remove operation key=H4VHC37BOZJ3 tag=EAZXK5SSMBG3 type=del 2024-01-13T18:20:43.451 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.450+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~94KH8C307ADH.0 size=1048576 2024-01-13T18:20:43.453 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.452+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~94KH8C307ADH.1 size=123784 2024-01-13T18:20:43.453 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.452+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=94KH8C307ADH tag=PZPJMRJM0BBN type=write size=2220936 2024-01-13T18:20:43.457 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.456+0000 7f759fd04880 1 < suggested update operation key=JN46AMLYHN8E tag=1LII2885IR2Z type=del size=2971121 2024-01-13T18:20:43.459 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.458+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=PTTQ2NHORUN2 type=del size=2776274 2024-01-13T18:20:43.461 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.460+0000 7f759fd04880 1 < canceled operation key=0TIZPXX8CMHA tag=XFEQSO0E61PS type=del size=469272 2024-01-13T18:20:43.463 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.462+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=UYS5DY33FOE7 type=del size=1544370 2024-01-13T18:20:43.464 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.464+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=3AQV8N6Z6GZ0 type=del 2024-01-13T18:20:43.468 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.467+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~8P798X26VOX9.0 size=325914 2024-01-13T18:20:43.468 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.467+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=8P798X26VOX9 tag=8S8X9OL6MD3M type=write size=1374490 2024-01-13T18:20:43.471 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.469+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~ROLP4FADBACD.0 size=1048576 2024-01-13T18:20:43.472 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.471+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~ROLP4FADBACD.1 size=1048576 2024-01-13T18:20:43.474 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.473+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~ROLP4FADBACD.2 size=598428 2024-01-13T18:20:43.477 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.476+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=ROLP4FADBACD tag=B0AI351HMIW0 type=write size=3744156 2024-01-13T18:20:43.479 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.478+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=SX5R1MBURE0W type=del size=3898133 2024-01-13T18:20:43.481 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.480+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~GHGNY7I9C9V4.0 size=1048576 2024-01-13T18:20:43.483 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.483+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~GHGNY7I9C9V4.1 size=474058 2024-01-13T18:20:43.488 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.487+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=GHGNY7I9C9V4 tag=AAQ7UDXYJR4U type=write size=2571210 2024-01-13T18:20:43.491 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.490+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~UJ7NHLQS4U3E.0 size=1048576 2024-01-13T18:20:43.493 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.492+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~UJ7NHLQS4U3E.1 size=800581 2024-01-13T18:20:43.493 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.492+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=UJ7NHLQS4U3E tag=RW7W8CAQ2J02 type=write size=2897733 2024-01-13T18:20:43.496 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.495+0000 7f759fd04880 1 < completed write operation key=WSRJB811XCVL tag=OESTUX1C8UU7 type=write size=694360 2024-01-13T18:20:43.498 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.497+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=461ZT9KKC0LH type=write size=266256 2024-01-13T18:20:43.500 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.499+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~TVDA7PMHS2PF.0 size=1048576 2024-01-13T18:20:43.502 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.501+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~TVDA7PMHS2PF.1 size=1048576 2024-01-13T18:20:43.504 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.503+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~TVDA7PMHS2PF.2 size=850255 2024-01-13T18:20:43.508 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.507+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=TVDA7PMHS2PF tag=5D7HGGHVTXA6 type=write size=3995983 2024-01-13T18:20:43.511 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.510+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~GMS9BT3QQS4F.0 size=1048576 2024-01-13T18:20:43.513 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.512+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~GMS9BT3QQS4F.1 size=576225 2024-01-13T18:20:43.513 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.512+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=GMS9BT3QQS4F tag=JEPTWB3WWCCL type=write size=2673377 2024-01-13T18:20:43.516 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.515+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=J2HABHALKTKH type=del 2024-01-13T18:20:43.518 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.517+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=KGVH7RNZODVE type=del size=2438342 2024-01-13T18:20:43.520 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.519+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~6MSHTE1Y7EZE.0 size=1048576 2024-01-13T18:20:43.522 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.521+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~6MSHTE1Y7EZE.1 size=612231 2024-01-13T18:20:43.527 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.526+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=6MSHTE1Y7EZE tag=964X6WPFTL6S type=write size=2709383 2024-01-13T18:20:43.529 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.528+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=BU4RLNE5E4T7 type=del size=3893695 2024-01-13T18:20:43.531 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.530+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=QL9GPELYPPJ1 type=del 2024-01-13T18:20:43.533 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.533+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=8V4G4OY9UWZ7 type=del size=2829604 2024-01-13T18:20:43.536 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.535+0000 7f759fd04880 1 < completed write operation key=7WRTM9ANJRT4 tag=89VOFG8PF6CP type=write size=925490 2024-01-13T18:20:43.538 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.537+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=TZ5SVLPT3Q08 type=del size=1685149 2024-01-13T18:20:43.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.539+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=U4PJX44AGDH1 type=del 2024-01-13T18:20:43.542 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.541+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=QMI32GC64OK5 type=del size=2362051 2024-01-13T18:20:43.545 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.544+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=O7EG67H82ANE type=del 2024-01-13T18:20:43.549 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.548+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~CKBAKO2GEZZE.0 size=1048576 2024-01-13T18:20:43.551 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.550+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~CKBAKO2GEZZE.1 size=1048576 2024-01-13T18:20:43.556 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.552+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~CKBAKO2GEZZE.2 size=28795 2024-01-13T18:20:43.556 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.552+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=CKBAKO2GEZZE tag=0ORPMN9MWL07 type=write size=3174523 2024-01-13T18:20:43.556 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.554+0000 7f759fd04880 1 < completed write operation key=7WRTM9ANJRT4 tag=1FYMNI18NU1O type=write size=440393 2024-01-13T18:20:43.558 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.557+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=76AA9SP9F783 type=write size=693909 2024-01-13T18:20:43.561 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.560+0000 7f759fd04880 1 < suggested update operation key=H972TC5DOMHL tag=7RYC62RTBB69 type=del size=1069750 2024-01-13T18:20:43.565 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.564+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~B3EAZ30H308J.0 size=1048576 2024-01-13T18:20:43.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.566+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~B3EAZ30H308J.1 size=900485 2024-01-13T18:20:43.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.566+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=B3EAZ30H308J tag=CVRH7E0D7HE7 type=write size=2997637 2024-01-13T18:20:43.569 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.568+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~94KH8C307ADH.0 size=1048576 2024-01-13T18:20:43.571 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.571+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~94KH8C307ADH.1 size=123784 2024-01-13T18:20:43.575 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.574+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=94KH8C307ADH tag=PZPJMRJM0BBN type=write size=2220936 2024-01-13T18:20:43.577 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.576+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=F1LURYKOD2OU type=del size=154046 2024-01-13T18:20:43.580 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.579+0000 7f759fd04880 1 < canceled operation key=XBTWSUA3D7U3 tag=PTTQ2NHORUN2 type=del size=2776274 2024-01-13T18:20:43.582 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.581+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=3LLETRECJG59 type=write size=727803 2024-01-13T18:20:43.584 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.583+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=UYS5DY33FOE7 type=del 2024-01-13T18:20:43.590 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.588+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~XJ5ONILOMLME.0 size=1048576 2024-01-13T18:20:43.591 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.590+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~XJ5ONILOMLME.1 size=262285 2024-01-13T18:20:43.591 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.590+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=XJ5ONILOMLME tag=O1QWWGVBD41W type=write size=2359437 2024-01-13T18:20:43.592 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.591+0000 7f759fd04880 1 < canceled part key=_multipart_1O3XX67RKHNW.2~8P798X26VOX9.0 size=325914 2024-01-13T18:20:43.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.594+0000 7f759fd04880 1 < canceled multipart upload key=1O3XX67RKHNW upload=8P798X26VOX9 tag=8S8X9OL6MD3M type=write size=1374490 2024-01-13T18:20:43.597 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.596+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=AZM5E6JL7GIX type=del size=311388 2024-01-13T18:20:43.599 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.598+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=SX5R1MBURE0W type=del 2024-01-13T18:20:43.601 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.601+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=JLJ8N2HMPJCE type=del size=2823495 2024-01-13T18:20:43.604 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.603+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~UJ7NHLQS4U3E.0 size=1048576 2024-01-13T18:20:43.605 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.604+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~UJ7NHLQS4U3E.1 size=800581 2024-01-13T18:20:43.609 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.608+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=UJ7NHLQS4U3E tag=RW7W8CAQ2J02 type=write size=2897733 2024-01-13T18:20:43.611 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.610+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=8DMYNOD5IPAE type=write size=82045 2024-01-13T18:20:43.615 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.614+0000 7f759fd04880 1 < suggested update operation key=1YNH6QHP354U tag=461ZT9KKC0LH type=write size=266256 2024-01-13T18:20:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:43 smithi099 ceph-mon[138788]: pgmap v1460: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 597 KiB/s rd, 207 KiB/s wr, 1.05k op/s 2024-01-13T18:20:43.619 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.619+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~KBE29FFAAG8H.0 size=1048576 2024-01-13T18:20:43.622 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.620+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~KBE29FFAAG8H.1 size=1020859 2024-01-13T18:20:43.622 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.620+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=KBE29FFAAG8H tag=DCZJ816GZJIM type=write size=3118011 2024-01-13T18:20:43.623 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.622+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~GMS9BT3QQS4F.0 size=1048576 2024-01-13T18:20:43.625 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.624+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~GMS9BT3QQS4F.1 size=576225 2024-01-13T18:20:43.629 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.628+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=GMS9BT3QQS4F tag=JEPTWB3WWCCL type=write size=2673377 2024-01-13T18:20:43.633 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.632+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~REVJ2N7LZCUO.0 size=1048576 2024-01-13T18:20:43.634 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.633+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~REVJ2N7LZCUO.1 size=450778 2024-01-13T18:20:43.635 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.633+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=REVJ2N7LZCUO tag=5ENGYE0OSGRQ type=write size=2547930 2024-01-13T18:20:43.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.636+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=KGVH7RNZODVE type=del 2024-01-13T18:20:43.639 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.638+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=1V04IP9EHYI7 type=del size=1610140 2024-01-13T18:20:43.641 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.640+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=BU4RLNE5E4T7 type=del 2024-01-13T18:20:43.645 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.644+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~OAO6OCYB8AZY.0 size=1048576 2024-01-13T18:20:43.647 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.646+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~OAO6OCYB8AZY.1 size=1048576 2024-01-13T18:20:43.650 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.649+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~OAO6OCYB8AZY.2 size=484302 2024-01-13T18:20:43.650 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.649+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=OAO6OCYB8AZY tag=J92G8EKIMHTB type=write size=3630030 2024-01-13T18:20:43.652 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.651+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=8V4G4OY9UWZ7 type=del 2024-01-13T18:20:43.656 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.655+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~4XTZ2YZTFW23.0 size=336393 2024-01-13T18:20:43.656 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.655+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=4XTZ2YZTFW23 tag=0X00PVA1PUA6 type=write size=1384969 2024-01-13T18:20:43.658 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.657+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=TZ5SVLPT3Q08 type=del 2024-01-13T18:20:43.660 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.659+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=94AKO319ISH2 type=del size=1110103 2024-01-13T18:20:43.662 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.661+0000 7f759fd04880 -1 < failed to complete operation key=1YNH6QHP354U tag=QMI32GC64OK5 type=del size=2362051: (22) Invalid argument 2024-01-13T18:20:43.667 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.666+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~XCE9M8034GZI.0 size=885528 2024-01-13T18:20:43.667 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.666+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=XCE9M8034GZI tag=SJSE8M91YAD6 type=write size=1934104 2024-01-13T18:20:43.667 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.666+0000 7f759fd04880 1 < canceled part key=_multipart_H7C1UAGAUR7D.2~CKBAKO2GEZZE.0 size=1048576 2024-01-13T18:20:43.669 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.668+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~CKBAKO2GEZZE.1 size=1048576 2024-01-13T18:20:43.671 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.670+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~CKBAKO2GEZZE.2 size=28795 2024-01-13T18:20:43.675 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.674+0000 7f759fd04880 1 < canceled multipart upload key=H7C1UAGAUR7D upload=CKBAKO2GEZZE tag=0ORPMN9MWL07 type=write size=3174523 2024-01-13T18:20:43.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:43 smithi084 ceph-mon[116404]: pgmap v1460: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 597 KiB/s rd, 207 KiB/s wr, 1.05k op/s 2024-01-13T18:20:43.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:43 smithi084 ceph-mon[119097]: pgmap v1460: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 597 KiB/s rd, 207 KiB/s wr, 1.05k op/s 2024-01-13T18:20:43.679 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.678+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~H8ZJSQ5MXRNB.0 size=1048576 2024-01-13T18:20:43.681 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.680+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~H8ZJSQ5MXRNB.1 size=1048576 2024-01-13T18:20:43.683 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.682+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~H8ZJSQ5MXRNB.2 size=567754 2024-01-13T18:20:43.683 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.682+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=H8ZJSQ5MXRNB tag=CS3CHG5TFBZ7 type=write size=3713482 2024-01-13T18:20:43.687 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.686+0000 7f759fd04880 1 < suggested remove operation key=TNC2YDZYGM6G tag=76AA9SP9F783 type=write 2024-01-13T18:20:43.689 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.688+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=DB6IB439JFAZ type=del size=3564084 2024-01-13T18:20:43.691 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.690+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~B3EAZ30H308J.0 size=1048576 2024-01-13T18:20:43.693 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.692+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~B3EAZ30H308J.1 size=900485 2024-01-13T18:20:43.696 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.695+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=B3EAZ30H308J tag=CVRH7E0D7HE7 type=write size=2997637 2024-01-13T18:20:43.700 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.699+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~A4YD598V80ZB.0 size=1048576 2024-01-13T18:20:43.702 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.701+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~A4YD598V80ZB.1 size=366985 2024-01-13T18:20:43.703 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.701+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=A4YD598V80ZB tag=05WQVADW6R44 type=write size=2464137 2024-01-13T18:20:43.705 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.704+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=F1LURYKOD2OU type=del 2024-01-13T18:20:43.707 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.706+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=56EU0SB2NOSE type=del size=3650185 2024-01-13T18:20:43.709 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.708+0000 7f759fd04880 1 < canceled operation key=3K20F802EFEQ tag=3LLETRECJG59 type=write size=727803 2024-01-13T18:20:43.711 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.710+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=FTOF8LWDNZK6 type=del size=3544231 2024-01-13T18:20:43.713 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.712+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~XJ5ONILOMLME.0 size=1048576 2024-01-13T18:20:43.715 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.715+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~XJ5ONILOMLME.1 size=262285 2024-01-13T18:20:43.720 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.719+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=XJ5ONILOMLME tag=O1QWWGVBD41W type=write size=2359437 2024-01-13T18:20:43.724 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.723+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~FNKRAB9LD662.0 size=998375 2024-01-13T18:20:43.724 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.723+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=FNKRAB9LD662 tag=Q7GX0OFIQVC4 type=write size=2046951 2024-01-13T18:20:43.726 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.725+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=AZM5E6JL7GIX type=del 2024-01-13T18:20:43.730 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.729+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~BJPWKSFHA8HS.0 size=1048576 2024-01-13T18:20:43.732 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.731+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~BJPWKSFHA8HS.1 size=845036 2024-01-13T18:20:43.732 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.731+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=BJPWKSFHA8HS tag=A6IOJ3Z5V18B type=write size=2942188 2024-01-13T18:20:43.734 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.733+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=JLJ8N2HMPJCE type=del 2024-01-13T18:20:43.737 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.736+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=LCJKBCPOGWNZ type=del size=2952247 2024-01-13T18:20:43.739 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.738+0000 7f759fd04880 1 < completed write operation key=H972TC5DOMHL tag=8DMYNOD5IPAE type=write size=82045 2024-01-13T18:20:43.741 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.740+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=KZFQTJYVS5SO type=del size=1439639 2024-01-13T18:20:43.743 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.742+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~KBE29FFAAG8H.0 size=1048576 2024-01-13T18:20:43.745 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.744+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~KBE29FFAAG8H.1 size=1020859 2024-01-13T18:20:43.748 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.747+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=KBE29FFAAG8H tag=DCZJ816GZJIM type=write size=3118011 2024-01-13T18:20:43.750 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.749+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=KJT78WMMY13K type=del size=2191897 2024-01-13T18:20:43.753 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.752+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~REVJ2N7LZCUO.0 size=1048576 2024-01-13T18:20:43.755 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.754+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~REVJ2N7LZCUO.1 size=450778 2024-01-13T18:20:43.759 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.757+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=REVJ2N7LZCUO tag=5ENGYE0OSGRQ type=write size=2547930 2024-01-13T18:20:43.761 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.760+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=U0YR0Z51R72C type=del size=2091211 2024-01-13T18:20:43.763 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.762+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=1V04IP9EHYI7 type=del 2024-01-13T18:20:43.765 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.764+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=UNQ3DRB8DQ26 type=del size=1054631 2024-01-13T18:20:43.767 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.766+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~OAO6OCYB8AZY.0 size=1048576 2024-01-13T18:20:43.768 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.767+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~OAO6OCYB8AZY.1 size=1048576 2024-01-13T18:20:43.770 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.769+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~OAO6OCYB8AZY.2 size=484302 2024-01-13T18:20:43.774 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.773+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=OAO6OCYB8AZY tag=J92G8EKIMHTB type=write size=3630030 2024-01-13T18:20:43.778 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.777+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~HN2VJRYHIRQK.0 size=1048576 2024-01-13T18:20:43.780 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.779+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~HN2VJRYHIRQK.1 size=1048576 2024-01-13T18:20:43.782 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.781+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~HN2VJRYHIRQK.2 size=157389 2024-01-13T18:20:43.782 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.781+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=HN2VJRYHIRQK tag=7VQDK217ST17 type=write size=3303117 2024-01-13T18:20:43.782 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.781+0000 7f759fd04880 1 < canceled part key=_multipart_AJZB1PXB1NB5.2~4XTZ2YZTFW23.0 size=336393 2024-01-13T18:20:43.786 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.785+0000 7f759fd04880 1 < canceled multipart upload key=AJZB1PXB1NB5 upload=4XTZ2YZTFW23 tag=0X00PVA1PUA6 type=write size=1384969 2024-01-13T18:20:43.788 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.787+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=391OQHEVMVVZ type=del size=3286057 2024-01-13T18:20:43.791 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.790+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=94AKO319ISH2 type=del 2024-01-13T18:20:43.793 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.792+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=XR5YKXA1GAWJ type=write size=1017619 2024-01-13T18:20:43.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.794+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~XCE9M8034GZI.0 size=885528 2024-01-13T18:20:43.798 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.797+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=XCE9M8034GZI tag=SJSE8M91YAD6 type=write size=1934104 2024-01-13T18:20:43.800 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.799+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=70GKLMUQI0MM type=del size=3262607 2024-01-13T18:20:43.800 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.800+0000 7f759fd04880 1 < canceled part key=_multipart_TNC2YDZYGM6G.2~H8ZJSQ5MXRNB.0 size=1048576 2024-01-13T18:20:43.802 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.801+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~H8ZJSQ5MXRNB.1 size=1048576 2024-01-13T18:20:43.804 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.803+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~H8ZJSQ5MXRNB.2 size=567754 2024-01-13T18:20:43.808 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.807+0000 7f759fd04880 1 < canceled multipart upload key=TNC2YDZYGM6G upload=H8ZJSQ5MXRNB tag=CS3CHG5TFBZ7 type=write size=3713482 2024-01-13T18:20:43.812 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.811+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~XGJSVC65RB1Z.0 size=531684 2024-01-13T18:20:43.812 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.811+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=XGJSVC65RB1Z tag=93TSBIEW34AC type=write size=1580260 2024-01-13T18:20:43.814 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.813+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=DB6IB439JFAZ type=del 2024-01-13T18:20:43.816 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.815+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=TKJCZQ919K7E type=del size=386958 2024-01-13T18:20:43.818 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.817+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~A4YD598V80ZB.0 size=1048576 2024-01-13T18:20:43.820 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.819+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~A4YD598V80ZB.1 size=366985 2024-01-13T18:20:43.824 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.823+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=A4YD598V80ZB tag=05WQVADW6R44 type=write size=2464137 2024-01-13T18:20:43.828 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.826+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~X4V7HLSGAFI3.0 size=1048576 2024-01-13T18:20:43.830 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.829+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~X4V7HLSGAFI3.1 size=959581 2024-01-13T18:20:43.830 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.829+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=X4V7HLSGAFI3 tag=1ZUR4L2INGB0 type=write size=3056733 2024-01-13T18:20:43.832 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.831+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=56EU0SB2NOSE type=del 2024-01-13T18:20:43.834 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.833+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=SV07CBSMHIZG type=del size=2560150 2024-01-13T18:20:43.836 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.835+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=FTOF8LWDNZK6 type=del 2024-01-13T18:20:43.838 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.837+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=4FWA53KOVM2P type=write size=616392 2024-01-13T18:20:43.841 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.840+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~FNKRAB9LD662.0 size=998375 2024-01-13T18:20:43.845 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.844+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=FNKRAB9LD662 tag=Q7GX0OFIQVC4 type=write size=2046951 2024-01-13T18:20:43.849 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.849+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~AOC4E4MEQQJI.0 size=1048576 2024-01-13T18:20:43.852 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.850+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~AOC4E4MEQQJI.1 size=1048576 2024-01-13T18:20:43.853 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.852+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~AOC4E4MEQQJI.2 size=572485 2024-01-13T18:20:43.853 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.852+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=AOC4E4MEQQJI tag=UC9446PI1A9X type=write size=3718213 2024-01-13T18:20:43.855 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.854+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~BJPWKSFHA8HS.0 size=1048576 2024-01-13T18:20:43.858 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.857+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~BJPWKSFHA8HS.1 size=845036 2024-01-13T18:20:43.862 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.861+0000 7f759fd04880 1 < completed multipart upload key=7R5YIO7UFSDZ upload=BJPWKSFHA8HS tag=A6IOJ3Z5V18B type=write size=2942188 2024-01-13T18:20:43.864 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.863+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=72SJ5R288LOX type=del size=1442265 2024-01-13T18:20:43.866 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.865+0000 7f759fd04880 1 < canceled operation key=DOXP3EJ03EBY tag=LCJKBCPOGWNZ type=del size=2952247 2024-01-13T18:20:43.870 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.869+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~UP4MDI680RCV.0 size=1048576 2024-01-13T18:20:43.871 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.870+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~UP4MDI680RCV.1 size=1048576 2024-01-13T18:20:43.873 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.873+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~UP4MDI680RCV.2 size=581752 2024-01-13T18:20:43.874 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.873+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=UP4MDI680RCV tag=PRRRHI74ZL8U type=write size=3727480 2024-01-13T18:20:43.877 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.876+0000 7f759fd04880 1 < suggested remove operation key=7LXXSKLOM1JZ tag=KZFQTJYVS5SO type=del 2024-01-13T18:20:43.883 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.880+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~FT6HPQZ4T9T8.0 size=1048576 2024-01-13T18:20:43.883 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.882+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~FT6HPQZ4T9T8.1 size=818192 2024-01-13T18:20:43.883 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.882+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=FT6HPQZ4T9T8 tag=VTQA5NIIXSYZ type=write size=2915344 2024-01-13T18:20:43.887 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.886+0000 7f759fd04880 1 < suggested remove operation key=RY0W5S41XK3F tag=KJT78WMMY13K type=del 2024-01-13T18:20:43.892 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.891+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~KMSFKXTD76DJ.0 size=1048576 2024-01-13T18:20:43.895 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.893+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~KMSFKXTD76DJ.1 size=590297 2024-01-13T18:20:43.895 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.893+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=KMSFKXTD76DJ tag=6WM3SZ5SVDIK type=write size=2687449 2024-01-13T18:20:43.896 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.895+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=U0YR0Z51R72C type=del 2024-01-13T18:20:43.899 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.898+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~5H99X6P4ETXW.0 size=98611 2024-01-13T18:20:43.899 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.898+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=5H99X6P4ETXW tag=6LY40G14INDY type=write size=1147187 2024-01-13T18:20:43.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.900+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=UNQ3DRB8DQ26 type=del 2024-01-13T18:20:43.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.902+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=9GMV6F7JJP0Y type=del size=3763552 2024-01-13T18:20:43.905 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.905+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~HN2VJRYHIRQK.0 size=1048576 2024-01-13T18:20:43.907 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.906+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~HN2VJRYHIRQK.1 size=1048576 2024-01-13T18:20:43.909 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.908+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~HN2VJRYHIRQK.2 size=157389 2024-01-13T18:20:43.913 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.912+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=HN2VJRYHIRQK tag=7VQDK217ST17 type=write size=3303117 2024-01-13T18:20:43.915 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.914+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=O87448UBEIFJ type=del size=2455787 2024-01-13T18:20:43.918 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.917+0000 7f759fd04880 -1 < failed to complete operation key=RY0W5S41XK3F tag=391OQHEVMVVZ type=del size=3286057: (22) Invalid argument 2024-01-13T18:20:43.921 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.920+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~6L5EIIZ0QM6B.0 size=169602 2024-01-13T18:20:43.922 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.920+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=6L5EIIZ0QM6B tag=Q0ISQLNN92U3 type=write size=1218178 2024-01-13T18:20:43.923 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.922+0000 7f759fd04880 1 < completed write operation key=QD5GBLNCY707 tag=XR5YKXA1GAWJ type=write size=1017619 2024-01-13T18:20:43.927 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.926+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~MWZ05EROTHOF.0 size=690728 2024-01-13T18:20:43.927 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.926+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=MWZ05EROTHOF tag=3MOKO34OFHUC type=write size=1739304 2024-01-13T18:20:43.929 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.928+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=70GKLMUQI0MM type=del 2024-01-13T18:20:43.931 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.930+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=YVKZ4BNWPKTN type=del size=2281939 2024-01-13T18:20:43.932 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.930+0000 7f759fd04880 1 < canceled part key=_multipart_7R5YIO7UFSDZ.2~XGJSVC65RB1Z.0 size=531684 2024-01-13T18:20:43.935 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.934+0000 7f759fd04880 1 < canceled multipart upload key=7R5YIO7UFSDZ upload=XGJSVC65RB1Z tag=93TSBIEW34AC type=write size=1580260 2024-01-13T18:20:43.937 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.936+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=CM3A3UJN1B3X type=del size=2257851 2024-01-13T18:20:43.939 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.938+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=TKJCZQ919K7E type=del 2024-01-13T18:20:43.944 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.942+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~PZ00RPXMH9W8.0 size=224690 2024-01-13T18:20:43.944 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.942+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=PZ00RPXMH9W8 tag=OF1FNE9656O0 type=write size=1273266 2024-01-13T18:20:43.945 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.944+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~X4V7HLSGAFI3.0 size=1048576 2024-01-13T18:20:43.947 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.946+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~X4V7HLSGAFI3.1 size=959581 2024-01-13T18:20:43.951 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.950+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=X4V7HLSGAFI3 tag=1ZUR4L2INGB0 type=write size=3056733 2024-01-13T18:20:43.953 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.952+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=39TD0XJ2E09R type=del size=2550044 2024-01-13T18:20:43.955 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.954+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=SV07CBSMHIZG type=del 2024-01-13T18:20:43.957 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.956+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=90R3Q38PHT6I type=del size=822646 2024-01-13T18:20:43.959 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.958+0000 7f759fd04880 1 < completed write operation key=BPUBFFWB9D3C tag=4FWA53KOVM2P type=write size=616392 2024-01-13T18:20:43.963 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.962+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~T8V2S60RLR41.0 size=1048576 2024-01-13T18:20:43.964 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.963+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~T8V2S60RLR41.1 size=1048576 2024-01-13T18:20:43.966 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.965+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~T8V2S60RLR41.2 size=77290 2024-01-13T18:20:43.966 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.965+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=T8V2S60RLR41 tag=514BJR3DV2TB type=write size=3223018 2024-01-13T18:20:43.968 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.967+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~AOC4E4MEQQJI.0 size=1048576 2024-01-13T18:20:43.970 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.969+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~AOC4E4MEQQJI.1 size=1048576 2024-01-13T18:20:43.972 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.971+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~AOC4E4MEQQJI.2 size=572485 2024-01-13T18:20:43.975 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.974+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=AOC4E4MEQQJI tag=UC9446PI1A9X type=write size=3718213 2024-01-13T18:20:43.980 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.979+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~CT3GFB3VDLBV.0 size=1048576 2024-01-13T18:20:43.982 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.980+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~CT3GFB3VDLBV.1 size=1048576 2024-01-13T18:20:43.983 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.982+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~CT3GFB3VDLBV.2 size=43628 2024-01-13T18:20:43.983 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.982+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=CT3GFB3VDLBV tag=03TELZ5MWX3Q type=write size=3189356 2024-01-13T18:20:43.987 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.986+0000 7f759fd04880 1 < suggested update operation key=WSRJB811XCVL tag=72SJ5R288LOX type=del size=1442265 2024-01-13T18:20:43.990 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.989+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=YDV0UV6O50ER type=del size=2929042 2024-01-13T18:20:43.991 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.990+0000 7f759fd04880 1 < canceled part key=_multipart_3K20F802EFEQ.2~UP4MDI680RCV.0 size=1048576 2024-01-13T18:20:43.992 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.991+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~UP4MDI680RCV.1 size=1048576 2024-01-13T18:20:43.994 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.993+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~UP4MDI680RCV.2 size=581752 2024-01-13T18:20:43.997 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.996+0000 7f759fd04880 1 < canceled multipart upload key=3K20F802EFEQ upload=UP4MDI680RCV tag=PRRRHI74ZL8U type=write size=3727480 2024-01-13T18:20:44.000 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:43.999+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=SXRZ568OL4UR type=del size=3388992 2024-01-13T18:20:44.002 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.001+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~FT6HPQZ4T9T8.0 size=1048576 2024-01-13T18:20:44.003 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.003+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~FT6HPQZ4T9T8.1 size=818192 2024-01-13T18:20:44.008 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.007+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=FT6HPQZ4T9T8 tag=VTQA5NIIXSYZ type=write size=2915344 2024-01-13T18:20:44.011 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.010+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~J8XGRQ9Z4UNO.0 size=1048576 2024-01-13T18:20:44.013 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.012+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~J8XGRQ9Z4UNO.1 size=1048576 2024-01-13T18:20:44.015 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.014+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~J8XGRQ9Z4UNO.2 size=797442 2024-01-13T18:20:44.015 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.014+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=J8XGRQ9Z4UNO tag=I7K2OR5XPVHK type=write size=3943170 2024-01-13T18:20:44.017 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.016+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~KMSFKXTD76DJ.0 size=1048576 2024-01-13T18:20:44.019 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.018+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~KMSFKXTD76DJ.1 size=590297 2024-01-13T18:20:44.022 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.022+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=KMSFKXTD76DJ tag=6WM3SZ5SVDIK type=write size=2687449 2024-01-13T18:20:44.025 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.024+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=BNFCP6X7EP80 type=del size=149955 2024-01-13T18:20:44.027 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.026+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~5H99X6P4ETXW.0 size=98611 2024-01-13T18:20:44.031 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.029+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=5H99X6P4ETXW tag=6LY40G14INDY type=write size=1147187 2024-01-13T18:20:44.032 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.031+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=H6N3C1CMFUES type=del size=1372947 2024-01-13T18:20:44.034 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.034+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=9GMV6F7JJP0Y type=del 2024-01-13T18:20:44.037 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.036+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=QIRYYYGNNIZV type=write size=938692 2024-01-13T18:20:44.039 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.038+0000 7f759fd04880 1 < canceled operation key=VZHGQM6ZNJYQ tag=O87448UBEIFJ type=del size=2455787 2024-01-13T18:20:44.041 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.040+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=66728VAZB1BC type=del size=1053359 2024-01-13T18:20:44.043 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.042+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~6L5EIIZ0QM6B.0 size=169602 2024-01-13T18:20:44.046 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.045+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=6L5EIIZ0QM6B tag=Q0ISQLNN92U3 type=write size=1218178 2024-01-13T18:20:44.048 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.047+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=TCZEMW9BZD2V type=del size=2529568 2024-01-13T18:20:44.050 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.049+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~MWZ05EROTHOF.0 size=690728 2024-01-13T18:20:44.054 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.053+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=MWZ05EROTHOF tag=3MOKO34OFHUC type=write size=1739304 2024-01-13T18:20:44.058 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.057+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~DR87Q88KU0F9.0 size=1048576 2024-01-13T18:20:44.060 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.059+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~DR87Q88KU0F9.1 size=120776 2024-01-13T18:20:44.060 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.059+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=DR87Q88KU0F9 tag=2RPTY0DJ0VAB type=write size=2217928 2024-01-13T18:20:44.065 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.064+0000 7f759fd04880 1 < suggested update operation key=3K20F802EFEQ tag=YVKZ4BNWPKTN type=del size=2281939 2024-01-13T18:20:44.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.068+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~MJ31IXF6ERJA.0 size=917134 2024-01-13T18:20:44.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.068+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=MJ31IXF6ERJA tag=TVA74X21WZ6N type=write size=1965710 2024-01-13T18:20:44.071 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.070+0000 7f759fd04880 1 < completed delete operation key=1YNH6QHP354U tag=CM3A3UJN1B3X type=del 2024-01-13T18:20:44.073 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.072+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=PYT95DIGVPR7 type=del size=259176 2024-01-13T18:20:44.075 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.074+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~PZ00RPXMH9W8.0 size=224690 2024-01-13T18:20:44.079 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.078+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=PZ00RPXMH9W8 tag=OF1FNE9656O0 type=write size=1273266 2024-01-13T18:20:44.083 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.082+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~BEXR14M9XWUZ.0 size=1048576 2024-01-13T18:20:44.085 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.084+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~BEXR14M9XWUZ.1 size=1048576 2024-01-13T18:20:44.087 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.086+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~BEXR14M9XWUZ.2 size=747412 2024-01-13T18:20:44.087 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.086+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=BEXR14M9XWUZ tag=GB0USHJX61YX type=write size=3893140 2024-01-13T18:20:44.089 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.088+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=39TD0XJ2E09R type=del 2024-01-13T18:20:44.092 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.091+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=ZLKIP15RZ1GI type=del size=755775 2024-01-13T18:20:44.095 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.093+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=90R3Q38PHT6I type=del 2024-01-13T18:20:44.096 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.095+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=BK4GR99JU720 type=write size=397974 2024-01-13T18:20:44.098 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.097+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~T8V2S60RLR41.0 size=1048576 2024-01-13T18:20:44.100 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.099+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~T8V2S60RLR41.1 size=1048576 2024-01-13T18:20:44.100 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.099+0000 7f759fd04880 1 < canceled part key=_multipart_8EWIOXN5H9KU.2~T8V2S60RLR41.2 size=77290 2024-01-13T18:20:44.103 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.102+0000 7f759fd04880 1 < canceled multipart upload key=8EWIOXN5H9KU upload=T8V2S60RLR41 tag=514BJR3DV2TB type=write size=3223018 2024-01-13T18:20:44.105 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.104+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=DMP03U0712JZ type=del size=2415494 2024-01-13T18:20:44.107 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.106+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~CT3GFB3VDLBV.0 size=1048576 2024-01-13T18:20:44.109 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.108+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~CT3GFB3VDLBV.1 size=1048576 2024-01-13T18:20:44.111 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.110+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~CT3GFB3VDLBV.2 size=43628 2024-01-13T18:20:44.115 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.114+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=CT3GFB3VDLBV tag=03TELZ5MWX3Q type=write size=3189356 2024-01-13T18:20:44.118 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.117+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~MI6MT16SUUNM.0 size=1048576 2024-01-13T18:20:44.120 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.119+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~MI6MT16SUUNM.1 size=255016 2024-01-13T18:20:44.120 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.119+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=MI6MT16SUUNM tag=033A9FFK1AI0 type=write size=2352168 2024-01-13T18:20:44.122 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.121+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=YDV0UV6O50ER type=del 2024-01-13T18:20:44.126 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.125+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~A43JX1Y1NSKG.0 size=127209 2024-01-13T18:20:44.126 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.125+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=A43JX1Y1NSKG tag=SK6HXNP47RWH type=write size=1175785 2024-01-13T18:20:44.131 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.130+0000 7f759fd04880 1 < suggested remove operation key=WSRJB811XCVL tag=SXRZ568OL4UR type=del 2024-01-13T18:20:44.135 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.134+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~ZIIYALNT6CDY.0 size=1048576 2024-01-13T18:20:44.136 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.135+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~ZIIYALNT6CDY.1 size=1048576 2024-01-13T18:20:44.138 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.137+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~ZIIYALNT6CDY.2 size=162019 2024-01-13T18:20:44.138 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.137+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=ZIIYALNT6CDY tag=A9P9BX280J0L type=write size=3307747 2024-01-13T18:20:44.141 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.139+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~J8XGRQ9Z4UNO.0 size=1048576 2024-01-13T18:20:44.142 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.141+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~J8XGRQ9Z4UNO.1 size=1048576 2024-01-13T18:20:44.144 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.143+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~J8XGRQ9Z4UNO.2 size=797442 2024-01-13T18:20:44.147 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.146+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=J8XGRQ9Z4UNO tag=I7K2OR5XPVHK type=write size=3943170 2024-01-13T18:20:44.149 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.148+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=VCIVAKLHJDUG type=write size=388586 2024-01-13T18:20:44.152 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.151+0000 7f759fd04880 1 < canceled operation key=H972TC5DOMHL tag=BNFCP6X7EP80 type=del size=149955 2024-01-13T18:20:44.154 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.153+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=LPWR085NQQVI type=del size=3261386 2024-01-13T18:20:44.158 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.157+0000 7f759fd04880 1 < suggested update operation key=H4VHC37BOZJ3 tag=H6N3C1CMFUES type=del size=1372947 2024-01-13T18:20:44.160 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.159+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=TF3FU1CT41H6 type=del size=1703717 2024-01-13T18:20:44.162 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.161+0000 7f759fd04880 1 < completed write operation key=OMA1B74S8FXS tag=QIRYYYGNNIZV type=write size=938692 2024-01-13T18:20:44.164 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.163+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=BTAXFALZ3SMW type=del size=2590384 2024-01-13T18:20:44.166 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.165+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=66728VAZB1BC type=del 2024-01-13T18:20:44.169 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.168+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=91PH9XNT693H type=del size=593403 2024-01-13T18:20:44.173 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.172+0000 7f759fd04880 1 < suggested update operation key=7WRTM9ANJRT4 tag=TCZEMW9BZD2V type=del size=2529568 2024-01-13T18:20:44.176 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.175+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~3EUWA0GTW6EV.0 size=1048576 2024-01-13T18:20:44.178 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.177+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~3EUWA0GTW6EV.1 size=1048576 2024-01-13T18:20:44.180 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.179+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~3EUWA0GTW6EV.2 size=1032422 2024-01-13T18:20:44.180 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.179+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=3EUWA0GTW6EV tag=QX3QD3MFLSB6 type=write size=4178150 2024-01-13T18:20:44.182 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.181+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~DR87Q88KU0F9.0 size=1048576 2024-01-13T18:20:44.183 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.183+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~DR87Q88KU0F9.1 size=120776 2024-01-13T18:20:44.187 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.187+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=DR87Q88KU0F9 tag=2RPTY0DJ0VAB type=write size=2217928 2024-01-13T18:20:44.189 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.188+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=HOLJG4MODUZK type=del size=754928 2024-01-13T18:20:44.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.190+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~MJ31IXF6ERJA.0 size=917134 2024-01-13T18:20:44.195 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.194+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=MJ31IXF6ERJA tag=TVA74X21WZ6N type=write size=1965710 2024-01-13T18:20:44.197 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.196+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=F1AT1XYHTSMV type=write size=957194 2024-01-13T18:20:44.199 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.198+0000 7f759fd04880 1 < canceled operation key=7LXXSKLOM1JZ tag=PYT95DIGVPR7 type=del size=259176 2024-01-13T18:20:44.202 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.201+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~T72BOUF6FUA3.0 size=1048576 2024-01-13T18:20:44.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.203+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~T72BOUF6FUA3.1 size=1048576 2024-01-13T18:20:44.205 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.204+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~T72BOUF6FUA3.2 size=167536 2024-01-13T18:20:44.205 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.204+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=T72BOUF6FUA3 tag=12429OSQRK4X type=write size=3313264 2024-01-13T18:20:44.207 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.206+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~BEXR14M9XWUZ.0 size=1048576 2024-01-13T18:20:44.209 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.208+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~BEXR14M9XWUZ.1 size=1048576 2024-01-13T18:20:44.209 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.208+0000 7f759fd04880 1 < canceled part key=_multipart_8EWIOXN5H9KU.2~BEXR14M9XWUZ.2 size=747412 2024-01-13T18:20:44.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.212+0000 7f759fd04880 1 < canceled multipart upload key=8EWIOXN5H9KU upload=BEXR14M9XWUZ tag=GB0USHJX61YX type=write size=3893140 2024-01-13T18:20:44.215 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.214+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=JWVDVA4PJWNY type=del size=2827989 2024-01-13T18:20:44.216 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.215+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=ZLKIP15RZ1GI type=del 2024-01-13T18:20:44.219 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.218+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=BRAZ0QZLV31J type=write size=740487 2024-01-13T18:20:44.221 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.220+0000 7f759fd04880 1 < completed write operation key=XBTWSUA3D7U3 tag=BK4GR99JU720 type=write size=397974 2024-01-13T18:20:44.222 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.221+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=SZGCJE43IIR8 type=del size=2967622 2024-01-13T18:20:44.224 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.223+0000 7f759fd04880 1 < completed delete operation key=ZI9WAZQHVPAR tag=DMP03U0712JZ type=del 2024-01-13T18:20:44.226 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.225+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=FMRF41EPV306 type=write size=596920 2024-01-13T18:20:44.228 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.227+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~MI6MT16SUUNM.0 size=1048576 2024-01-13T18:20:44.230 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.229+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~MI6MT16SUUNM.1 size=255016 2024-01-13T18:20:44.234 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.233+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=MI6MT16SUUNM tag=033A9FFK1AI0 type=write size=2352168 2024-01-13T18:20:44.236 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.235+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=RDSZEW7R7VMU type=del size=1048915 2024-01-13T18:20:44.237 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.237+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~A43JX1Y1NSKG.0 size=127209 2024-01-13T18:20:44.241 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.240+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=A43JX1Y1NSKG tag=SK6HXNP47RWH type=write size=1175785 2024-01-13T18:20:44.245 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.244+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~AFZYAXGZP6K2.0 size=1048576 2024-01-13T18:20:44.247 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.246+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~AFZYAXGZP6K2.1 size=602196 2024-01-13T18:20:44.247 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.246+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=AFZYAXGZP6K2 tag=562UNRU80HCX type=write size=2699348 2024-01-13T18:20:44.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.248+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~ZIIYALNT6CDY.0 size=1048576 2024-01-13T18:20:44.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.248+0000 7f759fd04880 1 < canceled part key=_multipart_7R5YIO7UFSDZ.2~ZIIYALNT6CDY.1 size=1048576 2024-01-13T18:20:44.251 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.250+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~ZIIYALNT6CDY.2 size=162019 2024-01-13T18:20:44.254 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.253+0000 7f759fd04880 1 < canceled multipart upload key=7R5YIO7UFSDZ upload=ZIIYALNT6CDY tag=A9P9BX280J0L type=write size=3307747 2024-01-13T18:20:44.256 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.255+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=8GT3GRGDIG6K type=del size=3482861 2024-01-13T18:20:44.258 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.257+0000 7f759fd04880 1 < completed write operation key=8EWIOXN5H9KU tag=VCIVAKLHJDUG type=write size=388586 2024-01-13T18:20:44.260 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.259+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=1F4EODWECEMP type=del size=2931722 2024-01-13T18:20:44.262 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.261+0000 7f759fd04880 -1 < failed to complete operation key=7WRTM9ANJRT4 tag=LPWR085NQQVI type=del size=3261386: (22) Invalid argument 2024-01-13T18:20:44.266 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.265+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~5DVQMXRJ79PN.0 size=1048576 2024-01-13T18:20:44.268 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.267+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~5DVQMXRJ79PN.1 size=964549 2024-01-13T18:20:44.268 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.267+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=5DVQMXRJ79PN tag=BA73QIIKD94Q type=write size=3061701 2024-01-13T18:20:44.270 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.269+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=TF3FU1CT41H6 type=del 2024-01-13T18:20:44.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.271+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=FVHLD7Y5D7BG type=del size=848806 2024-01-13T18:20:44.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.273+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=BTAXFALZ3SMW type=del 2024-01-13T18:20:44.278 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.277+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~FQ373UONKZK4.0 size=1048576 2024-01-13T18:20:44.280 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.279+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~FQ373UONKZK4.1 size=305625 2024-01-13T18:20:44.280 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.279+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=FQ373UONKZK4 tag=V67ACGP6BWRJ type=write size=2402777 2024-01-13T18:20:44.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.281+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=91PH9XNT693H type=del 2024-01-13T18:20:44.284 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.283+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=3507CC68PUPV type=del size=1247179 2024-01-13T18:20:44.286 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.285+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~3EUWA0GTW6EV.0 size=1048576 2024-01-13T18:20:44.290 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.289+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~3EUWA0GTW6EV.1 size=1048576 2024-01-13T18:20:44.292 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.291+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~3EUWA0GTW6EV.2 size=1032422 2024-01-13T18:20:44.296 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.295+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=3EUWA0GTW6EV tag=QX3QD3MFLSB6 type=write size=4178150 2024-01-13T18:20:44.298 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.297+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=SQFKGG97X03G type=del size=1858951 2024-01-13T18:20:44.300 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.299+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=HOLJG4MODUZK type=del 2024-01-13T18:20:44.304 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.303+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~EA6FKN7H6IIQ.0 size=1048576 2024-01-13T18:20:44.305 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.305+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~EA6FKN7H6IIQ.1 size=679083 2024-01-13T18:20:44.306 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.305+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=EA6FKN7H6IIQ tag=L6SD1F40XXFF type=write size=2776235 2024-01-13T18:20:44.307 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.306+0000 7f759fd04880 1 < completed write operation key=DOXP3EJ03EBY tag=F1AT1XYHTSMV type=write size=957194 2024-01-13T18:20:44.309 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.308+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=W60G9YMDN0EA type=del size=2138413 2024-01-13T18:20:44.310 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.309+0000 7f759fd04880 1 < canceled part key=_multipart_7LXXSKLOM1JZ.2~T72BOUF6FUA3.0 size=1048576 2024-01-13T18:20:44.310 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.309+0000 7f759fd04880 1 < canceled part key=_multipart_7LXXSKLOM1JZ.2~T72BOUF6FUA3.1 size=1048576 2024-01-13T18:20:44.311 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.310+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~T72BOUF6FUA3.2 size=167536 2024-01-13T18:20:44.315 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.314+0000 7f759fd04880 1 < canceled multipart upload key=7LXXSKLOM1JZ upload=T72BOUF6FUA3 tag=12429OSQRK4X type=write size=3313264 2024-01-13T18:20:44.318 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.317+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~MSNR40DAAZQ5.0 size=1048576 2024-01-13T18:20:44.320 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.319+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~MSNR40DAAZQ5.1 size=853890 2024-01-13T18:20:44.320 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.319+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=MSNR40DAAZQ5 tag=4IQ9YJC95VUD type=write size=2951042 2024-01-13T18:20:44.322 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.321+0000 7f759fd04880 1 < canceled operation key=XBTWSUA3D7U3 tag=JWVDVA4PJWNY type=del size=2827989 2024-01-13T18:20:44.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.323+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=L9KUSMF1JHQ0 type=del size=2740682 2024-01-13T18:20:44.326 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.325+0000 7f759fd04880 1 < completed write operation key=BPUBFFWB9D3C tag=BRAZ0QZLV31J type=write size=740487 2024-01-13T18:20:44.329 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.329+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~FJHSUSSN7Z3J.0 size=1048576 2024-01-13T18:20:44.331 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.330+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~FJHSUSSN7Z3J.1 size=1048576 2024-01-13T18:20:44.333 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.332+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~FJHSUSSN7Z3J.2 size=942819 2024-01-13T18:20:44.333 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.332+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=FJHSUSSN7Z3J tag=UFPJBBBPWCCK type=write size=4088547 2024-01-13T18:20:44.337 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.336+0000 7f759fd04880 1 < suggested remove operation key=2OO7S2NBZ7M6 tag=SZGCJE43IIR8 type=del 2024-01-13T18:20:44.339 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.338+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=2NN2ZF49DE7D type=del size=1983553 2024-01-13T18:20:44.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.340+0000 7f759fd04880 1 < completed write operation key=WSRJB811XCVL tag=FMRF41EPV306 type=write size=596920 2024-01-13T18:20:44.343 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.342+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=OBR2JXPUSKH6 type=del size=416339 2024-01-13T18:20:44.345 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.344+0000 7f759fd04880 1 < canceled operation key=OMA1B74S8FXS tag=RDSZEW7R7VMU type=del size=1048915 2024-01-13T18:20:44.347 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.346+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=JRINFRAQF74N type=write size=1005704 2024-01-13T18:20:44.347 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.346+0000 7f759fd04880 1 < canceled part key=_multipart_QS9PLJKINY4R.2~AFZYAXGZP6K2.0 size=1048576 2024-01-13T18:20:44.349 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.348+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~AFZYAXGZP6K2.1 size=602196 2024-01-13T18:20:44.353 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.352+0000 7f759fd04880 1 < canceled multipart upload key=QS9PLJKINY4R upload=AFZYAXGZP6K2 tag=562UNRU80HCX type=write size=2699348 2024-01-13T18:20:44.355 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.354+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=UTSPLIL3PA5Q type=del size=4040407 2024-01-13T18:20:44.356 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.356+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=8GT3GRGDIG6K type=del 2024-01-13T18:20:44.361 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.360+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~18GOJTM7DKF9.0 size=257471 2024-01-13T18:20:44.361 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.360+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=18GOJTM7DKF9 tag=SSUSGAWUIL2Y type=write size=1306047 2024-01-13T18:20:44.365 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.364+0000 7f759fd04880 1 < suggested remove operation key=TNC2YDZYGM6G tag=1F4EODWECEMP type=del 2024-01-13T18:20:44.370 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.369+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~QQUNV3UPOTGH.0 size=1048576 2024-01-13T18:20:44.371 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.370+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~QQUNV3UPOTGH.1 size=312572 2024-01-13T18:20:44.371 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.370+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=QQUNV3UPOTGH tag=XTJO53MY33C1 type=write size=2409724 2024-01-13T18:20:44.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.372+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~5DVQMXRJ79PN.0 size=1048576 2024-01-13T18:20:44.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.372+0000 7f759fd04880 1 < canceled part key=_multipart_JGALONWJXLQY.2~5DVQMXRJ79PN.1 size=964549 2024-01-13T18:20:44.377 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.376+0000 7f759fd04880 1 < canceled multipart upload key=JGALONWJXLQY upload=5DVQMXRJ79PN tag=BA73QIIKD94Q type=write size=3061701 2024-01-13T18:20:44.380 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.378+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=0OBU8CRDPMEH type=del size=1952007 2024-01-13T18:20:44.382 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.381+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=FVHLD7Y5D7BG type=del 2024-01-13T18:20:44.387 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.386+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~HBC2W225U7H3.0 size=1048576 2024-01-13T18:20:44.389 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.388+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~HBC2W225U7H3.1 size=253867 2024-01-13T18:20:44.389 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.388+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=HBC2W225U7H3 tag=ISG3ZNRQ090B type=write size=2351019 2024-01-13T18:20:44.392 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.390+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~FQ373UONKZK4.0 size=1048576 2024-01-13T18:20:44.393 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.392+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~FQ373UONKZK4.1 size=305625 2024-01-13T18:20:44.397 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.396+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=FQ373UONKZK4 tag=V67ACGP6BWRJ type=write size=2402777 2024-01-13T18:20:44.399 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.398+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=6IYB1HGA0D6L type=write size=684620 2024-01-13T18:20:44.402 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.401+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=3507CC68PUPV type=del 2024-01-13T18:20:44.404 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.403+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=11VDV8TAZFAG type=del size=1723617 2024-01-13T18:20:44.408 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.407+0000 7f759fd04880 1 < suggested remove operation key=6GOU0WSHKUQ0 tag=SQFKGG97X03G type=del 2024-01-13T18:20:44.410 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.409+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=8LI2I3G0U898 type=del size=898558 2024-01-13T18:20:44.412 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.411+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~EA6FKN7H6IIQ.0 size=1048576 2024-01-13T18:20:44.413 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.412+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~EA6FKN7H6IIQ.1 size=679083 2024-01-13T18:20:44.417 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.416+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=EA6FKN7H6IIQ tag=L6SD1F40XXFF type=write size=2776235 2024-01-13T18:20:44.419 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.418+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=WSGJTIIXA88B type=write size=980368 2024-01-13T18:20:44.421 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.420+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=W60G9YMDN0EA type=del 2024-01-13T18:20:44.424 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.423+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~FE5CGAAEPM92.0 size=1048576 2024-01-13T18:20:44.426 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.425+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~FE5CGAAEPM92.1 size=1048576 2024-01-13T18:20:44.428 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.427+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~FE5CGAAEPM92.2 size=723155 2024-01-13T18:20:44.428 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.427+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=FE5CGAAEPM92 tag=WC0PJOHFKDPX type=write size=3868883 2024-01-13T18:20:44.430 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.429+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~MSNR40DAAZQ5.0 size=1048576 2024-01-13T18:20:44.431 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.430+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~MSNR40DAAZQ5.1 size=853890 2024-01-13T18:20:44.435 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.434+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=MSNR40DAAZQ5 tag=4IQ9YJC95VUD type=write size=2951042 2024-01-13T18:20:44.439 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.438+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~NTYHTK341EMM.0 size=1048576 2024-01-13T18:20:44.441 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.440+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~NTYHTK341EMM.1 size=1048576 2024-01-13T18:20:44.442 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.441+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~NTYHTK341EMM.2 size=39602 2024-01-13T18:20:44.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.441+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=NTYHTK341EMM tag=20R93609ZYT9 type=write size=3185330 2024-01-13T18:20:44.444 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.444+0000 7f759fd04880 1 < canceled operation key=QS9PLJKINY4R tag=L9KUSMF1JHQ0 type=del size=2740682 2024-01-13T18:20:44.447 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.446+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=DJ8FIPD6ZHKA type=del size=1862137 2024-01-13T18:20:44.449 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.448+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~FJHSUSSN7Z3J.0 size=1048576 2024-01-13T18:20:44.451 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.450+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~FJHSUSSN7Z3J.1 size=1048576 2024-01-13T18:20:44.452 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.451+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~FJHSUSSN7Z3J.2 size=942819 2024-01-13T18:20:44.456 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.455+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=FJHSUSSN7Z3J tag=UFPJBBBPWCCK type=write size=4088547 2024-01-13T18:20:44.460 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.459+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~10UAZGAUCVCS.0 size=1048576 2024-01-13T18:20:44.462 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.461+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~10UAZGAUCVCS.1 size=1048576 2024-01-13T18:20:44.464 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.463+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~10UAZGAUCVCS.2 size=152510 2024-01-13T18:20:44.464 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.463+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=10UAZGAUCVCS tag=UY6HW8MXRJQV type=write size=3298238 2024-01-13T18:20:44.466 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.465+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=2NN2ZF49DE7D type=del 2024-01-13T18:20:44.469 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.468+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~R7C3BZ7SDLLJ.0 size=1048576 2024-01-13T18:20:44.471 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.470+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~R7C3BZ7SDLLJ.1 size=1048576 2024-01-13T18:20:44.473 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.472+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~R7C3BZ7SDLLJ.2 size=440343 2024-01-13T18:20:44.473 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.472+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=R7C3BZ7SDLLJ tag=PDDZSGQJ8P69 type=write size=3586071 2024-01-13T18:20:44.475 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.474+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=OBR2JXPUSKH6 type=del 2024-01-13T18:20:44.477 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.476+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=L9P4ZLYT5IL9 type=del size=390688 2024-01-13T18:20:44.478 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.478+0000 7f759fd04880 1 < completed write operation key=AJZB1PXB1NB5 tag=JRINFRAQF74N type=write size=1005704 2024-01-13T18:20:44.482 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.481+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~ZB1SSROG54V3.0 size=1048576 2024-01-13T18:20:44.484 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.483+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~ZB1SSROG54V3.1 size=1048576 2024-01-13T18:20:44.486 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.485+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~ZB1SSROG54V3.2 size=438217 2024-01-13T18:20:44.486 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.485+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=ZB1SSROG54V3 tag=TNLFMTIM8K9C type=write size=3583945 2024-01-13T18:20:44.490 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.489+0000 7f759fd04880 1 < suggested update operation key=DOXP3EJ03EBY tag=UTSPLIL3PA5Q type=del size=4040407 2024-01-13T18:20:44.492 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.491+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=9VXOSLKH5Z01 type=write size=486597 2024-01-13T18:20:44.492 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.491+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~18GOJTM7DKF9.0 size=257471 2024-01-13T18:20:44.496 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.495+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=18GOJTM7DKF9 tag=SSUSGAWUIL2Y type=write size=1306047 2024-01-13T18:20:44.498 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.497+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=1GGSFW50YVIP type=del size=4034552 2024-01-13T18:20:44.501 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.500+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~QQUNV3UPOTGH.0 size=1048576 2024-01-13T18:20:44.503 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.502+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~QQUNV3UPOTGH.1 size=312572 2024-01-13T18:20:44.506 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.505+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=QQUNV3UPOTGH tag=XTJO53MY33C1 type=write size=2409724 2024-01-13T18:20:44.508 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.507+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=IFS9HKH3VE7G type=del size=2371777 2024-01-13T18:20:44.510 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.509+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=0OBU8CRDPMEH type=del 2024-01-13T18:20:44.512 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.511+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=DB0T493UTA0U type=del size=2945806 2024-01-13T18:20:44.513 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.512+0000 7f759fd04880 1 < canceled part key=_multipart_DOXP3EJ03EBY.2~HBC2W225U7H3.0 size=1048576 2024-01-13T18:20:44.514 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.513+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~HBC2W225U7H3.1 size=253867 2024-01-13T18:20:44.518 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.517+0000 7f759fd04880 1 < canceled multipart upload key=DOXP3EJ03EBY upload=HBC2W225U7H3 tag=ISG3ZNRQ090B type=write size=2351019 2024-01-13T18:20:44.522 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.521+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~F2MNJ8D47ETL.0 size=1048576 2024-01-13T18:20:44.523 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.522+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~F2MNJ8D47ETL.1 size=1048576 2024-01-13T18:20:44.525 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.524+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~F2MNJ8D47ETL.2 size=470474 2024-01-13T18:20:44.525 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.524+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=F2MNJ8D47ETL tag=O8ZX5G0TSZHE type=write size=3616202 2024-01-13T18:20:44.529 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.528+0000 7f759fd04880 1 < suggested update operation key=3K20F802EFEQ tag=6IYB1HGA0D6L type=write size=684620 2024-01-13T18:20:44.531 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.530+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=DFV64YZJ04YA type=del size=3542399 2024-01-13T18:20:44.533 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.532+0000 7f759fd04880 1 < canceled operation key=H972TC5DOMHL tag=11VDV8TAZFAG type=del size=1723617 2024-01-13T18:20:44.535 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.534+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=48R4812GC25Z type=write size=169538 2024-01-13T18:20:44.537 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.536+0000 7f759fd04880 -1 < failed to complete operation key=DOXP3EJ03EBY tag=8LI2I3G0U898 type=del size=898558: (22) Invalid argument 2024-01-13T18:20:44.539 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.538+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=O029YTVHU267 type=del size=291953 2024-01-13T18:20:44.542 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.541+0000 7f759fd04880 1 < completed write operation key=7LXXSKLOM1JZ tag=WSGJTIIXA88B type=write size=980368 2024-01-13T18:20:44.543 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.543+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=FLY4DK02H08Q type=del size=2623589 2024-01-13T18:20:44.545 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.544+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~FE5CGAAEPM92.0 size=1048576 2024-01-13T18:20:44.547 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.546+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~FE5CGAAEPM92.1 size=1048576 2024-01-13T18:20:44.549 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.548+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~FE5CGAAEPM92.2 size=723155 2024-01-13T18:20:44.552 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.551+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=FE5CGAAEPM92 tag=WC0PJOHFKDPX type=write size=3868883 2024-01-13T18:20:44.555 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.554+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=521KQB9URGRZ type=del size=4171761 2024-01-13T18:20:44.555 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.554+0000 7f759fd04880 1 < canceled part key=_multipart_QS9PLJKINY4R.2~NTYHTK341EMM.0 size=1048576 2024-01-13T18:20:44.557 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.556+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~NTYHTK341EMM.1 size=1048576 2024-01-13T18:20:44.559 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.558+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~NTYHTK341EMM.2 size=39602 2024-01-13T18:20:44.562 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.561+0000 7f759fd04880 1 < canceled multipart upload key=QS9PLJKINY4R upload=NTYHTK341EMM tag=20R93609ZYT9 type=write size=3185330 2024-01-13T18:20:44.566 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.565+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~WJ0HGA5N9JU6.0 size=1048576 2024-01-13T18:20:44.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.566+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~WJ0HGA5N9JU6.1 size=249135 2024-01-13T18:20:44.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.566+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=WJ0HGA5N9JU6 tag=PXGKNQ0EZ7WJ type=write size=2346287 2024-01-13T18:20:44.569 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.568+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=DJ8FIPD6ZHKA type=del 2024-01-13T18:20:44.575 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.573+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~DDNRDNU1AJ6J.0 size=1048576 2024-01-13T18:20:44.576 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.575+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~DDNRDNU1AJ6J.1 size=1048576 2024-01-13T18:20:44.578 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.577+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~DDNRDNU1AJ6J.2 size=458793 2024-01-13T18:20:44.578 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.577+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=DDNRDNU1AJ6J tag=HJENF3G2W3B9 type=write size=3604521 2024-01-13T18:20:44.580 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.579+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~10UAZGAUCVCS.0 size=1048576 2024-01-13T18:20:44.580 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.579+0000 7f759fd04880 1 < canceled part key=_multipart_1O3XX67RKHNW.2~10UAZGAUCVCS.1 size=1048576 2024-01-13T18:20:44.582 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.581+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~10UAZGAUCVCS.2 size=152510 2024-01-13T18:20:44.585 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.584+0000 7f759fd04880 1 < canceled multipart upload key=1O3XX67RKHNW upload=10UAZGAUCVCS tag=UY6HW8MXRJQV type=write size=3298238 2024-01-13T18:20:44.589 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.588+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~GGXAPS2I24ZX.0 size=1048576 2024-01-13T18:20:44.590 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.590+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~GGXAPS2I24ZX.1 size=1017857 2024-01-13T18:20:44.591 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.590+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=GGXAPS2I24ZX tag=YZ37NVZ38A1X type=write size=3115009 2024-01-13T18:20:44.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.591+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~R7C3BZ7SDLLJ.0 size=1048576 2024-01-13T18:20:44.594 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.593+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~R7C3BZ7SDLLJ.1 size=1048576 2024-01-13T18:20:44.596 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.595+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~R7C3BZ7SDLLJ.2 size=440343 2024-01-13T18:20:44.600 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.598+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=R7C3BZ7SDLLJ tag=PDDZSGQJ8P69 type=write size=3586071 2024-01-13T18:20:44.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.602+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~VQEM3MZ0QI6G.0 size=245853 2024-01-13T18:20:44.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.602+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=VQEM3MZ0QI6G tag=YX1LTU841W9I type=write size=1294429 2024-01-13T18:20:44.605 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.604+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=L9P4ZLYT5IL9 type=del 2024-01-13T18:20:44.609 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.608+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~AK1LNXZJVMH8.0 size=1048576 2024-01-13T18:20:44.611 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.610+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~AK1LNXZJVMH8.1 size=1048576 2024-01-13T18:20:44.612 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.611+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~AK1LNXZJVMH8.2 size=444137 2024-01-13T18:20:44.612 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.611+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=AK1LNXZJVMH8 tag=RBZ7J7TYA0I4 type=write size=3589865 2024-01-13T18:20:44.614 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.613+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~ZB1SSROG54V3.0 size=1048576 2024-01-13T18:20:44.616 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.615+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~ZB1SSROG54V3.1 size=1048576 2024-01-13T18:20:44.618 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.617+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~ZB1SSROG54V3.2 size=438217 2024-01-13T18:20:44.621 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.620+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=ZB1SSROG54V3 tag=TNLFMTIM8K9C type=write size=3583945 2024-01-13T18:20:44.625 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.624+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~Y1EV3EQLCL4B.0 size=532592 2024-01-13T18:20:44.625 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.624+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=Y1EV3EQLCL4B tag=EILZ1BFSLOMK type=write size=1581168 2024-01-13T18:20:44.627 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.626+0000 7f759fd04880 1 < completed write operation key=P8FMRQR7GXN7 tag=9VXOSLKH5Z01 type=write size=486597 2024-01-13T18:20:44.629 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.628+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=322MIO8W5EEM type=write size=820882 2024-01-13T18:20:44.631 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.630+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=1GGSFW50YVIP type=del 2024-01-13T18:20:44.633 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.632+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=6EFBG3NXM8M5 type=del size=3373436 2024-01-13T18:20:44.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.636+0000 7f759fd04880 1 < suggested remove operation key=7LXXSKLOM1JZ tag=IFS9HKH3VE7G type=del 2024-01-13T18:20:44.639 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.638+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=YI70MWHMAII9 type=write size=231272 2024-01-13T18:20:44.641 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.640+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=DB0T493UTA0U type=del 2024-01-13T18:20:44.644 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.643+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~BPZC037M5BPR.0 size=1048576 2024-01-13T18:20:44.646 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.645+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~BPZC037M5BPR.1 size=1048576 2024-01-13T18:20:44.647 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.646+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~BPZC037M5BPR.2 size=29880 2024-01-13T18:20:44.647 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.646+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=BPZC037M5BPR tag=8C1AWT265N12 type=write size=3175608 2024-01-13T18:20:44.649 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.648+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~F2MNJ8D47ETL.0 size=1048576 2024-01-13T18:20:44.651 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.650+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~F2MNJ8D47ETL.1 size=1048576 2024-01-13T18:20:44.653 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.652+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~F2MNJ8D47ETL.2 size=470474 2024-01-13T18:20:44.656 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.655+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=F2MNJ8D47ETL tag=O8ZX5G0TSZHE type=write size=3616202 2024-01-13T18:20:44.659 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.659+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~2GQ38N8V76I2.0 size=587716 2024-01-13T18:20:44.660 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.659+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=2GQ38N8V76I2 tag=UG857CQSO1ZE type=write size=1636292 2024-01-13T18:20:44.661 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.660+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=DFV64YZJ04YA type=del 2024-01-13T18:20:44.663 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.663+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=T5NWRH700QXH type=del size=1200895 2024-01-13T18:20:44.666 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.665+0000 7f759fd04880 1 < completed write operation key=0TIZPXX8CMHA tag=48R4812GC25Z type=write size=169538 2024-01-13T18:20:44.670 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.669+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~B1YFYAO06ZUK.0 size=1048576 2024-01-13T18:20:44.671 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.670+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~B1YFYAO06ZUK.1 size=389819 2024-01-13T18:20:44.671 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.670+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=B1YFYAO06ZUK tag=JOY4VNWKOYBZ type=write size=2486971 2024-01-13T18:20:44.673 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.672+0000 7f759fd04880 1 < canceled operation key=7WRTM9ANJRT4 tag=O029YTVHU267 type=del size=291953 2024-01-13T18:20:44.675 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.674+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=WEVKUOQHEQ26 type=write size=247536 2024-01-13T18:20:44.677 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.676+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=FLY4DK02H08Q type=del 2024-01-13T18:20:44.681 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.680+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~XXOMT19RY58S.0 size=1048576 2024-01-13T18:20:44.682 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.682+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~XXOMT19RY58S.1 size=1037465 2024-01-13T18:20:44.683 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.682+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=XXOMT19RY58S tag=4SW7AHFZNV52 type=write size=3134617 2024-01-13T18:20:44.686 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.685+0000 7f759fd04880 1 < suggested update operation key=DOXP3EJ03EBY tag=521KQB9URGRZ type=del size=4171761 2024-01-13T18:20:44.690 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.689+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~2EU6F22231W5.0 size=583479 2024-01-13T18:20:44.690 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.689+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=2EU6F22231W5 tag=2C7E8AM0O53Y type=write size=1632055 2024-01-13T18:20:44.691 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.689+0000 7f759fd04880 1 < canceled part key=_multipart_7WRTM9ANJRT4.2~WJ0HGA5N9JU6.0 size=1048576 2024-01-13T18:20:44.692 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.691+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~WJ0HGA5N9JU6.1 size=249135 2024-01-13T18:20:44.695 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.695+0000 7f759fd04880 1 < canceled multipart upload key=7WRTM9ANJRT4 upload=WJ0HGA5N9JU6 tag=PXGKNQ0EZ7WJ type=write size=2346287 2024-01-13T18:20:44.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.696+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=9N7LC1W1OELE type=del size=1164431 2024-01-13T18:20:44.699 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.698+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~DDNRDNU1AJ6J.0 size=1048576 2024-01-13T18:20:44.701 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.700+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~DDNRDNU1AJ6J.1 size=1048576 2024-01-13T18:20:44.703 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.702+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~DDNRDNU1AJ6J.2 size=458793 2024-01-13T18:20:44.706 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.705+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=DDNRDNU1AJ6J tag=HJENF3G2W3B9 type=write size=3604521 2024-01-13T18:20:44.710 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.709+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~4AD0L8HJ39A8.0 size=1048576 2024-01-13T18:20:44.712 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.710+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~4AD0L8HJ39A8.1 size=659402 2024-01-13T18:20:44.712 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.710+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=4AD0L8HJ39A8 tag=DTG7RRP5DWXR type=write size=2756554 2024-01-13T18:20:44.714 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.713+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~GGXAPS2I24ZX.0 size=1048576 2024-01-13T18:20:44.715 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.715+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~GGXAPS2I24ZX.1 size=1017857 2024-01-13T18:20:44.719 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.718+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=GGXAPS2I24ZX tag=YZ37NVZ38A1X type=write size=3115009 2024-01-13T18:20:44.722 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.721+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=8JVX4PNHYMJE type=del size=2895138 2024-01-13T18:20:44.725 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.724+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~VQEM3MZ0QI6G.0 size=245853 2024-01-13T18:20:44.728 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.727+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=VQEM3MZ0QI6G tag=YX1LTU841W9I type=write size=1294429 2024-01-13T18:20:44.730 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.729+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=RT10OKOP68P0 type=del size=552561 2024-01-13T18:20:44.733 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.731+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~AK1LNXZJVMH8.0 size=1048576 2024-01-13T18:20:44.734 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.733+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~AK1LNXZJVMH8.1 size=1048576 2024-01-13T18:20:44.736 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.735+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~AK1LNXZJVMH8.2 size=444137 2024-01-13T18:20:44.740 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.739+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=AK1LNXZJVMH8 tag=RBZ7J7TYA0I4 type=write size=3589865 2024-01-13T18:20:44.742 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.741+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=PICVG8K2Y39L type=write size=561520 2024-01-13T18:20:44.744 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.743+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~Y1EV3EQLCL4B.0 size=532592 2024-01-13T18:20:44.748 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.747+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=Y1EV3EQLCL4B tag=EILZ1BFSLOMK type=write size=1581168 2024-01-13T18:20:44.750 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.749+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=UBZDSM1IMBOK type=del size=3917840 2024-01-13T18:20:44.752 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.751+0000 7f759fd04880 1 < completed write operation key=AJZB1PXB1NB5 tag=322MIO8W5EEM type=write size=820882 2024-01-13T18:20:44.754 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.753+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=K22AQIT9LUMH type=del size=1172620 2024-01-13T18:20:44.756 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.755+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=6EFBG3NXM8M5 type=del 2024-01-13T18:20:44.758 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.757+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=SIRXF3K64Z8L type=write size=363621 2024-01-13T18:20:44.762 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.761+0000 7f759fd04880 1 < suggested remove operation key=8EWIOXN5H9KU tag=YI70MWHMAII9 type=write 2024-01-13T18:20:44.765 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.764+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=JDAV0EKTIAFK type=del size=1789124 2024-01-13T18:20:44.767 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.766+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~BPZC037M5BPR.0 size=1048576 2024-01-13T18:20:44.768 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.767+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~BPZC037M5BPR.1 size=1048576 2024-01-13T18:20:44.770 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.769+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~BPZC037M5BPR.2 size=29880 2024-01-13T18:20:44.773 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.772+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=BPZC037M5BPR tag=8C1AWT265N12 type=write size=3175608 2024-01-13T18:20:44.777 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.776+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~13J8IF3V4VQ3.0 size=353723 2024-01-13T18:20:44.777 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.776+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=13J8IF3V4VQ3 tag=7328NF1BWHYL type=write size=1402299 2024-01-13T18:20:44.779 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.778+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~2GQ38N8V76I2.0 size=587716 2024-01-13T18:20:44.783 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.782+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=2GQ38N8V76I2 tag=UG857CQSO1ZE type=write size=1636292 2024-01-13T18:20:44.787 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.786+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~8Q6UXJ8ZK3X1.0 size=1048576 2024-01-13T18:20:44.789 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.788+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~8Q6UXJ8ZK3X1.1 size=1048576 2024-01-13T18:20:44.790 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.790+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~8Q6UXJ8ZK3X1.2 size=692409 2024-01-13T18:20:44.791 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.790+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=8Q6UXJ8ZK3X1 tag=TGEOJAKHF224 type=write size=3838137 2024-01-13T18:20:44.793 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.792+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=T5NWRH700QXH type=del 2024-01-13T18:20:44.797 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.796+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~95WDXVK80CE2.0 size=1048576 2024-01-13T18:20:44.799 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.798+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~95WDXVK80CE2.1 size=1048576 2024-01-13T18:20:44.801 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.800+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~95WDXVK80CE2.2 size=548502 2024-01-13T18:20:44.801 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.800+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=95WDXVK80CE2 tag=JZ51ZZP5FX8G type=write size=3694230 2024-01-13T18:20:44.804 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.803+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~B1YFYAO06ZUK.0 size=1048576 2024-01-13T18:20:44.806 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.805+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~B1YFYAO06ZUK.1 size=389819 2024-01-13T18:20:44.810 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.809+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=B1YFYAO06ZUK tag=JOY4VNWKOYBZ type=write size=2486971 2024-01-13T18:20:44.814 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.813+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~7LX3I5V3NMTC.0 size=1048576 2024-01-13T18:20:44.816 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.815+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~7LX3I5V3NMTC.1 size=1048576 2024-01-13T18:20:44.818 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.817+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~7LX3I5V3NMTC.2 size=155629 2024-01-13T18:20:44.818 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.817+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=7LX3I5V3NMTC tag=BPT0VWYL4XLS type=write size=3301357 2024-01-13T18:20:44.820 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.819+0000 7f759fd04880 1 < canceled operation key=1O3XX67RKHNW tag=WEVKUOQHEQ26 type=write size=247536 2024-01-13T18:20:44.822 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.821+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=538LCBBLLENB type=del size=843372 2024-01-13T18:20:44.824 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.823+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~XXOMT19RY58S.0 size=1048576 2024-01-13T18:20:44.824 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.823+0000 7f759fd04880 1 < canceled part key=_multipart_1O3XX67RKHNW.2~XXOMT19RY58S.1 size=1037465 2024-01-13T18:20:44.827 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.826+0000 7f759fd04880 1 < canceled multipart upload key=1O3XX67RKHNW upload=XXOMT19RY58S tag=4SW7AHFZNV52 type=write size=3134617 2024-01-13T18:20:44.832 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.830+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~EYSAKRRJ7OYN.0 size=1048576 2024-01-13T18:20:44.833 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.832+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~EYSAKRRJ7OYN.1 size=1048576 2024-01-13T18:20:44.835 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.834+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~EYSAKRRJ7OYN.2 size=46657 2024-01-13T18:20:44.835 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.834+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=EYSAKRRJ7OYN tag=NTNLWU5TRHGL type=write size=3192385 2024-01-13T18:20:44.837 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.836+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~2EU6F22231W5.0 size=583479 2024-01-13T18:20:44.841 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.840+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=2EU6F22231W5 tag=2C7E8AM0O53Y type=write size=1632055 2024-01-13T18:20:44.843 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.842+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=CJRB09Q2RTW8 type=del size=2604431 2024-01-13T18:20:44.845 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.844+0000 7f759fd04880 1 < completed delete operation key=QKNPXHB99KVP tag=9N7LC1W1OELE type=del 2024-01-13T18:20:44.847 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.846+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=G9EJPFO1GWNF type=del size=689627 2024-01-13T18:20:44.847 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.846+0000 7f759fd04880 1 < canceled part key=_multipart_TNC2YDZYGM6G.2~4AD0L8HJ39A8.0 size=1048576 2024-01-13T18:20:44.849 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.848+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~4AD0L8HJ39A8.1 size=659402 2024-01-13T18:20:44.852 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.851+0000 7f759fd04880 1 < canceled multipart upload key=TNC2YDZYGM6G upload=4AD0L8HJ39A8 tag=DTG7RRP5DWXR type=write size=2756554 2024-01-13T18:20:44.854 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.853+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=7UB8VKEE0UDR type=del size=873288 2024-01-13T18:20:44.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.856+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=8JVX4PNHYMJE type=del 2024-01-13T18:20:44.860 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.859+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~FA2PK48JU1BX.0 size=1048576 2024-01-13T18:20:44.863 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.862+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~FA2PK48JU1BX.1 size=1048576 2024-01-13T18:20:44.864 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.863+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~FA2PK48JU1BX.2 size=749698 2024-01-13T18:20:44.864 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.863+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=FA2PK48JU1BX tag=CB5J4E1MZ1U0 type=write size=3895426 2024-01-13T18:20:44.866 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.865+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=RT10OKOP68P0 type=del 2024-01-13T18:20:44.869 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.868+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=YIEC3OA3DHX4 type=del size=2185818 2024-01-13T18:20:44.871 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.870+0000 7f759fd04880 1 < completed write operation key=7LXXSKLOM1JZ tag=PICVG8K2Y39L type=write size=561520 2024-01-13T18:20:44.875 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.874+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~AA1AYHW7NCBG.0 size=487513 2024-01-13T18:20:44.875 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.874+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=AA1AYHW7NCBG tag=TGC1BL2AZBMH type=write size=1536089 2024-01-13T18:20:44.879 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.878+0000 7f759fd04880 1 < suggested remove operation key=OMA1B74S8FXS tag=UBZDSM1IMBOK type=del 2024-01-13T18:20:44.883 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.882+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~XLINWCG0YDK9.0 size=1048576 2024-01-13T18:20:44.885 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.884+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~XLINWCG0YDK9.1 size=935380 2024-01-13T18:20:44.885 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.884+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=XLINWCG0YDK9 tag=JDTDI25QTH1J type=write size=3032532 2024-01-13T18:20:44.887 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.886+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=K22AQIT9LUMH type=del 2024-01-13T18:20:44.891 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.890+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~5USC4M05EW7Y.0 size=1048576 2024-01-13T18:20:44.893 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.892+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~5USC4M05EW7Y.1 size=1030465 2024-01-13T18:20:44.893 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.892+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=5USC4M05EW7Y tag=39DPMRAIZZ0Y type=write size=3127617 2024-01-13T18:20:44.893 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.892+0000 7f759fd04880 -1 < no bi entry to suggest for operation key=OMA1B74S8FXS tag=SIRXF3K64Z8L type=write size=363621: (2) No such file or directory 2024-01-13T18:20:44.897 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.896+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~PMN35HD46D1X.0 size=1048576 2024-01-13T18:20:44.899 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.898+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~PMN35HD46D1X.1 size=1048576 2024-01-13T18:20:44.900 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.899+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~PMN35HD46D1X.2 size=26127 2024-01-13T18:20:44.900 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.899+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=PMN35HD46D1X tag=K5V51VXMMFB0 type=write size=3171855 2024-01-13T18:20:44.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.903+0000 7f759fd04880 1 < suggested update operation key=7WRTM9ANJRT4 tag=JDAV0EKTIAFK type=del size=1789124 2024-01-13T18:20:44.907 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.906+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=4577SU431EKT type=del size=2894830 2024-01-13T18:20:44.909 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.908+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~13J8IF3V4VQ3.0 size=353723 2024-01-13T18:20:44.912 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.912+0000 7f759fd04880 1 < completed multipart upload key=OMA1B74S8FXS upload=13J8IF3V4VQ3 tag=7328NF1BWHYL type=write size=1402299 2024-01-13T18:20:44.916 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.915+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~L3R106V9H2MO.0 size=1048576 2024-01-13T18:20:44.918 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.917+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~L3R106V9H2MO.1 size=679065 2024-01-13T18:20:44.919 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.917+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=L3R106V9H2MO tag=7RI8J21X36AW type=write size=2776217 2024-01-13T18:20:44.921 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.920+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~8Q6UXJ8ZK3X1.0 size=1048576 2024-01-13T18:20:44.923 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.922+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~8Q6UXJ8ZK3X1.1 size=1048576 2024-01-13T18:20:44.925 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.924+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~8Q6UXJ8ZK3X1.2 size=692409 2024-01-13T18:20:44.929 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.928+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=8Q6UXJ8ZK3X1 tag=TGEOJAKHF224 type=write size=3838137 2024-01-13T18:20:44.931 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.930+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=8L8S3AU9OBRB type=del size=1279749 2024-01-13T18:20:44.931 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.930+0000 7f759fd04880 1 < canceled part key=_multipart_AJZB1PXB1NB5.2~95WDXVK80CE2.0 size=1048576 2024-01-13T18:20:44.934 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.933+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~95WDXVK80CE2.1 size=1048576 2024-01-13T18:20:44.936 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.935+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~95WDXVK80CE2.2 size=548502 2024-01-13T18:20:44.940 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.939+0000 7f759fd04880 1 < canceled multipart upload key=AJZB1PXB1NB5 upload=95WDXVK80CE2 tag=JZ51ZZP5FX8G type=write size=3694230 2024-01-13T18:20:44.942 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.941+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=M6RKF1DCGQW9 type=del size=2407925 2024-01-13T18:20:44.944 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.943+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~7LX3I5V3NMTC.0 size=1048576 2024-01-13T18:20:44.944 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.943+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~7LX3I5V3NMTC.1 size=1048576 2024-01-13T18:20:44.945 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.945+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~7LX3I5V3NMTC.2 size=155629 2024-01-13T18:20:44.949 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.948+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=7LX3I5V3NMTC tag=BPT0VWYL4XLS type=write size=3301357 2024-01-13T18:20:44.951 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.950+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=BWLO2W46HIHD type=write size=1010361 2024-01-13T18:20:44.953 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.952+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=538LCBBLLENB type=del 2024-01-13T18:20:44.955 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.954+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=9MZW1W5NSKXP type=del size=3544423 2024-01-13T18:20:44.957 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.956+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~EYSAKRRJ7OYN.0 size=1048576 2024-01-13T18:20:44.959 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.958+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~EYSAKRRJ7OYN.1 size=1048576 2024-01-13T18:20:44.961 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.960+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~EYSAKRRJ7OYN.2 size=46657 2024-01-13T18:20:44.965 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.964+0000 7f759fd04880 1 < completed multipart upload key=ZI9WAZQHVPAR upload=EYSAKRRJ7OYN tag=NTNLWU5TRHGL type=write size=3192385 2024-01-13T18:20:44.969 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.968+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~MS6MGQPID1N0.0 size=1048576 2024-01-13T18:20:44.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.970+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~MS6MGQPID1N0.1 size=1048576 2024-01-13T18:20:44.973 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.972+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~MS6MGQPID1N0.2 size=886917 2024-01-13T18:20:44.973 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.972+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=MS6MGQPID1N0 tag=9VPZ1QA1ZNBO type=write size=4032645 2024-01-13T18:20:44.975 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.974+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=CJRB09Q2RTW8 type=del 2024-01-13T18:20:44.979 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.977+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~TKN8AH6S4WVD.0 size=1048576 2024-01-13T18:20:44.980 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.979+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~TKN8AH6S4WVD.1 size=242682 2024-01-13T18:20:44.980 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.979+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=TKN8AH6S4WVD tag=2B02Q0LW68V7 type=write size=2339834 2024-01-13T18:20:44.983 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.981+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=G9EJPFO1GWNF type=del 2024-01-13T18:20:44.986 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.985+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~LKD6J77PVNUR.0 size=1048576 2024-01-13T18:20:44.988 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.987+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~LKD6J77PVNUR.1 size=160517 2024-01-13T18:20:44.988 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.987+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=LKD6J77PVNUR tag=P83IUA52TGFP type=write size=2257669 2024-01-13T18:20:44.990 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.989+0000 7f759fd04880 1 < canceled operation key=7LXXSKLOM1JZ tag=7UB8VKEE0UDR type=del size=873288 2024-01-13T18:20:44.992 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.991+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=77BIH4Z910VF type=del size=2178783 2024-01-13T18:20:44.994 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.993+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~FA2PK48JU1BX.0 size=1048576 2024-01-13T18:20:44.997 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.996+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~FA2PK48JU1BX.1 size=1048576 2024-01-13T18:20:44.999 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:44.998+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~FA2PK48JU1BX.2 size=749698 2024-01-13T18:20:45.003 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.002+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=FA2PK48JU1BX tag=CB5J4E1MZ1U0 type=write size=3895426 2024-01-13T18:20:45.007 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.006+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~CHN219N6MH10.0 size=736001 2024-01-13T18:20:45.007 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.006+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=CHN219N6MH10 tag=FCDFWAF8TQE6 type=write size=1784577 2024-01-13T18:20:45.009 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.008+0000 7f759fd04880 1 < canceled operation key=ZI9WAZQHVPAR tag=YIEC3OA3DHX4 type=del size=2185818 2024-01-13T18:20:45.012 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.011+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=ANPHHPLDYJT4 type=write size=335644 2024-01-13T18:20:45.014 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.013+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~AA1AYHW7NCBG.0 size=487513 2024-01-13T18:20:45.018 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.017+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=AA1AYHW7NCBG tag=TGC1BL2AZBMH type=write size=1536089 2024-01-13T18:20:45.020 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.019+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=XR7CIF9HRHDT type=del size=393621 2024-01-13T18:20:45.022 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.021+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~XLINWCG0YDK9.0 size=1048576 2024-01-13T18:20:45.023 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.023+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~XLINWCG0YDK9.1 size=935380 2024-01-13T18:20:45.027 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.026+0000 7f759fd04880 1 < completed multipart upload key=VZHGQM6ZNJYQ upload=XLINWCG0YDK9 tag=JDTDI25QTH1J type=write size=3032532 2024-01-13T18:20:45.029 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.028+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=NZ1FATAHUG3U type=del size=1875036 2024-01-13T18:20:45.031 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.030+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~5USC4M05EW7Y.0 size=1048576 2024-01-13T18:20:45.033 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.032+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~5USC4M05EW7Y.1 size=1030465 2024-01-13T18:20:45.037 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.036+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=5USC4M05EW7Y tag=39DPMRAIZZ0Y type=write size=3127617 2024-01-13T18:20:45.041 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.040+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~K7KKXE8R51E3.0 size=820368 2024-01-13T18:20:45.041 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.040+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=K7KKXE8R51E3 tag=82NT9MEJG42A type=write size=1868944 2024-01-13T18:20:45.043 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.042+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~PMN35HD46D1X.0 size=1048576 2024-01-13T18:20:45.044 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.043+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~PMN35HD46D1X.1 size=1048576 2024-01-13T18:20:45.046 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.046+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~PMN35HD46D1X.2 size=26127 2024-01-13T18:20:45.050 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.050+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=PMN35HD46D1X tag=K5V51VXMMFB0 type=write size=3171855 2024-01-13T18:20:45.052 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.051+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=49G0BYJDXBP4 type=del size=1899615 2024-01-13T18:20:45.054 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.053+0000 7f759fd04880 1 < canceled operation key=H4VHC37BOZJ3 tag=4577SU431EKT type=del size=2894830 2024-01-13T18:20:45.057 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.056+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=GN4T22KXZZEZ type=del size=728800 2024-01-13T18:20:45.059 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.058+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~L3R106V9H2MO.0 size=1048576 2024-01-13T18:20:45.059 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.058+0000 7f759fd04880 1 < canceled part key=_multipart_TNC2YDZYGM6G.2~L3R106V9H2MO.1 size=679065 2024-01-13T18:20:45.062 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.061+0000 7f759fd04880 1 < canceled multipart upload key=TNC2YDZYGM6G upload=L3R106V9H2MO tag=7RI8J21X36AW type=write size=2776217 2024-01-13T18:20:45.066 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.065+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~U9G5AE619Z8N.0 size=1048576 2024-01-13T18:20:45.068 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.067+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~U9G5AE619Z8N.1 size=1048576 2024-01-13T18:20:45.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.068+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~U9G5AE619Z8N.2 size=935791 2024-01-13T18:20:45.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.068+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=U9G5AE619Z8N tag=9Y6SPACOU945 type=write size=4081519 2024-01-13T18:20:45.073 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.072+0000 7f759fd04880 1 < suggested update operation key=AJZB1PXB1NB5 tag=8L8S3AU9OBRB type=del size=1279749 2024-01-13T18:20:45.077 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.076+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~HX9SJZ8U7WIU.0 size=1048576 2024-01-13T18:20:45.079 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.078+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~HX9SJZ8U7WIU.1 size=109416 2024-01-13T18:20:45.079 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.078+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=HX9SJZ8U7WIU tag=P6POTYMWJVTY type=write size=2206568 2024-01-13T18:20:45.081 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.080+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=M6RKF1DCGQW9 type=del 2024-01-13T18:20:45.085 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.084+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~B2PDHMCMT4R8.0 size=1048576 2024-01-13T18:20:45.087 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.086+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~B2PDHMCMT4R8.1 size=527173 2024-01-13T18:20:45.087 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.086+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=B2PDHMCMT4R8 tag=P5KNP2Y6KTUP type=write size=2624325 2024-01-13T18:20:45.088 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.088+0000 7f759fd04880 1 < completed write operation key=6GOU0WSHKUQ0 tag=BWLO2W46HIHD type=write size=1010361 2024-01-13T18:20:45.092 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.091+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~GKNTD2E37L4A.0 size=1048576 2024-01-13T18:20:45.094 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.093+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~GKNTD2E37L4A.1 size=712388 2024-01-13T18:20:45.094 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.093+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=GKNTD2E37L4A tag=75Y69977I4D3 type=write size=2809540 2024-01-13T18:20:45.098 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.097+0000 7f759fd04880 1 < suggested update operation key=6GOU0WSHKUQ0 tag=9MZW1W5NSKXP type=del size=3544423 2024-01-13T18:20:45.100 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.099+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=PBG100WXRNLR type=write size=808897 2024-01-13T18:20:45.102 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.101+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~MS6MGQPID1N0.0 size=1048576 2024-01-13T18:20:45.104 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.103+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~MS6MGQPID1N0.1 size=1048576 2024-01-13T18:20:45.105 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.104+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~MS6MGQPID1N0.2 size=886917 2024-01-13T18:20:45.109 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.108+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=MS6MGQPID1N0 tag=9VPZ1QA1ZNBO type=write size=4032645 2024-01-13T18:20:45.111 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.110+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=465A41GZD9PF type=del size=1701383 2024-01-13T18:20:45.113 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.112+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~TKN8AH6S4WVD.0 size=1048576 2024-01-13T18:20:45.115 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.114+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~TKN8AH6S4WVD.1 size=242682 2024-01-13T18:20:45.118 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.117+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=TKN8AH6S4WVD tag=2B02Q0LW68V7 type=write size=2339834 2024-01-13T18:20:45.121 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.119+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=PQIM7A9JVA5Q type=del size=164053 2024-01-13T18:20:45.121 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.120+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~LKD6J77PVNUR.0 size=1048576 2024-01-13T18:20:45.123 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.122+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~LKD6J77PVNUR.1 size=160517 2024-01-13T18:20:45.126 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.125+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=LKD6J77PVNUR tag=P83IUA52TGFP type=write size=2257669 2024-01-13T18:20:45.128 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.127+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=ELR1HJ5S3F8H type=del size=2204868 2024-01-13T18:20:45.130 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.129+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=77BIH4Z910VF type=del 2024-01-13T18:20:45.132 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.131+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=OI12FQPO6EXZ type=del size=3408038 2024-01-13T18:20:45.135 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.134+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~CHN219N6MH10.0 size=736001 2024-01-13T18:20:45.139 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.138+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=CHN219N6MH10 tag=FCDFWAF8TQE6 type=write size=1784577 2024-01-13T18:20:45.140 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.139+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=WR5AH2UN1LLN type=del size=2129114 2024-01-13T18:20:45.142 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.141+0000 7f759fd04880 1 < completed write operation key=QD5GBLNCY707 tag=ANPHHPLDYJT4 type=write size=335644 2024-01-13T18:20:45.146 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.145+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~AV293XFWMNSK.0 size=1048576 2024-01-13T18:20:45.148 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.147+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~AV293XFWMNSK.1 size=89230 2024-01-13T18:20:45.148 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.147+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=AV293XFWMNSK tag=QB5M434IE0S5 type=write size=2186382 2024-01-13T18:20:45.150 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.149+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=XR7CIF9HRHDT type=del 2024-01-13T18:20:45.154 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.153+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~ZFWO3DICAFYO.0 size=1048576 2024-01-13T18:20:45.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.155+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~ZFWO3DICAFYO.1 size=379134 2024-01-13T18:20:45.156 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.155+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=ZFWO3DICAFYO tag=X9FFTLA265Q9 type=write size=2476286 2024-01-13T18:20:45.158 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.157+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=NZ1FATAHUG3U type=del 2024-01-13T18:20:45.162 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.161+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~19XR8OF3RJF6.0 size=1048576 2024-01-13T18:20:45.164 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.163+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~19XR8OF3RJF6.1 size=1048576 2024-01-13T18:20:45.165 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.164+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~19XR8OF3RJF6.2 size=16940 2024-01-13T18:20:45.166 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.164+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=19XR8OF3RJF6 tag=35NFHHLR4OUR type=write size=3162668 2024-01-13T18:20:45.168 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.166+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~K7KKXE8R51E3.0 size=820368 2024-01-13T18:20:45.171 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.170+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=K7KKXE8R51E3 tag=82NT9MEJG42A type=write size=1868944 2024-01-13T18:20:45.174 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.173+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~L0KV05ZWDS4K.0 size=1048576 2024-01-13T18:20:45.176 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.175+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~L0KV05ZWDS4K.1 size=1048576 2024-01-13T18:20:45.178 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.177+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~L0KV05ZWDS4K.2 size=603544 2024-01-13T18:20:45.178 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.177+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=L0KV05ZWDS4K tag=PPJ05729RT0F type=write size=3749272 2024-01-13T18:20:45.180 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.179+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=49G0BYJDXBP4 type=del 2024-01-13T18:20:45.182 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.181+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=2HBS26TVM0C0 type=del size=3719538 2024-01-13T18:20:45.184 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.183+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=GN4T22KXZZEZ type=del 2024-01-13T18:20:45.186 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.185+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=KQ1ZON85XCC5 type=del size=3466427 2024-01-13T18:20:45.188 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.187+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~U9G5AE619Z8N.0 size=1048576 2024-01-13T18:20:45.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.189+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~U9G5AE619Z8N.1 size=1048576 2024-01-13T18:20:45.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.191+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~U9G5AE619Z8N.2 size=935791 2024-01-13T18:20:45.195 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.194+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=U9G5AE619Z8N tag=9Y6SPACOU945 type=write size=4081519 2024-01-13T18:20:45.199 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.198+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~7IWGNSQFMHNJ.0 size=1048576 2024-01-13T18:20:45.200 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.200+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~7IWGNSQFMHNJ.1 size=81901 2024-01-13T18:20:45.201 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.200+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=7IWGNSQFMHNJ tag=ZN1ZJI4C2R8M type=write size=2179053 2024-01-13T18:20:45.203 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.202+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~HX9SJZ8U7WIU.0 size=1048576 2024-01-13T18:20:45.205 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.204+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~HX9SJZ8U7WIU.1 size=109416 2024-01-13T18:20:45.209 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.208+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=HX9SJZ8U7WIU tag=P6POTYMWJVTY type=write size=2206568 2024-01-13T18:20:45.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.212+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~3T143G8KBG7U.0 size=1048576 2024-01-13T18:20:45.214 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.214+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~3T143G8KBG7U.1 size=1048576 2024-01-13T18:20:45.216 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.215+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~3T143G8KBG7U.2 size=697366 2024-01-13T18:20:45.217 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.215+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=3T143G8KBG7U tag=3412YG9277QV type=write size=3843094 2024-01-13T18:20:45.219 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.218+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~B2PDHMCMT4R8.0 size=1048576 2024-01-13T18:20:45.220 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.219+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~B2PDHMCMT4R8.1 size=527173 2024-01-13T18:20:45.224 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.223+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=B2PDHMCMT4R8 tag=P5KNP2Y6KTUP type=write size=2624325 2024-01-13T18:20:45.226 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.225+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=VBBO0JOR99LB type=del size=2459140 2024-01-13T18:20:45.228 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.227+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~GKNTD2E37L4A.0 size=1048576 2024-01-13T18:20:45.229 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.228+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~GKNTD2E37L4A.1 size=712388 2024-01-13T18:20:45.233 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.232+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=GKNTD2E37L4A tag=75Y69977I4D3 type=write size=2809540 2024-01-13T18:20:45.236 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.235+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~VQ35XMA8VXRC.0 size=81859 2024-01-13T18:20:45.237 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.235+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=VQ35XMA8VXRC tag=ARC6CGK8ZYKT type=write size=1130435 2024-01-13T18:20:45.239 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.238+0000 7f759fd04880 1 < completed write operation key=TNC2YDZYGM6G tag=PBG100WXRNLR type=write size=808897 2024-01-13T18:20:45.241 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.240+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=E98A9SDH2DJY type=del size=4039289 2024-01-13T18:20:45.245 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.244+0000 7f759fd04880 1 < suggested remove operation key=7R5YIO7UFSDZ tag=465A41GZD9PF type=del 2024-01-13T18:20:45.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.248+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~8LPF6RW2GM1D.0 size=1690 2024-01-13T18:20:45.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.248+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=8LPF6RW2GM1D tag=2A9PAFGWG8WB type=write size=1050266 2024-01-13T18:20:45.253 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.252+0000 7f759fd04880 1 < suggested remove operation key=VZHGQM6ZNJYQ tag=PQIM7A9JVA5Q type=del 2024-01-13T18:20:45.255 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.254+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=GGEDW2TO2HZL type=del size=2213024 2024-01-13T18:20:45.257 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.256+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=ELR1HJ5S3F8H type=del 2024-01-13T18:20:45.260 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.259+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=0CI18NNCU88B type=del size=2958010 2024-01-13T18:20:45.262 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.261+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=OI12FQPO6EXZ type=del 2024-01-13T18:20:45.265 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.264+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~DRIZ9EI82SA8.0 size=387948 2024-01-13T18:20:45.265 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.264+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=DRIZ9EI82SA8 tag=M6GLHZLJ8HXR type=write size=1436524 2024-01-13T18:20:45.267 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.266+0000 7f759fd04880 1 < canceled operation key=XBTWSUA3D7U3 tag=WR5AH2UN1LLN type=del size=2129114 2024-01-13T18:20:45.269 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.268+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=I7YRB9IQDEB1 type=del size=2377649 2024-01-13T18:20:45.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.270+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~AV293XFWMNSK.0 size=1048576 2024-01-13T18:20:45.273 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.272+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~AV293XFWMNSK.1 size=89230 2024-01-13T18:20:45.277 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.276+0000 7f759fd04880 1 < completed multipart upload key=VZHGQM6ZNJYQ upload=AV293XFWMNSK tag=QB5M434IE0S5 type=write size=2186382 2024-01-13T18:20:45.279 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.278+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=PWXEJHDO6DCV type=write size=990132 2024-01-13T18:20:45.281 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.280+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~ZFWO3DICAFYO.0 size=1048576 2024-01-13T18:20:45.283 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.282+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~ZFWO3DICAFYO.1 size=379134 2024-01-13T18:20:45.287 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.286+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=ZFWO3DICAFYO tag=X9FFTLA265Q9 type=write size=2476286 2024-01-13T18:20:45.289 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.288+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=K41FERAUQD4M type=del size=264448 2024-01-13T18:20:45.291 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.290+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~19XR8OF3RJF6.0 size=1048576 2024-01-13T18:20:45.293 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.292+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~19XR8OF3RJF6.1 size=1048576 2024-01-13T18:20:45.295 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.294+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~19XR8OF3RJF6.2 size=16940 2024-01-13T18:20:45.299 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.298+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=19XR8OF3RJF6 tag=35NFHHLR4OUR type=write size=3162668 2024-01-13T18:20:45.301 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.300+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=3GA1H7OORP79 type=del size=1652921 2024-01-13T18:20:45.303 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.302+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~L0KV05ZWDS4K.0 size=1048576 2024-01-13T18:20:45.304 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.303+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~L0KV05ZWDS4K.1 size=1048576 2024-01-13T18:20:45.307 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.306+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~L0KV05ZWDS4K.2 size=603544 2024-01-13T18:20:45.311 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.310+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=L0KV05ZWDS4K tag=PPJ05729RT0F type=write size=3749272 2024-01-13T18:20:45.314 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.313+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~RLMADZIWOXJS.0 size=1048576 2024-01-13T18:20:45.316 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.315+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~RLMADZIWOXJS.1 size=108058 2024-01-13T18:20:45.317 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.315+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=RLMADZIWOXJS tag=PWOMR0UKZ33N type=write size=2205210 2024-01-13T18:20:45.321 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.320+0000 7f759fd04880 1 < suggested remove operation key=WSRJB811XCVL tag=2HBS26TVM0C0 type=del 2024-01-13T18:20:45.323 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.322+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=VOE2RV82EXPJ type=del size=2266647 2024-01-13T18:20:45.326 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.325+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=KQ1ZON85XCC5 type=del 2024-01-13T18:20:45.329 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.328+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~4SYQVPGYNXWY.0 size=1048576 2024-01-13T18:20:45.331 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.330+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~4SYQVPGYNXWY.1 size=649511 2024-01-13T18:20:45.331 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.330+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=4SYQVPGYNXWY tag=PNA9TIHCP97Q type=write size=2746663 2024-01-13T18:20:45.333 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.332+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~7IWGNSQFMHNJ.0 size=1048576 2024-01-13T18:20:45.334 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.334+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~7IWGNSQFMHNJ.1 size=81901 2024-01-13T18:20:45.338 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.337+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=7IWGNSQFMHNJ tag=ZN1ZJI4C2R8M type=write size=2179053 2024-01-13T18:20:45.340 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.339+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=A2LZ9SGAD8K1 type=del size=1068026 2024-01-13T18:20:45.342 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.341+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~3T143G8KBG7U.0 size=1048576 2024-01-13T18:20:45.343 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.343+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~3T143G8KBG7U.1 size=1048576 2024-01-13T18:20:45.346 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.345+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~3T143G8KBG7U.2 size=697366 2024-01-13T18:20:45.350 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.349+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=3T143G8KBG7U tag=3412YG9277QV type=write size=3843094 2024-01-13T18:20:45.354 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.353+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~U1KZICLGXC28.0 size=1048576 2024-01-13T18:20:45.356 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.355+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~U1KZICLGXC28.1 size=683677 2024-01-13T18:20:45.356 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.355+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=U1KZICLGXC28 tag=FV3SZ226UB9G type=write size=2780829 2024-01-13T18:20:45.360 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.359+0000 7f759fd04880 1 < suggested remove operation key=1YNH6QHP354U tag=VBBO0JOR99LB type=del 2024-01-13T18:20:45.362 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.361+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=WKJVRI8FO4F2 type=write size=609559 2024-01-13T18:20:45.365 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.364+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~VQ35XMA8VXRC.0 size=81859 2024-01-13T18:20:45.368 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.367+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=VQ35XMA8VXRC tag=ARC6CGK8ZYKT type=write size=1130435 2024-01-13T18:20:45.370 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.369+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=VHS0RDP7DLMT type=del size=3799060 2024-01-13T18:20:45.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.372+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=E98A9SDH2DJY type=del 2024-01-13T18:20:45.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.374+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=VOF3E3ULJ4YT type=write size=370185 2024-01-13T18:20:45.377 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.376+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~8LPF6RW2GM1D.0 size=1690 2024-01-13T18:20:45.380 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.379+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=8LPF6RW2GM1D tag=2A9PAFGWG8WB type=write size=1050266 2024-01-13T18:20:45.382 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.381+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=174ZH11D47YG type=del size=505402 2024-01-13T18:20:45.387 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.386+0000 7f759fd04880 1 < suggested remove operation key=QD5GBLNCY707 tag=GGEDW2TO2HZL type=del 2024-01-13T18:20:45.389 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.388+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=KO3WJX98WH17 type=del size=332370 2024-01-13T18:20:45.393 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.392+0000 7f759fd04880 1 < suggested remove operation key=QS9PLJKINY4R tag=0CI18NNCU88B type=del 2024-01-13T18:20:45.397 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.396+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~YT37MDRN4MQO.0 size=1048576 2024-01-13T18:20:45.399 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.398+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~YT37MDRN4MQO.1 size=631035 2024-01-13T18:20:45.399 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.398+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=YT37MDRN4MQO tag=79L7RU4P5V4R type=write size=2728187 2024-01-13T18:20:45.401 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.400+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~DRIZ9EI82SA8.0 size=387948 2024-01-13T18:20:45.404 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.403+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=DRIZ9EI82SA8 tag=M6GLHZLJ8HXR type=write size=1436524 2024-01-13T18:20:45.406 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.405+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=6G50UU10ANQB type=del size=3702489 2024-01-13T18:20:45.410 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.409+0000 7f759fd04880 1 < suggested remove operation key=H972TC5DOMHL tag=I7YRB9IQDEB1 type=del 2024-01-13T18:20:45.413 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.412+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~HBJKUGVMEG84.0 size=1048576 2024-01-13T18:20:45.415 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.414+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~HBJKUGVMEG84.1 size=188154 2024-01-13T18:20:45.415 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.414+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=HBJKUGVMEG84 tag=QJZ2S35HSG9O type=write size=2285306 2024-01-13T18:20:45.417 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.416+0000 7f759fd04880 1 < completed write operation key=DOXP3EJ03EBY tag=PWXEJHDO6DCV type=write size=990132 2024-01-13T18:20:45.422 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.421+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~9VBSIHRIQ38M.0 size=1048576 2024-01-13T18:20:45.423 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.422+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~9VBSIHRIQ38M.1 size=616799 2024-01-13T18:20:45.423 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.422+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=9VBSIHRIQ38M tag=GXLAT2K0NE2K type=write size=2713951 2024-01-13T18:20:45.426 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.425+0000 7f759fd04880 -1 < failed to complete operation key=QS9PLJKINY4R tag=K41FERAUQD4M type=del size=264448: (22) Invalid argument 2024-01-13T18:20:45.428 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.427+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=2S22ZX8GIR64 type=del size=4013361 2024-01-13T18:20:45.430 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.429+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=3GA1H7OORP79 type=del 2024-01-13T18:20:45.434 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.433+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~XTTYTRPI2L54.0 size=1048576 2024-01-13T18:20:45.436 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.435+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~XTTYTRPI2L54.1 size=1048576 2024-01-13T18:20:45.438 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.437+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~XTTYTRPI2L54.2 size=383547 2024-01-13T18:20:45.438 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.437+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=XTTYTRPI2L54 tag=Q8TGLI0GETIU type=write size=3529275 2024-01-13T18:20:45.440 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.439+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~RLMADZIWOXJS.0 size=1048576 2024-01-13T18:20:45.442 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.441+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~RLMADZIWOXJS.1 size=108058 2024-01-13T18:20:45.446 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.445+0000 7f759fd04880 1 < completed multipart upload key=7R5YIO7UFSDZ upload=RLMADZIWOXJS tag=PWOMR0UKZ33N type=write size=2205210 2024-01-13T18:20:45.448 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.447+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=CH21ZK2O187V type=del size=1071964 2024-01-13T18:20:45.450 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.449+0000 7f759fd04880 1 < canceled operation key=AJZB1PXB1NB5 tag=VOE2RV82EXPJ type=del size=2266647 2024-01-13T18:20:45.452 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.451+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=1CFLZOZRZK3N type=write size=32872 2024-01-13T18:20:45.453 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.453+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~4SYQVPGYNXWY.0 size=1048576 2024-01-13T18:20:45.456 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.454+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~4SYQVPGYNXWY.1 size=649511 2024-01-13T18:20:45.459 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.458+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=4SYQVPGYNXWY tag=PNA9TIHCP97Q type=write size=2746663 2024-01-13T18:20:45.462 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.461+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~L3UKFM6MAFA9.0 size=1048576 2024-01-13T18:20:45.464 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.463+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~L3UKFM6MAFA9.1 size=1048576 2024-01-13T18:20:45.466 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.465+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~L3UKFM6MAFA9.2 size=456845 2024-01-13T18:20:45.466 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.465+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=L3UKFM6MAFA9 tag=9UP9HRMIGZMV type=write size=3602573 2024-01-13T18:20:45.468 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.467+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=A2LZ9SGAD8K1 type=del 2024-01-13T18:20:45.470 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.470+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=DRLX268QONKM type=write size=879278 2024-01-13T18:20:45.472 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.471+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~U1KZICLGXC28.0 size=1048576 2024-01-13T18:20:45.474 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.473+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~U1KZICLGXC28.1 size=683677 2024-01-13T18:20:45.479 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.477+0000 7f759fd04880 1 < completed multipart upload key=VZHGQM6ZNJYQ upload=U1KZICLGXC28 tag=FV3SZ226UB9G type=write size=2780829 2024-01-13T18:20:45.481 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.480+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~7GDOJY3KZPQR.0 size=1048576 2024-01-13T18:20:45.483 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.482+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~7GDOJY3KZPQR.1 size=499112 2024-01-13T18:20:45.483 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.482+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=7GDOJY3KZPQR tag=ZS1MZS0PP5C0 type=write size=2596264 2024-01-13T18:20:45.487 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.486+0000 7f759fd04880 1 < suggested update operation key=VZHGQM6ZNJYQ tag=WKJVRI8FO4F2 type=write size=609559 2024-01-13T18:20:45.491 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.490+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~XH1MUPUARGOV.0 size=1048576 2024-01-13T18:20:45.493 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.492+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~XH1MUPUARGOV.1 size=1023131 2024-01-13T18:20:45.493 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.492+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=XH1MUPUARGOV tag=S28Y4M78K799 type=write size=3120283 2024-01-13T18:20:45.495 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.494+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=VHS0RDP7DLMT type=del 2024-01-13T18:20:45.498 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.496+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=LT2B8U1IQRJP type=del size=3700 2024-01-13T18:20:45.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.498+0000 7f759fd04880 1 < completed write operation key=ZI9WAZQHVPAR tag=VOF3E3ULJ4YT type=write size=370185 2024-01-13T18:20:45.503 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.502+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~J0ARTLT91SNF.0 size=23095 2024-01-13T18:20:45.504 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.502+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=J0ARTLT91SNF tag=ZQ0SQ40KH59Q type=write size=1071671 2024-01-13T18:20:45.506 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.505+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=174ZH11D47YG type=del 2024-01-13T18:20:45.508 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.507+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=JYD1W3ICBATH type=del size=2594157 2024-01-13T18:20:45.510 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.509+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=KO3WJX98WH17 type=del 2024-01-13T18:20:45.512 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.511+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=ZWHJ3SQ37KK7 type=del size=2125273 2024-01-13T18:20:45.514 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.513+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~YT37MDRN4MQO.0 size=1048576 2024-01-13T18:20:45.515 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.513+0000 7f759fd04880 1 < canceled part key=_multipart_OMA1B74S8FXS.2~YT37MDRN4MQO.1 size=631035 2024-01-13T18:20:45.518 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.517+0000 7f759fd04880 1 < canceled multipart upload key=OMA1B74S8FXS upload=YT37MDRN4MQO tag=79L7RU4P5V4R type=write size=2728187 2024-01-13T18:20:45.520 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.519+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=ZGNJ6PENP0C2 type=del size=1854027 2024-01-13T18:20:45.524 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.523+0000 7f759fd04880 -1 < failed to complete operation key=VZHGQM6ZNJYQ tag=6G50UU10ANQB type=del size=3702489: (22) Invalid argument 2024-01-13T18:20:45.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.526+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~2M6LQ8CTSMMD.0 size=1048576 2024-01-13T18:20:45.529 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.528+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~2M6LQ8CTSMMD.1 size=441567 2024-01-13T18:20:45.529 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.528+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=2M6LQ8CTSMMD tag=M2WVE4TBG3L1 type=write size=2538719 2024-01-13T18:20:45.530 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.528+0000 7f759fd04880 1 < canceled part key=_multipart_DOXP3EJ03EBY.2~HBJKUGVMEG84.0 size=1048576 2024-01-13T18:20:45.531 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.530+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~HBJKUGVMEG84.1 size=188154 2024-01-13T18:20:45.535 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.534+0000 7f759fd04880 1 < canceled multipart upload key=DOXP3EJ03EBY upload=HBJKUGVMEG84 tag=QJZ2S35HSG9O type=write size=2285306 2024-01-13T18:20:45.537 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.536+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=ZC3K32O6EQES type=del size=163448 2024-01-13T18:20:45.539 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.538+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~9VBSIHRIQ38M.0 size=1048576 2024-01-13T18:20:45.541 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.539+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~9VBSIHRIQ38M.1 size=616799 2024-01-13T18:20:45.544 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.543+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=9VBSIHRIQ38M tag=GXLAT2K0NE2K type=write size=2713951 2024-01-13T18:20:45.546 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.545+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=JUOPB62MMNX3 type=del size=2454928 2024-01-13T18:20:45.548 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.547+0000 7f759fd04880 1 < completed delete operation key=1YNH6QHP354U tag=2S22ZX8GIR64 type=del 2024-01-13T18:20:45.550 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.549+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=49LGMLRH6ANR type=del size=800207 2024-01-13T18:20:45.553 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.552+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~XTTYTRPI2L54.0 size=1048576 2024-01-13T18:20:45.553 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.552+0000 7f759fd04880 1 < canceled part key=_multipart_P8FMRQR7GXN7.2~XTTYTRPI2L54.1 size=1048576 2024-01-13T18:20:45.554 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.553+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~XTTYTRPI2L54.2 size=383547 2024-01-13T18:20:45.558 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.557+0000 7f759fd04880 1 < canceled multipart upload key=P8FMRQR7GXN7 upload=XTTYTRPI2L54 tag=Q8TGLI0GETIU type=write size=3529275 2024-01-13T18:20:45.560 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.559+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=NKO6TDMJ67QP type=del size=3710560 2024-01-13T18:20:45.562 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.561+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=CH21ZK2O187V type=del 2024-01-13T18:20:45.566 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.565+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~W1QJ134JF0CT.0 size=1048576 2024-01-13T18:20:45.568 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.567+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~W1QJ134JF0CT.1 size=140219 2024-01-13T18:20:45.568 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.567+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=W1QJ134JF0CT tag=3BXYVRS0THZQ type=write size=2237371 2024-01-13T18:20:45.570 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.569+0000 7f759fd04880 1 < completed write operation key=1QEZO616DBC3 tag=1CFLZOZRZK3N type=write size=32872 2024-01-13T18:20:45.572 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.571+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=VNOP3NMLZJJR type=del size=804387 2024-01-13T18:20:45.574 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.573+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~L3UKFM6MAFA9.0 size=1048576 2024-01-13T18:20:45.575 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.575+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~L3UKFM6MAFA9.1 size=1048576 2024-01-13T18:20:45.577 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.576+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~L3UKFM6MAFA9.2 size=456845 2024-01-13T18:20:45.581 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.580+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=L3UKFM6MAFA9 tag=9UP9HRMIGZMV type=write size=3602573 2024-01-13T18:20:45.585 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.584+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~JISZ10SIIOFJ.0 size=6413 2024-01-13T18:20:45.585 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.584+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=JISZ10SIIOFJ tag=FODF15X4X6A7 type=write size=1054989 2024-01-13T18:20:45.590 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.589+0000 7f759fd04880 1 < suggested update operation key=0TIZPXX8CMHA tag=DRLX268QONKM type=write size=879278 2024-01-13T18:20:45.592 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.591+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=CS0G1DUVBR5G type=del size=3871834 2024-01-13T18:20:45.594 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.593+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~7GDOJY3KZPQR.0 size=1048576 2024-01-13T18:20:45.596 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.595+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~7GDOJY3KZPQR.1 size=499112 2024-01-13T18:20:45.600 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.599+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=7GDOJY3KZPQR tag=ZS1MZS0PP5C0 type=write size=2596264 2024-01-13T18:20:45.602 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.601+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=JI4I7YODTVG1 type=del size=3415451 2024-01-13T18:20:45.604 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.603+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~XH1MUPUARGOV.0 size=1048576 2024-01-13T18:20:45.606 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.605+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~XH1MUPUARGOV.1 size=1023131 2024-01-13T18:20:45.609 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.608+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=XH1MUPUARGOV tag=S28Y4M78K799 type=write size=3120283 2024-01-13T18:20:45.611 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.610+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=CKND7C7EKCY5 type=del size=67981 2024-01-13T18:20:45.614 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.613+0000 7f759fd04880 -1 < failed to complete operation key=0TIZPXX8CMHA tag=LT2B8U1IQRJP type=del size=3700: (22) Invalid argument 2024-01-13T18:20:45.616 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.615+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=TE6PQUS5KHVQ type=del size=1408026 2024-01-13T18:20:45.617 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.616+0000 7f759fd04880 1 < canceled part key=_multipart_1QEZO616DBC3.2~J0ARTLT91SNF.0 size=23095 2024-01-13T18:20:45.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:45 smithi099 ceph-mon[138788]: pgmap v1461: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.2 MiB/s rd, 439 KiB/s wr, 2.24k op/s 2024-01-13T18:20:45.621 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.620+0000 7f759fd04880 1 < canceled multipart upload key=1QEZO616DBC3 upload=J0ARTLT91SNF tag=ZQ0SQ40KH59Q type=write size=1071671 2024-01-13T18:20:45.623 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.622+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=VAVCDCBXB64Q type=write size=24499 2024-01-13T18:20:45.625 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.624+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=JYD1W3ICBATH type=del 2024-01-13T18:20:45.627 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.626+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=BFL0Z7R0L4SW type=del size=126463 2024-01-13T18:20:45.629 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.628+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=ZWHJ3SQ37KK7 type=del 2024-01-13T18:20:45.633 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.632+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~L16HR91QH5LM.0 size=655366 2024-01-13T18:20:45.633 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.632+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=L16HR91QH5LM tag=7Y0X0IX5CVHW type=write size=1703942 2024-01-13T18:20:45.635 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.634+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=ZGNJ6PENP0C2 type=del 2024-01-13T18:20:45.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.636+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=M3IM4DN5531D type=write size=405041 2024-01-13T18:20:45.640 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.638+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~2M6LQ8CTSMMD.0 size=1048576 2024-01-13T18:20:45.642 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.641+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~2M6LQ8CTSMMD.1 size=441567 2024-01-13T18:20:45.646 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.645+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=2M6LQ8CTSMMD tag=M2WVE4TBG3L1 type=write size=2538719 2024-01-13T18:20:45.648 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.647+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=TL2JB6DSHA57 type=del size=2177455 2024-01-13T18:20:45.651 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.650+0000 7f759fd04880 1 < suggested remove operation key=WSRJB811XCVL tag=ZC3K32O6EQES type=del 2024-01-13T18:20:45.653 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.652+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=GW0HACVVYE1G type=del size=3741717 2024-01-13T18:20:45.658 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.657+0000 7f759fd04880 1 < suggested update operation key=ZI9WAZQHVPAR tag=JUOPB62MMNX3 type=del size=2454928 2024-01-13T18:20:45.660 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.659+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=92GAWH47VD7Z type=del size=1569692 2024-01-13T18:20:45.663 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.662+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=49LGMLRH6ANR type=del 2024-01-13T18:20:45.667 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.666+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~T4UBVMGU3J1I.0 size=1048576 2024-01-13T18:20:45.669 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.668+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~T4UBVMGU3J1I.1 size=309618 2024-01-13T18:20:45.669 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.668+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=T4UBVMGU3J1I tag=XNMXUHFJ6MYU type=write size=2406770 2024-01-13T18:20:45.671 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.670+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=NKO6TDMJ67QP type=del 2024-01-13T18:20:45.673 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.672+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=QEQP1731TZ4P type=del size=2513844 2024-01-13T18:20:45.675 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.674+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~W1QJ134JF0CT.0 size=1048576 2024-01-13T18:20:45.677 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.676+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~W1QJ134JF0CT.1 size=140219 2024-01-13T18:20:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:45 smithi084 ceph-mon[116404]: pgmap v1461: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.2 MiB/s rd, 439 KiB/s wr, 2.24k op/s 2024-01-13T18:20:45.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:45 smithi084 ceph-mon[119097]: pgmap v1461: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.2 MiB/s rd, 439 KiB/s wr, 2.24k op/s 2024-01-13T18:20:45.681 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.680+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=W1QJ134JF0CT tag=3BXYVRS0THZQ type=write size=2237371 2024-01-13T18:20:45.683 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.682+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=MJ0NCMZLYTKB type=write size=330545 2024-01-13T18:20:45.685 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.684+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=VNOP3NMLZJJR type=del 2024-01-13T18:20:45.689 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.688+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~XMSSN2AEANRW.0 size=1048576 2024-01-13T18:20:45.691 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.690+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~XMSSN2AEANRW.1 size=597456 2024-01-13T18:20:45.691 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.690+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=XMSSN2AEANRW tag=42G1SA90GLDY type=write size=2694608 2024-01-13T18:20:45.693 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.692+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~JISZ10SIIOFJ.0 size=6413 2024-01-13T18:20:45.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.696+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=JISZ10SIIOFJ tag=FODF15X4X6A7 type=write size=1054989 2024-01-13T18:20:45.699 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.698+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=P91UG5PWI1XA type=del size=3688080 2024-01-13T18:20:45.702 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.701+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=CS0G1DUVBR5G type=del 2024-01-13T18:20:45.704 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.703+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=H4M1KF9617RT type=write size=470569 2024-01-13T18:20:45.706 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.705+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=JI4I7YODTVG1 type=del 2024-01-13T18:20:45.710 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.709+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~F6AKVFXGUWK3.0 size=1048576 2024-01-13T18:20:45.712 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.711+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~F6AKVFXGUWK3.1 size=1048576 2024-01-13T18:20:45.714 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.713+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~F6AKVFXGUWK3.2 size=528848 2024-01-13T18:20:45.714 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.713+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=F6AKVFXGUWK3 tag=1O3CHLU54KJF type=write size=3674576 2024-01-13T18:20:45.716 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.715+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=CKND7C7EKCY5 type=del 2024-01-13T18:20:45.718 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.717+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=TPOTJVANHK2H type=del size=2829216 2024-01-13T18:20:45.721 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.719+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=TE6PQUS5KHVQ type=del 2024-01-13T18:20:45.722 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.721+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=VM21F26XLOWK type=del size=619110 2024-01-13T18:20:45.724 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.723+0000 7f759fd04880 1 < completed write operation key=QD5GBLNCY707 tag=VAVCDCBXB64Q type=write size=24499 2024-01-13T18:20:45.728 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.727+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~QNZ6UMMYSQGL.0 size=1048576 2024-01-13T18:20:45.730 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.729+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~QNZ6UMMYSQGL.1 size=1035678 2024-01-13T18:20:45.730 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.729+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=QNZ6UMMYSQGL tag=KL120Q3KL3HO type=write size=3132830 2024-01-13T18:20:45.732 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.731+0000 7f759fd04880 1 < canceled operation key=XBTWSUA3D7U3 tag=BFL0Z7R0L4SW type=del size=126463 2024-01-13T18:20:45.736 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.735+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~HMS5RUMPQM8M.0 size=1048576 2024-01-13T18:20:45.738 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.737+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~HMS5RUMPQM8M.1 size=79696 2024-01-13T18:20:45.738 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.737+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=HMS5RUMPQM8M tag=993QXE0B985G type=write size=2176848 2024-01-13T18:20:45.740 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.739+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~L16HR91QH5LM.0 size=655366 2024-01-13T18:20:45.743 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.742+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=L16HR91QH5LM tag=7Y0X0IX5CVHW type=write size=1703942 2024-01-13T18:20:45.746 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.745+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=9OTT36G8PS7I type=write size=553764 2024-01-13T18:20:45.748 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.747+0000 7f759fd04880 1 < completed write operation key=QKNPXHB99KVP tag=M3IM4DN5531D type=write size=405041 2024-01-13T18:20:45.751 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.750+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=YFH8EAAA8SWD type=del size=2334431 2024-01-13T18:20:45.753 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.752+0000 7f759fd04880 1 < canceled operation key=H7C1UAGAUR7D tag=TL2JB6DSHA57 type=del size=2177455 2024-01-13T18:20:45.756 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.755+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=WFERJVXYUW7H type=del size=2008073 2024-01-13T18:20:45.758 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.757+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=GW0HACVVYE1G type=del 2024-01-13T18:20:45.762 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.761+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~L9PKCFVWVUTU.0 size=1048576 2024-01-13T18:20:45.764 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.763+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~L9PKCFVWVUTU.1 size=288456 2024-01-13T18:20:45.764 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.763+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=L9PKCFVWVUTU tag=DA1OQPE3VGEK type=write size=2385608 2024-01-13T18:20:45.767 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.765+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=92GAWH47VD7Z type=del 2024-01-13T18:20:45.769 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.767+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=26HMS3BYDHFV type=write size=526348 2024-01-13T18:20:45.770 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.768+0000 7f759fd04880 1 < canceled part key=_multipart_VZHGQM6ZNJYQ.2~T4UBVMGU3J1I.0 size=1048576 2024-01-13T18:20:45.771 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.770+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~T4UBVMGU3J1I.1 size=309618 2024-01-13T18:20:45.774 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.773+0000 7f759fd04880 1 < canceled multipart upload key=VZHGQM6ZNJYQ upload=T4UBVMGU3J1I tag=XNMXUHFJ6MYU type=write size=2406770 2024-01-13T18:20:45.776 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.775+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=K0V98UL9ATS8 type=del size=899989 2024-01-13T18:20:45.778 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.777+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=QEQP1731TZ4P type=del 2024-01-13T18:20:45.780 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.779+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=2SD9QUBEQ5KW type=del size=2138658 2024-01-13T18:20:45.782 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.781+0000 7f759fd04880 1 < canceled operation key=AJZB1PXB1NB5 tag=MJ0NCMZLYTKB type=write size=330545 2024-01-13T18:20:45.784 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.783+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=GYR9L6SHCY7Q type=del size=1908540 2024-01-13T18:20:45.786 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.785+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~XMSSN2AEANRW.0 size=1048576 2024-01-13T18:20:45.788 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.787+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~XMSSN2AEANRW.1 size=597456 2024-01-13T18:20:45.791 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.791+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=XMSSN2AEANRW tag=42G1SA90GLDY type=write size=2694608 2024-01-13T18:20:45.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.795+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~K1A9U3F97PDS.0 size=1048576 2024-01-13T18:20:45.797 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.796+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~K1A9U3F97PDS.1 size=170645 2024-01-13T18:20:45.797 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.796+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=K1A9U3F97PDS tag=DU9PCK6M9ZYX type=write size=2267797 2024-01-13T18:20:45.799 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.798+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=P91UG5PWI1XA type=del 2024-01-13T18:20:45.801 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.800+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=SED3T523WWTM type=del size=1853936 2024-01-13T18:20:45.803 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.802+0000 7f759fd04880 1 < completed write operation key=JGALONWJXLQY tag=H4M1KF9617RT type=write size=470569 2024-01-13T18:20:45.806 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.804+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=A6473CL7OP1U type=del size=3277084 2024-01-13T18:20:45.808 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.807+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~F6AKVFXGUWK3.0 size=1048576 2024-01-13T18:20:45.809 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.808+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~F6AKVFXGUWK3.1 size=1048576 2024-01-13T18:20:45.811 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.810+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~F6AKVFXGUWK3.2 size=528848 2024-01-13T18:20:45.815 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.814+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=F6AKVFXGUWK3 tag=1O3CHLU54KJF type=write size=3674576 2024-01-13T18:20:45.819 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.818+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~P2CBJ3WA25LD.0 size=218578 2024-01-13T18:20:45.819 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.818+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=P2CBJ3WA25LD tag=51H7HF0NCTGK type=write size=1267154 2024-01-13T18:20:45.821 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.820+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=TPOTJVANHK2H type=del 2024-01-13T18:20:45.824 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.822+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=UOPB3NWU0IE3 type=del size=7344 2024-01-13T18:20:45.826 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.825+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=VM21F26XLOWK type=del 2024-01-13T18:20:45.828 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.827+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=Q6JZ7FUWGRVC type=write size=45102 2024-01-13T18:20:45.830 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.829+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~QNZ6UMMYSQGL.0 size=1048576 2024-01-13T18:20:45.832 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.831+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~QNZ6UMMYSQGL.1 size=1035678 2024-01-13T18:20:45.835 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.834+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=QNZ6UMMYSQGL tag=KL120Q3KL3HO type=write size=3132830 2024-01-13T18:20:45.838 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.836+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=262WC015WTYK type=write size=254658 2024-01-13T18:20:45.840 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.838+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~HMS5RUMPQM8M.0 size=1048576 2024-01-13T18:20:45.840 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.839+0000 7f759fd04880 1 < canceled part key=_multipart_1WSQNY2NDY3K.2~HMS5RUMPQM8M.1 size=79696 2024-01-13T18:20:45.843 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.842+0000 7f759fd04880 1 < canceled multipart upload key=1WSQNY2NDY3K upload=HMS5RUMPQM8M tag=993QXE0B985G type=write size=2176848 2024-01-13T18:20:45.846 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.845+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=ZXT85UPM45IN type=write size=41358 2024-01-13T18:20:45.848 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.847+0000 7f759fd04880 1 < completed write operation key=ZI9WAZQHVPAR tag=9OTT36G8PS7I type=write size=553764 2024-01-13T18:20:45.853 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.852+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~YXCIR78THZLK.0 size=1048576 2024-01-13T18:20:45.855 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.854+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~YXCIR78THZLK.1 size=1048576 2024-01-13T18:20:45.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.856+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~YXCIR78THZLK.2 size=268839 2024-01-13T18:20:45.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.856+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=YXCIR78THZLK tag=8STGB5XGPKR3 type=write size=3414567 2024-01-13T18:20:45.859 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.858+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=YFH8EAAA8SWD type=del 2024-01-13T18:20:45.862 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.861+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=T8V4ADCNP0XJ type=del size=1209359 2024-01-13T18:20:45.864 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.863+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=WFERJVXYUW7H type=del 2024-01-13T18:20:45.866 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.865+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=3GW0CQKCEG8D type=del size=124951 2024-01-13T18:20:45.868 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.867+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~L9PKCFVWVUTU.0 size=1048576 2024-01-13T18:20:45.870 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.869+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~L9PKCFVWVUTU.1 size=288456 2024-01-13T18:20:45.874 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.874+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=L9PKCFVWVUTU tag=DA1OQPE3VGEK type=write size=2385608 2024-01-13T18:20:45.879 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.879+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~272HKRIVU184.0 size=86541 2024-01-13T18:20:45.880 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.879+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=272HKRIVU184 tag=8D3NZOTW000S type=write size=1135117 2024-01-13T18:20:45.881 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.880+0000 7f759fd04880 1 < completed write operation key=3K20F802EFEQ tag=26HMS3BYDHFV type=write size=526348 2024-01-13T18:20:45.883 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.883+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=ELYFBZPTUJV0 type=del size=3837701 2024-01-13T18:20:45.886 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.885+0000 7f759fd04880 1 < canceled operation key=1YNH6QHP354U tag=K0V98UL9ATS8 type=del size=899989 2024-01-13T18:20:45.890 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.889+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~1071LW50FM6R.0 size=1048576 2024-01-13T18:20:45.891 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.891+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~1071LW50FM6R.1 size=105599 2024-01-13T18:20:45.892 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.891+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=1071LW50FM6R tag=KOZ5JG7C89OP type=write size=2202751 2024-01-13T18:20:45.894 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.893+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=2SD9QUBEQ5KW type=del 2024-01-13T18:20:45.897 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.897+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~WKGOPBITXS00.0 size=1048576 2024-01-13T18:20:45.899 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.898+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~WKGOPBITXS00.1 size=1048576 2024-01-13T18:20:45.901 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.900+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~WKGOPBITXS00.2 size=618704 2024-01-13T18:20:45.901 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.900+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=WKGOPBITXS00 tag=8IQTUVRVSMEK type=write size=3764432 2024-01-13T18:20:45.903 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.902+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=GYR9L6SHCY7Q type=del 2024-01-13T18:20:45.905 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.904+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=PEY4ZBO1HPYJ type=del size=2040859 2024-01-13T18:20:45.907 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.906+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~K1A9U3F97PDS.0 size=1048576 2024-01-13T18:20:45.909 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.908+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~K1A9U3F97PDS.1 size=170645 2024-01-13T18:20:45.913 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.912+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=K1A9U3F97PDS tag=DU9PCK6M9ZYX type=write size=2267797 2024-01-13T18:20:45.915 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.914+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=L92SNQZ5QY3A type=del size=1152226 2024-01-13T18:20:45.917 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.916+0000 7f759fd04880 1 < canceled operation key=RY0W5S41XK3F tag=SED3T523WWTM type=del size=1853936 2024-01-13T18:20:45.921 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.920+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~OFNC01NFAXGC.0 size=1048576 2024-01-13T18:20:45.923 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.922+0000 7f759fd04880 1 > prepared part key=_multipart_2OO7S2NBZ7M6.2~OFNC01NFAXGC.1 size=491464 2024-01-13T18:20:45.923 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.922+0000 7f759fd04880 1 > prepared multipart upload key=2OO7S2NBZ7M6 upload=OFNC01NFAXGC tag=93NYV5PCM49Q type=write size=2588616 2024-01-13T18:20:45.925 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.924+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=A6473CL7OP1U type=del 2024-01-13T18:20:45.927 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.926+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=LIPKS77I7GDB type=del size=2827650 2024-01-13T18:20:45.929 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.928+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~P2CBJ3WA25LD.0 size=218578 2024-01-13T18:20:45.933 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.932+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=P2CBJ3WA25LD tag=51H7HF0NCTGK type=write size=1267154 2024-01-13T18:20:45.937 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.936+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~VEAXZFI1FGKF.0 size=1048576 2024-01-13T18:20:45.939 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.938+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~VEAXZFI1FGKF.1 size=1048576 2024-01-13T18:20:45.941 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.940+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~VEAXZFI1FGKF.2 size=850902 2024-01-13T18:20:45.941 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.940+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=VEAXZFI1FGKF tag=Y0WHAMMDXC42 type=write size=3996630 2024-01-13T18:20:45.943 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.942+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=UOPB3NWU0IE3 type=del 2024-01-13T18:20:45.947 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.946+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~AXFLEVQEFPTX.0 size=1048576 2024-01-13T18:20:45.948 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.947+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~AXFLEVQEFPTX.1 size=1046076 2024-01-13T18:20:45.948 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.947+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=AXFLEVQEFPTX tag=4L7M4J6H1PY7 type=write size=3143228 2024-01-13T18:20:45.951 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.950+0000 7f759fd04880 1 < completed write operation key=QD5GBLNCY707 tag=Q6JZ7FUWGRVC type=write size=45102 2024-01-13T18:20:45.955 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.954+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~C7Y6CK99IT37.0 size=1048576 2024-01-13T18:20:45.957 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.956+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~C7Y6CK99IT37.1 size=1048576 2024-01-13T18:20:45.959 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.958+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~C7Y6CK99IT37.2 size=681900 2024-01-13T18:20:45.959 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.958+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=C7Y6CK99IT37 tag=N9689I1O1YTP type=write size=3827628 2024-01-13T18:20:45.962 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.961+0000 7f759fd04880 1 < completed write operation key=ZI9WAZQHVPAR tag=262WC015WTYK type=write size=254658 2024-01-13T18:20:45.964 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.963+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=YAIW1Y9EXFHL type=del size=3671195 2024-01-13T18:20:45.967 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.967+0000 7f759fd04880 1 < suggested update operation key=VZHGQM6ZNJYQ tag=ZXT85UPM45IN type=write size=41358 2024-01-13T18:20:45.969 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.968+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=B54SLIT1MZUA type=del size=1701694 2024-01-13T18:20:45.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.970+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~YXCIR78THZLK.0 size=1048576 2024-01-13T18:20:45.973 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.972+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~YXCIR78THZLK.1 size=1048576 2024-01-13T18:20:45.975 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.974+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~YXCIR78THZLK.2 size=268839 2024-01-13T18:20:45.979 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.978+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=YXCIR78THZLK tag=8STGB5XGPKR3 type=write size=3414567 2024-01-13T18:20:45.981 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.980+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=CZSMEY88XU9H type=write size=223071 2024-01-13T18:20:45.985 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.984+0000 7f759fd04880 1 < suggested update operation key=QS9PLJKINY4R tag=T8V4ADCNP0XJ type=del size=1209359 2024-01-13T18:20:45.987 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.986+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=C4VEL5HNF5TO type=del size=1549946 2024-01-13T18:20:45.989 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.988+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=3GW0CQKCEG8D type=del 2024-01-13T18:20:45.991 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.990+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=RQ50LISYGE4L type=del size=2013927 2024-01-13T18:20:45.994 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.993+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~272HKRIVU184.0 size=86541 2024-01-13T18:20:45.997 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:45.996+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=272HKRIVU184 tag=8D3NZOTW000S type=write size=1135117 2024-01-13T18:20:46.002 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.001+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~0KE8PLKKJAN2.0 size=1048576 2024-01-13T18:20:46.004 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.003+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~0KE8PLKKJAN2.1 size=721355 2024-01-13T18:20:46.004 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.003+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=0KE8PLKKJAN2 tag=PF6925G7W6NZ type=write size=2818507 2024-01-13T18:20:46.007 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.005+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=ELYFBZPTUJV0 type=del 2024-01-13T18:20:46.009 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.009+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~R87WHW4DUATM.0 size=1048576 2024-01-13T18:20:46.012 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.011+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~R87WHW4DUATM.1 size=239740 2024-01-13T18:20:46.012 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.011+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=R87WHW4DUATM tag=P7XDN6QD39X3 type=write size=2336892 2024-01-13T18:20:46.014 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.013+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~1071LW50FM6R.0 size=1048576 2024-01-13T18:20:46.014 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.013+0000 7f759fd04880 1 < canceled part key=_multipart_VZHGQM6ZNJYQ.2~1071LW50FM6R.1 size=105599 2024-01-13T18:20:46.018 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.017+0000 7f759fd04880 1 < canceled multipart upload key=VZHGQM6ZNJYQ upload=1071LW50FM6R tag=KOZ5JG7C89OP type=write size=2202751 2024-01-13T18:20:46.022 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.019+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=TBSQMD35YJWI type=del size=2913655 2024-01-13T18:20:46.023 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.022+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~WKGOPBITXS00.0 size=1048576 2024-01-13T18:20:46.024 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.023+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~WKGOPBITXS00.1 size=1048576 2024-01-13T18:20:46.026 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.025+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~WKGOPBITXS00.2 size=618704 2024-01-13T18:20:46.030 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.029+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=WKGOPBITXS00 tag=8IQTUVRVSMEK type=write size=3764432 2024-01-13T18:20:46.032 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.031+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=PU776W0PDB4N type=del size=1742656 2024-01-13T18:20:46.035 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.034+0000 7f759fd04880 -1 < failed to complete operation key=QS9PLJKINY4R tag=PEY4ZBO1HPYJ type=del size=2040859: (22) Invalid argument 2024-01-13T18:20:46.037 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.036+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=MSZH54KFZJCT type=del size=2216556 2024-01-13T18:20:46.040 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.039+0000 7f759fd04880 -1 < failed to complete operation key=QS9PLJKINY4R tag=L92SNQZ5QY3A type=del size=1152226: (22) Invalid argument 2024-01-13T18:20:46.043 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.041+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=EGAGSV4SXFHZ type=del size=3265720 2024-01-13T18:20:46.044 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.043+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~OFNC01NFAXGC.0 size=1048576 2024-01-13T18:20:46.046 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.045+0000 7f759fd04880 1 < completed part key=_multipart_2OO7S2NBZ7M6.2~OFNC01NFAXGC.1 size=491464 2024-01-13T18:20:46.049 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.048+0000 7f759fd04880 1 < completed multipart upload key=2OO7S2NBZ7M6 upload=OFNC01NFAXGC tag=93NYV5PCM49Q type=write size=2588616 2024-01-13T18:20:46.053 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.052+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~QTG4IZZGEXS3.0 size=1048576 2024-01-13T18:20:46.055 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.054+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~QTG4IZZGEXS3.1 size=1048576 2024-01-13T18:20:46.057 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.056+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~QTG4IZZGEXS3.2 size=287822 2024-01-13T18:20:46.057 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.056+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=QTG4IZZGEXS3 tag=GKTSQGF00XSJ type=write size=3433550 2024-01-13T18:20:46.059 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.058+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=LIPKS77I7GDB type=del 2024-01-13T18:20:46.061 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.060+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=JBSIMP7OC3WE type=write size=305237 2024-01-13T18:20:46.063 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.062+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~VEAXZFI1FGKF.0 size=1048576 2024-01-13T18:20:46.065 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.065+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~VEAXZFI1FGKF.1 size=1048576 2024-01-13T18:20:46.068 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.067+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~VEAXZFI1FGKF.2 size=850902 2024-01-13T18:20:46.072 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.071+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=VEAXZFI1FGKF tag=Y0WHAMMDXC42 type=write size=3996630 2024-01-13T18:20:46.075 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.074+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~12029894E8Y2.0 size=1048576 2024-01-13T18:20:46.077 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.076+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~12029894E8Y2.1 size=147317 2024-01-13T18:20:46.077 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.076+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=12029894E8Y2 tag=HS6FUJGAA91C type=write size=2244469 2024-01-13T18:20:46.079 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.078+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~AXFLEVQEFPTX.0 size=1048576 2024-01-13T18:20:46.081 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.080+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~AXFLEVQEFPTX.1 size=1046076 2024-01-13T18:20:46.085 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.083+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=AXFLEVQEFPTX tag=4L7M4J6H1PY7 type=write size=3143228 2024-01-13T18:20:46.086 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.085+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=UH75GK8VG5RC type=write size=715450 2024-01-13T18:20:46.089 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.088+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~C7Y6CK99IT37.0 size=1048576 2024-01-13T18:20:46.090 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.089+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~C7Y6CK99IT37.1 size=1048576 2024-01-13T18:20:46.092 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.091+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~C7Y6CK99IT37.2 size=681900 2024-01-13T18:20:46.096 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.095+0000 7f759fd04880 1 < completed multipart upload key=VZHGQM6ZNJYQ upload=C7Y6CK99IT37 tag=N9689I1O1YTP type=write size=3827628 2024-01-13T18:20:46.098 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.097+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=TI1DYZZNTVBE type=write size=265293 2024-01-13T18:20:46.101 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.100+0000 7f759fd04880 -1 < failed to complete operation key=QS9PLJKINY4R tag=YAIW1Y9EXFHL type=del size=3671195: (22) Invalid argument 2024-01-13T18:20:46.103 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.102+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=QJAHBK2R03Q9 type=del size=2136064 2024-01-13T18:20:46.105 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.104+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=B54SLIT1MZUA type=del 2024-01-13T18:20:46.107 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.106+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=3VY1RFNH8VAP type=del size=936398 2024-01-13T18:20:46.109 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.108+0000 7f759fd04880 1 < completed write operation key=ZI9WAZQHVPAR tag=CZSMEY88XU9H type=write size=223071 2024-01-13T18:20:46.115 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.112+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~OV493GEEVX1J.0 size=1048576 2024-01-13T18:20:46.115 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.114+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~OV493GEEVX1J.1 size=878779 2024-01-13T18:20:46.115 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.114+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=OV493GEEVX1J tag=DOSOB3X1SIJJ type=write size=2975931 2024-01-13T18:20:46.117 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.116+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=C4VEL5HNF5TO type=del 2024-01-13T18:20:46.121 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.120+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~6YFA8LJPST3G.0 size=1044608 2024-01-13T18:20:46.121 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.120+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=6YFA8LJPST3G tag=WUE63CVZNASG type=write size=2093184 2024-01-13T18:20:46.125 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.124+0000 7f759fd04880 1 < suggested remove operation key=1WSQNY2NDY3K tag=RQ50LISYGE4L type=del 2024-01-13T18:20:46.127 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.126+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=SSIGSZYE5V2I type=del size=2394004 2024-01-13T18:20:46.129 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.128+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~0KE8PLKKJAN2.0 size=1048576 2024-01-13T18:20:46.131 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.130+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~0KE8PLKKJAN2.1 size=721355 2024-01-13T18:20:46.135 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.134+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=0KE8PLKKJAN2 tag=PF6925G7W6NZ type=write size=2818507 2024-01-13T18:20:46.138 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.137+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~X5HVI6R4D40A.0 size=1048576 2024-01-13T18:20:46.140 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.139+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~X5HVI6R4D40A.1 size=1048576 2024-01-13T18:20:46.141 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.141+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~X5HVI6R4D40A.2 size=592447 2024-01-13T18:20:46.142 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.141+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=X5HVI6R4D40A tag=SN83KDIHDE1D type=write size=3738175 2024-01-13T18:20:46.144 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.143+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~R87WHW4DUATM.0 size=1048576 2024-01-13T18:20:46.146 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.145+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~R87WHW4DUATM.1 size=239740 2024-01-13T18:20:46.149 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.148+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=R87WHW4DUATM tag=P7XDN6QD39X3 type=write size=2336892 2024-01-13T18:20:46.151 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.150+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=0PWG8YUC1H8R type=del size=25462 2024-01-13T18:20:46.153 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.152+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=TBSQMD35YJWI type=del 2024-01-13T18:20:46.157 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.156+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~QFL52OCNLDJA.0 size=1048576 2024-01-13T18:20:46.159 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.158+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~QFL52OCNLDJA.1 size=811200 2024-01-13T18:20:46.160 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.159+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=QFL52OCNLDJA tag=TLHKJRZ9VUDH type=write size=2908352 2024-01-13T18:20:46.163 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.162+0000 7f759fd04880 1 < suggested remove operation key=P8FMRQR7GXN7 tag=PU776W0PDB4N type=del 2024-01-13T18:20:46.165 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.164+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=NEPNDR1VBYJW type=del size=1625773 2024-01-13T18:20:46.167 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.166+0000 7f759fd04880 1 < completed delete operation key=7LXXSKLOM1JZ tag=MSZH54KFZJCT type=del 2024-01-13T18:20:46.169 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.168+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=YB6DFE3CMJ5C type=del size=3284332 2024-01-13T18:20:46.172 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.172+0000 7f759fd04880 -1 < failed to complete operation key=1WSQNY2NDY3K tag=EGAGSV4SXFHZ type=del size=3265720: (22) Invalid argument 2024-01-13T18:20:46.175 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.174+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=3DVK0WQMEU4H type=del size=1139313 2024-01-13T18:20:46.176 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.175+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~QTG4IZZGEXS3.0 size=1048576 2024-01-13T18:20:46.178 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.177+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~QTG4IZZGEXS3.1 size=1048576 2024-01-13T18:20:46.180 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.179+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~QTG4IZZGEXS3.2 size=287822 2024-01-13T18:20:46.184 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.183+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=QTG4IZZGEXS3 tag=GKTSQGF00XSJ type=write size=3433550 2024-01-13T18:20:46.186 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.185+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=ONRIUN5YEMFL type=write size=11582 2024-01-13T18:20:46.188 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.187+0000 7f759fd04880 1 < completed write operation key=7WRTM9ANJRT4 tag=JBSIMP7OC3WE type=write size=305237 2024-01-13T18:20:46.190 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.189+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=WXYYFCX3V3WI type=del size=2277829 2024-01-13T18:20:46.192 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.191+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~12029894E8Y2.0 size=1048576 2024-01-13T18:20:46.193 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.192+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~12029894E8Y2.1 size=147317 2024-01-13T18:20:46.197 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.196+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=12029894E8Y2 tag=HS6FUJGAA91C type=write size=2244469 2024-01-13T18:20:46.201 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.200+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~F7LXOCHE0J6V.0 size=1048576 2024-01-13T18:20:46.202 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.201+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~F7LXOCHE0J6V.1 size=1048576 2024-01-13T18:20:46.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.203+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~F7LXOCHE0J6V.2 size=641042 2024-01-13T18:20:46.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.203+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=F7LXOCHE0J6V tag=4PMKG8I8P91K type=write size=3786770 2024-01-13T18:20:46.207 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.205+0000 7f759fd04880 1 < completed write operation key=H972TC5DOMHL tag=UH75GK8VG5RC type=write size=715450 2024-01-13T18:20:46.209 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.208+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=3L4MXSE9OICC type=del size=4126995 2024-01-13T18:20:46.211 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.210+0000 7f759fd04880 1 < completed write operation key=7LXXSKLOM1JZ tag=TI1DYZZNTVBE type=write size=265293 2024-01-13T18:20:46.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.212+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=RNSGLJSJJT2H type=del size=750229 2024-01-13T18:20:46.215 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.214+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=QJAHBK2R03Q9 type=del 2024-01-13T18:20:46.218 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.217+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~OHLRNRCIG1UX.0 size=1048576 2024-01-13T18:20:46.220 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.219+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~OHLRNRCIG1UX.1 size=759645 2024-01-13T18:20:46.220 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.219+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=OHLRNRCIG1UX tag=INU2XLFBZ5R9 type=write size=2856797 2024-01-13T18:20:46.224 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.223+0000 7f759fd04880 1 < suggested update operation key=RY0W5S41XK3F tag=3VY1RFNH8VAP type=del size=936398 2024-01-13T18:20:46.227 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.225+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=G7LQPUGJ98YT type=del size=2783195 2024-01-13T18:20:46.229 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.228+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~OV493GEEVX1J.0 size=1048576 2024-01-13T18:20:46.230 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.229+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~OV493GEEVX1J.1 size=878779 2024-01-13T18:20:46.234 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.233+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=OV493GEEVX1J tag=DOSOB3X1SIJJ type=write size=2975931 2024-01-13T18:20:46.237 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.236+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~C4BN3M7K48I4.0 size=1048576 2024-01-13T18:20:46.239 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.238+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~C4BN3M7K48I4.1 size=1048576 2024-01-13T18:20:46.241 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.240+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~C4BN3M7K48I4.2 size=320783 2024-01-13T18:20:46.241 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.240+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=C4BN3M7K48I4 tag=4JA59XQ33VCX type=write size=3466511 2024-01-13T18:20:46.243 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.242+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~6YFA8LJPST3G.0 size=1044608 2024-01-13T18:20:46.246 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.245+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=6YFA8LJPST3G tag=WUE63CVZNASG type=write size=2093184 2024-01-13T18:20:46.251 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.250+0000 7f759fd04880 1 > prepared part key=_multipart_7R5YIO7UFSDZ.2~APNX73RJD2F3.0 size=708448 2024-01-13T18:20:46.251 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.250+0000 7f759fd04880 1 > prepared multipart upload key=7R5YIO7UFSDZ upload=APNX73RJD2F3 tag=559PDD54XXFA type=write size=1757024 2024-01-13T18:20:46.253 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.252+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=SSIGSZYE5V2I type=del 2024-01-13T18:20:46.255 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.254+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=XPN8AHDCK2WK type=del size=375152 2024-01-13T18:20:46.257 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.256+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~X5HVI6R4D40A.0 size=1048576 2024-01-13T18:20:46.259 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.258+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~X5HVI6R4D40A.1 size=1048576 2024-01-13T18:20:46.260 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.259+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~X5HVI6R4D40A.2 size=592447 2024-01-13T18:20:46.265 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.264+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=X5HVI6R4D40A tag=SN83KDIHDE1D type=write size=3738175 2024-01-13T18:20:46.269 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.268+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~60NPX3JCNOM1.0 size=1048576 2024-01-13T18:20:46.270 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.269+0000 7f759fd04880 1 > prepared part key=_multipart_P8FMRQR7GXN7.2~60NPX3JCNOM1.1 size=727278 2024-01-13T18:20:46.270 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.269+0000 7f759fd04880 1 > prepared multipart upload key=P8FMRQR7GXN7 upload=60NPX3JCNOM1 tag=WOYOPLDKZ5W2 type=write size=2824430 2024-01-13T18:20:46.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.271+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=0PWG8YUC1H8R type=del 2024-01-13T18:20:46.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.273+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=FNERWZODVAZ0 type=del size=1331045 2024-01-13T18:20:46.276 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.275+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~QFL52OCNLDJA.0 size=1048576 2024-01-13T18:20:46.278 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.277+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~QFL52OCNLDJA.1 size=811200 2024-01-13T18:20:46.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.281+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=QFL52OCNLDJA tag=TLHKJRZ9VUDH type=write size=2908352 2024-01-13T18:20:46.284 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.283+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=E50TLJ1PX7BJ type=del size=1576793 2024-01-13T18:20:46.286 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.285+0000 7f759fd04880 1 < canceled operation key=XBTWSUA3D7U3 tag=NEPNDR1VBYJW type=del size=1625773 2024-01-13T18:20:46.288 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.287+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=P1QI0K5VHATJ type=del size=4163916 2024-01-13T18:20:46.290 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.289+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=YB6DFE3CMJ5C type=del 2024-01-13T18:20:46.293 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.292+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=KEOFU2WXLZVU type=write size=53375 2024-01-13T18:20:46.295 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.294+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=3DVK0WQMEU4H type=del 2024-01-13T18:20:46.297 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.296+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=OYR3LTHV8NBM type=del size=2847658 2024-01-13T18:20:46.299 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.298+0000 7f759fd04880 1 < completed write operation key=VZHGQM6ZNJYQ tag=ONRIUN5YEMFL type=write size=11582 2024-01-13T18:20:46.302 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.300+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=0QVXVDLCQ5HB type=del size=3591651 2024-01-13T18:20:46.303 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.302+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=WXYYFCX3V3WI type=del 2024-01-13T18:20:46.305 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.304+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=2QRV29UN06NK type=write size=612265 2024-01-13T18:20:46.307 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.306+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~F7LXOCHE0J6V.0 size=1048576 2024-01-13T18:20:46.309 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.308+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~F7LXOCHE0J6V.1 size=1048576 2024-01-13T18:20:46.311 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.310+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~F7LXOCHE0J6V.2 size=641042 2024-01-13T18:20:46.314 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.313+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=F7LXOCHE0J6V tag=4PMKG8I8P91K type=write size=3786770 2024-01-13T18:20:46.318 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.317+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~531GCPI1T5H9.0 size=1048576 2024-01-13T18:20:46.320 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.319+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~531GCPI1T5H9.1 size=1048576 2024-01-13T18:20:46.322 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.321+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~531GCPI1T5H9.2 size=618661 2024-01-13T18:20:46.322 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.321+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=531GCPI1T5H9 tag=GMGQDRMJSXDP type=write size=3764389 2024-01-13T18:20:46.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.323+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=3L4MXSE9OICC type=del 2024-01-13T18:20:46.326 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.325+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=PT3MWOO43254 type=write size=895718 2024-01-13T18:20:46.330 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.329+0000 7f759fd04880 1 < suggested remove operation key=8EWIOXN5H9KU tag=RNSGLJSJJT2H type=del 2024-01-13T18:20:46.332 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.331+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=6F6QSSESAR0Q type=del size=3986715 2024-01-13T18:20:46.334 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.333+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~OHLRNRCIG1UX.0 size=1048576 2024-01-13T18:20:46.335 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.334+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~OHLRNRCIG1UX.1 size=759645 2024-01-13T18:20:46.339 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.338+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=OHLRNRCIG1UX tag=INU2XLFBZ5R9 type=write size=2856797 2024-01-13T18:20:46.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.340+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=IFUUYHEE3QL5 type=write size=634695 2024-01-13T18:20:46.343 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.342+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=G7LQPUGJ98YT type=del 2024-01-13T18:20:46.347 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.346+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~3DSFDI3XJ6AP.0 size=1048576 2024-01-13T18:20:46.349 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.348+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~3DSFDI3XJ6AP.1 size=1048576 2024-01-13T18:20:46.351 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.350+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~3DSFDI3XJ6AP.2 size=286626 2024-01-13T18:20:46.351 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.350+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=3DSFDI3XJ6AP tag=L8JH54MEAKLP type=write size=3432354 2024-01-13T18:20:46.354 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.352+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~C4BN3M7K48I4.0 size=1048576 2024-01-13T18:20:46.356 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.355+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~C4BN3M7K48I4.1 size=1048576 2024-01-13T18:20:46.358 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.357+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~C4BN3M7K48I4.2 size=320783 2024-01-13T18:20:46.361 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.360+0000 7f759fd04880 1 < completed multipart upload key=OMA1B74S8FXS upload=C4BN3M7K48I4 tag=4JA59XQ33VCX type=write size=3466511 2024-01-13T18:20:46.363 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.362+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=KB92IUZWIQLX type=del size=251836 2024-01-13T18:20:46.365 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.364+0000 7f759fd04880 1 < completed part key=_multipart_7R5YIO7UFSDZ.2~APNX73RJD2F3.0 size=708448 2024-01-13T18:20:46.369 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.367+0000 7f759fd04880 1 < completed multipart upload key=7R5YIO7UFSDZ upload=APNX73RJD2F3 tag=559PDD54XXFA type=write size=1757024 2024-01-13T18:20:46.370 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.369+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=DY0O1X25226D type=del size=4027449 2024-01-13T18:20:46.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.372+0000 7f759fd04880 1 < completed delete operation key=QKNPXHB99KVP tag=XPN8AHDCK2WK type=del 2024-01-13T18:20:46.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.374+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=TS4YNAQ9NI10 type=del size=1473135 2024-01-13T18:20:46.377 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.376+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~60NPX3JCNOM1.0 size=1048576 2024-01-13T18:20:46.379 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.378+0000 7f759fd04880 1 < completed part key=_multipart_P8FMRQR7GXN7.2~60NPX3JCNOM1.1 size=727278 2024-01-13T18:20:46.383 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.382+0000 7f759fd04880 1 < completed multipart upload key=P8FMRQR7GXN7 upload=60NPX3JCNOM1 tag=WOYOPLDKZ5W2 type=write size=2824430 2024-01-13T18:20:46.385 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.384+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=6EQD4RKXII3Y type=del size=765662 2024-01-13T18:20:46.387 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.386+0000 7f759fd04880 1 < canceled operation key=H4VHC37BOZJ3 tag=FNERWZODVAZ0 type=del size=1331045 2024-01-13T18:20:46.389 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.388+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=OS34AO8T3W0N type=del size=3654644 2024-01-13T18:20:46.391 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.390+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=E50TLJ1PX7BJ type=del 2024-01-13T18:20:46.393 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.392+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=H3ZR3YQRLMQW type=del size=2577512 2024-01-13T18:20:46.396 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.395+0000 7f759fd04880 1 < suggested update operation key=P8FMRQR7GXN7 tag=P1QI0K5VHATJ type=del size=4163916 2024-01-13T18:20:46.398 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.397+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=VM77WKI82ILO type=write size=144555 2024-01-13T18:20:46.402 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.401+0000 7f759fd04880 1 < suggested update operation key=6GOU0WSHKUQ0 tag=KEOFU2WXLZVU type=write size=53375 2024-01-13T18:20:46.404 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.403+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=66LYNZJIGLNW type=write size=44314 2024-01-13T18:20:46.408 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.407+0000 7f759fd04880 1 < suggested remove operation key=H972TC5DOMHL tag=OYR3LTHV8NBM type=del 2024-01-13T18:20:46.412 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.411+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~WNC4QMR8ULIX.0 size=1048576 2024-01-13T18:20:46.415 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.413+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~WNC4QMR8ULIX.1 size=1048576 2024-01-13T18:20:46.416 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.415+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~WNC4QMR8ULIX.2 size=243026 2024-01-13T18:20:46.416 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.415+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=WNC4QMR8ULIX tag=NKZDS11RPZG9 type=write size=3388754 2024-01-13T18:20:46.418 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.417+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=0QVXVDLCQ5HB type=del 2024-01-13T18:20:46.422 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.421+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~23JV04JDYEMI.0 size=92773 2024-01-13T18:20:46.422 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.421+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=23JV04JDYEMI tag=L1ZJG5JRBBIV type=write size=1141349 2024-01-13T18:20:46.425 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.424+0000 7f759fd04880 -1 < failed to complete operation key=8EWIOXN5H9KU tag=2QRV29UN06NK type=write size=612265: (22) Invalid argument 2024-01-13T18:20:46.427 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.426+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=6J6X8K0GAKOQ type=del size=2503728 2024-01-13T18:20:46.427 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.426+0000 7f759fd04880 1 < canceled part key=_multipart_AJZB1PXB1NB5.2~531GCPI1T5H9.0 size=1048576 2024-01-13T18:20:46.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.428+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~531GCPI1T5H9.1 size=1048576 2024-01-13T18:20:46.431 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.430+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~531GCPI1T5H9.2 size=618661 2024-01-13T18:20:46.435 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.434+0000 7f759fd04880 1 < canceled multipart upload key=AJZB1PXB1NB5 upload=531GCPI1T5H9 tag=GMGQDRMJSXDP type=write size=3764389 2024-01-13T18:20:46.437 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.436+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=YL916YCF6GGY type=del size=62729 2024-01-13T18:20:46.439 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.438+0000 7f759fd04880 1 < completed write operation key=QKNPXHB99KVP tag=PT3MWOO43254 type=write size=895718 2024-01-13T18:20:46.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.442+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~3R46MYJE2QZO.0 size=86887 2024-01-13T18:20:46.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.442+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=3R46MYJE2QZO tag=61RWF3HTB2Z0 type=write size=1135463 2024-01-13T18:20:46.444 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.444+0000 7f759fd04880 1 < canceled operation key=7R5YIO7UFSDZ tag=6F6QSSESAR0Q type=del size=3986715 2024-01-13T18:20:46.448 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.447+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~XHVH6L1H4SQ2.0 size=1048576 2024-01-13T18:20:46.450 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.449+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~XHVH6L1H4SQ2.1 size=1002235 2024-01-13T18:20:46.450 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.449+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=XHVH6L1H4SQ2 tag=EV4C9IGLJCG5 type=write size=3099387 2024-01-13T18:20:46.454 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.453+0000 7f759fd04880 1 < suggested remove operation key=WSRJB811XCVL tag=IFUUYHEE3QL5 type=write 2024-01-13T18:20:46.457 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.456+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=T0D0MH3H2SHM type=del size=311870 2024-01-13T18:20:46.459 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.458+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~3DSFDI3XJ6AP.0 size=1048576 2024-01-13T18:20:46.461 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.460+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~3DSFDI3XJ6AP.1 size=1048576 2024-01-13T18:20:46.463 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.462+0000 7f759fd04880 1 < completed part key=_multipart_EW3ZFDVIQZ7G.2~3DSFDI3XJ6AP.2 size=286626 2024-01-13T18:20:46.466 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.465+0000 7f759fd04880 1 < completed multipart upload key=EW3ZFDVIQZ7G upload=3DSFDI3XJ6AP tag=L8JH54MEAKLP type=write size=3432354 2024-01-13T18:20:46.468 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.467+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=2HDMD417SOD8 type=del size=1269387 2024-01-13T18:20:46.471 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.470+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=KB92IUZWIQLX type=del 2024-01-13T18:20:46.473 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.472+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=G1QSV25CTJC9 type=del size=1536003 2024-01-13T18:20:46.476 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.475+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=DY0O1X25226D type=del 2024-01-13T18:20:46.478 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.477+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=8G4EYUGUA6HC type=del size=1151736 2024-01-13T18:20:46.483 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.481+0000 7f759fd04880 1 < suggested update operation key=1YNH6QHP354U tag=TS4YNAQ9NI10 type=del size=1473135 2024-01-13T18:20:46.486 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.485+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~B87UXVBFMYRX.0 size=1048576 2024-01-13T18:20:46.488 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.487+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~B87UXVBFMYRX.1 size=1048576 2024-01-13T18:20:46.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.488+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~B87UXVBFMYRX.2 size=962138 2024-01-13T18:20:46.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.488+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=B87UXVBFMYRX tag=JWEKFGYEGGS1 type=write size=4107866 2024-01-13T18:20:46.491 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.490+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=6EQD4RKXII3Y type=del 2024-01-13T18:20:46.495 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.494+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~IIKA80RV1E0Z.0 size=1048576 2024-01-13T18:20:46.497 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.496+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~IIKA80RV1E0Z.1 size=1048576 2024-01-13T18:20:46.498 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.498+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~IIKA80RV1E0Z.2 size=943738 2024-01-13T18:20:46.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.498+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=IIKA80RV1E0Z tag=VY4QF8IIQ003 type=write size=4089466 2024-01-13T18:20:46.501 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.499+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=OS34AO8T3W0N type=del 2024-01-13T18:20:46.502 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.501+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=NXQ421D4QOSM type=del size=2096410 2024-01-13T18:20:46.507 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.506+0000 7f759fd04880 1 < suggested update operation key=2OO7S2NBZ7M6 tag=H3ZR3YQRLMQW type=del size=2577512 2024-01-13T18:20:46.511 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.510+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~LBWNMQNZ1D3A.0 size=1048576 2024-01-13T18:20:46.513 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.512+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~LBWNMQNZ1D3A.1 size=510898 2024-01-13T18:20:46.513 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.512+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=LBWNMQNZ1D3A tag=XMKMWR513TGV type=write size=2608050 2024-01-13T18:20:46.515 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.514+0000 7f759fd04880 1 < completed write operation key=7WRTM9ANJRT4 tag=VM77WKI82ILO type=write size=144555 2024-01-13T18:20:46.517 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.516+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=6SITAJV8A3E8 type=del size=2826017 2024-01-13T18:20:46.519 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.518+0000 7f759fd04880 1 < canceled operation key=QD5GBLNCY707 tag=66LYNZJIGLNW type=write size=44314 2024-01-13T18:20:46.523 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.522+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~OW4GCNAFC6SN.0 size=1048576 2024-01-13T18:20:46.525 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.524+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~OW4GCNAFC6SN.1 size=505611 2024-01-13T18:20:46.525 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.524+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=OW4GCNAFC6SN tag=QEI3DKDUU33T type=write size=2602763 2024-01-13T18:20:46.527 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.526+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~WNC4QMR8ULIX.0 size=1048576 2024-01-13T18:20:46.529 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.528+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~WNC4QMR8ULIX.1 size=1048576 2024-01-13T18:20:46.531 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.529+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~WNC4QMR8ULIX.2 size=243026 2024-01-13T18:20:46.535 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.534+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=WNC4QMR8ULIX tag=NKZDS11RPZG9 type=write size=3388754 2024-01-13T18:20:46.537 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.536+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=2CYB9ZF7V8NG type=del size=2353507 2024-01-13T18:20:46.539 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.538+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~23JV04JDYEMI.0 size=92773 2024-01-13T18:20:46.542 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.541+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=23JV04JDYEMI tag=L1ZJG5JRBBIV type=write size=1141349 2024-01-13T18:20:46.544 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.543+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=3OAURPJVZT9P type=del size=2530490 2024-01-13T18:20:46.549 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.548+0000 7f759fd04880 1 < suggested update operation key=1WSQNY2NDY3K tag=6J6X8K0GAKOQ type=del size=2503728 2024-01-13T18:20:46.551 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.550+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=IWY7OFWBPR3T type=del size=3356094 2024-01-13T18:20:46.554 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.553+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=YL916YCF6GGY type=del 2024-01-13T18:20:46.556 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.555+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=O49LN7NQUY65 type=del size=542739 2024-01-13T18:20:46.559 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.557+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~3R46MYJE2QZO.0 size=86887 2024-01-13T18:20:46.563 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.562+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=3R46MYJE2QZO tag=61RWF3HTB2Z0 type=write size=1135463 2024-01-13T18:20:46.565 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.564+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=SCRPLWV2BZDJ type=write size=470357 2024-01-13T18:20:46.565 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.564+0000 7f759fd04880 1 < canceled part key=_multipart_8EWIOXN5H9KU.2~XHVH6L1H4SQ2.0 size=1048576 2024-01-13T18:20:46.566 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.566+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~XHVH6L1H4SQ2.1 size=1002235 2024-01-13T18:20:46.570 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.569+0000 7f759fd04880 1 < canceled multipart upload key=8EWIOXN5H9KU upload=XHVH6L1H4SQ2 tag=EV4C9IGLJCG5 type=write size=3099387 2024-01-13T18:20:46.575 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.574+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~52LCA4HEYC26.0 size=1048576 2024-01-13T18:20:46.577 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.576+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~52LCA4HEYC26.1 size=102923 2024-01-13T18:20:46.577 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.576+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=52LCA4HEYC26 tag=HSYQ172HL36H type=write size=2200075 2024-01-13T18:20:46.579 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.578+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=T0D0MH3H2SHM type=del 2024-01-13T18:20:46.580 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.579+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=Z1D2N488UWRH type=del size=1260491 2024-01-13T18:20:46.583 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.583+0000 7f759fd04880 -1 < failed to complete operation key=1WSQNY2NDY3K tag=2HDMD417SOD8 type=del size=1269387: (22) Invalid argument 2024-01-13T18:20:46.586 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.585+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=2BUDKIBI0T6Q type=del size=1017808 2024-01-13T18:20:46.587 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.587+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=G1QSV25CTJC9 type=del 2024-01-13T18:20:46.591 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.590+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~ZGUA4QWJL2V3.0 size=1048576 2024-01-13T18:20:46.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.592+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~ZGUA4QWJL2V3.1 size=410811 2024-01-13T18:20:46.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.592+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=ZGUA4QWJL2V3 tag=XWDFJW5RPYE0 type=write size=2507963 2024-01-13T18:20:46.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.594+0000 7f759fd04880 1 < canceled operation key=1O3XX67RKHNW tag=8G4EYUGUA6HC type=del size=1151736 2024-01-13T18:20:46.597 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.596+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=D1LAQKBOFH2P type=del size=3322861 2024-01-13T18:20:46.597 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.596+0000 7f759fd04880 1 < canceled part key=_multipart_7LXXSKLOM1JZ.2~B87UXVBFMYRX.0 size=1048576 2024-01-13T18:20:46.599 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.598+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~B87UXVBFMYRX.1 size=1048576 2024-01-13T18:20:46.599 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.598+0000 7f759fd04880 1 < canceled part key=_multipart_7LXXSKLOM1JZ.2~B87UXVBFMYRX.2 size=962138 2024-01-13T18:20:46.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.602+0000 7f759fd04880 1 < canceled multipart upload key=7LXXSKLOM1JZ upload=B87UXVBFMYRX tag=JWEKFGYEGGS1 type=write size=4107866 2024-01-13T18:20:46.604 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.603+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=SL35K5KYB4E5 type=write size=973299 2024-01-13T18:20:46.607 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.606+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~IIKA80RV1E0Z.0 size=1048576 2024-01-13T18:20:46.608 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.608+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~IIKA80RV1E0Z.1 size=1048576 2024-01-13T18:20:46.610 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.609+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~IIKA80RV1E0Z.2 size=943738 2024-01-13T18:20:46.614 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.613+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=IIKA80RV1E0Z tag=VY4QF8IIQ003 type=write size=4089466 2024-01-13T18:20:46.616 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.615+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=BL4V4JONQXZX type=del size=3592827 2024-01-13T18:20:46.619 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.618+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=NXQ421D4QOSM type=del 2024-01-13T18:20:46.621 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.620+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=VSANQUQFLRCY type=del size=11882 2024-01-13T18:20:46.623 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.622+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~LBWNMQNZ1D3A.0 size=1048576 2024-01-13T18:20:46.625 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.624+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~LBWNMQNZ1D3A.1 size=510898 2024-01-13T18:20:46.628 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.627+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=LBWNMQNZ1D3A tag=XMKMWR513TGV type=write size=2608050 2024-01-13T18:20:46.630 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.629+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=43L4108CG52C type=del size=2296602 2024-01-13T18:20:46.632 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.632+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=6SITAJV8A3E8 type=del 2024-01-13T18:20:46.634 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.634+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=MP9EDLTIYHV4 type=del size=2892366 2024-01-13T18:20:46.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.636+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~OW4GCNAFC6SN.0 size=1048576 2024-01-13T18:20:46.638 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.637+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~OW4GCNAFC6SN.1 size=505611 2024-01-13T18:20:46.642 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.641+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=OW4GCNAFC6SN tag=QEI3DKDUU33T type=write size=2602763 2024-01-13T18:20:46.646 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.645+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~T11EV6RMOO71.0 size=1048576 2024-01-13T18:20:46.648 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.647+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~T11EV6RMOO71.1 size=541383 2024-01-13T18:20:46.648 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.647+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=T11EV6RMOO71 tag=2HTM6QBZ0XM2 type=write size=2638535 2024-01-13T18:20:46.652 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.651+0000 7f759fd04880 1 < suggested remove operation key=H7C1UAGAUR7D tag=2CYB9ZF7V8NG type=del 2024-01-13T18:20:46.654 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.653+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=Y2UHP9100LL0 type=del size=2773607 2024-01-13T18:20:46.656 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.655+0000 7f759fd04880 1 < completed delete operation key=JN46AMLYHN8E tag=3OAURPJVZT9P type=del 2024-01-13T18:20:46.658 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.657+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=KES0TSEOV02F type=del size=970812 2024-01-13T18:20:46.660 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.659+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=IWY7OFWBPR3T type=del 2024-01-13T18:20:46.662 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.661+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=PA8S55883UYU type=del size=13591 2024-01-13T18:20:46.664 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.663+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=O49LN7NQUY65 type=del 2024-01-13T18:20:46.666 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.665+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=9NJWU2KAGHWE type=del size=3187365 2024-01-13T18:20:46.670 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.669+0000 7f759fd04880 1 < suggested update operation key=7LXXSKLOM1JZ tag=SCRPLWV2BZDJ type=write size=470357 2024-01-13T18:20:46.674 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.673+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~MUB11V59SOQH.0 size=565279 2024-01-13T18:20:46.674 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.673+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=MUB11V59SOQH tag=O6U7PSKQ53Y2 type=write size=1613855 2024-01-13T18:20:46.676 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.675+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~52LCA4HEYC26.0 size=1048576 2024-01-13T18:20:46.677 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.676+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~52LCA4HEYC26.1 size=102923 2024-01-13T18:20:46.681 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.680+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=52LCA4HEYC26 tag=HSYQ172HL36H type=write size=2200075 2024-01-13T18:20:46.685 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.684+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~RKMD7S7Y25D0.0 size=1048576 2024-01-13T18:20:46.687 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.686+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~RKMD7S7Y25D0.1 size=37758 2024-01-13T18:20:46.687 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.686+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=RKMD7S7Y25D0 tag=EILU3PX3WFO6 type=write size=2134910 2024-01-13T18:20:46.688 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.688+0000 7f759fd04880 1 < canceled operation key=VZHGQM6ZNJYQ tag=Z1D2N488UWRH type=del size=1260491 2024-01-13T18:20:46.690 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.690+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=BEBZH0EYPAMY type=write size=1008701 2024-01-13T18:20:46.692 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.692+0000 7f759fd04880 1 < canceled operation key=JGALONWJXLQY tag=2BUDKIBI0T6Q type=del size=1017808 2024-01-13T18:20:46.695 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.694+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=PC3SIAW43D2V type=write size=775760 2024-01-13T18:20:46.697 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.696+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~ZGUA4QWJL2V3.0 size=1048576 2024-01-13T18:20:46.699 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.698+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~ZGUA4QWJL2V3.1 size=410811 2024-01-13T18:20:46.703 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.702+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=ZGUA4QWJL2V3 tag=XWDFJW5RPYE0 type=write size=2507963 2024-01-13T18:20:46.704 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.703+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=R73645X8EYSZ type=del size=3991566 2024-01-13T18:20:46.706 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.705+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=D1LAQKBOFH2P type=del 2024-01-13T18:20:46.711 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.710+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~9KQMHQ1CKPI6.0 size=991751 2024-01-13T18:20:46.711 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.710+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=9KQMHQ1CKPI6 tag=C40CV6EYA9ZG type=write size=2040327 2024-01-13T18:20:46.713 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.712+0000 7f759fd04880 1 < completed write operation key=P8FMRQR7GXN7 tag=SL35K5KYB4E5 type=write size=973299 2024-01-13T18:20:46.716 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.715+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~4VD29ECZQ8G1.0 size=676017 2024-01-13T18:20:46.716 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.715+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=4VD29ECZQ8G1 tag=JZ529RZYT7BI type=write size=1724593 2024-01-13T18:20:46.720 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.719+0000 7f759fd04880 1 < suggested update operation key=JN46AMLYHN8E tag=BL4V4JONQXZX type=del size=3592827 2024-01-13T18:20:46.723 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.722+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=2B1UJ4T9QMHD type=del size=556878 2024-01-13T18:20:46.728 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.726+0000 7f759fd04880 1 < suggested update operation key=7R5YIO7UFSDZ tag=VSANQUQFLRCY type=del size=11882 2024-01-13T18:20:46.732 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.730+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~1NF1JGZYCE4T.0 size=748900 2024-01-13T18:20:46.732 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.730+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=1NF1JGZYCE4T tag=FRLFJ842XGNJ type=write size=1797476 2024-01-13T18:20:46.733 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.732+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=43L4108CG52C type=del 2024-01-13T18:20:46.738 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.737+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~5VGXCH5WX47O.0 size=42013 2024-01-13T18:20:46.738 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.737+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=5VGXCH5WX47O tag=T4YJ9QIV2EDO type=write size=1090589 2024-01-13T18:20:46.740 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.739+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=MP9EDLTIYHV4 type=del 2024-01-13T18:20:46.742 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.741+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=7RKYN1RRL21Z type=del size=3695550 2024-01-13T18:20:46.744 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.743+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~T11EV6RMOO71.0 size=1048576 2024-01-13T18:20:46.746 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.745+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~T11EV6RMOO71.1 size=541383 2024-01-13T18:20:46.750 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.749+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=T11EV6RMOO71 tag=2HTM6QBZ0XM2 type=write size=2638535 2024-01-13T18:20:46.753 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.752+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~6VGA185AUHCJ.0 size=495101 2024-01-13T18:20:46.754 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.752+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=6VGA185AUHCJ tag=1WAICOSR2USG type=write size=1543677 2024-01-13T18:20:46.756 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.755+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=Y2UHP9100LL0 type=del 2024-01-13T18:20:46.759 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.758+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=B1A4YQT4493J type=del size=2018390 2024-01-13T18:20:46.761 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.760+0000 7f759fd04880 1 < canceled operation key=QS9PLJKINY4R tag=KES0TSEOV02F type=del size=970812 2024-01-13T18:20:46.765 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.764+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~ETKLZ9MVMTRW.0 size=1048576 2024-01-13T18:20:46.767 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.766+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~ETKLZ9MVMTRW.1 size=315510 2024-01-13T18:20:46.767 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.766+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=ETKLZ9MVMTRW tag=MISVBWNFC1UP type=write size=2412662 2024-01-13T18:20:46.769 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.769+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=PA8S55883UYU type=del 2024-01-13T18:20:46.772 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.770+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=X8REWLAA699O type=write size=263491 2024-01-13T18:20:46.774 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.773+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=9NJWU2KAGHWE type=del 2024-01-13T18:20:46.776 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.775+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=DRZ38C2IKV2C type=del size=1770050 2024-01-13T18:20:46.778 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.777+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~MUB11V59SOQH.0 size=565279 2024-01-13T18:20:46.782 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.781+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=MUB11V59SOQH tag=O6U7PSKQ53Y2 type=write size=1613855 2024-01-13T18:20:46.785 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.784+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~NUC1TM3L5E2D.0 size=1048576 2024-01-13T18:20:46.787 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.786+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~NUC1TM3L5E2D.1 size=1048576 2024-01-13T18:20:46.789 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.788+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~NUC1TM3L5E2D.2 size=363399 2024-01-13T18:20:46.789 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.788+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=NUC1TM3L5E2D tag=NZ6LWWO7OBBH type=write size=3509127 2024-01-13T18:20:46.790 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.790+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~RKMD7S7Y25D0.0 size=1048576 2024-01-13T18:20:46.792 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.791+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~RKMD7S7Y25D0.1 size=37758 2024-01-13T18:20:46.796 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.795+0000 7f759fd04880 1 < completed multipart upload key=OMA1B74S8FXS upload=RKMD7S7Y25D0 tag=EILU3PX3WFO6 type=write size=2134910 2024-01-13T18:20:46.798 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.797+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=XT9ZMH0RPEW5 type=write size=64487 2024-01-13T18:20:46.800 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.799+0000 7f759fd04880 1 < completed write operation key=0TIZPXX8CMHA tag=BEBZH0EYPAMY type=write size=1008701 2024-01-13T18:20:46.803 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.802+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=J1Q2UDW9N3FO type=write size=907901 2024-01-13T18:20:46.805 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.804+0000 7f759fd04880 1 < completed write operation key=QD5GBLNCY707 tag=PC3SIAW43D2V type=write size=775760 2024-01-13T18:20:46.808 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.807+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=YG38URQMP750 type=del size=311117 2024-01-13T18:20:46.812 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.811+0000 7f759fd04880 1 < suggested remove operation key=BPUBFFWB9D3C tag=R73645X8EYSZ type=del 2024-01-13T18:20:46.816 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.815+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~025UJXEECPDP.0 size=1048576 2024-01-13T18:20:46.818 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.817+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~025UJXEECPDP.1 size=292805 2024-01-13T18:20:46.818 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.817+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=025UJXEECPDP tag=IDRSVD2RDB9E type=write size=2389957 2024-01-13T18:20:46.818 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.817+0000 7f759fd04880 1 < canceled part key=_multipart_1WSQNY2NDY3K.2~9KQMHQ1CKPI6.0 size=991751 2024-01-13T18:20:46.824 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.821+0000 7f759fd04880 1 < canceled multipart upload key=1WSQNY2NDY3K upload=9KQMHQ1CKPI6 tag=C40CV6EYA9ZG type=write size=2040327 2024-01-13T18:20:46.825 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.824+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~Y85QVKXA84JF.0 size=1048576 2024-01-13T18:20:46.827 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.826+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~Y85QVKXA84JF.1 size=576267 2024-01-13T18:20:46.827 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.826+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=Y85QVKXA84JF tag=MI4D1ACNEYKQ type=write size=2673419 2024-01-13T18:20:46.829 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.828+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~4VD29ECZQ8G1.0 size=676017 2024-01-13T18:20:46.832 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.831+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=4VD29ECZQ8G1 tag=JZ529RZYT7BI type=write size=1724593 2024-01-13T18:20:46.836 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.835+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~W0XSP463PTGN.0 size=1048576 2024-01-13T18:20:46.838 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.837+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~W0XSP463PTGN.1 size=1007045 2024-01-13T18:20:46.838 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.837+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=W0XSP463PTGN tag=1RUZ8I7IJXDC type=write size=3104197 2024-01-13T18:20:46.840 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.839+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=2B1UJ4T9QMHD type=del 2024-01-13T18:20:46.843 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.842+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=5LJQHR3ML5WG type=del size=405996 2024-01-13T18:20:46.845 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.844+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~1NF1JGZYCE4T.0 size=748900 2024-01-13T18:20:46.848 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.847+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=1NF1JGZYCE4T tag=FRLFJ842XGNJ type=write size=1797476 2024-01-13T18:20:46.852 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.851+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~7AB01DT5NKVL.0 size=1048576 2024-01-13T18:20:46.854 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.853+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~7AB01DT5NKVL.1 size=1048576 2024-01-13T18:20:46.856 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.855+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~7AB01DT5NKVL.2 size=482678 2024-01-13T18:20:46.856 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.855+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=7AB01DT5NKVL tag=VEYD4G2IMYDG type=write size=3628406 2024-01-13T18:20:46.858 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.857+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~5VGXCH5WX47O.0 size=42013 2024-01-13T18:20:46.862 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.861+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=5VGXCH5WX47O tag=T4YJ9QIV2EDO type=write size=1090589 2024-01-13T18:20:46.864 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.863+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=HQ5FSOTLUCA3 type=del size=3407529 2024-01-13T18:20:46.866 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.865+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=7RKYN1RRL21Z type=del 2024-01-13T18:20:46.870 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.869+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~ZH3HVEU18OZA.0 size=1048576 2024-01-13T18:20:46.871 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.871+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~ZH3HVEU18OZA.1 size=1048576 2024-01-13T18:20:46.873 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.872+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~ZH3HVEU18OZA.2 size=103582 2024-01-13T18:20:46.874 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.872+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=ZH3HVEU18OZA tag=TO455JW3W6WA type=write size=3249310 2024-01-13T18:20:46.875 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.874+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~6VGA185AUHCJ.0 size=495101 2024-01-13T18:20:46.879 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.878+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=6VGA185AUHCJ tag=1WAICOSR2USG type=write size=1543677 2024-01-13T18:20:46.881 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.880+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=4O0GRPH59Q53 type=del size=1600935 2024-01-13T18:20:46.883 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.882+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=B1A4YQT4493J type=del 2024-01-13T18:20:46.885 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.884+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=BSJBGKV1A64V type=del size=1662416 2024-01-13T18:20:46.887 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.886+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~ETKLZ9MVMTRW.0 size=1048576 2024-01-13T18:20:46.889 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.888+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~ETKLZ9MVMTRW.1 size=315510 2024-01-13T18:20:46.893 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.892+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=ETKLZ9MVMTRW tag=MISVBWNFC1UP type=write size=2412662 2024-01-13T18:20:46.895 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.894+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=BD9COHSXMZKN type=write size=2488 2024-01-13T18:20:46.898 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.897+0000 7f759fd04880 -1 < failed to complete operation key=BPUBFFWB9D3C tag=X8REWLAA699O type=write size=263491: (22) Invalid argument 2024-01-13T18:20:46.900 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.899+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=APPAMDLV7YH6 type=del size=512129 2024-01-13T18:20:46.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.903+0000 7f759fd04880 1 < suggested update operation key=7LXXSKLOM1JZ tag=DRZ38C2IKV2C type=del size=1770050 2024-01-13T18:20:46.908 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.907+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~GYZIDFL83YK3.0 size=1048576 2024-01-13T18:20:46.910 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.909+0000 7f759fd04880 1 > prepared part key=_multipart_1QEZO616DBC3.2~GYZIDFL83YK3.1 size=422615 2024-01-13T18:20:46.910 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.909+0000 7f759fd04880 1 > prepared multipart upload key=1QEZO616DBC3 upload=GYZIDFL83YK3 tag=I2AKCRHNM1JT type=write size=2519767 2024-01-13T18:20:46.912 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.911+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~NUC1TM3L5E2D.0 size=1048576 2024-01-13T18:20:46.914 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.913+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~NUC1TM3L5E2D.1 size=1048576 2024-01-13T18:20:46.916 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.915+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~NUC1TM3L5E2D.2 size=363399 2024-01-13T18:20:46.920 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.919+0000 7f759fd04880 1 < completed multipart upload key=BPUBFFWB9D3C upload=NUC1TM3L5E2D tag=NZ6LWWO7OBBH type=write size=3509127 2024-01-13T18:20:46.922 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.921+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=MIQF576PUT1I type=del size=4084196 2024-01-13T18:20:46.924 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.923+0000 7f759fd04880 1 < completed write operation key=8EWIOXN5H9KU tag=XT9ZMH0RPEW5 type=write size=64487 2024-01-13T18:20:46.928 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.927+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~79SN6VN40DHC.0 size=1048576 2024-01-13T18:20:46.929 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.928+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~79SN6VN40DHC.1 size=787626 2024-01-13T18:20:46.929 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.928+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=79SN6VN40DHC tag=H19AUU98J8VS type=write size=2884778 2024-01-13T18:20:46.933 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.931+0000 7f759fd04880 -1 < failed to complete operation key=BPUBFFWB9D3C tag=J1Q2UDW9N3FO type=write size=907901: (22) Invalid argument 2024-01-13T18:20:46.936 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.935+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~01DSFUOL45UK.0 size=1048576 2024-01-13T18:20:46.938 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.937+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~01DSFUOL45UK.1 size=1048576 2024-01-13T18:20:46.940 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.939+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~01DSFUOL45UK.2 size=780766 2024-01-13T18:20:46.940 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.939+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=01DSFUOL45UK tag=NSNVW2HUXQOS type=write size=3926494 2024-01-13T18:20:46.944 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.943+0000 7f759fd04880 1 < suggested update operation key=3K20F802EFEQ tag=YG38URQMP750 type=del size=311117 2024-01-13T18:20:46.948 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.947+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~RTI01QWIY1LJ.0 size=1048576 2024-01-13T18:20:46.950 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.949+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~RTI01QWIY1LJ.1 size=1048576 2024-01-13T18:20:46.951 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.950+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~RTI01QWIY1LJ.2 size=701180 2024-01-13T18:20:46.951 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.950+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=RTI01QWIY1LJ tag=KK2ZN28H5U15 type=write size=3846908 2024-01-13T18:20:46.953 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.952+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~025UJXEECPDP.0 size=1048576 2024-01-13T18:20:46.955 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.954+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~025UJXEECPDP.1 size=292805 2024-01-13T18:20:46.959 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.958+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=025UJXEECPDP tag=IDRSVD2RDB9E type=write size=2389957 2024-01-13T18:20:46.963 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.962+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~Q4DCQUFZMB5V.0 size=1048576 2024-01-13T18:20:46.965 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.964+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~Q4DCQUFZMB5V.1 size=366448 2024-01-13T18:20:46.965 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.964+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=Q4DCQUFZMB5V tag=4PPH20L91B6B type=write size=2463600 2024-01-13T18:20:46.967 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.966+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~Y85QVKXA84JF.0 size=1048576 2024-01-13T18:20:46.967 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.966+0000 7f759fd04880 1 < canceled part key=_multipart_RY0W5S41XK3F.2~Y85QVKXA84JF.1 size=576267 2024-01-13T18:20:46.970 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.969+0000 7f759fd04880 1 < canceled multipart upload key=RY0W5S41XK3F upload=Y85QVKXA84JF tag=MI4D1ACNEYKQ type=write size=2673419 2024-01-13T18:20:46.973 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.972+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=Z1KEQ8DAKYK5 type=del size=1752603 2024-01-13T18:20:46.975 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.974+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~W0XSP463PTGN.0 size=1048576 2024-01-13T18:20:46.977 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.976+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~W0XSP463PTGN.1 size=1007045 2024-01-13T18:20:46.980 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.979+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=W0XSP463PTGN tag=1RUZ8I7IJXDC type=write size=3104197 2024-01-13T18:20:46.983 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.982+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=5YTJRH5E741W type=del size=80486 2024-01-13T18:20:46.985 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.984+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=5LJQHR3ML5WG type=del 2024-01-13T18:20:46.987 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.986+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=T5KTK4D5YY6H type=write size=294708 2024-01-13T18:20:46.989 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.988+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~7AB01DT5NKVL.0 size=1048576 2024-01-13T18:20:46.991 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.990+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~7AB01DT5NKVL.1 size=1048576 2024-01-13T18:20:46.993 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.992+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~7AB01DT5NKVL.2 size=482678 2024-01-13T18:20:46.998 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.997+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=7AB01DT5NKVL tag=VEYD4G2IMYDG type=write size=3628406 2024-01-13T18:20:47.000 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:46.999+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=MMI6D6M363XV type=write size=512701 2024-01-13T18:20:47.002 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.001+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=HQ5FSOTLUCA3 type=del 2024-01-13T18:20:47.004 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.003+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=ZIB807GAQHGO type=del size=1399713 2024-01-13T18:20:47.006 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.005+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~ZH3HVEU18OZA.0 size=1048576 2024-01-13T18:20:47.008 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.007+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~ZH3HVEU18OZA.1 size=1048576 2024-01-13T18:20:47.009 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.008+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~ZH3HVEU18OZA.2 size=103582 2024-01-13T18:20:47.013 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.012+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=ZH3HVEU18OZA tag=TO455JW3W6WA type=write size=3249310 2024-01-13T18:20:47.015 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.014+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=VCXK54TIE6BH type=del size=769537 2024-01-13T18:20:47.017 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.016+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=4O0GRPH59Q53 type=del 2024-01-13T18:20:47.021 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.020+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~PPL2IDW0795U.0 size=1048576 2024-01-13T18:20:47.023 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.022+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~PPL2IDW0795U.1 size=1048576 2024-01-13T18:20:47.025 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.024+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~PPL2IDW0795U.2 size=723770 2024-01-13T18:20:47.025 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.024+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=PPL2IDW0795U tag=B52VIE48HTFN type=write size=3869498 2024-01-13T18:20:47.028 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.028+0000 7f759fd04880 1 < suggested update operation key=OMA1B74S8FXS tag=BSJBGKV1A64V type=del size=1662416 2024-01-13T18:20:47.032 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.031+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~0KDWAVREL74Z.0 size=168808 2024-01-13T18:20:47.032 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.031+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=0KDWAVREL74Z tag=YLDPS6WRMHEZ type=write size=1217384 2024-01-13T18:20:47.034 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.033+0000 7f759fd04880 1 < completed write operation key=H4VHC37BOZJ3 tag=BD9COHSXMZKN type=write size=2488 2024-01-13T18:20:47.038 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.037+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~20KAKA9IIL1V.0 size=1048576 2024-01-13T18:20:47.040 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.039+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~20KAKA9IIL1V.1 size=1048576 2024-01-13T18:20:47.042 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.041+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~20KAKA9IIL1V.2 size=626257 2024-01-13T18:20:47.042 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.041+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=20KAKA9IIL1V tag=PW0ZTKJZR15P type=write size=3771985 2024-01-13T18:20:47.045 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.044+0000 7f759fd04880 1 < suggested remove operation key=0TIZPXX8CMHA tag=APPAMDLV7YH6 type=del 2024-01-13T18:20:47.048 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.047+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=9J2IZ601JPOJ type=del size=569746 2024-01-13T18:20:47.050 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.049+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~GYZIDFL83YK3.0 size=1048576 2024-01-13T18:20:47.052 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.051+0000 7f759fd04880 1 < completed part key=_multipart_1QEZO616DBC3.2~GYZIDFL83YK3.1 size=422615 2024-01-13T18:20:47.056 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.055+0000 7f759fd04880 1 < completed multipart upload key=1QEZO616DBC3 upload=GYZIDFL83YK3 tag=I2AKCRHNM1JT type=write size=2519767 2024-01-13T18:20:47.058 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.057+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=JQGIJVQPG1ZG type=del size=1632634 2024-01-13T18:20:47.060 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.059+0000 7f759fd04880 -1 < failed to complete operation key=0TIZPXX8CMHA tag=MIQF576PUT1I type=del size=4084196: (22) Invalid argument 2024-01-13T18:20:47.063 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.062+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=FVGSW123A6PR type=del size=2626705 2024-01-13T18:20:47.065 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.064+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~79SN6VN40DHC.0 size=1048576 2024-01-13T18:20:47.065 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.064+0000 7f759fd04880 1 < canceled part key=_multipart_JN46AMLYHN8E.2~79SN6VN40DHC.1 size=787626 2024-01-13T18:20:47.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.068+0000 7f759fd04880 1 < canceled multipart upload key=JN46AMLYHN8E upload=79SN6VN40DHC tag=H19AUU98J8VS type=write size=2884778 2024-01-13T18:20:47.073 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.072+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~XEKAZKD24VUX.0 size=1048576 2024-01-13T18:20:47.074 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.073+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~XEKAZKD24VUX.1 size=1048576 2024-01-13T18:20:47.076 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.075+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~XEKAZKD24VUX.2 size=492454 2024-01-13T18:20:47.076 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.075+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=XEKAZKD24VUX tag=BLBVW2KR1FEN type=write size=3638182 2024-01-13T18:20:47.076 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.075+0000 7f759fd04880 1 < canceled part key=_multipart_8EWIOXN5H9KU.2~01DSFUOL45UK.0 size=1048576 2024-01-13T18:20:47.078 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.077+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~01DSFUOL45UK.1 size=1048576 2024-01-13T18:20:47.080 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.079+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~01DSFUOL45UK.2 size=780766 2024-01-13T18:20:47.084 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.083+0000 7f759fd04880 1 < canceled multipart upload key=8EWIOXN5H9KU upload=01DSFUOL45UK tag=NSNVW2HUXQOS type=write size=3926494 2024-01-13T18:20:47.086 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.085+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=Z79IKNVBIHQ2 type=del size=2537330 2024-01-13T18:20:47.088 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.087+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~RTI01QWIY1LJ.0 size=1048576 2024-01-13T18:20:47.090 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.089+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~RTI01QWIY1LJ.1 size=1048576 2024-01-13T18:20:47.091 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.091+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~RTI01QWIY1LJ.2 size=701180 2024-01-13T18:20:47.095 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.094+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=RTI01QWIY1LJ tag=KK2ZN28H5U15 type=write size=3846908 2024-01-13T18:20:47.097 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.096+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=DOL056O4XD93 type=del size=443568 2024-01-13T18:20:47.099 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.098+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~Q4DCQUFZMB5V.0 size=1048576 2024-01-13T18:20:47.101 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.100+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~Q4DCQUFZMB5V.1 size=366448 2024-01-13T18:20:47.105 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.104+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=Q4DCQUFZMB5V tag=4PPH20L91B6B type=write size=2463600 2024-01-13T18:20:47.109 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.108+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~9XKVO9K8CCI5.0 size=1048576 2024-01-13T18:20:47.111 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.110+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~9XKVO9K8CCI5.1 size=334882 2024-01-13T18:20:47.111 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.110+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=9XKVO9K8CCI5 tag=QY9TFCLTU0E5 type=write size=2432034 2024-01-13T18:20:47.113 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.112+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=Z1KEQ8DAKYK5 type=del 2024-01-13T18:20:47.115 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.114+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=VAKAJNFD20OW type=write size=207636 2024-01-13T18:20:47.117 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.116+0000 7f759fd04880 1 < completed delete operation key=QKNPXHB99KVP tag=5YTJRH5E741W type=del 2024-01-13T18:20:47.119 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.118+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=EQ0LV02ILK1Z type=del size=3456778 2024-01-13T18:20:47.122 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.121+0000 7f759fd04880 -1 < failed to complete operation key=OMA1B74S8FXS tag=T5KTK4D5YY6H type=write size=294708: (22) Invalid argument 2024-01-13T18:20:47.126 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.125+0000 7f759fd04880 1 > prepared part key=_multipart_7WRTM9ANJRT4.2~0LJSUVLRK15K.0 size=408757 2024-01-13T18:20:47.126 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.125+0000 7f759fd04880 1 > prepared multipart upload key=7WRTM9ANJRT4 upload=0LJSUVLRK15K tag=O1RDKSTYW28I type=write size=1457333 2024-01-13T18:20:47.131 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.130+0000 7f759fd04880 1 < suggested remove operation key=7LXXSKLOM1JZ tag=MMI6D6M363XV type=write 2024-01-13T18:20:47.133 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.132+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=51DCQYCEUWMS type=del size=1231324 2024-01-13T18:20:47.135 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.134+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=ZIB807GAQHGO type=del 2024-01-13T18:20:47.137 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.136+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=5QG8UX4QN7N9 type=del size=242429 2024-01-13T18:20:47.139 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.138+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=VCXK54TIE6BH type=del 2024-01-13T18:20:47.141 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.140+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=B1ZDFMORPQTB type=del size=125612 2024-01-13T18:20:47.143 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.142+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~PPL2IDW0795U.0 size=1048576 2024-01-13T18:20:47.145 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.143+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~PPL2IDW0795U.1 size=1048576 2024-01-13T18:20:47.146 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.145+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~PPL2IDW0795U.2 size=723770 2024-01-13T18:20:47.150 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.149+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=PPL2IDW0795U tag=B52VIE48HTFN type=write size=3869498 2024-01-13T18:20:47.152 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.151+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=IGE04X15D28T type=del size=743353 2024-01-13T18:20:47.155 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.154+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~0KDWAVREL74Z.0 size=168808 2024-01-13T18:20:47.158 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.157+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=0KDWAVREL74Z tag=YLDPS6WRMHEZ type=write size=1217384 2024-01-13T18:20:47.160 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.159+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=9A82ZB4RE4FX type=del size=2423691 2024-01-13T18:20:47.161 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.160+0000 7f759fd04880 1 < canceled part key=_multipart_8EWIOXN5H9KU.2~20KAKA9IIL1V.0 size=1048576 2024-01-13T18:20:47.162 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.161+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~20KAKA9IIL1V.1 size=1048576 2024-01-13T18:20:47.165 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.163+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~20KAKA9IIL1V.2 size=626257 2024-01-13T18:20:47.168 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.167+0000 7f759fd04880 1 < canceled multipart upload key=8EWIOXN5H9KU upload=20KAKA9IIL1V tag=PW0ZTKJZR15P type=write size=3771985 2024-01-13T18:20:47.172 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.171+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~56VPD5I8ESBC.0 size=914293 2024-01-13T18:20:47.172 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.171+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=56VPD5I8ESBC tag=9565DJSAM0NZ type=write size=1962869 2024-01-13T18:20:47.174 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.173+0000 7f759fd04880 1 < canceled operation key=P8FMRQR7GXN7 tag=9J2IZ601JPOJ type=del size=569746 2024-01-13T18:20:47.176 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.175+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=7OD16GW1EDT3 type=del size=2351933 2024-01-13T18:20:47.178 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.177+0000 7f759fd04880 1 < canceled operation key=H972TC5DOMHL tag=JQGIJVQPG1ZG type=del size=1632634 2024-01-13T18:20:47.181 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.181+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~EUSNHX583CWJ.0 size=1037450 2024-01-13T18:20:47.182 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.181+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=EUSNHX583CWJ tag=3HTI3BBR6GFZ type=write size=2086026 2024-01-13T18:20:47.183 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.182+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=FVGSW123A6PR type=del 2024-01-13T18:20:47.185 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.184+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=VO4CK1WQC8OX type=del size=308304 2024-01-13T18:20:47.188 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.187+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~XEKAZKD24VUX.0 size=1048576 2024-01-13T18:20:47.190 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.189+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~XEKAZKD24VUX.1 size=1048576 2024-01-13T18:20:47.191 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.190+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~XEKAZKD24VUX.2 size=492454 2024-01-13T18:20:47.195 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.194+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=XEKAZKD24VUX tag=BLBVW2KR1FEN type=write size=3638182 2024-01-13T18:20:47.199 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.198+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~N568MROHUTAG.0 size=1048576 2024-01-13T18:20:47.200 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.199+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~N568MROHUTAG.1 size=1048576 2024-01-13T18:20:47.202 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.201+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~N568MROHUTAG.2 size=948431 2024-01-13T18:20:47.202 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.201+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=N568MROHUTAG tag=WE04Z3260EJD type=write size=4094159 2024-01-13T18:20:47.205 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.204+0000 7f759fd04880 -1 < failed to complete operation key=7LXXSKLOM1JZ tag=Z79IKNVBIHQ2 type=del size=2537330: (22) Invalid argument 2024-01-13T18:20:47.209 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.208+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~RAHUGVSOV3BR.0 size=1048576 2024-01-13T18:20:47.211 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.210+0000 7f759fd04880 1 > prepared part key=_multipart_3K20F802EFEQ.2~RAHUGVSOV3BR.1 size=231671 2024-01-13T18:20:47.211 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.210+0000 7f759fd04880 1 > prepared multipart upload key=3K20F802EFEQ upload=RAHUGVSOV3BR tag=J7YYR8XJOK23 type=write size=2328823 2024-01-13T18:20:47.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.212+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=DOL056O4XD93 type=del 2024-01-13T18:20:47.216 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.215+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~UDPCX7BAAH13.0 size=16441 2024-01-13T18:20:47.216 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.215+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=UDPCX7BAAH13 tag=OP0035NSOMG9 type=write size=1065017 2024-01-13T18:20:47.218 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.218+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~9XKVO9K8CCI5.0 size=1048576 2024-01-13T18:20:47.220 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.219+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~9XKVO9K8CCI5.1 size=334882 2024-01-13T18:20:47.224 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.223+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=9XKVO9K8CCI5 tag=QY9TFCLTU0E5 type=write size=2432034 2024-01-13T18:20:47.226 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.225+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=BS9HPVX1M4M5 type=del size=2815019 2024-01-13T18:20:47.228 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.227+0000 7f759fd04880 1 < canceled operation key=H972TC5DOMHL tag=VAKAJNFD20OW type=write size=207636 2024-01-13T18:20:47.232 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.231+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~896GP3NA8ZFJ.0 size=837313 2024-01-13T18:20:47.232 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.231+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=896GP3NA8ZFJ tag=DY34GEN1O9KL type=write size=1885889 2024-01-13T18:20:47.236 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.235+0000 7f759fd04880 1 < suggested update operation key=OMA1B74S8FXS tag=EQ0LV02ILK1Z type=del size=3456778 2024-01-13T18:20:47.239 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.238+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=UU73E32M71CG type=write size=400728 2024-01-13T18:20:47.241 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.240+0000 7f759fd04880 1 < completed part key=_multipart_7WRTM9ANJRT4.2~0LJSUVLRK15K.0 size=408757 2024-01-13T18:20:47.245 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.244+0000 7f759fd04880 1 < completed multipart upload key=7WRTM9ANJRT4 upload=0LJSUVLRK15K tag=O1RDKSTYW28I type=write size=1457333 2024-01-13T18:20:47.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.248+0000 7f759fd04880 1 > prepared part key=_multipart_H972TC5DOMHL.2~BKTU9LGRY63S.0 size=503757 2024-01-13T18:20:47.249 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.248+0000 7f759fd04880 1 > prepared multipart upload key=H972TC5DOMHL upload=BKTU9LGRY63S tag=IDQUU342H4QB type=write size=1552333 2024-01-13T18:20:47.254 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.253+0000 7f759fd04880 1 < suggested remove operation key=JN46AMLYHN8E tag=51DCQYCEUWMS type=del 2024-01-13T18:20:47.255 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.254+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=8QQ8VYGTM3K1 type=del size=3539268 2024-01-13T18:20:47.257 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.256+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=5QG8UX4QN7N9 type=del 2024-01-13T18:20:47.261 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.260+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~OHXGEAYG28Q8.0 size=1048576 2024-01-13T18:20:47.263 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.262+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~OHXGEAYG28Q8.1 size=31573 2024-01-13T18:20:47.263 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.262+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=OHXGEAYG28Q8 tag=XEKUOY6PG33O type=write size=2128725 2024-01-13T18:20:47.265 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.264+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=B1ZDFMORPQTB type=del 2024-01-13T18:20:47.269 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.267+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~12WRM1SO1OX1.0 size=1048576 2024-01-13T18:20:47.270 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.269+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~12WRM1SO1OX1.1 size=151864 2024-01-13T18:20:47.270 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.269+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=12WRM1SO1OX1 tag=BN7X57QD3WVW type=write size=2249016 2024-01-13T18:20:47.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.271+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=IGE04X15D28T type=del 2024-01-13T18:20:47.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.273+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=UY2Z8703S5XN type=del size=557603 2024-01-13T18:20:47.276 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.275+0000 7f759fd04880 1 < canceled operation key=QD5GBLNCY707 tag=9A82ZB4RE4FX type=del size=2423691 2024-01-13T18:20:47.278 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.277+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=V86XZPZGZG6U type=del size=1616957 2024-01-13T18:20:47.281 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.280+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~56VPD5I8ESBC.0 size=914293 2024-01-13T18:20:47.284 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.283+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=56VPD5I8ESBC tag=9565DJSAM0NZ type=write size=1962869 2024-01-13T18:20:47.288 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.287+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~ZITOI1TEA5KI.0 size=1048576 2024-01-13T18:20:47.290 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.288+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~ZITOI1TEA5KI.1 size=291499 2024-01-13T18:20:47.290 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.288+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=ZITOI1TEA5KI tag=O41CLLAD4FEE type=write size=2388651 2024-01-13T18:20:47.292 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.291+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=7OD16GW1EDT3 type=del 2024-01-13T18:20:47.294 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.293+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=E5SQN4M734Z5 type=del size=2894534 2024-01-13T18:20:47.294 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.293+0000 7f759fd04880 1 < canceled part key=_multipart_OMA1B74S8FXS.2~EUSNHX583CWJ.0 size=1037450 2024-01-13T18:20:47.298 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.297+0000 7f759fd04880 1 < canceled multipart upload key=OMA1B74S8FXS upload=EUSNHX583CWJ tag=3HTI3BBR6GFZ type=write size=2086026 2024-01-13T18:20:47.300 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.299+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=GQXE66PV5E43 type=del size=1742600 2024-01-13T18:20:47.304 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.303+0000 7f759fd04880 1 < suggested update operation key=H4VHC37BOZJ3 tag=VO4CK1WQC8OX type=del size=308304 2024-01-13T18:20:47.307 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.306+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=QFI2C86IV8FU type=del size=2868702 2024-01-13T18:20:47.309 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.308+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~N568MROHUTAG.0 size=1048576 2024-01-13T18:20:47.311 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.310+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~N568MROHUTAG.1 size=1048576 2024-01-13T18:20:47.312 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.311+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~N568MROHUTAG.2 size=948431 2024-01-13T18:20:47.316 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.315+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=N568MROHUTAG tag=WE04Z3260EJD type=write size=4094159 2024-01-13T18:20:47.318 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.317+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=74WXBUI40FYC type=write size=158569 2024-01-13T18:20:47.320 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.319+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~RAHUGVSOV3BR.0 size=1048576 2024-01-13T18:20:47.322 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.321+0000 7f759fd04880 1 < completed part key=_multipart_3K20F802EFEQ.2~RAHUGVSOV3BR.1 size=231671 2024-01-13T18:20:47.326 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.325+0000 7f759fd04880 1 < completed multipart upload key=3K20F802EFEQ upload=RAHUGVSOV3BR tag=J7YYR8XJOK23 type=write size=2328823 2024-01-13T18:20:47.328 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.327+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=RJRVH18P1UEY type=del size=3568353 2024-01-13T18:20:47.331 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.329+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~UDPCX7BAAH13.0 size=16441 2024-01-13T18:20:47.334 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.333+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=UDPCX7BAAH13 tag=OP0035NSOMG9 type=write size=1065017 2024-01-13T18:20:47.336 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.335+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=8X4FNN2W0FT5 type=del size=3703380 2024-01-13T18:20:47.339 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.338+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=BS9HPVX1M4M5 type=del 2024-01-13T18:20:47.344 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.343+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~K6WSO6GUJ4DA.0 size=416231 2024-01-13T18:20:47.344 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.343+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=K6WSO6GUJ4DA tag=R9P0RUNIQEXL type=write size=1464807 2024-01-13T18:20:47.346 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.345+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~896GP3NA8ZFJ.0 size=837313 2024-01-13T18:20:47.350 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.349+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=896GP3NA8ZFJ tag=DY34GEN1O9KL type=write size=1885889 2024-01-13T18:20:47.352 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.351+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=68D9BAMP13U7 type=del size=1026469 2024-01-13T18:20:47.357 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.356+0000 7f759fd04880 1 < suggested update operation key=H7C1UAGAUR7D tag=UU73E32M71CG type=write size=400728 2024-01-13T18:20:47.359 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.358+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=T3E72IH0HXEQ type=del size=1471620 2024-01-13T18:20:47.361 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.360+0000 7f759fd04880 1 < completed part key=_multipart_H972TC5DOMHL.2~BKTU9LGRY63S.0 size=503757 2024-01-13T18:20:47.364 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.363+0000 7f759fd04880 1 < completed multipart upload key=H972TC5DOMHL upload=BKTU9LGRY63S tag=IDQUU342H4QB type=write size=1552333 2024-01-13T18:20:47.367 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.366+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=SHW92M6AJOAL type=del size=4057915 2024-01-13T18:20:47.369 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.368+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=8QQ8VYGTM3K1 type=del 2024-01-13T18:20:47.371 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.370+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=2RPY9503F8CG type=del size=3490379 2024-01-13T18:20:47.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.371+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~OHXGEAYG28Q8.0 size=1048576 2024-01-13T18:20:47.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.374+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~OHXGEAYG28Q8.1 size=31573 2024-01-13T18:20:47.378 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.377+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=OHXGEAYG28Q8 tag=XEKUOY6PG33O type=write size=2128725 2024-01-13T18:20:47.382 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.381+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~36OQSC8NH1RX.0 size=363385 2024-01-13T18:20:47.382 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.381+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=36OQSC8NH1RX tag=Q1A681ES7BNV type=write size=1411961 2024-01-13T18:20:47.384 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.383+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~12WRM1SO1OX1.0 size=1048576 2024-01-13T18:20:47.386 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.385+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~12WRM1SO1OX1.1 size=151864 2024-01-13T18:20:47.390 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.389+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=12WRM1SO1OX1 tag=BN7X57QD3WVW type=write size=2249016 2024-01-13T18:20:47.392 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.391+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=9U0OILEZ1XLN type=del size=171824 2024-01-13T18:20:47.397 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.396+0000 7f759fd04880 1 < suggested update operation key=RY0W5S41XK3F tag=UY2Z8703S5XN type=del size=557603 2024-01-13T18:20:47.402 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.401+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~5EYFHI4R0QCN.0 size=1048576 2024-01-13T18:20:47.404 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.403+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~5EYFHI4R0QCN.1 size=1048576 2024-01-13T18:20:47.406 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.405+0000 7f759fd04880 1 > prepared part key=_multipart_ZI9WAZQHVPAR.2~5EYFHI4R0QCN.2 size=1005164 2024-01-13T18:20:47.406 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.405+0000 7f759fd04880 1 > prepared multipart upload key=ZI9WAZQHVPAR upload=5EYFHI4R0QCN tag=AX1VT6R4PJ7Q type=write size=4150892 2024-01-13T18:20:47.408 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.407+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=V86XZPZGZG6U type=del 2024-01-13T18:20:47.411 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.410+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~UX1659OACXSW.0 size=1048576 2024-01-13T18:20:47.413 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.412+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~UX1659OACXSW.1 size=1048576 2024-01-13T18:20:47.415 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.414+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~UX1659OACXSW.2 size=270863 2024-01-13T18:20:47.415 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.414+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=UX1659OACXSW tag=2ZD7HUVX4VG1 type=write size=3416591 2024-01-13T18:20:47.417 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.416+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~ZITOI1TEA5KI.0 size=1048576 2024-01-13T18:20:47.419 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.418+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~ZITOI1TEA5KI.1 size=291499 2024-01-13T18:20:47.423 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.422+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=ZITOI1TEA5KI tag=O41CLLAD4FEE type=write size=2388651 2024-01-13T18:20:47.427 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.426+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~YC3QP24HC8W1.0 size=843186 2024-01-13T18:20:47.427 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.426+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=YC3QP24HC8W1 tag=471BHE62X1T5 type=write size=1891762 2024-01-13T18:20:47.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.428+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=E5SQN4M734Z5 type=del 2024-01-13T18:20:47.431 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.430+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=AB2HTF8RK8VI type=del size=2838674 2024-01-13T18:20:47.434 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.433+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=GQXE66PV5E43 type=del 2024-01-13T18:20:47.438 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.437+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~OMK7Z44VNFBQ.0 size=1048576 2024-01-13T18:20:47.440 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.439+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~OMK7Z44VNFBQ.1 size=853404 2024-01-13T18:20:47.440 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.439+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=OMK7Z44VNFBQ tag=MZ306OPJD13Q type=write size=2950556 2024-01-13T18:20:47.443 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.441+0000 7f759fd04880 1 < canceled operation key=QD5GBLNCY707 tag=QFI2C86IV8FU type=del size=2868702 2024-01-13T18:20:47.444 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.444+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=JLYOWPFRXXUR type=del size=1982423 2024-01-13T18:20:47.449 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.448+0000 7f759fd04880 1 < suggested remove operation key=1YNH6QHP354U tag=74WXBUI40FYC type=write 2024-01-13T18:20:47.451 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.450+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=BAQ64O3UP8DD type=del size=4178793 2024-01-13T18:20:47.455 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.454+0000 7f759fd04880 1 < suggested update operation key=8EWIOXN5H9KU tag=RJRVH18P1UEY type=del size=3568353 2024-01-13T18:20:47.457 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.456+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=BL5KDS0M82L2 type=del size=1298218 2024-01-13T18:20:47.459 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.459+0000 7f759fd04880 1 < completed delete operation key=H972TC5DOMHL tag=8X4FNN2W0FT5 type=del 2024-01-13T18:20:47.464 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.463+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~F3JGWPURU40L.0 size=1048576 2024-01-13T18:20:47.471 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.470+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~F3JGWPURU40L.1 size=174318 2024-01-13T18:20:47.471 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.470+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=F3JGWPURU40L tag=62PBW3H24NPB type=write size=2271470 2024-01-13T18:20:47.473 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.472+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~K6WSO6GUJ4DA.0 size=416231 2024-01-13T18:20:47.477 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.476+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=K6WSO6GUJ4DA tag=R9P0RUNIQEXL type=write size=1464807 2024-01-13T18:20:47.481 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.480+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~K6FTVL6GYCXA.0 size=1048576 2024-01-13T18:20:47.483 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.482+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~K6FTVL6GYCXA.1 size=1048576 2024-01-13T18:20:47.485 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.484+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~K6FTVL6GYCXA.2 size=274555 2024-01-13T18:20:47.485 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.484+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=K6FTVL6GYCXA tag=EMDC8J6KR2N3 type=write size=3420283 2024-01-13T18:20:47.487 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.486+0000 7f759fd04880 1 < completed delete operation key=EW3ZFDVIQZ7G tag=68D9BAMP13U7 type=del 2024-01-13T18:20:47.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.488+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=GEE8IPABJ3BW type=write size=852567 2024-01-13T18:20:47.492 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.491+0000 7f759fd04880 -1 < failed to complete operation key=RY0W5S41XK3F tag=T3E72IH0HXEQ type=del size=1471620: (22) Invalid argument 2024-01-13T18:20:47.494 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.493+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=QMWJM64ZCLDW type=del size=212965 2024-01-13T18:20:47.496 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.495+0000 7f759fd04880 1 < completed delete operation key=2OO7S2NBZ7M6 tag=SHW92M6AJOAL type=del 2024-01-13T18:20:47.498 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.497+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=LQ1Q82539JZB type=del size=933297 2024-01-13T18:20:47.500 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.499+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=2RPY9503F8CG type=del 2024-01-13T18:20:47.502 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.501+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=I98ABHG6KLGX type=del size=3806774 2024-01-13T18:20:47.504 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.503+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~36OQSC8NH1RX.0 size=363385 2024-01-13T18:20:47.508 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.507+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=36OQSC8NH1RX tag=Q1A681ES7BNV type=write size=1411961 2024-01-13T18:20:47.512 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.511+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~NTB453PANI5V.0 size=1048576 2024-01-13T18:20:47.514 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.513+0000 7f759fd04880 1 > prepared part key=_multipart_1WSQNY2NDY3K.2~NTB453PANI5V.1 size=9560 2024-01-13T18:20:47.514 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.513+0000 7f759fd04880 1 > prepared multipart upload key=1WSQNY2NDY3K upload=NTB453PANI5V tag=S2XZVHKU3XAF type=write size=2106712 2024-01-13T18:20:47.517 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.516+0000 7f759fd04880 -1 < failed to complete operation key=8EWIOXN5H9KU tag=9U0OILEZ1XLN type=del size=171824: (22) Invalid argument 2024-01-13T18:20:47.519 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.518+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=3F4G8T04HPBV type=del size=1418527 2024-01-13T18:20:47.519 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.518+0000 7f759fd04880 1 < canceled part key=_multipart_ZI9WAZQHVPAR.2~5EYFHI4R0QCN.0 size=1048576 2024-01-13T18:20:47.521 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.520+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~5EYFHI4R0QCN.1 size=1048576 2024-01-13T18:20:47.523 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.523+0000 7f759fd04880 1 < completed part key=_multipart_ZI9WAZQHVPAR.2~5EYFHI4R0QCN.2 size=1005164 2024-01-13T18:20:47.527 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.526+0000 7f759fd04880 1 < canceled multipart upload key=ZI9WAZQHVPAR upload=5EYFHI4R0QCN tag=AX1VT6R4PJ7Q type=write size=4150892 2024-01-13T18:20:47.530 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.529+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=8KA4QS9E4TDJ type=del size=833049 2024-01-13T18:20:47.532 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.531+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~UX1659OACXSW.0 size=1048576 2024-01-13T18:20:47.534 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.533+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~UX1659OACXSW.1 size=1048576 2024-01-13T18:20:47.536 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.535+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~UX1659OACXSW.2 size=270863 2024-01-13T18:20:47.540 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.539+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=UX1659OACXSW tag=2ZD7HUVX4VG1 type=write size=3416591 2024-01-13T18:20:47.544 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.543+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~IIYPW8F4ORCU.0 size=943066 2024-01-13T18:20:47.544 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.543+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=IIYPW8F4ORCU tag=61TQKHCONYAQ type=write size=1991642 2024-01-13T18:20:47.546 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.545+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~YC3QP24HC8W1.0 size=843186 2024-01-13T18:20:47.550 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.549+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=YC3QP24HC8W1 tag=471BHE62X1T5 type=write size=1891762 2024-01-13T18:20:47.552 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.551+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=FTKDET3ZYNZ7 type=del size=1448797 2024-01-13T18:20:47.557 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.555+0000 7f759fd04880 1 < suggested update operation key=QS9PLJKINY4R tag=AB2HTF8RK8VI type=del size=2838674 2024-01-13T18:20:47.560 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.559+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~S7S3E43EAVH2.0 size=993742 2024-01-13T18:20:47.560 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.559+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=S7S3E43EAVH2 tag=7PSJFJUNXVAH type=write size=2042318 2024-01-13T18:20:47.563 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.562+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~OMK7Z44VNFBQ.0 size=1048576 2024-01-13T18:20:47.564 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.563+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~OMK7Z44VNFBQ.1 size=853404 2024-01-13T18:20:47.568 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.567+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=OMK7Z44VNFBQ tag=MZ306OPJD13Q type=write size=2950556 2024-01-13T18:20:47.570 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.569+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=4F8N6UI9L8Y5 type=del size=1441764 2024-01-13T18:20:47.572 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.571+0000 7f759fd04880 1 < canceled operation key=QD5GBLNCY707 tag=JLYOWPFRXXUR type=del size=1982423 2024-01-13T18:20:47.574 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.573+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=WHTU9R4KQTLX type=write size=10981 2024-01-13T18:20:47.577 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.576+0000 7f759fd04880 -1 < failed to complete operation key=8EWIOXN5H9KU tag=BAQ64O3UP8DD type=del size=4178793: (22) Invalid argument 2024-01-13T18:20:47.579 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.578+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=BCXMKTTEW1O4 type=write size=962763 2024-01-13T18:20:47.582 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.581+0000 7f759fd04880 1 < completed delete operation key=WSRJB811XCVL tag=BL5KDS0M82L2 type=del 2024-01-13T18:20:47.584 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.583+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=02LTTZX9Y741 type=write size=324396 2024-01-13T18:20:47.586 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.585+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~F3JGWPURU40L.0 size=1048576 2024-01-13T18:20:47.587 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.586+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~F3JGWPURU40L.1 size=174318 2024-01-13T18:20:47.591 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.590+0000 7f759fd04880 1 < completed multipart upload key=VZHGQM6ZNJYQ upload=F3JGWPURU40L tag=62PBW3H24NPB type=write size=2271470 2024-01-13T18:20:47.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.592+0000 7f759fd04880 1 > prepared operation key=DOXP3EJ03EBY tag=ME3IF2USFXM9 type=del size=1558599 2024-01-13T18:20:47.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.594+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~K6FTVL6GYCXA.0 size=1048576 2024-01-13T18:20:47.597 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.596+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~K6FTVL6GYCXA.1 size=1048576 2024-01-13T18:20:47.599 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.598+0000 7f759fd04880 1 < completed part key=_multipart_DOXP3EJ03EBY.2~K6FTVL6GYCXA.2 size=274555 2024-01-13T18:20:47.602 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.601+0000 7f759fd04880 1 < completed multipart upload key=DOXP3EJ03EBY upload=K6FTVL6GYCXA tag=EMDC8J6KR2N3 type=write size=3420283 2024-01-13T18:20:47.604 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.603+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=0LAB2N2SK0TX type=del size=1451202 2024-01-13T18:20:47.606 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.605+0000 7f759fd04880 1 < completed write operation key=1YNH6QHP354U tag=GEE8IPABJ3BW type=write size=852567 2024-01-13T18:20:47.610 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.609+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~J36I0HSHZQJR.0 size=1048576 2024-01-13T18:20:47.611 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.610+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~J36I0HSHZQJR.1 size=847084 2024-01-13T18:20:47.611 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.610+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=J36I0HSHZQJR tag=R79I1W9DV4LN type=write size=2944236 2024-01-13T18:20:47.614 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.613+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=QMWJM64ZCLDW type=del 2024-01-13T18:20:47.616 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.615+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=OKLE6ZN1WF02 type=del size=2961970 2024-01-13T18:20:47.618 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.617+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=LQ1Q82539JZB type=del 2024-01-13T18:20:47.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:47 smithi099 ceph-mon[138788]: pgmap v1462: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 396 KiB/s wr, 2.02k op/s 2024-01-13T18:20:47.620 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.619+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=TOHPF8WBEDU0 type=del size=3436316 2024-01-13T18:20:47.622 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.621+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=I98ABHG6KLGX type=del 2024-01-13T18:20:47.624 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.623+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=IIW8EZG3YQV6 type=write size=548887 2024-01-13T18:20:47.626 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.625+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~NTB453PANI5V.0 size=1048576 2024-01-13T18:20:47.627 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.626+0000 7f759fd04880 1 < completed part key=_multipart_1WSQNY2NDY3K.2~NTB453PANI5V.1 size=9560 2024-01-13T18:20:47.631 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.630+0000 7f759fd04880 1 < completed multipart upload key=1WSQNY2NDY3K upload=NTB453PANI5V tag=S2XZVHKU3XAF type=write size=2106712 2024-01-13T18:20:47.635 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.634+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~39EY4VEEOIE3.0 size=1048576 2024-01-13T18:20:47.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.636+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~39EY4VEEOIE3.1 size=915644 2024-01-13T18:20:47.637 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.636+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=39EY4VEEOIE3 tag=T2M2LEJWH810 type=write size=3012796 2024-01-13T18:20:47.638 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.638+0000 7f759fd04880 1 < completed delete operation key=JGALONWJXLQY tag=3F4G8T04HPBV type=del 2024-01-13T18:20:47.643 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.641+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~ZSCPXCU4CA7M.0 size=1048576 2024-01-13T18:20:47.644 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.643+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~ZSCPXCU4CA7M.1 size=1048576 2024-01-13T18:20:47.646 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.645+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~ZSCPXCU4CA7M.2 size=384862 2024-01-13T18:20:47.646 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.645+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=ZSCPXCU4CA7M tag=SNFU5SZW4NXG type=write size=3530590 2024-01-13T18:20:47.648 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.647+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=8KA4QS9E4TDJ type=del 2024-01-13T18:20:47.650 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.649+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=N6EFRSIZOVW8 type=del size=2184461 2024-01-13T18:20:47.652 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.651+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~IIYPW8F4ORCU.0 size=943066 2024-01-13T18:20:47.656 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.655+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=IIYPW8F4ORCU tag=61TQKHCONYAQ type=write size=1991642 2024-01-13T18:20:47.658 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.657+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=HV11L3YNU5ZA type=write size=485282 2024-01-13T18:20:47.660 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.659+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=FTKDET3ZYNZ7 type=del 2024-01-13T18:20:47.663 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.663+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~YNEBVAEHMCEJ.0 size=1048576 2024-01-13T18:20:47.665 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.664+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~YNEBVAEHMCEJ.1 size=891272 2024-01-13T18:20:47.665 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.664+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=YNEBVAEHMCEJ tag=F92Y50DR4A9A type=write size=2988424 2024-01-13T18:20:47.668 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.667+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~S7S3E43EAVH2.0 size=993742 2024-01-13T18:20:47.671 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.670+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=S7S3E43EAVH2 tag=7PSJFJUNXVAH type=write size=2042318 2024-01-13T18:20:47.675 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.674+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~SDEQQIN40C2V.0 size=909603 2024-01-13T18:20:47.675 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.674+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=SDEQQIN40C2V tag=OIOLE4H4IH2C type=write size=1958179 2024-01-13T18:20:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:47 smithi084 ceph-mon[116404]: pgmap v1462: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 396 KiB/s wr, 2.02k op/s 2024-01-13T18:20:47.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:47 smithi084 ceph-mon[119097]: pgmap v1462: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 396 KiB/s wr, 2.02k op/s 2024-01-13T18:20:47.679 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.679+0000 7f759fd04880 1 < suggested remove operation key=BPUBFFWB9D3C tag=4F8N6UI9L8Y5 type=del 2024-01-13T18:20:47.683 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.682+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~2I91XTC15O2Y.0 size=501181 2024-01-13T18:20:47.683 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.682+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=2I91XTC15O2Y tag=UMTOISXUKQRO type=write size=1549757 2024-01-13T18:20:47.685 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.684+0000 7f759fd04880 1 < completed write operation key=VZHGQM6ZNJYQ tag=WHTU9R4KQTLX type=write size=10981 2024-01-13T18:20:47.690 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.688+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~ICTJF930GYJV.0 size=1048576 2024-01-13T18:20:47.691 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.690+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~ICTJF930GYJV.1 size=1048576 2024-01-13T18:20:47.693 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.692+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~ICTJF930GYJV.2 size=184232 2024-01-13T18:20:47.693 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.692+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=ICTJF930GYJV tag=UAZI92B77C7J type=write size=3329960 2024-01-13T18:20:47.695 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.694+0000 7f759fd04880 1 < completed write operation key=WSRJB811XCVL tag=BCXMKTTEW1O4 type=write size=962763 2024-01-13T18:20:47.699 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.698+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~NX9WXWKDT9JL.0 size=1048576 2024-01-13T18:20:47.701 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.700+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~NX9WXWKDT9JL.1 size=1048576 2024-01-13T18:20:47.703 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.702+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~NX9WXWKDT9JL.2 size=341221 2024-01-13T18:20:47.703 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.702+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=NX9WXWKDT9JL tag=BB1RRIB0YO47 type=write size=3486949 2024-01-13T18:20:47.707 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.706+0000 7f759fd04880 1 < suggested remove operation key=7WRTM9ANJRT4 tag=02LTTZX9Y741 type=write 2024-01-13T18:20:47.709 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.708+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=PX6T5QMPAWI9 type=del size=3051986 2024-01-13T18:20:47.711 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.709+0000 7f759fd04880 1 < completed delete operation key=DOXP3EJ03EBY tag=ME3IF2USFXM9 type=del 2024-01-13T18:20:47.713 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.711+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=DM3QVMSCVX35 type=del size=1984915 2024-01-13T18:20:47.716 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.715+0000 7f759fd04880 1 < suggested remove operation key=JN46AMLYHN8E tag=0LAB2N2SK0TX type=del 2024-01-13T18:20:47.720 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.719+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~81JATXWBLB79.0 size=106390 2024-01-13T18:20:47.720 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.719+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=81JATXWBLB79 tag=KDX8WV2AURX3 type=write size=1154966 2024-01-13T18:20:47.720 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.719+0000 7f759fd04880 1 < canceled part key=_multipart_QS9PLJKINY4R.2~J36I0HSHZQJR.0 size=1048576 2024-01-13T18:20:47.722 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.721+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~J36I0HSHZQJR.1 size=847084 2024-01-13T18:20:47.727 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.726+0000 7f759fd04880 1 < canceled multipart upload key=QS9PLJKINY4R upload=J36I0HSHZQJR tag=R79I1W9DV4LN type=write size=2944236 2024-01-13T18:20:47.729 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.728+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=GDB4O1SH9G7I type=del size=328832 2024-01-13T18:20:47.731 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.730+0000 7f759fd04880 1 < canceled operation key=3K20F802EFEQ tag=OKLE6ZN1WF02 type=del size=2961970 2024-01-13T18:20:47.736 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.733+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~4MJIFNEB9RLR.0 size=1048576 2024-01-13T18:20:47.736 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.735+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~4MJIFNEB9RLR.1 size=1048576 2024-01-13T18:20:47.738 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.737+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~4MJIFNEB9RLR.2 size=459982 2024-01-13T18:20:47.738 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.737+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=4MJIFNEB9RLR tag=C3ASCV1J8PE3 type=write size=3605710 2024-01-13T18:20:47.742 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.741+0000 7f759fd04880 1 < suggested remove operation key=2OO7S2NBZ7M6 tag=TOHPF8WBEDU0 type=del 2024-01-13T18:20:47.744 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.743+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=5R0H7ZUJ3REG type=del size=2536606 2024-01-13T18:20:47.746 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.745+0000 7f759fd04880 1 < completed write operation key=1YNH6QHP354U tag=IIW8EZG3YQV6 type=write size=548887 2024-01-13T18:20:47.750 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.749+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~8TSUB9OZ5LEX.0 size=1048576 2024-01-13T18:20:47.751 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.750+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~8TSUB9OZ5LEX.1 size=698374 2024-01-13T18:20:47.751 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.750+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=8TSUB9OZ5LEX tag=5WPUER1NF6S3 type=write size=2795526 2024-01-13T18:20:47.751 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.750+0000 7f759fd04880 1 < canceled part key=_multipart_OMA1B74S8FXS.2~39EY4VEEOIE3.0 size=1048576 2024-01-13T18:20:47.753 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.752+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~39EY4VEEOIE3.1 size=915644 2024-01-13T18:20:47.757 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.756+0000 7f759fd04880 1 < canceled multipart upload key=OMA1B74S8FXS upload=39EY4VEEOIE3 tag=T2M2LEJWH810 type=write size=3012796 2024-01-13T18:20:47.759 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.758+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=M3UXK31QRAYB type=del size=1345518 2024-01-13T18:20:47.759 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.758+0000 7f759fd04880 1 < canceled part key=_multipart_6GOU0WSHKUQ0.2~ZSCPXCU4CA7M.0 size=1048576 2024-01-13T18:20:47.761 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.760+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~ZSCPXCU4CA7M.1 size=1048576 2024-01-13T18:20:47.763 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.762+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~ZSCPXCU4CA7M.2 size=384862 2024-01-13T18:20:47.767 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.766+0000 7f759fd04880 1 < canceled multipart upload key=6GOU0WSHKUQ0 upload=ZSCPXCU4CA7M tag=SNFU5SZW4NXG type=write size=3530590 2024-01-13T18:20:47.769 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.768+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=2M94PQZ7NU8K type=del size=2352829 2024-01-13T18:20:47.771 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.770+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=N6EFRSIZOVW8 type=del 2024-01-13T18:20:47.774 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.773+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~LJUTZ4ZFZSPP.0 size=1048576 2024-01-13T18:20:47.776 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.775+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~LJUTZ4ZFZSPP.1 size=969498 2024-01-13T18:20:47.777 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.775+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=LJUTZ4ZFZSPP tag=DOI0RWQH3VLE type=write size=3066650 2024-01-13T18:20:47.779 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.778+0000 7f759fd04880 1 < completed write operation key=0TIZPXX8CMHA tag=HV11L3YNU5ZA type=write size=485282 2024-01-13T18:20:47.783 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.781+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~0FICW52PX26O.0 size=1048576 2024-01-13T18:20:47.784 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.783+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~0FICW52PX26O.1 size=1048576 2024-01-13T18:20:47.786 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.785+0000 7f759fd04880 1 > prepared part key=_multipart_TNC2YDZYGM6G.2~0FICW52PX26O.2 size=216466 2024-01-13T18:20:47.786 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.785+0000 7f759fd04880 1 > prepared multipart upload key=TNC2YDZYGM6G upload=0FICW52PX26O tag=0Z7ZRI9TCGNC type=write size=3362194 2024-01-13T18:20:47.788 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.787+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~YNEBVAEHMCEJ.0 size=1048576 2024-01-13T18:20:47.788 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.787+0000 7f759fd04880 1 < canceled part key=_multipart_XBTWSUA3D7U3.2~YNEBVAEHMCEJ.1 size=891272 2024-01-13T18:20:47.791 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.790+0000 7f759fd04880 1 < canceled multipart upload key=XBTWSUA3D7U3 upload=YNEBVAEHMCEJ tag=F92Y50DR4A9A type=write size=2988424 2024-01-13T18:20:47.795 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.794+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~L1GUU5B2HRM4.0 size=1048576 2024-01-13T18:20:47.797 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.796+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~L1GUU5B2HRM4.1 size=1048576 2024-01-13T18:20:47.799 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.797+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~L1GUU5B2HRM4.2 size=520062 2024-01-13T18:20:47.799 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.797+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=L1GUU5B2HRM4 tag=RVXLKDNTH8TT type=write size=3665790 2024-01-13T18:20:47.800 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.799+0000 7f759fd04880 1 < completed part key=_multipart_AJZB1PXB1NB5.2~SDEQQIN40C2V.0 size=909603 2024-01-13T18:20:47.804 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.803+0000 7f759fd04880 1 < completed multipart upload key=AJZB1PXB1NB5 upload=SDEQQIN40C2V tag=OIOLE4H4IH2C type=write size=1958179 2024-01-13T18:20:47.808 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.807+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~S2NHGECPN9M3.0 size=1048576 2024-01-13T18:20:47.809 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.808+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~S2NHGECPN9M3.1 size=1048576 2024-01-13T18:20:47.811 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.810+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~S2NHGECPN9M3.2 size=627620 2024-01-13T18:20:47.811 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.810+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=S2NHGECPN9M3 tag=4BPSDHMLS9UH type=write size=3773348 2024-01-13T18:20:47.813 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.812+0000 7f759fd04880 1 < completed part key=_multipart_WSRJB811XCVL.2~2I91XTC15O2Y.0 size=501181 2024-01-13T18:20:47.817 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.816+0000 7f759fd04880 1 < completed multipart upload key=WSRJB811XCVL upload=2I91XTC15O2Y tag=UMTOISXUKQRO type=write size=1549757 2024-01-13T18:20:47.821 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.820+0000 7f759fd04880 1 > prepared part key=_multipart_QD5GBLNCY707.2~8HO8LK9MDQBQ.0 size=713025 2024-01-13T18:20:47.821 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.820+0000 7f759fd04880 1 > prepared multipart upload key=QD5GBLNCY707 upload=8HO8LK9MDQBQ tag=S447NL6TE79S type=write size=1761601 2024-01-13T18:20:47.823 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.822+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~ICTJF930GYJV.0 size=1048576 2024-01-13T18:20:47.825 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.824+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~ICTJF930GYJV.1 size=1048576 2024-01-13T18:20:47.826 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.825+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~ICTJF930GYJV.2 size=184232 2024-01-13T18:20:47.830 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.829+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=ICTJF930GYJV tag=UAZI92B77C7J type=write size=3329960 2024-01-13T18:20:47.832 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.831+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=FPB6U1KXNKUU type=del size=2661987 2024-01-13T18:20:47.833 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.831+0000 7f759fd04880 1 < canceled part key=_multipart_6GOU0WSHKUQ0.2~NX9WXWKDT9JL.0 size=1048576 2024-01-13T18:20:47.834 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.833+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~NX9WXWKDT9JL.1 size=1048576 2024-01-13T18:20:47.836 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.835+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~NX9WXWKDT9JL.2 size=341221 2024-01-13T18:20:47.839 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.838+0000 7f759fd04880 1 < canceled multipart upload key=6GOU0WSHKUQ0 upload=NX9WXWKDT9JL tag=BB1RRIB0YO47 type=write size=3486949 2024-01-13T18:20:47.843 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.842+0000 7f759fd04880 1 > prepared part key=_multipart_1YNH6QHP354U.2~5BV76VPJRE2O.0 size=683695 2024-01-13T18:20:47.843 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.842+0000 7f759fd04880 1 > prepared multipart upload key=1YNH6QHP354U upload=5BV76VPJRE2O tag=2GMJYY9XSTCC type=write size=1732271 2024-01-13T18:20:47.845 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.844+0000 7f759fd04880 1 < completed delete operation key=QKNPXHB99KVP tag=PX6T5QMPAWI9 type=del 2024-01-13T18:20:47.847 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.846+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=CI9RQ0WFKIRF type=del size=3504367 2024-01-13T18:20:47.851 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.848+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=DM3QVMSCVX35 type=del 2024-01-13T18:20:47.853 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.852+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~UN46ZKBPJO4T.0 size=1048576 2024-01-13T18:20:47.855 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.854+0000 7f759fd04880 1 > prepared part key=_multipart_0TIZPXX8CMHA.2~UN46ZKBPJO4T.1 size=555932 2024-01-13T18:20:47.855 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.854+0000 7f759fd04880 1 > prepared multipart upload key=0TIZPXX8CMHA upload=UN46ZKBPJO4T tag=5IY2A1ZJEDKE type=write size=2653084 2024-01-13T18:20:47.857 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.856+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~81JATXWBLB79.0 size=106390 2024-01-13T18:20:47.860 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.859+0000 7f759fd04880 1 < completed multipart upload key=JGALONWJXLQY upload=81JATXWBLB79 tag=KDX8WV2AURX3 type=write size=1154966 2024-01-13T18:20:47.862 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.861+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=V1AKSR1O35L0 type=del size=3376308 2024-01-13T18:20:47.865 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.864+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=GDB4O1SH9G7I type=del 2024-01-13T18:20:47.867 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.866+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=ZTDFJPJEMD5E type=write size=143985 2024-01-13T18:20:47.869 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.868+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~4MJIFNEB9RLR.0 size=1048576 2024-01-13T18:20:47.871 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.870+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~4MJIFNEB9RLR.1 size=1048576 2024-01-13T18:20:47.873 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.872+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~4MJIFNEB9RLR.2 size=459982 2024-01-13T18:20:47.877 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.876+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=4MJIFNEB9RLR tag=C3ASCV1J8PE3 type=write size=3605710 2024-01-13T18:20:47.881 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.880+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~UUPFM3H00CGD.0 size=1048576 2024-01-13T18:20:47.882 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.881+0000 7f759fd04880 1 > prepared part key=_multipart_VZHGQM6ZNJYQ.2~UUPFM3H00CGD.1 size=141548 2024-01-13T18:20:47.883 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.881+0000 7f759fd04880 1 > prepared multipart upload key=VZHGQM6ZNJYQ upload=UUPFM3H00CGD tag=G99HLVTNXZ3E type=write size=2238700 2024-01-13T18:20:47.887 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.887+0000 7f759fd04880 1 < suggested update operation key=2OO7S2NBZ7M6 tag=5R0H7ZUJ3REG type=del size=2536606 2024-01-13T18:20:47.890 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.889+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=NCQ451QB9RXI type=del size=1669046 2024-01-13T18:20:47.892 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.891+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~8TSUB9OZ5LEX.0 size=1048576 2024-01-13T18:20:47.893 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.893+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~8TSUB9OZ5LEX.1 size=698374 2024-01-13T18:20:47.897 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.897+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=8TSUB9OZ5LEX tag=5WPUER1NF6S3 type=write size=2795526 2024-01-13T18:20:47.902 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.901+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~BESH8NSUSQMD.0 size=1048576 2024-01-13T18:20:47.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.903+0000 7f759fd04880 1 > prepared part key=_multipart_XBTWSUA3D7U3.2~BESH8NSUSQMD.1 size=954795 2024-01-13T18:20:47.904 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.903+0000 7f759fd04880 1 > prepared multipart upload key=XBTWSUA3D7U3 upload=BESH8NSUSQMD tag=ZXBOD6JUO8NC type=write size=3051947 2024-01-13T18:20:47.906 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.905+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=M3UXK31QRAYB type=del 2024-01-13T18:20:47.908 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.907+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=ZO9H2Q25ZWFM type=write size=50273 2024-01-13T18:20:47.910 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.910+0000 7f759fd04880 1 < canceled operation key=XBTWSUA3D7U3 tag=2M94PQZ7NU8K type=del size=2352829 2024-01-13T18:20:47.913 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.912+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=VLGWAMFCY15T type=del size=3696698 2024-01-13T18:20:47.915 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.914+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~LJUTZ4ZFZSPP.0 size=1048576 2024-01-13T18:20:47.917 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.916+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~LJUTZ4ZFZSPP.1 size=969498 2024-01-13T18:20:47.920 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.919+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=LJUTZ4ZFZSPP tag=DOI0RWQH3VLE type=write size=3066650 2024-01-13T18:20:47.925 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.924+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~LU7RBYF5HD2L.0 size=1048576 2024-01-13T18:20:47.926 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.925+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~LU7RBYF5HD2L.1 size=1048576 2024-01-13T18:20:47.928 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.927+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~LU7RBYF5HD2L.2 size=960719 2024-01-13T18:20:47.928 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.927+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=LU7RBYF5HD2L tag=HBL6AK990A3S type=write size=4106447 2024-01-13T18:20:47.930 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.929+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~0FICW52PX26O.0 size=1048576 2024-01-13T18:20:47.932 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.931+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~0FICW52PX26O.1 size=1048576 2024-01-13T18:20:47.934 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.933+0000 7f759fd04880 1 < completed part key=_multipart_TNC2YDZYGM6G.2~0FICW52PX26O.2 size=216466 2024-01-13T18:20:47.938 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.937+0000 7f759fd04880 1 < completed multipart upload key=TNC2YDZYGM6G upload=0FICW52PX26O tag=0Z7ZRI9TCGNC type=write size=3362194 2024-01-13T18:20:47.942 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.941+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~9HIMP1G33NJF.0 size=1048576 2024-01-13T18:20:47.944 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.943+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~9HIMP1G33NJF.1 size=758980 2024-01-13T18:20:47.944 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.943+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=9HIMP1G33NJF tag=TFY05WJEE8IQ type=write size=2856132 2024-01-13T18:20:47.946 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.945+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~L1GUU5B2HRM4.0 size=1048576 2024-01-13T18:20:47.948 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.947+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~L1GUU5B2HRM4.1 size=1048576 2024-01-13T18:20:47.950 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.949+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~L1GUU5B2HRM4.2 size=520062 2024-01-13T18:20:47.954 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.953+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=L1GUU5B2HRM4 tag=RVXLKDNTH8TT type=write size=3665790 2024-01-13T18:20:47.957 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.956+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=7SFP6G041FTJ type=del size=2360212 2024-01-13T18:20:47.959 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.958+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~S2NHGECPN9M3.0 size=1048576 2024-01-13T18:20:47.960 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.960+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~S2NHGECPN9M3.1 size=1048576 2024-01-13T18:20:47.962 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.961+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~S2NHGECPN9M3.2 size=627620 2024-01-13T18:20:47.966 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.965+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=S2NHGECPN9M3 tag=4BPSDHMLS9UH type=write size=3773348 2024-01-13T18:20:47.970 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.969+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~X5UHI2LYVPQ5.0 size=1048576 2024-01-13T18:20:47.971 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.970+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~X5UHI2LYVPQ5.1 size=1048576 2024-01-13T18:20:47.973 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.972+0000 7f759fd04880 1 > prepared part key=_multipart_OMA1B74S8FXS.2~X5UHI2LYVPQ5.2 size=683107 2024-01-13T18:20:47.973 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.972+0000 7f759fd04880 1 > prepared multipart upload key=OMA1B74S8FXS upload=X5UHI2LYVPQ5 tag=EXJ8RPPT17CK type=write size=3828835 2024-01-13T18:20:47.975 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.974+0000 7f759fd04880 1 < completed part key=_multipart_QD5GBLNCY707.2~8HO8LK9MDQBQ.0 size=713025 2024-01-13T18:20:47.978 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.978+0000 7f759fd04880 1 < completed multipart upload key=QD5GBLNCY707 upload=8HO8LK9MDQBQ tag=S447NL6TE79S type=write size=1761601 2024-01-13T18:20:47.981 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.980+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=MT9IBH3QZ29P type=del size=4189475 2024-01-13T18:20:47.983 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.982+0000 7f759fd04880 -1 < failed to complete operation key=2OO7S2NBZ7M6 tag=FPB6U1KXNKUU type=del size=2661987: (22) Invalid argument 2024-01-13T18:20:47.986 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.984+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=JO68GEVPQRBG type=del size=1485463 2024-01-13T18:20:47.988 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.986+0000 7f759fd04880 1 < completed part key=_multipart_1YNH6QHP354U.2~5BV76VPJRE2O.0 size=683695 2024-01-13T18:20:47.991 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.990+0000 7f759fd04880 1 < completed multipart upload key=1YNH6QHP354U upload=5BV76VPJRE2O tag=2GMJYY9XSTCC type=write size=1732271 2024-01-13T18:20:47.993 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.992+0000 7f759fd04880 1 > prepared operation key=6GOU0WSHKUQ0 tag=EPCHUB2OZF59 type=del size=1754899 2024-01-13T18:20:47.995 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.994+0000 7f759fd04880 1 < completed delete operation key=1YNH6QHP354U tag=CI9RQ0WFKIRF type=del 2024-01-13T18:20:47.998 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.997+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=CVYQ0QLD2EV2 type=del size=3768568 2024-01-13T18:20:48.000 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:47.999+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~UN46ZKBPJO4T.0 size=1048576 2024-01-13T18:20:48.001 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.000+0000 7f759fd04880 1 < completed part key=_multipart_0TIZPXX8CMHA.2~UN46ZKBPJO4T.1 size=555932 2024-01-13T18:20:48.005 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.004+0000 7f759fd04880 1 < completed multipart upload key=0TIZPXX8CMHA upload=UN46ZKBPJO4T tag=5IY2A1ZJEDKE type=write size=2653084 2024-01-13T18:20:48.007 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.006+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=LSWUFSLOYWZH type=del size=991535 2024-01-13T18:20:48.009 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.008+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=V1AKSR1O35L0 type=del 2024-01-13T18:20:48.011 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.010+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=GMN0BXP7J92X type=del size=1782323 2024-01-13T18:20:48.013 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.012+0000 7f759fd04880 1 < completed write operation key=WSRJB811XCVL tag=ZTDFJPJEMD5E type=write size=143985 2024-01-13T18:20:48.015 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.014+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=7GG676A20B45 type=del size=1683822 2024-01-13T18:20:48.016 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.014+0000 7f759fd04880 1 < canceled part key=_multipart_VZHGQM6ZNJYQ.2~UUPFM3H00CGD.0 size=1048576 2024-01-13T18:20:48.017 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.016+0000 7f759fd04880 1 < completed part key=_multipart_VZHGQM6ZNJYQ.2~UUPFM3H00CGD.1 size=141548 2024-01-13T18:20:48.021 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.020+0000 7f759fd04880 1 < canceled multipart upload key=VZHGQM6ZNJYQ upload=UUPFM3H00CGD tag=G99HLVTNXZ3E type=write size=2238700 2024-01-13T18:20:48.023 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.022+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=5LQZDVVB8OGT type=del size=4013391 2024-01-13T18:20:48.026 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.024+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=NCQ451QB9RXI type=del 2024-01-13T18:20:48.028 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.027+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=NAH5HOJRET2C type=del size=1196564 2024-01-13T18:20:48.029 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.029+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~BESH8NSUSQMD.0 size=1048576 2024-01-13T18:20:48.031 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.030+0000 7f759fd04880 1 < completed part key=_multipart_XBTWSUA3D7U3.2~BESH8NSUSQMD.1 size=954795 2024-01-13T18:20:48.035 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.034+0000 7f759fd04880 1 < completed multipart upload key=XBTWSUA3D7U3 upload=BESH8NSUSQMD tag=ZXBOD6JUO8NC type=write size=3051947 2024-01-13T18:20:48.038 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.037+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=IWZ2D8U0238K type=del size=3100281 2024-01-13T18:20:48.040 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.039+0000 7f759fd04880 1 < completed write operation key=JGALONWJXLQY tag=ZO9H2Q25ZWFM type=write size=50273 2024-01-13T18:20:48.042 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.041+0000 7f759fd04880 1 > prepared operation key=JN46AMLYHN8E tag=70HQLF47EVCJ type=write size=8503 2024-01-13T18:20:48.044 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.043+0000 7f759fd04880 1 < canceled operation key=H972TC5DOMHL tag=VLGWAMFCY15T type=del size=3696698 2024-01-13T18:20:48.046 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.045+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=TI0EDTI5VUKE type=del size=2920278 2024-01-13T18:20:48.049 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.048+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~LU7RBYF5HD2L.0 size=1048576 2024-01-13T18:20:48.050 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.050+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~LU7RBYF5HD2L.1 size=1048576 2024-01-13T18:20:48.055 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.051+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~LU7RBYF5HD2L.2 size=960719 2024-01-13T18:20:48.056 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.055+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=LU7RBYF5HD2L tag=HBL6AK990A3S type=write size=4106447 2024-01-13T18:20:48.059 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.058+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~5QG021WG1C4Y.0 size=1048576 2024-01-13T18:20:48.061 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.060+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~5QG021WG1C4Y.1 size=1048576 2024-01-13T18:20:48.063 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.062+0000 7f759fd04880 1 > prepared part key=_multipart_JGALONWJXLQY.2~5QG021WG1C4Y.2 size=663731 2024-01-13T18:20:48.063 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.062+0000 7f759fd04880 1 > prepared multipart upload key=JGALONWJXLQY upload=5QG021WG1C4Y tag=426LVKY1X5VN type=write size=3809459 2024-01-13T18:20:48.064 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.062+0000 7f759fd04880 1 < canceled part key=_multipart_7LXXSKLOM1JZ.2~9HIMP1G33NJF.0 size=1048576 2024-01-13T18:20:48.065 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.064+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~9HIMP1G33NJF.1 size=758980 2024-01-13T18:20:48.069 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.068+0000 7f759fd04880 1 < canceled multipart upload key=7LXXSKLOM1JZ upload=9HIMP1G33NJF tag=TFY05WJEE8IQ type=write size=2856132 2024-01-13T18:20:48.071 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.070+0000 7f759fd04880 1 > prepared operation key=0TIZPXX8CMHA tag=J8BHGT13D9EC type=del size=893943 2024-01-13T18:20:48.075 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.074+0000 7f759fd04880 1 < suggested update operation key=H7C1UAGAUR7D tag=7SFP6G041FTJ type=del size=2360212 2024-01-13T18:20:48.077 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.076+0000 7f759fd04880 1 > prepared operation key=QD5GBLNCY707 tag=4RSA0ZNLZC1T type=del size=2342933 2024-01-13T18:20:48.078 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.077+0000 7f759fd04880 1 < canceled part key=_multipart_OMA1B74S8FXS.2~X5UHI2LYVPQ5.0 size=1048576 2024-01-13T18:20:48.080 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.079+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~X5UHI2LYVPQ5.1 size=1048576 2024-01-13T18:20:48.081 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.080+0000 7f759fd04880 1 < completed part key=_multipart_OMA1B74S8FXS.2~X5UHI2LYVPQ5.2 size=683107 2024-01-13T18:20:48.085 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.085+0000 7f759fd04880 1 < canceled multipart upload key=OMA1B74S8FXS upload=X5UHI2LYVPQ5 tag=EXJ8RPPT17CK type=write size=3828835 2024-01-13T18:20:48.090 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.089+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~9MVPJ8X30TM9.0 size=1048576 2024-01-13T18:20:48.091 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.090+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~9MVPJ8X30TM9.1 size=1048576 2024-01-13T18:20:48.093 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.092+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~9MVPJ8X30TM9.2 size=987701 2024-01-13T18:20:48.093 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.092+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=9MVPJ8X30TM9 tag=AE4OFHFR0OWH type=write size=4133429 2024-01-13T18:20:48.095 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.094+0000 7f759fd04880 1 < completed delete operation key=AJZB1PXB1NB5 tag=MT9IBH3QZ29P type=del 2024-01-13T18:20:48.097 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.096+0000 7f759fd04880 1 > prepared operation key=2OO7S2NBZ7M6 tag=FS1C4A4V0WRO type=write size=561493 2024-01-13T18:20:48.100 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.099+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=JO68GEVPQRBG type=del 2024-01-13T18:20:48.105 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.104+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~MULJC2QOJ7YQ.0 size=1048576 2024-01-13T18:20:48.107 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.106+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~MULJC2QOJ7YQ.1 size=1048576 2024-01-13T18:20:48.109 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.108+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~MULJC2QOJ7YQ.2 size=1011169 2024-01-13T18:20:48.109 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.108+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=MULJC2QOJ7YQ tag=2X8C14IO7T3O type=write size=4156897 2024-01-13T18:20:48.111 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.110+0000 7f759fd04880 1 < completed delete operation key=6GOU0WSHKUQ0 tag=EPCHUB2OZF59 type=del 2024-01-13T18:20:48.115 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.114+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~37SAD1WUPCVG.0 size=1048576 2024-01-13T18:20:48.116 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.115+0000 7f759fd04880 1 > prepared part key=_multipart_RY0W5S41XK3F.2~37SAD1WUPCVG.1 size=1024452 2024-01-13T18:20:48.116 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.115+0000 7f759fd04880 1 > prepared multipart upload key=RY0W5S41XK3F upload=37SAD1WUPCVG tag=004XZAAYY3VU type=write size=3121604 2024-01-13T18:20:48.122 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.120+0000 7f759fd04880 1 < suggested update operation key=7WRTM9ANJRT4 tag=CVYQ0QLD2EV2 type=del size=3768568 2024-01-13T18:20:48.123 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.122+0000 7f759fd04880 1 > prepared operation key=7R5YIO7UFSDZ tag=HT3INE0DEKW2 type=del size=3691538 2024-01-13T18:20:48.125 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.124+0000 7f759fd04880 1 < completed delete operation key=P8FMRQR7GXN7 tag=LSWUFSLOYWZH type=del 2024-01-13T18:20:48.129 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.129+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~DE93H4P11AWO.0 size=1048576 2024-01-13T18:20:48.131 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.130+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~DE93H4P11AWO.1 size=809586 2024-01-13T18:20:48.131 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.130+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=DE93H4P11AWO tag=683KSUOH9R7N type=write size=2906738 2024-01-13T18:20:48.134 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.133+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=GMN0BXP7J92X type=del 2024-01-13T18:20:48.136 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.135+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=Y4V4UCPGRWKK type=del size=339459 2024-01-13T18:20:48.139 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.138+0000 7f759fd04880 -1 < failed to complete operation key=H7C1UAGAUR7D tag=7GG676A20B45 type=del size=1683822: (22) Invalid argument 2024-01-13T18:20:48.141 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.140+0000 7f759fd04880 1 > prepared operation key=OMA1B74S8FXS tag=XI6Q0OVE9V45 type=del size=631911 2024-01-13T18:20:48.145 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.143+0000 7f759fd04880 1 < suggested update operation key=7WRTM9ANJRT4 tag=5LQZDVVB8OGT type=del size=4013391 2024-01-13T18:20:48.148 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.147+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~FEGA2HEM4LMX.0 size=1048576 2024-01-13T18:20:48.150 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.149+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~FEGA2HEM4LMX.1 size=1048576 2024-01-13T18:20:48.151 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.150+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~FEGA2HEM4LMX.2 size=820266 2024-01-13T18:20:48.152 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.150+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=FEGA2HEM4LMX tag=WJDIW8XXOPUQ type=write size=3965994 2024-01-13T18:20:48.153 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.152+0000 7f759fd04880 1 < canceled operation key=1O3XX67RKHNW tag=NAH5HOJRET2C type=del size=1196564 2024-01-13T18:20:48.155 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.154+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=70HYQP0M7UTO type=write size=947506 2024-01-13T18:20:48.160 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.158+0000 7f759fd04880 -1 < failed to complete operation key=7WRTM9ANJRT4 tag=IWZ2D8U0238K type=del size=3100281: (22) Invalid argument 2024-01-13T18:20:48.162 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.161+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=NLARC97WMAGB type=del size=3671054 2024-01-13T18:20:48.164 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.163+0000 7f759fd04880 1 < completed write operation key=JN46AMLYHN8E tag=70HQLF47EVCJ type=write size=8503 2024-01-13T18:20:48.166 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.165+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=OCC2MRCPAXCU type=del size=351129 2024-01-13T18:20:48.171 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.169+0000 7f759fd04880 1 < suggested remove operation key=QS9PLJKINY4R tag=TI0EDTI5VUKE type=del 2024-01-13T18:20:48.172 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.171+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=WT5Y7XRXDE3J type=write size=322065 2024-01-13T18:20:48.173 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.172+0000 7f759fd04880 1 < canceled part key=_multipart_JGALONWJXLQY.2~5QG021WG1C4Y.0 size=1048576 2024-01-13T18:20:48.174 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.174+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~5QG021WG1C4Y.1 size=1048576 2024-01-13T18:20:48.176 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.175+0000 7f759fd04880 1 < completed part key=_multipart_JGALONWJXLQY.2~5QG021WG1C4Y.2 size=663731 2024-01-13T18:20:48.180 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.179+0000 7f759fd04880 1 < canceled multipart upload key=JGALONWJXLQY upload=5QG021WG1C4Y tag=426LVKY1X5VN type=write size=3809459 2024-01-13T18:20:48.182 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.181+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=YDK3X1759S3S type=del size=1404352 2024-01-13T18:20:48.184 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.183+0000 7f759fd04880 1 < completed delete operation key=0TIZPXX8CMHA tag=J8BHGT13D9EC type=del 2024-01-13T18:20:48.186 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.185+0000 7f759fd04880 1 > prepared operation key=7WRTM9ANJRT4 tag=AZ3W3U8HQFAC type=del size=3819324 2024-01-13T18:20:48.188 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.187+0000 7f759fd04880 1 < completed delete operation key=QD5GBLNCY707 tag=4RSA0ZNLZC1T type=del 2024-01-13T18:20:48.190 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.189+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=EPATF3ERQFD7 type=del size=4079771 2024-01-13T18:20:48.192 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.191+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~9MVPJ8X30TM9.0 size=1048576 2024-01-13T18:20:48.194 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.194+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~9MVPJ8X30TM9.1 size=1048576 2024-01-13T18:20:48.195 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.194+0000 7f759fd04880 1 < canceled part key=_multipart_H7C1UAGAUR7D.2~9MVPJ8X30TM9.2 size=987701 2024-01-13T18:20:48.198 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.197+0000 7f759fd04880 1 < canceled multipart upload key=H7C1UAGAUR7D upload=9MVPJ8X30TM9 tag=AE4OFHFR0OWH type=write size=4133429 2024-01-13T18:20:48.200 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.199+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=D0P88RC8ETTY type=del size=1716900 2024-01-13T18:20:48.202 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.201+0000 7f759fd04880 1 < completed write operation key=2OO7S2NBZ7M6 tag=FS1C4A4V0WRO type=write size=561493 2024-01-13T18:20:48.204 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.203+0000 7f759fd04880 1 > prepared operation key=EW3ZFDVIQZ7G tag=5GPDW5EZQZXK type=del size=1817889 2024-01-13T18:20:48.206 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.205+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~MULJC2QOJ7YQ.0 size=1048576 2024-01-13T18:20:48.208 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.206+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~MULJC2QOJ7YQ.1 size=1048576 2024-01-13T18:20:48.209 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.208+0000 7f759fd04880 1 < completed part key=_multipart_7LXXSKLOM1JZ.2~MULJC2QOJ7YQ.2 size=1011169 2024-01-13T18:20:48.213 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.212+0000 7f759fd04880 1 < completed multipart upload key=7LXXSKLOM1JZ upload=MULJC2QOJ7YQ tag=2X8C14IO7T3O type=write size=4156897 2024-01-13T18:20:48.215 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.214+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=2CPET32PBQDX type=del size=4076377 2024-01-13T18:20:48.217 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.216+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~37SAD1WUPCVG.0 size=1048576 2024-01-13T18:20:48.219 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.218+0000 7f759fd04880 1 < completed part key=_multipart_RY0W5S41XK3F.2~37SAD1WUPCVG.1 size=1024452 2024-01-13T18:20:48.223 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.221+0000 7f759fd04880 1 < completed multipart upload key=RY0W5S41XK3F upload=37SAD1WUPCVG tag=004XZAAYY3VU type=write size=3121604 2024-01-13T18:20:48.225 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.224+0000 7f759fd04880 1 > prepared operation key=1QEZO616DBC3 tag=BGMD2NJ3Y7SN type=del size=3652580 2024-01-13T18:20:48.227 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.226+0000 7f759fd04880 1 < completed delete operation key=7R5YIO7UFSDZ tag=HT3INE0DEKW2 type=del 2024-01-13T18:20:48.230 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.228+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=JXZ3BPLX34MY type=del size=1305505 2024-01-13T18:20:48.230 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.229+0000 7f759fd04880 1 < canceled part key=_multipart_QKNPXHB99KVP.2~DE93H4P11AWO.0 size=1048576 2024-01-13T18:20:48.232 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.231+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~DE93H4P11AWO.1 size=809586 2024-01-13T18:20:48.236 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.234+0000 7f759fd04880 1 < canceled multipart upload key=QKNPXHB99KVP upload=DE93H4P11AWO tag=683KSUOH9R7N type=write size=2906738 2024-01-13T18:20:48.238 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.236+0000 7f759fd04880 1 > prepared operation key=TNC2YDZYGM6G tag=0I9NSVYHHPUL type=del size=834182 2024-01-13T18:20:48.242 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.241+0000 7f759fd04880 1 < suggested update operation key=AJZB1PXB1NB5 tag=Y4V4UCPGRWKK type=del size=339459 2024-01-13T18:20:48.244 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.243+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=2CYKNNF4GBYQ type=del size=387198 2024-01-13T18:20:48.246 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.245+0000 7f759fd04880 1 < completed delete operation key=OMA1B74S8FXS tag=XI6Q0OVE9V45 type=del 2024-01-13T18:20:48.250 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.249+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~G2YUY55YSHUX.0 size=1048576 2024-01-13T18:20:48.251 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.250+0000 7f759fd04880 1 > prepared part key=_multipart_QKNPXHB99KVP.2~G2YUY55YSHUX.1 size=706441 2024-01-13T18:20:48.252 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.250+0000 7f759fd04880 1 > prepared multipart upload key=QKNPXHB99KVP upload=G2YUY55YSHUX tag=M3CTQBK16K5H type=write size=2803593 2024-01-13T18:20:48.255 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.253+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~FEGA2HEM4LMX.0 size=1048576 2024-01-13T18:20:48.255 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.254+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~FEGA2HEM4LMX.1 size=1048576 2024-01-13T18:20:48.257 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.256+0000 7f759fd04880 1 < completed part key=_multipart_8EWIOXN5H9KU.2~FEGA2HEM4LMX.2 size=820266 2024-01-13T18:20:48.262 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.261+0000 7f759fd04880 1 < completed multipart upload key=8EWIOXN5H9KU upload=FEGA2HEM4LMX tag=WJDIW8XXOPUQ type=write size=3965994 2024-01-13T18:20:48.266 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.264+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~IDC9MG9VQ75R.0 size=944886 2024-01-13T18:20:48.266 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.264+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=IDC9MG9VQ75R tag=SQP061D20GS1 type=write size=1993462 2024-01-13T18:20:48.268 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.266+0000 7f759fd04880 1 < completed write operation key=BPUBFFWB9D3C tag=70HYQP0M7UTO type=write size=947506 2024-01-13T18:20:48.270 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.268+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=3U0C448SUDJJ type=del size=428461 2024-01-13T18:20:48.272 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.271+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=NLARC97WMAGB type=del 2024-01-13T18:20:48.274 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.273+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=5U6SW18QUOWZ type=del size=2089422 2024-01-13T18:20:48.278 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.277+0000 7f759fd04880 1 < suggested update operation key=ZI9WAZQHVPAR tag=OCC2MRCPAXCU type=del size=351129 2024-01-13T18:20:48.280 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.279+0000 7f759fd04880 1 > prepared operation key=BPUBFFWB9D3C tag=NFMGQXBPNGKG type=del size=2101386 2024-01-13T18:20:48.282 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.281+0000 7f759fd04880 1 < canceled operation key=XBTWSUA3D7U3 tag=WT5Y7XRXDE3J type=write size=322065 2024-01-13T18:20:48.284 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.283+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=CKBTNCTX430U type=del size=2319780 2024-01-13T18:20:48.285 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.285+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=YDK3X1759S3S type=del 2024-01-13T18:20:48.288 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.287+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=RYXSTZ0I57FG type=del size=3828934 2024-01-13T18:20:48.290 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.289+0000 7f759fd04880 1 < completed delete operation key=7WRTM9ANJRT4 tag=AZ3W3U8HQFAC type=del 2024-01-13T18:20:48.292 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.291+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=TZWN9XP4CXQU type=write size=539933 2024-01-13T18:20:48.294 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.293+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=EPATF3ERQFD7 type=del 2024-01-13T18:20:48.296 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.295+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=2EQKRJ8U07LL type=del size=549412 2024-01-13T18:20:48.300 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.299+0000 7f759fd04880 1 < suggested remove operation key=H972TC5DOMHL tag=D0P88RC8ETTY type=del 2024-01-13T18:20:48.302 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.301+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=B6CZBW4ZAD48 type=del size=3541426 2024-01-13T18:20:48.306 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.305+0000 7f759fd04880 1 < suggested update operation key=EW3ZFDVIQZ7G tag=5GPDW5EZQZXK type=del size=1817889 2024-01-13T18:20:48.308 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.307+0000 7f759fd04880 1 > prepared operation key=8EWIOXN5H9KU tag=BSLMFMHJ5G3H type=del size=914295 2024-01-13T18:20:48.310 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.309+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=2CPET32PBQDX type=del 2024-01-13T18:20:48.312 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.311+0000 7f759fd04880 1 > prepared operation key=H7C1UAGAUR7D tag=D1ZS1OGRUY64 type=del size=1725147 2024-01-13T18:20:48.314 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.313+0000 7f759fd04880 1 < completed delete operation key=1QEZO616DBC3 tag=BGMD2NJ3Y7SN type=del 2024-01-13T18:20:48.316 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.315+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=44KUSM3IUX2C type=write size=849232 2024-01-13T18:20:48.318 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.317+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=JXZ3BPLX34MY type=del 2024-01-13T18:20:48.322 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.321+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~WUAKIA7EI3Y6.0 size=1035246 2024-01-13T18:20:48.322 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.321+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=WUAKIA7EI3Y6 tag=94PNPLX9C7FJ type=write size=2083822 2024-01-13T18:20:48.324 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.323+0000 7f759fd04880 1 < completed delete operation key=TNC2YDZYGM6G tag=0I9NSVYHHPUL type=del 2024-01-13T18:20:48.328 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.327+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~EHMVJ6IZRLVK.0 size=1048576 2024-01-13T18:20:48.330 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.329+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~EHMVJ6IZRLVK.1 size=1048576 2024-01-13T18:20:48.332 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.331+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~EHMVJ6IZRLVK.2 size=937407 2024-01-13T18:20:48.332 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.331+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=EHMVJ6IZRLVK tag=39N40PQD31X1 type=write size=4083135 2024-01-13T18:20:48.333 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.333+0000 7f759fd04880 1 < completed delete operation key=8EWIOXN5H9KU tag=2CYKNNF4GBYQ type=del 2024-01-13T18:20:48.338 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.337+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~R10AMVZKIW2K.0 size=1048576 2024-01-13T18:20:48.339 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.339+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~R10AMVZKIW2K.1 size=107295 2024-01-13T18:20:48.340 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.339+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=R10AMVZKIW2K tag=1OBDGUUZ8YYN type=write size=2204447 2024-01-13T18:20:48.341 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.341+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~G2YUY55YSHUX.0 size=1048576 2024-01-13T18:20:48.343 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.342+0000 7f759fd04880 1 < completed part key=_multipart_QKNPXHB99KVP.2~G2YUY55YSHUX.1 size=706441 2024-01-13T18:20:48.347 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.346+0000 7f759fd04880 1 < completed multipart upload key=QKNPXHB99KVP upload=G2YUY55YSHUX tag=M3CTQBK16K5H type=write size=2803593 2024-01-13T18:20:48.350 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.349+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~M633ANOXAAK1.0 size=1048576 2024-01-13T18:20:48.352 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.351+0000 7f759fd04880 1 > prepared part key=_multipart_H7C1UAGAUR7D.2~M633ANOXAAK1.1 size=161645 2024-01-13T18:20:48.352 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.351+0000 7f759fd04880 1 > prepared multipart upload key=H7C1UAGAUR7D upload=M633ANOXAAK1 tag=7R7NTAHHD4UK type=write size=2258797 2024-01-13T18:20:48.354 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.353+0000 7f759fd04880 1 < completed part key=_multipart_6GOU0WSHKUQ0.2~IDC9MG9VQ75R.0 size=944886 2024-01-13T18:20:48.359 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.358+0000 7f759fd04880 1 < completed multipart upload key=6GOU0WSHKUQ0 upload=IDC9MG9VQ75R tag=SQP061D20GS1 type=write size=1993462 2024-01-13T18:20:48.362 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.361+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=AYQZ8WL6IYPQ type=del size=2007815 2024-01-13T18:20:48.364 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.363+0000 7f759fd04880 1 < completed delete operation key=1O3XX67RKHNW tag=3U0C448SUDJJ type=del 2024-01-13T18:20:48.366 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.365+0000 7f759fd04880 1 > prepared operation key=1YNH6QHP354U tag=COTP9OF5XVMP type=write size=975721 2024-01-13T18:20:48.370 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.369+0000 7f759fd04880 1 < suggested update operation key=QKNPXHB99KVP tag=5U6SW18QUOWZ type=del size=2089422 2024-01-13T18:20:48.373 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.372+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~UUKPRVT796QE.0 size=1048576 2024-01-13T18:20:48.375 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.374+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~UUKPRVT796QE.1 size=1048576 2024-01-13T18:20:48.377 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.376+0000 7f759fd04880 1 > prepared part key=_multipart_QS9PLJKINY4R.2~UUKPRVT796QE.2 size=337109 2024-01-13T18:20:48.377 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.376+0000 7f759fd04880 1 > prepared multipart upload key=QS9PLJKINY4R upload=UUKPRVT796QE tag=I09J4I5BVIXG type=write size=3482837 2024-01-13T18:20:48.379 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.378+0000 7f759fd04880 1 < completed delete operation key=BPUBFFWB9D3C tag=NFMGQXBPNGKG type=del 2024-01-13T18:20:48.381 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.380+0000 7f759fd04880 1 > prepared operation key=1WSQNY2NDY3K tag=VP5JG4Q0PKP4 type=del size=3066548 2024-01-13T18:20:48.383 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.382+0000 7f759fd04880 1 < completed delete operation key=XBTWSUA3D7U3 tag=CKBTNCTX430U type=del 2024-01-13T18:20:48.385 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.384+0000 7f759fd04880 1 > prepared operation key=P8FMRQR7GXN7 tag=SSXSO05B7CQ5 type=del size=2056635 2024-01-13T18:20:48.387 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.386+0000 7f759fd04880 1 < canceled operation key=VZHGQM6ZNJYQ tag=RYXSTZ0I57FG type=del size=3828934 2024-01-13T18:20:48.389 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.388+0000 7f759fd04880 1 > prepared operation key=3K20F802EFEQ tag=NE31RDCGLPJR type=write size=497668 2024-01-13T18:20:48.391 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.390+0000 7f759fd04880 1 < completed write operation key=H4VHC37BOZJ3 tag=TZWN9XP4CXQU type=write size=539933 2024-01-13T18:20:48.393 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.392+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=CO4GCT7FWBNN type=del size=1630478 2024-01-13T18:20:48.395 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.394+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=2EQKRJ8U07LL type=del 2024-01-13T18:20:48.399 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.397+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~S1XXSY6M5YSJ.0 size=1048576 2024-01-13T18:20:48.400 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.399+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~S1XXSY6M5YSJ.1 size=749014 2024-01-13T18:20:48.400 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.399+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=S1XXSY6M5YSJ tag=8PK6FI49DYZF type=write size=2846166 2024-01-13T18:20:48.402 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.401+0000 7f759fd04880 1 < completed delete operation key=3K20F802EFEQ tag=B6CZBW4ZAD48 type=del 2024-01-13T18:20:48.404 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.403+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=6E230OFYG3TE type=del size=164809 2024-01-13T18:20:48.408 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.407+0000 7f759fd04880 1 < suggested update operation key=8EWIOXN5H9KU tag=BSLMFMHJ5G3H type=del size=914295 2024-01-13T18:20:48.410 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.409+0000 7f759fd04880 1 > prepared operation key=XBTWSUA3D7U3 tag=G4F1STFZ2D04 type=del size=643243 2024-01-13T18:20:48.412 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.411+0000 7f759fd04880 1 < completed delete operation key=H7C1UAGAUR7D tag=D1ZS1OGRUY64 type=del 2024-01-13T18:20:48.414 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.413+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=16BVYUEL4AK9 type=del size=3600517 2024-01-13T18:20:48.416 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.415+0000 7f759fd04880 1 < completed write operation key=H4VHC37BOZJ3 tag=44KUSM3IUX2C type=write size=849232 2024-01-13T18:20:48.419 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.418+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=61HJM1YCHMLY type=write size=936452 2024-01-13T18:20:48.421 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.420+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~WUAKIA7EI3Y6.0 size=1035246 2024-01-13T18:20:48.424 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.423+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=WUAKIA7EI3Y6 tag=94PNPLX9C7FJ type=write size=2083822 2024-01-13T18:20:48.428 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.427+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~68FH5OQ62SRZ.0 size=1048576 2024-01-13T18:20:48.429 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.428+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~68FH5OQ62SRZ.1 size=1048576 2024-01-13T18:20:48.431 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.430+0000 7f759fd04880 1 > prepared part key=_multipart_JN46AMLYHN8E.2~68FH5OQ62SRZ.2 size=718182 2024-01-13T18:20:48.431 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.430+0000 7f759fd04880 1 > prepared multipart upload key=JN46AMLYHN8E upload=68FH5OQ62SRZ tag=4EWW9O7VZZU1 type=write size=3863910 2024-01-13T18:20:48.433 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.432+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~EHMVJ6IZRLVK.0 size=1048576 2024-01-13T18:20:48.435 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.434+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~EHMVJ6IZRLVK.1 size=1048576 2024-01-13T18:20:48.437 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.436+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~EHMVJ6IZRLVK.2 size=937407 2024-01-13T18:20:48.442 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.441+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=EHMVJ6IZRLVK tag=39N40PQD31X1 type=write size=4083135 2024-01-13T18:20:48.444 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.443+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=0EOVF9GTPJGD type=del size=1576319 2024-01-13T18:20:48.446 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.445+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~R10AMVZKIW2K.0 size=1048576 2024-01-13T18:20:48.447 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.446+0000 7f759fd04880 1 < completed part key=_multipart_H4VHC37BOZJ3.2~R10AMVZKIW2K.1 size=107295 2024-01-13T18:20:48.451 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.450+0000 7f759fd04880 1 < completed multipart upload key=H4VHC37BOZJ3 upload=R10AMVZKIW2K tag=1OBDGUUZ8YYN type=write size=2204447 2024-01-13T18:20:48.453 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.452+0000 7f759fd04880 1 > prepared operation key=RY0W5S41XK3F tag=3V2MU3CUDDIV type=write size=962806 2024-01-13T18:20:48.455 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.454+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~M633ANOXAAK1.0 size=1048576 2024-01-13T18:20:48.457 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.456+0000 7f759fd04880 1 < completed part key=_multipart_H7C1UAGAUR7D.2~M633ANOXAAK1.1 size=161645 2024-01-13T18:20:48.460 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.459+0000 7f759fd04880 1 < completed multipart upload key=H7C1UAGAUR7D upload=M633ANOXAAK1 tag=7R7NTAHHD4UK type=write size=2258797 2024-01-13T18:20:48.462 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.461+0000 7f759fd04880 1 > prepared operation key=7LXXSKLOM1JZ tag=IK1G2BMARNQB type=del size=1629640 2024-01-13T18:20:48.465 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.464+0000 7f759fd04880 -1 < failed to complete operation key=QKNPXHB99KVP tag=AYQZ8WL6IYPQ type=del size=2007815: (22) Invalid argument 2024-01-13T18:20:48.469 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.468+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~W1MTUWX10957.0 size=1048576 2024-01-13T18:20:48.470 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.469+0000 7f759fd04880 1 > prepared part key=_multipart_BPUBFFWB9D3C.2~W1MTUWX10957.1 size=422363 2024-01-13T18:20:48.471 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.469+0000 7f759fd04880 1 > prepared multipart upload key=BPUBFFWB9D3C upload=W1MTUWX10957 tag=KT6Q0UO77YK2 type=write size=2519515 2024-01-13T18:20:48.474 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.473+0000 7f759fd04880 1 < suggested remove operation key=1YNH6QHP354U tag=COTP9OF5XVMP type=write 2024-01-13T18:20:48.476 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.475+0000 7f759fd04880 1 > prepared operation key=VZHGQM6ZNJYQ tag=OZY2WN2CD01H type=del size=2750188 2024-01-13T18:20:48.478 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.477+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~UUKPRVT796QE.0 size=1048576 2024-01-13T18:20:48.480 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.479+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~UUKPRVT796QE.1 size=1048576 2024-01-13T18:20:48.482 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.481+0000 7f759fd04880 1 < completed part key=_multipart_QS9PLJKINY4R.2~UUKPRVT796QE.2 size=337109 2024-01-13T18:20:48.485 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.485+0000 7f759fd04880 1 < completed multipart upload key=QS9PLJKINY4R upload=UUKPRVT796QE tag=I09J4I5BVIXG type=write size=3482837 2024-01-13T18:20:48.487 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.486+0000 7f759fd04880 1 > prepared operation key=1O3XX67RKHNW tag=28VOAWSR7VDB type=del size=3895933 2024-01-13T18:20:48.489 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.488+0000 7f759fd04880 1 < completed delete operation key=1WSQNY2NDY3K tag=VP5JG4Q0PKP4 type=del 2024-01-13T18:20:48.491 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.490+0000 7f759fd04880 1 > prepared operation key=H4VHC37BOZJ3 tag=3FT974WE8HJ7 type=del size=3860265 2024-01-13T18:20:48.495 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.494+0000 7f759fd04880 1 < suggested remove operation key=P8FMRQR7GXN7 tag=SSXSO05B7CQ5 type=del 2024-01-13T18:20:48.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.498+0000 7f759fd04880 1 > prepared part key=_multipart_WSRJB811XCVL.2~IEZIJDMK7WPQ.0 size=357910 2024-01-13T18:20:48.499 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.498+0000 7f759fd04880 1 > prepared multipart upload key=WSRJB811XCVL upload=IEZIJDMK7WPQ tag=MJZPBN2O83SR type=write size=1406486 2024-01-13T18:20:48.501 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.500+0000 7f759fd04880 1 < completed write operation key=3K20F802EFEQ tag=NE31RDCGLPJR type=write size=497668 2024-01-13T18:20:48.505 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.504+0000 7f759fd04880 1 > prepared part key=_multipart_6GOU0WSHKUQ0.2~5AXN4HYVDM26.0 size=334875 2024-01-13T18:20:48.505 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.504+0000 7f759fd04880 1 > prepared multipart upload key=6GOU0WSHKUQ0 upload=5AXN4HYVDM26 tag=MEB5UPB41HEE type=write size=1383451 2024-01-13T18:20:48.506 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.505+0000 7f759fd04880 1 < completed delete operation key=RY0W5S41XK3F tag=CO4GCT7FWBNN type=del 2024-01-13T18:20:48.510 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.509+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~OC6LDMGOQQBK.0 size=1048576 2024-01-13T18:20:48.512 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.511+0000 7f759fd04880 1 > prepared part key=_multipart_EW3ZFDVIQZ7G.2~OC6LDMGOQQBK.1 size=506965 2024-01-13T18:20:48.512 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.511+0000 7f759fd04880 1 > prepared multipart upload key=EW3ZFDVIQZ7G upload=OC6LDMGOQQBK tag=T0ED70YAYMHR type=write size=2604117 2024-01-13T18:20:48.514 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.513+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~S1XXSY6M5YSJ.0 size=1048576 2024-01-13T18:20:48.515 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.514+0000 7f759fd04880 1 < completed part key=_multipart_1O3XX67RKHNW.2~S1XXSY6M5YSJ.1 size=749014 2024-01-13T18:20:48.519 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.518+0000 7f759fd04880 1 < completed multipart upload key=1O3XX67RKHNW upload=S1XXSY6M5YSJ tag=8PK6FI49DYZF type=write size=2846166 2024-01-13T18:20:48.522 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.522+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~ZXQIN697MEVA.0 size=1048576 2024-01-13T18:20:48.524 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.523+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~ZXQIN697MEVA.1 size=1048576 2024-01-13T18:20:48.526 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.525+0000 7f759fd04880 1 > prepared part key=_multipart_DOXP3EJ03EBY.2~ZXQIN697MEVA.2 size=949790 2024-01-13T18:20:48.526 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.525+0000 7f759fd04880 1 > prepared multipart upload key=DOXP3EJ03EBY upload=ZXQIN697MEVA tag=UOON3UQ7CX5A type=write size=4095518 2024-01-13T18:20:48.528 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.527+0000 7f759fd04880 1 < canceled operation key=7LXXSKLOM1JZ tag=6E230OFYG3TE type=del size=164809 2024-01-13T18:20:48.530 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.529+0000 7f759fd04880 1 > prepared operation key=WSRJB811XCVL tag=Q2L663JIFIIJ type=del size=4114534 2024-01-13T18:20:48.534 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.533+0000 7f759fd04880 1 < suggested update operation key=XBTWSUA3D7U3 tag=G4F1STFZ2D04 type=del size=643243 2024-01-13T18:20:48.537 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.536+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~OEZBBLY4JXX9.0 size=1048576 2024-01-13T18:20:48.539 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.538+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~OEZBBLY4JXX9.1 size=1048576 2024-01-13T18:20:48.541 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.540+0000 7f759fd04880 1 > prepared part key=_multipart_AJZB1PXB1NB5.2~OEZBBLY4JXX9.2 size=1045199 2024-01-13T18:20:48.541 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.540+0000 7f759fd04880 1 > prepared multipart upload key=AJZB1PXB1NB5 upload=OEZBBLY4JXX9 tag=SA0V906UZZR4 type=write size=4190927 2024-01-13T18:20:48.543 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.542+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=16BVYUEL4AK9 type=del 2024-01-13T18:20:48.547 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.545+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~WJ349XT53T7B.0 size=1048576 2024-01-13T18:20:48.548 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.547+0000 7f759fd04880 1 > prepared part key=_multipart_8EWIOXN5H9KU.2~WJ349XT53T7B.1 size=523140 2024-01-13T18:20:48.548 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.547+0000 7f759fd04880 1 > prepared multipart upload key=8EWIOXN5H9KU upload=WJ349XT53T7B tag=5VAVDP862WDI type=write size=2620292 2024-01-13T18:20:48.553 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.552+0000 7f759fd04880 1 < suggested remove operation key=1O3XX67RKHNW tag=61HJM1YCHMLY type=write 2024-01-13T18:20:48.554 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.553+0000 7f759fd04880 1 > prepared operation key=JGALONWJXLQY tag=820WJWYYL1VA type=del size=3898743 2024-01-13T18:20:48.556 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.555+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~68FH5OQ62SRZ.0 size=1048576 2024-01-13T18:20:48.558 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.557+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~68FH5OQ62SRZ.1 size=1048576 2024-01-13T18:20:48.560 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.559+0000 7f759fd04880 1 < completed part key=_multipart_JN46AMLYHN8E.2~68FH5OQ62SRZ.2 size=718182 2024-01-13T18:20:48.563 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.563+0000 7f759fd04880 1 < completed multipart upload key=JN46AMLYHN8E upload=68FH5OQ62SRZ tag=4EWW9O7VZZU1 type=write size=3863910 2024-01-13T18:20:48.565 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.564+0000 7f759fd04880 1 > prepared operation key=AJZB1PXB1NB5 tag=DQFMGQ4W9OPH type=write size=571347 2024-01-13T18:20:48.567 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.566+0000 7f759fd04880 1 < completed delete operation key=QS9PLJKINY4R tag=0EOVF9GTPJGD type=del 2024-01-13T18:20:48.571 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.570+0000 7f759fd04880 1 > prepared part key=_multipart_1O3XX67RKHNW.2~BWFOA9P47NDL.0 size=650565 2024-01-13T18:20:48.571 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.570+0000 7f759fd04880 1 > prepared multipart upload key=1O3XX67RKHNW upload=BWFOA9P47NDL tag=LO5HDJVVM31R type=write size=1699141 2024-01-13T18:20:48.573 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.572+0000 7f759fd04880 1 < completed write operation key=RY0W5S41XK3F tag=3V2MU3CUDDIV type=write size=962806 2024-01-13T18:20:48.575 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.574+0000 7f759fd04880 1 > prepared operation key=QS9PLJKINY4R tag=LXRQZU8QW2WG type=write size=715442 2024-01-13T18:20:48.579 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.578+0000 7f759fd04880 1 < suggested remove operation key=7LXXSKLOM1JZ tag=IK1G2BMARNQB type=del 2024-01-13T18:20:48.581 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.580+0000 7f759fd04880 1 > prepared operation key=ZI9WAZQHVPAR tag=LBKABQECU5UJ type=del size=2002620 2024-01-13T18:20:48.581 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.580+0000 7f759fd04880 1 < canceled part key=_multipart_BPUBFFWB9D3C.2~W1MTUWX10957.0 size=1048576 2024-01-13T18:20:48.583 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.582+0000 7f759fd04880 1 < completed part key=_multipart_BPUBFFWB9D3C.2~W1MTUWX10957.1 size=422363 2024-01-13T18:20:48.587 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.586+0000 7f759fd04880 1 < canceled multipart upload key=BPUBFFWB9D3C upload=W1MTUWX10957 tag=KT6Q0UO77YK2 type=write size=2519515 2024-01-13T18:20:48.591 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.590+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~MM470VCWYD1F.0 size=1048576 2024-01-13T18:20:48.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.592+0000 7f759fd04880 1 > prepared part key=_multipart_H4VHC37BOZJ3.2~MM470VCWYD1F.1 size=65384 2024-01-13T18:20:48.593 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.592+0000 7f759fd04880 1 > prepared multipart upload key=H4VHC37BOZJ3 upload=MM470VCWYD1F tag=SPA2HZ55S34Q type=write size=2162536 2024-01-13T18:20:48.595 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.594+0000 7f759fd04880 1 < completed delete operation key=VZHGQM6ZNJYQ tag=OZY2WN2CD01H type=del 2024-01-13T18:20:48.597 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.596+0000 7f759fd04880 1 > prepared operation key=H972TC5DOMHL tag=S38P5DN8XWVA type=del size=2184461 2024-01-13T18:20:48.597 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.596+0000 7f759fd04880 -1 < no bi entry to suggest for operation key=1O3XX67RKHNW tag=28VOAWSR7VDB type=del size=3895933: (2) No such file or directory 2024-01-13T18:20:48.601 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.600+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~3J3K0ET106EC.0 size=1048576 2024-01-13T18:20:48.602 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.601+0000 7f759fd04880 1 > prepared part key=_multipart_7LXXSKLOM1JZ.2~3J3K0ET106EC.1 size=249743 2024-01-13T18:20:48.603 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.601+0000 7f759fd04880 1 > prepared multipart upload key=7LXXSKLOM1JZ upload=3J3K0ET106EC tag=DG3A701EPDRM type=write size=2346895 2024-01-13T18:20:48.604 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.603+0000 7f759fd04880 1 < completed delete operation key=H4VHC37BOZJ3 tag=3FT974WE8HJ7 type=del 2024-01-13T18:20:48.606 INFO:tasks.workunit.client.0.smithi084.stderr:2024-01-13T18:20:48.605+0000 7f759fd04880 1 > prepared operation key=QKNPXHB99KVP tag=P591DVGQAPZ1 type=del size=2166207 2024-01-13T18:20:48.607 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] cls_rgw_stats.simulate (13440 ms) 2024-01-13T18:20:48.607 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 1 test from cls_rgw_stats (13440 ms total) 2024-01-13T18:20:48.607 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:20:48.607 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:20:49.119 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 1 test from 1 test suite ran. (15835 ms total) 2024-01-13T18:20:49.119 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 1 test. 2024-01-13T18:20:49.127 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:20:49.127 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:20:49.195 INFO:tasks.workunit:Running workunit cls/test_cls_sdk.sh... 2024-01-13T18:20:49.196 DEBUG:teuthology.orchestra.run.smithi084:workunit test cls/test_cls_sdk.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_sdk.sh 2024-01-13T18:20:49.266 INFO:tasks.workunit.client.0.smithi084.stdout:Running main() from gmock_main.cc 2024-01-13T18:20:49.266 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 2 tests from 1 test suite. 2024-01-13T18:20:49.266 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:20:49.266 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 2 tests from ClsSDK 2024-01-13T18:20:49.266 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsSDK.TestSDKCoverageWrite 2024-01-13T18:20:49.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:49 smithi099 ceph-mon[138788]: pgmap v1463: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.4 MiB/s rd, 499 KiB/s wr, 2.55k op/s 2024-01-13T18:20:49.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:49 smithi084 ceph-mon[116404]: pgmap v1463: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.4 MiB/s rd, 499 KiB/s wr, 2.55k op/s 2024-01-13T18:20:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:49 smithi084 ceph-mon[119097]: pgmap v1463: 137 pgs: 137 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.4 MiB/s rd, 499 KiB/s wr, 2.55k op/s 2024-01-13T18:20:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:50 smithi099 ceph-mon[138788]: osdmap e1119: 8 total, 8 up, 8 in 2024-01-13T18:20:50.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:50 smithi084 ceph-mon[116404]: osdmap e1119: 8 total, 8 up, 8 in 2024-01-13T18:20:50.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:50 smithi084 ceph-mon[119097]: osdmap e1119: 8 total, 8 up, 8 in 2024-01-13T18:20:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:20:50.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:20:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:20:50] "GET /metrics HTTP/1.1" 200 33910 "" "Prometheus/2.43.0" 2024-01-13T18:20:51.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:51 smithi084 ceph-mon[116404]: osdmap e1120: 8 total, 8 up, 8 in 2024-01-13T18:20:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:51 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2419354825' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:51 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:51.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:51 smithi084 ceph-mon[116404]: pgmap v1466: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:51 smithi084 ceph-mon[119097]: osdmap e1120: 8 total, 8 up, 8 in 2024-01-13T18:20:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:51 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2419354825' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:51 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:51 smithi084 ceph-mon[119097]: pgmap v1466: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:51 smithi099 ceph-mon[138788]: osdmap e1120: 8 total, 8 up, 8 in 2024-01-13T18:20:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:51 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2419354825' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:51 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:51 smithi099 ceph-mon[138788]: pgmap v1466: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:52.152 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsSDK.TestSDKCoverageWrite (2886 ms) 2024-01-13T18:20:52.152 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] ClsSDK.TestSDKCoverageReplay 2024-01-13T18:20:52.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:52 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:20:52.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:52 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:52.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:52 smithi084 ceph-mon[116404]: osdmap e1121: 8 total, 8 up, 8 in 2024-01-13T18:20:52.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:52 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:20:52.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:52 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:52.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:52 smithi084 ceph-mon[119097]: osdmap e1121: 8 total, 8 up, 8 in 2024-01-13T18:20:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:52 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:20:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:52 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:52.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:52 smithi099 ceph-mon[138788]: osdmap e1121: 8 total, 8 up, 8 in 2024-01-13T18:20:53.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:53 smithi084 ceph-mon[116404]: osdmap e1122: 8 total, 8 up, 8 in 2024-01-13T18:20:53.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:53 smithi084 ceph-mon[116404]: pgmap v1469: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:53.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:53 smithi084 ceph-mon[119097]: osdmap e1122: 8 total, 8 up, 8 in 2024-01-13T18:20:53.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:53 smithi084 ceph-mon[119097]: pgmap v1469: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:53 smithi099 ceph-mon[138788]: osdmap e1122: 8 total, 8 up, 8 in 2024-01-13T18:20:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:53 smithi099 ceph-mon[138788]: pgmap v1469: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:54.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:54 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:20:54.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:54 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:20:54.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:54 smithi084 ceph-mon[119097]: osdmap e1123: 8 total, 8 up, 8 in 2024-01-13T18:20:54.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:54 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/517612708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:54.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:54 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:20:54.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:54 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:20:54.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:54 smithi084 ceph-mon[116404]: osdmap e1123: 8 total, 8 up, 8 in 2024-01-13T18:20:54.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:54 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/517612708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:54 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:20:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:54 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:20:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:54 smithi099 ceph-mon[138788]: osdmap e1123: 8 total, 8 up, 8 in 2024-01-13T18:20:54.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:54 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/517612708' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:20:55.191 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] ClsSDK.TestSDKCoverageReplay (3040 ms) 2024-01-13T18:20:55.192 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 2 tests from ClsSDK (5926 ms total) 2024-01-13T18:20:55.192 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:20:55.192 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:20:55.192 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 2 tests from 1 test suite ran. (5926 ms total) 2024-01-13T18:20:55.192 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 2 tests. 2024-01-13T18:20:55.194 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:20:55.194 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:20:55.264 INFO:tasks.workunit:Stopping ['cls'] on client.0... 2024-01-13T18:20:55.264 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-13T18:20:55.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:55 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/517612708' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:55.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:55 smithi084 ceph-mon[116404]: osdmap e1124: 8 total, 8 up, 8 in 2024-01-13T18:20:55.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:55 smithi084 ceph-mon[116404]: pgmap v1472: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:55.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:55 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/517612708' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:55.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:55 smithi084 ceph-mon[119097]: osdmap e1124: 8 total, 8 up, 8 in 2024-01-13T18:20:55.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:55 smithi084 ceph-mon[119097]: pgmap v1472: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:55.505 DEBUG:teuthology.parallel:result is None 2024-01-13T18:20:55.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:20:55.532 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:20:55.533 DEBUG:teuthology.orchestra.run.smithi084:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:20:55.592 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:20:55.592 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-01-13T18:20:55.592 INFO:teuthology.task.print:**** done end rados_api.yaml 2024-01-13T18:20:55.592 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-01-13T18:20:55.592 INFO:teuthology.task.print:**** done start rados_loadgenbig.yaml 2024-01-13T18:20:55.592 INFO:teuthology.task.full_sequential:In full_sequential, running task workunit... 2024-01-13T18:20:55.593 INFO:tasks.workunit:Pulling workunits from ref quincy 2024-01-13T18:20:55.593 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-13T18:20:55.593 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:20:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:55 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/517612708' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi084-171807-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:20:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:55 smithi099 ceph-mon[138788]: osdmap e1124: 8 total, 8 up, 8 in 2024-01-13T18:20:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:55 smithi099 ceph-mon[138788]: pgmap v1472: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:55.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T18:20:55.649 INFO:teuthology.orchestra.run.smithi084.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-01-13T18:20:55.650 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:20:55.708 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-01-13T18:20:55.708 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-01-13T18:20:55.766 INFO:tasks.workunit:timeout=3h 2024-01-13T18:20:55.766 INFO:tasks.workunit:cleanup=True 2024-01-13T18:20:55.766 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch quincy https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 2024-01-13T18:20:55.824 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-13T18:20:56.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:56 smithi099 ceph-mon[138788]: osdmap e1125: 8 total, 8 up, 8 in 2024-01-13T18:20:56.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:56 smithi084 ceph-mon[116404]: osdmap e1125: 8 total, 8 up, 8 in 2024-01-13T18:20:56.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:56 smithi084 ceph-mon[119097]: osdmap e1125: 8 total, 8 up, 8 in 2024-01-13T18:20:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:57 smithi099 ceph-mon[138788]: pgmap v1474: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:57.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:57 smithi084 ceph-mon[116404]: pgmap v1474: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:57.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:57 smithi084 ceph-mon[119097]: pgmap v1474: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:59.369 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:20:59 smithi099 ceph-mon[138788]: pgmap v1475: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:59.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:20:59 smithi084 ceph-mon[116404]: pgmap v1475: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:20:59.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:20:59 smithi084 ceph-mon[119097]: pgmap v1475: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:21:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:21:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:21:00] "GET /metrics HTTP/1.1" 200 33910 "" "Prometheus/2.43.0" 2024-01-13T18:21:01.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:01 smithi099 ceph-mon[138788]: pgmap v1476: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:21:01.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:01 smithi084 ceph-mon[116404]: pgmap v1476: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:21:01.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:01 smithi084 ceph-mon[119097]: pgmap v1476: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:21:01.746 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-13T18:21:01.804 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-13T18:21:01.806 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-13T18:21:01.806 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-13T18:21:01.851 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-13T18:21:01.898 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-13T18:21:01.934 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-13T18:21:01.936 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-13T18:21:01.936 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-13T18:21:01.972 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-13T18:21:01.975 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T18:21:01.975 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-13T18:21:02.033 INFO:tasks.workunit:Running workunits matching rados/load-gen-big.sh on client.0... 2024-01-13T18:21:02.034 INFO:tasks.workunit:Running workunit rados/load-gen-big.sh... 2024-01-13T18:21:02.034 DEBUG:teuthology.orchestra.run.smithi084:workunit test rados/load-gen-big.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/load-gen-big.sh 2024-01-13T18:21:02.133 INFO:tasks.workunit.client.0.smithi084.stdout:run length 1200 seconds 2024-01-13T18:21:02.133 INFO:tasks.workunit.client.0.smithi084.stdout:preparing 10240 objects 2024-01-13T18:21:03.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:03 smithi099 ceph-mon[138788]: pgmap v1477: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:21:03.683 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:03 smithi084 ceph-mon[119097]: pgmap v1477: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:21:03.683 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:03 smithi084 ceph-mon[116404]: pgmap v1477: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:21:04.031 INFO:tasks.workunit.client.0.smithi084.stdout:load-gen will run 1200 seconds 2024-01-13T18:21:05.031 INFO:tasks.workunit.client.0.smithi084.stdout: 1: throughput=0MB/sec pending data=0 2024-01-13T18:21:05.031 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7UMSbXfAQuzDWMl off=4136704 len=1970472 2024-01-13T18:21:05.034 INFO:tasks.workunit.client.0.smithi084.stdout:op 0 completed, throughput=1.87MB/sec 2024-01-13T18:21:05.034 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gQ1vvNsNmTuINx0 off=2137698 len=472822 2024-01-13T18:21:05.035 INFO:tasks.workunit.client.0.smithi084.stdout:op 1 completed, throughput=2.32MB/sec 2024-01-13T18:21:05.035 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1GNy0j5Tc5Py8oi off=2075704 len=293004 2024-01-13T18:21:05.039 INFO:tasks.workunit.client.0.smithi084.stdout:op 2 completed, throughput=2.59MB/sec 2024-01-13T18:21:05.040 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EqjkL_VtYj-NshZ off=2258703 len=832259 2024-01-13T18:21:05.044 INFO:tasks.workunit.client.0.smithi084.stdout:op 3 completed, throughput=3.36MB/sec 2024-01-13T18:21:05.044 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5mA6PpuvZHMEI3U off=10399411 len=1297541 2024-01-13T18:21:05.050 INFO:tasks.workunit.client.0.smithi084.stdout:op 4 completed, throughput=4.55MB/sec 2024-01-13T18:21:05.050 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pW03cegsSJUVWlP off=18244116 len=1119029 2024-01-13T18:21:05.055 INFO:tasks.workunit.client.0.smithi084.stdout:op 5 completed, throughput=5.58MB/sec 2024-01-13T18:21:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:05 smithi099 ceph-mon[138788]: pgmap v1478: 105 pgs: 105 active+clean; 55 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 438 KiB/s wr, 438 op/s 2024-01-13T18:21:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:05 smithi084 ceph-mon[119097]: pgmap v1478: 105 pgs: 105 active+clean; 55 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 438 KiB/s wr, 438 op/s 2024-01-13T18:21:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:05 smithi084 ceph-mon[116404]: pgmap v1478: 105 pgs: 105 active+clean; 55 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 438 KiB/s wr, 438 op/s 2024-01-13T18:21:05.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:06.055 INFO:tasks.workunit.client.0.smithi084.stdout: 2: throughput=2.82MB/sec pending data=0 2024-01-13T18:21:06.055 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KfBojPK_ggncZNA off=10375792 len=1014674 2024-01-13T18:21:06.057 INFO:tasks.workunit.client.0.smithi084.stdout:op 6 completed, throughput=3.3MB/sec 2024-01-13T18:21:06.057 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vDXarucRDwIBXm2 off=627552 len=194566 2024-01-13T18:21:06.060 INFO:tasks.workunit.client.0.smithi084.stdout:op 7 completed, throughput=3.38MB/sec 2024-01-13T18:21:06.060 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-l6Y3_wX_YVEHNmS off=9040503 len=1604105 2024-01-13T18:21:06.068 INFO:tasks.workunit.client.0.smithi084.stdout:op 8 completed, throughput=4.12MB/sec 2024-01-13T18:21:06.068 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KLA21jFyxU9Zj-v off=19394858 len=1187524 2024-01-13T18:21:06.070 INFO:tasks.workunit.client.0.smithi084.stdout:op 9 completed, throughput=4.67MB/sec 2024-01-13T18:21:06.070 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kcsOKIBuBaCUmv9 off=1285713 len=1694150 2024-01-13T18:21:06.077 INFO:tasks.workunit.client.0.smithi084.stdout:op 10 completed, throughput=5.44MB/sec 2024-01-13T18:21:07.077 INFO:tasks.workunit.client.0.smithi084.stdout: 3: throughput=3.66MB/sec pending data=0 2024-01-13T18:21:07.078 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OYLk3RZ95yOra9P off=5204022 len=172745 2024-01-13T18:21:07.078 INFO:tasks.workunit.client.0.smithi084.stdout:op 11 completed, throughput=3.71MB/sec 2024-01-13T18:21:07.078 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BbY10N38D3ij85k off=7530237 len=1794156 2024-01-13T18:21:07.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 12 completed, throughput=4.27MB/sec 2024-01-13T18:21:07.080 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-c7MdYatNHL7C3Dj off=6742676 len=636376 2024-01-13T18:21:07.085 INFO:tasks.workunit.client.0.smithi084.stdout:op 13 completed, throughput=4.46MB/sec 2024-01-13T18:21:07.085 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-csCEy1p1djNkkxc off=12884919 len=1256884 2024-01-13T18:21:07.087 INFO:tasks.workunit.client.0.smithi084.stdout:op 14 completed, throughput=4.85MB/sec 2024-01-13T18:21:07.087 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-p2LYIPVK4V7Fy4C off=1240610 len=1884811 2024-01-13T18:21:07.090 INFO:tasks.workunit.client.0.smithi084.stdout:op 15 completed, throughput=5.43MB/sec 2024-01-13T18:21:07.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:07 smithi099 ceph-mon[138788]: pgmap v1479: 105 pgs: 105 active+clean; 87 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 628 KiB/s wr, 627 op/s 2024-01-13T18:21:07.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:07 smithi084 ceph-mon[116404]: pgmap v1479: 105 pgs: 105 active+clean; 87 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 628 KiB/s wr, 627 op/s 2024-01-13T18:21:07.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:07 smithi084 ceph-mon[119097]: pgmap v1479: 105 pgs: 105 active+clean; 87 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 628 KiB/s wr, 627 op/s 2024-01-13T18:21:08.091 INFO:tasks.workunit.client.0.smithi084.stdout: 4: throughput=4.09MB/sec pending data=0 2024-01-13T18:21:08.091 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ReVjzXIlsfP8TJO off=15050799 len=269003 2024-01-13T18:21:08.094 INFO:tasks.workunit.client.0.smithi084.stdout:op 16 completed, throughput=4.15MB/sec 2024-01-13T18:21:08.094 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TNcoMoCUeZiX2W4 off=1941824 len=1339627 2024-01-13T18:21:08.096 INFO:tasks.workunit.client.0.smithi084.stdout:op 17 completed, throughput=4.47MB/sec 2024-01-13T18:21:08.096 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U321ooqH1Vdv-ao off=313635 len=1655980 2024-01-13T18:21:08.098 INFO:tasks.workunit.client.0.smithi084.stdout:op 18 completed, throughput=4.85MB/sec 2024-01-13T18:21:08.098 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rdx4AeZq8jhp76T off=6116440 len=952629 2024-01-13T18:21:08.102 INFO:tasks.workunit.client.0.smithi084.stdout:op 19 completed, throughput=5.07MB/sec 2024-01-13T18:21:09.103 INFO:tasks.workunit.client.0.smithi084.stdout: 5: throughput=4.07MB/sec pending data=0 2024-01-13T18:21:09.103 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eZ0w_wSS4pgbP_x off=15489270 len=83586 2024-01-13T18:21:09.105 INFO:tasks.workunit.client.0.smithi084.stdout:op 20 completed, throughput=4.08MB/sec 2024-01-13T18:21:09.105 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vpbuWrZe4ukLXtP off=8113906 len=1342689 2024-01-13T18:21:09.114 INFO:tasks.workunit.client.0.smithi084.stdout:op 21 completed, throughput=4.33MB/sec 2024-01-13T18:21:09.114 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jnSGtiUcImKie2f off=1507336 len=1092852 2024-01-13T18:21:09.116 INFO:tasks.workunit.client.0.smithi084.stdout:op 22 completed, throughput=4.53MB/sec 2024-01-13T18:21:09.116 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zVL0B6vCDke9Bt2 off=4528746 len=1789048 2024-01-13T18:21:09.126 INFO:tasks.workunit.client.0.smithi084.stdout:op 23 completed, throughput=4.86MB/sec 2024-01-13T18:21:09.126 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3pRA9gOQiVI-2Ol off=2399149 len=1895557 2024-01-13T18:21:09.138 INFO:tasks.workunit.client.0.smithi084.stdout:op 24 completed, throughput=5.2MB/sec 2024-01-13T18:21:09.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:09 smithi084 ceph-mon[116404]: pgmap v1480: 105 pgs: 105 active+clean; 127 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 153 KiB/s rd, 895 KiB/s wr, 843 op/s 2024-01-13T18:21:09.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:09 smithi084 ceph-mon[119097]: pgmap v1480: 105 pgs: 105 active+clean; 127 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 153 KiB/s rd, 895 KiB/s wr, 843 op/s 2024-01-13T18:21:09.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:09 smithi099 ceph-mon[138788]: pgmap v1480: 105 pgs: 105 active+clean; 127 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 153 KiB/s rd, 895 KiB/s wr, 843 op/s 2024-01-13T18:21:10.138 INFO:tasks.workunit.client.0.smithi084.stdout: 6: throughput=4.35MB/sec pending data=0 2024-01-13T18:21:10.139 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OcG1X33m7ZGUwTN off=10626417 len=2005023 2024-01-13T18:21:10.142 INFO:tasks.workunit.client.0.smithi084.stdout:op 25 completed, throughput=4.66MB/sec 2024-01-13T18:21:10.142 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-U-_lEJyr90_B781 off=4096827 len=1681230 2024-01-13T18:21:10.151 INFO:tasks.workunit.client.0.smithi084.stdout:op 26 completed, throughput=4.91MB/sec 2024-01-13T18:21:10.151 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HbC6KNIsCGRlwcx off=1346558 len=649022 2024-01-13T18:21:10.152 INFO:tasks.workunit.client.0.smithi084.stdout:op 27 completed, throughput=5.01MB/sec 2024-01-13T18:21:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:21:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:21:10] "GET /metrics HTTP/1.1" 200 33954 "" "Prometheus/2.43.0" 2024-01-13T18:21:11.152 INFO:tasks.workunit.client.0.smithi084.stdout: 7: throughput=4.31MB/sec pending data=0 2024-01-13T18:21:11.152 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xG9mPs4FbJ3RmQK off=3555187 len=102134 2024-01-13T18:21:11.153 INFO:tasks.workunit.client.0.smithi084.stdout:op 28 completed, throughput=4.32MB/sec 2024-01-13T18:21:11.153 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xbrufmS8JDC92NL off=2761638 len=1898464 2024-01-13T18:21:11.155 INFO:tasks.workunit.client.0.smithi084.stdout:op 29 completed, throughput=4.58MB/sec 2024-01-13T18:21:11.155 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JzmcBJ884LyEe9F off=1971519 len=1355677 2024-01-13T18:21:11.156 INFO:tasks.workunit.client.0.smithi084.stdout:op 30 completed, throughput=4.76MB/sec 2024-01-13T18:21:11.156 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Kj0Nmjf-sFEEQno off=278568 len=1471349 2024-01-13T18:21:11.164 INFO:tasks.workunit.client.0.smithi084.stdout:op 31 completed, throughput=4.95MB/sec 2024-01-13T18:21:11.164 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vROgtZGqZcliCNS off=1818256 len=1363670 2024-01-13T18:21:11.171 INFO:tasks.workunit.client.0.smithi084.stdout:op 32 completed, throughput=5.13MB/sec 2024-01-13T18:21:11.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:11 smithi099 ceph-mon[138788]: pgmap v1481: 105 pgs: 105 active+clean; 128 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 903 KiB/s rd, 1.5 MiB/s wr, 854 op/s 2024-01-13T18:21:11.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:11 smithi084 ceph-mon[116404]: pgmap v1481: 105 pgs: 105 active+clean; 128 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 903 KiB/s rd, 1.5 MiB/s wr, 854 op/s 2024-01-13T18:21:11.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:11 smithi084 ceph-mon[119097]: pgmap v1481: 105 pgs: 105 active+clean; 128 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 903 KiB/s rd, 1.5 MiB/s wr, 854 op/s 2024-01-13T18:21:12.171 INFO:tasks.workunit.client.0.smithi084.stdout: 8: throughput=4.5MB/sec pending data=0 2024-01-13T18:21:12.171 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n7iMJYnV-MO7-4G off=11127359 len=1878908 2024-01-13T18:21:12.180 INFO:tasks.workunit.client.0.smithi084.stdout:op 33 completed, throughput=4.71MB/sec 2024-01-13T18:21:12.180 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y4PkwXgavQQl2AO off=3456721 len=2003368 2024-01-13T18:21:12.186 INFO:tasks.workunit.client.0.smithi084.stdout:op 34 completed, throughput=4.94MB/sec 2024-01-13T18:21:12.186 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DgycP7IKS2vl4jM off=9966382 len=1595029 2024-01-13T18:21:12.188 INFO:tasks.workunit.client.0.smithi084.stdout:op 35 completed, throughput=5.13MB/sec 2024-01-13T18:21:13.188 INFO:tasks.workunit.client.0.smithi084.stdout: 9: throughput=4.57MB/sec pending data=0 2024-01-13T18:21:13.188 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kBuEKDGDIFXT2Ep off=16283622 len=1169418 2024-01-13T18:21:13.193 INFO:tasks.workunit.client.0.smithi084.stdout:op 36 completed, throughput=4.69MB/sec 2024-01-13T18:21:13.193 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1LDs1VX32Ix9wLT off=2689327 len=563850 2024-01-13T18:21:13.194 INFO:tasks.workunit.client.0.smithi084.stdout:op 37 completed, throughput=4.74MB/sec 2024-01-13T18:21:13.195 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-om1ZWjA_O0m9aBA off=21116612 len=1179784 2024-01-13T18:21:13.197 INFO:tasks.workunit.client.0.smithi084.stdout:op 38 completed, throughput=4.87MB/sec 2024-01-13T18:21:13.197 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bJ882ER6DitH0SC off=10632943 len=830378 2024-01-13T18:21:13.202 INFO:tasks.workunit.client.0.smithi084.stdout:op 39 completed, throughput=4.95MB/sec 2024-01-13T18:21:13.202 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dcru71y07aOGulX off=22927642 len=765157 2024-01-13T18:21:13.206 INFO:tasks.workunit.client.0.smithi084.stdout:op 40 completed, throughput=5.03MB/sec 2024-01-13T18:21:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:13 smithi099 ceph-mon[138788]: pgmap v1482: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 854 op/s 2024-01-13T18:21:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:13 smithi084 ceph-mon[116404]: pgmap v1482: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 854 op/s 2024-01-13T18:21:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:13 smithi084 ceph-mon[119097]: pgmap v1482: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 854 op/s 2024-01-13T18:21:14.206 INFO:tasks.workunit.client.0.smithi084.stdout: 10: throughput=4.53MB/sec pending data=0 2024-01-13T18:21:14.206 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gZiedQqeMyKG3jV off=6022446 len=1478702 2024-01-13T18:21:14.214 INFO:tasks.workunit.client.0.smithi084.stdout:op 41 completed, throughput=4.67MB/sec 2024-01-13T18:21:14.214 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-brBGJ7vpfYISSEH off=885568 len=689058 2024-01-13T18:21:14.218 INFO:tasks.workunit.client.0.smithi084.stdout:op 42 completed, throughput=4.73MB/sec 2024-01-13T18:21:14.218 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TzrnQbfSIuGPbVO off=1355143 len=741765 2024-01-13T18:21:14.219 INFO:tasks.workunit.client.0.smithi084.stdout:op 43 completed, throughput=4.8MB/sec 2024-01-13T18:21:14.219 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mFJ3a32gWvaNbrE off=393297 len=2056515 2024-01-13T18:21:14.222 INFO:tasks.workunit.client.0.smithi084.stdout:op 44 completed, throughput=4.99MB/sec 2024-01-13T18:21:14.222 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7KMWggwFG0BN7f_ off=2526828 len=178501 2024-01-13T18:21:14.225 INFO:tasks.workunit.client.0.smithi084.stdout:op 45 completed, throughput=5.01MB/sec 2024-01-13T18:21:15.225 INFO:tasks.workunit.client.0.smithi084.stdout: 11: throughput=4.56MB/sec pending data=0 2024-01-13T18:21:15.225 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cwCUOumBW1lWz4c off=20692809 len=1932076 2024-01-13T18:21:15.237 INFO:tasks.workunit.client.0.smithi084.stdout:op 46 completed, throughput=4.72MB/sec 2024-01-13T18:21:15.237 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--gR8rgMJ8wGrcvi off=293571 len=225381 2024-01-13T18:21:15.237 INFO:tasks.workunit.client.0.smithi084.stdout:op 47 completed, throughput=4.74MB/sec 2024-01-13T18:21:15.238 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HmXO_kZCiDy27qS off=19765577 len=34835 2024-01-13T18:21:15.238 INFO:tasks.workunit.client.0.smithi084.stdout:op 48 completed, throughput=4.74MB/sec 2024-01-13T18:21:15.238 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x7R72ludSZ39LrN off=912394 len=1799101 2024-01-13T18:21:15.246 INFO:tasks.workunit.client.0.smithi084.stdout:op 49 completed, throughput=4.89MB/sec 2024-01-13T18:21:15.246 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-I7OVqojEq1zsGk2 off=6114326 len=1722763 2024-01-13T18:21:15.247 INFO:tasks.workunit.client.0.smithi084.stdout:op 50 completed, throughput=5.03MB/sec 2024-01-13T18:21:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:15 smithi099 ceph-mon[138788]: pgmap v1483: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 856 op/s 2024-01-13T18:21:15.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:15 smithi084 ceph-mon[116404]: pgmap v1483: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 856 op/s 2024-01-13T18:21:15.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:15 smithi084 ceph-mon[119097]: pgmap v1483: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 856 op/s 2024-01-13T18:21:16.248 INFO:tasks.workunit.client.0.smithi084.stdout: 12: throughput=4.62MB/sec pending data=0 2024-01-13T18:21:16.359 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lAW25685T7NHHJF off=418933 len=1275889 2024-01-13T18:21:16.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 51 completed, throughput=4.72MB/sec 2024-01-13T18:21:16.361 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-I79xDWgix3cD_MY off=7692012 len=1300049 2024-01-13T18:21:16.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 52 completed, throughput=4.82MB/sec 2024-01-13T18:21:16.361 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KiofhZCokW6mkGz off=3798066 len=1110697 2024-01-13T18:21:16.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 53 completed, throughput=4.9MB/sec 2024-01-13T18:21:16.361 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G3d1E4-ryYV5gPy off=9659850 len=1863518 2024-01-13T18:21:16.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 54 completed, throughput=5.05MB/sec 2024-01-13T18:21:17.270 INFO:tasks.workunit.client.0.smithi084.stdout: 13: throughput=4.67MB/sec pending data=0 2024-01-13T18:21:17.271 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ua4ovB40Led8TC9 off=5325539 len=1276181 2024-01-13T18:21:17.277 INFO:tasks.workunit.client.0.smithi084.stdout:op 55 completed, throughput=4.76MB/sec 2024-01-13T18:21:17.277 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qmpuNTsgmDAmt01 off=19705888 len=85363 2024-01-13T18:21:17.279 INFO:tasks.workunit.client.0.smithi084.stdout:op 56 completed, throughput=4.76MB/sec 2024-01-13T18:21:17.279 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M3yGVf-yzLPVsPN off=12085826 len=1738524 2024-01-13T18:21:17.280 INFO:tasks.workunit.client.0.smithi084.stdout:op 57 completed, throughput=4.88MB/sec 2024-01-13T18:21:17.281 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FLC-B4uIZ6EaAGg off=11364175 len=865221 2024-01-13T18:21:17.283 INFO:tasks.workunit.client.0.smithi084.stdout:op 58 completed, throughput=4.95MB/sec 2024-01-13T18:21:17.283 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-L8Q3A5YJs1T803h off=9653290 len=1505352 2024-01-13T18:21:17.295 INFO:tasks.workunit.client.0.smithi084.stdout:op 59 completed, throughput=5.05MB/sec 2024-01-13T18:21:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:17 smithi099 ceph-mon[138788]: pgmap v1484: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 491 op/s 2024-01-13T18:21:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:17 smithi084 ceph-mon[116404]: pgmap v1484: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 491 op/s 2024-01-13T18:21:17.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:17 smithi084 ceph-mon[119097]: pgmap v1484: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 491 op/s 2024-01-13T18:21:18.295 INFO:tasks.workunit.client.0.smithi084.stdout: 14: throughput=4.7MB/sec pending data=0 2024-01-13T18:21:18.295 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DkXBY1kZa-M1cfT off=2461241 len=743232 2024-01-13T18:21:18.300 INFO:tasks.workunit.client.0.smithi084.stdout:op 60 completed, throughput=4.74MB/sec 2024-01-13T18:21:18.300 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eG_mRiy4IJ0mhx2 off=6637479 len=1875149 2024-01-13T18:21:18.302 INFO:tasks.workunit.client.0.smithi084.stdout:op 61 completed, throughput=4.87MB/sec 2024-01-13T18:21:18.302 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-si5BPx7AtOJtYu6 off=1040954 len=539460 2024-01-13T18:21:18.303 INFO:tasks.workunit.client.0.smithi084.stdout:op 62 completed, throughput=4.9MB/sec 2024-01-13T18:21:18.303 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qgCCcBaLQbvN_9W off=13111913 len=938430 2024-01-13T18:21:18.308 INFO:tasks.workunit.client.0.smithi084.stdout:op 63 completed, throughput=4.97MB/sec 2024-01-13T18:21:18.308 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Fufc_CkYtfm3Z5b off=15785789 len=631999 2024-01-13T18:21:18.312 INFO:tasks.workunit.client.0.smithi084.stdout:op 64 completed, throughput=5.01MB/sec 2024-01-13T18:21:19.312 INFO:tasks.workunit.client.0.smithi084.stdout: 15: throughput=4.68MB/sec pending data=0 2024-01-13T18:21:19.313 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BJZX8GoZYT1W0yY off=15494189 len=1990222 2024-01-13T18:21:19.323 INFO:tasks.workunit.client.0.smithi084.stdout:op 65 completed, throughput=4.8MB/sec 2024-01-13T18:21:19.323 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6Xzr2xlXYMlPMvH off=7410724 len=337243 2024-01-13T18:21:19.326 INFO:tasks.workunit.client.0.smithi084.stdout:op 66 completed, throughput=4.82MB/sec 2024-01-13T18:21:19.326 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ltSDusqVk7a2ArP off=7240475 len=940674 2024-01-13T18:21:19.327 INFO:tasks.workunit.client.0.smithi084.stdout:op 67 completed, throughput=4.88MB/sec 2024-01-13T18:21:19.327 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BU-2yZpIZsq1hZx off=2465920 len=1953236 2024-01-13T18:21:19.328 INFO:tasks.workunit.client.0.smithi084.stdout:op 68 completed, throughput=5MB/sec 2024-01-13T18:21:19.329 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wjF6fOwg8iPjphl off=72783 len=1606051 2024-01-13T18:21:19.337 INFO:tasks.workunit.client.0.smithi084.stdout:op 69 completed, throughput=5.1MB/sec 2024-01-13T18:21:19.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:19 smithi084 ceph-mon[116404]: pgmap v1485: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 279 op/s 2024-01-13T18:21:19.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:19 smithi084 ceph-mon[119097]: pgmap v1485: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 279 op/s 2024-01-13T18:21:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:19 smithi099 ceph-mon[138788]: pgmap v1485: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 279 op/s 2024-01-13T18:21:20.338 INFO:tasks.workunit.client.0.smithi084.stdout: 16: throughput=4.78MB/sec pending data=0 2024-01-13T18:21:20.338 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0rUT--ddAIEUx11 off=9972175 len=1929040 2024-01-13T18:21:20.344 INFO:tasks.workunit.client.0.smithi084.stdout:op 70 completed, throughput=4.89MB/sec 2024-01-13T18:21:20.344 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kWuIYcm97-z-nCU off=8130327 len=1267700 2024-01-13T18:21:20.348 INFO:tasks.workunit.client.0.smithi084.stdout:op 71 completed, throughput=4.97MB/sec 2024-01-13T18:21:20.348 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xf0Qw4dzJUyvf50 off=823773 len=1117304 2024-01-13T18:21:20.353 INFO:tasks.workunit.client.0.smithi084.stdout:op 72 completed, throughput=5.03MB/sec 2024-01-13T18:21:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:21:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:20.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:21:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:21:20] "GET /metrics HTTP/1.1" 200 33975 "" "Prometheus/2.43.0" 2024-01-13T18:21:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:21:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:21:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:21.353 INFO:tasks.workunit.client.0.smithi084.stdout: 17: throughput=4.74MB/sec pending data=0 2024-01-13T18:21:21.353 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-j7Rbt_5y4cXH0Ya off=4318221 len=1106715 2024-01-13T18:21:21.356 INFO:tasks.workunit.client.0.smithi084.stdout:op 73 completed, throughput=4.8MB/sec 2024-01-13T18:21:21.356 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lLpvGWUajL4hc7g off=13242834 len=1176032 2024-01-13T18:21:21.360 INFO:tasks.workunit.client.0.smithi084.stdout:op 74 completed, throughput=4.86MB/sec 2024-01-13T18:21:21.360 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SwnOvGPY8IBPn1y off=484108 len=1357120 2024-01-13T18:21:21.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 75 completed, throughput=4.94MB/sec 2024-01-13T18:21:21.361 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ePE_UKiHOYpah6A off=10372217 len=1532239 2024-01-13T18:21:21.363 INFO:tasks.workunit.client.0.smithi084.stdout:op 76 completed, throughput=5.02MB/sec 2024-01-13T18:21:21.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:21:21.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:21:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:21:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:21 smithi084 ceph-mon[116404]: pgmap v1486: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2024-01-13T18:21:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:21:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:21:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:21:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:21 smithi084 ceph-mon[119097]: pgmap v1486: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2024-01-13T18:21:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:21:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:21:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:21:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:21 smithi099 ceph-mon[138788]: pgmap v1486: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2024-01-13T18:21:22.363 INFO:tasks.workunit.client.0.smithi084.stdout: 18: throughput=4.75MB/sec pending data=0 2024-01-13T18:21:22.363 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VHJQO2obs5qzHoz off=6599526 len=497641 2024-01-13T18:21:22.367 INFO:tasks.workunit.client.0.smithi084.stdout:op 77 completed, throughput=4.77MB/sec 2024-01-13T18:21:22.367 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IYb4WhsBmJUodgh off=893391 len=393127 2024-01-13T18:21:22.368 INFO:tasks.workunit.client.0.smithi084.stdout:op 78 completed, throughput=4.79MB/sec 2024-01-13T18:21:22.368 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mHj6xALwYnfadsP off=3263902 len=2035829 2024-01-13T18:21:22.371 INFO:tasks.workunit.client.0.smithi084.stdout:op 79 completed, throughput=4.9MB/sec 2024-01-13T18:21:22.371 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Udl1LwYR-gt7ZgP off=2952362 len=258710 2024-01-13T18:21:22.374 INFO:tasks.workunit.client.0.smithi084.stdout:op 80 completed, throughput=4.91MB/sec 2024-01-13T18:21:22.374 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FL0GuLpeV01NT4E off=15569741 len=329405 2024-01-13T18:21:22.377 INFO:tasks.workunit.client.0.smithi084.stdout:op 81 completed, throughput=4.93MB/sec 2024-01-13T18:21:22.377 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qImx6MUnQe5qHb1 off=10220540 len=337227 2024-01-13T18:21:22.379 INFO:tasks.workunit.client.0.smithi084.stdout:op 82 completed, throughput=4.94MB/sec 2024-01-13T18:21:22.379 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AV2oB_DA_vs87Am off=1168853 len=630692 2024-01-13T18:21:22.382 INFO:tasks.workunit.client.0.smithi084.stdout:op 83 completed, throughput=4.98MB/sec 2024-01-13T18:21:22.382 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZuED0jX4vjA2L5m off=16135550 len=940465 2024-01-13T18:21:22.386 INFO:tasks.workunit.client.0.smithi084.stdout:op 84 completed, throughput=5.02MB/sec 2024-01-13T18:21:23.387 INFO:tasks.workunit.client.0.smithi084.stdout: 19: throughput=4.76MB/sec pending data=0 2024-01-13T18:21:23.387 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-03Ue39QKZA0uGk8 off=4212545 len=432504 2024-01-13T18:21:23.390 INFO:tasks.workunit.client.0.smithi084.stdout:op 85 completed, throughput=4.79MB/sec 2024-01-13T18:21:23.390 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MEAWpYLm090WmI8 off=2906084 len=1889473 2024-01-13T18:21:23.400 INFO:tasks.workunit.client.0.smithi084.stdout:op 86 completed, throughput=4.88MB/sec 2024-01-13T18:21:23.400 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-51jwo2sOR3Fd95a off=2007046 len=1387882 2024-01-13T18:21:23.408 INFO:tasks.workunit.client.0.smithi084.stdout:op 87 completed, throughput=4.94MB/sec 2024-01-13T18:21:23.408 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y0IDAKY9hFPwOsS off=75476 len=110209 2024-01-13T18:21:23.408 INFO:tasks.workunit.client.0.smithi084.stdout:op 88 completed, throughput=4.95MB/sec 2024-01-13T18:21:23.408 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oNVMjXa3sg1vGB- off=8703720 len=1428583 2024-01-13T18:21:23.413 INFO:tasks.workunit.client.0.smithi084.stdout:op 89 completed, throughput=5.02MB/sec 2024-01-13T18:21:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:23 smithi099 ceph-mon[138788]: pgmap v1487: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 3 op/s 2024-01-13T18:21:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:23 smithi084 ceph-mon[116404]: pgmap v1487: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 3 op/s 2024-01-13T18:21:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:23 smithi084 ceph-mon[119097]: pgmap v1487: 105 pgs: 105 active+clean; 128 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 3 op/s 2024-01-13T18:21:24.415 INFO:tasks.workunit.client.0.smithi084.stdout: 20: throughput=4.77MB/sec pending data=0 2024-01-13T18:21:24.415 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9NNkPe2bsN2KSk7 off=11287466 len=2086011 2024-01-13T18:21:24.424 INFO:tasks.workunit.client.0.smithi084.stdout:op 90 completed, throughput=4.87MB/sec 2024-01-13T18:21:24.424 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ESr9_kYQ0EE2Xsh off=0 len=1686430 2024-01-13T18:21:24.427 INFO:tasks.workunit.client.0.smithi084.stdout:op 91 completed, throughput=4.94MB/sec 2024-01-13T18:21:24.428 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nmQAQl0uGuc1oCF off=16662396 len=247178 2024-01-13T18:21:24.428 INFO:tasks.workunit.client.0.smithi084.stdout:op 92 completed, throughput=4.95MB/sec 2024-01-13T18:21:24.428 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mqs_4ldy5RtBmHr off=9410794 len=1080790 2024-01-13T18:21:24.430 INFO:tasks.workunit.client.0.smithi084.stdout:op 93 completed, throughput=5MB/sec 2024-01-13T18:21:25.431 INFO:tasks.workunit.client.0.smithi084.stdout: 21: throughput=4.77MB/sec pending data=0 2024-01-13T18:21:25.431 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DhzJySoFYhTI8Ff off=3385340 len=1677689 2024-01-13T18:21:25.439 INFO:tasks.workunit.client.0.smithi084.stdout:op 94 completed, throughput=4.84MB/sec 2024-01-13T18:21:25.440 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-A1lchYCgqZUNKWS off=569568 len=517401 2024-01-13T18:21:25.440 INFO:tasks.workunit.client.0.smithi084.stdout:op 95 completed, throughput=4.87MB/sec 2024-01-13T18:21:25.441 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Geq2d9wCfXJ8DhR off=8646610 len=1193096 2024-01-13T18:21:25.442 INFO:tasks.workunit.client.0.smithi084.stdout:op 96 completed, throughput=4.92MB/sec 2024-01-13T18:21:25.442 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YSC3ZzBieOvG5o2 off=9836578 len=110778 2024-01-13T18:21:25.443 INFO:tasks.workunit.client.0.smithi084.stdout:op 97 completed, throughput=4.92MB/sec 2024-01-13T18:21:25.443 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-B7hUrZYrA9aHJm1 off=4204090 len=172371 2024-01-13T18:21:25.444 INFO:tasks.workunit.client.0.smithi084.stdout:op 98 completed, throughput=4.93MB/sec 2024-01-13T18:21:25.444 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zrQOZXp1HXKdm4T off=17155896 len=10877 2024-01-13T18:21:25.444 INFO:tasks.workunit.client.0.smithi084.stdout:op 99 completed, throughput=4.93MB/sec 2024-01-13T18:21:25.444 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AdZYzYcwdFBGP-X off=7011584 len=1711112 2024-01-13T18:21:25.454 INFO:tasks.workunit.client.0.smithi084.stdout:op 100 completed, throughput=5.01MB/sec 2024-01-13T18:21:25.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:25 smithi099 ceph-mon[138788]: pgmap v1488: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:21:25.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:25 smithi084 ceph-mon[116404]: pgmap v1488: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:21:25.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:25 smithi084 ceph-mon[119097]: pgmap v1488: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:21:26.455 INFO:tasks.workunit.client.0.smithi084.stdout: 22: throughput=4.78MB/sec pending data=0 2024-01-13T18:21:26.456 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-D4GfG2c9CrMmxtp off=18062922 len=249929 2024-01-13T18:21:26.456 INFO:tasks.workunit.client.0.smithi084.stdout:op 101 completed, throughput=4.79MB/sec 2024-01-13T18:21:26.456 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yHkmloslxvYeNhw off=5511913 len=378096 2024-01-13T18:21:26.456 INFO:tasks.workunit.client.0.smithi084.stdout:op 102 completed, throughput=4.81MB/sec 2024-01-13T18:21:26.457 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-J-mSvkkTzB4oRkX off=9320781 len=158345 2024-01-13T18:21:26.457 INFO:tasks.workunit.client.0.smithi084.stdout:op 103 completed, throughput=4.82MB/sec 2024-01-13T18:21:26.457 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YXhwXMSf5LQtW6C off=10823764 len=164847 2024-01-13T18:21:26.458 INFO:tasks.workunit.client.0.smithi084.stdout:op 104 completed, throughput=4.82MB/sec 2024-01-13T18:21:26.458 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QRUvN-U2FLjR0wM off=17757711 len=1726556 2024-01-13T18:21:26.467 INFO:tasks.workunit.client.0.smithi084.stdout:op 105 completed, throughput=4.89MB/sec 2024-01-13T18:21:26.467 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wt3wybpCcbj5iiv off=5489960 len=2035813 2024-01-13T18:21:26.470 INFO:tasks.workunit.client.0.smithi084.stdout:op 106 completed, throughput=4.98MB/sec 2024-01-13T18:21:26.471 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L32tPMQwbcI_m5C off=3167610 len=551696 2024-01-13T18:21:26.471 INFO:tasks.workunit.client.0.smithi084.stdout:op 107 completed, throughput=5MB/sec 2024-01-13T18:21:27.472 INFO:tasks.workunit.client.0.smithi084.stdout: 23: throughput=4.79MB/sec pending data=0 2024-01-13T18:21:27.472 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3ummY6Sj_s-64mB off=9321305 len=1954012 2024-01-13T18:21:27.482 INFO:tasks.workunit.client.0.smithi084.stdout:op 108 completed, throughput=4.87MB/sec 2024-01-13T18:21:27.482 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rJDFT2mBL-F_V5A off=755055 len=129625 2024-01-13T18:21:27.485 INFO:tasks.workunit.client.0.smithi084.stdout:op 109 completed, throughput=4.87MB/sec 2024-01-13T18:21:27.485 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6dpfDopz9w7-bmK off=12203663 len=37895 2024-01-13T18:21:27.485 INFO:tasks.workunit.client.0.smithi084.stdout:op 110 completed, throughput=4.87MB/sec 2024-01-13T18:21:27.486 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ejvQdRuhPPvIFR9 off=4215399 len=1668963 2024-01-13T18:21:27.487 INFO:tasks.workunit.client.0.smithi084.stdout:op 111 completed, throughput=4.94MB/sec 2024-01-13T18:21:27.487 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-f3bX42z3xkdmtxx off=1182810 len=83751 2024-01-13T18:21:27.490 INFO:tasks.workunit.client.0.smithi084.stdout:op 112 completed, throughput=4.94MB/sec 2024-01-13T18:21:27.490 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oEeAXwcz1e85pj1 off=1204746 len=703458 2024-01-13T18:21:27.491 INFO:tasks.workunit.client.0.smithi084.stdout:op 113 completed, throughput=4.97MB/sec 2024-01-13T18:21:27.491 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XbQrUMQyN_YVO67 off=16447905 len=2013163 2024-01-13T18:21:27.493 INFO:tasks.workunit.client.0.smithi084.stdout:op 114 completed, throughput=5.05MB/sec 2024-01-13T18:21:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:27 smithi099 ceph-mon[138788]: pgmap v1489: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:21:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:27 smithi084 ceph-mon[116404]: pgmap v1489: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:21:27.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:27 smithi084 ceph-mon[119097]: pgmap v1489: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:21:28.493 INFO:tasks.workunit.client.0.smithi084.stdout: 24: throughput=4.85MB/sec pending data=0 2024-01-13T18:21:28.493 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uSLSrHO5Wb_x5o- off=7124167 len=688970 2024-01-13T18:21:28.498 INFO:tasks.workunit.client.0.smithi084.stdout:op 115 completed, throughput=4.87MB/sec 2024-01-13T18:21:28.498 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YuoSot4vlJVX8Ku off=3964870 len=1546133 2024-01-13T18:21:28.504 INFO:tasks.workunit.client.0.smithi084.stdout:op 116 completed, throughput=4.93MB/sec 2024-01-13T18:21:28.504 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RxW_-X7tPAzzClA off=8103208 len=447929 2024-01-13T18:21:28.505 INFO:tasks.workunit.client.0.smithi084.stdout:op 117 completed, throughput=4.95MB/sec 2024-01-13T18:21:28.505 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M8lxnIrshfAbD1n off=1848076 len=875013 2024-01-13T18:21:28.506 INFO:tasks.workunit.client.0.smithi084.stdout:op 118 completed, throughput=4.98MB/sec 2024-01-13T18:21:28.506 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PnuVhitkaaA3oKe off=8391481 len=1520694 2024-01-13T18:21:28.509 INFO:tasks.workunit.client.0.smithi084.stdout:op 119 completed, throughput=5.04MB/sec 2024-01-13T18:21:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:29 smithi084 ceph-mon[116404]: pgmap v1490: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:29.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:29 smithi084 ceph-mon[119097]: pgmap v1490: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:29.509 INFO:tasks.workunit.client.0.smithi084.stdout: 25: throughput=4.84MB/sec pending data=0 2024-01-13T18:21:29.510 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-89jUeXqDsK1H1Bn off=762431 len=853902 2024-01-13T18:21:29.511 INFO:tasks.workunit.client.0.smithi084.stdout:op 120 completed, throughput=4.87MB/sec 2024-01-13T18:21:29.511 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eNBT1LTy5QpIGnA off=14635566 len=204762 2024-01-13T18:21:29.512 INFO:tasks.workunit.client.0.smithi084.stdout:op 121 completed, throughput=4.88MB/sec 2024-01-13T18:21:29.512 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wYsMP68_4Knv8PT off=3164837 len=669805 2024-01-13T18:21:29.513 INFO:tasks.workunit.client.0.smithi084.stdout:op 122 completed, throughput=4.91MB/sec 2024-01-13T18:21:29.513 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EwrjmMewCjlfUkJ off=240558 len=815208 2024-01-13T18:21:29.518 INFO:tasks.workunit.client.0.smithi084.stdout:op 123 completed, throughput=4.94MB/sec 2024-01-13T18:21:29.518 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mBfPtYQaCdwC_B_ off=12548458 len=1807636 2024-01-13T18:21:29.530 INFO:tasks.workunit.client.0.smithi084.stdout:op 124 completed, throughput=5MB/sec 2024-01-13T18:21:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:29 smithi099 ceph-mon[138788]: pgmap v1490: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:30.530 INFO:tasks.workunit.client.0.smithi084.stdout: 26: throughput=4.81MB/sec pending data=0 2024-01-13T18:21:30.530 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-10BPqJKyi2Y7nEi off=10866994 len=1564320 2024-01-13T18:21:30.536 INFO:tasks.workunit.client.0.smithi084.stdout:op 125 completed, throughput=4.87MB/sec 2024-01-13T18:21:30.537 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fBNI5m9dw2ScXaM off=2200482 len=340193 2024-01-13T18:21:30.538 INFO:tasks.workunit.client.0.smithi084.stdout:op 126 completed, throughput=4.88MB/sec 2024-01-13T18:21:30.538 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rVOErN96j-8NQ3e off=9572098 len=1362352 2024-01-13T18:21:30.540 INFO:tasks.workunit.client.0.smithi084.stdout:op 127 completed, throughput=4.93MB/sec 2024-01-13T18:21:30.540 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bLzGv1-AY_hemV4 off=6831035 len=807626 2024-01-13T18:21:30.540 INFO:tasks.workunit.client.0.smithi084.stdout:op 128 completed, throughput=4.96MB/sec 2024-01-13T18:21:30.540 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4L0hO1L761-j8kK off=4890776 len=58885 2024-01-13T18:21:30.541 INFO:tasks.workunit.client.0.smithi084.stdout:op 129 completed, throughput=4.96MB/sec 2024-01-13T18:21:30.541 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MBj5DwgrFKCpn6u off=2352063 len=1908664 2024-01-13T18:21:30.550 INFO:tasks.workunit.client.0.smithi084.stdout:op 130 completed, throughput=5.03MB/sec 2024-01-13T18:21:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:21:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:21:30] "GET /metrics HTTP/1.1" 200 33975 "" "Prometheus/2.43.0" 2024-01-13T18:21:31.551 INFO:tasks.workunit.client.0.smithi084.stdout: 27: throughput=4.84MB/sec pending data=0 2024-01-13T18:21:31.551 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hjBfVLjhrKzIbFf off=5844449 len=2051689 2024-01-13T18:21:31.553 INFO:tasks.workunit.client.0.smithi084.stdout:op 131 completed, throughput=4.91MB/sec 2024-01-13T18:21:31.554 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PkDxJOtrZgCHw7n off=2462775 len=1134383 2024-01-13T18:21:31.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 132 completed, throughput=4.95MB/sec 2024-01-13T18:21:31.559 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AAG87iqymqNLbzn off=537622 len=1185209 2024-01-13T18:21:31.566 INFO:tasks.workunit.client.0.smithi084.stdout:op 133 completed, throughput=4.99MB/sec 2024-01-13T18:21:31.566 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fHzGq8w1nt4KwaL off=1452671 len=138546 2024-01-13T18:21:31.569 INFO:tasks.workunit.client.0.smithi084.stdout:op 134 completed, throughput=5MB/sec 2024-01-13T18:21:31.569 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aXoe99xIuF3Gd4B off=13642895 len=947587 2024-01-13T18:21:31.573 INFO:tasks.workunit.client.0.smithi084.stdout:op 135 completed, throughput=5.03MB/sec 2024-01-13T18:21:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:31 smithi099 ceph-mon[138788]: pgmap v1491: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:21:31.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:31 smithi084 ceph-mon[116404]: pgmap v1491: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:21:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:31 smithi084 ceph-mon[119097]: pgmap v1491: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:21:32.574 INFO:tasks.workunit.client.0.smithi084.stdout: 28: throughput=4.85MB/sec pending data=0 2024-01-13T18:21:32.574 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Qtv4Q6RAU4jX1AH off=2513543 len=1693442 2024-01-13T18:21:32.575 INFO:tasks.workunit.client.0.smithi084.stdout:op 136 completed, throughput=4.91MB/sec 2024-01-13T18:21:32.576 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DlswqUPBzLIJYdw off=9448041 len=45942 2024-01-13T18:21:32.576 INFO:tasks.workunit.client.0.smithi084.stdout:op 137 completed, throughput=4.91MB/sec 2024-01-13T18:21:32.576 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_C9GTgs9o1-IZI2 off=9478973 len=1569411 2024-01-13T18:21:32.583 INFO:tasks.workunit.client.0.smithi084.stdout:op 138 completed, throughput=4.96MB/sec 2024-01-13T18:21:32.583 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6cLIkQiktJ2i3OK off=14585249 len=1011687 2024-01-13T18:21:32.588 INFO:tasks.workunit.client.0.smithi084.stdout:op 139 completed, throughput=4.99MB/sec 2024-01-13T18:21:32.588 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qk6MSBG5uZwaWMe off=3038527 len=932670 2024-01-13T18:21:32.591 INFO:tasks.workunit.client.0.smithi084.stdout:op 140 completed, throughput=5.02MB/sec 2024-01-13T18:21:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: 29: throughput=4.85MB/sec pending data=0 2024-01-13T18:21:33.592 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Uo6ZyUbQ2tviQFr off=5024836 len=244374 2024-01-13T18:21:33.595 INFO:tasks.workunit.client.0.smithi084.stdout:op 141 completed, throughput=4.86MB/sec 2024-01-13T18:21:33.595 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8iwJhnyZyGM4eho off=758844 len=510124 2024-01-13T18:21:33.598 INFO:tasks.workunit.client.0.smithi084.stdout:op 142 completed, throughput=4.88MB/sec 2024-01-13T18:21:33.599 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sMo3hA4R3qgcyR2 off=958875 len=2087578 2024-01-13T18:21:33.610 INFO:tasks.workunit.client.0.smithi084.stdout:op 143 completed, throughput=4.94MB/sec 2024-01-13T18:21:33.610 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BFQ-v9yPx6dR1Os off=3223598 len=748177 2024-01-13T18:21:33.611 INFO:tasks.workunit.client.0.smithi084.stdout:op 144 completed, throughput=4.97MB/sec 2024-01-13T18:21:33.611 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hd_vNU6HSAyS-rN off=2437508 len=1570142 2024-01-13T18:21:33.617 INFO:tasks.workunit.client.0.smithi084.stdout:op 145 completed, throughput=5.02MB/sec 2024-01-13T18:21:33.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:33 smithi099 ceph-mon[138788]: pgmap v1492: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:21:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:33 smithi084 ceph-mon[116404]: pgmap v1492: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:21:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:33 smithi084 ceph-mon[119097]: pgmap v1492: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:21:34.618 INFO:tasks.workunit.client.0.smithi084.stdout: 30: throughput=4.85MB/sec pending data=0 2024-01-13T18:21:34.618 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lN1VJW83RIkzjEe off=23243744 len=2038647 2024-01-13T18:21:34.627 INFO:tasks.workunit.client.0.smithi084.stdout:op 146 completed, throughput=4.91MB/sec 2024-01-13T18:21:34.627 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jC5RWi7Q2D-iVt5 off=2537941 len=314141 2024-01-13T18:21:34.627 INFO:tasks.workunit.client.0.smithi084.stdout:op 147 completed, throughput=4.92MB/sec 2024-01-13T18:21:34.628 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PYDFgTAsmRWyDLO off=7756182 len=791490 2024-01-13T18:21:34.629 INFO:tasks.workunit.client.0.smithi084.stdout:op 148 completed, throughput=4.95MB/sec 2024-01-13T18:21:34.629 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y-ODv7t38gecEcZ off=8026610 len=1485262 2024-01-13T18:21:34.632 INFO:tasks.workunit.client.0.smithi084.stdout:op 149 completed, throughput=4.99MB/sec 2024-01-13T18:21:34.632 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2o8NutitucQQQ9e off=1422304 len=1833910 2024-01-13T18:21:34.633 INFO:tasks.workunit.client.0.smithi084.stdout:op 150 completed, throughput=5.05MB/sec 2024-01-13T18:21:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:35 smithi099 ceph-mon[138788]: pgmap v1493: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:21:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:35.634 INFO:tasks.workunit.client.0.smithi084.stdout: 31: throughput=4.89MB/sec pending data=0 2024-01-13T18:21:35.634 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XN9KgYIw5xdeFK2 off=11658556 len=1285176 2024-01-13T18:21:35.640 INFO:tasks.workunit.client.0.smithi084.stdout:op 151 completed, throughput=4.93MB/sec 2024-01-13T18:21:35.641 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wnbtsTnY_q-dU_W off=258158 len=894064 2024-01-13T18:21:35.645 INFO:tasks.workunit.client.0.smithi084.stdout:op 152 completed, throughput=4.96MB/sec 2024-01-13T18:21:35.645 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MK_FU0Oz7Zs2RrD off=1071051 len=355027 2024-01-13T18:21:35.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 153 completed, throughput=4.97MB/sec 2024-01-13T18:21:35.646 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-P89r7aT72WdH2li off=15425315 len=1262022 2024-01-13T18:21:35.653 INFO:tasks.workunit.client.0.smithi084.stdout:op 154 completed, throughput=5MB/sec 2024-01-13T18:21:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:35 smithi084 ceph-mon[116404]: pgmap v1493: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:21:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:35 smithi084 ceph-mon[119097]: pgmap v1493: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:21:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:36.653 INFO:tasks.workunit.client.0.smithi084.stdout: 32: throughput=4.85MB/sec pending data=0 2024-01-13T18:21:36.653 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6pEsF_RDdecFgUD off=6935317 len=181201 2024-01-13T18:21:36.656 INFO:tasks.workunit.client.0.smithi084.stdout:op 155 completed, throughput=4.85MB/sec 2024-01-13T18:21:36.656 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--OsQotfaaF649yd off=704467 len=584999 2024-01-13T18:21:36.657 INFO:tasks.workunit.client.0.smithi084.stdout:op 156 completed, throughput=4.87MB/sec 2024-01-13T18:21:36.657 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DGzwtG_Wz3z1gWk off=3615743 len=2019608 2024-01-13T18:21:36.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 157 completed, throughput=4.93MB/sec 2024-01-13T18:21:36.660 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cKP7czTrO7bucem off=15223114 len=1444417 2024-01-13T18:21:36.667 INFO:tasks.workunit.client.0.smithi084.stdout:op 158 completed, throughput=4.97MB/sec 2024-01-13T18:21:36.667 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sqibw3AgXiIrv1S off=6238911 len=15665 2024-01-13T18:21:36.667 INFO:tasks.workunit.client.0.smithi084.stdout:op 159 completed, throughput=4.97MB/sec 2024-01-13T18:21:36.667 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y7xyc5JKn5ESz0B off=9701717 len=1541413 2024-01-13T18:21:36.671 INFO:tasks.workunit.client.0.smithi084.stdout:op 160 completed, throughput=5.02MB/sec 2024-01-13T18:21:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:37 smithi099 ceph-mon[138788]: pgmap v1494: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:21:37.672 INFO:tasks.workunit.client.0.smithi084.stdout: 33: throughput=4.87MB/sec pending data=0 2024-01-13T18:21:37.672 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-g0Dcpb4oPa6g8UC off=5682078 len=1099527 2024-01-13T18:21:37.677 INFO:tasks.workunit.client.0.smithi084.stdout:op 161 completed, throughput=4.9MB/sec 2024-01-13T18:21:37.677 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PVygJJn3DJC0xKA off=9180764 len=1817100 2024-01-13T18:21:37.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:37 smithi084 ceph-mon[119097]: pgmap v1494: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:21:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:37 smithi084 ceph-mon[116404]: pgmap v1494: 105 pgs: 105 active+clean; 128 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:21:37.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 162 completed, throughput=4.95MB/sec 2024-01-13T18:21:37.679 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uXaI2E6o3YqOmcN off=1986127 len=572039 2024-01-13T18:21:37.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 163 completed, throughput=4.96MB/sec 2024-01-13T18:21:37.679 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-diNtNVJVhpdr3Pk off=5584954 len=1363510 2024-01-13T18:21:37.682 INFO:tasks.workunit.client.0.smithi084.stdout:op 164 completed, throughput=5MB/sec 2024-01-13T18:21:38.683 INFO:tasks.workunit.client.0.smithi084.stdout: 34: throughput=4.86MB/sec pending data=0 2024-01-13T18:21:38.683 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Hkusq2stf9WYvHQ off=13623363 len=1440453 2024-01-13T18:21:38.689 INFO:tasks.workunit.client.0.smithi084.stdout:op 165 completed, throughput=4.9MB/sec 2024-01-13T18:21:38.689 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bZb1asUY-8kMvaM off=521949 len=1625401 2024-01-13T18:21:38.699 INFO:tasks.workunit.client.0.smithi084.stdout:op 166 completed, throughput=4.94MB/sec 2024-01-13T18:21:38.699 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vZaB1xrIU_X9x5f off=475016 len=244593 2024-01-13T18:21:38.701 INFO:tasks.workunit.client.0.smithi084.stdout:op 167 completed, throughput=4.95MB/sec 2024-01-13T18:21:38.702 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MUS9VehC75Bc6ki off=320217 len=1108684 2024-01-13T18:21:38.702 INFO:tasks.workunit.client.0.smithi084.stdout:op 168 completed, throughput=4.98MB/sec 2024-01-13T18:21:38.702 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5B7Mp6kGtpSrtv5 off=8299302 len=1454279 2024-01-13T18:21:38.708 INFO:tasks.workunit.client.0.smithi084.stdout:op 169 completed, throughput=5.02MB/sec 2024-01-13T18:21:39.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:39 smithi084 ceph-mon[116404]: pgmap v1495: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:21:39.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:39 smithi084 ceph-mon[119097]: pgmap v1495: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:21:39.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:39 smithi099 ceph-mon[138788]: pgmap v1495: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:21:39.709 INFO:tasks.workunit.client.0.smithi084.stdout: 35: throughput=4.88MB/sec pending data=0 2024-01-13T18:21:39.709 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6z13u6PeJ6RIqLz off=23088801 len=371106 2024-01-13T18:21:39.712 INFO:tasks.workunit.client.0.smithi084.stdout:op 170 completed, throughput=4.89MB/sec 2024-01-13T18:21:39.712 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-19zM1ipnHmnOv6B off=12936747 len=428877 2024-01-13T18:21:39.713 INFO:tasks.workunit.client.0.smithi084.stdout:op 171 completed, throughput=4.9MB/sec 2024-01-13T18:21:39.713 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-t9DXQhMCbYWw5GM off=3375509 len=1089864 2024-01-13T18:21:39.719 INFO:tasks.workunit.client.0.smithi084.stdout:op 172 completed, throughput=4.93MB/sec 2024-01-13T18:21:39.719 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NPs14wp_a5bY4W5 off=194886 len=1466682 2024-01-13T18:21:39.724 INFO:tasks.workunit.client.0.smithi084.stdout:op 173 completed, throughput=4.96MB/sec 2024-01-13T18:21:39.724 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CupTPrzI6oJXNMQ off=3756666 len=1998788 2024-01-13T18:21:39.726 INFO:tasks.workunit.client.0.smithi084.stdout:op 174 completed, throughput=5.02MB/sec 2024-01-13T18:21:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:21:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:21:40] "GET /metrics HTTP/1.1" 200 33976 "" "Prometheus/2.43.0" 2024-01-13T18:21:40.726 INFO:tasks.workunit.client.0.smithi084.stdout: 36: throughput=4.88MB/sec pending data=0 2024-01-13T18:21:40.726 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-g9bzq5UlvYOgoHj off=4222031 len=147961 2024-01-13T18:21:40.729 INFO:tasks.workunit.client.0.smithi084.stdout:op 175 completed, throughput=4.88MB/sec 2024-01-13T18:21:40.729 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-toI7ybLVZaBlNIr off=2941928 len=1745604 2024-01-13T18:21:40.739 INFO:tasks.workunit.client.0.smithi084.stdout:op 176 completed, throughput=4.93MB/sec 2024-01-13T18:21:40.739 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w1bnfFqoX-ymI3s off=2858760 len=464914 2024-01-13T18:21:40.740 INFO:tasks.workunit.client.0.smithi084.stdout:op 177 completed, throughput=4.94MB/sec 2024-01-13T18:21:40.740 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wT3qpWlisePN_k5 off=12748993 len=1645070 2024-01-13T18:21:40.742 INFO:tasks.workunit.client.0.smithi084.stdout:op 178 completed, throughput=4.98MB/sec 2024-01-13T18:21:40.742 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ctff-AQ0ArhnmVz off=6523987 len=1765798 2024-01-13T18:21:40.745 INFO:tasks.workunit.client.0.smithi084.stdout:op 179 completed, throughput=5.03MB/sec 2024-01-13T18:21:41.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:41 smithi099 ceph-mon[138788]: pgmap v1496: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:21:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:41 smithi084 ceph-mon[116404]: pgmap v1496: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:21:41.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:41 smithi084 ceph-mon[119097]: pgmap v1496: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:21:41.745 INFO:tasks.workunit.client.0.smithi084.stdout: 37: throughput=4.89MB/sec pending data=0 2024-01-13T18:21:41.746 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ob7cWdGqLBTvNrm off=5836515 len=1176856 2024-01-13T18:21:41.754 INFO:tasks.workunit.client.0.smithi084.stdout:op 180 completed, throughput=4.92MB/sec 2024-01-13T18:21:41.754 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-l1j2miSa9XtNvXi off=2570523 len=1301994 2024-01-13T18:21:41.761 INFO:tasks.workunit.client.0.smithi084.stdout:op 181 completed, throughput=4.95MB/sec 2024-01-13T18:21:41.761 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tJD2u4US6CNtL6w off=7170272 len=1019151 2024-01-13T18:21:41.765 INFO:tasks.workunit.client.0.smithi084.stdout:op 182 completed, throughput=4.98MB/sec 2024-01-13T18:21:41.765 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1xfQYJwKPUpO0RF off=15496959 len=641837 2024-01-13T18:21:41.769 INFO:tasks.workunit.client.0.smithi084.stdout:op 183 completed, throughput=5MB/sec 2024-01-13T18:21:41.770 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7PXdioRhThP9BvA off=2777226 len=1043939 2024-01-13T18:21:41.774 INFO:tasks.workunit.client.0.smithi084.stdout:op 184 completed, throughput=5.02MB/sec 2024-01-13T18:21:42.774 INFO:tasks.workunit.client.0.smithi084.stdout: 38: throughput=4.89MB/sec pending data=0 2024-01-13T18:21:42.775 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zDXs7ZSZoX0WIbg off=8296707 len=1775372 2024-01-13T18:21:42.786 INFO:tasks.workunit.client.0.smithi084.stdout:op 185 completed, throughput=4.93MB/sec 2024-01-13T18:21:42.786 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LkUv1xqQF1kLqaH off=7371058 len=224685 2024-01-13T18:21:42.788 INFO:tasks.workunit.client.0.smithi084.stdout:op 186 completed, throughput=4.94MB/sec 2024-01-13T18:21:42.789 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-egLp9bAmtjwAAFC off=9035184 len=594344 2024-01-13T18:21:42.789 INFO:tasks.workunit.client.0.smithi084.stdout:op 187 completed, throughput=4.95MB/sec 2024-01-13T18:21:42.789 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-p_hZ9DHljVoK8GS off=5749492 len=1203631 2024-01-13T18:21:42.796 INFO:tasks.workunit.client.0.smithi084.stdout:op 188 completed, throughput=4.98MB/sec 2024-01-13T18:21:42.796 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mrEki7IL6f53sLy off=12050451 len=971243 2024-01-13T18:21:42.801 INFO:tasks.workunit.client.0.smithi084.stdout:op 189 completed, throughput=5.01MB/sec 2024-01-13T18:21:43.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:43 smithi099 ceph-mon[138788]: pgmap v1497: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:43.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:43 smithi084 ceph-mon[116404]: pgmap v1497: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:43.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:43 smithi084 ceph-mon[119097]: pgmap v1497: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:43.801 INFO:tasks.workunit.client.0.smithi084.stdout: 39: throughput=4.88MB/sec pending data=0 2024-01-13T18:21:43.802 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uHjtgWD-oh5Qoc- off=7387462 len=945142 2024-01-13T18:21:43.803 INFO:tasks.workunit.client.0.smithi084.stdout:op 190 completed, throughput=4.9MB/sec 2024-01-13T18:21:43.803 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KW6phGBcOWLchew off=16090232 len=1634213 2024-01-13T18:21:43.805 INFO:tasks.workunit.client.0.smithi084.stdout:op 191 completed, throughput=4.94MB/sec 2024-01-13T18:21:43.805 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BaOKez2ZSa2F8x8 off=0 len=1107739 2024-01-13T18:21:43.806 INFO:tasks.workunit.client.0.smithi084.stdout:op 192 completed, throughput=4.97MB/sec 2024-01-13T18:21:43.806 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FN9xUbC6rsUDf4d off=14175201 len=544300 2024-01-13T18:21:43.810 INFO:tasks.workunit.client.0.smithi084.stdout:op 193 completed, throughput=4.98MB/sec 2024-01-13T18:21:43.810 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lgeYAlrCv07nac5 off=17974738 len=1745018 2024-01-13T18:21:43.820 INFO:tasks.workunit.client.0.smithi084.stdout:op 194 completed, throughput=5.02MB/sec 2024-01-13T18:21:44.820 INFO:tasks.workunit.client.0.smithi084.stdout: 40: throughput=4.9MB/sec pending data=0 2024-01-13T18:21:44.820 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FO2deM7ZzIKqueV off=3016373 len=854049 2024-01-13T18:21:44.822 INFO:tasks.workunit.client.0.smithi084.stdout:op 195 completed, throughput=4.92MB/sec 2024-01-13T18:21:44.822 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AuHzYql9pVJ-_r6 off=7698992 len=699714 2024-01-13T18:21:44.826 INFO:tasks.workunit.client.0.smithi084.stdout:op 196 completed, throughput=4.93MB/sec 2024-01-13T18:21:44.826 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JWwR_G6zMXv7L8d off=4011891 len=170661 2024-01-13T18:21:44.827 INFO:tasks.workunit.client.0.smithi084.stdout:op 197 completed, throughput=4.94MB/sec 2024-01-13T18:21:44.827 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Mh_j2OP4BxkWi9b off=1841930 len=90078 2024-01-13T18:21:44.827 INFO:tasks.workunit.client.0.smithi084.stdout:op 198 completed, throughput=4.94MB/sec 2024-01-13T18:21:44.827 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MOTsUjE5G5u30Ax off=10092365 len=1584932 2024-01-13T18:21:44.833 INFO:tasks.workunit.client.0.smithi084.stdout:op 199 completed, throughput=4.98MB/sec 2024-01-13T18:21:44.834 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qEq7wP6P2tiJjdR off=5932233 len=1911819 2024-01-13T18:21:44.845 INFO:tasks.workunit.client.0.smithi084.stdout:op 200 completed, throughput=5.02MB/sec 2024-01-13T18:21:45.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:45 smithi099 ceph-mon[138788]: pgmap v1498: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:21:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:45 smithi084 ceph-mon[116404]: pgmap v1498: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:21:45.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:45 smithi084 ceph-mon[119097]: pgmap v1498: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:21:45.846 INFO:tasks.workunit.client.0.smithi084.stdout: 41: throughput=4.9MB/sec pending data=0 2024-01-13T18:21:45.846 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fwJJZIYk2z7dmhP off=5254620 len=643689 2024-01-13T18:21:45.850 INFO:tasks.workunit.client.0.smithi084.stdout:op 201 completed, throughput=4.91MB/sec 2024-01-13T18:21:45.850 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V8ybL_TfIxt4uga off=1420016 len=1684670 2024-01-13T18:21:45.854 INFO:tasks.workunit.client.0.smithi084.stdout:op 202 completed, throughput=4.95MB/sec 2024-01-13T18:21:45.855 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6PnaFuq4E-9_l4q off=13832960 len=130398 2024-01-13T18:21:45.855 INFO:tasks.workunit.client.0.smithi084.stdout:op 203 completed, throughput=4.95MB/sec 2024-01-13T18:21:45.855 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GNiYJ1QeP3rV-2h off=802502 len=39964 2024-01-13T18:21:45.857 INFO:tasks.workunit.client.0.smithi084.stdout:op 204 completed, throughput=4.95MB/sec 2024-01-13T18:21:45.857 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WbaiuodvqgCu9EX off=269757 len=25875 2024-01-13T18:21:45.859 INFO:tasks.workunit.client.0.smithi084.stdout:op 205 completed, throughput=4.95MB/sec 2024-01-13T18:21:45.859 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N719XW4uN8SXkyR off=644247 len=949243 2024-01-13T18:21:45.860 INFO:tasks.workunit.client.0.smithi084.stdout:op 206 completed, throughput=4.98MB/sec 2024-01-13T18:21:45.860 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eaGjHC82nVtIj0A off=10333404 len=175805 2024-01-13T18:21:45.863 INFO:tasks.workunit.client.0.smithi084.stdout:op 207 completed, throughput=4.98MB/sec 2024-01-13T18:21:45.863 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JGg3_CsCkQe0M6l off=11815708 len=1174625 2024-01-13T18:21:45.865 INFO:tasks.workunit.client.0.smithi084.stdout:op 208 completed, throughput=5.01MB/sec 2024-01-13T18:21:46.865 INFO:tasks.workunit.client.0.smithi084.stdout: 42: throughput=4.89MB/sec pending data=0 2024-01-13T18:21:46.865 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e3nEz_5ctw85vfB off=14467040 len=1869807 2024-01-13T18:21:46.875 INFO:tasks.workunit.client.0.smithi084.stdout:op 209 completed, throughput=4.93MB/sec 2024-01-13T18:21:46.875 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TWUfF0DDLugB-1e off=9263918 len=989691 2024-01-13T18:21:46.876 INFO:tasks.workunit.client.0.smithi084.stdout:op 210 completed, throughput=4.95MB/sec 2024-01-13T18:21:46.876 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FzTdYblq6UROkSy off=3425603 len=1123698 2024-01-13T18:21:46.881 INFO:tasks.workunit.client.0.smithi084.stdout:op 211 completed, throughput=4.98MB/sec 2024-01-13T18:21:46.881 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7PMxy3yRgtM1HfD off=9297988 len=1992219 2024-01-13T18:21:46.885 INFO:tasks.workunit.client.0.smithi084.stdout:op 212 completed, throughput=5.02MB/sec 2024-01-13T18:21:47.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:47 smithi099 ceph-mon[138788]: pgmap v1499: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:47 smithi084 ceph-mon[116404]: pgmap v1499: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:47.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:47 smithi084 ceph-mon[119097]: pgmap v1499: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:47.885 INFO:tasks.workunit.client.0.smithi084.stdout: 43: throughput=4.91MB/sec pending data=0 2024-01-13T18:21:47.885 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_Q59L5Ab8IMogbW off=7487978 len=1536961 2024-01-13T18:21:47.894 INFO:tasks.workunit.client.0.smithi084.stdout:op 213 completed, throughput=4.94MB/sec 2024-01-13T18:21:47.894 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oDsFaxXpH4IShfG off=2949031 len=557427 2024-01-13T18:21:47.898 INFO:tasks.workunit.client.0.smithi084.stdout:op 214 completed, throughput=4.95MB/sec 2024-01-13T18:21:47.898 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VwFp63uMI-W4-yF off=1457580 len=1068394 2024-01-13T18:21:47.903 INFO:tasks.workunit.client.0.smithi084.stdout:op 215 completed, throughput=4.97MB/sec 2024-01-13T18:21:47.903 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4PS-iWtVTsxGBpB off=10330359 len=1574073 2024-01-13T18:21:47.912 INFO:tasks.workunit.client.0.smithi084.stdout:op 216 completed, throughput=5.01MB/sec 2024-01-13T18:21:48.913 INFO:tasks.workunit.client.0.smithi084.stdout: 44: throughput=4.89MB/sec pending data=0 2024-01-13T18:21:48.913 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Z0uPOQep9Wtbl6i off=5272680 len=1562428 2024-01-13T18:21:48.918 INFO:tasks.workunit.client.0.smithi084.stdout:op 217 completed, throughput=4.93MB/sec 2024-01-13T18:21:48.918 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-g0Dcpb4oPa6g8UC off=6930132 len=112047 2024-01-13T18:21:48.921 INFO:tasks.workunit.client.0.smithi084.stdout:op 218 completed, throughput=4.93MB/sec 2024-01-13T18:21:48.921 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mCpcBijG9iFj0GE off=108503 len=1523822 2024-01-13T18:21:48.929 INFO:tasks.workunit.client.0.smithi084.stdout:op 219 completed, throughput=4.96MB/sec 2024-01-13T18:21:48.929 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nIQd-LFepSSV23t off=16707362 len=1726945 2024-01-13T18:21:48.931 INFO:tasks.workunit.client.0.smithi084.stdout:op 220 completed, throughput=5MB/sec 2024-01-13T18:21:48.931 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EXyOB-gdddOOPY3 off=14130098 len=810040 2024-01-13T18:21:48.935 INFO:tasks.workunit.client.0.smithi084.stdout:op 221 completed, throughput=5.01MB/sec 2024-01-13T18:21:49.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:49 smithi084 ceph-mon[116404]: pgmap v1500: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:21:49.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:49 smithi084 ceph-mon[119097]: pgmap v1500: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:21:49.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:49 smithi099 ceph-mon[138788]: pgmap v1500: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:21:49.936 INFO:tasks.workunit.client.0.smithi084.stdout: 45: throughput=4.9MB/sec pending data=0 2024-01-13T18:21:49.936 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yqrcaGA2PF3JjrS off=6279573 len=892484 2024-01-13T18:21:49.937 INFO:tasks.workunit.client.0.smithi084.stdout:op 222 completed, throughput=4.92MB/sec 2024-01-13T18:21:49.937 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lU6elT-jH2HWQ-9 off=2483956 len=1225364 2024-01-13T18:21:49.943 INFO:tasks.workunit.client.0.smithi084.stdout:op 223 completed, throughput=4.95MB/sec 2024-01-13T18:21:49.943 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4STDFG5hxPdmJ-B off=2716691 len=1287508 2024-01-13T18:21:49.944 INFO:tasks.workunit.client.0.smithi084.stdout:op 224 completed, throughput=4.97MB/sec 2024-01-13T18:21:49.944 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8zQD3hP-ZUqhRyK off=13068386 len=1738914 2024-01-13T18:21:49.951 INFO:tasks.workunit.client.0.smithi084.stdout:op 225 completed, throughput=5.01MB/sec 2024-01-13T18:21:50.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:50.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:21:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:21:50] "GET /metrics HTTP/1.1" 200 33976 "" "Prometheus/2.43.0" 2024-01-13T18:21:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:21:50.951 INFO:tasks.workunit.client.0.smithi084.stdout: 46: throughput=4.9MB/sec pending data=0 2024-01-13T18:21:50.951 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n2xpYXKu4b8Q0uW off=14219314 len=1841095 2024-01-13T18:21:50.960 INFO:tasks.workunit.client.0.smithi084.stdout:op 226 completed, throughput=4.94MB/sec 2024-01-13T18:21:50.961 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NaQMCTUV3tjEurk off=1154516 len=498898 2024-01-13T18:21:50.963 INFO:tasks.workunit.client.0.smithi084.stdout:op 227 completed, throughput=4.95MB/sec 2024-01-13T18:21:50.963 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y0HYvckStMePIaT off=2117331 len=537964 2024-01-13T18:21:50.966 INFO:tasks.workunit.client.0.smithi084.stdout:op 228 completed, throughput=4.96MB/sec 2024-01-13T18:21:50.966 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GeEdN7r4TLSIlr4 off=5755444 len=81806 2024-01-13T18:21:50.968 INFO:tasks.workunit.client.0.smithi084.stdout:op 229 completed, throughput=4.96MB/sec 2024-01-13T18:21:50.969 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gQ1vvNsNmTuINx0 off=10143857 len=728784 2024-01-13T18:21:50.972 INFO:tasks.workunit.client.0.smithi084.stdout:op 230 completed, throughput=4.98MB/sec 2024-01-13T18:21:50.972 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nmyBtioPczXhgDj off=10755829 len=1352207 2024-01-13T18:21:50.980 INFO:tasks.workunit.client.0.smithi084.stdout:op 231 completed, throughput=5MB/sec 2024-01-13T18:21:51.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:51 smithi084 ceph-mon[116404]: pgmap v1501: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:21:51.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:51 smithi084 ceph-mon[119097]: pgmap v1501: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:21:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:51 smithi099 ceph-mon[138788]: pgmap v1501: 105 pgs: 105 active+clean; 128 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:21:51.980 INFO:tasks.workunit.client.0.smithi084.stdout: 47: throughput=4.9MB/sec pending data=0 2024-01-13T18:21:51.980 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dmN6bdmjUTHGlS2 off=3596883 len=50963 2024-01-13T18:21:51.981 INFO:tasks.workunit.client.0.smithi084.stdout:op 232 completed, throughput=4.9MB/sec 2024-01-13T18:21:51.981 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SBgnZw4n9IB192D off=12902428 len=1097416 2024-01-13T18:21:51.987 INFO:tasks.workunit.client.0.smithi084.stdout:op 233 completed, throughput=4.92MB/sec 2024-01-13T18:21:51.987 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EEL2OnVuNb7XXgN off=20820641 len=226995 2024-01-13T18:21:51.989 INFO:tasks.workunit.client.0.smithi084.stdout:op 234 completed, throughput=4.92MB/sec 2024-01-13T18:21:51.989 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cOiKJglV5gd99vW off=10666723 len=372467 2024-01-13T18:21:51.990 INFO:tasks.workunit.client.0.smithi084.stdout:op 235 completed, throughput=4.93MB/sec 2024-01-13T18:21:51.990 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4EmWJT9uG1alr2B off=1981619 len=137224 2024-01-13T18:21:51.993 INFO:tasks.workunit.client.0.smithi084.stdout:op 236 completed, throughput=4.93MB/sec 2024-01-13T18:21:51.993 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7rNFm8JdEsSelEW off=2305053 len=576437 2024-01-13T18:21:51.994 INFO:tasks.workunit.client.0.smithi084.stdout:op 237 completed, throughput=4.95MB/sec 2024-01-13T18:21:51.994 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-paAhLIbgkPyD2hs off=1516294 len=1091970 2024-01-13T18:21:51.996 INFO:tasks.workunit.client.0.smithi084.stdout:op 238 completed, throughput=4.97MB/sec 2024-01-13T18:21:51.997 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AjmoZWxRhM1_u3r off=4529329 len=1690933 2024-01-13T18:21:51.998 INFO:tasks.workunit.client.0.smithi084.stdout:op 239 completed, throughput=5MB/sec 2024-01-13T18:21:51.998 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hJ1RvwROPoRZPFR off=570190 len=1371102 2024-01-13T18:21:52.001 INFO:tasks.workunit.client.0.smithi084.stdout:op 240 completed, throughput=5.03MB/sec 2024-01-13T18:21:53.001 INFO:tasks.workunit.client.0.smithi084.stdout: 48: throughput=4.92MB/sec pending data=0 2024-01-13T18:21:53.001 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pdgF_rcGAh7nKcU off=760921 len=603337 2024-01-13T18:21:53.005 INFO:tasks.workunit.client.0.smithi084.stdout:op 241 completed, throughput=4.94MB/sec 2024-01-13T18:21:53.005 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xiIRscOmPyUI_uh off=8869349 len=451683 2024-01-13T18:21:53.006 INFO:tasks.workunit.client.0.smithi084.stdout:op 242 completed, throughput=4.94MB/sec 2024-01-13T18:21:53.006 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GO4d_3h3mCYWjFO off=16236714 len=1450437 2024-01-13T18:21:53.014 INFO:tasks.workunit.client.0.smithi084.stdout:op 243 completed, throughput=4.97MB/sec 2024-01-13T18:21:53.014 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wwmuZXZn0At8FyU off=6531 len=288014 2024-01-13T18:21:53.016 INFO:tasks.workunit.client.0.smithi084.stdout:op 244 completed, throughput=4.98MB/sec 2024-01-13T18:21:53.016 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-J9FzTTXUlnzJJRi off=7971886 len=405266 2024-01-13T18:21:53.019 INFO:tasks.workunit.client.0.smithi084.stdout:op 245 completed, throughput=4.98MB/sec 2024-01-13T18:21:53.019 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-W3EPymsn3Gml941 off=8331065 len=676375 2024-01-13T18:21:53.020 INFO:tasks.workunit.client.0.smithi084.stdout:op 246 completed, throughput=5MB/sec 2024-01-13T18:21:53.020 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ddTX61dUvSqj-te off=6478069 len=363040 2024-01-13T18:21:53.022 INFO:tasks.workunit.client.0.smithi084.stdout:op 247 completed, throughput=5MB/sec 2024-01-13T18:21:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:53 smithi099 ceph-mon[138788]: pgmap v1502: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:21:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:53 smithi084 ceph-mon[116404]: pgmap v1502: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:21:53.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:53 smithi084 ceph-mon[119097]: pgmap v1502: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:21:54.023 INFO:tasks.workunit.client.0.smithi084.stdout: 49: throughput=4.9MB/sec pending data=0 2024-01-13T18:21:54.023 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FnElY0v7TIRIwXa off=779385 len=1142789 2024-01-13T18:21:54.029 INFO:tasks.workunit.client.0.smithi084.stdout:op 248 completed, throughput=4.93MB/sec 2024-01-13T18:21:54.029 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HE5wgPQCLaA5ZeV off=12450498 len=1304925 2024-01-13T18:21:54.036 INFO:tasks.workunit.client.0.smithi084.stdout:op 249 completed, throughput=4.95MB/sec 2024-01-13T18:21:54.037 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LfpbKdxPsYl3l9j off=3589487 len=945903 2024-01-13T18:21:54.038 INFO:tasks.workunit.client.0.smithi084.stdout:op 250 completed, throughput=4.97MB/sec 2024-01-13T18:21:54.038 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KFKyplEQBK5sQWB off=5376435 len=1751399 2024-01-13T18:21:54.041 INFO:tasks.workunit.client.0.smithi084.stdout:op 251 completed, throughput=5MB/sec 2024-01-13T18:21:55.041 INFO:tasks.workunit.client.0.smithi084.stdout: 50: throughput=4.9MB/sec pending data=0 2024-01-13T18:21:55.041 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uLvX6CIESuLiw4T off=4728598 len=836150 2024-01-13T18:21:55.043 INFO:tasks.workunit.client.0.smithi084.stdout:op 252 completed, throughput=4.92MB/sec 2024-01-13T18:21:55.043 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TDoSHtsfKGleE7R off=15052369 len=2069187 2024-01-13T18:21:55.047 INFO:tasks.workunit.client.0.smithi084.stdout:op 253 completed, throughput=4.96MB/sec 2024-01-13T18:21:55.047 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ibdZrGi-kvUZdqv off=9006888 len=745928 2024-01-13T18:21:55.048 INFO:tasks.workunit.client.0.smithi084.stdout:op 254 completed, throughput=4.97MB/sec 2024-01-13T18:21:55.048 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5BGl-edFbyE-Lg4 off=14659462 len=119898 2024-01-13T18:21:55.048 INFO:tasks.workunit.client.0.smithi084.stdout:op 255 completed, throughput=4.97MB/sec 2024-01-13T18:21:55.048 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QELHVY_M17Osshi off=2835627 len=1200663 2024-01-13T18:21:55.054 INFO:tasks.workunit.client.0.smithi084.stdout:op 256 completed, throughput=4.99MB/sec 2024-01-13T18:21:55.054 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-v7_o0EfT__YZJfu off=1902971 len=1665084 2024-01-13T18:21:55.062 INFO:tasks.workunit.client.0.smithi084.stdout:op 257 completed, throughput=5.02MB/sec 2024-01-13T18:21:55.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:55 smithi099 ceph-mon[138788]: pgmap v1503: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:55 smithi084 ceph-mon[116404]: pgmap v1503: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:55.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:55 smithi084 ceph-mon[119097]: pgmap v1503: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:21:56.062 INFO:tasks.workunit.client.0.smithi084.stdout: 51: throughput=4.93MB/sec pending data=0 2024-01-13T18:21:56.062 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cS1Gf2ZDu8VsAGF off=6100611 len=1342957 2024-01-13T18:21:56.068 INFO:tasks.workunit.client.0.smithi084.stdout:op 258 completed, throughput=4.95MB/sec 2024-01-13T18:21:56.068 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0jrysGo4HN5vBUX off=1546608 len=463368 2024-01-13T18:21:56.068 INFO:tasks.workunit.client.0.smithi084.stdout:op 259 completed, throughput=4.96MB/sec 2024-01-13T18:21:56.068 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ecJ4azaj82E8KsX off=11974166 len=1459396 2024-01-13T18:21:56.077 INFO:tasks.workunit.client.0.smithi084.stdout:op 260 completed, throughput=4.99MB/sec 2024-01-13T18:21:56.078 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-d4SF4NjFkWXD2lj off=409465 len=1648369 2024-01-13T18:21:56.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 261 completed, throughput=5.02MB/sec 2024-01-13T18:21:57.080 INFO:tasks.workunit.client.0.smithi084.stdout: 52: throughput=4.92MB/sec pending data=0 2024-01-13T18:21:57.080 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1uac4noJJS7Z4-Z off=0 len=1283132 2024-01-13T18:21:57.082 INFO:tasks.workunit.client.0.smithi084.stdout:op 262 completed, throughput=4.94MB/sec 2024-01-13T18:21:57.082 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qCaOMjesI6fMJ1G off=5631892 len=902895 2024-01-13T18:21:57.083 INFO:tasks.workunit.client.0.smithi084.stdout:op 263 completed, throughput=4.96MB/sec 2024-01-13T18:21:57.084 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TGdLb18518JLobZ off=2810741 len=465506 2024-01-13T18:21:57.085 INFO:tasks.workunit.client.0.smithi084.stdout:op 264 completed, throughput=4.97MB/sec 2024-01-13T18:21:57.085 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fihJFut7STgov0S off=1376784 len=632072 2024-01-13T18:21:57.089 INFO:tasks.workunit.client.0.smithi084.stdout:op 265 completed, throughput=4.98MB/sec 2024-01-13T18:21:57.089 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vff42dCfieKQJc6 off=6357890 len=1912296 2024-01-13T18:21:57.100 INFO:tasks.workunit.client.0.smithi084.stdout:op 266 completed, throughput=5.01MB/sec 2024-01-13T18:21:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:57 smithi099 ceph-mon[138788]: pgmap v1504: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:21:57.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:57 smithi084 ceph-mon[116404]: pgmap v1504: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:21:57.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:57 smithi084 ceph-mon[119097]: pgmap v1504: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: 53: throughput=4.92MB/sec pending data=0 2024-01-13T18:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lslyPBGPpsYb2y- off=5378542 len=993787 2024-01-13T18:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout:op 267 completed, throughput=4.94MB/sec 2024-01-13T18:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4oq2lRtUM2nQQA3 off=13565071 len=1774978 2024-01-13T18:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout:op 268 completed, throughput=4.97MB/sec 2024-01-13T18:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4RHwcwtMwewdLyh off=1044253 len=924786 2024-01-13T18:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout:op 269 completed, throughput=4.98MB/sec 2024-01-13T18:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-q9QfG5VZfcvKtX2 off=4084901 len=1672103 2024-01-13T18:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout:op 270 completed, throughput=5.01MB/sec 2024-01-13T18:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: 54: throughput=4.92MB/sec pending data=0 2024-01-13T18:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FnN7ooNYA62HPvj off=1540429 len=1760605 2024-01-13T18:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout:op 271 completed, throughput=4.95MB/sec 2024-01-13T18:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4Z5qasLmFwKA8EL off=4829063 len=859909 2024-01-13T18:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout:op 272 completed, throughput=4.97MB/sec 2024-01-13T18:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rq5l13hCkAEIte3 off=8231899 len=898382 2024-01-13T18:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout:op 273 completed, throughput=4.98MB/sec 2024-01-13T18:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nAaeT2Vl3e1qJAj off=3592006 len=1079406 2024-01-13T18:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout:op 274 completed, throughput=5MB/sec 2024-01-13T18:21:59.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:21:59 smithi084 ceph-mon[116404]: pgmap v1505: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:21:59.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:21:59 smithi084 ceph-mon[119097]: pgmap v1505: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:21:59.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:21:59 smithi099 ceph-mon[138788]: pgmap v1505: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: 55: throughput=4.91MB/sec pending data=0 2024-01-13T18:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KQ3ZTQBOGpWp7bU off=9973964 len=1573541 2024-01-13T18:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout:op 275 completed, throughput=4.94MB/sec 2024-01-13T18:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-A7HDv3C2y2e16jM off=15567874 len=1106667 2024-01-13T18:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout:op 276 completed, throughput=4.96MB/sec 2024-01-13T18:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iCZ_SoKK3PM6mxV off=1411213 len=1520961 2024-01-13T18:22:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:op 277 completed, throughput=4.98MB/sec 2024-01-13T18:22:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5xp5JTt8jpP1Zgh off=74714 len=2093438 2024-01-13T18:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:op 278 completed, throughput=5.02MB/sec 2024-01-13T18:22:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:22:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:22:00] "GET /metrics HTTP/1.1" 200 33976 "" "Prometheus/2.43.0" 2024-01-13T18:22:01.146 INFO:tasks.workunit.client.0.smithi084.stdout: 56: throughput=4.93MB/sec pending data=0 2024-01-13T18:22:01.147 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-u-EBJlL6tWcUx4n off=10257738 len=832289 2024-01-13T18:22:01.149 INFO:tasks.workunit.client.0.smithi084.stdout:op 279 completed, throughput=4.94MB/sec 2024-01-13T18:22:01.149 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pDC6PZjYQng0IIG off=15800015 len=557279 2024-01-13T18:22:01.150 INFO:tasks.workunit.client.0.smithi084.stdout:op 280 completed, throughput=4.95MB/sec 2024-01-13T18:22:01.150 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0J66DgsvDbW1ZzR off=2512034 len=357333 2024-01-13T18:22:01.153 INFO:tasks.workunit.client.0.smithi084.stdout:op 281 completed, throughput=4.96MB/sec 2024-01-13T18:22:01.153 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7tqp5oCjWJ6_tJK off=15596471 len=1219975 2024-01-13T18:22:01.160 INFO:tasks.workunit.client.0.smithi084.stdout:op 282 completed, throughput=4.98MB/sec 2024-01-13T18:22:01.160 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BKhknjPTjl_yKJU off=6345568 len=611293 2024-01-13T18:22:01.164 INFO:tasks.workunit.client.0.smithi084.stdout:op 283 completed, throughput=4.99MB/sec 2024-01-13T18:22:01.164 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SL_JylGUQafh3Vt off=5661174 len=1765865 2024-01-13T18:22:01.166 INFO:tasks.workunit.client.0.smithi084.stdout:op 284 completed, throughput=5.02MB/sec 2024-01-13T18:22:01.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:01 smithi099 ceph-mon[138788]: pgmap v1506: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:22:01.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:01 smithi084 ceph-mon[116404]: pgmap v1506: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:22:01.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:01 smithi084 ceph-mon[119097]: pgmap v1506: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:22:02.166 INFO:tasks.workunit.client.0.smithi084.stdout: 57: throughput=4.93MB/sec pending data=0 2024-01-13T18:22:02.167 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n2EuzybFLqKWJ-K off=1589374 len=1459571 2024-01-13T18:22:02.168 INFO:tasks.workunit.client.0.smithi084.stdout:op 285 completed, throughput=4.95MB/sec 2024-01-13T18:22:02.168 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IDZngzkRMLWVxdS off=12774903 len=1363324 2024-01-13T18:22:02.174 INFO:tasks.workunit.client.0.smithi084.stdout:op 286 completed, throughput=4.98MB/sec 2024-01-13T18:22:02.174 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7ueYKlcWIzNpNXA off=2826594 len=983250 2024-01-13T18:22:02.179 INFO:tasks.workunit.client.0.smithi084.stdout:op 287 completed, throughput=4.99MB/sec 2024-01-13T18:22:02.179 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Oh_7O0_96q5hd4k off=11349596 len=1240790 2024-01-13T18:22:02.184 INFO:tasks.workunit.client.0.smithi084.stdout:op 288 completed, throughput=5.01MB/sec 2024-01-13T18:22:03.185 INFO:tasks.workunit.client.0.smithi084.stdout: 58: throughput=4.93MB/sec pending data=0 2024-01-13T18:22:03.185 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UK0GCu0QgM565Fm off=1101533 len=603715 2024-01-13T18:22:03.186 INFO:tasks.workunit.client.0.smithi084.stdout:op 289 completed, throughput=4.94MB/sec 2024-01-13T18:22:03.186 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TW-aYJGb1atNDFE off=830498 len=452274 2024-01-13T18:22:03.190 INFO:tasks.workunit.client.0.smithi084.stdout:op 290 completed, throughput=4.94MB/sec 2024-01-13T18:22:03.190 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ie6BwwuLJsCi7iE off=3413277 len=1134373 2024-01-13T18:22:03.193 INFO:tasks.workunit.client.0.smithi084.stdout:op 291 completed, throughput=4.96MB/sec 2024-01-13T18:22:03.193 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AjmoZWxRhM1_u3r off=7010915 len=654168 2024-01-13T18:22:03.196 INFO:tasks.workunit.client.0.smithi084.stdout:op 292 completed, throughput=4.97MB/sec 2024-01-13T18:22:03.196 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FGtQvDyMFTWjd03 off=867103 len=725000 2024-01-13T18:22:03.197 INFO:tasks.workunit.client.0.smithi084.stdout:op 293 completed, throughput=4.98MB/sec 2024-01-13T18:22:03.197 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Y03LMkcku6xUPAZ off=4536721 len=359925 2024-01-13T18:22:03.200 INFO:tasks.workunit.client.0.smithi084.stdout:op 294 completed, throughput=4.99MB/sec 2024-01-13T18:22:03.200 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YuS1JoPQdKEnYt7 off=13592825 len=1315672 2024-01-13T18:22:03.202 INFO:tasks.workunit.client.0.smithi084.stdout:op 295 completed, throughput=5.01MB/sec 2024-01-13T18:22:03.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:03 smithi099 ceph-mon[138788]: pgmap v1507: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:22:03.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:03 smithi084 ceph-mon[116404]: pgmap v1507: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:22:03.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:03 smithi084 ceph-mon[119097]: pgmap v1507: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:22:04.203 INFO:tasks.workunit.client.0.smithi084.stdout: 59: throughput=4.93MB/sec pending data=0 2024-01-13T18:22:04.203 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rkkgWydS036M4K2 off=2487423 len=416239 2024-01-13T18:22:04.207 INFO:tasks.workunit.client.0.smithi084.stdout:op 296 completed, throughput=4.93MB/sec 2024-01-13T18:22:04.207 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jS7SBq4llXOMx8v off=1232639 len=1679373 2024-01-13T18:22:04.209 INFO:tasks.workunit.client.0.smithi084.stdout:op 297 completed, throughput=4.96MB/sec 2024-01-13T18:22:04.210 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AV2oB_DA_vs87Am off=675533 len=774422 2024-01-13T18:22:04.211 INFO:tasks.workunit.client.0.smithi084.stdout:op 298 completed, throughput=4.97MB/sec 2024-01-13T18:22:04.211 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2pNFXgxz1YQB4-5 off=6789338 len=1868870 2024-01-13T18:22:04.221 INFO:tasks.workunit.client.0.smithi084.stdout:op 299 completed, throughput=5MB/sec 2024-01-13T18:22:05.221 INFO:tasks.workunit.client.0.smithi084.stdout: 60: throughput=4.92MB/sec pending data=0 2024-01-13T18:22:05.222 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JAFBZyFRwbedoho off=1729913 len=1687914 2024-01-13T18:22:05.230 INFO:tasks.workunit.client.0.smithi084.stdout:op 300 completed, throughput=4.94MB/sec 2024-01-13T18:22:05.230 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-R9WQ9TykJw9eNBn off=2654842 len=1393571 2024-01-13T18:22:05.233 INFO:tasks.workunit.client.0.smithi084.stdout:op 301 completed, throughput=4.97MB/sec 2024-01-13T18:22:05.233 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3wxTXz4KcQXFhnU off=4837558 len=1922984 2024-01-13T18:22:05.236 INFO:tasks.workunit.client.0.smithi084.stdout:op 302 completed, throughput=5MB/sec 2024-01-13T18:22:05.236 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JmOw5rHOidiutX4 off=453922 len=2049400 2024-01-13T18:22:05.248 INFO:tasks.workunit.client.0.smithi084.stdout:op 303 completed, throughput=5.03MB/sec 2024-01-13T18:22:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:05 smithi099 ceph-mon[138788]: pgmap v1508: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:22:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:05 smithi084 ceph-mon[116404]: pgmap v1508: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:22:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:05 smithi084 ceph-mon[119097]: pgmap v1508: 105 pgs: 105 active+clean; 128 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:22:05.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:06.248 INFO:tasks.workunit.client.0.smithi084.stdout: 61: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:06.248 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WV7FlJlnYW4M6ZM off=1344400 len=1184181 2024-01-13T18:22:06.250 INFO:tasks.workunit.client.0.smithi084.stdout:op 304 completed, throughput=4.96MB/sec 2024-01-13T18:22:06.250 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UuZmacovw6h6OFh off=2287531 len=1889650 2024-01-13T18:22:06.258 INFO:tasks.workunit.client.0.smithi084.stdout:op 305 completed, throughput=4.99MB/sec 2024-01-13T18:22:06.258 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IfPiZwHrxRTfPCC off=4781242 len=300171 2024-01-13T18:22:06.259 INFO:tasks.workunit.client.0.smithi084.stdout:op 306 completed, throughput=5MB/sec 2024-01-13T18:22:06.259 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UAzTiw1aCsgTrTD off=8937806 len=280604 2024-01-13T18:22:06.262 INFO:tasks.workunit.client.0.smithi084.stdout:op 307 completed, throughput=5MB/sec 2024-01-13T18:22:07.262 INFO:tasks.workunit.client.0.smithi084.stdout: 62: throughput=4.92MB/sec pending data=0 2024-01-13T18:22:07.262 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Von5NeOaCZyUMk8 off=5579842 len=1750874 2024-01-13T18:22:07.264 INFO:tasks.workunit.client.0.smithi084.stdout:op 308 completed, throughput=4.95MB/sec 2024-01-13T18:22:07.264 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FfHXdR0nYZvfrwT off=14083469 len=310679 2024-01-13T18:22:07.268 INFO:tasks.workunit.client.0.smithi084.stdout:op 309 completed, throughput=4.95MB/sec 2024-01-13T18:22:07.268 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-I1ngY4Jn7HQf0dO off=171360 len=771532 2024-01-13T18:22:07.269 INFO:tasks.workunit.client.0.smithi084.stdout:op 310 completed, throughput=4.96MB/sec 2024-01-13T18:22:07.269 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-foXVe5WUoU6JfgY off=16842313 len=1593056 2024-01-13T18:22:07.270 INFO:tasks.workunit.client.0.smithi084.stdout:op 311 completed, throughput=4.99MB/sec 2024-01-13T18:22:07.270 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XZmaBk8OKWBZ6TV off=4384266 len=1018264 2024-01-13T18:22:07.275 INFO:tasks.workunit.client.0.smithi084.stdout:op 312 completed, throughput=5MB/sec 2024-01-13T18:22:07.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:07 smithi099 ceph-mon[138788]: pgmap v1509: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:22:07.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:07 smithi084 ceph-mon[116404]: pgmap v1509: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:22:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:07 smithi084 ceph-mon[119097]: pgmap v1509: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:22:08.275 INFO:tasks.workunit.client.0.smithi084.stdout: 63: throughput=4.92MB/sec pending data=0 2024-01-13T18:22:08.276 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ICVdb0nw3eQutCB off=8143620 len=271209 2024-01-13T18:22:08.276 INFO:tasks.workunit.client.0.smithi084.stdout:op 313 completed, throughput=4.93MB/sec 2024-01-13T18:22:08.276 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g8WJdOVDQkVXc1I off=17002398 len=63253 2024-01-13T18:22:08.277 INFO:tasks.workunit.client.0.smithi084.stdout:op 314 completed, throughput=4.93MB/sec 2024-01-13T18:22:08.277 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-D1QmlD_uCJSUdUV off=19453110 len=812560 2024-01-13T18:22:08.279 INFO:tasks.workunit.client.0.smithi084.stdout:op 315 completed, throughput=4.94MB/sec 2024-01-13T18:22:08.279 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4gPIS16HD51KhH_ off=1652780 len=1099958 2024-01-13T18:22:08.280 INFO:tasks.workunit.client.0.smithi084.stdout:op 316 completed, throughput=4.96MB/sec 2024-01-13T18:22:08.280 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zcqVa7Eius3Y4oA off=3982679 len=716693 2024-01-13T18:22:08.284 INFO:tasks.workunit.client.0.smithi084.stdout:op 317 completed, throughput=4.97MB/sec 2024-01-13T18:22:08.284 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--eGtjuGRBYe5GV_ off=11403228 len=569593 2024-01-13T18:22:08.285 INFO:tasks.workunit.client.0.smithi084.stdout:op 318 completed, throughput=4.98MB/sec 2024-01-13T18:22:08.285 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5sCAHzdOhTET2h3 off=10231752 len=668442 2024-01-13T18:22:08.286 INFO:tasks.workunit.client.0.smithi084.stdout:op 319 completed, throughput=4.99MB/sec 2024-01-13T18:22:08.286 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VgHNhN168K4sCov off=19491542 len=159242 2024-01-13T18:22:08.287 INFO:tasks.workunit.client.0.smithi084.stdout:op 320 completed, throughput=4.99MB/sec 2024-01-13T18:22:08.287 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7rNFm8JdEsSelEW off=3051333 len=1701374 2024-01-13T18:22:08.294 INFO:tasks.workunit.client.0.smithi084.stdout:op 321 completed, throughput=5.01MB/sec 2024-01-13T18:22:09.295 INFO:tasks.workunit.client.0.smithi084.stdout: 64: throughput=4.94MB/sec pending data=0 2024-01-13T18:22:09.295 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8vYhc2VLwhuQDgg off=5469910 len=1791758 2024-01-13T18:22:09.305 INFO:tasks.workunit.client.0.smithi084.stdout:op 322 completed, throughput=4.96MB/sec 2024-01-13T18:22:09.305 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zsrOaJexgaQCUT3 off=4864312 len=215292 2024-01-13T18:22:09.306 INFO:tasks.workunit.client.0.smithi084.stdout:op 323 completed, throughput=4.97MB/sec 2024-01-13T18:22:09.306 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HeG93UQS7Lr2Iz8 off=15199508 len=393530 2024-01-13T18:22:09.306 INFO:tasks.workunit.client.0.smithi084.stdout:op 324 completed, throughput=4.97MB/sec 2024-01-13T18:22:09.306 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-j1j9KMn0oR8xYNg off=3349897 len=409634 2024-01-13T18:22:09.307 INFO:tasks.workunit.client.0.smithi084.stdout:op 325 completed, throughput=4.98MB/sec 2024-01-13T18:22:09.307 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WUf-p1uLk7_YcDt off=1457431 len=601007 2024-01-13T18:22:09.311 INFO:tasks.workunit.client.0.smithi084.stdout:op 326 completed, throughput=4.99MB/sec 2024-01-13T18:22:09.311 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jQjpJcQ4i-NytFX off=288426 len=260321 2024-01-13T18:22:09.314 INFO:tasks.workunit.client.0.smithi084.stdout:op 327 completed, throughput=4.99MB/sec 2024-01-13T18:22:09.314 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VUXQSPPLWM1YZCa off=18301364 len=665332 2024-01-13T18:22:09.317 INFO:tasks.workunit.client.0.smithi084.stdout:op 328 completed, throughput=5MB/sec 2024-01-13T18:22:09.317 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3ByHuFbQUPQoQhT off=1172022 len=962548 2024-01-13T18:22:09.322 INFO:tasks.workunit.client.0.smithi084.stdout:op 329 completed, throughput=5.01MB/sec 2024-01-13T18:22:09.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:09 smithi084 ceph-mon[116404]: pgmap v1510: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:22:09.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:09 smithi084 ceph-mon[119097]: pgmap v1510: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:22:09.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:09 smithi099 ceph-mon[138788]: pgmap v1510: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:22:10.322 INFO:tasks.workunit.client.0.smithi084.stdout: 65: throughput=4.94MB/sec pending data=0 2024-01-13T18:22:10.322 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mrVZrhnZ5QcX2c6 off=248558 len=1546283 2024-01-13T18:22:10.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 330 completed, throughput=4.96MB/sec 2024-01-13T18:22:10.329 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YWb0XrrNGl7KwFT off=3565316 len=2036945 2024-01-13T18:22:10.332 INFO:tasks.workunit.client.0.smithi084.stdout:op 331 completed, throughput=4.99MB/sec 2024-01-13T18:22:10.332 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IReUMQwVu_7gOjd off=0 len=1076504 2024-01-13T18:22:10.337 INFO:tasks.workunit.client.0.smithi084.stdout:op 332 completed, throughput=5MB/sec 2024-01-13T18:22:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:22:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:22:10] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:22:11.337 INFO:tasks.workunit.client.0.smithi084.stdout: 66: throughput=4.93MB/sec pending data=0 2024-01-13T18:22:11.338 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-60knDYAZ_t4Po-_ off=9387242 len=1867826 2024-01-13T18:22:11.347 INFO:tasks.workunit.client.0.smithi084.stdout:op 333 completed, throughput=4.95MB/sec 2024-01-13T18:22:11.347 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Nu3R2cvpLStr3YH off=2520269 len=572421 2024-01-13T18:22:11.351 INFO:tasks.workunit.client.0.smithi084.stdout:op 334 completed, throughput=4.96MB/sec 2024-01-13T18:22:11.351 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-w2FqQn7AayjhQSQ off=4126591 len=524385 2024-01-13T18:22:11.354 INFO:tasks.workunit.client.0.smithi084.stdout:op 335 completed, throughput=4.97MB/sec 2024-01-13T18:22:11.355 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_53bufl6nXSIOPN off=8565574 len=874519 2024-01-13T18:22:11.356 INFO:tasks.workunit.client.0.smithi084.stdout:op 336 completed, throughput=4.98MB/sec 2024-01-13T18:22:11.356 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hB8eNxZQXiFzkaZ off=3380729 len=944517 2024-01-13T18:22:11.357 INFO:tasks.workunit.client.0.smithi084.stdout:op 337 completed, throughput=4.99MB/sec 2024-01-13T18:22:11.357 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-W0yzfBOdHOkvvXJ off=9703005 len=355707 2024-01-13T18:22:11.357 INFO:tasks.workunit.client.0.smithi084.stdout:op 338 completed, throughput=5MB/sec 2024-01-13T18:22:11.357 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-orAajoLFoONNqa6 off=4647219 len=2027278 2024-01-13T18:22:11.360 INFO:tasks.workunit.client.0.smithi084.stdout:op 339 completed, throughput=5.03MB/sec 2024-01-13T18:22:11.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:11 smithi099 ceph-mon[138788]: pgmap v1511: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:22:11.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:11 smithi084 ceph-mon[116404]: pgmap v1511: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:22:11.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:11 smithi084 ceph-mon[119097]: pgmap v1511: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:22:12.360 INFO:tasks.workunit.client.0.smithi084.stdout: 67: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:12.360 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DXlfB6Rq8ZFhXbq off=15859723 len=833777 2024-01-13T18:22:12.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 340 completed, throughput=4.97MB/sec 2024-01-13T18:22:12.361 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tfNIMQGwwYj4z36 off=7218364 len=1182618 2024-01-13T18:22:12.363 INFO:tasks.workunit.client.0.smithi084.stdout:op 341 completed, throughput=4.98MB/sec 2024-01-13T18:22:12.363 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fwJJZIYk2z7dmhP off=9409855 len=902898 2024-01-13T18:22:12.364 INFO:tasks.workunit.client.0.smithi084.stdout:op 342 completed, throughput=4.99MB/sec 2024-01-13T18:22:12.364 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6pEsF_RDdecFgUD off=1264234 len=135307 2024-01-13T18:22:12.365 INFO:tasks.workunit.client.0.smithi084.stdout:op 343 completed, throughput=5MB/sec 2024-01-13T18:22:12.365 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Hm4WNoDS-_Evfpa off=15548071 len=1950308 2024-01-13T18:22:12.372 INFO:tasks.workunit.client.0.smithi084.stdout:op 344 completed, throughput=5.02MB/sec 2024-01-13T18:22:13.373 INFO:tasks.workunit.client.0.smithi084.stdout: 68: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:13.373 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Emm_MmnQfJCY9Vv off=2490305 len=817756 2024-01-13T18:22:13.374 INFO:tasks.workunit.client.0.smithi084.stdout:op 345 completed, throughput=4.96MB/sec 2024-01-13T18:22:13.374 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L5Rc6TUBX74075T off=8776682 len=513409 2024-01-13T18:22:13.375 INFO:tasks.workunit.client.0.smithi084.stdout:op 346 completed, throughput=4.97MB/sec 2024-01-13T18:22:13.375 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vWTSiyg-lq7a7sl off=6505878 len=511796 2024-01-13T18:22:13.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 347 completed, throughput=4.98MB/sec 2024-01-13T18:22:13.376 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LLDWDyRyD0A03yS off=699694 len=1844724 2024-01-13T18:22:13.385 INFO:tasks.workunit.client.0.smithi084.stdout:op 348 completed, throughput=5MB/sec 2024-01-13T18:22:13.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:13 smithi099 ceph-mon[138788]: pgmap v1512: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:13.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:13 smithi084 ceph-mon[116404]: pgmap v1512: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:13.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:13 smithi084 ceph-mon[119097]: pgmap v1512: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:14.385 INFO:tasks.workunit.client.0.smithi084.stdout: 69: throughput=4.93MB/sec pending data=0 2024-01-13T18:22:14.385 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-La2YtEGYbisEVSf off=4761820 len=1937287 2024-01-13T18:22:14.387 INFO:tasks.workunit.client.0.smithi084.stdout:op 349 completed, throughput=4.96MB/sec 2024-01-13T18:22:14.387 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BpeV1trwvpw50an off=1982585 len=457351 2024-01-13T18:22:14.388 INFO:tasks.workunit.client.0.smithi084.stdout:op 350 completed, throughput=4.96MB/sec 2024-01-13T18:22:14.388 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e0tlQ8gKd6yaup1 off=3453366 len=1804722 2024-01-13T18:22:14.399 INFO:tasks.workunit.client.0.smithi084.stdout:op 351 completed, throughput=4.99MB/sec 2024-01-13T18:22:14.399 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1UDKECJeyWo6cAe off=2169767 len=1930367 2024-01-13T18:22:14.405 INFO:tasks.workunit.client.0.smithi084.stdout:op 352 completed, throughput=5.01MB/sec 2024-01-13T18:22:15.406 INFO:tasks.workunit.client.0.smithi084.stdout: 70: throughput=4.94MB/sec pending data=0 2024-01-13T18:22:15.406 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6wwFzk6xm-wVd6t off=455518 len=1815435 2024-01-13T18:22:15.412 INFO:tasks.workunit.client.0.smithi084.stdout:op 353 completed, throughput=4.96MB/sec 2024-01-13T18:22:15.413 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xyQPLm1qXNjSsvd off=885868 len=1283392 2024-01-13T18:22:15.419 INFO:tasks.workunit.client.0.smithi084.stdout:op 354 completed, throughput=4.98MB/sec 2024-01-13T18:22:15.419 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PMvXekdgmL4PN8l off=3705928 len=1237629 2024-01-13T18:22:15.424 INFO:tasks.workunit.client.0.smithi084.stdout:op 355 completed, throughput=5MB/sec 2024-01-13T18:22:15.424 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xhdk8c4AqOIMJfS off=572390 len=1812064 2024-01-13T18:22:15.434 INFO:tasks.workunit.client.0.smithi084.stdout:op 356 completed, throughput=5.02MB/sec 2024-01-13T18:22:15.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:15 smithi099 ceph-mon[138788]: pgmap v1513: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:22:15.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:15 smithi084 ceph-mon[116404]: pgmap v1513: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:22:15.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:15 smithi084 ceph-mon[119097]: pgmap v1513: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:22:16.434 INFO:tasks.workunit.client.0.smithi084.stdout: 71: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:16.434 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-00wKOw4QwP9qB4I off=968521 len=370002 2024-01-13T18:22:16.438 INFO:tasks.workunit.client.0.smithi084.stdout:op 357 completed, throughput=4.96MB/sec 2024-01-13T18:22:16.438 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aOnXsMxO2qIn39Z off=3746656 len=13585 2024-01-13T18:22:16.438 INFO:tasks.workunit.client.0.smithi084.stdout:op 358 completed, throughput=4.96MB/sec 2024-01-13T18:22:16.439 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dNKRv27tWNtu7CZ off=9912854 len=1626841 2024-01-13T18:22:16.440 INFO:tasks.workunit.client.0.smithi084.stdout:op 359 completed, throughput=4.98MB/sec 2024-01-13T18:22:16.440 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M-v1t4bGYmd7VX2 off=1540021 len=529227 2024-01-13T18:22:16.442 INFO:tasks.workunit.client.0.smithi084.stdout:op 360 completed, throughput=4.98MB/sec 2024-01-13T18:22:16.442 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LUlt0zwUZKf0zz9 off=4442788 len=1156628 2024-01-13T18:22:16.448 INFO:tasks.workunit.client.0.smithi084.stdout:op 361 completed, throughput=5MB/sec 2024-01-13T18:22:16.448 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-avoTccsWEfEmy1X off=17150921 len=1687758 2024-01-13T18:22:16.456 INFO:tasks.workunit.client.0.smithi084.stdout:op 362 completed, throughput=5.02MB/sec 2024-01-13T18:22:17.456 INFO:tasks.workunit.client.0.smithi084.stdout: 72: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:17.456 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tkWPHtWnUShc1JW off=9522022 len=405352 2024-01-13T18:22:17.459 INFO:tasks.workunit.client.0.smithi084.stdout:op 363 completed, throughput=4.96MB/sec 2024-01-13T18:22:17.460 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-usZM4WVytDL0zzf off=20718689 len=1581576 2024-01-13T18:22:17.467 INFO:tasks.workunit.client.0.smithi084.stdout:op 364 completed, throughput=4.98MB/sec 2024-01-13T18:22:17.467 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5775w5x6BKLpNKp off=1977455 len=983629 2024-01-13T18:22:17.469 INFO:tasks.workunit.client.0.smithi084.stdout:op 365 completed, throughput=4.99MB/sec 2024-01-13T18:22:17.469 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kNypXCs4Rbpi98i off=1098423 len=1294119 2024-01-13T18:22:17.475 INFO:tasks.workunit.client.0.smithi084.stdout:op 366 completed, throughput=5.01MB/sec 2024-01-13T18:22:17.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:17 smithi099 ceph-mon[138788]: pgmap v1514: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:22:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:17 smithi084 ceph-mon[116404]: pgmap v1514: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:22:17.719 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:17 smithi084 ceph-mon[119097]: pgmap v1514: 105 pgs: 105 active+clean; 128 GiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:22:18.475 INFO:tasks.workunit.client.0.smithi084.stdout: 73: throughput=4.94MB/sec pending data=0 2024-01-13T18:22:18.475 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-isnOHcIXPcpfP5B off=7535860 len=965653 2024-01-13T18:22:18.477 INFO:tasks.workunit.client.0.smithi084.stdout:op 367 completed, throughput=4.95MB/sec 2024-01-13T18:22:18.477 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FAov_GL_FgihUHK off=4664614 len=419688 2024-01-13T18:22:18.481 INFO:tasks.workunit.client.0.smithi084.stdout:op 368 completed, throughput=4.96MB/sec 2024-01-13T18:22:18.481 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IsmlXefk3_Fod6L off=1144831 len=172836 2024-01-13T18:22:18.484 INFO:tasks.workunit.client.0.smithi084.stdout:op 369 completed, throughput=4.96MB/sec 2024-01-13T18:22:18.484 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-65KcylqttOyJDnG off=604461 len=888701 2024-01-13T18:22:18.489 INFO:tasks.workunit.client.0.smithi084.stdout:op 370 completed, throughput=4.97MB/sec 2024-01-13T18:22:18.489 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mha-CcaPr3rfu4c off=6738682 len=1114959 2024-01-13T18:22:18.495 INFO:tasks.workunit.client.0.smithi084.stdout:op 371 completed, throughput=4.98MB/sec 2024-01-13T18:22:18.495 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HMepR1c-s2Fls9v off=4322216 len=1601081 2024-01-13T18:22:18.498 INFO:tasks.workunit.client.0.smithi084.stdout:op 372 completed, throughput=5MB/sec 2024-01-13T18:22:19.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:19 smithi084 ceph-mon[116404]: pgmap v1515: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:22:19.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:19 smithi084 ceph-mon[119097]: pgmap v1515: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:22:19.498 INFO:tasks.workunit.client.0.smithi084.stdout: 74: throughput=4.94MB/sec pending data=0 2024-01-13T18:22:19.498 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-juOSHyhAkVVyorU off=1698594 len=1144766 2024-01-13T18:22:19.505 INFO:tasks.workunit.client.0.smithi084.stdout:op 373 completed, throughput=4.95MB/sec 2024-01-13T18:22:19.505 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KRAvELjKZunBRZf off=8739018 len=53130 2024-01-13T18:22:19.506 INFO:tasks.workunit.client.0.smithi084.stdout:op 374 completed, throughput=4.95MB/sec 2024-01-13T18:22:19.506 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-txVjNmU2nReRL8E off=1359273 len=233627 2024-01-13T18:22:19.508 INFO:tasks.workunit.client.0.smithi084.stdout:op 375 completed, throughput=4.96MB/sec 2024-01-13T18:22:19.508 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mArRmHTPS94yDpt off=11772578 len=2094375 2024-01-13T18:22:19.521 INFO:tasks.workunit.client.0.smithi084.stdout:op 376 completed, throughput=4.98MB/sec 2024-01-13T18:22:19.521 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PbU_AfvgyuWcQod off=8384393 len=1254394 2024-01-13T18:22:19.522 INFO:tasks.workunit.client.0.smithi084.stdout:op 377 completed, throughput=5MB/sec 2024-01-13T18:22:19.523 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aSd5SobepEwus2H off=6695007 len=953019 2024-01-13T18:22:19.527 INFO:tasks.workunit.client.0.smithi084.stdout:op 378 completed, throughput=5.01MB/sec 2024-01-13T18:22:19.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:19 smithi099 ceph-mon[138788]: pgmap v1515: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:22:20.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:20.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:22:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:22:20] "GET /metrics HTTP/1.1" 200 33980 "" "Prometheus/2.43.0" 2024-01-13T18:22:20.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:20.527 INFO:tasks.workunit.client.0.smithi084.stdout: 75: throughput=4.94MB/sec pending data=0 2024-01-13T18:22:20.527 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-69YXYFSrY3z2OB3 off=3319922 len=629925 2024-01-13T18:22:20.529 INFO:tasks.workunit.client.0.smithi084.stdout:op 379 completed, throughput=4.95MB/sec 2024-01-13T18:22:20.529 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_FL7XdSvagcbch7 off=12113548 len=1142949 2024-01-13T18:22:20.533 INFO:tasks.workunit.client.0.smithi084.stdout:op 380 completed, throughput=4.96MB/sec 2024-01-13T18:22:20.533 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xr1_Hq4POdHuD8H off=20557903 len=443735 2024-01-13T18:22:20.536 INFO:tasks.workunit.client.0.smithi084.stdout:op 381 completed, throughput=4.97MB/sec 2024-01-13T18:22:20.536 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y0rqfu8vRRXCLat off=1762741 len=1966218 2024-01-13T18:22:20.544 INFO:tasks.workunit.client.0.smithi084.stdout:op 382 completed, throughput=4.99MB/sec 2024-01-13T18:22:20.544 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-T3bi-ApM4pBvSjh off=1645717 len=1943367 2024-01-13T18:22:20.554 INFO:tasks.workunit.client.0.smithi084.stdout:op 383 completed, throughput=5.02MB/sec 2024-01-13T18:22:20.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:21.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:21 smithi084 ceph-mon[116404]: pgmap v1516: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:22:21.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:22:21.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:22:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:22:21.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:22:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:21 smithi084 ceph-mon[119097]: pgmap v1516: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:22:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:22:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:22:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:22:21.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:22:21.554 INFO:tasks.workunit.client.0.smithi084.stdout: 76: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:21.554 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NDjSfnFznfQNmkC off=15598721 len=1213608 2024-01-13T18:22:21.556 INFO:tasks.workunit.client.0.smithi084.stdout:op 384 completed, throughput=4.97MB/sec 2024-01-13T18:22:21.556 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TufzqLKiWssAamg off=728755 len=286666 2024-01-13T18:22:21.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 385 completed, throughput=4.97MB/sec 2024-01-13T18:22:21.559 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_hhMJ7PZkjIT9y- off=9932464 len=1314291 2024-01-13T18:22:21.565 INFO:tasks.workunit.client.0.smithi084.stdout:op 386 completed, throughput=4.99MB/sec 2024-01-13T18:22:21.565 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qV8VlaSM9K4XzW_ off=1237287 len=222047 2024-01-13T18:22:21.567 INFO:tasks.workunit.client.0.smithi084.stdout:op 387 completed, throughput=4.99MB/sec 2024-01-13T18:22:21.567 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oDedA0fBdjblQSk off=3945596 len=819274 2024-01-13T18:22:21.568 INFO:tasks.workunit.client.0.smithi084.stdout:op 388 completed, throughput=5MB/sec 2024-01-13T18:22:21.568 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_ukwKrDBMyWMJPc off=4537045 len=159311 2024-01-13T18:22:21.569 INFO:tasks.workunit.client.0.smithi084.stdout:op 389 completed, throughput=5MB/sec 2024-01-13T18:22:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:21 smithi099 ceph-mon[138788]: pgmap v1516: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:22:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:22:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:22:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:22:21.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:22:22.569 INFO:tasks.workunit.client.0.smithi084.stdout: 77: throughput=4.94MB/sec pending data=0 2024-01-13T18:22:22.569 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-25X_YId5pk5iXEW off=4212791 len=1572205 2024-01-13T18:22:22.571 INFO:tasks.workunit.client.0.smithi084.stdout:op 390 completed, throughput=4.96MB/sec 2024-01-13T18:22:22.571 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uT-jUpXx8l3o2IP off=4051399 len=986551 2024-01-13T18:22:22.574 INFO:tasks.workunit.client.0.smithi084.stdout:op 391 completed, throughput=4.97MB/sec 2024-01-13T18:22:22.574 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--Cv_kvWi5qh9FfU off=3118732 len=144502 2024-01-13T18:22:22.576 INFO:tasks.workunit.client.0.smithi084.stdout:op 392 completed, throughput=4.97MB/sec 2024-01-13T18:22:22.576 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BGnqbaBwbzE10ux off=19541604 len=1635602 2024-01-13T18:22:22.579 INFO:tasks.workunit.client.0.smithi084.stdout:op 393 completed, throughput=4.99MB/sec 2024-01-13T18:22:22.579 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fqz7gzTmdbI1px8 off=444373 len=1220495 2024-01-13T18:22:22.581 INFO:tasks.workunit.client.0.smithi084.stdout:op 394 completed, throughput=5MB/sec 2024-01-13T18:22:23.582 INFO:tasks.workunit.client.0.smithi084.stdout: 78: throughput=4.94MB/sec pending data=0 2024-01-13T18:22:23.582 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dHINk6zrwoUXSFP off=18769612 len=1983600 2024-01-13T18:22:23.584 INFO:tasks.workunit.client.0.smithi084.stdout:op 395 completed, throughput=4.96MB/sec 2024-01-13T18:22:23.584 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cF8T64nBitDrkzc off=291869 len=569658 2024-01-13T18:22:23.585 INFO:tasks.workunit.client.0.smithi084.stdout:op 396 completed, throughput=4.97MB/sec 2024-01-13T18:22:23.585 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9-0x0PknSJl_XHu off=12439628 len=1081916 2024-01-13T18:22:23.587 INFO:tasks.workunit.client.0.smithi084.stdout:op 397 completed, throughput=4.98MB/sec 2024-01-13T18:22:23.587 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IttXcQE1mZq-qY9 off=4327457 len=2061207 2024-01-13T18:22:23.595 INFO:tasks.workunit.client.0.smithi084.stdout:op 398 completed, throughput=5.01MB/sec 2024-01-13T18:22:23.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:23 smithi099 ceph-mon[138788]: pgmap v1517: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:22:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:23 smithi084 ceph-mon[116404]: pgmap v1517: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:22:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:23 smithi084 ceph-mon[119097]: pgmap v1517: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:22:24.595 INFO:tasks.workunit.client.0.smithi084.stdout: 79: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:24.595 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PrWAMpSI_NuXccT off=17654007 len=1923484 2024-01-13T18:22:24.597 INFO:tasks.workunit.client.0.smithi084.stdout:op 399 completed, throughput=4.97MB/sec 2024-01-13T18:22:24.598 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Sn8EzbI0H4aTR6T off=3685839 len=1475530 2024-01-13T18:22:24.603 INFO:tasks.workunit.client.0.smithi084.stdout:op 400 completed, throughput=4.99MB/sec 2024-01-13T18:22:24.604 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WbaiuodvqgCu9EX off=30738 len=1594756 2024-01-13T18:22:24.606 INFO:tasks.workunit.client.0.smithi084.stdout:op 401 completed, throughput=5MB/sec 2024-01-13T18:22:25.606 INFO:tasks.workunit.client.0.smithi084.stdout: 80: throughput=4.94MB/sec pending data=0 2024-01-13T18:22:25.606 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hkYhBitgIYEdydP off=2827498 len=1690999 2024-01-13T18:22:25.613 INFO:tasks.workunit.client.0.smithi084.stdout:op 402 completed, throughput=4.96MB/sec 2024-01-13T18:22:25.613 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AnqOHKvglh3QkdS off=10984144 len=523684 2024-01-13T18:22:25.615 INFO:tasks.workunit.client.0.smithi084.stdout:op 403 completed, throughput=4.97MB/sec 2024-01-13T18:22:25.615 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5ORz8ilH4lTXsmt off=15595254 len=229585 2024-01-13T18:22:25.618 INFO:tasks.workunit.client.0.smithi084.stdout:op 404 completed, throughput=4.97MB/sec 2024-01-13T18:22:25.618 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5cDf9ePB5_UINoc off=594208 len=581996 2024-01-13T18:22:25.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:25 smithi099 ceph-mon[138788]: pgmap v1518: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.4 MiB/s wr, 5 op/s 2024-01-13T18:22:25.619 INFO:tasks.workunit.client.0.smithi084.stdout:op 405 completed, throughput=4.98MB/sec 2024-01-13T18:22:25.619 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yY9B0jOG3hAsDSG off=23068992 len=562765 2024-01-13T18:22:25.620 INFO:tasks.workunit.client.0.smithi084.stdout:op 406 completed, throughput=4.98MB/sec 2024-01-13T18:22:25.620 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-U33nG1fcT_0kks6 off=12100292 len=1695092 2024-01-13T18:22:25.629 INFO:tasks.workunit.client.0.smithi084.stdout:op 407 completed, throughput=5MB/sec 2024-01-13T18:22:25.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:25 smithi084 ceph-mon[116404]: pgmap v1518: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.4 MiB/s wr, 5 op/s 2024-01-13T18:22:25.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:25 smithi084 ceph-mon[119097]: pgmap v1518: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.4 MiB/s wr, 5 op/s 2024-01-13T18:22:26.630 INFO:tasks.workunit.client.0.smithi084.stdout: 81: throughput=4.94MB/sec pending data=0 2024-01-13T18:22:26.630 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gidiERcH9wWqOr5 off=3375238 len=1247101 2024-01-13T18:22:26.638 INFO:tasks.workunit.client.0.smithi084.stdout:op 408 completed, throughput=4.96MB/sec 2024-01-13T18:22:26.638 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Rd0soUVvw3fiWDz off=14736604 len=882537 2024-01-13T18:22:26.638 INFO:tasks.workunit.client.0.smithi084.stdout:op 409 completed, throughput=4.97MB/sec 2024-01-13T18:22:26.638 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1SMsAqfqiZLtcVF off=1695291 len=337339 2024-01-13T18:22:26.640 INFO:tasks.workunit.client.0.smithi084.stdout:op 410 completed, throughput=4.97MB/sec 2024-01-13T18:22:26.640 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PIQkwbkMCV2MUQj off=15411175 len=662444 2024-01-13T18:22:26.641 INFO:tasks.workunit.client.0.smithi084.stdout:op 411 completed, throughput=4.98MB/sec 2024-01-13T18:22:26.641 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IeoHg37Wal3dZ2n off=945633 len=2042059 2024-01-13T18:22:26.644 INFO:tasks.workunit.client.0.smithi084.stdout:op 412 completed, throughput=5MB/sec 2024-01-13T18:22:27.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:27 smithi099 ceph-mon[138788]: pgmap v1519: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:22:27.645 INFO:tasks.workunit.client.0.smithi084.stdout: 82: throughput=4.94MB/sec pending data=0 2024-01-13T18:22:27.645 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-t9laKJRs6evWylY off=1807634 len=633411 2024-01-13T18:22:27.649 INFO:tasks.workunit.client.0.smithi084.stdout:op 413 completed, throughput=4.95MB/sec 2024-01-13T18:22:27.650 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V8bBBaouoJ6XsGh off=13790569 len=95433 2024-01-13T18:22:27.650 INFO:tasks.workunit.client.0.smithi084.stdout:op 414 completed, throughput=4.95MB/sec 2024-01-13T18:22:27.650 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xlaHriFtQV33V2T off=1015872 len=1422132 2024-01-13T18:22:27.658 INFO:tasks.workunit.client.0.smithi084.stdout:op 415 completed, throughput=4.97MB/sec 2024-01-13T18:22:27.658 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g_t46qk1xqvWtfl off=1773665 len=1382111 2024-01-13T18:22:27.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 416 completed, throughput=4.98MB/sec 2024-01-13T18:22:27.660 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8ed1S7osmC57Jyt off=4472425 len=677883 2024-01-13T18:22:27.664 INFO:tasks.workunit.client.0.smithi084.stdout:op 417 completed, throughput=4.99MB/sec 2024-01-13T18:22:27.664 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2sRjEriIPrfMVFt off=12547272 len=1437430 2024-01-13T18:22:27.666 INFO:tasks.workunit.client.0.smithi084.stdout:op 418 completed, throughput=5.01MB/sec 2024-01-13T18:22:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:27 smithi084 ceph-mon[116404]: pgmap v1519: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:22:27.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:27 smithi084 ceph-mon[119097]: pgmap v1519: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:22:28.667 INFO:tasks.workunit.client.0.smithi084.stdout: 83: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:28.667 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DhlBKdCsdScrXW7 off=12223853 len=900674 2024-01-13T18:22:28.668 INFO:tasks.workunit.client.0.smithi084.stdout:op 419 completed, throughput=4.96MB/sec 2024-01-13T18:22:28.668 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BgW0sBmY3-XMeWC off=3672375 len=488925 2024-01-13T18:22:28.669 INFO:tasks.workunit.client.0.smithi084.stdout:op 420 completed, throughput=4.96MB/sec 2024-01-13T18:22:28.669 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3Il_eSVpO5UUGYS off=8333327 len=1471263 2024-01-13T18:22:28.671 INFO:tasks.workunit.client.0.smithi084.stdout:op 421 completed, throughput=4.98MB/sec 2024-01-13T18:22:28.671 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-O3VJrxff_EXSfqu off=2933670 len=997657 2024-01-13T18:22:28.673 INFO:tasks.workunit.client.0.smithi084.stdout:op 422 completed, throughput=4.99MB/sec 2024-01-13T18:22:28.673 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-A3gPAHqWJW_fTw9 off=10115246 len=1439905 2024-01-13T18:22:28.674 INFO:tasks.workunit.client.0.smithi084.stdout:op 423 completed, throughput=5.01MB/sec 2024-01-13T18:22:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:29 smithi084 ceph-mon[116404]: pgmap v1520: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:22:29.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:29 smithi084 ceph-mon[119097]: pgmap v1520: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:22:29.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:29 smithi099 ceph-mon[138788]: pgmap v1520: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:22:29.675 INFO:tasks.workunit.client.0.smithi084.stdout: 84: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:29.675 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-as55YoUkfAe7Yv8 off=13510637 len=1006104 2024-01-13T18:22:29.681 INFO:tasks.workunit.client.0.smithi084.stdout:op 424 completed, throughput=4.96MB/sec 2024-01-13T18:22:29.681 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2pm1wNdrUih3m_m off=14025420 len=1693088 2024-01-13T18:22:29.687 INFO:tasks.workunit.client.0.smithi084.stdout:op 425 completed, throughput=4.98MB/sec 2024-01-13T18:22:29.687 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dja1FdslCsLowHN off=654022 len=1429741 2024-01-13T18:22:29.689 INFO:tasks.workunit.client.0.smithi084.stdout:op 426 completed, throughput=4.99MB/sec 2024-01-13T18:22:29.689 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QELHVY_M17Osshi off=7146790 len=28522 2024-01-13T18:22:29.689 INFO:tasks.workunit.client.0.smithi084.stdout:op 427 completed, throughput=4.99MB/sec 2024-01-13T18:22:29.690 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GSKMLeaeofC6L_C off=1275265 len=464968 2024-01-13T18:22:29.690 INFO:tasks.workunit.client.0.smithi084.stdout:op 428 completed, throughput=5MB/sec 2024-01-13T18:22:29.690 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mK_aTMSQ4R6i36D off=5430092 len=1441895 2024-01-13T18:22:29.691 INFO:tasks.workunit.client.0.smithi084.stdout:op 429 completed, throughput=5.01MB/sec 2024-01-13T18:22:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:22:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:22:30] "GET /metrics HTTP/1.1" 200 33980 "" "Prometheus/2.43.0" 2024-01-13T18:22:30.691 INFO:tasks.workunit.client.0.smithi084.stdout: 85: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:30.692 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-utHt3KCJThMbTzQ off=8760154 len=1742227 2024-01-13T18:22:30.693 INFO:tasks.workunit.client.0.smithi084.stdout:op 430 completed, throughput=4.97MB/sec 2024-01-13T18:22:30.693 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OS9sUujk1UhNjtZ off=18401629 len=1179921 2024-01-13T18:22:30.699 INFO:tasks.workunit.client.0.smithi084.stdout:op 431 completed, throughput=4.99MB/sec 2024-01-13T18:22:30.699 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AhgoTQrhkeUYc_J off=2009753 len=52718 2024-01-13T18:22:30.701 INFO:tasks.workunit.client.0.smithi084.stdout:op 432 completed, throughput=4.99MB/sec 2024-01-13T18:22:30.702 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4YmVhmZXByi6JsQ off=3539248 len=2011474 2024-01-13T18:22:30.706 INFO:tasks.workunit.client.0.smithi084.stdout:op 433 completed, throughput=5.01MB/sec 2024-01-13T18:22:31.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:31 smithi099 ceph-mon[138788]: pgmap v1521: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:22:31.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:31 smithi084 ceph-mon[116404]: pgmap v1521: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:22:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:31 smithi084 ceph-mon[119097]: pgmap v1521: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:22:31.706 INFO:tasks.workunit.client.0.smithi084.stdout: 86: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:31.706 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-c4iQ1iu2Lpt-Ozq off=5375827 len=1754193 2024-01-13T18:22:31.713 INFO:tasks.workunit.client.0.smithi084.stdout:op 434 completed, throughput=4.97MB/sec 2024-01-13T18:22:31.713 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G7Pn95CSWElpd7Y off=5068068 len=296596 2024-01-13T18:22:31.716 INFO:tasks.workunit.client.0.smithi084.stdout:op 435 completed, throughput=4.97MB/sec 2024-01-13T18:22:31.716 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JUM_MglJIP2zy-1 off=2101251 len=876756 2024-01-13T18:22:31.720 INFO:tasks.workunit.client.0.smithi084.stdout:op 436 completed, throughput=4.98MB/sec 2024-01-13T18:22:31.720 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2hj2KQDwjb09mCL off=11407479 len=1320867 2024-01-13T18:22:31.727 INFO:tasks.workunit.client.0.smithi084.stdout:op 437 completed, throughput=5MB/sec 2024-01-13T18:22:31.727 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UtYHAdTKWR8oycu off=3542369 len=576421 2024-01-13T18:22:31.730 INFO:tasks.workunit.client.0.smithi084.stdout:op 438 completed, throughput=5MB/sec 2024-01-13T18:22:32.730 INFO:tasks.workunit.client.0.smithi084.stdout: 87: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:32.731 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IEWT7U-FfomHHSU off=10270580 len=553855 2024-01-13T18:22:32.731 INFO:tasks.workunit.client.0.smithi084.stdout:op 439 completed, throughput=4.95MB/sec 2024-01-13T18:22:32.731 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1ZW6aCrr8z4qyta off=5234259 len=1635341 2024-01-13T18:22:32.733 INFO:tasks.workunit.client.0.smithi084.stdout:op 440 completed, throughput=4.97MB/sec 2024-01-13T18:22:32.733 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WEAEgYWJlMUYLWu off=5726284 len=332216 2024-01-13T18:22:32.734 INFO:tasks.workunit.client.0.smithi084.stdout:op 441 completed, throughput=4.97MB/sec 2024-01-13T18:22:32.734 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nzaac8Vssz2Wy3e off=946952 len=81648 2024-01-13T18:22:32.737 INFO:tasks.workunit.client.0.smithi084.stdout:op 442 completed, throughput=4.97MB/sec 2024-01-13T18:22:32.737 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7f09N-uR7wt8MA8 off=11071123 len=762539 2024-01-13T18:22:32.741 INFO:tasks.workunit.client.0.smithi084.stdout:op 443 completed, throughput=4.98MB/sec 2024-01-13T18:22:32.741 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dTuiU6XtUmFHD3r off=13963496 len=1770984 2024-01-13T18:22:32.752 INFO:tasks.workunit.client.0.smithi084.stdout:op 444 completed, throughput=5MB/sec 2024-01-13T18:22:33.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:33 smithi099 ceph-mon[138788]: pgmap v1522: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:22:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:33 smithi084 ceph-mon[116404]: pgmap v1522: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:22:33.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:33 smithi084 ceph-mon[119097]: pgmap v1522: 105 pgs: 105 active+clean; 128 GiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:22:33.752 INFO:tasks.workunit.client.0.smithi084.stdout: 88: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:33.753 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sqIkuI4VniLJIvh off=1752620 len=1505615 2024-01-13T18:22:33.754 INFO:tasks.workunit.client.0.smithi084.stdout:op 445 completed, throughput=4.96MB/sec 2024-01-13T18:22:33.754 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1VpyYnNHNvF29Hj off=18442705 len=1398633 2024-01-13T18:22:33.759 INFO:tasks.workunit.client.0.smithi084.stdout:op 446 completed, throughput=4.98MB/sec 2024-01-13T18:22:33.759 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5Yg6N3rQx9vS-0N off=20101275 len=2003204 2024-01-13T18:22:33.761 INFO:tasks.workunit.client.0.smithi084.stdout:op 447 completed, throughput=5MB/sec 2024-01-13T18:22:33.761 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Dvq3cGnrroCWpqt off=1980137 len=1795867 2024-01-13T18:22:33.765 INFO:tasks.workunit.client.0.smithi084.stdout:op 448 completed, throughput=5.02MB/sec 2024-01-13T18:22:34.765 INFO:tasks.workunit.client.0.smithi084.stdout: 89: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:34.765 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QpFhIClI9i_rmul off=10509869 len=1496949 2024-01-13T18:22:34.774 INFO:tasks.workunit.client.0.smithi084.stdout:op 449 completed, throughput=4.98MB/sec 2024-01-13T18:22:34.774 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JoIhY1xKXU-ewWU off=11723566 len=1348317 2024-01-13T18:22:34.776 INFO:tasks.workunit.client.0.smithi084.stdout:op 450 completed, throughput=4.99MB/sec 2024-01-13T18:22:34.776 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZtLDnR73kzNCMA4 off=9396525 len=1085281 2024-01-13T18:22:34.781 INFO:tasks.workunit.client.0.smithi084.stdout:op 451 completed, throughput=5MB/sec 2024-01-13T18:22:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:35 smithi099 ceph-mon[138788]: pgmap v1523: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:22:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:35 smithi084 ceph-mon[116404]: pgmap v1523: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:22:35.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:35 smithi084 ceph-mon[119097]: pgmap v1523: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:22:35.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:35.781 INFO:tasks.workunit.client.0.smithi084.stdout: 90: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:35.781 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-a7Xlm_qd7TnX8jV off=2252462 len=1272918 2024-01-13T18:22:35.783 INFO:tasks.workunit.client.0.smithi084.stdout:op 452 completed, throughput=4.96MB/sec 2024-01-13T18:22:35.783 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5AiOXhHUKpGAyg9 off=1584061 len=1404182 2024-01-13T18:22:35.791 INFO:tasks.workunit.client.0.smithi084.stdout:op 453 completed, throughput=4.97MB/sec 2024-01-13T18:22:35.791 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-M8bFrqNU-h9Gc1i off=18612488 len=1166188 2024-01-13T18:22:35.797 INFO:tasks.workunit.client.0.smithi084.stdout:op 454 completed, throughput=4.99MB/sec 2024-01-13T18:22:35.797 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U9-3MnyxXjjDbwK off=19364161 len=495992 2024-01-13T18:22:35.798 INFO:tasks.workunit.client.0.smithi084.stdout:op 455 completed, throughput=4.99MB/sec 2024-01-13T18:22:35.798 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AkXRNTeuLQId9-C off=9499570 len=1883987 2024-01-13T18:22:35.802 INFO:tasks.workunit.client.0.smithi084.stdout:op 456 completed, throughput=5.01MB/sec 2024-01-13T18:22:36.802 INFO:tasks.workunit.client.0.smithi084.stdout: 91: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:36.802 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bcP-T6R03PTMyYY off=322759 len=1206264 2024-01-13T18:22:36.803 INFO:tasks.workunit.client.0.smithi084.stdout:op 457 completed, throughput=4.97MB/sec 2024-01-13T18:22:36.804 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZmzWsBl9T2lXzgm off=9635222 len=206658 2024-01-13T18:22:36.806 INFO:tasks.workunit.client.0.smithi084.stdout:op 458 completed, throughput=4.97MB/sec 2024-01-13T18:22:36.806 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LkMhpTlvgwiEZuA off=12537993 len=1909093 2024-01-13T18:22:36.808 INFO:tasks.workunit.client.0.smithi084.stdout:op 459 completed, throughput=4.99MB/sec 2024-01-13T18:22:36.808 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FawxM2NX9-vxtIx off=16093156 len=229836 2024-01-13T18:22:36.809 INFO:tasks.workunit.client.0.smithi084.stdout:op 460 completed, throughput=4.99MB/sec 2024-01-13T18:22:36.809 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-J61yGQvBdguTBgI off=3043337 len=440037 2024-01-13T18:22:36.813 INFO:tasks.workunit.client.0.smithi084.stdout:op 461 completed, throughput=5MB/sec 2024-01-13T18:22:36.813 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7p1V1TyeX5LASGX off=3533848 len=1959843 2024-01-13T18:22:36.817 INFO:tasks.workunit.client.0.smithi084.stdout:op 462 completed, throughput=5.02MB/sec 2024-01-13T18:22:37.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:37 smithi099 ceph-mon[138788]: pgmap v1524: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:37.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:37 smithi084 ceph-mon[116404]: pgmap v1524: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:37.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:37 smithi084 ceph-mon[119097]: pgmap v1524: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:37.818 INFO:tasks.workunit.client.0.smithi084.stdout: 92: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GiAmqaS0cd0tM9D off=2897211 len=1213042 2024-01-13T18:22:37.824 INFO:tasks.workunit.client.0.smithi084.stdout:op 463 completed, throughput=4.98MB/sec 2024-01-13T18:22:37.824 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sUcPfPrawozsOAl off=19015668 len=1548504 2024-01-13T18:22:37.833 INFO:tasks.workunit.client.0.smithi084.stdout:op 464 completed, throughput=4.99MB/sec 2024-01-13T18:22:37.833 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--5hh5Y5OX1DpluU off=2189924 len=1429444 2024-01-13T18:22:37.841 INFO:tasks.workunit.client.0.smithi084.stdout:op 465 completed, throughput=5MB/sec 2024-01-13T18:22:38.841 INFO:tasks.workunit.client.0.smithi084.stdout: 93: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:38.841 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-caJgQwLG_WV643t off=9570133 len=1003566 2024-01-13T18:22:38.843 INFO:tasks.workunit.client.0.smithi084.stdout:op 466 completed, throughput=4.96MB/sec 2024-01-13T18:22:38.843 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tPwrv0FUB0xaxko off=4219303 len=1214899 2024-01-13T18:22:38.848 INFO:tasks.workunit.client.0.smithi084.stdout:op 467 completed, throughput=4.97MB/sec 2024-01-13T18:22:38.848 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WTylZkYhEVCVHiX off=15040997 len=812036 2024-01-13T18:22:38.849 INFO:tasks.workunit.client.0.smithi084.stdout:op 468 completed, throughput=4.98MB/sec 2024-01-13T18:22:38.850 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-D3HLDrqHRHi1-x5 off=12395735 len=1260121 2024-01-13T18:22:38.856 INFO:tasks.workunit.client.0.smithi084.stdout:op 469 completed, throughput=4.99MB/sec 2024-01-13T18:22:38.856 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JEunQY9jv6XrV-e off=13812249 len=652977 2024-01-13T18:22:38.861 INFO:tasks.workunit.client.0.smithi084.stdout:op 470 completed, throughput=5MB/sec 2024-01-13T18:22:39.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:39 smithi084 ceph-mon[116404]: pgmap v1525: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:39.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:39 smithi084 ceph-mon[119097]: pgmap v1525: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:39.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:39 smithi099 ceph-mon[138788]: pgmap v1525: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:39.861 INFO:tasks.workunit.client.0.smithi084.stdout: 94: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:39.861 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GUwgCq4nRNQ97yA off=4697957 len=1495776 2024-01-13T18:22:39.863 INFO:tasks.workunit.client.0.smithi084.stdout:op 471 completed, throughput=4.96MB/sec 2024-01-13T18:22:39.863 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FLz4GE3CBnjUjeA off=2919898 len=834063 2024-01-13T18:22:39.864 INFO:tasks.workunit.client.0.smithi084.stdout:op 472 completed, throughput=4.97MB/sec 2024-01-13T18:22:39.864 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7-NPzRehmAYZl02 off=0 len=1150697 2024-01-13T18:22:39.865 INFO:tasks.workunit.client.0.smithi084.stdout:op 473 completed, throughput=4.98MB/sec 2024-01-13T18:22:39.865 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--yj4We4Kzj0jnTA off=18283161 len=540915 2024-01-13T18:22:39.868 INFO:tasks.workunit.client.0.smithi084.stdout:op 474 completed, throughput=4.99MB/sec 2024-01-13T18:22:39.869 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YjnM5sb4UB6MFv_ off=15791010 len=934979 2024-01-13T18:22:39.873 INFO:tasks.workunit.client.0.smithi084.stdout:op 475 completed, throughput=5MB/sec 2024-01-13T18:22:39.873 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OoGjwgGp9UbtkZJ off=15234262 len=2085798 2024-01-13T18:22:39.887 INFO:tasks.workunit.client.0.smithi084.stdout:op 476 completed, throughput=5.02MB/sec 2024-01-13T18:22:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:22:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:22:40] "GET /metrics HTTP/1.1" 200 33973 "" "Prometheus/2.43.0" 2024-01-13T18:22:40.887 INFO:tasks.workunit.client.0.smithi084.stdout: 95: throughput=4.97MB/sec pending data=0 2024-01-13T18:22:40.887 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KdxW5FrrrD4YEBC off=5574035 len=1197941 2024-01-13T18:22:40.889 INFO:tasks.workunit.client.0.smithi084.stdout:op 477 completed, throughput=4.98MB/sec 2024-01-13T18:22:40.889 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tMt9bY91VyP_GkD off=1350049 len=1489893 2024-01-13T18:22:40.890 INFO:tasks.workunit.client.0.smithi084.stdout:op 478 completed, throughput=4.99MB/sec 2024-01-13T18:22:40.890 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f7IRq3JlRRZHA6h off=20790926 len=211626 2024-01-13T18:22:40.892 INFO:tasks.workunit.client.0.smithi084.stdout:op 479 completed, throughput=4.99MB/sec 2024-01-13T18:22:40.892 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-avoTccsWEfEmy1X off=14704147 len=1651058 2024-01-13T18:22:40.893 INFO:tasks.workunit.client.0.smithi084.stdout:op 480 completed, throughput=5.01MB/sec 2024-01-13T18:22:41.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:41 smithi099 ceph-mon[138788]: pgmap v1526: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:22:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:41 smithi084 ceph-mon[116404]: pgmap v1526: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:22:41.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:41 smithi084 ceph-mon[119097]: pgmap v1526: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:22:41.894 INFO:tasks.workunit.client.0.smithi084.stdout: 96: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:41.894 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RB_UTlSWheywycx off=14560284 len=1941426 2024-01-13T18:22:41.904 INFO:tasks.workunit.client.0.smithi084.stdout:op 481 completed, throughput=4.98MB/sec 2024-01-13T18:22:41.905 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cTZmo3w_2Uj_uK- off=4285923 len=1777107 2024-01-13T18:22:41.907 INFO:tasks.workunit.client.0.smithi084.stdout:op 482 completed, throughput=4.99MB/sec 2024-01-13T18:22:41.907 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Gh1v7f7amN_tZFo off=11964227 len=902859 2024-01-13T18:22:41.912 INFO:tasks.workunit.client.0.smithi084.stdout:op 483 completed, throughput=5MB/sec 2024-01-13T18:22:42.913 INFO:tasks.workunit.client.0.smithi084.stdout: 97: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:42.913 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qb_EjKcYdwzzIqA off=19608127 len=1944188 2024-01-13T18:22:42.915 INFO:tasks.workunit.client.0.smithi084.stdout:op 484 completed, throughput=4.97MB/sec 2024-01-13T18:22:42.915 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SET6qyX3o2PBgH7 off=493557 len=2017083 2024-01-13T18:22:42.927 INFO:tasks.workunit.client.0.smithi084.stdout:op 485 completed, throughput=4.99MB/sec 2024-01-13T18:22:42.927 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bqr3Po_hVxtDYpf off=109582 len=358520 2024-01-13T18:22:42.927 INFO:tasks.workunit.client.0.smithi084.stdout:op 486 completed, throughput=4.99MB/sec 2024-01-13T18:22:42.927 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QWlZ5B5-d5d0rgV off=2010728 len=1903905 2024-01-13T18:22:42.929 INFO:tasks.workunit.client.0.smithi084.stdout:op 487 completed, throughput=5.01MB/sec 2024-01-13T18:22:43.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:43 smithi099 ceph-mon[138788]: pgmap v1527: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:22:43.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:43 smithi084 ceph-mon[116404]: pgmap v1527: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:22:43.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:43 smithi084 ceph-mon[119097]: pgmap v1527: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:22:43.929 INFO:tasks.workunit.client.0.smithi084.stdout: 98: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:43.930 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ra5jN4ldtf5MJF- off=4426533 len=1213982 2024-01-13T18:22:43.931 INFO:tasks.workunit.client.0.smithi084.stdout:op 488 completed, throughput=4.97MB/sec 2024-01-13T18:22:43.931 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3cyvIOCaHVUnj3R off=16981807 len=1996103 2024-01-13T18:22:43.939 INFO:tasks.workunit.client.0.smithi084.stdout:op 489 completed, throughput=4.99MB/sec 2024-01-13T18:22:43.939 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KhFCUA7HJd3phex off=833716 len=806369 2024-01-13T18:22:43.941 INFO:tasks.workunit.client.0.smithi084.stdout:op 490 completed, throughput=5MB/sec 2024-01-13T18:22:43.941 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aScHhFGd3JC6rC6 off=3598125 len=1573565 2024-01-13T18:22:43.943 INFO:tasks.workunit.client.0.smithi084.stdout:op 491 completed, throughput=5.01MB/sec 2024-01-13T18:22:44.943 INFO:tasks.workunit.client.0.smithi084.stdout: 99: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:44.943 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BkwPvrlY7ODd1a6 off=9609843 len=515582 2024-01-13T18:22:44.944 INFO:tasks.workunit.client.0.smithi084.stdout:op 492 completed, throughput=4.97MB/sec 2024-01-13T18:22:44.944 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2JV2GRKbXfo-2al off=10690128 len=939038 2024-01-13T18:22:44.949 INFO:tasks.workunit.client.0.smithi084.stdout:op 493 completed, throughput=4.98MB/sec 2024-01-13T18:22:44.949 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-l8ULaFv4_00ZZCN off=794454 len=305780 2024-01-13T18:22:44.952 INFO:tasks.workunit.client.0.smithi084.stdout:op 494 completed, throughput=4.98MB/sec 2024-01-13T18:22:44.952 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SsuONgtNbqsXRZN off=1061535 len=1664776 2024-01-13T18:22:44.959 INFO:tasks.workunit.client.0.smithi084.stdout:op 495 completed, throughput=5MB/sec 2024-01-13T18:22:44.959 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G7lIvSfXMoWvo1_ off=2959566 len=676693 2024-01-13T18:22:44.963 INFO:tasks.workunit.client.0.smithi084.stdout:op 496 completed, throughput=5MB/sec 2024-01-13T18:22:45.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:45 smithi099 ceph-mon[138788]: pgmap v1528: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:22:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:45 smithi084 ceph-mon[116404]: pgmap v1528: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:22:45.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:45 smithi084 ceph-mon[119097]: pgmap v1528: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:22:45.963 INFO:tasks.workunit.client.0.smithi084.stdout: 100: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:45.963 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TYtnfD9TY0QN1pV off=5693959 len=208685 2024-01-13T18:22:45.966 INFO:tasks.workunit.client.0.smithi084.stdout:op 497 completed, throughput=4.95MB/sec 2024-01-13T18:22:45.966 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LLh4fgH2GVx1YLx off=6835922 len=2076380 2024-01-13T18:22:45.968 INFO:tasks.workunit.client.0.smithi084.stdout:op 498 completed, throughput=4.97MB/sec 2024-01-13T18:22:45.968 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Xd7zG0nE6YrkmSf off=8348641 len=378353 2024-01-13T18:22:45.971 INFO:tasks.workunit.client.0.smithi084.stdout:op 499 completed, throughput=4.98MB/sec 2024-01-13T18:22:45.972 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-E1lHzRUbYdYGFtu off=3392538 len=1967302 2024-01-13T18:22:45.974 INFO:tasks.workunit.client.0.smithi084.stdout:op 500 completed, throughput=5MB/sec 2024-01-13T18:22:45.974 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xYzbJKbC8-GdhW8 off=2840104 len=1103276 2024-01-13T18:22:45.976 INFO:tasks.workunit.client.0.smithi084.stdout:op 501 completed, throughput=5.01MB/sec 2024-01-13T18:22:46.977 INFO:tasks.workunit.client.0.smithi084.stdout: 101: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:46.977 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-96kb96eqVzTPzxc off=479200 len=1658587 2024-01-13T18:22:46.985 INFO:tasks.workunit.client.0.smithi084.stdout:op 502 completed, throughput=4.97MB/sec 2024-01-13T18:22:46.985 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AbbLOg1CmDOBNP5 off=13100245 len=559098 2024-01-13T18:22:46.988 INFO:tasks.workunit.client.0.smithi084.stdout:op 503 completed, throughput=4.98MB/sec 2024-01-13T18:22:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-q6slgUE5XC3MCbh off=1887095 len=449000 2024-01-13T18:22:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:op 504 completed, throughput=4.98MB/sec 2024-01-13T18:22:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fs9LFf5Ulq5XBUb off=665578 len=1455824 2024-01-13T18:22:47.001 INFO:tasks.workunit.client.0.smithi084.stdout:op 505 completed, throughput=4.99MB/sec 2024-01-13T18:22:47.001 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-INNeWQTUwbJ9fjD off=9356825 len=1410946 2024-01-13T18:22:47.003 INFO:tasks.workunit.client.0.smithi084.stdout:op 506 completed, throughput=5.01MB/sec 2024-01-13T18:22:47.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:47 smithi099 ceph-mon[138788]: pgmap v1529: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 3 op/s 2024-01-13T18:22:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:47 smithi084 ceph-mon[116404]: pgmap v1529: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 3 op/s 2024-01-13T18:22:47.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:47 smithi084 ceph-mon[119097]: pgmap v1529: 105 pgs: 105 active+clean; 128 GiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 3 op/s 2024-01-13T18:22:48.003 INFO:tasks.workunit.client.0.smithi084.stdout: 102: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:48.003 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-00wKOw4QwP9qB4I off=13072457 len=96722 2024-01-13T18:22:48.004 INFO:tasks.workunit.client.0.smithi084.stdout:op 507 completed, throughput=4.96MB/sec 2024-01-13T18:22:48.004 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Zcywj-EWZ1gQ1La off=1831890 len=1468428 2024-01-13T18:22:48.011 INFO:tasks.workunit.client.0.smithi084.stdout:op 508 completed, throughput=4.97MB/sec 2024-01-13T18:22:48.011 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vuukUmq4t8rnV64 off=726038 len=482856 2024-01-13T18:22:48.012 INFO:tasks.workunit.client.0.smithi084.stdout:op 509 completed, throughput=4.98MB/sec 2024-01-13T18:22:48.012 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SU8IWZH3oXxH3YQ off=20005598 len=1288723 2024-01-13T18:22:48.013 INFO:tasks.workunit.client.0.smithi084.stdout:op 510 completed, throughput=4.99MB/sec 2024-01-13T18:22:48.013 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M5MK60dBqBj1DBo off=16830142 len=1435563 2024-01-13T18:22:48.015 INFO:tasks.workunit.client.0.smithi084.stdout:op 511 completed, throughput=5MB/sec 2024-01-13T18:22:49.015 INFO:tasks.workunit.client.0.smithi084.stdout: 103: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:49.015 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JR51hI7yz8w3PO7 off=132930 len=207042 2024-01-13T18:22:49.018 INFO:tasks.workunit.client.0.smithi084.stdout:op 512 completed, throughput=4.96MB/sec 2024-01-13T18:22:49.018 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-h77CO9kfgbSUIY4 off=0 len=1291148 2024-01-13T18:22:49.020 INFO:tasks.workunit.client.0.smithi084.stdout:op 513 completed, throughput=4.97MB/sec 2024-01-13T18:22:49.020 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-q_lr4yutTxqXFd- off=6840030 len=1784017 2024-01-13T18:22:49.021 INFO:tasks.workunit.client.0.smithi084.stdout:op 514 completed, throughput=4.98MB/sec 2024-01-13T18:22:49.022 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--fbEJmyxbz5bbU6 off=3352096 len=69302 2024-01-13T18:22:49.024 INFO:tasks.workunit.client.0.smithi084.stdout:op 515 completed, throughput=4.98MB/sec 2024-01-13T18:22:49.024 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Rw4889i6dXxpPb3 off=10025137 len=655702 2024-01-13T18:22:49.028 INFO:tasks.workunit.client.0.smithi084.stdout:op 516 completed, throughput=4.99MB/sec 2024-01-13T18:22:49.028 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Xd7zG0nE6YrkmSf off=5838965 len=340879 2024-01-13T18:22:49.031 INFO:tasks.workunit.client.0.smithi084.stdout:op 517 completed, throughput=4.99MB/sec 2024-01-13T18:22:49.031 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pAVWH97uz9qwiAq off=4274387 len=1884722 2024-01-13T18:22:49.043 INFO:tasks.workunit.client.0.smithi084.stdout:op 518 completed, throughput=5.01MB/sec 2024-01-13T18:22:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:49 smithi084 ceph-mon[116404]: pgmap v1530: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:49.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:49 smithi084 ceph-mon[119097]: pgmap v1530: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:49.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:49 smithi099 ceph-mon[138788]: pgmap v1530: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:22:50.043 INFO:tasks.workunit.client.0.smithi084.stdout: 104: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:50.043 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jt9HA-GeI8ayCTq off=5990493 len=906078 2024-01-13T18:22:50.045 INFO:tasks.workunit.client.0.smithi084.stdout:op 519 completed, throughput=4.97MB/sec 2024-01-13T18:22:50.045 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XGhexROTeIE7CD_ off=4609421 len=1325734 2024-01-13T18:22:50.047 INFO:tasks.workunit.client.0.smithi084.stdout:op 520 completed, throughput=4.98MB/sec 2024-01-13T18:22:50.047 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nJyHZxkoj2rgkmq off=840229 len=1683607 2024-01-13T18:22:50.054 INFO:tasks.workunit.client.0.smithi084.stdout:op 521 completed, throughput=5MB/sec 2024-01-13T18:22:50.054 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WyBifHqJuPK-gxd off=674481 len=1109466 2024-01-13T18:22:50.056 INFO:tasks.workunit.client.0.smithi084.stdout:op 522 completed, throughput=5.01MB/sec 2024-01-13T18:22:50.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:50.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:22:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:22:50] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:22:50.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:50.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:22:51.056 INFO:tasks.workunit.client.0.smithi084.stdout: 105: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:51.056 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-keOyJ3oVd1g2LLp off=5580737 len=371785 2024-01-13T18:22:51.057 INFO:tasks.workunit.client.0.smithi084.stdout:op 523 completed, throughput=4.96MB/sec 2024-01-13T18:22:51.057 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TxvyJpO_muXNARB off=10274261 len=906143 2024-01-13T18:22:51.059 INFO:tasks.workunit.client.0.smithi084.stdout:op 524 completed, throughput=4.97MB/sec 2024-01-13T18:22:51.059 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x5Z14quwRaiVjqC off=5874860 len=571045 2024-01-13T18:22:51.063 INFO:tasks.workunit.client.0.smithi084.stdout:op 525 completed, throughput=4.98MB/sec 2024-01-13T18:22:51.063 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QfbLeO4TMiwBdDe off=479734 len=1078115 2024-01-13T18:22:51.064 INFO:tasks.workunit.client.0.smithi084.stdout:op 526 completed, throughput=4.99MB/sec 2024-01-13T18:22:51.064 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mW2F3Da2tRp461x off=10481317 len=293597 2024-01-13T18:22:51.072 INFO:tasks.workunit.client.0.smithi084.stdout:op 527 completed, throughput=4.99MB/sec 2024-01-13T18:22:51.073 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xc4-X-lrX_MPaeK off=2805436 len=1427022 2024-01-13T18:22:51.075 INFO:tasks.workunit.client.0.smithi084.stdout:op 528 completed, throughput=5MB/sec 2024-01-13T18:22:51.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:51 smithi084 ceph-mon[116404]: pgmap v1531: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:22:51.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:51 smithi084 ceph-mon[119097]: pgmap v1531: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:22:51.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:51 smithi099 ceph-mon[138788]: pgmap v1531: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:22:52.076 INFO:tasks.workunit.client.0.smithi084.stdout: 106: throughput=4.95MB/sec pending data=0 2024-01-13T18:22:52.076 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7WUDksyvo2Ei1vw off=2124408 len=122178 2024-01-13T18:22:52.079 INFO:tasks.workunit.client.0.smithi084.stdout:op 529 completed, throughput=4.96MB/sec 2024-01-13T18:22:52.079 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LPtMf4Eh4YClrIH off=2440549 len=864882 2024-01-13T18:22:52.084 INFO:tasks.workunit.client.0.smithi084.stdout:op 530 completed, throughput=4.96MB/sec 2024-01-13T18:22:52.084 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3D0nhi8tJi7-uFJ off=3248760 len=1809958 2024-01-13T18:22:52.093 INFO:tasks.workunit.client.0.smithi084.stdout:op 531 completed, throughput=4.98MB/sec 2024-01-13T18:22:52.093 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BqLJJO4G2L9lWlZ off=11114512 len=1609025 2024-01-13T18:22:52.102 INFO:tasks.workunit.client.0.smithi084.stdout:op 532 completed, throughput=4.99MB/sec 2024-01-13T18:22:52.102 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HL8DAFuImHgyLBU off=4547167 len=1576393 2024-01-13T18:22:52.103 INFO:tasks.workunit.client.0.smithi084.stdout:op 533 completed, throughput=5.01MB/sec 2024-01-13T18:22:53.104 INFO:tasks.workunit.client.0.smithi084.stdout: 107: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:53.104 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj---8LThXVqsS7Rr0 off=1400927 len=520913 2024-01-13T18:22:53.107 INFO:tasks.workunit.client.0.smithi084.stdout:op 534 completed, throughput=4.96MB/sec 2024-01-13T18:22:53.107 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0WGl5spLsFbsH4q off=1512178 len=330641 2024-01-13T18:22:53.111 INFO:tasks.workunit.client.0.smithi084.stdout:op 535 completed, throughput=4.97MB/sec 2024-01-13T18:22:53.111 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nGaFQvgwuuNQw9- off=1647656 len=992186 2024-01-13T18:22:53.113 INFO:tasks.workunit.client.0.smithi084.stdout:op 536 completed, throughput=4.98MB/sec 2024-01-13T18:22:53.113 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bHnlX2k-DufTZQS off=3283001 len=471986 2024-01-13T18:22:53.114 INFO:tasks.workunit.client.0.smithi084.stdout:op 537 completed, throughput=4.98MB/sec 2024-01-13T18:22:53.114 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5Q94SdgrSiC-Sq4 off=11582783 len=2023172 2024-01-13T18:22:53.117 INFO:tasks.workunit.client.0.smithi084.stdout:op 538 completed, throughput=5MB/sec 2024-01-13T18:22:53.117 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XonAFW5yeGNBi_I off=8714215 len=1619087 2024-01-13T18:22:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:op 539 completed, throughput=5.01MB/sec 2024-01-13T18:22:53.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:53 smithi099 ceph-mon[138788]: pgmap v1532: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 3 op/s 2024-01-13T18:22:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:53 smithi084 ceph-mon[116404]: pgmap v1532: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 3 op/s 2024-01-13T18:22:53.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:53 smithi084 ceph-mon[119097]: pgmap v1532: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 3 op/s 2024-01-13T18:22:54.120 INFO:tasks.workunit.client.0.smithi084.stdout: 108: throughput=4.97MB/sec pending data=0 2024-01-13T18:22:54.120 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HDNKtfYXKNtTxqb off=5279024 len=907040 2024-01-13T18:22:54.121 INFO:tasks.workunit.client.0.smithi084.stdout:op 540 completed, throughput=4.97MB/sec 2024-01-13T18:22:54.121 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nV4_uNnx8zXvbSM off=11952894 len=405122 2024-01-13T18:22:54.122 INFO:tasks.workunit.client.0.smithi084.stdout:op 541 completed, throughput=4.98MB/sec 2024-01-13T18:22:54.122 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8kEq_xeRBeHo9VK off=6318630 len=1484734 2024-01-13T18:22:54.131 INFO:tasks.workunit.client.0.smithi084.stdout:op 542 completed, throughput=4.99MB/sec 2024-01-13T18:22:54.131 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-K1W8MJFBvMe6f1b off=482440 len=1241974 2024-01-13T18:22:54.139 INFO:tasks.workunit.client.0.smithi084.stdout:op 543 completed, throughput=5MB/sec 2024-01-13T18:22:54.139 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2bz0SZMkYyI0Ekj off=5157142 len=1309987 2024-01-13T18:22:54.140 INFO:tasks.workunit.client.0.smithi084.stdout:op 544 completed, throughput=5.01MB/sec 2024-01-13T18:22:55.141 INFO:tasks.workunit.client.0.smithi084.stdout: 109: throughput=4.97MB/sec pending data=0 2024-01-13T18:22:55.141 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gSuQ_thtre7hkQi off=3791377 len=1818471 2024-01-13T18:22:55.150 INFO:tasks.workunit.client.0.smithi084.stdout:op 545 completed, throughput=4.98MB/sec 2024-01-13T18:22:55.150 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xV3ebi3fmsggjqr off=769026 len=1901827 2024-01-13T18:22:55.152 INFO:tasks.workunit.client.0.smithi084.stdout:op 546 completed, throughput=5MB/sec 2024-01-13T18:22:55.152 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_vvtsoZtNzjKtFx off=232754 len=913532 2024-01-13T18:22:55.153 INFO:tasks.workunit.client.0.smithi084.stdout:op 547 completed, throughput=5.01MB/sec 2024-01-13T18:22:55.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:55 smithi099 ceph-mon[138788]: pgmap v1533: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:22:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:55 smithi084 ceph-mon[116404]: pgmap v1533: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:22:55.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:55 smithi084 ceph-mon[119097]: pgmap v1533: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:22:56.154 INFO:tasks.workunit.client.0.smithi084.stdout: 110: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:56.154 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-N1ZVAQqaAXtxkG8 off=2788989 len=247760 2024-01-13T18:22:56.157 INFO:tasks.workunit.client.0.smithi084.stdout:op 548 completed, throughput=4.96MB/sec 2024-01-13T18:22:56.157 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-paAhLIbgkPyD2hs off=4585467 len=1028974 2024-01-13T18:22:56.159 INFO:tasks.workunit.client.0.smithi084.stdout:op 549 completed, throughput=4.97MB/sec 2024-01-13T18:22:56.159 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1x4iTE2GMLVXpEk off=23044069 len=658230 2024-01-13T18:22:56.163 INFO:tasks.workunit.client.0.smithi084.stdout:op 550 completed, throughput=4.98MB/sec 2024-01-13T18:22:56.163 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6QjtaK4r8Bn7T0J off=5513130 len=532361 2024-01-13T18:22:56.164 INFO:tasks.workunit.client.0.smithi084.stdout:op 551 completed, throughput=4.98MB/sec 2024-01-13T18:22:56.164 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SJNqgTrqseKPqTh off=2044153 len=2050729 2024-01-13T18:22:56.166 INFO:tasks.workunit.client.0.smithi084.stdout:op 552 completed, throughput=5MB/sec 2024-01-13T18:22:56.166 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-O0CjTDHvy2zyIPR off=2333826 len=239694 2024-01-13T18:22:56.169 INFO:tasks.workunit.client.0.smithi084.stdout:op 553 completed, throughput=5MB/sec 2024-01-13T18:22:57.169 INFO:tasks.workunit.client.0.smithi084.stdout: 111: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:57.169 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1tv_RwBn7aVB_MX off=796925 len=1710996 2024-01-13T18:22:57.179 INFO:tasks.workunit.client.0.smithi084.stdout:op 554 completed, throughput=4.97MB/sec 2024-01-13T18:22:57.179 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zOYUG19qwzNGoXi off=13500872 len=1742547 2024-01-13T18:22:57.188 INFO:tasks.workunit.client.0.smithi084.stdout:op 555 completed, throughput=4.98MB/sec 2024-01-13T18:22:57.188 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PI_CoFo_FOOQ66w off=2831195 len=154218 2024-01-13T18:22:57.188 INFO:tasks.workunit.client.0.smithi084.stdout:op 556 completed, throughput=4.99MB/sec 2024-01-13T18:22:57.188 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--AjXYDUqqnjNUXv off=937528 len=910773 2024-01-13T18:22:57.190 INFO:tasks.workunit.client.0.smithi084.stdout:op 557 completed, throughput=4.99MB/sec 2024-01-13T18:22:57.190 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Iabjlt1D6k1UblO off=48381 len=490780 2024-01-13T18:22:57.191 INFO:tasks.workunit.client.0.smithi084.stdout:op 558 completed, throughput=5MB/sec 2024-01-13T18:22:57.191 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5_wBhqrF_sNs1ej off=15754150 len=648463 2024-01-13T18:22:57.194 INFO:tasks.workunit.client.0.smithi084.stdout:op 559 completed, throughput=5MB/sec 2024-01-13T18:22:57.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:57 smithi099 ceph-mon[138788]: pgmap v1534: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:22:57.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:57 smithi084 ceph-mon[116404]: pgmap v1534: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:22:57.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:57 smithi084 ceph-mon[119097]: pgmap v1534: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:22:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: 112: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:58.195 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U2sOQ3QDZ6JJvnE off=33849 len=1209635 2024-01-13T18:22:58.196 INFO:tasks.workunit.client.0.smithi084.stdout:op 560 completed, throughput=4.97MB/sec 2024-01-13T18:22:58.197 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DgycP7IKS2vl4jM off=1493061 len=1595456 2024-01-13T18:22:58.204 INFO:tasks.workunit.client.0.smithi084.stdout:op 561 completed, throughput=4.98MB/sec 2024-01-13T18:22:58.204 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IrzFSz1mVzfPw-e off=6267564 len=858931 2024-01-13T18:22:58.209 INFO:tasks.workunit.client.0.smithi084.stdout:op 562 completed, throughput=4.99MB/sec 2024-01-13T18:22:58.209 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-F1KTWyGtCIxjf3l off=18840873 len=1951549 2024-01-13T18:22:58.211 INFO:tasks.workunit.client.0.smithi084.stdout:op 563 completed, throughput=5.01MB/sec 2024-01-13T18:22:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: 113: throughput=4.96MB/sec pending data=0 2024-01-13T18:22:59.212 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XrfGCymnYCxsler off=17295899 len=351617 2024-01-13T18:22:59.215 INFO:tasks.workunit.client.0.smithi084.stdout:op 564 completed, throughput=4.96MB/sec 2024-01-13T18:22:59.215 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VtGxolTh0qnNaUb off=17659695 len=1773853 2024-01-13T18:22:59.225 INFO:tasks.workunit.client.0.smithi084.stdout:op 565 completed, throughput=4.98MB/sec 2024-01-13T18:22:59.225 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QQMkesNohFMHADK off=8844329 len=460305 2024-01-13T18:22:59.226 INFO:tasks.workunit.client.0.smithi084.stdout:op 566 completed, throughput=4.98MB/sec 2024-01-13T18:22:59.226 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-P-XDvBSx0feVPsp off=1295263 len=1479413 2024-01-13T18:22:59.228 INFO:tasks.workunit.client.0.smithi084.stdout:op 567 completed, throughput=4.99MB/sec 2024-01-13T18:22:59.228 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8sVm1B9SRBCzVLN off=3629536 len=303147 2024-01-13T18:22:59.228 INFO:tasks.workunit.client.0.smithi084.stdout:op 568 completed, throughput=5MB/sec 2024-01-13T18:22:59.228 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SU8IWZH3oXxH3YQ off=15447785 len=372200 2024-01-13T18:22:59.231 INFO:tasks.workunit.client.0.smithi084.stdout:op 569 completed, throughput=5MB/sec 2024-01-13T18:22:59.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:22:59 smithi084 ceph-mon[116404]: pgmap v1535: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:22:59.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:22:59 smithi084 ceph-mon[119097]: pgmap v1535: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:22:59.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:22:59 smithi099 ceph-mon[138788]: pgmap v1535: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:23:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: 114: throughput=4.96MB/sec pending data=0 2024-01-13T18:23:00.231 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-i6w7RNkJTZh0WtO off=17666298 len=900151 2024-01-13T18:23:00.232 INFO:tasks.workunit.client.0.smithi084.stdout:op 570 completed, throughput=4.96MB/sec 2024-01-13T18:23:00.233 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-t5_hsVkQhnl8TIF off=10097848 len=1065620 2024-01-13T18:23:00.238 INFO:tasks.workunit.client.0.smithi084.stdout:op 571 completed, throughput=4.97MB/sec 2024-01-13T18:23:00.238 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kp5bQ0vtHDtDHll off=14535644 len=1805163 2024-01-13T18:23:00.245 INFO:tasks.workunit.client.0.smithi084.stdout:op 572 completed, throughput=4.99MB/sec 2024-01-13T18:23:00.246 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3ySJJQabmZcDPB9 off=1747621 len=415088 2024-01-13T18:23:00.249 INFO:tasks.workunit.client.0.smithi084.stdout:op 573 completed, throughput=4.99MB/sec 2024-01-13T18:23:00.249 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bEPwmm54n3IB3Vj off=3041248 len=416801 2024-01-13T18:23:00.252 INFO:tasks.workunit.client.0.smithi084.stdout:op 574 completed, throughput=4.99MB/sec 2024-01-13T18:23:00.252 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V7tG5ARgQ5gxPq1 off=12302082 len=1063949 2024-01-13T18:23:00.253 INFO:tasks.workunit.client.0.smithi084.stdout:op 575 completed, throughput=5MB/sec 2024-01-13T18:23:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:23:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:23:00] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:23:01.254 INFO:tasks.workunit.client.0.smithi084.stdout: 115: throughput=4.96MB/sec pending data=0 2024-01-13T18:23:01.254 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RIizaqMXIkkn6K5 off=10846687 len=718186 2024-01-13T18:23:01.255 INFO:tasks.workunit.client.0.smithi084.stdout:op 576 completed, throughput=4.97MB/sec 2024-01-13T18:23:01.255 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nbK1G0BDqJvmHKF off=1080110 len=547537 2024-01-13T18:23:01.256 INFO:tasks.workunit.client.0.smithi084.stdout:op 577 completed, throughput=4.97MB/sec 2024-01-13T18:23:01.256 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zKAn81CxfaBTH75 off=6908063 len=548997 2024-01-13T18:23:01.259 INFO:tasks.workunit.client.0.smithi084.stdout:op 578 completed, throughput=4.97MB/sec 2024-01-13T18:23:01.259 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--wXZgQQyyKvb6up off=2749794 len=1538782 2024-01-13T18:23:01.263 INFO:tasks.workunit.client.0.smithi084.stdout:op 579 completed, throughput=4.99MB/sec 2024-01-13T18:23:01.263 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wzmUPi2PvxC2xaK off=8488781 len=742546 2024-01-13T18:23:01.268 INFO:tasks.workunit.client.0.smithi084.stdout:op 580 completed, throughput=4.99MB/sec 2024-01-13T18:23:01.268 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dD2FTAVeBmtUARs off=14426621 len=276364 2024-01-13T18:23:01.269 INFO:tasks.workunit.client.0.smithi084.stdout:op 581 completed, throughput=4.99MB/sec 2024-01-13T18:23:01.269 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JY1pjPtFwz10lEu off=4684396 len=1290021 2024-01-13T18:23:01.275 INFO:tasks.workunit.client.0.smithi084.stdout:op 582 completed, throughput=5.01MB/sec 2024-01-13T18:23:01.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:01 smithi099 ceph-mon[138788]: pgmap v1536: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:23:01.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:01 smithi084 ceph-mon[116404]: pgmap v1536: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:23:01.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:01 smithi084 ceph-mon[119097]: pgmap v1536: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:23:02.276 INFO:tasks.workunit.client.0.smithi084.stdout: 116: throughput=4.96MB/sec pending data=0 2024-01-13T18:23:02.276 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-h9FhSz13fM2wgy4 off=4492034 len=1708964 2024-01-13T18:23:02.278 INFO:tasks.workunit.client.0.smithi084.stdout:op 583 completed, throughput=4.98MB/sec 2024-01-13T18:23:02.278 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bEPwmm54n3IB3Vj off=4995911 len=1130294 2024-01-13T18:23:02.284 INFO:tasks.workunit.client.0.smithi084.stdout:op 584 completed, throughput=4.99MB/sec 2024-01-13T18:23:02.284 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mmmTJNT0H4UFhUe off=5970105 len=905776 2024-01-13T18:23:02.285 INFO:tasks.workunit.client.0.smithi084.stdout:op 585 completed, throughput=4.99MB/sec 2024-01-13T18:23:02.285 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4JHgt9-cT3kAfG6 off=2620152 len=76579 2024-01-13T18:23:02.287 INFO:tasks.workunit.client.0.smithi084.stdout:op 586 completed, throughput=4.99MB/sec 2024-01-13T18:23:02.287 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sKGiBdsTtcLKEU- off=5930484 len=326415 2024-01-13T18:23:02.288 INFO:tasks.workunit.client.0.smithi084.stdout:op 587 completed, throughput=5MB/sec 2024-01-13T18:23:02.288 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TP29iNbWiGhIOtS off=3152005 len=1670712 2024-01-13T18:23:02.295 INFO:tasks.workunit.client.0.smithi084.stdout:op 588 completed, throughput=5.01MB/sec 2024-01-13T18:23:03.295 INFO:tasks.workunit.client.0.smithi084.stdout: 117: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:03.295 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KfBojPK_ggncZNA off=10497810 len=558984 2024-01-13T18:23:03.298 INFO:tasks.workunit.client.0.smithi084.stdout:op 589 completed, throughput=4.97MB/sec 2024-01-13T18:23:03.299 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6ooS1pQ5FPsKJtp off=6955606 len=157225 2024-01-13T18:23:03.299 INFO:tasks.workunit.client.0.smithi084.stdout:op 590 completed, throughput=4.97MB/sec 2024-01-13T18:23:03.300 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ab-xZpZLnz7VVvo off=278555 len=83513 2024-01-13T18:23:03.302 INFO:tasks.workunit.client.0.smithi084.stdout:op 591 completed, throughput=4.97MB/sec 2024-01-13T18:23:03.302 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-48z7iqhCjxMIs5t off=7032222 len=1487337 2024-01-13T18:23:03.309 INFO:tasks.workunit.client.0.smithi084.stdout:op 592 completed, throughput=4.98MB/sec 2024-01-13T18:23:03.309 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2NK5yi9IgPQGw64 off=16085302 len=516072 2024-01-13T18:23:03.313 INFO:tasks.workunit.client.0.smithi084.stdout:op 593 completed, throughput=4.99MB/sec 2024-01-13T18:23:03.313 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V5oYGj6zuPFo48c off=14755703 len=1187747 2024-01-13T18:23:03.314 INFO:tasks.workunit.client.0.smithi084.stdout:op 594 completed, throughput=5MB/sec 2024-01-13T18:23:03.314 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qrRX3JznXtM5HQh off=8383483 len=1249632 2024-01-13T18:23:03.317 INFO:tasks.workunit.client.0.smithi084.stdout:op 595 completed, throughput=5.01MB/sec 2024-01-13T18:23:03.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:03 smithi099 ceph-mon[138788]: pgmap v1537: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:23:03.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:03 smithi084 ceph-mon[116404]: pgmap v1537: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:23:03.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:03 smithi084 ceph-mon[119097]: pgmap v1537: 105 pgs: 105 active+clean; 128 GiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:23:04.317 INFO:tasks.workunit.client.0.smithi084.stdout: 118: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:04.317 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nNNt5eKTc7py6kA off=16825184 len=24078 2024-01-13T18:23:04.319 INFO:tasks.workunit.client.0.smithi084.stdout:op 596 completed, throughput=4.97MB/sec 2024-01-13T18:23:04.320 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rwn6lF9xNRfXZgy off=4654870 len=939636 2024-01-13T18:23:04.321 INFO:tasks.workunit.client.0.smithi084.stdout:op 597 completed, throughput=4.97MB/sec 2024-01-13T18:23:04.321 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nBIfNeqyOLHyVTr off=4252422 len=406458 2024-01-13T18:23:04.321 INFO:tasks.workunit.client.0.smithi084.stdout:op 598 completed, throughput=4.98MB/sec 2024-01-13T18:23:04.321 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Cmwn56gNydqCDVU off=3372915 len=925098 2024-01-13T18:23:04.326 INFO:tasks.workunit.client.0.smithi084.stdout:op 599 completed, throughput=4.98MB/sec 2024-01-13T18:23:04.326 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dmN6bdmjUTHGlS2 off=7782809 len=826744 2024-01-13T18:23:04.331 INFO:tasks.workunit.client.0.smithi084.stdout:op 600 completed, throughput=4.99MB/sec 2024-01-13T18:23:04.331 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rRy_FAPj80iEBk8 off=534724 len=628164 2024-01-13T18:23:04.332 INFO:tasks.workunit.client.0.smithi084.stdout:op 601 completed, throughput=5MB/sec 2024-01-13T18:23:04.332 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SxH7syXWycBc7yR off=3585711 len=1535446 2024-01-13T18:23:04.340 INFO:tasks.workunit.client.0.smithi084.stdout:op 602 completed, throughput=5.01MB/sec 2024-01-13T18:23:04.868 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:23:04 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=sqlstore.transactions t=2024-01-13T18:23:04.428678942Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-01-13T18:23:05.340 INFO:tasks.workunit.client.0.smithi084.stdout: 119: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:05.340 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_UPfJ63NqKlNqsU off=20896272 len=1228208 2024-01-13T18:23:05.341 INFO:tasks.workunit.client.0.smithi084.stdout:op 603 completed, throughput=4.98MB/sec 2024-01-13T18:23:05.341 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6ddRpzfpWaOUCxs off=7292994 len=1283922 2024-01-13T18:23:05.345 INFO:tasks.workunit.client.0.smithi084.stdout:op 604 completed, throughput=4.99MB/sec 2024-01-13T18:23:05.345 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vF4Yll6gLcAkJme off=10072620 len=350089 2024-01-13T18:23:05.348 INFO:tasks.workunit.client.0.smithi084.stdout:op 605 completed, throughput=4.99MB/sec 2024-01-13T18:23:05.348 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dXkNssRALOpz9FG off=16201184 len=933104 2024-01-13T18:23:05.349 INFO:tasks.workunit.client.0.smithi084.stdout:op 606 completed, throughput=5MB/sec 2024-01-13T18:23:05.349 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jjggQxBMcvsgP9n off=1164581 len=905761 2024-01-13T18:23:05.350 INFO:tasks.workunit.client.0.smithi084.stdout:op 607 completed, throughput=5MB/sec 2024-01-13T18:23:05.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:05 smithi099 ceph-mon[138788]: pgmap v1538: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:23:05.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:05 smithi084 ceph-mon[116404]: pgmap v1538: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:23:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:05 smithi084 ceph-mon[119097]: pgmap v1538: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:23:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:06.351 INFO:tasks.workunit.client.0.smithi084.stdout: 120: throughput=4.96MB/sec pending data=0 2024-01-13T18:23:06.351 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WNv4Q2HZ7us4bcb off=12014171 len=1587525 2024-01-13T18:23:06.360 INFO:tasks.workunit.client.0.smithi084.stdout:op 608 completed, throughput=4.97MB/sec 2024-01-13T18:23:06.360 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-a0PB8F4VEpVWYUw off=13904907 len=1221052 2024-01-13T18:23:06.366 INFO:tasks.workunit.client.0.smithi084.stdout:op 609 completed, throughput=4.98MB/sec 2024-01-13T18:23:06.367 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hHCAH99vRpKi8YA off=8507349 len=1584076 2024-01-13T18:23:06.368 INFO:tasks.workunit.client.0.smithi084.stdout:op 610 completed, throughput=4.99MB/sec 2024-01-13T18:23:06.368 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zUWE7XIBIR9dWIr off=11174611 len=772961 2024-01-13T18:23:06.372 INFO:tasks.workunit.client.0.smithi084.stdout:op 611 completed, throughput=5MB/sec 2024-01-13T18:23:07.373 INFO:tasks.workunit.client.0.smithi084.stdout: 121: throughput=4.96MB/sec pending data=0 2024-01-13T18:23:07.373 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kZNnoFJBTW-z7EI off=1075533 len=97780 2024-01-13T18:23:07.373 INFO:tasks.workunit.client.0.smithi084.stdout:op 612 completed, throughput=4.96MB/sec 2024-01-13T18:23:07.374 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6Zr_Nhy_C2V_9jn off=1117383 len=1760828 2024-01-13T18:23:07.383 INFO:tasks.workunit.client.0.smithi084.stdout:op 613 completed, throughput=4.97MB/sec 2024-01-13T18:23:07.383 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PgWasCUscJjSpoR off=180753 len=111456 2024-01-13T18:23:07.386 INFO:tasks.workunit.client.0.smithi084.stdout:op 614 completed, throughput=4.98MB/sec 2024-01-13T18:23:07.386 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YPvpSVqOY6exB5M off=530435 len=1061522 2024-01-13T18:23:07.387 INFO:tasks.workunit.client.0.smithi084.stdout:op 615 completed, throughput=4.98MB/sec 2024-01-13T18:23:07.387 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h9FhSz13fM2wgy4 off=3996255 len=358594 2024-01-13T18:23:07.390 INFO:tasks.workunit.client.0.smithi084.stdout:op 616 completed, throughput=4.99MB/sec 2024-01-13T18:23:07.390 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jt9HA-GeI8ayCTq off=11556820 len=1357435 2024-01-13T18:23:07.393 INFO:tasks.workunit.client.0.smithi084.stdout:op 617 completed, throughput=5MB/sec 2024-01-13T18:23:07.393 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-O7SpW1eZ24PlS2z off=7765101 len=2095923 2024-01-13T18:23:07.395 INFO:tasks.workunit.client.0.smithi084.stdout:op 618 completed, throughput=5.01MB/sec 2024-01-13T18:23:07.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:07 smithi099 ceph-mon[138788]: pgmap v1539: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:23:07.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:07 smithi084 ceph-mon[116404]: pgmap v1539: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:23:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:07 smithi084 ceph-mon[119097]: pgmap v1539: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:23:08.396 INFO:tasks.workunit.client.0.smithi084.stdout: 122: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:08.397 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k9X4QuqGkadRYkO off=3027785 len=406071 2024-01-13T18:23:08.397 INFO:tasks.workunit.client.0.smithi084.stdout:op 619 completed, throughput=4.98MB/sec 2024-01-13T18:23:08.398 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lmn_1_B535QcIaq off=4253148 len=23533 2024-01-13T18:23:08.398 INFO:tasks.workunit.client.0.smithi084.stdout:op 620 completed, throughput=4.98MB/sec 2024-01-13T18:23:08.398 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Tyhwsngq24BFnN3 off=2928394 len=1165167 2024-01-13T18:23:08.404 INFO:tasks.workunit.client.0.smithi084.stdout:op 621 completed, throughput=4.98MB/sec 2024-01-13T18:23:08.404 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--zlCbi9M-pXYEM9 off=327021 len=1534684 2024-01-13T18:23:08.406 INFO:tasks.workunit.client.0.smithi084.stdout:op 622 completed, throughput=5MB/sec 2024-01-13T18:23:08.406 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9GE63z2zH-UE6kz off=1433715 len=301749 2024-01-13T18:23:08.408 INFO:tasks.workunit.client.0.smithi084.stdout:op 623 completed, throughput=5MB/sec 2024-01-13T18:23:08.409 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XJjOi07wtLUI1fb off=2873838 len=2059868 2024-01-13T18:23:08.419 INFO:tasks.workunit.client.0.smithi084.stdout:op 624 completed, throughput=5.01MB/sec 2024-01-13T18:23:09.419 INFO:tasks.workunit.client.0.smithi084.stdout: 123: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:09.420 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Tcoj5mNDHdfaUq0 off=5541538 len=7724 2024-01-13T18:23:09.420 INFO:tasks.workunit.client.0.smithi084.stdout:op 625 completed, throughput=4.97MB/sec 2024-01-13T18:23:09.420 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_sfbNf0YGmyfeej off=9250553 len=773447 2024-01-13T18:23:09.421 INFO:tasks.workunit.client.0.smithi084.stdout:op 626 completed, throughput=4.98MB/sec 2024-01-13T18:23:09.422 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tHAkXbYlNvRvz3a off=2740882 len=1105499 2024-01-13T18:23:09.423 INFO:tasks.workunit.client.0.smithi084.stdout:op 627 completed, throughput=4.99MB/sec 2024-01-13T18:23:09.423 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lU6elT-jH2HWQ-9 off=6537539 len=1375869 2024-01-13T18:23:09.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:09 smithi084 ceph-mon[116404]: pgmap v1540: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:23:09.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:09 smithi084 ceph-mon[119097]: pgmap v1540: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:23:09.430 INFO:tasks.workunit.client.0.smithi084.stdout:op 628 completed, throughput=5MB/sec 2024-01-13T18:23:09.430 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IEVgdXjZVJ9TSs_ off=365759 len=750203 2024-01-13T18:23:09.434 INFO:tasks.workunit.client.0.smithi084.stdout:op 629 completed, throughput=5MB/sec 2024-01-13T18:23:09.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:09 smithi099 ceph-mon[138788]: pgmap v1540: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:23:10.434 INFO:tasks.workunit.client.0.smithi084.stdout: 124: throughput=4.96MB/sec pending data=0 2024-01-13T18:23:10.435 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LkrFPabXdnLW4kh off=5827591 len=1503414 2024-01-13T18:23:10.441 INFO:tasks.workunit.client.0.smithi084.stdout:op 630 completed, throughput=4.97MB/sec 2024-01-13T18:23:10.441 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BTfhWIx-jBUqT1V off=1419766 len=1604941 2024-01-13T18:23:10.450 INFO:tasks.workunit.client.0.smithi084.stdout:op 631 completed, throughput=4.99MB/sec 2024-01-13T18:23:10.450 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bZb1asUY-8kMvaM off=1579330 len=939518 2024-01-13T18:23:10.455 INFO:tasks.workunit.client.0.smithi084.stdout:op 632 completed, throughput=4.99MB/sec 2024-01-13T18:23:10.455 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WyBifHqJuPK-gxd off=2069344 len=80365 2024-01-13T18:23:10.457 INFO:tasks.workunit.client.0.smithi084.stdout:op 633 completed, throughput=4.99MB/sec 2024-01-13T18:23:10.458 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HhQjpCCLCSDYL2O off=4754039 len=1408228 2024-01-13T18:23:10.463 INFO:tasks.workunit.client.0.smithi084.stdout:op 634 completed, throughput=5MB/sec 2024-01-13T18:23:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:23:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:23:10] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:23:11.464 INFO:tasks.workunit.client.0.smithi084.stdout: 125: throughput=4.96MB/sec pending data=0 2024-01-13T18:23:11.464 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mDJLbQ84Q8ocMOn off=8238968 len=1148058 2024-01-13T18:23:11.470 INFO:tasks.workunit.client.0.smithi084.stdout:op 635 completed, throughput=4.97MB/sec 2024-01-13T18:23:11.470 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--k1O_vxcWovKT88 off=4368749 len=1562576 2024-01-13T18:23:11.479 INFO:tasks.workunit.client.0.smithi084.stdout:op 636 completed, throughput=4.98MB/sec 2024-01-13T18:23:11.479 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-05BxVaK6aizwbpN off=8420260 len=938902 2024-01-13T18:23:11.481 INFO:tasks.workunit.client.0.smithi084.stdout:op 637 completed, throughput=4.99MB/sec 2024-01-13T18:23:11.481 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qcnphd9lPJW5gFP off=228559 len=1613547 2024-01-13T18:23:11.490 INFO:tasks.workunit.client.0.smithi084.stdout:op 638 completed, throughput=5MB/sec 2024-01-13T18:23:11.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:11 smithi099 ceph-mon[138788]: pgmap v1541: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:23:11.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:11 smithi084 ceph-mon[116404]: pgmap v1541: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:23:11.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:11 smithi084 ceph-mon[119097]: pgmap v1541: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:23:12.491 INFO:tasks.workunit.client.0.smithi084.stdout: 126: throughput=4.96MB/sec pending data=0 2024-01-13T18:23:12.491 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8mri0QJpn9kutQY off=7267924 len=34439 2024-01-13T18:23:12.493 INFO:tasks.workunit.client.0.smithi084.stdout:op 639 completed, throughput=4.96MB/sec 2024-01-13T18:23:12.493 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-N6qrZhwetzH5bp1 off=5268934 len=1884468 2024-01-13T18:23:12.503 INFO:tasks.workunit.client.0.smithi084.stdout:op 640 completed, throughput=4.98MB/sec 2024-01-13T18:23:12.503 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ryOU9aQcLjI2cnX off=2724156 len=1278644 2024-01-13T18:23:12.508 INFO:tasks.workunit.client.0.smithi084.stdout:op 641 completed, throughput=4.99MB/sec 2024-01-13T18:23:12.509 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TuxoPz9tLkyF0Fb off=5230294 len=890972 2024-01-13T18:23:12.514 INFO:tasks.workunit.client.0.smithi084.stdout:op 642 completed, throughput=4.99MB/sec 2024-01-13T18:23:12.514 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SrAhvwrnvm3LR4j off=16714835 len=899921 2024-01-13T18:23:12.518 INFO:tasks.workunit.client.0.smithi084.stdout:op 643 completed, throughput=5MB/sec 2024-01-13T18:23:13.519 INFO:tasks.workunit.client.0.smithi084.stdout: 127: throughput=4.96MB/sec pending data=0 2024-01-13T18:23:13.519 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CNpDTRSNOW__DjX off=7472907 len=1126267 2024-01-13T18:23:13.525 INFO:tasks.workunit.client.0.smithi084.stdout:op 644 completed, throughput=4.97MB/sec 2024-01-13T18:23:13.525 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nH2idp7IhBd9LQF off=10835596 len=699347 2024-01-13T18:23:13.526 INFO:tasks.workunit.client.0.smithi084.stdout:op 645 completed, throughput=4.97MB/sec 2024-01-13T18:23:13.526 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hHmXb66gGw8HLak off=6469486 len=1469412 2024-01-13T18:23:13.532 INFO:tasks.workunit.client.0.smithi084.stdout:op 646 completed, throughput=4.99MB/sec 2024-01-13T18:23:13.533 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-80ywZZd6ZFYQoqP off=2473901 len=1747339 2024-01-13T18:23:13.534 INFO:tasks.workunit.client.0.smithi084.stdout:op 647 completed, throughput=5MB/sec 2024-01-13T18:23:13.534 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9MCOl-5wcYbzKGo off=1043239 len=998603 2024-01-13T18:23:13.539 INFO:tasks.workunit.client.0.smithi084.stdout:op 648 completed, throughput=5.01MB/sec 2024-01-13T18:23:13.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:13 smithi099 ceph-mon[138788]: pgmap v1542: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:23:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:13 smithi084 ceph-mon[116404]: pgmap v1542: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:23:13.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:13 smithi084 ceph-mon[119097]: pgmap v1542: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:23:14.539 INFO:tasks.workunit.client.0.smithi084.stdout: 128: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:14.540 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8P04bEw7_ZBec4s off=4818892 len=1057593 2024-01-13T18:23:14.541 INFO:tasks.workunit.client.0.smithi084.stdout:op 649 completed, throughput=4.97MB/sec 2024-01-13T18:23:14.541 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tnTXk5XElP99FF3 off=10711819 len=1999778 2024-01-13T18:23:14.551 INFO:tasks.workunit.client.0.smithi084.stdout:op 650 completed, throughput=4.99MB/sec 2024-01-13T18:23:14.552 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-seoINWkljYIRQpM off=15717370 len=846478 2024-01-13T18:23:14.556 INFO:tasks.workunit.client.0.smithi084.stdout:op 651 completed, throughput=4.99MB/sec 2024-01-13T18:23:14.556 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QtluiUGRuU_cwNn off=6072788 len=1573016 2024-01-13T18:23:14.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 652 completed, throughput=5.01MB/sec 2024-01-13T18:23:15.559 INFO:tasks.workunit.client.0.smithi084.stdout: 129: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:15.560 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Aj7Ql2Bj8ljcWh4 off=5568727 len=1181222 2024-01-13T18:23:15.565 INFO:tasks.workunit.client.0.smithi084.stdout:op 653 completed, throughput=4.98MB/sec 2024-01-13T18:23:15.565 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-w_HEEsSLtNtxIaq off=1044776 len=1042407 2024-01-13T18:23:15.570 INFO:tasks.workunit.client.0.smithi084.stdout:op 654 completed, throughput=4.98MB/sec 2024-01-13T18:23:15.571 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YElq2DshIrx8iMM off=3080279 len=1291085 2024-01-13T18:23:15.572 INFO:tasks.workunit.client.0.smithi084.stdout:op 655 completed, throughput=4.99MB/sec 2024-01-13T18:23:15.572 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DkTVNQyy3U3e5nl off=3215640 len=442630 2024-01-13T18:23:15.573 INFO:tasks.workunit.client.0.smithi084.stdout:op 656 completed, throughput=5MB/sec 2024-01-13T18:23:15.573 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Xge-gL4HpdK5GH9 off=6097123 len=928091 2024-01-13T18:23:15.577 INFO:tasks.workunit.client.0.smithi084.stdout:op 657 completed, throughput=5MB/sec 2024-01-13T18:23:15.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:15 smithi099 ceph-mon[138788]: pgmap v1543: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:23:15.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:15 smithi084 ceph-mon[116404]: pgmap v1543: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:23:15.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:15 smithi084 ceph-mon[119097]: pgmap v1543: 105 pgs: 105 active+clean; 128 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:23:16.578 INFO:tasks.workunit.client.0.smithi084.stdout: 130: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:16.578 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6X_C2LfczR-jzWF off=9477503 len=998952 2024-01-13T18:23:16.583 INFO:tasks.workunit.client.0.smithi084.stdout:op 658 completed, throughput=4.97MB/sec 2024-01-13T18:23:16.583 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LxVEpiP2TXIZzZM off=10227354 len=1836220 2024-01-13T18:23:16.591 INFO:tasks.workunit.client.0.smithi084.stdout:op 659 completed, throughput=4.98MB/sec 2024-01-13T18:23:16.591 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qZh9gHipD6VcOzL off=12616771 len=1018405 2024-01-13T18:23:16.592 INFO:tasks.workunit.client.0.smithi084.stdout:op 660 completed, throughput=4.99MB/sec 2024-01-13T18:23:16.592 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Wx2Q-w8wQE8EbqA off=2139345 len=1901243 2024-01-13T18:23:16.600 INFO:tasks.workunit.client.0.smithi084.stdout:op 661 completed, throughput=5.01MB/sec 2024-01-13T18:23:17.603 INFO:tasks.workunit.client.0.smithi084.stdout: 131: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:17.603 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XrJk41tMCb0466K off=1310012 len=1741026 2024-01-13T18:23:17.604 INFO:tasks.workunit.client.0.smithi084.stdout:op 662 completed, throughput=4.98MB/sec 2024-01-13T18:23:17.604 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IzR3UOhTIPPhDNQ off=1866162 len=1853370 2024-01-13T18:23:17.606 INFO:tasks.workunit.client.0.smithi084.stdout:op 663 completed, throughput=4.99MB/sec 2024-01-13T18:23:17.606 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SU8IWZH3oXxH3YQ off=1437092 len=2036044 2024-01-13T18:23:17.608 INFO:tasks.workunit.client.0.smithi084.stdout:op 664 completed, throughput=5.01MB/sec 2024-01-13T18:23:17.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:17 smithi099 ceph-mon[138788]: pgmap v1544: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:23:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:17 smithi084 ceph-mon[116404]: pgmap v1544: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:23:17.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:17 smithi084 ceph-mon[119097]: pgmap v1544: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:23:18.609 INFO:tasks.workunit.client.0.smithi084.stdout: 132: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:18.609 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ncdWUq5KAEpboCT off=6624806 len=1347176 2024-01-13T18:23:18.610 INFO:tasks.workunit.client.0.smithi084.stdout:op 665 completed, throughput=4.98MB/sec 2024-01-13T18:23:18.610 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qv15kElV4PfKCPW off=9723572 len=1725276 2024-01-13T18:23:18.614 INFO:tasks.workunit.client.0.smithi084.stdout:op 666 completed, throughput=4.99MB/sec 2024-01-13T18:23:18.614 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-679SbROTVa8L-Wr off=9123461 len=651795 2024-01-13T18:23:18.619 INFO:tasks.workunit.client.0.smithi084.stdout:op 667 completed, throughput=5MB/sec 2024-01-13T18:23:18.619 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tXqakwh0dsVS89F off=6659332 len=1309549 2024-01-13T18:23:18.624 INFO:tasks.workunit.client.0.smithi084.stdout:op 668 completed, throughput=5.01MB/sec 2024-01-13T18:23:19.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:19 smithi084 ceph-mon[116404]: pgmap v1545: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:23:19.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:19 smithi084 ceph-mon[119097]: pgmap v1545: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:23:19.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:19 smithi099 ceph-mon[138788]: pgmap v1545: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:23:19.624 INFO:tasks.workunit.client.0.smithi084.stdout: 133: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:19.624 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6dpfDopz9w7-bmK off=8229028 len=9300 2024-01-13T18:23:19.625 INFO:tasks.workunit.client.0.smithi084.stdout:op 669 completed, throughput=4.97MB/sec 2024-01-13T18:23:19.625 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UrccfEuZxyWPBwj off=4686455 len=2062595 2024-01-13T18:23:19.629 INFO:tasks.workunit.client.0.smithi084.stdout:op 670 completed, throughput=4.98MB/sec 2024-01-13T18:23:19.629 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yOk_myz7E1Krz_C off=4644813 len=933777 2024-01-13T18:23:19.631 INFO:tasks.workunit.client.0.smithi084.stdout:op 671 completed, throughput=4.99MB/sec 2024-01-13T18:23:19.631 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-faMz93KgDLqB-D5 off=11374942 len=1905080 2024-01-13T18:23:19.633 INFO:tasks.workunit.client.0.smithi084.stdout:op 672 completed, throughput=5MB/sec 2024-01-13T18:23:20.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:20.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:20.429 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:23:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:23:20] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:23:20.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:20.633 INFO:tasks.workunit.client.0.smithi084.stdout: 134: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:20.633 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mszjIUU1GsJOx7u off=3535405 len=1533699 2024-01-13T18:23:20.642 INFO:tasks.workunit.client.0.smithi084.stdout:op 673 completed, throughput=4.98MB/sec 2024-01-13T18:23:20.642 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xwFgLFAzAkZA2Tm off=3092619 len=1691769 2024-01-13T18:23:20.648 INFO:tasks.workunit.client.0.smithi084.stdout:op 674 completed, throughput=4.99MB/sec 2024-01-13T18:23:20.649 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WTv9hrp705KjygX off=2204756 len=1565633 2024-01-13T18:23:20.650 INFO:tasks.workunit.client.0.smithi084.stdout:op 675 completed, throughput=5MB/sec 2024-01-13T18:23:20.650 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_UPfJ63NqKlNqsU off=21801932 len=1172814 2024-01-13T18:23:20.651 INFO:tasks.workunit.client.0.smithi084.stdout:op 676 completed, throughput=5.01MB/sec 2024-01-13T18:23:21.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:21 smithi084 ceph-mon[116404]: pgmap v1546: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:23:21.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:23:21.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:21 smithi084 ceph-mon[119097]: pgmap v1546: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:23:21.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:23:21.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:21 smithi099 ceph-mon[138788]: pgmap v1546: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:23:21.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:23:21.651 INFO:tasks.workunit.client.0.smithi084.stdout: 135: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:21.651 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-F0N4I1jeKj1AXhS off=7278361 len=1096381 2024-01-13T18:23:21.653 INFO:tasks.workunit.client.0.smithi084.stdout:op 677 completed, throughput=4.98MB/sec 2024-01-13T18:23:21.653 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-231wOfKL7mvAsJK off=9953980 len=1135746 2024-01-13T18:23:21.655 INFO:tasks.workunit.client.0.smithi084.stdout:op 678 completed, throughput=4.99MB/sec 2024-01-13T18:23:21.655 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WNv4Q2HZ7us4bcb off=4467782 len=1964812 2024-01-13T18:23:21.664 INFO:tasks.workunit.client.0.smithi084.stdout:op 679 completed, throughput=5MB/sec 2024-01-13T18:23:21.664 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Dy6aUw3IPwZN9LR off=1489145 len=634870 2024-01-13T18:23:21.665 INFO:tasks.workunit.client.0.smithi084.stdout:op 680 completed, throughput=5MB/sec 2024-01-13T18:23:22.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:23:22.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:23:22.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:23:22.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:23:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:23:22.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:23:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:23:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:23:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:23:22.665 INFO:tasks.workunit.client.0.smithi084.stdout: 136: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:22.665 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj---tEAXwQsEngJNa off=2574426 len=1555724 2024-01-13T18:23:22.675 INFO:tasks.workunit.client.0.smithi084.stdout:op 681 completed, throughput=4.98MB/sec 2024-01-13T18:23:22.675 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-U-WAziBDGGQIeUR off=1236948 len=1612684 2024-01-13T18:23:22.683 INFO:tasks.workunit.client.0.smithi084.stdout:op 682 completed, throughput=4.99MB/sec 2024-01-13T18:23:22.683 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qr371MJjvF0QQta off=6760321 len=1588628 2024-01-13T18:23:22.689 INFO:tasks.workunit.client.0.smithi084.stdout:op 683 completed, throughput=5MB/sec 2024-01-13T18:23:22.689 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7DouodNy8cRvDXb off=540137 len=1236739 2024-01-13T18:23:22.692 INFO:tasks.workunit.client.0.smithi084.stdout:op 684 completed, throughput=5.01MB/sec 2024-01-13T18:23:23.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:23 smithi084 ceph-mon[116404]: pgmap v1547: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:23:23.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:23 smithi084 ceph-mon[119097]: pgmap v1547: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:23:23.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:23 smithi099 ceph-mon[138788]: pgmap v1547: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:23:23.692 INFO:tasks.workunit.client.0.smithi084.stdout: 137: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:23.692 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZlhKQF4sl09HHzI off=10489752 len=1869524 2024-01-13T18:23:23.703 INFO:tasks.workunit.client.0.smithi084.stdout:op 685 completed, throughput=4.98MB/sec 2024-01-13T18:23:23.703 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RhvpuTjagh8yq-i off=3169827 len=174880 2024-01-13T18:23:23.706 INFO:tasks.workunit.client.0.smithi084.stdout:op 686 completed, throughput=4.99MB/sec 2024-01-13T18:23:23.706 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mKRtTMXwcD09Pp8 off=10311528 len=373202 2024-01-13T18:23:23.710 INFO:tasks.workunit.client.0.smithi084.stdout:op 687 completed, throughput=4.99MB/sec 2024-01-13T18:23:23.710 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RQm8X_LJtP_Hq2_ off=1823018 len=230761 2024-01-13T18:23:23.710 INFO:tasks.workunit.client.0.smithi084.stdout:op 688 completed, throughput=4.99MB/sec 2024-01-13T18:23:23.710 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4fNU-HoEsf1l0vn off=491241 len=1430839 2024-01-13T18:23:23.712 INFO:tasks.workunit.client.0.smithi084.stdout:op 689 completed, throughput=5MB/sec 2024-01-13T18:23:23.712 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sDjLQEFBd2LLGD_ off=2035960 len=1365472 2024-01-13T18:23:23.719 INFO:tasks.workunit.client.0.smithi084.stdout:op 690 completed, throughput=5.01MB/sec 2024-01-13T18:23:24.719 INFO:tasks.workunit.client.0.smithi084.stdout: 138: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:24.719 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--41vr2yHKMb89_C off=1649258 len=1667713 2024-01-13T18:23:24.726 INFO:tasks.workunit.client.0.smithi084.stdout:op 691 completed, throughput=4.98MB/sec 2024-01-13T18:23:24.726 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wHLIzEJvqkjPl9B off=13479183 len=579866 2024-01-13T18:23:24.731 INFO:tasks.workunit.client.0.smithi084.stdout:op 692 completed, throughput=4.99MB/sec 2024-01-13T18:23:24.731 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-coHPj1u0hwjIpfk off=2291469 len=643569 2024-01-13T18:23:24.732 INFO:tasks.workunit.client.0.smithi084.stdout:op 693 completed, throughput=4.99MB/sec 2024-01-13T18:23:24.732 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rWdu8t6nfWv1ZMT off=13009600 len=848337 2024-01-13T18:23:24.744 INFO:tasks.workunit.client.0.smithi084.stdout:op 694 completed, throughput=5MB/sec 2024-01-13T18:23:24.744 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-esNglz3SJCGpA7D off=471521 len=1938713 2024-01-13T18:23:24.746 INFO:tasks.workunit.client.0.smithi084.stdout:op 695 completed, throughput=5.01MB/sec 2024-01-13T18:23:25.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:25 smithi099 ceph-mon[138788]: pgmap v1548: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:23:25.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:25 smithi084 ceph-mon[116404]: pgmap v1548: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:23:25.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:25 smithi084 ceph-mon[119097]: pgmap v1548: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:23:25.746 INFO:tasks.workunit.client.0.smithi084.stdout: 139: throughput=4.98MB/sec pending data=0 2024-01-13T18:23:25.746 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N719XW4uN8SXkyR off=2353816 len=546302 2024-01-13T18:23:25.748 INFO:tasks.workunit.client.0.smithi084.stdout:op 696 completed, throughput=4.98MB/sec 2024-01-13T18:23:25.748 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-J1huv7Fo6TYdulr off=5071270 len=1359273 2024-01-13T18:23:25.755 INFO:tasks.workunit.client.0.smithi084.stdout:op 697 completed, throughput=4.99MB/sec 2024-01-13T18:23:25.755 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HFCi267IxvUlRzW off=15860177 len=1747644 2024-01-13T18:23:25.757 INFO:tasks.workunit.client.0.smithi084.stdout:op 698 completed, throughput=5MB/sec 2024-01-13T18:23:25.757 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jd4jWIRmAwTetUw off=1266321 len=1451956 2024-01-13T18:23:25.758 INFO:tasks.workunit.client.0.smithi084.stdout:op 699 completed, throughput=5.01MB/sec 2024-01-13T18:23:26.758 INFO:tasks.workunit.client.0.smithi084.stdout: 140: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:26.759 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oUKOYd3UGWu_fIf off=1980301 len=1582390 2024-01-13T18:23:26.762 INFO:tasks.workunit.client.0.smithi084.stdout:op 700 completed, throughput=4.98MB/sec 2024-01-13T18:23:26.762 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hVenECFRXnENx1S off=492314 len=535084 2024-01-13T18:23:26.763 INFO:tasks.workunit.client.0.smithi084.stdout:op 701 completed, throughput=4.99MB/sec 2024-01-13T18:23:26.763 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QcdPVdZoTConxx- off=14181320 len=1159310 2024-01-13T18:23:26.768 INFO:tasks.workunit.client.0.smithi084.stdout:op 702 completed, throughput=5MB/sec 2024-01-13T18:23:26.769 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7iftuFiiWFL5g11 off=1875556 len=1989504 2024-01-13T18:23:26.779 INFO:tasks.workunit.client.0.smithi084.stdout:op 703 completed, throughput=5.01MB/sec 2024-01-13T18:23:27.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:27 smithi099 ceph-mon[138788]: pgmap v1549: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:23:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:27 smithi084 ceph-mon[116404]: pgmap v1549: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:23:27.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:27 smithi084 ceph-mon[119097]: pgmap v1549: 105 pgs: 105 active+clean; 128 GiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:23:27.779 INFO:tasks.workunit.client.0.smithi084.stdout: 141: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:27.780 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ABV8YV_RQwoK27e off=6881513 len=93968 2024-01-13T18:23:27.782 INFO:tasks.workunit.client.0.smithi084.stdout:op 704 completed, throughput=4.97MB/sec 2024-01-13T18:23:27.782 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6HJursNr9JGEe4A off=1948360 len=487815 2024-01-13T18:23:27.786 INFO:tasks.workunit.client.0.smithi084.stdout:op 705 completed, throughput=4.98MB/sec 2024-01-13T18:23:27.786 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PA5B7BEAMbOJuT6 off=3121800 len=1983769 2024-01-13T18:23:27.796 INFO:tasks.workunit.client.0.smithi084.stdout:op 706 completed, throughput=4.99MB/sec 2024-01-13T18:23:27.796 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rX_Hy3tS1_MvDz8 off=20926712 len=2021683 2024-01-13T18:23:27.798 INFO:tasks.workunit.client.0.smithi084.stdout:op 707 completed, throughput=5MB/sec 2024-01-13T18:23:28.798 INFO:tasks.workunit.client.0.smithi084.stdout: 142: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:28.798 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VCUN5hMMt6DeFPp off=18098069 len=49795 2024-01-13T18:23:28.799 INFO:tasks.workunit.client.0.smithi084.stdout:op 708 completed, throughput=4.97MB/sec 2024-01-13T18:23:28.799 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ygX9MJgCEFn_eVN off=889989 len=763925 2024-01-13T18:23:28.803 INFO:tasks.workunit.client.0.smithi084.stdout:op 709 completed, throughput=4.97MB/sec 2024-01-13T18:23:28.803 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tj_iZb45P7jjkb4 off=15558 len=1723269 2024-01-13T18:23:28.807 INFO:tasks.workunit.client.0.smithi084.stdout:op 710 completed, throughput=4.99MB/sec 2024-01-13T18:23:28.807 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kfn9qFHvYTVlX7o off=13578073 len=320530 2024-01-13T18:23:28.810 INFO:tasks.workunit.client.0.smithi084.stdout:op 711 completed, throughput=4.99MB/sec 2024-01-13T18:23:28.811 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZMXvY-xx3OdpU_l off=1051726 len=758580 2024-01-13T18:23:28.812 INFO:tasks.workunit.client.0.smithi084.stdout:op 712 completed, throughput=4.99MB/sec 2024-01-13T18:23:28.812 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y6tZQFAqeAharrk off=8744681 len=2038353 2024-01-13T18:23:28.814 INFO:tasks.workunit.client.0.smithi084.stdout:op 713 completed, throughput=5.01MB/sec 2024-01-13T18:23:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:29 smithi084 ceph-mon[116404]: pgmap v1550: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:23:29.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:29 smithi084 ceph-mon[119097]: pgmap v1550: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:23:29.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:29 smithi099 ceph-mon[138788]: pgmap v1550: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:23:29.815 INFO:tasks.workunit.client.0.smithi084.stdout: 143: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:29.815 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GeRgCfslVGMiZJw off=10439987 len=536314 2024-01-13T18:23:29.816 INFO:tasks.workunit.client.0.smithi084.stdout:op 714 completed, throughput=4.97MB/sec 2024-01-13T18:23:29.816 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h80expRfYKVa5_Q off=899557 len=1617560 2024-01-13T18:23:29.823 INFO:tasks.workunit.client.0.smithi084.stdout:op 715 completed, throughput=4.99MB/sec 2024-01-13T18:23:29.823 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zL8bUY923lVYFqs off=101190 len=2019938 2024-01-13T18:23:29.826 INFO:tasks.workunit.client.0.smithi084.stdout:op 716 completed, throughput=5MB/sec 2024-01-13T18:23:29.826 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-utHt3KCJThMbTzQ off=19022755 len=1616503 2024-01-13T18:23:29.826 INFO:tasks.workunit.client.0.smithi084.stdout:op 717 completed, throughput=5.01MB/sec 2024-01-13T18:23:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:23:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:23:30] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:23:30.827 INFO:tasks.workunit.client.0.smithi084.stdout: 144: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:30.827 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gvQaM1qZR2nv8GJ off=12103 len=1186132 2024-01-13T18:23:30.836 INFO:tasks.workunit.client.0.smithi084.stdout:op 718 completed, throughput=4.98MB/sec 2024-01-13T18:23:30.836 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-p1Fuy9PWoVHQtxj off=11164093 len=1289054 2024-01-13T18:23:30.842 INFO:tasks.workunit.client.0.smithi084.stdout:op 719 completed, throughput=4.99MB/sec 2024-01-13T18:23:30.842 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MMaRMhjYUpFMfXN off=2638578 len=1603471 2024-01-13T18:23:30.852 INFO:tasks.workunit.client.0.smithi084.stdout:op 720 completed, throughput=5MB/sec 2024-01-13T18:23:31.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:31 smithi099 ceph-mon[138788]: pgmap v1551: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:23:31.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:31 smithi084 ceph-mon[116404]: pgmap v1551: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:23:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:31 smithi084 ceph-mon[119097]: pgmap v1551: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:23:31.852 INFO:tasks.workunit.client.0.smithi084.stdout: 145: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:31.852 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tZKiUZsjUS7GTQq off=1540102 len=1745213 2024-01-13T18:23:31.861 INFO:tasks.workunit.client.0.smithi084.stdout:op 721 completed, throughput=4.98MB/sec 2024-01-13T18:23:31.861 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KhFCUA7HJd3phex off=424447 len=417048 2024-01-13T18:23:31.862 INFO:tasks.workunit.client.0.smithi084.stdout:op 722 completed, throughput=4.98MB/sec 2024-01-13T18:23:31.863 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-raHzIF6gHvl7uea off=408032 len=1635125 2024-01-13T18:23:31.864 INFO:tasks.workunit.client.0.smithi084.stdout:op 723 completed, throughput=4.99MB/sec 2024-01-13T18:23:31.864 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GKBwUlu3IZvMymc off=3462489 len=156794 2024-01-13T18:23:31.867 INFO:tasks.workunit.client.0.smithi084.stdout:op 724 completed, throughput=4.99MB/sec 2024-01-13T18:23:31.867 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EPamYNHenTeB17x off=16700022 len=1855827 2024-01-13T18:23:31.870 INFO:tasks.workunit.client.0.smithi084.stdout:op 725 completed, throughput=5MB/sec 2024-01-13T18:23:32.870 INFO:tasks.workunit.client.0.smithi084.stdout: 146: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:32.871 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-I4WWFnGMKI2Pn4F off=2044092 len=529885 2024-01-13T18:23:32.871 INFO:tasks.workunit.client.0.smithi084.stdout:op 726 completed, throughput=4.97MB/sec 2024-01-13T18:23:32.871 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AO3-M2nYpxmTb5b off=4457776 len=968732 2024-01-13T18:23:32.876 INFO:tasks.workunit.client.0.smithi084.stdout:op 727 completed, throughput=4.98MB/sec 2024-01-13T18:23:32.876 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-v9XUeT0cJ1S6JyF off=2457385 len=1103375 2024-01-13T18:23:32.882 INFO:tasks.workunit.client.0.smithi084.stdout:op 728 completed, throughput=4.99MB/sec 2024-01-13T18:23:32.882 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KswC8_AuX7y18Xv off=3212210 len=169004 2024-01-13T18:23:32.882 INFO:tasks.workunit.client.0.smithi084.stdout:op 729 completed, throughput=4.99MB/sec 2024-01-13T18:23:32.882 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eMKNGzbM4IFuCuR off=3215507 len=24001 2024-01-13T18:23:32.884 INFO:tasks.workunit.client.0.smithi084.stdout:op 730 completed, throughput=4.99MB/sec 2024-01-13T18:23:32.884 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f2__wj-5AYNDyuY off=12374148 len=254420 2024-01-13T18:23:32.885 INFO:tasks.workunit.client.0.smithi084.stdout:op 731 completed, throughput=4.99MB/sec 2024-01-13T18:23:32.885 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SxndBLVPVyybdOP off=7291988 len=157802 2024-01-13T18:23:32.885 INFO:tasks.workunit.client.0.smithi084.stdout:op 732 completed, throughput=4.99MB/sec 2024-01-13T18:23:32.886 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Mv0dT68zfqmPUuJ off=0 len=1902389 2024-01-13T18:23:32.897 INFO:tasks.workunit.client.0.smithi084.stdout:op 733 completed, throughput=5MB/sec 2024-01-13T18:23:33.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:33 smithi099 ceph-mon[138788]: pgmap v1552: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 3 op/s 2024-01-13T18:23:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:33 smithi084 ceph-mon[116404]: pgmap v1552: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 3 op/s 2024-01-13T18:23:33.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:33 smithi084 ceph-mon[119097]: pgmap v1552: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 3 op/s 2024-01-13T18:23:33.897 INFO:tasks.workunit.client.0.smithi084.stdout: 147: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:33.897 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yyeqJT87fsSmiOg off=14053018 len=169969 2024-01-13T18:23:33.900 INFO:tasks.workunit.client.0.smithi084.stdout:op 734 completed, throughput=4.97MB/sec 2024-01-13T18:23:33.900 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mK_7veCOwCYhTCC off=3534754 len=859300 2024-01-13T18:23:33.901 INFO:tasks.workunit.client.0.smithi084.stdout:op 735 completed, throughput=4.97MB/sec 2024-01-13T18:23:33.901 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-T2nojxIJljc7xOB off=34081 len=1693145 2024-01-13T18:23:33.903 INFO:tasks.workunit.client.0.smithi084.stdout:op 736 completed, throughput=4.99MB/sec 2024-01-13T18:23:33.903 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JXn24xibounx79R off=2976137 len=1179455 2024-01-13T18:23:33.904 INFO:tasks.workunit.client.0.smithi084.stdout:op 737 completed, throughput=4.99MB/sec 2024-01-13T18:23:33.904 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NAei2THO-Asjm7m off=2260720 len=1561273 2024-01-13T18:23:33.907 INFO:tasks.workunit.client.0.smithi084.stdout:op 738 completed, throughput=5MB/sec 2024-01-13T18:23:34.908 INFO:tasks.workunit.client.0.smithi084.stdout: 148: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:34.908 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OdR4uhF6R9hsxk5 off=13418406 len=1593042 2024-01-13T18:23:34.911 INFO:tasks.workunit.client.0.smithi084.stdout:op 739 completed, throughput=4.98MB/sec 2024-01-13T18:23:34.911 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-N0wkqc0WLLCIY77 off=3007935 len=1872267 2024-01-13T18:23:34.919 INFO:tasks.workunit.client.0.smithi084.stdout:op 740 completed, throughput=4.99MB/sec 2024-01-13T18:23:34.919 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-d1hHXbvT35O5pXj off=13167507 len=36448 2024-01-13T18:23:34.922 INFO:tasks.workunit.client.0.smithi084.stdout:op 741 completed, throughput=4.99MB/sec 2024-01-13T18:23:34.922 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pAVWH97uz9qwiAq off=6675280 len=1023524 2024-01-13T18:23:34.924 INFO:tasks.workunit.client.0.smithi084.stdout:op 742 completed, throughput=5MB/sec 2024-01-13T18:23:34.924 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-axcPUky6m-3o60t off=11789081 len=845845 2024-01-13T18:23:34.928 INFO:tasks.workunit.client.0.smithi084.stdout:op 743 completed, throughput=5MB/sec 2024-01-13T18:23:35.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:35 smithi099 ceph-mon[138788]: pgmap v1553: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:23:35.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:35 smithi084 ceph-mon[116404]: pgmap v1553: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:23:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:35 smithi084 ceph-mon[119097]: pgmap v1553: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:23:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:35.928 INFO:tasks.workunit.client.0.smithi084.stdout: 149: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:35.928 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y5u4_UNf1MJGwQQ off=17574722 len=1445794 2024-01-13T18:23:35.930 INFO:tasks.workunit.client.0.smithi084.stdout:op 744 completed, throughput=4.98MB/sec 2024-01-13T18:23:35.930 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DN7t83L34jMVlUS off=1665679 len=2068347 2024-01-13T18:23:35.934 INFO:tasks.workunit.client.0.smithi084.stdout:op 745 completed, throughput=4.99MB/sec 2024-01-13T18:23:35.934 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ozoGeZL-yAAKpMD off=18572951 len=191058 2024-01-13T18:23:35.937 INFO:tasks.workunit.client.0.smithi084.stdout:op 746 completed, throughput=4.99MB/sec 2024-01-13T18:23:35.937 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AUnbubaGlPlkSiO off=8266463 len=259241 2024-01-13T18:23:35.937 INFO:tasks.workunit.client.0.smithi084.stdout:op 747 completed, throughput=4.99MB/sec 2024-01-13T18:23:35.937 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-alca2gFmyYvtQqk off=1473940 len=707660 2024-01-13T18:23:35.941 INFO:tasks.workunit.client.0.smithi084.stdout:op 748 completed, throughput=5MB/sec 2024-01-13T18:23:35.941 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ndi0tDWEq-Jrn-f off=281291 len=570141 2024-01-13T18:23:35.944 INFO:tasks.workunit.client.0.smithi084.stdout:op 749 completed, throughput=5MB/sec 2024-01-13T18:23:36.945 INFO:tasks.workunit.client.0.smithi084.stdout: 150: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:36.945 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ixmSV0pZnkfRi0p off=1924264 len=24887 2024-01-13T18:23:36.945 INFO:tasks.workunit.client.0.smithi084.stdout:op 750 completed, throughput=4.97MB/sec 2024-01-13T18:23:36.946 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VqLLmjf7DZTUifb off=11380031 len=1514302 2024-01-13T18:23:36.954 INFO:tasks.workunit.client.0.smithi084.stdout:op 751 completed, throughput=4.98MB/sec 2024-01-13T18:23:36.955 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hbrpOPVbndvWnru off=5095265 len=943004 2024-01-13T18:23:36.960 INFO:tasks.workunit.client.0.smithi084.stdout:op 752 completed, throughput=4.98MB/sec 2024-01-13T18:23:36.960 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-B2iHjLNfMuee_UI off=5091317 len=758107 2024-01-13T18:23:36.964 INFO:tasks.workunit.client.0.smithi084.stdout:op 753 completed, throughput=4.99MB/sec 2024-01-13T18:23:36.964 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fGtW5bCsJotIBgP off=3756966 len=610345 2024-01-13T18:23:36.965 INFO:tasks.workunit.client.0.smithi084.stdout:op 754 completed, throughput=4.99MB/sec 2024-01-13T18:23:36.965 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Lp-iXYsQ5LB4Gpr off=3478381 len=2078769 2024-01-13T18:23:36.976 INFO:tasks.workunit.client.0.smithi084.stdout:op 755 completed, throughput=5.01MB/sec 2024-01-13T18:23:37.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:37 smithi099 ceph-mon[138788]: pgmap v1554: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:23:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:37 smithi084 ceph-mon[116404]: pgmap v1554: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:23:37.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:37 smithi084 ceph-mon[119097]: pgmap v1554: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:23:37.976 INFO:tasks.workunit.client.0.smithi084.stdout: 151: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:37.976 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NMP8jyCDipfPasE off=0 len=1435998 2024-01-13T18:23:37.982 INFO:tasks.workunit.client.0.smithi084.stdout:op 756 completed, throughput=4.98MB/sec 2024-01-13T18:23:37.982 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--BxEH--3M1qKh-b off=6583228 len=1768937 2024-01-13T18:23:37.992 INFO:tasks.workunit.client.0.smithi084.stdout:op 757 completed, throughput=4.99MB/sec 2024-01-13T18:23:37.992 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yC2kHe6hKmsr05G off=6309386 len=753616 2024-01-13T18:23:37.994 INFO:tasks.workunit.client.0.smithi084.stdout:op 758 completed, throughput=5MB/sec 2024-01-13T18:23:37.994 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-R97i5Pb6ah1WaQM off=1619182 len=1361002 2024-01-13T18:23:37.995 INFO:tasks.workunit.client.0.smithi084.stdout:op 759 completed, throughput=5.01MB/sec 2024-01-13T18:23:38.995 INFO:tasks.workunit.client.0.smithi084.stdout: 152: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:38.996 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OSrcM5RTRJ-XqBA off=5164071 len=1182622 2024-01-13T18:23:39.002 INFO:tasks.workunit.client.0.smithi084.stdout:op 760 completed, throughput=4.98MB/sec 2024-01-13T18:23:39.002 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wXuutiiVENdo6PR off=12774302 len=1758511 2024-01-13T18:23:39.012 INFO:tasks.workunit.client.0.smithi084.stdout:op 761 completed, throughput=4.99MB/sec 2024-01-13T18:23:39.012 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qomQnwCNcVg9nbg off=6902816 len=190599 2024-01-13T18:23:39.013 INFO:tasks.workunit.client.0.smithi084.stdout:op 762 completed, throughput=4.99MB/sec 2024-01-13T18:23:39.013 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WmLSDFe5P1WpEGD off=3525638 len=809089 2024-01-13T18:23:39.017 INFO:tasks.workunit.client.0.smithi084.stdout:op 763 completed, throughput=5MB/sec 2024-01-13T18:23:39.017 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tIaFDngQmbQktgD off=5697367 len=317875 2024-01-13T18:23:39.020 INFO:tasks.workunit.client.0.smithi084.stdout:op 764 completed, throughput=5MB/sec 2024-01-13T18:23:39.020 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VnVRgMdoa29GtfH off=12619209 len=1213953 2024-01-13T18:23:39.021 INFO:tasks.workunit.client.0.smithi084.stdout:op 765 completed, throughput=5.01MB/sec 2024-01-13T18:23:39.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:39 smithi084 ceph-mon[116404]: pgmap v1555: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:23:39.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:39 smithi084 ceph-mon[119097]: pgmap v1555: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:23:39.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:39 smithi099 ceph-mon[138788]: pgmap v1555: 105 pgs: 105 active+clean; 128 GiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:23:40.021 INFO:tasks.workunit.client.0.smithi084.stdout: 153: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:40.021 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eTPROI7479ZbslH off=6800158 len=74019 2024-01-13T18:23:40.022 INFO:tasks.workunit.client.0.smithi084.stdout:op 766 completed, throughput=4.97MB/sec 2024-01-13T18:23:40.022 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Dv8-9R9G25HE-PJ off=14456343 len=1697985 2024-01-13T18:23:40.031 INFO:tasks.workunit.client.0.smithi084.stdout:op 767 completed, throughput=4.98MB/sec 2024-01-13T18:23:40.031 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2OZFMNLkVvoVcmx off=0 len=1143939 2024-01-13T18:23:40.039 INFO:tasks.workunit.client.0.smithi084.stdout:op 768 completed, throughput=4.99MB/sec 2024-01-13T18:23:40.039 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qXxiwhGQmLWJuO9 off=9404042 len=917088 2024-01-13T18:23:40.043 INFO:tasks.workunit.client.0.smithi084.stdout:op 769 completed, throughput=5MB/sec 2024-01-13T18:23:40.043 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZcyVROLLgaFehTb off=1232733 len=1319319 2024-01-13T18:23:40.050 INFO:tasks.workunit.client.0.smithi084.stdout:op 770 completed, throughput=5MB/sec 2024-01-13T18:23:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:23:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:23:40] "GET /metrics HTTP/1.1" 200 33981 "" "Prometheus/2.43.0" 2024-01-13T18:23:41.050 INFO:tasks.workunit.client.0.smithi084.stdout: 154: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:41.050 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--IcbT0FKObMjVZZ off=11585462 len=1785595 2024-01-13T18:23:41.054 INFO:tasks.workunit.client.0.smithi084.stdout:op 771 completed, throughput=4.98MB/sec 2024-01-13T18:23:41.054 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EvUGGkzeu519vXa off=8047524 len=1481831 2024-01-13T18:23:41.062 INFO:tasks.workunit.client.0.smithi084.stdout:op 772 completed, throughput=4.99MB/sec 2024-01-13T18:23:41.062 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KKo-QvCDU1VsJN0 off=256365 len=1568965 2024-01-13T18:23:41.072 INFO:tasks.workunit.client.0.smithi084.stdout:op 773 completed, throughput=5MB/sec 2024-01-13T18:23:41.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:41 smithi099 ceph-mon[138788]: pgmap v1556: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:23:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:41 smithi084 ceph-mon[116404]: pgmap v1556: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:23:41.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:41 smithi084 ceph-mon[119097]: pgmap v1556: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:23:42.072 INFO:tasks.workunit.client.0.smithi084.stdout: 155: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:42.072 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FKdOVZpYr9ae28u off=15550065 len=1395385 2024-01-13T18:23:42.074 INFO:tasks.workunit.client.0.smithi084.stdout:op 774 completed, throughput=4.98MB/sec 2024-01-13T18:23:42.074 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e2wSnvUAPMOJt-h off=0 len=1300202 2024-01-13T18:23:42.079 INFO:tasks.workunit.client.0.smithi084.stdout:op 775 completed, throughput=4.99MB/sec 2024-01-13T18:23:42.079 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-C6Q72f4Kc74Wj7w off=4324265 len=905075 2024-01-13T18:23:42.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 776 completed, throughput=4.99MB/sec 2024-01-13T18:23:42.080 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--MZLFul4BkMGRlh off=736620 len=1894552 2024-01-13T18:23:42.082 INFO:tasks.workunit.client.0.smithi084.stdout:op 777 completed, throughput=5MB/sec 2024-01-13T18:23:43.083 INFO:tasks.workunit.client.0.smithi084.stdout: 156: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:43.083 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pcgHFFpTdQiFTE_ off=543166 len=895694 2024-01-13T18:23:43.084 INFO:tasks.workunit.client.0.smithi084.stdout:op 778 completed, throughput=4.98MB/sec 2024-01-13T18:23:43.084 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x5zRJSrURRUAvnP off=19166894 len=1113274 2024-01-13T18:23:43.090 INFO:tasks.workunit.client.0.smithi084.stdout:op 779 completed, throughput=4.98MB/sec 2024-01-13T18:23:43.090 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nYL191a7mAfWAq7 off=15411529 len=110156 2024-01-13T18:23:43.091 INFO:tasks.workunit.client.0.smithi084.stdout:op 780 completed, throughput=4.98MB/sec 2024-01-13T18:23:43.091 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-M8bFrqNU-h9Gc1i off=4788364 len=585015 2024-01-13T18:23:43.095 INFO:tasks.workunit.client.0.smithi084.stdout:op 781 completed, throughput=4.99MB/sec 2024-01-13T18:23:43.095 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VGy6kyNQVBbtdjo off=15979051 len=1572075 2024-01-13T18:23:43.102 INFO:tasks.workunit.client.0.smithi084.stdout:op 782 completed, throughput=5MB/sec 2024-01-13T18:23:43.102 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gYMfIHTRAS0snx1 off=9234672 len=905096 2024-01-13T18:23:43.107 INFO:tasks.workunit.client.0.smithi084.stdout:op 783 completed, throughput=5MB/sec 2024-01-13T18:23:43.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:43 smithi099 ceph-mon[138788]: pgmap v1557: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:23:43.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:43 smithi084 ceph-mon[116404]: pgmap v1557: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:23:43.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:43 smithi084 ceph-mon[119097]: pgmap v1557: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:23:44.108 INFO:tasks.workunit.client.0.smithi084.stdout: 157: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:44.108 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bNzdk0zsYhDENTu off=4769088 len=1800236 2024-01-13T18:23:44.110 INFO:tasks.workunit.client.0.smithi084.stdout:op 784 completed, throughput=4.98MB/sec 2024-01-13T18:23:44.110 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mZvKLDsGfbmoz1s off=353434 len=294132 2024-01-13T18:23:44.113 INFO:tasks.workunit.client.0.smithi084.stdout:op 785 completed, throughput=4.98MB/sec 2024-01-13T18:23:44.113 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CVxcj9P73K2yfnP off=3873506 len=1226564 2024-01-13T18:23:44.115 INFO:tasks.workunit.client.0.smithi084.stdout:op 786 completed, throughput=4.99MB/sec 2024-01-13T18:23:44.115 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BT5BvkGZNCAcKCC off=3106411 len=982032 2024-01-13T18:23:44.117 INFO:tasks.workunit.client.0.smithi084.stdout:op 787 completed, throughput=5MB/sec 2024-01-13T18:23:44.117 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EGxeNtUc8ceXgHc off=283065 len=1204651 2024-01-13T18:23:44.125 INFO:tasks.workunit.client.0.smithi084.stdout:op 788 completed, throughput=5MB/sec 2024-01-13T18:23:45.126 INFO:tasks.workunit.client.0.smithi084.stdout: 158: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:45.126 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HFal0orvZOx_259 off=8124433 len=299542 2024-01-13T18:23:45.129 INFO:tasks.workunit.client.0.smithi084.stdout:op 789 completed, throughput=4.97MB/sec 2024-01-13T18:23:45.129 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XN9KgYIw5xdeFK2 off=11648592 len=1273197 2024-01-13T18:23:45.138 INFO:tasks.workunit.client.0.smithi084.stdout:op 790 completed, throughput=4.98MB/sec 2024-01-13T18:23:45.138 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sFDgP4sUUuKpLF7 off=1145378 len=499151 2024-01-13T18:23:45.139 INFO:tasks.workunit.client.0.smithi084.stdout:op 791 completed, throughput=4.98MB/sec 2024-01-13T18:23:45.139 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CEO9nfnTKwVD2Zz off=1390998 len=1139279 2024-01-13T18:23:45.144 INFO:tasks.workunit.client.0.smithi084.stdout:op 792 completed, throughput=4.99MB/sec 2024-01-13T18:23:45.144 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PkMG8cnNrvXAdOw off=5739406 len=129830 2024-01-13T18:23:45.147 INFO:tasks.workunit.client.0.smithi084.stdout:op 793 completed, throughput=4.99MB/sec 2024-01-13T18:23:45.147 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PvuEG3i9ujgwRJo off=15559335 len=790839 2024-01-13T18:23:45.151 INFO:tasks.workunit.client.0.smithi084.stdout:op 794 completed, throughput=4.99MB/sec 2024-01-13T18:23:45.151 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0Z_KGdmVkfRcGj7 off=16418378 len=165200 2024-01-13T18:23:45.152 INFO:tasks.workunit.client.0.smithi084.stdout:op 795 completed, throughput=5MB/sec 2024-01-13T18:23:45.152 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VijcoWxk_vtQ6ro off=607772 len=2053307 2024-01-13T18:23:45.154 INFO:tasks.workunit.client.0.smithi084.stdout:op 796 completed, throughput=5.01MB/sec 2024-01-13T18:23:45.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:45 smithi099 ceph-mon[138788]: pgmap v1558: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:23:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:45 smithi084 ceph-mon[116404]: pgmap v1558: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:23:45.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:45 smithi084 ceph-mon[119097]: pgmap v1558: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:23:46.154 INFO:tasks.workunit.client.0.smithi084.stdout: 159: throughput=4.98MB/sec pending data=0 2024-01-13T18:23:46.154 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eCMS05gie1tER6E off=6908671 len=1097645 2024-01-13T18:23:46.161 INFO:tasks.workunit.client.0.smithi084.stdout:op 797 completed, throughput=4.98MB/sec 2024-01-13T18:23:46.161 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vuukUmq4t8rnV64 off=6595 len=21862 2024-01-13T18:23:46.162 INFO:tasks.workunit.client.0.smithi084.stdout:op 798 completed, throughput=4.98MB/sec 2024-01-13T18:23:46.162 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EOiJZy3FXwnubvJ off=20211784 len=1638115 2024-01-13T18:23:46.171 INFO:tasks.workunit.client.0.smithi084.stdout:op 799 completed, throughput=4.99MB/sec 2024-01-13T18:23:46.171 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-V76Pct4YIzBIKOf off=1680305 len=600580 2024-01-13T18:23:46.175 INFO:tasks.workunit.client.0.smithi084.stdout:op 800 completed, throughput=5MB/sec 2024-01-13T18:23:46.175 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-byiwjUmSH1CsyMF off=1081548 len=1625396 2024-01-13T18:23:46.177 INFO:tasks.workunit.client.0.smithi084.stdout:op 801 completed, throughput=5.01MB/sec 2024-01-13T18:23:47.177 INFO:tasks.workunit.client.0.smithi084.stdout: 160: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:47.178 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zSxRTpVfEihNl6A off=1161860 len=469574 2024-01-13T18:23:47.178 INFO:tasks.workunit.client.0.smithi084.stdout:op 802 completed, throughput=4.98MB/sec 2024-01-13T18:23:47.178 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tqpIb3mOxOFdWBY off=16681890 len=1933828 2024-01-13T18:23:47.188 INFO:tasks.workunit.client.0.smithi084.stdout:op 803 completed, throughput=4.99MB/sec 2024-01-13T18:23:47.188 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1G48i26Usvf2lEc off=6826333 len=1559426 2024-01-13T18:23:47.196 INFO:tasks.workunit.client.0.smithi084.stdout:op 804 completed, throughput=5MB/sec 2024-01-13T18:23:47.196 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1eVmkckc8yVXKaC off=8012417 len=290932 2024-01-13T18:23:47.199 INFO:tasks.workunit.client.0.smithi084.stdout:op 805 completed, throughput=5MB/sec 2024-01-13T18:23:47.199 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bHdAtVIawc5GVDW off=12862524 len=1353314 2024-01-13T18:23:47.201 INFO:tasks.workunit.client.0.smithi084.stdout:op 806 completed, throughput=5.01MB/sec 2024-01-13T18:23:47.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:47 smithi099 ceph-mon[138788]: pgmap v1559: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:23:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:47 smithi084 ceph-mon[116404]: pgmap v1559: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:23:47.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:47 smithi084 ceph-mon[119097]: pgmap v1559: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:23:48.201 INFO:tasks.workunit.client.0.smithi084.stdout: 161: throughput=4.98MB/sec pending data=0 2024-01-13T18:23:48.201 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IYzQ43Yprist5K4 off=277241 len=2053634 2024-01-13T18:23:48.213 INFO:tasks.workunit.client.0.smithi084.stdout:op 807 completed, throughput=4.99MB/sec 2024-01-13T18:23:48.213 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OITI9lPQbiruScg off=3793256 len=1784407 2024-01-13T18:23:48.221 INFO:tasks.workunit.client.0.smithi084.stdout:op 808 completed, throughput=5MB/sec 2024-01-13T18:23:48.221 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mlI-oI2Z6Dv16TJ off=16317179 len=901671 2024-01-13T18:23:48.225 INFO:tasks.workunit.client.0.smithi084.stdout:op 809 completed, throughput=5MB/sec 2024-01-13T18:23:49.226 INFO:tasks.workunit.client.0.smithi084.stdout: 162: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:49.226 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0rmfIKqUayuvfuh off=568421 len=415173 2024-01-13T18:23:49.227 INFO:tasks.workunit.client.0.smithi084.stdout:op 810 completed, throughput=4.98MB/sec 2024-01-13T18:23:49.227 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-o-7tfoSoWHY2ONr off=21092275 len=332432 2024-01-13T18:23:49.230 INFO:tasks.workunit.client.0.smithi084.stdout:op 811 completed, throughput=4.98MB/sec 2024-01-13T18:23:49.230 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WmIEAkmu_mTSS6x off=17306858 len=762408 2024-01-13T18:23:49.232 INFO:tasks.workunit.client.0.smithi084.stdout:op 812 completed, throughput=4.98MB/sec 2024-01-13T18:23:49.232 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cUyzp-n1o_akLuT off=1176848 len=924169 2024-01-13T18:23:49.234 INFO:tasks.workunit.client.0.smithi084.stdout:op 813 completed, throughput=4.99MB/sec 2024-01-13T18:23:49.234 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-alLnKo_txOzCZGN off=2335778 len=954823 2024-01-13T18:23:49.238 INFO:tasks.workunit.client.0.smithi084.stdout:op 814 completed, throughput=4.99MB/sec 2024-01-13T18:23:49.238 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uH4hO5Nmglzq2nf off=4669806 len=1383274 2024-01-13T18:23:49.247 INFO:tasks.workunit.client.0.smithi084.stdout:op 815 completed, throughput=5MB/sec 2024-01-13T18:23:49.247 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7bRh8M_tQNkUvhX off=7471119 len=1559176 2024-01-13T18:23:49.254 INFO:tasks.workunit.client.0.smithi084.stdout:op 816 completed, throughput=5.01MB/sec 2024-01-13T18:23:49.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:49 smithi084 ceph-mon[116404]: pgmap v1560: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:23:49.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:49 smithi084 ceph-mon[119097]: pgmap v1560: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:23:49.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:49 smithi099 ceph-mon[138788]: pgmap v1560: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:23:50.254 INFO:tasks.workunit.client.0.smithi084.stdout: 163: throughput=4.98MB/sec pending data=0 2024-01-13T18:23:50.255 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kWtQd2WTpA5rB2O off=5901159 len=789565 2024-01-13T18:23:50.255 INFO:tasks.workunit.client.0.smithi084.stdout:op 817 completed, throughput=4.98MB/sec 2024-01-13T18:23:50.256 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-70ACe_InWLKyRY6 off=7893298 len=322430 2024-01-13T18:23:50.256 INFO:tasks.workunit.client.0.smithi084.stdout:op 818 completed, throughput=4.98MB/sec 2024-01-13T18:23:50.256 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Pza1Iup9pPaNp_J off=2628894 len=2003238 2024-01-13T18:23:50.266 INFO:tasks.workunit.client.0.smithi084.stdout:op 819 completed, throughput=5MB/sec 2024-01-13T18:23:50.266 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9TRH-1CirYZ7y3N off=4111820 len=187922 2024-01-13T18:23:50.266 INFO:tasks.workunit.client.0.smithi084.stdout:op 820 completed, throughput=5MB/sec 2024-01-13T18:23:50.266 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8GCgRt-pCaU7Ke1 off=6545175 len=1681856 2024-01-13T18:23:50.268 INFO:tasks.workunit.client.0.smithi084.stdout:op 821 completed, throughput=5.01MB/sec 2024-01-13T18:23:50.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:50.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:23:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:23:50] "GET /metrics HTTP/1.1" 200 33981 "" "Prometheus/2.43.0" 2024-01-13T18:23:50.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:50.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:23:51.268 INFO:tasks.workunit.client.0.smithi084.stdout: 164: throughput=4.98MB/sec pending data=0 2024-01-13T18:23:51.268 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-M4THqAvYOTyWP0E off=20086483 len=1340249 2024-01-13T18:23:51.277 INFO:tasks.workunit.client.0.smithi084.stdout:op 822 completed, throughput=4.98MB/sec 2024-01-13T18:23:51.277 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bskta-d3Pk796FR off=2363973 len=2079597 2024-01-13T18:23:51.288 INFO:tasks.workunit.client.0.smithi084.stdout:op 823 completed, throughput=5MB/sec 2024-01-13T18:23:51.288 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dMe3suJzpVhtVS1 off=10564688 len=1310019 2024-01-13T18:23:51.295 INFO:tasks.workunit.client.0.smithi084.stdout:op 824 completed, throughput=5MB/sec 2024-01-13T18:23:51.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:51 smithi084 ceph-mon[116404]: pgmap v1561: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:23:51.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:51 smithi084 ceph-mon[119097]: pgmap v1561: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:23:51.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:51 smithi099 ceph-mon[138788]: pgmap v1561: 105 pgs: 105 active+clean; 128 GiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:23:52.296 INFO:tasks.workunit.client.0.smithi084.stdout: 165: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:52.296 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9chrk5sUt-immAE off=6174106 len=797805 2024-01-13T18:23:52.297 INFO:tasks.workunit.client.0.smithi084.stdout:op 825 completed, throughput=4.98MB/sec 2024-01-13T18:23:52.297 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hviLEoNxthl0lM5 off=1281511 len=1318091 2024-01-13T18:23:52.298 INFO:tasks.workunit.client.0.smithi084.stdout:op 826 completed, throughput=4.98MB/sec 2024-01-13T18:23:52.298 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MPX4UDgCheFXtyn off=714809 len=1204431 2024-01-13T18:23:52.300 INFO:tasks.workunit.client.0.smithi084.stdout:op 827 completed, throughput=4.99MB/sec 2024-01-13T18:23:52.300 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iL5XVegq7txnBdM off=1650059 len=265196 2024-01-13T18:23:52.301 INFO:tasks.workunit.client.0.smithi084.stdout:op 828 completed, throughput=4.99MB/sec 2024-01-13T18:23:52.302 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N1Mwo9m59mHzt_k off=1132430 len=1170484 2024-01-13T18:23:52.304 INFO:tasks.workunit.client.0.smithi084.stdout:op 829 completed, throughput=5MB/sec 2024-01-13T18:23:52.304 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-F4Le8MQ6SiPlDpt off=17262453 len=775498 2024-01-13T18:23:52.304 INFO:tasks.workunit.client.0.smithi084.stdout:op 830 completed, throughput=5MB/sec 2024-01-13T18:23:53.305 INFO:tasks.workunit.client.0.smithi084.stdout: 166: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:53.305 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Fu4Q-qW4zZh-pJI off=19677396 len=518329 2024-01-13T18:23:53.306 INFO:tasks.workunit.client.0.smithi084.stdout:op 831 completed, throughput=4.98MB/sec 2024-01-13T18:23:53.306 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tiOzCfdddlMt3t1 off=6129629 len=767222 2024-01-13T18:23:53.311 INFO:tasks.workunit.client.0.smithi084.stdout:op 832 completed, throughput=4.98MB/sec 2024-01-13T18:23:53.311 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Zx8PBI1LIg1imrG off=3811384 len=511957 2024-01-13T18:23:53.312 INFO:tasks.workunit.client.0.smithi084.stdout:op 833 completed, throughput=4.98MB/sec 2024-01-13T18:23:53.312 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aJkQredtybWpB8B off=5095447 len=1629178 2024-01-13T18:23:53.322 INFO:tasks.workunit.client.0.smithi084.stdout:op 834 completed, throughput=4.99MB/sec 2024-01-13T18:23:53.322 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lVJZ8to64rOnbDw off=7588355 len=906980 2024-01-13T18:23:53.327 INFO:tasks.workunit.client.0.smithi084.stdout:op 835 completed, throughput=5MB/sec 2024-01-13T18:23:53.327 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4Rsmp9SrLW_eAH1 off=5985528 len=1275816 2024-01-13T18:23:53.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 836 completed, throughput=5.01MB/sec 2024-01-13T18:23:53.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:53 smithi099 ceph-mon[138788]: pgmap v1562: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:23:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:53 smithi084 ceph-mon[116404]: pgmap v1562: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:23:53.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:53 smithi084 ceph-mon[119097]: pgmap v1562: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:23:54.329 INFO:tasks.workunit.client.0.smithi084.stdout: 167: throughput=4.98MB/sec pending data=0 2024-01-13T18:23:54.329 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LERRQGixeFvFiUT off=1469637 len=322407 2024-01-13T18:23:54.332 INFO:tasks.workunit.client.0.smithi084.stdout:op 837 completed, throughput=4.98MB/sec 2024-01-13T18:23:54.333 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e18lBsUTGYLTbYn off=979816 len=753271 2024-01-13T18:23:54.336 INFO:tasks.workunit.client.0.smithi084.stdout:op 838 completed, throughput=4.98MB/sec 2024-01-13T18:23:54.337 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wMJN5eiqmOkyDFc off=8764783 len=713344 2024-01-13T18:23:54.339 INFO:tasks.workunit.client.0.smithi084.stdout:op 839 completed, throughput=4.99MB/sec 2024-01-13T18:23:54.340 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DApBWMRYAh_5MW- off=7680122 len=404031 2024-01-13T18:23:54.343 INFO:tasks.workunit.client.0.smithi084.stdout:op 840 completed, throughput=4.99MB/sec 2024-01-13T18:23:54.343 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-S8bVayjp-1IfECr off=1756409 len=203674 2024-01-13T18:23:54.344 INFO:tasks.workunit.client.0.smithi084.stdout:op 841 completed, throughput=4.99MB/sec 2024-01-13T18:23:54.344 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WO1SAyO2M4ZasA9 off=1424806 len=1032060 2024-01-13T18:23:54.346 INFO:tasks.workunit.client.0.smithi084.stdout:op 842 completed, throughput=4.99MB/sec 2024-01-13T18:23:54.346 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_bCxcUku5R9bc5b off=7826533 len=1533467 2024-01-13T18:23:54.352 INFO:tasks.workunit.client.0.smithi084.stdout:op 843 completed, throughput=5MB/sec 2024-01-13T18:23:55.352 INFO:tasks.workunit.client.0.smithi084.stdout: 168: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:55.352 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6zKM7JDa6L91Ze0 off=2270501 len=101001 2024-01-13T18:23:55.353 INFO:tasks.workunit.client.0.smithi084.stdout:op 844 completed, throughput=4.97MB/sec 2024-01-13T18:23:55.353 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kr1-86gBD6eBtzI off=16115462 len=1669283 2024-01-13T18:23:55.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 845 completed, throughput=4.98MB/sec 2024-01-13T18:23:55.361 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8sL1HfdRipGGnNn off=1693271 len=367756 2024-01-13T18:23:55.365 INFO:tasks.workunit.client.0.smithi084.stdout:op 846 completed, throughput=4.99MB/sec 2024-01-13T18:23:55.365 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Z7AnNFjVydGQ58c off=5146485 len=370028 2024-01-13T18:23:55.368 INFO:tasks.workunit.client.0.smithi084.stdout:op 847 completed, throughput=4.99MB/sec 2024-01-13T18:23:55.368 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1rcSrTDDzmmdELC off=5963105 len=1892270 2024-01-13T18:23:55.374 INFO:tasks.workunit.client.0.smithi084.stdout:op 848 completed, throughput=5MB/sec 2024-01-13T18:23:55.374 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tBbbNJWMLKbbxzC off=644626 len=2025059 2024-01-13T18:23:55.385 INFO:tasks.workunit.client.0.smithi084.stdout:op 849 completed, throughput=5.01MB/sec 2024-01-13T18:23:55.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:55 smithi099 ceph-mon[138788]: pgmap v1563: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:23:55.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:55 smithi084 ceph-mon[116404]: pgmap v1563: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:23:55.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:55 smithi084 ceph-mon[119097]: pgmap v1563: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:23:56.386 INFO:tasks.workunit.client.0.smithi084.stdout: 169: throughput=4.98MB/sec pending data=0 2024-01-13T18:23:56.386 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wMslIekSPOkSMWi off=2619345 len=1283532 2024-01-13T18:23:56.388 INFO:tasks.workunit.client.0.smithi084.stdout:op 850 completed, throughput=4.99MB/sec 2024-01-13T18:23:56.388 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6gcHnkMnosJbOlJ off=524683 len=91740 2024-01-13T18:23:56.391 INFO:tasks.workunit.client.0.smithi084.stdout:op 851 completed, throughput=4.99MB/sec 2024-01-13T18:23:56.391 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cotH6tTfrzogS1w off=5353960 len=207088 2024-01-13T18:23:56.392 INFO:tasks.workunit.client.0.smithi084.stdout:op 852 completed, throughput=4.99MB/sec 2024-01-13T18:23:56.392 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V46Sdl-HAVQBafE off=6280720 len=443913 2024-01-13T18:23:56.393 INFO:tasks.workunit.client.0.smithi084.stdout:op 853 completed, throughput=4.99MB/sec 2024-01-13T18:23:56.393 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ssmKwydGggsvrX4 off=2325290 len=1998835 2024-01-13T18:23:56.404 INFO:tasks.workunit.client.0.smithi084.stdout:op 854 completed, throughput=5MB/sec 2024-01-13T18:23:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: 170: throughput=4.97MB/sec pending data=0 2024-01-13T18:23:57.405 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hFhfz5dgY22O7Lf off=3298893 len=682224 2024-01-13T18:23:57.406 INFO:tasks.workunit.client.0.smithi084.stdout:op 855 completed, throughput=4.98MB/sec 2024-01-13T18:23:57.406 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_affKr_IB5hBMwr off=3839185 len=1739256 2024-01-13T18:23:57.408 INFO:tasks.workunit.client.0.smithi084.stdout:op 856 completed, throughput=4.99MB/sec 2024-01-13T18:23:57.408 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cPIoBlCMJM4blWO off=13069304 len=1043899 2024-01-13T18:23:57.410 INFO:tasks.workunit.client.0.smithi084.stdout:op 857 completed, throughput=4.99MB/sec 2024-01-13T18:23:57.410 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-91O11Ddb3bOQ8fv off=864402 len=778657 2024-01-13T18:23:57.415 INFO:tasks.workunit.client.0.smithi084.stdout:op 858 completed, throughput=5MB/sec 2024-01-13T18:23:57.415 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KF6W6jU68tXih98 off=6032592 len=492383 2024-01-13T18:23:57.416 INFO:tasks.workunit.client.0.smithi084.stdout:op 859 completed, throughput=5MB/sec 2024-01-13T18:23:57.416 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZhbfcYjjtEuYq7v off=2632354 len=2063794 2024-01-13T18:23:57.428 INFO:tasks.workunit.client.0.smithi084.stdout:op 860 completed, throughput=5.01MB/sec 2024-01-13T18:23:57.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:57 smithi099 ceph-mon[138788]: pgmap v1564: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:23:57.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:57 smithi084 ceph-mon[116404]: pgmap v1564: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:23:57.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:57 smithi084 ceph-mon[119097]: pgmap v1564: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:23:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: 171: throughput=4.98MB/sec pending data=0 2024-01-13T18:23:58.428 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OM5kT38-VV11FJh off=400070 len=1515595 2024-01-13T18:23:58.430 INFO:tasks.workunit.client.0.smithi084.stdout:op 861 completed, throughput=4.99MB/sec 2024-01-13T18:23:58.430 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4EmWJT9uG1alr2B off=1596410 len=2060299 2024-01-13T18:23:58.443 INFO:tasks.workunit.client.0.smithi084.stdout:op 862 completed, throughput=5MB/sec 2024-01-13T18:23:58.443 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L7bdsNt_IR2u-sb off=1743426 len=1563525 2024-01-13T18:23:58.443 INFO:tasks.workunit.client.0.smithi084.stdout:op 863 completed, throughput=5.01MB/sec 2024-01-13T18:23:59.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:23:59 smithi084 ceph-mon[116404]: pgmap v1565: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:23:59.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:23:59 smithi084 ceph-mon[119097]: pgmap v1565: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:23:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: 172: throughput=4.98MB/sec pending data=0 2024-01-13T18:23:59.444 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--gZ1s4RCxd5Q7DJ off=7947060 len=1893753 2024-01-13T18:23:59.451 INFO:tasks.workunit.client.0.smithi084.stdout:op 864 completed, throughput=4.99MB/sec 2024-01-13T18:23:59.451 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HQgg2j16h8dLXLx off=9046294 len=1232788 2024-01-13T18:23:59.453 INFO:tasks.workunit.client.0.smithi084.stdout:op 865 completed, throughput=5MB/sec 2024-01-13T18:23:59.453 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ie6BwwuLJsCi7iE off=1992801 len=929929 2024-01-13T18:23:59.454 INFO:tasks.workunit.client.0.smithi084.stdout:op 866 completed, throughput=5MB/sec 2024-01-13T18:23:59.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:23:59 smithi099 ceph-mon[138788]: pgmap v1565: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:24:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: 173: throughput=4.97MB/sec pending data=0 2024-01-13T18:24:00.455 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eAHcDDR5DDqHSC7 off=520735 len=904812 2024-01-13T18:24:00.460 INFO:tasks.workunit.client.0.smithi084.stdout:op 867 completed, throughput=4.98MB/sec 2024-01-13T18:24:00.460 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7_yu6QKirlE9IXX off=893396 len=1613420 2024-01-13T18:24:00.467 INFO:tasks.workunit.client.0.smithi084.stdout:op 868 completed, throughput=4.99MB/sec 2024-01-13T18:24:00.467 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h_bkMLkdi4PX5Oa off=1094554 len=1263416 2024-01-13T18:24:00.472 INFO:tasks.workunit.client.0.smithi084.stdout:op 869 completed, throughput=4.99MB/sec 2024-01-13T18:24:00.472 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CASwWAmSgAEbzC8 off=12599394 len=1176261 2024-01-13T18:24:00.474 INFO:tasks.workunit.client.0.smithi084.stdout:op 870 completed, throughput=5MB/sec 2024-01-13T18:24:00.474 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zjj7ArZujbeRnbo off=266285 len=898828 2024-01-13T18:24:00.478 INFO:tasks.workunit.client.0.smithi084.stdout:op 871 completed, throughput=5MB/sec 2024-01-13T18:24:00.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:24:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:24:00] "GET /metrics HTTP/1.1" 200 33981 "" "Prometheus/2.43.0" 2024-01-13T18:24:01.479 INFO:tasks.workunit.client.0.smithi084.stdout: 174: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:01.479 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mLWM6oRMWEaPNiX off=12146773 len=478360 2024-01-13T18:24:01.480 INFO:tasks.workunit.client.0.smithi084.stdout:op 872 completed, throughput=4.98MB/sec 2024-01-13T18:24:01.480 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eKIypPNHcncJGcV off=7126096 len=350449 2024-01-13T18:24:01.483 INFO:tasks.workunit.client.0.smithi084.stdout:op 873 completed, throughput=4.98MB/sec 2024-01-13T18:24:01.483 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_q6-wOxXXmlaV3F off=2511473 len=383814 2024-01-13T18:24:01.487 INFO:tasks.workunit.client.0.smithi084.stdout:op 874 completed, throughput=4.98MB/sec 2024-01-13T18:24:01.487 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gm_V5iyhQcirvJ_ off=216847 len=1649605 2024-01-13T18:24:01.489 INFO:tasks.workunit.client.0.smithi084.stdout:op 875 completed, throughput=4.99MB/sec 2024-01-13T18:24:01.489 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tNSB-ouvucj6SJb off=12241580 len=938848 2024-01-13T18:24:01.490 INFO:tasks.workunit.client.0.smithi084.stdout:op 876 completed, throughput=5MB/sec 2024-01-13T18:24:01.490 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ww1MWcd0vORPpzj off=1104603 len=177073 2024-01-13T18:24:01.492 INFO:tasks.workunit.client.0.smithi084.stdout:op 877 completed, throughput=5MB/sec 2024-01-13T18:24:01.492 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UG8emBTws8yx09L off=15102800 len=151975 2024-01-13T18:24:01.495 INFO:tasks.workunit.client.0.smithi084.stdout:op 878 completed, throughput=5MB/sec 2024-01-13T18:24:01.495 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DAs45PlWqJPJYy5 off=11239498 len=2095118 2024-01-13T18:24:01.507 INFO:tasks.workunit.client.0.smithi084.stdout:op 879 completed, throughput=5.01MB/sec 2024-01-13T18:24:01.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:01 smithi099 ceph-mon[138788]: pgmap v1566: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 5 op/s 2024-01-13T18:24:01.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:01 smithi084 ceph-mon[116404]: pgmap v1566: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 5 op/s 2024-01-13T18:24:01.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:01 smithi084 ceph-mon[119097]: pgmap v1566: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 5 op/s 2024-01-13T18:24:02.507 INFO:tasks.workunit.client.0.smithi084.stdout: 175: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:02.507 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-a65rfosQ30xs5t0 off=13377389 len=1313053 2024-01-13T18:24:02.516 INFO:tasks.workunit.client.0.smithi084.stdout:op 880 completed, throughput=4.99MB/sec 2024-01-13T18:24:02.516 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DSd9lcIujRLKUxK off=10255863 len=49873 2024-01-13T18:24:02.516 INFO:tasks.workunit.client.0.smithi084.stdout:op 881 completed, throughput=4.99MB/sec 2024-01-13T18:24:02.516 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gNBs-sGVsjBU3ch off=7622939 len=1556578 2024-01-13T18:24:02.522 INFO:tasks.workunit.client.0.smithi084.stdout:op 882 completed, throughput=5MB/sec 2024-01-13T18:24:02.522 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZgcRIU94-WOXds8 off=3472352 len=345809 2024-01-13T18:24:02.525 INFO:tasks.workunit.client.0.smithi084.stdout:op 883 completed, throughput=5MB/sec 2024-01-13T18:24:02.525 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5RIs7kuRC8oikpg off=6475027 len=818114 2024-01-13T18:24:02.529 INFO:tasks.workunit.client.0.smithi084.stdout:op 884 completed, throughput=5MB/sec 2024-01-13T18:24:03.529 INFO:tasks.workunit.client.0.smithi084.stdout: 176: throughput=4.97MB/sec pending data=0 2024-01-13T18:24:03.530 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ctczsPTPXI7pNSP off=10273310 len=740778 2024-01-13T18:24:03.534 INFO:tasks.workunit.client.0.smithi084.stdout:op 885 completed, throughput=4.98MB/sec 2024-01-13T18:24:03.534 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0zDTLkT41NfHo8j off=8722528 len=350731 2024-01-13T18:24:03.535 INFO:tasks.workunit.client.0.smithi084.stdout:op 886 completed, throughput=4.98MB/sec 2024-01-13T18:24:03.535 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IVfSe7rUgpW8xDu off=9616458 len=293683 2024-01-13T18:24:03.536 INFO:tasks.workunit.client.0.smithi084.stdout:op 887 completed, throughput=4.98MB/sec 2024-01-13T18:24:03.536 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AG1sVhw9FbqX5QC off=7959507 len=1286717 2024-01-13T18:24:03.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 888 completed, throughput=4.99MB/sec 2024-01-13T18:24:03.544 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XoSBx2qmA4CZFxI off=14274467 len=116432 2024-01-13T18:24:03.546 INFO:tasks.workunit.client.0.smithi084.stdout:op 889 completed, throughput=4.99MB/sec 2024-01-13T18:24:03.546 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SUvf0yywx7WIPv6 off=1831699 len=641049 2024-01-13T18:24:03.546 INFO:tasks.workunit.client.0.smithi084.stdout:op 890 completed, throughput=4.99MB/sec 2024-01-13T18:24:03.546 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Tkwf2Foz_iNyaW7 off=6620420 len=1692509 2024-01-13T18:24:03.555 INFO:tasks.workunit.client.0.smithi084.stdout:op 891 completed, throughput=5MB/sec 2024-01-13T18:24:03.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:03 smithi099 ceph-mon[138788]: pgmap v1567: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:24:03.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:03 smithi084 ceph-mon[116404]: pgmap v1567: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:24:03.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:03 smithi084 ceph-mon[119097]: pgmap v1567: 105 pgs: 105 active+clean; 128 GiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:24:04.555 INFO:tasks.workunit.client.0.smithi084.stdout: 177: throughput=4.97MB/sec pending data=0 2024-01-13T18:24:04.555 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4cr1flvQODFhkwp off=942415 len=1821048 2024-01-13T18:24:04.566 INFO:tasks.workunit.client.0.smithi084.stdout:op 892 completed, throughput=4.98MB/sec 2024-01-13T18:24:04.566 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XWZRqlmyzYu2Voz off=14268916 len=889055 2024-01-13T18:24:04.571 INFO:tasks.workunit.client.0.smithi084.stdout:op 893 completed, throughput=4.99MB/sec 2024-01-13T18:24:04.571 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MQbIkoksFfwxBdN off=43317 len=554416 2024-01-13T18:24:04.572 INFO:tasks.workunit.client.0.smithi084.stdout:op 894 completed, throughput=4.99MB/sec 2024-01-13T18:24:04.572 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_MFmuO7TXM5kwyF off=19912402 len=2070582 2024-01-13T18:24:04.573 INFO:tasks.workunit.client.0.smithi084.stdout:op 895 completed, throughput=5MB/sec 2024-01-13T18:24:05.574 INFO:tasks.workunit.client.0.smithi084.stdout: 178: throughput=4.97MB/sec pending data=0 2024-01-13T18:24:05.574 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zhQQpNOeomMXypH off=4508222 len=1140705 2024-01-13T18:24:05.575 INFO:tasks.workunit.client.0.smithi084.stdout:op 896 completed, throughput=4.98MB/sec 2024-01-13T18:24:05.575 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7M2MVfnPc-O_MzT off=4727249 len=309548 2024-01-13T18:24:05.576 INFO:tasks.workunit.client.0.smithi084.stdout:op 897 completed, throughput=4.98MB/sec 2024-01-13T18:24:05.576 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UkCMTTe_12fSvO4 off=10521921 len=998615 2024-01-13T18:24:05.577 INFO:tasks.workunit.client.0.smithi084.stdout:op 898 completed, throughput=4.99MB/sec 2024-01-13T18:24:05.577 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wQfwgQKetABskx_ off=1575988 len=787930 2024-01-13T18:24:05.578 INFO:tasks.workunit.client.0.smithi084.stdout:op 899 completed, throughput=4.99MB/sec 2024-01-13T18:24:05.578 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qIhiIB4rcV5D6xr off=6426528 len=1744771 2024-01-13T18:24:05.582 INFO:tasks.workunit.client.0.smithi084.stdout:op 900 completed, throughput=5MB/sec 2024-01-13T18:24:05.582 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_cYGG97VaF6JoeT off=4561903 len=1764053 2024-01-13T18:24:05.584 INFO:tasks.workunit.client.0.smithi084.stdout:op 901 completed, throughput=5.01MB/sec 2024-01-13T18:24:05.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:05 smithi099 ceph-mon[138788]: pgmap v1568: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:24:05.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:05 smithi084 ceph-mon[116404]: pgmap v1568: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:24:05.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:05 smithi084 ceph-mon[119097]: pgmap v1568: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:24:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:06.584 INFO:tasks.workunit.client.0.smithi084.stdout: 179: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:06.584 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pvPnlexLCNz-HM1 off=1134170 len=1925209 2024-01-13T18:24:06.586 INFO:tasks.workunit.client.0.smithi084.stdout:op 902 completed, throughput=4.99MB/sec 2024-01-13T18:24:06.586 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JPs3VF0ntt6ReNj off=795479 len=1631745 2024-01-13T18:24:06.590 INFO:tasks.workunit.client.0.smithi084.stdout:op 903 completed, throughput=5MB/sec 2024-01-13T18:24:06.590 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pRTEJkHT6NG0Cpc off=0 len=1919883 2024-01-13T18:24:06.599 INFO:tasks.workunit.client.0.smithi084.stdout:op 904 completed, throughput=5.01MB/sec 2024-01-13T18:24:07.599 INFO:tasks.workunit.client.0.smithi084.stdout: 180: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:07.599 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-L7BdYACGT_Df6jr off=5146613 len=1684741 2024-01-13T18:24:07.608 INFO:tasks.workunit.client.0.smithi084.stdout:op 905 completed, throughput=4.99MB/sec 2024-01-13T18:24:07.608 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6uVYs4cW95OCGQz off=13944026 len=711633 2024-01-13T18:24:07.612 INFO:tasks.workunit.client.0.smithi084.stdout:op 906 completed, throughput=4.99MB/sec 2024-01-13T18:24:07.612 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qeX-zU-2NU4JDyg off=6645084 len=246019 2024-01-13T18:24:07.615 INFO:tasks.workunit.client.0.smithi084.stdout:op 907 completed, throughput=4.99MB/sec 2024-01-13T18:24:07.615 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NdoNZTopNWJUa2h off=3307 len=469068 2024-01-13T18:24:07.618 INFO:tasks.workunit.client.0.smithi084.stdout:op 908 completed, throughput=5MB/sec 2024-01-13T18:24:07.618 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UWN6z85qY8yl7dn off=11041170 len=963508 2024-01-13T18:24:07.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:07 smithi099 ceph-mon[138788]: pgmap v1569: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:24:07.623 INFO:tasks.workunit.client.0.smithi084.stdout:op 909 completed, throughput=5MB/sec 2024-01-13T18:24:07.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:07 smithi084 ceph-mon[116404]: pgmap v1569: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:24:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:07 smithi084 ceph-mon[119097]: pgmap v1569: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:24:08.624 INFO:tasks.workunit.client.0.smithi084.stdout: 181: throughput=4.97MB/sec pending data=0 2024-01-13T18:24:08.624 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kLXCdnCepc_yK3Q off=16285847 len=138496 2024-01-13T18:24:08.626 INFO:tasks.workunit.client.0.smithi084.stdout:op 910 completed, throughput=4.98MB/sec 2024-01-13T18:24:08.626 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WC0cYHmr-G4dkH5 off=3346132 len=1033474 2024-01-13T18:24:08.631 INFO:tasks.workunit.client.0.smithi084.stdout:op 911 completed, throughput=4.98MB/sec 2024-01-13T18:24:08.631 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-snKH0nFLVNfkSmO off=415891 len=667983 2024-01-13T18:24:08.635 INFO:tasks.workunit.client.0.smithi084.stdout:op 912 completed, throughput=4.98MB/sec 2024-01-13T18:24:08.635 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7vKlXYvsVyoRAIT off=6495118 len=1893199 2024-01-13T18:24:08.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 913 completed, throughput=4.99MB/sec 2024-01-13T18:24:08.646 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-e6ifLAW8wZSzCmQ off=7079243 len=1198342 2024-01-13T18:24:08.647 INFO:tasks.workunit.client.0.smithi084.stdout:op 914 completed, throughput=5MB/sec 2024-01-13T18:24:08.647 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rNNolup7pX0SuZe off=2767696 len=498813 2024-01-13T18:24:08.651 INFO:tasks.workunit.client.0.smithi084.stdout:op 915 completed, throughput=5MB/sec 2024-01-13T18:24:09.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:09 smithi084 ceph-mon[116404]: pgmap v1570: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:24:09.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:09 smithi084 ceph-mon[119097]: pgmap v1570: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:24:09.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:09 smithi099 ceph-mon[138788]: pgmap v1570: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:24:09.651 INFO:tasks.workunit.client.0.smithi084.stdout: 182: throughput=4.97MB/sec pending data=0 2024-01-13T18:24:09.651 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Oh_7O0_96q5hd4k off=13670929 len=1627124 2024-01-13T18:24:09.653 INFO:tasks.workunit.client.0.smithi084.stdout:op 916 completed, throughput=4.98MB/sec 2024-01-13T18:24:09.653 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gZ3enN4gYbvpbFE off=20069032 len=618412 2024-01-13T18:24:09.655 INFO:tasks.workunit.client.0.smithi084.stdout:op 917 completed, throughput=4.99MB/sec 2024-01-13T18:24:09.655 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sp8cqsEqGRCY8WM off=15027961 len=1582928 2024-01-13T18:24:09.658 INFO:tasks.workunit.client.0.smithi084.stdout:op 918 completed, throughput=4.99MB/sec 2024-01-13T18:24:09.658 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QLbXnOvUupYD-En off=7010263 len=1820452 2024-01-13T18:24:09.669 INFO:tasks.workunit.client.0.smithi084.stdout:op 919 completed, throughput=5MB/sec 2024-01-13T18:24:10.669 INFO:tasks.workunit.client.0.smithi084.stdout: 183: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:10.670 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IEqFHJ8A5go6N7v off=225533 len=117194 2024-01-13T18:24:10.672 INFO:tasks.workunit.client.0.smithi084.stdout:op 920 completed, throughput=4.98MB/sec 2024-01-13T18:24:10.672 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CWogcfgoxeSp7k7 off=8599375 len=1457854 2024-01-13T18:24:10.674 INFO:tasks.workunit.client.0.smithi084.stdout:op 921 completed, throughput=4.98MB/sec 2024-01-13T18:24:10.674 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1LTixnM829MFUN8 off=8579360 len=2025416 2024-01-13T18:24:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:24:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:24:10] "GET /metrics HTTP/1.1" 200 33982 "" "Prometheus/2.43.0" 2024-01-13T18:24:10.686 INFO:tasks.workunit.client.0.smithi084.stdout:op 922 completed, throughput=4.99MB/sec 2024-01-13T18:24:10.686 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XIM1QblSwpM9Kso off=1887025 len=1959579 2024-01-13T18:24:10.696 INFO:tasks.workunit.client.0.smithi084.stdout:op 923 completed, throughput=5MB/sec 2024-01-13T18:24:11.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:11 smithi099 ceph-mon[138788]: pgmap v1571: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:24:11.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:11 smithi084 ceph-mon[116404]: pgmap v1571: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:24:11.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:11 smithi084 ceph-mon[119097]: pgmap v1571: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:24:11.696 INFO:tasks.workunit.client.0.smithi084.stdout: 184: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:11.696 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-t8MpXqJLbFYQZ3U off=596669 len=861266 2024-01-13T18:24:11.697 INFO:tasks.workunit.client.0.smithi084.stdout:op 924 completed, throughput=4.98MB/sec 2024-01-13T18:24:11.697 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2TIN0AKks_7OAY4 off=2988111 len=1509244 2024-01-13T18:24:11.706 INFO:tasks.workunit.client.0.smithi084.stdout:op 925 completed, throughput=4.99MB/sec 2024-01-13T18:24:11.706 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qex69x8gwWYbzAy off=798448 len=568396 2024-01-13T18:24:11.709 INFO:tasks.workunit.client.0.smithi084.stdout:op 926 completed, throughput=4.99MB/sec 2024-01-13T18:24:11.709 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PGDj4JliJTgSVeX off=6319375 len=1787837 2024-01-13T18:24:11.711 INFO:tasks.workunit.client.0.smithi084.stdout:op 927 completed, throughput=5MB/sec 2024-01-13T18:24:12.712 INFO:tasks.workunit.client.0.smithi084.stdout: 185: throughput=4.97MB/sec pending data=0 2024-01-13T18:24:12.712 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ge_20MrX9zfKtdp off=15531092 len=1848586 2024-01-13T18:24:12.714 INFO:tasks.workunit.client.0.smithi084.stdout:op 928 completed, throughput=4.98MB/sec 2024-01-13T18:24:12.714 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ssmKwydGggsvrX4 off=1066011 len=516764 2024-01-13T18:24:12.716 INFO:tasks.workunit.client.0.smithi084.stdout:op 929 completed, throughput=4.99MB/sec 2024-01-13T18:24:12.716 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Mb-jnDAwgcCRGu6 off=17304108 len=1630602 2024-01-13T18:24:12.718 INFO:tasks.workunit.client.0.smithi084.stdout:op 930 completed, throughput=4.99MB/sec 2024-01-13T18:24:12.718 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DEsPoxczxQeiP2B off=3242141 len=969200 2024-01-13T18:24:12.720 INFO:tasks.workunit.client.0.smithi084.stdout:op 931 completed, throughput=5MB/sec 2024-01-13T18:24:12.720 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QYeCMm4QWwSbVzi off=7314951 len=1938011 2024-01-13T18:24:12.733 INFO:tasks.workunit.client.0.smithi084.stdout:op 932 completed, throughput=5.01MB/sec 2024-01-13T18:24:13.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:13 smithi099 ceph-mon[138788]: pgmap v1572: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:24:13.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:13 smithi084 ceph-mon[116404]: pgmap v1572: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:24:13.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:13 smithi084 ceph-mon[119097]: pgmap v1572: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:24:13.733 INFO:tasks.workunit.client.0.smithi084.stdout: 186: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:13.733 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FwsU_nd_hfMSmU_ off=15184629 len=1456390 2024-01-13T18:24:13.735 INFO:tasks.workunit.client.0.smithi084.stdout:op 933 completed, throughput=4.99MB/sec 2024-01-13T18:24:13.735 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_MOIOmjC0LfmWHC off=7924034 len=1094041 2024-01-13T18:24:13.741 INFO:tasks.workunit.client.0.smithi084.stdout:op 934 completed, throughput=5MB/sec 2024-01-13T18:24:13.741 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L5Rc6TUBX74075T off=2700817 len=185211 2024-01-13T18:24:13.741 INFO:tasks.workunit.client.0.smithi084.stdout:op 935 completed, throughput=5MB/sec 2024-01-13T18:24:13.741 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S2h3BXck6S-a10- off=4038260 len=626188 2024-01-13T18:24:13.745 INFO:tasks.workunit.client.0.smithi084.stdout:op 936 completed, throughput=5MB/sec 2024-01-13T18:24:13.745 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6em9O7r9Ihp3Zag off=1250095 len=856403 2024-01-13T18:24:13.746 INFO:tasks.workunit.client.0.smithi084.stdout:op 937 completed, throughput=5MB/sec 2024-01-13T18:24:14.747 INFO:tasks.workunit.client.0.smithi084.stdout: 187: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:14.747 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-udgNSjFT9yHRMll off=10992594 len=1836850 2024-01-13T18:24:14.749 INFO:tasks.workunit.client.0.smithi084.stdout:op 938 completed, throughput=4.99MB/sec 2024-01-13T18:24:14.749 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--yoXpvudNRGgtzW off=3909509 len=1437072 2024-01-13T18:24:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:op 939 completed, throughput=4.99MB/sec 2024-01-13T18:24:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NEzpSh5nFeZ_PD6 off=11064201 len=516797 2024-01-13T18:24:14.760 INFO:tasks.workunit.client.0.smithi084.stdout:op 940 completed, throughput=5MB/sec 2024-01-13T18:24:14.760 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-M-v1t4bGYmd7VX2 off=11423708 len=523091 2024-01-13T18:24:14.763 INFO:tasks.workunit.client.0.smithi084.stdout:op 941 completed, throughput=5MB/sec 2024-01-13T18:24:14.763 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tiklcJeV1Z967SS off=4991960 len=59455 2024-01-13T18:24:14.764 INFO:tasks.workunit.client.0.smithi084.stdout:op 942 completed, throughput=5MB/sec 2024-01-13T18:24:14.764 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YIxxir0GZf2HVG4 off=1109826 len=17337 2024-01-13T18:24:14.764 INFO:tasks.workunit.client.0.smithi084.stdout:op 943 completed, throughput=5MB/sec 2024-01-13T18:24:14.764 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k9X4QuqGkadRYkO off=1361083 len=1000507 2024-01-13T18:24:14.769 INFO:tasks.workunit.client.0.smithi084.stdout:op 944 completed, throughput=5MB/sec 2024-01-13T18:24:15.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:15 smithi099 ceph-mon[138788]: pgmap v1573: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:24:15.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:15 smithi084 ceph-mon[116404]: pgmap v1573: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:24:15.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:15 smithi084 ceph-mon[119097]: pgmap v1573: 105 pgs: 105 active+clean; 128 GiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:24:15.770 INFO:tasks.workunit.client.0.smithi084.stdout: 188: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:15.770 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FfqKW3VXzrkg9wS off=0 len=1503131 2024-01-13T18:24:15.771 INFO:tasks.workunit.client.0.smithi084.stdout:op 945 completed, throughput=4.99MB/sec 2024-01-13T18:24:15.772 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2Hm7WFSOM10sM7E off=20738800 len=1874565 2024-01-13T18:24:15.781 INFO:tasks.workunit.client.0.smithi084.stdout:op 946 completed, throughput=4.99MB/sec 2024-01-13T18:24:15.781 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-45WJm6dq0CLVj2q off=17174741 len=1821515 2024-01-13T18:24:15.792 INFO:tasks.workunit.client.0.smithi084.stdout:op 947 completed, throughput=5MB/sec 2024-01-13T18:24:16.792 INFO:tasks.workunit.client.0.smithi084.stdout: 189: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:16.792 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JUzAr9vtJuFee1l off=3256079 len=819728 2024-01-13T18:24:16.796 INFO:tasks.workunit.client.0.smithi084.stdout:op 948 completed, throughput=4.98MB/sec 2024-01-13T18:24:16.796 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RCo6FndNbECTiop off=8487283 len=1334510 2024-01-13T18:24:16.798 INFO:tasks.workunit.client.0.smithi084.stdout:op 949 completed, throughput=4.99MB/sec 2024-01-13T18:24:16.798 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iPWTSzJ7cxLtcVJ off=681398 len=729506 2024-01-13T18:24:16.800 INFO:tasks.workunit.client.0.smithi084.stdout:op 950 completed, throughput=4.99MB/sec 2024-01-13T18:24:16.800 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4a2Sxn0pzT0cOyr off=3013741 len=276179 2024-01-13T18:24:16.801 INFO:tasks.workunit.client.0.smithi084.stdout:op 951 completed, throughput=4.99MB/sec 2024-01-13T18:24:16.801 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-htZZ3SPeQYH6BYB off=20402040 len=798711 2024-01-13T18:24:16.805 INFO:tasks.workunit.client.0.smithi084.stdout:op 952 completed, throughput=5MB/sec 2024-01-13T18:24:16.806 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oA45gtitzzvhfBV off=8470103 len=1676346 2024-01-13T18:24:16.808 INFO:tasks.workunit.client.0.smithi084.stdout:op 953 completed, throughput=5MB/sec 2024-01-13T18:24:17.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:17 smithi099 ceph-mon[138788]: pgmap v1574: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:24:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:17 smithi084 ceph-mon[116404]: pgmap v1574: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:24:17.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:17 smithi084 ceph-mon[119097]: pgmap v1574: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:24:17.809 INFO:tasks.workunit.client.0.smithi084.stdout: 190: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:17.809 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TDwdXDaVMKYLwd- off=12969976 len=976255 2024-01-13T18:24:17.814 INFO:tasks.workunit.client.0.smithi084.stdout:op 954 completed, throughput=4.98MB/sec 2024-01-13T18:24:17.814 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tw1793nvkv6lWbv off=10997792 len=591928 2024-01-13T18:24:17.818 INFO:tasks.workunit.client.0.smithi084.stdout:op 955 completed, throughput=4.99MB/sec 2024-01-13T18:24:17.818 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G6SL48VEAlLMnol off=838599 len=1114801 2024-01-13T18:24:17.823 INFO:tasks.workunit.client.0.smithi084.stdout:op 956 completed, throughput=4.99MB/sec 2024-01-13T18:24:17.823 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-b29iwuFR7IUHo1- off=9467373 len=1618890 2024-01-13T18:24:17.830 INFO:tasks.workunit.client.0.smithi084.stdout:op 957 completed, throughput=5MB/sec 2024-01-13T18:24:17.830 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lO-QsFxZHz7XY9V off=713016 len=949595 2024-01-13T18:24:17.831 INFO:tasks.workunit.client.0.smithi084.stdout:op 958 completed, throughput=5MB/sec 2024-01-13T18:24:18.832 INFO:tasks.workunit.client.0.smithi084.stdout: 191: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:18.832 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n5ajS_-WPNMD8P2 off=2853194 len=530523 2024-01-13T18:24:18.832 INFO:tasks.workunit.client.0.smithi084.stdout:op 959 completed, throughput=4.98MB/sec 2024-01-13T18:24:18.833 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vxgEsfAMcibXe50 off=283642 len=1137136 2024-01-13T18:24:18.839 INFO:tasks.workunit.client.0.smithi084.stdout:op 960 completed, throughput=4.99MB/sec 2024-01-13T18:24:18.839 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-R5yPzGWFkQ-N9qp off=7221377 len=506304 2024-01-13T18:24:18.840 INFO:tasks.workunit.client.0.smithi084.stdout:op 961 completed, throughput=4.99MB/sec 2024-01-13T18:24:18.840 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eqU5zrSNTDwroMJ off=9289575 len=1984737 2024-01-13T18:24:18.848 INFO:tasks.workunit.client.0.smithi084.stdout:op 962 completed, throughput=5MB/sec 2024-01-13T18:24:18.849 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dQQoyJbtjDGYEgH off=6231783 len=857204 2024-01-13T18:24:18.853 INFO:tasks.workunit.client.0.smithi084.stdout:op 963 completed, throughput=5MB/sec 2024-01-13T18:24:19.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:19 smithi084 ceph-mon[116404]: pgmap v1575: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:24:19.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:19 smithi084 ceph-mon[119097]: pgmap v1575: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:24:19.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:19 smithi099 ceph-mon[138788]: pgmap v1575: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:24:19.854 INFO:tasks.workunit.client.0.smithi084.stdout: 192: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:19.854 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7GZeDQPfxxOdHME off=8294873 len=787858 2024-01-13T18:24:19.856 INFO:tasks.workunit.client.0.smithi084.stdout:op 964 completed, throughput=4.98MB/sec 2024-01-13T18:24:19.856 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OoVRN4SriB4rGq4 off=3947074 len=1392906 2024-01-13T18:24:19.863 INFO:tasks.workunit.client.0.smithi084.stdout:op 965 completed, throughput=4.99MB/sec 2024-01-13T18:24:19.863 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k0syTvX2-Vdnptw off=10475678 len=511990 2024-01-13T18:24:19.864 INFO:tasks.workunit.client.0.smithi084.stdout:op 966 completed, throughput=4.99MB/sec 2024-01-13T18:24:19.864 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XFu5ffNv7bEmA9_ off=10068789 len=1830394 2024-01-13T18:24:19.874 INFO:tasks.workunit.client.0.smithi084.stdout:op 967 completed, throughput=5MB/sec 2024-01-13T18:24:19.874 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uGr28WDtsQfWwTF off=8389879 len=2017643 2024-01-13T18:24:19.876 INFO:tasks.workunit.client.0.smithi084.stdout:op 968 completed, throughput=5.01MB/sec 2024-01-13T18:24:20.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:20.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:24:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:24:20] "GET /metrics HTTP/1.1" 200 33980 "" "Prometheus/2.43.0" 2024-01-13T18:24:20.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:20.876 INFO:tasks.workunit.client.0.smithi084.stdout: 193: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:20.876 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2UaocKQvgWOYqb4 off=7285769 len=281561 2024-01-13T18:24:20.879 INFO:tasks.workunit.client.0.smithi084.stdout:op 969 completed, throughput=4.98MB/sec 2024-01-13T18:24:20.879 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-edQibCiJviPGe1C off=974765 len=728242 2024-01-13T18:24:20.880 INFO:tasks.workunit.client.0.smithi084.stdout:op 970 completed, throughput=4.99MB/sec 2024-01-13T18:24:20.881 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bLzGv1-AY_hemV4 off=2838560 len=1281390 2024-01-13T18:24:20.886 INFO:tasks.workunit.client.0.smithi084.stdout:op 971 completed, throughput=4.99MB/sec 2024-01-13T18:24:20.887 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-X3oTNXxgcFS2mH9 off=7998376 len=743202 2024-01-13T18:24:20.888 INFO:tasks.workunit.client.0.smithi084.stdout:op 972 completed, throughput=5MB/sec 2024-01-13T18:24:20.888 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rkIicvjEwDFBmOH off=1618546 len=1679559 2024-01-13T18:24:20.898 INFO:tasks.workunit.client.0.smithi084.stdout:op 973 completed, throughput=5MB/sec 2024-01-13T18:24:21.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:21 smithi084 ceph-mon[116404]: pgmap v1576: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:24:21.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:21 smithi084 ceph-mon[119097]: pgmap v1576: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:24:21.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:21 smithi099 ceph-mon[138788]: pgmap v1576: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:24:21.898 INFO:tasks.workunit.client.0.smithi084.stdout: 194: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:21.898 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hXASoq2YQxrs6BJ off=2370005 len=1663119 2024-01-13T18:24:21.899 INFO:tasks.workunit.client.0.smithi084.stdout:op 974 completed, throughput=4.99MB/sec 2024-01-13T18:24:21.899 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gyofuxFSjRYDwQ5 off=1138683 len=561801 2024-01-13T18:24:21.902 INFO:tasks.workunit.client.0.smithi084.stdout:op 975 completed, throughput=4.99MB/sec 2024-01-13T18:24:21.903 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WWw5zTwytHFKw_f off=10990138 len=624541 2024-01-13T18:24:21.903 INFO:tasks.workunit.client.0.smithi084.stdout:op 976 completed, throughput=4.99MB/sec 2024-01-13T18:24:21.903 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zHIwLkZkaqZfx80 off=865089 len=1949370 2024-01-13T18:24:21.912 INFO:tasks.workunit.client.0.smithi084.stdout:op 977 completed, throughput=5MB/sec 2024-01-13T18:24:22.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:24:22.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:24:22.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:24:22.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:24:22.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:24:22.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:24:22.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:24:22.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:24:22.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:24:22.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:24:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:24:22.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:24:22.912 INFO:tasks.workunit.client.0.smithi084.stdout: 195: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:22.913 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-72Uu5KcogPnhZnY off=2440830 len=1717381 2024-01-13T18:24:22.914 INFO:tasks.workunit.client.0.smithi084.stdout:op 978 completed, throughput=4.99MB/sec 2024-01-13T18:24:22.914 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w9q75F39Rf_Tu4i off=282948 len=933749 2024-01-13T18:24:22.916 INFO:tasks.workunit.client.0.smithi084.stdout:op 979 completed, throughput=4.99MB/sec 2024-01-13T18:24:22.916 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lsSqFhdzODgZg1X off=7537614 len=1624606 2024-01-13T18:24:22.917 INFO:tasks.workunit.client.0.smithi084.stdout:op 980 completed, throughput=5MB/sec 2024-01-13T18:24:22.918 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xkgLwMIoryOhpEK off=7365449 len=1446382 2024-01-13T18:24:22.925 INFO:tasks.workunit.client.0.smithi084.stdout:op 981 completed, throughput=5MB/sec 2024-01-13T18:24:23.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:23 smithi084 ceph-mon[116404]: pgmap v1577: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:24:23.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:23 smithi084 ceph-mon[119097]: pgmap v1577: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:24:23.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:23 smithi099 ceph-mon[138788]: pgmap v1577: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:24:23.925 INFO:tasks.workunit.client.0.smithi084.stdout: 196: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:23.926 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2_tC4amwSJpmbM5 off=10000713 len=1546236 2024-01-13T18:24:23.927 INFO:tasks.workunit.client.0.smithi084.stdout:op 982 completed, throughput=4.99MB/sec 2024-01-13T18:24:23.927 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0VElfozSBpNcLcS off=12190617 len=875667 2024-01-13T18:24:23.929 INFO:tasks.workunit.client.0.smithi084.stdout:op 983 completed, throughput=4.99MB/sec 2024-01-13T18:24:23.929 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0OhywlS3NWa6L7k off=16829938 len=940571 2024-01-13T18:24:23.933 INFO:tasks.workunit.client.0.smithi084.stdout:op 984 completed, throughput=4.99MB/sec 2024-01-13T18:24:23.933 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZwkSR1z5_IoWytE off=154811 len=1847596 2024-01-13T18:24:23.944 INFO:tasks.workunit.client.0.smithi084.stdout:op 985 completed, throughput=5MB/sec 2024-01-13T18:24:24.944 INFO:tasks.workunit.client.0.smithi084.stdout: 197: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:24.944 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wzmUPi2PvxC2xaK off=5840633 len=262745 2024-01-13T18:24:24.948 INFO:tasks.workunit.client.0.smithi084.stdout:op 986 completed, throughput=4.98MB/sec 2024-01-13T18:24:24.948 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-u1oIvVYQyy9pRiN off=14293094 len=1004333 2024-01-13T18:24:24.949 INFO:tasks.workunit.client.0.smithi084.stdout:op 987 completed, throughput=4.98MB/sec 2024-01-13T18:24:24.949 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WSRh-Fpp-TivwyM off=3970113 len=7623 2024-01-13T18:24:24.951 INFO:tasks.workunit.client.0.smithi084.stdout:op 988 completed, throughput=4.98MB/sec 2024-01-13T18:24:24.951 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wLcWQ-6tMU2A7v- off=16890589 len=565740 2024-01-13T18:24:24.952 INFO:tasks.workunit.client.0.smithi084.stdout:op 989 completed, throughput=4.99MB/sec 2024-01-13T18:24:24.952 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VbMlpeh3eHDtZDi off=4451073 len=123249 2024-01-13T18:24:24.953 INFO:tasks.workunit.client.0.smithi084.stdout:op 990 completed, throughput=4.99MB/sec 2024-01-13T18:24:24.953 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y5NPgYYzTeU6EkT off=8525519 len=1319113 2024-01-13T18:24:24.958 INFO:tasks.workunit.client.0.smithi084.stdout:op 991 completed, throughput=4.99MB/sec 2024-01-13T18:24:24.958 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bRFq1Fbudk_LeHs off=3729512 len=1589022 2024-01-13T18:24:24.968 INFO:tasks.workunit.client.0.smithi084.stdout:op 992 completed, throughput=5MB/sec 2024-01-13T18:24:25.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:25 smithi099 ceph-mon[138788]: pgmap v1578: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:24:25.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:25 smithi084 ceph-mon[116404]: pgmap v1578: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:24:25.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:25 smithi084 ceph-mon[119097]: pgmap v1578: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:24:25.968 INFO:tasks.workunit.client.0.smithi084.stdout: 198: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:25.969 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hnwzerSH0pK9dmC off=14617039 len=1595147 2024-01-13T18:24:25.977 INFO:tasks.workunit.client.0.smithi084.stdout:op 993 completed, throughput=4.98MB/sec 2024-01-13T18:24:25.977 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Y8pMk_t1-EOBhtA off=72032 len=213771 2024-01-13T18:24:25.980 INFO:tasks.workunit.client.0.smithi084.stdout:op 994 completed, throughput=4.98MB/sec 2024-01-13T18:24:25.980 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TNTuq2yezxZUb0i off=1687056 len=452050 2024-01-13T18:24:25.983 INFO:tasks.workunit.client.0.smithi084.stdout:op 995 completed, throughput=4.99MB/sec 2024-01-13T18:24:25.983 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MyMsML4pCp5ifwn off=8029731 len=1022777 2024-01-13T18:24:25.985 INFO:tasks.workunit.client.0.smithi084.stdout:op 996 completed, throughput=4.99MB/sec 2024-01-13T18:24:25.985 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8_UdKeiClCo8q-T off=7065237 len=1498361 2024-01-13T18:24:25.987 INFO:tasks.workunit.client.0.smithi084.stdout:op 997 completed, throughput=5MB/sec 2024-01-13T18:24:25.987 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3k8cni-HYY88Ue8 off=8157939 len=1275437 2024-01-13T18:24:25.994 INFO:tasks.workunit.client.0.smithi084.stdout:op 998 completed, throughput=5MB/sec 2024-01-13T18:24:26.994 INFO:tasks.workunit.client.0.smithi084.stdout: 199: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:26.994 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r4w5_V-z-INihlG off=14473609 len=489367 2024-01-13T18:24:26.998 INFO:tasks.workunit.client.0.smithi084.stdout:op 999 completed, throughput=4.98MB/sec 2024-01-13T18:24:26.998 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NpK4rwu9gSS2p88 off=3711691 len=876872 2024-01-13T18:24:26.999 INFO:tasks.workunit.client.0.smithi084.stdout:op 1000 completed, throughput=4.99MB/sec 2024-01-13T18:24:26.999 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UZdLtnKQGGp4weJ off=7628861 len=1326356 2024-01-13T18:24:27.002 INFO:tasks.workunit.client.0.smithi084.stdout:op 1001 completed, throughput=4.99MB/sec 2024-01-13T18:24:27.002 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kiJguxT2MVna3tj off=7843929 len=587290 2024-01-13T18:24:27.006 INFO:tasks.workunit.client.0.smithi084.stdout:op 1002 completed, throughput=4.99MB/sec 2024-01-13T18:24:27.006 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OGPpm73gBUoO0HI off=3849409 len=1623666 2024-01-13T18:24:27.007 INFO:tasks.workunit.client.0.smithi084.stdout:op 1003 completed, throughput=5MB/sec 2024-01-13T18:24:27.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:27 smithi099 ceph-mon[138788]: pgmap v1579: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:24:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:27 smithi084 ceph-mon[116404]: pgmap v1579: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:24:27.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:27 smithi084 ceph-mon[119097]: pgmap v1579: 105 pgs: 105 active+clean; 128 GiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:24:28.008 INFO:tasks.workunit.client.0.smithi084.stdout: 200: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:28.008 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4iJN8c7Vyi3Uq0J off=7634052 len=1444263 2024-01-13T18:24:28.014 INFO:tasks.workunit.client.0.smithi084.stdout:op 1004 completed, throughput=4.98MB/sec 2024-01-13T18:24:28.014 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DCSbYMPm4IC0hhp off=1722202 len=1976546 2024-01-13T18:24:28.016 INFO:tasks.workunit.client.0.smithi084.stdout:op 1005 completed, throughput=4.99MB/sec 2024-01-13T18:24:28.016 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0vzK2Bga1x65M3o off=9407062 len=233158 2024-01-13T18:24:28.019 INFO:tasks.workunit.client.0.smithi084.stdout:op 1006 completed, throughput=4.99MB/sec 2024-01-13T18:24:28.019 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zrfbgE1d9xJ4lNk off=9919173 len=608937 2024-01-13T18:24:28.021 INFO:tasks.workunit.client.0.smithi084.stdout:op 1007 completed, throughput=5MB/sec 2024-01-13T18:24:28.021 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zPKaHZDYGnxh1b8 off=44223 len=1779242 2024-01-13T18:24:28.028 INFO:tasks.workunit.client.0.smithi084.stdout:op 1008 completed, throughput=5.01MB/sec 2024-01-13T18:24:29.028 INFO:tasks.workunit.client.0.smithi084.stdout: 201: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:29.028 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8PwxnWb4Uj2-5K9 off=9357443 len=179563 2024-01-13T18:24:29.029 INFO:tasks.workunit.client.0.smithi084.stdout:op 1009 completed, throughput=4.98MB/sec 2024-01-13T18:24:29.029 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h_bkMLkdi4PX5Oa off=3122710 len=962090 2024-01-13T18:24:29.034 INFO:tasks.workunit.client.0.smithi084.stdout:op 1010 completed, throughput=4.99MB/sec 2024-01-13T18:24:29.034 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OtcHPoe3FHAOAvy off=4975685 len=459166 2024-01-13T18:24:29.037 INFO:tasks.workunit.client.0.smithi084.stdout:op 1011 completed, throughput=4.99MB/sec 2024-01-13T18:24:29.037 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ra4LX-aFkQ8bRE4 off=7166936 len=1019671 2024-01-13T18:24:29.042 INFO:tasks.workunit.client.0.smithi084.stdout:op 1012 completed, throughput=4.99MB/sec 2024-01-13T18:24:29.043 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ybjmJGkgDoixx20 off=4036765 len=1258589 2024-01-13T18:24:29.044 INFO:tasks.workunit.client.0.smithi084.stdout:op 1013 completed, throughput=5MB/sec 2024-01-13T18:24:29.044 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9w_e_9B02y-4N-d off=4376114 len=1604978 2024-01-13T18:24:29.054 INFO:tasks.workunit.client.0.smithi084.stdout:op 1014 completed, throughput=5.01MB/sec 2024-01-13T18:24:29.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:29 smithi084 ceph-mon[116404]: pgmap v1580: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:24:29.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:29 smithi084 ceph-mon[119097]: pgmap v1580: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:24:29.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:29 smithi099 ceph-mon[138788]: pgmap v1580: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:24:30.054 INFO:tasks.workunit.client.0.smithi084.stdout: 202: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:30.054 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dja1FdslCsLowHN off=5982451 len=257105 2024-01-13T18:24:30.055 INFO:tasks.workunit.client.0.smithi084.stdout:op 1015 completed, throughput=4.98MB/sec 2024-01-13T18:24:30.055 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SmhLc_GoRqdzogu off=1599675 len=1523684 2024-01-13T18:24:30.057 INFO:tasks.workunit.client.0.smithi084.stdout:op 1016 completed, throughput=4.99MB/sec 2024-01-13T18:24:30.057 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OlDN8F6Yejz9EzW off=2571728 len=1320497 2024-01-13T18:24:30.058 INFO:tasks.workunit.client.0.smithi084.stdout:op 1017 completed, throughput=5MB/sec 2024-01-13T18:24:30.058 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JpZxvSTDxuwxln1 off=9560192 len=636621 2024-01-13T18:24:30.063 INFO:tasks.workunit.client.0.smithi084.stdout:op 1018 completed, throughput=5MB/sec 2024-01-13T18:24:30.063 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sAY-nCbOmolGZi3 off=23974751 len=698907 2024-01-13T18:24:30.064 INFO:tasks.workunit.client.0.smithi084.stdout:op 1019 completed, throughput=5MB/sec 2024-01-13T18:24:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:24:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:24:30] "GET /metrics HTTP/1.1" 200 33980 "" "Prometheus/2.43.0" 2024-01-13T18:24:31.064 INFO:tasks.workunit.client.0.smithi084.stdout: 203: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:31.064 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8oaypU_vA3xi_44 off=7637482 len=1494430 2024-01-13T18:24:31.071 INFO:tasks.workunit.client.0.smithi084.stdout:op 1020 completed, throughput=4.98MB/sec 2024-01-13T18:24:31.071 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RcmwW9LrjQW5dCp off=1210177 len=1916265 2024-01-13T18:24:31.083 INFO:tasks.workunit.client.0.smithi084.stdout:op 1021 completed, throughput=4.99MB/sec 2024-01-13T18:24:31.083 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U8qVUJ-Cj8w9ZLZ off=2618765 len=777872 2024-01-13T18:24:31.084 INFO:tasks.workunit.client.0.smithi084.stdout:op 1022 completed, throughput=5MB/sec 2024-01-13T18:24:31.084 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Pu0-LUOtREMlhmp off=16086369 len=605430 2024-01-13T18:24:31.088 INFO:tasks.workunit.client.0.smithi084.stdout:op 1023 completed, throughput=5MB/sec 2024-01-13T18:24:31.088 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hGYpqkfw-qmPqVA off=10165694 len=852870 2024-01-13T18:24:31.090 INFO:tasks.workunit.client.0.smithi084.stdout:op 1024 completed, throughput=5MB/sec 2024-01-13T18:24:31.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:31 smithi099 ceph-mon[138788]: pgmap v1581: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:24:31.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:31 smithi084 ceph-mon[116404]: pgmap v1581: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:24:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:31 smithi084 ceph-mon[119097]: pgmap v1581: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:24:32.091 INFO:tasks.workunit.client.0.smithi084.stdout: 204: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:32.091 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-A34qyXK_vH9V4Ah off=5424470 len=1309499 2024-01-13T18:24:32.099 INFO:tasks.workunit.client.0.smithi084.stdout:op 1025 completed, throughput=4.98MB/sec 2024-01-13T18:24:32.099 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-57s2J84JxHQHeBD off=1840513 len=771998 2024-01-13T18:24:32.103 INFO:tasks.workunit.client.0.smithi084.stdout:op 1026 completed, throughput=4.99MB/sec 2024-01-13T18:24:32.103 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rwITflM7DDMZzQX off=5549007 len=1010548 2024-01-13T18:24:32.109 INFO:tasks.workunit.client.0.smithi084.stdout:op 1027 completed, throughput=4.99MB/sec 2024-01-13T18:24:32.109 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ePE_UKiHOYpah6A off=10068136 len=1305266 2024-01-13T18:24:32.110 INFO:tasks.workunit.client.0.smithi084.stdout:op 1028 completed, throughput=5MB/sec 2024-01-13T18:24:32.110 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-s5xhx0FWwFlsjTI off=6134017 len=694035 2024-01-13T18:24:32.111 INFO:tasks.workunit.client.0.smithi084.stdout:op 1029 completed, throughput=5MB/sec 2024-01-13T18:24:33.115 INFO:tasks.workunit.client.0.smithi084.stdout: 205: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3WFyjP4gInyBVao off=24306 len=960072 2024-01-13T18:24:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:op 1030 completed, throughput=4.98MB/sec 2024-01-13T18:24:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OoUoC3ljipSqWJr off=12721052 len=1291465 2024-01-13T18:24:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:op 1031 completed, throughput=4.99MB/sec 2024-01-13T18:24:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eAtih7NhHqE5kiQ off=841256 len=59304 2024-01-13T18:24:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:op 1032 completed, throughput=4.99MB/sec 2024-01-13T18:24:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-b2i3BU5uNefIZID off=2973464 len=646169 2024-01-13T18:24:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:op 1033 completed, throughput=4.99MB/sec 2024-01-13T18:24:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_gHSPnXX14X6MWW off=4863803 len=496548 2024-01-13T18:24:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:op 1034 completed, throughput=4.99MB/sec 2024-01-13T18:24:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-h7ecwefKuPrlOJ- off=426625 len=2012865 2024-01-13T18:24:33.126 INFO:tasks.workunit.client.0.smithi084.stdout:op 1035 completed, throughput=5MB/sec 2024-01-13T18:24:33.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:33 smithi099 ceph-mon[138788]: pgmap v1582: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:24:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:33 smithi084 ceph-mon[116404]: pgmap v1582: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:24:33.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:33 smithi084 ceph-mon[119097]: pgmap v1582: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:24:34.126 INFO:tasks.workunit.client.0.smithi084.stdout: 206: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:34.126 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xVhMxZp7cXdE6_k off=1555813 len=1215593 2024-01-13T18:24:34.129 INFO:tasks.workunit.client.0.smithi084.stdout:op 1036 completed, throughput=4.98MB/sec 2024-01-13T18:24:34.129 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3GxJuVrjg0JKPzy off=14010599 len=670552 2024-01-13T18:24:34.135 INFO:tasks.workunit.client.0.smithi084.stdout:op 1037 completed, throughput=4.99MB/sec 2024-01-13T18:24:34.136 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Vxehp4WJ2PBwh8s off=354440 len=1469458 2024-01-13T18:24:34.141 INFO:tasks.workunit.client.0.smithi084.stdout:op 1038 completed, throughput=4.99MB/sec 2024-01-13T18:24:34.141 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jGWpqbKjg3iSK2A off=2454923 len=689064 2024-01-13T18:24:34.143 INFO:tasks.workunit.client.0.smithi084.stdout:op 1039 completed, throughput=5MB/sec 2024-01-13T18:24:34.143 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6aesVlnBOMLwKHP off=668113 len=1627050 2024-01-13T18:24:34.152 INFO:tasks.workunit.client.0.smithi084.stdout:op 1040 completed, throughput=5MB/sec 2024-01-13T18:24:35.155 INFO:tasks.workunit.client.0.smithi084.stdout: 207: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:35.155 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n3oBs8ybTlYE_3- off=8847671 len=725287 2024-01-13T18:24:35.156 INFO:tasks.workunit.client.0.smithi084.stdout:op 1041 completed, throughput=4.98MB/sec 2024-01-13T18:24:35.156 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jeiFYYO_KyHFwB1 off=9727879 len=336002 2024-01-13T18:24:35.156 INFO:tasks.workunit.client.0.smithi084.stdout:op 1042 completed, throughput=4.99MB/sec 2024-01-13T18:24:35.156 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8JeMWa9-gzi5OXT off=1703229 len=325239 2024-01-13T18:24:35.156 INFO:tasks.workunit.client.0.smithi084.stdout:op 1043 completed, throughput=4.99MB/sec 2024-01-13T18:24:35.157 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2S6NBhQ5C1LPnPD off=0 len=1199906 2024-01-13T18:24:35.162 INFO:tasks.workunit.client.0.smithi084.stdout:op 1044 completed, throughput=4.99MB/sec 2024-01-13T18:24:35.162 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-caNzPbvx5vTqTgR off=3250024 len=423704 2024-01-13T18:24:35.162 INFO:tasks.workunit.client.0.smithi084.stdout:op 1045 completed, throughput=4.99MB/sec 2024-01-13T18:24:35.162 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CqOdecJZzk6tCla off=9537352 len=970771 2024-01-13T18:24:35.164 INFO:tasks.workunit.client.0.smithi084.stdout:op 1046 completed, throughput=5MB/sec 2024-01-13T18:24:35.164 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XhdJ7pY8mMj85VA off=2543906 len=1265200 2024-01-13T18:24:35.166 INFO:tasks.workunit.client.0.smithi084.stdout:op 1047 completed, throughput=5MB/sec 2024-01-13T18:24:35.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:35 smithi099 ceph-mon[138788]: pgmap v1583: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:24:35.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:35 smithi084 ceph-mon[116404]: pgmap v1583: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:24:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:35 smithi084 ceph-mon[119097]: pgmap v1583: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:24:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:36.166 INFO:tasks.workunit.client.0.smithi084.stdout: 208: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:36.166 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0mDUgFLXh18YZyi off=13224358 len=2062679 2024-01-13T18:24:36.168 INFO:tasks.workunit.client.0.smithi084.stdout:op 1048 completed, throughput=4.99MB/sec 2024-01-13T18:24:36.168 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jPSwS6l_JLcemfV off=6109560 len=1095704 2024-01-13T18:24:36.170 INFO:tasks.workunit.client.0.smithi084.stdout:op 1049 completed, throughput=4.99MB/sec 2024-01-13T18:24:36.170 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y9GeGc1Kc2kd4xl off=12297801 len=1777571 2024-01-13T18:24:36.172 INFO:tasks.workunit.client.0.smithi084.stdout:op 1050 completed, throughput=5MB/sec 2024-01-13T18:24:37.172 INFO:tasks.workunit.client.0.smithi084.stdout: 209: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:37.173 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TA1Dh0nwG1SY-_G off=6198063 len=1140923 2024-01-13T18:24:37.179 INFO:tasks.workunit.client.0.smithi084.stdout:op 1051 completed, throughput=4.98MB/sec 2024-01-13T18:24:37.179 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4pbItIvpylw-0Y4 off=6349201 len=743756 2024-01-13T18:24:37.182 INFO:tasks.workunit.client.0.smithi084.stdout:op 1052 completed, throughput=4.99MB/sec 2024-01-13T18:24:37.183 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Gj4Bi5VPajZDt0T off=2598885 len=1681134 2024-01-13T18:24:37.186 INFO:tasks.workunit.client.0.smithi084.stdout:op 1053 completed, throughput=4.99MB/sec 2024-01-13T18:24:37.186 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UU-XnYCddEcjSNm off=9583086 len=260247 2024-01-13T18:24:37.187 INFO:tasks.workunit.client.0.smithi084.stdout:op 1054 completed, throughput=5MB/sec 2024-01-13T18:24:37.187 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-u1PWwx88x1B0L0C off=115946 len=1906519 2024-01-13T18:24:37.187 INFO:tasks.workunit.client.0.smithi084.stdout:op 1055 completed, throughput=5MB/sec 2024-01-13T18:24:37.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:37 smithi099 ceph-mon[138788]: pgmap v1584: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:24:37.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:37 smithi084 ceph-mon[116404]: pgmap v1584: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:24:37.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:37 smithi084 ceph-mon[119097]: pgmap v1584: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:24:38.188 INFO:tasks.workunit.client.0.smithi084.stdout: 210: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:38.188 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Qg8ICwqWl1Ixgco off=5614217 len=1880151 2024-01-13T18:24:38.191 INFO:tasks.workunit.client.0.smithi084.stdout:op 1056 completed, throughput=4.99MB/sec 2024-01-13T18:24:38.191 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-D_Kue4ER_vS1dge off=13854490 len=886168 2024-01-13T18:24:38.197 INFO:tasks.workunit.client.0.smithi084.stdout:op 1057 completed, throughput=4.99MB/sec 2024-01-13T18:24:38.197 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gcKP5eJ7PdPsh1j off=6014680 len=1168324 2024-01-13T18:24:38.199 INFO:tasks.workunit.client.0.smithi084.stdout:op 1058 completed, throughput=5MB/sec 2024-01-13T18:24:38.199 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1VpyYnNHNvF29Hj off=8387728 len=1104231 2024-01-13T18:24:38.200 INFO:tasks.workunit.client.0.smithi084.stdout:op 1059 completed, throughput=5MB/sec 2024-01-13T18:24:39.200 INFO:tasks.workunit.client.0.smithi084.stdout: 211: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:39.200 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HZLua5VgbmXTGRo off=1067090 len=1487436 2024-01-13T18:24:39.202 INFO:tasks.workunit.client.0.smithi084.stdout:op 1060 completed, throughput=4.99MB/sec 2024-01-13T18:24:39.202 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ow3dg7ZnyICsIMF off=16170520 len=664178 2024-01-13T18:24:39.204 INFO:tasks.workunit.client.0.smithi084.stdout:op 1061 completed, throughput=4.99MB/sec 2024-01-13T18:24:39.204 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SrxBFtIXfaIs7G2 off=11891785 len=1443653 2024-01-13T18:24:39.211 INFO:tasks.workunit.client.0.smithi084.stdout:op 1062 completed, throughput=5MB/sec 2024-01-13T18:24:39.211 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dfaP1tG1WqjPdTt off=3466070 len=495821 2024-01-13T18:24:39.215 INFO:tasks.workunit.client.0.smithi084.stdout:op 1063 completed, throughput=5MB/sec 2024-01-13T18:24:39.215 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y12WtzYTBzgTZ7L off=7905992 len=150111 2024-01-13T18:24:39.215 INFO:tasks.workunit.client.0.smithi084.stdout:op 1064 completed, throughput=5MB/sec 2024-01-13T18:24:39.216 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1JmTrFkgQLapbJ1 off=5549522 len=1911469 2024-01-13T18:24:39.226 INFO:tasks.workunit.client.0.smithi084.stdout:op 1065 completed, throughput=5.01MB/sec 2024-01-13T18:24:39.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:39 smithi084 ceph-mon[116404]: pgmap v1585: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:24:39.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:39 smithi084 ceph-mon[119097]: pgmap v1585: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:24:39.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:39 smithi099 ceph-mon[138788]: pgmap v1585: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:24:40.227 INFO:tasks.workunit.client.0.smithi084.stdout: 212: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:40.227 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8GCgRt-pCaU7Ke1 off=10407906 len=1864583 2024-01-13T18:24:40.229 INFO:tasks.workunit.client.0.smithi084.stdout:op 1066 completed, throughput=4.99MB/sec 2024-01-13T18:24:40.229 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ii2fC4RWOV_zJ0X off=5849287 len=1964475 2024-01-13T18:24:40.239 INFO:tasks.workunit.client.0.smithi084.stdout:op 1067 completed, throughput=5MB/sec 2024-01-13T18:24:40.239 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oZI2tu6ywuLn9do off=512712 len=1255177 2024-01-13T18:24:40.240 INFO:tasks.workunit.client.0.smithi084.stdout:op 1068 completed, throughput=5.01MB/sec 2024-01-13T18:24:40.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:24:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:24:40] "GET /metrics HTTP/1.1" 200 33981 "" "Prometheus/2.43.0" 2024-01-13T18:24:41.240 INFO:tasks.workunit.client.0.smithi084.stdout: 213: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:41.241 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qQHOjVMV8EWmL32 off=1445704 len=1597744 2024-01-13T18:24:41.249 INFO:tasks.workunit.client.0.smithi084.stdout:op 1069 completed, throughput=4.99MB/sec 2024-01-13T18:24:41.249 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Abf5Ua68MZp17zl off=4146031 len=600867 2024-01-13T18:24:41.253 INFO:tasks.workunit.client.0.smithi084.stdout:op 1070 completed, throughput=4.99MB/sec 2024-01-13T18:24:41.253 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Kw7p1uYlDzMd1Al off=1262932 len=1048300 2024-01-13T18:24:41.255 INFO:tasks.workunit.client.0.smithi084.stdout:op 1071 completed, throughput=5MB/sec 2024-01-13T18:24:41.255 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3cct403IXRPMhgD off=3558576 len=1992944 2024-01-13T18:24:41.258 INFO:tasks.workunit.client.0.smithi084.stdout:op 1072 completed, throughput=5MB/sec 2024-01-13T18:24:41.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:41 smithi099 ceph-mon[138788]: pgmap v1586: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:24:41.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:41 smithi084 ceph-mon[116404]: pgmap v1586: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:24:41.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:41 smithi084 ceph-mon[119097]: pgmap v1586: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:24:42.259 INFO:tasks.workunit.client.0.smithi084.stdout: 214: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:42.259 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lpRpM6dGyoETqcX off=11529959 len=938046 2024-01-13T18:24:42.264 INFO:tasks.workunit.client.0.smithi084.stdout:op 1073 completed, throughput=4.99MB/sec 2024-01-13T18:24:42.264 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-O_SlAjzGzHpy6HG off=7858124 len=938075 2024-01-13T18:24:42.265 INFO:tasks.workunit.client.0.smithi084.stdout:op 1074 completed, throughput=4.99MB/sec 2024-01-13T18:24:42.265 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Sm6RPLURRglT-Fv off=22047835 len=1121898 2024-01-13T18:24:42.267 INFO:tasks.workunit.client.0.smithi084.stdout:op 1075 completed, throughput=4.99MB/sec 2024-01-13T18:24:42.267 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-P0ikFg0CPSL7BK9 off=7400350 len=1113738 2024-01-13T18:24:42.272 INFO:tasks.workunit.client.0.smithi084.stdout:op 1076 completed, throughput=5MB/sec 2024-01-13T18:24:42.273 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-U_xQrnChB4dARgN off=13908437 len=1514422 2024-01-13T18:24:42.278 INFO:tasks.workunit.client.0.smithi084.stdout:op 1077 completed, throughput=5.01MB/sec 2024-01-13T18:24:43.278 INFO:tasks.workunit.client.0.smithi084.stdout: 215: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:43.279 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fVzfXr7G6M35hFG off=1645956 len=679855 2024-01-13T18:24:43.280 INFO:tasks.workunit.client.0.smithi084.stdout:op 1078 completed, throughput=4.99MB/sec 2024-01-13T18:24:43.280 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-m3PO1Sl-Gp9ct04 off=9329600 len=1928589 2024-01-13T18:24:43.282 INFO:tasks.workunit.client.0.smithi084.stdout:op 1079 completed, throughput=4.99MB/sec 2024-01-13T18:24:43.282 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Bs48Ui94Mn3bhM- off=2817870 len=1741699 2024-01-13T18:24:43.285 INFO:tasks.workunit.client.0.smithi084.stdout:op 1080 completed, throughput=5MB/sec 2024-01-13T18:24:43.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:43 smithi099 ceph-mon[138788]: pgmap v1587: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:24:43.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:43 smithi084 ceph-mon[116404]: pgmap v1587: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:24:43.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:43 smithi084 ceph-mon[119097]: pgmap v1587: 105 pgs: 105 active+clean; 128 GiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:24:44.286 INFO:tasks.workunit.client.0.smithi084.stdout: 216: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:44.286 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aok44OeQ7jySruI off=1600126 len=233273 2024-01-13T18:24:44.286 INFO:tasks.workunit.client.0.smithi084.stdout:op 1081 completed, throughput=4.98MB/sec 2024-01-13T18:24:44.286 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YtvSAhN8y5DdEgy off=168240 len=923520 2024-01-13T18:24:44.291 INFO:tasks.workunit.client.0.smithi084.stdout:op 1082 completed, throughput=4.98MB/sec 2024-01-13T18:24:44.291 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YTyaFKu6RTq40Us off=3642633 len=1716692 2024-01-13T18:24:44.293 INFO:tasks.workunit.client.0.smithi084.stdout:op 1083 completed, throughput=4.99MB/sec 2024-01-13T18:24:44.293 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fJY1NXUZ6SvrOVD off=4049134 len=192585 2024-01-13T18:24:44.294 INFO:tasks.workunit.client.0.smithi084.stdout:op 1084 completed, throughput=4.99MB/sec 2024-01-13T18:24:44.294 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sqZMzuLO9QHIUqk off=2230170 len=256866 2024-01-13T18:24:44.296 INFO:tasks.workunit.client.0.smithi084.stdout:op 1085 completed, throughput=4.99MB/sec 2024-01-13T18:24:44.296 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ea6hswK3Wp8Fovy off=19588426 len=392426 2024-01-13T18:24:44.298 INFO:tasks.workunit.client.0.smithi084.stdout:op 1086 completed, throughput=4.99MB/sec 2024-01-13T18:24:44.298 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RsK5n_aW_ZTEcJP off=2854820 len=1441671 2024-01-13T18:24:44.306 INFO:tasks.workunit.client.0.smithi084.stdout:op 1087 completed, throughput=5MB/sec 2024-01-13T18:24:45.307 INFO:tasks.workunit.client.0.smithi084.stdout: 217: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:45.307 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pW3OoCy9pKyQr4A off=12533077 len=1459158 2024-01-13T18:24:45.313 INFO:tasks.workunit.client.0.smithi084.stdout:op 1088 completed, throughput=4.98MB/sec 2024-01-13T18:24:45.313 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mZhjKkppoDFvk6o off=0 len=1396249 2024-01-13T18:24:45.314 INFO:tasks.workunit.client.0.smithi084.stdout:op 1089 completed, throughput=4.99MB/sec 2024-01-13T18:24:45.314 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8mOvXxoQpRcrxiQ off=706648 len=1030110 2024-01-13T18:24:45.315 INFO:tasks.workunit.client.0.smithi084.stdout:op 1090 completed, throughput=4.99MB/sec 2024-01-13T18:24:45.316 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Xwlg2kkHG6V7JgM off=2230782 len=2056299 2024-01-13T18:24:45.316 INFO:tasks.workunit.client.0.smithi084.stdout:op 1091 completed, throughput=5MB/sec 2024-01-13T18:24:45.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:45 smithi099 ceph-mon[138788]: pgmap v1588: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:24:45.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:45 smithi084 ceph-mon[119097]: pgmap v1588: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:24:45.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:45 smithi084 ceph-mon[116404]: pgmap v1588: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:24:46.317 INFO:tasks.workunit.client.0.smithi084.stdout: 218: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:46.317 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-a-5nDie8vruCwNY off=10159649 len=1134450 2024-01-13T18:24:46.322 INFO:tasks.workunit.client.0.smithi084.stdout:op 1092 completed, throughput=4.99MB/sec 2024-01-13T18:24:46.323 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KYQbJ8MCRjyGrzJ off=9327390 len=1955356 2024-01-13T18:24:46.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 1093 completed, throughput=4.99MB/sec 2024-01-13T18:24:46.329 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fihJFut7STgov0S off=2396711 len=309552 2024-01-13T18:24:46.330 INFO:tasks.workunit.client.0.smithi084.stdout:op 1094 completed, throughput=5MB/sec 2024-01-13T18:24:46.330 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-au7ikwcfTrqTvri off=7640812 len=637250 2024-01-13T18:24:46.331 INFO:tasks.workunit.client.0.smithi084.stdout:op 1095 completed, throughput=5MB/sec 2024-01-13T18:24:46.331 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bPo1Uit36NNxffs off=174020 len=82131 2024-01-13T18:24:46.331 INFO:tasks.workunit.client.0.smithi084.stdout:op 1096 completed, throughput=5MB/sec 2024-01-13T18:24:46.331 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-II4GLMzx_h5Orj2 off=20478923 len=655345 2024-01-13T18:24:46.332 INFO:tasks.workunit.client.0.smithi084.stdout:op 1097 completed, throughput=5MB/sec 2024-01-13T18:24:47.332 INFO:tasks.workunit.client.0.smithi084.stdout: 219: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:47.333 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pS2azm5Bs2TPNcw off=14101002 len=263878 2024-01-13T18:24:47.333 INFO:tasks.workunit.client.0.smithi084.stdout:op 1098 completed, throughput=4.98MB/sec 2024-01-13T18:24:47.333 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7e3LQG_qoEyTqP9 off=5606293 len=1328204 2024-01-13T18:24:47.336 INFO:tasks.workunit.client.0.smithi084.stdout:op 1099 completed, throughput=4.99MB/sec 2024-01-13T18:24:47.336 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-drmi36kTng_wlD0 off=2700289 len=1975988 2024-01-13T18:24:47.339 INFO:tasks.workunit.client.0.smithi084.stdout:op 1100 completed, throughput=4.99MB/sec 2024-01-13T18:24:47.339 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-72HwD-Vt5BkNKq- off=2329532 len=1066396 2024-01-13T18:24:47.345 INFO:tasks.workunit.client.0.smithi084.stdout:op 1101 completed, throughput=5MB/sec 2024-01-13T18:24:47.345 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IEFsN9YFkqHXAcW off=0 len=1224628 2024-01-13T18:24:47.347 INFO:tasks.workunit.client.0.smithi084.stdout:op 1102 completed, throughput=5MB/sec 2024-01-13T18:24:47.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:47 smithi099 ceph-mon[138788]: pgmap v1589: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:24:47.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:47 smithi084 ceph-mon[119097]: pgmap v1589: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:24:47.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:47 smithi084 ceph-mon[116404]: pgmap v1589: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:24:48.347 INFO:tasks.workunit.client.0.smithi084.stdout: 220: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:48.347 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zOYUG19qwzNGoXi off=11411963 len=617772 2024-01-13T18:24:48.352 INFO:tasks.workunit.client.0.smithi084.stdout:op 1103 completed, throughput=4.98MB/sec 2024-01-13T18:24:48.352 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uwByEsBO9xmVgC- off=10862659 len=704120 2024-01-13T18:24:48.352 INFO:tasks.workunit.client.0.smithi084.stdout:op 1104 completed, throughput=4.99MB/sec 2024-01-13T18:24:48.352 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zB4DJG98-MsuK-U off=18552041 len=1406262 2024-01-13T18:24:48.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 1105 completed, throughput=4.99MB/sec 2024-01-13T18:24:48.361 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OWFn8kQqfXlc8g_ off=2127700 len=1981782 2024-01-13T18:24:48.363 INFO:tasks.workunit.client.0.smithi084.stdout:op 1106 completed, throughput=5MB/sec 2024-01-13T18:24:49.363 INFO:tasks.workunit.client.0.smithi084.stdout: 221: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:49.364 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-u_bITV_UlPRLDNq off=15713667 len=1852460 2024-01-13T18:24:49.373 INFO:tasks.workunit.client.0.smithi084.stdout:op 1107 completed, throughput=4.99MB/sec 2024-01-13T18:24:49.373 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_r0EUmGne_INdmU off=1872489 len=242996 2024-01-13T18:24:49.375 INFO:tasks.workunit.client.0.smithi084.stdout:op 1108 completed, throughput=4.99MB/sec 2024-01-13T18:24:49.375 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NvI-wmdv2-XcUSN off=8866897 len=151066 2024-01-13T18:24:49.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 1109 completed, throughput=4.99MB/sec 2024-01-13T18:24:49.376 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-W1EyJFkwkw6ECad off=5085599 len=1835988 2024-01-13T18:24:49.386 INFO:tasks.workunit.client.0.smithi084.stdout:op 1110 completed, throughput=5MB/sec 2024-01-13T18:24:49.386 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vWTSiyg-lq7a7sl off=13452352 len=1459047 2024-01-13T18:24:49.388 INFO:tasks.workunit.client.0.smithi084.stdout:op 1111 completed, throughput=5MB/sec 2024-01-13T18:24:49.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:49 smithi084 ceph-mon[116404]: pgmap v1590: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:24:49.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:49 smithi084 ceph-mon[119097]: pgmap v1590: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:24:49.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:49 smithi099 ceph-mon[138788]: pgmap v1590: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:24:50.389 INFO:tasks.workunit.client.0.smithi084.stdout: 222: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:50.389 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qMTVcuRbL3z0Ks8 off=9239502 len=434068 2024-01-13T18:24:50.398 INFO:tasks.workunit.client.0.smithi084.stdout:op 1112 completed, throughput=4.98MB/sec 2024-01-13T18:24:50.398 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nAcumZXQvpJReBb off=531769 len=875724 2024-01-13T18:24:50.399 INFO:tasks.workunit.client.0.smithi084.stdout:op 1113 completed, throughput=4.98MB/sec 2024-01-13T18:24:50.399 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bXYiXx9zdJ6nH-9 off=7232296 len=1648221 2024-01-13T18:24:50.407 INFO:tasks.workunit.client.0.smithi084.stdout:op 1114 completed, throughput=4.99MB/sec 2024-01-13T18:24:50.407 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vWTSiyg-lq7a7sl off=13102936 len=282508 2024-01-13T18:24:50.408 INFO:tasks.workunit.client.0.smithi084.stdout:op 1115 completed, throughput=4.99MB/sec 2024-01-13T18:24:50.408 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OZ9Jhx5Pyv9uhHl off=2091585 len=1789081 2024-01-13T18:24:50.411 INFO:tasks.workunit.client.0.smithi084.stdout:op 1116 completed, throughput=5MB/sec 2024-01-13T18:24:50.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:50.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:50.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:24:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:24:50] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:24:50.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:24:51.411 INFO:tasks.workunit.client.0.smithi084.stdout: 223: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:51.412 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OSPnRIXdJXbZTkh off=10797771 len=866791 2024-01-13T18:24:51.416 INFO:tasks.workunit.client.0.smithi084.stdout:op 1117 completed, throughput=4.98MB/sec 2024-01-13T18:24:51.417 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-d2GuTBSpmYR8stz off=16474106 len=1461773 2024-01-13T18:24:51.419 INFO:tasks.workunit.client.0.smithi084.stdout:op 1118 completed, throughput=4.99MB/sec 2024-01-13T18:24:51.419 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TYtnfD9TY0QN1pV off=1013907 len=279784 2024-01-13T18:24:51.420 INFO:tasks.workunit.client.0.smithi084.stdout:op 1119 completed, throughput=4.99MB/sec 2024-01-13T18:24:51.420 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YP7TmMxlN2AkARZ off=11071456 len=431999 2024-01-13T18:24:51.424 INFO:tasks.workunit.client.0.smithi084.stdout:op 1120 completed, throughput=4.99MB/sec 2024-01-13T18:24:51.424 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ARf0Kv1ehSJ42Fm off=5524709 len=1325622 2024-01-13T18:24:51.426 INFO:tasks.workunit.client.0.smithi084.stdout:op 1121 completed, throughput=5MB/sec 2024-01-13T18:24:51.426 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mCK9AIQt7tsjI8t off=2430070 len=1290023 2024-01-13T18:24:51.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:51 smithi084 ceph-mon[116404]: pgmap v1591: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:24:51.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:51 smithi084 ceph-mon[119097]: pgmap v1591: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:24:51.433 INFO:tasks.workunit.client.0.smithi084.stdout:op 1122 completed, throughput=5MB/sec 2024-01-13T18:24:51.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:51 smithi099 ceph-mon[138788]: pgmap v1591: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:24:52.434 INFO:tasks.workunit.client.0.smithi084.stdout: 224: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:52.434 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IEVgdXjZVJ9TSs_ off=3160922 len=1500442 2024-01-13T18:24:52.435 INFO:tasks.workunit.client.0.smithi084.stdout:op 1123 completed, throughput=4.99MB/sec 2024-01-13T18:24:52.435 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZF_SWwQcMXIDHM2 off=640670 len=1626407 2024-01-13T18:24:52.437 INFO:tasks.workunit.client.0.smithi084.stdout:op 1124 completed, throughput=4.99MB/sec 2024-01-13T18:24:52.437 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-whL5Q36r-e2YCNe off=957830 len=301296 2024-01-13T18:24:52.440 INFO:tasks.workunit.client.0.smithi084.stdout:op 1125 completed, throughput=4.99MB/sec 2024-01-13T18:24:52.441 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nRgDCU9Cy-VOW0p off=9836757 len=1696882 2024-01-13T18:24:52.444 INFO:tasks.workunit.client.0.smithi084.stdout:op 1126 completed, throughput=5MB/sec 2024-01-13T18:24:53.444 INFO:tasks.workunit.client.0.smithi084.stdout: 225: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:53.444 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ET6YazGW4tGsB4_ off=6832905 len=98396 2024-01-13T18:24:53.447 INFO:tasks.workunit.client.0.smithi084.stdout:op 1127 completed, throughput=4.98MB/sec 2024-01-13T18:24:53.447 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eVEQwm4UvSIwWrc off=61255 len=819571 2024-01-13T18:24:53.449 INFO:tasks.workunit.client.0.smithi084.stdout:op 1128 completed, throughput=4.98MB/sec 2024-01-13T18:24:53.449 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-v_c0H1YucgJN3fm off=5585676 len=247679 2024-01-13T18:24:53.449 INFO:tasks.workunit.client.0.smithi084.stdout:op 1129 completed, throughput=4.98MB/sec 2024-01-13T18:24:53.449 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GzIKDXBaljUv6Rb off=4766397 len=1177590 2024-01-13T18:24:53.451 INFO:tasks.workunit.client.0.smithi084.stdout:op 1130 completed, throughput=4.99MB/sec 2024-01-13T18:24:53.451 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ChIrnMlBkd4Wchd off=14062688 len=1217194 2024-01-13T18:24:53.456 INFO:tasks.workunit.client.0.smithi084.stdout:op 1131 completed, throughput=4.99MB/sec 2024-01-13T18:24:53.456 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3sJnGXsKsGDtxQB off=891287 len=1690456 2024-01-13T18:24:53.464 INFO:tasks.workunit.client.0.smithi084.stdout:op 1132 completed, throughput=5MB/sec 2024-01-13T18:24:53.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:53 smithi099 ceph-mon[138788]: pgmap v1592: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:24:53.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:53 smithi084 ceph-mon[116404]: pgmap v1592: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:24:53.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:53 smithi084 ceph-mon[119097]: pgmap v1592: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:24:54.464 INFO:tasks.workunit.client.0.smithi084.stdout: 226: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:54.464 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RTDP53PFzG-hZJs off=11727387 len=132986 2024-01-13T18:24:54.465 INFO:tasks.workunit.client.0.smithi084.stdout:op 1133 completed, throughput=4.98MB/sec 2024-01-13T18:24:54.465 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7GZF51RA6trBF26 off=295068 len=619684 2024-01-13T18:24:54.466 INFO:tasks.workunit.client.0.smithi084.stdout:op 1134 completed, throughput=4.98MB/sec 2024-01-13T18:24:54.466 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LXIwlGQ3xcSMQC2 off=408084 len=320590 2024-01-13T18:24:54.466 INFO:tasks.workunit.client.0.smithi084.stdout:op 1135 completed, throughput=4.98MB/sec 2024-01-13T18:24:54.466 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zLgJ4C0CcKVBYxB off=9581187 len=517843 2024-01-13T18:24:54.467 INFO:tasks.workunit.client.0.smithi084.stdout:op 1136 completed, throughput=4.99MB/sec 2024-01-13T18:24:54.467 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zmfIS4AOlMq-Ddk off=745998 len=1938341 2024-01-13T18:24:54.469 INFO:tasks.workunit.client.0.smithi084.stdout:op 1137 completed, throughput=4.99MB/sec 2024-01-13T18:24:54.469 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DDGy35Yhi1YXH2x off=790947 len=984537 2024-01-13T18:24:54.475 INFO:tasks.workunit.client.0.smithi084.stdout:op 1138 completed, throughput=5MB/sec 2024-01-13T18:24:54.475 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-22ME2-ZukpFPvzs off=268165 len=2027933 2024-01-13T18:24:54.486 INFO:tasks.workunit.client.0.smithi084.stdout:op 1139 completed, throughput=5.01MB/sec 2024-01-13T18:24:55.486 INFO:tasks.workunit.client.0.smithi084.stdout: 227: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:55.486 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Br-IFZVZW8QZ9B2 off=1729999 len=1438743 2024-01-13T18:24:55.493 INFO:tasks.workunit.client.0.smithi084.stdout:op 1140 completed, throughput=4.99MB/sec 2024-01-13T18:24:55.493 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_KC56q9FIoKQ2dn off=810268 len=1709505 2024-01-13T18:24:55.496 INFO:tasks.workunit.client.0.smithi084.stdout:op 1141 completed, throughput=5MB/sec 2024-01-13T18:24:55.496 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xhSZ9Im6Xz09MwP off=8191046 len=1051724 2024-01-13T18:24:55.501 INFO:tasks.workunit.client.0.smithi084.stdout:op 1142 completed, throughput=5MB/sec 2024-01-13T18:24:55.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:55 smithi084 ceph-mon[116404]: pgmap v1593: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:24:55.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:55 smithi084 ceph-mon[119097]: pgmap v1593: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:24:55.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:55 smithi099 ceph-mon[138788]: pgmap v1593: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:24:56.501 INFO:tasks.workunit.client.0.smithi084.stdout: 228: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:56.501 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5DDJ7BkRRNa7hm8 off=8163834 len=1537212 2024-01-13T18:24:56.511 INFO:tasks.workunit.client.0.smithi084.stdout:op 1143 completed, throughput=4.99MB/sec 2024-01-13T18:24:56.511 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xRwolY99P1Q5-h4 off=8602768 len=148325 2024-01-13T18:24:56.511 INFO:tasks.workunit.client.0.smithi084.stdout:op 1144 completed, throughput=4.99MB/sec 2024-01-13T18:24:56.511 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-moQmoEZlqouYwWf off=8398928 len=744181 2024-01-13T18:24:56.513 INFO:tasks.workunit.client.0.smithi084.stdout:op 1145 completed, throughput=4.99MB/sec 2024-01-13T18:24:56.513 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8zQD3hP-ZUqhRyK off=8471698 len=1946885 2024-01-13T18:24:56.514 INFO:tasks.workunit.client.0.smithi084.stdout:op 1146 completed, throughput=5MB/sec 2024-01-13T18:24:56.514 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SAu98NsiV44tFGS off=2470276 len=1198665 2024-01-13T18:24:56.519 INFO:tasks.workunit.client.0.smithi084.stdout:op 1147 completed, throughput=5MB/sec 2024-01-13T18:24:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: 229: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:57.519 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-70ACe_InWLKyRY6 off=5432381 len=1263852 2024-01-13T18:24:57.521 INFO:tasks.workunit.client.0.smithi084.stdout:op 1148 completed, throughput=4.99MB/sec 2024-01-13T18:24:57.521 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZmzWsBl9T2lXzgm off=2060150 len=877494 2024-01-13T18:24:57.525 INFO:tasks.workunit.client.0.smithi084.stdout:op 1149 completed, throughput=4.99MB/sec 2024-01-13T18:24:57.525 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1SEJOqutm0eGqwl off=16001620 len=362501 2024-01-13T18:24:57.526 INFO:tasks.workunit.client.0.smithi084.stdout:op 1150 completed, throughput=4.99MB/sec 2024-01-13T18:24:57.526 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lYp72XaIeIrsaHn off=4290314 len=654927 2024-01-13T18:24:57.530 INFO:tasks.workunit.client.0.smithi084.stdout:op 1151 completed, throughput=4.99MB/sec 2024-01-13T18:24:57.530 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sTW8m8ZOJXpeX9C off=5641612 len=892238 2024-01-13T18:24:57.534 INFO:tasks.workunit.client.0.smithi084.stdout:op 1152 completed, throughput=5MB/sec 2024-01-13T18:24:57.534 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-53mNEvLEm1SqOhJ off=84029 len=319086 2024-01-13T18:24:57.534 INFO:tasks.workunit.client.0.smithi084.stdout:op 1153 completed, throughput=5MB/sec 2024-01-13T18:24:57.535 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XRJ1hFwatCykzXh off=1444251 len=136674 2024-01-13T18:24:57.535 INFO:tasks.workunit.client.0.smithi084.stdout:op 1154 completed, throughput=5MB/sec 2024-01-13T18:24:57.535 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Z7_Q_lqPiOztA6I off=654422 len=569446 2024-01-13T18:24:57.536 INFO:tasks.workunit.client.0.smithi084.stdout:op 1155 completed, throughput=5MB/sec 2024-01-13T18:24:57.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:57 smithi084 ceph-mon[116404]: pgmap v1594: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:24:57.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:57 smithi084 ceph-mon[119097]: pgmap v1594: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:24:57.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:57 smithi099 ceph-mon[138788]: pgmap v1594: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:24:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: 230: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:58.536 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Jwoa1hcB19jREwo off=6110873 len=854223 2024-01-13T18:24:58.538 INFO:tasks.workunit.client.0.smithi084.stdout:op 1156 completed, throughput=4.98MB/sec 2024-01-13T18:24:58.538 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zg8oViBZhFcB08V off=8472991 len=959016 2024-01-13T18:24:58.539 INFO:tasks.workunit.client.0.smithi084.stdout:op 1157 completed, throughput=4.99MB/sec 2024-01-13T18:24:58.540 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5I57F_rPt0LiP14 off=628139 len=1641767 2024-01-13T18:24:58.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 1158 completed, throughput=4.99MB/sec 2024-01-13T18:24:58.543 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jwHmUBehaGMMGFn off=2448791 len=756109 2024-01-13T18:24:58.547 INFO:tasks.workunit.client.0.smithi084.stdout:op 1159 completed, throughput=5MB/sec 2024-01-13T18:24:58.547 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-H476Qt1M6cPZ4Tb off=8136976 len=981593 2024-01-13T18:24:58.551 INFO:tasks.workunit.client.0.smithi084.stdout:op 1160 completed, throughput=5MB/sec 2024-01-13T18:24:58.552 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jwHmUBehaGMMGFn off=4862645 len=1076102 2024-01-13T18:24:58.556 INFO:tasks.workunit.client.0.smithi084.stdout:op 1161 completed, throughput=5MB/sec 2024-01-13T18:24:59.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:24:59 smithi084 ceph-mon[116404]: pgmap v1595: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:24:59.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:24:59 smithi084 ceph-mon[119097]: pgmap v1595: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:24:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: 231: throughput=4.98MB/sec pending data=0 2024-01-13T18:24:59.556 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZPKYevdhU9yIzxU off=5366323 len=62694 2024-01-13T18:24:59.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 1162 completed, throughput=4.98MB/sec 2024-01-13T18:24:59.559 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hbdtHenZJ5D2odf off=3397285 len=705043 2024-01-13T18:24:59.560 INFO:tasks.workunit.client.0.smithi084.stdout:op 1163 completed, throughput=4.99MB/sec 2024-01-13T18:24:59.560 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5ER0AvZik0430BG off=6296001 len=1248044 2024-01-13T18:24:59.562 INFO:tasks.workunit.client.0.smithi084.stdout:op 1164 completed, throughput=4.99MB/sec 2024-01-13T18:24:59.562 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GyBqnllSENCg1zi off=12013455 len=617256 2024-01-13T18:24:59.562 INFO:tasks.workunit.client.0.smithi084.stdout:op 1165 completed, throughput=4.99MB/sec 2024-01-13T18:24:59.562 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Gpwe-6ZaUktuqso off=2207548 len=977812 2024-01-13T18:24:59.567 INFO:tasks.workunit.client.0.smithi084.stdout:op 1166 completed, throughput=5MB/sec 2024-01-13T18:24:59.567 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gHfLGcgC1HEC7GE off=4503394 len=1849535 2024-01-13T18:24:59.574 INFO:tasks.workunit.client.0.smithi084.stdout:op 1167 completed, throughput=5MB/sec 2024-01-13T18:24:59.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:24:59 smithi099 ceph-mon[138788]: pgmap v1595: 105 pgs: 105 active+clean; 128 GiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:25:00.574 INFO:tasks.workunit.client.0.smithi084.stdout: 232: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G7lIvSfXMoWvo1_ off=1346770 len=637315 2024-01-13T18:25:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:op 1168 completed, throughput=4.99MB/sec 2024-01-13T18:25:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-heu8Epqh2xOxI5Z off=753005 len=543440 2024-01-13T18:25:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:op 1169 completed, throughput=4.99MB/sec 2024-01-13T18:25:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ycmpIBT1d45lShl off=6581646 len=204851 2024-01-13T18:25:00.582 INFO:tasks.workunit.client.0.smithi084.stdout:op 1170 completed, throughput=4.99MB/sec 2024-01-13T18:25:00.582 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6dpfDopz9w7-bmK off=10752728 len=1320610 2024-01-13T18:25:00.584 INFO:tasks.workunit.client.0.smithi084.stdout:op 1171 completed, throughput=4.99MB/sec 2024-01-13T18:25:00.584 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nvH1zYcPhmcHfBn off=6696530 len=1302251 2024-01-13T18:25:00.592 INFO:tasks.workunit.client.0.smithi084.stdout:op 1172 completed, throughput=5MB/sec 2024-01-13T18:25:00.592 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uFKZwwTla4bHiRJ off=1977204 len=865379 2024-01-13T18:25:00.597 INFO:tasks.workunit.client.0.smithi084.stdout:op 1173 completed, throughput=5MB/sec 2024-01-13T18:25:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:25:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:25:00] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:25:01.597 INFO:tasks.workunit.client.0.smithi084.stdout: 233: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:01.597 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nV4_uNnx8zXvbSM off=4849448 len=248736 2024-01-13T18:25:01.600 INFO:tasks.workunit.client.0.smithi084.stdout:op 1174 completed, throughput=4.98MB/sec 2024-01-13T18:25:01.600 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TfgLh2pT2oDuhJ6 off=9944564 len=1614732 2024-01-13T18:25:01.602 INFO:tasks.workunit.client.0.smithi084.stdout:op 1175 completed, throughput=4.99MB/sec 2024-01-13T18:25:01.602 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3V8ujtTpta_JZHT off=141374 len=2088192 2024-01-13T18:25:01.606 INFO:tasks.workunit.client.0.smithi084.stdout:op 1176 completed, throughput=5MB/sec 2024-01-13T18:25:01.606 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-89jUeXqDsK1H1Bn off=1504288 len=255855 2024-01-13T18:25:01.606 INFO:tasks.workunit.client.0.smithi084.stdout:op 1177 completed, throughput=5MB/sec 2024-01-13T18:25:01.606 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XJjOi07wtLUI1fb off=2991671 len=1942035 2024-01-13T18:25:01.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:01 smithi099 ceph-mon[138788]: pgmap v1596: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:25:01.619 INFO:tasks.workunit.client.0.smithi084.stdout:op 1178 completed, throughput=5.01MB/sec 2024-01-13T18:25:01.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:01 smithi084 ceph-mon[116404]: pgmap v1596: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:25:01.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:01 smithi084 ceph-mon[119097]: pgmap v1596: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:25:02.619 INFO:tasks.workunit.client.0.smithi084.stdout: 234: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:02.619 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-02W58nkbBUQTZvi off=20602148 len=1123888 2024-01-13T18:25:02.624 INFO:tasks.workunit.client.0.smithi084.stdout:op 1179 completed, throughput=4.99MB/sec 2024-01-13T18:25:02.624 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bL3Av07k9aZFjWI off=3523119 len=921853 2024-01-13T18:25:02.629 INFO:tasks.workunit.client.0.smithi084.stdout:op 1180 completed, throughput=4.99MB/sec 2024-01-13T18:25:02.629 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--fbEJmyxbz5bbU6 off=11441729 len=2017653 2024-01-13T18:25:02.631 INFO:tasks.workunit.client.0.smithi084.stdout:op 1181 completed, throughput=5MB/sec 2024-01-13T18:25:03.632 INFO:tasks.workunit.client.0.smithi084.stdout: 235: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:03.632 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sRblObluQttaDPM off=14412175 len=513569 2024-01-13T18:25:03.633 INFO:tasks.workunit.client.0.smithi084.stdout:op 1182 completed, throughput=4.98MB/sec 2024-01-13T18:25:03.633 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hhv8133QoZfeqnd off=7562750 len=1386906 2024-01-13T18:25:03.639 INFO:tasks.workunit.client.0.smithi084.stdout:op 1183 completed, throughput=4.99MB/sec 2024-01-13T18:25:03.639 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jjEcjijOLac6DIJ off=18562782 len=769398 2024-01-13T18:25:03.640 INFO:tasks.workunit.client.0.smithi084.stdout:op 1184 completed, throughput=4.99MB/sec 2024-01-13T18:25:03.640 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8OT55-8koLcZ1ep off=3985846 len=1660390 2024-01-13T18:25:03.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 1185 completed, throughput=5MB/sec 2024-01-13T18:25:03.647 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TVUY2anCfYfb224 off=2096747 len=1477055 2024-01-13T18:25:03.651 INFO:tasks.workunit.client.0.smithi084.stdout:op 1186 completed, throughput=5MB/sec 2024-01-13T18:25:03.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:03 smithi084 ceph-mon[119097]: pgmap v1597: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:25:03.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:03 smithi084 ceph-mon[116404]: pgmap v1597: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:25:03.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:03 smithi099 ceph-mon[138788]: pgmap v1597: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:25:04.652 INFO:tasks.workunit.client.0.smithi084.stdout: 236: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:04.652 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DgQvfKhu4ZLjB4q off=7465798 len=951639 2024-01-13T18:25:04.658 INFO:tasks.workunit.client.0.smithi084.stdout:op 1187 completed, throughput=4.99MB/sec 2024-01-13T18:25:04.658 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kgzmiZYG3WTHBeI off=3802611 len=165393 2024-01-13T18:25:04.658 INFO:tasks.workunit.client.0.smithi084.stdout:op 1188 completed, throughput=4.99MB/sec 2024-01-13T18:25:04.658 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-W3AOyIqNfajXwTJ off=509818 len=1632508 2024-01-13T18:25:04.661 INFO:tasks.workunit.client.0.smithi084.stdout:op 1189 completed, throughput=4.99MB/sec 2024-01-13T18:25:04.661 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XNSrV2fuDV8kdWg off=3391346 len=1952084 2024-01-13T18:25:04.670 INFO:tasks.workunit.client.0.smithi084.stdout:op 1190 completed, throughput=5MB/sec 2024-01-13T18:25:05.671 INFO:tasks.workunit.client.0.smithi084.stdout: 237: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:05.671 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oy22X0nG_aYpfpL off=5572271 len=1295533 2024-01-13T18:25:05.672 INFO:tasks.workunit.client.0.smithi084.stdout:op 1191 completed, throughput=4.98MB/sec 2024-01-13T18:25:05.672 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TyPl6w06yZqHTDJ off=1327789 len=1775630 2024-01-13T18:25:05.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:05 smithi084 ceph-mon[116404]: pgmap v1598: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:25:05.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:05 smithi084 ceph-mon[119097]: pgmap v1598: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:25:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:05.680 INFO:tasks.workunit.client.0.smithi084.stdout:op 1192 completed, throughput=4.99MB/sec 2024-01-13T18:25:05.681 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IM90YLmrN08ALMm off=1942357 len=1575882 2024-01-13T18:25:05.687 INFO:tasks.workunit.client.0.smithi084.stdout:op 1193 completed, throughput=5MB/sec 2024-01-13T18:25:05.687 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-usZM4WVytDL0zzf off=22215507 len=36577 2024-01-13T18:25:05.688 INFO:tasks.workunit.client.0.smithi084.stdout:op 1194 completed, throughput=5MB/sec 2024-01-13T18:25:05.688 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2-MQ2txa42mwZzg off=8272128 len=611665 2024-01-13T18:25:05.693 INFO:tasks.workunit.client.0.smithi084.stdout:op 1195 completed, throughput=5MB/sec 2024-01-13T18:25:05.693 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4e9xHgWSnvdY32v off=1655859 len=1735336 2024-01-13T18:25:05.694 INFO:tasks.workunit.client.0.smithi084.stdout:op 1196 completed, throughput=5.01MB/sec 2024-01-13T18:25:05.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:05 smithi099 ceph-mon[138788]: pgmap v1598: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:25:05.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:06.694 INFO:tasks.workunit.client.0.smithi084.stdout: 238: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:06.695 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Jwoa1hcB19jREwo off=6505778 len=2025152 2024-01-13T18:25:06.705 INFO:tasks.workunit.client.0.smithi084.stdout:op 1197 completed, throughput=4.99MB/sec 2024-01-13T18:25:06.705 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n2xpYXKu4b8Q0uW off=4810408 len=705802 2024-01-13T18:25:06.707 INFO:tasks.workunit.client.0.smithi084.stdout:op 1198 completed, throughput=5MB/sec 2024-01-13T18:25:06.707 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Afulz8C4nGT4Y8q off=8741563 len=1526898 2024-01-13T18:25:06.715 INFO:tasks.workunit.client.0.smithi084.stdout:op 1199 completed, throughput=5MB/sec 2024-01-13T18:25:07.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:07 smithi084 ceph-mon[116404]: pgmap v1599: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:25:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:07 smithi084 ceph-mon[119097]: pgmap v1599: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:25:07.715 INFO:tasks.workunit.client.0.smithi084.stdout: 239: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:07.715 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YIQ4h8vyddjqcgR off=8556936 len=679748 2024-01-13T18:25:07.719 INFO:tasks.workunit.client.0.smithi084.stdout:op 1200 completed, throughput=4.98MB/sec 2024-01-13T18:25:07.720 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4OJkdtpFiHa-pAl off=1479130 len=348164 2024-01-13T18:25:07.723 INFO:tasks.workunit.client.0.smithi084.stdout:op 1201 completed, throughput=4.99MB/sec 2024-01-13T18:25:07.723 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aj8s7B2BcHdj76y off=10008310 len=1981001 2024-01-13T18:25:07.738 INFO:tasks.workunit.client.0.smithi084.stdout:op 1202 completed, throughput=4.99MB/sec 2024-01-13T18:25:07.738 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rhGUSc3Muu2DmdM off=5010381 len=293453 2024-01-13T18:25:07.739 INFO:tasks.workunit.client.0.smithi084.stdout:op 1203 completed, throughput=4.99MB/sec 2024-01-13T18:25:07.739 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Fhlicx-h0vZH7O2 off=8593662 len=1385137 2024-01-13T18:25:07.740 INFO:tasks.workunit.client.0.smithi084.stdout:op 1204 completed, throughput=5MB/sec 2024-01-13T18:25:07.740 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bL3Av07k9aZFjWI off=1747203 len=1777913 2024-01-13T18:25:07.750 INFO:tasks.workunit.client.0.smithi084.stdout:op 1205 completed, throughput=5.01MB/sec 2024-01-13T18:25:07.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:07 smithi099 ceph-mon[138788]: pgmap v1599: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:25:08.751 INFO:tasks.workunit.client.0.smithi084.stdout: 240: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:08.751 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-o2y6sp-pAuB9rgg off=4765631 len=492134 2024-01-13T18:25:08.752 INFO:tasks.workunit.client.0.smithi084.stdout:op 1206 completed, throughput=4.99MB/sec 2024-01-13T18:25:08.752 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L8SomylvM1xvWvi off=18020071 len=1190899 2024-01-13T18:25:08.754 INFO:tasks.workunit.client.0.smithi084.stdout:op 1207 completed, throughput=4.99MB/sec 2024-01-13T18:25:08.754 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-difpAOtZ-lbaqRY off=10606694 len=808907 2024-01-13T18:25:08.756 INFO:tasks.workunit.client.0.smithi084.stdout:op 1208 completed, throughput=5MB/sec 2024-01-13T18:25:08.756 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NjfmA3w05gTVLv0 off=17387421 len=1541514 2024-01-13T18:25:08.764 INFO:tasks.workunit.client.0.smithi084.stdout:op 1209 completed, throughput=5MB/sec 2024-01-13T18:25:09.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:09 smithi084 ceph-mon[116404]: pgmap v1600: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:25:09.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:09 smithi084 ceph-mon[119097]: pgmap v1600: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:25:09.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:09 smithi099 ceph-mon[138788]: pgmap v1600: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:25:09.765 INFO:tasks.workunit.client.0.smithi084.stdout: 241: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:09.765 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NdDvIxGkPZECUeO off=3439824 len=361320 2024-01-13T18:25:09.768 INFO:tasks.workunit.client.0.smithi084.stdout:op 1210 completed, throughput=4.98MB/sec 2024-01-13T18:25:09.768 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ANoRYdwB__WRNSH off=235965 len=1989615 2024-01-13T18:25:09.778 INFO:tasks.workunit.client.0.smithi084.stdout:op 1211 completed, throughput=4.99MB/sec 2024-01-13T18:25:09.778 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Wp-xJE3BrtTr9oQ off=902504 len=516758 2024-01-13T18:25:09.779 INFO:tasks.workunit.client.0.smithi084.stdout:op 1212 completed, throughput=4.99MB/sec 2024-01-13T18:25:09.779 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-StL8OAO0YnNxTAg off=699811 len=908688 2024-01-13T18:25:09.784 INFO:tasks.workunit.client.0.smithi084.stdout:op 1213 completed, throughput=5MB/sec 2024-01-13T18:25:09.784 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sM_03MEUWyMGll1 off=4213936 len=378517 2024-01-13T18:25:09.787 INFO:tasks.workunit.client.0.smithi084.stdout:op 1214 completed, throughput=5MB/sec 2024-01-13T18:25:09.787 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yqlUusLtodE6bBm off=10111972 len=1758362 2024-01-13T18:25:09.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 1215 completed, throughput=5MB/sec 2024-01-13T18:25:10.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:25:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:25:10] "GET /metrics HTTP/1.1" 200 33982 "" "Prometheus/2.43.0" 2024-01-13T18:25:10.795 INFO:tasks.workunit.client.0.smithi084.stdout: 242: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:10.795 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CxnczEBv12YgipP off=2984193 len=816232 2024-01-13T18:25:10.800 INFO:tasks.workunit.client.0.smithi084.stdout:op 1216 completed, throughput=4.99MB/sec 2024-01-13T18:25:10.800 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ktNLHEpw0Ktwfho off=4097697 len=1278926 2024-01-13T18:25:10.807 INFO:tasks.workunit.client.0.smithi084.stdout:op 1217 completed, throughput=4.99MB/sec 2024-01-13T18:25:10.808 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KJl59-8S00fTaz7 off=2160202 len=419141 2024-01-13T18:25:10.808 INFO:tasks.workunit.client.0.smithi084.stdout:op 1218 completed, throughput=4.99MB/sec 2024-01-13T18:25:10.809 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wpwn2_D7IbUW7Ch off=6013569 len=1088437 2024-01-13T18:25:10.811 INFO:tasks.workunit.client.0.smithi084.stdout:op 1219 completed, throughput=5MB/sec 2024-01-13T18:25:10.811 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lJIzWyKqxuDRW1i off=14231270 len=91089 2024-01-13T18:25:10.813 INFO:tasks.workunit.client.0.smithi084.stdout:op 1220 completed, throughput=5MB/sec 2024-01-13T18:25:10.814 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-J4s3wcK4TLZeWO8 off=2777701 len=1882257 2024-01-13T18:25:10.815 INFO:tasks.workunit.client.0.smithi084.stdout:op 1221 completed, throughput=5MB/sec 2024-01-13T18:25:11.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:11 smithi084 ceph-mon[116404]: pgmap v1601: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:25:11.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:11 smithi084 ceph-mon[119097]: pgmap v1601: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:25:11.816 INFO:tasks.workunit.client.0.smithi084.stdout: 243: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:11.826 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j5sFp5TMyWwwAQ8 off=960577 len=1728352 2024-01-13T18:25:11.827 INFO:tasks.workunit.client.0.smithi084.stdout:op 1222 completed, throughput=4.99MB/sec 2024-01-13T18:25:11.827 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mkH6_D_C_2phqo7 off=296046 len=1088720 2024-01-13T18:25:11.827 INFO:tasks.workunit.client.0.smithi084.stdout:op 1223 completed, throughput=4.99MB/sec 2024-01-13T18:25:11.828 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ydhdkghr3Qwvwpm off=10800508 len=1232901 2024-01-13T18:25:11.833 INFO:tasks.workunit.client.0.smithi084.stdout:op 1224 completed, throughput=5MB/sec 2024-01-13T18:25:11.833 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-unD80mrBXFCqTmt off=19768280 len=191162 2024-01-13T18:25:11.835 INFO:tasks.workunit.client.0.smithi084.stdout:op 1225 completed, throughput=5MB/sec 2024-01-13T18:25:11.836 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SLys2WjnLds39ml off=3717967 len=1658644 2024-01-13T18:25:11.836 INFO:tasks.workunit.client.0.smithi084.stdout:op 1226 completed, throughput=5.01MB/sec 2024-01-13T18:25:11.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:11 smithi099 ceph-mon[138788]: pgmap v1601: 105 pgs: 105 active+clean; 128 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:25:12.837 INFO:tasks.workunit.client.0.smithi084.stdout: 244: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:12.837 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oxkrwNfhOsPrPma off=435538 len=1966367 2024-01-13T18:25:12.850 INFO:tasks.workunit.client.0.smithi084.stdout:op 1227 completed, throughput=4.99MB/sec 2024-01-13T18:25:12.850 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WObGJTjWNv2SyBP off=9855054 len=1616766 2024-01-13T18:25:12.852 INFO:tasks.workunit.client.0.smithi084.stdout:op 1228 completed, throughput=5MB/sec 2024-01-13T18:25:12.852 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ien07OmnU8CiiqT off=4846068 len=1595804 2024-01-13T18:25:12.861 INFO:tasks.workunit.client.0.smithi084.stdout:op 1229 completed, throughput=5.01MB/sec 2024-01-13T18:25:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:13 smithi084 ceph-mon[116404]: pgmap v1602: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:25:13.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:13 smithi084 ceph-mon[119097]: pgmap v1602: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:25:13.862 INFO:tasks.workunit.client.0.smithi084.stdout: 245: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:13.862 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pRTEJkHT6NG0Cpc off=606613 len=147553 2024-01-13T18:25:13.864 INFO:tasks.workunit.client.0.smithi084.stdout:op 1230 completed, throughput=4.99MB/sec 2024-01-13T18:25:13.865 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Io8AJxVrESP5uy0 off=2872637 len=1142698 2024-01-13T18:25:13.866 INFO:tasks.workunit.client.0.smithi084.stdout:op 1231 completed, throughput=4.99MB/sec 2024-01-13T18:25:13.866 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Su2GesyyY3fvg-1 off=6485816 len=1276488 2024-01-13T18:25:13.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:13 smithi099 ceph-mon[138788]: pgmap v1602: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:25:13.873 INFO:tasks.workunit.client.0.smithi084.stdout:op 1232 completed, throughput=5MB/sec 2024-01-13T18:25:13.873 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bRFq1Fbudk_LeHs off=3680234 len=2041468 2024-01-13T18:25:13.883 INFO:tasks.workunit.client.0.smithi084.stdout:op 1233 completed, throughput=5MB/sec 2024-01-13T18:25:14.884 INFO:tasks.workunit.client.0.smithi084.stdout: 246: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:14.884 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KwNiNXHPkf0UWTO off=4620973 len=1581391 2024-01-13T18:25:14.885 INFO:tasks.workunit.client.0.smithi084.stdout:op 1234 completed, throughput=4.99MB/sec 2024-01-13T18:25:14.885 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-A8c8VXgABVaVduR off=758517 len=1776276 2024-01-13T18:25:14.887 INFO:tasks.workunit.client.0.smithi084.stdout:op 1235 completed, throughput=5MB/sec 2024-01-13T18:25:14.888 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eQ1bzBL5TNl8YoL off=4131102 len=1407433 2024-01-13T18:25:14.894 INFO:tasks.workunit.client.0.smithi084.stdout:op 1236 completed, throughput=5MB/sec 2024-01-13T18:25:15.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:15 smithi084 ceph-mon[119097]: pgmap v1603: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:25:15.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:15 smithi084 ceph-mon[116404]: pgmap v1603: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:25:15.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:15 smithi099 ceph-mon[138788]: pgmap v1603: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:25:15.894 INFO:tasks.workunit.client.0.smithi084.stdout: 247: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:15.894 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-u1oIvVYQyy9pRiN off=2561788 len=1303103 2024-01-13T18:25:15.896 INFO:tasks.workunit.client.0.smithi084.stdout:op 1237 completed, throughput=4.99MB/sec 2024-01-13T18:25:15.896 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-g8krjMc9kk3Gv_N off=9263443 len=1462621 2024-01-13T18:25:15.903 INFO:tasks.workunit.client.0.smithi084.stdout:op 1238 completed, throughput=4.99MB/sec 2024-01-13T18:25:15.903 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TzCHPN8bFYBEBc6 off=6024353 len=1599243 2024-01-13T18:25:15.906 INFO:tasks.workunit.client.0.smithi084.stdout:op 1239 completed, throughput=5MB/sec 2024-01-13T18:25:15.906 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xDtP_h-BML7Dt8v off=9529654 len=389643 2024-01-13T18:25:15.907 INFO:tasks.workunit.client.0.smithi084.stdout:op 1240 completed, throughput=5MB/sec 2024-01-13T18:25:15.907 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vw4V5cOYatCFiSS off=13078683 len=1658824 2024-01-13T18:25:15.916 INFO:tasks.workunit.client.0.smithi084.stdout:op 1241 completed, throughput=5MB/sec 2024-01-13T18:25:16.916 INFO:tasks.workunit.client.0.smithi084.stdout: 248: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:16.916 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0vzK2Bga1x65M3o off=21325439 len=1718581 2024-01-13T18:25:16.918 INFO:tasks.workunit.client.0.smithi084.stdout:op 1242 completed, throughput=4.99MB/sec 2024-01-13T18:25:16.918 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tj_iZb45P7jjkb4 off=69634 len=533583 2024-01-13T18:25:16.920 INFO:tasks.workunit.client.0.smithi084.stdout:op 1243 completed, throughput=4.99MB/sec 2024-01-13T18:25:16.920 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9roP3cN_l8zAasG off=4266724 len=109899 2024-01-13T18:25:16.922 INFO:tasks.workunit.client.0.smithi084.stdout:op 1244 completed, throughput=4.99MB/sec 2024-01-13T18:25:16.922 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4DmGA3dLV2cC6bA off=21127629 len=505495 2024-01-13T18:25:16.923 INFO:tasks.workunit.client.0.smithi084.stdout:op 1245 completed, throughput=5MB/sec 2024-01-13T18:25:16.923 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NpODPZ9pT_psA8K off=7828352 len=586814 2024-01-13T18:25:16.924 INFO:tasks.workunit.client.0.smithi084.stdout:op 1246 completed, throughput=5MB/sec 2024-01-13T18:25:16.924 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3_LyeynrXVP415p off=22773497 len=1392046 2024-01-13T18:25:16.931 INFO:tasks.workunit.client.0.smithi084.stdout:op 1247 completed, throughput=5MB/sec 2024-01-13T18:25:17.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:17 smithi084 ceph-mon[116404]: pgmap v1604: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:25:17.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:17 smithi084 ceph-mon[119097]: pgmap v1604: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:25:17.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:17 smithi099 ceph-mon[138788]: pgmap v1604: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:25:17.932 INFO:tasks.workunit.client.0.smithi084.stdout: 249: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:17.932 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GfqUNhNc9i7B_ce off=2858165 len=1505629 2024-01-13T18:25:17.935 INFO:tasks.workunit.client.0.smithi084.stdout:op 1248 completed, throughput=4.99MB/sec 2024-01-13T18:25:17.935 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-u-EBJlL6tWcUx4n off=923558 len=843663 2024-01-13T18:25:17.937 INFO:tasks.workunit.client.0.smithi084.stdout:op 1249 completed, throughput=4.99MB/sec 2024-01-13T18:25:17.937 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-enHPW47R1tGgFKM off=7493841 len=992848 2024-01-13T18:25:17.943 INFO:tasks.workunit.client.0.smithi084.stdout:op 1250 completed, throughput=5MB/sec 2024-01-13T18:25:17.943 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4cRLlgIZdtw0xtb off=0 len=1718234 2024-01-13T18:25:17.945 INFO:tasks.workunit.client.0.smithi084.stdout:op 1251 completed, throughput=5MB/sec 2024-01-13T18:25:18.945 INFO:tasks.workunit.client.0.smithi084.stdout: 250: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:18.945 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_Q17jzvGMyoIuWT off=7803404 len=924245 2024-01-13T18:25:18.951 INFO:tasks.workunit.client.0.smithi084.stdout:op 1252 completed, throughput=4.99MB/sec 2024-01-13T18:25:18.951 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n178k6FBvh6kUvc off=2164555 len=834688 2024-01-13T18:25:18.954 INFO:tasks.workunit.client.0.smithi084.stdout:op 1253 completed, throughput=4.99MB/sec 2024-01-13T18:25:18.954 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WEbFWm2Wc_5hJdN off=17327696 len=335146 2024-01-13T18:25:18.955 INFO:tasks.workunit.client.0.smithi084.stdout:op 1254 completed, throughput=4.99MB/sec 2024-01-13T18:25:18.955 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-moHyjwcYIx-60cm off=4692746 len=187974 2024-01-13T18:25:18.958 INFO:tasks.workunit.client.0.smithi084.stdout:op 1255 completed, throughput=4.99MB/sec 2024-01-13T18:25:18.958 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NEbpTffZ4qCT3gr off=4350608 len=1966369 2024-01-13T18:25:18.960 INFO:tasks.workunit.client.0.smithi084.stdout:op 1256 completed, throughput=5MB/sec 2024-01-13T18:25:18.960 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7XnHxwI7Acv7qz4 off=6149774 len=731434 2024-01-13T18:25:18.964 INFO:tasks.workunit.client.0.smithi084.stdout:op 1257 completed, throughput=5MB/sec 2024-01-13T18:25:19.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:19 smithi084 ceph-mon[116404]: pgmap v1605: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:25:19.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:19 smithi084 ceph-mon[119097]: pgmap v1605: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:25:19.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:19 smithi099 ceph-mon[138788]: pgmap v1605: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:25:19.964 INFO:tasks.workunit.client.0.smithi084.stdout: 251: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:19.965 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gEZaTWKJUtWyzcD off=5786886 len=21354 2024-01-13T18:25:19.965 INFO:tasks.workunit.client.0.smithi084.stdout:op 1258 completed, throughput=4.98MB/sec 2024-01-13T18:25:19.965 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NPS9ZTIgrS3B9jY off=19975277 len=1018841 2024-01-13T18:25:19.971 INFO:tasks.workunit.client.0.smithi084.stdout:op 1259 completed, throughput=4.98MB/sec 2024-01-13T18:25:19.971 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ub_SgxGg8bjUyMG off=13707566 len=1505825 2024-01-13T18:25:19.972 INFO:tasks.workunit.client.0.smithi084.stdout:op 1260 completed, throughput=4.99MB/sec 2024-01-13T18:25:19.973 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Od4_d8foIv_y21i off=3245875 len=1109222 2024-01-13T18:25:19.979 INFO:tasks.workunit.client.0.smithi084.stdout:op 1261 completed, throughput=4.99MB/sec 2024-01-13T18:25:19.979 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3IEqOMNsi8R1Drx off=12794956 len=187934 2024-01-13T18:25:19.982 INFO:tasks.workunit.client.0.smithi084.stdout:op 1262 completed, throughput=4.99MB/sec 2024-01-13T18:25:19.982 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CiP0PtjpsVgl8Tj off=2327826 len=1053301 2024-01-13T18:25:19.984 INFO:tasks.workunit.client.0.smithi084.stdout:op 1263 completed, throughput=5MB/sec 2024-01-13T18:25:19.984 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hEhRlw6EMnLj41s off=4035169 len=201785 2024-01-13T18:25:19.987 INFO:tasks.workunit.client.0.smithi084.stdout:op 1264 completed, throughput=5MB/sec 2024-01-13T18:25:19.987 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zWRt5lAhhAi5VnD off=4661424 len=776670 2024-01-13T18:25:19.988 INFO:tasks.workunit.client.0.smithi084.stdout:op 1265 completed, throughput=5MB/sec 2024-01-13T18:25:20.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:20.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:20.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:25:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:25:20] "GET /metrics HTTP/1.1" 200 33983 "" "Prometheus/2.43.0" 2024-01-13T18:25:20.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:20.988 INFO:tasks.workunit.client.0.smithi084.stdout: 252: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:20.988 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GbQlPAKaDGA0Ohk off=16832490 len=2095272 2024-01-13T18:25:21.000 INFO:tasks.workunit.client.0.smithi084.stdout:op 1266 completed, throughput=4.99MB/sec 2024-01-13T18:25:21.001 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lO-QsFxZHz7XY9V off=14935051 len=1716466 2024-01-13T18:25:21.002 INFO:tasks.workunit.client.0.smithi084.stdout:op 1267 completed, throughput=5MB/sec 2024-01-13T18:25:21.002 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--Hemh2HOcyWRROF off=1085203 len=982266 2024-01-13T18:25:21.003 INFO:tasks.workunit.client.0.smithi084.stdout:op 1268 completed, throughput=5MB/sec 2024-01-13T18:25:21.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:21 smithi099 ceph-mon[138788]: pgmap v1606: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:25:21.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:21 smithi084 ceph-mon[116404]: pgmap v1606: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:25:21.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:21 smithi084 ceph-mon[119097]: pgmap v1606: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:25:22.004 INFO:tasks.workunit.client.0.smithi084.stdout: 253: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:22.004 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qM_YDiVLxhZYy7Q off=3964691 len=1192306 2024-01-13T18:25:22.009 INFO:tasks.workunit.client.0.smithi084.stdout:op 1269 completed, throughput=4.99MB/sec 2024-01-13T18:25:22.009 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--ChdYijr-bh2xWT off=5941549 len=1048833 2024-01-13T18:25:22.010 INFO:tasks.workunit.client.0.smithi084.stdout:op 1270 completed, throughput=4.99MB/sec 2024-01-13T18:25:22.010 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UzucBcNs23wa_9l off=20013219 len=605693 2024-01-13T18:25:22.015 INFO:tasks.workunit.client.0.smithi084.stdout:op 1271 completed, throughput=4.99MB/sec 2024-01-13T18:25:22.015 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BrtEVeJH7TZSw6V off=5620567 len=357600 2024-01-13T18:25:22.015 INFO:tasks.workunit.client.0.smithi084.stdout:op 1272 completed, throughput=4.99MB/sec 2024-01-13T18:25:22.015 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZDSfoDHp4-t1zif off=4754999 len=1151765 2024-01-13T18:25:22.017 INFO:tasks.workunit.client.0.smithi084.stdout:op 1273 completed, throughput=5MB/sec 2024-01-13T18:25:22.017 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Iq8TqShpv-4TfQ- off=1032796 len=1921655 2024-01-13T18:25:22.023 INFO:tasks.workunit.client.0.smithi084.stdout:op 1274 completed, throughput=5MB/sec 2024-01-13T18:25:22.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:22 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:25:22.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:22 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:25:22.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:22 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:25:23.020 INFO:tasks.workunit.client.0.smithi084.stdout: 254: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:23.021 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2iubaf0ex_mc_iB off=2343658 len=899677 2024-01-13T18:25:23.025 INFO:tasks.workunit.client.0.smithi084.stdout:op 1275 completed, throughput=4.99MB/sec 2024-01-13T18:25:23.025 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yOk_myz7E1Krz_C off=14515864 len=1083960 2024-01-13T18:25:23.026 INFO:tasks.workunit.client.0.smithi084.stdout:op 1276 completed, throughput=4.99MB/sec 2024-01-13T18:25:23.026 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Q1__mVh6-M_IfC_ off=20939113 len=965548 2024-01-13T18:25:23.029 INFO:tasks.workunit.client.0.smithi084.stdout:op 1277 completed, throughput=5MB/sec 2024-01-13T18:25:23.030 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j3EHTlWNtIGamxX off=235707 len=1161350 2024-01-13T18:25:23.035 INFO:tasks.workunit.client.0.smithi084.stdout:op 1278 completed, throughput=5MB/sec 2024-01-13T18:25:23.035 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7uyJ7UwHRn5RnM3 off=17717363 len=428756 2024-01-13T18:25:23.037 INFO:tasks.workunit.client.0.smithi084.stdout:op 1279 completed, throughput=5MB/sec 2024-01-13T18:25:23.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:23 smithi099 ceph-mon[138788]: pgmap v1607: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:25:23.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:25:23.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:25:23.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:25:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:23 smithi084 ceph-mon[119097]: pgmap v1607: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:25:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:25:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:25:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:25:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:23 smithi084 ceph-mon[116404]: pgmap v1607: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:25:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:25:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:25:23.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:25:24.038 INFO:tasks.workunit.client.0.smithi084.stdout: 255: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:24.038 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iPWTSzJ7cxLtcVJ off=1189608 len=2082817 2024-01-13T18:25:24.041 INFO:tasks.workunit.client.0.smithi084.stdout:op 1280 completed, throughput=4.99MB/sec 2024-01-13T18:25:24.042 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6PnaFuq4E-9_l4q off=15287624 len=252692 2024-01-13T18:25:24.042 INFO:tasks.workunit.client.0.smithi084.stdout:op 1281 completed, throughput=4.99MB/sec 2024-01-13T18:25:24.043 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-G3d1E4-ryYV5gPy off=12849368 len=1400357 2024-01-13T18:25:24.044 INFO:tasks.workunit.client.0.smithi084.stdout:op 1282 completed, throughput=5MB/sec 2024-01-13T18:25:24.044 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7uyJ7UwHRn5RnM3 off=10693815 len=943421 2024-01-13T18:25:24.046 INFO:tasks.workunit.client.0.smithi084.stdout:op 1283 completed, throughput=5MB/sec 2024-01-13T18:25:24.046 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tyB431I0fXmw3Dx off=11880755 len=2045621 2024-01-13T18:25:24.058 INFO:tasks.workunit.client.0.smithi084.stdout:op 1284 completed, throughput=5.01MB/sec 2024-01-13T18:25:25.058 INFO:tasks.workunit.client.0.smithi084.stdout: 256: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:25.058 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HmV4Gu8FRtQcCKb off=900642 len=1715242 2024-01-13T18:25:25.066 INFO:tasks.workunit.client.0.smithi084.stdout:op 1285 completed, throughput=4.99MB/sec 2024-01-13T18:25:25.067 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EGxeNtUc8ceXgHc off=1566339 len=520304 2024-01-13T18:25:25.070 INFO:tasks.workunit.client.0.smithi084.stdout:op 1286 completed, throughput=4.99MB/sec 2024-01-13T18:25:25.070 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-54a4KrAD9lDzOq8 off=7536824 len=1428359 2024-01-13T18:25:25.073 INFO:tasks.workunit.client.0.smithi084.stdout:op 1287 completed, throughput=5MB/sec 2024-01-13T18:25:25.073 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vbczYWYMn2J11LX off=2600148 len=174335 2024-01-13T18:25:25.073 INFO:tasks.workunit.client.0.smithi084.stdout:op 1288 completed, throughput=5MB/sec 2024-01-13T18:25:25.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:25 smithi084 ceph-mon[116404]: pgmap v1608: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:25:25.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:25 smithi084 ceph-mon[119097]: pgmap v1608: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:25:25.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:25 smithi099 ceph-mon[138788]: pgmap v1608: 105 pgs: 105 active+clean; 128 GiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:25:26.074 INFO:tasks.workunit.client.0.smithi084.stdout: 257: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:26.074 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0iMJ0sVpQGCLKr7 off=1055040 len=153253 2024-01-13T18:25:26.074 INFO:tasks.workunit.client.0.smithi084.stdout:op 1289 completed, throughput=4.98MB/sec 2024-01-13T18:25:26.074 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-a8_bY_2DNcntHn7 off=21617178 len=1551752 2024-01-13T18:25:26.081 INFO:tasks.workunit.client.0.smithi084.stdout:op 1290 completed, throughput=4.99MB/sec 2024-01-13T18:25:26.081 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0ol0o84QaJ_MPpC off=7067509 len=880001 2024-01-13T18:25:26.082 INFO:tasks.workunit.client.0.smithi084.stdout:op 1291 completed, throughput=4.99MB/sec 2024-01-13T18:25:26.082 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TDoSHtsfKGleE7R off=15814907 len=1532394 2024-01-13T18:25:26.085 INFO:tasks.workunit.client.0.smithi084.stdout:op 1292 completed, throughput=5MB/sec 2024-01-13T18:25:26.086 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dfaP1tG1WqjPdTt off=7091787 len=988623 2024-01-13T18:25:26.092 INFO:tasks.workunit.client.0.smithi084.stdout:op 1293 completed, throughput=5MB/sec 2024-01-13T18:25:26.092 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Kukd81QUGt9QHtw off=525981 len=855390 2024-01-13T18:25:26.096 INFO:tasks.workunit.client.0.smithi084.stdout:op 1294 completed, throughput=5MB/sec 2024-01-13T18:25:27.097 INFO:tasks.workunit.client.0.smithi084.stdout: 258: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:27.097 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V9SRLgpmUIfQvw1 off=0 len=1483174 2024-01-13T18:25:27.099 INFO:tasks.workunit.client.0.smithi084.stdout:op 1295 completed, throughput=4.99MB/sec 2024-01-13T18:25:27.099 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-l_rv2SCnlhclFLA off=12473433 len=1307825 2024-01-13T18:25:27.101 INFO:tasks.workunit.client.0.smithi084.stdout:op 1296 completed, throughput=4.99MB/sec 2024-01-13T18:25:27.101 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-64GUZDJCNCbJPlu off=11065130 len=413121 2024-01-13T18:25:27.104 INFO:tasks.workunit.client.0.smithi084.stdout:op 1297 completed, throughput=5MB/sec 2024-01-13T18:25:27.104 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MdLV8lF_bEtfUMM off=5601728 len=1289535 2024-01-13T18:25:27.106 INFO:tasks.workunit.client.0.smithi084.stdout:op 1298 completed, throughput=5MB/sec 2024-01-13T18:25:27.106 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gqsfkuBHYQY17La off=12241807 len=1935150 2024-01-13T18:25:27.117 INFO:tasks.workunit.client.0.smithi084.stdout:op 1299 completed, throughput=5.01MB/sec 2024-01-13T18:25:27.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:27 smithi084 ceph-mon[119097]: pgmap v1609: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:25:27.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:27 smithi084 ceph-mon[116404]: pgmap v1609: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:25:27.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:27 smithi099 ceph-mon[138788]: pgmap v1609: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:25:28.117 INFO:tasks.workunit.client.0.smithi084.stdout: 259: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-E1lHzRUbYdYGFtu off=11706920 len=1399231 2024-01-13T18:25:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:op 1300 completed, throughput=4.99MB/sec 2024-01-13T18:25:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fMUJhPQw1EX5KI- off=4239713 len=1365253 2024-01-13T18:25:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:op 1301 completed, throughput=5MB/sec 2024-01-13T18:25:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hkYhBitgIYEdydP off=2582175 len=1936322 2024-01-13T18:25:28.129 INFO:tasks.workunit.client.0.smithi084.stdout:op 1302 completed, throughput=5MB/sec 2024-01-13T18:25:29.129 INFO:tasks.workunit.client.0.smithi084.stdout: 260: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:29.129 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BAvrMDqCTfAYBWA off=10208330 len=1656405 2024-01-13T18:25:29.138 INFO:tasks.workunit.client.0.smithi084.stdout:op 1303 completed, throughput=4.99MB/sec 2024-01-13T18:25:29.138 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cyf8sey0I0cN4Sn off=2017242 len=613450 2024-01-13T18:25:29.142 INFO:tasks.workunit.client.0.smithi084.stdout:op 1304 completed, throughput=4.99MB/sec 2024-01-13T18:25:29.142 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uCFnz-TOcC9aVJl off=2063098 len=1366745 2024-01-13T18:25:29.143 INFO:tasks.workunit.client.0.smithi084.stdout:op 1305 completed, throughput=5MB/sec 2024-01-13T18:25:29.143 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Wru1auKZ3pOinfl off=6521315 len=1485713 2024-01-13T18:25:29.150 INFO:tasks.workunit.client.0.smithi084.stdout:op 1306 completed, throughput=5MB/sec 2024-01-13T18:25:29.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:29 smithi084 ceph-mon[116404]: pgmap v1610: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:25:29.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:29 smithi084 ceph-mon[119097]: pgmap v1610: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:25:29.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:29 smithi099 ceph-mon[138788]: pgmap v1610: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:25:30.151 INFO:tasks.workunit.client.0.smithi084.stdout: 261: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:30.151 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4bRZbibWNxd48ac off=8741542 len=852613 2024-01-13T18:25:30.152 INFO:tasks.workunit.client.0.smithi084.stdout:op 1307 completed, throughput=4.99MB/sec 2024-01-13T18:25:30.152 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0paRGQ8k0N2-xMH off=4074525 len=1118364 2024-01-13T18:25:30.154 INFO:tasks.workunit.client.0.smithi084.stdout:op 1308 completed, throughput=4.99MB/sec 2024-01-13T18:25:30.154 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YRYRd-9UhM0ic6C off=3770907 len=1780558 2024-01-13T18:25:30.156 INFO:tasks.workunit.client.0.smithi084.stdout:op 1309 completed, throughput=5MB/sec 2024-01-13T18:25:30.156 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2NxN4agIffmQGxS off=4670537 len=948147 2024-01-13T18:25:30.161 INFO:tasks.workunit.client.0.smithi084.stdout:op 1310 completed, throughput=5MB/sec 2024-01-13T18:25:30.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:25:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:25:30] "GET /metrics HTTP/1.1" 200 33983 "" "Prometheus/2.43.0" 2024-01-13T18:25:31.161 INFO:tasks.workunit.client.0.smithi084.stdout: 262: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:31.161 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x9HemdQjnjqXAIE off=5783878 len=1032401 2024-01-13T18:25:31.167 INFO:tasks.workunit.client.0.smithi084.stdout:op 1311 completed, throughput=4.99MB/sec 2024-01-13T18:25:31.167 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0_8trknAMG-Qs6B off=10252335 len=762278 2024-01-13T18:25:31.168 INFO:tasks.workunit.client.0.smithi084.stdout:op 1312 completed, throughput=4.99MB/sec 2024-01-13T18:25:31.168 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qltdoKgHwHEA2ZJ off=2168058 len=69253 2024-01-13T18:25:31.168 INFO:tasks.workunit.client.0.smithi084.stdout:op 1313 completed, throughput=4.99MB/sec 2024-01-13T18:25:31.168 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5cAPshlsnPnNbO6 off=1579627 len=444518 2024-01-13T18:25:31.169 INFO:tasks.workunit.client.0.smithi084.stdout:op 1314 completed, throughput=4.99MB/sec 2024-01-13T18:25:31.169 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-drSmVFkzy_TIt0D off=2284228 len=1772722 2024-01-13T18:25:31.171 INFO:tasks.workunit.client.0.smithi084.stdout:op 1315 completed, throughput=5MB/sec 2024-01-13T18:25:31.171 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VArR6X04KzWBs6V off=3967130 len=880689 2024-01-13T18:25:31.173 INFO:tasks.workunit.client.0.smithi084.stdout:op 1316 completed, throughput=5MB/sec 2024-01-13T18:25:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:31 smithi084 ceph-mon[119097]: pgmap v1611: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:25:31.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:31 smithi084 ceph-mon[116404]: pgmap v1611: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:25:31.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:31 smithi099 ceph-mon[138788]: pgmap v1611: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:25:32.173 INFO:tasks.workunit.client.0.smithi084.stdout: 263: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:32.173 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-03GbRmwf0mXItvi off=19081986 len=865239 2024-01-13T18:25:32.174 INFO:tasks.workunit.client.0.smithi084.stdout:op 1317 completed, throughput=4.98MB/sec 2024-01-13T18:25:32.175 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GNnb1EPiR1fyMp2 off=5481201 len=15435 2024-01-13T18:25:32.175 INFO:tasks.workunit.client.0.smithi084.stdout:op 1318 completed, throughput=4.98MB/sec 2024-01-13T18:25:32.175 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L2hSd_RBi0ccVOO off=1108791 len=944137 2024-01-13T18:25:32.176 INFO:tasks.workunit.client.0.smithi084.stdout:op 1319 completed, throughput=4.99MB/sec 2024-01-13T18:25:32.176 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_1srKSQ6ASFmdUt off=19206007 len=355372 2024-01-13T18:25:32.179 INFO:tasks.workunit.client.0.smithi084.stdout:op 1320 completed, throughput=4.99MB/sec 2024-01-13T18:25:32.180 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VXJ5e51HVOaVFNq off=8500204 len=1648421 2024-01-13T18:25:32.181 INFO:tasks.workunit.client.0.smithi084.stdout:op 1321 completed, throughput=4.99MB/sec 2024-01-13T18:25:32.182 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-456BCKjtgX5HA4y off=764870 len=777904 2024-01-13T18:25:32.183 INFO:tasks.workunit.client.0.smithi084.stdout:op 1322 completed, throughput=5MB/sec 2024-01-13T18:25:32.183 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LelPwuBboAMOeFX off=510476 len=1934095 2024-01-13T18:25:32.185 INFO:tasks.workunit.client.0.smithi084.stdout:op 1323 completed, throughput=5MB/sec 2024-01-13T18:25:33.185 INFO:tasks.workunit.client.0.smithi084.stdout: 264: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:33.185 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sZ4XOgC6yVPwVXx off=7002780 len=1982569 2024-01-13T18:25:33.187 INFO:tasks.workunit.client.0.smithi084.stdout:op 1324 completed, throughput=4.99MB/sec 2024-01-13T18:25:33.187 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NP5XTQZt68T-fp_ off=6030195 len=2038189 2024-01-13T18:25:33.198 INFO:tasks.workunit.client.0.smithi084.stdout:op 1325 completed, throughput=5MB/sec 2024-01-13T18:25:33.198 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xzm7rxh8CUbxKjE off=2836559 len=903723 2024-01-13T18:25:33.203 INFO:tasks.workunit.client.0.smithi084.stdout:op 1326 completed, throughput=5MB/sec 2024-01-13T18:25:33.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:33 smithi084 ceph-mon[116404]: pgmap v1612: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:25:33.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:33 smithi084 ceph-mon[119097]: pgmap v1612: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:25:33.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:33 smithi099 ceph-mon[138788]: pgmap v1612: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:25:34.204 INFO:tasks.workunit.client.0.smithi084.stdout: 265: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ddTX61dUvSqj-te off=8574366 len=1146535 2024-01-13T18:25:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:op 1327 completed, throughput=4.99MB/sec 2024-01-13T18:25:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8iY0ZjjiEPn2Fop off=8380963 len=1513660 2024-01-13T18:25:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:op 1328 completed, throughput=4.99MB/sec 2024-01-13T18:25:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YrpA7pIBz3h2SAx off=2965234 len=1081010 2024-01-13T18:25:34.220 INFO:tasks.workunit.client.0.smithi084.stdout:op 1329 completed, throughput=5MB/sec 2024-01-13T18:25:34.220 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iY3gJcWOICymy8l off=13886688 len=865712 2024-01-13T18:25:34.222 INFO:tasks.workunit.client.0.smithi084.stdout:op 1330 completed, throughput=5MB/sec 2024-01-13T18:25:35.222 INFO:tasks.workunit.client.0.smithi084.stdout: 266: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:35.222 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XJ98429g0y70V-5 off=1216503 len=1724133 2024-01-13T18:25:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:op 1331 completed, throughput=4.99MB/sec 2024-01-13T18:25:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Br-IFZVZW8QZ9B2 off=6638642 len=1067837 2024-01-13T18:25:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:op 1332 completed, throughput=4.99MB/sec 2024-01-13T18:25:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QVmQmnlWHNkIU2U off=1823915 len=1277901 2024-01-13T18:25:35.232 INFO:tasks.workunit.client.0.smithi084.stdout:op 1333 completed, throughput=5MB/sec 2024-01-13T18:25:35.232 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PhMkh5krb-cihEC off=10524945 len=1050641 2024-01-13T18:25:35.233 INFO:tasks.workunit.client.0.smithi084.stdout:op 1334 completed, throughput=5MB/sec 2024-01-13T18:25:35.234 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FvpAGLWCAYiu0Uy off=3478309 len=1076420 2024-01-13T18:25:35.238 INFO:tasks.workunit.client.0.smithi084.stdout:op 1335 completed, throughput=5MB/sec 2024-01-13T18:25:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:35 smithi084 ceph-mon[119097]: pgmap v1613: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:25:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:35 smithi084 ceph-mon[116404]: pgmap v1613: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:25:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:35.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:35 smithi099 ceph-mon[138788]: pgmap v1613: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:25:35.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:36.238 INFO:tasks.workunit.client.0.smithi084.stdout: 267: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:36.238 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bwq6Mzy3B2YJmJj off=1562127 len=434524 2024-01-13T18:25:36.240 INFO:tasks.workunit.client.0.smithi084.stdout:op 1336 completed, throughput=4.99MB/sec 2024-01-13T18:25:36.240 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0oRBCvqUkc9HSBW off=2342346 len=927396 2024-01-13T18:25:36.244 INFO:tasks.workunit.client.0.smithi084.stdout:op 1337 completed, throughput=4.99MB/sec 2024-01-13T18:25:36.244 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NlIpOt1tww50Gg5 off=3071256 len=1113706 2024-01-13T18:25:36.249 INFO:tasks.workunit.client.0.smithi084.stdout:op 1338 completed, throughput=4.99MB/sec 2024-01-13T18:25:36.249 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-V9SRLgpmUIfQvw1 off=845798 len=637376 2024-01-13T18:25:36.252 INFO:tasks.workunit.client.0.smithi084.stdout:op 1339 completed, throughput=5MB/sec 2024-01-13T18:25:36.253 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mIdvLQDVvTmuKWk off=1903317 len=201872 2024-01-13T18:25:36.253 INFO:tasks.workunit.client.0.smithi084.stdout:op 1340 completed, throughput=5MB/sec 2024-01-13T18:25:36.253 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EakLvkWMI1Gzai5 off=9448850 len=377066 2024-01-13T18:25:36.254 INFO:tasks.workunit.client.0.smithi084.stdout:op 1341 completed, throughput=5MB/sec 2024-01-13T18:25:36.254 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r579FjaHFnYkBo1 off=11971754 len=1022670 2024-01-13T18:25:36.260 INFO:tasks.workunit.client.0.smithi084.stdout:op 1342 completed, throughput=5MB/sec 2024-01-13T18:25:37.260 INFO:tasks.workunit.client.0.smithi084.stdout: 268: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:37.260 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h9KDx9TjLwCmEGX off=0 len=1201702 2024-01-13T18:25:37.266 INFO:tasks.workunit.client.0.smithi084.stdout:op 1343 completed, throughput=4.99MB/sec 2024-01-13T18:25:37.266 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Nv3Rg9AKa4lTani off=15799710 len=1460051 2024-01-13T18:25:37.269 INFO:tasks.workunit.client.0.smithi084.stdout:op 1344 completed, throughput=4.99MB/sec 2024-01-13T18:25:37.269 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-StL8OAO0YnNxTAg off=1134475 len=164027 2024-01-13T18:25:37.272 INFO:tasks.workunit.client.0.smithi084.stdout:op 1345 completed, throughput=4.99MB/sec 2024-01-13T18:25:37.272 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sQoppv7tBTYKivg off=829737 len=1113440 2024-01-13T18:25:37.273 INFO:tasks.workunit.client.0.smithi084.stdout:op 1346 completed, throughput=5MB/sec 2024-01-13T18:25:37.273 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lTOZckMuXROLxqt off=16471306 len=336634 2024-01-13T18:25:37.274 INFO:tasks.workunit.client.0.smithi084.stdout:op 1347 completed, throughput=5MB/sec 2024-01-13T18:25:37.274 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-u1oIvVYQyy9pRiN off=14029332 len=1030660 2024-01-13T18:25:37.275 INFO:tasks.workunit.client.0.smithi084.stdout:op 1348 completed, throughput=5MB/sec 2024-01-13T18:25:37.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:37 smithi084 ceph-mon[116404]: pgmap v1614: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:25:37.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:37 smithi084 ceph-mon[119097]: pgmap v1614: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:25:37.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:37 smithi099 ceph-mon[138788]: pgmap v1614: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:25:38.276 INFO:tasks.workunit.client.0.smithi084.stdout: 269: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:38.276 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NJp71O73mXWJufW off=1291868 len=1179195 2024-01-13T18:25:38.278 INFO:tasks.workunit.client.0.smithi084.stdout:op 1349 completed, throughput=4.99MB/sec 2024-01-13T18:25:38.278 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-axu8Es0_UkROjTd off=24033 len=1806069 2024-01-13T18:25:38.288 INFO:tasks.workunit.client.0.smithi084.stdout:op 1350 completed, throughput=4.99MB/sec 2024-01-13T18:25:38.288 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7vz83qDLHhXk7D6 off=8886657 len=1944448 2024-01-13T18:25:38.299 INFO:tasks.workunit.client.0.smithi084.stdout:op 1351 completed, throughput=5MB/sec 2024-01-13T18:25:38.299 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cE4Je_b_SOlruiO off=6126897 len=320055 2024-01-13T18:25:38.301 INFO:tasks.workunit.client.0.smithi084.stdout:op 1352 completed, throughput=5MB/sec 2024-01-13T18:25:39.302 INFO:tasks.workunit.client.0.smithi084.stdout: 270: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:39.302 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-05QS7WJMGEw6CIA off=961240 len=849782 2024-01-13T18:25:39.303 INFO:tasks.workunit.client.0.smithi084.stdout:op 1353 completed, throughput=4.99MB/sec 2024-01-13T18:25:39.303 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6R0ny5Fjl1z65Iz off=8425179 len=25832 2024-01-13T18:25:39.303 INFO:tasks.workunit.client.0.smithi084.stdout:op 1354 completed, throughput=4.99MB/sec 2024-01-13T18:25:39.304 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cB1qDamxjlSwPWH off=14319978 len=765256 2024-01-13T18:25:39.309 INFO:tasks.workunit.client.0.smithi084.stdout:op 1355 completed, throughput=4.99MB/sec 2024-01-13T18:25:39.309 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5JeRLTpJIcAfdps off=4332216 len=398787 2024-01-13T18:25:39.312 INFO:tasks.workunit.client.0.smithi084.stdout:op 1356 completed, throughput=4.99MB/sec 2024-01-13T18:25:39.313 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_y9fhF4L2DNztA2 off=910139 len=503235 2024-01-13T18:25:39.315 INFO:tasks.workunit.client.0.smithi084.stdout:op 1357 completed, throughput=4.99MB/sec 2024-01-13T18:25:39.315 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SuEh_VgRfTNo56Z off=11514702 len=2023431 2024-01-13T18:25:39.323 INFO:tasks.workunit.client.0.smithi084.stdout:op 1358 completed, throughput=5MB/sec 2024-01-13T18:25:39.323 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xf23R4fTpSG2s14 off=15155537 len=1350502 2024-01-13T18:25:39.324 INFO:tasks.workunit.client.0.smithi084.stdout:op 1359 completed, throughput=5MB/sec 2024-01-13T18:25:39.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:39 smithi084 ceph-mon[119097]: pgmap v1615: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:25:39.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:39 smithi084 ceph-mon[116404]: pgmap v1615: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:25:39.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:39 smithi099 ceph-mon[138788]: pgmap v1615: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:25:40.325 INFO:tasks.workunit.client.0.smithi084.stdout: 271: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:40.325 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9x2qruMdDj1drWY off=3267742 len=1436764 2024-01-13T18:25:40.332 INFO:tasks.workunit.client.0.smithi084.stdout:op 1360 completed, throughput=4.99MB/sec 2024-01-13T18:25:40.332 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k7pWSFZH9dHF-tB off=13220798 len=364951 2024-01-13T18:25:40.333 INFO:tasks.workunit.client.0.smithi084.stdout:op 1361 completed, throughput=4.99MB/sec 2024-01-13T18:25:40.333 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LH58iE669uIc5UW off=2647717 len=672671 2024-01-13T18:25:40.337 INFO:tasks.workunit.client.0.smithi084.stdout:op 1362 completed, throughput=4.99MB/sec 2024-01-13T18:25:40.337 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Wy61PYk62fct_ap off=7447131 len=1492728 2024-01-13T18:25:40.338 INFO:tasks.workunit.client.0.smithi084.stdout:op 1363 completed, throughput=5MB/sec 2024-01-13T18:25:40.338 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bsURwaSt6MxbSlC off=5502135 len=1098321 2024-01-13T18:25:40.339 INFO:tasks.workunit.client.0.smithi084.stdout:op 1364 completed, throughput=5MB/sec 2024-01-13T18:25:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:25:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:25:40] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:25:41.340 INFO:tasks.workunit.client.0.smithi084.stdout: 272: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:41.340 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zOxPqEQIGHhltrw off=12535273 len=1481368 2024-01-13T18:25:41.342 INFO:tasks.workunit.client.0.smithi084.stdout:op 1365 completed, throughput=4.99MB/sec 2024-01-13T18:25:41.342 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kZNnoFJBTW-z7EI off=447548 len=2094300 2024-01-13T18:25:41.353 INFO:tasks.workunit.client.0.smithi084.stdout:op 1366 completed, throughput=5MB/sec 2024-01-13T18:25:41.354 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hSWMYy5CcW1N69s off=1401516 len=1493007 2024-01-13T18:25:41.355 INFO:tasks.workunit.client.0.smithi084.stdout:op 1367 completed, throughput=5MB/sec 2024-01-13T18:25:41.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:41 smithi084 ceph-mon[116404]: pgmap v1616: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:25:41.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:41 smithi084 ceph-mon[119097]: pgmap v1616: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:25:41.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:41 smithi099 ceph-mon[138788]: pgmap v1616: 105 pgs: 105 active+clean; 128 GiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:25:42.355 INFO:tasks.workunit.client.0.smithi084.stdout: 273: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:42.356 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-J26pWPD8APxS3yO off=1493298 len=55669 2024-01-13T18:25:42.358 INFO:tasks.workunit.client.0.smithi084.stdout:op 1368 completed, throughput=4.98MB/sec 2024-01-13T18:25:42.358 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5bszLN5hqQTVVaw off=4600539 len=1662633 2024-01-13T18:25:42.360 INFO:tasks.workunit.client.0.smithi084.stdout:op 1369 completed, throughput=4.99MB/sec 2024-01-13T18:25:42.360 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PdQeNG2GnTr-_RF off=1522407 len=260821 2024-01-13T18:25:42.360 INFO:tasks.workunit.client.0.smithi084.stdout:op 1370 completed, throughput=4.99MB/sec 2024-01-13T18:25:42.361 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ccDbbKjhqk4vxgl off=4343569 len=998623 2024-01-13T18:25:42.362 INFO:tasks.workunit.client.0.smithi084.stdout:op 1371 completed, throughput=4.99MB/sec 2024-01-13T18:25:42.362 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-u52mbi4a2_5NhMQ off=713810 len=906618 2024-01-13T18:25:42.363 INFO:tasks.workunit.client.0.smithi084.stdout:op 1372 completed, throughput=5MB/sec 2024-01-13T18:25:42.364 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--g67OMgtwo6YEVB off=2365726 len=392998 2024-01-13T18:25:42.365 INFO:tasks.workunit.client.0.smithi084.stdout:op 1373 completed, throughput=5MB/sec 2024-01-13T18:25:42.365 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rxoooM6xXHFnG7g off=1134384 len=667475 2024-01-13T18:25:42.370 INFO:tasks.workunit.client.0.smithi084.stdout:op 1374 completed, throughput=5MB/sec 2024-01-13T18:25:42.370 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tFoxff0zkO-xrm6 off=1192049 len=2047386 2024-01-13T18:25:42.372 INFO:tasks.workunit.client.0.smithi084.stdout:op 1375 completed, throughput=5.01MB/sec 2024-01-13T18:25:43.372 INFO:tasks.workunit.client.0.smithi084.stdout: 274: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:43.373 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GFSBF1D6WbDR-6j off=8944529 len=75323 2024-01-13T18:25:43.373 INFO:tasks.workunit.client.0.smithi084.stdout:op 1376 completed, throughput=4.99MB/sec 2024-01-13T18:25:43.373 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UeYndETov4O65WC off=7327595 len=348873 2024-01-13T18:25:43.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 1377 completed, throughput=4.99MB/sec 2024-01-13T18:25:43.376 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Yhhivb__N8aG-0i off=15812930 len=2030040 2024-01-13T18:25:43.379 INFO:tasks.workunit.client.0.smithi084.stdout:op 1378 completed, throughput=5MB/sec 2024-01-13T18:25:43.379 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oDn5pHSZRvjK1mB off=12625802 len=757795 2024-01-13T18:25:43.380 INFO:tasks.workunit.client.0.smithi084.stdout:op 1379 completed, throughput=5MB/sec 2024-01-13T18:25:43.381 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MJPnUddiwONjm4m off=1087354 len=663356 2024-01-13T18:25:43.381 INFO:tasks.workunit.client.0.smithi084.stdout:op 1380 completed, throughput=5MB/sec 2024-01-13T18:25:43.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:43 smithi084 ceph-mon[116404]: pgmap v1617: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:25:43.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:43 smithi084 ceph-mon[119097]: pgmap v1617: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:25:43.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:43 smithi099 ceph-mon[138788]: pgmap v1617: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:25:44.382 INFO:tasks.workunit.client.0.smithi084.stdout: 275: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:44.382 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-A-lddu-FZHJW2QN off=10844264 len=710097 2024-01-13T18:25:44.383 INFO:tasks.workunit.client.0.smithi084.stdout:op 1381 completed, throughput=4.99MB/sec 2024-01-13T18:25:44.383 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3LwuuY42lpuGH7C off=9354332 len=1627087 2024-01-13T18:25:44.387 INFO:tasks.workunit.client.0.smithi084.stdout:op 1382 completed, throughput=4.99MB/sec 2024-01-13T18:25:44.387 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_0CQxfqyu_66wJf off=312207 len=622053 2024-01-13T18:25:44.391 INFO:tasks.workunit.client.0.smithi084.stdout:op 1383 completed, throughput=4.99MB/sec 2024-01-13T18:25:44.391 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Lkyp1nMQ-OUIFA7 off=68695 len=1051164 2024-01-13T18:25:44.392 INFO:tasks.workunit.client.0.smithi084.stdout:op 1384 completed, throughput=5MB/sec 2024-01-13T18:25:44.393 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-o3pFKD77jSGOQvu off=9297892 len=941283 2024-01-13T18:25:44.397 INFO:tasks.workunit.client.0.smithi084.stdout:op 1385 completed, throughput=5MB/sec 2024-01-13T18:25:45.398 INFO:tasks.workunit.client.0.smithi084.stdout: 276: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:45.398 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gEeIyaEfEuaRX_1 off=10983242 len=1677794 2024-01-13T18:25:45.404 INFO:tasks.workunit.client.0.smithi084.stdout:op 1386 completed, throughput=4.99MB/sec 2024-01-13T18:25:45.405 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-w-XWOeKZnC3-pf4 off=6743530 len=746423 2024-01-13T18:25:45.409 INFO:tasks.workunit.client.0.smithi084.stdout:op 1387 completed, throughput=4.99MB/sec 2024-01-13T18:25:45.409 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LzEl1L2NqzPBLE1 off=3170080 len=1524234 2024-01-13T18:25:45.411 INFO:tasks.workunit.client.0.smithi084.stdout:op 1388 completed, throughput=5MB/sec 2024-01-13T18:25:45.411 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iEwPAqwChPh8N0F off=2557687 len=1560780 2024-01-13T18:25:45.418 INFO:tasks.workunit.client.0.smithi084.stdout:op 1389 completed, throughput=5MB/sec 2024-01-13T18:25:45.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:45 smithi084 ceph-mon[116404]: pgmap v1618: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:25:45.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:45 smithi084 ceph-mon[119097]: pgmap v1618: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:25:45.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:45 smithi099 ceph-mon[138788]: pgmap v1618: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:25:46.419 INFO:tasks.workunit.client.0.smithi084.stdout: 277: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:46.419 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Z0uPOQep9Wtbl6i off=8021125 len=155578 2024-01-13T18:25:46.419 INFO:tasks.workunit.client.0.smithi084.stdout:op 1390 completed, throughput=4.98MB/sec 2024-01-13T18:25:46.419 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WNr8QfWQwZwKCrj off=8255837 len=373082 2024-01-13T18:25:46.420 INFO:tasks.workunit.client.0.smithi084.stdout:op 1391 completed, throughput=4.98MB/sec 2024-01-13T18:25:46.420 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WV7FlJlnYW4M6ZM off=6758540 len=1205551 2024-01-13T18:25:46.421 INFO:tasks.workunit.client.0.smithi084.stdout:op 1392 completed, throughput=4.99MB/sec 2024-01-13T18:25:46.421 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WhA_hnUnJKl8iW5 off=21969744 len=1182791 2024-01-13T18:25:46.426 INFO:tasks.workunit.client.0.smithi084.stdout:op 1393 completed, throughput=4.99MB/sec 2024-01-13T18:25:46.426 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ozoGeZL-yAAKpMD off=7514300 len=1231139 2024-01-13T18:25:46.427 INFO:tasks.workunit.client.0.smithi084.stdout:op 1394 completed, throughput=5MB/sec 2024-01-13T18:25:46.427 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eXQZ4PTD-0x82Ig off=990808 len=106290 2024-01-13T18:25:46.428 INFO:tasks.workunit.client.0.smithi084.stdout:op 1395 completed, throughput=5MB/sec 2024-01-13T18:25:46.428 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n9v-ga_c_2rHx3B off=6298167 len=1407986 2024-01-13T18:25:46.434 INFO:tasks.workunit.client.0.smithi084.stdout:op 1396 completed, throughput=5MB/sec 2024-01-13T18:25:47.435 INFO:tasks.workunit.client.0.smithi084.stdout: 278: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:47.435 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eDuyjbFsIGsTcSH off=10491581 len=1499216 2024-01-13T18:25:47.440 INFO:tasks.workunit.client.0.smithi084.stdout:op 1397 completed, throughput=4.99MB/sec 2024-01-13T18:25:47.440 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w76rbe6cWVvcPOY off=580315 len=161872 2024-01-13T18:25:47.441 INFO:tasks.workunit.client.0.smithi084.stdout:op 1398 completed, throughput=4.99MB/sec 2024-01-13T18:25:47.441 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sPsZZaIoztJZ2Zp off=8084648 len=819548 2024-01-13T18:25:47.446 INFO:tasks.workunit.client.0.smithi084.stdout:op 1399 completed, throughput=4.99MB/sec 2024-01-13T18:25:47.446 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-W1E6PsdCCLPamTV off=698198 len=418054 2024-01-13T18:25:47.447 INFO:tasks.workunit.client.0.smithi084.stdout:op 1400 completed, throughput=4.99MB/sec 2024-01-13T18:25:47.447 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nfSrI2gzzEvlcuK off=2170463 len=1729601 2024-01-13T18:25:47.456 INFO:tasks.workunit.client.0.smithi084.stdout:op 1401 completed, throughput=5MB/sec 2024-01-13T18:25:47.457 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MkcRjkkFvzHr9iL off=18259 len=1415138 2024-01-13T18:25:47.458 INFO:tasks.workunit.client.0.smithi084.stdout:op 1402 completed, throughput=5MB/sec 2024-01-13T18:25:47.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:47 smithi084 ceph-mon[116404]: pgmap v1619: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:25:47.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:47 smithi084 ceph-mon[119097]: pgmap v1619: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:25:47.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:47 smithi099 ceph-mon[138788]: pgmap v1619: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:25:48.459 INFO:tasks.workunit.client.0.smithi084.stdout: 279: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:48.459 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Va7w6-HDiWRewkt off=293683 len=1393857 2024-01-13T18:25:48.466 INFO:tasks.workunit.client.0.smithi084.stdout:op 1403 completed, throughput=4.99MB/sec 2024-01-13T18:25:48.466 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n2O4Ev54Ug5UhMJ off=4059608 len=1243354 2024-01-13T18:25:48.468 INFO:tasks.workunit.client.0.smithi084.stdout:op 1404 completed, throughput=5MB/sec 2024-01-13T18:25:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EnXkVmGhn8mNZyA off=10777923 len=1937892 2024-01-13T18:25:48.480 INFO:tasks.workunit.client.0.smithi084.stdout:op 1405 completed, throughput=5MB/sec 2024-01-13T18:25:49.480 INFO:tasks.workunit.client.0.smithi084.stdout: 280: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:49.481 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uUg7djb-WcdfMdv off=8335306 len=1504153 2024-01-13T18:25:49.482 INFO:tasks.workunit.client.0.smithi084.stdout:op 1406 completed, throughput=4.99MB/sec 2024-01-13T18:25:49.482 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eVM9t_Q0ub0XRGo off=16399403 len=371331 2024-01-13T18:25:49.485 INFO:tasks.workunit.client.0.smithi084.stdout:op 1407 completed, throughput=4.99MB/sec 2024-01-13T18:25:49.485 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yZ3v5S8Ii4iqGHL off=1368179 len=1434373 2024-01-13T18:25:49.494 INFO:tasks.workunit.client.0.smithi084.stdout:op 1408 completed, throughput=4.99MB/sec 2024-01-13T18:25:49.494 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-udgNSjFT9yHRMll off=14249330 len=1678417 2024-01-13T18:25:49.496 INFO:tasks.workunit.client.0.smithi084.stdout:op 1409 completed, throughput=5MB/sec 2024-01-13T18:25:49.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:49 smithi099 ceph-mon[138788]: pgmap v1620: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:25:49.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:49 smithi084 ceph-mon[116404]: pgmap v1620: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:25:49.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:49 smithi084 ceph-mon[119097]: pgmap v1620: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:25:50.496 INFO:tasks.workunit.client.0.smithi084.stdout: 281: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:50.497 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-itb3KRuoLFBo-d6 off=158294 len=1289499 2024-01-13T18:25:50.498 INFO:tasks.workunit.client.0.smithi084.stdout:op 1410 completed, throughput=4.99MB/sec 2024-01-13T18:25:50.498 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_FHoS1NuRuPWVHc off=4036742 len=542238 2024-01-13T18:25:50.503 INFO:tasks.workunit.client.0.smithi084.stdout:op 1411 completed, throughput=4.99MB/sec 2024-01-13T18:25:50.503 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ygjr1BSQaX1EZPr off=9903721 len=12110 2024-01-13T18:25:50.504 INFO:tasks.workunit.client.0.smithi084.stdout:op 1412 completed, throughput=4.99MB/sec 2024-01-13T18:25:50.504 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8dEiyd-rBJx2zZM off=4615559 len=1369638 2024-01-13T18:25:50.507 INFO:tasks.workunit.client.0.smithi084.stdout:op 1413 completed, throughput=4.99MB/sec 2024-01-13T18:25:50.507 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XtUICNkturW5GBh off=1961492 len=1217902 2024-01-13T18:25:50.515 INFO:tasks.workunit.client.0.smithi084.stdout:op 1414 completed, throughput=5MB/sec 2024-01-13T18:25:50.515 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cn9OA1k_nT2UinG off=1292310 len=306150 2024-01-13T18:25:50.518 INFO:tasks.workunit.client.0.smithi084.stdout:op 1415 completed, throughput=5MB/sec 2024-01-13T18:25:50.518 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-v3l8nDBD0Xlf9od off=11253012 len=1775068 2024-01-13T18:25:50.520 INFO:tasks.workunit.client.0.smithi084.stdout:op 1416 completed, throughput=5MB/sec 2024-01-13T18:25:50.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:25:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:25:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:25:50] "GET /metrics HTTP/1.1" 200 33981 "" "Prometheus/2.43.0" 2024-01-13T18:25:51.520 INFO:tasks.workunit.client.0.smithi084.stdout: 282: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:51.520 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oEFuIDRNk9zpQ9G off=719371 len=60303 2024-01-13T18:25:51.523 INFO:tasks.workunit.client.0.smithi084.stdout:op 1417 completed, throughput=4.99MB/sec 2024-01-13T18:25:51.523 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AGeXKcWHIPEJvVU off=998970 len=1847036 2024-01-13T18:25:51.525 INFO:tasks.workunit.client.0.smithi084.stdout:op 1418 completed, throughput=4.99MB/sec 2024-01-13T18:25:51.525 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LzEl1L2NqzPBLE1 off=3048975 len=1730117 2024-01-13T18:25:51.526 INFO:tasks.workunit.client.0.smithi084.stdout:op 1419 completed, throughput=5MB/sec 2024-01-13T18:25:51.526 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gC8F3V0PsYMbEf1 off=10617203 len=93721 2024-01-13T18:25:51.527 INFO:tasks.workunit.client.0.smithi084.stdout:op 1420 completed, throughput=5MB/sec 2024-01-13T18:25:51.527 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JqI8ybk78xkz-tH off=8884213 len=1904137 2024-01-13T18:25:51.530 INFO:tasks.workunit.client.0.smithi084.stdout:op 1421 completed, throughput=5.01MB/sec 2024-01-13T18:25:51.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:51 smithi099 ceph-mon[138788]: pgmap v1621: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:25:51.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:51 smithi084 ceph-mon[116404]: pgmap v1621: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:25:51.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:51 smithi084 ceph-mon[119097]: pgmap v1621: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:25:52.531 INFO:tasks.workunit.client.0.smithi084.stdout: 283: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:52.531 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PcqHnGpbDgik8e8 off=1618856 len=1556863 2024-01-13T18:25:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:op 1422 completed, throughput=4.99MB/sec 2024-01-13T18:25:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-V7hLUbjwkQpAdwD off=2058148 len=509560 2024-01-13T18:25:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 1423 completed, throughput=4.99MB/sec 2024-01-13T18:25:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9roP3cN_l8zAasG off=5768303 len=1978614 2024-01-13T18:25:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:op 1424 completed, throughput=5MB/sec 2024-01-13T18:25:53.545 INFO:tasks.workunit.client.0.smithi084.stdout: 284: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:53.545 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mmfNc_CQ_ZVEmO5 off=493915 len=391388 2024-01-13T18:25:53.548 INFO:tasks.workunit.client.0.smithi084.stdout:op 1425 completed, throughput=4.99MB/sec 2024-01-13T18:25:53.548 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-00wKOw4QwP9qB4I off=8167409 len=1745750 2024-01-13T18:25:53.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 1426 completed, throughput=4.99MB/sec 2024-01-13T18:25:53.559 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DApBWMRYAh_5MW- off=7404742 len=604173 2024-01-13T18:25:53.562 INFO:tasks.workunit.client.0.smithi084.stdout:op 1427 completed, throughput=4.99MB/sec 2024-01-13T18:25:53.562 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-967vSDsdfExD1Ys off=1673743 len=1385824 2024-01-13T18:25:53.565 INFO:tasks.workunit.client.0.smithi084.stdout:op 1428 completed, throughput=5MB/sec 2024-01-13T18:25:53.565 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6vU5GKBslI_J4mt off=6231911 len=1745873 2024-01-13T18:25:53.572 INFO:tasks.workunit.client.0.smithi084.stdout:op 1429 completed, throughput=5MB/sec 2024-01-13T18:25:53.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:53 smithi084 ceph-mon[116404]: pgmap v1622: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:25:53.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:53 smithi084 ceph-mon[119097]: pgmap v1622: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:25:53.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:53 smithi099 ceph-mon[138788]: pgmap v1622: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:25:54.572 INFO:tasks.workunit.client.0.smithi084.stdout: 285: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:54.572 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5wg-Znm72cHxStb off=13783483 len=1096065 2024-01-13T18:25:54.578 INFO:tasks.workunit.client.0.smithi084.stdout:op 1430 completed, throughput=4.99MB/sec 2024-01-13T18:25:54.578 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8KileGfrQDp7t_Z off=933744 len=91751 2024-01-13T18:25:54.580 INFO:tasks.workunit.client.0.smithi084.stdout:op 1431 completed, throughput=4.99MB/sec 2024-01-13T18:25:54.580 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZMlNfLGJcoR_Kym off=3918767 len=1300126 2024-01-13T18:25:54.588 INFO:tasks.workunit.client.0.smithi084.stdout:op 1432 completed, throughput=4.99MB/sec 2024-01-13T18:25:54.588 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eRuT5MyfiOLtOx8 off=3157180 len=701335 2024-01-13T18:25:54.589 INFO:tasks.workunit.client.0.smithi084.stdout:op 1433 completed, throughput=5MB/sec 2024-01-13T18:25:54.589 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-La2YtEGYbisEVSf off=4634425 len=1829976 2024-01-13T18:25:54.590 INFO:tasks.workunit.client.0.smithi084.stdout:op 1434 completed, throughput=5MB/sec 2024-01-13T18:25:55.591 INFO:tasks.workunit.client.0.smithi084.stdout: 286: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:55.591 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mUaD8BlwYdn7F_A off=11399033 len=532906 2024-01-13T18:25:55.594 INFO:tasks.workunit.client.0.smithi084.stdout:op 1435 completed, throughput=4.99MB/sec 2024-01-13T18:25:55.594 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4YFizxArQdtTpXS off=1067952 len=755646 2024-01-13T18:25:55.597 INFO:tasks.workunit.client.0.smithi084.stdout:op 1436 completed, throughput=4.99MB/sec 2024-01-13T18:25:55.597 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YrpA7pIBz3h2SAx off=6460282 len=8822 2024-01-13T18:25:55.600 INFO:tasks.workunit.client.0.smithi084.stdout:op 1437 completed, throughput=4.99MB/sec 2024-01-13T18:25:55.600 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8bS28Zylt1OfCnB off=8132265 len=1386733 2024-01-13T18:25:55.601 INFO:tasks.workunit.client.0.smithi084.stdout:op 1438 completed, throughput=4.99MB/sec 2024-01-13T18:25:55.601 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Cxyu29qo3B15CFA off=1039451 len=1099080 2024-01-13T18:25:55.604 INFO:tasks.workunit.client.0.smithi084.stdout:op 1439 completed, throughput=5MB/sec 2024-01-13T18:25:55.604 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OLqNAIqzIjzd1Km off=12057489 len=1327745 2024-01-13T18:25:55.607 INFO:tasks.workunit.client.0.smithi084.stdout:op 1440 completed, throughput=5MB/sec 2024-01-13T18:25:55.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:55 smithi084 ceph-mon[116404]: pgmap v1623: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:25:55.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:55 smithi084 ceph-mon[119097]: pgmap v1623: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:25:55.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:55 smithi099 ceph-mon[138788]: pgmap v1623: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:25:56.608 INFO:tasks.workunit.client.0.smithi084.stdout: 287: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:56.608 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-f7KlW5CPcXuxAYE off=8864515 len=1145228 2024-01-13T18:25:56.612 INFO:tasks.workunit.client.0.smithi084.stdout:op 1441 completed, throughput=4.99MB/sec 2024-01-13T18:25:56.612 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WLWovPYe93G0qib off=6200675 len=1394853 2024-01-13T18:25:56.619 INFO:tasks.workunit.client.0.smithi084.stdout:op 1442 completed, throughput=4.99MB/sec 2024-01-13T18:25:56.619 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sh8Az67FOhSQrKv off=2021625 len=1978151 2024-01-13T18:25:56.628 INFO:tasks.workunit.client.0.smithi084.stdout:op 1443 completed, throughput=5MB/sec 2024-01-13T18:25:56.628 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mW2F3Da2tRp461x off=1578536 len=1122047 2024-01-13T18:25:56.633 INFO:tasks.workunit.client.0.smithi084.stdout:op 1444 completed, throughput=5MB/sec 2024-01-13T18:25:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: 288: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LncwDIUJpL2Ps-E off=550218 len=223903 2024-01-13T18:25:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:op 1445 completed, throughput=4.99MB/sec 2024-01-13T18:25:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MSFEFaaUl5j-8KW off=11994658 len=1141571 2024-01-13T18:25:57.642 INFO:tasks.workunit.client.0.smithi084.stdout:op 1446 completed, throughput=4.99MB/sec 2024-01-13T18:25:57.642 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2aV8deTN-s2roiJ off=2295137 len=814225 2024-01-13T18:25:57.644 INFO:tasks.workunit.client.0.smithi084.stdout:op 1447 completed, throughput=4.99MB/sec 2024-01-13T18:25:57.645 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ll0at-XslbQq_02 off=5934829 len=268890 2024-01-13T18:25:57.648 INFO:tasks.workunit.client.0.smithi084.stdout:op 1448 completed, throughput=4.99MB/sec 2024-01-13T18:25:57.648 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y61NyP0ehmmkDEO off=6250465 len=779729 2024-01-13T18:25:57.649 INFO:tasks.workunit.client.0.smithi084.stdout:op 1449 completed, throughput=5MB/sec 2024-01-13T18:25:57.649 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uwF10rZXe8HLKSm off=385601 len=53438 2024-01-13T18:25:57.649 INFO:tasks.workunit.client.0.smithi084.stdout:op 1450 completed, throughput=5MB/sec 2024-01-13T18:25:57.650 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uAIFSOjp63R49Uq off=1853877 len=1711124 2024-01-13T18:25:57.651 INFO:tasks.workunit.client.0.smithi084.stdout:op 1451 completed, throughput=5MB/sec 2024-01-13T18:25:57.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:57 smithi084 ceph-mon[116404]: pgmap v1624: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:25:57.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:57 smithi084 ceph-mon[119097]: pgmap v1624: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:25:57.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:57 smithi099 ceph-mon[138788]: pgmap v1624: 105 pgs: 105 active+clean; 128 GiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:25:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: 289: throughput=4.98MB/sec pending data=0 2024-01-13T18:25:58.651 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ViJdxN2heDUqH3V off=1232967 len=990940 2024-01-13T18:25:58.652 INFO:tasks.workunit.client.0.smithi084.stdout:op 1452 completed, throughput=4.99MB/sec 2024-01-13T18:25:58.652 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-P8HIC38XfwrVdB_ off=3225575 len=1897556 2024-01-13T18:25:58.654 INFO:tasks.workunit.client.0.smithi084.stdout:op 1453 completed, throughput=4.99MB/sec 2024-01-13T18:25:58.654 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Op__MvvY7Sx16WP off=7756248 len=1075443 2024-01-13T18:25:58.661 INFO:tasks.workunit.client.0.smithi084.stdout:op 1454 completed, throughput=5MB/sec 2024-01-13T18:25:58.661 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_fWQWLX7PibFFJQ off=15695527 len=765008 2024-01-13T18:25:58.662 INFO:tasks.workunit.client.0.smithi084.stdout:op 1455 completed, throughput=5MB/sec 2024-01-13T18:25:58.662 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ev67I8baQkcH2rr off=1464653 len=1693688 2024-01-13T18:25:58.664 INFO:tasks.workunit.client.0.smithi084.stdout:op 1456 completed, throughput=5MB/sec 2024-01-13T18:25:59.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:25:59 smithi099 ceph-mon[138788]: pgmap v1625: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:25:59.664 INFO:tasks.workunit.client.0.smithi084.stdout: 290: throughput=4.99MB/sec pending data=0 2024-01-13T18:25:59.664 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nuiTqWxeSEj1tr4 off=10188880 len=203529 2024-01-13T18:25:59.667 INFO:tasks.workunit.client.0.smithi084.stdout:op 1457 completed, throughput=4.99MB/sec 2024-01-13T18:25:59.668 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ksJc-n1GpUo6LUp off=17035936 len=331528 2024-01-13T18:25:59.669 INFO:tasks.workunit.client.0.smithi084.stdout:op 1458 completed, throughput=4.99MB/sec 2024-01-13T18:25:59.669 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cotH6tTfrzogS1w off=6625242 len=152698 2024-01-13T18:25:59.669 INFO:tasks.workunit.client.0.smithi084.stdout:op 1459 completed, throughput=4.99MB/sec 2024-01-13T18:25:59.670 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-seoINWkljYIRQpM off=17100529 len=739924 2024-01-13T18:25:59.670 INFO:tasks.workunit.client.0.smithi084.stdout:op 1460 completed, throughput=4.99MB/sec 2024-01-13T18:25:59.671 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-V2rPZ3NSFyRjcgp off=12225821 len=52779 2024-01-13T18:25:59.673 INFO:tasks.workunit.client.0.smithi084.stdout:op 1461 completed, throughput=4.99MB/sec 2024-01-13T18:25:59.673 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CByXjl1X4ctjR_D off=5943088 len=1197440 2024-01-13T18:25:59.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:25:59 smithi084 ceph-mon[116404]: pgmap v1625: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:25:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:25:59 smithi084 ceph-mon[119097]: pgmap v1625: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:25:59.678 INFO:tasks.workunit.client.0.smithi084.stdout:op 1462 completed, throughput=5MB/sec 2024-01-13T18:25:59.678 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6MOkC7Uynp3oQ0n off=6428926 len=1824588 2024-01-13T18:25:59.680 INFO:tasks.workunit.client.0.smithi084.stdout:op 1463 completed, throughput=5MB/sec 2024-01-13T18:26:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:26:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:26:00] "GET /metrics HTTP/1.1" 200 33981 "" "Prometheus/2.43.0" 2024-01-13T18:26:00.680 INFO:tasks.workunit.client.0.smithi084.stdout: 291: throughput=4.98MB/sec pending data=0 2024-01-13T18:26:00.680 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-P9tEm7h2ubyCTR5 off=13785882 len=1077592 2024-01-13T18:26:00.682 INFO:tasks.workunit.client.0.smithi084.stdout:op 1464 completed, throughput=4.99MB/sec 2024-01-13T18:26:00.682 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-m5YwGEODxuFYf59 off=8087913 len=1870904 2024-01-13T18:26:00.693 INFO:tasks.workunit.client.0.smithi084.stdout:op 1465 completed, throughput=4.99MB/sec 2024-01-13T18:26:00.693 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oMbWPFltwueOqq7 off=1826705 len=266538 2024-01-13T18:26:00.696 INFO:tasks.workunit.client.0.smithi084.stdout:op 1466 completed, throughput=4.99MB/sec 2024-01-13T18:26:00.696 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cyiVK3ApGJgqaM1 off=7560475 len=1695575 2024-01-13T18:26:00.699 INFO:tasks.workunit.client.0.smithi084.stdout:op 1467 completed, throughput=5MB/sec 2024-01-13T18:26:01.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:01 smithi084 ceph-mon[116404]: pgmap v1626: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:01.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:01 smithi084 ceph-mon[119097]: pgmap v1626: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:01.699 INFO:tasks.workunit.client.0.smithi084.stdout: 292: throughput=4.98MB/sec pending data=0 2024-01-13T18:26:01.699 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L0WX43tI7BzxNWl off=4070826 len=64473 2024-01-13T18:26:01.699 INFO:tasks.workunit.client.0.smithi084.stdout:op 1468 completed, throughput=4.98MB/sec 2024-01-13T18:26:01.700 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pg9akX_SHM7BVWI off=12719333 len=830536 2024-01-13T18:26:01.701 INFO:tasks.workunit.client.0.smithi084.stdout:op 1469 completed, throughput=4.99MB/sec 2024-01-13T18:26:01.701 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QyLzkR3-JBFQKht off=79008 len=272919 2024-01-13T18:26:01.702 INFO:tasks.workunit.client.0.smithi084.stdout:op 1470 completed, throughput=4.99MB/sec 2024-01-13T18:26:01.702 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w0WkwYTAMcHvwC1 off=8971961 len=359868 2024-01-13T18:26:01.703 INFO:tasks.workunit.client.0.smithi084.stdout:op 1471 completed, throughput=4.99MB/sec 2024-01-13T18:26:01.703 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GxN5MEGijBUjyvP off=21807366 len=945084 2024-01-13T18:26:01.704 INFO:tasks.workunit.client.0.smithi084.stdout:op 1472 completed, throughput=4.99MB/sec 2024-01-13T18:26:01.704 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Yx32eIHJm3vmaNv off=5204350 len=711433 2024-01-13T18:26:01.706 INFO:tasks.workunit.client.0.smithi084.stdout:op 1473 completed, throughput=4.99MB/sec 2024-01-13T18:26:01.706 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Y_9dNLO2ilX-h-x off=7645127 len=359731 2024-01-13T18:26:01.709 INFO:tasks.workunit.client.0.smithi084.stdout:op 1474 completed, throughput=4.99MB/sec 2024-01-13T18:26:01.709 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9vB1c3U1rlTPiVg off=1748721 len=1708760 2024-01-13T18:26:01.718 INFO:tasks.workunit.client.0.smithi084.stdout:op 1475 completed, throughput=5MB/sec 2024-01-13T18:26:01.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:01 smithi099 ceph-mon[138788]: pgmap v1626: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:02.719 INFO:tasks.workunit.client.0.smithi084.stdout: 293: throughput=4.98MB/sec pending data=0 2024-01-13T18:26:02.719 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-a1Il8uZsYUDfugZ off=11625681 len=63353 2024-01-13T18:26:02.721 INFO:tasks.workunit.client.0.smithi084.stdout:op 1476 completed, throughput=4.98MB/sec 2024-01-13T18:26:02.721 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HM6TkEJLNAuK5LN off=0 len=1421701 2024-01-13T18:26:02.723 INFO:tasks.workunit.client.0.smithi084.stdout:op 1477 completed, throughput=4.99MB/sec 2024-01-13T18:26:02.723 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aQTfEvp-jhzjOTf off=3811074 len=397174 2024-01-13T18:26:02.726 INFO:tasks.workunit.client.0.smithi084.stdout:op 1478 completed, throughput=4.99MB/sec 2024-01-13T18:26:02.726 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7IQpqq61ncLZ5Mp off=8591599 len=297086 2024-01-13T18:26:02.727 INFO:tasks.workunit.client.0.smithi084.stdout:op 1479 completed, throughput=4.99MB/sec 2024-01-13T18:26:02.727 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-R2IoJqL3udMHiIO off=2942825 len=535501 2024-01-13T18:26:02.728 INFO:tasks.workunit.client.0.smithi084.stdout:op 1480 completed, throughput=4.99MB/sec 2024-01-13T18:26:02.729 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8THNFmrjTqxVXgQ off=9117444 len=520164 2024-01-13T18:26:02.732 INFO:tasks.workunit.client.0.smithi084.stdout:op 1481 completed, throughput=4.99MB/sec 2024-01-13T18:26:02.732 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2BGXcv73w-AFF7c off=6592987 len=525912 2024-01-13T18:26:02.733 INFO:tasks.workunit.client.0.smithi084.stdout:op 1482 completed, throughput=5MB/sec 2024-01-13T18:26:02.733 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dsSmwod8RGbVSOD off=18049487 len=32943 2024-01-13T18:26:02.733 INFO:tasks.workunit.client.0.smithi084.stdout:op 1483 completed, throughput=5MB/sec 2024-01-13T18:26:02.733 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--41vr2yHKMb89_C off=93226 len=1086722 2024-01-13T18:26:02.738 INFO:tasks.workunit.client.0.smithi084.stdout:op 1484 completed, throughput=5MB/sec 2024-01-13T18:26:02.738 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UCV-RnkzKIL0X1D off=3293074 len=800759 2024-01-13T18:26:02.741 INFO:tasks.workunit.client.0.smithi084.stdout:op 1485 completed, throughput=5MB/sec 2024-01-13T18:26:03.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:03 smithi084 ceph-mon[116404]: pgmap v1627: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:26:03.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:03 smithi084 ceph-mon[119097]: pgmap v1627: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:26:03.741 INFO:tasks.workunit.client.0.smithi084.stdout: 294: throughput=4.98MB/sec pending data=0 2024-01-13T18:26:03.742 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Hrp00F8N_wlXDT4 off=975107 len=1201047 2024-01-13T18:26:03.743 INFO:tasks.workunit.client.0.smithi084.stdout:op 1486 completed, throughput=4.99MB/sec 2024-01-13T18:26:03.743 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OTnjibpMUySihwd off=5695790 len=1873170 2024-01-13T18:26:03.745 INFO:tasks.workunit.client.0.smithi084.stdout:op 1487 completed, throughput=4.99MB/sec 2024-01-13T18:26:03.746 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3bektLe8bCqBRw9 off=13653826 len=1213313 2024-01-13T18:26:03.747 INFO:tasks.workunit.client.0.smithi084.stdout:op 1488 completed, throughput=5MB/sec 2024-01-13T18:26:03.747 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-q_1FFnhiojNEaPd off=6518053 len=192882 2024-01-13T18:26:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:op 1489 completed, throughput=5MB/sec 2024-01-13T18:26:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pw_7BtNJQO42aqj off=661315 len=68286 2024-01-13T18:26:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:op 1490 completed, throughput=5MB/sec 2024-01-13T18:26:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SBQ8thRkb-ymEr0 off=535198 len=604206 2024-01-13T18:26:03.752 INFO:tasks.workunit.client.0.smithi084.stdout:op 1491 completed, throughput=5MB/sec 2024-01-13T18:26:03.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:03 smithi099 ceph-mon[138788]: pgmap v1627: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:26:04.752 INFO:tasks.workunit.client.0.smithi084.stdout: 295: throughput=4.98MB/sec pending data=0 2024-01-13T18:26:04.752 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0X6TrIPN9S6uh82 off=5629707 len=799595 2024-01-13T18:26:04.757 INFO:tasks.workunit.client.0.smithi084.stdout:op 1492 completed, throughput=4.99MB/sec 2024-01-13T18:26:04.757 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y7xyc5JKn5ESz0B off=9954396 len=1288734 2024-01-13T18:26:04.765 INFO:tasks.workunit.client.0.smithi084.stdout:op 1493 completed, throughput=4.99MB/sec 2024-01-13T18:26:04.765 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bHdAtVIawc5GVDW off=18170520 len=1200987 2024-01-13T18:26:04.773 INFO:tasks.workunit.client.0.smithi084.stdout:op 1494 completed, throughput=4.99MB/sec 2024-01-13T18:26:04.773 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-niHvdvWV7Sppl3V off=19637978 len=206135 2024-01-13T18:26:04.774 INFO:tasks.workunit.client.0.smithi084.stdout:op 1495 completed, throughput=4.99MB/sec 2024-01-13T18:26:04.774 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gvoNtaa9J02DZSs off=611964 len=1177060 2024-01-13T18:26:04.775 INFO:tasks.workunit.client.0.smithi084.stdout:op 1496 completed, throughput=5MB/sec 2024-01-13T18:26:04.775 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-i9bz56fuwe-yYyt off=11896197 len=640479 2024-01-13T18:26:04.779 INFO:tasks.workunit.client.0.smithi084.stdout:op 1497 completed, throughput=5MB/sec 2024-01-13T18:26:05.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:05 smithi084 ceph-mon[116404]: pgmap v1628: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:26:05.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:05 smithi084 ceph-mon[119097]: pgmap v1628: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:26:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:05.779 INFO:tasks.workunit.client.0.smithi084.stdout: 296: throughput=4.98MB/sec pending data=0 2024-01-13T18:26:05.779 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vV8kb0RcPs6oCKF off=61757 len=1028201 2024-01-13T18:26:05.781 INFO:tasks.workunit.client.0.smithi084.stdout:op 1498 completed, throughput=4.99MB/sec 2024-01-13T18:26:05.781 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Hoqwp3KAtd8-DV4 off=244460 len=75020 2024-01-13T18:26:05.783 INFO:tasks.workunit.client.0.smithi084.stdout:op 1499 completed, throughput=4.99MB/sec 2024-01-13T18:26:05.783 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1s4vngE-AszsDy5 off=1819814 len=1691421 2024-01-13T18:26:05.785 INFO:tasks.workunit.client.0.smithi084.stdout:op 1500 completed, throughput=4.99MB/sec 2024-01-13T18:26:05.785 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1uZcFD2yeIknvwt off=2007967 len=135946 2024-01-13T18:26:05.785 INFO:tasks.workunit.client.0.smithi084.stdout:op 1501 completed, throughput=4.99MB/sec 2024-01-13T18:26:05.785 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KUayUkTsr3T9NLS off=12236520 len=467039 2024-01-13T18:26:05.789 INFO:tasks.workunit.client.0.smithi084.stdout:op 1502 completed, throughput=4.99MB/sec 2024-01-13T18:26:05.789 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-R5I9-Wox9ZQ9Uy0 off=13176635 len=27920 2024-01-13T18:26:05.790 INFO:tasks.workunit.client.0.smithi084.stdout:op 1503 completed, throughput=4.99MB/sec 2024-01-13T18:26:05.790 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5ZZilZV5cMGKzhf off=9205207 len=159480 2024-01-13T18:26:05.790 INFO:tasks.workunit.client.0.smithi084.stdout:op 1504 completed, throughput=4.99MB/sec 2024-01-13T18:26:05.791 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Qlstcj4ADXdyAB8 off=11992060 len=314047 2024-01-13T18:26:05.791 INFO:tasks.workunit.client.0.smithi084.stdout:op 1505 completed, throughput=5MB/sec 2024-01-13T18:26:05.791 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TVUY2anCfYfb224 off=8540747 len=339659 2024-01-13T18:26:05.793 INFO:tasks.workunit.client.0.smithi084.stdout:op 1506 completed, throughput=5MB/sec 2024-01-13T18:26:05.793 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ie6BwwuLJsCi7iE off=300439 len=37717 2024-01-13T18:26:05.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 1507 completed, throughput=5MB/sec 2024-01-13T18:26:05.795 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G20TosdHZ33JEaL off=10261541 len=1963347 2024-01-13T18:26:05.803 INFO:tasks.workunit.client.0.smithi084.stdout:op 1508 completed, throughput=5MB/sec 2024-01-13T18:26:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:05 smithi099 ceph-mon[138788]: pgmap v1628: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:26:05.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:06.803 INFO:tasks.workunit.client.0.smithi084.stdout: 297: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:06.804 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zjj7ArZujbeRnbo off=402750 len=1000455 2024-01-13T18:26:06.805 INFO:tasks.workunit.client.0.smithi084.stdout:op 1509 completed, throughput=4.99MB/sec 2024-01-13T18:26:06.805 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3VXsegZVA6z1dvQ off=2965987 len=820112 2024-01-13T18:26:06.810 INFO:tasks.workunit.client.0.smithi084.stdout:op 1510 completed, throughput=4.99MB/sec 2024-01-13T18:26:06.810 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0_PwM6dpOVgIwkM off=973830 len=230928 2024-01-13T18:26:06.814 INFO:tasks.workunit.client.0.smithi084.stdout:op 1511 completed, throughput=4.99MB/sec 2024-01-13T18:26:06.814 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9iBt-acAdmlzl9P off=3821066 len=955481 2024-01-13T18:26:06.818 INFO:tasks.workunit.client.0.smithi084.stdout:op 1512 completed, throughput=5MB/sec 2024-01-13T18:26:06.818 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Cw41cCvtt1dqkA8 off=7424030 len=658151 2024-01-13T18:26:06.821 INFO:tasks.workunit.client.0.smithi084.stdout:op 1513 completed, throughput=5MB/sec 2024-01-13T18:26:06.821 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JBC4L44oGJreOUt off=1800960 len=2005393 2024-01-13T18:26:06.823 INFO:tasks.workunit.client.0.smithi084.stdout:op 1514 completed, throughput=5MB/sec 2024-01-13T18:26:07.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:07 smithi084 ceph-mon[116404]: pgmap v1629: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:26:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:07 smithi084 ceph-mon[119097]: pgmap v1629: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:26:07.824 INFO:tasks.workunit.client.0.smithi084.stdout: 298: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:07.824 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dHyUcGvtDVO9-_n off=18400209 len=1744667 2024-01-13T18:26:07.833 INFO:tasks.workunit.client.0.smithi084.stdout:op 1515 completed, throughput=4.99MB/sec 2024-01-13T18:26:07.833 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Yk4rNNe-bjiZ8qh off=10917951 len=894033 2024-01-13T18:26:07.838 INFO:tasks.workunit.client.0.smithi084.stdout:op 1516 completed, throughput=5MB/sec 2024-01-13T18:26:07.838 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rYmceSqB5cZoVZj off=908349 len=1078621 2024-01-13T18:26:07.844 INFO:tasks.workunit.client.0.smithi084.stdout:op 1517 completed, throughput=5MB/sec 2024-01-13T18:26:07.844 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nLcBC4TJloh3Iqb off=9678994 len=108757 2024-01-13T18:26:07.844 INFO:tasks.workunit.client.0.smithi084.stdout:op 1518 completed, throughput=5MB/sec 2024-01-13T18:26:07.844 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-99tbwmMHYA1ijvR off=10439449 len=1233316 2024-01-13T18:26:07.849 INFO:tasks.workunit.client.0.smithi084.stdout:op 1519 completed, throughput=5MB/sec 2024-01-13T18:26:07.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:07 smithi099 ceph-mon[138788]: pgmap v1629: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:26:08.850 INFO:tasks.workunit.client.0.smithi084.stdout: 299: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:08.850 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-orAajoLFoONNqa6 off=5776704 len=897793 2024-01-13T18:26:08.855 INFO:tasks.workunit.client.0.smithi084.stdout:op 1520 completed, throughput=4.99MB/sec 2024-01-13T18:26:08.855 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1ZW6aCrr8z4qyta off=233903 len=1584591 2024-01-13T18:26:08.863 INFO:tasks.workunit.client.0.smithi084.stdout:op 1521 completed, throughput=4.99MB/sec 2024-01-13T18:26:08.863 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rVSfJ--UHMFwOhV off=3265266 len=1766043 2024-01-13T18:26:08.872 INFO:tasks.workunit.client.0.smithi084.stdout:op 1522 completed, throughput=5MB/sec 2024-01-13T18:26:08.872 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zWJ_-cbYfvdhLgY off=316859 len=1372473 2024-01-13T18:26:08.881 INFO:tasks.workunit.client.0.smithi084.stdout:op 1523 completed, throughput=5MB/sec 2024-01-13T18:26:09.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:09 smithi099 ceph-mon[138788]: pgmap v1630: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:26:09.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:09 smithi084 ceph-mon[116404]: pgmap v1630: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:26:09.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:09 smithi084 ceph-mon[119097]: pgmap v1630: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:26:09.881 INFO:tasks.workunit.client.0.smithi084.stdout: 300: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:09.881 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-e9utMH--f23A9UV off=122961 len=39335 2024-01-13T18:26:09.881 INFO:tasks.workunit.client.0.smithi084.stdout:op 1524 completed, throughput=4.99MB/sec 2024-01-13T18:26:09.882 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YabiXAp_4T8ZSo5 off=295152 len=1364355 2024-01-13T18:26:09.883 INFO:tasks.workunit.client.0.smithi084.stdout:op 1525 completed, throughput=4.99MB/sec 2024-01-13T18:26:09.883 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-m999LmjXWKOz3zW off=7751084 len=1785306 2024-01-13T18:26:09.885 INFO:tasks.workunit.client.0.smithi084.stdout:op 1526 completed, throughput=5MB/sec 2024-01-13T18:26:09.885 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3BFiERocjENV8vV off=9184330 len=668770 2024-01-13T18:26:09.886 INFO:tasks.workunit.client.0.smithi084.stdout:op 1527 completed, throughput=5MB/sec 2024-01-13T18:26:09.886 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9EmyyGVIKWKWzq2 off=16812654 len=1436949 2024-01-13T18:26:09.888 INFO:tasks.workunit.client.0.smithi084.stdout:op 1528 completed, throughput=5MB/sec 2024-01-13T18:26:10.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:26:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:26:10] "GET /metrics HTTP/1.1" 200 33983 "" "Prometheus/2.43.0" 2024-01-13T18:26:10.888 INFO:tasks.workunit.client.0.smithi084.stdout: 301: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:10.888 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--b__SaoWCmpZpsC off=7771417 len=737526 2024-01-13T18:26:10.890 INFO:tasks.workunit.client.0.smithi084.stdout:op 1529 completed, throughput=4.99MB/sec 2024-01-13T18:26:10.890 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Xkd9PHIvvPWuIFJ off=0 len=1197083 2024-01-13T18:26:10.892 INFO:tasks.workunit.client.0.smithi084.stdout:op 1530 completed, throughput=4.99MB/sec 2024-01-13T18:26:10.892 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-O6HzKgTSWxqjlPk off=6389994 len=1674982 2024-01-13T18:26:10.899 INFO:tasks.workunit.client.0.smithi084.stdout:op 1531 completed, throughput=5MB/sec 2024-01-13T18:26:10.899 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0JdensaN_vsKZ0- off=3075711 len=46282 2024-01-13T18:26:10.901 INFO:tasks.workunit.client.0.smithi084.stdout:op 1532 completed, throughput=5MB/sec 2024-01-13T18:26:10.901 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NwCbeRsXq1xk3ly off=15328823 len=813186 2024-01-13T18:26:10.902 INFO:tasks.workunit.client.0.smithi084.stdout:op 1533 completed, throughput=5MB/sec 2024-01-13T18:26:11.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:11 smithi084 ceph-mon[119097]: pgmap v1631: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:26:11.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:11 smithi084 ceph-mon[116404]: pgmap v1631: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:26:11.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:11 smithi099 ceph-mon[138788]: pgmap v1631: 105 pgs: 105 active+clean; 128 GiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:26:11.902 INFO:tasks.workunit.client.0.smithi084.stdout: 302: throughput=4.98MB/sec pending data=0 2024-01-13T18:26:11.902 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UiqUaNdHF14Z7Zm off=526894 len=987795 2024-01-13T18:26:11.907 INFO:tasks.workunit.client.0.smithi084.stdout:op 1534 completed, throughput=4.99MB/sec 2024-01-13T18:26:11.908 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-v1NhFhCKCln0-j- off=7827666 len=512405 2024-01-13T18:26:11.911 INFO:tasks.workunit.client.0.smithi084.stdout:op 1535 completed, throughput=4.99MB/sec 2024-01-13T18:26:11.911 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Lsj044ruB0ndhV5 off=3203735 len=103066 2024-01-13T18:26:11.911 INFO:tasks.workunit.client.0.smithi084.stdout:op 1536 completed, throughput=4.99MB/sec 2024-01-13T18:26:11.912 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V9m9Fe0BXTxKIiM off=1463423 len=421411 2024-01-13T18:26:11.913 INFO:tasks.workunit.client.0.smithi084.stdout:op 1537 completed, throughput=4.99MB/sec 2024-01-13T18:26:11.913 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PjfZhwgKV28ikvf off=41509 len=184823 2024-01-13T18:26:11.913 INFO:tasks.workunit.client.0.smithi084.stdout:op 1538 completed, throughput=4.99MB/sec 2024-01-13T18:26:11.913 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aqk0gVU9j-JjMNe off=7362552 len=758363 2024-01-13T18:26:11.917 INFO:tasks.workunit.client.0.smithi084.stdout:op 1539 completed, throughput=4.99MB/sec 2024-01-13T18:26:11.917 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-b7u8Rwx_3JClV8A off=15093763 len=839509 2024-01-13T18:26:11.922 INFO:tasks.workunit.client.0.smithi084.stdout:op 1540 completed, throughput=5MB/sec 2024-01-13T18:26:11.922 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Wh9_zBl-1s71__a off=2519180 len=1045434 2024-01-13T18:26:11.923 INFO:tasks.workunit.client.0.smithi084.stdout:op 1541 completed, throughput=5MB/sec 2024-01-13T18:26:11.923 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7yc_mNu4wegBwrh off=5444779 len=1236679 2024-01-13T18:26:11.924 INFO:tasks.workunit.client.0.smithi084.stdout:op 1542 completed, throughput=5MB/sec 2024-01-13T18:26:12.925 INFO:tasks.workunit.client.0.smithi084.stdout: 303: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:12.925 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CpWx3eJmR9B9Ibs off=13735746 len=1280865 2024-01-13T18:26:12.926 INFO:tasks.workunit.client.0.smithi084.stdout:op 1543 completed, throughput=4.99MB/sec 2024-01-13T18:26:12.926 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6bxBbxnG8ujh3SX off=7358150 len=501799 2024-01-13T18:26:12.927 INFO:tasks.workunit.client.0.smithi084.stdout:op 1544 completed, throughput=4.99MB/sec 2024-01-13T18:26:12.927 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xOz0b5XzFaJr5JO off=2115747 len=1226083 2024-01-13T18:26:12.934 INFO:tasks.workunit.client.0.smithi084.stdout:op 1545 completed, throughput=5MB/sec 2024-01-13T18:26:12.934 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VHGB3kOBTU-GcZT off=21269210 len=708249 2024-01-13T18:26:12.937 INFO:tasks.workunit.client.0.smithi084.stdout:op 1546 completed, throughput=5MB/sec 2024-01-13T18:26:12.937 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EGt1W8iECn0AvVF off=139133 len=369871 2024-01-13T18:26:12.940 INFO:tasks.workunit.client.0.smithi084.stdout:op 1547 completed, throughput=5MB/sec 2024-01-13T18:26:12.940 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sU7sl3G4tNWZsdT off=11189492 len=126668 2024-01-13T18:26:12.943 INFO:tasks.workunit.client.0.smithi084.stdout:op 1548 completed, throughput=5MB/sec 2024-01-13T18:26:12.943 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NPs14wp_a5bY4W5 off=1088202 len=1287547 2024-01-13T18:26:12.945 INFO:tasks.workunit.client.0.smithi084.stdout:op 1549 completed, throughput=5MB/sec 2024-01-13T18:26:13.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:13 smithi084 ceph-mon[119097]: pgmap v1632: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:26:13.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:13 smithi084 ceph-mon[116404]: pgmap v1632: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:26:13.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:13 smithi099 ceph-mon[138788]: pgmap v1632: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:26:13.945 INFO:tasks.workunit.client.0.smithi084.stdout: 304: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:13.945 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ybhEvlXDCES1LRR off=16031746 len=1257647 2024-01-13T18:26:13.952 INFO:tasks.workunit.client.0.smithi084.stdout:op 1550 completed, throughput=4.99MB/sec 2024-01-13T18:26:13.952 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5KsuuoytBEt36wx off=1340899 len=2032649 2024-01-13T18:26:13.956 INFO:tasks.workunit.client.0.smithi084.stdout:op 1551 completed, throughput=5MB/sec 2024-01-13T18:26:13.956 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AazWZMNDfzhouo4 off=7976025 len=1282933 2024-01-13T18:26:13.957 INFO:tasks.workunit.client.0.smithi084.stdout:op 1552 completed, throughput=5MB/sec 2024-01-13T18:26:14.958 INFO:tasks.workunit.client.0.smithi084.stdout: 305: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:14.958 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--KkBBzgUKH_TVUT off=5979965 len=141688 2024-01-13T18:26:14.960 INFO:tasks.workunit.client.0.smithi084.stdout:op 1553 completed, throughput=4.99MB/sec 2024-01-13T18:26:14.960 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eIUIRADj2W5Qxg5 off=4162337 len=1631415 2024-01-13T18:26:14.962 INFO:tasks.workunit.client.0.smithi084.stdout:op 1554 completed, throughput=4.99MB/sec 2024-01-13T18:26:14.962 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wnbtsTnY_q-dU_W off=15507479 len=123010 2024-01-13T18:26:14.965 INFO:tasks.workunit.client.0.smithi084.stdout:op 1555 completed, throughput=4.99MB/sec 2024-01-13T18:26:14.965 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PBTQmItDYs1bbaq off=18795568 len=1740659 2024-01-13T18:26:14.967 INFO:tasks.workunit.client.0.smithi084.stdout:op 1556 completed, throughput=5MB/sec 2024-01-13T18:26:14.967 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OYpTcFL8ZjGbRxy off=3871093 len=1290222 2024-01-13T18:26:14.968 INFO:tasks.workunit.client.0.smithi084.stdout:op 1557 completed, throughput=5MB/sec 2024-01-13T18:26:15.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:15 smithi084 ceph-mon[116404]: pgmap v1633: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 6 op/s 2024-01-13T18:26:15.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:15 smithi084 ceph-mon[119097]: pgmap v1633: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 6 op/s 2024-01-13T18:26:15.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:15 smithi099 ceph-mon[138788]: pgmap v1633: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 6 op/s 2024-01-13T18:26:15.969 INFO:tasks.workunit.client.0.smithi084.stdout: 306: throughput=4.98MB/sec pending data=0 2024-01-13T18:26:15.969 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-G1qE50BJEhmeFAD off=16602842 len=2089547 2024-01-13T18:26:15.973 INFO:tasks.workunit.client.0.smithi084.stdout:op 1558 completed, throughput=4.99MB/sec 2024-01-13T18:26:15.973 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ljMUUJt969UtyeH off=8190807 len=48620 2024-01-13T18:26:15.973 INFO:tasks.workunit.client.0.smithi084.stdout:op 1559 completed, throughput=4.99MB/sec 2024-01-13T18:26:15.973 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BsnNoAbmhNzkEoj off=1146552 len=643650 2024-01-13T18:26:15.974 INFO:tasks.workunit.client.0.smithi084.stdout:op 1560 completed, throughput=4.99MB/sec 2024-01-13T18:26:15.974 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-it-ofEZ1Yi6rEDd off=7754387 len=965884 2024-01-13T18:26:15.980 INFO:tasks.workunit.client.0.smithi084.stdout:op 1561 completed, throughput=5MB/sec 2024-01-13T18:26:15.980 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mkH6_D_C_2phqo7 off=11926082 len=397795 2024-01-13T18:26:15.983 INFO:tasks.workunit.client.0.smithi084.stdout:op 1562 completed, throughput=5MB/sec 2024-01-13T18:26:15.983 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AIzA2u9dEovfz-u off=365723 len=457739 2024-01-13T18:26:15.986 INFO:tasks.workunit.client.0.smithi084.stdout:op 1563 completed, throughput=5MB/sec 2024-01-13T18:26:15.986 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KvDWPNxOIUhVs5N off=12776457 len=901048 2024-01-13T18:26:15.990 INFO:tasks.workunit.client.0.smithi084.stdout:op 1564 completed, throughput=5MB/sec 2024-01-13T18:26:16.991 INFO:tasks.workunit.client.0.smithi084.stdout: 307: throughput=4.98MB/sec pending data=0 2024-01-13T18:26:16.991 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mUgtXXyGN93pBKn off=2675974 len=993406 2024-01-13T18:26:16.996 INFO:tasks.workunit.client.0.smithi084.stdout:op 1565 completed, throughput=4.99MB/sec 2024-01-13T18:26:16.996 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VbMlpeh3eHDtZDi off=4916223 len=488982 2024-01-13T18:26:16.997 INFO:tasks.workunit.client.0.smithi084.stdout:op 1566 completed, throughput=4.99MB/sec 2024-01-13T18:26:16.997 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9iBt-acAdmlzl9P off=8949317 len=590041 2024-01-13T18:26:17.001 INFO:tasks.workunit.client.0.smithi084.stdout:op 1567 completed, throughput=4.99MB/sec 2024-01-13T18:26:17.001 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-p3JRsMISI_XbyXP off=1952856 len=1089504 2024-01-13T18:26:17.002 INFO:tasks.workunit.client.0.smithi084.stdout:op 1568 completed, throughput=4.99MB/sec 2024-01-13T18:26:17.002 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2JV2GRKbXfo-2al off=22792957 len=338549 2024-01-13T18:26:17.005 INFO:tasks.workunit.client.0.smithi084.stdout:op 1569 completed, throughput=5MB/sec 2024-01-13T18:26:17.005 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6Zr_Nhy_C2V_9jn off=1020914 len=1138673 2024-01-13T18:26:17.011 INFO:tasks.workunit.client.0.smithi084.stdout:op 1570 completed, throughput=5MB/sec 2024-01-13T18:26:17.011 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FPgCTdmOEo3YvnZ off=3440020 len=2051528 2024-01-13T18:26:17.015 INFO:tasks.workunit.client.0.smithi084.stdout:op 1571 completed, throughput=5MB/sec 2024-01-13T18:26:17.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:17 smithi084 ceph-mon[116404]: pgmap v1634: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:17.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:17 smithi084 ceph-mon[119097]: pgmap v1634: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:17.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:17 smithi099 ceph-mon[138788]: pgmap v1634: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:18.015 INFO:tasks.workunit.client.0.smithi084.stdout: 308: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:18.015 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UwxMCQiQznE3jen off=2769930 len=202613 2024-01-13T18:26:18.016 INFO:tasks.workunit.client.0.smithi084.stdout:op 1572 completed, throughput=4.99MB/sec 2024-01-13T18:26:18.016 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rgqJjAfI2ZP61_0 off=1904809 len=1255316 2024-01-13T18:26:18.018 INFO:tasks.workunit.client.0.smithi084.stdout:op 1573 completed, throughput=4.99MB/sec 2024-01-13T18:26:18.018 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y_9dNLO2ilX-h-x off=7565367 len=123150 2024-01-13T18:26:18.019 INFO:tasks.workunit.client.0.smithi084.stdout:op 1574 completed, throughput=4.99MB/sec 2024-01-13T18:26:18.019 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y1gc0L426c-vkGd off=1115929 len=1627529 2024-01-13T18:26:18.020 INFO:tasks.workunit.client.0.smithi084.stdout:op 1575 completed, throughput=5MB/sec 2024-01-13T18:26:18.021 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DXHN4EsDAp08iwI off=5661123 len=820989 2024-01-13T18:26:18.022 INFO:tasks.workunit.client.0.smithi084.stdout:op 1576 completed, throughput=5MB/sec 2024-01-13T18:26:19.022 INFO:tasks.workunit.client.0.smithi084.stdout: 309: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:19.022 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZJ92Hfp-YurCBXz off=613601 len=292764 2024-01-13T18:26:19.025 INFO:tasks.workunit.client.0.smithi084.stdout:op 1577 completed, throughput=4.99MB/sec 2024-01-13T18:26:19.026 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yNrRcmOnvC-6Fha off=10612390 len=26040 2024-01-13T18:26:19.027 INFO:tasks.workunit.client.0.smithi084.stdout:op 1578 completed, throughput=4.99MB/sec 2024-01-13T18:26:19.028 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0Bv4poQqUiwc7gC off=2824000 len=1959244 2024-01-13T18:26:19.030 INFO:tasks.workunit.client.0.smithi084.stdout:op 1579 completed, throughput=4.99MB/sec 2024-01-13T18:26:19.030 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VrMGqI5gRy3Eno7 off=7108242 len=1862035 2024-01-13T18:26:19.032 INFO:tasks.workunit.client.0.smithi084.stdout:op 1580 completed, throughput=5MB/sec 2024-01-13T18:26:19.032 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-od7-qcGyklUd96c off=18792596 len=1088688 2024-01-13T18:26:19.037 INFO:tasks.workunit.client.0.smithi084.stdout:op 1581 completed, throughput=5MB/sec 2024-01-13T18:26:19.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:19 smithi099 ceph-mon[138788]: pgmap v1635: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:26:19.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:19 smithi084 ceph-mon[116404]: pgmap v1635: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:26:19.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:19 smithi084 ceph-mon[119097]: pgmap v1635: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:26:20.037 INFO:tasks.workunit.client.0.smithi084.stdout: 310: throughput=4.98MB/sec pending data=0 2024-01-13T18:26:20.037 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jGWpqbKjg3iSK2A off=2237612 len=1383455 2024-01-13T18:26:20.046 INFO:tasks.workunit.client.0.smithi084.stdout:op 1582 completed, throughput=4.99MB/sec 2024-01-13T18:26:20.047 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_JnRF7ulgZFxpil off=16624027 len=610534 2024-01-13T18:26:20.047 INFO:tasks.workunit.client.0.smithi084.stdout:op 1583 completed, throughput=4.99MB/sec 2024-01-13T18:26:20.048 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cl0g1gIcenuLCdC off=21669912 len=1256660 2024-01-13T18:26:20.053 INFO:tasks.workunit.client.0.smithi084.stdout:op 1584 completed, throughput=4.99MB/sec 2024-01-13T18:26:20.053 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6Slo6L-88IAkxuB off=2559994 len=1836995 2024-01-13T18:26:20.055 INFO:tasks.workunit.client.0.smithi084.stdout:op 1585 completed, throughput=5MB/sec 2024-01-13T18:26:20.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:20.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:26:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:26:20] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:26:21.055 INFO:tasks.workunit.client.0.smithi084.stdout: 311: throughput=4.98MB/sec pending data=0 2024-01-13T18:26:21.056 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mZvKLDsGfbmoz1s off=4365581 len=1471837 2024-01-13T18:26:21.057 INFO:tasks.workunit.client.0.smithi084.stdout:op 1586 completed, throughput=4.99MB/sec 2024-01-13T18:26:21.057 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MOdHhZtXJRGJWD5 off=18714059 len=1604792 2024-01-13T18:26:21.061 INFO:tasks.workunit.client.0.smithi084.stdout:op 1587 completed, throughput=4.99MB/sec 2024-01-13T18:26:21.061 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6em9O7r9Ihp3Zag off=5287519 len=1473404 2024-01-13T18:26:21.063 INFO:tasks.workunit.client.0.smithi084.stdout:op 1588 completed, throughput=5MB/sec 2024-01-13T18:26:21.063 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RIwlMaH4w2P8QKe off=8851784 len=1388036 2024-01-13T18:26:21.071 INFO:tasks.workunit.client.0.smithi084.stdout:op 1589 completed, throughput=5MB/sec 2024-01-13T18:26:21.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:21 smithi099 ceph-mon[138788]: pgmap v1636: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 6 op/s 2024-01-13T18:26:21.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:21 smithi084 ceph-mon[116404]: pgmap v1636: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 6 op/s 2024-01-13T18:26:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:21 smithi084 ceph-mon[119097]: pgmap v1636: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 6 op/s 2024-01-13T18:26:22.071 INFO:tasks.workunit.client.0.smithi084.stdout: 312: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:22.071 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PBTQmItDYs1bbaq off=18171130 len=1668783 2024-01-13T18:26:22.073 INFO:tasks.workunit.client.0.smithi084.stdout:op 1590 completed, throughput=4.99MB/sec 2024-01-13T18:26:22.073 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L3vEV8_PJ4TFrEn off=2237767 len=1878459 2024-01-13T18:26:22.075 INFO:tasks.workunit.client.0.smithi084.stdout:op 1591 completed, throughput=5MB/sec 2024-01-13T18:26:22.075 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NqRvE0Wfi1s7iBl off=6747878 len=203582 2024-01-13T18:26:22.076 INFO:tasks.workunit.client.0.smithi084.stdout:op 1592 completed, throughput=5MB/sec 2024-01-13T18:26:22.076 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RM55BKS9pfVd6m9 off=4575853 len=337856 2024-01-13T18:26:22.077 INFO:tasks.workunit.client.0.smithi084.stdout:op 1593 completed, throughput=5MB/sec 2024-01-13T18:26:22.077 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NnRl9_OAtCbf0Gj off=1043967 len=239107 2024-01-13T18:26:22.078 INFO:tasks.workunit.client.0.smithi084.stdout:op 1594 completed, throughput=5MB/sec 2024-01-13T18:26:22.078 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QLz7WByMaOTMqAK off=4355934 len=1520229 2024-01-13T18:26:22.084 INFO:tasks.workunit.client.0.smithi084.stdout:op 1595 completed, throughput=5MB/sec 2024-01-13T18:26:23.085 INFO:tasks.workunit.client.0.smithi084.stdout: 313: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:23.085 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aQBNo5a131uq--L off=15625117 len=224334 2024-01-13T18:26:23.088 INFO:tasks.workunit.client.0.smithi084.stdout:op 1596 completed, throughput=4.99MB/sec 2024-01-13T18:26:23.088 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9ftBXHsLuz-dzOK off=17947104 len=89980 2024-01-13T18:26:23.089 INFO:tasks.workunit.client.0.smithi084.stdout:op 1597 completed, throughput=4.99MB/sec 2024-01-13T18:26:23.089 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-naAYgYN8EQUTcsX off=1104225 len=1162563 2024-01-13T18:26:23.090 INFO:tasks.workunit.client.0.smithi084.stdout:op 1598 completed, throughput=4.99MB/sec 2024-01-13T18:26:23.090 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GrF0rlzpg6HaBab off=2573982 len=581202 2024-01-13T18:26:23.091 INFO:tasks.workunit.client.0.smithi084.stdout:op 1599 completed, throughput=4.99MB/sec 2024-01-13T18:26:23.091 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ucdT_SkIkg0Qxa- off=8664842 len=732775 2024-01-13T18:26:23.092 INFO:tasks.workunit.client.0.smithi084.stdout:op 1600 completed, throughput=5MB/sec 2024-01-13T18:26:23.092 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GDosDCMQz0t38jL off=8835935 len=1602993 2024-01-13T18:26:23.098 INFO:tasks.workunit.client.0.smithi084.stdout:op 1601 completed, throughput=5MB/sec 2024-01-13T18:26:23.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[116404]: pgmap v1637: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:26:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:26:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:26:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:26:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[119097]: pgmap v1637: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:26:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:26:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:26:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:26:23.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:23 smithi099 ceph-mon[138788]: pgmap v1637: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:26:23.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:26:23.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:23.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:26:23.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:26:23.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:26:24.098 INFO:tasks.workunit.client.0.smithi084.stdout: 314: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:24.098 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DgycP7IKS2vl4jM off=12430564 len=614790 2024-01-13T18:26:24.099 INFO:tasks.workunit.client.0.smithi084.stdout:op 1602 completed, throughput=4.99MB/sec 2024-01-13T18:26:24.099 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-53hI7Sv2DkvGR4I off=8462651 len=209510 2024-01-13T18:26:24.100 INFO:tasks.workunit.client.0.smithi084.stdout:op 1603 completed, throughput=4.99MB/sec 2024-01-13T18:26:24.100 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NEzpSh5nFeZ_PD6 off=20221514 len=1362350 2024-01-13T18:26:24.103 INFO:tasks.workunit.client.0.smithi084.stdout:op 1604 completed, throughput=4.99MB/sec 2024-01-13T18:26:24.103 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UmWNn5pVOrulu8h off=1138779 len=1717985 2024-01-13T18:26:24.106 INFO:tasks.workunit.client.0.smithi084.stdout:op 1605 completed, throughput=5MB/sec 2024-01-13T18:26:24.106 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lcfK6NKPWmktyRi off=13212312 len=715737 2024-01-13T18:26:24.107 INFO:tasks.workunit.client.0.smithi084.stdout:op 1606 completed, throughput=5MB/sec 2024-01-13T18:26:24.107 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ln0-5hM0mig4sp- off=9138120 len=1782585 2024-01-13T18:26:24.110 INFO:tasks.workunit.client.0.smithi084.stdout:op 1607 completed, throughput=5MB/sec 2024-01-13T18:26:25.111 INFO:tasks.workunit.client.0.smithi084.stdout: 315: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:25.111 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HVrtyZeOWO1gD3Z off=7993457 len=167559 2024-01-13T18:26:25.111 INFO:tasks.workunit.client.0.smithi084.stdout:op 1608 completed, throughput=4.99MB/sec 2024-01-13T18:26:25.111 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wwKymUDkfk-UHxt off=19365788 len=1256150 2024-01-13T18:26:25.113 INFO:tasks.workunit.client.0.smithi084.stdout:op 1609 completed, throughput=4.99MB/sec 2024-01-13T18:26:25.113 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-toI7ybLVZaBlNIr off=5079441 len=1831989 2024-01-13T18:26:25.116 INFO:tasks.workunit.client.0.smithi084.stdout:op 1610 completed, throughput=5MB/sec 2024-01-13T18:26:25.117 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fXJU9deptuQbSsX off=243546 len=1903024 2024-01-13T18:26:25.124 INFO:tasks.workunit.client.0.smithi084.stdout:op 1611 completed, throughput=5MB/sec 2024-01-13T18:26:25.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:25 smithi084 ceph-mon[116404]: pgmap v1638: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 5 op/s 2024-01-13T18:26:25.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:25 smithi084 ceph-mon[119097]: pgmap v1638: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 5 op/s 2024-01-13T18:26:25.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:25 smithi099 ceph-mon[138788]: pgmap v1638: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 5 op/s 2024-01-13T18:26:26.125 INFO:tasks.workunit.client.0.smithi084.stdout: 316: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:26.125 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rQGe_AmZqNgkMhl off=11476444 len=381160 2024-01-13T18:26:26.125 INFO:tasks.workunit.client.0.smithi084.stdout:op 1612 completed, throughput=4.99MB/sec 2024-01-13T18:26:26.126 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-alEBfYIYuIlwFQb off=6743152 len=581846 2024-01-13T18:26:26.127 INFO:tasks.workunit.client.0.smithi084.stdout:op 1613 completed, throughput=4.99MB/sec 2024-01-13T18:26:26.127 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LJRravSRubWNDNq off=4386527 len=105120 2024-01-13T18:26:26.129 INFO:tasks.workunit.client.0.smithi084.stdout:op 1614 completed, throughput=4.99MB/sec 2024-01-13T18:26:26.130 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-shP20Ec-Lh-5O9h off=13821424 len=868448 2024-01-13T18:26:26.131 INFO:tasks.workunit.client.0.smithi084.stdout:op 1615 completed, throughput=4.99MB/sec 2024-01-13T18:26:26.131 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_-ep52tIgTuTpCR off=7378536 len=1216794 2024-01-13T18:26:26.132 INFO:tasks.workunit.client.0.smithi084.stdout:op 1616 completed, throughput=5MB/sec 2024-01-13T18:26:26.132 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MOTsUjE5G5u30Ax off=9834245 len=471532 2024-01-13T18:26:26.136 INFO:tasks.workunit.client.0.smithi084.stdout:op 1617 completed, throughput=5MB/sec 2024-01-13T18:26:26.136 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nCeoMLCPff8NDLq off=5463658 len=800137 2024-01-13T18:26:26.141 INFO:tasks.workunit.client.0.smithi084.stdout:op 1618 completed, throughput=5MB/sec 2024-01-13T18:26:27.141 INFO:tasks.workunit.client.0.smithi084.stdout: 317: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:27.141 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YhiQHb0cqCJMXN_ off=2582336 len=619942 2024-01-13T18:26:27.145 INFO:tasks.workunit.client.0.smithi084.stdout:op 1619 completed, throughput=4.99MB/sec 2024-01-13T18:26:27.145 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LMTX8a1yqxD-ODw off=3910188 len=782790 2024-01-13T18:26:27.151 INFO:tasks.workunit.client.0.smithi084.stdout:op 1620 completed, throughput=4.99MB/sec 2024-01-13T18:26:27.152 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hBFbhwa7-2r-gyM off=2244983 len=1557790 2024-01-13T18:26:27.158 INFO:tasks.workunit.client.0.smithi084.stdout:op 1621 completed, throughput=4.99MB/sec 2024-01-13T18:26:27.158 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4UoCIVM8c1tKJQQ off=486738 len=1836911 2024-01-13T18:26:27.162 INFO:tasks.workunit.client.0.smithi084.stdout:op 1622 completed, throughput=5MB/sec 2024-01-13T18:26:27.162 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-__7pCqAFf9qhBMp off=2654029 len=1504192 2024-01-13T18:26:27.163 INFO:tasks.workunit.client.0.smithi084.stdout:op 1623 completed, throughput=5MB/sec 2024-01-13T18:26:27.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:27 smithi084 ceph-mon[116404]: pgmap v1639: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:26:27.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:27 smithi084 ceph-mon[119097]: pgmap v1639: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:26:27.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:27 smithi099 ceph-mon[138788]: pgmap v1639: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:26:28.164 INFO:tasks.workunit.client.0.smithi084.stdout: 318: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:28.164 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6Kja63VUWpZvmMU off=10469743 len=432193 2024-01-13T18:26:28.165 INFO:tasks.workunit.client.0.smithi084.stdout:op 1624 completed, throughput=4.99MB/sec 2024-01-13T18:26:28.165 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ulSEFLqXRWJ4DUC off=6505831 len=1528638 2024-01-13T18:26:28.167 INFO:tasks.workunit.client.0.smithi084.stdout:op 1625 completed, throughput=4.99MB/sec 2024-01-13T18:26:28.167 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QdRfKChFVyF7Tv2 off=10713365 len=37640 2024-01-13T18:26:28.167 INFO:tasks.workunit.client.0.smithi084.stdout:op 1626 completed, throughput=4.99MB/sec 2024-01-13T18:26:28.167 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Pr5ODT22spzXpLq off=21357386 len=1386804 2024-01-13T18:26:28.168 INFO:tasks.workunit.client.0.smithi084.stdout:op 1627 completed, throughput=5MB/sec 2024-01-13T18:26:28.169 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lOOi1YW0vzODLvQ off=11825001 len=1134006 2024-01-13T18:26:28.173 INFO:tasks.workunit.client.0.smithi084.stdout:op 1628 completed, throughput=5MB/sec 2024-01-13T18:26:29.174 INFO:tasks.workunit.client.0.smithi084.stdout: 319: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:29.174 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1Q7dEnRrdyYnJ9D off=9619940 len=1998793 2024-01-13T18:26:29.176 INFO:tasks.workunit.client.0.smithi084.stdout:op 1629 completed, throughput=4.99MB/sec 2024-01-13T18:26:29.176 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PCz0PaKaFAp2JEQ off=17113618 len=914768 2024-01-13T18:26:29.181 INFO:tasks.workunit.client.0.smithi084.stdout:op 1630 completed, throughput=4.99MB/sec 2024-01-13T18:26:29.181 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Sn8EzbI0H4aTR6T off=733817 len=262702 2024-01-13T18:26:29.182 INFO:tasks.workunit.client.0.smithi084.stdout:op 1631 completed, throughput=5MB/sec 2024-01-13T18:26:29.182 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vq7tWGXU3tQ4AIr off=18421684 len=960910 2024-01-13T18:26:29.187 INFO:tasks.workunit.client.0.smithi084.stdout:op 1632 completed, throughput=5MB/sec 2024-01-13T18:26:29.187 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OSZ0Pzvl72bLVBi off=275736 len=1840708 2024-01-13T18:26:29.190 INFO:tasks.workunit.client.0.smithi084.stdout:op 1633 completed, throughput=5MB/sec 2024-01-13T18:26:29.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:29 smithi099 ceph-mon[138788]: pgmap v1640: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-01-13T18:26:29.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:29 smithi084 ceph-mon[116404]: pgmap v1640: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-01-13T18:26:29.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:29 smithi084 ceph-mon[119097]: pgmap v1640: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-01-13T18:26:30.190 INFO:tasks.workunit.client.0.smithi084.stdout: 320: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:30.191 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RdnwfEl2cdDi7YW off=226076 len=1879942 2024-01-13T18:26:30.202 INFO:tasks.workunit.client.0.smithi084.stdout:op 1634 completed, throughput=4.99MB/sec 2024-01-13T18:26:30.202 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DKi7SmE9KD6nXVq off=3504264 len=412904 2024-01-13T18:26:30.202 INFO:tasks.workunit.client.0.smithi084.stdout:op 1635 completed, throughput=4.99MB/sec 2024-01-13T18:26:30.202 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-deVUFbjFuO3tUSn off=4809922 len=1193114 2024-01-13T18:26:30.205 INFO:tasks.workunit.client.0.smithi084.stdout:op 1636 completed, throughput=5MB/sec 2024-01-13T18:26:30.205 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-elNrrlgWCWVQUiw off=330448 len=1283751 2024-01-13T18:26:30.213 INFO:tasks.workunit.client.0.smithi084.stdout:op 1637 completed, throughput=5MB/sec 2024-01-13T18:26:30.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:26:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:26:30] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:26:31.213 INFO:tasks.workunit.client.0.smithi084.stdout: 321: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:31.213 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IYUv-zXY9Cx8sW4 off=14991871 len=1996086 2024-01-13T18:26:31.215 INFO:tasks.workunit.client.0.smithi084.stdout:op 1638 completed, throughput=4.99MB/sec 2024-01-13T18:26:31.215 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WLL9LIkOzR6yZx0 off=13313473 len=1873072 2024-01-13T18:26:31.224 INFO:tasks.workunit.client.0.smithi084.stdout:op 1639 completed, throughput=5MB/sec 2024-01-13T18:26:31.224 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1se6IQa6MiWvbLo off=8206787 len=474986 2024-01-13T18:26:31.228 INFO:tasks.workunit.client.0.smithi084.stdout:op 1640 completed, throughput=5MB/sec 2024-01-13T18:26:31.229 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UIKhL0jes6h1r5Z off=17688549 len=984494 2024-01-13T18:26:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:op 1641 completed, throughput=5MB/sec 2024-01-13T18:26:31.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:31 smithi084 ceph-mon[116404]: pgmap v1641: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:26:31.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:31 smithi084 ceph-mon[119097]: pgmap v1641: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:26:31.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:31 smithi099 ceph-mon[138788]: pgmap v1641: 105 pgs: 105 active+clean; 128 GiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:26:32.233 INFO:tasks.workunit.client.0.smithi084.stdout: 322: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:32.233 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bZb1asUY-8kMvaM off=3960643 len=4855 2024-01-13T18:26:32.233 INFO:tasks.workunit.client.0.smithi084.stdout:op 1642 completed, throughput=4.99MB/sec 2024-01-13T18:26:32.234 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-esIQkz6GkqhxVmk off=899375 len=720257 2024-01-13T18:26:32.238 INFO:tasks.workunit.client.0.smithi084.stdout:op 1643 completed, throughput=4.99MB/sec 2024-01-13T18:26:32.238 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_-Ku7TnKwg7tQop off=1485674 len=415302 2024-01-13T18:26:32.239 INFO:tasks.workunit.client.0.smithi084.stdout:op 1644 completed, throughput=4.99MB/sec 2024-01-13T18:26:32.239 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bhCgtCkEaPMXUu6 off=1100031 len=692072 2024-01-13T18:26:32.240 INFO:tasks.workunit.client.0.smithi084.stdout:op 1645 completed, throughput=4.99MB/sec 2024-01-13T18:26:32.240 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oBvDHXSpVIK780o off=11400363 len=508602 2024-01-13T18:26:32.240 INFO:tasks.workunit.client.0.smithi084.stdout:op 1646 completed, throughput=4.99MB/sec 2024-01-13T18:26:32.241 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0WXwoUPDVLLgqVY off=6456440 len=1524244 2024-01-13T18:26:32.249 INFO:tasks.workunit.client.0.smithi084.stdout:op 1647 completed, throughput=5MB/sec 2024-01-13T18:26:32.249 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7-Ty0ALk8udtpxg off=21655970 len=486022 2024-01-13T18:26:32.250 INFO:tasks.workunit.client.0.smithi084.stdout:op 1648 completed, throughput=5MB/sec 2024-01-13T18:26:32.250 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JLumHboGiT4TnRC off=715829 len=6018 2024-01-13T18:26:32.250 INFO:tasks.workunit.client.0.smithi084.stdout:op 1649 completed, throughput=5MB/sec 2024-01-13T18:26:32.250 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PnpqcZRLVq12Ka7 off=1550374 len=1377340 2024-01-13T18:26:32.252 INFO:tasks.workunit.client.0.smithi084.stdout:op 1650 completed, throughput=5MB/sec 2024-01-13T18:26:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: 323: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:33.252 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-t2CYLeM_aEU9lV5 off=7061327 len=1051832 2024-01-13T18:26:33.257 INFO:tasks.workunit.client.0.smithi084.stdout:op 1651 completed, throughput=4.99MB/sec 2024-01-13T18:26:33.257 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0M3cqNNcOujiXyg off=7589277 len=939522 2024-01-13T18:26:33.262 INFO:tasks.workunit.client.0.smithi084.stdout:op 1652 completed, throughput=4.99MB/sec 2024-01-13T18:26:33.263 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2qtk3LWF4tJVfx4 off=669355 len=1122416 2024-01-13T18:26:33.267 INFO:tasks.workunit.client.0.smithi084.stdout:op 1653 completed, throughput=5MB/sec 2024-01-13T18:26:33.268 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wn0KGM60pkxOsa1 off=684057 len=1606129 2024-01-13T18:26:33.272 INFO:tasks.workunit.client.0.smithi084.stdout:op 1654 completed, throughput=5MB/sec 2024-01-13T18:26:33.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:33 smithi084 ceph-mon[116404]: pgmap v1642: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.3 MiB/s wr, 4 op/s 2024-01-13T18:26:33.785 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:33 smithi084 ceph-mon[119097]: pgmap v1642: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.3 MiB/s wr, 4 op/s 2024-01-13T18:26:33.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:33 smithi099 ceph-mon[138788]: pgmap v1642: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.3 MiB/s wr, 4 op/s 2024-01-13T18:26:34.272 INFO:tasks.workunit.client.0.smithi084.stdout: 324: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:34.273 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Jab2nFqIY-oR0EC off=1744040 len=384384 2024-01-13T18:26:34.276 INFO:tasks.workunit.client.0.smithi084.stdout:op 1655 completed, throughput=4.99MB/sec 2024-01-13T18:26:34.276 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gfQVtKtYWPYu6sB off=3915938 len=560688 2024-01-13T18:26:34.277 INFO:tasks.workunit.client.0.smithi084.stdout:op 1656 completed, throughput=4.99MB/sec 2024-01-13T18:26:34.277 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FLz4GE3CBnjUjeA off=3472158 len=1463324 2024-01-13T18:26:34.279 INFO:tasks.workunit.client.0.smithi084.stdout:op 1657 completed, throughput=4.99MB/sec 2024-01-13T18:26:34.279 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9Ju_mjRtgm-mnim off=8365158 len=790708 2024-01-13T18:26:34.284 INFO:tasks.workunit.client.0.smithi084.stdout:op 1658 completed, throughput=4.99MB/sec 2024-01-13T18:26:34.284 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-z9hSHlhBoGFlpqt off=23752966 len=1683660 2024-01-13T18:26:34.291 INFO:tasks.workunit.client.0.smithi084.stdout:op 1659 completed, throughput=5MB/sec 2024-01-13T18:26:34.291 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-52uhCBOi4eyOEKt off=292306 len=1732746 2024-01-13T18:26:34.293 INFO:tasks.workunit.client.0.smithi084.stdout:op 1660 completed, throughput=5MB/sec 2024-01-13T18:26:35.294 INFO:tasks.workunit.client.0.smithi084.stdout: 325: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:35.294 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-z61i7J0_aYbF3XI off=14053846 len=400183 2024-01-13T18:26:35.298 INFO:tasks.workunit.client.0.smithi084.stdout:op 1661 completed, throughput=4.99MB/sec 2024-01-13T18:26:35.298 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AaSyM5uvfdOZcOf off=11316993 len=1186983 2024-01-13T18:26:35.305 INFO:tasks.workunit.client.0.smithi084.stdout:op 1662 completed, throughput=4.99MB/sec 2024-01-13T18:26:35.305 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wvL2lRBZSX4KO0Y off=555611 len=1893417 2024-01-13T18:26:35.307 INFO:tasks.workunit.client.0.smithi084.stdout:op 1663 completed, throughput=5MB/sec 2024-01-13T18:26:35.307 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uwByEsBO9xmVgC- off=10945665 len=210247 2024-01-13T18:26:35.308 INFO:tasks.workunit.client.0.smithi084.stdout:op 1664 completed, throughput=5MB/sec 2024-01-13T18:26:35.308 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S7L2dEIjGLjhcXB off=5417562 len=2039711 2024-01-13T18:26:35.317 INFO:tasks.workunit.client.0.smithi084.stdout:op 1665 completed, throughput=5.01MB/sec 2024-01-13T18:26:35.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:35 smithi084 ceph-mon[116404]: pgmap v1643: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.8 MiB/s wr, 5 op/s 2024-01-13T18:26:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:35 smithi084 ceph-mon[119097]: pgmap v1643: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.8 MiB/s wr, 5 op/s 2024-01-13T18:26:35.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:35.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:35 smithi099 ceph-mon[138788]: pgmap v1643: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.8 MiB/s wr, 5 op/s 2024-01-13T18:26:35.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:36.317 INFO:tasks.workunit.client.0.smithi084.stdout: 326: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:36.317 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jk5WfngO4e9jsXE off=5485132 len=1375309 2024-01-13T18:26:36.320 INFO:tasks.workunit.client.0.smithi084.stdout:op 1666 completed, throughput=4.99MB/sec 2024-01-13T18:26:36.321 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f7IRq3JlRRZHA6h off=22763788 len=149371 2024-01-13T18:26:36.322 INFO:tasks.workunit.client.0.smithi084.stdout:op 1667 completed, throughput=4.99MB/sec 2024-01-13T18:26:36.322 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--YTHsUkwEoWxQIo off=396402 len=2421 2024-01-13T18:26:36.324 INFO:tasks.workunit.client.0.smithi084.stdout:op 1668 completed, throughput=4.99MB/sec 2024-01-13T18:26:36.324 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-48YFQzvbohlyecA off=10409219 len=743392 2024-01-13T18:26:36.325 INFO:tasks.workunit.client.0.smithi084.stdout:op 1669 completed, throughput=5MB/sec 2024-01-13T18:26:36.325 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N0wkqc0WLLCIY77 off=3691979 len=2088413 2024-01-13T18:26:36.328 INFO:tasks.workunit.client.0.smithi084.stdout:op 1670 completed, throughput=5MB/sec 2024-01-13T18:26:37.328 INFO:tasks.workunit.client.0.smithi084.stdout: 327: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:37.329 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HV4ycjsKhy9wBrm off=7238567 len=1595730 2024-01-13T18:26:37.330 INFO:tasks.workunit.client.0.smithi084.stdout:op 1671 completed, throughput=4.99MB/sec 2024-01-13T18:26:37.330 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mnrE8w-6P72o24b off=10191976 len=844649 2024-01-13T18:26:37.331 INFO:tasks.workunit.client.0.smithi084.stdout:op 1672 completed, throughput=4.99MB/sec 2024-01-13T18:26:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6_yrm_NNPdEVP8c off=4042925 len=945406 2024-01-13T18:26:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:op 1673 completed, throughput=5MB/sec 2024-01-13T18:26:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BLvbqWu19er0tyP off=7874019 len=598517 2024-01-13T18:26:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:op 1674 completed, throughput=5MB/sec 2024-01-13T18:26:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2fSIq30dQ_PU-2K off=429703 len=888454 2024-01-13T18:26:37.339 INFO:tasks.workunit.client.0.smithi084.stdout:op 1675 completed, throughput=5MB/sec 2024-01-13T18:26:37.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:37 smithi084 ceph-mon[116404]: pgmap v1644: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:26:37.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:37 smithi084 ceph-mon[119097]: pgmap v1644: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:26:37.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:37 smithi099 ceph-mon[138788]: pgmap v1644: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:26:38.340 INFO:tasks.workunit.client.0.smithi084.stdout: 328: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:38.340 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1LDs1VX32Ix9wLT off=2375754 len=2056853 2024-01-13T18:26:38.348 INFO:tasks.workunit.client.0.smithi084.stdout:op 1676 completed, throughput=4.99MB/sec 2024-01-13T18:26:38.348 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xGtDiFqWc1q0Gzg off=925467 len=1957320 2024-01-13T18:26:38.357 INFO:tasks.workunit.client.0.smithi084.stdout:op 1677 completed, throughput=5MB/sec 2024-01-13T18:26:38.357 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MevqX2VwwGZPr1k off=3387239 len=366063 2024-01-13T18:26:38.359 INFO:tasks.workunit.client.0.smithi084.stdout:op 1678 completed, throughput=5MB/sec 2024-01-13T18:26:38.360 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NUt90H0e3JlslPs off=653611 len=757974 2024-01-13T18:26:38.364 INFO:tasks.workunit.client.0.smithi084.stdout:op 1679 completed, throughput=5MB/sec 2024-01-13T18:26:39.364 INFO:tasks.workunit.client.0.smithi084.stdout: 329: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:39.365 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Y0wsKI1I1ct4a4U off=539624 len=770539 2024-01-13T18:26:39.369 INFO:tasks.workunit.client.0.smithi084.stdout:op 1680 completed, throughput=4.99MB/sec 2024-01-13T18:26:39.369 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EwrjmMewCjlfUkJ off=3907593 len=183154 2024-01-13T18:26:39.372 INFO:tasks.workunit.client.0.smithi084.stdout:op 1681 completed, throughput=4.99MB/sec 2024-01-13T18:26:39.372 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6CRaWd4FnloECXR off=16115533 len=1670650 2024-01-13T18:26:39.373 INFO:tasks.workunit.client.0.smithi084.stdout:op 1682 completed, throughput=4.99MB/sec 2024-01-13T18:26:39.374 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-K5MH52pLFPHmJi3 off=4724786 len=965311 2024-01-13T18:26:39.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 1683 completed, throughput=5MB/sec 2024-01-13T18:26:39.376 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KXlcrCZ3KqngqMy off=4356416 len=949742 2024-01-13T18:26:39.378 INFO:tasks.workunit.client.0.smithi084.stdout:op 1684 completed, throughput=5MB/sec 2024-01-13T18:26:39.378 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tAl_o-uSqkQQq_n off=1594317 len=268940 2024-01-13T18:26:39.378 INFO:tasks.workunit.client.0.smithi084.stdout:op 1685 completed, throughput=5MB/sec 2024-01-13T18:26:39.379 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Vn3rBECIgn92gkd off=0 len=1629674 2024-01-13T18:26:39.387 INFO:tasks.workunit.client.0.smithi084.stdout:op 1686 completed, throughput=5MB/sec 2024-01-13T18:26:39.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:39 smithi099 ceph-mon[138788]: pgmap v1645: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:26:39.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:39 smithi084 ceph-mon[116404]: pgmap v1645: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:26:39.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:39 smithi084 ceph-mon[119097]: pgmap v1645: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:26:40.387 INFO:tasks.workunit.client.0.smithi084.stdout: 330: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:40.387 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8P04bEw7_ZBec4s off=4098671 len=564957 2024-01-13T18:26:40.391 INFO:tasks.workunit.client.0.smithi084.stdout:op 1687 completed, throughput=4.99MB/sec 2024-01-13T18:26:40.391 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k-T5iyRtMMJJ9I0 off=2579582 len=1419167 2024-01-13T18:26:40.398 INFO:tasks.workunit.client.0.smithi084.stdout:op 1688 completed, throughput=4.99MB/sec 2024-01-13T18:26:40.398 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MWHa50fo0rjUWf- off=7933464 len=1221272 2024-01-13T18:26:40.403 INFO:tasks.workunit.client.0.smithi084.stdout:op 1689 completed, throughput=5MB/sec 2024-01-13T18:26:40.403 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4kSlpVxo-lk3K32 off=4640789 len=817973 2024-01-13T18:26:40.404 INFO:tasks.workunit.client.0.smithi084.stdout:op 1690 completed, throughput=5MB/sec 2024-01-13T18:26:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:26:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:26:40] "GET /metrics HTTP/1.1" 200 33980 "" "Prometheus/2.43.0" 2024-01-13T18:26:41.404 INFO:tasks.workunit.client.0.smithi084.stdout: 331: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:41.404 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-amp29mQ89NOhZal off=16505216 len=512200 2024-01-13T18:26:41.405 INFO:tasks.workunit.client.0.smithi084.stdout:op 1691 completed, throughput=4.99MB/sec 2024-01-13T18:26:41.405 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--GVN8pYfsibUnnD off=5121953 len=461626 2024-01-13T18:26:41.406 INFO:tasks.workunit.client.0.smithi084.stdout:op 1692 completed, throughput=4.99MB/sec 2024-01-13T18:26:41.406 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k8wfi0ft8ING0zS off=17811055 len=1330261 2024-01-13T18:26:41.409 INFO:tasks.workunit.client.0.smithi084.stdout:op 1693 completed, throughput=4.99MB/sec 2024-01-13T18:26:41.409 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AyseinoP8vFXgsc off=3610390 len=1058105 2024-01-13T18:26:41.410 INFO:tasks.workunit.client.0.smithi084.stdout:op 1694 completed, throughput=4.99MB/sec 2024-01-13T18:26:41.410 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-q8sGCu0YSJrSJta off=6362477 len=1068675 2024-01-13T18:26:41.416 INFO:tasks.workunit.client.0.smithi084.stdout:op 1695 completed, throughput=5MB/sec 2024-01-13T18:26:41.416 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ceAWgkiLXlfW_aC off=1366025 len=1472175 2024-01-13T18:26:41.417 INFO:tasks.workunit.client.0.smithi084.stdout:op 1696 completed, throughput=5MB/sec 2024-01-13T18:26:41.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:41 smithi084 ceph-mon[116404]: pgmap v1646: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:41.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:41 smithi084 ceph-mon[119097]: pgmap v1646: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:41.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:41 smithi099 ceph-mon[138788]: pgmap v1646: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:42.418 INFO:tasks.workunit.client.0.smithi084.stdout: 332: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:42.418 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xO2p1NjbJRbn_VQ off=24132553 len=217888 2024-01-13T18:26:42.421 INFO:tasks.workunit.client.0.smithi084.stdout:op 1697 completed, throughput=4.99MB/sec 2024-01-13T18:26:42.421 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kIikC1NQLAqTCeL off=3467404 len=1410838 2024-01-13T18:26:42.428 INFO:tasks.workunit.client.0.smithi084.stdout:op 1698 completed, throughput=4.99MB/sec 2024-01-13T18:26:42.428 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PKG3UBtLxw2kVD0 off=4170997 len=1145774 2024-01-13T18:26:42.433 INFO:tasks.workunit.client.0.smithi084.stdout:op 1699 completed, throughput=4.99MB/sec 2024-01-13T18:26:42.434 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lJy3tC_WIkPLVrP off=18405828 len=1840973 2024-01-13T18:26:42.436 INFO:tasks.workunit.client.0.smithi084.stdout:op 1700 completed, throughput=5MB/sec 2024-01-13T18:26:42.436 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-b_sA9cGcPgwek-0 off=4175300 len=584948 2024-01-13T18:26:42.437 INFO:tasks.workunit.client.0.smithi084.stdout:op 1701 completed, throughput=5MB/sec 2024-01-13T18:26:43.438 INFO:tasks.workunit.client.0.smithi084.stdout: 333: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:43.438 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VXJ5e51HVOaVFNq off=5999002 len=1192709 2024-01-13T18:26:43.443 INFO:tasks.workunit.client.0.smithi084.stdout:op 1702 completed, throughput=4.99MB/sec 2024-01-13T18:26:43.443 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DPxsO_1QpIQjeqw off=10542034 len=748290 2024-01-13T18:26:43.446 INFO:tasks.workunit.client.0.smithi084.stdout:op 1703 completed, throughput=4.99MB/sec 2024-01-13T18:26:43.446 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ulOXoYHQKsBSewU off=1221885 len=2091287 2024-01-13T18:26:43.455 INFO:tasks.workunit.client.0.smithi084.stdout:op 1704 completed, throughput=5MB/sec 2024-01-13T18:26:43.455 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZxfjRGbwglkwQzQ off=16159735 len=267799 2024-01-13T18:26:43.459 INFO:tasks.workunit.client.0.smithi084.stdout:op 1705 completed, throughput=5MB/sec 2024-01-13T18:26:43.459 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-reAYaggPldWUZc- off=792953 len=586126 2024-01-13T18:26:43.460 INFO:tasks.workunit.client.0.smithi084.stdout:op 1706 completed, throughput=5MB/sec 2024-01-13T18:26:43.460 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xbWFaKu8hOTTQpY off=1097900 len=772302 2024-01-13T18:26:43.460 INFO:tasks.workunit.client.0.smithi084.stdout:op 1707 completed, throughput=5MB/sec 2024-01-13T18:26:43.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:43 smithi084 ceph-mon[116404]: pgmap v1647: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:26:43.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:43 smithi084 ceph-mon[119097]: pgmap v1647: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:26:43.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:43 smithi099 ceph-mon[138788]: pgmap v1647: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:26:44.461 INFO:tasks.workunit.client.0.smithi084.stdout: 334: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:44.461 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7rMQPoqhd3N2uLx off=10449617 len=10688 2024-01-13T18:26:44.463 INFO:tasks.workunit.client.0.smithi084.stdout:op 1708 completed, throughput=4.99MB/sec 2024-01-13T18:26:44.463 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZF9M_er1V-fhCPm off=1294619 len=2066637 2024-01-13T18:26:44.465 INFO:tasks.workunit.client.0.smithi084.stdout:op 1709 completed, throughput=4.99MB/sec 2024-01-13T18:26:44.465 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-08bbkitVIwdfQCT off=723802 len=1917754 2024-01-13T18:26:44.478 INFO:tasks.workunit.client.0.smithi084.stdout:op 1710 completed, throughput=5MB/sec 2024-01-13T18:26:44.478 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EhegG4US3PfhhoE off=16597082 len=693530 2024-01-13T18:26:44.482 INFO:tasks.workunit.client.0.smithi084.stdout:op 1711 completed, throughput=5MB/sec 2024-01-13T18:26:45.482 INFO:tasks.workunit.client.0.smithi084.stdout: 335: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:45.483 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1eCDN8437bPgWiY off=4975552 len=1440747 2024-01-13T18:26:45.490 INFO:tasks.workunit.client.0.smithi084.stdout:op 1712 completed, throughput=4.99MB/sec 2024-01-13T18:26:45.490 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rK-CtiqLteF4Q_s off=2719710 len=1213849 2024-01-13T18:26:45.491 INFO:tasks.workunit.client.0.smithi084.stdout:op 1713 completed, throughput=4.99MB/sec 2024-01-13T18:26:45.491 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uZiDRIqrbc--uN9 off=12562552 len=1651941 2024-01-13T18:26:45.501 INFO:tasks.workunit.client.0.smithi084.stdout:op 1714 completed, throughput=5MB/sec 2024-01-13T18:26:45.501 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-q1VJnm6XNd3NrMo off=11378058 len=1775340 2024-01-13T18:26:45.511 INFO:tasks.workunit.client.0.smithi084.stdout:op 1715 completed, throughput=5MB/sec 2024-01-13T18:26:45.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:45 smithi084 ceph-mon[116404]: pgmap v1648: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:26:45.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:45 smithi084 ceph-mon[119097]: pgmap v1648: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:26:45.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:45 smithi099 ceph-mon[138788]: pgmap v1648: 105 pgs: 105 active+clean; 128 GiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:26:46.512 INFO:tasks.workunit.client.0.smithi084.stdout: 336: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:46.512 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sq_jlU63IFixDck off=2177517 len=301398 2024-01-13T18:26:46.515 INFO:tasks.workunit.client.0.smithi084.stdout:op 1716 completed, throughput=4.99MB/sec 2024-01-13T18:26:46.515 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MIuca0A8uNW3rWd off=10059005 len=1580530 2024-01-13T18:26:46.518 INFO:tasks.workunit.client.0.smithi084.stdout:op 1717 completed, throughput=4.99MB/sec 2024-01-13T18:26:46.518 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AZCq5qHXNMgZoNs off=13560375 len=1146210 2024-01-13T18:26:46.519 INFO:tasks.workunit.client.0.smithi084.stdout:op 1718 completed, throughput=5MB/sec 2024-01-13T18:26:46.520 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HXsrxlLWcVIiDCD off=11519860 len=1128616 2024-01-13T18:26:46.522 INFO:tasks.workunit.client.0.smithi084.stdout:op 1719 completed, throughput=5MB/sec 2024-01-13T18:26:46.522 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IJmSTigpgo_VC2Y off=2031973 len=1469281 2024-01-13T18:26:46.530 INFO:tasks.workunit.client.0.smithi084.stdout:op 1720 completed, throughput=5MB/sec 2024-01-13T18:26:47.530 INFO:tasks.workunit.client.0.smithi084.stdout: 337: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:47.530 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-htLRiIBSG5jSppr off=10698430 len=1299149 2024-01-13T18:26:47.536 INFO:tasks.workunit.client.0.smithi084.stdout:op 1721 completed, throughput=4.99MB/sec 2024-01-13T18:26:47.537 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-huabwkAmnyYn_bg off=5687696 len=1116446 2024-01-13T18:26:47.538 INFO:tasks.workunit.client.0.smithi084.stdout:op 1722 completed, throughput=4.99MB/sec 2024-01-13T18:26:47.538 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_1L3WBiAwDGq32k off=319980 len=307861 2024-01-13T18:26:47.538 INFO:tasks.workunit.client.0.smithi084.stdout:op 1723 completed, throughput=5MB/sec 2024-01-13T18:26:47.538 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LMTX8a1yqxD-ODw off=9893999 len=1178506 2024-01-13T18:26:47.539 INFO:tasks.workunit.client.0.smithi084.stdout:op 1724 completed, throughput=5MB/sec 2024-01-13T18:26:47.539 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oy_ihu5A6rOKdLY off=9240220 len=61095 2024-01-13T18:26:47.540 INFO:tasks.workunit.client.0.smithi084.stdout:op 1725 completed, throughput=5MB/sec 2024-01-13T18:26:47.540 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h2jLWrUJhA6DaTr off=2294651 len=947735 2024-01-13T18:26:47.544 INFO:tasks.workunit.client.0.smithi084.stdout:op 1726 completed, throughput=5MB/sec 2024-01-13T18:26:47.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:47 smithi084 ceph-mon[116404]: pgmap v1649: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:26:47.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:47 smithi084 ceph-mon[119097]: pgmap v1649: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:26:47.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:47 smithi099 ceph-mon[138788]: pgmap v1649: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:26:48.545 INFO:tasks.workunit.client.0.smithi084.stdout: 338: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:48.545 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xJDHzjnbluNuEzk off=14441081 len=475882 2024-01-13T18:26:48.548 INFO:tasks.workunit.client.0.smithi084.stdout:op 1727 completed, throughput=4.99MB/sec 2024-01-13T18:26:48.548 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U2sOQ3QDZ6JJvnE off=429815 len=813669 2024-01-13T18:26:48.549 INFO:tasks.workunit.client.0.smithi084.stdout:op 1728 completed, throughput=4.99MB/sec 2024-01-13T18:26:48.550 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pDnAMYo6lVWGD6V off=4762150 len=1575318 2024-01-13T18:26:48.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 1729 completed, throughput=4.99MB/sec 2024-01-13T18:26:48.559 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DUNfc2_xKK5yIyG off=7592726 len=804844 2024-01-13T18:26:48.563 INFO:tasks.workunit.client.0.smithi084.stdout:op 1730 completed, throughput=5MB/sec 2024-01-13T18:26:48.563 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VXxGhTAkiVCZJhv off=2438621 len=1869813 2024-01-13T18:26:48.565 INFO:tasks.workunit.client.0.smithi084.stdout:op 1731 completed, throughput=5MB/sec 2024-01-13T18:26:49.565 INFO:tasks.workunit.client.0.smithi084.stdout: 339: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:49.565 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SRs7pperLDzrgM2 off=88211 len=1444462 2024-01-13T18:26:49.574 INFO:tasks.workunit.client.0.smithi084.stdout:op 1732 completed, throughput=4.99MB/sec 2024-01-13T18:26:49.574 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RIXuMssZd4fw5YK off=10427255 len=2090242 2024-01-13T18:26:49.582 INFO:tasks.workunit.client.0.smithi084.stdout:op 1733 completed, throughput=5MB/sec 2024-01-13T18:26:49.582 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-A0un52rukl4DPel off=15786857 len=929577 2024-01-13T18:26:49.587 INFO:tasks.workunit.client.0.smithi084.stdout:op 1734 completed, throughput=5MB/sec 2024-01-13T18:26:49.588 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G3d1E4-ryYV5gPy off=21052689 len=1511953 2024-01-13T18:26:49.593 INFO:tasks.workunit.client.0.smithi084.stdout:op 1735 completed, throughput=5MB/sec 2024-01-13T18:26:49.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:49 smithi099 ceph-mon[138788]: pgmap v1650: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:49.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:49 smithi084 ceph-mon[116404]: pgmap v1650: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:49 smithi084 ceph-mon[119097]: pgmap v1650: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:26:50.593 INFO:tasks.workunit.client.0.smithi084.stdout: 340: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:50.593 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FFATVv6-c3Xp_0Z off=1903305 len=977439 2024-01-13T18:26:50.595 INFO:tasks.workunit.client.0.smithi084.stdout:op 1736 completed, throughput=4.99MB/sec 2024-01-13T18:26:50.595 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HybECrcxyBvRJoc off=6765848 len=1619061 2024-01-13T18:26:50.604 INFO:tasks.workunit.client.0.smithi084.stdout:op 1737 completed, throughput=5MB/sec 2024-01-13T18:26:50.604 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8v7zb4ouvu_wZ3E off=12719931 len=1292077 2024-01-13T18:26:50.606 INFO:tasks.workunit.client.0.smithi084.stdout:op 1738 completed, throughput=5MB/sec 2024-01-13T18:26:50.606 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-URO2Uzf-6gi30xf off=8436534 len=1305500 2024-01-13T18:26:50.607 INFO:tasks.workunit.client.0.smithi084.stdout:op 1739 completed, throughput=5MB/sec 2024-01-13T18:26:50.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:50.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:26:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:26:50] "GET /metrics HTTP/1.1" 200 33976 "" "Prometheus/2.43.0" 2024-01-13T18:26:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:26:51.608 INFO:tasks.workunit.client.0.smithi084.stdout: 341: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:51.608 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MWqwcj3f7ckjDDD off=2215703 len=1536836 2024-01-13T18:26:51.610 INFO:tasks.workunit.client.0.smithi084.stdout:op 1740 completed, throughput=4.99MB/sec 2024-01-13T18:26:51.610 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-npIaCqp9oFatBRq off=6413773 len=1865871 2024-01-13T18:26:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:51 smithi099 ceph-mon[138788]: pgmap v1651: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:26:51.621 INFO:tasks.workunit.client.0.smithi084.stdout:op 1741 completed, throughput=5MB/sec 2024-01-13T18:26:51.621 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hqAtjmxUtVy_1U6 off=2795035 len=2027696 2024-01-13T18:26:51.623 INFO:tasks.workunit.client.0.smithi084.stdout:op 1742 completed, throughput=5MB/sec 2024-01-13T18:26:51.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:51 smithi084 ceph-mon[116404]: pgmap v1651: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:26:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:51 smithi084 ceph-mon[119097]: pgmap v1651: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:26:52.623 INFO:tasks.workunit.client.0.smithi084.stdout: 342: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:52.624 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-b1AYsA3QxWLrnPE off=17732852 len=1575963 2024-01-13T18:26:52.630 INFO:tasks.workunit.client.0.smithi084.stdout:op 1743 completed, throughput=4.99MB/sec 2024-01-13T18:26:52.630 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iXMNnpEHpZuBkq5 off=5752924 len=1261448 2024-01-13T18:26:52.638 INFO:tasks.workunit.client.0.smithi084.stdout:op 1744 completed, throughput=5MB/sec 2024-01-13T18:26:52.638 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uVeZy-dMb4B_JXm off=14966441 len=940690 2024-01-13T18:26:52.643 INFO:tasks.workunit.client.0.smithi084.stdout:op 1745 completed, throughput=5MB/sec 2024-01-13T18:26:52.643 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U356Zxzomjs0w8C off=17860865 len=1391146 2024-01-13T18:26:52.645 INFO:tasks.workunit.client.0.smithi084.stdout:op 1746 completed, throughput=5MB/sec 2024-01-13T18:26:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: 343: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:53.645 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vUTmjxJrqQAQvfp off=2561929 len=1242274 2024-01-13T18:26:53.653 INFO:tasks.workunit.client.0.smithi084.stdout:op 1747 completed, throughput=4.99MB/sec 2024-01-13T18:26:53.653 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yYFkZ98R3_rPwBb off=5559633 len=548835 2024-01-13T18:26:53.656 INFO:tasks.workunit.client.0.smithi084.stdout:op 1748 completed, throughput=4.99MB/sec 2024-01-13T18:26:53.656 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-02W58nkbBUQTZvi off=21391985 len=1404519 2024-01-13T18:26:53.664 INFO:tasks.workunit.client.0.smithi084.stdout:op 1749 completed, throughput=5MB/sec 2024-01-13T18:26:53.664 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bL3Av07k9aZFjWI off=2364204 len=1455002 2024-01-13T18:26:53.673 INFO:tasks.workunit.client.0.smithi084.stdout:op 1750 completed, throughput=5MB/sec 2024-01-13T18:26:53.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:53 smithi084 ceph-mon[116404]: pgmap v1652: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:26:53.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:53 smithi084 ceph-mon[119097]: pgmap v1652: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:26:53.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:53 smithi099 ceph-mon[138788]: pgmap v1652: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:26:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: 344: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:54.673 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qSPNnfyEaIF7oie off=584399 len=1199653 2024-01-13T18:26:54.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 1751 completed, throughput=4.99MB/sec 2024-01-13T18:26:54.679 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Xhh6Fy39_BBkqwP off=1833632 len=189534 2024-01-13T18:26:54.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 1752 completed, throughput=4.99MB/sec 2024-01-13T18:26:54.679 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aKerVzkCDgJNHgH off=5080008 len=2041572 2024-01-13T18:26:54.681 INFO:tasks.workunit.client.0.smithi084.stdout:op 1753 completed, throughput=5MB/sec 2024-01-13T18:26:54.681 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6wwFzk6xm-wVd6t off=2529318 len=1136801 2024-01-13T18:26:54.687 INFO:tasks.workunit.client.0.smithi084.stdout:op 1754 completed, throughput=5MB/sec 2024-01-13T18:26:54.687 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JgGYUo9IKVHnldp off=1333979 len=1160206 2024-01-13T18:26:54.689 INFO:tasks.workunit.client.0.smithi084.stdout:op 1755 completed, throughput=5MB/sec 2024-01-13T18:26:55.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:55 smithi084 ceph-mon[116404]: pgmap v1653: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:26:55.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:55 smithi084 ceph-mon[119097]: pgmap v1653: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:26:55.690 INFO:tasks.workunit.client.0.smithi084.stdout: 345: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:55.690 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZTbBgef3rm0Nbsq off=3623704 len=967455 2024-01-13T18:26:55.691 INFO:tasks.workunit.client.0.smithi084.stdout:op 1756 completed, throughput=4.99MB/sec 2024-01-13T18:26:55.691 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GFSBF1D6WbDR-6j off=17961154 len=1835139 2024-01-13T18:26:55.694 INFO:tasks.workunit.client.0.smithi084.stdout:op 1757 completed, throughput=5MB/sec 2024-01-13T18:26:55.694 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-O7P8J055tiWBUQi off=7475274 len=1956851 2024-01-13T18:26:55.702 INFO:tasks.workunit.client.0.smithi084.stdout:op 1758 completed, throughput=5MB/sec 2024-01-13T18:26:55.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:55 smithi099 ceph-mon[138788]: pgmap v1653: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:26:56.702 INFO:tasks.workunit.client.0.smithi084.stdout: 346: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:56.703 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-X7LzPSFDKMpLssC off=10364050 len=1361694 2024-01-13T18:26:56.704 INFO:tasks.workunit.client.0.smithi084.stdout:op 1759 completed, throughput=4.99MB/sec 2024-01-13T18:26:56.704 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hHsAqFU27lPoCez off=2689164 len=1248680 2024-01-13T18:26:56.706 INFO:tasks.workunit.client.0.smithi084.stdout:op 1760 completed, throughput=4.99MB/sec 2024-01-13T18:26:56.706 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ie6BwwuLJsCi7iE off=1031344 len=865642 2024-01-13T18:26:56.710 INFO:tasks.workunit.client.0.smithi084.stdout:op 1761 completed, throughput=5MB/sec 2024-01-13T18:26:56.710 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j1Batzq6W0NHWMI off=1777427 len=658408 2024-01-13T18:26:56.715 INFO:tasks.workunit.client.0.smithi084.stdout:op 1762 completed, throughput=5MB/sec 2024-01-13T18:26:56.715 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Gihcf9eMg0W3LQW off=6667421 len=473231 2024-01-13T18:26:56.716 INFO:tasks.workunit.client.0.smithi084.stdout:op 1763 completed, throughput=5MB/sec 2024-01-13T18:26:56.716 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jtSr8v6IdW7Sg3v off=4795358 len=1627419 2024-01-13T18:26:56.723 INFO:tasks.workunit.client.0.smithi084.stdout:op 1764 completed, throughput=5MB/sec 2024-01-13T18:26:57.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:57 smithi084 ceph-mon[116404]: pgmap v1654: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:26:57.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:57 smithi084 ceph-mon[119097]: pgmap v1654: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:26:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: 347: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:57.723 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kNnTzp9vpTN7pC3 off=8787824 len=1884283 2024-01-13T18:26:57.725 INFO:tasks.workunit.client.0.smithi084.stdout:op 1765 completed, throughput=4.99MB/sec 2024-01-13T18:26:57.725 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wF8Gye-tzqLS-au off=1399356 len=1469303 2024-01-13T18:26:57.727 INFO:tasks.workunit.client.0.smithi084.stdout:op 1766 completed, throughput=5MB/sec 2024-01-13T18:26:57.727 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qxfA_8kmo47cOKu off=741401 len=1070154 2024-01-13T18:26:57.733 INFO:tasks.workunit.client.0.smithi084.stdout:op 1767 completed, throughput=5MB/sec 2024-01-13T18:26:57.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:57 smithi099 ceph-mon[138788]: pgmap v1654: 105 pgs: 105 active+clean; 128 GiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:26:58.734 INFO:tasks.workunit.client.0.smithi084.stdout: 348: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:58.734 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-q3PkZuMXE8IfO_O off=10749290 len=444184 2024-01-13T18:26:58.737 INFO:tasks.workunit.client.0.smithi084.stdout:op 1768 completed, throughput=4.99MB/sec 2024-01-13T18:26:58.737 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rpbsTJtEfq29Xhk off=2783088 len=1569260 2024-01-13T18:26:58.743 INFO:tasks.workunit.client.0.smithi084.stdout:op 1769 completed, throughput=4.99MB/sec 2024-01-13T18:26:58.743 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3o1CkLhuTs_w-5L off=8868365 len=1286787 2024-01-13T18:26:58.748 INFO:tasks.workunit.client.0.smithi084.stdout:op 1770 completed, throughput=5MB/sec 2024-01-13T18:26:58.748 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uBHXhgua7ATm7Wf off=12897985 len=1880795 2024-01-13T18:26:58.754 INFO:tasks.workunit.client.0.smithi084.stdout:op 1771 completed, throughput=5MB/sec 2024-01-13T18:26:59.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:26:59 smithi099 ceph-mon[138788]: pgmap v1655: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:26:59.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:26:59 smithi084 ceph-mon[116404]: pgmap v1655: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:26:59.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:26:59 smithi084 ceph-mon[119097]: pgmap v1655: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:26:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: 349: throughput=4.99MB/sec pending data=0 2024-01-13T18:26:59.754 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rUnZGLfmYERwEob off=14380410 len=1265265 2024-01-13T18:26:59.762 INFO:tasks.workunit.client.0.smithi084.stdout:op 1772 completed, throughput=4.99MB/sec 2024-01-13T18:26:59.762 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-O3VJrxff_EXSfqu off=9709913 len=1881029 2024-01-13T18:26:59.772 INFO:tasks.workunit.client.0.smithi084.stdout:op 1773 completed, throughput=4.99MB/sec 2024-01-13T18:26:59.773 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ERYIb1P9Obd47UH off=285307 len=1014726 2024-01-13T18:26:59.774 INFO:tasks.workunit.client.0.smithi084.stdout:op 1774 completed, throughput=5MB/sec 2024-01-13T18:26:59.774 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_LR6vbz3eo_IvWU off=8548008 len=318648 2024-01-13T18:26:59.775 INFO:tasks.workunit.client.0.smithi084.stdout:op 1775 completed, throughput=5MB/sec 2024-01-13T18:26:59.775 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--HnJlNw1LyEuspF off=1510403 len=541174 2024-01-13T18:26:59.779 INFO:tasks.workunit.client.0.smithi084.stdout:op 1776 completed, throughput=5MB/sec 2024-01-13T18:26:59.779 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zYWOZR5HXxEja8r off=17752001 len=1766856 2024-01-13T18:26:59.781 INFO:tasks.workunit.client.0.smithi084.stdout:op 1777 completed, throughput=5MB/sec 2024-01-13T18:27:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:27:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:27:00] "GET /metrics HTTP/1.1" 200 33976 "" "Prometheus/2.43.0" 2024-01-13T18:27:00.781 INFO:tasks.workunit.client.0.smithi084.stdout: 350: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:00.781 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7g5pO3fsZRYlpyj off=1363116 len=190458 2024-01-13T18:27:00.782 INFO:tasks.workunit.client.0.smithi084.stdout:op 1778 completed, throughput=4.99MB/sec 2024-01-13T18:27:00.782 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-C1Zhf0H8AOEybfv off=12700913 len=1023048 2024-01-13T18:27:00.783 INFO:tasks.workunit.client.0.smithi084.stdout:op 1779 completed, throughput=4.99MB/sec 2024-01-13T18:27:00.783 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-McaIT_QrRcpudXK off=10119973 len=1474531 2024-01-13T18:27:00.785 INFO:tasks.workunit.client.0.smithi084.stdout:op 1780 completed, throughput=5MB/sec 2024-01-13T18:27:00.785 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MlUhSNrHQTn8HU4 off=2704982 len=1902057 2024-01-13T18:27:00.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 1781 completed, throughput=5MB/sec 2024-01-13T18:27:01.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:01 smithi084 ceph-mon[119097]: pgmap v1656: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 4 op/s 2024-01-13T18:27:01.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:01 smithi084 ceph-mon[116404]: pgmap v1656: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 4 op/s 2024-01-13T18:27:01.795 INFO:tasks.workunit.client.0.smithi084.stdout: 351: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:01.795 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JXEgw5zKdXRjhgP off=19582925 len=1416118 2024-01-13T18:27:01.801 INFO:tasks.workunit.client.0.smithi084.stdout:op 1782 completed, throughput=4.99MB/sec 2024-01-13T18:27:01.801 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L9Xg4Z3VtQ_XeQ6 off=6527278 len=11471 2024-01-13T18:27:01.802 INFO:tasks.workunit.client.0.smithi084.stdout:op 1783 completed, throughput=4.99MB/sec 2024-01-13T18:27:01.802 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7hmNNcOre3hC32q off=11896549 len=1798319 2024-01-13T18:27:01.809 INFO:tasks.workunit.client.0.smithi084.stdout:op 1784 completed, throughput=5MB/sec 2024-01-13T18:27:01.809 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Pza1Iup9pPaNp_J off=13516203 len=815797 2024-01-13T18:27:01.813 INFO:tasks.workunit.client.0.smithi084.stdout:op 1785 completed, throughput=5MB/sec 2024-01-13T18:27:01.813 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-m6ghQxIf2mYYbKE off=6652667 len=516966 2024-01-13T18:27:01.815 INFO:tasks.workunit.client.0.smithi084.stdout:op 1786 completed, throughput=5MB/sec 2024-01-13T18:27:01.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:01 smithi099 ceph-mon[138788]: pgmap v1656: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 4 op/s 2024-01-13T18:27:02.816 INFO:tasks.workunit.client.0.smithi084.stdout: 352: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:02.816 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-r9ov7nhslib5vIm off=14179863 len=1016199 2024-01-13T18:27:02.817 INFO:tasks.workunit.client.0.smithi084.stdout:op 1787 completed, throughput=4.99MB/sec 2024-01-13T18:27:02.817 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WjjEZxER0Ckfs-b off=366718 len=1519081 2024-01-13T18:27:02.819 INFO:tasks.workunit.client.0.smithi084.stdout:op 1788 completed, throughput=4.99MB/sec 2024-01-13T18:27:02.819 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xkgLwMIoryOhpEK off=14518581 len=246186 2024-01-13T18:27:02.822 INFO:tasks.workunit.client.0.smithi084.stdout:op 1789 completed, throughput=4.99MB/sec 2024-01-13T18:27:02.823 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yDnxdkaBZsAoCIX off=8580825 len=424224 2024-01-13T18:27:02.823 INFO:tasks.workunit.client.0.smithi084.stdout:op 1790 completed, throughput=4.99MB/sec 2024-01-13T18:27:02.823 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4jSNnCVjKgVZBud off=1005570 len=55567 2024-01-13T18:27:02.824 INFO:tasks.workunit.client.0.smithi084.stdout:op 1791 completed, throughput=4.99MB/sec 2024-01-13T18:27:02.824 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YBEJYAppTxHmvUd off=3872200 len=1696318 2024-01-13T18:27:02.831 INFO:tasks.workunit.client.0.smithi084.stdout:op 1792 completed, throughput=5MB/sec 2024-01-13T18:27:02.831 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VbMlpeh3eHDtZDi off=987091 len=616446 2024-01-13T18:27:02.831 INFO:tasks.workunit.client.0.smithi084.stdout:op 1793 completed, throughput=5MB/sec 2024-01-13T18:27:03.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:03 smithi084 ceph-mon[116404]: pgmap v1657: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 3 op/s 2024-01-13T18:27:03.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:03 smithi084 ceph-mon[119097]: pgmap v1657: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 3 op/s 2024-01-13T18:27:03.832 INFO:tasks.workunit.client.0.smithi084.stdout: 353: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:03.832 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7RsMBTH3VHBuDcY off=11578313 len=1576469 2024-01-13T18:27:03.835 INFO:tasks.workunit.client.0.smithi084.stdout:op 1794 completed, throughput=4.99MB/sec 2024-01-13T18:27:03.835 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TzrnQbfSIuGPbVO off=382869 len=1961684 2024-01-13T18:27:03.839 INFO:tasks.workunit.client.0.smithi084.stdout:op 1795 completed, throughput=5MB/sec 2024-01-13T18:27:03.839 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y9gAa-1Rh5yMYfB off=7364734 len=919204 2024-01-13T18:27:03.841 INFO:tasks.workunit.client.0.smithi084.stdout:op 1796 completed, throughput=5MB/sec 2024-01-13T18:27:03.841 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-q_lr4yutTxqXFd- off=8251081 len=985192 2024-01-13T18:27:03.845 INFO:tasks.workunit.client.0.smithi084.stdout:op 1797 completed, throughput=5MB/sec 2024-01-13T18:27:03.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:03 smithi099 ceph-mon[138788]: pgmap v1657: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 3 op/s 2024-01-13T18:27:04.846 INFO:tasks.workunit.client.0.smithi084.stdout: 354: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:04.846 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-33FKM1ztkVEMLLc off=2750236 len=527645 2024-01-13T18:27:04.847 INFO:tasks.workunit.client.0.smithi084.stdout:op 1798 completed, throughput=4.99MB/sec 2024-01-13T18:27:04.847 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EY8jJojQe0NO0cH off=3001305 len=2006117 2024-01-13T18:27:04.858 INFO:tasks.workunit.client.0.smithi084.stdout:op 1799 completed, throughput=4.99MB/sec 2024-01-13T18:27:04.858 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-m6ghQxIf2mYYbKE off=338169 len=165986 2024-01-13T18:27:04.861 INFO:tasks.workunit.client.0.smithi084.stdout:op 1800 completed, throughput=4.99MB/sec 2024-01-13T18:27:04.861 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-psYe4AjMThvys0u off=6372280 len=122017 2024-01-13T18:27:04.862 INFO:tasks.workunit.client.0.smithi084.stdout:op 1801 completed, throughput=4.99MB/sec 2024-01-13T18:27:04.862 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6S6Q9NWTAioRkkv off=1028924 len=817207 2024-01-13T18:27:04.866 INFO:tasks.workunit.client.0.smithi084.stdout:op 1802 completed, throughput=5MB/sec 2024-01-13T18:27:04.866 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8CvWZSdpfeR7Khf off=8956587 len=1446193 2024-01-13T18:27:04.871 INFO:tasks.workunit.client.0.smithi084.stdout:op 1803 completed, throughput=5MB/sec 2024-01-13T18:27:05.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:05 smithi084 ceph-mon[116404]: pgmap v1658: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:27:05.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:05 smithi084 ceph-mon[119097]: pgmap v1658: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:27:05.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:05.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:05 smithi099 ceph-mon[138788]: pgmap v1658: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:27:05.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:05.871 INFO:tasks.workunit.client.0.smithi084.stdout: 355: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:05.871 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8CvWZSdpfeR7Khf off=6439110 len=239303 2024-01-13T18:27:05.872 INFO:tasks.workunit.client.0.smithi084.stdout:op 1804 completed, throughput=4.99MB/sec 2024-01-13T18:27:05.872 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4b6YWm-6dfS2a_N off=3044852 len=1975167 2024-01-13T18:27:05.874 INFO:tasks.workunit.client.0.smithi084.stdout:op 1805 completed, throughput=4.99MB/sec 2024-01-13T18:27:05.874 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VXEPpOC-wB_Y4s8 off=544944 len=1380307 2024-01-13T18:27:05.880 INFO:tasks.workunit.client.0.smithi084.stdout:op 1806 completed, throughput=5MB/sec 2024-01-13T18:27:05.881 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-h_hQ5t7E5F1EQEi off=1636668 len=103852 2024-01-13T18:27:05.881 INFO:tasks.workunit.client.0.smithi084.stdout:op 1807 completed, throughput=5MB/sec 2024-01-13T18:27:05.881 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iGIwH0Q4kb4_B9H off=2988993 len=1810392 2024-01-13T18:27:05.884 INFO:tasks.workunit.client.0.smithi084.stdout:op 1808 completed, throughput=5MB/sec 2024-01-13T18:27:06.885 INFO:tasks.workunit.client.0.smithi084.stdout: 356: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:06.885 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_I6U0sIgs_PquYT off=15918997 len=1509955 2024-01-13T18:27:06.893 INFO:tasks.workunit.client.0.smithi084.stdout:op 1809 completed, throughput=4.99MB/sec 2024-01-13T18:27:06.893 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UO_iYI8iGCMrNNC off=58061 len=1380578 2024-01-13T18:27:06.895 INFO:tasks.workunit.client.0.smithi084.stdout:op 1810 completed, throughput=4.99MB/sec 2024-01-13T18:27:06.895 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GbGAugk3S67tcWI off=3148838 len=1844289 2024-01-13T18:27:06.906 INFO:tasks.workunit.client.0.smithi084.stdout:op 1811 completed, throughput=5MB/sec 2024-01-13T18:27:06.906 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0Y32Mg2TwzdHFky off=12879872 len=1242049 2024-01-13T18:27:06.912 INFO:tasks.workunit.client.0.smithi084.stdout:op 1812 completed, throughput=5MB/sec 2024-01-13T18:27:07.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:07 smithi084 ceph-mon[116404]: pgmap v1659: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:27:07.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:07 smithi084 ceph-mon[119097]: pgmap v1659: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:27:07.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:07 smithi099 ceph-mon[138788]: pgmap v1659: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:27:07.912 INFO:tasks.workunit.client.0.smithi084.stdout: 357: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:07.913 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bKirJC0P6FJGZqZ off=2060765 len=1134173 2024-01-13T18:27:07.919 INFO:tasks.workunit.client.0.smithi084.stdout:op 1813 completed, throughput=4.99MB/sec 2024-01-13T18:27:07.919 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-s_B7u5fRdoyoF_v off=13725338 len=371216 2024-01-13T18:27:07.920 INFO:tasks.workunit.client.0.smithi084.stdout:op 1814 completed, throughput=4.99MB/sec 2024-01-13T18:27:07.923 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PHfagXZK6ERaWzY off=5241294 len=411090 2024-01-13T18:27:07.923 INFO:tasks.workunit.client.0.smithi084.stdout:op 1815 completed, throughput=4.99MB/sec 2024-01-13T18:27:07.923 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-64_WW-2KUSqvTET off=3018433 len=539660 2024-01-13T18:27:07.924 INFO:tasks.workunit.client.0.smithi084.stdout:op 1816 completed, throughput=4.99MB/sec 2024-01-13T18:27:07.924 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-37qqkBrE_0CL_nz off=12033291 len=797730 2024-01-13T18:27:07.926 INFO:tasks.workunit.client.0.smithi084.stdout:op 1817 completed, throughput=5MB/sec 2024-01-13T18:27:07.926 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0zJrCeDguUeWU0q off=5491001 len=1194872 2024-01-13T18:27:07.932 INFO:tasks.workunit.client.0.smithi084.stdout:op 1818 completed, throughput=5MB/sec 2024-01-13T18:27:08.933 INFO:tasks.workunit.client.0.smithi084.stdout: 358: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:08.933 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-P3BFBjjALA4Ej1- off=12194452 len=1799651 2024-01-13T18:27:08.941 INFO:tasks.workunit.client.0.smithi084.stdout:op 1819 completed, throughput=4.99MB/sec 2024-01-13T18:27:08.941 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8P04bEw7_ZBec4s off=3044131 len=656280 2024-01-13T18:27:08.947 INFO:tasks.workunit.client.0.smithi084.stdout:op 1820 completed, throughput=4.99MB/sec 2024-01-13T18:27:08.947 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Gxo3zV7eQ_B6mHZ off=10058660 len=2083774 2024-01-13T18:27:08.954 INFO:tasks.workunit.client.0.smithi084.stdout:op 1821 completed, throughput=5MB/sec 2024-01-13T18:27:08.954 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Y8EYdpKaQegfPYm off=7584208 len=393321 2024-01-13T18:27:08.957 INFO:tasks.workunit.client.0.smithi084.stdout:op 1822 completed, throughput=5MB/sec 2024-01-13T18:27:08.957 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5arDnMme-BpC3yU off=6177206 len=1848064 2024-01-13T18:27:08.963 INFO:tasks.workunit.client.0.smithi084.stdout:op 1823 completed, throughput=5MB/sec 2024-01-13T18:27:09.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:09 smithi099 ceph-mon[138788]: pgmap v1660: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:27:09.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:09 smithi084 ceph-mon[116404]: pgmap v1660: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:27:09.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:09 smithi084 ceph-mon[119097]: pgmap v1660: 105 pgs: 105 active+clean; 128 GiB data, 6.7 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:27:09.963 INFO:tasks.workunit.client.0.smithi084.stdout: 359: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:09.963 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cEVP8QId2hN0cVD off=9613367 len=1089279 2024-01-13T18:27:09.968 INFO:tasks.workunit.client.0.smithi084.stdout:op 1824 completed, throughput=4.99MB/sec 2024-01-13T18:27:09.968 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-x1PMg0B0PrQyztR off=1588593 len=235054 2024-01-13T18:27:09.969 INFO:tasks.workunit.client.0.smithi084.stdout:op 1825 completed, throughput=4.99MB/sec 2024-01-13T18:27:09.969 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ecJ4azaj82E8KsX off=10587559 len=1482470 2024-01-13T18:27:09.978 INFO:tasks.workunit.client.0.smithi084.stdout:op 1826 completed, throughput=5MB/sec 2024-01-13T18:27:09.978 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-d058aIipgwhbLKd off=2152976 len=262071 2024-01-13T18:27:09.979 INFO:tasks.workunit.client.0.smithi084.stdout:op 1827 completed, throughput=5MB/sec 2024-01-13T18:27:09.979 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8aycbqCOPUnlcli off=1888918 len=1673613 2024-01-13T18:27:09.987 INFO:tasks.workunit.client.0.smithi084.stdout:op 1828 completed, throughput=5MB/sec 2024-01-13T18:27:10.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:27:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:27:10] "GET /metrics HTTP/1.1" 200 33978 "" "Prometheus/2.43.0" 2024-01-13T18:27:10.987 INFO:tasks.workunit.client.0.smithi084.stdout: 360: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:10.988 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AjrCIbONj6XsHkW off=5698255 len=1474255 2024-01-13T18:27:10.991 INFO:tasks.workunit.client.0.smithi084.stdout:op 1829 completed, throughput=4.99MB/sec 2024-01-13T18:27:10.991 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WC0cYHmr-G4dkH5 off=11081898 len=1317549 2024-01-13T18:27:10.996 INFO:tasks.workunit.client.0.smithi084.stdout:op 1830 completed, throughput=5MB/sec 2024-01-13T18:27:10.996 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9UfOO-3HWAOfvyv off=6202376 len=1514332 2024-01-13T18:27:11.000 INFO:tasks.workunit.client.0.smithi084.stdout:op 1831 completed, throughput=5MB/sec 2024-01-13T18:27:11.000 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_LrTH4xjNWtWxf7 off=225584 len=1897089 2024-01-13T18:27:11.011 INFO:tasks.workunit.client.0.smithi084.stdout:op 1832 completed, throughput=5MB/sec 2024-01-13T18:27:11.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:11 smithi084 ceph-mon[119097]: pgmap v1661: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:27:11.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:11 smithi084 ceph-mon[116404]: pgmap v1661: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:27:11.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:11 smithi099 ceph-mon[138788]: pgmap v1661: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:27:12.011 INFO:tasks.workunit.client.0.smithi084.stdout: 361: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:12.012 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tzgnLKilvyw5nq5 off=1402349 len=1792632 2024-01-13T18:27:12.013 INFO:tasks.workunit.client.0.smithi084.stdout:op 1833 completed, throughput=5MB/sec 2024-01-13T18:27:12.013 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-N4Mxd5TmaZW7AyW off=707885 len=548707 2024-01-13T18:27:12.019 INFO:tasks.workunit.client.0.smithi084.stdout:op 1834 completed, throughput=5MB/sec 2024-01-13T18:27:12.019 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1YoGtlNSXUbSKGY off=3039751 len=122754 2024-01-13T18:27:12.020 INFO:tasks.workunit.client.0.smithi084.stdout:op 1835 completed, throughput=5MB/sec 2024-01-13T18:27:12.020 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WEbFWm2Wc_5hJdN off=5546375 len=70305 2024-01-13T18:27:12.021 INFO:tasks.workunit.client.0.smithi084.stdout:op 1836 completed, throughput=5MB/sec 2024-01-13T18:27:12.021 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BU-2yZpIZsq1hZx off=766533 len=749711 2024-01-13T18:27:12.024 INFO:tasks.workunit.client.0.smithi084.stdout:op 1837 completed, throughput=5MB/sec 2024-01-13T18:27:12.024 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BGmLYaXkFRGzLtS off=11875814 len=1700440 2024-01-13T18:27:12.026 INFO:tasks.workunit.client.0.smithi084.stdout:op 1838 completed, throughput=5MB/sec 2024-01-13T18:27:13.027 INFO:tasks.workunit.client.0.smithi084.stdout: 362: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:13.027 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YI0JGt6ijdf4ssH off=2146709 len=1870555 2024-01-13T18:27:13.030 INFO:tasks.workunit.client.0.smithi084.stdout:op 1839 completed, throughput=4.99MB/sec 2024-01-13T18:27:13.030 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QYyBZh9Gsx63g0g off=7070303 len=720835 2024-01-13T18:27:13.034 INFO:tasks.workunit.client.0.smithi084.stdout:op 1840 completed, throughput=5MB/sec 2024-01-13T18:27:13.034 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NK8Qe-xDkGAnYaJ off=1993840 len=1954834 2024-01-13T18:27:13.038 INFO:tasks.workunit.client.0.smithi084.stdout:op 1841 completed, throughput=5MB/sec 2024-01-13T18:27:13.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:13 smithi084 ceph-mon[116404]: pgmap v1662: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:27:13.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:13 smithi084 ceph-mon[119097]: pgmap v1662: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:27:13.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:13 smithi099 ceph-mon[138788]: pgmap v1662: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:27:14.038 INFO:tasks.workunit.client.0.smithi084.stdout: 363: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:14.038 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YEeIqm2Wd1bhS4R off=1467246 len=2032325 2024-01-13T18:27:14.050 INFO:tasks.workunit.client.0.smithi084.stdout:op 1842 completed, throughput=4.99MB/sec 2024-01-13T18:27:14.050 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ey2zGk7PBGgk0pF off=9587735 len=2020179 2024-01-13T18:27:14.063 INFO:tasks.workunit.client.0.smithi084.stdout:op 1843 completed, throughput=5MB/sec 2024-01-13T18:27:14.063 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-57vh1bbQKfpKrrl off=562818 len=310606 2024-01-13T18:27:14.064 INFO:tasks.workunit.client.0.smithi084.stdout:op 1844 completed, throughput=5MB/sec 2024-01-13T18:27:14.064 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FmNAy41wweCyIiG off=6552960 len=516574 2024-01-13T18:27:14.064 INFO:tasks.workunit.client.0.smithi084.stdout:op 1845 completed, throughput=5MB/sec 2024-01-13T18:27:15.065 INFO:tasks.workunit.client.0.smithi084.stdout: 364: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:15.065 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9P0z1xVpmPzr5Zt off=5953019 len=1838701 2024-01-13T18:27:15.076 INFO:tasks.workunit.client.0.smithi084.stdout:op 1846 completed, throughput=4.99MB/sec 2024-01-13T18:27:15.076 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HMepR1c-s2Fls9v off=7723111 len=978579 2024-01-13T18:27:15.078 INFO:tasks.workunit.client.0.smithi084.stdout:op 1847 completed, throughput=4.99MB/sec 2024-01-13T18:27:15.078 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-S7lDvdT4TLPZYer off=16096294 len=1155698 2024-01-13T18:27:15.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 1848 completed, throughput=5MB/sec 2024-01-13T18:27:15.080 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UZulkjUdjj9KzKe off=160458 len=189190 2024-01-13T18:27:15.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 1849 completed, throughput=5MB/sec 2024-01-13T18:27:15.080 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LHg3HlD9P8LzsTM off=3734088 len=50098 2024-01-13T18:27:15.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 1850 completed, throughput=5MB/sec 2024-01-13T18:27:15.081 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-m5FCXCBMVkVVdLW off=841465 len=180853 2024-01-13T18:27:15.083 INFO:tasks.workunit.client.0.smithi084.stdout:op 1851 completed, throughput=5MB/sec 2024-01-13T18:27:15.083 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jGWpqbKjg3iSK2A off=13803395 len=90184 2024-01-13T18:27:15.087 INFO:tasks.workunit.client.0.smithi084.stdout:op 1852 completed, throughput=5MB/sec 2024-01-13T18:27:15.087 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g5CoFK3p1rd76W5 off=18081420 len=345777 2024-01-13T18:27:15.088 INFO:tasks.workunit.client.0.smithi084.stdout:op 1853 completed, throughput=5MB/sec 2024-01-13T18:27:15.088 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-a7dj4otFK9lDgzR off=4828253 len=374525 2024-01-13T18:27:15.088 INFO:tasks.workunit.client.0.smithi084.stdout:op 1854 completed, throughput=5MB/sec 2024-01-13T18:27:15.088 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-28fXtJ2AVT5UBIC off=2114779 len=1880452 2024-01-13T18:27:15.099 INFO:tasks.workunit.client.0.smithi084.stdout:op 1855 completed, throughput=5MB/sec 2024-01-13T18:27:15.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:15 smithi084 ceph-mon[116404]: pgmap v1663: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:27:15.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:15 smithi084 ceph-mon[119097]: pgmap v1663: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:27:15.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:15 smithi099 ceph-mon[138788]: pgmap v1663: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:27:16.099 INFO:tasks.workunit.client.0.smithi084.stdout: 365: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:16.099 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bOe2kaVITLZ6tJS off=10890822 len=537625 2024-01-13T18:27:16.100 INFO:tasks.workunit.client.0.smithi084.stdout:op 1856 completed, throughput=4.99MB/sec 2024-01-13T18:27:16.100 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hbued3g4lKXlnwp off=3005034 len=824771 2024-01-13T18:27:16.108 INFO:tasks.workunit.client.0.smithi084.stdout:op 1857 completed, throughput=4.99MB/sec 2024-01-13T18:27:16.108 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FzEoJKPfxG0HfGA off=16998951 len=554774 2024-01-13T18:27:16.108 INFO:tasks.workunit.client.0.smithi084.stdout:op 1858 completed, throughput=5MB/sec 2024-01-13T18:27:16.108 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ttNsLb6wrUfIOfC off=12646900 len=1003208 2024-01-13T18:27:16.108 INFO:tasks.workunit.client.0.smithi084.stdout:op 1859 completed, throughput=5MB/sec 2024-01-13T18:27:16.108 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eeBfkfzFQZdqhVX off=10931506 len=458147 2024-01-13T18:27:16.108 INFO:tasks.workunit.client.0.smithi084.stdout:op 1860 completed, throughput=5MB/sec 2024-01-13T18:27:16.109 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iYwTJi8ahjvsNIN off=5458185 len=560982 2024-01-13T18:27:16.109 INFO:tasks.workunit.client.0.smithi084.stdout:op 1861 completed, throughput=5MB/sec 2024-01-13T18:27:17.109 INFO:tasks.workunit.client.0.smithi084.stdout: 366: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:17.110 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eTPROI7479ZbslH off=4773766 len=1190374 2024-01-13T18:27:17.116 INFO:tasks.workunit.client.0.smithi084.stdout:op 1862 completed, throughput=4.99MB/sec 2024-01-13T18:27:17.117 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tvN_lWeWYTuahny off=2984274 len=498821 2024-01-13T18:27:17.118 INFO:tasks.workunit.client.0.smithi084.stdout:op 1863 completed, throughput=4.99MB/sec 2024-01-13T18:27:17.118 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oDqXpqypZEuc-Cv off=10728455 len=1893240 2024-01-13T18:27:17.127 INFO:tasks.workunit.client.0.smithi084.stdout:op 1864 completed, throughput=5MB/sec 2024-01-13T18:27:17.127 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lgeYAlrCv07nac5 off=14915437 len=925084 2024-01-13T18:27:17.132 INFO:tasks.workunit.client.0.smithi084.stdout:op 1865 completed, throughput=5MB/sec 2024-01-13T18:27:17.132 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-c16sUsegZChm_67 off=1647527 len=1584096 2024-01-13T18:27:17.135 INFO:tasks.workunit.client.0.smithi084.stdout:op 1866 completed, throughput=5MB/sec 2024-01-13T18:27:17.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:17 smithi084 ceph-mon[116404]: pgmap v1664: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:27:17.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:17 smithi084 ceph-mon[119097]: pgmap v1664: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:27:17.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:17 smithi099 ceph-mon[138788]: pgmap v1664: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:27:18.134 INFO:tasks.workunit.client.0.smithi084.stdout: 367: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:18.134 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XgPFnrQN8gxY9Lo off=4291455 len=297927 2024-01-13T18:27:18.138 INFO:tasks.workunit.client.0.smithi084.stdout:op 1867 completed, throughput=4.99MB/sec 2024-01-13T18:27:18.138 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_M30mcbKDYU9lCE off=14888030 len=653715 2024-01-13T18:27:18.139 INFO:tasks.workunit.client.0.smithi084.stdout:op 1868 completed, throughput=4.99MB/sec 2024-01-13T18:27:18.139 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5VuRXaETIA6u5du off=18783624 len=1834113 2024-01-13T18:27:18.150 INFO:tasks.workunit.client.0.smithi084.stdout:op 1869 completed, throughput=5MB/sec 2024-01-13T18:27:18.150 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DGvZRyEpleFJun3 off=4157951 len=549095 2024-01-13T18:27:18.155 INFO:tasks.workunit.client.0.smithi084.stdout:op 1870 completed, throughput=5MB/sec 2024-01-13T18:27:18.155 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fg-HDqknD2INv6y off=8580755 len=168915 2024-01-13T18:27:18.155 INFO:tasks.workunit.client.0.smithi084.stdout:op 1871 completed, throughput=5MB/sec 2024-01-13T18:27:18.155 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CGk8e_8lFNkaJ87 off=15254068 len=270295 2024-01-13T18:27:18.156 INFO:tasks.workunit.client.0.smithi084.stdout:op 1872 completed, throughput=5MB/sec 2024-01-13T18:27:18.156 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pAVWH97uz9qwiAq off=7942140 len=226327 2024-01-13T18:27:18.156 INFO:tasks.workunit.client.0.smithi084.stdout:op 1873 completed, throughput=5MB/sec 2024-01-13T18:27:18.156 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LhukHdItwIWrZG_ off=6629235 len=204716 2024-01-13T18:27:18.159 INFO:tasks.workunit.client.0.smithi084.stdout:op 1874 completed, throughput=5MB/sec 2024-01-13T18:27:18.159 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VB7tpi6t_2uXidj off=3060074 len=1770032 2024-01-13T18:27:18.160 INFO:tasks.workunit.client.0.smithi084.stdout:op 1875 completed, throughput=5MB/sec 2024-01-13T18:27:19.161 INFO:tasks.workunit.client.0.smithi084.stdout: 368: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:19.161 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Y0wsKI1I1ct4a4U off=3732834 len=489202 2024-01-13T18:27:19.165 INFO:tasks.workunit.client.0.smithi084.stdout:op 1876 completed, throughput=4.99MB/sec 2024-01-13T18:27:19.165 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_ohP7v6Eo-Fi2oQ off=0 len=1836811 2024-01-13T18:27:19.167 INFO:tasks.workunit.client.0.smithi084.stdout:op 1877 completed, throughput=5MB/sec 2024-01-13T18:27:19.167 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mDgcruV8HHkholz off=2341287 len=2048783 2024-01-13T18:27:19.178 INFO:tasks.workunit.client.0.smithi084.stdout:op 1878 completed, throughput=5MB/sec 2024-01-13T18:27:19.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:19 smithi099 ceph-mon[138788]: pgmap v1665: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:27:19.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:19 smithi084 ceph-mon[116404]: pgmap v1665: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:27:19.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:19 smithi084 ceph-mon[119097]: pgmap v1665: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:27:20.178 INFO:tasks.workunit.client.0.smithi084.stdout: 369: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:20.179 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NAB-vQ5IVx7JIWJ off=4774072 len=1852412 2024-01-13T18:27:20.180 INFO:tasks.workunit.client.0.smithi084.stdout:op 1879 completed, throughput=4.99MB/sec 2024-01-13T18:27:20.180 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VhuyWwKowxdlLyV off=1309666 len=589886 2024-01-13T18:27:20.181 INFO:tasks.workunit.client.0.smithi084.stdout:op 1880 completed, throughput=4.99MB/sec 2024-01-13T18:27:20.181 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wngoy9UdBYlzve0 off=2617269 len=2416 2024-01-13T18:27:20.184 INFO:tasks.workunit.client.0.smithi084.stdout:op 1881 completed, throughput=4.99MB/sec 2024-01-13T18:27:20.184 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tyB5XIA7hJjVYs3 off=5130434 len=1481554 2024-01-13T18:27:20.186 INFO:tasks.workunit.client.0.smithi084.stdout:op 1882 completed, throughput=5MB/sec 2024-01-13T18:27:20.186 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-18ltrh1_hYy4dg5 off=4656867 len=1309497 2024-01-13T18:27:20.192 INFO:tasks.workunit.client.0.smithi084.stdout:op 1883 completed, throughput=5MB/sec 2024-01-13T18:27:20.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:27:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:27:20] "GET /metrics HTTP/1.1" 200 33975 "" "Prometheus/2.43.0" 2024-01-13T18:27:21.192 INFO:tasks.workunit.client.0.smithi084.stdout: 370: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:21.192 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1SMsAqfqiZLtcVF off=3530750 len=2034127 2024-01-13T18:27:21.205 INFO:tasks.workunit.client.0.smithi084.stdout:op 1884 completed, throughput=4.99MB/sec 2024-01-13T18:27:21.205 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Rk_PTcC3zmhGz6I off=10648815 len=1100283 2024-01-13T18:27:21.206 INFO:tasks.workunit.client.0.smithi084.stdout:op 1885 completed, throughput=5MB/sec 2024-01-13T18:27:21.206 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-c8EMxWsjrlAESY9 off=7104420 len=1880101 2024-01-13T18:27:21.210 INFO:tasks.workunit.client.0.smithi084.stdout:op 1886 completed, throughput=5MB/sec 2024-01-13T18:27:21.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:21 smithi099 ceph-mon[138788]: pgmap v1666: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:27:21.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:21 smithi084 ceph-mon[116404]: pgmap v1666: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:27:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:21 smithi084 ceph-mon[119097]: pgmap v1666: 105 pgs: 105 active+clean; 128 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:27:22.210 INFO:tasks.workunit.client.0.smithi084.stdout: 371: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:22.210 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Dnwf2nMBNhTTpRs off=4703103 len=1183519 2024-01-13T18:27:22.213 INFO:tasks.workunit.client.0.smithi084.stdout:op 1887 completed, throughput=4.99MB/sec 2024-01-13T18:27:22.213 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cn9OA1k_nT2UinG off=2266539 len=1465029 2024-01-13T18:27:22.221 INFO:tasks.workunit.client.0.smithi084.stdout:op 1888 completed, throughput=4.99MB/sec 2024-01-13T18:27:22.221 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lh2sJARayqSdx8l off=3197192 len=1977091 2024-01-13T18:27:22.223 INFO:tasks.workunit.client.0.smithi084.stdout:op 1889 completed, throughput=5MB/sec 2024-01-13T18:27:22.224 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jwHmUBehaGMMGFn off=5587948 len=230858 2024-01-13T18:27:22.227 INFO:tasks.workunit.client.0.smithi084.stdout:op 1890 completed, throughput=5MB/sec 2024-01-13T18:27:22.227 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zi-c-ykMdAj7xjg off=7814416 len=1784526 2024-01-13T18:27:22.228 INFO:tasks.workunit.client.0.smithi084.stdout:op 1891 completed, throughput=5MB/sec 2024-01-13T18:27:23.229 INFO:tasks.workunit.client.0.smithi084.stdout: 372: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:23.229 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XK_i9OKupNpFji5 off=19271029 len=1404139 2024-01-13T18:27:23.231 INFO:tasks.workunit.client.0.smithi084.stdout:op 1892 completed, throughput=4.99MB/sec 2024-01-13T18:27:23.231 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f0C0L3gg3kyEHkS off=8363655 len=1000107 2024-01-13T18:27:23.232 INFO:tasks.workunit.client.0.smithi084.stdout:op 1893 completed, throughput=5MB/sec 2024-01-13T18:27:23.232 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6QeVfxoRXlWow_M off=1134141 len=447954 2024-01-13T18:27:23.233 INFO:tasks.workunit.client.0.smithi084.stdout:op 1894 completed, throughput=5MB/sec 2024-01-13T18:27:23.233 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-v6L_dSKnpPwgN7i off=10774259 len=438219 2024-01-13T18:27:23.236 INFO:tasks.workunit.client.0.smithi084.stdout:op 1895 completed, throughput=5MB/sec 2024-01-13T18:27:23.236 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-G28ra9s1xCLT7P1 off=3150473 len=548407 2024-01-13T18:27:23.237 INFO:tasks.workunit.client.0.smithi084.stdout:op 1896 completed, throughput=5MB/sec 2024-01-13T18:27:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:23 smithi084 ceph-mon[116404]: pgmap v1667: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:27:23.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:23 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:27:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:23 smithi084 ceph-mon[119097]: pgmap v1667: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:27:23.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:23 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:27:23.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:23 smithi099 ceph-mon[138788]: pgmap v1667: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:27:23.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:23 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:27:24.237 INFO:tasks.workunit.client.0.smithi084.stdout: 373: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:24.238 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FCTcbIr2DKiAy3Q off=17245637 len=1373298 2024-01-13T18:27:24.242 INFO:tasks.workunit.client.0.smithi084.stdout:op 1897 completed, throughput=4.99MB/sec 2024-01-13T18:27:24.242 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vw4V5cOYatCFiSS off=5757384 len=1806118 2024-01-13T18:27:24.252 INFO:tasks.workunit.client.0.smithi084.stdout:op 1898 completed, throughput=4.99MB/sec 2024-01-13T18:27:24.252 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--QI813iBzP0zbVN off=6484147 len=1267615 2024-01-13T18:27:24.259 INFO:tasks.workunit.client.0.smithi084.stdout:op 1899 completed, throughput=5MB/sec 2024-01-13T18:27:24.259 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4QMQAOvGrtssxMC off=5727054 len=1092019 2024-01-13T18:27:24.260 INFO:tasks.workunit.client.0.smithi084.stdout:op 1900 completed, throughput=5MB/sec 2024-01-13T18:27:24.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:24 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:27:24.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:24 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:27:24.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:24 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:27:24.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:24 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:27:24.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:24 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:27:24.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:24 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:27:24.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:24 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:27:24.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:24 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:27:24.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:24 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:27:25.261 INFO:tasks.workunit.client.0.smithi084.stdout: 374: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:25.261 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-p6BxppX5qJ76Gaf off=9453414 len=419957 2024-01-13T18:27:25.264 INFO:tasks.workunit.client.0.smithi084.stdout:op 1901 completed, throughput=4.99MB/sec 2024-01-13T18:27:25.264 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wN1c3yaziCHsc6Y off=1798536 len=766215 2024-01-13T18:27:25.265 INFO:tasks.workunit.client.0.smithi084.stdout:op 1902 completed, throughput=4.99MB/sec 2024-01-13T18:27:25.265 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6rWV1mk7ohal3I6 off=2759660 len=762389 2024-01-13T18:27:25.270 INFO:tasks.workunit.client.0.smithi084.stdout:op 1903 completed, throughput=4.99MB/sec 2024-01-13T18:27:25.270 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--W_nuG_OwHJtfYx off=1901193 len=1852527 2024-01-13T18:27:25.272 INFO:tasks.workunit.client.0.smithi084.stdout:op 1904 completed, throughput=5MB/sec 2024-01-13T18:27:25.272 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oKs56oPhNYOvNfa off=4615639 len=860557 2024-01-13T18:27:25.273 INFO:tasks.workunit.client.0.smithi084.stdout:op 1905 completed, throughput=5MB/sec 2024-01-13T18:27:25.274 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0queb3HqpkWU0Kg off=8354402 len=522391 2024-01-13T18:27:25.275 INFO:tasks.workunit.client.0.smithi084.stdout:op 1906 completed, throughput=5MB/sec 2024-01-13T18:27:25.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:25 smithi084 ceph-mon[116404]: pgmap v1668: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:27:25.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:25 smithi084 ceph-mon[119097]: pgmap v1668: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:27:25.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:25 smithi099 ceph-mon[138788]: pgmap v1668: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:27:26.275 INFO:tasks.workunit.client.0.smithi084.stdout: 375: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:26.275 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g1wHHyGpVkrmhFD off=11269759 len=1350986 2024-01-13T18:27:26.278 INFO:tasks.workunit.client.0.smithi084.stdout:op 1907 completed, throughput=4.99MB/sec 2024-01-13T18:27:26.278 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cl0g1gIcenuLCdC off=6741540 len=1992774 2024-01-13T18:27:26.280 INFO:tasks.workunit.client.0.smithi084.stdout:op 1908 completed, throughput=5MB/sec 2024-01-13T18:27:26.280 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Wh9_zBl-1s71__a off=18375538 len=1437707 2024-01-13T18:27:26.282 INFO:tasks.workunit.client.0.smithi084.stdout:op 1909 completed, throughput=5MB/sec 2024-01-13T18:27:26.282 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uZiDRIqrbc--uN9 off=14501701 len=1523935 2024-01-13T18:27:26.291 INFO:tasks.workunit.client.0.smithi084.stdout:op 1910 completed, throughput=5MB/sec 2024-01-13T18:27:27.291 INFO:tasks.workunit.client.0.smithi084.stdout: 376: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:27.292 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IHa8G3blxj4pX33 off=671448 len=1666950 2024-01-13T18:27:27.298 INFO:tasks.workunit.client.0.smithi084.stdout:op 1911 completed, throughput=4.99MB/sec 2024-01-13T18:27:27.298 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-o6urvpE09SgN8Um off=13306959 len=652316 2024-01-13T18:27:27.303 INFO:tasks.workunit.client.0.smithi084.stdout:op 1912 completed, throughput=5MB/sec 2024-01-13T18:27:27.303 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aXoe99xIuF3Gd4B off=12552630 len=115178 2024-01-13T18:27:27.305 INFO:tasks.workunit.client.0.smithi084.stdout:op 1913 completed, throughput=5MB/sec 2024-01-13T18:27:27.305 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-r7MfqXd5S7ue13q off=10302062 len=529550 2024-01-13T18:27:27.306 INFO:tasks.workunit.client.0.smithi084.stdout:op 1914 completed, throughput=5MB/sec 2024-01-13T18:27:27.306 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-264zPR6BKxHxb5Q off=1968494 len=1184999 2024-01-13T18:27:27.314 INFO:tasks.workunit.client.0.smithi084.stdout:op 1915 completed, throughput=5MB/sec 2024-01-13T18:27:27.314 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ObFVRABQgaZcObU off=4276822 len=933293 2024-01-13T18:27:27.314 INFO:tasks.workunit.client.0.smithi084.stdout:op 1916 completed, throughput=5MB/sec 2024-01-13T18:27:27.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:27 smithi084 ceph-mon[116404]: pgmap v1669: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:27:27.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:27 smithi084 ceph-mon[119097]: pgmap v1669: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:27:27.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:27 smithi099 ceph-mon[138788]: pgmap v1669: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:27:28.315 INFO:tasks.workunit.client.0.smithi084.stdout: 377: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:28.315 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zmfIS4AOlMq-Ddk off=12448703 len=504362 2024-01-13T18:27:28.316 INFO:tasks.workunit.client.0.smithi084.stdout:op 1917 completed, throughput=4.99MB/sec 2024-01-13T18:27:28.316 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SPFXIkSr6yxPrxj off=737960 len=1387194 2024-01-13T18:27:28.319 INFO:tasks.workunit.client.0.smithi084.stdout:op 1918 completed, throughput=4.99MB/sec 2024-01-13T18:27:28.319 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RqdlrAn5nasSOuZ off=6818932 len=416513 2024-01-13T18:27:28.319 INFO:tasks.workunit.client.0.smithi084.stdout:op 1919 completed, throughput=4.99MB/sec 2024-01-13T18:27:28.319 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9w_e_9B02y-4N-d off=7145290 len=1899363 2024-01-13T18:27:28.323 INFO:tasks.workunit.client.0.smithi084.stdout:op 1920 completed, throughput=5MB/sec 2024-01-13T18:27:28.323 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TNojRk4Jc-i_Lpc off=8534672 len=1752732 2024-01-13T18:27:28.331 INFO:tasks.workunit.client.0.smithi084.stdout:op 1921 completed, throughput=5MB/sec 2024-01-13T18:27:29.331 INFO:tasks.workunit.client.0.smithi084.stdout: 378: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:29.332 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r0nyAIzyuhCHeVA off=2269010 len=1230786 2024-01-13T18:27:29.340 INFO:tasks.workunit.client.0.smithi084.stdout:op 1922 completed, throughput=4.99MB/sec 2024-01-13T18:27:29.340 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-H0CJdk2g2ALMMG5 off=0 len=1338797 2024-01-13T18:27:29.342 INFO:tasks.workunit.client.0.smithi084.stdout:op 1923 completed, throughput=5MB/sec 2024-01-13T18:27:29.342 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4v3KCatIBlJTKqh off=4535329 len=81616 2024-01-13T18:27:29.343 INFO:tasks.workunit.client.0.smithi084.stdout:op 1924 completed, throughput=5MB/sec 2024-01-13T18:27:29.343 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8fEW902XehWbJUB off=22884784 len=758546 2024-01-13T18:27:29.344 INFO:tasks.workunit.client.0.smithi084.stdout:op 1925 completed, throughput=5MB/sec 2024-01-13T18:27:29.344 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UYKYvt0cYQWZGJN off=4748984 len=1178490 2024-01-13T18:27:29.345 INFO:tasks.workunit.client.0.smithi084.stdout:op 1926 completed, throughput=5MB/sec 2024-01-13T18:27:29.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:29 smithi099 ceph-mon[138788]: pgmap v1670: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:27:29.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:29 smithi084 ceph-mon[116404]: pgmap v1670: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:27:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:29 smithi084 ceph-mon[119097]: pgmap v1670: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:27:30.346 INFO:tasks.workunit.client.0.smithi084.stdout: 379: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:30.346 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-i2dfkGc5owBctJP off=10388559 len=583450 2024-01-13T18:27:30.347 INFO:tasks.workunit.client.0.smithi084.stdout:op 1927 completed, throughput=4.99MB/sec 2024-01-13T18:27:30.347 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bFa31nqpDsPYjDK off=3471935 len=1526334 2024-01-13T18:27:30.349 INFO:tasks.workunit.client.0.smithi084.stdout:op 1928 completed, throughput=4.99MB/sec 2024-01-13T18:27:30.349 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x7CEccaz6JDtzLq off=8480439 len=616658 2024-01-13T18:27:30.353 INFO:tasks.workunit.client.0.smithi084.stdout:op 1929 completed, throughput=5MB/sec 2024-01-13T18:27:30.353 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6KScza8Rp5pvQAe off=9446254 len=621034 2024-01-13T18:27:30.357 INFO:tasks.workunit.client.0.smithi084.stdout:op 1930 completed, throughput=5MB/sec 2024-01-13T18:27:30.358 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G-l8UErszMjrSp9 off=828981 len=548562 2024-01-13T18:27:30.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 1931 completed, throughput=5MB/sec 2024-01-13T18:27:30.361 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uooE0fz8DtGg1RO off=1688772 len=1455594 2024-01-13T18:27:30.370 INFO:tasks.workunit.client.0.smithi084.stdout:op 1932 completed, throughput=5MB/sec 2024-01-13T18:27:30.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:27:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:27:30] "GET /metrics HTTP/1.1" 200 33975 "" "Prometheus/2.43.0" 2024-01-13T18:27:31.370 INFO:tasks.workunit.client.0.smithi084.stdout: 380: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:31.370 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3xBN5kW8Ep8OcHI off=3053663 len=428048 2024-01-13T18:27:31.374 INFO:tasks.workunit.client.0.smithi084.stdout:op 1933 completed, throughput=4.99MB/sec 2024-01-13T18:27:31.374 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xqrCpTGJGk5BpQj off=20541257 len=1673907 2024-01-13T18:27:31.381 INFO:tasks.workunit.client.0.smithi084.stdout:op 1934 completed, throughput=4.99MB/sec 2024-01-13T18:27:31.381 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YEeIqm2Wd1bhS4R off=303267 len=395954 2024-01-13T18:27:31.382 INFO:tasks.workunit.client.0.smithi084.stdout:op 1935 completed, throughput=4.99MB/sec 2024-01-13T18:27:31.382 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5-6pmfiWSh-cjE5 off=10313285 len=1826031 2024-01-13T18:27:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:op 1936 completed, throughput=5MB/sec 2024-01-13T18:27:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k8svVYQY7bxurbh off=13921728 len=1500315 2024-01-13T18:27:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:op 1937 completed, throughput=5MB/sec 2024-01-13T18:27:31.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:31 smithi084 ceph-mon[116404]: pgmap v1671: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:27:31.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:31 smithi084 ceph-mon[119097]: pgmap v1671: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:27:31.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:31 smithi099 ceph-mon[138788]: pgmap v1671: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:27:32.394 INFO:tasks.workunit.client.0.smithi084.stdout: 381: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:32.394 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DtqGLOgsOfB1r1K off=6456875 len=1609456 2024-01-13T18:27:32.404 INFO:tasks.workunit.client.0.smithi084.stdout:op 1938 completed, throughput=4.99MB/sec 2024-01-13T18:27:32.404 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uua8hWzMzWyYvi- off=12275259 len=1519532 2024-01-13T18:27:32.410 INFO:tasks.workunit.client.0.smithi084.stdout:op 1939 completed, throughput=5MB/sec 2024-01-13T18:27:32.410 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HjJUBtA_PESbVw4 off=19361787 len=2029770 2024-01-13T18:27:32.413 INFO:tasks.workunit.client.0.smithi084.stdout:op 1940 completed, throughput=5MB/sec 2024-01-13T18:27:33.413 INFO:tasks.workunit.client.0.smithi084.stdout: 382: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:33.413 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vbC4E_i7sxwG0Lf off=17926212 len=1762371 2024-01-13T18:27:33.415 INFO:tasks.workunit.client.0.smithi084.stdout:op 1941 completed, throughput=4.99MB/sec 2024-01-13T18:27:33.415 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jAfwG_uqU1CapxB off=1864972 len=1795492 2024-01-13T18:27:33.425 INFO:tasks.workunit.client.0.smithi084.stdout:op 1942 completed, throughput=5MB/sec 2024-01-13T18:27:33.425 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hWJSkxIFlDd8z8T off=11978212 len=271021 2024-01-13T18:27:33.428 INFO:tasks.workunit.client.0.smithi084.stdout:op 1943 completed, throughput=5MB/sec 2024-01-13T18:27:33.428 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9hHvjFrsNhTQB9X off=13801070 len=1638699 2024-01-13T18:27:33.430 INFO:tasks.workunit.client.0.smithi084.stdout:op 1944 completed, throughput=5MB/sec 2024-01-13T18:27:33.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:33 smithi084 ceph-mon[116404]: pgmap v1672: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:27:33.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:33 smithi084 ceph-mon[119097]: pgmap v1672: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:27:33.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:33 smithi099 ceph-mon[138788]: pgmap v1672: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:27:34.430 INFO:tasks.workunit.client.0.smithi084.stdout: 383: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:34.430 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qr_yj2YHfHsUTOH off=7999862 len=865447 2024-01-13T18:27:34.435 INFO:tasks.workunit.client.0.smithi084.stdout:op 1945 completed, throughput=4.99MB/sec 2024-01-13T18:27:34.435 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Yo_zY9U-8ifOTbf off=9772159 len=1881873 2024-01-13T18:27:34.446 INFO:tasks.workunit.client.0.smithi084.stdout:op 1946 completed, throughput=5MB/sec 2024-01-13T18:27:34.446 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-q0lDZdT8GDxL_0Z off=2265541 len=499530 2024-01-13T18:27:34.449 INFO:tasks.workunit.client.0.smithi084.stdout:op 1947 completed, throughput=5MB/sec 2024-01-13T18:27:34.450 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QBmZ8A24EuViHpo off=21270636 len=369351 2024-01-13T18:27:34.453 INFO:tasks.workunit.client.0.smithi084.stdout:op 1948 completed, throughput=5MB/sec 2024-01-13T18:27:34.453 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-68lVsiUwX4bPY-W off=1612179 len=1563155 2024-01-13T18:27:34.454 INFO:tasks.workunit.client.0.smithi084.stdout:op 1949 completed, throughput=5MB/sec 2024-01-13T18:27:35.455 INFO:tasks.workunit.client.0.smithi084.stdout: 384: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:35.455 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cxTwsY-bfldfGmf off=9389093 len=1309033 2024-01-13T18:27:35.456 INFO:tasks.workunit.client.0.smithi084.stdout:op 1950 completed, throughput=4.99MB/sec 2024-01-13T18:27:35.456 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-E4-2zO6TSPM2I8d off=3874437 len=535172 2024-01-13T18:27:35.457 INFO:tasks.workunit.client.0.smithi084.stdout:op 1951 completed, throughput=4.99MB/sec 2024-01-13T18:27:35.457 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-l8ULaFv4_00ZZCN off=298755 len=24999 2024-01-13T18:27:35.458 INFO:tasks.workunit.client.0.smithi084.stdout:op 1952 completed, throughput=4.99MB/sec 2024-01-13T18:27:35.458 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MRpokmmWenthaLy off=9041014 len=27101 2024-01-13T18:27:35.458 INFO:tasks.workunit.client.0.smithi084.stdout:op 1953 completed, throughput=4.99MB/sec 2024-01-13T18:27:35.458 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gQdf8uoLPalVaUt off=14360148 len=710349 2024-01-13T18:27:35.459 INFO:tasks.workunit.client.0.smithi084.stdout:op 1954 completed, throughput=5MB/sec 2024-01-13T18:27:35.459 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7pt1Ql3nmlHuNbD off=2037249 len=1490030 2024-01-13T18:27:35.462 INFO:tasks.workunit.client.0.smithi084.stdout:op 1955 completed, throughput=5MB/sec 2024-01-13T18:27:35.462 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HgVXOdXraZOS_rZ off=4041181 len=855288 2024-01-13T18:27:35.463 INFO:tasks.workunit.client.0.smithi084.stdout:op 1956 completed, throughput=5MB/sec 2024-01-13T18:27:35.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:35 smithi084 ceph-mon[119097]: pgmap v1673: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:27:35.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:35 smithi084 ceph-mon[116404]: pgmap v1673: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:27:35.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:35.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:35 smithi099 ceph-mon[138788]: pgmap v1673: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:27:35.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:36.464 INFO:tasks.workunit.client.0.smithi084.stdout: 385: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:36.464 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ccM7lHRoqyrqdlc off=4089035 len=1432904 2024-01-13T18:27:36.465 INFO:tasks.workunit.client.0.smithi084.stdout:op 1957 completed, throughput=4.99MB/sec 2024-01-13T18:27:36.465 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HeG93UQS7Lr2Iz8 off=6105170 len=1768292 2024-01-13T18:27:36.474 INFO:tasks.workunit.client.0.smithi084.stdout:op 1958 completed, throughput=5MB/sec 2024-01-13T18:27:36.474 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Uy-MkVy9R4IYW6- off=15301084 len=1071452 2024-01-13T18:27:36.480 INFO:tasks.workunit.client.0.smithi084.stdout:op 1959 completed, throughput=5MB/sec 2024-01-13T18:27:36.480 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j9Md3ESW2znUe3p off=13161489 len=867954 2024-01-13T18:27:36.484 INFO:tasks.workunit.client.0.smithi084.stdout:op 1960 completed, throughput=5MB/sec 2024-01-13T18:27:37.485 INFO:tasks.workunit.client.0.smithi084.stdout: 386: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:37.485 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vGStFN0uqgyyMMx off=6536671 len=1774930 2024-01-13T18:27:37.496 INFO:tasks.workunit.client.0.smithi084.stdout:op 1961 completed, throughput=4.99MB/sec 2024-01-13T18:27:37.496 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UWtBUSXlkE_3aFD off=905730 len=40713 2024-01-13T18:27:37.497 INFO:tasks.workunit.client.0.smithi084.stdout:op 1962 completed, throughput=4.99MB/sec 2024-01-13T18:27:37.497 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EBRIgkIvZ8KeBHx off=13723338 len=1360600 2024-01-13T18:27:37.499 INFO:tasks.workunit.client.0.smithi084.stdout:op 1963 completed, throughput=5MB/sec 2024-01-13T18:27:37.499 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ec9Vp8-K4MzLX2o off=2438647 len=826222 2024-01-13T18:27:37.500 INFO:tasks.workunit.client.0.smithi084.stdout:op 1964 completed, throughput=5MB/sec 2024-01-13T18:27:37.500 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fTV5H-5zyISSAgh off=544255 len=1240671 2024-01-13T18:27:37.502 INFO:tasks.workunit.client.0.smithi084.stdout:op 1965 completed, throughput=5MB/sec 2024-01-13T18:27:37.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:37 smithi084 ceph-mon[116404]: pgmap v1674: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:27:37.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:37 smithi084 ceph-mon[119097]: pgmap v1674: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:27:37.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:37 smithi099 ceph-mon[138788]: pgmap v1674: 105 pgs: 105 active+clean; 128 GiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:27:38.502 INFO:tasks.workunit.client.0.smithi084.stdout: 387: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:38.502 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PgWasCUscJjSpoR off=736871 len=1327307 2024-01-13T18:27:38.504 INFO:tasks.workunit.client.0.smithi084.stdout:op 1966 completed, throughput=4.99MB/sec 2024-01-13T18:27:38.504 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qhYmxAifPoQ1sny off=731441 len=1194035 2024-01-13T18:27:38.509 INFO:tasks.workunit.client.0.smithi084.stdout:op 1967 completed, throughput=4.99MB/sec 2024-01-13T18:27:38.509 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lgshnsB6FXKD1IQ off=2040601 len=735009 2024-01-13T18:27:38.510 INFO:tasks.workunit.client.0.smithi084.stdout:op 1968 completed, throughput=5MB/sec 2024-01-13T18:27:38.511 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-teboQHN-OnWT-2z off=1605332 len=2019591 2024-01-13T18:27:38.520 INFO:tasks.workunit.client.0.smithi084.stdout:op 1969 completed, throughput=5MB/sec 2024-01-13T18:27:39.520 INFO:tasks.workunit.client.0.smithi084.stdout: 388: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:39.520 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pUufGZKS9npwAp3 off=15051286 len=1327992 2024-01-13T18:27:39.527 INFO:tasks.workunit.client.0.smithi084.stdout:op 1970 completed, throughput=4.99MB/sec 2024-01-13T18:27:39.527 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iOYTuglB0mdI01- off=13298443 len=596076 2024-01-13T18:27:39.528 INFO:tasks.workunit.client.0.smithi084.stdout:op 1971 completed, throughput=4.99MB/sec 2024-01-13T18:27:39.528 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sTW8m8ZOJXpeX9C off=14347485 len=167847 2024-01-13T18:27:39.529 INFO:tasks.workunit.client.0.smithi084.stdout:op 1972 completed, throughput=4.99MB/sec 2024-01-13T18:27:39.529 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XY1R_cJpxnCNC9V off=5067332 len=985931 2024-01-13T18:27:39.534 INFO:tasks.workunit.client.0.smithi084.stdout:op 1973 completed, throughput=5MB/sec 2024-01-13T18:27:39.534 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-b-8a0xBxxso8ffN off=10875562 len=667523 2024-01-13T18:27:39.539 INFO:tasks.workunit.client.0.smithi084.stdout:op 1974 completed, throughput=5MB/sec 2024-01-13T18:27:39.539 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-taIYNcmqHpnEpnS off=9004843 len=1291809 2024-01-13T18:27:39.552 INFO:tasks.workunit.client.0.smithi084.stdout:op 1975 completed, throughput=5MB/sec 2024-01-13T18:27:39.552 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jiGB503o2kNzAyC off=9856206 len=480791 2024-01-13T18:27:39.553 INFO:tasks.workunit.client.0.smithi084.stdout:op 1976 completed, throughput=5MB/sec 2024-01-13T18:27:39.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:39 smithi099 ceph-mon[138788]: pgmap v1675: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:27:39.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:39 smithi084 ceph-mon[116404]: pgmap v1675: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:27:39.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:39 smithi084 ceph-mon[119097]: pgmap v1675: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:27:40.554 INFO:tasks.workunit.client.0.smithi084.stdout: 389: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:40.554 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n03dF7AeLIBSi47 off=529799 len=1496972 2024-01-13T18:27:40.563 INFO:tasks.workunit.client.0.smithi084.stdout:op 1977 completed, throughput=4.99MB/sec 2024-01-13T18:27:40.563 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-o-zRfh36VP4vUbs off=1158599 len=434411 2024-01-13T18:27:40.566 INFO:tasks.workunit.client.0.smithi084.stdout:op 1978 completed, throughput=4.99MB/sec 2024-01-13T18:27:40.566 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nQT1vGFifmJcbsD off=8159660 len=480094 2024-01-13T18:27:40.570 INFO:tasks.workunit.client.0.smithi084.stdout:op 1979 completed, throughput=4.99MB/sec 2024-01-13T18:27:40.570 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qk6MSBG5uZwaWMe off=4800835 len=220588 2024-01-13T18:27:40.572 INFO:tasks.workunit.client.0.smithi084.stdout:op 1980 completed, throughput=4.99MB/sec 2024-01-13T18:27:40.572 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cvcJIluTj_O8oEz off=6190331 len=20828 2024-01-13T18:27:40.574 INFO:tasks.workunit.client.0.smithi084.stdout:op 1981 completed, throughput=4.99MB/sec 2024-01-13T18:27:40.575 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rz5qTBrb7gdBIru off=9501676 len=2031466 2024-01-13T18:27:40.576 INFO:tasks.workunit.client.0.smithi084.stdout:op 1982 completed, throughput=5MB/sec 2024-01-13T18:27:40.576 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ey8TuD4jdGScKXd off=234522 len=1182571 2024-01-13T18:27:40.577 INFO:tasks.workunit.client.0.smithi084.stdout:op 1983 completed, throughput=5MB/sec 2024-01-13T18:27:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:27:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:27:40] "GET /metrics HTTP/1.1" 200 33992 "" "Prometheus/2.43.0" 2024-01-13T18:27:41.578 INFO:tasks.workunit.client.0.smithi084.stdout: 390: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:41.578 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KVQ9c64fkO8AuN1 off=21616178 len=1133994 2024-01-13T18:27:41.583 INFO:tasks.workunit.client.0.smithi084.stdout:op 1984 completed, throughput=4.99MB/sec 2024-01-13T18:27:41.583 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U6G_L26cxzDNTxc off=11144057 len=251030 2024-01-13T18:27:41.584 INFO:tasks.workunit.client.0.smithi084.stdout:op 1985 completed, throughput=4.99MB/sec 2024-01-13T18:27:41.584 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wZJX0unpxdb_kns off=416052 len=45211 2024-01-13T18:27:41.586 INFO:tasks.workunit.client.0.smithi084.stdout:op 1986 completed, throughput=4.99MB/sec 2024-01-13T18:27:41.586 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZMXvY-xx3OdpU_l off=1128418 len=37113 2024-01-13T18:27:41.587 INFO:tasks.workunit.client.0.smithi084.stdout:op 1987 completed, throughput=4.99MB/sec 2024-01-13T18:27:41.587 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-b_sA9cGcPgwek-0 off=4286846 len=1791558 2024-01-13T18:27:41.596 INFO:tasks.workunit.client.0.smithi084.stdout:op 1988 completed, throughput=5MB/sec 2024-01-13T18:27:41.596 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PXVRqSCO8u0xHZS off=341523 len=1434369 2024-01-13T18:27:41.598 INFO:tasks.workunit.client.0.smithi084.stdout:op 1989 completed, throughput=5MB/sec 2024-01-13T18:27:41.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:41 smithi084 ceph-mon[116404]: pgmap v1676: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:27:41.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:41 smithi084 ceph-mon[119097]: pgmap v1676: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:27:41.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:41 smithi099 ceph-mon[138788]: pgmap v1676: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:27:42.598 INFO:tasks.workunit.client.0.smithi084.stdout: 391: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:42.598 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KitzofHJOMwkwpn off=2329989 len=193829 2024-01-13T18:27:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:op 1990 completed, throughput=4.99MB/sec 2024-01-13T18:27:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-La7ILPcEHG5wWm1 off=20054935 len=1005488 2024-01-13T18:27:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:op 1991 completed, throughput=4.99MB/sec 2024-01-13T18:27:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DKi7SmE9KD6nXVq off=1186325 len=1896696 2024-01-13T18:27:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:op 1992 completed, throughput=5MB/sec 2024-01-13T18:27:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hKz5vYF-gcldbAi off=3385020 len=682591 2024-01-13T18:27:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:op 1993 completed, throughput=5MB/sec 2024-01-13T18:27:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r2kDxmJYZ6zONcT off=270567 len=94617 2024-01-13T18:27:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:op 1994 completed, throughput=5MB/sec 2024-01-13T18:27:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uua8hWzMzWyYvi- off=4899803 len=1493156 2024-01-13T18:27:42.615 INFO:tasks.workunit.client.0.smithi084.stdout:op 1995 completed, throughput=5MB/sec 2024-01-13T18:27:43.615 INFO:tasks.workunit.client.0.smithi084.stdout: 392: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:43.615 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oToe7chaHHGOmQD off=2045717 len=1700621 2024-01-13T18:27:43.624 INFO:tasks.workunit.client.0.smithi084.stdout:op 1996 completed, throughput=4.99MB/sec 2024-01-13T18:27:43.624 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8jnhAWxOvds2up- off=6607591 len=442582 2024-01-13T18:27:43.627 INFO:tasks.workunit.client.0.smithi084.stdout:op 1997 completed, throughput=4.99MB/sec 2024-01-13T18:27:43.627 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-V9x2eTOzMq7vJZA off=16670441 len=1037767 2024-01-13T18:27:43.632 INFO:tasks.workunit.client.0.smithi084.stdout:op 1998 completed, throughput=5MB/sec 2024-01-13T18:27:43.632 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2yyKME65mIufptI off=310638 len=1241876 2024-01-13T18:27:43.638 INFO:tasks.workunit.client.0.smithi084.stdout:op 1999 completed, throughput=5MB/sec 2024-01-13T18:27:43.638 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ssiEtoMtEyqsCkY off=208932 len=1848496 2024-01-13T18:27:43.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 2000 completed, throughput=5MB/sec 2024-01-13T18:27:43.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:43 smithi084 ceph-mon[116404]: pgmap v1677: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:27:43.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:43 smithi084 ceph-mon[119097]: pgmap v1677: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:27:43.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:43 smithi099 ceph-mon[138788]: pgmap v1677: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:27:44.647 INFO:tasks.workunit.client.0.smithi084.stdout: 393: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:44.647 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S_Yx6oYuv1Zms1i off=20740599 len=1305444 2024-01-13T18:27:44.654 INFO:tasks.workunit.client.0.smithi084.stdout:op 2001 completed, throughput=4.99MB/sec 2024-01-13T18:27:44.654 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2t_murvrwUvVxpd off=9774174 len=810299 2024-01-13T18:27:44.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 2002 completed, throughput=4.99MB/sec 2024-01-13T18:27:44.659 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uOcSi9izkKqmO2B off=15699451 len=998734 2024-01-13T18:27:44.664 INFO:tasks.workunit.client.0.smithi084.stdout:op 2003 completed, throughput=5MB/sec 2024-01-13T18:27:44.664 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OBuLixKj1hUgKiI off=4637506 len=1102980 2024-01-13T18:27:44.668 INFO:tasks.workunit.client.0.smithi084.stdout:op 2004 completed, throughput=5MB/sec 2024-01-13T18:27:44.668 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kiJguxT2MVna3tj off=4817615 len=1581004 2024-01-13T18:27:44.670 INFO:tasks.workunit.client.0.smithi084.stdout:op 2005 completed, throughput=5MB/sec 2024-01-13T18:27:45.670 INFO:tasks.workunit.client.0.smithi084.stdout: 394: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:45.670 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Jlw8Icd2MYOaukR off=7830542 len=1329272 2024-01-13T18:27:45.672 INFO:tasks.workunit.client.0.smithi084.stdout:op 2006 completed, throughput=4.99MB/sec 2024-01-13T18:27:45.672 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HEsP9RrFV7GAh6r off=10953556 len=21544 2024-01-13T18:27:45.673 INFO:tasks.workunit.client.0.smithi084.stdout:op 2007 completed, throughput=4.99MB/sec 2024-01-13T18:27:45.673 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-moHyjwcYIx-60cm off=6712432 len=1905064 2024-01-13T18:27:45.676 INFO:tasks.workunit.client.0.smithi084.stdout:op 2008 completed, throughput=5MB/sec 2024-01-13T18:27:45.676 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2pm1wNdrUih3m_m off=11650338 len=376414 2024-01-13T18:27:45.677 INFO:tasks.workunit.client.0.smithi084.stdout:op 2009 completed, throughput=5MB/sec 2024-01-13T18:27:45.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:45 smithi084 ceph-mon[116404]: pgmap v1678: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:27:45.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:45 smithi084 ceph-mon[119097]: pgmap v1678: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:27:45.677 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PHfagXZK6ERaWzY off=13434237 len=1176924 2024-01-13T18:27:45.678 INFO:tasks.workunit.client.0.smithi084.stdout:op 2010 completed, throughput=5MB/sec 2024-01-13T18:27:45.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:45 smithi099 ceph-mon[138788]: pgmap v1678: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:27:46.679 INFO:tasks.workunit.client.0.smithi084.stdout: 395: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:46.679 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5h9J4uR08jzId26 off=643543 len=370415 2024-01-13T18:27:46.680 INFO:tasks.workunit.client.0.smithi084.stdout:op 2011 completed, throughput=4.99MB/sec 2024-01-13T18:27:46.680 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5cAPshlsnPnNbO6 off=4616778 len=735437 2024-01-13T18:27:46.681 INFO:tasks.workunit.client.0.smithi084.stdout:op 2012 completed, throughput=4.99MB/sec 2024-01-13T18:27:46.681 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-splnGO9QnQLv9Ny off=10395622 len=865723 2024-01-13T18:27:46.682 INFO:tasks.workunit.client.0.smithi084.stdout:op 2013 completed, throughput=4.99MB/sec 2024-01-13T18:27:46.682 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CwTPhMq2eOclaYV off=11255418 len=1443683 2024-01-13T18:27:46.684 INFO:tasks.workunit.client.0.smithi084.stdout:op 2014 completed, throughput=5MB/sec 2024-01-13T18:27:46.684 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GyBqnllSENCg1zi off=3357440 len=437271 2024-01-13T18:27:46.685 INFO:tasks.workunit.client.0.smithi084.stdout:op 2015 completed, throughput=5MB/sec 2024-01-13T18:27:46.685 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ObFVRABQgaZcObU off=832894 len=295136 2024-01-13T18:27:46.688 INFO:tasks.workunit.client.0.smithi084.stdout:op 2016 completed, throughput=5MB/sec 2024-01-13T18:27:46.688 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cCIXY8gdVT_BEo2 off=11806830 len=1504792 2024-01-13T18:27:46.689 INFO:tasks.workunit.client.0.smithi084.stdout:op 2017 completed, throughput=5MB/sec 2024-01-13T18:27:47.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:47 smithi084 ceph-mon[116404]: pgmap v1679: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:27:47.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:47 smithi084 ceph-mon[119097]: pgmap v1679: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:27:47.690 INFO:tasks.workunit.client.0.smithi084.stdout: 396: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:47.690 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FlNyFpLaoHu7v_p off=2722101 len=1966940 2024-01-13T18:27:47.701 INFO:tasks.workunit.client.0.smithi084.stdout:op 2018 completed, throughput=5MB/sec 2024-01-13T18:27:47.701 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KpxY1BnQ4E4htki off=14042045 len=912233 2024-01-13T18:27:47.702 INFO:tasks.workunit.client.0.smithi084.stdout:op 2019 completed, throughput=5MB/sec 2024-01-13T18:27:47.702 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ovnu6cwja7O6t81 off=3832262 len=1984922 2024-01-13T18:27:47.714 INFO:tasks.workunit.client.0.smithi084.stdout:op 2020 completed, throughput=5MB/sec 2024-01-13T18:27:47.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:47 smithi099 ceph-mon[138788]: pgmap v1679: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:27:48.714 INFO:tasks.workunit.client.0.smithi084.stdout: 397: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:48.714 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PipxTxbLn2MHwKX off=2950494 len=1181944 2024-01-13T18:27:48.721 INFO:tasks.workunit.client.0.smithi084.stdout:op 2021 completed, throughput=4.99MB/sec 2024-01-13T18:27:48.721 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2NxN4agIffmQGxS off=493473 len=1619032 2024-01-13T18:27:48.724 INFO:tasks.workunit.client.0.smithi084.stdout:op 2022 completed, throughput=5MB/sec 2024-01-13T18:27:48.724 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cXlQ7OdQLpRkzvC off=9275835 len=740538 2024-01-13T18:27:48.729 INFO:tasks.workunit.client.0.smithi084.stdout:op 2023 completed, throughput=5MB/sec 2024-01-13T18:27:48.729 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1_cMG4LL1b2VQ0m off=7166411 len=1266829 2024-01-13T18:27:48.735 INFO:tasks.workunit.client.0.smithi084.stdout:op 2024 completed, throughput=5MB/sec 2024-01-13T18:27:49.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:49 smithi099 ceph-mon[138788]: pgmap v1680: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:27:49.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:49 smithi084 ceph-mon[116404]: pgmap v1680: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:27:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:49 smithi084 ceph-mon[119097]: pgmap v1680: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:27:49.735 INFO:tasks.workunit.client.0.smithi084.stdout: 398: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:49.735 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TRXTG1_J0yF-kc1 off=23796632 len=1555132 2024-01-13T18:27:49.742 INFO:tasks.workunit.client.0.smithi084.stdout:op 2025 completed, throughput=4.99MB/sec 2024-01-13T18:27:49.742 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rWnTCENySYqu65A off=8779452 len=929115 2024-01-13T18:27:49.745 INFO:tasks.workunit.client.0.smithi084.stdout:op 2026 completed, throughput=4.99MB/sec 2024-01-13T18:27:49.745 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MYPQUjMHRgfroxJ off=1881827 len=1225798 2024-01-13T18:27:49.753 INFO:tasks.workunit.client.0.smithi084.stdout:op 2027 completed, throughput=5MB/sec 2024-01-13T18:27:49.753 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Vxehp4WJ2PBwh8s off=58435 len=1030949 2024-01-13T18:27:49.754 INFO:tasks.workunit.client.0.smithi084.stdout:op 2028 completed, throughput=5MB/sec 2024-01-13T18:27:49.755 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hTau-aDBPWa7pSj off=849638 len=810108 2024-01-13T18:27:49.755 INFO:tasks.workunit.client.0.smithi084.stdout:op 2029 completed, throughput=5MB/sec 2024-01-13T18:27:50.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:27:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:27:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:27:50] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:27:50.755 INFO:tasks.workunit.client.0.smithi084.stdout: 399: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:50.756 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ALTYEItKOjPvhQf off=2900806 len=28864 2024-01-13T18:27:50.758 INFO:tasks.workunit.client.0.smithi084.stdout:op 2030 completed, throughput=4.99MB/sec 2024-01-13T18:27:50.758 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2WYNUKRGJvsyVAc off=12315476 len=932586 2024-01-13T18:27:50.763 INFO:tasks.workunit.client.0.smithi084.stdout:op 2031 completed, throughput=4.99MB/sec 2024-01-13T18:27:50.764 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CxnaMYWsJQQiuWN off=7121178 len=130283 2024-01-13T18:27:50.766 INFO:tasks.workunit.client.0.smithi084.stdout:op 2032 completed, throughput=4.99MB/sec 2024-01-13T18:27:50.766 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IbyKcMLb5SZhqPM off=10432522 len=382324 2024-01-13T18:27:50.769 INFO:tasks.workunit.client.0.smithi084.stdout:op 2033 completed, throughput=4.99MB/sec 2024-01-13T18:27:50.769 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0gnEAjJ-xBwSZZ1 off=11891714 len=1217824 2024-01-13T18:27:50.776 INFO:tasks.workunit.client.0.smithi084.stdout:op 2034 completed, throughput=4.99MB/sec 2024-01-13T18:27:50.776 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-05I_u6s9Qt76qSk off=9558342 len=1986466 2024-01-13T18:27:50.783 INFO:tasks.workunit.client.0.smithi084.stdout:op 2035 completed, throughput=5MB/sec 2024-01-13T18:27:50.783 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-byiwjUmSH1CsyMF off=14593556 len=1061721 2024-01-13T18:27:50.784 INFO:tasks.workunit.client.0.smithi084.stdout:op 2036 completed, throughput=5MB/sec 2024-01-13T18:27:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:51 smithi099 ceph-mon[138788]: pgmap v1681: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:27:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:51 smithi084 ceph-mon[119097]: pgmap v1681: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:27:51.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:51 smithi084 ceph-mon[116404]: pgmap v1681: 105 pgs: 105 active+clean; 128 GiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:27:51.785 INFO:tasks.workunit.client.0.smithi084.stdout: 400: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:51.785 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6AgJyMUFRUNVBtZ off=5250196 len=836084 2024-01-13T18:27:51.790 INFO:tasks.workunit.client.0.smithi084.stdout:op 2037 completed, throughput=4.99MB/sec 2024-01-13T18:27:51.790 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ejvQdRuhPPvIFR9 off=15020808 len=1773468 2024-01-13T18:27:51.792 INFO:tasks.workunit.client.0.smithi084.stdout:op 2038 completed, throughput=5MB/sec 2024-01-13T18:27:51.792 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pXQTy11_zZfH4vE off=591626 len=1888927 2024-01-13T18:27:51.801 INFO:tasks.workunit.client.0.smithi084.stdout:op 2039 completed, throughput=5MB/sec 2024-01-13T18:27:52.802 INFO:tasks.workunit.client.0.smithi084.stdout: 401: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:52.802 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-D380Tq0HAerBcGl off=161017 len=1793967 2024-01-13T18:27:52.803 INFO:tasks.workunit.client.0.smithi084.stdout:op 2040 completed, throughput=4.99MB/sec 2024-01-13T18:27:52.804 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gyofuxFSjRYDwQ5 off=4336564 len=1938796 2024-01-13T18:27:52.806 INFO:tasks.workunit.client.0.smithi084.stdout:op 2041 completed, throughput=5MB/sec 2024-01-13T18:27:52.806 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rDALOAKeSJRQvcp off=4938140 len=146231 2024-01-13T18:27:52.807 INFO:tasks.workunit.client.0.smithi084.stdout:op 2042 completed, throughput=5MB/sec 2024-01-13T18:27:52.807 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-s9jNKkeAELQ8Y9I off=3017168 len=387888 2024-01-13T18:27:52.810 INFO:tasks.workunit.client.0.smithi084.stdout:op 2043 completed, throughput=5MB/sec 2024-01-13T18:27:52.810 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NqQPdV2eovUF55C off=16767727 len=14237 2024-01-13T18:27:52.810 INFO:tasks.workunit.client.0.smithi084.stdout:op 2044 completed, throughput=5MB/sec 2024-01-13T18:27:52.811 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ha18aI_jo19MZrm off=5059333 len=1031029 2024-01-13T18:27:52.816 INFO:tasks.workunit.client.0.smithi084.stdout:op 2045 completed, throughput=5MB/sec 2024-01-13T18:27:53.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:53 smithi084 ceph-mon[116404]: pgmap v1682: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:27:53.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:53 smithi084 ceph-mon[119097]: pgmap v1682: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:27:53.816 INFO:tasks.workunit.client.0.smithi084.stdout: 402: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:53.816 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Tkwf2Foz_iNyaW7 off=2063284 len=214051 2024-01-13T18:27:53.817 INFO:tasks.workunit.client.0.smithi084.stdout:op 2046 completed, throughput=4.99MB/sec 2024-01-13T18:27:53.817 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0_TEHXSSMfXBy32 off=5931038 len=547633 2024-01-13T18:27:53.818 INFO:tasks.workunit.client.0.smithi084.stdout:op 2047 completed, throughput=4.99MB/sec 2024-01-13T18:27:53.818 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ETe3l27T4mM87FR off=7498637 len=1598637 2024-01-13T18:27:53.821 INFO:tasks.workunit.client.0.smithi084.stdout:op 2048 completed, throughput=4.99MB/sec 2024-01-13T18:27:53.823 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XvyK_wpS1sNBCyS off=13917650 len=1191013 2024-01-13T18:27:53.827 INFO:tasks.workunit.client.0.smithi084.stdout:op 2049 completed, throughput=5MB/sec 2024-01-13T18:27:53.827 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2i2dXN7FLYXTfPQ off=4634192 len=404985 2024-01-13T18:27:53.830 INFO:tasks.workunit.client.0.smithi084.stdout:op 2050 completed, throughput=5MB/sec 2024-01-13T18:27:53.830 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MdGahmRe3BKQUIi off=1551440 len=508188 2024-01-13T18:27:53.833 INFO:tasks.workunit.client.0.smithi084.stdout:op 2051 completed, throughput=5MB/sec 2024-01-13T18:27:53.834 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ffbOnPaLiT2ZudP off=17623531 len=265165 2024-01-13T18:27:53.834 INFO:tasks.workunit.client.0.smithi084.stdout:op 2052 completed, throughput=5MB/sec 2024-01-13T18:27:53.834 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aWX5gAzGoBQgpqQ off=1377623 len=180587 2024-01-13T18:27:53.835 INFO:tasks.workunit.client.0.smithi084.stdout:op 2053 completed, throughput=5MB/sec 2024-01-13T18:27:53.835 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JlUIIVR4wRNN5xb off=13469062 len=283012 2024-01-13T18:27:53.835 INFO:tasks.workunit.client.0.smithi084.stdout:op 2054 completed, throughput=5MB/sec 2024-01-13T18:27:53.836 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_K1AsF_4W25j4rP off=8186827 len=31570 2024-01-13T18:27:53.836 INFO:tasks.workunit.client.0.smithi084.stdout:op 2055 completed, throughput=5MB/sec 2024-01-13T18:27:53.836 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2Kbk5JRGgiZI0Ad off=659806 len=151894 2024-01-13T18:27:53.836 INFO:tasks.workunit.client.0.smithi084.stdout:op 2056 completed, throughput=5MB/sec 2024-01-13T18:27:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:53 smithi099 ceph-mon[138788]: pgmap v1682: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:27:54.837 INFO:tasks.workunit.client.0.smithi084.stdout: 403: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:54.837 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e7vwdEAPd_D4Xti off=3338345 len=897234 2024-01-13T18:27:54.841 INFO:tasks.workunit.client.0.smithi084.stdout:op 2057 completed, throughput=4.99MB/sec 2024-01-13T18:27:54.842 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8dYLIR1zXwtqoSW off=22217342 len=1278614 2024-01-13T18:27:54.843 INFO:tasks.workunit.client.0.smithi084.stdout:op 2058 completed, throughput=4.99MB/sec 2024-01-13T18:27:54.843 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-L6ODYKIO37-_cx- off=2886869 len=1484788 2024-01-13T18:27:54.852 INFO:tasks.workunit.client.0.smithi084.stdout:op 2059 completed, throughput=5MB/sec 2024-01-13T18:27:54.853 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4gF_u_ZyPnw_HEx off=10053998 len=609265 2024-01-13T18:27:54.854 INFO:tasks.workunit.client.0.smithi084.stdout:op 2060 completed, throughput=5MB/sec 2024-01-13T18:27:54.854 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZPKYevdhU9yIzxU off=12624519 len=2093129 2024-01-13T18:27:54.857 INFO:tasks.workunit.client.0.smithi084.stdout:op 2061 completed, throughput=5MB/sec 2024-01-13T18:27:55.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:55 smithi084 ceph-mon[116404]: pgmap v1683: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:27:55.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:55 smithi084 ceph-mon[119097]: pgmap v1683: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:27:55.857 INFO:tasks.workunit.client.0.smithi084.stdout: 404: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:55.857 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MdjS96hi263ugzn off=125133 len=774152 2024-01-13T18:27:55.858 INFO:tasks.workunit.client.0.smithi084.stdout:op 2062 completed, throughput=4.99MB/sec 2024-01-13T18:27:55.859 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xM6Anf7vBBetpV4 off=10139146 len=1081210 2024-01-13T18:27:55.860 INFO:tasks.workunit.client.0.smithi084.stdout:op 2063 completed, throughput=4.99MB/sec 2024-01-13T18:27:55.860 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FA2vPWl_AQ4J36r off=8510067 len=1017182 2024-01-13T18:27:55.861 INFO:tasks.workunit.client.0.smithi084.stdout:op 2064 completed, throughput=5MB/sec 2024-01-13T18:27:55.861 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-R0Hpblu7CpIzTWx off=6246935 len=993545 2024-01-13T18:27:55.866 INFO:tasks.workunit.client.0.smithi084.stdout:op 2065 completed, throughput=5MB/sec 2024-01-13T18:27:55.867 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8d5HDTvZf9Opgai off=7049077 len=767614 2024-01-13T18:27:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:55 smithi099 ceph-mon[138788]: pgmap v1683: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:27:55.868 INFO:tasks.workunit.client.0.smithi084.stdout:op 2066 completed, throughput=5MB/sec 2024-01-13T18:27:56.868 INFO:tasks.workunit.client.0.smithi084.stdout: 405: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:56.868 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RIizaqMXIkkn6K5 off=2993783 len=741101 2024-01-13T18:27:56.869 INFO:tasks.workunit.client.0.smithi084.stdout:op 2067 completed, throughput=4.99MB/sec 2024-01-13T18:27:56.869 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IPVyO8FOiTFFutE off=8882035 len=1543344 2024-01-13T18:27:56.871 INFO:tasks.workunit.client.0.smithi084.stdout:op 2068 completed, throughput=4.99MB/sec 2024-01-13T18:27:56.871 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4QMQAOvGrtssxMC off=10706810 len=1719458 2024-01-13T18:27:56.878 INFO:tasks.workunit.client.0.smithi084.stdout:op 2069 completed, throughput=5MB/sec 2024-01-13T18:27:56.878 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OZFTmnxOz2TLwNz off=1988134 len=1732673 2024-01-13T18:27:56.880 INFO:tasks.workunit.client.0.smithi084.stdout:op 2070 completed, throughput=5MB/sec 2024-01-13T18:27:57.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:57 smithi084 ceph-mon[116404]: pgmap v1684: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:27:57.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:57 smithi084 ceph-mon[119097]: pgmap v1684: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:27:57.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:57 smithi099 ceph-mon[138788]: pgmap v1684: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:27:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: 406: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:57.881 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YIQ4h8vyddjqcgR off=16356849 len=1066112 2024-01-13T18:27:57.886 INFO:tasks.workunit.client.0.smithi084.stdout:op 2071 completed, throughput=4.99MB/sec 2024-01-13T18:27:57.886 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Dy6aUw3IPwZN9LR off=757066 len=1062808 2024-01-13T18:27:57.888 INFO:tasks.workunit.client.0.smithi084.stdout:op 2072 completed, throughput=4.99MB/sec 2024-01-13T18:27:57.888 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-60knDYAZ_t4Po-_ off=6867774 len=1220559 2024-01-13T18:27:57.889 INFO:tasks.workunit.client.0.smithi084.stdout:op 2073 completed, throughput=5MB/sec 2024-01-13T18:27:57.889 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2S6NBhQ5C1LPnPD off=504279 len=134589 2024-01-13T18:27:57.892 INFO:tasks.workunit.client.0.smithi084.stdout:op 2074 completed, throughput=5MB/sec 2024-01-13T18:27:57.892 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-p2gm2-blDVXHAb8 off=3349213 len=1084198 2024-01-13T18:27:57.896 INFO:tasks.workunit.client.0.smithi084.stdout:op 2075 completed, throughput=5MB/sec 2024-01-13T18:27:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: 407: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:58.897 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dGYIeMHOWN9k02d off=1981022 len=980658 2024-01-13T18:27:58.897 INFO:tasks.workunit.client.0.smithi084.stdout:op 2076 completed, throughput=4.99MB/sec 2024-01-13T18:27:58.898 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yf4OaBl2v36wv2D off=4930436 len=6858 2024-01-13T18:27:58.898 INFO:tasks.workunit.client.0.smithi084.stdout:op 2077 completed, throughput=4.99MB/sec 2024-01-13T18:27:58.898 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kBuEKDGDIFXT2Ep off=20235113 len=404174 2024-01-13T18:27:58.899 INFO:tasks.workunit.client.0.smithi084.stdout:op 2078 completed, throughput=4.99MB/sec 2024-01-13T18:27:58.899 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zcqVa7Eius3Y4oA off=6495890 len=1109787 2024-01-13T18:27:58.905 INFO:tasks.workunit.client.0.smithi084.stdout:op 2079 completed, throughput=4.99MB/sec 2024-01-13T18:27:58.905 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PKG3UBtLxw2kVD0 off=11205212 len=98439 2024-01-13T18:27:58.907 INFO:tasks.workunit.client.0.smithi084.stdout:op 2080 completed, throughput=4.99MB/sec 2024-01-13T18:27:58.907 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Kzuf5ffZuDDQWRj off=11346961 len=980750 2024-01-13T18:27:58.909 INFO:tasks.workunit.client.0.smithi084.stdout:op 2081 completed, throughput=5MB/sec 2024-01-13T18:27:58.909 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9AtaNhLrRwdYhBR off=11846434 len=1459559 2024-01-13T18:27:58.916 INFO:tasks.workunit.client.0.smithi084.stdout:op 2082 completed, throughput=5MB/sec 2024-01-13T18:27:58.916 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TRlh_8ADeGa7Yqw off=5389544 len=680738 2024-01-13T18:27:58.919 INFO:tasks.workunit.client.0.smithi084.stdout:op 2083 completed, throughput=5MB/sec 2024-01-13T18:27:59.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:27:59 smithi099 ceph-mon[138788]: pgmap v1685: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:27:59.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:27:59 smithi084 ceph-mon[116404]: pgmap v1685: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:27:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:27:59 smithi084 ceph-mon[119097]: pgmap v1685: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:27:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: 408: throughput=4.99MB/sec pending data=0 2024-01-13T18:27:59.920 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gT1ffpY-AkOA4BE off=15424715 len=1085692 2024-01-13T18:27:59.925 INFO:tasks.workunit.client.0.smithi084.stdout:op 2084 completed, throughput=4.99MB/sec 2024-01-13T18:27:59.925 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ogcd-QzhxOyCh7g off=1565558 len=292577 2024-01-13T18:27:59.928 INFO:tasks.workunit.client.0.smithi084.stdout:op 2085 completed, throughput=4.99MB/sec 2024-01-13T18:27:59.928 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BJ4YgOGryW8Jnty off=732062 len=289561 2024-01-13T18:27:59.931 INFO:tasks.workunit.client.0.smithi084.stdout:op 2086 completed, throughput=4.99MB/sec 2024-01-13T18:27:59.931 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TTZubOb38KOUlxV off=16433692 len=965519 2024-01-13T18:27:59.936 INFO:tasks.workunit.client.0.smithi084.stdout:op 2087 completed, throughput=4.99MB/sec 2024-01-13T18:27:59.936 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qqnmW28s8kyFAA2 off=3868380 len=888978 2024-01-13T18:27:59.937 INFO:tasks.workunit.client.0.smithi084.stdout:op 2088 completed, throughput=5MB/sec 2024-01-13T18:27:59.937 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gnWhKpYzZIXNQZ- off=4334467 len=300953 2024-01-13T18:27:59.940 INFO:tasks.workunit.client.0.smithi084.stdout:op 2089 completed, throughput=5MB/sec 2024-01-13T18:27:59.940 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FzWJNNNNDlD5TbR off=7246097 len=1532477 2024-01-13T18:27:59.947 INFO:tasks.workunit.client.0.smithi084.stdout:op 2090 completed, throughput=5MB/sec 2024-01-13T18:28:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:28:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:28:00] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:28:00.947 INFO:tasks.workunit.client.0.smithi084.stdout: 409: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:00.947 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hekJjRgc2K-_B5P off=651602 len=1894338 2024-01-13T18:28:00.949 INFO:tasks.workunit.client.0.smithi084.stdout:op 2091 completed, throughput=4.99MB/sec 2024-01-13T18:28:00.949 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_lqGQTqBjRZ3C4J off=2096163 len=86137 2024-01-13T18:28:00.952 INFO:tasks.workunit.client.0.smithi084.stdout:op 2092 completed, throughput=4.99MB/sec 2024-01-13T18:28:00.952 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rpYbR-_isPj1j6S off=7711987 len=323193 2024-01-13T18:28:00.955 INFO:tasks.workunit.client.0.smithi084.stdout:op 2093 completed, throughput=4.99MB/sec 2024-01-13T18:28:00.955 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-heu8Epqh2xOxI5Z off=17692319 len=1013822 2024-01-13T18:28:00.960 INFO:tasks.workunit.client.0.smithi084.stdout:op 2094 completed, throughput=5MB/sec 2024-01-13T18:28:00.960 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ppG3S7mY0YfublB off=15479285 len=1413349 2024-01-13T18:28:00.962 INFO:tasks.workunit.client.0.smithi084.stdout:op 2095 completed, throughput=5MB/sec 2024-01-13T18:28:00.962 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Mi2SxtIuJM42ZoI off=3704219 len=1227696 2024-01-13T18:28:00.965 INFO:tasks.workunit.client.0.smithi084.stdout:op 2096 completed, throughput=5MB/sec 2024-01-13T18:28:01.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:01 smithi084 ceph-mon[116404]: pgmap v1686: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:28:01.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:01 smithi084 ceph-mon[119097]: pgmap v1686: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:28:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:01 smithi099 ceph-mon[138788]: pgmap v1686: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:28:01.965 INFO:tasks.workunit.client.0.smithi084.stdout: 410: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:01.965 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-00mnl-BDJypdMAP off=223492 len=538582 2024-01-13T18:28:01.969 INFO:tasks.workunit.client.0.smithi084.stdout:op 2097 completed, throughput=4.99MB/sec 2024-01-13T18:28:01.970 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_GPnRPsrBWg6Bew off=6514349 len=1851456 2024-01-13T18:28:01.972 INFO:tasks.workunit.client.0.smithi084.stdout:op 2098 completed, throughput=5MB/sec 2024-01-13T18:28:01.972 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-t1w51fmVm-jbFxr off=1398419 len=1780793 2024-01-13T18:28:01.974 INFO:tasks.workunit.client.0.smithi084.stdout:op 2099 completed, throughput=5MB/sec 2024-01-13T18:28:01.974 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kAwhcerPRs3lh7P off=14907233 len=140256 2024-01-13T18:28:01.974 INFO:tasks.workunit.client.0.smithi084.stdout:op 2100 completed, throughput=5MB/sec 2024-01-13T18:28:02.975 INFO:tasks.workunit.client.0.smithi084.stdout: 411: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:02.975 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-21t2qUf6S0OKijW off=6777805 len=254375 2024-01-13T18:28:02.979 INFO:tasks.workunit.client.0.smithi084.stdout:op 2101 completed, throughput=4.99MB/sec 2024-01-13T18:28:02.979 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uYwa8-srbh3QpXV off=10934399 len=1598757 2024-01-13T18:28:02.980 INFO:tasks.workunit.client.0.smithi084.stdout:op 2102 completed, throughput=4.99MB/sec 2024-01-13T18:28:02.980 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2-MQ2txa42mwZzg off=6458427 len=1498943 2024-01-13T18:28:02.984 INFO:tasks.workunit.client.0.smithi084.stdout:op 2103 completed, throughput=5MB/sec 2024-01-13T18:28:02.984 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HmRSdiQUz-dW-Zd off=18022025 len=887796 2024-01-13T18:28:02.985 INFO:tasks.workunit.client.0.smithi084.stdout:op 2104 completed, throughput=5MB/sec 2024-01-13T18:28:02.985 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YElq2DshIrx8iMM off=3593658 len=650972 2024-01-13T18:28:02.989 INFO:tasks.workunit.client.0.smithi084.stdout:op 2105 completed, throughput=5MB/sec 2024-01-13T18:28:02.989 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yYZA7ZrnBlCnNRK off=13812454 len=1168175 2024-01-13T18:28:02.990 INFO:tasks.workunit.client.0.smithi084.stdout:op 2106 completed, throughput=5MB/sec 2024-01-13T18:28:03.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:03 smithi084 ceph-mon[116404]: pgmap v1687: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:28:03.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:03 smithi084 ceph-mon[119097]: pgmap v1687: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:28:03.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:03 smithi099 ceph-mon[138788]: pgmap v1687: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:28:03.991 INFO:tasks.workunit.client.0.smithi084.stdout: 412: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:03.991 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FLz4GE3CBnjUjeA off=4039917 len=1305233 2024-01-13T18:28:03.992 INFO:tasks.workunit.client.0.smithi084.stdout:op 2107 completed, throughput=4.99MB/sec 2024-01-13T18:28:03.992 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oQnwAaB6WGP9AjV off=0 len=1167106 2024-01-13T18:28:03.999 INFO:tasks.workunit.client.0.smithi084.stdout:op 2108 completed, throughput=5MB/sec 2024-01-13T18:28:03.999 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Nk6xFBb_2l9VWfe off=722177 len=1719352 2024-01-13T18:28:04.006 INFO:tasks.workunit.client.0.smithi084.stdout:op 2109 completed, throughput=5MB/sec 2024-01-13T18:28:04.006 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-W0yzfBOdHOkvvXJ off=7223698 len=2030093 2024-01-13T18:28:04.008 INFO:tasks.workunit.client.0.smithi084.stdout:op 2110 completed, throughput=5MB/sec 2024-01-13T18:28:05.008 INFO:tasks.workunit.client.0.smithi084.stdout: 413: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:05.008 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yU60WdvKNHhIfc1 off=12811504 len=1425968 2024-01-13T18:28:05.016 INFO:tasks.workunit.client.0.smithi084.stdout:op 2111 completed, throughput=5MB/sec 2024-01-13T18:28:05.016 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UNNdz9S0cZpsmKp off=5546071 len=715321 2024-01-13T18:28:05.020 INFO:tasks.workunit.client.0.smithi084.stdout:op 2112 completed, throughput=5MB/sec 2024-01-13T18:28:05.020 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0OCBBMc79CH3xQj off=6227193 len=1307285 2024-01-13T18:28:05.022 INFO:tasks.workunit.client.0.smithi084.stdout:op 2113 completed, throughput=5MB/sec 2024-01-13T18:28:05.022 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bAHPkf0mGypwFzh off=9161670 len=407788 2024-01-13T18:28:05.025 INFO:tasks.workunit.client.0.smithi084.stdout:op 2114 completed, throughput=5MB/sec 2024-01-13T18:28:05.617 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:28:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=cleanup t=2024-01-13T18:28:05.351208339Z level=info msg="Completed cleanup jobs" duration=12.909182ms 2024-01-13T18:28:05.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:05 smithi099 ceph-mon[138788]: pgmap v1688: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:28:05.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:05.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:05 smithi084 ceph-mon[119097]: pgmap v1688: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:28:05.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:05.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:05 smithi084 ceph-mon[116404]: pgmap v1688: 105 pgs: 105 active+clean; 128 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:28:05.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:06.025 INFO:tasks.workunit.client.0.smithi084.stdout: 414: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:06.025 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KbeWB4a6yE2yBkY off=1170925 len=53215 2024-01-13T18:28:06.026 INFO:tasks.workunit.client.0.smithi084.stdout:op 2115 completed, throughput=4.99MB/sec 2024-01-13T18:28:06.026 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6B9JIpV2wJoL-mk off=993904 len=170105 2024-01-13T18:28:06.027 INFO:tasks.workunit.client.0.smithi084.stdout:op 2116 completed, throughput=4.99MB/sec 2024-01-13T18:28:06.027 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DRR0R8JfXEbw04g off=19692575 len=1242940 2024-01-13T18:28:06.032 INFO:tasks.workunit.client.0.smithi084.stdout:op 2117 completed, throughput=4.99MB/sec 2024-01-13T18:28:06.032 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sYka_hWCioMgCs6 off=1847775 len=1204274 2024-01-13T18:28:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:op 2118 completed, throughput=4.99MB/sec 2024-01-13T18:28:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Pg_wHDWWlLqQC0J off=2215994 len=1283618 2024-01-13T18:28:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:op 2119 completed, throughput=5MB/sec 2024-01-13T18:28:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-O8IggCH9HOZ7sdY off=12316446 len=1578081 2024-01-13T18:28:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:op 2120 completed, throughput=5MB/sec 2024-01-13T18:28:07.050 INFO:tasks.workunit.client.0.smithi084.stdout: 415: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:07.051 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SnrrcwkWGO5iOfx off=450158 len=1311706 2024-01-13T18:28:07.057 INFO:tasks.workunit.client.0.smithi084.stdout:op 2121 completed, throughput=4.99MB/sec 2024-01-13T18:28:07.057 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eGIVhoNZzgxH-J_ off=854057 len=1644533 2024-01-13T18:28:07.063 INFO:tasks.workunit.client.0.smithi084.stdout:op 2122 completed, throughput=5MB/sec 2024-01-13T18:28:07.063 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0J27xq_g9QY3qKa off=11453548 len=239037 2024-01-13T18:28:07.064 INFO:tasks.workunit.client.0.smithi084.stdout:op 2123 completed, throughput=5MB/sec 2024-01-13T18:28:07.064 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Agt1OKyJG774DBZ off=536783 len=881097 2024-01-13T18:28:07.068 INFO:tasks.workunit.client.0.smithi084.stdout:op 2124 completed, throughput=5MB/sec 2024-01-13T18:28:07.068 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ixZManqMlCh23Jl off=28877 len=1199041 2024-01-13T18:28:07.074 INFO:tasks.workunit.client.0.smithi084.stdout:op 2125 completed, throughput=5MB/sec 2024-01-13T18:28:07.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:07 smithi099 ceph-mon[138788]: pgmap v1689: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:28:07.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:07 smithi084 ceph-mon[116404]: pgmap v1689: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:28:07.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:07 smithi084 ceph-mon[119097]: pgmap v1689: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:28:08.074 INFO:tasks.workunit.client.0.smithi084.stdout: 416: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:08.074 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n2xpYXKu4b8Q0uW off=8484487 len=968609 2024-01-13T18:28:08.076 INFO:tasks.workunit.client.0.smithi084.stdout:op 2126 completed, throughput=4.99MB/sec 2024-01-13T18:28:08.076 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6A3X4j-H1_Jk5Gu off=15748227 len=832752 2024-01-13T18:28:08.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 2127 completed, throughput=4.99MB/sec 2024-01-13T18:28:08.081 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TzrnQbfSIuGPbVO off=2234829 len=457556 2024-01-13T18:28:08.082 INFO:tasks.workunit.client.0.smithi084.stdout:op 2128 completed, throughput=4.99MB/sec 2024-01-13T18:28:08.082 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dTgPKtpeq4zw3gm off=14932217 len=1222933 2024-01-13T18:28:08.087 INFO:tasks.workunit.client.0.smithi084.stdout:op 2129 completed, throughput=5MB/sec 2024-01-13T18:28:08.087 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kNypXCs4Rbpi98i off=1747824 len=814854 2024-01-13T18:28:08.090 INFO:tasks.workunit.client.0.smithi084.stdout:op 2130 completed, throughput=5MB/sec 2024-01-13T18:28:08.090 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mYD0IdLMXB9T2PE off=3209642 len=1940605 2024-01-13T18:28:08.100 INFO:tasks.workunit.client.0.smithi084.stdout:op 2131 completed, throughput=5MB/sec 2024-01-13T18:28:09.101 INFO:tasks.workunit.client.0.smithi084.stdout: 417: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:09.101 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BfOcZ3Hk1Z0Engl off=7333132 len=1016564 2024-01-13T18:28:09.106 INFO:tasks.workunit.client.0.smithi084.stdout:op 2132 completed, throughput=4.99MB/sec 2024-01-13T18:28:09.106 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xJjD3GSNsWIgz2V off=13033532 len=1739540 2024-01-13T18:28:09.115 INFO:tasks.workunit.client.0.smithi084.stdout:op 2133 completed, throughput=5MB/sec 2024-01-13T18:28:09.115 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qznSxpXNu36AoJb off=9104192 len=1325405 2024-01-13T18:28:09.117 INFO:tasks.workunit.client.0.smithi084.stdout:op 2134 completed, throughput=5MB/sec 2024-01-13T18:28:09.117 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6Xzr2xlXYMlPMvH off=7733131 len=789817 2024-01-13T18:28:09.121 INFO:tasks.workunit.client.0.smithi084.stdout:op 2135 completed, throughput=5MB/sec 2024-01-13T18:28:09.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:09 smithi099 ceph-mon[138788]: pgmap v1690: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:28:09.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:09 smithi084 ceph-mon[116404]: pgmap v1690: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:28:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:09 smithi084 ceph-mon[119097]: pgmap v1690: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:28:10.121 INFO:tasks.workunit.client.0.smithi084.stdout: 418: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:10.122 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZI-TXZ_suHVKlUZ off=2019658 len=2039172 2024-01-13T18:28:10.133 INFO:tasks.workunit.client.0.smithi084.stdout:op 2136 completed, throughput=4.99MB/sec 2024-01-13T18:28:10.134 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zHIwLkZkaqZfx80 off=1030894 len=1783565 2024-01-13T18:28:10.145 INFO:tasks.workunit.client.0.smithi084.stdout:op 2137 completed, throughput=5MB/sec 2024-01-13T18:28:10.145 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Daf7nnLB7Dcqkzy off=4961263 len=1686695 2024-01-13T18:28:10.148 INFO:tasks.workunit.client.0.smithi084.stdout:op 2138 completed, throughput=5MB/sec 2024-01-13T18:28:10.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:28:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:28:10] "GET /metrics HTTP/1.1" 200 33994 "" "Prometheus/2.43.0" 2024-01-13T18:28:11.148 INFO:tasks.workunit.client.0.smithi084.stdout: 419: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:11.148 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lodWvvPvyYe5zj4 off=6008249 len=404655 2024-01-13T18:28:11.149 INFO:tasks.workunit.client.0.smithi084.stdout:op 2139 completed, throughput=4.99MB/sec 2024-01-13T18:28:11.149 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wuU4BzVQBA8gUan off=4897552 len=760734 2024-01-13T18:28:11.150 INFO:tasks.workunit.client.0.smithi084.stdout:op 2140 completed, throughput=4.99MB/sec 2024-01-13T18:28:11.150 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ycErXUYJPYn1_m0 off=13024906 len=1548979 2024-01-13T18:28:11.160 INFO:tasks.workunit.client.0.smithi084.stdout:op 2141 completed, throughput=5MB/sec 2024-01-13T18:28:11.160 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2tRNt3DMEO_ROzb off=11903641 len=616539 2024-01-13T18:28:11.161 INFO:tasks.workunit.client.0.smithi084.stdout:op 2142 completed, throughput=5MB/sec 2024-01-13T18:28:11.161 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gDfv7iTFwp7sAYk off=2936904 len=921956 2024-01-13T18:28:11.162 INFO:tasks.workunit.client.0.smithi084.stdout:op 2143 completed, throughput=5MB/sec 2024-01-13T18:28:11.162 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KfmB-I2yzkLaGET off=2415907 len=48226 2024-01-13T18:28:11.165 INFO:tasks.workunit.client.0.smithi084.stdout:op 2144 completed, throughput=5MB/sec 2024-01-13T18:28:11.165 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-t8MpXqJLbFYQZ3U off=1194874 len=1218152 2024-01-13T18:28:11.170 INFO:tasks.workunit.client.0.smithi084.stdout:op 2145 completed, throughput=5MB/sec 2024-01-13T18:28:11.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:11 smithi099 ceph-mon[138788]: pgmap v1691: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:28:11.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:11 smithi084 ceph-mon[116404]: pgmap v1691: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:28:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:11 smithi084 ceph-mon[119097]: pgmap v1691: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:28:12.170 INFO:tasks.workunit.client.0.smithi084.stdout: 420: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:12.171 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rWxDccCuK9go2Vw off=2031547 len=441396 2024-01-13T18:28:12.174 INFO:tasks.workunit.client.0.smithi084.stdout:op 2146 completed, throughput=4.99MB/sec 2024-01-13T18:28:12.174 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-d4SF4NjFkWXD2lj off=6299 len=1870829 2024-01-13T18:28:12.184 INFO:tasks.workunit.client.0.smithi084.stdout:op 2147 completed, throughput=5MB/sec 2024-01-13T18:28:12.185 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-V5V3ZJ0oa5ZB9XV off=2596011 len=761251 2024-01-13T18:28:12.189 INFO:tasks.workunit.client.0.smithi084.stdout:op 2148 completed, throughput=5MB/sec 2024-01-13T18:28:12.189 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FGtQvDyMFTWjd03 off=1223471 len=741724 2024-01-13T18:28:12.190 INFO:tasks.workunit.client.0.smithi084.stdout:op 2149 completed, throughput=5MB/sec 2024-01-13T18:28:12.190 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bz1ryptFWVp2zJg off=6675306 len=128851 2024-01-13T18:28:12.192 INFO:tasks.workunit.client.0.smithi084.stdout:op 2150 completed, throughput=5MB/sec 2024-01-13T18:28:12.192 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ra0fbQCfmEkByAa off=5418824 len=1741473 2024-01-13T18:28:12.200 INFO:tasks.workunit.client.0.smithi084.stdout:op 2151 completed, throughput=5MB/sec 2024-01-13T18:28:13.201 INFO:tasks.workunit.client.0.smithi084.stdout: 421: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:13.201 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SnsQNXnkjRaiY-R off=10313320 len=1996837 2024-01-13T18:28:13.203 INFO:tasks.workunit.client.0.smithi084.stdout:op 2152 completed, throughput=5MB/sec 2024-01-13T18:28:13.203 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-R_RxN7jECJ0uHKn off=5382736 len=1472221 2024-01-13T18:28:13.205 INFO:tasks.workunit.client.0.smithi084.stdout:op 2153 completed, throughput=5MB/sec 2024-01-13T18:28:13.205 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xDtP_h-BML7Dt8v off=18356137 len=1651467 2024-01-13T18:28:13.213 INFO:tasks.workunit.client.0.smithi084.stdout:op 2154 completed, throughput=5MB/sec 2024-01-13T18:28:13.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:13 smithi099 ceph-mon[138788]: pgmap v1692: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:28:13.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:13 smithi084 ceph-mon[116404]: pgmap v1692: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:28:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:13 smithi084 ceph-mon[119097]: pgmap v1692: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:28:14.214 INFO:tasks.workunit.client.0.smithi084.stdout: 422: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:14.214 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5zP8RnOtU_vZnFB off=5933256 len=283552 2024-01-13T18:28:14.214 INFO:tasks.workunit.client.0.smithi084.stdout:op 2155 completed, throughput=4.99MB/sec 2024-01-13T18:28:14.214 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MeH0UgfHo5ctgXP off=2396830 len=1485213 2024-01-13T18:28:14.221 INFO:tasks.workunit.client.0.smithi084.stdout:op 2156 completed, throughput=4.99MB/sec 2024-01-13T18:28:14.221 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SZq6za48K8vCgVD off=7163529 len=218329 2024-01-13T18:28:14.222 INFO:tasks.workunit.client.0.smithi084.stdout:op 2157 completed, throughput=4.99MB/sec 2024-01-13T18:28:14.222 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EdtRuMoK5UTtt-K off=1867114 len=1207227 2024-01-13T18:28:14.223 INFO:tasks.workunit.client.0.smithi084.stdout:op 2158 completed, throughput=5MB/sec 2024-01-13T18:28:14.223 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mUaD8BlwYdn7F_A off=6002169 len=1488673 2024-01-13T18:28:14.225 INFO:tasks.workunit.client.0.smithi084.stdout:op 2159 completed, throughput=5MB/sec 2024-01-13T18:28:15.225 INFO:tasks.workunit.client.0.smithi084.stdout: 423: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:15.226 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cbr3K2eYCbBIrX1 off=2486982 len=969071 2024-01-13T18:28:15.230 INFO:tasks.workunit.client.0.smithi084.stdout:op 2160 completed, throughput=4.99MB/sec 2024-01-13T18:28:15.231 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aS44FXV8-iQuB0z off=10067087 len=1662017 2024-01-13T18:28:15.238 INFO:tasks.workunit.client.0.smithi084.stdout:op 2161 completed, throughput=4.99MB/sec 2024-01-13T18:28:15.238 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--IoNlf9PDmI8qAS off=8641601 len=912849 2024-01-13T18:28:15.240 INFO:tasks.workunit.client.0.smithi084.stdout:op 2162 completed, throughput=5MB/sec 2024-01-13T18:28:15.240 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-t5_hsVkQhnl8TIF off=3723788 len=1876984 2024-01-13T18:28:15.242 INFO:tasks.workunit.client.0.smithi084.stdout:op 2163 completed, throughput=5MB/sec 2024-01-13T18:28:15.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:15 smithi099 ceph-mon[138788]: pgmap v1693: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:28:15.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:15 smithi084 ceph-mon[116404]: pgmap v1693: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:28:15.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:15 smithi084 ceph-mon[119097]: pgmap v1693: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:28:16.242 INFO:tasks.workunit.client.0.smithi084.stdout: 424: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:16.242 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Bu93GQaMeHWw8Ld off=6608073 len=1418478 2024-01-13T18:28:16.250 INFO:tasks.workunit.client.0.smithi084.stdout:op 2164 completed, throughput=4.99MB/sec 2024-01-13T18:28:16.250 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rfzjHdAqjkjM988 off=73647 len=1125029 2024-01-13T18:28:16.254 INFO:tasks.workunit.client.0.smithi084.stdout:op 2165 completed, throughput=4.99MB/sec 2024-01-13T18:28:16.255 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MGVuoZDh9lxsGTb off=3676320 len=292900 2024-01-13T18:28:16.258 INFO:tasks.workunit.client.0.smithi084.stdout:op 2166 completed, throughput=5MB/sec 2024-01-13T18:28:16.258 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FhRWjRUksb-CFc2 off=441069 len=222262 2024-01-13T18:28:16.259 INFO:tasks.workunit.client.0.smithi084.stdout:op 2167 completed, throughput=5MB/sec 2024-01-13T18:28:16.259 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZDjO6INAMaNnxu6 off=1947311 len=721670 2024-01-13T18:28:16.262 INFO:tasks.workunit.client.0.smithi084.stdout:op 2168 completed, throughput=5MB/sec 2024-01-13T18:28:16.262 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-So7VF0sV9TNNuGx off=402087 len=1415895 2024-01-13T18:28:16.269 INFO:tasks.workunit.client.0.smithi084.stdout:op 2169 completed, throughput=5MB/sec 2024-01-13T18:28:17.269 INFO:tasks.workunit.client.0.smithi084.stdout: 425: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:17.270 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6KLNypaBVfwxr71 off=4133859 len=1623172 2024-01-13T18:28:17.271 INFO:tasks.workunit.client.0.smithi084.stdout:op 2170 completed, throughput=4.99MB/sec 2024-01-13T18:28:17.271 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ihV1OXKv4KVjHtb off=1658815 len=1751200 2024-01-13T18:28:17.281 INFO:tasks.workunit.client.0.smithi084.stdout:op 2171 completed, throughput=5MB/sec 2024-01-13T18:28:17.281 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wR20pp7RaoIyP-s off=2060893 len=438386 2024-01-13T18:28:17.282 INFO:tasks.workunit.client.0.smithi084.stdout:op 2172 completed, throughput=5MB/sec 2024-01-13T18:28:17.282 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UXTj85vEotMmtDb off=564234 len=528590 2024-01-13T18:28:17.283 INFO:tasks.workunit.client.0.smithi084.stdout:op 2173 completed, throughput=5MB/sec 2024-01-13T18:28:17.283 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-W7LqvlPU4wM_rTD off=9442345 len=1644910 2024-01-13T18:28:17.292 INFO:tasks.workunit.client.0.smithi084.stdout:op 2174 completed, throughput=5MB/sec 2024-01-13T18:28:17.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:17 smithi099 ceph-mon[138788]: pgmap v1694: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:28:17.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:17 smithi084 ceph-mon[116404]: pgmap v1694: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:28:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:17 smithi084 ceph-mon[119097]: pgmap v1694: 105 pgs: 105 active+clean; 128 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:28:18.293 INFO:tasks.workunit.client.0.smithi084.stdout: 426: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:18.293 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-W0nRKuZC0IMlH9X off=3102445 len=2011997 2024-01-13T18:28:18.297 INFO:tasks.workunit.client.0.smithi084.stdout:op 2175 completed, throughput=4.99MB/sec 2024-01-13T18:28:18.297 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y_QewitNGhQciVF off=19826244 len=1426736 2024-01-13T18:28:18.306 INFO:tasks.workunit.client.0.smithi084.stdout:op 2176 completed, throughput=5MB/sec 2024-01-13T18:28:18.306 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-i6w7RNkJTZh0WtO off=13735995 len=1955006 2024-01-13T18:28:18.308 INFO:tasks.workunit.client.0.smithi084.stdout:op 2177 completed, throughput=5MB/sec 2024-01-13T18:28:19.309 INFO:tasks.workunit.client.0.smithi084.stdout: 427: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:19.309 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FZLNhqS_DZl48av off=1952210 len=1378841 2024-01-13T18:28:19.311 INFO:tasks.workunit.client.0.smithi084.stdout:op 2178 completed, throughput=4.99MB/sec 2024-01-13T18:28:19.311 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N6Eie3OkwZuTGwT off=1028 len=1723466 2024-01-13T18:28:19.314 INFO:tasks.workunit.client.0.smithi084.stdout:op 2179 completed, throughput=5MB/sec 2024-01-13T18:28:19.314 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6s7TyFknK9EQhWs off=12938461 len=1205002 2024-01-13T18:28:19.320 INFO:tasks.workunit.client.0.smithi084.stdout:op 2180 completed, throughput=5MB/sec 2024-01-13T18:28:19.320 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sRdCTTPJeYvglwG off=507498 len=1107841 2024-01-13T18:28:19.321 INFO:tasks.workunit.client.0.smithi084.stdout:op 2181 completed, throughput=5MB/sec 2024-01-13T18:28:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:19 smithi099 ceph-mon[138788]: pgmap v1695: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:28:19.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:19 smithi084 ceph-mon[116404]: pgmap v1695: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:28:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:19 smithi084 ceph-mon[119097]: pgmap v1695: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:28:20.322 INFO:tasks.workunit.client.0.smithi084.stdout: 428: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:20.322 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JwIv2V_Lio-y5NR off=6738594 len=1002456 2024-01-13T18:28:20.323 INFO:tasks.workunit.client.0.smithi084.stdout:op 2182 completed, throughput=4.99MB/sec 2024-01-13T18:28:20.323 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uZDyMW-80qcaFze off=3099453 len=755484 2024-01-13T18:28:20.325 INFO:tasks.workunit.client.0.smithi084.stdout:op 2183 completed, throughput=4.99MB/sec 2024-01-13T18:28:20.325 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FYNchpAjsaFF-Tc off=10622077 len=1337833 2024-01-13T18:28:20.328 INFO:tasks.workunit.client.0.smithi084.stdout:op 2184 completed, throughput=5MB/sec 2024-01-13T18:28:20.328 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0baKF-lGJtHQHZj off=1422608 len=937159 2024-01-13T18:28:20.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 2185 completed, throughput=5MB/sec 2024-01-13T18:28:20.329 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hLMj-adnBsSgzX9 off=9445299 len=1371817 2024-01-13T18:28:20.338 INFO:tasks.workunit.client.0.smithi084.stdout:op 2186 completed, throughput=5MB/sec 2024-01-13T18:28:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:20.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:28:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:28:20] "GET /metrics HTTP/1.1" 200 33994 "" "Prometheus/2.43.0" 2024-01-13T18:28:21.338 INFO:tasks.workunit.client.0.smithi084.stdout: 429: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:21.338 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Fv-LE9lNWXvMtM1 off=1349269 len=831903 2024-01-13T18:28:21.343 INFO:tasks.workunit.client.0.smithi084.stdout:op 2187 completed, throughput=4.99MB/sec 2024-01-13T18:28:21.343 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-O2Kk21sRJ8qSXIj off=11499608 len=201766 2024-01-13T18:28:21.344 INFO:tasks.workunit.client.0.smithi084.stdout:op 2188 completed, throughput=4.99MB/sec 2024-01-13T18:28:21.344 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KKo-QvCDU1VsJN0 off=759382 len=925684 2024-01-13T18:28:21.347 INFO:tasks.workunit.client.0.smithi084.stdout:op 2189 completed, throughput=5MB/sec 2024-01-13T18:28:21.347 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WbaO2n7aM9J-NE1 off=1637120 len=392716 2024-01-13T18:28:21.348 INFO:tasks.workunit.client.0.smithi084.stdout:op 2190 completed, throughput=5MB/sec 2024-01-13T18:28:21.348 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gfs-lCm8Ojos-0b off=8864969 len=1549953 2024-01-13T18:28:21.350 INFO:tasks.workunit.client.0.smithi084.stdout:op 2191 completed, throughput=5MB/sec 2024-01-13T18:28:21.350 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ixZgJqH088kIQ8k off=15893076 len=717084 2024-01-13T18:28:21.354 INFO:tasks.workunit.client.0.smithi084.stdout:op 2192 completed, throughput=5MB/sec 2024-01-13T18:28:21.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:21 smithi099 ceph-mon[138788]: pgmap v1696: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:28:21.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:21 smithi084 ceph-mon[116404]: pgmap v1696: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:28:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:21 smithi084 ceph-mon[119097]: pgmap v1696: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:28:22.355 INFO:tasks.workunit.client.0.smithi084.stdout: 430: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:22.355 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aMcE-ibtwjlrfst off=393344 len=662353 2024-01-13T18:28:22.356 INFO:tasks.workunit.client.0.smithi084.stdout:op 2193 completed, throughput=4.99MB/sec 2024-01-13T18:28:22.356 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZS714VpHMTiIk59 off=2440018 len=701954 2024-01-13T18:28:22.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 2194 completed, throughput=4.99MB/sec 2024-01-13T18:28:22.361 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GqW2rHAq5nLaMFY off=3947122 len=2084594 2024-01-13T18:28:22.372 INFO:tasks.workunit.client.0.smithi084.stdout:op 2195 completed, throughput=5MB/sec 2024-01-13T18:28:22.373 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qCaOMjesI6fMJ1G off=523317 len=577884 2024-01-13T18:28:22.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 2196 completed, throughput=5MB/sec 2024-01-13T18:28:22.376 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PqUGQAWl_l7isFI off=2742505 len=765745 2024-01-13T18:28:22.380 INFO:tasks.workunit.client.0.smithi084.stdout:op 2197 completed, throughput=5MB/sec 2024-01-13T18:28:22.380 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SRs7pperLDzrgM2 off=8108633 len=1832842 2024-01-13T18:28:22.388 INFO:tasks.workunit.client.0.smithi084.stdout:op 2198 completed, throughput=5MB/sec 2024-01-13T18:28:23.388 INFO:tasks.workunit.client.0.smithi084.stdout: 431: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:23.388 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6AgJyMUFRUNVBtZ off=11053834 len=285359 2024-01-13T18:28:23.390 INFO:tasks.workunit.client.0.smithi084.stdout:op 2199 completed, throughput=4.99MB/sec 2024-01-13T18:28:23.390 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vU-so-tG9otuiP4 off=466857 len=783855 2024-01-13T18:28:23.394 INFO:tasks.workunit.client.0.smithi084.stdout:op 2200 completed, throughput=4.99MB/sec 2024-01-13T18:28:23.394 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gKLLWCyvAcX1Nuz off=4695847 len=1654882 2024-01-13T18:28:23.402 INFO:tasks.workunit.client.0.smithi084.stdout:op 2201 completed, throughput=5MB/sec 2024-01-13T18:28:23.402 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xRLyfBiX7zmubuH off=23653386 len=1350999 2024-01-13T18:28:23.404 INFO:tasks.workunit.client.0.smithi084.stdout:op 2202 completed, throughput=5MB/sec 2024-01-13T18:28:23.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:23 smithi084 ceph-mon[116404]: pgmap v1697: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:23.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:23 smithi084 ceph-mon[119097]: pgmap v1697: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:23 smithi099 ceph-mon[138788]: pgmap v1697: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:24.405 INFO:tasks.workunit.client.0.smithi084.stdout: 432: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:24.405 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lABth_ogBiR0L1V off=1913119 len=373412 2024-01-13T18:28:24.408 INFO:tasks.workunit.client.0.smithi084.stdout:op 2203 completed, throughput=4.99MB/sec 2024-01-13T18:28:24.408 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1eVmkckc8yVXKaC off=15496009 len=1563094 2024-01-13T18:28:24.414 INFO:tasks.workunit.client.0.smithi084.stdout:op 2204 completed, throughput=4.99MB/sec 2024-01-13T18:28:24.414 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n9v-ga_c_2rHx3B off=7355876 len=1889776 2024-01-13T18:28:24.424 INFO:tasks.workunit.client.0.smithi084.stdout:op 2205 completed, throughput=5MB/sec 2024-01-13T18:28:24.424 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ndL493H1G3-7QZk off=1413190 len=1183568 2024-01-13T18:28:24.431 INFO:tasks.workunit.client.0.smithi084.stdout:op 2206 completed, throughput=5MB/sec 2024-01-13T18:28:24.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:24 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:28:24.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:24 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:28:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:24 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:28:25.431 INFO:tasks.workunit.client.0.smithi084.stdout: 433: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:25.431 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ild62KyxeGf3rUM off=330885 len=301746 2024-01-13T18:28:25.432 INFO:tasks.workunit.client.0.smithi084.stdout:op 2207 completed, throughput=4.99MB/sec 2024-01-13T18:28:25.432 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-m2GhRpwq0lTvFtb off=2660583 len=1148318 2024-01-13T18:28:25.438 INFO:tasks.workunit.client.0.smithi084.stdout:op 2208 completed, throughput=4.99MB/sec 2024-01-13T18:28:25.438 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6ObWcTXRYlb0GDY off=3448593 len=248228 2024-01-13T18:28:25.438 INFO:tasks.workunit.client.0.smithi084.stdout:op 2209 completed, throughput=4.99MB/sec 2024-01-13T18:28:25.439 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7IFuT0I0XIYDUbW off=2897202 len=1484851 2024-01-13T18:28:25.447 INFO:tasks.workunit.client.0.smithi084.stdout:op 2210 completed, throughput=5MB/sec 2024-01-13T18:28:25.447 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8MmsJJdMu9VnHGE off=8744732 len=120994 2024-01-13T18:28:25.449 INFO:tasks.workunit.client.0.smithi084.stdout:op 2211 completed, throughput=5MB/sec 2024-01-13T18:28:25.449 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1IV4X8z7jCWGbdj off=452136 len=1907913 2024-01-13T18:28:25.451 INFO:tasks.workunit.client.0.smithi084.stdout:op 2212 completed, throughput=5MB/sec 2024-01-13T18:28:25.451 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FzGIUNDiu4-Ofc2 off=3213040 len=1338095 2024-01-13T18:28:25.452 INFO:tasks.workunit.client.0.smithi084.stdout:op 2213 completed, throughput=5MB/sec 2024-01-13T18:28:25.813 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:25 smithi099 ceph-mon[138788]: pgmap v1698: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:25.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:25 smithi084 ceph-mon[116404]: pgmap v1698: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:25.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:25 smithi084 ceph-mon[119097]: pgmap v1698: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:26.452 INFO:tasks.workunit.client.0.smithi084.stdout: 434: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:26.452 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-l-2-pFcComhrzv5 off=1689653 len=831689 2024-01-13T18:28:26.456 INFO:tasks.workunit.client.0.smithi084.stdout:op 2214 completed, throughput=4.99MB/sec 2024-01-13T18:28:26.456 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ue_fwYNmpbTxVa6 off=1562068 len=622191 2024-01-13T18:28:26.456 INFO:tasks.workunit.client.0.smithi084.stdout:op 2215 completed, throughput=4.99MB/sec 2024-01-13T18:28:26.456 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Gl6_SSZYA4mj-Wg off=8278681 len=1789516 2024-01-13T18:28:26.466 INFO:tasks.workunit.client.0.smithi084.stdout:op 2216 completed, throughput=5MB/sec 2024-01-13T18:28:26.466 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-D_Kue4ER_vS1dge off=10907404 len=1703573 2024-01-13T18:28:26.467 INFO:tasks.workunit.client.0.smithi084.stdout:op 2217 completed, throughput=5MB/sec 2024-01-13T18:28:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:26.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:28:26.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:28:26.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:26.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[119097]: pgmap v1699: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 3 op/s 2024-01-13T18:28:26.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:26.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:26.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:26.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:26.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:28:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:28:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:26.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:26 smithi084 ceph-mon[116404]: pgmap v1699: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 3 op/s 2024-01-13T18:28:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:27.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:27.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:27.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:27.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:28:27.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:28:27.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:28:27.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:26 smithi099 ceph-mon[138788]: pgmap v1699: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 3 op/s 2024-01-13T18:28:27.467 INFO:tasks.workunit.client.0.smithi084.stdout: 435: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:27.467 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8s4em6crES4N4fV off=1492196 len=903994 2024-01-13T18:28:27.469 INFO:tasks.workunit.client.0.smithi084.stdout:op 2218 completed, throughput=4.99MB/sec 2024-01-13T18:28:27.469 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ON-nYUPsAFrahBM off=3131082 len=1774488 2024-01-13T18:28:27.471 INFO:tasks.workunit.client.0.smithi084.stdout:op 2219 completed, throughput=5MB/sec 2024-01-13T18:28:27.471 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7DEa5IgISaZr22f off=4037259 len=934138 2024-01-13T18:28:27.475 INFO:tasks.workunit.client.0.smithi084.stdout:op 2220 completed, throughput=5MB/sec 2024-01-13T18:28:27.475 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Nv3Rg9AKa4lTani off=695826 len=1883936 2024-01-13T18:28:27.478 INFO:tasks.workunit.client.0.smithi084.stdout:op 2221 completed, throughput=5MB/sec 2024-01-13T18:28:28.479 INFO:tasks.workunit.client.0.smithi084.stdout: 436: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:28.479 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SxcDQzbo55M1Wbl off=3880237 len=681338 2024-01-13T18:28:28.483 INFO:tasks.workunit.client.0.smithi084.stdout:op 2222 completed, throughput=4.99MB/sec 2024-01-13T18:28:28.483 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dZBlcYZ53lOSy3o off=6056675 len=83691 2024-01-13T18:28:28.486 INFO:tasks.workunit.client.0.smithi084.stdout:op 2223 completed, throughput=4.99MB/sec 2024-01-13T18:28:28.486 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--WBkuttWY6Pwi53 off=8854572 len=1408339 2024-01-13T18:28:28.488 INFO:tasks.workunit.client.0.smithi084.stdout:op 2224 completed, throughput=5MB/sec 2024-01-13T18:28:28.488 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vuVQhgxraf0kuAq off=10746520 len=1248749 2024-01-13T18:28:28.489 INFO:tasks.workunit.client.0.smithi084.stdout:op 2225 completed, throughput=5MB/sec 2024-01-13T18:28:28.489 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j9Md3ESW2znUe3p off=12143583 len=1164046 2024-01-13T18:28:28.495 INFO:tasks.workunit.client.0.smithi084.stdout:op 2226 completed, throughput=5MB/sec 2024-01-13T18:28:29.496 INFO:tasks.workunit.client.0.smithi084.stdout: 437: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:29.496 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-X7LzPSFDKMpLssC off=6984325 len=2028607 2024-01-13T18:28:29.505 INFO:tasks.workunit.client.0.smithi084.stdout:op 2227 completed, throughput=4.99MB/sec 2024-01-13T18:28:29.506 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2yJrZmSH-6BCiM9 off=20453809 len=1104308 2024-01-13T18:28:29.512 INFO:tasks.workunit.client.0.smithi084.stdout:op 2228 completed, throughput=5MB/sec 2024-01-13T18:28:29.512 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ftt8pxQHfNZf9O1 off=11668424 len=552869 2024-01-13T18:28:29.516 INFO:tasks.workunit.client.0.smithi084.stdout:op 2229 completed, throughput=5MB/sec 2024-01-13T18:28:29.516 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-m8Dcp_A04aPlLrH off=2733523 len=1947965 2024-01-13T18:28:29.523 INFO:tasks.workunit.client.0.smithi084.stdout:op 2230 completed, throughput=5MB/sec 2024-01-13T18:28:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:29 smithi099 ceph-mon[138788]: pgmap v1700: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:28:29.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:29 smithi084 ceph-mon[116404]: pgmap v1700: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:28:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:29 smithi084 ceph-mon[119097]: pgmap v1700: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:28:30.523 INFO:tasks.workunit.client.0.smithi084.stdout: 438: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:30.524 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MWopnaVctX9zmXm off=4183943 len=80902 2024-01-13T18:28:30.526 INFO:tasks.workunit.client.0.smithi084.stdout:op 2231 completed, throughput=4.99MB/sec 2024-01-13T18:28:30.526 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NUt90H0e3JlslPs off=834109 len=1014212 2024-01-13T18:28:30.529 INFO:tasks.workunit.client.0.smithi084.stdout:op 2232 completed, throughput=4.99MB/sec 2024-01-13T18:28:30.529 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iXw_Zj1_nlfAS8_ off=8079705 len=414728 2024-01-13T18:28:30.530 INFO:tasks.workunit.client.0.smithi084.stdout:op 2233 completed, throughput=4.99MB/sec 2024-01-13T18:28:30.530 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y_QewitNGhQciVF off=12090794 len=5212 2024-01-13T18:28:30.530 INFO:tasks.workunit.client.0.smithi084.stdout:op 2234 completed, throughput=4.99MB/sec 2024-01-13T18:28:30.530 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Oz422yeYGFA7bGd off=10371282 len=1599667 2024-01-13T18:28:30.539 INFO:tasks.workunit.client.0.smithi084.stdout:op 2235 completed, throughput=5MB/sec 2024-01-13T18:28:30.539 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qBPmftrIDTwY113 off=19373473 len=450326 2024-01-13T18:28:30.542 INFO:tasks.workunit.client.0.smithi084.stdout:op 2236 completed, throughput=5MB/sec 2024-01-13T18:28:30.542 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tOsjGBNwyenUAYT off=1940110 len=1424637 2024-01-13T18:28:30.550 INFO:tasks.workunit.client.0.smithi084.stdout:op 2237 completed, throughput=5MB/sec 2024-01-13T18:28:30.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:28:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:28:30] "GET /metrics HTTP/1.1" 200 33994 "" "Prometheus/2.43.0" 2024-01-13T18:28:31.551 INFO:tasks.workunit.client.0.smithi084.stdout: 439: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:31.551 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oIAxvqolD-PhEXO off=13709514 len=1610269 2024-01-13T18:28:31.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 2238 completed, throughput=4.99MB/sec 2024-01-13T18:28:31.559 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-U321ooqH1Vdv-ao off=95232 len=1931293 2024-01-13T18:28:31.571 INFO:tasks.workunit.client.0.smithi084.stdout:op 2239 completed, throughput=5MB/sec 2024-01-13T18:28:31.571 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rEf2K_QWRw9bliU off=2126992 len=192706 2024-01-13T18:28:31.574 INFO:tasks.workunit.client.0.smithi084.stdout:op 2240 completed, throughput=5MB/sec 2024-01-13T18:28:31.574 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FBeiBhYBqIuSe9V off=3486291 len=1169725 2024-01-13T18:28:31.579 INFO:tasks.workunit.client.0.smithi084.stdout:op 2241 completed, throughput=5MB/sec 2024-01-13T18:28:31.579 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XJ-FR_B2eMftRfc off=2240339 len=530495 2024-01-13T18:28:31.583 INFO:tasks.workunit.client.0.smithi084.stdout:op 2242 completed, throughput=5MB/sec 2024-01-13T18:28:31.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:31 smithi099 ceph-mon[138788]: pgmap v1701: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:31 smithi084 ceph-mon[116404]: pgmap v1701: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:31 smithi084 ceph-mon[119097]: pgmap v1701: 105 pgs: 105 active+clean; 128 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:32.583 INFO:tasks.workunit.client.0.smithi084.stdout: 440: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:32.583 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ihir0lFoBHJUISs off=3356452 len=798765 2024-01-13T18:28:32.584 INFO:tasks.workunit.client.0.smithi084.stdout:op 2243 completed, throughput=4.99MB/sec 2024-01-13T18:28:32.585 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4e9xHgWSnvdY32v off=6622269 len=1599750 2024-01-13T18:28:32.587 INFO:tasks.workunit.client.0.smithi084.stdout:op 2244 completed, throughput=4.99MB/sec 2024-01-13T18:28:32.587 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3YpDBwyROuTJLl8 off=7643146 len=1063872 2024-01-13T18:28:32.588 INFO:tasks.workunit.client.0.smithi084.stdout:op 2245 completed, throughput=5MB/sec 2024-01-13T18:28:32.588 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-i2QjMI_LHLX6WbO off=1883425 len=1948844 2024-01-13T18:28:32.590 INFO:tasks.workunit.client.0.smithi084.stdout:op 2246 completed, throughput=5MB/sec 2024-01-13T18:28:33.590 INFO:tasks.workunit.client.0.smithi084.stdout: 441: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:33.590 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AeukVgDVZFKy5jJ off=6931238 len=394660 2024-01-13T18:28:33.594 INFO:tasks.workunit.client.0.smithi084.stdout:op 2247 completed, throughput=4.99MB/sec 2024-01-13T18:28:33.594 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-coHPj1u0hwjIpfk off=1037702 len=395975 2024-01-13T18:28:33.595 INFO:tasks.workunit.client.0.smithi084.stdout:op 2248 completed, throughput=4.99MB/sec 2024-01-13T18:28:33.595 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4wUcBSOC1tkboJe off=13405829 len=1843330 2024-01-13T18:28:33.603 INFO:tasks.workunit.client.0.smithi084.stdout:op 2249 completed, throughput=4.99MB/sec 2024-01-13T18:28:33.603 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7lH56gyxfAm4wj0 off=10197379 len=1002085 2024-01-13T18:28:33.605 INFO:tasks.workunit.client.0.smithi084.stdout:op 2250 completed, throughput=5MB/sec 2024-01-13T18:28:33.605 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k3t8bQ9i-Vscm1B off=3400358 len=174944 2024-01-13T18:28:33.607 INFO:tasks.workunit.client.0.smithi084.stdout:op 2251 completed, throughput=5MB/sec 2024-01-13T18:28:33.607 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ys0R7tvPq6IgsGa off=14890250 len=272514 2024-01-13T18:28:33.609 INFO:tasks.workunit.client.0.smithi084.stdout:op 2252 completed, throughput=5MB/sec 2024-01-13T18:28:33.609 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nY2T61TjFVHREAZ off=11171036 len=1033542 2024-01-13T18:28:33.614 INFO:tasks.workunit.client.0.smithi084.stdout:op 2253 completed, throughput=5MB/sec 2024-01-13T18:28:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:33 smithi099 ceph-mon[138788]: pgmap v1702: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:33.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:33 smithi084 ceph-mon[116404]: pgmap v1702: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:33.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:33 smithi084 ceph-mon[119097]: pgmap v1702: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:28:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: 442: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:34.615 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dRtfm029I0LmL7B off=11254723 len=1146941 2024-01-13T18:28:34.619 INFO:tasks.workunit.client.0.smithi084.stdout:op 2254 completed, throughput=4.99MB/sec 2024-01-13T18:28:34.619 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3bektLe8bCqBRw9 off=3958884 len=1866606 2024-01-13T18:28:34.629 INFO:tasks.workunit.client.0.smithi084.stdout:op 2255 completed, throughput=5MB/sec 2024-01-13T18:28:34.629 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZQUI4zarkdTVvvb off=15036570 len=1170416 2024-01-13T18:28:34.634 INFO:tasks.workunit.client.0.smithi084.stdout:op 2256 completed, throughput=5MB/sec 2024-01-13T18:28:34.634 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Xojy7HlNr6tF1ET off=1316570 len=687321 2024-01-13T18:28:34.638 INFO:tasks.workunit.client.0.smithi084.stdout:op 2257 completed, throughput=5MB/sec 2024-01-13T18:28:34.638 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZCdj24afW5huRD5 off=1107357 len=559122 2024-01-13T18:28:34.642 INFO:tasks.workunit.client.0.smithi084.stdout:op 2258 completed, throughput=5MB/sec 2024-01-13T18:28:35.642 INFO:tasks.workunit.client.0.smithi084.stdout: 443: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:35.642 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RfjqSwNG3ROLI-h off=9579383 len=775861 2024-01-13T18:28:35.647 INFO:tasks.workunit.client.0.smithi084.stdout:op 2259 completed, throughput=4.99MB/sec 2024-01-13T18:28:35.647 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VX3oWIyLBBYEThm off=7578892 len=782957 2024-01-13T18:28:35.648 INFO:tasks.workunit.client.0.smithi084.stdout:op 2260 completed, throughput=4.99MB/sec 2024-01-13T18:28:35.648 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f4k54ira5D5d0XY off=12618250 len=568994 2024-01-13T18:28:35.650 INFO:tasks.workunit.client.0.smithi084.stdout:op 2261 completed, throughput=4.99MB/sec 2024-01-13T18:28:35.650 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Kfx0RI6mhVrJYBS off=1524167 len=1331420 2024-01-13T18:28:35.651 INFO:tasks.workunit.client.0.smithi084.stdout:op 2262 completed, throughput=5MB/sec 2024-01-13T18:28:35.651 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hgoYmla16jjLCM8 off=9271721 len=1198341 2024-01-13T18:28:35.652 INFO:tasks.workunit.client.0.smithi084.stdout:op 2263 completed, throughput=5MB/sec 2024-01-13T18:28:35.652 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-X8AResZJi2wau0G off=7372318 len=189975 2024-01-13T18:28:35.653 INFO:tasks.workunit.client.0.smithi084.stdout:op 2264 completed, throughput=5MB/sec 2024-01-13T18:28:35.653 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7IlnmKgtWjYQ9IT off=498916 len=1005623 2024-01-13T18:28:35.654 INFO:tasks.workunit.client.0.smithi084.stdout:op 2265 completed, throughput=5MB/sec 2024-01-13T18:28:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:35 smithi099 ceph-mon[138788]: pgmap v1703: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:28:35.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:35 smithi084 ceph-mon[116404]: pgmap v1703: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:28:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:35 smithi084 ceph-mon[119097]: pgmap v1703: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:28:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:36.654 INFO:tasks.workunit.client.0.smithi084.stdout: 444: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:36.654 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BKhknjPTjl_yKJU off=5701670 len=1985482 2024-01-13T18:28:36.658 INFO:tasks.workunit.client.0.smithi084.stdout:op 2266 completed, throughput=4.99MB/sec 2024-01-13T18:28:36.659 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eG0jOsx5MnF56kP off=1296193 len=1071134 2024-01-13T18:28:36.665 INFO:tasks.workunit.client.0.smithi084.stdout:op 2267 completed, throughput=5MB/sec 2024-01-13T18:28:36.665 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5qCPjCrbCbn02hp off=9561238 len=100440 2024-01-13T18:28:36.667 INFO:tasks.workunit.client.0.smithi084.stdout:op 2268 completed, throughput=5MB/sec 2024-01-13T18:28:36.667 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zzCZC92rkTsEFk5 off=22640439 len=605066 2024-01-13T18:28:36.671 INFO:tasks.workunit.client.0.smithi084.stdout:op 2269 completed, throughput=5MB/sec 2024-01-13T18:28:36.671 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Mqc6C5Jep7_64E5 off=3069286 len=1427700 2024-01-13T18:28:36.672 INFO:tasks.workunit.client.0.smithi084.stdout:op 2270 completed, throughput=5MB/sec 2024-01-13T18:28:37.673 INFO:tasks.workunit.client.0.smithi084.stdout: 445: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:37.673 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g4eLlscVyJDOYDF off=4985990 len=355366 2024-01-13T18:28:37.674 INFO:tasks.workunit.client.0.smithi084.stdout:op 2271 completed, throughput=4.99MB/sec 2024-01-13T18:28:37.674 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JrxI7S9XeBx6sST off=3397092 len=689293 2024-01-13T18:28:37.675 INFO:tasks.workunit.client.0.smithi084.stdout:op 2272 completed, throughput=4.99MB/sec 2024-01-13T18:28:37.675 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zW__OXLr75NiVpd off=5487165 len=578794 2024-01-13T18:28:37.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 2273 completed, throughput=4.99MB/sec 2024-01-13T18:28:37.679 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ytwjE-FDQ-NLuQ_ off=2196689 len=24005 2024-01-13T18:28:37.680 INFO:tasks.workunit.client.0.smithi084.stdout:op 2274 completed, throughput=4.99MB/sec 2024-01-13T18:28:37.680 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7p-pPt3BM6bgBJ5 off=1021818 len=1779000 2024-01-13T18:28:37.690 INFO:tasks.workunit.client.0.smithi084.stdout:op 2275 completed, throughput=5MB/sec 2024-01-13T18:28:37.690 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-a0gPl1m2tar6WjL off=316661 len=1629222 2024-01-13T18:28:37.698 INFO:tasks.workunit.client.0.smithi084.stdout:op 2276 completed, throughput=5MB/sec 2024-01-13T18:28:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:37 smithi099 ceph-mon[138788]: pgmap v1704: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:28:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:37 smithi084 ceph-mon[116404]: pgmap v1704: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:28:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:37 smithi084 ceph-mon[119097]: pgmap v1704: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:28:38.698 INFO:tasks.workunit.client.0.smithi084.stdout: 446: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:38.698 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r5wiqMNGkPVrz3y off=15387651 len=170803 2024-01-13T18:28:38.701 INFO:tasks.workunit.client.0.smithi084.stdout:op 2277 completed, throughput=4.99MB/sec 2024-01-13T18:28:38.701 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Q8kvM1dB5p5CDn- off=12533219 len=626514 2024-01-13T18:28:38.703 INFO:tasks.workunit.client.0.smithi084.stdout:op 2278 completed, throughput=4.99MB/sec 2024-01-13T18:28:38.703 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dWcwRVsoFiZfV28 off=931303 len=1489447 2024-01-13T18:28:38.711 INFO:tasks.workunit.client.0.smithi084.stdout:op 2279 completed, throughput=4.99MB/sec 2024-01-13T18:28:38.711 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-__7pCqAFf9qhBMp off=2725656 len=1432565 2024-01-13T18:28:38.718 INFO:tasks.workunit.client.0.smithi084.stdout:op 2280 completed, throughput=5MB/sec 2024-01-13T18:28:38.718 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RZRfjPd8hqRXq-T off=12447117 len=440112 2024-01-13T18:28:38.722 INFO:tasks.workunit.client.0.smithi084.stdout:op 2281 completed, throughput=5MB/sec 2024-01-13T18:28:38.722 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BP5Z_GhlUWMUaef off=4411449 len=585937 2024-01-13T18:28:38.726 INFO:tasks.workunit.client.0.smithi084.stdout:op 2282 completed, throughput=5MB/sec 2024-01-13T18:28:38.726 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mhgrA0fuD2iVOM- off=6089325 len=1436922 2024-01-13T18:28:38.733 INFO:tasks.workunit.client.0.smithi084.stdout:op 2283 completed, throughput=5MB/sec 2024-01-13T18:28:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:39 smithi099 ceph-mon[138788]: pgmap v1705: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:28:39.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:39 smithi084 ceph-mon[116404]: pgmap v1705: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:28:39.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:39 smithi084 ceph-mon[119097]: pgmap v1705: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 5 op/s 2024-01-13T18:28:39.733 INFO:tasks.workunit.client.0.smithi084.stdout: 447: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:39.733 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8sL1HfdRipGGnNn off=8146344 len=1605092 2024-01-13T18:28:39.743 INFO:tasks.workunit.client.0.smithi084.stdout:op 2284 completed, throughput=4.99MB/sec 2024-01-13T18:28:39.743 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FO3Bqbu9CudaFJ- off=11999484 len=1325282 2024-01-13T18:28:39.744 INFO:tasks.workunit.client.0.smithi084.stdout:op 2285 completed, throughput=5MB/sec 2024-01-13T18:28:39.744 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WaGdwLiZ3jo6Rtp off=28363 len=588856 2024-01-13T18:28:39.748 INFO:tasks.workunit.client.0.smithi084.stdout:op 2286 completed, throughput=5MB/sec 2024-01-13T18:28:39.749 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-brZ5dr-Uk6HoV0_ off=6305364 len=31462 2024-01-13T18:28:39.749 INFO:tasks.workunit.client.0.smithi084.stdout:op 2287 completed, throughput=5MB/sec 2024-01-13T18:28:39.749 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ggTrEa5onp4D6Pz off=56200 len=1636621 2024-01-13T18:28:39.758 INFO:tasks.workunit.client.0.smithi084.stdout:op 2288 completed, throughput=5MB/sec 2024-01-13T18:28:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:28:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:28:40] "GET /metrics HTTP/1.1" 200 33989 "" "Prometheus/2.43.0" 2024-01-13T18:28:40.758 INFO:tasks.workunit.client.0.smithi084.stdout: 448: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:40.758 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lKSyNqHHIfQZPaU off=18827458 len=1307547 2024-01-13T18:28:40.764 INFO:tasks.workunit.client.0.smithi084.stdout:op 2289 completed, throughput=4.99MB/sec 2024-01-13T18:28:40.764 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sSUj6Z5l0U4_YHG off=1930546 len=1677766 2024-01-13T18:28:40.772 INFO:tasks.workunit.client.0.smithi084.stdout:op 2290 completed, throughput=5MB/sec 2024-01-13T18:28:40.772 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_UPfJ63NqKlNqsU off=19237907 len=1403762 2024-01-13T18:28:40.774 INFO:tasks.workunit.client.0.smithi084.stdout:op 2291 completed, throughput=5MB/sec 2024-01-13T18:28:40.774 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9A_xjnO1d_64zRj off=4778013 len=189987 2024-01-13T18:28:40.774 INFO:tasks.workunit.client.0.smithi084.stdout:op 2292 completed, throughput=5MB/sec 2024-01-13T18:28:40.774 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bgI1Rey1Kelbgrw off=22262523 len=1932090 2024-01-13T18:28:40.785 INFO:tasks.workunit.client.0.smithi084.stdout:op 2293 completed, throughput=5MB/sec 2024-01-13T18:28:41.786 INFO:tasks.workunit.client.0.smithi084.stdout: 449: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:41.786 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pSfEa7Xl7nCcDca off=12120054 len=944307 2024-01-13T18:28:41.787 INFO:tasks.workunit.client.0.smithi084.stdout:op 2294 completed, throughput=4.99MB/sec 2024-01-13T18:28:41.787 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cFyifpPgpqsX1yA off=2190960 len=95867 2024-01-13T18:28:41.787 INFO:tasks.workunit.client.0.smithi084.stdout:op 2295 completed, throughput=5MB/sec 2024-01-13T18:28:41.788 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Xojy7HlNr6tF1ET off=2788568 len=392112 2024-01-13T18:28:41.788 INFO:tasks.workunit.client.0.smithi084.stdout:op 2296 completed, throughput=5MB/sec 2024-01-13T18:28:41.788 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bISxGHLqen93dDt off=9623564 len=384416 2024-01-13T18:28:41.792 INFO:tasks.workunit.client.0.smithi084.stdout:op 2297 completed, throughput=5MB/sec 2024-01-13T18:28:41.792 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-o2y6sp-pAuB9rgg off=4626605 len=596570 2024-01-13T18:28:41.793 INFO:tasks.workunit.client.0.smithi084.stdout:op 2298 completed, throughput=5MB/sec 2024-01-13T18:28:41.793 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MyNEO6YStyZZFaU off=3279655 len=1186562 2024-01-13T18:28:41.798 INFO:tasks.workunit.client.0.smithi084.stdout:op 2299 completed, throughput=5MB/sec 2024-01-13T18:28:41.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:41 smithi099 ceph-mon[138788]: pgmap v1706: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:28:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:41 smithi084 ceph-mon[116404]: pgmap v1706: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:28:41.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:41 smithi084 ceph-mon[119097]: pgmap v1706: 105 pgs: 105 active+clean; 128 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:28:42.798 INFO:tasks.workunit.client.0.smithi084.stdout: 450: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:42.799 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uiiT2QYPy5hvTye off=13497750 len=1570236 2024-01-13T18:28:42.808 INFO:tasks.workunit.client.0.smithi084.stdout:op 2300 completed, throughput=4.99MB/sec 2024-01-13T18:28:42.808 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VtFNfv7pt1FFBvk off=2228147 len=1644997 2024-01-13T18:28:42.816 INFO:tasks.workunit.client.0.smithi084.stdout:op 2301 completed, throughput=5MB/sec 2024-01-13T18:28:42.816 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IyLBKOU4A-9sqfN off=797299 len=994460 2024-01-13T18:28:42.817 INFO:tasks.workunit.client.0.smithi084.stdout:op 2302 completed, throughput=5MB/sec 2024-01-13T18:28:42.817 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hzpXiI0DmMAXsUj off=6711755 len=1903204 2024-01-13T18:28:42.819 INFO:tasks.workunit.client.0.smithi084.stdout:op 2303 completed, throughput=5MB/sec 2024-01-13T18:28:43.819 INFO:tasks.workunit.client.0.smithi084.stdout: 451: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:43.819 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fXJU9deptuQbSsX off=3158600 len=100504 2024-01-13T18:28:43.822 INFO:tasks.workunit.client.0.smithi084.stdout:op 2304 completed, throughput=4.99MB/sec 2024-01-13T18:28:43.822 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-olzOBIo2V919vys off=170425 len=1858979 2024-01-13T18:28:43.830 INFO:tasks.workunit.client.0.smithi084.stdout:op 2305 completed, throughput=4.99MB/sec 2024-01-13T18:28:43.831 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hbued3g4lKXlnwp off=2214389 len=686245 2024-01-13T18:28:43.835 INFO:tasks.workunit.client.0.smithi084.stdout:op 2306 completed, throughput=5MB/sec 2024-01-13T18:28:43.835 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5mUDYLOEGaPiImI off=13025026 len=1486992 2024-01-13T18:28:43.838 INFO:tasks.workunit.client.0.smithi084.stdout:op 2307 completed, throughput=5MB/sec 2024-01-13T18:28:43.838 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TAo6pJrOzjDBRcs off=8951622 len=454457 2024-01-13T18:28:43.841 INFO:tasks.workunit.client.0.smithi084.stdout:op 2308 completed, throughput=5MB/sec 2024-01-13T18:28:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:43 smithi099 ceph-mon[138788]: pgmap v1707: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:28:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:43 smithi084 ceph-mon[116404]: pgmap v1707: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:28:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:43 smithi084 ceph-mon[119097]: pgmap v1707: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:28:44.842 INFO:tasks.workunit.client.0.smithi084.stdout: 452: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:44.842 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PnELQTmZCJbXurL off=12995719 len=1826494 2024-01-13T18:28:44.851 INFO:tasks.workunit.client.0.smithi084.stdout:op 2309 completed, throughput=4.99MB/sec 2024-01-13T18:28:44.851 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2uttUQtnI8T4sfr off=4981954 len=1607877 2024-01-13T18:28:44.852 INFO:tasks.workunit.client.0.smithi084.stdout:op 2310 completed, throughput=5MB/sec 2024-01-13T18:28:44.852 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SSF9nsNueA1W9B8 off=7126869 len=2067771 2024-01-13T18:28:44.865 INFO:tasks.workunit.client.0.smithi084.stdout:op 2311 completed, throughput=5MB/sec 2024-01-13T18:28:45.865 INFO:tasks.workunit.client.0.smithi084.stdout: 453: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:45.865 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kOm4kr3_2P3Fe0O off=575913 len=1235853 2024-01-13T18:28:45.866 INFO:tasks.workunit.client.0.smithi084.stdout:op 2312 completed, throughput=4.99MB/sec 2024-01-13T18:28:45.866 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LXjkhUOnGEOJcUi off=11937386 len=1820738 2024-01-13T18:28:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:45 smithi099 ceph-mon[138788]: pgmap v1708: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 5 op/s 2024-01-13T18:28:45.877 INFO:tasks.workunit.client.0.smithi084.stdout:op 2313 completed, throughput=5MB/sec 2024-01-13T18:28:45.877 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w_Gc94UFpFPmyOW off=74205 len=708518 2024-01-13T18:28:45.879 INFO:tasks.workunit.client.0.smithi084.stdout:op 2314 completed, throughput=5MB/sec 2024-01-13T18:28:45.879 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eDwucj-mbexEPhp off=2239778 len=599456 2024-01-13T18:28:45.882 INFO:tasks.workunit.client.0.smithi084.stdout:op 2315 completed, throughput=5MB/sec 2024-01-13T18:28:45.883 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PLx7i8XIK6rJl5w off=10770801 len=280742 2024-01-13T18:28:45.883 INFO:tasks.workunit.client.0.smithi084.stdout:op 2316 completed, throughput=5MB/sec 2024-01-13T18:28:45.883 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ijFX2dT-dl2Ux-_ off=6991838 len=1037975 2024-01-13T18:28:45.885 INFO:tasks.workunit.client.0.smithi084.stdout:op 2317 completed, throughput=5MB/sec 2024-01-13T18:28:45.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:45 smithi084 ceph-mon[116404]: pgmap v1708: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 5 op/s 2024-01-13T18:28:45.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:45 smithi084 ceph-mon[119097]: pgmap v1708: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 5 op/s 2024-01-13T18:28:46.886 INFO:tasks.workunit.client.0.smithi084.stdout: 454: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:46.886 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OLEJTZTKHfoZNwy off=1107632 len=424577 2024-01-13T18:28:46.887 INFO:tasks.workunit.client.0.smithi084.stdout:op 2318 completed, throughput=4.99MB/sec 2024-01-13T18:28:46.887 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f5lpsKcHA3d4Z9q off=456227 len=934509 2024-01-13T18:28:46.888 INFO:tasks.workunit.client.0.smithi084.stdout:op 2319 completed, throughput=4.99MB/sec 2024-01-13T18:28:46.889 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5sCAHzdOhTET2h3 off=3707319 len=1832560 2024-01-13T18:28:46.896 INFO:tasks.workunit.client.0.smithi084.stdout:op 2320 completed, throughput=5MB/sec 2024-01-13T18:28:46.896 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PaAMMxIBCB6sH5- off=14978408 len=1796813 2024-01-13T18:28:46.904 INFO:tasks.workunit.client.0.smithi084.stdout:op 2321 completed, throughput=5MB/sec 2024-01-13T18:28:47.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:47 smithi099 ceph-mon[138788]: pgmap v1709: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:28:47.904 INFO:tasks.workunit.client.0.smithi084.stdout: 455: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:47.904 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2o8pvrqFtghIFqY off=9430650 len=1779425 2024-01-13T18:28:47.911 INFO:tasks.workunit.client.0.smithi084.stdout:op 2322 completed, throughput=4.99MB/sec 2024-01-13T18:28:47.911 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rABvDOqsn94W8f1 off=425510 len=2028673 2024-01-13T18:28:47.923 INFO:tasks.workunit.client.0.smithi084.stdout:op 2323 completed, throughput=5MB/sec 2024-01-13T18:28:47.923 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7M2MVfnPc-O_MzT off=4721258 len=573829 2024-01-13T18:28:47.926 INFO:tasks.workunit.client.0.smithi084.stdout:op 2324 completed, throughput=5MB/sec 2024-01-13T18:28:47.926 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aWX5gAzGoBQgpqQ off=16342571 len=760133 2024-01-13T18:28:47.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:47 smithi084 ceph-mon[116404]: pgmap v1709: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:28:47.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:47 smithi084 ceph-mon[119097]: pgmap v1709: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:28:47.929 INFO:tasks.workunit.client.0.smithi084.stdout:op 2325 completed, throughput=5MB/sec 2024-01-13T18:28:48.930 INFO:tasks.workunit.client.0.smithi084.stdout: 456: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:48.930 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Dz3Yqd0YOWwFSKr off=6213800 len=306402 2024-01-13T18:28:48.933 INFO:tasks.workunit.client.0.smithi084.stdout:op 2326 completed, throughput=4.99MB/sec 2024-01-13T18:28:48.933 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j1njStTuK-QU4HF off=18517444 len=2036636 2024-01-13T18:28:48.946 INFO:tasks.workunit.client.0.smithi084.stdout:op 2327 completed, throughput=4.99MB/sec 2024-01-13T18:28:48.946 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dMe3suJzpVhtVS1 off=16268181 len=962173 2024-01-13T18:28:48.951 INFO:tasks.workunit.client.0.smithi084.stdout:op 2328 completed, throughput=5MB/sec 2024-01-13T18:28:48.951 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-S8bVayjp-1IfECr off=5027710 len=1494402 2024-01-13T18:28:48.954 INFO:tasks.workunit.client.0.smithi084.stdout:op 2329 completed, throughput=5MB/sec 2024-01-13T18:28:48.954 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3Fbl3g5PiTBDR2P off=13335988 len=82730 2024-01-13T18:28:48.956 INFO:tasks.workunit.client.0.smithi084.stdout:op 2330 completed, throughput=5MB/sec 2024-01-13T18:28:48.956 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XwAteNtX-1feSuV off=900269 len=1805451 2024-01-13T18:28:48.959 INFO:tasks.workunit.client.0.smithi084.stdout:op 2331 completed, throughput=5MB/sec 2024-01-13T18:28:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:49 smithi099 ceph-mon[138788]: pgmap v1710: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:28:49.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:49 smithi084 ceph-mon[116404]: pgmap v1710: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:28:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:49 smithi084 ceph-mon[119097]: pgmap v1710: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:28:49.959 INFO:tasks.workunit.client.0.smithi084.stdout: 457: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:49.959 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SqQondZ1hwd-fdW off=2177586 len=477753 2024-01-13T18:28:49.960 INFO:tasks.workunit.client.0.smithi084.stdout:op 2332 completed, throughput=4.99MB/sec 2024-01-13T18:28:49.960 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8or0vjSVeZzzu7R off=7445455 len=447298 2024-01-13T18:28:49.961 INFO:tasks.workunit.client.0.smithi084.stdout:op 2333 completed, throughput=4.99MB/sec 2024-01-13T18:28:49.961 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ma5rzXclaDqoKuM off=0 len=1746464 2024-01-13T18:28:49.968 INFO:tasks.workunit.client.0.smithi084.stdout:op 2334 completed, throughput=5MB/sec 2024-01-13T18:28:49.968 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WyBifHqJuPK-gxd off=1439916 len=961778 2024-01-13T18:28:49.972 INFO:tasks.workunit.client.0.smithi084.stdout:op 2335 completed, throughput=5MB/sec 2024-01-13T18:28:49.972 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Kukd81QUGt9QHtw off=1856285 len=1270674 2024-01-13T18:28:49.974 INFO:tasks.workunit.client.0.smithi084.stdout:op 2336 completed, throughput=5MB/sec 2024-01-13T18:28:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:50.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:28:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:28:50] "GET /metrics HTTP/1.1" 200 33992 "" "Prometheus/2.43.0" 2024-01-13T18:28:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:28:50.974 INFO:tasks.workunit.client.0.smithi084.stdout: 458: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:50.975 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rD199DpNoJBYzTH off=14828369 len=1809183 2024-01-13T18:28:50.986 INFO:tasks.workunit.client.0.smithi084.stdout:op 2337 completed, throughput=4.99MB/sec 2024-01-13T18:28:50.986 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sVQ5VgN5vKKz5wS off=11724235 len=380171 2024-01-13T18:28:50.989 INFO:tasks.workunit.client.0.smithi084.stdout:op 2338 completed, throughput=5MB/sec 2024-01-13T18:28:50.989 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KIKXiGIc1QrED-R off=8268047 len=591772 2024-01-13T18:28:50.990 INFO:tasks.workunit.client.0.smithi084.stdout:op 2339 completed, throughput=5MB/sec 2024-01-13T18:28:50.991 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iyWdxpJv7633ons off=3189175 len=76785 2024-01-13T18:28:50.991 INFO:tasks.workunit.client.0.smithi084.stdout:op 2340 completed, throughput=5MB/sec 2024-01-13T18:28:50.991 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Fwl5w8QgztslxvP off=5103763 len=320606 2024-01-13T18:28:50.992 INFO:tasks.workunit.client.0.smithi084.stdout:op 2341 completed, throughput=5MB/sec 2024-01-13T18:28:50.992 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_hMMcbA5l7r23pv off=6268196 len=800837 2024-01-13T18:28:50.993 INFO:tasks.workunit.client.0.smithi084.stdout:op 2342 completed, throughput=5MB/sec 2024-01-13T18:28:50.993 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eKIypPNHcncJGcV off=14285042 len=559374 2024-01-13T18:28:50.993 INFO:tasks.workunit.client.0.smithi084.stdout:op 2343 completed, throughput=5MB/sec 2024-01-13T18:28:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:51 smithi099 ceph-mon[138788]: pgmap v1711: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 5 op/s 2024-01-13T18:28:51.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:51 smithi084 ceph-mon[116404]: pgmap v1711: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 5 op/s 2024-01-13T18:28:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:51 smithi084 ceph-mon[119097]: pgmap v1711: 105 pgs: 105 active+clean; 128 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 5 op/s 2024-01-13T18:28:51.994 INFO:tasks.workunit.client.0.smithi084.stdout: 459: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:51.994 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tGNaTG9AQFYydAT off=7986300 len=1067358 2024-01-13T18:28:51.995 INFO:tasks.workunit.client.0.smithi084.stdout:op 2344 completed, throughput=4.99MB/sec 2024-01-13T18:28:51.995 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Oz422yeYGFA7bGd off=3160744 len=1700539 2024-01-13T18:28:52.006 INFO:tasks.workunit.client.0.smithi084.stdout:op 2345 completed, throughput=4.99MB/sec 2024-01-13T18:28:52.006 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IuBy0jzx3h3dDTi off=7929587 len=1825360 2024-01-13T18:28:52.016 INFO:tasks.workunit.client.0.smithi084.stdout:op 2346 completed, throughput=5MB/sec 2024-01-13T18:28:52.016 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UFT3nnJltfamV_V off=1892737 len=785788 2024-01-13T18:28:52.020 INFO:tasks.workunit.client.0.smithi084.stdout:op 2347 completed, throughput=5MB/sec 2024-01-13T18:28:53.021 INFO:tasks.workunit.client.0.smithi084.stdout: 460: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:53.021 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oToe7chaHHGOmQD off=2035016 len=1711322 2024-01-13T18:28:53.023 INFO:tasks.workunit.client.0.smithi084.stdout:op 2348 completed, throughput=4.99MB/sec 2024-01-13T18:28:53.023 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vYlGva5mFLTl2Rj off=5320283 len=1206446 2024-01-13T18:28:53.031 INFO:tasks.workunit.client.0.smithi084.stdout:op 2349 completed, throughput=5MB/sec 2024-01-13T18:28:53.031 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sa88R9KX6Dn2jtm off=150545 len=830688 2024-01-13T18:28:53.035 INFO:tasks.workunit.client.0.smithi084.stdout:op 2350 completed, throughput=5MB/sec 2024-01-13T18:28:53.036 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cxTwsY-bfldfGmf off=13483881 len=800228 2024-01-13T18:28:53.041 INFO:tasks.workunit.client.0.smithi084.stdout:op 2351 completed, throughput=5MB/sec 2024-01-13T18:28:53.041 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9t5y4Kvl_HTpQD2 off=819789 len=987402 2024-01-13T18:28:53.045 INFO:tasks.workunit.client.0.smithi084.stdout:op 2352 completed, throughput=5MB/sec 2024-01-13T18:28:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:53 smithi099 ceph-mon[138788]: pgmap v1712: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:28:53.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:53 smithi084 ceph-mon[116404]: pgmap v1712: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:28:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:53 smithi084 ceph-mon[119097]: pgmap v1712: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:28:54.045 INFO:tasks.workunit.client.0.smithi084.stdout: 461: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:54.046 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xNOsI6Rtmot4CNK off=1763974 len=1726668 2024-01-13T18:28:54.056 INFO:tasks.workunit.client.0.smithi084.stdout:op 2353 completed, throughput=4.99MB/sec 2024-01-13T18:28:54.056 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4gPIS16HD51KhH_ off=5144550 len=182857 2024-01-13T18:28:54.059 INFO:tasks.workunit.client.0.smithi084.stdout:op 2354 completed, throughput=4.99MB/sec 2024-01-13T18:28:54.059 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GNzDdck21WfYeBa off=628555 len=1484394 2024-01-13T18:28:54.060 INFO:tasks.workunit.client.0.smithi084.stdout:op 2355 completed, throughput=5MB/sec 2024-01-13T18:28:54.060 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e9o--UymHf0Ic0u off=2048271 len=1353279 2024-01-13T18:28:54.066 INFO:tasks.workunit.client.0.smithi084.stdout:op 2356 completed, throughput=5MB/sec 2024-01-13T18:28:54.066 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5JQ5-UIxDlkwpxo off=1558310 len=491211 2024-01-13T18:28:54.066 INFO:tasks.workunit.client.0.smithi084.stdout:op 2357 completed, throughput=5MB/sec 2024-01-13T18:28:55.067 INFO:tasks.workunit.client.0.smithi084.stdout: 462: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:55.067 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-b1IAl_wQHxSe7aQ off=10247039 len=1474716 2024-01-13T18:28:55.075 INFO:tasks.workunit.client.0.smithi084.stdout:op 2358 completed, throughput=4.99MB/sec 2024-01-13T18:28:55.075 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pH_P3hv-aSaZCuE off=6601400 len=1678527 2024-01-13T18:28:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:op 2359 completed, throughput=5MB/sec 2024-01-13T18:28:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gp8QYfbR3Om0YFu off=14950821 len=1500101 2024-01-13T18:28:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:op 2360 completed, throughput=5MB/sec 2024-01-13T18:28:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DhzJySoFYhTI8Ff off=17767084 len=437086 2024-01-13T18:28:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:op 2361 completed, throughput=5MB/sec 2024-01-13T18:28:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-c_gpCW_fSQ-cQk0 off=2745564 len=1615929 2024-01-13T18:28:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:op 2362 completed, throughput=5MB/sec 2024-01-13T18:28:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:55 smithi099 ceph-mon[138788]: pgmap v1713: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:28:55.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:55 smithi084 ceph-mon[116404]: pgmap v1713: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:28:55.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:55 smithi084 ceph-mon[119097]: pgmap v1713: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:28:56.089 INFO:tasks.workunit.client.0.smithi084.stdout: 463: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:56.089 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TyPl6w06yZqHTDJ off=7950810 len=21903 2024-01-13T18:28:56.090 INFO:tasks.workunit.client.0.smithi084.stdout:op 2363 completed, throughput=4.99MB/sec 2024-01-13T18:28:56.090 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_NdJhfYou76ZiG4 off=8405260 len=1344989 2024-01-13T18:28:56.091 INFO:tasks.workunit.client.0.smithi084.stdout:op 2364 completed, throughput=5MB/sec 2024-01-13T18:28:56.091 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RYnMuGzBRu7Jp2W off=11275767 len=744698 2024-01-13T18:28:56.096 INFO:tasks.workunit.client.0.smithi084.stdout:op 2365 completed, throughput=5MB/sec 2024-01-13T18:28:56.096 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1er7LPyuNFNxZY9 off=2104201 len=725060 2024-01-13T18:28:56.097 INFO:tasks.workunit.client.0.smithi084.stdout:op 2366 completed, throughput=5MB/sec 2024-01-13T18:28:56.097 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eTPROI7479ZbslH off=5348632 len=1525545 2024-01-13T18:28:56.106 INFO:tasks.workunit.client.0.smithi084.stdout:op 2367 completed, throughput=5MB/sec 2024-01-13T18:28:57.106 INFO:tasks.workunit.client.0.smithi084.stdout: 464: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:57.106 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dhq3ZdNjtI0Pcrv off=8296729 len=1840485 2024-01-13T18:28:57.109 INFO:tasks.workunit.client.0.smithi084.stdout:op 2368 completed, throughput=4.99MB/sec 2024-01-13T18:28:57.109 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jgRzZporQiXCiHx off=345673 len=1708488 2024-01-13T18:28:57.111 INFO:tasks.workunit.client.0.smithi084.stdout:op 2369 completed, throughput=5MB/sec 2024-01-13T18:28:57.111 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GH9954zyfNQsiNS off=10010456 len=1225675 2024-01-13T18:28:57.116 INFO:tasks.workunit.client.0.smithi084.stdout:op 2370 completed, throughput=5MB/sec 2024-01-13T18:28:57.116 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mQCm4EX_Gmv0YOC off=1298646 len=622703 2024-01-13T18:28:57.120 INFO:tasks.workunit.client.0.smithi084.stdout:op 2371 completed, throughput=5MB/sec 2024-01-13T18:28:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:57 smithi099 ceph-mon[138788]: pgmap v1714: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-01-13T18:28:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:57 smithi084 ceph-mon[119097]: pgmap v1714: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-01-13T18:28:57.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:57 smithi084 ceph-mon[116404]: pgmap v1714: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-01-13T18:28:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: 465: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:58.121 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xQ0hCpqI-jXF7a4 off=153701 len=1306834 2024-01-13T18:28:58.122 INFO:tasks.workunit.client.0.smithi084.stdout:op 2372 completed, throughput=4.99MB/sec 2024-01-13T18:28:58.122 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-z7y7BvqO2I0pyUq off=838754 len=1857630 2024-01-13T18:28:58.124 INFO:tasks.workunit.client.0.smithi084.stdout:op 2373 completed, throughput=5MB/sec 2024-01-13T18:28:58.125 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ogcd-QzhxOyCh7g off=647803 len=2091783 2024-01-13T18:28:58.127 INFO:tasks.workunit.client.0.smithi084.stdout:op 2374 completed, throughput=5MB/sec 2024-01-13T18:28:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: 466: throughput=4.99MB/sec pending data=0 2024-01-13T18:28:59.128 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7PM20hEU5wzJ9F0 off=6076809 len=1707947 2024-01-13T18:28:59.136 INFO:tasks.workunit.client.0.smithi084.stdout:op 2375 completed, throughput=4.99MB/sec 2024-01-13T18:28:59.136 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ET6YazGW4tGsB4_ off=3323519 len=404205 2024-01-13T18:28:59.137 INFO:tasks.workunit.client.0.smithi084.stdout:op 2376 completed, throughput=4.99MB/sec 2024-01-13T18:28:59.137 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FbjyNav6rgAqX7u off=1565948 len=1908344 2024-01-13T18:28:59.150 INFO:tasks.workunit.client.0.smithi084.stdout:op 2377 completed, throughput=5MB/sec 2024-01-13T18:28:59.150 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fv7_T8S3NqSY7gb off=2175246 len=1612157 2024-01-13T18:28:59.151 INFO:tasks.workunit.client.0.smithi084.stdout:op 2378 completed, throughput=5MB/sec 2024-01-13T18:28:59.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:28:59 smithi099 ceph-mon[138788]: pgmap v1715: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:28:59.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:28:59 smithi084 ceph-mon[116404]: pgmap v1715: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:28:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:28:59 smithi084 ceph-mon[119097]: pgmap v1715: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:29:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: 467: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1xfQYJwKPUpO0RF off=9957466 len=226172 2024-01-13T18:29:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:op 2379 completed, throughput=4.99MB/sec 2024-01-13T18:29:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KUayUkTsr3T9NLS off=1120079 len=913787 2024-01-13T18:29:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:op 2380 completed, throughput=4.99MB/sec 2024-01-13T18:29:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bKDr61zXS_cQYmo off=3141722 len=848819 2024-01-13T18:29:00.162 INFO:tasks.workunit.client.0.smithi084.stdout:op 2381 completed, throughput=4.99MB/sec 2024-01-13T18:29:00.162 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-o2ymn8LF3s02sCJ off=5601286 len=1771918 2024-01-13T18:29:00.172 INFO:tasks.workunit.client.0.smithi084.stdout:op 2382 completed, throughput=5MB/sec 2024-01-13T18:29:00.172 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wfJlGi-1ZaXyMQX off=13787678 len=410004 2024-01-13T18:29:00.175 INFO:tasks.workunit.client.0.smithi084.stdout:op 2383 completed, throughput=5MB/sec 2024-01-13T18:29:00.175 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L4zFASHn4pjTz-F off=6515555 len=371295 2024-01-13T18:29:00.176 INFO:tasks.workunit.client.0.smithi084.stdout:op 2384 completed, throughput=5MB/sec 2024-01-13T18:29:00.176 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-c5O8pNRVYeEoihl off=2412232 len=1192700 2024-01-13T18:29:00.177 INFO:tasks.workunit.client.0.smithi084.stdout:op 2385 completed, throughput=5MB/sec 2024-01-13T18:29:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:29:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:29:00] "GET /metrics HTTP/1.1" 200 33992 "" "Prometheus/2.43.0" 2024-01-13T18:29:01.178 INFO:tasks.workunit.client.0.smithi084.stdout: 468: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:01.178 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_95ADjny1u3WM8_ off=2799723 len=1578714 2024-01-13T18:29:01.186 INFO:tasks.workunit.client.0.smithi084.stdout:op 2386 completed, throughput=4.99MB/sec 2024-01-13T18:29:01.186 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VBK-84SFy76pO7A off=6484257 len=1181847 2024-01-13T18:29:01.188 INFO:tasks.workunit.client.0.smithi084.stdout:op 2387 completed, throughput=5MB/sec 2024-01-13T18:29:01.189 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-h9KDx9TjLwCmEGX off=335428 len=207816 2024-01-13T18:29:01.191 INFO:tasks.workunit.client.0.smithi084.stdout:op 2388 completed, throughput=5MB/sec 2024-01-13T18:29:01.191 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0o-bFoq8Wc4S3HJ off=1815278 len=1885957 2024-01-13T18:29:01.199 INFO:tasks.workunit.client.0.smithi084.stdout:op 2389 completed, throughput=5MB/sec 2024-01-13T18:29:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:01 smithi099 ceph-mon[138788]: pgmap v1716: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:29:01.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:01 smithi084 ceph-mon[116404]: pgmap v1716: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:29:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:01 smithi084 ceph-mon[119097]: pgmap v1716: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:29:02.199 INFO:tasks.workunit.client.0.smithi084.stdout: 469: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:02.200 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0bSuqGMq9FBe-a2 off=1224886 len=1273047 2024-01-13T18:29:02.206 INFO:tasks.workunit.client.0.smithi084.stdout:op 2390 completed, throughput=4.99MB/sec 2024-01-13T18:29:02.206 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6p2G4b8pkgMqNjF off=13101757 len=2092784 2024-01-13T18:29:02.207 INFO:tasks.workunit.client.0.smithi084.stdout:op 2391 completed, throughput=5MB/sec 2024-01-13T18:29:02.207 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-23VZ-qsxz9ParNh off=1520337 len=1780128 2024-01-13T18:29:02.217 INFO:tasks.workunit.client.0.smithi084.stdout:op 2392 completed, throughput=5MB/sec 2024-01-13T18:29:03.217 INFO:tasks.workunit.client.0.smithi084.stdout: 470: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:03.218 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dfaP1tG1WqjPdTt off=5132677 len=1707569 2024-01-13T18:29:03.226 INFO:tasks.workunit.client.0.smithi084.stdout:op 2393 completed, throughput=4.99MB/sec 2024-01-13T18:29:03.226 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EY8jJojQe0NO0cH off=853521 len=1977523 2024-01-13T18:29:03.228 INFO:tasks.workunit.client.0.smithi084.stdout:op 2394 completed, throughput=5MB/sec 2024-01-13T18:29:03.228 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-V-H_bwG6HQ-rgEI off=6791779 len=559618 2024-01-13T18:29:03.231 INFO:tasks.workunit.client.0.smithi084.stdout:op 2395 completed, throughput=5MB/sec 2024-01-13T18:29:03.232 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GNzDdck21WfYeBa off=18834852 len=972043 2024-01-13T18:29:03.235 INFO:tasks.workunit.client.0.smithi084.stdout:op 2396 completed, throughput=5MB/sec 2024-01-13T18:29:03.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:03 smithi099 ceph-mon[138788]: pgmap v1717: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:29:03.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:03 smithi084 ceph-mon[116404]: pgmap v1717: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:29:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:03 smithi084 ceph-mon[119097]: pgmap v1717: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:29:04.235 INFO:tasks.workunit.client.0.smithi084.stdout: 471: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:04.235 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4jfAYQPRmGh7W8G off=4756764 len=1642512 2024-01-13T18:29:04.237 INFO:tasks.workunit.client.0.smithi084.stdout:op 2397 completed, throughput=4.99MB/sec 2024-01-13T18:29:04.237 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZqD1PpDnIqnjFOt off=96280 len=666104 2024-01-13T18:29:04.241 INFO:tasks.workunit.client.0.smithi084.stdout:op 2398 completed, throughput=4.99MB/sec 2024-01-13T18:29:04.241 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QBhZsl0TYdUfY3P off=1404157 len=605983 2024-01-13T18:29:04.246 INFO:tasks.workunit.client.0.smithi084.stdout:op 2399 completed, throughput=5MB/sec 2024-01-13T18:29:04.246 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-urBHJWMFawH3Xjg off=10518281 len=421969 2024-01-13T18:29:04.249 INFO:tasks.workunit.client.0.smithi084.stdout:op 2400 completed, throughput=5MB/sec 2024-01-13T18:29:04.249 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9dkuokzvobl0jII off=2447740 len=992215 2024-01-13T18:29:04.251 INFO:tasks.workunit.client.0.smithi084.stdout:op 2401 completed, throughput=5MB/sec 2024-01-13T18:29:04.251 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-K1uIPBRR_h8azVK off=2231523 len=551058 2024-01-13T18:29:04.254 INFO:tasks.workunit.client.0.smithi084.stdout:op 2402 completed, throughput=5MB/sec 2024-01-13T18:29:04.254 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rF8OasB7wGn8qfg off=2919224 len=1960022 2024-01-13T18:29:04.262 INFO:tasks.workunit.client.0.smithi084.stdout:op 2403 completed, throughput=5MB/sec 2024-01-13T18:29:05.262 INFO:tasks.workunit.client.0.smithi084.stdout: 472: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:05.262 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6W78ptzj-IVWhLc off=4831854 len=582576 2024-01-13T18:29:05.266 INFO:tasks.workunit.client.0.smithi084.stdout:op 2404 completed, throughput=4.99MB/sec 2024-01-13T18:29:05.267 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-p17x9NS7GK-uCmn off=6626637 len=410634 2024-01-13T18:29:05.269 INFO:tasks.workunit.client.0.smithi084.stdout:op 2405 completed, throughput=5MB/sec 2024-01-13T18:29:05.269 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eLpVPWLbd1VAbhs off=12005407 len=1655171 2024-01-13T18:29:05.271 INFO:tasks.workunit.client.0.smithi084.stdout:op 2406 completed, throughput=5MB/sec 2024-01-13T18:29:05.271 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Yo_zY9U-8ifOTbf off=11728080 len=1136459 2024-01-13T18:29:05.272 INFO:tasks.workunit.client.0.smithi084.stdout:op 2407 completed, throughput=5MB/sec 2024-01-13T18:29:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:05 smithi099 ceph-mon[138788]: pgmap v1718: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:29:05.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:05 smithi084 ceph-mon[116404]: pgmap v1718: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:29:05.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:05.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:05 smithi084 ceph-mon[119097]: pgmap v1718: 105 pgs: 105 active+clean; 128 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:29:05.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:06.273 INFO:tasks.workunit.client.0.smithi084.stdout: 473: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:06.273 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-flkJm0Iyjgx-h0O off=921813 len=1705224 2024-01-13T18:29:06.275 INFO:tasks.workunit.client.0.smithi084.stdout:op 2408 completed, throughput=4.99MB/sec 2024-01-13T18:29:06.275 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--fXzU93CTVcFpyJ off=4605958 len=1071414 2024-01-13T18:29:06.276 INFO:tasks.workunit.client.0.smithi084.stdout:op 2409 completed, throughput=5MB/sec 2024-01-13T18:29:06.276 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GeEdN7r4TLSIlr4 off=10238892 len=1442930 2024-01-13T18:29:06.279 INFO:tasks.workunit.client.0.smithi084.stdout:op 2410 completed, throughput=5MB/sec 2024-01-13T18:29:06.280 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UwN8lMSAaP5iizu off=1607313 len=1957727 2024-01-13T18:29:06.281 INFO:tasks.workunit.client.0.smithi084.stdout:op 2411 completed, throughput=5MB/sec 2024-01-13T18:29:07.282 INFO:tasks.workunit.client.0.smithi084.stdout: 474: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:07.339 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IWuPDcnadBZePxq off=5824176 len=580407 2024-01-13T18:29:07.341 INFO:tasks.workunit.client.0.smithi084.stdout:op 2412 completed, throughput=4.99MB/sec 2024-01-13T18:29:07.341 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HCbu8J5t_Vhgt0G off=16502958 len=449462 2024-01-13T18:29:07.341 INFO:tasks.workunit.client.0.smithi084.stdout:op 2413 completed, throughput=4.99MB/sec 2024-01-13T18:29:07.341 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GwoImlbS3go7_v- off=3308744 len=1049224 2024-01-13T18:29:07.341 INFO:tasks.workunit.client.0.smithi084.stdout:op 2414 completed, throughput=5MB/sec 2024-01-13T18:29:07.341 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xwFgLFAzAkZA2Tm off=1647613 len=770076 2024-01-13T18:29:07.341 INFO:tasks.workunit.client.0.smithi084.stdout:op 2415 completed, throughput=5MB/sec 2024-01-13T18:29:07.341 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HImarWGmqFeYsJ0 off=3483344 len=1404186 2024-01-13T18:29:07.341 INFO:tasks.workunit.client.0.smithi084.stdout:op 2416 completed, throughput=5MB/sec 2024-01-13T18:29:07.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:07 smithi099 ceph-mon[138788]: pgmap v1719: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:29:07.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:07 smithi084 ceph-mon[116404]: pgmap v1719: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:29:07.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:07 smithi084 ceph-mon[119097]: pgmap v1719: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:29:08.305 INFO:tasks.workunit.client.0.smithi084.stdout: 475: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:08.306 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ihKDM1cKDxvGr4n off=5704578 len=2076757 2024-01-13T18:29:08.308 INFO:tasks.workunit.client.0.smithi084.stdout:op 2417 completed, throughput=4.99MB/sec 2024-01-13T18:29:08.308 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cB1qDamxjlSwPWH off=18138073 len=1746548 2024-01-13T18:29:08.310 INFO:tasks.workunit.client.0.smithi084.stdout:op 2418 completed, throughput=5MB/sec 2024-01-13T18:29:08.310 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-udcHpVMAWXiBmDJ off=6296946 len=999825 2024-01-13T18:29:08.312 INFO:tasks.workunit.client.0.smithi084.stdout:op 2419 completed, throughput=5MB/sec 2024-01-13T18:29:08.312 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pcgHFFpTdQiFTE_ off=6286901 len=1246786 2024-01-13T18:29:08.313 INFO:tasks.workunit.client.0.smithi084.stdout:op 2420 completed, throughput=5MB/sec 2024-01-13T18:29:09.313 INFO:tasks.workunit.client.0.smithi084.stdout: 476: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:09.314 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QHX0rr4Ku9Hjjgt off=1382130 len=2002415 2024-01-13T18:29:09.324 INFO:tasks.workunit.client.0.smithi084.stdout:op 2421 completed, throughput=5MB/sec 2024-01-13T18:29:09.324 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zSxRTpVfEihNl6A off=12106081 len=1849570 2024-01-13T18:29:09.332 INFO:tasks.workunit.client.0.smithi084.stdout:op 2422 completed, throughput=5MB/sec 2024-01-13T18:29:09.332 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kULHHThGl7fkeBN off=12376586 len=961912 2024-01-13T18:29:09.334 INFO:tasks.workunit.client.0.smithi084.stdout:op 2423 completed, throughput=5MB/sec 2024-01-13T18:29:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:09 smithi099 ceph-mon[138788]: pgmap v1720: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:29:09.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:09 smithi084 ceph-mon[116404]: pgmap v1720: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:29:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:09 smithi084 ceph-mon[119097]: pgmap v1720: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:29:10.334 INFO:tasks.workunit.client.0.smithi084.stdout: 477: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:10.334 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f3jlsF8bXkY1vAG off=7685284 len=641935 2024-01-13T18:29:10.336 INFO:tasks.workunit.client.0.smithi084.stdout:op 2424 completed, throughput=4.99MB/sec 2024-01-13T18:29:10.336 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ssivs4-lfJVaIN8 off=1446785 len=1833043 2024-01-13T18:29:10.347 INFO:tasks.workunit.client.0.smithi084.stdout:op 2425 completed, throughput=5MB/sec 2024-01-13T18:29:10.347 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XTiE5yj3d4BgR9w off=10929597 len=449576 2024-01-13T18:29:10.350 INFO:tasks.workunit.client.0.smithi084.stdout:op 2426 completed, throughput=5MB/sec 2024-01-13T18:29:10.351 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nMdoUyyG6gkdzyk off=2157567 len=1641012 2024-01-13T18:29:10.352 INFO:tasks.workunit.client.0.smithi084.stdout:op 2427 completed, throughput=5MB/sec 2024-01-13T18:29:10.352 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-W_WHbmdj_kdTkVM off=558405 len=1503362 2024-01-13T18:29:10.358 INFO:tasks.workunit.client.0.smithi084.stdout:op 2428 completed, throughput=5MB/sec 2024-01-13T18:29:10.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:29:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:29:10] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:29:11.359 INFO:tasks.workunit.client.0.smithi084.stdout: 478: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:11.359 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AAk_bw725PPvkN2 off=2311861 len=503054 2024-01-13T18:29:11.363 INFO:tasks.workunit.client.0.smithi084.stdout:op 2429 completed, throughput=4.99MB/sec 2024-01-13T18:29:11.363 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3xBN5kW8Ep8OcHI off=9696367 len=2061970 2024-01-13T18:29:11.366 INFO:tasks.workunit.client.0.smithi084.stdout:op 2430 completed, throughput=5MB/sec 2024-01-13T18:29:11.366 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0hz4D4eyzP2UeYp off=1731301 len=1628785 2024-01-13T18:29:11.375 INFO:tasks.workunit.client.0.smithi084.stdout:op 2431 completed, throughput=5MB/sec 2024-01-13T18:29:11.375 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bwd6FTKNHWJq0Yf off=4569766 len=306198 2024-01-13T18:29:11.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 2432 completed, throughput=5MB/sec 2024-01-13T18:29:11.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:11 smithi099 ceph-mon[138788]: pgmap v1721: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:29:11.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:11 smithi084 ceph-mon[116404]: pgmap v1721: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:29:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:11 smithi084 ceph-mon[119097]: pgmap v1721: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:29:12.376 INFO:tasks.workunit.client.0.smithi084.stdout: 479: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:12.376 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HalMKa2mq2YL53q off=7437831 len=987601 2024-01-13T18:29:12.377 INFO:tasks.workunit.client.0.smithi084.stdout:op 2433 completed, throughput=4.99MB/sec 2024-01-13T18:29:12.378 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mUaD8BlwYdn7F_A off=17106529 len=1335027 2024-01-13T18:29:12.386 INFO:tasks.workunit.client.0.smithi084.stdout:op 2434 completed, throughput=4.99MB/sec 2024-01-13T18:29:12.386 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h50pyhIL879-0Tq off=10018940 len=1040619 2024-01-13T18:29:12.392 INFO:tasks.workunit.client.0.smithi084.stdout:op 2435 completed, throughput=5MB/sec 2024-01-13T18:29:12.392 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-a4wfoaGSQlDc_Oy off=303346 len=1339072 2024-01-13T18:29:12.405 INFO:tasks.workunit.client.0.smithi084.stdout:op 2436 completed, throughput=5MB/sec 2024-01-13T18:29:12.405 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GqxLjdrasgBnh60 off=6423102 len=1476068 2024-01-13T18:29:12.414 INFO:tasks.workunit.client.0.smithi084.stdout:op 2437 completed, throughput=5MB/sec 2024-01-13T18:29:13.415 INFO:tasks.workunit.client.0.smithi084.stdout: 480: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:13.415 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_Rw35-ew6vaF5ya off=8125162 len=75252 2024-01-13T18:29:13.415 INFO:tasks.workunit.client.0.smithi084.stdout:op 2438 completed, throughput=4.99MB/sec 2024-01-13T18:29:13.416 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BSijHXkyZXiguw5 off=5817149 len=53667 2024-01-13T18:29:13.416 INFO:tasks.workunit.client.0.smithi084.stdout:op 2439 completed, throughput=4.99MB/sec 2024-01-13T18:29:13.416 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mBfPtYQaCdwC_B_ off=15718448 len=1783197 2024-01-13T18:29:13.427 INFO:tasks.workunit.client.0.smithi084.stdout:op 2440 completed, throughput=5MB/sec 2024-01-13T18:29:13.427 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2tRNt3DMEO_ROzb off=7455482 len=955272 2024-01-13T18:29:13.432 INFO:tasks.workunit.client.0.smithi084.stdout:op 2441 completed, throughput=5MB/sec 2024-01-13T18:29:13.432 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0k3T1s24T3K89nk off=3131605 len=1446759 2024-01-13T18:29:13.433 INFO:tasks.workunit.client.0.smithi084.stdout:op 2442 completed, throughput=5MB/sec 2024-01-13T18:29:13.433 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-u3mH0p9k1rqgJ3l off=11850449 len=717687 2024-01-13T18:29:13.436 INFO:tasks.workunit.client.0.smithi084.stdout:op 2443 completed, throughput=5MB/sec 2024-01-13T18:29:13.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:13 smithi099 ceph-mon[138788]: pgmap v1722: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:29:13.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:13 smithi084 ceph-mon[116404]: pgmap v1722: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:29:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:13 smithi084 ceph-mon[119097]: pgmap v1722: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:29:14.437 INFO:tasks.workunit.client.0.smithi084.stdout: 481: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:14.437 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-F1Iu0eKsvstQOZ- off=17840401 len=91589 2024-01-13T18:29:14.438 INFO:tasks.workunit.client.0.smithi084.stdout:op 2444 completed, throughput=4.99MB/sec 2024-01-13T18:29:14.438 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qAYi7fvjQ3lyEma off=1487717 len=820956 2024-01-13T18:29:14.439 INFO:tasks.workunit.client.0.smithi084.stdout:op 2445 completed, throughput=4.99MB/sec 2024-01-13T18:29:14.439 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dgS-qODMTKvZJ-T off=7623839 len=2029250 2024-01-13T18:29:14.441 INFO:tasks.workunit.client.0.smithi084.stdout:op 2446 completed, throughput=5MB/sec 2024-01-13T18:29:14.441 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eKLF32WHp1el5nS off=8977865 len=1164505 2024-01-13T18:29:14.450 INFO:tasks.workunit.client.0.smithi084.stdout:op 2447 completed, throughput=5MB/sec 2024-01-13T18:29:14.450 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kR35a3qG4hWBaXK off=3982000 len=1569526 2024-01-13T18:29:14.457 INFO:tasks.workunit.client.0.smithi084.stdout:op 2448 completed, throughput=5MB/sec 2024-01-13T18:29:15.458 INFO:tasks.workunit.client.0.smithi084.stdout: 482: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:15.458 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V2rPZ3NSFyRjcgp off=73765 len=1187667 2024-01-13T18:29:15.459 INFO:tasks.workunit.client.0.smithi084.stdout:op 2449 completed, throughput=4.99MB/sec 2024-01-13T18:29:15.459 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Lb5Bfk18RAZxvt1 off=166619 len=472201 2024-01-13T18:29:15.462 INFO:tasks.workunit.client.0.smithi084.stdout:op 2450 completed, throughput=4.99MB/sec 2024-01-13T18:29:15.463 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OSZ0Pzvl72bLVBi off=1401972 len=714472 2024-01-13T18:29:15.464 INFO:tasks.workunit.client.0.smithi084.stdout:op 2451 completed, throughput=5MB/sec 2024-01-13T18:29:15.464 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IvXwI3waFwQUc_2 off=2074017 len=1556832 2024-01-13T18:29:15.473 INFO:tasks.workunit.client.0.smithi084.stdout:op 2452 completed, throughput=5MB/sec 2024-01-13T18:29:15.473 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tKl3thzTEXv1iRr off=2586151 len=2046349 2024-01-13T18:29:15.474 INFO:tasks.workunit.client.0.smithi084.stdout:op 2453 completed, throughput=5MB/sec 2024-01-13T18:29:15.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:15 smithi099 ceph-mon[138788]: pgmap v1723: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:29:15.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:15 smithi084 ceph-mon[116404]: pgmap v1723: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:29:15.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:15 smithi084 ceph-mon[119097]: pgmap v1723: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:29:16.474 INFO:tasks.workunit.client.0.smithi084.stdout: 483: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:16.475 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-om1ZWjA_O0m9aBA off=19556892 len=679415 2024-01-13T18:29:16.479 INFO:tasks.workunit.client.0.smithi084.stdout:op 2454 completed, throughput=4.99MB/sec 2024-01-13T18:29:16.479 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yg1To8ri0ApetZe off=665040 len=952013 2024-01-13T18:29:16.483 INFO:tasks.workunit.client.0.smithi084.stdout:op 2455 completed, throughput=5MB/sec 2024-01-13T18:29:16.484 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-esJFDSdyFmQsm06 off=16691981 len=701763 2024-01-13T18:29:16.485 INFO:tasks.workunit.client.0.smithi084.stdout:op 2456 completed, throughput=5MB/sec 2024-01-13T18:29:16.485 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-izl5yPQmkXKNKvl off=6706302 len=1878122 2024-01-13T18:29:16.495 INFO:tasks.workunit.client.0.smithi084.stdout:op 2457 completed, throughput=5MB/sec 2024-01-13T18:29:17.495 INFO:tasks.workunit.client.0.smithi084.stdout: 484: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:17.495 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XquvzwY2hPqw7Fh off=1167185 len=1401831 2024-01-13T18:29:17.504 INFO:tasks.workunit.client.0.smithi084.stdout:op 2458 completed, throughput=4.99MB/sec 2024-01-13T18:29:17.504 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-a3P6HM1IhTjsBOd off=4386787 len=1837700 2024-01-13T18:29:17.513 INFO:tasks.workunit.client.0.smithi084.stdout:op 2459 completed, throughput=5MB/sec 2024-01-13T18:29:17.513 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WV9jit4PQJWlZD2 off=4206114 len=1545179 2024-01-13T18:29:17.518 INFO:tasks.workunit.client.0.smithi084.stdout:op 2460 completed, throughput=5MB/sec 2024-01-13T18:29:17.518 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-30T022Tw548qVJm off=16366182 len=1947673 2024-01-13T18:29:17.529 INFO:tasks.workunit.client.0.smithi084.stdout:op 2461 completed, throughput=5MB/sec 2024-01-13T18:29:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:17 smithi099 ceph-mon[138788]: pgmap v1724: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:29:17.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:17 smithi084 ceph-mon[116404]: pgmap v1724: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:29:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:17 smithi084 ceph-mon[119097]: pgmap v1724: 105 pgs: 105 active+clean; 128 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:29:18.529 INFO:tasks.workunit.client.0.smithi084.stdout: 485: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:18.529 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-s_qnZlsBSoQX6fr off=4478026 len=1634355 2024-01-13T18:29:18.531 INFO:tasks.workunit.client.0.smithi084.stdout:op 2462 completed, throughput=5MB/sec 2024-01-13T18:29:18.531 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XqIMJPSqYZVZuyM off=2567299 len=1023598 2024-01-13T18:29:18.533 INFO:tasks.workunit.client.0.smithi084.stdout:op 2463 completed, throughput=5MB/sec 2024-01-13T18:29:18.533 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L5YbFzqFIa_ygbP off=5743521 len=1654956 2024-01-13T18:29:18.535 INFO:tasks.workunit.client.0.smithi084.stdout:op 2464 completed, throughput=5MB/sec 2024-01-13T18:29:19.535 INFO:tasks.workunit.client.0.smithi084.stdout: 486: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:19.535 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SJNqgTrqseKPqTh off=1055289 len=1389591 2024-01-13T18:29:19.541 INFO:tasks.workunit.client.0.smithi084.stdout:op 2465 completed, throughput=4.99MB/sec 2024-01-13T18:29:19.542 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lYBfea5Sa_MkAzz off=9535328 len=2066598 2024-01-13T18:29:19.554 INFO:tasks.workunit.client.0.smithi084.stdout:op 2466 completed, throughput=5MB/sec 2024-01-13T18:29:19.555 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4ZxNq4O03MC388q off=5347565 len=1713386 2024-01-13T18:29:19.564 INFO:tasks.workunit.client.0.smithi084.stdout:op 2467 completed, throughput=5MB/sec 2024-01-13T18:29:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:19 smithi099 ceph-mon[138788]: pgmap v1725: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:29:19.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:19 smithi084 ceph-mon[116404]: pgmap v1725: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:29:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:19 smithi084 ceph-mon[119097]: pgmap v1725: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:29:20.565 INFO:tasks.workunit.client.0.smithi084.stdout: 487: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:20.565 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cDqmNoTbQsQNnty off=15549306 len=1365190 2024-01-13T18:29:20.567 INFO:tasks.workunit.client.0.smithi084.stdout:op 2468 completed, throughput=4.99MB/sec 2024-01-13T18:29:20.567 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-deFVsYfvVXgtOX3 off=1832355 len=577658 2024-01-13T18:29:20.571 INFO:tasks.workunit.client.0.smithi084.stdout:op 2469 completed, throughput=4.99MB/sec 2024-01-13T18:29:20.571 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y5uYnZRxpL_Jtgb off=59574 len=245719 2024-01-13T18:29:20.571 INFO:tasks.workunit.client.0.smithi084.stdout:op 2470 completed, throughput=5MB/sec 2024-01-13T18:29:20.571 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_Pl3QwaRzh4ity9 off=1440254 len=141781 2024-01-13T18:29:20.572 INFO:tasks.workunit.client.0.smithi084.stdout:op 2471 completed, throughput=5MB/sec 2024-01-13T18:29:20.572 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8mri0QJpn9kutQY off=2528871 len=1939742 2024-01-13T18:29:20.583 INFO:tasks.workunit.client.0.smithi084.stdout:op 2472 completed, throughput=5MB/sec 2024-01-13T18:29:20.583 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cxJChPlQNH4WK24 off=14212334 len=239328 2024-01-13T18:29:20.586 INFO:tasks.workunit.client.0.smithi084.stdout:op 2473 completed, throughput=5MB/sec 2024-01-13T18:29:20.586 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PbfDucH3281ulw5 off=22091280 len=1204508 2024-01-13T18:29:20.591 INFO:tasks.workunit.client.0.smithi084.stdout:op 2474 completed, throughput=5MB/sec 2024-01-13T18:29:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:29:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:29:20] "GET /metrics HTTP/1.1" 200 33993 "" "Prometheus/2.43.0" 2024-01-13T18:29:21.592 INFO:tasks.workunit.client.0.smithi084.stdout: 488: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:21.592 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kx0gq2i-S2PmCo1 off=10291961 len=704117 2024-01-13T18:29:21.596 INFO:tasks.workunit.client.0.smithi084.stdout:op 2475 completed, throughput=4.99MB/sec 2024-01-13T18:29:21.597 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rF9TwyFhQj-HXN0 off=3187679 len=1245108 2024-01-13T18:29:21.598 INFO:tasks.workunit.client.0.smithi084.stdout:op 2476 completed, throughput=5MB/sec 2024-01-13T18:29:21.598 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZH77Rr7tKvOLUPD off=3337477 len=226652 2024-01-13T18:29:21.601 INFO:tasks.workunit.client.0.smithi084.stdout:op 2477 completed, throughput=5MB/sec 2024-01-13T18:29:21.601 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-agnWkYYZvpPOomT off=8116925 len=433252 2024-01-13T18:29:21.604 INFO:tasks.workunit.client.0.smithi084.stdout:op 2478 completed, throughput=5MB/sec 2024-01-13T18:29:21.604 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xUelAWjJePfAlE_ off=10301836 len=1254862 2024-01-13T18:29:21.612 INFO:tasks.workunit.client.0.smithi084.stdout:op 2479 completed, throughput=5MB/sec 2024-01-13T18:29:21.612 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KdM-EPctJgrR-DM off=17696740 len=1287219 2024-01-13T18:29:21.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:21 smithi099 ceph-mon[138788]: pgmap v1726: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:29:21.619 INFO:tasks.workunit.client.0.smithi084.stdout:op 2480 completed, throughput=5MB/sec 2024-01-13T18:29:21.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:21 smithi084 ceph-mon[116404]: pgmap v1726: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:29:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:21 smithi084 ceph-mon[119097]: pgmap v1726: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:29:22.619 INFO:tasks.workunit.client.0.smithi084.stdout: 489: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:22.619 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Mibq226cTAFcTh3 off=1607011 len=914812 2024-01-13T18:29:22.624 INFO:tasks.workunit.client.0.smithi084.stdout:op 2481 completed, throughput=4.99MB/sec 2024-01-13T18:29:22.624 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GMuEl8WqHV_sC1z off=3140463 len=2028441 2024-01-13T18:29:22.626 INFO:tasks.workunit.client.0.smithi084.stdout:op 2482 completed, throughput=5MB/sec 2024-01-13T18:29:22.626 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gX4NVJ9vmxnw1_h off=5898332 len=1824724 2024-01-13T18:29:22.636 INFO:tasks.workunit.client.0.smithi084.stdout:op 2483 completed, throughput=5MB/sec 2024-01-13T18:29:23.636 INFO:tasks.workunit.client.0.smithi084.stdout: 490: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:23.636 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iYwTJi8ahjvsNIN off=7302140 len=1523051 2024-01-13T18:29:23.645 INFO:tasks.workunit.client.0.smithi084.stdout:op 2484 completed, throughput=4.99MB/sec 2024-01-13T18:29:23.645 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_rKKb3bh_VeOepp off=3060594 len=528488 2024-01-13T18:29:23.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 2485 completed, throughput=4.99MB/sec 2024-01-13T18:29:23.646 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MYpEgZHi3OMtFKD off=3008232 len=1837065 2024-01-13T18:29:23.654 INFO:tasks.workunit.client.0.smithi084.stdout:op 2486 completed, throughput=5MB/sec 2024-01-13T18:29:23.654 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LOJHFHekd3qMxd3 off=594486 len=1609553 2024-01-13T18:29:23.657 INFO:tasks.workunit.client.0.smithi084.stdout:op 2487 completed, throughput=5MB/sec 2024-01-13T18:29:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:23 smithi099 ceph-mon[138788]: pgmap v1727: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:29:23.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:23 smithi084 ceph-mon[116404]: pgmap v1727: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:29:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:23 smithi084 ceph-mon[119097]: pgmap v1727: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:29:24.657 INFO:tasks.workunit.client.0.smithi084.stdout: 491: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:24.658 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NZGAYYfllw_bejj off=10205340 len=1118645 2024-01-13T18:29:24.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 2488 completed, throughput=4.99MB/sec 2024-01-13T18:29:24.659 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ey0-1E9Oh8t4X_H off=12454760 len=237470 2024-01-13T18:29:24.662 INFO:tasks.workunit.client.0.smithi084.stdout:op 2489 completed, throughput=4.99MB/sec 2024-01-13T18:29:24.662 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PU74RFxaQ7qxwb2 off=12217083 len=126912 2024-01-13T18:29:24.663 INFO:tasks.workunit.client.0.smithi084.stdout:op 2490 completed, throughput=4.99MB/sec 2024-01-13T18:29:24.663 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Qyb7qhUmSTjD9kY off=6276725 len=1111526 2024-01-13T18:29:24.668 INFO:tasks.workunit.client.0.smithi084.stdout:op 2491 completed, throughput=5MB/sec 2024-01-13T18:29:24.668 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5xHkT3riGKxs-l5 off=7191050 len=1718092 2024-01-13T18:29:24.677 INFO:tasks.workunit.client.0.smithi084.stdout:op 2492 completed, throughput=5MB/sec 2024-01-13T18:29:24.677 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-s0JJM25Tsr9wH2O off=649548 len=8649 2024-01-13T18:29:24.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 2493 completed, throughput=5MB/sec 2024-01-13T18:29:24.679 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DApBWMRYAh_5MW- off=6706211 len=1073456 2024-01-13T18:29:24.684 INFO:tasks.workunit.client.0.smithi084.stdout:op 2494 completed, throughput=5MB/sec 2024-01-13T18:29:25.684 INFO:tasks.workunit.client.0.smithi084.stdout: 492: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:25.684 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2DKHHx-3m9-Z5xl off=1852139 len=1135953 2024-01-13T18:29:25.687 INFO:tasks.workunit.client.0.smithi084.stdout:op 2495 completed, throughput=4.99MB/sec 2024-01-13T18:29:25.687 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-D8Fttg9r4QkbpDv off=1978362 len=577415 2024-01-13T18:29:25.690 INFO:tasks.workunit.client.0.smithi084.stdout:op 2496 completed, throughput=4.99MB/sec 2024-01-13T18:29:25.690 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-COHk6bo8N4PA121 off=3710933 len=1014645 2024-01-13T18:29:25.692 INFO:tasks.workunit.client.0.smithi084.stdout:op 2497 completed, throughput=5MB/sec 2024-01-13T18:29:25.692 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-of9NbQ0dbz-as0J off=949073 len=1147016 2024-01-13T18:29:25.694 INFO:tasks.workunit.client.0.smithi084.stdout:op 2498 completed, throughput=5MB/sec 2024-01-13T18:29:25.694 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vykQ9bdYqis4CQV off=3522240 len=794674 2024-01-13T18:29:25.699 INFO:tasks.workunit.client.0.smithi084.stdout:op 2499 completed, throughput=5MB/sec 2024-01-13T18:29:25.699 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-X0Vq1u7HHAFsw0g off=3888874 len=1967456 2024-01-13T18:29:25.708 INFO:tasks.workunit.client.0.smithi084.stdout:op 2500 completed, throughput=5MB/sec 2024-01-13T18:29:25.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:25 smithi099 ceph-mon[138788]: pgmap v1728: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 4 op/s 2024-01-13T18:29:25.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:25 smithi084 ceph-mon[116404]: pgmap v1728: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 4 op/s 2024-01-13T18:29:25.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:25 smithi084 ceph-mon[119097]: pgmap v1728: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 4 op/s 2024-01-13T18:29:26.709 INFO:tasks.workunit.client.0.smithi084.stdout: 493: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:26.709 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eIWpWroi1zNns4Y off=166853 len=264685 2024-01-13T18:29:26.709 INFO:tasks.workunit.client.0.smithi084.stdout:op 2501 completed, throughput=4.99MB/sec 2024-01-13T18:29:26.709 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iq6g6gedfNGKNTR off=16300852 len=650336 2024-01-13T18:29:26.712 INFO:tasks.workunit.client.0.smithi084.stdout:op 2502 completed, throughput=4.99MB/sec 2024-01-13T18:29:26.712 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kZVadC8Rgz5vdb9 off=21197783 len=1598561 2024-01-13T18:29:26.713 INFO:tasks.workunit.client.0.smithi084.stdout:op 2503 completed, throughput=5MB/sec 2024-01-13T18:29:26.713 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-riC9sTd5apAFhMG off=13691272 len=713082 2024-01-13T18:29:26.717 INFO:tasks.workunit.client.0.smithi084.stdout:op 2504 completed, throughput=5MB/sec 2024-01-13T18:29:26.717 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gwZNxKoAQaXeJ1P off=5917630 len=1846196 2024-01-13T18:29:26.724 INFO:tasks.workunit.client.0.smithi084.stdout:op 2505 completed, throughput=5MB/sec 2024-01-13T18:29:27.724 INFO:tasks.workunit.client.0.smithi084.stdout: 494: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:27.724 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JUb9ldecHh3SM3l off=9142971 len=1777235 2024-01-13T18:29:27.730 INFO:tasks.workunit.client.0.smithi084.stdout:op 2506 completed, throughput=5MB/sec 2024-01-13T18:29:27.730 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--2JPQa_WKqaDM87 off=15720322 len=167198 2024-01-13T18:29:27.731 INFO:tasks.workunit.client.0.smithi084.stdout:op 2507 completed, throughput=5MB/sec 2024-01-13T18:29:27.731 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QXTFh9L8UmpMxH0 off=8259358 len=107170 2024-01-13T18:29:27.733 INFO:tasks.workunit.client.0.smithi084.stdout:op 2508 completed, throughput=5MB/sec 2024-01-13T18:29:27.733 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NAB-vQ5IVx7JIWJ off=8983815 len=1061859 2024-01-13T18:29:27.738 INFO:tasks.workunit.client.0.smithi084.stdout:op 2509 completed, throughput=5MB/sec 2024-01-13T18:29:27.738 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ElGgFcFIh7iLbl5 off=10479010 len=30456 2024-01-13T18:29:27.739 INFO:tasks.workunit.client.0.smithi084.stdout:op 2510 completed, throughput=5MB/sec 2024-01-13T18:29:27.739 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UwxMCQiQznE3jen off=3548767 len=21955 2024-01-13T18:29:27.739 INFO:tasks.workunit.client.0.smithi084.stdout:op 2511 completed, throughput=5MB/sec 2024-01-13T18:29:27.739 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RHzk6jq8LEEzahK off=1290089 len=900935 2024-01-13T18:29:27.740 INFO:tasks.workunit.client.0.smithi084.stdout:op 2512 completed, throughput=5MB/sec 2024-01-13T18:29:27.740 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nVamUEItdeIH8os off=4237814 len=90562 2024-01-13T18:29:27.740 INFO:tasks.workunit.client.0.smithi084.stdout:op 2513 completed, throughput=5MB/sec 2024-01-13T18:29:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:27 smithi099 ceph-mon[138788]: pgmap v1729: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:29:27.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:29:27.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:29:27.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:29:27.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:29:27.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:27 smithi084 ceph-mon[116404]: pgmap v1729: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:29:27.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:29:27.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:29:27.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:29:27.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:29:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:27 smithi084 ceph-mon[119097]: pgmap v1729: 105 pgs: 105 active+clean; 128 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:29:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:29:27.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:29:27.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:29:27.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:29:28.741 INFO:tasks.workunit.client.0.smithi084.stdout: 495: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:28.741 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wt3wybpCcbj5iiv off=15548840 len=714084 2024-01-13T18:29:28.742 INFO:tasks.workunit.client.0.smithi084.stdout:op 2514 completed, throughput=4.99MB/sec 2024-01-13T18:29:28.742 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VkXvjXsL96CJpME off=14570078 len=105293 2024-01-13T18:29:28.745 INFO:tasks.workunit.client.0.smithi084.stdout:op 2515 completed, throughput=4.99MB/sec 2024-01-13T18:29:28.745 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aWycgO_mXNZyAN- off=13456155 len=1827626 2024-01-13T18:29:28.755 INFO:tasks.workunit.client.0.smithi084.stdout:op 2516 completed, throughput=5MB/sec 2024-01-13T18:29:28.755 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eEP0qT9pSf4BYgT off=10631522 len=531530 2024-01-13T18:29:28.755 INFO:tasks.workunit.client.0.smithi084.stdout:op 2517 completed, throughput=5MB/sec 2024-01-13T18:29:28.755 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aScHhFGd3JC6rC6 off=3083481 len=61487 2024-01-13T18:29:28.756 INFO:tasks.workunit.client.0.smithi084.stdout:op 2518 completed, throughput=5MB/sec 2024-01-13T18:29:28.756 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GnKcXgwvRIxrz0O off=633680 len=142158 2024-01-13T18:29:28.756 INFO:tasks.workunit.client.0.smithi084.stdout:op 2519 completed, throughput=5MB/sec 2024-01-13T18:29:28.757 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-icM03qTZhwG-mKC off=15129687 len=139272 2024-01-13T18:29:28.757 INFO:tasks.workunit.client.0.smithi084.stdout:op 2520 completed, throughput=5MB/sec 2024-01-13T18:29:28.757 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OTnjibpMUySihwd off=1195663 len=1054174 2024-01-13T18:29:28.758 INFO:tasks.workunit.client.0.smithi084.stdout:op 2521 completed, throughput=5MB/sec 2024-01-13T18:29:28.758 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vfgMvHyC6F0HF3C off=9314383 len=54889 2024-01-13T18:29:28.761 INFO:tasks.workunit.client.0.smithi084.stdout:op 2522 completed, throughput=5MB/sec 2024-01-13T18:29:28.761 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aF0ee0x34pIZu3e off=2550706 len=1846790 2024-01-13T18:29:28.762 INFO:tasks.workunit.client.0.smithi084.stdout:op 2523 completed, throughput=5MB/sec 2024-01-13T18:29:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:29 smithi099 ceph-mon[138788]: pgmap v1730: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:29:29.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:29 smithi084 ceph-mon[116404]: pgmap v1730: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:29:29.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:29 smithi084 ceph-mon[119097]: pgmap v1730: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:29:29.763 INFO:tasks.workunit.client.0.smithi084.stdout: 496: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:29.763 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ozoGeZL-yAAKpMD off=17427890 len=1452814 2024-01-13T18:29:29.768 INFO:tasks.workunit.client.0.smithi084.stdout:op 2524 completed, throughput=5MB/sec 2024-01-13T18:29:29.769 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WSpgXYnfFEH1YKc off=4561455 len=1268759 2024-01-13T18:29:29.776 INFO:tasks.workunit.client.0.smithi084.stdout:op 2525 completed, throughput=5MB/sec 2024-01-13T18:29:29.776 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LJlszEMrbxk_sDf off=5798793 len=521430 2024-01-13T18:29:29.777 INFO:tasks.workunit.client.0.smithi084.stdout:op 2526 completed, throughput=5MB/sec 2024-01-13T18:29:29.777 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6ZBPulxhvLPjNZS off=8540993 len=1536891 2024-01-13T18:29:29.783 INFO:tasks.workunit.client.0.smithi084.stdout:op 2527 completed, throughput=5MB/sec 2024-01-13T18:29:30.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:29:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:29:30] "GET /metrics HTTP/1.1" 200 33993 "" "Prometheus/2.43.0" 2024-01-13T18:29:30.784 INFO:tasks.workunit.client.0.smithi084.stdout: 497: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:30.784 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9wbS-4yapWJ-Pt- off=1051644 len=1301845 2024-01-13T18:29:30.790 INFO:tasks.workunit.client.0.smithi084.stdout:op 2528 completed, throughput=4.99MB/sec 2024-01-13T18:29:30.790 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9s-BbYsasM13gBs off=6787493 len=2005636 2024-01-13T18:29:30.792 INFO:tasks.workunit.client.0.smithi084.stdout:op 2529 completed, throughput=5MB/sec 2024-01-13T18:29:30.792 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7vKlXYvsVyoRAIT off=20541154 len=1110163 2024-01-13T18:29:30.794 INFO:tasks.workunit.client.0.smithi084.stdout:op 2530 completed, throughput=5MB/sec 2024-01-13T18:29:30.794 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4Xfx3ORxB5Qc2dL off=8311421 len=654420 2024-01-13T18:29:30.798 INFO:tasks.workunit.client.0.smithi084.stdout:op 2531 completed, throughput=5MB/sec 2024-01-13T18:29:31.798 INFO:tasks.workunit.client.0.smithi084.stdout: 498: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:31.798 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7f09N-uR7wt8MA8 off=672416 len=765299 2024-01-13T18:29:31.803 INFO:tasks.workunit.client.0.smithi084.stdout:op 2532 completed, throughput=4.99MB/sec 2024-01-13T18:29:31.803 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-48YFQzvbohlyecA off=11318159 len=170165 2024-01-13T18:29:31.805 INFO:tasks.workunit.client.0.smithi084.stdout:op 2533 completed, throughput=4.99MB/sec 2024-01-13T18:29:31.805 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-P_gpvFEItplmN49 off=12914317 len=209854 2024-01-13T18:29:31.806 INFO:tasks.workunit.client.0.smithi084.stdout:op 2534 completed, throughput=4.99MB/sec 2024-01-13T18:29:31.806 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RjwWHdNFZFALHpM off=3399782 len=700301 2024-01-13T18:29:31.810 INFO:tasks.workunit.client.0.smithi084.stdout:op 2535 completed, throughput=4.99MB/sec 2024-01-13T18:29:31.810 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VX3oWIyLBBYEThm off=7283326 len=1967227 2024-01-13T18:29:31.812 INFO:tasks.workunit.client.0.smithi084.stdout:op 2536 completed, throughput=5MB/sec 2024-01-13T18:29:31.812 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MRbRBK5XV2fEXMu off=12010589 len=1171397 2024-01-13T18:29:31.817 INFO:tasks.workunit.client.0.smithi084.stdout:op 2537 completed, throughput=5MB/sec 2024-01-13T18:29:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:31 smithi099 ceph-mon[138788]: pgmap v1731: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:29:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:31 smithi084 ceph-mon[116404]: pgmap v1731: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:29:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:31 smithi084 ceph-mon[119097]: pgmap v1731: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:29:32.818 INFO:tasks.workunit.client.0.smithi084.stdout: 499: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:32.818 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pLdF50hh4r-o7-9 off=20767074 len=1232575 2024-01-13T18:29:32.820 INFO:tasks.workunit.client.0.smithi084.stdout:op 2538 completed, throughput=4.99MB/sec 2024-01-13T18:29:32.820 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wSje2E2Py8o3N54 off=1172637 len=94365 2024-01-13T18:29:32.823 INFO:tasks.workunit.client.0.smithi084.stdout:op 2539 completed, throughput=4.99MB/sec 2024-01-13T18:29:32.823 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-olXI1cWaQzpoaaM off=10260952 len=426237 2024-01-13T18:29:32.824 INFO:tasks.workunit.client.0.smithi084.stdout:op 2540 completed, throughput=4.99MB/sec 2024-01-13T18:29:32.824 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UNNdz9S0cZpsmKp off=4881348 len=1599119 2024-01-13T18:29:32.826 INFO:tasks.workunit.client.0.smithi084.stdout:op 2541 completed, throughput=5MB/sec 2024-01-13T18:29:32.826 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ETYHH5hQpt1TgTf off=1844234 len=571619 2024-01-13T18:29:32.830 INFO:tasks.workunit.client.0.smithi084.stdout:op 2542 completed, throughput=5MB/sec 2024-01-13T18:29:32.830 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IU0QsVkGKMPyGGs off=4759757 len=1108031 2024-01-13T18:29:32.831 INFO:tasks.workunit.client.0.smithi084.stdout:op 2543 completed, throughput=5MB/sec 2024-01-13T18:29:32.831 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Z1tjLMsfVqgQdJh off=4610202 len=170285 2024-01-13T18:29:32.834 INFO:tasks.workunit.client.0.smithi084.stdout:op 2544 completed, throughput=5MB/sec 2024-01-13T18:29:32.834 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LGQsPafDtS0zaM8 off=7897198 len=1450695 2024-01-13T18:29:32.835 INFO:tasks.workunit.client.0.smithi084.stdout:op 2545 completed, throughput=5MB/sec 2024-01-13T18:29:33.835 INFO:tasks.workunit.client.0.smithi084.stdout: 500: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:33.835 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OL214W4EcAF547T off=14005456 len=1100023 2024-01-13T18:29:33.841 INFO:tasks.workunit.client.0.smithi084.stdout:op 2546 completed, throughput=4.99MB/sec 2024-01-13T18:29:33.841 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RcjtwlohQS8E86i off=596946 len=1763064 2024-01-13T18:29:33.843 INFO:tasks.workunit.client.0.smithi084.stdout:op 2547 completed, throughput=5MB/sec 2024-01-13T18:29:33.843 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZZaL8tbx7jq0Brh off=1769318 len=930344 2024-01-13T18:29:33.848 INFO:tasks.workunit.client.0.smithi084.stdout:op 2548 completed, throughput=5MB/sec 2024-01-13T18:29:33.848 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-m6ghQxIf2mYYbKE off=2825123 len=1368346 2024-01-13T18:29:33.850 INFO:tasks.workunit.client.0.smithi084.stdout:op 2549 completed, throughput=5MB/sec 2024-01-13T18:29:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:33 smithi099 ceph-mon[138788]: pgmap v1732: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:29:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:33 smithi084 ceph-mon[119097]: pgmap v1732: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:29:33.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:33 smithi084 ceph-mon[116404]: pgmap v1732: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:29:34.850 INFO:tasks.workunit.client.0.smithi084.stdout: 501: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:34.850 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YvSzvKmKDaFJsR8 off=284420 len=1405459 2024-01-13T18:29:34.856 INFO:tasks.workunit.client.0.smithi084.stdout:op 2550 completed, throughput=4.99MB/sec 2024-01-13T18:29:34.856 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tefLNwxfU-n7LFo off=2031047 len=854154 2024-01-13T18:29:34.861 INFO:tasks.workunit.client.0.smithi084.stdout:op 2551 completed, throughput=5MB/sec 2024-01-13T18:29:34.861 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9DO4JCpSpNSjVRt off=7436452 len=229117 2024-01-13T18:29:34.862 INFO:tasks.workunit.client.0.smithi084.stdout:op 2552 completed, throughput=5MB/sec 2024-01-13T18:29:34.862 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-INNeWQTUwbJ9fjD off=15630432 len=1963249 2024-01-13T18:29:34.864 INFO:tasks.workunit.client.0.smithi084.stdout:op 2553 completed, throughput=5MB/sec 2024-01-13T18:29:35.864 INFO:tasks.workunit.client.0.smithi084.stdout: 502: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:35.864 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jhaEcwMMwYqeoFF off=13008267 len=829284 2024-01-13T18:29:35.866 INFO:tasks.workunit.client.0.smithi084.stdout:op 2554 completed, throughput=4.99MB/sec 2024-01-13T18:29:35.866 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-smi2A6lv0UP0iLg off=12779803 len=596838 2024-01-13T18:29:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:35 smithi099 ceph-mon[138788]: pgmap v1733: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 6 op/s 2024-01-13T18:29:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:35.870 INFO:tasks.workunit.client.0.smithi084.stdout:op 2555 completed, throughput=4.99MB/sec 2024-01-13T18:29:35.870 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DlswqUPBzLIJYdw off=4560496 len=585046 2024-01-13T18:29:35.870 INFO:tasks.workunit.client.0.smithi084.stdout:op 2556 completed, throughput=4.99MB/sec 2024-01-13T18:29:35.871 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FzTdYblq6UROkSy off=3126243 len=44111 2024-01-13T18:29:35.871 INFO:tasks.workunit.client.0.smithi084.stdout:op 2557 completed, throughput=4.99MB/sec 2024-01-13T18:29:35.871 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U1vVjCcCQbljqJN off=6245562 len=1367670 2024-01-13T18:29:35.872 INFO:tasks.workunit.client.0.smithi084.stdout:op 2558 completed, throughput=5MB/sec 2024-01-13T18:29:35.872 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pB1-dRzN9qwnquC off=15040797 len=697282 2024-01-13T18:29:35.877 INFO:tasks.workunit.client.0.smithi084.stdout:op 2559 completed, throughput=5MB/sec 2024-01-13T18:29:35.877 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MRfD5XGW_1srgyI off=1340052 len=1445349 2024-01-13T18:29:35.878 INFO:tasks.workunit.client.0.smithi084.stdout:op 2560 completed, throughput=5MB/sec 2024-01-13T18:29:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:35 smithi084 ceph-mon[116404]: pgmap v1733: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 6 op/s 2024-01-13T18:29:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:35 smithi084 ceph-mon[119097]: pgmap v1733: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 6 op/s 2024-01-13T18:29:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:36.879 INFO:tasks.workunit.client.0.smithi084.stdout: 503: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:36.879 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-od-0ZSiL2_5ZAQC off=13865038 len=2071070 2024-01-13T18:29:36.882 INFO:tasks.workunit.client.0.smithi084.stdout:op 2561 completed, throughput=5MB/sec 2024-01-13T18:29:36.882 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aQTfEvp-jhzjOTf off=2634202 len=405003 2024-01-13T18:29:36.883 INFO:tasks.workunit.client.0.smithi084.stdout:op 2562 completed, throughput=5MB/sec 2024-01-13T18:29:36.883 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EBCKqUcBZbP4rH1 off=3203185 len=569657 2024-01-13T18:29:36.886 INFO:tasks.workunit.client.0.smithi084.stdout:op 2563 completed, throughput=5MB/sec 2024-01-13T18:29:36.887 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ot5oumnUL4sMF02 off=5486999 len=586641 2024-01-13T18:29:36.888 INFO:tasks.workunit.client.0.smithi084.stdout:op 2564 completed, throughput=5MB/sec 2024-01-13T18:29:36.888 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xhOFFQvAQU0Xy3j off=16760675 len=1297096 2024-01-13T18:29:36.890 INFO:tasks.workunit.client.0.smithi084.stdout:op 2565 completed, throughput=5MB/sec 2024-01-13T18:29:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:37 smithi099 ceph-mon[138788]: pgmap v1734: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:29:37.890 INFO:tasks.workunit.client.0.smithi084.stdout: 504: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:37.890 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-whQw45p9eKK49li off=1261129 len=815856 2024-01-13T18:29:37.894 INFO:tasks.workunit.client.0.smithi084.stdout:op 2566 completed, throughput=4.99MB/sec 2024-01-13T18:29:37.895 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-t2CYLeM_aEU9lV5 off=7112801 len=328242 2024-01-13T18:29:37.896 INFO:tasks.workunit.client.0.smithi084.stdout:op 2567 completed, throughput=4.99MB/sec 2024-01-13T18:29:37.897 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vAVoVVaQwZF5Nmm off=6877542 len=293174 2024-01-13T18:29:37.899 INFO:tasks.workunit.client.0.smithi084.stdout:op 2568 completed, throughput=4.99MB/sec 2024-01-13T18:29:37.900 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hFvNH49zeivHkoW off=11782527 len=1706086 2024-01-13T18:29:37.910 INFO:tasks.workunit.client.0.smithi084.stdout:op 2569 completed, throughput=5MB/sec 2024-01-13T18:29:37.910 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MKa-d_nyegDmMNH off=13131471 len=1599670 2024-01-13T18:29:37.912 INFO:tasks.workunit.client.0.smithi084.stdout:op 2570 completed, throughput=5MB/sec 2024-01-13T18:29:37.912 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PqUGQAWl_l7isFI off=2480537 len=1387883 2024-01-13T18:29:37.917 INFO:tasks.workunit.client.0.smithi084.stdout:op 2571 completed, throughput=5MB/sec 2024-01-13T18:29:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:37 smithi084 ceph-mon[116404]: pgmap v1734: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:29:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:37 smithi084 ceph-mon[119097]: pgmap v1734: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:29:38.917 INFO:tasks.workunit.client.0.smithi084.stdout: 505: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:38.917 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cF8T64nBitDrkzc off=397697 len=872627 2024-01-13T18:29:38.923 INFO:tasks.workunit.client.0.smithi084.stdout:op 2572 completed, throughput=4.99MB/sec 2024-01-13T18:29:38.923 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GW6PLs8lbvUlEpF off=3101872 len=1816832 2024-01-13T18:29:38.932 INFO:tasks.workunit.client.0.smithi084.stdout:op 2573 completed, throughput=5MB/sec 2024-01-13T18:29:38.932 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--VGgIqX15yOIneB off=397180 len=241625 2024-01-13T18:29:38.933 INFO:tasks.workunit.client.0.smithi084.stdout:op 2574 completed, throughput=5MB/sec 2024-01-13T18:29:38.933 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yQnYCBMWQSec41E off=3242060 len=1481664 2024-01-13T18:29:38.936 INFO:tasks.workunit.client.0.smithi084.stdout:op 2575 completed, throughput=5MB/sec 2024-01-13T18:29:38.936 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w78VUQw2RgyjqvT off=1456173 len=943862 2024-01-13T18:29:38.938 INFO:tasks.workunit.client.0.smithi084.stdout:op 2576 completed, throughput=5MB/sec 2024-01-13T18:29:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:39 smithi099 ceph-mon[138788]: pgmap v1735: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:29:39.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:39 smithi084 ceph-mon[116404]: pgmap v1735: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:29:39.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:39 smithi084 ceph-mon[119097]: pgmap v1735: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:29:39.938 INFO:tasks.workunit.client.0.smithi084.stdout: 506: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:39.938 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xfhDR8G9XR8Du7p off=4750069 len=281105 2024-01-13T18:29:39.942 INFO:tasks.workunit.client.0.smithi084.stdout:op 2577 completed, throughput=4.99MB/sec 2024-01-13T18:29:39.942 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-F5yjsrwm3foDqC4 off=9713148 len=421450 2024-01-13T18:29:39.945 INFO:tasks.workunit.client.0.smithi084.stdout:op 2578 completed, throughput=4.99MB/sec 2024-01-13T18:29:39.945 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RRBxrNVS8fZQ15Y off=21851916 len=381346 2024-01-13T18:29:39.948 INFO:tasks.workunit.client.0.smithi084.stdout:op 2579 completed, throughput=4.99MB/sec 2024-01-13T18:29:39.948 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aptwf28INO5c7dl off=18884957 len=1529421 2024-01-13T18:29:39.955 INFO:tasks.workunit.client.0.smithi084.stdout:op 2580 completed, throughput=5MB/sec 2024-01-13T18:29:39.955 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Mqc6C5Jep7_64E5 off=2807447 len=320533 2024-01-13T18:29:39.958 INFO:tasks.workunit.client.0.smithi084.stdout:op 2581 completed, throughput=5MB/sec 2024-01-13T18:29:39.958 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HEjH4KQx9S0-q5q off=13259184 len=753164 2024-01-13T18:29:39.959 INFO:tasks.workunit.client.0.smithi084.stdout:op 2582 completed, throughput=5MB/sec 2024-01-13T18:29:39.960 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Kj0Nmjf-sFEEQno off=555255 len=397734 2024-01-13T18:29:39.961 INFO:tasks.workunit.client.0.smithi084.stdout:op 2583 completed, throughput=5MB/sec 2024-01-13T18:29:39.961 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ghoF2IHjlwSFL6W off=284137 len=1149115 2024-01-13T18:29:39.969 INFO:tasks.workunit.client.0.smithi084.stdout:op 2584 completed, throughput=5MB/sec 2024-01-13T18:29:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:29:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:29:40] "GET /metrics HTTP/1.1" 200 33999 "" "Prometheus/2.43.0" 2024-01-13T18:29:40.969 INFO:tasks.workunit.client.0.smithi084.stdout: 507: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:40.969 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FFATVv6-c3Xp_0Z off=1273108 len=1046683 2024-01-13T18:29:40.970 INFO:tasks.workunit.client.0.smithi084.stdout:op 2585 completed, throughput=4.99MB/sec 2024-01-13T18:29:40.970 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-E2TzQ4V-P7Jr5yh off=1572499 len=1646745 2024-01-13T18:29:40.972 INFO:tasks.workunit.client.0.smithi084.stdout:op 2586 completed, throughput=5MB/sec 2024-01-13T18:29:40.972 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9TiqMwXIUBPuoxw off=14105787 len=644475 2024-01-13T18:29:40.973 INFO:tasks.workunit.client.0.smithi084.stdout:op 2587 completed, throughput=5MB/sec 2024-01-13T18:29:40.974 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wT3qpWlisePN_k5 off=10361131 len=839857 2024-01-13T18:29:40.978 INFO:tasks.workunit.client.0.smithi084.stdout:op 2588 completed, throughput=5MB/sec 2024-01-13T18:29:40.978 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lueb3i75LpGMzVp off=6096186 len=172645 2024-01-13T18:29:40.978 INFO:tasks.workunit.client.0.smithi084.stdout:op 2589 completed, throughput=5MB/sec 2024-01-13T18:29:40.978 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hQizoQLM_228RcV off=14683619 len=1464772 2024-01-13T18:29:40.986 INFO:tasks.workunit.client.0.smithi084.stdout:op 2590 completed, throughput=5MB/sec 2024-01-13T18:29:41.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:41 smithi099 ceph-mon[138788]: pgmap v1736: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:29:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:41 smithi084 ceph-mon[116404]: pgmap v1736: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:29:41.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:41 smithi084 ceph-mon[119097]: pgmap v1736: 105 pgs: 105 active+clean; 128 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:29:41.986 INFO:tasks.workunit.client.0.smithi084.stdout: 508: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:41.986 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-txTJe12C8OXNSp- off=6888357 len=476248 2024-01-13T18:29:41.990 INFO:tasks.workunit.client.0.smithi084.stdout:op 2591 completed, throughput=4.99MB/sec 2024-01-13T18:29:41.990 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FScysBcKdNU6b0s off=800668 len=710069 2024-01-13T18:29:41.994 INFO:tasks.workunit.client.0.smithi084.stdout:op 2592 completed, throughput=4.99MB/sec 2024-01-13T18:29:41.994 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TE4SlSFVWgKa7hl off=5829489 len=622949 2024-01-13T18:29:41.998 INFO:tasks.workunit.client.0.smithi084.stdout:op 2593 completed, throughput=5MB/sec 2024-01-13T18:29:41.998 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ugP-yHVGuWgeMPY off=11658142 len=1422726 2024-01-13T18:29:42.004 INFO:tasks.workunit.client.0.smithi084.stdout:op 2594 completed, throughput=5MB/sec 2024-01-13T18:29:42.004 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lGWW9XYbi8KXawO off=7576184 len=1719535 2024-01-13T18:29:42.010 INFO:tasks.workunit.client.0.smithi084.stdout:op 2595 completed, throughput=5MB/sec 2024-01-13T18:29:43.011 INFO:tasks.workunit.client.0.smithi084.stdout: 509: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:43.011 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TMCP8w99lrV4-X5 off=10192591 len=1745001 2024-01-13T18:29:43.021 INFO:tasks.workunit.client.0.smithi084.stdout:op 2596 completed, throughput=4.99MB/sec 2024-01-13T18:29:43.021 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iJMHctGVXONq154 off=1867439 len=1668574 2024-01-13T18:29:43.030 INFO:tasks.workunit.client.0.smithi084.stdout:op 2597 completed, throughput=5MB/sec 2024-01-13T18:29:43.030 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-s8zdyRl1zEf_UyT off=1880542 len=2082004 2024-01-13T18:29:43.031 INFO:tasks.workunit.client.0.smithi084.stdout:op 2598 completed, throughput=5MB/sec 2024-01-13T18:29:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:43 smithi099 ceph-mon[138788]: pgmap v1737: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:29:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:43 smithi084 ceph-mon[116404]: pgmap v1737: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:29:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:43 smithi084 ceph-mon[119097]: pgmap v1737: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:29:44.032 INFO:tasks.workunit.client.0.smithi084.stdout: 510: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:44.032 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-t3tlrIzUNrtQD6x off=17986165 len=201783 2024-01-13T18:29:44.033 INFO:tasks.workunit.client.0.smithi084.stdout:op 2599 completed, throughput=4.99MB/sec 2024-01-13T18:29:44.033 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uMMt5M2Z_pp3Mvd off=447859 len=1138759 2024-01-13T18:29:44.034 INFO:tasks.workunit.client.0.smithi084.stdout:op 2600 completed, throughput=4.99MB/sec 2024-01-13T18:29:44.034 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Fy9EPnmMUgaH2dH off=16650411 len=2004932 2024-01-13T18:29:44.036 INFO:tasks.workunit.client.0.smithi084.stdout:op 2601 completed, throughput=5MB/sec 2024-01-13T18:29:44.036 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0H6OaXcq1B3W08d off=8897075 len=571218 2024-01-13T18:29:44.040 INFO:tasks.workunit.client.0.smithi084.stdout:op 2602 completed, throughput=5MB/sec 2024-01-13T18:29:44.040 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-48z7iqhCjxMIs5t off=10728906 len=258060 2024-01-13T18:29:44.040 INFO:tasks.workunit.client.0.smithi084.stdout:op 2603 completed, throughput=5MB/sec 2024-01-13T18:29:44.040 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Lb6hRHl2LrJwrBi off=11573301 len=795439 2024-01-13T18:29:44.041 INFO:tasks.workunit.client.0.smithi084.stdout:op 2604 completed, throughput=5MB/sec 2024-01-13T18:29:45.042 INFO:tasks.workunit.client.0.smithi084.stdout: 511: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:45.042 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nmnm2DCJkvRoKNp off=5644481 len=1515011 2024-01-13T18:29:45.050 INFO:tasks.workunit.client.0.smithi084.stdout:op 2605 completed, throughput=4.99MB/sec 2024-01-13T18:29:45.050 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VPbajdJhQYwte2e off=14848264 len=1154435 2024-01-13T18:29:45.050 INFO:tasks.workunit.client.0.smithi084.stdout:op 2606 completed, throughput=5MB/sec 2024-01-13T18:29:45.050 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QBRIt4DK7eHtDxu off=1128639 len=791597 2024-01-13T18:29:45.055 INFO:tasks.workunit.client.0.smithi084.stdout:op 2607 completed, throughput=5MB/sec 2024-01-13T18:29:45.055 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Hj0tq5xJ5xoCMJ6 off=1870366 len=1790810 2024-01-13T18:29:45.057 INFO:tasks.workunit.client.0.smithi084.stdout:op 2608 completed, throughput=5MB/sec 2024-01-13T18:29:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:45 smithi099 ceph-mon[138788]: pgmap v1738: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:29:45.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:45 smithi084 ceph-mon[116404]: pgmap v1738: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:29:45.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:45 smithi084 ceph-mon[119097]: pgmap v1738: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:29:46.057 INFO:tasks.workunit.client.0.smithi084.stdout: 512: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:46.057 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0bT5T3TiujzHOky off=286161 len=2014280 2024-01-13T18:29:46.069 INFO:tasks.workunit.client.0.smithi084.stdout:op 2609 completed, throughput=5MB/sec 2024-01-13T18:29:46.069 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jZxloj_gpM3D5t5 off=2903561 len=501457 2024-01-13T18:29:46.072 INFO:tasks.workunit.client.0.smithi084.stdout:op 2610 completed, throughput=5MB/sec 2024-01-13T18:29:46.072 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QIN-OStj6GJP5Qo off=5768227 len=254108 2024-01-13T18:29:46.075 INFO:tasks.workunit.client.0.smithi084.stdout:op 2611 completed, throughput=5MB/sec 2024-01-13T18:29:46.075 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--ZcEevUFp0OJayB off=4716487 len=690144 2024-01-13T18:29:46.076 INFO:tasks.workunit.client.0.smithi084.stdout:op 2612 completed, throughput=5MB/sec 2024-01-13T18:29:46.076 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-U8M-qTXAj6ocLK5 off=1156294 len=854195 2024-01-13T18:29:46.081 INFO:tasks.workunit.client.0.smithi084.stdout:op 2613 completed, throughput=5MB/sec 2024-01-13T18:29:46.081 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SoZoTjMJaWuQxKz off=3397073 len=1957340 2024-01-13T18:29:46.083 INFO:tasks.workunit.client.0.smithi084.stdout:op 2614 completed, throughput=5MB/sec 2024-01-13T18:29:47.083 INFO:tasks.workunit.client.0.smithi084.stdout: 513: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:47.084 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6bjgsV-mfx2-eJK off=9812303 len=1461996 2024-01-13T18:29:47.085 INFO:tasks.workunit.client.0.smithi084.stdout:op 2615 completed, throughput=5MB/sec 2024-01-13T18:29:47.085 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rpbsTJtEfq29Xhk off=12678967 len=2025147 2024-01-13T18:29:47.094 INFO:tasks.workunit.client.0.smithi084.stdout:op 2616 completed, throughput=5MB/sec 2024-01-13T18:29:47.094 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cILqj0e08bmktWm off=6201909 len=51590 2024-01-13T18:29:47.095 INFO:tasks.workunit.client.0.smithi084.stdout:op 2617 completed, throughput=5MB/sec 2024-01-13T18:29:47.095 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aCrw5DPXLTuR--V off=8987613 len=1622072 2024-01-13T18:29:47.096 INFO:tasks.workunit.client.0.smithi084.stdout:op 2618 completed, throughput=5MB/sec 2024-01-13T18:29:47.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:47 smithi099 ceph-mon[138788]: pgmap v1739: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:29:47.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:47 smithi084 ceph-mon[116404]: pgmap v1739: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:29:47.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:47 smithi084 ceph-mon[119097]: pgmap v1739: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:29:48.097 INFO:tasks.workunit.client.0.smithi084.stdout: 514: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:48.099 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MecAnmhW6ObBddK off=10504295 len=905861 2024-01-13T18:29:48.102 INFO:tasks.workunit.client.0.smithi084.stdout:op 2619 completed, throughput=4.99MB/sec 2024-01-13T18:29:48.102 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gQdf8uoLPalVaUt off=3969613 len=1074766 2024-01-13T18:29:48.107 INFO:tasks.workunit.client.0.smithi084.stdout:op 2620 completed, throughput=5MB/sec 2024-01-13T18:29:48.107 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qltdoKgHwHEA2ZJ off=2214801 len=20342 2024-01-13T18:29:48.109 INFO:tasks.workunit.client.0.smithi084.stdout:op 2621 completed, throughput=5MB/sec 2024-01-13T18:29:48.109 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-taIYNcmqHpnEpnS off=11013899 len=1186139 2024-01-13T18:29:48.111 INFO:tasks.workunit.client.0.smithi084.stdout:op 2622 completed, throughput=5MB/sec 2024-01-13T18:29:48.111 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-33IvfwSY9ZJ5hur off=3388688 len=1136678 2024-01-13T18:29:48.113 INFO:tasks.workunit.client.0.smithi084.stdout:op 2623 completed, throughput=5MB/sec 2024-01-13T18:29:49.113 INFO:tasks.workunit.client.0.smithi084.stdout: 515: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:49.113 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JHm4SDBMNUAJoYy off=16868464 len=300341 2024-01-13T18:29:49.117 INFO:tasks.workunit.client.0.smithi084.stdout:op 2624 completed, throughput=4.99MB/sec 2024-01-13T18:29:49.117 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RDopGushI3cN_w6 off=916127 len=812465 2024-01-13T18:29:49.118 INFO:tasks.workunit.client.0.smithi084.stdout:op 2625 completed, throughput=4.99MB/sec 2024-01-13T18:29:49.118 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IPVyO8FOiTFFutE off=8061409 len=292434 2024-01-13T18:29:49.119 INFO:tasks.workunit.client.0.smithi084.stdout:op 2626 completed, throughput=4.99MB/sec 2024-01-13T18:29:49.119 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LpT-Y2cJT48mLdL off=2436480 len=1606199 2024-01-13T18:29:49.120 INFO:tasks.workunit.client.0.smithi084.stdout:op 2627 completed, throughput=5MB/sec 2024-01-13T18:29:49.121 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-D1QmlD_uCJSUdUV off=14817523 len=1404235 2024-01-13T18:29:49.122 INFO:tasks.workunit.client.0.smithi084.stdout:op 2628 completed, throughput=5MB/sec 2024-01-13T18:29:49.122 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cosjcFQNCQFYLcY off=2467721 len=525635 2024-01-13T18:29:49.123 INFO:tasks.workunit.client.0.smithi084.stdout:op 2629 completed, throughput=5MB/sec 2024-01-13T18:29:49.123 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VnKmIxrkVabyi0m off=2656489 len=624700 2024-01-13T18:29:49.127 INFO:tasks.workunit.client.0.smithi084.stdout:op 2630 completed, throughput=5MB/sec 2024-01-13T18:29:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:49 smithi099 ceph-mon[138788]: pgmap v1740: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:29:49.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:49 smithi084 ceph-mon[116404]: pgmap v1740: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:29:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:49 smithi084 ceph-mon[119097]: pgmap v1740: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:29:50.127 INFO:tasks.workunit.client.0.smithi084.stdout: 516: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:50.127 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hTaflTu5iptkr43 off=11350802 len=1554755 2024-01-13T18:29:50.130 INFO:tasks.workunit.client.0.smithi084.stdout:op 2631 completed, throughput=4.99MB/sec 2024-01-13T18:29:50.130 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CVPbfwbMD2KRQMe off=2860038 len=1222398 2024-01-13T18:29:50.132 INFO:tasks.workunit.client.0.smithi084.stdout:op 2632 completed, throughput=5MB/sec 2024-01-13T18:29:50.132 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GVceg6NTQFgRZpN off=8398775 len=58355 2024-01-13T18:29:50.132 INFO:tasks.workunit.client.0.smithi084.stdout:op 2633 completed, throughput=5MB/sec 2024-01-13T18:29:50.133 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-X9lTKCmOJskTr0a off=2864089 len=590378 2024-01-13T18:29:50.137 INFO:tasks.workunit.client.0.smithi084.stdout:op 2634 completed, throughput=5MB/sec 2024-01-13T18:29:50.137 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cL9FJXf93zmgV42 off=9415002 len=451290 2024-01-13T18:29:50.140 INFO:tasks.workunit.client.0.smithi084.stdout:op 2635 completed, throughput=5MB/sec 2024-01-13T18:29:50.140 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mneW9KS9vOmdPPD off=5799521 len=567548 2024-01-13T18:29:50.141 INFO:tasks.workunit.client.0.smithi084.stdout:op 2636 completed, throughput=5MB/sec 2024-01-13T18:29:50.141 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NNURAIkbr5TcO1_ off=2182522 len=367805 2024-01-13T18:29:50.141 INFO:tasks.workunit.client.0.smithi084.stdout:op 2637 completed, throughput=5MB/sec 2024-01-13T18:29:50.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:29:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:29:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:29:50] "GET /metrics HTTP/1.1" 200 33993 "" "Prometheus/2.43.0" 2024-01-13T18:29:51.142 INFO:tasks.workunit.client.0.smithi084.stdout: 517: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:51.142 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nk4phhIPcycYvq7 off=14468874 len=1468249 2024-01-13T18:29:51.151 INFO:tasks.workunit.client.0.smithi084.stdout:op 2638 completed, throughput=4.99MB/sec 2024-01-13T18:29:51.151 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-u_sf_DQdVnQG24I off=7618438 len=1844831 2024-01-13T18:29:51.158 INFO:tasks.workunit.client.0.smithi084.stdout:op 2639 completed, throughput=5MB/sec 2024-01-13T18:29:51.159 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-q61bnDUsWTitmOb off=2176325 len=95887 2024-01-13T18:29:51.159 INFO:tasks.workunit.client.0.smithi084.stdout:op 2640 completed, throughput=5MB/sec 2024-01-13T18:29:51.159 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-C4gn1yrViWOwDh7 off=489118 len=1777996 2024-01-13T18:29:51.166 INFO:tasks.workunit.client.0.smithi084.stdout:op 2641 completed, throughput=5MB/sec 2024-01-13T18:29:51.166 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sRdCTTPJeYvglwG off=30467 len=1938017 2024-01-13T18:29:51.176 INFO:tasks.workunit.client.0.smithi084.stdout:op 2642 completed, throughput=5MB/sec 2024-01-13T18:29:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:51 smithi099 ceph-mon[138788]: pgmap v1741: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:29:51.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:51 smithi084 ceph-mon[116404]: pgmap v1741: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:29:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:51 smithi084 ceph-mon[119097]: pgmap v1741: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:29:52.177 INFO:tasks.workunit.client.0.smithi084.stdout: 518: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:52.177 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-alZwd85NKasJPXx off=12830481 len=1209324 2024-01-13T18:29:52.183 INFO:tasks.workunit.client.0.smithi084.stdout:op 2643 completed, throughput=5MB/sec 2024-01-13T18:29:52.183 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rW1ZVmm_Uv4V7Lg off=14122991 len=907620 2024-01-13T18:29:52.187 INFO:tasks.workunit.client.0.smithi084.stdout:op 2644 completed, throughput=5MB/sec 2024-01-13T18:29:52.187 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HTpagYKwvB5pMF4 off=191027 len=1950281 2024-01-13T18:29:52.198 INFO:tasks.workunit.client.0.smithi084.stdout:op 2645 completed, throughput=5MB/sec 2024-01-13T18:29:53.198 INFO:tasks.workunit.client.0.smithi084.stdout: 519: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:53.198 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8PMlaPV16fEAdsD off=433969 len=865007 2024-01-13T18:29:53.200 INFO:tasks.workunit.client.0.smithi084.stdout:op 2646 completed, throughput=4.99MB/sec 2024-01-13T18:29:53.200 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jAfwG_uqU1CapxB off=6186839 len=1382667 2024-01-13T18:29:53.206 INFO:tasks.workunit.client.0.smithi084.stdout:op 2647 completed, throughput=5MB/sec 2024-01-13T18:29:53.206 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-86QzMM4zNOjeXjL off=9797188 len=494725 2024-01-13T18:29:53.210 INFO:tasks.workunit.client.0.smithi084.stdout:op 2648 completed, throughput=5MB/sec 2024-01-13T18:29:53.210 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sFDgP4sUUuKpLF7 off=9122331 len=1799054 2024-01-13T18:29:53.220 INFO:tasks.workunit.client.0.smithi084.stdout:op 2649 completed, throughput=5MB/sec 2024-01-13T18:29:53.220 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-90CDU3l6FywN5BR off=11635655 len=1903083 2024-01-13T18:29:53.228 INFO:tasks.workunit.client.0.smithi084.stdout:op 2650 completed, throughput=5MB/sec 2024-01-13T18:29:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:53 smithi099 ceph-mon[138788]: pgmap v1742: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:29:53.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:53 smithi084 ceph-mon[116404]: pgmap v1742: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:29:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:53 smithi084 ceph-mon[119097]: pgmap v1742: 105 pgs: 105 active+clean; 128 GiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:29:54.228 INFO:tasks.workunit.client.0.smithi084.stdout: 520: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:54.228 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uz1Bj2oKJTVPT7t off=11666262 len=1925795 2024-01-13T18:29:54.230 INFO:tasks.workunit.client.0.smithi084.stdout:op 2651 completed, throughput=5MB/sec 2024-01-13T18:29:54.231 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UBCjQ7afSrejpv6 off=4699865 len=139207 2024-01-13T18:29:54.231 INFO:tasks.workunit.client.0.smithi084.stdout:op 2652 completed, throughput=5MB/sec 2024-01-13T18:29:54.231 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aUNONzs6WoQFovV off=13803668 len=1402137 2024-01-13T18:29:54.235 INFO:tasks.workunit.client.0.smithi084.stdout:op 2653 completed, throughput=5MB/sec 2024-01-13T18:29:54.235 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-c48YNsFM4FBPJAW off=2628444 len=32233 2024-01-13T18:29:54.235 INFO:tasks.workunit.client.0.smithi084.stdout:op 2654 completed, throughput=5MB/sec 2024-01-13T18:29:54.235 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j2imvsdCCExmX96 off=1697423 len=1704688 2024-01-13T18:29:54.241 INFO:tasks.workunit.client.0.smithi084.stdout:op 2655 completed, throughput=5MB/sec 2024-01-13T18:29:55.242 INFO:tasks.workunit.client.0.smithi084.stdout: 521: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:55.242 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sTlELKQk0e_AYcs off=2920781 len=540363 2024-01-13T18:29:55.243 INFO:tasks.workunit.client.0.smithi084.stdout:op 2656 completed, throughput=4.99MB/sec 2024-01-13T18:29:55.243 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gI736BIO5C2yCxl off=10428392 len=816630 2024-01-13T18:29:55.244 INFO:tasks.workunit.client.0.smithi084.stdout:op 2657 completed, throughput=5MB/sec 2024-01-13T18:29:55.245 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_w85zH9Pp5Dw3MZ off=633768 len=1049798 2024-01-13T18:29:55.247 INFO:tasks.workunit.client.0.smithi084.stdout:op 2658 completed, throughput=5MB/sec 2024-01-13T18:29:55.247 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-b7u8Rwx_3JClV8A off=12357396 len=226954 2024-01-13T18:29:55.249 INFO:tasks.workunit.client.0.smithi084.stdout:op 2659 completed, throughput=5MB/sec 2024-01-13T18:29:55.250 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9x2qruMdDj1drWY off=4315470 len=756360 2024-01-13T18:29:55.251 INFO:tasks.workunit.client.0.smithi084.stdout:op 2660 completed, throughput=5MB/sec 2024-01-13T18:29:55.251 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9pLlelIdDbNRLnJ off=15393030 len=646333 2024-01-13T18:29:55.255 INFO:tasks.workunit.client.0.smithi084.stdout:op 2661 completed, throughput=5MB/sec 2024-01-13T18:29:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:55 smithi099 ceph-mon[138788]: pgmap v1743: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:29:55.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:55 smithi084 ceph-mon[116404]: pgmap v1743: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:29:55.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:55 smithi084 ceph-mon[119097]: pgmap v1743: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:29:56.255 INFO:tasks.workunit.client.0.smithi084.stdout: 522: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:56.256 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-d7eqILr_D-Ny-SN off=39221 len=185075 2024-01-13T18:29:56.259 INFO:tasks.workunit.client.0.smithi084.stdout:op 2662 completed, throughput=4.99MB/sec 2024-01-13T18:29:56.259 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Qn38JBAYmTAFFd0 off=15770732 len=90943 2024-01-13T18:29:56.261 INFO:tasks.workunit.client.0.smithi084.stdout:op 2663 completed, throughput=4.99MB/sec 2024-01-13T18:29:56.261 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9hdRjeeJcmBd4mL off=14282185 len=54533 2024-01-13T18:29:56.263 INFO:tasks.workunit.client.0.smithi084.stdout:op 2664 completed, throughput=4.99MB/sec 2024-01-13T18:29:56.264 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NMWLbGJUTlyAld3 off=10625810 len=1730779 2024-01-13T18:29:56.266 INFO:tasks.workunit.client.0.smithi084.stdout:op 2665 completed, throughput=4.99MB/sec 2024-01-13T18:29:56.266 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VONLNlFNYxwm068 off=1248204 len=314980 2024-01-13T18:29:56.266 INFO:tasks.workunit.client.0.smithi084.stdout:op 2666 completed, throughput=4.99MB/sec 2024-01-13T18:29:56.266 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pNmTZrrZV6r7Xh- off=4694371 len=961718 2024-01-13T18:29:56.271 INFO:tasks.workunit.client.0.smithi084.stdout:op 2667 completed, throughput=5MB/sec 2024-01-13T18:29:56.271 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AsWeRTaksIF_4ZJ off=403873 len=79047 2024-01-13T18:29:56.272 INFO:tasks.workunit.client.0.smithi084.stdout:op 2668 completed, throughput=5MB/sec 2024-01-13T18:29:56.272 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qUb8ohRoV7gea3E off=10400162 len=1595877 2024-01-13T18:29:56.283 INFO:tasks.workunit.client.0.smithi084.stdout:op 2669 completed, throughput=5MB/sec 2024-01-13T18:29:56.283 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2ZImTOy2biEf3K7 off=9642506 len=267107 2024-01-13T18:29:56.283 INFO:tasks.workunit.client.0.smithi084.stdout:op 2670 completed, throughput=5MB/sec 2024-01-13T18:29:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: 523: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:57.281 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FGUPRcOUP5L2JLY off=4123416 len=1622491 2024-01-13T18:29:57.284 INFO:tasks.workunit.client.0.smithi084.stdout:op 2671 completed, throughput=4.99MB/sec 2024-01-13T18:29:57.284 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7SVZ5j61CNQX9iG off=4281080 len=504653 2024-01-13T18:29:57.287 INFO:tasks.workunit.client.0.smithi084.stdout:op 2672 completed, throughput=4.99MB/sec 2024-01-13T18:29:57.288 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_c-utBqxjVa-B1D off=419006 len=520613 2024-01-13T18:29:57.289 INFO:tasks.workunit.client.0.smithi084.stdout:op 2673 completed, throughput=5MB/sec 2024-01-13T18:29:57.289 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Q8DkePpCg8Uwc5j off=2823353 len=1552236 2024-01-13T18:29:57.296 INFO:tasks.workunit.client.0.smithi084.stdout:op 2674 completed, throughput=5MB/sec 2024-01-13T18:29:57.296 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k7eWwkqIKNZtnM7 off=10738890 len=1221228 2024-01-13T18:29:57.298 INFO:tasks.workunit.client.0.smithi084.stdout:op 2675 completed, throughput=5MB/sec 2024-01-13T18:29:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:57 smithi099 ceph-mon[138788]: pgmap v1744: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:29:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:57 smithi084 ceph-mon[119097]: pgmap v1744: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:29:57.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:57 smithi084 ceph-mon[116404]: pgmap v1744: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:29:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: 524: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:58.299 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xkBluPMfVCN_wvM off=10844073 len=1650801 2024-01-13T18:29:58.302 INFO:tasks.workunit.client.0.smithi084.stdout:op 2676 completed, throughput=4.99MB/sec 2024-01-13T18:29:58.302 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yYR8yj6Cps5Zk9D off=4167060 len=1256977 2024-01-13T18:29:58.303 INFO:tasks.workunit.client.0.smithi084.stdout:op 2677 completed, throughput=5MB/sec 2024-01-13T18:29:58.303 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZtLDnR73kzNCMA4 off=13223663 len=1136588 2024-01-13T18:29:58.309 INFO:tasks.workunit.client.0.smithi084.stdout:op 2678 completed, throughput=5MB/sec 2024-01-13T18:29:58.309 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LVRypT78GhziFqR off=1976357 len=78347 2024-01-13T18:29:58.310 INFO:tasks.workunit.client.0.smithi084.stdout:op 2679 completed, throughput=5MB/sec 2024-01-13T18:29:58.310 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gqsfkuBHYQY17La off=1181216 len=314847 2024-01-13T18:29:58.313 INFO:tasks.workunit.client.0.smithi084.stdout:op 2680 completed, throughput=5MB/sec 2024-01-13T18:29:58.313 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MxOWP-Z_GuQY3ej off=956959 len=322445 2024-01-13T18:29:58.315 INFO:tasks.workunit.client.0.smithi084.stdout:op 2681 completed, throughput=5MB/sec 2024-01-13T18:29:58.316 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9ZgC4xdxS0xpkYM off=5533420 len=523201 2024-01-13T18:29:58.319 INFO:tasks.workunit.client.0.smithi084.stdout:op 2682 completed, throughput=5MB/sec 2024-01-13T18:29:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: 525: throughput=4.99MB/sec pending data=0 2024-01-13T18:29:59.319 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OHl-bQQTnSPpGyH off=609350 len=2012240 2024-01-13T18:29:59.321 INFO:tasks.workunit.client.0.smithi084.stdout:op 2683 completed, throughput=4.99MB/sec 2024-01-13T18:29:59.321 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2acX0tvu0N-CU01 off=3160331 len=1453098 2024-01-13T18:29:59.330 INFO:tasks.workunit.client.0.smithi084.stdout:op 2684 completed, throughput=5MB/sec 2024-01-13T18:29:59.331 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sZRsSp0TLwjYuZB off=22413280 len=1074857 2024-01-13T18:29:59.332 INFO:tasks.workunit.client.0.smithi084.stdout:op 2685 completed, throughput=5MB/sec 2024-01-13T18:29:59.332 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Cn0-U21NTGWLYWE off=119921 len=709644 2024-01-13T18:29:59.333 INFO:tasks.workunit.client.0.smithi084.stdout:op 2686 completed, throughput=5MB/sec 2024-01-13T18:29:59.333 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JcbkHxgOD5hj-oA off=5791684 len=1547190 2024-01-13T18:29:59.335 INFO:tasks.workunit.client.0.smithi084.stdout:op 2687 completed, throughput=5MB/sec 2024-01-13T18:29:59.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:29:59 smithi099 ceph-mon[138788]: pgmap v1745: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:29:59.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:29:59 smithi084 ceph-mon[116404]: pgmap v1745: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:29:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:29:59 smithi084 ceph-mon[119097]: pgmap v1745: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:30:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: 526: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:00.335 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9CO7W6PmG2P-93g off=2325507 len=950812 2024-01-13T18:30:00.340 INFO:tasks.workunit.client.0.smithi084.stdout:op 2688 completed, throughput=4.99MB/sec 2024-01-13T18:30:00.340 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-v8se01leOGOAQwN off=6268269 len=1219684 2024-01-13T18:30:00.345 INFO:tasks.workunit.client.0.smithi084.stdout:op 2689 completed, throughput=5MB/sec 2024-01-13T18:30:00.345 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dZvBU0tgKyFQgMp off=13101248 len=146338 2024-01-13T18:30:00.348 INFO:tasks.workunit.client.0.smithi084.stdout:op 2690 completed, throughput=5MB/sec 2024-01-13T18:30:00.348 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FFeN_FkehrbXBJI off=446355 len=44594 2024-01-13T18:30:00.351 INFO:tasks.workunit.client.0.smithi084.stdout:op 2691 completed, throughput=5MB/sec 2024-01-13T18:30:00.351 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3kLpfqTDp3Hqk0g off=8203619 len=1121874 2024-01-13T18:30:00.357 INFO:tasks.workunit.client.0.smithi084.stdout:op 2692 completed, throughput=5MB/sec 2024-01-13T18:30:00.357 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tHuq0NOPTzUXwFw off=5591685 len=889411 2024-01-13T18:30:00.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 2693 completed, throughput=5MB/sec 2024-01-13T18:30:00.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:00 smithi099 ceph-mon[138788]: overall HEALTH_OK 2024-01-13T18:30:00.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:00 smithi084 ceph-mon[116404]: overall HEALTH_OK 2024-01-13T18:30:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:30:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:30:00] "GET /metrics HTTP/1.1" 200 33993 "" "Prometheus/2.43.0" 2024-01-13T18:30:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:00 smithi084 ceph-mon[119097]: overall HEALTH_OK 2024-01-13T18:30:01.361 INFO:tasks.workunit.client.0.smithi084.stdout: 527: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:01.362 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-axcPUky6m-3o60t off=8564087 len=1725015 2024-01-13T18:30:01.370 INFO:tasks.workunit.client.0.smithi084.stdout:op 2694 completed, throughput=4.99MB/sec 2024-01-13T18:30:01.370 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-11xd70Z3I-KDrbD off=349244 len=206054 2024-01-13T18:30:01.370 INFO:tasks.workunit.client.0.smithi084.stdout:op 2695 completed, throughput=4.99MB/sec 2024-01-13T18:30:01.371 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kAuY7ZCNVJTMZXh off=0 len=1512000 2024-01-13T18:30:01.378 INFO:tasks.workunit.client.0.smithi084.stdout:op 2696 completed, throughput=5MB/sec 2024-01-13T18:30:01.378 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n-A6f3mSZ5r6puB off=10861093 len=1708548 2024-01-13T18:30:01.381 INFO:tasks.workunit.client.0.smithi084.stdout:op 2697 completed, throughput=5MB/sec 2024-01-13T18:30:01.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:01 smithi099 ceph-mon[138788]: pgmap v1746: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:30:01.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:01 smithi084 ceph-mon[116404]: pgmap v1746: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:30:01.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:01 smithi084 ceph-mon[119097]: pgmap v1746: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:30:02.381 INFO:tasks.workunit.client.0.smithi084.stdout: 528: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:02.381 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OSbxu47RmKiRDGh off=2182188 len=985917 2024-01-13T18:30:02.387 INFO:tasks.workunit.client.0.smithi084.stdout:op 2698 completed, throughput=4.99MB/sec 2024-01-13T18:30:02.387 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WEO7DqpN26ShnMc off=842046 len=1128784 2024-01-13T18:30:02.392 INFO:tasks.workunit.client.0.smithi084.stdout:op 2699 completed, throughput=4.99MB/sec 2024-01-13T18:30:02.392 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lFag5OFIiOIiktm off=4644817 len=1927814 2024-01-13T18:30:02.394 INFO:tasks.workunit.client.0.smithi084.stdout:op 2700 completed, throughput=5MB/sec 2024-01-13T18:30:02.394 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-d0iXGbc8sZxPmLI off=5215841 len=1114833 2024-01-13T18:30:02.394 INFO:tasks.workunit.client.0.smithi084.stdout:op 2701 completed, throughput=5MB/sec 2024-01-13T18:30:03.395 INFO:tasks.workunit.client.0.smithi084.stdout: 529: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:03.395 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hung5Z3b5DsVRdO off=4072174 len=1279937 2024-01-13T18:30:03.404 INFO:tasks.workunit.client.0.smithi084.stdout:op 2702 completed, throughput=4.99MB/sec 2024-01-13T18:30:03.404 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--7EMNmJTTFmEOe6 off=8511969 len=1272580 2024-01-13T18:30:03.410 INFO:tasks.workunit.client.0.smithi084.stdout:op 2703 completed, throughput=5MB/sec 2024-01-13T18:30:03.410 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lABth_ogBiR0L1V off=1608754 len=209445 2024-01-13T18:30:03.412 INFO:tasks.workunit.client.0.smithi084.stdout:op 2704 completed, throughput=5MB/sec 2024-01-13T18:30:03.412 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ml9ODPn73JRJijk off=1330451 len=840202 2024-01-13T18:30:03.416 INFO:tasks.workunit.client.0.smithi084.stdout:op 2705 completed, throughput=5MB/sec 2024-01-13T18:30:03.416 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S6Uhc2jZrwzV7b4 off=1055840 len=1530965 2024-01-13T18:30:03.421 INFO:tasks.workunit.client.0.smithi084.stdout:op 2706 completed, throughput=5MB/sec 2024-01-13T18:30:03.422 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1PrTuSblwZQnFYX off=1906697 len=462551 2024-01-13T18:30:03.425 INFO:tasks.workunit.client.0.smithi084.stdout:op 2707 completed, throughput=5MB/sec 2024-01-13T18:30:03.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:03 smithi099 ceph-mon[138788]: pgmap v1747: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:30:03.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:03 smithi084 ceph-mon[116404]: pgmap v1747: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:30:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:03 smithi084 ceph-mon[119097]: pgmap v1747: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:30:04.425 INFO:tasks.workunit.client.0.smithi084.stdout: 530: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:04.425 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k-JVC7JSkOsBqf4 off=413982 len=758197 2024-01-13T18:30:04.426 INFO:tasks.workunit.client.0.smithi084.stdout:op 2708 completed, throughput=4.99MB/sec 2024-01-13T18:30:04.426 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sWBHohRcdxPSVMI off=8127991 len=1809162 2024-01-13T18:30:04.428 INFO:tasks.workunit.client.0.smithi084.stdout:op 2709 completed, throughput=5MB/sec 2024-01-13T18:30:04.428 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hLMj-adnBsSgzX9 off=1436677 len=1910774 2024-01-13T18:30:04.431 INFO:tasks.workunit.client.0.smithi084.stdout:op 2710 completed, throughput=5MB/sec 2024-01-13T18:30:04.432 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ibJxW76EHNJr0MJ off=5363922 len=1833870 2024-01-13T18:30:04.439 INFO:tasks.workunit.client.0.smithi084.stdout:op 2711 completed, throughput=5MB/sec 2024-01-13T18:30:05.439 INFO:tasks.workunit.client.0.smithi084.stdout: 531: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:05.439 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WxuOTUBsCBYFVQ6 off=6331836 len=319371 2024-01-13T18:30:05.440 INFO:tasks.workunit.client.0.smithi084.stdout:op 2712 completed, throughput=4.99MB/sec 2024-01-13T18:30:05.440 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3ed_M_2uYvGSZzh off=13376082 len=1783567 2024-01-13T18:30:05.447 INFO:tasks.workunit.client.0.smithi084.stdout:op 2713 completed, throughput=5MB/sec 2024-01-13T18:30:05.447 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j5KnGuNaCflS4FB off=22104290 len=1509082 2024-01-13T18:30:05.453 INFO:tasks.workunit.client.0.smithi084.stdout:op 2714 completed, throughput=5MB/sec 2024-01-13T18:30:05.453 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tKl3thzTEXv1iRr off=3109929 len=1522571 2024-01-13T18:30:05.460 INFO:tasks.workunit.client.0.smithi084.stdout:op 2715 completed, throughput=5MB/sec 2024-01-13T18:30:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:05 smithi099 ceph-mon[138788]: pgmap v1748: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:30:05.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:05 smithi084 ceph-mon[116404]: pgmap v1748: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:30:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:05 smithi084 ceph-mon[119097]: pgmap v1748: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:30:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:06.460 INFO:tasks.workunit.client.0.smithi084.stdout: 532: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:06.460 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VBK-84SFy76pO7A off=7489606 len=1938011 2024-01-13T18:30:06.473 INFO:tasks.workunit.client.0.smithi084.stdout:op 2716 completed, throughput=5MB/sec 2024-01-13T18:30:06.473 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0-R9W8BTbd401JL off=328908 len=1020716 2024-01-13T18:30:06.478 INFO:tasks.workunit.client.0.smithi084.stdout:op 2717 completed, throughput=5MB/sec 2024-01-13T18:30:06.478 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xAJ-WjlkhDvR39r off=21087228 len=1056274 2024-01-13T18:30:06.481 INFO:tasks.workunit.client.0.smithi084.stdout:op 2718 completed, throughput=5MB/sec 2024-01-13T18:30:06.481 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pCjKgt17i0R79Ay off=2599551 len=1985302 2024-01-13T18:30:06.490 INFO:tasks.workunit.client.0.smithi084.stdout:op 2719 completed, throughput=5MB/sec 2024-01-13T18:30:07.490 INFO:tasks.workunit.client.0.smithi084.stdout: 533: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:07.490 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UvsGgBKUalu7ptG off=1406166 len=611200 2024-01-13T18:30:07.495 INFO:tasks.workunit.client.0.smithi084.stdout:op 2720 completed, throughput=4.99MB/sec 2024-01-13T18:30:07.495 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OuWJznhmzI_XRPw off=8932205 len=588408 2024-01-13T18:30:07.499 INFO:tasks.workunit.client.0.smithi084.stdout:op 2721 completed, throughput=5MB/sec 2024-01-13T18:30:07.499 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kmzVTDH6mMWrowh off=89852 len=1784982 2024-01-13T18:30:07.500 INFO:tasks.workunit.client.0.smithi084.stdout:op 2722 completed, throughput=5MB/sec 2024-01-13T18:30:07.501 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tFoxff0zkO-xrm6 off=1278286 len=1961149 2024-01-13T18:30:07.503 INFO:tasks.workunit.client.0.smithi084.stdout:op 2723 completed, throughput=5MB/sec 2024-01-13T18:30:07.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:07 smithi099 ceph-mon[138788]: pgmap v1749: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:30:07.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:07 smithi084 ceph-mon[116404]: pgmap v1749: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:30:07.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:07 smithi084 ceph-mon[119097]: pgmap v1749: 105 pgs: 105 active+clean; 128 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:30:08.503 INFO:tasks.workunit.client.0.smithi084.stdout: 534: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:08.503 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wtZFjpfgILaoIo1 off=2821968 len=304249 2024-01-13T18:30:08.504 INFO:tasks.workunit.client.0.smithi084.stdout:op 2724 completed, throughput=4.99MB/sec 2024-01-13T18:30:08.505 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ulOXoYHQKsBSewU off=1234590 len=1851161 2024-01-13T18:30:08.507 INFO:tasks.workunit.client.0.smithi084.stdout:op 2725 completed, throughput=5MB/sec 2024-01-13T18:30:08.507 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-H-2bVea6e45rzqY off=15910559 len=23570 2024-01-13T18:30:08.510 INFO:tasks.workunit.client.0.smithi084.stdout:op 2726 completed, throughput=5MB/sec 2024-01-13T18:30:08.510 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fVzfXr7G6M35hFG off=507688 len=1914139 2024-01-13T18:30:08.517 INFO:tasks.workunit.client.0.smithi084.stdout:op 2727 completed, throughput=5MB/sec 2024-01-13T18:30:09.517 INFO:tasks.workunit.client.0.smithi084.stdout: 535: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:09.518 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Pu2FTvaTh-3Kiup off=19549556 len=588078 2024-01-13T18:30:09.518 INFO:tasks.workunit.client.0.smithi084.stdout:op 2728 completed, throughput=4.99MB/sec 2024-01-13T18:30:09.518 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fTWhDPTIvplWcAB off=6641187 len=1803255 2024-01-13T18:30:09.526 INFO:tasks.workunit.client.0.smithi084.stdout:op 2729 completed, throughput=5MB/sec 2024-01-13T18:30:09.527 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iJ62sn02V05_mxN off=5834213 len=1260509 2024-01-13T18:30:09.535 INFO:tasks.workunit.client.0.smithi084.stdout:op 2730 completed, throughput=5MB/sec 2024-01-13T18:30:09.535 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NAVLETSJkARENsq off=7178545 len=1625186 2024-01-13T18:30:09.541 INFO:tasks.workunit.client.0.smithi084.stdout:op 2731 completed, throughput=5MB/sec 2024-01-13T18:30:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:09 smithi099 ceph-mon[138788]: pgmap v1750: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:30:09.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:09 smithi084 ceph-mon[116404]: pgmap v1750: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:30:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:09 smithi084 ceph-mon[119097]: pgmap v1750: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:30:10.541 INFO:tasks.workunit.client.0.smithi084.stdout: 536: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:10.541 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FmAy5YCvBaKpcfH off=4586250 len=1564335 2024-01-13T18:30:10.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 2732 completed, throughput=4.99MB/sec 2024-01-13T18:30:10.543 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cxJwadEu8bnA-de off=9308496 len=851577 2024-01-13T18:30:10.548 INFO:tasks.workunit.client.0.smithi084.stdout:op 2733 completed, throughput=5MB/sec 2024-01-13T18:30:10.548 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BHEFeoyqIpZZcol off=3413091 len=428437 2024-01-13T18:30:10.549 INFO:tasks.workunit.client.0.smithi084.stdout:op 2734 completed, throughput=5MB/sec 2024-01-13T18:30:10.549 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rhGUSc3Muu2DmdM off=3981459 len=1066067 2024-01-13T18:30:10.555 INFO:tasks.workunit.client.0.smithi084.stdout:op 2735 completed, throughput=5MB/sec 2024-01-13T18:30:10.555 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-U2sOQ3QDZ6JJvnE off=0 len=1243484 2024-01-13T18:30:10.561 INFO:tasks.workunit.client.0.smithi084.stdout:op 2736 completed, throughput=5MB/sec 2024-01-13T18:30:10.562 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zRw5q7mIWeogey1 off=361592 len=770676 2024-01-13T18:30:10.563 INFO:tasks.workunit.client.0.smithi084.stdout:op 2737 completed, throughput=5MB/sec 2024-01-13T18:30:10.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:30:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:30:10] "GET /metrics HTTP/1.1" 200 33994 "" "Prometheus/2.43.0" 2024-01-13T18:30:11.564 INFO:tasks.workunit.client.0.smithi084.stdout: 537: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:11.564 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SFwMWOS3mFnJyPa off=4110128 len=558692 2024-01-13T18:30:11.568 INFO:tasks.workunit.client.0.smithi084.stdout:op 2738 completed, throughput=4.99MB/sec 2024-01-13T18:30:11.568 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-t2CYLeM_aEU9lV5 off=5064026 len=1222266 2024-01-13T18:30:11.577 INFO:tasks.workunit.client.0.smithi084.stdout:op 2739 completed, throughput=4.99MB/sec 2024-01-13T18:30:11.577 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8ed1S7osmC57Jyt off=7607105 len=1474282 2024-01-13T18:30:11.579 INFO:tasks.workunit.client.0.smithi084.stdout:op 2740 completed, throughput=5MB/sec 2024-01-13T18:30:11.579 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CN1jvvtGoQMnmjn off=12346897 len=732091 2024-01-13T18:30:11.580 INFO:tasks.workunit.client.0.smithi084.stdout:op 2741 completed, throughput=5MB/sec 2024-01-13T18:30:11.580 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Kukd81QUGt9QHtw off=4995070 len=1069581 2024-01-13T18:30:11.582 INFO:tasks.workunit.client.0.smithi084.stdout:op 2742 completed, throughput=5MB/sec 2024-01-13T18:30:11.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:11 smithi099 ceph-mon[138788]: pgmap v1751: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:30:11.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:11 smithi084 ceph-mon[116404]: pgmap v1751: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:30:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:11 smithi084 ceph-mon[119097]: pgmap v1751: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:30:12.582 INFO:tasks.workunit.client.0.smithi084.stdout: 538: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:12.583 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gia-OVIHhLfD9K7 off=2022205 len=835700 2024-01-13T18:30:12.584 INFO:tasks.workunit.client.0.smithi084.stdout:op 2743 completed, throughput=4.99MB/sec 2024-01-13T18:30:12.584 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ue_fwYNmpbTxVa6 off=6872230 len=926345 2024-01-13T18:30:12.585 INFO:tasks.workunit.client.0.smithi084.stdout:op 2744 completed, throughput=4.99MB/sec 2024-01-13T18:30:12.585 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wRR6-mdX_Eu5V_a off=15335574 len=618153 2024-01-13T18:30:12.586 INFO:tasks.workunit.client.0.smithi084.stdout:op 2745 completed, throughput=5MB/sec 2024-01-13T18:30:12.586 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AsDnoDf6Tor_HF4 off=18875855 len=239831 2024-01-13T18:30:12.589 INFO:tasks.workunit.client.0.smithi084.stdout:op 2746 completed, throughput=5MB/sec 2024-01-13T18:30:12.590 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NBSs72rEq2JcMFW off=11876428 len=240581 2024-01-13T18:30:12.590 INFO:tasks.workunit.client.0.smithi084.stdout:op 2747 completed, throughput=5MB/sec 2024-01-13T18:30:12.590 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mkH6_D_C_2phqo7 off=13898457 len=304352 2024-01-13T18:30:12.591 INFO:tasks.workunit.client.0.smithi084.stdout:op 2748 completed, throughput=5MB/sec 2024-01-13T18:30:12.591 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XrXnYdwFFEfmSwY off=3475916 len=928221 2024-01-13T18:30:12.596 INFO:tasks.workunit.client.0.smithi084.stdout:op 2749 completed, throughput=5MB/sec 2024-01-13T18:30:12.596 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iW32GExe72ers5M off=3257100 len=1960581 2024-01-13T18:30:12.607 INFO:tasks.workunit.client.0.smithi084.stdout:op 2750 completed, throughput=5MB/sec 2024-01-13T18:30:13.607 INFO:tasks.workunit.client.0.smithi084.stdout: 539: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:13.607 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MRbRBK5XV2fEXMu off=14141265 len=1516548 2024-01-13T18:30:13.614 INFO:tasks.workunit.client.0.smithi084.stdout:op 2751 completed, throughput=5MB/sec 2024-01-13T18:30:13.614 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-I9-r2jZK2i4NaI7 off=6057427 len=314516 2024-01-13T18:30:13.617 INFO:tasks.workunit.client.0.smithi084.stdout:op 2752 completed, throughput=5MB/sec 2024-01-13T18:30:13.617 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bFa31nqpDsPYjDK off=17299897 len=2032382 2024-01-13T18:30:13.618 INFO:tasks.workunit.client.0.smithi084.stdout:op 2753 completed, throughput=5MB/sec 2024-01-13T18:30:13.618 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--JE8IgNNJWUFBcq off=16809065 len=1202736 2024-01-13T18:30:13.621 INFO:tasks.workunit.client.0.smithi084.stdout:op 2754 completed, throughput=5MB/sec 2024-01-13T18:30:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:13 smithi099 ceph-mon[138788]: pgmap v1752: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:30:13.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:13 smithi084 ceph-mon[116404]: pgmap v1752: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:30:13.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:13 smithi084 ceph-mon[119097]: pgmap v1752: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:30:14.621 INFO:tasks.workunit.client.0.smithi084.stdout: 540: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:14.621 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SoAGAckoDYDbyT_ off=3996814 len=761092 2024-01-13T18:30:14.625 INFO:tasks.workunit.client.0.smithi084.stdout:op 2755 completed, throughput=4.99MB/sec 2024-01-13T18:30:14.625 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-toI7ybLVZaBlNIr off=72098 len=1227098 2024-01-13T18:30:14.628 INFO:tasks.workunit.client.0.smithi084.stdout:op 2756 completed, throughput=5MB/sec 2024-01-13T18:30:14.628 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EXyOB-gdddOOPY3 off=12882228 len=1199342 2024-01-13T18:30:14.630 INFO:tasks.workunit.client.0.smithi084.stdout:op 2757 completed, throughput=5MB/sec 2024-01-13T18:30:14.630 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wQfwgQKetABskx_ off=3102580 len=276139 2024-01-13T18:30:14.633 INFO:tasks.workunit.client.0.smithi084.stdout:op 2758 completed, throughput=5MB/sec 2024-01-13T18:30:14.633 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4Z5qasLmFwKA8EL off=1557932 len=1710750 2024-01-13T18:30:14.635 INFO:tasks.workunit.client.0.smithi084.stdout:op 2759 completed, throughput=5MB/sec 2024-01-13T18:30:15.635 INFO:tasks.workunit.client.0.smithi084.stdout: 541: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:15.635 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2DCUIqaQFXjOddU off=827627 len=589250 2024-01-13T18:30:15.636 INFO:tasks.workunit.client.0.smithi084.stdout:op 2760 completed, throughput=4.99MB/sec 2024-01-13T18:30:15.636 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NuiIE6D_v4OK1xb off=6132398 len=1722642 2024-01-13T18:30:15.638 INFO:tasks.workunit.client.0.smithi084.stdout:op 2761 completed, throughput=5MB/sec 2024-01-13T18:30:15.638 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y5uYnZRxpL_Jtgb off=446077 len=477586 2024-01-13T18:30:15.639 INFO:tasks.workunit.client.0.smithi084.stdout:op 2762 completed, throughput=5MB/sec 2024-01-13T18:30:15.639 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_f7KBLfpOLCYjhz off=4784706 len=986436 2024-01-13T18:30:15.644 INFO:tasks.workunit.client.0.smithi084.stdout:op 2763 completed, throughput=5MB/sec 2024-01-13T18:30:15.644 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bJXRNH8vaEiY68v off=9560926 len=724076 2024-01-13T18:30:15.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 2764 completed, throughput=5MB/sec 2024-01-13T18:30:15.646 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mvqSvTi4gQZ1vVx off=4889489 len=338826 2024-01-13T18:30:15.648 INFO:tasks.workunit.client.0.smithi084.stdout:op 2765 completed, throughput=5MB/sec 2024-01-13T18:30:15.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:15 smithi099 ceph-mon[138788]: pgmap v1753: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 4 op/s 2024-01-13T18:30:15.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:15 smithi084 ceph-mon[116404]: pgmap v1753: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 4 op/s 2024-01-13T18:30:15.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:15 smithi084 ceph-mon[119097]: pgmap v1753: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 4 op/s 2024-01-13T18:30:16.649 INFO:tasks.workunit.client.0.smithi084.stdout: 542: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:16.649 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xB_Oe9iXAVNzLr8 off=7099668 len=1891008 2024-01-13T18:30:16.651 INFO:tasks.workunit.client.0.smithi084.stdout:op 2766 completed, throughput=4.99MB/sec 2024-01-13T18:30:16.651 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cPIoBlCMJM4blWO off=12361980 len=335776 2024-01-13T18:30:16.652 INFO:tasks.workunit.client.0.smithi084.stdout:op 2767 completed, throughput=4.99MB/sec 2024-01-13T18:30:16.653 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8_Cq8BNy6uzyTyx off=5618499 len=824969 2024-01-13T18:30:16.654 INFO:tasks.workunit.client.0.smithi084.stdout:op 2768 completed, throughput=5MB/sec 2024-01-13T18:30:16.654 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wQUHyXysmH1oqxS off=1167736 len=1952428 2024-01-13T18:30:16.655 INFO:tasks.workunit.client.0.smithi084.stdout:op 2769 completed, throughput=5MB/sec 2024-01-13T18:30:16.655 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cxTwsY-bfldfGmf off=7080643 len=1845561 2024-01-13T18:30:16.657 INFO:tasks.workunit.client.0.smithi084.stdout:op 2770 completed, throughput=5MB/sec 2024-01-13T18:30:17.658 INFO:tasks.workunit.client.0.smithi084.stdout: 543: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:17.658 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kBCY0QpKXLuTuh7 off=2505618 len=1852652 2024-01-13T18:30:17.668 INFO:tasks.workunit.client.0.smithi084.stdout:op 2771 completed, throughput=5MB/sec 2024-01-13T18:30:17.668 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YEAVfsTWFmNoqpv off=4946979 len=1115959 2024-01-13T18:30:17.675 INFO:tasks.workunit.client.0.smithi084.stdout:op 2772 completed, throughput=5MB/sec 2024-01-13T18:30:17.675 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LdNPWTpbvIteKCE off=2077963 len=920905 2024-01-13T18:30:17.680 INFO:tasks.workunit.client.0.smithi084.stdout:op 2773 completed, throughput=5MB/sec 2024-01-13T18:30:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:17 smithi099 ceph-mon[138788]: pgmap v1754: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:30:17.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:17 smithi084 ceph-mon[116404]: pgmap v1754: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:30:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:17 smithi084 ceph-mon[119097]: pgmap v1754: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:30:18.680 INFO:tasks.workunit.client.0.smithi084.stdout: 544: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:18.680 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aoEieCrFyDXfASN off=7584452 len=1134427 2024-01-13T18:30:18.687 INFO:tasks.workunit.client.0.smithi084.stdout:op 2774 completed, throughput=4.99MB/sec 2024-01-13T18:30:18.687 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aayZLXh94158dMX off=659900 len=1907403 2024-01-13T18:30:18.691 INFO:tasks.workunit.client.0.smithi084.stdout:op 2775 completed, throughput=5MB/sec 2024-01-13T18:30:18.691 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5GQzLfTEHnwDyeq off=251859 len=1588209 2024-01-13T18:30:18.693 INFO:tasks.workunit.client.0.smithi084.stdout:op 2776 completed, throughput=5MB/sec 2024-01-13T18:30:18.693 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MHvWalkkTF-YUQT off=5303868 len=600285 2024-01-13T18:30:18.697 INFO:tasks.workunit.client.0.smithi084.stdout:op 2777 completed, throughput=5MB/sec 2024-01-13T18:30:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:19 smithi099 ceph-mon[138788]: pgmap v1755: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:30:19.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:19 smithi084 ceph-mon[116404]: pgmap v1755: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:30:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:19 smithi084 ceph-mon[119097]: pgmap v1755: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:30:19.698 INFO:tasks.workunit.client.0.smithi084.stdout: 545: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:19.698 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S1kq4tNMumQ7nsw off=1056147 len=354623 2024-01-13T18:30:19.701 INFO:tasks.workunit.client.0.smithi084.stdout:op 2778 completed, throughput=4.99MB/sec 2024-01-13T18:30:19.701 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G_2nbHETfw5iqeL off=1580489 len=1747041 2024-01-13T18:30:19.708 INFO:tasks.workunit.client.0.smithi084.stdout:op 2779 completed, throughput=4.99MB/sec 2024-01-13T18:30:19.708 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-T_IX7ut85lFwP3K off=6464267 len=1820336 2024-01-13T18:30:19.718 INFO:tasks.workunit.client.0.smithi084.stdout:op 2780 completed, throughput=5MB/sec 2024-01-13T18:30:19.718 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QHX0rr4Ku9Hjjgt off=1592625 len=706829 2024-01-13T18:30:19.721 INFO:tasks.workunit.client.0.smithi084.stdout:op 2781 completed, throughput=5MB/sec 2024-01-13T18:30:19.722 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IDZngzkRMLWVxdS off=15695713 len=1332776 2024-01-13T18:30:19.723 INFO:tasks.workunit.client.0.smithi084.stdout:op 2782 completed, throughput=5MB/sec 2024-01-13T18:30:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:30:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:30:20] "GET /metrics HTTP/1.1" 200 33990 "" "Prometheus/2.43.0" 2024-01-13T18:30:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:20.723 INFO:tasks.workunit.client.0.smithi084.stdout: 546: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:20.724 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2-YpDapisKRzyk1 off=3977941 len=539487 2024-01-13T18:30:20.725 INFO:tasks.workunit.client.0.smithi084.stdout:op 2783 completed, throughput=4.99MB/sec 2024-01-13T18:30:20.725 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y12WtzYTBzgTZ7L off=7659582 len=337026 2024-01-13T18:30:20.726 INFO:tasks.workunit.client.0.smithi084.stdout:op 2784 completed, throughput=4.99MB/sec 2024-01-13T18:30:20.726 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3bsD4UXvN2j46mp off=406347 len=1670451 2024-01-13T18:30:20.735 INFO:tasks.workunit.client.0.smithi084.stdout:op 2785 completed, throughput=5MB/sec 2024-01-13T18:30:20.735 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mOFgQgVFXwMyOey off=2830300 len=2048727 2024-01-13T18:30:20.737 INFO:tasks.workunit.client.0.smithi084.stdout:op 2786 completed, throughput=5MB/sec 2024-01-13T18:30:20.737 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DCuaRqWuWztk22g off=11153940 len=73248 2024-01-13T18:30:20.739 INFO:tasks.workunit.client.0.smithi084.stdout:op 2787 completed, throughput=5MB/sec 2024-01-13T18:30:21.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:21 smithi099 ceph-mon[138788]: pgmap v1756: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:30:21.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:21 smithi084 ceph-mon[116404]: pgmap v1756: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:30:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:21 smithi084 ceph-mon[119097]: pgmap v1756: 105 pgs: 105 active+clean; 128 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:30:21.740 INFO:tasks.workunit.client.0.smithi084.stdout: 547: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:21.740 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dT7EsANF0MqbmJQ off=1063802 len=1840144 2024-01-13T18:30:21.742 INFO:tasks.workunit.client.0.smithi084.stdout:op 2788 completed, throughput=4.99MB/sec 2024-01-13T18:30:21.742 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-q1kxaHuYjVPFCla off=7957021 len=1377255 2024-01-13T18:30:21.750 INFO:tasks.workunit.client.0.smithi084.stdout:op 2789 completed, throughput=5MB/sec 2024-01-13T18:30:21.750 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JgGYUo9IKVHnldp off=1659333 len=320789 2024-01-13T18:30:21.751 INFO:tasks.workunit.client.0.smithi084.stdout:op 2790 completed, throughput=5MB/sec 2024-01-13T18:30:21.751 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-any5k7BKlI3OSy9 off=447972 len=869734 2024-01-13T18:30:21.756 INFO:tasks.workunit.client.0.smithi084.stdout:op 2791 completed, throughput=5MB/sec 2024-01-13T18:30:21.756 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pEsx5cNvIy05-JU off=1832934 len=752127 2024-01-13T18:30:21.757 INFO:tasks.workunit.client.0.smithi084.stdout:op 2792 completed, throughput=5MB/sec 2024-01-13T18:30:21.757 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BP4Ox426OfBUTQ6 off=11515029 len=1693600 2024-01-13T18:30:21.763 INFO:tasks.workunit.client.0.smithi084.stdout:op 2793 completed, throughput=5MB/sec 2024-01-13T18:30:22.764 INFO:tasks.workunit.client.0.smithi084.stdout: 548: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:22.764 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OCiEq2RTBj4sHza off=10262704 len=1733523 2024-01-13T18:30:22.767 INFO:tasks.workunit.client.0.smithi084.stdout:op 2794 completed, throughput=5MB/sec 2024-01-13T18:30:22.767 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cXX-7-71A747BrD off=3983259 len=1144290 2024-01-13T18:30:22.773 INFO:tasks.workunit.client.0.smithi084.stdout:op 2795 completed, throughput=5MB/sec 2024-01-13T18:30:22.773 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XJ-FR_B2eMftRfc off=5931531 len=380822 2024-01-13T18:30:22.773 INFO:tasks.workunit.client.0.smithi084.stdout:op 2796 completed, throughput=5MB/sec 2024-01-13T18:30:22.774 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V46Sdl-HAVQBafE off=10075067 len=722823 2024-01-13T18:30:22.775 INFO:tasks.workunit.client.0.smithi084.stdout:op 2797 completed, throughput=5MB/sec 2024-01-13T18:30:23.775 INFO:tasks.workunit.client.0.smithi084.stdout: 549: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:23.775 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6ZBPulxhvLPjNZS off=6464520 len=2094129 2024-01-13T18:30:23.777 INFO:tasks.workunit.client.0.smithi084.stdout:op 2798 completed, throughput=4.99MB/sec 2024-01-13T18:30:23.778 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G7L3yxgYbp4wwKc off=8076539 len=1823413 2024-01-13T18:30:23.787 INFO:tasks.workunit.client.0.smithi084.stdout:op 2799 completed, throughput=5MB/sec 2024-01-13T18:30:23.788 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--WBkuttWY6Pwi53 off=14177468 len=1357593 2024-01-13T18:30:23.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 2800 completed, throughput=5MB/sec 2024-01-13T18:30:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:23 smithi099 ceph-mon[138788]: pgmap v1757: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:30:23.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:23 smithi084 ceph-mon[116404]: pgmap v1757: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:30:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:23 smithi084 ceph-mon[119097]: pgmap v1757: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:30:24.796 INFO:tasks.workunit.client.0.smithi084.stdout: 550: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:24.796 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lLhT1IAOyuE8ya4 off=10296616 len=22914 2024-01-13T18:30:24.798 INFO:tasks.workunit.client.0.smithi084.stdout:op 2801 completed, throughput=4.99MB/sec 2024-01-13T18:30:24.798 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NhPrUtaalxfWZEK off=233273 len=903685 2024-01-13T18:30:24.804 INFO:tasks.workunit.client.0.smithi084.stdout:op 2802 completed, throughput=4.99MB/sec 2024-01-13T18:30:24.804 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tZf9KgiyrryoNzD off=743177 len=1441365 2024-01-13T18:30:24.805 INFO:tasks.workunit.client.0.smithi084.stdout:op 2803 completed, throughput=5MB/sec 2024-01-13T18:30:24.805 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wag9NqRY9FCHDUz off=9001968 len=1179496 2024-01-13T18:30:24.808 INFO:tasks.workunit.client.0.smithi084.stdout:op 2804 completed, throughput=5MB/sec 2024-01-13T18:30:24.808 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Zl5gArGSyiUp3e6 off=1318829 len=2016582 2024-01-13T18:30:24.810 INFO:tasks.workunit.client.0.smithi084.stdout:op 2805 completed, throughput=5MB/sec 2024-01-13T18:30:25.810 INFO:tasks.workunit.client.0.smithi084.stdout: 551: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:25.810 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EfN2efTxirP_Qkw off=14764462 len=626494 2024-01-13T18:30:25.814 INFO:tasks.workunit.client.0.smithi084.stdout:op 2806 completed, throughput=4.99MB/sec 2024-01-13T18:30:25.815 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gEeIyaEfEuaRX_1 off=10883742 len=592955 2024-01-13T18:30:25.816 INFO:tasks.workunit.client.0.smithi084.stdout:op 2807 completed, throughput=4.99MB/sec 2024-01-13T18:30:25.816 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rPa-Vb_16oPpQOu off=10869380 len=1200825 2024-01-13T18:30:25.819 INFO:tasks.workunit.client.0.smithi084.stdout:op 2808 completed, throughput=5MB/sec 2024-01-13T18:30:25.819 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aRgcIHdrAoMxJgM off=1651775 len=1995590 2024-01-13T18:30:25.822 INFO:tasks.workunit.client.0.smithi084.stdout:op 2809 completed, throughput=5MB/sec 2024-01-13T18:30:25.822 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kiJguxT2MVna3tj off=2155151 len=542578 2024-01-13T18:30:25.823 INFO:tasks.workunit.client.0.smithi084.stdout:op 2810 completed, throughput=5MB/sec 2024-01-13T18:30:25.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:25 smithi099 ceph-mon[138788]: pgmap v1758: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:30:25.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:25 smithi084 ceph-mon[116404]: pgmap v1758: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:30:25.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:25 smithi084 ceph-mon[119097]: pgmap v1758: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:30:26.823 INFO:tasks.workunit.client.0.smithi084.stdout: 552: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:26.824 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-c_lQuHv7epb8v7s off=3910131 len=1645206 2024-01-13T18:30:26.832 INFO:tasks.workunit.client.0.smithi084.stdout:op 2811 completed, throughput=4.99MB/sec 2024-01-13T18:30:26.832 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qL_mYG-9NjZgpTS off=3505335 len=52286 2024-01-13T18:30:26.832 INFO:tasks.workunit.client.0.smithi084.stdout:op 2812 completed, throughput=4.99MB/sec 2024-01-13T18:30:26.832 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Lxv30x8C_BDUEXi off=5140315 len=687984 2024-01-13T18:30:26.836 INFO:tasks.workunit.client.0.smithi084.stdout:op 2813 completed, throughput=5MB/sec 2024-01-13T18:30:26.836 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OSPnRIXdJXbZTkh off=679477 len=1406157 2024-01-13T18:30:26.838 INFO:tasks.workunit.client.0.smithi084.stdout:op 2814 completed, throughput=5MB/sec 2024-01-13T18:30:26.838 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mwUnjQIW3-1pcai off=148230 len=1035959 2024-01-13T18:30:26.840 INFO:tasks.workunit.client.0.smithi084.stdout:op 2815 completed, throughput=5MB/sec 2024-01-13T18:30:26.840 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-phOtYRP895xQbki off=5941906 len=360501 2024-01-13T18:30:26.843 INFO:tasks.workunit.client.0.smithi084.stdout:op 2816 completed, throughput=5MB/sec 2024-01-13T18:30:26.844 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TLZ2zQDlJqoPTqe off=489451 len=816206 2024-01-13T18:30:26.847 INFO:tasks.workunit.client.0.smithi084.stdout:op 2817 completed, throughput=5MB/sec 2024-01-13T18:30:27.847 INFO:tasks.workunit.client.0.smithi084.stdout: 553: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:27.848 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SfSqIDOy804mpa6 off=9141098 len=1977961 2024-01-13T18:30:27.849 INFO:tasks.workunit.client.0.smithi084.stdout:op 2818 completed, throughput=5MB/sec 2024-01-13T18:30:27.849 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rJDFT2mBL-F_V5A off=27785 len=82257 2024-01-13T18:30:27.851 INFO:tasks.workunit.client.0.smithi084.stdout:op 2819 completed, throughput=5MB/sec 2024-01-13T18:30:27.851 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nCeoMLCPff8NDLq off=12173065 len=947540 2024-01-13T18:30:27.855 INFO:tasks.workunit.client.0.smithi084.stdout:op 2820 completed, throughput=5MB/sec 2024-01-13T18:30:27.855 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Z7uqvcSg6ZNLWz6 off=2922505 len=726446 2024-01-13T18:30:27.856 INFO:tasks.workunit.client.0.smithi084.stdout:op 2821 completed, throughput=5MB/sec 2024-01-13T18:30:27.856 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JM_RluunomrYDJU off=2909333 len=1832800 2024-01-13T18:30:27.866 INFO:tasks.workunit.client.0.smithi084.stdout:op 2822 completed, throughput=5MB/sec 2024-01-13T18:30:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:27 smithi099 ceph-mon[138788]: pgmap v1759: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:30:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:30:27.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:27 smithi084 ceph-mon[116404]: pgmap v1759: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:30:27.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:30:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:27 smithi084 ceph-mon[119097]: pgmap v1759: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:30:27.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:30:28.867 INFO:tasks.workunit.client.0.smithi084.stdout: 554: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:28.867 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ln0-5hM0mig4sp- off=1362170 len=1211639 2024-01-13T18:30:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:30:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:30:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:30:28.873 INFO:tasks.workunit.client.0.smithi084.stdout:op 2823 completed, throughput=4.99MB/sec 2024-01-13T18:30:28.873 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XGpC3pi0Q9UGp_X off=15783409 len=500753 2024-01-13T18:30:28.877 INFO:tasks.workunit.client.0.smithi084.stdout:op 2824 completed, throughput=5MB/sec 2024-01-13T18:30:28.877 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_RoFcMwMF6T_kwQ off=15635376 len=1246140 2024-01-13T18:30:28.882 INFO:tasks.workunit.client.0.smithi084.stdout:op 2825 completed, throughput=5MB/sec 2024-01-13T18:30:28.882 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iTovHaDXG1F480t off=1702939 len=1914764 2024-01-13T18:30:28.892 INFO:tasks.workunit.client.0.smithi084.stdout:op 2826 completed, throughput=5MB/sec 2024-01-13T18:30:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:30:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:30:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:30:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:30:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:30:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:30:29.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:29 smithi099 ceph-mon[138788]: pgmap v1760: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:30:29.893 INFO:tasks.workunit.client.0.smithi084.stdout: 555: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:29.893 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-plnM6LeWyFgQ_yC off=457933 len=639544 2024-01-13T18:30:29.894 INFO:tasks.workunit.client.0.smithi084.stdout:op 2827 completed, throughput=4.99MB/sec 2024-01-13T18:30:29.894 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4EmWJT9uG1alr2B off=1522219 len=1079286 2024-01-13T18:30:29.897 INFO:tasks.workunit.client.0.smithi084.stdout:op 2828 completed, throughput=4.99MB/sec 2024-01-13T18:30:29.897 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Uzsiv9h2aj8q13t off=940324 len=1082115 2024-01-13T18:30:29.898 INFO:tasks.workunit.client.0.smithi084.stdout:op 2829 completed, throughput=5MB/sec 2024-01-13T18:30:29.898 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OWFn8kQqfXlc8g_ off=6924554 len=202370 2024-01-13T18:30:29.899 INFO:tasks.workunit.client.0.smithi084.stdout:op 2830 completed, throughput=5MB/sec 2024-01-13T18:30:29.899 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-niHvdvWV7Sppl3V off=14979516 len=1518906 2024-01-13T18:30:29.908 INFO:tasks.workunit.client.0.smithi084.stdout:op 2831 completed, throughput=5MB/sec 2024-01-13T18:30:29.908 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kZNnoFJBTW-z7EI off=1252120 len=1289728 2024-01-13T18:30:29.915 INFO:tasks.workunit.client.0.smithi084.stdout:op 2832 completed, throughput=5MB/sec 2024-01-13T18:30:29.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:29 smithi084 ceph-mon[116404]: pgmap v1760: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:30:29.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:29 smithi084 ceph-mon[119097]: pgmap v1760: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:30:30.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:30:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:30:30] "GET /metrics HTTP/1.1" 200 33990 "" "Prometheus/2.43.0" 2024-01-13T18:30:30.915 INFO:tasks.workunit.client.0.smithi084.stdout: 556: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:30.915 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5bszLN5hqQTVVaw off=7342348 len=1531276 2024-01-13T18:30:30.917 INFO:tasks.workunit.client.0.smithi084.stdout:op 2833 completed, throughput=5MB/sec 2024-01-13T18:30:30.917 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PqUGQAWl_l7isFI off=2978031 len=1376558 2024-01-13T18:30:30.923 INFO:tasks.workunit.client.0.smithi084.stdout:op 2834 completed, throughput=5MB/sec 2024-01-13T18:30:30.923 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2T7E3ExGX04LcPQ off=593207 len=1691788 2024-01-13T18:30:30.925 INFO:tasks.workunit.client.0.smithi084.stdout:op 2835 completed, throughput=5MB/sec 2024-01-13T18:30:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:31 smithi099 ceph-mon[138788]: pgmap v1761: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:30:31.925 INFO:tasks.workunit.client.0.smithi084.stdout: 557: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:31.925 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-orI2xD85B2A5tUt off=1352779 len=318375 2024-01-13T18:30:31.926 INFO:tasks.workunit.client.0.smithi084.stdout:op 2836 completed, throughput=4.99MB/sec 2024-01-13T18:30:31.926 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Zr59XaogY7AEg2B off=3915942 len=1571033 2024-01-13T18:30:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:31 smithi084 ceph-mon[116404]: pgmap v1761: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:30:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:31 smithi084 ceph-mon[119097]: pgmap v1761: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:30:31.929 INFO:tasks.workunit.client.0.smithi084.stdout:op 2837 completed, throughput=4.99MB/sec 2024-01-13T18:30:31.929 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--6nVWWKc1Lil-4O off=1980402 len=1286472 2024-01-13T18:30:31.935 INFO:tasks.workunit.client.0.smithi084.stdout:op 2838 completed, throughput=5MB/sec 2024-01-13T18:30:31.935 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PAry1iExdPxjKUB off=3215695 len=806871 2024-01-13T18:30:31.940 INFO:tasks.workunit.client.0.smithi084.stdout:op 2839 completed, throughput=5MB/sec 2024-01-13T18:30:31.940 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aj8s7B2BcHdj76y off=567820 len=584868 2024-01-13T18:30:31.941 INFO:tasks.workunit.client.0.smithi084.stdout:op 2840 completed, throughput=5MB/sec 2024-01-13T18:30:31.941 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eN0RlzFYac8wBLu off=1381576 len=338494 2024-01-13T18:30:31.942 INFO:tasks.workunit.client.0.smithi084.stdout:op 2841 completed, throughput=5MB/sec 2024-01-13T18:30:31.942 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M_5UQWndZch_jvE off=3541418 len=187222 2024-01-13T18:30:31.943 INFO:tasks.workunit.client.0.smithi084.stdout:op 2842 completed, throughput=5MB/sec 2024-01-13T18:30:31.943 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hiIsFVcfqc6bjfc off=6841825 len=437619 2024-01-13T18:30:31.943 INFO:tasks.workunit.client.0.smithi084.stdout:op 2843 completed, throughput=5MB/sec 2024-01-13T18:30:32.944 INFO:tasks.workunit.client.0.smithi084.stdout: 558: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:32.944 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KTK3FDpO02U7IGI off=5049666 len=1459641 2024-01-13T18:30:32.945 INFO:tasks.workunit.client.0.smithi084.stdout:op 2844 completed, throughput=4.99MB/sec 2024-01-13T18:30:32.945 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GJW65-9upERx4oQ off=8910325 len=1701462 2024-01-13T18:30:32.947 INFO:tasks.workunit.client.0.smithi084.stdout:op 2845 completed, throughput=5MB/sec 2024-01-13T18:30:32.947 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zRw5q7mIWeogey1 off=453373 len=41476 2024-01-13T18:30:32.948 INFO:tasks.workunit.client.0.smithi084.stdout:op 2846 completed, throughput=5MB/sec 2024-01-13T18:30:32.948 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tK4A1FmBXp9XDZ0 off=8919575 len=1014144 2024-01-13T18:30:32.954 INFO:tasks.workunit.client.0.smithi084.stdout:op 2847 completed, throughput=5MB/sec 2024-01-13T18:30:32.954 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_9fZV8iaJYBgC4t off=10217558 len=1682132 2024-01-13T18:30:32.961 INFO:tasks.workunit.client.0.smithi084.stdout:op 2848 completed, throughput=5MB/sec 2024-01-13T18:30:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:33 smithi099 ceph-mon[138788]: pgmap v1762: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:30:33.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:33 smithi084 ceph-mon[116404]: pgmap v1762: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:30:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:33 smithi084 ceph-mon[119097]: pgmap v1762: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:30:33.961 INFO:tasks.workunit.client.0.smithi084.stdout: 559: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:33.961 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TSWA83oub4bxoGG off=459187 len=1205014 2024-01-13T18:30:33.963 INFO:tasks.workunit.client.0.smithi084.stdout:op 2849 completed, throughput=4.99MB/sec 2024-01-13T18:30:33.963 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-p1rtLRAmTM5i3oU off=2972259 len=1099437 2024-01-13T18:30:33.968 INFO:tasks.workunit.client.0.smithi084.stdout:op 2850 completed, throughput=5MB/sec 2024-01-13T18:30:33.968 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IEWT7U-FfomHHSU off=14119425 len=929338 2024-01-13T18:30:33.969 INFO:tasks.workunit.client.0.smithi084.stdout:op 2851 completed, throughput=5MB/sec 2024-01-13T18:30:33.969 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EEjNlpP3GGYN7Hi off=11551412 len=1878800 2024-01-13T18:30:33.976 INFO:tasks.workunit.client.0.smithi084.stdout:op 2852 completed, throughput=5MB/sec 2024-01-13T18:30:34.976 INFO:tasks.workunit.client.0.smithi084.stdout: 560: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:34.976 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WyBifHqJuPK-gxd off=515730 len=885605 2024-01-13T18:30:34.978 INFO:tasks.workunit.client.0.smithi084.stdout:op 2853 completed, throughput=4.99MB/sec 2024-01-13T18:30:34.978 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Dq4yiKXx23gnpES off=325614 len=69533 2024-01-13T18:30:34.981 INFO:tasks.workunit.client.0.smithi084.stdout:op 2854 completed, throughput=4.99MB/sec 2024-01-13T18:30:34.981 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-P89r7aT72WdH2li off=816669 len=520233 2024-01-13T18:30:34.985 INFO:tasks.workunit.client.0.smithi084.stdout:op 2855 completed, throughput=4.99MB/sec 2024-01-13T18:30:34.985 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4Z5qasLmFwKA8EL off=2037968 len=1407417 2024-01-13T18:30:34.992 INFO:tasks.workunit.client.0.smithi084.stdout:op 2856 completed, throughput=5MB/sec 2024-01-13T18:30:34.992 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-A0un52rukl4DPel off=16618162 len=1002202 2024-01-13T18:30:34.996 INFO:tasks.workunit.client.0.smithi084.stdout:op 2857 completed, throughput=5MB/sec 2024-01-13T18:30:34.996 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-urwnT9Iy4-FlyvH off=9128141 len=1015455 2024-01-13T18:30:35.001 INFO:tasks.workunit.client.0.smithi084.stdout:op 2858 completed, throughput=5MB/sec 2024-01-13T18:30:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:35 smithi099 ceph-mon[138788]: pgmap v1763: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:30:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:35 smithi084 ceph-mon[116404]: pgmap v1763: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:30:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:35 smithi084 ceph-mon[119097]: pgmap v1763: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:30:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:36.002 INFO:tasks.workunit.client.0.smithi084.stdout: 561: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:36.002 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NPs14wp_a5bY4W5 off=1731244 len=193647 2024-01-13T18:30:36.002 INFO:tasks.workunit.client.0.smithi084.stdout:op 2859 completed, throughput=4.99MB/sec 2024-01-13T18:30:36.002 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_mRIySjVKQSiUYM off=13698614 len=1528517 2024-01-13T18:30:36.005 INFO:tasks.workunit.client.0.smithi084.stdout:op 2860 completed, throughput=4.99MB/sec 2024-01-13T18:30:36.005 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rXGpaEG86pswsX3 off=3665509 len=466378 2024-01-13T18:30:36.009 INFO:tasks.workunit.client.0.smithi084.stdout:op 2861 completed, throughput=5MB/sec 2024-01-13T18:30:36.009 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-D5dxOZ84YltZG8E off=6499460 len=908827 2024-01-13T18:30:36.014 INFO:tasks.workunit.client.0.smithi084.stdout:op 2862 completed, throughput=5MB/sec 2024-01-13T18:30:36.014 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hF3DaJAaIvQZKgx off=5021082 len=636301 2024-01-13T18:30:36.018 INFO:tasks.workunit.client.0.smithi084.stdout:op 2863 completed, throughput=5MB/sec 2024-01-13T18:30:36.018 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4WiCw23N6jjU4os off=3302886 len=362165 2024-01-13T18:30:36.018 INFO:tasks.workunit.client.0.smithi084.stdout:op 2864 completed, throughput=5MB/sec 2024-01-13T18:30:36.018 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1zaOA-2AYC6s5nL off=18878071 len=1526176 2024-01-13T18:30:36.026 INFO:tasks.workunit.client.0.smithi084.stdout:op 2865 completed, throughput=5MB/sec 2024-01-13T18:30:37.027 INFO:tasks.workunit.client.0.smithi084.stdout: 562: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aLBK1wRgJ3Uwj5d off=10511048 len=639370 2024-01-13T18:30:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:op 2866 completed, throughput=4.99MB/sec 2024-01-13T18:30:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S0JH4WUglIXOHWV off=2691904 len=1359172 2024-01-13T18:30:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:op 2867 completed, throughput=5MB/sec 2024-01-13T18:30:37.035 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uiJase9oQEdi1Rn off=12850359 len=1889746 2024-01-13T18:30:37.044 INFO:tasks.workunit.client.0.smithi084.stdout:op 2868 completed, throughput=5MB/sec 2024-01-13T18:30:37.044 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8EfXprTj3Rpkajq off=10703086 len=787557 2024-01-13T18:30:37.045 INFO:tasks.workunit.client.0.smithi084.stdout:op 2869 completed, throughput=5MB/sec 2024-01-13T18:30:37.047 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-INWXvVfufd5rmTQ off=3698955 len=1881032 2024-01-13T18:30:37.055 INFO:tasks.workunit.client.0.smithi084.stdout:op 2870 completed, throughput=5MB/sec 2024-01-13T18:30:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:37 smithi099 ceph-mon[138788]: pgmap v1764: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:30:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:37 smithi084 ceph-mon[116404]: pgmap v1764: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:30:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:37 smithi084 ceph-mon[119097]: pgmap v1764: 105 pgs: 105 active+clean; 128 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:30:38.055 INFO:tasks.workunit.client.0.smithi084.stdout: 563: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:38.055 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-P9wnRSy4ZeOYD8Z off=7244688 len=1859554 2024-01-13T18:30:38.057 INFO:tasks.workunit.client.0.smithi084.stdout:op 2871 completed, throughput=5MB/sec 2024-01-13T18:30:38.057 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zZ1eDyQb1zl9SYW off=14331234 len=2095532 2024-01-13T18:30:38.066 INFO:tasks.workunit.client.0.smithi084.stdout:op 2872 completed, throughput=5MB/sec 2024-01-13T18:30:39.066 INFO:tasks.workunit.client.0.smithi084.stdout: 564: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:39.066 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5egQtwO3_OiS2G8 off=4193613 len=1693920 2024-01-13T18:30:39.075 INFO:tasks.workunit.client.0.smithi084.stdout:op 2873 completed, throughput=4.99MB/sec 2024-01-13T18:30:39.075 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-d9camIQ1FAc8SZ4 off=10097543 len=231431 2024-01-13T18:30:39.076 INFO:tasks.workunit.client.0.smithi084.stdout:op 2874 completed, throughput=4.99MB/sec 2024-01-13T18:30:39.076 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-U1vVjCcCQbljqJN off=6403961 len=1573307 2024-01-13T18:30:39.082 INFO:tasks.workunit.client.0.smithi084.stdout:op 2875 completed, throughput=5MB/sec 2024-01-13T18:30:39.082 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-C15dAQpQ-aCjNUA off=7408642 len=1345183 2024-01-13T18:30:39.083 INFO:tasks.workunit.client.0.smithi084.stdout:op 2876 completed, throughput=5MB/sec 2024-01-13T18:30:39.083 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IjwWvhVgm8XmbLs off=721323 len=699459 2024-01-13T18:30:39.085 INFO:tasks.workunit.client.0.smithi084.stdout:op 2877 completed, throughput=5MB/sec 2024-01-13T18:30:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:39 smithi099 ceph-mon[138788]: pgmap v1765: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:30:39.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:39 smithi084 ceph-mon[116404]: pgmap v1765: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:30:39.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:39 smithi084 ceph-mon[119097]: pgmap v1765: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:30:40.085 INFO:tasks.workunit.client.0.smithi084.stdout: 565: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:40.086 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eB9Z2I9x7g_U255 off=6812986 len=183612 2024-01-13T18:30:40.089 INFO:tasks.workunit.client.0.smithi084.stdout:op 2878 completed, throughput=4.99MB/sec 2024-01-13T18:30:40.089 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pUufGZKS9npwAp3 off=16295413 len=1665150 2024-01-13T18:30:40.091 INFO:tasks.workunit.client.0.smithi084.stdout:op 2879 completed, throughput=5MB/sec 2024-01-13T18:30:40.091 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iG8lGl3QiDXUSUD off=7987744 len=815419 2024-01-13T18:30:40.092 INFO:tasks.workunit.client.0.smithi084.stdout:op 2880 completed, throughput=5MB/sec 2024-01-13T18:30:40.093 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w2FlCAoQ68R2VQ3 off=7278070 len=391757 2024-01-13T18:30:40.093 INFO:tasks.workunit.client.0.smithi084.stdout:op 2881 completed, throughput=5MB/sec 2024-01-13T18:30:40.093 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7Cg4xuaTlqLvRk5 off=5850105 len=336107 2024-01-13T18:30:40.094 INFO:tasks.workunit.client.0.smithi084.stdout:op 2882 completed, throughput=5MB/sec 2024-01-13T18:30:40.094 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-94-82UJpXcS1p0z off=4661953 len=144593 2024-01-13T18:30:40.097 INFO:tasks.workunit.client.0.smithi084.stdout:op 2883 completed, throughput=5MB/sec 2024-01-13T18:30:40.097 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9fiT568KeraF-bz off=4657393 len=1285281 2024-01-13T18:30:40.103 INFO:tasks.workunit.client.0.smithi084.stdout:op 2884 completed, throughput=5MB/sec 2024-01-13T18:30:40.104 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-79zozY2iFzHK8lN off=2621715 len=397460 2024-01-13T18:30:40.104 INFO:tasks.workunit.client.0.smithi084.stdout:op 2885 completed, throughput=5MB/sec 2024-01-13T18:30:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:30:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:30:40] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:30:41.105 INFO:tasks.workunit.client.0.smithi084.stdout: 566: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:41.105 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Hkn5fU6cphRAcCp off=8163002 len=361969 2024-01-13T18:30:41.106 INFO:tasks.workunit.client.0.smithi084.stdout:op 2886 completed, throughput=4.99MB/sec 2024-01-13T18:30:41.106 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k8wfi0ft8ING0zS off=6110153 len=1083261 2024-01-13T18:30:41.108 INFO:tasks.workunit.client.0.smithi084.stdout:op 2887 completed, throughput=4.99MB/sec 2024-01-13T18:30:41.108 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ey0-1E9Oh8t4X_H off=7322354 len=1867279 2024-01-13T18:30:41.112 INFO:tasks.workunit.client.0.smithi084.stdout:op 2888 completed, throughput=5MB/sec 2024-01-13T18:30:41.112 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HVrtyZeOWO1gD3Z off=2257072 len=1631527 2024-01-13T18:30:41.119 INFO:tasks.workunit.client.0.smithi084.stdout:op 2889 completed, throughput=5MB/sec 2024-01-13T18:30:41.119 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j1Batzq6W0NHWMI off=3253389 len=1058001 2024-01-13T18:30:41.124 INFO:tasks.workunit.client.0.smithi084.stdout:op 2890 completed, throughput=5MB/sec 2024-01-13T18:30:41.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:41 smithi099 ceph-mon[138788]: pgmap v1766: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:30:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:41 smithi084 ceph-mon[116404]: pgmap v1766: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:30:41.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:41 smithi084 ceph-mon[119097]: pgmap v1766: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:30:42.125 INFO:tasks.workunit.client.0.smithi084.stdout: 567: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:42.125 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4tmxYdwZv3yVO8b off=1989640 len=2048532 2024-01-13T18:30:42.138 INFO:tasks.workunit.client.0.smithi084.stdout:op 2891 completed, throughput=5MB/sec 2024-01-13T18:30:42.138 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZI-TXZ_suHVKlUZ off=4487636 len=1942614 2024-01-13T18:30:42.140 INFO:tasks.workunit.client.0.smithi084.stdout:op 2892 completed, throughput=5MB/sec 2024-01-13T18:30:42.140 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MoG_YQTk9JFjH1a off=3039985 len=1218052 2024-01-13T18:30:42.145 INFO:tasks.workunit.client.0.smithi084.stdout:op 2893 completed, throughput=5MB/sec 2024-01-13T18:30:43.146 INFO:tasks.workunit.client.0.smithi084.stdout: 568: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:43.146 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bCgOIQgACtua_Gb off=134106 len=1055965 2024-01-13T18:30:43.152 INFO:tasks.workunit.client.0.smithi084.stdout:op 2894 completed, throughput=4.99MB/sec 2024-01-13T18:30:43.152 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JcpsUQWzMPp6Wi9 off=6343352 len=1308252 2024-01-13T18:30:43.161 INFO:tasks.workunit.client.0.smithi084.stdout:op 2895 completed, throughput=5MB/sec 2024-01-13T18:30:43.161 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XnJwnyG6TkjHPSy off=2496176 len=2078109 2024-01-13T18:30:43.171 INFO:tasks.workunit.client.0.smithi084.stdout:op 2896 completed, throughput=5MB/sec 2024-01-13T18:30:43.172 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NPS9ZTIgrS3B9jY off=7303832 len=1402204 2024-01-13T18:30:43.179 INFO:tasks.workunit.client.0.smithi084.stdout:op 2897 completed, throughput=5MB/sec 2024-01-13T18:30:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:43 smithi099 ceph-mon[138788]: pgmap v1767: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:30:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:43 smithi084 ceph-mon[116404]: pgmap v1767: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:30:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:43 smithi084 ceph-mon[119097]: pgmap v1767: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:30:44.179 INFO:tasks.workunit.client.0.smithi084.stdout: 569: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:44.179 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nBIfNeqyOLHyVTr off=17156567 len=616923 2024-01-13T18:30:44.181 INFO:tasks.workunit.client.0.smithi084.stdout:op 2898 completed, throughput=4.99MB/sec 2024-01-13T18:30:44.181 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hFhfz5dgY22O7Lf off=5155957 len=242025 2024-01-13T18:30:44.184 INFO:tasks.workunit.client.0.smithi084.stdout:op 2899 completed, throughput=4.99MB/sec 2024-01-13T18:30:44.184 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wzx0JI5OFu8Jm3- off=765545 len=25238 2024-01-13T18:30:44.186 INFO:tasks.workunit.client.0.smithi084.stdout:op 2900 completed, throughput=4.99MB/sec 2024-01-13T18:30:44.186 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8nTEokf7d8dXnuN off=0 len=1369156 2024-01-13T18:30:44.193 INFO:tasks.workunit.client.0.smithi084.stdout:op 2901 completed, throughput=5MB/sec 2024-01-13T18:30:44.193 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yPw0XViYltod056 off=17647013 len=1846982 2024-01-13T18:30:44.195 INFO:tasks.workunit.client.0.smithi084.stdout:op 2902 completed, throughput=5MB/sec 2024-01-13T18:30:45.195 INFO:tasks.workunit.client.0.smithi084.stdout: 570: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:45.196 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OmYnw4zKMSQVYWO off=4568480 len=17418 2024-01-13T18:30:45.198 INFO:tasks.workunit.client.0.smithi084.stdout:op 2903 completed, throughput=4.99MB/sec 2024-01-13T18:30:45.198 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bQA62A71Sl0i0Z_ off=1010971 len=21514 2024-01-13T18:30:45.200 INFO:tasks.workunit.client.0.smithi084.stdout:op 2904 completed, throughput=4.99MB/sec 2024-01-13T18:30:45.200 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n0y0CJNdgrJ90S_ off=8905319 len=1104546 2024-01-13T18:30:45.206 INFO:tasks.workunit.client.0.smithi084.stdout:op 2905 completed, throughput=4.99MB/sec 2024-01-13T18:30:45.206 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qr4or_Agcgl5PfQ off=5941427 len=1844815 2024-01-13T18:30:45.214 INFO:tasks.workunit.client.0.smithi084.stdout:op 2906 completed, throughput=5MB/sec 2024-01-13T18:30:45.214 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dgcTG6m8_hkN9RF off=767187 len=1585985 2024-01-13T18:30:45.217 INFO:tasks.workunit.client.0.smithi084.stdout:op 2907 completed, throughput=5MB/sec 2024-01-13T18:30:45.217 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f7IRq3JlRRZHA6h off=20068490 len=1125376 2024-01-13T18:30:45.219 INFO:tasks.workunit.client.0.smithi084.stdout:op 2908 completed, throughput=5MB/sec 2024-01-13T18:30:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:45 smithi099 ceph-mon[138788]: pgmap v1768: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:30:45.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:45 smithi084 ceph-mon[116404]: pgmap v1768: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:30:45.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:45 smithi084 ceph-mon[119097]: pgmap v1768: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:30:46.220 INFO:tasks.workunit.client.0.smithi084.stdout: 571: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:46.220 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9uMxSWotBbtMezz off=8210749 len=10333 2024-01-13T18:30:46.220 INFO:tasks.workunit.client.0.smithi084.stdout:op 2909 completed, throughput=4.99MB/sec 2024-01-13T18:30:46.220 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wQUHyXysmH1oqxS off=8182 len=1499988 2024-01-13T18:30:46.222 INFO:tasks.workunit.client.0.smithi084.stdout:op 2910 completed, throughput=4.99MB/sec 2024-01-13T18:30:46.222 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1se6IQa6MiWvbLo off=11380363 len=734296 2024-01-13T18:30:46.224 INFO:tasks.workunit.client.0.smithi084.stdout:op 2911 completed, throughput=5MB/sec 2024-01-13T18:30:46.224 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-u_sf_DQdVnQG24I off=817299 len=1382080 2024-01-13T18:30:46.225 INFO:tasks.workunit.client.0.smithi084.stdout:op 2912 completed, throughput=5MB/sec 2024-01-13T18:30:46.225 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pSfEa7Xl7nCcDca off=16799973 len=432498 2024-01-13T18:30:46.229 INFO:tasks.workunit.client.0.smithi084.stdout:op 2913 completed, throughput=5MB/sec 2024-01-13T18:30:46.229 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IHTsa1Pi65AaWGO off=1029276 len=1604213 2024-01-13T18:30:46.230 INFO:tasks.workunit.client.0.smithi084.stdout:op 2914 completed, throughput=5MB/sec 2024-01-13T18:30:47.231 INFO:tasks.workunit.client.0.smithi084.stdout: 572: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:47.231 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-emYpLdqIHO-cP_Y off=9624748 len=1441059 2024-01-13T18:30:47.238 INFO:tasks.workunit.client.0.smithi084.stdout:op 2915 completed, throughput=4.99MB/sec 2024-01-13T18:30:47.238 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AmjKvF266dMzJhl off=2585503 len=400380 2024-01-13T18:30:47.241 INFO:tasks.workunit.client.0.smithi084.stdout:op 2916 completed, throughput=5MB/sec 2024-01-13T18:30:47.241 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GeJbiLTdaykXYUQ off=16776662 len=1747396 2024-01-13T18:30:47.243 INFO:tasks.workunit.client.0.smithi084.stdout:op 2917 completed, throughput=5MB/sec 2024-01-13T18:30:47.243 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZZaL8tbx7jq0Brh off=1377814 len=211089 2024-01-13T18:30:47.246 INFO:tasks.workunit.client.0.smithi084.stdout:op 2918 completed, throughput=5MB/sec 2024-01-13T18:30:47.246 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LJYKcBENA0thmBO off=8833280 len=1523791 2024-01-13T18:30:47.253 INFO:tasks.workunit.client.0.smithi084.stdout:op 2919 completed, throughput=5MB/sec 2024-01-13T18:30:47.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:47 smithi099 ceph-mon[138788]: pgmap v1769: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:30:47.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:47 smithi084 ceph-mon[116404]: pgmap v1769: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:30:47.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:47 smithi084 ceph-mon[119097]: pgmap v1769: 105 pgs: 105 active+clean; 128 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:30:48.254 INFO:tasks.workunit.client.0.smithi084.stdout: 573: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:48.254 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bQA62A71Sl0i0Z_ off=2660975 len=124998 2024-01-13T18:30:48.256 INFO:tasks.workunit.client.0.smithi084.stdout:op 2920 completed, throughput=4.99MB/sec 2024-01-13T18:30:48.256 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8zQD3hP-ZUqhRyK off=6261232 len=1308875 2024-01-13T18:30:48.258 INFO:tasks.workunit.client.0.smithi084.stdout:op 2921 completed, throughput=4.99MB/sec 2024-01-13T18:30:48.258 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UOg4KqBxBZPPI_O off=2367281 len=1768980 2024-01-13T18:30:48.266 INFO:tasks.workunit.client.0.smithi084.stdout:op 2922 completed, throughput=5MB/sec 2024-01-13T18:30:48.266 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FZvgk0UQUPGVvgl off=735486 len=2081977 2024-01-13T18:30:48.273 INFO:tasks.workunit.client.0.smithi084.stdout:op 2923 completed, throughput=5MB/sec 2024-01-13T18:30:49.274 INFO:tasks.workunit.client.0.smithi084.stdout: 574: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:49.274 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hkYhBitgIYEdydP off=1456012 len=279944 2024-01-13T18:30:49.277 INFO:tasks.workunit.client.0.smithi084.stdout:op 2924 completed, throughput=4.99MB/sec 2024-01-13T18:30:49.277 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FnElY0v7TIRIwXa off=1618310 len=532668 2024-01-13T18:30:49.281 INFO:tasks.workunit.client.0.smithi084.stdout:op 2925 completed, throughput=4.99MB/sec 2024-01-13T18:30:49.281 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4w2Ob-DVynizOOc off=2430143 len=1672467 2024-01-13T18:30:49.290 INFO:tasks.workunit.client.0.smithi084.stdout:op 2926 completed, throughput=5MB/sec 2024-01-13T18:30:49.290 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4nvyiQOHwPYjQjw off=15345053 len=474134 2024-01-13T18:30:49.291 INFO:tasks.workunit.client.0.smithi084.stdout:op 2927 completed, throughput=5MB/sec 2024-01-13T18:30:49.291 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4VjJleUam8Cy5LO off=1357052 len=891609 2024-01-13T18:30:49.292 INFO:tasks.workunit.client.0.smithi084.stdout:op 2928 completed, throughput=5MB/sec 2024-01-13T18:30:49.292 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EF1YDMqLEQiYKF6 off=2129729 len=2081217 2024-01-13T18:30:49.294 INFO:tasks.workunit.client.0.smithi084.stdout:op 2929 completed, throughput=5MB/sec 2024-01-13T18:30:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:49 smithi099 ceph-mon[138788]: pgmap v1770: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:30:49.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:49 smithi084 ceph-mon[116404]: pgmap v1770: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:30:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:49 smithi084 ceph-mon[119097]: pgmap v1770: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:30:50.294 INFO:tasks.workunit.client.0.smithi084.stdout: 575: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:50.294 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wATI0LrU-Hs2fTC off=3889987 len=723774 2024-01-13T18:30:50.298 INFO:tasks.workunit.client.0.smithi084.stdout:op 2930 completed, throughput=4.99MB/sec 2024-01-13T18:30:50.298 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8-6iJlyrWVJJBdS off=176122 len=1073247 2024-01-13T18:30:50.300 INFO:tasks.workunit.client.0.smithi084.stdout:op 2931 completed, throughput=5MB/sec 2024-01-13T18:30:50.300 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TjgKgMU2i-RX_b1 off=1783731 len=1315452 2024-01-13T18:30:50.301 INFO:tasks.workunit.client.0.smithi084.stdout:op 2932 completed, throughput=5MB/sec 2024-01-13T18:30:50.301 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lvy54vXOojVKKlu off=1320172 len=2155 2024-01-13T18:30:50.302 INFO:tasks.workunit.client.0.smithi084.stdout:op 2933 completed, throughput=5MB/sec 2024-01-13T18:30:50.302 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-859ZLmwlfYjUQP2 off=5750190 len=1243098 2024-01-13T18:30:50.304 INFO:tasks.workunit.client.0.smithi084.stdout:op 2934 completed, throughput=5MB/sec 2024-01-13T18:30:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:30:50.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:30:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:30:50] "GET /metrics HTTP/1.1" 200 33988 "" "Prometheus/2.43.0" 2024-01-13T18:30:51.304 INFO:tasks.workunit.client.0.smithi084.stdout: 576: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:51.304 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Kt2s5r75tawUk-Y off=7307409 len=1183523 2024-01-13T18:30:51.306 INFO:tasks.workunit.client.0.smithi084.stdout:op 2935 completed, throughput=4.99MB/sec 2024-01-13T18:30:51.306 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dYSA-p-STxi29xp off=314703 len=1757665 2024-01-13T18:30:51.313 INFO:tasks.workunit.client.0.smithi084.stdout:op 2936 completed, throughput=5MB/sec 2024-01-13T18:30:51.313 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OlofVZVbDMnh4sf off=7203576 len=582413 2024-01-13T18:30:51.314 INFO:tasks.workunit.client.0.smithi084.stdout:op 2937 completed, throughput=5MB/sec 2024-01-13T18:30:51.314 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w0LjBUbXQHGS_EI off=3882104 len=1770554 2024-01-13T18:30:51.316 INFO:tasks.workunit.client.0.smithi084.stdout:op 2938 completed, throughput=5MB/sec 2024-01-13T18:30:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:51 smithi099 ceph-mon[138788]: pgmap v1771: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:30:51.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:51 smithi084 ceph-mon[116404]: pgmap v1771: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:30:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:51 smithi084 ceph-mon[119097]: pgmap v1771: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:30:52.316 INFO:tasks.workunit.client.0.smithi084.stdout: 577: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:52.317 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FVc11fj_sWdPPo2 off=18147063 len=1827401 2024-01-13T18:30:52.325 INFO:tasks.workunit.client.0.smithi084.stdout:op 2939 completed, throughput=4.99MB/sec 2024-01-13T18:30:52.325 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rBhy-RsVD8ChljD off=3527827 len=1093802 2024-01-13T18:30:52.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 2940 completed, throughput=5MB/sec 2024-01-13T18:30:52.329 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zTsGBKlP4GiRVpk off=11797597 len=1157967 2024-01-13T18:30:52.336 INFO:tasks.workunit.client.0.smithi084.stdout:op 2941 completed, throughput=5MB/sec 2024-01-13T18:30:52.336 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ImczCgCLNv2VJaV off=11979885 len=795705 2024-01-13T18:30:52.337 INFO:tasks.workunit.client.0.smithi084.stdout:op 2942 completed, throughput=5MB/sec 2024-01-13T18:30:52.337 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-x9mfqayFz3zv5VU off=14769511 len=791095 2024-01-13T18:30:52.338 INFO:tasks.workunit.client.0.smithi084.stdout:op 2943 completed, throughput=5MB/sec 2024-01-13T18:30:53.338 INFO:tasks.workunit.client.0.smithi084.stdout: 578: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:53.338 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Yciw2EOcmr_UuMH off=392731 len=1246570 2024-01-13T18:30:53.340 INFO:tasks.workunit.client.0.smithi084.stdout:op 2944 completed, throughput=4.99MB/sec 2024-01-13T18:30:53.340 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WV7FlJlnYW4M6ZM off=6406269 len=1455355 2024-01-13T18:30:53.341 INFO:tasks.workunit.client.0.smithi084.stdout:op 2945 completed, throughput=5MB/sec 2024-01-13T18:30:53.341 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-256cU0J4pD9lJzy off=10770059 len=1152548 2024-01-13T18:30:53.346 INFO:tasks.workunit.client.0.smithi084.stdout:op 2946 completed, throughput=5MB/sec 2024-01-13T18:30:53.347 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CY3wjsFGXFdLXKW off=16353519 len=457206 2024-01-13T18:30:53.350 INFO:tasks.workunit.client.0.smithi084.stdout:op 2947 completed, throughput=5MB/sec 2024-01-13T18:30:53.351 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hTaflTu5iptkr43 off=2570035 len=583889 2024-01-13T18:30:53.354 INFO:tasks.workunit.client.0.smithi084.stdout:op 2948 completed, throughput=5MB/sec 2024-01-13T18:30:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:53 smithi099 ceph-mon[138788]: pgmap v1772: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:30:53.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:53 smithi084 ceph-mon[116404]: pgmap v1772: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:30:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:53 smithi084 ceph-mon[119097]: pgmap v1772: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:30:54.354 INFO:tasks.workunit.client.0.smithi084.stdout: 579: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:54.355 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8pNKNvGyUoVRgRd off=11024223 len=703086 2024-01-13T18:30:54.355 INFO:tasks.workunit.client.0.smithi084.stdout:op 2949 completed, throughput=4.99MB/sec 2024-01-13T18:30:54.356 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EK2z2P05ejbJwNO off=13069648 len=601521 2024-01-13T18:30:54.357 INFO:tasks.workunit.client.0.smithi084.stdout:op 2950 completed, throughput=4.99MB/sec 2024-01-13T18:30:54.357 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-o4VobvUfKUsR9bk off=1093425 len=40603 2024-01-13T18:30:54.357 INFO:tasks.workunit.client.0.smithi084.stdout:op 2951 completed, throughput=4.99MB/sec 2024-01-13T18:30:54.357 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LYSvyzmowjNLTtd off=1833881 len=811231 2024-01-13T18:30:54.360 INFO:tasks.workunit.client.0.smithi084.stdout:op 2952 completed, throughput=5MB/sec 2024-01-13T18:30:54.360 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vuN4PApIVKlaBFS off=4042999 len=294161 2024-01-13T18:30:54.363 INFO:tasks.workunit.client.0.smithi084.stdout:op 2953 completed, throughput=5MB/sec 2024-01-13T18:30:54.363 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XXzYL2XSYCvwuLM off=8733171 len=1492073 2024-01-13T18:30:54.364 INFO:tasks.workunit.client.0.smithi084.stdout:op 2954 completed, throughput=5MB/sec 2024-01-13T18:30:54.365 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9uMxSWotBbtMezz off=10994426 len=1061493 2024-01-13T18:30:54.366 INFO:tasks.workunit.client.0.smithi084.stdout:op 2955 completed, throughput=5MB/sec 2024-01-13T18:30:54.367 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TZHd8ueSzhRqR_0 off=164555 len=545685 2024-01-13T18:30:54.370 INFO:tasks.workunit.client.0.smithi084.stdout:op 2956 completed, throughput=5MB/sec 2024-01-13T18:30:55.371 INFO:tasks.workunit.client.0.smithi084.stdout: 580: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:55.371 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UwaTYvwhGnzEPQR off=629413 len=438630 2024-01-13T18:30:55.374 INFO:tasks.workunit.client.0.smithi084.stdout:op 2957 completed, throughput=4.99MB/sec 2024-01-13T18:30:55.374 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZZ9vc4Fn1Xx3jcD off=2206679 len=7662 2024-01-13T18:30:55.375 INFO:tasks.workunit.client.0.smithi084.stdout:op 2958 completed, throughput=4.99MB/sec 2024-01-13T18:30:55.375 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FQ7TrBqIFZNRtHC off=7426819 len=623661 2024-01-13T18:30:55.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 2959 completed, throughput=4.99MB/sec 2024-01-13T18:30:55.376 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6mPMsQCh56NIaVN off=19825516 len=496389 2024-01-13T18:30:55.379 INFO:tasks.workunit.client.0.smithi084.stdout:op 2960 completed, throughput=4.99MB/sec 2024-01-13T18:30:55.380 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sq_jlU63IFixDck off=3045711 len=1257214 2024-01-13T18:30:55.382 INFO:tasks.workunit.client.0.smithi084.stdout:op 2961 completed, throughput=5MB/sec 2024-01-13T18:30:55.382 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-awpjm2blcAYhnZa off=9652957 len=951533 2024-01-13T18:30:55.383 INFO:tasks.workunit.client.0.smithi084.stdout:op 2962 completed, throughput=5MB/sec 2024-01-13T18:30:55.383 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-F8KY6yTT0FUBpcZ off=6491692 len=781712 2024-01-13T18:30:55.388 INFO:tasks.workunit.client.0.smithi084.stdout:op 2963 completed, throughput=5MB/sec 2024-01-13T18:30:55.388 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DptDX_pwdQQgoB0 off=1141059 len=1688411 2024-01-13T18:30:55.397 INFO:tasks.workunit.client.0.smithi084.stdout:op 2964 completed, throughput=5MB/sec 2024-01-13T18:30:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:55 smithi099 ceph-mon[138788]: pgmap v1773: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:30:55.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:55 smithi084 ceph-mon[116404]: pgmap v1773: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:30:55.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:55 smithi084 ceph-mon[119097]: pgmap v1773: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:30:56.398 INFO:tasks.workunit.client.0.smithi084.stdout: 581: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:56.398 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r7o-WEsilU0dVp8 off=4625943 len=178236 2024-01-13T18:30:56.401 INFO:tasks.workunit.client.0.smithi084.stdout:op 2965 completed, throughput=4.99MB/sec 2024-01-13T18:30:56.401 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V6MO82h592WsOHF off=16479752 len=1919325 2024-01-13T18:30:56.403 INFO:tasks.workunit.client.0.smithi084.stdout:op 2966 completed, throughput=5MB/sec 2024-01-13T18:30:56.403 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XbQrUMQyN_YVO67 off=21948240 len=128412 2024-01-13T18:30:56.405 INFO:tasks.workunit.client.0.smithi084.stdout:op 2967 completed, throughput=5MB/sec 2024-01-13T18:30:56.405 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZVbjqpAY_dso4aH off=15972402 len=1823150 2024-01-13T18:30:56.414 INFO:tasks.workunit.client.0.smithi084.stdout:op 2968 completed, throughput=5MB/sec 2024-01-13T18:30:56.414 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LtCTg322-XtJVX2 off=2635317 len=1073829 2024-01-13T18:30:56.419 INFO:tasks.workunit.client.0.smithi084.stdout:op 2969 completed, throughput=5MB/sec 2024-01-13T18:30:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: 582: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:57.419 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zDXs7ZSZoX0WIbg off=8528296 len=1543783 2024-01-13T18:30:57.422 INFO:tasks.workunit.client.0.smithi084.stdout:op 2970 completed, throughput=5MB/sec 2024-01-13T18:30:57.422 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ApAkiDp-fr905Iq off=6215791 len=1596810 2024-01-13T18:30:57.431 INFO:tasks.workunit.client.0.smithi084.stdout:op 2971 completed, throughput=5MB/sec 2024-01-13T18:30:57.431 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yw__zkBnhI8dnb7 off=4850622 len=862179 2024-01-13T18:30:57.432 INFO:tasks.workunit.client.0.smithi084.stdout:op 2972 completed, throughput=5MB/sec 2024-01-13T18:30:57.433 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Nv3Rg9AKa4lTani off=2155873 len=1369235 2024-01-13T18:30:57.435 INFO:tasks.workunit.client.0.smithi084.stdout:op 2973 completed, throughput=5MB/sec 2024-01-13T18:30:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:57 smithi099 ceph-mon[138788]: pgmap v1774: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:30:57.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:57 smithi084 ceph-mon[116404]: pgmap v1774: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:30:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:57 smithi084 ceph-mon[119097]: pgmap v1774: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:30:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: 583: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:58.435 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OMvlgPcdAdcZDJ9 off=1913544 len=1143609 2024-01-13T18:30:58.442 INFO:tasks.workunit.client.0.smithi084.stdout:op 2974 completed, throughput=5MB/sec 2024-01-13T18:30:58.442 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vGmXAeItGfeiy4Z off=7927524 len=1517455 2024-01-13T18:30:58.448 INFO:tasks.workunit.client.0.smithi084.stdout:op 2975 completed, throughput=5MB/sec 2024-01-13T18:30:58.448 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h_fAAykEw6Ovit5 off=10214158 len=764262 2024-01-13T18:30:58.453 INFO:tasks.workunit.client.0.smithi084.stdout:op 2976 completed, throughput=5MB/sec 2024-01-13T18:30:58.453 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-l_q3xa9by0_iNl4 off=0 len=1508345 2024-01-13T18:30:58.458 INFO:tasks.workunit.client.0.smithi084.stdout:op 2977 completed, throughput=5MB/sec 2024-01-13T18:30:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: 584: throughput=4.99MB/sec pending data=0 2024-01-13T18:30:59.459 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-o1hiuH25gCQndbf off=1195349 len=100247 2024-01-13T18:30:59.462 INFO:tasks.workunit.client.0.smithi084.stdout:op 2978 completed, throughput=4.99MB/sec 2024-01-13T18:30:59.462 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UNVQMeZGthW5fux off=12724994 len=633123 2024-01-13T18:30:59.463 INFO:tasks.workunit.client.0.smithi084.stdout:op 2979 completed, throughput=4.99MB/sec 2024-01-13T18:30:59.463 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JaOXzyqUGMA7cN5 off=1350028 len=1444028 2024-01-13T18:30:59.469 INFO:tasks.workunit.client.0.smithi084.stdout:op 2980 completed, throughput=5MB/sec 2024-01-13T18:30:59.469 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nIQd-LFepSSV23t off=15950657 len=852618 2024-01-13T18:30:59.470 INFO:tasks.workunit.client.0.smithi084.stdout:op 2981 completed, throughput=5MB/sec 2024-01-13T18:30:59.470 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-c9bmX-iRcVEPEXg off=17494765 len=301458 2024-01-13T18:30:59.473 INFO:tasks.workunit.client.0.smithi084.stdout:op 2982 completed, throughput=5MB/sec 2024-01-13T18:30:59.473 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-McaIT_QrRcpudXK off=8902797 len=95826 2024-01-13T18:30:59.473 INFO:tasks.workunit.client.0.smithi084.stdout:op 2983 completed, throughput=5MB/sec 2024-01-13T18:30:59.473 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XXbiGWFuvWbNvxM off=11580277 len=2087674 2024-01-13T18:30:59.482 INFO:tasks.workunit.client.0.smithi084.stdout:op 2984 completed, throughput=5MB/sec 2024-01-13T18:30:59.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:30:59 smithi099 ceph-mon[138788]: pgmap v1775: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:30:59.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:30:59 smithi084 ceph-mon[116404]: pgmap v1775: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:30:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:30:59 smithi084 ceph-mon[119097]: pgmap v1775: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:31:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: 585: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:00.483 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VZipb_zu1C14dSj off=7821341 len=537906 2024-01-13T18:31:00.487 INFO:tasks.workunit.client.0.smithi084.stdout:op 2985 completed, throughput=4.99MB/sec 2024-01-13T18:31:00.487 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Xqu2Uw3MDAN7b15 off=8684438 len=1649901 2024-01-13T18:31:00.493 INFO:tasks.workunit.client.0.smithi084.stdout:op 2986 completed, throughput=5MB/sec 2024-01-13T18:31:00.493 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AG1sVhw9FbqX5QC off=4781907 len=1782047 2024-01-13T18:31:00.495 INFO:tasks.workunit.client.0.smithi084.stdout:op 2987 completed, throughput=5MB/sec 2024-01-13T18:31:00.495 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LLWSWwRZQYlhLc_ off=12844971 len=918504 2024-01-13T18:31:00.496 INFO:tasks.workunit.client.0.smithi084.stdout:op 2988 completed, throughput=5MB/sec 2024-01-13T18:31:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:31:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:31:00] "GET /metrics HTTP/1.1" 200 33988 "" "Prometheus/2.43.0" 2024-01-13T18:31:01.496 INFO:tasks.workunit.client.0.smithi084.stdout: 586: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:01.497 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bWDZB21DcSrM2cS off=9629188 len=1660751 2024-01-13T18:31:01.506 INFO:tasks.workunit.client.0.smithi084.stdout:op 2989 completed, throughput=4.99MB/sec 2024-01-13T18:31:01.506 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-v1UBSxny0b_0cbc off=979674 len=1070033 2024-01-13T18:31:01.508 INFO:tasks.workunit.client.0.smithi084.stdout:op 2990 completed, throughput=5MB/sec 2024-01-13T18:31:01.508 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pDC6PZjYQng0IIG off=6113187 len=1018388 2024-01-13T18:31:01.509 INFO:tasks.workunit.client.0.smithi084.stdout:op 2991 completed, throughput=5MB/sec 2024-01-13T18:31:01.509 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-i10EOOdPP4XEfe6 off=19440107 len=1537543 2024-01-13T18:31:01.510 INFO:tasks.workunit.client.0.smithi084.stdout:op 2992 completed, throughput=5MB/sec 2024-01-13T18:31:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:01 smithi099 ceph-mon[138788]: pgmap v1776: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:31:01.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:01 smithi084 ceph-mon[116404]: pgmap v1776: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:31:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:01 smithi084 ceph-mon[119097]: pgmap v1776: 105 pgs: 105 active+clean; 128 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:31:02.511 INFO:tasks.workunit.client.0.smithi084.stdout: 587: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:02.511 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kHIoArdY8qJ3aop off=4663177 len=1541312 2024-01-13T18:31:02.519 INFO:tasks.workunit.client.0.smithi084.stdout:op 2993 completed, throughput=4.99MB/sec 2024-01-13T18:31:02.519 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Jrzg_Bppar-p9uF off=1164712 len=905804 2024-01-13T18:31:02.524 INFO:tasks.workunit.client.0.smithi084.stdout:op 2994 completed, throughput=5MB/sec 2024-01-13T18:31:02.524 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kmbl6QW8melZA3w off=1126125 len=236613 2024-01-13T18:31:02.527 INFO:tasks.workunit.client.0.smithi084.stdout:op 2995 completed, throughput=5MB/sec 2024-01-13T18:31:02.527 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gOTq1qg3zq-9FDg off=685285 len=1147025 2024-01-13T18:31:02.531 INFO:tasks.workunit.client.0.smithi084.stdout:op 2996 completed, throughput=5MB/sec 2024-01-13T18:31:02.531 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JpZxvSTDxuwxln1 off=3381974 len=1809224 2024-01-13T18:31:02.533 INFO:tasks.workunit.client.0.smithi084.stdout:op 2997 completed, throughput=5MB/sec 2024-01-13T18:31:03.533 INFO:tasks.workunit.client.0.smithi084.stdout: 588: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:03.533 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oMb6Aob1eLBMuud off=245722 len=1163461 2024-01-13T18:31:03.535 INFO:tasks.workunit.client.0.smithi084.stdout:op 2998 completed, throughput=4.99MB/sec 2024-01-13T18:31:03.535 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-49bYI7I8DVg302Z off=1993685 len=1984029 2024-01-13T18:31:03.537 INFO:tasks.workunit.client.0.smithi084.stdout:op 2999 completed, throughput=5MB/sec 2024-01-13T18:31:03.537 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JSV9YIG-WhTav_3 off=2603947 len=1333369 2024-01-13T18:31:03.538 INFO:tasks.workunit.client.0.smithi084.stdout:op 3000 completed, throughput=5MB/sec 2024-01-13T18:31:03.538 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7VVN3i7Ja38xvhs off=115078 len=1103339 2024-01-13T18:31:03.539 INFO:tasks.workunit.client.0.smithi084.stdout:op 3001 completed, throughput=5MB/sec 2024-01-13T18:31:03.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:03 smithi099 ceph-mon[138788]: pgmap v1777: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:31:03.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:03 smithi084 ceph-mon[116404]: pgmap v1777: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:31:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:03 smithi084 ceph-mon[119097]: pgmap v1777: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:31:04.539 INFO:tasks.workunit.client.0.smithi084.stdout: 589: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:04.540 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rIGM9eBTI7YlECE off=11914472 len=637011 2024-01-13T18:31:04.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 3002 completed, throughput=4.99MB/sec 2024-01-13T18:31:04.544 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RitYcf4TPN1EbfX off=2514018 len=1731698 2024-01-13T18:31:04.552 INFO:tasks.workunit.client.0.smithi084.stdout:op 3003 completed, throughput=5MB/sec 2024-01-13T18:31:04.552 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n82xzY1oxPHLZXP off=7968242 len=798274 2024-01-13T18:31:04.556 INFO:tasks.workunit.client.0.smithi084.stdout:op 3004 completed, throughput=5MB/sec 2024-01-13T18:31:04.557 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-REtsVnH2xIt7WlH off=1193784 len=819953 2024-01-13T18:31:04.557 INFO:tasks.workunit.client.0.smithi084.stdout:op 3005 completed, throughput=5MB/sec 2024-01-13T18:31:04.557 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GEnbFU27JK94Nvy off=1840230 len=1995099 2024-01-13T18:31:04.567 INFO:tasks.workunit.client.0.smithi084.stdout:op 3006 completed, throughput=5MB/sec 2024-01-13T18:31:05.568 INFO:tasks.workunit.client.0.smithi084.stdout: 590: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:05.568 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TupBxAUBcTNBXA- off=3370836 len=1933518 2024-01-13T18:31:05.579 INFO:tasks.workunit.client.0.smithi084.stdout:op 3007 completed, throughput=5MB/sec 2024-01-13T18:31:05.580 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XpM08e-kEAbf5Rt off=712903 len=607389 2024-01-13T18:31:05.581 INFO:tasks.workunit.client.0.smithi084.stdout:op 3008 completed, throughput=5MB/sec 2024-01-13T18:31:05.581 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Xe4hYApE2-Yp5RR off=9704750 len=1479269 2024-01-13T18:31:05.583 INFO:tasks.workunit.client.0.smithi084.stdout:op 3009 completed, throughput=5MB/sec 2024-01-13T18:31:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:05 smithi099 ceph-mon[138788]: pgmap v1778: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:05 smithi084 ceph-mon[116404]: pgmap v1778: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:05 smithi084 ceph-mon[119097]: pgmap v1778: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:06.583 INFO:tasks.workunit.client.0.smithi084.stdout: 591: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:06.583 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Wc2AVv5vfbfyKTL off=5509646 len=1639909 2024-01-13T18:31:06.593 INFO:tasks.workunit.client.0.smithi084.stdout:op 3010 completed, throughput=4.99MB/sec 2024-01-13T18:31:06.593 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6gcHnkMnosJbOlJ off=2439374 len=1057161 2024-01-13T18:31:06.600 INFO:tasks.workunit.client.0.smithi084.stdout:op 3011 completed, throughput=5MB/sec 2024-01-13T18:31:06.600 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mKffVF8sPkKGNAd off=9585669 len=418227 2024-01-13T18:31:06.603 INFO:tasks.workunit.client.0.smithi084.stdout:op 3012 completed, throughput=5MB/sec 2024-01-13T18:31:06.603 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GrOuUNGcaYBN7SZ off=1277278 len=1439910 2024-01-13T18:31:06.609 INFO:tasks.workunit.client.0.smithi084.stdout:op 3013 completed, throughput=5MB/sec 2024-01-13T18:31:06.609 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2FlO25ZSAOzInPK off=301839 len=838040 2024-01-13T18:31:06.610 INFO:tasks.workunit.client.0.smithi084.stdout:op 3014 completed, throughput=5MB/sec 2024-01-13T18:31:07.610 INFO:tasks.workunit.client.0.smithi084.stdout: 592: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:07.611 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Yr0rZ3BEdKdaVY3 off=4847605 len=1178242 2024-01-13T18:31:07.612 INFO:tasks.workunit.client.0.smithi084.stdout:op 3015 completed, throughput=4.99MB/sec 2024-01-13T18:31:07.612 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_oDt9SAL9P5lQP1 off=832604 len=1927167 2024-01-13T18:31:07.620 INFO:tasks.workunit.client.0.smithi084.stdout:op 3016 completed, throughput=5MB/sec 2024-01-13T18:31:07.620 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5F5DYlshe1I8ErN off=1788386 len=1577412 2024-01-13T18:31:07.626 INFO:tasks.workunit.client.0.smithi084.stdout:op 3017 completed, throughput=5MB/sec 2024-01-13T18:31:07.626 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e7WYRd9sRpAuk_V off=5071785 len=2029287 2024-01-13T18:31:07.636 INFO:tasks.workunit.client.0.smithi084.stdout:op 3018 completed, throughput=5MB/sec 2024-01-13T18:31:07.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:07 smithi099 ceph-mon[138788]: pgmap v1779: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:31:07.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:07 smithi084 ceph-mon[116404]: pgmap v1779: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:31:07.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:07 smithi084 ceph-mon[119097]: pgmap v1779: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:31:08.637 INFO:tasks.workunit.client.0.smithi084.stdout: 593: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:08.637 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8cawHQlDWtioy2T off=647386 len=657488 2024-01-13T18:31:08.638 INFO:tasks.workunit.client.0.smithi084.stdout:op 3019 completed, throughput=5MB/sec 2024-01-13T18:31:08.638 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8aLA1bwK1591Y7t off=15456330 len=1377665 2024-01-13T18:31:08.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 3020 completed, throughput=5MB/sec 2024-01-13T18:31:08.646 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DdV44gmNFdJ2apt off=1319593 len=1364015 2024-01-13T18:31:08.652 INFO:tasks.workunit.client.0.smithi084.stdout:op 3021 completed, throughput=5MB/sec 2024-01-13T18:31:08.652 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2MUMNFNzw2Lh8rL off=8437342 len=1724157 2024-01-13T18:31:08.661 INFO:tasks.workunit.client.0.smithi084.stdout:op 3022 completed, throughput=5MB/sec 2024-01-13T18:31:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:09 smithi099 ceph-mon[138788]: pgmap v1780: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:31:09.661 INFO:tasks.workunit.client.0.smithi084.stdout: 594: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:09.661 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Yr8IX5P3i4ZumwJ off=1840021 len=1206300 2024-01-13T18:31:09.663 INFO:tasks.workunit.client.0.smithi084.stdout:op 3023 completed, throughput=5MB/sec 2024-01-13T18:31:09.663 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1W74EEPuX9IG_ON off=1046503 len=1347391 2024-01-13T18:31:09.670 INFO:tasks.workunit.client.0.smithi084.stdout:op 3024 completed, throughput=5MB/sec 2024-01-13T18:31:09.671 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Li-rypSQQ4t0lNU off=12232893 len=1582780 2024-01-13T18:31:09.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:09 smithi084 ceph-mon[116404]: pgmap v1780: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:31:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:09 smithi084 ceph-mon[119097]: pgmap v1780: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:31:09.677 INFO:tasks.workunit.client.0.smithi084.stdout:op 3025 completed, throughput=5MB/sec 2024-01-13T18:31:10.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:31:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:31:10] "GET /metrics HTTP/1.1" 200 33994 "" "Prometheus/2.43.0" 2024-01-13T18:31:10.677 INFO:tasks.workunit.client.0.smithi084.stdout: 595: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:10.677 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-veP3EIVTb3z2q6U off=458220 len=1884813 2024-01-13T18:31:10.686 INFO:tasks.workunit.client.0.smithi084.stdout:op 3026 completed, throughput=4.99MB/sec 2024-01-13T18:31:10.686 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SfSqIDOy804mpa6 off=14831700 len=1044168 2024-01-13T18:31:10.688 INFO:tasks.workunit.client.0.smithi084.stdout:op 3027 completed, throughput=5MB/sec 2024-01-13T18:31:10.688 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-X87JxAUXKChGUGn off=16312060 len=1218469 2024-01-13T18:31:10.690 INFO:tasks.workunit.client.0.smithi084.stdout:op 3028 completed, throughput=5MB/sec 2024-01-13T18:31:10.690 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uDqBHNeZK-zOijV off=14410650 len=2057449 2024-01-13T18:31:10.692 INFO:tasks.workunit.client.0.smithi084.stdout:op 3029 completed, throughput=5MB/sec 2024-01-13T18:31:11.692 INFO:tasks.workunit.client.0.smithi084.stdout: 596: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:11.692 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cEw-UTlwbzYR3sh off=2448504 len=356786 2024-01-13T18:31:11.695 INFO:tasks.workunit.client.0.smithi084.stdout:op 3030 completed, throughput=4.99MB/sec 2024-01-13T18:31:11.695 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gXQpjn4it1UuJFx off=21498895 len=1976126 2024-01-13T18:31:11.697 INFO:tasks.workunit.client.0.smithi084.stdout:op 3031 completed, throughput=5MB/sec 2024-01-13T18:31:11.698 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aWX5gAzGoBQgpqQ off=14179229 len=2062809 2024-01-13T18:31:11.708 INFO:tasks.workunit.client.0.smithi084.stdout:op 3032 completed, throughput=5MB/sec 2024-01-13T18:31:11.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:11 smithi099 ceph-mon[138788]: pgmap v1781: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:31:11.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:11 smithi084 ceph-mon[116404]: pgmap v1781: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:31:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:11 smithi084 ceph-mon[119097]: pgmap v1781: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:31:12.708 INFO:tasks.workunit.client.0.smithi084.stdout: 597: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:12.708 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IeQTl6tvic-M9TE off=6597582 len=1149191 2024-01-13T18:31:12.710 INFO:tasks.workunit.client.0.smithi084.stdout:op 3033 completed, throughput=4.99MB/sec 2024-01-13T18:31:12.710 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eUxfYXpsqk0Q_5u off=9884 len=1318310 2024-01-13T18:31:12.712 INFO:tasks.workunit.client.0.smithi084.stdout:op 3034 completed, throughput=5MB/sec 2024-01-13T18:31:12.712 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DGXdGdjDCMvLHkP off=2111555 len=1218910 2024-01-13T18:31:12.713 INFO:tasks.workunit.client.0.smithi084.stdout:op 3035 completed, throughput=5MB/sec 2024-01-13T18:31:12.713 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YPzkqPy4NU9q_Eh off=8672379 len=1523896 2024-01-13T18:31:12.721 INFO:tasks.workunit.client.0.smithi084.stdout:op 3036 completed, throughput=5MB/sec 2024-01-13T18:31:12.721 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bn6-ctBaEA14dld off=14492397 len=1322999 2024-01-13T18:31:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:op 3037 completed, throughput=5MB/sec 2024-01-13T18:31:13.723 INFO:tasks.workunit.client.0.smithi084.stdout: 598: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:13.723 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2_tC4amwSJpmbM5 off=932021 len=319965 2024-01-13T18:31:13.726 INFO:tasks.workunit.client.0.smithi084.stdout:op 3038 completed, throughput=4.99MB/sec 2024-01-13T18:31:13.726 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rOhPw2woqiLjrpK off=1611149 len=1633560 2024-01-13T18:31:13.728 INFO:tasks.workunit.client.0.smithi084.stdout:op 3039 completed, throughput=5MB/sec 2024-01-13T18:31:13.728 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y8WxeqLq3u4TjTl off=71410 len=369371 2024-01-13T18:31:13.729 INFO:tasks.workunit.client.0.smithi084.stdout:op 3040 completed, throughput=5MB/sec 2024-01-13T18:31:13.729 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-L32tPMQwbcI_m5C off=12780660 len=2028152 2024-01-13T18:31:13.739 INFO:tasks.workunit.client.0.smithi084.stdout:op 3041 completed, throughput=5MB/sec 2024-01-13T18:31:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:13 smithi099 ceph-mon[138788]: pgmap v1782: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:31:13.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:13 smithi084 ceph-mon[116404]: pgmap v1782: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:31:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:13 smithi084 ceph-mon[119097]: pgmap v1782: 105 pgs: 105 active+clean; 128 GiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:31:14.739 INFO:tasks.workunit.client.0.smithi084.stdout: 599: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:14.739 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3bektLe8bCqBRw9 off=8563598 len=1135302 2024-01-13T18:31:14.747 INFO:tasks.workunit.client.0.smithi084.stdout:op 3042 completed, throughput=4.99MB/sec 2024-01-13T18:31:14.748 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cL9FJXf93zmgV42 off=15543826 len=1781098 2024-01-13T18:31:14.753 INFO:tasks.workunit.client.0.smithi084.stdout:op 3043 completed, throughput=5MB/sec 2024-01-13T18:31:14.753 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bJXRNH8vaEiY68v off=6458848 len=706205 2024-01-13T18:31:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:op 3044 completed, throughput=5MB/sec 2024-01-13T18:31:14.758 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LkrFPabXdnLW4kh off=8922673 len=1488595 2024-01-13T18:31:14.763 INFO:tasks.workunit.client.0.smithi084.stdout:op 3045 completed, throughput=5MB/sec 2024-01-13T18:31:14.763 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-e-s_9VpJbVpRAYS off=5670057 len=856171 2024-01-13T18:31:14.764 INFO:tasks.workunit.client.0.smithi084.stdout:op 3046 completed, throughput=5MB/sec 2024-01-13T18:31:15.765 INFO:tasks.workunit.client.0.smithi084.stdout: 600: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:15.765 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hGvjwCeO9Kunc9l off=16217086 len=636862 2024-01-13T18:31:15.767 INFO:tasks.workunit.client.0.smithi084.stdout:op 3047 completed, throughput=4.99MB/sec 2024-01-13T18:31:15.767 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Y4GclXK51TvHxlt off=2361113 len=1554922 2024-01-13T18:31:15.774 INFO:tasks.workunit.client.0.smithi084.stdout:op 3048 completed, throughput=5MB/sec 2024-01-13T18:31:15.774 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ALIqF45kt9uRbK0 off=1157961 len=1789604 2024-01-13T18:31:15.775 INFO:tasks.workunit.client.0.smithi084.stdout:op 3049 completed, throughput=5MB/sec 2024-01-13T18:31:15.775 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ls2XyBkjT--q8EZ off=7013468 len=256245 2024-01-13T18:31:15.778 INFO:tasks.workunit.client.0.smithi084.stdout:op 3050 completed, throughput=5MB/sec 2024-01-13T18:31:15.778 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kr0_wFqsVfcfaoK off=8991881 len=784945 2024-01-13T18:31:15.779 INFO:tasks.workunit.client.0.smithi084.stdout:op 3051 completed, throughput=5MB/sec 2024-01-13T18:31:15.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:15 smithi099 ceph-mon[138788]: pgmap v1783: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 4 op/s 2024-01-13T18:31:15.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:15 smithi084 ceph-mon[116404]: pgmap v1783: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 4 op/s 2024-01-13T18:31:15.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:15 smithi084 ceph-mon[119097]: pgmap v1783: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 4 op/s 2024-01-13T18:31:16.780 INFO:tasks.workunit.client.0.smithi084.stdout: 601: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:16.780 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UFoU2aVgY8cAXGk off=10181306 len=659473 2024-01-13T18:31:16.784 INFO:tasks.workunit.client.0.smithi084.stdout:op 3052 completed, throughput=4.99MB/sec 2024-01-13T18:31:16.784 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vF4k8l_5dBU83bR off=527511 len=771724 2024-01-13T18:31:16.789 INFO:tasks.workunit.client.0.smithi084.stdout:op 3053 completed, throughput=4.99MB/sec 2024-01-13T18:31:16.789 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mneW9KS9vOmdPPD off=22105013 len=1291973 2024-01-13T18:31:16.789 INFO:tasks.workunit.client.0.smithi084.stdout:op 3054 completed, throughput=5MB/sec 2024-01-13T18:31:16.789 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-C1aWDq6wegen5-M off=13622479 len=1935547 2024-01-13T18:31:16.799 INFO:tasks.workunit.client.0.smithi084.stdout:op 3055 completed, throughput=5MB/sec 2024-01-13T18:31:16.799 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DdV44gmNFdJ2apt off=820864 len=1689424 2024-01-13T18:31:16.801 INFO:tasks.workunit.client.0.smithi084.stdout:op 3056 completed, throughput=5MB/sec 2024-01-13T18:31:17.801 INFO:tasks.workunit.client.0.smithi084.stdout: 602: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:17.801 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DeV4rKO23QGoB32 off=11458223 len=413486 2024-01-13T18:31:17.802 INFO:tasks.workunit.client.0.smithi084.stdout:op 3057 completed, throughput=4.99MB/sec 2024-01-13T18:31:17.803 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zyNWhr2Yxaty3GL off=187522 len=1187172 2024-01-13T18:31:17.804 INFO:tasks.workunit.client.0.smithi084.stdout:op 3058 completed, throughput=5MB/sec 2024-01-13T18:31:17.804 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AS6xSkV4O7aE9bX off=199062 len=893952 2024-01-13T18:31:17.808 INFO:tasks.workunit.client.0.smithi084.stdout:op 3059 completed, throughput=5MB/sec 2024-01-13T18:31:17.809 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eDSnOrELwbr-dpC off=3098661 len=402999 2024-01-13T18:31:17.811 INFO:tasks.workunit.client.0.smithi084.stdout:op 3060 completed, throughput=5MB/sec 2024-01-13T18:31:17.811 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KDooV_I5GfWqaT- off=326176 len=1133016 2024-01-13T18:31:17.814 INFO:tasks.workunit.client.0.smithi084.stdout:op 3061 completed, throughput=5MB/sec 2024-01-13T18:31:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:17 smithi099 ceph-mon[138788]: pgmap v1784: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 3 op/s 2024-01-13T18:31:17.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:17 smithi084 ceph-mon[116404]: pgmap v1784: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 3 op/s 2024-01-13T18:31:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:17 smithi084 ceph-mon[119097]: pgmap v1784: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 3 op/s 2024-01-13T18:31:18.814 INFO:tasks.workunit.client.0.smithi084.stdout: 603: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:18.814 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-r9UnadMovCdyy3D off=12349449 len=672281 2024-01-13T18:31:18.816 INFO:tasks.workunit.client.0.smithi084.stdout:op 3062 completed, throughput=4.99MB/sec 2024-01-13T18:31:18.816 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bsRhAkBaSjcKaid off=8387715 len=1464729 2024-01-13T18:31:18.822 INFO:tasks.workunit.client.0.smithi084.stdout:op 3063 completed, throughput=5MB/sec 2024-01-13T18:31:18.822 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-C1TO3Dq2yo2Bsb9 off=17397151 len=2029542 2024-01-13T18:31:18.826 INFO:tasks.workunit.client.0.smithi084.stdout:op 3064 completed, throughput=5MB/sec 2024-01-13T18:31:18.826 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7WrGdVr3QLvttK8 off=18072986 len=1540654 2024-01-13T18:31:18.827 INFO:tasks.workunit.client.0.smithi084.stdout:op 3065 completed, throughput=5MB/sec 2024-01-13T18:31:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:19 smithi099 ceph-mon[138788]: pgmap v1785: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:31:19.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:19 smithi084 ceph-mon[116404]: pgmap v1785: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:31:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:19 smithi084 ceph-mon[119097]: pgmap v1785: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:31:19.828 INFO:tasks.workunit.client.0.smithi084.stdout: 604: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:19.828 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CEO9nfnTKwVD2Zz off=3394003 len=1752603 2024-01-13T18:31:19.830 INFO:tasks.workunit.client.0.smithi084.stdout:op 3066 completed, throughput=5MB/sec 2024-01-13T18:31:19.830 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TSuEvLljM_HAZjC off=4407801 len=1065427 2024-01-13T18:31:19.836 INFO:tasks.workunit.client.0.smithi084.stdout:op 3067 completed, throughput=5MB/sec 2024-01-13T18:31:19.836 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YVrZJJrHjBzMid9 off=5991379 len=681983 2024-01-13T18:31:19.840 INFO:tasks.workunit.client.0.smithi084.stdout:op 3068 completed, throughput=5MB/sec 2024-01-13T18:31:19.840 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ckn0qv2pAA9NiwT off=12688824 len=1241151 2024-01-13T18:31:19.845 INFO:tasks.workunit.client.0.smithi084.stdout:op 3069 completed, throughput=5MB/sec 2024-01-13T18:31:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:31:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:31:20] "GET /metrics HTTP/1.1" 200 33995 "" "Prometheus/2.43.0" 2024-01-13T18:31:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:20.845 INFO:tasks.workunit.client.0.smithi084.stdout: 605: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:20.845 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HV1WNV8OgMMoMA_ off=387475 len=1026089 2024-01-13T18:31:20.850 INFO:tasks.workunit.client.0.smithi084.stdout:op 3070 completed, throughput=4.99MB/sec 2024-01-13T18:31:20.850 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wDBz0vKvmtsHjEz off=16442184 len=292116 2024-01-13T18:31:20.853 INFO:tasks.workunit.client.0.smithi084.stdout:op 3071 completed, throughput=4.99MB/sec 2024-01-13T18:31:20.854 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RwIykHS4cFKaZ7y off=5080461 len=1205420 2024-01-13T18:31:20.858 INFO:tasks.workunit.client.0.smithi084.stdout:op 3072 completed, throughput=5MB/sec 2024-01-13T18:31:20.859 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pZfur_QoJnUCGF5 off=1148751 len=1772263 2024-01-13T18:31:20.866 INFO:tasks.workunit.client.0.smithi084.stdout:op 3073 completed, throughput=5MB/sec 2024-01-13T18:31:20.867 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-52_tQI43ojrDx6I off=8593359 len=1320883 2024-01-13T18:31:20.872 INFO:tasks.workunit.client.0.smithi084.stdout:op 3074 completed, throughput=5MB/sec 2024-01-13T18:31:21.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:21 smithi099 ceph-mon[138788]: pgmap v1786: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:31:21.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:21 smithi084 ceph-mon[116404]: pgmap v1786: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:31:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:21 smithi084 ceph-mon[119097]: pgmap v1786: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:31:21.873 INFO:tasks.workunit.client.0.smithi084.stdout: 606: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:21.873 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-niotNDEtkLKuJUq off=1147802 len=446806 2024-01-13T18:31:21.873 INFO:tasks.workunit.client.0.smithi084.stdout:op 3075 completed, throughput=4.99MB/sec 2024-01-13T18:31:21.874 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FY601McgoMT-6bN off=3289646 len=1201642 2024-01-13T18:31:21.879 INFO:tasks.workunit.client.0.smithi084.stdout:op 3076 completed, throughput=4.99MB/sec 2024-01-13T18:31:21.880 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8QjkkBJPgy1i6mj off=13807232 len=25432 2024-01-13T18:31:21.882 INFO:tasks.workunit.client.0.smithi084.stdout:op 3077 completed, throughput=4.99MB/sec 2024-01-13T18:31:21.882 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bmCBtrXi45Q7KHF off=572348 len=359783 2024-01-13T18:31:21.885 INFO:tasks.workunit.client.0.smithi084.stdout:op 3078 completed, throughput=5MB/sec 2024-01-13T18:31:21.885 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OAEO6LSERcfU6y8 off=12213924 len=225083 2024-01-13T18:31:21.887 INFO:tasks.workunit.client.0.smithi084.stdout:op 3079 completed, throughput=5MB/sec 2024-01-13T18:31:21.887 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zFxfDqy4ZUxrT5g off=8799829 len=322283 2024-01-13T18:31:21.889 INFO:tasks.workunit.client.0.smithi084.stdout:op 3080 completed, throughput=5MB/sec 2024-01-13T18:31:21.890 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KQ3ZTQBOGpWp7bU off=11259243 len=102909 2024-01-13T18:31:21.890 INFO:tasks.workunit.client.0.smithi084.stdout:op 3081 completed, throughput=5MB/sec 2024-01-13T18:31:21.890 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lU6elT-jH2HWQ-9 off=21660994 len=668334 2024-01-13T18:31:21.891 INFO:tasks.workunit.client.0.smithi084.stdout:op 3082 completed, throughput=5MB/sec 2024-01-13T18:31:21.891 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6n6yu3cbCV3T06r off=1642155 len=1735717 2024-01-13T18:31:21.900 INFO:tasks.workunit.client.0.smithi084.stdout:op 3083 completed, throughput=5MB/sec 2024-01-13T18:31:21.900 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QWlZ5B5-d5d0rgV off=17910371 len=1273854 2024-01-13T18:31:21.907 INFO:tasks.workunit.client.0.smithi084.stdout:op 3084 completed, throughput=5MB/sec 2024-01-13T18:31:22.907 INFO:tasks.workunit.client.0.smithi084.stdout: 607: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:22.908 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yPw0XViYltod056 off=15558905 len=1071970 2024-01-13T18:31:22.909 INFO:tasks.workunit.client.0.smithi084.stdout:op 3085 completed, throughput=5MB/sec 2024-01-13T18:31:22.909 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xRwolY99P1Q5-h4 off=7324120 len=1133192 2024-01-13T18:31:22.910 INFO:tasks.workunit.client.0.smithi084.stdout:op 3086 completed, throughput=5MB/sec 2024-01-13T18:31:22.910 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2ABSGaVTOx17InO off=6104997 len=111011 2024-01-13T18:31:22.911 INFO:tasks.workunit.client.0.smithi084.stdout:op 3087 completed, throughput=5MB/sec 2024-01-13T18:31:22.911 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FUcH-2rhK_rpDyr off=9058135 len=228965 2024-01-13T18:31:22.912 INFO:tasks.workunit.client.0.smithi084.stdout:op 3088 completed, throughput=5MB/sec 2024-01-13T18:31:22.912 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FOEchyPmaZtmd4L off=10177963 len=1357196 2024-01-13T18:31:22.926 INFO:tasks.workunit.client.0.smithi084.stdout:op 3089 completed, throughput=5MB/sec 2024-01-13T18:31:22.926 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sRASYoeoV-sp93R off=3064666 len=1932407 2024-01-13T18:31:22.936 INFO:tasks.workunit.client.0.smithi084.stdout:op 3090 completed, throughput=5MB/sec 2024-01-13T18:31:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:23 smithi099 ceph-mon[138788]: pgmap v1787: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:31:23.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:23 smithi084 ceph-mon[116404]: pgmap v1787: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:31:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:23 smithi084 ceph-mon[119097]: pgmap v1787: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:31:23.936 INFO:tasks.workunit.client.0.smithi084.stdout: 608: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:23.936 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rBTfAzuMlBHs8iY off=138492 len=1393178 2024-01-13T18:31:23.938 INFO:tasks.workunit.client.0.smithi084.stdout:op 3091 completed, throughput=5MB/sec 2024-01-13T18:31:23.938 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-r7dqYs7O5M4xceW off=6041139 len=874762 2024-01-13T18:31:23.939 INFO:tasks.workunit.client.0.smithi084.stdout:op 3092 completed, throughput=5MB/sec 2024-01-13T18:31:23.939 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n6ZWqKbWKzyudSO off=4159581 len=741766 2024-01-13T18:31:23.940 INFO:tasks.workunit.client.0.smithi084.stdout:op 3093 completed, throughput=5MB/sec 2024-01-13T18:31:23.940 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nT0D2aE8FzchJPm off=8181025 len=1923796 2024-01-13T18:31:23.951 INFO:tasks.workunit.client.0.smithi084.stdout:op 3094 completed, throughput=5MB/sec 2024-01-13T18:31:24.951 INFO:tasks.workunit.client.0.smithi084.stdout: 609: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:24.951 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-t5zCiJS3-C8tvEA off=7075411 len=1319985 2024-01-13T18:31:24.953 INFO:tasks.workunit.client.0.smithi084.stdout:op 3095 completed, throughput=5MB/sec 2024-01-13T18:31:24.953 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ayP2eQ9L9-g-sQl off=1523986 len=1328550 2024-01-13T18:31:24.958 INFO:tasks.workunit.client.0.smithi084.stdout:op 3096 completed, throughput=5MB/sec 2024-01-13T18:31:24.958 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r2_BtBeTleZAde1 off=17006720 len=1349751 2024-01-13T18:31:24.965 INFO:tasks.workunit.client.0.smithi084.stdout:op 3097 completed, throughput=5MB/sec 2024-01-13T18:31:24.965 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-p2gm2-blDVXHAb8 off=2576274 len=773600 2024-01-13T18:31:24.969 INFO:tasks.workunit.client.0.smithi084.stdout:op 3098 completed, throughput=5MB/sec 2024-01-13T18:31:25.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:25 smithi099 ceph-mon[138788]: pgmap v1788: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:31:25.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:25 smithi084 ceph-mon[116404]: pgmap v1788: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:31:25.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:25 smithi084 ceph-mon[119097]: pgmap v1788: 105 pgs: 105 active+clean; 128 GiB data, 8.7 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:31:25.969 INFO:tasks.workunit.client.0.smithi084.stdout: 610: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:25.969 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5W6GrI8JHID0e40 off=634494 len=235274 2024-01-13T18:31:25.973 INFO:tasks.workunit.client.0.smithi084.stdout:op 3099 completed, throughput=4.99MB/sec 2024-01-13T18:31:25.973 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2rABN9TfKGBMMQF off=1405800 len=541953 2024-01-13T18:31:25.974 INFO:tasks.workunit.client.0.smithi084.stdout:op 3100 completed, throughput=4.99MB/sec 2024-01-13T18:31:25.974 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LOrTOZmtAb4gra9 off=6238848 len=145431 2024-01-13T18:31:25.977 INFO:tasks.workunit.client.0.smithi084.stdout:op 3101 completed, throughput=4.99MB/sec 2024-01-13T18:31:25.977 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oKjrCix3U87QMIh off=10879170 len=1946139 2024-01-13T18:31:25.988 INFO:tasks.workunit.client.0.smithi084.stdout:op 3102 completed, throughput=5MB/sec 2024-01-13T18:31:25.988 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KChjLn0LZoQT1Iq off=2772019 len=224278 2024-01-13T18:31:25.991 INFO:tasks.workunit.client.0.smithi084.stdout:op 3103 completed, throughput=5MB/sec 2024-01-13T18:31:25.991 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_Gxe5J9AgLt-70w off=4833258 len=678053 2024-01-13T18:31:25.992 INFO:tasks.workunit.client.0.smithi084.stdout:op 3104 completed, throughput=5MB/sec 2024-01-13T18:31:25.992 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iDny0cQkkJHxwbt off=5384731 len=1758084 2024-01-13T18:31:25.993 INFO:tasks.workunit.client.0.smithi084.stdout:op 3105 completed, throughput=5MB/sec 2024-01-13T18:31:26.994 INFO:tasks.workunit.client.0.smithi084.stdout: 611: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:26.994 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AuJKyTyxG8j4eFT off=2196078 len=1619453 2024-01-13T18:31:26.995 INFO:tasks.workunit.client.0.smithi084.stdout:op 3106 completed, throughput=5MB/sec 2024-01-13T18:31:26.995 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nBIfNeqyOLHyVTr off=6700016 len=971971 2024-01-13T18:31:27.001 INFO:tasks.workunit.client.0.smithi084.stdout:op 3107 completed, throughput=5MB/sec 2024-01-13T18:31:27.001 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yJa-BcF80rXH9KN off=14468313 len=1963534 2024-01-13T18:31:27.005 INFO:tasks.workunit.client.0.smithi084.stdout:op 3108 completed, throughput=5MB/sec 2024-01-13T18:31:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:27 smithi099 ceph-mon[138788]: pgmap v1789: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:31:27.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:27 smithi084 ceph-mon[116404]: pgmap v1789: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:31:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:27 smithi084 ceph-mon[119097]: pgmap v1789: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:31:28.005 INFO:tasks.workunit.client.0.smithi084.stdout: 612: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:28.005 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Z7uqvcSg6ZNLWz6 off=1445748 len=1157388 2024-01-13T18:31:28.006 INFO:tasks.workunit.client.0.smithi084.stdout:op 3109 completed, throughput=4.99MB/sec 2024-01-13T18:31:28.006 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KrP8GtRUlL2XrPo off=4933095 len=441518 2024-01-13T18:31:28.007 INFO:tasks.workunit.client.0.smithi084.stdout:op 3110 completed, throughput=4.99MB/sec 2024-01-13T18:31:28.007 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-81lUMQyBfah-_1P off=4947056 len=386266 2024-01-13T18:31:28.008 INFO:tasks.workunit.client.0.smithi084.stdout:op 3111 completed, throughput=5MB/sec 2024-01-13T18:31:28.008 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MevqX2VwwGZPr1k off=4434646 len=136116 2024-01-13T18:31:28.010 INFO:tasks.workunit.client.0.smithi084.stdout:op 3112 completed, throughput=5MB/sec 2024-01-13T18:31:28.010 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7tzufNEPj3EuPV9 off=9125731 len=613278 2024-01-13T18:31:28.012 INFO:tasks.workunit.client.0.smithi084.stdout:op 3113 completed, throughput=5MB/sec 2024-01-13T18:31:28.013 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6q8meDAZMuKDhC4 off=23710 len=890820 2024-01-13T18:31:28.016 INFO:tasks.workunit.client.0.smithi084.stdout:op 3114 completed, throughput=5MB/sec 2024-01-13T18:31:28.016 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4ddvzrm-kWXMI9g off=4433231 len=551206 2024-01-13T18:31:28.019 INFO:tasks.workunit.client.0.smithi084.stdout:op 3115 completed, throughput=5MB/sec 2024-01-13T18:31:28.019 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ul9kYSLtn0YLiMx off=0 len=1664643 2024-01-13T18:31:28.026 INFO:tasks.workunit.client.0.smithi084.stdout:op 3116 completed, throughput=5MB/sec 2024-01-13T18:31:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:31:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:31:28.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:31:28.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:31:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:31:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:31:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:31:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:31:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:31:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:31:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:31:28.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:31:29.026 INFO:tasks.workunit.client.0.smithi084.stdout: 613: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:29.026 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-V7tG5ARgQ5gxPq1 off=7720608 len=1010396 2024-01-13T18:31:29.031 INFO:tasks.workunit.client.0.smithi084.stdout:op 3117 completed, throughput=4.99MB/sec 2024-01-13T18:31:29.031 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-P0ikFg0CPSL7BK9 off=12817313 len=1373081 2024-01-13T18:31:29.039 INFO:tasks.workunit.client.0.smithi084.stdout:op 3118 completed, throughput=5MB/sec 2024-01-13T18:31:29.039 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hpDHSkhaUk4kMfj off=0 len=2034790 2024-01-13T18:31:29.047 INFO:tasks.workunit.client.0.smithi084.stdout:op 3119 completed, throughput=5MB/sec 2024-01-13T18:31:29.047 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AGd8gegWNk3xUQM off=3054122 len=1859521 2024-01-13T18:31:29.048 INFO:tasks.workunit.client.0.smithi084.stdout:op 3120 completed, throughput=5MB/sec 2024-01-13T18:31:29.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:29 smithi099 ceph-mon[138788]: pgmap v1790: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:31:29.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:29 smithi084 ceph-mon[116404]: pgmap v1790: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:31:29.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:29 smithi084 ceph-mon[119097]: pgmap v1790: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:31:30.048 INFO:tasks.workunit.client.0.smithi084.stdout: 614: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:30.048 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SbHuzQA_7m9dlGg off=3844157 len=6410 2024-01-13T18:31:30.049 INFO:tasks.workunit.client.0.smithi084.stdout:op 3121 completed, throughput=4.99MB/sec 2024-01-13T18:31:30.049 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1Cow07E7_p7B889 off=6793396 len=1388156 2024-01-13T18:31:30.050 INFO:tasks.workunit.client.0.smithi084.stdout:op 3122 completed, throughput=5MB/sec 2024-01-13T18:31:30.051 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-D_ySiCvXO9OFajg off=6358918 len=1692644 2024-01-13T18:31:30.059 INFO:tasks.workunit.client.0.smithi084.stdout:op 3123 completed, throughput=5MB/sec 2024-01-13T18:31:30.059 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-D34gs1XeLdoca2S off=1052999 len=1517091 2024-01-13T18:31:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:op 3124 completed, throughput=5MB/sec 2024-01-13T18:31:30.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:31:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:31:30] "GET /metrics HTTP/1.1" 200 33995 "" "Prometheus/2.43.0" 2024-01-13T18:31:31.067 INFO:tasks.workunit.client.0.smithi084.stdout: 615: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:31.067 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JAGYE5jXOb-jJ3Q off=3338076 len=51212 2024-01-13T18:31:31.068 INFO:tasks.workunit.client.0.smithi084.stdout:op 3125 completed, throughput=4.99MB/sec 2024-01-13T18:31:31.068 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2E8RRyoPLMQQg6d off=1840327 len=234010 2024-01-13T18:31:31.068 INFO:tasks.workunit.client.0.smithi084.stdout:op 3126 completed, throughput=4.99MB/sec 2024-01-13T18:31:31.068 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7ZSgZ298gtm6HP2 off=6046160 len=932172 2024-01-13T18:31:31.073 INFO:tasks.workunit.client.0.smithi084.stdout:op 3127 completed, throughput=5MB/sec 2024-01-13T18:31:31.073 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1SCkbxuXd84PAhM off=839859 len=1360117 2024-01-13T18:31:31.079 INFO:tasks.workunit.client.0.smithi084.stdout:op 3128 completed, throughput=5MB/sec 2024-01-13T18:31:31.079 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pqgyEjW0GQehVl9 off=3503555 len=697182 2024-01-13T18:31:31.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 3129 completed, throughput=5MB/sec 2024-01-13T18:31:31.080 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9MT9QMMi2_Qtmk3 off=11856449 len=1648290 2024-01-13T18:31:31.083 INFO:tasks.workunit.client.0.smithi084.stdout:op 3130 completed, throughput=5MB/sec 2024-01-13T18:31:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:31 smithi099 ceph-mon[138788]: pgmap v1791: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:31:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:31 smithi084 ceph-mon[116404]: pgmap v1791: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:31:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:31 smithi084 ceph-mon[119097]: pgmap v1791: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:31:32.083 INFO:tasks.workunit.client.0.smithi084.stdout: 616: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:32.084 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8oaypU_vA3xi_44 off=5277145 len=2044186 2024-01-13T18:31:32.092 INFO:tasks.workunit.client.0.smithi084.stdout:op 3131 completed, throughput=5MB/sec 2024-01-13T18:31:32.093 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GIKi4vzc0hgH_z6 off=1199607 len=1997251 2024-01-13T18:31:32.104 INFO:tasks.workunit.client.0.smithi084.stdout:op 3132 completed, throughput=5MB/sec 2024-01-13T18:31:32.104 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-erJ9_48e960qWYu off=5667494 len=847316 2024-01-13T18:31:32.105 INFO:tasks.workunit.client.0.smithi084.stdout:op 3133 completed, throughput=5MB/sec 2024-01-13T18:31:32.105 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ADWNtYoZhppFnF0 off=9814845 len=991868 2024-01-13T18:31:32.106 INFO:tasks.workunit.client.0.smithi084.stdout:op 3134 completed, throughput=5MB/sec 2024-01-13T18:31:33.106 INFO:tasks.workunit.client.0.smithi084.stdout: 617: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:33.107 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bEPwmm54n3IB3Vj off=17815743 len=1164548 2024-01-13T18:31:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:op 3135 completed, throughput=5MB/sec 2024-01-13T18:31:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eG_mRiy4IJ0mhx2 off=9030160 len=665075 2024-01-13T18:31:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:op 3136 completed, throughput=5MB/sec 2024-01-13T18:31:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-inzpU7zWV-lfXyv off=1357876 len=1526968 2024-01-13T18:31:33.126 INFO:tasks.workunit.client.0.smithi084.stdout:op 3137 completed, throughput=5MB/sec 2024-01-13T18:31:33.126 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NcKXSGpmb5IBpEJ off=19320384 len=797598 2024-01-13T18:31:33.127 INFO:tasks.workunit.client.0.smithi084.stdout:op 3138 completed, throughput=5MB/sec 2024-01-13T18:31:33.127 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-E95cngg32aOtIg- off=4409252 len=1018004 2024-01-13T18:31:33.128 INFO:tasks.workunit.client.0.smithi084.stdout:op 3139 completed, throughput=5MB/sec 2024-01-13T18:31:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:33 smithi099 ceph-mon[138788]: pgmap v1792: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:31:33.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:33 smithi084 ceph-mon[116404]: pgmap v1792: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:31:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:33 smithi084 ceph-mon[119097]: pgmap v1792: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:31:34.129 INFO:tasks.workunit.client.0.smithi084.stdout: 618: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:34.129 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JenQnrsI9oC-ZOU off=22235471 len=1173929 2024-01-13T18:31:34.130 INFO:tasks.workunit.client.0.smithi084.stdout:op 3140 completed, throughput=4.99MB/sec 2024-01-13T18:31:34.130 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LIrKAF4Ebx3DWGS off=6850996 len=52998 2024-01-13T18:31:34.131 INFO:tasks.workunit.client.0.smithi084.stdout:op 3141 completed, throughput=4.99MB/sec 2024-01-13T18:31:34.131 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Y_TxJKnNhKMHum7 off=3181413 len=483351 2024-01-13T18:31:34.135 INFO:tasks.workunit.client.0.smithi084.stdout:op 3142 completed, throughput=5MB/sec 2024-01-13T18:31:34.135 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-t44qL2xtMvx9BgS off=13159609 len=940814 2024-01-13T18:31:34.136 INFO:tasks.workunit.client.0.smithi084.stdout:op 3143 completed, throughput=5MB/sec 2024-01-13T18:31:34.136 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DTYqUs2BQSbljfG off=6005241 len=1180222 2024-01-13T18:31:34.141 INFO:tasks.workunit.client.0.smithi084.stdout:op 3144 completed, throughput=5MB/sec 2024-01-13T18:31:34.141 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TbNOsaR0Gz-tkTM off=2113571 len=286296 2024-01-13T18:31:34.144 INFO:tasks.workunit.client.0.smithi084.stdout:op 3145 completed, throughput=5MB/sec 2024-01-13T18:31:34.144 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fs9LFf5Ulq5XBUb off=2976700 len=660889 2024-01-13T18:31:34.148 INFO:tasks.workunit.client.0.smithi084.stdout:op 3146 completed, throughput=5MB/sec 2024-01-13T18:31:35.148 INFO:tasks.workunit.client.0.smithi084.stdout: 619: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:35.148 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pgjnJkDsN6RLWwi off=13748460 len=329634 2024-01-13T18:31:35.151 INFO:tasks.workunit.client.0.smithi084.stdout:op 3147 completed, throughput=4.99MB/sec 2024-01-13T18:31:35.152 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7uyJ7UwHRn5RnM3 off=17444826 len=1432977 2024-01-13T18:31:35.161 INFO:tasks.workunit.client.0.smithi084.stdout:op 3148 completed, throughput=4.99MB/sec 2024-01-13T18:31:35.161 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8JeMWa9-gzi5OXT off=3339946 len=1165162 2024-01-13T18:31:35.166 INFO:tasks.workunit.client.0.smithi084.stdout:op 3149 completed, throughput=5MB/sec 2024-01-13T18:31:35.166 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-irY32jozodyL84h off=10822716 len=948175 2024-01-13T18:31:35.168 INFO:tasks.workunit.client.0.smithi084.stdout:op 3150 completed, throughput=5MB/sec 2024-01-13T18:31:35.168 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jQjpJcQ4i-NytFX off=1912920 len=1082781 2024-01-13T18:31:35.169 INFO:tasks.workunit.client.0.smithi084.stdout:op 3151 completed, throughput=5MB/sec 2024-01-13T18:31:35.169 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8mOvXxoQpRcrxiQ off=1732300 len=594588 2024-01-13T18:31:35.170 INFO:tasks.workunit.client.0.smithi084.stdout:op 3152 completed, throughput=5MB/sec 2024-01-13T18:31:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:35 smithi099 ceph-mon[138788]: pgmap v1793: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:31:35.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:35 smithi084 ceph-mon[116404]: pgmap v1793: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:31:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:35 smithi084 ceph-mon[119097]: pgmap v1793: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:31:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:36.171 INFO:tasks.workunit.client.0.smithi084.stdout: 620: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:36.171 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iEVe6X0KmUJpCWo off=2964987 len=3932 2024-01-13T18:31:36.171 INFO:tasks.workunit.client.0.smithi084.stdout:op 3153 completed, throughput=4.99MB/sec 2024-01-13T18:31:36.172 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7ulZfRdUMnaQizh off=9147396 len=861550 2024-01-13T18:31:36.176 INFO:tasks.workunit.client.0.smithi084.stdout:op 3154 completed, throughput=4.99MB/sec 2024-01-13T18:31:36.176 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V7ejpqR-QjuKEU6 off=672834 len=559787 2024-01-13T18:31:36.177 INFO:tasks.workunit.client.0.smithi084.stdout:op 3155 completed, throughput=4.99MB/sec 2024-01-13T18:31:36.177 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N3BDQHumir9eWNz off=3149278 len=416703 2024-01-13T18:31:36.178 INFO:tasks.workunit.client.0.smithi084.stdout:op 3156 completed, throughput=5MB/sec 2024-01-13T18:31:36.178 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BDpy2t1GjRcnuu3 off=2781608 len=657525 2024-01-13T18:31:36.183 INFO:tasks.workunit.client.0.smithi084.stdout:op 3157 completed, throughput=5MB/sec 2024-01-13T18:31:36.183 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PvuEG3i9ujgwRJo off=20111798 len=1517 2024-01-13T18:31:36.183 INFO:tasks.workunit.client.0.smithi084.stdout:op 3158 completed, throughput=5MB/sec 2024-01-13T18:31:36.183 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7yc_mNu4wegBwrh off=5216690 len=1613882 2024-01-13T18:31:36.190 INFO:tasks.workunit.client.0.smithi084.stdout:op 3159 completed, throughput=5MB/sec 2024-01-13T18:31:36.190 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3azoAm6BQYZJ_YW off=1767204 len=1962179 2024-01-13T18:31:36.191 INFO:tasks.workunit.client.0.smithi084.stdout:op 3160 completed, throughput=5MB/sec 2024-01-13T18:31:37.192 INFO:tasks.workunit.client.0.smithi084.stdout: 621: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:37.192 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-taIYNcmqHpnEpnS off=13405836 len=1193150 2024-01-13T18:31:37.200 INFO:tasks.workunit.client.0.smithi084.stdout:op 3161 completed, throughput=5MB/sec 2024-01-13T18:31:37.200 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-48dVWiTZToMbpY2 off=3630464 len=1605150 2024-01-13T18:31:37.202 INFO:tasks.workunit.client.0.smithi084.stdout:op 3162 completed, throughput=5MB/sec 2024-01-13T18:31:37.202 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8JeMWa9-gzi5OXT off=2037393 len=971225 2024-01-13T18:31:37.204 INFO:tasks.workunit.client.0.smithi084.stdout:op 3163 completed, throughput=5MB/sec 2024-01-13T18:31:37.204 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-04aeaoFCgpmkYqv off=1857161 len=575558 2024-01-13T18:31:37.205 INFO:tasks.workunit.client.0.smithi084.stdout:op 3164 completed, throughput=5MB/sec 2024-01-13T18:31:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:37 smithi099 ceph-mon[138788]: pgmap v1794: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:31:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:37 smithi084 ceph-mon[116404]: pgmap v1794: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:31:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:37 smithi084 ceph-mon[119097]: pgmap v1794: 105 pgs: 105 active+clean; 128 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:31:38.205 INFO:tasks.workunit.client.0.smithi084.stdout: 622: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:38.205 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6Ti_FP-2pSO_3ra off=363784 len=1992250 2024-01-13T18:31:38.215 INFO:tasks.workunit.client.0.smithi084.stdout:op 3165 completed, throughput=5MB/sec 2024-01-13T18:31:38.215 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PhMkh5krb-cihEC off=5513025 len=1251983 2024-01-13T18:31:38.217 INFO:tasks.workunit.client.0.smithi084.stdout:op 3166 completed, throughput=5MB/sec 2024-01-13T18:31:38.217 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PGJTgNawQakkOm1 off=5468790 len=1469585 2024-01-13T18:31:38.223 INFO:tasks.workunit.client.0.smithi084.stdout:op 3167 completed, throughput=5MB/sec 2024-01-13T18:31:38.224 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QwVwKihI-_yz1Gs off=5160355 len=831614 2024-01-13T18:31:38.224 INFO:tasks.workunit.client.0.smithi084.stdout:op 3168 completed, throughput=5MB/sec 2024-01-13T18:31:39.225 INFO:tasks.workunit.client.0.smithi084.stdout: 623: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:39.225 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DoLx4QvZsVcBZzu off=11084646 len=2011062 2024-01-13T18:31:39.234 INFO:tasks.workunit.client.0.smithi084.stdout:op 3169 completed, throughput=5MB/sec 2024-01-13T18:31:39.234 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OgapYDDT8ecblFi off=614959 len=1573491 2024-01-13T18:31:39.243 INFO:tasks.workunit.client.0.smithi084.stdout:op 3170 completed, throughput=5MB/sec 2024-01-13T18:31:39.244 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PbVLFf0nQAXq0Jc off=8808170 len=354333 2024-01-13T18:31:39.244 INFO:tasks.workunit.client.0.smithi084.stdout:op 3171 completed, throughput=5MB/sec 2024-01-13T18:31:39.244 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-94alKsr-g3UQDFJ off=4931122 len=1559034 2024-01-13T18:31:39.252 INFO:tasks.workunit.client.0.smithi084.stdout:op 3172 completed, throughput=5MB/sec 2024-01-13T18:31:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:39 smithi099 ceph-mon[138788]: pgmap v1795: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:31:39.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:39 smithi084 ceph-mon[119097]: pgmap v1795: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:31:39.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:39 smithi084 ceph-mon[116404]: pgmap v1795: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:31:40.252 INFO:tasks.workunit.client.0.smithi084.stdout: 624: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:40.252 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HDcXnee7CfDG9-Z off=12191173 len=1589823 2024-01-13T18:31:40.259 INFO:tasks.workunit.client.0.smithi084.stdout:op 3173 completed, throughput=5MB/sec 2024-01-13T18:31:40.259 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nBIfNeqyOLHyVTr off=4440616 len=1241851 2024-01-13T18:31:40.264 INFO:tasks.workunit.client.0.smithi084.stdout:op 3174 completed, throughput=5MB/sec 2024-01-13T18:31:40.264 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8-6iJlyrWVJJBdS off=2757330 len=478090 2024-01-13T18:31:40.265 INFO:tasks.workunit.client.0.smithi084.stdout:op 3175 completed, throughput=5MB/sec 2024-01-13T18:31:40.265 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vuPVdaFvjPATahy off=672835 len=467008 2024-01-13T18:31:40.266 INFO:tasks.workunit.client.0.smithi084.stdout:op 3176 completed, throughput=5MB/sec 2024-01-13T18:31:40.266 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4kSlpVxo-lk3K32 off=15992816 len=1622605 2024-01-13T18:31:40.268 INFO:tasks.workunit.client.0.smithi084.stdout:op 3177 completed, throughput=5MB/sec 2024-01-13T18:31:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:31:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:31:40] "GET /metrics HTTP/1.1" 200 33994 "" "Prometheus/2.43.0" 2024-01-13T18:31:41.268 INFO:tasks.workunit.client.0.smithi084.stdout: 625: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:41.268 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ODao6RNvm31f7gl off=15558733 len=1873823 2024-01-13T18:31:41.270 INFO:tasks.workunit.client.0.smithi084.stdout:op 3178 completed, throughput=5MB/sec 2024-01-13T18:31:41.270 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kVR_kh4u55e45Ez off=363855 len=551438 2024-01-13T18:31:41.271 INFO:tasks.workunit.client.0.smithi084.stdout:op 3179 completed, throughput=5MB/sec 2024-01-13T18:31:41.271 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gTDtyWMRyc9NSyF off=1606034 len=53564 2024-01-13T18:31:41.272 INFO:tasks.workunit.client.0.smithi084.stdout:op 3180 completed, throughput=5MB/sec 2024-01-13T18:31:41.272 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lR9slrk1Fwe2LtQ off=726913 len=1431261 2024-01-13T18:31:41.278 INFO:tasks.workunit.client.0.smithi084.stdout:op 3181 completed, throughput=5MB/sec 2024-01-13T18:31:41.278 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DokX2t9wu9NWep2 off=3031553 len=1535085 2024-01-13T18:31:41.280 INFO:tasks.workunit.client.0.smithi084.stdout:op 3182 completed, throughput=5MB/sec 2024-01-13T18:31:41.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:41 smithi099 ceph-mon[138788]: pgmap v1796: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:31:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:41 smithi084 ceph-mon[116404]: pgmap v1796: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:31:41.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:41 smithi084 ceph-mon[119097]: pgmap v1796: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:31:42.281 INFO:tasks.workunit.client.0.smithi084.stdout: 626: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:42.281 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ww1MWcd0vORPpzj off=160864 len=1120812 2024-01-13T18:31:42.283 INFO:tasks.workunit.client.0.smithi084.stdout:op 3183 completed, throughput=4.99MB/sec 2024-01-13T18:31:42.283 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x58Madu0DSXn14T off=12714764 len=812910 2024-01-13T18:31:42.287 INFO:tasks.workunit.client.0.smithi084.stdout:op 3184 completed, throughput=5MB/sec 2024-01-13T18:31:42.287 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JOOesPwpPMGiIyp off=6447105 len=258802 2024-01-13T18:31:42.288 INFO:tasks.workunit.client.0.smithi084.stdout:op 3185 completed, throughput=5MB/sec 2024-01-13T18:31:42.288 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BT5BvkGZNCAcKCC off=1412766 len=770451 2024-01-13T18:31:42.293 INFO:tasks.workunit.client.0.smithi084.stdout:op 3186 completed, throughput=5MB/sec 2024-01-13T18:31:42.293 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nmnm2DCJkvRoKNp off=7152177 len=1409212 2024-01-13T18:31:42.294 INFO:tasks.workunit.client.0.smithi084.stdout:op 3187 completed, throughput=5MB/sec 2024-01-13T18:31:42.294 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k7pWSFZH9dHF-tB off=5810919 len=698069 2024-01-13T18:31:42.299 INFO:tasks.workunit.client.0.smithi084.stdout:op 3188 completed, throughput=5MB/sec 2024-01-13T18:31:43.299 INFO:tasks.workunit.client.0.smithi084.stdout: 627: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:43.299 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ET1UbUvHZ3YfwAc off=13622047 len=1327143 2024-01-13T18:31:43.305 INFO:tasks.workunit.client.0.smithi084.stdout:op 3189 completed, throughput=4.99MB/sec 2024-01-13T18:31:43.305 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1oJaQ3DrrpfntpN off=16074745 len=946453 2024-01-13T18:31:43.309 INFO:tasks.workunit.client.0.smithi084.stdout:op 3190 completed, throughput=5MB/sec 2024-01-13T18:31:43.309 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nmQAQl0uGuc1oCF off=551180 len=1534180 2024-01-13T18:31:43.310 INFO:tasks.workunit.client.0.smithi084.stdout:op 3191 completed, throughput=5MB/sec 2024-01-13T18:31:43.310 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4fNU-HoEsf1l0vn off=1228661 len=261142 2024-01-13T18:31:43.311 INFO:tasks.workunit.client.0.smithi084.stdout:op 3192 completed, throughput=5MB/sec 2024-01-13T18:31:43.311 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8ZbEsHbkHEub-WT off=12904991 len=1529646 2024-01-13T18:31:43.318 INFO:tasks.workunit.client.0.smithi084.stdout:op 3193 completed, throughput=5MB/sec 2024-01-13T18:31:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:43 smithi099 ceph-mon[138788]: pgmap v1797: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:31:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:43 smithi084 ceph-mon[119097]: pgmap v1797: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:31:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:43 smithi084 ceph-mon[116404]: pgmap v1797: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:31:44.319 INFO:tasks.workunit.client.0.smithi084.stdout: 628: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:44.319 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-089zwiyYGkay45B off=17758431 len=1671917 2024-01-13T18:31:44.321 INFO:tasks.workunit.client.0.smithi084.stdout:op 3194 completed, throughput=5MB/sec 2024-01-13T18:31:44.321 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FPCovi3gxxsw-NK off=3971195 len=1332351 2024-01-13T18:31:44.328 INFO:tasks.workunit.client.0.smithi084.stdout:op 3195 completed, throughput=5MB/sec 2024-01-13T18:31:44.328 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZRKcGq53lbXoWo3 off=8166792 len=1982068 2024-01-13T18:31:44.330 INFO:tasks.workunit.client.0.smithi084.stdout:op 3196 completed, throughput=5MB/sec 2024-01-13T18:31:45.330 INFO:tasks.workunit.client.0.smithi084.stdout: 629: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:45.331 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5AiOXhHUKpGAyg9 off=87864 len=596593 2024-01-13T18:31:45.335 INFO:tasks.workunit.client.0.smithi084.stdout:op 3197 completed, throughput=4.99MB/sec 2024-01-13T18:31:45.335 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--vbf9_ahlazIPVb off=4029722 len=580769 2024-01-13T18:31:45.336 INFO:tasks.workunit.client.0.smithi084.stdout:op 3198 completed, throughput=4.99MB/sec 2024-01-13T18:31:45.336 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FHT3YffHZNumKxd off=828521 len=285537 2024-01-13T18:31:45.339 INFO:tasks.workunit.client.0.smithi084.stdout:op 3199 completed, throughput=4.99MB/sec 2024-01-13T18:31:45.340 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-evzMn69gZjiUXNY off=8801154 len=166650 2024-01-13T18:31:45.342 INFO:tasks.workunit.client.0.smithi084.stdout:op 3200 completed, throughput=4.99MB/sec 2024-01-13T18:31:45.342 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zyn_42heyTahu7a off=4811467 len=714913 2024-01-13T18:31:45.347 INFO:tasks.workunit.client.0.smithi084.stdout:op 3201 completed, throughput=5MB/sec 2024-01-13T18:31:45.347 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-elNrrlgWCWVQUiw off=279246 len=248838 2024-01-13T18:31:45.349 INFO:tasks.workunit.client.0.smithi084.stdout:op 3202 completed, throughput=5MB/sec 2024-01-13T18:31:45.349 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g04dm5rTM9tS5eF off=13691996 len=240430 2024-01-13T18:31:45.351 INFO:tasks.workunit.client.0.smithi084.stdout:op 3203 completed, throughput=5MB/sec 2024-01-13T18:31:45.351 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0WMVWnGRQ_a07Ba off=987431 len=581414 2024-01-13T18:31:45.353 INFO:tasks.workunit.client.0.smithi084.stdout:op 3204 completed, throughput=5MB/sec 2024-01-13T18:31:45.353 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0MXIRS5u6Wr8GLv off=8554851 len=991378 2024-01-13T18:31:45.359 INFO:tasks.workunit.client.0.smithi084.stdout:op 3205 completed, throughput=5MB/sec 2024-01-13T18:31:45.359 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HQgg2j16h8dLXLx off=13640157 len=1229836 2024-01-13T18:31:45.362 INFO:tasks.workunit.client.0.smithi084.stdout:op 3206 completed, throughput=5MB/sec 2024-01-13T18:31:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:45 smithi099 ceph-mon[138788]: pgmap v1798: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:45.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:45 smithi084 ceph-mon[116404]: pgmap v1798: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:45.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:45 smithi084 ceph-mon[119097]: pgmap v1798: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:46.362 INFO:tasks.workunit.client.0.smithi084.stdout: 630: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:46.362 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NDjSfnFznfQNmkC off=16642715 len=581113 2024-01-13T18:31:46.364 INFO:tasks.workunit.client.0.smithi084.stdout:op 3207 completed, throughput=4.99MB/sec 2024-01-13T18:31:46.364 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yCw7KsZLGBuTu7C off=895325 len=877516 2024-01-13T18:31:46.368 INFO:tasks.workunit.client.0.smithi084.stdout:op 3208 completed, throughput=5MB/sec 2024-01-13T18:31:46.369 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MHv0KVNT1d7562I off=10984380 len=546114 2024-01-13T18:31:46.370 INFO:tasks.workunit.client.0.smithi084.stdout:op 3209 completed, throughput=5MB/sec 2024-01-13T18:31:46.370 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PnpqcZRLVq12Ka7 off=1200761 len=53063 2024-01-13T18:31:46.372 INFO:tasks.workunit.client.0.smithi084.stdout:op 3210 completed, throughput=5MB/sec 2024-01-13T18:31:46.372 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OoGjwgGp9UbtkZJ off=16922521 len=2051005 2024-01-13T18:31:46.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 3211 completed, throughput=5MB/sec 2024-01-13T18:31:46.376 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f7KlW5CPcXuxAYE off=720911 len=1754170 2024-01-13T18:31:46.378 INFO:tasks.workunit.client.0.smithi084.stdout:op 3212 completed, throughput=5MB/sec 2024-01-13T18:31:47.378 INFO:tasks.workunit.client.0.smithi084.stdout: 631: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:47.378 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vzKwPTc2xdDrIwg off=736812 len=1808569 2024-01-13T18:31:47.380 INFO:tasks.workunit.client.0.smithi084.stdout:op 3213 completed, throughput=5MB/sec 2024-01-13T18:31:47.381 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-99kEvgbf3adF_Zt off=150722 len=1088860 2024-01-13T18:31:47.387 INFO:tasks.workunit.client.0.smithi084.stdout:op 3214 completed, throughput=5MB/sec 2024-01-13T18:31:47.387 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vdN3IbAv1ULkH2c off=9578053 len=378200 2024-01-13T18:31:47.388 INFO:tasks.workunit.client.0.smithi084.stdout:op 3215 completed, throughput=5MB/sec 2024-01-13T18:31:47.388 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4ZSCr7vt0Ok8elM off=7001244 len=880938 2024-01-13T18:31:47.393 INFO:tasks.workunit.client.0.smithi084.stdout:op 3216 completed, throughput=5MB/sec 2024-01-13T18:31:47.393 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-INNeWQTUwbJ9fjD off=12494804 len=1450143 2024-01-13T18:31:47.400 INFO:tasks.workunit.client.0.smithi084.stdout:op 3217 completed, throughput=5MB/sec 2024-01-13T18:31:47.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:47 smithi099 ceph-mon[138788]: pgmap v1799: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:47.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:47 smithi084 ceph-mon[116404]: pgmap v1799: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:47.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:47 smithi084 ceph-mon[119097]: pgmap v1799: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:48.401 INFO:tasks.workunit.client.0.smithi084.stdout: 632: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:48.401 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SS6TfeXPVwToJ45 off=18846304 len=54647 2024-01-13T18:31:48.401 INFO:tasks.workunit.client.0.smithi084.stdout:op 3218 completed, throughput=4.99MB/sec 2024-01-13T18:31:48.401 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nLsjV--yrX0pKmT off=639594 len=252403 2024-01-13T18:31:48.404 INFO:tasks.workunit.client.0.smithi084.stdout:op 3219 completed, throughput=4.99MB/sec 2024-01-13T18:31:48.404 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SbibxKs9vNdJVgn off=4868420 len=1342852 2024-01-13T18:31:48.411 INFO:tasks.workunit.client.0.smithi084.stdout:op 3220 completed, throughput=5MB/sec 2024-01-13T18:31:48.411 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rNNolup7pX0SuZe off=4653546 len=1151312 2024-01-13T18:31:48.417 INFO:tasks.workunit.client.0.smithi084.stdout:op 3221 completed, throughput=5MB/sec 2024-01-13T18:31:48.417 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-P9wnRSy4ZeOYD8Z off=7875578 len=431221 2024-01-13T18:31:48.417 INFO:tasks.workunit.client.0.smithi084.stdout:op 3222 completed, throughput=5MB/sec 2024-01-13T18:31:48.417 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tkFib_O4mJaIPqI off=1457320 len=971315 2024-01-13T18:31:48.423 INFO:tasks.workunit.client.0.smithi084.stdout:op 3223 completed, throughput=5MB/sec 2024-01-13T18:31:49.423 INFO:tasks.workunit.client.0.smithi084.stdout: 633: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:49.423 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Mi2SxtIuJM42ZoI off=2450236 len=1504292 2024-01-13T18:31:49.432 INFO:tasks.workunit.client.0.smithi084.stdout:op 3224 completed, throughput=4.99MB/sec 2024-01-13T18:31:49.432 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-F-hje3ZVxWE6Sin off=9145784 len=381839 2024-01-13T18:31:49.435 INFO:tasks.workunit.client.0.smithi084.stdout:op 3225 completed, throughput=5MB/sec 2024-01-13T18:31:49.436 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tkFib_O4mJaIPqI off=8874390 len=1355203 2024-01-13T18:31:49.442 INFO:tasks.workunit.client.0.smithi084.stdout:op 3226 completed, throughput=5MB/sec 2024-01-13T18:31:49.442 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1IV4X8z7jCWGbdj off=1560695 len=717210 2024-01-13T18:31:49.443 INFO:tasks.workunit.client.0.smithi084.stdout:op 3227 completed, throughput=5MB/sec 2024-01-13T18:31:49.443 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MpfvnCam0-iHxiJ off=6165627 len=1061260 2024-01-13T18:31:49.446 INFO:tasks.workunit.client.0.smithi084.stdout:op 3228 completed, throughput=5MB/sec 2024-01-13T18:31:49.446 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Q59VmPKb-jvkSAV off=9460281 len=334543 2024-01-13T18:31:49.447 INFO:tasks.workunit.client.0.smithi084.stdout:op 3229 completed, throughput=5MB/sec 2024-01-13T18:31:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:49 smithi099 ceph-mon[138788]: pgmap v1800: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:31:49.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:49 smithi084 ceph-mon[116404]: pgmap v1800: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:31:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:49 smithi084 ceph-mon[119097]: pgmap v1800: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:31:50.448 INFO:tasks.workunit.client.0.smithi084.stdout: 634: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:50.448 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5fInLT_RtxTR26G off=1307456 len=177597 2024-01-13T18:31:50.451 INFO:tasks.workunit.client.0.smithi084.stdout:op 3230 completed, throughput=4.99MB/sec 2024-01-13T18:31:50.451 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mlI-oI2Z6Dv16TJ off=15008633 len=1363338 2024-01-13T18:31:50.453 INFO:tasks.workunit.client.0.smithi084.stdout:op 3231 completed, throughput=4.99MB/sec 2024-01-13T18:31:50.453 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5700YyxYHH3xs8w off=5270533 len=1834638 2024-01-13T18:31:50.456 INFO:tasks.workunit.client.0.smithi084.stdout:op 3232 completed, throughput=5MB/sec 2024-01-13T18:31:50.457 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-txVjNmU2nReRL8E off=148132 len=855259 2024-01-13T18:31:50.461 INFO:tasks.workunit.client.0.smithi084.stdout:op 3233 completed, throughput=5MB/sec 2024-01-13T18:31:50.461 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vKD4PQ-H3agpECm off=7722296 len=1587124 2024-01-13T18:31:50.463 INFO:tasks.workunit.client.0.smithi084.stdout:op 3234 completed, throughput=5MB/sec 2024-01-13T18:31:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:50.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:31:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:31:50] "GET /metrics HTTP/1.1" 200 33994 "" "Prometheus/2.43.0" 2024-01-13T18:31:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:31:51.463 INFO:tasks.workunit.client.0.smithi084.stdout: 635: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:51.463 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LX7zfeX97J_ie5f off=14841280 len=1112651 2024-01-13T18:31:51.470 INFO:tasks.workunit.client.0.smithi084.stdout:op 3235 completed, throughput=4.99MB/sec 2024-01-13T18:31:51.470 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dEzftVXGKjQ8d5W off=5852069 len=1050222 2024-01-13T18:31:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:op 3236 completed, throughput=5MB/sec 2024-01-13T18:31:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pE4JFm92lqZ27To off=1017140 len=1346147 2024-01-13T18:31:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:op 3237 completed, throughput=5MB/sec 2024-01-13T18:31:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vyO_6YajXXtJdt_ off=11259478 len=2041331 2024-01-13T18:31:51.480 INFO:tasks.workunit.client.0.smithi084.stdout:op 3238 completed, throughput=5MB/sec 2024-01-13T18:31:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:51 smithi099 ceph-mon[138788]: pgmap v1801: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:51.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:51 smithi084 ceph-mon[116404]: pgmap v1801: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:51 smithi084 ceph-mon[119097]: pgmap v1801: 105 pgs: 105 active+clean; 128 GiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:52.480 INFO:tasks.workunit.client.0.smithi084.stdout: 636: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:52.480 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bFa31nqpDsPYjDK off=14705349 len=1372166 2024-01-13T18:31:52.488 INFO:tasks.workunit.client.0.smithi084.stdout:op 3239 completed, throughput=5MB/sec 2024-01-13T18:31:52.488 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9bOl1xlwKd8DLr5 off=2588750 len=23875 2024-01-13T18:31:52.490 INFO:tasks.workunit.client.0.smithi084.stdout:op 3240 completed, throughput=5MB/sec 2024-01-13T18:31:52.490 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-N351HXURXK67Fuq off=1832608 len=1394590 2024-01-13T18:31:52.496 INFO:tasks.workunit.client.0.smithi084.stdout:op 3241 completed, throughput=5MB/sec 2024-01-13T18:31:52.496 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-scSGXUgXP_1q4cg off=1054487 len=8554 2024-01-13T18:31:52.498 INFO:tasks.workunit.client.0.smithi084.stdout:op 3242 completed, throughput=5MB/sec 2024-01-13T18:31:52.498 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-292LSnzERiKxbZp off=4457471 len=1232950 2024-01-13T18:31:52.501 INFO:tasks.workunit.client.0.smithi084.stdout:op 3243 completed, throughput=5MB/sec 2024-01-13T18:31:52.501 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ac336FbAsyQVCVT off=4885972 len=1590377 2024-01-13T18:31:52.504 INFO:tasks.workunit.client.0.smithi084.stdout:op 3244 completed, throughput=5MB/sec 2024-01-13T18:31:53.504 INFO:tasks.workunit.client.0.smithi084.stdout: 637: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:53.505 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vDXarucRDwIBXm2 off=2733590 len=1578271 2024-01-13T18:31:53.514 INFO:tasks.workunit.client.0.smithi084.stdout:op 3245 completed, throughput=5MB/sec 2024-01-13T18:31:53.514 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7VM_Pq7IoIJVqMn off=10478834 len=1482365 2024-01-13T18:31:53.522 INFO:tasks.workunit.client.0.smithi084.stdout:op 3246 completed, throughput=5MB/sec 2024-01-13T18:31:53.522 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zMjSC2A2jfxlfau off=3257289 len=1362624 2024-01-13T18:31:53.523 INFO:tasks.workunit.client.0.smithi084.stdout:op 3247 completed, throughput=5MB/sec 2024-01-13T18:31:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:53 smithi099 ceph-mon[138788]: pgmap v1802: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:31:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:53 smithi084 ceph-mon[116404]: pgmap v1802: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:31:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:53 smithi084 ceph-mon[119097]: pgmap v1802: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:31:54.524 INFO:tasks.workunit.client.0.smithi084.stdout: 638: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:54.524 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Osqb2YCGEv12h8j off=7901962 len=715837 2024-01-13T18:31:54.525 INFO:tasks.workunit.client.0.smithi084.stdout:op 3248 completed, throughput=4.99MB/sec 2024-01-13T18:31:54.525 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FR8XP1Ek-tf5GND off=1023928 len=694568 2024-01-13T18:31:54.528 INFO:tasks.workunit.client.0.smithi084.stdout:op 3249 completed, throughput=4.99MB/sec 2024-01-13T18:31:54.529 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2XXORkqX4ltoC08 off=6727705 len=22223 2024-01-13T18:31:54.531 INFO:tasks.workunit.client.0.smithi084.stdout:op 3250 completed, throughput=4.99MB/sec 2024-01-13T18:31:54.531 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pLcCRWiMbn21bGj off=13649924 len=845471 2024-01-13T18:31:54.536 INFO:tasks.workunit.client.0.smithi084.stdout:op 3251 completed, throughput=5MB/sec 2024-01-13T18:31:54.536 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cwCUOumBW1lWz4c off=14472713 len=891517 2024-01-13T18:31:54.541 INFO:tasks.workunit.client.0.smithi084.stdout:op 3252 completed, throughput=5MB/sec 2024-01-13T18:31:54.541 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r3YNvXxctfnTmed off=12115434 len=2093752 2024-01-13T18:31:54.552 INFO:tasks.workunit.client.0.smithi084.stdout:op 3253 completed, throughput=5MB/sec 2024-01-13T18:31:55.552 INFO:tasks.workunit.client.0.smithi084.stdout: 639: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:55.553 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-arusVAybRQ2M_ai off=10878929 len=1515688 2024-01-13T18:31:55.555 INFO:tasks.workunit.client.0.smithi084.stdout:op 3254 completed, throughput=4.99MB/sec 2024-01-13T18:31:55.555 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-T2nojxIJljc7xOB off=9334483 len=528554 2024-01-13T18:31:55.555 INFO:tasks.workunit.client.0.smithi084.stdout:op 3255 completed, throughput=5MB/sec 2024-01-13T18:31:55.555 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jtSr8v6IdW7Sg3v off=17071162 len=132283 2024-01-13T18:31:55.556 INFO:tasks.workunit.client.0.smithi084.stdout:op 3256 completed, throughput=5MB/sec 2024-01-13T18:31:55.556 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zW75mJTXUdoRuHC off=210296 len=562030 2024-01-13T18:31:55.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 3257 completed, throughput=5MB/sec 2024-01-13T18:31:55.560 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RMsk7x9wLzSHCEI off=5403520 len=1286578 2024-01-13T18:31:55.565 INFO:tasks.workunit.client.0.smithi084.stdout:op 3258 completed, throughput=5MB/sec 2024-01-13T18:31:55.565 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-61cRUsuZHNmDGeD off=6958069 len=1023870 2024-01-13T18:31:55.571 INFO:tasks.workunit.client.0.smithi084.stdout:op 3259 completed, throughput=5MB/sec 2024-01-13T18:31:55.571 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AvHgpiwE0e9tamb off=23138712 len=629275 2024-01-13T18:31:55.572 INFO:tasks.workunit.client.0.smithi084.stdout:op 3260 completed, throughput=5MB/sec 2024-01-13T18:31:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:55 smithi099 ceph-mon[138788]: pgmap v1803: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:31:55.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:55 smithi084 ceph-mon[116404]: pgmap v1803: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:31:55.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:55 smithi084 ceph-mon[119097]: pgmap v1803: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:31:56.572 INFO:tasks.workunit.client.0.smithi084.stdout: 640: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:56.572 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2JmXA_IyPGGnhn5 off=3842414 len=1502271 2024-01-13T18:31:56.580 INFO:tasks.workunit.client.0.smithi084.stdout:op 3261 completed, throughput=4.99MB/sec 2024-01-13T18:31:56.580 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jXZPDf2A6Mi63Ql off=14291671 len=354345 2024-01-13T18:31:56.583 INFO:tasks.workunit.client.0.smithi084.stdout:op 3262 completed, throughput=5MB/sec 2024-01-13T18:31:56.584 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-csjlsMqe1gWN4pK off=20842850 len=707249 2024-01-13T18:31:56.588 INFO:tasks.workunit.client.0.smithi084.stdout:op 3263 completed, throughput=5MB/sec 2024-01-13T18:31:56.588 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gxI5Ojt6pOS_XZf off=17048580 len=244696 2024-01-13T18:31:56.588 INFO:tasks.workunit.client.0.smithi084.stdout:op 3264 completed, throughput=5MB/sec 2024-01-13T18:31:56.588 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zdoFyiin_MNhTQJ off=1428666 len=937376 2024-01-13T18:31:56.589 INFO:tasks.workunit.client.0.smithi084.stdout:op 3265 completed, throughput=5MB/sec 2024-01-13T18:31:56.589 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rP5pnEaprXGpsAx off=16637597 len=1306828 2024-01-13T18:31:56.590 INFO:tasks.workunit.client.0.smithi084.stdout:op 3266 completed, throughput=5MB/sec 2024-01-13T18:31:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: 641: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:57.591 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qcgtkP0mdQKV2FY off=3265361 len=423094 2024-01-13T18:31:57.594 INFO:tasks.workunit.client.0.smithi084.stdout:op 3267 completed, throughput=4.99MB/sec 2024-01-13T18:31:57.594 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mEwxs4Mz68MMKle off=134902 len=2069727 2024-01-13T18:31:57.596 INFO:tasks.workunit.client.0.smithi084.stdout:op 3268 completed, throughput=5MB/sec 2024-01-13T18:31:57.597 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SFpIsIQY4iVaN8Y off=788737 len=358519 2024-01-13T18:31:57.599 INFO:tasks.workunit.client.0.smithi084.stdout:op 3269 completed, throughput=5MB/sec 2024-01-13T18:31:57.599 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7hfwmfoanqrn0Cy off=3911302 len=129832 2024-01-13T18:31:57.600 INFO:tasks.workunit.client.0.smithi084.stdout:op 3270 completed, throughput=5MB/sec 2024-01-13T18:31:57.600 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yGs7AqXWTJsKZpw off=1994977 len=542326 2024-01-13T18:31:57.601 INFO:tasks.workunit.client.0.smithi084.stdout:op 3271 completed, throughput=5MB/sec 2024-01-13T18:31:57.601 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AUhax5ec6Q4gELt off=9793510 len=1571056 2024-01-13T18:31:57.603 INFO:tasks.workunit.client.0.smithi084.stdout:op 3272 completed, throughput=5MB/sec 2024-01-13T18:31:57.603 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VtFNfv7pt1FFBvk off=5087160 len=1996270 2024-01-13T18:31:57.604 INFO:tasks.workunit.client.0.smithi084.stdout:op 3273 completed, throughput=5MB/sec 2024-01-13T18:31:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:57 smithi099 ceph-mon[138788]: pgmap v1804: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:31:57.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:57 smithi084 ceph-mon[116404]: pgmap v1804: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:31:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:57 smithi084 ceph-mon[119097]: pgmap v1804: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:31:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: 642: throughput=5MB/sec pending data=0 2024-01-13T18:31:58.605 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rVLoCOQPWplZL_I off=7354570 len=1590922 2024-01-13T18:31:58.607 INFO:tasks.workunit.client.0.smithi084.stdout:op 3274 completed, throughput=5MB/sec 2024-01-13T18:31:58.607 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-g_TNfKhwmdFrVz0 off=1658448 len=438716 2024-01-13T18:31:58.611 INFO:tasks.workunit.client.0.smithi084.stdout:op 3275 completed, throughput=5MB/sec 2024-01-13T18:31:58.611 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sUWFXcloBokOENs off=2403516 len=772300 2024-01-13T18:31:58.615 INFO:tasks.workunit.client.0.smithi084.stdout:op 3276 completed, throughput=5MB/sec 2024-01-13T18:31:58.615 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4ZSCr7vt0Ok8elM off=6766691 len=1731300 2024-01-13T18:31:58.623 INFO:tasks.workunit.client.0.smithi084.stdout:op 3277 completed, throughput=5MB/sec 2024-01-13T18:31:59.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:31:59 smithi099 ceph-mon[138788]: pgmap v1805: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:59.623 INFO:tasks.workunit.client.0.smithi084.stdout: 643: throughput=4.99MB/sec pending data=0 2024-01-13T18:31:59.623 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-g0EdHgvax_9jT6q off=16424837 len=759279 2024-01-13T18:31:59.627 INFO:tasks.workunit.client.0.smithi084.stdout:op 3278 completed, throughput=4.99MB/sec 2024-01-13T18:31:59.627 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lAo21DpZs73-Yf0 off=1121655 len=781910 2024-01-13T18:31:59.633 INFO:tasks.workunit.client.0.smithi084.stdout:op 3279 completed, throughput=5MB/sec 2024-01-13T18:31:59.633 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-c7MdYatNHL7C3Dj off=6295415 len=912129 2024-01-13T18:31:59.637 INFO:tasks.workunit.client.0.smithi084.stdout:op 3280 completed, throughput=5MB/sec 2024-01-13T18:31:59.637 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HCbu8J5t_Vhgt0G off=9897360 len=1866278 2024-01-13T18:31:59.639 INFO:tasks.workunit.client.0.smithi084.stdout:op 3281 completed, throughput=5MB/sec 2024-01-13T18:31:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:31:59 smithi084 ceph-mon[116404]: pgmap v1805: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:31:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:31:59 smithi084 ceph-mon[119097]: pgmap v1805: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:32:00.639 INFO:tasks.workunit.client.0.smithi084.stdout: 644: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:00.639 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-95EGAeF4P71rLtC off=7816690 len=1042967 2024-01-13T18:32:00.644 INFO:tasks.workunit.client.0.smithi084.stdout:op 3282 completed, throughput=4.99MB/sec 2024-01-13T18:32:00.644 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y8WxeqLq3u4TjTl off=5840996 len=235342 2024-01-13T18:32:00.645 INFO:tasks.workunit.client.0.smithi084.stdout:op 3283 completed, throughput=4.99MB/sec 2024-01-13T18:32:00.645 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uYWrHcmeO7Hj_lJ off=18153873 len=817548 2024-01-13T18:32:00.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 3284 completed, throughput=5MB/sec 2024-01-13T18:32:00.646 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zrEIE3hxKmiXFXw off=4702035 len=853340 2024-01-13T18:32:00.647 INFO:tasks.workunit.client.0.smithi084.stdout:op 3285 completed, throughput=5MB/sec 2024-01-13T18:32:00.647 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zYDDlO2a_l1QyVR off=14315601 len=390652 2024-01-13T18:32:00.648 INFO:tasks.workunit.client.0.smithi084.stdout:op 3286 completed, throughput=5MB/sec 2024-01-13T18:32:00.648 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ka-9_OhV1JR8yIh off=12627778 len=1532754 2024-01-13T18:32:00.656 INFO:tasks.workunit.client.0.smithi084.stdout:op 3287 completed, throughput=5MB/sec 2024-01-13T18:32:00.657 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--fXzU93CTVcFpyJ off=7341497 len=1089156 2024-01-13T18:32:00.657 INFO:tasks.workunit.client.0.smithi084.stdout:op 3288 completed, throughput=5MB/sec 2024-01-13T18:32:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:32:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:32:00] "GET /metrics HTTP/1.1" 200 33994 "" "Prometheus/2.43.0" 2024-01-13T18:32:01.658 INFO:tasks.workunit.client.0.smithi084.stdout: 645: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:01.658 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-o3QUg5ZPAG8gEQo off=6284904 len=1278059 2024-01-13T18:32:01.660 INFO:tasks.workunit.client.0.smithi084.stdout:op 3289 completed, throughput=5MB/sec 2024-01-13T18:32:01.661 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ElE7wfpge3F-eZp off=19295951 len=530436 2024-01-13T18:32:01.665 INFO:tasks.workunit.client.0.smithi084.stdout:op 3290 completed, throughput=5MB/sec 2024-01-13T18:32:01.665 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uw_zDTT2LqUOMEL off=6804021 len=1154060 2024-01-13T18:32:01.670 INFO:tasks.workunit.client.0.smithi084.stdout:op 3291 completed, throughput=5MB/sec 2024-01-13T18:32:01.671 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-s8zdyRl1zEf_UyT off=929504 len=1524219 2024-01-13T18:32:01.678 INFO:tasks.workunit.client.0.smithi084.stdout:op 3292 completed, throughput=5MB/sec 2024-01-13T18:32:01.678 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VN-7ow-5sn9eAmg off=22824751 len=1683274 2024-01-13T18:32:01.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 3293 completed, throughput=5MB/sec 2024-01-13T18:32:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:01 smithi099 ceph-mon[138788]: pgmap v1806: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:32:01.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:01 smithi084 ceph-mon[116404]: pgmap v1806: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:32:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:01 smithi084 ceph-mon[119097]: pgmap v1806: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:32:02.680 INFO:tasks.workunit.client.0.smithi084.stdout: 646: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:02.680 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3ZiIk7Gj1tQtNhX off=16926564 len=154370 2024-01-13T18:32:02.681 INFO:tasks.workunit.client.0.smithi084.stdout:op 3294 completed, throughput=4.99MB/sec 2024-01-13T18:32:02.681 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ADGyO7lZdSWaCzn off=3405504 len=765193 2024-01-13T18:32:02.682 INFO:tasks.workunit.client.0.smithi084.stdout:op 3295 completed, throughput=5MB/sec 2024-01-13T18:32:02.682 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lpGmZF-ee7U4fAs off=14606969 len=1472119 2024-01-13T18:32:02.691 INFO:tasks.workunit.client.0.smithi084.stdout:op 3296 completed, throughput=5MB/sec 2024-01-13T18:32:02.691 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-C7a9SGB99aaFvMk off=6582724 len=1499696 2024-01-13T18:32:02.699 INFO:tasks.workunit.client.0.smithi084.stdout:op 3297 completed, throughput=5MB/sec 2024-01-13T18:32:03.699 INFO:tasks.workunit.client.0.smithi084.stdout: 647: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:03.699 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9pGxShkCTriFzSo off=7706781 len=1102659 2024-01-13T18:32:03.701 INFO:tasks.workunit.client.0.smithi084.stdout:op 3298 completed, throughput=4.99MB/sec 2024-01-13T18:32:03.701 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6SAVxcyTkG78scI off=3255035 len=1858272 2024-01-13T18:32:03.711 INFO:tasks.workunit.client.0.smithi084.stdout:op 3299 completed, throughput=5MB/sec 2024-01-13T18:32:03.711 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zcUb5CiDA2Jsjg5 off=5632031 len=1581882 2024-01-13T18:32:03.719 INFO:tasks.workunit.client.0.smithi084.stdout:op 3300 completed, throughput=5MB/sec 2024-01-13T18:32:03.719 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lokuTA2EJ5BLkhr off=9873961 len=1921215 2024-01-13T18:32:03.721 INFO:tasks.workunit.client.0.smithi084.stdout:op 3301 completed, throughput=5MB/sec 2024-01-13T18:32:03.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:03 smithi099 ceph-mon[138788]: pgmap v1807: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:32:03.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:03 smithi084 ceph-mon[116404]: pgmap v1807: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:32:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:03 smithi084 ceph-mon[119097]: pgmap v1807: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:32:04.722 INFO:tasks.workunit.client.0.smithi084.stdout: 648: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:04.722 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-R5yPzGWFkQ-N9qp off=2069725 len=805236 2024-01-13T18:32:04.723 INFO:tasks.workunit.client.0.smithi084.stdout:op 3302 completed, throughput=5MB/sec 2024-01-13T18:32:04.723 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NqX4dvUwDbQ4dlI off=3769703 len=495119 2024-01-13T18:32:04.724 INFO:tasks.workunit.client.0.smithi084.stdout:op 3303 completed, throughput=5MB/sec 2024-01-13T18:32:04.724 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-C31WhY9bKDbyGxB off=2983180 len=910555 2024-01-13T18:32:04.725 INFO:tasks.workunit.client.0.smithi084.stdout:op 3304 completed, throughput=5MB/sec 2024-01-13T18:32:04.725 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Bza_E_D4Y0TVN5Q off=5906980 len=1567681 2024-01-13T18:32:04.731 INFO:tasks.workunit.client.0.smithi084.stdout:op 3305 completed, throughput=5MB/sec 2024-01-13T18:32:04.731 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lYk3q3UR02kTniI off=456830 len=645758 2024-01-13T18:32:04.735 INFO:tasks.workunit.client.0.smithi084.stdout:op 3306 completed, throughput=5MB/sec 2024-01-13T18:32:05.735 INFO:tasks.workunit.client.0.smithi084.stdout: 649: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:05.736 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_w85zH9Pp5Dw3MZ off=1327020 len=1921387 2024-01-13T18:32:05.739 INFO:tasks.workunit.client.0.smithi084.stdout:op 3307 completed, throughput=5MB/sec 2024-01-13T18:32:05.739 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rlVxI-qw0-YhbY3 off=3398354 len=231476 2024-01-13T18:32:05.742 INFO:tasks.workunit.client.0.smithi084.stdout:op 3308 completed, throughput=5MB/sec 2024-01-13T18:32:05.742 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aQBNo5a131uq--L off=9115911 len=1170994 2024-01-13T18:32:05.743 INFO:tasks.workunit.client.0.smithi084.stdout:op 3309 completed, throughput=5MB/sec 2024-01-13T18:32:05.744 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0bT5T3TiujzHOky off=1740486 len=399785 2024-01-13T18:32:05.745 INFO:tasks.workunit.client.0.smithi084.stdout:op 3310 completed, throughput=5MB/sec 2024-01-13T18:32:05.745 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Hzcd64NpykzHY-M off=7560333 len=1244638 2024-01-13T18:32:05.747 INFO:tasks.workunit.client.0.smithi084.stdout:op 3311 completed, throughput=5MB/sec 2024-01-13T18:32:05.748 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y12FSR-al7kGcHu off=6580412 len=1950850 2024-01-13T18:32:05.756 INFO:tasks.workunit.client.0.smithi084.stdout:op 3312 completed, throughput=5MB/sec 2024-01-13T18:32:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:05 smithi099 ceph-mon[138788]: pgmap v1808: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:32:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:05 smithi084 ceph-mon[116404]: pgmap v1808: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:32:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:05 smithi084 ceph-mon[119097]: pgmap v1808: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:32:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:06.757 INFO:tasks.workunit.client.0.smithi084.stdout: 650: throughput=5MB/sec pending data=0 2024-01-13T18:32:06.757 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oKjrCix3U87QMIh off=15671949 len=969279 2024-01-13T18:32:06.758 INFO:tasks.workunit.client.0.smithi084.stdout:op 3313 completed, throughput=5MB/sec 2024-01-13T18:32:06.758 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-d3xv-N093X3YOYn off=0 len=1358367 2024-01-13T18:32:06.765 INFO:tasks.workunit.client.0.smithi084.stdout:op 3314 completed, throughput=5MB/sec 2024-01-13T18:32:06.765 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jJ8Yje8wYym6D8c off=3854824 len=794396 2024-01-13T18:32:06.770 INFO:tasks.workunit.client.0.smithi084.stdout:op 3315 completed, throughput=5MB/sec 2024-01-13T18:32:06.770 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yvuSnL48EvaIo2- off=2410233 len=438272 2024-01-13T18:32:06.771 INFO:tasks.workunit.client.0.smithi084.stdout:op 3316 completed, throughput=5MB/sec 2024-01-13T18:32:07.771 INFO:tasks.workunit.client.0.smithi084.stdout: 651: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:07.771 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Q7DFRvg98xLimGd off=5743154 len=1561487 2024-01-13T18:32:07.779 INFO:tasks.workunit.client.0.smithi084.stdout:op 3317 completed, throughput=4.99MB/sec 2024-01-13T18:32:07.780 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Mw8VCZ9n3qVFO9n off=11222650 len=809804 2024-01-13T18:32:07.783 INFO:tasks.workunit.client.0.smithi084.stdout:op 3318 completed, throughput=5MB/sec 2024-01-13T18:32:07.783 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iQEvuFjCN9M7X2R off=192897 len=1894913 2024-01-13T18:32:07.793 INFO:tasks.workunit.client.0.smithi084.stdout:op 3319 completed, throughput=5MB/sec 2024-01-13T18:32:07.793 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0dBvBwremGQ-1C- off=17570554 len=8361 2024-01-13T18:32:07.794 INFO:tasks.workunit.client.0.smithi084.stdout:op 3320 completed, throughput=5MB/sec 2024-01-13T18:32:07.794 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tPhGjp9jsPo8Shv off=12881929 len=423767 2024-01-13T18:32:07.794 INFO:tasks.workunit.client.0.smithi084.stdout:op 3321 completed, throughput=5MB/sec 2024-01-13T18:32:07.795 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kAwkmAgPwEFmBAB off=12575431 len=1179178 2024-01-13T18:32:07.796 INFO:tasks.workunit.client.0.smithi084.stdout:op 3322 completed, throughput=5MB/sec 2024-01-13T18:32:07.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:07 smithi099 ceph-mon[138788]: pgmap v1809: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:32:07.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:07 smithi084 ceph-mon[116404]: pgmap v1809: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:32:07.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:07 smithi084 ceph-mon[119097]: pgmap v1809: 105 pgs: 105 active+clean; 128 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:32:08.796 INFO:tasks.workunit.client.0.smithi084.stdout: 652: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:08.796 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IkVxxkiP2H9jVsR off=14912435 len=1994561 2024-01-13T18:32:08.798 INFO:tasks.workunit.client.0.smithi084.stdout:op 3323 completed, throughput=5MB/sec 2024-01-13T18:32:08.799 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qk6MSBG5uZwaWMe off=6816397 len=721991 2024-01-13T18:32:08.803 INFO:tasks.workunit.client.0.smithi084.stdout:op 3324 completed, throughput=5MB/sec 2024-01-13T18:32:08.803 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3o9wkNTGdbKXxiB off=16385065 len=1082691 2024-01-13T18:32:08.808 INFO:tasks.workunit.client.0.smithi084.stdout:op 3325 completed, throughput=5MB/sec 2024-01-13T18:32:08.808 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-frKiY-ILmYqbHnK off=1178076 len=1666356 2024-01-13T18:32:08.816 INFO:tasks.workunit.client.0.smithi084.stdout:op 3326 completed, throughput=5MB/sec 2024-01-13T18:32:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:09 smithi099 ceph-mon[138788]: pgmap v1810: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:32:09.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:09 smithi084 ceph-mon[116404]: pgmap v1810: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:32:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:09 smithi084 ceph-mon[119097]: pgmap v1810: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:32:09.816 INFO:tasks.workunit.client.0.smithi084.stdout: 653: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:09.816 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3p4IwVfMCi5e0eA off=981161 len=1518867 2024-01-13T18:32:09.819 INFO:tasks.workunit.client.0.smithi084.stdout:op 3327 completed, throughput=5MB/sec 2024-01-13T18:32:09.819 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OgEu7lyO3nQja2K off=262327 len=1013480 2024-01-13T18:32:09.826 INFO:tasks.workunit.client.0.smithi084.stdout:op 3328 completed, throughput=5MB/sec 2024-01-13T18:32:09.826 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nFsXxd1GetyhuV8 off=9640854 len=1884782 2024-01-13T18:32:09.836 INFO:tasks.workunit.client.0.smithi084.stdout:op 3329 completed, throughput=5MB/sec 2024-01-13T18:32:09.836 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_RoFcMwMF6T_kwQ off=6928857 len=1203548 2024-01-13T18:32:09.838 INFO:tasks.workunit.client.0.smithi084.stdout:op 3330 completed, throughput=5MB/sec 2024-01-13T18:32:10.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:32:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:32:10] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:32:10.839 INFO:tasks.workunit.client.0.smithi084.stdout: 654: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:10.839 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Xps_EsS3q7H3jyj off=20819543 len=801216 2024-01-13T18:32:10.843 INFO:tasks.workunit.client.0.smithi084.stdout:op 3331 completed, throughput=4.99MB/sec 2024-01-13T18:32:10.843 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uic9Z_syxd-P4YW off=15551533 len=1113137 2024-01-13T18:32:10.845 INFO:tasks.workunit.client.0.smithi084.stdout:op 3332 completed, throughput=5MB/sec 2024-01-13T18:32:10.845 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DNPCXL-wEPyy8Vj off=11499062 len=334644 2024-01-13T18:32:10.845 INFO:tasks.workunit.client.0.smithi084.stdout:op 3333 completed, throughput=5MB/sec 2024-01-13T18:32:10.846 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UcE2K0OpP2RgOss off=1606381 len=1852500 2024-01-13T18:32:10.848 INFO:tasks.workunit.client.0.smithi084.stdout:op 3334 completed, throughput=5MB/sec 2024-01-13T18:32:10.848 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HXsrxlLWcVIiDCD off=7006543 len=1510776 2024-01-13T18:32:10.855 INFO:tasks.workunit.client.0.smithi084.stdout:op 3335 completed, throughput=5MB/sec 2024-01-13T18:32:11.855 INFO:tasks.workunit.client.0.smithi084.stdout: 655: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:11.856 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_E89rrE00bxldEQ off=1991157 len=1931875 2024-01-13T18:32:11.859 INFO:tasks.workunit.client.0.smithi084.stdout:op 3336 completed, throughput=5MB/sec 2024-01-13T18:32:11.859 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-T_IX7ut85lFwP3K off=6616650 len=202709 2024-01-13T18:32:11.862 INFO:tasks.workunit.client.0.smithi084.stdout:op 3337 completed, throughput=5MB/sec 2024-01-13T18:32:11.863 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DgQvfKhu4ZLjB4q off=10157376 len=1393874 2024-01-13T18:32:11.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:11 smithi099 ceph-mon[138788]: pgmap v1811: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:32:11.870 INFO:tasks.workunit.client.0.smithi084.stdout:op 3338 completed, throughput=5MB/sec 2024-01-13T18:32:11.870 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AubXfdbnvKMvgUP off=6405382 len=2011819 2024-01-13T18:32:11.878 INFO:tasks.workunit.client.0.smithi084.stdout:op 3339 completed, throughput=5MB/sec 2024-01-13T18:32:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:11 smithi084 ceph-mon[116404]: pgmap v1811: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:32:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:11 smithi084 ceph-mon[119097]: pgmap v1811: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:32:12.879 INFO:tasks.workunit.client.0.smithi084.stdout: 656: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:12.879 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-h-UvQEtidUAhtNl off=3486326 len=1553569 2024-01-13T18:32:12.881 INFO:tasks.workunit.client.0.smithi084.stdout:op 3340 completed, throughput=5MB/sec 2024-01-13T18:32:12.881 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-curwM4UIyNvtdnr off=10255790 len=967021 2024-01-13T18:32:12.881 INFO:tasks.workunit.client.0.smithi084.stdout:op 3341 completed, throughput=5MB/sec 2024-01-13T18:32:12.882 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qb_EjKcYdwzzIqA off=19184119 len=140012 2024-01-13T18:32:12.882 INFO:tasks.workunit.client.0.smithi084.stdout:op 3342 completed, throughput=5MB/sec 2024-01-13T18:32:12.882 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1cNNVRhTGD8Ha1o off=4089936 len=1234766 2024-01-13T18:32:12.883 INFO:tasks.workunit.client.0.smithi084.stdout:op 3343 completed, throughput=5MB/sec 2024-01-13T18:32:12.884 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-m5YwGEODxuFYf59 off=10873192 len=1829004 2024-01-13T18:32:12.894 INFO:tasks.workunit.client.0.smithi084.stdout:op 3344 completed, throughput=5MB/sec 2024-01-13T18:32:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:13 smithi099 ceph-mon[138788]: pgmap v1812: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:13.895 INFO:tasks.workunit.client.0.smithi084.stdout: 657: throughput=5MB/sec pending data=0 2024-01-13T18:32:13.895 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AkXRNTeuLQId9-C off=17231278 len=1476630 2024-01-13T18:32:13.902 INFO:tasks.workunit.client.0.smithi084.stdout:op 3345 completed, throughput=5MB/sec 2024-01-13T18:32:13.902 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n7qprjHnPhqIJ9Y off=612833 len=1730414 2024-01-13T18:32:13.910 INFO:tasks.workunit.client.0.smithi084.stdout:op 3346 completed, throughput=5MB/sec 2024-01-13T18:32:13.910 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XFS9_yQIteFpDoN off=694177 len=1344370 2024-01-13T18:32:13.917 INFO:tasks.workunit.client.0.smithi084.stdout:op 3347 completed, throughput=5MB/sec 2024-01-13T18:32:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:13 smithi084 ceph-mon[116404]: pgmap v1812: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:13 smithi084 ceph-mon[119097]: pgmap v1812: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:14.918 INFO:tasks.workunit.client.0.smithi084.stdout: 658: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:14.970 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Xojy7HlNr6tF1ET off=6439236 len=380426 2024-01-13T18:32:14.971 INFO:tasks.workunit.client.0.smithi084.stdout:op 3348 completed, throughput=4.99MB/sec 2024-01-13T18:32:14.971 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6I5U0LHBXvCK5s_ off=14926365 len=1788935 2024-01-13T18:32:14.971 INFO:tasks.workunit.client.0.smithi084.stdout:op 3349 completed, throughput=5MB/sec 2024-01-13T18:32:14.971 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lhfi0lH6ZSrhNli off=4727634 len=1311613 2024-01-13T18:32:14.971 INFO:tasks.workunit.client.0.smithi084.stdout:op 3350 completed, throughput=5MB/sec 2024-01-13T18:32:14.972 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TP2MG9DwPUKW1-x off=12603698 len=1926172 2024-01-13T18:32:14.972 INFO:tasks.workunit.client.0.smithi084.stdout:op 3351 completed, throughput=5MB/sec 2024-01-13T18:32:15.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:15 smithi099 ceph-mon[138788]: pgmap v1813: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:15.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:15 smithi084 ceph-mon[116404]: pgmap v1813: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:15.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:15 smithi084 ceph-mon[119097]: pgmap v1813: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:15.934 INFO:tasks.workunit.client.0.smithi084.stdout: 659: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:15.935 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MdGahmRe3BKQUIi off=1106699 len=1867274 2024-01-13T18:32:15.945 INFO:tasks.workunit.client.0.smithi084.stdout:op 3352 completed, throughput=5MB/sec 2024-01-13T18:32:15.945 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UNVQMeZGthW5fux off=13142867 len=1924210 2024-01-13T18:32:15.952 INFO:tasks.workunit.client.0.smithi084.stdout:op 3353 completed, throughput=5MB/sec 2024-01-13T18:32:15.952 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jAffllu128q_alL off=6937016 len=471850 2024-01-13T18:32:15.954 INFO:tasks.workunit.client.0.smithi084.stdout:op 3354 completed, throughput=5MB/sec 2024-01-13T18:32:15.954 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Qv4jETdPC0e66JA off=13232659 len=462287 2024-01-13T18:32:15.954 INFO:tasks.workunit.client.0.smithi084.stdout:op 3355 completed, throughput=5MB/sec 2024-01-13T18:32:16.955 INFO:tasks.workunit.client.0.smithi084.stdout: 660: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:16.955 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rvswbjoZe1oaa8n off=4718901 len=1132047 2024-01-13T18:32:16.956 INFO:tasks.workunit.client.0.smithi084.stdout:op 3356 completed, throughput=4.99MB/sec 2024-01-13T18:32:16.956 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-679SbROTVa8L-Wr off=7048918 len=2094098 2024-01-13T18:32:16.961 INFO:tasks.workunit.client.0.smithi084.stdout:op 3357 completed, throughput=5MB/sec 2024-01-13T18:32:16.961 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2qg25svSln8rOkF off=17340010 len=581337 2024-01-13T18:32:16.965 INFO:tasks.workunit.client.0.smithi084.stdout:op 3358 completed, throughput=5MB/sec 2024-01-13T18:32:16.966 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lw6bh8IlW7wa0yN off=20469919 len=915270 2024-01-13T18:32:16.967 INFO:tasks.workunit.client.0.smithi084.stdout:op 3359 completed, throughput=5MB/sec 2024-01-13T18:32:16.967 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Mh_j2OP4BxkWi9b off=1288209 len=268735 2024-01-13T18:32:16.967 INFO:tasks.workunit.client.0.smithi084.stdout:op 3360 completed, throughput=5MB/sec 2024-01-13T18:32:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:17 smithi099 ceph-mon[138788]: pgmap v1814: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:17.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:17 smithi084 ceph-mon[116404]: pgmap v1814: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:17.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:17 smithi084 ceph-mon[119097]: pgmap v1814: 105 pgs: 105 active+clean; 128 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:17.968 INFO:tasks.workunit.client.0.smithi084.stdout: 661: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:17.968 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lokuTA2EJ5BLkhr off=1688142 len=1944341 2024-01-13T18:32:17.977 INFO:tasks.workunit.client.0.smithi084.stdout:op 3361 completed, throughput=5MB/sec 2024-01-13T18:32:17.977 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lN1VJW83RIkzjEe off=16232194 len=111157 2024-01-13T18:32:17.977 INFO:tasks.workunit.client.0.smithi084.stdout:op 3362 completed, throughput=5MB/sec 2024-01-13T18:32:17.977 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-buH35oSINVMrbAy off=7862471 len=764888 2024-01-13T18:32:17.981 INFO:tasks.workunit.client.0.smithi084.stdout:op 3363 completed, throughput=5MB/sec 2024-01-13T18:32:17.982 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sgM-kw4dwlKecyU off=11282811 len=554401 2024-01-13T18:32:17.986 INFO:tasks.workunit.client.0.smithi084.stdout:op 3364 completed, throughput=5MB/sec 2024-01-13T18:32:17.986 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zQGrny3rcWBvQZW off=4500494 len=832592 2024-01-13T18:32:17.987 INFO:tasks.workunit.client.0.smithi084.stdout:op 3365 completed, throughput=5MB/sec 2024-01-13T18:32:17.988 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OMvlgPcdAdcZDJ9 off=1912822 len=1144331 2024-01-13T18:32:17.992 INFO:tasks.workunit.client.0.smithi084.stdout:op 3366 completed, throughput=5MB/sec 2024-01-13T18:32:18.992 INFO:tasks.workunit.client.0.smithi084.stdout: 662: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:18.992 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9UrN0BzhmeHjz32 off=11481851 len=346738 2024-01-13T18:32:18.995 INFO:tasks.workunit.client.0.smithi084.stdout:op 3367 completed, throughput=4.99MB/sec 2024-01-13T18:32:18.996 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f0Atch0cnMvyIfx off=12585588 len=531566 2024-01-13T18:32:18.997 INFO:tasks.workunit.client.0.smithi084.stdout:op 3368 completed, throughput=4.99MB/sec 2024-01-13T18:32:18.997 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yy63T9ZcOnunC5A off=3483530 len=743737 2024-01-13T18:32:18.998 INFO:tasks.workunit.client.0.smithi084.stdout:op 3369 completed, throughput=4.99MB/sec 2024-01-13T18:32:18.998 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2elhZ-vzRTIEi14 off=3558543 len=1212939 2024-01-13T18:32:19.000 INFO:tasks.workunit.client.0.smithi084.stdout:op 3370 completed, throughput=5MB/sec 2024-01-13T18:32:19.000 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-a3HGn4y8EgqnlzN off=5390813 len=1407775 2024-01-13T18:32:19.002 INFO:tasks.workunit.client.0.smithi084.stdout:op 3371 completed, throughput=5MB/sec 2024-01-13T18:32:19.002 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RphAqdlHxqq6V4q off=11009982 len=1929190 2024-01-13T18:32:19.011 INFO:tasks.workunit.client.0.smithi084.stdout:op 3372 completed, throughput=5MB/sec 2024-01-13T18:32:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:19 smithi099 ceph-mon[138788]: pgmap v1815: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:32:19.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:19 smithi084 ceph-mon[116404]: pgmap v1815: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:32:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:19 smithi084 ceph-mon[119097]: pgmap v1815: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:32:20.011 INFO:tasks.workunit.client.0.smithi084.stdout: 663: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:20.011 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xElTUFjs7m5gXGP off=14865115 len=1490092 2024-01-13T18:32:20.014 INFO:tasks.workunit.client.0.smithi084.stdout:op 3373 completed, throughput=5MB/sec 2024-01-13T18:32:20.014 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Kf8_cmZu9w3KE3l off=7647828 len=1450554 2024-01-13T18:32:20.017 INFO:tasks.workunit.client.0.smithi084.stdout:op 3374 completed, throughput=5MB/sec 2024-01-13T18:32:20.017 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-npFsejso3vxo5PE off=193841 len=1849249 2024-01-13T18:32:20.027 INFO:tasks.workunit.client.0.smithi084.stdout:op 3375 completed, throughput=5MB/sec 2024-01-13T18:32:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:20.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:32:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:32:20] "GET /metrics HTTP/1.1" 200 33993 "" "Prometheus/2.43.0" 2024-01-13T18:32:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:21.027 INFO:tasks.workunit.client.0.smithi084.stdout: 664: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:21.027 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-R5I9-Wox9ZQ9Uy0 off=1623689 len=1814438 2024-01-13T18:32:21.037 INFO:tasks.workunit.client.0.smithi084.stdout:op 3376 completed, throughput=5MB/sec 2024-01-13T18:32:21.037 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-v_c0H1YucgJN3fm off=5508331 len=1936323 2024-01-13T18:32:21.046 INFO:tasks.workunit.client.0.smithi084.stdout:op 3377 completed, throughput=5MB/sec 2024-01-13T18:32:21.046 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PrJ47VkQ4jiIR-0 off=16332497 len=1648304 2024-01-13T18:32:21.048 INFO:tasks.workunit.client.0.smithi084.stdout:op 3378 completed, throughput=5MB/sec 2024-01-13T18:32:21.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:21 smithi099 ceph-mon[138788]: pgmap v1816: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:32:21.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:21 smithi084 ceph-mon[116404]: pgmap v1816: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:32:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:21 smithi084 ceph-mon[119097]: pgmap v1816: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:32:22.048 INFO:tasks.workunit.client.0.smithi084.stdout: 665: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:22.048 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-znKL8HosXylBlSK off=11622614 len=653937 2024-01-13T18:32:22.049 INFO:tasks.workunit.client.0.smithi084.stdout:op 3379 completed, throughput=4.99MB/sec 2024-01-13T18:32:22.049 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vw4V5cOYatCFiSS off=5482183 len=1771552 2024-01-13T18:32:22.052 INFO:tasks.workunit.client.0.smithi084.stdout:op 3380 completed, throughput=5MB/sec 2024-01-13T18:32:22.052 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qL0sLfxgN09oULW off=7368402 len=1251253 2024-01-13T18:32:22.059 INFO:tasks.workunit.client.0.smithi084.stdout:op 3381 completed, throughput=5MB/sec 2024-01-13T18:32:22.059 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fiG1viKk-rVv9gF off=5035556 len=1934590 2024-01-13T18:32:22.067 INFO:tasks.workunit.client.0.smithi084.stdout:op 3382 completed, throughput=5MB/sec 2024-01-13T18:32:23.068 INFO:tasks.workunit.client.0.smithi084.stdout: 666: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:23.068 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fXR0p0RIpr5AMDr off=10143675 len=392654 2024-01-13T18:32:23.068 INFO:tasks.workunit.client.0.smithi084.stdout:op 3383 completed, throughput=4.99MB/sec 2024-01-13T18:32:23.069 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Le_EohG18M15nXh off=1716473 len=1939356 2024-01-13T18:32:23.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 3384 completed, throughput=5MB/sec 2024-01-13T18:32:23.080 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-heY3-s7GNw_0cMt off=4277885 len=289560 2024-01-13T18:32:23.081 INFO:tasks.workunit.client.0.smithi084.stdout:op 3385 completed, throughput=5MB/sec 2024-01-13T18:32:23.081 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--H8wEwzb2KxDF5I off=0 len=1598651 2024-01-13T18:32:23.088 INFO:tasks.workunit.client.0.smithi084.stdout:op 3386 completed, throughput=5MB/sec 2024-01-13T18:32:23.088 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8oufHbAh7J4-gC0 off=5629492 len=662071 2024-01-13T18:32:23.089 INFO:tasks.workunit.client.0.smithi084.stdout:op 3387 completed, throughput=5MB/sec 2024-01-13T18:32:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:23 smithi099 ceph-mon[138788]: pgmap v1817: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:32:23.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:23 smithi084 ceph-mon[116404]: pgmap v1817: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:32:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:23 smithi084 ceph-mon[119097]: pgmap v1817: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:32:24.089 INFO:tasks.workunit.client.0.smithi084.stdout: 667: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:24.089 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DKi7SmE9KD6nXVq off=1518077 len=1097001 2024-01-13T18:32:24.090 INFO:tasks.workunit.client.0.smithi084.stdout:op 3388 completed, throughput=4.99MB/sec 2024-01-13T18:32:24.090 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yGs7AqXWTJsKZpw off=16546389 len=644615 2024-01-13T18:32:24.091 INFO:tasks.workunit.client.0.smithi084.stdout:op 3389 completed, throughput=5MB/sec 2024-01-13T18:32:24.091 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xwFgLFAzAkZA2Tm off=181723 len=1439350 2024-01-13T18:32:24.093 INFO:tasks.workunit.client.0.smithi084.stdout:op 3390 completed, throughput=5MB/sec 2024-01-13T18:32:24.093 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ISR5e2LdQ95YHvq off=20118682 len=1231938 2024-01-13T18:32:24.100 INFO:tasks.workunit.client.0.smithi084.stdout:op 3391 completed, throughput=5MB/sec 2024-01-13T18:32:24.100 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-M200-5-RorKWQ2f off=9474424 len=837768 2024-01-13T18:32:24.104 INFO:tasks.workunit.client.0.smithi084.stdout:op 3392 completed, throughput=5MB/sec 2024-01-13T18:32:25.109 INFO:tasks.workunit.client.0.smithi084.stdout: 668: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:25.109 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UBCjQ7afSrejpv6 off=1243680 len=87884 2024-01-13T18:32:25.109 INFO:tasks.workunit.client.0.smithi084.stdout:op 3393 completed, throughput=4.99MB/sec 2024-01-13T18:32:25.110 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-urT52LhqAcY5SQ7 off=2266349 len=1479415 2024-01-13T18:32:25.110 INFO:tasks.workunit.client.0.smithi084.stdout:op 3394 completed, throughput=5MB/sec 2024-01-13T18:32:25.110 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9kQuVFbARBXnIQU off=5560800 len=1794132 2024-01-13T18:32:25.110 INFO:tasks.workunit.client.0.smithi084.stdout:op 3395 completed, throughput=5MB/sec 2024-01-13T18:32:25.110 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fFKl7mZ2zmua9N5 off=9550217 len=805770 2024-01-13T18:32:25.114 INFO:tasks.workunit.client.0.smithi084.stdout:op 3396 completed, throughput=5MB/sec 2024-01-13T18:32:25.114 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bN_6fqpCrWknzED off=4359357 len=1202803 2024-01-13T18:32:25.116 INFO:tasks.workunit.client.0.smithi084.stdout:op 3397 completed, throughput=5MB/sec 2024-01-13T18:32:25.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:25 smithi099 ceph-mon[138788]: pgmap v1818: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:32:25.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:25 smithi084 ceph-mon[116404]: pgmap v1818: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:32:25.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:25 smithi084 ceph-mon[119097]: pgmap v1818: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:32:26.116 INFO:tasks.workunit.client.0.smithi084.stdout: 669: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:26.116 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-51793XBZ-66oVYI off=20105308 len=1909997 2024-01-13T18:32:26.132 INFO:tasks.workunit.client.0.smithi084.stdout:op 3398 completed, throughput=5MB/sec 2024-01-13T18:32:26.132 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MYF-FUM3AI_Evii off=3482290 len=1125575 2024-01-13T18:32:26.134 INFO:tasks.workunit.client.0.smithi084.stdout:op 3399 completed, throughput=5MB/sec 2024-01-13T18:32:26.134 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-B5w3Yio3qYc_ZdY off=464503 len=583493 2024-01-13T18:32:26.135 INFO:tasks.workunit.client.0.smithi084.stdout:op 3400 completed, throughput=5MB/sec 2024-01-13T18:32:26.135 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9jZG6cvFPzZlEj1 off=8963978 len=1405405 2024-01-13T18:32:26.140 INFO:tasks.workunit.client.0.smithi084.stdout:op 3401 completed, throughput=5MB/sec 2024-01-13T18:32:26.140 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kEswkiYkNxrYBZ2 off=6026278 len=99392 2024-01-13T18:32:26.143 INFO:tasks.workunit.client.0.smithi084.stdout:op 3402 completed, throughput=5MB/sec 2024-01-13T18:32:26.143 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DkTVNQyy3U3e5nl off=14907518 len=1253374 2024-01-13T18:32:26.144 INFO:tasks.workunit.client.0.smithi084.stdout:op 3403 completed, throughput=5MB/sec 2024-01-13T18:32:27.144 INFO:tasks.workunit.client.0.smithi084.stdout: 670: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:27.144 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KnmZMuigFOgEj9d off=5751439 len=1561920 2024-01-13T18:32:27.153 INFO:tasks.workunit.client.0.smithi084.stdout:op 3404 completed, throughput=5MB/sec 2024-01-13T18:32:27.153 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-E8dEx-Ur8ZkMvJL off=347620 len=549323 2024-01-13T18:32:27.154 INFO:tasks.workunit.client.0.smithi084.stdout:op 3405 completed, throughput=5MB/sec 2024-01-13T18:32:27.154 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k3qUvGfGGOrpZqz off=3933725 len=638889 2024-01-13T18:32:27.159 INFO:tasks.workunit.client.0.smithi084.stdout:op 3406 completed, throughput=5MB/sec 2024-01-13T18:32:27.159 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-phOtYRP895xQbki off=894116 len=1699401 2024-01-13T18:32:27.161 INFO:tasks.workunit.client.0.smithi084.stdout:op 3407 completed, throughput=5MB/sec 2024-01-13T18:32:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:27 smithi099 ceph-mon[138788]: pgmap v1819: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:27.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:27 smithi084 ceph-mon[116404]: pgmap v1819: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:27 smithi084 ceph-mon[119097]: pgmap v1819: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:28.161 INFO:tasks.workunit.client.0.smithi084.stdout: 671: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:28.161 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8iL0UF310uv45fm off=11794421 len=1275830 2024-01-13T18:32:28.163 INFO:tasks.workunit.client.0.smithi084.stdout:op 3408 completed, throughput=4.99MB/sec 2024-01-13T18:32:28.163 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lsKanivSoftMcB9 off=13442862 len=1694097 2024-01-13T18:32:28.165 INFO:tasks.workunit.client.0.smithi084.stdout:op 3409 completed, throughput=5MB/sec 2024-01-13T18:32:28.165 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7K8pGmk6A-hajmO off=18312107 len=214253 2024-01-13T18:32:28.165 INFO:tasks.workunit.client.0.smithi084.stdout:op 3410 completed, throughput=5MB/sec 2024-01-13T18:32:28.165 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OZNF0B0xHxFSGKi off=0 len=1404274 2024-01-13T18:32:28.174 INFO:tasks.workunit.client.0.smithi084.stdout:op 3411 completed, throughput=5MB/sec 2024-01-13T18:32:28.174 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Yo_zY9U-8ifOTbf off=2965892 len=690693 2024-01-13T18:32:28.179 INFO:tasks.workunit.client.0.smithi084.stdout:op 3412 completed, throughput=5MB/sec 2024-01-13T18:32:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:32:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:32:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:32:29.179 INFO:tasks.workunit.client.0.smithi084.stdout: 672: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:29.179 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-61_5HEnqYfA4EaN off=2239106 len=1375604 2024-01-13T18:32:29.180 INFO:tasks.workunit.client.0.smithi084.stdout:op 3413 completed, throughput=4.99MB/sec 2024-01-13T18:32:29.180 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PNTo83l_xaJgDdJ off=4980803 len=502198 2024-01-13T18:32:29.184 INFO:tasks.workunit.client.0.smithi084.stdout:op 3414 completed, throughput=5MB/sec 2024-01-13T18:32:29.184 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f6ZeAa9DHFQ7d8p off=2929840 len=913050 2024-01-13T18:32:29.185 INFO:tasks.workunit.client.0.smithi084.stdout:op 3415 completed, throughput=5MB/sec 2024-01-13T18:32:29.186 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hHsAqFU27lPoCez off=1929514 len=2008330 2024-01-13T18:32:29.195 INFO:tasks.workunit.client.0.smithi084.stdout:op 3416 completed, throughput=5MB/sec 2024-01-13T18:32:29.195 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-b8gDhJYl-Y2_7cG off=531042 len=441647 2024-01-13T18:32:29.196 INFO:tasks.workunit.client.0.smithi084.stdout:op 3417 completed, throughput=5MB/sec 2024-01-13T18:32:29.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:29 smithi099 ceph-mon[138788]: pgmap v1820: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:29.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:32:29.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:32:29.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:32:29.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:29 smithi084 ceph-mon[116404]: pgmap v1820: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:29.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:32:29.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:32:29.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:32:29.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:29 smithi084 ceph-mon[119097]: pgmap v1820: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:29.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:32:29.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:32:29.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:32:30.196 INFO:tasks.workunit.client.0.smithi084.stdout: 673: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:30.196 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7o59mf7jWCwoVMD off=2504765 len=943387 2024-01-13T18:32:30.201 INFO:tasks.workunit.client.0.smithi084.stdout:op 3418 completed, throughput=4.99MB/sec 2024-01-13T18:32:30.201 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MXG7cj85z5bL9oV off=611213 len=1802710 2024-01-13T18:32:30.212 INFO:tasks.workunit.client.0.smithi084.stdout:op 3419 completed, throughput=5MB/sec 2024-01-13T18:32:30.212 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-d_szGSUMUTI5imB off=15122143 len=1704367 2024-01-13T18:32:30.213 INFO:tasks.workunit.client.0.smithi084.stdout:op 3420 completed, throughput=5MB/sec 2024-01-13T18:32:30.213 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QAGZUIsfiSskdIR off=16757444 len=2026766 2024-01-13T18:32:30.222 INFO:tasks.workunit.client.0.smithi084.stdout:op 3421 completed, throughput=5MB/sec 2024-01-13T18:32:30.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:32:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:32:30] "GET /metrics HTTP/1.1" 200 33993 "" "Prometheus/2.43.0" 2024-01-13T18:32:31.223 INFO:tasks.workunit.client.0.smithi084.stdout: 674: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:31.223 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nbK1G0BDqJvmHKF off=451751 len=1175896 2024-01-13T18:32:31.224 INFO:tasks.workunit.client.0.smithi084.stdout:op 3422 completed, throughput=5MB/sec 2024-01-13T18:32:31.224 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CztMYKzXumTxseJ off=4356516 len=1515610 2024-01-13T18:32:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:op 3423 completed, throughput=5MB/sec 2024-01-13T18:32:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Iwz7tVaoSlfTMpx off=14577913 len=1923822 2024-01-13T18:32:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:op 3424 completed, throughput=5MB/sec 2024-01-13T18:32:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:31 smithi099 ceph-mon[138788]: pgmap v1821: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:31 smithi084 ceph-mon[116404]: pgmap v1821: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:31 smithi084 ceph-mon[119097]: pgmap v1821: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:32.236 INFO:tasks.workunit.client.0.smithi084.stdout: 675: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:32.236 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3gzGK4Wr4Sen1Gr off=2858384 len=65817 2024-01-13T18:32:32.237 INFO:tasks.workunit.client.0.smithi084.stdout:op 3425 completed, throughput=4.99MB/sec 2024-01-13T18:32:32.237 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TeU91iTRivPql_0 off=5898736 len=869900 2024-01-13T18:32:32.238 INFO:tasks.workunit.client.0.smithi084.stdout:op 3426 completed, throughput=4.99MB/sec 2024-01-13T18:32:32.238 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wnvV8lBDTtD7T8y off=17087942 len=1359324 2024-01-13T18:32:32.239 INFO:tasks.workunit.client.0.smithi084.stdout:op 3427 completed, throughput=5MB/sec 2024-01-13T18:32:32.239 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-v-MReqbi7jDp3pO off=6543281 len=981748 2024-01-13T18:32:32.241 INFO:tasks.workunit.client.0.smithi084.stdout:op 3428 completed, throughput=5MB/sec 2024-01-13T18:32:32.241 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7HYhsGDnVH-5EZd off=7280403 len=1380647 2024-01-13T18:32:32.242 INFO:tasks.workunit.client.0.smithi084.stdout:op 3429 completed, throughput=5MB/sec 2024-01-13T18:32:32.242 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JpZxvSTDxuwxln1 off=54514 len=382347 2024-01-13T18:32:32.245 INFO:tasks.workunit.client.0.smithi084.stdout:op 3430 completed, throughput=5MB/sec 2024-01-13T18:32:33.245 INFO:tasks.workunit.client.0.smithi084.stdout: 676: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:33.246 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QBHJkhJmS5D_hOu off=5879766 len=2037276 2024-01-13T18:32:33.256 INFO:tasks.workunit.client.0.smithi084.stdout:op 3431 completed, throughput=5MB/sec 2024-01-13T18:32:33.256 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_1L3WBiAwDGq32k off=3821344 len=1661664 2024-01-13T18:32:33.262 INFO:tasks.workunit.client.0.smithi084.stdout:op 3432 completed, throughput=5MB/sec 2024-01-13T18:32:33.262 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZRALwEPaYMKP4Ks off=20877435 len=1119404 2024-01-13T18:32:33.263 INFO:tasks.workunit.client.0.smithi084.stdout:op 3433 completed, throughput=5MB/sec 2024-01-13T18:32:33.263 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IgKK3dkrcghY-Ve off=4402793 len=1457336 2024-01-13T18:32:33.266 INFO:tasks.workunit.client.0.smithi084.stdout:op 3434 completed, throughput=5MB/sec 2024-01-13T18:32:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:33 smithi099 ceph-mon[138788]: pgmap v1822: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-01-13T18:32:33.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:33 smithi084 ceph-mon[116404]: pgmap v1822: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-01-13T18:32:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:33 smithi084 ceph-mon[119097]: pgmap v1822: 105 pgs: 105 active+clean; 128 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-01-13T18:32:34.266 INFO:tasks.workunit.client.0.smithi084.stdout: 677: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:34.267 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oOCKz1Cg2lXBZ5v off=4704996 len=65829 2024-01-13T18:32:34.268 INFO:tasks.workunit.client.0.smithi084.stdout:op 3435 completed, throughput=4.99MB/sec 2024-01-13T18:32:34.268 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-l5G6v1aSDveVl3x off=2660333 len=1827277 2024-01-13T18:32:34.270 INFO:tasks.workunit.client.0.smithi084.stdout:op 3436 completed, throughput=5MB/sec 2024-01-13T18:32:34.270 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6q9k9dSwuScugsb off=14135463 len=939953 2024-01-13T18:32:34.275 INFO:tasks.workunit.client.0.smithi084.stdout:op 3437 completed, throughput=5MB/sec 2024-01-13T18:32:34.276 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-t_6ADdSwn_qhLC1 off=2623257 len=1788239 2024-01-13T18:32:34.283 INFO:tasks.workunit.client.0.smithi084.stdout:op 3438 completed, throughput=5MB/sec 2024-01-13T18:32:35.283 INFO:tasks.workunit.client.0.smithi084.stdout: 678: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:35.283 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HFCi267IxvUlRzW off=1145692 len=1620905 2024-01-13T18:32:35.291 INFO:tasks.workunit.client.0.smithi084.stdout:op 3439 completed, throughput=5MB/sec 2024-01-13T18:32:35.291 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hJTemhzzjQrUs-E off=2557189 len=829451 2024-01-13T18:32:35.292 INFO:tasks.workunit.client.0.smithi084.stdout:op 3440 completed, throughput=5MB/sec 2024-01-13T18:32:35.292 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UG8emBTws8yx09L off=3483927 len=1023480 2024-01-13T18:32:35.297 INFO:tasks.workunit.client.0.smithi084.stdout:op 3441 completed, throughput=5MB/sec 2024-01-13T18:32:35.297 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bHAjMo7sMd_-Hqi off=15939462 len=1269986 2024-01-13T18:32:35.306 INFO:tasks.workunit.client.0.smithi084.stdout:op 3442 completed, throughput=5MB/sec 2024-01-13T18:32:35.306 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mauObU-3gklfU5r off=8770490 len=350238 2024-01-13T18:32:35.308 INFO:tasks.workunit.client.0.smithi084.stdout:op 3443 completed, throughput=5MB/sec 2024-01-13T18:32:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:35 smithi099 ceph-mon[138788]: pgmap v1823: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:35 smithi084 ceph-mon[116404]: pgmap v1823: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:35 smithi084 ceph-mon[119097]: pgmap v1823: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:36.309 INFO:tasks.workunit.client.0.smithi084.stdout: 679: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:36.309 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fHU1mEVmFBk2X2s off=3189124 len=1439822 2024-01-13T18:32:36.311 INFO:tasks.workunit.client.0.smithi084.stdout:op 3444 completed, throughput=5MB/sec 2024-01-13T18:32:36.311 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7K3aMjCJbBkdexf off=1125971 len=1388269 2024-01-13T18:32:36.312 INFO:tasks.workunit.client.0.smithi084.stdout:op 3445 completed, throughput=5MB/sec 2024-01-13T18:32:36.312 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zFHaXHN99FcdMGX off=7002843 len=838340 2024-01-13T18:32:36.318 INFO:tasks.workunit.client.0.smithi084.stdout:op 3446 completed, throughput=5MB/sec 2024-01-13T18:32:36.318 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yhlsk--lBFY2vij off=12186525 len=1840373 2024-01-13T18:32:36.320 INFO:tasks.workunit.client.0.smithi084.stdout:op 3447 completed, throughput=5MB/sec 2024-01-13T18:32:37.320 INFO:tasks.workunit.client.0.smithi084.stdout: 680: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:37.320 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0OXk1QGMXqAkwOw off=3479491 len=1260929 2024-01-13T18:32:37.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 3448 completed, throughput=5MB/sec 2024-01-13T18:32:37.329 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bKaSCUUCoAkgQOj off=2043963 len=1027478 2024-01-13T18:32:37.330 INFO:tasks.workunit.client.0.smithi084.stdout:op 3449 completed, throughput=5MB/sec 2024-01-13T18:32:37.330 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-u6pQOQDI2heb7gI off=0 len=1775248 2024-01-13T18:32:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:op 3450 completed, throughput=5MB/sec 2024-01-13T18:32:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6TZA6LOBN9-XBE8 off=21269300 len=2065217 2024-01-13T18:32:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:op 3451 completed, throughput=5MB/sec 2024-01-13T18:32:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:37 smithi099 ceph-mon[138788]: pgmap v1824: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 3 op/s 2024-01-13T18:32:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:37 smithi084 ceph-mon[116404]: pgmap v1824: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 3 op/s 2024-01-13T18:32:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:37 smithi084 ceph-mon[119097]: pgmap v1824: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 3 op/s 2024-01-13T18:32:38.336 INFO:tasks.workunit.client.0.smithi084.stdout: 681: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:38.336 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AGy-I1G-wjh-AMU off=597473 len=1899913 2024-01-13T18:32:38.338 INFO:tasks.workunit.client.0.smithi084.stdout:op 3452 completed, throughput=5MB/sec 2024-01-13T18:32:38.338 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FySMPQhxcfArjju off=1930379 len=1444745 2024-01-13T18:32:38.339 INFO:tasks.workunit.client.0.smithi084.stdout:op 3453 completed, throughput=5MB/sec 2024-01-13T18:32:38.339 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LzRkWlRuXVeAaGg off=1948659 len=2551 2024-01-13T18:32:38.340 INFO:tasks.workunit.client.0.smithi084.stdout:op 3454 completed, throughput=5MB/sec 2024-01-13T18:32:38.340 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1oI2DJ9OVCa6xd7 off=6765354 len=383290 2024-01-13T18:32:38.343 INFO:tasks.workunit.client.0.smithi084.stdout:op 3455 completed, throughput=5MB/sec 2024-01-13T18:32:38.343 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-e7vwdEAPd_D4Xti off=4978106 len=952661 2024-01-13T18:32:38.344 INFO:tasks.workunit.client.0.smithi084.stdout:op 3456 completed, throughput=5MB/sec 2024-01-13T18:32:39.345 INFO:tasks.workunit.client.0.smithi084.stdout: 682: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:39.345 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9mbaCoB4lytsDTk off=5960599 len=1603590 2024-01-13T18:32:39.352 INFO:tasks.workunit.client.0.smithi084.stdout:op 3457 completed, throughput=5MB/sec 2024-01-13T18:32:39.352 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4nvyiQOHwPYjQjw off=16621138 len=1451155 2024-01-13T18:32:39.359 INFO:tasks.workunit.client.0.smithi084.stdout:op 3458 completed, throughput=5MB/sec 2024-01-13T18:32:39.359 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bCgOIQgACtua_Gb off=224346 len=965725 2024-01-13T18:32:39.365 INFO:tasks.workunit.client.0.smithi084.stdout:op 3459 completed, throughput=5MB/sec 2024-01-13T18:32:39.365 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ICVdb0nw3eQutCB off=14028274 len=984722 2024-01-13T18:32:39.366 INFO:tasks.workunit.client.0.smithi084.stdout:op 3460 completed, throughput=5MB/sec 2024-01-13T18:32:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:39 smithi099 ceph-mon[138788]: pgmap v1825: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:32:39.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:39 smithi084 ceph-mon[116404]: pgmap v1825: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:32:39.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:39 smithi084 ceph-mon[119097]: pgmap v1825: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:32:40.367 INFO:tasks.workunit.client.0.smithi084.stdout: 683: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:40.367 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BIc-UeMiek_PDAK off=4859193 len=459864 2024-01-13T18:32:40.368 INFO:tasks.workunit.client.0.smithi084.stdout:op 3461 completed, throughput=4.99MB/sec 2024-01-13T18:32:40.368 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-R3NR_CIStlpwg1D off=2044660 len=44355 2024-01-13T18:32:40.371 INFO:tasks.workunit.client.0.smithi084.stdout:op 3462 completed, throughput=4.99MB/sec 2024-01-13T18:32:40.371 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2Z90rgv64ixkHyJ off=6877420 len=660305 2024-01-13T18:32:40.372 INFO:tasks.workunit.client.0.smithi084.stdout:op 3463 completed, throughput=4.99MB/sec 2024-01-13T18:32:40.372 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8OR-bfwIlx6ITDj off=8749752 len=1630575 2024-01-13T18:32:40.380 INFO:tasks.workunit.client.0.smithi084.stdout:op 3464 completed, throughput=5MB/sec 2024-01-13T18:32:40.380 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8s4em6crES4N4fV off=13852 len=1649348 2024-01-13T18:32:40.388 INFO:tasks.workunit.client.0.smithi084.stdout:op 3465 completed, throughput=5MB/sec 2024-01-13T18:32:40.388 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lokuTA2EJ5BLkhr off=2544263 len=1266054 2024-01-13T18:32:40.394 INFO:tasks.workunit.client.0.smithi084.stdout:op 3466 completed, throughput=5MB/sec 2024-01-13T18:32:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:32:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:32:40] "GET /metrics HTTP/1.1" 200 33994 "" "Prometheus/2.43.0" 2024-01-13T18:32:41.394 INFO:tasks.workunit.client.0.smithi084.stdout: 684: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:41.394 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8XQBTktvGFbJj35 off=8444088 len=1917113 2024-01-13T18:32:41.396 INFO:tasks.workunit.client.0.smithi084.stdout:op 3467 completed, throughput=5MB/sec 2024-01-13T18:32:41.397 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ChjH-5JLVUmXFCJ off=5531980 len=1596896 2024-01-13T18:32:41.398 INFO:tasks.workunit.client.0.smithi084.stdout:op 3468 completed, throughput=5MB/sec 2024-01-13T18:32:41.398 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kvk0ER95eIM3kAa off=3105036 len=1657726 2024-01-13T18:32:41.402 INFO:tasks.workunit.client.0.smithi084.stdout:op 3469 completed, throughput=5MB/sec 2024-01-13T18:32:41.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:41 smithi099 ceph-mon[138788]: pgmap v1826: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:32:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:41 smithi084 ceph-mon[116404]: pgmap v1826: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:32:41.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:41 smithi084 ceph-mon[119097]: pgmap v1826: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:32:42.402 INFO:tasks.workunit.client.0.smithi084.stdout: 685: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:42.402 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Xd855cxbKd31iN4 off=1521116 len=1001525 2024-01-13T18:32:42.403 INFO:tasks.workunit.client.0.smithi084.stdout:op 3470 completed, throughput=4.99MB/sec 2024-01-13T18:32:42.403 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-s1eU0_JR5Q6pasc off=429595 len=1091105 2024-01-13T18:32:42.409 INFO:tasks.workunit.client.0.smithi084.stdout:op 3471 completed, throughput=5MB/sec 2024-01-13T18:32:42.410 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0Ww45anGo5qMHUC off=11848176 len=990737 2024-01-13T18:32:42.412 INFO:tasks.workunit.client.0.smithi084.stdout:op 3472 completed, throughput=5MB/sec 2024-01-13T18:32:42.412 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-L-tTVUtYi7NB9VF off=10869650 len=1392612 2024-01-13T18:32:42.418 INFO:tasks.workunit.client.0.smithi084.stdout:op 3473 completed, throughput=5MB/sec 2024-01-13T18:32:42.418 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VRp1hui80jTjkYi off=10333716 len=466041 2024-01-13T18:32:42.421 INFO:tasks.workunit.client.0.smithi084.stdout:op 3474 completed, throughput=5MB/sec 2024-01-13T18:32:43.421 INFO:tasks.workunit.client.0.smithi084.stdout: 686: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:43.421 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S6Uhc2jZrwzV7b4 off=485050 len=329081 2024-01-13T18:32:43.424 INFO:tasks.workunit.client.0.smithi084.stdout:op 3475 completed, throughput=4.99MB/sec 2024-01-13T18:32:43.424 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-H1DHtLN8Gze_3Nq off=2681402 len=1137271 2024-01-13T18:32:43.430 INFO:tasks.workunit.client.0.smithi084.stdout:op 3476 completed, throughput=4.99MB/sec 2024-01-13T18:32:43.430 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EV2127JkKyJq0NB off=20366518 len=552158 2024-01-13T18:32:43.434 INFO:tasks.workunit.client.0.smithi084.stdout:op 3477 completed, throughput=5MB/sec 2024-01-13T18:32:43.434 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Gw-mEzAIyh40LGt off=1284335 len=1464745 2024-01-13T18:32:43.437 INFO:tasks.workunit.client.0.smithi084.stdout:op 3478 completed, throughput=5MB/sec 2024-01-13T18:32:43.437 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-42PraoH_zVhjYIk off=408847 len=892195 2024-01-13T18:32:43.438 INFO:tasks.workunit.client.0.smithi084.stdout:op 3479 completed, throughput=5MB/sec 2024-01-13T18:32:43.438 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Af7OOmYCbdSR9lG off=11187185 len=135099 2024-01-13T18:32:43.444 INFO:tasks.workunit.client.0.smithi084.stdout:op 3480 completed, throughput=5MB/sec 2024-01-13T18:32:43.444 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-X5qv6uJoN6sGkdf off=2558806 len=359656 2024-01-13T18:32:43.445 INFO:tasks.workunit.client.0.smithi084.stdout:op 3481 completed, throughput=5MB/sec 2024-01-13T18:32:43.445 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lZZK6zfTkcs7RU6 off=13153899 len=1995209 2024-01-13T18:32:43.448 INFO:tasks.workunit.client.0.smithi084.stdout:op 3482 completed, throughput=5MB/sec 2024-01-13T18:32:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:43 smithi099 ceph-mon[138788]: pgmap v1827: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:32:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:43 smithi084 ceph-mon[116404]: pgmap v1827: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:32:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:43 smithi084 ceph-mon[119097]: pgmap v1827: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:32:44.448 INFO:tasks.workunit.client.0.smithi084.stdout: 687: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:44.449 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_lWOsHv73SmqVcF off=13865727 len=1007847 2024-01-13T18:32:44.450 INFO:tasks.workunit.client.0.smithi084.stdout:op 3483 completed, throughput=5MB/sec 2024-01-13T18:32:44.450 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lsi65xJZEj6iUVW off=325899 len=1319827 2024-01-13T18:32:44.458 INFO:tasks.workunit.client.0.smithi084.stdout:op 3484 completed, throughput=5MB/sec 2024-01-13T18:32:44.459 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ph-Kh-e9s6cqQfa off=12873111 len=1902473 2024-01-13T18:32:44.468 INFO:tasks.workunit.client.0.smithi084.stdout:op 3485 completed, throughput=5MB/sec 2024-01-13T18:32:45.468 INFO:tasks.workunit.client.0.smithi084.stdout: 688: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:45.468 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TUKP7DePd3YrN7T off=961946 len=459053 2024-01-13T18:32:45.473 INFO:tasks.workunit.client.0.smithi084.stdout:op 3486 completed, throughput=4.99MB/sec 2024-01-13T18:32:45.473 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Xe6vR1--0jS3A1G off=2493422 len=1555075 2024-01-13T18:32:45.479 INFO:tasks.workunit.client.0.smithi084.stdout:op 3487 completed, throughput=5MB/sec 2024-01-13T18:32:45.479 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aayZLXh94158dMX off=2736495 len=1239260 2024-01-13T18:32:45.482 INFO:tasks.workunit.client.0.smithi084.stdout:op 3488 completed, throughput=5MB/sec 2024-01-13T18:32:45.482 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UFT3nnJltfamV_V off=4555654 len=1821621 2024-01-13T18:32:45.483 INFO:tasks.workunit.client.0.smithi084.stdout:op 3489 completed, throughput=5MB/sec 2024-01-13T18:32:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:45 smithi099 ceph-mon[138788]: pgmap v1828: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:45.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:45 smithi084 ceph-mon[116404]: pgmap v1828: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:45.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:45 smithi084 ceph-mon[119097]: pgmap v1828: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:46.484 INFO:tasks.workunit.client.0.smithi084.stdout: 689: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:46.484 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mUaD8BlwYdn7F_A off=2254023 len=1023723 2024-01-13T18:32:46.485 INFO:tasks.workunit.client.0.smithi084.stdout:op 3490 completed, throughput=4.99MB/sec 2024-01-13T18:32:46.485 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yHkmloslxvYeNhw off=2691387 len=486094 2024-01-13T18:32:46.486 INFO:tasks.workunit.client.0.smithi084.stdout:op 3491 completed, throughput=5MB/sec 2024-01-13T18:32:46.486 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1fNAdTVlqzgHFgv off=10168642 len=1434299 2024-01-13T18:32:46.494 INFO:tasks.workunit.client.0.smithi084.stdout:op 3492 completed, throughput=5MB/sec 2024-01-13T18:32:46.494 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ONviTUtHgo7GeDp off=1066004 len=1780389 2024-01-13T18:32:46.504 INFO:tasks.workunit.client.0.smithi084.stdout:op 3493 completed, throughput=5MB/sec 2024-01-13T18:32:46.504 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j6WTp8Xy92TMLwG off=3259952 len=1206415 2024-01-13T18:32:46.510 INFO:tasks.workunit.client.0.smithi084.stdout:op 3494 completed, throughput=5MB/sec 2024-01-13T18:32:47.511 INFO:tasks.workunit.client.0.smithi084.stdout: 690: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3eh5JuuEk_Edf4G off=10423190 len=280386 2024-01-13T18:32:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:op 3495 completed, throughput=4.99MB/sec 2024-01-13T18:32:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kKc0_mtU9nBHQ6N off=1797054 len=672727 2024-01-13T18:32:47.516 INFO:tasks.workunit.client.0.smithi084.stdout:op 3496 completed, throughput=5MB/sec 2024-01-13T18:32:47.516 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gak7a2GHHxNXRsf off=16891398 len=1488737 2024-01-13T18:32:47.519 INFO:tasks.workunit.client.0.smithi084.stdout:op 3497 completed, throughput=5MB/sec 2024-01-13T18:32:47.519 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kEI9_a1yQ5H4Bnk off=4070648 len=707953 2024-01-13T18:32:47.520 INFO:tasks.workunit.client.0.smithi084.stdout:op 3498 completed, throughput=5MB/sec 2024-01-13T18:32:47.520 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pw_7BtNJQO42aqj off=9165251 len=2010682 2024-01-13T18:32:47.531 INFO:tasks.workunit.client.0.smithi084.stdout:op 3499 completed, throughput=5MB/sec 2024-01-13T18:32:47.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:47 smithi099 ceph-mon[138788]: pgmap v1829: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:32:47.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:47 smithi084 ceph-mon[116404]: pgmap v1829: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:32:47.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:47 smithi084 ceph-mon[119097]: pgmap v1829: 105 pgs: 105 active+clean; 128 GiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:32:48.532 INFO:tasks.workunit.client.0.smithi084.stdout: 691: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:48.532 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4E2vy-6MjhIw3O6 off=6950343 len=1169373 2024-01-13T18:32:48.533 INFO:tasks.workunit.client.0.smithi084.stdout:op 3500 completed, throughput=5MB/sec 2024-01-13T18:32:48.533 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ggbj4hzTXDbZ4qK off=1255825 len=1165604 2024-01-13T18:32:48.534 INFO:tasks.workunit.client.0.smithi084.stdout:op 3501 completed, throughput=5MB/sec 2024-01-13T18:32:48.534 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MEfkUBnF2lLlHFc off=10530582 len=1063463 2024-01-13T18:32:48.540 INFO:tasks.workunit.client.0.smithi084.stdout:op 3502 completed, throughput=5MB/sec 2024-01-13T18:32:48.540 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tAhgnS8-GfLk4AZ off=5037018 len=1121727 2024-01-13T18:32:48.541 INFO:tasks.workunit.client.0.smithi084.stdout:op 3503 completed, throughput=5MB/sec 2024-01-13T18:32:48.541 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vwa-C0lVHjtxPss off=2188678 len=393479 2024-01-13T18:32:48.542 INFO:tasks.workunit.client.0.smithi084.stdout:op 3504 completed, throughput=5MB/sec 2024-01-13T18:32:49.542 INFO:tasks.workunit.client.0.smithi084.stdout: 692: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:49.542 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2XXORkqX4ltoC08 off=2366220 len=1618067 2024-01-13T18:32:49.544 INFO:tasks.workunit.client.0.smithi084.stdout:op 3505 completed, throughput=5MB/sec 2024-01-13T18:32:49.544 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-liDPqNA5-9E-NDe off=7563700 len=758426 2024-01-13T18:32:49.548 INFO:tasks.workunit.client.0.smithi084.stdout:op 3506 completed, throughput=5MB/sec 2024-01-13T18:32:49.548 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CmbwTfkEiD7Nicr off=13142230 len=869579 2024-01-13T18:32:49.553 INFO:tasks.workunit.client.0.smithi084.stdout:op 3507 completed, throughput=5MB/sec 2024-01-13T18:32:49.554 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OmzzE5GgIlHAGCX off=9010306 len=1591699 2024-01-13T18:32:49.561 INFO:tasks.workunit.client.0.smithi084.stdout:op 3508 completed, throughput=5MB/sec 2024-01-13T18:32:49.561 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-18lLcATHq6gXv5u off=1130911 len=1210792 2024-01-13T18:32:49.567 INFO:tasks.workunit.client.0.smithi084.stdout:op 3509 completed, throughput=5MB/sec 2024-01-13T18:32:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:49 smithi099 ceph-mon[138788]: pgmap v1830: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:32:49.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:49 smithi084 ceph-mon[116404]: pgmap v1830: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:32:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:49 smithi084 ceph-mon[119097]: pgmap v1830: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:32:50.568 INFO:tasks.workunit.client.0.smithi084.stdout: 693: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:50.568 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h1o-CRVVMshvkjZ off=8355422 len=866818 2024-01-13T18:32:50.573 INFO:tasks.workunit.client.0.smithi084.stdout:op 3510 completed, throughput=5MB/sec 2024-01-13T18:32:50.573 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-K-NqumHHWWxKTq0 off=3992019 len=1824190 2024-01-13T18:32:50.575 INFO:tasks.workunit.client.0.smithi084.stdout:op 3511 completed, throughput=5MB/sec 2024-01-13T18:32:50.575 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N_8x6ijRh8twOid off=12657609 len=1856952 2024-01-13T18:32:50.578 INFO:tasks.workunit.client.0.smithi084.stdout:op 3512 completed, throughput=5MB/sec 2024-01-13T18:32:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:50.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:50.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:32:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:32:50] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:32:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:32:51.579 INFO:tasks.workunit.client.0.smithi084.stdout: 694: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:51.579 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PCMWg0Xymw_xSGz off=7780259 len=1925316 2024-01-13T18:32:51.590 INFO:tasks.workunit.client.0.smithi084.stdout:op 3513 completed, throughput=5MB/sec 2024-01-13T18:32:51.590 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4lBOeiZrxTF6kIz off=1438289 len=1963301 2024-01-13T18:32:51.592 INFO:tasks.workunit.client.0.smithi084.stdout:op 3514 completed, throughput=5MB/sec 2024-01-13T18:32:51.592 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-igLqlXUu7l7A6-z off=1510428 len=1868371 2024-01-13T18:32:51.594 INFO:tasks.workunit.client.0.smithi084.stdout:op 3515 completed, throughput=5MB/sec 2024-01-13T18:32:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:51 smithi099 ceph-mon[138788]: pgmap v1831: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:32:51.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:51 smithi084 ceph-mon[116404]: pgmap v1831: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:32:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:51 smithi084 ceph-mon[119097]: pgmap v1831: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:32:52.595 INFO:tasks.workunit.client.0.smithi084.stdout: 695: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:52.595 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-alMKMQ9A30B3SEc off=7860897 len=1818989 2024-01-13T18:32:52.603 INFO:tasks.workunit.client.0.smithi084.stdout:op 3516 completed, throughput=5MB/sec 2024-01-13T18:32:52.603 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OL214W4EcAF547T off=20164950 len=1591809 2024-01-13T18:32:52.604 INFO:tasks.workunit.client.0.smithi084.stdout:op 3517 completed, throughput=5MB/sec 2024-01-13T18:32:52.605 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-s60-K397CDMCc1R off=402069 len=304987 2024-01-13T18:32:52.608 INFO:tasks.workunit.client.0.smithi084.stdout:op 3518 completed, throughput=5MB/sec 2024-01-13T18:32:52.608 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0UpbGdZJ1PE-oFZ off=5006723 len=423269 2024-01-13T18:32:52.611 INFO:tasks.workunit.client.0.smithi084.stdout:op 3519 completed, throughput=5MB/sec 2024-01-13T18:32:52.611 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xOz0b5XzFaJr5JO off=1523298 len=1818532 2024-01-13T18:32:52.616 INFO:tasks.workunit.client.0.smithi084.stdout:op 3520 completed, throughput=5MB/sec 2024-01-13T18:32:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: 696: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:53.617 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mQCm4EX_Gmv0YOC off=1594640 len=1752580 2024-01-13T18:32:53.627 INFO:tasks.workunit.client.0.smithi084.stdout:op 3521 completed, throughput=5MB/sec 2024-01-13T18:32:53.627 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Yhhivb__N8aG-0i off=3177999 len=670607 2024-01-13T18:32:53.632 INFO:tasks.workunit.client.0.smithi084.stdout:op 3522 completed, throughput=5MB/sec 2024-01-13T18:32:53.632 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VXJ5e51HVOaVFNq off=7045613 len=1363913 2024-01-13T18:32:53.637 INFO:tasks.workunit.client.0.smithi084.stdout:op 3523 completed, throughput=5MB/sec 2024-01-13T18:32:53.638 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KJVSMGni9WjMaPb off=13602837 len=1367062 2024-01-13T18:32:53.644 INFO:tasks.workunit.client.0.smithi084.stdout:op 3524 completed, throughput=5MB/sec 2024-01-13T18:32:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:53 smithi099 ceph-mon[138788]: pgmap v1832: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:32:53.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:53 smithi084 ceph-mon[116404]: pgmap v1832: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:32:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:53 smithi084 ceph-mon[119097]: pgmap v1832: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:32:54.644 INFO:tasks.workunit.client.0.smithi084.stdout: 697: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:54.644 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qzc2PCaawTwPeJA off=10275166 len=1547724 2024-01-13T18:32:54.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 3525 completed, throughput=5MB/sec 2024-01-13T18:32:54.647 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Hyt4cKY5ROPpDoA off=15633088 len=1944525 2024-01-13T18:32:54.648 INFO:tasks.workunit.client.0.smithi084.stdout:op 3526 completed, throughput=5MB/sec 2024-01-13T18:32:54.648 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cq6JyuHiL_vZ8a8 off=10932196 len=81185 2024-01-13T18:32:54.651 INFO:tasks.workunit.client.0.smithi084.stdout:op 3527 completed, throughput=5MB/sec 2024-01-13T18:32:54.651 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-p-tWtkf-tQ7vtke off=9194231 len=344901 2024-01-13T18:32:54.655 INFO:tasks.workunit.client.0.smithi084.stdout:op 3528 completed, throughput=5MB/sec 2024-01-13T18:32:54.655 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eB2BTYOMsfY9MNi off=13270749 len=779996 2024-01-13T18:32:54.656 INFO:tasks.workunit.client.0.smithi084.stdout:op 3529 completed, throughput=5MB/sec 2024-01-13T18:32:55.656 INFO:tasks.workunit.client.0.smithi084.stdout: 698: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:55.656 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DGXdGdjDCMvLHkP off=2003174 len=576173 2024-01-13T18:32:55.661 INFO:tasks.workunit.client.0.smithi084.stdout:op 3530 completed, throughput=4.99MB/sec 2024-01-13T18:32:55.661 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mNtZxcMjYBGqTbg off=1735146 len=1177830 2024-01-13T18:32:55.668 INFO:tasks.workunit.client.0.smithi084.stdout:op 3531 completed, throughput=5MB/sec 2024-01-13T18:32:55.668 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bZfUDS3NH1rPpvq off=64133 len=804473 2024-01-13T18:32:55.669 INFO:tasks.workunit.client.0.smithi084.stdout:op 3532 completed, throughput=5MB/sec 2024-01-13T18:32:55.669 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hR4jGqRTckBXs27 off=4548551 len=1152631 2024-01-13T18:32:55.671 INFO:tasks.workunit.client.0.smithi084.stdout:op 3533 completed, throughput=5MB/sec 2024-01-13T18:32:55.671 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DjWqRfnBDr_uCSQ off=281596 len=1193409 2024-01-13T18:32:55.677 INFO:tasks.workunit.client.0.smithi084.stdout:op 3534 completed, throughput=5MB/sec 2024-01-13T18:32:55.678 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uOcSi9izkKqmO2B off=17342171 len=892066 2024-01-13T18:32:55.682 INFO:tasks.workunit.client.0.smithi084.stdout:op 3535 completed, throughput=5MB/sec 2024-01-13T18:32:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:55 smithi099 ceph-mon[138788]: pgmap v1833: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:32:55.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:55 smithi084 ceph-mon[116404]: pgmap v1833: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:32:55.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:55 smithi084 ceph-mon[119097]: pgmap v1833: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 4 op/s 2024-01-13T18:32:56.682 INFO:tasks.workunit.client.0.smithi084.stdout: 699: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:56.682 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oFR19TGP0CUVsd- off=609567 len=150294 2024-01-13T18:32:56.683 INFO:tasks.workunit.client.0.smithi084.stdout:op 3536 completed, throughput=4.99MB/sec 2024-01-13T18:32:56.683 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-T9MctK964b_6HAR off=6260191 len=13715 2024-01-13T18:32:56.686 INFO:tasks.workunit.client.0.smithi084.stdout:op 3537 completed, throughput=4.99MB/sec 2024-01-13T18:32:56.686 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iPWTSzJ7cxLtcVJ off=541651 len=398588 2024-01-13T18:32:56.690 INFO:tasks.workunit.client.0.smithi084.stdout:op 3538 completed, throughput=4.99MB/sec 2024-01-13T18:32:56.690 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9HZKllRaX7vYSpO off=5381845 len=441295 2024-01-13T18:32:56.693 INFO:tasks.workunit.client.0.smithi084.stdout:op 3539 completed, throughput=5MB/sec 2024-01-13T18:32:56.693 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_4TV_v6VXz4bq_6 off=680944 len=1398921 2024-01-13T18:32:56.695 INFO:tasks.workunit.client.0.smithi084.stdout:op 3540 completed, throughput=5MB/sec 2024-01-13T18:32:56.695 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eD0vNhYneOhL0I- off=17810369 len=1973141 2024-01-13T18:32:56.698 INFO:tasks.workunit.client.0.smithi084.stdout:op 3541 completed, throughput=5MB/sec 2024-01-13T18:32:56.698 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-u4330BLdsZQ3gOY off=19051649 len=2058105 2024-01-13T18:32:56.699 INFO:tasks.workunit.client.0.smithi084.stdout:op 3542 completed, throughput=5MB/sec 2024-01-13T18:32:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: 700: throughput=5MB/sec pending data=0 2024-01-13T18:32:57.700 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OmYnw4zKMSQVYWO off=10605654 len=1037297 2024-01-13T18:32:57.705 INFO:tasks.workunit.client.0.smithi084.stdout:op 3543 completed, throughput=5MB/sec 2024-01-13T18:32:57.705 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dHY-64GiIV3RNXv off=19484333 len=1746154 2024-01-13T18:32:57.715 INFO:tasks.workunit.client.0.smithi084.stdout:op 3544 completed, throughput=5MB/sec 2024-01-13T18:32:57.715 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7K8pGmk6A-hajmO off=5993429 len=1902308 2024-01-13T18:32:57.725 INFO:tasks.workunit.client.0.smithi084.stdout:op 3545 completed, throughput=5MB/sec 2024-01-13T18:32:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:57 smithi099 ceph-mon[138788]: pgmap v1834: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:57 smithi084 ceph-mon[116404]: pgmap v1834: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:57 smithi084 ceph-mon[119097]: pgmap v1834: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:32:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: 701: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:58.726 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ibJxW76EHNJr0MJ off=2735978 len=983951 2024-01-13T18:32:58.727 INFO:tasks.workunit.client.0.smithi084.stdout:op 3546 completed, throughput=5MB/sec 2024-01-13T18:32:58.727 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gXqvuipBc9K1uv2 off=5199583 len=1817041 2024-01-13T18:32:58.738 INFO:tasks.workunit.client.0.smithi084.stdout:op 3547 completed, throughput=5MB/sec 2024-01-13T18:32:58.738 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ja87b6g_4pkRGU_ off=1612423 len=1771438 2024-01-13T18:32:58.744 INFO:tasks.workunit.client.0.smithi084.stdout:op 3548 completed, throughput=5MB/sec 2024-01-13T18:32:59.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:32:59 smithi099 ceph-mon[138788]: pgmap v1835: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:59.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:32:59 smithi084 ceph-mon[116404]: pgmap v1835: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:32:59 smithi084 ceph-mon[119097]: pgmap v1835: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:32:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: 702: throughput=4.99MB/sec pending data=0 2024-01-13T18:32:59.745 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g04dm5rTM9tS5eF off=13424050 len=1763849 2024-01-13T18:32:59.747 INFO:tasks.workunit.client.0.smithi084.stdout:op 3549 completed, throughput=5MB/sec 2024-01-13T18:32:59.747 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oUlzmeUvWz69OXO off=8735254 len=1252971 2024-01-13T18:32:59.751 INFO:tasks.workunit.client.0.smithi084.stdout:op 3550 completed, throughput=5MB/sec 2024-01-13T18:32:59.751 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WavP6d76x6uw_D9 off=715392 len=519885 2024-01-13T18:32:59.752 INFO:tasks.workunit.client.0.smithi084.stdout:op 3551 completed, throughput=5MB/sec 2024-01-13T18:32:59.753 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-A-lddu-FZHJW2QN off=1098676 len=894695 2024-01-13T18:32:59.754 INFO:tasks.workunit.client.0.smithi084.stdout:op 3552 completed, throughput=5MB/sec 2024-01-13T18:32:59.754 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YG4FFcMrZ_Zq9qB off=5672489 len=1696543 2024-01-13T18:32:59.756 INFO:tasks.workunit.client.0.smithi084.stdout:op 3553 completed, throughput=5MB/sec 2024-01-13T18:33:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:33:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:33:00] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:33:00.756 INFO:tasks.workunit.client.0.smithi084.stdout: 703: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:00.756 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-s-RBQJk9tX5f9FJ off=12065521 len=719941 2024-01-13T18:33:00.757 INFO:tasks.workunit.client.0.smithi084.stdout:op 3554 completed, throughput=5MB/sec 2024-01-13T18:33:00.757 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SDW9pB--qM7hBQV off=7347065 len=772763 2024-01-13T18:33:00.763 INFO:tasks.workunit.client.0.smithi084.stdout:op 3555 completed, throughput=5MB/sec 2024-01-13T18:33:00.763 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DWGoB5WXFDtgB9D off=313818 len=1816053 2024-01-13T18:33:00.766 INFO:tasks.workunit.client.0.smithi084.stdout:op 3556 completed, throughput=5MB/sec 2024-01-13T18:33:00.766 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N0oGaYtWAepPUbn off=661283 len=555303 2024-01-13T18:33:00.767 INFO:tasks.workunit.client.0.smithi084.stdout:op 3557 completed, throughput=5MB/sec 2024-01-13T18:33:00.767 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NzPyWNz8k4ww-53 off=2750826 len=408818 2024-01-13T18:33:00.770 INFO:tasks.workunit.client.0.smithi084.stdout:op 3558 completed, throughput=5MB/sec 2024-01-13T18:33:01.771 INFO:tasks.workunit.client.0.smithi084.stdout: 704: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:01.771 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iMYFnfM_G1NRUdg off=13923721 len=988971 2024-01-13T18:33:01.772 INFO:tasks.workunit.client.0.smithi084.stdout:op 3559 completed, throughput=4.99MB/sec 2024-01-13T18:33:01.772 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Njlg6s5m1_u7vN_ off=449508 len=1159846 2024-01-13T18:33:01.779 INFO:tasks.workunit.client.0.smithi084.stdout:op 3560 completed, throughput=5MB/sec 2024-01-13T18:33:01.779 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0yYcsdkSK2CTDMC off=4421318 len=755307 2024-01-13T18:33:01.779 INFO:tasks.workunit.client.0.smithi084.stdout:op 3561 completed, throughput=5MB/sec 2024-01-13T18:33:01.779 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--LrBCK1-rJICjb1 off=10454795 len=1309138 2024-01-13T18:33:01.788 INFO:tasks.workunit.client.0.smithi084.stdout:op 3562 completed, throughput=5MB/sec 2024-01-13T18:33:01.788 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-q_Lv4zo9ItR2MCK off=5755209 len=428368 2024-01-13T18:33:01.788 INFO:tasks.workunit.client.0.smithi084.stdout:op 3563 completed, throughput=5MB/sec 2024-01-13T18:33:01.789 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nQongx5FJUemcaq off=1274779 len=1537201 2024-01-13T18:33:01.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 3564 completed, throughput=5MB/sec 2024-01-13T18:33:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:01 smithi099 ceph-mon[138788]: pgmap v1836: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:33:01.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:01 smithi084 ceph-mon[116404]: pgmap v1836: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:33:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:01 smithi084 ceph-mon[119097]: pgmap v1836: 105 pgs: 105 active+clean; 128 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:33:02.795 INFO:tasks.workunit.client.0.smithi084.stdout: 705: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:02.795 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8-T-e6Te5wGSZbh off=2735867 len=1753447 2024-01-13T18:33:02.797 INFO:tasks.workunit.client.0.smithi084.stdout:op 3565 completed, throughput=5MB/sec 2024-01-13T18:33:02.797 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2E8RRyoPLMQQg6d off=5290780 len=1911952 2024-01-13T18:33:02.799 INFO:tasks.workunit.client.0.smithi084.stdout:op 3566 completed, throughput=5MB/sec 2024-01-13T18:33:02.799 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ubyZdG42FMyOXNN off=152451 len=639022 2024-01-13T18:33:02.801 INFO:tasks.workunit.client.0.smithi084.stdout:op 3567 completed, throughput=5MB/sec 2024-01-13T18:33:02.801 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hVenECFRXnENx1S off=4168749 len=1003940 2024-01-13T18:33:02.806 INFO:tasks.workunit.client.0.smithi084.stdout:op 3568 completed, throughput=5MB/sec 2024-01-13T18:33:03.807 INFO:tasks.workunit.client.0.smithi084.stdout: 706: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:03.807 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XB4geREsCVasLyt off=11564203 len=1219926 2024-01-13T18:33:03.812 INFO:tasks.workunit.client.0.smithi084.stdout:op 3569 completed, throughput=5MB/sec 2024-01-13T18:33:03.812 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-X7TEJpPNdGJjQSz off=5106115 len=1530499 2024-01-13T18:33:03.819 INFO:tasks.workunit.client.0.smithi084.stdout:op 3570 completed, throughput=5MB/sec 2024-01-13T18:33:03.819 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tZ-L0AbKsNmz80W off=1547952 len=840716 2024-01-13T18:33:03.820 INFO:tasks.workunit.client.0.smithi084.stdout:op 3571 completed, throughput=5MB/sec 2024-01-13T18:33:03.820 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BhMcv-AbcE05VuI off=1213735 len=599605 2024-01-13T18:33:03.821 INFO:tasks.workunit.client.0.smithi084.stdout:op 3572 completed, throughput=5MB/sec 2024-01-13T18:33:03.821 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ARf0Kv1ehSJ42Fm off=4403945 len=1783169 2024-01-13T18:33:03.824 INFO:tasks.workunit.client.0.smithi084.stdout:op 3573 completed, throughput=5MB/sec 2024-01-13T18:33:03.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:03 smithi099 ceph-mon[138788]: pgmap v1837: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-01-13T18:33:03.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:03 smithi084 ceph-mon[116404]: pgmap v1837: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-01-13T18:33:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:03 smithi084 ceph-mon[119097]: pgmap v1837: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-01-13T18:33:04.824 INFO:tasks.workunit.client.0.smithi084.stdout: 707: throughput=5MB/sec pending data=0 2024-01-13T18:33:04.824 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LaNXIwf6rDBy8xi off=1878855 len=1189941 2024-01-13T18:33:04.827 INFO:tasks.workunit.client.0.smithi084.stdout:op 3574 completed, throughput=5MB/sec 2024-01-13T18:33:04.827 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ozF4Owu5bJeanuZ off=452299 len=967567 2024-01-13T18:33:04.829 INFO:tasks.workunit.client.0.smithi084.stdout:op 3575 completed, throughput=5MB/sec 2024-01-13T18:33:04.829 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VGy6kyNQVBbtdjo off=20409053 len=1250920 2024-01-13T18:33:04.835 INFO:tasks.workunit.client.0.smithi084.stdout:op 3576 completed, throughput=5MB/sec 2024-01-13T18:33:04.835 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4Lvd99Co5vinB3n off=342313 len=1625396 2024-01-13T18:33:04.837 INFO:tasks.workunit.client.0.smithi084.stdout:op 3577 completed, throughput=5MB/sec 2024-01-13T18:33:05.838 INFO:tasks.workunit.client.0.smithi084.stdout: 708: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:05.838 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w_Gc94UFpFPmyOW off=2354249 len=137671 2024-01-13T18:33:05.839 INFO:tasks.workunit.client.0.smithi084.stdout:op 3578 completed, throughput=4.99MB/sec 2024-01-13T18:33:05.839 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WdaevG-ksTRTzxM off=12013925 len=1344958 2024-01-13T18:33:05.847 INFO:tasks.workunit.client.0.smithi084.stdout:op 3579 completed, throughput=5MB/sec 2024-01-13T18:33:05.848 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ks-yCxeAxctRre9 off=1279407 len=429650 2024-01-13T18:33:05.848 INFO:tasks.workunit.client.0.smithi084.stdout:op 3580 completed, throughput=5MB/sec 2024-01-13T18:33:05.849 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-utHt3KCJThMbTzQ off=22386204 len=1090953 2024-01-13T18:33:05.853 INFO:tasks.workunit.client.0.smithi084.stdout:op 3581 completed, throughput=5MB/sec 2024-01-13T18:33:05.854 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pvVF76_T9PZLKaV off=9183394 len=1314654 2024-01-13T18:33:05.855 INFO:tasks.workunit.client.0.smithi084.stdout:op 3582 completed, throughput=5MB/sec 2024-01-13T18:33:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:05 smithi099 ceph-mon[138788]: pgmap v1838: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:05 smithi084 ceph-mon[116404]: pgmap v1838: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:05 smithi084 ceph-mon[119097]: pgmap v1838: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:06.856 INFO:tasks.workunit.client.0.smithi084.stdout: 709: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:06.856 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-stl0OmLvegu90ql off=2045272 len=594369 2024-01-13T18:33:06.856 INFO:tasks.workunit.client.0.smithi084.stdout:op 3583 completed, throughput=4.99MB/sec 2024-01-13T18:33:06.857 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-idPImQzs7_DZJKV off=14815600 len=397160 2024-01-13T18:33:06.858 INFO:tasks.workunit.client.0.smithi084.stdout:op 3584 completed, throughput=4.99MB/sec 2024-01-13T18:33:06.858 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mkH6_D_C_2phqo7 off=6133795 len=837091 2024-01-13T18:33:06.863 INFO:tasks.workunit.client.0.smithi084.stdout:op 3585 completed, throughput=5MB/sec 2024-01-13T18:33:06.863 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9r0epJxNVlOjff2 off=1219346 len=1538001 2024-01-13T18:33:06.870 INFO:tasks.workunit.client.0.smithi084.stdout:op 3586 completed, throughput=5MB/sec 2024-01-13T18:33:06.870 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gjuWmFoHj2yUGRj off=88672 len=1673434 2024-01-13T18:33:06.873 INFO:tasks.workunit.client.0.smithi084.stdout:op 3587 completed, throughput=5MB/sec 2024-01-13T18:33:06.873 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iyzpZww4e2ER2-o off=4594020 len=547738 2024-01-13T18:33:06.877 INFO:tasks.workunit.client.0.smithi084.stdout:op 3588 completed, throughput=5MB/sec 2024-01-13T18:33:07.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:07 smithi099 ceph-mon[138788]: pgmap v1839: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:33:07.877 INFO:tasks.workunit.client.0.smithi084.stdout: 710: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:07.877 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YaH37IOaItEIKL_ off=15784249 len=1145946 2024-01-13T18:33:07.879 INFO:tasks.workunit.client.0.smithi084.stdout:op 3589 completed, throughput=5MB/sec 2024-01-13T18:33:07.879 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9lnlxSHaX-b9eze off=4573993 len=615430 2024-01-13T18:33:07.883 INFO:tasks.workunit.client.0.smithi084.stdout:op 3590 completed, throughput=5MB/sec 2024-01-13T18:33:07.883 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QruQmjkwPjc6pWT off=5232285 len=369813 2024-01-13T18:33:07.886 INFO:tasks.workunit.client.0.smithi084.stdout:op 3591 completed, throughput=5MB/sec 2024-01-13T18:33:07.886 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SsqtoB1SEbADLm1 off=7214062 len=805765 2024-01-13T18:33:07.890 INFO:tasks.workunit.client.0.smithi084.stdout:op 3592 completed, throughput=5MB/sec 2024-01-13T18:33:07.891 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FNtrd6O_WkE6e1n off=18826193 len=1841373 2024-01-13T18:33:07.901 INFO:tasks.workunit.client.0.smithi084.stdout:op 3593 completed, throughput=5MB/sec 2024-01-13T18:33:07.901 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iaQ2i0ehy5dCuSy off=2614890 len=1314480 2024-01-13T18:33:07.902 INFO:tasks.workunit.client.0.smithi084.stdout:op 3594 completed, throughput=5MB/sec 2024-01-13T18:33:07.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:07 smithi084 ceph-mon[116404]: pgmap v1839: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:33:07.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:07 smithi084 ceph-mon[119097]: pgmap v1839: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:33:08.903 INFO:tasks.workunit.client.0.smithi084.stdout: 711: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:08.903 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-emtnQaq_a0xhuQ4 off=555048 len=1300848 2024-01-13T18:33:08.910 INFO:tasks.workunit.client.0.smithi084.stdout:op 3595 completed, throughput=5MB/sec 2024-01-13T18:33:08.910 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gi1OZ3VYUU44ddI off=799722 len=676953 2024-01-13T18:33:08.914 INFO:tasks.workunit.client.0.smithi084.stdout:op 3596 completed, throughput=5MB/sec 2024-01-13T18:33:08.914 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fAAlZbL6Oi2bg9T off=11791943 len=1951387 2024-01-13T18:33:08.925 INFO:tasks.workunit.client.0.smithi084.stdout:op 3597 completed, throughput=5MB/sec 2024-01-13T18:33:08.925 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rGkop7BYFJMMVij off=14700397 len=736675 2024-01-13T18:33:08.929 INFO:tasks.workunit.client.0.smithi084.stdout:op 3598 completed, throughput=5MB/sec 2024-01-13T18:33:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:09 smithi099 ceph-mon[138788]: pgmap v1840: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:33:09.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:09 smithi084 ceph-mon[116404]: pgmap v1840: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:33:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:09 smithi084 ceph-mon[119097]: pgmap v1840: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:33:09.929 INFO:tasks.workunit.client.0.smithi084.stdout: 712: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:09.929 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-enfIaaEBt1jXC8U off=208536 len=1726730 2024-01-13T18:33:09.931 INFO:tasks.workunit.client.0.smithi084.stdout:op 3599 completed, throughput=5MB/sec 2024-01-13T18:33:09.931 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ruFn9bWn03pI6H- off=17752286 len=966521 2024-01-13T18:33:09.936 INFO:tasks.workunit.client.0.smithi084.stdout:op 3600 completed, throughput=5MB/sec 2024-01-13T18:33:09.936 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--Mz622wvMuph3XL off=175943 len=1158381 2024-01-13T18:33:09.944 INFO:tasks.workunit.client.0.smithi084.stdout:op 3601 completed, throughput=5MB/sec 2024-01-13T18:33:09.944 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-R02cc9u3JFxWJ7a off=3526944 len=25334 2024-01-13T18:33:09.946 INFO:tasks.workunit.client.0.smithi084.stdout:op 3602 completed, throughput=5MB/sec 2024-01-13T18:33:09.947 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-leqEesf6DVbSuum off=514310 len=1782388 2024-01-13T18:33:09.948 INFO:tasks.workunit.client.0.smithi084.stdout:op 3603 completed, throughput=5MB/sec 2024-01-13T18:33:10.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:33:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:33:10] "GET /metrics HTTP/1.1" 200 34000 "" "Prometheus/2.43.0" 2024-01-13T18:33:10.949 INFO:tasks.workunit.client.0.smithi084.stdout: 713: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:10.949 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6JbfW3mNYU1nlI3 off=285109 len=1375336 2024-01-13T18:33:10.956 INFO:tasks.workunit.client.0.smithi084.stdout:op 3604 completed, throughput=5MB/sec 2024-01-13T18:33:10.956 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_ukwKrDBMyWMJPc off=528321 len=2070732 2024-01-13T18:33:10.964 INFO:tasks.workunit.client.0.smithi084.stdout:op 3605 completed, throughput=5MB/sec 2024-01-13T18:33:10.964 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zcUb5CiDA2Jsjg5 off=355871 len=2004095 2024-01-13T18:33:10.976 INFO:tasks.workunit.client.0.smithi084.stdout:op 3606 completed, throughput=5MB/sec 2024-01-13T18:33:11.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:11 smithi099 ceph-mon[138788]: pgmap v1841: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:33:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:11 smithi084 ceph-mon[116404]: pgmap v1841: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:33:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:11 smithi084 ceph-mon[119097]: pgmap v1841: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:33:11.975 INFO:tasks.workunit.client.0.smithi084.stdout: 714: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:11.975 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QLc7XMjTRnI87Jj off=5404103 len=1158248 2024-01-13T18:33:11.978 INFO:tasks.workunit.client.0.smithi084.stdout:op 3607 completed, throughput=5MB/sec 2024-01-13T18:33:11.978 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KnctUezJegklWSR off=10354393 len=1814136 2024-01-13T18:33:11.987 INFO:tasks.workunit.client.0.smithi084.stdout:op 3608 completed, throughput=5MB/sec 2024-01-13T18:33:11.987 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pgcL7WdM4fq68hW off=15295156 len=112168 2024-01-13T18:33:11.990 INFO:tasks.workunit.client.0.smithi084.stdout:op 3609 completed, throughput=5MB/sec 2024-01-13T18:33:11.990 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-q7OARLctqzUm8ut off=1733425 len=651565 2024-01-13T18:33:11.991 INFO:tasks.workunit.client.0.smithi084.stdout:op 3610 completed, throughput=5MB/sec 2024-01-13T18:33:11.991 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0VBQZdnR4Zul6gB off=428479 len=1512720 2024-01-13T18:33:11.994 INFO:tasks.workunit.client.0.smithi084.stdout:op 3611 completed, throughput=5MB/sec 2024-01-13T18:33:12.994 INFO:tasks.workunit.client.0.smithi084.stdout: 715: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:12.994 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-INnUw5fp3a5qUn9 off=2187279 len=1725772 2024-01-13T18:33:12.997 INFO:tasks.workunit.client.0.smithi084.stdout:op 3612 completed, throughput=5MB/sec 2024-01-13T18:33:12.998 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-au7ikwcfTrqTvri off=3464291 len=1253723 2024-01-13T18:33:13.003 INFO:tasks.workunit.client.0.smithi084.stdout:op 3613 completed, throughput=5MB/sec 2024-01-13T18:33:13.003 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YBEJYAppTxHmvUd off=1688809 len=94007 2024-01-13T18:33:13.004 INFO:tasks.workunit.client.0.smithi084.stdout:op 3614 completed, throughput=5MB/sec 2024-01-13T18:33:13.004 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-woC2-DZxYPVqghp off=3177727 len=891623 2024-01-13T18:33:13.008 INFO:tasks.workunit.client.0.smithi084.stdout:op 3615 completed, throughput=5MB/sec 2024-01-13T18:33:13.008 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FlNyFpLaoHu7v_p off=5201627 len=250391 2024-01-13T18:33:13.009 INFO:tasks.workunit.client.0.smithi084.stdout:op 3616 completed, throughput=5MB/sec 2024-01-13T18:33:13.009 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y-ODv7t38gecEcZ off=565241 len=1624149 2024-01-13T18:33:13.011 INFO:tasks.workunit.client.0.smithi084.stdout:op 3617 completed, throughput=5MB/sec 2024-01-13T18:33:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:13 smithi099 ceph-mon[138788]: pgmap v1842: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:13.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:13 smithi084 ceph-mon[116404]: pgmap v1842: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:13 smithi084 ceph-mon[119097]: pgmap v1842: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:14.012 INFO:tasks.workunit.client.0.smithi084.stdout: 716: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:14.012 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rigW5QqTBmx101f off=8588360 len=316333 2024-01-13T18:33:14.015 INFO:tasks.workunit.client.0.smithi084.stdout:op 3618 completed, throughput=5MB/sec 2024-01-13T18:33:14.015 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PnELQTmZCJbXurL off=15584633 len=1717580 2024-01-13T18:33:14.023 INFO:tasks.workunit.client.0.smithi084.stdout:op 3619 completed, throughput=5MB/sec 2024-01-13T18:33:14.023 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3BFiERocjENV8vV off=11232301 len=115515 2024-01-13T18:33:14.024 INFO:tasks.workunit.client.0.smithi084.stdout:op 3620 completed, throughput=5MB/sec 2024-01-13T18:33:14.024 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UdnqPODpLCpmOWR off=1581493 len=913054 2024-01-13T18:33:14.029 INFO:tasks.workunit.client.0.smithi084.stdout:op 3621 completed, throughput=5MB/sec 2024-01-13T18:33:14.029 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YXhwXMSf5LQtW6C off=4348813 len=771951 2024-01-13T18:33:14.031 INFO:tasks.workunit.client.0.smithi084.stdout:op 3622 completed, throughput=5MB/sec 2024-01-13T18:33:14.031 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dhq3ZdNjtI0Pcrv off=8654739 len=735326 2024-01-13T18:33:14.032 INFO:tasks.workunit.client.0.smithi084.stdout:op 3623 completed, throughput=5MB/sec 2024-01-13T18:33:15.032 INFO:tasks.workunit.client.0.smithi084.stdout: 717: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:15.032 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qoDLM92BAirTGxy off=11339325 len=976239 2024-01-13T18:33:15.037 INFO:tasks.workunit.client.0.smithi084.stdout:op 3624 completed, throughput=5MB/sec 2024-01-13T18:33:15.037 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FdYQjy1JrToDALG off=13017471 len=1762146 2024-01-13T18:33:15.045 INFO:tasks.workunit.client.0.smithi084.stdout:op 3625 completed, throughput=5MB/sec 2024-01-13T18:33:15.045 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RroltChWj1GjsDs off=7423343 len=160040 2024-01-13T18:33:15.046 INFO:tasks.workunit.client.0.smithi084.stdout:op 3626 completed, throughput=5MB/sec 2024-01-13T18:33:15.046 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-76e4sQ8mvwAiADG off=10939692 len=944808 2024-01-13T18:33:15.048 INFO:tasks.workunit.client.0.smithi084.stdout:op 3627 completed, throughput=5MB/sec 2024-01-13T18:33:15.048 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-c5O8pNRVYeEoihl off=456742 len=1856363 2024-01-13T18:33:15.050 INFO:tasks.workunit.client.0.smithi084.stdout:op 3628 completed, throughput=5MB/sec 2024-01-13T18:33:15.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:15 smithi099 ceph-mon[138788]: pgmap v1843: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:33:15.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:15 smithi084 ceph-mon[116404]: pgmap v1843: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:33:15.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:15 smithi084 ceph-mon[119097]: pgmap v1843: 105 pgs: 105 active+clean; 128 GiB data, 9.5 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:33:16.050 INFO:tasks.workunit.client.0.smithi084.stdout: 718: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:16.050 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k5sOP8_7EmB1uq3 off=7523737 len=411113 2024-01-13T18:33:16.053 INFO:tasks.workunit.client.0.smithi084.stdout:op 3629 completed, throughput=4.99MB/sec 2024-01-13T18:33:16.054 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Fu921lfc3-38fk9 off=9193232 len=1916206 2024-01-13T18:33:16.056 INFO:tasks.workunit.client.0.smithi084.stdout:op 3630 completed, throughput=5MB/sec 2024-01-13T18:33:16.056 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ew_d41ko5iQ5V4G off=3881038 len=383495 2024-01-13T18:33:16.059 INFO:tasks.workunit.client.0.smithi084.stdout:op 3631 completed, throughput=5MB/sec 2024-01-13T18:33:16.059 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TvUVlLVyKYBjwgB off=9086863 len=1729394 2024-01-13T18:33:16.063 INFO:tasks.workunit.client.0.smithi084.stdout:op 3632 completed, throughput=5MB/sec 2024-01-13T18:33:17.062 INFO:tasks.workunit.client.0.smithi084.stdout: 719: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:17.062 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-579DQh_VHIbzeQm off=18358205 len=1368210 2024-01-13T18:33:17.069 INFO:tasks.workunit.client.0.smithi084.stdout:op 3633 completed, throughput=4.99MB/sec 2024-01-13T18:33:17.070 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NMP8jyCDipfPasE off=0 len=1435998 2024-01-13T18:33:17.083 INFO:tasks.workunit.client.0.smithi084.stdout:op 3634 completed, throughput=5MB/sec 2024-01-13T18:33:17.083 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n3wc3SLbjw7NbAG off=10842849 len=1641704 2024-01-13T18:33:17.084 INFO:tasks.workunit.client.0.smithi084.stdout:op 3635 completed, throughput=5MB/sec 2024-01-13T18:33:17.084 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-b-8R7cxbqm7dU58 off=923182 len=211877 2024-01-13T18:33:17.084 INFO:tasks.workunit.client.0.smithi084.stdout:op 3636 completed, throughput=5MB/sec 2024-01-13T18:33:17.084 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VKX2ybxPsJFVKgm off=10778492 len=1433296 2024-01-13T18:33:17.086 INFO:tasks.workunit.client.0.smithi084.stdout:op 3637 completed, throughput=5MB/sec 2024-01-13T18:33:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:17 smithi099 ceph-mon[138788]: pgmap v1844: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:33:17.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:17 smithi084 ceph-mon[116404]: pgmap v1844: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:33:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:17 smithi084 ceph-mon[119097]: pgmap v1844: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:33:18.086 INFO:tasks.workunit.client.0.smithi084.stdout: 720: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:18.086 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--YTHsUkwEoWxQIo off=218684 len=595981 2024-01-13T18:33:18.090 INFO:tasks.workunit.client.0.smithi084.stdout:op 3638 completed, throughput=4.99MB/sec 2024-01-13T18:33:18.091 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g7bjXMGcroVoqls off=13932 len=1294103 2024-01-13T18:33:18.092 INFO:tasks.workunit.client.0.smithi084.stdout:op 3639 completed, throughput=5MB/sec 2024-01-13T18:33:18.092 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UC6gXw7ZSBxYV14 off=3971383 len=1700196 2024-01-13T18:33:18.100 INFO:tasks.workunit.client.0.smithi084.stdout:op 3640 completed, throughput=5MB/sec 2024-01-13T18:33:18.100 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-edQibCiJviPGe1C off=11125511 len=1524312 2024-01-13T18:33:18.106 INFO:tasks.workunit.client.0.smithi084.stdout:op 3641 completed, throughput=5MB/sec 2024-01-13T18:33:19.106 INFO:tasks.workunit.client.0.smithi084.stdout: 721: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:19.107 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MK_FU0Oz7Zs2RrD off=27362 len=1298845 2024-01-13T18:33:19.108 INFO:tasks.workunit.client.0.smithi084.stdout:op 3642 completed, throughput=5MB/sec 2024-01-13T18:33:19.108 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Xjpu7bQXX4IXmIE off=4955773 len=1780480 2024-01-13T18:33:19.123 INFO:tasks.workunit.client.0.smithi084.stdout:op 3643 completed, throughput=5MB/sec 2024-01-13T18:33:19.123 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5B7Mp6kGtpSrtv5 off=6824845 len=727554 2024-01-13T18:33:19.129 INFO:tasks.workunit.client.0.smithi084.stdout:op 3644 completed, throughput=5MB/sec 2024-01-13T18:33:19.129 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Rq-eDYfEKEqIIfA off=1913677 len=231131 2024-01-13T18:33:19.131 INFO:tasks.workunit.client.0.smithi084.stdout:op 3645 completed, throughput=5MB/sec 2024-01-13T18:33:19.131 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-j3NldoElY9wPPd2 off=103369 len=1546033 2024-01-13T18:33:19.132 INFO:tasks.workunit.client.0.smithi084.stdout:op 3646 completed, throughput=5MB/sec 2024-01-13T18:33:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:19 smithi099 ceph-mon[138788]: pgmap v1845: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:19.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:19 smithi084 ceph-mon[116404]: pgmap v1845: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:19 smithi084 ceph-mon[119097]: pgmap v1845: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:20.133 INFO:tasks.workunit.client.0.smithi084.stdout: 722: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:20.133 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0K_w6Jzez69I_SG off=2279492 len=1682392 2024-01-13T18:33:20.136 INFO:tasks.workunit.client.0.smithi084.stdout:op 3647 completed, throughput=5MB/sec 2024-01-13T18:33:20.136 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Zv7rMRc-4iIRr4i off=1476716 len=2072702 2024-01-13T18:33:20.139 INFO:tasks.workunit.client.0.smithi084.stdout:op 3648 completed, throughput=5MB/sec 2024-01-13T18:33:20.139 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g9gFKxp2MJf7fAv off=973915 len=759210 2024-01-13T18:33:20.140 INFO:tasks.workunit.client.0.smithi084.stdout:op 3649 completed, throughput=5MB/sec 2024-01-13T18:33:20.140 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wQ4Pad76bK7A9lX off=182355 len=1302841 2024-01-13T18:33:20.149 INFO:tasks.workunit.client.0.smithi084.stdout:op 3650 completed, throughput=5MB/sec 2024-01-13T18:33:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:33:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:33:20] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:33:21.149 INFO:tasks.workunit.client.0.smithi084.stdout: 723: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:21.149 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WlmSQDYIaVmDiw- off=320502 len=240477 2024-01-13T18:33:21.152 INFO:tasks.workunit.client.0.smithi084.stdout:op 3651 completed, throughput=5MB/sec 2024-01-13T18:33:21.152 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VKrKIsbj-UmaRGy off=18827212 len=2090540 2024-01-13T18:33:21.154 INFO:tasks.workunit.client.0.smithi084.stdout:op 3652 completed, throughput=5MB/sec 2024-01-13T18:33:21.154 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UOg4KqBxBZPPI_O off=2931878 len=1204383 2024-01-13T18:33:21.161 INFO:tasks.workunit.client.0.smithi084.stdout:op 3653 completed, throughput=5MB/sec 2024-01-13T18:33:21.162 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yI9hnfs-kxh8_af off=4914809 len=1259948 2024-01-13T18:33:21.163 INFO:tasks.workunit.client.0.smithi084.stdout:op 3654 completed, throughput=5MB/sec 2024-01-13T18:33:21.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:21 smithi099 ceph-mon[138788]: pgmap v1846: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:21.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:21 smithi084 ceph-mon[116404]: pgmap v1846: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:21 smithi084 ceph-mon[119097]: pgmap v1846: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:22.163 INFO:tasks.workunit.client.0.smithi084.stdout: 724: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:22.164 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XJOiVjB9xMV39CF off=1642432 len=1585627 2024-01-13T18:33:22.170 INFO:tasks.workunit.client.0.smithi084.stdout:op 3655 completed, throughput=5MB/sec 2024-01-13T18:33:22.171 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SUZJHqDT98JJqHL off=14195620 len=1703357 2024-01-13T18:33:22.182 INFO:tasks.workunit.client.0.smithi084.stdout:op 3656 completed, throughput=5MB/sec 2024-01-13T18:33:22.182 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oDedA0fBdjblQSk off=629017 len=1468181 2024-01-13T18:33:22.187 INFO:tasks.workunit.client.0.smithi084.stdout:op 3657 completed, throughput=5MB/sec 2024-01-13T18:33:23.188 INFO:tasks.workunit.client.0.smithi084.stdout: 725: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:23.188 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AZ73zaYQa7t9yuy off=3961844 len=1177474 2024-01-13T18:33:23.189 INFO:tasks.workunit.client.0.smithi084.stdout:op 3658 completed, throughput=4.99MB/sec 2024-01-13T18:33:23.189 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uoeGgUp8vLJPhVD off=4817667 len=864838 2024-01-13T18:33:23.191 INFO:tasks.workunit.client.0.smithi084.stdout:op 3659 completed, throughput=5MB/sec 2024-01-13T18:33:23.191 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WdbGqxf2Lsl2fe3 off=388085 len=1082861 2024-01-13T18:33:23.197 INFO:tasks.workunit.client.0.smithi084.stdout:op 3660 completed, throughput=5MB/sec 2024-01-13T18:33:23.197 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZExJA_7VVlvBtix off=495348 len=1323204 2024-01-13T18:33:23.204 INFO:tasks.workunit.client.0.smithi084.stdout:op 3661 completed, throughput=5MB/sec 2024-01-13T18:33:23.204 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wNydq8F097jgD1r off=2200798 len=1059905 2024-01-13T18:33:23.205 INFO:tasks.workunit.client.0.smithi084.stdout:op 3662 completed, throughput=5MB/sec 2024-01-13T18:33:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:23 smithi099 ceph-mon[138788]: pgmap v1847: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:33:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:23 smithi084 ceph-mon[116404]: pgmap v1847: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:33:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:23 smithi084 ceph-mon[119097]: pgmap v1847: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:33:24.205 INFO:tasks.workunit.client.0.smithi084.stdout: 726: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:24.205 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1IV4X8z7jCWGbdj off=1025923 len=1334126 2024-01-13T18:33:24.212 INFO:tasks.workunit.client.0.smithi084.stdout:op 3663 completed, throughput=5MB/sec 2024-01-13T18:33:24.212 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kvk0ER95eIM3kAa off=836006 len=1879943 2024-01-13T18:33:24.216 INFO:tasks.workunit.client.0.smithi084.stdout:op 3664 completed, throughput=5MB/sec 2024-01-13T18:33:24.216 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xEZysgDElexzRfl off=5945655 len=1285956 2024-01-13T18:33:24.222 INFO:tasks.workunit.client.0.smithi084.stdout:op 3665 completed, throughput=5MB/sec 2024-01-13T18:33:24.223 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3IP4rAKg7pAg4-v off=22874314 len=1078603 2024-01-13T18:33:24.224 INFO:tasks.workunit.client.0.smithi084.stdout:op 3666 completed, throughput=5MB/sec 2024-01-13T18:33:25.224 INFO:tasks.workunit.client.0.smithi084.stdout: 727: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:25.224 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FFeN_FkehrbXBJI off=535353 len=1913109 2024-01-13T18:33:25.228 INFO:tasks.workunit.client.0.smithi084.stdout:op 3667 completed, throughput=5MB/sec 2024-01-13T18:33:25.228 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Pw9M3uETC4tZ7Gp off=16435793 len=745664 2024-01-13T18:33:25.232 INFO:tasks.workunit.client.0.smithi084.stdout:op 3668 completed, throughput=5MB/sec 2024-01-13T18:33:25.233 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ctff-AQ0ArhnmVz off=24023755 len=1184542 2024-01-13T18:33:25.240 INFO:tasks.workunit.client.0.smithi084.stdout:op 3669 completed, throughput=5MB/sec 2024-01-13T18:33:25.240 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hqs6BKtcxfypLxy off=2856800 len=860773 2024-01-13T18:33:25.245 INFO:tasks.workunit.client.0.smithi084.stdout:op 3670 completed, throughput=5MB/sec 2024-01-13T18:33:25.245 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2qwiedH-00SmXOj off=9515374 len=1588772 2024-01-13T18:33:25.247 INFO:tasks.workunit.client.0.smithi084.stdout:op 3671 completed, throughput=5MB/sec 2024-01-13T18:33:25.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:25 smithi099 ceph-mon[138788]: pgmap v1848: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:25.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:25 smithi084 ceph-mon[116404]: pgmap v1848: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:25.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:25 smithi084 ceph-mon[119097]: pgmap v1848: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:26.247 INFO:tasks.workunit.client.0.smithi084.stdout: 728: throughput=5MB/sec pending data=0 2024-01-13T18:33:26.247 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9-0x0PknSJl_XHu off=13213884 len=1288428 2024-01-13T18:33:26.249 INFO:tasks.workunit.client.0.smithi084.stdout:op 3672 completed, throughput=5MB/sec 2024-01-13T18:33:26.249 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XFQp7CXtAnh0Zm9 off=12694414 len=2080407 2024-01-13T18:33:26.261 INFO:tasks.workunit.client.0.smithi084.stdout:op 3673 completed, throughput=5MB/sec 2024-01-13T18:33:26.261 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WEbFWm2Wc_5hJdN off=18564401 len=178056 2024-01-13T18:33:26.261 INFO:tasks.workunit.client.0.smithi084.stdout:op 3674 completed, throughput=5MB/sec 2024-01-13T18:33:26.261 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pXQTy11_zZfH4vE off=8940165 len=2043473 2024-01-13T18:33:26.271 INFO:tasks.workunit.client.0.smithi084.stdout:op 3675 completed, throughput=5MB/sec 2024-01-13T18:33:27.271 INFO:tasks.workunit.client.0.smithi084.stdout: 729: throughput=5MB/sec pending data=0 2024-01-13T18:33:27.271 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GDosDCMQz0t38jL off=12726388 len=821533 2024-01-13T18:33:27.276 INFO:tasks.workunit.client.0.smithi084.stdout:op 3676 completed, throughput=5MB/sec 2024-01-13T18:33:27.276 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8UuaZMcYXAauozS off=5324370 len=376328 2024-01-13T18:33:27.277 INFO:tasks.workunit.client.0.smithi084.stdout:op 3677 completed, throughput=5MB/sec 2024-01-13T18:33:27.277 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Bv_swx9hbsgU4IJ off=5660319 len=921546 2024-01-13T18:33:27.282 INFO:tasks.workunit.client.0.smithi084.stdout:op 3678 completed, throughput=5MB/sec 2024-01-13T18:33:27.282 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NoyjGFKAx1XJ52j off=2970290 len=1525803 2024-01-13T18:33:27.287 INFO:tasks.workunit.client.0.smithi084.stdout:op 3679 completed, throughput=5MB/sec 2024-01-13T18:33:27.288 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iaQ2i0ehy5dCuSy off=4722651 len=114765 2024-01-13T18:33:27.288 INFO:tasks.workunit.client.0.smithi084.stdout:op 3680 completed, throughput=5MB/sec 2024-01-13T18:33:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:27 smithi099 ceph-mon[138788]: pgmap v1849: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:33:27.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:27 smithi084 ceph-mon[116404]: pgmap v1849: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:33:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:27 smithi084 ceph-mon[119097]: pgmap v1849: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:33:28.288 INFO:tasks.workunit.client.0.smithi084.stdout: 730: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:28.288 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ys0Q7W8nqsQcd3L off=5207902 len=2095210 2024-01-13T18:33:28.300 INFO:tasks.workunit.client.0.smithi084.stdout:op 3681 completed, throughput=5MB/sec 2024-01-13T18:33:28.300 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NMWLbGJUTlyAld3 off=11404551 len=318792 2024-01-13T18:33:28.304 INFO:tasks.workunit.client.0.smithi084.stdout:op 3682 completed, throughput=5MB/sec 2024-01-13T18:33:28.304 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Hoqwp3KAtd8-DV4 off=5476939 len=1087415 2024-01-13T18:33:28.305 INFO:tasks.workunit.client.0.smithi084.stdout:op 3683 completed, throughput=5MB/sec 2024-01-13T18:33:28.305 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wlchCJbz4wtRVZg off=24012581 len=1440837 2024-01-13T18:33:28.308 INFO:tasks.workunit.client.0.smithi084.stdout:op 3684 completed, throughput=5MB/sec 2024-01-13T18:33:28.308 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BxSIN3rgCrenDfK off=3843541 len=1438785 2024-01-13T18:33:28.310 INFO:tasks.workunit.client.0.smithi084.stdout:op 3685 completed, throughput=5MB/sec 2024-01-13T18:33:29.310 INFO:tasks.workunit.client.0.smithi084.stdout: 731: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:29.310 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XJrFVYYilrRbhhS off=1233278 len=1870684 2024-01-13T18:33:29.312 INFO:tasks.workunit.client.0.smithi084.stdout:op 3686 completed, throughput=5MB/sec 2024-01-13T18:33:29.312 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3rIu8PcEdrnwdNV off=8906302 len=166451 2024-01-13T18:33:29.314 INFO:tasks.workunit.client.0.smithi084.stdout:op 3687 completed, throughput=5MB/sec 2024-01-13T18:33:29.315 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5ctJEe8WS8Xy4mb off=931686 len=22037 2024-01-13T18:33:29.315 INFO:tasks.workunit.client.0.smithi084.stdout:op 3688 completed, throughput=5MB/sec 2024-01-13T18:33:29.315 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gOTq1qg3zq-9FDg off=917755 len=280576 2024-01-13T18:33:29.315 INFO:tasks.workunit.client.0.smithi084.stdout:op 3689 completed, throughput=5MB/sec 2024-01-13T18:33:29.315 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bwunTwXxdsq6f3o off=12143947 len=730791 2024-01-13T18:33:29.318 INFO:tasks.workunit.client.0.smithi084.stdout:op 3690 completed, throughput=5MB/sec 2024-01-13T18:33:29.319 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NqX4dvUwDbQ4dlI off=427853 len=497403 2024-01-13T18:33:29.319 INFO:tasks.workunit.client.0.smithi084.stdout:op 3691 completed, throughput=5MB/sec 2024-01-13T18:33:29.319 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iJ4PikO1rzWO6Wi off=10225141 len=462645 2024-01-13T18:33:29.322 INFO:tasks.workunit.client.0.smithi084.stdout:op 3692 completed, throughput=5MB/sec 2024-01-13T18:33:29.322 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DGkWYy6VVLtSgz5 off=16168454 len=901914 2024-01-13T18:33:29.327 INFO:tasks.workunit.client.0.smithi084.stdout:op 3693 completed, throughput=5MB/sec 2024-01-13T18:33:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:29 smithi099 ceph-mon[138788]: pgmap v1850: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:33:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:33:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:33:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:33:29.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:29 smithi084 ceph-mon[116404]: pgmap v1850: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:29.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:33:29.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:33:29.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:33:29.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:33:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:29 smithi084 ceph-mon[119097]: pgmap v1850: 105 pgs: 105 active+clean; 128 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:33:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:33:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:33:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:33:30.327 INFO:tasks.workunit.client.0.smithi084.stdout: 732: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:30.327 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JqsDnBCrrdqHz3b off=5948713 len=1839068 2024-01-13T18:33:30.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 3694 completed, throughput=5MB/sec 2024-01-13T18:33:30.329 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-F-LwoBIJwXx-X2b off=11416167 len=913732 2024-01-13T18:33:30.330 INFO:tasks.workunit.client.0.smithi084.stdout:op 3695 completed, throughput=5MB/sec 2024-01-13T18:33:30.330 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5gzla5dVy4_m_g4 off=1067030 len=1479567 2024-01-13T18:33:30.333 INFO:tasks.workunit.client.0.smithi084.stdout:op 3696 completed, throughput=5MB/sec 2024-01-13T18:33:30.333 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KTK3FDpO02U7IGI off=2728189 len=1873743 2024-01-13T18:33:30.335 INFO:tasks.workunit.client.0.smithi084.stdout:op 3697 completed, throughput=5MB/sec 2024-01-13T18:33:30.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:33:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:33:30] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:33:31.336 INFO:tasks.workunit.client.0.smithi084.stdout: 733: throughput=5MB/sec pending data=0 2024-01-13T18:33:31.336 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nF9t1JKmdffF2X2 off=1941503 len=1108806 2024-01-13T18:33:31.338 INFO:tasks.workunit.client.0.smithi084.stdout:op 3698 completed, throughput=5MB/sec 2024-01-13T18:33:31.338 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lAVd5XOV6CdmULR off=3318162 len=1039426 2024-01-13T18:33:31.339 INFO:tasks.workunit.client.0.smithi084.stdout:op 3699 completed, throughput=5MB/sec 2024-01-13T18:33:31.339 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0Z_KGdmVkfRcGj7 off=11235654 len=1274826 2024-01-13T18:33:31.345 INFO:tasks.workunit.client.0.smithi084.stdout:op 3700 completed, throughput=5MB/sec 2024-01-13T18:33:31.345 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4pDoTgJ4DBf_pwA off=5397419 len=2039941 2024-01-13T18:33:31.352 INFO:tasks.workunit.client.0.smithi084.stdout:op 3701 completed, throughput=5MB/sec 2024-01-13T18:33:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:31 smithi099 ceph-mon[138788]: pgmap v1851: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:33:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:31 smithi084 ceph-mon[116404]: pgmap v1851: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:33:31.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:31 smithi084 ceph-mon[119097]: pgmap v1851: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:33:32.353 INFO:tasks.workunit.client.0.smithi084.stdout: 734: throughput=5MB/sec pending data=0 2024-01-13T18:33:32.353 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Iabjlt1D6k1UblO off=8424379 len=621907 2024-01-13T18:33:32.356 INFO:tasks.workunit.client.0.smithi084.stdout:op 3702 completed, throughput=5MB/sec 2024-01-13T18:33:32.357 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qevCgahF9LPHUo0 off=10613338 len=667828 2024-01-13T18:33:32.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 3703 completed, throughput=5MB/sec 2024-01-13T18:33:32.361 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kL5uS2OHz-7cIap off=1920835 len=1543760 2024-01-13T18:33:32.370 INFO:tasks.workunit.client.0.smithi084.stdout:op 3704 completed, throughput=5MB/sec 2024-01-13T18:33:32.370 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5GLqTs_MPyBcPR9 off=21163473 len=855122 2024-01-13T18:33:32.375 INFO:tasks.workunit.client.0.smithi084.stdout:op 3705 completed, throughput=5MB/sec 2024-01-13T18:33:32.375 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wDf2n1EnlCXUcle off=6326961 len=947384 2024-01-13T18:33:32.380 INFO:tasks.workunit.client.0.smithi084.stdout:op 3706 completed, throughput=5MB/sec 2024-01-13T18:33:33.380 INFO:tasks.workunit.client.0.smithi084.stdout: 735: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:33.380 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g_syh58XDcVUNFG off=7948090 len=1658023 2024-01-13T18:33:33.382 INFO:tasks.workunit.client.0.smithi084.stdout:op 3707 completed, throughput=5MB/sec 2024-01-13T18:33:33.382 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gCGFYhTvO1r3b6v off=302944 len=1914388 2024-01-13T18:33:33.394 INFO:tasks.workunit.client.0.smithi084.stdout:op 3708 completed, throughput=5MB/sec 2024-01-13T18:33:33.394 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jgevN-5JbBlw62V off=7468673 len=1633426 2024-01-13T18:33:33.395 INFO:tasks.workunit.client.0.smithi084.stdout:op 3709 completed, throughput=5MB/sec 2024-01-13T18:33:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:33 smithi099 ceph-mon[138788]: pgmap v1852: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:33.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:33 smithi084 ceph-mon[116404]: pgmap v1852: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:33 smithi084 ceph-mon[119097]: pgmap v1852: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:33:34.395 INFO:tasks.workunit.client.0.smithi084.stdout: 736: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:34.396 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JGt11UYHilssnJM off=4340062 len=1153638 2024-01-13T18:33:34.397 INFO:tasks.workunit.client.0.smithi084.stdout:op 3710 completed, throughput=5MB/sec 2024-01-13T18:33:34.397 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RrkZWy6EDt6ql0V off=2759210 len=1525098 2024-01-13T18:33:34.405 INFO:tasks.workunit.client.0.smithi084.stdout:op 3711 completed, throughput=5MB/sec 2024-01-13T18:33:34.405 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bz1ryptFWVp2zJg off=7292299 len=1758837 2024-01-13T18:33:34.407 INFO:tasks.workunit.client.0.smithi084.stdout:op 3712 completed, throughput=5MB/sec 2024-01-13T18:33:34.407 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6CI0V873qlUtaJ1 off=920372 len=1418766 2024-01-13T18:33:34.416 INFO:tasks.workunit.client.0.smithi084.stdout:op 3713 completed, throughput=5MB/sec 2024-01-13T18:33:35.416 INFO:tasks.workunit.client.0.smithi084.stdout: 737: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:35.416 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KS-jANFCxHrOE3o off=4410253 len=290595 2024-01-13T18:33:35.417 INFO:tasks.workunit.client.0.smithi084.stdout:op 3714 completed, throughput=5MB/sec 2024-01-13T18:33:35.417 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DIgxMBuGO8NUwSD off=4350866 len=1961599 2024-01-13T18:33:35.421 INFO:tasks.workunit.client.0.smithi084.stdout:op 3715 completed, throughput=5MB/sec 2024-01-13T18:33:35.421 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CLXUmSrT4ruTSQU off=7077694 len=1808924 2024-01-13T18:33:35.424 INFO:tasks.workunit.client.0.smithi084.stdout:op 3716 completed, throughput=5MB/sec 2024-01-13T18:33:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:35 smithi099 ceph-mon[138788]: pgmap v1853: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:35 smithi084 ceph-mon[116404]: pgmap v1853: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:35 smithi084 ceph-mon[119097]: pgmap v1853: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:36.425 INFO:tasks.workunit.client.0.smithi084.stdout: 738: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:36.425 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N9szRCu86AGanZw off=11017232 len=486365 2024-01-13T18:33:36.425 INFO:tasks.workunit.client.0.smithi084.stdout:op 3717 completed, throughput=4.99MB/sec 2024-01-13T18:33:36.426 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qbHe8fn4b7_YB2w off=5434226 len=545260 2024-01-13T18:33:36.430 INFO:tasks.workunit.client.0.smithi084.stdout:op 3718 completed, throughput=4.99MB/sec 2024-01-13T18:33:36.430 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MY1Ba4ds6ztVHjo off=6541493 len=1078803 2024-01-13T18:33:36.436 INFO:tasks.workunit.client.0.smithi084.stdout:op 3719 completed, throughput=5MB/sec 2024-01-13T18:33:36.436 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8iwJhnyZyGM4eho off=18525967 len=788722 2024-01-13T18:33:36.437 INFO:tasks.workunit.client.0.smithi084.stdout:op 3720 completed, throughput=5MB/sec 2024-01-13T18:33:36.437 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qb_EjKcYdwzzIqA off=13287410 len=1925808 2024-01-13T18:33:36.439 INFO:tasks.workunit.client.0.smithi084.stdout:op 3721 completed, throughput=5MB/sec 2024-01-13T18:33:36.439 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ggTrEa5onp4D6Pz off=5909869 len=2085174 2024-01-13T18:33:36.450 INFO:tasks.workunit.client.0.smithi084.stdout:op 3722 completed, throughput=5MB/sec 2024-01-13T18:33:37.450 INFO:tasks.workunit.client.0.smithi084.stdout: 739: throughput=5MB/sec pending data=0 2024-01-13T18:33:37.451 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WV9jit4PQJWlZD2 off=16614122 len=1298805 2024-01-13T18:33:37.452 INFO:tasks.workunit.client.0.smithi084.stdout:op 3723 completed, throughput=5MB/sec 2024-01-13T18:33:37.452 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-H7bR9-8Lcym_J-t off=17840910 len=611312 2024-01-13T18:33:37.456 INFO:tasks.workunit.client.0.smithi084.stdout:op 3724 completed, throughput=5MB/sec 2024-01-13T18:33:37.456 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iXw_Zj1_nlfAS8_ off=10256742 len=254405 2024-01-13T18:33:37.457 INFO:tasks.workunit.client.0.smithi084.stdout:op 3725 completed, throughput=5MB/sec 2024-01-13T18:33:37.457 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PqUGQAWl_l7isFI off=2399812 len=1954777 2024-01-13T18:33:37.466 INFO:tasks.workunit.client.0.smithi084.stdout:op 3726 completed, throughput=5MB/sec 2024-01-13T18:33:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:37 smithi099 ceph-mon[138788]: pgmap v1854: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 3 op/s 2024-01-13T18:33:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:37 smithi084 ceph-mon[116404]: pgmap v1854: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 3 op/s 2024-01-13T18:33:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:37 smithi084 ceph-mon[119097]: pgmap v1854: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 3 op/s 2024-01-13T18:33:38.466 INFO:tasks.workunit.client.0.smithi084.stdout: 740: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:38.467 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4e9xHgWSnvdY32v off=9839889 len=829399 2024-01-13T18:33:38.471 INFO:tasks.workunit.client.0.smithi084.stdout:op 3727 completed, throughput=4.99MB/sec 2024-01-13T18:33:38.471 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TRlh_8ADeGa7Yqw off=1497918 len=724003 2024-01-13T18:33:38.473 INFO:tasks.workunit.client.0.smithi084.stdout:op 3728 completed, throughput=5MB/sec 2024-01-13T18:33:38.473 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yPQJ-wXh_CMvoN4 off=14534909 len=1870945 2024-01-13T18:33:38.482 INFO:tasks.workunit.client.0.smithi084.stdout:op 3729 completed, throughput=5MB/sec 2024-01-13T18:33:38.482 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5fo59Nva4EHCixh off=1096840 len=1603980 2024-01-13T18:33:38.489 INFO:tasks.workunit.client.0.smithi084.stdout:op 3730 completed, throughput=5MB/sec 2024-01-13T18:33:39.490 INFO:tasks.workunit.client.0.smithi084.stdout: 741: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:39.490 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-N2kDxRoHoUSG4MD off=4388027 len=1180121 2024-01-13T18:33:39.495 INFO:tasks.workunit.client.0.smithi084.stdout:op 3731 completed, throughput=4.99MB/sec 2024-01-13T18:33:39.495 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-v3l8nDBD0Xlf9od off=19123686 len=1279622 2024-01-13T18:33:39.502 INFO:tasks.workunit.client.0.smithi084.stdout:op 3732 completed, throughput=5MB/sec 2024-01-13T18:33:39.502 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tVU0CS2BDhfdTOe off=8531474 len=1922934 2024-01-13T18:33:39.512 INFO:tasks.workunit.client.0.smithi084.stdout:op 3733 completed, throughput=5MB/sec 2024-01-13T18:33:39.513 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sJ6XQ6OMezNYV3i off=12744877 len=1340979 2024-01-13T18:33:39.514 INFO:tasks.workunit.client.0.smithi084.stdout:op 3734 completed, throughput=5MB/sec 2024-01-13T18:33:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:39 smithi099 ceph-mon[138788]: pgmap v1855: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:33:39.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:39 smithi084 ceph-mon[116404]: pgmap v1855: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:33:39.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:39 smithi084 ceph-mon[119097]: pgmap v1855: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:33:40.514 INFO:tasks.workunit.client.0.smithi084.stdout: 742: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ifu7xAGOlKqNVd1 off=8953451 len=639729 2024-01-13T18:33:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:op 3735 completed, throughput=4.99MB/sec 2024-01-13T18:33:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4jfAYQPRmGh7W8G off=11446586 len=1529625 2024-01-13T18:33:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:op 3736 completed, throughput=5MB/sec 2024-01-13T18:33:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QFQxXZt1oDIxujz off=292700 len=1418384 2024-01-13T18:33:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:op 3737 completed, throughput=5MB/sec 2024-01-13T18:33:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-d058aIipgwhbLKd off=22340027 len=731094 2024-01-13T18:33:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:op 3738 completed, throughput=5MB/sec 2024-01-13T18:33:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Urr8_p3qegfh7Ob off=9572115 len=1858897 2024-01-13T18:33:40.533 INFO:tasks.workunit.client.0.smithi084.stdout:op 3739 completed, throughput=5MB/sec 2024-01-13T18:33:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:33:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:33:40] "GET /metrics HTTP/1.1" 200 34003 "" "Prometheus/2.43.0" 2024-01-13T18:33:41.534 INFO:tasks.workunit.client.0.smithi084.stdout: 743: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:41.534 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e3nEz_5ctw85vfB off=780446 len=1127030 2024-01-13T18:33:41.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 3740 completed, throughput=5MB/sec 2024-01-13T18:33:41.543 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2Q1hqHJC9QTyWtu off=322963 len=752496 2024-01-13T18:33:41.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 3741 completed, throughput=5MB/sec 2024-01-13T18:33:41.543 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Oox0WBtCGMiKS4s off=542014 len=1502898 2024-01-13T18:33:41.549 INFO:tasks.workunit.client.0.smithi084.stdout:op 3742 completed, throughput=5MB/sec 2024-01-13T18:33:41.549 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-N1ZVAQqaAXtxkG8 off=4680099 len=1150066 2024-01-13T18:33:41.555 INFO:tasks.workunit.client.0.smithi084.stdout:op 3743 completed, throughput=5MB/sec 2024-01-13T18:33:41.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:41 smithi099 ceph-mon[138788]: pgmap v1856: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:33:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:41 smithi084 ceph-mon[116404]: pgmap v1856: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:33:41.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:41 smithi084 ceph-mon[119097]: pgmap v1856: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:33:42.556 INFO:tasks.workunit.client.0.smithi084.stdout: 744: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:42.556 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VaPUsNd-Ie08TSy off=4312288 len=1337470 2024-01-13T18:33:42.562 INFO:tasks.workunit.client.0.smithi084.stdout:op 3744 completed, throughput=5MB/sec 2024-01-13T18:33:42.562 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7PXdioRhThP9BvA off=4913089 len=783165 2024-01-13T18:33:42.565 INFO:tasks.workunit.client.0.smithi084.stdout:op 3745 completed, throughput=5MB/sec 2024-01-13T18:33:42.566 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BKc6fx88_uscD3s off=3147995 len=1067285 2024-01-13T18:33:42.567 INFO:tasks.workunit.client.0.smithi084.stdout:op 3746 completed, throughput=5MB/sec 2024-01-13T18:33:42.567 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-l1j2miSa9XtNvXi off=6243497 len=389032 2024-01-13T18:33:42.570 INFO:tasks.workunit.client.0.smithi084.stdout:op 3747 completed, throughput=5MB/sec 2024-01-13T18:33:42.571 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MYF-FUM3AI_Evii off=837838 len=1764030 2024-01-13T18:33:42.577 INFO:tasks.workunit.client.0.smithi084.stdout:op 3748 completed, throughput=5MB/sec 2024-01-13T18:33:43.577 INFO:tasks.workunit.client.0.smithi084.stdout: 745: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:43.577 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-d5wmBgcU_rJZrnc off=1683628 len=257474 2024-01-13T18:33:43.578 INFO:tasks.workunit.client.0.smithi084.stdout:op 3749 completed, throughput=4.99MB/sec 2024-01-13T18:33:43.578 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y_TxJKnNhKMHum7 off=659783 len=1848381 2024-01-13T18:33:43.581 INFO:tasks.workunit.client.0.smithi084.stdout:op 3750 completed, throughput=5MB/sec 2024-01-13T18:33:43.582 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--fnWFgpL1DhXPYt off=2027296 len=1747396 2024-01-13T18:33:43.590 INFO:tasks.workunit.client.0.smithi084.stdout:op 3751 completed, throughput=5MB/sec 2024-01-13T18:33:43.590 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LUlt0zwUZKf0zz9 off=7670089 len=1818849 2024-01-13T18:33:43.593 INFO:tasks.workunit.client.0.smithi084.stdout:op 3752 completed, throughput=5MB/sec 2024-01-13T18:33:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:43 smithi099 ceph-mon[138788]: pgmap v1857: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:33:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:43 smithi084 ceph-mon[116404]: pgmap v1857: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:33:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:43 smithi084 ceph-mon[119097]: pgmap v1857: 105 pgs: 105 active+clean; 128 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:33:44.594 INFO:tasks.workunit.client.0.smithi084.stdout: 746: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:44.594 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VXEPpOC-wB_Y4s8 off=201794 len=201930 2024-01-13T18:33:44.597 INFO:tasks.workunit.client.0.smithi084.stdout:op 3753 completed, throughput=4.99MB/sec 2024-01-13T18:33:44.597 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-N1ZVAQqaAXtxkG8 off=6437778 len=53919 2024-01-13T18:33:44.600 INFO:tasks.workunit.client.0.smithi084.stdout:op 3754 completed, throughput=4.99MB/sec 2024-01-13T18:33:44.600 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EEjNlpP3GGYN7Hi off=4956436 len=1631175 2024-01-13T18:33:44.608 INFO:tasks.workunit.client.0.smithi084.stdout:op 3755 completed, throughput=5MB/sec 2024-01-13T18:33:44.608 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ytwjE-FDQ-NLuQ_ off=9595242 len=1180652 2024-01-13T18:33:44.614 INFO:tasks.workunit.client.0.smithi084.stdout:op 3756 completed, throughput=5MB/sec 2024-01-13T18:33:44.614 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-00mnl-BDJypdMAP off=715136 len=1023999 2024-01-13T18:33:44.619 INFO:tasks.workunit.client.0.smithi084.stdout:op 3757 completed, throughput=5MB/sec 2024-01-13T18:33:44.619 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ey0-1E9Oh8t4X_H off=6110389 len=993818 2024-01-13T18:33:44.621 INFO:tasks.workunit.client.0.smithi084.stdout:op 3758 completed, throughput=5MB/sec 2024-01-13T18:33:45.621 INFO:tasks.workunit.client.0.smithi084.stdout: 747: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:45.621 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-unD80mrBXFCqTmt off=23819742 len=84622 2024-01-13T18:33:45.622 INFO:tasks.workunit.client.0.smithi084.stdout:op 3759 completed, throughput=4.99MB/sec 2024-01-13T18:33:45.622 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-s0JJM25Tsr9wH2O off=1747956 len=1818211 2024-01-13T18:33:45.624 INFO:tasks.workunit.client.0.smithi084.stdout:op 3760 completed, throughput=5MB/sec 2024-01-13T18:33:45.624 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-s_QaK1Xrjvt1n5H off=205606 len=764054 2024-01-13T18:33:45.625 INFO:tasks.workunit.client.0.smithi084.stdout:op 3761 completed, throughput=5MB/sec 2024-01-13T18:33:45.625 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-B72s2ygOAOuuDtR off=11996206 len=1908495 2024-01-13T18:33:45.627 INFO:tasks.workunit.client.0.smithi084.stdout:op 3762 completed, throughput=5MB/sec 2024-01-13T18:33:45.627 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nosoYWMNloDD1jx off=5703883 len=210844 2024-01-13T18:33:45.631 INFO:tasks.workunit.client.0.smithi084.stdout:op 3763 completed, throughput=5MB/sec 2024-01-13T18:33:45.631 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XW2rbf_TbwoJsfh off=9278459 len=1267336 2024-01-13T18:33:45.632 INFO:tasks.workunit.client.0.smithi084.stdout:op 3764 completed, throughput=5MB/sec 2024-01-13T18:33:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:45 smithi099 ceph-mon[138788]: pgmap v1858: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:33:45.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:45 smithi084 ceph-mon[116404]: pgmap v1858: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:33:45.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:45 smithi084 ceph-mon[119097]: pgmap v1858: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 4 op/s 2024-01-13T18:33:46.632 INFO:tasks.workunit.client.0.smithi084.stdout: 748: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:46.632 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WhA_hnUnJKl8iW5 off=13950194 len=750142 2024-01-13T18:33:46.633 INFO:tasks.workunit.client.0.smithi084.stdout:op 3765 completed, throughput=5MB/sec 2024-01-13T18:33:46.633 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ckE1t5u7ogzqhuT off=8069027 len=1767217 2024-01-13T18:33:46.637 INFO:tasks.workunit.client.0.smithi084.stdout:op 3766 completed, throughput=5MB/sec 2024-01-13T18:33:46.637 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0pqdPXOnDPVCJYY off=2258961 len=1672322 2024-01-13T18:33:46.639 INFO:tasks.workunit.client.0.smithi084.stdout:op 3767 completed, throughput=5MB/sec 2024-01-13T18:33:47.639 INFO:tasks.workunit.client.0.smithi084.stdout: 749: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:47.640 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zbY5zWVVi92os9t off=1347626 len=890989 2024-01-13T18:33:47.640 INFO:tasks.workunit.client.0.smithi084.stdout:op 3768 completed, throughput=4.99MB/sec 2024-01-13T18:33:47.641 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DZlaoDbvKzm2ZSU off=2649331 len=455329 2024-01-13T18:33:47.644 INFO:tasks.workunit.client.0.smithi084.stdout:op 3769 completed, throughput=5MB/sec 2024-01-13T18:33:47.645 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CVPbfwbMD2KRQMe off=6234274 len=308071 2024-01-13T18:33:47.648 INFO:tasks.workunit.client.0.smithi084.stdout:op 3770 completed, throughput=5MB/sec 2024-01-13T18:33:47.648 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xKRNdoALd1rca2p off=5149410 len=905041 2024-01-13T18:33:47.649 INFO:tasks.workunit.client.0.smithi084.stdout:op 3771 completed, throughput=5MB/sec 2024-01-13T18:33:47.649 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7IQpqq61ncLZ5Mp off=9594071 len=956925 2024-01-13T18:33:47.650 INFO:tasks.workunit.client.0.smithi084.stdout:op 3772 completed, throughput=5MB/sec 2024-01-13T18:33:47.650 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4L5mqbCUGuxBanH off=79926 len=1182427 2024-01-13T18:33:47.656 INFO:tasks.workunit.client.0.smithi084.stdout:op 3773 completed, throughput=5MB/sec 2024-01-13T18:33:47.656 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kmxio3EYIabaKiV off=450152 len=675579 2024-01-13T18:33:47.657 INFO:tasks.workunit.client.0.smithi084.stdout:op 3774 completed, throughput=5MB/sec 2024-01-13T18:33:47.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:47 smithi099 ceph-mon[138788]: pgmap v1859: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:33:47.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:47 smithi084 ceph-mon[116404]: pgmap v1859: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:33:47.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:47 smithi084 ceph-mon[119097]: pgmap v1859: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:33:48.658 INFO:tasks.workunit.client.0.smithi084.stdout: 750: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:48.658 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5YlNWM5CJ_IMarp off=6029137 len=1509150 2024-01-13T18:33:48.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 3775 completed, throughput=5MB/sec 2024-01-13T18:33:48.659 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-60knDYAZ_t4Po-_ off=3270470 len=1181215 2024-01-13T18:33:48.661 INFO:tasks.workunit.client.0.smithi084.stdout:op 3776 completed, throughput=5MB/sec 2024-01-13T18:33:48.661 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-l3IzjNPQKQUljIs off=7391051 len=606779 2024-01-13T18:33:48.665 INFO:tasks.workunit.client.0.smithi084.stdout:op 3777 completed, throughput=5MB/sec 2024-01-13T18:33:48.666 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Uq7kv6saqLlWh7u off=0 len=1792033 2024-01-13T18:33:48.672 INFO:tasks.workunit.client.0.smithi084.stdout:op 3778 completed, throughput=5MB/sec 2024-01-13T18:33:48.672 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DfHgR7jMTxks6m6 off=10591214 len=1213933 2024-01-13T18:33:48.678 INFO:tasks.workunit.client.0.smithi084.stdout:op 3779 completed, throughput=5MB/sec 2024-01-13T18:33:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:49 smithi099 ceph-mon[138788]: pgmap v1860: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:33:49.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:49 smithi084 ceph-mon[116404]: pgmap v1860: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:33:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:49 smithi084 ceph-mon[119097]: pgmap v1860: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:33:49.679 INFO:tasks.workunit.client.0.smithi084.stdout: 751: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:49.679 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mBZkkdEGAZbVubD off=8721575 len=59661 2024-01-13T18:33:49.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 3780 completed, throughput=4.99MB/sec 2024-01-13T18:33:49.679 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IQOCyOocdmAfEmx off=9132090 len=1917340 2024-01-13T18:33:49.689 INFO:tasks.workunit.client.0.smithi084.stdout:op 3781 completed, throughput=5MB/sec 2024-01-13T18:33:49.689 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2EwyhVmrvug3vzz off=1760847 len=1151865 2024-01-13T18:33:49.697 INFO:tasks.workunit.client.0.smithi084.stdout:op 3782 completed, throughput=5MB/sec 2024-01-13T18:33:49.697 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IlJipBdwQJMvAjh off=3904803 len=801749 2024-01-13T18:33:49.698 INFO:tasks.workunit.client.0.smithi084.stdout:op 3783 completed, throughput=5MB/sec 2024-01-13T18:33:49.698 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RZnNaY04bfI8Kbk off=9877752 len=1623597 2024-01-13T18:33:49.698 INFO:tasks.workunit.client.0.smithi084.stdout:op 3784 completed, throughput=5MB/sec 2024-01-13T18:33:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:50.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:50.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:33:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:33:50] "GET /metrics HTTP/1.1" 200 33995 "" "Prometheus/2.43.0" 2024-01-13T18:33:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:33:50.698 INFO:tasks.workunit.client.0.smithi084.stdout: 752: throughput=5MB/sec pending data=0 2024-01-13T18:33:50.698 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LH-RKyl9upqfCGF off=18166020 len=815917 2024-01-13T18:33:50.703 INFO:tasks.workunit.client.0.smithi084.stdout:op 3785 completed, throughput=5MB/sec 2024-01-13T18:33:50.704 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AckKH_hiN88FpFl off=1510940 len=1229661 2024-01-13T18:33:50.711 INFO:tasks.workunit.client.0.smithi084.stdout:op 3786 completed, throughput=5MB/sec 2024-01-13T18:33:50.711 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-c2gw4cIJ7MvcQwv off=13449965 len=914974 2024-01-13T18:33:50.716 INFO:tasks.workunit.client.0.smithi084.stdout:op 3787 completed, throughput=5MB/sec 2024-01-13T18:33:50.716 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RMyxi7y5OC-4cjA off=15994325 len=177168 2024-01-13T18:33:50.719 INFO:tasks.workunit.client.0.smithi084.stdout:op 3788 completed, throughput=5MB/sec 2024-01-13T18:33:50.719 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gyofuxFSjRYDwQ5 off=5059760 len=1215600 2024-01-13T18:33:50.723 INFO:tasks.workunit.client.0.smithi084.stdout:op 3789 completed, throughput=5MB/sec 2024-01-13T18:33:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:51 smithi099 ceph-mon[138788]: pgmap v1861: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:51.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:51 smithi084 ceph-mon[116404]: pgmap v1861: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:51 smithi084 ceph-mon[119097]: pgmap v1861: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:33:51.724 INFO:tasks.workunit.client.0.smithi084.stdout: 753: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:51.724 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RxW_-X7tPAzzClA off=199467 len=1149112 2024-01-13T18:33:51.729 INFO:tasks.workunit.client.0.smithi084.stdout:op 3790 completed, throughput=5MB/sec 2024-01-13T18:33:51.729 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7mF6pIYDhEFlhL9 off=6603660 len=1607233 2024-01-13T18:33:51.735 INFO:tasks.workunit.client.0.smithi084.stdout:op 3791 completed, throughput=5MB/sec 2024-01-13T18:33:51.735 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--yRI2NRHCaLOUuw off=15973590 len=1985746 2024-01-13T18:33:51.744 INFO:tasks.workunit.client.0.smithi084.stdout:op 3792 completed, throughput=5MB/sec 2024-01-13T18:33:51.744 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Lb5Bfk18RAZxvt1 off=139671 len=162998 2024-01-13T18:33:51.746 INFO:tasks.workunit.client.0.smithi084.stdout:op 3793 completed, throughput=5MB/sec 2024-01-13T18:33:51.746 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GMuEl8WqHV_sC1z off=15498634 len=567228 2024-01-13T18:33:51.746 INFO:tasks.workunit.client.0.smithi084.stdout:op 3794 completed, throughput=5MB/sec 2024-01-13T18:33:52.747 INFO:tasks.workunit.client.0.smithi084.stdout: 754: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:52.747 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qJ9p3iqv-AGq7le off=3749254 len=1547075 2024-01-13T18:33:52.756 INFO:tasks.workunit.client.0.smithi084.stdout:op 3795 completed, throughput=5MB/sec 2024-01-13T18:33:52.756 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CZI8Njx1VdCJ5pZ off=124617 len=1015967 2024-01-13T18:33:52.758 INFO:tasks.workunit.client.0.smithi084.stdout:op 3796 completed, throughput=5MB/sec 2024-01-13T18:33:52.758 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0rIe3xYEtJcsJPl off=290502 len=1615797 2024-01-13T18:33:52.767 INFO:tasks.workunit.client.0.smithi084.stdout:op 3797 completed, throughput=5MB/sec 2024-01-13T18:33:52.767 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QcdPVdZoTConxx- off=13502764 len=637107 2024-01-13T18:33:52.771 INFO:tasks.workunit.client.0.smithi084.stdout:op 3798 completed, throughput=5MB/sec 2024-01-13T18:33:52.771 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Tps0J62Vp3EnvG3 off=1002609 len=1654869 2024-01-13T18:33:52.773 INFO:tasks.workunit.client.0.smithi084.stdout:op 3799 completed, throughput=5MB/sec 2024-01-13T18:33:53.773 INFO:tasks.workunit.client.0.smithi084.stdout: 755: throughput=5MB/sec pending data=0 2024-01-13T18:33:53.773 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3TuZELCDF3Fqfxp off=535222 len=1037562 2024-01-13T18:33:53.774 INFO:tasks.workunit.client.0.smithi084.stdout:op 3800 completed, throughput=5MB/sec 2024-01-13T18:33:53.775 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zKgPori_B-ilui9 off=369860 len=1029358 2024-01-13T18:33:53.776 INFO:tasks.workunit.client.0.smithi084.stdout:op 3801 completed, throughput=5MB/sec 2024-01-13T18:33:53.776 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VWqQAqnkMvL8u_I off=12393322 len=1347864 2024-01-13T18:33:53.778 INFO:tasks.workunit.client.0.smithi084.stdout:op 3802 completed, throughput=5MB/sec 2024-01-13T18:33:53.778 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jtENeMTsHGeKatd off=1996219 len=1070144 2024-01-13T18:33:53.784 INFO:tasks.workunit.client.0.smithi084.stdout:op 3803 completed, throughput=5MB/sec 2024-01-13T18:33:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:53 smithi099 ceph-mon[138788]: pgmap v1862: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:33:53.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:53 smithi084 ceph-mon[116404]: pgmap v1862: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:33:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:53 smithi084 ceph-mon[119097]: pgmap v1862: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:33:54.785 INFO:tasks.workunit.client.0.smithi084.stdout: 756: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:54.785 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-33IvfwSY9ZJ5hur off=4747067 len=469257 2024-01-13T18:33:54.786 INFO:tasks.workunit.client.0.smithi084.stdout:op 3804 completed, throughput=4.99MB/sec 2024-01-13T18:33:54.786 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UN0snfK_clBxlhW off=459303 len=1460188 2024-01-13T18:33:54.792 INFO:tasks.workunit.client.0.smithi084.stdout:op 3805 completed, throughput=5MB/sec 2024-01-13T18:33:54.792 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--eGtjuGRBYe5GV_ off=12749995 len=1003208 2024-01-13T18:33:54.797 INFO:tasks.workunit.client.0.smithi084.stdout:op 3806 completed, throughput=5MB/sec 2024-01-13T18:33:54.797 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Pb5R-vGSIy905e2 off=5751775 len=1603502 2024-01-13T18:33:54.798 INFO:tasks.workunit.client.0.smithi084.stdout:op 3807 completed, throughput=5MB/sec 2024-01-13T18:33:54.799 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2aqD2zWTA_YY9EX off=4067988 len=308997 2024-01-13T18:33:54.799 INFO:tasks.workunit.client.0.smithi084.stdout:op 3808 completed, throughput=5MB/sec 2024-01-13T18:33:55.799 INFO:tasks.workunit.client.0.smithi084.stdout: 757: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:55.800 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-L32tPMQwbcI_m5C off=10900749 len=41788 2024-01-13T18:33:55.802 INFO:tasks.workunit.client.0.smithi084.stdout:op 3809 completed, throughput=4.99MB/sec 2024-01-13T18:33:55.802 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GrF0rlzpg6HaBab off=1188905 len=1510383 2024-01-13T18:33:55.804 INFO:tasks.workunit.client.0.smithi084.stdout:op 3810 completed, throughput=5MB/sec 2024-01-13T18:33:55.804 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-huabwkAmnyYn_bg off=1351502 len=209785 2024-01-13T18:33:55.805 INFO:tasks.workunit.client.0.smithi084.stdout:op 3811 completed, throughput=5MB/sec 2024-01-13T18:33:55.805 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ea6hswK3Wp8Fovy off=20841252 len=739940 2024-01-13T18:33:55.806 INFO:tasks.workunit.client.0.smithi084.stdout:op 3812 completed, throughput=5MB/sec 2024-01-13T18:33:55.807 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-P0ikFg0CPSL7BK9 off=9456641 len=2030379 2024-01-13T18:33:55.818 INFO:tasks.workunit.client.0.smithi084.stdout:op 3813 completed, throughput=5MB/sec 2024-01-13T18:33:55.818 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XRJ1hFwatCykzXh off=444491 len=919773 2024-01-13T18:33:55.823 INFO:tasks.workunit.client.0.smithi084.stdout:op 3814 completed, throughput=5MB/sec 2024-01-13T18:33:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:55 smithi099 ceph-mon[138788]: pgmap v1863: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:33:55.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:55 smithi084 ceph-mon[116404]: pgmap v1863: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:33:55.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:55 smithi084 ceph-mon[119097]: pgmap v1863: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:33:56.823 INFO:tasks.workunit.client.0.smithi084.stdout: 758: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:56.823 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hbrpOPVbndvWnru off=11760643 len=1950751 2024-01-13T18:33:56.825 INFO:tasks.workunit.client.0.smithi084.stdout:op 3815 completed, throughput=5MB/sec 2024-01-13T18:33:56.825 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hd_vNU6HSAyS-rN off=3067278 len=1545818 2024-01-13T18:33:56.827 INFO:tasks.workunit.client.0.smithi084.stdout:op 3816 completed, throughput=5MB/sec 2024-01-13T18:33:56.827 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-syNtgJnsM_M2m58 off=3307899 len=862049 2024-01-13T18:33:56.833 INFO:tasks.workunit.client.0.smithi084.stdout:op 3817 completed, throughput=5MB/sec 2024-01-13T18:33:56.833 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dvxCsdXfpW0a0yD off=869371 len=907061 2024-01-13T18:33:56.834 INFO:tasks.workunit.client.0.smithi084.stdout:op 3818 completed, throughput=5MB/sec 2024-01-13T18:33:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: 759: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:57.835 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0M3cqNNcOujiXyg off=17205630 len=1859689 2024-01-13T18:33:57.838 INFO:tasks.workunit.client.0.smithi084.stdout:op 3819 completed, throughput=5MB/sec 2024-01-13T18:33:57.838 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6eXj6xhUc4jeBxy off=11704742 len=135981 2024-01-13T18:33:57.839 INFO:tasks.workunit.client.0.smithi084.stdout:op 3820 completed, throughput=5MB/sec 2024-01-13T18:33:57.839 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iSjOse6kZ_J3Tl7 off=8335058 len=336094 2024-01-13T18:33:57.842 INFO:tasks.workunit.client.0.smithi084.stdout:op 3821 completed, throughput=5MB/sec 2024-01-13T18:33:57.842 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cwV6LKpQlHMPkHw off=1423744 len=1244634 2024-01-13T18:33:57.844 INFO:tasks.workunit.client.0.smithi084.stdout:op 3822 completed, throughput=5MB/sec 2024-01-13T18:33:57.844 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-w-KOWv_4DmbU6Ly off=12884866 len=1919473 2024-01-13T18:33:57.855 INFO:tasks.workunit.client.0.smithi084.stdout:op 3823 completed, throughput=5MB/sec 2024-01-13T18:33:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:57 smithi099 ceph-mon[138788]: pgmap v1864: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:33:57.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:57 smithi084 ceph-mon[116404]: pgmap v1864: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:33:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:57 smithi084 ceph-mon[119097]: pgmap v1864: 105 pgs: 105 active+clean; 128 GiB data, 9.8 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:33:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: 760: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:58.856 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wIt3F_XgXxTJbob off=14248838 len=448693 2024-01-13T18:33:58.857 INFO:tasks.workunit.client.0.smithi084.stdout:op 3824 completed, throughput=4.99MB/sec 2024-01-13T18:33:58.857 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S1c3IAG6IX0WGT2 off=21415932 len=65896 2024-01-13T18:33:58.859 INFO:tasks.workunit.client.0.smithi084.stdout:op 3825 completed, throughput=4.99MB/sec 2024-01-13T18:33:58.859 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9nbvhfP1uLp4PvJ off=9830247 len=2044251 2024-01-13T18:33:58.870 INFO:tasks.workunit.client.0.smithi084.stdout:op 3826 completed, throughput=5MB/sec 2024-01-13T18:33:58.871 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tVraEahrYuz1f0e off=374330 len=1527610 2024-01-13T18:33:58.873 INFO:tasks.workunit.client.0.smithi084.stdout:op 3827 completed, throughput=5MB/sec 2024-01-13T18:33:58.873 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ig2xDz--Lg9ZSUH off=9492166 len=1692094 2024-01-13T18:33:58.875 INFO:tasks.workunit.client.0.smithi084.stdout:op 3828 completed, throughput=5MB/sec 2024-01-13T18:33:59.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:33:59 smithi099 ceph-mon[138788]: pgmap v1865: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:33:59.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:33:59 smithi084 ceph-mon[116404]: pgmap v1865: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:33:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:33:59 smithi084 ceph-mon[119097]: pgmap v1865: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:33:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: 761: throughput=4.99MB/sec pending data=0 2024-01-13T18:33:59.876 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9cPJRu6zDc3H5gT off=3736378 len=643911 2024-01-13T18:33:59.877 INFO:tasks.workunit.client.0.smithi084.stdout:op 3829 completed, throughput=5MB/sec 2024-01-13T18:33:59.877 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qwp7QNMQyBKngu- off=0 len=1080515 2024-01-13T18:33:59.883 INFO:tasks.workunit.client.0.smithi084.stdout:op 3830 completed, throughput=5MB/sec 2024-01-13T18:33:59.883 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-J6HxUPiG3_Y3uCD off=5917409 len=82041 2024-01-13T18:33:59.883 INFO:tasks.workunit.client.0.smithi084.stdout:op 3831 completed, throughput=5MB/sec 2024-01-13T18:33:59.884 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-J14K2MQIYZ34jbw off=11164562 len=672526 2024-01-13T18:33:59.885 INFO:tasks.workunit.client.0.smithi084.stdout:op 3832 completed, throughput=5MB/sec 2024-01-13T18:33:59.885 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-s1TtSEQIsq5fAo_ off=1056086 len=586872 2024-01-13T18:33:59.886 INFO:tasks.workunit.client.0.smithi084.stdout:op 3833 completed, throughput=5MB/sec 2024-01-13T18:33:59.886 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-T6MmTq-2xUDSCUH off=12896981 len=1337021 2024-01-13T18:33:59.888 INFO:tasks.workunit.client.0.smithi084.stdout:op 3834 completed, throughput=5MB/sec 2024-01-13T18:33:59.888 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-X1yJumbbSxpjco5 off=327663 len=247213 2024-01-13T18:33:59.891 INFO:tasks.workunit.client.0.smithi084.stdout:op 3835 completed, throughput=5MB/sec 2024-01-13T18:34:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:34:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:34:00] "GET /metrics HTTP/1.1" 200 33995 "" "Prometheus/2.43.0" 2024-01-13T18:34:00.891 INFO:tasks.workunit.client.0.smithi084.stdout: 762: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:00.891 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gm5QPfAAzDdOMno off=1515290 len=1806953 2024-01-13T18:34:00.893 INFO:tasks.workunit.client.0.smithi084.stdout:op 3836 completed, throughput=5MB/sec 2024-01-13T18:34:00.893 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wWR5_c4um7PCzSm off=910446 len=68792 2024-01-13T18:34:00.896 INFO:tasks.workunit.client.0.smithi084.stdout:op 3837 completed, throughput=5MB/sec 2024-01-13T18:34:00.896 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-C9nWdyEJK6Sge0Y off=483113 len=1929494 2024-01-13T18:34:00.898 INFO:tasks.workunit.client.0.smithi084.stdout:op 3838 completed, throughput=5MB/sec 2024-01-13T18:34:00.898 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-25X_YId5pk5iXEW off=1984467 len=679612 2024-01-13T18:34:00.899 INFO:tasks.workunit.client.0.smithi084.stdout:op 3839 completed, throughput=5MB/sec 2024-01-13T18:34:00.899 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-irY32jozodyL84h off=9203249 len=2075661 2024-01-13T18:34:00.909 INFO:tasks.workunit.client.0.smithi084.stdout:op 3840 completed, throughput=5MB/sec 2024-01-13T18:34:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:01 smithi099 ceph-mon[138788]: pgmap v1866: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:34:01.909 INFO:tasks.workunit.client.0.smithi084.stdout: 763: throughput=5MB/sec pending data=0 2024-01-13T18:34:01.910 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dgS-qODMTKvZJ-T off=5681483 len=1871635 2024-01-13T18:34:01.918 INFO:tasks.workunit.client.0.smithi084.stdout:op 3841 completed, throughput=5MB/sec 2024-01-13T18:34:01.918 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JSV9YIG-WhTav_3 off=2802334 len=821032 2024-01-13T18:34:01.923 INFO:tasks.workunit.client.0.smithi084.stdout:op 3842 completed, throughput=5MB/sec 2024-01-13T18:34:01.923 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cvCNBqAdy-3HE_L off=7041467 len=975224 2024-01-13T18:34:01.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:01 smithi084 ceph-mon[116404]: pgmap v1866: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:34:01.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:01 smithi084 ceph-mon[119097]: pgmap v1866: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:34:01.928 INFO:tasks.workunit.client.0.smithi084.stdout:op 3843 completed, throughput=5MB/sec 2024-01-13T18:34:01.928 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_I_s2-q1acppfPU off=66944 len=1690525 2024-01-13T18:34:01.935 INFO:tasks.workunit.client.0.smithi084.stdout:op 3844 completed, throughput=5MB/sec 2024-01-13T18:34:02.936 INFO:tasks.workunit.client.0.smithi084.stdout: 764: throughput=5MB/sec pending data=0 2024-01-13T18:34:02.936 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Rf1kwEKOpvGUiPB off=1402777 len=372512 2024-01-13T18:34:02.939 INFO:tasks.workunit.client.0.smithi084.stdout:op 3845 completed, throughput=5MB/sec 2024-01-13T18:34:02.939 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TWA4wbehRhfPw1V off=11248586 len=467401 2024-01-13T18:34:02.940 INFO:tasks.workunit.client.0.smithi084.stdout:op 3846 completed, throughput=5MB/sec 2024-01-13T18:34:02.940 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S9CCvWXuTOQjt8q off=10805206 len=3577 2024-01-13T18:34:02.942 INFO:tasks.workunit.client.0.smithi084.stdout:op 3847 completed, throughput=5MB/sec 2024-01-13T18:34:02.942 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zbwyiQoKec_nON1 off=581746 len=280916 2024-01-13T18:34:02.945 INFO:tasks.workunit.client.0.smithi084.stdout:op 3848 completed, throughput=5MB/sec 2024-01-13T18:34:02.945 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bs2QxVUUnqp-g5F off=6807097 len=2071718 2024-01-13T18:34:02.947 INFO:tasks.workunit.client.0.smithi084.stdout:op 3849 completed, throughput=5MB/sec 2024-01-13T18:34:02.947 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jno8ndDZJCgI0fT off=1304880 len=473511 2024-01-13T18:34:02.951 INFO:tasks.workunit.client.0.smithi084.stdout:op 3850 completed, throughput=5MB/sec 2024-01-13T18:34:02.951 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qIFfnbJhrMJFUrA off=7876901 len=42380 2024-01-13T18:34:02.954 INFO:tasks.workunit.client.0.smithi084.stdout:op 3851 completed, throughput=5MB/sec 2024-01-13T18:34:02.954 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IL_9PahzZyi8eTx off=10552373 len=760606 2024-01-13T18:34:02.955 INFO:tasks.workunit.client.0.smithi084.stdout:op 3852 completed, throughput=5MB/sec 2024-01-13T18:34:03.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:03 smithi099 ceph-mon[138788]: pgmap v1867: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:34:03.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:03 smithi084 ceph-mon[116404]: pgmap v1867: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:34:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:03 smithi084 ceph-mon[119097]: pgmap v1867: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:34:03.955 INFO:tasks.workunit.client.0.smithi084.stdout: 765: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:03.955 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-loZsbGv3ELVb8gh off=2514991 len=1750355 2024-01-13T18:34:03.958 INFO:tasks.workunit.client.0.smithi084.stdout:op 3853 completed, throughput=5MB/sec 2024-01-13T18:34:03.959 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oy22X0nG_aYpfpL off=6790398 len=1108129 2024-01-13T18:34:03.965 INFO:tasks.workunit.client.0.smithi084.stdout:op 3854 completed, throughput=5MB/sec 2024-01-13T18:34:03.965 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Rem5ZvrpqCDYfE8 off=9139523 len=1489753 2024-01-13T18:34:03.971 INFO:tasks.workunit.client.0.smithi084.stdout:op 3855 completed, throughput=5MB/sec 2024-01-13T18:34:03.971 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y79xRf2-Oe1VbXA off=14959987 len=1143110 2024-01-13T18:34:03.976 INFO:tasks.workunit.client.0.smithi084.stdout:op 3856 completed, throughput=5MB/sec 2024-01-13T18:34:04.976 INFO:tasks.workunit.client.0.smithi084.stdout: 766: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:04.976 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wOb1Z8NF8AtyFom off=2178798 len=115593 2024-01-13T18:34:04.979 INFO:tasks.workunit.client.0.smithi084.stdout:op 3857 completed, throughput=4.99MB/sec 2024-01-13T18:34:04.979 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0Q-OBpkBrbTvRgt off=18378812 len=226487 2024-01-13T18:34:04.982 INFO:tasks.workunit.client.0.smithi084.stdout:op 3858 completed, throughput=4.99MB/sec 2024-01-13T18:34:04.982 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gbqaFy9_M1yD5YQ off=10907458 len=2039724 2024-01-13T18:34:04.984 INFO:tasks.workunit.client.0.smithi084.stdout:op 3859 completed, throughput=5MB/sec 2024-01-13T18:34:04.984 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SNX9CLM85XnGlpk off=2169116 len=906204 2024-01-13T18:34:04.989 INFO:tasks.workunit.client.0.smithi084.stdout:op 3860 completed, throughput=5MB/sec 2024-01-13T18:34:04.989 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-x3dKOQrr0jVFgl7 off=668880 len=956084 2024-01-13T18:34:04.990 INFO:tasks.workunit.client.0.smithi084.stdout:op 3861 completed, throughput=5MB/sec 2024-01-13T18:34:04.990 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OCiEq2RTBj4sHza off=12163817 len=83466 2024-01-13T18:34:04.991 INFO:tasks.workunit.client.0.smithi084.stdout:op 3862 completed, throughput=5MB/sec 2024-01-13T18:34:04.991 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZZbF4WnXhhIT7ba off=3628399 len=1797178 2024-01-13T18:34:04.992 INFO:tasks.workunit.client.0.smithi084.stdout:op 3863 completed, throughput=5MB/sec 2024-01-13T18:34:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:05 smithi099 ceph-mon[138788]: pgmap v1868: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:34:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:05 smithi084 ceph-mon[116404]: pgmap v1868: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:34:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:05 smithi084 ceph-mon[119097]: pgmap v1868: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:34:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:05.992 INFO:tasks.workunit.client.0.smithi084.stdout: 767: throughput=5MB/sec pending data=0 2024-01-13T18:34:05.993 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_sfbNf0YGmyfeej off=7618460 len=998290 2024-01-13T18:34:05.994 INFO:tasks.workunit.client.0.smithi084.stdout:op 3864 completed, throughput=5MB/sec 2024-01-13T18:34:05.994 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EeHloRgX84Ibze0 off=130911 len=1899030 2024-01-13T18:34:06.001 INFO:tasks.workunit.client.0.smithi084.stdout:op 3865 completed, throughput=5MB/sec 2024-01-13T18:34:06.002 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f7KlW5CPcXuxAYE off=6494512 len=707850 2024-01-13T18:34:06.002 INFO:tasks.workunit.client.0.smithi084.stdout:op 3866 completed, throughput=5MB/sec 2024-01-13T18:34:06.002 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YKoD9QaGO-KLe_S off=1228265 len=1577060 2024-01-13T18:34:06.004 INFO:tasks.workunit.client.0.smithi084.stdout:op 3867 completed, throughput=5MB/sec 2024-01-13T18:34:07.004 INFO:tasks.workunit.client.0.smithi084.stdout: 768: throughput=5MB/sec pending data=0 2024-01-13T18:34:07.004 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZJO3LoTudmdS_mG off=13817652 len=1661565 2024-01-13T18:34:07.007 INFO:tasks.workunit.client.0.smithi084.stdout:op 3868 completed, throughput=5MB/sec 2024-01-13T18:34:07.007 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-C15dAQpQ-aCjNUA off=4343269 len=1899306 2024-01-13T18:34:07.010 INFO:tasks.workunit.client.0.smithi084.stdout:op 3869 completed, throughput=5MB/sec 2024-01-13T18:34:07.010 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pIXG0P90cvdtuuT off=13047225 len=185032 2024-01-13T18:34:07.013 INFO:tasks.workunit.client.0.smithi084.stdout:op 3870 completed, throughput=5MB/sec 2024-01-13T18:34:07.013 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ah1Qg8zPimvV3ig off=8099003 len=1706056 2024-01-13T18:34:07.014 INFO:tasks.workunit.client.0.smithi084.stdout:op 3871 completed, throughput=5MB/sec 2024-01-13T18:34:07.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:07 smithi099 ceph-mon[138788]: pgmap v1869: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:34:07.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:07 smithi084 ceph-mon[116404]: pgmap v1869: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:34:07.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:07 smithi084 ceph-mon[119097]: pgmap v1869: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:34:08.015 INFO:tasks.workunit.client.0.smithi084.stdout: 769: throughput=5MB/sec pending data=0 2024-01-13T18:34:08.015 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lt5RnqZyPjduprg off=1263962 len=31574 2024-01-13T18:34:08.016 INFO:tasks.workunit.client.0.smithi084.stdout:op 3872 completed, throughput=5MB/sec 2024-01-13T18:34:08.016 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CORW5MNeGaztAmE off=13555403 len=132494 2024-01-13T18:34:08.019 INFO:tasks.workunit.client.0.smithi084.stdout:op 3873 completed, throughput=5MB/sec 2024-01-13T18:34:08.019 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PtvHxBlfvgisYP4 off=5737776 len=1952004 2024-01-13T18:34:08.028 INFO:tasks.workunit.client.0.smithi084.stdout:op 3874 completed, throughput=5MB/sec 2024-01-13T18:34:08.028 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_jJTzPJRC4YBkWA off=1841241 len=1259673 2024-01-13T18:34:08.036 INFO:tasks.workunit.client.0.smithi084.stdout:op 3875 completed, throughput=5MB/sec 2024-01-13T18:34:08.036 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TWgezNVRxD8xFx2 off=5370388 len=1307017 2024-01-13T18:34:08.037 INFO:tasks.workunit.client.0.smithi084.stdout:op 3876 completed, throughput=5MB/sec 2024-01-13T18:34:09.038 INFO:tasks.workunit.client.0.smithi084.stdout: 770: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:09.038 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-18WRxC9rgmfSv8p off=10078489 len=604796 2024-01-13T18:34:09.039 INFO:tasks.workunit.client.0.smithi084.stdout:op 3877 completed, throughput=5MB/sec 2024-01-13T18:34:09.039 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ESZ0bsIvVE8AE4a off=4996841 len=1468456 2024-01-13T18:34:09.046 INFO:tasks.workunit.client.0.smithi084.stdout:op 3878 completed, throughput=5MB/sec 2024-01-13T18:34:09.046 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g0EdHgvax_9jT6q off=11511911 len=948787 2024-01-13T18:34:09.047 INFO:tasks.workunit.client.0.smithi084.stdout:op 3879 completed, throughput=5MB/sec 2024-01-13T18:34:09.048 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Vp7ZitMgpRsTcOw off=717655 len=912557 2024-01-13T18:34:09.052 INFO:tasks.workunit.client.0.smithi084.stdout:op 3880 completed, throughput=5MB/sec 2024-01-13T18:34:09.052 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EdM_XCEygHvSauL off=1966573 len=1785884 2024-01-13T18:34:09.053 INFO:tasks.workunit.client.0.smithi084.stdout:op 3881 completed, throughput=5MB/sec 2024-01-13T18:34:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:09 smithi099 ceph-mon[138788]: pgmap v1870: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:34:09.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:09 smithi084 ceph-mon[116404]: pgmap v1870: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:34:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:09 smithi084 ceph-mon[119097]: pgmap v1870: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:34:10.054 INFO:tasks.workunit.client.0.smithi084.stdout: 771: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:10.054 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NlIpOt1tww50Gg5 off=3710221 len=588520 2024-01-13T18:34:10.058 INFO:tasks.workunit.client.0.smithi084.stdout:op 3882 completed, throughput=5MB/sec 2024-01-13T18:34:10.058 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UmWNn5pVOrulu8h off=9086478 len=1715181 2024-01-13T18:34:10.061 INFO:tasks.workunit.client.0.smithi084.stdout:op 3883 completed, throughput=5MB/sec 2024-01-13T18:34:10.061 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xfRhHfgkst7eMd2 off=3834627 len=2033957 2024-01-13T18:34:10.063 INFO:tasks.workunit.client.0.smithi084.stdout:op 3884 completed, throughput=5MB/sec 2024-01-13T18:34:10.679 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:34:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:34:10] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:34:11.064 INFO:tasks.workunit.client.0.smithi084.stdout: 772: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:11.064 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xVs0RSDDycnRI5o off=9526275 len=1993666 2024-01-13T18:34:11.077 INFO:tasks.workunit.client.0.smithi084.stdout:op 3885 completed, throughput=5MB/sec 2024-01-13T18:34:11.077 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y8pMk_t1-EOBhtA off=6719174 len=104135 2024-01-13T18:34:11.077 INFO:tasks.workunit.client.0.smithi084.stdout:op 3886 completed, throughput=5MB/sec 2024-01-13T18:34:11.077 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LERRQGixeFvFiUT off=2100732 len=130407 2024-01-13T18:34:11.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 3887 completed, throughput=5MB/sec 2024-01-13T18:34:11.080 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-orCpBjtIyyI5UuJ off=1623664 len=100756 2024-01-13T18:34:11.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 3888 completed, throughput=5MB/sec 2024-01-13T18:34:11.081 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OfwU4Mqs9bv8SbY off=7517365 len=1952015 2024-01-13T18:34:11.082 INFO:tasks.workunit.client.0.smithi084.stdout:op 3889 completed, throughput=5MB/sec 2024-01-13T18:34:11.083 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AB-6MgBx8sFtmX7 off=5938282 len=1174486 2024-01-13T18:34:11.085 INFO:tasks.workunit.client.0.smithi084.stdout:op 3890 completed, throughput=5MB/sec 2024-01-13T18:34:11.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:11 smithi099 ceph-mon[138788]: pgmap v1871: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:34:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:11 smithi084 ceph-mon[116404]: pgmap v1871: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:34:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:11 smithi084 ceph-mon[119097]: pgmap v1871: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:34:12.085 INFO:tasks.workunit.client.0.smithi084.stdout: 773: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:12.085 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wHs6YpL5wosDADX off=187342 len=2079587 2024-01-13T18:34:12.088 INFO:tasks.workunit.client.0.smithi084.stdout:op 3891 completed, throughput=5MB/sec 2024-01-13T18:34:12.088 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mCkyP_Xwy8FdQHs off=854342 len=1554399 2024-01-13T18:34:12.091 INFO:tasks.workunit.client.0.smithi084.stdout:op 3892 completed, throughput=5MB/sec 2024-01-13T18:34:12.091 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QBmZ8A24EuViHpo off=7505904 len=568179 2024-01-13T18:34:12.095 INFO:tasks.workunit.client.0.smithi084.stdout:op 3893 completed, throughput=5MB/sec 2024-01-13T18:34:12.095 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M5ccYyJVe0XsSHO off=15889483 len=1442179 2024-01-13T18:34:12.096 INFO:tasks.workunit.client.0.smithi084.stdout:op 3894 completed, throughput=5MB/sec 2024-01-13T18:34:13.097 INFO:tasks.workunit.client.0.smithi084.stdout: 774: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:13.097 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jByiU2EqWOTv1Sp off=12402591 len=1302030 2024-01-13T18:34:13.098 INFO:tasks.workunit.client.0.smithi084.stdout:op 3895 completed, throughput=5MB/sec 2024-01-13T18:34:13.098 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QDfWZIDo0oz4dFZ off=14122976 len=1194103 2024-01-13T18:34:13.104 INFO:tasks.workunit.client.0.smithi084.stdout:op 3896 completed, throughput=5MB/sec 2024-01-13T18:34:13.104 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Gbo_nHXsss0biTa off=5613705 len=661775 2024-01-13T18:34:13.106 INFO:tasks.workunit.client.0.smithi084.stdout:op 3897 completed, throughput=5MB/sec 2024-01-13T18:34:13.106 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AvHgpiwE0e9tamb off=13674766 len=918589 2024-01-13T18:34:13.107 INFO:tasks.workunit.client.0.smithi084.stdout:op 3898 completed, throughput=5MB/sec 2024-01-13T18:34:13.107 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M1U3fVGe66VaX4F off=20788462 len=1687017 2024-01-13T18:34:13.110 INFO:tasks.workunit.client.0.smithi084.stdout:op 3899 completed, throughput=5MB/sec 2024-01-13T18:34:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:13 smithi099 ceph-mon[138788]: pgmap v1872: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:34:13.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:13 smithi084 ceph-mon[116404]: pgmap v1872: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:34:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:13 smithi084 ceph-mon[119097]: pgmap v1872: 105 pgs: 105 active+clean; 128 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:34:14.111 INFO:tasks.workunit.client.0.smithi084.stdout: 775: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:14.111 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-79ViH-lUvyu-fCl off=795185 len=265732 2024-01-13T18:34:14.114 INFO:tasks.workunit.client.0.smithi084.stdout:op 3900 completed, throughput=5MB/sec 2024-01-13T18:34:14.114 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eFu-sKb84mxgW_P off=6066211 len=1600963 2024-01-13T18:34:14.115 INFO:tasks.workunit.client.0.smithi084.stdout:op 3901 completed, throughput=5MB/sec 2024-01-13T18:34:14.115 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZFMklJcrhIfzk2b off=10397843 len=979104 2024-01-13T18:34:14.121 INFO:tasks.workunit.client.0.smithi084.stdout:op 3902 completed, throughput=5MB/sec 2024-01-13T18:34:14.121 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-smc0o33_ra-br5f off=16722243 len=990375 2024-01-13T18:34:14.123 INFO:tasks.workunit.client.0.smithi084.stdout:op 3903 completed, throughput=5MB/sec 2024-01-13T18:34:14.123 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wSje2E2Py8o3N54 off=2946385 len=14518 2024-01-13T18:34:14.125 INFO:tasks.workunit.client.0.smithi084.stdout:op 3904 completed, throughput=5MB/sec 2024-01-13T18:34:14.125 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Fhkzc2KpkrywIYO off=3339261 len=46997 2024-01-13T18:34:14.126 INFO:tasks.workunit.client.0.smithi084.stdout:op 3905 completed, throughput=5MB/sec 2024-01-13T18:34:14.126 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6n6yu3cbCV3T06r off=5980699 len=515568 2024-01-13T18:34:14.127 INFO:tasks.workunit.client.0.smithi084.stdout:op 3906 completed, throughput=5MB/sec 2024-01-13T18:34:15.127 INFO:tasks.workunit.client.0.smithi084.stdout: 776: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:15.128 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-A13KxtXhDqf0IL7 off=5536758 len=1449114 2024-01-13T18:34:15.133 INFO:tasks.workunit.client.0.smithi084.stdout:op 3907 completed, throughput=5MB/sec 2024-01-13T18:34:15.134 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_Nx1hkAxyibyOjH off=3723325 len=1292570 2024-01-13T18:34:15.142 INFO:tasks.workunit.client.0.smithi084.stdout:op 3908 completed, throughput=5MB/sec 2024-01-13T18:34:15.142 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0mPGRsr3eXG5B-d off=1762880 len=1209046 2024-01-13T18:34:15.143 INFO:tasks.workunit.client.0.smithi084.stdout:op 3909 completed, throughput=5MB/sec 2024-01-13T18:34:15.143 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FzWJNNNNDlD5TbR off=3486727 len=1693916 2024-01-13T18:34:15.145 INFO:tasks.workunit.client.0.smithi084.stdout:op 3910 completed, throughput=5MB/sec 2024-01-13T18:34:15.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:15 smithi099 ceph-mon[138788]: pgmap v1873: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:34:15.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:15 smithi084 ceph-mon[116404]: pgmap v1873: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:34:15.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:15 smithi084 ceph-mon[119097]: pgmap v1873: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:34:16.146 INFO:tasks.workunit.client.0.smithi084.stdout: 777: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:16.146 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xkS9qOSdpDfi7DQ off=1450147 len=423285 2024-01-13T18:34:16.149 INFO:tasks.workunit.client.0.smithi084.stdout:op 3911 completed, throughput=4.99MB/sec 2024-01-13T18:34:16.149 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-i_u-DctHrzH6zpN off=1584206 len=1259384 2024-01-13T18:34:16.157 INFO:tasks.workunit.client.0.smithi084.stdout:op 3912 completed, throughput=5MB/sec 2024-01-13T18:34:16.157 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tiklcJeV1Z967SS off=16589506 len=1109928 2024-01-13T18:34:16.163 INFO:tasks.workunit.client.0.smithi084.stdout:op 3913 completed, throughput=5MB/sec 2024-01-13T18:34:16.163 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aj8s7B2BcHdj76y off=5924063 len=1905829 2024-01-13T18:34:16.165 INFO:tasks.workunit.client.0.smithi084.stdout:op 3914 completed, throughput=5MB/sec 2024-01-13T18:34:16.165 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cc4KSp4B5wkH9wq off=11406356 len=138375 2024-01-13T18:34:16.167 INFO:tasks.workunit.client.0.smithi084.stdout:op 3915 completed, throughput=5MB/sec 2024-01-13T18:34:16.167 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DHTHjj__3InX3fH off=14698898 len=1012811 2024-01-13T18:34:16.172 INFO:tasks.workunit.client.0.smithi084.stdout:op 3916 completed, throughput=5MB/sec 2024-01-13T18:34:17.172 INFO:tasks.workunit.client.0.smithi084.stdout: 778: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:17.172 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j0pe_NlwLKe3M4_ off=111604 len=55554 2024-01-13T18:34:17.175 INFO:tasks.workunit.client.0.smithi084.stdout:op 3917 completed, throughput=4.99MB/sec 2024-01-13T18:34:17.175 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kUnfx593174BJ_I off=14504588 len=776971 2024-01-13T18:34:17.177 INFO:tasks.workunit.client.0.smithi084.stdout:op 3918 completed, throughput=5MB/sec 2024-01-13T18:34:17.177 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eivTW6tnqrIHga1 off=1749704 len=1011041 2024-01-13T18:34:17.182 INFO:tasks.workunit.client.0.smithi084.stdout:op 3919 completed, throughput=5MB/sec 2024-01-13T18:34:17.182 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mQFbhvQprXVvdff off=2467959 len=1974171 2024-01-13T18:34:17.185 INFO:tasks.workunit.client.0.smithi084.stdout:op 3920 completed, throughput=5MB/sec 2024-01-13T18:34:17.185 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OlofVZVbDMnh4sf off=6684918 len=960489 2024-01-13T18:34:17.190 INFO:tasks.workunit.client.0.smithi084.stdout:op 3921 completed, throughput=5MB/sec 2024-01-13T18:34:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:17 smithi099 ceph-mon[138788]: pgmap v1874: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 3 op/s 2024-01-13T18:34:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:17 smithi084 ceph-mon[116404]: pgmap v1874: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 3 op/s 2024-01-13T18:34:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:17 smithi084 ceph-mon[119097]: pgmap v1874: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 3 op/s 2024-01-13T18:34:18.191 INFO:tasks.workunit.client.0.smithi084.stdout: 779: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:18.191 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gDDU8fI5yQwRoT1 off=2099950 len=288526 2024-01-13T18:34:18.194 INFO:tasks.workunit.client.0.smithi084.stdout:op 3922 completed, throughput=4.99MB/sec 2024-01-13T18:34:18.194 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-X9lTKCmOJskTr0a off=8427994 len=973249 2024-01-13T18:34:18.199 INFO:tasks.workunit.client.0.smithi084.stdout:op 3923 completed, throughput=5MB/sec 2024-01-13T18:34:18.199 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EnNMkH0j467MOfg off=2135193 len=1695156 2024-01-13T18:34:18.201 INFO:tasks.workunit.client.0.smithi084.stdout:op 3924 completed, throughput=5MB/sec 2024-01-13T18:34:18.201 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iZELp5QU-w3eYsB off=2786727 len=1002908 2024-01-13T18:34:18.206 INFO:tasks.workunit.client.0.smithi084.stdout:op 3925 completed, throughput=5MB/sec 2024-01-13T18:34:18.206 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8BJdZv8J4I_bgbp off=13629037 len=354090 2024-01-13T18:34:18.207 INFO:tasks.workunit.client.0.smithi084.stdout:op 3926 completed, throughput=5MB/sec 2024-01-13T18:34:18.207 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-q61bnDUsWTitmOb off=5013443 len=1743879 2024-01-13T18:34:18.209 INFO:tasks.workunit.client.0.smithi084.stdout:op 3927 completed, throughput=5MB/sec 2024-01-13T18:34:19.209 INFO:tasks.workunit.client.0.smithi084.stdout: 780: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:19.209 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-t6zfro7YBLJZ_Oi off=2833741 len=292753 2024-01-13T18:34:19.211 INFO:tasks.workunit.client.0.smithi084.stdout:op 3928 completed, throughput=5MB/sec 2024-01-13T18:34:19.211 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-O-eJCR8W4hLs2bQ off=4343491 len=626370 2024-01-13T18:34:19.214 INFO:tasks.workunit.client.0.smithi084.stdout:op 3929 completed, throughput=5MB/sec 2024-01-13T18:34:19.214 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PjOBVA_dvAwnAJj off=10033384 len=794798 2024-01-13T18:34:19.215 INFO:tasks.workunit.client.0.smithi084.stdout:op 3930 completed, throughput=5MB/sec 2024-01-13T18:34:19.216 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HYr2o_hMC2e7VAy off=9832936 len=1591198 2024-01-13T18:34:19.218 INFO:tasks.workunit.client.0.smithi084.stdout:op 3931 completed, throughput=5MB/sec 2024-01-13T18:34:19.218 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZhetAMT0-GuT9vI off=4540191 len=18432 2024-01-13T18:34:19.220 INFO:tasks.workunit.client.0.smithi084.stdout:op 3932 completed, throughput=5MB/sec 2024-01-13T18:34:19.220 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-O3VJrxff_EXSfqu off=2669722 len=439021 2024-01-13T18:34:19.224 INFO:tasks.workunit.client.0.smithi084.stdout:op 3933 completed, throughput=5MB/sec 2024-01-13T18:34:19.224 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2TIN0AKks_7OAY4 off=15502345 len=882707 2024-01-13T18:34:19.229 INFO:tasks.workunit.client.0.smithi084.stdout:op 3934 completed, throughput=5MB/sec 2024-01-13T18:34:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:19 smithi099 ceph-mon[138788]: pgmap v1875: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-01-13T18:34:19.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:19 smithi084 ceph-mon[116404]: pgmap v1875: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-01-13T18:34:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:19 smithi084 ceph-mon[119097]: pgmap v1875: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-01-13T18:34:20.230 INFO:tasks.workunit.client.0.smithi084.stdout: 781: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:20.230 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3Ojy-UMXeRuGqj7 off=3274442 len=1986587 2024-01-13T18:34:20.234 INFO:tasks.workunit.client.0.smithi084.stdout:op 3935 completed, throughput=5MB/sec 2024-01-13T18:34:20.234 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jAffllu128q_alL off=19679681 len=148493 2024-01-13T18:34:20.237 INFO:tasks.workunit.client.0.smithi084.stdout:op 3936 completed, throughput=5MB/sec 2024-01-13T18:34:20.237 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2E8RRyoPLMQQg6d off=153504 len=925509 2024-01-13T18:34:20.241 INFO:tasks.workunit.client.0.smithi084.stdout:op 3937 completed, throughput=5MB/sec 2024-01-13T18:34:20.242 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DNhtO_IaPo-_dQ_ off=8575443 len=966732 2024-01-13T18:34:20.243 INFO:tasks.workunit.client.0.smithi084.stdout:op 3938 completed, throughput=5MB/sec 2024-01-13T18:34:20.243 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--Nq1Dw8UIQndIUN off=9668600 len=179157 2024-01-13T18:34:20.243 INFO:tasks.workunit.client.0.smithi084.stdout:op 3939 completed, throughput=5MB/sec 2024-01-13T18:34:20.243 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g_TNfKhwmdFrVz0 off=643602 len=1538133 2024-01-13T18:34:20.245 INFO:tasks.workunit.client.0.smithi084.stdout:op 3940 completed, throughput=5MB/sec 2024-01-13T18:34:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:34:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:34:20] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:34:21.245 INFO:tasks.workunit.client.0.smithi084.stdout: 782: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:21.246 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-C9rjNpyq4wjnP4u off=13332866 len=2056606 2024-01-13T18:34:21.248 INFO:tasks.workunit.client.0.smithi084.stdout:op 3941 completed, throughput=5MB/sec 2024-01-13T18:34:21.248 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KNqHUgxtCKXkPYL off=13665109 len=160083 2024-01-13T18:34:21.251 INFO:tasks.workunit.client.0.smithi084.stdout:op 3942 completed, throughput=5MB/sec 2024-01-13T18:34:21.251 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-O3pnLRV_qRDR9DQ off=2399432 len=1697912 2024-01-13T18:34:21.253 INFO:tasks.workunit.client.0.smithi084.stdout:op 3943 completed, throughput=5MB/sec 2024-01-13T18:34:21.253 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dHdvCC4lIVLra6o off=4674638 len=1830678 2024-01-13T18:34:21.256 INFO:tasks.workunit.client.0.smithi084.stdout:op 3944 completed, throughput=5MB/sec 2024-01-13T18:34:21.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:21 smithi099 ceph-mon[138788]: pgmap v1876: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:34:21.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:21 smithi084 ceph-mon[116404]: pgmap v1876: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:34:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:21 smithi084 ceph-mon[119097]: pgmap v1876: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:34:22.257 INFO:tasks.workunit.client.0.smithi084.stdout: 783: throughput=5MB/sec pending data=0 2024-01-13T18:34:22.257 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Sk4HthbNTULQxgv off=2179683 len=1845569 2024-01-13T18:34:22.260 INFO:tasks.workunit.client.0.smithi084.stdout:op 3945 completed, throughput=5MB/sec 2024-01-13T18:34:22.260 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lyfcTQGym5GdX72 off=602972 len=525973 2024-01-13T18:34:22.261 INFO:tasks.workunit.client.0.smithi084.stdout:op 3946 completed, throughput=5MB/sec 2024-01-13T18:34:22.261 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ShQFbMuuXLRXQPL off=11742647 len=655196 2024-01-13T18:34:22.262 INFO:tasks.workunit.client.0.smithi084.stdout:op 3947 completed, throughput=5MB/sec 2024-01-13T18:34:22.262 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TNcoMoCUeZiX2W4 off=1483798 len=1797653 2024-01-13T18:34:22.264 INFO:tasks.workunit.client.0.smithi084.stdout:op 3948 completed, throughput=5MB/sec 2024-01-13T18:34:23.265 INFO:tasks.workunit.client.0.smithi084.stdout: 784: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:23.265 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-S5j4inzI8VjMV-g off=8083665 len=1937630 2024-01-13T18:34:23.267 INFO:tasks.workunit.client.0.smithi084.stdout:op 3949 completed, throughput=5MB/sec 2024-01-13T18:34:23.267 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-p2LYIPVK4V7Fy4C off=9251864 len=335727 2024-01-13T18:34:23.268 INFO:tasks.workunit.client.0.smithi084.stdout:op 3950 completed, throughput=5MB/sec 2024-01-13T18:34:23.268 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_hpJImK_oXF3a0P off=811608 len=49570 2024-01-13T18:34:23.271 INFO:tasks.workunit.client.0.smithi084.stdout:op 3951 completed, throughput=5MB/sec 2024-01-13T18:34:23.271 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YTtWdD5t1exu0kF off=6703452 len=2023132 2024-01-13T18:34:23.273 INFO:tasks.workunit.client.0.smithi084.stdout:op 3952 completed, throughput=5MB/sec 2024-01-13T18:34:23.273 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SL_JylGUQafh3Vt off=1518108 len=942253 2024-01-13T18:34:23.278 INFO:tasks.workunit.client.0.smithi084.stdout:op 3953 completed, throughput=5MB/sec 2024-01-13T18:34:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:23 smithi099 ceph-mon[138788]: pgmap v1877: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 4 op/s 2024-01-13T18:34:23.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:23 smithi084 ceph-mon[116404]: pgmap v1877: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 4 op/s 2024-01-13T18:34:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:23 smithi084 ceph-mon[119097]: pgmap v1877: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 4 op/s 2024-01-13T18:34:24.278 INFO:tasks.workunit.client.0.smithi084.stdout: 785: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:24.278 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-txCrEi81f_Lq0Hw off=20119624 len=1476878 2024-01-13T18:34:24.280 INFO:tasks.workunit.client.0.smithi084.stdout:op 3954 completed, throughput=5MB/sec 2024-01-13T18:34:24.280 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dRtfm029I0LmL7B off=6890683 len=620970 2024-01-13T18:34:24.285 INFO:tasks.workunit.client.0.smithi084.stdout:op 3955 completed, throughput=5MB/sec 2024-01-13T18:34:24.286 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FawxM2NX9-vxtIx off=6800096 len=1180594 2024-01-13T18:34:24.287 INFO:tasks.workunit.client.0.smithi084.stdout:op 3956 completed, throughput=5MB/sec 2024-01-13T18:34:24.287 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--47yYRUN5FVE1Gj off=1347796 len=179964 2024-01-13T18:34:24.288 INFO:tasks.workunit.client.0.smithi084.stdout:op 3957 completed, throughput=5MB/sec 2024-01-13T18:34:24.288 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_affKr_IB5hBMwr off=5944812 len=581099 2024-01-13T18:34:24.292 INFO:tasks.workunit.client.0.smithi084.stdout:op 3958 completed, throughput=5MB/sec 2024-01-13T18:34:24.292 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xt2Zpjzk81Gk90m off=5217358 len=1768311 2024-01-13T18:34:24.302 INFO:tasks.workunit.client.0.smithi084.stdout:op 3959 completed, throughput=5MB/sec 2024-01-13T18:34:25.302 INFO:tasks.workunit.client.0.smithi084.stdout: 786: throughput=5MB/sec pending data=0 2024-01-13T18:34:25.302 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FzTdYblq6UROkSy off=3815647 len=375406 2024-01-13T18:34:25.305 INFO:tasks.workunit.client.0.smithi084.stdout:op 3960 completed, throughput=5MB/sec 2024-01-13T18:34:25.305 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-URO2Uzf-6gi30xf off=8514749 len=1734489 2024-01-13T18:34:25.315 INFO:tasks.workunit.client.0.smithi084.stdout:op 3961 completed, throughput=5MB/sec 2024-01-13T18:34:25.315 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9z1ooRMsX50vYMv off=562592 len=1405312 2024-01-13T18:34:25.320 INFO:tasks.workunit.client.0.smithi084.stdout:op 3962 completed, throughput=5MB/sec 2024-01-13T18:34:25.320 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WtLvle6_tlvEoEc off=7461273 len=1383861 2024-01-13T18:34:25.321 INFO:tasks.workunit.client.0.smithi084.stdout:op 3963 completed, throughput=5MB/sec 2024-01-13T18:34:25.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:25 smithi099 ceph-mon[138788]: pgmap v1878: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:34:25.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:25 smithi084 ceph-mon[116404]: pgmap v1878: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:34:25.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:25 smithi084 ceph-mon[119097]: pgmap v1878: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:34:26.322 INFO:tasks.workunit.client.0.smithi084.stdout: 787: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:26.322 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OQUdgyNuBiBtnmL off=15882143 len=1904491 2024-01-13T18:34:26.324 INFO:tasks.workunit.client.0.smithi084.stdout:op 3964 completed, throughput=5MB/sec 2024-01-13T18:34:26.324 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--41vr2yHKMb89_C off=811283 len=1222491 2024-01-13T18:34:26.326 INFO:tasks.workunit.client.0.smithi084.stdout:op 3965 completed, throughput=5MB/sec 2024-01-13T18:34:26.326 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BeeboU_7ahL6PGX off=11879641 len=906850 2024-01-13T18:34:26.332 INFO:tasks.workunit.client.0.smithi084.stdout:op 3966 completed, throughput=5MB/sec 2024-01-13T18:34:26.332 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Kf8_cmZu9w3KE3l off=124251 len=1494374 2024-01-13T18:34:26.340 INFO:tasks.workunit.client.0.smithi084.stdout:op 3967 completed, throughput=5MB/sec 2024-01-13T18:34:27.341 INFO:tasks.workunit.client.0.smithi084.stdout: 788: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:27.341 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0Y32Mg2TwzdHFky off=11549040 len=1339116 2024-01-13T18:34:27.343 INFO:tasks.workunit.client.0.smithi084.stdout:op 3968 completed, throughput=5MB/sec 2024-01-13T18:34:27.343 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RgcxEkU4A_w1VKp off=783641 len=684212 2024-01-13T18:34:27.348 INFO:tasks.workunit.client.0.smithi084.stdout:op 3969 completed, throughput=5MB/sec 2024-01-13T18:34:27.348 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FLC-B4uIZ6EaAGg off=7591837 len=1123977 2024-01-13T18:34:27.350 INFO:tasks.workunit.client.0.smithi084.stdout:op 3970 completed, throughput=5MB/sec 2024-01-13T18:34:27.350 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rF8OasB7wGn8qfg off=3778074 len=1101172 2024-01-13T18:34:27.352 INFO:tasks.workunit.client.0.smithi084.stdout:op 3971 completed, throughput=5MB/sec 2024-01-13T18:34:27.352 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IPzdGkIAI6xAi7V off=4711025 len=911816 2024-01-13T18:34:27.357 INFO:tasks.workunit.client.0.smithi084.stdout:op 3972 completed, throughput=5MB/sec 2024-01-13T18:34:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:27 smithi099 ceph-mon[138788]: pgmap v1879: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:34:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:27 smithi084 ceph-mon[116404]: pgmap v1879: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:34:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:27 smithi084 ceph-mon[119097]: pgmap v1879: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2024-01-13T18:34:28.357 INFO:tasks.workunit.client.0.smithi084.stdout: 789: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:28.357 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BtMd6XpU1nA579r off=11970485 len=823007 2024-01-13T18:34:28.358 INFO:tasks.workunit.client.0.smithi084.stdout:op 3973 completed, throughput=5MB/sec 2024-01-13T18:34:28.359 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mRfCHmaUzqeMSph off=7394283 len=1679294 2024-01-13T18:34:28.367 INFO:tasks.workunit.client.0.smithi084.stdout:op 3974 completed, throughput=5MB/sec 2024-01-13T18:34:28.367 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PT4yiEtEDTShnbQ off=3548010 len=858809 2024-01-13T18:34:28.372 INFO:tasks.workunit.client.0.smithi084.stdout:op 3975 completed, throughput=5MB/sec 2024-01-13T18:34:28.372 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VI_SgXvsaq54cEW off=6052014 len=131786 2024-01-13T18:34:28.375 INFO:tasks.workunit.client.0.smithi084.stdout:op 3976 completed, throughput=5MB/sec 2024-01-13T18:34:28.375 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-heu8Epqh2xOxI5Z off=14195406 len=2082281 2024-01-13T18:34:28.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 3977 completed, throughput=5MB/sec 2024-01-13T18:34:29.376 INFO:tasks.workunit.client.0.smithi084.stdout: 790: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:29.377 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PYDFgTAsmRWyDLO off=4006273 len=1584521 2024-01-13T18:34:29.384 INFO:tasks.workunit.client.0.smithi084.stdout:op 3978 completed, throughput=5MB/sec 2024-01-13T18:34:29.384 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UxHIeFiHnbrTPNK off=1622537 len=886756 2024-01-13T18:34:29.386 INFO:tasks.workunit.client.0.smithi084.stdout:op 3979 completed, throughput=5MB/sec 2024-01-13T18:34:29.386 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3JeDeKWJ9P9w0h1 off=1489609 len=920476 2024-01-13T18:34:29.387 INFO:tasks.workunit.client.0.smithi084.stdout:op 3980 completed, throughput=5MB/sec 2024-01-13T18:34:29.387 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TBB4eZ2zMzesYOL off=806376 len=766399 2024-01-13T18:34:29.392 INFO:tasks.workunit.client.0.smithi084.stdout:op 3981 completed, throughput=5MB/sec 2024-01-13T18:34:29.392 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VNEj2G9rjLTcAlj off=18701810 len=736339 2024-01-13T18:34:29.393 INFO:tasks.workunit.client.0.smithi084.stdout:op 3982 completed, throughput=5MB/sec 2024-01-13T18:34:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:29 smithi099 ceph-mon[138788]: pgmap v1880: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:34:29.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:29 smithi084 ceph-mon[116404]: pgmap v1880: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:34:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:29 smithi084 ceph-mon[119097]: pgmap v1880: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:34:30.393 INFO:tasks.workunit.client.0.smithi084.stdout: 791: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:30.393 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OsDIabqfHyYIVlC off=18062497 len=1759757 2024-01-13T18:34:30.402 INFO:tasks.workunit.client.0.smithi084.stdout:op 3983 completed, throughput=5MB/sec 2024-01-13T18:34:30.402 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_bFqPhvTx6S6cvT off=7237134 len=1777185 2024-01-13T18:34:30.411 INFO:tasks.workunit.client.0.smithi084.stdout:op 3984 completed, throughput=5MB/sec 2024-01-13T18:34:30.411 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ihoqt2XMocnRRB_ off=9252530 len=1944748 2024-01-13T18:34:30.419 INFO:tasks.workunit.client.0.smithi084.stdout:op 3985 completed, throughput=5MB/sec 2024-01-13T18:34:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:34:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:34:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:34:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:34:30.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:34:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:34:30] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:34:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:34:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:34:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:34:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:34:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:34:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:34:30.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:34:30.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:34:31.419 INFO:tasks.workunit.client.0.smithi084.stdout: 792: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:31.420 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UIKhL0jes6h1r5Z off=10577428 len=461885 2024-01-13T18:34:31.423 INFO:tasks.workunit.client.0.smithi084.stdout:op 3986 completed, throughput=5MB/sec 2024-01-13T18:34:31.423 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-z1K3dmpd4xz89Qf off=17151180 len=337031 2024-01-13T18:34:31.424 INFO:tasks.workunit.client.0.smithi084.stdout:op 3987 completed, throughput=5MB/sec 2024-01-13T18:34:31.424 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S_yKKPSePtXFQmh off=5496527 len=1817365 2024-01-13T18:34:31.433 INFO:tasks.workunit.client.0.smithi084.stdout:op 3988 completed, throughput=5MB/sec 2024-01-13T18:34:31.433 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kHW6ky9daZZvDRU off=3845170 len=902710 2024-01-13T18:34:31.438 INFO:tasks.workunit.client.0.smithi084.stdout:op 3989 completed, throughput=5MB/sec 2024-01-13T18:34:31.438 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FPgCTdmOEo3YvnZ off=1841646 len=550434 2024-01-13T18:34:31.442 INFO:tasks.workunit.client.0.smithi084.stdout:op 3990 completed, throughput=5MB/sec 2024-01-13T18:34:31.442 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_DJY0XfLosVU5XO off=4125518 len=150172 2024-01-13T18:34:31.443 INFO:tasks.workunit.client.0.smithi084.stdout:op 3991 completed, throughput=5MB/sec 2024-01-13T18:34:31.443 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ithZGnBYt3SGj6a off=6032062 len=1943757 2024-01-13T18:34:31.446 INFO:tasks.workunit.client.0.smithi084.stdout:op 3992 completed, throughput=5MB/sec 2024-01-13T18:34:31.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:31 smithi099 ceph-mon[138788]: pgmap v1881: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:34:31.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:31 smithi084 ceph-mon[116404]: pgmap v1881: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:34:31.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:31 smithi084 ceph-mon[119097]: pgmap v1881: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:34:32.447 INFO:tasks.workunit.client.0.smithi084.stdout: 793: throughput=5MB/sec pending data=0 2024-01-13T18:34:32.447 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RWcKckifyIaYOrq off=4353868 len=830959 2024-01-13T18:34:32.451 INFO:tasks.workunit.client.0.smithi084.stdout:op 3993 completed, throughput=5MB/sec 2024-01-13T18:34:32.451 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YLqTF5X_UWWnCHV off=9085293 len=497231 2024-01-13T18:34:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:op 3994 completed, throughput=5MB/sec 2024-01-13T18:34:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-z_ZZW8w62Pj8dXy off=4736252 len=1703153 2024-01-13T18:34:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:op 3995 completed, throughput=5MB/sec 2024-01-13T18:34:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n6S-_aP0CO4zlbk off=221212 len=1124905 2024-01-13T18:34:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:op 3996 completed, throughput=5MB/sec 2024-01-13T18:34:33.463 INFO:tasks.workunit.client.0.smithi084.stdout: 794: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:33.463 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r20Q0hLnVocn0dV off=19138704 len=933359 2024-01-13T18:34:33.468 INFO:tasks.workunit.client.0.smithi084.stdout:op 3997 completed, throughput=5MB/sec 2024-01-13T18:34:33.469 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8ZiQ-86PEq0pp3R off=908936 len=371527 2024-01-13T18:34:33.472 INFO:tasks.workunit.client.0.smithi084.stdout:op 3998 completed, throughput=5MB/sec 2024-01-13T18:34:33.472 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dsiqZ6qBo6NW9uR off=7448448 len=1657000 2024-01-13T18:34:33.482 INFO:tasks.workunit.client.0.smithi084.stdout:op 3999 completed, throughput=5MB/sec 2024-01-13T18:34:33.482 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-A4FwDw5JiaAdBGo off=290010 len=2062122 2024-01-13T18:34:33.490 INFO:tasks.workunit.client.0.smithi084.stdout:op 4000 completed, throughput=5MB/sec 2024-01-13T18:34:33.490 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5DQvJIiwtJP62eT off=17297462 len=436719 2024-01-13T18:34:33.493 INFO:tasks.workunit.client.0.smithi084.stdout:op 4001 completed, throughput=5MB/sec 2024-01-13T18:34:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:33 smithi099 ceph-mon[138788]: pgmap v1882: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.8 MiB/s wr, 5 op/s 2024-01-13T18:34:33.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:33 smithi084 ceph-mon[116404]: pgmap v1882: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.8 MiB/s wr, 5 op/s 2024-01-13T18:34:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:33 smithi084 ceph-mon[119097]: pgmap v1882: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.8 MiB/s wr, 5 op/s 2024-01-13T18:34:34.493 INFO:tasks.workunit.client.0.smithi084.stdout: 795: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:34.493 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iO4s3zdKKKPt-OA off=6094605 len=55110 2024-01-13T18:34:34.494 INFO:tasks.workunit.client.0.smithi084.stdout:op 4002 completed, throughput=4.99MB/sec 2024-01-13T18:34:34.494 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YrpA7pIBz3h2SAx off=5724518 len=1290914 2024-01-13T18:34:34.501 INFO:tasks.workunit.client.0.smithi084.stdout:op 4003 completed, throughput=5MB/sec 2024-01-13T18:34:34.501 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-o3pFKD77jSGOQvu off=2793034 len=505893 2024-01-13T18:34:34.505 INFO:tasks.workunit.client.0.smithi084.stdout:op 4004 completed, throughput=5MB/sec 2024-01-13T18:34:34.505 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Tcoj5mNDHdfaUq0 off=5133552 len=175170 2024-01-13T18:34:34.508 INFO:tasks.workunit.client.0.smithi084.stdout:op 4005 completed, throughput=5MB/sec 2024-01-13T18:34:34.508 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HWww8ZcSRrXTnyu off=4191234 len=1384465 2024-01-13T18:34:34.510 INFO:tasks.workunit.client.0.smithi084.stdout:op 4006 completed, throughput=5MB/sec 2024-01-13T18:34:34.510 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VGy6kyNQVBbtdjo off=4969757 len=1487038 2024-01-13T18:34:34.517 INFO:tasks.workunit.client.0.smithi084.stdout:op 4007 completed, throughput=5MB/sec 2024-01-13T18:34:34.517 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lPQAF9DcCo52zXR off=7144509 len=345037 2024-01-13T18:34:34.518 INFO:tasks.workunit.client.0.smithi084.stdout:op 4008 completed, throughput=5MB/sec 2024-01-13T18:34:35.518 INFO:tasks.workunit.client.0.smithi084.stdout: 796: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:35.519 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8FcVI2ryZWnoK26 off=9585235 len=888649 2024-01-13T18:34:35.520 INFO:tasks.workunit.client.0.smithi084.stdout:op 4009 completed, throughput=5MB/sec 2024-01-13T18:34:35.520 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LqskgQfUAMUjb9h off=0 len=1357373 2024-01-13T18:34:35.527 INFO:tasks.workunit.client.0.smithi084.stdout:op 4010 completed, throughput=5MB/sec 2024-01-13T18:34:35.527 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RrfroR1fTqKvpG3 off=9697083 len=754791 2024-01-13T18:34:35.531 INFO:tasks.workunit.client.0.smithi084.stdout:op 4011 completed, throughput=5MB/sec 2024-01-13T18:34:35.531 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x6qehuOdwNwPD6n off=11643940 len=992866 2024-01-13T18:34:35.536 INFO:tasks.workunit.client.0.smithi084.stdout:op 4012 completed, throughput=5MB/sec 2024-01-13T18:34:35.536 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jJ8Yje8wYym6D8c off=1448625 len=1224239 2024-01-13T18:34:35.538 INFO:tasks.workunit.client.0.smithi084.stdout:op 4013 completed, throughput=5MB/sec 2024-01-13T18:34:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:35 smithi099 ceph-mon[138788]: pgmap v1883: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:34:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:35 smithi084 ceph-mon[119097]: pgmap v1883: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:34:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:35 smithi084 ceph-mon[116404]: pgmap v1883: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:34:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:36.539 INFO:tasks.workunit.client.0.smithi084.stdout: 797: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:36.539 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-11xd70Z3I-KDrbD off=455894 len=1782925 2024-01-13T18:34:36.541 INFO:tasks.workunit.client.0.smithi084.stdout:op 4014 completed, throughput=5MB/sec 2024-01-13T18:34:36.541 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jtSr8v6IdW7Sg3v off=9863784 len=1757723 2024-01-13T18:34:36.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 4015 completed, throughput=5MB/sec 2024-01-13T18:34:36.543 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8yIY5l3sNfeHTmB off=3503508 len=1127416 2024-01-13T18:34:36.548 INFO:tasks.workunit.client.0.smithi084.stdout:op 4016 completed, throughput=5MB/sec 2024-01-13T18:34:36.548 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DNq6Iu-Izr5QsqV off=4161194 len=1331239 2024-01-13T18:34:36.554 INFO:tasks.workunit.client.0.smithi084.stdout:op 4017 completed, throughput=5MB/sec 2024-01-13T18:34:37.554 INFO:tasks.workunit.client.0.smithi084.stdout: 798: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:37.554 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y6tZQFAqeAharrk off=10620731 len=1141211 2024-01-13T18:34:37.555 INFO:tasks.workunit.client.0.smithi084.stdout:op 4018 completed, throughput=5MB/sec 2024-01-13T18:34:37.556 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iMYFnfM_G1NRUdg off=15798536 len=978874 2024-01-13T18:34:37.560 INFO:tasks.workunit.client.0.smithi084.stdout:op 4019 completed, throughput=5MB/sec 2024-01-13T18:34:37.560 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Q8DkePpCg8Uwc5j off=1968955 len=355326 2024-01-13T18:34:37.563 INFO:tasks.workunit.client.0.smithi084.stdout:op 4020 completed, throughput=5MB/sec 2024-01-13T18:34:37.563 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rI6t863OWiqCZzD off=8685242 len=697370 2024-01-13T18:34:37.568 INFO:tasks.workunit.client.0.smithi084.stdout:op 4021 completed, throughput=5MB/sec 2024-01-13T18:34:37.568 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lZdMkbAcG0Z4Ojn off=11324885 len=1081557 2024-01-13T18:34:37.569 INFO:tasks.workunit.client.0.smithi084.stdout:op 4022 completed, throughput=5MB/sec 2024-01-13T18:34:37.569 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n5AfeEgemdacxNj off=8534695 len=456429 2024-01-13T18:34:37.570 INFO:tasks.workunit.client.0.smithi084.stdout:op 4023 completed, throughput=5MB/sec 2024-01-13T18:34:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:37 smithi099 ceph-mon[138788]: pgmap v1884: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:34:37.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:37 smithi084 ceph-mon[119097]: pgmap v1884: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:34:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:37 smithi084 ceph-mon[116404]: pgmap v1884: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:34:38.570 INFO:tasks.workunit.client.0.smithi084.stdout: 799: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:38.571 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1IV4X8z7jCWGbdj off=1490706 len=869343 2024-01-13T18:34:38.574 INFO:tasks.workunit.client.0.smithi084.stdout:op 4024 completed, throughput=4.99MB/sec 2024-01-13T18:34:38.575 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-03x22kyohEm5Lyr off=8556810 len=1521634 2024-01-13T18:34:38.578 INFO:tasks.workunit.client.0.smithi084.stdout:op 4025 completed, throughput=5MB/sec 2024-01-13T18:34:38.578 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-u-sUQJvMDVRS7bo off=5120526 len=1170019 2024-01-13T18:34:38.584 INFO:tasks.workunit.client.0.smithi084.stdout:op 4026 completed, throughput=5MB/sec 2024-01-13T18:34:38.584 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1Lf9MS4X4SUz0NG off=11525050 len=634342 2024-01-13T18:34:38.585 INFO:tasks.workunit.client.0.smithi084.stdout:op 4027 completed, throughput=5MB/sec 2024-01-13T18:34:38.585 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8onHXHmPXjeG3Zf off=4701426 len=1119316 2024-01-13T18:34:38.586 INFO:tasks.workunit.client.0.smithi084.stdout:op 4028 completed, throughput=5MB/sec 2024-01-13T18:34:39.587 INFO:tasks.workunit.client.0.smithi084.stdout: 800: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:39.587 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Oyq4DX56h3PMMeJ off=7019649 len=1158301 2024-01-13T18:34:39.594 INFO:tasks.workunit.client.0.smithi084.stdout:op 4029 completed, throughput=5MB/sec 2024-01-13T18:34:39.594 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JOvLHv_6Mxwz9Y- off=467808 len=1108821 2024-01-13T18:34:39.596 INFO:tasks.workunit.client.0.smithi084.stdout:op 4030 completed, throughput=5MB/sec 2024-01-13T18:34:39.596 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9YllmHTfYt1cn2o off=9354180 len=1373296 2024-01-13T18:34:39.597 INFO:tasks.workunit.client.0.smithi084.stdout:op 4031 completed, throughput=5MB/sec 2024-01-13T18:34:39.598 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OGUI2zLgDH1c7fK off=12225571 len=434848 2024-01-13T18:34:39.600 INFO:tasks.workunit.client.0.smithi084.stdout:op 4032 completed, throughput=5MB/sec 2024-01-13T18:34:39.601 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aCrw5DPXLTuR--V off=14328074 len=896890 2024-01-13T18:34:39.602 INFO:tasks.workunit.client.0.smithi084.stdout:op 4033 completed, throughput=5MB/sec 2024-01-13T18:34:39.602 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7RsMBTH3VHBuDcY off=4561451 len=933911 2024-01-13T18:34:39.604 INFO:tasks.workunit.client.0.smithi084.stdout:op 4034 completed, throughput=5MB/sec 2024-01-13T18:34:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:39 smithi099 ceph-mon[138788]: pgmap v1885: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:34:39.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:39 smithi084 ceph-mon[119097]: pgmap v1885: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:34:39.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:39 smithi084 ceph-mon[116404]: pgmap v1885: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:34:40.608 INFO:tasks.workunit.client.0.smithi084.stdout: 801: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:40.608 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-149GvuhtN0nlx2z off=2070944 len=1885449 2024-01-13T18:34:40.613 INFO:tasks.workunit.client.0.smithi084.stdout:op 4035 completed, throughput=5MB/sec 2024-01-13T18:34:40.613 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Q7TELTg3PpYhhug off=6867724 len=845113 2024-01-13T18:34:40.617 INFO:tasks.workunit.client.0.smithi084.stdout:op 4036 completed, throughput=5MB/sec 2024-01-13T18:34:40.617 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-m7eaKVxiC5Hn1LR off=1079511 len=1976797 2024-01-13T18:34:40.629 INFO:tasks.workunit.client.0.smithi084.stdout:op 4037 completed, throughput=5MB/sec 2024-01-13T18:34:40.629 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-X53i86faaiuhcBd off=7539888 len=408138 2024-01-13T18:34:40.632 INFO:tasks.workunit.client.0.smithi084.stdout:op 4038 completed, throughput=5MB/sec 2024-01-13T18:34:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:34:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:34:40] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:34:41.633 INFO:tasks.workunit.client.0.smithi084.stdout: 802: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:41.633 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rOUIVr4DPezurpZ off=5231925 len=489877 2024-01-13T18:34:41.634 INFO:tasks.workunit.client.0.smithi084.stdout:op 4039 completed, throughput=4.99MB/sec 2024-01-13T18:34:41.634 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-huTv08sdJ-18eew off=4006572 len=1622468 2024-01-13T18:34:41.636 INFO:tasks.workunit.client.0.smithi084.stdout:op 4040 completed, throughput=5MB/sec 2024-01-13T18:34:41.636 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cARDppeYOFLhT7Q off=5389582 len=1227220 2024-01-13T18:34:41.638 INFO:tasks.workunit.client.0.smithi084.stdout:op 4041 completed, throughput=5MB/sec 2024-01-13T18:34:41.638 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-onakFssUHDgLnD8 off=11673783 len=49881 2024-01-13T18:34:41.639 INFO:tasks.workunit.client.0.smithi084.stdout:op 4042 completed, throughput=5MB/sec 2024-01-13T18:34:41.639 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TPYhmXiiAPvNcJ9 off=349934 len=1363230 2024-01-13T18:34:41.641 INFO:tasks.workunit.client.0.smithi084.stdout:op 4043 completed, throughput=5MB/sec 2024-01-13T18:34:41.641 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ETYHH5hQpt1TgTf off=373016 len=1443482 2024-01-13T18:34:41.643 INFO:tasks.workunit.client.0.smithi084.stdout:op 4044 completed, throughput=5MB/sec 2024-01-13T18:34:41.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:41 smithi099 ceph-mon[138788]: pgmap v1886: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:34:41.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:41 smithi084 ceph-mon[119097]: pgmap v1886: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:34:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:41 smithi084 ceph-mon[116404]: pgmap v1886: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:34:42.642 INFO:tasks.workunit.client.0.smithi084.stdout: 803: throughput=5MB/sec pending data=0 2024-01-13T18:34:42.642 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UQcipEi2jVwLVKf off=15527616 len=260051 2024-01-13T18:34:42.643 INFO:tasks.workunit.client.0.smithi084.stdout:op 4045 completed, throughput=5MB/sec 2024-01-13T18:34:42.643 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3n4g6Hlbz2944Df off=8695915 len=642308 2024-01-13T18:34:42.644 INFO:tasks.workunit.client.0.smithi084.stdout:op 4046 completed, throughput=5MB/sec 2024-01-13T18:34:42.644 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-u_bITV_UlPRLDNq off=8628791 len=1197328 2024-01-13T18:34:42.651 INFO:tasks.workunit.client.0.smithi084.stdout:op 4047 completed, throughput=5MB/sec 2024-01-13T18:34:42.651 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hqT_omqNGrxhV8Y off=8078452 len=2054819 2024-01-13T18:34:42.662 INFO:tasks.workunit.client.0.smithi084.stdout:op 4048 completed, throughput=5MB/sec 2024-01-13T18:34:43.662 INFO:tasks.workunit.client.0.smithi084.stdout: 804: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:43.663 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bCcruUQAKGNF7Bl off=11971876 len=1458900 2024-01-13T18:34:43.672 INFO:tasks.workunit.client.0.smithi084.stdout:op 4049 completed, throughput=5MB/sec 2024-01-13T18:34:43.672 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yeQawfMfcJJYi_x off=4585950 len=1738216 2024-01-13T18:34:43.674 INFO:tasks.workunit.client.0.smithi084.stdout:op 4050 completed, throughput=5MB/sec 2024-01-13T18:34:43.674 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ycmpIBT1d45lShl off=3125172 len=1128927 2024-01-13T18:34:43.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 4051 completed, throughput=5MB/sec 2024-01-13T18:34:43.679 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EXZTBuWDxiay08_ off=22540803 len=1446456 2024-01-13T18:34:43.681 INFO:tasks.workunit.client.0.smithi084.stdout:op 4052 completed, throughput=5MB/sec 2024-01-13T18:34:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:43 smithi099 ceph-mon[138788]: pgmap v1887: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:34:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:43 smithi084 ceph-mon[119097]: pgmap v1887: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:34:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:43 smithi084 ceph-mon[116404]: pgmap v1887: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:34:44.682 INFO:tasks.workunit.client.0.smithi084.stdout: 805: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:44.682 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ECsHHHmNTPmZlMk off=15433110 len=1988611 2024-01-13T18:34:44.684 INFO:tasks.workunit.client.0.smithi084.stdout:op 4053 completed, throughput=5MB/sec 2024-01-13T18:34:44.684 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RIcZLCcCvtrmVZ1 off=3826496 len=1378725 2024-01-13T18:34:44.692 INFO:tasks.workunit.client.0.smithi084.stdout:op 4054 completed, throughput=5MB/sec 2024-01-13T18:34:44.692 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WyCSD_rH-u84W2Z off=23963 len=1530559 2024-01-13T18:34:44.693 INFO:tasks.workunit.client.0.smithi084.stdout:op 4055 completed, throughput=5MB/sec 2024-01-13T18:34:45.694 INFO:tasks.workunit.client.0.smithi084.stdout: 806: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:45.694 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-reAYaggPldWUZc- off=3393105 len=445431 2024-01-13T18:34:45.694 INFO:tasks.workunit.client.0.smithi084.stdout:op 4056 completed, throughput=4.99MB/sec 2024-01-13T18:34:45.695 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4VjJleUam8Cy5LO off=1366986 len=1584879 2024-01-13T18:34:45.696 INFO:tasks.workunit.client.0.smithi084.stdout:op 4057 completed, throughput=5MB/sec 2024-01-13T18:34:45.696 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TNdIZ8v9k05BD3U off=837614 len=1711210 2024-01-13T18:34:45.705 INFO:tasks.workunit.client.0.smithi084.stdout:op 4058 completed, throughput=5MB/sec 2024-01-13T18:34:45.705 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lZdMkbAcG0Z4Ojn off=5078970 len=1857388 2024-01-13T18:34:45.714 INFO:tasks.workunit.client.0.smithi084.stdout:op 4059 completed, throughput=5MB/sec 2024-01-13T18:34:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:45 smithi099 ceph-mon[138788]: pgmap v1888: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:34:45.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:45 smithi084 ceph-mon[116404]: pgmap v1888: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:34:45.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:45 smithi084 ceph-mon[119097]: pgmap v1888: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:34:46.714 INFO:tasks.workunit.client.0.smithi084.stdout: 807: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:46.714 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-INNeWQTUwbJ9fjD off=16180218 len=1241907 2024-01-13T18:34:46.716 INFO:tasks.workunit.client.0.smithi084.stdout:op 4060 completed, throughput=5MB/sec 2024-01-13T18:34:46.716 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WlaDkb6bPNnaUBW off=9479822 len=160101 2024-01-13T18:34:46.719 INFO:tasks.workunit.client.0.smithi084.stdout:op 4061 completed, throughput=5MB/sec 2024-01-13T18:34:46.719 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dYSA-p-STxi29xp off=2589964 len=1313902 2024-01-13T18:34:46.720 INFO:tasks.workunit.client.0.smithi084.stdout:op 4062 completed, throughput=5MB/sec 2024-01-13T18:34:46.720 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ah1Qg8zPimvV3ig off=7701559 len=247767 2024-01-13T18:34:46.721 INFO:tasks.workunit.client.0.smithi084.stdout:op 4063 completed, throughput=5MB/sec 2024-01-13T18:34:46.721 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jafRpb0puYskZc6 off=12914630 len=937436 2024-01-13T18:34:46.722 INFO:tasks.workunit.client.0.smithi084.stdout:op 4064 completed, throughput=5MB/sec 2024-01-13T18:34:46.722 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8PK1gWwP9dZ0z3q off=7491978 len=2089768 2024-01-13T18:34:46.726 INFO:tasks.workunit.client.0.smithi084.stdout:op 4065 completed, throughput=5MB/sec 2024-01-13T18:34:47.727 INFO:tasks.workunit.client.0.smithi084.stdout: 808: throughput=5MB/sec pending data=0 2024-01-13T18:34:47.727 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WTv9hrp705KjygX off=5317472 len=893219 2024-01-13T18:34:47.731 INFO:tasks.workunit.client.0.smithi084.stdout:op 4066 completed, throughput=5MB/sec 2024-01-13T18:34:47.731 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TPYhmXiiAPvNcJ9 off=833860 len=879304 2024-01-13T18:34:47.734 INFO:tasks.workunit.client.0.smithi084.stdout:op 4067 completed, throughput=5MB/sec 2024-01-13T18:34:47.735 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SPFXIkSr6yxPrxj off=6848420 len=1776925 2024-01-13T18:34:47.738 INFO:tasks.workunit.client.0.smithi084.stdout:op 4068 completed, throughput=5MB/sec 2024-01-13T18:34:47.738 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-j7uBA_Imne04Yaf off=16311102 len=1024323 2024-01-13T18:34:47.739 INFO:tasks.workunit.client.0.smithi084.stdout:op 4069 completed, throughput=5MB/sec 2024-01-13T18:34:47.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:47 smithi099 ceph-mon[138788]: pgmap v1889: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:34:47.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:47 smithi084 ceph-mon[116404]: pgmap v1889: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:34:47.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:47 smithi084 ceph-mon[119097]: pgmap v1889: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:34:48.740 INFO:tasks.workunit.client.0.smithi084.stdout: 809: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:48.740 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-s9jNKkeAELQ8Y9I off=3268160 len=124110 2024-01-13T18:34:48.741 INFO:tasks.workunit.client.0.smithi084.stdout:op 4070 completed, throughput=4.99MB/sec 2024-01-13T18:34:48.741 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-unTAp66vggCp77g off=1652716 len=362267 2024-01-13T18:34:48.742 INFO:tasks.workunit.client.0.smithi084.stdout:op 4071 completed, throughput=4.99MB/sec 2024-01-13T18:34:48.742 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pGrZBoymu2QCnR5 off=1695233 len=542654 2024-01-13T18:34:48.745 INFO:tasks.workunit.client.0.smithi084.stdout:op 4072 completed, throughput=5MB/sec 2024-01-13T18:34:48.746 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eJqYy5GqtndQpz3 off=58087 len=1243945 2024-01-13T18:34:48.753 INFO:tasks.workunit.client.0.smithi084.stdout:op 4073 completed, throughput=5MB/sec 2024-01-13T18:34:48.753 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Qywle42YbAd7iba off=5135089 len=2075408 2024-01-13T18:34:48.761 INFO:tasks.workunit.client.0.smithi084.stdout:op 4074 completed, throughput=5MB/sec 2024-01-13T18:34:48.761 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_Wu0YVDHKmGM69S off=2771162 len=1637054 2024-01-13T18:34:48.762 INFO:tasks.workunit.client.0.smithi084.stdout:op 4075 completed, throughput=5MB/sec 2024-01-13T18:34:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:49 smithi099 ceph-mon[138788]: pgmap v1890: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:34:49.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:49 smithi084 ceph-mon[116404]: pgmap v1890: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:34:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:49 smithi084 ceph-mon[119097]: pgmap v1890: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:34:49.762 INFO:tasks.workunit.client.0.smithi084.stdout: 810: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:49.762 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eqFpPAU9fqlB9yE off=19662956 len=213748 2024-01-13T18:34:49.763 INFO:tasks.workunit.client.0.smithi084.stdout:op 4076 completed, throughput=5MB/sec 2024-01-13T18:34:49.763 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GXe3sP57u8_Sdp3 off=9431604 len=321432 2024-01-13T18:34:49.767 INFO:tasks.workunit.client.0.smithi084.stdout:op 4077 completed, throughput=5MB/sec 2024-01-13T18:34:49.767 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-E3Ubu6aGsV7FySF off=6918610 len=1607722 2024-01-13T18:34:49.770 INFO:tasks.workunit.client.0.smithi084.stdout:op 4078 completed, throughput=5MB/sec 2024-01-13T18:34:49.770 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QtluiUGRuU_cwNn off=10400613 len=251136 2024-01-13T18:34:49.771 INFO:tasks.workunit.client.0.smithi084.stdout:op 4079 completed, throughput=5MB/sec 2024-01-13T18:34:49.771 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qo2dTtBFgpPBMKV off=19847227 len=1727445 2024-01-13T18:34:49.780 INFO:tasks.workunit.client.0.smithi084.stdout:op 4080 completed, throughput=5MB/sec 2024-01-13T18:34:49.780 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WDnavh1kRJgSHNk off=762533 len=131676 2024-01-13T18:34:49.781 INFO:tasks.workunit.client.0.smithi084.stdout:op 4081 completed, throughput=5MB/sec 2024-01-13T18:34:49.781 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ckn0qv2pAA9NiwT off=16682674 len=553147 2024-01-13T18:34:49.781 INFO:tasks.workunit.client.0.smithi084.stdout:op 4082 completed, throughput=5MB/sec 2024-01-13T18:34:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:50.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:34:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:34:50] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:34:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:34:50.781 INFO:tasks.workunit.client.0.smithi084.stdout: 811: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:50.781 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OQUdgyNuBiBtnmL off=15361760 len=1996949 2024-01-13T18:34:50.794 INFO:tasks.workunit.client.0.smithi084.stdout:op 4083 completed, throughput=5MB/sec 2024-01-13T18:34:50.794 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kNypXCs4Rbpi98i off=3631758 len=823241 2024-01-13T18:34:50.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 4084 completed, throughput=5MB/sec 2024-01-13T18:34:50.795 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uUg7djb-WcdfMdv off=1872085 len=355280 2024-01-13T18:34:50.798 INFO:tasks.workunit.client.0.smithi084.stdout:op 4085 completed, throughput=5MB/sec 2024-01-13T18:34:50.798 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PzvecyTnxJWguNG off=5567185 len=1269194 2024-01-13T18:34:50.806 INFO:tasks.workunit.client.0.smithi084.stdout:op 4086 completed, throughput=5MB/sec 2024-01-13T18:34:50.806 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7OdQDiOHjQPKmT_ off=6861945 len=949525 2024-01-13T18:34:50.807 INFO:tasks.workunit.client.0.smithi084.stdout:op 4087 completed, throughput=5MB/sec 2024-01-13T18:34:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:51 smithi099 ceph-mon[138788]: pgmap v1891: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:34:51.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:51 smithi084 ceph-mon[116404]: pgmap v1891: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:34:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:51 smithi084 ceph-mon[119097]: pgmap v1891: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:34:51.807 INFO:tasks.workunit.client.0.smithi084.stdout: 812: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:51.807 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M6AQWGwzzUvCfNL off=14706292 len=1235931 2024-01-13T18:34:51.809 INFO:tasks.workunit.client.0.smithi084.stdout:op 4088 completed, throughput=5MB/sec 2024-01-13T18:34:51.809 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gzxjZVzaWl-fUEG off=6362399 len=1493061 2024-01-13T18:34:51.816 INFO:tasks.workunit.client.0.smithi084.stdout:op 4089 completed, throughput=5MB/sec 2024-01-13T18:34:51.817 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gTDtyWMRyc9NSyF off=8909865 len=762596 2024-01-13T18:34:51.820 INFO:tasks.workunit.client.0.smithi084.stdout:op 4090 completed, throughput=5MB/sec 2024-01-13T18:34:51.820 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Dycu8gzrkiJMte5 off=14327254 len=893683 2024-01-13T18:34:51.825 INFO:tasks.workunit.client.0.smithi084.stdout:op 4091 completed, throughput=5MB/sec 2024-01-13T18:34:51.825 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RZnNaY04bfI8Kbk off=8775777 len=1924679 2024-01-13T18:34:51.826 INFO:tasks.workunit.client.0.smithi084.stdout:op 4092 completed, throughput=5MB/sec 2024-01-13T18:34:52.826 INFO:tasks.workunit.client.0.smithi084.stdout: 813: throughput=5MB/sec pending data=0 2024-01-13T18:34:52.826 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y1ic76dOrXDulGK off=520059 len=988309 2024-01-13T18:34:52.832 INFO:tasks.workunit.client.0.smithi084.stdout:op 4093 completed, throughput=5MB/sec 2024-01-13T18:34:52.832 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-81_pY7NfK5Z05lS off=5624792 len=1257487 2024-01-13T18:34:52.837 INFO:tasks.workunit.client.0.smithi084.stdout:op 4094 completed, throughput=5MB/sec 2024-01-13T18:34:52.837 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YKoD9QaGO-KLe_S off=1411552 len=1393773 2024-01-13T18:34:52.839 INFO:tasks.workunit.client.0.smithi084.stdout:op 4095 completed, throughput=5MB/sec 2024-01-13T18:34:52.839 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8pNKNvGyUoVRgRd off=20553222 len=1360594 2024-01-13T18:34:52.845 INFO:tasks.workunit.client.0.smithi084.stdout:op 4096 completed, throughput=5MB/sec 2024-01-13T18:34:53.846 INFO:tasks.workunit.client.0.smithi084.stdout: 814: throughput=5MB/sec pending data=0 2024-01-13T18:34:53.846 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dVVI8X1lDKyfmbj off=414944 len=1976269 2024-01-13T18:34:53.858 INFO:tasks.workunit.client.0.smithi084.stdout:op 4097 completed, throughput=5MB/sec 2024-01-13T18:34:53.858 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--WvSjdHfYVx3CUd off=0 len=1101319 2024-01-13T18:34:53.864 INFO:tasks.workunit.client.0.smithi084.stdout:op 4098 completed, throughput=5MB/sec 2024-01-13T18:34:53.865 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HImarWGmqFeYsJ0 off=1948577 len=1800595 2024-01-13T18:34:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:53 smithi099 ceph-mon[138788]: pgmap v1892: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:34:53.874 INFO:tasks.workunit.client.0.smithi084.stdout:op 4099 completed, throughput=5MB/sec 2024-01-13T18:34:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:53 smithi084 ceph-mon[116404]: pgmap v1892: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:34:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:53 smithi084 ceph-mon[119097]: pgmap v1892: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:34:54.875 INFO:tasks.workunit.client.0.smithi084.stdout: 815: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:54.875 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zzCZC92rkTsEFk5 off=16116326 len=806550 2024-01-13T18:34:54.879 INFO:tasks.workunit.client.0.smithi084.stdout:op 4100 completed, throughput=5MB/sec 2024-01-13T18:34:54.879 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-b2i3BU5uNefIZID off=6236418 len=418618 2024-01-13T18:34:54.882 INFO:tasks.workunit.client.0.smithi084.stdout:op 4101 completed, throughput=5MB/sec 2024-01-13T18:34:54.882 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MogQE1lZBvbe5c7 off=9171950 len=1996054 2024-01-13T18:34:54.886 INFO:tasks.workunit.client.0.smithi084.stdout:op 4102 completed, throughput=5MB/sec 2024-01-13T18:34:54.886 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-igPAZ7UYMOUb2qx off=8989016 len=407766 2024-01-13T18:34:54.886 INFO:tasks.workunit.client.0.smithi084.stdout:op 4103 completed, throughput=5MB/sec 2024-01-13T18:34:54.886 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CmQOa8SIpxtoTR6 off=8691657 len=159554 2024-01-13T18:34:54.889 INFO:tasks.workunit.client.0.smithi084.stdout:op 4104 completed, throughput=5MB/sec 2024-01-13T18:34:54.889 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U-WAziBDGGQIeUR off=68807 len=1058398 2024-01-13T18:34:54.890 INFO:tasks.workunit.client.0.smithi084.stdout:op 4105 completed, throughput=5MB/sec 2024-01-13T18:34:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:55 smithi099 ceph-mon[138788]: pgmap v1893: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:34:55.891 INFO:tasks.workunit.client.0.smithi084.stdout: 816: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:55.891 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M1sp9JIHLhMVTTf off=14921387 len=1415876 2024-01-13T18:34:55.892 INFO:tasks.workunit.client.0.smithi084.stdout:op 4106 completed, throughput=5MB/sec 2024-01-13T18:34:55.892 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yI9hnfs-kxh8_af off=13427920 len=148481 2024-01-13T18:34:55.893 INFO:tasks.workunit.client.0.smithi084.stdout:op 4107 completed, throughput=5MB/sec 2024-01-13T18:34:55.893 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yU60WdvKNHhIfc1 off=41484 len=756558 2024-01-13T18:34:55.894 INFO:tasks.workunit.client.0.smithi084.stdout:op 4108 completed, throughput=5MB/sec 2024-01-13T18:34:55.894 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_-LjZZbIhhEPIoj off=7022960 len=1462846 2024-01-13T18:34:55.896 INFO:tasks.workunit.client.0.smithi084.stdout:op 4109 completed, throughput=5MB/sec 2024-01-13T18:34:55.896 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ngi4z61yqJ_jDXe off=17922126 len=543399 2024-01-13T18:34:55.900 INFO:tasks.workunit.client.0.smithi084.stdout:op 4110 completed, throughput=5MB/sec 2024-01-13T18:34:55.900 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-01C4qkb30Lgydy1 off=5072797 len=436157 2024-01-13T18:34:55.901 INFO:tasks.workunit.client.0.smithi084.stdout:op 4111 completed, throughput=5MB/sec 2024-01-13T18:34:55.901 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OBTbaYa58-Pc25L off=17573222 len=2030037 2024-01-13T18:34:55.913 INFO:tasks.workunit.client.0.smithi084.stdout:op 4112 completed, throughput=5MB/sec 2024-01-13T18:34:55.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:55 smithi084 ceph-mon[116404]: pgmap v1893: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:34:55.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:55 smithi084 ceph-mon[119097]: pgmap v1893: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:34:56.913 INFO:tasks.workunit.client.0.smithi084.stdout: 817: throughput=5MB/sec pending data=0 2024-01-13T18:34:56.913 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OUqfjUfh_mr1a46 off=234195 len=736223 2024-01-13T18:34:56.915 INFO:tasks.workunit.client.0.smithi084.stdout:op 4113 completed, throughput=5MB/sec 2024-01-13T18:34:56.915 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vpbuWrZe4ukLXtP off=9494980 len=2009389 2024-01-13T18:34:56.918 INFO:tasks.workunit.client.0.smithi084.stdout:op 4114 completed, throughput=5MB/sec 2024-01-13T18:34:56.918 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RgnmG7ETz9mQVW2 off=3031433 len=1103723 2024-01-13T18:34:56.924 INFO:tasks.workunit.client.0.smithi084.stdout:op 4115 completed, throughput=5MB/sec 2024-01-13T18:34:56.924 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QRDB2YH42V3IF74 off=12458807 len=1831002 2024-01-13T18:34:56.933 INFO:tasks.workunit.client.0.smithi084.stdout:op 4116 completed, throughput=5MB/sec 2024-01-13T18:34:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:57 smithi099 ceph-mon[138788]: pgmap v1894: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:34:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:57 smithi084 ceph-mon[116404]: pgmap v1894: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:34:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:57 smithi084 ceph-mon[119097]: pgmap v1894: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:34:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: 818: throughput=5MB/sec pending data=0 2024-01-13T18:34:57.934 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mussB6QlNFPWaty off=10973105 len=1502046 2024-01-13T18:34:57.935 INFO:tasks.workunit.client.0.smithi084.stdout:op 4117 completed, throughput=5MB/sec 2024-01-13T18:34:57.935 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xOZVWmlcQ_-z394 off=3671218 len=92381 2024-01-13T18:34:57.938 INFO:tasks.workunit.client.0.smithi084.stdout:op 4118 completed, throughput=5MB/sec 2024-01-13T18:34:57.938 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9v9AwbSIM8qmL_d off=258938 len=171873 2024-01-13T18:34:57.939 INFO:tasks.workunit.client.0.smithi084.stdout:op 4119 completed, throughput=5MB/sec 2024-01-13T18:34:57.939 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-31sPUFDaQTbBhx7 off=993233 len=1276265 2024-01-13T18:34:57.940 INFO:tasks.workunit.client.0.smithi084.stdout:op 4120 completed, throughput=5MB/sec 2024-01-13T18:34:57.940 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FDzYELkgX3GIm6T off=6682306 len=1976726 2024-01-13T18:34:57.943 INFO:tasks.workunit.client.0.smithi084.stdout:op 4121 completed, throughput=5MB/sec 2024-01-13T18:34:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: 819: throughput=5MB/sec pending data=0 2024-01-13T18:34:58.944 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Meb1ddVdL0IAEQb off=9695314 len=1564184 2024-01-13T18:34:58.945 INFO:tasks.workunit.client.0.smithi084.stdout:op 4122 completed, throughput=5MB/sec 2024-01-13T18:34:58.945 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uSLSrHO5Wb_x5o- off=17936992 len=891425 2024-01-13T18:34:58.947 INFO:tasks.workunit.client.0.smithi084.stdout:op 4123 completed, throughput=5MB/sec 2024-01-13T18:34:58.947 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BrvqjudKhkD51p6 off=3115559 len=883168 2024-01-13T18:34:58.949 INFO:tasks.workunit.client.0.smithi084.stdout:op 4124 completed, throughput=5MB/sec 2024-01-13T18:34:58.949 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ErBolFQR1eXm8G2 off=644602 len=702032 2024-01-13T18:34:58.953 INFO:tasks.workunit.client.0.smithi084.stdout:op 4125 completed, throughput=5MB/sec 2024-01-13T18:34:59.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:34:59 smithi099 ceph-mon[138788]: pgmap v1895: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:34:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:34:59 smithi084 ceph-mon[116404]: pgmap v1895: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:34:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:34:59 smithi084 ceph-mon[119097]: pgmap v1895: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:34:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: 820: throughput=4.99MB/sec pending data=0 2024-01-13T18:34:59.954 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8nyo8DjUgt4PPio off=15750478 len=785977 2024-01-13T18:34:59.958 INFO:tasks.workunit.client.0.smithi084.stdout:op 4126 completed, throughput=5MB/sec 2024-01-13T18:34:59.958 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-O13O0RyNf2Fid3O off=9442602 len=739825 2024-01-13T18:34:59.963 INFO:tasks.workunit.client.0.smithi084.stdout:op 4127 completed, throughput=5MB/sec 2024-01-13T18:34:59.963 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xzK2ioFNwph4iFC off=10639579 len=202725 2024-01-13T18:34:59.964 INFO:tasks.workunit.client.0.smithi084.stdout:op 4128 completed, throughput=5MB/sec 2024-01-13T18:34:59.964 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dGYIeMHOWN9k02d off=1394137 len=1187476 2024-01-13T18:34:59.970 INFO:tasks.workunit.client.0.smithi084.stdout:op 4129 completed, throughput=5MB/sec 2024-01-13T18:34:59.970 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-72wePOzOt_5M-Yt off=24007458 len=1408143 2024-01-13T18:34:59.976 INFO:tasks.workunit.client.0.smithi084.stdout:op 4130 completed, throughput=5MB/sec 2024-01-13T18:34:59.976 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--AjXYDUqqnjNUXv off=282990 len=1565311 2024-01-13T18:34:59.977 INFO:tasks.workunit.client.0.smithi084.stdout:op 4131 completed, throughput=5MB/sec 2024-01-13T18:35:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:35:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:35:00] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:35:00.977 INFO:tasks.workunit.client.0.smithi084.stdout: 821: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:00.978 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vvRrTO0oZvBG9fj off=21683678 len=961927 2024-01-13T18:35:00.979 INFO:tasks.workunit.client.0.smithi084.stdout:op 4132 completed, throughput=5MB/sec 2024-01-13T18:35:00.979 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JP_SKuXU84UJ4f- off=6805845 len=2035453 2024-01-13T18:35:00.990 INFO:tasks.workunit.client.0.smithi084.stdout:op 4133 completed, throughput=5MB/sec 2024-01-13T18:35:00.991 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KVQ9c64fkO8AuN1 off=19115410 len=1350223 2024-01-13T18:35:00.992 INFO:tasks.workunit.client.0.smithi084.stdout:op 4134 completed, throughput=5MB/sec 2024-01-13T18:35:00.992 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IReUMQwVu_7gOjd off=0 len=1076504 2024-01-13T18:35:00.997 INFO:tasks.workunit.client.0.smithi084.stdout:op 4135 completed, throughput=5MB/sec 2024-01-13T18:35:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:01 smithi099 ceph-mon[138788]: pgmap v1896: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:35:01.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:01 smithi084 ceph-mon[116404]: pgmap v1896: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:35:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:01 smithi084 ceph-mon[119097]: pgmap v1896: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:35:01.997 INFO:tasks.workunit.client.0.smithi084.stdout: 822: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:01.998 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xZh9yPtXPvczhzR off=3210013 len=697818 2024-01-13T18:35:02.002 INFO:tasks.workunit.client.0.smithi084.stdout:op 4136 completed, throughput=5MB/sec 2024-01-13T18:35:02.002 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xb-_RJG_5Be9v_j off=3778284 len=461369 2024-01-13T18:35:02.005 INFO:tasks.workunit.client.0.smithi084.stdout:op 4137 completed, throughput=5MB/sec 2024-01-13T18:35:02.005 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-a3QalBJ9xQB6Eov off=9850675 len=1690338 2024-01-13T18:35:02.008 INFO:tasks.workunit.client.0.smithi084.stdout:op 4138 completed, throughput=5MB/sec 2024-01-13T18:35:02.008 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8QjkkBJPgy1i6mj off=14726366 len=437829 2024-01-13T18:35:02.008 INFO:tasks.workunit.client.0.smithi084.stdout:op 4139 completed, throughput=5MB/sec 2024-01-13T18:35:02.008 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-M8lxnIrshfAbD1n off=3735951 len=446566 2024-01-13T18:35:02.011 INFO:tasks.workunit.client.0.smithi084.stdout:op 4140 completed, throughput=5MB/sec 2024-01-13T18:35:02.012 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uXDZXyKAKOW_TLv off=4089948 len=774181 2024-01-13T18:35:02.012 INFO:tasks.workunit.client.0.smithi084.stdout:op 4141 completed, throughput=5MB/sec 2024-01-13T18:35:03.013 INFO:tasks.workunit.client.0.smithi084.stdout: 823: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:03.013 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HL7Er9RU7SlLw2C off=17879130 len=112815 2024-01-13T18:35:03.014 INFO:tasks.workunit.client.0.smithi084.stdout:op 4142 completed, throughput=4.99MB/sec 2024-01-13T18:35:03.014 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FM1xPlvzopYmT5V off=3012092 len=1212664 2024-01-13T18:35:03.021 INFO:tasks.workunit.client.0.smithi084.stdout:op 4143 completed, throughput=5MB/sec 2024-01-13T18:35:03.021 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wIe-S3uotzSY8Nh off=10407220 len=1333508 2024-01-13T18:35:03.023 INFO:tasks.workunit.client.0.smithi084.stdout:op 4144 completed, throughput=5MB/sec 2024-01-13T18:35:03.023 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rVNCG9lzom45byW off=13390147 len=702219 2024-01-13T18:35:03.027 INFO:tasks.workunit.client.0.smithi084.stdout:op 4145 completed, throughput=5MB/sec 2024-01-13T18:35:03.027 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yaTeJV7HPxGRPEt off=764500 len=1093535 2024-01-13T18:35:03.029 INFO:tasks.workunit.client.0.smithi084.stdout:op 4146 completed, throughput=5MB/sec 2024-01-13T18:35:03.029 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mqihCNtsMDPNZsV off=4706393 len=1045880 2024-01-13T18:35:03.034 INFO:tasks.workunit.client.0.smithi084.stdout:op 4147 completed, throughput=5MB/sec 2024-01-13T18:35:03.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:03 smithi099 ceph-mon[138788]: pgmap v1897: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:35:03.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:03 smithi084 ceph-mon[116404]: pgmap v1897: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:35:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:03 smithi084 ceph-mon[119097]: pgmap v1897: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:35:04.035 INFO:tasks.workunit.client.0.smithi084.stdout: 824: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:04.035 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-K2Gy5Bn-LvLrl8x off=3526624 len=187213 2024-01-13T18:35:04.036 INFO:tasks.workunit.client.0.smithi084.stdout:op 4148 completed, throughput=4.99MB/sec 2024-01-13T18:35:04.036 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kpN84_Q3CJiuId8 off=3472455 len=529413 2024-01-13T18:35:04.037 INFO:tasks.workunit.client.0.smithi084.stdout:op 4149 completed, throughput=5MB/sec 2024-01-13T18:35:04.037 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lyfcTQGym5GdX72 off=9101513 len=1430334 2024-01-13T18:35:04.045 INFO:tasks.workunit.client.0.smithi084.stdout:op 4150 completed, throughput=5MB/sec 2024-01-13T18:35:04.045 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-P01viI-hIixj7Dr off=8041048 len=1650884 2024-01-13T18:35:04.046 INFO:tasks.workunit.client.0.smithi084.stdout:op 4151 completed, throughput=5MB/sec 2024-01-13T18:35:04.046 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-r7MfqXd5S7ue13q off=1880319 len=186960 2024-01-13T18:35:04.047 INFO:tasks.workunit.client.0.smithi084.stdout:op 4152 completed, throughput=5MB/sec 2024-01-13T18:35:04.047 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_GPnRPsrBWg6Bew off=2472192 len=240134 2024-01-13T18:35:04.050 INFO:tasks.workunit.client.0.smithi084.stdout:op 4153 completed, throughput=5MB/sec 2024-01-13T18:35:04.050 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QC3RZr-46pTnzuv off=8085833 len=1030016 2024-01-13T18:35:04.057 INFO:tasks.workunit.client.0.smithi084.stdout:op 4154 completed, throughput=5MB/sec 2024-01-13T18:35:05.057 INFO:tasks.workunit.client.0.smithi084.stdout: 825: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:05.057 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Pb5R-vGSIy905e2 off=2307807 len=1050315 2024-01-13T18:35:05.058 INFO:tasks.workunit.client.0.smithi084.stdout:op 4155 completed, throughput=5MB/sec 2024-01-13T18:35:05.059 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3V8ujtTpta_JZHT off=634951 len=1594615 2024-01-13T18:35:05.061 INFO:tasks.workunit.client.0.smithi084.stdout:op 4156 completed, throughput=5MB/sec 2024-01-13T18:35:05.062 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cGBWTU_XCg7lpSK off=14546133 len=29074 2024-01-13T18:35:05.062 INFO:tasks.workunit.client.0.smithi084.stdout:op 4157 completed, throughput=5MB/sec 2024-01-13T18:35:05.062 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y1sO3xaSrfGHRXh off=1261672 len=1812319 2024-01-13T18:35:05.072 INFO:tasks.workunit.client.0.smithi084.stdout:op 4158 completed, throughput=5MB/sec 2024-01-13T18:35:05.072 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IjwWvhVgm8XmbLs off=377300 len=1428563 2024-01-13T18:35:05.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 4159 completed, throughput=5MB/sec 2024-01-13T18:35:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:05 smithi099 ceph-mon[138788]: pgmap v1898: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:35:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:05 smithi084 ceph-mon[116404]: pgmap v1898: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:35:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:05 smithi084 ceph-mon[119097]: pgmap v1898: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:35:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:06.080 INFO:tasks.workunit.client.0.smithi084.stdout: 826: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:06.081 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-F0H5f3OyJCPji7F off=14386844 len=850495 2024-01-13T18:35:06.086 INFO:tasks.workunit.client.0.smithi084.stdout:op 4160 completed, throughput=5MB/sec 2024-01-13T18:35:06.086 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-apDLrn4QyZRJSTp off=1245597 len=1592331 2024-01-13T18:35:06.088 INFO:tasks.workunit.client.0.smithi084.stdout:op 4161 completed, throughput=5MB/sec 2024-01-13T18:35:06.088 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Pu2FTvaTh-3Kiup off=2849164 len=1250445 2024-01-13T18:35:06.089 INFO:tasks.workunit.client.0.smithi084.stdout:op 4162 completed, throughput=5MB/sec 2024-01-13T18:35:06.090 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj---V8zp_L11SCP3- off=5424290 len=449822 2024-01-13T18:35:06.091 INFO:tasks.workunit.client.0.smithi084.stdout:op 4163 completed, throughput=5MB/sec 2024-01-13T18:35:06.091 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-P0SSiPFkXVGHUgs off=4260438 len=601487 2024-01-13T18:35:06.092 INFO:tasks.workunit.client.0.smithi084.stdout:op 4164 completed, throughput=5MB/sec 2024-01-13T18:35:07.092 INFO:tasks.workunit.client.0.smithi084.stdout: 827: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:07.092 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vkKrvf1ymxnMOJ_ off=7660108 len=445554 2024-01-13T18:35:07.093 INFO:tasks.workunit.client.0.smithi084.stdout:op 4165 completed, throughput=4.99MB/sec 2024-01-13T18:35:07.093 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8xyAdTnOiHgu5aA off=5793770 len=1364149 2024-01-13T18:35:07.097 INFO:tasks.workunit.client.0.smithi084.stdout:op 4166 completed, throughput=5MB/sec 2024-01-13T18:35:07.097 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uCFnz-TOcC9aVJl off=11309214 len=985764 2024-01-13T18:35:07.097 INFO:tasks.workunit.client.0.smithi084.stdout:op 4167 completed, throughput=5MB/sec 2024-01-13T18:35:07.097 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-v796DScGG8BKX2H off=1870722 len=241861 2024-01-13T18:35:07.099 INFO:tasks.workunit.client.0.smithi084.stdout:op 4168 completed, throughput=5MB/sec 2024-01-13T18:35:07.099 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lhpH_P9TFAkfeTE off=15430709 len=1212962 2024-01-13T18:35:07.105 INFO:tasks.workunit.client.0.smithi084.stdout:op 4169 completed, throughput=5MB/sec 2024-01-13T18:35:07.105 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-q6slgUE5XC3MCbh off=1176624 len=347422 2024-01-13T18:35:07.106 INFO:tasks.workunit.client.0.smithi084.stdout:op 4170 completed, throughput=5MB/sec 2024-01-13T18:35:07.106 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-o5YMgJLzOcd2sAb off=13922966 len=271650 2024-01-13T18:35:07.109 INFO:tasks.workunit.client.0.smithi084.stdout:op 4171 completed, throughput=5MB/sec 2024-01-13T18:35:07.109 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Qlstcj4ADXdyAB8 off=1339883 len=1609926 2024-01-13T18:35:07.110 INFO:tasks.workunit.client.0.smithi084.stdout:op 4172 completed, throughput=5MB/sec 2024-01-13T18:35:07.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:07 smithi099 ceph-mon[138788]: pgmap v1899: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:35:07.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:07 smithi084 ceph-mon[116404]: pgmap v1899: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:35:07.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:07 smithi084 ceph-mon[119097]: pgmap v1899: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:35:08.110 INFO:tasks.workunit.client.0.smithi084.stdout: 828: throughput=5MB/sec pending data=0 2024-01-13T18:35:08.110 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GNiYJ1QeP3rV-2h off=5993463 len=558733 2024-01-13T18:35:08.111 INFO:tasks.workunit.client.0.smithi084.stdout:op 4173 completed, throughput=5MB/sec 2024-01-13T18:35:08.111 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j3NldoElY9wPPd2 off=3860413 len=390932 2024-01-13T18:35:08.115 INFO:tasks.workunit.client.0.smithi084.stdout:op 4174 completed, throughput=5MB/sec 2024-01-13T18:35:08.115 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5R8QuDdnmW0Rm3O off=478332 len=2042906 2024-01-13T18:35:08.127 INFO:tasks.workunit.client.0.smithi084.stdout:op 4175 completed, throughput=5MB/sec 2024-01-13T18:35:08.127 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7lH56gyxfAm4wj0 off=6515971 len=850447 2024-01-13T18:35:08.129 INFO:tasks.workunit.client.0.smithi084.stdout:op 4176 completed, throughput=5MB/sec 2024-01-13T18:35:08.129 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cq6JyuHiL_vZ8a8 off=20091752 len=1213595 2024-01-13T18:35:08.134 INFO:tasks.workunit.client.0.smithi084.stdout:op 4177 completed, throughput=5MB/sec 2024-01-13T18:35:09.135 INFO:tasks.workunit.client.0.smithi084.stdout: 829: throughput=5MB/sec pending data=0 2024-01-13T18:35:09.135 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kgTnAuCaUt2dW0m off=6572424 len=777599 2024-01-13T18:35:09.140 INFO:tasks.workunit.client.0.smithi084.stdout:op 4178 completed, throughput=5MB/sec 2024-01-13T18:35:09.140 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ShM-W67P6WsQ0ge off=242344 len=563777 2024-01-13T18:35:09.143 INFO:tasks.workunit.client.0.smithi084.stdout:op 4179 completed, throughput=5MB/sec 2024-01-13T18:35:09.143 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n5AfeEgemdacxNj off=10429030 len=57657 2024-01-13T18:35:09.144 INFO:tasks.workunit.client.0.smithi084.stdout:op 4180 completed, throughput=5MB/sec 2024-01-13T18:35:09.144 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GO4d_3h3mCYWjFO off=946130 len=632783 2024-01-13T18:35:09.147 INFO:tasks.workunit.client.0.smithi084.stdout:op 4181 completed, throughput=5MB/sec 2024-01-13T18:35:09.147 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5DDJ7BkRRNa7hm8 off=4582976 len=1132662 2024-01-13T18:35:09.152 INFO:tasks.workunit.client.0.smithi084.stdout:op 4182 completed, throughput=5MB/sec 2024-01-13T18:35:09.153 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nkQlPd2JqM2qwD_ off=5357330 len=888897 2024-01-13T18:35:09.157 INFO:tasks.workunit.client.0.smithi084.stdout:op 4183 completed, throughput=5MB/sec 2024-01-13T18:35:09.157 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4WiCw23N6jjU4os off=6365990 len=119626 2024-01-13T18:35:09.159 INFO:tasks.workunit.client.0.smithi084.stdout:op 4184 completed, throughput=5MB/sec 2024-01-13T18:35:09.159 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iO4s3zdKKKPt-OA off=5187061 len=617603 2024-01-13T18:35:09.163 INFO:tasks.workunit.client.0.smithi084.stdout:op 4185 completed, throughput=5MB/sec 2024-01-13T18:35:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:09 smithi099 ceph-mon[138788]: pgmap v1900: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:35:09.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:09 smithi084 ceph-mon[116404]: pgmap v1900: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:35:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:09 smithi084 ceph-mon[119097]: pgmap v1900: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:35:10.164 INFO:tasks.workunit.client.0.smithi084.stdout: 830: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:10.164 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lM0IiJgIGouGFsr off=9761037 len=171021 2024-01-13T18:35:10.164 INFO:tasks.workunit.client.0.smithi084.stdout:op 4186 completed, throughput=4.99MB/sec 2024-01-13T18:35:10.164 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VAg0VzjsjLwa5Q- off=5858161 len=856379 2024-01-13T18:35:10.169 INFO:tasks.workunit.client.0.smithi084.stdout:op 4187 completed, throughput=5MB/sec 2024-01-13T18:35:10.169 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xDtP_h-BML7Dt8v off=9405266 len=203223 2024-01-13T18:35:10.169 INFO:tasks.workunit.client.0.smithi084.stdout:op 4188 completed, throughput=5MB/sec 2024-01-13T18:35:10.169 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gKgJAMX3PysSQoM off=34702 len=1301715 2024-01-13T18:35:10.171 INFO:tasks.workunit.client.0.smithi084.stdout:op 4189 completed, throughput=5MB/sec 2024-01-13T18:35:10.171 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-g7bjXMGcroVoqls off=5036343 len=777846 2024-01-13T18:35:10.175 INFO:tasks.workunit.client.0.smithi084.stdout:op 4190 completed, throughput=5MB/sec 2024-01-13T18:35:10.175 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-W5fEsEf_xQfePto off=4758087 len=314638 2024-01-13T18:35:10.178 INFO:tasks.workunit.client.0.smithi084.stdout:op 4191 completed, throughput=5MB/sec 2024-01-13T18:35:10.178 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hdP-rlQDsIfcBNb off=2640666 len=288777 2024-01-13T18:35:10.179 INFO:tasks.workunit.client.0.smithi084.stdout:op 4192 completed, throughput=5MB/sec 2024-01-13T18:35:10.179 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TW-aYJGb1atNDFE off=1092880 len=912976 2024-01-13T18:35:10.184 INFO:tasks.workunit.client.0.smithi084.stdout:op 4193 completed, throughput=5MB/sec 2024-01-13T18:35:10.184 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XfFkZnTYgLkdAi3 off=13760884 len=1082702 2024-01-13T18:35:10.190 INFO:tasks.workunit.client.0.smithi084.stdout:op 4194 completed, throughput=5MB/sec 2024-01-13T18:35:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:35:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:35:10] "GET /metrics HTTP/1.1" 200 33999 "" "Prometheus/2.43.0" 2024-01-13T18:35:11.190 INFO:tasks.workunit.client.0.smithi084.stdout: 831: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:11.191 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7tHA8rEVWUF4MXj off=15539442 len=1558360 2024-01-13T18:35:11.192 INFO:tasks.workunit.client.0.smithi084.stdout:op 4195 completed, throughput=5MB/sec 2024-01-13T18:35:11.192 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aGuDJueE6FTPFQf off=935022 len=1629147 2024-01-13T18:35:11.194 INFO:tasks.workunit.client.0.smithi084.stdout:op 4196 completed, throughput=5MB/sec 2024-01-13T18:35:11.194 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bZfUDS3NH1rPpvq off=7542579 len=1873671 2024-01-13T18:35:11.206 INFO:tasks.workunit.client.0.smithi084.stdout:op 4197 completed, throughput=5MB/sec 2024-01-13T18:35:11.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:11 smithi099 ceph-mon[138788]: pgmap v1901: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 6 op/s 2024-01-13T18:35:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:11 smithi084 ceph-mon[116404]: pgmap v1901: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 6 op/s 2024-01-13T18:35:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:11 smithi084 ceph-mon[119097]: pgmap v1901: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 6 op/s 2024-01-13T18:35:12.206 INFO:tasks.workunit.client.0.smithi084.stdout: 832: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:12.206 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QmnEBwFr1gVnqgy off=20862078 len=1270379 2024-01-13T18:35:12.212 INFO:tasks.workunit.client.0.smithi084.stdout:op 4198 completed, throughput=5MB/sec 2024-01-13T18:35:12.212 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VjFPRpFgXOmwluc off=1399090 len=2044360 2024-01-13T18:35:12.215 INFO:tasks.workunit.client.0.smithi084.stdout:op 4199 completed, throughput=5MB/sec 2024-01-13T18:35:12.215 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7eBLaUczSFXb-Yq off=2083643 len=1912 2024-01-13T18:35:12.217 INFO:tasks.workunit.client.0.smithi084.stdout:op 4200 completed, throughput=5MB/sec 2024-01-13T18:35:12.218 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Zht7LzLnweTh_FL off=12116922 len=1585432 2024-01-13T18:35:12.220 INFO:tasks.workunit.client.0.smithi084.stdout:op 4201 completed, throughput=5MB/sec 2024-01-13T18:35:13.221 INFO:tasks.workunit.client.0.smithi084.stdout: 833: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:13.221 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TvC5AIBeH2WnF23 off=2658743 len=619444 2024-01-13T18:35:13.222 INFO:tasks.workunit.client.0.smithi084.stdout:op 4202 completed, throughput=4.99MB/sec 2024-01-13T18:35:13.222 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-X4T-CKRN-h35dGh off=1779839 len=83488 2024-01-13T18:35:13.225 INFO:tasks.workunit.client.0.smithi084.stdout:op 4203 completed, throughput=4.99MB/sec 2024-01-13T18:35:13.225 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7YxOfdj6jyWDv-q off=165587 len=1376842 2024-01-13T18:35:13.232 INFO:tasks.workunit.client.0.smithi084.stdout:op 4204 completed, throughput=5MB/sec 2024-01-13T18:35:13.232 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sU7sl3G4tNWZsdT off=163656 len=1347260 2024-01-13T18:35:13.240 INFO:tasks.workunit.client.0.smithi084.stdout:op 4205 completed, throughput=5MB/sec 2024-01-13T18:35:13.241 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WsujvzyfY3UVAoW off=19155317 len=1919093 2024-01-13T18:35:13.250 INFO:tasks.workunit.client.0.smithi084.stdout:op 4206 completed, throughput=5MB/sec 2024-01-13T18:35:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:13 smithi099 ceph-mon[138788]: pgmap v1902: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:35:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:13 smithi084 ceph-mon[116404]: pgmap v1902: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:35:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:13 smithi084 ceph-mon[119097]: pgmap v1902: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:35:14.251 INFO:tasks.workunit.client.0.smithi084.stdout: 834: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:14.251 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1s4vngE-AszsDy5 off=1368188 len=1752183 2024-01-13T18:35:14.262 INFO:tasks.workunit.client.0.smithi084.stdout:op 4207 completed, throughput=5MB/sec 2024-01-13T18:35:14.262 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CZI8Njx1VdCJ5pZ off=366447 len=774137 2024-01-13T18:35:14.263 INFO:tasks.workunit.client.0.smithi084.stdout:op 4208 completed, throughput=5MB/sec 2024-01-13T18:35:14.263 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hIIB5_8ltsx6oC3 off=4198070 len=2051006 2024-01-13T18:35:14.271 INFO:tasks.workunit.client.0.smithi084.stdout:op 4209 completed, throughput=5MB/sec 2024-01-13T18:35:14.272 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tj0mGtPukvsfOtT off=13924480 len=518048 2024-01-13T18:35:14.272 INFO:tasks.workunit.client.0.smithi084.stdout:op 4210 completed, throughput=5MB/sec 2024-01-13T18:35:14.272 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ncdWUq5KAEpboCT off=7870306 len=1407327 2024-01-13T18:35:14.277 INFO:tasks.workunit.client.0.smithi084.stdout:op 4211 completed, throughput=5MB/sec 2024-01-13T18:35:15.278 INFO:tasks.workunit.client.0.smithi084.stdout: 835: throughput=5MB/sec pending data=0 2024-01-13T18:35:15.278 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gX4NVJ9vmxnw1_h off=807457 len=1431992 2024-01-13T18:35:15.286 INFO:tasks.workunit.client.0.smithi084.stdout:op 4212 completed, throughput=5MB/sec 2024-01-13T18:35:15.286 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_HCGbMxhPaSfKpr off=6710355 len=1408847 2024-01-13T18:35:15.289 INFO:tasks.workunit.client.0.smithi084.stdout:op 4213 completed, throughput=5MB/sec 2024-01-13T18:35:15.289 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-D_WRiB41fQeWTbc off=3380312 len=99832 2024-01-13T18:35:15.291 INFO:tasks.workunit.client.0.smithi084.stdout:op 4214 completed, throughput=5MB/sec 2024-01-13T18:35:15.291 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CN1jvvtGoQMnmjn off=2249193 len=1126546 2024-01-13T18:35:15.292 INFO:tasks.workunit.client.0.smithi084.stdout:op 4215 completed, throughput=5MB/sec 2024-01-13T18:35:15.292 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RdWn3kyYFhnIaK0 off=16745165 len=1059130 2024-01-13T18:35:15.293 INFO:tasks.workunit.client.0.smithi084.stdout:op 4216 completed, throughput=5MB/sec 2024-01-13T18:35:15.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:15 smithi099 ceph-mon[138788]: pgmap v1903: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:35:15.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:15 smithi084 ceph-mon[116404]: pgmap v1903: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:35:15.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:15 smithi084 ceph-mon[119097]: pgmap v1903: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 6 op/s 2024-01-13T18:35:16.294 INFO:tasks.workunit.client.0.smithi084.stdout: 836: throughput=5MB/sec pending data=0 2024-01-13T18:35:16.294 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EvVJrrXdBBhbWYq off=10172284 len=1948285 2024-01-13T18:35:16.296 INFO:tasks.workunit.client.0.smithi084.stdout:op 4217 completed, throughput=5MB/sec 2024-01-13T18:35:16.296 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LCWmkLO4PNZYUFi off=4324404 len=66854 2024-01-13T18:35:16.296 INFO:tasks.workunit.client.0.smithi084.stdout:op 4218 completed, throughput=5MB/sec 2024-01-13T18:35:16.296 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zFHlq9OahIsSAmI off=4307308 len=58523 2024-01-13T18:35:16.297 INFO:tasks.workunit.client.0.smithi084.stdout:op 4219 completed, throughput=5MB/sec 2024-01-13T18:35:16.297 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lT0jtx9VlLGm7cD off=469397 len=1163468 2024-01-13T18:35:16.303 INFO:tasks.workunit.client.0.smithi084.stdout:op 4220 completed, throughput=5MB/sec 2024-01-13T18:35:16.303 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TbBqHKZZBLzhxii off=12933888 len=91431 2024-01-13T18:35:16.303 INFO:tasks.workunit.client.0.smithi084.stdout:op 4221 completed, throughput=5MB/sec 2024-01-13T18:35:16.304 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dD2FTAVeBmtUARs off=14895139 len=1798664 2024-01-13T18:35:16.305 INFO:tasks.workunit.client.0.smithi084.stdout:op 4222 completed, throughput=5MB/sec 2024-01-13T18:35:17.305 INFO:tasks.workunit.client.0.smithi084.stdout: 837: throughput=5MB/sec pending data=0 2024-01-13T18:35:17.305 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8s4em6crES4N4fV off=485734 len=2045576 2024-01-13T18:35:17.308 INFO:tasks.workunit.client.0.smithi084.stdout:op 4223 completed, throughput=5MB/sec 2024-01-13T18:35:17.308 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LKClzwlcaJ4SmRQ off=966040 len=288526 2024-01-13T18:35:17.308 INFO:tasks.workunit.client.0.smithi084.stdout:op 4224 completed, throughput=5MB/sec 2024-01-13T18:35:17.308 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nL8D-UEfxiRcK8G off=1091891 len=1695933 2024-01-13T18:35:17.311 INFO:tasks.workunit.client.0.smithi084.stdout:op 4225 completed, throughput=5MB/sec 2024-01-13T18:35:17.311 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_SK243FSY4BMgqj off=5816760 len=201075 2024-01-13T18:35:17.313 INFO:tasks.workunit.client.0.smithi084.stdout:op 4226 completed, throughput=5MB/sec 2024-01-13T18:35:17.313 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TvUVlLVyKYBjwgB off=6356787 len=16246 2024-01-13T18:35:17.316 INFO:tasks.workunit.client.0.smithi084.stdout:op 4227 completed, throughput=5MB/sec 2024-01-13T18:35:17.316 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Z60E2Uta-UGNNZW off=2710677 len=1265966 2024-01-13T18:35:17.317 INFO:tasks.workunit.client.0.smithi084.stdout:op 4228 completed, throughput=5MB/sec 2024-01-13T18:35:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:17 smithi099 ceph-mon[138788]: pgmap v1904: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:17 smithi084 ceph-mon[116404]: pgmap v1904: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:17 smithi084 ceph-mon[119097]: pgmap v1904: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:18.317 INFO:tasks.workunit.client.0.smithi084.stdout: 838: throughput=5MB/sec pending data=0 2024-01-13T18:35:18.318 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wJhR_cJIQFmQj9Y off=10231879 len=1506463 2024-01-13T18:35:18.326 INFO:tasks.workunit.client.0.smithi084.stdout:op 4229 completed, throughput=5MB/sec 2024-01-13T18:35:18.326 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--F7MZvqyFkiaTOR off=6439678 len=439405 2024-01-13T18:35:18.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 4230 completed, throughput=5MB/sec 2024-01-13T18:35:18.329 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M4THqAvYOTyWP0E off=6187550 len=654395 2024-01-13T18:35:18.331 INFO:tasks.workunit.client.0.smithi084.stdout:op 4231 completed, throughput=5MB/sec 2024-01-13T18:35:18.331 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5egQtwO3_OiS2G8 off=9088189 len=518163 2024-01-13T18:35:18.334 INFO:tasks.workunit.client.0.smithi084.stdout:op 4232 completed, throughput=5MB/sec 2024-01-13T18:35:18.335 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-R7Z8wRZFRTmjLE9 off=13004311 len=1815619 2024-01-13T18:35:18.337 INFO:tasks.workunit.client.0.smithi084.stdout:op 4233 completed, throughput=5MB/sec 2024-01-13T18:35:19.337 INFO:tasks.workunit.client.0.smithi084.stdout: 839: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:19.338 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BCojDgkzVUYn7dN off=17442999 len=1743792 2024-01-13T18:35:19.339 INFO:tasks.workunit.client.0.smithi084.stdout:op 4234 completed, throughput=5MB/sec 2024-01-13T18:35:19.339 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1cO2vhkP0j-0X3B off=4314675 len=648444 2024-01-13T18:35:19.341 INFO:tasks.workunit.client.0.smithi084.stdout:op 4235 completed, throughput=5MB/sec 2024-01-13T18:35:19.341 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Id9DD5OHjQX7ABL off=1379437 len=184346 2024-01-13T18:35:19.343 INFO:tasks.workunit.client.0.smithi084.stdout:op 4236 completed, throughput=5MB/sec 2024-01-13T18:35:19.343 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7e3LQG_qoEyTqP9 off=6858020 len=735265 2024-01-13T18:35:19.345 INFO:tasks.workunit.client.0.smithi084.stdout:op 4237 completed, throughput=5MB/sec 2024-01-13T18:35:19.345 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GrIXAFtc5meZAWG off=10467466 len=404762 2024-01-13T18:35:19.348 INFO:tasks.workunit.client.0.smithi084.stdout:op 4238 completed, throughput=5MB/sec 2024-01-13T18:35:19.348 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Q8I4UXTfYvU1EIB off=4501453 len=517032 2024-01-13T18:35:19.350 INFO:tasks.workunit.client.0.smithi084.stdout:op 4239 completed, throughput=5MB/sec 2024-01-13T18:35:19.350 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xIRHqfInflWrNOj off=12169839 len=376066 2024-01-13T18:35:19.353 INFO:tasks.workunit.client.0.smithi084.stdout:op 4240 completed, throughput=5MB/sec 2024-01-13T18:35:19.353 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zwtTo4EURaDQp3b off=8857335 len=738045 2024-01-13T18:35:19.356 INFO:tasks.workunit.client.0.smithi084.stdout:op 4241 completed, throughput=5MB/sec 2024-01-13T18:35:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:19 smithi099 ceph-mon[138788]: pgmap v1905: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:35:19.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:19 smithi084 ceph-mon[116404]: pgmap v1905: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:35:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:19 smithi084 ceph-mon[119097]: pgmap v1905: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:35:20.356 INFO:tasks.workunit.client.0.smithi084.stdout: 840: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:20.356 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ACU0Slpl0y1OFoS off=5963828 len=497942 2024-01-13T18:35:20.360 INFO:tasks.workunit.client.0.smithi084.stdout:op 4242 completed, throughput=5MB/sec 2024-01-13T18:35:20.360 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zUWE7XIBIR9dWIr off=841564 len=95360 2024-01-13T18:35:20.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 4243 completed, throughput=5MB/sec 2024-01-13T18:35:20.361 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DDKxqK7G_ZiU6XW off=2192573 len=1158092 2024-01-13T18:35:20.364 INFO:tasks.workunit.client.0.smithi084.stdout:op 4244 completed, throughput=5MB/sec 2024-01-13T18:35:20.364 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6JojnWdmENXEyGx off=1217260 len=1062150 2024-01-13T18:35:20.365 INFO:tasks.workunit.client.0.smithi084.stdout:op 4245 completed, throughput=5MB/sec 2024-01-13T18:35:20.365 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yTbl2UQecbQlfM_ off=1657694 len=870247 2024-01-13T18:35:20.366 INFO:tasks.workunit.client.0.smithi084.stdout:op 4246 completed, throughput=5MB/sec 2024-01-13T18:35:20.366 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--GVN8pYfsibUnnD off=12136997 len=1143478 2024-01-13T18:35:20.368 INFO:tasks.workunit.client.0.smithi084.stdout:op 4247 completed, throughput=5MB/sec 2024-01-13T18:35:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:20.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:35:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:35:20] "GET /metrics HTTP/1.1" 200 34001 "" "Prometheus/2.43.0" 2024-01-13T18:35:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:21.368 INFO:tasks.workunit.client.0.smithi084.stdout: 841: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:21.368 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZGuZuFPeoLLlUhA off=20999933 len=242087 2024-01-13T18:35:21.371 INFO:tasks.workunit.client.0.smithi084.stdout:op 4248 completed, throughput=4.99MB/sec 2024-01-13T18:35:21.371 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yTFGXRREjIDKcwE off=1403009 len=1626275 2024-01-13T18:35:21.374 INFO:tasks.workunit.client.0.smithi084.stdout:op 4249 completed, throughput=5MB/sec 2024-01-13T18:35:21.374 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6ZvdIsq6x6DxdGf off=1675785 len=771309 2024-01-13T18:35:21.379 INFO:tasks.workunit.client.0.smithi084.stdout:op 4250 completed, throughput=5MB/sec 2024-01-13T18:35:21.379 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qzc2PCaawTwPeJA off=5230351 len=1028860 2024-01-13T18:35:21.381 INFO:tasks.workunit.client.0.smithi084.stdout:op 4251 completed, throughput=5MB/sec 2024-01-13T18:35:21.381 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w78VUQw2RgyjqvT off=8811106 len=604650 2024-01-13T18:35:21.382 INFO:tasks.workunit.client.0.smithi084.stdout:op 4252 completed, throughput=5MB/sec 2024-01-13T18:35:21.382 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G3d1E4-ryYV5gPy off=11110210 len=1471721 2024-01-13T18:35:21.388 INFO:tasks.workunit.client.0.smithi084.stdout:op 4253 completed, throughput=5MB/sec 2024-01-13T18:35:21.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:21 smithi099 ceph-mon[138788]: pgmap v1906: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:21.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:21 smithi084 ceph-mon[116404]: pgmap v1906: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:21 smithi084 ceph-mon[119097]: pgmap v1906: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:22.389 INFO:tasks.workunit.client.0.smithi084.stdout: 842: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:22.389 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x3IdIuQqwT7A7LB off=7125443 len=1933168 2024-01-13T18:35:22.399 INFO:tasks.workunit.client.0.smithi084.stdout:op 4254 completed, throughput=5MB/sec 2024-01-13T18:35:22.400 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tnDz7vxmtAxoG4D off=16556867 len=1166438 2024-01-13T18:35:22.405 INFO:tasks.workunit.client.0.smithi084.stdout:op 4255 completed, throughput=5MB/sec 2024-01-13T18:35:22.405 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TJi74rU3qbZwi_7 off=3202684 len=1793518 2024-01-13T18:35:22.415 INFO:tasks.workunit.client.0.smithi084.stdout:op 4256 completed, throughput=5MB/sec 2024-01-13T18:35:23.415 INFO:tasks.workunit.client.0.smithi084.stdout: 843: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:23.415 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uJC27sXhLwuWwh8 off=1680007 len=850652 2024-01-13T18:35:23.419 INFO:tasks.workunit.client.0.smithi084.stdout:op 4257 completed, throughput=5MB/sec 2024-01-13T18:35:23.420 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TMCP8w99lrV4-X5 off=735755 len=1908642 2024-01-13T18:35:23.423 INFO:tasks.workunit.client.0.smithi084.stdout:op 4258 completed, throughput=5MB/sec 2024-01-13T18:35:23.423 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sMHcZqf83Ldr_uK off=59619 len=454598 2024-01-13T18:35:23.427 INFO:tasks.workunit.client.0.smithi084.stdout:op 4259 completed, throughput=5MB/sec 2024-01-13T18:35:23.427 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-R6Fj5OA-N2XshUP off=18863021 len=1758001 2024-01-13T18:35:23.429 INFO:tasks.workunit.client.0.smithi084.stdout:op 4260 completed, throughput=5MB/sec 2024-01-13T18:35:23.429 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ij1CRZsR2zo5yKX off=2509081 len=1857132 2024-01-13T18:35:23.431 INFO:tasks.workunit.client.0.smithi084.stdout:op 4261 completed, throughput=5MB/sec 2024-01-13T18:35:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:23 smithi099 ceph-mon[138788]: pgmap v1907: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:35:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:23 smithi084 ceph-mon[116404]: pgmap v1907: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:35:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:23 smithi084 ceph-mon[119097]: pgmap v1907: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:35:24.431 INFO:tasks.workunit.client.0.smithi084.stdout: 844: throughput=5MB/sec pending data=0 2024-01-13T18:35:24.431 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rHbvbCzDv_mDqvM off=1778693 len=277055 2024-01-13T18:35:24.434 INFO:tasks.workunit.client.0.smithi084.stdout:op 4262 completed, throughput=5MB/sec 2024-01-13T18:35:24.434 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-juOSHyhAkVVyorU off=7263752 len=1794695 2024-01-13T18:35:24.437 INFO:tasks.workunit.client.0.smithi084.stdout:op 4263 completed, throughput=5MB/sec 2024-01-13T18:35:24.437 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZgcRIU94-WOXds8 off=16711906 len=574988 2024-01-13T18:35:24.438 INFO:tasks.workunit.client.0.smithi084.stdout:op 4264 completed, throughput=5MB/sec 2024-01-13T18:35:24.438 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-s4J4Kkl_Bw-ohni off=1117107 len=316287 2024-01-13T18:35:24.442 INFO:tasks.workunit.client.0.smithi084.stdout:op 4265 completed, throughput=5MB/sec 2024-01-13T18:35:24.442 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iLWHWxxvoOLQYJ0 off=3428402 len=1319701 2024-01-13T18:35:24.449 INFO:tasks.workunit.client.0.smithi084.stdout:op 4266 completed, throughput=5MB/sec 2024-01-13T18:35:25.449 INFO:tasks.workunit.client.0.smithi084.stdout: 845: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:25.449 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S8bVayjp-1IfECr off=20787454 len=2518 2024-01-13T18:35:25.452 INFO:tasks.workunit.client.0.smithi084.stdout:op 4267 completed, throughput=4.99MB/sec 2024-01-13T18:35:25.452 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-woC2-DZxYPVqghp off=2121377 len=1318347 2024-01-13T18:35:25.458 INFO:tasks.workunit.client.0.smithi084.stdout:op 4268 completed, throughput=5MB/sec 2024-01-13T18:35:25.458 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gak7a2GHHxNXRsf off=4090399 len=1121559 2024-01-13T18:35:25.460 INFO:tasks.workunit.client.0.smithi084.stdout:op 4269 completed, throughput=5MB/sec 2024-01-13T18:35:25.460 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Xw_CcGrPG-GBJMp off=502964 len=1681308 2024-01-13T18:35:25.462 INFO:tasks.workunit.client.0.smithi084.stdout:op 4270 completed, throughput=5MB/sec 2024-01-13T18:35:25.462 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TGtXV34T_20PWR2 off=17096684 len=878440 2024-01-13T18:35:25.464 INFO:tasks.workunit.client.0.smithi084.stdout:op 4271 completed, throughput=5MB/sec 2024-01-13T18:35:25.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:25 smithi099 ceph-mon[138788]: pgmap v1908: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:25.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:25 smithi084 ceph-mon[116404]: pgmap v1908: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:25.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:25 smithi084 ceph-mon[119097]: pgmap v1908: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:26.465 INFO:tasks.workunit.client.0.smithi084.stdout: 846: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:26.465 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-D4HK-xOuw5O30Ig off=11227640 len=66778 2024-01-13T18:35:26.465 INFO:tasks.workunit.client.0.smithi084.stdout:op 4272 completed, throughput=4.99MB/sec 2024-01-13T18:35:26.466 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-M-v1t4bGYmd7VX2 off=11374419 len=572380 2024-01-13T18:35:26.470 INFO:tasks.workunit.client.0.smithi084.stdout:op 4273 completed, throughput=5MB/sec 2024-01-13T18:35:26.470 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-if6fuF4obqiqBct off=19040445 len=1946921 2024-01-13T18:35:26.479 INFO:tasks.workunit.client.0.smithi084.stdout:op 4274 completed, throughput=5MB/sec 2024-01-13T18:35:26.479 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GkdqdXoVNQY6yxP off=837814 len=1961621 2024-01-13T18:35:26.486 INFO:tasks.workunit.client.0.smithi084.stdout:op 4275 completed, throughput=5MB/sec 2024-01-13T18:35:26.486 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2Dy4fQLcjBY1d4B off=17833419 len=1816161 2024-01-13T18:35:26.494 INFO:tasks.workunit.client.0.smithi084.stdout:op 4276 completed, throughput=5MB/sec 2024-01-13T18:35:27.494 INFO:tasks.workunit.client.0.smithi084.stdout: 847: throughput=5MB/sec pending data=0 2024-01-13T18:35:27.495 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LOJHFHekd3qMxd3 off=3470897 len=913589 2024-01-13T18:35:27.500 INFO:tasks.workunit.client.0.smithi084.stdout:op 4277 completed, throughput=5MB/sec 2024-01-13T18:35:27.500 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Napj57wMAgDcTSX off=3614745 len=1267190 2024-01-13T18:35:27.502 INFO:tasks.workunit.client.0.smithi084.stdout:op 4278 completed, throughput=5MB/sec 2024-01-13T18:35:27.502 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-u6pQOQDI2heb7gI off=0 len=1775248 2024-01-13T18:35:27.512 INFO:tasks.workunit.client.0.smithi084.stdout:op 4279 completed, throughput=5MB/sec 2024-01-13T18:35:27.512 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cXdaAUDy60omjGG off=19138009 len=1335771 2024-01-13T18:35:27.513 INFO:tasks.workunit.client.0.smithi084.stdout:op 4280 completed, throughput=5MB/sec 2024-01-13T18:35:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:27 smithi099 ceph-mon[138788]: pgmap v1909: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:27 smithi084 ceph-mon[116404]: pgmap v1909: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:27 smithi084 ceph-mon[119097]: pgmap v1909: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:28.514 INFO:tasks.workunit.client.0.smithi084.stdout: 848: throughput=5MB/sec pending data=0 2024-01-13T18:35:28.514 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JDk-8MDRVra1TFQ off=5203686 len=1641407 2024-01-13T18:35:28.523 INFO:tasks.workunit.client.0.smithi084.stdout:op 4281 completed, throughput=5MB/sec 2024-01-13T18:35:28.523 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-A6p2SMkriN1L-dr off=12580325 len=338638 2024-01-13T18:35:28.524 INFO:tasks.workunit.client.0.smithi084.stdout:op 4282 completed, throughput=5MB/sec 2024-01-13T18:35:28.525 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5R5nlUBJWJrWIY0 off=15138455 len=2075061 2024-01-13T18:35:28.527 INFO:tasks.workunit.client.0.smithi084.stdout:op 4283 completed, throughput=5MB/sec 2024-01-13T18:35:28.527 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dmiiZx3NefMddDm off=1254680 len=1868845 2024-01-13T18:35:28.530 INFO:tasks.workunit.client.0.smithi084.stdout:op 4284 completed, throughput=5MB/sec 2024-01-13T18:35:29.529 INFO:tasks.workunit.client.0.smithi084.stdout: 849: throughput=5MB/sec pending data=0 2024-01-13T18:35:29.529 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BP5Z_GhlUWMUaef off=5638084 len=1567357 2024-01-13T18:35:29.532 INFO:tasks.workunit.client.0.smithi084.stdout:op 4285 completed, throughput=5MB/sec 2024-01-13T18:35:29.532 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yiQS6hwN65YhVdx off=5175791 len=1053062 2024-01-13T18:35:29.538 INFO:tasks.workunit.client.0.smithi084.stdout:op 4286 completed, throughput=5MB/sec 2024-01-13T18:35:29.538 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IuBy0jzx3h3dDTi off=3867350 len=616467 2024-01-13T18:35:29.539 INFO:tasks.workunit.client.0.smithi084.stdout:op 4287 completed, throughput=5MB/sec 2024-01-13T18:35:29.540 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pKWED4GkGAbIVsB off=2912017 len=429527 2024-01-13T18:35:29.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 4288 completed, throughput=5MB/sec 2024-01-13T18:35:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:29 smithi099 ceph-mon[138788]: pgmap v1910: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:35:29.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:29 smithi084 ceph-mon[116404]: pgmap v1910: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:35:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:29 smithi084 ceph-mon[119097]: pgmap v1910: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:35:30.543 INFO:tasks.workunit.client.0.smithi084.stdout: 850: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:30.543 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cQWq2WW6SrN25vk off=3766290 len=1380365 2024-01-13T18:35:30.546 INFO:tasks.workunit.client.0.smithi084.stdout:op 4289 completed, throughput=5MB/sec 2024-01-13T18:35:30.546 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ao_oOFtZUYWAUj4 off=12329257 len=1234897 2024-01-13T18:35:30.552 INFO:tasks.workunit.client.0.smithi084.stdout:op 4290 completed, throughput=5MB/sec 2024-01-13T18:35:30.552 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TRXTG1_J0yF-kc1 off=18234935 len=691262 2024-01-13T18:35:30.555 INFO:tasks.workunit.client.0.smithi084.stdout:op 4291 completed, throughput=5MB/sec 2024-01-13T18:35:30.555 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_GPnRPsrBWg6Bew off=3844421 len=639694 2024-01-13T18:35:30.555 INFO:tasks.workunit.client.0.smithi084.stdout:op 4292 completed, throughput=5MB/sec 2024-01-13T18:35:30.556 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jVkH1Qz3I1aLaAm off=13841615 len=370729 2024-01-13T18:35:30.558 INFO:tasks.workunit.client.0.smithi084.stdout:op 4293 completed, throughput=5MB/sec 2024-01-13T18:35:30.558 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U3XTKj3qcWw8Aqo off=6627798 len=613486 2024-01-13T18:35:30.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 4294 completed, throughput=5MB/sec 2024-01-13T18:35:30.559 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fIn_TWOtrBR4Zd7 off=15094940 len=1637367 2024-01-13T18:35:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:op 4295 completed, throughput=5MB/sec 2024-01-13T18:35:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:35:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:35:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:35:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:35:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:35:30] "GET /metrics HTTP/1.1" 200 34001 "" "Prometheus/2.43.0" 2024-01-13T18:35:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:35:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:35:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:35:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:35:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:35:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:35:31.568 INFO:tasks.workunit.client.0.smithi084.stdout: 851: throughput=5MB/sec pending data=0 2024-01-13T18:35:31.568 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tSc5LpT_f-PknDR off=213917 len=995035 2024-01-13T18:35:31.570 INFO:tasks.workunit.client.0.smithi084.stdout:op 4296 completed, throughput=5MB/sec 2024-01-13T18:35:31.570 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-90CDU3l6FywN5BR off=21140164 len=299355 2024-01-13T18:35:31.574 INFO:tasks.workunit.client.0.smithi084.stdout:op 4297 completed, throughput=5MB/sec 2024-01-13T18:35:31.574 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hNQeNEWtKBTF1IZ off=3637350 len=1610560 2024-01-13T18:35:31.582 INFO:tasks.workunit.client.0.smithi084.stdout:op 4298 completed, throughput=5MB/sec 2024-01-13T18:35:31.582 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TA1Dh0nwG1SY-_G off=10031101 len=1035764 2024-01-13T18:35:31.583 INFO:tasks.workunit.client.0.smithi084.stdout:op 4299 completed, throughput=5MB/sec 2024-01-13T18:35:31.583 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aE_XNUHcimmx2Kd off=11124055 len=1918811 2024-01-13T18:35:31.585 INFO:tasks.workunit.client.0.smithi084.stdout:op 4300 completed, throughput=5MB/sec 2024-01-13T18:35:31.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:35:31.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:31 smithi099 ceph-mon[138788]: pgmap v1911: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:35:31.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:35:31.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:31 smithi084 ceph-mon[116404]: pgmap v1911: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:35:31.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:35:31.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:31 smithi084 ceph-mon[119097]: pgmap v1911: 105 pgs: 105 active+clean; 128 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:35:32.585 INFO:tasks.workunit.client.0.smithi084.stdout: 852: throughput=5MB/sec pending data=0 2024-01-13T18:35:32.585 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sbihg4VNXXFOxIZ off=3140572 len=1152501 2024-01-13T18:35:32.587 INFO:tasks.workunit.client.0.smithi084.stdout:op 4301 completed, throughput=5MB/sec 2024-01-13T18:35:32.587 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--RsSoKC_51nQsAu off=2742767 len=270791 2024-01-13T18:35:32.590 INFO:tasks.workunit.client.0.smithi084.stdout:op 4302 completed, throughput=5MB/sec 2024-01-13T18:35:32.590 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Gj4Bi5VPajZDt0T off=2486964 len=1793055 2024-01-13T18:35:32.598 INFO:tasks.workunit.client.0.smithi084.stdout:op 4303 completed, throughput=5MB/sec 2024-01-13T18:35:32.598 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sMHcZqf83Ldr_uK off=893922 len=133982 2024-01-13T18:35:32.601 INFO:tasks.workunit.client.0.smithi084.stdout:op 4304 completed, throughput=5MB/sec 2024-01-13T18:35:32.601 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LEMiOq2bXT_AR3Z off=14660607 len=65621 2024-01-13T18:35:32.601 INFO:tasks.workunit.client.0.smithi084.stdout:op 4305 completed, throughput=5MB/sec 2024-01-13T18:35:32.601 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nlK9BDZNJvDsOMB off=11248455 len=522654 2024-01-13T18:35:32.602 INFO:tasks.workunit.client.0.smithi084.stdout:op 4306 completed, throughput=5MB/sec 2024-01-13T18:35:33.602 INFO:tasks.workunit.client.0.smithi084.stdout: 853: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:33.603 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KV2e7yml3lr_Wb8 off=1938397 len=2076617 2024-01-13T18:35:33.605 INFO:tasks.workunit.client.0.smithi084.stdout:op 4307 completed, throughput=5MB/sec 2024-01-13T18:35:33.605 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-g1-kcf_lY-JiDnA off=765416 len=826194 2024-01-13T18:35:33.609 INFO:tasks.workunit.client.0.smithi084.stdout:op 4308 completed, throughput=5MB/sec 2024-01-13T18:35:33.610 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MqaRA3hbvAlpk-6 off=10404443 len=1129452 2024-01-13T18:35:33.611 INFO:tasks.workunit.client.0.smithi084.stdout:op 4309 completed, throughput=5MB/sec 2024-01-13T18:35:33.611 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qznSxpXNu36AoJb off=8755117 len=857482 2024-01-13T18:35:33.616 INFO:tasks.workunit.client.0.smithi084.stdout:op 4310 completed, throughput=5MB/sec 2024-01-13T18:35:33.616 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9lnlxSHaX-b9eze off=1641175 len=2062903 2024-01-13T18:35:33.626 INFO:tasks.workunit.client.0.smithi084.stdout:op 4311 completed, throughput=5MB/sec 2024-01-13T18:35:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:33 smithi099 ceph-mon[138788]: pgmap v1912: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:33 smithi084 ceph-mon[116404]: pgmap v1912: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:33 smithi084 ceph-mon[119097]: pgmap v1912: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:34.626 INFO:tasks.workunit.client.0.smithi084.stdout: 854: throughput=5MB/sec pending data=0 2024-01-13T18:35:34.658 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FBg52_gg-fGYzOd off=10198887 len=1364789 2024-01-13T18:35:34.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 4312 completed, throughput=5MB/sec 2024-01-13T18:35:34.659 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LzEl1L2NqzPBLE1 off=4115069 len=1666369 2024-01-13T18:35:34.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 4313 completed, throughput=5MB/sec 2024-01-13T18:35:34.659 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZfI5hxr9O6OIers off=3064353 len=1628941 2024-01-13T18:35:34.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 4314 completed, throughput=5MB/sec 2024-01-13T18:35:35.641 INFO:tasks.workunit.client.0.smithi084.stdout: 855: throughput=5MB/sec pending data=0 2024-01-13T18:35:35.642 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--PKnwfZ3uJ9bOtH off=8030610 len=1092035 2024-01-13T18:35:35.647 INFO:tasks.workunit.client.0.smithi084.stdout:op 4315 completed, throughput=5MB/sec 2024-01-13T18:35:35.647 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WJI8fPyygiFBQv- off=4125834 len=572450 2024-01-13T18:35:35.648 INFO:tasks.workunit.client.0.smithi084.stdout:op 4316 completed, throughput=5MB/sec 2024-01-13T18:35:35.648 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1_UiDSd5VAroe8A off=13878332 len=1045995 2024-01-13T18:35:35.653 INFO:tasks.workunit.client.0.smithi084.stdout:op 4317 completed, throughput=5MB/sec 2024-01-13T18:35:35.653 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xcjdjA_hI8_pCTy off=2931367 len=897480 2024-01-13T18:35:35.657 INFO:tasks.workunit.client.0.smithi084.stdout:op 4318 completed, throughput=5MB/sec 2024-01-13T18:35:35.657 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ld-2zI0K0uCb3ly off=9622861 len=1414373 2024-01-13T18:35:35.666 INFO:tasks.workunit.client.0.smithi084.stdout:op 4319 completed, throughput=5MB/sec 2024-01-13T18:35:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:35 smithi099 ceph-mon[138788]: pgmap v1913: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:35 smithi084 ceph-mon[116404]: pgmap v1913: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:35 smithi084 ceph-mon[119097]: pgmap v1913: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:35:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:36.666 INFO:tasks.workunit.client.0.smithi084.stdout: 856: throughput=5MB/sec pending data=0 2024-01-13T18:35:36.666 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yLSIP9dGtB4MYz6 off=287784 len=190707 2024-01-13T18:35:36.666 INFO:tasks.workunit.client.0.smithi084.stdout:op 4320 completed, throughput=5MB/sec 2024-01-13T18:35:36.667 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Bbe8kSfAzm2oUuX off=2999180 len=1930773 2024-01-13T18:35:36.678 INFO:tasks.workunit.client.0.smithi084.stdout:op 4321 completed, throughput=5MB/sec 2024-01-13T18:35:36.679 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mlI-oI2Z6Dv16TJ off=2989119 len=1033088 2024-01-13T18:35:36.684 INFO:tasks.workunit.client.0.smithi084.stdout:op 4322 completed, throughput=5MB/sec 2024-01-13T18:35:36.684 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BPlU56xfLUtjefs off=1717407 len=699328 2024-01-13T18:35:36.687 INFO:tasks.workunit.client.0.smithi084.stdout:op 4323 completed, throughput=5MB/sec 2024-01-13T18:35:36.687 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EPa9Sd3So0ts9_x off=6845397 len=51381 2024-01-13T18:35:36.687 INFO:tasks.workunit.client.0.smithi084.stdout:op 4324 completed, throughput=5MB/sec 2024-01-13T18:35:36.687 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xaPOcvtq63ovfoU off=2091939 len=1757916 2024-01-13T18:35:36.695 INFO:tasks.workunit.client.0.smithi084.stdout:op 4325 completed, throughput=5MB/sec 2024-01-13T18:35:37.695 INFO:tasks.workunit.client.0.smithi084.stdout: 857: throughput=5MB/sec pending data=0 2024-01-13T18:35:37.696 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8FcVI2ryZWnoK26 off=8366253 len=218205 2024-01-13T18:35:37.696 INFO:tasks.workunit.client.0.smithi084.stdout:op 4326 completed, throughput=5MB/sec 2024-01-13T18:35:37.696 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fnZtl4q3IrhxLZL off=4250022 len=1469908 2024-01-13T18:35:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:op 4327 completed, throughput=5MB/sec 2024-01-13T18:35:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iYSjMQ8Bc5PBeDd off=39438 len=419409 2024-01-13T18:35:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:op 4328 completed, throughput=5MB/sec 2024-01-13T18:35:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TFP2LM6cDSgzpBY off=76756 len=285520 2024-01-13T18:35:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:op 4329 completed, throughput=5MB/sec 2024-01-13T18:35:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KDooV_I5GfWqaT- off=5016135 len=511649 2024-01-13T18:35:37.712 INFO:tasks.workunit.client.0.smithi084.stdout:op 4330 completed, throughput=5MB/sec 2024-01-13T18:35:37.713 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-urDLQlvbJ96xlmg off=3064290 len=1716507 2024-01-13T18:35:37.714 INFO:tasks.workunit.client.0.smithi084.stdout:op 4331 completed, throughput=5MB/sec 2024-01-13T18:35:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:37 smithi099 ceph-mon[138788]: pgmap v1914: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:37 smithi084 ceph-mon[116404]: pgmap v1914: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:37 smithi084 ceph-mon[119097]: pgmap v1914: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:38.716 INFO:tasks.workunit.client.0.smithi084.stdout: 858: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:38.716 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pbNkDMlvKY5OpoZ off=20388437 len=1877171 2024-01-13T18:35:38.718 INFO:tasks.workunit.client.0.smithi084.stdout:op 4332 completed, throughput=5MB/sec 2024-01-13T18:35:38.718 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kLXCdnCepc_yK3Q off=2830080 len=590743 2024-01-13T18:35:38.719 INFO:tasks.workunit.client.0.smithi084.stdout:op 4333 completed, throughput=5MB/sec 2024-01-13T18:35:38.719 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VY7x7HZZJtjtoIh off=2222917 len=757614 2024-01-13T18:35:38.724 INFO:tasks.workunit.client.0.smithi084.stdout:op 4334 completed, throughput=5MB/sec 2024-01-13T18:35:38.724 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-K1W8MJFBvMe6f1b off=753122 len=1366683 2024-01-13T18:35:38.734 INFO:tasks.workunit.client.0.smithi084.stdout:op 4335 completed, throughput=5MB/sec 2024-01-13T18:35:38.734 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S7TApQHU30x_l7y off=21853524 len=675061 2024-01-13T18:35:38.737 INFO:tasks.workunit.client.0.smithi084.stdout:op 4336 completed, throughput=5MB/sec 2024-01-13T18:35:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:39 smithi099 ceph-mon[138788]: pgmap v1915: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:35:39.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:39 smithi084 ceph-mon[116404]: pgmap v1915: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:35:39.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:39 smithi084 ceph-mon[119097]: pgmap v1915: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:35:39.738 INFO:tasks.workunit.client.0.smithi084.stdout: 859: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:39.738 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cQlPOQOxyCt27J4 off=2087141 len=884040 2024-01-13T18:35:39.743 INFO:tasks.workunit.client.0.smithi084.stdout:op 4337 completed, throughput=5MB/sec 2024-01-13T18:35:39.743 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pjTQKoHAku5LaKl off=6475430 len=1355584 2024-01-13T18:35:39.745 INFO:tasks.workunit.client.0.smithi084.stdout:op 4338 completed, throughput=5MB/sec 2024-01-13T18:35:39.745 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cGbPvAthg-XcSqq off=11779540 len=122420 2024-01-13T18:35:39.746 INFO:tasks.workunit.client.0.smithi084.stdout:op 4339 completed, throughput=5MB/sec 2024-01-13T18:35:39.746 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TRrfgAe9TIutedF off=12230658 len=1554326 2024-01-13T18:35:39.748 INFO:tasks.workunit.client.0.smithi084.stdout:op 4340 completed, throughput=5MB/sec 2024-01-13T18:35:39.748 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gYMfIHTRAS0snx1 off=11767436 len=806536 2024-01-13T18:35:39.749 INFO:tasks.workunit.client.0.smithi084.stdout:op 4341 completed, throughput=5MB/sec 2024-01-13T18:35:39.749 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WaGdwLiZ3jo6Rtp off=1007815 len=1239750 2024-01-13T18:35:39.756 INFO:tasks.workunit.client.0.smithi084.stdout:op 4342 completed, throughput=5MB/sec 2024-01-13T18:35:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:35:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:35:40] "GET /metrics HTTP/1.1" 200 33999 "" "Prometheus/2.43.0" 2024-01-13T18:35:40.756 INFO:tasks.workunit.client.0.smithi084.stdout: 860: throughput=5MB/sec pending data=0 2024-01-13T18:35:40.756 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gia-OVIHhLfD9K7 off=1509910 len=2024457 2024-01-13T18:35:40.766 INFO:tasks.workunit.client.0.smithi084.stdout:op 4343 completed, throughput=5MB/sec 2024-01-13T18:35:40.766 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IqZv8iOJ3mnPY4d off=707337 len=1337916 2024-01-13T18:35:40.767 INFO:tasks.workunit.client.0.smithi084.stdout:op 4344 completed, throughput=5MB/sec 2024-01-13T18:35:40.767 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TAo6pJrOzjDBRcs off=7633965 len=453442 2024-01-13T18:35:40.771 INFO:tasks.workunit.client.0.smithi084.stdout:op 4345 completed, throughput=5MB/sec 2024-01-13T18:35:40.771 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DVtl-fGTlnLCHx7 off=946202 len=1197779 2024-01-13T18:35:40.775 INFO:tasks.workunit.client.0.smithi084.stdout:op 4346 completed, throughput=5MB/sec 2024-01-13T18:35:41.776 INFO:tasks.workunit.client.0.smithi084.stdout: 861: throughput=5MB/sec pending data=0 2024-01-13T18:35:41.776 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GfqUNhNc9i7B_ce off=2381979 len=1909782 2024-01-13T18:35:41.779 INFO:tasks.workunit.client.0.smithi084.stdout:op 4347 completed, throughput=5MB/sec 2024-01-13T18:35:41.779 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yI9hnfs-kxh8_af off=14306880 len=1113524 2024-01-13T18:35:41.781 INFO:tasks.workunit.client.0.smithi084.stdout:op 4348 completed, throughput=5MB/sec 2024-01-13T18:35:41.781 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sa4iDA44umY8H4I off=1759340 len=435761 2024-01-13T18:35:41.781 INFO:tasks.workunit.client.0.smithi084.stdout:op 4349 completed, throughput=5MB/sec 2024-01-13T18:35:41.782 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DKi7SmE9KD6nXVq off=2777758 len=1150603 2024-01-13T18:35:41.787 INFO:tasks.workunit.client.0.smithi084.stdout:op 4350 completed, throughput=5MB/sec 2024-01-13T18:35:41.787 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--5veXsF_qQ4ojMF off=946737 len=1244449 2024-01-13T18:35:41.793 INFO:tasks.workunit.client.0.smithi084.stdout:op 4351 completed, throughput=5MB/sec 2024-01-13T18:35:41.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:41 smithi099 ceph-mon[138788]: pgmap v1916: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:35:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:41 smithi084 ceph-mon[116404]: pgmap v1916: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:35:41.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:41 smithi084 ceph-mon[119097]: pgmap v1916: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:35:42.793 INFO:tasks.workunit.client.0.smithi084.stdout: 862: throughput=5MB/sec pending data=0 2024-01-13T18:35:42.793 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4N5SRFwfnwz4Rlk off=5323748 len=16903 2024-01-13T18:35:42.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 4352 completed, throughput=5MB/sec 2024-01-13T18:35:42.795 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8YIjzSHGdtu5ROh off=1505108 len=955091 2024-01-13T18:35:42.797 INFO:tasks.workunit.client.0.smithi084.stdout:op 4353 completed, throughput=5MB/sec 2024-01-13T18:35:42.798 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DBI6nsIxzsZK5sk off=909356 len=301191 2024-01-13T18:35:42.800 INFO:tasks.workunit.client.0.smithi084.stdout:op 4354 completed, throughput=5MB/sec 2024-01-13T18:35:42.800 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-v1UBSxny0b_0cbc off=466818 len=2068868 2024-01-13T18:35:42.802 INFO:tasks.workunit.client.0.smithi084.stdout:op 4355 completed, throughput=5MB/sec 2024-01-13T18:35:42.803 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hsgdv7Lt4222uBu off=4568275 len=1192451 2024-01-13T18:35:42.808 INFO:tasks.workunit.client.0.smithi084.stdout:op 4356 completed, throughput=5MB/sec 2024-01-13T18:35:43.808 INFO:tasks.workunit.client.0.smithi084.stdout: 863: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:43.809 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5aD0CHImkMnDZ_A off=9668812 len=2087151 2024-01-13T18:35:43.819 INFO:tasks.workunit.client.0.smithi084.stdout:op 4357 completed, throughput=5MB/sec 2024-01-13T18:35:43.819 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vXwMUWb7oTRx5Vf off=0 len=1822369 2024-01-13T18:35:43.822 INFO:tasks.workunit.client.0.smithi084.stdout:op 4358 completed, throughput=5MB/sec 2024-01-13T18:35:43.822 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-l8al-THPGLKZIPV off=11208034 len=1885001 2024-01-13T18:35:43.826 INFO:tasks.workunit.client.0.smithi084.stdout:op 4359 completed, throughput=5MB/sec 2024-01-13T18:35:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:43 smithi099 ceph-mon[138788]: pgmap v1917: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:35:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:43 smithi084 ceph-mon[116404]: pgmap v1917: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:35:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:43 smithi084 ceph-mon[119097]: pgmap v1917: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:35:44.826 INFO:tasks.workunit.client.0.smithi084.stdout: 864: throughput=5MB/sec pending data=0 2024-01-13T18:35:44.827 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1OcY-h_JYOpnfz6 off=4723421 len=1340683 2024-01-13T18:35:44.829 INFO:tasks.workunit.client.0.smithi084.stdout:op 4360 completed, throughput=5MB/sec 2024-01-13T18:35:44.830 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ONpZlhdSvPXQYSK off=202228 len=1843885 2024-01-13T18:35:44.833 INFO:tasks.workunit.client.0.smithi084.stdout:op 4361 completed, throughput=5MB/sec 2024-01-13T18:35:44.833 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LuUDexoxBtr_xBO off=3209357 len=1928469 2024-01-13T18:35:44.844 INFO:tasks.workunit.client.0.smithi084.stdout:op 4362 completed, throughput=5MB/sec 2024-01-13T18:35:45.844 INFO:tasks.workunit.client.0.smithi084.stdout: 865: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:45.845 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-231wOfKL7mvAsJK off=5695711 len=826622 2024-01-13T18:35:45.846 INFO:tasks.workunit.client.0.smithi084.stdout:op 4363 completed, throughput=5MB/sec 2024-01-13T18:35:45.846 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uiGG0P3BPKufOT3 off=7110594 len=1675092 2024-01-13T18:35:45.853 INFO:tasks.workunit.client.0.smithi084.stdout:op 4364 completed, throughput=5MB/sec 2024-01-13T18:35:45.853 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Napj57wMAgDcTSX off=8792762 len=910629 2024-01-13T18:35:45.854 INFO:tasks.workunit.client.0.smithi084.stdout:op 4365 completed, throughput=5MB/sec 2024-01-13T18:35:45.855 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9DO4JCpSpNSjVRt off=4246157 len=714077 2024-01-13T18:35:45.859 INFO:tasks.workunit.client.0.smithi084.stdout:op 4366 completed, throughput=5MB/sec 2024-01-13T18:35:45.859 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NK8Qe-xDkGAnYaJ off=1585569 len=716152 2024-01-13T18:35:45.861 INFO:tasks.workunit.client.0.smithi084.stdout:op 4367 completed, throughput=5MB/sec 2024-01-13T18:35:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:45 smithi099 ceph-mon[138788]: pgmap v1918: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:35:45.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:45 smithi084 ceph-mon[119097]: pgmap v1918: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:35:45.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:45 smithi084 ceph-mon[116404]: pgmap v1918: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:35:46.861 INFO:tasks.workunit.client.0.smithi084.stdout: 866: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:46.861 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lU6elT-jH2HWQ-9 off=15905977 len=1733661 2024-01-13T18:35:46.863 INFO:tasks.workunit.client.0.smithi084.stdout:op 4368 completed, throughput=5MB/sec 2024-01-13T18:35:46.863 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PtvHxBlfvgisYP4 off=977711 len=1850751 2024-01-13T18:35:46.865 INFO:tasks.workunit.client.0.smithi084.stdout:op 4369 completed, throughput=5MB/sec 2024-01-13T18:35:46.865 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gmUSXQ7LH_Iy0es off=7484174 len=2012367 2024-01-13T18:35:46.874 INFO:tasks.workunit.client.0.smithi084.stdout:op 4370 completed, throughput=5MB/sec 2024-01-13T18:35:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:46 smithi084 ceph-mon[116404]: pgmap v1919: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:35:46.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:46 smithi084 ceph-mon[119097]: pgmap v1919: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:35:47.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:46 smithi099 ceph-mon[138788]: pgmap v1919: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:35:47.874 INFO:tasks.workunit.client.0.smithi084.stdout: 867: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:47.874 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xLvmzM7pDB7yxVY off=5964540 len=91659 2024-01-13T18:35:47.875 INFO:tasks.workunit.client.0.smithi084.stdout:op 4371 completed, throughput=4.99MB/sec 2024-01-13T18:35:47.875 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RRBxrNVS8fZQ15Y off=10638011 len=132475 2024-01-13T18:35:47.877 INFO:tasks.workunit.client.0.smithi084.stdout:op 4372 completed, throughput=5MB/sec 2024-01-13T18:35:47.877 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wf_xZ-QqmRArQQw off=16889043 len=796213 2024-01-13T18:35:47.883 INFO:tasks.workunit.client.0.smithi084.stdout:op 4373 completed, throughput=5MB/sec 2024-01-13T18:35:47.883 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6W78ptzj-IVWhLc off=5065064 len=2058230 2024-01-13T18:35:47.892 INFO:tasks.workunit.client.0.smithi084.stdout:op 4374 completed, throughput=5MB/sec 2024-01-13T18:35:47.892 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sKhEPx_b7aex710 off=5432215 len=905117 2024-01-13T18:35:47.893 INFO:tasks.workunit.client.0.smithi084.stdout:op 4375 completed, throughput=5MB/sec 2024-01-13T18:35:47.893 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-c_lQuHv7epb8v7s off=3280513 len=1156671 2024-01-13T18:35:47.895 INFO:tasks.workunit.client.0.smithi084.stdout:op 4376 completed, throughput=5MB/sec 2024-01-13T18:35:48.895 INFO:tasks.workunit.client.0.smithi084.stdout: 868: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:48.895 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fapN0b6kprqMlFR off=8139929 len=436439 2024-01-13T18:35:48.899 INFO:tasks.workunit.client.0.smithi084.stdout:op 4377 completed, throughput=5MB/sec 2024-01-13T18:35:48.899 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lKLC4qhJu44PPTG off=3643369 len=147926 2024-01-13T18:35:48.902 INFO:tasks.workunit.client.0.smithi084.stdout:op 4378 completed, throughput=5MB/sec 2024-01-13T18:35:48.902 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WN3Ms0VCJNZ3Wwv off=9259552 len=2069849 2024-01-13T18:35:48.904 INFO:tasks.workunit.client.0.smithi084.stdout:op 4379 completed, throughput=5MB/sec 2024-01-13T18:35:48.904 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-I9bCwyxPZ0ubR9b off=652921 len=1536304 2024-01-13T18:35:48.906 INFO:tasks.workunit.client.0.smithi084.stdout:op 4380 completed, throughput=5MB/sec 2024-01-13T18:35:48.906 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uDqBHNeZK-zOijV off=3105583 len=1471929 2024-01-13T18:35:48.912 INFO:tasks.workunit.client.0.smithi084.stdout:op 4381 completed, throughput=5MB/sec 2024-01-13T18:35:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:49 smithi099 ceph-mon[138788]: pgmap v1920: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:35:49.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:49 smithi084 ceph-mon[116404]: pgmap v1920: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:35:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:49 smithi084 ceph-mon[119097]: pgmap v1920: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:35:49.912 INFO:tasks.workunit.client.0.smithi084.stdout: 869: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:49.912 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Pw9M3uETC4tZ7Gp off=38467 len=485913 2024-01-13T18:35:49.913 INFO:tasks.workunit.client.0.smithi084.stdout:op 4382 completed, throughput=5MB/sec 2024-01-13T18:35:49.913 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ssivs4-lfJVaIN8 off=5217933 len=1514791 2024-01-13T18:35:49.915 INFO:tasks.workunit.client.0.smithi084.stdout:op 4383 completed, throughput=5MB/sec 2024-01-13T18:35:49.915 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JCRXDtFh2ULNNfN off=2387478 len=263962 2024-01-13T18:35:49.920 INFO:tasks.workunit.client.0.smithi084.stdout:op 4384 completed, throughput=5MB/sec 2024-01-13T18:35:49.920 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yT2Bncyiuxrub9Q off=0 len=1724175 2024-01-13T18:35:49.921 INFO:tasks.workunit.client.0.smithi084.stdout:op 4385 completed, throughput=5MB/sec 2024-01-13T18:35:49.921 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PRCZZ0-yD2ZXal2 off=244181 len=490663 2024-01-13T18:35:49.921 INFO:tasks.workunit.client.0.smithi084.stdout:op 4386 completed, throughput=5MB/sec 2024-01-13T18:35:49.921 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gRt6juUWZCXrXjD off=15796587 len=888289 2024-01-13T18:35:49.921 INFO:tasks.workunit.client.0.smithi084.stdout:op 4387 completed, throughput=5MB/sec 2024-01-13T18:35:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:35:50.678 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:35:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:35:50] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:35:50.920 INFO:tasks.workunit.client.0.smithi084.stdout: 870: throughput=5MB/sec pending data=0 2024-01-13T18:35:50.921 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oBtmcWJGqU7E1zo off=5622221 len=766706 2024-01-13T18:35:50.922 INFO:tasks.workunit.client.0.smithi084.stdout:op 4388 completed, throughput=5MB/sec 2024-01-13T18:35:50.922 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tBbbNJWMLKbbxzC off=6841246 len=1851280 2024-01-13T18:35:50.925 INFO:tasks.workunit.client.0.smithi084.stdout:op 4389 completed, throughput=5MB/sec 2024-01-13T18:35:50.925 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Lb6hRHl2LrJwrBi off=16575856 len=847879 2024-01-13T18:35:50.926 INFO:tasks.workunit.client.0.smithi084.stdout:op 4390 completed, throughput=5MB/sec 2024-01-13T18:35:50.927 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wMJN5eiqmOkyDFc off=10896989 len=1916246 2024-01-13T18:35:50.928 INFO:tasks.workunit.client.0.smithi084.stdout:op 4391 completed, throughput=5MB/sec 2024-01-13T18:35:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:51 smithi099 ceph-mon[138788]: pgmap v1921: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:35:51.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:51 smithi084 ceph-mon[116404]: pgmap v1921: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:35:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:51 smithi084 ceph-mon[119097]: pgmap v1921: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:35:51.929 INFO:tasks.workunit.client.0.smithi084.stdout: 871: throughput=5MB/sec pending data=0 2024-01-13T18:35:51.929 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bMd-ElZMBSYXm1y off=288039 len=1892667 2024-01-13T18:35:51.931 INFO:tasks.workunit.client.0.smithi084.stdout:op 4392 completed, throughput=5MB/sec 2024-01-13T18:35:51.931 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-I5PdpmtFgaI7bph off=1701058 len=653774 2024-01-13T18:35:51.936 INFO:tasks.workunit.client.0.smithi084.stdout:op 4393 completed, throughput=5MB/sec 2024-01-13T18:35:51.936 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FzTdYblq6UROkSy off=3123463 len=369533 2024-01-13T18:35:51.937 INFO:tasks.workunit.client.0.smithi084.stdout:op 4394 completed, throughput=5MB/sec 2024-01-13T18:35:51.937 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EwrjmMewCjlfUkJ off=4484137 len=1736803 2024-01-13T18:35:51.945 INFO:tasks.workunit.client.0.smithi084.stdout:op 4395 completed, throughput=5MB/sec 2024-01-13T18:35:52.946 INFO:tasks.workunit.client.0.smithi084.stdout: 872: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:52.946 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-x74oUtw26HAg7Td off=1467388 len=1556776 2024-01-13T18:35:52.949 INFO:tasks.workunit.client.0.smithi084.stdout:op 4396 completed, throughput=5MB/sec 2024-01-13T18:35:52.949 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eqLL05abR9zoBu5 off=14431224 len=501457 2024-01-13T18:35:52.950 INFO:tasks.workunit.client.0.smithi084.stdout:op 4397 completed, throughput=5MB/sec 2024-01-13T18:35:52.950 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lpGmZF-ee7U4fAs off=8861159 len=1816975 2024-01-13T18:35:52.953 INFO:tasks.workunit.client.0.smithi084.stdout:op 4398 completed, throughput=5MB/sec 2024-01-13T18:35:52.953 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-i6w7RNkJTZh0WtO off=4846117 len=1441868 2024-01-13T18:35:52.955 INFO:tasks.workunit.client.0.smithi084.stdout:op 4399 completed, throughput=5MB/sec 2024-01-13T18:35:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:53 smithi099 ceph-mon[138788]: pgmap v1922: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:53 smithi084 ceph-mon[116404]: pgmap v1922: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:53 smithi084 ceph-mon[119097]: pgmap v1922: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:35:53.955 INFO:tasks.workunit.client.0.smithi084.stdout: 873: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:53.955 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HUrB7KSnCOZCU5- off=2742859 len=466767 2024-01-13T18:35:53.956 INFO:tasks.workunit.client.0.smithi084.stdout:op 4400 completed, throughput=4.99MB/sec 2024-01-13T18:35:53.956 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g_TNfKhwmdFrVz0 off=1554728 len=627007 2024-01-13T18:35:53.957 INFO:tasks.workunit.client.0.smithi084.stdout:op 4401 completed, throughput=5MB/sec 2024-01-13T18:35:53.957 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ma5rzXclaDqoKuM off=116285 len=574638 2024-01-13T18:35:53.964 INFO:tasks.workunit.client.0.smithi084.stdout:op 4402 completed, throughput=5MB/sec 2024-01-13T18:35:53.964 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4jfAYQPRmGh7W8G off=12742418 len=1497190 2024-01-13T18:35:53.965 INFO:tasks.workunit.client.0.smithi084.stdout:op 4403 completed, throughput=5MB/sec 2024-01-13T18:35:53.965 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6qbPk-dEjT0KkKD off=6337082 len=412096 2024-01-13T18:35:53.966 INFO:tasks.workunit.client.0.smithi084.stdout:op 4404 completed, throughput=5MB/sec 2024-01-13T18:35:53.966 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ICtYyk4t8TaErIs off=2239539 len=1674740 2024-01-13T18:35:53.968 INFO:tasks.workunit.client.0.smithi084.stdout:op 4405 completed, throughput=5MB/sec 2024-01-13T18:35:53.968 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cOiKJglV5gd99vW off=5755341 len=1749100 2024-01-13T18:35:53.970 INFO:tasks.workunit.client.0.smithi084.stdout:op 4406 completed, throughput=5MB/sec 2024-01-13T18:35:54.970 INFO:tasks.workunit.client.0.smithi084.stdout: 874: throughput=5MB/sec pending data=0 2024-01-13T18:35:54.971 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_N6tqwv_GVPvQ_- off=7359063 len=244273 2024-01-13T18:35:54.974 INFO:tasks.workunit.client.0.smithi084.stdout:op 4407 completed, throughput=5MB/sec 2024-01-13T18:35:54.974 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dHiKZMvSnkbwAJy off=7110706 len=1765691 2024-01-13T18:35:54.988 INFO:tasks.workunit.client.0.smithi084.stdout:op 4408 completed, throughput=5MB/sec 2024-01-13T18:35:54.988 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3tputRuj88qOCUs off=2992503 len=2040451 2024-01-13T18:35:54.991 INFO:tasks.workunit.client.0.smithi084.stdout:op 4409 completed, throughput=5MB/sec 2024-01-13T18:35:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:55 smithi099 ceph-mon[138788]: pgmap v1923: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:35:55.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:55 smithi084 ceph-mon[116404]: pgmap v1923: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:35:55.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:55 smithi084 ceph-mon[119097]: pgmap v1923: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:35:55.992 INFO:tasks.workunit.client.0.smithi084.stdout: 875: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:55.992 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Yhhivb__N8aG-0i off=6008106 len=40870 2024-01-13T18:35:55.994 INFO:tasks.workunit.client.0.smithi084.stdout:op 4410 completed, throughput=4.99MB/sec 2024-01-13T18:35:55.994 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-O0CjTDHvy2zyIPR off=1395445 len=916455 2024-01-13T18:35:55.999 INFO:tasks.workunit.client.0.smithi084.stdout:op 4411 completed, throughput=5MB/sec 2024-01-13T18:35:55.999 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8O9sypxuucxVlQ- off=5209691 len=854310 2024-01-13T18:35:56.000 INFO:tasks.workunit.client.0.smithi084.stdout:op 4412 completed, throughput=5MB/sec 2024-01-13T18:35:56.000 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k3qUvGfGGOrpZqz off=510235 len=544448 2024-01-13T18:35:56.004 INFO:tasks.workunit.client.0.smithi084.stdout:op 4413 completed, throughput=5MB/sec 2024-01-13T18:35:56.004 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BgW0sBmY3-XMeWC off=6327107 len=561310 2024-01-13T18:35:56.008 INFO:tasks.workunit.client.0.smithi084.stdout:op 4414 completed, throughput=5MB/sec 2024-01-13T18:35:56.008 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xPl2aveN9uFquI6 off=1499600 len=1964705 2024-01-13T18:35:56.017 INFO:tasks.workunit.client.0.smithi084.stdout:op 4415 completed, throughput=5MB/sec 2024-01-13T18:35:56.017 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oJtB1VTUqxoirnc off=7677721 len=908501 2024-01-13T18:35:56.018 INFO:tasks.workunit.client.0.smithi084.stdout:op 4416 completed, throughput=5MB/sec 2024-01-13T18:35:57.018 INFO:tasks.workunit.client.0.smithi084.stdout: 876: throughput=5MB/sec pending data=0 2024-01-13T18:35:57.018 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nJyHZxkoj2rgkmq off=1429687 len=647197 2024-01-13T18:35:57.022 INFO:tasks.workunit.client.0.smithi084.stdout:op 4417 completed, throughput=5MB/sec 2024-01-13T18:35:57.022 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-f3jlsF8bXkY1vAG off=4825904 len=1003026 2024-01-13T18:35:57.028 INFO:tasks.workunit.client.0.smithi084.stdout:op 4418 completed, throughput=5MB/sec 2024-01-13T18:35:57.028 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rfp-96Gf2fEU9Z1 off=4768270 len=1017245 2024-01-13T18:35:57.032 INFO:tasks.workunit.client.0.smithi084.stdout:op 4419 completed, throughput=5MB/sec 2024-01-13T18:35:57.032 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OBTbaYa58-Pc25L off=10189488 len=2088008 2024-01-13T18:35:57.035 INFO:tasks.workunit.client.0.smithi084.stdout:op 4420 completed, throughput=5MB/sec 2024-01-13T18:35:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:57 smithi099 ceph-mon[138788]: pgmap v1924: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:35:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:57 smithi084 ceph-mon[116404]: pgmap v1924: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:35:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:57 smithi084 ceph-mon[119097]: pgmap v1924: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:35:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: 877: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:58.035 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ffAX7aghtFRR5Oc off=8507564 len=178135 2024-01-13T18:35:58.039 INFO:tasks.workunit.client.0.smithi084.stdout:op 4421 completed, throughput=4.99MB/sec 2024-01-13T18:35:58.039 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YmY6_vbR1W6N9vA off=13220964 len=488755 2024-01-13T18:35:58.042 INFO:tasks.workunit.client.0.smithi084.stdout:op 4422 completed, throughput=5MB/sec 2024-01-13T18:35:58.042 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7RsMBTH3VHBuDcY off=4816811 len=1039975 2024-01-13T18:35:58.048 INFO:tasks.workunit.client.0.smithi084.stdout:op 4423 completed, throughput=5MB/sec 2024-01-13T18:35:58.048 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VNEj2G9rjLTcAlj off=156514 len=781639 2024-01-13T18:35:58.052 INFO:tasks.workunit.client.0.smithi084.stdout:op 4424 completed, throughput=5MB/sec 2024-01-13T18:35:58.052 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XgPFnrQN8gxY9Lo off=1718626 len=580267 2024-01-13T18:35:58.056 INFO:tasks.workunit.client.0.smithi084.stdout:op 4425 completed, throughput=5MB/sec 2024-01-13T18:35:58.056 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Io8AJxVrESP5uy0 off=1264943 len=1479557 2024-01-13T18:35:58.058 INFO:tasks.workunit.client.0.smithi084.stdout:op 4426 completed, throughput=5MB/sec 2024-01-13T18:35:58.058 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-I5PdpmtFgaI7bph off=5099675 len=821420 2024-01-13T18:35:58.058 INFO:tasks.workunit.client.0.smithi084.stdout:op 4427 completed, throughput=5MB/sec 2024-01-13T18:35:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: 878: throughput=4.99MB/sec pending data=0 2024-01-13T18:35:59.059 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dXkNssRALOpz9FG off=12579543 len=1242655 2024-01-13T18:35:59.064 INFO:tasks.workunit.client.0.smithi084.stdout:op 4428 completed, throughput=5MB/sec 2024-01-13T18:35:59.064 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4VjJleUam8Cy5LO off=1317408 len=884995 2024-01-13T18:35:59.070 INFO:tasks.workunit.client.0.smithi084.stdout:op 4429 completed, throughput=5MB/sec 2024-01-13T18:35:59.070 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hV6ybvCcvpmJYfx off=1607881 len=602312 2024-01-13T18:35:59.074 INFO:tasks.workunit.client.0.smithi084.stdout:op 4430 completed, throughput=5MB/sec 2024-01-13T18:35:59.074 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-s1TtSEQIsq5fAo_ off=5861657 len=1234532 2024-01-13T18:35:59.075 INFO:tasks.workunit.client.0.smithi084.stdout:op 4431 completed, throughput=5MB/sec 2024-01-13T18:35:59.075 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QRUvN-U2FLjR0wM off=2007980 len=1326931 2024-01-13T18:35:59.083 INFO:tasks.workunit.client.0.smithi084.stdout:op 4432 completed, throughput=5MB/sec 2024-01-13T18:35:59.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:35:59 smithi099 ceph-mon[138788]: pgmap v1925: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 4 op/s 2024-01-13T18:35:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:35:59 smithi084 ceph-mon[116404]: pgmap v1925: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 4 op/s 2024-01-13T18:35:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:35:59 smithi084 ceph-mon[119097]: pgmap v1925: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.5 MiB/s wr, 4 op/s 2024-01-13T18:36:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: 879: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:00.083 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9-0x0PknSJl_XHu off=24926350 len=323076 2024-01-13T18:36:00.086 INFO:tasks.workunit.client.0.smithi084.stdout:op 4433 completed, throughput=4.99MB/sec 2024-01-13T18:36:00.086 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-74-m-eVlVNg6yRt off=4404536 len=1581630 2024-01-13T18:36:00.095 INFO:tasks.workunit.client.0.smithi084.stdout:op 4434 completed, throughput=5MB/sec 2024-01-13T18:36:00.095 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JhRNJZ5ia8N0cME off=21249408 len=1232073 2024-01-13T18:36:00.097 INFO:tasks.workunit.client.0.smithi084.stdout:op 4435 completed, throughput=5MB/sec 2024-01-13T18:36:00.098 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LXIwlGQ3xcSMQC2 off=1220054 len=1922264 2024-01-13T18:36:00.099 INFO:tasks.workunit.client.0.smithi084.stdout:op 4436 completed, throughput=5MB/sec 2024-01-13T18:36:00.100 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VGO6jrjrDppYyvf off=14820761 len=145885 2024-01-13T18:36:00.102 INFO:tasks.workunit.client.0.smithi084.stdout:op 4437 completed, throughput=5MB/sec 2024-01-13T18:36:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:36:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:36:00] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:36:01.102 INFO:tasks.workunit.client.0.smithi084.stdout: 880: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:01.102 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zTOssURAgU1LJ0l off=12388466 len=680260 2024-01-13T18:36:01.106 INFO:tasks.workunit.client.0.smithi084.stdout:op 4438 completed, throughput=5MB/sec 2024-01-13T18:36:01.107 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uGbv6TzCTuo-yE8 off=1032336 len=603131 2024-01-13T18:36:01.110 INFO:tasks.workunit.client.0.smithi084.stdout:op 4439 completed, throughput=5MB/sec 2024-01-13T18:36:01.110 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MeH0UgfHo5ctgXP off=2700369 len=648832 2024-01-13T18:36:01.113 INFO:tasks.workunit.client.0.smithi084.stdout:op 4440 completed, throughput=5MB/sec 2024-01-13T18:36:01.113 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7bkA-AiPlAAhXsg off=6159454 len=1299079 2024-01-13T18:36:01.119 INFO:tasks.workunit.client.0.smithi084.stdout:op 4441 completed, throughput=5MB/sec 2024-01-13T18:36:01.119 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5R2fWCNuK65YbPo off=2224077 len=1528960 2024-01-13T18:36:01.120 INFO:tasks.workunit.client.0.smithi084.stdout:op 4442 completed, throughput=5MB/sec 2024-01-13T18:36:01.120 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CKfhmzV-aaNC-Po off=3719267 len=656233 2024-01-13T18:36:01.124 INFO:tasks.workunit.client.0.smithi084.stdout:op 4443 completed, throughput=5MB/sec 2024-01-13T18:36:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:01 smithi099 ceph-mon[138788]: pgmap v1926: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:36:01.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:01 smithi084 ceph-mon[116404]: pgmap v1926: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:36:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:01 smithi084 ceph-mon[119097]: pgmap v1926: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:36:02.125 INFO:tasks.workunit.client.0.smithi084.stdout: 881: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:02.125 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2-192vEmOKBYz2o off=8977176 len=1681973 2024-01-13T18:36:02.134 INFO:tasks.workunit.client.0.smithi084.stdout:op 4444 completed, throughput=5MB/sec 2024-01-13T18:36:02.134 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lSIjyJXAe9bCcco off=1367218 len=2050259 2024-01-13T18:36:02.142 INFO:tasks.workunit.client.0.smithi084.stdout:op 4445 completed, throughput=5MB/sec 2024-01-13T18:36:02.142 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5Ihw7mby36ecoS6 off=11828630 len=1562325 2024-01-13T18:36:02.151 INFO:tasks.workunit.client.0.smithi084.stdout:op 4446 completed, throughput=5MB/sec 2024-01-13T18:36:03.151 INFO:tasks.workunit.client.0.smithi084.stdout: 882: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:03.152 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NHIrMkghR6nAX65 off=2203838 len=1857264 2024-01-13T18:36:03.153 INFO:tasks.workunit.client.0.smithi084.stdout:op 4447 completed, throughput=5MB/sec 2024-01-13T18:36:03.153 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MnOdv19si6Nl44l off=18582503 len=6483 2024-01-13T18:36:03.156 INFO:tasks.workunit.client.0.smithi084.stdout:op 4448 completed, throughput=5MB/sec 2024-01-13T18:36:03.156 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-crxWABTjIuGfLum off=5565494 len=1400998 2024-01-13T18:36:03.165 INFO:tasks.workunit.client.0.smithi084.stdout:op 4449 completed, throughput=5MB/sec 2024-01-13T18:36:03.165 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_GLLtNZb0bwChGK off=12477634 len=905263 2024-01-13T18:36:03.169 INFO:tasks.workunit.client.0.smithi084.stdout:op 4450 completed, throughput=5MB/sec 2024-01-13T18:36:03.169 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9ncg0ZSqAGFd9-Y off=6989797 len=1059696 2024-01-13T18:36:03.171 INFO:tasks.workunit.client.0.smithi084.stdout:op 4451 completed, throughput=5MB/sec 2024-01-13T18:36:03.171 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Fwl5w8QgztslxvP off=8824202 len=1174858 2024-01-13T18:36:03.172 INFO:tasks.workunit.client.0.smithi084.stdout:op 4452 completed, throughput=5MB/sec 2024-01-13T18:36:03.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:03 smithi099 ceph-mon[138788]: pgmap v1927: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-01-13T18:36:03.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:03 smithi084 ceph-mon[116404]: pgmap v1927: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-01-13T18:36:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:03 smithi084 ceph-mon[119097]: pgmap v1927: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-01-13T18:36:04.172 INFO:tasks.workunit.client.0.smithi084.stdout: 883: throughput=5MB/sec pending data=0 2024-01-13T18:36:04.172 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nbIIhXm-aCtaosu off=662970 len=667470 2024-01-13T18:36:04.177 INFO:tasks.workunit.client.0.smithi084.stdout:op 4453 completed, throughput=5MB/sec 2024-01-13T18:36:04.177 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Zcv_IrVxn4fmOHU off=9477297 len=1272478 2024-01-13T18:36:04.178 INFO:tasks.workunit.client.0.smithi084.stdout:op 4454 completed, throughput=5MB/sec 2024-01-13T18:36:04.178 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CfhJASzC40lujPL off=2142206 len=1598712 2024-01-13T18:36:04.185 INFO:tasks.workunit.client.0.smithi084.stdout:op 4455 completed, throughput=5MB/sec 2024-01-13T18:36:04.186 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UKehINR58KgNmUp off=18949824 len=257684 2024-01-13T18:36:04.186 INFO:tasks.workunit.client.0.smithi084.stdout:op 4456 completed, throughput=5MB/sec 2024-01-13T18:36:04.186 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VbvZyUVYQgs6eMv off=349090 len=1599942 2024-01-13T18:36:04.189 INFO:tasks.workunit.client.0.smithi084.stdout:op 4457 completed, throughput=5MB/sec 2024-01-13T18:36:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:04 smithi099 ceph-mon[138788]: pgmap v1928: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:36:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:04 smithi084 ceph-mon[116404]: pgmap v1928: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:36:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:04 smithi084 ceph-mon[119097]: pgmap v1928: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 705 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:36:05.189 INFO:tasks.workunit.client.0.smithi084.stdout: 884: throughput=5MB/sec pending data=0 2024-01-13T18:36:05.190 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MevqX2VwwGZPr1k off=2197968 len=1725628 2024-01-13T18:36:05.192 INFO:tasks.workunit.client.0.smithi084.stdout:op 4458 completed, throughput=5MB/sec 2024-01-13T18:36:05.192 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OZ6vr1zIg6NAED1 off=11975278 len=701598 2024-01-13T18:36:05.196 INFO:tasks.workunit.client.0.smithi084.stdout:op 4459 completed, throughput=5MB/sec 2024-01-13T18:36:05.197 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0X6TrIPN9S6uh82 off=5451526 len=977776 2024-01-13T18:36:05.200 INFO:tasks.workunit.client.0.smithi084.stdout:op 4460 completed, throughput=5MB/sec 2024-01-13T18:36:05.201 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5EYr6_jE4YuoM0X off=698541 len=703900 2024-01-13T18:36:05.202 INFO:tasks.workunit.client.0.smithi084.stdout:op 4461 completed, throughput=5MB/sec 2024-01-13T18:36:05.202 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NzPyWNz8k4ww-53 off=14300676 len=30319 2024-01-13T18:36:05.204 INFO:tasks.workunit.client.0.smithi084.stdout:op 4462 completed, throughput=5MB/sec 2024-01-13T18:36:05.205 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-d04ZGmogIQ1KH-J off=1711698 len=121824 2024-01-13T18:36:05.205 INFO:tasks.workunit.client.0.smithi084.stdout:op 4463 completed, throughput=5MB/sec 2024-01-13T18:36:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:06.205 INFO:tasks.workunit.client.0.smithi084.stdout: 885: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:06.206 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-X8AResZJi2wau0G off=14202933 len=1172265 2024-01-13T18:36:06.212 INFO:tasks.workunit.client.0.smithi084.stdout:op 4464 completed, throughput=5MB/sec 2024-01-13T18:36:06.212 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kDClHCQSGQMp8ZN off=4006850 len=1118082 2024-01-13T18:36:06.219 INFO:tasks.workunit.client.0.smithi084.stdout:op 4465 completed, throughput=5MB/sec 2024-01-13T18:36:06.219 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KyOS9vzuSHdSE82 off=4000488 len=1002539 2024-01-13T18:36:06.223 INFO:tasks.workunit.client.0.smithi084.stdout:op 4466 completed, throughput=5MB/sec 2024-01-13T18:36:06.223 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vXwMUWb7oTRx5Vf off=273698 len=261704 2024-01-13T18:36:06.224 INFO:tasks.workunit.client.0.smithi084.stdout:op 4467 completed, throughput=5MB/sec 2024-01-13T18:36:06.224 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XtzsiDIgC1Y3DIS off=5169341 len=2089249 2024-01-13T18:36:06.225 INFO:tasks.workunit.client.0.smithi084.stdout:op 4468 completed, throughput=5MB/sec 2024-01-13T18:36:06.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:06 smithi099 ceph-mon[138788]: pgmap v1929: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:36:06.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:06 smithi084 ceph-mon[116404]: pgmap v1929: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:36:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:06 smithi084 ceph-mon[119097]: pgmap v1929: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:36:07.226 INFO:tasks.workunit.client.0.smithi084.stdout: 886: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:07.226 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AkXRNTeuLQId9-C off=18934233 len=2074329 2024-01-13T18:36:07.237 INFO:tasks.workunit.client.0.smithi084.stdout:op 4469 completed, throughput=5MB/sec 2024-01-13T18:36:07.237 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-f20GmeBRxr6opwF off=3521606 len=161153 2024-01-13T18:36:07.240 INFO:tasks.workunit.client.0.smithi084.stdout:op 4470 completed, throughput=5MB/sec 2024-01-13T18:36:07.240 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1xmJNX3DfXPsu2L off=1117165 len=1885257 2024-01-13T18:36:07.242 INFO:tasks.workunit.client.0.smithi084.stdout:op 4471 completed, throughput=5MB/sec 2024-01-13T18:36:07.242 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aBhQbZrE70k3N0F off=12598708 len=1290682 2024-01-13T18:36:07.243 INFO:tasks.workunit.client.0.smithi084.stdout:op 4472 completed, throughput=5MB/sec 2024-01-13T18:36:08.243 INFO:tasks.workunit.client.0.smithi084.stdout: 887: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:08.243 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2lbCvsPB4bpPxLE off=243267 len=899681 2024-01-13T18:36:08.248 INFO:tasks.workunit.client.0.smithi084.stdout:op 4473 completed, throughput=5MB/sec 2024-01-13T18:36:08.248 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N8q1wUeY4a0aRyA off=14560218 len=1666548 2024-01-13T18:36:08.252 INFO:tasks.workunit.client.0.smithi084.stdout:op 4474 completed, throughput=5MB/sec 2024-01-13T18:36:08.252 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3xYXDW1czysDW-0 off=3006106 len=1954451 2024-01-13T18:36:08.260 INFO:tasks.workunit.client.0.smithi084.stdout:op 4475 completed, throughput=5MB/sec 2024-01-13T18:36:08.260 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x3IdIuQqwT7A7LB off=773576 len=1935597 2024-01-13T18:36:08.272 INFO:tasks.workunit.client.0.smithi084.stdout:op 4476 completed, throughput=5MB/sec 2024-01-13T18:36:09.273 INFO:tasks.workunit.client.0.smithi084.stdout: 888: throughput=5MB/sec pending data=0 2024-01-13T18:36:09.273 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sBrMfnqnB1LowN9 off=4163144 len=850923 2024-01-13T18:36:09.277 INFO:tasks.workunit.client.0.smithi084.stdout:op 4477 completed, throughput=5MB/sec 2024-01-13T18:36:09.277 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-it-d3GHRkEnTF-P off=18813834 len=820162 2024-01-13T18:36:09.282 INFO:tasks.workunit.client.0.smithi084.stdout:op 4478 completed, throughput=5MB/sec 2024-01-13T18:36:09.282 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dHiKZMvSnkbwAJy off=3736800 len=814730 2024-01-13T18:36:09.286 INFO:tasks.workunit.client.0.smithi084.stdout:op 4479 completed, throughput=5MB/sec 2024-01-13T18:36:09.287 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Kf8_cmZu9w3KE3l off=1675733 len=503779 2024-01-13T18:36:09.290 INFO:tasks.workunit.client.0.smithi084.stdout:op 4480 completed, throughput=5MB/sec 2024-01-13T18:36:09.291 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gTlRuCfO6KK_Q8N off=9062437 len=9843 2024-01-13T18:36:09.291 INFO:tasks.workunit.client.0.smithi084.stdout:op 4481 completed, throughput=5MB/sec 2024-01-13T18:36:09.291 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ggBxefmLfqbjdxi off=5058135 len=148856 2024-01-13T18:36:09.293 INFO:tasks.workunit.client.0.smithi084.stdout:op 4482 completed, throughput=5MB/sec 2024-01-13T18:36:09.293 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-X1x-aBI6m35ZJfp off=158906 len=950963 2024-01-13T18:36:09.298 INFO:tasks.workunit.client.0.smithi084.stdout:op 4483 completed, throughput=5MB/sec 2024-01-13T18:36:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:09 smithi099 ceph-mon[138788]: pgmap v1930: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:36:09.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:09 smithi084 ceph-mon[116404]: pgmap v1930: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:36:09.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:09 smithi084 ceph-mon[119097]: pgmap v1930: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:36:10.299 INFO:tasks.workunit.client.0.smithi084.stdout: 889: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:10.299 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-crxWABTjIuGfLum off=1621127 len=2045044 2024-01-13T18:36:10.302 INFO:tasks.workunit.client.0.smithi084.stdout:op 4484 completed, throughput=5MB/sec 2024-01-13T18:36:10.302 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HQBnN4x1yJ-K-4X off=8996050 len=1019814 2024-01-13T18:36:10.309 INFO:tasks.workunit.client.0.smithi084.stdout:op 4485 completed, throughput=5MB/sec 2024-01-13T18:36:10.309 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-90zHM8d39fi5M_X off=4081004 len=1753073 2024-01-13T18:36:10.312 INFO:tasks.workunit.client.0.smithi084.stdout:op 4486 completed, throughput=5MB/sec 2024-01-13T18:36:10.312 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uNhJL2Lq5nxmLdq off=7963619 len=1207050 2024-01-13T18:36:10.314 INFO:tasks.workunit.client.0.smithi084.stdout:op 4487 completed, throughput=5MB/sec 2024-01-13T18:36:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:36:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:36:10] "GET /metrics HTTP/1.1" 200 33995 "" "Prometheus/2.43.0" 2024-01-13T18:36:11.315 INFO:tasks.workunit.client.0.smithi084.stdout: 890: throughput=5MB/sec pending data=0 2024-01-13T18:36:11.315 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xsAc1mdL18njgGw off=2823480 len=2076930 2024-01-13T18:36:11.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 4488 completed, throughput=5MB/sec 2024-01-13T18:36:11.329 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3eHqcY9wqi5Phet off=6280524 len=402269 2024-01-13T18:36:11.332 INFO:tasks.workunit.client.0.smithi084.stdout:op 4489 completed, throughput=5MB/sec 2024-01-13T18:36:11.332 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bH4zaDXsaxfr2PI off=3088464 len=1327937 2024-01-13T18:36:11.334 INFO:tasks.workunit.client.0.smithi084.stdout:op 4490 completed, throughput=5MB/sec 2024-01-13T18:36:11.334 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wpiWivBrHGq9Sdj off=16558256 len=888058 2024-01-13T18:36:11.339 INFO:tasks.workunit.client.0.smithi084.stdout:op 4491 completed, throughput=5MB/sec 2024-01-13T18:36:11.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:11 smithi099 ceph-mon[138788]: pgmap v1931: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 6 op/s 2024-01-13T18:36:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:11 smithi084 ceph-mon[116404]: pgmap v1931: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 6 op/s 2024-01-13T18:36:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:11 smithi084 ceph-mon[119097]: pgmap v1931: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 6 op/s 2024-01-13T18:36:12.340 INFO:tasks.workunit.client.0.smithi084.stdout: 891: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:12.340 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0KCvIfBNihcQeoP off=1839233 len=1729611 2024-01-13T18:36:12.343 INFO:tasks.workunit.client.0.smithi084.stdout:op 4492 completed, throughput=5MB/sec 2024-01-13T18:36:12.343 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cxTwsY-bfldfGmf off=10178922 len=1442803 2024-01-13T18:36:12.351 INFO:tasks.workunit.client.0.smithi084.stdout:op 4493 completed, throughput=5MB/sec 2024-01-13T18:36:12.351 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GVceg6NTQFgRZpN off=3923957 len=83779 2024-01-13T18:36:12.353 INFO:tasks.workunit.client.0.smithi084.stdout:op 4494 completed, throughput=5MB/sec 2024-01-13T18:36:12.353 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nksrUq1ZnbfJYrS off=7271189 len=1128194 2024-01-13T18:36:12.358 INFO:tasks.workunit.client.0.smithi084.stdout:op 4495 completed, throughput=5MB/sec 2024-01-13T18:36:12.358 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-b1HVAMDnarRlTgI off=3745781 len=933914 2024-01-13T18:36:12.361 INFO:tasks.workunit.client.0.smithi084.stdout:op 4496 completed, throughput=5MB/sec 2024-01-13T18:36:13.362 INFO:tasks.workunit.client.0.smithi084.stdout: 892: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:13.362 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pxFadv23fYMaHbr off=1008409 len=914252 2024-01-13T18:36:13.367 INFO:tasks.workunit.client.0.smithi084.stdout:op 4497 completed, throughput=5MB/sec 2024-01-13T18:36:13.367 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3YpDBwyROuTJLl8 off=3395354 len=1647898 2024-01-13T18:36:13.368 INFO:tasks.workunit.client.0.smithi084.stdout:op 4498 completed, throughput=5MB/sec 2024-01-13T18:36:13.369 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--OaDF4SEJR5Mj7r off=8967791 len=809270 2024-01-13T18:36:13.369 INFO:tasks.workunit.client.0.smithi084.stdout:op 4499 completed, throughput=5MB/sec 2024-01-13T18:36:13.369 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QAGZUIsfiSskdIR off=20255770 len=1241928 2024-01-13T18:36:13.371 INFO:tasks.workunit.client.0.smithi084.stdout:op 4500 completed, throughput=5MB/sec 2024-01-13T18:36:13.371 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-s7xdVZfmW9GoN2w off=1831983 len=899104 2024-01-13T18:36:13.371 INFO:tasks.workunit.client.0.smithi084.stdout:op 4501 completed, throughput=5MB/sec 2024-01-13T18:36:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:13 smithi099 ceph-mon[138788]: pgmap v1932: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:36:13.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:13 smithi084 ceph-mon[116404]: pgmap v1932: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:36:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:13 smithi084 ceph-mon[119097]: pgmap v1932: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:36:14.372 INFO:tasks.workunit.client.0.smithi084.stdout: 893: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:14.372 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8rnOyElBKfqy3D4 off=2979976 len=812650 2024-01-13T18:36:14.373 INFO:tasks.workunit.client.0.smithi084.stdout:op 4502 completed, throughput=5MB/sec 2024-01-13T18:36:14.373 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SUZJHqDT98JJqHL off=2364817 len=1848137 2024-01-13T18:36:14.375 INFO:tasks.workunit.client.0.smithi084.stdout:op 4503 completed, throughput=5MB/sec 2024-01-13T18:36:14.375 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3PKsKWZTvk8NU_H off=12290594 len=503074 2024-01-13T18:36:14.380 INFO:tasks.workunit.client.0.smithi084.stdout:op 4504 completed, throughput=5MB/sec 2024-01-13T18:36:14.380 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GVceg6NTQFgRZpN off=4358294 len=1331816 2024-01-13T18:36:14.381 INFO:tasks.workunit.client.0.smithi084.stdout:op 4505 completed, throughput=5MB/sec 2024-01-13T18:36:14.381 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5ydG6hOKNJlDCQS off=15606956 len=750161 2024-01-13T18:36:14.384 INFO:tasks.workunit.client.0.smithi084.stdout:op 4506 completed, throughput=5MB/sec 2024-01-13T18:36:14.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:14 smithi099 ceph-mon[138788]: pgmap v1933: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:36:14.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:14 smithi084 ceph-mon[116404]: pgmap v1933: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:36:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:14 smithi084 ceph-mon[119097]: pgmap v1933: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 4 op/s 2024-01-13T18:36:15.385 INFO:tasks.workunit.client.0.smithi084.stdout: 894: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:15.385 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LYSvyzmowjNLTtd off=9398175 len=1520572 2024-01-13T18:36:15.394 INFO:tasks.workunit.client.0.smithi084.stdout:op 4507 completed, throughput=5MB/sec 2024-01-13T18:36:15.394 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-F3D7GVxwE_Us0tc off=879697 len=576158 2024-01-13T18:36:15.395 INFO:tasks.workunit.client.0.smithi084.stdout:op 4508 completed, throughput=5MB/sec 2024-01-13T18:36:15.395 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7_9aZnmsV9kl-qs off=2757652 len=1139893 2024-01-13T18:36:15.396 INFO:tasks.workunit.client.0.smithi084.stdout:op 4509 completed, throughput=5MB/sec 2024-01-13T18:36:15.396 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S7TApQHU30x_l7y off=23759701 len=349149 2024-01-13T18:36:15.399 INFO:tasks.workunit.client.0.smithi084.stdout:op 4510 completed, throughput=5MB/sec 2024-01-13T18:36:15.399 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RwZ-hhLs-cxPlIw off=18315817 len=2085164 2024-01-13T18:36:15.401 INFO:tasks.workunit.client.0.smithi084.stdout:op 4511 completed, throughput=5MB/sec 2024-01-13T18:36:16.402 INFO:tasks.workunit.client.0.smithi084.stdout: 895: throughput=5MB/sec pending data=0 2024-01-13T18:36:16.402 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-M5BtyiaCCXZEmf_ off=194950 len=247462 2024-01-13T18:36:16.405 INFO:tasks.workunit.client.0.smithi084.stdout:op 4512 completed, throughput=5MB/sec 2024-01-13T18:36:16.405 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5kdzUVfCDJS-mrj off=335177 len=1351253 2024-01-13T18:36:16.413 INFO:tasks.workunit.client.0.smithi084.stdout:op 4513 completed, throughput=5MB/sec 2024-01-13T18:36:16.413 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5R5nlUBJWJrWIY0 off=17539 len=2008210 2024-01-13T18:36:16.422 INFO:tasks.workunit.client.0.smithi084.stdout:op 4514 completed, throughput=5MB/sec 2024-01-13T18:36:16.422 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-skpz2h9boXyyi_L off=3454121 len=1950722 2024-01-13T18:36:16.433 INFO:tasks.workunit.client.0.smithi084.stdout:op 4515 completed, throughput=5MB/sec 2024-01-13T18:36:17.434 INFO:tasks.workunit.client.0.smithi084.stdout: 896: throughput=5MB/sec pending data=0 2024-01-13T18:36:17.434 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gSR8XnE6ZwP-GU5 off=0 len=1723962 2024-01-13T18:36:17.436 INFO:tasks.workunit.client.0.smithi084.stdout:op 4516 completed, throughput=5MB/sec 2024-01-13T18:36:17.436 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LMTX8a1yqxD-ODw off=7332400 len=2055805 2024-01-13T18:36:17.438 INFO:tasks.workunit.client.0.smithi084.stdout:op 4517 completed, throughput=5MB/sec 2024-01-13T18:36:17.438 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8VqOzOJRrrBUliX off=8135025 len=1473277 2024-01-13T18:36:17.445 INFO:tasks.workunit.client.0.smithi084.stdout:op 4518 completed, throughput=5MB/sec 2024-01-13T18:36:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:17 smithi099 ceph-mon[138788]: pgmap v1934: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:36:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:17 smithi084 ceph-mon[116404]: pgmap v1934: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:36:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:17 smithi084 ceph-mon[119097]: pgmap v1934: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:36:18.446 INFO:tasks.workunit.client.0.smithi084.stdout: 897: throughput=5MB/sec pending data=0 2024-01-13T18:36:18.446 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Qzwi04O2Ey7zIJ2 off=11867193 len=1645091 2024-01-13T18:36:18.448 INFO:tasks.workunit.client.0.smithi084.stdout:op 4519 completed, throughput=5MB/sec 2024-01-13T18:36:18.448 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3wxTXz4KcQXFhnU off=972429 len=462347 2024-01-13T18:36:18.452 INFO:tasks.workunit.client.0.smithi084.stdout:op 4520 completed, throughput=5MB/sec 2024-01-13T18:36:18.452 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ebnhzXQkaX2qSGj off=2250373 len=468639 2024-01-13T18:36:18.453 INFO:tasks.workunit.client.0.smithi084.stdout:op 4521 completed, throughput=5MB/sec 2024-01-13T18:36:18.453 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uPgNTL7RU9CoNtl off=5442688 len=751989 2024-01-13T18:36:18.457 INFO:tasks.workunit.client.0.smithi084.stdout:op 4522 completed, throughput=5MB/sec 2024-01-13T18:36:18.458 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RTDP53PFzG-hZJs off=11798870 len=1191482 2024-01-13T18:36:18.463 INFO:tasks.workunit.client.0.smithi084.stdout:op 4523 completed, throughput=5MB/sec 2024-01-13T18:36:18.463 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0hRJzCWA0NCyK2y off=12017966 len=2070720 2024-01-13T18:36:18.468 INFO:tasks.workunit.client.0.smithi084.stdout:op 4524 completed, throughput=5MB/sec 2024-01-13T18:36:19.469 INFO:tasks.workunit.client.0.smithi084.stdout: 898: throughput=5MB/sec pending data=0 2024-01-13T18:36:19.469 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZgcRIU94-WOXds8 off=6742956 len=1378621 2024-01-13T18:36:19.476 INFO:tasks.workunit.client.0.smithi084.stdout:op 4525 completed, throughput=5MB/sec 2024-01-13T18:36:19.476 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-15pWKn10VMxL2fj off=1460826 len=69338 2024-01-13T18:36:19.478 INFO:tasks.workunit.client.0.smithi084.stdout:op 4526 completed, throughput=5MB/sec 2024-01-13T18:36:19.478 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MlUhSNrHQTn8HU4 off=5293080 len=40268 2024-01-13T18:36:19.480 INFO:tasks.workunit.client.0.smithi084.stdout:op 4527 completed, throughput=5MB/sec 2024-01-13T18:36:19.480 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1ue3e4bvt6dvtj1 off=8272547 len=1169041 2024-01-13T18:36:19.481 INFO:tasks.workunit.client.0.smithi084.stdout:op 4528 completed, throughput=5MB/sec 2024-01-13T18:36:19.482 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vbczYWYMn2J11LX off=625955 len=243122 2024-01-13T18:36:19.484 INFO:tasks.workunit.client.0.smithi084.stdout:op 4529 completed, throughput=5MB/sec 2024-01-13T18:36:19.484 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Mhw2xKvDKcnLvSJ off=10484492 len=1888629 2024-01-13T18:36:19.486 INFO:tasks.workunit.client.0.smithi084.stdout:op 4530 completed, throughput=5MB/sec 2024-01-13T18:36:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:19 smithi099 ceph-mon[138788]: pgmap v1935: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:36:19.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:19 smithi084 ceph-mon[116404]: pgmap v1935: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:36:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:19 smithi084 ceph-mon[119097]: pgmap v1935: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:36:20.486 INFO:tasks.workunit.client.0.smithi084.stdout: 899: throughput=5MB/sec pending data=0 2024-01-13T18:36:20.486 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BaOKez2ZSa2F8x8 off=0 len=1107739 2024-01-13T18:36:20.492 INFO:tasks.workunit.client.0.smithi084.stdout:op 4531 completed, throughput=5MB/sec 2024-01-13T18:36:20.493 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zEx9UIPnHKh5UdH off=2429607 len=2087468 2024-01-13T18:36:20.505 INFO:tasks.workunit.client.0.smithi084.stdout:op 4532 completed, throughput=5MB/sec 2024-01-13T18:36:20.505 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0M3cqNNcOujiXyg off=22572729 len=1085845 2024-01-13T18:36:20.511 INFO:tasks.workunit.client.0.smithi084.stdout:op 4533 completed, throughput=5MB/sec 2024-01-13T18:36:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:20.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:36:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:36:20] "GET /metrics HTTP/1.1" 200 33995 "" "Prometheus/2.43.0" 2024-01-13T18:36:21.511 INFO:tasks.workunit.client.0.smithi084.stdout: 900: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:21.511 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gQ1vvNsNmTuINx0 off=2172341 len=325334 2024-01-13T18:36:21.512 INFO:tasks.workunit.client.0.smithi084.stdout:op 4534 completed, throughput=5MB/sec 2024-01-13T18:36:21.512 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0UxuN6WBdMopUK6 off=2602508 len=1453997 2024-01-13T18:36:21.514 INFO:tasks.workunit.client.0.smithi084.stdout:op 4535 completed, throughput=5MB/sec 2024-01-13T18:36:21.514 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yhlsk--lBFY2vij off=7603429 len=501952 2024-01-13T18:36:21.518 INFO:tasks.workunit.client.0.smithi084.stdout:op 4536 completed, throughput=5MB/sec 2024-01-13T18:36:21.518 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QyuZUWV16LlXI-s off=13301188 len=1183037 2024-01-13T18:36:21.520 INFO:tasks.workunit.client.0.smithi084.stdout:op 4537 completed, throughput=5MB/sec 2024-01-13T18:36:21.520 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_affKr_IB5hBMwr off=5281519 len=1227315 2024-01-13T18:36:21.522 INFO:tasks.workunit.client.0.smithi084.stdout:op 4538 completed, throughput=5MB/sec 2024-01-13T18:36:21.522 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7ueYKlcWIzNpNXA off=989924 len=2002503 2024-01-13T18:36:21.532 INFO:tasks.workunit.client.0.smithi084.stdout:op 4539 completed, throughput=5MB/sec 2024-01-13T18:36:21.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:21 smithi099 ceph-mon[138788]: pgmap v1936: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:36:21.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:21 smithi084 ceph-mon[116404]: pgmap v1936: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:36:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:21 smithi084 ceph-mon[119097]: pgmap v1936: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:36:22.532 INFO:tasks.workunit.client.0.smithi084.stdout: 901: throughput=5MB/sec pending data=0 2024-01-13T18:36:22.532 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gQdf8uoLPalVaUt off=2240621 len=916661 2024-01-13T18:36:22.534 INFO:tasks.workunit.client.0.smithi084.stdout:op 4540 completed, throughput=5MB/sec 2024-01-13T18:36:22.534 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uHjtgWD-oh5Qoc- off=10801837 len=1247126 2024-01-13T18:36:22.541 INFO:tasks.workunit.client.0.smithi084.stdout:op 4541 completed, throughput=5MB/sec 2024-01-13T18:36:22.541 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y7xyc5JKn5ESz0B off=3843727 len=343209 2024-01-13T18:36:22.545 INFO:tasks.workunit.client.0.smithi084.stdout:op 4542 completed, throughput=5MB/sec 2024-01-13T18:36:22.545 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-P0twmhB8wvh51UM off=20638967 len=1924478 2024-01-13T18:36:22.547 INFO:tasks.workunit.client.0.smithi084.stdout:op 4543 completed, throughput=5MB/sec 2024-01-13T18:36:23.547 INFO:tasks.workunit.client.0.smithi084.stdout: 902: throughput=5MB/sec pending data=0 2024-01-13T18:36:23.547 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4RbOenfsVbZ91uV off=47987 len=400441 2024-01-13T18:36:23.548 INFO:tasks.workunit.client.0.smithi084.stdout:op 4544 completed, throughput=5MB/sec 2024-01-13T18:36:23.548 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5Ccv0lGeX4nejbS off=3067728 len=649294 2024-01-13T18:36:23.551 INFO:tasks.workunit.client.0.smithi084.stdout:op 4545 completed, throughput=5MB/sec 2024-01-13T18:36:23.551 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SMYvhlyedsSVVWQ off=3535187 len=1534457 2024-01-13T18:36:23.556 INFO:tasks.workunit.client.0.smithi084.stdout:op 4546 completed, throughput=5MB/sec 2024-01-13T18:36:23.556 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-N9szRCu86AGanZw off=7166505 len=2009634 2024-01-13T18:36:23.569 INFO:tasks.workunit.client.0.smithi084.stdout:op 4547 completed, throughput=5MB/sec 2024-01-13T18:36:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:23 smithi099 ceph-mon[138788]: pgmap v1937: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:36:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:23 smithi084 ceph-mon[116404]: pgmap v1937: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:36:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:23 smithi084 ceph-mon[119097]: pgmap v1937: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:36:24.569 INFO:tasks.workunit.client.0.smithi084.stdout: 903: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:24.569 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4pDoTgJ4DBf_pwA off=12849255 len=112290 2024-01-13T18:36:24.572 INFO:tasks.workunit.client.0.smithi084.stdout:op 4548 completed, throughput=4.99MB/sec 2024-01-13T18:36:24.572 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CRmgZrp9TjvPuWm off=43729 len=1920117 2024-01-13T18:36:24.581 INFO:tasks.workunit.client.0.smithi084.stdout:op 4549 completed, throughput=5MB/sec 2024-01-13T18:36:24.581 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ma_6LZ3CagMoqm2 off=6436873 len=1410891 2024-01-13T18:36:24.588 INFO:tasks.workunit.client.0.smithi084.stdout:op 4550 completed, throughput=5MB/sec 2024-01-13T18:36:24.588 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DZOPZ8qHeUKHTKh off=1244018 len=377661 2024-01-13T18:36:24.589 INFO:tasks.workunit.client.0.smithi084.stdout:op 4551 completed, throughput=5MB/sec 2024-01-13T18:36:24.589 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rpofyHqJ9Drfkk_ off=2826714 len=1252401 2024-01-13T18:36:24.590 INFO:tasks.workunit.client.0.smithi084.stdout:op 4552 completed, throughput=5MB/sec 2024-01-13T18:36:24.590 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZhbfcYjjtEuYq7v off=3556674 len=826260 2024-01-13T18:36:24.594 INFO:tasks.workunit.client.0.smithi084.stdout:op 4553 completed, throughput=5MB/sec 2024-01-13T18:36:24.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:24 smithi099 ceph-mon[138788]: pgmap v1938: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:24 smithi084 ceph-mon[116404]: pgmap v1938: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:24 smithi084 ceph-mon[119097]: pgmap v1938: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:25.595 INFO:tasks.workunit.client.0.smithi084.stdout: 904: throughput=5MB/sec pending data=0 2024-01-13T18:36:25.595 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GMXSNWPrCf8fLiY off=11176748 len=1832878 2024-01-13T18:36:25.597 INFO:tasks.workunit.client.0.smithi084.stdout:op 4554 completed, throughput=5MB/sec 2024-01-13T18:36:25.597 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JcpsUQWzMPp6Wi9 off=930251 len=948723 2024-01-13T18:36:25.599 INFO:tasks.workunit.client.0.smithi084.stdout:op 4555 completed, throughput=5MB/sec 2024-01-13T18:36:25.599 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-W2cb1LHYsHtGcbw off=22041132 len=1519563 2024-01-13T18:36:25.601 INFO:tasks.workunit.client.0.smithi084.stdout:op 4556 completed, throughput=5MB/sec 2024-01-13T18:36:25.601 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xk5F8ENF8PWELeV off=4229358 len=1427853 2024-01-13T18:36:25.606 INFO:tasks.workunit.client.0.smithi084.stdout:op 4557 completed, throughput=5MB/sec 2024-01-13T18:36:26.607 INFO:tasks.workunit.client.0.smithi084.stdout: 905: throughput=5MB/sec pending data=0 2024-01-13T18:36:26.607 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6-pV1kYY0VB_Udo off=0 len=1860690 2024-01-13T18:36:26.609 INFO:tasks.workunit.client.0.smithi084.stdout:op 4558 completed, throughput=5MB/sec 2024-01-13T18:36:26.609 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iCZ_SoKK3PM6mxV off=13414270 len=1233436 2024-01-13T18:36:26.610 INFO:tasks.workunit.client.0.smithi084.stdout:op 4559 completed, throughput=5MB/sec 2024-01-13T18:36:26.610 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BgW0sBmY3-XMeWC off=7762263 len=2058908 2024-01-13T18:36:26.612 INFO:tasks.workunit.client.0.smithi084.stdout:op 4560 completed, throughput=5MB/sec 2024-01-13T18:36:26.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:26 smithi084 ceph-mon[116404]: pgmap v1939: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:26 smithi084 ceph-mon[119097]: pgmap v1939: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:26 smithi099 ceph-mon[138788]: pgmap v1939: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:27.612 INFO:tasks.workunit.client.0.smithi084.stdout: 906: throughput=5MB/sec pending data=0 2024-01-13T18:36:27.613 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kEI9_a1yQ5H4Bnk off=7530910 len=1011726 2024-01-13T18:36:27.615 INFO:tasks.workunit.client.0.smithi084.stdout:op 4561 completed, throughput=5MB/sec 2024-01-13T18:36:27.615 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pF5hVGKhFlnvr8w off=5325795 len=869894 2024-01-13T18:36:27.619 INFO:tasks.workunit.client.0.smithi084.stdout:op 4562 completed, throughput=5MB/sec 2024-01-13T18:36:27.619 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AsWeRTaksIF_4ZJ off=0 len=1358059 2024-01-13T18:36:27.626 INFO:tasks.workunit.client.0.smithi084.stdout:op 4563 completed, throughput=5MB/sec 2024-01-13T18:36:27.626 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ebnhzXQkaX2qSGj off=160868 len=130923 2024-01-13T18:36:27.628 INFO:tasks.workunit.client.0.smithi084.stdout:op 4564 completed, throughput=5MB/sec 2024-01-13T18:36:27.628 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SbHuzQA_7m9dlGg off=1946010 len=293390 2024-01-13T18:36:27.631 INFO:tasks.workunit.client.0.smithi084.stdout:op 4565 completed, throughput=5MB/sec 2024-01-13T18:36:27.631 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KDooV_I5GfWqaT- off=6498019 len=766082 2024-01-13T18:36:27.633 INFO:tasks.workunit.client.0.smithi084.stdout:op 4566 completed, throughput=5MB/sec 2024-01-13T18:36:27.633 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HeG93UQS7Lr2Iz8 off=14955836 len=93186 2024-01-13T18:36:27.633 INFO:tasks.workunit.client.0.smithi084.stdout:op 4567 completed, throughput=5MB/sec 2024-01-13T18:36:28.633 INFO:tasks.workunit.client.0.smithi084.stdout: 907: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:28.634 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Lio3vc0slsplxXa off=22434198 len=183818 2024-01-13T18:36:28.636 INFO:tasks.workunit.client.0.smithi084.stdout:op 4568 completed, throughput=4.99MB/sec 2024-01-13T18:36:28.636 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uolYtvhTjE0RYas off=2423880 len=1765073 2024-01-13T18:36:28.638 INFO:tasks.workunit.client.0.smithi084.stdout:op 4569 completed, throughput=5MB/sec 2024-01-13T18:36:28.639 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-w6HLsshCE8J8vfo off=5646853 len=606627 2024-01-13T18:36:28.643 INFO:tasks.workunit.client.0.smithi084.stdout:op 4570 completed, throughput=5MB/sec 2024-01-13T18:36:28.643 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y5lnJqth91pTK3e off=826362 len=2002100 2024-01-13T18:36:28.654 INFO:tasks.workunit.client.0.smithi084.stdout:op 4571 completed, throughput=5MB/sec 2024-01-13T18:36:28.654 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-doW4aM-BibUgCHe off=6629092 len=1852062 2024-01-13T18:36:28.656 INFO:tasks.workunit.client.0.smithi084.stdout:op 4572 completed, throughput=5MB/sec 2024-01-13T18:36:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:29 smithi099 ceph-mon[138788]: pgmap v1940: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:29.656 INFO:tasks.workunit.client.0.smithi084.stdout: 908: throughput=5MB/sec pending data=0 2024-01-13T18:36:29.657 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bQ2MvxwOGZp8mZM off=6512234 len=1529654 2024-01-13T18:36:29.665 INFO:tasks.workunit.client.0.smithi084.stdout:op 4573 completed, throughput=5MB/sec 2024-01-13T18:36:29.665 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Fufc_CkYtfm3Z5b off=4106480 len=1256320 2024-01-13T18:36:29.666 INFO:tasks.workunit.client.0.smithi084.stdout:op 4574 completed, throughput=5MB/sec 2024-01-13T18:36:29.666 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tCsxV51W4rH1AeZ off=14799936 len=732301 2024-01-13T18:36:29.667 INFO:tasks.workunit.client.0.smithi084.stdout:op 4575 completed, throughput=5MB/sec 2024-01-13T18:36:29.667 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IfPiZwHrxRTfPCC off=4231572 len=498063 2024-01-13T18:36:29.671 INFO:tasks.workunit.client.0.smithi084.stdout:op 4576 completed, throughput=5MB/sec 2024-01-13T18:36:29.671 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zZ1eDyQb1zl9SYW off=10682571 len=1485589 2024-01-13T18:36:29.675 INFO:tasks.workunit.client.0.smithi084.stdout:op 4577 completed, throughput=5MB/sec 2024-01-13T18:36:29.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:29 smithi084 ceph-mon[116404]: pgmap v1940: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:29.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:29 smithi084 ceph-mon[119097]: pgmap v1940: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:30.676 INFO:tasks.workunit.client.0.smithi084.stdout: 909: throughput=5MB/sec pending data=0 2024-01-13T18:36:30.677 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5FnpnRizY-r_LRT off=6306539 len=234141 2024-01-13T18:36:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:36:30.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:36:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:36:30] "GET /metrics HTTP/1.1" 200 33995 "" "Prometheus/2.43.0" 2024-01-13T18:36:30.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:36:30.678 INFO:tasks.workunit.client.0.smithi084.stdout:op 4578 completed, throughput=5MB/sec 2024-01-13T18:36:30.679 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wF8Gye-tzqLS-au off=7341833 len=204098 2024-01-13T18:36:30.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 4579 completed, throughput=5MB/sec 2024-01-13T18:36:30.679 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-liRt5JJC4b8RTel off=17425018 len=872455 2024-01-13T18:36:30.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 4580 completed, throughput=5MB/sec 2024-01-13T18:36:30.679 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_L97MPwwe4kuR_N off=6605687 len=813742 2024-01-13T18:36:30.682 INFO:tasks.workunit.client.0.smithi084.stdout:op 4581 completed, throughput=5MB/sec 2024-01-13T18:36:30.682 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XmiduNjaFax572J off=78308 len=1509415 2024-01-13T18:36:30.688 INFO:tasks.workunit.client.0.smithi084.stdout:op 4582 completed, throughput=5MB/sec 2024-01-13T18:36:30.688 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_-nQnKGA9Fr2cnu off=10506865 len=1748119 2024-01-13T18:36:30.690 INFO:tasks.workunit.client.0.smithi084.stdout:op 4583 completed, throughput=5MB/sec 2024-01-13T18:36:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:36:31.690 INFO:tasks.workunit.client.0.smithi084.stdout: 910: throughput=5MB/sec pending data=0 2024-01-13T18:36:31.690 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IGKrWbBVEsd8_8T off=470 len=893190 2024-01-13T18:36:31.691 INFO:tasks.workunit.client.0.smithi084.stdout:op 4584 completed, throughput=5MB/sec 2024-01-13T18:36:31.691 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JgGYUo9IKVHnldp off=2138742 len=232095 2024-01-13T18:36:31.692 INFO:tasks.workunit.client.0.smithi084.stdout:op 4585 completed, throughput=5MB/sec 2024-01-13T18:36:31.692 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kdnHYrc68aeLrTA off=11064064 len=151717 2024-01-13T18:36:31.692 INFO:tasks.workunit.client.0.smithi084.stdout:op 4586 completed, throughput=5MB/sec 2024-01-13T18:36:31.693 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-X4gztW5iuDIXgSM off=17666150 len=1470527 2024-01-13T18:36:31.699 INFO:tasks.workunit.client.0.smithi084.stdout:op 4587 completed, throughput=5MB/sec 2024-01-13T18:36:31.699 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ei7IjfU9FeRGxrr off=3358943 len=703956 2024-01-13T18:36:31.703 INFO:tasks.workunit.client.0.smithi084.stdout:op 4588 completed, throughput=5MB/sec 2024-01-13T18:36:31.703 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TP29iNbWiGhIOtS off=5525445 len=346208 2024-01-13T18:36:31.704 INFO:tasks.workunit.client.0.smithi084.stdout:op 4589 completed, throughput=5MB/sec 2024-01-13T18:36:31.704 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-G7lIvSfXMoWvo1_ off=137388 len=33595 2024-01-13T18:36:31.704 INFO:tasks.workunit.client.0.smithi084.stdout:op 4590 completed, throughput=5MB/sec 2024-01-13T18:36:31.704 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qj86rHBkuHLhgYf off=5617947 len=447978 2024-01-13T18:36:31.704 INFO:tasks.workunit.client.0.smithi084.stdout:op 4591 completed, throughput=5MB/sec 2024-01-13T18:36:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:31 smithi099 ceph-mon[138788]: pgmap v1941: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:36:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:36:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:36:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[116404]: pgmap v1941: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:36:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:36:31.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:36:31.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[119097]: pgmap v1941: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:36:31.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:31.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:36:31.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:36:31.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:36:32.705 INFO:tasks.workunit.client.0.smithi084.stdout: 911: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:32.705 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Qqt9eINZN6qV-z1 off=2120811 len=1674202 2024-01-13T18:36:32.712 INFO:tasks.workunit.client.0.smithi084.stdout:op 4592 completed, throughput=5MB/sec 2024-01-13T18:36:32.712 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MHP2GEuIcqDdyFm off=8403392 len=621221 2024-01-13T18:36:32.713 INFO:tasks.workunit.client.0.smithi084.stdout:op 4593 completed, throughput=5MB/sec 2024-01-13T18:36:32.713 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ceoc1_RfNaLjSh6 off=4749561 len=2019380 2024-01-13T18:36:32.717 INFO:tasks.workunit.client.0.smithi084.stdout:op 4594 completed, throughput=5MB/sec 2024-01-13T18:36:32.717 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-C1TO3Dq2yo2Bsb9 off=10686569 len=1238645 2024-01-13T18:36:32.719 INFO:tasks.workunit.client.0.smithi084.stdout:op 4595 completed, throughput=5MB/sec 2024-01-13T18:36:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:32 smithi084 ceph-mon[116404]: pgmap v1942: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:36:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:32 smithi084 ceph-mon[119097]: pgmap v1942: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:36:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:32 smithi099 ceph-mon[138788]: pgmap v1942: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:36:33.719 INFO:tasks.workunit.client.0.smithi084.stdout: 912: throughput=5MB/sec pending data=0 2024-01-13T18:36:33.719 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ksBGEGO1Q60o6KH off=20425548 len=586724 2024-01-13T18:36:33.720 INFO:tasks.workunit.client.0.smithi084.stdout:op 4596 completed, throughput=5MB/sec 2024-01-13T18:36:33.720 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0B5FMvnsY7AmTS4 off=1680171 len=1215925 2024-01-13T18:36:33.726 INFO:tasks.workunit.client.0.smithi084.stdout:op 4597 completed, throughput=5MB/sec 2024-01-13T18:36:33.726 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4oK4FKnkOp4IIOh off=6967454 len=1637670 2024-01-13T18:36:33.727 INFO:tasks.workunit.client.0.smithi084.stdout:op 4598 completed, throughput=5MB/sec 2024-01-13T18:36:33.728 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-U-86dC24-uEeXLL off=9533493 len=1362780 2024-01-13T18:36:33.732 INFO:tasks.workunit.client.0.smithi084.stdout:op 4599 completed, throughput=5MB/sec 2024-01-13T18:36:34.733 INFO:tasks.workunit.client.0.smithi084.stdout: 913: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:34.733 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JHgzua0l1YcaOIq off=2726591 len=409313 2024-01-13T18:36:34.736 INFO:tasks.workunit.client.0.smithi084.stdout:op 4600 completed, throughput=5MB/sec 2024-01-13T18:36:34.736 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g0Dcpb4oPa6g8UC off=8485647 len=514483 2024-01-13T18:36:34.737 INFO:tasks.workunit.client.0.smithi084.stdout:op 4601 completed, throughput=5MB/sec 2024-01-13T18:36:34.737 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wn0KGM60pkxOsa1 off=1378939 len=793317 2024-01-13T18:36:34.739 INFO:tasks.workunit.client.0.smithi084.stdout:op 4602 completed, throughput=5MB/sec 2024-01-13T18:36:34.739 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N2kDxRoHoUSG4MD off=884193 len=1577863 2024-01-13T18:36:34.741 INFO:tasks.workunit.client.0.smithi084.stdout:op 4603 completed, throughput=5MB/sec 2024-01-13T18:36:34.741 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3dZPqudIVBmuQvp off=7980691 len=1867325 2024-01-13T18:36:34.754 INFO:tasks.workunit.client.0.smithi084.stdout:op 4604 completed, throughput=5MB/sec 2024-01-13T18:36:34.754 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UuB_uwBvQoX1MUW off=9000559 len=1189223 2024-01-13T18:36:34.759 INFO:tasks.workunit.client.0.smithi084.stdout:op 4605 completed, throughput=5MB/sec 2024-01-13T18:36:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:34 smithi084 ceph-mon[116404]: pgmap v1943: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:36:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:34 smithi084 ceph-mon[119097]: pgmap v1943: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:36:35.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:34 smithi099 ceph-mon[138788]: pgmap v1943: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:36:35.760 INFO:tasks.workunit.client.0.smithi084.stdout: 914: throughput=5MB/sec pending data=0 2024-01-13T18:36:35.760 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8PMlaPV16fEAdsD off=254534 len=1022345 2024-01-13T18:36:35.766 INFO:tasks.workunit.client.0.smithi084.stdout:op 4606 completed, throughput=5MB/sec 2024-01-13T18:36:35.766 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Tbn2OU1_2fT5dH_ off=6668049 len=1044002 2024-01-13T18:36:35.771 INFO:tasks.workunit.client.0.smithi084.stdout:op 4607 completed, throughput=5MB/sec 2024-01-13T18:36:35.771 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WF02kfhjq6ip_dJ off=94435 len=485673 2024-01-13T18:36:35.773 INFO:tasks.workunit.client.0.smithi084.stdout:op 4608 completed, throughput=5MB/sec 2024-01-13T18:36:35.773 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fTo3fzdi4e47brg off=186333 len=1167054 2024-01-13T18:36:35.775 INFO:tasks.workunit.client.0.smithi084.stdout:op 4609 completed, throughput=5MB/sec 2024-01-13T18:36:35.775 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-A6_lUFxof03Y0cR off=0 len=1587379 2024-01-13T18:36:35.778 INFO:tasks.workunit.client.0.smithi084.stdout:op 4610 completed, throughput=5MB/sec 2024-01-13T18:36:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:36.778 INFO:tasks.workunit.client.0.smithi084.stdout: 915: throughput=5MB/sec pending data=0 2024-01-13T18:36:36.778 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TUMJ-c_gNOlyDi1 off=6638770 len=1055763 2024-01-13T18:36:36.783 INFO:tasks.workunit.client.0.smithi084.stdout:op 4611 completed, throughput=5MB/sec 2024-01-13T18:36:36.783 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4Z5qasLmFwKA8EL off=5186524 len=293791 2024-01-13T18:36:36.786 INFO:tasks.workunit.client.0.smithi084.stdout:op 4612 completed, throughput=5MB/sec 2024-01-13T18:36:36.786 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vBZ7H0S4qSV5v9i off=3956216 len=1997753 2024-01-13T18:36:36.788 INFO:tasks.workunit.client.0.smithi084.stdout:op 4613 completed, throughput=5MB/sec 2024-01-13T18:36:36.788 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Jlw8Icd2MYOaukR off=3965406 len=1013779 2024-01-13T18:36:36.789 INFO:tasks.workunit.client.0.smithi084.stdout:op 4614 completed, throughput=5MB/sec 2024-01-13T18:36:36.789 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2lwoSX6b9aybz9d off=1113023 len=332264 2024-01-13T18:36:36.790 INFO:tasks.workunit.client.0.smithi084.stdout:op 4615 completed, throughput=5MB/sec 2024-01-13T18:36:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:36 smithi084 ceph-mon[116404]: pgmap v1944: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:36:36.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:36 smithi084 ceph-mon[119097]: pgmap v1944: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:36:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:36 smithi099 ceph-mon[138788]: pgmap v1944: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:36:37.790 INFO:tasks.workunit.client.0.smithi084.stdout: 916: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:37.791 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gidiERcH9wWqOr5 off=7389756 len=991727 2024-01-13T18:36:37.792 INFO:tasks.workunit.client.0.smithi084.stdout:op 4616 completed, throughput=5MB/sec 2024-01-13T18:36:37.792 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xUelAWjJePfAlE_ off=18106485 len=762535 2024-01-13T18:36:37.793 INFO:tasks.workunit.client.0.smithi084.stdout:op 4617 completed, throughput=5MB/sec 2024-01-13T18:36:37.793 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fVzfXr7G6M35hFG off=4022917 len=1526183 2024-01-13T18:36:37.794 INFO:tasks.workunit.client.0.smithi084.stdout:op 4618 completed, throughput=5MB/sec 2024-01-13T18:36:37.794 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-i3PCBof78PiYz9- off=5682576 len=547832 2024-01-13T18:36:37.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 4619 completed, throughput=5MB/sec 2024-01-13T18:36:37.795 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bC-f0Ka94eo265F off=425851 len=693558 2024-01-13T18:36:37.799 INFO:tasks.workunit.client.0.smithi084.stdout:op 4620 completed, throughput=5MB/sec 2024-01-13T18:36:37.799 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4xy6Ons-gEFgh85 off=4171949 len=153452 2024-01-13T18:36:37.802 INFO:tasks.workunit.client.0.smithi084.stdout:op 4621 completed, throughput=5MB/sec 2024-01-13T18:36:37.802 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tlU4CceNpJQt-E0 off=8074830 len=1713284 2024-01-13T18:36:37.804 INFO:tasks.workunit.client.0.smithi084.stdout:op 4622 completed, throughput=5MB/sec 2024-01-13T18:36:38.804 INFO:tasks.workunit.client.0.smithi084.stdout: 917: throughput=5MB/sec pending data=0 2024-01-13T18:36:38.805 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-o9IJpxw4_QhQNQm off=7663045 len=1321111 2024-01-13T18:36:38.812 INFO:tasks.workunit.client.0.smithi084.stdout:op 4623 completed, throughput=5MB/sec 2024-01-13T18:36:38.812 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eU4xW_XAJJun17x off=2156037 len=1172880 2024-01-13T18:36:38.818 INFO:tasks.workunit.client.0.smithi084.stdout:op 4624 completed, throughput=5MB/sec 2024-01-13T18:36:38.818 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yvUSNIoD1HWth1O off=8059565 len=477096 2024-01-13T18:36:38.822 INFO:tasks.workunit.client.0.smithi084.stdout:op 4625 completed, throughput=5MB/sec 2024-01-13T18:36:38.822 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AV2oB_DA_vs87Am off=2084275 len=1901968 2024-01-13T18:36:38.831 INFO:tasks.workunit.client.0.smithi084.stdout:op 4626 completed, throughput=5MB/sec 2024-01-13T18:36:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:39 smithi099 ceph-mon[138788]: pgmap v1945: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:36:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:39 smithi084 ceph-mon[116404]: pgmap v1945: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:36:39.680 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:39 smithi084 ceph-mon[119097]: pgmap v1945: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:36:39.831 INFO:tasks.workunit.client.0.smithi084.stdout: 918: throughput=5MB/sec pending data=0 2024-01-13T18:36:39.831 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SfSqIDOy804mpa6 off=5652914 len=1960464 2024-01-13T18:36:39.841 INFO:tasks.workunit.client.0.smithi084.stdout:op 4627 completed, throughput=5MB/sec 2024-01-13T18:36:39.841 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PXVRqSCO8u0xHZS off=1781687 len=229320 2024-01-13T18:36:39.844 INFO:tasks.workunit.client.0.smithi084.stdout:op 4628 completed, throughput=5MB/sec 2024-01-13T18:36:39.844 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hd3Dkt_-QOcBns1 off=1438244 len=674976 2024-01-13T18:36:39.848 INFO:tasks.workunit.client.0.smithi084.stdout:op 4629 completed, throughput=5MB/sec 2024-01-13T18:36:39.848 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-d72DlRJkVonE1dR off=19944552 len=1126878 2024-01-13T18:36:39.850 INFO:tasks.workunit.client.0.smithi084.stdout:op 4630 completed, throughput=5MB/sec 2024-01-13T18:36:39.850 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nbK1G0BDqJvmHKF off=28116 len=899056 2024-01-13T18:36:39.851 INFO:tasks.workunit.client.0.smithi084.stdout:op 4631 completed, throughput=5MB/sec 2024-01-13T18:36:40.628 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:36:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:36:40] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:36:40.851 INFO:tasks.workunit.client.0.smithi084.stdout: 919: throughput=5MB/sec pending data=0 2024-01-13T18:36:40.851 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TeU91iTRivPql_0 off=308938 len=1127651 2024-01-13T18:36:40.853 INFO:tasks.workunit.client.0.smithi084.stdout:op 4632 completed, throughput=5MB/sec 2024-01-13T18:36:40.853 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4Xfx3ORxB5Qc2dL off=4208658 len=471592 2024-01-13T18:36:40.856 INFO:tasks.workunit.client.0.smithi084.stdout:op 4633 completed, throughput=5MB/sec 2024-01-13T18:36:40.856 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-STaWzjhNWUSfXW2 off=1167285 len=291276 2024-01-13T18:36:40.859 INFO:tasks.workunit.client.0.smithi084.stdout:op 4634 completed, throughput=5MB/sec 2024-01-13T18:36:40.859 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BDQHwlIbLi7H9W9 off=6041009 len=289699 2024-01-13T18:36:40.862 INFO:tasks.workunit.client.0.smithi084.stdout:op 4635 completed, throughput=5MB/sec 2024-01-13T18:36:40.862 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eaGjHC82nVtIj0A off=12169990 len=1913116 2024-01-13T18:36:40.872 INFO:tasks.workunit.client.0.smithi084.stdout:op 4636 completed, throughput=5MB/sec 2024-01-13T18:36:40.872 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cSEma5-QypCCZ98 off=139572 len=359015 2024-01-13T18:36:40.875 INFO:tasks.workunit.client.0.smithi084.stdout:op 4637 completed, throughput=5MB/sec 2024-01-13T18:36:40.875 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lZ1Ycb_LMyCRySn off=5249621 len=2091263 2024-01-13T18:36:40.877 INFO:tasks.workunit.client.0.smithi084.stdout:op 4638 completed, throughput=5MB/sec 2024-01-13T18:36:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:40 smithi084 ceph-mon[116404]: pgmap v1946: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:36:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:40 smithi084 ceph-mon[119097]: pgmap v1946: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:36:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:40 smithi099 ceph-mon[138788]: pgmap v1946: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:36:41.878 INFO:tasks.workunit.client.0.smithi084.stdout: 920: throughput=5MB/sec pending data=0 2024-01-13T18:36:41.878 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_c-utBqxjVa-B1D off=1814009 len=813010 2024-01-13T18:36:41.880 INFO:tasks.workunit.client.0.smithi084.stdout:op 4639 completed, throughput=5MB/sec 2024-01-13T18:36:41.880 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2X9U3vnm2I3h7jx off=6046688 len=538390 2024-01-13T18:36:41.884 INFO:tasks.workunit.client.0.smithi084.stdout:op 4640 completed, throughput=5MB/sec 2024-01-13T18:36:41.884 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RZH0kDjbIf4JOJ8 off=853269 len=2070854 2024-01-13T18:36:41.892 INFO:tasks.workunit.client.0.smithi084.stdout:op 4641 completed, throughput=5MB/sec 2024-01-13T18:36:41.892 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ubsgGh85JY4rWXA off=10386259 len=775889 2024-01-13T18:36:41.897 INFO:tasks.workunit.client.0.smithi084.stdout:op 4642 completed, throughput=5MB/sec 2024-01-13T18:36:42.897 INFO:tasks.workunit.client.0.smithi084.stdout: 921: throughput=5MB/sec pending data=0 2024-01-13T18:36:42.897 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RdMOiBPO1fTITx8 off=4136872 len=1878844 2024-01-13T18:36:42.907 INFO:tasks.workunit.client.0.smithi084.stdout:op 4643 completed, throughput=5MB/sec 2024-01-13T18:36:42.908 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zqPP0c8RwtlYSDS off=5882160 len=1027640 2024-01-13T18:36:42.912 INFO:tasks.workunit.client.0.smithi084.stdout:op 4644 completed, throughput=5MB/sec 2024-01-13T18:36:42.912 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2jZZH_YHQAAaUSA off=2756003 len=1641261 2024-01-13T18:36:42.914 INFO:tasks.workunit.client.0.smithi084.stdout:op 4645 completed, throughput=5MB/sec 2024-01-13T18:36:42.914 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hIpLr1NfHTK4HVg off=21481148 len=1393549 2024-01-13T18:36:42.916 INFO:tasks.workunit.client.0.smithi084.stdout:op 4646 completed, throughput=5MB/sec 2024-01-13T18:36:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:42 smithi084 ceph-mon[116404]: pgmap v1947: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:36:42.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:42 smithi084 ceph-mon[119097]: pgmap v1947: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:36:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:42 smithi099 ceph-mon[138788]: pgmap v1947: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:36:43.916 INFO:tasks.workunit.client.0.smithi084.stdout: 922: throughput=5MB/sec pending data=0 2024-01-13T18:36:43.916 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xElTUFjs7m5gXGP off=4310929 len=335954 2024-01-13T18:36:43.920 INFO:tasks.workunit.client.0.smithi084.stdout:op 4647 completed, throughput=5MB/sec 2024-01-13T18:36:43.920 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bCLNsX_7GO42zv2 off=1822313 len=1747564 2024-01-13T18:36:43.923 INFO:tasks.workunit.client.0.smithi084.stdout:op 4648 completed, throughput=5MB/sec 2024-01-13T18:36:43.923 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kKgAq_wxGZc64ig off=7674957 len=1796814 2024-01-13T18:36:43.934 INFO:tasks.workunit.client.0.smithi084.stdout:op 4649 completed, throughput=5MB/sec 2024-01-13T18:36:43.934 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LwcD_VnG2If_VHO off=840843 len=2053431 2024-01-13T18:36:43.938 INFO:tasks.workunit.client.0.smithi084.stdout:op 4650 completed, throughput=5MB/sec 2024-01-13T18:36:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:44 smithi084 ceph-mon[119097]: pgmap v1948: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:36:44.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:44 smithi084 ceph-mon[116404]: pgmap v1948: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:36:44.938 INFO:tasks.workunit.client.0.smithi084.stdout: 923: throughput=5MB/sec pending data=0 2024-01-13T18:36:44.938 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oUBa9oCmw6SSK9h off=3589285 len=1701153 2024-01-13T18:36:44.947 INFO:tasks.workunit.client.0.smithi084.stdout:op 4651 completed, throughput=5MB/sec 2024-01-13T18:36:44.947 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KIKXiGIc1QrED-R off=3616608 len=928273 2024-01-13T18:36:44.951 INFO:tasks.workunit.client.0.smithi084.stdout:op 4652 completed, throughput=5MB/sec 2024-01-13T18:36:44.951 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_bpQH8r6x8K0RPe off=5563451 len=1741717 2024-01-13T18:36:44.961 INFO:tasks.workunit.client.0.smithi084.stdout:op 4653 completed, throughput=5MB/sec 2024-01-13T18:36:45.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:44 smithi099 ceph-mon[138788]: pgmap v1948: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:36:45.962 INFO:tasks.workunit.client.0.smithi084.stdout: 924: throughput=5MB/sec pending data=0 2024-01-13T18:36:45.962 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wmu3VVKgxveOkRi off=4520628 len=184108 2024-01-13T18:36:45.965 INFO:tasks.workunit.client.0.smithi084.stdout:op 4654 completed, throughput=5MB/sec 2024-01-13T18:36:45.965 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jrbxGBuj35tu3te off=16661206 len=1747756 2024-01-13T18:36:45.967 INFO:tasks.workunit.client.0.smithi084.stdout:op 4655 completed, throughput=5MB/sec 2024-01-13T18:36:45.967 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n36b4W3M5pAF1LW off=5592774 len=359457 2024-01-13T18:36:45.970 INFO:tasks.workunit.client.0.smithi084.stdout:op 4656 completed, throughput=5MB/sec 2024-01-13T18:36:45.970 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mvqSvTi4gQZ1vVx off=797626 len=1691153 2024-01-13T18:36:45.977 INFO:tasks.workunit.client.0.smithi084.stdout:op 4657 completed, throughput=5MB/sec 2024-01-13T18:36:45.977 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Nbhn6EqR4g6cNlf off=5828622 len=1938753 2024-01-13T18:36:45.981 INFO:tasks.workunit.client.0.smithi084.stdout:op 4658 completed, throughput=5MB/sec 2024-01-13T18:36:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:46 smithi084 ceph-mon[119097]: pgmap v1949: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:36:46.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:46 smithi084 ceph-mon[116404]: pgmap v1949: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:36:46.981 INFO:tasks.workunit.client.0.smithi084.stdout: 925: throughput=5MB/sec pending data=0 2024-01-13T18:36:46.981 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-49nkjHJjJJUN43c off=5685987 len=1445385 2024-01-13T18:36:46.984 INFO:tasks.workunit.client.0.smithi084.stdout:op 4659 completed, throughput=5MB/sec 2024-01-13T18:36:46.984 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-o8mQRyPtkzPksE4 off=7523528 len=390006 2024-01-13T18:36:46.985 INFO:tasks.workunit.client.0.smithi084.stdout:op 4660 completed, throughput=5MB/sec 2024-01-13T18:36:46.985 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qcnphd9lPJW5gFP off=1495858 len=360586 2024-01-13T18:36:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:op 4661 completed, throughput=5MB/sec 2024-01-13T18:36:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-l8ULaFv4_00ZZCN off=1303856 len=768629 2024-01-13T18:36:46.995 INFO:tasks.workunit.client.0.smithi084.stdout:op 4662 completed, throughput=5MB/sec 2024-01-13T18:36:46.995 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ll0at-XslbQq_02 off=2440045 len=1740473 2024-01-13T18:36:47.003 INFO:tasks.workunit.client.0.smithi084.stdout:op 4663 completed, throughput=5MB/sec 2024-01-13T18:36:47.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:46 smithi099 ceph-mon[138788]: pgmap v1949: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:36:48.003 INFO:tasks.workunit.client.0.smithi084.stdout: 926: throughput=5MB/sec pending data=0 2024-01-13T18:36:48.003 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-77yh0w1nqGVOTIJ off=4432449 len=1009395 2024-01-13T18:36:48.004 INFO:tasks.workunit.client.0.smithi084.stdout:op 4664 completed, throughput=5MB/sec 2024-01-13T18:36:48.004 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UAzTiw1aCsgTrTD off=2574816 len=675848 2024-01-13T18:36:48.005 INFO:tasks.workunit.client.0.smithi084.stdout:op 4665 completed, throughput=5MB/sec 2024-01-13T18:36:48.006 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7qDUCatgbxihTj- off=10326401 len=844578 2024-01-13T18:36:48.007 INFO:tasks.workunit.client.0.smithi084.stdout:op 4666 completed, throughput=5MB/sec 2024-01-13T18:36:48.007 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ygus8lHFL0mOI_V off=19557368 len=597462 2024-01-13T18:36:48.011 INFO:tasks.workunit.client.0.smithi084.stdout:op 4667 completed, throughput=5MB/sec 2024-01-13T18:36:48.011 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6UkiQnXg7zP6SBN off=4846212 len=1770824 2024-01-13T18:36:48.020 INFO:tasks.workunit.client.0.smithi084.stdout:op 4668 completed, throughput=5MB/sec 2024-01-13T18:36:49.020 INFO:tasks.workunit.client.0.smithi084.stdout: 927: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:49.021 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yUF1BE0Mhk8RKS4 off=5029014 len=1484671 2024-01-13T18:36:49.022 INFO:tasks.workunit.client.0.smithi084.stdout:op 4669 completed, throughput=5MB/sec 2024-01-13T18:36:49.022 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-o-7tfoSoWHY2ONr off=11827526 len=2024375 2024-01-13T18:36:49.024 INFO:tasks.workunit.client.0.smithi084.stdout:op 4670 completed, throughput=5MB/sec 2024-01-13T18:36:49.024 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-B_i7Ef6HuW73u8K off=3343113 len=1413927 2024-01-13T18:36:49.026 INFO:tasks.workunit.client.0.smithi084.stdout:op 4671 completed, throughput=5MB/sec 2024-01-13T18:36:49.026 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QSSqsXTdVyGamVN off=1100096 len=1490391 2024-01-13T18:36:49.036 INFO:tasks.workunit.client.0.smithi084.stdout:op 4672 completed, throughput=5MB/sec 2024-01-13T18:36:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:49 smithi099 ceph-mon[138788]: pgmap v1950: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:49.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:49 smithi084 ceph-mon[119097]: pgmap v1950: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:49.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:49 smithi084 ceph-mon[116404]: pgmap v1950: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:50.036 INFO:tasks.workunit.client.0.smithi084.stdout: 928: throughput=5MB/sec pending data=0 2024-01-13T18:36:50.036 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dCUwVpDNwHt-xr_ off=20419412 len=1086323 2024-01-13T18:36:50.041 INFO:tasks.workunit.client.0.smithi084.stdout:op 4673 completed, throughput=5MB/sec 2024-01-13T18:36:50.042 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UhsP3WzF_xGTGuX off=2769755 len=196826 2024-01-13T18:36:50.042 INFO:tasks.workunit.client.0.smithi084.stdout:op 4674 completed, throughput=5MB/sec 2024-01-13T18:36:50.042 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pDnAMYo6lVWGD6V off=2116935 len=598003 2024-01-13T18:36:50.043 INFO:tasks.workunit.client.0.smithi084.stdout:op 4675 completed, throughput=5MB/sec 2024-01-13T18:36:50.044 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WLWovPYe93G0qib off=13376377 len=1028447 2024-01-13T18:36:50.049 INFO:tasks.workunit.client.0.smithi084.stdout:op 4676 completed, throughput=5MB/sec 2024-01-13T18:36:50.049 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NhgWKjVZJoWK13i off=924444 len=938366 2024-01-13T18:36:50.051 INFO:tasks.workunit.client.0.smithi084.stdout:op 4677 completed, throughput=5MB/sec 2024-01-13T18:36:50.051 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iholfeHAfQAwvsF off=679311 len=1933721 2024-01-13T18:36:50.061 INFO:tasks.workunit.client.0.smithi084.stdout:op 4678 completed, throughput=5MB/sec 2024-01-13T18:36:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:50.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:36:50.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:36:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:36:50] "GET /metrics HTTP/1.1" 200 33995 "" "Prometheus/2.43.0" 2024-01-13T18:36:51.062 INFO:tasks.workunit.client.0.smithi084.stdout: 929: throughput=5MB/sec pending data=0 2024-01-13T18:36:51.062 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GJW65-9upERx4oQ off=5621376 len=1334583 2024-01-13T18:36:51.063 INFO:tasks.workunit.client.0.smithi084.stdout:op 4679 completed, throughput=5MB/sec 2024-01-13T18:36:51.063 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Nlq9B-oHHgHDTQA off=15760743 len=1689242 2024-01-13T18:36:51.072 INFO:tasks.workunit.client.0.smithi084.stdout:op 4680 completed, throughput=5MB/sec 2024-01-13T18:36:51.072 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cnMfr3PP2gj8aa8 off=3458151 len=904625 2024-01-13T18:36:51.073 INFO:tasks.workunit.client.0.smithi084.stdout:op 4681 completed, throughput=5MB/sec 2024-01-13T18:36:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:51 smithi099 ceph-mon[138788]: pgmap v1951: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:36:51.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:51 smithi084 ceph-mon[116404]: pgmap v1951: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:36:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:51 smithi084 ceph-mon[119097]: pgmap v1951: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:36:52.073 INFO:tasks.workunit.client.0.smithi084.stdout: 930: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:52.073 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XkB1HofZuWdJa2o off=13261949 len=626111 2024-01-13T18:36:52.077 INFO:tasks.workunit.client.0.smithi084.stdout:op 4682 completed, throughput=5MB/sec 2024-01-13T18:36:52.077 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uWhZvMrgL7kNys7 off=4498896 len=1262824 2024-01-13T18:36:52.079 INFO:tasks.workunit.client.0.smithi084.stdout:op 4683 completed, throughput=5MB/sec 2024-01-13T18:36:52.079 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fK9vcvm04a8zaQS off=2704332 len=52116 2024-01-13T18:36:52.081 INFO:tasks.workunit.client.0.smithi084.stdout:op 4684 completed, throughput=5MB/sec 2024-01-13T18:36:52.081 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UqOyBF0Jb7OjkZG off=13793749 len=1662073 2024-01-13T18:36:52.084 INFO:tasks.workunit.client.0.smithi084.stdout:op 4685 completed, throughput=5MB/sec 2024-01-13T18:36:52.085 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jY1jxSzoDqozvga off=1945936 len=1208872 2024-01-13T18:36:52.091 INFO:tasks.workunit.client.0.smithi084.stdout:op 4686 completed, throughput=5MB/sec 2024-01-13T18:36:52.091 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ccUbhtTsJFKoJm5 off=2882877 len=847590 2024-01-13T18:36:52.092 INFO:tasks.workunit.client.0.smithi084.stdout:op 4687 completed, throughput=5MB/sec 2024-01-13T18:36:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:52 smithi084 ceph-mon[116404]: pgmap v1952: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:52 smithi084 ceph-mon[119097]: pgmap v1952: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:53.092 INFO:tasks.workunit.client.0.smithi084.stdout: 931: throughput=5MB/sec pending data=0 2024-01-13T18:36:53.093 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-F0N4I1jeKj1AXhS off=2894451 len=1123052 2024-01-13T18:36:53.095 INFO:tasks.workunit.client.0.smithi084.stdout:op 4688 completed, throughput=5MB/sec 2024-01-13T18:36:53.095 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pJRwFMNEFeyZ1xm off=12379155 len=604665 2024-01-13T18:36:53.099 INFO:tasks.workunit.client.0.smithi084.stdout:op 4689 completed, throughput=5MB/sec 2024-01-13T18:36:53.099 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LpgLqOiBAd8TJnX off=762521 len=1664206 2024-01-13T18:36:53.109 INFO:tasks.workunit.client.0.smithi084.stdout:op 4690 completed, throughput=5MB/sec 2024-01-13T18:36:53.109 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XfjIzisAC2Krufd off=7331708 len=1303206 2024-01-13T18:36:53.111 INFO:tasks.workunit.client.0.smithi084.stdout:op 4691 completed, throughput=5MB/sec 2024-01-13T18:36:53.111 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-F2G-_1YBZEu5wXR off=2357600 len=754086 2024-01-13T18:36:53.115 INFO:tasks.workunit.client.0.smithi084.stdout:op 4692 completed, throughput=5MB/sec 2024-01-13T18:36:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:52 smithi099 ceph-mon[138788]: pgmap v1952: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:36:54.116 INFO:tasks.workunit.client.0.smithi084.stdout: 932: throughput=5MB/sec pending data=0 2024-01-13T18:36:54.116 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4SZh3PdJL51c3wF off=3441415 len=385239 2024-01-13T18:36:54.120 INFO:tasks.workunit.client.0.smithi084.stdout:op 4693 completed, throughput=5MB/sec 2024-01-13T18:36:54.120 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2iKyvT_9b026c7o off=9962052 len=1633081 2024-01-13T18:36:54.122 INFO:tasks.workunit.client.0.smithi084.stdout:op 4694 completed, throughput=5MB/sec 2024-01-13T18:36:54.122 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-91O11Ddb3bOQ8fv off=5466401 len=1234547 2024-01-13T18:36:54.130 INFO:tasks.workunit.client.0.smithi084.stdout:op 4695 completed, throughput=5MB/sec 2024-01-13T18:36:54.130 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-b8N4iScKk9oYhEF off=8682974 len=791828 2024-01-13T18:36:54.134 INFO:tasks.workunit.client.0.smithi084.stdout:op 4696 completed, throughput=5MB/sec 2024-01-13T18:36:54.134 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zhwUs4-S4OaM1SN off=12132530 len=253885 2024-01-13T18:36:54.134 INFO:tasks.workunit.client.0.smithi084.stdout:op 4697 completed, throughput=5MB/sec 2024-01-13T18:36:54.135 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-spETRc6BffzClUB off=5219615 len=1292151 2024-01-13T18:36:54.136 INFO:tasks.workunit.client.0.smithi084.stdout:op 4698 completed, throughput=5MB/sec 2024-01-13T18:36:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:54 smithi084 ceph-mon[116404]: pgmap v1953: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:36:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:54 smithi084 ceph-mon[119097]: pgmap v1953: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:36:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:54 smithi099 ceph-mon[138788]: pgmap v1953: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:36:55.136 INFO:tasks.workunit.client.0.smithi084.stdout: 933: throughput=5MB/sec pending data=0 2024-01-13T18:36:55.136 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vQm2my17A5t2ewd off=6602353 len=1735853 2024-01-13T18:36:55.144 INFO:tasks.workunit.client.0.smithi084.stdout:op 4699 completed, throughput=5MB/sec 2024-01-13T18:36:55.144 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-W3AOyIqNfajXwTJ off=20464 len=1753163 2024-01-13T18:36:55.154 INFO:tasks.workunit.client.0.smithi084.stdout:op 4700 completed, throughput=5MB/sec 2024-01-13T18:36:55.154 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LLSr109J13TigA5 off=16058262 len=72483 2024-01-13T18:36:55.154 INFO:tasks.workunit.client.0.smithi084.stdout:op 4701 completed, throughput=5MB/sec 2024-01-13T18:36:55.154 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Glou3jrWWSFuf8Z off=4103288 len=809448 2024-01-13T18:36:55.156 INFO:tasks.workunit.client.0.smithi084.stdout:op 4702 completed, throughput=5MB/sec 2024-01-13T18:36:55.156 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XRf4LY1xc5c0t1a off=10083674 len=708369 2024-01-13T18:36:55.160 INFO:tasks.workunit.client.0.smithi084.stdout:op 4703 completed, throughput=5MB/sec 2024-01-13T18:36:56.160 INFO:tasks.workunit.client.0.smithi084.stdout: 934: throughput=5MB/sec pending data=0 2024-01-13T18:36:56.160 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-B_i7Ef6HuW73u8K off=2330298 len=1258941 2024-01-13T18:36:56.167 INFO:tasks.workunit.client.0.smithi084.stdout:op 4704 completed, throughput=5MB/sec 2024-01-13T18:36:56.167 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8i8dNLVCGZHn3Zf off=1467535 len=1093507 2024-01-13T18:36:56.168 INFO:tasks.workunit.client.0.smithi084.stdout:op 4705 completed, throughput=5MB/sec 2024-01-13T18:36:56.168 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SN3BU1RIifyCTB2 off=23665794 len=382470 2024-01-13T18:36:56.169 INFO:tasks.workunit.client.0.smithi084.stdout:op 4706 completed, throughput=5MB/sec 2024-01-13T18:36:56.169 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mySipoVrKhyovdC off=8489133 len=740131 2024-01-13T18:36:56.173 INFO:tasks.workunit.client.0.smithi084.stdout:op 4707 completed, throughput=5MB/sec 2024-01-13T18:36:56.173 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e1BEjOilEbLyVRQ off=49361 len=1785231 2024-01-13T18:36:56.182 INFO:tasks.workunit.client.0.smithi084.stdout:op 4708 completed, throughput=5MB/sec 2024-01-13T18:36:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:56 smithi084 ceph-mon[116404]: pgmap v1954: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:36:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:56 smithi084 ceph-mon[119097]: pgmap v1954: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:36:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:56 smithi099 ceph-mon[138788]: pgmap v1954: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:36:57.182 INFO:tasks.workunit.client.0.smithi084.stdout: 935: throughput=5MB/sec pending data=0 2024-01-13T18:36:57.183 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3kxGUu9UxXw0KrK off=65372 len=1541261 2024-01-13T18:36:57.192 INFO:tasks.workunit.client.0.smithi084.stdout:op 4709 completed, throughput=5MB/sec 2024-01-13T18:36:57.192 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hJ1RvwROPoRZPFR off=4988459 len=1701629 2024-01-13T18:36:57.195 INFO:tasks.workunit.client.0.smithi084.stdout:op 4710 completed, throughput=5MB/sec 2024-01-13T18:36:57.195 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SEBOFc8JWhrrIBe off=2986390 len=323633 2024-01-13T18:36:57.199 INFO:tasks.workunit.client.0.smithi084.stdout:op 4711 completed, throughput=5MB/sec 2024-01-13T18:36:57.199 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Q1_2xuLphzIFjwn off=8911663 len=1858916 2024-01-13T18:36:57.206 INFO:tasks.workunit.client.0.smithi084.stdout:op 4712 completed, throughput=5MB/sec 2024-01-13T18:36:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: 936: throughput=5MB/sec pending data=0 2024-01-13T18:36:58.207 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Hdjtssn8ZsjhTei off=496074 len=1408788 2024-01-13T18:36:58.208 INFO:tasks.workunit.client.0.smithi084.stdout:op 4713 completed, throughput=5MB/sec 2024-01-13T18:36:58.209 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-28fXtJ2AVT5UBIC off=492268 len=1559510 2024-01-13T18:36:58.210 INFO:tasks.workunit.client.0.smithi084.stdout:op 4714 completed, throughput=5MB/sec 2024-01-13T18:36:58.210 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tZZYbygyXKvgt8b off=20971769 len=1102681 2024-01-13T18:36:58.212 INFO:tasks.workunit.client.0.smithi084.stdout:op 4715 completed, throughput=5MB/sec 2024-01-13T18:36:58.212 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PHfagXZK6ERaWzY off=10295870 len=904631 2024-01-13T18:36:58.216 INFO:tasks.workunit.client.0.smithi084.stdout:op 4716 completed, throughput=5MB/sec 2024-01-13T18:36:59.217 INFO:tasks.workunit.client.0.smithi084.stdout: 937: throughput=4.99MB/sec pending data=0 2024-01-13T18:36:59.217 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YGsDuvJhwzoCZ42 off=18766874 len=1191516 2024-01-13T18:36:59.218 INFO:tasks.workunit.client.0.smithi084.stdout:op 4717 completed, throughput=5MB/sec 2024-01-13T18:36:59.218 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ePelxXgl7WSNrxN off=1137770 len=1726608 2024-01-13T18:36:59.222 INFO:tasks.workunit.client.0.smithi084.stdout:op 4718 completed, throughput=5MB/sec 2024-01-13T18:36:59.222 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KWZCIMaApsfHrvz off=5493469 len=1463218 2024-01-13T18:36:59.223 INFO:tasks.workunit.client.0.smithi084.stdout:op 4719 completed, throughput=5MB/sec 2024-01-13T18:36:59.223 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--fUtohQXx2bskrJ off=197070 len=671340 2024-01-13T18:36:59.224 INFO:tasks.workunit.client.0.smithi084.stdout:op 4720 completed, throughput=5MB/sec 2024-01-13T18:36:59.224 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Em0y1JhbhHBLYnM off=2549842 len=243669 2024-01-13T18:36:59.225 INFO:tasks.workunit.client.0.smithi084.stdout:op 4721 completed, throughput=5MB/sec 2024-01-13T18:36:59.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:36:59 smithi099 ceph-mon[138788]: pgmap v1955: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:36:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:36:59 smithi084 ceph-mon[116404]: pgmap v1955: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:36:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:36:59 smithi084 ceph-mon[119097]: pgmap v1955: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:37:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: 938: throughput=4.99MB/sec pending data=0 2024-01-13T18:37:00.225 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UOgzvpguLhpqcbK off=8414791 len=486578 2024-01-13T18:37:00.227 INFO:tasks.workunit.client.0.smithi084.stdout:op 4722 completed, throughput=5MB/sec 2024-01-13T18:37:00.227 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bfBbmraeguSdDKZ off=14200757 len=604422 2024-01-13T18:37:00.229 INFO:tasks.workunit.client.0.smithi084.stdout:op 4723 completed, throughput=5MB/sec 2024-01-13T18:37:00.229 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8yIY5l3sNfeHTmB off=21111717 len=1767365 2024-01-13T18:37:00.238 INFO:tasks.workunit.client.0.smithi084.stdout:op 4724 completed, throughput=5MB/sec 2024-01-13T18:37:00.238 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WFJQQl0zHYt4CFs off=3604802 len=2015668 2024-01-13T18:37:00.241 INFO:tasks.workunit.client.0.smithi084.stdout:op 4725 completed, throughput=5MB/sec 2024-01-13T18:37:00.241 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wZF0jpXhyrC6lig off=957452 len=1198255 2024-01-13T18:37:00.249 INFO:tasks.workunit.client.0.smithi084.stdout:op 4726 completed, throughput=5MB/sec 2024-01-13T18:37:00.630 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:37:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:37:00] "GET /metrics HTTP/1.1" 200 33995 "" "Prometheus/2.43.0" 2024-01-13T18:37:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:00 smithi084 ceph-mon[116404]: pgmap v1956: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:37:00.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:00 smithi084 ceph-mon[119097]: pgmap v1956: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:37:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:00 smithi099 ceph-mon[138788]: pgmap v1956: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:37:01.249 INFO:tasks.workunit.client.0.smithi084.stdout: 939: throughput=5MB/sec pending data=0 2024-01-13T18:37:01.249 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CMBtsMnneNQWQUH off=1654685 len=1825444 2024-01-13T18:37:01.251 INFO:tasks.workunit.client.0.smithi084.stdout:op 4727 completed, throughput=5MB/sec 2024-01-13T18:37:01.252 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cDqmNoTbQsQNnty off=21019931 len=1077236 2024-01-13T18:37:01.258 INFO:tasks.workunit.client.0.smithi084.stdout:op 4728 completed, throughput=5MB/sec 2024-01-13T18:37:01.258 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-seOInI_oHkoMdCt off=16982796 len=1416126 2024-01-13T18:37:01.266 INFO:tasks.workunit.client.0.smithi084.stdout:op 4729 completed, throughput=5MB/sec 2024-01-13T18:37:01.266 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-88VKLJWtCE84dJf off=1064306 len=588643 2024-01-13T18:37:01.267 INFO:tasks.workunit.client.0.smithi084.stdout:op 4730 completed, throughput=5MB/sec 2024-01-13T18:37:02.267 INFO:tasks.workunit.client.0.smithi084.stdout: 940: throughput=5MB/sec pending data=0 2024-01-13T18:37:02.268 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jZjUdTCTuUYZrkI off=22384407 len=1146603 2024-01-13T18:37:02.270 INFO:tasks.workunit.client.0.smithi084.stdout:op 4731 completed, throughput=5MB/sec 2024-01-13T18:37:02.270 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ra9cilGLCJpDb5g off=16153267 len=105693 2024-01-13T18:37:02.270 INFO:tasks.workunit.client.0.smithi084.stdout:op 4732 completed, throughput=5MB/sec 2024-01-13T18:37:02.270 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fwJJZIYk2z7dmhP off=1055663 len=368258 2024-01-13T18:37:02.273 INFO:tasks.workunit.client.0.smithi084.stdout:op 4733 completed, throughput=5MB/sec 2024-01-13T18:37:02.273 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TfgLh2pT2oDuhJ6 off=13538697 len=1477502 2024-01-13T18:37:02.281 INFO:tasks.workunit.client.0.smithi084.stdout:op 4734 completed, throughput=5MB/sec 2024-01-13T18:37:02.281 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jcsESCFuBrFIAUz off=5548646 len=1109090 2024-01-13T18:37:02.286 INFO:tasks.workunit.client.0.smithi084.stdout:op 4735 completed, throughput=5MB/sec 2024-01-13T18:37:02.286 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LOJHFHekd3qMxd3 off=2192349 len=1100485 2024-01-13T18:37:02.291 INFO:tasks.workunit.client.0.smithi084.stdout:op 4736 completed, throughput=5MB/sec 2024-01-13T18:37:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:02 smithi084 ceph-mon[116404]: pgmap v1957: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:37:02.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:02 smithi084 ceph-mon[119097]: pgmap v1957: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:37:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:02 smithi099 ceph-mon[138788]: pgmap v1957: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:37:03.292 INFO:tasks.workunit.client.0.smithi084.stdout: 941: throughput=5MB/sec pending data=0 2024-01-13T18:37:03.292 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zB4DJG98-MsuK-U off=12949797 len=471389 2024-01-13T18:37:03.296 INFO:tasks.workunit.client.0.smithi084.stdout:op 4737 completed, throughput=5MB/sec 2024-01-13T18:37:03.296 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5ejuDJGbw6baKnf off=10607530 len=117255 2024-01-13T18:37:03.298 INFO:tasks.workunit.client.0.smithi084.stdout:op 4738 completed, throughput=5MB/sec 2024-01-13T18:37:03.298 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gQ4UstZmubzl62j off=15064116 len=1760227 2024-01-13T18:37:03.300 INFO:tasks.workunit.client.0.smithi084.stdout:op 4739 completed, throughput=5MB/sec 2024-01-13T18:37:03.300 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rW1ZVmm_Uv4V7Lg off=545393 len=337055 2024-01-13T18:37:03.303 INFO:tasks.workunit.client.0.smithi084.stdout:op 4740 completed, throughput=5MB/sec 2024-01-13T18:37:03.303 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-64GUZDJCNCbJPlu off=17219936 len=155748 2024-01-13T18:37:03.304 INFO:tasks.workunit.client.0.smithi084.stdout:op 4741 completed, throughput=5MB/sec 2024-01-13T18:37:03.304 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZTJv-YjwZrQ9KYb off=19552518 len=612050 2024-01-13T18:37:03.305 INFO:tasks.workunit.client.0.smithi084.stdout:op 4742 completed, throughput=5MB/sec 2024-01-13T18:37:03.305 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mFJ0Fd1AtAWEL0k off=13204516 len=1836710 2024-01-13T18:37:03.307 INFO:tasks.workunit.client.0.smithi084.stdout:op 4743 completed, throughput=5MB/sec 2024-01-13T18:37:04.308 INFO:tasks.workunit.client.0.smithi084.stdout: 942: throughput=5MB/sec pending data=0 2024-01-13T18:37:04.308 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--ZQvJa4dtznplNc off=9919441 len=628334 2024-01-13T18:37:04.312 INFO:tasks.workunit.client.0.smithi084.stdout:op 4744 completed, throughput=5MB/sec 2024-01-13T18:37:04.312 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vM6FXbLXnNI0aLB off=7885438 len=749756 2024-01-13T18:37:04.317 INFO:tasks.workunit.client.0.smithi084.stdout:op 4745 completed, throughput=5MB/sec 2024-01-13T18:37:04.317 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OtUFl83N-wQ1dM2 off=5478406 len=683137 2024-01-13T18:37:04.318 INFO:tasks.workunit.client.0.smithi084.stdout:op 4746 completed, throughput=5MB/sec 2024-01-13T18:37:04.318 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sHszWjbX5r7Txrn off=970375 len=98200 2024-01-13T18:37:04.318 INFO:tasks.workunit.client.0.smithi084.stdout:op 4747 completed, throughput=5MB/sec 2024-01-13T18:37:04.318 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7rNFm8JdEsSelEW off=3528977 len=13843 2024-01-13T18:37:04.319 INFO:tasks.workunit.client.0.smithi084.stdout:op 4748 completed, throughput=5MB/sec 2024-01-13T18:37:04.319 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DOKrbki8Zl_r_LO off=11746232 len=264914 2024-01-13T18:37:04.322 INFO:tasks.workunit.client.0.smithi084.stdout:op 4749 completed, throughput=5MB/sec 2024-01-13T18:37:04.322 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MpbldxQk5UlWsqZ off=6470377 len=635563 2024-01-13T18:37:04.323 INFO:tasks.workunit.client.0.smithi084.stdout:op 4750 completed, throughput=5MB/sec 2024-01-13T18:37:04.323 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ySWO55sakSujVGd off=6413391 len=1236884 2024-01-13T18:37:04.325 INFO:tasks.workunit.client.0.smithi084.stdout:op 4751 completed, throughput=5MB/sec 2024-01-13T18:37:04.325 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KsEdxRcawCs1-19 off=8637339 len=147864 2024-01-13T18:37:04.325 INFO:tasks.workunit.client.0.smithi084.stdout:op 4752 completed, throughput=5MB/sec 2024-01-13T18:37:04.325 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-F_XwNjpYrA8Xr5E off=3429326 len=1015121 2024-01-13T18:37:04.330 INFO:tasks.workunit.client.0.smithi084.stdout:op 4753 completed, throughput=5MB/sec 2024-01-13T18:37:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:04 smithi084 ceph-mon[116404]: pgmap v1958: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:37:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:04 smithi084 ceph-mon[119097]: pgmap v1958: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:37:05.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:04 smithi099 ceph-mon[138788]: pgmap v1958: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:37:05.331 INFO:tasks.workunit.client.0.smithi084.stdout: 943: throughput=5MB/sec pending data=0 2024-01-13T18:37:05.331 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mrBxfu7RiGgZQK5 off=0 len=1372578 2024-01-13T18:37:05.332 INFO:tasks.workunit.client.0.smithi084.stdout:op 4754 completed, throughput=5MB/sec 2024-01-13T18:37:05.332 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lodWvvPvyYe5zj4 off=3979561 len=866552 2024-01-13T18:37:05.337 INFO:tasks.workunit.client.0.smithi084.stdout:op 4755 completed, throughput=5MB/sec 2024-01-13T18:37:05.337 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MniyvQusVOK2pPj off=2338959 len=1045098 2024-01-13T18:37:05.338 INFO:tasks.workunit.client.0.smithi084.stdout:op 4756 completed, throughput=5MB/sec 2024-01-13T18:37:05.338 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ceAWgkiLXlfW_aC off=9692537 len=1044516 2024-01-13T18:37:05.339 INFO:tasks.workunit.client.0.smithi084.stdout:op 4757 completed, throughput=5MB/sec 2024-01-13T18:37:05.340 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-i4syu4rL7S-OaqR off=11204391 len=672680 2024-01-13T18:37:05.343 INFO:tasks.workunit.client.0.smithi084.stdout:op 4758 completed, throughput=5MB/sec 2024-01-13T18:37:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:06.343 INFO:tasks.workunit.client.0.smithi084.stdout: 944: throughput=5MB/sec pending data=0 2024-01-13T18:37:06.343 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-D8Fttg9r4QkbpDv off=1121343 len=1941102 2024-01-13T18:37:06.346 INFO:tasks.workunit.client.0.smithi084.stdout:op 4759 completed, throughput=5MB/sec 2024-01-13T18:37:06.346 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QFQxXZt1oDIxujz off=9991219 len=1915307 2024-01-13T18:37:06.356 INFO:tasks.workunit.client.0.smithi084.stdout:op 4760 completed, throughput=5MB/sec 2024-01-13T18:37:06.356 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qochYJznAAgS9YE off=2266379 len=858769 2024-01-13T18:37:06.358 INFO:tasks.workunit.client.0.smithi084.stdout:op 4761 completed, throughput=5MB/sec 2024-01-13T18:37:06.358 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tHuq0NOPTzUXwFw off=1070105 len=554433 2024-01-13T18:37:06.362 INFO:tasks.workunit.client.0.smithi084.stdout:op 4762 completed, throughput=5MB/sec 2024-01-13T18:37:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:06 smithi084 ceph-mon[116404]: pgmap v1959: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:37:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:06 smithi084 ceph-mon[119097]: pgmap v1959: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:37:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:06 smithi099 ceph-mon[138788]: pgmap v1959: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:37:07.362 INFO:tasks.workunit.client.0.smithi084.stdout: 945: throughput=4.99MB/sec pending data=0 2024-01-13T18:37:07.363 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-D3dsv_RtHihsb_G off=6000367 len=1770476 2024-01-13T18:37:07.373 INFO:tasks.workunit.client.0.smithi084.stdout:op 4763 completed, throughput=5MB/sec 2024-01-13T18:37:07.373 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZI7jgqzNlLwcg3U off=860375 len=162677 2024-01-13T18:37:07.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 4764 completed, throughput=5MB/sec 2024-01-13T18:37:07.376 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xG83VH0RT5OstQi off=1395936 len=1094714 2024-01-13T18:37:07.377 INFO:tasks.workunit.client.0.smithi084.stdout:op 4765 completed, throughput=5MB/sec 2024-01-13T18:37:07.377 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OyivRpl9WWbszZS off=22125777 len=203783 2024-01-13T18:37:07.378 INFO:tasks.workunit.client.0.smithi084.stdout:op 4766 completed, throughput=5MB/sec 2024-01-13T18:37:07.378 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iTovHaDXG1F480t off=13572630 len=910759 2024-01-13T18:37:07.383 INFO:tasks.workunit.client.0.smithi084.stdout:op 4767 completed, throughput=5MB/sec 2024-01-13T18:37:07.383 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HFo9RLbhrt7qZaS off=4816729 len=839445 2024-01-13T18:37:07.384 INFO:tasks.workunit.client.0.smithi084.stdout:op 4768 completed, throughput=5MB/sec 2024-01-13T18:37:07.384 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QQWLKblXzYVjtoB off=4932221 len=575044 2024-01-13T18:37:07.388 INFO:tasks.workunit.client.0.smithi084.stdout:op 4769 completed, throughput=5MB/sec 2024-01-13T18:37:08.388 INFO:tasks.workunit.client.0.smithi084.stdout: 946: throughput=5MB/sec pending data=0 2024-01-13T18:37:08.388 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-48YFQzvbohlyecA off=5824494 len=1121568 2024-01-13T18:37:08.390 INFO:tasks.workunit.client.0.smithi084.stdout:op 4770 completed, throughput=5MB/sec 2024-01-13T18:37:08.390 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0jIViYfY3ovqRor off=17406002 len=456182 2024-01-13T18:37:08.390 INFO:tasks.workunit.client.0.smithi084.stdout:op 4771 completed, throughput=5MB/sec 2024-01-13T18:37:08.390 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3Bo5N2U2tJCfA3P off=778622 len=1446462 2024-01-13T18:37:08.394 INFO:tasks.workunit.client.0.smithi084.stdout:op 4772 completed, throughput=5MB/sec 2024-01-13T18:37:08.394 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5TmfN8OdvxGMo_W off=3403477 len=1552167 2024-01-13T18:37:08.395 INFO:tasks.workunit.client.0.smithi084.stdout:op 4773 completed, throughput=5MB/sec 2024-01-13T18:37:08.395 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OvGikSUQv0Hp-Gf off=5134047 len=1328570 2024-01-13T18:37:08.403 INFO:tasks.workunit.client.0.smithi084.stdout:op 4774 completed, throughput=5MB/sec 2024-01-13T18:37:09.403 INFO:tasks.workunit.client.0.smithi084.stdout: 947: throughput=5MB/sec pending data=0 2024-01-13T18:37:09.404 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3JeDeKWJ9P9w0h1 off=859517 len=302658 2024-01-13T18:37:09.406 INFO:tasks.workunit.client.0.smithi084.stdout:op 4775 completed, throughput=5MB/sec 2024-01-13T18:37:09.406 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4EIF0rhuyg2xITP off=4111704 len=1411113 2024-01-13T18:37:09.414 INFO:tasks.workunit.client.0.smithi084.stdout:op 4776 completed, throughput=5MB/sec 2024-01-13T18:37:09.414 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0e8rg8uEppDkuAP off=3088714 len=1124372 2024-01-13T18:37:09.415 INFO:tasks.workunit.client.0.smithi084.stdout:op 4777 completed, throughput=5MB/sec 2024-01-13T18:37:09.416 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YWb0XrrNGl7KwFT off=1296589 len=1481408 2024-01-13T18:37:09.418 INFO:tasks.workunit.client.0.smithi084.stdout:op 4778 completed, throughput=5MB/sec 2024-01-13T18:37:09.418 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Qtv4Q6RAU4jX1AH off=791446 len=1409413 2024-01-13T18:37:09.420 INFO:tasks.workunit.client.0.smithi084.stdout:op 4779 completed, throughput=5MB/sec 2024-01-13T18:37:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:09 smithi099 ceph-mon[138788]: pgmap v1960: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:09.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:09 smithi084 ceph-mon[116404]: pgmap v1960: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:09 smithi084 ceph-mon[119097]: pgmap v1960: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:10.420 INFO:tasks.workunit.client.0.smithi084.stdout: 948: throughput=5MB/sec pending data=0 2024-01-13T18:37:10.420 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qX2PoZgmWEBQUct off=2368909 len=1016832 2024-01-13T18:37:10.422 INFO:tasks.workunit.client.0.smithi084.stdout:op 4780 completed, throughput=5MB/sec 2024-01-13T18:37:10.422 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sPsZZaIoztJZ2Zp off=5069489 len=1099014 2024-01-13T18:37:10.423 INFO:tasks.workunit.client.0.smithi084.stdout:op 4781 completed, throughput=5MB/sec 2024-01-13T18:37:10.423 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Qa3K0dIERFGK7Yd off=4766561 len=1315114 2024-01-13T18:37:10.425 INFO:tasks.workunit.client.0.smithi084.stdout:op 4782 completed, throughput=5MB/sec 2024-01-13T18:37:10.425 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3P-2c5O1yYRvAXK off=1143217 len=429162 2024-01-13T18:37:10.428 INFO:tasks.workunit.client.0.smithi084.stdout:op 4783 completed, throughput=5MB/sec 2024-01-13T18:37:10.428 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ob7KGrRLmvBwUvC off=6950670 len=1094165 2024-01-13T18:37:10.430 INFO:tasks.workunit.client.0.smithi084.stdout:op 4784 completed, throughput=5MB/sec 2024-01-13T18:37:10.634 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:37:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:37:10] "GET /metrics HTTP/1.1" 200 33998 "" "Prometheus/2.43.0" 2024-01-13T18:37:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:10 smithi084 ceph-mon[116404]: pgmap v1961: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:37:10.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:10 smithi084 ceph-mon[119097]: pgmap v1961: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:37:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:10 smithi099 ceph-mon[138788]: pgmap v1961: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:37:11.430 INFO:tasks.workunit.client.0.smithi084.stdout: 949: throughput=5MB/sec pending data=0 2024-01-13T18:37:11.430 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2iKyvT_9b026c7o off=8236792 len=682006 2024-01-13T18:37:11.431 INFO:tasks.workunit.client.0.smithi084.stdout:op 4785 completed, throughput=5MB/sec 2024-01-13T18:37:11.431 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-H4r6lUxHZz1TEZo off=2752119 len=265425 2024-01-13T18:37:11.435 INFO:tasks.workunit.client.0.smithi084.stdout:op 4786 completed, throughput=5MB/sec 2024-01-13T18:37:11.435 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PzvecyTnxJWguNG off=6931092 len=1274446 2024-01-13T18:37:11.441 INFO:tasks.workunit.client.0.smithi084.stdout:op 4787 completed, throughput=5MB/sec 2024-01-13T18:37:11.441 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6ik-gYp8XHgcxNx off=2845965 len=1967726 2024-01-13T18:37:11.442 INFO:tasks.workunit.client.0.smithi084.stdout:op 4788 completed, throughput=5MB/sec 2024-01-13T18:37:11.443 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gKtXyHwgSUXkhGb off=7212880 len=2022048 2024-01-13T18:37:11.454 INFO:tasks.workunit.client.0.smithi084.stdout:op 4789 completed, throughput=5MB/sec 2024-01-13T18:37:12.454 INFO:tasks.workunit.client.0.smithi084.stdout: 950: throughput=5MB/sec pending data=0 2024-01-13T18:37:12.454 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4ZVGBLZYXmpSP-q off=7737738 len=1302033 2024-01-13T18:37:12.460 INFO:tasks.workunit.client.0.smithi084.stdout:op 4790 completed, throughput=5MB/sec 2024-01-13T18:37:12.460 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y1gc0L426c-vkGd off=6672547 len=275643 2024-01-13T18:37:12.461 INFO:tasks.workunit.client.0.smithi084.stdout:op 4791 completed, throughput=5MB/sec 2024-01-13T18:37:12.461 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WObGJTjWNv2SyBP off=8309587 len=45410 2024-01-13T18:37:12.461 INFO:tasks.workunit.client.0.smithi084.stdout:op 4792 completed, throughput=5MB/sec 2024-01-13T18:37:12.461 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0j4Qxha9AzOQvEE off=2798701 len=1449475 2024-01-13T18:37:12.471 INFO:tasks.workunit.client.0.smithi084.stdout:op 4793 completed, throughput=5MB/sec 2024-01-13T18:37:12.471 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RIXuMssZd4fw5YK off=16966041 len=1239536 2024-01-13T18:37:12.471 INFO:tasks.workunit.client.0.smithi084.stdout:op 4794 completed, throughput=5MB/sec 2024-01-13T18:37:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:12 smithi084 ceph-mon[116404]: pgmap v1962: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:37:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:12 smithi084 ceph-mon[119097]: pgmap v1962: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:37:13.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:12 smithi099 ceph-mon[138788]: pgmap v1962: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:37:13.470 INFO:tasks.workunit.client.0.smithi084.stdout: 951: throughput=5MB/sec pending data=0 2024-01-13T18:37:13.470 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-c-AgLW-wb1lwMPU off=2813110 len=1225942 2024-01-13T18:37:13.472 INFO:tasks.workunit.client.0.smithi084.stdout:op 4795 completed, throughput=5MB/sec 2024-01-13T18:37:13.472 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ev67I8baQkcH2rr off=3385969 len=228473 2024-01-13T18:37:13.472 INFO:tasks.workunit.client.0.smithi084.stdout:op 4796 completed, throughput=5MB/sec 2024-01-13T18:37:13.472 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IEWT7U-FfomHHSU off=5815183 len=1470576 2024-01-13T18:37:13.474 INFO:tasks.workunit.client.0.smithi084.stdout:op 4797 completed, throughput=5MB/sec 2024-01-13T18:37:13.474 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-etdTgwQt1S2cWzg off=3895327 len=898215 2024-01-13T18:37:13.479 INFO:tasks.workunit.client.0.smithi084.stdout:op 4798 completed, throughput=5MB/sec 2024-01-13T18:37:13.479 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aRgcIHdrAoMxJgM off=1758737 len=1888628 2024-01-13T18:37:13.489 INFO:tasks.workunit.client.0.smithi084.stdout:op 4799 completed, throughput=5MB/sec 2024-01-13T18:37:14.490 INFO:tasks.workunit.client.0.smithi084.stdout: 952: throughput=5MB/sec pending data=0 2024-01-13T18:37:14.490 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PX_opfzJmfvAk3N off=1752825 len=1984764 2024-01-13T18:37:14.498 INFO:tasks.workunit.client.0.smithi084.stdout:op 4800 completed, throughput=5MB/sec 2024-01-13T18:37:14.498 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IqZv8iOJ3mnPY4d off=5184535 len=147127 2024-01-13T18:37:14.498 INFO:tasks.workunit.client.0.smithi084.stdout:op 4801 completed, throughput=5MB/sec 2024-01-13T18:37:14.498 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vQWtxnahWvE1tak off=2292703 len=1444104 2024-01-13T18:37:14.505 INFO:tasks.workunit.client.0.smithi084.stdout:op 4802 completed, throughput=5MB/sec 2024-01-13T18:37:14.505 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-f1SmIwzyCONQdT8 off=5635188 len=1420336 2024-01-13T18:37:14.512 INFO:tasks.workunit.client.0.smithi084.stdout:op 4803 completed, throughput=5MB/sec 2024-01-13T18:37:14.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:14 smithi084 ceph-mon[116404]: pgmap v1963: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 6 op/s 2024-01-13T18:37:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:14 smithi084 ceph-mon[119097]: pgmap v1963: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 6 op/s 2024-01-13T18:37:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:14 smithi099 ceph-mon[138788]: pgmap v1963: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 6 op/s 2024-01-13T18:37:15.512 INFO:tasks.workunit.client.0.smithi084.stdout: 953: throughput=5MB/sec pending data=0 2024-01-13T18:37:15.513 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iQcLPXGk2L1b0QI off=5280630 len=1004532 2024-01-13T18:37:15.518 INFO:tasks.workunit.client.0.smithi084.stdout:op 4804 completed, throughput=5MB/sec 2024-01-13T18:37:15.518 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qpUEKp7kEwCmIru off=1161462 len=1556626 2024-01-13T18:37:15.520 INFO:tasks.workunit.client.0.smithi084.stdout:op 4805 completed, throughput=5MB/sec 2024-01-13T18:37:15.520 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ceprm4dotWlzpiM off=50183 len=1296603 2024-01-13T18:37:15.525 INFO:tasks.workunit.client.0.smithi084.stdout:op 4806 completed, throughput=5MB/sec 2024-01-13T18:37:15.525 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FA2vPWl_AQ4J36r off=331263 len=1209382 2024-01-13T18:37:15.526 INFO:tasks.workunit.client.0.smithi084.stdout:op 4807 completed, throughput=5MB/sec 2024-01-13T18:37:16.526 INFO:tasks.workunit.client.0.smithi084.stdout: 954: throughput=5MB/sec pending data=0 2024-01-13T18:37:16.527 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G3_LSLMRJAsCWCw off=1586049 len=1908164 2024-01-13T18:37:16.539 INFO:tasks.workunit.client.0.smithi084.stdout:op 4808 completed, throughput=5MB/sec 2024-01-13T18:37:16.539 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IKYE2OPDJQCXfmb off=3042365 len=392746 2024-01-13T18:37:16.542 INFO:tasks.workunit.client.0.smithi084.stdout:op 4809 completed, throughput=5MB/sec 2024-01-13T18:37:16.542 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XCDHbSRAsqd8B_0 off=2254165 len=47016 2024-01-13T18:37:16.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 4810 completed, throughput=5MB/sec 2024-01-13T18:37:16.543 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jTRQh5vqCmKCWqF off=23825717 len=262059 2024-01-13T18:37:16.545 INFO:tasks.workunit.client.0.smithi084.stdout:op 4811 completed, throughput=5MB/sec 2024-01-13T18:37:16.545 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Gbo_nHXsss0biTa off=13697369 len=304608 2024-01-13T18:37:16.546 INFO:tasks.workunit.client.0.smithi084.stdout:op 4812 completed, throughput=5MB/sec 2024-01-13T18:37:16.546 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Z1tjLMsfVqgQdJh off=7916628 len=332168 2024-01-13T18:37:16.547 INFO:tasks.workunit.client.0.smithi084.stdout:op 4813 completed, throughput=5MB/sec 2024-01-13T18:37:16.547 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qk6MSBG5uZwaWMe off=4188195 len=786448 2024-01-13T18:37:16.549 INFO:tasks.workunit.client.0.smithi084.stdout:op 4814 completed, throughput=5MB/sec 2024-01-13T18:37:16.549 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-itEI_lOCYF4Tl-o off=2076732 len=891253 2024-01-13T18:37:16.550 INFO:tasks.workunit.client.0.smithi084.stdout:op 4815 completed, throughput=5MB/sec 2024-01-13T18:37:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:16 smithi084 ceph-mon[116404]: pgmap v1964: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:37:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:16 smithi084 ceph-mon[119097]: pgmap v1964: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:37:17.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:16 smithi099 ceph-mon[138788]: pgmap v1964: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:37:17.551 INFO:tasks.workunit.client.0.smithi084.stdout: 955: throughput=4.99MB/sec pending data=0 2024-01-13T18:37:17.551 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FhRWjRUksb-CFc2 off=2945368 len=1367140 2024-01-13T18:37:17.557 INFO:tasks.workunit.client.0.smithi084.stdout:op 4816 completed, throughput=5MB/sec 2024-01-13T18:37:17.557 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_qP4bTCLDkK1Llq off=3796652 len=2076175 2024-01-13T18:37:17.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 4817 completed, throughput=5MB/sec 2024-01-13T18:37:17.559 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V2jNal-lR7DLvho off=8838149 len=664051 2024-01-13T18:37:17.560 INFO:tasks.workunit.client.0.smithi084.stdout:op 4818 completed, throughput=5MB/sec 2024-01-13T18:37:17.560 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RAYnPDnQDxMbJHc off=15563588 len=1951906 2024-01-13T18:37:17.563 INFO:tasks.workunit.client.0.smithi084.stdout:op 4819 completed, throughput=5MB/sec 2024-01-13T18:37:18.564 INFO:tasks.workunit.client.0.smithi084.stdout: 956: throughput=5MB/sec pending data=0 2024-01-13T18:37:18.564 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ub_VjgleRnuaRLk off=3210129 len=396727 2024-01-13T18:37:18.568 INFO:tasks.workunit.client.0.smithi084.stdout:op 4820 completed, throughput=5MB/sec 2024-01-13T18:37:18.568 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-paAhLIbgkPyD2hs off=5679799 len=1102475 2024-01-13T18:37:18.573 INFO:tasks.workunit.client.0.smithi084.stdout:op 4821 completed, throughput=5MB/sec 2024-01-13T18:37:18.573 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9NZ98Jn75D8oAr- off=5398627 len=1630183 2024-01-13T18:37:18.575 INFO:tasks.workunit.client.0.smithi084.stdout:op 4822 completed, throughput=5MB/sec 2024-01-13T18:37:18.575 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QSuqBcn3ZfDeiV1 off=608422 len=846184 2024-01-13T18:37:18.576 INFO:tasks.workunit.client.0.smithi084.stdout:op 4823 completed, throughput=5MB/sec 2024-01-13T18:37:18.576 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fBNI5m9dw2ScXaM off=2309416 len=221281 2024-01-13T18:37:18.579 INFO:tasks.workunit.client.0.smithi084.stdout:op 4824 completed, throughput=5MB/sec 2024-01-13T18:37:18.579 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VEGBNJuBUnri8aG off=3574274 len=1574930 2024-01-13T18:37:18.580 INFO:tasks.workunit.client.0.smithi084.stdout:op 4825 completed, throughput=5MB/sec 2024-01-13T18:37:19.581 INFO:tasks.workunit.client.0.smithi084.stdout: 957: throughput=5MB/sec pending data=0 2024-01-13T18:37:19.581 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--Sn1c5g0nJwLyDy off=7215400 len=1851043 2024-01-13T18:37:19.591 INFO:tasks.workunit.client.0.smithi084.stdout:op 4826 completed, throughput=5MB/sec 2024-01-13T18:37:19.591 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k_rDiPWcYU69AlB off=4517809 len=1434758 2024-01-13T18:37:19.594 INFO:tasks.workunit.client.0.smithi084.stdout:op 4827 completed, throughput=5MB/sec 2024-01-13T18:37:19.594 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Zk5f1D9XU1-_yf7 off=8386832 len=907719 2024-01-13T18:37:19.595 INFO:tasks.workunit.client.0.smithi084.stdout:op 4828 completed, throughput=5MB/sec 2024-01-13T18:37:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:19 smithi099 ceph-mon[138788]: pgmap v1965: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:37:19.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:19 smithi084 ceph-mon[119097]: pgmap v1965: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:37:19.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:19 smithi084 ceph-mon[116404]: pgmap v1965: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:37:20.595 INFO:tasks.workunit.client.0.smithi084.stdout: 958: throughput=5MB/sec pending data=0 2024-01-13T18:37:20.595 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-E1oh7M2lcV-tGF0 off=8060828 len=613284 2024-01-13T18:37:20.596 INFO:tasks.workunit.client.0.smithi084.stdout:op 4829 completed, throughput=5MB/sec 2024-01-13T18:37:20.596 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kL5uS2OHz-7cIap off=1298217 len=129592 2024-01-13T18:37:20.597 INFO:tasks.workunit.client.0.smithi084.stdout:op 4830 completed, throughput=5MB/sec 2024-01-13T18:37:20.597 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HIMMLLISwUPY02y off=2728444 len=1362753 2024-01-13T18:37:20.599 INFO:tasks.workunit.client.0.smithi084.stdout:op 4831 completed, throughput=5MB/sec 2024-01-13T18:37:20.599 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6Vp4iDcZpiCsUov off=4121139 len=1245970 2024-01-13T18:37:20.605 INFO:tasks.workunit.client.0.smithi084.stdout:op 4832 completed, throughput=5MB/sec 2024-01-13T18:37:20.605 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-77yREjHqVZ4XLTH off=14277820 len=2066576 2024-01-13T18:37:20.617 INFO:tasks.workunit.client.0.smithi084.stdout:op 4833 completed, throughput=5MB/sec 2024-01-13T18:37:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:20.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:37:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:37:20] "GET /metrics HTTP/1.1" 200 33999 "" "Prometheus/2.43.0" 2024-01-13T18:37:21.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:21 smithi099 ceph-mon[138788]: pgmap v1966: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:37:21.617 INFO:tasks.workunit.client.0.smithi084.stdout: 959: throughput=5MB/sec pending data=0 2024-01-13T18:37:21.617 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-a1dcIH-zdmnPn2Q off=11676887 len=22586 2024-01-13T18:37:21.618 INFO:tasks.workunit.client.0.smithi084.stdout:op 4834 completed, throughput=5MB/sec 2024-01-13T18:37:21.618 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QKT0XVS5Ts11glG off=7214885 len=1614456 2024-01-13T18:37:21.619 INFO:tasks.workunit.client.0.smithi084.stdout:op 4835 completed, throughput=5MB/sec 2024-01-13T18:37:21.619 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5SthS2NvrFUAOJ2 off=6854711 len=2023006 2024-01-13T18:37:21.631 INFO:tasks.workunit.client.0.smithi084.stdout:op 4836 completed, throughput=5MB/sec 2024-01-13T18:37:21.631 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-565N-8hhhWYu1gu off=6927886 len=1691642 2024-01-13T18:37:21.640 INFO:tasks.workunit.client.0.smithi084.stdout:op 4837 completed, throughput=5MB/sec 2024-01-13T18:37:21.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:21 smithi084 ceph-mon[116404]: pgmap v1966: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:37:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:21 smithi084 ceph-mon[119097]: pgmap v1966: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:37:22.641 INFO:tasks.workunit.client.0.smithi084.stdout: 960: throughput=5MB/sec pending data=0 2024-01-13T18:37:22.641 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ks-yCxeAxctRre9 off=11479829 len=1313429 2024-01-13T18:37:22.642 INFO:tasks.workunit.client.0.smithi084.stdout:op 4838 completed, throughput=5MB/sec 2024-01-13T18:37:22.643 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FibXpa10rfA06NR off=43039 len=1897656 2024-01-13T18:37:22.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 4839 completed, throughput=5MB/sec 2024-01-13T18:37:22.646 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CTU1bbQBqZlLTHw off=1870323 len=359049 2024-01-13T18:37:22.647 INFO:tasks.workunit.client.0.smithi084.stdout:op 4840 completed, throughput=5MB/sec 2024-01-13T18:37:22.647 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OZ6vr1zIg6NAED1 off=2172112 len=1593584 2024-01-13T18:37:22.654 INFO:tasks.workunit.client.0.smithi084.stdout:op 4841 completed, throughput=5MB/sec 2024-01-13T18:37:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:22 smithi084 ceph-mon[116404]: pgmap v1967: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:37:22.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:22 smithi084 ceph-mon[119097]: pgmap v1967: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:37:23.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:22 smithi099 ceph-mon[138788]: pgmap v1967: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:37:23.654 INFO:tasks.workunit.client.0.smithi084.stdout: 961: throughput=4.99MB/sec pending data=0 2024-01-13T18:37:23.654 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6A3X4j-H1_Jk5Gu off=10969629 len=491833 2024-01-13T18:37:23.655 INFO:tasks.workunit.client.0.smithi084.stdout:op 4842 completed, throughput=5MB/sec 2024-01-13T18:37:23.655 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hkjbUNAetn8O-oT off=13308088 len=792969 2024-01-13T18:37:23.657 INFO:tasks.workunit.client.0.smithi084.stdout:op 4843 completed, throughput=5MB/sec 2024-01-13T18:37:23.657 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-d38WP6Pd9QXgrZO off=10738322 len=1378158 2024-01-13T18:37:23.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 4844 completed, throughput=5MB/sec 2024-01-13T18:37:23.660 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dGYIeMHOWN9k02d off=1437151 len=718311 2024-01-13T18:37:23.665 INFO:tasks.workunit.client.0.smithi084.stdout:op 4845 completed, throughput=5MB/sec 2024-01-13T18:37:23.665 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9z1ooRMsX50vYMv off=1730926 len=527953 2024-01-13T18:37:23.665 INFO:tasks.workunit.client.0.smithi084.stdout:op 4846 completed, throughput=5MB/sec 2024-01-13T18:37:23.666 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-olalAx4IJ6Whnjp off=3734103 len=668938 2024-01-13T18:37:23.667 INFO:tasks.workunit.client.0.smithi084.stdout:op 4847 completed, throughput=5MB/sec 2024-01-13T18:37:23.667 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vuPVdaFvjPATahy off=345242 len=795020 2024-01-13T18:37:23.668 INFO:tasks.workunit.client.0.smithi084.stdout:op 4848 completed, throughput=5MB/sec 2024-01-13T18:37:24.668 INFO:tasks.workunit.client.0.smithi084.stdout: 962: throughput=4.99MB/sec pending data=0 2024-01-13T18:37:24.669 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lFag5OFIiOIiktm off=4420175 len=828761 2024-01-13T18:37:24.669 INFO:tasks.workunit.client.0.smithi084.stdout:op 4849 completed, throughput=5MB/sec 2024-01-13T18:37:24.669 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RdWn3kyYFhnIaK0 off=6629677 len=779810 2024-01-13T18:37:24.670 INFO:tasks.workunit.client.0.smithi084.stdout:op 4850 completed, throughput=5MB/sec 2024-01-13T18:37:24.670 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wQlVdj0JAFO2oNm off=13412698 len=1183620 2024-01-13T18:37:24.679 INFO:tasks.workunit.client.0.smithi084.stdout:op 4851 completed, throughput=5MB/sec 2024-01-13T18:37:24.679 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pEfOffA3_77i9Ii off=10601085 len=1059706 2024-01-13T18:37:24.683 INFO:tasks.workunit.client.0.smithi084.stdout:op 4852 completed, throughput=5MB/sec 2024-01-13T18:37:24.684 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3_LyeynrXVP415p off=20606648 len=1247416 2024-01-13T18:37:24.685 INFO:tasks.workunit.client.0.smithi084.stdout:op 4853 completed, throughput=5MB/sec 2024-01-13T18:37:24.685 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vc-68vBrZVwTk4m off=562297 len=1478111 2024-01-13T18:37:24.692 INFO:tasks.workunit.client.0.smithi084.stdout:op 4854 completed, throughput=5MB/sec 2024-01-13T18:37:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:24 smithi084 ceph-mon[116404]: pgmap v1968: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:37:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:24 smithi084 ceph-mon[119097]: pgmap v1968: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:37:25.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:24 smithi099 ceph-mon[138788]: pgmap v1968: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:37:25.693 INFO:tasks.workunit.client.0.smithi084.stdout: 963: throughput=5MB/sec pending data=0 2024-01-13T18:37:25.693 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IbyKcMLb5SZhqPM off=683770 len=1473666 2024-01-13T18:37:25.694 INFO:tasks.workunit.client.0.smithi084.stdout:op 4855 completed, throughput=5MB/sec 2024-01-13T18:37:25.694 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CKR3O48XnlYR4Mf off=8243719 len=150215 2024-01-13T18:37:25.697 INFO:tasks.workunit.client.0.smithi084.stdout:op 4856 completed, throughput=5MB/sec 2024-01-13T18:37:25.698 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-93SfoNB1f0cM0FI off=20805366 len=2063964 2024-01-13T18:37:25.707 INFO:tasks.workunit.client.0.smithi084.stdout:op 4857 completed, throughput=5MB/sec 2024-01-13T18:37:25.707 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uAIFSOjp63R49Uq off=626321 len=249337 2024-01-13T18:37:25.707 INFO:tasks.workunit.client.0.smithi084.stdout:op 4858 completed, throughput=5MB/sec 2024-01-13T18:37:25.707 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JPs3VF0ntt6ReNj off=973331 len=1453893 2024-01-13T18:37:25.716 INFO:tasks.workunit.client.0.smithi084.stdout:op 4859 completed, throughput=5MB/sec 2024-01-13T18:37:26.716 INFO:tasks.workunit.client.0.smithi084.stdout: 964: throughput=5MB/sec pending data=0 2024-01-13T18:37:26.716 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8bS28Zylt1OfCnB off=14059163 len=1861547 2024-01-13T18:37:26.727 INFO:tasks.workunit.client.0.smithi084.stdout:op 4860 completed, throughput=5MB/sec 2024-01-13T18:37:26.727 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y-FOHJly-EBpFEI off=3682672 len=1987037 2024-01-13T18:37:26.729 INFO:tasks.workunit.client.0.smithi084.stdout:op 4861 completed, throughput=5MB/sec 2024-01-13T18:37:26.729 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-H1fnUGscRepD1qc off=8313251 len=2094725 2024-01-13T18:37:26.741 INFO:tasks.workunit.client.0.smithi084.stdout:op 4862 completed, throughput=5MB/sec 2024-01-13T18:37:26.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:26 smithi084 ceph-mon[119097]: pgmap v1969: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:37:26.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:26 smithi084 ceph-mon[116404]: pgmap v1969: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:37:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:26 smithi099 ceph-mon[138788]: pgmap v1969: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:37:27.741 INFO:tasks.workunit.client.0.smithi084.stdout: 965: throughput=5MB/sec pending data=0 2024-01-13T18:37:27.742 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7LjCYum9M-eBMYX off=435563 len=1137883 2024-01-13T18:37:27.743 INFO:tasks.workunit.client.0.smithi084.stdout:op 4863 completed, throughput=5MB/sec 2024-01-13T18:37:27.743 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WT-y_UdF6rR9tY3 off=1572266 len=724880 2024-01-13T18:37:27.747 INFO:tasks.workunit.client.0.smithi084.stdout:op 4864 completed, throughput=5MB/sec 2024-01-13T18:37:27.748 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EvGEDo0tk6yzhtc off=4676486 len=828398 2024-01-13T18:37:27.748 INFO:tasks.workunit.client.0.smithi084.stdout:op 4865 completed, throughput=5MB/sec 2024-01-13T18:37:27.748 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lLiY8TuuOThlf7Y off=6191941 len=622874 2024-01-13T18:37:27.749 INFO:tasks.workunit.client.0.smithi084.stdout:op 4866 completed, throughput=5MB/sec 2024-01-13T18:37:27.749 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9TAr3AaJzsJ4r3i off=3608241 len=1157963 2024-01-13T18:37:27.751 INFO:tasks.workunit.client.0.smithi084.stdout:op 4867 completed, throughput=5MB/sec 2024-01-13T18:37:28.751 INFO:tasks.workunit.client.0.smithi084.stdout: 966: throughput=5MB/sec pending data=0 2024-01-13T18:37:28.752 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rK-CtiqLteF4Q_s off=2686536 len=98561 2024-01-13T18:37:28.752 INFO:tasks.workunit.client.0.smithi084.stdout:op 4868 completed, throughput=5MB/sec 2024-01-13T18:37:28.752 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AuHzYql9pVJ-_r6 off=6240351 len=2074887 2024-01-13T18:37:28.757 INFO:tasks.workunit.client.0.smithi084.stdout:op 4869 completed, throughput=5MB/sec 2024-01-13T18:37:28.757 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NA6aEE16LHNsZhh off=14651997 len=1501850 2024-01-13T18:37:28.763 INFO:tasks.workunit.client.0.smithi084.stdout:op 4870 completed, throughput=5MB/sec 2024-01-13T18:37:28.763 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aU4rnJf_4XV-ktg off=9452485 len=320136 2024-01-13T18:37:28.765 INFO:tasks.workunit.client.0.smithi084.stdout:op 4871 completed, throughput=5MB/sec 2024-01-13T18:37:28.765 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-A7HDv3C2y2e16jM off=147585 len=528713 2024-01-13T18:37:28.766 INFO:tasks.workunit.client.0.smithi084.stdout:op 4872 completed, throughput=5MB/sec 2024-01-13T18:37:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:29 smithi099 ceph-mon[138788]: pgmap v1970: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:37:29.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:29 smithi084 ceph-mon[116404]: pgmap v1970: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:37:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:29 smithi084 ceph-mon[119097]: pgmap v1970: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:37:29.766 INFO:tasks.workunit.client.0.smithi084.stdout: 967: throughput=5MB/sec pending data=0 2024-01-13T18:37:29.766 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mqCC33OgsP-gTO4 off=15657729 len=823173 2024-01-13T18:37:29.768 INFO:tasks.workunit.client.0.smithi084.stdout:op 4873 completed, throughput=5MB/sec 2024-01-13T18:37:29.768 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pB5VRbFKdYkpNLk off=15113606 len=1958510 2024-01-13T18:37:29.776 INFO:tasks.workunit.client.0.smithi084.stdout:op 4874 completed, throughput=5MB/sec 2024-01-13T18:37:29.776 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Zu6Ne6x_sbb1n54 off=1118244 len=1287931 2024-01-13T18:37:29.781 INFO:tasks.workunit.client.0.smithi084.stdout:op 4875 completed, throughput=5MB/sec 2024-01-13T18:37:29.781 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AAk_bw725PPvkN2 off=5325779 len=172951 2024-01-13T18:37:29.784 INFO:tasks.workunit.client.0.smithi084.stdout:op 4876 completed, throughput=5MB/sec 2024-01-13T18:37:29.784 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fFKl7mZ2zmua9N5 off=4969134 len=496545 2024-01-13T18:37:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:op 4877 completed, throughput=5MB/sec 2024-01-13T18:37:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Imf_4sdSMPxA9S4 off=2865658 len=1063285 2024-01-13T18:37:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:op 4878 completed, throughput=5MB/sec 2024-01-13T18:37:30.638 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:37:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:37:30] "GET /metrics HTTP/1.1" 200 33999 "" "Prometheus/2.43.0" 2024-01-13T18:37:30.787 INFO:tasks.workunit.client.0.smithi084.stdout: 968: throughput=5MB/sec pending data=0 2024-01-13T18:37:30.787 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XiNYo8zTyWoYkWS off=18879233 len=1480871 2024-01-13T18:37:30.793 INFO:tasks.workunit.client.0.smithi084.stdout:op 4879 completed, throughput=5MB/sec 2024-01-13T18:37:30.793 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8O9sypxuucxVlQ- off=5365987 len=177763 2024-01-13T18:37:30.793 INFO:tasks.workunit.client.0.smithi084.stdout:op 4880 completed, throughput=5MB/sec 2024-01-13T18:37:30.794 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yN5JLw-Ovdc3bhj off=1733948 len=1245890 2024-01-13T18:37:30.800 INFO:tasks.workunit.client.0.smithi084.stdout:op 4881 completed, throughput=5MB/sec 2024-01-13T18:37:30.800 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oBtmcWJGqU7E1zo off=3488690 len=1404682 2024-01-13T18:37:30.806 INFO:tasks.workunit.client.0.smithi084.stdout:op 4882 completed, throughput=5MB/sec 2024-01-13T18:37:30.806 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rdx4AeZq8jhp76T off=4685021 len=1143530 2024-01-13T18:37:30.807 INFO:tasks.workunit.client.0.smithi084.stdout:op 4883 completed, throughput=5MB/sec 2024-01-13T18:37:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:30 smithi084 ceph-mon[116404]: pgmap v1971: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:30.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:30 smithi084 ceph-mon[119097]: pgmap v1971: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:30 smithi099 ceph-mon[138788]: pgmap v1971: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:31.807 INFO:tasks.workunit.client.0.smithi084.stdout: 969: throughput=5MB/sec pending data=0 2024-01-13T18:37:31.807 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LvzI5aIAWy50RCM off=2453880 len=1374883 2024-01-13T18:37:31.808 INFO:tasks.workunit.client.0.smithi084.stdout:op 4884 completed, throughput=5MB/sec 2024-01-13T18:37:31.808 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sCNnHKtnVu5q4uH off=18549688 len=1125626 2024-01-13T18:37:31.810 INFO:tasks.workunit.client.0.smithi084.stdout:op 4885 completed, throughput=5MB/sec 2024-01-13T18:37:31.810 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Rq-eDYfEKEqIIfA off=3574000 len=1004647 2024-01-13T18:37:31.815 INFO:tasks.workunit.client.0.smithi084.stdout:op 4886 completed, throughput=5MB/sec 2024-01-13T18:37:31.815 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Tv37zAEFvL3esFW off=1827383 len=2079475 2024-01-13T18:37:31.817 INFO:tasks.workunit.client.0.smithi084.stdout:op 4887 completed, throughput=5MB/sec 2024-01-13T18:37:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:37:31.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:37:32.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:37:32.817 INFO:tasks.workunit.client.0.smithi084.stdout: 970: throughput=5MB/sec pending data=0 2024-01-13T18:37:32.818 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7M2FEL8ef8lUm-X off=338326 len=1432860 2024-01-13T18:37:32.819 INFO:tasks.workunit.client.0.smithi084.stdout:op 4888 completed, throughput=5MB/sec 2024-01-13T18:37:32.819 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-shP20Ec-Lh-5O9h off=3170086 len=1516603 2024-01-13T18:37:32.828 INFO:tasks.workunit.client.0.smithi084.stdout:op 4889 completed, throughput=5MB/sec 2024-01-13T18:37:32.828 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5DQvJIiwtJP62eT off=1364151 len=608577 2024-01-13T18:37:32.832 INFO:tasks.workunit.client.0.smithi084.stdout:op 4890 completed, throughput=5MB/sec 2024-01-13T18:37:32.832 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NNURAIkbr5TcO1_ off=1191286 len=1887955 2024-01-13T18:37:32.841 INFO:tasks.workunit.client.0.smithi084.stdout:op 4891 completed, throughput=5MB/sec 2024-01-13T18:37:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:37:32.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:37:32.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:37:32.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:32 smithi084 ceph-mon[116404]: pgmap v1972: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:37:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:37:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:37:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:37:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:32 smithi084 ceph-mon[119097]: pgmap v1972: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:37:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:37:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:37:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:37:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:32 smithi099 ceph-mon[138788]: pgmap v1972: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:37:33.841 INFO:tasks.workunit.client.0.smithi084.stdout: 971: throughput=5MB/sec pending data=0 2024-01-13T18:37:33.841 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-F1A8E3GgTD9yUz5 off=785653 len=561794 2024-01-13T18:37:33.845 INFO:tasks.workunit.client.0.smithi084.stdout:op 4892 completed, throughput=5MB/sec 2024-01-13T18:37:33.845 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jL7Cqu2zEzBV2nh off=1506177 len=449916 2024-01-13T18:37:33.849 INFO:tasks.workunit.client.0.smithi084.stdout:op 4893 completed, throughput=5MB/sec 2024-01-13T18:37:33.849 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TChJ_3XvK7Ju4Xs off=538242 len=962551 2024-01-13T18:37:33.854 INFO:tasks.workunit.client.0.smithi084.stdout:op 4894 completed, throughput=5MB/sec 2024-01-13T18:37:33.855 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QBhZsl0TYdUfY3P off=2034412 len=1239873 2024-01-13T18:37:33.861 INFO:tasks.workunit.client.0.smithi084.stdout:op 4895 completed, throughput=5MB/sec 2024-01-13T18:37:33.861 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zTsGBKlP4GiRVpk off=12526305 len=429259 2024-01-13T18:37:33.862 INFO:tasks.workunit.client.0.smithi084.stdout:op 4896 completed, throughput=5MB/sec 2024-01-13T18:37:33.862 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fV-hl8FsLN2DVUd off=6915192 len=1215541 2024-01-13T18:37:33.869 INFO:tasks.workunit.client.0.smithi084.stdout:op 4897 completed, throughput=5MB/sec 2024-01-13T18:37:34.869 INFO:tasks.workunit.client.0.smithi084.stdout: 972: throughput=5MB/sec pending data=0 2024-01-13T18:37:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Od4_d8foIv_y21i off=2926602 len=2045556 2024-01-13T18:37:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:op 4898 completed, throughput=5MB/sec 2024-01-13T18:37:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OgapYDDT8ecblFi off=1065594 len=828320 2024-01-13T18:37:34.877 INFO:tasks.workunit.client.0.smithi084.stdout:op 4899 completed, throughput=5MB/sec 2024-01-13T18:37:34.877 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jth7Gsp6JbhYejD off=9657736 len=7578 2024-01-13T18:37:34.878 INFO:tasks.workunit.client.0.smithi084.stdout:op 4900 completed, throughput=5MB/sec 2024-01-13T18:37:34.878 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Vudu7CejcH0A3DV off=4433808 len=15275 2024-01-13T18:37:34.880 INFO:tasks.workunit.client.0.smithi084.stdout:op 4901 completed, throughput=5MB/sec 2024-01-13T18:37:34.880 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IL_9PahzZyi8eTx off=8325686 len=210571 2024-01-13T18:37:34.883 INFO:tasks.workunit.client.0.smithi084.stdout:op 4902 completed, throughput=5MB/sec 2024-01-13T18:37:34.883 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-shP20Ec-Lh-5O9h off=14290458 len=1549741 2024-01-13T18:37:34.890 INFO:tasks.workunit.client.0.smithi084.stdout:op 4903 completed, throughput=5MB/sec 2024-01-13T18:37:34.891 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WEbFWm2Wc_5hJdN off=3285025 len=1986516 2024-01-13T18:37:34.902 INFO:tasks.workunit.client.0.smithi084.stdout:op 4904 completed, throughput=5MB/sec 2024-01-13T18:37:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:34 smithi084 ceph-mon[116404]: pgmap v1973: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:37:34.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:34 smithi084 ceph-mon[119097]: pgmap v1973: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:37:35.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:34 smithi099 ceph-mon[138788]: pgmap v1973: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:37:35.902 INFO:tasks.workunit.client.0.smithi084.stdout: 973: throughput=5MB/sec pending data=0 2024-01-13T18:37:35.903 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zjj7ArZujbeRnbo off=559287 len=838212 2024-01-13T18:37:35.904 INFO:tasks.workunit.client.0.smithi084.stdout:op 4905 completed, throughput=5MB/sec 2024-01-13T18:37:35.904 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kdEbyET0P7kmSeQ off=17282921 len=2069717 2024-01-13T18:37:35.914 INFO:tasks.workunit.client.0.smithi084.stdout:op 4906 completed, throughput=5MB/sec 2024-01-13T18:37:35.914 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jJ8Yje8wYym6D8c off=913394 len=556046 2024-01-13T18:37:35.917 INFO:tasks.workunit.client.0.smithi084.stdout:op 4907 completed, throughput=5MB/sec 2024-01-13T18:37:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:36.917 INFO:tasks.workunit.client.0.smithi084.stdout: 974: throughput=4.99MB/sec pending data=0 2024-01-13T18:37:36.918 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FDo9_JDql4jCIut off=7476193 len=761607 2024-01-13T18:37:36.919 INFO:tasks.workunit.client.0.smithi084.stdout:op 4908 completed, throughput=5MB/sec 2024-01-13T18:37:36.919 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GrOuUNGcaYBN7SZ off=705431 len=4550 2024-01-13T18:37:36.921 INFO:tasks.workunit.client.0.smithi084.stdout:op 4909 completed, throughput=5MB/sec 2024-01-13T18:37:36.921 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dLwj1qB3LI0BQGb off=6483258 len=225209 2024-01-13T18:37:36.922 INFO:tasks.workunit.client.0.smithi084.stdout:op 4910 completed, throughput=5MB/sec 2024-01-13T18:37:36.922 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3xBN5kW8Ep8OcHI off=2563643 len=990294 2024-01-13T18:37:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:36 smithi084 ceph-mon[116404]: pgmap v1974: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:37:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:36 smithi084 ceph-mon[119097]: pgmap v1974: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:37:36.927 INFO:tasks.workunit.client.0.smithi084.stdout:op 4911 completed, throughput=5MB/sec 2024-01-13T18:37:36.927 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Kukd81QUGt9QHtw off=3842658 len=571821 2024-01-13T18:37:36.928 INFO:tasks.workunit.client.0.smithi084.stdout:op 4912 completed, throughput=5MB/sec 2024-01-13T18:37:36.928 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7N69OvhJLnIcypA off=20000047 len=349142 2024-01-13T18:37:36.932 INFO:tasks.workunit.client.0.smithi084.stdout:op 4913 completed, throughput=5MB/sec 2024-01-13T18:37:36.932 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sGFCBQmvQVaLiB4 off=781085 len=879998 2024-01-13T18:37:36.936 INFO:tasks.workunit.client.0.smithi084.stdout:op 4914 completed, throughput=5MB/sec 2024-01-13T18:37:36.936 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-W9W3X88_wQUIvJS off=6188797 len=1276551 2024-01-13T18:37:36.937 INFO:tasks.workunit.client.0.smithi084.stdout:op 4915 completed, throughput=5MB/sec 2024-01-13T18:37:36.937 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eB3-2Bnpz0ABrEM off=756692 len=350202 2024-01-13T18:37:36.940 INFO:tasks.workunit.client.0.smithi084.stdout:op 4916 completed, throughput=5MB/sec 2024-01-13T18:37:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:36 smithi099 ceph-mon[138788]: pgmap v1974: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:37:37.941 INFO:tasks.workunit.client.0.smithi084.stdout: 975: throughput=5MB/sec pending data=0 2024-01-13T18:37:37.941 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pgcL7WdM4fq68hW off=2224491 len=36848 2024-01-13T18:37:37.942 INFO:tasks.workunit.client.0.smithi084.stdout:op 4917 completed, throughput=5MB/sec 2024-01-13T18:37:37.942 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--V-QHDbBnGYnLUM off=5697483 len=926602 2024-01-13T18:37:37.943 INFO:tasks.workunit.client.0.smithi084.stdout:op 4918 completed, throughput=5MB/sec 2024-01-13T18:37:37.943 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-diL5f4hh1J71Qom off=8038327 len=902016 2024-01-13T18:37:37.944 INFO:tasks.workunit.client.0.smithi084.stdout:op 4919 completed, throughput=5MB/sec 2024-01-13T18:37:37.944 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-v3l8nDBD0Xlf9od off=16982508 len=1096682 2024-01-13T18:37:37.951 INFO:tasks.workunit.client.0.smithi084.stdout:op 4920 completed, throughput=5MB/sec 2024-01-13T18:37:37.952 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OEGs7kcum-2br5k off=1359163 len=1453951 2024-01-13T18:37:37.952 INFO:tasks.workunit.client.0.smithi084.stdout:op 4921 completed, throughput=5MB/sec 2024-01-13T18:37:37.952 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YBYdXlAFI0HVplQ off=7360732 len=422973 2024-01-13T18:37:37.956 INFO:tasks.workunit.client.0.smithi084.stdout:op 4922 completed, throughput=5MB/sec 2024-01-13T18:37:37.956 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Pb5R-vGSIy905e2 off=3666505 len=766087 2024-01-13T18:37:37.959 INFO:tasks.workunit.client.0.smithi084.stdout:op 4923 completed, throughput=5MB/sec 2024-01-13T18:37:38.960 INFO:tasks.workunit.client.0.smithi084.stdout: 976: throughput=5MB/sec pending data=0 2024-01-13T18:37:38.960 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BUn3HTmo9SpoUNS off=6621063 len=206249 2024-01-13T18:37:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:op 4924 completed, throughput=5MB/sec 2024-01-13T18:37:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bQC0RcOu_08GPys off=5901213 len=792025 2024-01-13T18:37:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:op 4925 completed, throughput=5MB/sec 2024-01-13T18:37:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OPuMzWW2yESiYiw off=9508101 len=2039378 2024-01-13T18:37:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:op 4926 completed, throughput=5MB/sec 2024-01-13T18:37:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jkO95yac9Et73N3 off=15784054 len=330427 2024-01-13T18:37:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:op 4927 completed, throughput=5MB/sec 2024-01-13T18:37:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0bpMWLlxQhraEkl off=57745 len=495646 2024-01-13T18:37:38.980 INFO:tasks.workunit.client.0.smithi084.stdout:op 4928 completed, throughput=5MB/sec 2024-01-13T18:37:38.980 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5xp5JTt8jpP1Zgh off=402350 len=2032854 2024-01-13T18:37:38.982 INFO:tasks.workunit.client.0.smithi084.stdout:op 4929 completed, throughput=5MB/sec 2024-01-13T18:37:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:39 smithi099 ceph-mon[138788]: pgmap v1975: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:37:39.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:39 smithi084 ceph-mon[116404]: pgmap v1975: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:37:39.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:39 smithi084 ceph-mon[119097]: pgmap v1975: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:37:39.983 INFO:tasks.workunit.client.0.smithi084.stdout: 977: throughput=5MB/sec pending data=0 2024-01-13T18:37:39.983 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Mt9cYPm1NjXFZAT off=18367100 len=463929 2024-01-13T18:37:39.987 INFO:tasks.workunit.client.0.smithi084.stdout:op 4930 completed, throughput=5MB/sec 2024-01-13T18:37:39.987 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ieGkR-_FgTpyCZ_ off=9609864 len=1514899 2024-01-13T18:37:39.994 INFO:tasks.workunit.client.0.smithi084.stdout:op 4931 completed, throughput=5MB/sec 2024-01-13T18:37:39.994 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NC4MNF5PrLOrgpl off=1384892 len=26143 2024-01-13T18:37:39.994 INFO:tasks.workunit.client.0.smithi084.stdout:op 4932 completed, throughput=5MB/sec 2024-01-13T18:37:39.995 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OEGs7kcum-2br5k off=3122644 len=292772 2024-01-13T18:37:39.998 INFO:tasks.workunit.client.0.smithi084.stdout:op 4933 completed, throughput=5MB/sec 2024-01-13T18:37:39.998 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-l8al-THPGLKZIPV off=17797978 len=1648718 2024-01-13T18:37:40.001 INFO:tasks.workunit.client.0.smithi084.stdout:op 4934 completed, throughput=5MB/sec 2024-01-13T18:37:40.001 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pBuiN3boV_ZAdy- off=2315536 len=1933863 2024-01-13T18:37:40.003 INFO:tasks.workunit.client.0.smithi084.stdout:op 4935 completed, throughput=5MB/sec 2024-01-13T18:37:40.638 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:37:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:37:40] "GET /metrics HTTP/1.1" 200 33999 "" "Prometheus/2.43.0" 2024-01-13T18:37:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:40 smithi084 ceph-mon[116404]: pgmap v1976: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:37:40.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:40 smithi084 ceph-mon[119097]: pgmap v1976: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:37:41.003 INFO:tasks.workunit.client.0.smithi084.stdout: 978: throughput=5MB/sec pending data=0 2024-01-13T18:37:41.003 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-boPs99_1gDDJskn off=5682196 len=1527093 2024-01-13T18:37:41.010 INFO:tasks.workunit.client.0.smithi084.stdout:op 4936 completed, throughput=5MB/sec 2024-01-13T18:37:41.010 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--Cv_kvWi5qh9FfU off=871033 len=718156 2024-01-13T18:37:41.011 INFO:tasks.workunit.client.0.smithi084.stdout:op 4937 completed, throughput=5MB/sec 2024-01-13T18:37:41.011 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UNR32OiHjrP685A off=15905230 len=1106522 2024-01-13T18:37:41.017 INFO:tasks.workunit.client.0.smithi084.stdout:op 4938 completed, throughput=5MB/sec 2024-01-13T18:37:41.017 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6KFtk4iKdzRhiTE off=8412627 len=1406472 2024-01-13T18:37:41.023 INFO:tasks.workunit.client.0.smithi084.stdout:op 4939 completed, throughput=5MB/sec 2024-01-13T18:37:41.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:40 smithi099 ceph-mon[138788]: pgmap v1976: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:37:42.023 INFO:tasks.workunit.client.0.smithi084.stdout: 979: throughput=5MB/sec pending data=0 2024-01-13T18:37:42.023 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WIM1y5Al1jD_O7s off=1167899 len=32854 2024-01-13T18:37:42.025 INFO:tasks.workunit.client.0.smithi084.stdout:op 4940 completed, throughput=5MB/sec 2024-01-13T18:37:42.026 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tOK4c8dEBGZVBDE off=4833835 len=1287142 2024-01-13T18:37:42.034 INFO:tasks.workunit.client.0.smithi084.stdout:op 4941 completed, throughput=5MB/sec 2024-01-13T18:37:42.034 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cwzzgdP7TbGfIhZ off=13485667 len=143007 2024-01-13T18:37:42.036 INFO:tasks.workunit.client.0.smithi084.stdout:op 4942 completed, throughput=5MB/sec 2024-01-13T18:37:42.036 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6bzPdmAEBwoeaTZ off=473459 len=758855 2024-01-13T18:37:42.037 INFO:tasks.workunit.client.0.smithi084.stdout:op 4943 completed, throughput=5MB/sec 2024-01-13T18:37:42.037 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Xi4y_eqNgyLuqOv off=25744 len=1071036 2024-01-13T18:37:42.042 INFO:tasks.workunit.client.0.smithi084.stdout:op 4944 completed, throughput=5MB/sec 2024-01-13T18:37:42.043 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qUKPTPAIwuOfQBS off=4286457 len=1464167 2024-01-13T18:37:42.056 INFO:tasks.workunit.client.0.smithi084.stdout:op 4945 completed, throughput=5MB/sec 2024-01-13T18:37:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:42 smithi084 ceph-mon[116404]: pgmap v1977: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:37:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:42 smithi084 ceph-mon[119097]: pgmap v1977: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:37:43.056 INFO:tasks.workunit.client.0.smithi084.stdout: 980: throughput=5MB/sec pending data=0 2024-01-13T18:37:43.056 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UV72GPrkTTRCoyQ off=3821092 len=232836 2024-01-13T18:37:43.059 INFO:tasks.workunit.client.0.smithi084.stdout:op 4946 completed, throughput=5MB/sec 2024-01-13T18:37:43.059 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2Bv-Lf4ePNxTCsJ off=11717631 len=130908 2024-01-13T18:37:43.062 INFO:tasks.workunit.client.0.smithi084.stdout:op 4947 completed, throughput=5MB/sec 2024-01-13T18:37:43.062 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZlmPSDQxkgogjDq off=3161219 len=997024 2024-01-13T18:37:43.066 INFO:tasks.workunit.client.0.smithi084.stdout:op 4948 completed, throughput=5MB/sec 2024-01-13T18:37:43.067 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2BZpajwAPNVTKPJ off=6124572 len=1248903 2024-01-13T18:37:43.068 INFO:tasks.workunit.client.0.smithi084.stdout:op 4949 completed, throughput=5MB/sec 2024-01-13T18:37:43.068 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dHY-64GiIV3RNXv off=7163696 len=1534589 2024-01-13T18:37:43.077 INFO:tasks.workunit.client.0.smithi084.stdout:op 4950 completed, throughput=5MB/sec 2024-01-13T18:37:43.077 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_Q59L5Ab8IMogbW off=21190942 len=1127012 2024-01-13T18:37:43.079 INFO:tasks.workunit.client.0.smithi084.stdout:op 4951 completed, throughput=5MB/sec 2024-01-13T18:37:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:42 smithi099 ceph-mon[138788]: pgmap v1977: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:37:44.080 INFO:tasks.workunit.client.0.smithi084.stdout: 981: throughput=5MB/sec pending data=0 2024-01-13T18:37:44.080 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WTylZkYhEVCVHiX off=4593542 len=709914 2024-01-13T18:37:44.085 INFO:tasks.workunit.client.0.smithi084.stdout:op 4952 completed, throughput=5MB/sec 2024-01-13T18:37:44.085 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--vbf9_ahlazIPVb off=6072664 len=1516496 2024-01-13T18:37:44.094 INFO:tasks.workunit.client.0.smithi084.stdout:op 4953 completed, throughput=5MB/sec 2024-01-13T18:37:44.094 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k8wfi0ft8ING0zS off=5217790 len=1529089 2024-01-13T18:37:44.101 INFO:tasks.workunit.client.0.smithi084.stdout:op 4954 completed, throughput=5MB/sec 2024-01-13T18:37:44.102 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hqQsgtn7zrRad3a off=318174 len=937129 2024-01-13T18:37:44.103 INFO:tasks.workunit.client.0.smithi084.stdout:op 4955 completed, throughput=5MB/sec 2024-01-13T18:37:44.103 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xYq4Pd2rpIqMlZB off=2277183 len=1061671 2024-01-13T18:37:44.109 INFO:tasks.workunit.client.0.smithi084.stdout:op 4956 completed, throughput=5MB/sec 2024-01-13T18:37:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:44 smithi084 ceph-mon[116404]: pgmap v1978: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:37:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:44 smithi084 ceph-mon[119097]: pgmap v1978: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:37:45.109 INFO:tasks.workunit.client.0.smithi084.stdout: 982: throughput=5MB/sec pending data=0 2024-01-13T18:37:45.109 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VjFPRpFgXOmwluc off=3148537 len=33954 2024-01-13T18:37:45.112 INFO:tasks.workunit.client.0.smithi084.stdout:op 4957 completed, throughput=5MB/sec 2024-01-13T18:37:45.112 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ag5E01AfkqUPP-d off=6157090 len=854664 2024-01-13T18:37:45.113 INFO:tasks.workunit.client.0.smithi084.stdout:op 4958 completed, throughput=5MB/sec 2024-01-13T18:37:45.113 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vaYceGpB47AqaBJ off=937727 len=205174 2024-01-13T18:37:45.116 INFO:tasks.workunit.client.0.smithi084.stdout:op 4959 completed, throughput=5MB/sec 2024-01-13T18:37:45.116 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pgd3iGGgk8MaNc4 off=9858156 len=25290 2024-01-13T18:37:45.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:44 smithi099 ceph-mon[138788]: pgmap v1978: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 5 op/s 2024-01-13T18:37:45.118 INFO:tasks.workunit.client.0.smithi084.stdout:op 4960 completed, throughput=5MB/sec 2024-01-13T18:37:45.118 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sdlgIso4po2VfNo off=1457075 len=616674 2024-01-13T18:37:45.122 INFO:tasks.workunit.client.0.smithi084.stdout:op 4961 completed, throughput=5MB/sec 2024-01-13T18:37:45.122 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aCrw5DPXLTuR--V off=14713513 len=1330622 2024-01-13T18:37:45.123 INFO:tasks.workunit.client.0.smithi084.stdout:op 4962 completed, throughput=5MB/sec 2024-01-13T18:37:45.123 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WYrWqCiWxv55wfo off=12308254 len=738909 2024-01-13T18:37:45.124 INFO:tasks.workunit.client.0.smithi084.stdout:op 4963 completed, throughput=5MB/sec 2024-01-13T18:37:45.125 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rO2Dkd_xIFh3w4z off=3533423 len=2067525 2024-01-13T18:37:45.126 INFO:tasks.workunit.client.0.smithi084.stdout:op 4964 completed, throughput=5MB/sec 2024-01-13T18:37:46.127 INFO:tasks.workunit.client.0.smithi084.stdout: 983: throughput=5MB/sec pending data=0 2024-01-13T18:37:46.127 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_7uR1fZPxruUzr0 off=425654 len=1034353 2024-01-13T18:37:46.128 INFO:tasks.workunit.client.0.smithi084.stdout:op 4965 completed, throughput=5MB/sec 2024-01-13T18:37:46.128 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NWRc2Y4t2-PeoL3 off=5034920 len=1543994 2024-01-13T18:37:46.130 INFO:tasks.workunit.client.0.smithi084.stdout:op 4966 completed, throughput=5MB/sec 2024-01-13T18:37:46.130 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Z1fis8eLO5t90IL off=1799178 len=1423917 2024-01-13T18:37:46.131 INFO:tasks.workunit.client.0.smithi084.stdout:op 4967 completed, throughput=5MB/sec 2024-01-13T18:37:46.131 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--C5eI7XSirWA_qh off=3099924 len=83551 2024-01-13T18:37:46.134 INFO:tasks.workunit.client.0.smithi084.stdout:op 4968 completed, throughput=5MB/sec 2024-01-13T18:37:46.134 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hIIB5_8ltsx6oC3 off=1520664 len=2039809 2024-01-13T18:37:46.136 INFO:tasks.workunit.client.0.smithi084.stdout:op 4969 completed, throughput=5MB/sec 2024-01-13T18:37:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:46 smithi084 ceph-mon[116404]: pgmap v1979: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:37:46.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:46 smithi084 ceph-mon[119097]: pgmap v1979: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:37:47.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:46 smithi099 ceph-mon[138788]: pgmap v1979: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:37:47.137 INFO:tasks.workunit.client.0.smithi084.stdout: 984: throughput=5MB/sec pending data=0 2024-01-13T18:37:47.137 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oO47HLkdsoDEG6d off=4489350 len=352310 2024-01-13T18:37:47.137 INFO:tasks.workunit.client.0.smithi084.stdout:op 4970 completed, throughput=5MB/sec 2024-01-13T18:37:47.138 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cBUbwnqohp2c1UO off=4942198 len=273846 2024-01-13T18:37:47.138 INFO:tasks.workunit.client.0.smithi084.stdout:op 4971 completed, throughput=5MB/sec 2024-01-13T18:37:47.138 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xxJ4pXAMRgMJNjM off=16307493 len=1886660 2024-01-13T18:37:47.140 INFO:tasks.workunit.client.0.smithi084.stdout:op 4972 completed, throughput=5MB/sec 2024-01-13T18:37:47.140 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tKl3thzTEXv1iRr off=3126404 len=1506096 2024-01-13T18:37:47.149 INFO:tasks.workunit.client.0.smithi084.stdout:op 4973 completed, throughput=5MB/sec 2024-01-13T18:37:48.149 INFO:tasks.workunit.client.0.smithi084.stdout: 985: throughput=5MB/sec pending data=0 2024-01-13T18:37:48.149 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_ZtDjsLNqNihBFg off=1192968 len=1588768 2024-01-13T18:37:48.151 INFO:tasks.workunit.client.0.smithi084.stdout:op 4974 completed, throughput=5MB/sec 2024-01-13T18:37:48.151 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4gm5ma_ebNbZNRe off=358817 len=1538179 2024-01-13T18:37:48.154 INFO:tasks.workunit.client.0.smithi084.stdout:op 4975 completed, throughput=5MB/sec 2024-01-13T18:37:48.154 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZiFRvOtK8s8T0eW off=18480016 len=585722 2024-01-13T18:37:48.159 INFO:tasks.workunit.client.0.smithi084.stdout:op 4976 completed, throughput=5MB/sec 2024-01-13T18:37:48.159 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7dJiup3DKuRGNyy off=190044 len=718132 2024-01-13T18:37:48.160 INFO:tasks.workunit.client.0.smithi084.stdout:op 4977 completed, throughput=5MB/sec 2024-01-13T18:37:48.160 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CPmcd-wPEuzanCQ off=8214975 len=1468237 2024-01-13T18:37:48.165 INFO:tasks.workunit.client.0.smithi084.stdout:op 4978 completed, throughput=5MB/sec 2024-01-13T18:37:49.165 INFO:tasks.workunit.client.0.smithi084.stdout: 986: throughput=5MB/sec pending data=0 2024-01-13T18:37:49.165 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YK8CJfizlSTq_WY off=1441558 len=937250 2024-01-13T18:37:49.172 INFO:tasks.workunit.client.0.smithi084.stdout:op 4979 completed, throughput=5MB/sec 2024-01-13T18:37:49.172 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-E4-2zO6TSPM2I8d off=3543711 len=1472135 2024-01-13T18:37:49.177 INFO:tasks.workunit.client.0.smithi084.stdout:op 4980 completed, throughput=5MB/sec 2024-01-13T18:37:49.177 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rqG0pCo0BNmAb7U off=571764 len=54492 2024-01-13T18:37:49.179 INFO:tasks.workunit.client.0.smithi084.stdout:op 4981 completed, throughput=5MB/sec 2024-01-13T18:37:49.179 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8BJdZv8J4I_bgbp off=20906339 len=1778847 2024-01-13T18:37:49.180 INFO:tasks.workunit.client.0.smithi084.stdout:op 4982 completed, throughput=5MB/sec 2024-01-13T18:37:49.181 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zjj7ArZujbeRnbo off=0 len=1403205 2024-01-13T18:37:49.182 INFO:tasks.workunit.client.0.smithi084.stdout:op 4983 completed, throughput=5MB/sec 2024-01-13T18:37:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:49 smithi099 ceph-mon[138788]: pgmap v1980: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:37:49.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:49 smithi084 ceph-mon[116404]: pgmap v1980: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:37:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:49 smithi084 ceph-mon[119097]: pgmap v1980: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:37:50.183 INFO:tasks.workunit.client.0.smithi084.stdout: 987: throughput=5MB/sec pending data=0 2024-01-13T18:37:50.183 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RQvXtBHZPEsYxmk off=3308720 len=846700 2024-01-13T18:37:50.187 INFO:tasks.workunit.client.0.smithi084.stdout:op 4984 completed, throughput=5MB/sec 2024-01-13T18:37:50.187 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-i3PCBof78PiYz9- off=8195885 len=296417 2024-01-13T18:37:50.190 INFO:tasks.workunit.client.0.smithi084.stdout:op 4985 completed, throughput=5MB/sec 2024-01-13T18:37:50.191 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-j3Nmur9xe7N0Cl4 off=896704 len=843415 2024-01-13T18:37:50.191 INFO:tasks.workunit.client.0.smithi084.stdout:op 4986 completed, throughput=5MB/sec 2024-01-13T18:37:50.192 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MkcRjkkFvzHr9iL off=17837531 len=1280997 2024-01-13T18:37:50.194 INFO:tasks.workunit.client.0.smithi084.stdout:op 4987 completed, throughput=5MB/sec 2024-01-13T18:37:50.194 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Eq2XXoxlFh6UI2o off=15438455 len=188294 2024-01-13T18:37:50.194 INFO:tasks.workunit.client.0.smithi084.stdout:op 4988 completed, throughput=5MB/sec 2024-01-13T18:37:50.194 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VXpUMWkoj4CbX-R off=4832294 len=2021004 2024-01-13T18:37:50.203 INFO:tasks.workunit.client.0.smithi084.stdout:op 4989 completed, throughput=5MB/sec 2024-01-13T18:37:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:50.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:50.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:37:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:37:50] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:37:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:37:51.203 INFO:tasks.workunit.client.0.smithi084.stdout: 988: throughput=5MB/sec pending data=0 2024-01-13T18:37:51.203 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WmIEAkmu_mTSS6x off=9986966 len=1067694 2024-01-13T18:37:51.208 INFO:tasks.workunit.client.0.smithi084.stdout:op 4990 completed, throughput=5MB/sec 2024-01-13T18:37:51.208 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LMTX8a1yqxD-ODw off=14250454 len=1348612 2024-01-13T18:37:51.210 INFO:tasks.workunit.client.0.smithi084.stdout:op 4991 completed, throughput=5MB/sec 2024-01-13T18:37:51.210 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kubRgfe8YuSbDtq off=6644024 len=1318649 2024-01-13T18:37:51.216 INFO:tasks.workunit.client.0.smithi084.stdout:op 4992 completed, throughput=5MB/sec 2024-01-13T18:37:51.216 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MKiVmAQjKaCBjlN off=3825714 len=1425781 2024-01-13T18:37:51.217 INFO:tasks.workunit.client.0.smithi084.stdout:op 4993 completed, throughput=5MB/sec 2024-01-13T18:37:51.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:51 smithi099 ceph-mon[138788]: pgmap v1981: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 6 op/s 2024-01-13T18:37:51.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:51 smithi084 ceph-mon[116404]: pgmap v1981: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 6 op/s 2024-01-13T18:37:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:51 smithi084 ceph-mon[119097]: pgmap v1981: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 6 op/s 2024-01-13T18:37:52.218 INFO:tasks.workunit.client.0.smithi084.stdout: 989: throughput=5MB/sec pending data=0 2024-01-13T18:37:52.218 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U_xQrnChB4dARgN off=18760762 len=737705 2024-01-13T18:37:52.219 INFO:tasks.workunit.client.0.smithi084.stdout:op 4994 completed, throughput=5MB/sec 2024-01-13T18:37:52.219 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mqs_4ldy5RtBmHr off=9932684 len=377916 2024-01-13T18:37:52.220 INFO:tasks.workunit.client.0.smithi084.stdout:op 4995 completed, throughput=5MB/sec 2024-01-13T18:37:52.220 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jPC09iHWdE-i8b8 off=3109264 len=1207560 2024-01-13T18:37:52.226 INFO:tasks.workunit.client.0.smithi084.stdout:op 4996 completed, throughput=5MB/sec 2024-01-13T18:37:52.226 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WtAVB6son7_qelR off=915504 len=120445 2024-01-13T18:37:52.227 INFO:tasks.workunit.client.0.smithi084.stdout:op 4997 completed, throughput=5MB/sec 2024-01-13T18:37:52.227 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5hq1LioCV8jVtzf off=8513600 len=647875 2024-01-13T18:37:52.232 INFO:tasks.workunit.client.0.smithi084.stdout:op 4998 completed, throughput=5MB/sec 2024-01-13T18:37:52.232 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xr4hmwxHitbThND off=10529030 len=1576218 2024-01-13T18:37:52.239 INFO:tasks.workunit.client.0.smithi084.stdout:op 4999 completed, throughput=5MB/sec 2024-01-13T18:37:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:52 smithi084 ceph-mon[116404]: pgmap v1982: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:52 smithi084 ceph-mon[119097]: pgmap v1982: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:52 smithi099 ceph-mon[138788]: pgmap v1982: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:53.239 INFO:tasks.workunit.client.0.smithi084.stdout: 990: throughput=5MB/sec pending data=0 2024-01-13T18:37:53.239 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IRUshBzaysNbMxa off=7864606 len=1390040 2024-01-13T18:37:53.247 INFO:tasks.workunit.client.0.smithi084.stdout:op 5000 completed, throughput=5MB/sec 2024-01-13T18:37:53.247 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qjbHh015-TkUbyU off=13989179 len=1581813 2024-01-13T18:37:53.249 INFO:tasks.workunit.client.0.smithi084.stdout:op 5001 completed, throughput=5MB/sec 2024-01-13T18:37:53.249 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-P3Asz822WgiFNZj off=997706 len=124705 2024-01-13T18:37:53.251 INFO:tasks.workunit.client.0.smithi084.stdout:op 5002 completed, throughput=5MB/sec 2024-01-13T18:37:53.251 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-74XpIf3UKnjRKKt off=1044121 len=1745197 2024-01-13T18:37:53.254 INFO:tasks.workunit.client.0.smithi084.stdout:op 5003 completed, throughput=5MB/sec 2024-01-13T18:37:54.255 INFO:tasks.workunit.client.0.smithi084.stdout: 991: throughput=5MB/sec pending data=0 2024-01-13T18:37:54.255 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kbMEyKaoYpD_pNZ off=9684584 len=138955 2024-01-13T18:37:54.256 INFO:tasks.workunit.client.0.smithi084.stdout:op 5004 completed, throughput=5MB/sec 2024-01-13T18:37:54.256 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rIGM9eBTI7YlECE off=943921 len=1850250 2024-01-13T18:37:54.258 INFO:tasks.workunit.client.0.smithi084.stdout:op 5005 completed, throughput=5MB/sec 2024-01-13T18:37:54.258 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SoAGAckoDYDbyT_ off=2519712 len=937763 2024-01-13T18:37:54.260 INFO:tasks.workunit.client.0.smithi084.stdout:op 5006 completed, throughput=5MB/sec 2024-01-13T18:37:54.260 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j_VhaHeVPCenVJ- off=4547108 len=611675 2024-01-13T18:37:54.263 INFO:tasks.workunit.client.0.smithi084.stdout:op 5007 completed, throughput=5MB/sec 2024-01-13T18:37:54.264 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HHnIbCN7kUv0S3r off=13516030 len=1087171 2024-01-13T18:37:54.264 INFO:tasks.workunit.client.0.smithi084.stdout:op 5008 completed, throughput=5MB/sec 2024-01-13T18:37:54.264 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Qv4jETdPC0e66JA off=18603464 len=1347754 2024-01-13T18:37:54.265 INFO:tasks.workunit.client.0.smithi084.stdout:op 5009 completed, throughput=5MB/sec 2024-01-13T18:37:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:54 smithi084 ceph-mon[116404]: pgmap v1983: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:37:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:54 smithi084 ceph-mon[119097]: pgmap v1983: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:37:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:54 smithi099 ceph-mon[138788]: pgmap v1983: 105 pgs: 105 active+clean; 128 GiB data, 11 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:37:55.266 INFO:tasks.workunit.client.0.smithi084.stdout: 992: throughput=5MB/sec pending data=0 2024-01-13T18:37:55.266 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oJfViyV3Od24AZK off=6524246 len=142017 2024-01-13T18:37:55.267 INFO:tasks.workunit.client.0.smithi084.stdout:op 5010 completed, throughput=5MB/sec 2024-01-13T18:37:55.267 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UwGnlhk8xsydd-d off=6209759 len=209726 2024-01-13T18:37:55.267 INFO:tasks.workunit.client.0.smithi084.stdout:op 5011 completed, throughput=5MB/sec 2024-01-13T18:37:55.267 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ddT8wOvoIjmCECI off=5399477 len=2017102 2024-01-13T18:37:55.269 INFO:tasks.workunit.client.0.smithi084.stdout:op 5012 completed, throughput=5MB/sec 2024-01-13T18:37:55.269 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--ZRfHPCeNOKrVKu off=22384641 len=93969 2024-01-13T18:37:55.271 INFO:tasks.workunit.client.0.smithi084.stdout:op 5013 completed, throughput=5MB/sec 2024-01-13T18:37:55.271 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cn9OA1k_nT2UinG off=754900 len=1078760 2024-01-13T18:37:55.273 INFO:tasks.workunit.client.0.smithi084.stdout:op 5014 completed, throughput=5MB/sec 2024-01-13T18:37:55.273 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qMTVcuRbL3z0Ks8 off=12522785 len=140113 2024-01-13T18:37:55.276 INFO:tasks.workunit.client.0.smithi084.stdout:op 5015 completed, throughput=5MB/sec 2024-01-13T18:37:55.276 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-41MTlKQjbTncfVY off=5166277 len=604252 2024-01-13T18:37:55.280 INFO:tasks.workunit.client.0.smithi084.stdout:op 5016 completed, throughput=5MB/sec 2024-01-13T18:37:55.280 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w7CtENYXuK-ihzN off=1104033 len=1777633 2024-01-13T18:37:55.283 INFO:tasks.workunit.client.0.smithi084.stdout:op 5017 completed, throughput=5MB/sec 2024-01-13T18:37:56.284 INFO:tasks.workunit.client.0.smithi084.stdout: 993: throughput=5MB/sec pending data=0 2024-01-13T18:37:56.284 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LCWmkLO4PNZYUFi off=2257018 len=1279667 2024-01-13T18:37:56.291 INFO:tasks.workunit.client.0.smithi084.stdout:op 5018 completed, throughput=5MB/sec 2024-01-13T18:37:56.291 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ahuUUybB4z7Qi9Q off=8346948 len=1672227 2024-01-13T18:37:56.292 INFO:tasks.workunit.client.0.smithi084.stdout:op 5019 completed, throughput=5MB/sec 2024-01-13T18:37:56.292 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GrOuUNGcaYBN7SZ off=879006 len=1686322 2024-01-13T18:37:56.299 INFO:tasks.workunit.client.0.smithi084.stdout:op 5020 completed, throughput=5MB/sec 2024-01-13T18:37:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:56 smithi084 ceph-mon[116404]: pgmap v1984: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:56 smithi084 ceph-mon[119097]: pgmap v1984: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:56 smithi099 ceph-mon[138788]: pgmap v1984: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:37:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: 994: throughput=5MB/sec pending data=0 2024-01-13T18:37:57.300 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YMgY_fW9SHznAk_ off=539178 len=1186816 2024-01-13T18:37:57.306 INFO:tasks.workunit.client.0.smithi084.stdout:op 5021 completed, throughput=5MB/sec 2024-01-13T18:37:57.306 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VEjgiwqy3A2IF9_ off=1084866 len=207843 2024-01-13T18:37:57.308 INFO:tasks.workunit.client.0.smithi084.stdout:op 5022 completed, throughput=5MB/sec 2024-01-13T18:37:57.309 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qznSxpXNu36AoJb off=1642330 len=558927 2024-01-13T18:37:57.309 INFO:tasks.workunit.client.0.smithi084.stdout:op 5023 completed, throughput=5MB/sec 2024-01-13T18:37:57.309 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DRNlONxK8eh_Tvv off=5561466 len=1987303 2024-01-13T18:37:57.310 INFO:tasks.workunit.client.0.smithi084.stdout:op 5024 completed, throughput=5MB/sec 2024-01-13T18:37:57.311 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pcgHFFpTdQiFTE_ off=3370940 len=522526 2024-01-13T18:37:57.315 INFO:tasks.workunit.client.0.smithi084.stdout:op 5025 completed, throughput=5MB/sec 2024-01-13T18:37:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: 995: throughput=5MB/sec pending data=0 2024-01-13T18:37:58.316 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-meHfCV7EvYufFqr off=4152420 len=1121852 2024-01-13T18:37:58.319 INFO:tasks.workunit.client.0.smithi084.stdout:op 5026 completed, throughput=5MB/sec 2024-01-13T18:37:58.319 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Fwl5w8QgztslxvP off=10922476 len=1194209 2024-01-13T18:37:58.319 INFO:tasks.workunit.client.0.smithi084.stdout:op 5027 completed, throughput=5MB/sec 2024-01-13T18:37:58.320 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Nv1ibK-ECW5s-Qx off=1126520 len=945496 2024-01-13T18:37:58.321 INFO:tasks.workunit.client.0.smithi084.stdout:op 5028 completed, throughput=5MB/sec 2024-01-13T18:37:58.321 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CKfhmzV-aaNC-Po off=3049419 len=1042761 2024-01-13T18:37:58.322 INFO:tasks.workunit.client.0.smithi084.stdout:op 5029 completed, throughput=5MB/sec 2024-01-13T18:37:58.322 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BI46d_rMi9tQ9Ci off=21708613 len=986643 2024-01-13T18:37:58.327 INFO:tasks.workunit.client.0.smithi084.stdout:op 5030 completed, throughput=5MB/sec 2024-01-13T18:37:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: 996: throughput=5MB/sec pending data=0 2024-01-13T18:37:59.328 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZIEFsivDfHXIXuR off=60453 len=855632 2024-01-13T18:37:59.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 5031 completed, throughput=5MB/sec 2024-01-13T18:37:59.329 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FWfg08n14TwpkHo off=18195710 len=2052851 2024-01-13T18:37:59.342 INFO:tasks.workunit.client.0.smithi084.stdout:op 5032 completed, throughput=5MB/sec 2024-01-13T18:37:59.342 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oUB2RMbBpJuF5cn off=12874345 len=951283 2024-01-13T18:37:59.348 INFO:tasks.workunit.client.0.smithi084.stdout:op 5033 completed, throughput=5MB/sec 2024-01-13T18:37:59.348 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-74-m-eVlVNg6yRt off=3680145 len=1673086 2024-01-13T18:37:59.350 INFO:tasks.workunit.client.0.smithi084.stdout:op 5034 completed, throughput=5MB/sec 2024-01-13T18:37:59.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:37:59 smithi099 ceph-mon[138788]: pgmap v1985: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:37:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:37:59 smithi084 ceph-mon[116404]: pgmap v1985: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:37:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:37:59 smithi084 ceph-mon[119097]: pgmap v1985: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:38:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: 997: throughput=5MB/sec pending data=0 2024-01-13T18:38:00.350 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-njuVQ2Pc5V7T3jK off=8717840 len=1883912 2024-01-13T18:38:00.354 INFO:tasks.workunit.client.0.smithi084.stdout:op 5035 completed, throughput=5MB/sec 2024-01-13T18:38:00.354 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lfO2HbYeeZDncyF off=8629379 len=454069 2024-01-13T18:38:00.358 INFO:tasks.workunit.client.0.smithi084.stdout:op 5036 completed, throughput=5MB/sec 2024-01-13T18:38:00.358 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NFKG_gDSqhwnJiA off=4558912 len=573159 2024-01-13T18:38:00.362 INFO:tasks.workunit.client.0.smithi084.stdout:op 5037 completed, throughput=5MB/sec 2024-01-13T18:38:00.362 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WInnnZLp3ISZ7OD off=10687879 len=416263 2024-01-13T18:38:00.363 INFO:tasks.workunit.client.0.smithi084.stdout:op 5038 completed, throughput=5MB/sec 2024-01-13T18:38:00.363 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-e5Lqdlz1kPsjXC0 off=1556214 len=176225 2024-01-13T18:38:00.363 INFO:tasks.workunit.client.0.smithi084.stdout:op 5039 completed, throughput=5MB/sec 2024-01-13T18:38:00.363 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QM9vyDK8dl1kpfT off=7191931 len=1822845 2024-01-13T18:38:00.365 INFO:tasks.workunit.client.0.smithi084.stdout:op 5040 completed, throughput=5MB/sec 2024-01-13T18:38:00.641 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:38:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:38:00] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:38:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:00 smithi084 ceph-mon[116404]: pgmap v1986: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:38:00.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:00 smithi084 ceph-mon[119097]: pgmap v1986: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:38:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:00 smithi099 ceph-mon[138788]: pgmap v1986: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:38:01.366 INFO:tasks.workunit.client.0.smithi084.stdout: 998: throughput=5MB/sec pending data=0 2024-01-13T18:38:01.366 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-S3Zu0XRJZhqSGR8 off=2439936 len=172056 2024-01-13T18:38:01.368 INFO:tasks.workunit.client.0.smithi084.stdout:op 5041 completed, throughput=5MB/sec 2024-01-13T18:38:01.368 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3bsD4UXvN2j46mp off=1566490 len=1490627 2024-01-13T18:38:01.370 INFO:tasks.workunit.client.0.smithi084.stdout:op 5042 completed, throughput=5MB/sec 2024-01-13T18:38:01.371 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cOevf4wp947XGSh off=18171372 len=518588 2024-01-13T18:38:01.372 INFO:tasks.workunit.client.0.smithi084.stdout:op 5043 completed, throughput=5MB/sec 2024-01-13T18:38:01.372 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SPsgZbkjo7QieGI off=7553666 len=845504 2024-01-13T18:38:01.373 INFO:tasks.workunit.client.0.smithi084.stdout:op 5044 completed, throughput=5MB/sec 2024-01-13T18:38:01.373 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XN9KgYIw5xdeFK2 off=17829760 len=1586047 2024-01-13T18:38:01.384 INFO:tasks.workunit.client.0.smithi084.stdout:op 5045 completed, throughput=5MB/sec 2024-01-13T18:38:01.384 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tZ-L0AbKsNmz80W off=2261311 len=659190 2024-01-13T18:38:01.385 INFO:tasks.workunit.client.0.smithi084.stdout:op 5046 completed, throughput=5MB/sec 2024-01-13T18:38:02.385 INFO:tasks.workunit.client.0.smithi084.stdout: 999: throughput=5MB/sec pending data=0 2024-01-13T18:38:02.385 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jQjpJcQ4i-NytFX off=1778020 len=1283546 2024-01-13T18:38:02.393 INFO:tasks.workunit.client.0.smithi084.stdout:op 5047 completed, throughput=5MB/sec 2024-01-13T18:38:02.393 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7IQpqq61ncLZ5Mp off=3135218 len=193714 2024-01-13T18:38:02.397 INFO:tasks.workunit.client.0.smithi084.stdout:op 5048 completed, throughput=5MB/sec 2024-01-13T18:38:02.397 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wqfKmSUte6H982R off=2820616 len=326131 2024-01-13T18:38:02.398 INFO:tasks.workunit.client.0.smithi084.stdout:op 5049 completed, throughput=5MB/sec 2024-01-13T18:38:02.398 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WInnnZLp3ISZ7OD off=4141427 len=1633540 2024-01-13T18:38:02.405 INFO:tasks.workunit.client.0.smithi084.stdout:op 5050 completed, throughput=5MB/sec 2024-01-13T18:38:02.405 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dq5LOqcfoRMS1pQ off=1812021 len=1606824 2024-01-13T18:38:02.407 INFO:tasks.workunit.client.0.smithi084.stdout:op 5051 completed, throughput=5MB/sec 2024-01-13T18:38:02.407 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-l4uDx6pDVkBDJTt off=8684024 len=1860466 2024-01-13T18:38:02.415 INFO:tasks.workunit.client.0.smithi084.stdout:op 5052 completed, throughput=5MB/sec 2024-01-13T18:38:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:02 smithi084 ceph-mon[116404]: pgmap v1987: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:38:02.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:02 smithi084 ceph-mon[119097]: pgmap v1987: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:38:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:02 smithi099 ceph-mon[138788]: pgmap v1987: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:38:03.415 INFO:tasks.workunit.client.0.smithi084.stdout: 1000: throughput=5MB/sec pending data=0 2024-01-13T18:38:03.416 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IC0oA-Y0VOeVAU1 off=17912883 len=1314782 2024-01-13T18:38:03.421 INFO:tasks.workunit.client.0.smithi084.stdout:op 5053 completed, throughput=5MB/sec 2024-01-13T18:38:03.421 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lQlrP17qzZ_hM-B off=11713969 len=1058761 2024-01-13T18:38:03.422 INFO:tasks.workunit.client.0.smithi084.stdout:op 5054 completed, throughput=5MB/sec 2024-01-13T18:38:03.422 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-B569qQ_2pxu0RMD off=5747399 len=198343 2024-01-13T18:38:03.422 INFO:tasks.workunit.client.0.smithi084.stdout:op 5055 completed, throughput=5MB/sec 2024-01-13T18:38:03.422 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Pu0-LUOtREMlhmp off=9845066 len=777210 2024-01-13T18:38:03.427 INFO:tasks.workunit.client.0.smithi084.stdout:op 5056 completed, throughput=5MB/sec 2024-01-13T18:38:03.428 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lLhT1IAOyuE8ya4 off=11879351 len=731040 2024-01-13T18:38:03.429 INFO:tasks.workunit.client.0.smithi084.stdout:op 5057 completed, throughput=5MB/sec 2024-01-13T18:38:04.429 INFO:tasks.workunit.client.0.smithi084.stdout: 1001: throughput=5MB/sec pending data=0 2024-01-13T18:38:04.430 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-W1EyJFkwkw6ECad off=6129664 len=294862 2024-01-13T18:38:04.433 INFO:tasks.workunit.client.0.smithi084.stdout:op 5058 completed, throughput=5MB/sec 2024-01-13T18:38:04.433 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rC0UTPX3tBRwIpd off=13901735 len=527286 2024-01-13T18:38:04.434 INFO:tasks.workunit.client.0.smithi084.stdout:op 5059 completed, throughput=5MB/sec 2024-01-13T18:38:04.435 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0J27xq_g9QY3qKa off=2334580 len=1533690 2024-01-13T18:38:04.443 INFO:tasks.workunit.client.0.smithi084.stdout:op 5060 completed, throughput=5MB/sec 2024-01-13T18:38:04.443 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wyDXg_Djk2cHxMa off=334852 len=64189 2024-01-13T18:38:04.444 INFO:tasks.workunit.client.0.smithi084.stdout:op 5061 completed, throughput=5MB/sec 2024-01-13T18:38:04.444 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-v1UBSxny0b_0cbc off=2889040 len=657704 2024-01-13T18:38:04.448 INFO:tasks.workunit.client.0.smithi084.stdout:op 5062 completed, throughput=5MB/sec 2024-01-13T18:38:04.448 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rH1OwvOYvTcYRo_ off=7397205 len=643966 2024-01-13T18:38:04.449 INFO:tasks.workunit.client.0.smithi084.stdout:op 5063 completed, throughput=5MB/sec 2024-01-13T18:38:04.449 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lABth_ogBiR0L1V off=3031493 len=941307 2024-01-13T18:38:04.454 INFO:tasks.workunit.client.0.smithi084.stdout:op 5064 completed, throughput=5MB/sec 2024-01-13T18:38:04.454 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IPVyO8FOiTFFutE off=12660365 len=468776 2024-01-13T18:38:04.457 INFO:tasks.workunit.client.0.smithi084.stdout:op 5065 completed, throughput=5MB/sec 2024-01-13T18:38:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:04 smithi084 ceph-mon[116404]: pgmap v1988: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:38:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:04 smithi084 ceph-mon[119097]: pgmap v1988: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:38:05.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:04 smithi099 ceph-mon[138788]: pgmap v1988: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:38:05.457 INFO:tasks.workunit.client.0.smithi084.stdout: 1002: throughput=5MB/sec pending data=0 2024-01-13T18:38:05.458 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-chvyvp6EsV-PkCy off=5777162 len=1713571 2024-01-13T18:38:05.467 INFO:tasks.workunit.client.0.smithi084.stdout:op 5066 completed, throughput=5MB/sec 2024-01-13T18:38:05.467 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HGsAUITbAdW2LgJ off=4779489 len=63283 2024-01-13T18:38:05.468 INFO:tasks.workunit.client.0.smithi084.stdout:op 5067 completed, throughput=5MB/sec 2024-01-13T18:38:05.468 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_LrTH4xjNWtWxf7 off=1665404 len=298468 2024-01-13T18:38:05.469 INFO:tasks.workunit.client.0.smithi084.stdout:op 5068 completed, throughput=5MB/sec 2024-01-13T18:38:05.469 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--YtOZ0BhRZm7w6h off=22548807 len=266050 2024-01-13T18:38:05.470 INFO:tasks.workunit.client.0.smithi084.stdout:op 5069 completed, throughput=5MB/sec 2024-01-13T18:38:05.470 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--jfJr8w9VILrqrL off=7679515 len=441817 2024-01-13T18:38:05.471 INFO:tasks.workunit.client.0.smithi084.stdout:op 5070 completed, throughput=5MB/sec 2024-01-13T18:38:05.471 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Uq7F03KUxGbkutc off=1009010 len=1677630 2024-01-13T18:38:05.473 INFO:tasks.workunit.client.0.smithi084.stdout:op 5071 completed, throughput=5MB/sec 2024-01-13T18:38:05.473 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-omC9DDZ8kru3yqd off=846462 len=1100828 2024-01-13T18:38:05.478 INFO:tasks.workunit.client.0.smithi084.stdout:op 5072 completed, throughput=5MB/sec 2024-01-13T18:38:05.617 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:38:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=cleanup t=2024-01-13T18:38:05.351943616Z level=info msg="Completed cleanup jobs" duration=13.645309ms 2024-01-13T18:38:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:06.479 INFO:tasks.workunit.client.0.smithi084.stdout: 1003: throughput=5MB/sec pending data=0 2024-01-13T18:38:06.479 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dVnYRB-KUwX4yS5 off=2453306 len=160386 2024-01-13T18:38:06.479 INFO:tasks.workunit.client.0.smithi084.stdout:op 5073 completed, throughput=5MB/sec 2024-01-13T18:38:06.479 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_E89rrE00bxldEQ off=3449178 len=595519 2024-01-13T18:38:06.484 INFO:tasks.workunit.client.0.smithi084.stdout:op 5074 completed, throughput=5MB/sec 2024-01-13T18:38:06.484 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KZXBUNExwW_qQeI off=7383960 len=957171 2024-01-13T18:38:06.486 INFO:tasks.workunit.client.0.smithi084.stdout:op 5075 completed, throughput=5MB/sec 2024-01-13T18:38:06.486 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2sPJPbgHKi11n-A off=1489451 len=190737 2024-01-13T18:38:06.487 INFO:tasks.workunit.client.0.smithi084.stdout:op 5076 completed, throughput=5MB/sec 2024-01-13T18:38:06.487 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JUM_MglJIP2zy-1 off=3148323 len=1459615 2024-01-13T18:38:06.495 INFO:tasks.workunit.client.0.smithi084.stdout:op 5077 completed, throughput=5MB/sec 2024-01-13T18:38:06.495 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4hDIOkxchSD4ASH off=3055888 len=1107714 2024-01-13T18:38:06.500 INFO:tasks.workunit.client.0.smithi084.stdout:op 5078 completed, throughput=5MB/sec 2024-01-13T18:38:06.501 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pbn-AqCUBomys_c off=13991011 len=395283 2024-01-13T18:38:06.503 INFO:tasks.workunit.client.0.smithi084.stdout:op 5079 completed, throughput=5MB/sec 2024-01-13T18:38:06.503 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UwSdyF-Q3_uhMEQ off=1897276 len=924087 2024-01-13T18:38:06.508 INFO:tasks.workunit.client.0.smithi084.stdout:op 5080 completed, throughput=5MB/sec 2024-01-13T18:38:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:06 smithi084 ceph-mon[116404]: pgmap v1989: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:38:06.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:06 smithi084 ceph-mon[119097]: pgmap v1989: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:38:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:06 smithi099 ceph-mon[138788]: pgmap v1989: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:38:07.511 INFO:tasks.workunit.client.0.smithi084.stdout: 1004: throughput=5MB/sec pending data=0 2024-01-13T18:38:07.512 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-b-8R7cxbqm7dU58 off=281581 len=853478 2024-01-13T18:38:07.512 INFO:tasks.workunit.client.0.smithi084.stdout:op 5081 completed, throughput=5MB/sec 2024-01-13T18:38:07.512 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4gm5ma_ebNbZNRe off=4169316 len=746067 2024-01-13T18:38:07.512 INFO:tasks.workunit.client.0.smithi084.stdout:op 5082 completed, throughput=5MB/sec 2024-01-13T18:38:07.512 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jIkrYc5j5ndaY_- off=3599576 len=838126 2024-01-13T18:38:07.513 INFO:tasks.workunit.client.0.smithi084.stdout:op 5083 completed, throughput=5MB/sec 2024-01-13T18:38:07.513 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-H7TaV6ZZ-RG2DaD off=17734516 len=1716708 2024-01-13T18:38:07.515 INFO:tasks.workunit.client.0.smithi084.stdout:op 5084 completed, throughput=5MB/sec 2024-01-13T18:38:07.515 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2_qsiqtZIx6PAJv off=1540398 len=1009865 2024-01-13T18:38:07.519 INFO:tasks.workunit.client.0.smithi084.stdout:op 5085 completed, throughput=5MB/sec 2024-01-13T18:38:08.520 INFO:tasks.workunit.client.0.smithi084.stdout: 1005: throughput=5MB/sec pending data=0 2024-01-13T18:38:08.520 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3tPnxsVQoleFYcM off=11556659 len=223327 2024-01-13T18:38:08.523 INFO:tasks.workunit.client.0.smithi084.stdout:op 5086 completed, throughput=5MB/sec 2024-01-13T18:38:08.523 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2T-9z6A6qof18jN off=10384507 len=862674 2024-01-13T18:38:08.524 INFO:tasks.workunit.client.0.smithi084.stdout:op 5087 completed, throughput=5MB/sec 2024-01-13T18:38:08.525 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DGvZRyEpleFJun3 off=4576735 len=347458 2024-01-13T18:38:08.528 INFO:tasks.workunit.client.0.smithi084.stdout:op 5088 completed, throughput=5MB/sec 2024-01-13T18:38:08.529 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WoWAi_MIS4VaZzo off=13734879 len=635981 2024-01-13T18:38:08.529 INFO:tasks.workunit.client.0.smithi084.stdout:op 5089 completed, throughput=5MB/sec 2024-01-13T18:38:08.529 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Pg3wxW1TU29NI3P off=17382422 len=1493600 2024-01-13T18:38:08.531 INFO:tasks.workunit.client.0.smithi084.stdout:op 5090 completed, throughput=5MB/sec 2024-01-13T18:38:08.531 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VYJzEGoamvjC_zu off=1988594 len=1329202 2024-01-13T18:38:08.532 INFO:tasks.workunit.client.0.smithi084.stdout:op 5091 completed, throughput=5MB/sec 2024-01-13T18:38:09.533 INFO:tasks.workunit.client.0.smithi084.stdout: 1006: throughput=5MB/sec pending data=0 2024-01-13T18:38:09.533 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eYncbXrYbSqIV8L off=8815807 len=1672866 2024-01-13T18:38:09.541 INFO:tasks.workunit.client.0.smithi084.stdout:op 5092 completed, throughput=5MB/sec 2024-01-13T18:38:09.542 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sFeUdCV0B7R3_1B off=4669607 len=973572 2024-01-13T18:38:09.546 INFO:tasks.workunit.client.0.smithi084.stdout:op 5093 completed, throughput=5MB/sec 2024-01-13T18:38:09.546 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dnhSX2y24mVoT5T off=4850489 len=744742 2024-01-13T18:38:09.550 INFO:tasks.workunit.client.0.smithi084.stdout:op 5094 completed, throughput=5MB/sec 2024-01-13T18:38:09.550 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kGzvYVNmIYBS6fJ off=12925624 len=1799025 2024-01-13T18:38:09.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 5095 completed, throughput=5MB/sec 2024-01-13T18:38:09.559 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-87fM-sb1uynZCSO off=3116824 len=310941 2024-01-13T18:38:09.560 INFO:tasks.workunit.client.0.smithi084.stdout:op 5096 completed, throughput=5MB/sec 2024-01-13T18:38:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:09 smithi099 ceph-mon[138788]: pgmap v1990: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:38:09.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:09 smithi084 ceph-mon[116404]: pgmap v1990: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:38:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:09 smithi084 ceph-mon[119097]: pgmap v1990: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:38:10.560 INFO:tasks.workunit.client.0.smithi084.stdout: 1007: throughput=5MB/sec pending data=0 2024-01-13T18:38:10.561 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-v3l8nDBD0Xlf9od off=14973821 len=96945 2024-01-13T18:38:10.561 INFO:tasks.workunit.client.0.smithi084.stdout:op 5097 completed, throughput=5MB/sec 2024-01-13T18:38:10.561 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4L7d7VJKrDcBPB0 off=110509 len=646133 2024-01-13T18:38:10.566 INFO:tasks.workunit.client.0.smithi084.stdout:op 5098 completed, throughput=5MB/sec 2024-01-13T18:38:10.566 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9rxc8KlrE7algBT off=5740459 len=1212811 2024-01-13T18:38:10.567 INFO:tasks.workunit.client.0.smithi084.stdout:op 5099 completed, throughput=5MB/sec 2024-01-13T18:38:10.567 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1zCbVywGKjHCaO3 off=7433506 len=912474 2024-01-13T18:38:10.569 INFO:tasks.workunit.client.0.smithi084.stdout:op 5100 completed, throughput=5MB/sec 2024-01-13T18:38:10.569 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EsqtLDIy-ApLLNl off=18799924 len=1506203 2024-01-13T18:38:10.574 INFO:tasks.workunit.client.0.smithi084.stdout:op 5101 completed, throughput=5MB/sec 2024-01-13T18:38:10.575 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YJCM25E5lwRHt4a off=3342096 len=1865368 2024-01-13T18:38:10.578 INFO:tasks.workunit.client.0.smithi084.stdout:op 5102 completed, throughput=5MB/sec 2024-01-13T18:38:10.642 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:38:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:38:10] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:38:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:10 smithi084 ceph-mon[116404]: pgmap v1991: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 6 op/s 2024-01-13T18:38:10.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:10 smithi084 ceph-mon[119097]: pgmap v1991: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 6 op/s 2024-01-13T18:38:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:10 smithi099 ceph-mon[138788]: pgmap v1991: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 6 op/s 2024-01-13T18:38:11.578 INFO:tasks.workunit.client.0.smithi084.stdout: 1008: throughput=5MB/sec pending data=0 2024-01-13T18:38:11.578 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LIrKAF4Ebx3DWGS off=377201 len=211778 2024-01-13T18:38:11.579 INFO:tasks.workunit.client.0.smithi084.stdout:op 5103 completed, throughput=5MB/sec 2024-01-13T18:38:11.579 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PgG8O7qNDw3wTCA off=16135735 len=462914 2024-01-13T18:38:11.582 INFO:tasks.workunit.client.0.smithi084.stdout:op 5104 completed, throughput=5MB/sec 2024-01-13T18:38:11.583 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7R9xI4CgQ3V8re8 off=20189660 len=2017555 2024-01-13T18:38:11.586 INFO:tasks.workunit.client.0.smithi084.stdout:op 5105 completed, throughput=5MB/sec 2024-01-13T18:38:11.586 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HDcXnee7CfDG9-Z off=10853380 len=674301 2024-01-13T18:38:11.587 INFO:tasks.workunit.client.0.smithi084.stdout:op 5106 completed, throughput=5MB/sec 2024-01-13T18:38:11.587 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rF9TwyFhQj-HXN0 off=6541326 len=1752502 2024-01-13T18:38:11.597 INFO:tasks.workunit.client.0.smithi084.stdout:op 5107 completed, throughput=5MB/sec 2024-01-13T18:38:12.597 INFO:tasks.workunit.client.0.smithi084.stdout: 1009: throughput=5MB/sec pending data=0 2024-01-13T18:38:12.597 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Kza0sEwHL_W2Lhr off=736717 len=156140 2024-01-13T18:38:12.598 INFO:tasks.workunit.client.0.smithi084.stdout:op 5108 completed, throughput=5MB/sec 2024-01-13T18:38:12.598 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3OVaoRZ2kZJlU1r off=445787 len=2046150 2024-01-13T18:38:12.602 INFO:tasks.workunit.client.0.smithi084.stdout:op 5109 completed, throughput=5MB/sec 2024-01-13T18:38:12.602 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tCwUt5Pop79pOux off=4095102 len=128083 2024-01-13T18:38:12.602 INFO:tasks.workunit.client.0.smithi084.stdout:op 5110 completed, throughput=5MB/sec 2024-01-13T18:38:12.602 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tHuq0NOPTzUXwFw off=6380047 len=1102794 2024-01-13T18:38:12.608 INFO:tasks.workunit.client.0.smithi084.stdout:op 5111 completed, throughput=5MB/sec 2024-01-13T18:38:12.608 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LzhJohvK4SWF2AD off=2707442 len=1253322 2024-01-13T18:38:12.610 INFO:tasks.workunit.client.0.smithi084.stdout:op 5112 completed, throughput=5MB/sec 2024-01-13T18:38:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:12 smithi084 ceph-mon[116404]: pgmap v1992: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:38:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:12 smithi084 ceph-mon[119097]: pgmap v1992: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:38:13.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:12 smithi099 ceph-mon[138788]: pgmap v1992: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:38:13.610 INFO:tasks.workunit.client.0.smithi084.stdout: 1010: throughput=5MB/sec pending data=0 2024-01-13T18:38:13.610 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L9Yarb27fgds6q1 off=750553 len=776973 2024-01-13T18:38:13.611 INFO:tasks.workunit.client.0.smithi084.stdout:op 5113 completed, throughput=5MB/sec 2024-01-13T18:38:13.611 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HalMKa2mq2YL53q off=1314633 len=155638 2024-01-13T18:38:13.614 INFO:tasks.workunit.client.0.smithi084.stdout:op 5114 completed, throughput=5MB/sec 2024-01-13T18:38:13.615 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sCNnHKtnVu5q4uH off=3608502 len=415432 2024-01-13T18:38:13.616 INFO:tasks.workunit.client.0.smithi084.stdout:op 5115 completed, throughput=5MB/sec 2024-01-13T18:38:13.616 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZhetAMT0-GuT9vI off=7387722 len=1343625 2024-01-13T18:38:13.617 INFO:tasks.workunit.client.0.smithi084.stdout:op 5116 completed, throughput=5MB/sec 2024-01-13T18:38:13.617 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-17VtA8thKg0wFNq off=13286925 len=1753409 2024-01-13T18:38:13.619 INFO:tasks.workunit.client.0.smithi084.stdout:op 5117 completed, throughput=5MB/sec 2024-01-13T18:38:13.619 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qMqKA1YC-nx5M4O off=2311256 len=1704386 2024-01-13T18:38:13.628 INFO:tasks.workunit.client.0.smithi084.stdout:op 5118 completed, throughput=5MB/sec 2024-01-13T18:38:14.628 INFO:tasks.workunit.client.0.smithi084.stdout: 1011: throughput=5MB/sec pending data=0 2024-01-13T18:38:14.628 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kOt1Qa4z-I_uK_Y off=1360202 len=187326 2024-01-13T18:38:14.632 INFO:tasks.workunit.client.0.smithi084.stdout:op 5119 completed, throughput=5MB/sec 2024-01-13T18:38:14.632 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KiO7nNNVXMW5b1f off=3803427 len=1409449 2024-01-13T18:38:14.639 INFO:tasks.workunit.client.0.smithi084.stdout:op 5120 completed, throughput=5MB/sec 2024-01-13T18:38:14.640 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lLiY8TuuOThlf7Y off=442265 len=542942 2024-01-13T18:38:14.640 INFO:tasks.workunit.client.0.smithi084.stdout:op 5121 completed, throughput=5MB/sec 2024-01-13T18:38:14.640 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7_yu6QKirlE9IXX off=7741735 len=2046219 2024-01-13T18:38:14.642 INFO:tasks.workunit.client.0.smithi084.stdout:op 5122 completed, throughput=5MB/sec 2024-01-13T18:38:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:14 smithi084 ceph-mon[116404]: pgmap v1993: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 6 op/s 2024-01-13T18:38:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:14 smithi084 ceph-mon[119097]: pgmap v1993: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 6 op/s 2024-01-13T18:38:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:14 smithi099 ceph-mon[138788]: pgmap v1993: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 6 op/s 2024-01-13T18:38:15.643 INFO:tasks.workunit.client.0.smithi084.stdout: 1012: throughput=5MB/sec pending data=0 2024-01-13T18:38:15.643 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VEcjJIuFxOu31Tj off=7771544 len=1831864 2024-01-13T18:38:15.645 INFO:tasks.workunit.client.0.smithi084.stdout:op 5123 completed, throughput=5MB/sec 2024-01-13T18:38:15.645 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8LqLqVECJ4saxSE off=20781735 len=394574 2024-01-13T18:38:15.648 INFO:tasks.workunit.client.0.smithi084.stdout:op 5124 completed, throughput=5MB/sec 2024-01-13T18:38:15.648 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6OticBFVZ01gdZz off=2144664 len=458516 2024-01-13T18:38:15.649 INFO:tasks.workunit.client.0.smithi084.stdout:op 5125 completed, throughput=5MB/sec 2024-01-13T18:38:15.650 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KChjLn0LZoQT1Iq off=11205385 len=2088673 2024-01-13T18:38:15.661 INFO:tasks.workunit.client.0.smithi084.stdout:op 5126 completed, throughput=5MB/sec 2024-01-13T18:38:15.661 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rP5pnEaprXGpsAx off=15607946 len=879447 2024-01-13T18:38:15.662 INFO:tasks.workunit.client.0.smithi084.stdout:op 5127 completed, throughput=5MB/sec 2024-01-13T18:38:16.663 INFO:tasks.workunit.client.0.smithi084.stdout: 1013: throughput=5MB/sec pending data=0 2024-01-13T18:38:16.663 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kHIoArdY8qJ3aop off=1916476 len=997514 2024-01-13T18:38:16.667 INFO:tasks.workunit.client.0.smithi084.stdout:op 5128 completed, throughput=5MB/sec 2024-01-13T18:38:16.667 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NFiA28cItk9YnAl off=11659855 len=1652159 2024-01-13T18:38:16.670 INFO:tasks.workunit.client.0.smithi084.stdout:op 5129 completed, throughput=5MB/sec 2024-01-13T18:38:16.671 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZtvDjUg7RskdAw5 off=5698962 len=1393155 2024-01-13T18:38:16.672 INFO:tasks.workunit.client.0.smithi084.stdout:op 5130 completed, throughput=5MB/sec 2024-01-13T18:38:16.672 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-22ME2-ZukpFPvzs off=3668636 len=6494 2024-01-13T18:38:16.673 INFO:tasks.workunit.client.0.smithi084.stdout:op 5131 completed, throughput=5MB/sec 2024-01-13T18:38:16.673 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HhAcKx0S88-b6QD off=2616953 len=715783 2024-01-13T18:38:16.677 INFO:tasks.workunit.client.0.smithi084.stdout:op 5132 completed, throughput=5MB/sec 2024-01-13T18:38:16.677 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-F-lBEN493DE1pBq off=14622257 len=858733 2024-01-13T18:38:16.678 INFO:tasks.workunit.client.0.smithi084.stdout:op 5133 completed, throughput=5MB/sec 2024-01-13T18:38:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:16 smithi084 ceph-mon[116404]: pgmap v1994: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:38:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:16 smithi084 ceph-mon[119097]: pgmap v1994: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:38:17.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:16 smithi099 ceph-mon[138788]: pgmap v1994: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-01-13T18:38:17.679 INFO:tasks.workunit.client.0.smithi084.stdout: 1014: throughput=5MB/sec pending data=0 2024-01-13T18:38:17.679 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--T1noDzXubAp7iK off=47560 len=1561628 2024-01-13T18:38:17.681 INFO:tasks.workunit.client.0.smithi084.stdout:op 5134 completed, throughput=5MB/sec 2024-01-13T18:38:17.681 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yV6ShHGnLgeRYRh off=18192201 len=1562606 2024-01-13T18:38:17.689 INFO:tasks.workunit.client.0.smithi084.stdout:op 5135 completed, throughput=5MB/sec 2024-01-13T18:38:17.689 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AckKH_hiN88FpFl off=794113 len=1957748 2024-01-13T18:38:17.691 INFO:tasks.workunit.client.0.smithi084.stdout:op 5136 completed, throughput=5MB/sec 2024-01-13T18:38:18.692 INFO:tasks.workunit.client.0.smithi084.stdout: 1015: throughput=5MB/sec pending data=0 2024-01-13T18:38:18.692 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XonAFW5yeGNBi_I off=9581357 len=1515652 2024-01-13T18:38:18.695 INFO:tasks.workunit.client.0.smithi084.stdout:op 5137 completed, throughput=5MB/sec 2024-01-13T18:38:18.695 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ONviTUtHgo7GeDp off=633884 len=1957440 2024-01-13T18:38:18.707 INFO:tasks.workunit.client.0.smithi084.stdout:op 5138 completed, throughput=5MB/sec 2024-01-13T18:38:18.707 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6ZvdIsq6x6DxdGf off=706866 len=560417 2024-01-13T18:38:18.707 INFO:tasks.workunit.client.0.smithi084.stdout:op 5139 completed, throughput=5MB/sec 2024-01-13T18:38:18.708 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NtB2AKPQ5GOAA1C off=20451515 len=2022421 2024-01-13T18:38:18.718 INFO:tasks.workunit.client.0.smithi084.stdout:op 5140 completed, throughput=5MB/sec 2024-01-13T18:38:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:19 smithi099 ceph-mon[138788]: pgmap v1995: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:38:19.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:19 smithi084 ceph-mon[116404]: pgmap v1995: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:38:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:19 smithi084 ceph-mon[119097]: pgmap v1995: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 5 op/s 2024-01-13T18:38:19.718 INFO:tasks.workunit.client.0.smithi084.stdout: 1016: throughput=5MB/sec pending data=0 2024-01-13T18:38:19.719 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-leqEesf6DVbSuum off=1737476 len=18457 2024-01-13T18:38:19.721 INFO:tasks.workunit.client.0.smithi084.stdout:op 5141 completed, throughput=5MB/sec 2024-01-13T18:38:19.721 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-p7AByZYPR67EppQ off=1932346 len=1317094 2024-01-13T18:38:19.728 INFO:tasks.workunit.client.0.smithi084.stdout:op 5142 completed, throughput=5MB/sec 2024-01-13T18:38:19.728 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-flb15VVUJTTtz2t off=16303055 len=678157 2024-01-13T18:38:19.729 INFO:tasks.workunit.client.0.smithi084.stdout:op 5143 completed, throughput=5MB/sec 2024-01-13T18:38:19.729 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0dro8zfHflUyB75 off=8225601 len=584927 2024-01-13T18:38:19.730 INFO:tasks.workunit.client.0.smithi084.stdout:op 5144 completed, throughput=5MB/sec 2024-01-13T18:38:19.730 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sxD0IrymFXDzCxF off=2057360 len=958062 2024-01-13T18:38:19.730 INFO:tasks.workunit.client.0.smithi084.stdout:op 5145 completed, throughput=5MB/sec 2024-01-13T18:38:19.731 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Mqc6C5Jep7_64E5 off=2261148 len=482106 2024-01-13T18:38:19.731 INFO:tasks.workunit.client.0.smithi084.stdout:op 5146 completed, throughput=5MB/sec 2024-01-13T18:38:19.732 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AjmoZWxRhM1_u3r off=2781111 len=1366496 2024-01-13T18:38:19.732 INFO:tasks.workunit.client.0.smithi084.stdout:op 5147 completed, throughput=5MB/sec 2024-01-13T18:38:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:20.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:38:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:38:20] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:38:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:20.733 INFO:tasks.workunit.client.0.smithi084.stdout: 1017: throughput=5MB/sec pending data=0 2024-01-13T18:38:20.733 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2_qsiqtZIx6PAJv off=22677645 len=930738 2024-01-13T18:38:20.734 INFO:tasks.workunit.client.0.smithi084.stdout:op 5148 completed, throughput=5MB/sec 2024-01-13T18:38:20.734 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-J9FzTTXUlnzJJRi off=10346293 len=1333032 2024-01-13T18:38:20.742 INFO:tasks.workunit.client.0.smithi084.stdout:op 5149 completed, throughput=5MB/sec 2024-01-13T18:38:20.742 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TSuEvLljM_HAZjC off=3712458 len=1097613 2024-01-13T18:38:20.743 INFO:tasks.workunit.client.0.smithi084.stdout:op 5150 completed, throughput=5MB/sec 2024-01-13T18:38:20.743 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9ZgC4xdxS0xpkYM off=4756931 len=171436 2024-01-13T18:38:20.746 INFO:tasks.workunit.client.0.smithi084.stdout:op 5151 completed, throughput=5MB/sec 2024-01-13T18:38:20.746 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9ZgC4xdxS0xpkYM off=3721860 len=1451394 2024-01-13T18:38:20.754 INFO:tasks.workunit.client.0.smithi084.stdout:op 5152 completed, throughput=5MB/sec 2024-01-13T18:38:21.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:21 smithi099 ceph-mon[138788]: pgmap v1996: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:38:21.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:21 smithi084 ceph-mon[116404]: pgmap v1996: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:38:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:21 smithi084 ceph-mon[119097]: pgmap v1996: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-01-13T18:38:21.754 INFO:tasks.workunit.client.0.smithi084.stdout: 1018: throughput=5MB/sec pending data=0 2024-01-13T18:38:21.754 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ttNsLb6wrUfIOfC off=15585865 len=25839 2024-01-13T18:38:21.756 INFO:tasks.workunit.client.0.smithi084.stdout:op 5153 completed, throughput=5MB/sec 2024-01-13T18:38:21.756 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-t3cCCGCQ5g3qmVt off=8912136 len=552041 2024-01-13T18:38:21.760 INFO:tasks.workunit.client.0.smithi084.stdout:op 5154 completed, throughput=5MB/sec 2024-01-13T18:38:21.761 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kHW6ky9daZZvDRU off=517061 len=555295 2024-01-13T18:38:21.764 INFO:tasks.workunit.client.0.smithi084.stdout:op 5155 completed, throughput=5MB/sec 2024-01-13T18:38:21.765 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZRALwEPaYMKP4Ks off=8495078 len=374033 2024-01-13T18:38:21.765 INFO:tasks.workunit.client.0.smithi084.stdout:op 5156 completed, throughput=5MB/sec 2024-01-13T18:38:21.765 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NVhw-v6Qy6K2rwe off=1780127 len=848476 2024-01-13T18:38:21.770 INFO:tasks.workunit.client.0.smithi084.stdout:op 5157 completed, throughput=5MB/sec 2024-01-13T18:38:21.770 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5ER0AvZik0430BG off=5087387 len=1852571 2024-01-13T18:38:21.778 INFO:tasks.workunit.client.0.smithi084.stdout:op 5158 completed, throughput=5MB/sec 2024-01-13T18:38:21.778 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eJBng1eW0050UNV off=6306764 len=371656 2024-01-13T18:38:21.779 INFO:tasks.workunit.client.0.smithi084.stdout:op 5159 completed, throughput=5MB/sec 2024-01-13T18:38:21.779 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_vi_XHQWjKFuCgh off=17733515 len=653215 2024-01-13T18:38:21.783 INFO:tasks.workunit.client.0.smithi084.stdout:op 5160 completed, throughput=5MB/sec 2024-01-13T18:38:22.783 INFO:tasks.workunit.client.0.smithi084.stdout: 1019: throughput=5MB/sec pending data=0 2024-01-13T18:38:22.783 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--6C_VPAPaW68w6N off=16350579 len=2092025 2024-01-13T18:38:22.792 INFO:tasks.workunit.client.0.smithi084.stdout:op 5161 completed, throughput=5MB/sec 2024-01-13T18:38:22.792 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UtYHAdTKWR8oycu off=9257654 len=163599 2024-01-13T18:38:22.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 5162 completed, throughput=5MB/sec 2024-01-13T18:38:22.795 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lvy54vXOojVKKlu off=4707252 len=215049 2024-01-13T18:38:22.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 5163 completed, throughput=5MB/sec 2024-01-13T18:38:22.796 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-djPsckJ5eqoYgg- off=446941 len=244510 2024-01-13T18:38:22.796 INFO:tasks.workunit.client.0.smithi084.stdout:op 5164 completed, throughput=5MB/sec 2024-01-13T18:38:22.796 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VVUQ4v0ZdkeeLlD off=114430 len=1505813 2024-01-13T18:38:22.797 INFO:tasks.workunit.client.0.smithi084.stdout:op 5165 completed, throughput=5MB/sec 2024-01-13T18:38:22.797 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3Xk7TwVCl8nak7h off=10746705 len=607386 2024-01-13T18:38:22.798 INFO:tasks.workunit.client.0.smithi084.stdout:op 5166 completed, throughput=5MB/sec 2024-01-13T18:38:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:22 smithi084 ceph-mon[116404]: pgmap v1997: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:38:22.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:22 smithi084 ceph-mon[119097]: pgmap v1997: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:38:23.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:22 smithi099 ceph-mon[138788]: pgmap v1997: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:38:23.799 INFO:tasks.workunit.client.0.smithi084.stdout: 1020: throughput=5MB/sec pending data=0 2024-01-13T18:38:23.799 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9gnKBm7FUId-WCp off=4427862 len=1586238 2024-01-13T18:38:23.805 INFO:tasks.workunit.client.0.smithi084.stdout:op 5167 completed, throughput=5MB/sec 2024-01-13T18:38:23.806 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RN1pdU23dAYdT01 off=9143423 len=115009 2024-01-13T18:38:23.808 INFO:tasks.workunit.client.0.smithi084.stdout:op 5168 completed, throughput=5MB/sec 2024-01-13T18:38:23.808 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e0tlQ8gKd6yaup1 off=12561151 len=1053000 2024-01-13T18:38:23.814 INFO:tasks.workunit.client.0.smithi084.stdout:op 5169 completed, throughput=5MB/sec 2024-01-13T18:38:23.814 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JvckgKV87wpES79 off=20642346 len=942090 2024-01-13T18:38:23.819 INFO:tasks.workunit.client.0.smithi084.stdout:op 5170 completed, throughput=5MB/sec 2024-01-13T18:38:23.819 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dbjbDPeISq2HlcW off=13157604 len=1740516 2024-01-13T18:38:23.829 INFO:tasks.workunit.client.0.smithi084.stdout:op 5171 completed, throughput=5MB/sec 2024-01-13T18:38:24.830 INFO:tasks.workunit.client.0.smithi084.stdout: 1021: throughput=5MB/sec pending data=0 2024-01-13T18:38:24.830 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zFxfDqy4ZUxrT5g off=1882962 len=701048 2024-01-13T18:38:24.834 INFO:tasks.workunit.client.0.smithi084.stdout:op 5172 completed, throughput=5MB/sec 2024-01-13T18:38:24.834 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NyLhaI8PwbkJ9Np off=6367363 len=1507031 2024-01-13T18:38:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:op 5173 completed, throughput=5MB/sec 2024-01-13T18:38:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pLmlTqO3goMxQ4i off=12078826 len=926614 2024-01-13T18:38:24.852 INFO:tasks.workunit.client.0.smithi084.stdout:op 5174 completed, throughput=5MB/sec 2024-01-13T18:38:24.853 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6ObWcTXRYlb0GDY off=62506 len=31345 2024-01-13T18:38:24.853 INFO:tasks.workunit.client.0.smithi084.stdout:op 5175 completed, throughput=5MB/sec 2024-01-13T18:38:24.853 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aUNONzs6WoQFovV off=6277086 len=1513634 2024-01-13T18:38:24.854 INFO:tasks.workunit.client.0.smithi084.stdout:op 5176 completed, throughput=5MB/sec 2024-01-13T18:38:24.855 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_KC56q9FIoKQ2dn off=2956093 len=1751096 2024-01-13T18:38:24.863 INFO:tasks.workunit.client.0.smithi084.stdout:op 5177 completed, throughput=5MB/sec 2024-01-13T18:38:24.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:24 smithi084 ceph-mon[116404]: pgmap v1998: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:38:24.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:24 smithi084 ceph-mon[119097]: pgmap v1998: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:38:25.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:24 smithi099 ceph-mon[138788]: pgmap v1998: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:38:25.864 INFO:tasks.workunit.client.0.smithi084.stdout: 1022: throughput=5MB/sec pending data=0 2024-01-13T18:38:25.864 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4HGit31fl4dhrOb off=1179116 len=1119209 2024-01-13T18:38:25.870 INFO:tasks.workunit.client.0.smithi084.stdout:op 5178 completed, throughput=5MB/sec 2024-01-13T18:38:25.870 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-V8Q6Ub6Me_c0Ncj off=17658512 len=146994 2024-01-13T18:38:25.872 INFO:tasks.workunit.client.0.smithi084.stdout:op 5179 completed, throughput=5MB/sec 2024-01-13T18:38:25.872 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LaQigBdQztcNI3H off=594627 len=1545421 2024-01-13T18:38:25.879 INFO:tasks.workunit.client.0.smithi084.stdout:op 5180 completed, throughput=5MB/sec 2024-01-13T18:38:25.879 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-D2E1uxjXti_jfsJ off=6280220 len=99389 2024-01-13T18:38:25.881 INFO:tasks.workunit.client.0.smithi084.stdout:op 5181 completed, throughput=5MB/sec 2024-01-13T18:38:25.882 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rcBoWXPTMHhbwKx off=20381651 len=1757007 2024-01-13T18:38:25.891 INFO:tasks.workunit.client.0.smithi084.stdout:op 5182 completed, throughput=5MB/sec 2024-01-13T18:38:26.891 INFO:tasks.workunit.client.0.smithi084.stdout: 1023: throughput=5MB/sec pending data=0 2024-01-13T18:38:26.891 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tsAN-EBoYRswbm5 off=8365455 len=1590624 2024-01-13T18:38:26.900 INFO:tasks.workunit.client.0.smithi084.stdout:op 5183 completed, throughput=5MB/sec 2024-01-13T18:38:26.900 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UWN6z85qY8yl7dn off=7720369 len=1562424 2024-01-13T18:38:26.907 INFO:tasks.workunit.client.0.smithi084.stdout:op 5184 completed, throughput=5MB/sec 2024-01-13T18:38:26.907 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1vIOHvvPDDKAWyr off=4482059 len=994695 2024-01-13T18:38:26.908 INFO:tasks.workunit.client.0.smithi084.stdout:op 5185 completed, throughput=5MB/sec 2024-01-13T18:38:26.908 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qkKixmVV3kdv_nh off=4344404 len=585074 2024-01-13T18:38:26.909 INFO:tasks.workunit.client.0.smithi084.stdout:op 5186 completed, throughput=5MB/sec 2024-01-13T18:38:26.909 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gwIM0rcwXpTggCw off=1303549 len=647663 2024-01-13T18:38:26.913 INFO:tasks.workunit.client.0.smithi084.stdout:op 5187 completed, throughput=5MB/sec 2024-01-13T18:38:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:26 smithi084 ceph-mon[116404]: pgmap v1999: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:38:26.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:26 smithi084 ceph-mon[119097]: pgmap v1999: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:38:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:26 smithi099 ceph-mon[138788]: pgmap v1999: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:38:27.913 INFO:tasks.workunit.client.0.smithi084.stdout: 1024: throughput=5MB/sec pending data=0 2024-01-13T18:38:27.914 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qk6MSBG5uZwaWMe off=4247328 len=783330 2024-01-13T18:38:27.915 INFO:tasks.workunit.client.0.smithi084.stdout:op 5188 completed, throughput=5MB/sec 2024-01-13T18:38:27.915 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-95HYw9H2snq4R8x off=18353991 len=417769 2024-01-13T18:38:27.916 INFO:tasks.workunit.client.0.smithi084.stdout:op 5189 completed, throughput=5MB/sec 2024-01-13T18:38:27.916 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YsduU7fg92fLW2q off=15548398 len=1228063 2024-01-13T18:38:27.922 INFO:tasks.workunit.client.0.smithi084.stdout:op 5190 completed, throughput=5MB/sec 2024-01-13T18:38:27.922 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CbQG3_G4cbtucdb off=1548423 len=223518 2024-01-13T18:38:27.923 INFO:tasks.workunit.client.0.smithi084.stdout:op 5191 completed, throughput=5MB/sec 2024-01-13T18:38:27.923 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TbbkS3JbgG6DREV off=4181870 len=1674075 2024-01-13T18:38:27.931 INFO:tasks.workunit.client.0.smithi084.stdout:op 5192 completed, throughput=5MB/sec 2024-01-13T18:38:27.931 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G1qE50BJEhmeFAD off=5493748 len=1275920 2024-01-13T18:38:27.940 INFO:tasks.workunit.client.0.smithi084.stdout:op 5193 completed, throughput=5MB/sec 2024-01-13T18:38:28.940 INFO:tasks.workunit.client.0.smithi084.stdout: 1025: throughput=5MB/sec pending data=0 2024-01-13T18:38:28.940 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AoVlDJIH8xl5oO3 off=2028220 len=875488 2024-01-13T18:38:28.941 INFO:tasks.workunit.client.0.smithi084.stdout:op 5194 completed, throughput=5MB/sec 2024-01-13T18:38:28.941 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Fij6iTo6XWlS-cc off=522256 len=1018845 2024-01-13T18:38:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:op 5195 completed, throughput=5MB/sec 2024-01-13T18:38:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-R9fod15trswHeal off=1349548 len=1911057 2024-01-13T18:38:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:op 5196 completed, throughput=5MB/sec 2024-01-13T18:38:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-z2NhPNMFTfiF0E8 off=7704280 len=423969 2024-01-13T18:38:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:op 5197 completed, throughput=5MB/sec 2024-01-13T18:38:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3ummY6Sj_s-64mB off=7261039 len=352587 2024-01-13T18:38:28.950 INFO:tasks.workunit.client.0.smithi084.stdout:op 5198 completed, throughput=5MB/sec 2024-01-13T18:38:28.950 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0YajfSQp592SZla off=20056483 len=2018416 2024-01-13T18:38:28.952 INFO:tasks.workunit.client.0.smithi084.stdout:op 5199 completed, throughput=5MB/sec 2024-01-13T18:38:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:29 smithi099 ceph-mon[138788]: pgmap v2000: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:38:29.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:29 smithi084 ceph-mon[116404]: pgmap v2000: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:38:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:29 smithi084 ceph-mon[119097]: pgmap v2000: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:38:29.952 INFO:tasks.workunit.client.0.smithi084.stdout: 1026: throughput=5MB/sec pending data=0 2024-01-13T18:38:29.952 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rgAl5K09UaV6phG off=8667386 len=142087 2024-01-13T18:38:29.953 INFO:tasks.workunit.client.0.smithi084.stdout:op 5200 completed, throughput=5MB/sec 2024-01-13T18:38:29.953 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vm5kKEJGc-9X4OM off=10492 len=1063263 2024-01-13T18:38:29.959 INFO:tasks.workunit.client.0.smithi084.stdout:op 5201 completed, throughput=5MB/sec 2024-01-13T18:38:29.959 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XQF-_6GUSpAclBH off=7308809 len=2085684 2024-01-13T18:38:29.961 INFO:tasks.workunit.client.0.smithi084.stdout:op 5202 completed, throughput=5MB/sec 2024-01-13T18:38:29.961 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6iwbdxfE2nhyZuC off=3827246 len=856370 2024-01-13T18:38:29.962 INFO:tasks.workunit.client.0.smithi084.stdout:op 5203 completed, throughput=5MB/sec 2024-01-13T18:38:30.648 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:38:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:38:30] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:38:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:30 smithi084 ceph-mon[116404]: pgmap v2001: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 5 op/s 2024-01-13T18:38:30.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:30 smithi084 ceph-mon[119097]: pgmap v2001: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 5 op/s 2024-01-13T18:38:30.963 INFO:tasks.workunit.client.0.smithi084.stdout: 1027: throughput=5MB/sec pending data=0 2024-01-13T18:38:30.963 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4Rsmp9SrLW_eAH1 off=7004762 len=1257857 2024-01-13T18:38:30.971 INFO:tasks.workunit.client.0.smithi084.stdout:op 5204 completed, throughput=5MB/sec 2024-01-13T18:38:30.971 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AhgoTQrhkeUYc_J off=1127697 len=1205031 2024-01-13T18:38:30.973 INFO:tasks.workunit.client.0.smithi084.stdout:op 5205 completed, throughput=5MB/sec 2024-01-13T18:38:30.973 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aBhQbZrE70k3N0F off=13403802 len=1989322 2024-01-13T18:38:30.975 INFO:tasks.workunit.client.0.smithi084.stdout:op 5206 completed, throughput=5MB/sec 2024-01-13T18:38:30.975 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pS2azm5Bs2TPNcw off=5973132 len=417814 2024-01-13T18:38:30.976 INFO:tasks.workunit.client.0.smithi084.stdout:op 5207 completed, throughput=5MB/sec 2024-01-13T18:38:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:30 smithi099 ceph-mon[138788]: pgmap v2001: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 5 op/s 2024-01-13T18:38:31.977 INFO:tasks.workunit.client.0.smithi084.stdout: 1028: throughput=5MB/sec pending data=0 2024-01-13T18:38:31.977 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BlZeH8e940FXIFr off=14427010 len=1521448 2024-01-13T18:38:31.978 INFO:tasks.workunit.client.0.smithi084.stdout:op 5208 completed, throughput=5MB/sec 2024-01-13T18:38:31.978 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eDwucj-mbexEPhp off=1155477 len=1683757 2024-01-13T18:38:31.980 INFO:tasks.workunit.client.0.smithi084.stdout:op 5209 completed, throughput=5MB/sec 2024-01-13T18:38:31.980 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jICaolGtYHVdYBO off=17409432 len=141867 2024-01-13T18:38:31.981 INFO:tasks.workunit.client.0.smithi084.stdout:op 5210 completed, throughput=5MB/sec 2024-01-13T18:38:31.981 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1_CJ1VnQxbZt49n off=3692503 len=238531 2024-01-13T18:38:31.981 INFO:tasks.workunit.client.0.smithi084.stdout:op 5211 completed, throughput=5MB/sec 2024-01-13T18:38:31.982 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JoIhY1xKXU-ewWU off=23334700 len=694043 2024-01-13T18:38:31.982 INFO:tasks.workunit.client.0.smithi084.stdout:op 5212 completed, throughput=5MB/sec 2024-01-13T18:38:31.982 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-buoBDBYgFgoY5Nh off=476353 len=1713619 2024-01-13T18:38:31.984 INFO:tasks.workunit.client.0.smithi084.stdout:op 5213 completed, throughput=5MB/sec 2024-01-13T18:38:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:38:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:38:32.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:38:32.984 INFO:tasks.workunit.client.0.smithi084.stdout: 1029: throughput=5MB/sec pending data=0 2024-01-13T18:38:32.984 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VEGBNJuBUnri8aG off=3291069 len=1707813 2024-01-13T18:38:32.992 INFO:tasks.workunit.client.0.smithi084.stdout:op 5214 completed, throughput=5MB/sec 2024-01-13T18:38:32.992 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Fqs9qU5dNxX3NXi off=342525 len=1883188 2024-01-13T18:38:33.000 INFO:tasks.workunit.client.0.smithi084.stdout:op 5215 completed, throughput=5MB/sec 2024-01-13T18:38:33.000 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-dCpPTskWOaXB-CZ off=11932250 len=1107683 2024-01-13T18:38:33.005 INFO:tasks.workunit.client.0.smithi084.stdout:op 5216 completed, throughput=5MB/sec 2024-01-13T18:38:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:32 smithi084 ceph-mon[116404]: pgmap v2002: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:38:33.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:32 smithi084 ceph-mon[119097]: pgmap v2002: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:38:33.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:32 smithi099 ceph-mon[138788]: pgmap v2002: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:38:34.005 INFO:tasks.workunit.client.0.smithi084.stdout: 1030: throughput=5MB/sec pending data=0 2024-01-13T18:38:34.006 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-i4j057FJin0bkGb off=0 len=2052834 2024-01-13T18:38:34.007 INFO:tasks.workunit.client.0.smithi084.stdout:op 5217 completed, throughput=5MB/sec 2024-01-13T18:38:34.007 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dHyUcGvtDVO9-_n off=9824147 len=309536 2024-01-13T18:38:34.008 INFO:tasks.workunit.client.0.smithi084.stdout:op 5218 completed, throughput=5MB/sec 2024-01-13T18:38:34.008 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gpm3LcH5Stf5wKW off=12176911 len=1243253 2024-01-13T18:38:34.009 INFO:tasks.workunit.client.0.smithi084.stdout:op 5219 completed, throughput=5MB/sec 2024-01-13T18:38:34.009 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zKVm_CUGV0UbQ_0 off=2331686 len=1960535 2024-01-13T18:38:34.010 INFO:tasks.workunit.client.0.smithi084.stdout:op 5220 completed, throughput=5MB/sec 2024-01-13T18:38:34.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[116404]: pgmap v2003: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:38:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:34.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:34 smithi084 ceph-mon[119097]: pgmap v2003: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:38:35.011 INFO:tasks.workunit.client.0.smithi084.stdout: 1031: throughput=5MB/sec pending data=0 2024-01-13T18:38:35.011 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6O9gvADJNKwnsQb off=8780315 len=81988 2024-01-13T18:38:35.011 INFO:tasks.workunit.client.0.smithi084.stdout:op 5221 completed, throughput=5MB/sec 2024-01-13T18:38:35.011 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x3dKOQrr0jVFgl7 off=5108902 len=835710 2024-01-13T18:38:35.015 INFO:tasks.workunit.client.0.smithi084.stdout:op 5222 completed, throughput=5MB/sec 2024-01-13T18:38:35.015 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HnW4ayjEn61z7zP off=18434744 len=1520185 2024-01-13T18:38:35.023 INFO:tasks.workunit.client.0.smithi084.stdout:op 5223 completed, throughput=5MB/sec 2024-01-13T18:38:35.023 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yEpUBLGVVACrrjg off=12524308 len=1881399 2024-01-13T18:38:35.025 INFO:tasks.workunit.client.0.smithi084.stdout:op 5224 completed, throughput=5MB/sec 2024-01-13T18:38:35.025 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tdkTIUQbGqZQAW6 off=1887310 len=369463 2024-01-13T18:38:35.025 INFO:tasks.workunit.client.0.smithi084.stdout:op 5225 completed, throughput=5MB/sec 2024-01-13T18:38:35.056 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:35.056 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:35.056 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:35.056 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:35.056 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:35.056 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:35.056 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:34 smithi099 ceph-mon[138788]: pgmap v2003: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:38:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:36.025 INFO:tasks.workunit.client.0.smithi084.stdout: 1032: throughput=5MB/sec pending data=0 2024-01-13T18:38:36.026 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aXcTQHN-UvKuoA8 off=0 len=1207298 2024-01-13T18:38:36.031 INFO:tasks.workunit.client.0.smithi084.stdout:op 5226 completed, throughput=5MB/sec 2024-01-13T18:38:36.031 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fTnesdB-Wx7k59d off=15713625 len=1038913 2024-01-13T18:38:36.035 INFO:tasks.workunit.client.0.smithi084.stdout:op 5227 completed, throughput=5MB/sec 2024-01-13T18:38:36.036 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zAZWtcbRnD0xom2 off=749921 len=2021709 2024-01-13T18:38:36.043 INFO:tasks.workunit.client.0.smithi084.stdout:op 5228 completed, throughput=5MB/sec 2024-01-13T18:38:36.043 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WTaCgXi3hYWBm8J off=7711790 len=1788898 2024-01-13T18:38:36.044 INFO:tasks.workunit.client.0.smithi084.stdout:op 5229 completed, throughput=5MB/sec 2024-01-13T18:38:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:36.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:36 smithi099 ceph-mon[138788]: pgmap v2004: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:38:36.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:36.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:36 smithi084 ceph-mon[116404]: pgmap v2004: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:38:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:36.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:36 smithi084 ceph-mon[119097]: pgmap v2004: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:38:36.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:36.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:37.045 INFO:tasks.workunit.client.0.smithi084.stdout: 1033: throughput=5MB/sec pending data=0 2024-01-13T18:38:37.045 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eIWpWroi1zNns4Y off=568234 len=158134 2024-01-13T18:38:37.046 INFO:tasks.workunit.client.0.smithi084.stdout:op 5230 completed, throughput=5MB/sec 2024-01-13T18:38:37.047 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sJ6XQ6OMezNYV3i off=3126319 len=664741 2024-01-13T18:38:37.047 INFO:tasks.workunit.client.0.smithi084.stdout:op 5231 completed, throughput=5MB/sec 2024-01-13T18:38:37.047 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-e7b10sLOnceDRkl off=6324127 len=63593 2024-01-13T18:38:37.048 INFO:tasks.workunit.client.0.smithi084.stdout:op 5232 completed, throughput=5MB/sec 2024-01-13T18:38:37.048 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-s4J4Kkl_Bw-ohni off=281675 len=1631224 2024-01-13T18:38:37.053 INFO:tasks.workunit.client.0.smithi084.stdout:op 5233 completed, throughput=5MB/sec 2024-01-13T18:38:37.054 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jXZPDf2A6Mi63Ql off=11734027 len=17368 2024-01-13T18:38:37.054 INFO:tasks.workunit.client.0.smithi084.stdout:op 5234 completed, throughput=5MB/sec 2024-01-13T18:38:37.054 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e98bW83Q0M13Rsk off=1573248 len=805567 2024-01-13T18:38:37.058 INFO:tasks.workunit.client.0.smithi084.stdout:op 5235 completed, throughput=5MB/sec 2024-01-13T18:38:37.058 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Z3wKQeDf4pk-D8Y off=17419000 len=1388652 2024-01-13T18:38:37.065 INFO:tasks.workunit.client.0.smithi084.stdout:op 5236 completed, throughput=5MB/sec 2024-01-13T18:38:38.065 INFO:tasks.workunit.client.0.smithi084.stdout: 1034: throughput=5MB/sec pending data=0 2024-01-13T18:38:38.065 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kyOsGuvQ5_mGwCd off=6144101 len=675770 2024-01-13T18:38:38.069 INFO:tasks.workunit.client.0.smithi084.stdout:op 5237 completed, throughput=5MB/sec 2024-01-13T18:38:38.069 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U3jgPIamBf4LMCL off=5977601 len=1942773 2024-01-13T18:38:38.071 INFO:tasks.workunit.client.0.smithi084.stdout:op 5238 completed, throughput=5MB/sec 2024-01-13T18:38:38.072 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cL9FJXf93zmgV42 off=11249770 len=891148 2024-01-13T18:38:38.073 INFO:tasks.workunit.client.0.smithi084.stdout:op 5239 completed, throughput=5MB/sec 2024-01-13T18:38:38.073 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pexxk6Lutws-R9a off=1435971 len=1324556 2024-01-13T18:38:38.078 INFO:tasks.workunit.client.0.smithi084.stdout:op 5240 completed, throughput=5MB/sec 2024-01-13T18:38:38.078 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--Nq1Dw8UIQndIUN off=12658556 len=1887647 2024-01-13T18:38:38.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 5241 completed, throughput=5MB/sec 2024-01-13T18:38:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:38:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:38:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:38.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:38.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:38.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:38:38.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:38:38.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:38.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:38.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:38.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:38:38.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:38:38.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:38:39.080 INFO:tasks.workunit.client.0.smithi084.stdout: 1035: throughput=5MB/sec pending data=0 2024-01-13T18:38:39.080 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0BAu7RIIfse-sw4 off=12203247 len=1688747 2024-01-13T18:38:39.082 INFO:tasks.workunit.client.0.smithi084.stdout:op 5242 completed, throughput=5MB/sec 2024-01-13T18:38:39.082 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TQfjGKqqVG0r0zh off=4741915 len=507041 2024-01-13T18:38:39.087 INFO:tasks.workunit.client.0.smithi084.stdout:op 5243 completed, throughput=5MB/sec 2024-01-13T18:38:39.087 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IsM98-fUMvRKtYn off=870927 len=1713243 2024-01-13T18:38:39.088 INFO:tasks.workunit.client.0.smithi084.stdout:op 5244 completed, throughput=5MB/sec 2024-01-13T18:38:39.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:39 smithi099 ceph-mon[138788]: pgmap v2005: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:38:39.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:39 smithi084 ceph-mon[116404]: pgmap v2005: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:38:39.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:39 smithi084 ceph-mon[119097]: pgmap v2005: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:38:40.089 INFO:tasks.workunit.client.0.smithi084.stdout: 1036: throughput=5MB/sec pending data=0 2024-01-13T18:38:40.089 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-w4ooV6ecLK6bdnw off=13822931 len=2080821 2024-01-13T18:38:40.100 INFO:tasks.workunit.client.0.smithi084.stdout:op 5245 completed, throughput=5MB/sec 2024-01-13T18:38:40.100 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WsGXbutyNg4_K0q off=3636964 len=1688333 2024-01-13T18:38:40.102 INFO:tasks.workunit.client.0.smithi084.stdout:op 5246 completed, throughput=5MB/sec 2024-01-13T18:38:40.102 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IAg9CT7mAocvXmA off=19214239 len=1359098 2024-01-13T18:38:40.104 INFO:tasks.workunit.client.0.smithi084.stdout:op 5247 completed, throughput=5MB/sec 2024-01-13T18:38:40.647 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:38:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:38:40] "GET /metrics HTTP/1.1" 200 33995 "" "Prometheus/2.43.0" 2024-01-13T18:38:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:40 smithi084 ceph-mon[116404]: pgmap v2006: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:38:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:40 smithi084 ceph-mon[119097]: pgmap v2006: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:38:41.104 INFO:tasks.workunit.client.0.smithi084.stdout: 1037: throughput=5MB/sec pending data=0 2024-01-13T18:38:41.104 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cgy19JoB5dxK59c off=19010057 len=809570 2024-01-13T18:38:41.109 INFO:tasks.workunit.client.0.smithi084.stdout:op 5248 completed, throughput=5MB/sec 2024-01-13T18:38:41.109 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jkx9MhvU7jGQSx7 off=9615060 len=892404 2024-01-13T18:38:41.114 INFO:tasks.workunit.client.0.smithi084.stdout:op 5249 completed, throughput=5MB/sec 2024-01-13T18:38:41.114 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Psu11nvtT_fpGAo off=7412415 len=2046611 2024-01-13T18:38:41.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:40 smithi099 ceph-mon[138788]: pgmap v2006: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 5 op/s 2024-01-13T18:38:41.125 INFO:tasks.workunit.client.0.smithi084.stdout:op 5250 completed, throughput=5MB/sec 2024-01-13T18:38:41.125 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JHi7kikrozt10M1 off=9896341 len=90436 2024-01-13T18:38:41.127 INFO:tasks.workunit.client.0.smithi084.stdout:op 5251 completed, throughput=5MB/sec 2024-01-13T18:38:41.127 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Qm7iCI7X88ar00M off=1689397 len=419928 2024-01-13T18:38:41.128 INFO:tasks.workunit.client.0.smithi084.stdout:op 5252 completed, throughput=5MB/sec 2024-01-13T18:38:41.128 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jzwwvx2ibpSND9z off=7325445 len=527693 2024-01-13T18:38:41.129 INFO:tasks.workunit.client.0.smithi084.stdout:op 5253 completed, throughput=5MB/sec 2024-01-13T18:38:41.130 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3Wvm3UvQx65j99c off=19571001 len=977514 2024-01-13T18:38:41.134 INFO:tasks.workunit.client.0.smithi084.stdout:op 5254 completed, throughput=5MB/sec 2024-01-13T18:38:42.134 INFO:tasks.workunit.client.0.smithi084.stdout: 1038: throughput=5MB/sec pending data=0 2024-01-13T18:38:42.135 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OfhgJnIYLRgfRe2 off=10070775 len=1505066 2024-01-13T18:38:42.141 INFO:tasks.workunit.client.0.smithi084.stdout:op 5255 completed, throughput=5MB/sec 2024-01-13T18:38:42.142 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OoVRN4SriB4rGq4 off=3708477 len=1088430 2024-01-13T18:38:42.149 INFO:tasks.workunit.client.0.smithi084.stdout:op 5256 completed, throughput=5MB/sec 2024-01-13T18:38:42.149 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7ysyOoMiqjckG-D off=121427 len=1281127 2024-01-13T18:38:42.151 INFO:tasks.workunit.client.0.smithi084.stdout:op 5257 completed, throughput=5MB/sec 2024-01-13T18:38:42.151 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-n5AmKwI9bXPtdVN off=2921463 len=1060136 2024-01-13T18:38:42.152 INFO:tasks.workunit.client.0.smithi084.stdout:op 5258 completed, throughput=5MB/sec 2024-01-13T18:38:42.152 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-d1_OaooiczrSVJD off=18645440 len=1654197 2024-01-13T18:38:42.159 INFO:tasks.workunit.client.0.smithi084.stdout:op 5259 completed, throughput=5MB/sec 2024-01-13T18:38:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:42 smithi084 ceph-mon[116404]: pgmap v2007: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:38:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:42 smithi084 ceph-mon[119097]: pgmap v2007: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:38:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:42 smithi099 ceph-mon[138788]: pgmap v2007: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:38:43.159 INFO:tasks.workunit.client.0.smithi084.stdout: 1039: throughput=5MB/sec pending data=0 2024-01-13T18:38:43.159 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ycErXUYJPYn1_m0 off=17666928 len=1828262 2024-01-13T18:38:43.169 INFO:tasks.workunit.client.0.smithi084.stdout:op 5260 completed, throughput=5MB/sec 2024-01-13T18:38:43.169 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-25AT3gFttGUgruO off=10977868 len=271636 2024-01-13T18:38:43.172 INFO:tasks.workunit.client.0.smithi084.stdout:op 5261 completed, throughput=5MB/sec 2024-01-13T18:38:43.173 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5700YyxYHH3xs8w off=5607248 len=182300 2024-01-13T18:38:43.173 INFO:tasks.workunit.client.0.smithi084.stdout:op 5262 completed, throughput=5MB/sec 2024-01-13T18:38:43.173 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DkbewTq4HzpvYaj off=8925413 len=1393546 2024-01-13T18:38:43.181 INFO:tasks.workunit.client.0.smithi084.stdout:op 5263 completed, throughput=5MB/sec 2024-01-13T18:38:43.181 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HLx_xcw9vMdi8DV off=18787089 len=1319174 2024-01-13T18:38:43.182 INFO:tasks.workunit.client.0.smithi084.stdout:op 5264 completed, throughput=5MB/sec 2024-01-13T18:38:44.183 INFO:tasks.workunit.client.0.smithi084.stdout: 1040: throughput=5MB/sec pending data=0 2024-01-13T18:38:44.183 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EnGhPOVgJ3FWdUT off=2057735 len=1231510 2024-01-13T18:38:44.190 INFO:tasks.workunit.client.0.smithi084.stdout:op 5265 completed, throughput=5MB/sec 2024-01-13T18:38:44.190 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lLpvGWUajL4hc7g off=8682564 len=1153414 2024-01-13T18:38:44.192 INFO:tasks.workunit.client.0.smithi084.stdout:op 5266 completed, throughput=5MB/sec 2024-01-13T18:38:44.193 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Zdmyns3kOTtvo7O off=5600439 len=1035725 2024-01-13T18:38:44.194 INFO:tasks.workunit.client.0.smithi084.stdout:op 5267 completed, throughput=5MB/sec 2024-01-13T18:38:44.194 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZPF9MeS-ysH1Ri9 off=7259794 len=1384501 2024-01-13T18:38:44.201 INFO:tasks.workunit.client.0.smithi084.stdout:op 5268 completed, throughput=5MB/sec 2024-01-13T18:38:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:44 smithi084 ceph-mon[116404]: pgmap v2008: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:38:44.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:44 smithi084 ceph-mon[119097]: pgmap v2008: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:38:45.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:44 smithi099 ceph-mon[138788]: pgmap v2008: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:38:45.202 INFO:tasks.workunit.client.0.smithi084.stdout: 1041: throughput=5MB/sec pending data=0 2024-01-13T18:38:45.202 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-j_4RrxbyL3Gt-AO off=2020034 len=350322 2024-01-13T18:38:45.203 INFO:tasks.workunit.client.0.smithi084.stdout:op 5269 completed, throughput=5MB/sec 2024-01-13T18:38:45.203 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JPbgvntYXD6RHAo off=11108769 len=720594 2024-01-13T18:38:45.204 INFO:tasks.workunit.client.0.smithi084.stdout:op 5270 completed, throughput=5MB/sec 2024-01-13T18:38:45.204 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xiIRscOmPyUI_uh off=11659188 len=1415758 2024-01-13T18:38:45.210 INFO:tasks.workunit.client.0.smithi084.stdout:op 5271 completed, throughput=5MB/sec 2024-01-13T18:38:45.210 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NEweL9syMiRkkfz off=210732 len=221014 2024-01-13T18:38:45.211 INFO:tasks.workunit.client.0.smithi084.stdout:op 5272 completed, throughput=5MB/sec 2024-01-13T18:38:45.211 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8t1avsqljDuypZc off=9487368 len=1908322 2024-01-13T18:38:45.213 INFO:tasks.workunit.client.0.smithi084.stdout:op 5273 completed, throughput=5MB/sec 2024-01-13T18:38:45.213 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CkEMLCXhdy2x9I7 off=11045252 len=1049786 2024-01-13T18:38:45.219 INFO:tasks.workunit.client.0.smithi084.stdout:op 5274 completed, throughput=5MB/sec 2024-01-13T18:38:46.220 INFO:tasks.workunit.client.0.smithi084.stdout: 1042: throughput=5MB/sec pending data=0 2024-01-13T18:38:46.220 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h-t99r5gs74wcS7 off=12518457 len=1100566 2024-01-13T18:38:46.225 INFO:tasks.workunit.client.0.smithi084.stdout:op 5275 completed, throughput=5MB/sec 2024-01-13T18:38:46.225 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-enHPW47R1tGgFKM off=10101927 len=60533 2024-01-13T18:38:46.227 INFO:tasks.workunit.client.0.smithi084.stdout:op 5276 completed, throughput=5MB/sec 2024-01-13T18:38:46.227 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_1Z6YRDkvzLb3UR off=16180074 len=867462 2024-01-13T18:38:46.228 INFO:tasks.workunit.client.0.smithi084.stdout:op 5277 completed, throughput=5MB/sec 2024-01-13T18:38:46.228 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YzVVkWxqmFH9-su off=253045 len=223633 2024-01-13T18:38:46.231 INFO:tasks.workunit.client.0.smithi084.stdout:op 5278 completed, throughput=5MB/sec 2024-01-13T18:38:46.231 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-INnUw5fp3a5qUn9 off=3368508 len=18086 2024-01-13T18:38:46.233 INFO:tasks.workunit.client.0.smithi084.stdout:op 5279 completed, throughput=5MB/sec 2024-01-13T18:38:46.233 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7OJdxX_ELCidUZd off=1241260 len=1324557 2024-01-13T18:38:46.234 INFO:tasks.workunit.client.0.smithi084.stdout:op 5280 completed, throughput=5MB/sec 2024-01-13T18:38:46.234 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-x2vGHCR4AxMtmRa off=11816949 len=145207 2024-01-13T18:38:46.235 INFO:tasks.workunit.client.0.smithi084.stdout:op 5281 completed, throughput=5MB/sec 2024-01-13T18:38:46.235 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EKpjl8GBFUMlvTN off=13804796 len=842755 2024-01-13T18:38:46.236 INFO:tasks.workunit.client.0.smithi084.stdout:op 5282 completed, throughput=5MB/sec 2024-01-13T18:38:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:46 smithi084 ceph-mon[116404]: pgmap v2009: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:38:46.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:46 smithi084 ceph-mon[119097]: pgmap v2009: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:38:47.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:46 smithi099 ceph-mon[138788]: pgmap v2009: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 4 op/s 2024-01-13T18:38:47.236 INFO:tasks.workunit.client.0.smithi084.stdout: 1043: throughput=5MB/sec pending data=0 2024-01-13T18:38:47.236 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8JeMWa9-gzi5OXT off=791801 len=1726230 2024-01-13T18:38:47.239 INFO:tasks.workunit.client.0.smithi084.stdout:op 5283 completed, throughput=5MB/sec 2024-01-13T18:38:47.239 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-45WJm6dq0CLVj2q off=10713621 len=627348 2024-01-13T18:38:47.244 INFO:tasks.workunit.client.0.smithi084.stdout:op 5284 completed, throughput=5MB/sec 2024-01-13T18:38:47.244 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ij1CRZsR2zo5yKX off=4867501 len=1772061 2024-01-13T18:38:47.250 INFO:tasks.workunit.client.0.smithi084.stdout:op 5285 completed, throughput=5MB/sec 2024-01-13T18:38:47.250 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QDfWZIDo0oz4dFZ off=9247158 len=142070 2024-01-13T18:38:47.252 INFO:tasks.workunit.client.0.smithi084.stdout:op 5286 completed, throughput=5MB/sec 2024-01-13T18:38:47.252 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bGsezzZRVJVWfcU off=1744266 len=1682269 2024-01-13T18:38:47.262 INFO:tasks.workunit.client.0.smithi084.stdout:op 5287 completed, throughput=5MB/sec 2024-01-13T18:38:48.263 INFO:tasks.workunit.client.0.smithi084.stdout: 1044: throughput=5MB/sec pending data=0 2024-01-13T18:38:48.264 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GBrna_1dm9lj7OE off=1404009 len=662606 2024-01-13T18:38:48.267 INFO:tasks.workunit.client.0.smithi084.stdout:op 5288 completed, throughput=5MB/sec 2024-01-13T18:38:48.267 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj---tEAXwQsEngJNa off=1259133 len=741996 2024-01-13T18:38:48.269 INFO:tasks.workunit.client.0.smithi084.stdout:op 5289 completed, throughput=5MB/sec 2024-01-13T18:38:48.269 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tJD2u4US6CNtL6w off=9215917 len=492603 2024-01-13T18:38:48.270 INFO:tasks.workunit.client.0.smithi084.stdout:op 5290 completed, throughput=5MB/sec 2024-01-13T18:38:48.270 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ob7cWdGqLBTvNrm off=2893618 len=1258937 2024-01-13T18:38:48.276 INFO:tasks.workunit.client.0.smithi084.stdout:op 5291 completed, throughput=5MB/sec 2024-01-13T18:38:48.276 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FmInu8GRd9fLkof off=6500982 len=2075747 2024-01-13T18:38:48.288 INFO:tasks.workunit.client.0.smithi084.stdout:op 5292 completed, throughput=5MB/sec 2024-01-13T18:38:49.289 INFO:tasks.workunit.client.0.smithi084.stdout: 1045: throughput=5MB/sec pending data=0 2024-01-13T18:38:49.289 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UrccfEuZxyWPBwj off=5391575 len=1357475 2024-01-13T18:38:49.295 INFO:tasks.workunit.client.0.smithi084.stdout:op 5293 completed, throughput=5MB/sec 2024-01-13T18:38:49.295 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FCTcbIr2DKiAy3Q off=12665019 len=2021125 2024-01-13T18:38:49.298 INFO:tasks.workunit.client.0.smithi084.stdout:op 5294 completed, throughput=5MB/sec 2024-01-13T18:38:49.298 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-c6b57k5VZkt12BX off=4659331 len=1920695 2024-01-13T18:38:49.300 INFO:tasks.workunit.client.0.smithi084.stdout:op 5295 completed, throughput=5MB/sec 2024-01-13T18:38:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:49 smithi099 ceph-mon[138788]: pgmap v2010: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:38:49.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:49 smithi084 ceph-mon[116404]: pgmap v2010: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:38:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:49 smithi084 ceph-mon[119097]: pgmap v2010: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:38:50.300 INFO:tasks.workunit.client.0.smithi084.stdout: 1046: throughput=5MB/sec pending data=0 2024-01-13T18:38:50.300 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-fmT9IcIkDRFE252 off=9816941 len=1455259 2024-01-13T18:38:50.303 INFO:tasks.workunit.client.0.smithi084.stdout:op 5296 completed, throughput=5MB/sec 2024-01-13T18:38:50.303 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4ONIYuXoKXiQNsV off=0 len=1265156 2024-01-13T18:38:50.310 INFO:tasks.workunit.client.0.smithi084.stdout:op 5297 completed, throughput=5MB/sec 2024-01-13T18:38:50.310 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TtduF8tjmUKAjAN off=8826040 len=1460014 2024-01-13T18:38:50.318 INFO:tasks.workunit.client.0.smithi084.stdout:op 5298 completed, throughput=5MB/sec 2024-01-13T18:38:50.318 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vQWtxnahWvE1tak off=5191111 len=212561 2024-01-13T18:38:50.320 INFO:tasks.workunit.client.0.smithi084.stdout:op 5299 completed, throughput=5MB/sec 2024-01-13T18:38:50.320 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-H476Qt1M6cPZ4Tb off=5781735 len=605244 2024-01-13T18:38:50.324 INFO:tasks.workunit.client.0.smithi084.stdout:op 5300 completed, throughput=5MB/sec 2024-01-13T18:38:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:50.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:38:50.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:38:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:38:50] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:38:51.324 INFO:tasks.workunit.client.0.smithi084.stdout: 1047: throughput=5MB/sec pending data=0 2024-01-13T18:38:51.325 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0BAu7RIIfse-sw4 off=1425849 len=1870965 2024-01-13T18:38:51.326 INFO:tasks.workunit.client.0.smithi084.stdout:op 5301 completed, throughput=5MB/sec 2024-01-13T18:38:51.326 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bz1ryptFWVp2zJg off=3304614 len=49589 2024-01-13T18:38:51.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 5302 completed, throughput=5MB/sec 2024-01-13T18:38:51.329 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aOkxJpm_8CtSi_N off=294192 len=766793 2024-01-13T18:38:51.334 INFO:tasks.workunit.client.0.smithi084.stdout:op 5303 completed, throughput=5MB/sec 2024-01-13T18:38:51.334 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CO03XClAPb1n4GO off=15287296 len=774866 2024-01-13T18:38:51.335 INFO:tasks.workunit.client.0.smithi084.stdout:op 5304 completed, throughput=5MB/sec 2024-01-13T18:38:51.335 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hgsedv8mL1MCKSg off=13446282 len=1899017 2024-01-13T18:38:51.346 INFO:tasks.workunit.client.0.smithi084.stdout:op 5305 completed, throughput=5MB/sec 2024-01-13T18:38:51.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:51 smithi084 ceph-mon[116404]: pgmap v2011: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:38:51.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:51 smithi084 ceph-mon[119097]: pgmap v2011: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:38:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:51 smithi099 ceph-mon[138788]: pgmap v2011: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:38:52.345 INFO:tasks.workunit.client.0.smithi084.stdout: 1048: throughput=5MB/sec pending data=0 2024-01-13T18:38:52.345 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EJK66c8PBiiqOFh off=3072929 len=1210805 2024-01-13T18:38:52.347 INFO:tasks.workunit.client.0.smithi084.stdout:op 5306 completed, throughput=5MB/sec 2024-01-13T18:38:52.347 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JbBLVGw825SpT7a off=20766339 len=1113277 2024-01-13T18:38:52.353 INFO:tasks.workunit.client.0.smithi084.stdout:op 5307 completed, throughput=5MB/sec 2024-01-13T18:38:52.354 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-859ZLmwlfYjUQP2 off=8032148 len=1783400 2024-01-13T18:38:52.357 INFO:tasks.workunit.client.0.smithi084.stdout:op 5308 completed, throughput=5MB/sec 2024-01-13T18:38:52.357 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-II4GLMzx_h5Orj2 off=16601614 len=1528899 2024-01-13T18:38:52.365 INFO:tasks.workunit.client.0.smithi084.stdout:op 5309 completed, throughput=5MB/sec 2024-01-13T18:38:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:52 smithi084 ceph-mon[116404]: pgmap v2012: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:38:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:52 smithi084 ceph-mon[119097]: pgmap v2012: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:38:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:52 smithi099 ceph-mon[138788]: pgmap v2012: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:38:53.365 INFO:tasks.workunit.client.0.smithi084.stdout: 1049: throughput=5MB/sec pending data=0 2024-01-13T18:38:53.366 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xW8XHAr9p-hXHs- off=5695446 len=1250959 2024-01-13T18:38:53.367 INFO:tasks.workunit.client.0.smithi084.stdout:op 5310 completed, throughput=5MB/sec 2024-01-13T18:38:53.367 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hqAtjmxUtVy_1U6 off=7693778 len=1732132 2024-01-13T18:38:53.370 INFO:tasks.workunit.client.0.smithi084.stdout:op 5311 completed, throughput=5MB/sec 2024-01-13T18:38:53.371 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ub_VjgleRnuaRLk off=10215473 len=861595 2024-01-13T18:38:53.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 5312 completed, throughput=5MB/sec 2024-01-13T18:38:53.376 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_oDt9SAL9P5lQP1 off=2297355 len=193286 2024-01-13T18:38:53.377 INFO:tasks.workunit.client.0.smithi084.stdout:op 5313 completed, throughput=5MB/sec 2024-01-13T18:38:53.377 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hGvBkrbayyYrG6p off=6329589 len=1026418 2024-01-13T18:38:53.379 INFO:tasks.workunit.client.0.smithi084.stdout:op 5314 completed, throughput=5MB/sec 2024-01-13T18:38:54.379 INFO:tasks.workunit.client.0.smithi084.stdout: 1050: throughput=5MB/sec pending data=0 2024-01-13T18:38:54.379 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ESDdnpSnGdndfX4 off=6976451 len=1751101 2024-01-13T18:38:54.388 INFO:tasks.workunit.client.0.smithi084.stdout:op 5315 completed, throughput=5MB/sec 2024-01-13T18:38:54.388 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FR8XP1Ek-tf5GND off=1082066 len=145794 2024-01-13T18:38:54.391 INFO:tasks.workunit.client.0.smithi084.stdout:op 5316 completed, throughput=5MB/sec 2024-01-13T18:38:54.391 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WW3LEBcQ_1Yf7RF off=339733 len=432516 2024-01-13T18:38:54.395 INFO:tasks.workunit.client.0.smithi084.stdout:op 5317 completed, throughput=5MB/sec 2024-01-13T18:38:54.395 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FOLsmHFfVyZjJW6 off=0 len=1529147 2024-01-13T18:38:54.396 INFO:tasks.workunit.client.0.smithi084.stdout:op 5318 completed, throughput=5MB/sec 2024-01-13T18:38:54.396 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bISxGHLqen93dDt off=931591 len=71156 2024-01-13T18:38:54.396 INFO:tasks.workunit.client.0.smithi084.stdout:op 5319 completed, throughput=5MB/sec 2024-01-13T18:38:54.397 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ddT8wOvoIjmCECI off=15926855 len=1864313 2024-01-13T18:38:54.398 INFO:tasks.workunit.client.0.smithi084.stdout:op 5320 completed, throughput=5MB/sec 2024-01-13T18:38:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:54 smithi084 ceph-mon[116404]: pgmap v2013: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:38:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:54 smithi084 ceph-mon[119097]: pgmap v2013: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:38:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:54 smithi099 ceph-mon[138788]: pgmap v2013: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:38:55.398 INFO:tasks.workunit.client.0.smithi084.stdout: 1051: throughput=5MB/sec pending data=0 2024-01-13T18:38:55.398 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--eGtjuGRBYe5GV_ off=10736437 len=1079184 2024-01-13T18:38:55.400 INFO:tasks.workunit.client.0.smithi084.stdout:op 5321 completed, throughput=5MB/sec 2024-01-13T18:38:55.400 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f5lpsKcHA3d4Z9q off=460951 len=1980028 2024-01-13T18:38:55.402 INFO:tasks.workunit.client.0.smithi084.stdout:op 5322 completed, throughput=5MB/sec 2024-01-13T18:38:55.402 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zA8VQnsfWaDoKOq off=17348537 len=1280110 2024-01-13T18:38:55.405 INFO:tasks.workunit.client.0.smithi084.stdout:op 5323 completed, throughput=5MB/sec 2024-01-13T18:38:55.405 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZPnXutcKlNJHiWP off=16155263 len=1171287 2024-01-13T18:38:55.406 INFO:tasks.workunit.client.0.smithi084.stdout:op 5324 completed, throughput=5MB/sec 2024-01-13T18:38:56.407 INFO:tasks.workunit.client.0.smithi084.stdout: 1052: throughput=5MB/sec pending data=0 2024-01-13T18:38:56.407 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SUmg4RUZ4Pd7iGs off=9915571 len=987141 2024-01-13T18:38:56.408 INFO:tasks.workunit.client.0.smithi084.stdout:op 5325 completed, throughput=5MB/sec 2024-01-13T18:38:56.408 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_Lt650GGcLSelQ1 off=2060090 len=1347648 2024-01-13T18:38:56.415 INFO:tasks.workunit.client.0.smithi084.stdout:op 5326 completed, throughput=5MB/sec 2024-01-13T18:38:56.415 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qctQ-tuleFSvSlh off=10151071 len=543932 2024-01-13T18:38:56.416 INFO:tasks.workunit.client.0.smithi084.stdout:op 5327 completed, throughput=5MB/sec 2024-01-13T18:38:56.416 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4nvyiQOHwPYjQjw off=12174290 len=1319492 2024-01-13T18:38:56.422 INFO:tasks.workunit.client.0.smithi084.stdout:op 5328 completed, throughput=5MB/sec 2024-01-13T18:38:56.422 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1ujiYCuYprXiKXQ off=1273938 len=699378 2024-01-13T18:38:56.423 INFO:tasks.workunit.client.0.smithi084.stdout:op 5329 completed, throughput=5MB/sec 2024-01-13T18:38:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:56 smithi084 ceph-mon[116404]: pgmap v2014: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:38:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:56 smithi084 ceph-mon[119097]: pgmap v2014: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:38:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:56 smithi099 ceph-mon[138788]: pgmap v2014: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:38:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: 1053: throughput=5MB/sec pending data=0 2024-01-13T18:38:57.424 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rW1ZVmm_Uv4V7Lg off=20248206 len=868475 2024-01-13T18:38:57.429 INFO:tasks.workunit.client.0.smithi084.stdout:op 5330 completed, throughput=5MB/sec 2024-01-13T18:38:57.429 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FVc11fj_sWdPPo2 off=10483813 len=587423 2024-01-13T18:38:57.430 INFO:tasks.workunit.client.0.smithi084.stdout:op 5331 completed, throughput=5MB/sec 2024-01-13T18:38:57.430 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hOsbuxJ80Mr1NlX off=11165082 len=609305 2024-01-13T18:38:57.434 INFO:tasks.workunit.client.0.smithi084.stdout:op 5332 completed, throughput=5MB/sec 2024-01-13T18:38:57.434 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MoG_YQTk9JFjH1a off=1889409 len=1692311 2024-01-13T18:38:57.437 INFO:tasks.workunit.client.0.smithi084.stdout:op 5333 completed, throughput=5MB/sec 2024-01-13T18:38:57.437 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-x1PMg0B0PrQyztR off=743459 len=1142156 2024-01-13T18:38:57.439 INFO:tasks.workunit.client.0.smithi084.stdout:op 5334 completed, throughput=5MB/sec 2024-01-13T18:38:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: 1054: throughput=5MB/sec pending data=0 2024-01-13T18:38:58.440 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2-192vEmOKBYz2o off=15889416 len=322556 2024-01-13T18:38:58.443 INFO:tasks.workunit.client.0.smithi084.stdout:op 5335 completed, throughput=5MB/sec 2024-01-13T18:38:58.443 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ljMUUJt969UtyeH off=13876932 len=1676519 2024-01-13T18:38:58.452 INFO:tasks.workunit.client.0.smithi084.stdout:op 5336 completed, throughput=5MB/sec 2024-01-13T18:38:58.452 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-rLymhhsZY6Dj4uC off=3204920 len=1593467 2024-01-13T18:38:58.453 INFO:tasks.workunit.client.0.smithi084.stdout:op 5337 completed, throughput=5MB/sec 2024-01-13T18:38:58.454 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RH-XTSWh-kmTLFf off=3152380 len=243247 2024-01-13T18:38:58.454 INFO:tasks.workunit.client.0.smithi084.stdout:op 5338 completed, throughput=5MB/sec 2024-01-13T18:38:58.454 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aBhQbZrE70k3N0F off=16554910 len=1731423 2024-01-13T18:38:58.456 INFO:tasks.workunit.client.0.smithi084.stdout:op 5339 completed, throughput=5MB/sec 2024-01-13T18:38:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: 1055: throughput=5MB/sec pending data=0 2024-01-13T18:38:59.456 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gRYvbsJ5Jv6fOZG off=13992698 len=1735661 2024-01-13T18:38:59.465 INFO:tasks.workunit.client.0.smithi084.stdout:op 5340 completed, throughput=5MB/sec 2024-01-13T18:38:59.465 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DoLx4QvZsVcBZzu off=2053296 len=1973541 2024-01-13T18:38:59.467 INFO:tasks.workunit.client.0.smithi084.stdout:op 5341 completed, throughput=5MB/sec 2024-01-13T18:38:59.467 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dq5LOqcfoRMS1pQ off=4677496 len=1770823 2024-01-13T18:38:59.470 INFO:tasks.workunit.client.0.smithi084.stdout:op 5342 completed, throughput=5MB/sec 2024-01-13T18:38:59.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:38:59 smithi099 ceph-mon[138788]: pgmap v2015: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:38:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:38:59 smithi084 ceph-mon[116404]: pgmap v2015: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:38:59.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:38:59 smithi084 ceph-mon[119097]: pgmap v2015: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:39:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: 1056: throughput=5MB/sec pending data=0 2024-01-13T18:39:00.471 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YGPs6QONvRkqiAj off=3039948 len=623641 2024-01-13T18:39:00.474 INFO:tasks.workunit.client.0.smithi084.stdout:op 5343 completed, throughput=5MB/sec 2024-01-13T18:39:00.474 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rm4UFtMrO3ylaSp off=1163138 len=328464 2024-01-13T18:39:00.478 INFO:tasks.workunit.client.0.smithi084.stdout:op 5344 completed, throughput=5MB/sec 2024-01-13T18:39:00.478 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-enfIaaEBt1jXC8U off=703187 len=1070795 2024-01-13T18:39:00.479 INFO:tasks.workunit.client.0.smithi084.stdout:op 5345 completed, throughput=5MB/sec 2024-01-13T18:39:00.479 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-e5Lqdlz1kPsjXC0 off=4479216 len=459744 2024-01-13T18:39:00.483 INFO:tasks.workunit.client.0.smithi084.stdout:op 5346 completed, throughput=5MB/sec 2024-01-13T18:39:00.483 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3yoj_6MwI5u7l0a off=9540990 len=1867428 2024-01-13T18:39:00.494 INFO:tasks.workunit.client.0.smithi084.stdout:op 5347 completed, throughput=5MB/sec 2024-01-13T18:39:00.494 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f5EdK-Bxg-yuIps off=12889501 len=520423 2024-01-13T18:39:00.495 INFO:tasks.workunit.client.0.smithi084.stdout:op 5348 completed, throughput=5MB/sec 2024-01-13T18:39:00.652 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:39:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:39:00] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:39:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:00 smithi084 ceph-mon[116404]: pgmap v2016: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:39:00.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:00 smithi084 ceph-mon[119097]: pgmap v2016: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:39:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:00 smithi099 ceph-mon[138788]: pgmap v2016: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:39:01.495 INFO:tasks.workunit.client.0.smithi084.stdout: 1057: throughput=5MB/sec pending data=0 2024-01-13T18:39:01.496 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ysirbEYYqGgqo5q off=3892686 len=1690672 2024-01-13T18:39:01.504 INFO:tasks.workunit.client.0.smithi084.stdout:op 5349 completed, throughput=5MB/sec 2024-01-13T18:39:01.505 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GeEdN7r4TLSIlr4 off=11812037 len=1429717 2024-01-13T18:39:01.508 INFO:tasks.workunit.client.0.smithi084.stdout:op 5350 completed, throughput=5MB/sec 2024-01-13T18:39:01.508 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9P0z1xVpmPzr5Zt off=1760750 len=117211 2024-01-13T18:39:01.508 INFO:tasks.workunit.client.0.smithi084.stdout:op 5351 completed, throughput=5MB/sec 2024-01-13T18:39:01.508 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2sPJPbgHKi11n-A off=2778824 len=929359 2024-01-13T18:39:01.510 INFO:tasks.workunit.client.0.smithi084.stdout:op 5352 completed, throughput=5MB/sec 2024-01-13T18:39:01.510 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-o8gC6Eto7JTlYTV off=713481 len=602337 2024-01-13T18:39:01.511 INFO:tasks.workunit.client.0.smithi084.stdout:op 5353 completed, throughput=5MB/sec 2024-01-13T18:39:01.511 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2XXORkqX4ltoC08 off=2211012 len=471974 2024-01-13T18:39:01.511 INFO:tasks.workunit.client.0.smithi084.stdout:op 5354 completed, throughput=5MB/sec 2024-01-13T18:39:01.512 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qAUVWqhnHICMr3T off=4274844 len=610253 2024-01-13T18:39:01.516 INFO:tasks.workunit.client.0.smithi084.stdout:op 5355 completed, throughput=5MB/sec 2024-01-13T18:39:02.516 INFO:tasks.workunit.client.0.smithi084.stdout: 1058: throughput=5MB/sec pending data=0 2024-01-13T18:39:02.516 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4RbOenfsVbZ91uV off=140041 len=1059525 2024-01-13T18:39:02.517 INFO:tasks.workunit.client.0.smithi084.stdout:op 5356 completed, throughput=5MB/sec 2024-01-13T18:39:02.517 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5-2xWh2tU5cKnmq off=21528317 len=232349 2024-01-13T18:39:02.519 INFO:tasks.workunit.client.0.smithi084.stdout:op 5357 completed, throughput=5MB/sec 2024-01-13T18:39:02.519 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r2kDxmJYZ6zONcT off=2214321 len=1170544 2024-01-13T18:39:02.527 INFO:tasks.workunit.client.0.smithi084.stdout:op 5358 completed, throughput=5MB/sec 2024-01-13T18:39:02.527 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iIf2VMp-JoolRrQ off=7619721 len=425106 2024-01-13T18:39:02.530 INFO:tasks.workunit.client.0.smithi084.stdout:op 5359 completed, throughput=5MB/sec 2024-01-13T18:39:02.530 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_49zewGOtHyzFyw off=16406583 len=1527169 2024-01-13T18:39:02.532 INFO:tasks.workunit.client.0.smithi084.stdout:op 5360 completed, throughput=5MB/sec 2024-01-13T18:39:02.532 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cgiiCO6ELXUFhVF off=58357 len=1011610 2024-01-13T18:39:02.538 INFO:tasks.workunit.client.0.smithi084.stdout:op 5361 completed, throughput=5MB/sec 2024-01-13T18:39:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:02 smithi084 ceph-mon[116404]: pgmap v2017: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:39:02.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:02 smithi084 ceph-mon[119097]: pgmap v2017: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:39:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:02 smithi099 ceph-mon[138788]: pgmap v2017: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:39:03.538 INFO:tasks.workunit.client.0.smithi084.stdout: 1059: throughput=5MB/sec pending data=0 2024-01-13T18:39:03.538 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tSc5LpT_f-PknDR off=380359 len=734885 2024-01-13T18:39:03.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 5362 completed, throughput=5MB/sec 2024-01-13T18:39:03.543 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qYqj-kDlGvzdjEv off=10506170 len=105395 2024-01-13T18:39:03.545 INFO:tasks.workunit.client.0.smithi084.stdout:op 5363 completed, throughput=5MB/sec 2024-01-13T18:39:03.545 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-r3YNvXxctfnTmed off=17276188 len=1383292 2024-01-13T18:39:03.547 INFO:tasks.workunit.client.0.smithi084.stdout:op 5364 completed, throughput=5MB/sec 2024-01-13T18:39:03.547 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OLoAoYSXuGAxpsU off=76796 len=1317691 2024-01-13T18:39:03.550 INFO:tasks.workunit.client.0.smithi084.stdout:op 5365 completed, throughput=5MB/sec 2024-01-13T18:39:03.550 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3V8ujtTpta_JZHT off=200625 len=2028941 2024-01-13T18:39:03.553 INFO:tasks.workunit.client.0.smithi084.stdout:op 5366 completed, throughput=5MB/sec 2024-01-13T18:39:04.554 INFO:tasks.workunit.client.0.smithi084.stdout: 1060: throughput=5MB/sec pending data=0 2024-01-13T18:39:04.554 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tIKPuEAVh3BtdxT off=6131879 len=1745406 2024-01-13T18:39:04.556 INFO:tasks.workunit.client.0.smithi084.stdout:op 5367 completed, throughput=5MB/sec 2024-01-13T18:39:04.556 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LoSiXkbQ2Vu3kS9 off=2866163 len=1396723 2024-01-13T18:39:04.564 INFO:tasks.workunit.client.0.smithi084.stdout:op 5368 completed, throughput=5MB/sec 2024-01-13T18:39:04.564 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6PvauFVO26I_bu2 off=721294 len=1574987 2024-01-13T18:39:04.572 INFO:tasks.workunit.client.0.smithi084.stdout:op 5369 completed, throughput=5MB/sec 2024-01-13T18:39:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:04 smithi084 ceph-mon[116404]: pgmap v2018: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:39:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:04 smithi084 ceph-mon[119097]: pgmap v2018: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:39:05.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:04 smithi099 ceph-mon[138788]: pgmap v2018: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:39:05.572 INFO:tasks.workunit.client.0.smithi084.stdout: 1061: throughput=5MB/sec pending data=0 2024-01-13T18:39:05.572 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Mx8bnvYH5cEZ-Zd off=18769844 len=1237943 2024-01-13T18:39:05.574 INFO:tasks.workunit.client.0.smithi084.stdout:op 5370 completed, throughput=5MB/sec 2024-01-13T18:39:05.574 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-o2ymn8LF3s02sCJ off=7708575 len=1756835 2024-01-13T18:39:05.576 INFO:tasks.workunit.client.0.smithi084.stdout:op 5371 completed, throughput=5MB/sec 2024-01-13T18:39:05.576 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-o-7tfoSoWHY2ONr off=9357548 len=1221411 2024-01-13T18:39:05.577 INFO:tasks.workunit.client.0.smithi084.stdout:op 5372 completed, throughput=5MB/sec 2024-01-13T18:39:05.577 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lLpvGWUajL4hc7g off=7833537 len=1895092 2024-01-13T18:39:05.586 INFO:tasks.workunit.client.0.smithi084.stdout:op 5373 completed, throughput=5MB/sec 2024-01-13T18:39:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:06.586 INFO:tasks.workunit.client.0.smithi084.stdout: 1062: throughput=5MB/sec pending data=0 2024-01-13T18:39:06.587 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wBoVTDrmVaapub0 off=7297830 len=1911702 2024-01-13T18:39:06.589 INFO:tasks.workunit.client.0.smithi084.stdout:op 5374 completed, throughput=5MB/sec 2024-01-13T18:39:06.589 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PipxTxbLn2MHwKX off=18707480 len=2026909 2024-01-13T18:39:06.591 INFO:tasks.workunit.client.0.smithi084.stdout:op 5375 completed, throughput=5MB/sec 2024-01-13T18:39:06.591 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KnmZMuigFOgEj9d off=3559697 len=1874724 2024-01-13T18:39:06.594 INFO:tasks.workunit.client.0.smithi084.stdout:op 5376 completed, throughput=5MB/sec 2024-01-13T18:39:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:06 smithi084 ceph-mon[116404]: pgmap v2019: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 4 op/s 2024-01-13T18:39:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:06 smithi084 ceph-mon[119097]: pgmap v2019: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 4 op/s 2024-01-13T18:39:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:06 smithi099 ceph-mon[138788]: pgmap v2019: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 4 op/s 2024-01-13T18:39:07.595 INFO:tasks.workunit.client.0.smithi084.stdout: 1063: throughput=5MB/sec pending data=0 2024-01-13T18:39:07.595 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SUZJHqDT98JJqHL off=529759 len=989273 2024-01-13T18:39:07.601 INFO:tasks.workunit.client.0.smithi084.stdout:op 5377 completed, throughput=5MB/sec 2024-01-13T18:39:07.601 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QuCxobZKIq2Dyrq off=12050013 len=1249662 2024-01-13T18:39:07.603 INFO:tasks.workunit.client.0.smithi084.stdout:op 5378 completed, throughput=5MB/sec 2024-01-13T18:39:07.603 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FoxtKLjRtXVlH_o off=15241111 len=865568 2024-01-13T18:39:07.604 INFO:tasks.workunit.client.0.smithi084.stdout:op 5379 completed, throughput=5MB/sec 2024-01-13T18:39:07.604 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vYPFQB5AyI9LbmR off=13591507 len=1264737 2024-01-13T18:39:07.606 INFO:tasks.workunit.client.0.smithi084.stdout:op 5380 completed, throughput=5MB/sec 2024-01-13T18:39:08.607 INFO:tasks.workunit.client.0.smithi084.stdout: 1064: throughput=5MB/sec pending data=0 2024-01-13T18:39:08.607 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9fiT568KeraF-bz off=2113766 len=1719864 2024-01-13T18:39:08.609 INFO:tasks.workunit.client.0.smithi084.stdout:op 5381 completed, throughput=5MB/sec 2024-01-13T18:39:08.609 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k96Qr6Azal5bMcD off=11596352 len=143995 2024-01-13T18:39:08.609 INFO:tasks.workunit.client.0.smithi084.stdout:op 5382 completed, throughput=5MB/sec 2024-01-13T18:39:08.610 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-87NA-hTCbkJvx0w off=47642 len=676325 2024-01-13T18:39:08.611 INFO:tasks.workunit.client.0.smithi084.stdout:op 5383 completed, throughput=5MB/sec 2024-01-13T18:39:08.611 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6yNDB5UMJ1DIvbL off=1280196 len=1577356 2024-01-13T18:39:08.619 INFO:tasks.workunit.client.0.smithi084.stdout:op 5384 completed, throughput=5MB/sec 2024-01-13T18:39:08.619 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TzJB4YiqtTinyCD off=36544 len=742457 2024-01-13T18:39:08.624 INFO:tasks.workunit.client.0.smithi084.stdout:op 5385 completed, throughput=5MB/sec 2024-01-13T18:39:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:09 smithi099 ceph-mon[138788]: pgmap v2020: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:39:09.624 INFO:tasks.workunit.client.0.smithi084.stdout: 1065: throughput=5MB/sec pending data=0 2024-01-13T18:39:09.624 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-99tbwmMHYA1ijvR off=6958017 len=853580 2024-01-13T18:39:09.629 INFO:tasks.workunit.client.0.smithi084.stdout:op 5386 completed, throughput=5MB/sec 2024-01-13T18:39:09.629 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-E8gCBOkAi9brNOZ off=1092047 len=1244706 2024-01-13T18:39:09.631 INFO:tasks.workunit.client.0.smithi084.stdout:op 5387 completed, throughput=5MB/sec 2024-01-13T18:39:09.631 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vm5kKEJGc-9X4OM off=1560055 len=615744 2024-01-13T18:39:09.635 INFO:tasks.workunit.client.0.smithi084.stdout:op 5388 completed, throughput=5MB/sec 2024-01-13T18:39:09.635 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0o5T5Je34X-58x1 off=7515627 len=1180772 2024-01-13T18:39:09.641 INFO:tasks.workunit.client.0.smithi084.stdout:op 5389 completed, throughput=5MB/sec 2024-01-13T18:39:09.641 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Z_hPEACF4phWv3Z off=0 len=1089427 2024-01-13T18:39:09.642 INFO:tasks.workunit.client.0.smithi084.stdout:op 5390 completed, throughput=5MB/sec 2024-01-13T18:39:09.642 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tI_8z2vEg0Ak-K8 off=958883 len=1045778 2024-01-13T18:39:09.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 5391 completed, throughput=5MB/sec 2024-01-13T18:39:09.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:09 smithi084 ceph-mon[116404]: pgmap v2020: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:39:09.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:09 smithi084 ceph-mon[119097]: pgmap v2020: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:39:10.647 INFO:tasks.workunit.client.0.smithi084.stdout: 1066: throughput=5MB/sec pending data=0 2024-01-13T18:39:10.647 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Pchjbr1ntcUwFe7 off=4667550 len=32500 2024-01-13T18:39:10.647 INFO:tasks.workunit.client.0.smithi084.stdout:op 5392 completed, throughput=5MB/sec 2024-01-13T18:39:10.648 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RgnmG7ETz9mQVW2 off=936727 len=1627396 2024-01-13T18:39:10.651 INFO:tasks.workunit.client.0.smithi084.stdout:op 5393 completed, throughput=5MB/sec 2024-01-13T18:39:10.651 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CptPdJxYI8ohpND off=44253 len=1285119 2024-01-13T18:39:10.652 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:39:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:39:10] "GET /metrics HTTP/1.1" 200 33994 "" "Prometheus/2.43.0" 2024-01-13T18:39:10.657 INFO:tasks.workunit.client.0.smithi084.stdout:op 5394 completed, throughput=5MB/sec 2024-01-13T18:39:10.657 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-u89VUHVjT_fhVQf off=2234607 len=182492 2024-01-13T18:39:10.660 INFO:tasks.workunit.client.0.smithi084.stdout:op 5395 completed, throughput=5MB/sec 2024-01-13T18:39:10.660 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-J_i5GfNVgkiEjS3 off=8146833 len=1592897 2024-01-13T18:39:10.663 INFO:tasks.workunit.client.0.smithi084.stdout:op 5396 completed, throughput=5MB/sec 2024-01-13T18:39:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:10 smithi084 ceph-mon[116404]: pgmap v2021: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:39:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:10 smithi084 ceph-mon[119097]: pgmap v2021: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:39:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:10 smithi099 ceph-mon[138788]: pgmap v2021: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:39:11.663 INFO:tasks.workunit.client.0.smithi084.stdout: 1067: throughput=5MB/sec pending data=0 2024-01-13T18:39:11.663 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QIBm_KoufXB17Hd off=8851593 len=1141805 2024-01-13T18:39:11.671 INFO:tasks.workunit.client.0.smithi084.stdout:op 5397 completed, throughput=5MB/sec 2024-01-13T18:39:11.671 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-U0ZIxFFi8qjOdvC off=1774593 len=737119 2024-01-13T18:39:11.672 INFO:tasks.workunit.client.0.smithi084.stdout:op 5398 completed, throughput=5MB/sec 2024-01-13T18:39:11.672 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vzgcor8c2KcdJWn off=2669973 len=53448 2024-01-13T18:39:11.673 INFO:tasks.workunit.client.0.smithi084.stdout:op 5399 completed, throughput=5MB/sec 2024-01-13T18:39:11.673 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OB3o2xGvVVqYhn- off=20689890 len=224738 2024-01-13T18:39:11.674 INFO:tasks.workunit.client.0.smithi084.stdout:op 5400 completed, throughput=5MB/sec 2024-01-13T18:39:11.674 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Oyq4DX56h3PMMeJ off=9302705 len=1377074 2024-01-13T18:39:11.677 INFO:tasks.workunit.client.0.smithi084.stdout:op 5401 completed, throughput=5MB/sec 2024-01-13T18:39:11.677 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1YXDKORm9vsVJna off=6583947 len=1080052 2024-01-13T18:39:11.678 INFO:tasks.workunit.client.0.smithi084.stdout:op 5402 completed, throughput=5MB/sec 2024-01-13T18:39:11.678 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Sm2T3CNKfdaJyOp off=1658484 len=538903 2024-01-13T18:39:11.682 INFO:tasks.workunit.client.0.smithi084.stdout:op 5403 completed, throughput=5MB/sec 2024-01-13T18:39:12.682 INFO:tasks.workunit.client.0.smithi084.stdout: 1068: throughput=5MB/sec pending data=0 2024-01-13T18:39:12.682 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-gTlRuCfO6KK_Q8N off=2488260 len=438894 2024-01-13T18:39:12.683 INFO:tasks.workunit.client.0.smithi084.stdout:op 5404 completed, throughput=5MB/sec 2024-01-13T18:39:12.683 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-F0H5f3OyJCPji7F off=11040404 len=854713 2024-01-13T18:39:12.689 INFO:tasks.workunit.client.0.smithi084.stdout:op 5405 completed, throughput=5MB/sec 2024-01-13T18:39:12.689 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-w0WkwYTAMcHvwC1 off=3473170 len=1427033 2024-01-13T18:39:12.691 INFO:tasks.workunit.client.0.smithi084.stdout:op 5406 completed, throughput=5MB/sec 2024-01-13T18:39:12.691 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wTnXy3u3p0c7RlF off=2685151 len=367913 2024-01-13T18:39:12.694 INFO:tasks.workunit.client.0.smithi084.stdout:op 5407 completed, throughput=5MB/sec 2024-01-13T18:39:12.694 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ckQSdnMJYJQEDf6 off=0 len=1336465 2024-01-13T18:39:12.701 INFO:tasks.workunit.client.0.smithi084.stdout:op 5408 completed, throughput=5MB/sec 2024-01-13T18:39:12.701 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6-DGjZ07ZnfqjSx off=3660942 len=1619427 2024-01-13T18:39:12.707 INFO:tasks.workunit.client.0.smithi084.stdout:op 5409 completed, throughput=5MB/sec 2024-01-13T18:39:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:12 smithi084 ceph-mon[116404]: pgmap v2022: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:39:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:12 smithi084 ceph-mon[119097]: pgmap v2022: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:39:13.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:12 smithi099 ceph-mon[138788]: pgmap v2022: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 4 op/s 2024-01-13T18:39:13.708 INFO:tasks.workunit.client.0.smithi084.stdout: 1069: throughput=5MB/sec pending data=0 2024-01-13T18:39:13.708 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RXCt6ZQgCez-FOA off=603427 len=1061897 2024-01-13T18:39:13.714 INFO:tasks.workunit.client.0.smithi084.stdout:op 5410 completed, throughput=5MB/sec 2024-01-13T18:39:13.714 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nNVqUGSozOd71Ag off=10805105 len=241944 2024-01-13T18:39:13.715 INFO:tasks.workunit.client.0.smithi084.stdout:op 5411 completed, throughput=5MB/sec 2024-01-13T18:39:13.715 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-reKgm-UoKb7qiAR off=2043537 len=800868 2024-01-13T18:39:13.716 INFO:tasks.workunit.client.0.smithi084.stdout:op 5412 completed, throughput=5MB/sec 2024-01-13T18:39:13.716 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4E2vy-6MjhIw3O6 off=5702230 len=1186459 2024-01-13T18:39:13.722 INFO:tasks.workunit.client.0.smithi084.stdout:op 5413 completed, throughput=5MB/sec 2024-01-13T18:39:13.722 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6kYYXCqKSPIAJhM off=1510309 len=349170 2024-01-13T18:39:13.723 INFO:tasks.workunit.client.0.smithi084.stdout:op 5414 completed, throughput=5MB/sec 2024-01-13T18:39:13.724 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qez1AztBbxWo2B5 off=6226319 len=1372916 2024-01-13T18:39:13.729 INFO:tasks.workunit.client.0.smithi084.stdout:op 5415 completed, throughput=5MB/sec 2024-01-13T18:39:14.730 INFO:tasks.workunit.client.0.smithi084.stdout: 1070: throughput=5MB/sec pending data=0 2024-01-13T18:39:14.730 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ygjr1BSQaX1EZPr off=6256634 len=1194971 2024-01-13T18:39:14.735 INFO:tasks.workunit.client.0.smithi084.stdout:op 5416 completed, throughput=5MB/sec 2024-01-13T18:39:14.735 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JScJe9r8vdzEj9a off=0 len=1641136 2024-01-13T18:39:14.740 INFO:tasks.workunit.client.0.smithi084.stdout:op 5417 completed, throughput=5MB/sec 2024-01-13T18:39:14.740 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JDk-8MDRVra1TFQ off=3491790 len=785287 2024-01-13T18:39:14.745 INFO:tasks.workunit.client.0.smithi084.stdout:op 5418 completed, throughput=5MB/sec 2024-01-13T18:39:14.745 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eRwOHmNuB1WML9O off=2659970 len=464264 2024-01-13T18:39:14.749 INFO:tasks.workunit.client.0.smithi084.stdout:op 5419 completed, throughput=5MB/sec 2024-01-13T18:39:14.749 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZMYe2OwHuDMpJ1m off=11758234 len=985616 2024-01-13T18:39:14.750 INFO:tasks.workunit.client.0.smithi084.stdout:op 5420 completed, throughput=5MB/sec 2024-01-13T18:39:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:14 smithi084 ceph-mon[116404]: pgmap v2023: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:39:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:14 smithi084 ceph-mon[119097]: pgmap v2023: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:39:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:14 smithi099 ceph-mon[138788]: pgmap v2023: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 5 op/s 2024-01-13T18:39:15.751 INFO:tasks.workunit.client.0.smithi084.stdout: 1071: throughput=5MB/sec pending data=0 2024-01-13T18:39:15.751 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OzPLP3PmzvWkj1n off=3856968 len=2039580 2024-01-13T18:39:15.761 INFO:tasks.workunit.client.0.smithi084.stdout:op 5421 completed, throughput=5MB/sec 2024-01-13T18:39:15.761 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MOucN7WPY9NZXpX off=18482384 len=323170 2024-01-13T18:39:15.764 INFO:tasks.workunit.client.0.smithi084.stdout:op 5422 completed, throughput=5MB/sec 2024-01-13T18:39:15.764 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qrcDJjXaIHyCK5y off=3106550 len=1218049 2024-01-13T18:39:15.771 INFO:tasks.workunit.client.0.smithi084.stdout:op 5423 completed, throughput=5MB/sec 2024-01-13T18:39:15.771 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2XMOn8pAnrX98fy off=16602394 len=211137 2024-01-13T18:39:15.773 INFO:tasks.workunit.client.0.smithi084.stdout:op 5424 completed, throughput=5MB/sec 2024-01-13T18:39:15.773 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LMTX8a1yqxD-ODw off=1491341 len=1628520 2024-01-13T18:39:15.774 INFO:tasks.workunit.client.0.smithi084.stdout:op 5425 completed, throughput=5MB/sec 2024-01-13T18:39:16.775 INFO:tasks.workunit.client.0.smithi084.stdout: 1072: throughput=5MB/sec pending data=0 2024-01-13T18:39:16.775 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Z9bAZtxXhJOLMFs off=12173586 len=925363 2024-01-13T18:39:16.780 INFO:tasks.workunit.client.0.smithi084.stdout:op 5426 completed, throughput=5MB/sec 2024-01-13T18:39:16.780 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Q59VmPKb-jvkSAV off=5782261 len=840477 2024-01-13T18:39:16.784 INFO:tasks.workunit.client.0.smithi084.stdout:op 5427 completed, throughput=5MB/sec 2024-01-13T18:39:16.784 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-s44ZIqk5PD2raFe off=5795590 len=1331226 2024-01-13T18:39:16.791 INFO:tasks.workunit.client.0.smithi084.stdout:op 5428 completed, throughput=5MB/sec 2024-01-13T18:39:16.791 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mB8agLaz3EHm3_Z off=14106891 len=2017041 2024-01-13T18:39:16.803 INFO:tasks.workunit.client.0.smithi084.stdout:op 5429 completed, throughput=5MB/sec 2024-01-13T18:39:16.803 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9o8OTd-ln1Gl0dS off=5756866 len=800310 2024-01-13T18:39:16.804 INFO:tasks.workunit.client.0.smithi084.stdout:op 5430 completed, throughput=5MB/sec 2024-01-13T18:39:16.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:16 smithi084 ceph-mon[116404]: pgmap v2024: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:39:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:16 smithi084 ceph-mon[119097]: pgmap v2024: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:39:17.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:16 smithi099 ceph-mon[138788]: pgmap v2024: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-01-13T18:39:17.804 INFO:tasks.workunit.client.0.smithi084.stdout: 1073: throughput=5MB/sec pending data=0 2024-01-13T18:39:17.804 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nfSrI2gzzEvlcuK off=3995743 len=1232252 2024-01-13T18:39:17.806 INFO:tasks.workunit.client.0.smithi084.stdout:op 5431 completed, throughput=5MB/sec 2024-01-13T18:39:17.807 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-7IFuT0I0XIYDUbW off=436895 len=1597951 2024-01-13T18:39:17.810 INFO:tasks.workunit.client.0.smithi084.stdout:op 5432 completed, throughput=5MB/sec 2024-01-13T18:39:17.810 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ha6kCg1pzyHZ0C8 off=8172170 len=1310622 2024-01-13T18:39:17.816 INFO:tasks.workunit.client.0.smithi084.stdout:op 5433 completed, throughput=5MB/sec 2024-01-13T18:39:17.816 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BaOKez2ZSa2F8x8 off=0 len=1107739 2024-01-13T18:39:17.820 INFO:tasks.workunit.client.0.smithi084.stdout:op 5434 completed, throughput=5MB/sec 2024-01-13T18:39:18.821 INFO:tasks.workunit.client.0.smithi084.stdout: 1074: throughput=5MB/sec pending data=0 2024-01-13T18:39:18.821 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9gnKBm7FUId-WCp off=3506763 len=1584236 2024-01-13T18:39:18.823 INFO:tasks.workunit.client.0.smithi084.stdout:op 5435 completed, throughput=5MB/sec 2024-01-13T18:39:18.823 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rcLzElpRsw1dDY1 off=13856509 len=120036 2024-01-13T18:39:18.826 INFO:tasks.workunit.client.0.smithi084.stdout:op 5436 completed, throughput=5MB/sec 2024-01-13T18:39:18.826 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8LQRn3LnhuxH8gS off=10620026 len=1316903 2024-01-13T18:39:18.832 INFO:tasks.workunit.client.0.smithi084.stdout:op 5437 completed, throughput=5MB/sec 2024-01-13T18:39:18.832 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8u1nwGpA8rPSfPT off=4760726 len=149844 2024-01-13T18:39:18.833 INFO:tasks.workunit.client.0.smithi084.stdout:op 5438 completed, throughput=5MB/sec 2024-01-13T18:39:18.833 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NbiaBsR0EobCNUL off=15589290 len=1991703 2024-01-13T18:39:18.845 INFO:tasks.workunit.client.0.smithi084.stdout:op 5439 completed, throughput=5MB/sec 2024-01-13T18:39:19.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:19 smithi099 ceph-mon[138788]: pgmap v2025: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:39:19.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:19 smithi084 ceph-mon[116404]: pgmap v2025: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:39:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:19 smithi084 ceph-mon[119097]: pgmap v2025: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:39:19.845 INFO:tasks.workunit.client.0.smithi084.stdout: 1075: throughput=5MB/sec pending data=0 2024-01-13T18:39:19.845 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sg0OJHV4LEOH48J off=5494320 len=840951 2024-01-13T18:39:19.846 INFO:tasks.workunit.client.0.smithi084.stdout:op 5440 completed, throughput=5MB/sec 2024-01-13T18:39:19.847 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6ooS1pQ5FPsKJtp off=1381863 len=1019736 2024-01-13T18:39:19.849 INFO:tasks.workunit.client.0.smithi084.stdout:op 5441 completed, throughput=5MB/sec 2024-01-13T18:39:19.849 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k8uMXatqEoE-VFB off=3872013 len=1446872 2024-01-13T18:39:19.850 INFO:tasks.workunit.client.0.smithi084.stdout:op 5442 completed, throughput=5MB/sec 2024-01-13T18:39:19.850 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YMa2CPnXHcusmZs off=3670115 len=2088095 2024-01-13T18:39:19.862 INFO:tasks.workunit.client.0.smithi084.stdout:op 5443 completed, throughput=5MB/sec 2024-01-13T18:39:20.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:20.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:39:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:39:20] "GET /metrics HTTP/1.1" 200 33998 "" "Prometheus/2.43.0" 2024-01-13T18:39:20.862 INFO:tasks.workunit.client.0.smithi084.stdout: 1076: throughput=5MB/sec pending data=0 2024-01-13T18:39:20.863 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-11AFgdzvE-A6oPD off=1948971 len=1132151 2024-01-13T18:39:20.864 INFO:tasks.workunit.client.0.smithi084.stdout:op 5444 completed, throughput=5MB/sec 2024-01-13T18:39:20.864 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8jZ5pZlLJJNlitK off=2043463 len=1460129 2024-01-13T18:39:20.872 INFO:tasks.workunit.client.0.smithi084.stdout:op 5445 completed, throughput=5MB/sec 2024-01-13T18:39:20.872 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qXTrRhqT_Be-DEM off=11611657 len=101532 2024-01-13T18:39:20.875 INFO:tasks.workunit.client.0.smithi084.stdout:op 5446 completed, throughput=5MB/sec 2024-01-13T18:39:20.875 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zWJ_-cbYfvdhLgY off=2708384 len=1676623 2024-01-13T18:39:20.878 INFO:tasks.workunit.client.0.smithi084.stdout:op 5447 completed, throughput=5MB/sec 2024-01-13T18:39:20.878 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ePelxXgl7WSNrxN off=3569857 len=1527635 2024-01-13T18:39:20.881 INFO:tasks.workunit.client.0.smithi084.stdout:op 5448 completed, throughput=5MB/sec 2024-01-13T18:39:21.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:21 smithi084 ceph-mon[116404]: pgmap v2026: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:39:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:21 smithi084 ceph-mon[119097]: pgmap v2026: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:39:21.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:21 smithi099 ceph-mon[138788]: pgmap v2026: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 5 op/s 2024-01-13T18:39:21.881 INFO:tasks.workunit.client.0.smithi084.stdout: 1077: throughput=5MB/sec pending data=0 2024-01-13T18:39:21.881 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7y01TXPYxzU1Tk3 off=10878985 len=1451799 2024-01-13T18:39:21.890 INFO:tasks.workunit.client.0.smithi084.stdout:op 5449 completed, throughput=5MB/sec 2024-01-13T18:39:21.890 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IztyQAiwm8QN-EY off=1119577 len=985932 2024-01-13T18:39:21.896 INFO:tasks.workunit.client.0.smithi084.stdout:op 5450 completed, throughput=5MB/sec 2024-01-13T18:39:21.896 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9FmnNVrpEIXaIqX off=703581 len=813969 2024-01-13T18:39:21.897 INFO:tasks.workunit.client.0.smithi084.stdout:op 5451 completed, throughput=5MB/sec 2024-01-13T18:39:21.897 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wSje2E2Py8o3N54 off=7490637 len=247010 2024-01-13T18:39:21.900 INFO:tasks.workunit.client.0.smithi084.stdout:op 5452 completed, throughput=5MB/sec 2024-01-13T18:39:21.900 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LLwrz732G2WhtL9 off=4539564 len=1405779 2024-01-13T18:39:21.907 INFO:tasks.workunit.client.0.smithi084.stdout:op 5453 completed, throughput=5MB/sec 2024-01-13T18:39:22.908 INFO:tasks.workunit.client.0.smithi084.stdout: 1078: throughput=5MB/sec pending data=0 2024-01-13T18:39:22.908 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-g3QtEA7uyR0haFY off=242734 len=1005439 2024-01-13T18:39:22.909 INFO:tasks.workunit.client.0.smithi084.stdout:op 5454 completed, throughput=5MB/sec 2024-01-13T18:39:22.909 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uHP7RCjJhSb1z5N off=26784 len=660853 2024-01-13T18:39:22.914 INFO:tasks.workunit.client.0.smithi084.stdout:op 5455 completed, throughput=5MB/sec 2024-01-13T18:39:22.914 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tPwrv0FUB0xaxko off=13117018 len=938204 2024-01-13T18:39:22.919 INFO:tasks.workunit.client.0.smithi084.stdout:op 5456 completed, throughput=5MB/sec 2024-01-13T18:39:22.919 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tuo3WqrbM4lAQSz off=7492578 len=556472 2024-01-13T18:39:22.923 INFO:tasks.workunit.client.0.smithi084.stdout:op 5457 completed, throughput=5MB/sec 2024-01-13T18:39:22.923 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-g13jb_vkE5BoMlh off=3230375 len=1597455 2024-01-13T18:39:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:22 smithi084 ceph-mon[116404]: pgmap v2027: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:39:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:22 smithi084 ceph-mon[119097]: pgmap v2027: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:39:22.929 INFO:tasks.workunit.client.0.smithi084.stdout:op 5458 completed, throughput=5MB/sec 2024-01-13T18:39:22.929 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YRwh88vlTk1A_HW off=9636708 len=1746357 2024-01-13T18:39:22.932 INFO:tasks.workunit.client.0.smithi084.stdout:op 5459 completed, throughput=5MB/sec 2024-01-13T18:39:23.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:22 smithi099 ceph-mon[138788]: pgmap v2027: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:39:23.932 INFO:tasks.workunit.client.0.smithi084.stdout: 1079: throughput=5MB/sec pending data=0 2024-01-13T18:39:23.933 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj---V8zp_L11SCP3- off=633197 len=518366 2024-01-13T18:39:23.936 INFO:tasks.workunit.client.0.smithi084.stdout:op 5460 completed, throughput=5MB/sec 2024-01-13T18:39:23.937 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r8z_euGjt4xLPsz off=3148385 len=1792161 2024-01-13T18:39:23.944 INFO:tasks.workunit.client.0.smithi084.stdout:op 5461 completed, throughput=5MB/sec 2024-01-13T18:39:23.944 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-W44MY5Db2Q5NBDE off=2874694 len=450016 2024-01-13T18:39:23.947 INFO:tasks.workunit.client.0.smithi084.stdout:op 5462 completed, throughput=5MB/sec 2024-01-13T18:39:23.947 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1zaOA-2AYC6s5nL off=7625205 len=1733492 2024-01-13T18:39:23.958 INFO:tasks.workunit.client.0.smithi084.stdout:op 5463 completed, throughput=5MB/sec 2024-01-13T18:39:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:24 smithi084 ceph-mon[116404]: pgmap v2028: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:39:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:24 smithi084 ceph-mon[119097]: pgmap v2028: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:39:24.958 INFO:tasks.workunit.client.0.smithi084.stdout: 1080: throughput=5MB/sec pending data=0 2024-01-13T18:39:24.958 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-05QS7WJMGEw6CIA off=3410627 len=880018 2024-01-13T18:39:24.959 INFO:tasks.workunit.client.0.smithi084.stdout:op 5464 completed, throughput=5MB/sec 2024-01-13T18:39:24.960 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-T-x3vuN1pGCbh5b off=1319712 len=212532 2024-01-13T18:39:24.963 INFO:tasks.workunit.client.0.smithi084.stdout:op 5465 completed, throughput=5MB/sec 2024-01-13T18:39:24.963 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Mfb85xc_4A1qHKI off=16069163 len=1864828 2024-01-13T18:39:24.965 INFO:tasks.workunit.client.0.smithi084.stdout:op 5466 completed, throughput=5MB/sec 2024-01-13T18:39:24.965 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wQlVdj0JAFO2oNm off=1275190 len=1873082 2024-01-13T18:39:24.968 INFO:tasks.workunit.client.0.smithi084.stdout:op 5467 completed, throughput=5MB/sec 2024-01-13T18:39:25.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:24 smithi099 ceph-mon[138788]: pgmap v2028: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:39:25.969 INFO:tasks.workunit.client.0.smithi084.stdout: 1081: throughput=5MB/sec pending data=0 2024-01-13T18:39:25.969 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NFiA28cItk9YnAl off=8336277 len=1524367 2024-01-13T18:39:25.972 INFO:tasks.workunit.client.0.smithi084.stdout:op 5468 completed, throughput=5MB/sec 2024-01-13T18:39:25.972 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eWZqyQlW0c_LkCT off=11389 len=1129521 2024-01-13T18:39:25.973 INFO:tasks.workunit.client.0.smithi084.stdout:op 5469 completed, throughput=5MB/sec 2024-01-13T18:39:25.973 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DPw_OrQjRHE6Hk9 off=414699 len=2686 2024-01-13T18:39:25.976 INFO:tasks.workunit.client.0.smithi084.stdout:op 5470 completed, throughput=5MB/sec 2024-01-13T18:39:25.976 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-f9dTjd00ynoy_3n off=762877 len=933500 2024-01-13T18:39:25.981 INFO:tasks.workunit.client.0.smithi084.stdout:op 5471 completed, throughput=5MB/sec 2024-01-13T18:39:25.982 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eDuyjbFsIGsTcSH off=10976719 len=1762387 2024-01-13T18:39:25.984 INFO:tasks.workunit.client.0.smithi084.stdout:op 5472 completed, throughput=5MB/sec 2024-01-13T18:39:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:26 smithi084 ceph-mon[116404]: pgmap v2029: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:26.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:26 smithi084 ceph-mon[119097]: pgmap v2029: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:26.984 INFO:tasks.workunit.client.0.smithi084.stdout: 1082: throughput=5MB/sec pending data=0 2024-01-13T18:39:26.984 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-raHzIF6gHvl7uea off=14650284 len=417009 2024-01-13T18:39:26.985 INFO:tasks.workunit.client.0.smithi084.stdout:op 5473 completed, throughput=5MB/sec 2024-01-13T18:39:26.985 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zJuUj74GjpUshO3 off=896740 len=1026974 2024-01-13T18:39:26.988 INFO:tasks.workunit.client.0.smithi084.stdout:op 5474 completed, throughput=5MB/sec 2024-01-13T18:39:26.988 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mha-CcaPr3rfu4c off=2597054 len=2018581 2024-01-13T18:39:27.000 INFO:tasks.workunit.client.0.smithi084.stdout:op 5475 completed, throughput=5MB/sec 2024-01-13T18:39:27.001 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3biyI0dgZH2bkYP off=3391399 len=553041 2024-01-13T18:39:27.002 INFO:tasks.workunit.client.0.smithi084.stdout:op 5476 completed, throughput=5MB/sec 2024-01-13T18:39:27.002 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-u8rivL3w5ygKIW8 off=15933104 len=439333 2024-01-13T18:39:27.002 INFO:tasks.workunit.client.0.smithi084.stdout:op 5477 completed, throughput=5MB/sec 2024-01-13T18:39:27.002 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-vcg3844sZt4m93I off=12480482 len=1724833 2024-01-13T18:39:27.010 INFO:tasks.workunit.client.0.smithi084.stdout:op 5478 completed, throughput=5MB/sec 2024-01-13T18:39:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:26 smithi099 ceph-mon[138788]: pgmap v2029: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:28.011 INFO:tasks.workunit.client.0.smithi084.stdout: 1083: throughput=5MB/sec pending data=0 2024-01-13T18:39:28.011 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uolYtvhTjE0RYas off=4911807 len=504873 2024-01-13T18:39:28.015 INFO:tasks.workunit.client.0.smithi084.stdout:op 5479 completed, throughput=5MB/sec 2024-01-13T18:39:28.015 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AYrDJ7Wt_NVefzG off=4297266 len=1444937 2024-01-13T18:39:28.024 INFO:tasks.workunit.client.0.smithi084.stdout:op 5480 completed, throughput=5MB/sec 2024-01-13T18:39:28.024 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n0y0CJNdgrJ90S_ off=8685160 len=663326 2024-01-13T18:39:28.029 INFO:tasks.workunit.client.0.smithi084.stdout:op 5481 completed, throughput=5MB/sec 2024-01-13T18:39:28.029 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kq3wrDoBRoxl1ql off=10972940 len=627103 2024-01-13T18:39:28.030 INFO:tasks.workunit.client.0.smithi084.stdout:op 5482 completed, throughput=5MB/sec 2024-01-13T18:39:28.030 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GDSLJxMN45UFHKk off=6909660 len=1363019 2024-01-13T18:39:28.033 INFO:tasks.workunit.client.0.smithi084.stdout:op 5483 completed, throughput=5MB/sec 2024-01-13T18:39:29.033 INFO:tasks.workunit.client.0.smithi084.stdout: 1084: throughput=5MB/sec pending data=0 2024-01-13T18:39:29.033 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-O7KOHjG3Ey8mRVl off=3294544 len=967533 2024-01-13T18:39:29.036 INFO:tasks.workunit.client.0.smithi084.stdout:op 5484 completed, throughput=5MB/sec 2024-01-13T18:39:29.036 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0Fs31-yS4fhIX9V off=4646863 len=1965946 2024-01-13T18:39:29.048 INFO:tasks.workunit.client.0.smithi084.stdout:op 5485 completed, throughput=5MB/sec 2024-01-13T18:39:29.048 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xnRx_dArddnKyG6 off=2576215 len=613834 2024-01-13T18:39:29.049 INFO:tasks.workunit.client.0.smithi084.stdout:op 5486 completed, throughput=5MB/sec 2024-01-13T18:39:29.049 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YK8CJfizlSTq_WY off=11192073 len=2042395 2024-01-13T18:39:29.060 INFO:tasks.workunit.client.0.smithi084.stdout:op 5487 completed, throughput=5MB/sec 2024-01-13T18:39:29.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:29 smithi099 ceph-mon[138788]: pgmap v2030: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:29.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:29 smithi084 ceph-mon[116404]: pgmap v2030: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:29.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:29 smithi084 ceph-mon[119097]: pgmap v2030: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:30.060 INFO:tasks.workunit.client.0.smithi084.stdout: 1085: throughput=5MB/sec pending data=0 2024-01-13T18:39:30.060 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qwYvxtA6FANuShR off=2773741 len=524580 2024-01-13T18:39:30.062 INFO:tasks.workunit.client.0.smithi084.stdout:op 5488 completed, throughput=5MB/sec 2024-01-13T18:39:30.062 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4t9aywsjgrBquqd off=1685009 len=736551 2024-01-13T18:39:30.063 INFO:tasks.workunit.client.0.smithi084.stdout:op 5489 completed, throughput=5MB/sec 2024-01-13T18:39:30.063 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2XqYcqL1xXkLJkX off=333762 len=634811 2024-01-13T18:39:30.064 INFO:tasks.workunit.client.0.smithi084.stdout:op 5490 completed, throughput=5MB/sec 2024-01-13T18:39:30.064 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SsqtoB1SEbADLm1 off=4294044 len=1441493 2024-01-13T18:39:30.072 INFO:tasks.workunit.client.0.smithi084.stdout:op 5491 completed, throughput=5MB/sec 2024-01-13T18:39:30.072 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-CM20iDxunDr4FOt off=5519517 len=1156457 2024-01-13T18:39:30.079 INFO:tasks.workunit.client.0.smithi084.stdout:op 5492 completed, throughput=5MB/sec 2024-01-13T18:39:30.079 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bOyh3mzN_Ks8UA_ off=14029341 len=1708089 2024-01-13T18:39:30.080 INFO:tasks.workunit.client.0.smithi084.stdout:op 5493 completed, throughput=5MB/sec 2024-01-13T18:39:30.655 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:39:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:39:30] "GET /metrics HTTP/1.1" 200 33998 "" "Prometheus/2.43.0" 2024-01-13T18:39:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:30 smithi084 ceph-mon[116404]: pgmap v2031: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:39:30.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:30 smithi084 ceph-mon[119097]: pgmap v2031: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:39:31.081 INFO:tasks.workunit.client.0.smithi084.stdout: 1086: throughput=5MB/sec pending data=0 2024-01-13T18:39:31.081 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-K7dLrNjQE_gkmGK off=3479258 len=841049 2024-01-13T18:39:31.082 INFO:tasks.workunit.client.0.smithi084.stdout:op 5494 completed, throughput=5MB/sec 2024-01-13T18:39:31.082 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nPQS4tU7Od_lTsU off=4246282 len=1996258 2024-01-13T18:39:31.092 INFO:tasks.workunit.client.0.smithi084.stdout:op 5495 completed, throughput=5MB/sec 2024-01-13T18:39:31.092 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Mi2SxtIuJM42ZoI off=1861027 len=869778 2024-01-13T18:39:31.098 INFO:tasks.workunit.client.0.smithi084.stdout:op 5496 completed, throughput=5MB/sec 2024-01-13T18:39:31.098 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OnwGe4itc09mgi4 off=3082960 len=1957574 2024-01-13T18:39:31.107 INFO:tasks.workunit.client.0.smithi084.stdout:op 5497 completed, throughput=5MB/sec 2024-01-13T18:39:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:30 smithi099 ceph-mon[138788]: pgmap v2031: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:39:32.107 INFO:tasks.workunit.client.0.smithi084.stdout: 1087: throughput=5MB/sec pending data=0 2024-01-13T18:39:32.107 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iWXoJfrQhq7LjeT off=1935788 len=1523493 2024-01-13T18:39:32.115 INFO:tasks.workunit.client.0.smithi084.stdout:op 5498 completed, throughput=5MB/sec 2024-01-13T18:39:32.115 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-p17x9NS7GK-uCmn off=1299841 len=110471 2024-01-13T18:39:32.115 INFO:tasks.workunit.client.0.smithi084.stdout:op 5499 completed, throughput=5MB/sec 2024-01-13T18:39:32.115 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XrbJSjt9-SJd9dc off=4877823 len=1136676 2024-01-13T18:39:32.122 INFO:tasks.workunit.client.0.smithi084.stdout:op 5500 completed, throughput=5MB/sec 2024-01-13T18:39:32.122 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4dfw4RQhVeLjDUN off=14177968 len=1193775 2024-01-13T18:39:32.127 INFO:tasks.workunit.client.0.smithi084.stdout:op 5501 completed, throughput=5MB/sec 2024-01-13T18:39:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:32 smithi084 ceph-mon[116404]: pgmap v2032: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:39:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:32 smithi084 ceph-mon[119097]: pgmap v2032: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:39:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:32 smithi099 ceph-mon[138788]: pgmap v2032: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:39:33.128 INFO:tasks.workunit.client.0.smithi084.stdout: 1088: throughput=5MB/sec pending data=0 2024-01-13T18:39:33.128 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--jputMcVuhquh2j off=3221449 len=249277 2024-01-13T18:39:33.129 INFO:tasks.workunit.client.0.smithi084.stdout:op 5502 completed, throughput=5MB/sec 2024-01-13T18:39:33.129 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-voRJpSOWVqbZw53 off=5792170 len=1113491 2024-01-13T18:39:33.131 INFO:tasks.workunit.client.0.smithi084.stdout:op 5503 completed, throughput=5MB/sec 2024-01-13T18:39:33.131 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-AsOQM8UtflMvKKu off=110561 len=1477531 2024-01-13T18:39:33.132 INFO:tasks.workunit.client.0.smithi084.stdout:op 5504 completed, throughput=5MB/sec 2024-01-13T18:39:33.132 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-I82swi62ktVX7Nu off=6169686 len=489524 2024-01-13T18:39:33.133 INFO:tasks.workunit.client.0.smithi084.stdout:op 5505 completed, throughput=5MB/sec 2024-01-13T18:39:33.133 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-r7MfqXd5S7ue13q off=13161425 len=1007726 2024-01-13T18:39:33.139 INFO:tasks.workunit.client.0.smithi084.stdout:op 5506 completed, throughput=5MB/sec 2024-01-13T18:39:33.139 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RsP3MXsXSQOH1Jj off=217699 len=993991 2024-01-13T18:39:33.144 INFO:tasks.workunit.client.0.smithi084.stdout:op 5507 completed, throughput=5MB/sec 2024-01-13T18:39:34.144 INFO:tasks.workunit.client.0.smithi084.stdout: 1089: throughput=5MB/sec pending data=0 2024-01-13T18:39:34.145 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aQmNJRXTKuBTka8 off=4515586 len=1690681 2024-01-13T18:39:34.151 INFO:tasks.workunit.client.0.smithi084.stdout:op 5508 completed, throughput=5MB/sec 2024-01-13T18:39:34.151 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SIQe8b5mSpw9DsP off=10832763 len=1090647 2024-01-13T18:39:34.156 INFO:tasks.workunit.client.0.smithi084.stdout:op 5509 completed, throughput=5MB/sec 2024-01-13T18:39:34.156 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-CpWx3eJmR9B9Ibs off=13560232 len=1463545 2024-01-13T18:39:34.157 INFO:tasks.workunit.client.0.smithi084.stdout:op 5510 completed, throughput=5MB/sec 2024-01-13T18:39:34.158 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y9gAa-1Rh5yMYfB off=3942512 len=1405937 2024-01-13T18:39:34.166 INFO:tasks.workunit.client.0.smithi084.stdout:op 5511 completed, throughput=5MB/sec 2024-01-13T18:39:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:34 smithi084 ceph-mon[116404]: pgmap v2033: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:34 smithi084 ceph-mon[119097]: pgmap v2033: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:35.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:34 smithi099 ceph-mon[138788]: pgmap v2033: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:35.166 INFO:tasks.workunit.client.0.smithi084.stdout: 1090: throughput=5MB/sec pending data=0 2024-01-13T18:39:35.167 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-X2_lmtQYFGLR6pu off=5332121 len=868170 2024-01-13T18:39:35.168 INFO:tasks.workunit.client.0.smithi084.stdout:op 5512 completed, throughput=5MB/sec 2024-01-13T18:39:35.168 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-giL6xtL62EsHc63 off=3191149 len=98258 2024-01-13T18:39:35.170 INFO:tasks.workunit.client.0.smithi084.stdout:op 5513 completed, throughput=5MB/sec 2024-01-13T18:39:35.171 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-q087YgtJCSDii6G off=1431744 len=626548 2024-01-13T18:39:35.171 INFO:tasks.workunit.client.0.smithi084.stdout:op 5514 completed, throughput=5MB/sec 2024-01-13T18:39:35.172 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_MyKFIud_f059Gi off=18243769 len=511457 2024-01-13T18:39:35.176 INFO:tasks.workunit.client.0.smithi084.stdout:op 5515 completed, throughput=5MB/sec 2024-01-13T18:39:35.176 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pRHbW3xn71VFnJ6 off=5964431 len=355133 2024-01-13T18:39:35.179 INFO:tasks.workunit.client.0.smithi084.stdout:op 5516 completed, throughput=5MB/sec 2024-01-13T18:39:35.179 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yEik4QQRyd5nKx0 off=17621901 len=391563 2024-01-13T18:39:35.180 INFO:tasks.workunit.client.0.smithi084.stdout:op 5517 completed, throughput=5MB/sec 2024-01-13T18:39:35.180 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EJxmSZ1A6LjNg30 off=3498389 len=1393983 2024-01-13T18:39:35.188 INFO:tasks.workunit.client.0.smithi084.stdout:op 5518 completed, throughput=5MB/sec 2024-01-13T18:39:35.188 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-50Z6CUgevIVFdUg off=5618949 len=1575540 2024-01-13T18:39:35.189 INFO:tasks.workunit.client.0.smithi084.stdout:op 5519 completed, throughput=5MB/sec 2024-01-13T18:39:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:36.190 INFO:tasks.workunit.client.0.smithi084.stdout: 1091: throughput=5MB/sec pending data=0 2024-01-13T18:39:36.190 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hZaECd9EiPi6OdP off=8933079 len=1490716 2024-01-13T18:39:36.192 INFO:tasks.workunit.client.0.smithi084.stdout:op 5520 completed, throughput=5MB/sec 2024-01-13T18:39:36.192 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Y7pKLNhN6KlxTem off=4232851 len=1461305 2024-01-13T18:39:36.201 INFO:tasks.workunit.client.0.smithi084.stdout:op 5521 completed, throughput=5MB/sec 2024-01-13T18:39:36.201 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0WXgs8NC0ST_34n off=724053 len=734009 2024-01-13T18:39:36.205 INFO:tasks.workunit.client.0.smithi084.stdout:op 5522 completed, throughput=5MB/sec 2024-01-13T18:39:36.205 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VnKmIxrkVabyi0m off=8243351 len=223857 2024-01-13T18:39:36.206 INFO:tasks.workunit.client.0.smithi084.stdout:op 5523 completed, throughput=5MB/sec 2024-01-13T18:39:36.206 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wIstIyC9LXFSjBg off=11827133 len=1610862 2024-01-13T18:39:36.212 INFO:tasks.workunit.client.0.smithi084.stdout:op 5524 completed, throughput=5MB/sec 2024-01-13T18:39:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:36 smithi084 ceph-mon[116404]: pgmap v2034: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:36 smithi084 ceph-mon[119097]: pgmap v2034: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:36 smithi099 ceph-mon[138788]: pgmap v2034: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:39:37.213 INFO:tasks.workunit.client.0.smithi084.stdout: 1092: throughput=5MB/sec pending data=0 2024-01-13T18:39:37.213 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bQA62A71Sl0i0Z_ off=3625346 len=1144467 2024-01-13T18:39:37.217 INFO:tasks.workunit.client.0.smithi084.stdout:op 5525 completed, throughput=5MB/sec 2024-01-13T18:39:37.217 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jwYpmavHeScla3h off=3312916 len=266992 2024-01-13T18:39:37.218 INFO:tasks.workunit.client.0.smithi084.stdout:op 5526 completed, throughput=5MB/sec 2024-01-13T18:39:37.218 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-oc4lWfL7GkRV50j off=553511 len=506479 2024-01-13T18:39:37.219 INFO:tasks.workunit.client.0.smithi084.stdout:op 5527 completed, throughput=5MB/sec 2024-01-13T18:39:37.219 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZTJv-YjwZrQ9KYb off=3880450 len=1694789 2024-01-13T18:39:37.220 INFO:tasks.workunit.client.0.smithi084.stdout:op 5528 completed, throughput=5MB/sec 2024-01-13T18:39:37.220 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-DGvw1XQokuUH-5l off=12637021 len=975027 2024-01-13T18:39:37.225 INFO:tasks.workunit.client.0.smithi084.stdout:op 5529 completed, throughput=5MB/sec 2024-01-13T18:39:37.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:39:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:39:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:39:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:39:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:39:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:39:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:39:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:39:38.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:39:38.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:39:38.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:39:38.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:39:38.226 INFO:tasks.workunit.client.0.smithi084.stdout: 1093: throughput=5MB/sec pending data=0 2024-01-13T18:39:38.226 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rrTYnoJBhYVOfsy off=5096286 len=261962 2024-01-13T18:39:38.229 INFO:tasks.workunit.client.0.smithi084.stdout:op 5530 completed, throughput=5MB/sec 2024-01-13T18:39:38.229 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-X-ZaVmWhSnU2dv9 off=3422468 len=1005508 2024-01-13T18:39:38.231 INFO:tasks.workunit.client.0.smithi084.stdout:op 5531 completed, throughput=5MB/sec 2024-01-13T18:39:38.231 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TRlh_8ADeGa7Yqw off=6220382 len=1485441 2024-01-13T18:39:38.234 INFO:tasks.workunit.client.0.smithi084.stdout:op 5532 completed, throughput=5MB/sec 2024-01-13T18:39:38.234 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3cyvIOCaHVUnj3R off=15451531 len=1597167 2024-01-13T18:39:38.235 INFO:tasks.workunit.client.0.smithi084.stdout:op 5533 completed, throughput=5MB/sec 2024-01-13T18:39:38.236 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8-T-e6Te5wGSZbh off=1793568 len=1979783 2024-01-13T18:39:38.244 INFO:tasks.workunit.client.0.smithi084.stdout:op 5534 completed, throughput=5MB/sec 2024-01-13T18:39:39.244 INFO:tasks.workunit.client.0.smithi084.stdout: 1094: throughput=5MB/sec pending data=0 2024-01-13T18:39:39.244 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-98MdxTYqxZyprnf off=31275 len=1618779 2024-01-13T18:39:39.252 INFO:tasks.workunit.client.0.smithi084.stdout:op 5535 completed, throughput=5MB/sec 2024-01-13T18:39:39.252 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nzaac8Vssz2Wy3e off=3136438 len=1682222 2024-01-13T18:39:39.262 INFO:tasks.workunit.client.0.smithi084.stdout:op 5536 completed, throughput=5MB/sec 2024-01-13T18:39:39.262 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--WBkuttWY6Pwi53 off=5644904 len=1029364 2024-01-13T18:39:39.263 INFO:tasks.workunit.client.0.smithi084.stdout:op 5537 completed, throughput=5MB/sec 2024-01-13T18:39:39.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:39 smithi084 ceph-mon[116404]: pgmap v2035: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:39:39.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:39 smithi084 ceph-mon[119097]: pgmap v2035: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:39:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:39 smithi099 ceph-mon[138788]: pgmap v2035: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:39:40.264 INFO:tasks.workunit.client.0.smithi084.stdout: 1095: throughput=5MB/sec pending data=0 2024-01-13T18:39:40.264 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-py7AYGqrf0N4qgE off=2028455 len=1534512 2024-01-13T18:39:40.272 INFO:tasks.workunit.client.0.smithi084.stdout:op 5538 completed, throughput=5MB/sec 2024-01-13T18:39:40.272 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3dyfAgoBXPY3Yop off=2602313 len=1806459 2024-01-13T18:39:40.283 INFO:tasks.workunit.client.0.smithi084.stdout:op 5539 completed, throughput=5MB/sec 2024-01-13T18:39:40.283 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4w2Ob-DVynizOOc off=6844769 len=88719 2024-01-13T18:39:40.283 INFO:tasks.workunit.client.0.smithi084.stdout:op 5540 completed, throughput=5MB/sec 2024-01-13T18:39:40.284 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8kbcXG6ti_m7y3t off=9817673 len=1923183 2024-01-13T18:39:40.294 INFO:tasks.workunit.client.0.smithi084.stdout:op 5541 completed, throughput=5MB/sec 2024-01-13T18:39:40.659 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:39:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:39:40] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:39:40.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:40 smithi084 ceph-mon[119097]: pgmap v2036: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:40.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:40 smithi084 ceph-mon[116404]: pgmap v2036: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:41.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:40 smithi099 ceph-mon[138788]: pgmap v2036: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:41.295 INFO:tasks.workunit.client.0.smithi084.stdout: 1096: throughput=5MB/sec pending data=0 2024-01-13T18:39:41.295 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-I51jok-PGpqGAN1 off=242758 len=161615 2024-01-13T18:39:41.297 INFO:tasks.workunit.client.0.smithi084.stdout:op 5542 completed, throughput=5MB/sec 2024-01-13T18:39:41.297 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Qsv4U_T2316yIjU off=1438332 len=1369984 2024-01-13T18:39:41.305 INFO:tasks.workunit.client.0.smithi084.stdout:op 5543 completed, throughput=5MB/sec 2024-01-13T18:39:41.305 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-AeukVgDVZFKy5jJ off=4549485 len=267606 2024-01-13T18:39:41.308 INFO:tasks.workunit.client.0.smithi084.stdout:op 5544 completed, throughput=5MB/sec 2024-01-13T18:39:41.308 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--JTPWEEeaCPGW9U off=1790845 len=78918 2024-01-13T18:39:41.310 INFO:tasks.workunit.client.0.smithi084.stdout:op 5545 completed, throughput=5MB/sec 2024-01-13T18:39:41.310 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QAGZUIsfiSskdIR off=3783052 len=934262 2024-01-13T18:39:41.311 INFO:tasks.workunit.client.0.smithi084.stdout:op 5546 completed, throughput=5MB/sec 2024-01-13T18:39:41.311 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gY6Z9sW3IuZPxu1 off=346302 len=2044906 2024-01-13T18:39:41.320 INFO:tasks.workunit.client.0.smithi084.stdout:op 5547 completed, throughput=5MB/sec 2024-01-13T18:39:41.320 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-J6Xk-s9scCr7r-m off=3500742 len=1501639 2024-01-13T18:39:41.327 INFO:tasks.workunit.client.0.smithi084.stdout:op 5548 completed, throughput=5MB/sec 2024-01-13T18:39:42.328 INFO:tasks.workunit.client.0.smithi084.stdout: 1097: throughput=5MB/sec pending data=0 2024-01-13T18:39:42.328 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JiQeZnNDKmv0qMB off=7573039 len=778078 2024-01-13T18:39:42.332 INFO:tasks.workunit.client.0.smithi084.stdout:op 5549 completed, throughput=5MB/sec 2024-01-13T18:39:42.332 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XHd1OeijaXd564r off=4967258 len=660460 2024-01-13T18:39:42.336 INFO:tasks.workunit.client.0.smithi084.stdout:op 5550 completed, throughput=5MB/sec 2024-01-13T18:39:42.337 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xM6Anf7vBBetpV4 off=8501990 len=620511 2024-01-13T18:39:42.341 INFO:tasks.workunit.client.0.smithi084.stdout:op 5551 completed, throughput=5MB/sec 2024-01-13T18:39:42.341 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x3IdIuQqwT7A7LB off=8733736 len=506343 2024-01-13T18:39:42.345 INFO:tasks.workunit.client.0.smithi084.stdout:op 5552 completed, throughput=5MB/sec 2024-01-13T18:39:42.345 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PrWAMpSI_NuXccT off=7400676 len=635319 2024-01-13T18:39:42.345 INFO:tasks.workunit.client.0.smithi084.stdout:op 5553 completed, throughput=5MB/sec 2024-01-13T18:39:42.346 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-R1VBf0l5VPFycfj off=3921359 len=2096579 2024-01-13T18:39:42.356 INFO:tasks.workunit.client.0.smithi084.stdout:op 5554 completed, throughput=5MB/sec 2024-01-13T18:39:42.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:42 smithi084 ceph-mon[119097]: pgmap v2037: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:39:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:42 smithi084 ceph-mon[116404]: pgmap v2037: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:39:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:42 smithi099 ceph-mon[138788]: pgmap v2037: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:39:43.357 INFO:tasks.workunit.client.0.smithi084.stdout: 1098: throughput=5MB/sec pending data=0 2024-01-13T18:39:43.358 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1x4iTE2GMLVXpEk off=1275218 len=1806325 2024-01-13T18:39:43.359 INFO:tasks.workunit.client.0.smithi084.stdout:op 5555 completed, throughput=5MB/sec 2024-01-13T18:39:43.359 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-j3EHTlWNtIGamxX off=1111553 len=675507 2024-01-13T18:39:43.360 INFO:tasks.workunit.client.0.smithi084.stdout:op 5556 completed, throughput=5MB/sec 2024-01-13T18:39:43.361 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3biyI0dgZH2bkYP off=2058301 len=1596881 2024-01-13T18:39:43.362 INFO:tasks.workunit.client.0.smithi084.stdout:op 5557 completed, throughput=5MB/sec 2024-01-13T18:39:44.364 INFO:tasks.workunit.client.0.smithi084.stdout: 1099: throughput=5MB/sec pending data=0 2024-01-13T18:39:44.364 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-64_WW-2KUSqvTET off=288402 len=294137 2024-01-13T18:39:44.364 INFO:tasks.workunit.client.0.smithi084.stdout:op 5558 completed, throughput=5MB/sec 2024-01-13T18:39:44.364 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-gY6Z9sW3IuZPxu1 off=2271626 len=1500057 2024-01-13T18:39:44.370 INFO:tasks.workunit.client.0.smithi084.stdout:op 5559 completed, throughput=5MB/sec 2024-01-13T18:39:44.370 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-T2nojxIJljc7xOB off=8469729 len=2044355 2024-01-13T18:39:44.380 INFO:tasks.workunit.client.0.smithi084.stdout:op 5560 completed, throughput=5MB/sec 2024-01-13T18:39:44.380 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sfBV11xxlDRkGjT off=5896771 len=938535 2024-01-13T18:39:44.380 INFO:tasks.workunit.client.0.smithi084.stdout:op 5561 completed, throughput=5MB/sec 2024-01-13T18:39:44.380 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FtJA7dtACc5deYH off=4475066 len=1235856 2024-01-13T18:39:44.383 INFO:tasks.workunit.client.0.smithi084.stdout:op 5562 completed, throughput=5MB/sec 2024-01-13T18:39:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:44 smithi084 ceph-mon[119097]: pgmap v2038: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:44.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:44 smithi084 ceph-mon[116404]: pgmap v2038: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:45.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:44 smithi099 ceph-mon[138788]: pgmap v2038: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:45.383 INFO:tasks.workunit.client.0.smithi084.stdout: 1100: throughput=5MB/sec pending data=0 2024-01-13T18:39:45.383 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0bRiY3vmZplrDX7 off=1533354 len=1721612 2024-01-13T18:39:45.387 INFO:tasks.workunit.client.0.smithi084.stdout:op 5563 completed, throughput=5MB/sec 2024-01-13T18:39:45.387 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-c4KJ-UelfQJgtEu off=15429640 len=790700 2024-01-13T18:39:45.392 INFO:tasks.workunit.client.0.smithi084.stdout:op 5564 completed, throughput=5MB/sec 2024-01-13T18:39:45.392 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6jlLUb587BwLJXk off=8512701 len=1985681 2024-01-13T18:39:45.394 INFO:tasks.workunit.client.0.smithi084.stdout:op 5565 completed, throughput=5MB/sec 2024-01-13T18:39:45.394 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-en68UfgqBX7QcSz off=3131250 len=1017279 2024-01-13T18:39:45.400 INFO:tasks.workunit.client.0.smithi084.stdout:op 5566 completed, throughput=5MB/sec 2024-01-13T18:39:46.404 INFO:tasks.workunit.client.0.smithi084.stdout: 1101: throughput=5MB/sec pending data=0 2024-01-13T18:39:46.404 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Md0LmHMl9EZuUl2 off=10774404 len=989322 2024-01-13T18:39:46.404 INFO:tasks.workunit.client.0.smithi084.stdout:op 5567 completed, throughput=5MB/sec 2024-01-13T18:39:46.404 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2-YpDapisKRzyk1 off=7251887 len=528917 2024-01-13T18:39:46.406 INFO:tasks.workunit.client.0.smithi084.stdout:op 5568 completed, throughput=5MB/sec 2024-01-13T18:39:46.406 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qcvvx-LqeKZEMw6 off=15551503 len=122905 2024-01-13T18:39:46.409 INFO:tasks.workunit.client.0.smithi084.stdout:op 5569 completed, throughput=5MB/sec 2024-01-13T18:39:46.409 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-x-I12TdCywx1swV off=3468870 len=691322 2024-01-13T18:39:46.413 INFO:tasks.workunit.client.0.smithi084.stdout:op 5570 completed, throughput=5MB/sec 2024-01-13T18:39:46.413 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-P6hFcA9x_RU1nR- off=8656026 len=1751596 2024-01-13T18:39:46.422 INFO:tasks.workunit.client.0.smithi084.stdout:op 5571 completed, throughput=5MB/sec 2024-01-13T18:39:46.422 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k_bw0YFA6Ui7m75 off=13144024 len=1708600 2024-01-13T18:39:46.431 INFO:tasks.workunit.client.0.smithi084.stdout:op 5572 completed, throughput=5MB/sec 2024-01-13T18:39:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:46 smithi084 ceph-mon[116404]: pgmap v2039: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:46.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:46 smithi084 ceph-mon[119097]: pgmap v2039: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:47.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:46 smithi099 ceph-mon[138788]: pgmap v2039: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:47.431 INFO:tasks.workunit.client.0.smithi084.stdout: 1102: throughput=5MB/sec pending data=0 2024-01-13T18:39:47.431 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-PMsOSAFOQKdKVoq off=5103020 len=34565 2024-01-13T18:39:47.431 INFO:tasks.workunit.client.0.smithi084.stdout:op 5573 completed, throughput=5MB/sec 2024-01-13T18:39:47.432 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tfVcF2PXB8uglJb off=0 len=1140395 2024-01-13T18:39:47.433 INFO:tasks.workunit.client.0.smithi084.stdout:op 5574 completed, throughput=5MB/sec 2024-01-13T18:39:47.433 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pgd3iGGgk8MaNc4 off=2018805 len=522984 2024-01-13T18:39:47.434 INFO:tasks.workunit.client.0.smithi084.stdout:op 5575 completed, throughput=5MB/sec 2024-01-13T18:39:47.434 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XP1Z-ldgBmUjeuS off=6088495 len=828361 2024-01-13T18:39:47.436 INFO:tasks.workunit.client.0.smithi084.stdout:op 5576 completed, throughput=5MB/sec 2024-01-13T18:39:47.436 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-BojaNEOLIoXGhJh off=4296524 len=1970073 2024-01-13T18:39:47.444 INFO:tasks.workunit.client.0.smithi084.stdout:op 5577 completed, throughput=5MB/sec 2024-01-13T18:39:48.444 INFO:tasks.workunit.client.0.smithi084.stdout: 1103: throughput=5MB/sec pending data=0 2024-01-13T18:39:48.445 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8l5n6V-XOWeIzes off=21278993 len=1498477 2024-01-13T18:39:48.448 INFO:tasks.workunit.client.0.smithi084.stdout:op 5578 completed, throughput=5MB/sec 2024-01-13T18:39:48.448 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-m5rm5J7W2Gcd-2S off=4454838 len=521449 2024-01-13T18:39:48.452 INFO:tasks.workunit.client.0.smithi084.stdout:op 5579 completed, throughput=5MB/sec 2024-01-13T18:39:48.452 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-o_GSs-d3pQp_IOo off=690782 len=1930263 2024-01-13T18:39:48.462 INFO:tasks.workunit.client.0.smithi084.stdout:op 5580 completed, throughput=5MB/sec 2024-01-13T18:39:48.462 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h50pyhIL879-0Tq off=14042314 len=115038 2024-01-13T18:39:48.464 INFO:tasks.workunit.client.0.smithi084.stdout:op 5581 completed, throughput=5MB/sec 2024-01-13T18:39:48.464 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xG83VH0RT5OstQi off=13587420 len=57618 2024-01-13T18:39:48.466 INFO:tasks.workunit.client.0.smithi084.stdout:op 5582 completed, throughput=5MB/sec 2024-01-13T18:39:48.466 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QLc7XMjTRnI87Jj off=15152417 len=842986 2024-01-13T18:39:48.471 INFO:tasks.workunit.client.0.smithi084.stdout:op 5583 completed, throughput=5MB/sec 2024-01-13T18:39:49.471 INFO:tasks.workunit.client.0.smithi084.stdout: 1104: throughput=5MB/sec pending data=0 2024-01-13T18:39:49.472 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8l5n6V-XOWeIzes off=20951060 len=989753 2024-01-13T18:39:49.474 INFO:tasks.workunit.client.0.smithi084.stdout:op 5584 completed, throughput=5MB/sec 2024-01-13T18:39:49.474 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-E_0KA2ApopGvlY9 off=1604908 len=268692 2024-01-13T18:39:49.474 INFO:tasks.workunit.client.0.smithi084.stdout:op 5585 completed, throughput=5MB/sec 2024-01-13T18:39:49.475 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uMMt5M2Z_pp3Mvd off=5497615 len=269112 2024-01-13T18:39:49.475 INFO:tasks.workunit.client.0.smithi084.stdout:op 5586 completed, throughput=5MB/sec 2024-01-13T18:39:49.475 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-TuxoPz9tLkyF0Fb off=4028517 len=595490 2024-01-13T18:39:49.480 INFO:tasks.workunit.client.0.smithi084.stdout:op 5587 completed, throughput=5MB/sec 2024-01-13T18:39:49.480 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9HsKnTJR3I9a2L_ off=12668453 len=1577718 2024-01-13T18:39:49.488 INFO:tasks.workunit.client.0.smithi084.stdout:op 5588 completed, throughput=5MB/sec 2024-01-13T18:39:49.489 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-h_v81XrXackoPrh off=2453879 len=889588 2024-01-13T18:39:49.490 INFO:tasks.workunit.client.0.smithi084.stdout:op 5589 completed, throughput=5MB/sec 2024-01-13T18:39:49.490 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qkh7XXpf-2z2QGn off=13456086 len=1109770 2024-01-13T18:39:49.495 INFO:tasks.workunit.client.0.smithi084.stdout:op 5590 completed, throughput=5MB/sec 2024-01-13T18:39:49.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:49 smithi084 ceph-mon[116404]: pgmap v2040: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:39:49.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:49 smithi084 ceph-mon[119097]: pgmap v2040: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:39:49.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:49 smithi099 ceph-mon[138788]: pgmap v2040: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 5 op/s 2024-01-13T18:39:50.496 INFO:tasks.workunit.client.0.smithi084.stdout: 1105: throughput=5MB/sec pending data=0 2024-01-13T18:39:50.496 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8FcVI2ryZWnoK26 off=11756035 len=478270 2024-01-13T18:39:50.499 INFO:tasks.workunit.client.0.smithi084.stdout:op 5591 completed, throughput=5MB/sec 2024-01-13T18:39:50.499 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8LQRn3LnhuxH8gS off=5139296 len=834213 2024-01-13T18:39:50.500 INFO:tasks.workunit.client.0.smithi084.stdout:op 5592 completed, throughput=5MB/sec 2024-01-13T18:39:50.500 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-bv29mJbPXbM9mAL off=4107059 len=1366379 2024-01-13T18:39:50.502 INFO:tasks.workunit.client.0.smithi084.stdout:op 5593 completed, throughput=5MB/sec 2024-01-13T18:39:50.502 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HlqQENFi_c8nLu8 off=6437112 len=1640089 2024-01-13T18:39:50.503 INFO:tasks.workunit.client.0.smithi084.stdout:op 5594 completed, throughput=5MB/sec 2024-01-13T18:39:50.504 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5wg-Znm72cHxStb off=3688638 len=1270799 2024-01-13T18:39:50.511 INFO:tasks.workunit.client.0.smithi084.stdout:op 5595 completed, throughput=5MB/sec 2024-01-13T18:39:50.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:39:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:39:50] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:39:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:39:51.512 INFO:tasks.workunit.client.0.smithi084.stdout: 1106: throughput=5MB/sec pending data=0 2024-01-13T18:39:51.512 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-utOnJ_l_wIal4ML off=3811000 len=1853379 2024-01-13T18:39:51.514 INFO:tasks.workunit.client.0.smithi084.stdout:op 5596 completed, throughput=5MB/sec 2024-01-13T18:39:51.514 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-HwaedWlFBB3ayRE off=125116 len=858752 2024-01-13T18:39:51.520 INFO:tasks.workunit.client.0.smithi084.stdout:op 5597 completed, throughput=5MB/sec 2024-01-13T18:39:51.520 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-M5BtyiaCCXZEmf_ off=11379383 len=1659890 2024-01-13T18:39:51.530 INFO:tasks.workunit.client.0.smithi084.stdout:op 5598 completed, throughput=5MB/sec 2024-01-13T18:39:51.530 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hhv8133QoZfeqnd off=5559054 len=1948135 2024-01-13T18:39:51.532 INFO:tasks.workunit.client.0.smithi084.stdout:op 5599 completed, throughput=5MB/sec 2024-01-13T18:39:51.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:51 smithi084 ceph-mon[116404]: pgmap v2041: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:51.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:51 smithi084 ceph-mon[119097]: pgmap v2041: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:51 smithi099 ceph-mon[138788]: pgmap v2041: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 5 op/s 2024-01-13T18:39:52.533 INFO:tasks.workunit.client.0.smithi084.stdout: 1107: throughput=5MB/sec pending data=0 2024-01-13T18:39:52.533 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3GxJuVrjg0JKPzy off=17288063 len=1698260 2024-01-13T18:39:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:op 5600 completed, throughput=5MB/sec 2024-01-13T18:39:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-it-ofEZ1Yi6rEDd off=5096301 len=1369517 2024-01-13T18:39:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:op 5601 completed, throughput=5MB/sec 2024-01-13T18:39:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2bz0SZMkYyI0Ekj off=6590071 len=1537967 2024-01-13T18:39:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:op 5602 completed, throughput=5MB/sec 2024-01-13T18:39:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:52 smithi084 ceph-mon[116404]: pgmap v2042: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:39:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:52 smithi084 ceph-mon[119097]: pgmap v2042: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:39:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:52 smithi099 ceph-mon[138788]: pgmap v2042: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 4 op/s 2024-01-13T18:39:53.551 INFO:tasks.workunit.client.0.smithi084.stdout: 1108: throughput=5MB/sec pending data=0 2024-01-13T18:39:53.551 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BHEFeoyqIpZZcol off=5924834 len=1543118 2024-01-13T18:39:53.552 INFO:tasks.workunit.client.0.smithi084.stdout:op 5603 completed, throughput=5MB/sec 2024-01-13T18:39:53.552 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EBCKqUcBZbP4rH1 off=17201226 len=1246287 2024-01-13T18:39:53.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 5604 completed, throughput=5MB/sec 2024-01-13T18:39:53.560 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tw5mm7BQvu1LIuK off=2348305 len=1277364 2024-01-13T18:39:53.565 INFO:tasks.workunit.client.0.smithi084.stdout:op 5605 completed, throughput=5MB/sec 2024-01-13T18:39:53.566 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-28cYRwprKF0u_UT off=5648379 len=1285207 2024-01-13T18:39:53.568 INFO:tasks.workunit.client.0.smithi084.stdout:op 5606 completed, throughput=5MB/sec 2024-01-13T18:39:54.568 INFO:tasks.workunit.client.0.smithi084.stdout: 1109: throughput=5MB/sec pending data=0 2024-01-13T18:39:54.569 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-W06dsGaiCF_L4yB off=9812091 len=1961726 2024-01-13T18:39:54.580 INFO:tasks.workunit.client.0.smithi084.stdout:op 5607 completed, throughput=5MB/sec 2024-01-13T18:39:54.580 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2-YpDapisKRzyk1 off=8535516 len=607916 2024-01-13T18:39:54.580 INFO:tasks.workunit.client.0.smithi084.stdout:op 5608 completed, throughput=5MB/sec 2024-01-13T18:39:54.580 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dTpz4a9JnwWXsPO off=5599001 len=2095251 2024-01-13T18:39:54.582 INFO:tasks.workunit.client.0.smithi084.stdout:op 5609 completed, throughput=5MB/sec 2024-01-13T18:39:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:54 smithi084 ceph-mon[116404]: pgmap v2043: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:39:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:54 smithi084 ceph-mon[119097]: pgmap v2043: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:39:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:54 smithi099 ceph-mon[138788]: pgmap v2043: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 5 op/s 2024-01-13T18:39:55.583 INFO:tasks.workunit.client.0.smithi084.stdout: 1110: throughput=5MB/sec pending data=0 2024-01-13T18:39:55.583 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k96Qr6Azal5bMcD off=5109309 len=91407 2024-01-13T18:39:55.583 INFO:tasks.workunit.client.0.smithi084.stdout:op 5610 completed, throughput=5MB/sec 2024-01-13T18:39:55.583 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uw8dNEm9KcTv30P off=8915472 len=705205 2024-01-13T18:39:55.584 INFO:tasks.workunit.client.0.smithi084.stdout:op 5611 completed, throughput=5MB/sec 2024-01-13T18:39:55.584 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-yHbW9A5Lu0oXwf7 off=2556435 len=600746 2024-01-13T18:39:55.588 INFO:tasks.workunit.client.0.smithi084.stdout:op 5612 completed, throughput=5MB/sec 2024-01-13T18:39:55.589 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-e1G9mEwaHVxIULo off=5208694 len=1973551 2024-01-13T18:39:55.591 INFO:tasks.workunit.client.0.smithi084.stdout:op 5613 completed, throughput=5MB/sec 2024-01-13T18:39:55.591 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M5BtyiaCCXZEmf_ off=20679231 len=93097 2024-01-13T18:39:55.592 INFO:tasks.workunit.client.0.smithi084.stdout:op 5614 completed, throughput=5MB/sec 2024-01-13T18:39:55.592 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EnGhPOVgJ3FWdUT off=3595955 len=2031008 2024-01-13T18:39:55.593 INFO:tasks.workunit.client.0.smithi084.stdout:op 5615 completed, throughput=5MB/sec 2024-01-13T18:39:56.594 INFO:tasks.workunit.client.0.smithi084.stdout: 1111: throughput=5MB/sec pending data=0 2024-01-13T18:39:56.594 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-fXJU9deptuQbSsX off=2658753 len=366776 2024-01-13T18:39:56.597 INFO:tasks.workunit.client.0.smithi084.stdout:op 5616 completed, throughput=5MB/sec 2024-01-13T18:39:56.598 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pfo6xjca5LWAqW3 off=223603 len=1470306 2024-01-13T18:39:56.599 INFO:tasks.workunit.client.0.smithi084.stdout:op 5617 completed, throughput=5MB/sec 2024-01-13T18:39:56.599 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9Jw7Lknk9Yhbkxx off=7532475 len=1705312 2024-01-13T18:39:56.602 INFO:tasks.workunit.client.0.smithi084.stdout:op 5618 completed, throughput=5MB/sec 2024-01-13T18:39:56.603 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-w7CtENYXuK-ihzN off=3327817 len=1100364 2024-01-13T18:39:56.611 INFO:tasks.workunit.client.0.smithi084.stdout:op 5619 completed, throughput=5MB/sec 2024-01-13T18:39:56.611 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZqVFkpq85BmCpi1 off=732343 len=1054674 2024-01-13T18:39:56.615 INFO:tasks.workunit.client.0.smithi084.stdout:op 5620 completed, throughput=5MB/sec 2024-01-13T18:39:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:56 smithi084 ceph-mon[116404]: pgmap v2044: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:39:56.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:56 smithi084 ceph-mon[119097]: pgmap v2044: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:39:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:56 smithi099 ceph-mon[138788]: pgmap v2044: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:39:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: 1112: throughput=5MB/sec pending data=0 2024-01-13T18:39:57.616 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-5iPWY17FJJ2f7mQ off=4524164 len=651144 2024-01-13T18:39:57.620 INFO:tasks.workunit.client.0.smithi084.stdout:op 5621 completed, throughput=5MB/sec 2024-01-13T18:39:57.621 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-At1-QJ888AQBdK7 off=6279423 len=1782703 2024-01-13T18:39:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:op 5622 completed, throughput=5MB/sec 2024-01-13T18:39:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dbZuJkcLPj-lx5K off=7361636 len=540506 2024-01-13T18:39:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:op 5623 completed, throughput=5MB/sec 2024-01-13T18:39:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MHP2GEuIcqDdyFm off=10951370 len=2008772 2024-01-13T18:39:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:op 5624 completed, throughput=5MB/sec 2024-01-13T18:39:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: 1113: throughput=5MB/sec pending data=0 2024-01-13T18:39:58.635 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qpucIXLg55Wb8WS off=17733625 len=75387 2024-01-13T18:39:58.636 INFO:tasks.workunit.client.0.smithi084.stdout:op 5625 completed, throughput=5MB/sec 2024-01-13T18:39:58.636 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xB_Oe9iXAVNzLr8 off=5115929 len=314906 2024-01-13T18:39:58.639 INFO:tasks.workunit.client.0.smithi084.stdout:op 5626 completed, throughput=5MB/sec 2024-01-13T18:39:58.639 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Bs7Skj3apuVeXwk off=15595862 len=815434 2024-01-13T18:39:58.644 INFO:tasks.workunit.client.0.smithi084.stdout:op 5627 completed, throughput=5MB/sec 2024-01-13T18:39:58.644 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-M-v1t4bGYmd7VX2 off=298999 len=706898 2024-01-13T18:39:58.651 INFO:tasks.workunit.client.0.smithi084.stdout:op 5628 completed, throughput=5MB/sec 2024-01-13T18:39:58.651 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NJkEIURYlYzLlvy off=3559114 len=1587267 2024-01-13T18:39:58.653 INFO:tasks.workunit.client.0.smithi084.stdout:op 5629 completed, throughput=5MB/sec 2024-01-13T18:39:58.653 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5Q94SdgrSiC-Sq4 off=12053219 len=395059 2024-01-13T18:39:58.654 INFO:tasks.workunit.client.0.smithi084.stdout:op 5630 completed, throughput=5MB/sec 2024-01-13T18:39:58.654 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1h-NTkx2IpyfLdJ off=9578953 len=824514 2024-01-13T18:39:58.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 5631 completed, throughput=5MB/sec 2024-01-13T18:39:58.659 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0UpbGdZJ1PE-oFZ off=1093726 len=1984403 2024-01-13T18:39:58.662 INFO:tasks.workunit.client.0.smithi084.stdout:op 5632 completed, throughput=5MB/sec 2024-01-13T18:39:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: 1114: throughput=5MB/sec pending data=0 2024-01-13T18:39:59.663 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-E20kRflJSI_-w5v off=1743973 len=1582730 2024-01-13T18:39:59.671 INFO:tasks.workunit.client.0.smithi084.stdout:op 5633 completed, throughput=5MB/sec 2024-01-13T18:39:59.672 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2iubaf0ex_mc_iB off=421207 len=783650 2024-01-13T18:39:59.673 INFO:tasks.workunit.client.0.smithi084.stdout:op 5634 completed, throughput=5MB/sec 2024-01-13T18:39:59.673 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bHdAtVIawc5GVDW off=2934065 len=1370483 2024-01-13T18:39:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:39:59 smithi084 ceph-mon[116404]: pgmap v2045: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:39:59.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:39:59 smithi084 ceph-mon[119097]: pgmap v2045: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:39:59.681 INFO:tasks.workunit.client.0.smithi084.stdout:op 5635 completed, throughput=5MB/sec 2024-01-13T18:39:59.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:39:59 smithi099 ceph-mon[138788]: pgmap v2045: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:40:00.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:00 smithi084 ceph-mon[119097]: overall HEALTH_OK 2024-01-13T18:40:00.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:00 smithi084 ceph-mon[116404]: overall HEALTH_OK 2024-01-13T18:40:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:40:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:40:00] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:40:00.681 INFO:tasks.workunit.client.0.smithi084.stdout: 1115: throughput=5MB/sec pending data=0 2024-01-13T18:40:00.681 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kr1-86gBD6eBtzI off=1439252 len=532214 2024-01-13T18:40:00.685 INFO:tasks.workunit.client.0.smithi084.stdout:op 5636 completed, throughput=5MB/sec 2024-01-13T18:40:00.685 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-opgxnxuh2fqaAGh off=505790 len=828191 2024-01-13T18:40:00.692 INFO:tasks.workunit.client.0.smithi084.stdout:op 5637 completed, throughput=5MB/sec 2024-01-13T18:40:00.692 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hekJjRgc2K-_B5P off=341740 len=1299610 2024-01-13T18:40:00.698 INFO:tasks.workunit.client.0.smithi084.stdout:op 5638 completed, throughput=5MB/sec 2024-01-13T18:40:00.698 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LJ9d08xi1i6rAs7 off=3149564 len=461847 2024-01-13T18:40:00.698 INFO:tasks.workunit.client.0.smithi084.stdout:op 5639 completed, throughput=5MB/sec 2024-01-13T18:40:00.698 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IFzvX5OCNqlpvkI off=7943822 len=1780157 2024-01-13T18:40:00.707 INFO:tasks.workunit.client.0.smithi084.stdout:op 5640 completed, throughput=5MB/sec 2024-01-13T18:40:00.708 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-w1nVeUf45w_xJuu off=327619 len=952341 2024-01-13T18:40:00.712 INFO:tasks.workunit.client.0.smithi084.stdout:op 5641 completed, throughput=5MB/sec 2024-01-13T18:40:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:00 smithi099 ceph-mon[138788]: overall HEALTH_OK 2024-01-13T18:40:01.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:01 smithi084 ceph-mon[116404]: pgmap v2046: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:40:01.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:01 smithi084 ceph-mon[119097]: pgmap v2046: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:40:01.712 INFO:tasks.workunit.client.0.smithi084.stdout: 1116: throughput=5MB/sec pending data=0 2024-01-13T18:40:01.712 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M1U3fVGe66VaX4F off=16791646 len=1207971 2024-01-13T18:40:01.715 INFO:tasks.workunit.client.0.smithi084.stdout:op 5642 completed, throughput=5MB/sec 2024-01-13T18:40:01.715 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9vB1c3U1rlTPiVg off=6924668 len=2057571 2024-01-13T18:40:01.729 INFO:tasks.workunit.client.0.smithi084.stdout:op 5643 completed, throughput=5MB/sec 2024-01-13T18:40:01.730 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_Aot_7sBoOav7rs off=14671613 len=837893 2024-01-13T18:40:01.734 INFO:tasks.workunit.client.0.smithi084.stdout:op 5644 completed, throughput=5MB/sec 2024-01-13T18:40:01.734 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-sKO1jXEGsZU5Pyd off=1073519 len=306494 2024-01-13T18:40:01.737 INFO:tasks.workunit.client.0.smithi084.stdout:op 5645 completed, throughput=5MB/sec 2024-01-13T18:40:01.737 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NEbpTffZ4qCT3gr off=3592284 len=1813875 2024-01-13T18:40:01.738 INFO:tasks.workunit.client.0.smithi084.stdout:op 5646 completed, throughput=5MB/sec 2024-01-13T18:40:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:01 smithi099 ceph-mon[138788]: pgmap v2046: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 5 op/s 2024-01-13T18:40:02.739 INFO:tasks.workunit.client.0.smithi084.stdout: 1117: throughput=5MB/sec pending data=0 2024-01-13T18:40:02.739 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QYeCMm4QWwSbVzi off=5521917 len=856418 2024-01-13T18:40:02.744 INFO:tasks.workunit.client.0.smithi084.stdout:op 5647 completed, throughput=5MB/sec 2024-01-13T18:40:02.744 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Wn7PRJrgQWyAUoY off=16179558 len=1399379 2024-01-13T18:40:02.745 INFO:tasks.workunit.client.0.smithi084.stdout:op 5648 completed, throughput=5MB/sec 2024-01-13T18:40:02.746 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3-8OfGKsriXUcbw off=19655000 len=2069450 2024-01-13T18:40:02.747 INFO:tasks.workunit.client.0.smithi084.stdout:op 5649 completed, throughput=5MB/sec 2024-01-13T18:40:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:02 smithi084 ceph-mon[116404]: pgmap v2047: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:40:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:02 smithi084 ceph-mon[119097]: pgmap v2047: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:40:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:02 smithi099 ceph-mon[138788]: pgmap v2047: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:40:03.748 INFO:tasks.workunit.client.0.smithi084.stdout: 1118: throughput=5MB/sec pending data=0 2024-01-13T18:40:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ggv-clZoAw7H_c- off=2271560 len=144926 2024-01-13T18:40:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:op 5650 completed, throughput=5MB/sec 2024-01-13T18:40:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aQBNo5a131uq--L off=12472591 len=1398233 2024-01-13T18:40:03.750 INFO:tasks.workunit.client.0.smithi084.stdout:op 5651 completed, throughput=5MB/sec 2024-01-13T18:40:03.750 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BTRsZRqh0wH8-XR off=5448624 len=740367 2024-01-13T18:40:03.751 INFO:tasks.workunit.client.0.smithi084.stdout:op 5652 completed, throughput=5MB/sec 2024-01-13T18:40:03.751 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SZFE8DTqa4X2W2X off=9133265 len=948392 2024-01-13T18:40:03.756 INFO:tasks.workunit.client.0.smithi084.stdout:op 5653 completed, throughput=5MB/sec 2024-01-13T18:40:03.756 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NoyjGFKAx1XJ52j off=3142476 len=1353617 2024-01-13T18:40:03.762 INFO:tasks.workunit.client.0.smithi084.stdout:op 5654 completed, throughput=5MB/sec 2024-01-13T18:40:03.762 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Zfe-86zgLjEfRbV off=7424589 len=1101866 2024-01-13T18:40:03.768 INFO:tasks.workunit.client.0.smithi084.stdout:op 5655 completed, throughput=5MB/sec 2024-01-13T18:40:04.768 INFO:tasks.workunit.client.0.smithi084.stdout: 1119: throughput=5MB/sec pending data=0 2024-01-13T18:40:04.768 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FF9pL38ZKlqrvax off=9341525 len=1595550 2024-01-13T18:40:04.771 INFO:tasks.workunit.client.0.smithi084.stdout:op 5656 completed, throughput=5MB/sec 2024-01-13T18:40:04.771 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-NnekbiZP9G7vBQF off=544053 len=1173140 2024-01-13T18:40:04.777 INFO:tasks.workunit.client.0.smithi084.stdout:op 5657 completed, throughput=5MB/sec 2024-01-13T18:40:04.777 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KDSHuyZIPDcUw_1 off=1796956 len=1510117 2024-01-13T18:40:04.785 INFO:tasks.workunit.client.0.smithi084.stdout:op 5658 completed, throughput=5MB/sec 2024-01-13T18:40:04.785 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Eyzu1AxcvzpiPFZ off=287583 len=852015 2024-01-13T18:40:04.789 INFO:tasks.workunit.client.0.smithi084.stdout:op 5659 completed, throughput=5MB/sec 2024-01-13T18:40:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:04 smithi084 ceph-mon[116404]: pgmap v2048: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:40:04.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:04 smithi084 ceph-mon[119097]: pgmap v2048: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:40:05.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:04 smithi099 ceph-mon[138788]: pgmap v2048: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:40:05.790 INFO:tasks.workunit.client.0.smithi084.stdout: 1120: throughput=5MB/sec pending data=0 2024-01-13T18:40:05.790 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aayZLXh94158dMX off=1325353 len=560185 2024-01-13T18:40:05.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 5660 completed, throughput=5MB/sec 2024-01-13T18:40:05.795 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OPuMzWW2yESiYiw off=5055544 len=329118 2024-01-13T18:40:05.798 INFO:tasks.workunit.client.0.smithi084.stdout:op 5661 completed, throughput=5MB/sec 2024-01-13T18:40:05.798 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eYmm1Ywl5bkRlxt off=1270778 len=584380 2024-01-13T18:40:05.800 INFO:tasks.workunit.client.0.smithi084.stdout:op 5662 completed, throughput=5MB/sec 2024-01-13T18:40:05.800 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WObGJTjWNv2SyBP off=800323 len=1827789 2024-01-13T18:40:05.801 INFO:tasks.workunit.client.0.smithi084.stdout:op 5663 completed, throughput=5MB/sec 2024-01-13T18:40:05.802 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ualBRQAhQai-bii off=1171150 len=1151987 2024-01-13T18:40:05.803 INFO:tasks.workunit.client.0.smithi084.stdout:op 5664 completed, throughput=5MB/sec 2024-01-13T18:40:05.803 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QaD1zr6fT5dIUFR off=16349804 len=1644688 2024-01-13T18:40:05.805 INFO:tasks.workunit.client.0.smithi084.stdout:op 5665 completed, throughput=5MB/sec 2024-01-13T18:40:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:06.805 INFO:tasks.workunit.client.0.smithi084.stdout: 1121: throughput=5MB/sec pending data=0 2024-01-13T18:40:06.805 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj--RbKZhZsdCE2mpj off=600049 len=558547 2024-01-13T18:40:06.809 INFO:tasks.workunit.client.0.smithi084.stdout:op 5666 completed, throughput=5MB/sec 2024-01-13T18:40:06.809 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wvdgQIsaid4bOzj off=19745954 len=1208606 2024-01-13T18:40:06.811 INFO:tasks.workunit.client.0.smithi084.stdout:op 5667 completed, throughput=5MB/sec 2024-01-13T18:40:06.811 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JUzAr9vtJuFee1l off=4589617 len=1238623 2024-01-13T18:40:06.812 INFO:tasks.workunit.client.0.smithi084.stdout:op 5668 completed, throughput=5MB/sec 2024-01-13T18:40:06.812 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_Nx1hkAxyibyOjH off=555499 len=1933107 2024-01-13T18:40:06.823 INFO:tasks.workunit.client.0.smithi084.stdout:op 5669 completed, throughput=5MB/sec 2024-01-13T18:40:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:06 smithi084 ceph-mon[116404]: pgmap v2049: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:40:06.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:06 smithi084 ceph-mon[119097]: pgmap v2049: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:40:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:06 smithi099 ceph-mon[138788]: pgmap v2049: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 3 op/s 2024-01-13T18:40:07.823 INFO:tasks.workunit.client.0.smithi084.stdout: 1122: throughput=5MB/sec pending data=0 2024-01-13T18:40:07.920 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RtPtGCXbNY2W4Me off=5110309 len=735525 2024-01-13T18:40:07.921 INFO:tasks.workunit.client.0.smithi084.stdout:op 5670 completed, throughput=5MB/sec 2024-01-13T18:40:07.921 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WKDATNdYEiALMXo off=8610052 len=61355 2024-01-13T18:40:07.921 INFO:tasks.workunit.client.0.smithi084.stdout:op 5671 completed, throughput=5MB/sec 2024-01-13T18:40:07.921 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UWR2lw6aLJ3Txwn off=3574925 len=955117 2024-01-13T18:40:07.921 INFO:tasks.workunit.client.0.smithi084.stdout:op 5672 completed, throughput=5MB/sec 2024-01-13T18:40:07.921 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kHIoArdY8qJ3aop off=4592608 len=1837911 2024-01-13T18:40:07.921 INFO:tasks.workunit.client.0.smithi084.stdout:op 5673 completed, throughput=5MB/sec 2024-01-13T18:40:07.921 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MY1Ba4ds6ztVHjo off=11397606 len=706518 2024-01-13T18:40:07.921 INFO:tasks.workunit.client.0.smithi084.stdout:op 5674 completed, throughput=5MB/sec 2024-01-13T18:40:07.921 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-S_Yx6oYuv1Zms1i off=9716540 len=876272 2024-01-13T18:40:07.922 INFO:tasks.workunit.client.0.smithi084.stdout:op 5675 completed, throughput=5MB/sec 2024-01-13T18:40:08.834 INFO:tasks.workunit.client.0.smithi084.stdout: 1123: throughput=5MB/sec pending data=0 2024-01-13T18:40:08.834 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PaAMMxIBCB6sH5- off=7710615 len=1797013 2024-01-13T18:40:08.842 INFO:tasks.workunit.client.0.smithi084.stdout:op 5676 completed, throughput=5MB/sec 2024-01-13T18:40:08.842 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uvYSTio7mXHzaoA off=78303 len=2041529 2024-01-13T18:40:08.844 INFO:tasks.workunit.client.0.smithi084.stdout:op 5677 completed, throughput=5MB/sec 2024-01-13T18:40:08.844 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-N8PeJ6YkmKg9nLh off=8107676 len=795325 2024-01-13T18:40:08.844 INFO:tasks.workunit.client.0.smithi084.stdout:op 5678 completed, throughput=5MB/sec 2024-01-13T18:40:09.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:09 smithi084 ceph-mon[116404]: pgmap v2050: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:40:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:09 smithi084 ceph-mon[119097]: pgmap v2050: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:40:09.845 INFO:tasks.workunit.client.0.smithi084.stdout: 1124: throughput=5MB/sec pending data=0 2024-01-13T18:40:09.845 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9uMxSWotBbtMezz off=8219808 len=650197 2024-01-13T18:40:09.849 INFO:tasks.workunit.client.0.smithi084.stdout:op 5679 completed, throughput=5MB/sec 2024-01-13T18:40:09.849 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WmLSDFe5P1WpEGD off=2282835 len=1354761 2024-01-13T18:40:09.851 INFO:tasks.workunit.client.0.smithi084.stdout:op 5680 completed, throughput=5MB/sec 2024-01-13T18:40:09.851 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2BrK0EbZcIC8fGj off=10756915 len=1511042 2024-01-13T18:40:09.853 INFO:tasks.workunit.client.0.smithi084.stdout:op 5681 completed, throughput=5MB/sec 2024-01-13T18:40:09.853 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y0rqfu8vRRXCLat off=2003837 len=1767995 2024-01-13T18:40:09.855 INFO:tasks.workunit.client.0.smithi084.stdout:op 5682 completed, throughput=5MB/sec 2024-01-13T18:40:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:09 smithi099 ceph-mon[138788]: pgmap v2050: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:40:10.664 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:40:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:40:10] "GET /metrics HTTP/1.1" 200 33997 "" "Prometheus/2.43.0" 2024-01-13T18:40:10.856 INFO:tasks.workunit.client.0.smithi084.stdout: 1125: throughput=5MB/sec pending data=0 2024-01-13T18:40:10.856 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-IOdv4mAD8BSW3ws off=932637 len=2023687 2024-01-13T18:40:10.858 INFO:tasks.workunit.client.0.smithi084.stdout:op 5683 completed, throughput=5MB/sec 2024-01-13T18:40:10.859 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ClhtaL9-fPgnQ45 off=2745343 len=955594 2024-01-13T18:40:10.863 INFO:tasks.workunit.client.0.smithi084.stdout:op 5684 completed, throughput=5MB/sec 2024-01-13T18:40:10.864 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LXjkhUOnGEOJcUi off=1147214 len=1055658 2024-01-13T18:40:10.869 INFO:tasks.workunit.client.0.smithi084.stdout:op 5685 completed, throughput=5MB/sec 2024-01-13T18:40:10.870 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-vcg3844sZt4m93I off=6261193 len=1941633 2024-01-13T18:40:10.872 INFO:tasks.workunit.client.0.smithi084.stdout:op 5686 completed, throughput=5MB/sec 2024-01-13T18:40:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:10 smithi084 ceph-mon[116404]: pgmap v2051: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:10 smithi084 ceph-mon[119097]: pgmap v2051: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:10 smithi099 ceph-mon[138788]: pgmap v2051: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:11.872 INFO:tasks.workunit.client.0.smithi084.stdout: 1126: throughput=5MB/sec pending data=0 2024-01-13T18:40:11.872 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-turQB0mTA_Xg7Me off=2072446 len=1181077 2024-01-13T18:40:11.873 INFO:tasks.workunit.client.0.smithi084.stdout:op 5687 completed, throughput=5MB/sec 2024-01-13T18:40:11.874 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZQOgIFW2w-cAnum off=4266898 len=1080504 2024-01-13T18:40:11.875 INFO:tasks.workunit.client.0.smithi084.stdout:op 5688 completed, throughput=5MB/sec 2024-01-13T18:40:11.875 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4Sn_zN0PgBlwKM9 off=2020598 len=1127336 2024-01-13T18:40:11.880 INFO:tasks.workunit.client.0.smithi084.stdout:op 5689 completed, throughput=5MB/sec 2024-01-13T18:40:11.880 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-j1Batzq6W0NHWMI off=934663 len=1072149 2024-01-13T18:40:11.886 INFO:tasks.workunit.client.0.smithi084.stdout:op 5690 completed, throughput=5MB/sec 2024-01-13T18:40:11.886 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-292LSnzERiKxbZp off=5049297 len=465934 2024-01-13T18:40:11.887 INFO:tasks.workunit.client.0.smithi084.stdout:op 5691 completed, throughput=5MB/sec 2024-01-13T18:40:12.888 INFO:tasks.workunit.client.0.smithi084.stdout: 1127: throughput=5MB/sec pending data=0 2024-01-13T18:40:12.888 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-i8n61ImOAz46O-m off=10744 len=1006239 2024-01-13T18:40:12.894 INFO:tasks.workunit.client.0.smithi084.stdout:op 5692 completed, throughput=5MB/sec 2024-01-13T18:40:12.894 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-KVQkG_lf0hZqLid off=6446418 len=1830689 2024-01-13T18:40:12.896 INFO:tasks.workunit.client.0.smithi084.stdout:op 5693 completed, throughput=5MB/sec 2024-01-13T18:40:12.896 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-X53i86faaiuhcBd off=1587472 len=71916 2024-01-13T18:40:12.897 INFO:tasks.workunit.client.0.smithi084.stdout:op 5694 completed, throughput=5MB/sec 2024-01-13T18:40:12.897 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-VxUiy38Rg6VBc7n off=9027295 len=1041725 2024-01-13T18:40:12.902 INFO:tasks.workunit.client.0.smithi084.stdout:op 5695 completed, throughput=5MB/sec 2024-01-13T18:40:12.902 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bcP-T6R03PTMyYY off=3459204 len=811135 2024-01-13T18:40:12.909 INFO:tasks.workunit.client.0.smithi084.stdout:op 5696 completed, throughput=5MB/sec 2024-01-13T18:40:12.909 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NjfmA3w05gTVLv0 off=16772190 len=545404 2024-01-13T18:40:12.909 INFO:tasks.workunit.client.0.smithi084.stdout:op 5697 completed, throughput=5MB/sec 2024-01-13T18:40:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:12 smithi084 ceph-mon[116404]: pgmap v2052: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:40:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:12 smithi084 ceph-mon[119097]: pgmap v2052: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:40:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:12 smithi099 ceph-mon[138788]: pgmap v2052: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:40:13.907 INFO:tasks.workunit.client.0.smithi084.stdout: 1128: throughput=5MB/sec pending data=0 2024-01-13T18:40:13.907 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qXh7pi2n7MKG_tw off=13435573 len=1108664 2024-01-13T18:40:13.913 INFO:tasks.workunit.client.0.smithi084.stdout:op 5698 completed, throughput=5MB/sec 2024-01-13T18:40:13.913 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pgd3iGGgk8MaNc4 off=9506892 len=943408 2024-01-13T18:40:13.914 INFO:tasks.workunit.client.0.smithi084.stdout:op 5699 completed, throughput=5MB/sec 2024-01-13T18:40:13.914 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-J1huv7Fo6TYdulr off=326348 len=2012330 2024-01-13T18:40:13.916 INFO:tasks.workunit.client.0.smithi084.stdout:op 5700 completed, throughput=5MB/sec 2024-01-13T18:40:13.916 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NzPyWNz8k4ww-53 off=133409 len=790997 2024-01-13T18:40:13.918 INFO:tasks.workunit.client.0.smithi084.stdout:op 5701 completed, throughput=5MB/sec 2024-01-13T18:40:13.918 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qevCgahF9LPHUo0 off=869848 len=2006348 2024-01-13T18:40:13.926 INFO:tasks.workunit.client.0.smithi084.stdout:op 5702 completed, throughput=5MB/sec 2024-01-13T18:40:14.926 INFO:tasks.workunit.client.0.smithi084.stdout: 1129: throughput=5MB/sec pending data=0 2024-01-13T18:40:14.926 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9EJ5ScMp21sObXO off=3801586 len=2033960 2024-01-13T18:40:14.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:14 smithi084 ceph-mon[116404]: pgmap v2053: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:40:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:14 smithi084 ceph-mon[119097]: pgmap v2053: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:40:14.937 INFO:tasks.workunit.client.0.smithi084.stdout:op 5703 completed, throughput=5MB/sec 2024-01-13T18:40:14.937 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-wYEcju4MU2Dg__Q off=24593569 len=814204 2024-01-13T18:40:14.939 INFO:tasks.workunit.client.0.smithi084.stdout:op 5704 completed, throughput=5MB/sec 2024-01-13T18:40:14.939 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PkMG8cnNrvXAdOw off=15462750 len=708112 2024-01-13T18:40:14.943 INFO:tasks.workunit.client.0.smithi084.stdout:op 5705 completed, throughput=5MB/sec 2024-01-13T18:40:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:14 smithi099 ceph-mon[138788]: pgmap v2053: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:40:15.943 INFO:tasks.workunit.client.0.smithi084.stdout: 1130: throughput=5MB/sec pending data=0 2024-01-13T18:40:15.943 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Pu2FTvaTh-3Kiup off=8287788 len=765832 2024-01-13T18:40:15.944 INFO:tasks.workunit.client.0.smithi084.stdout:op 5706 completed, throughput=5MB/sec 2024-01-13T18:40:15.944 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Rk_PTcC3zmhGz6I off=11995114 len=1528908 2024-01-13T18:40:15.946 INFO:tasks.workunit.client.0.smithi084.stdout:op 5707 completed, throughput=5MB/sec 2024-01-13T18:40:15.946 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-y6-vdlO4eDNSldG off=3632582 len=799293 2024-01-13T18:40:15.950 INFO:tasks.workunit.client.0.smithi084.stdout:op 5708 completed, throughput=5MB/sec 2024-01-13T18:40:15.951 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1l98HKsXyMzp3P4 off=13194664 len=271890 2024-01-13T18:40:15.954 INFO:tasks.workunit.client.0.smithi084.stdout:op 5709 completed, throughput=5MB/sec 2024-01-13T18:40:15.954 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cwzzgdP7TbGfIhZ off=1029194 len=616065 2024-01-13T18:40:15.957 INFO:tasks.workunit.client.0.smithi084.stdout:op 5710 completed, throughput=5MB/sec 2024-01-13T18:40:15.957 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-L5Rc6TUBX74075T off=6272544 len=1634032 2024-01-13T18:40:15.959 INFO:tasks.workunit.client.0.smithi084.stdout:op 5711 completed, throughput=5MB/sec 2024-01-13T18:40:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:16 smithi084 ceph-mon[116404]: pgmap v2054: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:40:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:16 smithi084 ceph-mon[119097]: pgmap v2054: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:40:16.959 INFO:tasks.workunit.client.0.smithi084.stdout: 1131: throughput=5MB/sec pending data=0 2024-01-13T18:40:16.959 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DHTGzh8H0r8t_V0 off=318078 len=402064 2024-01-13T18:40:16.961 INFO:tasks.workunit.client.0.smithi084.stdout:op 5712 completed, throughput=5MB/sec 2024-01-13T18:40:16.961 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-oNL5qgG_C7wZDyH off=8081995 len=1638662 2024-01-13T18:40:16.970 INFO:tasks.workunit.client.0.smithi084.stdout:op 5713 completed, throughput=5MB/sec 2024-01-13T18:40:16.971 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-t8MpXqJLbFYQZ3U off=1737116 len=2052216 2024-01-13T18:40:16.980 INFO:tasks.workunit.client.0.smithi084.stdout:op 5714 completed, throughput=5MB/sec 2024-01-13T18:40:16.980 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cotH6tTfrzogS1w off=957355 len=1768271 2024-01-13T18:40:16.981 INFO:tasks.workunit.client.0.smithi084.stdout:op 5715 completed, throughput=5MB/sec 2024-01-13T18:40:17.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:16 smithi099 ceph-mon[138788]: pgmap v2054: 105 pgs: 105 active+clean; 128 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 4 op/s 2024-01-13T18:40:17.981 INFO:tasks.workunit.client.0.smithi084.stdout: 1132: throughput=5MB/sec pending data=0 2024-01-13T18:40:17.982 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SUZJHqDT98JJqHL off=4888502 len=1462840 2024-01-13T18:40:17.983 INFO:tasks.workunit.client.0.smithi084.stdout:op 5716 completed, throughput=5MB/sec 2024-01-13T18:40:17.983 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-V9SRLgpmUIfQvw1 off=373809 len=1109365 2024-01-13T18:40:17.990 INFO:tasks.workunit.client.0.smithi084.stdout:op 5717 completed, throughput=5MB/sec 2024-01-13T18:40:17.990 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HJh96CTP3a9U1Gf off=3002578 len=318625 2024-01-13T18:40:17.990 INFO:tasks.workunit.client.0.smithi084.stdout:op 5718 completed, throughput=5MB/sec 2024-01-13T18:40:17.991 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-MOLPIlNoWVv9BEX off=4020190 len=935759 2024-01-13T18:40:17.995 INFO:tasks.workunit.client.0.smithi084.stdout:op 5719 completed, throughput=5MB/sec 2024-01-13T18:40:17.995 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-qZD11GAJd0iqKeA off=1896576 len=1034470 2024-01-13T18:40:17.995 INFO:tasks.workunit.client.0.smithi084.stdout:op 5720 completed, throughput=5MB/sec 2024-01-13T18:40:18.996 INFO:tasks.workunit.client.0.smithi084.stdout: 1133: throughput=5MB/sec pending data=0 2024-01-13T18:40:18.996 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uKticcPQAA6ucwe off=2107923 len=1659860 2024-01-13T18:40:19.006 INFO:tasks.workunit.client.0.smithi084.stdout:op 5721 completed, throughput=5MB/sec 2024-01-13T18:40:19.006 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RWcKckifyIaYOrq off=7775316 len=1626947 2024-01-13T18:40:19.012 INFO:tasks.workunit.client.0.smithi084.stdout:op 5722 completed, throughput=5MB/sec 2024-01-13T18:40:19.012 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cE4Je_b_SOlruiO off=3922453 len=1219673 2024-01-13T18:40:19.015 INFO:tasks.workunit.client.0.smithi084.stdout:op 5723 completed, throughput=5MB/sec 2024-01-13T18:40:19.015 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Ga-3xlJ5fjWNhDP off=8794085 len=1908948 2024-01-13T18:40:19.024 INFO:tasks.workunit.client.0.smithi084.stdout:op 5724 completed, throughput=5MB/sec 2024-01-13T18:40:19.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:19 smithi084 ceph-mon[116404]: pgmap v2055: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:40:19.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:19 smithi084 ceph-mon[119097]: pgmap v2055: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:40:19.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:19 smithi099 ceph-mon[138788]: pgmap v2055: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:40:20.025 INFO:tasks.workunit.client.0.smithi084.stdout: 1134: throughput=5MB/sec pending data=0 2024-01-13T18:40:20.025 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HFCi267IxvUlRzW off=5622378 len=1945356 2024-01-13T18:40:20.027 INFO:tasks.workunit.client.0.smithi084.stdout:op 5725 completed, throughput=5MB/sec 2024-01-13T18:40:20.027 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WtsVWaK1EWvinvf off=14745763 len=852468 2024-01-13T18:40:20.028 INFO:tasks.workunit.client.0.smithi084.stdout:op 5726 completed, throughput=5MB/sec 2024-01-13T18:40:20.028 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4eX-vWrPjqIpv-K off=11740220 len=1172406 2024-01-13T18:40:20.029 INFO:tasks.workunit.client.0.smithi084.stdout:op 5727 completed, throughput=5MB/sec 2024-01-13T18:40:20.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:20.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:20.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:40:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:40:20] "GET /metrics HTTP/1.1" 200 33998 "" "Prometheus/2.43.0" 2024-01-13T18:40:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:21.030 INFO:tasks.workunit.client.0.smithi084.stdout: 1135: throughput=5MB/sec pending data=0 2024-01-13T18:40:21.030 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5YdThiGTrlLmCPz off=5797444 len=133604 2024-01-13T18:40:21.031 INFO:tasks.workunit.client.0.smithi084.stdout:op 5728 completed, throughput=5MB/sec 2024-01-13T18:40:21.031 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_GPnRPsrBWg6Bew off=4153837 len=457772 2024-01-13T18:40:21.032 INFO:tasks.workunit.client.0.smithi084.stdout:op 5729 completed, throughput=5MB/sec 2024-01-13T18:40:21.032 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2t38826EVM-kyjX off=15154273 len=2065103 2024-01-13T18:40:21.034 INFO:tasks.workunit.client.0.smithi084.stdout:op 5730 completed, throughput=5MB/sec 2024-01-13T18:40:21.034 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0mHmE2PMOYwYySK off=6051638 len=2036692 2024-01-13T18:40:21.044 INFO:tasks.workunit.client.0.smithi084.stdout:op 5731 completed, throughput=5MB/sec 2024-01-13T18:40:21.044 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-I9bCwyxPZ0ubR9b off=11600526 len=756780 2024-01-13T18:40:21.044 INFO:tasks.workunit.client.0.smithi084.stdout:op 5732 completed, throughput=5MB/sec 2024-01-13T18:40:21.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:21 smithi084 ceph-mon[116404]: pgmap v2056: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:40:21.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:21 smithi084 ceph-mon[119097]: pgmap v2056: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:40:21.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:21 smithi099 ceph-mon[138788]: pgmap v2056: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 4 op/s 2024-01-13T18:40:22.045 INFO:tasks.workunit.client.0.smithi084.stdout: 1136: throughput=5MB/sec pending data=0 2024-01-13T18:40:22.045 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-b8gDhJYl-Y2_7cG off=1234613 len=953568 2024-01-13T18:40:22.047 INFO:tasks.workunit.client.0.smithi084.stdout:op 5733 completed, throughput=5MB/sec 2024-01-13T18:40:22.047 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-r1wSHXg32CYM01z off=5650153 len=1527151 2024-01-13T18:40:22.048 INFO:tasks.workunit.client.0.smithi084.stdout:op 5734 completed, throughput=5MB/sec 2024-01-13T18:40:22.048 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-0DPPPcqtuPDdGbk off=11489681 len=1791304 2024-01-13T18:40:22.052 INFO:tasks.workunit.client.0.smithi084.stdout:op 5735 completed, throughput=5MB/sec 2024-01-13T18:40:22.052 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-olzOBIo2V919vys off=3800418 len=1168155 2024-01-13T18:40:22.053 INFO:tasks.workunit.client.0.smithi084.stdout:op 5736 completed, throughput=5MB/sec 2024-01-13T18:40:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:22 smithi084 ceph-mon[116404]: pgmap v2057: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:40:22.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:22 smithi084 ceph-mon[119097]: pgmap v2057: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:40:23.053 INFO:tasks.workunit.client.0.smithi084.stdout: 1137: throughput=5MB/sec pending data=0 2024-01-13T18:40:23.053 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-4KL7yWOyPvN1CQH off=6052777 len=1858031 2024-01-13T18:40:23.064 INFO:tasks.workunit.client.0.smithi084.stdout:op 5737 completed, throughput=5MB/sec 2024-01-13T18:40:23.064 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2l9BceLhkygbl9Z off=1178745 len=804611 2024-01-13T18:40:23.068 INFO:tasks.workunit.client.0.smithi084.stdout:op 5738 completed, throughput=5MB/sec 2024-01-13T18:40:23.068 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-N7tuQCUI1hZEoBG off=644535 len=1992536 2024-01-13T18:40:23.077 INFO:tasks.workunit.client.0.smithi084.stdout:op 5739 completed, throughput=5MB/sec 2024-01-13T18:40:23.077 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-QBmZ8A24EuViHpo off=1320413 len=887332 2024-01-13T18:40:23.081 INFO:tasks.workunit.client.0.smithi084.stdout:op 5740 completed, throughput=5MB/sec 2024-01-13T18:40:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:22 smithi099 ceph-mon[138788]: pgmap v2057: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:40:24.081 INFO:tasks.workunit.client.0.smithi084.stdout: 1138: throughput=5MB/sec pending data=0 2024-01-13T18:40:24.081 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-JS5Rdn1srpkW9ri off=6940917 len=726906 2024-01-13T18:40:24.082 INFO:tasks.workunit.client.0.smithi084.stdout:op 5741 completed, throughput=5MB/sec 2024-01-13T18:40:24.082 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-QVmQmnlWHNkIU2U off=7545268 len=1131345 2024-01-13T18:40:24.085 INFO:tasks.workunit.client.0.smithi084.stdout:op 5742 completed, throughput=5MB/sec 2024-01-13T18:40:24.085 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-h4UWd9EuZUUXGtj off=12258649 len=1448184 2024-01-13T18:40:24.087 INFO:tasks.workunit.client.0.smithi084.stdout:op 5743 completed, throughput=5MB/sec 2024-01-13T18:40:24.087 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qUwgzFfY79QoX9r off=338789 len=1709876 2024-01-13T18:40:24.097 INFO:tasks.workunit.client.0.smithi084.stdout:op 5744 completed, throughput=5MB/sec 2024-01-13T18:40:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:24 smithi084 ceph-mon[116404]: pgmap v2058: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:40:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:24 smithi084 ceph-mon[119097]: pgmap v2058: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:40:25.097 INFO:tasks.workunit.client.0.smithi084.stdout: 1139: throughput=5MB/sec pending data=0 2024-01-13T18:40:25.098 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iTHlF8N1CrKYSRD off=18804678 len=949571 2024-01-13T18:40:25.102 INFO:tasks.workunit.client.0.smithi084.stdout:op 5745 completed, throughput=5MB/sec 2024-01-13T18:40:25.103 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-of7U3-w7Cr5yjyY off=448483 len=1089718 2024-01-13T18:40:25.105 INFO:tasks.workunit.client.0.smithi084.stdout:op 5746 completed, throughput=5MB/sec 2024-01-13T18:40:25.105 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-I79xDWgix3cD_MY off=885986 len=491163 2024-01-13T18:40:25.109 INFO:tasks.workunit.client.0.smithi084.stdout:op 5747 completed, throughput=5MB/sec 2024-01-13T18:40:25.109 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3tMSrmvZ2cLxSzH off=1747807 len=339446 2024-01-13T18:40:25.110 INFO:tasks.workunit.client.0.smithi084.stdout:op 5748 completed, throughput=5MB/sec 2024-01-13T18:40:25.110 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Eq5_fv-0cpSIZ6e off=21459923 len=259682 2024-01-13T18:40:25.112 INFO:tasks.workunit.client.0.smithi084.stdout:op 5749 completed, throughput=5MB/sec 2024-01-13T18:40:25.112 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ww5QSQJOyTVKBtx off=3642588 len=300686 2024-01-13T18:40:25.113 INFO:tasks.workunit.client.0.smithi084.stdout:op 5750 completed, throughput=5MB/sec 2024-01-13T18:40:25.113 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Jef7_nKtOlyOw65 off=7927907 len=1647541 2024-01-13T18:40:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:24 smithi099 ceph-mon[138788]: pgmap v2058: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:40:25.121 INFO:tasks.workunit.client.0.smithi084.stdout:op 5751 completed, throughput=5MB/sec 2024-01-13T18:40:25.121 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0LOY2q6cfYWpDMC off=6977701 len=1819727 2024-01-13T18:40:25.131 INFO:tasks.workunit.client.0.smithi084.stdout:op 5752 completed, throughput=5MB/sec 2024-01-13T18:40:26.131 INFO:tasks.workunit.client.0.smithi084.stdout: 1140: throughput=5MB/sec pending data=0 2024-01-13T18:40:26.131 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M5ccYyJVe0XsSHO off=5063028 len=1614188 2024-01-13T18:40:26.133 INFO:tasks.workunit.client.0.smithi084.stdout:op 5753 completed, throughput=5MB/sec 2024-01-13T18:40:26.133 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-D34gs1XeLdoca2S off=3057493 len=45097 2024-01-13T18:40:26.133 INFO:tasks.workunit.client.0.smithi084.stdout:op 5754 completed, throughput=5MB/sec 2024-01-13T18:40:26.133 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FBfl9sdlTyrigYD off=2325717 len=1249327 2024-01-13T18:40:26.140 INFO:tasks.workunit.client.0.smithi084.stdout:op 5755 completed, throughput=5MB/sec 2024-01-13T18:40:26.140 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-LGQsPafDtS0zaM8 off=6711340 len=1745641 2024-01-13T18:40:26.142 INFO:tasks.workunit.client.0.smithi084.stdout:op 5756 completed, throughput=5MB/sec 2024-01-13T18:40:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:26 smithi084 ceph-mon[116404]: pgmap v2059: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:26 smithi084 ceph-mon[119097]: pgmap v2059: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:26 smithi099 ceph-mon[138788]: pgmap v2059: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:27.142 INFO:tasks.workunit.client.0.smithi084.stdout: 1141: throughput=5MB/sec pending data=0 2024-01-13T18:40:27.143 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-MPglL8S_xuGEcFT off=2597116 len=175243 2024-01-13T18:40:27.143 INFO:tasks.workunit.client.0.smithi084.stdout:op 5757 completed, throughput=5MB/sec 2024-01-13T18:40:27.143 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-3pJ__uSb1gtjuwM off=315913 len=120470 2024-01-13T18:40:27.146 INFO:tasks.workunit.client.0.smithi084.stdout:op 5758 completed, throughput=5MB/sec 2024-01-13T18:40:27.146 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kyOsGuvQ5_mGwCd off=7094126 len=2004297 2024-01-13T18:40:27.154 INFO:tasks.workunit.client.0.smithi084.stdout:op 5759 completed, throughput=5MB/sec 2024-01-13T18:40:27.154 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-d7eqILr_D-Ny-SN off=664936 len=915739 2024-01-13T18:40:27.155 INFO:tasks.workunit.client.0.smithi084.stdout:op 5760 completed, throughput=5MB/sec 2024-01-13T18:40:27.155 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XWZRqlmyzYu2Voz off=14431083 len=2043144 2024-01-13T18:40:27.159 INFO:tasks.workunit.client.0.smithi084.stdout:op 5761 completed, throughput=5MB/sec 2024-01-13T18:40:28.160 INFO:tasks.workunit.client.0.smithi084.stdout: 1142: throughput=5MB/sec pending data=0 2024-01-13T18:40:28.160 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y8WpAKZHVxzHarG off=165771 len=1099829 2024-01-13T18:40:28.162 INFO:tasks.workunit.client.0.smithi084.stdout:op 5762 completed, throughput=5MB/sec 2024-01-13T18:40:28.162 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xm8TFcpH6qCg2Km off=3124773 len=2043557 2024-01-13T18:40:28.164 INFO:tasks.workunit.client.0.smithi084.stdout:op 5763 completed, throughput=5MB/sec 2024-01-13T18:40:28.164 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZNkKOkt-gDEbsv- off=3916334 len=1965185 2024-01-13T18:40:28.176 INFO:tasks.workunit.client.0.smithi084.stdout:op 5764 completed, throughput=5MB/sec 2024-01-13T18:40:29.176 INFO:tasks.workunit.client.0.smithi084.stdout: 1143: throughput=5MB/sec pending data=0 2024-01-13T18:40:29.176 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KIKXiGIc1QrED-R off=5573739 len=516515 2024-01-13T18:40:29.180 INFO:tasks.workunit.client.0.smithi084.stdout:op 5765 completed, throughput=5MB/sec 2024-01-13T18:40:29.180 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-1FiJBEGBAwZOgQy off=4254841 len=1189204 2024-01-13T18:40:29.187 INFO:tasks.workunit.client.0.smithi084.stdout:op 5766 completed, throughput=5MB/sec 2024-01-13T18:40:29.187 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-et1pdu-sTa1Dawq off=2964675 len=667983 2024-01-13T18:40:29.188 INFO:tasks.workunit.client.0.smithi084.stdout:op 5767 completed, throughput=5MB/sec 2024-01-13T18:40:29.188 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-olJ8s2JMjdS2eW2 off=12695421 len=714973 2024-01-13T18:40:29.192 INFO:tasks.workunit.client.0.smithi084.stdout:op 5768 completed, throughput=5MB/sec 2024-01-13T18:40:29.193 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-M3i1I4EMi106Av8 off=1176526 len=1713490 2024-01-13T18:40:29.194 INFO:tasks.workunit.client.0.smithi084.stdout:op 5769 completed, throughput=5MB/sec 2024-01-13T18:40:29.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:29 smithi084 ceph-mon[116404]: pgmap v2060: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:29.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:29 smithi084 ceph-mon[119097]: pgmap v2060: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:29.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:29 smithi099 ceph-mon[138788]: pgmap v2060: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:30.195 INFO:tasks.workunit.client.0.smithi084.stdout: 1144: throughput=5MB/sec pending data=0 2024-01-13T18:40:30.195 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-94-82UJpXcS1p0z off=6181482 len=1617277 2024-01-13T18:40:30.197 INFO:tasks.workunit.client.0.smithi084.stdout:op 5770 completed, throughput=5MB/sec 2024-01-13T18:40:30.197 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mB8agLaz3EHm3_Z off=10215042 len=876165 2024-01-13T18:40:30.202 INFO:tasks.workunit.client.0.smithi084.stdout:op 5771 completed, throughput=5MB/sec 2024-01-13T18:40:30.202 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cQHKDoYkJLt3uHs off=1189998 len=2095414 2024-01-13T18:40:30.205 INFO:tasks.workunit.client.0.smithi084.stdout:op 5772 completed, throughput=5MB/sec 2024-01-13T18:40:30.205 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-mJJRcEpC6GREta- off=5375816 len=910325 2024-01-13T18:40:30.207 INFO:tasks.workunit.client.0.smithi084.stdout:op 5773 completed, throughput=5MB/sec 2024-01-13T18:40:30.665 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:40:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:40:30] "GET /metrics HTTP/1.1" 200 33998 "" "Prometheus/2.43.0" 2024-01-13T18:40:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:30 smithi084 ceph-mon[116404]: pgmap v2061: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:40:30.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:30 smithi084 ceph-mon[119097]: pgmap v2061: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:40:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:30 smithi099 ceph-mon[138788]: pgmap v2061: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:40:31.208 INFO:tasks.workunit.client.0.smithi084.stdout: 1145: throughput=5MB/sec pending data=0 2024-01-13T18:40:31.208 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4lBOeiZrxTF6kIz off=6235424 len=620595 2024-01-13T18:40:31.209 INFO:tasks.workunit.client.0.smithi084.stdout:op 5774 completed, throughput=5MB/sec 2024-01-13T18:40:31.209 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-RrkZWy6EDt6ql0V off=9702275 len=1680905 2024-01-13T18:40:31.218 INFO:tasks.workunit.client.0.smithi084.stdout:op 5775 completed, throughput=5MB/sec 2024-01-13T18:40:31.218 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-La2YtEGYbisEVSf off=969335 len=1397310 2024-01-13T18:40:31.225 INFO:tasks.workunit.client.0.smithi084.stdout:op 5776 completed, throughput=5MB/sec 2024-01-13T18:40:31.225 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kOm4kr3_2P3Fe0O off=1309871 len=2048842 2024-01-13T18:40:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:op 5777 completed, throughput=5MB/sec 2024-01-13T18:40:32.235 INFO:tasks.workunit.client.0.smithi084.stdout: 1146: throughput=5MB/sec pending data=0 2024-01-13T18:40:32.235 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-T0VzlxUIumlSB4D off=4218340 len=897090 2024-01-13T18:40:32.240 INFO:tasks.workunit.client.0.smithi084.stdout:op 5778 completed, throughput=5MB/sec 2024-01-13T18:40:32.240 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HybECrcxyBvRJoc off=3546510 len=1943469 2024-01-13T18:40:32.244 INFO:tasks.workunit.client.0.smithi084.stdout:op 5779 completed, throughput=5MB/sec 2024-01-13T18:40:32.244 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-orAajoLFoONNqa6 off=2811753 len=1032495 2024-01-13T18:40:32.249 INFO:tasks.workunit.client.0.smithi084.stdout:op 5780 completed, throughput=5MB/sec 2024-01-13T18:40:32.249 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-q5LUKtKlhz4VxT7 off=751156 len=369748 2024-01-13T18:40:32.250 INFO:tasks.workunit.client.0.smithi084.stdout:op 5781 completed, throughput=5MB/sec 2024-01-13T18:40:32.250 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8oaypU_vA3xi_44 off=4130355 len=1735850 2024-01-13T18:40:32.252 INFO:tasks.workunit.client.0.smithi084.stdout:op 5782 completed, throughput=5MB/sec 2024-01-13T18:40:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:32 smithi084 ceph-mon[116404]: pgmap v2062: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:40:32.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:32 smithi084 ceph-mon[119097]: pgmap v2062: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:40:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:32 smithi099 ceph-mon[138788]: pgmap v2062: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:40:33.252 INFO:tasks.workunit.client.0.smithi084.stdout: 1147: throughput=5MB/sec pending data=0 2024-01-13T18:40:33.253 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-EW8oC8Hx5RXmmiE off=14996940 len=811685 2024-01-13T18:40:33.258 INFO:tasks.workunit.client.0.smithi084.stdout:op 5783 completed, throughput=5MB/sec 2024-01-13T18:40:33.258 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0JzHMTA6uTOVsS3 off=4548890 len=297275 2024-01-13T18:40:33.260 INFO:tasks.workunit.client.0.smithi084.stdout:op 5784 completed, throughput=5MB/sec 2024-01-13T18:40:33.260 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-n6ZWqKbWKzyudSO off=3263298 len=2009004 2024-01-13T18:40:33.269 INFO:tasks.workunit.client.0.smithi084.stdout:op 5785 completed, throughput=5MB/sec 2024-01-13T18:40:33.269 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KF6W6jU68tXih98 off=729684 len=719261 2024-01-13T18:40:33.274 INFO:tasks.workunit.client.0.smithi084.stdout:op 5786 completed, throughput=5MB/sec 2024-01-13T18:40:33.274 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3ZiIk7Gj1tQtNhX off=2286357 len=892582 2024-01-13T18:40:33.276 INFO:tasks.workunit.client.0.smithi084.stdout:op 5787 completed, throughput=5MB/sec 2024-01-13T18:40:34.277 INFO:tasks.workunit.client.0.smithi084.stdout: 1148: throughput=5MB/sec pending data=0 2024-01-13T18:40:34.277 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uR_XUWUesX0xbPc off=1681480 len=1335697 2024-01-13T18:40:34.279 INFO:tasks.workunit.client.0.smithi084.stdout:op 5788 completed, throughput=5MB/sec 2024-01-13T18:40:34.279 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eLpVPWLbd1VAbhs off=6123282 len=873268 2024-01-13T18:40:34.284 INFO:tasks.workunit.client.0.smithi084.stdout:op 5789 completed, throughput=5MB/sec 2024-01-13T18:40:34.284 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-uvPyCM7zjK9IFCt off=4063631 len=91190 2024-01-13T18:40:34.285 INFO:tasks.workunit.client.0.smithi084.stdout:op 5790 completed, throughput=5MB/sec 2024-01-13T18:40:34.285 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-P6_aFkWYwgjzk1C off=13789929 len=1702125 2024-01-13T18:40:34.287 INFO:tasks.workunit.client.0.smithi084.stdout:op 5791 completed, throughput=5MB/sec 2024-01-13T18:40:34.287 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-SFwMWOS3mFnJyPa off=5188651 len=320374 2024-01-13T18:40:34.287 INFO:tasks.workunit.client.0.smithi084.stdout:op 5792 completed, throughput=5MB/sec 2024-01-13T18:40:34.288 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SBz3-JJj6kXhBo- off=18527065 len=1683037 2024-01-13T18:40:34.295 INFO:tasks.workunit.client.0.smithi084.stdout:op 5793 completed, throughput=5MB/sec 2024-01-13T18:40:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:34 smithi084 ceph-mon[116404]: pgmap v2063: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:40:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:34 smithi084 ceph-mon[119097]: pgmap v2063: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:40:35.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:34 smithi099 ceph-mon[138788]: pgmap v2063: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-01-13T18:40:35.296 INFO:tasks.workunit.client.0.smithi084.stdout: 1149: throughput=5MB/sec pending data=0 2024-01-13T18:40:35.296 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Qv4jETdPC0e66JA off=5005538 len=669368 2024-01-13T18:40:35.301 INFO:tasks.workunit.client.0.smithi084.stdout:op 5794 completed, throughput=5MB/sec 2024-01-13T18:40:35.301 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-6mPMsQCh56NIaVN off=19059607 len=1535666 2024-01-13T18:40:35.310 INFO:tasks.workunit.client.0.smithi084.stdout:op 5795 completed, throughput=5MB/sec 2024-01-13T18:40:35.310 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XFS9_yQIteFpDoN off=1155732 len=882815 2024-01-13T18:40:35.312 INFO:tasks.workunit.client.0.smithi084.stdout:op 5796 completed, throughput=5MB/sec 2024-01-13T18:40:35.312 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RSXX2yXzdJU8Rxf off=2157514 len=1053072 2024-01-13T18:40:35.313 INFO:tasks.workunit.client.0.smithi084.stdout:op 5797 completed, throughput=5MB/sec 2024-01-13T18:40:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:36.314 INFO:tasks.workunit.client.0.smithi084.stdout: 1150: throughput=5MB/sec pending data=0 2024-01-13T18:40:36.314 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9s-BbYsasM13gBs off=12822637 len=206497 2024-01-13T18:40:36.317 INFO:tasks.workunit.client.0.smithi084.stdout:op 5798 completed, throughput=5MB/sec 2024-01-13T18:40:36.317 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-SLys2WjnLds39ml off=3794242 len=2063801 2024-01-13T18:40:36.329 INFO:tasks.workunit.client.0.smithi084.stdout:op 5799 completed, throughput=5MB/sec 2024-01-13T18:40:36.330 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-uw8dNEm9KcTv30P off=13038490 len=622628 2024-01-13T18:40:36.333 INFO:tasks.workunit.client.0.smithi084.stdout:op 5800 completed, throughput=5MB/sec 2024-01-13T18:40:36.333 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-k_mbYW-6R3vyOyk off=6365054 len=425118 2024-01-13T18:40:36.333 INFO:tasks.workunit.client.0.smithi084.stdout:op 5801 completed, throughput=5MB/sec 2024-01-13T18:40:36.334 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-WV9jit4PQJWlZD2 off=7523034 len=294666 2024-01-13T18:40:36.334 INFO:tasks.workunit.client.0.smithi084.stdout:op 5802 completed, throughput=5MB/sec 2024-01-13T18:40:36.334 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VbvZyUVYQgs6eMv off=2096135 len=823981 2024-01-13T18:40:36.336 INFO:tasks.workunit.client.0.smithi084.stdout:op 5803 completed, throughput=5MB/sec 2024-01-13T18:40:36.336 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--8Be4kiol3xAwyI off=10439011 len=390406 2024-01-13T18:40:36.337 INFO:tasks.workunit.client.0.smithi084.stdout:op 5804 completed, throughput=5MB/sec 2024-01-13T18:40:36.337 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Nbhn6EqR4g6cNlf off=1163740 len=499897 2024-01-13T18:40:36.338 INFO:tasks.workunit.client.0.smithi084.stdout:op 5805 completed, throughput=5MB/sec 2024-01-13T18:40:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:36 smithi084 ceph-mon[116404]: pgmap v2064: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:40:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:36 smithi084 ceph-mon[119097]: pgmap v2064: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:40:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:36 smithi099 ceph-mon[138788]: pgmap v2064: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 4 op/s 2024-01-13T18:40:37.339 INFO:tasks.workunit.client.0.smithi084.stdout: 1151: throughput=5MB/sec pending data=0 2024-01-13T18:40:37.339 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-XDkfNl4i81LBywE off=5469587 len=1924287 2024-01-13T18:40:37.348 INFO:tasks.workunit.client.0.smithi084.stdout:op 5806 completed, throughput=5MB/sec 2024-01-13T18:40:37.348 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-YVrZJJrHjBzMid9 off=777681 len=851894 2024-01-13T18:40:37.352 INFO:tasks.workunit.client.0.smithi084.stdout:op 5807 completed, throughput=5MB/sec 2024-01-13T18:40:37.352 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-0PIzDrtAZGY0ZHP off=1295452 len=1111580 2024-01-13T18:40:37.358 INFO:tasks.workunit.client.0.smithi084.stdout:op 5808 completed, throughput=5MB/sec 2024-01-13T18:40:37.358 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-cbq4-1dvQzzKuiQ off=11240922 len=1732264 2024-01-13T18:40:37.364 INFO:tasks.workunit.client.0.smithi084.stdout:op 5809 completed, throughput=5MB/sec 2024-01-13T18:40:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:40:37.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:40:38.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:40:38.365 INFO:tasks.workunit.client.0.smithi084.stdout: 1152: throughput=5MB/sec pending data=0 2024-01-13T18:40:38.365 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-HWww8ZcSRrXTnyu off=8705293 len=749492 2024-01-13T18:40:38.366 INFO:tasks.workunit.client.0.smithi084.stdout:op 5810 completed, throughput=5MB/sec 2024-01-13T18:40:38.366 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Rmjf0ZYZFdJOY1_ off=3549813 len=1138673 2024-01-13T18:40:38.371 INFO:tasks.workunit.client.0.smithi084.stdout:op 5811 completed, throughput=5MB/sec 2024-01-13T18:40:38.371 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZhbfcYjjtEuYq7v off=3058506 len=470756 2024-01-13T18:40:38.375 INFO:tasks.workunit.client.0.smithi084.stdout:op 5812 completed, throughput=5MB/sec 2024-01-13T18:40:38.375 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6NN4Xu44SSw05xc off=2326553 len=1819061 2024-01-13T18:40:38.376 INFO:tasks.workunit.client.0.smithi084.stdout:op 5813 completed, throughput=5MB/sec 2024-01-13T18:40:38.376 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dTY7oEcSawtWTUW off=1063502 len=319969 2024-01-13T18:40:38.377 INFO:tasks.workunit.client.0.smithi084.stdout:op 5814 completed, throughput=5MB/sec 2024-01-13T18:40:38.377 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-1s4vngE-AszsDy5 off=6408761 len=167811 2024-01-13T18:40:38.377 INFO:tasks.workunit.client.0.smithi084.stdout:op 5815 completed, throughput=5MB/sec 2024-01-13T18:40:38.377 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kRtPVgi0APClEm5 off=11509819 len=1709058 2024-01-13T18:40:38.377 INFO:tasks.workunit.client.0.smithi084.stdout:op 5816 completed, throughput=5MB/sec 2024-01-13T18:40:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:40:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:40:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:40:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:38 smithi084 ceph-mon[119097]: pgmap v2065: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:40:38.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:40:38.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:40:38.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:40:38.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:38 smithi084 ceph-mon[116404]: pgmap v2065: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:40:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:40:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:40:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:40:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:38 smithi099 ceph-mon[138788]: pgmap v2065: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:40:39.378 INFO:tasks.workunit.client.0.smithi084.stdout: 1153: throughput=5MB/sec pending data=0 2024-01-13T18:40:39.378 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-mnyMK9mykawnhzX off=2319149 len=1712627 2024-01-13T18:40:39.386 INFO:tasks.workunit.client.0.smithi084.stdout:op 5817 completed, throughput=5MB/sec 2024-01-13T18:40:39.386 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj--YTHsUkwEoWxQIo off=511149 len=694574 2024-01-13T18:40:39.388 INFO:tasks.workunit.client.0.smithi084.stdout:op 5818 completed, throughput=5MB/sec 2024-01-13T18:40:39.388 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ualBRQAhQai-bii off=6280317 len=1992025 2024-01-13T18:40:39.390 INFO:tasks.workunit.client.0.smithi084.stdout:op 5819 completed, throughput=5MB/sec 2024-01-13T18:40:40.390 INFO:tasks.workunit.client.0.smithi084.stdout: 1154: throughput=5MB/sec pending data=0 2024-01-13T18:40:40.391 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-BelSwkmxVlmMZ5A off=653743 len=721895 2024-01-13T18:40:40.391 INFO:tasks.workunit.client.0.smithi084.stdout:op 5820 completed, throughput=5MB/sec 2024-01-13T18:40:40.392 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Kfx0RI6mhVrJYBS off=13855181 len=703978 2024-01-13T18:40:40.396 INFO:tasks.workunit.client.0.smithi084.stdout:op 5821 completed, throughput=5MB/sec 2024-01-13T18:40:40.396 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-p999gwTQb3xc3p4 off=6031280 len=448135 2024-01-13T18:40:40.400 INFO:tasks.workunit.client.0.smithi084.stdout:op 5822 completed, throughput=5MB/sec 2024-01-13T18:40:40.400 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-LRtY_1_u0p7lknI off=5604709 len=1441263 2024-01-13T18:40:40.409 INFO:tasks.workunit.client.0.smithi084.stdout:op 5823 completed, throughput=5MB/sec 2024-01-13T18:40:40.409 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8EPKQwzod-wTEDY off=931594 len=569242 2024-01-13T18:40:40.410 INFO:tasks.workunit.client.0.smithi084.stdout:op 5824 completed, throughput=5MB/sec 2024-01-13T18:40:40.410 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_I_s2-q1acppfPU off=1395904 len=38480 2024-01-13T18:40:40.412 INFO:tasks.workunit.client.0.smithi084.stdout:op 5825 completed, throughput=5MB/sec 2024-01-13T18:40:40.412 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-nWLdel7dDO_f9_F off=2422269 len=613080 2024-01-13T18:40:40.416 INFO:tasks.workunit.client.0.smithi084.stdout:op 5826 completed, throughput=5MB/sec 2024-01-13T18:40:40.416 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-G5PSIzOYA61pTt6 off=3300323 len=130242 2024-01-13T18:40:40.418 INFO:tasks.workunit.client.0.smithi084.stdout:op 5827 completed, throughput=5MB/sec 2024-01-13T18:40:40.419 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-cARDppeYOFLhT7Q off=192220 len=1994239 2024-01-13T18:40:40.423 INFO:tasks.workunit.client.0.smithi084.stdout:op 5828 completed, throughput=5MB/sec 2024-01-13T18:40:40.666 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:40:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:40:40] "GET /metrics HTTP/1.1" 200 34001 "" "Prometheus/2.43.0" 2024-01-13T18:40:40.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:40 smithi084 ceph-mon[116404]: pgmap v2066: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:40:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:40 smithi084 ceph-mon[119097]: pgmap v2066: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:40:41.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:40 smithi099 ceph-mon[138788]: pgmap v2066: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 5 op/s 2024-01-13T18:40:41.422 INFO:tasks.workunit.client.0.smithi084.stdout: 1155: throughput=5MB/sec pending data=0 2024-01-13T18:40:41.422 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-hiIsFVcfqc6bjfc off=6428297 len=71509 2024-01-13T18:40:41.425 INFO:tasks.workunit.client.0.smithi084.stdout:op 5829 completed, throughput=5MB/sec 2024-01-13T18:40:41.425 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-UxRwld4G6acZZEF off=2246885 len=1656778 2024-01-13T18:40:41.434 INFO:tasks.workunit.client.0.smithi084.stdout:op 5830 completed, throughput=5MB/sec 2024-01-13T18:40:41.434 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-R5HUGW1ukjXyTvV off=5449043 len=892740 2024-01-13T18:40:41.439 INFO:tasks.workunit.client.0.smithi084.stdout:op 5831 completed, throughput=5MB/sec 2024-01-13T18:40:41.439 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-wsDVGr9Xt1VV2fj off=94161 len=1062767 2024-01-13T18:40:41.443 INFO:tasks.workunit.client.0.smithi084.stdout:op 5832 completed, throughput=5MB/sec 2024-01-13T18:40:42.443 INFO:tasks.workunit.client.0.smithi084.stdout: 1156: throughput=5MB/sec pending data=0 2024-01-13T18:40:42.443 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Ub_SgxGg8bjUyMG off=11126862 len=1731032 2024-01-13T18:40:42.445 INFO:tasks.workunit.client.0.smithi084.stdout:op 5833 completed, throughput=5MB/sec 2024-01-13T18:40:42.445 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-4jav3HeW1LjfuZ9 off=13447129 len=754885 2024-01-13T18:40:42.446 INFO:tasks.workunit.client.0.smithi084.stdout:op 5834 completed, throughput=5MB/sec 2024-01-13T18:40:42.446 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k8uMXatqEoE-VFB off=4188973 len=2046685 2024-01-13T18:40:42.457 INFO:tasks.workunit.client.0.smithi084.stdout:op 5835 completed, throughput=5MB/sec 2024-01-13T18:40:42.457 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XGT60Mm87pNF7yS off=177352 len=508766 2024-01-13T18:40:42.458 INFO:tasks.workunit.client.0.smithi084.stdout:op 5836 completed, throughput=5MB/sec 2024-01-13T18:40:42.458 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_Gdi7V3hwu4ujEn off=18959366 len=349524 2024-01-13T18:40:42.459 INFO:tasks.workunit.client.0.smithi084.stdout:op 5837 completed, throughput=5MB/sec 2024-01-13T18:40:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:42 smithi084 ceph-mon[116404]: pgmap v2067: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:40:42.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:42 smithi084 ceph-mon[119097]: pgmap v2067: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:40:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:42 smithi099 ceph-mon[138788]: pgmap v2067: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 4 op/s 2024-01-13T18:40:43.459 INFO:tasks.workunit.client.0.smithi084.stdout: 1157: throughput=5MB/sec pending data=0 2024-01-13T18:40:43.459 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jTFWK9_wbeekT5z off=2577551 len=545231 2024-01-13T18:40:43.460 INFO:tasks.workunit.client.0.smithi084.stdout:op 5838 completed, throughput=5MB/sec 2024-01-13T18:40:43.460 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Prfww7gBZJ7Djw6 off=7344311 len=2040334 2024-01-13T18:40:43.469 INFO:tasks.workunit.client.0.smithi084.stdout:op 5839 completed, throughput=5MB/sec 2024-01-13T18:40:43.470 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-orN2JYOVhHiKRxL off=2106515 len=544897 2024-01-13T18:40:43.473 INFO:tasks.workunit.client.0.smithi084.stdout:op 5840 completed, throughput=5MB/sec 2024-01-13T18:40:43.473 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-foPSDksc0kk4Ief off=2576538 len=376539 2024-01-13T18:40:43.476 INFO:tasks.workunit.client.0.smithi084.stdout:op 5841 completed, throughput=5MB/sec 2024-01-13T18:40:43.477 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-9hax1nxa5_7fjyJ off=437426 len=1834150 2024-01-13T18:40:43.485 INFO:tasks.workunit.client.0.smithi084.stdout:op 5842 completed, throughput=5MB/sec 2024-01-13T18:40:44.485 INFO:tasks.workunit.client.0.smithi084.stdout: 1158: throughput=5MB/sec pending data=0 2024-01-13T18:40:44.485 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-RULn9lUnPULjubw off=2988961 len=463768 2024-01-13T18:40:44.486 INFO:tasks.workunit.client.0.smithi084.stdout:op 5843 completed, throughput=5MB/sec 2024-01-13T18:40:44.486 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iholfeHAfQAwvsF off=23844722 len=613058 2024-01-13T18:40:44.491 INFO:tasks.workunit.client.0.smithi084.stdout:op 5844 completed, throughput=5MB/sec 2024-01-13T18:40:44.491 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-_LNOvOSnmAnMWXP off=318690 len=111962 2024-01-13T18:40:44.493 INFO:tasks.workunit.client.0.smithi084.stdout:op 5845 completed, throughput=5MB/sec 2024-01-13T18:40:44.493 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-H6mDRWHuDzotdKA off=12829038 len=1886376 2024-01-13T18:40:44.495 INFO:tasks.workunit.client.0.smithi084.stdout:op 5846 completed, throughput=5MB/sec 2024-01-13T18:40:44.495 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-i2dfkGc5owBctJP off=12658812 len=1333263 2024-01-13T18:40:44.498 INFO:tasks.workunit.client.0.smithi084.stdout:op 5847 completed, throughput=5MB/sec 2024-01-13T18:40:44.498 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-L9Yarb27fgds6q1 off=0 len=1527526 2024-01-13T18:40:44.504 INFO:tasks.workunit.client.0.smithi084.stdout:op 5848 completed, throughput=5MB/sec 2024-01-13T18:40:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:44 smithi084 ceph-mon[116404]: pgmap v2068: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:40:44.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:44 smithi084 ceph-mon[119097]: pgmap v2068: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:40:45.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:44 smithi099 ceph-mon[138788]: pgmap v2068: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2024-01-13T18:40:45.504 INFO:tasks.workunit.client.0.smithi084.stdout: 1159: throughput=5MB/sec pending data=0 2024-01-13T18:40:45.505 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-48dVWiTZToMbpY2 off=4415942 len=22466 2024-01-13T18:40:45.507 INFO:tasks.workunit.client.0.smithi084.stdout:op 5849 completed, throughput=5MB/sec 2024-01-13T18:40:45.507 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-YEeIqm2Wd1bhS4R off=3733059 len=109415 2024-01-13T18:40:45.507 INFO:tasks.workunit.client.0.smithi084.stdout:op 5850 completed, throughput=5MB/sec 2024-01-13T18:40:45.507 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VeumiTj5QR6hpD- off=4646253 len=1720270 2024-01-13T18:40:45.511 INFO:tasks.workunit.client.0.smithi084.stdout:op 5851 completed, throughput=5MB/sec 2024-01-13T18:40:45.511 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ubsgGh85JY4rWXA off=8430801 len=1171789 2024-01-13T18:40:45.517 INFO:tasks.workunit.client.0.smithi084.stdout:op 5852 completed, throughput=5MB/sec 2024-01-13T18:40:45.517 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-KI1olnCdJnoB8wR off=11169510 len=1624110 2024-01-13T18:40:45.526 INFO:tasks.workunit.client.0.smithi084.stdout:op 5853 completed, throughput=5MB/sec 2024-01-13T18:40:46.526 INFO:tasks.workunit.client.0.smithi084.stdout: 1160: throughput=5MB/sec pending data=0 2024-01-13T18:40:46.526 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-A_0s6WmIBdiumcH off=4323005 len=1674832 2024-01-13T18:40:46.528 INFO:tasks.workunit.client.0.smithi084.stdout:op 5854 completed, throughput=5MB/sec 2024-01-13T18:40:46.528 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eIUIRADj2W5Qxg5 off=1523033 len=1043811 2024-01-13T18:40:46.533 INFO:tasks.workunit.client.0.smithi084.stdout:op 5855 completed, throughput=5MB/sec 2024-01-13T18:40:46.533 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-qctQ-tuleFSvSlh off=7198553 len=962151 2024-01-13T18:40:46.538 INFO:tasks.workunit.client.0.smithi084.stdout:op 5856 completed, throughput=5MB/sec 2024-01-13T18:40:46.538 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Y03LMkcku6xUPAZ off=12295005 len=711743 2024-01-13T18:40:46.539 INFO:tasks.workunit.client.0.smithi084.stdout:op 5857 completed, throughput=5MB/sec 2024-01-13T18:40:46.539 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-sIbZWHv4r8EHJKo off=2446722 len=471585 2024-01-13T18:40:46.540 INFO:tasks.workunit.client.0.smithi084.stdout:op 5858 completed, throughput=5MB/sec 2024-01-13T18:40:46.540 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ZPKYevdhU9yIzxU off=5598796 len=371771 2024-01-13T18:40:46.543 INFO:tasks.workunit.client.0.smithi084.stdout:op 5859 completed, throughput=5MB/sec 2024-01-13T18:40:46.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:46 smithi084 ceph-mon[116404]: pgmap v2069: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:40:46.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:46 smithi084 ceph-mon[119097]: pgmap v2069: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:40:47.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:46 smithi099 ceph-mon[138788]: pgmap v2069: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 703 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:40:47.543 INFO:tasks.workunit.client.0.smithi084.stdout: 1161: throughput=5MB/sec pending data=0 2024-01-13T18:40:47.543 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ZDxxNGDhr3Hjll7 off=5372172 len=1274675 2024-01-13T18:40:47.546 INFO:tasks.workunit.client.0.smithi084.stdout:op 5860 completed, throughput=5MB/sec 2024-01-13T18:40:47.546 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7ysyOoMiqjckG-D off=9034177 len=1438791 2024-01-13T18:40:47.555 INFO:tasks.workunit.client.0.smithi084.stdout:op 5861 completed, throughput=5MB/sec 2024-01-13T18:40:47.555 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aj8s7B2BcHdj76y off=3125212 len=561187 2024-01-13T18:40:47.556 INFO:tasks.workunit.client.0.smithi084.stdout:op 5862 completed, throughput=5MB/sec 2024-01-13T18:40:47.557 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Byj9lKvm_pmPEir off=13666389 len=230807 2024-01-13T18:40:47.559 INFO:tasks.workunit.client.0.smithi084.stdout:op 5863 completed, throughput=5MB/sec 2024-01-13T18:40:47.559 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-DYBq3AHPB2b8eV2 off=14246189 len=261930 2024-01-13T18:40:47.560 INFO:tasks.workunit.client.0.smithi084.stdout:op 5864 completed, throughput=5MB/sec 2024-01-13T18:40:47.560 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bnRj3WvOeViXtOn off=3887416 len=399528 2024-01-13T18:40:47.563 INFO:tasks.workunit.client.0.smithi084.stdout:op 5865 completed, throughput=5MB/sec 2024-01-13T18:40:47.563 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-PAWPDNnnTfiE2yY off=15803105 len=958814 2024-01-13T18:40:47.567 INFO:tasks.workunit.client.0.smithi084.stdout:op 5866 completed, throughput=5MB/sec 2024-01-13T18:40:47.567 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VYJzEGoamvjC_zu off=4300215 len=1978966 2024-01-13T18:40:47.569 INFO:tasks.workunit.client.0.smithi084.stdout:op 5867 completed, throughput=5MB/sec 2024-01-13T18:40:48.569 INFO:tasks.workunit.client.0.smithi084.stdout: 1162: throughput=5MB/sec pending data=0 2024-01-13T18:40:48.570 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-iXw_Zj1_nlfAS8_ off=8847942 len=1507545 2024-01-13T18:40:48.579 INFO:tasks.workunit.client.0.smithi084.stdout:op 5868 completed, throughput=5MB/sec 2024-01-13T18:40:48.579 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-k6rJEfmVOXhxqc5 off=5876043 len=1490418 2024-01-13T18:40:48.586 INFO:tasks.workunit.client.0.smithi084.stdout:op 5869 completed, throughput=5MB/sec 2024-01-13T18:40:48.586 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-XgPFnrQN8gxY9Lo off=5561986 len=1417830 2024-01-13T18:40:48.588 INFO:tasks.workunit.client.0.smithi084.stdout:op 5870 completed, throughput=5MB/sec 2024-01-13T18:40:49.589 INFO:tasks.workunit.client.0.smithi084.stdout: 1163: throughput=5MB/sec pending data=0 2024-01-13T18:40:49.589 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-TUMJ-c_gNOlyDi1 off=5258445 len=1152190 2024-01-13T18:40:49.590 INFO:tasks.workunit.client.0.smithi084.stdout:op 5871 completed, throughput=5MB/sec 2024-01-13T18:40:49.590 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lIZPebtqzNvT6bx off=6529064 len=309562 2024-01-13T18:40:49.592 INFO:tasks.workunit.client.0.smithi084.stdout:op 5872 completed, throughput=5MB/sec 2024-01-13T18:40:49.592 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-nY4yY5Bqqp9Nz2- off=2654295 len=1717541 2024-01-13T18:40:49.594 INFO:tasks.workunit.client.0.smithi084.stdout:op 5873 completed, throughput=5MB/sec 2024-01-13T18:40:49.594 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-lIHQeznm6obtM_R off=4885005 len=848961 2024-01-13T18:40:49.595 INFO:tasks.workunit.client.0.smithi084.stdout:op 5874 completed, throughput=5MB/sec 2024-01-13T18:40:49.595 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8yIY5l3sNfeHTmB off=22054984 len=337782 2024-01-13T18:40:49.599 INFO:tasks.workunit.client.0.smithi084.stdout:op 5875 completed, throughput=5MB/sec 2024-01-13T18:40:49.599 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-rlVxI-qw0-YhbY3 off=1865481 len=425706 2024-01-13T18:40:49.602 INFO:tasks.workunit.client.0.smithi084.stdout:op 5876 completed, throughput=5MB/sec 2024-01-13T18:40:49.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:49 smithi084 ceph-mon[116404]: pgmap v2070: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:40:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:49 smithi084 ceph-mon[119097]: pgmap v2070: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:40:49.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:49 smithi099 ceph-mon[138788]: pgmap v2070: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 5 op/s 2024-01-13T18:40:50.603 INFO:tasks.workunit.client.0.smithi084.stdout: 1164: throughput=5MB/sec pending data=0 2024-01-13T18:40:50.603 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-am3vEkDcq_ow_wQ off=8606237 len=1245891 2024-01-13T18:40:50.610 INFO:tasks.workunit.client.0.smithi084.stdout:op 5877 completed, throughput=5MB/sec 2024-01-13T18:40:50.610 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-bFa31nqpDsPYjDK off=10310301 len=1518258 2024-01-13T18:40:50.618 INFO:tasks.workunit.client.0.smithi084.stdout:op 5878 completed, throughput=5MB/sec 2024-01-13T18:40:50.618 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-foXVe5WUoU6JfgY off=1732030 len=361894 2024-01-13T18:40:50.621 INFO:tasks.workunit.client.0.smithi084.stdout:op 5879 completed, throughput=5MB/sec 2024-01-13T18:40:50.621 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-GPeu3MmP_39qi7X off=245861 len=172597 2024-01-13T18:40:50.622 INFO:tasks.workunit.client.0.smithi084.stdout:op 5880 completed, throughput=5MB/sec 2024-01-13T18:40:50.622 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-udcHpVMAWXiBmDJ off=777716 len=894696 2024-01-13T18:40:50.625 INFO:tasks.workunit.client.0.smithi084.stdout:op 5881 completed, throughput=5MB/sec 2024-01-13T18:40:50.626 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lGWW9XYbi8KXawO off=6531630 len=1024635 2024-01-13T18:40:50.630 INFO:tasks.workunit.client.0.smithi084.stdout:op 5882 completed, throughput=5MB/sec 2024-01-13T18:40:50.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:40:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:40:50] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:40:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:40:51.630 INFO:tasks.workunit.client.0.smithi084.stdout: 1165: throughput=5MB/sec pending data=0 2024-01-13T18:40:51.631 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-jgevN-5JbBlw62V off=6846263 len=1679839 2024-01-13T18:40:51.637 INFO:tasks.workunit.client.0.smithi084.stdout:op 5883 completed, throughput=5MB/sec 2024-01-13T18:40:51.637 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tfOgdnMAFFlRkwo off=11960327 len=1015170 2024-01-13T18:40:51.638 INFO:tasks.workunit.client.0.smithi084.stdout:op 5884 completed, throughput=5MB/sec 2024-01-13T18:40:51.638 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-7MwWtmObt3xqYlX off=1065276 len=1084484 2024-01-13T18:40:51.644 INFO:tasks.workunit.client.0.smithi084.stdout:op 5885 completed, throughput=5MB/sec 2024-01-13T18:40:51.644 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-EQeUCCiO7lkq4r6 off=15958234 len=1559959 2024-01-13T18:40:51.646 INFO:tasks.workunit.client.0.smithi084.stdout:op 5886 completed, throughput=5MB/sec 2024-01-13T18:40:51.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:51 smithi084 ceph-mon[119097]: pgmap v2071: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 6 op/s 2024-01-13T18:40:51.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:51 smithi084 ceph-mon[116404]: pgmap v2071: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 6 op/s 2024-01-13T18:40:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:51 smithi099 ceph-mon[138788]: pgmap v2071: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 6 op/s 2024-01-13T18:40:52.647 INFO:tasks.workunit.client.0.smithi084.stdout: 1166: throughput=5MB/sec pending data=0 2024-01-13T18:40:52.647 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-F6ZMhQwbhXJ6buH off=3839165 len=958882 2024-01-13T18:40:52.648 INFO:tasks.workunit.client.0.smithi084.stdout:op 5887 completed, throughput=5MB/sec 2024-01-13T18:40:52.648 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pE4JFm92lqZ27To off=10318804 len=470426 2024-01-13T18:40:52.649 INFO:tasks.workunit.client.0.smithi084.stdout:op 5888 completed, throughput=5MB/sec 2024-01-13T18:40:52.649 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-VPoTZ-lJsnwoBPY off=15494434 len=372099 2024-01-13T18:40:52.651 INFO:tasks.workunit.client.0.smithi084.stdout:op 5889 completed, throughput=5MB/sec 2024-01-13T18:40:52.651 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5-dSrObXrmcXP-F off=1065874 len=1666326 2024-01-13T18:40:52.652 INFO:tasks.workunit.client.0.smithi084.stdout:op 5890 completed, throughput=5MB/sec 2024-01-13T18:40:52.653 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-o_M09BvxBRtqMG6 off=5757085 len=1793783 2024-01-13T18:40:52.654 INFO:tasks.workunit.client.0.smithi084.stdout:op 5891 completed, throughput=5MB/sec 2024-01-13T18:40:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:52 smithi084 ceph-mon[116404]: pgmap v2072: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:40:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:52 smithi084 ceph-mon[119097]: pgmap v2072: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:40:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:52 smithi099 ceph-mon[138788]: pgmap v2072: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 4 op/s 2024-01-13T18:40:53.655 INFO:tasks.workunit.client.0.smithi084.stdout: 1167: throughput=5MB/sec pending data=0 2024-01-13T18:40:53.655 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-C0CyQbGhWehGoqR off=14460967 len=1026776 2024-01-13T18:40:53.656 INFO:tasks.workunit.client.0.smithi084.stdout:op 5892 completed, throughput=5MB/sec 2024-01-13T18:40:53.656 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-h8xmFO6hfZPHQfr off=2259049 len=83700 2024-01-13T18:40:53.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 5893 completed, throughput=5MB/sec 2024-01-13T18:40:53.659 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-hu10-7aAx9knMBp off=12209680 len=741288 2024-01-13T18:40:53.659 INFO:tasks.workunit.client.0.smithi084.stdout:op 5894 completed, throughput=5MB/sec 2024-01-13T18:40:53.659 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Xd7zG0nE6YrkmSf off=3304551 len=236278 2024-01-13T18:40:53.660 INFO:tasks.workunit.client.0.smithi084.stdout:op 5895 completed, throughput=5MB/sec 2024-01-13T18:40:53.660 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-dCpPTskWOaXB-CZ off=11838052 len=1201881 2024-01-13T18:40:53.662 INFO:tasks.workunit.client.0.smithi084.stdout:op 5896 completed, throughput=5MB/sec 2024-01-13T18:40:53.662 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-zrQOZXp1HXKdm4T off=8687492 len=578934 2024-01-13T18:40:53.667 INFO:tasks.workunit.client.0.smithi084.stdout:op 5897 completed, throughput=5MB/sec 2024-01-13T18:40:53.667 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-GdXFYtxZ0fe-6Na off=1508126 len=1866483 2024-01-13T18:40:53.675 INFO:tasks.workunit.client.0.smithi084.stdout:op 5898 completed, throughput=5MB/sec 2024-01-13T18:40:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: 1168: throughput=5MB/sec pending data=0 2024-01-13T18:40:54.676 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-6O9gvADJNKwnsQb off=5123127 len=1190724 2024-01-13T18:40:54.677 INFO:tasks.workunit.client.0.smithi084.stdout:op 5899 completed, throughput=5MB/sec 2024-01-13T18:40:54.677 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-aj8s7B2BcHdj76y off=5738118 len=1868393 2024-01-13T18:40:54.688 INFO:tasks.workunit.client.0.smithi084.stdout:op 5900 completed, throughput=5MB/sec 2024-01-13T18:40:54.689 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-_rdUlRdys4XYXN0 off=3051013 len=1165362 2024-01-13T18:40:54.691 INFO:tasks.workunit.client.0.smithi084.stdout:op 5901 completed, throughput=5MB/sec 2024-01-13T18:40:54.691 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-xIRHqfInflWrNOj off=2218932 len=562417 2024-01-13T18:40:54.694 INFO:tasks.workunit.client.0.smithi084.stdout:op 5902 completed, throughput=5MB/sec 2024-01-13T18:40:54.694 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WmIEAkmu_mTSS6x off=15110799 len=1382792 2024-01-13T18:40:54.701 INFO:tasks.workunit.client.0.smithi084.stdout:op 5903 completed, throughput=5MB/sec 2024-01-13T18:40:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:54 smithi084 ceph-mon[116404]: pgmap v2073: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:40:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:54 smithi084 ceph-mon[119097]: pgmap v2073: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:40:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:54 smithi099 ceph-mon[138788]: pgmap v2073: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 4 op/s 2024-01-13T18:40:55.701 INFO:tasks.workunit.client.0.smithi084.stdout: 1169: throughput=5MB/sec pending data=0 2024-01-13T18:40:55.702 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-8fgdIDD4XzJwn3U off=4286993 len=1485815 2024-01-13T18:40:55.703 INFO:tasks.workunit.client.0.smithi084.stdout:op 5904 completed, throughput=5MB/sec 2024-01-13T18:40:55.703 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-zbwyiQoKec_nON1 off=3415949 len=1596310 2024-01-13T18:40:55.705 INFO:tasks.workunit.client.0.smithi084.stdout:op 5905 completed, throughput=5MB/sec 2024-01-13T18:40:55.705 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-kRjU9jTpn0hRgGU off=198234 len=1158844 2024-01-13T18:40:55.711 INFO:tasks.workunit.client.0.smithi084.stdout:op 5906 completed, throughput=5MB/sec 2024-01-13T18:40:56.711 INFO:tasks.workunit.client.0.smithi084.stdout: 1170: throughput=5MB/sec pending data=0 2024-01-13T18:40:56.711 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-d8TrkRORgz6ANiq off=10329480 len=162825 2024-01-13T18:40:56.714 INFO:tasks.workunit.client.0.smithi084.stdout:op 5907 completed, throughput=5MB/sec 2024-01-13T18:40:56.714 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-iWIk2CdX1qA_j0t off=3454287 len=159262 2024-01-13T18:40:56.714 INFO:tasks.workunit.client.0.smithi084.stdout:op 5908 completed, throughput=5MB/sec 2024-01-13T18:40:56.715 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tVraEahrYuz1f0e off=766353 len=603504 2024-01-13T18:40:56.716 INFO:tasks.workunit.client.0.smithi084.stdout:op 5909 completed, throughput=5MB/sec 2024-01-13T18:40:56.716 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-xr4hmwxHitbThND off=6362253 len=866303 2024-01-13T18:40:56.717 INFO:tasks.workunit.client.0.smithi084.stdout:op 5910 completed, throughput=5MB/sec 2024-01-13T18:40:56.717 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-9RcERWeSeKIFor1 off=4437282 len=1848646 2024-01-13T18:40:56.720 INFO:tasks.workunit.client.0.smithi084.stdout:op 5911 completed, throughput=5MB/sec 2024-01-13T18:40:56.720 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-WyCSD_rH-u84W2Z off=1219402 len=307916 2024-01-13T18:40:56.723 INFO:tasks.workunit.client.0.smithi084.stdout:op 5912 completed, throughput=5MB/sec 2024-01-13T18:40:56.723 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Yr7Xnjsa2bUn0nC off=7085097 len=661334 2024-01-13T18:40:56.727 INFO:tasks.workunit.client.0.smithi084.stdout:op 5913 completed, throughput=5MB/sec 2024-01-13T18:40:56.727 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-kRjU9jTpn0hRgGU off=4087846 len=1274786 2024-01-13T18:40:56.729 INFO:tasks.workunit.client.0.smithi084.stdout:op 5914 completed, throughput=5MB/sec 2024-01-13T18:40:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:56 smithi084 ceph-mon[116404]: pgmap v2074: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:56.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:56 smithi084 ceph-mon[119097]: pgmap v2074: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:56 smithi099 ceph-mon[138788]: pgmap v2074: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 4 op/s 2024-01-13T18:40:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: 1171: throughput=5MB/sec pending data=0 2024-01-13T18:40:57.729 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-2Dy4fQLcjBY1d4B off=8808086 len=1143799 2024-01-13T18:40:57.731 INFO:tasks.workunit.client.0.smithi084.stdout:op 5915 completed, throughput=5MB/sec 2024-01-13T18:40:57.731 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-f0QotdTkdG9osEj off=7965298 len=1312299 2024-01-13T18:40:57.732 INFO:tasks.workunit.client.0.smithi084.stdout:op 5916 completed, throughput=5MB/sec 2024-01-13T18:40:57.732 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-yV6ShHGnLgeRYRh off=13455069 len=476008 2024-01-13T18:40:57.734 INFO:tasks.workunit.client.0.smithi084.stdout:op 5917 completed, throughput=5MB/sec 2024-01-13T18:40:57.734 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-tihNig6NLxnCtDj off=3819238 len=864728 2024-01-13T18:40:57.739 INFO:tasks.workunit.client.0.smithi084.stdout:op 5918 completed, throughput=5MB/sec 2024-01-13T18:40:57.739 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-pF5hVGKhFlnvr8w off=10070049 len=5089 2024-01-13T18:40:57.742 INFO:tasks.workunit.client.0.smithi084.stdout:op 5919 completed, throughput=5MB/sec 2024-01-13T18:40:57.742 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-tmubBS9FcmuDync off=2578890 len=985117 2024-01-13T18:40:57.743 INFO:tasks.workunit.client.0.smithi084.stdout:op 5920 completed, throughput=5MB/sec 2024-01-13T18:40:58.743 INFO:tasks.workunit.client.0.smithi084.stdout: 1172: throughput=5MB/sec pending data=0 2024-01-13T18:40:58.743 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-jLVGxTs4eUHyPpD off=590267 len=1960429 2024-01-13T18:40:58.745 INFO:tasks.workunit.client.0.smithi084.stdout:op 5921 completed, throughput=5MB/sec 2024-01-13T18:40:58.745 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-JoyBXgT5OLPkDPB off=8079631 len=1207567 2024-01-13T18:40:58.752 INFO:tasks.workunit.client.0.smithi084.stdout:op 5922 completed, throughput=5MB/sec 2024-01-13T18:40:58.752 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-eNBT1LTy5QpIGnA off=13074913 len=1057488 2024-01-13T18:40:58.758 INFO:tasks.workunit.client.0.smithi084.stdout:op 5923 completed, throughput=5MB/sec 2024-01-13T18:40:58.758 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-NSrTSKtXYpigkce off=8106009 len=1485708 2024-01-13T18:40:58.759 INFO:tasks.workunit.client.0.smithi084.stdout:op 5924 completed, throughput=5MB/sec 2024-01-13T18:40:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:40:59 smithi084 ceph-mon[116404]: pgmap v2075: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:40:59.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:40:59 smithi084 ceph-mon[119097]: pgmap v2075: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:40:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: 1173: throughput=5MB/sec pending data=0 2024-01-13T18:40:59.760 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-lslyPBGPpsYb2y- off=1875523 len=1162221 2024-01-13T18:40:59.767 INFO:tasks.workunit.client.0.smithi084.stdout:op 5925 completed, throughput=5MB/sec 2024-01-13T18:40:59.768 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FjtU08yf9HO24cW off=14897841 len=1752254 2024-01-13T18:40:59.769 INFO:tasks.workunit.client.0.smithi084.stdout:op 5926 completed, throughput=5MB/sec 2024-01-13T18:40:59.769 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-Bs7Skj3apuVeXwk off=9606496 len=1344329 2024-01-13T18:40:59.776 INFO:tasks.workunit.client.0.smithi084.stdout:op 5927 completed, throughput=5MB/sec 2024-01-13T18:40:59.776 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-FGUPRcOUP5L2JLY off=4408633 len=479270 2024-01-13T18:40:59.779 INFO:tasks.workunit.client.0.smithi084.stdout:op 5928 completed, throughput=5MB/sec 2024-01-13T18:40:59.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:40:59 smithi099 ceph-mon[138788]: pgmap v2075: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-01-13T18:41:00.672 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:41:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:41:00] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:41:00.779 INFO:tasks.workunit.client.0.smithi084.stdout: 1174: throughput=5MB/sec pending data=0 2024-01-13T18:41:00.779 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-r2_BtBeTleZAde1 off=392347 len=847773 2024-01-13T18:41:00.781 INFO:tasks.workunit.client.0.smithi084.stdout:op 5929 completed, throughput=5MB/sec 2024-01-13T18:41:00.781 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-D_WRiB41fQeWTbc off=3414010 len=452339 2024-01-13T18:41:00.782 INFO:tasks.workunit.client.0.smithi084.stdout:op 5930 completed, throughput=5MB/sec 2024-01-13T18:41:00.782 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-8OBYPsZfV8U2r1v off=17228075 len=1071458 2024-01-13T18:41:00.788 INFO:tasks.workunit.client.0.smithi084.stdout:op 5931 completed, throughput=5MB/sec 2024-01-13T18:41:00.789 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-FGUPRcOUP5L2JLY off=4404696 len=29943 2024-01-13T18:41:00.790 INFO:tasks.workunit.client.0.smithi084.stdout:op 5932 completed, throughput=5MB/sec 2024-01-13T18:41:00.791 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eyt3oNf2L8YxHg2 off=14315837 len=1335014 2024-01-13T18:41:00.792 INFO:tasks.workunit.client.0.smithi084.stdout:op 5933 completed, throughput=5MB/sec 2024-01-13T18:41:00.792 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-V19S0Xt-pAAO4xy off=6284261 len=1126063 2024-01-13T18:41:00.793 INFO:tasks.workunit.client.0.smithi084.stdout:op 5934 completed, throughput=5MB/sec 2024-01-13T18:41:00.793 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-OpB3xOWS_IRbz62 off=1184840 len=1968733 2024-01-13T18:41:00.795 INFO:tasks.workunit.client.0.smithi084.stdout:op 5935 completed, throughput=5MB/sec 2024-01-13T18:41:00.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:00 smithi084 ceph-mon[119097]: pgmap v2076: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:41:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:00 smithi084 ceph-mon[116404]: pgmap v2076: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:41:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:00 smithi099 ceph-mon[138788]: pgmap v2076: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.9 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:41:01.796 INFO:tasks.workunit.client.0.smithi084.stdout: 1175: throughput=5MB/sec pending data=0 2024-01-13T18:41:01.796 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-3ed_M_2uYvGSZzh off=12963104 len=836745 2024-01-13T18:41:01.797 INFO:tasks.workunit.client.0.smithi084.stdout:op 5936 completed, throughput=5MB/sec 2024-01-13T18:41:01.797 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-F3D7GVxwE_Us0tc off=1587031 len=2046740 2024-01-13T18:41:01.807 INFO:tasks.workunit.client.0.smithi084.stdout:op 5937 completed, throughput=5MB/sec 2024-01-13T18:41:01.808 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-eUxfYXpsqk0Q_5u off=3908886 len=323497 2024-01-13T18:41:01.808 INFO:tasks.workunit.client.0.smithi084.stdout:op 5938 completed, throughput=5MB/sec 2024-01-13T18:41:01.808 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-IPVyO8FOiTFFutE off=953998 len=54934 2024-01-13T18:41:01.811 INFO:tasks.workunit.client.0.smithi084.stdout:op 5939 completed, throughput=5MB/sec 2024-01-13T18:41:01.811 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-ExikCNTyb7QlBVp off=22593139 len=1871071 2024-01-13T18:41:01.820 INFO:tasks.workunit.client.0.smithi084.stdout:op 5940 completed, throughput=5MB/sec 2024-01-13T18:41:02.820 INFO:tasks.workunit.client.0.smithi084.stdout: 1176: throughput=5MB/sec pending data=0 2024-01-13T18:41:02.821 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-UwSVK-bdHuY9Onw off=798765 len=2076730 2024-01-13T18:41:02.823 INFO:tasks.workunit.client.0.smithi084.stdout:op 5941 completed, throughput=5MB/sec 2024-01-13T18:41:02.823 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-Qv4jETdPC0e66JA off=9335100 len=245897 2024-01-13T18:41:02.823 INFO:tasks.workunit.client.0.smithi084.stdout:op 5942 completed, throughput=5MB/sec 2024-01-13T18:41:02.824 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-OS5vvG-1dRhjeTT off=2759876 len=1125215 2024-01-13T18:41:02.829 INFO:tasks.workunit.client.0.smithi084.stdout:op 5943 completed, throughput=5MB/sec 2024-01-13T18:41:02.829 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-41MTlKQjbTncfVY off=4354727 len=324491 2024-01-13T18:41:02.830 INFO:tasks.workunit.client.0.smithi084.stdout:op 5944 completed, throughput=5MB/sec 2024-01-13T18:41:02.830 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-pl-xyKInO0quGC4 off=21886577 len=1740804 2024-01-13T18:41:02.832 INFO:tasks.workunit.client.0.smithi084.stdout:op 5945 completed, throughput=5MB/sec 2024-01-13T18:41:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:02 smithi084 ceph-mon[119097]: pgmap v2077: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 4 op/s 2024-01-13T18:41:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:02 smithi084 ceph-mon[116404]: pgmap v2077: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 4 op/s 2024-01-13T18:41:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:02 smithi099 ceph-mon[138788]: pgmap v2077: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 4 op/s 2024-01-13T18:41:03.832 INFO:tasks.workunit.client.0.smithi084.stdout: 1177: throughput=5MB/sec pending data=0 2024-01-13T18:41:03.833 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-y4ikjHl6oIMAg0j off=8963897 len=6197 2024-01-13T18:41:03.833 INFO:tasks.workunit.client.0.smithi084.stdout:op 5946 completed, throughput=5MB/sec 2024-01-13T18:41:03.833 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-5ctJEe8WS8Xy4mb off=181848 len=2082588 2024-01-13T18:41:03.836 INFO:tasks.workunit.client.0.smithi084.stdout:op 5947 completed, throughput=5MB/sec 2024-01-13T18:41:03.836 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-aoMHzmgTBlwN8nZ off=2600583 len=131805 2024-01-13T18:41:03.836 INFO:tasks.workunit.client.0.smithi084.stdout:op 5948 completed, throughput=5MB/sec 2024-01-13T18:41:03.837 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-2SNxyYpbSgy7smp off=2247277 len=1085241 2024-01-13T18:41:03.842 INFO:tasks.workunit.client.0.smithi084.stdout:op 5949 completed, throughput=5MB/sec 2024-01-13T18:41:03.842 INFO:tasks.workunit.client.0.smithi084.stdout:READ : oid=obj-ifoqBegaW2JxXs9 off=19269188 len=386838 2024-01-13T18:41:03.842 INFO:tasks.workunit.client.0.smithi084.stdout:op 5950 completed, throughput=5MB/sec 2024-01-13T18:41:03.842 INFO:tasks.workunit.client.0.smithi084.stdout:WRITE : oid=obj-przKnsIgzxCgv14 off=4977288 len=1169120 2024-01-13T18:41:03.848 INFO:tasks.workunit.client.0.smithi084.stdout:op 5951 completed, throughput=5MB/sec 2024-01-13T18:41:04.849 INFO:tasks.workunit.client.0.smithi084.stdout:waiting for all operations to complete 2024-01-13T18:41:04.849 INFO:tasks.workunit.client.0.smithi084.stdout:cleaning up objects 2024-01-13T18:41:04.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:04 smithi084 ceph-mon[119097]: pgmap v2078: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:41:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:04 smithi084 ceph-mon[116404]: pgmap v2078: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:41:05.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:04 smithi099 ceph-mon[138788]: pgmap v2078: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 5 op/s 2024-01-13T18:41:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:06 smithi099 ceph-mon[138788]: pgmap v2079: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:41:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:06 smithi084 ceph-mon[116404]: pgmap v2079: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:41:07.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:06 smithi084 ceph-mon[119097]: pgmap v2079: 105 pgs: 105 active+clean; 128 GiB data, 13 GiB used, 702 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 5 op/s 2024-01-13T18:41:09.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:09 smithi084 ceph-mon[116404]: pgmap v2080: 105 pgs: 105 active+clean; 121 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.6 MiB/s wr, 53 op/s 2024-01-13T18:41:09.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:09 smithi084 ceph-mon[119097]: pgmap v2080: 105 pgs: 105 active+clean; 121 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.6 MiB/s wr, 53 op/s 2024-01-13T18:41:09.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:09 smithi099 ceph-mon[138788]: pgmap v2080: 105 pgs: 105 active+clean; 121 GiB data, 12 GiB used, 703 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.6 MiB/s wr, 53 op/s 2024-01-13T18:41:10.671 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:41:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:41:10] "GET /metrics HTTP/1.1" 200 33996 "" "Prometheus/2.43.0" 2024-01-13T18:41:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:10 smithi084 ceph-mon[116404]: pgmap v2081: 105 pgs: 105 active+clean; 98 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-01-13T18:41:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:10 smithi084 ceph-mon[119097]: pgmap v2081: 105 pgs: 105 active+clean; 98 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-01-13T18:41:11.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:10 smithi099 ceph-mon[138788]: pgmap v2081: 105 pgs: 105 active+clean; 98 GiB data, 12 GiB used, 704 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-01-13T18:41:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:12 smithi084 ceph-mon[116404]: pgmap v2082: 105 pgs: 105 active+clean; 88 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 271 op/s 2024-01-13T18:41:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:12 smithi084 ceph-mon[119097]: pgmap v2082: 105 pgs: 105 active+clean; 88 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 271 op/s 2024-01-13T18:41:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:12 smithi099 ceph-mon[138788]: pgmap v2082: 105 pgs: 105 active+clean; 88 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 271 op/s 2024-01-13T18:41:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:14 smithi084 ceph-mon[116404]: pgmap v2083: 105 pgs: 105 active+clean; 68 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 405 op/s 2024-01-13T18:41:14.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:14 smithi084 ceph-mon[119097]: pgmap v2083: 105 pgs: 105 active+clean; 68 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 405 op/s 2024-01-13T18:41:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:14 smithi099 ceph-mon[138788]: pgmap v2083: 105 pgs: 105 active+clean; 68 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 405 op/s 2024-01-13T18:41:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:16 smithi084 ceph-mon[116404]: pgmap v2084: 105 pgs: 105 active+clean; 58 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 594 KiB/s rd, 354 KiB/s wr, 469 op/s 2024-01-13T18:41:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:16 smithi084 ceph-mon[119097]: pgmap v2084: 105 pgs: 105 active+clean; 58 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 594 KiB/s rd, 354 KiB/s wr, 469 op/s 2024-01-13T18:41:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:16 smithi099 ceph-mon[138788]: pgmap v2084: 105 pgs: 105 active+clean; 58 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 594 KiB/s rd, 354 KiB/s wr, 469 op/s 2024-01-13T18:41:19.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:19 smithi084 ceph-mon[116404]: pgmap v2085: 105 pgs: 105 active+clean; 44 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 354 KiB/s rd, 350 KiB/s wr, 561 op/s 2024-01-13T18:41:19.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:19 smithi084 ceph-mon[119097]: pgmap v2085: 105 pgs: 105 active+clean; 44 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 354 KiB/s rd, 350 KiB/s wr, 561 op/s 2024-01-13T18:41:19.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:19 smithi099 ceph-mon[138788]: pgmap v2085: 105 pgs: 105 active+clean; 44 GiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 354 KiB/s rd, 350 KiB/s wr, 561 op/s 2024-01-13T18:41:20.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:41:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:41:20] "GET /metrics HTTP/1.1" 200 33990 "" "Prometheus/2.43.0" 2024-01-13T18:41:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:21.389 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:41:21.389 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:41:21.460 INFO:tasks.workunit:Stopping ['rados/load-gen-big.sh'] on client.0... 2024-01-13T18:41:21.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-13T18:41:21.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:21 smithi084 ceph-mon[116404]: pgmap v2086: 105 pgs: 105 active+clean; 22 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 169 KiB/s rd, 0 B/s wr, 662 op/s 2024-01-13T18:41:21.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:21 smithi084 ceph-mon[119097]: pgmap v2086: 105 pgs: 105 active+clean; 22 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 169 KiB/s rd, 0 B/s wr, 662 op/s 2024-01-13T18:41:21.699 DEBUG:teuthology.parallel:result is None 2024-01-13T18:41:21.700 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:41:21.728 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:41:21.728 DEBUG:teuthology.orchestra.run.smithi084:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:41:21.786 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:41:21.787 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-01-13T18:41:21.787 INFO:teuthology.task.print:**** done end rados_loadgenbig.yaml 2024-01-13T18:41:21.787 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-01-13T18:41:21.787 INFO:teuthology.task.print:**** done start rbd_import_export.yaml 2024-01-13T18:41:21.787 INFO:teuthology.task.full_sequential:In full_sequential, running task workunit... 2024-01-13T18:41:21.788 INFO:tasks.workunit:Pulling workunits from ref quincy 2024-01-13T18:41:21.788 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-13T18:41:21.788 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.1 2024-01-13T18:41:21.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T18:41:21.808 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-01-13T18:41:21.808 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.1 2024-01-13T18:41:21.866 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.1 2024-01-13T18:41:21.866 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.1 && mkdir -- client.1 2024-01-13T18:41:21.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:21 smithi099 ceph-mon[138788]: pgmap v2086: 105 pgs: 105 active+clean; 22 GiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 169 KiB/s rd, 0 B/s wr, 662 op/s 2024-01-13T18:41:21.883 INFO:tasks.workunit:timeout=3h 2024-01-13T18:41:21.883 INFO:tasks.workunit:cleanup=True 2024-01-13T18:41:21.884 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone --depth 1 --branch quincy https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 2024-01-13T18:41:21.944 INFO:tasks.workunit.client.1.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-01-13T18:41:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:22 smithi084 ceph-mon[116404]: pgmap v2087: 105 pgs: 105 active+clean; 14 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 563 op/s 2024-01-13T18:41:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:22 smithi084 ceph-mon[119097]: pgmap v2087: 105 pgs: 105 active+clean; 14 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 563 op/s 2024-01-13T18:41:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:22 smithi099 ceph-mon[138788]: pgmap v2087: 105 pgs: 105 active+clean; 14 GiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 0 B/s wr, 563 op/s 2024-01-13T18:41:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:24 smithi084 ceph-mon[119097]: pgmap v2088: 105 pgs: 105 active+clean; 3.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 565 op/s 2024-01-13T18:41:24.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:24 smithi084 ceph-mon[116404]: pgmap v2088: 105 pgs: 105 active+clean; 3.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 565 op/s 2024-01-13T18:41:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:24 smithi099 ceph-mon[138788]: pgmap v2088: 105 pgs: 105 active+clean; 3.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 565 op/s 2024-01-13T18:41:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:26 smithi084 ceph-mon[116404]: pgmap v2089: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 450 op/s 2024-01-13T18:41:26.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:26 smithi084 ceph-mon[119097]: pgmap v2089: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 450 op/s 2024-01-13T18:41:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:26 smithi099 ceph-mon[138788]: pgmap v2089: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 450 op/s 2024-01-13T18:41:28.112 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-01-13T18:41:28.186 INFO:tasks.workunit.client.1.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-13T18:41:28.187 INFO:tasks.workunit.client.1.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-01-13T18:41:28.188 INFO:tasks.workunit.client.1.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-13T18:41:28.715 INFO:tasks.workunit.client.1.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-13T18:41:28.774 INFO:tasks.workunit.client.1.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-13T18:41:28.812 INFO:tasks.workunit.client.1.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-01-13T18:41:28.813 INFO:tasks.workunit.client.1.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-01-13T18:41:28.813 INFO:tasks.workunit.client.1.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-13T18:41:28.849 INFO:tasks.workunit.client.1.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-01-13T18:41:28.852 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-13T18:41:28.853 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-01-13T18:41:28.911 INFO:tasks.workunit:Running workunits matching rbd/import_export.sh on client.1... 2024-01-13T18:41:28.913 INFO:tasks.workunit:Running workunit rbd/import_export.sh... 2024-01-13T18:41:28.913 DEBUG:teuthology.orchestra.run.smithi099:workunit test rbd/import_export.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 RBD_CREATE_ARGS=--new-format adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/rbd/import_export.sh 2024-01-13T18:41:28.984 INFO:tasks.workunit.client.1.smithi099.stderr:+ export RBD_FORCE_ALLOW_V1=1 2024-01-13T18:41:28.985 INFO:tasks.workunit.client.1.smithi099.stderr:+ RBD_FORCE_ALLOW_V1=1 2024-01-13T18:41:28.985 INFO:tasks.workunit.client.1.smithi099.stderr:+ TMPDIR=/tmp/rbd_import_export_200797 2024-01-13T18:41:28.985 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm -rf /tmp/rbd_import_export_200797 2024-01-13T18:41:28.985 INFO:tasks.workunit.client.1.smithi099.stderr:+ mkdir /tmp/rbd_import_export_200797 2024-01-13T18:41:28.986 INFO:tasks.workunit.client.1.smithi099.stderr:+ trap 'rm -rf /tmp/rbd_import_export_200797' INT TERM EXIT 2024-01-13T18:41:28.986 INFO:tasks.workunit.client.1.smithi099.stderr:+ mkdir foo.200797 2024-01-13T18:41:28.986 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import foo.200797 foo.dir 2024-01-13T18:41:29.016 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: cannot import a directory 2024-01-13T18:41:29.016 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 0% complete...failed. 2024-01-13T18:41:29.016 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: import failed: (21) Is a directory 2024-01-13T18:41:29.018 INFO:tasks.workunit.client.1.smithi099.stderr:+ true 2024-01-13T18:41:29.018 INFO:tasks.workunit.client.1.smithi099.stderr:+ rmdir foo.200797 2024-01-13T18:41:29.027 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/bin/sh of=/tmp/rbd_import_export_200797/img bs=1k count=1 seek=10 2024-01-13T18:41:29.028 INFO:tasks.workunit.client.1.smithi099.stderr:1+0 records in 2024-01-13T18:41:29.028 INFO:tasks.workunit.client.1.smithi099.stderr:1+0 records out 2024-01-13T18:41:29.028 INFO:tasks.workunit.client.1.smithi099.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 3.8053e-05 s, 26.9 MB/s 2024-01-13T18:41:29.028 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/bin/dd of=/tmp/rbd_import_export_200797/img bs=1k count=10 seek=100 2024-01-13T18:41:29.029 INFO:tasks.workunit.client.1.smithi099.stderr:10+0 records in 2024-01-13T18:41:29.029 INFO:tasks.workunit.client.1.smithi099.stderr:10+0 records out 2024-01-13T18:41:29.029 INFO:tasks.workunit.client.1.smithi099.stderr:10240 bytes (10 kB, 10 KiB) copied, 4.9928e-05 s, 205 MB/s 2024-01-13T18:41:29.029 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/bin/rm of=/tmp/rbd_import_export_200797/img bs=1k count=100 seek=1000 2024-01-13T18:41:29.030 INFO:tasks.workunit.client.1.smithi099.stderr:70+1 records in 2024-01-13T18:41:29.030 INFO:tasks.workunit.client.1.smithi099.stderr:70+1 records out 2024-01-13T18:41:29.030 INFO:tasks.workunit.client.1.smithi099.stderr:72208 bytes (72 kB, 71 KiB) copied, 0.000184024 s, 392 MB/s 2024-01-13T18:41:29.030 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/bin/ls of=/tmp/rbd_import_export_200797/img bs=1k seek=10000 2024-01-13T18:41:29.031 INFO:tasks.workunit.client.1.smithi099.stderr:140+1 records in 2024-01-13T18:41:29.031 INFO:tasks.workunit.client.1.smithi099.stderr:140+1 records out 2024-01-13T18:41:29.031 INFO:tasks.workunit.client.1.smithi099.stderr:143376 bytes (143 kB, 140 KiB) copied, 0.000311196 s, 461 MB/s 2024-01-13T18:41:29.031 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/bin/ln of=/tmp/rbd_import_export_200797/img bs=1k seek=100000 2024-01-13T18:41:29.032 INFO:tasks.workunit.client.1.smithi099.stderr:70+1 records in 2024-01-13T18:41:29.032 INFO:tasks.workunit.client.1.smithi099.stderr:70+1 records out 2024-01-13T18:41:29.032 INFO:tasks.workunit.client.1.smithi099.stderr:72312 bytes (72 kB, 71 KiB) copied, 0.000183797 s, 393 MB/s 2024-01-13T18:41:29.032 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/bin/grep of=/tmp/rbd_import_export_200797/img bs=1k seek=1000000 2024-01-13T18:41:29.033 INFO:tasks.workunit.client.1.smithi099.stderr:193+1 records in 2024-01-13T18:41:29.033 INFO:tasks.workunit.client.1.smithi099.stderr:193+1 records out 2024-01-13T18:41:29.033 INFO:tasks.workunit.client.1.smithi099.stderr:198280 bytes (198 kB, 194 KiB) copied, 0.000442076 s, 449 MB/s 2024-01-13T18:41:29.033 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm testimg 2024-01-13T18:41:29.087 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 0% complete...failed. 2024-01-13T18:41:29.087 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: delete error: (2) No such file or directory 2024-01-13T18:41:29.088 INFO:tasks.workunit.client.1.smithi099.stderr:+ true 2024-01-13T18:41:29.088 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --new-format /tmp/rbd_import_export_200797/img testimg 2024-01-13T18:41:29.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:29 smithi084 ceph-mon[116404]: pgmap v2090: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 384 op/s 2024-01-13T18:41:29.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:29 smithi084 ceph-mon[119097]: pgmap v2090: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 384 op/s 2024-01-13T18:41:29.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:29 smithi099 ceph-mon[138788]: pgmap v2090: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 384 op/s 2024-01-13T18:41:30.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:30 smithi084 ceph-mon[116404]: osdmap e1126: 8 total, 8 up, 8 in 2024-01-13T18:41:30.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:30 smithi084 ceph-mon[119097]: osdmap e1126: 8 total, 8 up, 8 in 2024-01-13T18:41:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:41:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:41:30] "GET /metrics HTTP/1.1" 200 33990 "" "Prometheus/2.43.0" 2024-01-13T18:41:30.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:30 smithi099 ceph-mon[138788]: osdmap e1126: 8 total, 8 up, 8 in 2024-01-13T18:41:30.941 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 1% complete... Importing image: 2% complete... Importing image: 3% complete... Importing image: 4% complete... Importing image: 5% complete... Importing image: 6% complete... Importing image: 7% complete... Importing image: 8% complete... Importing image: 9% complete... Importing image: 10% complete... Importing image: 11% complete... Importing image: 12% complete... Importing image: 13% complete... Importing image: 14% complete... Importing image: 15% complete... Importing image: 16% complete... Importing image: 17% complete... Importing image: 18% complete... Importing image: 19% complete... Importing image: 20% complete... Importing image: 21% complete... Importing image: 22% complete... Importing image: 23% complete... Importing image: 24% complete... Importing image: 25% complete... Importing image: 26% complete... Importing image: 27% complete... Importing image: 28% complete... Importing image: 29% complete... Importing image: 30% complete... Importing image: 31% complete... Importing image: 32% complete... Importing image: 33% complete... Importing image: 34% complete... Importing image: 35% complete... Importing image: 36% complete... Importing image: 37% complete... Importing image: 38% complete... Importing image: 39% complete... Importing image: 40% complete... Importing image: 41% complete... Importing image: 42% complete... Importing image: 43% complete... Importing image: 44% complete... Importing image: 45% complete... Importing image: 46% complete... Importing image: 47% complete... Importing image: 48% complete... Importing image: 49% complete... Importing image: 50% complete... Importing image: 51% complete... Importing image: 52% complete... Importing image: 53% complete... Importing image: 54% complete... Importing image: 55% complete... Importing image: 56% complete... Importing image: 57% complete... Importing image: 58% complete... Importing image: 59% complete... Importing image: 60% complete... Importing image: 61% complete... Importing image: 62% complete... Importing image: 63% complete... Importing image: 64% complete... Importing image: 65% complete... Importing image: 66% complete... Importing image: 67% complete... Importing image: 68% complete... Importing image: 69% complete... Importing image: 70% complete... Importing image: 71% complete... Importing image: 72% complete... Importing image: 73% complete... Importing image: 74% complete... Importing image: 75% complete... Importing image: 76% complete... Importing image: 77% complete... Importing image: 78% complete... Importing image: 79% complete... Importing image: 80% complete... Importing image: 81% complete... Importing image: 82% complete... Importing image: 83% complete... Importing image: 84% complete... Importing image: 85% complete... Importing image: 86% complete... Importing image: 87% complete... Importing image: 88% complete... Importing image: 89% complete... Importing image: 90% complete... Importing image: 91% complete... Importing image: 92% complete... Importing image: 93% complete... Importing image: 94% complete... Importing image: 95% complete... Importing image: 96% complete... Importing image: 97% complete... Importing image: 98% complete... Importing image: 99% complete... Importing image: 100% complete...done. 2024-01-13T18:41:30.941 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --new-format is deprecated, use --image-format 2 2024-01-13T18:41:30.944 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export testimg /tmp/rbd_import_export_200797/img2 2024-01-13T18:41:31.208 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:31.211 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export testimg - 2024-01-13T18:41:31.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:31 smithi084 ceph-mon[116404]: osdmap e1127: 8 total, 8 up, 8 in 2024-01-13T18:41:31.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:31 smithi084 ceph-mon[116404]: pgmap v2093: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 131 op/s 2024-01-13T18:41:31.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:31 smithi084 ceph-mon[119097]: osdmap e1127: 8 total, 8 up, 8 in 2024-01-13T18:41:31.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:31 smithi084 ceph-mon[119097]: pgmap v2093: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 131 op/s 2024-01-13T18:41:31.838 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:31.841 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm testimg 2024-01-13T18:41:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:31 smithi099 ceph-mon[138788]: osdmap e1127: 8 total, 8 up, 8 in 2024-01-13T18:41:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:31 smithi099 ceph-mon[138788]: pgmap v2093: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 131 op/s 2024-01-13T18:41:31.967 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-01-13T18:41:31.969 INFO:tasks.workunit.client.1.smithi099.stderr:+ cmp /tmp/rbd_import_export_200797/img /tmp/rbd_import_export_200797/img2 2024-01-13T18:41:32.573 INFO:tasks.workunit.client.1.smithi099.stderr:+ cmp /tmp/rbd_import_export_200797/img /tmp/rbd_import_export_200797/img3 2024-01-13T18:41:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:32 smithi084 ceph-mon[116404]: pgmap v2094: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 28 op/s 2024-01-13T18:41:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:32 smithi084 ceph-mon[119097]: pgmap v2094: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 28 op/s 2024-01-13T18:41:32.969 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/img2 /tmp/rbd_import_export_200797/img3 2024-01-13T18:41:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:32 smithi099 ceph-mon[138788]: pgmap v2094: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 28 op/s 2024-01-13T18:41:33.154 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --new-format - testimg 2024-01-13T18:41:33.576 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete...done. 2024-01-13T18:41:33.577 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --new-format is deprecated, use --image-format 2 2024-01-13T18:41:33.579 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export testimg /tmp/rbd_import_export_200797/img2 2024-01-13T18:41:33.828 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:33.831 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export testimg - 2024-01-13T18:41:34.480 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:34.483 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm testimg 2024-01-13T18:41:34.602 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-01-13T18:41:34.605 INFO:tasks.workunit.client.1.smithi099.stderr:+ cmp /tmp/rbd_import_export_200797/img /tmp/rbd_import_export_200797/img2 2024-01-13T18:41:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:34 smithi084 ceph-mon[116404]: pgmap v2095: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 98 KiB/s rd, 47 KiB/s wr, 25 op/s 2024-01-13T18:41:34.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:34 smithi084 ceph-mon[119097]: pgmap v2095: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 98 KiB/s rd, 47 KiB/s wr, 25 op/s 2024-01-13T18:41:35.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:34 smithi099 ceph-mon[138788]: pgmap v2095: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 98 KiB/s rd, 47 KiB/s wr, 25 op/s 2024-01-13T18:41:35.172 INFO:tasks.workunit.client.1.smithi099.stderr:+ cmp /tmp/rbd_import_export_200797/img /tmp/rbd_import_export_200797/img3 2024-01-13T18:41:35.570 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/img /tmp/rbd_import_export_200797/img2 /tmp/rbd_import_export_200797/img3 2024-01-13T18:41:35.808 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd help export 2024-01-13T18:41:35.808 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep -q export-format 2024-01-13T18:41:35.827 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/bin/dd of=/tmp/rbd_import_export_200797/img bs=1k count=10 seek=100 2024-01-13T18:41:35.828 INFO:tasks.workunit.client.1.smithi099.stderr:10+0 records in 2024-01-13T18:41:35.828 INFO:tasks.workunit.client.1.smithi099.stderr:10+0 records out 2024-01-13T18:41:35.828 INFO:tasks.workunit.client.1.smithi099.stderr:10240 bytes (10 kB, 10 KiB) copied, 5.99e-05 s, 171 MB/s 2024-01-13T18:41:35.828 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --new-format /tmp/rbd_import_export_200797/img testimg 2024-01-13T18:41:35.894 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete...done. 2024-01-13T18:41:35.894 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --new-format is deprecated, use --image-format 2 2024-01-13T18:41:35.896 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd snap create testimg@snap 2024-01-13T18:41:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:36.699 INFO:tasks.workunit.client.1.smithi099.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-01-13T18:41:36.709 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd image-meta set testimg key1 value1 2024-01-13T18:41:36.769 INFO:tasks.workunit.client.1.smithi099.stderr:++ rbd image-meta list testimg 2024-01-13T18:41:36.811 INFO:tasks.workunit.client.1.smithi099.stderr:+ IMAGEMETA_BEFORE='There is 1 metadatum on this image: 2024-01-13T18:41:36.812 INFO:tasks.workunit.client.1.smithi099.stderr: 2024-01-13T18:41:36.812 INFO:tasks.workunit.client.1.smithi099.stderr:Key Value 2024-01-13T18:41:36.812 INFO:tasks.workunit.client.1.smithi099.stderr:key1 value1' 2024-01-13T18:41:36.812 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export --export-format 2 testimg /tmp/rbd_import_export_200797/img_v2 2024-01-13T18:41:36.849 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 100% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:36.851 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --export-format 2 /tmp/rbd_import_export_200797/img_v2 testimg_import 2024-01-13T18:41:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:36 smithi099 ceph-mon[138788]: pgmap v2096: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 314 KiB/s rd, 130 KiB/s wr, 90 op/s 2024-01-13T18:41:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:36 smithi084 ceph-mon[116404]: pgmap v2096: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 314 KiB/s rd, 130 KiB/s wr, 90 op/s 2024-01-13T18:41:37.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:36 smithi084 ceph-mon[119097]: pgmap v2096: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 314 KiB/s rd, 130 KiB/s wr, 90 op/s 2024-01-13T18:41:37.711 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 50% complete... Importing image: 100% complete... Importing image: 100% complete...done. 2024-01-13T18:41:37.715 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd info testimg_import 2024-01-13T18:41:37.752 INFO:tasks.workunit.client.1.smithi099.stdout:rbd image 'testimg_import': 2024-01-13T18:41:37.752 INFO:tasks.workunit.client.1.smithi099.stdout: size 110 KiB in 1 objects 2024-01-13T18:41:37.752 INFO:tasks.workunit.client.1.smithi099.stdout: order 22 (4 MiB objects) 2024-01-13T18:41:37.752 INFO:tasks.workunit.client.1.smithi099.stdout: snapshot_count: 1 2024-01-13T18:41:37.752 INFO:tasks.workunit.client.1.smithi099.stdout: id: d5fa45a1eb85 2024-01-13T18:41:37.752 INFO:tasks.workunit.client.1.smithi099.stdout: block_name_prefix: rbd_data.d5fa45a1eb85 2024-01-13T18:41:37.752 INFO:tasks.workunit.client.1.smithi099.stdout: format: 2 2024-01-13T18:41:37.752 INFO:tasks.workunit.client.1.smithi099.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2024-01-13T18:41:37.753 INFO:tasks.workunit.client.1.smithi099.stdout: op_features: 2024-01-13T18:41:37.753 INFO:tasks.workunit.client.1.smithi099.stdout: flags: 2024-01-13T18:41:37.753 INFO:tasks.workunit.client.1.smithi099.stdout: create_timestamp: Sat Jan 13 18:41:36 2024 2024-01-13T18:41:37.753 INFO:tasks.workunit.client.1.smithi099.stdout: access_timestamp: Sat Jan 13 18:41:36 2024 2024-01-13T18:41:37.753 INFO:tasks.workunit.client.1.smithi099.stdout: modify_timestamp: Sat Jan 13 18:41:36 2024 2024-01-13T18:41:37.755 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd info testimg_import@snap 2024-01-13T18:41:37.791 INFO:tasks.workunit.client.1.smithi099.stdout:rbd image 'testimg_import': 2024-01-13T18:41:37.791 INFO:tasks.workunit.client.1.smithi099.stdout: size 110 KiB in 1 objects 2024-01-13T18:41:37.791 INFO:tasks.workunit.client.1.smithi099.stdout: order 22 (4 MiB objects) 2024-01-13T18:41:37.791 INFO:tasks.workunit.client.1.smithi099.stdout: snapshot_count: 1 2024-01-13T18:41:37.791 INFO:tasks.workunit.client.1.smithi099.stdout: id: d5fa45a1eb85 2024-01-13T18:41:37.791 INFO:tasks.workunit.client.1.smithi099.stdout: block_name_prefix: rbd_data.d5fa45a1eb85 2024-01-13T18:41:37.791 INFO:tasks.workunit.client.1.smithi099.stdout: format: 2 2024-01-13T18:41:37.791 INFO:tasks.workunit.client.1.smithi099.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2024-01-13T18:41:37.791 INFO:tasks.workunit.client.1.smithi099.stdout: op_features: 2024-01-13T18:41:37.791 INFO:tasks.workunit.client.1.smithi099.stdout: flags: 2024-01-13T18:41:37.791 INFO:tasks.workunit.client.1.smithi099.stdout: create_timestamp: Sat Jan 13 18:41:36 2024 2024-01-13T18:41:37.792 INFO:tasks.workunit.client.1.smithi099.stdout: access_timestamp: Sat Jan 13 18:41:36 2024 2024-01-13T18:41:37.792 INFO:tasks.workunit.client.1.smithi099.stdout: modify_timestamp: Sat Jan 13 18:41:36 2024 2024-01-13T18:41:37.792 INFO:tasks.workunit.client.1.smithi099.stdout: protected: False 2024-01-13T18:41:37.794 INFO:tasks.workunit.client.1.smithi099.stderr:++ rbd image-meta list testimg_import 2024-01-13T18:41:37.835 INFO:tasks.workunit.client.1.smithi099.stderr:+ IMAGEMETA_AFTER='There is 1 metadatum on this image: 2024-01-13T18:41:37.835 INFO:tasks.workunit.client.1.smithi099.stderr: 2024-01-13T18:41:37.836 INFO:tasks.workunit.client.1.smithi099.stderr:Key Value 2024-01-13T18:41:37.836 INFO:tasks.workunit.client.1.smithi099.stderr:key1 value1' 2024-01-13T18:41:37.836 INFO:tasks.workunit.client.1.smithi099.stderr:+ '[' 'There is 1 metadatum on this image: 2024-01-13T18:41:37.836 INFO:tasks.workunit.client.1.smithi099.stderr: 2024-01-13T18:41:37.836 INFO:tasks.workunit.client.1.smithi099.stderr:Key Value 2024-01-13T18:41:37.836 INFO:tasks.workunit.client.1.smithi099.stderr:key1 value1' = 'There is 1 metadatum on this image: 2024-01-13T18:41:37.836 INFO:tasks.workunit.client.1.smithi099.stderr: 2024-01-13T18:41:37.836 INFO:tasks.workunit.client.1.smithi099.stderr:Key Value 2024-01-13T18:41:37.836 INFO:tasks.workunit.client.1.smithi099.stderr:key1 value1' ']' 2024-01-13T18:41:37.836 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export testimg_import /tmp/rbd_import_export_200797/img_import 2024-01-13T18:41:37.869 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 100% complete...done. 2024-01-13T18:41:37.872 INFO:tasks.workunit.client.1.smithi099.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_200797/img /tmp/rbd_import_export_200797/img_import 2024-01-13T18:41:37.872 INFO:tasks.workunit.client.1.smithi099.stderr:+ cmp -l /tmp/rbd_import_export_200797/img /tmp/rbd_import_export_200797/img_import 2024-01-13T18:41:37.873 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/img --format %b 2024-01-13T18:41:37.873 INFO:tasks.workunit.client.1.smithi099.stderr:+ origsize=24 2024-01-13T18:41:37.874 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/img_import --format %b 2024-01-13T18:41:37.875 INFO:tasks.workunit.client.1.smithi099.stderr:+ exportsize=224 2024-01-13T18:41:37.875 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=200 2024-01-13T18:41:37.875 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=200 2024-01-13T18:41:37.875 INFO:tasks.workunit.client.1.smithi099.stderr:+ test 200 -ge 0 -a 200 -lt 4096 2024-01-13T18:41:37.875 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export testimg@snap /tmp/rbd_import_export_200797/img_snap 2024-01-13T18:41:37.909 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 100% complete...done. 2024-01-13T18:41:37.912 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export testimg_import@snap /tmp/rbd_import_export_200797/img_snap_import 2024-01-13T18:41:37.945 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 100% complete...done. 2024-01-13T18:41:37.948 INFO:tasks.workunit.client.1.smithi099.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_200797/img_snap /tmp/rbd_import_export_200797/img_snap_import 2024-01-13T18:41:37.948 INFO:tasks.workunit.client.1.smithi099.stderr:+ cmp -l /tmp/rbd_import_export_200797/img_snap /tmp/rbd_import_export_200797/img_snap_import 2024-01-13T18:41:37.949 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/img_snap --format %b 2024-01-13T18:41:37.950 INFO:tasks.workunit.client.1.smithi099.stderr:+ origsize=224 2024-01-13T18:41:37.950 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/img_snap_import --format %b 2024-01-13T18:41:37.951 INFO:tasks.workunit.client.1.smithi099.stderr:+ exportsize=224 2024-01-13T18:41:37.951 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=0 2024-01-13T18:41:37.951 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=0 2024-01-13T18:41:37.951 INFO:tasks.workunit.client.1.smithi099.stderr:+ test 0 -ge 0 -a 0 -lt 4096 2024-01-13T18:41:37.951 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/img_v2 2024-01-13T18:41:37.952 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/img_import 2024-01-13T18:41:37.952 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/img_snap 2024-01-13T18:41:37.953 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/img_snap_import 2024-01-13T18:41:37.953 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd snap rm testimg_import@snap 2024-01-13T18:41:38.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:37 smithi099 ceph-mon[138788]: osdmap e1128: 8 total, 8 up, 8 in 2024-01-13T18:41:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:37 smithi084 ceph-mon[116404]: osdmap e1128: 8 total, 8 up, 8 in 2024-01-13T18:41:38.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:37 smithi084 ceph-mon[119097]: osdmap e1128: 8 total, 8 up, 8 in 2024-01-13T18:41:38.405 INFO:tasks.workunit.client.1.smithi099.stderr: Removing snap: 100% complete...done. 2024-01-13T18:41:38.416 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd remove testimg_import 2024-01-13T18:41:38.534 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 100% complete...done. 2024-01-13T18:41:38.537 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd snap rm testimg@snap 2024-01-13T18:41:39.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:38 smithi099 ceph-mon[138788]: osdmap e1129: 8 total, 8 up, 8 in 2024-01-13T18:41:39.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:41:39.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:38 smithi099 ceph-mon[138788]: osdmap e1130: 8 total, 8 up, 8 in 2024-01-13T18:41:39.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:38 smithi099 ceph-mon[138788]: pgmap v2100: 105 pgs: 105 active+clean; 693 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 424 KiB/s rd, 177 KiB/s wr, 130 op/s 2024-01-13T18:41:39.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:41:39.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:41:39.120 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:41:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[116404]: osdmap e1129: 8 total, 8 up, 8 in 2024-01-13T18:41:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:41:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[116404]: osdmap e1130: 8 total, 8 up, 8 in 2024-01-13T18:41:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[116404]: pgmap v2100: 105 pgs: 105 active+clean; 693 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 424 KiB/s rd, 177 KiB/s wr, 130 op/s 2024-01-13T18:41:39.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:41:39.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:41:39.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:41:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[119097]: osdmap e1129: 8 total, 8 up, 8 in 2024-01-13T18:41:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:41:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[119097]: osdmap e1130: 8 total, 8 up, 8 in 2024-01-13T18:41:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[119097]: pgmap v2100: 105 pgs: 105 active+clean; 693 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 424 KiB/s rd, 177 KiB/s wr, 130 op/s 2024-01-13T18:41:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:41:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:41:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:41:39.420 INFO:tasks.workunit.client.1.smithi099.stderr: Removing snap: 100% complete...done. 2024-01-13T18:41:39.431 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm testimg 2024-01-13T18:41:39.557 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 100% complete...done. 2024-01-13T18:41:39.559 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --order 20 /tmp/rbd_import_export_200797/img testimg 2024-01-13T18:41:39.624 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete...done. 2024-01-13T18:41:39.625 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --order is deprecated, use --object-size 2024-01-13T18:41:39.627 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export --export-format 2 testimg /tmp/rbd_import_export_200797/img_v2 2024-01-13T18:41:39.662 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 100% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:39.665 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --export-format 2 /tmp/rbd_import_export_200797/img_v2 testimg_import 2024-01-13T18:41:39.735 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete... Importing image: 100% complete...done. 2024-01-13T18:41:39.739 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd info testimg_import 2024-01-13T18:41:39.739 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep order 2024-01-13T18:41:39.739 INFO:tasks.workunit.client.1.smithi099.stderr:+ awk '{print $2}' 2024-01-13T18:41:39.739 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep 20 2024-01-13T18:41:39.772 INFO:tasks.workunit.client.1.smithi099.stdout:20 2024-01-13T18:41:39.772 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/img_v2 2024-01-13T18:41:39.773 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd remove testimg_import 2024-01-13T18:41:39.887 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 100% complete...done. 2024-01-13T18:41:39.889 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd remove testimg 2024-01-13T18:41:40.000 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 100% complete...done. 2024-01-13T18:41:40.002 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --image-feature layering /tmp/rbd_import_export_200797/img testimg 2024-01-13T18:41:40.057 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete...done. 2024-01-13T18:41:40.060 INFO:tasks.workunit.client.1.smithi099.stderr:++ rbd info testimg 2024-01-13T18:41:40.060 INFO:tasks.workunit.client.1.smithi099.stderr:++ grep features 2024-01-13T18:41:40.094 INFO:tasks.workunit.client.1.smithi099.stderr:+ FEATURES_BEFORE=' features: layering 2024-01-13T18:41:40.094 INFO:tasks.workunit.client.1.smithi099.stderr: op_features: ' 2024-01-13T18:41:40.094 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export --export-format 2 testimg /tmp/rbd_import_export_200797/img_v2 2024-01-13T18:41:40.129 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 100% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:40.132 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --export-format 2 /tmp/rbd_import_export_200797/img_v2 testimg_import 2024-01-13T18:41:40.193 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete... Importing image: 100% complete...done. 2024-01-13T18:41:40.196 INFO:tasks.workunit.client.1.smithi099.stderr:++ rbd info testimg_import 2024-01-13T18:41:40.196 INFO:tasks.workunit.client.1.smithi099.stderr:++ grep features 2024-01-13T18:41:40.230 INFO:tasks.workunit.client.1.smithi099.stderr:+ FEATURES_AFTER=' features: layering 2024-01-13T18:41:40.230 INFO:tasks.workunit.client.1.smithi099.stderr: op_features: ' 2024-01-13T18:41:40.230 INFO:tasks.workunit.client.1.smithi099.stderr:+ '[' ' features: layering 2024-01-13T18:41:40.230 INFO:tasks.workunit.client.1.smithi099.stderr: op_features: ' '!=' ' features: layering 2024-01-13T18:41:40.230 INFO:tasks.workunit.client.1.smithi099.stderr: op_features: ' ']' 2024-01-13T18:41:40.230 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/img_v2 2024-01-13T18:41:40.230 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd remove testimg_import 2024-01-13T18:41:40.314 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 100% complete...done. 2024-01-13T18:41:40.316 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd remove testimg 2024-01-13T18:41:40.405 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 100% complete...done. 2024-01-13T18:41:40.408 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --stripe-count 1000 --stripe-unit 4096 /tmp/rbd_import_export_200797/img testimg 2024-01-13T18:41:40.479 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete...done. 2024-01-13T18:41:40.481 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export --export-format 2 testimg /tmp/rbd_import_export_200797/img_v2 2024-01-13T18:41:40.521 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 100% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:40.524 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --export-format 2 /tmp/rbd_import_export_200797/img_v2 testimg_import 2024-01-13T18:41:40.599 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete... Importing image: 100% complete...done. 2024-01-13T18:41:40.602 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd info testimg_import 2024-01-13T18:41:40.603 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep 'stripe unit' 2024-01-13T18:41:40.603 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep -Ei '(4 KiB|4096)' 2024-01-13T18:41:40.639 INFO:tasks.workunit.client.1.smithi099.stdout: stripe unit: 4 KiB 2024-01-13T18:41:40.639 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd info testimg_import 2024-01-13T18:41:40.639 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep 'stripe count' 2024-01-13T18:41:40.639 INFO:tasks.workunit.client.1.smithi099.stderr:+ awk '{print $3}' 2024-01-13T18:41:40.639 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep 1000 2024-01-13T18:41:40.674 INFO:tasks.workunit.client.1.smithi099.stdout:1000 2024-01-13T18:41:40.674 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/img_v2 2024-01-13T18:41:40.675 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd remove testimg_import 2024-01-13T18:41:40.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:40 smithi084 ceph-mon[116404]: osdmap e1131: 8 total, 8 up, 8 in 2024-01-13T18:41:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:41:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:41:40] "GET /metrics HTTP/1.1" 200 33982 "" "Prometheus/2.43.0" 2024-01-13T18:41:40.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:40 smithi084 ceph-mon[119097]: osdmap e1131: 8 total, 8 up, 8 in 2024-01-13T18:41:40.789 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 3% complete... Removing image: 7% complete... Removing image: 10% complete... Removing image: 14% complete... Removing image: 17% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 32% complete... Removing image: 35% complete... Removing image: 39% complete... Removing image: 42% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 57% complete... Removing image: 60% complete... Removing image: 64% complete... Removing image: 67% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 82% complete... Removing image: 85% complete... Removing image: 89% complete... Removing image: 92% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-01-13T18:41:40.792 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd remove testimg 2024-01-13T18:41:40.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:40 smithi099 ceph-mon[138788]: osdmap e1131: 8 total, 8 up, 8 in 2024-01-13T18:41:40.903 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 3% complete... Removing image: 7% complete... Removing image: 10% complete... Removing image: 14% complete... Removing image: 17% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 32% complete... Removing image: 35% complete... Removing image: 39% complete... Removing image: 42% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 57% complete... Removing image: 60% complete... Removing image: 64% complete... Removing image: 67% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 82% complete... Removing image: 85% complete... Removing image: 89% complete... Removing image: 92% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-01-13T18:41:40.906 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --image-format=2 /tmp/rbd_import_export_200797/img testimg 2024-01-13T18:41:40.968 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete...done. 2024-01-13T18:41:40.971 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd snap create testimg@snap1 2024-01-13T18:41:41.431 INFO:tasks.workunit.client.1.smithi099.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-01-13T18:41:41.440 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd snap create testimg@snap2 2024-01-13T18:41:41.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:41 smithi084 ceph-mon[116404]: pgmap v2102: 105 pgs: 105 active+clean; 693 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 176 KiB/s rd, 17 KiB/s wr, 226 op/s 2024-01-13T18:41:41.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:41 smithi084 ceph-mon[119097]: pgmap v2102: 105 pgs: 105 active+clean; 693 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 176 KiB/s rd, 17 KiB/s wr, 226 op/s 2024-01-13T18:41:41.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:41 smithi099 ceph-mon[138788]: pgmap v2102: 105 pgs: 105 active+clean; 693 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 176 KiB/s rd, 17 KiB/s wr, 226 op/s 2024-01-13T18:41:42.438 INFO:tasks.workunit.client.1.smithi099.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-01-13T18:41:42.449 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd snap protect testimg@snap2 2024-01-13T18:41:42.494 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export --export-format 2 testimg /tmp/rbd_import_export_200797/snap_protect 2024-01-13T18:41:42.535 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 33% complete... Exporting image: 100% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:42.538 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --export-format 2 /tmp/rbd_import_export_200797/snap_protect testimg_import 2024-01-13T18:41:42.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:42 smithi084 ceph-mon[116404]: osdmap e1132: 8 total, 8 up, 8 in 2024-01-13T18:41:42.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:42 smithi084 ceph-mon[119097]: osdmap e1132: 8 total, 8 up, 8 in 2024-01-13T18:41:42.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:42 smithi099 ceph-mon[138788]: osdmap e1132: 8 total, 8 up, 8 in 2024-01-13T18:41:43.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:43 smithi084 ceph-mon[116404]: osdmap e1133: 8 total, 8 up, 8 in 2024-01-13T18:41:43.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:43 smithi084 ceph-mon[116404]: pgmap v2105: 105 pgs: 105 active+clean; 693 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 249 KiB/s rd, 27 KiB/s wr, 328 op/s 2024-01-13T18:41:43.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:43 smithi084 ceph-mon[119097]: osdmap e1133: 8 total, 8 up, 8 in 2024-01-13T18:41:43.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:43 smithi084 ceph-mon[119097]: pgmap v2105: 105 pgs: 105 active+clean; 693 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 249 KiB/s rd, 27 KiB/s wr, 328 op/s 2024-01-13T18:41:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:43 smithi099 ceph-mon[138788]: osdmap e1133: 8 total, 8 up, 8 in 2024-01-13T18:41:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:43 smithi099 ceph-mon[138788]: pgmap v2105: 105 pgs: 105 active+clean; 693 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 249 KiB/s rd, 27 KiB/s wr, 328 op/s 2024-01-13T18:41:44.460 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 33% complete... Importing image: 66% complete... Importing image: 100% complete... Importing image: 100% complete...done. 2024-01-13T18:41:44.464 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd info testimg_import@snap1 2024-01-13T18:41:44.464 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep 'protected: False' 2024-01-13T18:41:44.502 INFO:tasks.workunit.client.1.smithi099.stdout: protected: False 2024-01-13T18:41:44.502 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd info testimg_import@snap2 2024-01-13T18:41:44.502 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep 'protected: True' 2024-01-13T18:41:44.539 INFO:tasks.workunit.client.1.smithi099.stdout: protected: True 2024-01-13T18:41:44.539 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/snap_protect 2024-01-13T18:41:44.539 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd snap unprotect testimg@snap2 2024-01-13T18:41:44.586 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd snap unprotect testimg_import@snap2 2024-01-13T18:41:44.630 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd snap purge testimg 2024-01-13T18:41:44.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:44 smithi099 ceph-mon[138788]: osdmap e1134: 8 total, 8 up, 8 in 2024-01-13T18:41:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:44 smithi084 ceph-mon[116404]: osdmap e1134: 8 total, 8 up, 8 in 2024-01-13T18:41:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:44 smithi084 ceph-mon[119097]: osdmap e1134: 8 total, 8 up, 8 in 2024-01-13T18:41:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:45 smithi099 ceph-mon[138788]: osdmap e1135: 8 total, 8 up, 8 in 2024-01-13T18:41:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:45 smithi099 ceph-mon[138788]: pgmap v2108: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 284 KiB/s rd, 33 KiB/s wr, 385 op/s 2024-01-13T18:41:45.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:45 smithi084 ceph-mon[119097]: osdmap e1135: 8 total, 8 up, 8 in 2024-01-13T18:41:45.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:45 smithi084 ceph-mon[119097]: pgmap v2108: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 284 KiB/s rd, 33 KiB/s wr, 385 op/s 2024-01-13T18:41:45.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:45 smithi084 ceph-mon[116404]: osdmap e1135: 8 total, 8 up, 8 in 2024-01-13T18:41:45.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:45 smithi084 ceph-mon[116404]: pgmap v2108: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 284 KiB/s rd, 33 KiB/s wr, 385 op/s 2024-01-13T18:41:46.452 INFO:tasks.workunit.client.1.smithi099.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-01-13T18:41:46.467 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd snap purge testimg_import 2024-01-13T18:41:46.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:46 smithi099 ceph-mon[138788]: osdmap e1136: 8 total, 8 up, 8 in 2024-01-13T18:41:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:46 smithi084 ceph-mon[116404]: osdmap e1136: 8 total, 8 up, 8 in 2024-01-13T18:41:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:46 smithi084 ceph-mon[119097]: osdmap e1136: 8 total, 8 up, 8 in 2024-01-13T18:41:47.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:47 smithi099 ceph-mon[138788]: osdmap e1137: 8 total, 8 up, 8 in 2024-01-13T18:41:47.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:47 smithi099 ceph-mon[138788]: pgmap v2111: 105 pgs: 105 active+clean; 803 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 289 KiB/s rd, 31 KiB/s wr, 379 op/s 2024-01-13T18:41:47.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:47 smithi084 ceph-mon[116404]: osdmap e1137: 8 total, 8 up, 8 in 2024-01-13T18:41:47.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:47 smithi084 ceph-mon[116404]: pgmap v2111: 105 pgs: 105 active+clean; 803 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 289 KiB/s rd, 31 KiB/s wr, 379 op/s 2024-01-13T18:41:47.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:47 smithi084 ceph-mon[119097]: osdmap e1137: 8 total, 8 up, 8 in 2024-01-13T18:41:47.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:47 smithi084 ceph-mon[119097]: pgmap v2111: 105 pgs: 105 active+clean; 803 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 289 KiB/s rd, 31 KiB/s wr, 379 op/s 2024-01-13T18:41:48.403 INFO:tasks.workunit.client.1.smithi099.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-01-13T18:41:48.418 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd remove testimg 2024-01-13T18:41:48.545 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 100% complete...done. 2024-01-13T18:41:48.547 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd remove testimg_import 2024-01-13T18:41:48.659 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 100% complete...done. 2024-01-13T18:41:48.662 INFO:tasks.workunit.client.1.smithi099.stderr:+ tiered=0 2024-01-13T18:41:48.662 INFO:tasks.workunit.client.1.smithi099.stderr:+ ceph osd dump 2024-01-13T18:41:48.662 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep '^pool' 2024-01-13T18:41:48.662 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep ''\''rbd'\''' 2024-01-13T18:41:48.662 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep tier 2024-01-13T18:41:48.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:48 smithi099 ceph-mon[138788]: osdmap e1138: 8 total, 8 up, 8 in 2024-01-13T18:41:48.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:48 smithi099 ceph-mon[138788]: osdmap e1139: 8 total, 8 up, 8 in 2024-01-13T18:41:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:48 smithi084 ceph-mon[116404]: osdmap e1138: 8 total, 8 up, 8 in 2024-01-13T18:41:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:48 smithi084 ceph-mon[116404]: osdmap e1139: 8 total, 8 up, 8 in 2024-01-13T18:41:48.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:48 smithi084 ceph-mon[119097]: osdmap e1138: 8 total, 8 up, 8 in 2024-01-13T18:41:48.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:48 smithi084 ceph-mon[119097]: osdmap e1139: 8 total, 8 up, 8 in 2024-01-13T18:41:49.101 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/dev/urandom bs=1M seek=1 count=1 of=/tmp/rbd_import_export_200797/sparse1 2024-01-13T18:41:49.107 INFO:tasks.workunit.client.1.smithi099.stderr:1+0 records in 2024-01-13T18:41:49.107 INFO:tasks.workunit.client.1.smithi099.stderr:1+0 records out 2024-01-13T18:41:49.107 INFO:tasks.workunit.client.1.smithi099.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00494173 s, 212 MB/s 2024-01-13T18:41:49.107 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/dev/urandom bs=1M count=1 of=/tmp/rbd_import_export_200797/sparse2 2024-01-13T18:41:49.113 INFO:tasks.workunit.client.1.smithi099.stderr:1+0 records in 2024-01-13T18:41:49.113 INFO:tasks.workunit.client.1.smithi099.stderr:1+0 records out 2024-01-13T18:41:49.113 INFO:tasks.workunit.client.1.smithi099.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00487308 s, 215 MB/s 2024-01-13T18:41:49.113 INFO:tasks.workunit.client.1.smithi099.stderr:+ truncate /tmp/rbd_import_export_200797/sparse2 -s 2M 2024-01-13T18:41:49.148 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm sparse1 2024-01-13T18:41:49.199 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 0% complete...failed. 2024-01-13T18:41:49.199 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: delete error: (2) No such file or directory 2024-01-13T18:41:49.201 INFO:tasks.workunit.client.1.smithi099.stderr:+ true 2024-01-13T18:41:49.201 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --new-format --order 20 /tmp/rbd_import_export_200797/sparse1 2024-01-13T18:41:49.272 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 50% complete... Importing image: 100% complete...done. 2024-01-13T18:41:49.272 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --new-format is deprecated, use --image-format 2 2024-01-13T18:41:49.272 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --order is deprecated, use --object-size 2024-01-13T18:41:49.275 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd ls -l 2024-01-13T18:41:49.275 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep sparse1 2024-01-13T18:41:49.275 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep -Ei '(2 MiB|2048k)' 2024-01-13T18:41:49.309 INFO:tasks.workunit.client.1.smithi099.stdout:sparse1 2 MiB 2 2024-01-13T18:41:49.310 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects sparse1 2024-01-13T18:41:49.310 INFO:tasks.workunit.client.1.smithi099.stderr:++ image=sparse1 2024-01-13T18:41:49.310 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rbd info sparse1 2024-01-13T18:41:49.310 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep block_name_prefix 2024-01-13T18:41:49.311 INFO:tasks.workunit.client.1.smithi099.stderr:+++ awk '{print $NF;}' 2024-01-13T18:41:49.344 INFO:tasks.workunit.client.1.smithi099.stderr:++ prefix=rbd_data.d714ea39a763 2024-01-13T18:41:49.345 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep rbd_data.d714ea39a763 2024-01-13T18:41:49.345 INFO:tasks.workunit.client.1.smithi099.stderr:++++ get_image_data_pool sparse1 2024-01-13T18:41:49.346 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sed -e 's/rbd_data.d714ea39a763\.//' -e 's/^0*\([0-9a-f]\)/\1/' 2024-01-13T18:41:49.346 INFO:tasks.workunit.client.1.smithi099.stderr:++++ image=sparse1 2024-01-13T18:41:49.346 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sort -u 2024-01-13T18:41:49.346 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ rbd info sparse1 2024-01-13T18:41:49.346 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ grep 'data_pool: ' 2024-01-13T18:41:49.346 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ awk -F: '{ print $NF }' 2024-01-13T18:41:49.380 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool= 2024-01-13T18:41:49.380 INFO:tasks.workunit.client.1.smithi099.stderr:++++ '[' -z ']' 2024-01-13T18:41:49.381 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool=rbd 2024-01-13T18:41:49.381 INFO:tasks.workunit.client.1.smithi099.stderr:++++ echo rbd 2024-01-13T18:41:49.381 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rados ls -p rbd 2024-01-13T18:41:49.455 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects=1 2024-01-13T18:41:49.455 INFO:tasks.workunit.client.1.smithi099.stderr:++ echo 1 2024-01-13T18:41:49.455 INFO:tasks.workunit.client.1.smithi099.stderr:+ '[' 0 -eq 1 -o 1 = 1 ']' 2024-01-13T18:41:49.455 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export sparse1 /tmp/rbd_import_export_200797/sparse1.out 2024-01-13T18:41:49.489 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 50% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:49.492 INFO:tasks.workunit.client.1.smithi099.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_200797/sparse1 /tmp/rbd_import_export_200797/sparse1.out 2024-01-13T18:41:49.492 INFO:tasks.workunit.client.1.smithi099.stderr:+ cmp -l /tmp/rbd_import_export_200797/sparse1 /tmp/rbd_import_export_200797/sparse1.out 2024-01-13T18:41:49.494 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/sparse1 --format %b 2024-01-13T18:41:49.495 INFO:tasks.workunit.client.1.smithi099.stderr:+ origsize=2048 2024-01-13T18:41:49.495 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/sparse1.out --format %b 2024-01-13T18:41:49.496 INFO:tasks.workunit.client.1.smithi099.stderr:+ exportsize=2048 2024-01-13T18:41:49.496 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=0 2024-01-13T18:41:49.496 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=0 2024-01-13T18:41:49.496 INFO:tasks.workunit.client.1.smithi099.stderr:+ test 0 -ge 0 -a 0 -lt 4096 2024-01-13T18:41:49.496 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/sparse1.out 2024-01-13T18:41:49.497 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm sparse1 2024-01-13T18:41:49.611 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 50% complete... Removing image: 100% complete...done. 2024-01-13T18:41:49.614 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm sparse2 2024-01-13T18:41:49.664 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 0% complete...failed. 2024-01-13T18:41:49.664 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: delete error: (2) No such file or directory 2024-01-13T18:41:49.666 INFO:tasks.workunit.client.1.smithi099.stderr:+ true 2024-01-13T18:41:49.666 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --new-format --order 20 /tmp/rbd_import_export_200797/sparse2 2024-01-13T18:41:49.739 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 50% complete... Importing image: 100% complete...done. 2024-01-13T18:41:49.740 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --new-format is deprecated, use --image-format 2 2024-01-13T18:41:49.740 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --order is deprecated, use --object-size 2024-01-13T18:41:49.742 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd ls -l 2024-01-13T18:41:49.743 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep sparse2 2024-01-13T18:41:49.743 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep -Ei '(2 MiB|2048k)' 2024-01-13T18:41:49.777 INFO:tasks.workunit.client.1.smithi099.stdout:sparse2 2 MiB 2 2024-01-13T18:41:49.778 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects sparse2 2024-01-13T18:41:49.778 INFO:tasks.workunit.client.1.smithi099.stderr:++ image=sparse2 2024-01-13T18:41:49.778 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rbd info sparse2 2024-01-13T18:41:49.778 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep block_name_prefix 2024-01-13T18:41:49.778 INFO:tasks.workunit.client.1.smithi099.stderr:+++ awk '{print $NF;}' 2024-01-13T18:41:49.814 INFO:tasks.workunit.client.1.smithi099.stderr:++ prefix=rbd_data.d747e17ae85d 2024-01-13T18:41:49.814 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep rbd_data.d747e17ae85d 2024-01-13T18:41:49.814 INFO:tasks.workunit.client.1.smithi099.stderr:++++ get_image_data_pool sparse2 2024-01-13T18:41:49.815 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sed -e 's/rbd_data.d747e17ae85d\.//' -e 's/^0*\([0-9a-f]\)/\1/' 2024-01-13T18:41:49.815 INFO:tasks.workunit.client.1.smithi099.stderr:++++ image=sparse2 2024-01-13T18:41:49.815 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sort -u 2024-01-13T18:41:49.815 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ rbd info sparse2 2024-01-13T18:41:49.815 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ grep 'data_pool: ' 2024-01-13T18:41:49.815 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ awk -F: '{ print $NF }' 2024-01-13T18:41:49.852 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool= 2024-01-13T18:41:49.852 INFO:tasks.workunit.client.1.smithi099.stderr:++++ '[' -z ']' 2024-01-13T18:41:49.852 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool=rbd 2024-01-13T18:41:49.852 INFO:tasks.workunit.client.1.smithi099.stderr:++++ echo rbd 2024-01-13T18:41:49.852 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rados ls -p rbd 2024-01-13T18:41:49.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:49 smithi099 ceph-mon[138788]: pgmap v2114: 105 pgs: 105 active+clean; 803 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 169 KiB/s rd, 20 KiB/s wr, 224 op/s 2024-01-13T18:41:49.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:49 smithi099 ceph-mon[138788]: from='client.? 172.21.15.99:0/3740131702' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-13T18:41:49.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:49 smithi099 ceph-mon[138788]: from='client.? 172.21.15.99:0/3740131702' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-13T18:41:49.921 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects=0 2024-01-13T18:41:49.921 INFO:tasks.workunit.client.1.smithi099.stderr:++ echo 0 2024-01-13T18:41:49.922 INFO:tasks.workunit.client.1.smithi099.stderr:+ '[' 0 -eq 1 -o 0 = 0 ']' 2024-01-13T18:41:49.922 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export sparse2 /tmp/rbd_import_export_200797/sparse2.out 2024-01-13T18:41:49.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:49 smithi084 ceph-mon[116404]: pgmap v2114: 105 pgs: 105 active+clean; 803 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 169 KiB/s rd, 20 KiB/s wr, 224 op/s 2024-01-13T18:41:49.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:49 smithi084 ceph-mon[116404]: from='client.? 172.21.15.99:0/3740131702' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-13T18:41:49.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:49 smithi084 ceph-mon[116404]: from='client.? 172.21.15.99:0/3740131702' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-13T18:41:49.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:49 smithi084 ceph-mon[119097]: pgmap v2114: 105 pgs: 105 active+clean; 803 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 169 KiB/s rd, 20 KiB/s wr, 224 op/s 2024-01-13T18:41:49.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:49 smithi084 ceph-mon[119097]: from='client.? 172.21.15.99:0/3740131702' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-13T18:41:49.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:49 smithi084 ceph-mon[119097]: from='client.? 172.21.15.99:0/3740131702' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-13T18:41:49.957 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 50% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:49.959 INFO:tasks.workunit.client.1.smithi099.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_200797/sparse2 /tmp/rbd_import_export_200797/sparse2.out 2024-01-13T18:41:49.959 INFO:tasks.workunit.client.1.smithi099.stderr:+ cmp -l /tmp/rbd_import_export_200797/sparse2 /tmp/rbd_import_export_200797/sparse2.out 2024-01-13T18:41:49.961 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/sparse2 --format %b 2024-01-13T18:41:49.962 INFO:tasks.workunit.client.1.smithi099.stderr:+ origsize=2048 2024-01-13T18:41:49.962 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/sparse2.out --format %b 2024-01-13T18:41:49.964 INFO:tasks.workunit.client.1.smithi099.stderr:+ exportsize=2048 2024-01-13T18:41:49.964 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=0 2024-01-13T18:41:49.964 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=0 2024-01-13T18:41:49.964 INFO:tasks.workunit.client.1.smithi099.stderr:+ test 0 -ge 0 -a 0 -lt 4096 2024-01-13T18:41:49.964 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/sparse2.out 2024-01-13T18:41:49.964 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm sparse2 2024-01-13T18:41:50.075 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 50% complete... Removing image: 100% complete...done. 2024-01-13T18:41:50.077 INFO:tasks.workunit.client.1.smithi099.stderr:+ truncate /tmp/rbd_import_export_200797/sparse1 -s 10M 2024-01-13T18:41:50.078 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --new-format --order 20 - sparse1 2024-01-13T18:41:50.184 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete...done. 2024-01-13T18:41:50.184 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --new-format is deprecated, use --image-format 2 2024-01-13T18:41:50.184 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --order is deprecated, use --object-size 2024-01-13T18:41:50.187 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd ls -l 2024-01-13T18:41:50.187 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep sparse1 2024-01-13T18:41:50.187 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep -Ei '(10 MiB|10240k)' 2024-01-13T18:41:50.221 INFO:tasks.workunit.client.1.smithi099.stdout:sparse1 10 MiB 2 2024-01-13T18:41:50.222 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects sparse1 2024-01-13T18:41:50.222 INFO:tasks.workunit.client.1.smithi099.stderr:++ image=sparse1 2024-01-13T18:41:50.222 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rbd info sparse1 2024-01-13T18:41:50.222 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep block_name_prefix 2024-01-13T18:41:50.222 INFO:tasks.workunit.client.1.smithi099.stderr:+++ awk '{print $NF;}' 2024-01-13T18:41:50.255 INFO:tasks.workunit.client.1.smithi099.stderr:++ prefix=rbd_data.d774ea63e161 2024-01-13T18:41:50.257 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep rbd_data.d774ea63e161 2024-01-13T18:41:50.257 INFO:tasks.workunit.client.1.smithi099.stderr:++++ get_image_data_pool sparse1 2024-01-13T18:41:50.257 INFO:tasks.workunit.client.1.smithi099.stderr:++++ image=sparse1 2024-01-13T18:41:50.257 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sed -e 's/rbd_data.d774ea63e161\.//' -e 's/^0*\([0-9a-f]\)/\1/' 2024-01-13T18:41:50.257 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sort -u 2024-01-13T18:41:50.257 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ rbd info sparse1 2024-01-13T18:41:50.257 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ grep 'data_pool: ' 2024-01-13T18:41:50.257 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ awk -F: '{ print $NF }' 2024-01-13T18:41:50.291 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool= 2024-01-13T18:41:50.291 INFO:tasks.workunit.client.1.smithi099.stderr:++++ '[' -z ']' 2024-01-13T18:41:50.291 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool=rbd 2024-01-13T18:41:50.292 INFO:tasks.workunit.client.1.smithi099.stderr:++++ echo rbd 2024-01-13T18:41:50.292 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rados ls -p rbd 2024-01-13T18:41:50.358 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects=1 2024-01-13T18:41:50.358 INFO:tasks.workunit.client.1.smithi099.stderr:++ echo 1 2024-01-13T18:41:50.358 INFO:tasks.workunit.client.1.smithi099.stderr:+ '[' 0 -eq 1 -o 1 = 1 ']' 2024-01-13T18:41:50.358 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export sparse1 /tmp/rbd_import_export_200797/sparse1.out 2024-01-13T18:41:50.393 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 40% complete... Exporting image: 50% complete... Exporting image: 60% complete... Exporting image: 70% complete... Exporting image: 80% complete... Exporting image: 90% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:50.396 INFO:tasks.workunit.client.1.smithi099.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_200797/sparse1 /tmp/rbd_import_export_200797/sparse1.out 2024-01-13T18:41:50.396 INFO:tasks.workunit.client.1.smithi099.stderr:+ cmp -l /tmp/rbd_import_export_200797/sparse1 /tmp/rbd_import_export_200797/sparse1.out 2024-01-13T18:41:50.403 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/sparse1 --format %b 2024-01-13T18:41:50.404 INFO:tasks.workunit.client.1.smithi099.stderr:+ origsize=2048 2024-01-13T18:41:50.404 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/sparse1.out --format %b 2024-01-13T18:41:50.405 INFO:tasks.workunit.client.1.smithi099.stderr:+ exportsize=2048 2024-01-13T18:41:50.405 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=0 2024-01-13T18:41:50.405 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=0 2024-01-13T18:41:50.406 INFO:tasks.workunit.client.1.smithi099.stderr:+ test 0 -ge 0 -a 0 -lt 4096 2024-01-13T18:41:50.406 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/sparse1.out 2024-01-13T18:41:50.406 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm sparse1 2024-01-13T18:41:50.521 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 10% complete... Removing image: 20% complete... Removing image: 30% complete... Removing image: 40% complete... Removing image: 50% complete... Removing image: 60% complete... Removing image: 70% complete... Removing image: 80% complete... Removing image: 90% complete... Removing image: 100% complete...done. 2024-01-13T18:41:50.524 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/dev/urandom bs=2M count=1 of=/tmp/rbd_import_export_200797/sparse2 oflag=append conv=notrunc 2024-01-13T18:41:50.534 INFO:tasks.workunit.client.1.smithi099.stderr:1+0 records in 2024-01-13T18:41:50.534 INFO:tasks.workunit.client.1.smithi099.stderr:1+0 records out 2024-01-13T18:41:50.534 INFO:tasks.workunit.client.1.smithi099.stderr:2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.00990831 s, 212 MB/s 2024-01-13T18:41:50.534 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --new-format --order 20 - sparse2 2024-01-13T18:41:50.634 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete...done. 2024-01-13T18:41:50.635 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --new-format is deprecated, use --image-format 2 2024-01-13T18:41:50.635 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --order is deprecated, use --object-size 2024-01-13T18:41:50.637 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd ls -l 2024-01-13T18:41:50.637 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep sparse2 2024-01-13T18:41:50.637 INFO:tasks.workunit.client.1.smithi099.stderr:+ grep -Ei '(4 MiB|4096k)' 2024-01-13T18:41:50.672 INFO:tasks.workunit.client.1.smithi099.stdout:sparse2 4 MiB 2 2024-01-13T18:41:50.673 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects sparse2 2024-01-13T18:41:50.673 INFO:tasks.workunit.client.1.smithi099.stderr:++ image=sparse2 2024-01-13T18:41:50.673 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rbd info sparse2 2024-01-13T18:41:50.673 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep block_name_prefix 2024-01-13T18:41:50.673 INFO:tasks.workunit.client.1.smithi099.stderr:+++ awk '{print $NF;}' 2024-01-13T18:41:50.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:41:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:41:50] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:41:50.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:50.707 INFO:tasks.workunit.client.1.smithi099.stderr:++ prefix=rbd_data.d7a1ea3fa37e 2024-01-13T18:41:50.708 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep rbd_data.d7a1ea3fa37e 2024-01-13T18:41:50.708 INFO:tasks.workunit.client.1.smithi099.stderr:++++ get_image_data_pool sparse2 2024-01-13T18:41:50.708 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sed -e 's/rbd_data.d7a1ea3fa37e\.//' -e 's/^0*\([0-9a-f]\)/\1/' 2024-01-13T18:41:50.708 INFO:tasks.workunit.client.1.smithi099.stderr:++++ image=sparse2 2024-01-13T18:41:50.708 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sort -u 2024-01-13T18:41:50.709 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ rbd info sparse2 2024-01-13T18:41:50.709 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ grep 'data_pool: ' 2024-01-13T18:41:50.709 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ awk -F: '{ print $NF }' 2024-01-13T18:41:50.743 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool= 2024-01-13T18:41:50.743 INFO:tasks.workunit.client.1.smithi099.stderr:++++ '[' -z ']' 2024-01-13T18:41:50.743 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool=rbd 2024-01-13T18:41:50.743 INFO:tasks.workunit.client.1.smithi099.stderr:++++ echo rbd 2024-01-13T18:41:50.743 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rados ls -p rbd 2024-01-13T18:41:50.811 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects='0 2024-01-13T18:41:50.812 INFO:tasks.workunit.client.1.smithi099.stderr:2 2024-01-13T18:41:50.812 INFO:tasks.workunit.client.1.smithi099.stderr:3' 2024-01-13T18:41:50.812 INFO:tasks.workunit.client.1.smithi099.stderr:++ echo 0 2 3 2024-01-13T18:41:50.812 INFO:tasks.workunit.client.1.smithi099.stderr:+ '[' 0 -eq 1 -o '0 2 3' = '0 2 3' ']' 2024-01-13T18:41:50.812 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export sparse2 /tmp/rbd_import_export_200797/sparse2.out 2024-01-13T18:41:50.849 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 25% complete... Exporting image: 50% complete... Exporting image: 75% complete... Exporting image: 100% complete...done. 2024-01-13T18:41:50.852 INFO:tasks.workunit.client.1.smithi099.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_200797/sparse2 /tmp/rbd_import_export_200797/sparse2.out 2024-01-13T18:41:50.852 INFO:tasks.workunit.client.1.smithi099.stderr:+ cmp -l /tmp/rbd_import_export_200797/sparse2 /tmp/rbd_import_export_200797/sparse2.out 2024-01-13T18:41:50.855 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/sparse2 --format %b 2024-01-13T18:41:50.856 INFO:tasks.workunit.client.1.smithi099.stderr:+ origsize=6144 2024-01-13T18:41:50.856 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/sparse2.out --format %b 2024-01-13T18:41:50.857 INFO:tasks.workunit.client.1.smithi099.stderr:+ exportsize=6144 2024-01-13T18:41:50.857 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=0 2024-01-13T18:41:50.857 INFO:tasks.workunit.client.1.smithi099.stderr:+ difference=0 2024-01-13T18:41:50.858 INFO:tasks.workunit.client.1.smithi099.stderr:+ test 0 -ge 0 -a 0 -lt 4096 2024-01-13T18:41:50.858 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/sparse2.out 2024-01-13T18:41:50.859 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm sparse2 2024-01-13T18:41:50.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:41:50.976 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 25% complete... Removing image: 50% complete... Removing image: 75% complete... Removing image: 100% complete...done. 2024-01-13T18:41:50.979 INFO:tasks.workunit.client.1.smithi099.stderr:+ echo 'partially-sparse file imports to partially-sparse image' 2024-01-13T18:41:50.980 INFO:tasks.workunit.client.1.smithi099.stdout:partially-sparse file imports to partially-sparse image 2024-01-13T18:41:50.980 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --new-format --order 20 /tmp/rbd_import_export_200797/sparse1 sparse 2024-01-13T18:41:51.051 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 10% complete... Importing image: 20% complete... Importing image: 30% complete... Importing image: 40% complete... Importing image: 50% complete... Importing image: 60% complete... Importing image: 70% complete... Importing image: 80% complete... Importing image: 90% complete... Importing image: 100% complete...done. 2024-01-13T18:41:51.052 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --new-format is deprecated, use --image-format 2 2024-01-13T18:41:51.052 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --order is deprecated, use --object-size 2024-01-13T18:41:51.054 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects sparse 2024-01-13T18:41:51.054 INFO:tasks.workunit.client.1.smithi099.stderr:++ image=sparse 2024-01-13T18:41:51.055 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rbd info sparse 2024-01-13T18:41:51.055 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep block_name_prefix 2024-01-13T18:41:51.055 INFO:tasks.workunit.client.1.smithi099.stderr:+++ awk '{print $NF;}' 2024-01-13T18:41:51.089 INFO:tasks.workunit.client.1.smithi099.stderr:++ prefix=rbd_data.d7ce521af8bb 2024-01-13T18:41:51.091 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep rbd_data.d7ce521af8bb 2024-01-13T18:41:51.091 INFO:tasks.workunit.client.1.smithi099.stderr:++++ get_image_data_pool sparse 2024-01-13T18:41:51.091 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sed -e 's/rbd_data.d7ce521af8bb\.//' -e 's/^0*\([0-9a-f]\)/\1/' 2024-01-13T18:41:51.091 INFO:tasks.workunit.client.1.smithi099.stderr:++++ image=sparse 2024-01-13T18:41:51.091 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sort -u 2024-01-13T18:41:51.091 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ rbd info sparse 2024-01-13T18:41:51.091 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ grep 'data_pool: ' 2024-01-13T18:41:51.091 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ awk -F: '{ print $NF }' 2024-01-13T18:41:51.125 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool= 2024-01-13T18:41:51.125 INFO:tasks.workunit.client.1.smithi099.stderr:++++ '[' -z ']' 2024-01-13T18:41:51.125 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool=rbd 2024-01-13T18:41:51.125 INFO:tasks.workunit.client.1.smithi099.stderr:++++ echo rbd 2024-01-13T18:41:51.125 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rados ls -p rbd 2024-01-13T18:41:51.191 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects=1 2024-01-13T18:41:51.191 INFO:tasks.workunit.client.1.smithi099.stderr:++ echo 1 2024-01-13T18:41:51.191 INFO:tasks.workunit.client.1.smithi099.stderr:+ '[' 0 -eq 1 -o 1 = 1 ']' 2024-01-13T18:41:51.191 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm sparse 2024-01-13T18:41:51.305 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 10% complete... Removing image: 20% complete... Removing image: 30% complete... Removing image: 40% complete... Removing image: 50% complete... Removing image: 60% complete... Removing image: 70% complete... Removing image: 80% complete... Removing image: 90% complete... Removing image: 100% complete...done. 2024-01-13T18:41:51.308 INFO:tasks.workunit.client.1.smithi099.stdout:zeros import through stdin to sparse image 2024-01-13T18:41:51.308 INFO:tasks.workunit.client.1.smithi099.stderr:+ echo 'zeros import through stdin to sparse image' 2024-01-13T18:41:51.308 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/dev/zero bs=1M count=4 2024-01-13T18:41:51.308 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd import --new-format - sparse 2024-01-13T18:41:51.358 INFO:tasks.workunit.client.1.smithi099.stderr:4+0 records in 2024-01-13T18:41:51.358 INFO:tasks.workunit.client.1.smithi099.stderr:4+0 records out 2024-01-13T18:41:51.358 INFO:tasks.workunit.client.1.smithi099.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.0495071 s, 84.7 MB/s 2024-01-13T18:41:51.373 INFO:tasks.workunit.client.1.smithi099.stderr: Importing image: 100% complete...done. 2024-01-13T18:41:51.374 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --new-format is deprecated, use --image-format 2 2024-01-13T18:41:51.376 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects sparse 2024-01-13T18:41:51.376 INFO:tasks.workunit.client.1.smithi099.stderr:++ image=sparse 2024-01-13T18:41:51.377 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rbd info sparse 2024-01-13T18:41:51.377 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep block_name_prefix 2024-01-13T18:41:51.377 INFO:tasks.workunit.client.1.smithi099.stderr:+++ awk '{print $NF;}' 2024-01-13T18:41:51.411 INFO:tasks.workunit.client.1.smithi099.stderr:++ prefix=rbd_data.d7ef11d788fa 2024-01-13T18:41:51.411 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep rbd_data.d7ef11d788fa 2024-01-13T18:41:51.412 INFO:tasks.workunit.client.1.smithi099.stderr:++++ get_image_data_pool sparse 2024-01-13T18:41:51.412 INFO:tasks.workunit.client.1.smithi099.stderr:++++ image=sparse 2024-01-13T18:41:51.412 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sed -e 's/rbd_data.d7ef11d788fa\.//' -e 's/^0*\([0-9a-f]\)/\1/' 2024-01-13T18:41:51.412 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sort -u 2024-01-13T18:41:51.412 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ rbd info sparse 2024-01-13T18:41:51.412 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ grep 'data_pool: ' 2024-01-13T18:41:51.412 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ awk -F: '{ print $NF }' 2024-01-13T18:41:51.447 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool= 2024-01-13T18:41:51.447 INFO:tasks.workunit.client.1.smithi099.stderr:++++ '[' -z ']' 2024-01-13T18:41:51.447 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool=rbd 2024-01-13T18:41:51.447 INFO:tasks.workunit.client.1.smithi099.stderr:++++ echo rbd 2024-01-13T18:41:51.447 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rados ls -p rbd 2024-01-13T18:41:51.520 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects= 2024-01-13T18:41:51.521 INFO:tasks.workunit.client.1.smithi099.stderr:++ echo 2024-01-13T18:41:51.521 INFO:tasks.workunit.client.1.smithi099.stderr:+ '[' 0 -eq 1 -o '' = '' ']' 2024-01-13T18:41:51.521 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm sparse 2024-01-13T18:41:51.631 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 100% complete...done. 2024-01-13T18:41:51.633 INFO:tasks.workunit.client.1.smithi099.stderr:+ echo 'zeros export to sparse file' 2024-01-13T18:41:51.634 INFO:tasks.workunit.client.1.smithi099.stdout:zeros export to sparse file 2024-01-13T18:41:51.634 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd create --new-format sparse --size 4 2024-01-13T18:41:51.673 INFO:tasks.workunit.client.1.smithi099.stderr:rbd: --new-format is deprecated, use --image-format 2 2024-01-13T18:41:51.675 INFO:tasks.workunit.client.1.smithi099.stderr:++ rbd info sparse 2024-01-13T18:41:51.675 INFO:tasks.workunit.client.1.smithi099.stderr:++ grep block_name_prefix 2024-01-13T18:41:51.675 INFO:tasks.workunit.client.1.smithi099.stderr:++ awk '{print $NF;}' 2024-01-13T18:41:51.710 INFO:tasks.workunit.client.1.smithi099.stderr:+ prefix=rbd_data.d810f601d397 2024-01-13T18:41:51.710 INFO:tasks.workunit.client.1.smithi099.stderr:+ dd if=/dev/zero bs=4M count=1 2024-01-13T18:41:51.710 INFO:tasks.workunit.client.1.smithi099.stderr:++ get_image_data_pool sparse 2024-01-13T18:41:51.710 INFO:tasks.workunit.client.1.smithi099.stderr:++ image=sparse 2024-01-13T18:41:51.711 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rbd info sparse 2024-01-13T18:41:51.711 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep 'data_pool: ' 2024-01-13T18:41:51.711 INFO:tasks.workunit.client.1.smithi099.stderr:+++ awk -F: '{ print $NF }' 2024-01-13T18:41:51.745 INFO:tasks.workunit.client.1.smithi099.stderr:++ data_pool= 2024-01-13T18:41:51.745 INFO:tasks.workunit.client.1.smithi099.stderr:++ '[' -z ']' 2024-01-13T18:41:51.745 INFO:tasks.workunit.client.1.smithi099.stderr:++ data_pool=rbd 2024-01-13T18:41:51.745 INFO:tasks.workunit.client.1.smithi099.stderr:++ echo rbd 2024-01-13T18:41:51.745 INFO:tasks.workunit.client.1.smithi099.stderr:+ rados -p rbd put rbd_data.d810f601d397.000000000000 - 2024-01-13T18:41:51.774 INFO:tasks.workunit.client.1.smithi099.stderr:1+0 records in 2024-01-13T18:41:51.774 INFO:tasks.workunit.client.1.smithi099.stderr:1+0 records out 2024-01-13T18:41:51.774 INFO:tasks.workunit.client.1.smithi099.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.063292 s, 66.3 MB/s 2024-01-13T18:41:51.792 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects sparse 2024-01-13T18:41:51.792 INFO:tasks.workunit.client.1.smithi099.stderr:++ image=sparse 2024-01-13T18:41:51.792 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rbd info sparse 2024-01-13T18:41:51.792 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep block_name_prefix 2024-01-13T18:41:51.792 INFO:tasks.workunit.client.1.smithi099.stderr:+++ awk '{print $NF;}' 2024-01-13T18:41:51.826 INFO:tasks.workunit.client.1.smithi099.stderr:++ prefix=rbd_data.d810f601d397 2024-01-13T18:41:51.827 INFO:tasks.workunit.client.1.smithi099.stderr:+++ grep rbd_data.d810f601d397 2024-01-13T18:41:51.827 INFO:tasks.workunit.client.1.smithi099.stderr:++++ get_image_data_pool sparse 2024-01-13T18:41:51.827 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sed -e 's/rbd_data.d810f601d397\.//' -e 's/^0*\([0-9a-f]\)/\1/' 2024-01-13T18:41:51.827 INFO:tasks.workunit.client.1.smithi099.stderr:++++ image=sparse 2024-01-13T18:41:51.827 INFO:tasks.workunit.client.1.smithi099.stderr:+++ sort -u 2024-01-13T18:41:51.827 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ rbd info sparse 2024-01-13T18:41:51.828 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ grep 'data_pool: ' 2024-01-13T18:41:51.828 INFO:tasks.workunit.client.1.smithi099.stderr:+++++ awk -F: '{ print $NF }' 2024-01-13T18:41:51.861 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool= 2024-01-13T18:41:51.861 INFO:tasks.workunit.client.1.smithi099.stderr:++++ '[' -z ']' 2024-01-13T18:41:51.862 INFO:tasks.workunit.client.1.smithi099.stderr:++++ data_pool=rbd 2024-01-13T18:41:51.862 INFO:tasks.workunit.client.1.smithi099.stderr:++++ echo rbd 2024-01-13T18:41:51.862 INFO:tasks.workunit.client.1.smithi099.stderr:+++ rados ls -p rbd 2024-01-13T18:41:51.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:51 smithi099 ceph-mon[138788]: pgmap v2115: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 335 KiB/s rd, 206 KiB/s wr, 183 op/s 2024-01-13T18:41:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:51 smithi084 ceph-mon[116404]: pgmap v2115: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 335 KiB/s rd, 206 KiB/s wr, 183 op/s 2024-01-13T18:41:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:51 smithi084 ceph-mon[119097]: pgmap v2115: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 335 KiB/s rd, 206 KiB/s wr, 183 op/s 2024-01-13T18:41:51.927 INFO:tasks.workunit.client.1.smithi099.stderr:++ objects=0 2024-01-13T18:41:51.927 INFO:tasks.workunit.client.1.smithi099.stderr:++ echo 0 2024-01-13T18:41:51.927 INFO:tasks.workunit.client.1.smithi099.stderr:+ '[' 0 -eq 1 -o 0 = 0 ']' 2024-01-13T18:41:51.927 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/sparse 2024-01-13T18:41:51.928 INFO:tasks.workunit.client.1.smithi099.stderr:rm: cannot remove '/tmp/rbd_import_export_200797/sparse': No such file or directory 2024-01-13T18:41:51.928 INFO:tasks.workunit.client.1.smithi099.stderr:+ true 2024-01-13T18:41:51.928 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd export sparse /tmp/rbd_import_export_200797/sparse 2024-01-13T18:41:51.961 INFO:tasks.workunit.client.1.smithi099.stderr: Exporting image: 100% complete...done. 2024-01-13T18:41:51.966 INFO:tasks.workunit.client.1.smithi099.stderr:++ stat /tmp/rbd_import_export_200797/sparse --format=%b 2024-01-13T18:41:51.966 INFO:tasks.workunit.client.1.smithi099.stderr:+ '[' 0 = 0 ']' 2024-01-13T18:41:51.966 INFO:tasks.workunit.client.1.smithi099.stderr:+ rbd rm sparse 2024-01-13T18:41:52.073 INFO:tasks.workunit.client.1.smithi099.stderr: Removing image: 100% complete...done. 2024-01-13T18:41:52.076 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm /tmp/rbd_import_export_200797/sparse /tmp/rbd_import_export_200797/sparse1 /tmp/rbd_import_export_200797/sparse2 /tmp/rbd_import_export_200797/sparse3 2024-01-13T18:41:52.078 INFO:tasks.workunit.client.1.smithi099.stderr:rm: cannot remove '/tmp/rbd_import_export_200797/sparse3': No such file or directory 2024-01-13T18:41:52.078 INFO:tasks.workunit.client.1.smithi099.stderr:+ true 2024-01-13T18:41:52.078 INFO:tasks.workunit.client.1.smithi099.stdout:OK 2024-01-13T18:41:52.079 INFO:tasks.workunit.client.1.smithi099.stderr:+ echo OK 2024-01-13T18:41:52.079 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm -rf /tmp/rbd_import_export_200797 2024-01-13T18:41:52.080 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:41:52.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-01-13T18:41:52.150 INFO:tasks.workunit:Stopping ['rbd/import_export.sh'] on client.1... 2024-01-13T18:41:52.150 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-01-13T18:41:52.366 DEBUG:teuthology.parallel:result is None 2024-01-13T18:41:52.367 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-01-13T18:41:52.394 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-01-13T18:41:52.394 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.1 2024-01-13T18:41:52.452 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.1/client.1 2024-01-13T18:41:52.452 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-01-13T18:41:52.452 INFO:teuthology.task.print:**** done end rbd_import_export.yaml 2024-01-13T18:41:52.452 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-01-13T18:41:52.452 INFO:teuthology.task.print:**** done start test_rbd_api.yaml 2024-01-13T18:41:52.452 INFO:teuthology.task.full_sequential:In full_sequential, running task workunit... 2024-01-13T18:41:52.453 INFO:tasks.workunit:Pulling workunits from ref quincy 2024-01-13T18:41:52.453 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-13T18:41:52.453 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:41:52.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T18:41:52.472 INFO:teuthology.orchestra.run.smithi084.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-01-13T18:41:52.473 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:41:52.532 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-01-13T18:41:52.532 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-01-13T18:41:52.590 INFO:tasks.workunit:timeout=3h 2024-01-13T18:41:52.590 INFO:tasks.workunit:cleanup=True 2024-01-13T18:41:52.590 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch quincy https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 2024-01-13T18:41:52.648 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-13T18:41:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:52 smithi099 ceph-mon[138788]: pgmap v2116: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 496 KiB/s rd, 345 KiB/s wr, 223 op/s 2024-01-13T18:41:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:52 smithi084 ceph-mon[116404]: pgmap v2116: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 496 KiB/s rd, 345 KiB/s wr, 223 op/s 2024-01-13T18:41:53.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:52 smithi084 ceph-mon[119097]: pgmap v2116: 105 pgs: 105 active+clean; 583 KiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 496 KiB/s rd, 345 KiB/s wr, 223 op/s 2024-01-13T18:41:54.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:54 smithi084 ceph-mon[116404]: osdmap e1140: 8 total, 8 up, 8 in 2024-01-13T18:41:54.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:54 smithi084 ceph-mon[119097]: osdmap e1140: 8 total, 8 up, 8 in 2024-01-13T18:41:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:54 smithi099 ceph-mon[138788]: osdmap e1140: 8 total, 8 up, 8 in 2024-01-13T18:41:55.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:55 smithi084 ceph-mon[116404]: pgmap v2118: 105 pgs: 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 422 op/s 2024-01-13T18:41:55.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:55 smithi084 ceph-mon[119097]: pgmap v2118: 105 pgs: 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 422 op/s 2024-01-13T18:41:55.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:55 smithi099 ceph-mon[138788]: pgmap v2118: 105 pgs: 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 422 op/s 2024-01-13T18:41:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:56 smithi099 ceph-mon[138788]: pgmap v2119: 105 pgs: 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 997 KiB/s rd, 1.4 MiB/s wr, 335 op/s 2024-01-13T18:41:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:56 smithi084 ceph-mon[116404]: pgmap v2119: 105 pgs: 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 997 KiB/s rd, 1.4 MiB/s wr, 335 op/s 2024-01-13T18:41:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:56 smithi084 ceph-mon[119097]: pgmap v2119: 105 pgs: 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 997 KiB/s rd, 1.4 MiB/s wr, 335 op/s 2024-01-13T18:41:58.726 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-13T18:41:58.785 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-13T18:41:58.787 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-13T18:41:58.787 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-13T18:41:58.833 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-13T18:41:58.880 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-13T18:41:58.917 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-13T18:41:58.918 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-13T18:41:58.918 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-13T18:41:58.954 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-13T18:41:58.957 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T18:41:58.957 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-13T18:41:59.016 INFO:tasks.workunit:Running workunits matching rbd/test_librbd.sh on client.0... 2024-01-13T18:41:59.017 INFO:tasks.workunit:Running workunit rbd/test_librbd.sh... 2024-01-13T18:41:59.017 DEBUG:teuthology.orchestra.run.smithi084:workunit test rbd/test_librbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh 2024-01-13T18:41:59.102 INFO:tasks.workunit.client.0.smithi084.stderr:warning: failed to enable lockdep 2024-01-13T18:41:59.103 INFO:tasks.workunit.client.0.smithi084.stdout:seed 180317 2024-01-13T18:41:59.103 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] Running 409 tests from 16 test suites. 2024-01-13T18:41:59.103 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment set-up. 2024-01-13T18:41:59.103 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 159 tests from TestLibRBD 2024-01-13T18:41:59.130 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.CreateAndStat 2024-01-13T18:41:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:59 smithi084 ceph-mon[116404]: osdmap e1141: 8 total, 8 up, 8 in 2024-01-13T18:41:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:41:59 smithi084 ceph-mon[116404]: pgmap v2121: 105 pgs: 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 844 KiB/s rd, 1.3 MiB/s wr, 275 op/s 2024-01-13T18:41:59.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:59 smithi084 ceph-mon[119097]: osdmap e1141: 8 total, 8 up, 8 in 2024-01-13T18:41:59.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:41:59 smithi084 ceph-mon[119097]: pgmap v2121: 105 pgs: 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 844 KiB/s rd, 1.3 MiB/s wr, 275 op/s 2024-01-13T18:41:59.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:59 smithi099 ceph-mon[138788]: osdmap e1141: 8 total, 8 up, 8 in 2024-01-13T18:41:59.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:41:59 smithi099 ceph-mon[138788]: pgmap v2121: 105 pgs: 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 844 KiB/s rd, 1.3 MiB/s wr, 275 op/s 2024-01-13T18:42:00.435 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:42:00] "GET /metrics HTTP/1.1" 200 33979 "" "Prometheus/2.43.0" 2024-01-13T18:42:00.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:00 smithi084 ceph-mon[116404]: osdmap e1142: 8 total, 8 up, 8 in 2024-01-13T18:42:00.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:00 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/380092827' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:00.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:00 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:00 smithi084 ceph-mon[119097]: osdmap e1142: 8 total, 8 up, 8 in 2024-01-13T18:42:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:00 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/380092827' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:00 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:00.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:00 smithi099 ceph-mon[138788]: osdmap e1142: 8 total, 8 up, 8 in 2024-01-13T18:42:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:00 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/380092827' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:00 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:01 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:01 smithi099 ceph-mon[138788]: osdmap e1143: 8 total, 8 up, 8 in 2024-01-13T18:42:01.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:01 smithi099 ceph-mon[138788]: pgmap v2124: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 174 KiB/s rd, 171 KiB/s wr, 9 op/s 2024-01-13T18:42:01.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:01 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:01.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:01 smithi084 ceph-mon[116404]: osdmap e1143: 8 total, 8 up, 8 in 2024-01-13T18:42:01.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:01 smithi084 ceph-mon[116404]: pgmap v2124: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 174 KiB/s rd, 171 KiB/s wr, 9 op/s 2024-01-13T18:42:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:01 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:01 smithi084 ceph-mon[119097]: osdmap e1143: 8 total, 8 up, 8 in 2024-01-13T18:42:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:01 smithi084 ceph-mon[119097]: pgmap v2124: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 174 KiB/s rd, 171 KiB/s wr, 9 op/s 2024-01-13T18:42:02.462 INFO:tasks.workunit.client.0.smithi084.stdout:image has size 2097152 and order 22 2024-01-13T18:42:02.462 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.CreateAndStat (3332 ms) 2024-01-13T18:42:02.462 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.CreateWithSameDataPool 2024-01-13T18:42:02.463 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.480 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.CreateWithSameDataPool (18 ms) 2024-01-13T18:42:02.480 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.CreateAndStatPP 2024-01-13T18:42:02.480 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.499 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.CreateAndStatPP (18 ms) 2024-01-13T18:42:02.499 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.GetId 2024-01-13T18:42:02.499 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.524 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.GetId (25 ms) 2024-01-13T18:42:02.524 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.GetIdPP 2024-01-13T18:42:02.524 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.551 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.GetIdPP (28 ms) 2024-01-13T18:42:02.552 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefix 2024-01-13T18:42:02.552 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.568 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.GetBlockNamePrefix (17 ms) 2024-01-13T18:42:02.568 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefixPP 2024-01-13T18:42:02.569 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.586 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.GetBlockNamePrefixPP (18 ms) 2024-01-13T18:42:02.586 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestGetCreateTimestamp 2024-01-13T18:42:02.586 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.603 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestGetCreateTimestamp (17 ms) 2024-01-13T18:42:02.603 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.GetCreateTimestampPP 2024-01-13T18:42:02.603 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.619 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.GetCreateTimestampPP (16 ms) 2024-01-13T18:42:02.619 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.OpenAio 2024-01-13T18:42:02.619 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.635 INFO:tasks.workunit.client.0.smithi084.stdout:image has size 2097152 and order 22 2024-01-13T18:42:02.635 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.OpenAio (16 ms) 2024-01-13T18:42:02.635 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.OpenAioFail 2024-01-13T18:42:02.637 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.OpenAioFail (2 ms) 2024-01-13T18:42:02.638 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.OpenAioPP 2024-01-13T18:42:02.638 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.660 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.OpenAioPP (23 ms) 2024-01-13T18:42:02.660 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.OpenAioFailPP 2024-01-13T18:42:02.663 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.OpenAioFailPP (3 ms) 2024-01-13T18:42:02.663 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ResizeAndStat 2024-01-13T18:42:02.663 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.695 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ResizeAndStat (31 ms) 2024-01-13T18:42:02.695 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ResizeAndStatPP 2024-01-13T18:42:02.695 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.723 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ResizeAndStatPP (29 ms) 2024-01-13T18:42:02.723 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResize 2024-01-13T18:42:02.723 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.756 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.UpdateWatchAndResize (33 ms) 2024-01-13T18:42:02.756 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResizePP 2024-01-13T18:42:02.756 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:02.795 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.UpdateWatchAndResizePP (38 ms) 2024-01-13T18:42:02.795 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCreateLsDelete 2024-01-13T18:42:02.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:02 smithi099 ceph-mon[138788]: osdmap e1144: 8 total, 8 up, 8 in 2024-01-13T18:42:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:02 smithi084 ceph-mon[116404]: osdmap e1144: 8 total, 8 up, 8 in 2024-01-13T18:42:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:02 smithi084 ceph-mon[119097]: osdmap e1144: 8 total, 8 up, 8 in 2024-01-13T18:42:03.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:03 smithi099 ceph-mon[138788]: osdmap e1145: 8 total, 8 up, 8 in 2024-01-13T18:42:03.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:03 smithi099 ceph-mon[138788]: pgmap v2127: 137 pgs: 11 creating+peering, 6 unknown, 120 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-01-13T18:42:03.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:03 smithi084 ceph-mon[116404]: osdmap e1145: 8 total, 8 up, 8 in 2024-01-13T18:42:03.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:03 smithi084 ceph-mon[116404]: pgmap v2127: 137 pgs: 11 creating+peering, 6 unknown, 120 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-01-13T18:42:03.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:03 smithi084 ceph-mon[119097]: osdmap e1145: 8 total, 8 up, 8 in 2024-01-13T18:42:03.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:03 smithi084 ceph-mon[119097]: pgmap v2127: 137 pgs: 11 creating+peering, 6 unknown, 120 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-01-13T18:42:04.469 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:04.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:04 smithi099 ceph-mon[138788]: osdmap e1146: 8 total, 8 up, 8 in 2024-01-13T18:42:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:04 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1547288944' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:04 smithi084 ceph-mon[116404]: osdmap e1146: 8 total, 8 up, 8 in 2024-01-13T18:42:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:04 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1547288944' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:04 smithi084 ceph-mon[119097]: osdmap e1146: 8 total, 8 up, 8 in 2024-01-13T18:42:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:04 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1547288944' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:05 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1547288944' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:05 smithi099 ceph-mon[138788]: osdmap e1147: 8 total, 8 up, 8 in 2024-01-13T18:42:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:05 smithi099 ceph-mon[138788]: pgmap v2130: 169 pgs: 15 creating+peering, 28 unknown, 126 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 3.2 KiB/s wr, 30 op/s 2024-01-13T18:42:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:05 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1547288944' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:05 smithi084 ceph-mon[116404]: osdmap e1147: 8 total, 8 up, 8 in 2024-01-13T18:42:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:05 smithi084 ceph-mon[116404]: pgmap v2130: 169 pgs: 15 creating+peering, 28 unknown, 126 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 3.2 KiB/s wr, 30 op/s 2024-01-13T18:42:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:05 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1547288944' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:05 smithi084 ceph-mon[119097]: osdmap e1147: 8 total, 8 up, 8 in 2024-01-13T18:42:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:05 smithi084 ceph-mon[119097]: pgmap v2130: 169 pgs: 15 creating+peering, 28 unknown, 126 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 3.2 KiB/s wr, 30 op/s 2024-01-13T18:42:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:06.488 INFO:tasks.workunit.client.0.smithi084.stdout:image: image18 2024-01-13T18:42:06.489 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image18 2024-01-13T18:42:06.489 INFO:tasks.workunit.client.0.smithi084.stdout:found image18 2024-01-13T18:42:06.489 INFO:tasks.workunit.client.0.smithi084.stdout:erased image18 2024-01-13T18:42:06.489 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:06.565 INFO:tasks.workunit.client.0.smithi084.stdout:image: image18 2024-01-13T18:42:06.565 INFO:tasks.workunit.client.0.smithi084.stdout:image: image19 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image18 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:found image18 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:erased image18 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image19 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:found image19 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:erased image19 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:image: image19 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image19 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:found image19 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:erased image19 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCreateLsDelete (3771 ms) 2024-01-13T18:42:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCreateLsDeletePP 2024-01-13T18:42:06.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:06 smithi099 ceph-mon[138788]: osdmap e1148: 8 total, 8 up, 8 in 2024-01-13T18:42:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:06 smithi084 ceph-mon[116404]: osdmap e1148: 8 total, 8 up, 8 in 2024-01-13T18:42:06.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:06 smithi084 ceph-mon[119097]: osdmap e1148: 8 total, 8 up, 8 in 2024-01-13T18:42:07.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:07 smithi099 ceph-mon[138788]: osdmap e1149: 8 total, 8 up, 8 in 2024-01-13T18:42:07.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:07 smithi099 ceph-mon[138788]: pgmap v2133: 169 pgs: 4 creating+peering, 21 unknown, 144 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 63 KiB/s rd, 7.5 KiB/s wr, 94 op/s 2024-01-13T18:42:07.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:07 smithi084 ceph-mon[119097]: osdmap e1149: 8 total, 8 up, 8 in 2024-01-13T18:42:07.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:07 smithi084 ceph-mon[119097]: pgmap v2133: 169 pgs: 4 creating+peering, 21 unknown, 144 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 63 KiB/s rd, 7.5 KiB/s wr, 94 op/s 2024-01-13T18:42:07.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:07 smithi084 ceph-mon[116404]: osdmap e1149: 8 total, 8 up, 8 in 2024-01-13T18:42:07.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:07 smithi084 ceph-mon[116404]: pgmap v2133: 169 pgs: 4 creating+peering, 21 unknown, 144 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 63 KiB/s rd, 7.5 KiB/s wr, 94 op/s 2024-01-13T18:42:08.489 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:08.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:08 smithi099 ceph-mon[138788]: osdmap e1150: 8 total, 8 up, 8 in 2024-01-13T18:42:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:08 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1815581617' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:08 smithi084 ceph-mon[116404]: osdmap e1150: 8 total, 8 up, 8 in 2024-01-13T18:42:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:08 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1815581617' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:08 smithi084 ceph-mon[119097]: osdmap e1150: 8 total, 8 up, 8 in 2024-01-13T18:42:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:08 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1815581617' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:09 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1815581617' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:09 smithi099 ceph-mon[138788]: osdmap e1151: 8 total, 8 up, 8 in 2024-01-13T18:42:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:09 smithi099 ceph-mon[138788]: pgmap v2136: 201 pgs: 15 creating+peering, 21 unknown, 165 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 170 KiB/s rd, 19 KiB/s wr, 237 op/s 2024-01-13T18:42:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:09 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1815581617' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:09 smithi084 ceph-mon[116404]: osdmap e1151: 8 total, 8 up, 8 in 2024-01-13T18:42:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:09 smithi084 ceph-mon[116404]: pgmap v2136: 201 pgs: 15 creating+peering, 21 unknown, 165 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 170 KiB/s rd, 19 KiB/s wr, 237 op/s 2024-01-13T18:42:09.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:09 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1815581617' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:09.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:09 smithi084 ceph-mon[119097]: osdmap e1151: 8 total, 8 up, 8 in 2024-01-13T18:42:09.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:09 smithi084 ceph-mon[119097]: pgmap v2136: 201 pgs: 15 creating+peering, 21 unknown, 165 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 170 KiB/s rd, 19 KiB/s wr, 237 op/s 2024-01-13T18:42:10.514 INFO:tasks.workunit.client.0.smithi084.stdout:num images is: 1 2024-01-13T18:42:10.514 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:42:10.514 INFO:tasks.workunit.client.0.smithi084.stdout:image: image20 2024-01-13T18:42:10.514 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image20 2024-01-13T18:42:10.514 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:10.524 INFO:tasks.workunit.client.0.smithi084.stdout:num images is: 2 2024-01-13T18:42:10.524 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:42:10.524 INFO:tasks.workunit.client.0.smithi084.stdout:image: image20 2024-01-13T18:42:10.524 INFO:tasks.workunit.client.0.smithi084.stdout:image: image21 2024-01-13T18:42:10.524 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image20 2024-01-13T18:42:10.524 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image21 2024-01-13T18:42:10.581 INFO:tasks.workunit.client.0.smithi084.stdout:num images is: 1 2024-01-13T18:42:10.581 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:42:10.581 INFO:tasks.workunit.client.0.smithi084.stdout:image: image21 2024-01-13T18:42:10.581 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image21 2024-01-13T18:42:10.581 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCreateLsDeletePP (4015 ms) 2024-01-13T18:42:10.581 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCopy 2024-01-13T18:42:10.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:10 smithi084 ceph-mon[116404]: osdmap e1152: 8 total, 8 up, 8 in 2024-01-13T18:42:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:42:10] "GET /metrics HTTP/1.1" 200 38755 "" "Prometheus/2.43.0" 2024-01-13T18:42:10.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:10 smithi084 ceph-mon[119097]: osdmap e1152: 8 total, 8 up, 8 in 2024-01-13T18:42:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:10 smithi099 ceph-mon[138788]: osdmap e1152: 8 total, 8 up, 8 in 2024-01-13T18:42:11.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:11 smithi099 ceph-mon[138788]: osdmap e1153: 8 total, 8 up, 8 in 2024-01-13T18:42:11.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:11 smithi099 ceph-mon[138788]: pgmap v2139: 201 pgs: 11 creating+peering, 11 unknown, 179 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 146 KiB/s rd, 16 KiB/s wr, 197 op/s 2024-01-13T18:42:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:11 smithi084 ceph-mon[116404]: osdmap e1153: 8 total, 8 up, 8 in 2024-01-13T18:42:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:11 smithi084 ceph-mon[116404]: pgmap v2139: 201 pgs: 11 creating+peering, 11 unknown, 179 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 146 KiB/s rd, 16 KiB/s wr, 197 op/s 2024-01-13T18:42:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:11 smithi084 ceph-mon[119097]: osdmap e1153: 8 total, 8 up, 8 in 2024-01-13T18:42:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:11 smithi084 ceph-mon[119097]: pgmap v2139: 201 pgs: 11 creating+peering, 11 unknown, 179 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 146 KiB/s rd, 16 KiB/s wr, 197 op/s 2024-01-13T18:42:12.530 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:12 smithi099 ceph-mon[138788]: osdmap e1154: 8 total, 8 up, 8 in 2024-01-13T18:42:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:12 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2762030709' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:12 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:12 smithi084 ceph-mon[116404]: osdmap e1154: 8 total, 8 up, 8 in 2024-01-13T18:42:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:12 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2762030709' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:12 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:12 smithi084 ceph-mon[119097]: osdmap e1154: 8 total, 8 up, 8 in 2024-01-13T18:42:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:12 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2762030709' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:12 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:13 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:13 smithi099 ceph-mon[138788]: osdmap e1155: 8 total, 8 up, 8 in 2024-01-13T18:42:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:13 smithi099 ceph-mon[138788]: pgmap v2142: 233 pgs: 30 creating+peering, 13 unknown, 190 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 1.2 KiB/s wr, 28 op/s 2024-01-13T18:42:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:13 smithi099 ceph-mon[138788]: osdmap e1156: 8 total, 8 up, 8 in 2024-01-13T18:42:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:13 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:13 smithi084 ceph-mon[116404]: osdmap e1155: 8 total, 8 up, 8 in 2024-01-13T18:42:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:13 smithi084 ceph-mon[116404]: pgmap v2142: 233 pgs: 30 creating+peering, 13 unknown, 190 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 1.2 KiB/s wr, 28 op/s 2024-01-13T18:42:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:13 smithi084 ceph-mon[116404]: osdmap e1156: 8 total, 8 up, 8 in 2024-01-13T18:42:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:13 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:13 smithi084 ceph-mon[119097]: osdmap e1155: 8 total, 8 up, 8 in 2024-01-13T18:42:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:13 smithi084 ceph-mon[119097]: pgmap v2142: 233 pgs: 30 creating+peering, 13 unknown, 190 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 1.2 KiB/s wr, 28 op/s 2024-01-13T18:42:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:13 smithi084 ceph-mon[119097]: osdmap e1156: 8 total, 8 up, 8 in 2024-01-13T18:42:14.755 INFO:tasks.workunit.client.0.smithi084.stdout:image: image22 2024-01-13T18:42:14.755 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image22 2024-01-13T18:42:14.755 INFO:tasks.workunit.client.0.smithi084.stdout:found image22 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:erased image22 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:image: image22 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:image: image23 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image22 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:found image22 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:erased image22 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image23 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:found image23 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:erased image23 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:100.00% done 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:image: image22 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:image: image23 2024-01-13T18:42:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:image: image24 2024-01-13T18:42:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image22 2024-01-13T18:42:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:found image22 2024-01-13T18:42:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:erased image22 2024-01-13T18:42:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image23 2024-01-13T18:42:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:found image23 2024-01-13T18:42:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:erased image23 2024-01-13T18:42:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image24 2024-01-13T18:42:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:found image24 2024-01-13T18:42:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:erased image24 2024-01-13T18:42:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCopy (4175 ms) 2024-01-13T18:42:14.757 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCopyPP 2024-01-13T18:42:15.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:15 smithi084 ceph-mon[116404]: osdmap e1157: 8 total, 8 up, 8 in 2024-01-13T18:42:15.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:15 smithi084 ceph-mon[116404]: pgmap v2145: 233 pgs: 19 creating+peering, 1 unknown, 213 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 24 KiB/s rd, 2.0 KiB/s wr, 35 op/s 2024-01-13T18:42:15.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:15 smithi084 ceph-mon[119097]: osdmap e1157: 8 total, 8 up, 8 in 2024-01-13T18:42:15.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:15 smithi084 ceph-mon[119097]: pgmap v2145: 233 pgs: 19 creating+peering, 1 unknown, 213 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 24 KiB/s rd, 2.0 KiB/s wr, 35 op/s 2024-01-13T18:42:15.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:15 smithi099 ceph-mon[138788]: osdmap e1157: 8 total, 8 up, 8 in 2024-01-13T18:42:15.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:15 smithi099 ceph-mon[138788]: pgmap v2145: 233 pgs: 19 creating+peering, 1 unknown, 213 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 24 KiB/s rd, 2.0 KiB/s wr, 35 op/s 2024-01-13T18:42:16.453 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:16.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:16 smithi084 ceph-mon[116404]: osdmap e1158: 8 total, 8 up, 8 in 2024-01-13T18:42:16.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:16 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1941679559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:16.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:16 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:16.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:16 smithi084 ceph-mon[119097]: osdmap e1158: 8 total, 8 up, 8 in 2024-01-13T18:42:16.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:16 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1941679559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:16.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:16 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:16.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:16 smithi099 ceph-mon[138788]: osdmap e1158: 8 total, 8 up, 8 in 2024-01-13T18:42:16.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:16 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1941679559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:16 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:17 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:17 smithi099 ceph-mon[138788]: osdmap e1159: 8 total, 8 up, 8 in 2024-01-13T18:42:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:17 smithi099 ceph-mon[138788]: pgmap v2148: 265 pgs: 32 unknown, 19 creating+peering, 214 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 24 KiB/s rd, 2.7 KiB/s wr, 36 op/s 2024-01-13T18:42:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:17 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:17 smithi084 ceph-mon[116404]: osdmap e1159: 8 total, 8 up, 8 in 2024-01-13T18:42:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:17 smithi084 ceph-mon[116404]: pgmap v2148: 265 pgs: 32 unknown, 19 creating+peering, 214 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 24 KiB/s rd, 2.7 KiB/s wr, 36 op/s 2024-01-13T18:42:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:17 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:17 smithi084 ceph-mon[119097]: osdmap e1159: 8 total, 8 up, 8 in 2024-01-13T18:42:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:17 smithi084 ceph-mon[119097]: pgmap v2148: 265 pgs: 32 unknown, 19 creating+peering, 214 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 24 KiB/s rd, 2.7 KiB/s wr, 36 op/s 2024-01-13T18:42:18.721 INFO:tasks.workunit.client.0.smithi084.stdout:num images is: 1 2024-01-13T18:42:18.721 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:42:18.721 INFO:tasks.workunit.client.0.smithi084.stdout:image: image25 2024-01-13T18:42:18.721 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image25 2024-01-13T18:42:18.742 INFO:tasks.workunit.client.0.smithi084.stdout:num images is: 2 2024-01-13T18:42:18.742 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:42:18.742 INFO:tasks.workunit.client.0.smithi084.stdout:image: image25 2024-01-13T18:42:18.742 INFO:tasks.workunit.client.0.smithi084.stdout:image: image26 2024-01-13T18:42:18.742 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image25 2024-01-13T18:42:18.742 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image26 2024-01-13T18:42:18.784 INFO:tasks.workunit.client.0.smithi084.stdout:100.00% done 2024-01-13T18:42:18.784 INFO:tasks.workunit.client.0.smithi084.stdout:num images is: 3 2024-01-13T18:42:18.784 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 3 2024-01-13T18:42:18.784 INFO:tasks.workunit.client.0.smithi084.stdout:image: image25 2024-01-13T18:42:18.785 INFO:tasks.workunit.client.0.smithi084.stdout:image: image26 2024-01-13T18:42:18.785 INFO:tasks.workunit.client.0.smithi084.stdout:image: image27 2024-01-13T18:42:18.785 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image25 2024-01-13T18:42:18.785 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image26 2024-01-13T18:42:18.785 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image27 2024-01-13T18:42:18.817 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCopyPP (4061 ms) 2024-01-13T18:42:18.817 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestDeepCopy 2024-01-13T18:42:18.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:18 smithi099 ceph-mon[138788]: osdmap e1160: 8 total, 8 up, 8 in 2024-01-13T18:42:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:18 smithi099 ceph-mon[138788]: osdmap e1161: 8 total, 8 up, 8 in 2024-01-13T18:42:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:18 smithi084 ceph-mon[119097]: osdmap e1160: 8 total, 8 up, 8 in 2024-01-13T18:42:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:18 smithi084 ceph-mon[119097]: osdmap e1161: 8 total, 8 up, 8 in 2024-01-13T18:42:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:18 smithi084 ceph-mon[116404]: osdmap e1160: 8 total, 8 up, 8 in 2024-01-13T18:42:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:18 smithi084 ceph-mon[116404]: osdmap e1161: 8 total, 8 up, 8 in 2024-01-13T18:42:19.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:19 smithi099 ceph-mon[138788]: pgmap v2151: 265 pgs: 9 unknown, 256 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 324 KiB/s rd, 22 KiB/s wr, 381 op/s 2024-01-13T18:42:19.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:19 smithi084 ceph-mon[116404]: pgmap v2151: 265 pgs: 9 unknown, 256 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 324 KiB/s rd, 22 KiB/s wr, 381 op/s 2024-01-13T18:42:19.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:19 smithi084 ceph-mon[119097]: pgmap v2151: 265 pgs: 9 unknown, 256 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 324 KiB/s rd, 22 KiB/s wr, 381 op/s 2024-01-13T18:42:20.472 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:42:20] "GET /metrics HTTP/1.1" 200 48360 "" "Prometheus/2.43.0" 2024-01-13T18:42:20.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:20 smithi084 ceph-mon[116404]: osdmap e1162: 8 total, 8 up, 8 in 2024-01-13T18:42:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:20 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544879669' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:20 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:20 smithi084 ceph-mon[119097]: osdmap e1162: 8 total, 8 up, 8 in 2024-01-13T18:42:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:20 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544879669' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:20 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:20.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:20 smithi099 ceph-mon[138788]: osdmap e1162: 8 total, 8 up, 8 in 2024-01-13T18:42:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:20 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544879669' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:20 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:21.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:21 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:21.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:21 smithi099 ceph-mon[138788]: osdmap e1163: 8 total, 8 up, 8 in 2024-01-13T18:42:21.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:21 smithi099 ceph-mon[138788]: pgmap v2154: 297 pgs: 10 creating+peering, 22 unknown, 265 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 364 KiB/s rd, 23 KiB/s wr, 425 op/s 2024-01-13T18:42:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:21 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:21 smithi084 ceph-mon[116404]: osdmap e1163: 8 total, 8 up, 8 in 2024-01-13T18:42:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:21 smithi084 ceph-mon[116404]: pgmap v2154: 297 pgs: 10 creating+peering, 22 unknown, 265 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 364 KiB/s rd, 23 KiB/s wr, 425 op/s 2024-01-13T18:42:21.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:21 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:21.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:21 smithi084 ceph-mon[119097]: osdmap e1163: 8 total, 8 up, 8 in 2024-01-13T18:42:21.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:21 smithi084 ceph-mon[119097]: pgmap v2154: 297 pgs: 10 creating+peering, 22 unknown, 265 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 364 KiB/s rd, 23 KiB/s wr, 425 op/s 2024-01-13T18:42:22.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:22 smithi099 ceph-mon[138788]: osdmap e1164: 8 total, 8 up, 8 in 2024-01-13T18:42:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:22 smithi084 ceph-mon[119097]: osdmap e1164: 8 total, 8 up, 8 in 2024-01-13T18:42:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:22 smithi084 ceph-mon[116404]: osdmap e1164: 8 total, 8 up, 8 in 2024-01-13T18:42:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:23 smithi099 ceph-mon[138788]: osdmap e1165: 8 total, 8 up, 8 in 2024-01-13T18:42:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:23 smithi099 ceph-mon[138788]: pgmap v2157: 297 pgs: 10 creating+peering, 7 unknown, 280 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 361 KiB/s rd, 22 KiB/s wr, 419 op/s 2024-01-13T18:42:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:23 smithi099 ceph-mon[138788]: osdmap e1166: 8 total, 8 up, 8 in 2024-01-13T18:42:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:23 smithi084 ceph-mon[116404]: osdmap e1165: 8 total, 8 up, 8 in 2024-01-13T18:42:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:23 smithi084 ceph-mon[116404]: pgmap v2157: 297 pgs: 10 creating+peering, 7 unknown, 280 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 361 KiB/s rd, 22 KiB/s wr, 419 op/s 2024-01-13T18:42:23.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:23 smithi084 ceph-mon[116404]: osdmap e1166: 8 total, 8 up, 8 in 2024-01-13T18:42:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:23 smithi084 ceph-mon[119097]: osdmap e1165: 8 total, 8 up, 8 in 2024-01-13T18:42:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:23 smithi084 ceph-mon[119097]: pgmap v2157: 297 pgs: 10 creating+peering, 7 unknown, 280 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 361 KiB/s rd, 22 KiB/s wr, 419 op/s 2024-01-13T18:42:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:23 smithi084 ceph-mon[119097]: osdmap e1166: 8 total, 8 up, 8 in 2024-01-13T18:42:25.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:25 smithi099 ceph-mon[138788]: osdmap e1167: 8 total, 8 up, 8 in 2024-01-13T18:42:25.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:25 smithi099 ceph-mon[138788]: pgmap v2160: 297 pgs: 10 creating+peering, 287 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 342 KiB/s rd, 21 KiB/s wr, 399 op/s 2024-01-13T18:42:25.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:25 smithi084 ceph-mon[116404]: osdmap e1167: 8 total, 8 up, 8 in 2024-01-13T18:42:25.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:25 smithi084 ceph-mon[116404]: pgmap v2160: 297 pgs: 10 creating+peering, 287 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 342 KiB/s rd, 21 KiB/s wr, 399 op/s 2024-01-13T18:42:25.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:25 smithi084 ceph-mon[119097]: osdmap e1167: 8 total, 8 up, 8 in 2024-01-13T18:42:25.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:25 smithi084 ceph-mon[119097]: pgmap v2160: 297 pgs: 10 creating+peering, 287 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 342 KiB/s rd, 21 KiB/s wr, 399 op/s 2024-01-13T18:42:26.565 INFO:tasks.workunit.client.0.smithi084.stdout:image: image28 2024-01-13T18:42:26.565 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image28 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:found image28 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:erased image28 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:image: image28 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:image: image29 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image28 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:found image28 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:erased image28 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image29 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:found image29 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:erased image29 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:100.00% done 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:image: image28 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:image: image29 2024-01-13T18:42:26.566 INFO:tasks.workunit.client.0.smithi084.stdout:image: image30 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image28 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:found image28 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:erased image28 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image29 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:found image29 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:erased image29 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image30 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:found image30 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:erased image30 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:image: image28 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:image: image29 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:image: image30 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:image: image31 2024-01-13T18:42:26.567 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image28 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:found image28 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:erased image28 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image29 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:found image29 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:erased image29 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image30 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:found image30 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:erased image30 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image31 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:found image31 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:erased image31 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:image: image28 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:image: image29 2024-01-13T18:42:26.568 INFO:tasks.workunit.client.0.smithi084.stdout:image: image30 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:image: image31 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:image: image32 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image28 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:found image28 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:erased image28 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image29 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:found image29 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:erased image29 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image30 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:found image30 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:erased image30 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image31 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:found image31 2024-01-13T18:42:26.569 INFO:tasks.workunit.client.0.smithi084.stdout:erased image31 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image32 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:found image32 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:erased image32 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:100.00% done 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:image: image28 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:image: image29 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:image: image30 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:image: image31 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:image: image32 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:image: image33 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image28 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:found image28 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:erased image28 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image29 2024-01-13T18:42:26.570 INFO:tasks.workunit.client.0.smithi084.stdout:found image29 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:erased image29 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image30 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:found image30 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:erased image30 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image31 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:found image31 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:erased image31 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image32 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:found image32 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:erased image32 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image33 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:found image33 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:erased image33 2024-01-13T18:42:26.571 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestDeepCopy (7749 ms) 2024-01-13T18:42:26.572 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestDeepCopyPP 2024-01-13T18:42:26.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:26 smithi099 ceph-mon[138788]: osdmap e1168: 8 total, 8 up, 8 in 2024-01-13T18:42:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:26 smithi084 ceph-mon[116404]: osdmap e1168: 8 total, 8 up, 8 in 2024-01-13T18:42:26.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:26 smithi084 ceph-mon[119097]: osdmap e1168: 8 total, 8 up, 8 in 2024-01-13T18:42:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:27 smithi099 ceph-mon[138788]: osdmap e1169: 8 total, 8 up, 8 in 2024-01-13T18:42:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:27 smithi099 ceph-mon[138788]: pgmap v2163: 297 pgs: 297 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 26 KiB/s rd, 2.2 KiB/s wr, 37 op/s 2024-01-13T18:42:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:27 smithi084 ceph-mon[116404]: osdmap e1169: 8 total, 8 up, 8 in 2024-01-13T18:42:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:27 smithi084 ceph-mon[116404]: pgmap v2163: 297 pgs: 297 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 26 KiB/s rd, 2.2 KiB/s wr, 37 op/s 2024-01-13T18:42:27.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:27 smithi084 ceph-mon[119097]: osdmap e1169: 8 total, 8 up, 8 in 2024-01-13T18:42:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:27 smithi084 ceph-mon[119097]: pgmap v2163: 297 pgs: 297 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 26 KiB/s rd, 2.2 KiB/s wr, 37 op/s 2024-01-13T18:42:28.436 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:28 smithi099 ceph-mon[138788]: osdmap e1170: 8 total, 8 up, 8 in 2024-01-13T18:42:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:28 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3558818661' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:28 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:28 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:28 smithi099 ceph-mon[138788]: osdmap e1171: 8 total, 8 up, 8 in 2024-01-13T18:42:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:28 smithi084 ceph-mon[116404]: osdmap e1170: 8 total, 8 up, 8 in 2024-01-13T18:42:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:28 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3558818661' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:28 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:28 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:28 smithi084 ceph-mon[116404]: osdmap e1171: 8 total, 8 up, 8 in 2024-01-13T18:42:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:28 smithi084 ceph-mon[119097]: osdmap e1170: 8 total, 8 up, 8 in 2024-01-13T18:42:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:28 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3558818661' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:28 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:28 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:28 smithi084 ceph-mon[119097]: osdmap e1171: 8 total, 8 up, 8 in 2024-01-13T18:42:29.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:29 smithi099 ceph-mon[138788]: pgmap v2166: 329 pgs: 9 creating+peering, 23 unknown, 297 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 517 KiB/s rd, 31 KiB/s wr, 611 op/s 2024-01-13T18:42:29.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:29 smithi099 ceph-mon[138788]: osdmap e1172: 8 total, 8 up, 8 in 2024-01-13T18:42:29.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:29 smithi084 ceph-mon[116404]: pgmap v2166: 329 pgs: 9 creating+peering, 23 unknown, 297 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 517 KiB/s rd, 31 KiB/s wr, 611 op/s 2024-01-13T18:42:29.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:29 smithi084 ceph-mon[116404]: osdmap e1172: 8 total, 8 up, 8 in 2024-01-13T18:42:29.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:29 smithi084 ceph-mon[119097]: pgmap v2166: 329 pgs: 9 creating+peering, 23 unknown, 297 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 517 KiB/s rd, 31 KiB/s wr, 611 op/s 2024-01-13T18:42:29.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:29 smithi084 ceph-mon[119097]: osdmap e1172: 8 total, 8 up, 8 in 2024-01-13T18:42:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:42:30] "GET /metrics HTTP/1.1" 200 48360 "" "Prometheus/2.43.0" 2024-01-13T18:42:30.694 INFO:tasks.workunit.client.0.smithi084.stdout:num images is: 1 2024-01-13T18:42:30.694 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:42:30.694 INFO:tasks.workunit.client.0.smithi084.stdout:image: image34 2024-01-13T18:42:30.694 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image34 2024-01-13T18:42:30.719 INFO:tasks.workunit.client.0.smithi084.stdout:num images is: 2 2024-01-13T18:42:30.719 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:42:30.720 INFO:tasks.workunit.client.0.smithi084.stdout:image: image34 2024-01-13T18:42:30.720 INFO:tasks.workunit.client.0.smithi084.stdout:image: image35 2024-01-13T18:42:30.720 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image34 2024-01-13T18:42:30.720 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image35 2024-01-13T18:42:30.766 INFO:tasks.workunit.client.0.smithi084.stdout:100.00% done 2024-01-13T18:42:30.767 INFO:tasks.workunit.client.0.smithi084.stdout:num images is: 3 2024-01-13T18:42:30.767 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 3 2024-01-13T18:42:30.767 INFO:tasks.workunit.client.0.smithi084.stdout:image: image34 2024-01-13T18:42:30.767 INFO:tasks.workunit.client.0.smithi084.stdout:image: image35 2024-01-13T18:42:30.767 INFO:tasks.workunit.client.0.smithi084.stdout:image: image36 2024-01-13T18:42:30.767 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image34 2024-01-13T18:42:30.767 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image35 2024-01-13T18:42:30.767 INFO:tasks.workunit.client.0.smithi084.stdout:expected = image36 2024-01-13T18:42:30.796 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestDeepCopyPP (4231 ms) 2024-01-13T18:42:30.797 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnap 2024-01-13T18:42:30.797 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:31.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:31 smithi099 ceph-mon[138788]: osdmap e1173: 8 total, 8 up, 8 in 2024-01-13T18:42:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:31 smithi099 ceph-mon[138788]: pgmap v2169: 329 pgs: 9 creating+peering, 13 unknown, 307 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 522 KiB/s rd, 30 KiB/s wr, 614 op/s 2024-01-13T18:42:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:31 smithi084 ceph-mon[116404]: osdmap e1173: 8 total, 8 up, 8 in 2024-01-13T18:42:31.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:31 smithi084 ceph-mon[116404]: pgmap v2169: 329 pgs: 9 creating+peering, 13 unknown, 307 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 522 KiB/s rd, 30 KiB/s wr, 614 op/s 2024-01-13T18:42:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:31 smithi084 ceph-mon[119097]: osdmap e1173: 8 total, 8 up, 8 in 2024-01-13T18:42:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:31 smithi084 ceph-mon[119097]: pgmap v2169: 329 pgs: 9 creating+peering, 13 unknown, 307 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 522 KiB/s rd, 30 KiB/s wr, 614 op/s 2024-01-13T18:42:32.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:32 smithi099 ceph-mon[138788]: osdmap e1174: 8 total, 8 up, 8 in 2024-01-13T18:42:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:32 smithi084 ceph-mon[116404]: osdmap e1174: 8 total, 8 up, 8 in 2024-01-13T18:42:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:32 smithi084 ceph-mon[119097]: osdmap e1174: 8 total, 8 up, 8 in 2024-01-13T18:42:33.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:33 smithi099 ceph-mon[138788]: osdmap e1175: 8 total, 8 up, 8 in 2024-01-13T18:42:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:33 smithi099 ceph-mon[138788]: pgmap v2172: 329 pgs: 9 creating+peering, 320 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 316 KiB/s rd, 20 KiB/s wr, 375 op/s 2024-01-13T18:42:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:33 smithi099 ceph-mon[138788]: osdmap e1176: 8 total, 8 up, 8 in 2024-01-13T18:42:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:33 smithi084 ceph-mon[116404]: osdmap e1175: 8 total, 8 up, 8 in 2024-01-13T18:42:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:33 smithi084 ceph-mon[116404]: pgmap v2172: 329 pgs: 9 creating+peering, 320 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 316 KiB/s rd, 20 KiB/s wr, 375 op/s 2024-01-13T18:42:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:33 smithi084 ceph-mon[116404]: osdmap e1176: 8 total, 8 up, 8 in 2024-01-13T18:42:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:33 smithi084 ceph-mon[119097]: osdmap e1175: 8 total, 8 up, 8 in 2024-01-13T18:42:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:33 smithi084 ceph-mon[119097]: pgmap v2172: 329 pgs: 9 creating+peering, 320 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 316 KiB/s rd, 20 KiB/s wr, 375 op/s 2024-01-13T18:42:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:33 smithi084 ceph-mon[119097]: osdmap e1176: 8 total, 8 up, 8 in 2024-01-13T18:42:34.439 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 1 2024-01-13T18:42:34.440 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:42:34.440 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap1 2024-01-13T18:42:34.440 INFO:tasks.workunit.client.0.smithi084.stdout:found snap1 with size 2097152 2024-01-13T18:42:34.440 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 2 2024-01-13T18:42:34.440 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:42:34.440 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap1 2024-01-13T18:42:34.440 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap2 2024-01-13T18:42:34.440 INFO:tasks.workunit.client.0.smithi084.stdout:found snap1 with size 2097152 2024-01-13T18:42:34.440 INFO:tasks.workunit.client.0.smithi084.stdout:found snap2 with size 4194304 2024-01-13T18:42:34.440 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 1 2024-01-13T18:42:34.441 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:42:34.441 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap2 2024-01-13T18:42:34.441 INFO:tasks.workunit.client.0.smithi084.stdout:found snap2 with size 4194304 2024-01-13T18:42:34.441 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 0 2024-01-13T18:42:34.441 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 0 2024-01-13T18:42:34.441 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnap (3643 ms) 2024-01-13T18:42:34.441 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestGetSnapShotTimeStamp 2024-01-13T18:42:34.441 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:35.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:35 smithi084 ceph-mon[116404]: osdmap e1177: 8 total, 8 up, 8 in 2024-01-13T18:42:35.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:35 smithi084 ceph-mon[116404]: pgmap v2175: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 365 KiB/s rd, 24 KiB/s wr, 434 op/s 2024-01-13T18:42:35.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:35.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:35 smithi084 ceph-mon[119097]: osdmap e1177: 8 total, 8 up, 8 in 2024-01-13T18:42:35.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:35 smithi084 ceph-mon[119097]: pgmap v2175: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 365 KiB/s rd, 24 KiB/s wr, 434 op/s 2024-01-13T18:42:35.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:35 smithi099 ceph-mon[138788]: osdmap e1177: 8 total, 8 up, 8 in 2024-01-13T18:42:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:35 smithi099 ceph-mon[138788]: pgmap v2175: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 365 KiB/s rd, 24 KiB/s wr, 434 op/s 2024-01-13T18:42:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:36.450 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestGetSnapShotTimeStamp (2010 ms) 2024-01-13T18:42:36.450 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnapPP 2024-01-13T18:42:36.450 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:36.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:36 smithi099 ceph-mon[138788]: osdmap e1178: 8 total, 8 up, 8 in 2024-01-13T18:42:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:36 smithi084 ceph-mon[119097]: osdmap e1178: 8 total, 8 up, 8 in 2024-01-13T18:42:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:36 smithi084 ceph-mon[116404]: osdmap e1178: 8 total, 8 up, 8 in 2024-01-13T18:42:37.474 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 1 2024-01-13T18:42:37.474 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:42:37.474 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap1 2024-01-13T18:42:37.474 INFO:tasks.workunit.client.0.smithi084.stdout:found snap1 with size 2097152 2024-01-13T18:42:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:37 smithi099 ceph-mon[138788]: osdmap e1179: 8 total, 8 up, 8 in 2024-01-13T18:42:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:37 smithi099 ceph-mon[138788]: pgmap v2178: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 63 KiB/s rd, 4.2 KiB/s wr, 79 op/s 2024-01-13T18:42:37.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:37 smithi084 ceph-mon[119097]: osdmap e1179: 8 total, 8 up, 8 in 2024-01-13T18:42:37.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:37 smithi084 ceph-mon[119097]: pgmap v2178: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 63 KiB/s rd, 4.2 KiB/s wr, 79 op/s 2024-01-13T18:42:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:37 smithi084 ceph-mon[116404]: osdmap e1179: 8 total, 8 up, 8 in 2024-01-13T18:42:37.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:37 smithi084 ceph-mon[116404]: pgmap v2178: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 63 KiB/s rd, 4.2 KiB/s wr, 79 op/s 2024-01-13T18:42:38.432 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 2 2024-01-13T18:42:38.432 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:42:38.432 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap1 2024-01-13T18:42:38.433 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap2 2024-01-13T18:42:38.433 INFO:tasks.workunit.client.0.smithi084.stdout:found snap1 with size 2097152 2024-01-13T18:42:38.433 INFO:tasks.workunit.client.0.smithi084.stdout:found snap2 with size 4194304 2024-01-13T18:42:38.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:38 smithi099 ceph-mon[138788]: osdmap e1180: 8 total, 8 up, 8 in 2024-01-13T18:42:38.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:38 smithi099 ceph-mon[138788]: osdmap e1181: 8 total, 8 up, 8 in 2024-01-13T18:42:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:38 smithi084 ceph-mon[116404]: osdmap e1180: 8 total, 8 up, 8 in 2024-01-13T18:42:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:38 smithi084 ceph-mon[116404]: osdmap e1181: 8 total, 8 up, 8 in 2024-01-13T18:42:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:38 smithi084 ceph-mon[119097]: osdmap e1180: 8 total, 8 up, 8 in 2024-01-13T18:42:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:38 smithi084 ceph-mon[119097]: osdmap e1181: 8 total, 8 up, 8 in 2024-01-13T18:42:39.443 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 1 2024-01-13T18:42:39.443 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:42:39.443 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap2 2024-01-13T18:42:39.443 INFO:tasks.workunit.client.0.smithi084.stdout:found snap2 with size 4194304 2024-01-13T18:42:39.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:39 smithi099 ceph-mon[138788]: pgmap v2181: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 33 KiB/s rd, 5.0 KiB/s wr, 49 op/s 2024-01-13T18:42:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:39 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:42:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:39 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:42:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:39 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:42:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:39 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:42:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:39 smithi099 ceph-mon[138788]: osdmap e1182: 8 total, 8 up, 8 in 2024-01-13T18:42:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[116404]: pgmap v2181: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 33 KiB/s rd, 5.0 KiB/s wr, 49 op/s 2024-01-13T18:42:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:42:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:42:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:42:39.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:42:39.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[116404]: osdmap e1182: 8 total, 8 up, 8 in 2024-01-13T18:42:39.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[119097]: pgmap v2181: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 33 KiB/s rd, 5.0 KiB/s wr, 49 op/s 2024-01-13T18:42:39.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:42:39.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:42:39.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:42:39.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:42:39.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:39 smithi084 ceph-mon[119097]: osdmap e1182: 8 total, 8 up, 8 in 2024-01-13T18:42:40.477 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 0 2024-01-13T18:42:40.477 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 0 2024-01-13T18:42:40.482 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnapPP (4032 ms) 2024-01-13T18:42:40.482 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestGetNameIdSnapPP 2024-01-13T18:42:40.482 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:42:40] "GET /metrics HTTP/1.1" 200 50829 "" "Prometheus/2.43.0" 2024-01-13T18:42:41.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:41 smithi099 ceph-mon[138788]: osdmap e1183: 8 total, 8 up, 8 in 2024-01-13T18:42:41.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:41 smithi099 ceph-mon[138788]: pgmap v2184: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 77 KiB/s rd, 9.5 KiB/s wr, 106 op/s 2024-01-13T18:42:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:41 smithi084 ceph-mon[116404]: osdmap e1183: 8 total, 8 up, 8 in 2024-01-13T18:42:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:41 smithi084 ceph-mon[116404]: pgmap v2184: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 77 KiB/s rd, 9.5 KiB/s wr, 106 op/s 2024-01-13T18:42:41.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:41 smithi084 ceph-mon[119097]: osdmap e1183: 8 total, 8 up, 8 in 2024-01-13T18:42:41.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:41 smithi084 ceph-mon[119097]: pgmap v2184: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 77 KiB/s rd, 9.5 KiB/s wr, 106 op/s 2024-01-13T18:42:42.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:42 smithi099 ceph-mon[138788]: osdmap e1184: 8 total, 8 up, 8 in 2024-01-13T18:42:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:42 smithi084 ceph-mon[116404]: osdmap e1184: 8 total, 8 up, 8 in 2024-01-13T18:42:42.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:42 smithi084 ceph-mon[119097]: osdmap e1184: 8 total, 8 up, 8 in 2024-01-13T18:42:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:43 smithi099 ceph-mon[138788]: osdmap e1185: 8 total, 8 up, 8 in 2024-01-13T18:42:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:43 smithi099 ceph-mon[138788]: pgmap v2187: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 53 KiB/s rd, 6.0 KiB/s wr, 72 op/s 2024-01-13T18:42:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:43 smithi099 ceph-mon[138788]: osdmap e1186: 8 total, 8 up, 8 in 2024-01-13T18:42:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:43 smithi084 ceph-mon[116404]: osdmap e1185: 8 total, 8 up, 8 in 2024-01-13T18:42:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:43 smithi084 ceph-mon[116404]: pgmap v2187: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 53 KiB/s rd, 6.0 KiB/s wr, 72 op/s 2024-01-13T18:42:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:43 smithi084 ceph-mon[116404]: osdmap e1186: 8 total, 8 up, 8 in 2024-01-13T18:42:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:43 smithi084 ceph-mon[119097]: osdmap e1185: 8 total, 8 up, 8 in 2024-01-13T18:42:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:43 smithi084 ceph-mon[119097]: pgmap v2187: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 53 KiB/s rd, 6.0 KiB/s wr, 72 op/s 2024-01-13T18:42:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:43 smithi084 ceph-mon[119097]: osdmap e1186: 8 total, 8 up, 8 in 2024-01-13T18:42:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:45 smithi084 ceph-mon[116404]: osdmap e1187: 8 total, 8 up, 8 in 2024-01-13T18:42:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:45 smithi084 ceph-mon[116404]: pgmap v2190: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s 2024-01-13T18:42:45.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:45 smithi084 ceph-mon[119097]: osdmap e1187: 8 total, 8 up, 8 in 2024-01-13T18:42:45.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:45 smithi084 ceph-mon[119097]: pgmap v2190: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s 2024-01-13T18:42:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:45 smithi099 ceph-mon[138788]: osdmap e1187: 8 total, 8 up, 8 in 2024-01-13T18:42:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:45 smithi099 ceph-mon[138788]: pgmap v2190: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s 2024-01-13T18:42:46.451 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 0 2024-01-13T18:42:46.451 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 0 2024-01-13T18:42:46.458 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestGetNameIdSnapPP (5977 ms) 2024-01-13T18:42:46.458 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCreateLsRenameSnapPP 2024-01-13T18:42:46.458 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:46.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:46 smithi084 ceph-mon[116404]: osdmap e1188: 8 total, 8 up, 8 in 2024-01-13T18:42:46.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:46 smithi084 ceph-mon[119097]: osdmap e1188: 8 total, 8 up, 8 in 2024-01-13T18:42:46.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:46 smithi099 ceph-mon[138788]: osdmap e1188: 8 total, 8 up, 8 in 2024-01-13T18:42:47.456 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 1 2024-01-13T18:42:47.457 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:42:47.457 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap1 2024-01-13T18:42:47.457 INFO:tasks.workunit.client.0.smithi084.stdout:found snap1 with size 2097152 2024-01-13T18:42:47.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:47 smithi099 ceph-mon[138788]: osdmap e1189: 8 total, 8 up, 8 in 2024-01-13T18:42:47.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:47 smithi099 ceph-mon[138788]: pgmap v2193: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 45 KiB/s rd, 4.2 KiB/s wr, 60 op/s 2024-01-13T18:42:47.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:47 smithi084 ceph-mon[119097]: osdmap e1189: 8 total, 8 up, 8 in 2024-01-13T18:42:47.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:47 smithi084 ceph-mon[119097]: pgmap v2193: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 45 KiB/s rd, 4.2 KiB/s wr, 60 op/s 2024-01-13T18:42:47.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:47 smithi084 ceph-mon[116404]: osdmap e1189: 8 total, 8 up, 8 in 2024-01-13T18:42:47.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:47 smithi084 ceph-mon[116404]: pgmap v2193: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 45 KiB/s rd, 4.2 KiB/s wr, 60 op/s 2024-01-13T18:42:48.442 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 2 2024-01-13T18:42:48.443 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:42:48.443 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap1 2024-01-13T18:42:48.443 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap2 2024-01-13T18:42:48.443 INFO:tasks.workunit.client.0.smithi084.stdout:found snap1 with size 2097152 2024-01-13T18:42:48.443 INFO:tasks.workunit.client.0.smithi084.stdout:found snap2 with size 4194304 2024-01-13T18:42:48.447 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 2 2024-01-13T18:42:48.447 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:42:48.447 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap1-rename 2024-01-13T18:42:48.447 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap2 2024-01-13T18:42:48.447 INFO:tasks.workunit.client.0.smithi084.stdout:found snap1-rename with size 2097152 2024-01-13T18:42:48.447 INFO:tasks.workunit.client.0.smithi084.stdout:found snap2 with size 4194304 2024-01-13T18:42:48.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:48 smithi099 ceph-mon[138788]: osdmap e1190: 8 total, 8 up, 8 in 2024-01-13T18:42:48.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:48 smithi099 ceph-mon[138788]: osdmap e1191: 8 total, 8 up, 8 in 2024-01-13T18:42:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:48 smithi084 ceph-mon[116404]: osdmap e1190: 8 total, 8 up, 8 in 2024-01-13T18:42:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:48 smithi084 ceph-mon[116404]: osdmap e1191: 8 total, 8 up, 8 in 2024-01-13T18:42:48.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:48 smithi084 ceph-mon[119097]: osdmap e1190: 8 total, 8 up, 8 in 2024-01-13T18:42:48.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:48 smithi084 ceph-mon[119097]: osdmap e1191: 8 total, 8 up, 8 in 2024-01-13T18:42:49.471 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 1 2024-01-13T18:42:49.471 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:42:49.471 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap2-rename 2024-01-13T18:42:49.471 INFO:tasks.workunit.client.0.smithi084.stdout:found snap2-rename with size 4194304 2024-01-13T18:42:49.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:49 smithi099 ceph-mon[138788]: pgmap v2196: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 54 KiB/s rd, 5.2 KiB/s wr, 75 op/s 2024-01-13T18:42:49.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:49 smithi084 ceph-mon[116404]: pgmap v2196: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 54 KiB/s rd, 5.2 KiB/s wr, 75 op/s 2024-01-13T18:42:49.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:49 smithi084 ceph-mon[119097]: pgmap v2196: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 54 KiB/s rd, 5.2 KiB/s wr, 75 op/s 2024-01-13T18:42:50.471 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 0 2024-01-13T18:42:50.471 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 0 2024-01-13T18:42:50.476 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCreateLsRenameSnapPP (4017 ms) 2024-01-13T18:42:50.476 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ConcurrentCreatesUnvalidatedPool 2024-01-13T18:42:50.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:50 smithi084 ceph-mon[116404]: osdmap e1192: 8 total, 8 up, 8 in 2024-01-13T18:42:50.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:50.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:42:50] "GET /metrics HTTP/1.1" 200 50829 "" "Prometheus/2.43.0" 2024-01-13T18:42:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:50 smithi084 ceph-mon[119097]: osdmap e1192: 8 total, 8 up, 8 in 2024-01-13T18:42:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:50.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:50 smithi099 ceph-mon[138788]: osdmap e1192: 8 total, 8 up, 8 in 2024-01-13T18:42:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:42:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:51 smithi099 ceph-mon[138788]: osdmap e1193: 8 total, 8 up, 8 in 2024-01-13T18:42:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:51 smithi099 ceph-mon[138788]: pgmap v2199: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 3.2 KiB/s wr, 36 op/s 2024-01-13T18:42:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "77.1f", "id": [6, 4]}]: dispatch 2024-01-13T18:42:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.10", "id": [5, 6]}]: dispatch 2024-01-13T18:42:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.1d", "id": [5, 1]}]: dispatch 2024-01-13T18:42:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "80.1a", "id": [4, 6]}]: dispatch 2024-01-13T18:42:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "82.1a", "id": [1, 7]}]: dispatch 2024-01-13T18:42:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[119097]: osdmap e1193: 8 total, 8 up, 8 in 2024-01-13T18:42:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[119097]: pgmap v2199: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 3.2 KiB/s wr, 36 op/s 2024-01-13T18:42:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "77.1f", "id": [6, 4]}]: dispatch 2024-01-13T18:42:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.10", "id": [5, 6]}]: dispatch 2024-01-13T18:42:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.1d", "id": [5, 1]}]: dispatch 2024-01-13T18:42:51.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "80.1a", "id": [4, 6]}]: dispatch 2024-01-13T18:42:51.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "82.1a", "id": [1, 7]}]: dispatch 2024-01-13T18:42:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[116404]: osdmap e1193: 8 total, 8 up, 8 in 2024-01-13T18:42:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[116404]: pgmap v2199: 329 pgs: 329 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 3.2 KiB/s wr, 36 op/s 2024-01-13T18:42:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "77.1f", "id": [6, 4]}]: dispatch 2024-01-13T18:42:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.10", "id": [5, 6]}]: dispatch 2024-01-13T18:42:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.1d", "id": [5, 1]}]: dispatch 2024-01-13T18:42:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "80.1a", "id": [4, 6]}]: dispatch 2024-01-13T18:42:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "82.1a", "id": [1, 7]}]: dispatch 2024-01-13T18:42:52.478 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:52.478 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:52.478 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:52.479 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "77.1f", "id": [6, 4]}]': finished 2024-01-13T18:42:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.10", "id": [5, 6]}]': finished 2024-01-13T18:42:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.1d", "id": [5, 1]}]': finished 2024-01-13T18:42:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "80.1a", "id": [4, 6]}]': finished 2024-01-13T18:42:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "82.1a", "id": [1, 7]}]': finished 2024-01-13T18:42:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:52 smithi099 ceph-mon[138788]: osdmap e1194: 8 total, 8 up, 8 in 2024-01-13T18:42:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:52 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3799048257' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "77.1f", "id": [6, 4]}]': finished 2024-01-13T18:42:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.10", "id": [5, 6]}]': finished 2024-01-13T18:42:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.1d", "id": [5, 1]}]': finished 2024-01-13T18:42:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "80.1a", "id": [4, 6]}]': finished 2024-01-13T18:42:52.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "82.1a", "id": [1, 7]}]': finished 2024-01-13T18:42:52.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[116404]: osdmap e1194: 8 total, 8 up, 8 in 2024-01-13T18:42:52.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3799048257' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "77.1f", "id": [6, 4]}]': finished 2024-01-13T18:42:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.10", "id": [5, 6]}]': finished 2024-01-13T18:42:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "78.1d", "id": [5, 1]}]': finished 2024-01-13T18:42:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "80.1a", "id": [4, 6]}]': finished 2024-01-13T18:42:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "82.1a", "id": [1, 7]}]': finished 2024-01-13T18:42:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[119097]: osdmap e1194: 8 total, 8 up, 8 in 2024-01-13T18:42:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:52 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3799048257' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:53 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3799048257' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:53 smithi099 ceph-mon[138788]: osdmap e1195: 8 total, 8 up, 8 in 2024-01-13T18:42:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:53 smithi099 ceph-mon[138788]: pgmap v2202: 361 pgs: 18 creating+peering, 2 peering, 14 unknown, 327 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 62 KiB/s rd, 6.0 KiB/s wr, 83 op/s 2024-01-13T18:42:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:53 smithi099 ceph-mon[138788]: osdmap e1196: 8 total, 8 up, 8 in 2024-01-13T18:42:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:53 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3799048257' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:53 smithi084 ceph-mon[119097]: osdmap e1195: 8 total, 8 up, 8 in 2024-01-13T18:42:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:53 smithi084 ceph-mon[119097]: pgmap v2202: 361 pgs: 18 creating+peering, 2 peering, 14 unknown, 327 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 62 KiB/s rd, 6.0 KiB/s wr, 83 op/s 2024-01-13T18:42:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:53 smithi084 ceph-mon[119097]: osdmap e1196: 8 total, 8 up, 8 in 2024-01-13T18:42:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:53 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3799048257' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:53.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:53 smithi084 ceph-mon[116404]: osdmap e1195: 8 total, 8 up, 8 in 2024-01-13T18:42:53.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:53 smithi084 ceph-mon[116404]: pgmap v2202: 361 pgs: 18 creating+peering, 2 peering, 14 unknown, 327 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 62 KiB/s rd, 6.0 KiB/s wr, 83 op/s 2024-01-13T18:42:53.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:53 smithi084 ceph-mon[116404]: osdmap e1196: 8 total, 8 up, 8 in 2024-01-13T18:42:54.692 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ConcurrentCreatesUnvalidatedPool (4216 ms) 2024-01-13T18:42:54.692 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.RemoveFullTry 2024-01-13T18:42:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:55 smithi099 ceph-mon[138788]: osdmap e1197: 8 total, 8 up, 8 in 2024-01-13T18:42:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:55 smithi099 ceph-mon[138788]: pgmap v2205: 361 pgs: 18 creating+peering, 2 peering, 5 unknown, 336 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 48 KiB/s rd, 4.0 KiB/s wr, 61 op/s; 30 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:42:55.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:55 smithi084 ceph-mon[116404]: osdmap e1197: 8 total, 8 up, 8 in 2024-01-13T18:42:55.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:55 smithi084 ceph-mon[116404]: pgmap v2205: 361 pgs: 18 creating+peering, 2 peering, 5 unknown, 336 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 48 KiB/s rd, 4.0 KiB/s wr, 61 op/s; 30 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:42:55.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:55 smithi084 ceph-mon[119097]: osdmap e1197: 8 total, 8 up, 8 in 2024-01-13T18:42:55.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:55 smithi084 ceph-mon[119097]: pgmap v2205: 361 pgs: 18 creating+peering, 2 peering, 5 unknown, 336 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 48 KiB/s rd, 4.0 KiB/s wr, 61 op/s; 30 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:42:56.475 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:56 smithi099 ceph-mon[138788]: osdmap e1198: 8 total, 8 up, 8 in 2024-01-13T18:42:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:56 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2380359486' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:56 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-mon[116404]: osdmap e1198: 8 total, 8 up, 8 in 2024-01-13T18:42:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2380359486' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:56.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-mon[119097]: osdmap e1198: 8 total, 8 up, 8 in 2024-01-13T18:42:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2380359486' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:42:56.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:42:56] ENGINE Bus STOPPING 2024-01-13T18:42:56.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:42:56] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:42:56.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:42:56] ENGINE Bus STOPPED 2024-01-13T18:42:56.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:42:56] ENGINE Bus STARTING 2024-01-13T18:42:56.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:42:56] ENGINE Serving on http://:::9283 2024-01-13T18:42:56.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:42:56 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:42:56] ENGINE Bus STARTED 2024-01-13T18:42:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:57 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:57 smithi099 ceph-mon[138788]: osdmap e1199: 8 total, 8 up, 8 in 2024-01-13T18:42:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:57 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' 2024-01-13T18:42:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:57 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:42:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:57 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:42:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:57 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:42:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:57 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:42:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:57 smithi099 ceph-mon[138788]: pgmap v2208: 393 pgs: 32 unknown, 18 creating+peering, 2 peering, 341 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 26 KiB/s rd, 3.5 KiB/s wr, 38 op/s; 30 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:42:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[116404]: osdmap e1199: 8 total, 8 up, 8 in 2024-01-13T18:42:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' 2024-01-13T18:42:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:42:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:42:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:42:57.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:42:57.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[116404]: pgmap v2208: 393 pgs: 32 unknown, 18 creating+peering, 2 peering, 341 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 26 KiB/s rd, 3.5 KiB/s wr, 38 op/s; 30 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:42:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:42:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[119097]: osdmap e1199: 8 total, 8 up, 8 in 2024-01-13T18:42:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' 2024-01-13T18:42:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:42:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:42:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:42:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:42:57.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:57 smithi084 ceph-mon[119097]: pgmap v2208: 393 pgs: 32 unknown, 18 creating+peering, 2 peering, 341 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 26 KiB/s rd, 3.5 KiB/s wr, 38 op/s; 30 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:42:58.514 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:42:58.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:58 smithi099 ceph-mon[138788]: osdmap e1200: 8 total, 8 up, 8 in 2024-01-13T18:42:58.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:58 smithi099 ceph-mon[138788]: osdmap e1201: 8 total, 8 up, 8 in 2024-01-13T18:42:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:58 smithi084 ceph-mon[116404]: osdmap e1200: 8 total, 8 up, 8 in 2024-01-13T18:42:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:58 smithi084 ceph-mon[116404]: osdmap e1201: 8 total, 8 up, 8 in 2024-01-13T18:42:58.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:58 smithi084 ceph-mon[119097]: osdmap e1200: 8 total, 8 up, 8 in 2024-01-13T18:42:58.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:58 smithi084 ceph-mon[119097]: osdmap e1201: 8 total, 8 up, 8 in 2024-01-13T18:42:59.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:59 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-9", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:42:59.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:59 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-9", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:42:59.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:42:59 smithi099 ceph-mon[138788]: pgmap v2211: 393 pgs: 15 unknown, 378 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 74 KiB/s rd, 6.7 KiB/s wr, 109 op/s 2024-01-13T18:42:59.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:59 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-9", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:42:59.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:59 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-9", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:42:59.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:42:59 smithi084 ceph-mon[116404]: pgmap v2211: 393 pgs: 15 unknown, 378 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 74 KiB/s rd, 6.7 KiB/s wr, 109 op/s 2024-01-13T18:42:59.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:59 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-9", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:42:59.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:59 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-9", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:42:59.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:42:59 smithi084 ceph-mon[119097]: pgmap v2211: 393 pgs: 15 unknown, 378 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 74 KiB/s rd, 6.7 KiB/s wr, 109 op/s 2024-01-13T18:43:00.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:00 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-9", "field": "max_bytes", "val": "10485760"}]': finished 2024-01-13T18:43:00.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:00 smithi084 ceph-mon[116404]: osdmap e1202: 8 total, 8 up, 8 in 2024-01-13T18:43:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:00 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-9", "field": "max_bytes", "val": "10485760"}]': finished 2024-01-13T18:43:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:00 smithi084 ceph-mon[119097]: osdmap e1202: 8 total, 8 up, 8 in 2024-01-13T18:43:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:43:00] "GET /metrics HTTP/1.1" 200 50829 "" "Prometheus/2.43.0" 2024-01-13T18:43:00.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:00 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-9", "field": "max_bytes", "val": "10485760"}]': finished 2024-01-13T18:43:00.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:00 smithi099 ceph-mon[138788]: osdmap e1202: 8 total, 8 up, 8 in 2024-01-13T18:43:02.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:02 smithi099 ceph-mon[138788]: pgmap v2213: 393 pgs: 393 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 95 KiB/s rd, 5.5 KiB/s wr, 132 op/s 2024-01-13T18:43:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:02 smithi084 ceph-mon[116404]: pgmap v2213: 393 pgs: 393 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 95 KiB/s rd, 5.5 KiB/s wr, 132 op/s 2024-01-13T18:43:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:02 smithi084 ceph-mon[119097]: pgmap v2213: 393 pgs: 393 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 95 KiB/s rd, 5.5 KiB/s wr, 132 op/s 2024-01-13T18:43:04.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:04 smithi084 ceph-mon[116404]: pgmap v2214: 393 pgs: 393 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 69 KiB/s rd, 4.5 KiB/s wr, 98 op/s 2024-01-13T18:43:04.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:04 smithi084 ceph-mon[116404]: osdmap e1203: 8 total, 8 up, 8 in 2024-01-13T18:43:04.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:04 smithi084 ceph-mon[119097]: pgmap v2214: 393 pgs: 393 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 69 KiB/s rd, 4.5 KiB/s wr, 98 op/s 2024-01-13T18:43:04.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:04 smithi084 ceph-mon[119097]: osdmap e1203: 8 total, 8 up, 8 in 2024-01-13T18:43:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:04 smithi099 ceph-mon[138788]: pgmap v2214: 393 pgs: 393 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 69 KiB/s rd, 4.5 KiB/s wr, 98 op/s 2024-01-13T18:43:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:04 smithi099 ceph-mon[138788]: osdmap e1203: 8 total, 8 up, 8 in 2024-01-13T18:43:05.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:05.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:05.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:06.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:06 smithi084 ceph-mon[116404]: pgmap v2216: 393 pgs: 393 active+clean; 8.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 38 KiB/s rd, 662 KiB/s wr, 55 op/s 2024-01-13T18:43:06.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:06 smithi084 ceph-mon[119097]: pgmap v2216: 393 pgs: 393 active+clean; 8.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 38 KiB/s rd, 662 KiB/s wr, 55 op/s 2024-01-13T18:43:06.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:06 smithi099 ceph-mon[138788]: pgmap v2216: 393 pgs: 393 active+clean; 8.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 38 KiB/s rd, 662 KiB/s wr, 55 op/s 2024-01-13T18:43:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:08 smithi099 ceph-mon[138788]: pgmap v2217: 393 pgs: 393 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 30 KiB/s rd, 770 KiB/s wr, 43 op/s 2024-01-13T18:43:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:08 smithi099 ceph-mon[138788]: osdmap e1204: 8 total, 8 up, 8 in 2024-01-13T18:43:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:08 smithi084 ceph-mon[116404]: pgmap v2217: 393 pgs: 393 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 30 KiB/s rd, 770 KiB/s wr, 43 op/s 2024-01-13T18:43:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:08 smithi084 ceph-mon[116404]: osdmap e1204: 8 total, 8 up, 8 in 2024-01-13T18:43:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:08 smithi084 ceph-mon[119097]: pgmap v2217: 393 pgs: 393 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 30 KiB/s rd, 770 KiB/s wr, 43 op/s 2024-01-13T18:43:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:08 smithi084 ceph-mon[119097]: osdmap e1204: 8 total, 8 up, 8 in 2024-01-13T18:43:10.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:10 smithi084 ceph-mon[116404]: pgmap v2219: 393 pgs: 393 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.5 KiB/s rd, 769 KiB/s wr, 10 op/s 2024-01-13T18:43:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:43:10] "GET /metrics HTTP/1.1" 200 55654 "" "Prometheus/2.43.0" 2024-01-13T18:43:10.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:10 smithi084 ceph-mon[119097]: pgmap v2219: 393 pgs: 393 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.5 KiB/s rd, 769 KiB/s wr, 10 op/s 2024-01-13T18:43:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:10 smithi099 ceph-mon[138788]: pgmap v2219: 393 pgs: 393 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.5 KiB/s rd, 769 KiB/s wr, 10 op/s 2024-01-13T18:43:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:12 smithi099 ceph-mon[138788]: pgmap v2220: 393 pgs: 393 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-01-13T18:43:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:12 smithi084 ceph-mon[116404]: pgmap v2220: 393 pgs: 393 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-01-13T18:43:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:12 smithi084 ceph-mon[119097]: pgmap v2220: 393 pgs: 393 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-01-13T18:43:13.654 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.RemoveFullTry (18963 ms) 2024-01-13T18:43:13.655 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.RemoveFullTryDataPool 2024-01-13T18:43:13.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:13 smithi099 ceph-mon[138788]: pool 'test-librbd-smithi084-180317-9' is full (reached quota's max_bytes: 10 MiB) 2024-01-13T18:43:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:13 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-01-13T18:43:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:13 smithi099 ceph-mon[138788]: osdmap e1205: 8 total, 8 up, 8 in 2024-01-13T18:43:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:13 smithi084 ceph-mon[116404]: pool 'test-librbd-smithi084-180317-9' is full (reached quota's max_bytes: 10 MiB) 2024-01-13T18:43:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:13 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-01-13T18:43:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:13 smithi084 ceph-mon[116404]: osdmap e1205: 8 total, 8 up, 8 in 2024-01-13T18:43:13.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:13 smithi084 ceph-mon[119097]: pool 'test-librbd-smithi084-180317-9' is full (reached quota's max_bytes: 10 MiB) 2024-01-13T18:43:13.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:13 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-01-13T18:43:13.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:13 smithi084 ceph-mon[119097]: osdmap e1205: 8 total, 8 up, 8 in 2024-01-13T18:43:14.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:14 smithi099 ceph-mon[138788]: pgmap v2221: 393 pgs: 393 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.7 KiB/s rd, 667 KiB/s wr, 3 op/s 2024-01-13T18:43:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:14 smithi084 ceph-mon[116404]: pgmap v2221: 393 pgs: 393 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.7 KiB/s rd, 667 KiB/s wr, 3 op/s 2024-01-13T18:43:14.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:14 smithi084 ceph-mon[119097]: pgmap v2221: 393 pgs: 393 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.7 KiB/s rd, 667 KiB/s wr, 3 op/s 2024-01-13T18:43:15.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:15 smithi099 ceph-mon[138788]: osdmap e1206: 8 total, 8 up, 8 in 2024-01-13T18:43:15.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:15 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3629670559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:43:15.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:15 smithi084 ceph-mon[119097]: osdmap e1206: 8 total, 8 up, 8 in 2024-01-13T18:43:15.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:15 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3629670559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:43:15.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:15 smithi084 ceph-mon[116404]: osdmap e1206: 8 total, 8 up, 8 in 2024-01-13T18:43:15.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:15 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3629670559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:43:16.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:16 smithi099 ceph-mon[138788]: pgmap v2224: 425 pgs: 32 unknown, 393 active+clean; 13 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.3 KiB/s rd, 989 KiB/s wr, 4 op/s 2024-01-13T18:43:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:16 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:43:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:16 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3629670559' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:43:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:16 smithi099 ceph-mon[138788]: osdmap e1207: 8 total, 8 up, 8 in 2024-01-13T18:43:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:16 smithi084 ceph-mon[116404]: pgmap v2224: 425 pgs: 32 unknown, 393 active+clean; 13 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.3 KiB/s rd, 989 KiB/s wr, 4 op/s 2024-01-13T18:43:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:16 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:43:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:16 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3629670559' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:43:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:16 smithi084 ceph-mon[116404]: osdmap e1207: 8 total, 8 up, 8 in 2024-01-13T18:43:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:16 smithi084 ceph-mon[119097]: pgmap v2224: 425 pgs: 32 unknown, 393 active+clean; 13 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.3 KiB/s rd, 989 KiB/s wr, 4 op/s 2024-01-13T18:43:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:16 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:43:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:16 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3629670559' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:43:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:16 smithi084 ceph-mon[119097]: osdmap e1207: 8 total, 8 up, 8 in 2024-01-13T18:43:17.520 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:43:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:17 smithi099 ceph-mon[138788]: osdmap e1208: 8 total, 8 up, 8 in 2024-01-13T18:43:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:17 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/6611127' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:43:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:17 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:43:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-mon[116404]: osdmap e1208: 8 total, 8 up, 8 in 2024-01-13T18:43:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/6611127' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:43:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:43:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-mon[119097]: osdmap e1208: 8 total, 8 up, 8 in 2024-01-13T18:43:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/6611127' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:43:17.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:43:17.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:43:17] ENGINE Bus STOPPING 2024-01-13T18:43:17.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:43:17] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:43:17.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:43:17] ENGINE Bus STOPPED 2024-01-13T18:43:17.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:43:17] ENGINE Bus STARTING 2024-01-13T18:43:17.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:43:17] ENGINE Serving on http://:::9283 2024-01-13T18:43:17.928 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:17 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:43:17] ENGINE Bus STARTED 2024-01-13T18:43:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:18 smithi099 ceph-mon[138788]: pgmap v2227: 457 pgs: 6 creating+peering, 58 unknown, 393 active+clean; 8.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 1024 KiB/s wr, 26 op/s 2024-01-13T18:43:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:18 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:43:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:18 smithi099 ceph-mon[138788]: osdmap e1209: 8 total, 8 up, 8 in 2024-01-13T18:43:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:18 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' 2024-01-13T18:43:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:43:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:43:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:43:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:43:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:18 smithi099 ceph-mon[138788]: pool 'test-librbd-smithi084-180317-9' no longer out of quota; removing NO_QUOTA flag 2024-01-13T18:43:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:18 smithi099 ceph-mon[138788]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-01-13T18:43:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:18 smithi099 ceph-mon[138788]: osdmap e1210: 8 total, 8 up, 8 in 2024-01-13T18:43:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[116404]: pgmap v2227: 457 pgs: 6 creating+peering, 58 unknown, 393 active+clean; 8.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 1024 KiB/s wr, 26 op/s 2024-01-13T18:43:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:43:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[116404]: osdmap e1209: 8 total, 8 up, 8 in 2024-01-13T18:43:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' 2024-01-13T18:43:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:43:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:43:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:43:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:43:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[116404]: pool 'test-librbd-smithi084-180317-9' no longer out of quota; removing NO_QUOTA flag 2024-01-13T18:43:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[116404]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-01-13T18:43:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[116404]: osdmap e1210: 8 total, 8 up, 8 in 2024-01-13T18:43:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[119097]: pgmap v2227: 457 pgs: 6 creating+peering, 58 unknown, 393 active+clean; 8.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 1024 KiB/s wr, 26 op/s 2024-01-13T18:43:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:43:18.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[119097]: osdmap e1209: 8 total, 8 up, 8 in 2024-01-13T18:43:18.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' 2024-01-13T18:43:18.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:43:18.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:43:18.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:43:18.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:43:18.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[119097]: pool 'test-librbd-smithi084-180317-9' no longer out of quota; removing NO_QUOTA flag 2024-01-13T18:43:18.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[119097]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-01-13T18:43:18.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:18 smithi084 ceph-mon[119097]: osdmap e1210: 8 total, 8 up, 8 in 2024-01-13T18:43:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:43:20] "GET /metrics HTTP/1.1" 200 60375 "" "Prometheus/2.43.0" 2024-01-13T18:43:20.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[119097]: pgmap v2230: 457 pgs: 17 creating+peering, 22 unknown, 418 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 27 KiB/s rd, 514 KiB/s wr, 38 op/s 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[119097]: osdmap e1211: 8 total, 8 up, 8 in 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-11", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-11", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[116404]: pgmap v2230: 457 pgs: 17 creating+peering, 22 unknown, 418 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 27 KiB/s rd, 514 KiB/s wr, 38 op/s 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[116404]: osdmap e1211: 8 total, 8 up, 8 in 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-11", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-11", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:43:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:20 smithi099 ceph-mon[138788]: pgmap v2230: 457 pgs: 17 creating+peering, 22 unknown, 418 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 27 KiB/s rd, 514 KiB/s wr, 38 op/s 2024-01-13T18:43:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:20 smithi099 ceph-mon[138788]: osdmap e1211: 8 total, 8 up, 8 in 2024-01-13T18:43:20.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:20 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-11", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:43:20.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:20 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-11", "field": "max_bytes", "val": "10485760"}]: dispatch 2024-01-13T18:43:20.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:20 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:43:20.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:20 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:43:20.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:21.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:21 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-11", "field": "max_bytes", "val": "10485760"}]': finished 2024-01-13T18:43:21.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:21 smithi099 ceph-mon[138788]: osdmap e1212: 8 total, 8 up, 8 in 2024-01-13T18:43:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:21 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-11", "field": "max_bytes", "val": "10485760"}]': finished 2024-01-13T18:43:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:21 smithi084 ceph-mon[116404]: osdmap e1212: 8 total, 8 up, 8 in 2024-01-13T18:43:21.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:21 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-librbd-smithi084-180317-11", "field": "max_bytes", "val": "10485760"}]': finished 2024-01-13T18:43:21.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:21 smithi084 ceph-mon[119097]: osdmap e1212: 8 total, 8 up, 8 in 2024-01-13T18:43:22.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:22 smithi099 ceph-mon[138788]: pgmap v2233: 457 pgs: 11 creating+peering, 446 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-01-13T18:43:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:22 smithi084 ceph-mon[116404]: pgmap v2233: 457 pgs: 11 creating+peering, 446 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-01-13T18:43:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:22 smithi084 ceph-mon[119097]: pgmap v2233: 457 pgs: 11 creating+peering, 446 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-01-13T18:43:24.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:24 smithi099 ceph-mon[138788]: pgmap v2234: 457 pgs: 457 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-01-13T18:43:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:24 smithi084 ceph-mon[116404]: pgmap v2234: 457 pgs: 457 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-01-13T18:43:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:24 smithi084 ceph-mon[119097]: pgmap v2234: 457 pgs: 457 active+clean; 4.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-01-13T18:43:26.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:26 smithi099 ceph-mon[138788]: pgmap v2235: 457 pgs: 457 active+clean; 7.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 KiB/s rd, 495 KiB/s wr, 9 op/s 2024-01-13T18:43:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:26 smithi084 ceph-mon[116404]: pgmap v2235: 457 pgs: 457 active+clean; 7.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 KiB/s rd, 495 KiB/s wr, 9 op/s 2024-01-13T18:43:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:26 smithi084 ceph-mon[119097]: pgmap v2235: 457 pgs: 457 active+clean; 7.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 KiB/s rd, 495 KiB/s wr, 9 op/s 2024-01-13T18:43:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:28 smithi099 ceph-mon[138788]: pgmap v2236: 457 pgs: 457 active+clean; 7.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.1 KiB/s rd, 385 KiB/s wr, 7 op/s 2024-01-13T18:43:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:28 smithi099 ceph-mon[138788]: osdmap e1213: 8 total, 8 up, 8 in 2024-01-13T18:43:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:28 smithi084 ceph-mon[116404]: pgmap v2236: 457 pgs: 457 active+clean; 7.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.1 KiB/s rd, 385 KiB/s wr, 7 op/s 2024-01-13T18:43:28.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:28 smithi084 ceph-mon[116404]: osdmap e1213: 8 total, 8 up, 8 in 2024-01-13T18:43:28.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:28 smithi084 ceph-mon[119097]: pgmap v2236: 457 pgs: 457 active+clean; 7.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.1 KiB/s rd, 385 KiB/s wr, 7 op/s 2024-01-13T18:43:28.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:28 smithi084 ceph-mon[119097]: osdmap e1213: 8 total, 8 up, 8 in 2024-01-13T18:43:30.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:30 smithi084 ceph-mon[116404]: pgmap v2238: 457 pgs: 457 active+clean; 12 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.6 KiB/s rd, 875 KiB/s wr, 8 op/s 2024-01-13T18:43:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:43:30] "GET /metrics HTTP/1.1" 200 60375 "" "Prometheus/2.43.0" 2024-01-13T18:43:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:30 smithi084 ceph-mon[119097]: pgmap v2238: 457 pgs: 457 active+clean; 12 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.6 KiB/s rd, 875 KiB/s wr, 8 op/s 2024-01-13T18:43:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:30 smithi099 ceph-mon[138788]: pgmap v2238: 457 pgs: 457 active+clean; 12 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.6 KiB/s rd, 875 KiB/s wr, 8 op/s 2024-01-13T18:43:32.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:32 smithi099 ceph-mon[138788]: pgmap v2239: 457 pgs: 457 active+clean; 14 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.8 KiB/s rd, 922 KiB/s wr, 7 op/s 2024-01-13T18:43:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:32 smithi084 ceph-mon[116404]: pgmap v2239: 457 pgs: 457 active+clean; 14 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.8 KiB/s rd, 922 KiB/s wr, 7 op/s 2024-01-13T18:43:32.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:32 smithi084 ceph-mon[119097]: pgmap v2239: 457 pgs: 457 active+clean; 14 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.8 KiB/s rd, 922 KiB/s wr, 7 op/s 2024-01-13T18:43:34.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:34 smithi099 ceph-mon[138788]: pgmap v2240: 457 pgs: 457 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 KiB/s rd, 1024 KiB/s wr, 3 op/s 2024-01-13T18:43:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:34 smithi084 ceph-mon[116404]: pgmap v2240: 457 pgs: 457 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 KiB/s rd, 1024 KiB/s wr, 3 op/s 2024-01-13T18:43:34.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:34 smithi084 ceph-mon[119097]: pgmap v2240: 457 pgs: 457 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 KiB/s rd, 1024 KiB/s wr, 3 op/s 2024-01-13T18:43:35.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:36.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:36 smithi099 ceph-mon[138788]: pgmap v2241: 457 pgs: 457 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 717 KiB/s wr, 3 op/s 2024-01-13T18:43:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:36 smithi084 ceph-mon[119097]: pgmap v2241: 457 pgs: 457 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 717 KiB/s wr, 3 op/s 2024-01-13T18:43:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:36 smithi084 ceph-mon[116404]: pgmap v2241: 457 pgs: 457 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 717 KiB/s wr, 3 op/s 2024-01-13T18:43:38.663 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.RemoveFullTryDataPool (25008 ms) 2024-01-13T18:43:38.663 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestIO 2024-01-13T18:43:38.663 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:43:38.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:38 smithi099 ceph-mon[138788]: pgmap v2242: 457 pgs: 457 active+clean; 20 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 MiB/s wr, 3 op/s 2024-01-13T18:43:38.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:38 smithi099 ceph-mon[138788]: pool 'test-librbd-smithi084-180317-11' is full (reached quota's max_bytes: 10 MiB) 2024-01-13T18:43:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:38 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-01-13T18:43:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:38 smithi099 ceph-mon[138788]: osdmap e1214: 8 total, 8 up, 8 in 2024-01-13T18:43:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:38 smithi084 ceph-mon[116404]: pgmap v2242: 457 pgs: 457 active+clean; 20 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 MiB/s wr, 3 op/s 2024-01-13T18:43:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:38 smithi084 ceph-mon[116404]: pool 'test-librbd-smithi084-180317-11' is full (reached quota's max_bytes: 10 MiB) 2024-01-13T18:43:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:38 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-01-13T18:43:38.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:38 smithi084 ceph-mon[116404]: osdmap e1214: 8 total, 8 up, 8 in 2024-01-13T18:43:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:38 smithi084 ceph-mon[119097]: pgmap v2242: 457 pgs: 457 active+clean; 20 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 MiB/s wr, 3 op/s 2024-01-13T18:43:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:38 smithi084 ceph-mon[119097]: pool 'test-librbd-smithi084-180317-11' is full (reached quota's max_bytes: 10 MiB) 2024-01-13T18:43:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:38 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-01-13T18:43:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:38 smithi084 ceph-mon[119097]: osdmap e1214: 8 total, 8 up, 8 in 2024-01-13T18:43:40.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:40 smithi084 ceph-mon[116404]: pgmap v2244: 457 pgs: 457 active+clean; 21 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 922 KiB/s wr, 3 op/s 2024-01-13T18:43:40.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:40 smithi084 ceph-mon[119097]: pgmap v2244: 457 pgs: 457 active+clean; 21 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 922 KiB/s wr, 3 op/s 2024-01-13T18:43:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:43:40] "GET /metrics HTTP/1.1" 200 60469 "" "Prometheus/2.43.0" 2024-01-13T18:43:40.800 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:40.800 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:40.800 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:40.800 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:40.800 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:40.800 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.800 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:43:40.800 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:43:40.801 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:43:40.802 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:43:40.803 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.804 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.805 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 512~512 = 512 2024-01-13T18:43:40.806 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.807 INFO:tasks.workunit.client.0.smithi084.stdout:aio discard: 1536~512 = 0 2024-01-13T18:43:40.807 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:40.807 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:40.807 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:40.807 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:40.807 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:40.807 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:43:40.807 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.807 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.808 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:43:40.808 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.808 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.808 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:43:40.808 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.808 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.808 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:43:40.808 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.808 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:43:40.809 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.810 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.811 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.812 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.813 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.814 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.815 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.816 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.816 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:40.816 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:40.816 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:40.816 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:40.816 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:40.816 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:40.816 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:40 smithi099 ceph-mon[138788]: pgmap v2244: 457 pgs: 457 active+clean; 21 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.5 KiB/s rd, 922 KiB/s wr, 3 op/s 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.601 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.602 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.603 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.604 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.605 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.606 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.607 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.608 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.609 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:42.609 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:42.609 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:42.609 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:42.609 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:42.609 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:42.609 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:42.609 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:42.609 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestIO (3938 ms) 2024-01-13T18:43:42.609 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS1 2024-01-13T18:43:42.609 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:43:42.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:42 smithi099 ceph-mon[138788]: pgmap v2245: 457 pgs: 457 active+clean; 14 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 133 KiB/s rd, 886 KiB/s wr, 235 op/s 2024-01-13T18:43:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:42 smithi084 ceph-mon[116404]: pgmap v2245: 457 pgs: 457 active+clean; 14 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 133 KiB/s rd, 886 KiB/s wr, 235 op/s 2024-01-13T18:43:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:42 smithi084 ceph-mon[119097]: pgmap v2245: 457 pgs: 457 active+clean; 14 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 133 KiB/s rd, 886 KiB/s wr, 235 op/s 2024-01-13T18:43:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:43 smithi099 ceph-mon[138788]: pool 'test-librbd-smithi084-180317-11' no longer out of quota; removing NO_QUOTA flag 2024-01-13T18:43:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:43 smithi099 ceph-mon[138788]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-01-13T18:43:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:43 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:43:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:43 smithi099 ceph-mon[138788]: osdmap e1215: 8 total, 8 up, 8 in 2024-01-13T18:43:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:43 smithi084 ceph-mon[119097]: pool 'test-librbd-smithi084-180317-11' no longer out of quota; removing NO_QUOTA flag 2024-01-13T18:43:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:43 smithi084 ceph-mon[119097]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-01-13T18:43:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:43 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:43:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:43 smithi084 ceph-mon[119097]: osdmap e1215: 8 total, 8 up, 8 in 2024-01-13T18:43:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:43 smithi084 ceph-mon[116404]: pool 'test-librbd-smithi084-180317-11' no longer out of quota; removing NO_QUOTA flag 2024-01-13T18:43:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:43 smithi084 ceph-mon[116404]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-01-13T18:43:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:43 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:43:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:43 smithi084 ceph-mon[116404]: osdmap e1215: 8 total, 8 up, 8 in 2024-01-13T18:43:44.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:44 smithi099 ceph-mon[138788]: pgmap v2246: 457 pgs: 457 active+clean; 8.7 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 142 KiB/s rd, 886 KiB/s wr, 246 op/s 2024-01-13T18:43:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:44 smithi084 ceph-mon[116404]: pgmap v2246: 457 pgs: 457 active+clean; 8.7 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 142 KiB/s rd, 886 KiB/s wr, 246 op/s 2024-01-13T18:43:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:44 smithi084 ceph-mon[119097]: pgmap v2246: 457 pgs: 457 active+clean; 8.7 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 142 KiB/s rd, 886 KiB/s wr, 246 op/s 2024-01-13T18:43:46.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:46 smithi099 ceph-mon[138788]: pgmap v2248: 457 pgs: 457 active+clean; 4.7 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 182 KiB/s rd, 468 KiB/s wr, 316 op/s 2024-01-13T18:43:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:46 smithi084 ceph-mon[116404]: pgmap v2248: 457 pgs: 457 active+clean; 4.7 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 182 KiB/s rd, 468 KiB/s wr, 316 op/s 2024-01-13T18:43:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:46 smithi084 ceph-mon[119097]: pgmap v2248: 457 pgs: 457 active+clean; 4.7 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 182 KiB/s rd, 468 KiB/s wr, 316 op/s 2024-01-13T18:43:47.791 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:47.791 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:43:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.796 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 512~512 = 512 2024-01-13T18:43:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:aio discard: 1536~512 = 0 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:43:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:43:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.802 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:47.806 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:47.806 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:47.806 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:47.806 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:47.806 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:48.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:48 smithi099 ceph-mon[138788]: pgmap v2249: 457 pgs: 457 active+clean; 6.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 529 KiB/s rd, 506 KiB/s wr, 1.05k op/s 2024-01-13T18:43:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:48 smithi084 ceph-mon[116404]: pgmap v2249: 457 pgs: 457 active+clean; 6.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 529 KiB/s rd, 506 KiB/s wr, 1.05k op/s 2024-01-13T18:43:48.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:48 smithi084 ceph-mon[119097]: pgmap v2249: 457 pgs: 457 active+clean; 6.6 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 529 KiB/s rd, 506 KiB/s wr, 1.05k op/s 2024-01-13T18:43:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:43:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:43:50] "GET /metrics HTTP/1.1" 200 60435 "" "Prometheus/2.43.0" 2024-01-13T18:43:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:50 smithi084 ceph-mon[116404]: pgmap v2250: 457 pgs: 457 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 436 KiB/s rd, 826 KiB/s wr, 866 op/s 2024-01-13T18:43:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:50 smithi084 ceph-mon[119097]: pgmap v2250: 457 pgs: 457 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 436 KiB/s rd, 826 KiB/s wr, 866 op/s 2024-01-13T18:43:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:50.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:50 smithi099 ceph-mon[138788]: pgmap v2250: 457 pgs: 457 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 436 KiB/s rd, 826 KiB/s wr, 866 op/s 2024-01-13T18:43:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:43:51.471 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.471 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.471 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.471 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.471 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.471 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.471 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.471 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.471 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.471 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.472 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.473 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.474 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.475 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.476 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.476 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.476 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.476 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.476 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.476 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.476 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.476 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.476 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.477 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.478 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:43:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:43:51.480 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:43:51.480 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:51.480 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:51.480 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:43:51.480 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:43:51.480 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 4 2024-01-13T18:43:51.480 INFO:tasks.workunit.client.0.smithi084.stdout:read: 4 2024-01-13T18:43:51.480 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS1 (8870 ms) 2024-01-13T18:43:51.480 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS2 2024-01-13T18:43:51.480 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:43:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.5", "id": [5, 2]}]: dispatch 2024-01-13T18:43:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.a", "id": [5, 2]}]: dispatch 2024-01-13T18:43:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.d", "id": [5, 0]}]: dispatch 2024-01-13T18:43:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.5", "id": [5, 2]}]: dispatch 2024-01-13T18:43:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.a", "id": [5, 2]}]: dispatch 2024-01-13T18:43:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.d", "id": [5, 0]}]: dispatch 2024-01-13T18:43:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.5", "id": [5, 2]}]: dispatch 2024-01-13T18:43:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.a", "id": [5, 2]}]: dispatch 2024-01-13T18:43:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.d", "id": [5, 0]}]: dispatch 2024-01-13T18:43:52.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:52 smithi099 ceph-mon[138788]: pgmap v2251: 457 pgs: 457 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 1.48k op/s 2024-01-13T18:43:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.5", "id": [5, 2]}]': finished 2024-01-13T18:43:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.a", "id": [5, 2]}]': finished 2024-01-13T18:43:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.d", "id": [5, 0]}]': finished 2024-01-13T18:43:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:52 smithi099 ceph-mon[138788]: osdmap e1216: 8 total, 8 up, 8 in 2024-01-13T18:43:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:52 smithi084 ceph-mon[116404]: pgmap v2251: 457 pgs: 457 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 1.48k op/s 2024-01-13T18:43:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.5", "id": [5, 2]}]': finished 2024-01-13T18:43:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.a", "id": [5, 2]}]': finished 2024-01-13T18:43:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.d", "id": [5, 0]}]': finished 2024-01-13T18:43:52.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:52 smithi084 ceph-mon[116404]: osdmap e1216: 8 total, 8 up, 8 in 2024-01-13T18:43:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:52 smithi084 ceph-mon[119097]: pgmap v2251: 457 pgs: 457 active+clean; 11 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 1.48k op/s 2024-01-13T18:43:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.5", "id": [5, 2]}]': finished 2024-01-13T18:43:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.a", "id": [5, 2]}]': finished 2024-01-13T18:43:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "85.d", "id": [5, 0]}]': finished 2024-01-13T18:43:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:52 smithi084 ceph-mon[119097]: osdmap e1216: 8 total, 8 up, 8 in 2024-01-13T18:43:53.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:53 smithi099 ceph-mon[138788]: osdmap e1217: 8 total, 8 up, 8 in 2024-01-13T18:43:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:53 smithi084 ceph-mon[116404]: osdmap e1217: 8 total, 8 up, 8 in 2024-01-13T18:43:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:53 smithi084 ceph-mon[119097]: osdmap e1217: 8 total, 8 up, 8 in 2024-01-13T18:43:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:54 smithi099 ceph-mon[138788]: pgmap v2254: 457 pgs: 1 peering, 456 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 1.83k op/s 2024-01-13T18:43:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:54 smithi084 ceph-mon[116404]: pgmap v2254: 457 pgs: 1 peering, 456 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 1.83k op/s 2024-01-13T18:43:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:54 smithi084 ceph-mon[119097]: pgmap v2254: 457 pgs: 1 peering, 456 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 1.83k op/s 2024-01-13T18:43:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:56 smithi099 ceph-mon[138788]: pgmap v2255: 457 pgs: 1 peering, 456 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 1.07k op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:43:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:56 smithi084 ceph-mon[116404]: pgmap v2255: 457 pgs: 1 peering, 456 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 1.07k op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:43:56.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:56 smithi084 ceph-mon[119097]: pgmap v2255: 457 pgs: 1 peering, 456 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 1.07k op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:43:58.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:43:58 smithi099 ceph-mon[138788]: pgmap v2256: 457 pgs: 1 peering, 456 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 526 KiB/s wr, 1.07k op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:43:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:43:58 smithi084 ceph-mon[116404]: pgmap v2256: 457 pgs: 1 peering, 456 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 526 KiB/s wr, 1.07k op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:43:58.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:43:58 smithi084 ceph-mon[119097]: pgmap v2256: 457 pgs: 1 peering, 456 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 526 KiB/s wr, 1.07k op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:00.567 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:00.567 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:00.567 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:00.567 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:00.567 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:00.567 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.567 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:00.567 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:00.571 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:00.573 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:00.573 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.573 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:00.573 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:00.573 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:00.573 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.573 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:00.573 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:00.573 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:00.573 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 512~512 = 512 2024-01-13T18:44:00.573 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:aio discard: 1536~512 = 0 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:44:00.574 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.575 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.576 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.577 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.578 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.579 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.580 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.581 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.582 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.582 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:00.582 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:00.582 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:00.582 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:00.582 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:00.582 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:00.582 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:00.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:00 smithi084 ceph-mon[116404]: pgmap v2257: 457 pgs: 457 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 43 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:44:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:44:00] "GET /metrics HTTP/1.1" 200 60435 "" "Prometheus/2.43.0" 2024-01-13T18:44:00.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:00 smithi084 ceph-mon[119097]: pgmap v2257: 457 pgs: 457 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 43 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:00.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:00 smithi099 ceph-mon[138788]: pgmap v2257: 457 pgs: 457 active+clean; 15 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 43 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:02.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:02 smithi099 ceph-mon[138788]: pgmap v2258: 457 pgs: 457 active+clean; 19 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 449 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:02 smithi084 ceph-mon[116404]: pgmap v2258: 457 pgs: 457 active+clean; 19 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 449 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:02 smithi084 ceph-mon[119097]: pgmap v2258: 457 pgs: 457 active+clean; 19 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 449 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:04.162 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.162 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.162 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.162 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.162 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.162 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.162 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.162 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.162 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.162 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.162 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.166 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:04.169 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:04.170 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:04.170 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:04.170 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:04.170 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:04.170 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 4 2024-01-13T18:44:04.170 INFO:tasks.workunit.client.0.smithi084.stdout:read: 4 2024-01-13T18:44:04.170 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS2 (12691 ms) 2024-01-13T18:44:04.170 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestIOWithIOHint 2024-01-13T18:44:04.170 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:04.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:04 smithi099 ceph-mon[138788]: pgmap v2259: 457 pgs: 457 active+clean; 31 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 752 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:04 smithi084 ceph-mon[116404]: pgmap v2259: 457 pgs: 457 active+clean; 31 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 752 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:04.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:04 smithi084 ceph-mon[119097]: pgmap v2259: 457 pgs: 457 active+clean; 31 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 752 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:05.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:06.041 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:06.042 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:06.044 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 512~512 = 512 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:aio discard: 1536~512 = 0 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:06.045 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.046 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:44:06.047 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:44:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.049 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.050 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:06.053 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:06.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:06 smithi099 ceph-mon[138788]: pgmap v2260: 457 pgs: 457 active+clean; 31 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 636 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:06 smithi084 ceph-mon[116404]: pgmap v2260: 457 pgs: 457 active+clean; 31 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 636 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:06.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:06 smithi084 ceph-mon[119097]: pgmap v2260: 457 pgs: 457 active+clean; 31 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 636 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.684 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:07.688 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:07.691 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.691 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.691 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:07.691 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:07.691 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:07.691 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:07.691 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:07.691 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:07.691 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:07.691 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestIOWithIOHint (3521 ms) 2024-01-13T18:44:07.691 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestDataPoolIO 2024-01-13T18:44:08.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:08 smithi099 ceph-mon[138788]: pgmap v2261: 457 pgs: 457 active+clean; 35 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 740 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:08 smithi084 ceph-mon[116404]: pgmap v2261: 457 pgs: 457 active+clean; 35 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 740 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:08.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:08 smithi084 ceph-mon[119097]: pgmap v2261: 457 pgs: 457 active+clean; 35 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 740 op/s; 0 B/s, 0 objects/s recovering 2024-01-13T18:44:09.562 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:09 smithi099 ceph-mon[138788]: osdmap e1218: 8 total, 8 up, 8 in 2024-01-13T18:44:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:09 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1449286371' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:09 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:09 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:09 smithi099 ceph-mon[138788]: osdmap e1219: 8 total, 8 up, 8 in 2024-01-13T18:44:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:09 smithi084 ceph-mon[116404]: osdmap e1218: 8 total, 8 up, 8 in 2024-01-13T18:44:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:09 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1449286371' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:09 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:09.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:09 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:09.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:09 smithi084 ceph-mon[116404]: osdmap e1219: 8 total, 8 up, 8 in 2024-01-13T18:44:09.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:09 smithi084 ceph-mon[119097]: osdmap e1218: 8 total, 8 up, 8 in 2024-01-13T18:44:09.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:09 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1449286371' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:09.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:09 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:09.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:09 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:09.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:09 smithi084 ceph-mon[119097]: osdmap e1219: 8 total, 8 up, 8 in 2024-01-13T18:44:10.589 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:44:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:44:10] "GET /metrics HTTP/1.1" 200 60446 "" "Prometheus/2.43.0" 2024-01-13T18:44:10.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:10 smithi099 ceph-mon[138788]: pgmap v2263: 489 pgs: 32 unknown, 457 active+clean; 35 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.1 MiB/s wr, 994 op/s 2024-01-13T18:44:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:10 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:44:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:10 smithi099 ceph-mon[138788]: osdmap e1220: 8 total, 8 up, 8 in 2024-01-13T18:44:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:10 smithi084 ceph-mon[119097]: pgmap v2263: 489 pgs: 32 unknown, 457 active+clean; 35 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.1 MiB/s wr, 994 op/s 2024-01-13T18:44:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:10 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:44:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:10 smithi084 ceph-mon[119097]: osdmap e1220: 8 total, 8 up, 8 in 2024-01-13T18:44:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:10 smithi084 ceph-mon[116404]: pgmap v2263: 489 pgs: 32 unknown, 457 active+clean; 35 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.1 MiB/s wr, 994 op/s 2024-01-13T18:44:10.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:10 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:44:10.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:10 smithi084 ceph-mon[116404]: osdmap e1220: 8 total, 8 up, 8 in 2024-01-13T18:44:11.624 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:11.624 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:11.624 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:11.624 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:11.624 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 512~512 = 512 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:aio discard: 1536~512 = 0 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:11.629 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:11.629 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestDataPoolIO (3942 ms) 2024-01-13T18:44:11.629 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatch 2024-01-13T18:44:11.629 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:11.652 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatch (27 ms) 2024-01-13T18:44:11.652 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatch 2024-01-13T18:44:11.652 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:11.680 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatch (29 ms) 2024-01-13T18:44:11.681 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccess 2024-01-13T18:44:11.681 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:11.704 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccess (24 ms) 2024-01-13T18:44:11.704 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccess 2024-01-13T18:44:11.704 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:11.731 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccess (27 ms) 2024-01-13T18:44:11.732 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned 2024-01-13T18:44:11.732 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:11.809 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnaligned (77 ms) 2024-01-13T18:44:11.809 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned 2024-01-13T18:44:11.809 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:11.871 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnaligned (63 ms) 2024-01-13T18:44:11.872 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLarge 2024-01-13T18:44:11.872 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:11.941 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLarge (70 ms) 2024-01-13T18:44:11.941 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLarge 2024-01-13T18:44:11.942 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:12.007 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLarge (64 ms) 2024-01-13T18:44:12.007 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess 2024-01-13T18:44:12.007 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:12.262 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccess (256 ms) 2024-01-13T18:44:12.262 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess 2024-01-13T18:44:12.262 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:12.598 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccess (336 ms) 2024-01-13T18:44:12.598 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers 2024-01-13T18:44:12.598 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:12.625 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVIovecLenDiffers (27 ms) 2024-01-13T18:44:12.625 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVMismatch 2024-01-13T18:44:12.625 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:12.651 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVMismatch (26 ms) 2024-01-13T18:44:12.651 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteVSuccess 2024-01-13T18:44:12.651 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:12.677 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteVSuccess (26 ms) 2024-01-13T18:44:12.677 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestScatterGatherIO 2024-01-13T18:44:12.677 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:12.703 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestScatterGatherIO (26 ms) 2024-01-13T18:44:12.703 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestEmptyDiscard 2024-01-13T18:44:12.703 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:12.722 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:aio discard: 0~1048576 = 0 2024-01-13T18:44:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:aio discard: 0~4194304 = 0 2024-01-13T18:44:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:aio discard: 3145728~1048576 = 0 2024-01-13T18:44:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestEmptyDiscard (20 ms) 2024-01-13T18:44:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestFUA 2024-01-13T18:44:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:12.822 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:12.822 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:12.822 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:12.822 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:12.822 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:12.822 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:12.822 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:12.822 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:12.822 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:12.822 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.823 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:12.824 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:12.825 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:12.825 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.825 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:12.825 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:12.825 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:12.825 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.825 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:12.825 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:12.825 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:12.826 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.827 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:12.827 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:12.827 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:12.827 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.827 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:12.827 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:12.827 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:12.827 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestFUA (99 ms) 2024-01-13T18:44:12.827 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestIOPP 2024-01-13T18:44:12.827 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:12.842 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:12.844 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.856 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.856 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:12.856 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:12.856 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:12.856 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:12.857 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:12.857 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:12.857 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:12.857 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:12.857 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:12.857 INFO:tasks.workunit.client.0.smithi084.stdout:start compare and write 2024-01-13T18:44:12.857 INFO:tasks.workunit.client.0.smithi084.stdout:compare and wrote: 512 2024-01-13T18:44:12.857 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.857 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:12.857 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.857 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.858 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:12.858 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.858 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:12.858 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.858 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.858 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:12.858 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.858 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:12.858 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.859 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.859 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:12.859 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.859 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:12.859 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.860 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.860 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:12.860 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.860 INFO:tasks.workunit.client.0.smithi084.stdout:started aio compare and write 2024-01-13T18:44:12.860 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.862 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:12.862 INFO:tasks.workunit.client.0.smithi084.stdout:finished aio compare and write 2024-01-13T18:44:12.862 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:12.862 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:12.862 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:12.862 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:12.862 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:12.862 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.863 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:12.863 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:12.863 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:12.863 INFO:tasks.workunit.client.0.smithi084.stdout:finished read 2024-01-13T18:44:12.863 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.863 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:12.863 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:12.863 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:12.863 INFO:tasks.workunit.client.0.smithi084.stdout:finished read 2024-01-13T18:44:12.863 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.864 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:12.864 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:12.864 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:12.865 INFO:tasks.workunit.client.0.smithi084.stdout:finished read 2024-01-13T18:44:12.865 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.865 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:12.865 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:12.865 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:12.865 INFO:tasks.workunit.client.0.smithi084.stdout:finished read 2024-01-13T18:44:12.865 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:12.865 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:12.866 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:12.866 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:12.866 INFO:tasks.workunit.client.0.smithi084.stdout:finished read 2024-01-13T18:44:12.866 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 512~512 2024-01-13T18:44:12.866 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:12 smithi099 ceph-mon[138788]: pgmap v2266: 489 pgs: 4 creating+peering, 23 unknown, 462 active+clean; 37 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.5 MiB/s rd, 424 KiB/s wr, 1.59k op/s 2024-01-13T18:44:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:12 smithi099 ceph-mon[138788]: osdmap e1221: 8 total, 8 up, 8 in 2024-01-13T18:44:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:12 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:44:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:12 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:44:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:12 smithi084 ceph-mon[116404]: pgmap v2266: 489 pgs: 4 creating+peering, 23 unknown, 462 active+clean; 37 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.5 MiB/s rd, 424 KiB/s wr, 1.59k op/s 2024-01-13T18:44:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:12 smithi084 ceph-mon[116404]: osdmap e1221: 8 total, 8 up, 8 in 2024-01-13T18:44:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:12 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:44:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:12 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:44:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:12 smithi084 ceph-mon[119097]: pgmap v2266: 489 pgs: 4 creating+peering, 23 unknown, 462 active+clean; 37 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.5 MiB/s rd, 424 KiB/s wr, 1.59k op/s 2024-01-13T18:44:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:12 smithi084 ceph-mon[119097]: osdmap e1221: 8 total, 8 up, 8 in 2024-01-13T18:44:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:12 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:44:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:12 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:44:13.708 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:13.708 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:13.708 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:13.708 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:13.708 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:44:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:44:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:44:13.710 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.710 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.710 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:44:13.710 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.710 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.710 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.710 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.711 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:44:13.711 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.711 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.711 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:44:13.711 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.711 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.711 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:44:13.712 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.712 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.712 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:44:13.712 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.712 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.712 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.713 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.713 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:44:13.713 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.713 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.713 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:44:13.713 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.713 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.714 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:44:13.714 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.714 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.714 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:44:13.714 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.714 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.714 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.715 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.715 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:44:13.715 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.715 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.715 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:44:13.715 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.715 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.716 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:44:13.716 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.716 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.716 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:44:13.716 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.716 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.716 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.717 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.717 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:44:13.717 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.717 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.717 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:44:13.717 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.717 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.718 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:44:13.718 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.718 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.718 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:44:13.718 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.718 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.718 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.719 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.719 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.719 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.719 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.719 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.719 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.719 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.719 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.720 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.720 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.720 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.720 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.720 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.720 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.720 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.721 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.721 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.721 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.722 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.722 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.722 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.722 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.722 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.722 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.723 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.723 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.723 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.723 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.723 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.723 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.723 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.723 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.724 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.724 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.724 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.724 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.724 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.724 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.741 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.741 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.742 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.742 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.742 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.742 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.742 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.759 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.760 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.760 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.760 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.760 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.760 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.760 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.786 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.786 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.786 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.787 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.787 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.787 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.787 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.811 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.812 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.849 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.849 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.849 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.849 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.849 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.850 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.850 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.886 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.887 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.887 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.887 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.887 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.887 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.887 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.933 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.933 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.933 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.933 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.933 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.933 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.933 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:13.976 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:13.976 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:13.976 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:13.976 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:13.976 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.976 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.976 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.977 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.977 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.977 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:13.977 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:13.977 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:13.977 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.040 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:14.040 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:14.040 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:14.041 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:14.041 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:14.041 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:14.041 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.098 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:14.098 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:14.098 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:14.098 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:14.098 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:14.099 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:14.099 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.166 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:14.166 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:14.166 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:14.166 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:14.166 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:14.166 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:14.166 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.230 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:14.230 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:14.230 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:14.230 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:14.230 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:14.230 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:14.231 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:14.231 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:14.231 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:14.231 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:14.231 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:14.231 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:14.231 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.320 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:14.320 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:14.321 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:14.321 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:14.321 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:14.321 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:14.321 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.390 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:14.391 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:14.391 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:14.391 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:14.391 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:14.391 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:14.391 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.482 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:14.482 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:14.482 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:14.482 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:14.482 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:14.482 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:14.482 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.565 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:14.565 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:14.565 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:14.565 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:14.565 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:14.566 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:14.566 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:14.566 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:14.566 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:14.566 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:14.566 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestIOPP (1744 ms) 2024-01-13T18:44:14.566 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP 2024-01-13T18:44:14.566 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.595 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteCompareTooSmallPP (30 ms) 2024-01-13T18:44:14.596 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP 2024-01-13T18:44:14.596 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.619 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteCompareTooSmallPP (24 ms) 2024-01-13T18:44:14.619 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP 2024-01-13T18:44:14.619 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.645 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteWriteTooSmallPP (25 ms) 2024-01-13T18:44:14.645 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP 2024-01-13T18:44:14.645 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.669 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteWriteTooSmallPP (25 ms) 2024-01-13T18:44:14.669 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchPP 2024-01-13T18:44:14.669 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.698 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchPP (29 ms) 2024-01-13T18:44:14.698 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchPP 2024-01-13T18:44:14.698 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.720 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.723 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchPP (25 ms) 2024-01-13T18:44:14.723 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP 2024-01-13T18:44:14.724 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.750 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteMismatchBufferlistGreaterLenPP (26 ms) 2024-01-13T18:44:14.750 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP 2024-01-13T18:44:14.750 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.772 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.775 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteMismatchBufferlistGreaterLenPP (25 ms) 2024-01-13T18:44:14.775 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessPP 2024-01-13T18:44:14.775 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.800 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessPP (26 ms) 2024-01-13T18:44:14.800 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessPP 2024-01-13T18:44:14.800 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.819 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.822 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessPP (22 ms) 2024-01-13T18:44:14.822 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP 2024-01-13T18:44:14.822 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.849 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteSuccessBufferlistGreaterLenPP (27 ms) 2024-01-13T18:44:14.850 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP 2024-01-13T18:44:14.850 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:14 smithi099 ceph-mon[138788]: pgmap v2268: 489 pgs: 4 creating+peering, 2 unknown, 483 active+clean; 39 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 866 KiB/s rd, 430 KiB/s wr, 1.78k op/s 2024-01-13T18:44:14.875 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:14.878 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteSuccessBufferlistGreaterLenPP (28 ms) 2024-01-13T18:44:14.878 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP 2024-01-13T18:44:14.878 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:14 smithi084 ceph-mon[116404]: pgmap v2268: 489 pgs: 4 creating+peering, 2 unknown, 483 active+clean; 39 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 866 KiB/s rd, 430 KiB/s wr, 1.78k op/s 2024-01-13T18:44:14.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:14 smithi084 ceph-mon[119097]: pgmap v2268: 489 pgs: 4 creating+peering, 2 unknown, 483 active+clean; 39 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 866 KiB/s rd, 430 KiB/s wr, 1.78k op/s 2024-01-13T18:44:14.940 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitUnalignedPP (63 ms) 2024-01-13T18:44:14.940 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP 2024-01-13T18:44:14.940 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:14.986 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:15.001 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitUnalignedPP (60 ms) 2024-01-13T18:44:15.001 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteTooLargePP 2024-01-13T18:44:15.001 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:15.064 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteTooLargePP (63 ms) 2024-01-13T18:44:15.064 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteTooLargePP 2024-01-13T18:44:15.064 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:15.120 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:15.145 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteTooLargePP (82 ms) 2024-01-13T18:44:15.145 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP 2024-01-13T18:44:15.146 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:15.400 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestCompareAndWriteStripeUnitSuccessPP (254 ms) 2024-01-13T18:44:15.400 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP 2024-01-13T18:44:15.400 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:15.722 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:15.742 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestAioCompareAndWriteStripeUnitSuccessPP (342 ms) 2024-01-13T18:44:15.742 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestIOPPWithIOHint 2024-01-13T18:44:15.742 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:15.774 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:15.775 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:15.775 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:15.775 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:15.775 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:44:15.775 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:15.775 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:15.776 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:15.776 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:15.776 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:15.777 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:15.777 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:15.777 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:15.777 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:15.777 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:15.777 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:15.777 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:15.777 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:15.778 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:15.778 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:15.778 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:15.778 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:15.778 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:15.781 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:15.781 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:15.781 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:15.781 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:44:15.781 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:15.782 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:15.782 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:44:15.782 INFO:tasks.workunit.client.0.smithi084.stdout:read: 512 2024-01-13T18:44:15.782 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:15.782 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:15.782 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:15.782 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:15.782 INFO:tasks.workunit.client.0.smithi084.stdout:finished read 2024-01-13T18:44:15.782 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:15.782 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:15.783 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:15.783 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:15.783 INFO:tasks.workunit.client.0.smithi084.stdout:finished read 2024-01-13T18:44:15.783 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:15.783 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:15.783 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:15.783 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:15.783 INFO:tasks.workunit.client.0.smithi084.stdout:finished read 2024-01-13T18:44:15.784 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:15.784 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:15.784 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:15.784 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:15.784 INFO:tasks.workunit.client.0.smithi084.stdout:finished read 2024-01-13T18:44:15.784 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:15.784 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:44:15.784 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:44:16.621 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:44:16.621 INFO:tasks.workunit.client.0.smithi084.stdout:finished read 2024-01-13T18:44:16.621 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:44:16.621 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.621 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.621 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 0 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 16384 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.622 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 49152 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 65536 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 98304 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:44:16.623 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 114688 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 147456 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.624 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 163840 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 196608 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.625 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 212992 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.626 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.627 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.627 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.627 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.627 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.627 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.627 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.627 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.627 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.627 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.628 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.628 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.628 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.630 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.630 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.630 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.631 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.631 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.631 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.631 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.638 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.638 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.638 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.638 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.638 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.638 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.638 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.638 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.639 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.639 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.639 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.639 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.639 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.658 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.659 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.659 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.659 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.659 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.659 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.659 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.679 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.679 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.679 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.679 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.679 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.679 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.680 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.707 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.707 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.707 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.707 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.707 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.707 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.707 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.734 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.735 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.735 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.735 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.735 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.735 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.735 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.735 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.735 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.736 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.736 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.736 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.736 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.776 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.776 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.776 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.776 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.776 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.776 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.777 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.814 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.815 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.815 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.815 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.815 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.815 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.815 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.861 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.861 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.861 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.861 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.861 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.861 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.861 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:16 smithi099 ceph-mon[138788]: pgmap v2269: 489 pgs: 489 active+clean; 51 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 1.25k op/s 2024-01-13T18:44:16.902 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.903 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:16 smithi084 ceph-mon[116404]: pgmap v2269: 489 pgs: 489 active+clean; 51 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 1.25k op/s 2024-01-13T18:44:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:16 smithi084 ceph-mon[119097]: pgmap v2269: 489 pgs: 489 active+clean; 51 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 1.25k op/s 2024-01-13T18:44:16.959 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:16.959 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:16.959 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:16.959 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:16.959 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:16.959 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:16.960 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:17.014 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:17.015 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:17.015 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:17.015 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:17.015 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:17.015 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:17.015 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:17.072 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:17.072 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:17.072 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:17.072 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:17.072 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:17.072 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:17.072 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:17.133 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:17.213 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:17.213 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:17.213 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:17.214 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:17.214 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:17.214 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:17.214 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:17.284 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:17.284 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:17.284 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:17.284 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:17.284 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:17.284 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:17.284 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:17.363 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:17.363 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:17.363 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:17.363 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:17.363 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:17.364 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:17.364 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:44:17.449 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:44:17.449 INFO:tasks.workunit.client.0.smithi084.stdout:finished writesame 2024-01-13T18:44:17.449 INFO:tasks.workunit.client.0.smithi084.stdout:to verify the data 2024-01-13T18:44:17.450 INFO:tasks.workunit.client.0.smithi084.stdout:verified 2024-01-13T18:44:17.450 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:17.450 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:17.450 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:17.450 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:44:17.450 INFO:tasks.workunit.client.0.smithi084.stdout:started writesame 2024-01-13T18:44:17.450 INFO:tasks.workunit.client.0.smithi084.stdout:expected fail, finished writesame 2024-01-13T18:44:17.450 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestIOPPWithIOHint (1708 ms) 2024-01-13T18:44:17.450 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestIOToSnapshot 2024-01-13T18:44:17.450 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:18.470 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 0 2024-01-13T18:44:18.470 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 0 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 1 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:snap: orig 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:found orig with size 2097152 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:read: 80 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:write test data! 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 80 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 2 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:snap: orig 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:snap: written 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:found orig with size 2097152 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:found written with size 2097152 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:read: 80 2024-01-13T18:44:18.471 INFO:tasks.workunit.client.0.smithi084.stdout:read: 80 2024-01-13T18:44:18.472 INFO:tasks.workunit.client.0.smithi084.stdout:read: 80 2024-01-13T18:44:18.472 INFO:tasks.workunit.client.0.smithi084.stdout:write to snapshot returned -30 2024-01-13T18:44:18.472 INFO:tasks.workunit.client.0.smithi084.stdout:Read-only file system 2024-01-13T18:44:18.490 INFO:tasks.workunit.client.0.smithi084.stdout:read: 80 2024-01-13T18:44:18.490 INFO:tasks.workunit.client.0.smithi084.stdout:read: 80 2024-01-13T18:44:18.490 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 80 2024-01-13T18:44:18.490 INFO:tasks.workunit.client.0.smithi084.stdout:opening testimg@orig 2024-01-13T18:44:18.490 INFO:tasks.workunit.client.0.smithi084.stdout:read: 80 2024-01-13T18:44:18.490 INFO:tasks.workunit.client.0.smithi084.stdout:write to snapshot returned -30 2024-01-13T18:44:18.491 INFO:tasks.workunit.client.0.smithi084.stdout:Read-only file system 2024-01-13T18:44:18.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:18 smithi099 ceph-mon[138788]: pgmap v2270: 489 pgs: 489 active+clean; 63 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 1.12k op/s 2024-01-13T18:44:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:18 smithi099 ceph-mon[138788]: osdmap e1222: 8 total, 8 up, 8 in 2024-01-13T18:44:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:44:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:44:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:44:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:44:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:18 smithi099 ceph-mon[138788]: osdmap e1223: 8 total, 8 up, 8 in 2024-01-13T18:44:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[116404]: pgmap v2270: 489 pgs: 489 active+clean; 63 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 1.12k op/s 2024-01-13T18:44:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[116404]: osdmap e1222: 8 total, 8 up, 8 in 2024-01-13T18:44:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:44:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:44:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:44:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:44:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[116404]: osdmap e1223: 8 total, 8 up, 8 in 2024-01-13T18:44:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[119097]: pgmap v2270: 489 pgs: 489 active+clean; 63 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 1.12k op/s 2024-01-13T18:44:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[119097]: osdmap e1222: 8 total, 8 up, 8 in 2024-01-13T18:44:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:44:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:44:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:44:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:44:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:18 smithi084 ceph-mon[119097]: osdmap e1223: 8 total, 8 up, 8 in 2024-01-13T18:44:20.497 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 2 2024-01-13T18:44:20.497 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:44:20.497 INFO:tasks.workunit.client.0.smithi084.stdout:snap: orig 2024-01-13T18:44:20.497 INFO:tasks.workunit.client.0.smithi084.stdout:snap: written 2024-01-13T18:44:20.497 INFO:tasks.workunit.client.0.smithi084.stdout:found orig with size 2097152 2024-01-13T18:44:20.497 INFO:tasks.workunit.client.0.smithi084.stdout:found written with size 2097152 2024-01-13T18:44:20.497 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 1 2024-01-13T18:44:20.497 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:44:20.498 INFO:tasks.workunit.client.0.smithi084.stdout:snap: orig 2024-01-13T18:44:20.498 INFO:tasks.workunit.client.0.smithi084.stdout:found orig with size 2097152 2024-01-13T18:44:20.498 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 0 2024-01-13T18:44:20.498 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 0 2024-01-13T18:44:20.498 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestIOToSnapshot (3047 ms) 2024-01-13T18:44:20.498 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestSnapshotDeletedIo 2024-01-13T18:44:20.498 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:44:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:44:20] "GET /metrics HTTP/1.1" 200 62856 "" "Prometheus/2.43.0" 2024-01-13T18:44:20.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:20 smithi084 ceph-mon[116404]: pgmap v2273: 489 pgs: 489 active+clean; 119 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 14 MiB/s wr, 1.49k op/s 2024-01-13T18:44:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:20 smithi084 ceph-mon[116404]: osdmap e1224: 8 total, 8 up, 8 in 2024-01-13T18:44:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:20 smithi084 ceph-mon[119097]: pgmap v2273: 489 pgs: 489 active+clean; 119 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 14 MiB/s wr, 1.49k op/s 2024-01-13T18:44:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:20 smithi084 ceph-mon[119097]: osdmap e1224: 8 total, 8 up, 8 in 2024-01-13T18:44:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:20.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:20 smithi099 ceph-mon[138788]: pgmap v2273: 489 pgs: 489 active+clean; 119 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 14 MiB/s wr, 1.49k op/s 2024-01-13T18:44:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:20 smithi099 ceph-mon[138788]: osdmap e1224: 8 total, 8 up, 8 in 2024-01-13T18:44:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:21.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:21 smithi099 ceph-mon[138788]: osdmap e1225: 8 total, 8 up, 8 in 2024-01-13T18:44:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:21 smithi084 ceph-mon[116404]: osdmap e1225: 8 total, 8 up, 8 in 2024-01-13T18:44:21.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:21 smithi084 ceph-mon[119097]: osdmap e1225: 8 total, 8 up, 8 in 2024-01-13T18:44:22.494 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestSnapshotDeletedIo (1997 ms) 2024-01-13T18:44:22.494 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestClone 2024-01-13T18:44:22.494 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:22.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:22 smithi099 ceph-mon[138788]: pgmap v2276: 489 pgs: 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 24 MiB/s rd, 23 MiB/s wr, 4.64k op/s 2024-01-13T18:44:22.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:22 smithi099 ceph-mon[138788]: osdmap e1226: 8 total, 8 up, 8 in 2024-01-13T18:44:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:22 smithi084 ceph-mon[116404]: pgmap v2276: 489 pgs: 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 24 MiB/s rd, 23 MiB/s wr, 4.64k op/s 2024-01-13T18:44:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:22 smithi084 ceph-mon[116404]: osdmap e1226: 8 total, 8 up, 8 in 2024-01-13T18:44:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:22 smithi084 ceph-mon[119097]: pgmap v2276: 489 pgs: 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 24 MiB/s rd, 23 MiB/s wr, 4.64k op/s 2024-01-13T18:44:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:22 smithi084 ceph-mon[119097]: osdmap e1226: 8 total, 8 up, 8 in 2024-01-13T18:44:23.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:23 smithi099 ceph-mon[138788]: osdmap e1227: 8 total, 8 up, 8 in 2024-01-13T18:44:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:23 smithi084 ceph-mon[116404]: osdmap e1227: 8 total, 8 up, 8 in 2024-01-13T18:44:23.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:23 smithi084 ceph-mon[119097]: osdmap e1227: 8 total, 8 up, 8 in 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:made parent image "parent" 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:parent has no parent info 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:made snapshot "parent@parent_snap" 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:can't unprotect an unprotected snap 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:can't protect a protected snap 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:made and opened clone "child" 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:read: 8 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:read: 8 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:read: 8 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:sizes and overlaps are good between parent and child 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:child image successfully cloned all image-meta pairs 2024-01-13T18:44:24.510 INFO:tasks.workunit.client.0.smithi084.stdout:sized down clone, changed overlap 2024-01-13T18:44:24.511 INFO:tasks.workunit.client.0.smithi084.stdout:parent info: size 4194304 obj_size 4194304 parent_pool 18446744073709551615 2024-01-13T18:44:24.511 INFO:tasks.workunit.client.0.smithi084.stdout:sized up clone, changed size but not overlap or parent's size 2024-01-13T18:44:24.511 INFO:tasks.workunit.client.0.smithi084.stdout:can't remove parent while child still exists 2024-01-13T18:44:24.511 INFO:tasks.workunit.client.0.smithi084.stdout:can't remove parent while still protected 2024-01-13T18:44:24.511 INFO:tasks.workunit.client.0.smithi084.stdout:removed parent snap after unprotecting 2024-01-13T18:44:24.511 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestClone (2016 ms) 2024-01-13T18:44:24.511 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestClone2 2024-01-13T18:44:24.511 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:24.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:24 smithi099 ceph-mon[138788]: pgmap v2279: 489 pgs: 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.5 MiB/s wr, 2.29k op/s 2024-01-13T18:44:24.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:24 smithi099 ceph-mon[138788]: osdmap e1228: 8 total, 8 up, 8 in 2024-01-13T18:44:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:24 smithi084 ceph-mon[116404]: pgmap v2279: 489 pgs: 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.5 MiB/s wr, 2.29k op/s 2024-01-13T18:44:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:24 smithi084 ceph-mon[116404]: osdmap e1228: 8 total, 8 up, 8 in 2024-01-13T18:44:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:24 smithi084 ceph-mon[119097]: pgmap v2279: 489 pgs: 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.5 MiB/s wr, 2.29k op/s 2024-01-13T18:44:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:24 smithi084 ceph-mon[119097]: osdmap e1228: 8 total, 8 up, 8 in 2024-01-13T18:44:25.613 INFO:tasks.workunit.client.0.smithi084.stdout:made parent image "parent" 2024-01-13T18:44:25.614 INFO:tasks.workunit.client.0.smithi084.stdout:parent has no parent info 2024-01-13T18:44:25.614 INFO:tasks.workunit.client.0.smithi084.stdout:made snapshot "parent@parent_snap" 2024-01-13T18:44:25.614 INFO:tasks.workunit.client.0.smithi084.stdout:made and opened clone "child" 2024-01-13T18:44:25.614 INFO:tasks.workunit.client.0.smithi084.stdout:child image successfully cloned all image-meta pairs 2024-01-13T18:44:25.614 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestClone2 (1104 ms) 2024-01-13T18:44:25.614 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ListChildren 2024-01-13T18:44:25.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:25 smithi099 ceph-mon[138788]: osdmap e1229: 8 total, 8 up, 8 in 2024-01-13T18:44:25.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:25 smithi084 ceph-mon[116404]: osdmap e1229: 8 total, 8 up, 8 in 2024-01-13T18:44:25.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:25 smithi084 ceph-mon[119097]: osdmap e1229: 8 total, 8 up, 8 in 2024-01-13T18:44:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:26 smithi099 ceph-mon[138788]: pgmap v2282: 489 pgs: 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 75 KiB/s rd, 8.5 KiB/s wr, 104 op/s 2024-01-13T18:44:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:26 smithi099 ceph-mon[138788]: osdmap e1230: 8 total, 8 up, 8 in 2024-01-13T18:44:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:26 smithi084 ceph-mon[116404]: pgmap v2282: 489 pgs: 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 75 KiB/s rd, 8.5 KiB/s wr, 104 op/s 2024-01-13T18:44:26.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:26 smithi084 ceph-mon[116404]: osdmap e1230: 8 total, 8 up, 8 in 2024-01-13T18:44:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:26 smithi084 ceph-mon[119097]: pgmap v2282: 489 pgs: 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 75 KiB/s rd, 8.5 KiB/s wr, 104 op/s 2024-01-13T18:44:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:26 smithi084 ceph-mon[119097]: osdmap e1230: 8 total, 8 up, 8 in 2024-01-13T18:44:27.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:27 smithi099 ceph-mon[138788]: osdmap e1231: 8 total, 8 up, 8 in 2024-01-13T18:44:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:27 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/871711777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:27 smithi084 ceph-mon[116404]: osdmap e1231: 8 total, 8 up, 8 in 2024-01-13T18:44:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:27 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/871711777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:27.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:27 smithi084 ceph-mon[119097]: osdmap e1231: 8 total, 8 up, 8 in 2024-01-13T18:44:27.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:27 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/871711777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:28 smithi099 ceph-mon[138788]: pgmap v2285: 521 pgs: 32 unknown, 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 208 KiB/s rd, 18 KiB/s wr, 261 op/s 2024-01-13T18:44:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:28 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:44:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:28 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/871711777' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:28 smithi099 ceph-mon[138788]: osdmap e1232: 8 total, 8 up, 8 in 2024-01-13T18:44:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:28 smithi099 ceph-mon[138788]: osdmap e1233: 8 total, 8 up, 8 in 2024-01-13T18:44:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:28 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1075703420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:28.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:28 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[116404]: pgmap v2285: 521 pgs: 32 unknown, 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 208 KiB/s rd, 18 KiB/s wr, 261 op/s 2024-01-13T18:44:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:44:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/871711777' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[116404]: osdmap e1232: 8 total, 8 up, 8 in 2024-01-13T18:44:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[116404]: osdmap e1233: 8 total, 8 up, 8 in 2024-01-13T18:44:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1075703420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[119097]: pgmap v2285: 521 pgs: 32 unknown, 489 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 208 KiB/s rd, 18 KiB/s wr, 261 op/s 2024-01-13T18:44:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:44:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/871711777' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[119097]: osdmap e1232: 8 total, 8 up, 8 in 2024-01-13T18:44:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[119097]: osdmap e1233: 8 total, 8 up, 8 in 2024-01-13T18:44:28.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1075703420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:28.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:28 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:29.474 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:44:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:44:30] "GET /metrics HTTP/1.1" 200 62856 "" "Prometheus/2.43.0" 2024-01-13T18:44:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:30 smithi084 ceph-mon[116404]: pgmap v2288: 553 pgs: 10 creating+peering, 48 unknown, 495 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 647 KiB/s rd, 46 KiB/s wr, 780 op/s 2024-01-13T18:44:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:30 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:30 smithi084 ceph-mon[116404]: osdmap e1234: 8 total, 8 up, 8 in 2024-01-13T18:44:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:30 smithi084 ceph-mon[119097]: pgmap v2288: 553 pgs: 10 creating+peering, 48 unknown, 495 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 647 KiB/s rd, 46 KiB/s wr, 780 op/s 2024-01-13T18:44:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:30 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:30 smithi084 ceph-mon[119097]: osdmap e1234: 8 total, 8 up, 8 in 2024-01-13T18:44:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:30 smithi099 ceph-mon[138788]: pgmap v2288: 553 pgs: 10 creating+peering, 48 unknown, 495 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 647 KiB/s rd, 46 KiB/s wr, 780 op/s 2024-01-13T18:44:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:30 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:30 smithi099 ceph-mon[138788]: osdmap e1234: 8 total, 8 up, 8 in 2024-01-13T18:44:31.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:31 smithi099 ceph-mon[138788]: osdmap e1235: 8 total, 8 up, 8 in 2024-01-13T18:44:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:31 smithi084 ceph-mon[116404]: osdmap e1235: 8 total, 8 up, 8 in 2024-01-13T18:44:31.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:31 smithi084 ceph-mon[119097]: osdmap e1235: 8 total, 8 up, 8 in 2024-01-13T18:44:32.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:32 smithi099 ceph-mon[138788]: pgmap v2291: 553 pgs: 16 creating+peering, 22 unknown, 515 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 571 KiB/s rd, 37 KiB/s wr, 672 op/s 2024-01-13T18:44:32.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:32 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:44:32.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:32 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:44:32.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:32 smithi099 ceph-mon[138788]: osdmap e1236: 8 total, 8 up, 8 in 2024-01-13T18:44:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:32 smithi084 ceph-mon[116404]: pgmap v2291: 553 pgs: 16 creating+peering, 22 unknown, 515 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 571 KiB/s rd, 37 KiB/s wr, 672 op/s 2024-01-13T18:44:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:32 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:44:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:32 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:44:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:32 smithi084 ceph-mon[116404]: osdmap e1236: 8 total, 8 up, 8 in 2024-01-13T18:44:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:32 smithi084 ceph-mon[119097]: pgmap v2291: 553 pgs: 16 creating+peering, 22 unknown, 515 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 571 KiB/s rd, 37 KiB/s wr, 672 op/s 2024-01-13T18:44:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:32 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:44:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:32 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:44:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:32 smithi084 ceph-mon[119097]: osdmap e1236: 8 total, 8 up, 8 in 2024-01-13T18:44:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:33 smithi099 ceph-mon[138788]: osdmap e1237: 8 total, 8 up, 8 in 2024-01-13T18:44:33.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:33 smithi099 ceph-mon[138788]: osdmap e1238: 8 total, 8 up, 8 in 2024-01-13T18:44:33.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:33 smithi084 ceph-mon[116404]: osdmap e1237: 8 total, 8 up, 8 in 2024-01-13T18:44:33.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:33 smithi084 ceph-mon[116404]: osdmap e1238: 8 total, 8 up, 8 in 2024-01-13T18:44:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:33 smithi084 ceph-mon[119097]: osdmap e1237: 8 total, 8 up, 8 in 2024-01-13T18:44:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:33 smithi084 ceph-mon[119097]: osdmap e1238: 8 total, 8 up, 8 in 2024-01-13T18:44:34.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:34 smithi099 ceph-mon[138788]: pgmap v2294: 553 pgs: 6 creating+peering, 9 unknown, 538 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 131 KiB/s rd, 9.0 KiB/s wr, 150 op/s 2024-01-13T18:44:34.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:34 smithi099 ceph-mon[138788]: osdmap e1239: 8 total, 8 up, 8 in 2024-01-13T18:44:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:34 smithi084 ceph-mon[116404]: pgmap v2294: 553 pgs: 6 creating+peering, 9 unknown, 538 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 131 KiB/s rd, 9.0 KiB/s wr, 150 op/s 2024-01-13T18:44:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:34 smithi084 ceph-mon[116404]: osdmap e1239: 8 total, 8 up, 8 in 2024-01-13T18:44:34.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:34 smithi084 ceph-mon[119097]: pgmap v2294: 553 pgs: 6 creating+peering, 9 unknown, 538 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 131 KiB/s rd, 9.0 KiB/s wr, 150 op/s 2024-01-13T18:44:34.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:34 smithi084 ceph-mon[119097]: osdmap e1239: 8 total, 8 up, 8 in 2024-01-13T18:44:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.951 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 1 2024-01-13T18:44:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:44:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:child: image96 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96/b186f807aa9c 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.952 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 2 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:child: image97 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:child: image96 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96/b186f807aa9c 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97/b1862ba93284 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image98 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image98 2024-01-13T18:44:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image98 2024-01-13T18:44:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 3 2024-01-13T18:44:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 3 2024-01-13T18:44:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:child: image97 2024-01-13T18:44:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:child: image96 2024-01-13T18:44:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:child: image98 2024-01-13T18:44:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96/b186f807aa9c 2024-01-13T18:44:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97/b1862ba93284 2024-01-13T18:44:34.955 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image98/b1866cbfdfdf 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.956 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 3 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 3 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout:child: image97 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout:child: image96 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout:child: image98 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96/b186f807aa9c 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97/b1862ba93284 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image98/b1866cbfdfdf 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.957 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.958 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 4 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 4 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout:child: image97 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout:child: image96 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout:child: image98 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout:child: image99 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96/b186f807aa9c 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97/b1862ba93284 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image98/b1866cbfdfdf 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image99/b186270482c 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.959 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image98 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:34.960 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image98 2024-01-13T18:44:34.961 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image98 2024-01-13T18:44:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.961 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:34.961 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:34.961 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.563 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image96 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image98 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 4 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 4 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout:child: image97 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout:child: image96 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout:child: image98 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout:child: image99 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image96/b186f807aa9c 2024-01-13T18:44:35.564 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97/b1862ba93284 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image98/b1866cbfdfdf 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image99/b186270482c 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image98 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.565 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image98 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image98 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image98 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 3 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 3 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout:child: image97 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout:child: image98 2024-01-13T18:44:35.566 INFO:tasks.workunit.client.0.smithi084.stdout:child: image99 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97/b1862ba93284 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image98/b1866cbfdfdf 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image99/b186270482c 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.567 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image99 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 2 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout:child: image97 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout:child: image99 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97/b1862ba93284 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-14/image99/b186270482c 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.568 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 1 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout:child: image97 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-13/image97/b1862ba93284 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 0 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 0 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ListChildren (9950 ms) 2024-01-13T18:44:35.569 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ListChildrenTiered 2024-01-13T18:44:35.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:36.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:36 smithi099 ceph-mon[138788]: pgmap v2297: 553 pgs: 553 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T18:44:36.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:36 smithi099 ceph-mon[138788]: osdmap e1240: 8 total, 8 up, 8 in 2024-01-13T18:44:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:36 smithi084 ceph-mon[116404]: pgmap v2297: 553 pgs: 553 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T18:44:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:36 smithi084 ceph-mon[116404]: osdmap e1240: 8 total, 8 up, 8 in 2024-01-13T18:44:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:36 smithi084 ceph-mon[119097]: pgmap v2297: 553 pgs: 553 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T18:44:36.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:36 smithi084 ceph-mon[119097]: osdmap e1240: 8 total, 8 up, 8 in 2024-01-13T18:44:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:37 smithi099 ceph-mon[138788]: osdmap e1241: 8 total, 8 up, 8 in 2024-01-13T18:44:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:37 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/824531001' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:37 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:37 smithi084 ceph-mon[116404]: osdmap e1241: 8 total, 8 up, 8 in 2024-01-13T18:44:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:37 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/824531001' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:37 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:37 smithi084 ceph-mon[119097]: osdmap e1241: 8 total, 8 up, 8 in 2024-01-13T18:44:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:37 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/824531001' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:37 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:38 smithi099 ceph-mon[138788]: pgmap v2300: 585 pgs: 32 unknown, 553 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 87 KiB/s rd, 2.7 KiB/s wr, 105 op/s 2024-01-13T18:44:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:38 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:44:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:38 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:38 smithi099 ceph-mon[138788]: osdmap e1242: 8 total, 8 up, 8 in 2024-01-13T18:44:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:38 smithi099 ceph-mon[138788]: osdmap e1243: 8 total, 8 up, 8 in 2024-01-13T18:44:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:38 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2545384843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:38 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[116404]: pgmap v2300: 585 pgs: 32 unknown, 553 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 87 KiB/s rd, 2.7 KiB/s wr, 105 op/s 2024-01-13T18:44:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:44:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:38.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[116404]: osdmap e1242: 8 total, 8 up, 8 in 2024-01-13T18:44:38.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[116404]: osdmap e1243: 8 total, 8 up, 8 in 2024-01-13T18:44:38.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2545384843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:38.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[119097]: pgmap v2300: 585 pgs: 32 unknown, 553 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 87 KiB/s rd, 2.7 KiB/s wr, 105 op/s 2024-01-13T18:44:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:44:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[119097]: osdmap e1242: 8 total, 8 up, 8 in 2024-01-13T18:44:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[119097]: osdmap e1243: 8 total, 8 up, 8 in 2024-01-13T18:44:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2545384843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:38 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:44:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:44:40] "GET /metrics HTTP/1.1" 200 67615 "" "Prometheus/2.43.0" 2024-01-13T18:44:40.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:40 smithi084 ceph-mon[116404]: pgmap v2303: 617 pgs: 11 creating+peering, 46 unknown, 560 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 429 KiB/s rd, 12 KiB/s wr, 525 op/s 2024-01-13T18:44:40.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:40 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:40.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:40 smithi084 ceph-mon[116404]: osdmap e1244: 8 total, 8 up, 8 in 2024-01-13T18:44:40.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:40 smithi084 ceph-mon[119097]: pgmap v2303: 617 pgs: 11 creating+peering, 46 unknown, 560 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 429 KiB/s rd, 12 KiB/s wr, 525 op/s 2024-01-13T18:44:40.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:40 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:40.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:40 smithi084 ceph-mon[119097]: osdmap e1244: 8 total, 8 up, 8 in 2024-01-13T18:44:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:40 smithi099 ceph-mon[138788]: pgmap v2303: 617 pgs: 11 creating+peering, 46 unknown, 560 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 429 KiB/s rd, 12 KiB/s wr, 525 op/s 2024-01-13T18:44:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:40 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:40 smithi099 ceph-mon[138788]: osdmap e1244: 8 total, 8 up, 8 in 2024-01-13T18:44:41.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:41 smithi099 ceph-mon[138788]: osdmap e1245: 8 total, 8 up, 8 in 2024-01-13T18:44:41.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:41 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3395460996' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:41.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:41 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:41 smithi084 ceph-mon[116404]: osdmap e1245: 8 total, 8 up, 8 in 2024-01-13T18:44:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:41 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3395460996' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:41 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:41.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:41 smithi084 ceph-mon[119097]: osdmap e1245: 8 total, 8 up, 8 in 2024-01-13T18:44:41.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:41 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3395460996' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:41.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:41 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:44:42.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:42 smithi099 ceph-mon[138788]: pgmap v2306: 649 pgs: 12 creating+peering, 50 unknown, 587 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 509 KiB/s rd, 13 KiB/s wr, 624 op/s 2024-01-13T18:44:42.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:42 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:42.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:42 smithi099 ceph-mon[138788]: osdmap e1246: 8 total, 8 up, 8 in 2024-01-13T18:44:42.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:42 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17", "force_nonempty":""}]: dispatch 2024-01-13T18:44:42.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:42 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17", "force_nonempty":""}]: dispatch 2024-01-13T18:44:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:42 smithi084 ceph-mon[116404]: pgmap v2306: 649 pgs: 12 creating+peering, 50 unknown, 587 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 509 KiB/s rd, 13 KiB/s wr, 624 op/s 2024-01-13T18:44:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:42 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:42 smithi084 ceph-mon[116404]: osdmap e1246: 8 total, 8 up, 8 in 2024-01-13T18:44:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:42 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17", "force_nonempty":""}]: dispatch 2024-01-13T18:44:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:42 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17", "force_nonempty":""}]: dispatch 2024-01-13T18:44:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:42 smithi084 ceph-mon[119097]: pgmap v2306: 649 pgs: 12 creating+peering, 50 unknown, 587 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 509 KiB/s rd, 13 KiB/s wr, 624 op/s 2024-01-13T18:44:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:42 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:44:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:42 smithi084 ceph-mon[119097]: osdmap e1246: 8 total, 8 up, 8 in 2024-01-13T18:44:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:42 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17", "force_nonempty":""}]: dispatch 2024-01-13T18:44:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:42 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17", "force_nonempty":""}]: dispatch 2024-01-13T18:44:43.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17", "force_nonempty":""}]': finished 2024-01-13T18:44:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:43 smithi099 ceph-mon[138788]: osdmap e1247: 8 total, 8 up, 8 in 2024-01-13T18:44:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-librbd-smithi084-180317-17", "mode":"writeback"}]: dispatch 2024-01-13T18:44:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-librbd-smithi084-180317-17", "mode":"writeback"}]: dispatch 2024-01-13T18:44:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:43 smithi099 ceph-mon[138788]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-01-13T18:44:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-librbd-smithi084-180317-17", "mode":"writeback"}]': finished 2024-01-13T18:44:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:43 smithi099 ceph-mon[138788]: osdmap e1248: 8 total, 8 up, 8 in 2024-01-13T18:44:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-librbd-smithi084-180317-15", "overlaypool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-librbd-smithi084-180317-15", "overlaypool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17", "force_nonempty":""}]': finished 2024-01-13T18:44:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[116404]: osdmap e1247: 8 total, 8 up, 8 in 2024-01-13T18:44:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-librbd-smithi084-180317-17", "mode":"writeback"}]: dispatch 2024-01-13T18:44:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-librbd-smithi084-180317-17", "mode":"writeback"}]: dispatch 2024-01-13T18:44:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[116404]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-01-13T18:44:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-librbd-smithi084-180317-17", "mode":"writeback"}]': finished 2024-01-13T18:44:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[116404]: osdmap e1248: 8 total, 8 up, 8 in 2024-01-13T18:44:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-librbd-smithi084-180317-15", "overlaypool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-librbd-smithi084-180317-15", "overlaypool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17", "force_nonempty":""}]': finished 2024-01-13T18:44:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[119097]: osdmap e1247: 8 total, 8 up, 8 in 2024-01-13T18:44:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-librbd-smithi084-180317-17", "mode":"writeback"}]: dispatch 2024-01-13T18:44:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-librbd-smithi084-180317-17", "mode":"writeback"}]: dispatch 2024-01-13T18:44:43.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[119097]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-01-13T18:44:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-librbd-smithi084-180317-17", "mode":"writeback"}]': finished 2024-01-13T18:44:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[119097]: osdmap e1248: 8 total, 8 up, 8 in 2024-01-13T18:44:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-librbd-smithi084-180317-15", "overlaypool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-librbd-smithi084-180317-15", "overlaypool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:44.474 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:44.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:44 smithi099 ceph-mon[138788]: pgmap v2309: 649 pgs: 1 creating+peering, 29 unknown, 619 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 165 KiB/s rd, 3.7 KiB/s wr, 198 op/s 2024-01-13T18:44:44.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:44 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:44:44.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:44 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-librbd-smithi084-180317-15", "overlaypool":"test-librbd-smithi084-180317-17"}]': finished 2024-01-13T18:44:44.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:44 smithi099 ceph-mon[138788]: osdmap e1249: 8 total, 8 up, 8 in 2024-01-13T18:44:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:44 smithi084 ceph-mon[116404]: pgmap v2309: 649 pgs: 1 creating+peering, 29 unknown, 619 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 165 KiB/s rd, 3.7 KiB/s wr, 198 op/s 2024-01-13T18:44:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:44 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:44:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:44 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-librbd-smithi084-180317-15", "overlaypool":"test-librbd-smithi084-180317-17"}]': finished 2024-01-13T18:44:44.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:44 smithi084 ceph-mon[116404]: osdmap e1249: 8 total, 8 up, 8 in 2024-01-13T18:44:44.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:44 smithi084 ceph-mon[119097]: pgmap v2309: 649 pgs: 1 creating+peering, 29 unknown, 619 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 165 KiB/s rd, 3.7 KiB/s wr, 198 op/s 2024-01-13T18:44:44.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:44 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:44:44.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:44 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-librbd-smithi084-180317-15", "overlaypool":"test-librbd-smithi084-180317-17"}]': finished 2024-01-13T18:44:44.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:44 smithi084 ceph-mon[119097]: osdmap e1249: 8 total, 8 up, 8 in 2024-01-13T18:44:46.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:46 smithi099 ceph-mon[138788]: pgmap v2312: 649 pgs: 4 unknown, 645 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:44:46.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:46 smithi099 ceph-mon[138788]: osdmap e1250: 8 total, 8 up, 8 in 2024-01-13T18:44:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:46 smithi084 ceph-mon[116404]: pgmap v2312: 649 pgs: 4 unknown, 645 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:44:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:46 smithi084 ceph-mon[116404]: osdmap e1250: 8 total, 8 up, 8 in 2024-01-13T18:44:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:46 smithi084 ceph-mon[119097]: pgmap v2312: 649 pgs: 4 unknown, 645 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:44:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:46 smithi084 ceph-mon[119097]: osdmap e1250: 8 total, 8 up, 8 in 2024-01-13T18:44:47.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:47 smithi099 ceph-mon[138788]: osdmap e1251: 8 total, 8 up, 8 in 2024-01-13T18:44:47.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:47 smithi084 ceph-mon[116404]: osdmap e1251: 8 total, 8 up, 8 in 2024-01-13T18:44:47.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:47 smithi084 ceph-mon[119097]: osdmap e1251: 8 total, 8 up, 8 in 2024-01-13T18:44:48.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:48 smithi099 ceph-mon[138788]: pgmap v2315: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:44:48.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:48 smithi099 ceph-mon[138788]: osdmap e1252: 8 total, 8 up, 8 in 2024-01-13T18:44:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:48 smithi084 ceph-mon[116404]: pgmap v2315: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:44:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:48 smithi084 ceph-mon[116404]: osdmap e1252: 8 total, 8 up, 8 in 2024-01-13T18:44:48.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:48 smithi084 ceph-mon[119097]: pgmap v2315: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:44:48.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:48 smithi084 ceph-mon[119097]: osdmap e1252: 8 total, 8 up, 8 in 2024-01-13T18:44:49.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:49 smithi099 ceph-mon[138788]: osdmap e1253: 8 total, 8 up, 8 in 2024-01-13T18:44:49.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:49 smithi084 ceph-mon[116404]: osdmap e1253: 8 total, 8 up, 8 in 2024-01-13T18:44:49.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:49 smithi084 ceph-mon[119097]: osdmap e1253: 8 total, 8 up, 8 in 2024-01-13T18:44:50.085 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.085 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.085 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.085 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.085 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.085 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 1 2024-01-13T18:44:50.085 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:44:50.085 INFO:tasks.workunit.client.0.smithi084.stdout:child: image101 2024-01-13T18:44:50.085 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101/b18643f95fec 2024-01-13T18:44:50.085 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 2 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:44:50.086 INFO:tasks.workunit.client.0.smithi084.stdout:child: image102 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout:child: image101 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101/b18643f95fec 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102/b186351df114 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.087 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image103 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image103 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image103 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 3 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 3 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout:child: image102 2024-01-13T18:44:50.088 INFO:tasks.workunit.client.0.smithi084.stdout:child: image101 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout:child: image103 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101/b18643f95fec 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102/b186351df114 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image103/b18691cf1f95 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.089 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 3 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 3 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout:child: image102 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout:child: image101 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout:child: image103 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101/b18643f95fec 2024-01-13T18:44:50.090 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102/b186351df114 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image103/b18691cf1f95 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.091 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 4 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 4 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:child: image102 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:child: image101 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:child: image103 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:child: image104 2024-01-13T18:44:50.092 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101/b18643f95fec 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102/b186351df114 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image103/b18691cf1f95 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image104/b1863e20a971 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.093 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image103 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image103 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image103 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:50.094 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:44:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:44:50] "GET /metrics HTTP/1.1" 200 74875 "" "Prometheus/2.43.0" 2024-01-13T18:44:50.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:50 smithi084 ceph-mon[116404]: pgmap v2318: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-01-13T18:44:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:50 smithi084 ceph-mon[116404]: osdmap e1254: 8 total, 8 up, 8 in 2024-01-13T18:44:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:44:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:50 smithi084 ceph-mon[119097]: pgmap v2318: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-01-13T18:44:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:50 smithi084 ceph-mon[119097]: osdmap e1254: 8 total, 8 up, 8 in 2024-01-13T18:44:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:44:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:50 smithi099 ceph-mon[138788]: pgmap v2318: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-01-13T18:44:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:50 smithi099 ceph-mon[138788]: osdmap e1254: 8 total, 8 up, 8 in 2024-01-13T18:44:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:44:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:44:52.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: pgmap v2320: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 2.4 KiB/s wr, 19 op/s 2024-01-13T18:44:52.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: osdmap e1255: 8 total, 8 up, 8 in 2024-01-13T18:44:52.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-librbd-smithi084-180317-15"}]: dispatch 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-librbd-smithi084-180317-15"}]: dispatch 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.14", "id": [7, 1]}]: dispatch 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.19", "id": [7, 4]}]: dispatch 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.4", "id": [3, 5]}]: dispatch 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.7", "id": [4, 5]}]: dispatch 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.5", "id": [1, 3]}]: dispatch 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.a", "id": [2, 4]}]: dispatch 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.10", "id": [2, 4]}]: dispatch 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1a", "id": [2, 4]}]: dispatch 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1b", "id": [2, 4]}]: dispatch 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: pgmap v2320: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 2.4 KiB/s wr, 19 op/s 2024-01-13T18:44:52.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: osdmap e1255: 8 total, 8 up, 8 in 2024-01-13T18:44:52.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-librbd-smithi084-180317-15"}]: dispatch 2024-01-13T18:44:52.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-librbd-smithi084-180317-15"}]: dispatch 2024-01-13T18:44:52.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.14", "id": [7, 1]}]: dispatch 2024-01-13T18:44:52.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.19", "id": [7, 4]}]: dispatch 2024-01-13T18:44:52.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.4", "id": [3, 5]}]: dispatch 2024-01-13T18:44:52.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.7", "id": [4, 5]}]: dispatch 2024-01-13T18:44:52.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.5", "id": [1, 3]}]: dispatch 2024-01-13T18:44:52.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.a", "id": [2, 4]}]: dispatch 2024-01-13T18:44:52.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.10", "id": [2, 4]}]: dispatch 2024-01-13T18:44:52.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1a", "id": [2, 4]}]: dispatch 2024-01-13T18:44:52.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1b", "id": [2, 4]}]: dispatch 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: pgmap v2320: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 2.4 KiB/s wr, 19 op/s 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: osdmap e1255: 8 total, 8 up, 8 in 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-librbd-smithi084-180317-15"}]: dispatch 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-librbd-smithi084-180317-15"}]: dispatch 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.14", "id": [7, 1]}]: dispatch 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.19", "id": [7, 4]}]: dispatch 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.4", "id": [3, 5]}]: dispatch 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.7", "id": [4, 5]}]: dispatch 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.5", "id": [1, 3]}]: dispatch 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.a", "id": [2, 4]}]: dispatch 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.10", "id": [2, 4]}]: dispatch 2024-01-13T18:44:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1a", "id": [2, 4]}]: dispatch 2024-01-13T18:44:52.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1b", "id": [2, 4]}]: dispatch 2024-01-13T18:44:53.119 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image101 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image103 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 4 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 4 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:child: image102 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:child: image101 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:child: image103 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:child: image104 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image101/b18643f95fec 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102/b186351df114 2024-01-13T18:44:53.121 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.121 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image103/b18691cf1f95 2024-01-13T18:44:53.121 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.121 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image104/b1863e20a971 2024-01-13T18:44:53.121 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.121 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.121 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.121 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.121 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.121 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.121 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image103 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image103 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image103 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image103 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 3 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 3 2024-01-13T18:44:53.122 INFO:tasks.workunit.client.0.smithi084.stdout:child: image102 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout:child: image103 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout:child: image104 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102/b186351df114 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image103/b18691cf1f95 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image104/b1863e20a971 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.123 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image104 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 2 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 2 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout:child: image102 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout:child: image104 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102/b186351df114 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-16/image104/b1863e20a971 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.124 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:trying to find test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:checking test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 1 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 1 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:child: image102 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-15/image102/b186351df114 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 0 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 0 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ListChildrenTiered (17553 ms) 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.LockingPP 2024-01-13T18:44:53.125 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:53.175 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.LockingPP (58 ms) 2024-01-13T18:44:53.175 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.FlushAio 2024-01-13T18:44:53.175 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:53.421 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.FlushAio (246 ms) 2024-01-13T18:44:53.421 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.FlushAioPP 2024-01-13T18:44:53.421 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:53.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-librbd-smithi084-180317-15"}]': finished 2024-01-13T18:44:53.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.14", "id": [7, 1]}]': finished 2024-01-13T18:44:53.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.19", "id": [7, 4]}]': finished 2024-01-13T18:44:53.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.4", "id": [3, 5]}]': finished 2024-01-13T18:44:53.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.7", "id": [4, 5]}]': finished 2024-01-13T18:44:53.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.5", "id": [1, 3]}]': finished 2024-01-13T18:44:53.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.a", "id": [2, 4]}]': finished 2024-01-13T18:44:53.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.10", "id": [2, 4]}]': finished 2024-01-13T18:44:53.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1a", "id": [2, 4]}]': finished 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1b", "id": [2, 4]}]': finished 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: osdmap e1256: 8 total, 8 up, 8 in 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17"}]': finished 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[119097]: osdmap e1257: 8 total, 8 up, 8 in 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-librbd-smithi084-180317-15"}]': finished 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.14", "id": [7, 1]}]': finished 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.19", "id": [7, 4]}]': finished 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.4", "id": [3, 5]}]': finished 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.7", "id": [4, 5]}]': finished 2024-01-13T18:44:53.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.5", "id": [1, 3]}]': finished 2024-01-13T18:44:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.a", "id": [2, 4]}]': finished 2024-01-13T18:44:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.10", "id": [2, 4]}]': finished 2024-01-13T18:44:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1a", "id": [2, 4]}]': finished 2024-01-13T18:44:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1b", "id": [2, 4]}]': finished 2024-01-13T18:44:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: osdmap e1256: 8 total, 8 up, 8 in 2024-01-13T18:44:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-01-13T18:44:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:44:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17"}]': finished 2024-01-13T18:44:53.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:53 smithi084 ceph-mon[116404]: osdmap e1257: 8 total, 8 up, 8 in 2024-01-13T18:44:53.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-librbd-smithi084-180317-15"}]': finished 2024-01-13T18:44:53.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.14", "id": [7, 1]}]': finished 2024-01-13T18:44:53.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "89.19", "id": [7, 4]}]': finished 2024-01-13T18:44:53.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.4", "id": [3, 5]}]': finished 2024-01-13T18:44:53.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "90.7", "id": [4, 5]}]': finished 2024-01-13T18:44:53.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.5", "id": [1, 3]}]': finished 2024-01-13T18:44:53.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.a", "id": [2, 4]}]': finished 2024-01-13T18:44:53.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.10", "id": [2, 4]}]': finished 2024-01-13T18:44:53.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1a", "id": [2, 4]}]': finished 2024-01-13T18:44:53.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "93.1b", "id": [2, 4]}]': finished 2024-01-13T18:44:53.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: osdmap e1256: 8 total, 8 up, 8 in 2024-01-13T18:44:53.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:53.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17"}]: dispatch 2024-01-13T18:44:53.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-01-13T18:44:53.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:44:53.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-librbd-smithi084-180317-15", "tierpool":"test-librbd-smithi084-180317-17"}]': finished 2024-01-13T18:44:53.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:53 smithi099 ceph-mon[138788]: osdmap e1257: 8 total, 8 up, 8 in 2024-01-13T18:44:53.621 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.FlushAioPP (201 ms) 2024-01-13T18:44:53.621 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ZeroLengthWrite 2024-01-13T18:44:53.621 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:53.650 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ZeroLengthWrite (28 ms) 2024-01-13T18:44:53.650 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ZeroLengthDiscard 2024-01-13T18:44:53.650 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:53.674 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ZeroLengthDiscard (25 ms) 2024-01-13T18:44:53.674 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ZeroLengthRead 2024-01-13T18:44:53.674 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:53.692 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ZeroLengthRead (18 ms) 2024-01-13T18:44:53.692 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.LargeCacheRead 2024-01-13T18:44:53.692 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:53.727 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.LargeCacheRead (34 ms) 2024-01-13T18:44:53.727 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestPendingAio 2024-01-13T18:44:53.727 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:53.933 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestPendingAio (207 ms) 2024-01-13T18:44:53.933 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyup 2024-01-13T18:44:53.933 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:54.561 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:54.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:54 smithi099 ceph-mon[138788]: pgmap v2323: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 360 KiB/s rd, 7.9 KiB/s wr, 432 op/s 2024-01-13T18:44:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:54 smithi099 ceph-mon[138788]: osdmap e1258: 8 total, 8 up, 8 in 2024-01-13T18:44:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:54 smithi084 ceph-mon[116404]: pgmap v2323: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 360 KiB/s rd, 7.9 KiB/s wr, 432 op/s 2024-01-13T18:44:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:54 smithi084 ceph-mon[116404]: osdmap e1258: 8 total, 8 up, 8 in 2024-01-13T18:44:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:54 smithi084 ceph-mon[119097]: pgmap v2323: 649 pgs: 649 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 360 KiB/s rd, 7.9 KiB/s wr, 432 op/s 2024-01-13T18:44:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:54 smithi084 ceph-mon[119097]: osdmap e1258: 8 total, 8 up, 8 in 2024-01-13T18:44:55.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:55 smithi099 ceph-mon[138788]: osdmap e1259: 8 total, 8 up, 8 in 2024-01-13T18:44:55.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:55 smithi084 ceph-mon[116404]: osdmap e1259: 8 total, 8 up, 8 in 2024-01-13T18:44:55.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:55 smithi084 ceph-mon[119097]: osdmap e1259: 8 total, 8 up, 8 in 2024-01-13T18:44:56.515 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.CompareAndWriteCopyup (2582 ms) 2024-01-13T18:44:56.515 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.CompareAndWriteCopyupMismatch 2024-01-13T18:44:56.515 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:56.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:56 smithi099 ceph-mon[138788]: pgmap v2327: 649 pgs: 2 peering, 647 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 546 KiB/s rd, 13 KiB/s wr, 659 op/s 2024-01-13T18:44:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:56 smithi099 ceph-mon[138788]: osdmap e1260: 8 total, 8 up, 8 in 2024-01-13T18:44:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:56 smithi084 ceph-mon[116404]: pgmap v2327: 649 pgs: 2 peering, 647 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 546 KiB/s rd, 13 KiB/s wr, 659 op/s 2024-01-13T18:44:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:56 smithi084 ceph-mon[116404]: osdmap e1260: 8 total, 8 up, 8 in 2024-01-13T18:44:56.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:56 smithi084 ceph-mon[119097]: pgmap v2327: 649 pgs: 2 peering, 647 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 546 KiB/s rd, 13 KiB/s wr, 659 op/s 2024-01-13T18:44:56.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:56 smithi084 ceph-mon[119097]: osdmap e1260: 8 total, 8 up, 8 in 2024-01-13T18:44:57.582 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:44:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:57 smithi099 ceph-mon[138788]: osdmap e1261: 8 total, 8 up, 8 in 2024-01-13T18:44:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:57 smithi084 ceph-mon[116404]: osdmap e1261: 8 total, 8 up, 8 in 2024-01-13T18:44:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:57 smithi084 ceph-mon[119097]: osdmap e1261: 8 total, 8 up, 8 in 2024-01-13T18:44:58.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:58 smithi099 ceph-mon[138788]: pgmap v2330: 649 pgs: 2 peering, 647 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 147 KiB/s rd, 7.5 KiB/s wr, 200 op/s 2024-01-13T18:44:58.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:58 smithi099 ceph-mon[138788]: osdmap e1262: 8 total, 8 up, 8 in 2024-01-13T18:44:58.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:44:58 smithi099 ceph-mon[138788]: osdmap e1263: 8 total, 8 up, 8 in 2024-01-13T18:44:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:58 smithi084 ceph-mon[116404]: pgmap v2330: 649 pgs: 2 peering, 647 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 147 KiB/s rd, 7.5 KiB/s wr, 200 op/s 2024-01-13T18:44:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:58 smithi084 ceph-mon[116404]: osdmap e1262: 8 total, 8 up, 8 in 2024-01-13T18:44:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:44:58 smithi084 ceph-mon[116404]: osdmap e1263: 8 total, 8 up, 8 in 2024-01-13T18:44:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:58 smithi084 ceph-mon[119097]: pgmap v2330: 649 pgs: 2 peering, 647 active+clean; 135 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 147 KiB/s rd, 7.5 KiB/s wr, 200 op/s 2024-01-13T18:44:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:58 smithi084 ceph-mon[119097]: osdmap e1262: 8 total, 8 up, 8 in 2024-01-13T18:44:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:44:58 smithi084 ceph-mon[119097]: osdmap e1263: 8 total, 8 up, 8 in 2024-01-13T18:44:59.536 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.CompareAndWriteCopyupMismatch (3021 ms) 2024-01-13T18:44:59.536 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.Flatten 2024-01-13T18:44:59.537 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:00.603 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.Flatten (1066 ms) 2024-01-13T18:45:00.603 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.Sparsify 2024-01-13T18:45:00.603 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:00.639 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 32768 2024-01-13T18:45:00.639 INFO:tasks.workunit.client.0.smithi084.stdout:read: 32768 2024-01-13T18:45:00.639 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.Sparsify (36 ms) 2024-01-13T18:45:00.639 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.SparsifyPP 2024-01-13T18:45:00.639 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:00.670 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.SparsifyPP (31 ms) 2024-01-13T18:45:00.670 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.SnapshotLimit 2024-01-13T18:45:00.670 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:45:00] "GET /metrics HTTP/1.1" 200 74875 "" "Prometheus/2.43.0" 2024-01-13T18:45:00.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:00 smithi084 ceph-mon[116404]: pgmap v2333: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 874 KiB/s rd, 732 KiB/s wr, 664 op/s; 4 B/s, 0 objects/s recovering 2024-01-13T18:45:00.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:00 smithi084 ceph-mon[116404]: osdmap e1264: 8 total, 8 up, 8 in 2024-01-13T18:45:00.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:00 smithi084 ceph-mon[119097]: pgmap v2333: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 874 KiB/s rd, 732 KiB/s wr, 664 op/s; 4 B/s, 0 objects/s recovering 2024-01-13T18:45:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:00 smithi084 ceph-mon[119097]: osdmap e1264: 8 total, 8 up, 8 in 2024-01-13T18:45:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:00 smithi099 ceph-mon[138788]: pgmap v2333: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 874 KiB/s rd, 732 KiB/s wr, 664 op/s; 4 B/s, 0 objects/s recovering 2024-01-13T18:45:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:00 smithi099 ceph-mon[138788]: osdmap e1264: 8 total, 8 up, 8 in 2024-01-13T18:45:01.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:01 smithi099 ceph-mon[138788]: osdmap e1265: 8 total, 8 up, 8 in 2024-01-13T18:45:01.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:01 smithi084 ceph-mon[116404]: osdmap e1265: 8 total, 8 up, 8 in 2024-01-13T18:45:01.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:01 smithi084 ceph-mon[119097]: osdmap e1265: 8 total, 8 up, 8 in 2024-01-13T18:45:02.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:02 smithi099 ceph-mon[138788]: pgmap v2336: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 834 KiB/s rd, 733 KiB/s wr, 611 op/s; 4 B/s, 0 objects/s recovering 2024-01-13T18:45:02.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:02 smithi099 ceph-mon[138788]: osdmap e1266: 8 total, 8 up, 8 in 2024-01-13T18:45:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:02 smithi084 ceph-mon[116404]: pgmap v2336: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 834 KiB/s rd, 733 KiB/s wr, 611 op/s; 4 B/s, 0 objects/s recovering 2024-01-13T18:45:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:02 smithi084 ceph-mon[116404]: osdmap e1266: 8 total, 8 up, 8 in 2024-01-13T18:45:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:02 smithi084 ceph-mon[119097]: pgmap v2336: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 834 KiB/s rd, 733 KiB/s wr, 611 op/s; 4 B/s, 0 objects/s recovering 2024-01-13T18:45:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:02 smithi084 ceph-mon[119097]: osdmap e1266: 8 total, 8 up, 8 in 2024-01-13T18:45:03.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:03 smithi099 ceph-mon[138788]: osdmap e1267: 8 total, 8 up, 8 in 2024-01-13T18:45:03.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:03 smithi084 ceph-mon[116404]: osdmap e1267: 8 total, 8 up, 8 in 2024-01-13T18:45:03.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:03 smithi084 ceph-mon[119097]: osdmap e1267: 8 total, 8 up, 8 in 2024-01-13T18:45:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:04 smithi099 ceph-mon[138788]: pgmap v2339: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 268 KiB/s rd, 37 KiB/s wr, 330 op/s 2024-01-13T18:45:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:04 smithi099 ceph-mon[138788]: osdmap e1268: 8 total, 8 up, 8 in 2024-01-13T18:45:04.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:04 smithi084 ceph-mon[119097]: pgmap v2339: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 268 KiB/s rd, 37 KiB/s wr, 330 op/s 2024-01-13T18:45:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:04 smithi084 ceph-mon[119097]: osdmap e1268: 8 total, 8 up, 8 in 2024-01-13T18:45:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:04 smithi084 ceph-mon[116404]: pgmap v2339: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 268 KiB/s rd, 37 KiB/s wr, 330 op/s 2024-01-13T18:45:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:04 smithi084 ceph-mon[116404]: osdmap e1268: 8 total, 8 up, 8 in 2024-01-13T18:45:05.558 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.SnapshotLimit (4888 ms) 2024-01-13T18:45:05.558 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.SnapshotLimitPP 2024-01-13T18:45:05.558 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:05.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:05 smithi099 ceph-mon[138788]: osdmap e1269: 8 total, 8 up, 8 in 2024-01-13T18:45:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:45:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:05 smithi084 ceph-mon[119097]: osdmap e1269: 8 total, 8 up, 8 in 2024-01-13T18:45:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:45:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:05 smithi084 ceph-mon[116404]: osdmap e1269: 8 total, 8 up, 8 in 2024-01-13T18:45:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:45:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:06.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:06 smithi099 ceph-mon[138788]: pgmap v2342: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 201 KiB/s rd, 34 KiB/s wr, 243 op/s 2024-01-13T18:45:06.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:06 smithi099 ceph-mon[138788]: osdmap e1270: 8 total, 8 up, 8 in 2024-01-13T18:45:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:06 smithi084 ceph-mon[116404]: pgmap v2342: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 201 KiB/s rd, 34 KiB/s wr, 243 op/s 2024-01-13T18:45:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:06 smithi084 ceph-mon[116404]: osdmap e1270: 8 total, 8 up, 8 in 2024-01-13T18:45:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:06 smithi084 ceph-mon[119097]: pgmap v2342: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 201 KiB/s rd, 34 KiB/s wr, 243 op/s 2024-01-13T18:45:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:06 smithi084 ceph-mon[119097]: osdmap e1270: 8 total, 8 up, 8 in 2024-01-13T18:45:07.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:07 smithi099 ceph-mon[138788]: osdmap e1271: 8 total, 8 up, 8 in 2024-01-13T18:45:07.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:07 smithi084 ceph-mon[116404]: osdmap e1271: 8 total, 8 up, 8 in 2024-01-13T18:45:07.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:07 smithi084 ceph-mon[119097]: osdmap e1271: 8 total, 8 up, 8 in 2024-01-13T18:45:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:08 smithi099 ceph-mon[138788]: pgmap v2345: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 8.5 KiB/s wr, 62 op/s 2024-01-13T18:45:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:08 smithi099 ceph-mon[138788]: osdmap e1272: 8 total, 8 up, 8 in 2024-01-13T18:45:08.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:08 smithi084 ceph-mon[119097]: pgmap v2345: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 8.5 KiB/s wr, 62 op/s 2024-01-13T18:45:08.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:08 smithi084 ceph-mon[119097]: osdmap e1272: 8 total, 8 up, 8 in 2024-01-13T18:45:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:08 smithi084 ceph-mon[116404]: pgmap v2345: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 8.5 KiB/s wr, 62 op/s 2024-01-13T18:45:08.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:08 smithi084 ceph-mon[116404]: osdmap e1272: 8 total, 8 up, 8 in 2024-01-13T18:45:09.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:09 smithi099 ceph-mon[138788]: osdmap e1273: 8 total, 8 up, 8 in 2024-01-13T18:45:09.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:09 smithi084 ceph-mon[119097]: osdmap e1273: 8 total, 8 up, 8 in 2024-01-13T18:45:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:09 smithi084 ceph-mon[116404]: osdmap e1273: 8 total, 8 up, 8 in 2024-01-13T18:45:10.558 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:45:10] "GET /metrics HTTP/1.1" 200 74918 "" "Prometheus/2.43.0" 2024-01-13T18:45:10.598 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.SnapshotLimitPP (5041 ms) 2024-01-13T18:45:10.598 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.RebuildObjectMapViaLockOwner 2024-01-13T18:45:10.598 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:10.660 INFO:tasks.workunit.client.0.smithi084.stdout:0.00% done 2024-01-13T18:45:10.660 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.RebuildObjectMapViaLockOwner (62 ms) 2024-01-13T18:45:10.660 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.RenameViaLockOwner 2024-01-13T18:45:10.660 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:10.733 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.RenameViaLockOwner (73 ms) 2024-01-13T18:45:10.734 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.SnapCreateViaLockOwner 2024-01-13T18:45:10.734 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:10.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:10 smithi099 ceph-mon[138788]: pgmap v2348: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 42 KiB/s rd, 6.5 KiB/s wr, 60 op/s 2024-01-13T18:45:10.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:10 smithi099 ceph-mon[138788]: osdmap e1274: 8 total, 8 up, 8 in 2024-01-13T18:45:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:10 smithi084 ceph-mon[119097]: pgmap v2348: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 42 KiB/s rd, 6.5 KiB/s wr, 60 op/s 2024-01-13T18:45:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:10 smithi084 ceph-mon[119097]: osdmap e1274: 8 total, 8 up, 8 in 2024-01-13T18:45:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:10 smithi084 ceph-mon[116404]: pgmap v2348: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 42 KiB/s rd, 6.5 KiB/s wr, 60 op/s 2024-01-13T18:45:10.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:10 smithi084 ceph-mon[116404]: osdmap e1274: 8 total, 8 up, 8 in 2024-01-13T18:45:11.609 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.SnapCreateViaLockOwner (876 ms) 2024-01-13T18:45:11.609 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.SnapRemoveViaLockOwner 2024-01-13T18:45:11.609 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:11.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:11 smithi099 ceph-mon[138788]: osdmap e1275: 8 total, 8 up, 8 in 2024-01-13T18:45:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:11 smithi084 ceph-mon[116404]: osdmap e1275: 8 total, 8 up, 8 in 2024-01-13T18:45:11.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:11 smithi084 ceph-mon[119097]: osdmap e1275: 8 total, 8 up, 8 in 2024-01-13T18:45:12.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:12 smithi099 ceph-mon[138788]: pgmap v2351: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 26 KiB/s rd, 3.7 KiB/s wr, 37 op/s 2024-01-13T18:45:12.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:12 smithi099 ceph-mon[138788]: osdmap e1276: 8 total, 8 up, 8 in 2024-01-13T18:45:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:12 smithi084 ceph-mon[116404]: pgmap v2351: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 26 KiB/s rd, 3.7 KiB/s wr, 37 op/s 2024-01-13T18:45:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:12 smithi084 ceph-mon[116404]: osdmap e1276: 8 total, 8 up, 8 in 2024-01-13T18:45:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:12 smithi084 ceph-mon[119097]: pgmap v2351: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 26 KiB/s rd, 3.7 KiB/s wr, 37 op/s 2024-01-13T18:45:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:12 smithi084 ceph-mon[119097]: osdmap e1276: 8 total, 8 up, 8 in 2024-01-13T18:45:13.490 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.SnapRemoveViaLockOwner (1881 ms) 2024-01-13T18:45:13.490 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.UpdateFeaturesViaLockOwner 2024-01-13T18:45:13.490 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:13.546 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.UpdateFeaturesViaLockOwner (56 ms) 2024-01-13T18:45:13.547 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.EnableJournalingViaLockOwner 2024-01-13T18:45:13.547 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:45:13.547 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.EnableJournalingViaLockOwner (0 ms) 2024-01-13T18:45:13.547 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.SnapRemove2 2024-01-13T18:45:13.547 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:13.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:13 smithi099 ceph-mon[138788]: osdmap e1277: 8 total, 8 up, 8 in 2024-01-13T18:45:13.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:13 smithi099 ceph-mon[138788]: osdmap e1278: 8 total, 8 up, 8 in 2024-01-13T18:45:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:13 smithi084 ceph-mon[116404]: osdmap e1277: 8 total, 8 up, 8 in 2024-01-13T18:45:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:13 smithi084 ceph-mon[116404]: osdmap e1278: 8 total, 8 up, 8 in 2024-01-13T18:45:13.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:13 smithi084 ceph-mon[119097]: osdmap e1277: 8 total, 8 up, 8 in 2024-01-13T18:45:13.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:13 smithi084 ceph-mon[119097]: osdmap e1278: 8 total, 8 up, 8 in 2024-01-13T18:45:14.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:14 smithi099 ceph-mon[138788]: pgmap v2354: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 75 KiB/s rd, 5.7 KiB/s wr, 100 op/s 2024-01-13T18:45:14.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:14 smithi099 ceph-mon[138788]: osdmap e1279: 8 total, 8 up, 8 in 2024-01-13T18:45:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:14 smithi084 ceph-mon[116404]: pgmap v2354: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 75 KiB/s rd, 5.7 KiB/s wr, 100 op/s 2024-01-13T18:45:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:14 smithi084 ceph-mon[116404]: osdmap e1279: 8 total, 8 up, 8 in 2024-01-13T18:45:14.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:14 smithi084 ceph-mon[119097]: pgmap v2354: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 75 KiB/s rd, 5.7 KiB/s wr, 100 op/s 2024-01-13T18:45:14.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:14 smithi084 ceph-mon[119097]: osdmap e1279: 8 total, 8 up, 8 in 2024-01-13T18:45:15.642 INFO:tasks.workunit.client.0.smithi084.stdout:100.00% done 2024-01-13T18:45:15.698 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.SnapRemove2 (2095 ms) 2024-01-13T18:45:15.699 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.SnapRenameViaLockOwner 2024-01-13T18:45:15.699 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:16.665 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.SnapRenameViaLockOwner (1023 ms) 2024-01-13T18:45:16.665 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.SnapProtectViaLockOwner 2024-01-13T18:45:16.665 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:16 smithi099 ceph-mon[138788]: pgmap v2357: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 79 KiB/s rd, 6.5 KiB/s wr, 110 op/s 2024-01-13T18:45:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:16 smithi099 ceph-mon[138788]: osdmap e1280: 8 total, 8 up, 8 in 2024-01-13T18:45:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:16 smithi084 ceph-mon[116404]: pgmap v2357: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 79 KiB/s rd, 6.5 KiB/s wr, 110 op/s 2024-01-13T18:45:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:16 smithi084 ceph-mon[116404]: osdmap e1280: 8 total, 8 up, 8 in 2024-01-13T18:45:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:16 smithi084 ceph-mon[119097]: pgmap v2357: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 79 KiB/s rd, 6.5 KiB/s wr, 110 op/s 2024-01-13T18:45:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:16 smithi084 ceph-mon[119097]: osdmap e1280: 8 total, 8 up, 8 in 2024-01-13T18:45:17.671 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.SnapProtectViaLockOwner (1007 ms) 2024-01-13T18:45:17.671 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.SnapUnprotectViaLockOwner 2024-01-13T18:45:17.671 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:17 smithi084 ceph-mon[116404]: osdmap e1281: 8 total, 8 up, 8 in 2024-01-13T18:45:17.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:17 smithi084 ceph-mon[119097]: osdmap e1281: 8 total, 8 up, 8 in 2024-01-13T18:45:18.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:17 smithi099 ceph-mon[138788]: osdmap e1281: 8 total, 8 up, 8 in 2024-01-13T18:45:18.522 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.SnapUnprotectViaLockOwner (851 ms) 2024-01-13T18:45:18.522 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.FlattenViaLockOwner 2024-01-13T18:45:18.522 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:18 smithi084 ceph-mon[116404]: pgmap v2360: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 71 KiB/s rd, 7.7 KiB/s wr, 101 op/s 2024-01-13T18:45:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:18 smithi084 ceph-mon[116404]: osdmap e1282: 8 total, 8 up, 8 in 2024-01-13T18:45:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:18 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:45:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:18 smithi084 ceph-mon[116404]: osdmap e1283: 8 total, 8 up, 8 in 2024-01-13T18:45:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:18 smithi084 ceph-mon[119097]: pgmap v2360: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 71 KiB/s rd, 7.7 KiB/s wr, 101 op/s 2024-01-13T18:45:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:18 smithi084 ceph-mon[119097]: osdmap e1282: 8 total, 8 up, 8 in 2024-01-13T18:45:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:18 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:45:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:18 smithi084 ceph-mon[119097]: osdmap e1283: 8 total, 8 up, 8 in 2024-01-13T18:45:19.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:18 smithi099 ceph-mon[138788]: pgmap v2360: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 71 KiB/s rd, 7.7 KiB/s wr, 101 op/s 2024-01-13T18:45:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:18 smithi099 ceph-mon[138788]: osdmap e1282: 8 total, 8 up, 8 in 2024-01-13T18:45:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:18 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:45:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:18 smithi099 ceph-mon[138788]: osdmap e1283: 8 total, 8 up, 8 in 2024-01-13T18:45:19.586 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.FlattenViaLockOwner (1064 ms) 2024-01-13T18:45:19.586 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ResizeViaLockOwner 2024-01-13T18:45:19.586 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:19.627 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ResizeViaLockOwner (40 ms) 2024-01-13T18:45:19.627 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.SparsifyViaLockOwner 2024-01-13T18:45:19.627 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:19.661 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.SparsifyViaLockOwner (34 ms) 2024-01-13T18:45:19.661 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ObjectMapConsistentSnap 2024-01-13T18:45:19.661 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:19.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:45:19.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:45:19.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:19 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:45:19.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:19 smithi084 ceph-mon[116404]: osdmap e1284: 8 total, 8 up, 8 in 2024-01-13T18:45:19.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:45:19.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:45:19.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:19 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:45:19.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:19 smithi084 ceph-mon[119097]: osdmap e1284: 8 total, 8 up, 8 in 2024-01-13T18:45:20.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:45:20.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:45:20.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:19 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:45:20.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:19 smithi099 ceph-mon[138788]: osdmap e1284: 8 total, 8 up, 8 in 2024-01-13T18:45:20.636 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:45:20] "GET /metrics HTTP/1.1" 200 74918 "" "Prometheus/2.43.0" 2024-01-13T18:45:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:20 smithi084 ceph-mon[116404]: pgmap v2363: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 186 KiB/s rd, 15 KiB/s wr, 249 op/s 2024-01-13T18:45:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:20.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:20 smithi084 ceph-mon[119097]: pgmap v2363: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 186 KiB/s rd, 15 KiB/s wr, 249 op/s 2024-01-13T18:45:20.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:20 smithi099 ceph-mon[138788]: pgmap v2363: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 186 KiB/s rd, 15 KiB/s wr, 249 op/s 2024-01-13T18:45:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:21 smithi084 ceph-mon[116404]: osdmap e1285: 8 total, 8 up, 8 in 2024-01-13T18:45:21.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:21 smithi084 ceph-mon[119097]: osdmap e1285: 8 total, 8 up, 8 in 2024-01-13T18:45:22.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:21 smithi099 ceph-mon[138788]: osdmap e1285: 8 total, 8 up, 8 in 2024-01-13T18:45:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:22 smithi084 ceph-mon[116404]: pgmap v2366: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 203 KiB/s rd, 14 KiB/s wr, 275 op/s 2024-01-13T18:45:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:22 smithi084 ceph-mon[116404]: osdmap e1286: 8 total, 8 up, 8 in 2024-01-13T18:45:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:22 smithi084 ceph-mon[119097]: pgmap v2366: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 203 KiB/s rd, 14 KiB/s wr, 275 op/s 2024-01-13T18:45:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:22 smithi084 ceph-mon[119097]: osdmap e1286: 8 total, 8 up, 8 in 2024-01-13T18:45:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:22 smithi099 ceph-mon[138788]: pgmap v2366: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 203 KiB/s rd, 14 KiB/s wr, 275 op/s 2024-01-13T18:45:23.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:22 smithi099 ceph-mon[138788]: osdmap e1286: 8 total, 8 up, 8 in 2024-01-13T18:45:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:23 smithi084 ceph-mon[116404]: osdmap e1287: 8 total, 8 up, 8 in 2024-01-13T18:45:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:23 smithi084 ceph-mon[116404]: osdmap e1288: 8 total, 8 up, 8 in 2024-01-13T18:45:23.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:23 smithi084 ceph-mon[119097]: osdmap e1287: 8 total, 8 up, 8 in 2024-01-13T18:45:23.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:23 smithi084 ceph-mon[119097]: osdmap e1288: 8 total, 8 up, 8 in 2024-01-13T18:45:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:23 smithi099 ceph-mon[138788]: osdmap e1287: 8 total, 8 up, 8 in 2024-01-13T18:45:24.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:23 smithi099 ceph-mon[138788]: osdmap e1288: 8 total, 8 up, 8 in 2024-01-13T18:45:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:24 smithi084 ceph-mon[116404]: pgmap v2369: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 194 KiB/s rd, 11 KiB/s wr, 257 op/s 2024-01-13T18:45:24.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:24 smithi084 ceph-mon[116404]: osdmap e1289: 8 total, 8 up, 8 in 2024-01-13T18:45:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:24 smithi084 ceph-mon[119097]: pgmap v2369: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 194 KiB/s rd, 11 KiB/s wr, 257 op/s 2024-01-13T18:45:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:24 smithi084 ceph-mon[119097]: osdmap e1289: 8 total, 8 up, 8 in 2024-01-13T18:45:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:24 smithi099 ceph-mon[138788]: pgmap v2369: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 194 KiB/s rd, 11 KiB/s wr, 257 op/s 2024-01-13T18:45:25.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:24 smithi099 ceph-mon[138788]: osdmap e1289: 8 total, 8 up, 8 in 2024-01-13T18:45:26.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:26 smithi099 ceph-mon[138788]: pgmap v2372: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 114 KiB/s rd, 6.7 KiB/s wr, 148 op/s 2024-01-13T18:45:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:26 smithi099 ceph-mon[138788]: osdmap e1290: 8 total, 8 up, 8 in 2024-01-13T18:45:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:26 smithi084 ceph-mon[116404]: pgmap v2372: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 114 KiB/s rd, 6.7 KiB/s wr, 148 op/s 2024-01-13T18:45:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:26 smithi084 ceph-mon[116404]: osdmap e1290: 8 total, 8 up, 8 in 2024-01-13T18:45:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:26 smithi084 ceph-mon[119097]: pgmap v2372: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 114 KiB/s rd, 6.7 KiB/s wr, 148 op/s 2024-01-13T18:45:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:26 smithi084 ceph-mon[119097]: osdmap e1290: 8 total, 8 up, 8 in 2024-01-13T18:45:27.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:27 smithi099 ceph-mon[138788]: osdmap e1291: 8 total, 8 up, 8 in 2024-01-13T18:45:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:27 smithi084 ceph-mon[116404]: osdmap e1291: 8 total, 8 up, 8 in 2024-01-13T18:45:27.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:27 smithi084 ceph-mon[119097]: osdmap e1291: 8 total, 8 up, 8 in 2024-01-13T18:45:28.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:28 smithi099 ceph-mon[138788]: pgmap v2375: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-01-13T18:45:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:28 smithi099 ceph-mon[138788]: osdmap e1292: 8 total, 8 up, 8 in 2024-01-13T18:45:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:28 smithi084 ceph-mon[119097]: pgmap v2375: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-01-13T18:45:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:28 smithi084 ceph-mon[119097]: osdmap e1292: 8 total, 8 up, 8 in 2024-01-13T18:45:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:28 smithi084 ceph-mon[116404]: pgmap v2375: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-01-13T18:45:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:28 smithi084 ceph-mon[116404]: osdmap e1292: 8 total, 8 up, 8 in 2024-01-13T18:45:29.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:29 smithi099 ceph-mon[138788]: osdmap e1293: 8 total, 8 up, 8 in 2024-01-13T18:45:29.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:29 smithi084 ceph-mon[116404]: osdmap e1293: 8 total, 8 up, 8 in 2024-01-13T18:45:29.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:29 smithi084 ceph-mon[119097]: osdmap e1293: 8 total, 8 up, 8 in 2024-01-13T18:45:30.086 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ObjectMapConsistentSnap (10425 ms) 2024-01-13T18:45:30.086 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.Metadata 2024-01-13T18:45:30.086 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:30.620 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.Metadata (535 ms) 2024-01-13T18:45:30.621 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.MetadataPP 2024-01-13T18:45:30.621 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:45:30] "GET /metrics HTTP/1.1" 200 74918 "" "Prometheus/2.43.0" 2024-01-13T18:45:30.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:30 smithi084 ceph-mon[116404]: pgmap v2378: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 61 KiB/s rd, 4.2 KiB/s wr, 81 op/s 2024-01-13T18:45:30.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:30 smithi084 ceph-mon[116404]: osdmap e1294: 8 total, 8 up, 8 in 2024-01-13T18:45:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:30 smithi084 ceph-mon[119097]: pgmap v2378: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 61 KiB/s rd, 4.2 KiB/s wr, 81 op/s 2024-01-13T18:45:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:30 smithi084 ceph-mon[119097]: osdmap e1294: 8 total, 8 up, 8 in 2024-01-13T18:45:30.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:30 smithi099 ceph-mon[138788]: pgmap v2378: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 61 KiB/s rd, 4.2 KiB/s wr, 81 op/s 2024-01-13T18:45:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:30 smithi099 ceph-mon[138788]: osdmap e1294: 8 total, 8 up, 8 in 2024-01-13T18:45:31.631 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.MetadataPP (1011 ms) 2024-01-13T18:45:31.631 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.UpdateFeatures 2024-01-13T18:45:31.631 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:31.732 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.UpdateFeatures (101 ms) 2024-01-13T18:45:31.733 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.FeaturesBitmaskString 2024-01-13T18:45:31.733 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.FeaturesBitmaskString (0 ms) 2024-01-13T18:45:31.733 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.RebuildObjectMap 2024-01-13T18:45:31.733 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:31.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:31 smithi099 ceph-mon[138788]: osdmap e1295: 8 total, 8 up, 8 in 2024-01-13T18:45:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:31 smithi084 ceph-mon[116404]: osdmap e1295: 8 total, 8 up, 8 in 2024-01-13T18:45:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:31 smithi084 ceph-mon[119097]: osdmap e1295: 8 total, 8 up, 8 in 2024-01-13T18:45:32.606 INFO:tasks.workunit.client.0.smithi084.stdout:0.00% done 2024-01-13T18:45:32.606 INFO:tasks.workunit.client.0.smithi084.stdout:25.00% done 2024-01-13T18:45:32.606 INFO:tasks.workunit.client.0.smithi084.stdout:50.00% done 2024-01-13T18:45:32.606 INFO:tasks.workunit.client.0.smithi084.stdout:75.00% done 2024-01-13T18:45:32.607 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.RebuildObjectMap (874 ms) 2024-01-13T18:45:32.607 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.RebuildNewObjectMap 2024-01-13T18:45:32.637 INFO:tasks.workunit.client.0.smithi084.stdout:0.00% done 2024-01-13T18:45:32.637 INFO:tasks.workunit.client.0.smithi084.stdout:25.00% done 2024-01-13T18:45:32.637 INFO:tasks.workunit.client.0.smithi084.stdout:50.00% done 2024-01-13T18:45:32.637 INFO:tasks.workunit.client.0.smithi084.stdout:75.00% done 2024-01-13T18:45:32.637 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.RebuildNewObjectMap (31 ms) 2024-01-13T18:45:32.637 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.CheckObjectMap 2024-01-13T18:45:32.637 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:32.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:32 smithi099 ceph-mon[138788]: pgmap v2381: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 61 KiB/s rd, 10 KiB/s wr, 87 op/s 2024-01-13T18:45:32.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:32 smithi099 ceph-mon[138788]: osdmap e1296: 8 total, 8 up, 8 in 2024-01-13T18:45:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:32 smithi084 ceph-mon[116404]: pgmap v2381: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 61 KiB/s rd, 10 KiB/s wr, 87 op/s 2024-01-13T18:45:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:32 smithi084 ceph-mon[116404]: osdmap e1296: 8 total, 8 up, 8 in 2024-01-13T18:45:32.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:32 smithi084 ceph-mon[119097]: pgmap v2381: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 61 KiB/s rd, 10 KiB/s wr, 87 op/s 2024-01-13T18:45:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:32 smithi084 ceph-mon[119097]: osdmap e1296: 8 total, 8 up, 8 in 2024-01-13T18:45:33.635 INFO:tasks.workunit.client.0.smithi084.stdout:0.00% done 2024-01-13T18:45:33.635 INFO:tasks.workunit.client.0.smithi084.stdout:25.00% done 2024-01-13T18:45:33.635 INFO:tasks.workunit.client.0.smithi084.stdout:50.00% done 2024-01-13T18:45:33.636 INFO:tasks.workunit.client.0.smithi084.stdout:75.00% done 2024-01-13T18:45:33.636 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.CheckObjectMap (997 ms) 2024-01-13T18:45:33.636 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.BlockingAIO 2024-01-13T18:45:33.636 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:33.666 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.BlockingAIO (32 ms) 2024-01-13T18:45:33.666 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ExclusiveLockTransition 2024-01-13T18:45:33.667 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:33.828 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ExclusiveLockTransition (161 ms) 2024-01-13T18:45:33.828 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ExclusiveLockReadTransition 2024-01-13T18:45:33.828 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:45:33.828 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ExclusiveLockReadTransition (0 ms) 2024-01-13T18:45:33.828 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.CacheMayCopyOnWrite 2024-01-13T18:45:33.828 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:33.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:33 smithi099 ceph-mon[138788]: osdmap e1297: 8 total, 8 up, 8 in 2024-01-13T18:45:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:33 smithi084 ceph-mon[116404]: osdmap e1297: 8 total, 8 up, 8 in 2024-01-13T18:45:33.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:33 smithi084 ceph-mon[119097]: osdmap e1297: 8 total, 8 up, 8 in 2024-01-13T18:45:34.665 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.CacheMayCopyOnWrite (837 ms) 2024-01-13T18:45:34.665 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot 2024-01-13T18:45:34.665 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:34.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:34 smithi099 ceph-mon[138788]: pgmap v2384: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 289 KiB/s rd, 57 KiB/s wr, 414 op/s 2024-01-13T18:45:34.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:34 smithi099 ceph-mon[138788]: osdmap e1298: 8 total, 8 up, 8 in 2024-01-13T18:45:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:34 smithi084 ceph-mon[116404]: pgmap v2384: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 289 KiB/s rd, 57 KiB/s wr, 414 op/s 2024-01-13T18:45:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:34 smithi084 ceph-mon[116404]: osdmap e1298: 8 total, 8 up, 8 in 2024-01-13T18:45:34.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:34 smithi084 ceph-mon[119097]: pgmap v2384: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 289 KiB/s rd, 57 KiB/s wr, 414 op/s 2024-01-13T18:45:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:34 smithi084 ceph-mon[119097]: osdmap e1298: 8 total, 8 up, 8 in 2024-01-13T18:45:35.598 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.FlushEmptyOpsOnExternalSnapshot (933 ms) 2024-01-13T18:45:35.598 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestImageOptions 2024-01-13T18:45:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:35 smithi099 ceph-mon[138788]: osdmap e1299: 8 total, 8 up, 8 in 2024-01-13T18:45:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:35 smithi084 ceph-mon[116404]: osdmap e1299: 8 total, 8 up, 8 in 2024-01-13T18:45:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:35 smithi084 ceph-mon[119097]: osdmap e1299: 8 total, 8 up, 8 in 2024-01-13T18:45:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:36.705 INFO:tasks.workunit.client.0.smithi084.stdout:0.00% done 2024-01-13T18:45:36.705 INFO:tasks.workunit.client.0.smithi084.stdout:100.00% done 2024-01-13T18:45:36.705 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestImageOptions (1107 ms) 2024-01-13T18:45:36.705 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestImageOptionsPP 2024-01-13T18:45:36.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:36 smithi099 ceph-mon[138788]: pgmap v2387: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 624 KiB/s rd, 194 KiB/s wr, 958 op/s 2024-01-13T18:45:36.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:36 smithi099 ceph-mon[138788]: osdmap e1300: 8 total, 8 up, 8 in 2024-01-13T18:45:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:36 smithi084 ceph-mon[119097]: pgmap v2387: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 624 KiB/s rd, 194 KiB/s wr, 958 op/s 2024-01-13T18:45:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:36 smithi084 ceph-mon[119097]: osdmap e1300: 8 total, 8 up, 8 in 2024-01-13T18:45:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:36 smithi084 ceph-mon[116404]: pgmap v2387: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 624 KiB/s rd, 194 KiB/s wr, 958 op/s 2024-01-13T18:45:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:36 smithi084 ceph-mon[116404]: osdmap e1300: 8 total, 8 up, 8 in 2024-01-13T18:45:37.696 INFO:tasks.workunit.client.0.smithi084.stdout:0.00% done 2024-01-13T18:45:37.696 INFO:tasks.workunit.client.0.smithi084.stdout:100.00% done 2024-01-13T18:45:37.696 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestImageOptionsPP (991 ms) 2024-01-13T18:45:37.697 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.EventSocketPipe 2024-01-13T18:45:37.697 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.EventSocketPipe (1 ms) 2024-01-13T18:45:37.697 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.EventSocketEventfd 2024-01-13T18:45:37.697 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.EventSocketEventfd (0 ms) 2024-01-13T18:45:37.697 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ImagePollIO 2024-01-13T18:45:37.697 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:37.738 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:45:37.738 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:45:37.738 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:45:37.738 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:45:37.738 INFO:tasks.workunit.client.0.smithi084.stdout:wrote: 512 2024-01-13T18:45:37.738 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:45:37.738 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:45:37.738 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:45:37.738 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:45:37.739 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:started write 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:write completion cb called! 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 0 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:finished write 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:45:37.740 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:created completion 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:started read 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:read completion cb called! 2024-01-13T18:45:37.741 INFO:tasks.workunit.client.0.smithi084.stdout:return value is: 512 2024-01-13T18:45:37.742 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ImagePollIO (41 ms) 2024-01-13T18:45:37.742 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.Mirror 2024-01-13T18:45:37.742 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:37.749 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:37.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:37 smithi099 ceph-mon[138788]: osdmap e1301: 8 total, 8 up, 8 in 2024-01-13T18:45:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:37 smithi084 ceph-mon[116404]: osdmap e1301: 8 total, 8 up, 8 in 2024-01-13T18:45:37.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:37 smithi084 ceph-mon[119097]: osdmap e1301: 8 total, 8 up, 8 in 2024-01-13T18:45:38.750 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.Mirror (1013 ms) 2024-01-13T18:45:38.751 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.MirrorPeerAttributes 2024-01-13T18:45:38.765 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.MirrorPeerAttributes (15 ms) 2024-01-13T18:45:38.765 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.CreateWithMirrorEnabled 2024-01-13T18:45:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:38 smithi099 ceph-mon[138788]: pgmap v2390: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 474 KiB/s rd, 212 KiB/s wr, 763 op/s 2024-01-13T18:45:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:38 smithi099 ceph-mon[138788]: osdmap e1302: 8 total, 8 up, 8 in 2024-01-13T18:45:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:38 smithi084 ceph-mon[116404]: pgmap v2390: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 474 KiB/s rd, 212 KiB/s wr, 763 op/s 2024-01-13T18:45:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:38 smithi084 ceph-mon[116404]: osdmap e1302: 8 total, 8 up, 8 in 2024-01-13T18:45:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:38 smithi084 ceph-mon[119097]: pgmap v2390: 649 pgs: 649 active+clean; 143 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 474 KiB/s rd, 212 KiB/s wr, 763 op/s 2024-01-13T18:45:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:38 smithi084 ceph-mon[119097]: osdmap e1302: 8 total, 8 up, 8 in 2024-01-13T18:45:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: osdmap e1303: 8 total, 8 up, 8 in 2024-01-13T18:45:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/uuid4"}]: dispatch 2024-01-13T18:45:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/uuid4"}]': finished 2024-01-13T18:45:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/dca3caa6-ac39-4414-b00a-f15bdaa9b9bc"}]: dispatch 2024-01-13T18:45:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/dca3caa6-ac39-4414-b00a-f15bdaa9b9bc"}]': finished 2024-01-13T18:45:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/39ae2d16-d64f-4850-acfe-52864a31b3bf"}]: dispatch 2024-01-13T18:45:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/39ae2d16-d64f-4850-acfe-52864a31b3bf"}]': finished 2024-01-13T18:45:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/408e209a-7da1-4049-8a6c-a9cc8455ddcd"}]: dispatch 2024-01-13T18:45:39.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/408e209a-7da1-4049-8a6c-a9cc8455ddcd"}]': finished 2024-01-13T18:45:39.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]: dispatch 2024-01-13T18:45:39.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' 2024-01-13T18:45:39.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]: dispatch 2024-01-13T18:45:39.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]: dispatch 2024-01-13T18:45:39.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]': finished 2024-01-13T18:45:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: osdmap e1303: 8 total, 8 up, 8 in 2024-01-13T18:45:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/uuid4"}]: dispatch 2024-01-13T18:45:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/uuid4"}]': finished 2024-01-13T18:45:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/dca3caa6-ac39-4414-b00a-f15bdaa9b9bc"}]: dispatch 2024-01-13T18:45:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/dca3caa6-ac39-4414-b00a-f15bdaa9b9bc"}]': finished 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/39ae2d16-d64f-4850-acfe-52864a31b3bf"}]: dispatch 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/39ae2d16-d64f-4850-acfe-52864a31b3bf"}]': finished 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/408e209a-7da1-4049-8a6c-a9cc8455ddcd"}]: dispatch 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/408e209a-7da1-4049-8a6c-a9cc8455ddcd"}]': finished 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]: dispatch 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]: dispatch 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]: dispatch 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]': finished 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: osdmap e1303: 8 total, 8 up, 8 in 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/uuid4"}]: dispatch 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/uuid4"}]': finished 2024-01-13T18:45:39.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/dca3caa6-ac39-4414-b00a-f15bdaa9b9bc"}]: dispatch 2024-01-13T18:45:39.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/dca3caa6-ac39-4414-b00a-f15bdaa9b9bc"}]': finished 2024-01-13T18:45:39.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/39ae2d16-d64f-4850-acfe-52864a31b3bf"}]: dispatch 2024-01-13T18:45:39.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/39ae2d16-d64f-4850-acfe-52864a31b3bf"}]': finished 2024-01-13T18:45:39.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/408e209a-7da1-4049-8a6c-a9cc8455ddcd"}]: dispatch 2024-01-13T18:45:39.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/408e209a-7da1-4049-8a6c-a9cc8455ddcd"}]': finished 2024-01-13T18:45:39.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]: dispatch 2024-01-13T18:45:39.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' 2024-01-13T18:45:39.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]: dispatch 2024-01-13T18:45:39.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]: dispatch 2024-01-13T18:45:39.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/661208859' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/77/4593c871-b5ee-4bd0-bdc7-01ec56c0b8a1"}]': finished 2024-01-13T18:45:40.587 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:45:40] "GET /metrics HTTP/1.1" 200 74914 "" "Prometheus/2.43.0" 2024-01-13T18:45:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:40 smithi099 ceph-mon[138788]: pgmap v2393: 649 pgs: 649 active+clean; 148 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 386 KiB/s rd, 1.3 MiB/s wr, 520 op/s 2024-01-13T18:45:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:40 smithi099 ceph-mon[138788]: osdmap e1304: 8 total, 8 up, 8 in 2024-01-13T18:45:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:40 smithi084 ceph-mon[116404]: pgmap v2393: 649 pgs: 649 active+clean; 148 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 386 KiB/s rd, 1.3 MiB/s wr, 520 op/s 2024-01-13T18:45:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:40 smithi084 ceph-mon[116404]: osdmap e1304: 8 total, 8 up, 8 in 2024-01-13T18:45:40.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:40 smithi084 ceph-mon[119097]: pgmap v2393: 649 pgs: 649 active+clean; 148 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 386 KiB/s rd, 1.3 MiB/s wr, 520 op/s 2024-01-13T18:45:40.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:40 smithi084 ceph-mon[119097]: osdmap e1304: 8 total, 8 up, 8 in 2024-01-13T18:45:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:41 smithi099 ceph-mon[138788]: pgmap v2395: 649 pgs: 649 active+clean; 151 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 307 KiB/s rd, 2.0 MiB/s wr, 391 op/s 2024-01-13T18:45:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:41 smithi099 ceph-mon[138788]: osdmap e1305: 8 total, 8 up, 8 in 2024-01-13T18:45:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:41 smithi084 ceph-mon[116404]: pgmap v2395: 649 pgs: 649 active+clean; 151 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 307 KiB/s rd, 2.0 MiB/s wr, 391 op/s 2024-01-13T18:45:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:41 smithi084 ceph-mon[116404]: osdmap e1305: 8 total, 8 up, 8 in 2024-01-13T18:45:42.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:41 smithi084 ceph-mon[119097]: pgmap v2395: 649 pgs: 649 active+clean; 151 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 307 KiB/s rd, 2.0 MiB/s wr, 391 op/s 2024-01-13T18:45:42.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:41 smithi084 ceph-mon[119097]: osdmap e1305: 8 total, 8 up, 8 in 2024-01-13T18:45:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:42 smithi099 ceph-mon[138788]: osdmap e1306: 8 total, 8 up, 8 in 2024-01-13T18:45:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:42 smithi084 ceph-mon[116404]: osdmap e1306: 8 total, 8 up, 8 in 2024-01-13T18:45:43.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:42 smithi084 ceph-mon[119097]: osdmap e1306: 8 total, 8 up, 8 in 2024-01-13T18:45:43.828 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.CreateWithMirrorEnabled (5062 ms) 2024-01-13T18:45:43.828 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot 2024-01-13T18:45:43.828 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:43 smithi099 ceph-mon[138788]: pgmap v2398: 649 pgs: 649 active+clean; 151 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 210 KiB/s rd, 893 KiB/s wr, 276 op/s 2024-01-13T18:45:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:43 smithi099 ceph-mon[138788]: osdmap e1307: 8 total, 8 up, 8 in 2024-01-13T18:45:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:43 smithi084 ceph-mon[116404]: pgmap v2398: 649 pgs: 649 active+clean; 151 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 210 KiB/s rd, 893 KiB/s wr, 276 op/s 2024-01-13T18:45:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:43 smithi084 ceph-mon[116404]: osdmap e1307: 8 total, 8 up, 8 in 2024-01-13T18:45:44.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:43 smithi084 ceph-mon[119097]: pgmap v2398: 649 pgs: 649 active+clean; 151 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 210 KiB/s rd, 893 KiB/s wr, 276 op/s 2024-01-13T18:45:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:43 smithi084 ceph-mon[119097]: osdmap e1307: 8 total, 8 up, 8 in 2024-01-13T18:45:45.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:44 smithi099 ceph-mon[138788]: osdmap e1308: 8 total, 8 up, 8 in 2024-01-13T18:45:45.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:44 smithi084 ceph-mon[116404]: osdmap e1308: 8 total, 8 up, 8 in 2024-01-13T18:45:45.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:44 smithi084 ceph-mon[119097]: osdmap e1308: 8 total, 8 up, 8 in 2024-01-13T18:45:45.823 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.FlushCacheWithCopyupOnExternalSnapshot (1996 ms) 2024-01-13T18:45:45.823 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ExclusiveLock 2024-01-13T18:45:45.823 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:45.888 INFO:tasks.workunit.client.0.smithi084.stdout:1: acquiring exclusive lock 2024-01-13T18:45:45.889 INFO:tasks.workunit.client.0.smithi084.stdout:2: acquiring exclusive lock 2024-01-13T18:45:45.892 INFO:tasks.workunit.client.0.smithi084.stdout:2: exclusive lock acquired 2024-01-13T18:45:45.933 INFO:tasks.workunit.client.0.smithi084.stdout:2: releasing exclusive lock 2024-01-13T18:45:45.936 INFO:tasks.workunit.client.0.smithi084.stdout:2: exclusive lock released 2024-01-13T18:45:45.936 INFO:tasks.workunit.client.0.smithi084.stdout:2: acquiring exclusive lock 2024-01-13T18:45:45.940 INFO:tasks.workunit.client.0.smithi084.stdout:1: exclusive lock acquired 2024-01-13T18:45:45.960 INFO:tasks.workunit.client.0.smithi084.stdout:1: releasing exclusive lock 2024-01-13T18:45:45.962 INFO:tasks.workunit.client.0.smithi084.stdout:1: exclusive lock released 2024-01-13T18:45:45.962 INFO:tasks.workunit.client.0.smithi084.stdout:1: acquiring exclusive lock 2024-01-13T18:45:45.965 INFO:tasks.workunit.client.0.smithi084.stdout:2: exclusive lock acquired 2024-01-13T18:45:45.987 INFO:tasks.workunit.client.0.smithi084.stdout:2: releasing exclusive lock 2024-01-13T18:45:45.990 INFO:tasks.workunit.client.0.smithi084.stdout:2: exclusive lock released 2024-01-13T18:45:45.990 INFO:tasks.workunit.client.0.smithi084.stdout:2: acquiring exclusive lock 2024-01-13T18:45:45.993 INFO:tasks.workunit.client.0.smithi084.stdout:2: exclusive lock acquired 2024-01-13T18:45:46.031 INFO:tasks.workunit.client.0.smithi084.stdout:2: releasing exclusive lock 2024-01-13T18:45:46.034 INFO:tasks.workunit.client.0.smithi084.stdout:2: exclusive lock released 2024-01-13T18:45:46.034 INFO:tasks.workunit.client.0.smithi084.stdout:2: acquiring exclusive lock 2024-01-13T18:45:46.037 INFO:tasks.workunit.client.0.smithi084.stdout:2: exclusive lock acquired 2024-01-13T18:45:46.085 INFO:tasks.workunit.client.0.smithi084.stdout:2: releasing exclusive lock 2024-01-13T18:45:46.088 INFO:tasks.workunit.client.0.smithi084.stdout:2: exclusive lock released 2024-01-13T18:45:46.088 INFO:tasks.workunit.client.0.smithi084.stdout:2: acquiring exclusive lock 2024-01-13T18:45:46.091 INFO:tasks.workunit.client.0.smithi084.stdout:2: exclusive lock acquired 2024-01-13T18:45:46.106 INFO:tasks.workunit.client.0.smithi084.stdout:2: releasing exclusive lock 2024-01-13T18:45:46.109 INFO:tasks.workunit.client.0.smithi084.stdout:2: exclusive lock released 2024-01-13T18:45:46.112 INFO:tasks.workunit.client.0.smithi084.stdout:1: exclusive lock acquired 2024-01-13T18:45:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:45 smithi099 ceph-mon[138788]: pgmap v2401: 649 pgs: 649 active+clean; 151 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 188 KiB/s rd, 15 KiB/s wr, 243 op/s 2024-01-13T18:45:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:45 smithi099 ceph-mon[138788]: osdmap e1309: 8 total, 8 up, 8 in 2024-01-13T18:45:46.155 INFO:tasks.workunit.client.0.smithi084.stdout:1: releasing exclusive lock 2024-01-13T18:45:46.158 INFO:tasks.workunit.client.0.smithi084.stdout:1: exclusive lock released 2024-01-13T18:45:46.158 INFO:tasks.workunit.client.0.smithi084.stdout:1: acquiring exclusive lock 2024-01-13T18:45:46.161 INFO:tasks.workunit.client.0.smithi084.stdout:1: exclusive lock acquired 2024-01-13T18:45:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:45 smithi084 ceph-mon[116404]: pgmap v2401: 649 pgs: 649 active+clean; 151 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 188 KiB/s rd, 15 KiB/s wr, 243 op/s 2024-01-13T18:45:46.270 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:45 smithi084 ceph-mon[116404]: osdmap e1309: 8 total, 8 up, 8 in 2024-01-13T18:45:46.271 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:45 smithi084 ceph-mon[119097]: pgmap v2401: 649 pgs: 649 active+clean; 151 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 188 KiB/s rd, 15 KiB/s wr, 243 op/s 2024-01-13T18:45:46.271 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:45 smithi084 ceph-mon[119097]: osdmap e1309: 8 total, 8 up, 8 in 2024-01-13T18:45:46.272 INFO:tasks.workunit.client.0.smithi084.stdout:1: releasing exclusive lock 2024-01-13T18:45:46.272 INFO:tasks.workunit.client.0.smithi084.stdout:1: exclusive lock released 2024-01-13T18:45:46.272 INFO:tasks.workunit.client.0.smithi084.stdout:1: acquiring exclusive lock 2024-01-13T18:45:46.272 INFO:tasks.workunit.client.0.smithi084.stdout:1: exclusive lock acquired 2024-01-13T18:45:46.272 INFO:tasks.workunit.client.0.smithi084.stdout:1: releasing exclusive lock 2024-01-13T18:45:46.272 INFO:tasks.workunit.client.0.smithi084.stdout:1: exclusive lock released 2024-01-13T18:45:46.273 INFO:tasks.workunit.client.0.smithi084.stdout:1: acquiring exclusive lock 2024-01-13T18:45:46.273 INFO:tasks.workunit.client.0.smithi084.stdout:1: exclusive lock acquired 2024-01-13T18:45:46.273 INFO:tasks.workunit.client.0.smithi084.stdout:1: releasing exclusive lock 2024-01-13T18:45:46.273 INFO:tasks.workunit.client.0.smithi084.stdout:1: exclusive lock released 2024-01-13T18:45:46.276 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ExclusiveLock (453 ms) 2024-01-13T18:45:46.276 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.BreakLock 2024-01-13T18:45:46.291 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:46.839 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.BreakLock (562 ms) 2024-01-13T18:45:46.839 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.DiscardAfterWrite 2024-01-13T18:45:46.839 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:46.869 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.DiscardAfterWrite (31 ms) 2024-01-13T18:45:46.869 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.DefaultFeatures 2024-01-13T18:45:46.870 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.DefaultFeatures (0 ms) 2024-01-13T18:45:46.870 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurge 2024-01-13T18:45:46.870 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:46.929 INFO:tasks.workunit.client.0.smithi084.stdout:0.00% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:1.56% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:3.12% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:4.69% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:6.25% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:7.81% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:9.38% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:10.94% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:12.50% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:14.06% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:15.62% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:17.19% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:18.75% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:20.31% done 2024-01-13T18:45:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:21.88% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:23.44% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:25.00% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:26.56% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:28.12% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:29.69% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:31.25% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:32.81% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:34.38% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:35.94% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:37.50% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:39.06% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:40.62% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:42.19% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:43.75% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:45.31% done 2024-01-13T18:45:46.931 INFO:tasks.workunit.client.0.smithi084.stdout:46.88% done 2024-01-13T18:45:46.932 INFO:tasks.workunit.client.0.smithi084.stdout:48.44% done 2024-01-13T18:45:46.932 INFO:tasks.workunit.client.0.smithi084.stdout:50.00% done 2024-01-13T18:45:46.932 INFO:tasks.workunit.client.0.smithi084.stdout:51.56% done 2024-01-13T18:45:46.932 INFO:tasks.workunit.client.0.smithi084.stdout:53.12% done 2024-01-13T18:45:46.932 INFO:tasks.workunit.client.0.smithi084.stdout:54.69% done 2024-01-13T18:45:46.932 INFO:tasks.workunit.client.0.smithi084.stdout:56.25% done 2024-01-13T18:45:46.932 INFO:tasks.workunit.client.0.smithi084.stdout:57.81% done 2024-01-13T18:45:46.932 INFO:tasks.workunit.client.0.smithi084.stdout:59.38% done 2024-01-13T18:45:46.932 INFO:tasks.workunit.client.0.smithi084.stdout:60.94% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:62.50% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:64.06% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:65.62% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:67.19% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:68.75% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:70.31% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:71.88% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:73.44% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:75.00% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:76.56% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:78.12% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:79.69% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:81.25% done 2024-01-13T18:45:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:82.81% done 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:84.38% done 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:85.94% done 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:87.50% done 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:89.06% done 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:90.62% done 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:92.19% done 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:93.75% done 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:95.31% done 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:96.88% done 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:98.44% done 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestTrashMoveAndPurge (60 ms) 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay 2024-01-13T18:45:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:46.988 INFO:tasks.workunit.client.0.smithi084.stdout:0.00% done 2024-01-13T18:45:46.988 INFO:tasks.workunit.client.0.smithi084.stdout:1.56% done 2024-01-13T18:45:46.988 INFO:tasks.workunit.client.0.smithi084.stdout:3.12% done 2024-01-13T18:45:46.988 INFO:tasks.workunit.client.0.smithi084.stdout:4.69% done 2024-01-13T18:45:46.988 INFO:tasks.workunit.client.0.smithi084.stdout:6.25% done 2024-01-13T18:45:46.988 INFO:tasks.workunit.client.0.smithi084.stdout:7.81% done 2024-01-13T18:45:46.988 INFO:tasks.workunit.client.0.smithi084.stdout:9.38% done 2024-01-13T18:45:46.988 INFO:tasks.workunit.client.0.smithi084.stdout:10.94% done 2024-01-13T18:45:46.988 INFO:tasks.workunit.client.0.smithi084.stdout:12.50% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:14.06% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:15.62% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:17.19% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:18.75% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:20.31% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:21.88% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:23.44% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:25.00% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:26.56% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:28.12% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:29.69% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:31.25% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:32.81% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:34.38% done 2024-01-13T18:45:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:35.94% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:37.50% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:39.06% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:40.62% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:42.19% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:43.75% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:45.31% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:46.88% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:48.44% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:50.00% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:51.56% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:53.12% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:54.69% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:56.25% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:57.81% done 2024-01-13T18:45:46.990 INFO:tasks.workunit.client.0.smithi084.stdout:59.38% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:60.94% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:62.50% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:64.06% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:65.62% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:67.19% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:68.75% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:70.31% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:71.88% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:73.44% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:75.00% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:76.56% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:78.12% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:79.69% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:81.25% done 2024-01-13T18:45:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:82.81% done 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:84.38% done 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:85.94% done 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:87.50% done 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:89.06% done 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:90.62% done 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:92.19% done 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:93.75% done 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:95.31% done 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:96.88% done 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:98.44% done 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestTrashMoveAndPurgeNonExpiredDelay (58 ms) 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestTrashPurge 2024-01-13T18:45:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:46.995 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:47.109 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestTrashPurge (122 ms) 2024-01-13T18:45:47.110 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestTrashMoveAndRestore 2024-01-13T18:45:47.110 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:46 smithi099 ceph-mon[138788]: osdmap e1310: 8 total, 8 up, 8 in 2024-01-13T18:45:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:46 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/3454312159"}]: dispatch 2024-01-13T18:45:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:46 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/3454312159"}]: dispatch 2024-01-13T18:45:47.152 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestTrashMoveAndRestore (42 ms) 2024-01-13T18:45:47.152 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestListWatchers 2024-01-13T18:45:47.152 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:47.174 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestListWatchers (23 ms) 2024-01-13T18:45:47.174 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestSetSnapById 2024-01-13T18:45:47.174 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:46 smithi084 ceph-mon[116404]: osdmap e1310: 8 total, 8 up, 8 in 2024-01-13T18:45:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:46 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/3454312159"}]: dispatch 2024-01-13T18:45:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:46 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/3454312159"}]: dispatch 2024-01-13T18:45:47.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:46 smithi084 ceph-mon[119097]: osdmap e1310: 8 total, 8 up, 8 in 2024-01-13T18:45:47.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:46 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2923135867' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/3454312159"}]: dispatch 2024-01-13T18:45:47.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:46 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/3454312159"}]: dispatch 2024-01-13T18:45:47.843 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestSetSnapById (669 ms) 2024-01-13T18:45:47.843 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.Namespaces 2024-01-13T18:45:47.866 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.Namespaces (23 ms) 2024-01-13T18:45:47.866 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.NamespacesPP 2024-01-13T18:45:47.893 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:47.897 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:47.970 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.NamespacesPP (104 ms) 2024-01-13T18:45:47.970 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.Migration 2024-01-13T18:45:47.970 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:47.970 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:47 smithi099 ceph-mon[138788]: pgmap v2404: 649 pgs: 649 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 52 KiB/s rd, 69 KiB/s wr, 74 op/s 2024-01-13T18:45:48.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:47 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/3454312159"}]': finished 2024-01-13T18:45:48.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:47 smithi099 ceph-mon[138788]: osdmap e1311: 8 total, 8 up, 8 in 2024-01-13T18:45:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:47 smithi084 ceph-mon[116404]: pgmap v2404: 649 pgs: 649 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 52 KiB/s rd, 69 KiB/s wr, 74 op/s 2024-01-13T18:45:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:47 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/3454312159"}]': finished 2024-01-13T18:45:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:47 smithi084 ceph-mon[116404]: osdmap e1311: 8 total, 8 up, 8 in 2024-01-13T18:45:48.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:47 smithi084 ceph-mon[119097]: pgmap v2404: 649 pgs: 649 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 52 KiB/s rd, 69 KiB/s wr, 74 op/s 2024-01-13T18:45:48.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:47 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/3454312159"}]': finished 2024-01-13T18:45:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:47 smithi084 ceph-mon[119097]: osdmap e1311: 8 total, 8 up, 8 in 2024-01-13T18:45:48.348 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.Migration (378 ms) 2024-01-13T18:45:48.349 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.MigrationPP 2024-01-13T18:45:48.349 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:48.349 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:48.753 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.MigrationPP (404 ms) 2024-01-13T18:45:48.753 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestGetAccessTimestamp 2024-01-13T18:45:48.753 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:48.769 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestGetAccessTimestamp (17 ms) 2024-01-13T18:45:48.770 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.TestGetModifyTimestamp 2024-01-13T18:45:48.770 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:48.786 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.TestGetModifyTimestamp (16 ms) 2024-01-13T18:45:48.786 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ZeroOverlapFlatten 2024-01-13T18:45:48.786 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:49.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:48 smithi099 ceph-mon[138788]: osdmap e1312: 8 total, 8 up, 8 in 2024-01-13T18:45:49.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:48 smithi084 ceph-mon[119097]: osdmap e1312: 8 total, 8 up, 8 in 2024-01-13T18:45:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:48 smithi084 ceph-mon[116404]: osdmap e1312: 8 total, 8 up, 8 in 2024-01-13T18:45:49.567 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ZeroOverlapFlatten (781 ms) 2024-01-13T18:45:49.568 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.PoolMetadata 2024-01-13T18:45:49.596 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.PoolMetadata (28 ms) 2024-01-13T18:45:49.596 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.PoolMetadataPP 2024-01-13T18:45:49.613 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.PoolMetadataPP (17 ms) 2024-01-13T18:45:49.613 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.Config 2024-01-13T18:45:49.617 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:49.656 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.Config (43 ms) 2024-01-13T18:45:49.656 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ConfigPP 2024-01-13T18:45:49.660 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:49.695 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ConfigPP (39 ms) 2024-01-13T18:45:49.695 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.PoolStatsPP 2024-01-13T18:45:49.926 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:45:49] ENGINE Bus STOPPING 2024-01-13T18:45:49.926 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:45:49] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:45:49.926 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:45:49] ENGINE Bus STOPPED 2024-01-13T18:45:49.926 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:45:49] ENGINE Bus STARTING 2024-01-13T18:45:49.926 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:45:49] ENGINE Serving on http://:::9283 2024-01-13T18:45:49.926 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:49 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:45:49] ENGINE Bus STARTED 2024-01-13T18:45:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:45:50] "GET /metrics HTTP/1.1" 200 74917 "" "Prometheus/2.43.0" 2024-01-13T18:45:50.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[119097]: pgmap v2407: 649 pgs: 649 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 198 KiB/s rd, 142 KiB/s wr, 300 op/s 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[119097]: osdmap e1313: 8 total, 8 up, 8 in 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[116404]: pgmap v2407: 649 pgs: 649 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 198 KiB/s rd, 142 KiB/s wr, 300 op/s 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[116404]: osdmap e1313: 8 total, 8 up, 8 in 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:45:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:45:50.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:45:50.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:45:50.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:50 smithi099 ceph-mon[138788]: pgmap v2407: 649 pgs: 649 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 198 KiB/s rd, 142 KiB/s wr, 300 op/s 2024-01-13T18:45:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:50 smithi099 ceph-mon[138788]: osdmap e1313: 8 total, 8 up, 8 in 2024-01-13T18:45:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:50 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' 2024-01-13T18:45:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:45:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:45:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:45:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:45:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:45:51.656 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:51 smithi084 ceph-mon[116404]: osdmap e1314: 8 total, 8 up, 8 in 2024-01-13T18:45:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:51 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2682889999' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:45:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:51 smithi084 ceph-mon[119097]: osdmap e1314: 8 total, 8 up, 8 in 2024-01-13T18:45:51.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:51 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2682889999' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:45:52.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:51 smithi099 ceph-mon[138788]: osdmap e1314: 8 total, 8 up, 8 in 2024-01-13T18:45:52.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:51 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2682889999' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:45:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:52 smithi084 ceph-mon[116404]: pgmap v2410: 681 pgs: 32 unknown, 649 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 630 KiB/s rd, 93 KiB/s wr, 752 op/s 2024-01-13T18:45:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:52 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:45:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:52 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2682889999' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:45:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:52 smithi084 ceph-mon[116404]: osdmap e1315: 8 total, 8 up, 8 in 2024-01-13T18:45:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:52 smithi084 ceph-mon[119097]: pgmap v2410: 681 pgs: 32 unknown, 649 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 630 KiB/s rd, 93 KiB/s wr, 752 op/s 2024-01-13T18:45:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:52 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:45:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:52 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2682889999' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:45:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:52 smithi084 ceph-mon[119097]: osdmap e1315: 8 total, 8 up, 8 in 2024-01-13T18:45:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:52 smithi099 ceph-mon[138788]: pgmap v2410: 681 pgs: 32 unknown, 649 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 630 KiB/s rd, 93 KiB/s wr, 752 op/s 2024-01-13T18:45:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:52 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:45:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:52 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2682889999' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:45:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:52 smithi099 ceph-mon[138788]: osdmap e1315: 8 total, 8 up, 8 in 2024-01-13T18:45:53.509 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:53.517 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:53.526 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:53 smithi084 ceph-mon[116404]: osdmap e1316: 8 total, 8 up, 8 in 2024-01-13T18:45:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:53 smithi084 ceph-mon[116404]: osdmap e1317: 8 total, 8 up, 8 in 2024-01-13T18:45:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:53 smithi084 ceph-mon[119097]: osdmap e1316: 8 total, 8 up, 8 in 2024-01-13T18:45:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:53 smithi084 ceph-mon[119097]: osdmap e1317: 8 total, 8 up, 8 in 2024-01-13T18:45:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:53 smithi099 ceph-mon[138788]: osdmap e1316: 8 total, 8 up, 8 in 2024-01-13T18:45:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:53 smithi099 ceph-mon[138788]: osdmap e1317: 8 total, 8 up, 8 in 2024-01-13T18:45:54.563 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.PoolStatsPP (4868 ms) 2024-01-13T18:45:54.563 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ImageSpec 2024-01-13T18:45:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:54 smithi099 ceph-mon[138788]: pgmap v2413: 681 pgs: 19 unknown, 662 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 860 KiB/s rd, 48 KiB/s wr, 1.02k op/s 2024-01-13T18:45:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:54 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:45:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:54 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:45:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:54 smithi099 ceph-mon[138788]: osdmap e1318: 8 total, 8 up, 8 in 2024-01-13T18:45:55.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:54 smithi084 ceph-mon[116404]: pgmap v2413: 681 pgs: 19 unknown, 662 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 860 KiB/s rd, 48 KiB/s wr, 1.02k op/s 2024-01-13T18:45:55.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:54 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:45:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:54 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:45:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:54 smithi084 ceph-mon[116404]: osdmap e1318: 8 total, 8 up, 8 in 2024-01-13T18:45:55.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:54 smithi084 ceph-mon[119097]: pgmap v2413: 681 pgs: 19 unknown, 662 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 860 KiB/s rd, 48 KiB/s wr, 1.02k op/s 2024-01-13T18:45:55.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:54 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:45:55.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:54 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:45:55.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:54 smithi084 ceph-mon[119097]: osdmap e1318: 8 total, 8 up, 8 in 2024-01-13T18:45:56.515 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:45:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:56 smithi099 ceph-mon[138788]: pgmap v2416: 681 pgs: 4 unknown, 677 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 426 KiB/s rd, 37 KiB/s wr, 579 op/s 2024-01-13T18:45:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:56 smithi099 ceph-mon[138788]: osdmap e1319: 8 total, 8 up, 8 in 2024-01-13T18:45:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:56 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2957103802' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:45:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:56 smithi084 ceph-mon[116404]: pgmap v2416: 681 pgs: 4 unknown, 677 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 426 KiB/s rd, 37 KiB/s wr, 579 op/s 2024-01-13T18:45:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:56 smithi084 ceph-mon[116404]: osdmap e1319: 8 total, 8 up, 8 in 2024-01-13T18:45:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:56 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2957103802' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:45:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:56 smithi084 ceph-mon[119097]: pgmap v2416: 681 pgs: 4 unknown, 677 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 426 KiB/s rd, 37 KiB/s wr, 579 op/s 2024-01-13T18:45:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:56 smithi084 ceph-mon[119097]: osdmap e1319: 8 total, 8 up, 8 in 2024-01-13T18:45:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:56 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2957103802' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:45:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:57 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2957103802' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:45:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:57 smithi099 ceph-mon[138788]: osdmap e1320: 8 total, 8 up, 8 in 2024-01-13T18:45:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:57 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2957103802' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:45:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:57 smithi084 ceph-mon[116404]: osdmap e1320: 8 total, 8 up, 8 in 2024-01-13T18:45:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:57 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2957103802' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:45:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:57 smithi084 ceph-mon[119097]: osdmap e1320: 8 total, 8 up, 8 in 2024-01-13T18:45:58.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:58 smithi099 ceph-mon[138788]: pgmap v2419: 713 pgs: 32 unknown, 681 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 7.2 KiB/s wr, 40 op/s 2024-01-13T18:45:58.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:58 smithi099 ceph-mon[138788]: osdmap e1321: 8 total, 8 up, 8 in 2024-01-13T18:45:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:58 smithi084 ceph-mon[116404]: pgmap v2419: 713 pgs: 32 unknown, 681 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 7.2 KiB/s wr, 40 op/s 2024-01-13T18:45:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:58 smithi084 ceph-mon[116404]: osdmap e1321: 8 total, 8 up, 8 in 2024-01-13T18:45:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:58 smithi084 ceph-mon[119097]: pgmap v2419: 713 pgs: 32 unknown, 681 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 7.2 KiB/s wr, 40 op/s 2024-01-13T18:45:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:58 smithi084 ceph-mon[119097]: osdmap e1321: 8 total, 8 up, 8 in 2024-01-13T18:45:59.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:45:59 smithi099 ceph-mon[138788]: osdmap e1322: 8 total, 8 up, 8 in 2024-01-13T18:45:59.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:45:59 smithi084 ceph-mon[116404]: osdmap e1322: 8 total, 8 up, 8 in 2024-01-13T18:45:59.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:45:59 smithi084 ceph-mon[119097]: osdmap e1322: 8 total, 8 up, 8 in 2024-01-13T18:46:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:46:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:46:00] "GET /metrics HTTP/1.1" 200 74917 "" "Prometheus/2.43.0" 2024-01-13T18:46:00.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:00 smithi084 ceph-mon[116404]: pgmap v2422: 713 pgs: 11 unknown, 702 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 44 KiB/s rd, 6.5 KiB/s wr, 60 op/s 2024-01-13T18:46:00.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:00 smithi084 ceph-mon[116404]: osdmap e1323: 8 total, 8 up, 8 in 2024-01-13T18:46:00.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:00 smithi084 ceph-mon[119097]: pgmap v2422: 713 pgs: 11 unknown, 702 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 44 KiB/s rd, 6.5 KiB/s wr, 60 op/s 2024-01-13T18:46:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:00 smithi084 ceph-mon[119097]: osdmap e1323: 8 total, 8 up, 8 in 2024-01-13T18:46:00.681 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ImageSpec (6119 ms) 2024-01-13T18:46:00.681 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.SnapRemoveWithChildMissing 2024-01-13T18:46:00.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:00 smithi099 ceph-mon[138788]: pgmap v2422: 713 pgs: 11 unknown, 702 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 44 KiB/s rd, 6.5 KiB/s wr, 60 op/s 2024-01-13T18:46:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:00 smithi099 ceph-mon[138788]: osdmap e1323: 8 total, 8 up, 8 in 2024-01-13T18:46:01.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:01 smithi099 ceph-mon[138788]: osdmap e1324: 8 total, 8 up, 8 in 2024-01-13T18:46:01.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:01 smithi084 ceph-mon[116404]: osdmap e1324: 8 total, 8 up, 8 in 2024-01-13T18:46:01.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:01 smithi084 ceph-mon[119097]: osdmap e1324: 8 total, 8 up, 8 in 2024-01-13T18:46:02.579 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:46:02.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:02 smithi099 ceph-mon[138788]: pgmap v2425: 713 pgs: 713 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 39 KiB/s rd, 4.0 KiB/s wr, 51 op/s 2024-01-13T18:46:02.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:02 smithi099 ceph-mon[138788]: osdmap e1325: 8 total, 8 up, 8 in 2024-01-13T18:46:02.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:02 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/128563994' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:46:02.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:02 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:46:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:02 smithi084 ceph-mon[116404]: pgmap v2425: 713 pgs: 713 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 39 KiB/s rd, 4.0 KiB/s wr, 51 op/s 2024-01-13T18:46:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:02 smithi084 ceph-mon[116404]: osdmap e1325: 8 total, 8 up, 8 in 2024-01-13T18:46:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:02 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/128563994' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:46:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:02 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:46:02.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:02 smithi084 ceph-mon[119097]: pgmap v2425: 713 pgs: 713 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 39 KiB/s rd, 4.0 KiB/s wr, 51 op/s 2024-01-13T18:46:02.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:02 smithi084 ceph-mon[119097]: osdmap e1325: 8 total, 8 up, 8 in 2024-01-13T18:46:02.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:02 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/128563994' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:46:02.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:02 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:46:03.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:03 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:46:03.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:03 smithi099 ceph-mon[138788]: osdmap e1326: 8 total, 8 up, 8 in 2024-01-13T18:46:03.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:03 smithi099 ceph-mon[138788]: osdmap e1327: 8 total, 8 up, 8 in 2024-01-13T18:46:03.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:03 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:46:03.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:03 smithi084 ceph-mon[116404]: osdmap e1326: 8 total, 8 up, 8 in 2024-01-13T18:46:03.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:03 smithi084 ceph-mon[116404]: osdmap e1327: 8 total, 8 up, 8 in 2024-01-13T18:46:03.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:03 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:46:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:03 smithi084 ceph-mon[119097]: osdmap e1326: 8 total, 8 up, 8 in 2024-01-13T18:46:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:03 smithi084 ceph-mon[119097]: osdmap e1327: 8 total, 8 up, 8 in 2024-01-13T18:46:04.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:04 smithi099 ceph-mon[138788]: pgmap v2428: 745 pgs: 14 creating+peering, 18 unknown, 713 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 53 KiB/s rd, 3.0 KiB/s wr, 69 op/s 2024-01-13T18:46:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:04 smithi099 ceph-mon[138788]: osdmap e1328: 8 total, 8 up, 8 in 2024-01-13T18:46:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:04 smithi084 ceph-mon[116404]: pgmap v2428: 745 pgs: 14 creating+peering, 18 unknown, 713 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 53 KiB/s rd, 3.0 KiB/s wr, 69 op/s 2024-01-13T18:46:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:04 smithi084 ceph-mon[116404]: osdmap e1328: 8 total, 8 up, 8 in 2024-01-13T18:46:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:04 smithi084 ceph-mon[119097]: pgmap v2428: 745 pgs: 14 creating+peering, 18 unknown, 713 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 53 KiB/s rd, 3.0 KiB/s wr, 69 op/s 2024-01-13T18:46:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:04 smithi084 ceph-mon[119097]: osdmap e1328: 8 total, 8 up, 8 in 2024-01-13T18:46:05.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:05 smithi099 ceph-mon[138788]: osdmap e1329: 8 total, 8 up, 8 in 2024-01-13T18:46:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:05 smithi084 ceph-mon[116404]: osdmap e1329: 8 total, 8 up, 8 in 2024-01-13T18:46:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:05 smithi084 ceph-mon[119097]: osdmap e1329: 8 total, 8 up, 8 in 2024-01-13T18:46:06.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:06 smithi099 ceph-mon[138788]: pgmap v2431: 745 pgs: 14 creating+peering, 8 unknown, 723 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 116 KiB/s rd, 4.5 KiB/s wr, 147 op/s 2024-01-13T18:46:06.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:06 smithi099 ceph-mon[138788]: osdmap e1330: 8 total, 8 up, 8 in 2024-01-13T18:46:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:06 smithi084 ceph-mon[116404]: pgmap v2431: 745 pgs: 14 creating+peering, 8 unknown, 723 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 116 KiB/s rd, 4.5 KiB/s wr, 147 op/s 2024-01-13T18:46:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:06 smithi084 ceph-mon[116404]: osdmap e1330: 8 total, 8 up, 8 in 2024-01-13T18:46:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:06 smithi084 ceph-mon[119097]: pgmap v2431: 745 pgs: 14 creating+peering, 8 unknown, 723 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 116 KiB/s rd, 4.5 KiB/s wr, 147 op/s 2024-01-13T18:46:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:06 smithi084 ceph-mon[119097]: osdmap e1330: 8 total, 8 up, 8 in 2024-01-13T18:46:08.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:08 smithi099 ceph-mon[138788]: pgmap v2434: 745 pgs: 14 creating+peering, 731 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 86 KiB/s rd, 3.2 KiB/s wr, 106 op/s 2024-01-13T18:46:08.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:08 smithi099 ceph-mon[138788]: osdmap e1331: 8 total, 8 up, 8 in 2024-01-13T18:46:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:08 smithi099 ceph-mon[138788]: osdmap e1332: 8 total, 8 up, 8 in 2024-01-13T18:46:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:08 smithi084 ceph-mon[116404]: pgmap v2434: 745 pgs: 14 creating+peering, 731 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 86 KiB/s rd, 3.2 KiB/s wr, 106 op/s 2024-01-13T18:46:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:08 smithi084 ceph-mon[116404]: osdmap e1331: 8 total, 8 up, 8 in 2024-01-13T18:46:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:08 smithi084 ceph-mon[116404]: osdmap e1332: 8 total, 8 up, 8 in 2024-01-13T18:46:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:08 smithi084 ceph-mon[119097]: pgmap v2434: 745 pgs: 14 creating+peering, 731 active+clean; 152 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 86 KiB/s rd, 3.2 KiB/s wr, 106 op/s 2024-01-13T18:46:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:08 smithi084 ceph-mon[119097]: osdmap e1331: 8 total, 8 up, 8 in 2024-01-13T18:46:08.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:08 smithi084 ceph-mon[119097]: osdmap e1332: 8 total, 8 up, 8 in 2024-01-13T18:46:09.634 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 3 2024-01-13T18:46:09.634 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 3 2024-01-13T18:46:09.634 INFO:tasks.workunit.client.0.smithi084.stdout:child: image201 2024-01-13T18:46:09.634 INFO:tasks.workunit.client.0.smithi084.stdout:child: image203 2024-01-13T18:46:09.634 INFO:tasks.workunit.client.0.smithi084.stdout:child: image202 2024-01-13T18:46:09.634 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-1/image201/b186c9bc656 2024-01-13T18:46:09.635 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:46:09.635 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-20/image202/b18626462bb9 2024-01-13T18:46:09.635 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:46:09.635 INFO:tasks.workunit.client.0.smithi084.stdout:found child test-librbd-smithi084-180317-1/image203/b18618c2e6eb 2024-01-13T18:46:09.635 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:46:09.635 INFO:tasks.workunit.client.0.smithi084.stdout:num children is: 0 2024-01-13T18:46:09.635 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 0 2024-01-13T18:46:09.635 INFO:tasks.workunit.client.0.smithi084.stdout:num snaps is: 0 2024-01-13T18:46:09.635 INFO:tasks.workunit.client.0.smithi084.stdout:expected: 0 2024-01-13T18:46:09.635 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.SnapRemoveWithChildMissing (8953 ms) 2024-01-13T18:46:09.635 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.QuiesceWatch 2024-01-13T18:46:10.593 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:46:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:46:10] "GET /metrics HTTP/1.1" 200 82095 "" "Prometheus/2.43.0" 2024-01-13T18:46:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:10 smithi099 ceph-mon[138788]: pgmap v2437: 713 pgs: 713 active+clean; 6.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:46:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:10 smithi099 ceph-mon[138788]: osdmap e1333: 8 total, 8 up, 8 in 2024-01-13T18:46:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:10 smithi084 ceph-mon[119097]: pgmap v2437: 713 pgs: 713 active+clean; 6.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:46:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:10 smithi084 ceph-mon[119097]: osdmap e1333: 8 total, 8 up, 8 in 2024-01-13T18:46:10.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:10 smithi084 ceph-mon[116404]: pgmap v2437: 713 pgs: 713 active+clean; 6.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:46:10.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:10 smithi084 ceph-mon[116404]: osdmap e1333: 8 total, 8 up, 8 in 2024-01-13T18:46:11.640 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:46:11.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:11 smithi099 ceph-mon[138788]: osdmap e1334: 8 total, 8 up, 8 in 2024-01-13T18:46:11.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:11 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/973546954' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:46:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:11 smithi084 ceph-mon[116404]: osdmap e1334: 8 total, 8 up, 8 in 2024-01-13T18:46:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:11 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/973546954' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:46:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:11 smithi084 ceph-mon[119097]: osdmap e1334: 8 total, 8 up, 8 in 2024-01-13T18:46:11.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:11 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/973546954' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:46:12.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:12 smithi099 ceph-mon[138788]: pgmap v2440: 745 pgs: 32 unknown, 713 active+clean; 6.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:46:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:12 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:46:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:12 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/973546954' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:46:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:12 smithi099 ceph-mon[138788]: osdmap e1335: 8 total, 8 up, 8 in 2024-01-13T18:46:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:12 smithi084 ceph-mon[116404]: pgmap v2440: 745 pgs: 32 unknown, 713 active+clean; 6.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:46:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:12 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:46:12.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:12 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/973546954' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:46:12.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:12 smithi084 ceph-mon[116404]: osdmap e1335: 8 total, 8 up, 8 in 2024-01-13T18:46:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:12 smithi084 ceph-mon[119097]: pgmap v2440: 745 pgs: 32 unknown, 713 active+clean; 6.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:46:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:12 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:46:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:12 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/973546954' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:46:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:12 smithi084 ceph-mon[119097]: osdmap e1335: 8 total, 8 up, 8 in 2024-01-13T18:46:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:13 smithi084 ceph-mon[116404]: osdmap e1336: 8 total, 8 up, 8 in 2024-01-13T18:46:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:13 smithi084 ceph-mon[116404]: osdmap e1337: 8 total, 8 up, 8 in 2024-01-13T18:46:13.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:13 smithi084 ceph-mon[119097]: osdmap e1336: 8 total, 8 up, 8 in 2024-01-13T18:46:13.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:13 smithi084 ceph-mon[119097]: osdmap e1337: 8 total, 8 up, 8 in 2024-01-13T18:46:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:13 smithi099 ceph-mon[138788]: osdmap e1336: 8 total, 8 up, 8 in 2024-01-13T18:46:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:13 smithi099 ceph-mon[138788]: osdmap e1337: 8 total, 8 up, 8 in 2024-01-13T18:46:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:14 smithi084 ceph-mon[116404]: pgmap v2443: 745 pgs: 21 unknown, 724 active+clean; 6.6 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 61 KiB/s rd, 3.7 KiB/s wr, 79 op/s 2024-01-13T18:46:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:14 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:46:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:14 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:46:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:14 smithi084 ceph-mon[116404]: osdmap e1338: 8 total, 8 up, 8 in 2024-01-13T18:46:14.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:14 smithi084 ceph-mon[119097]: pgmap v2443: 745 pgs: 21 unknown, 724 active+clean; 6.6 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 61 KiB/s rd, 3.7 KiB/s wr, 79 op/s 2024-01-13T18:46:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:14 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:46:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:14 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:46:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:14 smithi084 ceph-mon[119097]: osdmap e1338: 8 total, 8 up, 8 in 2024-01-13T18:46:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:14 smithi099 ceph-mon[138788]: pgmap v2443: 745 pgs: 21 unknown, 724 active+clean; 6.6 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 61 KiB/s rd, 3.7 KiB/s wr, 79 op/s 2024-01-13T18:46:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:14 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:46:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:14 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:46:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:14 smithi099 ceph-mon[138788]: osdmap e1338: 8 total, 8 up, 8 in 2024-01-13T18:46:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:16 smithi099 ceph-mon[138788]: pgmap v2446: 745 pgs: 7 unknown, 738 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 31 KiB/s rd, 3.2 KiB/s wr, 44 op/s 2024-01-13T18:46:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:16 smithi099 ceph-mon[138788]: osdmap e1339: 8 total, 8 up, 8 in 2024-01-13T18:46:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:16 smithi084 ceph-mon[116404]: pgmap v2446: 745 pgs: 7 unknown, 738 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 31 KiB/s rd, 3.2 KiB/s wr, 44 op/s 2024-01-13T18:46:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:16 smithi084 ceph-mon[116404]: osdmap e1339: 8 total, 8 up, 8 in 2024-01-13T18:46:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:16 smithi084 ceph-mon[119097]: pgmap v2446: 745 pgs: 7 unknown, 738 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 31 KiB/s rd, 3.2 KiB/s wr, 44 op/s 2024-01-13T18:46:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:16 smithi084 ceph-mon[119097]: osdmap e1339: 8 total, 8 up, 8 in 2024-01-13T18:46:17.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:17 smithi099 ceph-mon[138788]: osdmap e1340: 8 total, 8 up, 8 in 2024-01-13T18:46:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:17 smithi084 ceph-mon[116404]: osdmap e1340: 8 total, 8 up, 8 in 2024-01-13T18:46:17.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:17 smithi084 ceph-mon[119097]: osdmap e1340: 8 total, 8 up, 8 in 2024-01-13T18:46:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:18 smithi099 ceph-mon[138788]: pgmap v2449: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 24 KiB/s rd, 1.7 KiB/s wr, 32 op/s 2024-01-13T18:46:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:18 smithi099 ceph-mon[138788]: osdmap e1341: 8 total, 8 up, 8 in 2024-01-13T18:46:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:18 smithi099 ceph-mon[138788]: osdmap e1342: 8 total, 8 up, 8 in 2024-01-13T18:46:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:18 smithi084 ceph-mon[119097]: pgmap v2449: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 24 KiB/s rd, 1.7 KiB/s wr, 32 op/s 2024-01-13T18:46:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:18 smithi084 ceph-mon[119097]: osdmap e1341: 8 total, 8 up, 8 in 2024-01-13T18:46:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:18 smithi084 ceph-mon[119097]: osdmap e1342: 8 total, 8 up, 8 in 2024-01-13T18:46:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:18 smithi084 ceph-mon[116404]: pgmap v2449: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 24 KiB/s rd, 1.7 KiB/s wr, 32 op/s 2024-01-13T18:46:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:18 smithi084 ceph-mon[116404]: osdmap e1341: 8 total, 8 up, 8 in 2024-01-13T18:46:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:18 smithi084 ceph-mon[116404]: osdmap e1342: 8 total, 8 up, 8 in 2024-01-13T18:46:19.626 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.QuiesceWatch (9992 ms) 2024-01-13T18:46:19.626 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.QuiesceWatchPP 2024-01-13T18:46:19.627 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:46:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:46:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:46:20] "GET /metrics HTTP/1.1" 200 82102 "" "Prometheus/2.43.0" 2024-01-13T18:46:20.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:20 smithi084 ceph-mon[116404]: pgmap v2452: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 25 KiB/s rd, 2.2 KiB/s wr, 33 op/s 2024-01-13T18:46:20.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:20 smithi084 ceph-mon[116404]: osdmap e1343: 8 total, 8 up, 8 in 2024-01-13T18:46:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:20 smithi084 ceph-mon[119097]: pgmap v2452: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 25 KiB/s rd, 2.2 KiB/s wr, 33 op/s 2024-01-13T18:46:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:20 smithi084 ceph-mon[119097]: osdmap e1343: 8 total, 8 up, 8 in 2024-01-13T18:46:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:20.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:20 smithi099 ceph-mon[138788]: pgmap v2452: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 25 KiB/s rd, 2.2 KiB/s wr, 33 op/s 2024-01-13T18:46:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:20 smithi099 ceph-mon[138788]: osdmap e1343: 8 total, 8 up, 8 in 2024-01-13T18:46:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:21.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:21 smithi099 ceph-mon[138788]: osdmap e1344: 8 total, 8 up, 8 in 2024-01-13T18:46:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:21 smithi084 ceph-mon[116404]: osdmap e1344: 8 total, 8 up, 8 in 2024-01-13T18:46:21.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:21 smithi084 ceph-mon[119097]: osdmap e1344: 8 total, 8 up, 8 in 2024-01-13T18:46:22.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:22 smithi099 ceph-mon[138788]: pgmap v2455: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 60 KiB/s rd, 5.2 KiB/s wr, 83 op/s 2024-01-13T18:46:22.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:22 smithi099 ceph-mon[138788]: osdmap e1345: 8 total, 8 up, 8 in 2024-01-13T18:46:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:22 smithi084 ceph-mon[119097]: pgmap v2455: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 60 KiB/s rd, 5.2 KiB/s wr, 83 op/s 2024-01-13T18:46:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:22 smithi084 ceph-mon[119097]: osdmap e1345: 8 total, 8 up, 8 in 2024-01-13T18:46:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:22 smithi084 ceph-mon[116404]: pgmap v2455: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 60 KiB/s rd, 5.2 KiB/s wr, 83 op/s 2024-01-13T18:46:22.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:22 smithi084 ceph-mon[116404]: osdmap e1345: 8 total, 8 up, 8 in 2024-01-13T18:46:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:23 smithi099 ceph-mon[138788]: osdmap e1346: 8 total, 8 up, 8 in 2024-01-13T18:46:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:23 smithi099 ceph-mon[138788]: osdmap e1347: 8 total, 8 up, 8 in 2024-01-13T18:46:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:23 smithi084 ceph-mon[116404]: osdmap e1346: 8 total, 8 up, 8 in 2024-01-13T18:46:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:23 smithi084 ceph-mon[116404]: osdmap e1347: 8 total, 8 up, 8 in 2024-01-13T18:46:23.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:23 smithi084 ceph-mon[119097]: osdmap e1346: 8 total, 8 up, 8 in 2024-01-13T18:46:23.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:23 smithi084 ceph-mon[119097]: osdmap e1347: 8 total, 8 up, 8 in 2024-01-13T18:46:24.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:24 smithi099 ceph-mon[138788]: pgmap v2458: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 91 KiB/s rd, 5.5 KiB/s wr, 120 op/s 2024-01-13T18:46:24.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:24 smithi099 ceph-mon[138788]: osdmap e1348: 8 total, 8 up, 8 in 2024-01-13T18:46:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:24 smithi084 ceph-mon[116404]: pgmap v2458: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 91 KiB/s rd, 5.5 KiB/s wr, 120 op/s 2024-01-13T18:46:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:24 smithi084 ceph-mon[116404]: osdmap e1348: 8 total, 8 up, 8 in 2024-01-13T18:46:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:24 smithi084 ceph-mon[119097]: pgmap v2458: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 91 KiB/s rd, 5.5 KiB/s wr, 120 op/s 2024-01-13T18:46:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:24 smithi084 ceph-mon[119097]: osdmap e1348: 8 total, 8 up, 8 in 2024-01-13T18:46:25.615 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.QuiesceWatchPP (5989 ms) 2024-01-13T18:46:25.615 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.QuiesceWatchError 2024-01-13T18:46:25.615 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:46:26.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:26 smithi099 ceph-mon[138788]: pgmap v2461: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 39 KiB/s rd, 2.5 KiB/s wr, 51 op/s 2024-01-13T18:46:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:26 smithi099 ceph-mon[138788]: osdmap e1349: 8 total, 8 up, 8 in 2024-01-13T18:46:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:26 smithi084 ceph-mon[116404]: pgmap v2461: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 39 KiB/s rd, 2.5 KiB/s wr, 51 op/s 2024-01-13T18:46:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:26 smithi084 ceph-mon[116404]: osdmap e1349: 8 total, 8 up, 8 in 2024-01-13T18:46:26.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:26 smithi084 ceph-mon[119097]: pgmap v2461: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 39 KiB/s rd, 2.5 KiB/s wr, 51 op/s 2024-01-13T18:46:26.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:26 smithi084 ceph-mon[119097]: osdmap e1349: 8 total, 8 up, 8 in 2024-01-13T18:46:27.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:27 smithi099 ceph-mon[138788]: osdmap e1350: 8 total, 8 up, 8 in 2024-01-13T18:46:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:27 smithi084 ceph-mon[116404]: osdmap e1350: 8 total, 8 up, 8 in 2024-01-13T18:46:27.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:27 smithi084 ceph-mon[119097]: osdmap e1350: 8 total, 8 up, 8 in 2024-01-13T18:46:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:28 smithi099 ceph-mon[138788]: pgmap v2464: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-01-13T18:46:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:28 smithi099 ceph-mon[138788]: osdmap e1351: 8 total, 8 up, 8 in 2024-01-13T18:46:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:28 smithi099 ceph-mon[138788]: osdmap e1352: 8 total, 8 up, 8 in 2024-01-13T18:46:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:28 smithi084 ceph-mon[116404]: pgmap v2464: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-01-13T18:46:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:28 smithi084 ceph-mon[116404]: osdmap e1351: 8 total, 8 up, 8 in 2024-01-13T18:46:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:28 smithi084 ceph-mon[116404]: osdmap e1352: 8 total, 8 up, 8 in 2024-01-13T18:46:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:28 smithi084 ceph-mon[119097]: pgmap v2464: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-01-13T18:46:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:28 smithi084 ceph-mon[119097]: osdmap e1351: 8 total, 8 up, 8 in 2024-01-13T18:46:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:28 smithi084 ceph-mon[119097]: osdmap e1352: 8 total, 8 up, 8 in 2024-01-13T18:46:30.605 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:46:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:46:30] "GET /metrics HTTP/1.1" 200 82102 "" "Prometheus/2.43.0" 2024-01-13T18:46:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:30 smithi099 ceph-mon[138788]: pgmap v2467: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 89 KiB/s rd, 7.0 KiB/s wr, 120 op/s 2024-01-13T18:46:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:30 smithi099 ceph-mon[138788]: osdmap e1353: 8 total, 8 up, 8 in 2024-01-13T18:46:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:30 smithi084 ceph-mon[116404]: pgmap v2467: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 89 KiB/s rd, 7.0 KiB/s wr, 120 op/s 2024-01-13T18:46:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:30 smithi084 ceph-mon[116404]: osdmap e1353: 8 total, 8 up, 8 in 2024-01-13T18:46:30.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:30 smithi084 ceph-mon[119097]: pgmap v2467: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 89 KiB/s rd, 7.0 KiB/s wr, 120 op/s 2024-01-13T18:46:30.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:30 smithi084 ceph-mon[119097]: osdmap e1353: 8 total, 8 up, 8 in 2024-01-13T18:46:31.713 INFO:tasks.workunit.client.0.smithi084.stdout:10.00% done 2024-01-13T18:46:31.713 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.QuiesceWatchError (6097 ms) 2024-01-13T18:46:31.713 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.QuiesceWatchTimeout 2024-01-13T18:46:31.713 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:46:31.731 INFO:tasks.workunit.client.0.smithi084.stderr:test quiesce is not long enough to time out 2024-01-13T18:46:31.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:31 smithi099 ceph-mon[138788]: osdmap e1354: 8 total, 8 up, 8 in 2024-01-13T18:46:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:31 smithi084 ceph-mon[116404]: osdmap e1354: 8 total, 8 up, 8 in 2024-01-13T18:46:31.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:31 smithi084 ceph-mon[119097]: osdmap e1354: 8 total, 8 up, 8 in 2024-01-13T18:46:32.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:32 smithi099 ceph-mon[138788]: pgmap v2470: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 6.5 KiB/s wr, 118 op/s 2024-01-13T18:46:32.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:32 smithi099 ceph-mon[138788]: osdmap e1355: 8 total, 8 up, 8 in 2024-01-13T18:46:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:32 smithi084 ceph-mon[116404]: pgmap v2470: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 6.5 KiB/s wr, 118 op/s 2024-01-13T18:46:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:32 smithi084 ceph-mon[116404]: osdmap e1355: 8 total, 8 up, 8 in 2024-01-13T18:46:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:32 smithi084 ceph-mon[119097]: pgmap v2470: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 6.5 KiB/s wr, 118 op/s 2024-01-13T18:46:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:32 smithi084 ceph-mon[119097]: osdmap e1355: 8 total, 8 up, 8 in 2024-01-13T18:46:34.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:34 smithi099 ceph-mon[138788]: pgmap v2472: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 10 KiB/s rd, 1.2 KiB/s wr, 18 op/s 2024-01-13T18:46:34.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:34 smithi099 ceph-mon[138788]: osdmap e1356: 8 total, 8 up, 8 in 2024-01-13T18:46:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:34 smithi084 ceph-mon[116404]: pgmap v2472: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 10 KiB/s rd, 1.2 KiB/s wr, 18 op/s 2024-01-13T18:46:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:34 smithi084 ceph-mon[116404]: osdmap e1356: 8 total, 8 up, 8 in 2024-01-13T18:46:34.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:34 smithi084 ceph-mon[119097]: pgmap v2472: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 10 KiB/s rd, 1.2 KiB/s wr, 18 op/s 2024-01-13T18:46:34.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:34 smithi084 ceph-mon[119097]: osdmap e1356: 8 total, 8 up, 8 in 2024-01-13T18:46:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:36.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:36 smithi099 ceph-mon[138788]: pgmap v2474: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 50 KiB/s rd, 4.7 KiB/s wr, 70 op/s 2024-01-13T18:46:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:36 smithi084 ceph-mon[116404]: pgmap v2474: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 50 KiB/s rd, 4.7 KiB/s wr, 70 op/s 2024-01-13T18:46:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:36 smithi084 ceph-mon[119097]: pgmap v2474: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 50 KiB/s rd, 4.7 KiB/s wr, 70 op/s 2024-01-13T18:46:38.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:38 smithi099 ceph-mon[138788]: pgmap v2475: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 41 KiB/s rd, 3.8 KiB/s wr, 57 op/s 2024-01-13T18:46:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:38 smithi084 ceph-mon[116404]: pgmap v2475: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 41 KiB/s rd, 3.8 KiB/s wr, 57 op/s 2024-01-13T18:46:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:38 smithi084 ceph-mon[119097]: pgmap v2475: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 41 KiB/s rd, 3.8 KiB/s wr, 57 op/s 2024-01-13T18:46:39.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:39 smithi099 ceph-mon[138788]: osdmap e1357: 8 total, 8 up, 8 in 2024-01-13T18:46:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:39 smithi084 ceph-mon[116404]: osdmap e1357: 8 total, 8 up, 8 in 2024-01-13T18:46:39.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:39 smithi084 ceph-mon[119097]: osdmap e1357: 8 total, 8 up, 8 in 2024-01-13T18:46:40.546 INFO:tasks.workunit.client.0.smithi084.stderr:test quiesce is timed out 2024-01-13T18:46:40.549 INFO:tasks.workunit.client.0.smithi084.stderr:waiting for timed out ... 0 2024-01-13T18:46:40.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:40 smithi084 ceph-mon[116404]: pgmap v2477: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 36 KiB/s rd, 3.2 KiB/s wr, 49 op/s 2024-01-13T18:46:40.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:40 smithi084 ceph-mon[119097]: pgmap v2477: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 36 KiB/s rd, 3.2 KiB/s wr, 49 op/s 2024-01-13T18:46:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:46:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:46:40] "GET /metrics HTTP/1.1" 200 82098 "" "Prometheus/2.43.0" 2024-01-13T18:46:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:40 smithi099 ceph-mon[138788]: pgmap v2477: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 36 KiB/s rd, 3.2 KiB/s wr, 49 op/s 2024-01-13T18:46:41.549 INFO:tasks.workunit.client.0.smithi084.stderr:waiting for timed out ... 1 2024-01-13T18:46:41.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:41 smithi099 ceph-mon[138788]: osdmap e1358: 8 total, 8 up, 8 in 2024-01-13T18:46:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:41 smithi084 ceph-mon[116404]: osdmap e1358: 8 total, 8 up, 8 in 2024-01-13T18:46:41.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:41 smithi084 ceph-mon[119097]: osdmap e1358: 8 total, 8 up, 8 in 2024-01-13T18:46:42.549 INFO:tasks.workunit.client.0.smithi084.stderr:waiting for timed out ... 2 2024-01-13T18:46:42.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:42 smithi099 ceph-mon[138788]: pgmap v2479: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 989 B/s rd, 141 B/s wr, 1 op/s 2024-01-13T18:46:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:42 smithi084 ceph-mon[116404]: pgmap v2479: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 989 B/s rd, 141 B/s wr, 1 op/s 2024-01-13T18:46:42.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:42 smithi084 ceph-mon[119097]: pgmap v2479: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 989 B/s rd, 141 B/s wr, 1 op/s 2024-01-13T18:46:43.549 INFO:tasks.workunit.client.0.smithi084.stderr:waiting for timed out ... 3 2024-01-13T18:46:44.549 INFO:tasks.workunit.client.0.smithi084.stderr:waiting for timed out ... 4 2024-01-13T18:46:44.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:44 smithi099 ceph-mon[138788]: pgmap v2480: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-01-13T18:46:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:44 smithi084 ceph-mon[116404]: pgmap v2480: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-01-13T18:46:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:44 smithi084 ceph-mon[119097]: pgmap v2480: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-01-13T18:46:45.550 INFO:tasks.workunit.client.0.smithi084.stderr:waiting for timed out ... 5 2024-01-13T18:46:46.549 INFO:tasks.workunit.client.0.smithi084.stderr:waiting for timed out ... 6 2024-01-13T18:46:46.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:46 smithi099 ceph-mon[138788]: pgmap v2481: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-01-13T18:46:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:46 smithi084 ceph-mon[116404]: pgmap v2481: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-01-13T18:46:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:46 smithi084 ceph-mon[119097]: pgmap v2481: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-01-13T18:46:47.549 INFO:tasks.workunit.client.0.smithi084.stderr:waiting for timed out ... 7 2024-01-13T18:46:48.550 INFO:tasks.workunit.client.0.smithi084.stderr:waiting for timed out ... 8 2024-01-13T18:46:48.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:48 smithi099 ceph-mon[138788]: pgmap v2482: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.5 KiB/s rd, 372 B/s wr, 4 op/s 2024-01-13T18:46:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:48 smithi084 ceph-mon[116404]: pgmap v2482: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.5 KiB/s rd, 372 B/s wr, 4 op/s 2024-01-13T18:46:48.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:48 smithi084 ceph-mon[119097]: pgmap v2482: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 3.5 KiB/s rd, 372 B/s wr, 4 op/s 2024-01-13T18:46:49.550 INFO:tasks.workunit.client.0.smithi084.stderr:waiting for timed out ... 9 2024-01-13T18:46:50.550 INFO:tasks.workunit.client.0.smithi084.stderr:waiting for timed out ... 10 2024-01-13T18:46:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:46:50] "GET /metrics HTTP/1.1" 200 82110 "" "Prometheus/2.43.0" 2024-01-13T18:46:50.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[116404]: pgmap v2483: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.9 KiB/s rd, 307 B/s wr, 3 op/s 2024-01-13T18:46:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:46:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:46:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:46:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[119097]: pgmap v2483: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.9 KiB/s rd, 307 B/s wr, 3 op/s 2024-01-13T18:46:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:46:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:46:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:46:50.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:50 smithi099 ceph-mon[138788]: pgmap v2483: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.9 KiB/s rd, 307 B/s wr, 3 op/s 2024-01-13T18:46:50.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:46:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:46:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:46:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:46:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:46:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:52 smithi099 ceph-mon[138788]: pgmap v2484: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.8 KiB/s rd, 300 B/s wr, 3 op/s 2024-01-13T18:46:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.b", "id": [1, 4]}]: dispatch 2024-01-13T18:46:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "96.1c", "id": [0, 3]}]: dispatch 2024-01-13T18:46:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "97.e", "id": [0, 7]}]: dispatch 2024-01-13T18:46:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:52 smithi084 ceph-mon[119097]: pgmap v2484: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.8 KiB/s rd, 300 B/s wr, 3 op/s 2024-01-13T18:46:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.b", "id": [1, 4]}]: dispatch 2024-01-13T18:46:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "96.1c", "id": [0, 3]}]: dispatch 2024-01-13T18:46:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "97.e", "id": [0, 7]}]: dispatch 2024-01-13T18:46:52.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:52 smithi084 ceph-mon[116404]: pgmap v2484: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 2.8 KiB/s rd, 300 B/s wr, 3 op/s 2024-01-13T18:46:52.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.b", "id": [1, 4]}]: dispatch 2024-01-13T18:46:52.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "96.1c", "id": [0, 3]}]: dispatch 2024-01-13T18:46:52.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "97.e", "id": [0, 7]}]: dispatch 2024-01-13T18:46:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.b", "id": [1, 4]}]': finished 2024-01-13T18:46:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "96.1c", "id": [0, 3]}]': finished 2024-01-13T18:46:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "97.e", "id": [0, 7]}]': finished 2024-01-13T18:46:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:53 smithi099 ceph-mon[138788]: osdmap e1359: 8 total, 8 up, 8 in 2024-01-13T18:46:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.b", "id": [1, 4]}]': finished 2024-01-13T18:46:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "96.1c", "id": [0, 3]}]': finished 2024-01-13T18:46:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "97.e", "id": [0, 7]}]': finished 2024-01-13T18:46:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:53 smithi084 ceph-mon[119097]: osdmap e1359: 8 total, 8 up, 8 in 2024-01-13T18:46:53.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.b", "id": [1, 4]}]': finished 2024-01-13T18:46:53.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "96.1c", "id": [0, 3]}]': finished 2024-01-13T18:46:53.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "97.e", "id": [0, 7]}]': finished 2024-01-13T18:46:53.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:53 smithi084 ceph-mon[116404]: osdmap e1359: 8 total, 8 up, 8 in 2024-01-13T18:46:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:54 smithi099 ceph-mon[138788]: pgmap v2486: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-01-13T18:46:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:54 smithi099 ceph-mon[138788]: osdmap e1360: 8 total, 8 up, 8 in 2024-01-13T18:46:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:54 smithi084 ceph-mon[116404]: pgmap v2486: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-01-13T18:46:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:54 smithi084 ceph-mon[116404]: osdmap e1360: 8 total, 8 up, 8 in 2024-01-13T18:46:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:54 smithi084 ceph-mon[119097]: pgmap v2486: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-01-13T18:46:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:54 smithi084 ceph-mon[119097]: osdmap e1360: 8 total, 8 up, 8 in 2024-01-13T18:46:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:56 smithi099 ceph-mon[138788]: pgmap v2488: 745 pgs: 1 peering, 744 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:46:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:56 smithi084 ceph-mon[116404]: pgmap v2488: 745 pgs: 1 peering, 744 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:46:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:56 smithi084 ceph-mon[119097]: pgmap v2488: 745 pgs: 1 peering, 744 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:46:58.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:46:58 smithi099 ceph-mon[138788]: pgmap v2489: 745 pgs: 1 peering, 744 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:46:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:46:58 smithi084 ceph-mon[116404]: pgmap v2489: 745 pgs: 1 peering, 744 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:46:58.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:46:58 smithi084 ceph-mon[119097]: pgmap v2489: 745 pgs: 1 peering, 744 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:47:00.563 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:47:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:47:00] "GET /metrics HTTP/1.1" 200 82110 "" "Prometheus/2.43.0" 2024-01-13T18:47:00.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:00 smithi099 ceph-mon[138788]: pgmap v2490: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:47:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:00 smithi084 ceph-mon[116404]: pgmap v2490: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:47:00.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:00 smithi084 ceph-mon[119097]: pgmap v2490: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:47:01.550 INFO:tasks.workunit.client.0.smithi084.stderr:test retry succeeds 2024-01-13T18:47:02.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:02 smithi099 ceph-mon[138788]: pgmap v2491: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:47:02.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:02 smithi099 ceph-mon[138788]: osdmap e1361: 8 total, 8 up, 8 in 2024-01-13T18:47:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:02 smithi084 ceph-mon[116404]: pgmap v2491: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:47:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:02 smithi084 ceph-mon[116404]: osdmap e1361: 8 total, 8 up, 8 in 2024-01-13T18:47:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:02 smithi084 ceph-mon[119097]: pgmap v2491: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-01-13T18:47:02.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:02 smithi084 ceph-mon[119097]: osdmap e1361: 8 total, 8 up, 8 in 2024-01-13T18:47:03.686 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.QuiesceWatchTimeout (31973 ms) 2024-01-13T18:47:03.686 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.WriteZeroes 2024-01-13T18:47:03.686 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:47:03.751 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.WriteZeroes (66 ms) 2024-01-13T18:47:03.751 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.WriteZeroesThickProvision 2024-01-13T18:47:03.751 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:47:03.816 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.WriteZeroesThickProvision (65 ms) 2024-01-13T18:47:03.816 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestLibRBD.ConcurentOperations 2024-01-13T18:47:03.816 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:47:03.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:03 smithi099 ceph-mon[138788]: osdmap e1362: 8 total, 8 up, 8 in 2024-01-13T18:47:03.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:03 smithi084 ceph-mon[116404]: osdmap e1362: 8 total, 8 up, 8 in 2024-01-13T18:47:03.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:03 smithi084 ceph-mon[119097]: osdmap e1362: 8 total, 8 up, 8 in 2024-01-13T18:47:04.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:04 smithi099 ceph-mon[138788]: pgmap v2494: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 8.2 KiB/s rd, 1.1 KiB/s wr, 10 op/s; 1 B/s, 0 objects/s recovering 2024-01-13T18:47:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:04 smithi099 ceph-mon[138788]: osdmap e1363: 8 total, 8 up, 8 in 2024-01-13T18:47:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:04 smithi084 ceph-mon[116404]: pgmap v2494: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 8.2 KiB/s rd, 1.1 KiB/s wr, 10 op/s; 1 B/s, 0 objects/s recovering 2024-01-13T18:47:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:04 smithi084 ceph-mon[116404]: osdmap e1363: 8 total, 8 up, 8 in 2024-01-13T18:47:04.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:04 smithi084 ceph-mon[119097]: pgmap v2494: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 8.2 KiB/s rd, 1.1 KiB/s wr, 10 op/s; 1 B/s, 0 objects/s recovering 2024-01-13T18:47:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:04 smithi084 ceph-mon[119097]: osdmap e1363: 8 total, 8 up, 8 in 2024-01-13T18:47:05.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:05 smithi099 ceph-mon[138788]: osdmap e1364: 8 total, 8 up, 8 in 2024-01-13T18:47:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:05 smithi084 ceph-mon[116404]: osdmap e1364: 8 total, 8 up, 8 in 2024-01-13T18:47:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:05 smithi084 ceph-mon[119097]: osdmap e1364: 8 total, 8 up, 8 in 2024-01-13T18:47:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:06.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:06 smithi099 ceph-mon[138788]: pgmap v2497: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 3.5 KiB/s wr, 29 op/s 2024-01-13T18:47:06.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:06 smithi099 ceph-mon[138788]: osdmap e1365: 8 total, 8 up, 8 in 2024-01-13T18:47:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:06 smithi084 ceph-mon[116404]: pgmap v2497: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 3.5 KiB/s wr, 29 op/s 2024-01-13T18:47:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:06 smithi084 ceph-mon[116404]: osdmap e1365: 8 total, 8 up, 8 in 2024-01-13T18:47:06.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:06 smithi084 ceph-mon[119097]: pgmap v2497: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 3.5 KiB/s wr, 29 op/s 2024-01-13T18:47:06.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:06 smithi084 ceph-mon[119097]: osdmap e1365: 8 total, 8 up, 8 in 2024-01-13T18:47:07.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:07 smithi099 ceph-mon[138788]: osdmap e1366: 8 total, 8 up, 8 in 2024-01-13T18:47:07.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:07 smithi084 ceph-mon[116404]: osdmap e1366: 8 total, 8 up, 8 in 2024-01-13T18:47:07.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:07 smithi084 ceph-mon[119097]: osdmap e1366: 8 total, 8 up, 8 in 2024-01-13T18:47:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:08 smithi084 ceph-mon[116404]: pgmap v2500: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-01-13T18:47:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:08 smithi084 ceph-mon[116404]: osdmap e1367: 8 total, 8 up, 8 in 2024-01-13T18:47:08.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:08 smithi084 ceph-mon[119097]: pgmap v2500: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-01-13T18:47:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:08 smithi084 ceph-mon[119097]: osdmap e1367: 8 total, 8 up, 8 in 2024-01-13T18:47:09.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:08 smithi099 ceph-mon[138788]: pgmap v2500: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-01-13T18:47:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:08 smithi099 ceph-mon[138788]: osdmap e1367: 8 total, 8 up, 8 in 2024-01-13T18:47:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:09 smithi084 ceph-mon[116404]: osdmap e1368: 8 total, 8 up, 8 in 2024-01-13T18:47:09.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:09 smithi084 ceph-mon[119097]: osdmap e1368: 8 total, 8 up, 8 in 2024-01-13T18:47:10.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:09 smithi099 ceph-mon[138788]: osdmap e1368: 8 total, 8 up, 8 in 2024-01-13T18:47:10.644 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:47:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:47:10] "GET /metrics HTTP/1.1" 200 82104 "" "Prometheus/2.43.0" 2024-01-13T18:47:10.644 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:10 smithi084 ceph-mon[119097]: pgmap v2503: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 114 KiB/s rd, 8.5 KiB/s wr, 158 op/s 2024-01-13T18:47:10.644 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:10 smithi084 ceph-mon[119097]: osdmap e1369: 8 total, 8 up, 8 in 2024-01-13T18:47:10.645 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:10 smithi084 ceph-mon[116404]: pgmap v2503: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 114 KiB/s rd, 8.5 KiB/s wr, 158 op/s 2024-01-13T18:47:10.645 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:10 smithi084 ceph-mon[116404]: osdmap e1369: 8 total, 8 up, 8 in 2024-01-13T18:47:11.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:10 smithi099 ceph-mon[138788]: pgmap v2503: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 114 KiB/s rd, 8.5 KiB/s wr, 158 op/s 2024-01-13T18:47:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:10 smithi099 ceph-mon[138788]: osdmap e1369: 8 total, 8 up, 8 in 2024-01-13T18:47:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:11 smithi084 ceph-mon[116404]: osdmap e1370: 8 total, 8 up, 8 in 2024-01-13T18:47:11.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:11 smithi084 ceph-mon[119097]: osdmap e1370: 8 total, 8 up, 8 in 2024-01-13T18:47:12.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:11 smithi099 ceph-mon[138788]: osdmap e1370: 8 total, 8 up, 8 in 2024-01-13T18:47:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:12 smithi084 ceph-mon[116404]: pgmap v2506: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 112 KiB/s rd, 7.0 KiB/s wr, 152 op/s 2024-01-13T18:47:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:12 smithi084 ceph-mon[116404]: osdmap e1371: 8 total, 8 up, 8 in 2024-01-13T18:47:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:12 smithi084 ceph-mon[119097]: pgmap v2506: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 112 KiB/s rd, 7.0 KiB/s wr, 152 op/s 2024-01-13T18:47:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:12 smithi084 ceph-mon[119097]: osdmap e1371: 8 total, 8 up, 8 in 2024-01-13T18:47:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:12 smithi099 ceph-mon[138788]: pgmap v2506: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 112 KiB/s rd, 7.0 KiB/s wr, 152 op/s 2024-01-13T18:47:13.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:12 smithi099 ceph-mon[138788]: osdmap e1371: 8 total, 8 up, 8 in 2024-01-13T18:47:13.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:13 smithi084 ceph-mon[119097]: osdmap e1372: 8 total, 8 up, 8 in 2024-01-13T18:47:13.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:13 smithi084 ceph-mon[119097]: osdmap e1373: 8 total, 8 up, 8 in 2024-01-13T18:47:13.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:13 smithi084 ceph-mon[116404]: osdmap e1372: 8 total, 8 up, 8 in 2024-01-13T18:47:13.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:13 smithi084 ceph-mon[116404]: osdmap e1373: 8 total, 8 up, 8 in 2024-01-13T18:47:14.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:13 smithi099 ceph-mon[138788]: osdmap e1372: 8 total, 8 up, 8 in 2024-01-13T18:47:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:13 smithi099 ceph-mon[138788]: osdmap e1373: 8 total, 8 up, 8 in 2024-01-13T18:47:14.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:14 smithi084 ceph-mon[119097]: pgmap v2509: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-01-13T18:47:14.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:14 smithi084 ceph-mon[119097]: osdmap e1374: 8 total, 8 up, 8 in 2024-01-13T18:47:14.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:14 smithi084 ceph-mon[116404]: pgmap v2509: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-01-13T18:47:14.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:14 smithi084 ceph-mon[116404]: osdmap e1374: 8 total, 8 up, 8 in 2024-01-13T18:47:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:14 smithi099 ceph-mon[138788]: pgmap v2509: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-01-13T18:47:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:14 smithi099 ceph-mon[138788]: osdmap e1374: 8 total, 8 up, 8 in 2024-01-13T18:47:16.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:16 smithi099 ceph-mon[138788]: pgmap v2512: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-01-13T18:47:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:16 smithi099 ceph-mon[138788]: osdmap e1375: 8 total, 8 up, 8 in 2024-01-13T18:47:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:16 smithi084 ceph-mon[116404]: pgmap v2512: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-01-13T18:47:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:16 smithi084 ceph-mon[116404]: osdmap e1375: 8 total, 8 up, 8 in 2024-01-13T18:47:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:16 smithi084 ceph-mon[119097]: pgmap v2512: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-01-13T18:47:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:16 smithi084 ceph-mon[119097]: osdmap e1375: 8 total, 8 up, 8 in 2024-01-13T18:47:17.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:17 smithi099 ceph-mon[138788]: osdmap e1376: 8 total, 8 up, 8 in 2024-01-13T18:47:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:17 smithi084 ceph-mon[116404]: osdmap e1376: 8 total, 8 up, 8 in 2024-01-13T18:47:17.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:17 smithi084 ceph-mon[119097]: osdmap e1376: 8 total, 8 up, 8 in 2024-01-13T18:47:18.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:18 smithi099 ceph-mon[138788]: pgmap v2515: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-01-13T18:47:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:18 smithi099 ceph-mon[138788]: osdmap e1377: 8 total, 8 up, 8 in 2024-01-13T18:47:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:18 smithi084 ceph-mon[116404]: pgmap v2515: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-01-13T18:47:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:18 smithi084 ceph-mon[116404]: osdmap e1377: 8 total, 8 up, 8 in 2024-01-13T18:47:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:18 smithi084 ceph-mon[119097]: pgmap v2515: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-01-13T18:47:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:18 smithi084 ceph-mon[119097]: osdmap e1377: 8 total, 8 up, 8 in 2024-01-13T18:47:19.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:19 smithi099 ceph-mon[138788]: osdmap e1378: 8 total, 8 up, 8 in 2024-01-13T18:47:19.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:19 smithi084 ceph-mon[116404]: osdmap e1378: 8 total, 8 up, 8 in 2024-01-13T18:47:19.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:19 smithi084 ceph-mon[119097]: osdmap e1378: 8 total, 8 up, 8 in 2024-01-13T18:47:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:47:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:47:20] "GET /metrics HTTP/1.1" 200 82105 "" "Prometheus/2.43.0" 2024-01-13T18:47:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:20 smithi084 ceph-mon[116404]: pgmap v2518: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 179 KiB/s rd, 5.7 KiB/s wr, 247 op/s 2024-01-13T18:47:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:20 smithi084 ceph-mon[116404]: osdmap e1379: 8 total, 8 up, 8 in 2024-01-13T18:47:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:20.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:20 smithi084 ceph-mon[119097]: pgmap v2518: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 179 KiB/s rd, 5.7 KiB/s wr, 247 op/s 2024-01-13T18:47:20.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:20 smithi084 ceph-mon[119097]: osdmap e1379: 8 total, 8 up, 8 in 2024-01-13T18:47:20.678 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:20.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:20 smithi099 ceph-mon[138788]: pgmap v2518: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 179 KiB/s rd, 5.7 KiB/s wr, 247 op/s 2024-01-13T18:47:20.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:20 smithi099 ceph-mon[138788]: osdmap e1379: 8 total, 8 up, 8 in 2024-01-13T18:47:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:21.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:21 smithi099 ceph-mon[138788]: osdmap e1380: 8 total, 8 up, 8 in 2024-01-13T18:47:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:21 smithi084 ceph-mon[116404]: osdmap e1380: 8 total, 8 up, 8 in 2024-01-13T18:47:21.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:21 smithi084 ceph-mon[119097]: osdmap e1380: 8 total, 8 up, 8 in 2024-01-13T18:47:22.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:22 smithi099 ceph-mon[138788]: pgmap v2521: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 180 KiB/s rd, 5.5 KiB/s wr, 248 op/s 2024-01-13T18:47:22.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:22 smithi099 ceph-mon[138788]: osdmap e1381: 8 total, 8 up, 8 in 2024-01-13T18:47:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:22 smithi084 ceph-mon[116404]: pgmap v2521: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 180 KiB/s rd, 5.5 KiB/s wr, 248 op/s 2024-01-13T18:47:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:22 smithi084 ceph-mon[116404]: osdmap e1381: 8 total, 8 up, 8 in 2024-01-13T18:47:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:22 smithi084 ceph-mon[119097]: pgmap v2521: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 180 KiB/s rd, 5.5 KiB/s wr, 248 op/s 2024-01-13T18:47:22.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:22 smithi084 ceph-mon[119097]: osdmap e1381: 8 total, 8 up, 8 in 2024-01-13T18:47:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:23 smithi099 ceph-mon[138788]: osdmap e1382: 8 total, 8 up, 8 in 2024-01-13T18:47:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:23 smithi099 ceph-mon[138788]: osdmap e1383: 8 total, 8 up, 8 in 2024-01-13T18:47:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:23 smithi084 ceph-mon[116404]: osdmap e1382: 8 total, 8 up, 8 in 2024-01-13T18:47:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:23 smithi084 ceph-mon[116404]: osdmap e1383: 8 total, 8 up, 8 in 2024-01-13T18:47:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:23 smithi084 ceph-mon[119097]: osdmap e1382: 8 total, 8 up, 8 in 2024-01-13T18:47:23.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:23 smithi084 ceph-mon[119097]: osdmap e1383: 8 total, 8 up, 8 in 2024-01-13T18:47:24.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:24 smithi099 ceph-mon[138788]: pgmap v2524: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 5.0 KiB/s wr, 23 op/s 2024-01-13T18:47:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:24 smithi084 ceph-mon[116404]: pgmap v2524: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 5.0 KiB/s wr, 23 op/s 2024-01-13T18:47:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:24 smithi084 ceph-mon[119097]: pgmap v2524: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 5.0 KiB/s wr, 23 op/s 2024-01-13T18:47:25.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:25 smithi099 ceph-mon[138788]: osdmap e1384: 8 total, 8 up, 8 in 2024-01-13T18:47:25.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:25 smithi084 ceph-mon[116404]: osdmap e1384: 8 total, 8 up, 8 in 2024-01-13T18:47:25.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:25 smithi084 ceph-mon[119097]: osdmap e1384: 8 total, 8 up, 8 in 2024-01-13T18:47:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:26 smithi099 ceph-mon[138788]: pgmap v2527: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 5.0 KiB/s wr, 23 op/s 2024-01-13T18:47:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:26 smithi099 ceph-mon[138788]: osdmap e1385: 8 total, 8 up, 8 in 2024-01-13T18:47:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:26 smithi084 ceph-mon[116404]: pgmap v2527: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 5.0 KiB/s wr, 23 op/s 2024-01-13T18:47:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:26 smithi084 ceph-mon[116404]: osdmap e1385: 8 total, 8 up, 8 in 2024-01-13T18:47:26.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:26 smithi084 ceph-mon[119097]: pgmap v2527: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 5.0 KiB/s wr, 23 op/s 2024-01-13T18:47:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:26 smithi084 ceph-mon[119097]: osdmap e1385: 8 total, 8 up, 8 in 2024-01-13T18:47:27.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:27 smithi099 ceph-mon[138788]: osdmap e1386: 8 total, 8 up, 8 in 2024-01-13T18:47:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:27 smithi084 ceph-mon[116404]: osdmap e1386: 8 total, 8 up, 8 in 2024-01-13T18:47:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:27 smithi084 ceph-mon[119097]: osdmap e1386: 8 total, 8 up, 8 in 2024-01-13T18:47:28.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:28 smithi099 ceph-mon[138788]: pgmap v2530: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-01-13T18:47:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:28 smithi099 ceph-mon[138788]: osdmap e1387: 8 total, 8 up, 8 in 2024-01-13T18:47:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:28 smithi099 ceph-mon[138788]: osdmap e1388: 8 total, 8 up, 8 in 2024-01-13T18:47:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:28 smithi084 ceph-mon[116404]: pgmap v2530: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-01-13T18:47:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:28 smithi084 ceph-mon[116404]: osdmap e1387: 8 total, 8 up, 8 in 2024-01-13T18:47:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:28 smithi084 ceph-mon[116404]: osdmap e1388: 8 total, 8 up, 8 in 2024-01-13T18:47:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:28 smithi084 ceph-mon[119097]: pgmap v2530: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-01-13T18:47:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:28 smithi084 ceph-mon[119097]: osdmap e1387: 8 total, 8 up, 8 in 2024-01-13T18:47:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:28 smithi084 ceph-mon[119097]: osdmap e1388: 8 total, 8 up, 8 in 2024-01-13T18:47:29.609 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestLibRBD.ConcurentOperations (25792 ms) 2024-01-13T18:47:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:47:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:47:30] "GET /metrics HTTP/1.1" 200 82105 "" "Prometheus/2.43.0" 2024-01-13T18:47:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:30 smithi084 ceph-mon[116404]: pgmap v2533: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 68 KiB/s rd, 4.2 KiB/s wr, 91 op/s 2024-01-13T18:47:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:30 smithi084 ceph-mon[116404]: osdmap e1389: 8 total, 8 up, 8 in 2024-01-13T18:47:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:30 smithi084 ceph-mon[119097]: pgmap v2533: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 68 KiB/s rd, 4.2 KiB/s wr, 91 op/s 2024-01-13T18:47:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:30 smithi084 ceph-mon[119097]: osdmap e1389: 8 total, 8 up, 8 in 2024-01-13T18:47:30.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:30 smithi099 ceph-mon[138788]: pgmap v2533: 745 pgs: 745 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 68 KiB/s rd, 4.2 KiB/s wr, 91 op/s 2024-01-13T18:47:30.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:30 smithi099 ceph-mon[138788]: osdmap e1389: 8 total, 8 up, 8 in 2024-01-13T18:47:31.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:31 smithi099 ceph-mon[138788]: osdmap e1390: 8 total, 8 up, 8 in 2024-01-13T18:47:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:31 smithi084 ceph-mon[116404]: osdmap e1390: 8 total, 8 up, 8 in 2024-01-13T18:47:31.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:31 smithi084 ceph-mon[119097]: osdmap e1390: 8 total, 8 up, 8 in 2024-01-13T18:47:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:32 smithi084 ceph-mon[116404]: pgmap v2536: 713 pgs: 713 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 49 op/s 2024-01-13T18:47:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:32 smithi084 ceph-mon[116404]: osdmap e1391: 8 total, 8 up, 8 in 2024-01-13T18:47:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:32 smithi084 ceph-mon[119097]: pgmap v2536: 713 pgs: 713 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 49 op/s 2024-01-13T18:47:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:32 smithi084 ceph-mon[119097]: osdmap e1391: 8 total, 8 up, 8 in 2024-01-13T18:47:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:32 smithi099 ceph-mon[138788]: pgmap v2536: 713 pgs: 713 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 49 op/s 2024-01-13T18:47:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:32 smithi099 ceph-mon[138788]: osdmap e1391: 8 total, 8 up, 8 in 2024-01-13T18:47:33.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:33 smithi084 ceph-mon[119097]: osdmap e1392: 8 total, 8 up, 8 in 2024-01-13T18:47:33.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:33 smithi084 ceph-mon[119097]: osdmap e1393: 8 total, 8 up, 8 in 2024-01-13T18:47:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:33 smithi084 ceph-mon[116404]: osdmap e1392: 8 total, 8 up, 8 in 2024-01-13T18:47:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:33 smithi084 ceph-mon[116404]: osdmap e1393: 8 total, 8 up, 8 in 2024-01-13T18:47:34.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:33 smithi099 ceph-mon[138788]: osdmap e1392: 8 total, 8 up, 8 in 2024-01-13T18:47:34.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:33 smithi099 ceph-mon[138788]: osdmap e1393: 8 total, 8 up, 8 in 2024-01-13T18:47:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:34 smithi084 ceph-mon[116404]: pgmap v2539: 649 pgs: 649 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:34 smithi084 ceph-mon[116404]: osdmap e1394: 8 total, 8 up, 8 in 2024-01-13T18:47:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:34 smithi084 ceph-mon[119097]: pgmap v2539: 649 pgs: 649 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:34 smithi084 ceph-mon[119097]: osdmap e1394: 8 total, 8 up, 8 in 2024-01-13T18:47:35.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:34 smithi099 ceph-mon[138788]: pgmap v2539: 649 pgs: 649 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:35.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:34 smithi099 ceph-mon[138788]: osdmap e1394: 8 total, 8 up, 8 in 2024-01-13T18:47:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:35 smithi084 ceph-mon[116404]: osdmap e1395: 8 total, 8 up, 8 in 2024-01-13T18:47:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:35 smithi084 ceph-mon[119097]: osdmap e1395: 8 total, 8 up, 8 in 2024-01-13T18:47:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:35 smithi099 ceph-mon[138788]: osdmap e1395: 8 total, 8 up, 8 in 2024-01-13T18:47:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:36 smithi084 ceph-mon[116404]: pgmap v2542: 585 pgs: 585 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:36 smithi084 ceph-mon[116404]: osdmap e1396: 8 total, 8 up, 8 in 2024-01-13T18:47:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:36 smithi084 ceph-mon[119097]: pgmap v2542: 585 pgs: 585 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:36.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:36 smithi084 ceph-mon[119097]: osdmap e1396: 8 total, 8 up, 8 in 2024-01-13T18:47:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:36 smithi099 ceph-mon[138788]: pgmap v2542: 585 pgs: 585 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:36 smithi099 ceph-mon[138788]: osdmap e1396: 8 total, 8 up, 8 in 2024-01-13T18:47:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:38 smithi099 ceph-mon[138788]: pgmap v2545: 521 pgs: 521 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:38 smithi099 ceph-mon[138788]: osdmap e1397: 8 total, 8 up, 8 in 2024-01-13T18:47:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:38 smithi099 ceph-mon[138788]: osdmap e1398: 8 total, 8 up, 8 in 2024-01-13T18:47:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:38 smithi084 ceph-mon[116404]: pgmap v2545: 521 pgs: 521 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:38 smithi084 ceph-mon[116404]: osdmap e1397: 8 total, 8 up, 8 in 2024-01-13T18:47:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:38 smithi084 ceph-mon[116404]: osdmap e1398: 8 total, 8 up, 8 in 2024-01-13T18:47:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:38 smithi084 ceph-mon[119097]: pgmap v2545: 521 pgs: 521 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:38 smithi084 ceph-mon[119097]: osdmap e1397: 8 total, 8 up, 8 in 2024-01-13T18:47:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:38 smithi084 ceph-mon[119097]: osdmap e1398: 8 total, 8 up, 8 in 2024-01-13T18:47:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:47:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:47:40] "GET /metrics HTTP/1.1" 200 70087 "" "Prometheus/2.43.0" 2024-01-13T18:47:40.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:40 smithi084 ceph-mon[116404]: pgmap v2548: 457 pgs: 457 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:40.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:40 smithi084 ceph-mon[116404]: osdmap e1399: 8 total, 8 up, 8 in 2024-01-13T18:47:40.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:40 smithi084 ceph-mon[119097]: pgmap v2548: 457 pgs: 457 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:40.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:40 smithi084 ceph-mon[119097]: osdmap e1399: 8 total, 8 up, 8 in 2024-01-13T18:47:40.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:40 smithi099 ceph-mon[138788]: pgmap v2548: 457 pgs: 457 active+clean; 6.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:40 smithi099 ceph-mon[138788]: osdmap e1399: 8 total, 8 up, 8 in 2024-01-13T18:47:41.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:41 smithi099 ceph-mon[138788]: osdmap e1400: 8 total, 8 up, 8 in 2024-01-13T18:47:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:41 smithi084 ceph-mon[116404]: osdmap e1400: 8 total, 8 up, 8 in 2024-01-13T18:47:41.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:41 smithi084 ceph-mon[119097]: osdmap e1400: 8 total, 8 up, 8 in 2024-01-13T18:47:42.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:42 smithi099 ceph-mon[138788]: pgmap v2551: 393 pgs: 393 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:42.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:42 smithi099 ceph-mon[138788]: osdmap e1401: 8 total, 8 up, 8 in 2024-01-13T18:47:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:42 smithi084 ceph-mon[116404]: pgmap v2551: 393 pgs: 393 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:42 smithi084 ceph-mon[116404]: osdmap e1401: 8 total, 8 up, 8 in 2024-01-13T18:47:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:42 smithi084 ceph-mon[119097]: pgmap v2551: 393 pgs: 393 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:42 smithi084 ceph-mon[119097]: osdmap e1401: 8 total, 8 up, 8 in 2024-01-13T18:47:43.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:43 smithi099 ceph-mon[138788]: osdmap e1402: 8 total, 8 up, 8 in 2024-01-13T18:47:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:43 smithi084 ceph-mon[116404]: osdmap e1402: 8 total, 8 up, 8 in 2024-01-13T18:47:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:43 smithi084 ceph-mon[119097]: osdmap e1402: 8 total, 8 up, 8 in 2024-01-13T18:47:44.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:44 smithi099 ceph-mon[138788]: pgmap v2554: 329 pgs: 329 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:44.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:44 smithi099 ceph-mon[138788]: osdmap e1403: 8 total, 8 up, 8 in 2024-01-13T18:47:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:44 smithi084 ceph-mon[116404]: pgmap v2554: 329 pgs: 329 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:44 smithi084 ceph-mon[116404]: osdmap e1403: 8 total, 8 up, 8 in 2024-01-13T18:47:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:44 smithi084 ceph-mon[119097]: pgmap v2554: 329 pgs: 329 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:44 smithi084 ceph-mon[119097]: osdmap e1403: 8 total, 8 up, 8 in 2024-01-13T18:47:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:45 smithi099 ceph-mon[138788]: osdmap e1404: 8 total, 8 up, 8 in 2024-01-13T18:47:45.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:45 smithi084 ceph-mon[116404]: osdmap e1404: 8 total, 8 up, 8 in 2024-01-13T18:47:45.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:45 smithi084 ceph-mon[119097]: osdmap e1404: 8 total, 8 up, 8 in 2024-01-13T18:47:46.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:46 smithi099 ceph-mon[138788]: pgmap v2557: 265 pgs: 265 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:46.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:46 smithi099 ceph-mon[138788]: osdmap e1405: 8 total, 8 up, 8 in 2024-01-13T18:47:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:46 smithi084 ceph-mon[116404]: pgmap v2557: 265 pgs: 265 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:46 smithi084 ceph-mon[116404]: osdmap e1405: 8 total, 8 up, 8 in 2024-01-13T18:47:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:46 smithi084 ceph-mon[119097]: pgmap v2557: 265 pgs: 265 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:46 smithi084 ceph-mon[119097]: osdmap e1405: 8 total, 8 up, 8 in 2024-01-13T18:47:47.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:47 smithi099 ceph-mon[138788]: osdmap e1406: 8 total, 8 up, 8 in 2024-01-13T18:47:47.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:47 smithi099 ceph-mon[138788]: osdmap e1407: 8 total, 8 up, 8 in 2024-01-13T18:47:47.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:47 smithi084 ceph-mon[116404]: osdmap e1406: 8 total, 8 up, 8 in 2024-01-13T18:47:47.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:47 smithi084 ceph-mon[116404]: osdmap e1407: 8 total, 8 up, 8 in 2024-01-13T18:47:47.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:47 smithi084 ceph-mon[119097]: osdmap e1406: 8 total, 8 up, 8 in 2024-01-13T18:47:47.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:47 smithi084 ceph-mon[119097]: osdmap e1407: 8 total, 8 up, 8 in 2024-01-13T18:47:48.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:48 smithi099 ceph-mon[138788]: pgmap v2560: 201 pgs: 201 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:48.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:48 smithi099 ceph-mon[138788]: osdmap e1408: 8 total, 8 up, 8 in 2024-01-13T18:47:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:48 smithi084 ceph-mon[116404]: pgmap v2560: 201 pgs: 201 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:48.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:48 smithi084 ceph-mon[116404]: osdmap e1408: 8 total, 8 up, 8 in 2024-01-13T18:47:48.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:48 smithi084 ceph-mon[119097]: pgmap v2560: 201 pgs: 201 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:48.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:48 smithi084 ceph-mon[119097]: osdmap e1408: 8 total, 8 up, 8 in 2024-01-13T18:47:49.571 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 159 tests from TestLibRBD (330478 ms total) 2024-01-13T18:47:49.571 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:47:49.571 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 12 tests from DiffIterateTest/0, where TypeParam = DiffIterateParams 2024-01-13T18:47:49.603 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterate 2024-01-13T18:47:50.554 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:47:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:47:50] "GET /metrics HTTP/1.1" 200 34057 "" "Prometheus/2.43.0" 2024-01-13T18:47:50.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:50 smithi099 ceph-mon[138788]: pgmap v2563: 137 pgs: 137 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:50 smithi099 ceph-mon[138788]: osdmap e1409: 8 total, 8 up, 8 in 2024-01-13T18:47:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:50.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:50 smithi084 ceph-mon[119097]: pgmap v2563: 137 pgs: 137 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:50.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:50 smithi084 ceph-mon[119097]: osdmap e1409: 8 total, 8 up, 8 in 2024-01-13T18:47:50.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:50 smithi084 ceph-mon[116404]: pgmap v2563: 137 pgs: 137 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:50 smithi084 ceph-mon[116404]: osdmap e1409: 8 total, 8 up, 8 in 2024-01-13T18:47:50.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:47:51.598 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:47:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:51 smithi099 ceph-mon[138788]: osdmap e1410: 8 total, 8 up, 8 in 2024-01-13T18:47:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:51 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3565264220' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:47:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:51 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:47:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:47:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:47:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:47:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:47:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[119097]: osdmap e1410: 8 total, 8 up, 8 in 2024-01-13T18:47:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3565264220' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:47:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:47:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:47:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:47:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:47:51.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:47:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[116404]: osdmap e1410: 8 total, 8 up, 8 in 2024-01-13T18:47:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3565264220' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:47:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:47:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:47:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:47:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:47:51.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:47:52.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:52 smithi099 ceph-mon[138788]: pgmap v2566: 137 pgs: 32 unknown, 105 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:52 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:47:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:52 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:47:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:52 smithi099 ceph-mon[138788]: osdmap e1411: 8 total, 8 up, 8 in 2024-01-13T18:47:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:52 smithi084 ceph-mon[116404]: pgmap v2566: 137 pgs: 32 unknown, 105 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:52 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:47:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:52 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:47:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:52 smithi084 ceph-mon[116404]: osdmap e1411: 8 total, 8 up, 8 in 2024-01-13T18:47:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:52 smithi084 ceph-mon[119097]: pgmap v2566: 137 pgs: 32 unknown, 105 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:52 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:47:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:52 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:47:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:52 smithi084 ceph-mon[119097]: osdmap e1411: 8 total, 8 up, 8 in 2024-01-13T18:47:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: wrote [109437~84853,1699539~72393,5648355~32938,7168859~88393,7648127~42596,8091567~10103,11652847~79342,20033144~86281,20436330~17815] 2024-01-13T18:47:53.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:53 smithi099 ceph-mon[138788]: osdmap e1412: 8 total, 8 up, 8 in 2024-01-13T18:47:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:53 smithi084 ceph-mon[116404]: osdmap e1412: 8 total, 8 up, 8 in 2024-01-13T18:47:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:53 smithi084 ceph-mon[119097]: osdmap e1412: 8 total, 8 up, 8 in 2024-01-13T18:47:54.618 INFO:tasks.workunit.client.0.smithi084.stdout: wrote [397667~30399,2419329~18866,2594149~29052,3024786~54013,3922113~61908,12911259~12319,16700235~58361,18096110~89291,18219197~75458,20301043~84055] 2024-01-13T18:47:54.629 INFO:tasks.workunit.client.0.smithi084.stdout: diff was [397667~30399,1771932~2212089,12582912~4175684,18096110~89291,18219197~75458,20301043~84055] 2024-01-13T18:47:54.633 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterate (5032 ms) 2024-01-13T18:47:54.634 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterateDeterministic 2024-01-13T18:47:54.634 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:47:54.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:54 smithi099 ceph-mon[138788]: pgmap v2569: 137 pgs: 14 unknown, 123 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:54 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:47:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:54 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:47:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:54 smithi099 ceph-mon[138788]: osdmap e1413: 8 total, 8 up, 8 in 2024-01-13T18:47:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:54 smithi084 ceph-mon[116404]: pgmap v2569: 137 pgs: 14 unknown, 123 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:54 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:47:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:54 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:47:54.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:54 smithi084 ceph-mon[116404]: osdmap e1413: 8 total, 8 up, 8 in 2024-01-13T18:47:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:54 smithi084 ceph-mon[119097]: pgmap v2569: 137 pgs: 14 unknown, 123 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:47:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:54 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:47:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:54 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:47:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:54 smithi084 ceph-mon[119097]: osdmap e1413: 8 total, 8 up, 8 in 2024-01-13T18:47:55.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:55 smithi099 ceph-mon[138788]: osdmap e1414: 8 total, 8 up, 8 in 2024-01-13T18:47:55.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:55 smithi084 ceph-mon[116404]: osdmap e1414: 8 total, 8 up, 8 in 2024-01-13T18:47:55.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:55 smithi084 ceph-mon[119097]: osdmap e1414: 8 total, 8 up, 8 in 2024-01-13T18:47:56.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:56 smithi099 ceph-mon[138788]: pgmap v2572: 137 pgs: 7 unknown, 130 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-01-13T18:47:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:56 smithi099 ceph-mon[138788]: osdmap e1415: 8 total, 8 up, 8 in 2024-01-13T18:47:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:56 smithi084 ceph-mon[116404]: pgmap v2572: 137 pgs: 7 unknown, 130 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-01-13T18:47:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:56 smithi084 ceph-mon[116404]: osdmap e1415: 8 total, 8 up, 8 in 2024-01-13T18:47:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:56 smithi084 ceph-mon[119097]: pgmap v2572: 137 pgs: 7 unknown, 130 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-01-13T18:47:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:56 smithi084 ceph-mon[119097]: osdmap e1415: 8 total, 8 up, 8 in 2024-01-13T18:47:57.656 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterateDeterministic (3022 ms) 2024-01-13T18:47:57.656 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterateDeterministicPP 2024-01-13T18:47:57.656 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:47:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:57 smithi084 ceph-mon[116404]: osdmap e1416: 8 total, 8 up, 8 in 2024-01-13T18:47:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:57 smithi084 ceph-mon[119097]: osdmap e1416: 8 total, 8 up, 8 in 2024-01-13T18:47:58.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:57 smithi099 ceph-mon[138788]: osdmap e1416: 8 total, 8 up, 8 in 2024-01-13T18:47:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:58 smithi084 ceph-mon[116404]: pgmap v2575: 137 pgs: 137 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 1023 B/s wr, 16 op/s 2024-01-13T18:47:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:58 smithi084 ceph-mon[116404]: osdmap e1417: 8 total, 8 up, 8 in 2024-01-13T18:47:58.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:58 smithi084 ceph-mon[119097]: pgmap v2575: 137 pgs: 137 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 1023 B/s wr, 16 op/s 2024-01-13T18:47:58.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:58 smithi084 ceph-mon[119097]: osdmap e1417: 8 total, 8 up, 8 in 2024-01-13T18:47:59.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:58 smithi099 ceph-mon[138788]: pgmap v2575: 137 pgs: 137 active+clean; 4.6 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 11 KiB/s rd, 1023 B/s wr, 16 op/s 2024-01-13T18:47:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:58 smithi099 ceph-mon[138788]: osdmap e1417: 8 total, 8 up, 8 in 2024-01-13T18:47:59.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:47:59 smithi084 ceph-mon[116404]: osdmap e1418: 8 total, 8 up, 8 in 2024-01-13T18:47:59.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:47:59 smithi084 ceph-mon[119097]: osdmap e1418: 8 total, 8 up, 8 in 2024-01-13T18:48:00.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:47:59 smithi099 ceph-mon[138788]: osdmap e1418: 8 total, 8 up, 8 in 2024-01-13T18:48:00.643 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:48:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:48:00] "GET /metrics HTTP/1.1" 200 34057 "" "Prometheus/2.43.0" 2024-01-13T18:48:00.681 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterateDeterministicPP (3025 ms) 2024-01-13T18:48:00.681 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterateDiscard 2024-01-13T18:48:00.681 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:00.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:00 smithi084 ceph-mon[119097]: pgmap v2578: 137 pgs: 137 active+clean; 23 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 37 KiB/s rd, 267 KiB/s wr, 65 op/s 2024-01-13T18:48:00.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:00 smithi084 ceph-mon[119097]: osdmap e1419: 8 total, 8 up, 8 in 2024-01-13T18:48:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:00 smithi084 ceph-mon[116404]: pgmap v2578: 137 pgs: 137 active+clean; 23 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 37 KiB/s rd, 267 KiB/s wr, 65 op/s 2024-01-13T18:48:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:00 smithi084 ceph-mon[116404]: osdmap e1419: 8 total, 8 up, 8 in 2024-01-13T18:48:01.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:00 smithi099 ceph-mon[138788]: pgmap v2578: 137 pgs: 137 active+clean; 23 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 37 KiB/s rd, 267 KiB/s wr, 65 op/s 2024-01-13T18:48:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:00 smithi099 ceph-mon[138788]: osdmap e1419: 8 total, 8 up, 8 in 2024-01-13T18:48:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:01 smithi084 ceph-mon[119097]: osdmap e1420: 8 total, 8 up, 8 in 2024-01-13T18:48:01.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:01 smithi084 ceph-mon[116404]: osdmap e1420: 8 total, 8 up, 8 in 2024-01-13T18:48:02.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:01 smithi099 ceph-mon[138788]: osdmap e1420: 8 total, 8 up, 8 in 2024-01-13T18:48:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:02 smithi084 ceph-mon[119097]: pgmap v2581: 137 pgs: 137 active+clean; 23 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 55 KiB/s rd, 269 KiB/s wr, 88 op/s 2024-01-13T18:48:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:02 smithi084 ceph-mon[119097]: osdmap e1421: 8 total, 8 up, 8 in 2024-01-13T18:48:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:02 smithi084 ceph-mon[116404]: pgmap v2581: 137 pgs: 137 active+clean; 23 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 55 KiB/s rd, 269 KiB/s wr, 88 op/s 2024-01-13T18:48:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:02 smithi084 ceph-mon[116404]: osdmap e1421: 8 total, 8 up, 8 in 2024-01-13T18:48:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:02 smithi099 ceph-mon[138788]: pgmap v2581: 137 pgs: 137 active+clean; 23 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 55 KiB/s rd, 269 KiB/s wr, 88 op/s 2024-01-13T18:48:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:02 smithi099 ceph-mon[138788]: osdmap e1421: 8 total, 8 up, 8 in 2024-01-13T18:48:03.541 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterateDiscard (2860 ms) 2024-01-13T18:48:03.541 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterateStress 2024-01-13T18:48:03.541 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:03.602 INFO:tasks.workunit.client.0.smithi084.stdout: i=0 exists [10798145~101157,28721825~5280269,70317545~6126860,100477884~4646022,109002391~2812774,146589068~1438073,204496729~380218,238969130~6824742,302351869~3225373,312719208~5052390] wrote [10798145~101157,28721825~5280269,70317545~6126860,100477884~4646022,109002391~2812774,146589068~1438073,204496729~380218,238969130~6824742,302351869~3225373,312719208~5052390] 2024-01-13T18:48:03.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:03 smithi084 ceph-mon[119097]: osdmap e1422: 8 total, 8 up, 8 in 2024-01-13T18:48:03.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:03 smithi084 ceph-mon[119097]: osdmap e1423: 8 total, 8 up, 8 in 2024-01-13T18:48:03.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:03 smithi084 ceph-mon[116404]: osdmap e1422: 8 total, 8 up, 8 in 2024-01-13T18:48:03.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:03 smithi084 ceph-mon[116404]: osdmap e1423: 8 total, 8 up, 8 in 2024-01-13T18:48:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:03 smithi099 ceph-mon[138788]: osdmap e1422: 8 total, 8 up, 8 in 2024-01-13T18:48:04.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:03 smithi099 ceph-mon[138788]: osdmap e1423: 8 total, 8 up, 8 in 2024-01-13T18:48:04.579 INFO:tasks.workunit.client.0.smithi084.stdout: i=1 exists [10798145~101157,28721825~5280269,70317545~10620526,100477884~8077180,109002391~2812774,136479109~3637566,146589068~1438073,182548154~1479868,204496729~380218,222723738~1459656,238969130~6824742,249498721~1761227,290012112~2205698,294668087~4911101,302351869~3225373,312719208~5052390,323618868~5695702] wrote [75062481~5875590,103311594~5243470,136479109~3637566,182548154~1479868,222723738~1459656,242600401~943800,249498721~1761227,290012112~2205698,294668087~4911101,323618868~5695702] 2024-01-13T18:48:04.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:04 smithi084 ceph-mon[119097]: pgmap v2584: 137 pgs: 137 active+clean; 23 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 41 KiB/s rd, 11 KiB/s wr, 73 op/s 2024-01-13T18:48:04.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:04 smithi084 ceph-mon[119097]: osdmap e1424: 8 total, 8 up, 8 in 2024-01-13T18:48:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:04 smithi084 ceph-mon[116404]: pgmap v2584: 137 pgs: 137 active+clean; 23 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 41 KiB/s rd, 11 KiB/s wr, 73 op/s 2024-01-13T18:48:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:04 smithi084 ceph-mon[116404]: osdmap e1424: 8 total, 8 up, 8 in 2024-01-13T18:48:05.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:04 smithi099 ceph-mon[138788]: pgmap v2584: 137 pgs: 137 active+clean; 23 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 41 KiB/s rd, 11 KiB/s wr, 73 op/s 2024-01-13T18:48:05.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:04 smithi099 ceph-mon[138788]: osdmap e1424: 8 total, 8 up, 8 in 2024-01-13T18:48:05.616 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:48:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=cleanup t=2024-01-13T18:48:05.352047151Z level=info msg="Completed cleanup jobs" duration=13.27905ms 2024-01-13T18:48:05.622 INFO:tasks.workunit.client.0.smithi084.stdout: i=2 exists [10798145~101157,28721825~5280269,70317545~10620526,88954561~8158012,100477884~8077180,109002391~2812774,136479109~3637566,146589068~1438073,159013013~7849399,182548154~1479868,200207792~4669155,222723738~1459656,238969130~6824742,249498721~1761227,256534876~6233411,290012112~2205698,294668087~11471304,312719208~5052390,323618868~5695702,408112887~6085693] wrote [88954561~8158012,159013013~7849399,200207792~4300664,256534876~6233411,298398098~7741293,408112887~6085693] 2024-01-13T18:48:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:05 smithi084 ceph-mon[116404]: osdmap e1425: 8 total, 8 up, 8 in 2024-01-13T18:48:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:05 smithi084 ceph-mon[119097]: osdmap e1425: 8 total, 8 up, 8 in 2024-01-13T18:48:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:05 smithi099 ceph-mon[138788]: osdmap e1425: 8 total, 8 up, 8 in 2024-01-13T18:48:06.594 INFO:tasks.workunit.client.0.smithi084.stdout: i=3 exists [10798145~101157,11593618~15432919,28721825~6331979,70317545~10620526,88954561~8158012,100477884~8077180,109002391~2812774,136479109~3637566,146589068~1438073,159013013~7849399,173815874~1486860,182548154~1479868,193955615~10921332,222723738~1459656,238969130~6824742,249498721~1761227,256534876~6233411,290012112~2205698,294668087~11471304,312719208~5052390,323618868~5695702,363111336~4238091,398149810~4235276,408112887~6085693] wrote [11593618~15432919,29748506~5305298,173815874~1486860,193955615~9348324,363111336~4238091,398149810~4235276] 2024-01-13T18:48:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:06 smithi099 ceph-mon[138788]: pgmap v2587: 137 pgs: 137 active+clean; 56 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 71 KiB/s rd, 5.4 MiB/s wr, 115 op/s 2024-01-13T18:48:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:06 smithi099 ceph-mon[138788]: osdmap e1426: 8 total, 8 up, 8 in 2024-01-13T18:48:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:06 smithi084 ceph-mon[116404]: pgmap v2587: 137 pgs: 137 active+clean; 56 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 71 KiB/s rd, 5.4 MiB/s wr, 115 op/s 2024-01-13T18:48:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:06 smithi084 ceph-mon[116404]: osdmap e1426: 8 total, 8 up, 8 in 2024-01-13T18:48:07.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:06 smithi084 ceph-mon[119097]: pgmap v2587: 137 pgs: 137 active+clean; 56 MiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 71 KiB/s rd, 5.4 MiB/s wr, 115 op/s 2024-01-13T18:48:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:06 smithi084 ceph-mon[119097]: osdmap e1426: 8 total, 8 up, 8 in 2024-01-13T18:48:07.589 INFO:tasks.workunit.client.0.smithi084.stdout: i=4 exists [10798145~101157,11593618~15432919,28721825~6331979,70317545~12943932,88954561~8158012,100477884~8077180,109002391~2812774,134395486~5721189,146589068~1438073,159013013~7849399,173815874~1486860,182548154~1479868,193955615~10921332,217797355~4036766,222723738~1459656,238969130~6824742,249498721~1761227,256534876~6233411,263720640~2233428,290012112~2205698,294668087~11471304,312719208~5052390,323618868~6104095,335074884~6066031,363111336~4238091,398149810~4235276,402755542~573723,408112887~6085693] wrote [76056957~7204520,134395486~2907830,201767691~2547318,217797355~4036766,239246680~358065,263720640~2233428,324252164~5470799,335074884~6066031,402755542~573723] 2024-01-13T18:48:08.605 INFO:tasks.workunit.client.0.smithi084.stdout: i=5 exists [10798145~101157,11593618~15432919,28721825~6331979,45624426~7872032,70317545~12943932,88954561~8158012,100477884~8077180,109002391~2812774,134395486~5721189,146589068~1438073,159013013~7849399,172033295~3914874,182548154~1479868,193955615~10921332,217797355~4036766,222723738~1459656,229292519~420981,238969130~6824742,249498721~1761227,256534876~6233411,263720640~8387376,290012112~16127279,312719208~5052390,323618868~6104095,335074884~7136019,361716437~8944053,398149810~4235276,402755542~573723,408112887~8033611] wrote [45624426~7872032,172033295~3914874,229292519~420981,264112753~7995263,291274950~7750456,340817643~1393260,361716437~8944053,409952547~6193951] 2024-01-13T18:48:08.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:08 smithi099 ceph-mon[138788]: pgmap v2590: 137 pgs: 137 active+clean; 57 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 65 KiB/s rd, 5.7 MiB/s wr, 91 op/s 2024-01-13T18:48:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:08 smithi099 ceph-mon[138788]: osdmap e1427: 8 total, 8 up, 8 in 2024-01-13T18:48:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:08 smithi084 ceph-mon[116404]: pgmap v2590: 137 pgs: 137 active+clean; 57 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 65 KiB/s rd, 5.7 MiB/s wr, 91 op/s 2024-01-13T18:48:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:08 smithi084 ceph-mon[116404]: osdmap e1427: 8 total, 8 up, 8 in 2024-01-13T18:48:08.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:08 smithi084 ceph-mon[119097]: pgmap v2590: 137 pgs: 137 active+clean; 57 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 65 KiB/s rd, 5.7 MiB/s wr, 91 op/s 2024-01-13T18:48:08.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:08 smithi084 ceph-mon[119097]: osdmap e1427: 8 total, 8 up, 8 in 2024-01-13T18:48:09.609 INFO:tasks.workunit.client.0.smithi084.stdout: i=6 exists [4365840~3616461,10798145~101157,11593618~16014254,28721825~6331979,45624426~7872032,68480684~14780793,88954561~8158012,98613212~9941852,109002391~2812774,134395486~5721189,143708340~245789,146589068~1438073,159013013~7849399,172033295~3914874,181876927~5768603,193955615~10921332,217797355~4036766,222723738~1459656,229292519~420981,238969130~6824742,249498721~1761227,256534876~6233411,263720640~8387376,290012112~16127279,312440258~5331340,323618868~6104095,332299113~9911790,361716437~8944053,398149810~4235276,402755542~573723,408112887~8033611] wrote [4365840~3616461,14654185~3311387,24911569~2696303,68480684~2307263,98613212~4405503,143708340~245789,181876927~5768603,312440258~5189012,332299113~7998214] 2024-01-13T18:48:09.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:09 smithi099 ceph-mon[138788]: osdmap e1428: 8 total, 8 up, 8 in 2024-01-13T18:48:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:09 smithi084 ceph-mon[116404]: osdmap e1428: 8 total, 8 up, 8 in 2024-01-13T18:48:09.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:09 smithi084 ceph-mon[119097]: osdmap e1428: 8 total, 8 up, 8 in 2024-01-13T18:48:10.619 INFO:tasks.workunit.client.0.smithi084.stdout: i=7 exists [4365840~3616461,10798145~101157,11593618~16014254,28721825~6331979,45624426~7872032,68480684~14780793,88954561~8158012,98613212~9941852,109002391~2812774,130159858~9956817,143708340~245789,146589068~1438073,159013013~7849399,172033295~3914874,179036474~8609056,193955615~10921332,205420097~4673977,217797355~4036766,222723738~1459656,229292519~420981,238969130~6824742,249498721~1761227,256534876~6233411,263720640~8387376,276254267~9922366,290012112~16127279,312440258~5331340,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,394406363~7978723,402755542~573723,408112887~8033611] wrote [101818516~2351756,130159858~5859778,179036474~7267759,205420097~4673977,276254267~9922366,331618892~7473188,351102125~3089602,394406363~4095017] 2024-01-13T18:48:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:48:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:48:10] "GET /metrics HTTP/1.1" 200 36473 "" "Prometheus/2.43.0" 2024-01-13T18:48:10.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:10 smithi084 ceph-mon[119097]: pgmap v2593: 137 pgs: 137 active+clean; 229 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 124 KiB/s rd, 37 MiB/s wr, 223 op/s 2024-01-13T18:48:10.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:10 smithi084 ceph-mon[119097]: osdmap e1429: 8 total, 8 up, 8 in 2024-01-13T18:48:10.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:10 smithi084 ceph-mon[116404]: pgmap v2593: 137 pgs: 137 active+clean; 229 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 124 KiB/s rd, 37 MiB/s wr, 223 op/s 2024-01-13T18:48:10.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:10 smithi084 ceph-mon[116404]: osdmap e1429: 8 total, 8 up, 8 in 2024-01-13T18:48:10.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:10 smithi099 ceph-mon[138788]: pgmap v2593: 137 pgs: 137 active+clean; 229 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 124 KiB/s rd, 37 MiB/s wr, 223 op/s 2024-01-13T18:48:10.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:10 smithi099 ceph-mon[138788]: osdmap e1429: 8 total, 8 up, 8 in 2024-01-13T18:48:11.612 INFO:tasks.workunit.client.0.smithi084.stdout: i=8 exists [4365840~3616461,10798145~101157,11593618~16014254,28721825~6331979,45624426~7872032,68480684~14780793,88954561~8202342,98613212~9941852,109002391~2812774,130159858~13055243,143708340~245789,146589068~1438073,159013013~7849399,172033295~15612235,193955615~10921332,205420097~10050418,217797355~4036766,222723738~1459656,229292519~420981,238969130~6824742,249498721~6450771,256534876~6233411,263720640~8387376,276254267~9922366,290012112~16127279,312440258~5331340,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] wrote [95204854~1952049,130809673~12405428,172914405~6401048,209302586~6167929,249803968~6145524,326962706~1885775,341269978~245901,362476731~2718391,391964709~287985] 2024-01-13T18:48:11.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:11 smithi099 ceph-mon[138788]: osdmap e1430: 8 total, 8 up, 8 in 2024-01-13T18:48:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:11 smithi084 ceph-mon[116404]: osdmap e1430: 8 total, 8 up, 8 in 2024-01-13T18:48:11.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:11 smithi084 ceph-mon[119097]: osdmap e1430: 8 total, 8 up, 8 in 2024-01-13T18:48:12.601 INFO:tasks.workunit.client.0.smithi084.stdout: i=9 exists [4365840~23242032,28721825~6331979,35630242~1411518,45624426~7872032,68480684~14780793,88954561~8202342,98613212~9941852,109002391~2812774,113958035~4675090,130159858~13055243,143708340~245789,146589068~1438073,159013013~7849399,172033295~15612235,193955615~10921332,205420097~10050418,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,238969130~6824742,249498721~6450771,256534876~6233411,263720640~8387376,276254267~9922366,290012112~16127279,312440258~5331340,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] wrote [7102798~7973877,19508956~569624,35630242~1411518,113958035~4675090,203805944~498528,227015110~1684466,259624261~976473,376640344~1055657,385613362~3174411] 2024-01-13T18:48:12.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:12 smithi099 ceph-mon[138788]: pgmap v2596: 137 pgs: 137 active+clean; 259 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 162 KiB/s rd, 44 MiB/s wr, 273 op/s 2024-01-13T18:48:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:12 smithi099 ceph-mon[138788]: osdmap e1431: 8 total, 8 up, 8 in 2024-01-13T18:48:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:12 smithi084 ceph-mon[116404]: pgmap v2596: 137 pgs: 137 active+clean; 259 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 162 KiB/s rd, 44 MiB/s wr, 273 op/s 2024-01-13T18:48:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:12 smithi084 ceph-mon[116404]: osdmap e1431: 8 total, 8 up, 8 in 2024-01-13T18:48:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:12 smithi084 ceph-mon[119097]: pgmap v2596: 137 pgs: 137 active+clean; 259 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 162 KiB/s rd, 44 MiB/s wr, 273 op/s 2024-01-13T18:48:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:12 smithi084 ceph-mon[119097]: osdmap e1431: 8 total, 8 up, 8 in 2024-01-13T18:48:13.674 INFO:tasks.workunit.client.0.smithi084.stdout: i=10 exists [4365840~23242032,28721825~6331979,35630242~6403187,45624426~7872032,68480684~14780793,88954561~8202342,98613212~9941852,109002391~2812774,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,146589068~1438073,158983813~7878599,172033295~15612235,193955615~10921332,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,238969130~6824742,247546686~15221601,263720640~8387376,276254267~9922366,287567067~386241,290012112~16127279,312440258~5331340,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] wrote [19803763~6627063,35727014~6306415,102376748~1281870,119353029~7838400,158983813~6147942,205218799~6779928,247546686~2370730,254416539~4300178,287567067~386241,397507568~266959] 2024-01-13T18:48:13.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:13 smithi099 ceph-mon[138788]: osdmap e1432: 8 total, 8 up, 8 in 2024-01-13T18:48:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:13 smithi084 ceph-mon[116404]: osdmap e1432: 8 total, 8 up, 8 in 2024-01-13T18:48:13.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:13 smithi084 ceph-mon[119097]: osdmap e1432: 8 total, 8 up, 8 in 2024-01-13T18:48:14.627 INFO:tasks.workunit.client.0.smithi084.stdout: i=11 exists [2944435~1232186,4365840~23242032,28721825~6331979,35630242~6403187,45624426~7872032,68480684~14780793,88697826~8459077,98613212~9941852,109002391~2812774,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,146589068~1438073,158983813~7878599,172033295~15612235,191505225~13371722,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,238969130~6824742,247546686~24561330,276254267~9922366,287567067~386241,290012112~16127279,312440258~5331340,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] wrote [2944435~1232186,69600439~276969,88697826~3850154,185632250~1177132,191505225~2593352,197421980~1034828,259207128~4730798,269226752~2712572,335743305~89762] 2024-01-13T18:48:14.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:14 smithi099 ceph-mon[138788]: pgmap v2599: 137 pgs: 137 active+clean; 371 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 164 KiB/s rd, 34 MiB/s wr, 264 op/s 2024-01-13T18:48:14.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:14 smithi099 ceph-mon[138788]: osdmap e1433: 8 total, 8 up, 8 in 2024-01-13T18:48:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:14 smithi084 ceph-mon[116404]: pgmap v2599: 137 pgs: 137 active+clean; 371 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 164 KiB/s rd, 34 MiB/s wr, 264 op/s 2024-01-13T18:48:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:14 smithi084 ceph-mon[116404]: osdmap e1433: 8 total, 8 up, 8 in 2024-01-13T18:48:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:14 smithi084 ceph-mon[119097]: pgmap v2599: 137 pgs: 137 active+clean; 371 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 164 KiB/s rd, 34 MiB/s wr, 264 op/s 2024-01-13T18:48:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:14 smithi084 ceph-mon[119097]: osdmap e1433: 8 total, 8 up, 8 in 2024-01-13T18:48:15.649 INFO:tasks.workunit.client.0.smithi084.stdout: i=12 exists [2944435~1232186,4365840~23242032,28721825~6331979,35630242~6403187,45624426~7872032,68480684~14780793,88697826~8459077,98132578~10422486,109002391~2812774,113048761~14142668,130159858~13055243,143708340~245789,146589068~1438073,158983813~7878599,172033295~15612235,191505225~13371722,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,238969130~6824742,247546686~24561330,276254267~9922366,287567067~386241,290012112~16127279,312440258~5331340,323618868~7414113,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] wrote [8756101~890404,16001665~6917915,35739606~3620200,90587997~2550253,98132578~3959518,113048761~7114609,253406819~1741280,257183390~600882,324168256~6864725,381985122~2149966] 2024-01-13T18:48:15.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:15 smithi099 ceph-mon[138788]: osdmap e1434: 8 total, 8 up, 8 in 2024-01-13T18:48:15.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:15 smithi084 ceph-mon[116404]: osdmap e1434: 8 total, 8 up, 8 in 2024-01-13T18:48:15.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:15 smithi084 ceph-mon[119097]: osdmap e1434: 8 total, 8 up, 8 in 2024-01-13T18:48:16.641 INFO:tasks.workunit.client.0.smithi084.stdout: i=13 exists [2944435~1232186,4365840~23242032,28721825~6331979,35630242~6403187,45624426~7872032,68480684~14780793,88697826~8459077,97646638~391752,98132578~10422486,109002391~2812774,113048761~14142668,130159858~13055243,143653047~2185284,146589068~1438073,158983813~7878599,172033295~15612235,188856643~16020304,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,238969130~6824742,247546686~24561330,276254267~9922366,287567067~386241,290012112~16127279,312440258~5331340,319248741~11784240,331618892~10592011,343466286~4956235,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] wrote [97646638~391752,114903388~3080711,143653047~2185284,188856643~2843252,254538211~6031422,263989353~7101983,292796827~5355009,319248741~6930129,343466286~4956235,399226595~2346842] 2024-01-13T18:48:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:16 smithi099 ceph-mon[138788]: pgmap v2602: 137 pgs: 137 active+clean; 449 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 115 KiB/s rd, 45 MiB/s wr, 207 op/s 2024-01-13T18:48:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:16 smithi099 ceph-mon[138788]: osdmap e1435: 8 total, 8 up, 8 in 2024-01-13T18:48:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:16 smithi084 ceph-mon[116404]: pgmap v2602: 137 pgs: 137 active+clean; 449 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 115 KiB/s rd, 45 MiB/s wr, 207 op/s 2024-01-13T18:48:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:16 smithi084 ceph-mon[116404]: osdmap e1435: 8 total, 8 up, 8 in 2024-01-13T18:48:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:16 smithi084 ceph-mon[119097]: pgmap v2602: 137 pgs: 137 active+clean; 449 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 115 KiB/s rd, 45 MiB/s wr, 207 op/s 2024-01-13T18:48:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:16 smithi084 ceph-mon[119097]: osdmap e1435: 8 total, 8 up, 8 in 2024-01-13T18:48:17.654 INFO:tasks.workunit.client.0.smithi084.stdout: i=14 exists [2944435~1232186,4365840~23242032,28721825~6331979,35630242~6403187,45624426~7872032,68480684~14780793,88697826~8459077,97646638~391752,98132578~10422486,109002391~2812774,113048761~14142668,130159858~18529845,152029904~773745,158983813~7878599,172033295~15612235,188856643~16020304,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,238969130~6824742,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5331340,319248741~12098279,331618892~10592011,343466286~4956235,351102125~3089602,361047331~9613159,376640344~1055657,381985122~2149966,385613362~3174411,390275045~12110041,402755542~573723,408112887~8033611] wrote [15588785~3603588,45900944~2844563,74302896~2170336,140941849~7747854,152029904~773745,279973420~6776407,330556735~790285,361047331~5147902,390275045~6069287,410297321~4357908] 2024-01-13T18:48:17.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:17 smithi099 ceph-mon[138788]: osdmap e1436: 8 total, 8 up, 8 in 2024-01-13T18:48:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:17 smithi084 ceph-mon[116404]: osdmap e1436: 8 total, 8 up, 8 in 2024-01-13T18:48:17.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:17 smithi084 ceph-mon[119097]: osdmap e1436: 8 total, 8 up, 8 in 2024-01-13T18:48:18.707 INFO:tasks.workunit.client.0.smithi084.stdout: i=15 exists [2944435~1232186,4365840~23242032,28721825~6331979,35630242~6403187,45624426~7872032,68480684~14780793,88697826~8459077,97646638~391752,98132578~10422486,109002391~2812774,113048761~14142668,130159858~19821102,152029904~773745,158983813~28661717,188856643~16020304,205218799~16615322,222723738~1459656,227015110~1684466,229292519~420981,238969130~6824742,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5331340,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~2149966,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] wrote [13002730~7727720,78503521~1316887,143546434~6434526,166553978~6404534,214537834~5674923,255921330~6419043,340979426~11887367,386682283~3566701,407206533~4345865] 2024-01-13T18:48:18.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:18 smithi099 ceph-mon[138788]: pgmap v2605: 137 pgs: 137 active+clean; 468 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 83 KiB/s rd, 24 MiB/s wr, 122 op/s 2024-01-13T18:48:18.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:18 smithi099 ceph-mon[138788]: osdmap e1437: 8 total, 8 up, 8 in 2024-01-13T18:48:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:18 smithi084 ceph-mon[116404]: pgmap v2605: 137 pgs: 137 active+clean; 468 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 83 KiB/s rd, 24 MiB/s wr, 122 op/s 2024-01-13T18:48:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:18 smithi084 ceph-mon[116404]: osdmap e1437: 8 total, 8 up, 8 in 2024-01-13T18:48:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:18 smithi084 ceph-mon[119097]: pgmap v2605: 137 pgs: 137 active+clean; 468 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 83 KiB/s rd, 24 MiB/s wr, 122 op/s 2024-01-13T18:48:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:18 smithi084 ceph-mon[119097]: osdmap e1437: 8 total, 8 up, 8 in 2024-01-13T18:48:19.621 INFO:tasks.workunit.client.0.smithi084.stdout: i=16 exists [2944435~1232186,4365840~23242032,28721825~6331979,35630242~6403187,45624426~7872032,67672839~15588638,88697826~8459077,97646638~391752,98132578~10422486,109002391~2812774,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~28661717,188856643~16020304,205218799~16615322,222723738~1680845,227015110~1684466,229292519~420981,238969130~6824742,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5331340,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~3410431,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] wrote [67672839~5301161,75543536~361206,103244556~2142486,109038547~1025258,131564029~101367,147532293~3478933,151265291~212696,223272757~1131826,255610167~3773019,383660976~1734577] 2024-01-13T18:48:19.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:19 smithi099 ceph-mon[138788]: osdmap e1438: 8 total, 8 up, 8 in 2024-01-13T18:48:19.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:19 smithi084 ceph-mon[116404]: osdmap e1438: 8 total, 8 up, 8 in 2024-01-13T18:48:19.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:19 smithi084 ceph-mon[119097]: osdmap e1438: 8 total, 8 up, 8 in 2024-01-13T18:48:20.600 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:48:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:48:20] "GET /metrics HTTP/1.1" 200 36491 "" "Prometheus/2.43.0" 2024-01-13T18:48:20.684 INFO:tasks.workunit.client.0.smithi084.stdout: i=17 exists [2944435~1232186,4365840~23242032,28721825~6331979,35630242~6403187,45624426~7872032,65173788~18087689,88697826~8459077,97646638~391752,98132578~10422486,109002391~18189038,130159858~20851368,151265291~212696,152029904~773745,156741708~30903822,188856643~16020304,205218799~17443040,222723738~1680845,227015110~1684466,229292519~420981,238969130~6824742,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5331340,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] wrote [65173788~7171390,110637922~4143483,138094318~2290832,156741708~4624986,175725121~1001214,194043488~3075904,217874007~4787832,299142188~5504827,350594700~6196920,375659080~7266970] 2024-01-13T18:48:20.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:20 smithi099 ceph-mon[138788]: pgmap v2608: 137 pgs: 137 active+clean; 615 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 199 KiB/s rd, 37 MiB/s wr, 318 op/s 2024-01-13T18:48:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:20 smithi099 ceph-mon[138788]: osdmap e1439: 8 total, 8 up, 8 in 2024-01-13T18:48:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:20 smithi084 ceph-mon[116404]: pgmap v2608: 137 pgs: 137 active+clean; 615 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 199 KiB/s rd, 37 MiB/s wr, 318 op/s 2024-01-13T18:48:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:20 smithi084 ceph-mon[116404]: osdmap e1439: 8 total, 8 up, 8 in 2024-01-13T18:48:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:20.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:20 smithi084 ceph-mon[119097]: pgmap v2608: 137 pgs: 137 active+clean; 615 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 199 KiB/s rd, 37 MiB/s wr, 318 op/s 2024-01-13T18:48:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:20 smithi084 ceph-mon[119097]: osdmap e1439: 8 total, 8 up, 8 in 2024-01-13T18:48:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:21.682 INFO:tasks.workunit.client.0.smithi084.stdout: i=18 exists [2944435~1232186,4365840~23242032,28721825~6331979,35630242~6403187,45624426~7872032,57445484~6985145,65173788~18087689,84751242~1122101,88697826~8459077,97646638~391752,98132578~10422486,109002391~18189038,130159858~21318129,152029904~773745,156741708~30903822,188856643~16020304,205218799~19185784,227015110~1684466,229292519~420981,238969130~6824742,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~5331340,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] wrote [9029220~2729175,57445484~6985145,84751242~1122101,149759153~1576257,159523541~2692326,194486488~10194709,220691306~2927789,290361154~4305765,302084659~6487436] 2024-01-13T18:48:21.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:21 smithi099 ceph-mon[138788]: osdmap e1440: 8 total, 8 up, 8 in 2024-01-13T18:48:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:21 smithi084 ceph-mon[116404]: osdmap e1440: 8 total, 8 up, 8 in 2024-01-13T18:48:21.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:21 smithi084 ceph-mon[119097]: osdmap e1440: 8 total, 8 up, 8 in 2024-01-13T18:48:22.715 INFO:tasks.workunit.client.0.smithi084.stdout: i=19 exists [2944435~1232186,4365840~23242032,28721825~6331979,35630242~6403187,45624426~8163807,57445484~6985145,65173788~18087689,84751242~12405661,97646638~391752,98132578~10422486,109002391~18189038,130159858~21318129,152029904~773745,156741708~30903822,188856643~16020304,205218799~19185784,227015110~1684466,229292519~420981,238969130~6824742,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] wrote [50511075~3277158,76805441~5721080,85591847~5314587,141071292~8054790,210395355~3329430,302316126~2407854,314018371~5695880,345729730~4569204,362554109~3901073,410023372~6188344] 2024-01-13T18:48:22.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:22 smithi099 ceph-mon[138788]: pgmap v2611: 137 pgs: 137 active+clean; 655 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 232 KiB/s rd, 43 MiB/s wr, 364 op/s 2024-01-13T18:48:22.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:22 smithi099 ceph-mon[138788]: osdmap e1441: 8 total, 8 up, 8 in 2024-01-13T18:48:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:22 smithi084 ceph-mon[116404]: pgmap v2611: 137 pgs: 137 active+clean; 655 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 232 KiB/s rd, 43 MiB/s wr, 364 op/s 2024-01-13T18:48:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:22 smithi084 ceph-mon[116404]: osdmap e1441: 8 total, 8 up, 8 in 2024-01-13T18:48:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:22 smithi084 ceph-mon[119097]: pgmap v2611: 137 pgs: 137 active+clean; 655 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 232 KiB/s rd, 43 MiB/s wr, 364 op/s 2024-01-13T18:48:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:22 smithi084 ceph-mon[119097]: osdmap e1441: 8 total, 8 up, 8 in 2024-01-13T18:48:23.642 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 1 diff [75062481~5875590,103311594~5243470,136479109~3637566,182548154~1479868,222723738~1459656,242600401~943800,249498721~1761227,290012112~2205698,294668087~4911101,323618868~5695702] 2024-01-13T18:48:23.642 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [75062481~5875590,103311594~5243470,136479109~3637566,182548154~1479868,222723738~1459656,242600401~943800,249498721~1761227,290012112~2205698,294668087~4911101,323618868~5695702] 2024-01-13T18:48:23.660 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [75062481~5875590,103311594~5243470,134217728~5898947,180355072~3672950,222298112~1885282,242600401~943800,247463936~3796012,289406976~2810834,293601280~5977908,322961408~6353162] 2024-01-13T18:48:23.660 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 2 diff [75062481~5875590,88954561~8158012,103311594~5243470,136479109~3637566,159013013~7849399,182548154~1479868,200207792~4300664,222723738~1459656,242600401~943800,249498721~1761227,256534876~6233411,290012112~2205698,294668087~11471304,323618868~5695702,408112887~6085693] 2024-01-13T18:48:23.660 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [75062481~5875590,88954561~8158012,103311594~5243470,136479109~3637566,159013013~7849399,182548154~1479868,200207792~4300664,222723738~1459656,242600401~943800,249498721~1761227,256534876~6233411,290012112~2205698,294668087~11471304,323618868~5695702,408112887~6085693] 2024-01-13T18:48:23.666 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [75062481~5875590,88080384~9032189,103311594~5243470,134217728~5898947,155189248~11673164,180355072~3672950,197132288~7376168,222298112~1885282,242600401~943800,247463936~3796012,255852544~6915743,289406976~2810834,293601280~12538111,322961408~6353162,406847488~7351092] 2024-01-13T18:48:23.666 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 3 diff [11593618~15432919,29748506~5305298,75062481~5875590,88954561~8158012,103311594~5243470,136479109~3637566,159013013~7849399,173815874~1486860,182548154~1479868,193955615~10552841,222723738~1459656,242600401~943800,249498721~1761227,256534876~6233411,290012112~2205698,294668087~11471304,323618868~5695702,363111336~4238091,398149810~4235276,408112887~6085693] 2024-01-13T18:48:23.666 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [11593618~15432919,29748506~5305298,75062481~5875590,88954561~8158012,103311594~5243470,136479109~3637566,159013013~7849399,173815874~1486860,182548154~1479868,193955615~10552841,222723738~1459656,242600401~943800,249498721~1761227,256534876~6233411,290012112~2205698,294668087~11471304,323618868~5695702,363111336~4238091,398149810~4235276,408112887~6085693] 2024-01-13T18:48:23.672 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [10899302~16127235,29748506~5305298,75062481~5875590,88080384~9032189,103311594~5243470,134217728~5898947,155189248~11673164,171966464~3336270,180355072~3672950,192937984~11570472,222298112~1885282,242600401~943800,247463936~3796012,255852544~6915743,289406976~2810834,293601280~12538111,322961408~6353162,360710144~6639283,394264576~8120510,406847488~7351092] 2024-01-13T18:48:23.672 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 4 diff [11593618~15432919,29748506~5305298,75062481~8198996,88954561~8158012,103311594~5243470,134395486~5721189,159013013~7849399,173815874~1486860,182548154~1479868,193955615~10552841,217797355~4036766,222723738~1459656,239246680~358065,242600401~943800,249498721~1761227,256534876~6233411,263720640~2233428,290012112~2205698,294668087~11471304,323618868~6104095,335074884~6066031,363111336~4238091,398149810~4235276,402755542~573723,408112887~6085693] 2024-01-13T18:48:23.672 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [11593618~15432919,29748506~5305298,75062481~8198996,88954561~8158012,103311594~5243470,134395486~5721189,159013013~7849399,173815874~1486860,182548154~1479868,193955615~10552841,217797355~4036766,222723738~1459656,239246680~358065,242600401~943800,249498721~1761227,256534876~6233411,263720640~2233428,290012112~2205698,294668087~11471304,323618868~6104095,335074884~6066031,363111336~4238091,398149810~4235276,402755542~573723,408112887~6085693] 2024-01-13T18:48:23.677 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [10899302~16127235,29748506~5305298,75062481~8198996,88080384~9032189,103311594~5243470,134217728~5898947,155189248~11673164,171966464~3336270,180355072~3672950,192937984~11570472,213909504~7924617,222298112~1885282,239246680~358065,242600401~943800,247463936~3796012,255852544~10101524,289406976~2810834,293601280~12538111,322961408~6761555,331350016~9790899,360710144~6639283,394264576~8120510,402653184~676081,406847488~7351092] 2024-01-13T18:48:23.677 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 5 diff [11593618~15432919,29748506~5305298,45624426~7872032,75062481~8198996,88954561~8158012,103311594~5243470,134395486~5721189,159013013~7849399,172033295~3914874,182548154~1479868,193955615~10552841,217797355~4036766,222723738~1459656,229292519~420981,239246680~358065,242600401~943800,249498721~1761227,256534876~6233411,263720640~8387376,290012112~16127279,323618868~6104095,335074884~7136019,361716437~8944053,398149810~4235276,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.677 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [11593618~15432919,29748506~5305298,45624426~7872032,75062481~8198996,88954561~8158012,103311594~5243470,134395486~5721189,159013013~7849399,172033295~3914874,182548154~1479868,193955615~10552841,217797355~4036766,222723738~1459656,229292519~420981,239246680~358065,242600401~943800,249498721~1761227,256534876~6233411,263720640~8387376,290012112~16127279,323618868~6104095,335074884~7136019,361716437~8944053,398149810~4235276,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.684 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [10899302~16127235,29748506~5305298,41943040~11553418,75062481~8198996,88080384~9032189,103311594~5243470,134217728~5898947,155189248~11673164,171966464~3981705,180355072~3672950,192937984~11570472,213909504~7924617,222298112~1885282,226492416~3221084,239246680~358065,242600401~943800,247463936~3796012,255852544~16255472,289406976~16732415,322961408~6761555,331350016~10860887,360710144~9950346,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.684 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 6 diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,75062481~8198996,88954561~8158012,98613212~4405503,103311594~5243470,134395486~5721189,143708340~245789,159013013~7849399,172033295~3914874,181876927~5768603,193955615~10552841,217797355~4036766,222723738~1459656,229292519~420981,239246680~358065,242600401~943800,249498721~1761227,256534876~6233411,263720640~8387376,290012112~16127279,312440258~5189012,323618868~6104095,332299113~9911790,361716437~8944053,398149810~4235276,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.684 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,75062481~8198996,88954561~8158012,98613212~4405503,103311594~5243470,134395486~5721189,143708340~245789,159013013~7849399,172033295~3914874,181876927~5768603,193955615~10552841,217797355~4036766,222723738~1459656,229292519~420981,239246680~358065,242600401~943800,249498721~1761227,256534876~6233411,263720640~8387376,290012112~16127279,312440258~5189012,323618868~6104095,332299113~9911790,361716437~8944053,398149810~4235276,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.689 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,10899302~16708570,29748506~5305298,41943040~11553418,68480684~2307263,75062481~8198996,88080384~9032189,98613212~4405503,103311594~5243470,134217728~5898947,143708340~245789,155189248~11673164,171966464~3981705,180355072~7290458,192937984~11570472,213909504~7924617,222298112~1885282,226492416~3221084,239246680~358065,242600401~943800,247463936~3796012,255852544~16255472,289406976~16732415,312440258~5189012,322961408~6761555,331350016~10860887,360710144~9950346,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.689 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 7 diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,75062481~8198996,88954561~8158012,98613212~9941852,130159858~9956817,143708340~245789,159013013~7849399,172033295~3914874,179036474~8609056,193955615~10552841,205420097~4673977,217797355~4036766,222723738~1459656,229292519~420981,239246680~358065,242600401~943800,249498721~1761227,256534876~6233411,263720640~8387376,276254267~9922366,290012112~16127279,312440258~5189012,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.689 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,75062481~8198996,88954561~8158012,98613212~9941852,130159858~9956817,143708340~245789,159013013~7849399,172033295~3914874,179036474~8609056,193955615~10552841,205420097~4673977,217797355~4036766,222723738~1459656,229292519~420981,239246680~358065,242600401~943800,249498721~1761227,256534876~6233411,263720640~8387376,276254267~9922366,290012112~16127279,312440258~5189012,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.694 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,10899302~16708570,29748506~5305298,41943040~11553418,68480684~2307263,75062481~8198996,88080384~9032189,98613212~9941852,130023424~10093251,143708340~245789,155189248~11673164,171966464~3981705,176160768~11484762,192937984~11570472,204876947~5217127,213909504~7924617,222298112~1885282,226492416~3221084,239246680~358065,242600401~943800,247463936~3796012,255852544~16255472,272629760~13546873,289406976~16732415,312440258~5189012,322961408~6761555,331350016~10860887,348127232~6064495,360710144~9950346,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.694 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 8 diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,75062481~8198996,88954561~8202342,98613212~9941852,130159858~13055243,143708340~245789,159013013~7849399,172033295~15612235,193955615~10552841,205420097~10050418,217797355~4036766,222723738~1459656,229292519~420981,239246680~358065,242600401~943800,249498721~6450771,256534876~6233411,263720640~8387376,276254267~9922366,290012112~16127279,312440258~5189012,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.695 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,75062481~8198996,88954561~8202342,98613212~9941852,130159858~13055243,143708340~245789,159013013~7849399,172033295~15612235,193955615~10552841,205420097~10050418,217797355~4036766,222723738~1459656,229292519~420981,239246680~358065,242600401~943800,249498721~6450771,256534876~6233411,263720640~8387376,276254267~9922366,290012112~16127279,312440258~5189012,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.700 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,10899302~16708570,29748506~5305298,41943040~11553418,68480684~2307263,75062481~8198996,88080384~9076519,98613212~9941852,130023424~13191677,143708340~245789,155189248~11673164,171966464~15679066,192937984~11570472,204876947~16957174,222298112~1885282,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~13546873,289406976~16732415,312440258~5189012,322961408~6761555,331350016~10860887,348127232~6064495,360710144~9950346,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.700 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 9 diff [4365840~23242032,29748506~5305298,35630242~1411518,45624426~7872032,68480684~2307263,75062481~8198996,88954561~8202342,98613212~9941852,113958035~4675090,130159858~13055243,143708340~245789,159013013~7849399,172033295~15612235,193955615~10552841,205420097~10050418,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,249498721~6450771,256534876~6233411,263720640~8387376,276254267~9922366,290012112~16127279,312440258~5189012,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.700 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~23242032,29748506~5305298,35630242~1411518,45624426~7872032,68480684~2307263,75062481~8198996,88954561~8202342,98613212~9941852,113958035~4675090,130159858~13055243,143708340~245789,159013013~7849399,172033295~15612235,193955615~10552841,205420097~10050418,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,249498721~6450771,256534876~6233411,263720640~8387376,276254267~9922366,290012112~16127279,312440258~5189012,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.706 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~23413568,29748506~7293254,41943040~11553418,68480684~2307263,75062481~8198996,88080384~9076519,98613212~9941852,113246208~5386917,130023424~13191677,143708340~245789,155189248~11673164,171966464~15679066,192937984~11570472,204876947~16957174,222298112~1885282,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~13546873,289406976~16732415,312440258~5189012,322961408~6761555,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.706 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 10 diff [4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,75062481~8198996,88954561~8202342,98613212~9941852,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,193955615~10552841,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~15221601,263720640~8387376,276254267~9922366,287567067~386241,290012112~16127279,312440258~5189012,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.706 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,75062481~8198996,88954561~8202342,98613212~9941852,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,193955615~10552841,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~15221601,263720640~8387376,276254267~9922366,287567067~386241,290012112~16127279,312440258~5189012,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.711 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~23413568,29748506~23747952,68480684~2307263,75062481~8198996,88080384~9076519,98613212~9941852,113246208~13945221,130023424~13191677,143708340~245789,155189248~11673164,171966464~15679066,192937984~11570472,204876947~16957174,222298112~1885282,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~16732415,312440258~5189012,322961408~6761555,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.711 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 11 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,75062481~8198996,88697826~8459077,98613212~9941852,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,191505225~13003231,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~9922366,287567067~386241,290012112~16127279,312440258~5189012,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.711 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,75062481~8198996,88697826~8459077,98613212~9941852,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,191505225~13003231,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~9922366,287567067~386241,290012112~16127279,312440258~5189012,323618868~6104095,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.716 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,75062481~8198996,88080384~9076519,98613212~9941852,113246208~13945221,130023424~13191677,143708340~245789,155189248~11673164,171966464~15679066,188743680~15764776,204876947~16957174,222298112~1885282,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~16732415,312440258~5189012,322961408~6761555,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.717 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 12 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,75062481~8198996,88697826~8459077,98132578~10422486,113048761~14142668,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,191505225~13003231,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~9922366,287567067~386241,290012112~16127279,312440258~5189012,323618868~7414113,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.717 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,75062481~8198996,88697826~8459077,98132578~10422486,113048761~14142668,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,191505225~13003231,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~9922366,287567067~386241,290012112~16127279,312440258~5189012,323618868~7414113,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.722 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,75062481~8198996,88080384~9076519,98132578~10422486,111815165~15376264,130023424~13191677,143708340~245789,155189248~11673164,171966464~15679066,188743680~15764776,204876947~16957174,222298112~1885282,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~16732415,312440258~5189012,322961408~8071573,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.722 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 13 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,75062481~8198996,88697826~8459077,97646638~391752,98132578~10422486,113048761~14142668,130159858~13055243,143653047~2185284,158983813~7878599,172033295~15612235,188856643~15651813,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~9922366,287567067~386241,290012112~16127279,312440258~5189012,319248741~11784240,331618892~10592011,343466286~4956235,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.722 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,75062481~8198996,88697826~8459077,97646638~391752,98132578~10422486,113048761~14142668,130159858~13055243,143653047~2185284,158983813~7878599,172033295~15612235,188856643~15651813,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~9922366,287567067~386241,290012112~16127279,312440258~5189012,319248741~11784240,331618892~10592011,343466286~4956235,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.727 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,75062481~8198996,88080384~9076519,97646638~391752,98132578~10422486,111815165~15376264,130023424~13191677,143653047~2185284,155189248~11673164,171966464~15679066,188743680~15764776,204876947~16957174,222298112~1885282,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~16732415,312440258~5189012,318767104~12265877,331350016~22841711,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.728 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 14 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~8459077,97646638~391752,98132578~10422486,113048761~14142668,130159858~18529845,152029904~773745,158983813~7878599,172033295~15612235,188856643~15651813,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5189012,319248741~12098279,331618892~10592011,343466286~4956235,351102125~3089602,361047331~9613159,376640344~1055657,381985122~2149966,385613362~3174411,390275045~12110041,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.728 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~8459077,97646638~391752,98132578~10422486,113048761~14142668,130159858~18529845,152029904~773745,158983813~7878599,172033295~15612235,188856643~15651813,205218799~10251716,217797355~4036766,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5189012,319248741~12098279,331618892~10592011,343466286~4956235,351102125~3089602,361047331~9613159,376640344~1055657,381985122~2149966,385613362~3174411,390275045~12110041,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.733 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,74302896~8958581,88080384~9076519,97646638~391752,98132578~10422486,111815165~15376264,130023424~18666279,150994944~1808705,155189248~11673164,171966464~15679066,188743680~15764776,204876947~16957174,222298112~1885282,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~16732415,312440258~5189012,318767104~12579916,331350016~22841711,360710144~9950346,373293056~4402945,381681664~7106109,390070272~12314814,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.733 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 15 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~8459077,97646638~391752,98132578~10422486,113048761~14142668,130159858~19821102,152029904~773745,158983813~28661717,188856643~15651813,205218799~16615322,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~2149966,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.733 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~8459077,97646638~391752,98132578~10422486,113048761~14142668,130159858~19821102,152029904~773745,158983813~28661717,188856643~15651813,205218799~16615322,222723738~1459656,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~2149966,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.739 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,74302896~8958581,88080384~9076519,97646638~391752,98132578~10422486,111815165~15376264,130023424~19957536,150994944~1808705,155189248~32456282,188743680~15764776,204876947~16957174,222298112~1885282,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~16732415,312440258~5189012,318767104~12579916,331350016~22841711,360710144~9950346,373293056~4402945,381681664~20703422,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.739 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 16 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,67672839~5301161,74302896~8958581,88697826~8459077,97646638~391752,98132578~10422486,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~28661717,188856643~15651813,205218799~16615322,222723738~1680845,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~3410431,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.739 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,67672839~5301161,74302896~8958581,88697826~8459077,97646638~391752,98132578~10422486,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~28661717,188856643~15651813,205218799~16615322,222723738~1680845,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~3410431,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.744 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,67672839~5301161,74302896~8958581,88080384~9076519,97646638~391752,98132578~10422486,109038547~1025258,111815165~15376264,130023424~22780225,155189248~32456282,188743680~15764776,204876947~16957174,222298112~2106471,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~16732415,312440258~5189012,318767104~12579916,331350016~22841711,360710144~9950346,373293056~4402945,381681664~20703422,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.745 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 17 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,65173788~7800212,74302896~8958581,88697826~8459077,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~30903822,188856643~15651813,205218799~17443040,222723738~1680845,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.745 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,65173788~7800212,74302896~8958581,88697826~8459077,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~30903822,188856643~15651813,205218799~17443040,222723738~1680845,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~16127279,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.751 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,62914560~10059440,74302896~8958581,88080384~9076519,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15764776,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~16732415,312440258~5189012,318767104~12579916,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.751 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 18 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,57445484~6985145,65173788~7800212,74302896~8958581,84751242~1122101,88697826~8459077,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.751 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,57445484~6985145,65173788~7800212,74302896~8958581,84751242~1122101,88697826~8459077,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.755 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,54525952~18448048,74302896~8958581,83886080~1987263,88080384~9076519,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~5189012,318767104~12579916,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.756 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 19 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:23.756 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:23.761 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 2 diff [88954561~8158012,159013013~7849399,200207792~4300664,256534876~6233411,298398098~7741293,408112887~6085693] 2024-01-13T18:48:23.761 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [88954561~8158012,159013013~7849399,200207792~4300664,256534876~6233411,298398098~7741293,408112887~6085693] 2024-01-13T18:48:23.766 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [88080384~9032189,155189248~11673164,197132288~7376168,255852544~6915743,298398098~7741293,406847488~7351092] 2024-01-13T18:48:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 3 diff [11593618~15432919,29748506~5305298,88954561~8158012,159013013~7849399,173815874~1486860,193955615~10552841,256534876~6233411,298398098~7741293,363111336~4238091,398149810~4235276,408112887~6085693] 2024-01-13T18:48:23.766 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [11593618~15432919,29748506~5305298,88954561~8158012,159013013~7849399,173815874~1486860,193955615~10552841,256534876~6233411,298398098~7741293,363111336~4238091,398149810~4235276,408112887~6085693] 2024-01-13T18:48:23.772 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [10899302~16127235,29748506~5305298,88080384~9032189,155189248~11673164,171966464~3336270,192937984~11570472,255852544~6915743,298398098~7741293,360710144~6639283,394264576~8120510,406847488~7351092] 2024-01-13T18:48:23.772 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 4 diff [11593618~15432919,29748506~5305298,76056957~7204520,88954561~8158012,134395486~2907830,159013013~7849399,173815874~1486860,193955615~10552841,217797355~4036766,239246680~358065,256534876~6233411,263720640~2233428,298398098~7741293,324252164~5470799,335074884~6066031,363111336~4238091,398149810~4235276,402755542~573723,408112887~6085693] 2024-01-13T18:48:23.772 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [11593618~15432919,29748506~5305298,76056957~7204520,88954561~8158012,134395486~2907830,159013013~7849399,173815874~1486860,193955615~10552841,217797355~4036766,239246680~358065,256534876~6233411,263720640~2233428,298398098~7741293,324252164~5470799,335074884~6066031,363111336~4238091,398149810~4235276,402755542~573723,408112887~6085693] 2024-01-13T18:48:23.777 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [10899302~16127235,29748506~5305298,76056957~7204520,88080384~9032189,134395486~2907830,155189248~11673164,171966464~3336270,192937984~11570472,213909504~7924617,239246680~358065,255852544~10101524,298398098~7741293,324252164~5470799,331350016~9790899,360710144~6639283,394264576~8120510,402653184~676081,406847488~7351092] 2024-01-13T18:48:23.777 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 5 diff [11593618~15432919,29748506~5305298,45624426~7872032,76056957~7204520,88954561~8158012,134395486~2907830,159013013~7849399,172033295~3914874,193955615~10552841,217797355~4036766,229292519~420981,239246680~358065,256534876~6233411,263720640~8387376,291274950~14864441,324252164~5470799,335074884~7136019,361716437~8944053,398149810~4235276,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.777 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [11593618~15432919,29748506~5305298,45624426~7872032,76056957~7204520,88954561~8158012,134395486~2907830,159013013~7849399,172033295~3914874,193955615~10552841,217797355~4036766,229292519~420981,239246680~358065,256534876~6233411,263720640~8387376,291274950~14864441,324252164~5470799,335074884~7136019,361716437~8944053,398149810~4235276,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.783 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [10899302~16127235,29748506~5305298,41943040~11553418,76056957~7204520,88080384~9032189,134395486~2907830,155189248~11673164,171966464~3981705,192937984~11570472,213909504~7924617,226492416~3221084,239246680~358065,255852544~16255472,291274950~14864441,324252164~5470799,331350016~10860887,360710144~9950346,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.783 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 6 diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,88954561~8158012,98613212~4405503,134395486~2907830,143708340~245789,159013013~7849399,172033295~3914874,181876927~5768603,193955615~10552841,217797355~4036766,229292519~420981,239246680~358065,256534876~6233411,263720640~8387376,291274950~14864441,312440258~5189012,324252164~5470799,332299113~9911790,361716437~8944053,398149810~4235276,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.783 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,88954561~8158012,98613212~4405503,134395486~2907830,143708340~245789,159013013~7849399,172033295~3914874,181876927~5768603,193955615~10552841,217797355~4036766,229292519~420981,239246680~358065,256534876~6233411,263720640~8387376,291274950~14864441,312440258~5189012,324252164~5470799,332299113~9911790,361716437~8944053,398149810~4235276,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.789 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,10899302~16708570,29748506~5305298,41943040~11553418,68480684~2307263,76056957~7204520,88080384~9032189,98613212~4405503,134395486~2907830,143708340~245789,155189248~11673164,171966464~3981705,181876927~5768603,192937984~11570472,213909504~7924617,226492416~3221084,239246680~358065,255852544~16255472,291274950~14864441,312440258~5189012,324252164~5470799,331350016~10860887,360710144~9950346,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.789 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 7 diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,88954561~8158012,98613212~5557060,130159858~7143458,143708340~245789,159013013~7849399,172033295~3914874,179036474~8609056,193955615~10552841,205420097~4673977,217797355~4036766,229292519~420981,239246680~358065,256534876~6233411,263720640~8387376,276254267~9922366,291274950~14864441,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.789 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,88954561~8158012,98613212~5557060,130159858~7143458,143708340~245789,159013013~7849399,172033295~3914874,179036474~8609056,193955615~10552841,205420097~4673977,217797355~4036766,229292519~420981,239246680~358065,256534876~6233411,263720640~8387376,276254267~9922366,291274950~14864441,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.794 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,10899302~16708570,29748506~5305298,41943040~11553418,68480684~2307263,76056957~7204520,88080384~9032189,98613212~5557060,130023424~7279892,143708340~245789,155189248~11673164,171966464~3981705,176160768~11484762,192937984~11570472,204876947~5217127,213909504~7924617,226492416~3221084,239246680~358065,255852544~16255472,272629760~13546873,291274950~14864441,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,360710144~9950346,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.794 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 8 diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,88954561~8202342,98613212~5557060,130159858~13055243,143708340~245789,159013013~7849399,172033295~15612235,193955615~10552841,205420097~10050418,217797355~4036766,229292519~420981,239246680~358065,249803968~6145524,256534876~6233411,263720640~8387376,276254267~9922366,291274950~14864441,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.794 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,88954561~8202342,98613212~5557060,130159858~13055243,143708340~245789,159013013~7849399,172033295~15612235,193955615~10552841,205420097~10050418,217797355~4036766,229292519~420981,239246680~358065,249803968~6145524,256534876~6233411,263720640~8387376,276254267~9922366,291274950~14864441,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.799 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,10899302~16708570,29748506~5305298,41943040~11553418,68480684~2307263,76056957~7204520,88080384~9076519,98613212~5557060,130023424~13191677,143708340~245789,155189248~11673164,171966464~15679066,192937984~11570472,204876947~16957174,226492416~3221084,239246680~358065,249803968~22304048,272629760~13546873,291274950~14864441,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,360710144~9950346,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.799 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 9 diff [4365840~23242032,29748506~5305298,35630242~1411518,45624426~7872032,68480684~2307263,76056957~7204520,88954561~8202342,98613212~5557060,113958035~4675090,130159858~13055243,143708340~245789,159013013~7849399,172033295~15612235,193955615~10552841,205420097~10050418,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,249803968~6145524,256534876~6233411,263720640~8387376,276254267~9922366,291274950~14864441,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.799 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~23242032,29748506~5305298,35630242~1411518,45624426~7872032,68480684~2307263,76056957~7204520,88954561~8202342,98613212~5557060,113958035~4675090,130159858~13055243,143708340~245789,159013013~7849399,172033295~15612235,193955615~10552841,205420097~10050418,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,249803968~6145524,256534876~6233411,263720640~8387376,276254267~9922366,291274950~14864441,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.805 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~23413568,29748506~7293254,41943040~11553418,68480684~2307263,76056957~7204520,88080384~9076519,98613212~5557060,113246208~5386917,130023424~13191677,143708340~245789,155189248~11673164,171966464~15679066,192937984~11570472,204876947~16957174,226492416~3221084,239246680~358065,249803968~22304048,272629760~13546873,291274950~14864441,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.805 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 10 diff [4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88954561~8202342,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,193955615~10552841,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~15221601,263720640~8387376,276254267~9922366,287567067~386241,291274950~14864441,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.805 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88954561~8202342,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,193955615~10552841,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~15221601,263720640~8387376,276254267~9922366,287567067~386241,291274950~14864441,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.810 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~23413568,29748506~23747952,68480684~2307263,76056957~7204520,88080384~9076519,98613212~5557060,113246208~13945221,130023424~13191677,143708340~245789,155189248~11673164,171966464~15679066,192937984~11570472,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~14864441,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.810 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 11 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~8459077,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,191505225~13003231,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~9922366,287567067~386241,291274950~14864441,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.810 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~8459077,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,191505225~13003231,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~9922366,287567067~386241,291274950~14864441,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.816 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,76056957~7204520,88080384~9076519,98613212~5557060,113246208~13945221,130023424~13191677,143708340~245789,155189248~11673164,171966464~15679066,188743680~15764776,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~14864441,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.816 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 12 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~8459077,98132578~6037694,113048761~14142668,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,191505225~13003231,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~9922366,287567067~386241,291274950~14864441,312440258~5189012,324168256~6864725,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.816 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~8459077,98132578~6037694,113048761~14142668,130159858~13055243,143708340~245789,158983813~7878599,172033295~15612235,191505225~13003231,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~9922366,287567067~386241,291274950~14864441,312440258~5189012,324168256~6864725,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.821 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,76056957~7204520,88080384~9076519,98132578~6037694,111815165~15376264,130023424~13191677,143708340~245789,155189248~11673164,171966464~15679066,188743680~15764776,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~14864441,312440258~5189012,324168256~6864725,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.821 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 13 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~8459077,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~7878599,172033295~15612235,188856643~15651813,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~9922366,287567067~386241,291274950~14864441,312440258~5189012,319248741~11784240,331618892~10592011,343466286~4956235,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.822 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~8459077,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~7878599,172033295~15612235,188856643~15651813,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~9922366,287567067~386241,291274950~14864441,312440258~5189012,319248741~11784240,331618892~10592011,343466286~4956235,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.827 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,76056957~7204520,88080384~9076519,97646638~391752,98132578~6037694,111815165~15376264,130023424~13191677,143653047~2185284,155189248~11673164,171966464~15679066,188743680~15764776,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~14864441,312440258~5189012,318767104~12265877,331350016~22841711,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.827 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 14 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~8459077,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~7878599,172033295~15612235,188856643~15651813,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~14864441,312440258~5189012,319248741~12098279,331618892~10592011,343466286~4956235,351102125~3089602,361047331~9613159,376640344~1055657,381985122~2149966,385613362~3174411,390275045~12110041,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.827 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~8459077,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~7878599,172033295~15612235,188856643~15651813,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~14864441,312440258~5189012,319248741~12098279,331618892~10592011,343466286~4956235,351102125~3089602,361047331~9613159,376640344~1055657,381985122~2149966,385613362~3174411,390275045~12110041,402755542~573723,408112887~8033611] 2024-01-13T18:48:23.832 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,74302896~8958581,88080384~9076519,97646638~391752,98132578~6037694,111815165~15376264,130023424~18666279,150994944~1808705,155189248~11673164,171966464~15679066,188743680~15764776,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~14864441,312440258~5189012,318767104~12579916,331350016~22841711,360710144~9950346,373293056~4402945,381681664~7106109,390070272~12314814,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.832 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 15 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~8459077,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~28661717,188856643~15651813,205218799~16615322,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~14864441,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~2149966,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.833 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~8459077,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~28661717,188856643~15651813,205218799~16615322,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~14864441,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~2149966,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.837 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,74302896~8958581,88080384~9076519,97646638~391752,98132578~6037694,111815165~15376264,130023424~19957536,150994944~1808705,155189248~32456282,188743680~15764776,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~14864441,312440258~5189012,318767104~12579916,331350016~22841711,360710144~9950346,373293056~4402945,381681664~20703422,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.837 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 16 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,67672839~5301161,74302896~8958581,88697826~8459077,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~28661717,188856643~15651813,205218799~16615322,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~14864441,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~3410431,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.838 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,67672839~5301161,74302896~8958581,88697826~8459077,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~28661717,188856643~15651813,205218799~16615322,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~14864441,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~3410431,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.843 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,67672839~5301161,74302896~8958581,88080384~9076519,97646638~391752,98132578~7254464,109038547~1025258,111815165~15376264,130023424~22780225,155189248~32456282,188743680~15764776,204876947~16957174,223272757~1131826,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~14864441,312440258~5189012,318767104~12579916,331350016~22841711,360710144~9950346,373293056~4402945,381681664~20703422,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.843 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 17 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,65173788~7800212,74302896~8958581,88697826~8459077,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~30903822,188856643~15651813,205218799~17443040,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~14864441,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.843 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,65173788~7800212,74302896~8958581,88697826~8459077,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~30903822,188856643~15651813,205218799~17443040,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~14864441,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.848 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,62914560~10059440,74302896~8958581,88080384~9076519,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15764776,204876947~17784892,223272757~1131826,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~14864441,312440258~5189012,318767104~12579916,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.849 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 18 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,57445484~6985145,65173788~7800212,74302896~8958581,84751242~1122101,88697826~8459077,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.849 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,57445484~6985145,65173788~7800212,74302896~8958581,84751242~1122101,88697826~8459077,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.854 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,54525952~18448048,74302896~8958581,83886080~1987263,88080384~9076519,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~5189012,318767104~12579916,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9299010] 2024-01-13T18:48:23.854 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 19 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:23.854 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:23.860 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:23.860 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 3 diff [11593618~15432919,29748506~5305298,173815874~1486860,193955615~9348324,363111336~4238091,398149810~4235276] 2024-01-13T18:48:23.860 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [11593618~15432919,29748506~5305298,173815874~1486860,193955615~9348324,363111336~4238091,398149810~4235276] 2024-01-13T18:48:23.865 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [10899302~16127235,29748506~5305298,171966464~3336270,192937984~10365955,360710144~6639283,394264576~8120510] 2024-01-13T18:48:23.865 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 4 diff [11593618~15432919,29748506~5305298,76056957~7204520,134395486~2907830,173815874~1486860,193955615~10359394,217797355~4036766,239246680~358065,263720640~2233428,324252164~5470799,335074884~6066031,363111336~4238091,398149810~4235276,402755542~573723] 2024-01-13T18:48:23.865 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [11593618~15432919,29748506~5305298,76056957~7204520,134395486~2907830,173815874~1486860,193955615~10359394,217797355~4036766,239246680~358065,263720640~2233428,324252164~5470799,335074884~6066031,363111336~4238091,398149810~4235276,402755542~573723] 2024-01-13T18:48:23.871 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [10899302~16127235,29748506~5305298,76056957~7204520,134395486~2907830,171966464~3336270,192937984~11377025,213909504~7924617,239246680~358065,262768287~3185781,324252164~5470799,331350016~9790899,360710144~6639283,394264576~8120510,402653184~676081] 2024-01-13T18:48:23.871 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 5 diff [11593618~15432919,29748506~5305298,45624426~7872032,76056957~7204520,134395486~2907830,172033295~3914874,193955615~10359394,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,291274950~7750456,324252164~5470799,335074884~7136019,361716437~8944053,398149810~4235276,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.871 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [11593618~15432919,29748506~5305298,45624426~7872032,76056957~7204520,134395486~2907830,172033295~3914874,193955615~10359394,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,291274950~7750456,324252164~5470799,335074884~7136019,361716437~8944053,398149810~4235276,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.876 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [10899302~16127235,29748506~5305298,41943040~11553418,76056957~7204520,134395486~2907830,171966464~3981705,192937984~11377025,213909504~7924617,226492416~3221084,239246680~358065,262768287~9339729,291274950~7750456,324252164~5470799,331350016~10860887,360710144~9950346,394264576~8120510,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.876 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 6 diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,98613212~4405503,134395486~2907830,143708340~245789,172033295~3914874,181876927~5768603,193955615~10359394,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,291274950~7750456,312440258~5189012,324252164~5470799,332299113~9911790,361716437~8944053,398149810~4235276,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.876 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,98613212~4405503,134395486~2907830,143708340~245789,172033295~3914874,181876927~5768603,193955615~10359394,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,291274950~7750456,312440258~5189012,324252164~5470799,332299113~9911790,361716437~8944053,398149810~4235276,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.882 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,10899302~16708570,29748506~5305298,41943040~11553418,68480684~2307263,76056957~7204520,98613212~4405503,134395486~2907830,143708340~245789,171966464~3981705,181876927~5768603,192937984~11377025,213909504~7924617,226492416~3221084,239246680~358065,262768287~9339729,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,360710144~9950346,394264576~8120510,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.882 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 7 diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,98613212~5557060,130159858~7143458,143708340~245789,172033295~3914874,179036474~8609056,193955615~10359394,205420097~4673977,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.882 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,98613212~5557060,130159858~7143458,143708340~245789,172033295~3914874,179036474~8609056,193955615~10359394,205420097~4673977,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.887 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,10899302~16708570,29748506~5305298,41943040~11553418,68480684~2307263,76056957~7204520,98613212~5557060,130023424~7279892,143708340~245789,171966464~3981705,176160768~11484762,192937984~11377025,204876947~5217127,213909504~7924617,226492416~3221084,239246680~358065,262768287~9339729,272629760~13546873,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,360710144~9950346,394264576~8120510,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.888 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 8 diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,130159858~13055243,143708340~245789,172033295~15612235,193955615~10359394,205420097~10050418,217797355~4036766,229292519~420981,239246680~358065,249803968~6145524,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.888 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,11593618~16014254,29748506~5305298,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,130159858~13055243,143708340~245789,172033295~15612235,193955615~10359394,205420097~10050418,217797355~4036766,229292519~420981,239246680~358065,249803968~6145524,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.893 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,10899302~16708570,29748506~5305298,41943040~11553418,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,130023424~13191677,143708340~245789,171966464~15679066,192937984~11377025,204876947~16957174,226492416~3221084,239246680~358065,249803968~6145524,262768287~9339729,272629760~13546873,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,360710144~9950346,390070272~2182422,394264576~8120510,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.893 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 9 diff [4365840~23242032,29748506~5305298,35630242~1411518,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113958035~4675090,130159858~13055243,143708340~245789,172033295~15612235,193955615~10359394,205420097~10050418,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,249803968~6145524,259624261~976473,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.893 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~23242032,29748506~5305298,35630242~1411518,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113958035~4675090,130159858~13055243,143708340~245789,172033295~15612235,193955615~10359394,205420097~10050418,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,249803968~6145524,259624261~976473,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.898 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~23413568,29748506~7293254,41943040~11553418,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113246208~5386917,130023424~13191677,143708340~245789,171966464~15679066,192937984~11377025,204876947~16957174,226492416~3221084,239246680~358065,249803968~6145524,259624261~976473,262768287~9339729,272629760~13546873,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.898 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 10 diff [4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,193955615~10359394,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259624261~976473,263720640~8387376,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.899 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,193955615~10359394,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259624261~976473,263720640~8387376,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.904 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~23413568,29748506~23747952,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113246208~13945221,130023424~13191677,143708340~245789,158983813~6147942,171966464~15679066,192937984~11377025,204876947~16957174,226492416~3221084,239246680~358065,247546686~11170031,259624261~976473,262768287~9339729,272629760~15323548,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.904 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 11 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~3850154,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~12809784,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259207128~12900888,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.904 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~3850154,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~12809784,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259207128~12900888,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.909 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,76056957~7204520,88697826~3850154,95204854~1952049,98613212~5557060,113246208~13945221,130023424~13191677,143708340~245789,158983813~6147942,171966464~15679066,188743680~15571329,204876947~16957174,226492416~3221084,239246680~358065,247546686~11170031,259207128~12900888,272629760~15323548,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.910 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 12 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,98132578~6037694,113048761~14142668,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~12809784,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259207128~12900888,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324168256~6864725,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.910 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,98132578~6037694,113048761~14142668,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~12809784,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259207128~12900888,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324168256~6864725,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.915 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,98132578~6037694,111815165~15376264,130023424~13191677,143708340~245789,158983813~6147942,171966464~15679066,188743680~15571329,204876947~16957174,226492416~3221084,239246680~358065,247546686~11170031,259207128~12900888,272629760~15323548,291274950~7750456,312440258~5189012,324168256~6864725,331350016~10860887,348127232~6064495,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.915 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 13 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~6147942,172033295~15612235,188856643~15458366,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,319248741~11784240,331618892~10592011,343466286~4956235,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.915 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~6147942,172033295~15612235,188856643~15458366,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,319248741~11784240,331618892~10592011,343466286~4956235,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~7978723,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.921 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~13191677,143653047~2185284,158983813~6147942,171966464~15679066,188743680~15571329,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12265877,331350016~22841711,360710144~9950346,373293056~4402945,381681664~7106109,390070272~2182422,394264576~8120510,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.921 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 14 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~6147942,172033295~15612235,188856643~15458366,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~10592011,343466286~4956235,351102125~3089602,361047331~9613159,376640344~1055657,381985122~2149966,385613362~3174411,390275045~12110041,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.921 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~6147942,172033295~15612235,188856643~15458366,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~10592011,343466286~4956235,351102125~3089602,361047331~9613159,376640344~1055657,381985122~2149966,385613362~3174411,390275045~12110041,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:23 smithi084 ceph-mon[119097]: osdmap e1442: 8 total, 8 up, 8 in 2024-01-13T18:48:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:23 smithi084 ceph-mon[116404]: osdmap e1442: 8 total, 8 up, 8 in 2024-01-13T18:48:23.926 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~18666279,150994944~1808705,158983813~6147942,171966464~15679066,188743680~15571329,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12579916,331350016~22841711,360710144~9950346,373293056~4402945,381681664~7106109,390070272~12314814,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.927 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 15 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~6147942,166553978~21091552,188856643~15458366,205218799~16615322,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~2149966,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.927 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~6147942,166553978~21091552,188856643~15458366,205218799~16615322,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~2149966,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.932 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~19957536,150994944~1808705,158983813~6147942,166553978~21091552,188743680~15571329,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12579916,331350016~22841711,360710144~9950346,373293056~4402945,381681664~20703422,402653184~676081,407206533~8939965] 2024-01-13T18:48:23.932 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 16 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,67672839~5301161,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~6147942,166553978~21091552,188856643~15458366,205218799~16615322,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~3410431,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.932 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,67672839~5301161,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~6147942,166553978~21091552,188856643~15458366,205218799~16615322,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~3410431,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.938 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,67672839~5301161,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,111815165~15376264,130023424~22780225,158983813~6147942,166553978~21091552,188743680~15571329,204876947~16957174,223272757~1131826,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12579916,331350016~22841711,360710144~9950346,373293056~4402945,381681664~20703422,402653184~676081,407206533~8939965] 2024-01-13T18:48:23.938 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 17 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,65173788~7800212,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~8390047,166553978~21091552,188856643~15458366,205218799~17443040,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,299142188~5504827,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.938 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,65173788~7800212,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~8390047,166553978~21091552,188856643~15458366,205218799~17443040,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,299142188~5504827,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.943 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,62914560~10059440,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15571329,204876947~17784892,223272757~1131826,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~7750456,299142188~5504827,312440258~5189012,318767104~12579916,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~8939965] 2024-01-13T18:48:23.944 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 18 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,57445484~6985145,65173788~7800212,74302896~8958581,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.944 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~7872032,57445484~6985145,65173788~7800212,74302896~8958581,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~8939965] 2024-01-13T18:48:23.949 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~23747952,54525952~18448048,74302896~8958581,83886080~1987263,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~5189012,318767104~12579916,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~8939965] 2024-01-13T18:48:23.949 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 19 diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:23.949 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:23.954 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:23.954 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 4 diff [76056957~7204520,134395486~2907830,201767691~2547318,217797355~4036766,239246680~358065,263720640~2233428,324252164~5470799,335074884~6066031,402755542~573723] 2024-01-13T18:48:23.954 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [76056957~7204520,134395486~2907830,201767691~2547318,217797355~4036766,239246680~358065,263720640~2233428,324252164~5470799,335074884~6066031,402755542~573723] 2024-01-13T18:48:23.960 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [76056957~7204520,134395486~2907830,201767691~2547318,213909504~7924617,239246680~358065,262768287~3185781,324252164~5470799,331350016~9790899,402653184~676081] 2024-01-13T18:48:23.960 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 5 diff [45624426~7872032,76056957~7204520,134395486~2907830,172033295~3914874,201767691~2547318,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,291274950~7750456,324252164~5470799,335074884~7136019,361716437~8944053,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.960 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [45624426~7872032,76056957~7204520,134395486~2907830,172033295~3914874,201767691~2547318,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,291274950~7750456,324252164~5470799,335074884~7136019,361716437~8944053,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.965 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [41943040~11553418,76056957~7204520,134395486~2907830,172033295~3914874,201767691~2547318,213909504~7924617,226492416~3221084,239246680~358065,262768287~9339729,291274950~7750456,324252164~5470799,331350016~10860887,361716437~8944053,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.966 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 6 diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,76056957~7204520,98613212~4405503,134395486~2907830,143708340~245789,172033295~3914874,181876927~5768603,201767691~2547318,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,291274950~7750456,312440258~5189012,324252164~5470799,332299113~9911790,361716437~8944053,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.966 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,76056957~7204520,98613212~4405503,134395486~2907830,143708340~245789,172033295~3914874,181876927~5768603,201767691~2547318,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,291274950~7750456,312440258~5189012,324252164~5470799,332299113~9911790,361716437~8944053,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.971 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,14654185~3311387,24911569~2696303,41943040~11553418,68480684~2307263,76056957~7204520,98613212~4405503,134395486~2907830,143708340~245789,172033295~3914874,181876927~5768603,201767691~2547318,213909504~7924617,226492416~3221084,239246680~358065,262768287~9339729,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,361716437~8944053,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.971 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 7 diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,76056957~7204520,98613212~5557060,130159858~7143458,143708340~245789,172033295~3914874,179036474~8609056,201767691~2547318,205420097~4673977,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.971 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,76056957~7204520,98613212~5557060,130159858~7143458,143708340~245789,172033295~3914874,179036474~8609056,201767691~2547318,205420097~4673977,217797355~4036766,229292519~420981,239246680~358065,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.977 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,14654185~3311387,24911569~2696303,41943040~11553418,68480684~2307263,76056957~7204520,98613212~5557060,130023424~7279892,143708340~245789,172033295~3914874,176160768~11484762,201767691~2547318,204876947~5217127,213909504~7924617,226492416~3221084,239246680~358065,262768287~9339729,272629760~13546873,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,361716437~8944053,394406363~4095017,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.977 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 8 diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,130159858~13055243,143708340~245789,172033295~15612235,201767691~2547318,205420097~10050418,217797355~4036766,229292519~420981,239246680~358065,249803968~6145524,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,391964709~287985,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.977 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,130159858~13055243,143708340~245789,172033295~15612235,201767691~2547318,205420097~10050418,217797355~4036766,229292519~420981,239246680~358065,249803968~6145524,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,391964709~287985,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.982 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,14654185~3311387,24911569~2696303,41943040~11553418,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,130023424~13191677,143708340~245789,172033295~15612235,201767691~2547318,204876947~16957174,226492416~3221084,239246680~358065,249803968~6145524,262768287~9339729,272629760~13546873,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,361716437~8944053,390070272~2182422,394406363~4095017,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.982 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 9 diff [4365840~13599732,19508956~569624,24911569~2696303,35630242~1411518,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113958035~4675090,130159858~13055243,143708340~245789,172033295~15612235,201767691~2547318,205420097~10050418,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,249803968~6145524,259624261~976473,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.982 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~13599732,19508956~569624,24911569~2696303,35630242~1411518,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113958035~4675090,130159858~13055243,143708340~245789,172033295~15612235,201767691~2547318,205420097~10050418,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,249803968~6145524,259624261~976473,263720640~8387376,276254267~9922366,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.988 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~13771268,19508956~569624,24911569~2696303,35053804~1987956,41943040~11553418,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113246208~5386917,130023424~13191677,143708340~245789,172033295~15612235,201767691~2547318,204876947~16957174,226492416~3221084,239246680~358065,249803968~6145524,259624261~976473,262768287~9339729,272629760~13546873,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,361716437~8944053,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.988 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 10 diff [4365840~13599732,19508956~8098916,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,201767691~2547318,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259624261~976473,263720640~8387376,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.988 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~13599732,19508956~8098916,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,201767691~2547318,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259624261~976473,263720640~8387376,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.993 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~13771268,19508956~8098916,35053804~18442654,68480684~2307263,76056957~7204520,95204854~1952049,98613212~5557060,113246208~13945221,130023424~13191677,143708340~245789,158983813~6147942,172033295~15612235,201767691~2547318,204876947~16957174,226492416~3221084,239246680~358065,247546686~11170031,259624261~976473,262768287~9339729,272629760~15323548,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,361716437~8944053,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.993 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 11 diff [2944435~1232186,4365840~13599732,19508956~8098916,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~3850154,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~2593352,197421980~1034828,201767691~2547318,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259207128~12900888,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.993 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~13599732,19508956~8098916,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~3850154,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~2593352,197421980~1034828,201767691~2547318,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259207128~12900888,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324252164~5470799,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.998 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~13771268,19508956~8098916,35053804~18442654,68480684~2307263,76056957~7204520,88697826~3850154,95204854~1952049,98613212~5557060,113246208~13945221,130023424~13191677,143708340~245789,158983813~6147942,172033295~15612235,188743680~5354897,197421980~1034828,201767691~2547318,204876947~16957174,226492416~3221084,239246680~358065,247546686~11170031,259207128~12900888,272629760~15323548,291274950~7750456,312440258~5189012,324252164~5470799,331350016~10860887,348127232~6064495,361716437~8944053,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,402653184~676081,409952547~6193951] 2024-01-13T18:48:23.999 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 12 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,98132578~6037694,113048761~14142668,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~2593352,197421980~1034828,201767691~2547318,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259207128~12900888,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324168256~6864725,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:23.999 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,98132578~6037694,113048761~14142668,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~2593352,197421980~1034828,201767691~2547318,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~11170031,259207128~12900888,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324168256~6864725,331618892~10592011,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,402755542~573723,409952547~6193951] 2024-01-13T18:48:24.004 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,98132578~6037694,111815165~15376264,130023424~13191677,143708340~245789,158983813~6147942,172033295~15612235,188743680~5354897,197421980~1034828,201767691~2547318,204876947~16957174,226492416~3221084,239246680~358065,247546686~11170031,259207128~12900888,272629760~15323548,291274950~7750456,312440258~5189012,324168256~6864725,331350016~10860887,348127232~6064495,361716437~8944053,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,402653184~676081,409952547~6193951] 2024-01-13T18:48:24.004 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 13 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~6147942,172033295~15612235,188856643~5241934,197421980~1034828,201767691~2547318,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,319248741~11784240,331618892~10592011,343466286~4956235,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,399226595~2346842,402755542~573723,409952547~6193951] 2024-01-13T18:48:24.005 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~6147942,172033295~15612235,188856643~5241934,197421980~1034828,201767691~2547318,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,319248741~11784240,331618892~10592011,343466286~4956235,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,399226595~2346842,402755542~573723,409952547~6193951] 2024-01-13T18:48:24.010 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,68480684~2307263,76056957~7204520,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~13191677,143653047~2185284,158983813~6147942,172033295~15612235,188743680~5354897,197421980~1034828,201767691~2547318,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12265877,331350016~22841711,361716437~8944053,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,399226595~2346842,402653184~676081,409952547~6193951] 2024-01-13T18:48:24.010 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 14 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~6147942,172033295~15612235,188856643~5241934,197421980~1034828,201767691~2547318,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~10592011,343466286~4956235,351102125~3089602,361047331~9613159,376640344~1055657,381985122~2149966,385613362~3174411,390275045~8226335,399226595~2346842,402755542~573723,409952547~6193951] 2024-01-13T18:48:24.010 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~6147942,172033295~15612235,188856643~5241934,197421980~1034828,201767691~2547318,205218799~10251716,217797355~4036766,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~10592011,343466286~4956235,351102125~3089602,361047331~9613159,376640344~1055657,381985122~2149966,385613362~3174411,390275045~8226335,399226595~2346842,402755542~573723,409952547~6193951] 2024-01-13T18:48:24.015 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~18666279,150994944~1808705,158983813~6147942,172033295~15612235,188743680~5354897,197421980~1034828,201767691~2547318,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12579916,331350016~22841711,361047331~9613159,373293056~4402945,381681664~7106109,390070272~8431108,399226595~2346842,402653184~676081,409952547~6193951] 2024-01-13T18:48:24.015 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 15 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,201767691~2547318,205218799~16615322,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~2149966,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~8939965] 2024-01-13T18:48:24.016 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,201767691~2547318,205218799~16615322,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~2149966,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~8939965] 2024-01-13T18:48:24.021 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,68480684~2307263,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~19957536,150994944~1808705,158983813~6147942,166553978~21091552,188743680~5354897,197421980~1034828,201767691~2547318,204876947~16957174,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12579916,331350016~22841711,361047331~9613159,373293056~4402945,381681664~16819716,399226595~2346842,402653184~676081,407206533~8939965] 2024-01-13T18:48:24.021 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 16 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,67672839~5301161,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,201767691~2547318,205218799~16615322,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~3410431,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~8939965] 2024-01-13T18:48:24.021 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,67672839~5301161,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,201767691~2547318,205218799~16615322,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~22572835,361047331~9613159,376640344~1055657,381985122~3410431,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~8939965] 2024-01-13T18:48:24.026 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,67672839~5301161,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,111815165~15376264,130023424~22780225,158983813~6147942,166553978~21091552,188743680~5354897,197421980~1034828,201767691~2547318,204876947~16957174,223272757~1131826,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12579916,331350016~22841711,361047331~9613159,373293056~4402945,381681664~16819716,399226595~2346842,402653184~676081,407206533~8939965] 2024-01-13T18:48:24.026 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 17 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,65173788~7800212,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~8390047,166553978~21091552,188856643~8262749,197421980~1034828,201767691~2547318,205218799~17443040,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,299142188~5504827,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~8939965] 2024-01-13T18:48:24.026 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,65173788~7800212,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~8390047,166553978~21091552,188856643~8262749,197421980~1034828,201767691~2547318,205218799~17443040,223272757~1131826,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,291274950~7750456,299142188~5504827,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~8939965] 2024-01-13T18:48:24.032 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,62914560~10059440,74302896~8958581,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~8375712,197421980~1034828,201767691~2547318,204876947~17784892,223272757~1131826,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,291274950~7750456,299142188~5504827,312440258~5189012,318767104~12579916,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~8939965] 2024-01-13T18:48:24.032 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 18 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,57445484~6985145,65173788~7800212,74302896~8958581,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~8939965] 2024-01-13T18:48:24.032 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,57445484~6985145,65173788~7800212,74302896~8958581,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~5189012,319248741~12098279,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~8939965] 2024-01-13T18:48:24.038 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,54525952~18448048,74302896~8958581,83886080~1987263,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~5189012,318767104~12579916,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~8939965] 2024-01-13T18:48:24.038 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 19 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:24.038 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:24.043 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:24.044 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 5 diff [45624426~7872032,172033295~3914874,229292519~420981,264112753~7995263,291274950~7750456,340817643~1393260,361716437~8944053,409952547~6193951] 2024-01-13T18:48:24.044 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [45624426~7872032,172033295~3914874,229292519~420981,264112753~7995263,291274950~7750456,340817643~1393260,361716437~8944053,409952547~6193951] 2024-01-13T18:48:24.049 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [41943040~11553418,172033295~3914874,226492416~3221084,264112753~7995263,291274950~7750456,340817643~1393260,361716437~8944053,409952547~6193951] 2024-01-13T18:48:24.049 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 6 diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,98613212~4405503,143708340~245789,172033295~3914874,181876927~5768603,229292519~420981,264112753~7995263,291274950~7750456,312440258~5189012,332299113~7998214,340817643~1393260,361716437~8944053,409952547~6193951] 2024-01-13T18:48:24.049 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,98613212~4405503,143708340~245789,172033295~3914874,181876927~5768603,229292519~420981,264112753~7995263,291274950~7750456,312440258~5189012,332299113~7998214,340817643~1393260,361716437~8944053,409952547~6193951] 2024-01-13T18:48:24.054 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,14654185~3311387,24911569~2696303,41943040~11553418,68480684~2307263,98613212~4405503,143708340~245789,172033295~3914874,181876927~5768603,226492416~3221084,264112753~7995263,291274950~7750456,312440258~5189012,332299113~7998214,340817643~1393260,361716437~8944053,409952547~6193951] 2024-01-13T18:48:24.054 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 7 diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,98613212~5557060,130159858~5859778,143708340~245789,172033295~3914874,179036474~8609056,205420097~4673977,229292519~420981,264112753~7995263,276254267~9922366,291274950~7750456,312440258~5189012,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.054 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,98613212~5557060,130159858~5859778,143708340~245789,172033295~3914874,179036474~8609056,205420097~4673977,229292519~420981,264112753~7995263,276254267~9922366,291274950~7750456,312440258~5189012,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.060 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,14654185~3311387,24911569~2696303,41943040~11553418,68480684~2307263,98613212~5557060,130023424~5996212,143708340~245789,172033295~3914874,176160768~11484762,204876947~5217127,226492416~3221084,264112753~7995263,272629760~13546873,291274950~7750456,312440258~5189012,331618892~8678435,340817643~1393260,348127232~6064495,361716437~8944053,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.060 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 8 diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,95204854~1952049,98613212~5557060,130159858~13055243,143708340~245789,172033295~15612235,205420097~10050418,229292519~420981,249803968~6145524,264112753~7995263,276254267~9922366,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,391964709~287985,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.060 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,14654185~3311387,24911569~2696303,45624426~7872032,68480684~2307263,95204854~1952049,98613212~5557060,130159858~13055243,143708340~245789,172033295~15612235,205420097~10050418,229292519~420981,249803968~6145524,264112753~7995263,276254267~9922366,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,391964709~287985,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.065 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,14654185~3311387,24911569~2696303,41943040~11553418,68480684~2307263,95204854~1952049,98613212~5557060,130023424~13191677,143708340~245789,172033295~15612235,204876947~10593568,226492416~3221084,249803968~6145524,264112753~7995263,272629760~13546873,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,348127232~6064495,361716437~8944053,390070272~2182422,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.065 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 9 diff [4365840~13599732,19508956~569624,24911569~2696303,35630242~1411518,45624426~7872032,68480684~2307263,95204854~1952049,98613212~5557060,113958035~4675090,130159858~13055243,143708340~245789,172033295~15612235,203805944~498528,205420097~10050418,227015110~1684466,229292519~420981,249803968~6145524,259624261~976473,264112753~7995263,276254267~9922366,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.065 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~13599732,19508956~569624,24911569~2696303,35630242~1411518,45624426~7872032,68480684~2307263,95204854~1952049,98613212~5557060,113958035~4675090,130159858~13055243,143708340~245789,172033295~15612235,203805944~498528,205420097~10050418,227015110~1684466,229292519~420981,249803968~6145524,259624261~976473,264112753~7995263,276254267~9922366,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.070 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~13771268,19508956~569624,24911569~2696303,35053804~1987956,41943040~11553418,68480684~2307263,95204854~1952049,98613212~5557060,113246208~5386917,130023424~13191677,143708340~245789,172033295~15612235,203805944~498528,204876947~10593568,226492416~3221084,249803968~6145524,259624261~976473,264112753~7995263,272629760~13546873,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,348127232~6064495,361716437~8944053,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.071 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 10 diff [4365840~13599732,19508956~8098916,35630242~6403187,45624426~7872032,68480684~2307263,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,203805944~498528,205218799~10251716,227015110~1684466,229292519~420981,247546686~11170031,259624261~976473,264112753~7995263,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.071 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~13599732,19508956~8098916,35630242~6403187,45624426~7872032,68480684~2307263,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,203805944~498528,205218799~10251716,227015110~1684466,229292519~420981,247546686~11170031,259624261~976473,264112753~7995263,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.076 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~13771268,19508956~8098916,35053804~18442654,68480684~2307263,95204854~1952049,98613212~5557060,113246208~13945221,130023424~13191677,143708340~245789,158983813~6147942,172033295~15612235,203805944~498528,204876947~10593568,226492416~3221084,247546686~11170031,259624261~976473,264112753~7995263,272629760~15323548,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,348127232~6064495,361716437~8944053,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.076 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 11 diff [2944435~1232186,4365840~13599732,19508956~8098916,35630242~6403187,45624426~7872032,68480684~2307263,88697826~3850154,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,229292519~420981,247546686~11170031,259207128~4730798,264112753~7995263,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.076 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~13599732,19508956~8098916,35630242~6403187,45624426~7872032,68480684~2307263,88697826~3850154,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,229292519~420981,247546686~11170031,259207128~4730798,264112753~7995263,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.082 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~13771268,19508956~8098916,35053804~18442654,68480684~2307263,88697826~3850154,95204854~1952049,98613212~5557060,113246208~13945221,130023424~13191677,143708340~245789,158983813~6147942,172033295~15612235,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,226492416~3221084,247546686~11170031,259207128~4730798,264112753~7995263,272629760~15323548,291274950~7750456,312440258~5189012,326962706~1885775,331618892~8678435,340817643~1393260,348127232~6064495,361716437~8944053,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.082 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 12 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,88697826~4440424,95204854~1952049,98132578~6037694,113048761~14142668,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,229292519~420981,247546686~11170031,259207128~4730798,264112753~7995263,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324168256~6864725,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.082 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,88697826~4440424,95204854~1952049,98132578~6037694,113048761~14142668,130159858~13055243,143708340~245789,158983813~6147942,172033295~15612235,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,229292519~420981,247546686~11170031,259207128~4730798,264112753~7995263,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,324168256~6864725,331618892~8678435,340817643~1393260,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.087 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,68480684~2307263,88697826~4440424,95204854~1952049,98132578~6037694,111815165~15376264,130023424~13191677,143708340~245789,158983813~6147942,172033295~15612235,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,226492416~3221084,247546686~11170031,259207128~4730798,264112753~7995263,272629760~15323548,291274950~7750456,312440258~5189012,324168256~6864725,331618892~8678435,340817643~1393260,348127232~6064495,361716437~8944053,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,409952547~6193951] 2024-01-13T18:48:24.087 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 13 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~6147942,172033295~15612235,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,319248741~11784240,331618892~8678435,340817643~1393260,343466286~4956235,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,399226595~2346842,409952547~6193951] 2024-01-13T18:48:24.087 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~6147942,172033295~15612235,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~9922366,287567067~386241,291274950~7750456,312440258~5189012,319248741~11784240,331618892~8678435,340817643~1393260,343466286~4956235,351102125~3089602,361716437~8944053,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,399226595~2346842,409952547~6193951] 2024-01-13T18:48:24.093 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,68480684~2307263,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~13191677,143653047~2185284,158983813~6147942,172033295~15612235,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12265877,331618892~8678435,340817643~13374084,361716437~8944053,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,399226595~2346842,409952547~6193951] 2024-01-13T18:48:24.093 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 14 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~6147942,172033295~15612235,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~8678435,340817643~1393260,343466286~4956235,351102125~3089602,361047331~9613159,376640344~1055657,381985122~2149966,385613362~3174411,390275045~8226335,399226595~2346842,409952547~6193951] 2024-01-13T18:48:24.093 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~6147942,172033295~15612235,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~8678435,340817643~1393260,343466286~4956235,351102125~3089602,361047331~9613159,376640344~1055657,381985122~2149966,385613362~3174411,390275045~8226335,399226595~2346842,409952547~6193951] 2024-01-13T18:48:24.098 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,68480684~2307263,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~18666279,150994944~1808705,158983813~6147942,172033295~15612235,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12579916,331618892~8678435,340817643~13374084,361047331~9613159,373293056~4402945,381681664~7106109,390070272~8431108,399226595~2346842,409952547~6193951] 2024-01-13T18:48:24.098 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 15 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~8678435,340817643~13374084,361047331~9613159,376640344~1055657,381985122~2149966,385613362~4635622,390275045~8226335,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.098 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,68480684~2307263,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~8678435,340817643~13374084,361047331~9613159,376640344~1055657,381985122~2149966,385613362~4635622,390275045~8226335,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.104 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,68480684~2307263,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~19957536,150994944~1808705,158983813~6147942,166553978~21091552,188743680~5354897,197421980~1034828,203805944~498528,204876947~15335810,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12579916,331618892~8678435,340817643~13374084,361047331~9613159,373293056~4402945,381681664~16819716,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.104 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 16 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,223272757~1131826,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~8678435,340817643~13374084,361047331~9613159,376640344~1055657,381985122~3410431,385613362~4635622,390275045~8226335,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.104 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,223272757~1131826,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,291274950~7750456,312440258~5189012,319248741~12098279,331618892~8678435,340817643~13374084,361047331~9613159,376640344~1055657,381985122~3410431,385613362~4635622,390275045~8226335,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.109 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,111815165~15376264,130023424~22780225,158983813~6147942,166553978~21091552,188743680~5354897,197421980~1034828,203805944~498528,204876947~15335810,223272757~1131826,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,291274950~7750456,312440258~5189012,318767104~12579916,331618892~8678435,340817643~13374084,361047331~9613159,373293056~4402945,381681664~16819716,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.109 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 17 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~8390047,166553978~21091552,188856643~8262749,197421980~1034828,203805944~498528,205218799~17443040,223272757~1131826,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,291274950~7750456,299142188~5504827,312440258~5189012,319248741~12098279,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.109 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~8390047,166553978~21091552,188856643~8262749,197421980~1034828,203805944~498528,205218799~17443040,223272757~1131826,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,291274950~7750456,299142188~5504827,312440258~5189012,319248741~12098279,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.114 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,62914560~10059440,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~8375712,197421980~1034828,203805944~498528,204876947~17784892,223272757~1131826,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,291274950~7750456,299142188~5504827,312440258~5189012,318767104~12579916,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.114 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 18 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~5189012,319248741~12098279,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.115 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~7872032,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~5189012,319248741~12098279,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:23 smithi099 ceph-mon[138788]: osdmap e1442: 8 total, 8 up, 8 in 2024-01-13T18:48:24.121 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18442654,54525952~18448048,74302896~2170336,78503521~1316887,83886080~1987263,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~5189012,318767104~12579916,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~8939965] 2024-01-13T18:48:24.121 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 19 diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.121 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.126 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.126 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 6 diff [4365840~3616461,14654185~3311387,24911569~2696303,68480684~2307263,98613212~4405503,143708340~245789,181876927~5768603,312440258~5189012,332299113~7998214] 2024-01-13T18:48:24.126 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,14654185~3311387,24911569~2696303,68480684~2307263,98613212~4405503,143708340~245789,181876927~5768603,312440258~5189012,332299113~7998214] 2024-01-13T18:48:24.132 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,14654185~3311387,24911569~2696303,68480684~2307263,98613212~4405503,143708340~245789,181876927~5768603,312440258~5189012,332299113~7998214] 2024-01-13T18:48:24.132 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 7 diff [4365840~3616461,14654185~3311387,24911569~2696303,68480684~2307263,98613212~5557060,130159858~5859778,143708340~245789,179036474~8609056,205420097~4673977,276254267~9922366,312440258~5189012,331618892~8678435,351102125~3089602,394406363~4095017] 2024-01-13T18:48:24.132 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,14654185~3311387,24911569~2696303,68480684~2307263,98613212~5557060,130159858~5859778,143708340~245789,179036474~8609056,205420097~4673977,276254267~9922366,312440258~5189012,331618892~8678435,351102125~3089602,394406363~4095017] 2024-01-13T18:48:24.137 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,14654185~3311387,24911569~2696303,68480684~2307263,98613212~5557060,130023424~5996212,143708340~245789,176160768~11484762,204876947~5217127,272629760~13546873,312440258~5189012,331618892~8678435,348127232~6064495,394406363~4095017] 2024-01-13T18:48:24.137 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 8 diff [4365840~3616461,14654185~3311387,24911569~2696303,68480684~2307263,95204854~1952049,98613212~5557060,130159858~13055243,143708340~245789,172914405~14731125,205420097~10050418,249803968~6145524,276254267~9922366,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,351102125~3089602,362476731~2718391,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.137 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~3616461,14654185~3311387,24911569~2696303,68480684~2307263,95204854~1952049,98613212~5557060,130159858~13055243,143708340~245789,172914405~14731125,205420097~10050418,249803968~6145524,276254267~9922366,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,351102125~3089602,362476731~2718391,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.142 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~3787997,14654185~3311387,24911569~2696303,68480684~2307263,95204854~1952049,98613212~5557060,130023424~13191677,143708340~245789,172914405~14731125,204876947~10593568,249803968~6145524,272629760~13546873,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,348127232~6064495,362476731~2718391,390070272~2182422,394406363~4095017] 2024-01-13T18:48:24.142 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 9 diff [4365840~13599732,19508956~569624,24911569~2696303,35630242~1411518,68480684~2307263,95204854~1952049,98613212~5557060,113958035~4675090,130159858~13055243,143708340~245789,172914405~14731125,203805944~498528,205420097~10050418,227015110~1684466,249803968~6145524,259624261~976473,276254267~9922366,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.143 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~13599732,19508956~569624,24911569~2696303,35630242~1411518,68480684~2307263,95204854~1952049,98613212~5557060,113958035~4675090,130159858~13055243,143708340~245789,172914405~14731125,203805944~498528,205420097~10050418,227015110~1684466,249803968~6145524,259624261~976473,276254267~9922366,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.148 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~13771268,19508956~569624,24911569~2696303,35053804~1987956,68480684~2307263,95204854~1952049,98613212~5557060,113246208~5386917,130023424~13191677,143708340~245789,172914405~14731125,203805944~498528,204876947~10593568,227015110~1684466,249803968~6145524,259624261~976473,272629760~13546873,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,348127232~6064495,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017] 2024-01-13T18:48:24.148 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 10 diff [4365840~13599732,19508956~8098916,35630242~6403187,68480684~2307263,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172914405~14731125,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259624261~976473,276254267~9922366,287567067~386241,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.148 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4365840~13599732,19508956~8098916,35630242~6403187,68480684~2307263,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172914405~14731125,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259624261~976473,276254267~9922366,287567067~386241,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.153 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~13771268,19508956~8098916,35053804~6979625,68480684~2307263,95204854~1952049,98613212~5557060,113246208~13945221,130023424~13191677,143708340~245789,158983813~6147942,172914405~14731125,203805944~498528,204876947~10593568,227015110~1684466,247546686~11170031,259624261~976473,272629760~15323548,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,348127232~6064495,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017] 2024-01-13T18:48:24.153 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 11 diff [2944435~1232186,4365840~13599732,19508956~8098916,35630242~6403187,68480684~2307263,88697826~3850154,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172914405~14731125,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,276254267~9922366,287567067~386241,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.154 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~13599732,19508956~8098916,35630242~6403187,68480684~2307263,88697826~3850154,95204854~1952049,98613212~5557060,113958035~4675090,119353029~7838400,130159858~13055243,143708340~245789,158983813~6147942,172914405~14731125,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,276254267~9922366,287567067~386241,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.159 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~13771268,19508956~8098916,35053804~6979625,68480684~2307263,88697826~3850154,95204854~1952049,98613212~5557060,113246208~13945221,130023424~13191677,143708340~245789,158983813~6147942,172914405~14731125,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,272629760~15323548,312440258~5189012,326962706~1885775,331618892~8678435,341269978~245901,348127232~6064495,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017] 2024-01-13T18:48:24.159 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 12 diff [2944435~1232186,4365840~23242032,35630242~6403187,68480684~2307263,88697826~4440424,95204854~1952049,98132578~6037694,113048761~14142668,130159858~13055243,143708340~245789,158983813~6147942,172914405~14731125,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,276254267~9922366,287567067~386241,312440258~5189012,324168256~6864725,331618892~8678435,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.159 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,68480684~2307263,88697826~4440424,95204854~1952049,98132578~6037694,113048761~14142668,130159858~13055243,143708340~245789,158983813~6147942,172914405~14731125,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,276254267~9922366,287567067~386241,312440258~5189012,324168256~6864725,331618892~8678435,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.164 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,68480684~2307263,88697826~4440424,95204854~1952049,98132578~6037694,111815165~15376264,130023424~13191677,143708340~245789,158983813~6147942,172914405~14731125,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,272629760~15323548,312440258~5189012,324168256~6864725,331618892~8678435,341269978~245901,348127232~6064495,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017] 2024-01-13T18:48:24.164 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 13 diff [2944435~1232186,4365840~23242032,35630242~6403187,68480684~2307263,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~6147942,172914405~14731125,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,276254267~9922366,287567067~386241,292796827~5355009,312440258~5189012,319248741~11784240,331618892~8678435,341269978~245901,343466286~4956235,351102125~3089602,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,399226595~2346842] 2024-01-13T18:48:24.164 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,68480684~2307263,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~6147942,172914405~14731125,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,276254267~9922366,287567067~386241,292796827~5355009,312440258~5189012,319248741~11784240,331618892~8678435,341269978~245901,343466286~4956235,351102125~3089602,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,399226595~2346842] 2024-01-13T18:48:24.170 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,68480684~2307263,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~13191677,143653047~2185284,158983813~6147942,172914405~14731125,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,292796827~5355009,312440258~5189012,318767104~12265877,331618892~8678435,341269978~245901,342210903~11980824,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,399226595~2346842] 2024-01-13T18:48:24.170 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 14 diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,68480684~2307263,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~6147942,172914405~14731125,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,312440258~5189012,319248741~12098279,331618892~8678435,341269978~245901,343466286~4956235,351102125~3089602,361047331~5147902,376640344~1055657,381985122~2149966,385613362~3174411,390275045~8226335,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.170 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,68480684~2307263,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~6147942,172914405~14731125,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,312440258~5189012,319248741~12098279,331618892~8678435,341269978~245901,343466286~4956235,351102125~3089602,361047331~5147902,376640344~1055657,381985122~2149966,385613362~3174411,390275045~8226335,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.176 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,68480684~2307263,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~18666279,150994944~1808705,158983813~6147942,172914405~14731125,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,292796827~5355009,312440258~5189012,318767104~12579916,331618892~8678435,341269978~245901,342210903~11980824,361047331~5147902,373293056~4402945,381681664~7106109,390070272~8431108,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.176 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 15 diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,68480684~2307263,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,312440258~5189012,319248741~12098279,331618892~8678435,340979426~13212301,361047331~5147902,376640344~1055657,381985122~2149966,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.176 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,68480684~2307263,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,312440258~5189012,319248741~12098279,331618892~8678435,340979426~13212301,361047331~5147902,376640344~1055657,381985122~2149966,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.181 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,68480684~2307263,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~19957536,150994944~1808705,158983813~6147942,166553978~21091552,188743680~5354897,197421980~1034828,203805944~498528,204876947~15335810,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,292796827~5355009,312440258~5189012,318767104~12579916,331618892~8678435,340979426~13212301,361047331~5147902,373293056~4402945,381681664~16819716,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.182 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 16 diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,312440258~5189012,319248741~12098279,331618892~8678435,340979426~13212301,361047331~5147902,376640344~1055657,381985122~3410431,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.182 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~6147942,166553978~21091552,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,312440258~5189012,319248741~12098279,331618892~8678435,340979426~13212301,361047331~5147902,376640344~1055657,381985122~3410431,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.187 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,111815165~15376264,130023424~22780225,158983813~6147942,166553978~21091552,188743680~5354897,197421980~1034828,203805944~498528,204876947~15335810,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,292796827~5355009,312440258~5189012,318767104~12579916,331618892~8678435,340979426~13212301,361047331~5147902,373293056~4402945,381681664~16819716,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.187 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 17 diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~8390047,166553978~21091552,188856643~8262749,197421980~1034828,203805944~498528,205218799~17443040,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,299142188~5504827,312440258~5189012,319248741~12098279,331618892~8678435,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.187 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~8390047,166553978~21091552,188856643~8262749,197421980~1034828,203805944~498528,205218799~17443040,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,299142188~5504827,312440258~5189012,319248741~12098279,331618892~8678435,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.192 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,62914560~10059440,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~8375712,197421980~1034828,203805944~498528,204876947~17784892,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,292796827~5355009,299142188~5504827,312440258~5189012,318767104~12579916,331618892~8678435,340979426~15812194,361047331~5147902,373293056~25208324,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.192 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 18 diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~5189012,319248741~12098279,331618892~8678435,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.193 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~5189012,319248741~12098279,331618892~8678435,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.197 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,54525952~18448048,74302896~2170336,78503521~1316887,83886080~1987263,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~5189012,318767104~12579916,331618892~8678435,340979426~15812194,361047331~5147902,373293056~25208324,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.197 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 19 diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.197 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.203 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.203 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 7 diff [101818516~2351756,130159858~5859778,179036474~7267759,205420097~4673977,276254267~9922366,331618892~7473188,351102125~3089602,394406363~4095017] 2024-01-13T18:48:24.203 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [101818516~2351756,130159858~5859778,179036474~7267759,205420097~4673977,276254267~9922366,331618892~7473188,351102125~3089602,394406363~4095017] 2024-01-13T18:48:24.208 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [101818516~2351756,130023424~5996212,176160768~10143465,204876947~5217127,272629760~13546873,331618892~7473188,348127232~6064495,394406363~4095017] 2024-01-13T18:48:24.209 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 8 diff [95204854~1952049,101818516~2351756,130159858~13055243,172914405~13389828,205420097~10050418,249803968~6145524,276254267~9922366,326962706~1885775,331618892~7473188,341269978~245901,351102125~3089602,362476731~2718391,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.209 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [95204854~1952049,101818516~2351756,130159858~13055243,172914405~13389828,205420097~10050418,249803968~6145524,276254267~9922366,326962706~1885775,331618892~7473188,341269978~245901,351102125~3089602,362476731~2718391,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.214 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [95204854~1952049,101818516~2351756,130023424~13191677,172914405~13389828,204876947~10593568,249803968~6145524,272629760~13546873,326962706~1885775,331618892~7473188,341269978~245901,348127232~6064495,362476731~2718391,390070272~2182422,394406363~4095017] 2024-01-13T18:48:24.214 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 9 diff [7102798~7973877,19508956~569624,35630242~1411518,95204854~1952049,101818516~2351756,113958035~4675090,130159858~13055243,172914405~13389828,203805944~498528,205420097~10050418,227015110~1684466,249803968~6145524,259624261~976473,276254267~9922366,326962706~1885775,331618892~7473188,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.214 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [7102798~7973877,19508956~569624,35630242~1411518,95204854~1952049,101818516~2351756,113958035~4675090,130159858~13055243,172914405~13389828,203805944~498528,205420097~10050418,227015110~1684466,249803968~6145524,259624261~976473,276254267~9922366,326962706~1885775,331618892~7473188,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.219 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [7102798~7973877,19508956~569624,35053804~1987956,95204854~1952049,101818516~2351756,113246208~5386917,130023424~13191677,172914405~13389828,203805944~498528,204876947~10593568,227015110~1684466,249803968~6145524,259624261~976473,272629760~13546873,326962706~1885775,331618892~7473188,341269978~245901,348127232~6064495,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017] 2024-01-13T18:48:24.219 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 10 diff [7102798~7973877,19508956~6921870,35630242~6403187,95204854~1952049,101818516~2351756,113958035~4675090,119353029~7838400,130159858~13055243,158983813~6147942,172914405~13389828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259624261~976473,276254267~9922366,287567067~386241,326962706~1885775,331618892~7473188,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.220 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [7102798~7973877,19508956~6921870,35630242~6403187,95204854~1952049,101818516~2351756,113958035~4675090,119353029~7838400,130159858~13055243,158983813~6147942,172914405~13389828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259624261~976473,276254267~9922366,287567067~386241,326962706~1885775,331618892~7473188,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.225 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [7102798~7973877,19508956~6921870,35053804~6979625,95204854~1952049,101818516~2351756,113246208~13945221,130023424~13191677,158983813~6147942,172914405~13389828,203805944~498528,204876947~10593568,227015110~1684466,247546686~11170031,259624261~976473,272629760~15323548,326962706~1885775,331618892~7473188,341269978~245901,348127232~6064495,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017] 2024-01-13T18:48:24.225 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 11 diff [2944435~1232186,7102798~7973877,19508956~6921870,35630242~6403187,69600439~276969,88697826~3850154,95204854~1952049,101818516~2351756,113958035~4675090,119353029~7838400,130159858~13055243,158983813~6147942,172914405~13894977,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,276254267~9922366,287567067~386241,326962706~1885775,331618892~7473188,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.225 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,19508956~6921870,35630242~6403187,69600439~276969,88697826~3850154,95204854~1952049,101818516~2351756,113958035~4675090,119353029~7838400,130159858~13055243,158983813~6147942,172914405~13894977,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,276254267~9922366,287567067~386241,326962706~1885775,331618892~7473188,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.231 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,19508956~6921870,35053804~6979625,69600439~276969,88697826~3850154,95204854~1952049,101818516~2351756,113246208~13945221,130023424~13191677,158983813~6147942,172914405~13894977,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,272629760~15323548,326962706~1885775,331618892~7473188,341269978~245901,348127232~6064495,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017] 2024-01-13T18:48:24.231 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 12 diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,95204854~1952049,98132578~6037694,113048761~14142668,130159858~13055243,158983813~6147942,172914405~13894977,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,276254267~9922366,287567067~386241,324168256~6864725,331618892~7473188,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.231 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,95204854~1952049,98132578~6037694,113048761~14142668,130159858~13055243,158983813~6147942,172914405~13894977,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,276254267~9922366,287567067~386241,324168256~6864725,331618892~7473188,341269978~245901,351102125~3089602,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017] 2024-01-13T18:48:24.236 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,16001665~10429161,35053804~6979625,69600439~276969,88697826~4440424,95204854~1952049,98132578~6037694,111815165~15376264,130023424~13191677,158983813~6147942,172914405~13894977,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,272629760~15323548,324168256~6864725,331618892~7473188,341269978~245901,348127232~6064495,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017] 2024-01-13T18:48:24.237 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 13 diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~6147942,172914405~13894977,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,276254267~9922366,287567067~386241,292796827~5355009,319248741~11784240,331618892~7473188,341269978~245901,343466286~4956235,351102125~3089602,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,399226595~2346842] 2024-01-13T18:48:24.237 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~13055243,143653047~2185284,158983813~6147942,172914405~13894977,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,276254267~9922366,287567067~386241,292796827~5355009,319248741~11784240,331618892~7473188,341269978~245901,343466286~4956235,351102125~3089602,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,394406363~4095017,399226595~2346842] 2024-01-13T18:48:24.242 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,16001665~10429161,35053804~6979625,69600439~276969,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~13191677,143653047~2185284,158983813~6147942,172914405~13894977,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,292796827~5355009,318767104~12265877,331618892~7473188,341269978~245901,342210903~11980824,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,394406363~4095017,399226595~2346842] 2024-01-13T18:48:24.242 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 14 diff [2944435~1232186,7102798~7973877,15588785~10842041,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~6147942,172914405~13894977,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,319248741~12098279,331618892~7473188,341269978~245901,343466286~4956235,351102125~3089602,361047331~5147902,376640344~1055657,381985122~2149966,385613362~3174411,390275045~8226335,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.242 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,15588785~10842041,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~18529845,152029904~773745,158983813~6147942,172914405~13894977,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,319248741~12098279,331618892~7473188,341269978~245901,343466286~4956235,351102125~3089602,361047331~5147902,376640344~1055657,381985122~2149966,385613362~3174411,390275045~8226335,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.247 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,15588785~10842041,35053804~6979625,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~18666279,150994944~1808705,158983813~6147942,172914405~13894977,188743680~5354897,197421980~1034828,203805944~498528,204876947~10593568,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,292796827~5355009,318767104~12579916,331618892~7473188,341269978~245901,342210903~11980824,361047331~5147902,373293056~4402945,381681664~7106109,390070272~8431108,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.247 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 15 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~6147942,166553978~20255404,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,319248741~12098279,331618892~7473188,340979426~13212301,361047331~5147902,376640344~1055657,381985122~2149966,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.247 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,113048761~14142668,130159858~19821102,152029904~773745,158983813~6147942,166553978~20255404,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,319248741~12098279,331618892~7473188,340979426~13212301,361047331~5147902,376640344~1055657,381985122~2149966,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.253 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~6037694,111815165~15376264,130023424~19957536,150994944~1808705,158983813~6147942,166553978~20255404,188743680~5354897,197421980~1034828,203805944~498528,204876947~15335810,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,292796827~5355009,318767104~12579916,331618892~7473188,340979426~13212301,361047331~5147902,373293056~4402945,381681664~16819716,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.253 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 16 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~6147942,166553978~20255404,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,319248741~12098279,331618892~7473188,340979426~13212301,361047331~5147902,376640344~1055657,381985122~3410431,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.253 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,113048761~14142668,130159858~20851368,151265291~212696,152029904~773745,158983813~6147942,166553978~20255404,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,319248741~12098279,331618892~7473188,340979426~13212301,361047331~5147902,376640344~1055657,381985122~3410431,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.258 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,111815165~15376264,130023424~22780225,158983813~6147942,166553978~20255404,188743680~5354897,197421980~1034828,203805944~498528,204876947~15335810,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,292796827~5355009,318767104~12579916,331618892~7473188,340979426~13212301,361047331~5147902,373293056~4402945,381681664~16819716,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.258 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 17 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~8390047,166553978~20255404,188856643~8262749,197421980~1034828,203805944~498528,205218799~17443040,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,299142188~5504827,319248741~12098279,331618892~7473188,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.258 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~20851368,151265291~212696,152029904~773745,156741708~8390047,166553978~20255404,188856643~8262749,197421980~1034828,203805944~498528,205218799~17443040,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,292796827~5355009,299142188~5504827,319248741~12098279,331618892~7473188,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.264 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,62914560~10059440,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~8375712,197421980~1034828,203805944~498528,204876947~17784892,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,292796827~5355009,299142188~5504827,318767104~12579916,331618892~7473188,340979426~15812194,361047331~5147902,373293056~25208324,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.264 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 18 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,319248741~12098279,331618892~7473188,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.264 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,319248741~12098279,331618892~7473188,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.269 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,54525952~18448048,74302896~2170336,78503521~1316887,83886080~1987263,88697826~4440424,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,318767104~12579916,331618892~7473188,340979426~15812194,361047331~5147902,373293056~25208324,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.269 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 19 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.269 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.275 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.275 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 8 diff [95204854~1952049,130809673~12405428,172914405~6401048,209302586~6167929,249803968~6145524,326962706~1885775,341269978~245901,362476731~2718391,391964709~287985] 2024-01-13T18:48:24.275 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [95204854~1952049,130809673~12405428,172914405~6401048,209302586~6167929,249803968~6145524,326962706~1885775,341269978~245901,362476731~2718391,391964709~287985] 2024-01-13T18:48:24.280 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [95204854~1952049,130809673~12405428,172914405~6401048,209302586~6167929,249803968~6145524,326962706~1885775,341269978~245901,362476731~2718391,390070272~2182422] 2024-01-13T18:48:24.280 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 9 diff [7102798~7973877,19508956~569624,35630242~1411518,95204854~1952049,113958035~4675090,130809673~12405428,172914405~6401048,203805944~498528,209302586~6167929,227015110~1684466,249803968~6145524,259624261~976473,326962706~1885775,341269978~245901,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985] 2024-01-13T18:48:24.280 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [7102798~7973877,19508956~569624,35630242~1411518,95204854~1952049,113958035~4675090,130809673~12405428,172914405~6401048,203805944~498528,209302586~6167929,227015110~1684466,249803968~6145524,259624261~976473,326962706~1885775,341269978~245901,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985] 2024-01-13T18:48:24.285 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [7102798~7973877,19508956~569624,35053804~1987956,95204854~1952049,113246208~5386917,130809673~12405428,172914405~6401048,203805944~498528,209302586~6167929,227015110~1684466,249803968~6145524,259624261~976473,326962706~1885775,341269978~245901,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422] 2024-01-13T18:48:24.285 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 10 diff [7102798~7973877,19508956~6921870,35630242~6403187,95204854~1952049,102376748~1281870,113958035~4675090,119353029~7838400,130809673~12405428,158983813~6147942,172914405~6401048,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259624261~976473,287567067~386241,326962706~1885775,341269978~245901,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,397507568~266959] 2024-01-13T18:48:24.286 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [7102798~7973877,19508956~6921870,35630242~6403187,95204854~1952049,102376748~1281870,113958035~4675090,119353029~7838400,130809673~12405428,158983813~6147942,172914405~6401048,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259624261~976473,287567067~386241,326962706~1885775,341269978~245901,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,397507568~266959] 2024-01-13T18:48:24.291 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [7102798~7973877,19508956~6921870,35053804~6979625,95204854~1952049,102376748~1281870,113246208~13945221,130809673~12405428,158983813~6147942,172914405~6401048,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259624261~976473,286176633~1776675,326962706~1885775,341269978~245901,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,397507568~266959] 2024-01-13T18:48:24.291 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 11 diff [2944435~1232186,7102798~7973877,19508956~6921870,35630242~6403187,69600439~276969,88697826~3850154,95204854~1952049,102376748~1281870,113958035~4675090,119353029~7838400,130809673~12405428,158983813~6147942,172914405~6401048,185632250~1177132,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,287567067~386241,326962706~1885775,335743305~89762,341269978~245901,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,397507568~266959] 2024-01-13T18:48:24.291 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,19508956~6921870,35630242~6403187,69600439~276969,88697826~3850154,95204854~1952049,102376748~1281870,113958035~4675090,119353029~7838400,130809673~12405428,158983813~6147942,172914405~6401048,185632250~1177132,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,287567067~386241,326962706~1885775,335743305~89762,341269978~245901,362476731~2718391,376640344~1055657,385613362~3174411,391964709~287985,397507568~266959] 2024-01-13T18:48:24.297 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,19508956~6921870,35053804~6979625,69600439~276969,88697826~3850154,95204854~1952049,102376748~1281870,113246208~13945221,130809673~12405428,158983813~6147942,172914405~6401048,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,286176633~1776675,326962706~1885775,335743305~89762,341269978~245901,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,397507568~266959] 2024-01-13T18:48:24.297 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 12 diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,95204854~1952049,98132578~3959518,102376748~1281870,113048761~14142668,130809673~12405428,158983813~6147942,172914405~6401048,185632250~1177132,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,287567067~386241,324168256~6864725,335743305~89762,341269978~245901,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,397507568~266959] 2024-01-13T18:48:24.297 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,95204854~1952049,98132578~3959518,102376748~1281870,113048761~14142668,130809673~12405428,158983813~6147942,172914405~6401048,185632250~1177132,191505225~2593352,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,287567067~386241,324168256~6864725,335743305~89762,341269978~245901,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,397507568~266959] 2024-01-13T18:48:24.302 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,16001665~10429161,35053804~6979625,69600439~276969,88697826~4440424,95204854~1952049,98132578~3959518,102376748~1281870,111815165~15376264,130809673~12405428,158983813~6147942,172914405~6401048,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~11170031,259207128~4730798,269226752~2712572,286176633~1776675,324168256~6864725,335743305~89762,341269978~245901,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,397507568~266959] 2024-01-13T18:48:24.302 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 13 diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,130809673~12405428,143653047~2185284,158983813~6147942,172914405~6401048,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,287567067~386241,292796827~5355009,319248741~11784240,335743305~89762,341269978~245901,343466286~4956235,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,397507568~266959,399226595~2346842] 2024-01-13T18:48:24.302 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,130809673~12405428,143653047~2185284,158983813~6147942,172914405~6401048,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,287567067~386241,292796827~5355009,319248741~11784240,335743305~89762,341269978~245901,343466286~4956235,362476731~2718391,376640344~1055657,381985122~2149966,385613362~3174411,391964709~287985,397507568~266959,399226595~2346842] 2024-01-13T18:48:24.307 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,16001665~10429161,35053804~6979625,69600439~276969,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~1281870,111815165~15376264,130809673~12405428,143653047~2185284,158983813~6147942,172914405~6401048,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,286176633~1776675,292796827~5355009,318767104~12265877,335743305~89762,341269978~245901,342210903~6211618,362476731~2718391,373293056~4402945,381681664~7106109,390070272~2182422,397507568~266959,399226595~2346842] 2024-01-13T18:48:24.308 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 14 diff [2944435~1232186,7102798~7973877,15588785~10842041,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,130809673~17880030,152029904~773745,158983813~6147942,172914405~6401048,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,341269978~245901,343466286~4956235,361047331~5147902,376640344~1055657,381985122~2149966,385613362~3174411,390275045~6069287,397507568~266959,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.308 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,15588785~10842041,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,130809673~17880030,152029904~773745,158983813~6147942,172914405~6401048,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,341269978~245901,343466286~4956235,361047331~5147902,376640344~1055657,381985122~2149966,385613362~3174411,390275045~6069287,397507568~266959,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.313 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,15588785~10842041,35053804~6979625,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~1281870,111815165~15376264,130809673~17880030,150994944~1808705,158983813~6147942,172914405~6401048,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~10251716,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,292796827~5355009,318767104~12579916,335743305~89762,341269978~245901,342210903~6211618,361047331~5147902,373293056~4402945,381681664~7106109,390070272~6274060,397507568~266959,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.314 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 15 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,130809673~19171287,152029904~773745,158983813~6147942,166553978~12761475,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,376640344~1055657,381985122~2149966,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.314 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,130809673~19171287,152029904~773745,158983813~6147942,166553978~12761475,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,376640344~1055657,381985122~2149966,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.318 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~1281870,111815165~15376264,130809673~19171287,150994944~1808705,158983813~6147942,166553978~12761475,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~14993958,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,292796827~5355009,318767104~12579916,335743305~89762,340979426~11887367,361047331~5147902,373293056~4402945,381681664~14662668,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.318 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 16 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,113048761~14142668,130809673~20201553,151265291~212696,152029904~773745,158983813~6147942,166553978~12761475,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,376640344~1055657,381985122~3410431,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.319 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,113048761~14142668,130809673~20201553,151265291~212696,152029904~773745,158983813~6147942,166553978~12761475,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~14993958,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,376640344~1055657,381985122~3410431,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.324 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,111815165~15376264,130809673~21993976,158983813~6147942,166553978~12761475,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~14993958,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,292796827~5355009,318767104~12579916,335743305~89762,340979426~11887367,361047331~5147902,373293056~4402945,381681664~14662668,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.324 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 17 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20201553,151265291~212696,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~8262749,197421980~1034828,203805944~498528,205218799~17443040,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,299142188~5504827,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.324 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20201553,151265291~212696,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~8262749,197421980~1034828,203805944~498528,205218799~17443040,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,299142188~5504827,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.330 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,62914560~10059440,74302896~2170336,78503521~1316887,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~8375712,197421980~1034828,203805944~498528,205218799~17443040,223272757~1131826,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,292796827~5355009,299142188~5504827,318767104~12579916,335743305~89762,340979426~15812194,361047331~5147902,373293056~23051276,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.330 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 18 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.330 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.335 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,54525952~18448048,74302896~2170336,78503521~1316887,83886080~1987263,88697826~4440424,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,318767104~12579916,335743305~89762,340979426~15812194,361047331~5147902,373293056~23051276,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.335 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 19 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.335 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.341 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 9 diff [7102798~7973877,19508956~569624,35630242~1411518,113958035~4675090,203805944~498528,227015110~1684466,259624261~976473,376640344~1055657,385613362~3174411] 2024-01-13T18:48:24.341 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [7102798~7973877,19508956~569624,35630242~1411518,113958035~4675090,203805944~498528,227015110~1684466,259624261~976473,376640344~1055657,385613362~3174411] 2024-01-13T18:48:24.346 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [7102798~7973877,19508956~569624,35053804~1987956,113246208~5386917,203805944~498528,227015110~1684466,259624261~976473,373293056~4402945,381681664~7106109] 2024-01-13T18:48:24.346 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 10 diff [7102798~7973877,19508956~6921870,35630242~6403187,102376748~1281870,113958035~4675090,119353029~7838400,158983813~6147942,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,254416539~4300178,259624261~976473,287567067~386241,376640344~1055657,385613362~3174411,397507568~266959] 2024-01-13T18:48:24.346 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [7102798~7973877,19508956~6921870,35630242~6403187,102376748~1281870,113958035~4675090,119353029~7838400,158983813~6147942,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,254416539~4300178,259624261~976473,287567067~386241,376640344~1055657,385613362~3174411,397507568~266959] 2024-01-13T18:48:24.351 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [7102798~7973877,19508956~6921870,35053804~6979625,102376748~1281870,113246208~13945221,158983813~6147942,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,254416539~4300178,259624261~976473,286176633~1776675,373293056~4402945,381681664~7106109,397507568~266959] 2024-01-13T18:48:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 11 diff [2944435~1232186,7102798~7973877,19508956~6921870,35630242~6403187,69600439~276969,88697826~3850154,102376748~1281870,113958035~4675090,119353029~7838400,158983813~6147942,185632250~1177132,191505225~2593352,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,254416539~4300178,259207128~4730798,269226752~2712572,287567067~386241,335743305~89762,376640344~1055657,385613362~3174411,397507568~266959] 2024-01-13T18:48:24.352 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,19508956~6921870,35630242~6403187,69600439~276969,88697826~3850154,102376748~1281870,113958035~4675090,119353029~7838400,158983813~6147942,185632250~1177132,191505225~2593352,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,254416539~4300178,259207128~4730798,269226752~2712572,287567067~386241,335743305~89762,376640344~1055657,385613362~3174411,397507568~266959] 2024-01-13T18:48:24.357 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,19508956~6921870,35053804~6979625,69600439~276969,88697826~3850154,102376748~1281870,113246208~13945221,158983813~6147942,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,254416539~4300178,259207128~4730798,269226752~2712572,286176633~1776675,335743305~89762,373293056~4402945,381681664~7106109,397507568~266959] 2024-01-13T18:48:24.357 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 12 diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,98132578~3959518,102376748~1281870,113048761~14142668,158983813~6147942,185632250~1177132,191505225~2593352,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,253406819~5309898,259207128~4730798,269226752~2712572,287567067~386241,324168256~6864725,335743305~89762,376640344~1055657,381985122~2149966,385613362~3174411,397507568~266959] 2024-01-13T18:48:24.357 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,98132578~3959518,102376748~1281870,113048761~14142668,158983813~6147942,185632250~1177132,191505225~2593352,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,253406819~5309898,259207128~4730798,269226752~2712572,287567067~386241,324168256~6864725,335743305~89762,376640344~1055657,381985122~2149966,385613362~3174411,397507568~266959] 2024-01-13T18:48:24.362 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,16001665~10429161,35053804~6979625,69600439~276969,88697826~4440424,98132578~3959518,102376748~1281870,111815165~15376264,158983813~6147942,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,253406819~5309898,259207128~4730798,269226752~2712572,286176633~1776675,324168256~6864725,335743305~89762,373293056~4402945,381681664~7106109,397507568~266959] 2024-01-13T18:48:24.362 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 13 diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,143653047~2185284,158983813~6147942,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,287567067~386241,292796827~5355009,319248741~11784240,335743305~89762,343466286~4956235,376640344~1055657,381985122~2149966,385613362~3174411,397507568~266959,399226595~2346842] 2024-01-13T18:48:24.363 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,16001665~10429161,35630242~6403187,69600439~276969,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,143653047~2185284,158983813~6147942,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,287567067~386241,292796827~5355009,319248741~11784240,335743305~89762,343466286~4956235,376640344~1055657,381985122~2149966,385613362~3174411,397507568~266959,399226595~2346842] 2024-01-13T18:48:24.368 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,16001665~10429161,35053804~6979625,69600439~276969,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,111815165~15376264,143653047~2185284,158983813~6147942,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,286176633~1776675,292796827~5355009,318767104~12265877,335743305~89762,342210903~6211618,373293056~4402945,381681664~7106109,397507568~266959,399226595~2346842] 2024-01-13T18:48:24.368 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 14 diff [2944435~1232186,7102798~7973877,15588785~10842041,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,140941849~7747854,152029904~773745,158983813~6147942,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,343466286~4956235,361047331~5147902,376640344~1055657,381985122~2149966,385613362~3174411,390275045~6069287,397507568~266959,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.368 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~7973877,15588785~10842041,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,140941849~7747854,152029904~773745,158983813~6147942,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,343466286~4956235,361047331~5147902,376640344~1055657,381985122~2149966,385613362~3174411,390275045~6069287,397507568~266959,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.374 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~7973877,15588785~10842041,35053804~6979625,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,111815165~15376264,140941849~7747854,150994944~1808705,158983813~6147942,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~6779928,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,292796827~5355009,318767104~12579916,335743305~89762,342210903~6211618,361047331~5147902,373293056~4402945,381681664~7106109,390275045~6069287,397507568~266959,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.374 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 15 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,140941849~9039111,152029904~773745,158983813~6147942,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~6779928,214537834~5674923,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,376640344~1055657,381985122~2149966,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.374 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,140941849~9039111,152029904~773745,158983813~6147942,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~6779928,214537834~5674923,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,376640344~1055657,381985122~2149966,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.379 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,111815165~15376264,140941849~9039111,150994944~1808705,158983813~6147942,166553978~6404534,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~6779928,214537834~5674923,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,292796827~5355009,318767104~12579916,335743305~89762,340979426~11887367,361047331~5147902,373293056~4402945,381681664~8567320,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.379 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 16 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,113048761~14142668,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,158983813~6147942,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~6779928,214537834~5674923,223272757~1131826,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,376640344~1055657,381985122~3410431,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.379 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,113048761~14142668,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,158983813~6147942,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,203805944~498528,205218799~6779928,214537834~5674923,223272757~1131826,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,376640344~1055657,381985122~3410431,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.384 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,111815165~15376264,131564029~101367,140941849~11861800,158983813~6147942,166553978~6404534,185632250~1177132,188743680~5354897,197421980~1034828,203805944~498528,205218799~6779928,214537834~5674923,223272757~1131826,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,292796827~5355009,318767104~12579916,335743305~89762,340979426~11887367,361047331~5147902,373293056~4402945,381681664~8567320,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.384 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 17 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~8262749,197421980~1034828,203805944~498528,205218799~6779928,214537834~8124005,223272757~1131826,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,299142188~5504827,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.384 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~8262749,197421980~1034828,203805944~498528,205218799~6779928,214537834~8124005,223272757~1131826,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,299142188~5504827,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.390 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,62914560~10059440,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~8375712,197421980~1034828,203805944~498528,205218799~6779928,214537834~8124005,223272757~1131826,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,292796827~5355009,299142188~5504827,318767104~12579916,335743305~89762,340979426~15812194,361047331~5147902,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.390 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 18 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~6779928,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.390 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~6779928,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.396 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,54525952~18448048,74302896~2170336,78503521~1316887,83886080~1987263,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~6779928,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,318767104~12579916,335743305~89762,340979426~15812194,361047331~5147902,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.396 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 19 diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.396 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.402 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.402 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 10 diff [19803763~6627063,35727014~6306415,102376748~1281870,119353029~7838400,158983813~6147942,205218799~6779928,247546686~2370730,254416539~4300178,287567067~386241,397507568~266959] 2024-01-13T18:48:24.402 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [19803763~6627063,35727014~6306415,102376748~1281870,119353029~7838400,158983813~6147942,205218799~6779928,247546686~2370730,254416539~4300178,287567067~386241,397507568~266959] 2024-01-13T18:48:24.407 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [19803763~6627063,35727014~6306415,102376748~1281870,118633125~8558304,158983813~6147942,205218799~6779928,247546686~2370730,254416539~4300178,286176633~1776675,397507568~266959] 2024-01-13T18:48:24.407 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 11 diff [2944435~1232186,19803763~6627063,35727014~6306415,69600439~276969,88697826~3850154,102376748~1281870,119353029~7838400,158983813~6147942,185632250~1177132,191505225~2593352,197421980~1034828,205218799~6779928,247546686~2370730,254416539~4300178,259207128~4730798,269226752~2712572,287567067~386241,335743305~89762,397507568~266959] 2024-01-13T18:48:24.407 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,19803763~6627063,35727014~6306415,69600439~276969,88697826~3850154,102376748~1281870,119353029~7838400,158983813~6147942,185632250~1177132,191505225~2593352,197421980~1034828,205218799~6779928,247546686~2370730,254416539~4300178,259207128~4730798,269226752~2712572,287567067~386241,335743305~89762,397507568~266959] 2024-01-13T18:48:24.412 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,19803763~6627063,35727014~6306415,69600439~276969,88697826~3850154,102376748~1281870,118633125~8558304,158983813~6147942,185632250~1177132,188743680~5354897,197421980~1034828,205218799~6779928,247546686~2370730,254416539~4300178,259207128~4730798,269226752~2712572,286176633~1776675,335743305~89762,397507568~266959] 2024-01-13T18:48:24.412 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 12 diff [2944435~1232186,8756101~890404,16001665~10429161,35727014~6306415,69600439~276969,88697826~4440424,98132578~3959518,102376748~1281870,113048761~14142668,158983813~6147942,185632250~1177132,191505225~2593352,197421980~1034828,205218799~6779928,247546686~2370730,253406819~5309898,259207128~4730798,269226752~2712572,287567067~386241,324168256~6864725,335743305~89762,381985122~2149966,397507568~266959] 2024-01-13T18:48:24.412 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,16001665~10429161,35727014~6306415,69600439~276969,88697826~4440424,98132578~3959518,102376748~1281870,113048761~14142668,158983813~6147942,185632250~1177132,191505225~2593352,197421980~1034828,205218799~6779928,247546686~2370730,253406819~5309898,259207128~4730798,269226752~2712572,287567067~386241,324168256~6864725,335743305~89762,381985122~2149966,397507568~266959] 2024-01-13T18:48:24.417 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,16001665~10429161,35727014~6306415,69600439~276969,88697826~4440424,98132578~3959518,102376748~1281870,111815165~15376264,158983813~6147942,185632250~1177132,188743680~5354897,197421980~1034828,205218799~6779928,247546686~2370730,253406819~5309898,259207128~4730798,269226752~2712572,286176633~1776675,324168256~6864725,335743305~89762,381985122~2149966,397507568~266959] 2024-01-13T18:48:24.417 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 13 diff [2944435~1232186,8756101~890404,16001665~10429161,35727014~6306415,69600439~276969,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,143653047~2185284,158983813~6147942,185632250~1177132,188856643~5241934,197421980~1034828,205218799~6779928,247546686~2370730,253406819~10531107,263989353~7949971,287567067~386241,292796827~5355009,319248741~11784240,335743305~89762,343466286~4956235,381985122~2149966,397507568~266959,399226595~2346842] 2024-01-13T18:48:24.417 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,16001665~10429161,35727014~6306415,69600439~276969,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,143653047~2185284,158983813~6147942,185632250~1177132,188856643~5241934,197421980~1034828,205218799~6779928,247546686~2370730,253406819~10531107,263989353~7949971,287567067~386241,292796827~5355009,319248741~11784240,335743305~89762,343466286~4956235,381985122~2149966,397507568~266959,399226595~2346842] 2024-01-13T18:48:24.423 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,16001665~10429161,35727014~6306415,69600439~276969,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,111815165~15376264,143653047~2185284,158983813~6147942,185632250~1177132,188743680~5354897,197421980~1034828,205218799~6779928,247546686~2370730,253406819~10531107,263989353~7949971,286176633~1776675,292796827~5355009,318767104~12265877,335743305~89762,342210903~6211618,381985122~2149966,397507568~266959,399226595~2346842] 2024-01-13T18:48:24.423 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 14 diff [2944435~1232186,8756101~890404,15588785~10842041,35727014~6306415,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,140941849~7747854,152029904~773745,158983813~6147942,185632250~1177132,188856643~5241934,197421980~1034828,205218799~6779928,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,343466286~4956235,361047331~5147902,381985122~2149966,390275045~6069287,397507568~266959,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.423 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,15588785~10842041,35727014~6306415,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,140941849~7747854,152029904~773745,158983813~6147942,185632250~1177132,188856643~5241934,197421980~1034828,205218799~6779928,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,343466286~4956235,361047331~5147902,381985122~2149966,390275045~6069287,397507568~266959,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.429 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,15588785~10842041,35727014~6306415,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,111815165~15376264,140941849~7747854,150994944~1808705,158983813~6147942,185632250~1177132,188743680~5354897,197421980~1034828,205218799~6779928,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,292796827~5355009,318767104~12579916,335743305~89762,342210903~6211618,361047331~5147902,381985122~2149966,390275045~6069287,397507568~266959,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.429 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 15 diff [2944435~1232186,8756101~890404,13002730~13428096,35727014~6306415,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,140941849~9039111,152029904~773745,158983813~6147942,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,205218799~6779928,214537834~5674923,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,381985122~2149966,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.429 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,13002730~13428096,35727014~6306415,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,113048761~14142668,140941849~9039111,152029904~773745,158983813~6147942,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,205218799~6779928,214537834~5674923,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,381985122~2149966,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.434 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,13002730~13428096,35727014~6306415,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~1281870,111815165~15376264,140941849~9039111,150994944~1808705,158983813~6147942,166553978~6404534,185632250~1177132,188743680~5354897,197421980~1034828,205218799~6779928,214537834~5674923,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,292796827~5355009,318767104~12579916,335743305~89762,340979426~11887367,361047331~5147902,381985122~2149966,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.434 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 16 diff [2944435~1232186,8756101~890404,13002730~13428096,35727014~6306415,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,113048761~14142668,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,158983813~6147942,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,205218799~6779928,214537834~5674923,223272757~1131826,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,381985122~3410431,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.434 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,13002730~13428096,35727014~6306415,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,113048761~14142668,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,158983813~6147942,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,205218799~6779928,214537834~5674923,223272757~1131826,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,381985122~3410431,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.439 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,13002730~13428096,35727014~6306415,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,111815165~15376264,131564029~101367,140941849~11861800,158983813~6147942,166553978~6404534,185632250~1177132,188743680~5354897,197421980~1034828,205218799~6779928,214537834~5674923,223272757~1131826,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,292796827~5355009,318767104~12579916,335743305~89762,340979426~11887367,361047331~5147902,381985122~3410431,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.439 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 17 diff [2944435~1232186,8756101~890404,13002730~13428096,35727014~6306415,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~8262749,197421980~1034828,205218799~6779928,214537834~8124005,223272757~1131826,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,299142188~5504827,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.440 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,13002730~13428096,35727014~6306415,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~8262749,197421980~1034828,205218799~6779928,214537834~8124005,223272757~1131826,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,292796827~5355009,299142188~5504827,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.445 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,13002730~13428096,35727014~6306415,45900944~2844563,62914560~10059440,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~8375712,197421980~1034828,205218799~6779928,214537834~8124005,223272757~1131826,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,292796827~5355009,299142188~5504827,318767104~12579916,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.445 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 18 diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~6779928,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.445 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~6779928,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.451 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,54525952~18448048,74302896~2170336,78503521~1316887,83886080~1987263,88697826~4440424,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~6779928,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,318767104~12579916,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.451 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 19 diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.451 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.456 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.456 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 11 diff [2944435~1232186,69600439~276969,88697826~3850154,185632250~1177132,191505225~2593352,197421980~1034828,259207128~4730798,269226752~2712572,335743305~89762] 2024-01-13T18:48:24.456 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,69600439~276969,88697826~3850154,185632250~1177132,191505225~2593352,197421980~1034828,259207128~4730798,269226752~2712572,335743305~89762] 2024-01-13T18:48:24.462 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,69600439~276969,88697826~3850154,185632250~1177132,188743680~5354897,197421980~1034828,259207128~4730798,269226752~2712572,335743305~89762] 2024-01-13T18:48:24.462 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 12 diff [2944435~1232186,8756101~890404,16001665~6917915,35739606~3620200,69600439~276969,88697826~4440424,98132578~3959518,113048761~7114609,185632250~1177132,191505225~2593352,197421980~1034828,253406819~1741280,257183390~600882,259207128~4730798,269226752~2712572,324168256~6864725,335743305~89762,381985122~2149966] 2024-01-13T18:48:24.462 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,16001665~6917915,35739606~3620200,69600439~276969,88697826~4440424,98132578~3959518,113048761~7114609,185632250~1177132,191505225~2593352,197421980~1034828,253406819~1741280,257183390~600882,259207128~4730798,269226752~2712572,324168256~6864725,335743305~89762,381985122~2149966] 2024-01-13T18:48:24.467 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,16001665~6917915,35739606~3620200,69600439~276969,88697826~4440424,98132578~3959518,111815165~8348205,185632250~1177132,188743680~5354897,197421980~1034828,253406819~1741280,257183390~600882,259207128~4730798,269226752~2712572,324168256~6864725,335743305~89762,381985122~2149966] 2024-01-13T18:48:24.467 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 13 diff [2944435~1232186,8756101~890404,16001665~6917915,35739606~3620200,69600439~276969,88697826~4440424,97646638~391752,98132578~3959518,113048761~7114609,143653047~2185284,185632250~1177132,188856643~5241934,197421980~1034828,253406819~10531107,263989353~7949971,292796827~5355009,319248741~11784240,335743305~89762,343466286~4956235,381985122~2149966,399226595~2346842] 2024-01-13T18:48:24.467 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,16001665~6917915,35739606~3620200,69600439~276969,88697826~4440424,97646638~391752,98132578~3959518,113048761~7114609,143653047~2185284,185632250~1177132,188856643~5241934,197421980~1034828,253406819~10531107,263989353~7949971,292796827~5355009,319248741~11784240,335743305~89762,343466286~4956235,381985122~2149966,399226595~2346842] 2024-01-13T18:48:24.473 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,16001665~6917915,35739606~3620200,69600439~276969,88697826~4440424,97646638~391752,98132578~3959518,111815165~8348205,143653047~2185284,185632250~1177132,188743680~5354897,197421980~1034828,253406819~10531107,263989353~7949971,292796827~5355009,318767104~12265877,335743305~89762,342210903~6211618,381985122~2149966,399226595~2346842] 2024-01-13T18:48:24.474 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 14 diff [2944435~1232186,8756101~890404,15588785~7330795,35739606~3620200,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,97646638~391752,98132578~3959518,113048761~7114609,140941849~7747854,152029904~773745,185632250~1177132,188856643~5241934,197421980~1034828,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,319248741~12098279,335743305~89762,343466286~4956235,361047331~5147902,381985122~2149966,390275045~6069287,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.474 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,15588785~7330795,35739606~3620200,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,97646638~391752,98132578~3959518,113048761~7114609,140941849~7747854,152029904~773745,185632250~1177132,188856643~5241934,197421980~1034828,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,319248741~12098279,335743305~89762,343466286~4956235,361047331~5147902,381985122~2149966,390275045~6069287,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.478 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,15588785~7330795,35739606~3620200,45900944~2844563,69600439~276969,74302896~2170336,88697826~4440424,97646638~391752,98132578~3959518,111815165~8348205,140941849~7747854,150994944~1808705,185632250~1177132,188743680~5354897,197421980~1034828,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,318767104~12579916,335743305~89762,342210903~6211618,361047331~5147902,381985122~2149966,390275045~6069287,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.478 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 15 diff [2944435~1232186,8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,113048761~7114609,140941849~9039111,152029904~773745,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,214537834~5674923,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,381985122~2149966,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.478 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,113048761~7114609,140941849~9039111,152029904~773745,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,214537834~5674923,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,381985122~2149966,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.484 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,69600439~276969,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,111815165~8348205,140941849~9039111,150994944~1808705,166553978~6404534,185632250~1177132,188743680~5354897,197421980~1034828,214537834~5674923,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,318767104~12579916,335743305~89762,340979426~11887367,361047331~5147902,381985122~2149966,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.484 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 16 diff [2944435~1232186,8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,113048761~7114609,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,214537834~5674923,223272757~1131826,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,381985122~3410431,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.484 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,113048761~7114609,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,166553978~6404534,185632250~1177132,188856643~5241934,197421980~1034828,214537834~5674923,223272757~1131826,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,319248741~12098279,335743305~89762,340979426~11887367,361047331~5147902,381985122~3410431,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.489 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,111815165~8348205,131564029~101367,140941849~11861800,166553978~6404534,185632250~1177132,188743680~5354897,197421980~1034828,214537834~5674923,223272757~1131826,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,318767104~12579916,335743305~89762,340979426~11887367,361047331~5147902,381985122~3410431,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.489 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 17 diff [2944435~1232186,8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~4624986,166553978~6404534,175725121~1001214,185632250~1177132,188856643~8262749,197421980~1034828,214537834~8124005,223272757~1131826,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,299142188~5504827,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.490 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~4624986,166553978~6404534,175725121~1001214,185632250~1177132,188856643~8262749,197421980~1034828,214537834~8124005,223272757~1131826,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,299142188~5504827,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.495 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,62914560~10059440,74302896~2170336,78503521~1316887,88697826~4440424,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~4624986,166553978~6404534,175725121~1001214,185632250~1177132,188743680~8375712,197421980~1034828,214537834~8124005,223272757~1131826,253406819~10531107,263989353~7949971,279973420~6776407,292796827~5355009,299142188~5504827,318767104~12579916,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.495 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 18 diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.495 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,88697826~4440424,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,319248741~12098279,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.503 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,54525952~18448048,74302896~2170336,78503521~1316887,83886080~1987263,88697826~4440424,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,318767104~12579916,335743305~89762,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.503 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 19 diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.503 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.506 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.506 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 12 diff [8756101~890404,16001665~6917915,35739606~3620200,90587997~2550253,98132578~3959518,113048761~7114609,253406819~1741280,257183390~600882,324168256~6864725,381985122~2149966] 2024-01-13T18:48:24.506 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~890404,16001665~6917915,35739606~3620200,90587997~2550253,98132578~3959518,113048761~7114609,253406819~1741280,257183390~600882,324168256~6864725,381985122~2149966] 2024-01-13T18:48:24.511 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~890404,16001665~6917915,35739606~3620200,90587997~2550253,98132578~3959518,111815165~8348205,253406819~1741280,257183390~600882,324168256~6864725,381985122~2149966] 2024-01-13T18:48:24.511 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 13 diff [8756101~890404,16001665~6917915,35739606~3620200,90587997~2550253,97646638~391752,98132578~3959518,113048761~7114609,143653047~2185284,188856643~2843252,253406819~7162814,263989353~7101983,292796827~5355009,319248741~11784240,343466286~4956235,381985122~2149966,399226595~2346842] 2024-01-13T18:48:24.512 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~890404,16001665~6917915,35739606~3620200,90587997~2550253,97646638~391752,98132578~3959518,113048761~7114609,143653047~2185284,188856643~2843252,253406819~7162814,263989353~7101983,292796827~5355009,319248741~11784240,343466286~4956235,381985122~2149966,399226595~2346842] 2024-01-13T18:48:24.517 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~890404,16001665~6917915,35739606~3620200,90587997~2550253,97646638~391752,98132578~3959518,111815165~8348205,143653047~2185284,188856643~2843252,253406819~7162814,263989353~7101983,292796827~5355009,318767104~12265877,342210903~6211618,381985122~2149966,399226595~2346842] 2024-01-13T18:48:24.517 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 14 diff [8756101~890404,15588785~7330795,35739606~3620200,45900944~2844563,74302896~2170336,90587997~2550253,97646638~391752,98132578~3959518,113048761~7114609,140941849~7747854,152029904~773745,188856643~2843252,253406819~7162814,263989353~7101983,279973420~6776407,292796827~5355009,319248741~12098279,343466286~4956235,361047331~5147902,381985122~2149966,390275045~6069287,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.517 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~890404,15588785~7330795,35739606~3620200,45900944~2844563,74302896~2170336,90587997~2550253,97646638~391752,98132578~3959518,113048761~7114609,140941849~7747854,152029904~773745,188856643~2843252,253406819~7162814,263989353~7101983,279973420~6776407,292796827~5355009,319248741~12098279,343466286~4956235,361047331~5147902,381985122~2149966,390275045~6069287,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.524 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~890404,15588785~7330795,35739606~3620200,45900944~2844563,74302896~2170336,90587997~2550253,97646638~391752,98132578~3959518,111815165~8348205,140941849~7747854,150994944~1808705,188856643~2843252,253406819~7162814,263989353~7101983,279973420~6776407,292796827~5355009,318767104~12579916,342210903~6211618,361047331~5147902,381985122~2149966,390275045~6069287,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.524 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 15 diff [8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,74302896~2170336,78503521~1316887,90587997~2550253,97646638~391752,98132578~3959518,113048761~7114609,140941849~9039111,152029904~773745,166553978~6404534,188856643~2843252,214537834~5674923,253406819~8933554,263989353~7101983,279973420~6776407,292796827~5355009,319248741~12098279,340979426~11887367,361047331~5147902,381985122~2149966,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.524 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,74302896~2170336,78503521~1316887,90587997~2550253,97646638~391752,98132578~3959518,113048761~7114609,140941849~9039111,152029904~773745,166553978~6404534,188856643~2843252,214537834~5674923,253406819~8933554,263989353~7101983,279973420~6776407,292796827~5355009,319248741~12098279,340979426~11887367,361047331~5147902,381985122~2149966,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.528 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,74302896~2170336,78503521~1316887,90587997~2550253,97646638~391752,98132578~3959518,111815165~8348205,140941849~9039111,150994944~1808705,166553978~6404534,188856643~2843252,214537834~5674923,253406819~8933554,263989353~7101983,279973420~6776407,292796827~5355009,318767104~12579916,340979426~11887367,361047331~5147902,381985122~2149966,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.528 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 16 diff [8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,90587997~2550253,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,113048761~7114609,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,166553978~6404534,188856643~2843252,214537834~5674923,223272757~1131826,253406819~8933554,263989353~7101983,279973420~6776407,292796827~5355009,319248741~12098279,340979426~11887367,361047331~5147902,381985122~3410431,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.528 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,90587997~2550253,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,113048761~7114609,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,166553978~6404534,188856643~2843252,214537834~5674923,223272757~1131826,253406819~8933554,263989353~7101983,279973420~6776407,292796827~5355009,319248741~12098279,340979426~11887367,361047331~5147902,381985122~3410431,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.534 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,90587997~2550253,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,111815165~8348205,131564029~101367,140941849~11861800,166553978~6404534,188856643~2843252,214537834~5674923,223272757~1131826,253406819~8933554,263989353~7101983,279973420~6776407,292796827~5355009,318767104~12579916,340979426~11887367,361047331~5147902,381985122~3410431,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.534 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 17 diff [8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,90587997~2550253,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~4624986,166553978~6404534,175725121~1001214,188856643~2843252,194043488~3075904,214537834~8124005,223272757~1131826,253406819~8933554,263989353~7101983,279973420~6776407,292796827~5355009,299142188~5504827,319248741~12098279,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.534 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,90587997~2550253,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~4624986,166553978~6404534,175725121~1001214,188856643~2843252,194043488~3075904,214537834~8124005,223272757~1131826,253406819~8933554,263989353~7101983,279973420~6776407,292796827~5355009,299142188~5504827,319248741~12098279,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.539 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~890404,13002730~9916850,35739606~3620200,45900944~2844563,62914560~10059440,74302896~2170336,78503521~1316887,90587997~2550253,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~4624986,166553978~6404534,175725121~1001214,188856643~2843252,194043488~3075904,214537834~8124005,223272757~1131826,253406819~8933554,263989353~7101983,279973420~6776407,292796827~5355009,299142188~5504827,318767104~12579916,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.539 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 18 diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,90587997~2550253,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,319248741~12098279,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.539 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,90587997~2550253,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,319248741~12098279,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.545 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,54525952~18448048,74302896~2170336,78503521~1316887,83886080~1987263,90587997~2550253,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,318767104~12579916,340979426~15812194,361047331~5147902,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.545 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 19 diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.545 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.550 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.550 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 13 diff [97646638~391752,114903388~3080711,143653047~2185284,188856643~2843252,254538211~6031422,263989353~7101983,292796827~5355009,319248741~6930129,343466286~4956235,399226595~2346842] 2024-01-13T18:48:24.550 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [97646638~391752,114903388~3080711,143653047~2185284,188856643~2843252,254538211~6031422,263989353~7101983,292796827~5355009,319248741~6930129,343466286~4956235,399226595~2346842] 2024-01-13T18:48:24.556 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [97646638~391752,114903388~3080711,143653047~2185284,188856643~2843252,254538211~6031422,263989353~7101983,292796827~5355009,318767104~7411766,342210903~6211618,399226595~2346842] 2024-01-13T18:48:24.556 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 14 diff [15588785~3603588,45900944~2844563,74302896~2170336,97646638~391752,114903388~3080711,140941849~7747854,152029904~773745,188856643~2843252,254538211~6031422,263989353~7101983,279973420~6776407,292796827~5355009,319248741~6930129,330556735~790285,343466286~4956235,361047331~5147902,390275045~6069287,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.556 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [15588785~3603588,45900944~2844563,74302896~2170336,97646638~391752,114903388~3080711,140941849~7747854,152029904~773745,188856643~2843252,254538211~6031422,263989353~7101983,279973420~6776407,292796827~5355009,319248741~6930129,330556735~790285,343466286~4956235,361047331~5147902,390275045~6069287,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.561 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [15588785~3603588,45900944~2844563,74302896~2170336,97646638~391752,114903388~3080711,140941849~7747854,150994944~1808705,188856643~2843252,254538211~6031422,263989353~7101983,279973420~6776407,292796827~5355009,318767104~7411766,330556735~790285,342210903~6211618,361047331~5147902,390275045~6069287,399226595~2346842,410297321~4357908] 2024-01-13T18:48:24.561 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 15 diff [13002730~7727720,45900944~2844563,74302896~2170336,78503521~1316887,97646638~391752,114903388~3080711,140941849~9039111,152029904~773745,166553978~6404534,188856643~2843252,214537834~5674923,254538211~7802162,263989353~7101983,279973420~6776407,292796827~5355009,319248741~6930129,330556735~790285,340979426~11887367,361047331~5147902,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.562 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [13002730~7727720,45900944~2844563,74302896~2170336,78503521~1316887,97646638~391752,114903388~3080711,140941849~9039111,152029904~773745,166553978~6404534,188856643~2843252,214537834~5674923,254538211~7802162,263989353~7101983,279973420~6776407,292796827~5355009,319248741~6930129,330556735~790285,340979426~11887367,361047331~5147902,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.567 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [13002730~7727720,45900944~2844563,74302896~2170336,78503521~1316887,97646638~391752,114903388~3080711,140941849~9039111,150994944~1808705,166553978~6404534,188856643~2843252,214537834~5674923,254538211~7802162,263989353~7101983,279973420~6776407,292796827~5355009,318767104~7411766,330556735~790285,340979426~11887367,361047331~5147902,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.567 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 16 diff [13002730~7727720,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,97646638~391752,103244556~2142486,109038547~1025258,114903388~3080711,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,166553978~6404534,188856643~2843252,214537834~5674923,223272757~1131826,254538211~7802162,263989353~7101983,279973420~6776407,292796827~5355009,319248741~6930129,330556735~790285,340979426~11887367,361047331~5147902,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.567 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [13002730~7727720,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,97646638~391752,103244556~2142486,109038547~1025258,114903388~3080711,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,166553978~6404534,188856643~2843252,214537834~5674923,223272757~1131826,254538211~7802162,263989353~7101983,279973420~6776407,292796827~5355009,319248741~6930129,330556735~790285,340979426~11887367,361047331~5147902,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.572 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [13002730~7727720,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,97646638~391752,103244556~2142486,109038547~1025258,114903388~3080711,131564029~101367,140941849~11861800,166553978~6404534,188856643~2843252,214537834~5674923,223272757~1131826,254538211~7802162,263989353~7101983,279973420~6776407,292796827~5355009,318767104~7411766,330556735~790285,340979426~11887367,361047331~5147902,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.572 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 17 diff [13002730~7727720,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~4624986,166553978~6404534,175725121~1001214,188856643~2843252,194043488~3075904,214537834~8124005,223272757~1131826,254538211~7802162,263989353~7101983,279973420~6776407,292796827~5355009,299142188~5504827,319248741~6930129,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.572 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [13002730~7727720,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~4624986,166553978~6404534,175725121~1001214,188856643~2843252,194043488~3075904,214537834~8124005,223272757~1131826,254538211~7802162,263989353~7101983,279973420~6776407,292796827~5355009,299142188~5504827,319248741~6930129,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.577 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [13002730~7727720,45900944~2844563,62914560~10059440,74302896~2170336,78503521~1316887,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~11861800,156741708~4624986,166553978~6404534,175725121~1001214,188856643~2843252,194043488~3075904,214537834~8124005,223272757~1131826,254538211~7802162,263989353~7101983,279973420~6776407,292796827~5355009,299142188~5504827,318767104~7411766,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.578 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 18 diff [9029220~2729175,13002730~7727720,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,319248741~6930129,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.578 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,319248741~6930129,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.583 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,54525952~18448048,74302896~2170336,78503521~1316887,83886080~1987263,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,318767104~7411766,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~7448696] 2024-01-13T18:48:24.583 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 19 diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.583 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.589 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:24.589 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 14 diff [15588785~3603588,45900944~2844563,74302896~2170336,140941849~7747854,152029904~773745,279973420~6776407,330556735~790285,361047331~5147902,390275045~6069287,410297321~4357908] 2024-01-13T18:48:24.589 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [15588785~3603588,45900944~2844563,74302896~2170336,140941849~7747854,152029904~773745,279973420~6776407,330556735~790285,361047331~5147902,390275045~6069287,410297321~4357908] 2024-01-13T18:48:24.594 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [15588785~3603588,45900944~2844563,74302896~2170336,140941849~7747854,150994944~1808705,279973420~6776407,330556735~790285,361047331~5147902,390275045~6069287,410297321~4357908] 2024-01-13T18:48:24.594 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 15 diff [13002730~7727720,45900944~2844563,74302896~2170336,78503521~1316887,140941849~9039111,152029904~773745,166553978~6404534,214537834~5674923,255921330~6419043,279973420~6776407,330556735~790285,340979426~11887367,361047331~5147902,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.594 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [13002730~7727720,45900944~2844563,74302896~2170336,78503521~1316887,140941849~9039111,152029904~773745,166553978~6404534,214537834~5674923,255921330~6419043,279973420~6776407,330556735~790285,340979426~11887367,361047331~5147902,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.599 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [13002730~7727720,45900944~2844563,74302896~2170336,78503521~1316887,140941849~9039111,150994944~1808705,166553978~6404534,214537834~5674923,255921330~6419043,279973420~6776407,330556735~790285,340979426~11887367,361047331~5147902,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.599 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 16 diff [13002730~7727720,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,103244556~2142486,109038547~1025258,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,166553978~6404534,214537834~5674923,223272757~1131826,255610167~6730206,279973420~6776407,330556735~790285,340979426~11887367,361047331~5147902,383660976~1734577,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.599 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [13002730~7727720,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,103244556~2142486,109038547~1025258,131564029~101367,140941849~10069377,151265291~212696,152029904~773745,166553978~6404534,214537834~5674923,223272757~1131826,255610167~6730206,279973420~6776407,330556735~790285,340979426~11887367,361047331~5147902,383660976~1734577,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.605 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [13002730~7727720,45900944~2844563,67672839~5301161,74302896~2170336,78503521~1316887,103244556~2142486,109038547~1025258,131564029~101367,140941849~11861800,166553978~6404534,214537834~5674923,223272757~1131826,255610167~6730206,279973420~6776407,330556735~790285,340979426~11887367,361047331~5147902,383660976~1734577,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.605 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 17 diff [13002730~7727720,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~4624986,166553978~6404534,175725121~1001214,194043488~3075904,214537834~8124005,223272757~1131826,255610167~6730206,279973420~6776407,299142188~5504827,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.605 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [13002730~7727720,45900944~2844563,65173788~7800212,74302896~2170336,78503521~1316887,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10069377,151265291~212696,152029904~773745,156741708~4624986,166553978~6404534,175725121~1001214,194043488~3075904,214537834~8124005,223272757~1131826,255610167~6730206,279973420~6776407,299142188~5504827,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.610 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [13002730~7727720,45900944~2844563,62914560~10059440,74302896~2170336,78503521~1316887,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~11861800,156741708~4624986,166553978~6404534,175725121~1001214,194043488~3075904,214537834~8124005,223272757~1131826,255610167~6730206,279973420~6776407,299142188~5504827,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.610 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 18 diff [9029220~2729175,13002730~7727720,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.610 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,57445484~6985145,65173788~7800212,74302896~2170336,78503521~1316887,84751242~1122101,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.616 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,54525952~18448048,74302896~2170336,78503521~1316887,83886080~1987263,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,330556735~790285,340979426~15812194,361047331~5147902,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~7448696] 2024-01-13T18:48:24.616 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 19 diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:24.616 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:24.621 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:24.621 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to 15 diff [13002730~7727720,78503521~1316887,143546434~6434526,166553978~6404534,214537834~5674923,255921330~6419043,340979426~11887367,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.621 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [13002730~7727720,78503521~1316887,143546434~6434526,166553978~6404534,214537834~5674923,255921330~6419043,340979426~11887367,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.630 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [13002730~7727720,78503521~1316887,143546434~6434526,166553978~6404534,214537834~5674923,255921330~6419043,340979426~11887367,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.630 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to 16 diff [13002730~7727720,67672839~5301161,75543536~361206,78503521~1316887,103244556~2142486,109038547~1025258,131564029~101367,143546434~7464792,151265291~212696,166553978~6404534,214537834~5674923,223272757~1131826,255610167~6730206,340979426~11887367,383660976~1734577,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.630 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [13002730~7727720,67672839~5301161,75543536~361206,78503521~1316887,103244556~2142486,109038547~1025258,131564029~101367,143546434~7464792,151265291~212696,166553978~6404534,214537834~5674923,223272757~1131826,255610167~6730206,340979426~11887367,383660976~1734577,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.635 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [13002730~7727720,67672839~5301161,75543536~361206,78503521~1316887,103244556~2142486,109038547~1025258,131564029~101367,143546434~7464792,151265291~212696,166553978~6404534,214537834~5674923,223272757~1131826,255610167~6730206,340979426~11887367,383660976~1734577,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.636 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to 17 diff [13002730~7727720,65173788~7800212,75543536~361206,78503521~1316887,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,143546434~7464792,151265291~212696,156741708~4624986,166553978~6404534,175725121~1001214,194043488~3075904,214537834~8124005,223272757~1131826,255610167~6730206,299142188~5504827,340979426~15812194,375659080~7266970,383660976~1734577,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.636 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [13002730~7727720,65173788~7800212,75543536~361206,78503521~1316887,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,143546434~7464792,151265291~212696,156741708~4624986,166553978~6404534,175725121~1001214,194043488~3075904,214537834~8124005,223272757~1131826,255610167~6730206,299142188~5504827,340979426~15812194,375659080~7266970,383660976~1734577,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.641 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [13002730~7727720,62914560~10059440,75543536~361206,78503521~1316887,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,143546434~7464792,151265291~212696,156741708~4624986,166553978~6404534,175725121~1001214,194043488~3075904,214537834~8124005,223272757~1131826,255610167~6730206,299142188~5504827,340979426~15812194,375659080~7266970,383660976~1734577,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.641 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to 18 diff [9029220~2729175,13002730~7727720,57445484~6985145,65173788~7800212,75543536~361206,78503521~1316887,84751242~1122101,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,143546434~7931553,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,340979426~15812194,375659080~7266970,383660976~1734577,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.641 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,57445484~6985145,65173788~7800212,75543536~361206,78503521~1316887,84751242~1122101,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,143546434~7931553,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,340979426~15812194,375659080~7266970,383660976~1734577,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.647 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,54525952~18448048,75543536~361206,78503521~1316887,83886080~1987263,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,143546434~7931553,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,340979426~15812194,375659080~7266970,383660976~1734577,386682283~3566701,407206533~4345865] 2024-01-13T18:48:24.647 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to 19 diff [9029220~2729175,13002730~7727720,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:24.647 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:24.652 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,50511075~3277158,54525952~18448048,75543536~361206,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:24.652 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to 16 diff [67672839~5301161,75543536~361206,103244556~2142486,109038547~1025258,131564029~101367,147532293~3478933,151265291~212696,223272757~1131826,255610167~3773019,383660976~1734577] 2024-01-13T18:48:24.652 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [67672839~5301161,75543536~361206,103244556~2142486,109038547~1025258,131564029~101367,147532293~3478933,151265291~212696,223272757~1131826,255610167~3773019,383660976~1734577] 2024-01-13T18:48:24.658 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [67672839~5301161,75543536~361206,103244556~2142486,109038547~1025258,131564029~101367,147532293~3478933,151265291~212696,223272757~1131826,255610167~3773019,383660976~1734577] 2024-01-13T18:48:24.658 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to 17 diff [65173788~7800212,75543536~361206,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,147532293~3478933,151265291~212696,156741708~4624986,175725121~1001214,194043488~3075904,217874007~4787832,223272757~1131826,255610167~3773019,299142188~5504827,350594700~6196920,375659080~7266970,383660976~1734577] 2024-01-13T18:48:24.658 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [65173788~7800212,75543536~361206,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,147532293~3478933,151265291~212696,156741708~4624986,175725121~1001214,194043488~3075904,217874007~4787832,223272757~1131826,255610167~3773019,299142188~5504827,350594700~6196920,375659080~7266970,383660976~1734577] 2024-01-13T18:48:24.663 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [62914560~10059440,75543536~361206,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,147532293~3478933,151265291~212696,156741708~4624986,175725121~1001214,194043488~3075904,217874007~4787832,223272757~1131826,255610167~3773019,299142188~5504827,350594700~6196920,375659080~7266970,383660976~1734577] 2024-01-13T18:48:24.663 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to 18 diff [9029220~2729175,57445484~6985145,65173788~7800212,75543536~361206,84751242~1122101,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,147532293~3945694,156741708~5474159,175725121~1001214,194043488~10637709,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,350594700~6196920,375659080~7266970,383660976~1734577] 2024-01-13T18:48:24.664 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,57445484~6985145,65173788~7800212,75543536~361206,84751242~1122101,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,147532293~3945694,156741708~5474159,175725121~1001214,194043488~10637709,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,350594700~6196920,375659080~7266970,383660976~1734577] 2024-01-13T18:48:24.668 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,54525952~18448048,75543536~361206,83886080~1987263,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,147532293~3945694,156741708~5474159,175725121~1001214,194043488~10637709,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,350594700~6196920,375659080~7266970,383660976~1734577] 2024-01-13T18:48:24.669 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to 19 diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:24.669 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:24.674 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,50511075~3277158,54525952~18448048,75543536~361206,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:24.674 INFO:tasks.workunit.client.0.smithi084.stdout:from 16 to 17 diff [65173788~7171390,110637922~4143483,138094318~2290832,156741708~4624986,175725121~1001214,194043488~3075904,217874007~4787832,299142188~5504827,350594700~6196920,375659080~7266970] 2024-01-13T18:48:24.674 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [65173788~7171390,110637922~4143483,138094318~2290832,156741708~4624986,175725121~1001214,194043488~3075904,217874007~4787832,299142188~5504827,350594700~6196920,375659080~7266970] 2024-01-13T18:48:24.680 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [62914560~9430618,110637922~4143483,138094318~2290832,156741708~4624986,175725121~1001214,194043488~3075904,217874007~4787832,299142188~5504827,350594700~6196920,375659080~7266970] 2024-01-13T18:48:24.680 INFO:tasks.workunit.client.0.smithi084.stdout:from 16 to 18 diff [9029220~2729175,57445484~6985145,65173788~7171390,84751242~1122101,110637922~4143483,138094318~2290832,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,217874007~5745088,290361154~4305765,299142188~9429907,350594700~6196920,375659080~7266970] 2024-01-13T18:48:24.680 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,57445484~6985145,65173788~7171390,84751242~1122101,110637922~4143483,138094318~2290832,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,217874007~5745088,290361154~4305765,299142188~9429907,350594700~6196920,375659080~7266970] 2024-01-13T18:48:24.685 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,54525952~17819226,83886080~1987263,110637922~4143483,138094318~2290832,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,217874007~5745088,290361154~4305765,299142188~9429907,350594700~6196920,375659080~7266970] 2024-01-13T18:48:24.685 INFO:tasks.workunit.client.0.smithi084.stdout:from 16 to 19 diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7171390,76805441~5721080,84751242~6155192,110637922~4143483,138094318~2290832,141071292~8054790,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~5745088,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,410023372~6188344] 2024-01-13T18:48:24.685 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7171390,76805441~5721080,84751242~6155192,110637922~4143483,138094318~2290832,141071292~8054790,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~5745088,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,410023372~6188344] 2024-01-13T18:48:24.691 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,50511075~3277158,54525952~17819226,76805441~5721080,83886080~7020354,110637922~4143483,138094318~2290832,141071292~8054790,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~5745088,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,410023372~6188344] 2024-01-13T18:48:24.691 INFO:tasks.workunit.client.0.smithi084.stdout:from 17 to 18 diff [9029220~2729175,57445484~6985145,84751242~1122101,149759153~1576257,159523541~2692326,194486488~10194709,220691306~2927789,290361154~4305765,302084659~6487436] 2024-01-13T18:48:24.691 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,57445484~6985145,84751242~1122101,149759153~1576257,159523541~2692326,194486488~10194709,220691306~2927789,290361154~4305765,302084659~6487436] 2024-01-13T18:48:24.696 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,54525952~9904677,83886080~1987263,149759153~1576257,159523541~2692326,194486488~10194709,220691306~2927789,290361154~4305765,302084659~6487436] 2024-01-13T18:48:24.696 INFO:tasks.workunit.client.0.smithi084.stdout:from 17 to 19 diff [9029220~2729175,50511075~3277158,57445484~6985145,76805441~5721080,84751242~6155192,141071292~8054790,149759153~1576257,159523541~2692326,194486488~10194709,210395355~3329430,220691306~2927789,290361154~4305765,302084659~6487436,314018371~5695880,345729730~4569204,362554109~3901073,410023372~6188344] 2024-01-13T18:48:24.696 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,50511075~3277158,57445484~6985145,76805441~5721080,84751242~6155192,141071292~8054790,149759153~1576257,159523541~2692326,194486488~10194709,210395355~3329430,220691306~2927789,290361154~4305765,302084659~6487436,314018371~5695880,345729730~4569204,362554109~3901073,410023372~6188344] 2024-01-13T18:48:24.702 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,50511075~3277158,54525952~9904677,76805441~5721080,83886080~7020354,141071292~8054790,149759153~1576257,159523541~2692326,194486488~10194709,210395355~3329430,220691306~2927789,290361154~4305765,302084659~6487436,314018371~5695880,345729730~4569204,362554109~3901073,410023372~6188344] 2024-01-13T18:48:24.702 INFO:tasks.workunit.client.0.smithi084.stdout:from 18 to 19 diff [50511075~3277158,76805441~5721080,85591847~5314587,141071292~8054790,210395355~3329430,302316126~2407854,314018371~5695880,345729730~4569204,362554109~3901073,410023372~6188344] 2024-01-13T18:48:24.702 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [50511075~3277158,76805441~5721080,85591847~5314587,141071292~8054790,210395355~3329430,302316126~2407854,314018371~5695880,345729730~4569204,362554109~3901073,410023372~6188344] 2024-01-13T18:48:24.707 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [50511075~3277158,76805441~5721080,85591847~5314587,141071292~8054790,210395355~3329430,302316126~2407854,314018371~5695880,345729730~4569204,362554109~3901073,410023372~6188344] 2024-01-13T18:48:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:24 smithi084 ceph-mon[116404]: pgmap v2614: 137 pgs: 137 active+clean; 722 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 236 KiB/s rd, 27 MiB/s wr, 360 op/s 2024-01-13T18:48:25.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:24 smithi084 ceph-mon[116404]: osdmap e1443: 8 total, 8 up, 8 in 2024-01-13T18:48:25.060 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:24 smithi084 ceph-mon[119097]: pgmap v2614: 137 pgs: 137 active+clean; 722 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 236 KiB/s rd, 27 MiB/s wr, 360 op/s 2024-01-13T18:48:25.060 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:24 smithi084 ceph-mon[119097]: osdmap e1443: 8 total, 8 up, 8 in 2024-01-13T18:48:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:24 smithi099 ceph-mon[138788]: pgmap v2614: 137 pgs: 137 active+clean; 722 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 236 KiB/s rd, 27 MiB/s wr, 360 op/s 2024-01-13T18:48:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:24 smithi099 ceph-mon[138788]: osdmap e1443: 8 total, 8 up, 8 in 2024-01-13T18:48:25.641 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:25.641 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:25.661 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:25.661 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:25.661 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:25.667 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:25.667 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:25.667 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:25.673 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:25.673 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:25.673 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:25.678 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:25.679 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.679 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.684 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.684 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.684 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.690 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.690 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.690 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.696 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.696 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.696 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.702 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.702 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.702 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.707 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.707 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.707 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.713 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.713 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.713 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.719 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.719 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.719 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.724 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.724 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.724 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.731 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:25.731 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to HEAD diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:25.731 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:25.735 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:25.735 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to HEAD diff [9029220~2729175,13002730~7727720,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:25.735 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:25.741 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,50511075~3277158,54525952~18448048,75543536~361206,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:25.741 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to HEAD diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:25.741 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:25.746 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,50511075~3277158,54525952~18448048,75543536~361206,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:25.746 INFO:tasks.workunit.client.0.smithi084.stdout:from 16 to HEAD diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7171390,76805441~5721080,84751242~6155192,110637922~4143483,138094318~2290832,141071292~8054790,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~5745088,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,410023372~6188344] 2024-01-13T18:48:25.747 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7171390,76805441~5721080,84751242~6155192,110637922~4143483,138094318~2290832,141071292~8054790,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~5745088,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,410023372~6188344] 2024-01-13T18:48:25.752 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,50511075~3277158,54525952~17819226,76805441~5721080,83886080~7020354,110637922~4143483,138094318~2290832,141071292~8054790,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~5745088,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,410023372~6188344] 2024-01-13T18:48:25.752 INFO:tasks.workunit.client.0.smithi084.stdout:from 17 to HEAD diff [9029220~2729175,50511075~3277158,57445484~6985145,76805441~5721080,84751242~6155192,141071292~8054790,149759153~1576257,159523541~2692326,194486488~10194709,210395355~3329430,220691306~2927789,290361154~4305765,302084659~6487436,314018371~5695880,345729730~4569204,362554109~3901073,410023372~6188344] 2024-01-13T18:48:25.752 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,50511075~3277158,57445484~6985145,76805441~5721080,84751242~6155192,141071292~8054790,149759153~1576257,159523541~2692326,194486488~10194709,210395355~3329430,220691306~2927789,290361154~4305765,302084659~6487436,314018371~5695880,345729730~4569204,362554109~3901073,410023372~6188344] 2024-01-13T18:48:25.757 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,50511075~3277158,54525952~9904677,76805441~5721080,83886080~7020354,141071292~8054790,149759153~1576257,159523541~2692326,194486488~10194709,210395355~3329430,220691306~2927789,290361154~4305765,302084659~6487436,314018371~5695880,345729730~4569204,362554109~3901073,410023372~6188344] 2024-01-13T18:48:26.646 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:26.646 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:26.675 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:26.675 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:26.675 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:26.685 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:26.685 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:26.685 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:26.690 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:26.691 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:26.691 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:26.696 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:26.696 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.696 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.701 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.701 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.702 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.707 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.707 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.707 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.712 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.713 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.713 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.718 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.718 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.718 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.723 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.724 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.724 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.729 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.729 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.729 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.734 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.735 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.735 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.740 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.740 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.740 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.745 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:26.745 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to HEAD diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:26.745 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:26.750 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:26.750 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to HEAD diff [9029220~2729175,13002730~7727720,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:26.750 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:26.755 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,50511075~3277158,54525952~18448048,75543536~361206,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:26.755 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to HEAD diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:26.755 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:26.761 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,50511075~3277158,54525952~18448048,75543536~361206,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:26.761 INFO:tasks.workunit.client.0.smithi084.stdout:from 16 to HEAD diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7171390,76805441~5721080,84751242~6155192,110637922~4143483,138094318~2290832,141071292~8054790,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~5745088,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,410023372~6188344] 2024-01-13T18:48:26.761 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7171390,76805441~5721080,84751242~6155192,110637922~4143483,138094318~2290832,141071292~8054790,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~5745088,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,410023372~6188344] 2024-01-13T18:48:26.768 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,50511075~3277158,54525952~17819226,76805441~5721080,83886080~7020354,110637922~4143483,138094318~2290832,141071292~8054790,149759153~1576257,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~5745088,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,410023372~6188344] 2024-01-13T18:48:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:26 smithi084 ceph-mon[116404]: pgmap v2616: 137 pgs: 137 active+clean; 813 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 118 KiB/s rd, 38 MiB/s wr, 539 op/s 2024-01-13T18:48:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:26 smithi084 ceph-mon[116404]: osdmap e1444: 8 total, 8 up, 8 in 2024-01-13T18:48:26.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:26 smithi084 ceph-mon[119097]: pgmap v2616: 137 pgs: 137 active+clean; 813 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 118 KiB/s rd, 38 MiB/s wr, 539 op/s 2024-01-13T18:48:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:26 smithi084 ceph-mon[119097]: osdmap e1444: 8 total, 8 up, 8 in 2024-01-13T18:48:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:26 smithi099 ceph-mon[138788]: pgmap v2616: 137 pgs: 137 active+clean; 813 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 118 KiB/s rd, 38 MiB/s wr, 539 op/s 2024-01-13T18:48:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:26 smithi099 ceph-mon[138788]: osdmap e1444: 8 total, 8 up, 8 in 2024-01-13T18:48:27.664 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:27.664 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:27.689 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:27.689 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:27.689 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:27.695 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:27.695 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:27.695 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:27.700 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:27.700 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:27.700 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:27.706 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:27.706 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.706 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.711 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.712 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.712 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.718 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.718 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.718 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.723 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.723 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.723 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.730 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.730 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.730 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.735 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.735 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.735 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.741 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.741 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.741 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.746 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.746 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.747 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.752 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.752 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.752 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.757 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:27.757 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to HEAD diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:27.757 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:27.763 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:27.763 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to HEAD diff [9029220~2729175,13002730~7727720,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:27.763 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:27.769 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,50511075~3277158,54525952~18448048,75543536~361206,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:27.769 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to HEAD diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:27.769 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:27.773 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,50511075~3277158,54525952~18448048,75543536~361206,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,175725121~1001214,194043488~10637709,210395355~3329430,217874007~6530576,255610167~3773019,290361154~4305765,299142188~9429907,314018371~5695880,345729730~4569204,350594700~6196920,362554109~3901073,375659080~7266970,383660976~1734577,410023372~6188344] 2024-01-13T18:48:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:27 smithi084 ceph-mon[116404]: osdmap e1445: 8 total, 8 up, 8 in 2024-01-13T18:48:27.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:27 smithi084 ceph-mon[119097]: osdmap e1445: 8 total, 8 up, 8 in 2024-01-13T18:48:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:27 smithi099 ceph-mon[138788]: osdmap e1445: 8 total, 8 up, 8 in 2024-01-13T18:48:28.675 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:28.675 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:28.707 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:28.708 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:28.713 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:28.714 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:28.719 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:28.719 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:28.725 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:28.725 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.725 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.731 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.731 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.731 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.736 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.736 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.736 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.742 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.742 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.743 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.748 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.748 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.748 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.753 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.753 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.753 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.758 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.758 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.759 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.764 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.764 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.764 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.770 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.770 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.770 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.776 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:28.776 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to HEAD diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:28.776 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:28.781 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:28.781 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to HEAD diff [9029220~2729175,13002730~7727720,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:28.781 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,50511075~3277158,57445484~6985145,65173788~7800212,75543536~361206,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:28.786 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,50511075~3277158,54525952~18448048,75543536~361206,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,141071292~10406695,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,290361154~4305765,299142188~9429907,314018371~5695880,340979426~15812194,362554109~3901073,375659080~7266970,383660976~1734577,386682283~3566701,407206533~9005183] 2024-01-13T18:48:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:28 smithi084 ceph-mon[116404]: pgmap v2619: 137 pgs: 137 active+clean; 833 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 239 KiB/s rd, 30 MiB/s wr, 1.07k op/s 2024-01-13T18:48:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:28 smithi084 ceph-mon[116404]: osdmap e1446: 8 total, 8 up, 8 in 2024-01-13T18:48:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:28 smithi084 ceph-mon[119097]: pgmap v2619: 137 pgs: 137 active+clean; 833 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 239 KiB/s rd, 30 MiB/s wr, 1.07k op/s 2024-01-13T18:48:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:28 smithi084 ceph-mon[119097]: osdmap e1446: 8 total, 8 up, 8 in 2024-01-13T18:48:29.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:28 smithi099 ceph-mon[138788]: pgmap v2619: 137 pgs: 137 active+clean; 833 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 239 KiB/s rd, 30 MiB/s wr, 1.07k op/s 2024-01-13T18:48:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:28 smithi099 ceph-mon[138788]: osdmap e1446: 8 total, 8 up, 8 in 2024-01-13T18:48:29.690 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:29.690 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:29.723 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:29.723 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:29.723 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:29.729 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:29.729 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:29.729 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:29.735 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:29.735 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:29.735 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:29.741 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:29.741 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.741 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.746 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.746 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.746 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.752 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.752 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.752 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.757 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.757 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.757 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.763 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.763 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.763 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.768 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.768 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.768 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.774 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.774 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.774 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.779 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.779 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.779 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.784 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.784 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.784 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.789 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to HEAD diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:29.789 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:29.794 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,103244556~2142486,109038547~1025258,110637922~4143483,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,194043488~10637709,210395355~3329430,214537834~9866749,255610167~6730206,279973420~6776407,290361154~4305765,299142188~9429907,314018371~5695880,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,407206533~9005183] 2024-01-13T18:48:29.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:29 smithi084 ceph-mon[116404]: osdmap e1447: 8 total, 8 up, 8 in 2024-01-13T18:48:29.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:29 smithi084 ceph-mon[119097]: osdmap e1447: 8 total, 8 up, 8 in 2024-01-13T18:48:30.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:29 smithi099 ceph-mon[138788]: osdmap e1447: 8 total, 8 up, 8 in 2024-01-13T18:48:30.667 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:48:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:48:30] "GET /metrics HTTP/1.1" 200 36491 "" "Prometheus/2.43.0" 2024-01-13T18:48:30.696 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:30.696 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:30.731 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:30.731 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:30.731 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:30.737 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:30.737 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:30.737 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:30.743 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:30.743 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:30.743 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:30.748 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:30.749 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.749 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.754 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.754 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.754 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.759 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.760 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.760 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.765 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.765 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.765 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.770 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.771 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.771 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.776 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.776 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.776 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.781 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.781 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.781 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.786 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.786 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.786 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.792 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.792 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.792 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~6155192,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.796 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [9029220~2729175,13002730~7727720,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~7020354,97646638~391752,103244556~2142486,109038547~1025258,110637922~4143483,114903388~3080711,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,254538211~7802162,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~12160499,330556735~790285,340979426~15812194,361047331~5407851,375659080~7266970,383660976~1734577,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:30 smithi084 ceph-mon[116404]: pgmap v2622: 137 pgs: 137 active+clean; 839 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 168 KiB/s rd, 8.5 MiB/s wr, 5.55k op/s 2024-01-13T18:48:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:30 smithi084 ceph-mon[116404]: osdmap e1448: 8 total, 8 up, 8 in 2024-01-13T18:48:30.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:30 smithi084 ceph-mon[119097]: pgmap v2622: 137 pgs: 137 active+clean; 839 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 168 KiB/s rd, 8.5 MiB/s wr, 5.55k op/s 2024-01-13T18:48:30.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:30 smithi084 ceph-mon[119097]: osdmap e1448: 8 total, 8 up, 8 in 2024-01-13T18:48:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:30 smithi099 ceph-mon[138788]: pgmap v2622: 137 pgs: 137 active+clean; 839 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 168 KiB/s rd, 8.5 MiB/s wr, 5.55k op/s 2024-01-13T18:48:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:30 smithi099 ceph-mon[138788]: osdmap e1448: 8 total, 8 up, 8 in 2024-01-13T18:48:31.700 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:31.700 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:31.744 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:31.744 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:31.744 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:31.754 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:31.754 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:31.754 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:31.759 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:31.759 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:31.759 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:31.766 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:31.766 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.766 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.770 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.770 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.770 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.776 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.776 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.776 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.781 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.781 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.781 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.786 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.786 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.786 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.792 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.792 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.792 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.797 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.797 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.797 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.802 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.802 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.803 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:31.807 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,188856643~2843252,194043488~10637709,210395355~3329430,214537834~9866749,253406819~8933554,263989353~7101983,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:31 smithi099 ceph-mon[138788]: osdmap e1449: 8 total, 8 up, 8 in 2024-01-13T18:48:32.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:31 smithi084 ceph-mon[119097]: osdmap e1449: 8 total, 8 up, 8 in 2024-01-13T18:48:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:31 smithi084 ceph-mon[116404]: osdmap e1449: 8 total, 8 up, 8 in 2024-01-13T18:48:32.717 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:32.717 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:32.757 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:32.757 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:32.764 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:32.764 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:32.772 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:32.772 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:32.778 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.778 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.783 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.783 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.784 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.789 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.789 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.794 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.795 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.795 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.800 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.800 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.805 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.805 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.810 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.810 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.811 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:32.816 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~9916850,35739606~3620200,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,103244556~2142486,109038547~1025258,110637922~9525448,131564029~101367,138094318~2290832,140941849~11861800,156741708~5474159,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,210395355~3329430,214537834~9866749,253406819~10531107,263989353~7949971,279973420~6776407,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:32 smithi099 ceph-mon[138788]: pgmap v2625: 137 pgs: 137 active+clean; 825 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 181 KiB/s rd, 3.4 MiB/s wr, 5.46k op/s 2024-01-13T18:48:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:32 smithi099 ceph-mon[138788]: osdmap e1450: 8 total, 8 up, 8 in 2024-01-13T18:48:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:32 smithi084 ceph-mon[116404]: pgmap v2625: 137 pgs: 137 active+clean; 825 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 181 KiB/s rd, 3.4 MiB/s wr, 5.46k op/s 2024-01-13T18:48:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:32 smithi084 ceph-mon[116404]: osdmap e1450: 8 total, 8 up, 8 in 2024-01-13T18:48:33.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:32 smithi084 ceph-mon[119097]: pgmap v2625: 137 pgs: 137 active+clean; 825 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 181 KiB/s rd, 3.4 MiB/s wr, 5.46k op/s 2024-01-13T18:48:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:32 smithi084 ceph-mon[119097]: osdmap e1450: 8 total, 8 up, 8 in 2024-01-13T18:48:33.531 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:33.532 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:33.570 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:33.570 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:33.581 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:33.581 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:33.587 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:33.587 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:33.592 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.593 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.598 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.603 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.609 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.609 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.614 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.614 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.620 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.620 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:33.624 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,8756101~3002294,13002730~13428096,35727014~6306415,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,386682283~3566701,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:33 smithi099 ceph-mon[138788]: osdmap e1451: 8 total, 8 up, 8 in 2024-01-13T18:48:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:33 smithi099 ceph-mon[138788]: pgmap v2628: 137 pgs: 137 active+clean; 801 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 141 KiB/s rd, 6.2 KiB/s wr, 1.31k op/s 2024-01-13T18:48:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:33 smithi099 ceph-mon[138788]: osdmap e1452: 8 total, 8 up, 8 in 2024-01-13T18:48:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:33 smithi084 ceph-mon[116404]: osdmap e1451: 8 total, 8 up, 8 in 2024-01-13T18:48:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:33 smithi084 ceph-mon[116404]: pgmap v2628: 137 pgs: 137 active+clean; 801 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 141 KiB/s rd, 6.2 KiB/s wr, 1.31k op/s 2024-01-13T18:48:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:33 smithi084 ceph-mon[116404]: osdmap e1452: 8 total, 8 up, 8 in 2024-01-13T18:48:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:33 smithi084 ceph-mon[119097]: osdmap e1451: 8 total, 8 up, 8 in 2024-01-13T18:48:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:33 smithi084 ceph-mon[119097]: pgmap v2628: 137 pgs: 137 active+clean; 801 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 141 KiB/s rd, 6.2 KiB/s wr, 1.31k op/s 2024-01-13T18:48:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:33 smithi084 ceph-mon[119097]: osdmap e1452: 8 total, 8 up, 8 in 2024-01-13T18:48:34.546 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:34.546 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:34.581 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:34.581 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:34.586 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:34.587 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:34.587 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:34.592 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:34.592 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:34.598 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.603 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.608 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.608 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.613 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.614 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.614 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.619 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.619 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~10536138,152029904~773745,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188856643~15824554,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:34.624 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,131564029~101367,138094318~2290832,140941849~11861800,156741708~8390047,166553978~6404534,175725121~1001214,185632250~1177132,188743680~15937517,205218799~8505986,214537834~9866749,227015110~1684466,247546686~2370730,253406819~10531107,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~16955928,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.551 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:35.551 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:35.585 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:35.585 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:35.586 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:35.607 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:35.607 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:35.607 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:35.612 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:35.612 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:35.612 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:35.618 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:35.618 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.618 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.623 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.623 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.624 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.629 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.629 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.630 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.634 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.635 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.635 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~20668314,152029904~773745,156741708~8390047,166553978~12761475,185632250~1177132,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~6776407,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~6069287,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.639 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~3959518,102376748~3010294,109038547~1025258,110637922~16553507,130809673~21993976,156741708~8390047,166553978~12761475,185632250~1177132,188743680~15937517,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,279973420~7979888,290361154~7790682,299142188~9429907,314018371~17328649,335743305~89762,340979426~15812194,361047331~5407851,373293056~23051276,397507568~266959,399226595~2346842,407206533~9005183] 2024-01-13T18:48:35.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:35 smithi099 ceph-mon[138788]: osdmap e1453: 8 total, 8 up, 8 in 2024-01-13T18:48:35.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:35 smithi084 ceph-mon[119097]: osdmap e1453: 8 total, 8 up, 8 in 2024-01-13T18:48:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:35 smithi084 ceph-mon[116404]: osdmap e1453: 8 total, 8 up, 8 in 2024-01-13T18:48:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:36.554 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:36.554 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:36.596 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:36.596 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:36.596 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:36.609 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:36.609 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:36.609 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:36.614 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:36.614 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:36.614 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:36.619 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:36.619 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:36.619 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:36.625 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:36.625 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:36.625 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:36.630 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:36.630 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:36.630 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,7102798~19328028,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~20255404,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:36.635 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,7102798~19328028,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~20255404,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,314018371~17328649,331618892~7473188,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:36.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:36 smithi099 ceph-mon[138788]: pgmap v2631: 137 pgs: 137 active+clean; 760 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 1.47k op/s 2024-01-13T18:48:36.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:36 smithi099 ceph-mon[138788]: osdmap e1454: 8 total, 8 up, 8 in 2024-01-13T18:48:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:36 smithi084 ceph-mon[116404]: pgmap v2631: 137 pgs: 137 active+clean; 760 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 1.47k op/s 2024-01-13T18:48:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:36 smithi084 ceph-mon[116404]: osdmap e1454: 8 total, 8 up, 8 in 2024-01-13T18:48:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:36 smithi084 ceph-mon[119097]: pgmap v2631: 137 pgs: 137 active+clean; 760 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 1.47k op/s 2024-01-13T18:48:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:36 smithi084 ceph-mon[119097]: osdmap e1454: 8 total, 8 up, 8 in 2024-01-13T18:48:37.563 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:37.563 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:37.600 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:37.600 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:37.601 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:37.607 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:37.608 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:37.608 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:37.612 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:37.612 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:37.612 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:37.617 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:37.617 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:37.617 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:37.622 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:37.622 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:37.623 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45900944~2844563,50511075~3277158,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,247546686~16391240,263989353~7949971,276254267~10495560,287567067~386241,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:37.627 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~6979625,45900944~2844563,50511075~3277158,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,227015110~1684466,247546686~16391240,263989353~7949971,272629760~15323548,290361154~7790682,299142188~9429907,312440258~18906762,331618892~8678435,340979426~15812194,361047331~5407851,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:37.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:37 smithi099 ceph-mon[138788]: osdmap e1455: 8 total, 8 up, 8 in 2024-01-13T18:48:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:37 smithi084 ceph-mon[116404]: osdmap e1455: 8 total, 8 up, 8 in 2024-01-13T18:48:37.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:37 smithi084 ceph-mon[119097]: osdmap e1455: 8 total, 8 up, 8 in 2024-01-13T18:48:38.538 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:38.538 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:38.579 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:38.579 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:38.579 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:38.591 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:38.591 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:38.591 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:38.596 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:38.596 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:38.597 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:38.601 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:38.602 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:38.602 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~2170336,76805441~5721080,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,247546686~16391240,263989353~8118663,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,407206533~9005183] 2024-01-13T18:48:38.606 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~2170336,76805441~5721080,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,247546686~16391240,263989353~8118663,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331618892~8678435,340817643~15973977,361047331~9613159,373293056~25208324,399226595~2346842,407206533~9005183] 2024-01-13T18:48:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:38 smithi099 ceph-mon[138788]: pgmap v2634: 137 pgs: 137 active+clean; 754 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 107 KiB/s rd, 5.0 KiB/s wr, 867 op/s 2024-01-13T18:48:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:38 smithi099 ceph-mon[138788]: osdmap e1456: 8 total, 8 up, 8 in 2024-01-13T18:48:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:38 smithi099 ceph-mon[138788]: osdmap e1457: 8 total, 8 up, 8 in 2024-01-13T18:48:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:38 smithi084 ceph-mon[116404]: pgmap v2634: 137 pgs: 137 active+clean; 754 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 107 KiB/s rd, 5.0 KiB/s wr, 867 op/s 2024-01-13T18:48:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:38 smithi084 ceph-mon[116404]: osdmap e1456: 8 total, 8 up, 8 in 2024-01-13T18:48:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:38 smithi084 ceph-mon[116404]: osdmap e1457: 8 total, 8 up, 8 in 2024-01-13T18:48:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:38 smithi084 ceph-mon[119097]: pgmap v2634: 137 pgs: 137 active+clean; 754 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 107 KiB/s rd, 5.0 KiB/s wr, 867 op/s 2024-01-13T18:48:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:38 smithi084 ceph-mon[119097]: osdmap e1456: 8 total, 8 up, 8 in 2024-01-13T18:48:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:38 smithi084 ceph-mon[119097]: osdmap e1457: 8 total, 8 up, 8 in 2024-01-13T18:48:39.566 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:39.567 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:39.604 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:39.604 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:39.604 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:39.614 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:39.615 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:39.615 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:39.620 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:39.620 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:39.620 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~8226335,399226595~2346842,402755542~573723,407206533~9005183] 2024-01-13T18:48:39.625 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,35053804~18734429,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,361047331~9613159,373293056~25208324,399226595~2346842,402653184~676081,407206533~9005183] 2024-01-13T18:48:40.546 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:48:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:48:40] "GET /metrics HTTP/1.1" 200 36487 "" "Prometheus/2.43.0" 2024-01-13T18:48:40.572 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:40.572 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:40.603 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:40.604 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:40.604 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:40.620 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:40.620 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:40.620 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~8387008,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~8390047,166553978~21091552,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~8664252,299142188~9429907,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:40.625 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~9252170,95204854~1952049,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,156741708~8390047,166553978~21091552,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~8664252,299142188~9429907,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,407206533~9005183] 2024-01-13T18:48:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:40 smithi099 ceph-mon[138788]: pgmap v2637: 137 pgs: 137 active+clean; 670 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 112 KiB/s rd, 6.0 KiB/s wr, 1.24k op/s 2024-01-13T18:48:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:40 smithi099 ceph-mon[138788]: osdmap e1458: 8 total, 8 up, 8 in 2024-01-13T18:48:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:40 smithi084 ceph-mon[116404]: pgmap v2637: 137 pgs: 137 active+clean; 670 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 112 KiB/s rd, 6.0 KiB/s wr, 1.24k op/s 2024-01-13T18:48:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:40 smithi084 ceph-mon[116404]: osdmap e1458: 8 total, 8 up, 8 in 2024-01-13T18:48:40.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:40 smithi084 ceph-mon[119097]: pgmap v2637: 137 pgs: 137 active+clean; 670 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 112 KiB/s rd, 6.0 KiB/s wr, 1.24k op/s 2024-01-13T18:48:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:40 smithi084 ceph-mon[119097]: osdmap e1458: 8 total, 8 up, 8 in 2024-01-13T18:48:41.586 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:41.587 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:41.619 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:41.619 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:41.619 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,247546686~24561330,276254267~10495560,287567067~386241,290361154~18210941,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:41.623 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~7254464,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,247546686~24561330,272629760~15323548,290361154~18210941,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:41.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:41 smithi099 ceph-mon[138788]: osdmap e1459: 8 total, 8 up, 8 in 2024-01-13T18:48:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:41 smithi084 ceph-mon[116404]: osdmap e1459: 8 total, 8 up, 8 in 2024-01-13T18:48:41.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:41 smithi084 ceph-mon[119097]: osdmap e1459: 8 total, 8 up, 8 in 2024-01-13T18:48:42.588 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:42.589 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [2944435~1232186,4365840~23242032,29748506~5305298,35630242~6403187,45624426~8163807,57445484~6985145,65173788~7800212,74302896~8958581,84751242~12405661,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130159858~21318129,152029904~773745,156741708~30903822,188856643~15824554,205218799~19185784,227015110~1684466,229292519~420981,239246680~358065,242600401~943800,247546686~24561330,276254267~10495560,287567067~386241,290012112~18559983,312440258~18906762,331618892~25172728,361047331~9613159,375659080~9736473,385613362~4635622,390275045~12110041,402755542~573723,407206533~9005183] 2024-01-13T18:48:42.624 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4176621,4194304~23413568,29748506~24039727,54525952~18448048,74302896~8958581,83886080~13270823,97646638~391752,98132578~10422486,109038547~1025258,110637922~16553507,130023424~22780225,155189248~32456282,188743680~15937517,204876947~19527636,226492416~3221084,239246680~358065,242600401~943800,247463936~24644080,272629760~15323548,289406976~19165119,312440258~18906762,331350016~25441604,360710144~9950346,373293056~29092030,402653184~676081,406847488~9364228] 2024-01-13T18:48:42.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:42 smithi099 ceph-mon[138788]: pgmap v2640: 137 pgs: 137 active+clean; 655 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 78 KiB/s rd, 6.0 KiB/s wr, 1.19k op/s 2024-01-13T18:48:42.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:42 smithi099 ceph-mon[138788]: osdmap e1460: 8 total, 8 up, 8 in 2024-01-13T18:48:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:42 smithi084 ceph-mon[116404]: pgmap v2640: 137 pgs: 137 active+clean; 655 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 78 KiB/s rd, 6.0 KiB/s wr, 1.19k op/s 2024-01-13T18:48:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:42 smithi084 ceph-mon[116404]: osdmap e1460: 8 total, 8 up, 8 in 2024-01-13T18:48:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:42 smithi084 ceph-mon[119097]: pgmap v2640: 137 pgs: 137 active+clean; 655 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 78 KiB/s rd, 6.0 KiB/s wr, 1.19k op/s 2024-01-13T18:48:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:42 smithi084 ceph-mon[119097]: osdmap e1460: 8 total, 8 up, 8 in 2024-01-13T18:48:43.552 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterateStress (40012 ms) 2024-01-13T18:48:43.552 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterateParent 2024-01-13T18:48:43.553 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:43 smithi099 ceph-mon[138788]: osdmap e1461: 8 total, 8 up, 8 in 2024-01-13T18:48:43.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:43 smithi099 ceph-mon[138788]: osdmap e1462: 8 total, 8 up, 8 in 2024-01-13T18:48:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:43 smithi084 ceph-mon[119097]: osdmap e1461: 8 total, 8 up, 8 in 2024-01-13T18:48:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:43 smithi084 ceph-mon[119097]: osdmap e1462: 8 total, 8 up, 8 in 2024-01-13T18:48:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:43 smithi084 ceph-mon[116404]: osdmap e1461: 8 total, 8 up, 8 in 2024-01-13T18:48:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:43 smithi084 ceph-mon[116404]: osdmap e1462: 8 total, 8 up, 8 in 2024-01-13T18:48:44.696 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterateParent (1143 ms) 2024-01-13T18:48:44.696 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterateIgnoreParent 2024-01-13T18:48:44.696 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:44.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:44 smithi099 ceph-mon[138788]: pgmap v2643: 137 pgs: 137 active+clean; 583 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 75 KiB/s rd, 6.0 KiB/s wr, 452 op/s 2024-01-13T18:48:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:44 smithi084 ceph-mon[116404]: pgmap v2643: 137 pgs: 137 active+clean; 583 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 75 KiB/s rd, 6.0 KiB/s wr, 452 op/s 2024-01-13T18:48:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:44 smithi084 ceph-mon[119097]: pgmap v2643: 137 pgs: 137 active+clean; 583 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 75 KiB/s rd, 6.0 KiB/s wr, 452 op/s 2024-01-13T18:48:45.704 INFO:tasks.workunit.client.0.smithi084.stdout: wrote [310432~94648,932745~140894,4092024~38392,4174754~96506,7273071~16511,14522952~87940,16809196~85342,18625989~15139,18837646~62969] to clone 2024-01-13T18:48:45.704 INFO:tasks.workunit.client.0.smithi084.stdout: diff was [0~7289582,12582912~2027980,16777216~2123399] 2024-01-13T18:48:45.708 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterateIgnoreParent (1013 ms) 2024-01-13T18:48:45.708 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterateCallbackError 2024-01-13T18:48:45.709 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:45.730 INFO:tasks.workunit.client.0.smithi084.stdout: wrote [406609~52669,2664139~95709,3481450~84103,4459926~7710,8641096~6141,9370439~96729,10564904~34693,19070085~83290,19520435~34690,19555970~54478] 2024-01-13T18:48:45.741 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterateCallbackError (32 ms) 2024-01-13T18:48:45.741 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterateParentDiscard 2024-01-13T18:48:45.741 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:45.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:45 smithi099 ceph-mon[138788]: osdmap e1463: 8 total, 8 up, 8 in 2024-01-13T18:48:45.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:45 smithi084 ceph-mon[116404]: osdmap e1463: 8 total, 8 up, 8 in 2024-01-13T18:48:45.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:45 smithi084 ceph-mon[119097]: osdmap e1463: 8 total, 8 up, 8 in 2024-01-13T18:48:46.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:46 smithi099 ceph-mon[138788]: pgmap v2646: 137 pgs: 137 active+clean; 493 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 5.2 KiB/s rd, 513 KiB/s wr, 365 op/s 2024-01-13T18:48:46.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:46 smithi099 ceph-mon[138788]: osdmap e1464: 8 total, 8 up, 8 in 2024-01-13T18:48:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:46 smithi084 ceph-mon[116404]: pgmap v2646: 137 pgs: 137 active+clean; 493 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 5.2 KiB/s rd, 513 KiB/s wr, 365 op/s 2024-01-13T18:48:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:46 smithi084 ceph-mon[116404]: osdmap e1464: 8 total, 8 up, 8 in 2024-01-13T18:48:46.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:46 smithi084 ceph-mon[119097]: pgmap v2646: 137 pgs: 137 active+clean; 493 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 5.2 KiB/s rd, 513 KiB/s wr, 365 op/s 2024-01-13T18:48:46.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:46 smithi084 ceph-mon[119097]: osdmap e1464: 8 total, 8 up, 8 in 2024-01-13T18:48:47.701 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterateParentDiscard (1961 ms) 2024-01-13T18:48:47.701 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterateUnalignedSmall 2024-01-13T18:48:47.701 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:47.755 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterateUnalignedSmall (53 ms) 2024-01-13T18:48:47.755 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterateUnaligned 2024-01-13T18:48:47.755 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:47.830 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterateUnaligned (74 ms) 2024-01-13T18:48:47.830 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/0.DiffIterateStriping 2024-01-13T18:48:47.830 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:48:47.830 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/0.DiffIterateStriping (0 ms) 2024-01-13T18:48:47.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:47 smithi099 ceph-mon[138788]: osdmap e1465: 8 total, 8 up, 8 in 2024-01-13T18:48:47.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:47 smithi084 ceph-mon[116404]: osdmap e1465: 8 total, 8 up, 8 in 2024-01-13T18:48:47.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:47 smithi084 ceph-mon[119097]: osdmap e1465: 8 total, 8 up, 8 in 2024-01-13T18:48:48.531 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 12 tests from DiffIterateTest/0 (58228 ms total) 2024-01-13T18:48:48.532 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:48:48.532 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 12 tests from DiffIterateTest/1, where TypeParam = DiffIterateParams 2024-01-13T18:48:48.561 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterate 2024-01-13T18:48:49.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:48 smithi099 ceph-mon[138788]: pgmap v2649: 137 pgs: 137 active+clean; 492 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 256 op/s 2024-01-13T18:48:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:48 smithi099 ceph-mon[138788]: osdmap e1466: 8 total, 8 up, 8 in 2024-01-13T18:48:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:48 smithi099 ceph-mon[138788]: osdmap e1467: 8 total, 8 up, 8 in 2024-01-13T18:48:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:48 smithi084 ceph-mon[116404]: pgmap v2649: 137 pgs: 137 active+clean; 492 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 256 op/s 2024-01-13T18:48:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:48 smithi084 ceph-mon[116404]: osdmap e1466: 8 total, 8 up, 8 in 2024-01-13T18:48:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:48 smithi084 ceph-mon[116404]: osdmap e1467: 8 total, 8 up, 8 in 2024-01-13T18:48:49.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:48 smithi084 ceph-mon[119097]: pgmap v2649: 137 pgs: 137 active+clean; 492 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 256 op/s 2024-01-13T18:48:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:48 smithi084 ceph-mon[119097]: osdmap e1466: 8 total, 8 up, 8 in 2024-01-13T18:48:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:48 smithi084 ceph-mon[119097]: osdmap e1467: 8 total, 8 up, 8 in 2024-01-13T18:48:50.545 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:50 smithi084 ceph-mon[119097]: pgmap v2652: 105 pgs: 105 active+clean; 4.6 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:48:50.545 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:50 smithi084 ceph-mon[119097]: osdmap e1468: 8 total, 8 up, 8 in 2024-01-13T18:48:50.545 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:48:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:48:50] "GET /metrics HTTP/1.1" 200 36422 "" "Prometheus/2.43.0" 2024-01-13T18:48:50.546 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:50 smithi084 ceph-mon[116404]: pgmap v2652: 105 pgs: 105 active+clean; 4.6 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:48:50.546 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:50 smithi084 ceph-mon[116404]: osdmap e1468: 8 total, 8 up, 8 in 2024-01-13T18:48:50.546 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:50 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1009500658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:48:50.546 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:50.557 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:50.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:50 smithi099 ceph-mon[138788]: pgmap v2652: 105 pgs: 105 active+clean; 4.6 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:48:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:50 smithi099 ceph-mon[138788]: osdmap e1468: 8 total, 8 up, 8 in 2024-01-13T18:48:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:50 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1009500658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:48:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:50 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1009500658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:48:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:48:51.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:51 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1009500658' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:48:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:51 smithi099 ceph-mon[138788]: osdmap e1469: 8 total, 8 up, 8 in 2024-01-13T18:48:51.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:51 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:48:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:51 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1009500658' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:48:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:51 smithi084 ceph-mon[116404]: osdmap e1469: 8 total, 8 up, 8 in 2024-01-13T18:48:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:51 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:48:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:51 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1009500658' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:48:51.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:51 smithi084 ceph-mon[119097]: osdmap e1469: 8 total, 8 up, 8 in 2024-01-13T18:48:51.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:51 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:48:52.590 INFO:tasks.workunit.client.0.smithi084.stdout: wrote [3507358~25543,4502785~19177,5104238~5035,6390424~77355,6665432~60379,8498991~31254,14750674~98492,18881221~76835,20449278~12885,20606209~70884] 2024-01-13T18:48:52.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:52 smithi099 ceph-mon[138788]: pgmap v2655: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 4.6 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:48:52.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:52 smithi099 ceph-mon[138788]: osdmap e1470: 8 total, 8 up, 8 in 2024-01-13T18:48:52.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:52 smithi084 ceph-mon[116404]: pgmap v2655: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 4.6 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:48:52.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:52 smithi084 ceph-mon[116404]: osdmap e1470: 8 total, 8 up, 8 in 2024-01-13T18:48:52.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:52 smithi084 ceph-mon[119097]: pgmap v2655: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 4.6 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:48:52.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:52 smithi084 ceph-mon[119097]: osdmap e1470: 8 total, 8 up, 8 in 2024-01-13T18:48:53.578 INFO:tasks.workunit.client.0.smithi084.stdout: wrote [4194304~16777216] 2024-01-13T18:48:53.587 INFO:tasks.workunit.client.0.smithi084.stdout: diff was [4194304~16777216] 2024-01-13T18:48:53.590 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterate (5030 ms) 2024-01-13T18:48:53.591 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterateDeterministic 2024-01-13T18:48:53.591 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:53.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:53 smithi099 ceph-mon[138788]: osdmap e1471: 8 total, 8 up, 8 in 2024-01-13T18:48:53.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:53 smithi084 ceph-mon[116404]: osdmap e1471: 8 total, 8 up, 8 in 2024-01-13T18:48:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:53 smithi084 ceph-mon[119097]: osdmap e1471: 8 total, 8 up, 8 in 2024-01-13T18:48:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:54 smithi099 ceph-mon[138788]: pgmap v2658: 137 pgs: 7 creating+peering, 11 unknown, 119 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 1 op/s 2024-01-13T18:48:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:54 smithi099 ceph-mon[138788]: osdmap e1472: 8 total, 8 up, 8 in 2024-01-13T18:48:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:54 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:48:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:54 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:48:54.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:54 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:54 smithi084 ceph-mon[116404]: pgmap v2658: 137 pgs: 7 creating+peering, 11 unknown, 119 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 1 op/s 2024-01-13T18:48:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:54 smithi084 ceph-mon[116404]: osdmap e1472: 8 total, 8 up, 8 in 2024-01-13T18:48:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:54 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:48:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:54 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:48:54.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:54 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:54 smithi084 ceph-mon[119097]: pgmap v2658: 137 pgs: 7 creating+peering, 11 unknown, 119 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 1 op/s 2024-01-13T18:48:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:54 smithi084 ceph-mon[119097]: osdmap e1472: 8 total, 8 up, 8 in 2024-01-13T18:48:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:54 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:48:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:54 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:48:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:54 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:48:55.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:55 smithi099 ceph-mon[138788]: osdmap e1473: 8 total, 8 up, 8 in 2024-01-13T18:48:55.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:55 smithi084 ceph-mon[119097]: osdmap e1473: 8 total, 8 up, 8 in 2024-01-13T18:48:55.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:55 smithi084 ceph-mon[116404]: osdmap e1473: 8 total, 8 up, 8 in 2024-01-13T18:48:56.618 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterateDeterministic (3028 ms) 2024-01-13T18:48:56.618 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterateDeterministicPP 2024-01-13T18:48:56.618 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:56.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:56 smithi099 ceph-mon[138788]: pgmap v2661: 137 pgs: 4 creating+peering, 133 active+clean; 18 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 165 KiB/s wr, 23 op/s 2024-01-13T18:48:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:56 smithi099 ceph-mon[138788]: osdmap e1474: 8 total, 8 up, 8 in 2024-01-13T18:48:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:56 smithi084 ceph-mon[116404]: pgmap v2661: 137 pgs: 4 creating+peering, 133 active+clean; 18 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 165 KiB/s wr, 23 op/s 2024-01-13T18:48:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:56 smithi084 ceph-mon[116404]: osdmap e1474: 8 total, 8 up, 8 in 2024-01-13T18:48:56.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:56 smithi084 ceph-mon[119097]: pgmap v2661: 137 pgs: 4 creating+peering, 133 active+clean; 18 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 165 KiB/s wr, 23 op/s 2024-01-13T18:48:56.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:56 smithi084 ceph-mon[119097]: osdmap e1474: 8 total, 8 up, 8 in 2024-01-13T18:48:57.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:57 smithi099 ceph-mon[138788]: osdmap e1475: 8 total, 8 up, 8 in 2024-01-13T18:48:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:57 smithi084 ceph-mon[116404]: osdmap e1475: 8 total, 8 up, 8 in 2024-01-13T18:48:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:57 smithi084 ceph-mon[119097]: osdmap e1475: 8 total, 8 up, 8 in 2024-01-13T18:48:58.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:58 smithi099 ceph-mon[138788]: pgmap v2664: 137 pgs: 137 active+clean; 22 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 224 KiB/s wr, 23 op/s 2024-01-13T18:48:58.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:58 smithi099 ceph-mon[138788]: osdmap e1476: 8 total, 8 up, 8 in 2024-01-13T18:48:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:58 smithi084 ceph-mon[119097]: pgmap v2664: 137 pgs: 137 active+clean; 22 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 224 KiB/s wr, 23 op/s 2024-01-13T18:48:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:58 smithi084 ceph-mon[119097]: osdmap e1476: 8 total, 8 up, 8 in 2024-01-13T18:48:58.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:58 smithi084 ceph-mon[116404]: pgmap v2664: 137 pgs: 137 active+clean; 22 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 224 KiB/s wr, 23 op/s 2024-01-13T18:48:58.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:58 smithi084 ceph-mon[116404]: osdmap e1476: 8 total, 8 up, 8 in 2024-01-13T18:48:59.635 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterateDeterministicPP (3016 ms) 2024-01-13T18:48:59.635 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterateDiscard 2024-01-13T18:48:59.635 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:48:59.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:48:59 smithi099 ceph-mon[138788]: osdmap e1477: 8 total, 8 up, 8 in 2024-01-13T18:48:59.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:48:59 smithi084 ceph-mon[116404]: osdmap e1477: 8 total, 8 up, 8 in 2024-01-13T18:48:59.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:48:59 smithi084 ceph-mon[119097]: osdmap e1477: 8 total, 8 up, 8 in 2024-01-13T18:49:00.601 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:49:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:49:00] "GET /metrics HTTP/1.1" 200 36422 "" "Prometheus/2.43.0" 2024-01-13T18:49:00.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:00 smithi099 ceph-mon[138788]: pgmap v2667: 137 pgs: 137 active+clean; 24 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 67 KiB/s rd, 95 KiB/s wr, 106 op/s 2024-01-13T18:49:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:00 smithi099 ceph-mon[138788]: osdmap e1478: 8 total, 8 up, 8 in 2024-01-13T18:49:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:00 smithi084 ceph-mon[116404]: pgmap v2667: 137 pgs: 137 active+clean; 24 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 67 KiB/s rd, 95 KiB/s wr, 106 op/s 2024-01-13T18:49:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:00 smithi084 ceph-mon[116404]: osdmap e1478: 8 total, 8 up, 8 in 2024-01-13T18:49:00.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:00 smithi084 ceph-mon[119097]: pgmap v2667: 137 pgs: 137 active+clean; 24 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 67 KiB/s rd, 95 KiB/s wr, 106 op/s 2024-01-13T18:49:00.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:00 smithi084 ceph-mon[119097]: osdmap e1478: 8 total, 8 up, 8 in 2024-01-13T18:49:01.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:01 smithi099 ceph-mon[138788]: osdmap e1479: 8 total, 8 up, 8 in 2024-01-13T18:49:01.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:01 smithi084 ceph-mon[116404]: osdmap e1479: 8 total, 8 up, 8 in 2024-01-13T18:49:01.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:01 smithi084 ceph-mon[119097]: osdmap e1479: 8 total, 8 up, 8 in 2024-01-13T18:49:02.654 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterateDiscard (3019 ms) 2024-01-13T18:49:02.654 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterateStress 2024-01-13T18:49:02.654 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:49:02.714 INFO:tasks.workunit.client.0.smithi084.stdout: i=0 exists [27471057~7523016,52734957~5062032,236302575~7066828,286781646~968244,342084442~4714672,348330357~4318654,362467293~4179723,379560197~4077044] wrote [27471057~7523016,52734957~5062032,236302575~7066828,286781646~968244,342084442~4714672,348330357~4318654,362467293~4179723,379560197~4077044] 2024-01-13T18:49:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:02 smithi084 ceph-mon[116404]: pgmap v2670: 137 pgs: 137 active+clean; 24 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 72 KiB/s rd, 36 KiB/s wr, 115 op/s 2024-01-13T18:49:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:02 smithi084 ceph-mon[116404]: osdmap e1480: 8 total, 8 up, 8 in 2024-01-13T18:49:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:02 smithi084 ceph-mon[119097]: pgmap v2670: 137 pgs: 137 active+clean; 24 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 72 KiB/s rd, 36 KiB/s wr, 115 op/s 2024-01-13T18:49:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:02 smithi084 ceph-mon[119097]: osdmap e1480: 8 total, 8 up, 8 in 2024-01-13T18:49:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:02 smithi099 ceph-mon[138788]: pgmap v2670: 137 pgs: 137 active+clean; 24 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 72 KiB/s rd, 36 KiB/s wr, 115 op/s 2024-01-13T18:49:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:02 smithi099 ceph-mon[138788]: osdmap e1480: 8 total, 8 up, 8 in 2024-01-13T18:49:03.577 INFO:tasks.workunit.client.0.smithi084.stdout: i=1 exists [27471057~7523016,52734957~6222096,86280065~2063634,139782882~3964725,152321363~8152040,162612579~2463444,186713364~3082292,236302575~7066828,286781646~968244,322676993~10297098,342084442~4714672,348330357~4318654,362467293~4179723,379560197~4077044,397555795~2892765] wrote [57248828~1708225,86280065~2063634,139782882~3964725,152321363~8152040,162612579~2463444,186713364~3082292,322676993~10297098,397555795~2892765] 2024-01-13T18:49:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:03 smithi084 ceph-mon[119097]: osdmap e1481: 8 total, 8 up, 8 in 2024-01-13T18:49:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:03 smithi084 ceph-mon[119097]: osdmap e1482: 8 total, 8 up, 8 in 2024-01-13T18:49:03.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:03 smithi084 ceph-mon[116404]: osdmap e1481: 8 total, 8 up, 8 in 2024-01-13T18:49:03.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:03 smithi084 ceph-mon[116404]: osdmap e1482: 8 total, 8 up, 8 in 2024-01-13T18:49:04.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:03 smithi099 ceph-mon[138788]: osdmap e1481: 8 total, 8 up, 8 in 2024-01-13T18:49:04.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:03 smithi099 ceph-mon[138788]: osdmap e1482: 8 total, 8 up, 8 in 2024-01-13T18:49:04.691 INFO:tasks.workunit.client.0.smithi084.stdout: i=2 exists [27471057~7523016,46690115~2647728,52734957~6222096,86280065~2063634,95465331~1573447,125098134~4581599,136040994~7965067,152321363~8152040,162612579~2463444,185354198~4441458,228073175~715365,236302575~7066828,267365643~6061869,278579695~2161413,286781646~968244,322676993~10297098,342084442~4714672,348330357~4318654,362467293~4179723,369278376~5958556,379560197~4077044,397555795~2892765] wrote [46690115~2647728,95465331~1573447,125098134~4581599,136040994~7965067,185354198~2530353,228073175~715365,267365643~6061869,278579695~2161413,327538418~701524,369278376~5958556] 2024-01-13T18:49:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:04 smithi084 ceph-mon[116404]: pgmap v2673: 137 pgs: 137 active+clean; 25 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 79 KiB/s rd, 436 KiB/s wr, 115 op/s 2024-01-13T18:49:04.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:04 smithi084 ceph-mon[119097]: pgmap v2673: 137 pgs: 137 active+clean; 25 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 79 KiB/s rd, 436 KiB/s wr, 115 op/s 2024-01-13T18:49:05.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:04 smithi099 ceph-mon[138788]: pgmap v2673: 137 pgs: 137 active+clean; 25 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 79 KiB/s rd, 436 KiB/s wr, 115 op/s 2024-01-13T18:49:05.734 INFO:tasks.workunit.client.0.smithi084.stdout: i=3 exists [19860089~1575368,27471057~11880401,46690115~2647728,52734957~6222096,86280065~2063634,95465331~1573447,125098134~4581599,132292761~11713300,152321363~8152040,162612579~2463444,184639646~665630,185354198~10210267,224342975~5525471,236302575~7066828,267365643~6061869,278579695~2161413,286781646~968244,322676993~15906905,342084442~4714672,348330357~4318654,362467293~4179723,369278376~5958556,379560197~4077044,390190015~10258545] wrote [19860089~1575368,31800591~7550867,132292761~5160963,184639646~665630,188247498~7316967,224342975~5525471,332323949~6259949,390190015~7733166] 2024-01-13T18:49:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:05 smithi084 ceph-mon[116404]: osdmap e1483: 8 total, 8 up, 8 in 2024-01-13T18:49:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:05 smithi084 ceph-mon[119097]: osdmap e1483: 8 total, 8 up, 8 in 2024-01-13T18:49:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:05 smithi099 ceph-mon[138788]: osdmap e1483: 8 total, 8 up, 8 in 2024-01-13T18:49:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:06.689 INFO:tasks.workunit.client.0.smithi084.stdout: i=4 exists [1767741~576224,19860089~1575368,27471057~11880401,46690115~2647728,52112644~6844409,86280065~2063634,95465331~1573447,125098134~4581599,132292761~11713300,152321363~8152040,162612579~2463444,184639646~665630,185354198~10210267,204100499~3831105,224342975~5525471,236302575~7066828,267365643~6061869,278579695~2161413,286781646~968244,297238714~2536503,322676993~18884526,342084442~4714672,348330357~4318654,362467293~4179723,369278376~5958556,379560197~4077044,385125622~328634,390190015~10258545] wrote [1767741~576224,30649337~5822570,52112644~3911931,96833917~175579,190064880~3471098,204100499~3831105,297238714~2536503,335712799~5848720,364237986~442554,385125622~328634] 2024-01-13T18:49:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:06 smithi084 ceph-mon[116404]: pgmap v2676: 137 pgs: 137 active+clean; 53 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 152 KiB/s rd, 4.9 MiB/s wr, 237 op/s 2024-01-13T18:49:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:06 smithi084 ceph-mon[116404]: osdmap e1484: 8 total, 8 up, 8 in 2024-01-13T18:49:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:06 smithi084 ceph-mon[119097]: pgmap v2676: 137 pgs: 137 active+clean; 53 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 152 KiB/s rd, 4.9 MiB/s wr, 237 op/s 2024-01-13T18:49:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:06 smithi084 ceph-mon[119097]: osdmap e1484: 8 total, 8 up, 8 in 2024-01-13T18:49:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:06 smithi099 ceph-mon[138788]: pgmap v2676: 137 pgs: 137 active+clean; 53 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 152 KiB/s rd, 4.9 MiB/s wr, 237 op/s 2024-01-13T18:49:07.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:06 smithi099 ceph-mon[138788]: osdmap e1484: 8 total, 8 up, 8 in 2024-01-13T18:49:07.718 INFO:tasks.workunit.client.0.smithi084.stdout: i=5 exists [1767741~576224,19860089~1575368,27471057~11880401,46690115~2647728,52112644~6844409,86280065~2063634,90054422~482934,95465331~1573447,125098134~4581599,132292761~11713300,152321363~8152040,162612579~2463444,176960894~4671563,184639646~665630,185354198~10210267,195615736~5633779,204100499~3831105,212573530~3456465,224342975~5525471,236302575~7066828,267365643~6061869,278579695~2161413,286781646~968244,297238714~2536503,309749103~7630186,322676993~18884526,342084442~4714672,348330357~4318654,362467293~4179723,369278376~5958556,379560197~4077044,385125622~328634,390190015~15054241,408497876~1814664] wrote [90054422~482934,176960894~4671563,191643457~3197721,195615736~5633779,212573530~3456465,309749103~7630186,363610808~2604940,398388166~6856090,408497876~1814664] 2024-01-13T18:49:07.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:07 smithi084 ceph-mon[116404]: osdmap e1485: 8 total, 8 up, 8 in 2024-01-13T18:49:07.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:07 smithi084 ceph-mon[119097]: osdmap e1485: 8 total, 8 up, 8 in 2024-01-13T18:49:08.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:07 smithi099 ceph-mon[138788]: osdmap e1485: 8 total, 8 up, 8 in 2024-01-13T18:49:08.719 INFO:tasks.workunit.client.0.smithi084.stdout: i=6 exists [1767741~576224,19860089~1575368,27471057~11880401,46690115~2647728,52112644~10437211,80724763~3878868,86280065~2063634,90054422~482934,95465331~1573447,122766344~8954144,132292761~11713300,152321363~8152040,162612579~2463444,176960894~4671563,184639646~665630,185354198~10210267,195615736~5633779,204100499~3831105,212573530~3456465,224342975~5525471,236302575~7066828,267365643~13375465,286781646~968244,290649863~329176,297238714~2536503,304672604~9697,309749103~7630186,322676993~18884526,342084442~4714672,348330357~4318654,362467293~4179723,369278376~5958556,379560197~4077044,385125622~328634,390190015~20122525] wrote [48268431~626645,58734299~3815556,80724763~3878868,122766344~8954144,271291894~8045526,290649863~329176,304672604~9697,402372191~7034065] 2024-01-13T18:49:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:08 smithi084 ceph-mon[116404]: pgmap v2679: 137 pgs: 137 active+clean; 101 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 82 KiB/s rd, 14 MiB/s wr, 146 op/s 2024-01-13T18:49:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:08 smithi084 ceph-mon[116404]: osdmap e1486: 8 total, 8 up, 8 in 2024-01-13T18:49:08.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:08 smithi084 ceph-mon[119097]: pgmap v2679: 137 pgs: 137 active+clean; 101 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 82 KiB/s rd, 14 MiB/s wr, 146 op/s 2024-01-13T18:49:08.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:08 smithi084 ceph-mon[119097]: osdmap e1486: 8 total, 8 up, 8 in 2024-01-13T18:49:09.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:08 smithi099 ceph-mon[138788]: pgmap v2679: 137 pgs: 137 active+clean; 101 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 82 KiB/s rd, 14 MiB/s wr, 146 op/s 2024-01-13T18:49:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:08 smithi099 ceph-mon[138788]: osdmap e1486: 8 total, 8 up, 8 in 2024-01-13T18:49:09.773 INFO:tasks.workunit.client.0.smithi084.stdout: i=7 exists [1767741~576224,7639876~5345884,15944640~6073998,27471057~11880401,46690115~2647728,52112644~13030465,80724763~3878868,86280065~2063634,90054422~482934,95465331~1573447,122766344~8954144,132292761~11713300,152321363~8152040,162612579~2463444,176960894~8344382,185354198~10210267,195615736~5633779,204100499~3831105,212573530~3456465,224342975~5525471,236302575~7066828,267365643~13375465,286120556~8104669,297238714~2536503,304672604~9697,309749103~7630186,322676993~18884526,342084442~4714672,348330357~4318654,362467293~4179723,369278376~5958556,377348022~1324573,379560197~4077044,385125622~328634,390190015~20122525] wrote [7639876~5345884,15944640~6073998,54192957~1793790,61139627~4003482,124256374~6586694,179959511~5054357,286120556~8104669,331496109~3066657,377348022~1324573] 2024-01-13T18:49:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:09 smithi084 ceph-mon[116404]: osdmap e1487: 8 total, 8 up, 8 in 2024-01-13T18:49:09.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:09 smithi084 ceph-mon[119097]: osdmap e1487: 8 total, 8 up, 8 in 2024-01-13T18:49:10.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:09 smithi099 ceph-mon[138788]: osdmap e1487: 8 total, 8 up, 8 in 2024-01-13T18:49:10.673 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:49:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:49:10] "GET /metrics HTTP/1.1" 200 36482 "" "Prometheus/2.43.0" 2024-01-13T18:49:10.767 INFO:tasks.workunit.client.0.smithi084.stdout: i=8 exists [1767741~576224,7639876~5345884,15944640~6073998,27471057~11880401,46690115~2647728,52112644~13030465,80724763~3878868,86280065~2063634,90054422~482934,95465331~1573447,122766344~8954144,132292761~11713300,152321363~8152040,162612579~2463444,176960894~8344382,185354198~10210267,195615736~7794481,204100499~3831105,212573530~3456465,224342975~5525471,236302575~7066828,267365643~13375465,286120556~8104669,295629500~4145717,304672604~9697,309749103~7630186,321896388~24902726,348330357~4318654,362467293~4179723,369278376~5958556,377348022~1324573,379560197~5459182,385125622~328634,390190015~20122525] wrote [31233536~1744769,55748380~8156784,177366088~2522811,199896379~3513838,286488052~6831745,295629500~1702031,321896388~7970293,338184281~4138852,381595277~3424102] 2024-01-13T18:49:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:10 smithi084 ceph-mon[116404]: pgmap v2682: 137 pgs: 137 active+clean; 243 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 51 KiB/s rd, 38 MiB/s wr, 90 op/s 2024-01-13T18:49:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:10 smithi084 ceph-mon[116404]: osdmap e1488: 8 total, 8 up, 8 in 2024-01-13T18:49:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:10 smithi084 ceph-mon[119097]: pgmap v2682: 137 pgs: 137 active+clean; 243 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 51 KiB/s rd, 38 MiB/s wr, 90 op/s 2024-01-13T18:49:10.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:10 smithi084 ceph-mon[119097]: osdmap e1488: 8 total, 8 up, 8 in 2024-01-13T18:49:11.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:10 smithi099 ceph-mon[138788]: pgmap v2682: 137 pgs: 137 active+clean; 243 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 51 KiB/s rd, 38 MiB/s wr, 90 op/s 2024-01-13T18:49:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:10 smithi099 ceph-mon[138788]: osdmap e1488: 8 total, 8 up, 8 in 2024-01-13T18:49:11.774 INFO:tasks.workunit.client.0.smithi084.stdout: i=9 exists [1767741~576224,7639876~5345884,14414705~7603933,27471057~11880401,46690115~2647728,52112644~13030465,80724763~3878868,86280065~2063634,90054422~482934,95465331~1573447,104780815~2719922,122766344~21239717,152321363~8152040,162612579~2463444,170913160~14392116,185354198~10210267,195615736~7794481,204100499~3831105,212573530~3456465,224342975~5525471,236302575~7066828,248246145~3156028,267365643~13375465,286120556~8104669,295024566~6181838,304672604~9697,309749103~7630186,321896388~24902726,348274548~4374463,362467293~12769639,377348022~1324573,379560197~5459182,385125622~328634,390190015~20122525] wrote [14414705~4826302,104780815~2719922,130266645~3883696,170913160~8055960,181173041~3888517,248246145~3156028,295024566~6181838,333513041~7245960,348274548~4237421,362850036~7340052] 2024-01-13T18:49:12.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:11 smithi099 ceph-mon[138788]: osdmap e1489: 8 total, 8 up, 8 in 2024-01-13T18:49:12.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:11 smithi084 ceph-mon[116404]: osdmap e1489: 8 total, 8 up, 8 in 2024-01-13T18:49:12.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:11 smithi084 ceph-mon[119097]: osdmap e1489: 8 total, 8 up, 8 in 2024-01-13T18:49:12.737 INFO:tasks.workunit.client.0.smithi084.stdout: i=10 exists [1767741~576224,7639876~5345884,14414705~7603933,27471057~11880401,46690115~2647728,52112644~13030465,80724763~3878868,86280065~4663739,95465331~1573447,104780815~2719922,119088302~24917759,152321363~8152040,160861188~386607,162612579~2463444,170913160~14392116,185354198~10210267,195615736~7794481,204100499~3831105,212573530~3456465,224342975~6751901,236302575~7066828,248246145~3156028,267365643~13375465,286120556~8104669,295024566~6181838,304672604~9697,309749103~7630186,321896388~24902726,348274548~4374463,355563622~1893493,362467293~12769639,377348022~1324573,379560197~5459182,385125622~328634,390190015~20122525] wrote [57669910~3051638,88001173~2942631,119088302~4932712,160861188~386607,226460656~4634220,288154201~5508719,296587035~14862,332692745~6928923,355563622~1893493,407936331~1704444] 2024-01-13T18:49:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:12 smithi099 ceph-mon[138788]: pgmap v2685: 137 pgs: 137 active+clean; 287 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 148 KiB/s rd, 38 MiB/s wr, 243 op/s 2024-01-13T18:49:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:12 smithi099 ceph-mon[138788]: osdmap e1490: 8 total, 8 up, 8 in 2024-01-13T18:49:13.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:12 smithi084 ceph-mon[119097]: pgmap v2685: 137 pgs: 137 active+clean; 287 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 148 KiB/s rd, 38 MiB/s wr, 243 op/s 2024-01-13T18:49:13.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:12 smithi084 ceph-mon[119097]: osdmap e1490: 8 total, 8 up, 8 in 2024-01-13T18:49:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:12 smithi084 ceph-mon[116404]: pgmap v2685: 137 pgs: 137 active+clean; 287 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 148 KiB/s rd, 38 MiB/s wr, 243 op/s 2024-01-13T18:49:13.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:12 smithi084 ceph-mon[116404]: osdmap e1490: 8 total, 8 up, 8 in 2024-01-13T18:49:13.776 INFO:tasks.workunit.client.0.smithi084.stdout: i=11 exists [1767741~576224,7639876~5345884,13483907~199083,14414705~7603933,27471057~11880401,45879010~3458833,52112644~13030465,80724763~3878868,86280065~4663739,95465331~1573447,104780815~2719922,119088302~24917759,152321363~8152040,160861188~386607,162612579~2463444,170913160~14392116,185354198~10210267,195615736~7794481,204100499~3831105,210169372~6282523,224342975~6751901,236302575~7066828,248246145~3156028,259329507~2405849,267365643~13375465,286120556~8104669,295024566~6181838,304672604~9697,309749103~7630186,319041924~27757190,347157715~5491296,355563622~1893493,361568520~13668412,377348022~1324573,379560197~5459182,385125622~328634,390190015~20122525] wrote [13483907~199083,45879010~2307269,152626423~4830808,210169372~6282523,239405914~2847824,259329507~2405849,319041924~3145422,347157715~4688153,361568520~8043915] 2024-01-13T18:49:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:13 smithi099 ceph-mon[138788]: osdmap e1491: 8 total, 8 up, 8 in 2024-01-13T18:49:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:13 smithi084 ceph-mon[116404]: osdmap e1491: 8 total, 8 up, 8 in 2024-01-13T18:49:14.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:13 smithi084 ceph-mon[119097]: osdmap e1491: 8 total, 8 up, 8 in 2024-01-13T18:49:14.769 INFO:tasks.workunit.client.0.smithi084.stdout: i=12 exists [1767741~576224,7639876~5345884,13483907~199083,14414705~7603933,27471057~11880401,45879010~3458833,52112644~13030465,70731358~4551188,80724763~3878868,86280065~5693825,95465331~1573447,99119942~8380795,108244000~691362,119088302~25452522,152321363~8152040,160861188~386607,162612579~2463444,170913160~14392116,185354198~10210267,195615736~7794481,204100499~3831105,210169372~6282523,224342975~6751901,236302575~7066828,248246145~3156028,259329507~2405849,267365643~13375465,286120556~8104669,295024566~6181838,304672604~9697,305185000~4454741,309749103~7630186,319041924~27757190,347157715~5491296,355563622~1893493,358946753~1392312,361568520~13668412,377348022~1324573,379560197~5459182,385125622~328634,390190015~20122525] wrote [29962447~7373354,70731358~4551188,86741891~5231999,99119942~7660288,108244000~691362,135972816~5522270,142489597~2051227,305185000~4454741,358946753~1392312,403596784~1275575] 2024-01-13T18:49:15.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:14 smithi099 ceph-mon[138788]: pgmap v2688: 137 pgs: 137 active+clean; 411 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 176 KiB/s rd, 37 MiB/s wr, 281 op/s 2024-01-13T18:49:15.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:14 smithi099 ceph-mon[138788]: osdmap e1492: 8 total, 8 up, 8 in 2024-01-13T18:49:15.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:14 smithi084 ceph-mon[119097]: pgmap v2688: 137 pgs: 137 active+clean; 411 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 176 KiB/s rd, 37 MiB/s wr, 281 op/s 2024-01-13T18:49:15.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:14 smithi084 ceph-mon[119097]: osdmap e1492: 8 total, 8 up, 8 in 2024-01-13T18:49:15.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:14 smithi084 ceph-mon[116404]: pgmap v2688: 137 pgs: 137 active+clean; 411 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 176 KiB/s rd, 37 MiB/s wr, 281 op/s 2024-01-13T18:49:15.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:14 smithi084 ceph-mon[116404]: osdmap e1492: 8 total, 8 up, 8 in 2024-01-13T18:49:15.761 INFO:tasks.workunit.client.0.smithi084.stdout: i=13 exists [1767741~576224,7639876~5345884,13483907~199083,14414705~9048895,27471057~11880401,45879010~3458833,52112644~13030465,70731358~4551188,80724763~4191571,86280065~5693825,95465331~1573447,99119942~8380795,108244000~691362,112441051~2828071,119088302~25452522,152321363~8152040,160861188~386607,162612579~2463444,170913160~14392116,185354198~10210267,195615736~7794481,204100499~3831105,210169372~6282523,224342975~19026428,247908911~3493262,259329507~2405849,267365643~13375465,286120556~8104669,295024566~6181838,304672604~9697,305185000~4454741,309749103~7630186,319041924~27757190,347157715~5491296,355563622~1893493,358946753~1392312,361568520~13668412,377348022~1324573,379560197~5459182,385125622~328634,390190015~20122525] wrote [16683262~6780338,33187875~1373364,81758281~3158053,112441051~2828071,133186086~2021878,229880792~7666582,247908911~2506021,312389202~3940080,374943949~232205] 2024-01-13T18:49:16.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:15 smithi099 ceph-mon[138788]: osdmap e1493: 8 total, 8 up, 8 in 2024-01-13T18:49:16.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:15 smithi099 ceph-mon[138788]: pgmap v2691: 137 pgs: 137 active+clean; 470 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 187 KiB/s rd, 40 MiB/s wr, 301 op/s 2024-01-13T18:49:16.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:15 smithi084 ceph-mon[116404]: osdmap e1493: 8 total, 8 up, 8 in 2024-01-13T18:49:16.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:15 smithi084 ceph-mon[116404]: pgmap v2691: 137 pgs: 137 active+clean; 470 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 187 KiB/s rd, 40 MiB/s wr, 301 op/s 2024-01-13T18:49:16.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:15 smithi084 ceph-mon[119097]: osdmap e1493: 8 total, 8 up, 8 in 2024-01-13T18:49:16.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:15 smithi084 ceph-mon[119097]: pgmap v2691: 137 pgs: 137 active+clean; 470 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 187 KiB/s rd, 40 MiB/s wr, 301 op/s 2024-01-13T18:49:16.772 INFO:tasks.workunit.client.0.smithi084.stdout: i=14 exists [1767741~576224,7639876~5345884,13483907~199083,14414705~9048895,27471057~11880401,45879010~19264099,70731358~4551188,80724763~4191571,86280065~5693825,95465331~1573447,99119942~8380795,108244000~691362,112441051~2828071,119088302~25452522,152321363~8152040,160861188~386607,162612579~2463444,165148955~20156321,185354198~10210267,195615736~7794481,204100499~3831105,210169372~6282523,224342975~19026428,247908911~3493262,259329507~2405849,266415543~14325565,286120556~8104669,295024566~6181838,304672604~9697,305185000~4454741,309749103~7630186,319041924~27757190,347157715~5491296,355563622~1893493,358946753~1392312,361568520~13668412,377348022~1324573,379560197~5894059,390190015~20122525] wrote [31487869~715570,46605149~7255489,135062662~3881801,165148955~7813228,190845385~365375,234585533~3222248,266415543~6799391,382735136~2614443,401564266~303790,409604703~105318] 2024-01-13T18:49:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:16 smithi099 ceph-mon[138788]: osdmap e1494: 8 total, 8 up, 8 in 2024-01-13T18:49:17.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:16 smithi084 ceph-mon[116404]: osdmap e1494: 8 total, 8 up, 8 in 2024-01-13T18:49:17.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:16 smithi084 ceph-mon[119097]: osdmap e1494: 8 total, 8 up, 8 in 2024-01-13T18:49:17.809 INFO:tasks.workunit.client.0.smithi084.stdout: i=15 exists [1767741~576224,7639876~5345884,13483907~199083,14414705~9048895,27471057~11880401,45879010~19264099,70731358~4551188,77589803~7326531,86280065~5693825,95465331~1573447,99119942~8380795,108244000~691362,112441051~2828071,119088302~25452522,152321363~8152040,160861188~386607,162612579~2463444,165148955~20156321,185354198~10210267,195615736~7794481,204100499~3831105,210169372~6282523,224297044~19072359,247908911~3493262,258090860~6832652,265269806~15471302,286120556~8104669,295024566~6181838,304672604~9697,305185000~4454741,309749103~7893578,319041924~27757190,347157715~5491296,355563622~1893493,358946753~1392312,361568520~13668412,377348022~1324573,379560197~6510334,390190015~20122525] wrote [14895338~7955635,77589803~4602939,211491031~4363054,224297044~6232539,236949899~4226819,258090860~6832652,265269806~3511777,317003119~639562,369471266~341040,383825105~2245426] 2024-01-13T18:49:18.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:17 smithi099 ceph-mon[138788]: osdmap e1495: 8 total, 8 up, 8 in 2024-01-13T18:49:18.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:17 smithi099 ceph-mon[138788]: pgmap v2694: 137 pgs: 137 active+clean; 519 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 112 KiB/s rd, 23 MiB/s wr, 193 op/s 2024-01-13T18:49:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:17 smithi084 ceph-mon[116404]: osdmap e1495: 8 total, 8 up, 8 in 2024-01-13T18:49:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:17 smithi084 ceph-mon[116404]: pgmap v2694: 137 pgs: 137 active+clean; 519 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 112 KiB/s rd, 23 MiB/s wr, 193 op/s 2024-01-13T18:49:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:17 smithi084 ceph-mon[119097]: osdmap e1495: 8 total, 8 up, 8 in 2024-01-13T18:49:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:17 smithi084 ceph-mon[119097]: pgmap v2694: 137 pgs: 137 active+clean; 519 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 112 KiB/s rd, 23 MiB/s wr, 193 op/s 2024-01-13T18:49:18.834 INFO:tasks.workunit.client.0.smithi084.stdout: i=16 exists [1767741~576224,7639876~6192235,14414705~9048895,27471057~11880401,45879010~19264099,70731358~4551188,77589803~7326531,86280065~5693825,95465331~1573447,97276459~1292577,99119942~8380795,108244000~691362,111521038~3748084,119088302~27091563,152321363~8152040,160765377~24539899,185354198~10210267,195615736~7794481,204100499~3831105,210169372~6282523,224297044~19072359,247908911~3493262,258090860~22650248,286120556~8104669,295024566~8811802,304672604~9697,305185000~4454741,309749103~7893578,319041924~27757190,347157715~5491296,355563622~1893493,358946753~1392312,361568520~13668412,377348022~1324573,379560197~6510334,390190015~20122525] wrote [9730362~4101749,57570042~6520805,97276459~1292577,111521038~977076,122601771~7953464,138127191~8052674,160765377~6893072,263167257~8129523,295796050~8040318] 2024-01-13T18:49:19.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:18 smithi099 ceph-mon[138788]: osdmap e1496: 8 total, 8 up, 8 in 2024-01-13T18:49:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:18 smithi084 ceph-mon[116404]: osdmap e1496: 8 total, 8 up, 8 in 2024-01-13T18:49:19.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:18 smithi084 ceph-mon[119097]: osdmap e1496: 8 total, 8 up, 8 in 2024-01-13T18:49:19.795 INFO:tasks.workunit.client.0.smithi084.stdout: i=17 exists [1767741~576224,7639876~6192235,14414705~9048895,27471057~11880401,45879010~20649418,70731358~4551188,77589803~7326531,86280065~5693825,95465331~1573447,97276459~1292577,99119942~8380795,108244000~691362,111521038~3748084,119088302~27091563,152321363~8152040,160765377~34799088,195615736~7794481,204100499~3831105,210169372~6282523,224297044~19072359,247908911~3493262,258090860~22650248,286120556~8104669,295024566~14615175,309749103~7893578,319041924~27757190,347157715~5491296,355563622~1893493,358548937~16687995,377348022~1324573,379560197~6510334,390190015~20122525] wrote [49639523~1284451,62681590~3846838,136846976~1914300,168716740~1903538,181073087~11271869,260461008~5705514,302687571~5009940,358548937~3917012,391757054~85164] 2024-01-13T18:49:20.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:19 smithi099 ceph-mon[138788]: osdmap e1497: 8 total, 8 up, 8 in 2024-01-13T18:49:20.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:19 smithi099 ceph-mon[138788]: pgmap v2697: 137 pgs: 137 active+clean; 636 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 110 KiB/s rd, 37 MiB/s wr, 166 op/s 2024-01-13T18:49:20.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:19 smithi084 ceph-mon[116404]: osdmap e1497: 8 total, 8 up, 8 in 2024-01-13T18:49:20.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:19 smithi084 ceph-mon[116404]: pgmap v2697: 137 pgs: 137 active+clean; 636 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 110 KiB/s rd, 37 MiB/s wr, 166 op/s 2024-01-13T18:49:20.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:19 smithi084 ceph-mon[119097]: osdmap e1497: 8 total, 8 up, 8 in 2024-01-13T18:49:20.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:19 smithi084 ceph-mon[119097]: pgmap v2697: 137 pgs: 137 active+clean; 636 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 110 KiB/s rd, 37 MiB/s wr, 166 op/s 2024-01-13T18:49:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:49:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:49:20] "GET /metrics HTTP/1.1" 200 36485 "" "Prometheus/2.43.0" 2024-01-13T18:49:20.808 INFO:tasks.workunit.client.0.smithi084.stdout: i=18 exists [1767741~576224,7639876~6192235,14414705~9048895,27471057~11880401,45879010~20649418,70731358~4551188,77589803~7326531,86280065~5693825,95465331~1573447,97276459~1292577,99119942~8380795,108244000~691362,111521038~3748084,119088302~32150555,152321363~8152040,160765377~34799088,195615736~12479591,210169372~6282523,224297044~19072359,247908911~3493262,258090860~22650248,284790190~9435035,295024566~14615175,309749103~37050011,347157715~5491296,355563622~1893493,358548937~16687995,377348022~1324573,379560197~6510334,390190015~23515791] wrote [15458448~130984,30248713~98059,47049212~4695251,145875941~5362916,166704736~2443544,201997072~6098255,284790190~3755440,315621474~7753977,406146082~7559724] 2024-01-13T18:49:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:20 smithi099 ceph-mon[138788]: osdmap e1498: 8 total, 8 up, 8 in 2024-01-13T18:49:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:20 smithi084 ceph-mon[116404]: osdmap e1498: 8 total, 8 up, 8 in 2024-01-13T18:49:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:21.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:20 smithi084 ceph-mon[119097]: osdmap e1498: 8 total, 8 up, 8 in 2024-01-13T18:49:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:21.836 INFO:tasks.workunit.client.0.smithi084.stdout: i=19 exists [1767741~576224,7639876~6192235,14414705~9048895,27471057~11880401,45879010~20649418,70731358~4551188,77589803~7326531,86280065~5693825,95465331~1573447,97276459~1292577,99119942~8380795,108244000~691362,111521038~3748084,119088302~32150555,152321363~8152040,160765377~34799088,195615736~12479591,210169372~6282523,219746267~681953,224297044~19072359,247908911~3493262,253635231~1741012,257005829~23735279,284790190~24849551,309749103~37050011,347157715~5491296,355563622~1893493,358548937~16687995,377348022~1324573,379560197~6510334,390190015~23515791] wrote [59795253~3808120,86739717~1227020,164763423~3929427,219746267~681953,253635231~1741012,257005829~1897765,286613109~13352192,364412383~4176302] 2024-01-13T18:49:22.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:21 smithi099 ceph-mon[138788]: osdmap e1499: 8 total, 8 up, 8 in 2024-01-13T18:49:22.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:21 smithi099 ceph-mon[138788]: pgmap v2700: 137 pgs: 137 active+clean; 676 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 220 KiB/s rd, 36 MiB/s wr, 341 op/s 2024-01-13T18:49:22.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:21 smithi084 ceph-mon[116404]: osdmap e1499: 8 total, 8 up, 8 in 2024-01-13T18:49:22.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:21 smithi084 ceph-mon[116404]: pgmap v2700: 137 pgs: 137 active+clean; 676 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 220 KiB/s rd, 36 MiB/s wr, 341 op/s 2024-01-13T18:49:22.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:21 smithi084 ceph-mon[119097]: osdmap e1499: 8 total, 8 up, 8 in 2024-01-13T18:49:22.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:21 smithi084 ceph-mon[119097]: pgmap v2700: 137 pgs: 137 active+clean; 676 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 220 KiB/s rd, 36 MiB/s wr, 341 op/s 2024-01-13T18:49:22.779 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 1 diff [54525952~4194304,83886080~4194304,138412032~4194304,150994944~12582912,184549376~4194304,318767104~12582912,394264576~4194304] 2024-01-13T18:49:22.780 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [54525952~4194304,83886080~4194304,138412032~4194304,150994944~12582912,184549376~4194304,318767104~12582912,394264576~4194304] 2024-01-13T18:49:22.793 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [54525952~8388608,83886080~8388608,138412032~8388608,150994944~16777216,184549376~8388608,318767104~16777216,394264576~8388608] 2024-01-13T18:49:22.793 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 2 diff [46137344~4194304,54525952~4194304,83886080~4194304,92274688~4194304,121634816~8388608,134217728~8388608,150994944~12582912,184549376~8388608,226492416~4194304,264241152~8388608,276824064~4194304,318767104~12582912,369098752~8388608,394264576~4194304] 2024-01-13T18:49:22.793 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [46137344~4194304,54525952~4194304,83886080~4194304,92274688~4194304,121634816~8388608,134217728~8388608,150994944~12582912,184549376~8388608,226492416~4194304,264241152~8388608,276824064~4194304,318767104~12582912,369098752~8388608,394264576~4194304] 2024-01-13T18:49:22.795 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [46137344~4194304,54525952~8388608,83886080~16777216,121634816~8388608,134217728~12582912,150994944~16777216,184549376~8388608,226492416~4194304,264241152~16777216,318767104~16777216,369098752~8388608,394264576~8388608] 2024-01-13T18:49:22.795 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 3 diff [16777216~4194304,29360128~8388608,46137344~4194304,54525952~4194304,83886080~4194304,92274688~4194304,121634816~20971520,150994944~12582912,184549376~12582912,222298112~8388608,264241152~8388608,276824064~4194304,318767104~16777216,369098752~8388608,390070272~12582912] 2024-01-13T18:49:22.795 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [16777216~4194304,29360128~8388608,46137344~4194304,54525952~4194304,83886080~4194304,92274688~4194304,121634816~20971520,150994944~12582912,184549376~12582912,222298112~8388608,264241152~8388608,276824064~4194304,318767104~16777216,369098752~8388608,390070272~12582912] 2024-01-13T18:49:22.798 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [16777216~8388608,29360128~12582912,46137344~4194304,54525952~8388608,83886080~16777216,121634816~25165824,150994944~16777216,184549376~12582912,222298112~8388608,264241152~16777216,318767104~20971520,369098752~8388608,390070272~12582912] 2024-01-13T18:49:22.798 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 4 diff [0~4194304,16777216~4194304,29360128~12582912,46137344~12582912,83886080~4194304,92274688~4194304,121634816~20971520,150994944~12582912,184549376~12582912,201326592~4194304,222298112~8388608,264241152~8388608,276824064~4194304,293601280~4194304,318767104~20971520,360710144~4194304,369098752~8388608,381681664~4194304,390070272~12582912] 2024-01-13T18:49:22.798 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,16777216~4194304,29360128~12582912,46137344~12582912,83886080~4194304,92274688~4194304,121634816~20971520,150994944~12582912,184549376~12582912,201326592~4194304,222298112~8388608,264241152~8388608,276824064~4194304,293601280~4194304,318767104~20971520,360710144~4194304,369098752~8388608,381681664~4194304,390070272~12582912] 2024-01-13T18:49:22.801 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,16777216~8388608,29360128~12582912,46137344~16777216,83886080~16777216,121634816~25165824,150994944~16777216,184549376~12582912,201326592~8388608,222298112~8388608,264241152~16777216,293601280~8388608,318767104~25165824,360710144~4194304,369098752~8388608,381681664~4194304,390070272~12582912] 2024-01-13T18:49:22.801 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 5 diff [0~4194304,16777216~4194304,29360128~12582912,46137344~12582912,83886080~12582912,121634816~20971520,150994944~12582912,176160768~29360128,209715200~4194304,222298112~8388608,264241152~8388608,276824064~4194304,293601280~4194304,306184192~8388608,318767104~20971520,360710144~4194304,369098752~8388608,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.802 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,16777216~4194304,29360128~12582912,46137344~12582912,83886080~12582912,121634816~20971520,150994944~12582912,176160768~29360128,209715200~4194304,222298112~8388608,264241152~8388608,276824064~4194304,293601280~4194304,306184192~8388608,318767104~20971520,360710144~4194304,369098752~8388608,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.805 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,16777216~8388608,29360128~12582912,46137344~16777216,83886080~16777216,121634816~25165824,150994944~16777216,176160768~41943040,222298112~8388608,264241152~16777216,293601280~8388608,306184192~37748736,360710144~16777216,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.805 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 6 diff [0~4194304,16777216~4194304,29360128~12582912,46137344~16777216,79691776~16777216,121634816~20971520,150994944~12582912,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,289406976~8388608,301989888~12582912,318767104~20971520,360710144~4194304,369098752~8388608,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.805 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,16777216~4194304,29360128~12582912,46137344~16777216,79691776~16777216,121634816~20971520,150994944~12582912,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,289406976~8388608,301989888~12582912,318767104~20971520,360710144~4194304,369098752~8388608,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.809 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,16777216~8388608,29360128~12582912,46137344~16777216,79691776~20971520,121634816~25165824,150994944~16777216,176160768~41943040,222298112~8388608,264241152~16777216,289406976~54525952,360710144~16777216,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.809 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 7 diff [0~20971520,29360128~12582912,46137344~16777216,79691776~16777216,121634816~20971520,150994944~12582912,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,285212672~12582912,301989888~12582912,318767104~20971520,360710144~4194304,369098752~8388608,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.809 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~16777216,79691776~16777216,121634816~20971520,150994944~12582912,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,285212672~12582912,301989888~12582912,318767104~20971520,360710144~4194304,369098752~8388608,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.813 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~20971520,121634816~25165824,150994944~16777216,176160768~41943040,222298112~8388608,264241152~16777216,285212672~58720256,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.813 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 8 diff [0~20971520,29360128~12582912,46137344~20971520,79691776~16777216,121634816~20971520,150994944~12582912,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,285212672~12582912,301989888~12582912,318767104~20971520,360710144~4194304,369098752~16777216,390070272~20971520] 2024-01-13T18:49:22.813 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~20971520,79691776~16777216,121634816~20971520,150994944~12582912,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,285212672~12582912,301989888~12582912,318767104~20971520,360710144~4194304,369098752~16777216,390070272~20971520] 2024-01-13T18:49:22.817 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~20971520,121634816~25165824,150994944~16777216,176160768~41943040,222298112~8388608,264241152~16777216,285212672~58720256,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.817 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 9 diff [0~20971520,29360128~12582912,46137344~20971520,79691776~16777216,100663296~4194304,121634816~25165824,150994944~12582912,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,264241152~16777216,285212672~29360128,318767104~20971520,348127232~8388608,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.817 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~20971520,79691776~16777216,100663296~4194304,121634816~25165824,150994944~12582912,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,264241152~16777216,285212672~29360128,318767104~20971520,348127232~8388608,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.822 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~29360128,121634816~25165824,150994944~67108864,222298112~8388608,247463936~4194304,264241152~16777216,285212672~58720256,348127232~8388608,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.822 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 10 diff [0~20971520,29360128~12582912,46137344~20971520,79691776~16777216,100663296~4194304,117440512~25165824,150994944~12582912,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,264241152~16777216,285212672~29360128,318767104~20971520,348127232~8388608,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.822 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~20971520,79691776~16777216,100663296~4194304,117440512~25165824,150994944~12582912,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,264241152~16777216,285212672~29360128,318767104~20971520,348127232~8388608,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.826 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~29360128,117440512~29360128,150994944~67108864,222298112~12582912,247463936~4194304,264241152~16777216,285212672~58720256,348127232~37748736,390070272~20971520] 2024-01-13T18:49:22.826 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 11 diff [0~20971520,29360128~16777216,50331648~16777216,79691776~16777216,100663296~4194304,117440512~25165824,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~37748736,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.826 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~16777216,50331648~16777216,79691776~16777216,100663296~4194304,117440512~25165824,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~37748736,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.831 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~37748736,79691776~29360128,117440512~29360128,150994944~67108864,222298112~12582912,239075328~4194304,247463936~4194304,255852544~25165824,285212672~100663296,390070272~20971520] 2024-01-13T18:49:22.832 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 12 diff [0~20971520,29360128~16777216,50331648~25165824,79691776~29360128,117440512~29360128,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~67108864,390070272~20971520] 2024-01-13T18:49:22.832 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~16777216,50331648~25165824,79691776~29360128,117440512~29360128,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~67108864,390070272~20971520] 2024-01-13T18:49:22.838 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~46137344,79691776~29360128,117440512~29360128,150994944~67108864,222298112~12582912,239075328~4194304,247463936~4194304,255852544~25165824,285212672~100663296,390070272~20971520] 2024-01-13T18:49:22.838 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 13 diff [0~25165824,29360128~16777216,50331648~25165824,79691776~33554432,117440512~29360128,150994944~12582912,167772160~37748736,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~67108864,390070272~20971520] 2024-01-13T18:49:22.838 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~16777216,50331648~25165824,79691776~33554432,117440512~29360128,150994944~12582912,167772160~37748736,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~67108864,390070272~20971520] 2024-01-13T18:49:22.845 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~46137344,79691776~67108864,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,390070272~20971520] 2024-01-13T18:49:22.845 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 14 diff [0~25165824,29360128~33554432,67108864~8388608,79691776~33554432,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,390070272~20971520] 2024-01-13T18:49:22.845 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~8388608,79691776~33554432,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,390070272~20971520] 2024-01-13T18:49:22.851 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~46137344,79691776~67108864,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,390070272~20971520] 2024-01-13T18:49:22.851 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 15 diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~20971520] 2024-01-13T18:49:22.851 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~20971520] 2024-01-13T18:49:22.857 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~117440512,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~125829120] 2024-01-13T18:49:22.857 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 16 diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~20971520] 2024-01-13T18:49:22.857 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~20971520] 2024-01-13T18:49:22.865 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~117440512,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~125829120] 2024-01-13T18:49:22.865 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 17 diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~20971520] 2024-01-13T18:49:22.865 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~20971520] 2024-01-13T18:49:22.873 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~117440512,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~125829120] 2024-01-13T18:49:22.873 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 18 diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~8388608,222298112~20971520,247463936~4194304,255852544~83886080,343932928~41943040,390070272~25165824] 2024-01-13T18:49:22.873 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~8388608,222298112~20971520,247463936~4194304,255852544~83886080,343932928~41943040,390070272~25165824] 2024-01-13T18:49:22.880 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~188743680,222298112~20971520,247463936~4194304,255852544~159383552] 2024-01-13T18:49:22.881 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to 19 diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:22.881 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:22.888 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:22.888 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 2 diff [46137344~4194304,92274688~4194304,121634816~8388608,134217728~8388608,184549376~4194304,226492416~4194304,264241152~8388608,276824064~4194304,327155712~4194304,369098752~8388608] 2024-01-13T18:49:22.888 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [46137344~4194304,92274688~4194304,121634816~8388608,134217728~8388608,184549376~4194304,226492416~4194304,264241152~8388608,276824064~4194304,327155712~4194304,369098752~8388608] 2024-01-13T18:49:22.890 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [46137344~4194304,92274688~8388608,121634816~8388608,134217728~12582912,184549376~4194304,226492416~4194304,264241152~16777216,327155712~4194304,369098752~8388608] 2024-01-13T18:49:22.890 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 3 diff [16777216~4194304,29360128~8388608,46137344~4194304,92274688~4194304,121634816~20971520,184549376~8388608,222298112~8388608,264241152~8388608,276824064~4194304,327155712~12582912,369098752~8388608,390070272~8388608] 2024-01-13T18:49:22.890 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [16777216~4194304,29360128~8388608,46137344~4194304,92274688~4194304,121634816~20971520,184549376~8388608,222298112~8388608,264241152~8388608,276824064~4194304,327155712~12582912,369098752~8388608,390070272~8388608] 2024-01-13T18:49:22.891 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [16777216~8388608,29360128~12582912,46137344~4194304,92274688~8388608,121634816~25165824,184549376~12582912,222298112~8388608,264241152~16777216,327155712~12582912,369098752~8388608,390070272~8388608] 2024-01-13T18:49:22.891 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 4 diff [0~4194304,16777216~4194304,29360128~12582912,46137344~8388608,92274688~4194304,121634816~20971520,184549376~8388608,201326592~4194304,222298112~8388608,264241152~8388608,276824064~4194304,293601280~4194304,327155712~16777216,360710144~4194304,369098752~8388608,381681664~4194304,390070272~8388608] 2024-01-13T18:49:22.891 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,16777216~4194304,29360128~12582912,46137344~8388608,92274688~4194304,121634816~20971520,184549376~8388608,201326592~4194304,222298112~8388608,264241152~8388608,276824064~4194304,293601280~4194304,327155712~16777216,360710144~4194304,369098752~8388608,381681664~4194304,390070272~8388608] 2024-01-13T18:49:22.893 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,16777216~8388608,29360128~12582912,46137344~12582912,92274688~8388608,121634816~25165824,184549376~12582912,201326592~8388608,222298112~8388608,264241152~16777216,293601280~8388608,327155712~16777216,360710144~4194304,369098752~8388608,381681664~4194304,390070272~8388608] 2024-01-13T18:49:22.894 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 5 diff [0~4194304,16777216~4194304,29360128~12582912,46137344~8388608,88080384~8388608,121634816~20971520,176160768~29360128,209715200~4194304,222298112~8388608,264241152~8388608,276824064~4194304,293601280~4194304,306184192~8388608,327155712~16777216,360710144~4194304,369098752~8388608,381681664~4194304,390070272~12582912,406847488~4194304] 2024-01-13T18:49:22.894 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,16777216~4194304,29360128~12582912,46137344~8388608,88080384~8388608,121634816~20971520,176160768~29360128,209715200~4194304,222298112~8388608,264241152~8388608,276824064~4194304,293601280~4194304,306184192~8388608,327155712~16777216,360710144~4194304,369098752~8388608,381681664~4194304,390070272~12582912,406847488~4194304] 2024-01-13T18:49:22.899 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,16777216~8388608,29360128~12582912,46137344~12582912,88080384~12582912,121634816~25165824,176160768~41943040,222298112~8388608,264241152~16777216,293601280~8388608,306184192~12582912,327155712~16777216,360710144~16777216,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.899 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 6 diff [0~4194304,16777216~4194304,29360128~12582912,46137344~8388608,58720256~4194304,79691776~4194304,88080384~8388608,121634816~20971520,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,289406976~8388608,301989888~12582912,327155712~16777216,360710144~4194304,369098752~8388608,381681664~4194304,390070272~16777216] 2024-01-13T18:49:22.899 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,16777216~4194304,29360128~12582912,46137344~8388608,58720256~4194304,79691776~4194304,88080384~8388608,121634816~20971520,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,289406976~8388608,301989888~12582912,327155712~16777216,360710144~4194304,369098752~8388608,381681664~4194304,390070272~16777216] 2024-01-13T18:49:22.899 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,16777216~8388608,29360128~12582912,46137344~16777216,79691776~20971520,121634816~25165824,176160768~41943040,222298112~8388608,264241152~16777216,289406976~29360128,327155712~16777216,360710144~16777216,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.899 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 7 diff [0~20971520,29360128~12582912,46137344~8388608,58720256~8388608,79691776~4194304,88080384~8388608,121634816~20971520,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,285212672~12582912,301989888~12582912,327155712~16777216,360710144~4194304,369098752~8388608,381681664~4194304,390070272~16777216] 2024-01-13T18:49:22.900 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~8388608,58720256~8388608,79691776~4194304,88080384~8388608,121634816~20971520,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,285212672~12582912,301989888~12582912,327155712~16777216,360710144~4194304,369098752~8388608,381681664~4194304,390070272~16777216] 2024-01-13T18:49:22.902 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~20971520,121634816~25165824,176160768~41943040,222298112~8388608,264241152~16777216,285212672~33554432,327155712~16777216,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.903 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 8 diff [0~20971520,29360128~12582912,46137344~20971520,79691776~4194304,88080384~8388608,121634816~20971520,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,285212672~12582912,301989888~12582912,318767104~8388608,331350016~12582912,360710144~4194304,369098752~16777216,390070272~16777216] 2024-01-13T18:49:22.903 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~20971520,79691776~4194304,88080384~8388608,121634816~20971520,176160768~29360128,209715200~4194304,222298112~8388608,264241152~16777216,285212672~12582912,301989888~12582912,318767104~8388608,331350016~12582912,360710144~4194304,369098752~16777216,390070272~16777216] 2024-01-13T18:49:22.906 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~20971520,121634816~25165824,176160768~41943040,222298112~8388608,264241152~16777216,285212672~58720256,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.906 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 9 diff [0~20971520,29360128~12582912,46137344~20971520,79691776~4194304,88080384~8388608,100663296~4194304,121634816~25165824,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,264241152~16777216,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~25165824,390070272~16777216] 2024-01-13T18:49:22.906 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~20971520,79691776~4194304,88080384~8388608,100663296~4194304,121634816~25165824,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,264241152~16777216,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~25165824,390070272~16777216] 2024-01-13T18:49:22.911 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~29360128,121634816~25165824,167772160~50331648,222298112~8388608,247463936~4194304,264241152~16777216,285212672~58720256,348127232~8388608,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.911 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 10 diff [0~20971520,29360128~12582912,46137344~20971520,79691776~8388608,92274688~4194304,100663296~4194304,117440512~25165824,159383552~4194304,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,264241152~16777216,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~25165824,390070272~16777216] 2024-01-13T18:49:22.911 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~20971520,79691776~8388608,92274688~4194304,100663296~4194304,117440512~25165824,159383552~4194304,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,264241152~16777216,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~25165824,390070272~16777216] 2024-01-13T18:49:22.914 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~29360128,117440512~29360128,159383552~4194304,167772160~50331648,222298112~12582912,247463936~4194304,264241152~16777216,285212672~58720256,348127232~37748736,390070272~20971520] 2024-01-13T18:49:22.914 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 11 diff [0~20971520,29360128~16777216,50331648~16777216,79691776~8388608,92274688~4194304,100663296~4194304,117440512~25165824,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~37748736,360710144~25165824,390070272~16777216] 2024-01-13T18:49:22.914 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~16777216,50331648~16777216,79691776~8388608,92274688~4194304,100663296~4194304,117440512~25165824,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~37748736,360710144~25165824,390070272~16777216] 2024-01-13T18:49:22.919 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~37748736,79691776~29360128,117440512~29360128,150994944~12582912,167772160~50331648,222298112~12582912,239075328~4194304,247463936~4194304,255852544~25165824,285212672~100663296,390070272~20971520] 2024-01-13T18:49:22.919 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 12 diff [0~20971520,29360128~16777216,50331648~25165824,79691776~29360128,117440512~29360128,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.919 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~16777216,50331648~25165824,79691776~29360128,117440512~29360128,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.924 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~46137344,79691776~29360128,117440512~29360128,150994944~12582912,167772160~50331648,222298112~12582912,239075328~4194304,247463936~4194304,255852544~25165824,285212672~100663296,390070272~20971520] 2024-01-13T18:49:22.924 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 13 diff [0~25165824,29360128~16777216,50331648~25165824,79691776~33554432,117440512~29360128,150994944~12582912,167772160~37748736,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.924 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~16777216,50331648~25165824,79691776~33554432,117440512~29360128,150994944~12582912,167772160~37748736,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.929 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~46137344,79691776~67108864,150994944~12582912,167772160~50331648,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,390070272~20971520] 2024-01-13T18:49:22.929 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 14 diff [0~25165824,29360128~33554432,67108864~8388608,79691776~33554432,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,390070272~16777216] 2024-01-13T18:49:22.929 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~8388608,79691776~33554432,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,390070272~16777216] 2024-01-13T18:49:22.934 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~46137344,79691776~67108864,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,390070272~20971520] 2024-01-13T18:49:22.934 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 15 diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.934 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.940 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~117440512,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~125829120] 2024-01-13T18:49:22.940 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 16 diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.940 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.945 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~117440512,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~125829120] 2024-01-13T18:49:22.945 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 17 diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.945 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.952 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~117440512,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~125829120] 2024-01-13T18:49:22.952 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 18 diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~8388608,222298112~20971520,247463936~4194304,255852544~71303168,331350016~54525952,390070272~20971520] 2024-01-13T18:49:22.952 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~8388608,222298112~20971520,247463936~4194304,255852544~71303168,331350016~54525952,390070272~20971520] 2024-01-13T18:49:22.958 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~188743680,222298112~20971520,247463936~4194304,255852544~159383552] 2024-01-13T18:49:22.958 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to 19 diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:22.958 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:22.965 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:22.965 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 3 diff [16777216~4194304,29360128~8388608,130023424~8388608,184549376~8388608,222298112~8388608,331350016~8388608,390070272~8388608] 2024-01-13T18:49:22.966 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [16777216~4194304,29360128~8388608,130023424~8388608,184549376~8388608,222298112~8388608,331350016~8388608,390070272~8388608] 2024-01-13T18:49:22.967 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [16777216~8388608,29360128~12582912,130023424~8388608,184549376~12582912,222298112~8388608,331350016~8388608,390070272~8388608] 2024-01-13T18:49:22.967 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 4 diff [0~4194304,16777216~4194304,29360128~12582912,50331648~4194304,96468992~4194304,130023424~8388608,184549376~8388608,201326592~4194304,222298112~8388608,293601280~4194304,331350016~12582912,360710144~4194304,381681664~4194304,390070272~8388608] 2024-01-13T18:49:22.967 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,16777216~4194304,29360128~12582912,50331648~4194304,96468992~4194304,130023424~8388608,184549376~8388608,201326592~4194304,222298112~8388608,293601280~4194304,331350016~12582912,360710144~4194304,381681664~4194304,390070272~8388608] 2024-01-13T18:49:22.968 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,16777216~8388608,29360128~12582912,50331648~8388608,96468992~4194304,130023424~8388608,184549376~12582912,201326592~8388608,222298112~8388608,293601280~8388608,331350016~12582912,360710144~4194304,381681664~4194304,390070272~8388608] 2024-01-13T18:49:22.968 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 5 diff [0~4194304,16777216~4194304,29360128~12582912,50331648~4194304,88080384~4194304,96468992~4194304,130023424~8388608,176160768~29360128,209715200~4194304,222298112~8388608,293601280~4194304,306184192~8388608,331350016~12582912,360710144~4194304,381681664~4194304,390070272~12582912,406847488~4194304] 2024-01-13T18:49:22.968 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,16777216~4194304,29360128~12582912,50331648~4194304,88080384~4194304,96468992~4194304,130023424~8388608,176160768~29360128,209715200~4194304,222298112~8388608,293601280~4194304,306184192~8388608,331350016~12582912,360710144~4194304,381681664~4194304,390070272~12582912,406847488~4194304] 2024-01-13T18:49:22.969 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,16777216~8388608,29360128~12582912,50331648~8388608,88080384~4194304,96468992~4194304,130023424~8388608,176160768~41943040,222298112~8388608,293601280~8388608,306184192~12582912,331350016~12582912,360710144~8388608,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.969 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 6 diff [0~4194304,16777216~4194304,29360128~12582912,46137344~8388608,58720256~4194304,79691776~4194304,88080384~4194304,96468992~4194304,121634816~16777216,176160768~29360128,209715200~4194304,222298112~8388608,268435456~8388608,289406976~8388608,301989888~12582912,331350016~12582912,360710144~4194304,381681664~4194304,390070272~16777216] 2024-01-13T18:49:22.969 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,16777216~4194304,29360128~12582912,46137344~8388608,58720256~4194304,79691776~4194304,88080384~4194304,96468992~4194304,121634816~16777216,176160768~29360128,209715200~4194304,222298112~8388608,268435456~8388608,289406976~8388608,301989888~12582912,331350016~12582912,360710144~4194304,381681664~4194304,390070272~16777216] 2024-01-13T18:49:22.972 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,16777216~8388608,29360128~12582912,46137344~16777216,79691776~12582912,96468992~4194304,121634816~16777216,176160768~41943040,222298112~8388608,268435456~12582912,289406976~29360128,331350016~12582912,360710144~8388608,381681664~4194304,390070272~20971520] 2024-01-13T18:49:22.972 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 7 diff [0~20971520,29360128~12582912,46137344~8388608,58720256~8388608,79691776~4194304,88080384~4194304,96468992~4194304,121634816~16777216,176160768~29360128,209715200~4194304,222298112~8388608,268435456~8388608,285212672~12582912,301989888~12582912,331350016~12582912,360710144~4194304,373293056~4194304,381681664~4194304,390070272~16777216] 2024-01-13T18:49:22.972 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~8388608,58720256~8388608,79691776~4194304,88080384~4194304,96468992~4194304,121634816~16777216,176160768~29360128,209715200~4194304,222298112~8388608,268435456~8388608,285212672~12582912,301989888~12582912,331350016~12582912,360710144~4194304,373293056~4194304,381681664~4194304,390070272~16777216] 2024-01-13T18:49:22.974 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~12582912,96468992~4194304,121634816~16777216,176160768~41943040,222298112~8388608,268435456~12582912,285212672~33554432,331350016~12582912,360710144~8388608,373293056~12582912,390070272~20971520] 2024-01-13T18:49:22.974 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 8 diff [0~20971520,29360128~12582912,46137344~20971520,79691776~4194304,88080384~4194304,96468992~4194304,121634816~16777216,176160768~29360128,209715200~4194304,222298112~8388608,268435456~8388608,285212672~12582912,301989888~12582912,318767104~8388608,331350016~12582912,360710144~4194304,373293056~12582912,390070272~16777216] 2024-01-13T18:49:22.974 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~20971520,79691776~4194304,88080384~4194304,96468992~4194304,121634816~16777216,176160768~29360128,209715200~4194304,222298112~8388608,268435456~8388608,285212672~12582912,301989888~12582912,318767104~8388608,331350016~12582912,360710144~4194304,373293056~12582912,390070272~16777216] 2024-01-13T18:49:22.977 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~12582912,96468992~4194304,121634816~16777216,176160768~41943040,222298112~8388608,268435456~12582912,285212672~58720256,360710144~8388608,373293056~12582912,390070272~20971520] 2024-01-13T18:49:22.977 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 9 diff [0~20971520,29360128~12582912,46137344~20971520,79691776~4194304,88080384~4194304,96468992~8388608,121634816~16777216,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~12582912,390070272~16777216] 2024-01-13T18:49:22.977 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~20971520,79691776~4194304,88080384~4194304,96468992~8388608,121634816~16777216,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~12582912,390070272~16777216] 2024-01-13T18:49:22.980 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~12582912,96468992~12582912,121634816~16777216,167772160~50331648,222298112~8388608,247463936~4194304,268435456~12582912,285212672~58720256,348127232~8388608,360710144~25165824,390070272~20971520] 2024-01-13T18:49:22.980 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 10 diff [0~20971520,29360128~12582912,46137344~20971520,79691776~8388608,96468992~8388608,117440512~20971520,159383552~4194304,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~12582912,390070272~16777216] 2024-01-13T18:49:22.980 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~12582912,46137344~20971520,79691776~8388608,96468992~8388608,117440512~20971520,159383552~4194304,167772160~37748736,209715200~4194304,222298112~8388608,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~12582912,390070272~16777216] 2024-01-13T18:49:22.983 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~12582912,46137344~20971520,79691776~12582912,96468992~12582912,117440512~20971520,159383552~4194304,167772160~50331648,222298112~12582912,247463936~4194304,268435456~12582912,285212672~58720256,348127232~37748736,390070272~20971520] 2024-01-13T18:49:22.984 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 11 diff [0~20971520,29360128~37748736,79691776~8388608,96468992~8388608,117440512~20971520,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~37748736,360710144~25165824,390070272~16777216] 2024-01-13T18:49:22.984 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~37748736,79691776~8388608,96468992~8388608,117440512~20971520,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~37748736,360710144~25165824,390070272~16777216] 2024-01-13T18:49:22.987 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~37748736,79691776~12582912,96468992~12582912,117440512~20971520,150994944~12582912,167772160~50331648,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,268435456~12582912,285212672~100663296,390070272~20971520] 2024-01-13T18:49:22.987 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 12 diff [0~20971520,29360128~46137344,79691776~12582912,96468992~12582912,117440512~25165824,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.987 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~46137344,79691776~12582912,96468992~12582912,117440512~25165824,150994944~12582912,167772160~37748736,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.991 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~46137344,79691776~12582912,96468992~12582912,117440512~29360128,150994944~12582912,167772160~50331648,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,268435456~12582912,285212672~100663296,390070272~20971520] 2024-01-13T18:49:22.991 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 13 diff [0~25165824,29360128~46137344,79691776~12582912,96468992~16777216,117440512~25165824,150994944~12582912,167772160~37748736,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.991 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~46137344,79691776~12582912,96468992~16777216,117440512~25165824,150994944~12582912,167772160~37748736,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:22.996 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~46137344,79691776~12582912,96468992~50331648,150994944~12582912,167772160~50331648,222298112~20971520,247463936~4194304,255852544~8388608,268435456~12582912,285212672~100663296,390070272~20971520] 2024-01-13T18:49:22.996 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 14 diff [0~25165824,29360128~33554432,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,390070272~16777216] 2024-01-13T18:49:22.996 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,390070272~16777216] 2024-01-13T18:49:23.000 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~46137344,79691776~12582912,96468992~50331648,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,390070272~20971520] 2024-01-13T18:49:23.000 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 15 diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~25165824,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:23.000 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~25165824,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:23.005 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~50331648,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~125829120] 2024-01-13T18:49:23.005 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 16 diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:23.006 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,390070272~16777216] 2024-01-13T18:49:23.011 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~50331648,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~125829120] 2024-01-13T18:49:23.011 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 17 diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~50331648,373293056~12582912,390070272~16777216] 2024-01-13T18:49:23.011 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~50331648,373293056~12582912,390070272~16777216] 2024-01-13T18:49:23.017 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~50331648,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~125829120] 2024-01-13T18:49:23.017 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 18 diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~8388608,222298112~20971520,247463936~4194304,255852544~71303168,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.017 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~8388608,222298112~20971520,247463936~4194304,255852544~71303168,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.023 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~121634816,222298112~20971520,247463936~4194304,255852544~159383552] 2024-01-13T18:49:23.023 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to 19 diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.023 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.029 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:23.029 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 4 diff [0~4194304,29360128~8388608,50331648~4194304,96468992~4194304,188743680~4194304,201326592~4194304,293601280~4194304,335544320~8388608,360710144~4194304,381681664~4194304] 2024-01-13T18:49:23.030 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,29360128~8388608,50331648~4194304,96468992~4194304,188743680~4194304,201326592~4194304,293601280~4194304,335544320~8388608,360710144~4194304,381681664~4194304] 2024-01-13T18:49:23.030 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,29360128~8388608,50331648~8388608,96468992~4194304,188743680~8388608,201326592~8388608,293601280~8388608,335544320~8388608,360710144~4194304,381681664~4194304] 2024-01-13T18:49:23.030 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 5 diff [0~4194304,29360128~8388608,50331648~4194304,88080384~4194304,96468992~4194304,176160768~8388608,188743680~16777216,209715200~4194304,293601280~4194304,306184192~8388608,335544320~8388608,360710144~4194304,381681664~4194304,394264576~8388608,406847488~4194304] 2024-01-13T18:49:23.030 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,29360128~8388608,50331648~4194304,88080384~4194304,96468992~4194304,176160768~8388608,188743680~16777216,209715200~4194304,293601280~4194304,306184192~8388608,335544320~8388608,360710144~4194304,381681664~4194304,394264576~8388608,406847488~4194304] 2024-01-13T18:49:23.032 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,29360128~8388608,50331648~8388608,88080384~4194304,96468992~4194304,176160768~8388608,188743680~29360128,293601280~8388608,306184192~12582912,335544320~8388608,360710144~8388608,381681664~4194304,394264576~16777216] 2024-01-13T18:49:23.032 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 6 diff [0~4194304,29360128~8388608,46137344~8388608,58720256~4194304,79691776~4194304,88080384~4194304,96468992~4194304,121634816~12582912,176160768~8388608,188743680~16777216,209715200~4194304,268435456~8388608,289406976~8388608,301989888~12582912,335544320~8388608,360710144~4194304,381681664~4194304,394264576~12582912] 2024-01-13T18:49:23.032 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~4194304,29360128~8388608,46137344~8388608,58720256~4194304,79691776~4194304,88080384~4194304,96468992~4194304,121634816~12582912,176160768~8388608,188743680~16777216,209715200~4194304,268435456~8388608,289406976~8388608,301989888~12582912,335544320~8388608,360710144~4194304,381681664~4194304,394264576~12582912] 2024-01-13T18:49:23.034 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~4194304,29360128~8388608,46137344~16777216,79691776~12582912,96468992~4194304,121634816~12582912,176160768~8388608,188743680~29360128,268435456~12582912,289406976~29360128,335544320~8388608,360710144~8388608,381681664~4194304,394264576~16777216] 2024-01-13T18:49:23.034 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 7 diff [0~20971520,29360128~8388608,46137344~8388608,58720256~8388608,79691776~4194304,88080384~4194304,96468992~4194304,121634816~12582912,176160768~8388608,188743680~16777216,209715200~4194304,268435456~8388608,285212672~12582912,301989888~12582912,331350016~12582912,360710144~4194304,373293056~4194304,381681664~4194304,394264576~12582912] 2024-01-13T18:49:23.034 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~8388608,46137344~8388608,58720256~8388608,79691776~4194304,88080384~4194304,96468992~4194304,121634816~12582912,176160768~8388608,188743680~16777216,209715200~4194304,268435456~8388608,285212672~12582912,301989888~12582912,331350016~12582912,360710144~4194304,373293056~4194304,381681664~4194304,394264576~12582912] 2024-01-13T18:49:23.036 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,46137344~20971520,79691776~12582912,96468992~4194304,121634816~12582912,176160768~41943040,268435456~12582912,285212672~33554432,331350016~12582912,360710144~8388608,373293056~12582912,394264576~16777216] 2024-01-13T18:49:23.036 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 8 diff [0~20971520,29360128~8388608,46137344~20971520,79691776~4194304,88080384~4194304,96468992~4194304,121634816~12582912,176160768~8388608,188743680~16777216,209715200~4194304,268435456~8388608,285212672~12582912,301989888~12582912,318767104~8388608,331350016~12582912,360710144~4194304,373293056~12582912,394264576~12582912] 2024-01-13T18:49:23.037 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~8388608,46137344~20971520,79691776~4194304,88080384~4194304,96468992~4194304,121634816~12582912,176160768~8388608,188743680~16777216,209715200~4194304,268435456~8388608,285212672~12582912,301989888~12582912,318767104~8388608,331350016~12582912,360710144~4194304,373293056~12582912,394264576~12582912] 2024-01-13T18:49:23.038 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,46137344~20971520,79691776~12582912,96468992~4194304,121634816~12582912,176160768~41943040,268435456~12582912,285212672~58720256,360710144~8388608,373293056~12582912,394264576~16777216] 2024-01-13T18:49:23.038 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 9 diff [0~20971520,29360128~8388608,46137344~20971520,79691776~4194304,88080384~4194304,96468992~8388608,121634816~12582912,167772160~16777216,188743680~16777216,209715200~4194304,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~12582912,394264576~12582912] 2024-01-13T18:49:23.039 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~8388608,46137344~20971520,79691776~4194304,88080384~4194304,96468992~8388608,121634816~12582912,167772160~16777216,188743680~16777216,209715200~4194304,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~12582912,394264576~12582912] 2024-01-13T18:49:23.041 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,46137344~20971520,79691776~12582912,96468992~12582912,121634816~12582912,167772160~50331648,247463936~4194304,268435456~12582912,285212672~58720256,348127232~8388608,360710144~25165824,394264576~16777216] 2024-01-13T18:49:23.041 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 10 diff [0~20971520,29360128~8388608,46137344~20971520,79691776~8388608,96468992~8388608,117440512~16777216,159383552~4194304,167772160~16777216,188743680~16777216,209715200~4194304,222298112~8388608,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~12582912,394264576~12582912] 2024-01-13T18:49:23.041 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~8388608,46137344~20971520,79691776~8388608,96468992~8388608,117440512~16777216,159383552~4194304,167772160~16777216,188743680~16777216,209715200~4194304,222298112~8388608,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~12582912,394264576~12582912] 2024-01-13T18:49:23.045 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,46137344~20971520,79691776~12582912,96468992~12582912,117440512~16777216,159383552~4194304,167772160~50331648,222298112~12582912,247463936~4194304,268435456~12582912,285212672~58720256,348127232~37748736,394264576~16777216] 2024-01-13T18:49:23.045 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 11 diff [0~20971520,29360128~8388608,41943040~25165824,79691776~8388608,96468992~8388608,117440512~16777216,150994944~12582912,167772160~16777216,188743680~16777216,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~37748736,360710144~25165824,394264576~12582912] 2024-01-13T18:49:23.045 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~8388608,41943040~25165824,79691776~8388608,96468992~8388608,117440512~16777216,150994944~12582912,167772160~16777216,188743680~16777216,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~37748736,360710144~25165824,394264576~12582912] 2024-01-13T18:49:23.048 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~25165824,79691776~12582912,96468992~12582912,117440512~16777216,150994944~12582912,167772160~50331648,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,268435456~12582912,285212672~100663296,394264576~16777216] 2024-01-13T18:49:23.048 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 12 diff [0~20971520,29360128~8388608,41943040~33554432,79691776~12582912,96468992~12582912,117440512~25165824,150994944~12582912,167772160~16777216,188743680~16777216,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.048 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~20971520,29360128~8388608,41943040~33554432,79691776~12582912,96468992~12582912,117440512~25165824,150994944~12582912,167772160~16777216,188743680~16777216,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.052 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~33554432,79691776~12582912,96468992~12582912,117440512~29360128,150994944~12582912,167772160~50331648,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,268435456~12582912,285212672~100663296,394264576~16777216] 2024-01-13T18:49:23.052 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 13 diff [0~25165824,29360128~8388608,41943040~33554432,79691776~12582912,96468992~16777216,117440512~25165824,150994944~12582912,167772160~16777216,188743680~16777216,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.052 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~33554432,79691776~12582912,96468992~16777216,117440512~25165824,150994944~12582912,167772160~16777216,188743680~16777216,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.057 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~33554432,79691776~12582912,96468992~50331648,150994944~12582912,167772160~50331648,222298112~20971520,247463936~4194304,255852544~8388608,268435456~12582912,285212672~100663296,394264576~16777216] 2024-01-13T18:49:23.057 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 14 diff [0~25165824,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~33554432,188743680~16777216,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,394264576~12582912] 2024-01-13T18:49:23.057 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~33554432,188743680~16777216,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,394264576~12582912] 2024-01-13T18:49:23.061 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~33554432,79691776~12582912,96468992~50331648,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,394264576~16777216] 2024-01-13T18:49:23.061 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 15 diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~25165824,150994944~33554432,188743680~16777216,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.061 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~25165824,150994944~33554432,188743680~16777216,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.066 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~50331648,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~104857600,394264576~16777216] 2024-01-13T18:49:23.066 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 16 diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~16777216,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.066 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~16777216,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.070 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~50331648,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~104857600,394264576~16777216] 2024-01-13T18:49:23.070 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 17 diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~50331648,373293056~12582912,390070272~16777216] 2024-01-13T18:49:23.071 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~50331648,373293056~12582912,390070272~16777216] 2024-01-13T18:49:23.076 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~50331648,150994944~67108864,222298112~20971520,247463936~4194304,255852544~25165824,285212672~125829120] 2024-01-13T18:49:23.076 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 18 diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~8388608,222298112~20971520,247463936~4194304,255852544~71303168,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.076 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~8388608,222298112~20971520,247463936~4194304,255852544~71303168,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.082 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~121634816,222298112~20971520,247463936~4194304,255852544~159383552] 2024-01-13T18:49:23.082 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to 19 diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.082 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.089 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:23.089 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 5 diff [88080384~4194304,176160768~8388608,188743680~12582912,209715200~4194304,306184192~8388608,360710144~4194304,394264576~8388608,406847488~4194304] 2024-01-13T18:49:23.089 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [88080384~4194304,176160768~8388608,188743680~12582912,209715200~4194304,306184192~8388608,360710144~4194304,394264576~8388608,406847488~4194304] 2024-01-13T18:49:23.089 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [88080384~4194304,176160768~8388608,188743680~12582912,209715200~8388608,306184192~12582912,360710144~8388608,394264576~16777216] 2024-01-13T18:49:23.089 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 6 diff [46137344~4194304,58720256~4194304,79691776~4194304,88080384~4194304,121634816~12582912,176160768~8388608,188743680~12582912,209715200~4194304,268435456~8388608,289406976~4194304,301989888~12582912,360710144~4194304,394264576~12582912] 2024-01-13T18:49:23.090 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [46137344~4194304,58720256~4194304,79691776~4194304,88080384~4194304,121634816~12582912,176160768~8388608,188743680~12582912,209715200~4194304,268435456~8388608,289406976~4194304,301989888~12582912,360710144~4194304,394264576~12582912] 2024-01-13T18:49:23.091 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [46137344~4194304,58720256~4194304,79691776~12582912,121634816~12582912,176160768~8388608,188743680~12582912,209715200~8388608,268435456~12582912,289406976~4194304,301989888~16777216,360710144~8388608,394264576~16777216] 2024-01-13T18:49:23.091 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 7 diff [4194304~16777216,46137344~8388608,58720256~8388608,79691776~4194304,88080384~4194304,121634816~12582912,176160768~8388608,188743680~12582912,209715200~4194304,268435456~8388608,285212672~8388608,301989888~12582912,331350016~4194304,360710144~4194304,373293056~4194304,394264576~12582912] 2024-01-13T18:49:23.092 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,46137344~8388608,58720256~8388608,79691776~4194304,88080384~4194304,121634816~12582912,176160768~8388608,188743680~12582912,209715200~4194304,268435456~8388608,285212672~8388608,301989888~12582912,331350016~4194304,360710144~4194304,373293056~4194304,394264576~12582912] 2024-01-13T18:49:23.094 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,46137344~20971520,79691776~12582912,121634816~12582912,176160768~25165824,209715200~8388608,268435456~12582912,285212672~12582912,301989888~16777216,331350016~4194304,360710144~8388608,373293056~8388608,394264576~16777216] 2024-01-13T18:49:23.094 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 8 diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~4194304,88080384~4194304,121634816~12582912,176160768~8388608,188743680~12582912,209715200~4194304,268435456~8388608,285212672~12582912,301989888~12582912,318767104~8388608,331350016~8388608,360710144~4194304,373293056~8388608,394264576~12582912] 2024-01-13T18:49:23.094 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~4194304,88080384~4194304,121634816~12582912,176160768~8388608,188743680~12582912,209715200~4194304,268435456~8388608,285212672~12582912,301989888~12582912,318767104~8388608,331350016~8388608,360710144~4194304,373293056~8388608,394264576~12582912] 2024-01-13T18:49:23.096 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,46137344~20971520,79691776~12582912,121634816~12582912,176160768~29360128,209715200~8388608,268435456~12582912,285212672~12582912,301989888~41943040,360710144~8388608,373293056~12582912,394264576~16777216] 2024-01-13T18:49:23.096 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 9 diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~4194304,88080384~4194304,100663296~4194304,121634816~12582912,167772160~16777216,188743680~12582912,209715200~4194304,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608,394264576~12582912] 2024-01-13T18:49:23.096 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~4194304,88080384~4194304,100663296~4194304,121634816~12582912,167772160~16777216,188743680~12582912,209715200~4194304,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608,394264576~12582912] 2024-01-13T18:49:23.099 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,46137344~20971520,79691776~12582912,100663296~8388608,121634816~12582912,167772160~37748736,209715200~8388608,247463936~4194304,268435456~12582912,285212672~58720256,348127232~8388608,360710144~25165824,394264576~16777216] 2024-01-13T18:49:23.099 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 10 diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~8388608,100663296~4194304,117440512~16777216,159383552~4194304,167772160~16777216,188743680~12582912,209715200~4194304,222298112~8388608,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608,394264576~12582912] 2024-01-13T18:49:23.099 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~8388608,100663296~4194304,117440512~16777216,159383552~4194304,167772160~16777216,188743680~12582912,209715200~4194304,222298112~8388608,247463936~4194304,268435456~8388608,285212672~29360128,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608,394264576~12582912] 2024-01-13T18:49:23.102 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,46137344~20971520,79691776~12582912,100663296~8388608,117440512~16777216,159383552~4194304,167772160~37748736,209715200~8388608,222298112~12582912,247463936~4194304,268435456~12582912,285212672~58720256,348127232~37748736,394264576~16777216] 2024-01-13T18:49:23.102 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 11 diff [4194304~16777216,29360128~4194304,41943040~20971520,79691776~8388608,100663296~4194304,117440512~16777216,150994944~12582912,167772160~16777216,188743680~12582912,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~37748736,360710144~20971520,394264576~12582912] 2024-01-13T18:49:23.102 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,41943040~20971520,79691776~8388608,100663296~4194304,117440512~16777216,150994944~12582912,167772160~16777216,188743680~12582912,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~37748736,360710144~20971520,394264576~12582912] 2024-01-13T18:49:23.107 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,41943040~25165824,79691776~12582912,100663296~8388608,117440512~16777216,150994944~12582912,167772160~37748736,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,268435456~12582912,285212672~100663296,394264576~16777216] 2024-01-13T18:49:23.108 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 12 diff [4194304~16777216,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~12582912,117440512~25165824,150994944~12582912,167772160~16777216,188743680~12582912,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~62914560,394264576~12582912] 2024-01-13T18:49:23.108 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~12582912,117440512~25165824,150994944~12582912,167772160~16777216,188743680~12582912,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~62914560,394264576~12582912] 2024-01-13T18:49:23.109 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~33554432,79691776~12582912,96468992~12582912,117440512~29360128,150994944~12582912,167772160~37748736,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,268435456~12582912,285212672~100663296,394264576~16777216] 2024-01-13T18:49:23.109 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 13 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~12582912,167772160~16777216,188743680~12582912,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~62914560,394264576~12582912] 2024-01-13T18:49:23.109 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~12582912,167772160~16777216,188743680~12582912,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~62914560,394264576~12582912] 2024-01-13T18:49:23.113 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~33554432,79691776~12582912,96468992~50331648,150994944~12582912,167772160~37748736,209715200~8388608,222298112~20971520,247463936~4194304,255852544~8388608,268435456~12582912,285212672~100663296,394264576~16777216] 2024-01-13T18:49:23.113 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 14 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~33554432,188743680~12582912,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,394264576~12582912] 2024-01-13T18:49:23.114 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~33554432,188743680~12582912,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,394264576~12582912] 2024-01-13T18:49:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:22 smithi099 ceph-mon[138788]: osdmap e1500: 8 total, 8 up, 8 in 2024-01-13T18:49:23.118 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~33554432,79691776~12582912,96468992~50331648,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,394264576~16777216] 2024-01-13T18:49:23.118 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 15 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~25165824,150994944~33554432,188743680~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.118 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~25165824,150994944~33554432,188743680~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.122 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~50331648,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~104857600,394264576~16777216] 2024-01-13T18:49:23.122 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 16 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.122 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~67108864,394264576~12582912] 2024-01-13T18:49:23.126 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~50331648,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~104857600,394264576~16777216] 2024-01-13T18:49:23.126 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 17 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~50331648,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~50331648,373293056~12582912,390070272~16777216] 2024-01-13T18:49:23.126 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~50331648,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~29360128,318767104~50331648,373293056~12582912,390070272~16777216] 2024-01-13T18:49:23.131 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~50331648,150994944~54525952,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~125829120] 2024-01-13T18:49:23.131 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 18 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~8388608,222298112~20971520,247463936~4194304,255852544~71303168,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.131 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~8388608,222298112~20971520,247463936~4194304,255852544~71303168,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.137 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~121634816,222298112~20971520,247463936~4194304,255852544~159383552] 2024-01-13T18:49:23.137 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to 19 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.137 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.143 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:23.143 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 6 diff [46137344~4194304,58720256~4194304,79691776~4194304,121634816~12582912,268435456~8388608,289406976~4194304,301989888~4194304,398458880~8388608] 2024-01-13T18:49:23.143 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [46137344~4194304,58720256~4194304,79691776~4194304,121634816~12582912,268435456~8388608,289406976~4194304,301989888~4194304,398458880~8388608] 2024-01-13T18:49:23.143 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [46137344~4194304,58720256~4194304,79691776~8388608,121634816~12582912,268435456~12582912,289406976~4194304,301989888~4194304,398458880~12582912] 2024-01-13T18:49:23.144 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 7 diff [4194304~16777216,46137344~8388608,58720256~8388608,79691776~4194304,121634816~12582912,176160768~8388608,268435456~8388608,285212672~8388608,301989888~4194304,331350016~4194304,373293056~4194304,398458880~8388608] 2024-01-13T18:49:23.144 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,46137344~8388608,58720256~8388608,79691776~4194304,121634816~12582912,176160768~8388608,268435456~8388608,285212672~8388608,301989888~4194304,331350016~4194304,373293056~4194304,398458880~8388608] 2024-01-13T18:49:23.145 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,46137344~20971520,79691776~8388608,121634816~12582912,176160768~12582912,268435456~12582912,285212672~12582912,301989888~4194304,331350016~4194304,373293056~8388608,398458880~12582912] 2024-01-13T18:49:23.145 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 8 diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~4194304,121634816~12582912,176160768~8388608,197132288~4194304,268435456~8388608,285212672~12582912,301989888~4194304,318767104~8388608,331350016~8388608,373293056~8388608,398458880~8388608] 2024-01-13T18:49:23.145 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~4194304,121634816~12582912,176160768~8388608,197132288~4194304,268435456~8388608,285212672~12582912,301989888~4194304,318767104~8388608,331350016~8388608,373293056~8388608,398458880~8388608] 2024-01-13T18:49:23.146 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,46137344~20971520,79691776~8388608,121634816~12582912,176160768~12582912,197132288~8388608,268435456~12582912,285212672~12582912,301989888~4194304,318767104~25165824,373293056~12582912,398458880~12582912] 2024-01-13T18:49:23.146 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 9 diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~4194304,100663296~4194304,121634816~12582912,167772160~16777216,197132288~4194304,247463936~4194304,268435456~8388608,285212672~20971520,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608,398458880~8388608] 2024-01-13T18:49:23.146 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~4194304,100663296~4194304,121634816~12582912,167772160~16777216,197132288~4194304,247463936~4194304,268435456~8388608,285212672~20971520,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608,398458880~8388608] 2024-01-13T18:49:23.148 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,46137344~20971520,79691776~8388608,100663296~8388608,121634816~12582912,167772160~20971520,197132288~8388608,247463936~4194304,268435456~12582912,285212672~20971520,318767104~25165824,348127232~8388608,360710144~25165824,398458880~12582912] 2024-01-13T18:49:23.148 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 10 diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~8388608,100663296~4194304,117440512~16777216,159383552~4194304,167772160~16777216,197132288~4194304,222298112~8388608,247463936~4194304,268435456~8388608,285212672~20971520,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608,398458880~8388608] 2024-01-13T18:49:23.148 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,46137344~16777216,79691776~8388608,100663296~4194304,117440512~16777216,159383552~4194304,167772160~16777216,197132288~4194304,222298112~8388608,247463936~4194304,268435456~8388608,285212672~20971520,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608,398458880~8388608] 2024-01-13T18:49:23.151 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,46137344~20971520,79691776~12582912,100663296~8388608,117440512~16777216,159383552~4194304,167772160~20971520,197132288~8388608,222298112~12582912,247463936~4194304,268435456~12582912,285212672~20971520,318767104~25165824,348127232~37748736,398458880~12582912] 2024-01-13T18:49:23.151 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 11 diff [4194304~16777216,29360128~4194304,41943040~20971520,79691776~8388608,100663296~4194304,117440512~16777216,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~20971520,318767104~37748736,360710144~20971520,398458880~8388608] 2024-01-13T18:49:23.151 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,41943040~20971520,79691776~8388608,100663296~4194304,117440512~16777216,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~20971520,318767104~37748736,360710144~20971520,398458880~8388608] 2024-01-13T18:49:23.153 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,41943040~25165824,79691776~12582912,100663296~8388608,117440512~16777216,150994944~12582912,167772160~20971520,197132288~8388608,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,268435456~12582912,285212672~20971520,318767104~67108864,398458880~12582912] 2024-01-13T18:49:23.153 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 12 diff [4194304~16777216,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~12582912,117440512~25165824,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~25165824,318767104~62914560,398458880~8388608] 2024-01-13T18:49:23.153 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~12582912,117440512~25165824,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~25165824,318767104~62914560,398458880~8388608] 2024-01-13T18:49:23.156 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~33554432,79691776~12582912,96468992~12582912,117440512~29360128,150994944~12582912,167772160~20971520,197132288~8388608,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,268435456~12582912,285212672~25165824,318767104~67108864,398458880~12582912] 2024-01-13T18:49:23.156 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 13 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~62914560,398458880~8388608] 2024-01-13T18:49:23.156 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,268435456~8388608,285212672~29360128,318767104~62914560,398458880~8388608] 2024-01-13T18:49:23.160 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~33554432,79691776~12582912,96468992~50331648,150994944~12582912,167772160~20971520,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~8388608,268435456~12582912,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.160 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 14 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,398458880~8388608] 2024-01-13T18:49:23.160 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~16777216,285212672~29360128,318767104~62914560,398458880~8388608] 2024-01-13T18:49:23.163 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~33554432,79691776~12582912,96468992~50331648,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.163 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 15 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~25165824,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,398458880~8388608] 2024-01-13T18:49:23.164 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~25165824,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,398458880~8388608] 2024-01-13T18:49:23.167 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~50331648,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~104857600,398458880~12582912] 2024-01-13T18:49:23.167 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 16 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,398458880~8388608] 2024-01-13T18:49:23.168 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~100663296,398458880~8388608] 2024-01-13T18:49:23.172 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~50331648,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~104857600,398458880~12582912] 2024-01-13T18:49:23.173 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 17 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~37748736,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~83886080,373293056~12582912,390070272~4194304,398458880~8388608] 2024-01-13T18:49:23.173 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~37748736,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~83886080,373293056~12582912,390070272~4194304,398458880~8388608] 2024-01-13T18:49:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:22 smithi084 ceph-mon[116404]: osdmap e1500: 8 total, 8 up, 8 in 2024-01-13T18:49:23.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:22 smithi084 ceph-mon[119097]: osdmap e1500: 8 total, 8 up, 8 in 2024-01-13T18:49:23.177 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~50331648,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~25165824,285212672~109051904,398458880~12582912] 2024-01-13T18:49:23.177 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 18 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~113246208,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.177 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~113246208,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.182 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~20971520,222298112~20971520,247463936~4194304,255852544~138412032,398458880~16777216] 2024-01-13T18:49:23.182 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to 19 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.182 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.188 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:23.188 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 7 diff [4194304~16777216,50331648~4194304,58720256~4194304,121634816~8388608,176160768~8388608,285212672~8388608,331350016~4194304,373293056~4194304] 2024-01-13T18:49:23.188 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,50331648~4194304,58720256~4194304,121634816~8388608,176160768~8388608,285212672~8388608,331350016~4194304,373293056~4194304] 2024-01-13T18:49:23.188 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,50331648~16777216,121634816~12582912,176160768~12582912,285212672~12582912,331350016~4194304,373293056~8388608] 2024-01-13T18:49:23.189 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 8 diff [4194304~16777216,29360128~4194304,50331648~12582912,121634816~8388608,176160768~8388608,197132288~4194304,285212672~12582912,318767104~8388608,331350016~8388608,373293056~8388608] 2024-01-13T18:49:23.189 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,50331648~12582912,121634816~8388608,176160768~8388608,197132288~4194304,285212672~12582912,318767104~8388608,331350016~8388608,373293056~8388608] 2024-01-13T18:49:23.190 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,50331648~16777216,121634816~12582912,176160768~12582912,197132288~8388608,285212672~12582912,318767104~25165824,373293056~12582912] 2024-01-13T18:49:23.190 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 9 diff [4194304~16777216,29360128~4194304,50331648~12582912,100663296~4194304,121634816~12582912,167772160~16777216,197132288~4194304,247463936~4194304,285212672~16777216,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608] 2024-01-13T18:49:23.190 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,50331648~12582912,100663296~4194304,121634816~12582912,167772160~16777216,197132288~4194304,247463936~4194304,285212672~16777216,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608] 2024-01-13T18:49:23.192 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,50331648~16777216,100663296~8388608,121634816~12582912,167772160~20971520,197132288~8388608,247463936~4194304,285212672~16777216,318767104~25165824,348127232~8388608,360710144~25165824] 2024-01-13T18:49:23.192 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 10 diff [4194304~16777216,29360128~4194304,50331648~12582912,83886080~4194304,100663296~4194304,117440512~16777216,159383552~4194304,167772160~16777216,197132288~4194304,222298112~8388608,247463936~4194304,285212672~16777216,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608,406847488~4194304] 2024-01-13T18:49:23.192 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,50331648~12582912,83886080~4194304,100663296~4194304,117440512~16777216,159383552~4194304,167772160~16777216,197132288~4194304,222298112~8388608,247463936~4194304,285212672~16777216,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,373293056~8388608,406847488~4194304] 2024-01-13T18:49:23.194 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,50331648~16777216,83886080~8388608,100663296~8388608,117440512~16777216,159383552~4194304,167772160~20971520,197132288~8388608,222298112~12582912,247463936~4194304,285212672~16777216,318767104~25165824,348127232~37748736,406847488~4194304] 2024-01-13T18:49:23.194 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 11 diff [4194304~16777216,29360128~4194304,41943040~4194304,50331648~12582912,83886080~4194304,100663296~4194304,117440512~16777216,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~16777216,318767104~37748736,360710144~20971520,406847488~4194304] 2024-01-13T18:49:23.195 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~4194304,41943040~4194304,50331648~12582912,83886080~4194304,100663296~4194304,117440512~16777216,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~16777216,318767104~37748736,360710144~20971520,406847488~4194304] 2024-01-13T18:49:23.197 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~4194304,41943040~25165824,83886080~8388608,100663296~8388608,117440512~16777216,150994944~12582912,167772160~20971520,197132288~8388608,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,285212672~16777216,318767104~67108864,406847488~4194304] 2024-01-13T18:49:23.197 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 12 diff [4194304~16777216,29360128~8388608,41943040~4194304,50331648~12582912,67108864~8388608,83886080~8388608,96468992~12582912,117440512~25165824,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~25165824,318767104~62914560,402653184~8388608] 2024-01-13T18:49:23.197 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~16777216,29360128~8388608,41943040~4194304,50331648~12582912,67108864~8388608,83886080~8388608,96468992~12582912,117440512~25165824,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~25165824,318767104~62914560,402653184~8388608] 2024-01-13T18:49:23.200 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~33554432,83886080~8388608,96468992~12582912,117440512~29360128,150994944~12582912,167772160~20971520,197132288~8388608,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,285212672~25165824,318767104~67108864,402653184~8388608] 2024-01-13T18:49:23.200 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 13 diff [4194304~20971520,29360128~8388608,41943040~4194304,50331648~12582912,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,285212672~29360128,318767104~62914560,402653184~8388608] 2024-01-13T18:49:23.200 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~4194304,50331648~12582912,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,285212672~29360128,318767104~62914560,402653184~8388608] 2024-01-13T18:49:23.203 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~33554432,79691776~12582912,96468992~50331648,150994944~12582912,167772160~20971520,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~8388608,285212672~100663296,402653184~8388608] 2024-01-13T18:49:23.204 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 14 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~8388608,285212672~29360128,318767104~62914560,398458880~12582912] 2024-01-13T18:49:23.204 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~16777216,117440512~25165824,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~8388608,285212672~29360128,318767104~62914560,398458880~12582912] 2024-01-13T18:49:23.207 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~33554432,79691776~12582912,96468992~50331648,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.207 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 15 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~25165824,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.207 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~25165824,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.211 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~50331648,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~104857600,398458880~12582912] 2024-01-13T18:49:23.211 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 16 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.211 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.215 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~50331648,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~104857600,398458880~12582912] 2024-01-13T18:49:23.216 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 17 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~37748736,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~83886080,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.216 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~29360128,150994944~37748736,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~83886080,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.220 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~50331648,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~109051904,398458880~12582912] 2024-01-13T18:49:23.220 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 18 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,281018368~88080384,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.221 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,281018368~88080384,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.225 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~20971520,222298112~20971520,247463936~4194304,255852544~20971520,281018368~113246208,398458880~16777216] 2024-01-13T18:49:23.226 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to 19 diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.226 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.231 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:23.231 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 8 diff [29360128~4194304,54525952~8388608,176160768~4194304,197132288~4194304,285212672~12582912,318767104~8388608,335544320~4194304,377487360~4194304] 2024-01-13T18:49:23.231 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [29360128~4194304,54525952~8388608,176160768~4194304,197132288~4194304,285212672~12582912,318767104~8388608,335544320~4194304,377487360~4194304] 2024-01-13T18:49:23.232 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [29360128~4194304,54525952~12582912,176160768~4194304,197132288~8388608,285212672~12582912,318767104~12582912,335544320~8388608,377487360~8388608] 2024-01-13T18:49:23.232 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 9 diff [12582912~8388608,29360128~4194304,54525952~8388608,100663296~4194304,130023424~4194304,167772160~16777216,197132288~4194304,247463936~4194304,285212672~16777216,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,377487360~4194304] 2024-01-13T18:49:23.233 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~4194304,54525952~8388608,100663296~4194304,130023424~4194304,167772160~16777216,197132288~4194304,247463936~4194304,285212672~16777216,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,377487360~4194304] 2024-01-13T18:49:23.233 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~8388608,29360128~4194304,54525952~12582912,100663296~8388608,130023424~4194304,167772160~20971520,197132288~8388608,247463936~4194304,285212672~16777216,318767104~25165824,348127232~8388608,360710144~12582912,377487360~8388608] 2024-01-13T18:49:23.234 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 10 diff [12582912~8388608,29360128~4194304,54525952~8388608,83886080~4194304,100663296~4194304,117440512~8388608,130023424~4194304,159383552~4194304,167772160~16777216,197132288~4194304,222298112~8388608,247463936~4194304,285212672~16777216,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,377487360~4194304,406847488~4194304] 2024-01-13T18:49:23.234 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~4194304,54525952~8388608,83886080~4194304,100663296~4194304,117440512~8388608,130023424~4194304,159383552~4194304,167772160~16777216,197132288~4194304,222298112~8388608,247463936~4194304,285212672~16777216,318767104~8388608,331350016~12582912,348127232~8388608,360710144~8388608,377487360~4194304,406847488~4194304] 2024-01-13T18:49:23.235 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~8388608,29360128~4194304,54525952~12582912,83886080~8388608,100663296~8388608,117440512~8388608,130023424~4194304,159383552~4194304,167772160~20971520,197132288~8388608,222298112~12582912,247463936~4194304,285212672~16777216,318767104~25165824,348127232~25165824,377487360~8388608,406847488~4194304] 2024-01-13T18:49:23.235 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 11 diff [12582912~8388608,29360128~4194304,41943040~4194304,54525952~8388608,83886080~4194304,100663296~4194304,117440512~8388608,130023424~4194304,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~16777216,318767104~37748736,360710144~12582912,377487360~4194304,406847488~4194304] 2024-01-13T18:49:23.235 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~4194304,41943040~4194304,54525952~8388608,83886080~4194304,100663296~4194304,117440512~8388608,130023424~4194304,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~16777216,318767104~37748736,360710144~12582912,377487360~4194304,406847488~4194304] 2024-01-13T18:49:23.237 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~8388608,29360128~4194304,41943040~8388608,54525952~12582912,83886080~8388608,100663296~8388608,117440512~8388608,130023424~4194304,150994944~12582912,167772160~20971520,197132288~8388608,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,285212672~16777216,318767104~54525952,377487360~8388608,406847488~4194304] 2024-01-13T18:49:23.237 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 12 diff [12582912~8388608,29360128~8388608,41943040~4194304,54525952~8388608,67108864~8388608,83886080~8388608,96468992~12582912,117440512~8388608,130023424~12582912,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~25165824,318767104~54525952,377487360~4194304,402653184~8388608] 2024-01-13T18:49:23.238 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~8388608,41943040~4194304,54525952~8388608,67108864~8388608,83886080~8388608,96468992~12582912,117440512~8388608,130023424~12582912,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~25165824,318767104~54525952,377487360~4194304,402653184~8388608] 2024-01-13T18:49:23.239 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~8388608,29360128~8388608,41943040~8388608,54525952~20971520,83886080~8388608,96468992~12582912,117440512~8388608,130023424~16777216,150994944~12582912,167772160~20971520,197132288~8388608,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,285212672~25165824,318767104~54525952,377487360~8388608,402653184~8388608] 2024-01-13T18:49:23.239 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 13 diff [12582912~12582912,29360128~8388608,41943040~4194304,54525952~8388608,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,285212672~29360128,318767104~62914560,402653184~8388608] 2024-01-13T18:49:23.239 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~12582912,29360128~8388608,41943040~4194304,54525952~8388608,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~12582912,167772160~16777216,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,285212672~29360128,318767104~62914560,402653184~8388608] 2024-01-13T18:49:23.242 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~8388608,54525952~20971520,79691776~12582912,96468992~29360128,130023424~16777216,150994944~12582912,167772160~20971520,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~8388608,285212672~100663296,402653184~8388608] 2024-01-13T18:49:23.242 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 14 diff [12582912~12582912,29360128~8388608,41943040~8388608,54525952~8388608,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~8388608,285212672~29360128,318767104~62914560,398458880~12582912] 2024-01-13T18:49:23.242 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~12582912,29360128~8388608,41943040~8388608,54525952~8388608,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~8388608,285212672~29360128,318767104~62914560,398458880~12582912] 2024-01-13T18:49:23.245 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~33554432,79691776~12582912,96468992~29360128,130023424~16777216,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.245 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 15 diff [12582912~12582912,29360128~8388608,41943040~8388608,54525952~8388608,67108864~25165824,96468992~16777216,117440512~8388608,130023424~12582912,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.246 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~12582912,29360128~8388608,41943040~8388608,54525952~8388608,67108864~25165824,96468992~16777216,117440512~8388608,130023424~12582912,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.249 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~50331648,96468992~29360128,130023424~16777216,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~104857600,398458880~12582912] 2024-01-13T18:49:23.249 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 16 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~8388608,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.249 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~8388608,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~4194304,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~100663296,398458880~12582912] 2024-01-13T18:49:23.253 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~50331648,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~104857600,398458880~12582912] 2024-01-13T18:49:23.253 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 17 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~29360128,150994944~41943040,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~83886080,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.253 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~29360128,150994944~41943040,197132288~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~83886080,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.257 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~50331648,150994944~41943040,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~109051904,398458880~12582912] 2024-01-13T18:49:23.257 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 18 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,281018368~88080384,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.257 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,281018368~88080384,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.262 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~20971520,222298112~20971520,247463936~4194304,255852544~20971520,281018368~113246208,398458880~16777216] 2024-01-13T18:49:23.262 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to 19 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.262 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.267 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:23.267 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 9 diff [12582912~8388608,100663296~4194304,130023424~4194304,167772160~8388608,180355072~4194304,247463936~4194304,293601280~8388608,331350016~8388608,348127232~8388608,360710144~8388608] 2024-01-13T18:49:23.267 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,100663296~4194304,130023424~4194304,167772160~8388608,180355072~4194304,247463936~4194304,293601280~8388608,331350016~8388608,348127232~8388608,360710144~8388608] 2024-01-13T18:49:23.268 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~8388608,100663296~8388608,130023424~4194304,167772160~20971520,247463936~4194304,293601280~8388608,331350016~12582912,348127232~8388608,360710144~12582912] 2024-01-13T18:49:23.268 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 10 diff [12582912~8388608,54525952~4194304,83886080~4194304,100663296~4194304,117440512~8388608,130023424~4194304,159383552~4194304,167772160~8388608,180355072~4194304,222298112~8388608,247463936~4194304,285212672~16777216,331350016~8388608,348127232~8388608,360710144~8388608,406847488~4194304] 2024-01-13T18:49:23.268 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,54525952~4194304,83886080~4194304,100663296~4194304,117440512~8388608,130023424~4194304,159383552~4194304,167772160~8388608,180355072~4194304,222298112~8388608,247463936~4194304,285212672~16777216,331350016~8388608,348127232~8388608,360710144~8388608,406847488~4194304] 2024-01-13T18:49:23.269 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~8388608,54525952~8388608,83886080~8388608,100663296~8388608,117440512~8388608,130023424~4194304,159383552~4194304,167772160~20971520,222298112~12582912,247463936~4194304,285212672~16777216,331350016~12582912,348127232~25165824,406847488~4194304] 2024-01-13T18:49:23.269 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 11 diff [12582912~8388608,41943040~4194304,54525952~4194304,83886080~4194304,100663296~4194304,117440512~8388608,130023424~4194304,150994944~12582912,167772160~8388608,180355072~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~16777216,318767104~4194304,331350016~8388608,343932928~12582912,360710144~12582912,406847488~4194304] 2024-01-13T18:49:23.269 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,41943040~4194304,54525952~4194304,83886080~4194304,100663296~4194304,117440512~8388608,130023424~4194304,150994944~12582912,167772160~8388608,180355072~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~16777216,318767104~4194304,331350016~8388608,343932928~12582912,360710144~12582912,406847488~4194304] 2024-01-13T18:49:23.271 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~8388608,41943040~8388608,54525952~8388608,83886080~8388608,100663296~8388608,117440512~8388608,130023424~4194304,150994944~12582912,167772160~20971520,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,285212672~16777216,318767104~4194304,331350016~41943040,406847488~4194304] 2024-01-13T18:49:23.271 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 12 diff [12582912~8388608,29360128~8388608,41943040~4194304,54525952~4194304,67108864~8388608,83886080~8388608,96468992~12582912,117440512~8388608,130023424~12582912,150994944~12582912,167772160~8388608,180355072~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~25165824,318767104~4194304,331350016~8388608,343932928~29360128,402653184~8388608] 2024-01-13T18:49:23.271 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~8388608,41943040~4194304,54525952~4194304,67108864~8388608,83886080~8388608,96468992~12582912,117440512~8388608,130023424~12582912,150994944~12582912,167772160~8388608,180355072~4194304,209715200~8388608,222298112~8388608,239075328~4194304,247463936~4194304,255852544~4194304,285212672~25165824,318767104~4194304,331350016~8388608,343932928~29360128,402653184~8388608] 2024-01-13T18:49:23.273 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~8388608,29360128~8388608,41943040~8388608,54525952~8388608,67108864~8388608,83886080~8388608,96468992~12582912,117440512~8388608,130023424~16777216,150994944~12582912,167772160~20971520,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~8388608,285212672~25165824,318767104~4194304,331350016~41943040,402653184~8388608] 2024-01-13T18:49:23.273 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 13 diff [12582912~12582912,29360128~8388608,41943040~4194304,54525952~4194304,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~12582912,167772160~8388608,180355072~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,285212672~29360128,318767104~4194304,331350016~8388608,343932928~33554432,402653184~8388608] 2024-01-13T18:49:23.273 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~12582912,29360128~8388608,41943040~4194304,54525952~4194304,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~12582912,167772160~8388608,180355072~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,285212672~29360128,318767104~4194304,331350016~8388608,343932928~33554432,402653184~8388608] 2024-01-13T18:49:23.276 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~8388608,54525952~8388608,67108864~8388608,79691776~12582912,96468992~29360128,130023424~16777216,150994944~12582912,167772160~20971520,209715200~8388608,222298112~20971520,247463936~4194304,255852544~8388608,285212672~37748736,331350016~46137344,402653184~8388608] 2024-01-13T18:49:23.276 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 14 diff [12582912~12582912,29360128~8388608,41943040~8388608,54525952~4194304,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~33554432,188743680~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~8388608,285212672~29360128,318767104~4194304,331350016~8388608,343932928~33554432,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.276 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~12582912,29360128~8388608,41943040~8388608,54525952~4194304,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~33554432,188743680~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~8388608,285212672~29360128,318767104~4194304,331350016~8388608,343932928~33554432,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.279 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~29360128,130023424~16777216,150994944~41943040,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~37748736,331350016~46137344,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.279 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 15 diff [12582912~12582912,29360128~8388608,41943040~8388608,54525952~4194304,67108864~25165824,96468992~16777216,117440512~8388608,130023424~12582912,150994944~33554432,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~37748736,331350016~8388608,343932928~33554432,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.279 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~12582912,29360128~8388608,41943040~8388608,54525952~4194304,67108864~25165824,96468992~16777216,117440512~8388608,130023424~12582912,150994944~33554432,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~37748736,331350016~8388608,343932928~33554432,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.282 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~20971520,67108864~25165824,96468992~29360128,130023424~16777216,150994944~41943040,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~37748736,331350016~46137344,381681664~8388608,398458880~12582912] 2024-01-13T18:49:23.282 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 16 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~8388608,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~37748736,331350016~8388608,343932928~33554432,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.282 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~8388608,67108864~25165824,96468992~16777216,117440512~29360128,150994944~33554432,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~37748736,331350016~8388608,343932928~33554432,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.285 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~50331648,150994944~41943040,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~37748736,331350016~46137344,381681664~8388608,398458880~12582912] 2024-01-13T18:49:23.285 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 17 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~29360128,150994944~41943040,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~37748736,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.285 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~29360128,150994944~41943040,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~37748736,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.289 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~50331648,150994944~41943040,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~37748736,331350016~46137344,381681664~12582912,398458880~12582912] 2024-01-13T18:49:23.290 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 18 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~16777216,222298112~20971520,247463936~4194304,255852544~16777216,281018368~41943040,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.290 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~16777216,222298112~20971520,247463936~4194304,255852544~16777216,281018368~41943040,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.293 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~16777216,222298112~20971520,247463936~4194304,255852544~20971520,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.294 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to 19 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.294 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.298 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~41943040,247463936~29360128,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.298 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 10 diff [54525952~4194304,83886080~4194304,117440512~8388608,159383552~4194304,222298112~8388608,285212672~12582912,331350016~8388608,352321536~4194304,406847488~4194304] 2024-01-13T18:49:23.298 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [54525952~4194304,83886080~4194304,117440512~8388608,159383552~4194304,222298112~8388608,285212672~12582912,331350016~8388608,352321536~4194304,406847488~4194304] 2024-01-13T18:49:23.299 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [54525952~8388608,83886080~8388608,117440512~8388608,159383552~4194304,222298112~12582912,285212672~12582912,331350016~8388608,352321536~8388608,406847488~4194304] 2024-01-13T18:49:23.299 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 11 diff [12582912~4194304,41943040~4194304,54525952~4194304,83886080~4194304,117440512~8388608,150994944~12582912,209715200~8388608,222298112~8388608,239075328~4194304,255852544~4194304,285212672~12582912,318767104~4194304,331350016~8388608,343932928~12582912,360710144~8388608,406847488~4194304] 2024-01-13T18:49:23.299 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~4194304,41943040~4194304,54525952~4194304,83886080~4194304,117440512~8388608,150994944~12582912,209715200~8388608,222298112~8388608,239075328~4194304,255852544~4194304,285212672~12582912,318767104~4194304,331350016~8388608,343932928~12582912,360710144~8388608,406847488~4194304] 2024-01-13T18:49:23.300 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~4194304,41943040~8388608,54525952~8388608,83886080~8388608,117440512~8388608,150994944~12582912,209715200~8388608,222298112~12582912,239075328~4194304,255852544~8388608,285212672~12582912,318767104~4194304,331350016~8388608,343932928~29360128,406847488~4194304] 2024-01-13T18:49:23.300 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 12 diff [12582912~4194304,29360128~8388608,41943040~4194304,54525952~4194304,67108864~8388608,83886080~8388608,96468992~12582912,117440512~8388608,134217728~8388608,150994944~12582912,209715200~8388608,222298112~8388608,239075328~4194304,255852544~4194304,285212672~12582912,301989888~8388608,318767104~4194304,331350016~8388608,343932928~25165824,402653184~8388608] 2024-01-13T18:49:23.300 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~4194304,29360128~8388608,41943040~4194304,54525952~4194304,67108864~8388608,83886080~8388608,96468992~12582912,117440512~8388608,134217728~8388608,150994944~12582912,209715200~8388608,222298112~8388608,239075328~4194304,255852544~4194304,285212672~12582912,301989888~8388608,318767104~4194304,331350016~8388608,343932928~25165824,402653184~8388608] 2024-01-13T18:49:23.302 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~4194304,29360128~8388608,41943040~8388608,54525952~8388608,67108864~8388608,83886080~8388608,96468992~12582912,117440512~8388608,134217728~12582912,150994944~12582912,209715200~8388608,222298112~12582912,239075328~4194304,255852544~8388608,285212672~12582912,301989888~8388608,318767104~4194304,331350016~8388608,343932928~29360128,402653184~8388608] 2024-01-13T18:49:23.302 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 13 diff [12582912~8388608,29360128~8388608,41943040~4194304,54525952~4194304,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~12582912,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,285212672~12582912,301989888~12582912,318767104~4194304,331350016~8388608,343932928~25165824,373293056~4194304,402653184~8388608] 2024-01-13T18:49:23.302 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~8388608,41943040~4194304,54525952~4194304,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~12582912,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,285212672~12582912,301989888~12582912,318767104~4194304,331350016~8388608,343932928~25165824,373293056~4194304,402653184~8388608] 2024-01-13T18:49:23.304 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~8388608,54525952~8388608,67108864~8388608,79691776~12582912,96468992~29360128,130023424~16777216,150994944~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~8388608,285212672~12582912,301989888~20971520,331350016~8388608,343932928~33554432,402653184~8388608] 2024-01-13T18:49:23.304 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 14 diff [12582912~8388608,29360128~8388608,41943040~8388608,54525952~4194304,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~20971520,188743680~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~8388608,285212672~12582912,301989888~12582912,318767104~4194304,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.304 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~8388608,41943040~8388608,54525952~4194304,67108864~8388608,79691776~12582912,96468992~16777216,117440512~8388608,130023424~12582912,150994944~20971520,188743680~4194304,209715200~8388608,222298112~12582912,239075328~4194304,247463936~4194304,255852544~4194304,264241152~8388608,285212672~12582912,301989888~12582912,318767104~4194304,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.307 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~20971520,67108864~8388608,79691776~12582912,96468992~29360128,130023424~16777216,150994944~25165824,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~12582912,301989888~20971520,331350016~8388608,343932928~33554432,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.307 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 15 diff [12582912~12582912,29360128~8388608,41943040~8388608,54525952~4194304,67108864~25165824,96468992~16777216,117440512~8388608,130023424~12582912,150994944~20971520,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~12582912,301989888~20971520,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.307 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~12582912,29360128~8388608,41943040~8388608,54525952~4194304,67108864~25165824,96468992~16777216,117440512~8388608,130023424~12582912,150994944~20971520,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~12582912,301989888~20971520,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.310 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~20971520,67108864~25165824,96468992~29360128,130023424~16777216,150994944~25165824,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~12582912,301989888~20971520,331350016~8388608,343932928~33554432,381681664~8388608,398458880~12582912] 2024-01-13T18:49:23.310 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 16 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~8388608,67108864~25165824,96468992~16777216,117440512~29360128,150994944~20971520,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~37748736,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.310 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~8388608,67108864~25165824,96468992~16777216,117440512~29360128,150994944~20971520,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~37748736,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.316 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~50331648,150994944~25165824,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~37748736,331350016~8388608,343932928~33554432,381681664~8388608,398458880~12582912] 2024-01-13T18:49:23.316 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 17 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~29360128,150994944~20971520,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~37748736,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.316 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~29360128,150994944~20971520,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,285212672~37748736,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.317 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~50331648,150994944~25165824,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,285212672~37748736,331350016~8388608,343932928~33554432,381681664~12582912,398458880~12582912] 2024-01-13T18:49:23.317 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 18 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~16777216,281018368~41943040,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.317 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~16777216,281018368~41943040,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.320 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~79691776,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~20971520,281018368~46137344,331350016~8388608,343932928~33554432,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.320 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to 19 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.321 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.325 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~79691776,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,331350016~8388608,343932928~33554432,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.325 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 11 diff [12582912~4194304,41943040~4194304,150994944~8388608,209715200~8388608,239075328~4194304,255852544~4194304,318767104~4194304,343932928~8388608,360710144~8388608] 2024-01-13T18:49:23.325 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~4194304,41943040~4194304,150994944~8388608,209715200~8388608,239075328~4194304,255852544~4194304,318767104~4194304,343932928~8388608,360710144~8388608] 2024-01-13T18:49:23.326 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~4194304,41943040~8388608,150994944~8388608,209715200~8388608,239075328~4194304,255852544~8388608,318767104~4194304,343932928~8388608,360710144~12582912] 2024-01-13T18:49:23.326 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 12 diff [12582912~4194304,29360128~8388608,41943040~4194304,67108864~8388608,83886080~8388608,96468992~12582912,134217728~8388608,150994944~8388608,209715200~8388608,239075328~4194304,255852544~4194304,301989888~8388608,318767104~4194304,343932928~8388608,356515840~12582912,402653184~4194304] 2024-01-13T18:49:23.326 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~4194304,29360128~8388608,41943040~4194304,67108864~8388608,83886080~8388608,96468992~12582912,134217728~8388608,150994944~8388608,209715200~8388608,239075328~4194304,255852544~4194304,301989888~8388608,318767104~4194304,343932928~8388608,356515840~12582912,402653184~4194304] 2024-01-13T18:49:23.327 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~4194304,29360128~8388608,41943040~8388608,67108864~8388608,83886080~8388608,96468992~12582912,134217728~12582912,150994944~8388608,209715200~8388608,239075328~4194304,255852544~8388608,301989888~8388608,318767104~4194304,343932928~8388608,356515840~16777216,402653184~4194304] 2024-01-13T18:49:23.328 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 13 diff [12582912~8388608,29360128~8388608,41943040~4194304,67108864~8388608,79691776~12582912,96468992~16777216,130023424~12582912,150994944~8388608,209715200~8388608,226492416~8388608,239075328~4194304,247463936~4194304,255852544~4194304,301989888~12582912,318767104~4194304,343932928~8388608,356515840~12582912,373293056~4194304,402653184~4194304] 2024-01-13T18:49:23.328 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~8388608,41943040~4194304,67108864~8388608,79691776~12582912,96468992~16777216,130023424~12582912,150994944~8388608,209715200~8388608,226492416~8388608,239075328~4194304,247463936~4194304,255852544~4194304,301989888~12582912,318767104~4194304,343932928~8388608,356515840~12582912,373293056~4194304,402653184~4194304] 2024-01-13T18:49:23.330 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~8388608,67108864~8388608,79691776~12582912,96468992~20971520,130023424~16777216,150994944~8388608,209715200~8388608,226492416~16777216,247463936~4194304,255852544~8388608,301989888~20971520,343932928~8388608,356515840~20971520,402653184~4194304] 2024-01-13T18:49:23.330 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 14 diff [12582912~8388608,29360128~8388608,41943040~8388608,67108864~8388608,79691776~12582912,96468992~16777216,130023424~12582912,150994944~8388608,163577856~8388608,188743680~4194304,209715200~8388608,226492416~8388608,239075328~4194304,247463936~4194304,255852544~4194304,264241152~8388608,301989888~12582912,318767104~4194304,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.330 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~8388608,41943040~8388608,67108864~8388608,79691776~12582912,96468992~16777216,130023424~12582912,150994944~8388608,163577856~8388608,188743680~4194304,209715200~8388608,226492416~8388608,239075328~4194304,247463936~4194304,255852544~4194304,264241152~8388608,301989888~12582912,318767104~4194304,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.332 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~12582912,67108864~8388608,79691776~12582912,96468992~20971520,130023424~16777216,150994944~8388608,163577856~12582912,188743680~4194304,209715200~8388608,226492416~16777216,247463936~4194304,255852544~20971520,301989888~20971520,343932928~8388608,356515840~20971520,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.332 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 15 diff [12582912~12582912,29360128~8388608,41943040~8388608,67108864~25165824,96468992~16777216,130023424~12582912,150994944~8388608,163577856~8388608,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,301989888~20971520,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.332 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~12582912,29360128~8388608,41943040~8388608,67108864~25165824,96468992~16777216,130023424~12582912,150994944~8388608,163577856~8388608,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,301989888~20971520,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.335 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,41943040~12582912,67108864~25165824,96468992~20971520,130023424~16777216,150994944~8388608,163577856~12582912,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,301989888~20971520,343932928~8388608,356515840~20971520,381681664~8388608,398458880~12582912] 2024-01-13T18:49:23.335 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 16 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~8388608,67108864~25165824,96468992~16777216,121634816~25165824,150994944~20971520,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~29360128,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.335 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~8388608,67108864~25165824,96468992~16777216,121634816~25165824,150994944~20971520,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~29360128,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.337 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~25165824,150994944~25165824,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,293601280~29360128,343932928~8388608,356515840~20971520,381681664~8388608,398458880~12582912] 2024-01-13T18:49:23.337 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 17 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~25165824,150994944~20971520,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~29360128,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.337 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~25165824,150994944~20971520,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~29360128,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.341 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~25165824,150994944~25165824,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,293601280~29360128,343932928~8388608,356515840~20971520,381681664~12582912,398458880~12582912] 2024-01-13T18:49:23.341 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 18 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~16777216,281018368~4194304,293601280~29360128,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.341 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~16777216,281018368~4194304,293601280~29360128,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.345 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~54525952,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~20971520,281018368~8388608,293601280~33554432,343932928~8388608,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.345 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to 19 diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.345 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.349 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~54525952,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,343932928~8388608,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.349 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 12 diff [29360128~8388608,67108864~8388608,83886080~8388608,96468992~12582912,134217728~8388608,301989888~8388608,356515840~4194304,402653184~4194304] 2024-01-13T18:49:23.349 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [29360128~8388608,67108864~8388608,83886080~8388608,96468992~12582912,134217728~8388608,301989888~8388608,356515840~4194304,402653184~4194304] 2024-01-13T18:49:23.350 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [29360128~8388608,67108864~8388608,83886080~8388608,96468992~12582912,134217728~12582912,301989888~8388608,356515840~4194304,402653184~4194304] 2024-01-13T18:49:23.350 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 13 diff [12582912~8388608,29360128~8388608,67108864~8388608,79691776~12582912,96468992~16777216,130023424~12582912,226492416~8388608,247463936~4194304,301989888~12582912,356515840~4194304,373293056~4194304,402653184~4194304] 2024-01-13T18:49:23.350 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~8388608,67108864~8388608,79691776~12582912,96468992~16777216,130023424~12582912,226492416~8388608,247463936~4194304,301989888~12582912,356515840~4194304,373293056~4194304,402653184~4194304] 2024-01-13T18:49:23.352 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,67108864~8388608,79691776~12582912,96468992~20971520,130023424~16777216,226492416~12582912,247463936~4194304,301989888~16777216,356515840~4194304,373293056~4194304,402653184~4194304] 2024-01-13T18:49:23.352 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 14 diff [12582912~8388608,29360128~8388608,46137344~8388608,67108864~8388608,79691776~12582912,96468992~16777216,130023424~12582912,163577856~8388608,188743680~4194304,226492416~8388608,247463936~4194304,264241152~8388608,301989888~12582912,356515840~4194304,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.352 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~8388608,46137344~8388608,67108864~8388608,79691776~12582912,96468992~16777216,130023424~12582912,163577856~8388608,188743680~4194304,226492416~8388608,247463936~4194304,264241152~8388608,301989888~12582912,356515840~4194304,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.353 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,46137344~8388608,67108864~8388608,79691776~12582912,96468992~20971520,130023424~16777216,163577856~12582912,188743680~4194304,226492416~12582912,247463936~4194304,264241152~12582912,301989888~16777216,356515840~4194304,373293056~4194304,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.353 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 15 diff [12582912~12582912,29360128~8388608,46137344~8388608,67108864~25165824,96468992~16777216,130023424~12582912,163577856~8388608,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,301989888~16777216,356515840~4194304,369098752~8388608,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.353 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~12582912,29360128~8388608,46137344~8388608,67108864~25165824,96468992~16777216,130023424~12582912,163577856~8388608,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,301989888~16777216,356515840~4194304,369098752~8388608,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.355 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,46137344~8388608,67108864~25165824,96468992~20971520,130023424~16777216,163577856~12582912,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,301989888~16777216,356515840~4194304,369098752~8388608,381681664~8388608,398458880~12582912] 2024-01-13T18:49:23.355 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 16 diff [8388608~16777216,29360128~8388608,46137344~16777216,67108864~25165824,96468992~16777216,121634816~25165824,159383552~12582912,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~25165824,356515840~4194304,369098752~8388608,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.355 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,46137344~16777216,67108864~25165824,96468992~16777216,121634816~25165824,159383552~12582912,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~25165824,356515840~4194304,369098752~8388608,381681664~4194304,398458880~12582912] 2024-01-13T18:49:23.358 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~46137344,96468992~20971520,121634816~25165824,159383552~16777216,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,293601280~25165824,356515840~4194304,369098752~8388608,381681664~8388608,398458880~12582912] 2024-01-13T18:49:23.358 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 17 diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~25165824,159383552~12582912,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~25165824,356515840~4194304,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.358 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~25165824,159383552~12582912,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~25165824,356515840~4194304,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.361 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~46137344,96468992~20971520,121634816~25165824,159383552~16777216,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,293601280~25165824,356515840~8388608,369098752~8388608,381681664~12582912,398458880~12582912] 2024-01-13T18:49:23.362 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 18 diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~16777216,281018368~4194304,293601280~29360128,356515840~4194304,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.362 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~16777216,281018368~4194304,293601280~29360128,356515840~4194304,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.364 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~46137344,96468992~20971520,121634816~33554432,159383552~16777216,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~20971520,281018368~8388608,293601280~33554432,356515840~8388608,369098752~8388608,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.364 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to 19 diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.364 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.367 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~46137344,96468992~20971520,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.368 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 13 diff [12582912~8388608,29360128~4194304,79691776~4194304,109051904~4194304,130023424~4194304,226492416~8388608,247463936~4194304,310378496~4194304,373293056~4194304] 2024-01-13T18:49:23.368 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~4194304,79691776~4194304,109051904~4194304,130023424~4194304,226492416~8388608,247463936~4194304,310378496~4194304,373293056~4194304] 2024-01-13T18:49:23.369 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,79691776~8388608,109051904~8388608,130023424~8388608,226492416~12582912,247463936~4194304,310378496~8388608,373293056~4194304] 2024-01-13T18:49:23.369 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 14 diff [12582912~8388608,29360128~4194304,46137344~8388608,79691776~4194304,109051904~4194304,130023424~8388608,163577856~8388608,188743680~4194304,226492416~8388608,247463936~4194304,264241152~8388608,310378496~4194304,373293056~4194304,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.369 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~4194304,46137344~8388608,79691776~4194304,109051904~4194304,130023424~8388608,163577856~8388608,188743680~4194304,226492416~8388608,247463936~4194304,264241152~8388608,310378496~4194304,373293056~4194304,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.370 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,46137344~8388608,79691776~8388608,109051904~8388608,130023424~12582912,163577856~12582912,188743680~4194304,226492416~12582912,247463936~4194304,264241152~12582912,310378496~8388608,373293056~4194304,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.370 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 15 diff [12582912~12582912,29360128~4194304,46137344~8388608,75497472~8388608,109051904~4194304,130023424~8388608,163577856~8388608,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,310378496~8388608,369098752~8388608,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.370 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~12582912,29360128~4194304,46137344~8388608,75497472~8388608,109051904~4194304,130023424~8388608,163577856~8388608,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,310378496~8388608,369098752~8388608,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.372 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~8388608,46137344~8388608,75497472~12582912,109051904~8388608,130023424~12582912,163577856~12582912,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,310378496~8388608,369098752~8388608,381681664~8388608,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.372 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 16 diff [8388608~16777216,29360128~4194304,46137344~16777216,75497472~8388608,96468992~4194304,109051904~4194304,121634816~25165824,159383552~12582912,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~8388608,310378496~8388608,369098752~8388608,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.372 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~4194304,46137344~16777216,75497472~8388608,96468992~4194304,109051904~4194304,121634816~25165824,159383552~12582912,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~8388608,310378496~8388608,369098752~8388608,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.374 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~20971520,75497472~12582912,96468992~4194304,109051904~8388608,121634816~25165824,159383552~16777216,188743680~4194304,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,293601280~12582912,310378496~8388608,369098752~8388608,381681664~8388608,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.374 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 17 diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~25165824,159383552~12582912,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~12582912,310378496~8388608,356515840~4194304,369098752~8388608,381681664~4194304,390070272~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.374 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~25165824,159383552~12582912,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~16777216,293601280~12582912,310378496~8388608,356515840~4194304,369098752~8388608,381681664~4194304,390070272~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.377 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~20971520,75497472~12582912,96468992~4194304,109051904~8388608,121634816~25165824,159383552~16777216,180355072~12582912,209715200~8388608,222298112~20971520,247463936~4194304,255852544~20971520,293601280~25165824,356515840~8388608,369098752~8388608,381681664~12582912,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.377 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 18 diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~16777216,281018368~4194304,293601280~12582912,310378496~12582912,356515840~4194304,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.377 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~16777216,281018368~4194304,293601280~12582912,310378496~12582912,356515840~4194304,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.379 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~20971520,75497472~12582912,96468992~4194304,109051904~8388608,121634816~33554432,159383552~16777216,180355072~12582912,201326592~16777216,222298112~20971520,247463936~4194304,255852544~20971520,281018368~8388608,293601280~33554432,356515840~8388608,369098752~8388608,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.380 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to 19 diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.380 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.382 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~20971520,75497472~12582912,96468992~4194304,109051904~8388608,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.383 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 14 diff [29360128~4194304,46137344~8388608,134217728~4194304,163577856~8388608,188743680~4194304,230686720~4194304,264241152~8388608,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.383 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [29360128~4194304,46137344~8388608,134217728~4194304,163577856~8388608,188743680~4194304,230686720~4194304,264241152~8388608,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.384 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [29360128~4194304,46137344~8388608,134217728~8388608,163577856~12582912,188743680~4194304,230686720~8388608,264241152~12582912,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.384 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 15 diff [12582912~8388608,29360128~4194304,46137344~8388608,75497472~8388608,134217728~4194304,163577856~8388608,188743680~4194304,209715200~8388608,222298112~16777216,255852544~16777216,314572800~4194304,369098752~4194304,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.384 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,29360128~4194304,46137344~8388608,75497472~8388608,134217728~4194304,163577856~8388608,188743680~4194304,209715200~8388608,222298112~16777216,255852544~16777216,314572800~4194304,369098752~4194304,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.385 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,29360128~4194304,46137344~8388608,75497472~8388608,134217728~8388608,163577856~12582912,188743680~4194304,209715200~8388608,222298112~20971520,255852544~20971520,314572800~4194304,369098752~4194304,381681664~8388608,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.385 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 16 diff [8388608~12582912,29360128~4194304,46137344~16777216,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~12582912,159383552~12582912,188743680~4194304,209715200~8388608,222298112~16777216,255852544~16777216,293601280~8388608,314572800~4194304,369098752~4194304,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.385 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~16777216,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~12582912,159383552~12582912,188743680~4194304,209715200~8388608,222298112~16777216,255852544~16777216,293601280~8388608,314572800~4194304,369098752~4194304,381681664~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.387 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~25165824,159383552~16777216,188743680~4194304,209715200~8388608,222298112~20971520,255852544~20971520,293601280~12582912,314572800~4194304,369098752~4194304,381681664~8388608,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.387 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 17 diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~12582912,159383552~12582912,180355072~12582912,209715200~8388608,222298112~16777216,255852544~16777216,293601280~12582912,314572800~4194304,356515840~4194304,369098752~4194304,381681664~4194304,390070272~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.387 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~12582912,159383552~12582912,180355072~12582912,209715200~8388608,222298112~16777216,255852544~16777216,293601280~12582912,314572800~4194304,356515840~4194304,369098752~4194304,381681664~4194304,390070272~4194304,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.389 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~25165824,159383552~16777216,180355072~12582912,209715200~8388608,222298112~20971520,255852544~20971520,293601280~16777216,314572800~4194304,356515840~8388608,369098752~4194304,381681664~12582912,398458880~4194304,406847488~4194304] 2024-01-13T18:49:23.389 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 18 diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~16777216,222298112~16777216,255852544~16777216,281018368~4194304,293601280~12582912,314572800~8388608,356515840~4194304,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.389 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~16777216,222298112~16777216,255852544~16777216,281018368~4194304,293601280~12582912,314572800~8388608,356515840~4194304,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.391 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~33554432,159383552~16777216,180355072~12582912,201326592~16777216,222298112~20971520,255852544~20971520,281018368~8388608,293601280~16777216,314572800~12582912,356515840~8388608,369098752~4194304,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.391 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to 19 diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.391 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.394 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,251658240~25165824,281018368~29360128,314572800~12582912,356515840~16777216,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.394 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to 15 diff [12582912~8388608,75497472~8388608,209715200~8388608,222298112~8388608,234881024~8388608,255852544~12582912,314572800~4194304,369098752~4194304,381681664~4194304] 2024-01-13T18:49:23.394 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~8388608,75497472~8388608,209715200~8388608,222298112~8388608,234881024~8388608,255852544~12582912,314572800~4194304,369098752~4194304,381681664~4194304] 2024-01-13T18:49:23.395 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~12582912,75497472~8388608,209715200~8388608,222298112~8388608,234881024~8388608,255852544~16777216,314572800~4194304,369098752~4194304,381681664~8388608] 2024-01-13T18:49:23.395 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to 16 diff [8388608~12582912,54525952~8388608,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~8388608,159383552~8388608,209715200~8388608,222298112~8388608,234881024~8388608,255852544~16777216,293601280~8388608,314572800~4194304,369098752~4194304,381681664~4194304] 2024-01-13T18:49:23.395 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,54525952~8388608,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~8388608,159383552~8388608,209715200~8388608,222298112~8388608,234881024~8388608,255852544~16777216,293601280~8388608,314572800~4194304,369098752~4194304,381681664~4194304] 2024-01-13T18:49:23.396 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,54525952~12582912,75497472~8388608,96468992~4194304,109051904~4194304,121634816~25165824,159383552~8388608,209715200~8388608,222298112~8388608,234881024~8388608,255852544~16777216,293601280~12582912,314572800~4194304,369098752~4194304,381681664~8388608] 2024-01-13T18:49:23.396 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to 17 diff [8388608~12582912,46137344~4194304,54525952~12582912,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~12582912,159383552~12582912,180355072~12582912,209715200~8388608,222298112~8388608,234881024~8388608,255852544~16777216,293601280~12582912,314572800~4194304,356515840~4194304,369098752~4194304,381681664~4194304,390070272~4194304] 2024-01-13T18:49:23.396 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,46137344~4194304,54525952~12582912,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~12582912,159383552~12582912,180355072~12582912,209715200~8388608,222298112~8388608,234881024~8388608,255852544~16777216,293601280~12582912,314572800~4194304,356515840~4194304,369098752~4194304,381681664~4194304,390070272~4194304] 2024-01-13T18:49:23.398 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~25165824,159383552~12582912,180355072~12582912,209715200~8388608,222298112~8388608,234881024~8388608,255852544~16777216,293601280~16777216,314572800~4194304,356515840~8388608,369098752~4194304,381681664~12582912] 2024-01-13T18:49:23.398 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to 18 diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~16777216,222298112~8388608,234881024~8388608,255852544~16777216,281018368~4194304,293601280~12582912,314572800~8388608,356515840~4194304,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.398 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~16777216,222298112~8388608,234881024~8388608,255852544~16777216,281018368~4194304,293601280~12582912,314572800~8388608,356515840~4194304,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.400 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~8388608,96468992~4194304,109051904~4194304,121634816~33554432,159383552~12582912,180355072~12582912,201326592~16777216,222298112~8388608,234881024~8388608,255852544~16777216,281018368~8388608,293601280~16777216,314572800~12582912,356515840~8388608,369098752~4194304,381681664~12582912,402653184~12582912] 2024-01-13T18:49:23.400 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to 19 diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.400 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.402 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~33554432,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~29360128,314572800~12582912,356515840~16777216,381681664~12582912,402653184~12582912] 2024-01-13T18:49:23.402 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to 16 diff [8388608~4194304,54525952~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~8388608,159383552~8388608,260046848~8388608,293601280~8388608] 2024-01-13T18:49:23.402 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~4194304,54525952~8388608,96468992~4194304,109051904~4194304,121634816~8388608,134217728~8388608,159383552~8388608,260046848~8388608,293601280~8388608] 2024-01-13T18:49:23.403 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~8388608,54525952~12582912,96468992~4194304,109051904~4194304,121634816~25165824,159383552~8388608,260046848~12582912,293601280~12582912] 2024-01-13T18:49:23.403 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to 17 diff [8388608~4194304,46137344~4194304,54525952~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~12582912,159383552~12582912,180355072~12582912,260046848~12582912,293601280~12582912,356515840~4194304,390070272~4194304] 2024-01-13T18:49:23.403 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~4194304,46137344~4194304,54525952~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~12582912,159383552~12582912,180355072~12582912,260046848~12582912,293601280~12582912,356515840~4194304,390070272~4194304] 2024-01-13T18:49:23.404 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~8388608,46137344~20971520,96468992~4194304,109051904~4194304,121634816~25165824,159383552~12582912,180355072~12582912,260046848~12582912,293601280~16777216,356515840~8388608,390070272~4194304] 2024-01-13T18:49:23.405 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to 18 diff [8388608~8388608,29360128~4194304,46137344~20971520,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~8388608,260046848~12582912,281018368~4194304,293601280~12582912,314572800~8388608,356515840~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.405 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~8388608,29360128~4194304,46137344~20971520,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~8388608,260046848~12582912,281018368~4194304,293601280~12582912,314572800~8388608,356515840~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.406 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~8388608,29360128~4194304,46137344~20971520,96468992~4194304,109051904~4194304,121634816~33554432,159383552~12582912,180355072~12582912,201326592~8388608,260046848~12582912,281018368~8388608,293601280~16777216,314572800~12582912,356515840~8388608,390070272~4194304,402653184~12582912] 2024-01-13T18:49:23.407 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to 19 diff [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.407 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.408 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~33554432,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~29360128,314572800~12582912,356515840~12582912,390070272~4194304,402653184~12582912] 2024-01-13T18:49:23.408 INFO:tasks.workunit.client.0.smithi084.stdout:from 16 to 17 diff [46137344~4194304,58720256~4194304,134217728~4194304,167772160~4194304,180355072~12582912,260046848~8388608,301989888~8388608,356515840~4194304,390070272~4194304] 2024-01-13T18:49:23.408 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [46137344~4194304,58720256~4194304,134217728~4194304,167772160~4194304,180355072~12582912,260046848~8388608,301989888~8388608,356515840~4194304,390070272~4194304] 2024-01-13T18:49:23.409 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [46137344~8388608,58720256~8388608,134217728~8388608,167772160~4194304,180355072~12582912,260046848~8388608,301989888~8388608,356515840~8388608,390070272~4194304] 2024-01-13T18:49:23.409 INFO:tasks.workunit.client.0.smithi084.stdout:from 16 to 18 diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~4194304,134217728~4194304,142606336~8388608,163577856~4194304,180355072~12582912,201326592~8388608,260046848~8388608,281018368~4194304,301989888~8388608,314572800~8388608,356515840~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.409 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~4194304,134217728~4194304,142606336~8388608,163577856~4194304,180355072~12582912,201326592~8388608,260046848~8388608,281018368~4194304,301989888~8388608,314572800~8388608,356515840~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.412 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,134217728~20971520,163577856~8388608,180355072~12582912,201326592~8388608,260046848~8388608,281018368~8388608,301989888~8388608,314572800~12582912,356515840~8388608,390070272~4194304,402653184~12582912] 2024-01-13T18:49:23.413 INFO:tasks.workunit.client.0.smithi084.stdout:from 16 to 19 diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,83886080~4194304,134217728~4194304,142606336~8388608,163577856~8388608,180355072~12582912,201326592~8388608,218103808~4194304,251658240~16777216,281018368~16777216,301989888~8388608,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.413 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,83886080~4194304,134217728~4194304,142606336~8388608,163577856~8388608,180355072~12582912,201326592~8388608,218103808~4194304,251658240~16777216,281018368~16777216,301989888~8388608,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.413 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,83886080~4194304,134217728~20971520,163577856~8388608,180355072~12582912,201326592~8388608,218103808~4194304,251658240~16777216,281018368~29360128,314572800~12582912,356515840~12582912,390070272~4194304,402653184~12582912] 2024-01-13T18:49:23.413 INFO:tasks.workunit.client.0.smithi084.stdout:from 17 to 18 diff [12582912~4194304,29360128~4194304,46137344~8388608,142606336~8388608,163577856~4194304,201326592~8388608,281018368~4194304,314572800~8388608,402653184~8388608] 2024-01-13T18:49:23.413 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~4194304,29360128~4194304,46137344~8388608,142606336~8388608,163577856~4194304,201326592~8388608,281018368~4194304,314572800~8388608,402653184~8388608] 2024-01-13T18:49:23.414 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~4194304,29360128~4194304,46137344~8388608,142606336~12582912,163577856~8388608,201326592~8388608,281018368~8388608,314572800~12582912,402653184~12582912] 2024-01-13T18:49:23.414 INFO:tasks.workunit.client.0.smithi084.stdout:from 17 to 19 diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~4194304,83886080~4194304,142606336~8388608,163577856~8388608,201326592~8388608,218103808~4194304,251658240~8388608,281018368~16777216,314572800~8388608,360710144~4194304,402653184~8388608] 2024-01-13T18:49:23.414 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~4194304,83886080~4194304,142606336~8388608,163577856~8388608,201326592~8388608,218103808~4194304,251658240~8388608,281018368~16777216,314572800~8388608,360710144~4194304,402653184~8388608] 2024-01-13T18:49:23.415 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,83886080~4194304,142606336~12582912,163577856~8388608,201326592~8388608,218103808~4194304,251658240~8388608,281018368~20971520,314572800~12582912,360710144~8388608,402653184~12582912] 2024-01-13T18:49:23.415 INFO:tasks.workunit.client.0.smithi084.stdout:from 18 to 19 diff [58720256~4194304,83886080~4194304,163577856~4194304,218103808~4194304,251658240~8388608,285212672~16777216,360710144~4194304] 2024-01-13T18:49:23.415 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [58720256~4194304,83886080~4194304,163577856~4194304,218103808~4194304,251658240~8388608,285212672~16777216,360710144~4194304] 2024-01-13T18:49:23.416 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [58720256~8388608,83886080~4194304,163577856~8388608,218103808~4194304,251658240~8388608,285212672~16777216,360710144~8388608] 2024-01-13T18:49:23.777 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:23.777 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:23.798 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:23.798 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:23.798 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:23.805 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:23.805 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.805 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.811 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:23.811 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.811 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.816 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:23.816 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.817 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:23.822 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:23.822 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.822 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.828 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:23.828 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.828 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.832 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:23.832 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.832 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.837 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:23.837 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.837 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.841 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~41943040,247463936~29360128,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.842 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.842 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.845 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~79691776,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,331350016~8388608,343932928~33554432,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.845 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.845 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.849 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~54525952,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,343932928~8388608,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.849 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.849 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.852 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~46137344,96468992~20971520,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.852 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.852 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.854 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~20971520,75497472~12582912,96468992~4194304,109051904~8388608,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.854 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to HEAD diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.854 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:23.857 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,251658240~25165824,281018368~29360128,314572800~12582912,356515840~16777216,381681664~12582912,398458880~16777216] 2024-01-13T18:49:23.857 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to HEAD diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.857 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.859 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~33554432,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~29360128,314572800~12582912,356515840~16777216,381681664~12582912,402653184~12582912] 2024-01-13T18:49:23.859 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to HEAD diff [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.859 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.860 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~33554432,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~29360128,314572800~12582912,356515840~12582912,390070272~4194304,402653184~12582912] 2024-01-13T18:49:23.860 INFO:tasks.workunit.client.0.smithi084.stdout:from 16 to HEAD diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,83886080~4194304,134217728~4194304,142606336~8388608,163577856~8388608,180355072~12582912,201326592~8388608,218103808~4194304,251658240~16777216,281018368~16777216,301989888~8388608,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.861 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,83886080~4194304,134217728~4194304,142606336~8388608,163577856~8388608,180355072~12582912,201326592~8388608,218103808~4194304,251658240~16777216,281018368~16777216,301989888~8388608,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:23.862 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,83886080~4194304,134217728~20971520,163577856~8388608,180355072~12582912,201326592~8388608,218103808~4194304,251658240~16777216,281018368~29360128,314572800~12582912,356515840~12582912,390070272~4194304,402653184~12582912] 2024-01-13T18:49:23.862 INFO:tasks.workunit.client.0.smithi084.stdout:from 17 to HEAD diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~4194304,83886080~4194304,142606336~8388608,163577856~8388608,201326592~8388608,218103808~4194304,251658240~8388608,281018368~16777216,314572800~8388608,360710144~4194304,402653184~8388608] 2024-01-13T18:49:23.862 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~4194304,83886080~4194304,142606336~8388608,163577856~8388608,201326592~8388608,218103808~4194304,251658240~8388608,281018368~16777216,314572800~8388608,360710144~4194304,402653184~8388608] 2024-01-13T18:49:23.863 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,83886080~4194304,142606336~12582912,163577856~8388608,201326592~8388608,218103808~4194304,251658240~8388608,281018368~20971520,314572800~12582912,360710144~8388608,402653184~12582912] 2024-01-13T18:49:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:23 smithi099 ceph-mon[138788]: osdmap e1501: 8 total, 8 up, 8 in 2024-01-13T18:49:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:23 smithi099 ceph-mon[138788]: pgmap v2703: 137 pgs: 137 active+clean; 792 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 219 KiB/s rd, 39 MiB/s wr, 343 op/s 2024-01-13T18:49:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:23 smithi084 ceph-mon[116404]: osdmap e1501: 8 total, 8 up, 8 in 2024-01-13T18:49:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:23 smithi084 ceph-mon[116404]: pgmap v2703: 137 pgs: 137 active+clean; 792 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 219 KiB/s rd, 39 MiB/s wr, 343 op/s 2024-01-13T18:49:24.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:23 smithi084 ceph-mon[119097]: osdmap e1501: 8 total, 8 up, 8 in 2024-01-13T18:49:24.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:23 smithi084 ceph-mon[119097]: pgmap v2703: 137 pgs: 137 active+clean; 792 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 219 KiB/s rd, 39 MiB/s wr, 343 op/s 2024-01-13T18:49:24.782 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:24.782 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:24.819 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:24.819 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:24.819 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:24.827 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:24.828 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:24.828 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:24.834 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:24.835 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:24.835 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:24.840 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:24.841 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:24.846 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.846 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.851 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.851 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.856 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:24.856 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.856 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.860 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:24.860 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.860 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.864 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~41943040,247463936~29360128,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:24.864 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.864 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.868 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~79691776,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,331350016~8388608,343932928~33554432,381681664~12582912,398458880~16777216] 2024-01-13T18:49:24.868 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.868 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.871 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~54525952,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,343932928~8388608,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:24.871 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.871 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.874 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~46137344,96468992~20971520,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:24.874 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.874 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.876 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~20971520,75497472~12582912,96468992~4194304,109051904~8388608,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:24.877 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to HEAD diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.877 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:24.879 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,251658240~25165824,281018368~29360128,314572800~12582912,356515840~16777216,381681664~12582912,398458880~16777216] 2024-01-13T18:49:24.879 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to HEAD diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:24.879 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:24.881 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~33554432,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~29360128,314572800~12582912,356515840~16777216,381681664~12582912,402653184~12582912] 2024-01-13T18:49:24.881 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to HEAD diff [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:24.881 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:24.882 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~33554432,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~29360128,314572800~12582912,356515840~12582912,390070272~4194304,402653184~12582912] 2024-01-13T18:49:24.882 INFO:tasks.workunit.client.0.smithi084.stdout:from 16 to HEAD diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,83886080~4194304,134217728~4194304,142606336~8388608,163577856~8388608,180355072~12582912,201326592~8388608,218103808~4194304,251658240~16777216,281018368~16777216,301989888~8388608,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:24.882 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,83886080~4194304,134217728~4194304,142606336~8388608,163577856~8388608,180355072~12582912,201326592~8388608,218103808~4194304,251658240~16777216,281018368~16777216,301989888~8388608,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:24.883 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [12582912~4194304,29360128~4194304,46137344~8388608,58720256~8388608,83886080~4194304,134217728~20971520,163577856~8388608,180355072~12582912,201326592~8388608,218103808~4194304,251658240~16777216,281018368~29360128,314572800~12582912,356515840~12582912,390070272~4194304,402653184~12582912] 2024-01-13T18:49:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:24 smithi099 ceph-mon[138788]: osdmap e1502: 8 total, 8 up, 8 in 2024-01-13T18:49:25.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:24 smithi084 ceph-mon[116404]: osdmap e1502: 8 total, 8 up, 8 in 2024-01-13T18:49:25.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:24 smithi084 ceph-mon[119097]: osdmap e1502: 8 total, 8 up, 8 in 2024-01-13T18:49:25.803 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:25.803 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:25.826 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:25.826 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:25.826 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:25.832 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:25.832 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:25.832 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:25.839 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:25.839 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:25.839 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:25.845 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:25.845 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:25.845 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:25.850 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:25.850 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.850 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.855 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:25.855 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.856 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.859 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:25.859 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.859 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.864 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:25.864 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.864 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.867 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~41943040,247463936~29360128,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:25.867 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.867 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.871 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~79691776,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,331350016~8388608,343932928~33554432,381681664~12582912,398458880~16777216] 2024-01-13T18:49:25.871 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.871 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.873 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~54525952,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,343932928~8388608,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:25.873 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.874 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.876 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~46137344,96468992~20971520,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:25.876 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.876 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.878 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~20971520,75497472~12582912,96468992~4194304,109051904~8388608,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:25.878 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to HEAD diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.878 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:25.879 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,251658240~25165824,281018368~29360128,314572800~12582912,356515840~16777216,381681664~12582912,398458880~16777216] 2024-01-13T18:49:25.880 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to HEAD diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:25.880 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:25.881 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~33554432,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~29360128,314572800~12582912,356515840~16777216,381681664~12582912,402653184~12582912] 2024-01-13T18:49:25.881 INFO:tasks.workunit.client.0.smithi084.stdout:from 15 to HEAD diff [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:25.881 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,390070272~4194304,402653184~8388608] 2024-01-13T18:49:25.882 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~8388608,29360128~4194304,46137344~20971520,83886080~4194304,96468992~4194304,109051904~4194304,121634816~33554432,159383552~12582912,180355072~12582912,201326592~8388608,218103808~4194304,251658240~20971520,281018368~29360128,314572800~12582912,356515840~12582912,390070272~4194304,402653184~12582912] 2024-01-13T18:49:26.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:25 smithi099 ceph-mon[138788]: pgmap v2705: 137 pgs: 137 active+clean; 841 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 293 KiB/s rd, 42 MiB/s wr, 508 op/s 2024-01-13T18:49:26.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:25 smithi099 ceph-mon[138788]: osdmap e1503: 8 total, 8 up, 8 in 2024-01-13T18:49:26.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:25 smithi084 ceph-mon[116404]: pgmap v2705: 137 pgs: 137 active+clean; 841 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 293 KiB/s rd, 42 MiB/s wr, 508 op/s 2024-01-13T18:49:26.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:25 smithi084 ceph-mon[116404]: osdmap e1503: 8 total, 8 up, 8 in 2024-01-13T18:49:26.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:25 smithi084 ceph-mon[119097]: pgmap v2705: 137 pgs: 137 active+clean; 841 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 293 KiB/s rd, 42 MiB/s wr, 508 op/s 2024-01-13T18:49:26.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:25 smithi084 ceph-mon[119097]: osdmap e1503: 8 total, 8 up, 8 in 2024-01-13T18:49:26.825 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:26.825 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:26.842 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:26.842 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:26.842 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:26.848 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:26.848 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:26.848 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:26.854 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:26.854 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:26.854 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:26.859 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:26.859 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:26.859 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:26.863 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:26.864 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.864 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.868 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:26.868 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.868 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.872 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:26.872 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.872 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.875 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:26.875 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.875 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.878 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~41943040,247463936~29360128,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:26.879 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.879 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.881 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~79691776,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,331350016~8388608,343932928~33554432,381681664~12582912,398458880~16777216] 2024-01-13T18:49:26.881 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.881 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.884 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~54525952,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,343932928~8388608,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:26.884 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.884 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.886 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~46137344,96468992~20971520,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:26.886 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.886 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.888 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~20971520,75497472~12582912,96468992~4194304,109051904~8388608,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:26.888 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to HEAD diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.888 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:26.889 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,251658240~25165824,281018368~29360128,314572800~12582912,356515840~16777216,381681664~12582912,398458880~16777216] 2024-01-13T18:49:26.890 INFO:tasks.workunit.client.0.smithi084.stdout:from 14 to HEAD diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:26.890 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,402653184~8388608] 2024-01-13T18:49:26.890 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~33554432,159383552~12582912,180355072~12582912,201326592~29360128,234881024~8388608,251658240~20971520,281018368~29360128,314572800~12582912,356515840~16777216,381681664~12582912,402653184~12582912] 2024-01-13T18:49:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:26 smithi099 ceph-mon[138788]: osdmap e1504: 8 total, 8 up, 8 in 2024-01-13T18:49:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:26 smithi084 ceph-mon[116404]: osdmap e1504: 8 total, 8 up, 8 in 2024-01-13T18:49:27.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:26 smithi084 ceph-mon[119097]: osdmap e1504: 8 total, 8 up, 8 in 2024-01-13T18:49:27.817 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:27.817 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:27.838 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:27.838 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:27.838 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:27.845 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:27.845 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:27.845 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:27.850 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:27.850 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:27.850 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:27.855 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:27.855 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:27.855 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:27.860 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:27.860 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.860 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.864 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:27.864 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.864 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.867 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:27.867 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.868 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.871 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:27.871 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.871 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.874 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~41943040,247463936~29360128,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:27.874 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.874 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.877 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~79691776,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,331350016~8388608,343932928~33554432,381681664~12582912,398458880~16777216] 2024-01-13T18:49:27.877 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.877 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.879 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~54525952,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,343932928~8388608,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:27.879 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.879 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.881 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~46137344,96468992~20971520,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:27.881 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.881 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.882 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~20971520,75497472~12582912,96468992~4194304,109051904~8388608,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:27.882 INFO:tasks.workunit.client.0.smithi084.stdout:from 13 to HEAD diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.882 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~12582912,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~8388608,134217728~16777216,159383552~12582912,180355072~12582912,201326592~37748736,251658240~20971520,281018368~25165824,314572800~8388608,356515840~8388608,369098752~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:27.883 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,251658240~25165824,281018368~29360128,314572800~12582912,356515840~16777216,381681664~12582912,398458880~16777216] 2024-01-13T18:49:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:27 smithi099 ceph-mon[138788]: pgmap v2708: 137 pgs: 137 active+clean; 853 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 291 KiB/s rd, 15 MiB/s wr, 564 op/s 2024-01-13T18:49:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:27 smithi099 ceph-mon[138788]: osdmap e1505: 8 total, 8 up, 8 in 2024-01-13T18:49:28.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:27 smithi084 ceph-mon[119097]: pgmap v2708: 137 pgs: 137 active+clean; 853 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 291 KiB/s rd, 15 MiB/s wr, 564 op/s 2024-01-13T18:49:28.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:27 smithi084 ceph-mon[119097]: osdmap e1505: 8 total, 8 up, 8 in 2024-01-13T18:49:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:27 smithi084 ceph-mon[116404]: pgmap v2708: 137 pgs: 137 active+clean; 853 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 291 KiB/s rd, 15 MiB/s wr, 564 op/s 2024-01-13T18:49:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:27 smithi084 ceph-mon[116404]: osdmap e1505: 8 total, 8 up, 8 in 2024-01-13T18:49:28.831 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:28.831 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:28.858 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:28.858 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:28.858 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:28.864 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:28.864 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:28.864 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:28.870 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:28.870 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:28.870 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:28.874 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:28.874 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:28.875 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:28.879 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:28.879 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.879 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.882 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:28.882 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.882 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.885 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:28.886 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.886 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.888 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:28.889 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.889 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.891 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~41943040,247463936~29360128,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:28.891 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.891 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.894 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~79691776,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,331350016~8388608,343932928~33554432,381681664~12582912,398458880~16777216] 2024-01-13T18:49:28.894 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.894 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.896 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~54525952,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,343932928~8388608,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:28.896 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.896 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.898 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~46137344,96468992~20971520,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:28.898 INFO:tasks.workunit.client.0.smithi084.stdout:from 12 to HEAD diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.898 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~4194304,46137344~20971520,75497472~12582912,96468992~4194304,109051904~4194304,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:28.899 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~20971520,75497472~12582912,96468992~4194304,109051904~8388608,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:29.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:28 smithi099 ceph-mon[138788]: osdmap e1506: 8 total, 8 up, 8 in 2024-01-13T18:49:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:28 smithi084 ceph-mon[116404]: osdmap e1506: 8 total, 8 up, 8 in 2024-01-13T18:49:29.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:28 smithi084 ceph-mon[119097]: osdmap e1506: 8 total, 8 up, 8 in 2024-01-13T18:49:29.856 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:29.856 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:29.876 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:29.876 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:29.876 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:29.881 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:29.881 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:29.881 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:29.885 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:29.886 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:29.886 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:29.890 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:29.890 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:29.890 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:29.893 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:29.894 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.894 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.897 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:29.897 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.897 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.900 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:29.900 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.900 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.902 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:29.902 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.902 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.904 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~41943040,247463936~29360128,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:29.905 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.905 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.906 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~79691776,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,331350016~8388608,343932928~33554432,381681664~12582912,398458880~16777216] 2024-01-13T18:49:29.906 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.906 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.908 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~54525952,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,343932928~8388608,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:29.908 INFO:tasks.workunit.client.0.smithi084.stdout:from 11 to HEAD diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.908 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,46137344~46137344,96468992~16777216,121634816~29360128,159383552~12582912,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,356515840~8388608,369098752~8388608,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:29.908 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,46137344~46137344,96468992~20971520,121634816~33554432,159383552~16777216,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:30.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:29 smithi099 ceph-mon[138788]: pgmap v2711: 137 pgs: 1 active+clean+snaptrim, 136 active+clean; 843 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 608 KiB/s rd, 2.9 MiB/s wr, 1.13k op/s 2024-01-13T18:49:30.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:29 smithi099 ceph-mon[138788]: osdmap e1507: 8 total, 8 up, 8 in 2024-01-13T18:49:30.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:29 smithi084 ceph-mon[119097]: pgmap v2711: 137 pgs: 1 active+clean+snaptrim, 136 active+clean; 843 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 608 KiB/s rd, 2.9 MiB/s wr, 1.13k op/s 2024-01-13T18:49:30.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:29 smithi084 ceph-mon[119097]: osdmap e1507: 8 total, 8 up, 8 in 2024-01-13T18:49:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:29 smithi084 ceph-mon[116404]: pgmap v2711: 137 pgs: 1 active+clean+snaptrim, 136 active+clean; 843 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 608 KiB/s rd, 2.9 MiB/s wr, 1.13k op/s 2024-01-13T18:49:30.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:29 smithi084 ceph-mon[116404]: osdmap e1507: 8 total, 8 up, 8 in 2024-01-13T18:49:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:49:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:49:30] "GET /metrics HTTP/1.1" 200 36485 "" "Prometheus/2.43.0" 2024-01-13T18:49:30.852 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:30.853 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:30.877 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:30.877 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:30.878 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:30.883 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:30.884 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:30.884 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:30.892 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:30.892 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:30.895 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:30.896 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:30.899 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.899 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.901 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.902 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.904 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:30.904 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.905 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.907 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:30.907 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.907 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.909 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~41943040,247463936~29360128,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:30.909 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.909 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.910 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~79691776,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,331350016~8388608,343932928~33554432,381681664~12582912,398458880~16777216] 2024-01-13T18:49:30.911 INFO:tasks.workunit.client.0.smithi084.stdout:from 10 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.911 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,121634816~50331648,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,343932928~8388608,356515840~12582912,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:30.911 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~20971520,121634816~54525952,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,343932928~8388608,356515840~20971520,381681664~12582912,398458880~16777216] 2024-01-13T18:49:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:30 smithi099 ceph-mon[138788]: osdmap e1508: 8 total, 8 up, 8 in 2024-01-13T18:49:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:30 smithi084 ceph-mon[116404]: osdmap e1508: 8 total, 8 up, 8 in 2024-01-13T18:49:31.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:30 smithi084 ceph-mon[119097]: osdmap e1508: 8 total, 8 up, 8 in 2024-01-13T18:49:31.846 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:31.846 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:31.883 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:31.883 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:31.883 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:31.890 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:31.890 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:31.890 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:31.895 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:31.895 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:31.895 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:31.898 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:31.898 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:31.898 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:31.901 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:31.902 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:31.902 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:31.904 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:31.904 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:31.904 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:31.906 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:31.906 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:31.906 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:31.908 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:31.908 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:31.908 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:31.910 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~41943040,247463936~29360128,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:31.910 INFO:tasks.workunit.client.0.smithi084.stdout:from 9 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:31.910 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~54525952,180355072~12582912,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:31.911 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~79691776,180355072~12582912,201326592~41943040,247463936~29360128,281018368~46137344,331350016~8388608,343932928~33554432,381681664~12582912,398458880~16777216] 2024-01-13T18:49:32.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:31 smithi099 ceph-mon[138788]: pgmap v2714: 137 pgs: 1 active+clean+snaptrim, 136 active+clean; 839 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 529 KiB/s rd, 741 KiB/s wr, 965 op/s 2024-01-13T18:49:32.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:31 smithi099 ceph-mon[138788]: osdmap e1509: 8 total, 8 up, 8 in 2024-01-13T18:49:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:31 smithi084 ceph-mon[116404]: pgmap v2714: 137 pgs: 1 active+clean+snaptrim, 136 active+clean; 839 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 529 KiB/s rd, 741 KiB/s wr, 965 op/s 2024-01-13T18:49:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:31 smithi084 ceph-mon[116404]: osdmap e1509: 8 total, 8 up, 8 in 2024-01-13T18:49:32.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:31 smithi084 ceph-mon[119097]: pgmap v2714: 137 pgs: 1 active+clean+snaptrim, 136 active+clean; 839 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 529 KiB/s rd, 741 KiB/s wr, 965 op/s 2024-01-13T18:49:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:31 smithi084 ceph-mon[119097]: osdmap e1509: 8 total, 8 up, 8 in 2024-01-13T18:49:32.863 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:32.863 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:32.881 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:32.881 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:32.886 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:32.886 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:32.889 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:32.889 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:32.890 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:32.893 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:32.893 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:32.896 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:32.896 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:32.898 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:32.898 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:32.899 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:32.901 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:32.901 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:32.902 INFO:tasks.workunit.client.0.smithi084.stdout:from 8 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:32.902 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,201326592~41943040,247463936~25165824,281018368~25165824,310378496~12582912,331350016~8388608,343932928~25165824,373293056~4194304,381681664~4194304,390070272~4194304,398458880~12582912] 2024-01-13T18:49:32.903 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,201326592~41943040,247463936~29360128,281018368~46137344,331350016~46137344,381681664~12582912,398458880~16777216] 2024-01-13T18:49:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:32 smithi099 ceph-mon[138788]: osdmap e1510: 8 total, 8 up, 8 in 2024-01-13T18:49:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:32 smithi084 ceph-mon[116404]: osdmap e1510: 8 total, 8 up, 8 in 2024-01-13T18:49:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:32 smithi084 ceph-mon[119097]: osdmap e1510: 8 total, 8 up, 8 in 2024-01-13T18:49:33.565 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:33.565 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:33.588 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:33.589 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:33.589 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:33.592 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:33.592 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:33.595 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:33.595 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:33.596 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:33.598 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:33.598 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:33.601 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:33.601 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:33.603 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:33.603 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:33.604 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:33.605 INFO:tasks.workunit.client.0.smithi084.stdout:from 7 to HEAD diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:33.605 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [8388608~16777216,29360128~8388608,41943040~8388608,54525952~37748736,96468992~16777216,117440512~75497472,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:33.606 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [8388608~16777216,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:34.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:33 smithi099 ceph-mon[138788]: pgmap v2717: 137 pgs: 137 active+clean; 782 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 228 KiB/s rd, 6.2 KiB/s wr, 384 op/s 2024-01-13T18:49:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:33 smithi099 ceph-mon[138788]: osdmap e1511: 8 total, 8 up, 8 in 2024-01-13T18:49:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:33 smithi099 ceph-mon[138788]: osdmap e1512: 8 total, 8 up, 8 in 2024-01-13T18:49:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:33 smithi084 ceph-mon[116404]: pgmap v2717: 137 pgs: 137 active+clean; 782 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 228 KiB/s rd, 6.2 KiB/s wr, 384 op/s 2024-01-13T18:49:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:33 smithi084 ceph-mon[116404]: osdmap e1511: 8 total, 8 up, 8 in 2024-01-13T18:49:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:33 smithi084 ceph-mon[116404]: osdmap e1512: 8 total, 8 up, 8 in 2024-01-13T18:49:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:33 smithi084 ceph-mon[119097]: pgmap v2717: 137 pgs: 137 active+clean; 782 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 228 KiB/s rd, 6.2 KiB/s wr, 384 op/s 2024-01-13T18:49:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:33 smithi084 ceph-mon[119097]: osdmap e1511: 8 total, 8 up, 8 in 2024-01-13T18:49:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:33 smithi084 ceph-mon[119097]: osdmap e1512: 8 total, 8 up, 8 in 2024-01-13T18:49:34.563 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:34.563 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:34.588 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:34.588 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:34.594 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:34.594 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:34.597 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:34.598 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:34.598 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:34.601 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:34.601 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:34.603 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:34.603 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:34.604 INFO:tasks.workunit.client.0.smithi084.stdout:from 6 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:34.604 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~25165824,281018368~25165824,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:34.605 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~29360128,281018368~113246208,398458880~16777216] 2024-01-13T18:49:35.580 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:35.580 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:35.604 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:35.604 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:35.604 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:35.607 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:35.607 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:35.607 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:35.611 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:35.611 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:35.611 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:35.613 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:35.614 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:35.614 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:35.616 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:35.616 INFO:tasks.workunit.client.0.smithi084.stdout:from 5 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:35.616 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~71303168,197132288~8388608,209715200~33554432,247463936~58720256,310378496~58720256,373293056~12582912,390070272~4194304,398458880~12582912] 2024-01-13T18:49:35.617 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~96468992,197132288~46137344,247463936~146800640,398458880~16777216] 2024-01-13T18:49:35.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:35 smithi099 ceph-mon[138788]: osdmap e1513: 8 total, 8 up, 8 in 2024-01-13T18:49:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:35 smithi084 ceph-mon[116404]: osdmap e1513: 8 total, 8 up, 8 in 2024-01-13T18:49:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:35 smithi084 ceph-mon[119097]: osdmap e1513: 8 total, 8 up, 8 in 2024-01-13T18:49:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:36.582 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:36.582 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:36.603 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:36.604 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:36.604 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:36.610 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:36.610 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:36.610 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:36.612 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:36.612 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:36.612 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:36.616 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:36.616 INFO:tasks.workunit.client.0.smithi084.stdout:from 4 to HEAD diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:36.616 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [4194304~20971520,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:36.617 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [4194304~20971520,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:36.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:36 smithi099 ceph-mon[138788]: pgmap v2721: 137 pgs: 137 active+clean; 761 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 257 KiB/s rd, 6.6 KiB/s wr, 440 op/s 2024-01-13T18:49:36.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:36 smithi099 ceph-mon[138788]: osdmap e1514: 8 total, 8 up, 8 in 2024-01-13T18:49:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:36 smithi084 ceph-mon[116404]: pgmap v2721: 137 pgs: 137 active+clean; 761 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 257 KiB/s rd, 6.6 KiB/s wr, 440 op/s 2024-01-13T18:49:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:36 smithi084 ceph-mon[116404]: osdmap e1514: 8 total, 8 up, 8 in 2024-01-13T18:49:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:36 smithi084 ceph-mon[119097]: pgmap v2721: 137 pgs: 137 active+clean; 761 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 257 KiB/s rd, 6.6 KiB/s wr, 440 op/s 2024-01-13T18:49:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:36 smithi084 ceph-mon[119097]: osdmap e1514: 8 total, 8 up, 8 in 2024-01-13T18:49:37.593 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:37.593 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:37.623 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:37.623 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:37.623 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:37.625 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:37.625 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:37.625 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:37.627 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:37.627 INFO:tasks.workunit.client.0.smithi084.stdout:from 3 to HEAD diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:37.627 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~8388608,41943040~20971520,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:37.628 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~8388608,41943040~50331648,96468992~146800640,247463936~167772160] 2024-01-13T18:49:37.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:37 smithi099 ceph-mon[138788]: osdmap e1515: 8 total, 8 up, 8 in 2024-01-13T18:49:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:37 smithi084 ceph-mon[116404]: osdmap e1515: 8 total, 8 up, 8 in 2024-01-13T18:49:37.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:37 smithi084 ceph-mon[119097]: osdmap e1515: 8 total, 8 up, 8 in 2024-01-13T18:49:38.552 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:38.552 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:38.568 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:38.568 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:38.568 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:38.573 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:38.573 INFO:tasks.workunit.client.0.smithi084.stdout:from 2 to HEAD diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:38.574 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~25165824,96468992~16777216,117440512~88080384,209715200~33554432,247463936~79691776,331350016~37748736,373293056~12582912,390070272~20971520] 2024-01-13T18:49:38.575 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~62914560,96468992~146800640,247463936~167772160] 2024-01-13T18:49:38.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:38 smithi099 ceph-mon[138788]: pgmap v2724: 137 pgs: 137 active+clean; 718 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 48 KiB/s rd, 1.5 KiB/s wr, 96 op/s 2024-01-13T18:49:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:38 smithi099 ceph-mon[138788]: osdmap e1516: 8 total, 8 up, 8 in 2024-01-13T18:49:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:38 smithi099 ceph-mon[138788]: osdmap e1517: 8 total, 8 up, 8 in 2024-01-13T18:49:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:38 smithi084 ceph-mon[116404]: pgmap v2724: 137 pgs: 137 active+clean; 718 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 48 KiB/s rd, 1.5 KiB/s wr, 96 op/s 2024-01-13T18:49:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:38 smithi084 ceph-mon[116404]: osdmap e1516: 8 total, 8 up, 8 in 2024-01-13T18:49:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:38 smithi084 ceph-mon[116404]: osdmap e1517: 8 total, 8 up, 8 in 2024-01-13T18:49:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:38 smithi084 ceph-mon[119097]: pgmap v2724: 137 pgs: 137 active+clean; 718 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 48 KiB/s rd, 1.5 KiB/s wr, 96 op/s 2024-01-13T18:49:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:38 smithi084 ceph-mon[119097]: osdmap e1516: 8 total, 8 up, 8 in 2024-01-13T18:49:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:38 smithi084 ceph-mon[119097]: osdmap e1517: 8 total, 8 up, 8 in 2024-01-13T18:49:39.594 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:39.594 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:39.619 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:39.619 INFO:tasks.workunit.client.0.smithi084.stdout:from 1 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:39.619 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~79691776,331350016~54525952,390070272~20971520] 2024-01-13T18:49:39.620 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:40.579 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:49:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:49:40] "GET /metrics HTTP/1.1" 200 36491 "" "Prometheus/2.43.0" 2024-01-13T18:49:40.599 INFO:tasks.workunit.client.0.smithi084.stdout:from 0 to HEAD diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:40.599 INFO:tasks.workunit.client.0.smithi084.stdout: limited diff [0~25165824,29360128~33554432,67108864~46137344,117440512~88080384,209715200~33554432,247463936~92274688,343932928~41943040,390070272~25165824] 2024-01-13T18:49:40.624 INFO:tasks.workunit.client.0.smithi084.stdout: actual was [0~25165824,29360128~213909504,247463936~167772160] 2024-01-13T18:49:40.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:40 smithi099 ceph-mon[138788]: pgmap v2727: 137 pgs: 137 active+clean; 600 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 136 KiB/s rd, 6.0 KiB/s wr, 214 op/s 2024-01-13T18:49:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:40 smithi099 ceph-mon[138788]: osdmap e1518: 8 total, 8 up, 8 in 2024-01-13T18:49:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:40 smithi084 ceph-mon[116404]: pgmap v2727: 137 pgs: 137 active+clean; 600 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 136 KiB/s rd, 6.0 KiB/s wr, 214 op/s 2024-01-13T18:49:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:40 smithi084 ceph-mon[116404]: osdmap e1518: 8 total, 8 up, 8 in 2024-01-13T18:49:40.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:40 smithi084 ceph-mon[119097]: pgmap v2727: 137 pgs: 137 active+clean; 600 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 136 KiB/s rd, 6.0 KiB/s wr, 214 op/s 2024-01-13T18:49:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:40 smithi084 ceph-mon[119097]: osdmap e1518: 8 total, 8 up, 8 in 2024-01-13T18:49:41.646 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterateStress (38992 ms) 2024-01-13T18:49:41.646 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterateParent 2024-01-13T18:49:41.646 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:49:41.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:41 smithi099 ceph-mon[138788]: osdmap e1519: 8 total, 8 up, 8 in 2024-01-13T18:49:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:41 smithi084 ceph-mon[116404]: osdmap e1519: 8 total, 8 up, 8 in 2024-01-13T18:49:41.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:41 smithi084 ceph-mon[119097]: osdmap e1519: 8 total, 8 up, 8 in 2024-01-13T18:49:42.718 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterateParent (1072 ms) 2024-01-13T18:49:42.718 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterateIgnoreParent 2024-01-13T18:49:42.718 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:49:42.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:42 smithi099 ceph-mon[138788]: pgmap v2730: 137 pgs: 137 active+clean; 564 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 145 KiB/s rd, 7.2 KiB/s wr, 233 op/s 2024-01-13T18:49:42.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:42 smithi099 ceph-mon[138788]: osdmap e1520: 8 total, 8 up, 8 in 2024-01-13T18:49:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:42 smithi084 ceph-mon[116404]: pgmap v2730: 137 pgs: 137 active+clean; 564 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 145 KiB/s rd, 7.2 KiB/s wr, 233 op/s 2024-01-13T18:49:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:42 smithi084 ceph-mon[116404]: osdmap e1520: 8 total, 8 up, 8 in 2024-01-13T18:49:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:42 smithi084 ceph-mon[119097]: pgmap v2730: 137 pgs: 137 active+clean; 564 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 145 KiB/s rd, 7.2 KiB/s wr, 233 op/s 2024-01-13T18:49:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:42 smithi084 ceph-mon[119097]: osdmap e1520: 8 total, 8 up, 8 in 2024-01-13T18:49:43.665 INFO:tasks.workunit.client.0.smithi084.stdout: wrote [0~20971520] to clone 2024-01-13T18:49:43.665 INFO:tasks.workunit.client.0.smithi084.stdout: diff was [0~20971520] 2024-01-13T18:49:43.669 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterateIgnoreParent (952 ms) 2024-01-13T18:49:43.669 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterateCallbackError 2024-01-13T18:49:43.669 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:49:43.688 INFO:tasks.workunit.client.0.smithi084.stdout: wrote [4275374~39079,5823106~44883,6311618~78277,11252803~25414,11337158~3380,11416099~28096,13527834~98777,14668902~79751,15430866~94387,18722625~61934] 2024-01-13T18:49:43.698 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterateCallbackError (29 ms) 2024-01-13T18:49:43.698 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterateParentDiscard 2024-01-13T18:49:43.698 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:49:43.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:43 smithi099 ceph-mon[138788]: osdmap e1521: 8 total, 8 up, 8 in 2024-01-13T18:49:43.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:43 smithi099 ceph-mon[138788]: osdmap e1522: 8 total, 8 up, 8 in 2024-01-13T18:49:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:43 smithi084 ceph-mon[116404]: osdmap e1521: 8 total, 8 up, 8 in 2024-01-13T18:49:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:43 smithi084 ceph-mon[116404]: osdmap e1522: 8 total, 8 up, 8 in 2024-01-13T18:49:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:43 smithi084 ceph-mon[119097]: osdmap e1521: 8 total, 8 up, 8 in 2024-01-13T18:49:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:43 smithi084 ceph-mon[119097]: osdmap e1522: 8 total, 8 up, 8 in 2024-01-13T18:49:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:44 smithi084 ceph-mon[116404]: pgmap v2733: 137 pgs: 137 active+clean; 484 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 59 KiB/s rd, 2.0 MiB/s wr, 95 op/s 2024-01-13T18:49:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:44 smithi084 ceph-mon[119097]: pgmap v2733: 137 pgs: 137 active+clean; 484 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 59 KiB/s rd, 2.0 MiB/s wr, 95 op/s 2024-01-13T18:49:45.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:44 smithi099 ceph-mon[138788]: pgmap v2733: 137 pgs: 137 active+clean; 484 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 59 KiB/s rd, 2.0 MiB/s wr, 95 op/s 2024-01-13T18:49:45.732 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterateParentDiscard (2034 ms) 2024-01-13T18:49:45.732 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterateUnalignedSmall 2024-01-13T18:49:45.732 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:49:45.787 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterateUnalignedSmall (54 ms) 2024-01-13T18:49:45.787 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterateUnaligned 2024-01-13T18:49:45.787 INFO:tasks.workunit.client.0.smithi084.stdout:using new format! 2024-01-13T18:49:45.863 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterateUnaligned (76 ms) 2024-01-13T18:49:45.863 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] DiffIterateTest/1.DiffIterateStriping 2024-01-13T18:49:45.863 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:49:45.863 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] DiffIterateTest/1.DiffIterateStriping (0 ms) 2024-01-13T18:49:45.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:45 smithi084 ceph-mon[116404]: osdmap e1523: 8 total, 8 up, 8 in 2024-01-13T18:49:45.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:45 smithi084 ceph-mon[119097]: osdmap e1523: 8 total, 8 up, 8 in 2024-01-13T18:49:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:45 smithi099 ceph-mon[138788]: osdmap e1523: 8 total, 8 up, 8 in 2024-01-13T18:49:46.647 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 12 tests from DiffIterateTest/1 (57302 ms total) 2024-01-13T18:49:46.648 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:49:46.648 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 17 tests from TestImageWatcher 2024-01-13T18:49:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:46 smithi084 ceph-mon[116404]: pgmap v2736: 137 pgs: 137 active+clean; 478 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 5.6 MiB/s wr, 141 op/s 2024-01-13T18:49:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:46 smithi084 ceph-mon[116404]: osdmap e1524: 8 total, 8 up, 8 in 2024-01-13T18:49:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:46 smithi084 ceph-mon[119097]: pgmap v2736: 137 pgs: 137 active+clean; 478 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 5.6 MiB/s wr, 141 op/s 2024-01-13T18:49:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:46 smithi084 ceph-mon[119097]: osdmap e1524: 8 total, 8 up, 8 in 2024-01-13T18:49:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:46 smithi099 ceph-mon[138788]: pgmap v2736: 137 pgs: 137 active+clean; 478 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 5.6 MiB/s wr, 141 op/s 2024-01-13T18:49:47.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:46 smithi099 ceph-mon[138788]: osdmap e1524: 8 total, 8 up, 8 in 2024-01-13T18:49:47.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:47 smithi084 ceph-mon[116404]: osdmap e1525: 8 total, 8 up, 8 in 2024-01-13T18:49:47.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:47 smithi084 ceph-mon[119097]: osdmap e1525: 8 total, 8 up, 8 in 2024-01-13T18:49:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:47 smithi099 ceph-mon[138788]: osdmap e1525: 8 total, 8 up, 8 in 2024-01-13T18:49:48.680 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifyHeaderUpdate 2024-01-13T18:49:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:48 smithi099 ceph-mon[138788]: pgmap v2739: 105 pgs: 105 active+clean; 4.6 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:49:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:48 smithi099 ceph-mon[138788]: osdmap e1526: 8 total, 8 up, 8 in 2024-01-13T18:49:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:48 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3299335179' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:49:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:48 smithi084 ceph-mon[116404]: pgmap v2739: 105 pgs: 105 active+clean; 4.6 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:49:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:48 smithi084 ceph-mon[116404]: osdmap e1526: 8 total, 8 up, 8 in 2024-01-13T18:49:49.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:48 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3299335179' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:49:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:48 smithi084 ceph-mon[119097]: pgmap v2739: 105 pgs: 105 active+clean; 4.6 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:49:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:48 smithi084 ceph-mon[119097]: osdmap e1526: 8 total, 8 up, 8 in 2024-01-13T18:49:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:48 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3299335179' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:49:50.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:49 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3299335179' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:49:50.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:49 smithi099 ceph-mon[138788]: osdmap e1527: 8 total, 8 up, 8 in 2024-01-13T18:49:50.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:49 smithi099 ceph-mon[138788]: osdmap e1528: 8 total, 8 up, 8 in 2024-01-13T18:49:50.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:49 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3299335179' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:49:50.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:49 smithi084 ceph-mon[116404]: osdmap e1527: 8 total, 8 up, 8 in 2024-01-13T18:49:50.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:49 smithi084 ceph-mon[116404]: osdmap e1528: 8 total, 8 up, 8 in 2024-01-13T18:49:50.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:49 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3299335179' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:49:50.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:49 smithi084 ceph-mon[119097]: osdmap e1527: 8 total, 8 up, 8 in 2024-01-13T18:49:50.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:49 smithi084 ceph-mon[119097]: osdmap e1528: 8 total, 8 up, 8 in 2024-01-13T18:49:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:49:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:49:50] "GET /metrics HTTP/1.1" 200 36484 "" "Prometheus/2.43.0" 2024-01-13T18:49:50.714 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifyHeaderUpdate (2034 ms) 2024-01-13T18:49:50.714 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifyFlatten 2024-01-13T18:49:50.739 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifyFlatten (24 ms) 2024-01-13T18:49:50.739 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifyResize 2024-01-13T18:49:50.761 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifyResize (22 ms) 2024-01-13T18:49:50.761 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifyRebuildObjectMap 2024-01-13T18:49:50.785 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifyRebuildObjectMap (25 ms) 2024-01-13T18:49:50.785 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifyUpdateFeatures 2024-01-13T18:49:50.806 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifyUpdateFeatures (21 ms) 2024-01-13T18:49:50.806 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifySnapCreate 2024-01-13T18:49:50.826 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifySnapCreate (20 ms) 2024-01-13T18:49:50.826 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifySnapCreateError 2024-01-13T18:49:50.846 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifySnapCreateError (19 ms) 2024-01-13T18:49:50.846 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifySnapRename 2024-01-13T18:49:50.864 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifySnapRename (19 ms) 2024-01-13T18:49:50.864 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifySnapRenameError 2024-01-13T18:49:50.883 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifySnapRenameError (18 ms) 2024-01-13T18:49:50.883 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifySnapRemove 2024-01-13T18:49:50.901 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifySnapRemove (18 ms) 2024-01-13T18:49:50.901 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifySnapProtect 2024-01-13T18:49:50.921 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifySnapProtect (20 ms) 2024-01-13T18:49:50.921 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifySnapUnprotect 2024-01-13T18:49:50.940 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifySnapUnprotect (20 ms) 2024-01-13T18:49:50.940 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifyRename 2024-01-13T18:49:50.962 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifyRename (21 ms) 2024-01-13T18:49:50.962 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifyAsyncTimedOut 2024-01-13T18:49:50.982 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifyAsyncTimedOut (21 ms) 2024-01-13T18:49:50.982 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifyAsyncError 2024-01-13T18:49:51.003 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifyAsyncError (20 ms) 2024-01-13T18:49:51.003 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifyAsyncCompleteError 2024-01-13T18:49:51.022 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifyAsyncCompleteError (19 ms) 2024-01-13T18:49:51.022 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestImageWatcher.NotifyAsyncRequestTimedOut 2024-01-13T18:49:51.045 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestImageWatcher.NotifyAsyncRequestTimedOut (24 ms) 2024-01-13T18:49:51.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:50 smithi099 ceph-mon[138788]: pgmap v2742: 137 pgs: 12 creating+peering, 16 unknown, 109 active+clean; 4.6 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:49:51.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:50 smithi099 ceph-mon[138788]: osdmap e1529: 8 total, 8 up, 8 in 2024-01-13T18:49:51.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:50 smithi084 ceph-mon[116404]: pgmap v2742: 137 pgs: 12 creating+peering, 16 unknown, 109 active+clean; 4.6 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:49:51.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:51.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:50 smithi084 ceph-mon[116404]: osdmap e1529: 8 total, 8 up, 8 in 2024-01-13T18:49:51.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:50 smithi084 ceph-mon[119097]: pgmap v2742: 137 pgs: 12 creating+peering, 16 unknown, 109 active+clean; 4.6 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:49:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:49:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:50 smithi084 ceph-mon[119097]: osdmap e1529: 8 total, 8 up, 8 in 2024-01-13T18:49:51.713 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 17 tests from TestImageWatcher (2365 ms total) 2024-01-13T18:49:51.713 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:49:51.713 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 34 tests from TestInternal 2024-01-13T18:49:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:52 smithi099 ceph-mon[138788]: pgmap v2745: 137 pgs: 12 creating+peering, 9 unknown, 116 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:49:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:52 smithi099 ceph-mon[138788]: osdmap e1530: 8 total, 8 up, 8 in 2024-01-13T18:49:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:52 smithi084 ceph-mon[116404]: pgmap v2745: 137 pgs: 12 creating+peering, 9 unknown, 116 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:49:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:52 smithi084 ceph-mon[116404]: osdmap e1530: 8 total, 8 up, 8 in 2024-01-13T18:49:53.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:52 smithi084 ceph-mon[119097]: pgmap v2745: 137 pgs: 12 creating+peering, 9 unknown, 116 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail 2024-01-13T18:49:53.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:52 smithi084 ceph-mon[119097]: osdmap e1530: 8 total, 8 up, 8 in 2024-01-13T18:49:53.723 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.OpenByID 2024-01-13T18:49:54.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:53 smithi099 ceph-mon[138788]: osdmap e1531: 8 total, 8 up, 8 in 2024-01-13T18:49:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:53 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3856574073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:49:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:53 smithi099 ceph-mon[138788]: pgmap v2748: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:49:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:53 smithi084 ceph-mon[116404]: osdmap e1531: 8 total, 8 up, 8 in 2024-01-13T18:49:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:53 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3856574073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:49:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:53 smithi084 ceph-mon[116404]: pgmap v2748: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:49:54.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:53 smithi084 ceph-mon[119097]: osdmap e1531: 8 total, 8 up, 8 in 2024-01-13T18:49:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:53 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3856574073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:49:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:53 smithi084 ceph-mon[119097]: pgmap v2748: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:49:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:54 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:49:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:54 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3856574073' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:49:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:54 smithi099 ceph-mon[138788]: osdmap e1532: 8 total, 8 up, 8 in 2024-01-13T18:49:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:54 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:49:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:54 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:49:55.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:54 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:49:55.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:54 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:49:55.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:49:55.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3856574073' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:49:55.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[119097]: osdmap e1532: 8 total, 8 up, 8 in 2024-01-13T18:49:55.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:49:55.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:49:55.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:49:55.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:49:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:49:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3856574073' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:49:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[116404]: osdmap e1532: 8 total, 8 up, 8 in 2024-01-13T18:49:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:49:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:49:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:49:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:54 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:49:55.775 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.OpenByID (2052 ms) 2024-01-13T18:49:55.775 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.OpenSnapDNE 2024-01-13T18:49:55.797 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.OpenSnapDNE (22 ms) 2024-01-13T18:49:55.797 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.IsExclusiveLockOwner 2024-01-13T18:49:55.820 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.IsExclusiveLockOwner (22 ms) 2024-01-13T18:49:55.820 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.ResizeLocksImage 2024-01-13T18:49:55.843 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.ResizeLocksImage (24 ms) 2024-01-13T18:49:55.843 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.ResizeFailsToLockImage 2024-01-13T18:49:55.859 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.ResizeFailsToLockImage (16 ms) 2024-01-13T18:49:55.859 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.SnapCreateLocksImage 2024-01-13T18:49:56.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:55 smithi099 ceph-mon[138788]: osdmap e1533: 8 total, 8 up, 8 in 2024-01-13T18:49:56.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:55 smithi099 ceph-mon[138788]: pgmap v2751: 137 pgs: 6 creating+peering, 19 unknown, 112 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:49:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:55 smithi084 ceph-mon[116404]: osdmap e1533: 8 total, 8 up, 8 in 2024-01-13T18:49:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:55 smithi084 ceph-mon[116404]: pgmap v2751: 137 pgs: 6 creating+peering, 19 unknown, 112 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:49:56.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:55 smithi084 ceph-mon[119097]: osdmap e1533: 8 total, 8 up, 8 in 2024-01-13T18:49:56.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:55 smithi084 ceph-mon[119097]: pgmap v2751: 137 pgs: 6 creating+peering, 19 unknown, 112 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:49:57.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:56 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:49:57.169 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:56 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:49:57.169 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:56 smithi099 ceph-mon[138788]: osdmap e1534: 8 total, 8 up, 8 in 2024-01-13T18:49:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:56 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:49:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:56 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:49:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:56 smithi084 ceph-mon[116404]: osdmap e1534: 8 total, 8 up, 8 in 2024-01-13T18:49:57.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:56 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:49:57.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:56 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:49:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:56 smithi084 ceph-mon[119097]: osdmap e1534: 8 total, 8 up, 8 in 2024-01-13T18:49:57.770 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.SnapCreateLocksImage (1910 ms) 2024-01-13T18:49:57.770 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.SnapCreateFailsToLockImage 2024-01-13T18:49:57.796 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.SnapCreateFailsToLockImage (26 ms) 2024-01-13T18:49:57.796 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.SnapRollbackLocksImage 2024-01-13T18:49:58.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:57 smithi099 ceph-mon[138788]: osdmap e1535: 8 total, 8 up, 8 in 2024-01-13T18:49:58.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:57 smithi099 ceph-mon[138788]: pgmap v2754: 137 pgs: 6 creating+peering, 10 unknown, 121 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-01-13T18:49:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:57 smithi084 ceph-mon[116404]: osdmap e1535: 8 total, 8 up, 8 in 2024-01-13T18:49:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:57 smithi084 ceph-mon[116404]: pgmap v2754: 137 pgs: 6 creating+peering, 10 unknown, 121 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-01-13T18:49:58.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:57 smithi084 ceph-mon[119097]: osdmap e1535: 8 total, 8 up, 8 in 2024-01-13T18:49:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:57 smithi084 ceph-mon[119097]: pgmap v2754: 137 pgs: 6 creating+peering, 10 unknown, 121 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 6.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-01-13T18:49:59.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:58 smithi099 ceph-mon[138788]: osdmap e1536: 8 total, 8 up, 8 in 2024-01-13T18:49:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:58 smithi084 ceph-mon[116404]: osdmap e1536: 8 total, 8 up, 8 in 2024-01-13T18:49:59.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:58 smithi084 ceph-mon[119097]: osdmap e1536: 8 total, 8 up, 8 in 2024-01-13T18:49:59.783 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.SnapRollbackLocksImage (1988 ms) 2024-01-13T18:49:59.783 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.SnapRollbackFailsToLockImage 2024-01-13T18:50:00.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:59 smithi099 ceph-mon[138788]: osdmap e1537: 8 total, 8 up, 8 in 2024-01-13T18:50:00.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:49:59 smithi099 ceph-mon[138788]: pgmap v2757: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 37 KiB/s rd, 6.5 KiB/s wr, 57 op/s 2024-01-13T18:50:00.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:59 smithi084 ceph-mon[116404]: osdmap e1537: 8 total, 8 up, 8 in 2024-01-13T18:50:00.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:49:59 smithi084 ceph-mon[116404]: pgmap v2757: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 37 KiB/s rd, 6.5 KiB/s wr, 57 op/s 2024-01-13T18:50:00.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:59 smithi084 ceph-mon[119097]: osdmap e1537: 8 total, 8 up, 8 in 2024-01-13T18:50:00.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:49:59 smithi084 ceph-mon[119097]: pgmap v2757: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 37 KiB/s rd, 6.5 KiB/s wr, 57 op/s 2024-01-13T18:50:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:50:00] "GET /metrics HTTP/1.1" 200 36484 "" "Prometheus/2.43.0" 2024-01-13T18:50:01.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:00 smithi099 ceph-mon[138788]: osdmap e1538: 8 total, 8 up, 8 in 2024-01-13T18:50:01.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:00 smithi099 ceph-mon[138788]: overall HEALTH_OK 2024-01-13T18:50:01.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:00 smithi084 ceph-mon[119097]: osdmap e1538: 8 total, 8 up, 8 in 2024-01-13T18:50:01.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:00 smithi084 ceph-mon[119097]: overall HEALTH_OK 2024-01-13T18:50:01.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:00 smithi084 ceph-mon[116404]: osdmap e1538: 8 total, 8 up, 8 in 2024-01-13T18:50:01.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:00 smithi084 ceph-mon[116404]: overall HEALTH_OK 2024-01-13T18:50:01.796 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.SnapRollbackFailsToLockImage (2013 ms) 2024-01-13T18:50:01.796 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.SnapSetReleasesLock 2024-01-13T18:50:02.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:01 smithi099 ceph-mon[138788]: osdmap e1539: 8 total, 8 up, 8 in 2024-01-13T18:50:02.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:01 smithi099 ceph-mon[138788]: pgmap v2760: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 59 KiB/s rd, 7.7 KiB/s wr, 86 op/s 2024-01-13T18:50:02.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:01 smithi084 ceph-mon[116404]: osdmap e1539: 8 total, 8 up, 8 in 2024-01-13T18:50:02.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:01 smithi084 ceph-mon[116404]: pgmap v2760: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 59 KiB/s rd, 7.7 KiB/s wr, 86 op/s 2024-01-13T18:50:02.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:01 smithi084 ceph-mon[119097]: osdmap e1539: 8 total, 8 up, 8 in 2024-01-13T18:50:02.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:01 smithi084 ceph-mon[119097]: pgmap v2760: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 59 KiB/s rd, 7.7 KiB/s wr, 86 op/s 2024-01-13T18:50:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:02 smithi099 ceph-mon[138788]: osdmap e1540: 8 total, 8 up, 8 in 2024-01-13T18:50:03.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:02 smithi084 ceph-mon[119097]: osdmap e1540: 8 total, 8 up, 8 in 2024-01-13T18:50:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:02 smithi084 ceph-mon[116404]: osdmap e1540: 8 total, 8 up, 8 in 2024-01-13T18:50:03.563 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.SnapSetReleasesLock (1767 ms) 2024-01-13T18:50:03.564 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.FlattenLocksImage 2024-01-13T18:50:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:03 smithi099 ceph-mon[138788]: pgmap v2763: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 80 KiB/s rd, 7.5 KiB/s wr, 115 op/s 2024-01-13T18:50:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:03 smithi099 ceph-mon[138788]: osdmap e1541: 8 total, 8 up, 8 in 2024-01-13T18:50:04.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:03 smithi099 ceph-mon[138788]: osdmap e1542: 8 total, 8 up, 8 in 2024-01-13T18:50:04.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:03 smithi084 ceph-mon[119097]: pgmap v2763: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 80 KiB/s rd, 7.5 KiB/s wr, 115 op/s 2024-01-13T18:50:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:03 smithi084 ceph-mon[119097]: osdmap e1541: 8 total, 8 up, 8 in 2024-01-13T18:50:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:03 smithi084 ceph-mon[119097]: osdmap e1542: 8 total, 8 up, 8 in 2024-01-13T18:50:04.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:03 smithi084 ceph-mon[116404]: pgmap v2763: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 80 KiB/s rd, 7.5 KiB/s wr, 115 op/s 2024-01-13T18:50:04.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:03 smithi084 ceph-mon[116404]: osdmap e1541: 8 total, 8 up, 8 in 2024-01-13T18:50:04.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:03 smithi084 ceph-mon[116404]: osdmap e1542: 8 total, 8 up, 8 in 2024-01-13T18:50:05.582 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.FlattenLocksImage (2018 ms) 2024-01-13T18:50:05.582 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.FlattenFailsToLockImage 2024-01-13T18:50:05.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:05 smithi099 ceph-mon[138788]: osdmap e1543: 8 total, 8 up, 8 in 2024-01-13T18:50:05.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:05 smithi084 ceph-mon[119097]: osdmap e1543: 8 total, 8 up, 8 in 2024-01-13T18:50:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:05 smithi084 ceph-mon[116404]: osdmap e1543: 8 total, 8 up, 8 in 2024-01-13T18:50:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:06.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:06 smithi099 ceph-mon[138788]: pgmap v2766: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 76 KiB/s rd, 7.7 KiB/s wr, 109 op/s 2024-01-13T18:50:06.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:06 smithi099 ceph-mon[138788]: osdmap e1544: 8 total, 8 up, 8 in 2024-01-13T18:50:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:06 smithi084 ceph-mon[116404]: pgmap v2766: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 76 KiB/s rd, 7.7 KiB/s wr, 109 op/s 2024-01-13T18:50:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:06 smithi084 ceph-mon[116404]: osdmap e1544: 8 total, 8 up, 8 in 2024-01-13T18:50:06.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:06 smithi084 ceph-mon[119097]: pgmap v2766: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 76 KiB/s rd, 7.7 KiB/s wr, 109 op/s 2024-01-13T18:50:06.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:06 smithi084 ceph-mon[119097]: osdmap e1544: 8 total, 8 up, 8 in 2024-01-13T18:50:07.596 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.FlattenFailsToLockImage (2015 ms) 2024-01-13T18:50:07.596 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklisted 2024-01-13T18:50:07.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:07 smithi099 ceph-mon[138788]: osdmap e1545: 8 total, 8 up, 8 in 2024-01-13T18:50:07.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:07 smithi084 ceph-mon[116404]: osdmap e1545: 8 total, 8 up, 8 in 2024-01-13T18:50:07.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:07 smithi084 ceph-mon[119097]: osdmap e1545: 8 total, 8 up, 8 in 2024-01-13T18:50:08.549 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.WriteFailsToLockImageBlocklisted (953 ms) 2024-01-13T18:50:08.549 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.WriteFailsToLockImageBlocklistedWatch 2024-01-13T18:50:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:08 smithi099 ceph-mon[138788]: pgmap v2769: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 105 KiB/s rd, 7.0 KiB/s wr, 137 op/s 2024-01-13T18:50:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:08 smithi099 ceph-mon[138788]: osdmap e1546: 8 total, 8 up, 8 in 2024-01-13T18:50:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:08 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1148350414' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/1148350414"}]: dispatch 2024-01-13T18:50:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:08 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1148350414' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/1148350414"}]': finished 2024-01-13T18:50:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:08 smithi099 ceph-mon[138788]: osdmap e1547: 8 total, 8 up, 8 in 2024-01-13T18:50:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:08 smithi084 ceph-mon[116404]: pgmap v2769: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 105 KiB/s rd, 7.0 KiB/s wr, 137 op/s 2024-01-13T18:50:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:08 smithi084 ceph-mon[116404]: osdmap e1546: 8 total, 8 up, 8 in 2024-01-13T18:50:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:08 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1148350414' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/1148350414"}]: dispatch 2024-01-13T18:50:08.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:08 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1148350414' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/1148350414"}]': finished 2024-01-13T18:50:08.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:08 smithi084 ceph-mon[116404]: osdmap e1547: 8 total, 8 up, 8 in 2024-01-13T18:50:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:08 smithi084 ceph-mon[119097]: pgmap v2769: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 105 KiB/s rd, 7.0 KiB/s wr, 137 op/s 2024-01-13T18:50:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:08 smithi084 ceph-mon[119097]: osdmap e1546: 8 total, 8 up, 8 in 2024-01-13T18:50:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:08 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1148350414' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/1148350414"}]: dispatch 2024-01-13T18:50:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:08 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1148350414' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/1148350414"}]': finished 2024-01-13T18:50:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:08 smithi084 ceph-mon[119097]: osdmap e1547: 8 total, 8 up, 8 in 2024-01-13T18:50:09.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:09 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2788148928' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/2788148928"}]: dispatch 2024-01-13T18:50:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:09 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2788148928' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/2788148928"}]: dispatch 2024-01-13T18:50:09.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:09 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2788148928' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/2788148928"}]: dispatch 2024-01-13T18:50:10.579 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:50:10] "GET /metrics HTTP/1.1" 200 36524 "" "Prometheus/2.43.0" 2024-01-13T18:50:10.590 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.WriteFailsToLockImageBlocklistedWatch (2041 ms) 2024-01-13T18:50:10.590 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.AioWriteRequestsLock 2024-01-13T18:50:10.627 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.AioWriteRequestsLock (35 ms) 2024-01-13T18:50:10.627 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.AioDiscardRequestsLock 2024-01-13T18:50:10.653 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.AioDiscardRequestsLock (27 ms) 2024-01-13T18:50:10.653 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.CancelAsyncResize 2024-01-13T18:50:10.697 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.CancelAsyncResize (44 ms) 2024-01-13T18:50:10.697 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.MultipleResize 2024-01-13T18:50:10.750 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.MultipleResize (53 ms) 2024-01-13T18:50:10.750 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.Metadata 2024-01-13T18:50:10.790 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.Metadata (40 ms) 2024-01-13T18:50:10.790 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.MetadataConfApply 2024-01-13T18:50:10.820 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.MetadataConfApply (30 ms) 2024-01-13T18:50:10.820 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.SnapshotCopyup 2024-01-13T18:50:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:10 smithi099 ceph-mon[138788]: pgmap v2772: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 200 KiB/s rd, 12 KiB/s wr, 266 op/s 2024-01-13T18:50:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:10 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2788148928' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/2788148928"}]': finished 2024-01-13T18:50:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:10 smithi099 ceph-mon[138788]: osdmap e1548: 8 total, 8 up, 8 in 2024-01-13T18:50:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:10 smithi084 ceph-mon[116404]: pgmap v2772: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 200 KiB/s rd, 12 KiB/s wr, 266 op/s 2024-01-13T18:50:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:10 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2788148928' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/2788148928"}]': finished 2024-01-13T18:50:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:10 smithi084 ceph-mon[116404]: osdmap e1548: 8 total, 8 up, 8 in 2024-01-13T18:50:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:10 smithi084 ceph-mon[119097]: pgmap v2772: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 200 KiB/s rd, 12 KiB/s wr, 266 op/s 2024-01-13T18:50:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:10 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2788148928' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/2788148928"}]': finished 2024-01-13T18:50:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:10 smithi084 ceph-mon[119097]: osdmap e1548: 8 total, 8 up, 8 in 2024-01-13T18:50:12.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:12 smithi099 ceph-mon[138788]: pgmap v2774: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 124 KiB/s rd, 8.3 KiB/s wr, 173 op/s 2024-01-13T18:50:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:12 smithi099 ceph-mon[138788]: osdmap e1549: 8 total, 8 up, 8 in 2024-01-13T18:50:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:12 smithi084 ceph-mon[116404]: pgmap v2774: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 124 KiB/s rd, 8.3 KiB/s wr, 173 op/s 2024-01-13T18:50:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:12 smithi084 ceph-mon[116404]: osdmap e1549: 8 total, 8 up, 8 in 2024-01-13T18:50:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:12 smithi084 ceph-mon[119097]: pgmap v2774: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 124 KiB/s rd, 8.3 KiB/s wr, 173 op/s 2024-01-13T18:50:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:12 smithi084 ceph-mon[119097]: osdmap e1549: 8 total, 8 up, 8 in 2024-01-13T18:50:13.622 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.SnapshotCopyup (2802 ms) 2024-01-13T18:50:13.622 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.SnapshotCopyupZeros 2024-01-13T18:50:13.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:13 smithi099 ceph-mon[138788]: osdmap e1550: 8 total, 8 up, 8 in 2024-01-13T18:50:13.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:13 smithi099 ceph-mon[138788]: osdmap e1551: 8 total, 8 up, 8 in 2024-01-13T18:50:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:13 smithi084 ceph-mon[116404]: osdmap e1550: 8 total, 8 up, 8 in 2024-01-13T18:50:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:13 smithi084 ceph-mon[116404]: osdmap e1551: 8 total, 8 up, 8 in 2024-01-13T18:50:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:13 smithi084 ceph-mon[119097]: osdmap e1550: 8 total, 8 up, 8 in 2024-01-13T18:50:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:13 smithi084 ceph-mon[119097]: osdmap e1551: 8 total, 8 up, 8 in 2024-01-13T18:50:14.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:14 smithi099 ceph-mon[138788]: pgmap v2777: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 136 KiB/s rd, 21 KiB/s wr, 201 op/s 2024-01-13T18:50:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:14 smithi084 ceph-mon[116404]: pgmap v2777: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 136 KiB/s rd, 21 KiB/s wr, 201 op/s 2024-01-13T18:50:14.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:14 smithi084 ceph-mon[119097]: pgmap v2777: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 136 KiB/s rd, 21 KiB/s wr, 201 op/s 2024-01-13T18:50:15.647 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.SnapshotCopyupZeros (2025 ms) 2024-01-13T18:50:15.647 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.SnapshotCopyupZerosMigration 2024-01-13T18:50:15.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:15 smithi099 ceph-mon[138788]: osdmap e1552: 8 total, 8 up, 8 in 2024-01-13T18:50:15.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:15 smithi084 ceph-mon[116404]: osdmap e1552: 8 total, 8 up, 8 in 2024-01-13T18:50:15.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:15 smithi084 ceph-mon[119097]: osdmap e1552: 8 total, 8 up, 8 in 2024-01-13T18:50:16.653 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.SnapshotCopyupZerosMigration (1006 ms) 2024-01-13T18:50:16.653 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.ResizeCopyup 2024-01-13T18:50:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:16 smithi084 ceph-mon[116404]: pgmap v2780: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 198 KiB/s rd, 24 KiB/s wr, 278 op/s 2024-01-13T18:50:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:16 smithi084 ceph-mon[116404]: osdmap e1553: 8 total, 8 up, 8 in 2024-01-13T18:50:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:16 smithi084 ceph-mon[119097]: pgmap v2780: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 198 KiB/s rd, 24 KiB/s wr, 278 op/s 2024-01-13T18:50:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:16 smithi084 ceph-mon[119097]: osdmap e1553: 8 total, 8 up, 8 in 2024-01-13T18:50:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:16 smithi099 ceph-mon[138788]: pgmap v2780: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 198 KiB/s rd, 24 KiB/s wr, 278 op/s 2024-01-13T18:50:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:16 smithi099 ceph-mon[138788]: osdmap e1553: 8 total, 8 up, 8 in 2024-01-13T18:50:17.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:17 smithi084 ceph-mon[119097]: osdmap e1554: 8 total, 8 up, 8 in 2024-01-13T18:50:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:17 smithi084 ceph-mon[116404]: osdmap e1554: 8 total, 8 up, 8 in 2024-01-13T18:50:18.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:17 smithi099 ceph-mon[138788]: osdmap e1554: 8 total, 8 up, 8 in 2024-01-13T18:50:18.604 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.ResizeCopyup (1952 ms) 2024-01-13T18:50:18.605 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.DiscardCopyup 2024-01-13T18:50:18.616 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:50:18.616 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.DiscardCopyup (11 ms) 2024-01-13T18:50:18.616 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.ImageOptions 2024-01-13T18:50:18.625 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.ImageOptions (9 ms) 2024-01-13T18:50:18.625 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.WriteFullCopyup 2024-01-13T18:50:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:18 smithi084 ceph-mon[119097]: pgmap v2783: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 144 KiB/s rd, 9.0 KiB/s wr, 190 op/s 2024-01-13T18:50:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:18 smithi084 ceph-mon[119097]: osdmap e1555: 8 total, 8 up, 8 in 2024-01-13T18:50:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:18 smithi084 ceph-mon[119097]: osdmap e1556: 8 total, 8 up, 8 in 2024-01-13T18:50:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:18 smithi084 ceph-mon[116404]: pgmap v2783: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 144 KiB/s rd, 9.0 KiB/s wr, 190 op/s 2024-01-13T18:50:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:18 smithi084 ceph-mon[116404]: osdmap e1555: 8 total, 8 up, 8 in 2024-01-13T18:50:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:18 smithi084 ceph-mon[116404]: osdmap e1556: 8 total, 8 up, 8 in 2024-01-13T18:50:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:18 smithi099 ceph-mon[138788]: pgmap v2783: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 144 KiB/s rd, 9.0 KiB/s wr, 190 op/s 2024-01-13T18:50:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:18 smithi099 ceph-mon[138788]: osdmap e1555: 8 total, 8 up, 8 in 2024-01-13T18:50:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:18 smithi099 ceph-mon[138788]: osdmap e1556: 8 total, 8 up, 8 in 2024-01-13T18:50:20.637 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:50:20] "GET /metrics HTTP/1.1" 200 36525 "" "Prometheus/2.43.0" 2024-01-13T18:50:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:20 smithi084 ceph-mon[116404]: pgmap v2786: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 158 KiB/s rd, 21 KiB/s wr, 225 op/s 2024-01-13T18:50:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:20 smithi084 ceph-mon[116404]: osdmap e1557: 8 total, 8 up, 8 in 2024-01-13T18:50:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:20.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:20 smithi084 ceph-mon[119097]: pgmap v2786: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 158 KiB/s rd, 21 KiB/s wr, 225 op/s 2024-01-13T18:50:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:20 smithi084 ceph-mon[119097]: osdmap e1557: 8 total, 8 up, 8 in 2024-01-13T18:50:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:20 smithi099 ceph-mon[138788]: pgmap v2786: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 158 KiB/s rd, 21 KiB/s wr, 225 op/s 2024-01-13T18:50:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:20 smithi099 ceph-mon[138788]: osdmap e1557: 8 total, 8 up, 8 in 2024-01-13T18:50:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:21 smithi084 ceph-mon[116404]: osdmap e1558: 8 total, 8 up, 8 in 2024-01-13T18:50:21.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:21 smithi084 ceph-mon[119097]: osdmap e1558: 8 total, 8 up, 8 in 2024-01-13T18:50:22.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:21 smithi099 ceph-mon[138788]: osdmap e1558: 8 total, 8 up, 8 in 2024-01-13T18:50:22.671 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.WriteFullCopyup (4046 ms) 2024-01-13T18:50:22.671 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.DiffIterateCloneOverwrite 2024-01-13T18:50:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:22 smithi084 ceph-mon[116404]: pgmap v2789: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 146 KiB/s rd, 19 KiB/s wr, 207 op/s 2024-01-13T18:50:22.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:22 smithi084 ceph-mon[116404]: osdmap e1559: 8 total, 8 up, 8 in 2024-01-13T18:50:22.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:22 smithi084 ceph-mon[119097]: pgmap v2789: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 146 KiB/s rd, 19 KiB/s wr, 207 op/s 2024-01-13T18:50:22.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:22 smithi084 ceph-mon[119097]: osdmap e1559: 8 total, 8 up, 8 in 2024-01-13T18:50:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:22 smithi099 ceph-mon[138788]: pgmap v2789: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 146 KiB/s rd, 19 KiB/s wr, 207 op/s 2024-01-13T18:50:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:22 smithi099 ceph-mon[138788]: osdmap e1559: 8 total, 8 up, 8 in 2024-01-13T18:50:23.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:23 smithi084 ceph-mon[119097]: osdmap e1560: 8 total, 8 up, 8 in 2024-01-13T18:50:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:23 smithi084 ceph-mon[116404]: osdmap e1560: 8 total, 8 up, 8 in 2024-01-13T18:50:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:23 smithi099 ceph-mon[138788]: osdmap e1560: 8 total, 8 up, 8 in 2024-01-13T18:50:24.698 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.DiffIterateCloneOverwrite (2028 ms) 2024-01-13T18:50:24.698 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.TestCoR 2024-01-13T18:50:24.707 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING due to disabled rbd_copy_on_read 2024-01-13T18:50:24.707 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.TestCoR (9 ms) 2024-01-13T18:50:24.707 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.FlattenNoEmptyObjects 2024-01-13T18:50:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:24 smithi084 ceph-mon[116404]: pgmap v2792: 137 pgs: 137 active+clean; 8.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 311 op/s 2024-01-13T18:50:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:24 smithi084 ceph-mon[116404]: osdmap e1561: 8 total, 8 up, 8 in 2024-01-13T18:50:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:24 smithi084 ceph-mon[119097]: pgmap v2792: 137 pgs: 137 active+clean; 8.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 311 op/s 2024-01-13T18:50:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:24 smithi084 ceph-mon[119097]: osdmap e1561: 8 total, 8 up, 8 in 2024-01-13T18:50:24.928 INFO:tasks.workunit.client.0.smithi084.stdout:made parent image "image57": 4194304K (1024 * 4K) 2024-01-13T18:50:24.928 INFO:tasks.workunit.client.0.smithi084.stdout:generated random write map: 2024-01-13T18:50:24.928 INFO:tasks.workunit.client.0.smithi084.stdout: [5 , 23915 ] 2024-01-13T18:50:24.928 INFO:tasks.workunit.client.0.smithi084.stdout: [7 , 29541 ] 2024-01-13T18:50:24.928 INFO:tasks.workunit.client.0.smithi084.stdout: [19 , 79364 ] 2024-01-13T18:50:24.928 INFO:tasks.workunit.client.0.smithi084.stdout: [47 , 195451 ] 2024-01-13T18:50:24.928 INFO:tasks.workunit.client.0.smithi084.stdout: [64 , 265170 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [68 , 278848 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [79 , 325099 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [110 , 453832 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [111 , 457157 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [132 , 540827 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [133 , 547427 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [136 , 557689 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [145 , 594021 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [146 , 600974 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [153 , 628431 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [158 , 650533 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [164 , 674867 ] 2024-01-13T18:50:24.929 INFO:tasks.workunit.client.0.smithi084.stdout: [165 , 679295 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [194 , 794795 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [206 , 845671 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [215 , 884179 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [219 , 899701 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [222 , 910851 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [239 , 981458 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [252 , 1034366 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [263 , 1079322 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [299 , 1226188 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [302 , 1237176 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [309 , 1269086 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [315 , 1293813 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [334 , 1371372 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [367 , 1505607 ] 2024-01-13T18:50:24.930 INFO:tasks.workunit.client.0.smithi084.stdout: [391 , 1604686 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [396 , 1622332 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [406 , 1663147 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [424 , 1739312 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [428 , 1754983 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [451 , 1848437 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [456 , 1868686 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [465 , 1908193 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [470 , 1925147 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [476 , 1952566 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [483 , 1981062 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [507 , 2079520 ] 2024-01-13T18:50:24.931 INFO:tasks.workunit.client.0.smithi084.stdout: [508 , 2082821 ] 2024-01-13T18:50:24.932 INFO:tasks.workunit.client.0.smithi084.stdout: [515 , 2112344 ] 2024-01-13T18:50:24.932 INFO:tasks.workunit.client.0.smithi084.stdout: [542 , 2223337 ] 2024-01-13T18:50:24.932 INFO:tasks.workunit.client.0.smithi084.stdout: [549 , 2251172 ] 2024-01-13T18:50:24.932 INFO:tasks.workunit.client.0.smithi084.stdout: [553 , 2265349 ] 2024-01-13T18:50:24.932 INFO:tasks.workunit.client.0.smithi084.stdout: [554 , 2269498 ] 2024-01-13T18:50:24.932 INFO:tasks.workunit.client.0.smithi084.stdout: [570 , 2336167 ] 2024-01-13T18:50:24.932 INFO:tasks.workunit.client.0.smithi084.stdout: [580 , 2379145 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [594 , 2435934 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [602 , 2468136 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [609 , 2494913 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [633 , 2593498 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [636 , 2607095 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [683 , 2798243 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [688 , 2819953 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [693 , 2841338 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [713 , 2922385 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [722 , 2960767 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [732 , 3001063 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [736 , 3015635 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [740 , 3033256 ] 2024-01-13T18:50:24.933 INFO:tasks.workunit.client.0.smithi084.stdout: [741 , 3035738 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [745 , 3054895 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [750 , 3074474 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [753 , 3087002 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [783 , 3207757 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [786 , 3222217 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [795 , 3257570 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [796 , 3260515 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [824 , 3377548 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [825 , 3379926 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [829 , 3397795 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [844 , 3457330 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [853 , 3495339 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [864 , 3540621 ] 2024-01-13T18:50:24.934 INFO:tasks.workunit.client.0.smithi084.stdout: [869 , 3562687 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [874 , 3583077 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [878 , 3597236 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [890 , 3645686 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [899 , 3683957 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [904 , 3704882 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [908 , 3721335 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [919 , 3764942 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [948 , 3883724 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [949 , 3889706 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [972 , 3983624 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [983 , 4029695 ] 2024-01-13T18:50:24.935 INFO:tasks.workunit.client.0.smithi084.stdout: [992 , 4065813 ] 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: [998 , 4088521 ] 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: [1016 , 4163756 ] 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: [1018 , 4170961 ] 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout:write data based on random map 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: write object-5 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: write object-7 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: write object-19 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: write object-47 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: write object-64 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: write object-68 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: write object-79 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: write object-110 2024-01-13T18:50:24.936 INFO:tasks.workunit.client.0.smithi084.stdout: write object-111 2024-01-13T18:50:24.937 INFO:tasks.workunit.client.0.smithi084.stdout: write object-132 2024-01-13T18:50:24.937 INFO:tasks.workunit.client.0.smithi084.stdout: write object-133 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-136 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-145 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-146 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-153 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-158 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-164 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-165 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-194 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-206 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-215 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-219 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-222 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-239 2024-01-13T18:50:24.938 INFO:tasks.workunit.client.0.smithi084.stdout: write object-252 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-263 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-299 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-302 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-309 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-315 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-334 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-367 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-391 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-396 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-406 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-424 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-428 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-451 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-456 2024-01-13T18:50:24.939 INFO:tasks.workunit.client.0.smithi084.stdout: write object-465 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-470 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-476 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-483 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-507 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-508 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-515 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-542 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-549 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-553 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-554 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-570 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-580 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-594 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-602 2024-01-13T18:50:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: write object-609 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-633 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-636 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-683 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-688 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-693 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-713 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-722 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-732 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-736 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-740 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-741 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-745 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-750 2024-01-13T18:50:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: write object-753 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-783 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-786 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-795 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-796 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-824 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-825 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-829 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-844 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-853 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-864 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-869 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-874 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-878 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-890 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-899 2024-01-13T18:50:24.942 INFO:tasks.workunit.client.0.smithi084.stdout: write object-904 2024-01-13T18:50:24.943 INFO:tasks.workunit.client.0.smithi084.stdout: write object-908 2024-01-13T18:50:24.943 INFO:tasks.workunit.client.0.smithi084.stdout: write object-919 2024-01-13T18:50:24.943 INFO:tasks.workunit.client.0.smithi084.stdout: write object-948 2024-01-13T18:50:24.943 INFO:tasks.workunit.client.0.smithi084.stdout: write object-949 2024-01-13T18:50:24.943 INFO:tasks.workunit.client.0.smithi084.stdout: write object-972 2024-01-13T18:50:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:24 smithi099 ceph-mon[138788]: pgmap v2792: 137 pgs: 137 active+clean; 8.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 311 op/s 2024-01-13T18:50:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:24 smithi099 ceph-mon[138788]: osdmap e1561: 8 total, 8 up, 8 in 2024-01-13T18:50:25.908 INFO:tasks.workunit.client.0.smithi084.stdout: write object-983 2024-01-13T18:50:25.908 INFO:tasks.workunit.client.0.smithi084.stdout: write object-992 2024-01-13T18:50:25.908 INFO:tasks.workunit.client.0.smithi084.stdout: write object-998 2024-01-13T18:50:25.908 INFO:tasks.workunit.client.0.smithi084.stdout: write object-1016 2024-01-13T18:50:25.909 INFO:tasks.workunit.client.0.smithi084.stdout: write object-1018 2024-01-13T18:50:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:verify written data by reading 2024-01-13T18:50:25.909 INFO:tasks.workunit.client.0.smithi084.stdout: read object-5 2024-01-13T18:50:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:made snapshot "image57@parent_snap" and protect it 2024-01-13T18:50:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:made and opened clone "image58" 2024-01-13T18:50:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:flattening clone: "image58" 2024-01-13T18:50:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:check whether child image has the same set of objects as parent 2024-01-13T18:50:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.FlattenNoEmptyObjects (1200 ms) 2024-01-13T18:50:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.PoolMetadataConfApply 2024-01-13T18:50:25.939 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:25 smithi084 ceph-mon[116404]: osdmap e1562: 8 total, 8 up, 8 in 2024-01-13T18:50:25.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:25 smithi084 ceph-mon[119097]: osdmap e1562: 8 total, 8 up, 8 in 2024-01-13T18:50:25.979 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.PoolMetadataConfApply (72 ms) 2024-01-13T18:50:25.980 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.Sparsify 2024-01-13T18:50:26.004 INFO:tasks.workunit.client.0.smithi084.stdout:sparsify_supported=1 2024-01-13T18:50:26.004 INFO:tasks.workunit.client.0.smithi084.stdout:sparse_read_supported=1 2024-01-13T18:50:26.034 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.Sparsify (54 ms) 2024-01-13T18:50:26.034 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.SparsifyClone 2024-01-13T18:50:26.050 INFO:tasks.workunit.client.0.smithi084.stdout:sparsify_supported=1 2024-01-13T18:50:26.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:25 smithi099 ceph-mon[138788]: osdmap e1562: 8 total, 8 up, 8 in 2024-01-13T18:50:26.426 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:25 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:50:25] ENGINE Bus STOPPING 2024-01-13T18:50:26.426 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:25 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:50:25] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T18:50:26.426 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:25 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:50:25] ENGINE Bus STOPPED 2024-01-13T18:50:26.426 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:25 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:50:25] ENGINE Bus STARTING 2024-01-13T18:50:26.426 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:50:26] ENGINE Serving on http://:::9283 2024-01-13T18:50:26.427 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:18:50:26] ENGINE Bus STARTED 2024-01-13T18:50:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:26 smithi099 ceph-mon[138788]: pgmap v2795: 137 pgs: 137 active+clean; 8.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 227 op/s 2024-01-13T18:50:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:26 smithi099 ceph-mon[138788]: osdmap e1563: 8 total, 8 up, 8 in 2024-01-13T18:50:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:26 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3856574073' entity='client.admin' 2024-01-13T18:50:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:50:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:50:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:50:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:50:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[116404]: pgmap v2795: 137 pgs: 137 active+clean; 8.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 227 op/s 2024-01-13T18:50:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[116404]: osdmap e1563: 8 total, 8 up, 8 in 2024-01-13T18:50:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3856574073' entity='client.admin' 2024-01-13T18:50:27.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:50:27.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:50:27.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:50:27.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:50:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[119097]: pgmap v2795: 137 pgs: 137 active+clean; 8.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 227 op/s 2024-01-13T18:50:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[119097]: osdmap e1563: 8 total, 8 up, 8 in 2024-01-13T18:50:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3856574073' entity='client.admin' 2024-01-13T18:50:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:50:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:50:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:50:27.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:50:28.020 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.SparsifyClone (1986 ms) 2024-01-13T18:50:28.020 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestInternal.MissingDataPool 2024-01-13T18:50:28.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:27 smithi099 ceph-mon[138788]: pgmap v2797: 137 pgs: 137 active+clean; 8.7 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 209 op/s 2024-01-13T18:50:28.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:27 smithi099 ceph-mon[138788]: osdmap e1564: 8 total, 8 up, 8 in 2024-01-13T18:50:28.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:27 smithi084 ceph-mon[119097]: pgmap v2797: 137 pgs: 137 active+clean; 8.7 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 209 op/s 2024-01-13T18:50:28.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:27 smithi084 ceph-mon[119097]: osdmap e1564: 8 total, 8 up, 8 in 2024-01-13T18:50:28.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:27 smithi084 ceph-mon[116404]: pgmap v2797: 137 pgs: 137 active+clean; 8.7 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 209 op/s 2024-01-13T18:50:28.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:27 smithi084 ceph-mon[116404]: osdmap e1564: 8 total, 8 up, 8 in 2024-01-13T18:50:28.648 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestInternal.MissingDataPool (629 ms) 2024-01-13T18:50:29.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:29 smithi099 ceph-mon[138788]: osdmap e1565: 8 total, 8 up, 8 in 2024-01-13T18:50:29.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:29 smithi099 ceph-mon[138788]: osdmap e1566: 8 total, 8 up, 8 in 2024-01-13T18:50:29.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:29 smithi084 ceph-mon[116404]: osdmap e1565: 8 total, 8 up, 8 in 2024-01-13T18:50:29.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:29 smithi084 ceph-mon[116404]: osdmap e1566: 8 total, 8 up, 8 in 2024-01-13T18:50:29.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:29 smithi084 ceph-mon[119097]: osdmap e1565: 8 total, 8 up, 8 in 2024-01-13T18:50:29.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:29 smithi084 ceph-mon[119097]: osdmap e1566: 8 total, 8 up, 8 in 2024-01-13T18:50:29.564 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 34 tests from TestInternal (34925 ms total) 2024-01-13T18:50:29.564 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:50:29.564 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 51 tests from TestMirroring 2024-01-13T18:50:30.555 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:50:30] "GET /metrics HTTP/1.1" 200 36525 "" "Prometheus/2.43.0" 2024-01-13T18:50:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:30 smithi099 ceph-mon[138788]: pgmap v2801: 137 pgs: 137 active+clean; 9.0 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 428 KiB/s rd, 153 KiB/s wr, 706 op/s 2024-01-13T18:50:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:30 smithi099 ceph-mon[138788]: osdmap e1567: 8 total, 8 up, 8 in 2024-01-13T18:50:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:30 smithi084 ceph-mon[116404]: pgmap v2801: 137 pgs: 137 active+clean; 9.0 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 428 KiB/s rd, 153 KiB/s wr, 706 op/s 2024-01-13T18:50:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:30 smithi084 ceph-mon[116404]: osdmap e1567: 8 total, 8 up, 8 in 2024-01-13T18:50:30.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:30 smithi084 ceph-mon[119097]: pgmap v2801: 137 pgs: 137 active+clean; 9.0 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 428 KiB/s rd, 153 KiB/s wr, 706 op/s 2024-01-13T18:50:30.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:30 smithi084 ceph-mon[119097]: osdmap e1567: 8 total, 8 up, 8 in 2024-01-13T18:50:31.587 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage 2024-01-13T18:50:31.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:31 smithi099 ceph-mon[138788]: osdmap e1568: 8 total, 8 up, 8 in 2024-01-13T18:50:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:50:31.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:50:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:31 smithi084 ceph-mon[116404]: osdmap e1568: 8 total, 8 up, 8 in 2024-01-13T18:50:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:50:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:50:31.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:31 smithi084 ceph-mon[119097]: osdmap e1568: 8 total, 8 up, 8 in 2024-01-13T18:50:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:50:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:50:32.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:32 smithi099 ceph-mon[138788]: pgmap v2804: 137 pgs: 32 unknown, 105 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:50:32.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:32 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:50:32.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:32 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:50:32.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:32 smithi099 ceph-mon[138788]: osdmap e1569: 8 total, 8 up, 8 in 2024-01-13T18:50:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:32 smithi084 ceph-mon[116404]: pgmap v2804: 137 pgs: 32 unknown, 105 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:50:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:32 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:50:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:32 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:50:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:32 smithi084 ceph-mon[116404]: osdmap e1569: 8 total, 8 up, 8 in 2024-01-13T18:50:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:32 smithi084 ceph-mon[119097]: pgmap v2804: 137 pgs: 32 unknown, 105 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:50:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:32 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:50:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:32 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:50:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:32 smithi084 ceph-mon[119097]: osdmap e1569: 8 total, 8 up, 8 in 2024-01-13T18:50:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage (2118 ms) 2024-01-13T18:50:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool 2024-01-13T18:50:33.813 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool (107 ms) 2024-01-13T18:50:33.813 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled 2024-01-13T18:50:33.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:33 smithi099 ceph-mon[138788]: osdmap e1570: 8 total, 8 up, 8 in 2024-01-13T18:50:33.890 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled (78 ms) 2024-01-13T18:50:33.890 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage 2024-01-13T18:50:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:33 smithi084 ceph-mon[116404]: osdmap e1570: 8 total, 8 up, 8 in 2024-01-13T18:50:33.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:33 smithi084 ceph-mon[119097]: osdmap e1570: 8 total, 8 up, 8 in 2024-01-13T18:50:33.990 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage (99 ms) 2024-01-13T18:50:33.990 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap 2024-01-13T18:50:34.077 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeImage_NoObjectMap (87 ms) 2024-01-13T18:50:34.077 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModePool 2024-01-13T18:50:34.164 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModePool (87 ms) 2024-01-13T18:50:34.164 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled 2024-01-13T18:50:34.276 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.DisableImageMirror_In_MirrorModeDisabled (113 ms) 2024-01-13T18:50:34.276 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.DisableImageMirrorWithPeer 2024-01-13T18:50:34.276 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:50:34.276 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.DisableImageMirrorWithPeer (0 ms) 2024-01-13T18:50:34.276 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.DisableJournalingWithPeer 2024-01-13T18:50:34.277 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:50:34.277 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.DisableJournalingWithPeer (0 ms) 2024-01-13T18:50:34.277 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling 2024-01-13T18:50:34.347 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeDisabled_WithoutJournaling (71 ms) 2024-01-13T18:50:34.348 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling 2024-01-13T18:50:34.419 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModePool_WithoutJournaling (72 ms) 2024-01-13T18:50:34.419 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling 2024-01-13T18:50:34.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:34 smithi099 ceph-mon[138788]: pgmap v2807: 137 pgs: 12 unknown, 125 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:50:34.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:34 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:50:34.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:34 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:50:34.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:34 smithi099 ceph-mon[138788]: osdmap e1571: 8 total, 8 up, 8 in 2024-01-13T18:50:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:34 smithi084 ceph-mon[116404]: pgmap v2807: 137 pgs: 12 unknown, 125 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:50:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:34 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:50:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:34 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:50:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:34 smithi084 ceph-mon[116404]: osdmap e1571: 8 total, 8 up, 8 in 2024-01-13T18:50:34.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:34 smithi084 ceph-mon[119097]: pgmap v2807: 137 pgs: 12 unknown, 125 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:50:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:34 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:50:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:34 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:50:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:34 smithi084 ceph-mon[119097]: osdmap e1571: 8 total, 8 up, 8 in 2024-01-13T18:50:35.657 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutJournaling (1238 ms) 2024-01-13T18:50:35.658 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock 2024-01-13T18:50:35.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:35 smithi099 ceph-mon[138788]: osdmap e1572: 8 total, 8 up, 8 in 2024-01-13T18:50:35.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:35 smithi084 ceph-mon[116404]: osdmap e1572: 8 total, 8 up, 8 in 2024-01-13T18:50:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:35 smithi084 ceph-mon[119097]: osdmap e1572: 8 total, 8 up, 8 in 2024-01-13T18:50:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:36.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:36 smithi099 ceph-mon[138788]: pgmap v2810: 137 pgs: 4 unknown, 133 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 78 KiB/s rd, 14 KiB/s wr, 115 op/s 2024-01-13T18:50:36.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:36 smithi099 ceph-mon[138788]: osdmap e1573: 8 total, 8 up, 8 in 2024-01-13T18:50:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:36 smithi084 ceph-mon[119097]: pgmap v2810: 137 pgs: 4 unknown, 133 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 78 KiB/s rd, 14 KiB/s wr, 115 op/s 2024-01-13T18:50:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:36 smithi084 ceph-mon[119097]: osdmap e1573: 8 total, 8 up, 8 in 2024-01-13T18:50:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:36 smithi084 ceph-mon[116404]: pgmap v2810: 137 pgs: 4 unknown, 133 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 78 KiB/s rd, 14 KiB/s wr, 115 op/s 2024-01-13T18:50:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:36 smithi084 ceph-mon[116404]: osdmap e1573: 8 total, 8 up, 8 in 2024-01-13T18:50:37.659 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.EnableImageMirror_In_MirrorModeImage_WithoutExclusiveLock (2001 ms) 2024-01-13T18:50:37.659 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeDisabled 2024-01-13T18:50:37.749 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeDisabled (90 ms) 2024-01-13T18:50:37.749 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage 2024-01-13T18:50:37.837 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage (88 ms) 2024-01-13T18:50:37.837 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool 2024-01-13T18:50:37.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:37 smithi099 ceph-mon[138788]: osdmap e1574: 8 total, 8 up, 8 in 2024-01-13T18:50:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:37 smithi084 ceph-mon[116404]: osdmap e1574: 8 total, 8 up, 8 in 2024-01-13T18:50:37.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:37 smithi084 ceph-mon[119097]: osdmap e1574: 8 total, 8 up, 8 in 2024-01-13T18:50:37.933 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool (96 ms) 2024-01-13T18:50:37.933 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling 2024-01-13T18:50:38.010 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModePool_WithoutJournaling (78 ms) 2024-01-13T18:50:38.011 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling 2024-01-13T18:50:38.087 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.CreateImage_In_MirrorModeImage_WithoutJournaling (77 ms) 2024-01-13T18:50:38.087 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeDisabled 2024-01-13T18:50:38.175 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeDisabled (88 ms) 2024-01-13T18:50:38.175 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage 2024-01-13T18:50:38.272 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage (97 ms) 2024-01-13T18:50:38.272 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled 2024-01-13T18:50:38.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:38 smithi099 ceph-mon[138788]: pgmap v2813: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 204 KiB/s rd, 31 KiB/s wr, 287 op/s 2024-01-13T18:50:38.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:38 smithi099 ceph-mon[138788]: osdmap e1575: 8 total, 8 up, 8 in 2024-01-13T18:50:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:38 smithi084 ceph-mon[119097]: pgmap v2813: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 204 KiB/s rd, 31 KiB/s wr, 287 op/s 2024-01-13T18:50:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:38 smithi084 ceph-mon[119097]: osdmap e1575: 8 total, 8 up, 8 in 2024-01-13T18:50:38.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:38 smithi084 ceph-mon[116404]: pgmap v2813: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 204 KiB/s rd, 31 KiB/s wr, 287 op/s 2024-01-13T18:50:38.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:38 smithi084 ceph-mon[116404]: osdmap e1575: 8 total, 8 up, 8 in 2024-01-13T18:50:39.690 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModeImage_SnapshotMirroringEnabled (1418 ms) 2024-01-13T18:50:39.690 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.EnableJournaling_In_MirrorModePool 2024-01-13T18:50:39.797 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.EnableJournaling_In_MirrorModePool (107 ms) 2024-01-13T18:50:39.797 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModePool 2024-01-13T18:50:39.902 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModePool (105 ms) 2024-01-13T18:50:39.902 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.DisableJournaling_In_MirrorModeImage 2024-01-13T18:50:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:39 smithi084 ceph-mon[116404]: osdmap e1576: 8 total, 8 up, 8 in 2024-01-13T18:50:39.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:39 smithi084 ceph-mon[119097]: osdmap e1576: 8 total, 8 up, 8 in 2024-01-13T18:50:39.998 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.DisableJournaling_In_MirrorModeImage (96 ms) 2024-01-13T18:50:39.998 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode 2024-01-13T18:50:40.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:39 smithi099 ceph-mon[138788]: osdmap e1576: 8 total, 8 up, 8 in 2024-01-13T18:50:40.150 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_PoolMode (152 ms) 2024-01-13T18:50:40.150 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode 2024-01-13T18:50:40.297 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_DisabledMode (147 ms) 2024-01-13T18:50:40.297 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode 2024-01-13T18:50:40.431 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.MirrorModeSet_DisabledMode_To_ImageMode (134 ms) 2024-01-13T18:50:40.431 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode 2024-01-13T18:50:40.567 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.MirrorModeSet_PoolMode_To_ImageMode (135 ms) 2024-01-13T18:50:40.567 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode 2024-01-13T18:50:40.626 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:50:40] "GET /metrics HTTP/1.1" 200 36517 "" "Prometheus/2.43.0" 2024-01-13T18:50:40.626 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:40 smithi084 ceph-mon[116404]: pgmap v2816: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 415 KiB/s rd, 49 KiB/s wr, 586 op/s 2024-01-13T18:50:40.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:40 smithi084 ceph-mon[116404]: osdmap e1577: 8 total, 8 up, 8 in 2024-01-13T18:50:40.717 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_PoolMode (151 ms) 2024-01-13T18:50:40.718 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode 2024-01-13T18:50:40.882 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.MirrorModeSet_ImageMode_To_DisabledMode (165 ms) 2024-01-13T18:50:40.883 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageEnabled 2024-01-13T18:50:40.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:40 smithi084 ceph-mon[119097]: pgmap v2816: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 415 KiB/s rd, 49 KiB/s wr, 586 op/s 2024-01-13T18:50:40.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:40 smithi084 ceph-mon[119097]: osdmap e1577: 8 total, 8 up, 8 in 2024-01-13T18:50:40.960 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageEnabled (78 ms) 2024-01-13T18:50:40.961 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDisabled 2024-01-13T18:50:41.036 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDisabled (76 ms) 2024-01-13T18:50:41.036 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.RemoveImage_With_ImageWithoutJournal 2024-01-13T18:50:41.101 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.RemoveImage_With_ImageWithoutJournal (65 ms) 2024-01-13T18:50:41.101 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.RemoveImage_With_MirrorImageDemoted 2024-01-13T18:50:41.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:40 smithi099 ceph-mon[138788]: pgmap v2816: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 415 KiB/s rd, 49 KiB/s wr, 586 op/s 2024-01-13T18:50:41.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:40 smithi099 ceph-mon[138788]: osdmap e1577: 8 total, 8 up, 8 in 2024-01-13T18:50:41.226 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.RemoveImage_With_MirrorImageDemoted (125 ms) 2024-01-13T18:50:41.226 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.TrashMoveRestore_PoolMode 2024-01-13T18:50:41.347 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.TrashMoveRestore_PoolMode (119 ms) 2024-01-13T18:50:41.347 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled 2024-01-13T18:50:41.448 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringDisabled (103 ms) 2024-01-13T18:50:41.448 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled 2024-01-13T18:50:41.560 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.TrashMoveRestore_ImageMode_MirroringEnabled (112 ms) 2024-01-13T18:50:41.560 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.MirrorStatusList 2024-01-13T18:50:41.632 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.MirrorStatusList (72 ms) 2024-01-13T18:50:41.633 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.RemoveBootstrapped 2024-01-13T18:50:41.725 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.RemoveBootstrapped (92 ms) 2024-01-13T18:50:41.725 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.AioPromoteDemote 2024-01-13T18:50:42.081 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.AioPromoteDemote (357 ms) 2024-01-13T18:50:42.081 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.AioGetInfo 2024-01-13T18:50:42.421 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.AioGetInfo (340 ms) 2024-01-13T18:50:42.421 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.AioGetStatus 2024-01-13T18:50:42.652 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.AioGetStatus (230 ms) 2024-01-13T18:50:42.652 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.SiteName 2024-01-13T18:50:42.662 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.SiteName (10 ms) 2024-01-13T18:50:42.662 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.Bootstrap 2024-01-13T18:50:42.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:42 smithi084 ceph-mon[119097]: pgmap v2818: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 499 KiB/s rd, 59 KiB/s wr, 719 op/s 2024-01-13T18:50:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:42 smithi084 ceph-mon[116404]: pgmap v2818: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 499 KiB/s rd, 59 KiB/s wr, 719 op/s 2024-01-13T18:50:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:42 smithi099 ceph-mon[138788]: pgmap v2818: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 499 KiB/s rd, 59 KiB/s wr, 719 op/s 2024-01-13T18:50:43.467 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.Bootstrap (806 ms) 2024-01-13T18:50:43.467 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.PeerDirection 2024-01-13T18:50:43.477 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.PeerDirection (10 ms) 2024-01-13T18:50:43.477 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.Snapshot 2024-01-13T18:50:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' 2024-01-13T18:50:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]': finished 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer_client_id"}]: dispatch 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]': finished 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e546ccfc-5939-4189-9821-a7c939a6ace8"}]: dispatch 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e546ccfc-5939-4189-9821-a7c939a6ace8"}]: dispatch 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e546ccfc-5939-4189-9821-a7c939a6ace8"}]': finished 2024-01-13T18:50:43.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[116404]: osdmap e1578: 8 total, 8 up, 8 in 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]': finished 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer_client_id"}]: dispatch 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]': finished 2024-01-13T18:50:43.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e546ccfc-5939-4189-9821-a7c939a6ace8"}]: dispatch 2024-01-13T18:50:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e546ccfc-5939-4189-9821-a7c939a6ace8"}]: dispatch 2024-01-13T18:50:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e546ccfc-5939-4189-9821-a7c939a6ace8"}]': finished 2024-01-13T18:50:43.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:43 smithi084 ceph-mon[119097]: osdmap e1578: 8 total, 8 up, 8 in 2024-01-13T18:50:44.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]': finished 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer_client_id"}]: dispatch 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]': finished 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T18:50:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e546ccfc-5939-4189-9821-a7c939a6ace8"}]: dispatch 2024-01-13T18:50:44.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e546ccfc-5939-4189-9821-a7c939a6ace8"}]: dispatch 2024-01-13T18:50:44.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e546ccfc-5939-4189-9821-a7c939a6ace8"}]': finished 2024-01-13T18:50:44.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:43 smithi099 ceph-mon[138788]: osdmap e1578: 8 total, 8 up, 8 in 2024-01-13T18:50:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:44 smithi084 ceph-mon[116404]: pgmap v2819: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 833 KiB/s rd, 109 KiB/s wr, 1.17k op/s 2024-01-13T18:50:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:44 smithi084 ceph-mon[116404]: osdmap e1579: 8 total, 8 up, 8 in 2024-01-13T18:50:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:44 smithi084 ceph-mon[119097]: pgmap v2819: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 833 KiB/s rd, 109 KiB/s wr, 1.17k op/s 2024-01-13T18:50:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:44 smithi084 ceph-mon[119097]: osdmap e1579: 8 total, 8 up, 8 in 2024-01-13T18:50:45.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:44 smithi099 ceph-mon[138788]: pgmap v2819: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 833 KiB/s rd, 109 KiB/s wr, 1.17k op/s 2024-01-13T18:50:45.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:44 smithi099 ceph-mon[138788]: osdmap e1579: 8 total, 8 up, 8 in 2024-01-13T18:50:46.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:46 smithi099 ceph-mon[138788]: pgmap v2822: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 159 KiB/s wr, 1.50k op/s 2024-01-13T18:50:46.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:46 smithi099 ceph-mon[138788]: osdmap e1580: 8 total, 8 up, 8 in 2024-01-13T18:50:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:46 smithi084 ceph-mon[116404]: pgmap v2822: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 159 KiB/s wr, 1.50k op/s 2024-01-13T18:50:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:46 smithi084 ceph-mon[116404]: osdmap e1580: 8 total, 8 up, 8 in 2024-01-13T18:50:46.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:46 smithi084 ceph-mon[119097]: pgmap v2822: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1.0 MiB/s rd, 159 KiB/s wr, 1.50k op/s 2024-01-13T18:50:46.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:46 smithi084 ceph-mon[119097]: osdmap e1580: 8 total, 8 up, 8 in 2024-01-13T18:50:47.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:47 smithi099 ceph-mon[138788]: osdmap e1581: 8 total, 8 up, 8 in 2024-01-13T18:50:47.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:47 smithi084 ceph-mon[116404]: osdmap e1581: 8 total, 8 up, 8 in 2024-01-13T18:50:47.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:47 smithi084 ceph-mon[119097]: osdmap e1581: 8 total, 8 up, 8 in 2024-01-13T18:50:48.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:48 smithi099 ceph-mon[138788]: pgmap v2825: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 972 KiB/s rd, 160 KiB/s wr, 1.37k op/s 2024-01-13T18:50:48.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:48 smithi099 ceph-mon[138788]: osdmap e1582: 8 total, 8 up, 8 in 2024-01-13T18:50:48.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:48 smithi099 ceph-mon[138788]: osdmap e1583: 8 total, 8 up, 8 in 2024-01-13T18:50:48.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:48 smithi084 ceph-mon[116404]: pgmap v2825: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 972 KiB/s rd, 160 KiB/s wr, 1.37k op/s 2024-01-13T18:50:48.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:48 smithi084 ceph-mon[116404]: osdmap e1582: 8 total, 8 up, 8 in 2024-01-13T18:50:48.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:48 smithi084 ceph-mon[116404]: osdmap e1583: 8 total, 8 up, 8 in 2024-01-13T18:50:48.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:48 smithi084 ceph-mon[119097]: pgmap v2825: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 972 KiB/s rd, 160 KiB/s wr, 1.37k op/s 2024-01-13T18:50:48.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:48 smithi084 ceph-mon[119097]: osdmap e1582: 8 total, 8 up, 8 in 2024-01-13T18:50:48.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:48 smithi084 ceph-mon[119097]: osdmap e1583: 8 total, 8 up, 8 in 2024-01-13T18:50:50.579 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:50:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:50:50] "GET /metrics HTTP/1.1" 200 36527 "" "Prometheus/2.43.0" 2024-01-13T18:50:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:50 smithi099 ceph-mon[138788]: pgmap v2828: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 781 KiB/s rd, 109 KiB/s wr, 1.03k op/s 2024-01-13T18:50:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:50 smithi099 ceph-mon[138788]: osdmap e1584: 8 total, 8 up, 8 in 2024-01-13T18:50:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:50 smithi084 ceph-mon[116404]: pgmap v2828: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 781 KiB/s rd, 109 KiB/s wr, 1.03k op/s 2024-01-13T18:50:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:50 smithi084 ceph-mon[116404]: osdmap e1584: 8 total, 8 up, 8 in 2024-01-13T18:50:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:50 smithi084 ceph-mon[119097]: pgmap v2828: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 781 KiB/s rd, 109 KiB/s wr, 1.03k op/s 2024-01-13T18:50:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:50 smithi084 ceph-mon[119097]: osdmap e1584: 8 total, 8 up, 8 in 2024-01-13T18:50:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:50:51.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:51 smithi099 ceph-mon[138788]: osdmap e1585: 8 total, 8 up, 8 in 2024-01-13T18:50:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:51 smithi084 ceph-mon[116404]: osdmap e1585: 8 total, 8 up, 8 in 2024-01-13T18:50:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:51 smithi084 ceph-mon[119097]: osdmap e1585: 8 total, 8 up, 8 in 2024-01-13T18:50:52.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:52 smithi099 ceph-mon[138788]: pgmap v2831: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 451 KiB/s rd, 57 KiB/s wr, 580 op/s 2024-01-13T18:50:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:52 smithi099 ceph-mon[138788]: osdmap e1586: 8 total, 8 up, 8 in 2024-01-13T18:50:52.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "102.17", "id": [6, 7]}]: dispatch 2024-01-13T18:50:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:52 smithi084 ceph-mon[116404]: pgmap v2831: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 451 KiB/s rd, 57 KiB/s wr, 580 op/s 2024-01-13T18:50:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:52 smithi084 ceph-mon[116404]: osdmap e1586: 8 total, 8 up, 8 in 2024-01-13T18:50:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "102.17", "id": [6, 7]}]: dispatch 2024-01-13T18:50:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:52 smithi084 ceph-mon[119097]: pgmap v2831: 137 pgs: 137 active+clean; 4.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 451 KiB/s rd, 57 KiB/s wr, 580 op/s 2024-01-13T18:50:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:52 smithi084 ceph-mon[119097]: osdmap e1586: 8 total, 8 up, 8 in 2024-01-13T18:50:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "102.17", "id": [6, 7]}]: dispatch 2024-01-13T18:50:53.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "102.17", "id": [6, 7]}]': finished 2024-01-13T18:50:53.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:53 smithi099 ceph-mon[138788]: osdmap e1587: 8 total, 8 up, 8 in 2024-01-13T18:50:53.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:53 smithi099 ceph-mon[138788]: osdmap e1588: 8 total, 8 up, 8 in 2024-01-13T18:50:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "102.17", "id": [6, 7]}]': finished 2024-01-13T18:50:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:53 smithi084 ceph-mon[116404]: osdmap e1587: 8 total, 8 up, 8 in 2024-01-13T18:50:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:53 smithi084 ceph-mon[116404]: osdmap e1588: 8 total, 8 up, 8 in 2024-01-13T18:50:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "102.17", "id": [6, 7]}]': finished 2024-01-13T18:50:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:53 smithi084 ceph-mon[119097]: osdmap e1587: 8 total, 8 up, 8 in 2024-01-13T18:50:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:53 smithi084 ceph-mon[119097]: osdmap e1588: 8 total, 8 up, 8 in 2024-01-13T18:50:54.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:54 smithi099 ceph-mon[138788]: pgmap v2834: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 67 KiB/s rd, 6.2 KiB/s wr, 88 op/s 2024-01-13T18:50:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:54 smithi084 ceph-mon[116404]: pgmap v2834: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 67 KiB/s rd, 6.2 KiB/s wr, 88 op/s 2024-01-13T18:50:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:54 smithi084 ceph-mon[119097]: pgmap v2834: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 67 KiB/s rd, 6.2 KiB/s wr, 88 op/s 2024-01-13T18:50:55.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:55 smithi084 ceph-mon[119097]: osdmap e1589: 8 total, 8 up, 8 in 2024-01-13T18:50:55.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:55 smithi084 ceph-mon[116404]: osdmap e1589: 8 total, 8 up, 8 in 2024-01-13T18:50:56.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:55 smithi099 ceph-mon[138788]: osdmap e1589: 8 total, 8 up, 8 in 2024-01-13T18:50:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:56 smithi084 ceph-mon[116404]: pgmap v2837: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 65 KiB/s rd, 6.0 KiB/s wr, 86 op/s 2024-01-13T18:50:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:56 smithi084 ceph-mon[116404]: osdmap e1590: 8 total, 8 up, 8 in 2024-01-13T18:50:56.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:56 smithi084 ceph-mon[119097]: pgmap v2837: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 65 KiB/s rd, 6.0 KiB/s wr, 86 op/s 2024-01-13T18:50:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:56 smithi084 ceph-mon[119097]: osdmap e1590: 8 total, 8 up, 8 in 2024-01-13T18:50:57.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:56 smithi099 ceph-mon[138788]: pgmap v2837: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 65 KiB/s rd, 6.0 KiB/s wr, 86 op/s 2024-01-13T18:50:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:56 smithi099 ceph-mon[138788]: osdmap e1590: 8 total, 8 up, 8 in 2024-01-13T18:50:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:57 smithi084 ceph-mon[116404]: osdmap e1591: 8 total, 8 up, 8 in 2024-01-13T18:50:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:57 smithi084 ceph-mon[119097]: osdmap e1591: 8 total, 8 up, 8 in 2024-01-13T18:50:58.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:57 smithi099 ceph-mon[138788]: osdmap e1591: 8 total, 8 up, 8 in 2024-01-13T18:50:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:58 smithi084 ceph-mon[116404]: pgmap v2840: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 49 KiB/s rd, 4.7 KiB/s wr, 65 op/s 2024-01-13T18:50:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:58 smithi084 ceph-mon[116404]: osdmap e1592: 8 total, 8 up, 8 in 2024-01-13T18:50:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:50:58 smithi084 ceph-mon[116404]: osdmap e1593: 8 total, 8 up, 8 in 2024-01-13T18:50:58.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:58 smithi084 ceph-mon[119097]: pgmap v2840: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 49 KiB/s rd, 4.7 KiB/s wr, 65 op/s 2024-01-13T18:50:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:58 smithi084 ceph-mon[119097]: osdmap e1592: 8 total, 8 up, 8 in 2024-01-13T18:50:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:50:58 smithi084 ceph-mon[119097]: osdmap e1593: 8 total, 8 up, 8 in 2024-01-13T18:50:59.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:58 smithi099 ceph-mon[138788]: pgmap v2840: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 49 KiB/s rd, 4.7 KiB/s wr, 65 op/s 2024-01-13T18:50:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:58 smithi099 ceph-mon[138788]: osdmap e1592: 8 total, 8 up, 8 in 2024-01-13T18:50:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:50:58 smithi099 ceph-mon[138788]: osdmap e1593: 8 total, 8 up, 8 in 2024-01-13T18:50:59.664 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.Snapshot (16186 ms) 2024-01-13T18:50:59.664 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.SnapshotRemoveOnDisable 2024-01-13T18:51:00.568 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:51:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:51:00] "GET /metrics HTTP/1.1" 200 36527 "" "Prometheus/2.43.0" 2024-01-13T18:51:00.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:00 smithi099 ceph-mon[138788]: pgmap v2843: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 53 KiB/s rd, 4.7 KiB/s wr, 73 op/s; 3 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:51:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:00 smithi099 ceph-mon[138788]: osdmap e1594: 8 total, 8 up, 8 in 2024-01-13T18:51:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:00 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e877f013-c8a3-44a6-9ebc-cf96010fdf20"}]: dispatch 2024-01-13T18:51:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:00 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e877f013-c8a3-44a6-9ebc-cf96010fdf20"}]: dispatch 2024-01-13T18:51:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:00 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e877f013-c8a3-44a6-9ebc-cf96010fdf20"}]': finished 2024-01-13T18:51:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:00 smithi084 ceph-mon[116404]: pgmap v2843: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 53 KiB/s rd, 4.7 KiB/s wr, 73 op/s; 3 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:51:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:00 smithi084 ceph-mon[116404]: osdmap e1594: 8 total, 8 up, 8 in 2024-01-13T18:51:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:00 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e877f013-c8a3-44a6-9ebc-cf96010fdf20"}]: dispatch 2024-01-13T18:51:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:00 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e877f013-c8a3-44a6-9ebc-cf96010fdf20"}]: dispatch 2024-01-13T18:51:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:00 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e877f013-c8a3-44a6-9ebc-cf96010fdf20"}]': finished 2024-01-13T18:51:00.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:00 smithi084 ceph-mon[119097]: pgmap v2843: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 53 KiB/s rd, 4.7 KiB/s wr, 73 op/s; 3 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:51:00.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:00 smithi084 ceph-mon[119097]: osdmap e1594: 8 total, 8 up, 8 in 2024-01-13T18:51:00.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:00 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e877f013-c8a3-44a6-9ebc-cf96010fdf20"}]: dispatch 2024-01-13T18:51:00.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:00 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e877f013-c8a3-44a6-9ebc-cf96010fdf20"}]: dispatch 2024-01-13T18:51:00.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:00 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/e877f013-c8a3-44a6-9ebc-cf96010fdf20"}]': finished 2024-01-13T18:51:01.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:01 smithi084 ceph-mon[116404]: osdmap e1595: 8 total, 8 up, 8 in 2024-01-13T18:51:01.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:01 smithi084 ceph-mon[119097]: osdmap e1595: 8 total, 8 up, 8 in 2024-01-13T18:51:02.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:01 smithi099 ceph-mon[138788]: osdmap e1595: 8 total, 8 up, 8 in 2024-01-13T18:51:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:02 smithi084 ceph-mon[116404]: pgmap v2846: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s; 3 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:51:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:02 smithi084 ceph-mon[116404]: osdmap e1596: 8 total, 8 up, 8 in 2024-01-13T18:51:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:02 smithi084 ceph-mon[119097]: pgmap v2846: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s; 3 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:51:02.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:02 smithi084 ceph-mon[119097]: osdmap e1596: 8 total, 8 up, 8 in 2024-01-13T18:51:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:02 smithi099 ceph-mon[138788]: pgmap v2846: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s; 3 B/s, 1 keys/s, 1 objects/s recovering 2024-01-13T18:51:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:02 smithi099 ceph-mon[138788]: osdmap e1596: 8 total, 8 up, 8 in 2024-01-13T18:51:03.648 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.SnapshotRemoveOnDisable (3985 ms) 2024-01-13T18:51:03.648 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.SnapshotUnlinkPeer 2024-01-13T18:51:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:03 smithi099 ceph-mon[138788]: osdmap e1597: 8 total, 8 up, 8 in 2024-01-13T18:51:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:03 smithi099 ceph-mon[138788]: osdmap e1598: 8 total, 8 up, 8 in 2024-01-13T18:51:04.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:03 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/54df82c7-d516-4fbb-8048-5b070b92c338"}]: dispatch 2024-01-13T18:51:04.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:03 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/54df82c7-d516-4fbb-8048-5b070b92c338"}]: dispatch 2024-01-13T18:51:04.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:03 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/54df82c7-d516-4fbb-8048-5b070b92c338"}]': finished 2024-01-13T18:51:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:03 smithi084 ceph-mon[116404]: osdmap e1597: 8 total, 8 up, 8 in 2024-01-13T18:51:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:03 smithi084 ceph-mon[116404]: osdmap e1598: 8 total, 8 up, 8 in 2024-01-13T18:51:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:03 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/54df82c7-d516-4fbb-8048-5b070b92c338"}]: dispatch 2024-01-13T18:51:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:03 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/54df82c7-d516-4fbb-8048-5b070b92c338"}]: dispatch 2024-01-13T18:51:04.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:03 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/54df82c7-d516-4fbb-8048-5b070b92c338"}]': finished 2024-01-13T18:51:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:03 smithi084 ceph-mon[119097]: osdmap e1597: 8 total, 8 up, 8 in 2024-01-13T18:51:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:03 smithi084 ceph-mon[119097]: osdmap e1598: 8 total, 8 up, 8 in 2024-01-13T18:51:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:03 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/54df82c7-d516-4fbb-8048-5b070b92c338"}]: dispatch 2024-01-13T18:51:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:03 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/54df82c7-d516-4fbb-8048-5b070b92c338"}]: dispatch 2024-01-13T18:51:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:03 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/54df82c7-d516-4fbb-8048-5b070b92c338"}]': finished 2024-01-13T18:51:05.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:04 smithi099 ceph-mon[138788]: pgmap v2849: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 78 KiB/s rd, 7.2 KiB/s wr, 108 op/s 2024-01-13T18:51:05.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:04 smithi084 ceph-mon[116404]: pgmap v2849: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 78 KiB/s rd, 7.2 KiB/s wr, 108 op/s 2024-01-13T18:51:05.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:04 smithi084 ceph-mon[119097]: pgmap v2849: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 78 KiB/s rd, 7.2 KiB/s wr, 108 op/s 2024-01-13T18:51:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:05 smithi099 ceph-mon[138788]: osdmap e1599: 8 total, 8 up, 8 in 2024-01-13T18:51:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:06.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:05 smithi084 ceph-mon[119097]: osdmap e1599: 8 total, 8 up, 8 in 2024-01-13T18:51:06.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:05 smithi084 ceph-mon[116404]: osdmap e1599: 8 total, 8 up, 8 in 2024-01-13T18:51:06.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:06 smithi099 ceph-mon[138788]: pgmap v2852: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 87 KiB/s rd, 10 KiB/s wr, 120 op/s 2024-01-13T18:51:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:06 smithi099 ceph-mon[138788]: osdmap e1600: 8 total, 8 up, 8 in 2024-01-13T18:51:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:06 smithi084 ceph-mon[116404]: pgmap v2852: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 87 KiB/s rd, 10 KiB/s wr, 120 op/s 2024-01-13T18:51:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:06 smithi084 ceph-mon[116404]: osdmap e1600: 8 total, 8 up, 8 in 2024-01-13T18:51:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:06 smithi084 ceph-mon[119097]: pgmap v2852: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 87 KiB/s rd, 10 KiB/s wr, 120 op/s 2024-01-13T18:51:07.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:06 smithi084 ceph-mon[119097]: osdmap e1600: 8 total, 8 up, 8 in 2024-01-13T18:51:08.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:07 smithi099 ceph-mon[138788]: osdmap e1601: 8 total, 8 up, 8 in 2024-01-13T18:51:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:07 smithi084 ceph-mon[116404]: osdmap e1601: 8 total, 8 up, 8 in 2024-01-13T18:51:08.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:07 smithi084 ceph-mon[119097]: osdmap e1601: 8 total, 8 up, 8 in 2024-01-13T18:51:09.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:08 smithi099 ceph-mon[138788]: pgmap v2855: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 4.5 KiB/s wr, 25 op/s 2024-01-13T18:51:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:08 smithi099 ceph-mon[138788]: osdmap e1602: 8 total, 8 up, 8 in 2024-01-13T18:51:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:08 smithi099 ceph-mon[138788]: osdmap e1603: 8 total, 8 up, 8 in 2024-01-13T18:51:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:08 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/799737ab-63e9-4c40-a30f-d5fc1cd65293"}]: dispatch 2024-01-13T18:51:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:08 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/799737ab-63e9-4c40-a30f-d5fc1cd65293"}]: dispatch 2024-01-13T18:51:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:08 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/799737ab-63e9-4c40-a30f-d5fc1cd65293"}]': finished 2024-01-13T18:51:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[116404]: pgmap v2855: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 4.5 KiB/s wr, 25 op/s 2024-01-13T18:51:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[116404]: osdmap e1602: 8 total, 8 up, 8 in 2024-01-13T18:51:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[116404]: osdmap e1603: 8 total, 8 up, 8 in 2024-01-13T18:51:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/799737ab-63e9-4c40-a30f-d5fc1cd65293"}]: dispatch 2024-01-13T18:51:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/799737ab-63e9-4c40-a30f-d5fc1cd65293"}]: dispatch 2024-01-13T18:51:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/799737ab-63e9-4c40-a30f-d5fc1cd65293"}]': finished 2024-01-13T18:51:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[119097]: pgmap v2855: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 4.5 KiB/s wr, 25 op/s 2024-01-13T18:51:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[119097]: osdmap e1602: 8 total, 8 up, 8 in 2024-01-13T18:51:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[119097]: osdmap e1603: 8 total, 8 up, 8 in 2024-01-13T18:51:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/799737ab-63e9-4c40-a30f-d5fc1cd65293"}]: dispatch 2024-01-13T18:51:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/799737ab-63e9-4c40-a30f-d5fc1cd65293"}]: dispatch 2024-01-13T18:51:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:08 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/799737ab-63e9-4c40-a30f-d5fc1cd65293"}]': finished 2024-01-13T18:51:10.582 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:51:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:51:10] "GET /metrics HTTP/1.1" 200 36531 "" "Prometheus/2.43.0" 2024-01-13T18:51:10.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:10 smithi099 ceph-mon[138788]: pgmap v2858: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 145 KiB/s rd, 11 KiB/s wr, 194 op/s 2024-01-13T18:51:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:10 smithi099 ceph-mon[138788]: osdmap e1604: 8 total, 8 up, 8 in 2024-01-13T18:51:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:10 smithi084 ceph-mon[119097]: pgmap v2858: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 145 KiB/s rd, 11 KiB/s wr, 194 op/s 2024-01-13T18:51:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:10 smithi084 ceph-mon[119097]: osdmap e1604: 8 total, 8 up, 8 in 2024-01-13T18:51:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:10 smithi084 ceph-mon[116404]: pgmap v2858: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 145 KiB/s rd, 11 KiB/s wr, 194 op/s 2024-01-13T18:51:10.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:10 smithi084 ceph-mon[116404]: osdmap e1604: 8 total, 8 up, 8 in 2024-01-13T18:51:11.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:11 smithi099 ceph-mon[138788]: osdmap e1605: 8 total, 8 up, 8 in 2024-01-13T18:51:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:11 smithi084 ceph-mon[116404]: osdmap e1605: 8 total, 8 up, 8 in 2024-01-13T18:51:11.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:11 smithi084 ceph-mon[119097]: osdmap e1605: 8 total, 8 up, 8 in 2024-01-13T18:51:12.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:12 smithi099 ceph-mon[138788]: pgmap v2861: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 144 KiB/s rd, 10 KiB/s wr, 190 op/s 2024-01-13T18:51:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:12 smithi099 ceph-mon[138788]: osdmap e1606: 8 total, 8 up, 8 in 2024-01-13T18:51:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:12 smithi084 ceph-mon[116404]: pgmap v2861: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 144 KiB/s rd, 10 KiB/s wr, 190 op/s 2024-01-13T18:51:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:12 smithi084 ceph-mon[116404]: osdmap e1606: 8 total, 8 up, 8 in 2024-01-13T18:51:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:12 smithi084 ceph-mon[119097]: pgmap v2861: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 144 KiB/s rd, 10 KiB/s wr, 190 op/s 2024-01-13T18:51:12.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:12 smithi084 ceph-mon[119097]: osdmap e1606: 8 total, 8 up, 8 in 2024-01-13T18:51:13.649 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.SnapshotUnlinkPeer (10001 ms) 2024-01-13T18:51:13.649 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.SnapshotImageState 2024-01-13T18:51:13.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:13 smithi099 ceph-mon[138788]: osdmap e1607: 8 total, 8 up, 8 in 2024-01-13T18:51:13.923 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:13 smithi099 ceph-mon[138788]: osdmap e1608: 8 total, 8 up, 8 in 2024-01-13T18:51:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:13 smithi084 ceph-mon[116404]: osdmap e1607: 8 total, 8 up, 8 in 2024-01-13T18:51:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:13 smithi084 ceph-mon[116404]: osdmap e1608: 8 total, 8 up, 8 in 2024-01-13T18:51:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:13 smithi084 ceph-mon[119097]: osdmap e1607: 8 total, 8 up, 8 in 2024-01-13T18:51:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:13 smithi084 ceph-mon[119097]: osdmap e1608: 8 total, 8 up, 8 in 2024-01-13T18:51:14.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:14 smithi099 ceph-mon[138788]: pgmap v2864: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 104 KiB/s rd, 7.5 KiB/s wr, 139 op/s 2024-01-13T18:51:14.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:14 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/3f8ec351-c3bb-44c0-8603-b3a2b8f41a82"}]: dispatch 2024-01-13T18:51:14.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:14 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/3f8ec351-c3bb-44c0-8603-b3a2b8f41a82"}]: dispatch 2024-01-13T18:51:14.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:14 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/3f8ec351-c3bb-44c0-8603-b3a2b8f41a82"}]': finished 2024-01-13T18:51:14.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:14 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/a53e37c4-cb54-4f0f-89fe-a74c40b5c985"}]: dispatch 2024-01-13T18:51:14.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:14 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/a53e37c4-cb54-4f0f-89fe-a74c40b5c985"}]: dispatch 2024-01-13T18:51:14.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:14 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/a53e37c4-cb54-4f0f-89fe-a74c40b5c985"}]': finished 2024-01-13T18:51:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[116404]: pgmap v2864: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 104 KiB/s rd, 7.5 KiB/s wr, 139 op/s 2024-01-13T18:51:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/3f8ec351-c3bb-44c0-8603-b3a2b8f41a82"}]: dispatch 2024-01-13T18:51:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/3f8ec351-c3bb-44c0-8603-b3a2b8f41a82"}]: dispatch 2024-01-13T18:51:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/3f8ec351-c3bb-44c0-8603-b3a2b8f41a82"}]': finished 2024-01-13T18:51:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/a53e37c4-cb54-4f0f-89fe-a74c40b5c985"}]: dispatch 2024-01-13T18:51:14.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/a53e37c4-cb54-4f0f-89fe-a74c40b5c985"}]: dispatch 2024-01-13T18:51:14.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/a53e37c4-cb54-4f0f-89fe-a74c40b5c985"}]': finished 2024-01-13T18:51:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[119097]: pgmap v2864: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 104 KiB/s rd, 7.5 KiB/s wr, 139 op/s 2024-01-13T18:51:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/3f8ec351-c3bb-44c0-8603-b3a2b8f41a82"}]: dispatch 2024-01-13T18:51:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/3f8ec351-c3bb-44c0-8603-b3a2b8f41a82"}]: dispatch 2024-01-13T18:51:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/3f8ec351-c3bb-44c0-8603-b3a2b8f41a82"}]': finished 2024-01-13T18:51:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/a53e37c4-cb54-4f0f-89fe-a74c40b5c985"}]: dispatch 2024-01-13T18:51:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/a53e37c4-cb54-4f0f-89fe-a74c40b5c985"}]: dispatch 2024-01-13T18:51:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:14 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/a53e37c4-cb54-4f0f-89fe-a74c40b5c985"}]': finished 2024-01-13T18:51:15.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:15 smithi084 ceph-mon[116404]: osdmap e1609: 8 total, 8 up, 8 in 2024-01-13T18:51:15.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:15 smithi084 ceph-mon[119097]: osdmap e1609: 8 total, 8 up, 8 in 2024-01-13T18:51:16.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:15 smithi099 ceph-mon[138788]: osdmap e1609: 8 total, 8 up, 8 in 2024-01-13T18:51:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:16 smithi084 ceph-mon[119097]: pgmap v2867: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 139 KiB/s rd, 10 KiB/s wr, 192 op/s 2024-01-13T18:51:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:16 smithi084 ceph-mon[119097]: osdmap e1610: 8 total, 8 up, 8 in 2024-01-13T18:51:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:16 smithi084 ceph-mon[116404]: pgmap v2867: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 139 KiB/s rd, 10 KiB/s wr, 192 op/s 2024-01-13T18:51:16.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:16 smithi084 ceph-mon[116404]: osdmap e1610: 8 total, 8 up, 8 in 2024-01-13T18:51:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:16 smithi099 ceph-mon[138788]: pgmap v2867: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 139 KiB/s rd, 10 KiB/s wr, 192 op/s 2024-01-13T18:51:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:16 smithi099 ceph-mon[138788]: osdmap e1610: 8 total, 8 up, 8 in 2024-01-13T18:51:17.722 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.SnapshotImageState (4072 ms) 2024-01-13T18:51:17.722 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.SnapshotPromoteDemote 2024-01-13T18:51:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:17 smithi084 ceph-mon[116404]: osdmap e1611: 8 total, 8 up, 8 in 2024-01-13T18:51:17.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:17 smithi084 ceph-mon[119097]: osdmap e1611: 8 total, 8 up, 8 in 2024-01-13T18:51:18.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:17 smithi099 ceph-mon[138788]: osdmap e1611: 8 total, 8 up, 8 in 2024-01-13T18:51:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:18 smithi084 ceph-mon[116404]: pgmap v2870: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 46 KiB/s rd, 9.2 KiB/s wr, 76 op/s 2024-01-13T18:51:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:18 smithi084 ceph-mon[116404]: osdmap e1612: 8 total, 8 up, 8 in 2024-01-13T18:51:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:18 smithi084 ceph-mon[116404]: osdmap e1613: 8 total, 8 up, 8 in 2024-01-13T18:51:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:18 smithi084 ceph-mon[119097]: pgmap v2870: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 46 KiB/s rd, 9.2 KiB/s wr, 76 op/s 2024-01-13T18:51:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:18 smithi084 ceph-mon[119097]: osdmap e1612: 8 total, 8 up, 8 in 2024-01-13T18:51:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:18 smithi084 ceph-mon[119097]: osdmap e1613: 8 total, 8 up, 8 in 2024-01-13T18:51:19.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:18 smithi099 ceph-mon[138788]: pgmap v2870: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 46 KiB/s rd, 9.2 KiB/s wr, 76 op/s 2024-01-13T18:51:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:18 smithi099 ceph-mon[138788]: osdmap e1612: 8 total, 8 up, 8 in 2024-01-13T18:51:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:18 smithi099 ceph-mon[138788]: osdmap e1613: 8 total, 8 up, 8 in 2024-01-13T18:51:20.579 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:51:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:51:20] "GET /metrics HTTP/1.1" 200 36532 "" "Prometheus/2.43.0" 2024-01-13T18:51:20.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:20 smithi099 ceph-mon[138788]: pgmap v2873: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 138 KiB/s rd, 20 KiB/s wr, 196 op/s 2024-01-13T18:51:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:20 smithi099 ceph-mon[138788]: osdmap e1614: 8 total, 8 up, 8 in 2024-01-13T18:51:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:20 smithi084 ceph-mon[116404]: pgmap v2873: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 138 KiB/s rd, 20 KiB/s wr, 196 op/s 2024-01-13T18:51:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:20 smithi084 ceph-mon[116404]: osdmap e1614: 8 total, 8 up, 8 in 2024-01-13T18:51:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:20 smithi084 ceph-mon[119097]: pgmap v2873: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 138 KiB/s rd, 20 KiB/s wr, 196 op/s 2024-01-13T18:51:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:20 smithi084 ceph-mon[119097]: osdmap e1614: 8 total, 8 up, 8 in 2024-01-13T18:51:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:21.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:21 smithi099 ceph-mon[138788]: osdmap e1615: 8 total, 8 up, 8 in 2024-01-13T18:51:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:21 smithi084 ceph-mon[116404]: osdmap e1615: 8 total, 8 up, 8 in 2024-01-13T18:51:21.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:21 smithi084 ceph-mon[119097]: osdmap e1615: 8 total, 8 up, 8 in 2024-01-13T18:51:22.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:22 smithi099 ceph-mon[138788]: pgmap v2876: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 173 KiB/s rd, 19 KiB/s wr, 234 op/s 2024-01-13T18:51:22.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:22 smithi099 ceph-mon[138788]: osdmap e1616: 8 total, 8 up, 8 in 2024-01-13T18:51:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:22 smithi084 ceph-mon[116404]: pgmap v2876: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 173 KiB/s rd, 19 KiB/s wr, 234 op/s 2024-01-13T18:51:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:22 smithi084 ceph-mon[116404]: osdmap e1616: 8 total, 8 up, 8 in 2024-01-13T18:51:22.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:22 smithi084 ceph-mon[119097]: pgmap v2876: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 173 KiB/s rd, 19 KiB/s wr, 234 op/s 2024-01-13T18:51:22.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:22 smithi084 ceph-mon[119097]: osdmap e1616: 8 total, 8 up, 8 in 2024-01-13T18:51:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:23 smithi099 ceph-mon[138788]: osdmap e1617: 8 total, 8 up, 8 in 2024-01-13T18:51:23.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:23 smithi099 ceph-mon[138788]: osdmap e1618: 8 total, 8 up, 8 in 2024-01-13T18:51:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:23 smithi084 ceph-mon[116404]: osdmap e1617: 8 total, 8 up, 8 in 2024-01-13T18:51:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:23 smithi084 ceph-mon[116404]: osdmap e1618: 8 total, 8 up, 8 in 2024-01-13T18:51:23.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:23 smithi084 ceph-mon[119097]: osdmap e1617: 8 total, 8 up, 8 in 2024-01-13T18:51:23.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:23 smithi084 ceph-mon[119097]: osdmap e1618: 8 total, 8 up, 8 in 2024-01-13T18:51:24.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:24 smithi099 ceph-mon[138788]: pgmap v2879: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 63 KiB/s rd, 7.0 KiB/s wr, 87 op/s 2024-01-13T18:51:24.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:24 smithi099 ceph-mon[138788]: osdmap e1619: 8 total, 8 up, 8 in 2024-01-13T18:51:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:24 smithi084 ceph-mon[116404]: pgmap v2879: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 63 KiB/s rd, 7.0 KiB/s wr, 87 op/s 2024-01-13T18:51:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:24 smithi084 ceph-mon[116404]: osdmap e1619: 8 total, 8 up, 8 in 2024-01-13T18:51:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:24 smithi084 ceph-mon[119097]: pgmap v2879: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 63 KiB/s rd, 7.0 KiB/s wr, 87 op/s 2024-01-13T18:51:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:24 smithi084 ceph-mon[119097]: osdmap e1619: 8 total, 8 up, 8 in 2024-01-13T18:51:26.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:26 smithi099 ceph-mon[138788]: pgmap v2882: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 4.2 KiB/s wr, 35 op/s 2024-01-13T18:51:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:26 smithi099 ceph-mon[138788]: osdmap e1620: 8 total, 8 up, 8 in 2024-01-13T18:51:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:51:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:51:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:51:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:26 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:51:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[116404]: pgmap v2882: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 4.2 KiB/s wr, 35 op/s 2024-01-13T18:51:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[116404]: osdmap e1620: 8 total, 8 up, 8 in 2024-01-13T18:51:26.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:51:26.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:51:26.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:51:26.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:51:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[119097]: pgmap v2882: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 4.2 KiB/s wr, 35 op/s 2024-01-13T18:51:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[119097]: osdmap e1620: 8 total, 8 up, 8 in 2024-01-13T18:51:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:51:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:51:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:51:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:26 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:51:27.660 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.SnapshotPromoteDemote (9939 ms) 2024-01-13T18:51:27.660 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroring.AioSnapshotCreate 2024-01-13T18:51:27.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:27 smithi099 ceph-mon[138788]: osdmap e1621: 8 total, 8 up, 8 in 2024-01-13T18:51:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:27 smithi084 ceph-mon[116404]: osdmap e1621: 8 total, 8 up, 8 in 2024-01-13T18:51:27.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:27 smithi084 ceph-mon[119097]: osdmap e1621: 8 total, 8 up, 8 in 2024-01-13T18:51:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:28 smithi099 ceph-mon[138788]: pgmap v2885: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 7.5 KiB/s wr, 119 op/s 2024-01-13T18:51:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:28 smithi099 ceph-mon[138788]: osdmap e1622: 8 total, 8 up, 8 in 2024-01-13T18:51:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:28 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/40944857-ab03-4bd9-a951-5c83bb35b468"}]: dispatch 2024-01-13T18:51:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:28 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/40944857-ab03-4bd9-a951-5c83bb35b468"}]: dispatch 2024-01-13T18:51:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:28 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/40944857-ab03-4bd9-a951-5c83bb35b468"}]': finished 2024-01-13T18:51:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:28 smithi099 ceph-mon[138788]: osdmap e1623: 8 total, 8 up, 8 in 2024-01-13T18:51:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[116404]: pgmap v2885: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 7.5 KiB/s wr, 119 op/s 2024-01-13T18:51:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[116404]: osdmap e1622: 8 total, 8 up, 8 in 2024-01-13T18:51:28.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/40944857-ab03-4bd9-a951-5c83bb35b468"}]: dispatch 2024-01-13T18:51:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/40944857-ab03-4bd9-a951-5c83bb35b468"}]: dispatch 2024-01-13T18:51:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/40944857-ab03-4bd9-a951-5c83bb35b468"}]': finished 2024-01-13T18:51:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[116404]: osdmap e1623: 8 total, 8 up, 8 in 2024-01-13T18:51:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[119097]: pgmap v2885: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 7.5 KiB/s wr, 119 op/s 2024-01-13T18:51:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[119097]: osdmap e1622: 8 total, 8 up, 8 in 2024-01-13T18:51:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/40944857-ab03-4bd9-a951-5c83bb35b468"}]: dispatch 2024-01-13T18:51:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/40944857-ab03-4bd9-a951-5c83bb35b468"}]: dispatch 2024-01-13T18:51:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/40944857-ab03-4bd9-a951-5c83bb35b468"}]': finished 2024-01-13T18:51:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:28 smithi084 ceph-mon[119097]: osdmap e1623: 8 total, 8 up, 8 in 2024-01-13T18:51:30.600 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:51:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:51:30] "GET /metrics HTTP/1.1" 200 36532 "" "Prometheus/2.43.0" 2024-01-13T18:51:30.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:30 smithi099 ceph-mon[138788]: pgmap v2888: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 6.5 KiB/s wr, 120 op/s 2024-01-13T18:51:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:30 smithi099 ceph-mon[138788]: osdmap e1624: 8 total, 8 up, 8 in 2024-01-13T18:51:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:30 smithi084 ceph-mon[116404]: pgmap v2888: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 6.5 KiB/s wr, 120 op/s 2024-01-13T18:51:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:30 smithi084 ceph-mon[116404]: osdmap e1624: 8 total, 8 up, 8 in 2024-01-13T18:51:30.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:30 smithi084 ceph-mon[119097]: pgmap v2888: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 6.5 KiB/s wr, 120 op/s 2024-01-13T18:51:30.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:30 smithi084 ceph-mon[119097]: osdmap e1624: 8 total, 8 up, 8 in 2024-01-13T18:51:31.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:31 smithi099 ceph-mon[138788]: osdmap e1625: 8 total, 8 up, 8 in 2024-01-13T18:51:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:31 smithi084 ceph-mon[116404]: osdmap e1625: 8 total, 8 up, 8 in 2024-01-13T18:51:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:31 smithi084 ceph-mon[119097]: osdmap e1625: 8 total, 8 up, 8 in 2024-01-13T18:51:32.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:32 smithi099 ceph-mon[138788]: pgmap v2891: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 4.2 KiB/s wr, 33 op/s 2024-01-13T18:51:32.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:32 smithi099 ceph-mon[138788]: osdmap e1626: 8 total, 8 up, 8 in 2024-01-13T18:51:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:32 smithi084 ceph-mon[116404]: pgmap v2891: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 4.2 KiB/s wr, 33 op/s 2024-01-13T18:51:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:32 smithi084 ceph-mon[116404]: osdmap e1626: 8 total, 8 up, 8 in 2024-01-13T18:51:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:32 smithi084 ceph-mon[119097]: pgmap v2891: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 4.2 KiB/s wr, 33 op/s 2024-01-13T18:51:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:32 smithi084 ceph-mon[119097]: osdmap e1626: 8 total, 8 up, 8 in 2024-01-13T18:51:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:33 smithi084 ceph-mon[116404]: osdmap e1627: 8 total, 8 up, 8 in 2024-01-13T18:51:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:33 smithi084 ceph-mon[116404]: osdmap e1628: 8 total, 8 up, 8 in 2024-01-13T18:51:33.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:33 smithi084 ceph-mon[119097]: osdmap e1627: 8 total, 8 up, 8 in 2024-01-13T18:51:33.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:33 smithi084 ceph-mon[119097]: osdmap e1628: 8 total, 8 up, 8 in 2024-01-13T18:51:34.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:33 smithi099 ceph-mon[138788]: osdmap e1627: 8 total, 8 up, 8 in 2024-01-13T18:51:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:33 smithi099 ceph-mon[138788]: osdmap e1628: 8 total, 8 up, 8 in 2024-01-13T18:51:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:34 smithi084 ceph-mon[116404]: pgmap v2894: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 91 KiB/s rd, 14 KiB/s wr, 135 op/s 2024-01-13T18:51:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:34 smithi084 ceph-mon[116404]: osdmap e1629: 8 total, 8 up, 8 in 2024-01-13T18:51:34.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:34 smithi084 ceph-mon[119097]: pgmap v2894: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 91 KiB/s rd, 14 KiB/s wr, 135 op/s 2024-01-13T18:51:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:34 smithi084 ceph-mon[119097]: osdmap e1629: 8 total, 8 up, 8 in 2024-01-13T18:51:35.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:34 smithi099 ceph-mon[138788]: pgmap v2894: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 91 KiB/s rd, 14 KiB/s wr, 135 op/s 2024-01-13T18:51:35.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:34 smithi099 ceph-mon[138788]: osdmap e1629: 8 total, 8 up, 8 in 2024-01-13T18:51:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:35 smithi084 ceph-mon[116404]: osdmap e1630: 8 total, 8 up, 8 in 2024-01-13T18:51:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:35 smithi084 ceph-mon[119097]: osdmap e1630: 8 total, 8 up, 8 in 2024-01-13T18:51:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:35 smithi099 ceph-mon[138788]: osdmap e1630: 8 total, 8 up, 8 in 2024-01-13T18:51:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:36 smithi084 ceph-mon[116404]: pgmap v2897: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 85 KiB/s rd, 14 KiB/s wr, 128 op/s 2024-01-13T18:51:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:36 smithi084 ceph-mon[116404]: osdmap e1631: 8 total, 8 up, 8 in 2024-01-13T18:51:36.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:36 smithi084 ceph-mon[119097]: pgmap v2897: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 85 KiB/s rd, 14 KiB/s wr, 128 op/s 2024-01-13T18:51:36.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:36 smithi084 ceph-mon[119097]: osdmap e1631: 8 total, 8 up, 8 in 2024-01-13T18:51:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:36 smithi099 ceph-mon[138788]: pgmap v2897: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 85 KiB/s rd, 14 KiB/s wr, 128 op/s 2024-01-13T18:51:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:36 smithi099 ceph-mon[138788]: osdmap e1631: 8 total, 8 up, 8 in 2024-01-13T18:51:38.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:38 smithi099 ceph-mon[138788]: pgmap v2900: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 38 KiB/s rd, 7.2 KiB/s wr, 56 op/s 2024-01-13T18:51:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:38 smithi099 ceph-mon[138788]: osdmap e1632: 8 total, 8 up, 8 in 2024-01-13T18:51:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:38 smithi099 ceph-mon[138788]: osdmap e1633: 8 total, 8 up, 8 in 2024-01-13T18:51:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:38 smithi084 ceph-mon[116404]: pgmap v2900: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 38 KiB/s rd, 7.2 KiB/s wr, 56 op/s 2024-01-13T18:51:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:38 smithi084 ceph-mon[116404]: osdmap e1632: 8 total, 8 up, 8 in 2024-01-13T18:51:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:38 smithi084 ceph-mon[116404]: osdmap e1633: 8 total, 8 up, 8 in 2024-01-13T18:51:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:38 smithi084 ceph-mon[119097]: pgmap v2900: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 38 KiB/s rd, 7.2 KiB/s wr, 56 op/s 2024-01-13T18:51:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:38 smithi084 ceph-mon[119097]: osdmap e1632: 8 total, 8 up, 8 in 2024-01-13T18:51:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:38 smithi084 ceph-mon[119097]: osdmap e1633: 8 total, 8 up, 8 in 2024-01-13T18:51:40.582 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:51:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:51:40] "GET /metrics HTTP/1.1" 200 36535 "" "Prometheus/2.43.0" 2024-01-13T18:51:40.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:40 smithi099 ceph-mon[138788]: pgmap v2903: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 83 KiB/s rd, 12 KiB/s wr, 114 op/s 2024-01-13T18:51:40.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:40 smithi099 ceph-mon[138788]: osdmap e1634: 8 total, 8 up, 8 in 2024-01-13T18:51:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:40 smithi084 ceph-mon[116404]: pgmap v2903: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 83 KiB/s rd, 12 KiB/s wr, 114 op/s 2024-01-13T18:51:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:40 smithi084 ceph-mon[116404]: osdmap e1634: 8 total, 8 up, 8 in 2024-01-13T18:51:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:40 smithi084 ceph-mon[119097]: pgmap v2903: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 83 KiB/s rd, 12 KiB/s wr, 114 op/s 2024-01-13T18:51:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:40 smithi084 ceph-mon[119097]: osdmap e1634: 8 total, 8 up, 8 in 2024-01-13T18:51:41.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:41 smithi099 ceph-mon[138788]: osdmap e1635: 8 total, 8 up, 8 in 2024-01-13T18:51:41.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:41 smithi084 ceph-mon[119097]: osdmap e1635: 8 total, 8 up, 8 in 2024-01-13T18:51:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:41 smithi084 ceph-mon[116404]: osdmap e1635: 8 total, 8 up, 8 in 2024-01-13T18:51:42.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:42 smithi099 ceph-mon[138788]: pgmap v2906: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 14 KiB/s wr, 122 op/s 2024-01-13T18:51:42.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:42 smithi099 ceph-mon[138788]: osdmap e1636: 8 total, 8 up, 8 in 2024-01-13T18:51:42.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:42 smithi084 ceph-mon[119097]: pgmap v2906: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 14 KiB/s wr, 122 op/s 2024-01-13T18:51:42.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:42 smithi084 ceph-mon[119097]: osdmap e1636: 8 total, 8 up, 8 in 2024-01-13T18:51:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:42 smithi084 ceph-mon[116404]: pgmap v2906: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 14 KiB/s wr, 122 op/s 2024-01-13T18:51:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:42 smithi084 ceph-mon[116404]: osdmap e1636: 8 total, 8 up, 8 in 2024-01-13T18:51:43.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:43 smithi099 ceph-mon[138788]: osdmap e1637: 8 total, 8 up, 8 in 2024-01-13T18:51:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:43 smithi084 ceph-mon[116404]: osdmap e1637: 8 total, 8 up, 8 in 2024-01-13T18:51:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:43 smithi084 ceph-mon[119097]: osdmap e1637: 8 total, 8 up, 8 in 2024-01-13T18:51:44.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:44 smithi099 ceph-mon[138788]: pgmap v2909: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 161 KiB/s rd, 18 KiB/s wr, 218 op/s 2024-01-13T18:51:44.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:44 smithi099 ceph-mon[138788]: osdmap e1638: 8 total, 8 up, 8 in 2024-01-13T18:51:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:44 smithi084 ceph-mon[116404]: pgmap v2909: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 161 KiB/s rd, 18 KiB/s wr, 218 op/s 2024-01-13T18:51:44.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:44 smithi084 ceph-mon[116404]: osdmap e1638: 8 total, 8 up, 8 in 2024-01-13T18:51:44.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:44 smithi084 ceph-mon[119097]: pgmap v2909: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 161 KiB/s rd, 18 KiB/s wr, 218 op/s 2024-01-13T18:51:44.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:44 smithi084 ceph-mon[119097]: osdmap e1638: 8 total, 8 up, 8 in 2024-01-13T18:51:45.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:45 smithi084 ceph-mon[116404]: osdmap e1639: 8 total, 8 up, 8 in 2024-01-13T18:51:45.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:45 smithi084 ceph-mon[119097]: osdmap e1639: 8 total, 8 up, 8 in 2024-01-13T18:51:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:45 smithi099 ceph-mon[138788]: osdmap e1639: 8 total, 8 up, 8 in 2024-01-13T18:51:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:46 smithi084 ceph-mon[116404]: pgmap v2912: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 134 KiB/s rd, 14 KiB/s wr, 184 op/s 2024-01-13T18:51:46.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:46 smithi084 ceph-mon[116404]: osdmap e1640: 8 total, 8 up, 8 in 2024-01-13T18:51:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:46 smithi084 ceph-mon[119097]: pgmap v2912: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 134 KiB/s rd, 14 KiB/s wr, 184 op/s 2024-01-13T18:51:46.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:46 smithi084 ceph-mon[119097]: osdmap e1640: 8 total, 8 up, 8 in 2024-01-13T18:51:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:46 smithi099 ceph-mon[138788]: pgmap v2912: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 134 KiB/s rd, 14 KiB/s wr, 184 op/s 2024-01-13T18:51:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:46 smithi099 ceph-mon[138788]: osdmap e1640: 8 total, 8 up, 8 in 2024-01-13T18:51:47.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:47 smithi084 ceph-mon[116404]: osdmap e1641: 8 total, 8 up, 8 in 2024-01-13T18:51:47.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:47 smithi084 ceph-mon[119097]: osdmap e1641: 8 total, 8 up, 8 in 2024-01-13T18:51:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:47 smithi099 ceph-mon[138788]: osdmap e1641: 8 total, 8 up, 8 in 2024-01-13T18:51:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:48 smithi084 ceph-mon[116404]: pgmap v2915: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 5.5 KiB/s wr, 60 op/s 2024-01-13T18:51:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:48 smithi084 ceph-mon[116404]: osdmap e1642: 8 total, 8 up, 8 in 2024-01-13T18:51:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:48 smithi084 ceph-mon[116404]: osdmap e1643: 8 total, 8 up, 8 in 2024-01-13T18:51:48.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:48 smithi084 ceph-mon[119097]: pgmap v2915: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 5.5 KiB/s wr, 60 op/s 2024-01-13T18:51:48.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:48 smithi084 ceph-mon[119097]: osdmap e1642: 8 total, 8 up, 8 in 2024-01-13T18:51:48.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:48 smithi084 ceph-mon[119097]: osdmap e1643: 8 total, 8 up, 8 in 2024-01-13T18:51:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:48 smithi099 ceph-mon[138788]: pgmap v2915: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 40 KiB/s rd, 5.5 KiB/s wr, 60 op/s 2024-01-13T18:51:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:48 smithi099 ceph-mon[138788]: osdmap e1642: 8 total, 8 up, 8 in 2024-01-13T18:51:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:48 smithi099 ceph-mon[138788]: osdmap e1643: 8 total, 8 up, 8 in 2024-01-13T18:51:50.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:50 smithi084 ceph-mon[119097]: pgmap v2918: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 100 KiB/s rd, 7.2 KiB/s wr, 140 op/s 2024-01-13T18:51:50.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:50 smithi084 ceph-mon[119097]: osdmap e1644: 8 total, 8 up, 8 in 2024-01-13T18:51:50.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:50.658 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:51:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:51:50] "GET /metrics HTTP/1.1" 200 36536 "" "Prometheus/2.43.0" 2024-01-13T18:51:50.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:50 smithi084 ceph-mon[116404]: pgmap v2918: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 100 KiB/s rd, 7.2 KiB/s wr, 140 op/s 2024-01-13T18:51:50.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:50 smithi084 ceph-mon[116404]: osdmap e1644: 8 total, 8 up, 8 in 2024-01-13T18:51:50.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:51.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:50 smithi099 ceph-mon[138788]: pgmap v2918: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 100 KiB/s rd, 7.2 KiB/s wr, 140 op/s 2024-01-13T18:51:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:50 smithi099 ceph-mon[138788]: osdmap e1644: 8 total, 8 up, 8 in 2024-01-13T18:51:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:51:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:51 smithi084 ceph-mon[116404]: osdmap e1645: 8 total, 8 up, 8 in 2024-01-13T18:51:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:51 smithi084 ceph-mon[119097]: osdmap e1645: 8 total, 8 up, 8 in 2024-01-13T18:51:52.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:51 smithi099 ceph-mon[138788]: osdmap e1645: 8 total, 8 up, 8 in 2024-01-13T18:51:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:52 smithi084 ceph-mon[116404]: pgmap v2921: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 68 KiB/s rd, 4.2 KiB/s wr, 100 op/s 2024-01-13T18:51:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:52 smithi084 ceph-mon[116404]: osdmap e1646: 8 total, 8 up, 8 in 2024-01-13T18:51:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:52 smithi084 ceph-mon[119097]: pgmap v2921: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 68 KiB/s rd, 4.2 KiB/s wr, 100 op/s 2024-01-13T18:51:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:52 smithi084 ceph-mon[119097]: osdmap e1646: 8 total, 8 up, 8 in 2024-01-13T18:51:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:52 smithi099 ceph-mon[138788]: pgmap v2921: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 68 KiB/s rd, 4.2 KiB/s wr, 100 op/s 2024-01-13T18:51:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:52 smithi099 ceph-mon[138788]: osdmap e1646: 8 total, 8 up, 8 in 2024-01-13T18:51:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:53 smithi084 ceph-mon[116404]: osdmap e1647: 8 total, 8 up, 8 in 2024-01-13T18:51:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:53 smithi084 ceph-mon[116404]: osdmap e1648: 8 total, 8 up, 8 in 2024-01-13T18:51:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:53 smithi084 ceph-mon[119097]: osdmap e1647: 8 total, 8 up, 8 in 2024-01-13T18:51:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:53 smithi084 ceph-mon[119097]: osdmap e1648: 8 total, 8 up, 8 in 2024-01-13T18:51:54.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:53 smithi099 ceph-mon[138788]: osdmap e1647: 8 total, 8 up, 8 in 2024-01-13T18:51:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:53 smithi099 ceph-mon[138788]: osdmap e1648: 8 total, 8 up, 8 in 2024-01-13T18:51:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:54 smithi084 ceph-mon[119097]: pgmap v2924: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 64 KiB/s rd, 6.2 KiB/s wr, 96 op/s 2024-01-13T18:51:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:54 smithi084 ceph-mon[119097]: osdmap e1649: 8 total, 8 up, 8 in 2024-01-13T18:51:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:54 smithi084 ceph-mon[116404]: pgmap v2924: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 64 KiB/s rd, 6.2 KiB/s wr, 96 op/s 2024-01-13T18:51:54.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:54 smithi084 ceph-mon[116404]: osdmap e1649: 8 total, 8 up, 8 in 2024-01-13T18:51:55.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:54 smithi099 ceph-mon[138788]: pgmap v2924: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 64 KiB/s rd, 6.2 KiB/s wr, 96 op/s 2024-01-13T18:51:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:54 smithi099 ceph-mon[138788]: osdmap e1649: 8 total, 8 up, 8 in 2024-01-13T18:51:57.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:56 smithi099 ceph-mon[138788]: pgmap v2927: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 118 KiB/s rd, 9.5 KiB/s wr, 169 op/s 2024-01-13T18:51:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:56 smithi099 ceph-mon[138788]: osdmap e1650: 8 total, 8 up, 8 in 2024-01-13T18:51:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:56 smithi084 ceph-mon[116404]: pgmap v2927: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 118 KiB/s rd, 9.5 KiB/s wr, 169 op/s 2024-01-13T18:51:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:56 smithi084 ceph-mon[116404]: osdmap e1650: 8 total, 8 up, 8 in 2024-01-13T18:51:57.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:56 smithi084 ceph-mon[119097]: pgmap v2927: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 118 KiB/s rd, 9.5 KiB/s wr, 169 op/s 2024-01-13T18:51:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:56 smithi084 ceph-mon[119097]: osdmap e1650: 8 total, 8 up, 8 in 2024-01-13T18:51:58.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:57 smithi099 ceph-mon[138788]: osdmap e1651: 8 total, 8 up, 8 in 2024-01-13T18:51:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:57 smithi084 ceph-mon[116404]: osdmap e1651: 8 total, 8 up, 8 in 2024-01-13T18:51:58.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:57 smithi084 ceph-mon[119097]: osdmap e1651: 8 total, 8 up, 8 in 2024-01-13T18:51:58.642 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroring.AioSnapshotCreate (30981 ms) 2024-01-13T18:51:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:58 smithi099 ceph-mon[138788]: pgmap v2930: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 84 KiB/s rd, 8.0 KiB/s wr, 120 op/s 2024-01-13T18:51:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:58 smithi099 ceph-mon[138788]: osdmap e1652: 8 total, 8 up, 8 in 2024-01-13T18:51:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:58 smithi099 ceph-mon[138788]: osdmap e1653: 8 total, 8 up, 8 in 2024-01-13T18:51:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:58 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/172d99ef-208e-4161-ae31-97ff9844b0c7"}]: dispatch 2024-01-13T18:51:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:58 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/172d99ef-208e-4161-ae31-97ff9844b0c7"}]: dispatch 2024-01-13T18:51:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:51:58 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/172d99ef-208e-4161-ae31-97ff9844b0c7"}]': finished 2024-01-13T18:51:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[116404]: pgmap v2930: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 84 KiB/s rd, 8.0 KiB/s wr, 120 op/s 2024-01-13T18:51:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[116404]: osdmap e1652: 8 total, 8 up, 8 in 2024-01-13T18:51:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[116404]: osdmap e1653: 8 total, 8 up, 8 in 2024-01-13T18:51:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/172d99ef-208e-4161-ae31-97ff9844b0c7"}]: dispatch 2024-01-13T18:51:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/172d99ef-208e-4161-ae31-97ff9844b0c7"}]: dispatch 2024-01-13T18:51:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/172d99ef-208e-4161-ae31-97ff9844b0c7"}]': finished 2024-01-13T18:51:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[119097]: pgmap v2930: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 84 KiB/s rd, 8.0 KiB/s wr, 120 op/s 2024-01-13T18:51:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[119097]: osdmap e1652: 8 total, 8 up, 8 in 2024-01-13T18:51:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[119097]: osdmap e1653: 8 total, 8 up, 8 in 2024-01-13T18:51:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/544036146' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/172d99ef-208e-4161-ae31-97ff9844b0c7"}]: dispatch 2024-01-13T18:51:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/172d99ef-208e-4161-ae31-97ff9844b0c7"}]: dispatch 2024-01-13T18:51:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:51:58 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/102/172d99ef-208e-4161-ae31-97ff9844b0c7"}]': finished 2024-01-13T18:51:59.653 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 51 tests from TestMirroring (87054 ms total) 2024-01-13T18:51:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:51:59.653 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 31 tests from TestDeepCopy 2024-01-13T18:52:00.652 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:52:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:52:00] "GET /metrics HTTP/1.1" 200 36536 "" "Prometheus/2.43.0" 2024-01-13T18:52:00.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:00 smithi084 ceph-mon[116404]: pgmap v2933: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 48 KiB/s rd, 3.5 KiB/s wr, 71 op/s 2024-01-13T18:52:00.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:00 smithi084 ceph-mon[116404]: osdmap e1654: 8 total, 8 up, 8 in 2024-01-13T18:52:00.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:00 smithi084 ceph-mon[119097]: pgmap v2933: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 48 KiB/s rd, 3.5 KiB/s wr, 71 op/s 2024-01-13T18:52:00.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:00 smithi084 ceph-mon[119097]: osdmap e1654: 8 total, 8 up, 8 in 2024-01-13T18:52:01.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:00 smithi099 ceph-mon[138788]: pgmap v2933: 137 pgs: 137 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 48 KiB/s rd, 3.5 KiB/s wr, 71 op/s 2024-01-13T18:52:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:00 smithi099 ceph-mon[138788]: osdmap e1654: 8 total, 8 up, 8 in 2024-01-13T18:52:01.649 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Empty 2024-01-13T18:52:01.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:01 smithi084 ceph-mon[116404]: osdmap e1655: 8 total, 8 up, 8 in 2024-01-13T18:52:01.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:01 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1908170667' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:52:01.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:01 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1908170667' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:52:01.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:01 smithi084 ceph-mon[116404]: osdmap e1656: 8 total, 8 up, 8 in 2024-01-13T18:52:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:01 smithi084 ceph-mon[119097]: osdmap e1655: 8 total, 8 up, 8 in 2024-01-13T18:52:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:01 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1908170667' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:52:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:01 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1908170667' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:52:01.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:01 smithi084 ceph-mon[119097]: osdmap e1656: 8 total, 8 up, 8 in 2024-01-13T18:52:02.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:01 smithi099 ceph-mon[138788]: osdmap e1655: 8 total, 8 up, 8 in 2024-01-13T18:52:02.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:01 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1908170667' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:52:02.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:01 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1908170667' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:52:02.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:01 smithi099 ceph-mon[138788]: osdmap e1656: 8 total, 8 up, 8 in 2024-01-13T18:52:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:02 smithi084 ceph-mon[116404]: pgmap v2936: 137 pgs: 32 unknown, 105 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:52:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:02 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:52:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:02 smithi084 ceph-mon[116404]: osdmap e1657: 8 total, 8 up, 8 in 2024-01-13T18:52:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:02 smithi084 ceph-mon[119097]: pgmap v2936: 137 pgs: 32 unknown, 105 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:52:02.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:02 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:52:02.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:02 smithi084 ceph-mon[119097]: osdmap e1657: 8 total, 8 up, 8 in 2024-01-13T18:52:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:02 smithi099 ceph-mon[138788]: pgmap v2936: 137 pgs: 32 unknown, 105 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:52:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:02 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:52:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:02 smithi099 ceph-mon[138788]: osdmap e1657: 8 total, 8 up, 8 in 2024-01-13T18:52:03.781 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Empty (2133 ms) 2024-01-13T18:52:03.781 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.NoSnaps 2024-01-13T18:52:04.029 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.NoSnaps (247 ms) 2024-01-13T18:52:04.029 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Snaps 2024-01-13T18:52:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:04 smithi084 ceph-mon[116404]: pgmap v2939: 137 pgs: 5 creating+peering, 13 unknown, 119 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:52:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:04 smithi084 ceph-mon[116404]: osdmap e1658: 8 total, 8 up, 8 in 2024-01-13T18:52:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:04 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:52:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:04 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:52:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:04 smithi084 ceph-mon[119097]: pgmap v2939: 137 pgs: 5 creating+peering, 13 unknown, 119 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:52:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:04 smithi084 ceph-mon[119097]: osdmap e1658: 8 total, 8 up, 8 in 2024-01-13T18:52:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:04 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:52:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:04 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:52:05.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:04 smithi099 ceph-mon[138788]: pgmap v2939: 137 pgs: 5 creating+peering, 13 unknown, 119 active+clean; 4.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:52:05.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:04 smithi099 ceph-mon[138788]: osdmap e1658: 8 total, 8 up, 8 in 2024-01-13T18:52:05.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:04 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:52:05.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:04 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:52:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:05 smithi099 ceph-mon[138788]: osdmap e1659: 8 total, 8 up, 8 in 2024-01-13T18:52:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:05 smithi084 ceph-mon[116404]: osdmap e1659: 8 total, 8 up, 8 in 2024-01-13T18:52:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:05 smithi084 ceph-mon[119097]: osdmap e1659: 8 total, 8 up, 8 in 2024-01-13T18:52:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:06 smithi099 ceph-mon[138788]: pgmap v2942: 137 pgs: 5 creating+peering, 132 active+clean; 25 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 5.0 MiB/s wr, 41 op/s 2024-01-13T18:52:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:06 smithi099 ceph-mon[138788]: osdmap e1660: 8 total, 8 up, 8 in 2024-01-13T18:52:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:06 smithi084 ceph-mon[116404]: pgmap v2942: 137 pgs: 5 creating+peering, 132 active+clean; 25 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 5.0 MiB/s wr, 41 op/s 2024-01-13T18:52:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:06 smithi084 ceph-mon[116404]: osdmap e1660: 8 total, 8 up, 8 in 2024-01-13T18:52:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:06 smithi084 ceph-mon[119097]: pgmap v2942: 137 pgs: 5 creating+peering, 132 active+clean; 25 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 5.0 MiB/s wr, 41 op/s 2024-01-13T18:52:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:06 smithi084 ceph-mon[119097]: osdmap e1660: 8 total, 8 up, 8 in 2024-01-13T18:52:08.041 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Snaps (4012 ms) 2024-01-13T18:52:08.041 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.SnapDiscard 2024-01-13T18:52:08.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:07 smithi099 ceph-mon[138788]: osdmap e1661: 8 total, 8 up, 8 in 2024-01-13T18:52:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:07 smithi084 ceph-mon[116404]: osdmap e1661: 8 total, 8 up, 8 in 2024-01-13T18:52:08.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:07 smithi084 ceph-mon[119097]: osdmap e1661: 8 total, 8 up, 8 in 2024-01-13T18:52:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:08 smithi099 ceph-mon[138788]: pgmap v2945: 137 pgs: 137 active+clean; 25 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 5.0 MiB/s wr, 78 op/s 2024-01-13T18:52:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:08 smithi099 ceph-mon[138788]: osdmap e1662: 8 total, 8 up, 8 in 2024-01-13T18:52:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:08 smithi084 ceph-mon[116404]: pgmap v2945: 137 pgs: 137 active+clean; 25 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 5.0 MiB/s wr, 78 op/s 2024-01-13T18:52:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:08 smithi084 ceph-mon[116404]: osdmap e1662: 8 total, 8 up, 8 in 2024-01-13T18:52:09.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:08 smithi084 ceph-mon[119097]: pgmap v2945: 137 pgs: 137 active+clean; 25 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 8.0 MiB/s rd, 5.0 MiB/s wr, 78 op/s 2024-01-13T18:52:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:08 smithi084 ceph-mon[119097]: osdmap e1662: 8 total, 8 up, 8 in 2024-01-13T18:52:09.839 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.SnapDiscard (1799 ms) 2024-01-13T18:52:09.840 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.CloneDiscard 2024-01-13T18:52:10.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:09 smithi099 ceph-mon[138788]: osdmap e1663: 8 total, 8 up, 8 in 2024-01-13T18:52:10.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:09 smithi084 ceph-mon[116404]: osdmap e1663: 8 total, 8 up, 8 in 2024-01-13T18:52:10.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:09 smithi084 ceph-mon[119097]: osdmap e1663: 8 total, 8 up, 8 in 2024-01-13T18:52:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:52:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:52:10] "GET /metrics HTTP/1.1" 200 36540 "" "Prometheus/2.43.0" 2024-01-13T18:52:10.928 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.CloneDiscard (1089 ms) 2024-01-13T18:52:10.928 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.CloneShrink 2024-01-13T18:52:11.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:10 smithi099 ceph-mon[138788]: pgmap v2948: 137 pgs: 137 active+clean; 45 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 124 op/s 2024-01-13T18:52:11.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:10 smithi099 ceph-mon[138788]: osdmap e1664: 8 total, 8 up, 8 in 2024-01-13T18:52:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:10 smithi084 ceph-mon[116404]: pgmap v2948: 137 pgs: 137 active+clean; 45 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 124 op/s 2024-01-13T18:52:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:10 smithi084 ceph-mon[116404]: osdmap e1664: 8 total, 8 up, 8 in 2024-01-13T18:52:11.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:10 smithi084 ceph-mon[119097]: pgmap v2948: 137 pgs: 137 active+clean; 45 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 124 op/s 2024-01-13T18:52:11.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:10 smithi084 ceph-mon[119097]: osdmap e1664: 8 total, 8 up, 8 in 2024-01-13T18:52:11.909 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.CloneShrink (981 ms) 2024-01-13T18:52:11.909 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.CloneExpand 2024-01-13T18:52:12.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:11 smithi099 ceph-mon[138788]: osdmap e1665: 8 total, 8 up, 8 in 2024-01-13T18:52:12.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:11 smithi099 ceph-mon[138788]: pgmap v2951: 137 pgs: 137 active+clean; 57 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 16 MiB/s rd, 8.0 MiB/s wr, 148 op/s 2024-01-13T18:52:12.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:11 smithi084 ceph-mon[116404]: osdmap e1665: 8 total, 8 up, 8 in 2024-01-13T18:52:12.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:11 smithi084 ceph-mon[116404]: pgmap v2951: 137 pgs: 137 active+clean; 57 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 16 MiB/s rd, 8.0 MiB/s wr, 148 op/s 2024-01-13T18:52:12.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:11 smithi084 ceph-mon[119097]: osdmap e1665: 8 total, 8 up, 8 in 2024-01-13T18:52:12.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:11 smithi084 ceph-mon[119097]: pgmap v2951: 137 pgs: 137 active+clean; 57 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 16 MiB/s rd, 8.0 MiB/s wr, 148 op/s 2024-01-13T18:52:12.961 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.CloneExpand (1051 ms) 2024-01-13T18:52:12.961 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.CloneHideParent 2024-01-13T18:52:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:12 smithi099 ceph-mon[138788]: osdmap e1666: 8 total, 8 up, 8 in 2024-01-13T18:52:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:12 smithi084 ceph-mon[116404]: osdmap e1666: 8 total, 8 up, 8 in 2024-01-13T18:52:13.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:12 smithi084 ceph-mon[119097]: osdmap e1666: 8 total, 8 up, 8 in 2024-01-13T18:52:14.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:13 smithi099 ceph-mon[138788]: osdmap e1667: 8 total, 8 up, 8 in 2024-01-13T18:52:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:13 smithi099 ceph-mon[138788]: pgmap v2954: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 24 MiB/s rd, 6.0 MiB/s wr, 300 op/s 2024-01-13T18:52:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:13 smithi099 ceph-mon[138788]: osdmap e1668: 8 total, 8 up, 8 in 2024-01-13T18:52:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:13 smithi084 ceph-mon[116404]: osdmap e1667: 8 total, 8 up, 8 in 2024-01-13T18:52:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:13 smithi084 ceph-mon[116404]: pgmap v2954: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 24 MiB/s rd, 6.0 MiB/s wr, 300 op/s 2024-01-13T18:52:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:13 smithi084 ceph-mon[116404]: osdmap e1668: 8 total, 8 up, 8 in 2024-01-13T18:52:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:13 smithi084 ceph-mon[119097]: osdmap e1667: 8 total, 8 up, 8 in 2024-01-13T18:52:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:13 smithi084 ceph-mon[119097]: pgmap v2954: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 24 MiB/s rd, 6.0 MiB/s wr, 300 op/s 2024-01-13T18:52:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:13 smithi084 ceph-mon[119097]: osdmap e1668: 8 total, 8 up, 8 in 2024-01-13T18:52:15.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:15 smithi099 ceph-mon[138788]: osdmap e1669: 8 total, 8 up, 8 in 2024-01-13T18:52:15.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:15 smithi084 ceph-mon[116404]: osdmap e1669: 8 total, 8 up, 8 in 2024-01-13T18:52:15.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:15 smithi084 ceph-mon[119097]: osdmap e1669: 8 total, 8 up, 8 in 2024-01-13T18:52:16.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:16 smithi099 ceph-mon[138788]: pgmap v2957: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 3.0 MiB/s wr, 470 op/s 2024-01-13T18:52:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:16 smithi099 ceph-mon[138788]: osdmap e1670: 8 total, 8 up, 8 in 2024-01-13T18:52:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:16 smithi084 ceph-mon[116404]: pgmap v2957: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 3.0 MiB/s wr, 470 op/s 2024-01-13T18:52:16.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:16 smithi084 ceph-mon[116404]: osdmap e1670: 8 total, 8 up, 8 in 2024-01-13T18:52:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:16 smithi084 ceph-mon[119097]: pgmap v2957: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 3.0 MiB/s wr, 470 op/s 2024-01-13T18:52:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:16 smithi084 ceph-mon[119097]: osdmap e1670: 8 total, 8 up, 8 in 2024-01-13T18:52:17.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:17 smithi099 ceph-mon[138788]: osdmap e1671: 8 total, 8 up, 8 in 2024-01-13T18:52:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:17 smithi084 ceph-mon[116404]: osdmap e1671: 8 total, 8 up, 8 in 2024-01-13T18:52:17.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:17 smithi084 ceph-mon[119097]: osdmap e1671: 8 total, 8 up, 8 in 2024-01-13T18:52:18.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:18 smithi099 ceph-mon[138788]: pgmap v2960: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 191 KiB/s rd, 14 KiB/s wr, 261 op/s 2024-01-13T18:52:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:18 smithi099 ceph-mon[138788]: osdmap e1672: 8 total, 8 up, 8 in 2024-01-13T18:52:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:18 smithi084 ceph-mon[119097]: pgmap v2960: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 191 KiB/s rd, 14 KiB/s wr, 261 op/s 2024-01-13T18:52:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:18 smithi084 ceph-mon[119097]: osdmap e1672: 8 total, 8 up, 8 in 2024-01-13T18:52:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:18 smithi084 ceph-mon[116404]: pgmap v2960: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 191 KiB/s rd, 14 KiB/s wr, 261 op/s 2024-01-13T18:52:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:18 smithi084 ceph-mon[116404]: osdmap e1672: 8 total, 8 up, 8 in 2024-01-13T18:52:19.733 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.CloneHideParent (6772 ms) 2024-01-13T18:52:19.733 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Clone 2024-01-13T18:52:19.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:19 smithi084 ceph-mon[116404]: osdmap e1673: 8 total, 8 up, 8 in 2024-01-13T18:52:19.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:19 smithi084 ceph-mon[119097]: osdmap e1673: 8 total, 8 up, 8 in 2024-01-13T18:52:20.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:19 smithi099 ceph-mon[138788]: osdmap e1673: 8 total, 8 up, 8 in 2024-01-13T18:52:20.618 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:52:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:52:20] "GET /metrics HTTP/1.1" 200 36545 "" "Prometheus/2.43.0" 2024-01-13T18:52:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:20 smithi084 ceph-mon[116404]: pgmap v2963: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 173 KiB/s rd, 14 KiB/s wr, 234 op/s 2024-01-13T18:52:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:20 smithi084 ceph-mon[116404]: osdmap e1674: 8 total, 8 up, 8 in 2024-01-13T18:52:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:20.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:20 smithi084 ceph-mon[119097]: pgmap v2963: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 173 KiB/s rd, 14 KiB/s wr, 234 op/s 2024-01-13T18:52:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:20 smithi084 ceph-mon[119097]: osdmap e1674: 8 total, 8 up, 8 in 2024-01-13T18:52:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:20 smithi099 ceph-mon[138788]: pgmap v2963: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 173 KiB/s rd, 14 KiB/s wr, 234 op/s 2024-01-13T18:52:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:20 smithi099 ceph-mon[138788]: osdmap e1674: 8 total, 8 up, 8 in 2024-01-13T18:52:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:21 smithi084 ceph-mon[116404]: osdmap e1675: 8 total, 8 up, 8 in 2024-01-13T18:52:21.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:21 smithi084 ceph-mon[119097]: osdmap e1675: 8 total, 8 up, 8 in 2024-01-13T18:52:21.978 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Clone (2245 ms) 2024-01-13T18:52:21.978 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.CloneFlatten 2024-01-13T18:52:22.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:21 smithi099 ceph-mon[138788]: osdmap e1675: 8 total, 8 up, 8 in 2024-01-13T18:52:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:22 smithi084 ceph-mon[119097]: pgmap v2966: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 160 KiB/s rd, 13 KiB/s wr, 218 op/s 2024-01-13T18:52:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:22 smithi084 ceph-mon[119097]: osdmap e1676: 8 total, 8 up, 8 in 2024-01-13T18:52:22.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:22 smithi084 ceph-mon[116404]: pgmap v2966: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 160 KiB/s rd, 13 KiB/s wr, 218 op/s 2024-01-13T18:52:22.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:22 smithi084 ceph-mon[116404]: osdmap e1676: 8 total, 8 up, 8 in 2024-01-13T18:52:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:22 smithi099 ceph-mon[138788]: pgmap v2966: 137 pgs: 137 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 160 KiB/s rd, 13 KiB/s wr, 218 op/s 2024-01-13T18:52:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:22 smithi099 ceph-mon[138788]: osdmap e1676: 8 total, 8 up, 8 in 2024-01-13T18:52:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:23 smithi084 ceph-mon[116404]: osdmap e1677: 8 total, 8 up, 8 in 2024-01-13T18:52:23.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:23 smithi084 ceph-mon[119097]: osdmap e1677: 8 total, 8 up, 8 in 2024-01-13T18:52:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:23 smithi099 ceph-mon[138788]: osdmap e1677: 8 total, 8 up, 8 in 2024-01-13T18:52:24.123 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.CloneFlatten (2145 ms) 2024-01-13T18:52:24.123 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Stress 2024-01-13T18:52:24.146 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 80590671~2698149 2024-01-13T18:52:24.165 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 80590455~3119740 2024-01-13T18:52:24.167 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 56191276~6748366 2024-01-13T18:52:24.187 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 37695859~1825256 2024-01-13T18:52:24.187 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 61434319~4691807 2024-01-13T18:52:24.198 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 45562603~1461308 2024-01-13T18:52:24.199 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 50918763~1057350 2024-01-13T18:52:24.203 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 28962954~2712483 2024-01-13T18:52:24.203 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap0 2024-01-13T18:52:24.668 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 141499552 2024-01-13T18:52:24.675 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 110485224~3008606 2024-01-13T18:52:24.678 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 109149720~6169369 2024-01-13T18:52:24.694 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 44925440~5134741 2024-01-13T18:52:24.694 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 86309040~597436 2024-01-13T18:52:24.695 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 77060787~3157945 2024-01-13T18:52:24.695 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 25787146~4059178 2024-01-13T18:52:24.695 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 123097082~941112 2024-01-13T18:52:24.695 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 6034095~7236870 2024-01-13T18:52:24.725 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap1 2024-01-13T18:52:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:24 smithi084 ceph-mon[116404]: pgmap v2969: 137 pgs: 137 active+clean; 81 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 250 op/s 2024-01-13T18:52:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:24 smithi084 ceph-mon[116404]: osdmap e1678: 8 total, 8 up, 8 in 2024-01-13T18:52:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:24 smithi084 ceph-mon[119097]: pgmap v2969: 137 pgs: 137 active+clean; 81 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 250 op/s 2024-01-13T18:52:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:24 smithi084 ceph-mon[119097]: osdmap e1678: 8 total, 8 up, 8 in 2024-01-13T18:52:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:24 smithi099 ceph-mon[138788]: pgmap v2969: 137 pgs: 137 active+clean; 81 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 250 op/s 2024-01-13T18:52:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:24 smithi099 ceph-mon[138788]: osdmap e1678: 8 total, 8 up, 8 in 2024-01-13T18:52:25.682 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 7050971~7859352 2024-01-13T18:52:25.685 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 5505159~1011089 2024-01-13T18:52:25.687 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 30903261~4726264 2024-01-13T18:52:25.687 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 76208259~3242157 2024-01-13T18:52:25.691 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 79682072~7343136 2024-01-13T18:52:25.691 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 80976164~7106647 2024-01-13T18:52:25.743 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 61553685~5932504 2024-01-13T18:52:25.743 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 24276497~2019212 2024-01-13T18:52:25.759 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap2 2024-01-13T18:52:25.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:25 smithi084 ceph-mon[116404]: osdmap e1679: 8 total, 8 up, 8 in 2024-01-13T18:52:25.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:25 smithi084 ceph-mon[119097]: osdmap e1679: 8 total, 8 up, 8 in 2024-01-13T18:52:26.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:25 smithi099 ceph-mon[138788]: osdmap e1679: 8 total, 8 up, 8 in 2024-01-13T18:52:26.704 INFO:tasks.workunit.client.0.smithi084.stdout:clone image144 -> image145 2024-01-13T18:52:26.756 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 128097649 2024-01-13T18:52:26.767 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 62930867~5276586 2024-01-13T18:52:26.792 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 65405847~5426474 2024-01-13T18:52:26.793 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 97493240~354684 2024-01-13T18:52:26.797 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 67541810~4460661 2024-01-13T18:52:26.799 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 38141115~3259 2024-01-13T18:52:26.802 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 7877192~241983 2024-01-13T18:52:26.810 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 82170452~1576893 2024-01-13T18:52:26.828 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 122375410~5722239 2024-01-13T18:52:26.832 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap3 2024-01-13T18:52:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:26 smithi084 ceph-mon[116404]: pgmap v2972: 137 pgs: 137 active+clean; 137 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 19 MiB/s rd, 18 MiB/s wr, 375 op/s 2024-01-13T18:52:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:26 smithi084 ceph-mon[116404]: osdmap e1680: 8 total, 8 up, 8 in 2024-01-13T18:52:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:26 smithi084 ceph-mon[119097]: pgmap v2972: 137 pgs: 137 active+clean; 137 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 19 MiB/s rd, 18 MiB/s wr, 375 op/s 2024-01-13T18:52:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:26 smithi084 ceph-mon[119097]: osdmap e1680: 8 total, 8 up, 8 in 2024-01-13T18:52:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:26 smithi099 ceph-mon[138788]: pgmap v2972: 137 pgs: 137 active+clean; 137 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 19 MiB/s rd, 18 MiB/s wr, 375 op/s 2024-01-13T18:52:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:26 smithi099 ceph-mon[138788]: osdmap e1680: 8 total, 8 up, 8 in 2024-01-13T18:52:27.701 INFO:tasks.workunit.client.0.smithi084.stdout:clone image145 -> image146 2024-01-13T18:52:27.986 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Stress (3863 ms) 2024-01-13T18:52:27.986 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.NoSnaps_LargerDstObjSize 2024-01-13T18:52:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:27 smithi099 ceph-mon[138788]: osdmap e1681: 8 total, 8 up, 8 in 2024-01-13T18:52:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:52:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:52:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:52:28.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:52:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:27 smithi084 ceph-mon[116404]: osdmap e1681: 8 total, 8 up, 8 in 2024-01-13T18:52:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:52:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:52:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:52:28.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:52:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:27 smithi084 ceph-mon[119097]: osdmap e1681: 8 total, 8 up, 8 in 2024-01-13T18:52:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:52:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:52:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:52:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:52:28.224 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.NoSnaps_LargerDstObjSize (238 ms) 2024-01-13T18:52:28.224 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Snaps_LargerDstObjSize 2024-01-13T18:52:29.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:28 smithi099 ceph-mon[138788]: pgmap v2975: 137 pgs: 137 active+clean; 176 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 30 MiB/s rd, 26 MiB/s wr, 192 op/s 2024-01-13T18:52:29.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:28 smithi099 ceph-mon[138788]: osdmap e1682: 8 total, 8 up, 8 in 2024-01-13T18:52:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:28 smithi084 ceph-mon[116404]: pgmap v2975: 137 pgs: 137 active+clean; 176 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 30 MiB/s rd, 26 MiB/s wr, 192 op/s 2024-01-13T18:52:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:28 smithi084 ceph-mon[116404]: osdmap e1682: 8 total, 8 up, 8 in 2024-01-13T18:52:29.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:28 smithi084 ceph-mon[119097]: pgmap v2975: 137 pgs: 137 active+clean; 176 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 30 MiB/s rd, 26 MiB/s wr, 192 op/s 2024-01-13T18:52:29.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:28 smithi084 ceph-mon[119097]: osdmap e1682: 8 total, 8 up, 8 in 2024-01-13T18:52:30.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:29 smithi099 ceph-mon[138788]: osdmap e1683: 8 total, 8 up, 8 in 2024-01-13T18:52:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:29 smithi084 ceph-mon[116404]: osdmap e1683: 8 total, 8 up, 8 in 2024-01-13T18:52:30.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:29 smithi084 ceph-mon[119097]: osdmap e1683: 8 total, 8 up, 8 in 2024-01-13T18:52:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:52:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:52:30] "GET /metrics HTTP/1.1" 200 36545 "" "Prometheus/2.43.0" 2024-01-13T18:52:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:30 smithi099 ceph-mon[138788]: pgmap v2978: 137 pgs: 137 active+clean; 276 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 34 MiB/s rd, 33 MiB/s wr, 413 op/s 2024-01-13T18:52:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:30 smithi099 ceph-mon[138788]: osdmap e1684: 8 total, 8 up, 8 in 2024-01-13T18:52:31.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:30 smithi084 ceph-mon[119097]: pgmap v2978: 137 pgs: 137 active+clean; 276 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 34 MiB/s rd, 33 MiB/s wr, 413 op/s 2024-01-13T18:52:31.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:30 smithi084 ceph-mon[119097]: osdmap e1684: 8 total, 8 up, 8 in 2024-01-13T18:52:31.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:30 smithi084 ceph-mon[116404]: pgmap v2978: 137 pgs: 137 active+clean; 276 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 34 MiB/s rd, 33 MiB/s wr, 413 op/s 2024-01-13T18:52:31.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:30 smithi084 ceph-mon[116404]: osdmap e1684: 8 total, 8 up, 8 in 2024-01-13T18:52:32.030 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Snaps_LargerDstObjSize (3807 ms) 2024-01-13T18:52:32.031 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Clone_LargerDstObjSize 2024-01-13T18:52:32.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:31 smithi099 ceph-mon[138788]: osdmap e1685: 8 total, 8 up, 8 in 2024-01-13T18:52:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:31 smithi084 ceph-mon[116404]: osdmap e1685: 8 total, 8 up, 8 in 2024-01-13T18:52:32.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:31 smithi084 ceph-mon[119097]: osdmap e1685: 8 total, 8 up, 8 in 2024-01-13T18:52:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:32 smithi099 ceph-mon[138788]: pgmap v2981: 137 pgs: 137 active+clean; 292 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 26 MiB/s wr, 371 op/s 2024-01-13T18:52:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:32 smithi099 ceph-mon[138788]: osdmap e1686: 8 total, 8 up, 8 in 2024-01-13T18:52:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:32 smithi084 ceph-mon[116404]: pgmap v2981: 137 pgs: 137 active+clean; 292 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 26 MiB/s wr, 371 op/s 2024-01-13T18:52:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:32 smithi084 ceph-mon[116404]: osdmap e1686: 8 total, 8 up, 8 in 2024-01-13T18:52:33.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:32 smithi084 ceph-mon[119097]: pgmap v2981: 137 pgs: 137 active+clean; 292 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 26 MiB/s wr, 371 op/s 2024-01-13T18:52:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:32 smithi084 ceph-mon[119097]: osdmap e1686: 8 total, 8 up, 8 in 2024-01-13T18:52:34.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:33 smithi099 ceph-mon[138788]: osdmap e1687: 8 total, 8 up, 8 in 2024-01-13T18:52:34.123 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Clone_LargerDstObjSize (2093 ms) 2024-01-13T18:52:34.123 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.CloneFlatten_LargerDstObjSize 2024-01-13T18:52:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:33 smithi084 ceph-mon[116404]: osdmap e1687: 8 total, 8 up, 8 in 2024-01-13T18:52:34.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:33 smithi084 ceph-mon[119097]: osdmap e1687: 8 total, 8 up, 8 in 2024-01-13T18:52:35.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:34 smithi099 ceph-mon[138788]: pgmap v2984: 137 pgs: 137 active+clean; 348 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 40 MiB/s rd, 17 MiB/s wr, 321 op/s 2024-01-13T18:52:35.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:34 smithi099 ceph-mon[138788]: osdmap e1688: 8 total, 8 up, 8 in 2024-01-13T18:52:35.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:34 smithi084 ceph-mon[119097]: pgmap v2984: 137 pgs: 137 active+clean; 348 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 40 MiB/s rd, 17 MiB/s wr, 321 op/s 2024-01-13T18:52:35.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:34 smithi084 ceph-mon[119097]: osdmap e1688: 8 total, 8 up, 8 in 2024-01-13T18:52:35.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:34 smithi084 ceph-mon[116404]: pgmap v2984: 137 pgs: 137 active+clean; 348 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 40 MiB/s rd, 17 MiB/s wr, 321 op/s 2024-01-13T18:52:35.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:34 smithi084 ceph-mon[116404]: osdmap e1688: 8 total, 8 up, 8 in 2024-01-13T18:52:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:35 smithi099 ceph-mon[138788]: osdmap e1689: 8 total, 8 up, 8 in 2024-01-13T18:52:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:35 smithi099 ceph-mon[138788]: pgmap v2987: 137 pgs: 137 active+clean; 368 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 41 MiB/s rd, 18 MiB/s wr, 374 op/s 2024-01-13T18:52:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:36.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:35 smithi084 ceph-mon[116404]: osdmap e1689: 8 total, 8 up, 8 in 2024-01-13T18:52:36.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:35 smithi084 ceph-mon[116404]: pgmap v2987: 137 pgs: 137 active+clean; 368 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 41 MiB/s rd, 18 MiB/s wr, 374 op/s 2024-01-13T18:52:36.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:35 smithi084 ceph-mon[119097]: osdmap e1689: 8 total, 8 up, 8 in 2024-01-13T18:52:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:35 smithi084 ceph-mon[119097]: pgmap v2987: 137 pgs: 137 active+clean; 368 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 41 MiB/s rd, 18 MiB/s wr, 374 op/s 2024-01-13T18:52:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:36.321 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.CloneFlatten_LargerDstObjSize (2198 ms) 2024-01-13T18:52:36.321 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Stress_LargerDstObjSize 2024-01-13T18:52:36.344 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 70984876~5654537 2024-01-13T18:52:36.374 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 11587041~1970369 2024-01-13T18:52:36.375 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 3989581~5602658 2024-01-13T18:52:36.390 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 35447632~6911698 2024-01-13T18:52:36.391 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 76289091~2754927 2024-01-13T18:52:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 40993473~7169786 2024-01-13T18:52:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 61020984~6218094 2024-01-13T18:52:36.430 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 66093347~7793725 2024-01-13T18:52:36.433 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap0 2024-01-13T18:52:36.771 INFO:tasks.workunit.client.0.smithi084.stdout:clone image165 -> image166 2024-01-13T18:52:36.823 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 42421970~7376350 2024-01-13T18:52:36.847 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 45641932~765555 2024-01-13T18:52:36.848 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 21049709~2055823 2024-01-13T18:52:36.854 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 22594739~1032524 2024-01-13T18:52:36.856 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 11385416~4117088 2024-01-13T18:52:36.874 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 42829493~4432773 2024-01-13T18:52:36.875 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 1698702~3915621 2024-01-13T18:52:36.898 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 39440422~4762466 2024-01-13T18:52:36.901 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap1 2024-01-13T18:52:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:36 smithi099 ceph-mon[138788]: osdmap e1690: 8 total, 8 up, 8 in 2024-01-13T18:52:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:36 smithi084 ceph-mon[116404]: osdmap e1690: 8 total, 8 up, 8 in 2024-01-13T18:52:37.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:36 smithi084 ceph-mon[119097]: osdmap e1690: 8 total, 8 up, 8 in 2024-01-13T18:52:37.773 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 45363266~1486964 2024-01-13T18:52:37.776 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 62962147~3869716 2024-01-13T18:52:37.777 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 52982542~4211846 2024-01-13T18:52:37.777 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 18818548~3292324 2024-01-13T18:52:37.779 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 27863265~4951622 2024-01-13T18:52:37.779 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 45267444~1025815 2024-01-13T18:52:37.788 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 25179381~3221013 2024-01-13T18:52:37.801 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 37541000~3803334 2024-01-13T18:52:37.823 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap2 2024-01-13T18:52:38.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:37 smithi099 ceph-mon[138788]: osdmap e1691: 8 total, 8 up, 8 in 2024-01-13T18:52:38.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:37 smithi099 ceph-mon[138788]: pgmap v2990: 137 pgs: 137 active+clean; 411 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 14 MiB/s wr, 149 op/s 2024-01-13T18:52:38.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:37 smithi084 ceph-mon[119097]: osdmap e1691: 8 total, 8 up, 8 in 2024-01-13T18:52:38.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:37 smithi084 ceph-mon[119097]: pgmap v2990: 137 pgs: 137 active+clean; 411 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 14 MiB/s wr, 149 op/s 2024-01-13T18:52:38.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:37 smithi084 ceph-mon[116404]: osdmap e1691: 8 total, 8 up, 8 in 2024-01-13T18:52:38.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:37 smithi084 ceph-mon[116404]: pgmap v2990: 137 pgs: 137 active+clean; 411 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 14 MiB/s wr, 149 op/s 2024-01-13T18:52:38.785 INFO:tasks.workunit.client.0.smithi084.stdout:clone image166 -> image167 2024-01-13T18:52:38.852 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 13133582~8259062 2024-01-13T18:52:38.885 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 62707798~3288073 2024-01-13T18:52:38.909 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 7720846~7741782 2024-01-13T18:52:38.936 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 53600444~4873995 2024-01-13T18:52:38.946 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 34802285~1030941 2024-01-13T18:52:38.950 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 22705293~766178 2024-01-13T18:52:38.952 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 2253142~3224369 2024-01-13T18:52:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 7094085~959695 2024-01-13T18:52:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap3 2024-01-13T18:52:39.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:38 smithi099 ceph-mon[138788]: osdmap e1692: 8 total, 8 up, 8 in 2024-01-13T18:52:39.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:38 smithi084 ceph-mon[119097]: osdmap e1692: 8 total, 8 up, 8 in 2024-01-13T18:52:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:38 smithi084 ceph-mon[116404]: osdmap e1692: 8 total, 8 up, 8 in 2024-01-13T18:52:39.790 INFO:tasks.workunit.client.0.smithi084.stdout:clone image167 -> image168 2024-01-13T18:52:39.875 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 93631060 2024-01-13T18:52:40.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:39 smithi099 ceph-mon[138788]: osdmap e1693: 8 total, 8 up, 8 in 2024-01-13T18:52:40.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:39 smithi099 ceph-mon[138788]: pgmap v2993: 137 pgs: 137 active+clean; 513 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 41 MiB/s rd, 34 MiB/s wr, 546 op/s 2024-01-13T18:52:40.128 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Stress_LargerDstObjSize (3807 ms) 2024-01-13T18:52:40.128 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.NoSnaps_SmallerDstObjSize 2024-01-13T18:52:40.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:39 smithi084 ceph-mon[116404]: osdmap e1693: 8 total, 8 up, 8 in 2024-01-13T18:52:40.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:39 smithi084 ceph-mon[116404]: pgmap v2993: 137 pgs: 137 active+clean; 513 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 41 MiB/s rd, 34 MiB/s wr, 546 op/s 2024-01-13T18:52:40.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:39 smithi084 ceph-mon[119097]: osdmap e1693: 8 total, 8 up, 8 in 2024-01-13T18:52:40.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:39 smithi084 ceph-mon[119097]: pgmap v2993: 137 pgs: 137 active+clean; 513 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 41 MiB/s rd, 34 MiB/s wr, 546 op/s 2024-01-13T18:52:40.354 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.NoSnaps_SmallerDstObjSize (225 ms) 2024-01-13T18:52:40.354 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Snaps_SmallerDstObjSize 2024-01-13T18:52:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:52:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:52:40] "GET /metrics HTTP/1.1" 200 36547 "" "Prometheus/2.43.0" 2024-01-13T18:52:41.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:40 smithi099 ceph-mon[138788]: osdmap e1694: 8 total, 8 up, 8 in 2024-01-13T18:52:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:40 smithi084 ceph-mon[116404]: osdmap e1694: 8 total, 8 up, 8 in 2024-01-13T18:52:41.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:40 smithi084 ceph-mon[119097]: osdmap e1694: 8 total, 8 up, 8 in 2024-01-13T18:52:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:41 smithi099 ceph-mon[138788]: osdmap e1695: 8 total, 8 up, 8 in 2024-01-13T18:52:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:41 smithi099 ceph-mon[138788]: pgmap v2996: 137 pgs: 137 active+clean; 555 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 40 MiB/s rd, 33 MiB/s wr, 503 op/s 2024-01-13T18:52:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:41 smithi084 ceph-mon[116404]: osdmap e1695: 8 total, 8 up, 8 in 2024-01-13T18:52:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:41 smithi084 ceph-mon[116404]: pgmap v2996: 137 pgs: 137 active+clean; 555 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 40 MiB/s rd, 33 MiB/s wr, 503 op/s 2024-01-13T18:52:42.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:41 smithi084 ceph-mon[119097]: osdmap e1695: 8 total, 8 up, 8 in 2024-01-13T18:52:42.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:41 smithi084 ceph-mon[119097]: pgmap v2996: 137 pgs: 137 active+clean; 555 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 40 MiB/s rd, 33 MiB/s wr, 503 op/s 2024-01-13T18:52:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:42 smithi099 ceph-mon[138788]: osdmap e1696: 8 total, 8 up, 8 in 2024-01-13T18:52:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:42 smithi084 ceph-mon[116404]: osdmap e1696: 8 total, 8 up, 8 in 2024-01-13T18:52:43.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:42 smithi084 ceph-mon[119097]: osdmap e1696: 8 total, 8 up, 8 in 2024-01-13T18:52:44.068 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Snaps_SmallerDstObjSize (3715 ms) 2024-01-13T18:52:44.069 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Clone_SmallerDstObjSize 2024-01-13T18:52:44.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:43 smithi099 ceph-mon[138788]: osdmap e1697: 8 total, 8 up, 8 in 2024-01-13T18:52:44.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:43 smithi099 ceph-mon[138788]: pgmap v2999: 137 pgs: 137 active+clean; 623 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 32 MiB/s rd, 26 MiB/s wr, 416 op/s 2024-01-13T18:52:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:43 smithi084 ceph-mon[116404]: osdmap e1697: 8 total, 8 up, 8 in 2024-01-13T18:52:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:43 smithi084 ceph-mon[116404]: pgmap v2999: 137 pgs: 137 active+clean; 623 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 32 MiB/s rd, 26 MiB/s wr, 416 op/s 2024-01-13T18:52:44.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:43 smithi084 ceph-mon[119097]: osdmap e1697: 8 total, 8 up, 8 in 2024-01-13T18:52:44.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:43 smithi084 ceph-mon[119097]: pgmap v2999: 137 pgs: 137 active+clean; 623 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 32 MiB/s rd, 26 MiB/s wr, 416 op/s 2024-01-13T18:52:45.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:44 smithi099 ceph-mon[138788]: osdmap e1698: 8 total, 8 up, 8 in 2024-01-13T18:52:45.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:44 smithi084 ceph-mon[116404]: osdmap e1698: 8 total, 8 up, 8 in 2024-01-13T18:52:45.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:44 smithi084 ceph-mon[119097]: osdmap e1698: 8 total, 8 up, 8 in 2024-01-13T18:52:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:45 smithi099 ceph-mon[138788]: osdmap e1699: 8 total, 8 up, 8 in 2024-01-13T18:52:46.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:45 smithi099 ceph-mon[138788]: pgmap v3002: 137 pgs: 137 active+clean; 651 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 39 MiB/s rd, 23 MiB/s wr, 583 op/s 2024-01-13T18:52:46.149 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Clone_SmallerDstObjSize (2081 ms) 2024-01-13T18:52:46.149 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.CloneFlatten_SmallerDstObjSize 2024-01-13T18:52:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:45 smithi084 ceph-mon[116404]: osdmap e1699: 8 total, 8 up, 8 in 2024-01-13T18:52:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:45 smithi084 ceph-mon[116404]: pgmap v3002: 137 pgs: 137 active+clean; 651 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 39 MiB/s rd, 23 MiB/s wr, 583 op/s 2024-01-13T18:52:46.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:45 smithi084 ceph-mon[119097]: osdmap e1699: 8 total, 8 up, 8 in 2024-01-13T18:52:46.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:45 smithi084 ceph-mon[119097]: pgmap v3002: 137 pgs: 137 active+clean; 651 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 39 MiB/s rd, 23 MiB/s wr, 583 op/s 2024-01-13T18:52:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:46 smithi099 ceph-mon[138788]: osdmap e1700: 8 total, 8 up, 8 in 2024-01-13T18:52:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:46 smithi084 ceph-mon[116404]: osdmap e1700: 8 total, 8 up, 8 in 2024-01-13T18:52:47.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:46 smithi084 ceph-mon[119097]: osdmap e1700: 8 total, 8 up, 8 in 2024-01-13T18:52:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:47 smithi099 ceph-mon[138788]: osdmap e1701: 8 total, 8 up, 8 in 2024-01-13T18:52:48.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:47 smithi099 ceph-mon[138788]: pgmap v3005: 137 pgs: 137 active+clean; 674 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 37 MiB/s rd, 13 MiB/s wr, 341 op/s 2024-01-13T18:52:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:47 smithi084 ceph-mon[116404]: osdmap e1701: 8 total, 8 up, 8 in 2024-01-13T18:52:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:47 smithi084 ceph-mon[116404]: pgmap v3005: 137 pgs: 137 active+clean; 674 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 37 MiB/s rd, 13 MiB/s wr, 341 op/s 2024-01-13T18:52:48.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:47 smithi084 ceph-mon[119097]: osdmap e1701: 8 total, 8 up, 8 in 2024-01-13T18:52:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:47 smithi084 ceph-mon[119097]: pgmap v3005: 137 pgs: 137 active+clean; 674 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 37 MiB/s rd, 13 MiB/s wr, 341 op/s 2024-01-13T18:52:48.291 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.CloneFlatten_SmallerDstObjSize (2142 ms) 2024-01-13T18:52:48.291 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Stress_SmallerDstObjSize 2024-01-13T18:52:48.314 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 58570336~4096191 2024-01-13T18:52:48.331 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 7317204~1243790 2024-01-13T18:52:48.332 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 21824341~8252246 2024-01-13T18:52:48.356 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 20353304~2915165 2024-01-13T18:52:48.356 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 53117267~2517675 2024-01-13T18:52:48.361 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 72914612~8321062 2024-01-13T18:52:48.362 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 41228668~6773161 2024-01-13T18:52:48.388 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 36812980~5137987 2024-01-13T18:52:48.391 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap0 2024-01-13T18:52:48.841 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 20097819~4506402 2024-01-13T18:52:48.845 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 7730771~3708397 2024-01-13T18:52:48.846 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 63388348~5573745 2024-01-13T18:52:48.846 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 37234603~6436249 2024-01-13T18:52:48.846 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 58124269~1451026 2024-01-13T18:52:48.847 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 42218331~5078920 2024-01-13T18:52:48.878 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 786503~5712007 2024-01-13T18:52:48.878 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 32121622~125372 2024-01-13T18:52:48.902 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap1 2024-01-13T18:52:49.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:48 smithi099 ceph-mon[138788]: osdmap e1702: 8 total, 8 up, 8 in 2024-01-13T18:52:49.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:48 smithi084 ceph-mon[116404]: osdmap e1702: 8 total, 8 up, 8 in 2024-01-13T18:52:49.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:48 smithi084 ceph-mon[119097]: osdmap e1702: 8 total, 8 up, 8 in 2024-01-13T18:52:49.847 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 2630265~3614315 2024-01-13T18:52:49.851 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 14520598~3565098 2024-01-13T18:52:49.852 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 3497552~5415884 2024-01-13T18:52:49.864 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 70909301~3549130 2024-01-13T18:52:49.864 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 67407373~2783180 2024-01-13T18:52:49.864 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 5337605~7058985 2024-01-13T18:52:49.878 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 45119819~6467437 2024-01-13T18:52:49.878 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 68896090~269600 2024-01-13T18:52:49.906 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap2 2024-01-13T18:52:50.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:49 smithi099 ceph-mon[138788]: pgmap v3007: 137 pgs: 137 active+clean; 726 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 40 MiB/s rd, 19 MiB/s wr, 357 op/s 2024-01-13T18:52:50.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:49 smithi099 ceph-mon[138788]: osdmap e1703: 8 total, 8 up, 8 in 2024-01-13T18:52:50.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:49 smithi084 ceph-mon[116404]: pgmap v3007: 137 pgs: 137 active+clean; 726 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 40 MiB/s rd, 19 MiB/s wr, 357 op/s 2024-01-13T18:52:50.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:49 smithi084 ceph-mon[116404]: osdmap e1703: 8 total, 8 up, 8 in 2024-01-13T18:52:50.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:49 smithi084 ceph-mon[119097]: pgmap v3007: 137 pgs: 137 active+clean; 726 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 40 MiB/s rd, 19 MiB/s wr, 357 op/s 2024-01-13T18:52:50.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:49 smithi084 ceph-mon[119097]: osdmap e1703: 8 total, 8 up, 8 in 2024-01-13T18:52:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:52:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:52:50] "GET /metrics HTTP/1.1" 200 36552 "" "Prometheus/2.43.0" 2024-01-13T18:52:50.866 INFO:tasks.workunit.client.0.smithi084.stdout:clone image187 -> image188 2024-01-13T18:52:50.923 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 132284439 2024-01-13T18:52:50.930 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 100487300~566584 2024-01-13T18:52:50.937 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 72223876~7906345 2024-01-13T18:52:50.943 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 45602646~6213829 2024-01-13T18:52:50.968 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 119885747~5682604 2024-01-13T18:52:50.969 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 41670804~8307008 2024-01-13T18:52:50.993 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 5674210~6715432 2024-01-13T18:52:51.001 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 78354783~7864109 2024-01-13T18:52:51.025 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 114626328~3472508 2024-01-13T18:52:51.025 INFO:tasks.workunit.client.0.smithi084.stdout:snap: snap3 2024-01-13T18:52:51.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:50 smithi099 ceph-mon[138788]: osdmap e1704: 8 total, 8 up, 8 in 2024-01-13T18:52:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:51.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:50 smithi084 ceph-mon[119097]: osdmap e1704: 8 total, 8 up, 8 in 2024-01-13T18:52:51.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:50 smithi084 ceph-mon[116404]: osdmap e1704: 8 total, 8 up, 8 in 2024-01-13T18:52:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:52:51.866 INFO:tasks.workunit.client.0.smithi084.stdout:clone image188 -> image189 2024-01-13T18:52:52.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:51 smithi099 ceph-mon[138788]: pgmap v3010: 137 pgs: 137 active+clean; 792 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 26 MiB/s rd, 27 MiB/s wr, 345 op/s 2024-01-13T18:52:52.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:51 smithi099 ceph-mon[138788]: osdmap e1705: 8 total, 8 up, 8 in 2024-01-13T18:52:52.168 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Stress_SmallerDstObjSize (3876 ms) 2024-01-13T18:52:52.168 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.NoSnaps_StrippingLargerDstObjSize 2024-01-13T18:52:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:51 smithi084 ceph-mon[116404]: pgmap v3010: 137 pgs: 137 active+clean; 792 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 26 MiB/s rd, 27 MiB/s wr, 345 op/s 2024-01-13T18:52:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:51 smithi084 ceph-mon[116404]: osdmap e1705: 8 total, 8 up, 8 in 2024-01-13T18:52:52.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:51 smithi084 ceph-mon[119097]: pgmap v3010: 137 pgs: 137 active+clean; 792 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 26 MiB/s rd, 27 MiB/s wr, 345 op/s 2024-01-13T18:52:52.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:51 smithi084 ceph-mon[119097]: osdmap e1705: 8 total, 8 up, 8 in 2024-01-13T18:52:52.195 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:52:52.266 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.NoSnaps_StrippingLargerDstObjSize (99 ms) 2024-01-13T18:52:52.266 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Snaps_StrippingLargerDstObjSize 2024-01-13T18:52:52.289 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:52:52.359 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Snaps_StrippingLargerDstObjSize (92 ms) 2024-01-13T18:52:52.359 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Clone_StrippingLargerDstObjSize 2024-01-13T18:52:52.381 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:52:52.453 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Clone_StrippingLargerDstObjSize (93 ms) 2024-01-13T18:52:52.453 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.CloneFlatten_StrippingLargerDstObjSize 2024-01-13T18:52:52.474 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:52:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.CloneFlatten_StrippingLargerDstObjSize (94 ms) 2024-01-13T18:52:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Stress_StrippingLargerDstObjSize 2024-01-13T18:52:52.571 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:52:52.642 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Stress_StrippingLargerDstObjSize (96 ms) 2024-01-13T18:52:52.642 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.NoSnaps_StrippingSmallerDstObjSize 2024-01-13T18:52:52.663 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:52:52.736 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.NoSnaps_StrippingSmallerDstObjSize (94 ms) 2024-01-13T18:52:52.736 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Snaps_StrippingSmallerDstObjSize 2024-01-13T18:52:52.760 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:52:52.831 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Snaps_StrippingSmallerDstObjSize (94 ms) 2024-01-13T18:52:52.831 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Clone_StrippingSmallerDstObjSize 2024-01-13T18:52:52.853 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:52:52.928 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Clone_StrippingSmallerDstObjSize (98 ms) 2024-01-13T18:52:52.928 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.CloneFlatten_StrippingSmallerDstObjSize 2024-01-13T18:52:52.951 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:52:53.022 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.CloneFlatten_StrippingSmallerDstObjSize (94 ms) 2024-01-13T18:52:53.023 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestDeepCopy.Stress_StrippingSmallerDstObjSize 2024-01-13T18:52:53.045 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:52:53.116 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestDeepCopy.Stress_StrippingSmallerDstObjSize (93 ms) 2024-01-13T18:52:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:52 smithi099 ceph-mon[138788]: osdmap e1706: 8 total, 8 up, 8 in 2024-01-13T18:52:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:52 smithi084 ceph-mon[116404]: osdmap e1706: 8 total, 8 up, 8 in 2024-01-13T18:52:53.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:52 smithi084 ceph-mon[119097]: osdmap e1706: 8 total, 8 up, 8 in 2024-01-13T18:52:53.876 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 31 tests from TestDeepCopy (51467 ms total) 2024-01-13T18:52:53.876 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:52:53.876 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 6 tests from TestGroup 2024-01-13T18:52:54.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:54 smithi099 ceph-mon[138788]: pgmap v3013: 137 pgs: 137 active+clean; 883 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 31 MiB/s rd, 35 MiB/s wr, 775 op/s 2024-01-13T18:52:54.871 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:54 smithi099 ceph-mon[138788]: osdmap e1707: 8 total, 8 up, 8 in 2024-01-13T18:52:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:54 smithi084 ceph-mon[116404]: pgmap v3013: 137 pgs: 137 active+clean; 883 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 31 MiB/s rd, 35 MiB/s wr, 775 op/s 2024-01-13T18:52:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:54 smithi084 ceph-mon[116404]: osdmap e1707: 8 total, 8 up, 8 in 2024-01-13T18:52:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:54 smithi084 ceph-mon[119097]: pgmap v3013: 137 pgs: 137 active+clean; 883 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 31 MiB/s rd, 35 MiB/s wr, 775 op/s 2024-01-13T18:52:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:54 smithi084 ceph-mon[119097]: osdmap e1707: 8 total, 8 up, 8 in 2024-01-13T18:52:55.872 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestGroup.group_create 2024-01-13T18:52:56.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:55 smithi084 ceph-mon[119097]: pgmap v3015: 105 pgs: 105 active+clean; 4.6 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail 2024-01-13T18:52:56.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:55 smithi084 ceph-mon[119097]: osdmap e1708: 8 total, 8 up, 8 in 2024-01-13T18:52:56.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:55 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3005798467' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:52:56.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:55 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:52:56.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:55 smithi084 ceph-mon[116404]: pgmap v3015: 105 pgs: 105 active+clean; 4.6 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail 2024-01-13T18:52:56.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:55 smithi084 ceph-mon[116404]: osdmap e1708: 8 total, 8 up, 8 in 2024-01-13T18:52:56.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:55 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3005798467' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:52:56.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:55 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:52:56.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:55 smithi099 ceph-mon[138788]: pgmap v3015: 105 pgs: 105 active+clean; 4.6 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail 2024-01-13T18:52:56.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:55 smithi099 ceph-mon[138788]: osdmap e1708: 8 total, 8 up, 8 in 2024-01-13T18:52:56.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:55 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3005798467' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:52:56.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:55 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:52:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:56 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:52:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:56 smithi084 ceph-mon[116404]: osdmap e1709: 8 total, 8 up, 8 in 2024-01-13T18:52:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:56 smithi084 ceph-mon[116404]: osdmap e1710: 8 total, 8 up, 8 in 2024-01-13T18:52:57.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:56 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:52:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:56 smithi084 ceph-mon[119097]: osdmap e1709: 8 total, 8 up, 8 in 2024-01-13T18:52:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:56 smithi084 ceph-mon[119097]: osdmap e1710: 8 total, 8 up, 8 in 2024-01-13T18:52:57.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:56 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:52:57.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:56 smithi099 ceph-mon[138788]: osdmap e1709: 8 total, 8 up, 8 in 2024-01-13T18:52:57.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:56 smithi099 ceph-mon[138788]: osdmap e1710: 8 total, 8 up, 8 in 2024-01-13T18:52:57.906 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestGroup.group_create (2033 ms) 2024-01-13T18:52:57.906 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestGroup.group_createPP 2024-01-13T18:52:57.924 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestGroup.group_createPP (18 ms) 2024-01-13T18:52:57.924 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestGroup.add_image 2024-01-13T18:52:57.965 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestGroup.add_image (41 ms) 2024-01-13T18:52:57.965 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestGroup.add_imagePP 2024-01-13T18:52:58.000 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestGroup.add_imagePP (36 ms) 2024-01-13T18:52:58.001 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestGroup.add_snapshot 2024-01-13T18:52:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:57 smithi084 ceph-mon[116404]: pgmap v3018: 137 pgs: 23 unknown, 114 active+clean; 4.6 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail 2024-01-13T18:52:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:57 smithi084 ceph-mon[116404]: osdmap e1711: 8 total, 8 up, 8 in 2024-01-13T18:52:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:57 smithi084 ceph-mon[119097]: pgmap v3018: 137 pgs: 23 unknown, 114 active+clean; 4.6 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail 2024-01-13T18:52:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:57 smithi084 ceph-mon[119097]: osdmap e1711: 8 total, 8 up, 8 in 2024-01-13T18:52:58.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:57 smithi099 ceph-mon[138788]: pgmap v3018: 137 pgs: 23 unknown, 114 active+clean; 4.6 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail 2024-01-13T18:52:58.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:57 smithi099 ceph-mon[138788]: osdmap e1711: 8 total, 8 up, 8 in 2024-01-13T18:53:00.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:59 smithi084 ceph-mon[119097]: pgmap v3021: 137 pgs: 6 unknown, 131 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-01-13T18:53:00.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:52:59 smithi084 ceph-mon[119097]: osdmap e1712: 8 total, 8 up, 8 in 2024-01-13T18:53:00.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:59 smithi084 ceph-mon[116404]: pgmap v3021: 137 pgs: 6 unknown, 131 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-01-13T18:53:00.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:52:59 smithi084 ceph-mon[116404]: osdmap e1712: 8 total, 8 up, 8 in 2024-01-13T18:53:00.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:59 smithi099 ceph-mon[138788]: pgmap v3021: 137 pgs: 6 unknown, 131 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-01-13T18:53:00.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:52:59 smithi099 ceph-mon[138788]: osdmap e1712: 8 total, 8 up, 8 in 2024-01-13T18:53:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:53:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:53:00] "GET /metrics HTTP/1.1" 200 36552 "" "Prometheus/2.43.0" 2024-01-13T18:53:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:00 smithi084 ceph-mon[116404]: osdmap e1713: 8 total, 8 up, 8 in 2024-01-13T18:53:01.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:00 smithi084 ceph-mon[119097]: osdmap e1713: 8 total, 8 up, 8 in 2024-01-13T18:53:01.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:00 smithi099 ceph-mon[138788]: osdmap e1713: 8 total, 8 up, 8 in 2024-01-13T18:53:02.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:01 smithi084 ceph-mon[116404]: pgmap v3024: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 7.5 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-01-13T18:53:02.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:01 smithi084 ceph-mon[116404]: osdmap e1714: 8 total, 8 up, 8 in 2024-01-13T18:53:02.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:01 smithi084 ceph-mon[119097]: pgmap v3024: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 7.5 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-01-13T18:53:02.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:01 smithi084 ceph-mon[119097]: osdmap e1714: 8 total, 8 up, 8 in 2024-01-13T18:53:02.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:01 smithi099 ceph-mon[138788]: pgmap v3024: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 7.5 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-01-13T18:53:02.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:01 smithi099 ceph-mon[138788]: osdmap e1714: 8 total, 8 up, 8 in 2024-01-13T18:53:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:02 smithi084 ceph-mon[116404]: osdmap e1715: 8 total, 8 up, 8 in 2024-01-13T18:53:03.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:02 smithi084 ceph-mon[119097]: osdmap e1715: 8 total, 8 up, 8 in 2024-01-13T18:53:03.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:02 smithi099 ceph-mon[138788]: osdmap e1715: 8 total, 8 up, 8 in 2024-01-13T18:53:03.622 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestGroup.add_snapshot (5621 ms) 2024-01-13T18:53:03.622 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestGroup.add_snapshotPP 2024-01-13T18:53:04.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:03 smithi084 ceph-mon[119097]: pgmap v3027: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 152 KiB/s rd, 18 KiB/s wr, 207 op/s 2024-01-13T18:53:04.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:03 smithi084 ceph-mon[119097]: osdmap e1716: 8 total, 8 up, 8 in 2024-01-13T18:53:04.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:03 smithi084 ceph-mon[119097]: osdmap e1717: 8 total, 8 up, 8 in 2024-01-13T18:53:04.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:03 smithi084 ceph-mon[116404]: pgmap v3027: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 152 KiB/s rd, 18 KiB/s wr, 207 op/s 2024-01-13T18:53:04.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:03 smithi084 ceph-mon[116404]: osdmap e1716: 8 total, 8 up, 8 in 2024-01-13T18:53:04.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:03 smithi084 ceph-mon[116404]: osdmap e1717: 8 total, 8 up, 8 in 2024-01-13T18:53:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:03 smithi099 ceph-mon[138788]: pgmap v3027: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 152 KiB/s rd, 18 KiB/s wr, 207 op/s 2024-01-13T18:53:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:03 smithi099 ceph-mon[138788]: osdmap e1716: 8 total, 8 up, 8 in 2024-01-13T18:53:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:03 smithi099 ceph-mon[138788]: osdmap e1717: 8 total, 8 up, 8 in 2024-01-13T18:53:05.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:05 smithi099 ceph-mon[138788]: osdmap e1718: 8 total, 8 up, 8 in 2024-01-13T18:53:05.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:05 smithi084 ceph-mon[116404]: osdmap e1718: 8 total, 8 up, 8 in 2024-01-13T18:53:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:05 smithi084 ceph-mon[119097]: osdmap e1718: 8 total, 8 up, 8 in 2024-01-13T18:53:05.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:06.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:06 smithi099 ceph-mon[138788]: pgmap v3031: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 151 KiB/s rd, 16 KiB/s wr, 203 op/s 2024-01-13T18:53:06.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:06 smithi099 ceph-mon[138788]: osdmap e1719: 8 total, 8 up, 8 in 2024-01-13T18:53:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:06 smithi084 ceph-mon[116404]: pgmap v3031: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 151 KiB/s rd, 16 KiB/s wr, 203 op/s 2024-01-13T18:53:06.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:06 smithi084 ceph-mon[116404]: osdmap e1719: 8 total, 8 up, 8 in 2024-01-13T18:53:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:06 smithi084 ceph-mon[119097]: pgmap v3031: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 151 KiB/s rd, 16 KiB/s wr, 203 op/s 2024-01-13T18:53:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:06 smithi084 ceph-mon[119097]: osdmap e1719: 8 total, 8 up, 8 in 2024-01-13T18:53:07.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:07 smithi099 ceph-mon[138788]: osdmap e1720: 8 total, 8 up, 8 in 2024-01-13T18:53:07.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:07 smithi084 ceph-mon[116404]: osdmap e1720: 8 total, 8 up, 8 in 2024-01-13T18:53:07.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:07 smithi084 ceph-mon[119097]: osdmap e1720: 8 total, 8 up, 8 in 2024-01-13T18:53:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:08 smithi084 ceph-mon[116404]: pgmap v3034: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 103 KiB/s rd, 7.9 KiB/s wr, 132 op/s 2024-01-13T18:53:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:08 smithi084 ceph-mon[116404]: osdmap e1721: 8 total, 8 up, 8 in 2024-01-13T18:53:08.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:08 smithi084 ceph-mon[116404]: osdmap e1722: 8 total, 8 up, 8 in 2024-01-13T18:53:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:08 smithi084 ceph-mon[119097]: pgmap v3034: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 103 KiB/s rd, 7.9 KiB/s wr, 132 op/s 2024-01-13T18:53:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:08 smithi084 ceph-mon[119097]: osdmap e1721: 8 total, 8 up, 8 in 2024-01-13T18:53:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:08 smithi084 ceph-mon[119097]: osdmap e1722: 8 total, 8 up, 8 in 2024-01-13T18:53:09.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:08 smithi099 ceph-mon[138788]: pgmap v3034: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 103 KiB/s rd, 7.9 KiB/s wr, 132 op/s 2024-01-13T18:53:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:08 smithi099 ceph-mon[138788]: osdmap e1721: 8 total, 8 up, 8 in 2024-01-13T18:53:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:08 smithi099 ceph-mon[138788]: osdmap e1722: 8 total, 8 up, 8 in 2024-01-13T18:53:09.667 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestGroup.add_snapshotPP (6044 ms) 2024-01-13T18:53:10.639 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:53:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:53:10] "GET /metrics HTTP/1.1" 200 36525 "" "Prometheus/2.43.0" 2024-01-13T18:53:10.643 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:10 smithi084 ceph-mon[116404]: pgmap v3037: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 116 KiB/s rd, 11 KiB/s wr, 155 op/s 2024-01-13T18:53:10.643 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:10 smithi084 ceph-mon[116404]: osdmap e1723: 8 total, 8 up, 8 in 2024-01-13T18:53:10.644 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 6 tests from TestGroup (13793 ms total) 2024-01-13T18:53:10.644 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:53:10.644 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 57 tests from TestMigration 2024-01-13T18:53:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:10 smithi084 ceph-mon[119097]: pgmap v3037: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 116 KiB/s rd, 11 KiB/s wr, 155 op/s 2024-01-13T18:53:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:10 smithi084 ceph-mon[119097]: osdmap e1723: 8 total, 8 up, 8 in 2024-01-13T18:53:11.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:10 smithi099 ceph-mon[138788]: pgmap v3037: 137 pgs: 137 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 116 KiB/s rd, 11 KiB/s wr, 155 op/s 2024-01-13T18:53:11.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:10 smithi099 ceph-mon[138788]: osdmap e1723: 8 total, 8 up, 8 in 2024-01-13T18:53:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:11 smithi084 ceph-mon[116404]: osdmap e1724: 8 total, 8 up, 8 in 2024-01-13T18:53:11.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:11 smithi084 ceph-mon[119097]: osdmap e1724: 8 total, 8 up, 8 in 2024-01-13T18:53:12.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:11 smithi099 ceph-mon[138788]: osdmap e1724: 8 total, 8 up, 8 in 2024-01-13T18:53:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:12 smithi084 ceph-mon[116404]: pgmap v3040: 105 pgs: 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:53:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:12 smithi084 ceph-mon[116404]: osdmap e1725: 8 total, 8 up, 8 in 2024-01-13T18:53:13.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:12 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3398163967' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:53:13.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:12 smithi084 ceph-mon[119097]: pgmap v3040: 105 pgs: 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:53:13.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:12 smithi084 ceph-mon[119097]: osdmap e1725: 8 total, 8 up, 8 in 2024-01-13T18:53:13.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:12 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3398163967' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:53:13.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:12 smithi099 ceph-mon[138788]: pgmap v3040: 105 pgs: 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:53:13.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:12 smithi099 ceph-mon[138788]: osdmap e1725: 8 total, 8 up, 8 in 2024-01-13T18:53:13.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:12 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3398163967' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:53:13.661 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.Empty 2024-01-13T18:53:14.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:13 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3398163967' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:53:14.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:13 smithi084 ceph-mon[119097]: osdmap e1726: 8 total, 8 up, 8 in 2024-01-13T18:53:14.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:13 smithi084 ceph-mon[119097]: pgmap v3043: 137 pgs: 21 creating+peering, 11 unknown, 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:53:14.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:13 smithi084 ceph-mon[119097]: osdmap e1727: 8 total, 8 up, 8 in 2024-01-13T18:53:14.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:13 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3398163967' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:53:14.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:13 smithi084 ceph-mon[116404]: osdmap e1726: 8 total, 8 up, 8 in 2024-01-13T18:53:14.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:13 smithi084 ceph-mon[116404]: pgmap v3043: 137 pgs: 21 creating+peering, 11 unknown, 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:53:14.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:13 smithi084 ceph-mon[116404]: osdmap e1727: 8 total, 8 up, 8 in 2024-01-13T18:53:14.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:13 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3398163967' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:53:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:13 smithi099 ceph-mon[138788]: osdmap e1726: 8 total, 8 up, 8 in 2024-01-13T18:53:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:13 smithi099 ceph-mon[138788]: pgmap v3043: 137 pgs: 21 creating+peering, 11 unknown, 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:53:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:13 smithi099 ceph-mon[138788]: osdmap e1727: 8 total, 8 up, 8 in 2024-01-13T18:53:15.715 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:15.725 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:15.862 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:15.924 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:15.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:15 smithi084 ceph-mon[116404]: osdmap e1728: 8 total, 8 up, 8 in 2024-01-13T18:53:15.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:15 smithi084 ceph-mon[119097]: osdmap e1728: 8 total, 8 up, 8 in 2024-01-13T18:53:16.003 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.Empty (2343 ms) 2024-01-13T18:53:16.003 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.OtherName 2024-01-13T18:53:16.033 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:16.044 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:16.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:15 smithi099 ceph-mon[138788]: osdmap e1728: 8 total, 8 up, 8 in 2024-01-13T18:53:16.172 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:16.237 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:16.317 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.OtherName (314 ms) 2024-01-13T18:53:16.317 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.OtherPool 2024-01-13T18:53:16.345 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:16.356 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:16 smithi084 ceph-mon[116404]: pgmap v3046: 169 pgs: 28 creating+peering, 19 unknown, 122 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:53:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:16 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:53:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:16 smithi084 ceph-mon[116404]: osdmap e1729: 8 total, 8 up, 8 in 2024-01-13T18:53:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:16 smithi084 ceph-mon[119097]: pgmap v3046: 169 pgs: 28 creating+peering, 19 unknown, 122 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:53:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:16 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:53:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:16 smithi084 ceph-mon[119097]: osdmap e1729: 8 total, 8 up, 8 in 2024-01-13T18:53:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:16 smithi099 ceph-mon[138788]: pgmap v3046: 169 pgs: 28 creating+peering, 19 unknown, 122 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:53:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:16 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:53:17.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:16 smithi099 ceph-mon[138788]: osdmap e1729: 8 total, 8 up, 8 in 2024-01-13T18:53:17.810 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:17.870 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:17.949 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.OtherPool (1631 ms) 2024-01-13T18:53:17.949 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.OtherNamespace 2024-01-13T18:53:17.981 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:17.993 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:18.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:17 smithi099 ceph-mon[138788]: osdmap e1730: 8 total, 8 up, 8 in 2024-01-13T18:53:18.118 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:17 smithi084 ceph-mon[116404]: osdmap e1730: 8 total, 8 up, 8 in 2024-01-13T18:53:18.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:17 smithi084 ceph-mon[119097]: osdmap e1730: 8 total, 8 up, 8 in 2024-01-13T18:53:18.185 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:18.265 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.OtherNamespace (316 ms) 2024-01-13T18:53:18.266 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.DataPool 2024-01-13T18:53:18.293 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:18.303 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:18.435 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:18.504 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:18.581 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.DataPool (315 ms) 2024-01-13T18:53:18.581 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.AbortAfterPrepare 2024-01-13T18:53:18.610 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:18.619 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:18.756 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:53:18.851 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.AbortAfterPrepare (271 ms) 2024-01-13T18:53:18.851 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.AbortAfterFailedPrepare 2024-01-13T18:53:18.882 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:18.892 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:18 smithi084 ceph-mon[119097]: pgmap v3049: 169 pgs: 14 creating+peering, 6 unknown, 149 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 108 KiB/s rd, 8.0 KiB/s wr, 144 op/s 2024-01-13T18:53:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:18 smithi084 ceph-mon[119097]: osdmap e1731: 8 total, 8 up, 8 in 2024-01-13T18:53:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:18 smithi084 ceph-mon[116404]: pgmap v3049: 169 pgs: 14 creating+peering, 6 unknown, 149 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 108 KiB/s rd, 8.0 KiB/s wr, 144 op/s 2024-01-13T18:53:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:18 smithi084 ceph-mon[116404]: osdmap e1731: 8 total, 8 up, 8 in 2024-01-13T18:53:18.989 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.AbortAfterFailedPrepare (138 ms) 2024-01-13T18:53:18.990 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.AbortAfterExecute 2024-01-13T18:53:19.018 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:19.028 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:18 smithi099 ceph-mon[138788]: pgmap v3049: 169 pgs: 14 creating+peering, 6 unknown, 149 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 108 KiB/s rd, 8.0 KiB/s wr, 144 op/s 2024-01-13T18:53:19.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:18 smithi099 ceph-mon[138788]: osdmap e1731: 8 total, 8 up, 8 in 2024-01-13T18:53:19.162 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:19.229 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:53:19.326 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.AbortAfterExecute (337 ms) 2024-01-13T18:53:19.326 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.OtherPoolAbortAfterExecute 2024-01-13T18:53:19.356 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:19.369 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:19.499 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:19.568 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:53:19.665 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.OtherPoolAbortAfterExecute (338 ms) 2024-01-13T18:53:19.665 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.OtherNamespaceAbortAfterExecute 2024-01-13T18:53:19.694 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:19.705 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:19.829 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:19.891 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:53:19.996 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.OtherNamespaceAbortAfterExecute (331 ms) 2024-01-13T18:53:19.996 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.MirroringSamePool 2024-01-13T18:53:20.024 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:20.034 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:53:20.039 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.MirroringSamePool (44 ms) 2024-01-13T18:53:20.040 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.MirroringAbort 2024-01-13T18:53:20.068 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:20.078 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:53:20.084 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.MirroringAbort (44 ms) 2024-01-13T18:53:20.084 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.MirroringOtherPoolDisabled 2024-01-13T18:53:20.116 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:20.126 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:53:20.133 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.MirroringOtherPoolDisabled (49 ms) 2024-01-13T18:53:20.133 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.MirroringOtherPoolEnabled 2024-01-13T18:53:20.162 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:20.172 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:53:20.178 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.MirroringOtherPoolEnabled (45 ms) 2024-01-13T18:53:20.178 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.MirroringPool 2024-01-13T18:53:20.207 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:20.217 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:53:20.223 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.MirroringPool (46 ms) 2024-01-13T18:53:20.223 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.Group 2024-01-13T18:53:20.255 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:20.272 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:20.417 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:20.485 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:20.573 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.Group (349 ms) 2024-01-13T18:53:20.573 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.GroupAbort 2024-01-13T18:53:20.602 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:20.621 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:53:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:53:20] "GET /metrics HTTP/1.1" 200 38982 "" "Prometheus/2.43.0" 2024-01-13T18:53:20.758 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:53:20.868 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.GroupAbort (294 ms) 2024-01-13T18:53:20.868 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.NoSnaps 2024-01-13T18:53:20.901 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:20.911 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:20.970 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:53:21.020 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:20 smithi099 ceph-mon[138788]: pgmap v3051: 169 pgs: 1 creating+peering, 168 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 298 KiB/s rd, 20 KiB/s wr, 383 op/s 2024-01-13T18:53:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:53:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:20 smithi084 ceph-mon[116404]: pgmap v3051: 169 pgs: 1 creating+peering, 168 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 298 KiB/s rd, 20 KiB/s wr, 383 op/s 2024-01-13T18:53:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:53:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:21.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:20 smithi084 ceph-mon[119097]: pgmap v3051: 169 pgs: 1 creating+peering, 168 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 298 KiB/s rd, 20 KiB/s wr, 383 op/s 2024-01-13T18:53:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:53:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:21.218 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:21.346 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:21.474 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.NoSnaps (607 ms) 2024-01-13T18:53:21.474 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.NoSnapsOtherPool 2024-01-13T18:53:21.504 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:21.513 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:21.569 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:53:21.631 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:21.634 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:53:21.713 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:21.883 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:22.000 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:22.130 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.NoSnapsOtherPool (656 ms) 2024-01-13T18:53:22.130 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.NoSnapsDataPool 2024-01-13T18:53:22.161 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:22.170 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:22.227 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:53:22.273 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:22.454 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:22.581 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:22.701 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.NoSnapsDataPool (571 ms) 2024-01-13T18:53:22.701 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.NoSnapsShrinkAfterPrepare 2024-01-13T18:53:22.732 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:22.742 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:22.801 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:53:22.856 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:23.042 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 41943040 2024-01-13T18:53:23.049 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:22 smithi099 ceph-mon[138788]: pgmap v3052: 169 pgs: 169 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 453 KiB/s rd, 24 KiB/s wr, 564 op/s 2024-01-13T18:53:23.159 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:22 smithi084 ceph-mon[116404]: pgmap v3052: 169 pgs: 169 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 453 KiB/s rd, 24 KiB/s wr, 564 op/s 2024-01-13T18:53:23.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:22 smithi084 ceph-mon[119097]: pgmap v3052: 169 pgs: 169 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 453 KiB/s rd, 24 KiB/s wr, 564 op/s 2024-01-13T18:53:23.264 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.NoSnapsShrinkAfterPrepare (563 ms) 2024-01-13T18:53:23.265 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.NoSnapsShrinkToZeroBeforePrepare 2024-01-13T18:53:23.294 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:23.305 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:23.371 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:53:23.424 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 0 2024-01-13T18:53:23.437 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:23.545 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:23.623 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:23.665 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.NoSnapsShrinkToZeroBeforePrepare (401 ms) 2024-01-13T18:53:23.665 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.NoSnapsShrinkToZeroAfterPrepare 2024-01-13T18:53:23.694 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:23.704 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:53:23.824 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:24.014 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 0 2024-01-13T18:53:24.026 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:24.094 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:24.149 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.NoSnapsShrinkToZeroAfterPrepare (483 ms) 2024-01-13T18:53:24.149 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.NoSnapsExpandAfterPrepare 2024-01-13T18:53:24.180 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:24.189 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:24.240 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:53:24.301 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:24.481 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:53:24.488 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:24.601 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:24.735 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.NoSnapsExpandAfterPrepare (587 ms) 2024-01-13T18:53:24.735 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.NoSnapsSnapAfterPrepare 2024-01-13T18:53:24.764 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:24.774 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:24.831 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:53:24.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:24 smithi099 ceph-mon[138788]: pgmap v3053: 169 pgs: 169 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 18 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2024-01-13T18:53:24.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:24 smithi099 ceph-mon[138788]: osdmap e1732: 8 total, 8 up, 8 in 2024-01-13T18:53:24.878 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:24 smithi084 ceph-mon[116404]: pgmap v3053: 169 pgs: 169 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 18 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2024-01-13T18:53:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:24 smithi084 ceph-mon[116404]: osdmap e1732: 8 total, 8 up, 8 in 2024-01-13T18:53:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:24 smithi084 ceph-mon[119097]: pgmap v3053: 169 pgs: 169 active+clean; 69 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 18 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2024-01-13T18:53:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:24 smithi084 ceph-mon[119097]: osdmap e1732: 8 total, 8 up, 8 in 2024-01-13T18:53:25.062 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: after_prepare_snap 2024-01-13T18:53:26.610 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 41943040 2024-01-13T18:53:26.632 INFO:tasks.workunit.client.0.smithi084.stdout:write: * 0~1000 2024-01-13T18:53:26.637 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:26.755 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:26.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:26 smithi099 ceph-mon[138788]: pgmap v3055: 169 pgs: 169 active+clean; 105 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 27 MiB/s rd, 22 MiB/s wr, 1.56k op/s 2024-01-13T18:53:26.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:26 smithi099 ceph-mon[138788]: osdmap e1733: 8 total, 8 up, 8 in 2024-01-13T18:53:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:26 smithi084 ceph-mon[116404]: pgmap v3055: 169 pgs: 169 active+clean; 105 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 27 MiB/s rd, 22 MiB/s wr, 1.56k op/s 2024-01-13T18:53:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:26 smithi084 ceph-mon[116404]: osdmap e1733: 8 total, 8 up, 8 in 2024-01-13T18:53:26.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:26 smithi084 ceph-mon[119097]: pgmap v3055: 169 pgs: 169 active+clean; 105 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 27 MiB/s rd, 22 MiB/s wr, 1.56k op/s 2024-01-13T18:53:26.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:26 smithi084 ceph-mon[119097]: osdmap e1733: 8 total, 8 up, 8 in 2024-01-13T18:53:26.927 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.NoSnapsSnapAfterPrepare (2191 ms) 2024-01-13T18:53:26.927 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.Snaps 2024-01-13T18:53:26.956 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:26.966 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:53:27.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:27 smithi099 ceph-mon[138788]: osdmap e1734: 8 total, 8 up, 8 in 2024-01-13T18:53:27.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:27 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:53:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:27 smithi084 ceph-mon[116404]: osdmap e1734: 8 total, 8 up, 8 in 2024-01-13T18:53:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:27 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:53:27.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:27 smithi084 ceph-mon[119097]: osdmap e1734: 8 total, 8 up, 8 in 2024-01-13T18:53:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:27 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:53:28.611 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 8388609~8388609 2024-01-13T18:53:28.623 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~1000 2024-01-13T18:53:28.624 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 1010~1000 2024-01-13T18:53:28.624 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:53:28.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:28 smithi099 ceph-mon[138788]: pgmap v3058: 169 pgs: 169 active+clean; 153 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 61 MiB/s rd, 49 MiB/s wr, 2.03k op/s 2024-01-13T18:53:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:28 smithi099 ceph-mon[138788]: osdmap e1735: 8 total, 8 up, 8 in 2024-01-13T18:53:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:53:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:53:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:53:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:28 smithi099 ceph-mon[138788]: osdmap e1736: 8 total, 8 up, 8 in 2024-01-13T18:53:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[119097]: pgmap v3058: 169 pgs: 169 active+clean; 153 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 61 MiB/s rd, 49 MiB/s wr, 2.03k op/s 2024-01-13T18:53:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[119097]: osdmap e1735: 8 total, 8 up, 8 in 2024-01-13T18:53:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:53:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:53:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:53:28.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[119097]: osdmap e1736: 8 total, 8 up, 8 in 2024-01-13T18:53:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[116404]: pgmap v3058: 169 pgs: 169 active+clean; 153 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 61 MiB/s rd, 49 MiB/s wr, 2.03k op/s 2024-01-13T18:53:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[116404]: osdmap e1735: 8 total, 8 up, 8 in 2024-01-13T18:53:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:53:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:53:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:53:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:28 smithi084 ceph-mon[116404]: osdmap e1736: 8 total, 8 up, 8 in 2024-01-13T18:53:30.622 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:53:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:53:30] "GET /metrics HTTP/1.1" 200 38982 "" "Prometheus/2.43.0" 2024-01-13T18:53:30.622 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:30 smithi084 ceph-mon[119097]: pgmap v3061: 169 pgs: 169 active+clean; 197 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 80 MiB/s rd, 53 MiB/s wr, 1.42k op/s 2024-01-13T18:53:30.623 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:30 smithi084 ceph-mon[119097]: osdmap e1737: 8 total, 8 up, 8 in 2024-01-13T18:53:30.631 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 8388609~1000 2024-01-13T18:53:30.638 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16777228~1000 2024-01-13T18:53:30.638 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:53:30.646 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 83886079~8388609 2024-01-13T18:53:30.658 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:53:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:30 smithi084 ceph-mon[116404]: pgmap v3061: 169 pgs: 169 active+clean; 197 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 80 MiB/s rd, 53 MiB/s wr, 1.42k op/s 2024-01-13T18:53:30.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:30 smithi084 ceph-mon[116404]: osdmap e1737: 8 total, 8 up, 8 in 2024-01-13T18:53:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:30 smithi099 ceph-mon[138788]: pgmap v3061: 169 pgs: 169 active+clean; 197 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 80 MiB/s rd, 53 MiB/s wr, 1.42k op/s 2024-01-13T18:53:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:30 smithi099 ceph-mon[138788]: osdmap e1737: 8 total, 8 up, 8 in 2024-01-13T18:53:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:31 smithi084 ceph-mon[116404]: osdmap e1738: 8 total, 8 up, 8 in 2024-01-13T18:53:31.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:31 smithi084 ceph-mon[119097]: osdmap e1738: 8 total, 8 up, 8 in 2024-01-13T18:53:32.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:31 smithi099 ceph-mon[138788]: osdmap e1738: 8 total, 8 up, 8 in 2024-01-13T18:53:32.661 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:32.683 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 83886079~1 2024-01-13T18:53:32.692 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:32 smithi084 ceph-mon[116404]: pgmap v3064: 169 pgs: 169 active+clean; 205 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 42 MiB/s rd, 24 MiB/s wr, 883 op/s 2024-01-13T18:53:32.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:32 smithi084 ceph-mon[116404]: osdmap e1739: 8 total, 8 up, 8 in 2024-01-13T18:53:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:32 smithi084 ceph-mon[119097]: pgmap v3064: 169 pgs: 169 active+clean; 205 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 42 MiB/s rd, 24 MiB/s wr, 883 op/s 2024-01-13T18:53:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:32 smithi084 ceph-mon[119097]: osdmap e1739: 8 total, 8 up, 8 in 2024-01-13T18:53:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:32 smithi099 ceph-mon[138788]: pgmap v3064: 169 pgs: 169 active+clean; 205 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 42 MiB/s rd, 24 MiB/s wr, 883 op/s 2024-01-13T18:53:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:32 smithi099 ceph-mon[138788]: osdmap e1739: 8 total, 8 up, 8 in 2024-01-13T18:53:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:33 smithi084 ceph-mon[116404]: osdmap e1740: 8 total, 8 up, 8 in 2024-01-13T18:53:33.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:33 smithi084 ceph-mon[119097]: osdmap e1740: 8 total, 8 up, 8 in 2024-01-13T18:53:34.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:33 smithi099 ceph-mon[138788]: osdmap e1740: 8 total, 8 up, 8 in 2024-01-13T18:53:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:34 smithi084 ceph-mon[116404]: pgmap v3067: 169 pgs: 169 active+clean; 241 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 6.1 MiB/s rd, 9.0 MiB/s wr, 162 op/s 2024-01-13T18:53:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:34 smithi084 ceph-mon[116404]: osdmap e1741: 8 total, 8 up, 8 in 2024-01-13T18:53:34.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:34 smithi084 ceph-mon[119097]: pgmap v3067: 169 pgs: 169 active+clean; 241 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 6.1 MiB/s rd, 9.0 MiB/s wr, 162 op/s 2024-01-13T18:53:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:34 smithi084 ceph-mon[119097]: osdmap e1741: 8 total, 8 up, 8 in 2024-01-13T18:53:35.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:34 smithi099 ceph-mon[138788]: pgmap v3067: 169 pgs: 169 active+clean; 241 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 6.1 MiB/s rd, 9.0 MiB/s wr, 162 op/s 2024-01-13T18:53:35.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:34 smithi099 ceph-mon[138788]: osdmap e1741: 8 total, 8 up, 8 in 2024-01-13T18:53:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:35 smithi084 ceph-mon[116404]: osdmap e1742: 8 total, 8 up, 8 in 2024-01-13T18:53:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:35 smithi084 ceph-mon[119097]: osdmap e1742: 8 total, 8 up, 8 in 2024-01-13T18:53:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:36.099 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:35 smithi099 ceph-mon[138788]: osdmap e1742: 8 total, 8 up, 8 in 2024-01-13T18:53:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:36.246 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:36 smithi084 ceph-mon[116404]: pgmap v3070: 169 pgs: 169 active+clean; 253 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 6.1 MiB/s rd, 10 MiB/s wr, 120 op/s 2024-01-13T18:53:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:36 smithi084 ceph-mon[116404]: osdmap e1743: 8 total, 8 up, 8 in 2024-01-13T18:53:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:36 smithi084 ceph-mon[119097]: pgmap v3070: 169 pgs: 169 active+clean; 253 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 6.1 MiB/s rd, 10 MiB/s wr, 120 op/s 2024-01-13T18:53:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:36 smithi084 ceph-mon[119097]: osdmap e1743: 8 total, 8 up, 8 in 2024-01-13T18:53:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:36 smithi099 ceph-mon[138788]: pgmap v3070: 169 pgs: 169 active+clean; 253 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 6.1 MiB/s rd, 10 MiB/s wr, 120 op/s 2024-01-13T18:53:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:36 smithi099 ceph-mon[138788]: osdmap e1743: 8 total, 8 up, 8 in 2024-01-13T18:53:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:37 smithi084 ceph-mon[116404]: osdmap e1744: 8 total, 8 up, 8 in 2024-01-13T18:53:37.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:37 smithi084 ceph-mon[119097]: osdmap e1744: 8 total, 8 up, 8 in 2024-01-13T18:53:38.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:37 smithi099 ceph-mon[138788]: osdmap e1744: 8 total, 8 up, 8 in 2024-01-13T18:53:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:38 smithi084 ceph-mon[119097]: pgmap v3073: 169 pgs: 169 active+clean; 261 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 19 MiB/s rd, 6.0 MiB/s wr, 463 op/s 2024-01-13T18:53:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:38 smithi084 ceph-mon[119097]: osdmap e1745: 8 total, 8 up, 8 in 2024-01-13T18:53:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:38 smithi084 ceph-mon[116404]: pgmap v3073: 169 pgs: 169 active+clean; 261 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 19 MiB/s rd, 6.0 MiB/s wr, 463 op/s 2024-01-13T18:53:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:38 smithi084 ceph-mon[116404]: osdmap e1745: 8 total, 8 up, 8 in 2024-01-13T18:53:39.004 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.Snaps (12078 ms) 2024-01-13T18:53:39.004 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.SnapsOtherPool 2024-01-13T18:53:39.039 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:39.050 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:39.104 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:53:39.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:38 smithi099 ceph-mon[138788]: pgmap v3073: 169 pgs: 169 active+clean; 261 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 19 MiB/s rd, 6.0 MiB/s wr, 463 op/s 2024-01-13T18:53:39.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:38 smithi099 ceph-mon[138788]: osdmap e1745: 8 total, 8 up, 8 in 2024-01-13T18:53:40.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:39 smithi099 ceph-mon[138788]: osdmap e1746: 8 total, 8 up, 8 in 2024-01-13T18:53:40.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:39 smithi084 ceph-mon[116404]: osdmap e1746: 8 total, 8 up, 8 in 2024-01-13T18:53:40.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:39 smithi084 ceph-mon[119097]: osdmap e1746: 8 total, 8 up, 8 in 2024-01-13T18:53:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:53:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:53:40] "GET /metrics HTTP/1.1" 200 39030 "" "Prometheus/2.43.0" 2024-01-13T18:53:40.708 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 8388609~8388609 2024-01-13T18:53:40.725 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~1000 2024-01-13T18:53:40.725 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 1010~1000 2024-01-13T18:53:40.725 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:53:41.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:40 smithi099 ceph-mon[138788]: pgmap v3076: 169 pgs: 169 active+clean; 269 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 28 MiB/s rd, 5.0 MiB/s wr, 470 op/s 2024-01-13T18:53:41.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:40 smithi099 ceph-mon[138788]: osdmap e1747: 8 total, 8 up, 8 in 2024-01-13T18:53:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:40 smithi084 ceph-mon[116404]: pgmap v3076: 169 pgs: 169 active+clean; 269 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 28 MiB/s rd, 5.0 MiB/s wr, 470 op/s 2024-01-13T18:53:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:40 smithi084 ceph-mon[116404]: osdmap e1747: 8 total, 8 up, 8 in 2024-01-13T18:53:41.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:40 smithi084 ceph-mon[119097]: pgmap v3076: 169 pgs: 169 active+clean; 269 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 28 MiB/s rd, 5.0 MiB/s wr, 470 op/s 2024-01-13T18:53:41.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:40 smithi084 ceph-mon[119097]: osdmap e1747: 8 total, 8 up, 8 in 2024-01-13T18:53:42.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:41 smithi099 ceph-mon[138788]: osdmap e1748: 8 total, 8 up, 8 in 2024-01-13T18:53:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:41 smithi084 ceph-mon[116404]: osdmap e1748: 8 total, 8 up, 8 in 2024-01-13T18:53:42.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:41 smithi084 ceph-mon[119097]: osdmap e1748: 8 total, 8 up, 8 in 2024-01-13T18:53:42.725 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 8388609~1000 2024-01-13T18:53:42.732 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16777228~1000 2024-01-13T18:53:42.732 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:53:42.742 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 83886079~8388609 2024-01-13T18:53:42.764 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:53:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:42 smithi099 ceph-mon[138788]: pgmap v3079: 169 pgs: 169 active+clean; 273 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 4.0 MiB/s wr, 84 op/s 2024-01-13T18:53:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:42 smithi099 ceph-mon[138788]: osdmap e1749: 8 total, 8 up, 8 in 2024-01-13T18:53:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:42 smithi084 ceph-mon[116404]: pgmap v3079: 169 pgs: 169 active+clean; 273 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 4.0 MiB/s wr, 84 op/s 2024-01-13T18:53:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:42 smithi084 ceph-mon[116404]: osdmap e1749: 8 total, 8 up, 8 in 2024-01-13T18:53:43.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:42 smithi084 ceph-mon[119097]: pgmap v3079: 169 pgs: 169 active+clean; 273 MiB data, 5.3 GiB used, 710 GiB / 715 GiB avail; 26 MiB/s rd, 4.0 MiB/s wr, 84 op/s 2024-01-13T18:53:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:42 smithi084 ceph-mon[119097]: osdmap e1749: 8 total, 8 up, 8 in 2024-01-13T18:53:44.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:43 smithi099 ceph-mon[138788]: osdmap e1750: 8 total, 8 up, 8 in 2024-01-13T18:53:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:43 smithi084 ceph-mon[116404]: osdmap e1750: 8 total, 8 up, 8 in 2024-01-13T18:53:44.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:43 smithi084 ceph-mon[119097]: osdmap e1750: 8 total, 8 up, 8 in 2024-01-13T18:53:44.731 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:44.756 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 83886079~1 2024-01-13T18:53:44.765 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:44.768 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:53:44.836 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:45.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:44 smithi099 ceph-mon[138788]: pgmap v3082: 169 pgs: 169 active+clean; 269 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 41 MiB/s rd, 5.0 MiB/s wr, 128 op/s 2024-01-13T18:53:45.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:44 smithi099 ceph-mon[138788]: osdmap e1751: 8 total, 8 up, 8 in 2024-01-13T18:53:45.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:44 smithi084 ceph-mon[119097]: pgmap v3082: 169 pgs: 169 active+clean; 269 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 41 MiB/s rd, 5.0 MiB/s wr, 128 op/s 2024-01-13T18:53:45.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:44 smithi084 ceph-mon[119097]: osdmap e1751: 8 total, 8 up, 8 in 2024-01-13T18:53:45.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:44 smithi084 ceph-mon[116404]: pgmap v3082: 169 pgs: 169 active+clean; 269 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 41 MiB/s rd, 5.0 MiB/s wr, 128 op/s 2024-01-13T18:53:45.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:44 smithi084 ceph-mon[116404]: osdmap e1751: 8 total, 8 up, 8 in 2024-01-13T18:53:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:45 smithi099 ceph-mon[138788]: osdmap e1752: 8 total, 8 up, 8 in 2024-01-13T18:53:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:45 smithi084 ceph-mon[116404]: osdmap e1752: 8 total, 8 up, 8 in 2024-01-13T18:53:46.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:45 smithi084 ceph-mon[119097]: osdmap e1752: 8 total, 8 up, 8 in 2024-01-13T18:53:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:46 smithi099 ceph-mon[138788]: pgmap v3085: 169 pgs: 169 active+clean; 297 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 25 MiB/s rd, 8.0 MiB/s wr, 128 op/s 2024-01-13T18:53:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:46 smithi099 ceph-mon[138788]: osdmap e1753: 8 total, 8 up, 8 in 2024-01-13T18:53:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:46 smithi084 ceph-mon[116404]: pgmap v3085: 169 pgs: 169 active+clean; 297 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 25 MiB/s rd, 8.0 MiB/s wr, 128 op/s 2024-01-13T18:53:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:46 smithi084 ceph-mon[116404]: osdmap e1753: 8 total, 8 up, 8 in 2024-01-13T18:53:47.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:46 smithi084 ceph-mon[119097]: pgmap v3085: 169 pgs: 169 active+clean; 297 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 25 MiB/s rd, 8.0 MiB/s wr, 128 op/s 2024-01-13T18:53:47.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:46 smithi084 ceph-mon[119097]: osdmap e1753: 8 total, 8 up, 8 in 2024-01-13T18:53:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:47 smithi099 ceph-mon[138788]: osdmap e1754: 8 total, 8 up, 8 in 2024-01-13T18:53:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:47 smithi099 ceph-mon[138788]: pgmap v3088: 169 pgs: 169 active+clean; 309 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 8.0 MiB/s wr, 110 op/s 2024-01-13T18:53:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:47 smithi084 ceph-mon[116404]: osdmap e1754: 8 total, 8 up, 8 in 2024-01-13T18:53:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:47 smithi084 ceph-mon[116404]: pgmap v3088: 169 pgs: 169 active+clean; 309 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 8.0 MiB/s wr, 110 op/s 2024-01-13T18:53:48.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:47 smithi084 ceph-mon[119097]: osdmap e1754: 8 total, 8 up, 8 in 2024-01-13T18:53:48.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:47 smithi084 ceph-mon[119097]: pgmap v3088: 169 pgs: 169 active+clean; 309 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 8.0 MiB/s wr, 110 op/s 2024-01-13T18:53:48.227 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:53:48.419 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:53:49.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:48 smithi099 ceph-mon[138788]: osdmap e1755: 8 total, 8 up, 8 in 2024-01-13T18:53:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:48 smithi099 ceph-mon[138788]: osdmap e1756: 8 total, 8 up, 8 in 2024-01-13T18:53:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:48 smithi084 ceph-mon[116404]: osdmap e1755: 8 total, 8 up, 8 in 2024-01-13T18:53:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:48 smithi084 ceph-mon[116404]: osdmap e1756: 8 total, 8 up, 8 in 2024-01-13T18:53:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:48 smithi084 ceph-mon[119097]: osdmap e1755: 8 total, 8 up, 8 in 2024-01-13T18:53:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:48 smithi084 ceph-mon[119097]: osdmap e1756: 8 total, 8 up, 8 in 2024-01-13T18:53:50.607 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:53:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:53:50] "GET /metrics HTTP/1.1" 200 39037 "" "Prometheus/2.43.0" 2024-01-13T18:53:50.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:50 smithi099 ceph-mon[138788]: pgmap v3091: 169 pgs: 169 active+clean; 341 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 11 MiB/s wr, 154 op/s 2024-01-13T18:53:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:50 smithi099 ceph-mon[138788]: osdmap e1757: 8 total, 8 up, 8 in 2024-01-13T18:53:50.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:50 smithi084 ceph-mon[116404]: pgmap v3091: 169 pgs: 169 active+clean; 341 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 11 MiB/s wr, 154 op/s 2024-01-13T18:53:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:50 smithi084 ceph-mon[116404]: osdmap e1757: 8 total, 8 up, 8 in 2024-01-13T18:53:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:50 smithi084 ceph-mon[119097]: pgmap v3091: 169 pgs: 169 active+clean; 341 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 11 MiB/s wr, 154 op/s 2024-01-13T18:53:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:50 smithi084 ceph-mon[119097]: osdmap e1757: 8 total, 8 up, 8 in 2024-01-13T18:53:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:53:50.984 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.SnapsOtherPool (11979 ms) 2024-01-13T18:53:50.984 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.SnapsDataPool 2024-01-13T18:53:51.016 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:51.026 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:53:51.082 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:53:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:51 smithi084 ceph-mon[119097]: osdmap e1758: 8 total, 8 up, 8 in 2024-01-13T18:53:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:51 smithi084 ceph-mon[116404]: osdmap e1758: 8 total, 8 up, 8 in 2024-01-13T18:53:52.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:51 smithi099 ceph-mon[138788]: osdmap e1758: 8 total, 8 up, 8 in 2024-01-13T18:53:52.649 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 8388609~8388609 2024-01-13T18:53:52.668 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~1000 2024-01-13T18:53:52.668 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 1010~1000 2024-01-13T18:53:52.668 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:53:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:52 smithi084 ceph-mon[119097]: pgmap v3094: 169 pgs: 169 active+clean; 365 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 28 MiB/s rd, 15 MiB/s wr, 307 op/s 2024-01-13T18:53:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:52 smithi084 ceph-mon[119097]: osdmap e1759: 8 total, 8 up, 8 in 2024-01-13T18:53:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:52 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "106.7", "id": [2, 5]}]: dispatch 2024-01-13T18:53:52.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:52 smithi084 ceph-mon[116404]: pgmap v3094: 169 pgs: 169 active+clean; 365 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 28 MiB/s rd, 15 MiB/s wr, 307 op/s 2024-01-13T18:53:52.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:52 smithi084 ceph-mon[116404]: osdmap e1759: 8 total, 8 up, 8 in 2024-01-13T18:53:52.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:52 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "106.7", "id": [2, 5]}]: dispatch 2024-01-13T18:53:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:52 smithi099 ceph-mon[138788]: pgmap v3094: 169 pgs: 169 active+clean; 365 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 28 MiB/s rd, 15 MiB/s wr, 307 op/s 2024-01-13T18:53:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:52 smithi099 ceph-mon[138788]: osdmap e1759: 8 total, 8 up, 8 in 2024-01-13T18:53:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:52 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "106.7", "id": [2, 5]}]: dispatch 2024-01-13T18:53:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:53 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "106.7", "id": [2, 5]}]': finished 2024-01-13T18:53:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:53 smithi084 ceph-mon[116404]: osdmap e1760: 8 total, 8 up, 8 in 2024-01-13T18:53:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:53 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "106.7", "id": [2, 5]}]': finished 2024-01-13T18:53:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:53 smithi084 ceph-mon[119097]: osdmap e1760: 8 total, 8 up, 8 in 2024-01-13T18:53:54.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:53 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "106.7", "id": [2, 5]}]': finished 2024-01-13T18:53:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:53 smithi099 ceph-mon[138788]: osdmap e1760: 8 total, 8 up, 8 in 2024-01-13T18:53:54.658 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 8388609~1000 2024-01-13T18:53:54.664 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16777228~1000 2024-01-13T18:53:54.664 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:53:54.677 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 83886079~8388609 2024-01-13T18:53:54.692 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:53:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:54 smithi084 ceph-mon[116404]: pgmap v3097: 169 pgs: 169 active+clean; 377 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 47 MiB/s rd, 12 MiB/s wr, 461 op/s 2024-01-13T18:53:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:54 smithi084 ceph-mon[116404]: osdmap e1761: 8 total, 8 up, 8 in 2024-01-13T18:53:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:54 smithi084 ceph-mon[119097]: pgmap v3097: 169 pgs: 169 active+clean; 377 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 47 MiB/s rd, 12 MiB/s wr, 461 op/s 2024-01-13T18:53:54.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:54 smithi084 ceph-mon[119097]: osdmap e1761: 8 total, 8 up, 8 in 2024-01-13T18:53:55.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:54 smithi099 ceph-mon[138788]: pgmap v3097: 169 pgs: 169 active+clean; 377 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 47 MiB/s rd, 12 MiB/s wr, 461 op/s 2024-01-13T18:53:55.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:54 smithi099 ceph-mon[138788]: osdmap e1761: 8 total, 8 up, 8 in 2024-01-13T18:53:55.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:55 smithi084 ceph-mon[116404]: osdmap e1762: 8 total, 8 up, 8 in 2024-01-13T18:53:55.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:55 smithi084 ceph-mon[119097]: osdmap e1762: 8 total, 8 up, 8 in 2024-01-13T18:53:56.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:55 smithi099 ceph-mon[138788]: osdmap e1762: 8 total, 8 up, 8 in 2024-01-13T18:53:56.674 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:53:56.699 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 83886079~1 2024-01-13T18:53:56.708 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:53:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:56 smithi084 ceph-mon[116404]: pgmap v3100: 169 pgs: 169 active+clean; 361 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 54 MiB/s rd, 7.0 MiB/s wr, 266 op/s 2024-01-13T18:53:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:56 smithi084 ceph-mon[116404]: osdmap e1763: 8 total, 8 up, 8 in 2024-01-13T18:53:56.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:56 smithi084 ceph-mon[119097]: pgmap v3100: 169 pgs: 169 active+clean; 361 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 54 MiB/s rd, 7.0 MiB/s wr, 266 op/s 2024-01-13T18:53:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:56 smithi084 ceph-mon[119097]: osdmap e1763: 8 total, 8 up, 8 in 2024-01-13T18:53:57.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:56 smithi099 ceph-mon[138788]: pgmap v3100: 169 pgs: 169 active+clean; 361 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 54 MiB/s rd, 7.0 MiB/s wr, 266 op/s 2024-01-13T18:53:57.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:56 smithi099 ceph-mon[138788]: osdmap e1763: 8 total, 8 up, 8 in 2024-01-13T18:53:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:57 smithi084 ceph-mon[116404]: osdmap e1764: 8 total, 8 up, 8 in 2024-01-13T18:53:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:57 smithi084 ceph-mon[119097]: osdmap e1764: 8 total, 8 up, 8 in 2024-01-13T18:53:58.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:57 smithi099 ceph-mon[138788]: osdmap e1764: 8 total, 8 up, 8 in 2024-01-13T18:53:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:58 smithi084 ceph-mon[116404]: pgmap v3103: 169 pgs: 169 active+clean; 385 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 8.0 MiB/s wr, 66 op/s; 1024 KiB/s, 0 objects/s recovering 2024-01-13T18:53:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:58 smithi084 ceph-mon[116404]: osdmap e1765: 8 total, 8 up, 8 in 2024-01-13T18:53:58.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:53:58 smithi084 ceph-mon[116404]: osdmap e1766: 8 total, 8 up, 8 in 2024-01-13T18:53:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:58 smithi084 ceph-mon[119097]: pgmap v3103: 169 pgs: 169 active+clean; 385 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 8.0 MiB/s wr, 66 op/s; 1024 KiB/s, 0 objects/s recovering 2024-01-13T18:53:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:58 smithi084 ceph-mon[119097]: osdmap e1765: 8 total, 8 up, 8 in 2024-01-13T18:53:58.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:53:58 smithi084 ceph-mon[119097]: osdmap e1766: 8 total, 8 up, 8 in 2024-01-13T18:53:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:58 smithi099 ceph-mon[138788]: pgmap v3103: 169 pgs: 169 active+clean; 385 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 20 MiB/s rd, 8.0 MiB/s wr, 66 op/s; 1024 KiB/s, 0 objects/s recovering 2024-01-13T18:53:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:58 smithi099 ceph-mon[138788]: osdmap e1765: 8 total, 8 up, 8 in 2024-01-13T18:53:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:53:58 smithi099 ceph-mon[138788]: osdmap e1766: 8 total, 8 up, 8 in 2024-01-13T18:54:00.057 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:54:00.203 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:54:00.606 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:54:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:54:00] "GET /metrics HTTP/1.1" 200 39037 "" "Prometheus/2.43.0" 2024-01-13T18:54:00.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:00 smithi099 ceph-mon[138788]: pgmap v3106: 169 pgs: 169 active+clean; 393 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 8.0 MiB/s wr, 176 op/s; 1024 KiB/s, 0 objects/s recovering 2024-01-13T18:54:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:00 smithi099 ceph-mon[138788]: osdmap e1767: 8 total, 8 up, 8 in 2024-01-13T18:54:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:00 smithi084 ceph-mon[116404]: pgmap v3106: 169 pgs: 169 active+clean; 393 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 8.0 MiB/s wr, 176 op/s; 1024 KiB/s, 0 objects/s recovering 2024-01-13T18:54:00.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:00 smithi084 ceph-mon[116404]: osdmap e1767: 8 total, 8 up, 8 in 2024-01-13T18:54:00.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:00 smithi084 ceph-mon[119097]: pgmap v3106: 169 pgs: 169 active+clean; 393 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 8.0 MiB/s wr, 176 op/s; 1024 KiB/s, 0 objects/s recovering 2024-01-13T18:54:00.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:00 smithi084 ceph-mon[119097]: osdmap e1767: 8 total, 8 up, 8 in 2024-01-13T18:54:01.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:01 smithi084 ceph-mon[116404]: osdmap e1768: 8 total, 8 up, 8 in 2024-01-13T18:54:01.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:01 smithi084 ceph-mon[119097]: osdmap e1768: 8 total, 8 up, 8 in 2024-01-13T18:54:02.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:01 smithi099 ceph-mon[138788]: osdmap e1768: 8 total, 8 up, 8 in 2024-01-13T18:54:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:02 smithi084 ceph-mon[116404]: pgmap v3109: 169 pgs: 169 active+clean; 397 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 150 op/s 2024-01-13T18:54:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:02 smithi084 ceph-mon[116404]: osdmap e1769: 8 total, 8 up, 8 in 2024-01-13T18:54:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:02 smithi084 ceph-mon[119097]: pgmap v3109: 169 pgs: 169 active+clean; 397 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 150 op/s 2024-01-13T18:54:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:02 smithi084 ceph-mon[119097]: osdmap e1769: 8 total, 8 up, 8 in 2024-01-13T18:54:03.007 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.SnapsDataPool (12023 ms) 2024-01-13T18:54:03.007 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.SnapsShrinkAfterPrepare 2024-01-13T18:54:03.042 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:54:03.052 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:54:03.108 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:54:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:02 smithi099 ceph-mon[138788]: pgmap v3109: 169 pgs: 169 active+clean; 397 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 150 op/s 2024-01-13T18:54:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:02 smithi099 ceph-mon[138788]: osdmap e1769: 8 total, 8 up, 8 in 2024-01-13T18:54:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:03 smithi099 ceph-mon[138788]: osdmap e1770: 8 total, 8 up, 8 in 2024-01-13T18:54:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:03 smithi084 ceph-mon[116404]: osdmap e1770: 8 total, 8 up, 8 in 2024-01-13T18:54:04.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:03 smithi084 ceph-mon[119097]: osdmap e1770: 8 total, 8 up, 8 in 2024-01-13T18:54:04.719 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 8388609~8388609 2024-01-13T18:54:04.737 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~1000 2024-01-13T18:54:04.737 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 1010~1000 2024-01-13T18:54:04.737 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:54:05.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:04 smithi099 ceph-mon[138788]: pgmap v3112: 169 pgs: 169 active+clean; 401 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 29 MiB/s rd, 3.0 MiB/s wr, 87 op/s 2024-01-13T18:54:05.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:04 smithi099 ceph-mon[138788]: osdmap e1771: 8 total, 8 up, 8 in 2024-01-13T18:54:05.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:04 smithi084 ceph-mon[116404]: pgmap v3112: 169 pgs: 169 active+clean; 401 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 29 MiB/s rd, 3.0 MiB/s wr, 87 op/s 2024-01-13T18:54:05.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:04 smithi084 ceph-mon[116404]: osdmap e1771: 8 total, 8 up, 8 in 2024-01-13T18:54:05.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:04 smithi084 ceph-mon[119097]: pgmap v3112: 169 pgs: 169 active+clean; 401 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 29 MiB/s rd, 3.0 MiB/s wr, 87 op/s 2024-01-13T18:54:05.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:04 smithi084 ceph-mon[119097]: osdmap e1771: 8 total, 8 up, 8 in 2024-01-13T18:54:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:05 smithi099 ceph-mon[138788]: osdmap e1772: 8 total, 8 up, 8 in 2024-01-13T18:54:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:05 smithi084 ceph-mon[116404]: osdmap e1772: 8 total, 8 up, 8 in 2024-01-13T18:54:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:06.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:05 smithi084 ceph-mon[119097]: osdmap e1772: 8 total, 8 up, 8 in 2024-01-13T18:54:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:06.731 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 8388609~1000 2024-01-13T18:54:06.737 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16777228~1000 2024-01-13T18:54:06.737 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:54:06.747 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 83886079~8388609 2024-01-13T18:54:06.762 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:54:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:06 smithi099 ceph-mon[138788]: pgmap v3115: 169 pgs: 169 active+clean; 417 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 42 MiB/s rd, 9.0 MiB/s wr, 455 op/s 2024-01-13T18:54:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:06 smithi099 ceph-mon[138788]: osdmap e1773: 8 total, 8 up, 8 in 2024-01-13T18:54:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:06 smithi084 ceph-mon[116404]: pgmap v3115: 169 pgs: 169 active+clean; 417 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 42 MiB/s rd, 9.0 MiB/s wr, 455 op/s 2024-01-13T18:54:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:06 smithi084 ceph-mon[116404]: osdmap e1773: 8 total, 8 up, 8 in 2024-01-13T18:54:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:06 smithi084 ceph-mon[119097]: pgmap v3115: 169 pgs: 169 active+clean; 417 MiB data, 5.7 GiB used, 710 GiB / 715 GiB avail; 42 MiB/s rd, 9.0 MiB/s wr, 455 op/s 2024-01-13T18:54:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:06 smithi084 ceph-mon[119097]: osdmap e1773: 8 total, 8 up, 8 in 2024-01-13T18:54:08.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:07 smithi099 ceph-mon[138788]: osdmap e1774: 8 total, 8 up, 8 in 2024-01-13T18:54:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:07 smithi084 ceph-mon[116404]: osdmap e1774: 8 total, 8 up, 8 in 2024-01-13T18:54:08.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:07 smithi084 ceph-mon[119097]: osdmap e1774: 8 total, 8 up, 8 in 2024-01-13T18:54:08.622 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:54:08.647 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 83886079~1 2024-01-13T18:54:08.656 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:54:09.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:08 smithi099 ceph-mon[138788]: pgmap v3118: 169 pgs: 169 active+clean; 425 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 28 MiB/s rd, 10 MiB/s wr, 418 op/s 2024-01-13T18:54:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:08 smithi099 ceph-mon[138788]: osdmap e1775: 8 total, 8 up, 8 in 2024-01-13T18:54:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:08 smithi099 ceph-mon[138788]: osdmap e1776: 8 total, 8 up, 8 in 2024-01-13T18:54:09.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:08 smithi084 ceph-mon[119097]: pgmap v3118: 169 pgs: 169 active+clean; 425 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 28 MiB/s rd, 10 MiB/s wr, 418 op/s 2024-01-13T18:54:09.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:08 smithi084 ceph-mon[119097]: osdmap e1775: 8 total, 8 up, 8 in 2024-01-13T18:54:09.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:08 smithi084 ceph-mon[119097]: osdmap e1776: 8 total, 8 up, 8 in 2024-01-13T18:54:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:08 smithi084 ceph-mon[116404]: pgmap v3118: 169 pgs: 169 active+clean; 425 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 28 MiB/s rd, 10 MiB/s wr, 418 op/s 2024-01-13T18:54:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:08 smithi084 ceph-mon[116404]: osdmap e1775: 8 total, 8 up, 8 in 2024-01-13T18:54:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:08 smithi084 ceph-mon[116404]: osdmap e1776: 8 total, 8 up, 8 in 2024-01-13T18:54:10.617 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:54:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:54:10] "GET /metrics HTTP/1.1" 200 39039 "" "Prometheus/2.43.0" 2024-01-13T18:54:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:10 smithi084 ceph-mon[116404]: pgmap v3121: 169 pgs: 169 active+clean; 433 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 27 MiB/s rd, 6.0 MiB/s wr, 126 op/s 2024-01-13T18:54:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:10 smithi084 ceph-mon[116404]: osdmap e1777: 8 total, 8 up, 8 in 2024-01-13T18:54:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:10 smithi084 ceph-mon[119097]: pgmap v3121: 169 pgs: 169 active+clean; 433 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 27 MiB/s rd, 6.0 MiB/s wr, 126 op/s 2024-01-13T18:54:10.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:10 smithi084 ceph-mon[119097]: osdmap e1777: 8 total, 8 up, 8 in 2024-01-13T18:54:11.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:10 smithi099 ceph-mon[138788]: pgmap v3121: 169 pgs: 169 active+clean; 433 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 27 MiB/s rd, 6.0 MiB/s wr, 126 op/s 2024-01-13T18:54:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:10 smithi099 ceph-mon[138788]: osdmap e1777: 8 total, 8 up, 8 in 2024-01-13T18:54:11.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:11 smithi084 ceph-mon[116404]: osdmap e1778: 8 total, 8 up, 8 in 2024-01-13T18:54:11.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:11 smithi084 ceph-mon[119097]: osdmap e1778: 8 total, 8 up, 8 in 2024-01-13T18:54:12.088 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 41943040 2024-01-13T18:54:12.110 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:54:12.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:11 smithi099 ceph-mon[138788]: osdmap e1778: 8 total, 8 up, 8 in 2024-01-13T18:54:12.265 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:54:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:12 smithi084 ceph-mon[116404]: pgmap v3124: 169 pgs: 169 active+clean; 437 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 3.0 MiB/s wr, 150 op/s 2024-01-13T18:54:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:12 smithi084 ceph-mon[116404]: osdmap e1779: 8 total, 8 up, 8 in 2024-01-13T18:54:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:12 smithi084 ceph-mon[119097]: pgmap v3124: 169 pgs: 169 active+clean; 437 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 3.0 MiB/s wr, 150 op/s 2024-01-13T18:54:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:12 smithi084 ceph-mon[119097]: osdmap e1779: 8 total, 8 up, 8 in 2024-01-13T18:54:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:12 smithi099 ceph-mon[138788]: pgmap v3124: 169 pgs: 169 active+clean; 437 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 13 MiB/s rd, 3.0 MiB/s wr, 150 op/s 2024-01-13T18:54:13.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:12 smithi099 ceph-mon[138788]: osdmap e1779: 8 total, 8 up, 8 in 2024-01-13T18:54:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:13 smithi084 ceph-mon[116404]: osdmap e1780: 8 total, 8 up, 8 in 2024-01-13T18:54:13.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:13 smithi084 ceph-mon[116404]: osdmap e1781: 8 total, 8 up, 8 in 2024-01-13T18:54:13.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:13 smithi084 ceph-mon[119097]: osdmap e1780: 8 total, 8 up, 8 in 2024-01-13T18:54:13.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:13 smithi084 ceph-mon[119097]: osdmap e1781: 8 total, 8 up, 8 in 2024-01-13T18:54:14.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:13 smithi099 ceph-mon[138788]: osdmap e1780: 8 total, 8 up, 8 in 2024-01-13T18:54:14.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:13 smithi099 ceph-mon[138788]: osdmap e1781: 8 total, 8 up, 8 in 2024-01-13T18:54:14.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:14 smithi084 ceph-mon[116404]: pgmap v3127: 169 pgs: 169 active+clean; 457 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.0 MiB/s wr, 201 op/s 2024-01-13T18:54:14.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:14 smithi084 ceph-mon[119097]: pgmap v3127: 169 pgs: 169 active+clean; 457 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.0 MiB/s wr, 201 op/s 2024-01-13T18:54:14.952 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.SnapsShrinkAfterPrepare (11946 ms) 2024-01-13T18:54:14.953 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.SnapsShrinkToZeroBeforePrepare 2024-01-13T18:54:14.982 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:54:14.992 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:54:15.048 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:54:15.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:14 smithi099 ceph-mon[138788]: pgmap v3127: 169 pgs: 169 active+clean; 457 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.0 MiB/s wr, 201 op/s 2024-01-13T18:54:15.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:15 smithi084 ceph-mon[116404]: osdmap e1782: 8 total, 8 up, 8 in 2024-01-13T18:54:15.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:15 smithi084 ceph-mon[119097]: osdmap e1782: 8 total, 8 up, 8 in 2024-01-13T18:54:16.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:15 smithi099 ceph-mon[138788]: osdmap e1782: 8 total, 8 up, 8 in 2024-01-13T18:54:16.677 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 8388609~8388609 2024-01-13T18:54:16.691 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~1000 2024-01-13T18:54:16.692 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 1010~1000 2024-01-13T18:54:16.692 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:54:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:16 smithi084 ceph-mon[116404]: pgmap v3130: 169 pgs: 169 active+clean; 465 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 22 MiB/s rd, 4.0 MiB/s wr, 339 op/s 2024-01-13T18:54:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:16 smithi084 ceph-mon[116404]: osdmap e1783: 8 total, 8 up, 8 in 2024-01-13T18:54:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:16 smithi084 ceph-mon[119097]: pgmap v3130: 169 pgs: 169 active+clean; 465 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 22 MiB/s rd, 4.0 MiB/s wr, 339 op/s 2024-01-13T18:54:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:16 smithi084 ceph-mon[119097]: osdmap e1783: 8 total, 8 up, 8 in 2024-01-13T18:54:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:16 smithi099 ceph-mon[138788]: pgmap v3130: 169 pgs: 169 active+clean; 465 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 22 MiB/s rd, 4.0 MiB/s wr, 339 op/s 2024-01-13T18:54:17.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:16 smithi099 ceph-mon[138788]: osdmap e1783: 8 total, 8 up, 8 in 2024-01-13T18:54:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:17 smithi084 ceph-mon[116404]: osdmap e1784: 8 total, 8 up, 8 in 2024-01-13T18:54:17.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:17 smithi084 ceph-mon[119097]: osdmap e1784: 8 total, 8 up, 8 in 2024-01-13T18:54:18.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:17 smithi099 ceph-mon[138788]: osdmap e1784: 8 total, 8 up, 8 in 2024-01-13T18:54:18.622 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 8388609~1000 2024-01-13T18:54:18.628 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16777228~1000 2024-01-13T18:54:18.628 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:54:18.639 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 83886079~8388609 2024-01-13T18:54:18.650 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:54:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:18 smithi084 ceph-mon[119097]: pgmap v3133: 169 pgs: 169 active+clean; 461 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 48 MiB/s rd, 5.0 MiB/s wr, 445 op/s 2024-01-13T18:54:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:18 smithi084 ceph-mon[119097]: osdmap e1785: 8 total, 8 up, 8 in 2024-01-13T18:54:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:18 smithi084 ceph-mon[119097]: osdmap e1786: 8 total, 8 up, 8 in 2024-01-13T18:54:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:18 smithi084 ceph-mon[116404]: pgmap v3133: 169 pgs: 169 active+clean; 461 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 48 MiB/s rd, 5.0 MiB/s wr, 445 op/s 2024-01-13T18:54:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:18 smithi084 ceph-mon[116404]: osdmap e1785: 8 total, 8 up, 8 in 2024-01-13T18:54:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:18 smithi084 ceph-mon[116404]: osdmap e1786: 8 total, 8 up, 8 in 2024-01-13T18:54:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:18 smithi099 ceph-mon[138788]: pgmap v3133: 169 pgs: 169 active+clean; 461 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 48 MiB/s rd, 5.0 MiB/s wr, 445 op/s 2024-01-13T18:54:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:18 smithi099 ceph-mon[138788]: osdmap e1785: 8 total, 8 up, 8 in 2024-01-13T18:54:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:18 smithi099 ceph-mon[138788]: osdmap e1786: 8 total, 8 up, 8 in 2024-01-13T18:54:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:54:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:54:20] "GET /metrics HTTP/1.1" 200 39039 "" "Prometheus/2.43.0" 2024-01-13T18:54:20.702 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:54:20.725 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 83886079~1 2024-01-13T18:54:20.733 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 0 2024-01-13T18:54:20.749 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:54:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:20 smithi099 ceph-mon[138788]: pgmap v3136: 169 pgs: 169 active+clean; 489 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 47 MiB/s rd, 11 MiB/s wr, 258 op/s 2024-01-13T18:54:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:20 smithi099 ceph-mon[138788]: osdmap e1787: 8 total, 8 up, 8 in 2024-01-13T18:54:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:20 smithi084 ceph-mon[116404]: pgmap v3136: 169 pgs: 169 active+clean; 489 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 47 MiB/s rd, 11 MiB/s wr, 258 op/s 2024-01-13T18:54:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:20 smithi084 ceph-mon[116404]: osdmap e1787: 8 total, 8 up, 8 in 2024-01-13T18:54:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:21.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:20 smithi084 ceph-mon[119097]: pgmap v3136: 169 pgs: 169 active+clean; 489 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 47 MiB/s rd, 11 MiB/s wr, 258 op/s 2024-01-13T18:54:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:20 smithi084 ceph-mon[119097]: osdmap e1787: 8 total, 8 up, 8 in 2024-01-13T18:54:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:22.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:21 smithi099 ceph-mon[138788]: osdmap e1788: 8 total, 8 up, 8 in 2024-01-13T18:54:22.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:21 smithi084 ceph-mon[116404]: osdmap e1788: 8 total, 8 up, 8 in 2024-01-13T18:54:22.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:21 smithi084 ceph-mon[119097]: osdmap e1788: 8 total, 8 up, 8 in 2024-01-13T18:54:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:22 smithi099 ceph-mon[138788]: pgmap v3139: 169 pgs: 169 active+clean; 493 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 15 MiB/s rd, 9.0 MiB/s wr, 55 op/s 2024-01-13T18:54:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:22 smithi099 ceph-mon[138788]: osdmap e1789: 8 total, 8 up, 8 in 2024-01-13T18:54:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:22 smithi084 ceph-mon[116404]: pgmap v3139: 169 pgs: 169 active+clean; 493 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 15 MiB/s rd, 9.0 MiB/s wr, 55 op/s 2024-01-13T18:54:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:22 smithi084 ceph-mon[116404]: osdmap e1789: 8 total, 8 up, 8 in 2024-01-13T18:54:23.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:22 smithi084 ceph-mon[119097]: pgmap v3139: 169 pgs: 169 active+clean; 493 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 15 MiB/s rd, 9.0 MiB/s wr, 55 op/s 2024-01-13T18:54:23.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:22 smithi084 ceph-mon[119097]: osdmap e1789: 8 total, 8 up, 8 in 2024-01-13T18:54:23.986 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:54:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:23 smithi099 ceph-mon[138788]: osdmap e1790: 8 total, 8 up, 8 in 2024-01-13T18:54:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:23 smithi099 ceph-mon[138788]: osdmap e1791: 8 total, 8 up, 8 in 2024-01-13T18:54:24.123 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:54:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:23 smithi084 ceph-mon[116404]: osdmap e1790: 8 total, 8 up, 8 in 2024-01-13T18:54:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:23 smithi084 ceph-mon[116404]: osdmap e1791: 8 total, 8 up, 8 in 2024-01-13T18:54:24.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:23 smithi084 ceph-mon[119097]: osdmap e1790: 8 total, 8 up, 8 in 2024-01-13T18:54:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:23 smithi084 ceph-mon[119097]: osdmap e1791: 8 total, 8 up, 8 in 2024-01-13T18:54:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:24 smithi099 ceph-mon[138788]: pgmap v3142: 169 pgs: 169 active+clean; 509 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 MiB/s wr, 177 op/s 2024-01-13T18:54:25.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:24 smithi084 ceph-mon[116404]: pgmap v3142: 169 pgs: 169 active+clean; 509 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 MiB/s wr, 177 op/s 2024-01-13T18:54:25.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:24 smithi084 ceph-mon[119097]: pgmap v3142: 169 pgs: 169 active+clean; 509 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 MiB/s wr, 177 op/s 2024-01-13T18:54:26.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:25 smithi099 ceph-mon[138788]: osdmap e1792: 8 total, 8 up, 8 in 2024-01-13T18:54:26.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:25 smithi084 ceph-mon[119097]: osdmap e1792: 8 total, 8 up, 8 in 2024-01-13T18:54:26.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:25 smithi084 ceph-mon[116404]: osdmap e1792: 8 total, 8 up, 8 in 2024-01-13T18:54:26.981 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.SnapsShrinkToZeroBeforePrepare (12028 ms) 2024-01-13T18:54:26.981 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.SnapsShrinkToZeroAfterPrepare 2024-01-13T18:54:27.013 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:54:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:54:27.089 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:54:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:26 smithi099 ceph-mon[138788]: pgmap v3145: 169 pgs: 169 active+clean; 509 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 MiB/s rd, 3.0 MiB/s wr, 354 op/s 2024-01-13T18:54:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:26 smithi099 ceph-mon[138788]: osdmap e1793: 8 total, 8 up, 8 in 2024-01-13T18:54:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:26 smithi084 ceph-mon[116404]: pgmap v3145: 169 pgs: 169 active+clean; 509 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 MiB/s rd, 3.0 MiB/s wr, 354 op/s 2024-01-13T18:54:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:26 smithi084 ceph-mon[116404]: osdmap e1793: 8 total, 8 up, 8 in 2024-01-13T18:54:27.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:26 smithi084 ceph-mon[119097]: pgmap v3145: 169 pgs: 169 active+clean; 509 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 MiB/s rd, 3.0 MiB/s wr, 354 op/s 2024-01-13T18:54:27.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:26 smithi084 ceph-mon[119097]: osdmap e1793: 8 total, 8 up, 8 in 2024-01-13T18:54:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:27 smithi099 ceph-mon[138788]: osdmap e1794: 8 total, 8 up, 8 in 2024-01-13T18:54:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:27 smithi084 ceph-mon[116404]: osdmap e1794: 8 total, 8 up, 8 in 2024-01-13T18:54:28.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:27 smithi084 ceph-mon[119097]: osdmap e1794: 8 total, 8 up, 8 in 2024-01-13T18:54:28.769 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 8388609~8388609 2024-01-13T18:54:28.781 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~1000 2024-01-13T18:54:28.782 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 1010~1000 2024-01-13T18:54:28.782 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:54:29.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:28 smithi099 ceph-mon[138788]: pgmap v3148: 169 pgs: 169 active+clean; 517 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 20 MiB/s rd, 5.0 MiB/s wr, 408 op/s 2024-01-13T18:54:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:28 smithi099 ceph-mon[138788]: osdmap e1795: 8 total, 8 up, 8 in 2024-01-13T18:54:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:54:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:54:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:54:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:54:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[116404]: pgmap v3148: 169 pgs: 169 active+clean; 517 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 20 MiB/s rd, 5.0 MiB/s wr, 408 op/s 2024-01-13T18:54:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[116404]: osdmap e1795: 8 total, 8 up, 8 in 2024-01-13T18:54:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:54:29.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:54:29.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:54:29.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:54:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[119097]: pgmap v3148: 169 pgs: 169 active+clean; 517 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 20 MiB/s rd, 5.0 MiB/s wr, 408 op/s 2024-01-13T18:54:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[119097]: osdmap e1795: 8 total, 8 up, 8 in 2024-01-13T18:54:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:54:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:54:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:54:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:54:30.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:29 smithi099 ceph-mon[138788]: osdmap e1796: 8 total, 8 up, 8 in 2024-01-13T18:54:30.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:29 smithi099 ceph-mon[138788]: pgmap v3151: 169 pgs: 169 active+clean; 521 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 33 MiB/s rd, 8.0 MiB/s wr, 241 op/s 2024-01-13T18:54:30.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:29 smithi084 ceph-mon[116404]: osdmap e1796: 8 total, 8 up, 8 in 2024-01-13T18:54:30.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:29 smithi084 ceph-mon[116404]: pgmap v3151: 169 pgs: 169 active+clean; 521 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 33 MiB/s rd, 8.0 MiB/s wr, 241 op/s 2024-01-13T18:54:30.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:29 smithi084 ceph-mon[119097]: osdmap e1796: 8 total, 8 up, 8 in 2024-01-13T18:54:30.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:29 smithi084 ceph-mon[119097]: pgmap v3151: 169 pgs: 169 active+clean; 521 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 33 MiB/s rd, 8.0 MiB/s wr, 241 op/s 2024-01-13T18:54:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:54:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:54:30] "GET /metrics HTTP/1.1" 200 39039 "" "Prometheus/2.43.0" 2024-01-13T18:54:30.781 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 8388609~1000 2024-01-13T18:54:30.787 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16777228~1000 2024-01-13T18:54:30.787 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:54:30.798 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 83886079~8388609 2024-01-13T18:54:30.807 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:54:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:30 smithi099 ceph-mon[138788]: osdmap e1797: 8 total, 8 up, 8 in 2024-01-13T18:54:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:30 smithi084 ceph-mon[116404]: osdmap e1797: 8 total, 8 up, 8 in 2024-01-13T18:54:31.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:30 smithi084 ceph-mon[119097]: osdmap e1797: 8 total, 8 up, 8 in 2024-01-13T18:54:32.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:31 smithi099 ceph-mon[138788]: osdmap e1798: 8 total, 8 up, 8 in 2024-01-13T18:54:32.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:31 smithi099 ceph-mon[138788]: pgmap v3154: 169 pgs: 169 active+clean; 525 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 26 MiB/s rd, 5.0 MiB/s wr, 111 op/s 2024-01-13T18:54:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:31 smithi084 ceph-mon[116404]: osdmap e1798: 8 total, 8 up, 8 in 2024-01-13T18:54:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:31 smithi084 ceph-mon[116404]: pgmap v3154: 169 pgs: 169 active+clean; 525 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 26 MiB/s rd, 5.0 MiB/s wr, 111 op/s 2024-01-13T18:54:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:31 smithi084 ceph-mon[119097]: osdmap e1798: 8 total, 8 up, 8 in 2024-01-13T18:54:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:31 smithi084 ceph-mon[119097]: pgmap v3154: 169 pgs: 169 active+clean; 525 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 26 MiB/s rd, 5.0 MiB/s wr, 111 op/s 2024-01-13T18:54:32.794 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:54:32.818 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 83886079~1 2024-01-13T18:54:32.827 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:54:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:32 smithi099 ceph-mon[138788]: osdmap e1799: 8 total, 8 up, 8 in 2024-01-13T18:54:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:32 smithi084 ceph-mon[116404]: osdmap e1799: 8 total, 8 up, 8 in 2024-01-13T18:54:33.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:32 smithi084 ceph-mon[119097]: osdmap e1799: 8 total, 8 up, 8 in 2024-01-13T18:54:34.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:33 smithi099 ceph-mon[138788]: osdmap e1800: 8 total, 8 up, 8 in 2024-01-13T18:54:34.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:33 smithi099 ceph-mon[138788]: pgmap v3157: 169 pgs: 169 active+clean; 561 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 9.1 MiB/s rd, 9.0 MiB/s wr, 106 op/s 2024-01-13T18:54:34.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:33 smithi099 ceph-mon[138788]: osdmap e1801: 8 total, 8 up, 8 in 2024-01-13T18:54:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:33 smithi084 ceph-mon[116404]: osdmap e1800: 8 total, 8 up, 8 in 2024-01-13T18:54:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:33 smithi084 ceph-mon[116404]: pgmap v3157: 169 pgs: 169 active+clean; 561 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 9.1 MiB/s rd, 9.0 MiB/s wr, 106 op/s 2024-01-13T18:54:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:33 smithi084 ceph-mon[116404]: osdmap e1801: 8 total, 8 up, 8 in 2024-01-13T18:54:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:33 smithi084 ceph-mon[119097]: osdmap e1800: 8 total, 8 up, 8 in 2024-01-13T18:54:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:33 smithi084 ceph-mon[119097]: pgmap v3157: 169 pgs: 169 active+clean; 561 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 9.1 MiB/s rd, 9.0 MiB/s wr, 106 op/s 2024-01-13T18:54:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:33 smithi084 ceph-mon[119097]: osdmap e1801: 8 total, 8 up, 8 in 2024-01-13T18:54:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:35 smithi084 ceph-mon[119097]: osdmap e1802: 8 total, 8 up, 8 in 2024-01-13T18:54:35.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:35 smithi084 ceph-mon[116404]: osdmap e1802: 8 total, 8 up, 8 in 2024-01-13T18:54:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:36.056 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 0 2024-01-13T18:54:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:35 smithi099 ceph-mon[138788]: osdmap e1802: 8 total, 8 up, 8 in 2024-01-13T18:54:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:36.138 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:54:36.251 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:54:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:36 smithi084 ceph-mon[116404]: pgmap v3160: 169 pgs: 169 active+clean; 565 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.0 MiB/s wr, 177 op/s 2024-01-13T18:54:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:36 smithi084 ceph-mon[116404]: osdmap e1803: 8 total, 8 up, 8 in 2024-01-13T18:54:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:36 smithi084 ceph-mon[119097]: pgmap v3160: 169 pgs: 169 active+clean; 565 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.0 MiB/s wr, 177 op/s 2024-01-13T18:54:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:36 smithi084 ceph-mon[119097]: osdmap e1803: 8 total, 8 up, 8 in 2024-01-13T18:54:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:36 smithi099 ceph-mon[138788]: pgmap v3160: 169 pgs: 169 active+clean; 565 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.0 MiB/s wr, 177 op/s 2024-01-13T18:54:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:36 smithi099 ceph-mon[138788]: osdmap e1803: 8 total, 8 up, 8 in 2024-01-13T18:54:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:37 smithi084 ceph-mon[116404]: osdmap e1804: 8 total, 8 up, 8 in 2024-01-13T18:54:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:37 smithi084 ceph-mon[119097]: osdmap e1804: 8 total, 8 up, 8 in 2024-01-13T18:54:38.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:37 smithi099 ceph-mon[138788]: osdmap e1804: 8 total, 8 up, 8 in 2024-01-13T18:54:38.875 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.SnapsShrinkToZeroAfterPrepare (11894 ms) 2024-01-13T18:54:38.875 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.SnapsExpandAfterPrepare 2024-01-13T18:54:38.909 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:54:38.919 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:54:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:38 smithi084 ceph-mon[116404]: pgmap v3163: 169 pgs: 169 active+clean; 569 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 20 MiB/s rd, 3.0 MiB/s wr, 218 op/s 2024-01-13T18:54:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:38 smithi084 ceph-mon[116404]: osdmap e1805: 8 total, 8 up, 8 in 2024-01-13T18:54:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:38 smithi084 ceph-mon[116404]: osdmap e1806: 8 total, 8 up, 8 in 2024-01-13T18:54:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:38 smithi084 ceph-mon[119097]: pgmap v3163: 169 pgs: 169 active+clean; 569 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 20 MiB/s rd, 3.0 MiB/s wr, 218 op/s 2024-01-13T18:54:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:38 smithi084 ceph-mon[119097]: osdmap e1805: 8 total, 8 up, 8 in 2024-01-13T18:54:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:38 smithi084 ceph-mon[119097]: osdmap e1806: 8 total, 8 up, 8 in 2024-01-13T18:54:38.985 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:54:39.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:38 smithi099 ceph-mon[138788]: pgmap v3163: 169 pgs: 169 active+clean; 569 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 20 MiB/s rd, 3.0 MiB/s wr, 218 op/s 2024-01-13T18:54:39.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:38 smithi099 ceph-mon[138788]: osdmap e1805: 8 total, 8 up, 8 in 2024-01-13T18:54:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:38 smithi099 ceph-mon[138788]: osdmap e1806: 8 total, 8 up, 8 in 2024-01-13T18:54:40.667 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:54:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:54:40] "GET /metrics HTTP/1.1" 200 39042 "" "Prometheus/2.43.0" 2024-01-13T18:54:40.685 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 8388609~8388609 2024-01-13T18:54:40.697 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~1000 2024-01-13T18:54:40.697 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 1010~1000 2024-01-13T18:54:40.697 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:54:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:40 smithi084 ceph-mon[116404]: pgmap v3166: 169 pgs: 169 active+clean; 577 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 35 MiB/s rd, 4.0 MiB/s wr, 115 op/s 2024-01-13T18:54:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:40 smithi084 ceph-mon[116404]: osdmap e1807: 8 total, 8 up, 8 in 2024-01-13T18:54:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:40 smithi084 ceph-mon[119097]: pgmap v3166: 169 pgs: 169 active+clean; 577 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 35 MiB/s rd, 4.0 MiB/s wr, 115 op/s 2024-01-13T18:54:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:40 smithi084 ceph-mon[119097]: osdmap e1807: 8 total, 8 up, 8 in 2024-01-13T18:54:41.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:40 smithi099 ceph-mon[138788]: pgmap v3166: 169 pgs: 169 active+clean; 577 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 35 MiB/s rd, 4.0 MiB/s wr, 115 op/s 2024-01-13T18:54:41.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:40 smithi099 ceph-mon[138788]: osdmap e1807: 8 total, 8 up, 8 in 2024-01-13T18:54:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:41 smithi084 ceph-mon[116404]: osdmap e1808: 8 total, 8 up, 8 in 2024-01-13T18:54:41.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:41 smithi084 ceph-mon[119097]: osdmap e1808: 8 total, 8 up, 8 in 2024-01-13T18:54:42.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:41 smithi099 ceph-mon[138788]: osdmap e1808: 8 total, 8 up, 8 in 2024-01-13T18:54:42.696 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 8388609~1000 2024-01-13T18:54:42.705 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16777228~1000 2024-01-13T18:54:42.705 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:54:42.714 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 83886079~8388609 2024-01-13T18:54:42.723 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:54:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:42 smithi084 ceph-mon[116404]: pgmap v3169: 169 pgs: 169 active+clean; 581 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 31 MiB/s rd, 4.0 MiB/s wr, 421 op/s 2024-01-13T18:54:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:42 smithi084 ceph-mon[116404]: osdmap e1809: 8 total, 8 up, 8 in 2024-01-13T18:54:42.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:42 smithi084 ceph-mon[119097]: pgmap v3169: 169 pgs: 169 active+clean; 581 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 31 MiB/s rd, 4.0 MiB/s wr, 421 op/s 2024-01-13T18:54:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:42 smithi084 ceph-mon[119097]: osdmap e1809: 8 total, 8 up, 8 in 2024-01-13T18:54:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:42 smithi099 ceph-mon[138788]: pgmap v3169: 169 pgs: 169 active+clean; 581 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 31 MiB/s rd, 4.0 MiB/s wr, 421 op/s 2024-01-13T18:54:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:42 smithi099 ceph-mon[138788]: osdmap e1809: 8 total, 8 up, 8 in 2024-01-13T18:54:44.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:43 smithi099 ceph-mon[138788]: osdmap e1810: 8 total, 8 up, 8 in 2024-01-13T18:54:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:43 smithi099 ceph-mon[138788]: osdmap e1811: 8 total, 8 up, 8 in 2024-01-13T18:54:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:43 smithi084 ceph-mon[116404]: osdmap e1810: 8 total, 8 up, 8 in 2024-01-13T18:54:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:43 smithi084 ceph-mon[116404]: osdmap e1811: 8 total, 8 up, 8 in 2024-01-13T18:54:44.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:43 smithi084 ceph-mon[119097]: osdmap e1810: 8 total, 8 up, 8 in 2024-01-13T18:54:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:43 smithi084 ceph-mon[119097]: osdmap e1811: 8 total, 8 up, 8 in 2024-01-13T18:54:44.632 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:54:44.661 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 83886079~1 2024-01-13T18:54:44.670 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:54:45.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:44 smithi099 ceph-mon[138788]: pgmap v3172: 169 pgs: 169 active+clean; 593 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 30 MiB/s rd, 9.0 MiB/s wr, 425 op/s 2024-01-13T18:54:45.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:44 smithi099 ceph-mon[138788]: osdmap e1812: 8 total, 8 up, 8 in 2024-01-13T18:54:45.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:44 smithi084 ceph-mon[116404]: pgmap v3172: 169 pgs: 169 active+clean; 593 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 30 MiB/s rd, 9.0 MiB/s wr, 425 op/s 2024-01-13T18:54:45.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:44 smithi084 ceph-mon[116404]: osdmap e1812: 8 total, 8 up, 8 in 2024-01-13T18:54:45.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:44 smithi084 ceph-mon[119097]: pgmap v3172: 169 pgs: 169 active+clean; 593 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 30 MiB/s rd, 9.0 MiB/s wr, 425 op/s 2024-01-13T18:54:45.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:44 smithi084 ceph-mon[119097]: osdmap e1812: 8 total, 8 up, 8 in 2024-01-13T18:54:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:46 smithi099 ceph-mon[138788]: pgmap v3175: 169 pgs: 169 active+clean; 605 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 15 MiB/s rd, 10 MiB/s wr, 148 op/s 2024-01-13T18:54:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:46 smithi099 ceph-mon[138788]: osdmap e1813: 8 total, 8 up, 8 in 2024-01-13T18:54:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:46 smithi084 ceph-mon[116404]: pgmap v3175: 169 pgs: 169 active+clean; 605 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 15 MiB/s rd, 10 MiB/s wr, 148 op/s 2024-01-13T18:54:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:46 smithi084 ceph-mon[116404]: osdmap e1813: 8 total, 8 up, 8 in 2024-01-13T18:54:47.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:46 smithi084 ceph-mon[119097]: pgmap v3175: 169 pgs: 169 active+clean; 605 MiB data, 6.2 GiB used, 709 GiB / 715 GiB avail; 15 MiB/s rd, 10 MiB/s wr, 148 op/s 2024-01-13T18:54:47.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:46 smithi084 ceph-mon[119097]: osdmap e1813: 8 total, 8 up, 8 in 2024-01-13T18:54:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:47 smithi099 ceph-mon[138788]: osdmap e1814: 8 total, 8 up, 8 in 2024-01-13T18:54:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:47 smithi084 ceph-mon[116404]: osdmap e1814: 8 total, 8 up, 8 in 2024-01-13T18:54:48.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:47 smithi084 ceph-mon[119097]: osdmap e1814: 8 total, 8 up, 8 in 2024-01-13T18:54:48.184 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:54:48.195 INFO:tasks.workunit.client.0.smithi084.stdout:write: * 83886080~1000 2024-01-13T18:54:48.230 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:54:48.369 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:54:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:48 smithi099 ceph-mon[138788]: pgmap v3178: 169 pgs: 169 active+clean; 617 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 MiB/s wr, 139 op/s 2024-01-13T18:54:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:48 smithi099 ceph-mon[138788]: osdmap e1815: 8 total, 8 up, 8 in 2024-01-13T18:54:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:48 smithi099 ceph-mon[138788]: osdmap e1816: 8 total, 8 up, 8 in 2024-01-13T18:54:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:48 smithi084 ceph-mon[116404]: pgmap v3178: 169 pgs: 169 active+clean; 617 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 MiB/s wr, 139 op/s 2024-01-13T18:54:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:48 smithi084 ceph-mon[116404]: osdmap e1815: 8 total, 8 up, 8 in 2024-01-13T18:54:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:48 smithi084 ceph-mon[116404]: osdmap e1816: 8 total, 8 up, 8 in 2024-01-13T18:54:49.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:48 smithi084 ceph-mon[119097]: pgmap v3178: 169 pgs: 169 active+clean; 617 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 MiB/s wr, 139 op/s 2024-01-13T18:54:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:48 smithi084 ceph-mon[119097]: osdmap e1815: 8 total, 8 up, 8 in 2024-01-13T18:54:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:48 smithi084 ceph-mon[119097]: osdmap e1816: 8 total, 8 up, 8 in 2024-01-13T18:54:50.624 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:54:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:54:50] "GET /metrics HTTP/1.1" 200 39036 "" "Prometheus/2.43.0" 2024-01-13T18:54:50.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:50 smithi084 ceph-mon[119097]: pgmap v3181: 169 pgs: 169 active+clean; 617 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 7.2 MiB/s rd, 2.0 MiB/s wr, 266 op/s 2024-01-13T18:54:50.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:50 smithi084 ceph-mon[119097]: osdmap e1817: 8 total, 8 up, 8 in 2024-01-13T18:54:50.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:50 smithi084 ceph-mon[116404]: pgmap v3181: 169 pgs: 169 active+clean; 617 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 7.2 MiB/s rd, 2.0 MiB/s wr, 266 op/s 2024-01-13T18:54:50.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:50 smithi084 ceph-mon[116404]: osdmap e1817: 8 total, 8 up, 8 in 2024-01-13T18:54:50.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:50.989 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.SnapsExpandAfterPrepare (12115 ms) 2024-01-13T18:54:50.990 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.SnapsExpandAfterPrepare2 2024-01-13T18:54:51.021 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:54:51.031 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 41943040~10 2024-01-13T18:54:51.040 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:54:51.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:50 smithi099 ceph-mon[138788]: pgmap v3181: 169 pgs: 169 active+clean; 617 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 7.2 MiB/s rd, 2.0 MiB/s wr, 266 op/s 2024-01-13T18:54:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:50 smithi099 ceph-mon[138788]: osdmap e1817: 8 total, 8 up, 8 in 2024-01-13T18:54:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:54:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:51 smithi084 ceph-mon[116404]: osdmap e1818: 8 total, 8 up, 8 in 2024-01-13T18:54:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:51 smithi084 ceph-mon[119097]: osdmap e1818: 8 total, 8 up, 8 in 2024-01-13T18:54:52.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:51 smithi099 ceph-mon[138788]: osdmap e1818: 8 total, 8 up, 8 in 2024-01-13T18:54:52.656 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 41943040 2024-01-13T18:54:52.682 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:54:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:52 smithi084 ceph-mon[116404]: pgmap v3184: 169 pgs: 169 active+clean; 617 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 8.2 MiB/s rd, 10 KiB/s wr, 255 op/s 2024-01-13T18:54:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:52 smithi084 ceph-mon[116404]: osdmap e1819: 8 total, 8 up, 8 in 2024-01-13T18:54:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:52 smithi084 ceph-mon[119097]: pgmap v3184: 169 pgs: 169 active+clean; 617 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 8.2 MiB/s rd, 10 KiB/s wr, 255 op/s 2024-01-13T18:54:52.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:52 smithi084 ceph-mon[119097]: osdmap e1819: 8 total, 8 up, 8 in 2024-01-13T18:54:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:52 smithi099 ceph-mon[138788]: pgmap v3184: 169 pgs: 169 active+clean; 617 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 8.2 MiB/s rd, 10 KiB/s wr, 255 op/s 2024-01-13T18:54:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:52 smithi099 ceph-mon[138788]: osdmap e1819: 8 total, 8 up, 8 in 2024-01-13T18:54:53.821 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:54:53.833 INFO:tasks.workunit.client.0.smithi084.stdout:write: Y 41943040~5 2024-01-13T18:54:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:53 smithi084 ceph-mon[116404]: osdmap e1820: 8 total, 8 up, 8 in 2024-01-13T18:54:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:53 smithi084 ceph-mon[119097]: osdmap e1820: 8 total, 8 up, 8 in 2024-01-13T18:54:53.940 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:54:54.013 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:54:54.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:53 smithi099 ceph-mon[138788]: osdmap e1820: 8 total, 8 up, 8 in 2024-01-13T18:54:54.763 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.SnapsExpandAfterPrepare2 (3774 ms) 2024-01-13T18:54:54.764 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.SnapsSnapAfterPrepare 2024-01-13T18:54:54.797 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:54:54.807 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:54:54.871 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:54:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:54 smithi084 ceph-mon[119097]: pgmap v3187: 169 pgs: 169 active+clean; 625 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 62 MiB/s rd, 6.0 MiB/s wr, 342 op/s 2024-01-13T18:54:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:54 smithi084 ceph-mon[119097]: osdmap e1821: 8 total, 8 up, 8 in 2024-01-13T18:54:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:54 smithi084 ceph-mon[116404]: pgmap v3187: 169 pgs: 169 active+clean; 625 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 62 MiB/s rd, 6.0 MiB/s wr, 342 op/s 2024-01-13T18:54:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:54 smithi084 ceph-mon[116404]: osdmap e1821: 8 total, 8 up, 8 in 2024-01-13T18:54:55.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:54 smithi099 ceph-mon[138788]: pgmap v3187: 169 pgs: 169 active+clean; 625 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 62 MiB/s rd, 6.0 MiB/s wr, 342 op/s 2024-01-13T18:54:55.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:54 smithi099 ceph-mon[138788]: osdmap e1821: 8 total, 8 up, 8 in 2024-01-13T18:54:55.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:55 smithi084 ceph-mon[116404]: osdmap e1822: 8 total, 8 up, 8 in 2024-01-13T18:54:55.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:55 smithi084 ceph-mon[119097]: osdmap e1822: 8 total, 8 up, 8 in 2024-01-13T18:54:56.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:55 smithi099 ceph-mon[138788]: osdmap e1822: 8 total, 8 up, 8 in 2024-01-13T18:54:56.675 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 8388609~8388609 2024-01-13T18:54:56.685 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~1000 2024-01-13T18:54:56.685 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 1010~1000 2024-01-13T18:54:56.685 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:54:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:56 smithi084 ceph-mon[116404]: pgmap v3190: 169 pgs: 169 active+clean; 621 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 62 MiB/s rd, 6.0 MiB/s wr, 466 op/s 2024-01-13T18:54:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:56 smithi084 ceph-mon[116404]: osdmap e1823: 8 total, 8 up, 8 in 2024-01-13T18:54:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:56 smithi084 ceph-mon[119097]: pgmap v3190: 169 pgs: 169 active+clean; 621 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 62 MiB/s rd, 6.0 MiB/s wr, 466 op/s 2024-01-13T18:54:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:56 smithi084 ceph-mon[119097]: osdmap e1823: 8 total, 8 up, 8 in 2024-01-13T18:54:57.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:56 smithi099 ceph-mon[138788]: pgmap v3190: 169 pgs: 169 active+clean; 621 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 62 MiB/s rd, 6.0 MiB/s wr, 466 op/s 2024-01-13T18:54:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:56 smithi099 ceph-mon[138788]: osdmap e1823: 8 total, 8 up, 8 in 2024-01-13T18:54:57.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:57 smithi084 ceph-mon[116404]: osdmap e1824: 8 total, 8 up, 8 in 2024-01-13T18:54:57.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:57 smithi084 ceph-mon[119097]: osdmap e1824: 8 total, 8 up, 8 in 2024-01-13T18:54:58.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:57 smithi099 ceph-mon[138788]: osdmap e1824: 8 total, 8 up, 8 in 2024-01-13T18:54:58.636 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 8388609~1000 2024-01-13T18:54:58.642 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16777228~1000 2024-01-13T18:54:58.642 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:54:58.654 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 83886079~8388609 2024-01-13T18:54:58.667 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:54:59.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:58 smithi099 ceph-mon[138788]: pgmap v3193: 169 pgs: 169 active+clean; 641 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 323 op/s 2024-01-13T18:54:59.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:58 smithi099 ceph-mon[138788]: osdmap e1825: 8 total, 8 up, 8 in 2024-01-13T18:54:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:54:58 smithi099 ceph-mon[138788]: osdmap e1826: 8 total, 8 up, 8 in 2024-01-13T18:54:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:58 smithi084 ceph-mon[116404]: pgmap v3193: 169 pgs: 169 active+clean; 641 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 323 op/s 2024-01-13T18:54:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:58 smithi084 ceph-mon[116404]: osdmap e1825: 8 total, 8 up, 8 in 2024-01-13T18:54:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:54:58 smithi084 ceph-mon[116404]: osdmap e1826: 8 total, 8 up, 8 in 2024-01-13T18:54:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:58 smithi084 ceph-mon[119097]: pgmap v3193: 169 pgs: 169 active+clean; 641 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 323 op/s 2024-01-13T18:54:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:58 smithi084 ceph-mon[119097]: osdmap e1825: 8 total, 8 up, 8 in 2024-01-13T18:54:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:54:58 smithi084 ceph-mon[119097]: osdmap e1826: 8 total, 8 up, 8 in 2024-01-13T18:55:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:55:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:55:00] "GET /metrics HTTP/1.1" 200 39036 "" "Prometheus/2.43.0" 2024-01-13T18:55:00.712 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:00.737 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 83886079~1 2024-01-13T18:55:00.745 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:55:01.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:00 smithi099 ceph-mon[138788]: pgmap v3196: 169 pgs: 169 active+clean; 649 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 225 KiB/s rd, 7.0 MiB/s wr, 300 op/s 2024-01-13T18:55:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:00 smithi099 ceph-mon[138788]: osdmap e1827: 8 total, 8 up, 8 in 2024-01-13T18:55:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:00 smithi084 ceph-mon[116404]: pgmap v3196: 169 pgs: 169 active+clean; 649 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 225 KiB/s rd, 7.0 MiB/s wr, 300 op/s 2024-01-13T18:55:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:00 smithi084 ceph-mon[116404]: osdmap e1827: 8 total, 8 up, 8 in 2024-01-13T18:55:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:00 smithi084 ceph-mon[119097]: pgmap v3196: 169 pgs: 169 active+clean; 649 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 225 KiB/s rd, 7.0 MiB/s wr, 300 op/s 2024-01-13T18:55:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:00 smithi084 ceph-mon[119097]: osdmap e1827: 8 total, 8 up, 8 in 2024-01-13T18:55:02.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:01 smithi099 ceph-mon[138788]: osdmap e1828: 8 total, 8 up, 8 in 2024-01-13T18:55:02.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:01 smithi084 ceph-mon[116404]: osdmap e1828: 8 total, 8 up, 8 in 2024-01-13T18:55:02.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:01 smithi084 ceph-mon[119097]: osdmap e1828: 8 total, 8 up, 8 in 2024-01-13T18:55:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:02 smithi099 ceph-mon[138788]: pgmap v3199: 169 pgs: 169 active+clean; 649 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 95 KiB/s rd, 2.0 MiB/s wr, 130 op/s 2024-01-13T18:55:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:02 smithi099 ceph-mon[138788]: osdmap e1829: 8 total, 8 up, 8 in 2024-01-13T18:55:03.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:02 smithi084 ceph-mon[119097]: pgmap v3199: 169 pgs: 169 active+clean; 649 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 95 KiB/s rd, 2.0 MiB/s wr, 130 op/s 2024-01-13T18:55:03.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:02 smithi084 ceph-mon[119097]: osdmap e1829: 8 total, 8 up, 8 in 2024-01-13T18:55:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:02 smithi084 ceph-mon[116404]: pgmap v3199: 169 pgs: 169 active+clean; 649 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 95 KiB/s rd, 2.0 MiB/s wr, 130 op/s 2024-01-13T18:55:03.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:02 smithi084 ceph-mon[116404]: osdmap e1829: 8 total, 8 up, 8 in 2024-01-13T18:55:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:03 smithi099 ceph-mon[138788]: osdmap e1830: 8 total, 8 up, 8 in 2024-01-13T18:55:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:03 smithi099 ceph-mon[138788]: osdmap e1831: 8 total, 8 up, 8 in 2024-01-13T18:55:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:03 smithi084 ceph-mon[116404]: osdmap e1830: 8 total, 8 up, 8 in 2024-01-13T18:55:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:03 smithi084 ceph-mon[116404]: osdmap e1831: 8 total, 8 up, 8 in 2024-01-13T18:55:04.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:03 smithi084 ceph-mon[119097]: osdmap e1830: 8 total, 8 up, 8 in 2024-01-13T18:55:04.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:03 smithi084 ceph-mon[119097]: osdmap e1831: 8 total, 8 up, 8 in 2024-01-13T18:55:04.208 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: after_prepare_snap 2024-01-13T18:55:05.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:04 smithi099 ceph-mon[138788]: pgmap v3202: 169 pgs: 169 active+clean; 677 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 65 KiB/s rd, 5.0 MiB/s wr, 102 op/s 2024-01-13T18:55:05.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:04 smithi084 ceph-mon[116404]: pgmap v3202: 169 pgs: 169 active+clean; 677 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 65 KiB/s rd, 5.0 MiB/s wr, 102 op/s 2024-01-13T18:55:05.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:04 smithi084 ceph-mon[119097]: pgmap v3202: 169 pgs: 169 active+clean; 677 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 65 KiB/s rd, 5.0 MiB/s wr, 102 op/s 2024-01-13T18:55:05.759 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 41943040 2024-01-13T18:55:05.796 INFO:tasks.workunit.client.0.smithi084.stdout:write: * 0~1000 2024-01-13T18:55:05.803 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:55:05.944 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:55:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:05 smithi099 ceph-mon[138788]: osdmap e1832: 8 total, 8 up, 8 in 2024-01-13T18:55:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:05 smithi084 ceph-mon[116404]: osdmap e1832: 8 total, 8 up, 8 in 2024-01-13T18:55:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:06.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:05 smithi084 ceph-mon[119097]: osdmap e1832: 8 total, 8 up, 8 in 2024-01-13T18:55:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:06 smithi099 ceph-mon[138788]: pgmap v3205: 169 pgs: 169 active+clean; 677 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 197 KiB/s rd, 5.0 MiB/s wr, 269 op/s 2024-01-13T18:55:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:06 smithi099 ceph-mon[138788]: osdmap e1833: 8 total, 8 up, 8 in 2024-01-13T18:55:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:06 smithi084 ceph-mon[116404]: pgmap v3205: 169 pgs: 169 active+clean; 677 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 197 KiB/s rd, 5.0 MiB/s wr, 269 op/s 2024-01-13T18:55:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:06 smithi084 ceph-mon[116404]: osdmap e1833: 8 total, 8 up, 8 in 2024-01-13T18:55:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:06 smithi084 ceph-mon[119097]: pgmap v3205: 169 pgs: 169 active+clean; 677 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 197 KiB/s rd, 5.0 MiB/s wr, 269 op/s 2024-01-13T18:55:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:06 smithi084 ceph-mon[119097]: osdmap e1833: 8 total, 8 up, 8 in 2024-01-13T18:55:08.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:07 smithi099 ceph-mon[138788]: osdmap e1834: 8 total, 8 up, 8 in 2024-01-13T18:55:08.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:07 smithi099 ceph-mon[138788]: pgmap v3208: 169 pgs: 169 active+clean; 693 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 38 MiB/s rd, 4.0 MiB/s wr, 221 op/s 2024-01-13T18:55:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:07 smithi084 ceph-mon[116404]: osdmap e1834: 8 total, 8 up, 8 in 2024-01-13T18:55:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:07 smithi084 ceph-mon[116404]: pgmap v3208: 169 pgs: 169 active+clean; 693 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 38 MiB/s rd, 4.0 MiB/s wr, 221 op/s 2024-01-13T18:55:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:07 smithi084 ceph-mon[119097]: osdmap e1834: 8 total, 8 up, 8 in 2024-01-13T18:55:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:07 smithi084 ceph-mon[119097]: pgmap v3208: 169 pgs: 169 active+clean; 693 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 38 MiB/s rd, 4.0 MiB/s wr, 221 op/s 2024-01-13T18:55:09.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:08 smithi099 ceph-mon[138788]: osdmap e1835: 8 total, 8 up, 8 in 2024-01-13T18:55:09.162 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.SnapsSnapAfterPrepare (14399 ms) 2024-01-13T18:55:09.163 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.SnapsSnapExpandAfterPrepare 2024-01-13T18:55:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:08 smithi084 ceph-mon[116404]: osdmap e1835: 8 total, 8 up, 8 in 2024-01-13T18:55:09.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:08 smithi084 ceph-mon[119097]: osdmap e1835: 8 total, 8 up, 8 in 2024-01-13T18:55:09.193 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:09.204 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:55:09.261 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:55:10.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:09 smithi099 ceph-mon[138788]: osdmap e1836: 8 total, 8 up, 8 in 2024-01-13T18:55:10.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:09 smithi099 ceph-mon[138788]: pgmap v3211: 169 pgs: 169 active+clean; 693 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 50 MiB/s rd, 5.0 MiB/s wr, 264 op/s 2024-01-13T18:55:10.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:09 smithi084 ceph-mon[116404]: osdmap e1836: 8 total, 8 up, 8 in 2024-01-13T18:55:10.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:09 smithi084 ceph-mon[116404]: pgmap v3211: 169 pgs: 169 active+clean; 693 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 50 MiB/s rd, 5.0 MiB/s wr, 264 op/s 2024-01-13T18:55:10.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:09 smithi084 ceph-mon[119097]: osdmap e1836: 8 total, 8 up, 8 in 2024-01-13T18:55:10.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:09 smithi084 ceph-mon[119097]: pgmap v3211: 169 pgs: 169 active+clean; 693 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 50 MiB/s rd, 5.0 MiB/s wr, 264 op/s 2024-01-13T18:55:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:55:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:55:10] "GET /metrics HTTP/1.1" 200 39037 "" "Prometheus/2.43.0" 2024-01-13T18:55:10.798 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 8388609~8388609 2024-01-13T18:55:10.810 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~1000 2024-01-13T18:55:10.811 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 1010~1000 2024-01-13T18:55:10.811 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:55:11.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:10 smithi099 ceph-mon[138788]: osdmap e1837: 8 total, 8 up, 8 in 2024-01-13T18:55:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:10 smithi084 ceph-mon[116404]: osdmap e1837: 8 total, 8 up, 8 in 2024-01-13T18:55:11.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:10 smithi084 ceph-mon[119097]: osdmap e1837: 8 total, 8 up, 8 in 2024-01-13T18:55:12.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:11 smithi099 ceph-mon[138788]: osdmap e1838: 8 total, 8 up, 8 in 2024-01-13T18:55:12.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:11 smithi099 ceph-mon[138788]: pgmap v3214: 169 pgs: 169 active+clean; 701 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 17 MiB/s rd, 2.0 MiB/s wr, 421 op/s 2024-01-13T18:55:12.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:11 smithi084 ceph-mon[116404]: osdmap e1838: 8 total, 8 up, 8 in 2024-01-13T18:55:12.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:11 smithi084 ceph-mon[116404]: pgmap v3214: 169 pgs: 169 active+clean; 701 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 17 MiB/s rd, 2.0 MiB/s wr, 421 op/s 2024-01-13T18:55:12.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:11 smithi084 ceph-mon[119097]: osdmap e1838: 8 total, 8 up, 8 in 2024-01-13T18:55:12.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:11 smithi084 ceph-mon[119097]: pgmap v3214: 169 pgs: 169 active+clean; 701 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 17 MiB/s rd, 2.0 MiB/s wr, 421 op/s 2024-01-13T18:55:12.812 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 8388609~1000 2024-01-13T18:55:12.820 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16777228~1000 2024-01-13T18:55:12.821 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:55:12.833 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 83886079~8388609 2024-01-13T18:55:12.850 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:55:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:12 smithi099 ceph-mon[138788]: osdmap e1839: 8 total, 8 up, 8 in 2024-01-13T18:55:13.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:12 smithi084 ceph-mon[119097]: osdmap e1839: 8 total, 8 up, 8 in 2024-01-13T18:55:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:12 smithi084 ceph-mon[116404]: osdmap e1839: 8 total, 8 up, 8 in 2024-01-13T18:55:14.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:13 smithi099 ceph-mon[138788]: osdmap e1840: 8 total, 8 up, 8 in 2024-01-13T18:55:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:13 smithi099 ceph-mon[138788]: pgmap v3217: 169 pgs: 169 active+clean; 697 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 39 MiB/s rd, 6.0 MiB/s wr, 290 op/s 2024-01-13T18:55:14.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:13 smithi084 ceph-mon[119097]: osdmap e1840: 8 total, 8 up, 8 in 2024-01-13T18:55:14.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:13 smithi084 ceph-mon[119097]: pgmap v3217: 169 pgs: 169 active+clean; 697 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 39 MiB/s rd, 6.0 MiB/s wr, 290 op/s 2024-01-13T18:55:14.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:13 smithi084 ceph-mon[116404]: osdmap e1840: 8 total, 8 up, 8 in 2024-01-13T18:55:14.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:13 smithi084 ceph-mon[116404]: pgmap v3217: 169 pgs: 169 active+clean; 697 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 39 MiB/s rd, 6.0 MiB/s wr, 290 op/s 2024-01-13T18:55:14.833 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:14.862 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 83886079~1 2024-01-13T18:55:14.871 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:55:15.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:14 smithi099 ceph-mon[138788]: osdmap e1841: 8 total, 8 up, 8 in 2024-01-13T18:55:15.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:14 smithi084 ceph-mon[119097]: osdmap e1841: 8 total, 8 up, 8 in 2024-01-13T18:55:15.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:14 smithi084 ceph-mon[116404]: osdmap e1841: 8 total, 8 up, 8 in 2024-01-13T18:55:16.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:15 smithi099 ceph-mon[138788]: osdmap e1842: 8 total, 8 up, 8 in 2024-01-13T18:55:16.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:15 smithi099 ceph-mon[138788]: pgmap v3220: 169 pgs: 169 active+clean; 709 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 35 MiB/s rd, 8.0 MiB/s wr, 119 op/s 2024-01-13T18:55:16.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:15 smithi084 ceph-mon[119097]: osdmap e1842: 8 total, 8 up, 8 in 2024-01-13T18:55:16.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:15 smithi084 ceph-mon[119097]: pgmap v3220: 169 pgs: 169 active+clean; 709 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 35 MiB/s rd, 8.0 MiB/s wr, 119 op/s 2024-01-13T18:55:16.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:15 smithi084 ceph-mon[116404]: osdmap e1842: 8 total, 8 up, 8 in 2024-01-13T18:55:16.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:15 smithi084 ceph-mon[116404]: pgmap v3220: 169 pgs: 169 active+clean; 709 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 35 MiB/s rd, 8.0 MiB/s wr, 119 op/s 2024-01-13T18:55:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:16 smithi099 ceph-mon[138788]: osdmap e1843: 8 total, 8 up, 8 in 2024-01-13T18:55:17.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:16 smithi084 ceph-mon[116404]: osdmap e1843: 8 total, 8 up, 8 in 2024-01-13T18:55:17.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:16 smithi084 ceph-mon[119097]: osdmap e1843: 8 total, 8 up, 8 in 2024-01-13T18:55:18.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:17 smithi099 ceph-mon[138788]: osdmap e1844: 8 total, 8 up, 8 in 2024-01-13T18:55:18.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:17 smithi099 ceph-mon[138788]: pgmap v3223: 169 pgs: 169 active+clean; 729 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.1 MiB/s rd, 6.0 MiB/s wr, 73 op/s 2024-01-13T18:55:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:17 smithi084 ceph-mon[116404]: osdmap e1844: 8 total, 8 up, 8 in 2024-01-13T18:55:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:17 smithi084 ceph-mon[116404]: pgmap v3223: 169 pgs: 169 active+clean; 729 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.1 MiB/s rd, 6.0 MiB/s wr, 73 op/s 2024-01-13T18:55:18.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:17 smithi084 ceph-mon[119097]: osdmap e1844: 8 total, 8 up, 8 in 2024-01-13T18:55:18.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:17 smithi084 ceph-mon[119097]: pgmap v3223: 169 pgs: 169 active+clean; 729 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 1.1 MiB/s rd, 6.0 MiB/s wr, 73 op/s 2024-01-13T18:55:18.331 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: after_prepare_snap 2024-01-13T18:55:19.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:18 smithi099 ceph-mon[138788]: osdmap e1845: 8 total, 8 up, 8 in 2024-01-13T18:55:19.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:18 smithi099 ceph-mon[138788]: osdmap e1846: 8 total, 8 up, 8 in 2024-01-13T18:55:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:18 smithi084 ceph-mon[116404]: osdmap e1845: 8 total, 8 up, 8 in 2024-01-13T18:55:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:18 smithi084 ceph-mon[116404]: osdmap e1846: 8 total, 8 up, 8 in 2024-01-13T18:55:19.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:18 smithi084 ceph-mon[119097]: osdmap e1845: 8 total, 8 up, 8 in 2024-01-13T18:55:19.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:18 smithi084 ceph-mon[119097]: osdmap e1846: 8 total, 8 up, 8 in 2024-01-13T18:55:19.647 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:55:19.661 INFO:tasks.workunit.client.0.smithi084.stdout:write: * 83886080~1000 2024-01-13T18:55:19.667 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:55:19.805 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:55:20.630 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:55:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:55:20] "GET /metrics HTTP/1.1" 200 39038 "" "Prometheus/2.43.0" 2024-01-13T18:55:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:20 smithi084 ceph-mon[116404]: pgmap v3226: 169 pgs: 169 active+clean; 733 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.0 MiB/s wr, 96 op/s 2024-01-13T18:55:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:20 smithi084 ceph-mon[116404]: osdmap e1847: 8 total, 8 up, 8 in 2024-01-13T18:55:20.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:20 smithi084 ceph-mon[119097]: pgmap v3226: 169 pgs: 169 active+clean; 733 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.0 MiB/s wr, 96 op/s 2024-01-13T18:55:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:20 smithi084 ceph-mon[119097]: osdmap e1847: 8 total, 8 up, 8 in 2024-01-13T18:55:20.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:20 smithi099 ceph-mon[138788]: pgmap v3226: 169 pgs: 169 active+clean; 733 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 7.1 MiB/s rd, 4.0 MiB/s wr, 96 op/s 2024-01-13T18:55:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:20 smithi099 ceph-mon[138788]: osdmap e1847: 8 total, 8 up, 8 in 2024-01-13T18:55:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:21 smithi084 ceph-mon[116404]: osdmap e1848: 8 total, 8 up, 8 in 2024-01-13T18:55:21.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:21 smithi084 ceph-mon[119097]: osdmap e1848: 8 total, 8 up, 8 in 2024-01-13T18:55:22.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:21 smithi099 ceph-mon[138788]: osdmap e1848: 8 total, 8 up, 8 in 2024-01-13T18:55:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:22 smithi084 ceph-mon[116404]: pgmap v3229: 169 pgs: 169 active+clean; 733 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 11 MiB/s rd, 1.0 MiB/s wr, 297 op/s 2024-01-13T18:55:22.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:22 smithi084 ceph-mon[116404]: osdmap e1849: 8 total, 8 up, 8 in 2024-01-13T18:55:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:22 smithi084 ceph-mon[119097]: pgmap v3229: 169 pgs: 169 active+clean; 733 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 11 MiB/s rd, 1.0 MiB/s wr, 297 op/s 2024-01-13T18:55:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:22 smithi084 ceph-mon[119097]: osdmap e1849: 8 total, 8 up, 8 in 2024-01-13T18:55:23.110 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.SnapsSnapExpandAfterPrepare (13947 ms) 2024-01-13T18:55:23.110 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.Clone 2024-01-13T18:55:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:22 smithi099 ceph-mon[138788]: pgmap v3229: 169 pgs: 169 active+clean; 733 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 11 MiB/s rd, 1.0 MiB/s wr, 297 op/s 2024-01-13T18:55:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:22 smithi099 ceph-mon[138788]: osdmap e1849: 8 total, 8 up, 8 in 2024-01-13T18:55:23.143 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:23.153 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~8388609 2024-01-13T18:55:23.213 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 16777218~8388609 2024-01-13T18:55:23.256 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap 2024-01-13T18:55:23.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:23 smithi084 ceph-mon[116404]: osdmap e1850: 8 total, 8 up, 8 in 2024-01-13T18:55:23.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:23 smithi084 ceph-mon[119097]: osdmap e1850: 8 total, 8 up, 8 in 2024-01-13T18:55:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:23 smithi099 ceph-mon[138788]: osdmap e1850: 8 total, 8 up, 8 in 2024-01-13T18:55:24.671 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap 2024-01-13T18:55:24.685 INFO:tasks.workunit.client.0.smithi084.stdout:clone image300 -> image303 2024-01-13T18:55:24.794 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~1000 2024-01-13T18:55:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 1010~1000 2024-01-13T18:55:24.854 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap 2024-01-13T18:55:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:24 smithi084 ceph-mon[116404]: pgmap v3232: 169 pgs: 169 active+clean; 741 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 30 MiB/s rd, 3.0 MiB/s wr, 375 op/s 2024-01-13T18:55:24.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:24 smithi084 ceph-mon[116404]: osdmap e1851: 8 total, 8 up, 8 in 2024-01-13T18:55:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:24 smithi084 ceph-mon[119097]: pgmap v3232: 169 pgs: 169 active+clean; 741 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 30 MiB/s rd, 3.0 MiB/s wr, 375 op/s 2024-01-13T18:55:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:24 smithi084 ceph-mon[119097]: osdmap e1851: 8 total, 8 up, 8 in 2024-01-13T18:55:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:24 smithi099 ceph-mon[138788]: pgmap v3232: 169 pgs: 169 active+clean; 741 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 30 MiB/s rd, 3.0 MiB/s wr, 375 op/s 2024-01-13T18:55:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:24 smithi099 ceph-mon[138788]: osdmap e1851: 8 total, 8 up, 8 in 2024-01-13T18:55:25.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:25 smithi084 ceph-mon[116404]: osdmap e1852: 8 total, 8 up, 8 in 2024-01-13T18:55:25.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:25 smithi084 ceph-mon[119097]: osdmap e1852: 8 total, 8 up, 8 in 2024-01-13T18:55:26.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:25 smithi099 ceph-mon[138788]: osdmap e1852: 8 total, 8 up, 8 in 2024-01-13T18:55:26.685 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap 2024-01-13T18:55:26.697 INFO:tasks.workunit.client.0.smithi084.stdout:clone image303 -> image305 2024-01-13T18:55:26.828 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 1000~1000 2024-01-13T18:55:26.887 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 2010~1000 2024-01-13T18:55:26.890 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:55:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:26 smithi099 ceph-mon[138788]: pgmap v3235: 169 pgs: 169 active+clean; 753 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 41 MiB/s rd, 8.0 MiB/s wr, 340 op/s 2024-01-13T18:55:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:26 smithi099 ceph-mon[138788]: osdmap e1853: 8 total, 8 up, 8 in 2024-01-13T18:55:27.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:26 smithi084 ceph-mon[119097]: pgmap v3235: 169 pgs: 169 active+clean; 753 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 41 MiB/s rd, 8.0 MiB/s wr, 340 op/s 2024-01-13T18:55:27.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:26 smithi084 ceph-mon[119097]: osdmap e1853: 8 total, 8 up, 8 in 2024-01-13T18:55:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:26 smithi084 ceph-mon[116404]: pgmap v3235: 169 pgs: 169 active+clean; 753 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 41 MiB/s rd, 8.0 MiB/s wr, 340 op/s 2024-01-13T18:55:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:26 smithi084 ceph-mon[116404]: osdmap e1853: 8 total, 8 up, 8 in 2024-01-13T18:55:27.183 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:55:27.360 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:55:27.535 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.Clone (4426 ms) 2024-01-13T18:55:27.536 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneParent 2024-01-13T18:55:27.568 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:27.578 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap 2024-01-13T18:55:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:27 smithi099 ceph-mon[138788]: osdmap e1854: 8 total, 8 up, 8 in 2024-01-13T18:55:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:27 smithi084 ceph-mon[116404]: osdmap e1854: 8 total, 8 up, 8 in 2024-01-13T18:55:28.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:27 smithi084 ceph-mon[119097]: osdmap e1854: 8 total, 8 up, 8 in 2024-01-13T18:55:28.637 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap 2024-01-13T18:55:28.646 INFO:tasks.workunit.client.0.smithi084.stdout:clone image306 -> image309 2024-01-13T18:55:28.745 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:55:28.896 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:55:29.024 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneParent (1489 ms) 2024-01-13T18:55:29.024 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneUpdateAfterPrepare 2024-01-13T18:55:29.056 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:29.065 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~10 2024-01-13T18:55:29.074 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap 2024-01-13T18:55:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:28 smithi099 ceph-mon[138788]: pgmap v3238: 169 pgs: 169 active+clean; 765 MiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 23 MiB/s rd, 11 MiB/s wr, 335 op/s 2024-01-13T18:55:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:28 smithi099 ceph-mon[138788]: osdmap e1855: 8 total, 8 up, 8 in 2024-01-13T18:55:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:28 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:55:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:28 smithi099 ceph-mon[138788]: osdmap e1856: 8 total, 8 up, 8 in 2024-01-13T18:55:29.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:28 smithi084 ceph-mon[119097]: pgmap v3238: 169 pgs: 169 active+clean; 765 MiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 23 MiB/s rd, 11 MiB/s wr, 335 op/s 2024-01-13T18:55:29.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:28 smithi084 ceph-mon[119097]: osdmap e1855: 8 total, 8 up, 8 in 2024-01-13T18:55:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:28 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:55:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:28 smithi084 ceph-mon[119097]: osdmap e1856: 8 total, 8 up, 8 in 2024-01-13T18:55:29.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:28 smithi084 ceph-mon[116404]: pgmap v3238: 169 pgs: 169 active+clean; 765 MiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 23 MiB/s rd, 11 MiB/s wr, 335 op/s 2024-01-13T18:55:29.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:28 smithi084 ceph-mon[116404]: osdmap e1855: 8 total, 8 up, 8 in 2024-01-13T18:55:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:28 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:55:29.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:28 smithi084 ceph-mon[116404]: osdmap e1856: 8 total, 8 up, 8 in 2024-01-13T18:55:30.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:55:30.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:55:30.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:55:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:55:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:55:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:55:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:55:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:55:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:55:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:55:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:55:30] "GET /metrics HTTP/1.1" 200 39038 "" "Prometheus/2.43.0" 2024-01-13T18:55:30.818 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap 2024-01-13T18:55:30.835 INFO:tasks.workunit.client.0.smithi084.stdout:clone image310 -> image313 2024-01-13T18:55:30.937 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:55:31.089 INFO:tasks.workunit.client.0.smithi084.stdout:write: Y 0~1 2024-01-13T18:55:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:30 smithi099 ceph-mon[138788]: pgmap v3241: 169 pgs: 169 active+clean; 773 MiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 32 MiB/s rd, 8.0 MiB/s wr, 518 op/s 2024-01-13T18:55:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:30 smithi099 ceph-mon[138788]: osdmap e1857: 8 total, 8 up, 8 in 2024-01-13T18:55:31.119 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:55:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:30 smithi084 ceph-mon[116404]: pgmap v3241: 169 pgs: 169 active+clean; 773 MiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 32 MiB/s rd, 8.0 MiB/s wr, 518 op/s 2024-01-13T18:55:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:30 smithi084 ceph-mon[116404]: osdmap e1857: 8 total, 8 up, 8 in 2024-01-13T18:55:31.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:30 smithi084 ceph-mon[119097]: pgmap v3241: 169 pgs: 169 active+clean; 773 MiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 32 MiB/s rd, 8.0 MiB/s wr, 518 op/s 2024-01-13T18:55:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:30 smithi084 ceph-mon[119097]: osdmap e1857: 8 total, 8 up, 8 in 2024-01-13T18:55:31.185 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:55:31.282 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneUpdateAfterPrepare (2257 ms) 2024-01-13T18:55:31.282 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.TriggerAssertSnapcSeq 2024-01-13T18:55:31.313 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:31.323 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 41943040~10 2024-01-13T18:55:31.331 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:55:32.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:31 smithi099 ceph-mon[138788]: osdmap e1858: 8 total, 8 up, 8 in 2024-01-13T18:55:32.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:31 smithi099 ceph-mon[138788]: pgmap v3244: 169 pgs: 169 active+clean; 781 MiB data, 6.7 GiB used, 708 GiB / 715 GiB avail; 28 MiB/s rd, 4.0 MiB/s wr, 520 op/s 2024-01-13T18:55:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:31 smithi084 ceph-mon[116404]: osdmap e1858: 8 total, 8 up, 8 in 2024-01-13T18:55:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:31 smithi084 ceph-mon[116404]: pgmap v3244: 169 pgs: 169 active+clean; 781 MiB data, 6.7 GiB used, 708 GiB / 715 GiB avail; 28 MiB/s rd, 4.0 MiB/s wr, 520 op/s 2024-01-13T18:55:32.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:31 smithi084 ceph-mon[119097]: osdmap e1858: 8 total, 8 up, 8 in 2024-01-13T18:55:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:31 smithi084 ceph-mon[119097]: pgmap v3244: 169 pgs: 169 active+clean; 781 MiB data, 6.7 GiB used, 708 GiB / 715 GiB avail; 28 MiB/s rd, 4.0 MiB/s wr, 520 op/s 2024-01-13T18:55:32.837 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 41943041~10 2024-01-13T18:55:32.843 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:55:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:32 smithi099 ceph-mon[138788]: osdmap e1859: 8 total, 8 up, 8 in 2024-01-13T18:55:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:32 smithi084 ceph-mon[116404]: osdmap e1859: 8 total, 8 up, 8 in 2024-01-13T18:55:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:32 smithi084 ceph-mon[119097]: osdmap e1859: 8 total, 8 up, 8 in 2024-01-13T18:55:33.776 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 41943042~10 2024-01-13T18:55:33.791 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:55:34.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:33 smithi099 ceph-mon[138788]: osdmap e1860: 8 total, 8 up, 8 in 2024-01-13T18:55:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:33 smithi099 ceph-mon[138788]: pgmap v3247: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 17 MiB/s rd, 4.0 MiB/s wr, 877 op/s 2024-01-13T18:55:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:33 smithi099 ceph-mon[138788]: osdmap e1861: 8 total, 8 up, 8 in 2024-01-13T18:55:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:33 smithi084 ceph-mon[116404]: osdmap e1860: 8 total, 8 up, 8 in 2024-01-13T18:55:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:33 smithi084 ceph-mon[116404]: pgmap v3247: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 17 MiB/s rd, 4.0 MiB/s wr, 877 op/s 2024-01-13T18:55:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:33 smithi084 ceph-mon[116404]: osdmap e1861: 8 total, 8 up, 8 in 2024-01-13T18:55:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:33 smithi084 ceph-mon[119097]: osdmap e1860: 8 total, 8 up, 8 in 2024-01-13T18:55:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:33 smithi084 ceph-mon[119097]: pgmap v3247: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 17 MiB/s rd, 4.0 MiB/s wr, 877 op/s 2024-01-13T18:55:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:33 smithi084 ceph-mon[119097]: osdmap e1861: 8 total, 8 up, 8 in 2024-01-13T18:55:35.658 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 41943040 2024-01-13T18:55:35.688 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:55:35.808 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:55:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:35 smithi084 ceph-mon[116404]: osdmap e1862: 8 total, 8 up, 8 in 2024-01-13T18:55:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:35 smithi084 ceph-mon[119097]: osdmap e1862: 8 total, 8 up, 8 in 2024-01-13T18:55:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:35 smithi099 ceph-mon[138788]: osdmap e1862: 8 total, 8 up, 8 in 2024-01-13T18:55:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:36.792 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.TriggerAssertSnapcSeq (5511 ms) 2024-01-13T18:55:36.793 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.SnapTrimBeforePrepare 2024-01-13T18:55:36.823 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:36.834 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 41943040~10 2024-01-13T18:55:36.842 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:55:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:36 smithi084 ceph-mon[116404]: pgmap v3250: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 2.0 MiB/s wr, 1.04k op/s 2024-01-13T18:55:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:36 smithi084 ceph-mon[116404]: osdmap e1863: 8 total, 8 up, 8 in 2024-01-13T18:55:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:36 smithi084 ceph-mon[119097]: pgmap v3250: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 2.0 MiB/s wr, 1.04k op/s 2024-01-13T18:55:36.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:36 smithi084 ceph-mon[119097]: osdmap e1863: 8 total, 8 up, 8 in 2024-01-13T18:55:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:36 smithi099 ceph-mon[138788]: pgmap v3250: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 2.0 MiB/s wr, 1.04k op/s 2024-01-13T18:55:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:36 smithi099 ceph-mon[138788]: osdmap e1863: 8 total, 8 up, 8 in 2024-01-13T18:55:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:37 smithi084 ceph-mon[116404]: osdmap e1864: 8 total, 8 up, 8 in 2024-01-13T18:55:37.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:37 smithi084 ceph-mon[119097]: osdmap e1864: 8 total, 8 up, 8 in 2024-01-13T18:55:38.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:37 smithi099 ceph-mon[138788]: osdmap e1864: 8 total, 8 up, 8 in 2024-01-13T18:55:38.675 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 41943040 2024-01-13T18:55:38.697 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:55:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:38 smithi084 ceph-mon[116404]: pgmap v3253: 169 pgs: 1 active+clean+snaptrim_wait, 168 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 245 KiB/s rd, 18 KiB/s wr, 318 op/s 2024-01-13T18:55:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:38 smithi084 ceph-mon[116404]: osdmap e1865: 8 total, 8 up, 8 in 2024-01-13T18:55:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:38 smithi084 ceph-mon[119097]: pgmap v3253: 169 pgs: 1 active+clean+snaptrim_wait, 168 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 245 KiB/s rd, 18 KiB/s wr, 318 op/s 2024-01-13T18:55:38.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:38 smithi084 ceph-mon[119097]: osdmap e1865: 8 total, 8 up, 8 in 2024-01-13T18:55:39.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:38 smithi099 ceph-mon[138788]: pgmap v3253: 169 pgs: 1 active+clean+snaptrim_wait, 168 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 245 KiB/s rd, 18 KiB/s wr, 318 op/s 2024-01-13T18:55:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:38 smithi099 ceph-mon[138788]: osdmap e1865: 8 total, 8 up, 8 in 2024-01-13T18:55:39.811 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:39.822 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:55:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:39 smithi084 ceph-mon[116404]: osdmap e1866: 8 total, 8 up, 8 in 2024-01-13T18:55:39.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:39 smithi084 ceph-mon[119097]: osdmap e1866: 8 total, 8 up, 8 in 2024-01-13T18:55:40.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:39 smithi099 ceph-mon[138788]: osdmap e1866: 8 total, 8 up, 8 in 2024-01-13T18:55:40.671 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:55:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:55:40] "GET /metrics HTTP/1.1" 200 39042 "" "Prometheus/2.43.0" 2024-01-13T18:55:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:40 smithi084 ceph-mon[116404]: pgmap v3256: 169 pgs: 1 active+clean+snaptrim_wait, 168 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 220 KiB/s rd, 19 KiB/s wr, 295 op/s 2024-01-13T18:55:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:40 smithi084 ceph-mon[116404]: osdmap e1867: 8 total, 8 up, 8 in 2024-01-13T18:55:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:40 smithi084 ceph-mon[119097]: pgmap v3256: 169 pgs: 1 active+clean+snaptrim_wait, 168 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 220 KiB/s rd, 19 KiB/s wr, 295 op/s 2024-01-13T18:55:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:40 smithi084 ceph-mon[119097]: osdmap e1867: 8 total, 8 up, 8 in 2024-01-13T18:55:41.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:40 smithi099 ceph-mon[138788]: pgmap v3256: 169 pgs: 1 active+clean+snaptrim_wait, 168 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 220 KiB/s rd, 19 KiB/s wr, 295 op/s 2024-01-13T18:55:41.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:40 smithi099 ceph-mon[138788]: osdmap e1867: 8 total, 8 up, 8 in 2024-01-13T18:55:41.710 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 41943040~10 2024-01-13T18:55:41.717 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap4 2024-01-13T18:55:42.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:41 smithi099 ceph-mon[138788]: osdmap e1868: 8 total, 8 up, 8 in 2024-01-13T18:55:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:41 smithi084 ceph-mon[116404]: osdmap e1868: 8 total, 8 up, 8 in 2024-01-13T18:55:42.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:41 smithi084 ceph-mon[119097]: osdmap e1868: 8 total, 8 up, 8 in 2024-01-13T18:55:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:42 smithi099 ceph-mon[138788]: pgmap v3259: 169 pgs: 1 active+clean+snaptrim_wait, 168 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 251 KiB/s rd, 20 KiB/s wr, 329 op/s 2024-01-13T18:55:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:42 smithi099 ceph-mon[138788]: osdmap e1869: 8 total, 8 up, 8 in 2024-01-13T18:55:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:42 smithi084 ceph-mon[116404]: pgmap v3259: 169 pgs: 1 active+clean+snaptrim_wait, 168 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 251 KiB/s rd, 20 KiB/s wr, 329 op/s 2024-01-13T18:55:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:42 smithi084 ceph-mon[116404]: osdmap e1869: 8 total, 8 up, 8 in 2024-01-13T18:55:43.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:42 smithi084 ceph-mon[119097]: pgmap v3259: 169 pgs: 1 active+clean+snaptrim_wait, 168 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 251 KiB/s rd, 20 KiB/s wr, 329 op/s 2024-01-13T18:55:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:42 smithi084 ceph-mon[119097]: osdmap e1869: 8 total, 8 up, 8 in 2024-01-13T18:55:43.718 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 41943040 2024-01-13T18:55:43.741 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:55:43.810 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:55:44.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:43 smithi099 ceph-mon[138788]: osdmap e1870: 8 total, 8 up, 8 in 2024-01-13T18:55:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:43 smithi084 ceph-mon[116404]: osdmap e1870: 8 total, 8 up, 8 in 2024-01-13T18:55:44.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:43 smithi084 ceph-mon[119097]: osdmap e1870: 8 total, 8 up, 8 in 2024-01-13T18:55:44.869 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.SnapTrimBeforePrepare (8076 ms) 2024-01-13T18:55:44.869 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.AbortInUseImage 2024-01-13T18:55:44.901 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:44.911 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:55:45.093 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.AbortInUseImage (224 ms) 2024-01-13T18:55:45.093 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.AbortWithoutSnapshots 2024-01-13T18:55:45.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:44 smithi099 ceph-mon[138788]: pgmap v3262: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 99 KiB/s rd, 13 KiB/s wr, 137 op/s 2024-01-13T18:55:45.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:44 smithi099 ceph-mon[138788]: osdmap e1871: 8 total, 8 up, 8 in 2024-01-13T18:55:45.121 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:45.131 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:55:45.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:44 smithi084 ceph-mon[116404]: pgmap v3262: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 99 KiB/s rd, 13 KiB/s wr, 137 op/s 2024-01-13T18:55:45.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:44 smithi084 ceph-mon[116404]: osdmap e1871: 8 total, 8 up, 8 in 2024-01-13T18:55:45.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:44 smithi084 ceph-mon[119097]: pgmap v3262: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 99 KiB/s rd, 13 KiB/s wr, 137 op/s 2024-01-13T18:55:45.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:44 smithi084 ceph-mon[119097]: osdmap e1871: 8 total, 8 up, 8 in 2024-01-13T18:55:45.193 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:55:45.264 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:55:45.458 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:55:45.506 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:55:45.556 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:55:45.752 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.AbortWithoutSnapshots (660 ms) 2024-01-13T18:55:45.752 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.AbortWithSnapshots 2024-01-13T18:55:45.783 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:45.794 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:55:45.853 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:55:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:45 smithi099 ceph-mon[138788]: osdmap e1872: 8 total, 8 up, 8 in 2024-01-13T18:55:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:45 smithi084 ceph-mon[116404]: osdmap e1872: 8 total, 8 up, 8 in 2024-01-13T18:55:46.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:45 smithi084 ceph-mon[119097]: osdmap e1872: 8 total, 8 up, 8 in 2024-01-13T18:55:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:46 smithi099 ceph-mon[138788]: pgmap v3265: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 137 KiB/s rd, 15 KiB/s wr, 183 op/s 2024-01-13T18:55:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:46 smithi084 ceph-mon[116404]: pgmap v3265: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 137 KiB/s rd, 15 KiB/s wr, 183 op/s 2024-01-13T18:55:47.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:46 smithi084 ceph-mon[119097]: pgmap v3265: 169 pgs: 169 active+clean; 785 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 137 KiB/s rd, 15 KiB/s wr, 183 op/s 2024-01-13T18:55:47.750 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 8388609~8388609 2024-01-13T18:55:47.764 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 0~1000 2024-01-13T18:55:47.765 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 1010~1000 2024-01-13T18:55:47.765 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:55:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:47 smithi099 ceph-mon[138788]: osdmap e1873: 8 total, 8 up, 8 in 2024-01-13T18:55:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:47 smithi084 ceph-mon[116404]: osdmap e1873: 8 total, 8 up, 8 in 2024-01-13T18:55:48.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:47 smithi084 ceph-mon[119097]: osdmap e1873: 8 total, 8 up, 8 in 2024-01-13T18:55:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:48 smithi099 ceph-mon[138788]: pgmap v3267: 169 pgs: 169 active+clean; 801 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 9.8 MiB/s rd, 9.6 MiB/s wr, 322 op/s 2024-01-13T18:55:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:48 smithi099 ceph-mon[138788]: osdmap e1874: 8 total, 8 up, 8 in 2024-01-13T18:55:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:48 smithi099 ceph-mon[138788]: osdmap e1875: 8 total, 8 up, 8 in 2024-01-13T18:55:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:48 smithi084 ceph-mon[116404]: pgmap v3267: 169 pgs: 169 active+clean; 801 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 9.8 MiB/s rd, 9.6 MiB/s wr, 322 op/s 2024-01-13T18:55:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:48 smithi084 ceph-mon[116404]: osdmap e1874: 8 total, 8 up, 8 in 2024-01-13T18:55:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:48 smithi084 ceph-mon[116404]: osdmap e1875: 8 total, 8 up, 8 in 2024-01-13T18:55:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:48 smithi084 ceph-mon[119097]: pgmap v3267: 169 pgs: 169 active+clean; 801 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 9.8 MiB/s rd, 9.6 MiB/s wr, 322 op/s 2024-01-13T18:55:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:48 smithi084 ceph-mon[119097]: osdmap e1874: 8 total, 8 up, 8 in 2024-01-13T18:55:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:48 smithi084 ceph-mon[119097]: osdmap e1875: 8 total, 8 up, 8 in 2024-01-13T18:55:49.654 INFO:tasks.workunit.client.0.smithi084.stdout:write: X 8388609~1000 2024-01-13T18:55:49.660 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16777228~1000 2024-01-13T18:55:49.660 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167772160 2024-01-13T18:55:49.669 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 83886079~8388609 2024-01-13T18:55:49.685 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:55:50.636 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:55:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:55:50] "GET /metrics HTTP/1.1" 200 39041 "" "Prometheus/2.43.0" 2024-01-13T18:55:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:50 smithi084 ceph-mon[116404]: pgmap v3270: 169 pgs: 169 active+clean; 833 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 17 MiB/s rd, 21 MiB/s wr, 530 op/s 2024-01-13T18:55:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:50 smithi084 ceph-mon[116404]: osdmap e1876: 8 total, 8 up, 8 in 2024-01-13T18:55:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:50 smithi084 ceph-mon[119097]: pgmap v3270: 169 pgs: 169 active+clean; 833 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 17 MiB/s rd, 21 MiB/s wr, 530 op/s 2024-01-13T18:55:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:50 smithi084 ceph-mon[119097]: osdmap e1876: 8 total, 8 up, 8 in 2024-01-13T18:55:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:51.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:50 smithi099 ceph-mon[138788]: pgmap v3270: 169 pgs: 169 active+clean; 833 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 17 MiB/s rd, 21 MiB/s wr, 530 op/s 2024-01-13T18:55:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:50 smithi099 ceph-mon[138788]: osdmap e1876: 8 total, 8 up, 8 in 2024-01-13T18:55:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:55:51.663 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:55:51.686 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 83886079~1 2024-01-13T18:55:51.694 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:55:51.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:51 smithi084 ceph-mon[116404]: osdmap e1877: 8 total, 8 up, 8 in 2024-01-13T18:55:51.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:51 smithi084 ceph-mon[119097]: osdmap e1877: 8 total, 8 up, 8 in 2024-01-13T18:55:52.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:51 smithi099 ceph-mon[138788]: osdmap e1877: 8 total, 8 up, 8 in 2024-01-13T18:55:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:52 smithi084 ceph-mon[116404]: pgmap v3273: 169 pgs: 169 active+clean; 845 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 16 MiB/s wr, 393 op/s 2024-01-13T18:55:52.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:52 smithi084 ceph-mon[116404]: osdmap e1878: 8 total, 8 up, 8 in 2024-01-13T18:55:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:52 smithi084 ceph-mon[119097]: pgmap v3273: 169 pgs: 169 active+clean; 845 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 16 MiB/s wr, 393 op/s 2024-01-13T18:55:52.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:52 smithi084 ceph-mon[119097]: osdmap e1878: 8 total, 8 up, 8 in 2024-01-13T18:55:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:52 smithi099 ceph-mon[138788]: pgmap v3273: 169 pgs: 169 active+clean; 845 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 16 MiB/s wr, 393 op/s 2024-01-13T18:55:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:52 smithi099 ceph-mon[138788]: osdmap e1878: 8 total, 8 up, 8 in 2024-01-13T18:55:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:53 smithi084 ceph-mon[116404]: osdmap e1879: 8 total, 8 up, 8 in 2024-01-13T18:55:53.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:53 smithi084 ceph-mon[116404]: osdmap e1880: 8 total, 8 up, 8 in 2024-01-13T18:55:53.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:53 smithi084 ceph-mon[119097]: osdmap e1879: 8 total, 8 up, 8 in 2024-01-13T18:55:53.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:53 smithi084 ceph-mon[119097]: osdmap e1880: 8 total, 8 up, 8 in 2024-01-13T18:55:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:53 smithi099 ceph-mon[138788]: osdmap e1879: 8 total, 8 up, 8 in 2024-01-13T18:55:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:53 smithi099 ceph-mon[138788]: osdmap e1880: 8 total, 8 up, 8 in 2024-01-13T18:55:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:54 smithi084 ceph-mon[116404]: pgmap v3276: 169 pgs: 169 active+clean; 865 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 4.1 MiB/s rd, 9.0 MiB/s wr, 149 op/s 2024-01-13T18:55:54.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:54 smithi084 ceph-mon[116404]: osdmap e1881: 8 total, 8 up, 8 in 2024-01-13T18:55:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:54 smithi084 ceph-mon[119097]: pgmap v3276: 169 pgs: 169 active+clean; 865 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 4.1 MiB/s rd, 9.0 MiB/s wr, 149 op/s 2024-01-13T18:55:54.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:54 smithi084 ceph-mon[119097]: osdmap e1881: 8 total, 8 up, 8 in 2024-01-13T18:55:55.106 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:55:55.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:54 smithi099 ceph-mon[138788]: pgmap v3276: 169 pgs: 169 active+clean; 865 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 4.1 MiB/s rd, 9.0 MiB/s wr, 149 op/s 2024-01-13T18:55:55.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:54 smithi099 ceph-mon[138788]: osdmap e1881: 8 total, 8 up, 8 in 2024-01-13T18:55:55.205 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:55:55.679 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 0~8388609 2024-01-13T18:55:55.691 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 16777218~8388609 2024-01-13T18:55:55.773 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:55:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:56 smithi084 ceph-mon[116404]: pgmap v3279: 169 pgs: 169 active+clean; 873 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 121 KiB/s rd, 7.0 MiB/s wr, 170 op/s 2024-01-13T18:55:56.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:56 smithi084 ceph-mon[116404]: osdmap e1882: 8 total, 8 up, 8 in 2024-01-13T18:55:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:56 smithi084 ceph-mon[119097]: pgmap v3279: 169 pgs: 169 active+clean; 873 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 121 KiB/s rd, 7.0 MiB/s wr, 170 op/s 2024-01-13T18:55:56.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:56 smithi084 ceph-mon[119097]: osdmap e1882: 8 total, 8 up, 8 in 2024-01-13T18:55:57.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:56 smithi099 ceph-mon[138788]: pgmap v3279: 169 pgs: 169 active+clean; 873 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 121 KiB/s rd, 7.0 MiB/s wr, 170 op/s 2024-01-13T18:55:57.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:56 smithi099 ceph-mon[138788]: osdmap e1882: 8 total, 8 up, 8 in 2024-01-13T18:55:58.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:57 smithi099 ceph-mon[138788]: osdmap e1883: 8 total, 8 up, 8 in 2024-01-13T18:55:58.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:57 smithi084 ceph-mon[119097]: osdmap e1883: 8 total, 8 up, 8 in 2024-01-13T18:55:58.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:57 smithi084 ceph-mon[116404]: osdmap e1883: 8 total, 8 up, 8 in 2024-01-13T18:55:59.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:58 smithi099 ceph-mon[138788]: pgmap v3282: 169 pgs: 169 active+clean; 893 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 9.2 MiB/s rd, 7.0 MiB/s wr, 335 op/s 2024-01-13T18:55:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:58 smithi099 ceph-mon[138788]: osdmap e1884: 8 total, 8 up, 8 in 2024-01-13T18:55:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:58 smithi084 ceph-mon[116404]: pgmap v3282: 169 pgs: 169 active+clean; 893 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 9.2 MiB/s rd, 7.0 MiB/s wr, 335 op/s 2024-01-13T18:55:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:58 smithi084 ceph-mon[116404]: osdmap e1884: 8 total, 8 up, 8 in 2024-01-13T18:55:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:58 smithi084 ceph-mon[119097]: pgmap v3282: 169 pgs: 169 active+clean; 893 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 9.2 MiB/s rd, 7.0 MiB/s wr, 335 op/s 2024-01-13T18:55:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:58 smithi084 ceph-mon[119097]: osdmap e1884: 8 total, 8 up, 8 in 2024-01-13T18:56:00.063 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.AbortWithSnapshots (14310 ms) 2024-01-13T18:56:00.063 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneV1Parent 2024-01-13T18:56:00.093 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:00.104 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 0~10 2024-01-13T18:56:00.112 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:00.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:55:59 smithi099 ceph-mon[138788]: osdmap e1885: 8 total, 8 up, 8 in 2024-01-13T18:56:00.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:55:59 smithi084 ceph-mon[116404]: osdmap e1885: 8 total, 8 up, 8 in 2024-01-13T18:56:00.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:55:59 smithi084 ceph-mon[119097]: osdmap e1885: 8 total, 8 up, 8 in 2024-01-13T18:56:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:56:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:56:00] "GET /metrics HTTP/1.1" 200 39041 "" "Prometheus/2.43.0" 2024-01-13T18:56:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:00 smithi099 ceph-mon[138788]: pgmap v3285: 169 pgs: 1 active+clean+snaptrim, 168 active+clean; 937 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 41 MiB/s rd, 19 MiB/s wr, 229 op/s 2024-01-13T18:56:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:00 smithi099 ceph-mon[138788]: osdmap e1886: 8 total, 8 up, 8 in 2024-01-13T18:56:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:00 smithi084 ceph-mon[116404]: pgmap v3285: 169 pgs: 1 active+clean+snaptrim, 168 active+clean; 937 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 41 MiB/s rd, 19 MiB/s wr, 229 op/s 2024-01-13T18:56:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:00 smithi084 ceph-mon[116404]: osdmap e1886: 8 total, 8 up, 8 in 2024-01-13T18:56:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:00 smithi084 ceph-mon[119097]: pgmap v3285: 169 pgs: 1 active+clean+snaptrim, 168 active+clean; 937 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 41 MiB/s rd, 19 MiB/s wr, 229 op/s 2024-01-13T18:56:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:00 smithi084 ceph-mon[119097]: osdmap e1886: 8 total, 8 up, 8 in 2024-01-13T18:56:01.728 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:01.790 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:56:02.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:01 smithi099 ceph-mon[138788]: osdmap e1887: 8 total, 8 up, 8 in 2024-01-13T18:56:02.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:01 smithi084 ceph-mon[116404]: osdmap e1887: 8 total, 8 up, 8 in 2024-01-13T18:56:02.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:01 smithi084 ceph-mon[119097]: osdmap e1887: 8 total, 8 up, 8 in 2024-01-13T18:56:02.925 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:56:03.001 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:56:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:02 smithi099 ceph-mon[138788]: pgmap v3288: 169 pgs: 1 active+clean+snaptrim, 168 active+clean; 945 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 33 MiB/s rd, 18 MiB/s wr, 169 op/s 2024-01-13T18:56:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:02 smithi099 ceph-mon[138788]: osdmap e1888: 8 total, 8 up, 8 in 2024-01-13T18:56:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:02 smithi084 ceph-mon[116404]: pgmap v3288: 169 pgs: 1 active+clean+snaptrim, 168 active+clean; 945 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 33 MiB/s rd, 18 MiB/s wr, 169 op/s 2024-01-13T18:56:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:02 smithi084 ceph-mon[116404]: osdmap e1888: 8 total, 8 up, 8 in 2024-01-13T18:56:03.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:02 smithi084 ceph-mon[119097]: pgmap v3288: 169 pgs: 1 active+clean+snaptrim, 168 active+clean; 945 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 33 MiB/s rd, 18 MiB/s wr, 169 op/s 2024-01-13T18:56:03.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:02 smithi084 ceph-mon[119097]: osdmap e1888: 8 total, 8 up, 8 in 2024-01-13T18:56:03.815 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneV1Parent (3753 ms) 2024-01-13T18:56:03.815 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneV2Parent 2024-01-13T18:56:03.847 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:03.858 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 0~10 2024-01-13T18:56:03.866 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:03 smithi099 ceph-mon[138788]: osdmap e1889: 8 total, 8 up, 8 in 2024-01-13T18:56:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:03 smithi099 ceph-mon[138788]: osdmap e1890: 8 total, 8 up, 8 in 2024-01-13T18:56:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:03 smithi084 ceph-mon[116404]: osdmap e1889: 8 total, 8 up, 8 in 2024-01-13T18:56:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:03 smithi084 ceph-mon[116404]: osdmap e1890: 8 total, 8 up, 8 in 2024-01-13T18:56:04.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:03 smithi084 ceph-mon[119097]: osdmap e1889: 8 total, 8 up, 8 in 2024-01-13T18:56:04.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:03 smithi084 ceph-mon[119097]: osdmap e1890: 8 total, 8 up, 8 in 2024-01-13T18:56:05.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:04 smithi099 ceph-mon[138788]: pgmap v3291: 169 pgs: 169 active+clean; 925 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 30 MiB/s rd, 4.0 MiB/s wr, 203 op/s 2024-01-13T18:56:05.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:04 smithi084 ceph-mon[116404]: pgmap v3291: 169 pgs: 169 active+clean; 925 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 30 MiB/s rd, 4.0 MiB/s wr, 203 op/s 2024-01-13T18:56:05.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:04 smithi084 ceph-mon[119097]: pgmap v3291: 169 pgs: 169 active+clean; 925 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 30 MiB/s rd, 4.0 MiB/s wr, 203 op/s 2024-01-13T18:56:05.772 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:05.832 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:56:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:05 smithi099 ceph-mon[138788]: osdmap e1891: 8 total, 8 up, 8 in 2024-01-13T18:56:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:05 smithi084 ceph-mon[116404]: osdmap e1891: 8 total, 8 up, 8 in 2024-01-13T18:56:06.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:05 smithi084 ceph-mon[119097]: osdmap e1891: 8 total, 8 up, 8 in 2024-01-13T18:56:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:06.971 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:56:07.049 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:56:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:06 smithi099 ceph-mon[138788]: pgmap v3294: 169 pgs: 169 active+clean; 905 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 36 MiB/s rd, 17 KiB/s wr, 208 op/s 2024-01-13T18:56:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:06 smithi099 ceph-mon[138788]: osdmap e1892: 8 total, 8 up, 8 in 2024-01-13T18:56:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:06 smithi084 ceph-mon[116404]: pgmap v3294: 169 pgs: 169 active+clean; 905 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 36 MiB/s rd, 17 KiB/s wr, 208 op/s 2024-01-13T18:56:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:06 smithi084 ceph-mon[116404]: osdmap e1892: 8 total, 8 up, 8 in 2024-01-13T18:56:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:06 smithi084 ceph-mon[119097]: pgmap v3294: 169 pgs: 169 active+clean; 905 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 36 MiB/s rd, 17 KiB/s wr, 208 op/s 2024-01-13T18:56:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:06 smithi084 ceph-mon[119097]: osdmap e1892: 8 total, 8 up, 8 in 2024-01-13T18:56:07.903 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneV2Parent (4087 ms) 2024-01-13T18:56:07.903 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneV1ParentAbort 2024-01-13T18:56:07.933 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:07.945 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 0~10 2024-01-13T18:56:07.953 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:08.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:07 smithi099 ceph-mon[138788]: osdmap e1893: 8 total, 8 up, 8 in 2024-01-13T18:56:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:07 smithi084 ceph-mon[116404]: osdmap e1893: 8 total, 8 up, 8 in 2024-01-13T18:56:08.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:07 smithi084 ceph-mon[119097]: osdmap e1893: 8 total, 8 up, 8 in 2024-01-13T18:56:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:08 smithi099 ceph-mon[138788]: pgmap v3297: 169 pgs: 169 active+clean; 905 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 7.4 MiB/s rd, 25 KiB/s wr, 517 op/s 2024-01-13T18:56:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:08 smithi099 ceph-mon[138788]: osdmap e1894: 8 total, 8 up, 8 in 2024-01-13T18:56:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:08 smithi099 ceph-mon[138788]: osdmap e1895: 8 total, 8 up, 8 in 2024-01-13T18:56:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:08 smithi084 ceph-mon[116404]: pgmap v3297: 169 pgs: 169 active+clean; 905 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 7.4 MiB/s rd, 25 KiB/s wr, 517 op/s 2024-01-13T18:56:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:08 smithi084 ceph-mon[116404]: osdmap e1894: 8 total, 8 up, 8 in 2024-01-13T18:56:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:08 smithi084 ceph-mon[116404]: osdmap e1895: 8 total, 8 up, 8 in 2024-01-13T18:56:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:08 smithi084 ceph-mon[119097]: pgmap v3297: 169 pgs: 169 active+clean; 905 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 7.4 MiB/s rd, 25 KiB/s wr, 517 op/s 2024-01-13T18:56:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:08 smithi084 ceph-mon[119097]: osdmap e1894: 8 total, 8 up, 8 in 2024-01-13T18:56:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:08 smithi084 ceph-mon[119097]: osdmap e1895: 8 total, 8 up, 8 in 2024-01-13T18:56:09.658 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:09.715 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:56:10.643 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:56:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:56:10] "GET /metrics HTTP/1.1" 200 39042 "" "Prometheus/2.43.0" 2024-01-13T18:56:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:10 smithi084 ceph-mon[116404]: pgmap v3300: 169 pgs: 169 active+clean; 905 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 404 KiB/s rd, 24 KiB/s wr, 511 op/s 2024-01-13T18:56:10.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:10 smithi084 ceph-mon[116404]: osdmap e1896: 8 total, 8 up, 8 in 2024-01-13T18:56:10.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:10 smithi084 ceph-mon[119097]: pgmap v3300: 169 pgs: 169 active+clean; 905 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 404 KiB/s rd, 24 KiB/s wr, 511 op/s 2024-01-13T18:56:10.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:10 smithi084 ceph-mon[119097]: osdmap e1896: 8 total, 8 up, 8 in 2024-01-13T18:56:10.949 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:56:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:10 smithi099 ceph-mon[138788]: pgmap v3300: 169 pgs: 169 active+clean; 905 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 404 KiB/s rd, 24 KiB/s wr, 511 op/s 2024-01-13T18:56:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:10 smithi099 ceph-mon[138788]: osdmap e1896: 8 total, 8 up, 8 in 2024-01-13T18:56:11.909 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneV1ParentAbort (4006 ms) 2024-01-13T18:56:11.909 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneV2ParentAbort 2024-01-13T18:56:11.942 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:11.956 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 0~10 2024-01-13T18:56:11.964 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:12.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:11 smithi099 ceph-mon[138788]: osdmap e1897: 8 total, 8 up, 8 in 2024-01-13T18:56:12.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:11 smithi099 ceph-mon[138788]: pgmap v3303: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 84 KiB/s rd, 8.2 KiB/s wr, 116 op/s 2024-01-13T18:56:12.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:11 smithi084 ceph-mon[116404]: osdmap e1897: 8 total, 8 up, 8 in 2024-01-13T18:56:12.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:11 smithi084 ceph-mon[116404]: pgmap v3303: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 84 KiB/s rd, 8.2 KiB/s wr, 116 op/s 2024-01-13T18:56:12.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:11 smithi084 ceph-mon[119097]: osdmap e1897: 8 total, 8 up, 8 in 2024-01-13T18:56:12.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:11 smithi084 ceph-mon[119097]: pgmap v3303: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 84 KiB/s rd, 8.2 KiB/s wr, 116 op/s 2024-01-13T18:56:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:12 smithi099 ceph-mon[138788]: osdmap e1898: 8 total, 8 up, 8 in 2024-01-13T18:56:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:12 smithi084 ceph-mon[116404]: osdmap e1898: 8 total, 8 up, 8 in 2024-01-13T18:56:13.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:12 smithi084 ceph-mon[119097]: osdmap e1898: 8 total, 8 up, 8 in 2024-01-13T18:56:13.654 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:13.721 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:56:14.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:13 smithi099 ceph-mon[138788]: osdmap e1899: 8 total, 8 up, 8 in 2024-01-13T18:56:14.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:13 smithi099 ceph-mon[138788]: pgmap v3306: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 420 KiB/s rd, 19 KiB/s wr, 519 op/s 2024-01-13T18:56:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:13 smithi099 ceph-mon[138788]: osdmap e1900: 8 total, 8 up, 8 in 2024-01-13T18:56:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:13 smithi084 ceph-mon[116404]: osdmap e1899: 8 total, 8 up, 8 in 2024-01-13T18:56:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:13 smithi084 ceph-mon[116404]: pgmap v3306: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 420 KiB/s rd, 19 KiB/s wr, 519 op/s 2024-01-13T18:56:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:13 smithi084 ceph-mon[116404]: osdmap e1900: 8 total, 8 up, 8 in 2024-01-13T18:56:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:13 smithi084 ceph-mon[119097]: osdmap e1899: 8 total, 8 up, 8 in 2024-01-13T18:56:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:13 smithi084 ceph-mon[119097]: pgmap v3306: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 420 KiB/s rd, 19 KiB/s wr, 519 op/s 2024-01-13T18:56:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:13 smithi084 ceph-mon[119097]: osdmap e1900: 8 total, 8 up, 8 in 2024-01-13T18:56:14.859 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:56:15.801 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneV2ParentAbort (3893 ms) 2024-01-13T18:56:15.802 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneV1ParentAbortFixIncompleteChildReattach 2024-01-13T18:56:15.838 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:15.848 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 0~10 2024-01-13T18:56:15.857 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:15.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:15 smithi084 ceph-mon[116404]: osdmap e1901: 8 total, 8 up, 8 in 2024-01-13T18:56:15.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:15 smithi084 ceph-mon[119097]: osdmap e1901: 8 total, 8 up, 8 in 2024-01-13T18:56:16.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:15 smithi099 ceph-mon[138788]: osdmap e1901: 8 total, 8 up, 8 in 2024-01-13T18:56:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:16 smithi084 ceph-mon[116404]: pgmap v3309: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 516 KiB/s rd, 28 KiB/s wr, 648 op/s 2024-01-13T18:56:16.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:16 smithi084 ceph-mon[116404]: osdmap e1902: 8 total, 8 up, 8 in 2024-01-13T18:56:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:16 smithi084 ceph-mon[119097]: pgmap v3309: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 516 KiB/s rd, 28 KiB/s wr, 648 op/s 2024-01-13T18:56:16.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:16 smithi084 ceph-mon[119097]: osdmap e1902: 8 total, 8 up, 8 in 2024-01-13T18:56:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:16 smithi099 ceph-mon[138788]: pgmap v3309: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 516 KiB/s rd, 28 KiB/s wr, 648 op/s 2024-01-13T18:56:17.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:16 smithi099 ceph-mon[138788]: osdmap e1902: 8 total, 8 up, 8 in 2024-01-13T18:56:17.695 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:17.761 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:56:17.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:17 smithi084 ceph-mon[116404]: osdmap e1903: 8 total, 8 up, 8 in 2024-01-13T18:56:17.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:17 smithi084 ceph-mon[119097]: osdmap e1903: 8 total, 8 up, 8 in 2024-01-13T18:56:18.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:17 smithi099 ceph-mon[138788]: osdmap e1903: 8 total, 8 up, 8 in 2024-01-13T18:56:18.852 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:56:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:18 smithi084 ceph-mon[116404]: pgmap v3312: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 212 KiB/s rd, 22 KiB/s wr, 284 op/s 2024-01-13T18:56:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:18 smithi084 ceph-mon[116404]: osdmap e1904: 8 total, 8 up, 8 in 2024-01-13T18:56:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:18 smithi084 ceph-mon[116404]: osdmap e1905: 8 total, 8 up, 8 in 2024-01-13T18:56:18.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:18 smithi084 ceph-mon[119097]: pgmap v3312: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 212 KiB/s rd, 22 KiB/s wr, 284 op/s 2024-01-13T18:56:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:18 smithi084 ceph-mon[119097]: osdmap e1904: 8 total, 8 up, 8 in 2024-01-13T18:56:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:18 smithi084 ceph-mon[119097]: osdmap e1905: 8 total, 8 up, 8 in 2024-01-13T18:56:19.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:18 smithi099 ceph-mon[138788]: pgmap v3312: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 212 KiB/s rd, 22 KiB/s wr, 284 op/s 2024-01-13T18:56:19.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:18 smithi099 ceph-mon[138788]: osdmap e1904: 8 total, 8 up, 8 in 2024-01-13T18:56:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:18 smithi099 ceph-mon[138788]: osdmap e1905: 8 total, 8 up, 8 in 2024-01-13T18:56:19.836 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneV1ParentAbortFixIncompleteChildReattach (4035 ms) 2024-01-13T18:56:19.836 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneV1ParentAbortFixParentReattach 2024-01-13T18:56:19.868 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:19.879 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 0~10 2024-01-13T18:56:19.887 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:56:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:56:20] "GET /metrics HTTP/1.1" 200 39036 "" "Prometheus/2.43.0" 2024-01-13T18:56:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:20 smithi099 ceph-mon[138788]: pgmap v3315: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 169 KiB/s rd, 17 KiB/s wr, 223 op/s 2024-01-13T18:56:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:20 smithi099 ceph-mon[138788]: osdmap e1906: 8 total, 8 up, 8 in 2024-01-13T18:56:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:20 smithi084 ceph-mon[116404]: pgmap v3315: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 169 KiB/s rd, 17 KiB/s wr, 223 op/s 2024-01-13T18:56:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:20 smithi084 ceph-mon[116404]: osdmap e1906: 8 total, 8 up, 8 in 2024-01-13T18:56:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:20 smithi084 ceph-mon[119097]: pgmap v3315: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 169 KiB/s rd, 17 KiB/s wr, 223 op/s 2024-01-13T18:56:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:20 smithi084 ceph-mon[119097]: osdmap e1906: 8 total, 8 up, 8 in 2024-01-13T18:56:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:21.709 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:21.770 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:56:22.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:21 smithi099 ceph-mon[138788]: osdmap e1907: 8 total, 8 up, 8 in 2024-01-13T18:56:22.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:21 smithi084 ceph-mon[116404]: osdmap e1907: 8 total, 8 up, 8 in 2024-01-13T18:56:22.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:21 smithi084 ceph-mon[119097]: osdmap e1907: 8 total, 8 up, 8 in 2024-01-13T18:56:22.896 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:56:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:22 smithi099 ceph-mon[138788]: pgmap v3318: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 104 KiB/s rd, 9.0 KiB/s wr, 137 op/s 2024-01-13T18:56:23.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:22 smithi099 ceph-mon[138788]: osdmap e1908: 8 total, 8 up, 8 in 2024-01-13T18:56:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:22 smithi084 ceph-mon[116404]: pgmap v3318: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 104 KiB/s rd, 9.0 KiB/s wr, 137 op/s 2024-01-13T18:56:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:22 smithi084 ceph-mon[116404]: osdmap e1908: 8 total, 8 up, 8 in 2024-01-13T18:56:23.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:22 smithi084 ceph-mon[119097]: pgmap v3318: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 104 KiB/s rd, 9.0 KiB/s wr, 137 op/s 2024-01-13T18:56:23.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:22 smithi084 ceph-mon[119097]: osdmap e1908: 8 total, 8 up, 8 in 2024-01-13T18:56:23.772 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneV1ParentAbortFixParentReattach (3935 ms) 2024-01-13T18:56:23.772 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneV1ParentAbortRelinkNotNeeded 2024-01-13T18:56:23.804 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:23.815 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 0~10 2024-01-13T18:56:23.824 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:23 smithi099 ceph-mon[138788]: osdmap e1909: 8 total, 8 up, 8 in 2024-01-13T18:56:24.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:23 smithi099 ceph-mon[138788]: osdmap e1910: 8 total, 8 up, 8 in 2024-01-13T18:56:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:23 smithi084 ceph-mon[116404]: osdmap e1909: 8 total, 8 up, 8 in 2024-01-13T18:56:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:23 smithi084 ceph-mon[116404]: osdmap e1910: 8 total, 8 up, 8 in 2024-01-13T18:56:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:23 smithi084 ceph-mon[119097]: osdmap e1909: 8 total, 8 up, 8 in 2024-01-13T18:56:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:23 smithi084 ceph-mon[119097]: osdmap e1910: 8 total, 8 up, 8 in 2024-01-13T18:56:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:24 smithi099 ceph-mon[138788]: pgmap v3321: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 272 KiB/s rd, 14 KiB/s wr, 348 op/s 2024-01-13T18:56:25.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:24 smithi084 ceph-mon[116404]: pgmap v3321: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 272 KiB/s rd, 14 KiB/s wr, 348 op/s 2024-01-13T18:56:25.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:24 smithi084 ceph-mon[119097]: pgmap v3321: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 272 KiB/s rd, 14 KiB/s wr, 348 op/s 2024-01-13T18:56:25.738 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:25.801 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:56:26.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:25 smithi099 ceph-mon[138788]: osdmap e1911: 8 total, 8 up, 8 in 2024-01-13T18:56:26.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:25 smithi084 ceph-mon[116404]: osdmap e1911: 8 total, 8 up, 8 in 2024-01-13T18:56:26.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:25 smithi084 ceph-mon[119097]: osdmap e1911: 8 total, 8 up, 8 in 2024-01-13T18:56:26.931 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:56:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:26 smithi099 ceph-mon[138788]: pgmap v3324: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 310 KiB/s rd, 20 KiB/s wr, 403 op/s 2024-01-13T18:56:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:26 smithi099 ceph-mon[138788]: osdmap e1912: 8 total, 8 up, 8 in 2024-01-13T18:56:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:26 smithi084 ceph-mon[116404]: pgmap v3324: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 310 KiB/s rd, 20 KiB/s wr, 403 op/s 2024-01-13T18:56:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:26 smithi084 ceph-mon[116404]: osdmap e1912: 8 total, 8 up, 8 in 2024-01-13T18:56:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:26 smithi084 ceph-mon[119097]: pgmap v3324: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 310 KiB/s rd, 20 KiB/s wr, 403 op/s 2024-01-13T18:56:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:26 smithi084 ceph-mon[119097]: osdmap e1912: 8 total, 8 up, 8 in 2024-01-13T18:56:27.887 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneV1ParentAbortRelinkNotNeeded (4116 ms) 2024-01-13T18:56:27.887 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneV2ParentAbortFixIncompleteChildReattach 2024-01-13T18:56:27.917 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:27.928 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 0~10 2024-01-13T18:56:27.936 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:27 smithi099 ceph-mon[138788]: osdmap e1913: 8 total, 8 up, 8 in 2024-01-13T18:56:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:27 smithi084 ceph-mon[116404]: osdmap e1913: 8 total, 8 up, 8 in 2024-01-13T18:56:28.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:27 smithi084 ceph-mon[119097]: osdmap e1913: 8 total, 8 up, 8 in 2024-01-13T18:56:29.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:28 smithi099 ceph-mon[138788]: pgmap v3327: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 274 KiB/s rd, 19 KiB/s wr, 353 op/s 2024-01-13T18:56:29.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:28 smithi099 ceph-mon[138788]: osdmap e1914: 8 total, 8 up, 8 in 2024-01-13T18:56:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:28 smithi099 ceph-mon[138788]: osdmap e1915: 8 total, 8 up, 8 in 2024-01-13T18:56:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:28 smithi084 ceph-mon[116404]: pgmap v3327: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 274 KiB/s rd, 19 KiB/s wr, 353 op/s 2024-01-13T18:56:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:28 smithi084 ceph-mon[116404]: osdmap e1914: 8 total, 8 up, 8 in 2024-01-13T18:56:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:28 smithi084 ceph-mon[116404]: osdmap e1915: 8 total, 8 up, 8 in 2024-01-13T18:56:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:28 smithi084 ceph-mon[119097]: pgmap v3327: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 274 KiB/s rd, 19 KiB/s wr, 353 op/s 2024-01-13T18:56:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:28 smithi084 ceph-mon[119097]: osdmap e1914: 8 total, 8 up, 8 in 2024-01-13T18:56:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:28 smithi084 ceph-mon[119097]: osdmap e1915: 8 total, 8 up, 8 in 2024-01-13T18:56:29.661 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:29.718 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:56:30.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:56:30.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:56:30.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:56:30.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:29 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:56:30.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:29 smithi099 ceph-mon[138788]: osdmap e1916: 8 total, 8 up, 8 in 2024-01-13T18:56:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:56:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:56:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:56:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:29 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:56:30.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:29 smithi084 ceph-mon[116404]: osdmap e1916: 8 total, 8 up, 8 in 2024-01-13T18:56:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:56:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:56:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:56:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:29 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:56:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:29 smithi084 ceph-mon[119097]: osdmap e1916: 8 total, 8 up, 8 in 2024-01-13T18:56:30.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:56:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:56:30] "GET /metrics HTTP/1.1" 200 39036 "" "Prometheus/2.43.0" 2024-01-13T18:56:30.940 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:56:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:30 smithi099 ceph-mon[138788]: pgmap v3330: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 277 KiB/s rd, 14 KiB/s wr, 345 op/s 2024-01-13T18:56:31.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:30 smithi084 ceph-mon[119097]: pgmap v3330: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 277 KiB/s rd, 14 KiB/s wr, 345 op/s 2024-01-13T18:56:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:30 smithi084 ceph-mon[116404]: pgmap v3330: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 277 KiB/s rd, 14 KiB/s wr, 345 op/s 2024-01-13T18:56:31.889 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneV2ParentAbortFixIncompleteChildReattach (4002 ms) 2024-01-13T18:56:31.889 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneV2ParentAbortFixParentReattach 2024-01-13T18:56:31.920 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:31.930 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 0~10 2024-01-13T18:56:31.939 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:32.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:31 smithi099 ceph-mon[138788]: osdmap e1917: 8 total, 8 up, 8 in 2024-01-13T18:56:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:31 smithi084 ceph-mon[116404]: osdmap e1917: 8 total, 8 up, 8 in 2024-01-13T18:56:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:31 smithi084 ceph-mon[119097]: osdmap e1917: 8 total, 8 up, 8 in 2024-01-13T18:56:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:32 smithi099 ceph-mon[138788]: pgmap v3333: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 198 KiB/s rd, 10 KiB/s wr, 249 op/s 2024-01-13T18:56:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:32 smithi099 ceph-mon[138788]: osdmap e1918: 8 total, 8 up, 8 in 2024-01-13T18:56:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:32 smithi084 ceph-mon[116404]: pgmap v3333: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 198 KiB/s rd, 10 KiB/s wr, 249 op/s 2024-01-13T18:56:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:32 smithi084 ceph-mon[116404]: osdmap e1918: 8 total, 8 up, 8 in 2024-01-13T18:56:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:32 smithi084 ceph-mon[119097]: pgmap v3333: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 198 KiB/s rd, 10 KiB/s wr, 249 op/s 2024-01-13T18:56:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:32 smithi084 ceph-mon[119097]: osdmap e1918: 8 total, 8 up, 8 in 2024-01-13T18:56:33.664 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:33.721 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:56:34.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:33 smithi099 ceph-mon[138788]: osdmap e1919: 8 total, 8 up, 8 in 2024-01-13T18:56:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:33 smithi099 ceph-mon[138788]: osdmap e1920: 8 total, 8 up, 8 in 2024-01-13T18:56:34.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:33 smithi084 ceph-mon[119097]: osdmap e1919: 8 total, 8 up, 8 in 2024-01-13T18:56:34.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:33 smithi084 ceph-mon[119097]: osdmap e1920: 8 total, 8 up, 8 in 2024-01-13T18:56:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:33 smithi084 ceph-mon[116404]: osdmap e1919: 8 total, 8 up, 8 in 2024-01-13T18:56:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:33 smithi084 ceph-mon[116404]: osdmap e1920: 8 total, 8 up, 8 in 2024-01-13T18:56:34.963 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:56:35.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:34 smithi099 ceph-mon[138788]: pgmap v3336: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 336 KiB/s rd, 20 KiB/s wr, 432 op/s 2024-01-13T18:56:35.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:34 smithi084 ceph-mon[116404]: pgmap v3336: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 336 KiB/s rd, 20 KiB/s wr, 432 op/s 2024-01-13T18:56:35.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:34 smithi084 ceph-mon[119097]: pgmap v3336: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 336 KiB/s rd, 20 KiB/s wr, 432 op/s 2024-01-13T18:56:35.923 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneV2ParentAbortFixParentReattach (4034 ms) 2024-01-13T18:56:35.924 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.CloneV2ParentAbortRelinkNotNeeded 2024-01-13T18:56:35.956 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:35.967 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 0~10 2024-01-13T18:56:35.975 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:35 smithi099 ceph-mon[138788]: osdmap e1921: 8 total, 8 up, 8 in 2024-01-13T18:56:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:35 smithi099 ceph-mon[138788]: pgmap v3339: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 331 KiB/s rd, 27 KiB/s wr, 430 op/s 2024-01-13T18:56:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:36.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:35 smithi084 ceph-mon[119097]: osdmap e1921: 8 total, 8 up, 8 in 2024-01-13T18:56:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:35 smithi084 ceph-mon[119097]: pgmap v3339: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 331 KiB/s rd, 27 KiB/s wr, 430 op/s 2024-01-13T18:56:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:36.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:35 smithi084 ceph-mon[116404]: osdmap e1921: 8 total, 8 up, 8 in 2024-01-13T18:56:36.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:35 smithi084 ceph-mon[116404]: pgmap v3339: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 331 KiB/s rd, 27 KiB/s wr, 430 op/s 2024-01-13T18:56:36.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:36 smithi099 ceph-mon[138788]: osdmap e1922: 8 total, 8 up, 8 in 2024-01-13T18:56:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:36 smithi084 ceph-mon[116404]: osdmap e1922: 8 total, 8 up, 8 in 2024-01-13T18:56:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:36 smithi084 ceph-mon[119097]: osdmap e1922: 8 total, 8 up, 8 in 2024-01-13T18:56:37.807 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:37.872 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:56:38.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:37 smithi099 ceph-mon[138788]: osdmap e1923: 8 total, 8 up, 8 in 2024-01-13T18:56:38.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:37 smithi099 ceph-mon[138788]: pgmap v3342: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 236 KiB/s rd, 21 KiB/s wr, 306 op/s 2024-01-13T18:56:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:37 smithi084 ceph-mon[116404]: osdmap e1923: 8 total, 8 up, 8 in 2024-01-13T18:56:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:37 smithi084 ceph-mon[116404]: pgmap v3342: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 236 KiB/s rd, 21 KiB/s wr, 306 op/s 2024-01-13T18:56:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:37 smithi084 ceph-mon[119097]: osdmap e1923: 8 total, 8 up, 8 in 2024-01-13T18:56:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:37 smithi084 ceph-mon[119097]: pgmap v3342: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 236 KiB/s rd, 21 KiB/s wr, 306 op/s 2024-01-13T18:56:38.830 INFO:tasks.workunit.client.0.smithi084.stdout:migration_abort 2024-01-13T18:56:39.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:38 smithi099 ceph-mon[138788]: osdmap e1924: 8 total, 8 up, 8 in 2024-01-13T18:56:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:38 smithi099 ceph-mon[138788]: osdmap e1925: 8 total, 8 up, 8 in 2024-01-13T18:56:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:38 smithi084 ceph-mon[116404]: osdmap e1924: 8 total, 8 up, 8 in 2024-01-13T18:56:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:38 smithi084 ceph-mon[116404]: osdmap e1925: 8 total, 8 up, 8 in 2024-01-13T18:56:39.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:38 smithi084 ceph-mon[119097]: osdmap e1924: 8 total, 8 up, 8 in 2024-01-13T18:56:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:38 smithi084 ceph-mon[119097]: osdmap e1925: 8 total, 8 up, 8 in 2024-01-13T18:56:39.947 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.CloneV2ParentAbortRelinkNotNeeded (4024 ms) 2024-01-13T18:56:39.948 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.StressNoMigrate 2024-01-13T18:56:39.980 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:39.990 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 57019731~6905635 2024-01-13T18:56:40.038 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 40253096~3386705 2024-01-13T18:56:40.038 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 18775645~3982080 2024-01-13T18:56:40.068 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 50174914~6617064 2024-01-13T18:56:40.070 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 73633339~325254 2024-01-13T18:56:40.077 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 51613991~7707376 2024-01-13T18:56:40.084 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 46869299~1608375 2024-01-13T18:56:40.099 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 50521476~7655317 2024-01-13T18:56:40.099 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap0 2024-01-13T18:56:40.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:39 smithi099 ceph-mon[138788]: pgmap v3345: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 215 KiB/s rd, 18 KiB/s wr, 278 op/s 2024-01-13T18:56:40.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:39 smithi084 ceph-mon[116404]: pgmap v3345: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 215 KiB/s rd, 18 KiB/s wr, 278 op/s 2024-01-13T18:56:40.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:39 smithi084 ceph-mon[119097]: pgmap v3345: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 215 KiB/s rd, 18 KiB/s wr, 278 op/s 2024-01-13T18:56:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:56:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:56:40] "GET /metrics HTTP/1.1" 200 39041 "" "Prometheus/2.43.0" 2024-01-13T18:56:41.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:40 smithi099 ceph-mon[138788]: osdmap e1926: 8 total, 8 up, 8 in 2024-01-13T18:56:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:40 smithi084 ceph-mon[116404]: osdmap e1926: 8 total, 8 up, 8 in 2024-01-13T18:56:41.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:40 smithi084 ceph-mon[119097]: osdmap e1926: 8 total, 8 up, 8 in 2024-01-13T18:56:41.838 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap0 2024-01-13T18:56:41.852 INFO:tasks.workunit.client.0.smithi084.stdout:clone image354 -> image357 2024-01-13T18:56:41.959 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 160938013 2024-01-13T18:56:41.970 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 75449702~6760797 2024-01-13T18:56:42.028 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 85745150~8256699 2024-01-13T18:56:42.028 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 155799362~5138651 2024-01-13T18:56:42.062 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 28683072~6838729 2024-01-13T18:56:42.072 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 35345372~2877896 2024-01-13T18:56:42.089 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 102884832~1229824 2024-01-13T18:56:42.089 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 44259406~4355047 2024-01-13T18:56:42.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:41 smithi099 ceph-mon[138788]: osdmap e1927: 8 total, 8 up, 8 in 2024-01-13T18:56:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:41 smithi099 ceph-mon[138788]: pgmap v3348: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 126 KiB/s rd, 11 KiB/s wr, 168 op/s 2024-01-13T18:56:42.121 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 7006631~3437477 2024-01-13T18:56:42.128 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:41 smithi084 ceph-mon[116404]: osdmap e1927: 8 total, 8 up, 8 in 2024-01-13T18:56:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:41 smithi084 ceph-mon[116404]: pgmap v3348: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 126 KiB/s rd, 11 KiB/s wr, 168 op/s 2024-01-13T18:56:42.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:41 smithi084 ceph-mon[119097]: osdmap e1927: 8 total, 8 up, 8 in 2024-01-13T18:56:42.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:41 smithi084 ceph-mon[119097]: pgmap v3348: 169 pgs: 169 active+clean; 905 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 126 KiB/s rd, 11 KiB/s wr, 168 op/s 2024-01-13T18:56:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:42 smithi099 ceph-mon[138788]: osdmap e1928: 8 total, 8 up, 8 in 2024-01-13T18:56:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:42 smithi084 ceph-mon[116404]: osdmap e1928: 8 total, 8 up, 8 in 2024-01-13T18:56:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:42 smithi084 ceph-mon[119097]: osdmap e1928: 8 total, 8 up, 8 in 2024-01-13T18:56:43.666 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:43.682 INFO:tasks.workunit.client.0.smithi084.stdout:clone image357 -> image359 2024-01-13T18:56:43.818 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 203452758 2024-01-13T18:56:43.830 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 16159879~3354646 2024-01-13T18:56:43.881 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 52772950~7418035 2024-01-13T18:56:43.920 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 193343674~7043504 2024-01-13T18:56:43.967 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 12572655~7599673 2024-01-13T18:56:43.973 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 103442469~827630 2024-01-13T18:56:43.983 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 42082909~7361725 2024-01-13T18:56:44.001 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 77987390~3277528 2024-01-13T18:56:44.056 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 80196706~2250182 2024-01-13T18:56:44.058 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:56:44.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:43 smithi099 ceph-mon[138788]: osdmap e1929: 8 total, 8 up, 8 in 2024-01-13T18:56:44.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:43 smithi099 ceph-mon[138788]: pgmap v3351: 169 pgs: 169 active+clean; 942 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 392 KiB/s rd, 7.6 MiB/s wr, 412 op/s 2024-01-13T18:56:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:43 smithi099 ceph-mon[138788]: osdmap e1930: 8 total, 8 up, 8 in 2024-01-13T18:56:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:43 smithi084 ceph-mon[116404]: osdmap e1929: 8 total, 8 up, 8 in 2024-01-13T18:56:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:43 smithi084 ceph-mon[116404]: pgmap v3351: 169 pgs: 169 active+clean; 942 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 392 KiB/s rd, 7.6 MiB/s wr, 412 op/s 2024-01-13T18:56:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:43 smithi084 ceph-mon[116404]: osdmap e1930: 8 total, 8 up, 8 in 2024-01-13T18:56:44.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:43 smithi084 ceph-mon[119097]: osdmap e1929: 8 total, 8 up, 8 in 2024-01-13T18:56:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:43 smithi084 ceph-mon[119097]: pgmap v3351: 169 pgs: 169 active+clean; 942 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 392 KiB/s rd, 7.6 MiB/s wr, 412 op/s 2024-01-13T18:56:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:43 smithi084 ceph-mon[119097]: osdmap e1930: 8 total, 8 up, 8 in 2024-01-13T18:56:45.856 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap2 2024-01-13T18:56:45.869 INFO:tasks.workunit.client.0.smithi084.stdout:clone image359 -> image361 2024-01-13T18:56:46.025 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 141735471 2024-01-13T18:56:46.042 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 57714550~130797 2024-01-13T18:56:46.052 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 136652260~5083211 2024-01-13T18:56:46.058 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 126878771~3630172 2024-01-13T18:56:46.087 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 52814192~889920 2024-01-13T18:56:46.094 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 126196137~3714754 2024-01-13T18:56:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:45 smithi099 ceph-mon[138788]: osdmap e1931: 8 total, 8 up, 8 in 2024-01-13T18:56:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:45 smithi099 ceph-mon[138788]: pgmap v3354: 169 pgs: 169 active+clean; 969 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 525 op/s 2024-01-13T18:56:46.121 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 10704369~4114949 2024-01-13T18:56:46.129 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 87115312~7755946 2024-01-13T18:56:46.173 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 62502738~3637741 2024-01-13T18:56:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:45 smithi084 ceph-mon[116404]: osdmap e1931: 8 total, 8 up, 8 in 2024-01-13T18:56:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:45 smithi084 ceph-mon[116404]: pgmap v3354: 169 pgs: 169 active+clean; 969 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 525 op/s 2024-01-13T18:56:46.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:45 smithi084 ceph-mon[119097]: osdmap e1931: 8 total, 8 up, 8 in 2024-01-13T18:56:46.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:45 smithi084 ceph-mon[119097]: pgmap v3354: 169 pgs: 169 active+clean; 969 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 525 op/s 2024-01-13T18:56:46.201 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:56:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:46 smithi099 ceph-mon[138788]: osdmap e1932: 8 total, 8 up, 8 in 2024-01-13T18:56:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:46 smithi084 ceph-mon[116404]: osdmap e1932: 8 total, 8 up, 8 in 2024-01-13T18:56:47.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:46 smithi084 ceph-mon[119097]: osdmap e1932: 8 total, 8 up, 8 in 2024-01-13T18:56:47.870 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap3 2024-01-13T18:56:47.884 INFO:tasks.workunit.client.0.smithi084.stdout:clone image361 -> image363 2024-01-13T18:56:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:47 smithi099 ceph-mon[138788]: osdmap e1933: 8 total, 8 up, 8 in 2024-01-13T18:56:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:47 smithi099 ceph-mon[138788]: pgmap v3357: 169 pgs: 169 active+clean; 1.0 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 7.8 MiB/s rd, 18 MiB/s wr, 463 op/s 2024-01-13T18:56:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:47 smithi084 ceph-mon[116404]: osdmap e1933: 8 total, 8 up, 8 in 2024-01-13T18:56:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:47 smithi084 ceph-mon[116404]: pgmap v3357: 169 pgs: 169 active+clean; 1.0 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 7.8 MiB/s rd, 18 MiB/s wr, 463 op/s 2024-01-13T18:56:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:47 smithi084 ceph-mon[119097]: osdmap e1933: 8 total, 8 up, 8 in 2024-01-13T18:56:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:47 smithi084 ceph-mon[119097]: pgmap v3357: 169 pgs: 169 active+clean; 1.0 GiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 7.8 MiB/s rd, 18 MiB/s wr, 463 op/s 2024-01-13T18:56:48.211 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.StressNoMigrate (8264 ms) 2024-01-13T18:56:48.211 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.Stress 2024-01-13T18:56:48.243 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:48.253 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 6452612~1251817 2024-01-13T18:56:48.268 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 64877412~5103174 2024-01-13T18:56:48.268 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 24262482~5425729 2024-01-13T18:56:48.311 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 5905537~1046076 2024-01-13T18:56:48.313 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 52172794~1346840 2024-01-13T18:56:48.326 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 10436952~3135389 2024-01-13T18:56:48.326 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 78763658~1086338 2024-01-13T18:56:48.335 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 48112589~5627744 2024-01-13T18:56:48.337 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap0 2024-01-13T18:56:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:48 smithi099 ceph-mon[138788]: osdmap e1934: 8 total, 8 up, 8 in 2024-01-13T18:56:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:48 smithi099 ceph-mon[138788]: osdmap e1935: 8 total, 8 up, 8 in 2024-01-13T18:56:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:48 smithi084 ceph-mon[116404]: osdmap e1934: 8 total, 8 up, 8 in 2024-01-13T18:56:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:48 smithi084 ceph-mon[116404]: osdmap e1935: 8 total, 8 up, 8 in 2024-01-13T18:56:49.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:48 smithi084 ceph-mon[119097]: osdmap e1934: 8 total, 8 up, 8 in 2024-01-13T18:56:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:48 smithi084 ceph-mon[119097]: osdmap e1935: 8 total, 8 up, 8 in 2024-01-13T18:56:49.668 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap0 2024-01-13T18:56:49.683 INFO:tasks.workunit.client.0.smithi084.stdout:clone image364 -> image367 2024-01-13T18:56:49.795 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 64236983~7219200 2024-01-13T18:56:49.847 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 36099779~7936958 2024-01-13T18:56:49.857 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 12051907~1529419 2024-01-13T18:56:49.871 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 68005621~7153661 2024-01-13T18:56:49.874 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 52734443~5150801 2024-01-13T18:56:49.905 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 38847632~2937509 2024-01-13T18:56:49.907 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 37743759~6678339 2024-01-13T18:56:49.948 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 20170121~3357204 2024-01-13T18:56:49.965 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:50.652 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:56:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:56:50] "GET /metrics HTTP/1.1" 200 39038 "" "Prometheus/2.43.0" 2024-01-13T18:56:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:50 smithi084 ceph-mon[116404]: pgmap v3360: 169 pgs: 169 active+clean; 1.1 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 23 MiB/s wr, 516 op/s 2024-01-13T18:56:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:50 smithi084 ceph-mon[116404]: osdmap e1936: 8 total, 8 up, 8 in 2024-01-13T18:56:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:50 smithi084 ceph-mon[119097]: pgmap v3360: 169 pgs: 169 active+clean; 1.1 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 23 MiB/s wr, 516 op/s 2024-01-13T18:56:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:50 smithi084 ceph-mon[119097]: osdmap e1936: 8 total, 8 up, 8 in 2024-01-13T18:56:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:50 smithi099 ceph-mon[138788]: pgmap v3360: 169 pgs: 169 active+clean; 1.1 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 23 MiB/s wr, 516 op/s 2024-01-13T18:56:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:50 smithi099 ceph-mon[138788]: osdmap e1936: 8 total, 8 up, 8 in 2024-01-13T18:56:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:56:51.880 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:56:51.894 INFO:tasks.workunit.client.0.smithi084.stdout:clone image367 -> image369 2024-01-13T18:56:52.030 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 161873115 2024-01-13T18:56:52.042 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 54412141~3003952 2024-01-13T18:56:52.090 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 111407439~3836404 2024-01-13T18:56:52.090 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 80732495~1046643 2024-01-13T18:56:52.128 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 110875170~5931436 2024-01-13T18:56:52.128 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 26388639~3123884 2024-01-13T18:56:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:51 smithi084 ceph-mon[116404]: osdmap e1937: 8 total, 8 up, 8 in 2024-01-13T18:56:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:51 smithi084 ceph-mon[116404]: pgmap v3363: 169 pgs: 169 active+clean; 1.1 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 7.1 MiB/s rd, 10 MiB/s wr, 329 op/s 2024-01-13T18:56:52.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:51 smithi084 ceph-mon[119097]: osdmap e1937: 8 total, 8 up, 8 in 2024-01-13T18:56:52.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:51 smithi084 ceph-mon[119097]: pgmap v3363: 169 pgs: 169 active+clean; 1.1 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 7.1 MiB/s rd, 10 MiB/s wr, 329 op/s 2024-01-13T18:56:52.195 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 60223885~551028 2024-01-13T18:56:52.202 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 152353768~2542970 2024-01-13T18:56:52.220 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 44811988~3541543 2024-01-13T18:56:52.250 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:56:52.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:51 smithi099 ceph-mon[138788]: osdmap e1937: 8 total, 8 up, 8 in 2024-01-13T18:56:52.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:51 smithi099 ceph-mon[138788]: pgmap v3363: 169 pgs: 169 active+clean; 1.1 GiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 7.1 MiB/s rd, 10 MiB/s wr, 329 op/s 2024-01-13T18:56:53.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:52 smithi084 ceph-mon[119097]: osdmap e1938: 8 total, 8 up, 8 in 2024-01-13T18:56:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:52 smithi084 ceph-mon[116404]: osdmap e1938: 8 total, 8 up, 8 in 2024-01-13T18:56:53.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:52 smithi099 ceph-mon[138788]: osdmap e1938: 8 total, 8 up, 8 in 2024-01-13T18:56:53.894 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap2 2024-01-13T18:56:53.906 INFO:tasks.workunit.client.0.smithi084.stdout:clone image369 -> image371 2024-01-13T18:56:54.058 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 150450544~3853371 2024-01-13T18:56:54.107 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 145723214~3967036 2024-01-13T18:56:54.112 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 119232059~3042834 2024-01-13T18:56:54.140 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 126512511~4545897 2024-01-13T18:56:54.148 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 103893166~4228832 2024-01-13T18:56:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:53 smithi084 ceph-mon[116404]: osdmap e1939: 8 total, 8 up, 8 in 2024-01-13T18:56:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:53 smithi084 ceph-mon[116404]: pgmap v3366: 169 pgs: 169 active+clean; 1.2 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 14 MiB/s wr, 526 op/s 2024-01-13T18:56:54.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:53 smithi084 ceph-mon[119097]: osdmap e1939: 8 total, 8 up, 8 in 2024-01-13T18:56:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:53 smithi084 ceph-mon[119097]: pgmap v3366: 169 pgs: 169 active+clean; 1.2 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 14 MiB/s wr, 526 op/s 2024-01-13T18:56:54.183 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 47486116~801429 2024-01-13T18:56:54.189 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 70264520~2039758 2024-01-13T18:56:54.230 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 47169477~2534411 2024-01-13T18:56:54.232 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:56:54.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:53 smithi099 ceph-mon[138788]: osdmap e1939: 8 total, 8 up, 8 in 2024-01-13T18:56:54.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:53 smithi099 ceph-mon[138788]: pgmap v3366: 169 pgs: 169 active+clean; 1.2 GiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 14 MiB/s wr, 526 op/s 2024-01-13T18:56:55.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:54 smithi084 ceph-mon[116404]: osdmap e1940: 8 total, 8 up, 8 in 2024-01-13T18:56:55.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:54 smithi084 ceph-mon[119097]: osdmap e1940: 8 total, 8 up, 8 in 2024-01-13T18:56:55.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:54 smithi099 ceph-mon[138788]: osdmap e1940: 8 total, 8 up, 8 in 2024-01-13T18:56:55.908 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap3 2024-01-13T18:56:55.923 INFO:tasks.workunit.client.0.smithi084.stdout:clone image371 -> image373 2024-01-13T18:56:56.107 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 168654899 2024-01-13T18:56:56.121 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:56:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:55 smithi084 ceph-mon[116404]: osdmap e1941: 8 total, 8 up, 8 in 2024-01-13T18:56:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:55 smithi084 ceph-mon[116404]: pgmap v3369: 169 pgs: 169 active+clean; 1.2 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 21 MiB/s wr, 531 op/s 2024-01-13T18:56:56.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:55 smithi084 ceph-mon[119097]: osdmap e1941: 8 total, 8 up, 8 in 2024-01-13T18:56:56.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:55 smithi084 ceph-mon[119097]: pgmap v3369: 169 pgs: 169 active+clean; 1.2 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 21 MiB/s wr, 531 op/s 2024-01-13T18:56:56.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:55 smithi099 ceph-mon[138788]: osdmap e1941: 8 total, 8 up, 8 in 2024-01-13T18:56:56.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:55 smithi099 ceph-mon[138788]: pgmap v3369: 169 pgs: 169 active+clean; 1.2 GiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 21 MiB/s wr, 531 op/s 2024-01-13T18:56:56.648 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:56:56.871 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:56:57.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:56 smithi084 ceph-mon[116404]: osdmap e1942: 8 total, 8 up, 8 in 2024-01-13T18:56:57.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:56 smithi084 ceph-mon[119097]: osdmap e1942: 8 total, 8 up, 8 in 2024-01-13T18:56:57.233 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.Stress (9022 ms) 2024-01-13T18:56:57.233 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.Stress2 2024-01-13T18:56:57.265 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:56:57.276 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 16282492~6193308 2024-01-13T18:56:57.318 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 43460118~6496186 2024-01-13T18:56:57.319 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 27266594~56305 2024-01-13T18:56:57.323 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 64844317~4060048 2024-01-13T18:56:57.323 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 759758~5642313 2024-01-13T18:56:57.363 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 29624372~5332628 2024-01-13T18:56:57.363 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 79272951~4613129 2024-01-13T18:56:57.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:56 smithi099 ceph-mon[138788]: osdmap e1942: 8 total, 8 up, 8 in 2024-01-13T18:56:57.396 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 44423727~36976 2024-01-13T18:56:57.397 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap0 2024-01-13T18:56:58.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:57 smithi099 ceph-mon[138788]: pgmap v3371: 169 pgs: 169 active+clean; 1.3 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 18 MiB/s wr, 679 op/s 2024-01-13T18:56:58.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:57 smithi084 ceph-mon[116404]: pgmap v3371: 169 pgs: 169 active+clean; 1.3 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 18 MiB/s wr, 679 op/s 2024-01-13T18:56:58.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:57 smithi084 ceph-mon[119097]: pgmap v3371: 169 pgs: 169 active+clean; 1.3 GiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 18 MiB/s wr, 679 op/s 2024-01-13T18:56:58.980 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 57655989~7026584 2024-01-13T18:56:59.001 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 40131210~5137436 2024-01-13T18:56:59.001 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 18149201~8125770 2024-01-13T18:56:59.009 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 11931151~227928 2024-01-13T18:56:59.009 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 56435738~3906396 2024-01-13T18:56:59.048 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 66207707~3804415 2024-01-13T18:56:59.049 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 35163547~1087784 2024-01-13T18:56:59.052 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 24361186~6992728 2024-01-13T18:56:59.072 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:56:59.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:58 smithi099 ceph-mon[138788]: osdmap e1943: 8 total, 8 up, 8 in 2024-01-13T18:56:59.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:58 smithi084 ceph-mon[116404]: osdmap e1943: 8 total, 8 up, 8 in 2024-01-13T18:56:59.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:58 smithi084 ceph-mon[119097]: osdmap e1943: 8 total, 8 up, 8 in 2024-01-13T18:57:00.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:59 smithi084 ceph-mon[116404]: pgmap v3373: 169 pgs: 169 active+clean; 1.3 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 26 MiB/s rd, 14 MiB/s wr, 804 op/s 2024-01-13T18:57:00.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:56:59 smithi084 ceph-mon[116404]: osdmap e1944: 8 total, 8 up, 8 in 2024-01-13T18:57:00.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:59 smithi084 ceph-mon[119097]: pgmap v3373: 169 pgs: 169 active+clean; 1.3 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 26 MiB/s rd, 14 MiB/s wr, 804 op/s 2024-01-13T18:57:00.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:56:59 smithi084 ceph-mon[119097]: osdmap e1944: 8 total, 8 up, 8 in 2024-01-13T18:57:00.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:59 smithi099 ceph-mon[138788]: pgmap v3373: 169 pgs: 169 active+clean; 1.3 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 26 MiB/s rd, 14 MiB/s wr, 804 op/s 2024-01-13T18:57:00.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:56:59 smithi099 ceph-mon[138788]: osdmap e1944: 8 total, 8 up, 8 in 2024-01-13T18:57:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:57:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:57:00] "GET /metrics HTTP/1.1" 200 39038 "" "Prometheus/2.43.0" 2024-01-13T18:57:00.992 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:57:01.005 INFO:tasks.workunit.client.0.smithi084.stdout:clone image374 -> image377 2024-01-13T18:57:01.108 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 85182213 2024-01-13T18:57:01.119 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 44135260~7186241 2024-01-13T18:57:01.175 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 78243767~6938446 2024-01-13T18:57:01.184 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 59063863~1728506 2024-01-13T18:57:01.228 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 45148588~4170520 2024-01-13T18:57:01.230 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 22059777~3045362 2024-01-13T18:57:01.280 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 17454593~7258640 2024-01-13T18:57:01.303 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 12530012~5289183 2024-01-13T18:57:01.331 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 25294076~702794 2024-01-13T18:57:01.335 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:57:01.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:00 smithi099 ceph-mon[138788]: osdmap e1945: 8 total, 8 up, 8 in 2024-01-13T18:57:01.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:00 smithi084 ceph-mon[116404]: osdmap e1945: 8 total, 8 up, 8 in 2024-01-13T18:57:01.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:00 smithi084 ceph-mon[119097]: osdmap e1945: 8 total, 8 up, 8 in 2024-01-13T18:57:02.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:01 smithi099 ceph-mon[138788]: pgmap v3376: 169 pgs: 169 active+clean; 1.3 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 31 MiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-01-13T18:57:02.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:01 smithi099 ceph-mon[138788]: osdmap e1946: 8 total, 8 up, 8 in 2024-01-13T18:57:02.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:01 smithi084 ceph-mon[116404]: pgmap v3376: 169 pgs: 169 active+clean; 1.3 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 31 MiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-01-13T18:57:02.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:01 smithi084 ceph-mon[116404]: osdmap e1946: 8 total, 8 up, 8 in 2024-01-13T18:57:02.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:01 smithi084 ceph-mon[119097]: pgmap v3376: 169 pgs: 169 active+clean; 1.3 GiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 31 MiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-01-13T18:57:02.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:01 smithi084 ceph-mon[119097]: osdmap e1946: 8 total, 8 up, 8 in 2024-01-13T18:57:03.015 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 167516530 2024-01-13T18:57:03.029 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 23525282~1085471 2024-01-13T18:57:03.037 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 115986830~1420765 2024-01-13T18:57:03.037 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 162436511~5080019 2024-01-13T18:57:03.043 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 5984809~6499001 2024-01-13T18:57:03.043 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 45735926~1703912 2024-01-13T18:57:03.045 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 138240293~2344564 2024-01-13T18:57:03.045 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 117714734~34220 2024-01-13T18:57:03.045 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 42045911~1549883 2024-01-13T18:57:03.045 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:57:03.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:02 smithi099 ceph-mon[138788]: osdmap e1947: 8 total, 8 up, 8 in 2024-01-13T18:57:03.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:02 smithi084 ceph-mon[116404]: osdmap e1947: 8 total, 8 up, 8 in 2024-01-13T18:57:03.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:02 smithi084 ceph-mon[119097]: osdmap e1947: 8 total, 8 up, 8 in 2024-01-13T18:57:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:03 smithi099 ceph-mon[138788]: pgmap v3379: 169 pgs: 169 active+clean; 1.4 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 22 MiB/s rd, 21 MiB/s wr, 639 op/s 2024-01-13T18:57:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:03 smithi099 ceph-mon[138788]: osdmap e1948: 8 total, 8 up, 8 in 2024-01-13T18:57:04.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:03 smithi084 ceph-mon[116404]: pgmap v3379: 169 pgs: 169 active+clean; 1.4 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 22 MiB/s rd, 21 MiB/s wr, 639 op/s 2024-01-13T18:57:04.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:03 smithi084 ceph-mon[116404]: osdmap e1948: 8 total, 8 up, 8 in 2024-01-13T18:57:04.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:03 smithi084 ceph-mon[119097]: pgmap v3379: 169 pgs: 169 active+clean; 1.4 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 22 MiB/s rd, 21 MiB/s wr, 639 op/s 2024-01-13T18:57:04.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:03 smithi084 ceph-mon[119097]: osdmap e1948: 8 total, 8 up, 8 in 2024-01-13T18:57:05.021 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap3 2024-01-13T18:57:05.036 INFO:tasks.workunit.client.0.smithi084.stdout:clone image377 -> image379 2024-01-13T18:57:05.180 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:57:05.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:05 smithi099 ceph-mon[138788]: osdmap e1949: 8 total, 8 up, 8 in 2024-01-13T18:57:05.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:05 smithi084 ceph-mon[119097]: osdmap e1949: 8 total, 8 up, 8 in 2024-01-13T18:57:05.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:05 smithi084 ceph-mon[116404]: osdmap e1949: 8 total, 8 up, 8 in 2024-01-13T18:57:05.575 INFO:tasks.workunit.client.0.smithi084.stdout:write: a 118987983~3762132 2024-01-13T18:57:05.617 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 27957445~7603632 2024-01-13T18:57:05.647 INFO:tasks.workunit.client.0.smithi084.stdout:write: a 29101705~6505441 2024-01-13T18:57:05.684 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 89986696~7313915 2024-01-13T18:57:05.715 INFO:tasks.workunit.client.0.smithi084.stdout:write: a 47157631~3871785 2024-01-13T18:57:05.767 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 82977817~1854134 2024-01-13T18:57:05.804 INFO:tasks.workunit.client.0.smithi084.stdout:write: a 161408587~6107943 2024-01-13T18:57:05.860 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 42872550~3539133 2024-01-13T18:57:05.878 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: user0 2024-01-13T18:57:06.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:06 smithi099 ceph-mon[138788]: pgmap v3382: 169 pgs: 169 active+clean; 1.4 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 22 MiB/s wr, 413 op/s 2024-01-13T18:57:06.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:06 smithi099 ceph-mon[138788]: osdmap e1950: 8 total, 8 up, 8 in 2024-01-13T18:57:06.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:06 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:06.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:06 smithi084 ceph-mon[119097]: pgmap v3382: 169 pgs: 169 active+clean; 1.4 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 22 MiB/s wr, 413 op/s 2024-01-13T18:57:06.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:06 smithi084 ceph-mon[119097]: osdmap e1950: 8 total, 8 up, 8 in 2024-01-13T18:57:06.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:06 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:06.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:06 smithi084 ceph-mon[116404]: pgmap v3382: 169 pgs: 169 active+clean; 1.4 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 22 MiB/s wr, 413 op/s 2024-01-13T18:57:06.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:06 smithi084 ceph-mon[116404]: osdmap e1950: 8 total, 8 up, 8 in 2024-01-13T18:57:06.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:06 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:07.039 INFO:tasks.workunit.client.0.smithi084.stdout:write: b 68757514~230544 2024-01-13T18:57:07.046 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 149077320~5939886 2024-01-13T18:57:07.046 INFO:tasks.workunit.client.0.smithi084.stdout:write: b 68708658~3352562 2024-01-13T18:57:07.111 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 8397647~6259248 2024-01-13T18:57:07.111 INFO:tasks.workunit.client.0.smithi084.stdout:write: b 32721815~7210692 2024-01-13T18:57:07.115 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 99332622~7902490 2024-01-13T18:57:07.119 INFO:tasks.workunit.client.0.smithi084.stdout:write: b 138289880~5468640 2024-01-13T18:57:07.182 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 65480737~2175828 2024-01-13T18:57:07.182 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: user1 2024-01-13T18:57:07.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:07 smithi099 ceph-mon[138788]: osdmap e1951: 8 total, 8 up, 8 in 2024-01-13T18:57:07.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:07 smithi084 ceph-mon[116404]: osdmap e1951: 8 total, 8 up, 8 in 2024-01-13T18:57:07.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:07 smithi084 ceph-mon[119097]: osdmap e1951: 8 total, 8 up, 8 in 2024-01-13T18:57:08.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:08 smithi099 ceph-mon[138788]: pgmap v3385: 169 pgs: 169 active+clean; 1.5 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 16 MiB/s rd, 17 MiB/s wr, 332 op/s 2024-01-13T18:57:08.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:08 smithi099 ceph-mon[138788]: osdmap e1952: 8 total, 8 up, 8 in 2024-01-13T18:57:08.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:08 smithi084 ceph-mon[116404]: pgmap v3385: 169 pgs: 169 active+clean; 1.5 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 16 MiB/s rd, 17 MiB/s wr, 332 op/s 2024-01-13T18:57:08.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:08 smithi084 ceph-mon[116404]: osdmap e1952: 8 total, 8 up, 8 in 2024-01-13T18:57:08.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:08 smithi084 ceph-mon[119097]: pgmap v3385: 169 pgs: 169 active+clean; 1.5 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 16 MiB/s rd, 17 MiB/s wr, 332 op/s 2024-01-13T18:57:08.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:08 smithi084 ceph-mon[119097]: osdmap e1952: 8 total, 8 up, 8 in 2024-01-13T18:57:09.060 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 280768993 2024-01-13T18:57:09.074 INFO:tasks.workunit.client.0.smithi084.stdout:write: c 136728967~2832274 2024-01-13T18:57:09.082 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 164078353~3125866 2024-01-13T18:57:09.082 INFO:tasks.workunit.client.0.smithi084.stdout:write: c 28245672~1939345 2024-01-13T18:57:09.083 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 158880854~609007 2024-01-13T18:57:09.084 INFO:tasks.workunit.client.0.smithi084.stdout:write: c 205872705~3247863 2024-01-13T18:57:09.086 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 103051259~3036435 2024-01-13T18:57:09.087 INFO:tasks.workunit.client.0.smithi084.stdout:write: c 118258813~2989497 2024-01-13T18:57:09.088 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 239865478~4036613 2024-01-13T18:57:09.089 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: user2 2024-01-13T18:57:09.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:09 smithi099 ceph-mon[138788]: osdmap e1953: 8 total, 8 up, 8 in 2024-01-13T18:57:09.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:09 smithi084 ceph-mon[116404]: osdmap e1953: 8 total, 8 up, 8 in 2024-01-13T18:57:09.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:09 smithi084 ceph-mon[119097]: osdmap e1953: 8 total, 8 up, 8 in 2024-01-13T18:57:10.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:10 smithi099 ceph-mon[138788]: pgmap v3388: 169 pgs: 169 active+clean; 1.6 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 22 MiB/s rd, 29 MiB/s wr, 470 op/s 2024-01-13T18:57:10.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:10 smithi099 ceph-mon[138788]: osdmap e1954: 8 total, 8 up, 8 in 2024-01-13T18:57:10.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:10 smithi084 ceph-mon[116404]: pgmap v3388: 169 pgs: 169 active+clean; 1.6 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 22 MiB/s rd, 29 MiB/s wr, 470 op/s 2024-01-13T18:57:10.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:10 smithi084 ceph-mon[116404]: osdmap e1954: 8 total, 8 up, 8 in 2024-01-13T18:57:10.427 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:57:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:57:10] "GET /metrics HTTP/1.1" 200 39040 "" "Prometheus/2.43.0" 2024-01-13T18:57:10.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:10 smithi084 ceph-mon[119097]: pgmap v3388: 169 pgs: 169 active+clean; 1.6 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 22 MiB/s rd, 29 MiB/s wr, 470 op/s 2024-01-13T18:57:10.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:10 smithi084 ceph-mon[119097]: osdmap e1954: 8 total, 8 up, 8 in 2024-01-13T18:57:11.076 INFO:tasks.workunit.client.0.smithi084.stdout:write: d 3772319~7389175 2024-01-13T18:57:11.090 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 95179183~5052304 2024-01-13T18:57:11.090 INFO:tasks.workunit.client.0.smithi084.stdout:write: d 221263445~6539332 2024-01-13T18:57:11.092 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 160391651~4867057 2024-01-13T18:57:11.093 INFO:tasks.workunit.client.0.smithi084.stdout:write: d 77045573~7132027 2024-01-13T18:57:11.160 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 100675977~7128856 2024-01-13T18:57:11.210 INFO:tasks.workunit.client.0.smithi084.stdout:write: d 137158536~3837778 2024-01-13T18:57:11.212 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 99621205~6291134 2024-01-13T18:57:11.243 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: user3 2024-01-13T18:57:11.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:11 smithi099 ceph-mon[138788]: osdmap e1955: 8 total, 8 up, 8 in 2024-01-13T18:57:11.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:11 smithi084 ceph-mon[116404]: osdmap e1955: 8 total, 8 up, 8 in 2024-01-13T18:57:11.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:11 smithi084 ceph-mon[119097]: osdmap e1955: 8 total, 8 up, 8 in 2024-01-13T18:57:12.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:12 smithi099 ceph-mon[138788]: pgmap v3391: 169 pgs: 169 active+clean; 1.6 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 10 MiB/s rd, 33 MiB/s wr, 541 op/s 2024-01-13T18:57:12.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:12 smithi099 ceph-mon[138788]: osdmap e1956: 8 total, 8 up, 8 in 2024-01-13T18:57:12.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:12 smithi084 ceph-mon[119097]: pgmap v3391: 169 pgs: 169 active+clean; 1.6 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 10 MiB/s rd, 33 MiB/s wr, 541 op/s 2024-01-13T18:57:12.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:12 smithi084 ceph-mon[119097]: osdmap e1956: 8 total, 8 up, 8 in 2024-01-13T18:57:12.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:12 smithi084 ceph-mon[116404]: pgmap v3391: 169 pgs: 169 active+clean; 1.6 GiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 10 MiB/s rd, 33 MiB/s wr, 541 op/s 2024-01-13T18:57:12.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:12 smithi084 ceph-mon[116404]: osdmap e1956: 8 total, 8 up, 8 in 2024-01-13T18:57:13.095 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 28076899~7019224 2024-01-13T18:57:13.103 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 29831705~3509612 2024-01-13T18:57:13.167 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 56153798~7019224 2024-01-13T18:57:13.170 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 57908604~3509612 2024-01-13T18:57:13.240 INFO:tasks.workunit.client.0.smithi084.stdout:write: 3 84230697~7019224 2024-01-13T18:57:13.242 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 85985503~3509612 2024-01-13T18:57:13.288 INFO:tasks.workunit.client.0.smithi084.stdout:write: 4 112307597~7019224 2024-01-13T18:57:13.290 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 114062403~3509612 2024-01-13T18:57:13.355 INFO:tasks.workunit.client.0.smithi084.stdout:write: 5 140384496~7019224 2024-01-13T18:57:13.357 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 142139302~3509612 2024-01-13T18:57:13.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:13 smithi099 ceph-mon[138788]: osdmap e1957: 8 total, 8 up, 8 in 2024-01-13T18:57:13.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:13 smithi084 ceph-mon[119097]: osdmap e1957: 8 total, 8 up, 8 in 2024-01-13T18:57:13.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:13 smithi084 ceph-mon[116404]: osdmap e1957: 8 total, 8 up, 8 in 2024-01-13T18:57:14.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:14 smithi099 ceph-mon[138788]: pgmap v3394: 169 pgs: 169 active+clean; 1.7 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 7.1 MiB/s rd, 35 MiB/s wr, 521 op/s 2024-01-13T18:57:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:14 smithi099 ceph-mon[138788]: osdmap e1958: 8 total, 8 up, 8 in 2024-01-13T18:57:14.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:14 smithi084 ceph-mon[116404]: pgmap v3394: 169 pgs: 169 active+clean; 1.7 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 7.1 MiB/s rd, 35 MiB/s wr, 521 op/s 2024-01-13T18:57:14.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:14 smithi084 ceph-mon[116404]: osdmap e1958: 8 total, 8 up, 8 in 2024-01-13T18:57:14.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:14 smithi084 ceph-mon[119097]: pgmap v3394: 169 pgs: 169 active+clean; 1.7 GiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 7.1 MiB/s rd, 35 MiB/s wr, 521 op/s 2024-01-13T18:57:14.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:14 smithi084 ceph-mon[119097]: osdmap e1958: 8 total, 8 up, 8 in 2024-01-13T18:57:14.980 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:57:15.170 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:57:16.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:16 smithi099 ceph-mon[138788]: pgmap v3396: 169 pgs: 169 active+clean; 1.8 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 54 MiB/s rd, 29 MiB/s wr, 359 op/s 2024-01-13T18:57:16.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:16 smithi084 ceph-mon[116404]: pgmap v3396: 169 pgs: 169 active+clean; 1.8 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 54 MiB/s rd, 29 MiB/s wr, 359 op/s 2024-01-13T18:57:16.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:16 smithi084 ceph-mon[119097]: pgmap v3396: 169 pgs: 169 active+clean; 1.8 GiB data, 9.0 GiB used, 706 GiB / 715 GiB avail; 54 MiB/s rd, 29 MiB/s wr, 359 op/s 2024-01-13T18:57:16.806 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.Stress2 (19572 ms) 2024-01-13T18:57:16.806 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMigration.StressLive 2024-01-13T18:57:16.841 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 83886080 2024-01-13T18:57:16.853 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 70953548~5046007 2024-01-13T18:57:16.893 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 22432230~3206594 2024-01-13T18:57:16.893 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 31620281~3341986 2024-01-13T18:57:16.914 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 23155638~815019 2024-01-13T18:57:16.914 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 37358948~453812 2024-01-13T18:57:16.919 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 54822074~1256794 2024-01-13T18:57:16.919 INFO:tasks.workunit.client.0.smithi084.stdout:write: A 41992890~4345292 2024-01-13T18:57:16.951 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 3673932~3490993 2024-01-13T18:57:16.951 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap0 2024-01-13T18:57:18.102 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap0 2024-01-13T18:57:18.119 INFO:tasks.workunit.client.0.smithi084.stdout:clone image380 -> image383 2024-01-13T18:57:18.219 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 82061424~1824656 2024-01-13T18:57:18.243 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 65497941~5322617 2024-01-13T18:57:18.257 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 39427650~5508961 2024-01-13T18:57:18.309 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 8967822~5517933 2024-01-13T18:57:18.316 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 58790389~1322389 2024-01-13T18:57:18.328 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 11616335~6870348 2024-01-13T18:57:18.333 INFO:tasks.workunit.client.0.smithi084.stdout:write: B 37082179~6136808 2024-01-13T18:57:18.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:18 smithi099 ceph-mon[138788]: pgmap v3397: 169 pgs: 169 active+clean; 1.9 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 165 MiB/s rd, 32 MiB/s wr, 513 op/s 2024-01-13T18:57:18.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:18 smithi099 ceph-mon[138788]: osdmap e1959: 8 total, 8 up, 8 in 2024-01-13T18:57:18.376 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 51286442~7072411 2024-01-13T18:57:18.383 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap1 2024-01-13T18:57:18.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:18 smithi084 ceph-mon[116404]: pgmap v3397: 169 pgs: 169 active+clean; 1.9 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 165 MiB/s rd, 32 MiB/s wr, 513 op/s 2024-01-13T18:57:18.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:18 smithi084 ceph-mon[116404]: osdmap e1959: 8 total, 8 up, 8 in 2024-01-13T18:57:18.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:18 smithi084 ceph-mon[119097]: pgmap v3397: 169 pgs: 169 active+clean; 1.9 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 165 MiB/s rd, 32 MiB/s wr, 513 op/s 2024-01-13T18:57:18.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:18 smithi084 ceph-mon[119097]: osdmap e1959: 8 total, 8 up, 8 in 2024-01-13T18:57:19.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:19 smithi099 ceph-mon[138788]: osdmap e1960: 8 total, 8 up, 8 in 2024-01-13T18:57:19.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:19 smithi084 ceph-mon[119097]: osdmap e1960: 8 total, 8 up, 8 in 2024-01-13T18:57:19.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:19 smithi084 ceph-mon[116404]: osdmap e1960: 8 total, 8 up, 8 in 2024-01-13T18:57:20.120 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap1 2024-01-13T18:57:20.134 INFO:tasks.workunit.client.0.smithi084.stdout:clone image383 -> image385 2024-01-13T18:57:20.270 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 51940820~7409251 2024-01-13T18:57:20.324 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 83360535~15604 2024-01-13T18:57:20.350 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 76769870~5413689 2024-01-13T18:57:20.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:20 smithi099 ceph-mon[138788]: pgmap v3400: 169 pgs: 169 active+clean; 1.9 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 249 MiB/s rd, 22 MiB/s wr, 555 op/s 2024-01-13T18:57:20.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:20 smithi099 ceph-mon[138788]: osdmap e1961: 8 total, 8 up, 8 in 2024-01-13T18:57:20.406 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 9758981~3964881 2024-01-13T18:57:20.415 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 15844483~1322248 2024-01-13T18:57:20.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:20 smithi084 ceph-mon[116404]: pgmap v3400: 169 pgs: 169 active+clean; 1.9 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 249 MiB/s rd, 22 MiB/s wr, 555 op/s 2024-01-13T18:57:20.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:20 smithi084 ceph-mon[116404]: osdmap e1961: 8 total, 8 up, 8 in 2024-01-13T18:57:20.426 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:57:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:57:20] "GET /metrics HTTP/1.1" 200 39040 "" "Prometheus/2.43.0" 2024-01-13T18:57:20.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:20 smithi084 ceph-mon[119097]: pgmap v3400: 169 pgs: 169 active+clean; 1.9 GiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 249 MiB/s rd, 22 MiB/s wr, 555 op/s 2024-01-13T18:57:20.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:20 smithi084 ceph-mon[119097]: osdmap e1961: 8 total, 8 up, 8 in 2024-01-13T18:57:20.427 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 6424402~5044305 2024-01-13T18:57:20.432 INFO:tasks.workunit.client.0.smithi084.stdout:write: C 6868961~7911435 2024-01-13T18:57:20.471 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 21622660~4801336 2024-01-13T18:57:20.480 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap2 2024-01-13T18:57:21.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:21 smithi099 ceph-mon[138788]: osdmap e1962: 8 total, 8 up, 8 in 2024-01-13T18:57:21.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:21.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:21 smithi084 ceph-mon[116404]: osdmap e1962: 8 total, 8 up, 8 in 2024-01-13T18:57:21.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:21.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:21 smithi084 ceph-mon[119097]: osdmap e1962: 8 total, 8 up, 8 in 2024-01-13T18:57:21.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:22.132 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap2 2024-01-13T18:57:22.145 INFO:tasks.workunit.client.0.smithi084.stdout:clone image385 -> image387 2024-01-13T18:57:22.315 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 77884836~2330054 2024-01-13T18:57:22.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:22 smithi099 ceph-mon[138788]: pgmap v3403: 169 pgs: 169 active+clean; 1.9 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 198 MiB/s rd, 6.7 MiB/s wr, 579 op/s 2024-01-13T18:57:22.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:22 smithi099 ceph-mon[138788]: osdmap e1963: 8 total, 8 up, 8 in 2024-01-13T18:57:22.389 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 79149915~2500904 2024-01-13T18:57:22.391 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 9371252~2457497 2024-01-13T18:57:22.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:22 smithi084 ceph-mon[116404]: pgmap v3403: 169 pgs: 169 active+clean; 1.9 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 198 MiB/s rd, 6.7 MiB/s wr, 579 op/s 2024-01-13T18:57:22.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:22 smithi084 ceph-mon[116404]: osdmap e1963: 8 total, 8 up, 8 in 2024-01-13T18:57:22.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:22 smithi084 ceph-mon[119097]: pgmap v3403: 169 pgs: 169 active+clean; 1.9 GiB data, 9.2 GiB used, 706 GiB / 715 GiB avail; 198 MiB/s rd, 6.7 MiB/s wr, 579 op/s 2024-01-13T18:57:22.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:22 smithi084 ceph-mon[119097]: osdmap e1963: 8 total, 8 up, 8 in 2024-01-13T18:57:22.443 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16982913~6880171 2024-01-13T18:57:22.453 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 39118406~4510392 2024-01-13T18:57:22.524 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 38858977~1160491 2024-01-13T18:57:22.526 INFO:tasks.workunit.client.0.smithi084.stdout:write: D 16958350~7589764 2024-01-13T18:57:22.572 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 76972362~6913718 2024-01-13T18:57:22.575 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: snap3 2024-01-13T18:57:23.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:23 smithi084 ceph-mon[116404]: osdmap e1964: 8 total, 8 up, 8 in 2024-01-13T18:57:23.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:23 smithi084 ceph-mon[119097]: osdmap e1964: 8 total, 8 up, 8 in 2024-01-13T18:57:23.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:23 smithi099 ceph-mon[138788]: osdmap e1964: 8 total, 8 up, 8 in 2024-01-13T18:57:24.147 INFO:tasks.workunit.client.0.smithi084.stdout:snap_protect: snap3 2024-01-13T18:57:24.160 INFO:tasks.workunit.client.0.smithi084.stdout:clone image387 -> image389 2024-01-13T18:57:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 159872710 2024-01-13T18:57:24.368 INFO:tasks.workunit.client.0.smithi084.stdout:migration_prepare 2024-01-13T18:57:24.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:24 smithi084 ceph-mon[116404]: pgmap v3406: 169 pgs: 169 active+clean; 2.0 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 75 MiB/s rd, 24 MiB/s wr, 503 op/s 2024-01-13T18:57:24.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:24 smithi084 ceph-mon[116404]: osdmap e1965: 8 total, 8 up, 8 in 2024-01-13T18:57:24.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:24 smithi084 ceph-mon[119097]: pgmap v3406: 169 pgs: 169 active+clean; 2.0 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 75 MiB/s rd, 24 MiB/s wr, 503 op/s 2024-01-13T18:57:24.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:24 smithi084 ceph-mon[119097]: osdmap e1965: 8 total, 8 up, 8 in 2024-01-13T18:57:24.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:24 smithi099 ceph-mon[138788]: pgmap v3406: 169 pgs: 169 active+clean; 2.0 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 75 MiB/s rd, 24 MiB/s wr, 503 op/s 2024-01-13T18:57:24.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:24 smithi099 ceph-mon[138788]: osdmap e1965: 8 total, 8 up, 8 in 2024-01-13T18:57:24.871 INFO:tasks.workunit.client.0.smithi084.stdout:migration_execute 2024-01-13T18:57:24.872 INFO:tasks.workunit.client.0.smithi084.stdout:write: a 136591952~3620471 2024-01-13T18:57:24.890 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 4717292~1811406 2024-01-13T18:57:24.916 INFO:tasks.workunit.client.0.smithi084.stdout:write: a 46265585~1964869 2024-01-13T18:57:24.955 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 16733280~2210565 2024-01-13T18:57:24.995 INFO:tasks.workunit.client.0.smithi084.stdout:write: a 72697399~4648537 2024-01-13T18:57:25.054 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 12023887~5703261 2024-01-13T18:57:25.089 INFO:tasks.workunit.client.0.smithi084.stdout:write: a 130495639~997456 2024-01-13T18:57:25.102 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 52046599~682523 2024-01-13T18:57:25.154 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: user0 2024-01-13T18:57:25.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:25 smithi084 ceph-mon[116404]: osdmap e1966: 8 total, 8 up, 8 in 2024-01-13T18:57:25.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:25 smithi084 ceph-mon[119097]: osdmap e1966: 8 total, 8 up, 8 in 2024-01-13T18:57:25.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:25 smithi099 ceph-mon[138788]: osdmap e1966: 8 total, 8 up, 8 in 2024-01-13T18:57:26.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:26 smithi084 ceph-mon[116404]: pgmap v3409: 169 pgs: 169 active+clean; 2.1 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 16 MiB/s rd, 33 MiB/s wr, 652 op/s 2024-01-13T18:57:26.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:26 smithi084 ceph-mon[119097]: pgmap v3409: 169 pgs: 169 active+clean; 2.1 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 16 MiB/s rd, 33 MiB/s wr, 652 op/s 2024-01-13T18:57:26.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:26 smithi099 ceph-mon[138788]: pgmap v3409: 169 pgs: 169 active+clean; 2.1 GiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 16 MiB/s rd, 33 MiB/s wr, 652 op/s 2024-01-13T18:57:27.162 INFO:tasks.workunit.client.0.smithi084.stdout:write: b 16494572~1665168 2024-01-13T18:57:27.169 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 81183874~2365212 2024-01-13T18:57:27.170 INFO:tasks.workunit.client.0.smithi084.stdout:write: b 68188777~316829 2024-01-13T18:57:27.170 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 39015235~3091497 2024-01-13T18:57:27.170 INFO:tasks.workunit.client.0.smithi084.stdout:write: b 84524371~3706838 2024-01-13T18:57:27.172 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 45305468~7123354 2024-01-13T18:57:27.173 INFO:tasks.workunit.client.0.smithi084.stdout:write: b 116175258~5555406 2024-01-13T18:57:27.183 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 124880984~6982899 2024-01-13T18:57:27.210 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: user1 2024-01-13T18:57:27.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:27 smithi084 ceph-mon[116404]: osdmap e1967: 8 total, 8 up, 8 in 2024-01-13T18:57:27.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:27 smithi084 ceph-mon[119097]: osdmap e1967: 8 total, 8 up, 8 in 2024-01-13T18:57:27.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:27 smithi099 ceph-mon[138788]: osdmap e1967: 8 total, 8 up, 8 in 2024-01-13T18:57:28.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:28 smithi084 ceph-mon[116404]: pgmap v3411: 169 pgs: 169 active+clean; 2.1 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 23 MiB/s rd, 28 MiB/s wr, 767 op/s 2024-01-13T18:57:28.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:28 smithi084 ceph-mon[116404]: osdmap e1968: 8 total, 8 up, 8 in 2024-01-13T18:57:28.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:28 smithi084 ceph-mon[119097]: pgmap v3411: 169 pgs: 169 active+clean; 2.1 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 23 MiB/s rd, 28 MiB/s wr, 767 op/s 2024-01-13T18:57:28.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:28 smithi084 ceph-mon[119097]: osdmap e1968: 8 total, 8 up, 8 in 2024-01-13T18:57:28.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:28 smithi099 ceph-mon[138788]: pgmap v3411: 169 pgs: 169 active+clean; 2.1 GiB data, 9.6 GiB used, 706 GiB / 715 GiB avail; 23 MiB/s rd, 28 MiB/s wr, 767 op/s 2024-01-13T18:57:28.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:28 smithi099 ceph-mon[138788]: osdmap e1968: 8 total, 8 up, 8 in 2024-01-13T18:57:29.187 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 179961510 2024-01-13T18:57:29.199 INFO:tasks.workunit.client.0.smithi084.stdout:write: c 161053188~4440839 2024-01-13T18:57:29.207 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 91133514~3492595 2024-01-13T18:57:29.207 INFO:tasks.workunit.client.0.smithi084.stdout:write: c 99022551~5531049 2024-01-13T18:57:29.210 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 72395781~2200715 2024-01-13T18:57:29.210 INFO:tasks.workunit.client.0.smithi084.stdout:write: c 41619278~3157453 2024-01-13T18:57:29.211 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 100869164~4395192 2024-01-13T18:57:29.256 INFO:tasks.workunit.client.0.smithi084.stdout:write: c 19036834~4062246 2024-01-13T18:57:29.257 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 56893984~2560207 2024-01-13T18:57:29.257 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: user2 2024-01-13T18:57:29.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:29 smithi084 ceph-mon[116404]: osdmap e1969: 8 total, 8 up, 8 in 2024-01-13T18:57:29.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:29 smithi084 ceph-mon[119097]: osdmap e1969: 8 total, 8 up, 8 in 2024-01-13T18:57:29.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:29 smithi099 ceph-mon[138788]: osdmap e1969: 8 total, 8 up, 8 in 2024-01-13T18:57:30.426 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:57:30] "GET /metrics HTTP/1.1" 200 39040 "" "Prometheus/2.43.0" 2024-01-13T18:57:30.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[116404]: pgmap v3414: 169 pgs: 169 active+clean; 2.1 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 34 MiB/s rd, 26 MiB/s wr, 798 op/s 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[116404]: osdmap e1970: 8 total, 8 up, 8 in 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[119097]: pgmap v3414: 169 pgs: 169 active+clean; 2.1 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 34 MiB/s rd, 26 MiB/s wr, 798 op/s 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[119097]: osdmap e1970: 8 total, 8 up, 8 in 2024-01-13T18:57:30.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:57:30.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:57:30.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:57:30.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:30 smithi099 ceph-mon[138788]: pgmap v3414: 169 pgs: 169 active+clean; 2.1 GiB data, 9.7 GiB used, 706 GiB / 715 GiB avail; 34 MiB/s rd, 26 MiB/s wr, 798 op/s 2024-01-13T18:57:30.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:30 smithi099 ceph-mon[138788]: osdmap e1970: 8 total, 8 up, 8 in 2024-01-13T18:57:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:57:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:57:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:57:30.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:31.202 INFO:tasks.workunit.client.0.smithi084.stdout:write: d 36693234~2877036 2024-01-13T18:57:31.212 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 45125185~6938810 2024-01-13T18:57:31.212 INFO:tasks.workunit.client.0.smithi084.stdout:write: d 103978601~5271392 2024-01-13T18:57:31.215 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 161203012~1129767 2024-01-13T18:57:31.217 INFO:tasks.workunit.client.0.smithi084.stdout:write: d 42296712~5722216 2024-01-13T18:57:31.256 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 68492690~7228111 2024-01-13T18:57:31.256 INFO:tasks.workunit.client.0.smithi084.stdout:write: d 127524901~1388983 2024-01-13T18:57:31.257 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 106870411~4250418 2024-01-13T18:57:31.284 INFO:tasks.workunit.client.0.smithi084.stdout:snap_create: user3 2024-01-13T18:57:31.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:31 smithi099 ceph-mon[138788]: osdmap e1971: 8 total, 8 up, 8 in 2024-01-13T18:57:31.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:31 smithi084 ceph-mon[116404]: osdmap e1971: 8 total, 8 up, 8 in 2024-01-13T18:57:31.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:31 smithi084 ceph-mon[119097]: osdmap e1971: 8 total, 8 up, 8 in 2024-01-13T18:57:32.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:32 smithi099 ceph-mon[138788]: pgmap v3417: 169 pgs: 169 active+clean; 2.2 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 19 MiB/s rd, 18 MiB/s wr, 385 op/s 2024-01-13T18:57:32.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:32 smithi099 ceph-mon[138788]: osdmap e1972: 8 total, 8 up, 8 in 2024-01-13T18:57:32.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:32 smithi084 ceph-mon[116404]: pgmap v3417: 169 pgs: 169 active+clean; 2.2 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 19 MiB/s rd, 18 MiB/s wr, 385 op/s 2024-01-13T18:57:32.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:32 smithi084 ceph-mon[116404]: osdmap e1972: 8 total, 8 up, 8 in 2024-01-13T18:57:32.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:32 smithi084 ceph-mon[119097]: pgmap v3417: 169 pgs: 169 active+clean; 2.2 GiB data, 9.7 GiB used, 705 GiB / 715 GiB avail; 19 MiB/s rd, 18 MiB/s wr, 385 op/s 2024-01-13T18:57:32.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:32 smithi084 ceph-mon[119097]: osdmap e1972: 8 total, 8 up, 8 in 2024-01-13T18:57:33.215 INFO:tasks.workunit.client.0.smithi084.stdout:resize: 246080910 2024-01-13T18:57:33.236 INFO:tasks.workunit.client.0.smithi084.stdout:write: 1 24608091~6152022 2024-01-13T18:57:33.238 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 26146096~3076011 2024-01-13T18:57:33.289 INFO:tasks.workunit.client.0.smithi084.stdout:write: 2 49216182~6152022 2024-01-13T18:57:33.291 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 50754187~3076011 2024-01-13T18:57:33.317 INFO:tasks.workunit.client.0.smithi084.stdout:write: 3 73824273~6152022 2024-01-13T18:57:33.319 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 75362278~3076011 2024-01-13T18:57:33.349 INFO:tasks.workunit.client.0.smithi084.stdout:write: 4 98432364~6152022 2024-01-13T18:57:33.351 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 99970369~3076011 2024-01-13T18:57:33.382 INFO:tasks.workunit.client.0.smithi084.stdout:write: 5 123040455~6152022 2024-01-13T18:57:33.384 INFO:tasks.workunit.client.0.smithi084.stdout:discard: 124578460~3076011 2024-01-13T18:57:33.523 INFO:tasks.workunit.client.0.smithi084.stdout:migration_commit 2024-01-13T18:57:33.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:33 smithi099 ceph-mon[138788]: osdmap e1973: 8 total, 8 up, 8 in 2024-01-13T18:57:33.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:33 smithi084 ceph-mon[116404]: osdmap e1973: 8 total, 8 up, 8 in 2024-01-13T18:57:33.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:33 smithi084 ceph-mon[119097]: osdmap e1973: 8 total, 8 up, 8 in 2024-01-13T18:57:34.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:34 smithi099 ceph-mon[138788]: pgmap v3420: 169 pgs: 169 active+clean; 2.3 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 6.3 MiB/s rd, 25 MiB/s wr, 398 op/s 2024-01-13T18:57:34.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:34 smithi099 ceph-mon[138788]: osdmap e1974: 8 total, 8 up, 8 in 2024-01-13T18:57:34.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:34 smithi084 ceph-mon[116404]: pgmap v3420: 169 pgs: 169 active+clean; 2.3 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 6.3 MiB/s rd, 25 MiB/s wr, 398 op/s 2024-01-13T18:57:34.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:34 smithi084 ceph-mon[116404]: osdmap e1974: 8 total, 8 up, 8 in 2024-01-13T18:57:34.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:34 smithi084 ceph-mon[119097]: pgmap v3420: 169 pgs: 169 active+clean; 2.3 GiB data, 9.9 GiB used, 705 GiB / 715 GiB avail; 6.3 MiB/s rd, 25 MiB/s wr, 398 op/s 2024-01-13T18:57:34.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:34 smithi084 ceph-mon[119097]: osdmap e1974: 8 total, 8 up, 8 in 2024-01-13T18:57:34.807 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMigration.StressLive (18001 ms) 2024-01-13T18:57:35.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:35.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:35.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:36.226 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 57 tests from TestMigration (261146 ms total) 2024-01-13T18:57:36.227 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:57:36.227 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 2 tests from TestMirroringWatcher 2024-01-13T18:57:36.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:36 smithi099 ceph-mon[138788]: pgmap v3422: 169 pgs: 169 active+clean; 2.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 39 MiB/s rd, 25 MiB/s wr, 367 op/s 2024-01-13T18:57:36.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:36 smithi099 ceph-mon[138788]: osdmap e1975: 8 total, 8 up, 8 in 2024-01-13T18:57:36.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:36 smithi084 ceph-mon[116404]: pgmap v3422: 169 pgs: 169 active+clean; 2.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 39 MiB/s rd, 25 MiB/s wr, 367 op/s 2024-01-13T18:57:36.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:36 smithi084 ceph-mon[116404]: osdmap e1975: 8 total, 8 up, 8 in 2024-01-13T18:57:36.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:36 smithi084 ceph-mon[119097]: pgmap v3422: 169 pgs: 169 active+clean; 2.3 GiB data, 10 GiB used, 705 GiB / 715 GiB avail; 39 MiB/s rd, 25 MiB/s wr, 367 op/s 2024-01-13T18:57:36.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:36 smithi084 ceph-mon[119097]: osdmap e1975: 8 total, 8 up, 8 in 2024-01-13T18:57:37.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:37 smithi099 ceph-mon[138788]: osdmap e1976: 8 total, 8 up, 8 in 2024-01-13T18:57:37.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:37 smithi084 ceph-mon[116404]: osdmap e1976: 8 total, 8 up, 8 in 2024-01-13T18:57:37.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:37 smithi084 ceph-mon[119097]: osdmap e1976: 8 total, 8 up, 8 in 2024-01-13T18:57:38.234 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroringWatcher.ModeUpdated 2024-01-13T18:57:38.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:38 smithi099 ceph-mon[138788]: pgmap v3425: 105 pgs: 105 active+clean; 4.6 MiB data, 9.9 GiB used, 705 GiB / 715 GiB avail 2024-01-13T18:57:38.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:38 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:57:38.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:38 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:57:38.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:38 smithi099 ceph-mon[138788]: osdmap e1977: 8 total, 8 up, 8 in 2024-01-13T18:57:38.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:38 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2573097766' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:38.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:38 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:38.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[116404]: pgmap v3425: 105 pgs: 105 active+clean; 4.6 MiB data, 9.9 GiB used, 705 GiB / 715 GiB avail 2024-01-13T18:57:38.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:57:38.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:57:38.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[116404]: osdmap e1977: 8 total, 8 up, 8 in 2024-01-13T18:57:38.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2573097766' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:38.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:38.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[119097]: pgmap v3425: 105 pgs: 105 active+clean; 4.6 MiB data, 9.9 GiB used, 705 GiB / 715 GiB avail 2024-01-13T18:57:38.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:57:38.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:57:38.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[119097]: osdmap e1977: 8 total, 8 up, 8 in 2024-01-13T18:57:38.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2573097766' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:38.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:38 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:39 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:39.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:39 smithi099 ceph-mon[138788]: osdmap e1978: 8 total, 8 up, 8 in 2024-01-13T18:57:39.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:39 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:39.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:39 smithi084 ceph-mon[116404]: osdmap e1978: 8 total, 8 up, 8 in 2024-01-13T18:57:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:39 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:39.679 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:39 smithi084 ceph-mon[119097]: osdmap e1978: 8 total, 8 up, 8 in 2024-01-13T18:57:40.283 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroringWatcher.ModeUpdated (2050 ms) 2024-01-13T18:57:40.284 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestMirroringWatcher.ImageStatusUpdated 2024-01-13T18:57:40.305 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestMirroringWatcher.ImageStatusUpdated (22 ms) 2024-01-13T18:57:40.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:40 smithi099 ceph-mon[138788]: pgmap v3428: 137 pgs: 5 creating+peering, 23 unknown, 109 active+clean; 4.6 MiB data, 8.3 GiB used, 707 GiB / 715 GiB avail 2024-01-13T18:57:40.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:40 smithi099 ceph-mon[138788]: osdmap e1979: 8 total, 8 up, 8 in 2024-01-13T18:57:40.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:40 smithi084 ceph-mon[116404]: pgmap v3428: 137 pgs: 5 creating+peering, 23 unknown, 109 active+clean; 4.6 MiB data, 8.3 GiB used, 707 GiB / 715 GiB avail 2024-01-13T18:57:40.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:40 smithi084 ceph-mon[116404]: osdmap e1979: 8 total, 8 up, 8 in 2024-01-13T18:57:40.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:57:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:57:40] "GET /metrics HTTP/1.1" 200 39048 "" "Prometheus/2.43.0" 2024-01-13T18:57:40.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:40 smithi084 ceph-mon[119097]: pgmap v3428: 137 pgs: 5 creating+peering, 23 unknown, 109 active+clean; 4.6 MiB data, 8.3 GiB used, 707 GiB / 715 GiB avail 2024-01-13T18:57:40.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:40 smithi084 ceph-mon[119097]: osdmap e1979: 8 total, 8 up, 8 in 2024-01-13T18:57:41.269 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 2 tests from TestMirroringWatcher (2072 ms total) 2024-01-13T18:57:41.269 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:57:41.269 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 4 tests from TestObjectMap 2024-01-13T18:57:41.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:41 smithi099 ceph-mon[138788]: osdmap e1980: 8 total, 8 up, 8 in 2024-01-13T18:57:41.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:41 smithi084 ceph-mon[116404]: osdmap e1980: 8 total, 8 up, 8 in 2024-01-13T18:57:41.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:41 smithi084 ceph-mon[119097]: osdmap e1980: 8 total, 8 up, 8 in 2024-01-13T18:57:42.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:42 smithi099 ceph-mon[138788]: pgmap v3431: 137 pgs: 5 creating+peering, 14 unknown, 118 active+clean; 4.6 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail 2024-01-13T18:57:42.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:42 smithi099 ceph-mon[138788]: osdmap e1981: 8 total, 8 up, 8 in 2024-01-13T18:57:42.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:42 smithi084 ceph-mon[119097]: pgmap v3431: 137 pgs: 5 creating+peering, 14 unknown, 118 active+clean; 4.6 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail 2024-01-13T18:57:42.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:42 smithi084 ceph-mon[119097]: osdmap e1981: 8 total, 8 up, 8 in 2024-01-13T18:57:42.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:42 smithi084 ceph-mon[116404]: pgmap v3431: 137 pgs: 5 creating+peering, 14 unknown, 118 active+clean; 4.6 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail 2024-01-13T18:57:42.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:42 smithi084 ceph-mon[116404]: osdmap e1981: 8 total, 8 up, 8 in 2024-01-13T18:57:43.279 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenCorrupt 2024-01-13T18:57:43.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:43 smithi099 ceph-mon[138788]: osdmap e1982: 8 total, 8 up, 8 in 2024-01-13T18:57:43.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/375749494' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:43.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:43.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:43 smithi084 ceph-mon[119097]: osdmap e1982: 8 total, 8 up, 8 in 2024-01-13T18:57:43.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/375749494' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:43.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:43.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:43 smithi084 ceph-mon[116404]: osdmap e1982: 8 total, 8 up, 8 in 2024-01-13T18:57:43.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/375749494' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:43.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:44.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:44 smithi099 ceph-mon[138788]: pgmap v3434: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:44.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:44 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:44.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:44 smithi099 ceph-mon[138788]: osdmap e1983: 8 total, 8 up, 8 in 2024-01-13T18:57:44.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:44 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:57:44.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:44 smithi099 ceph-mon[138788]: osdmap e1984: 8 total, 8 up, 8 in 2024-01-13T18:57:44.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:44 smithi084 ceph-mon[119097]: pgmap v3434: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:44.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:44 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:44.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:44 smithi084 ceph-mon[119097]: osdmap e1983: 8 total, 8 up, 8 in 2024-01-13T18:57:44.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:44 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:57:44.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:44 smithi084 ceph-mon[119097]: osdmap e1984: 8 total, 8 up, 8 in 2024-01-13T18:57:44.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:44 smithi084 ceph-mon[116404]: pgmap v3434: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:44.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:44 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:44.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:44 smithi084 ceph-mon[116404]: osdmap e1983: 8 total, 8 up, 8 in 2024-01-13T18:57:44.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:44 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:57:44.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:44 smithi084 ceph-mon[116404]: osdmap e1984: 8 total, 8 up, 8 in 2024-01-13T18:57:45.324 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestObjectMap.RefreshInvalidatesWhenCorrupt (2045 ms) 2024-01-13T18:57:45.324 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestObjectMap.RefreshInvalidatesWhenTooSmall 2024-01-13T18:57:45.350 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestObjectMap.RefreshInvalidatesWhenTooSmall (27 ms) 2024-01-13T18:57:45.350 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestObjectMap.InvalidateFlagOnDisk 2024-01-13T18:57:45.384 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestObjectMap.InvalidateFlagOnDisk (34 ms) 2024-01-13T18:57:45.384 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall 2024-01-13T18:57:45.410 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestObjectMap.AcquireLockInvalidatesWhenTooSmall (26 ms) 2024-01-13T18:57:46.308 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 4 tests from TestObjectMap (2132 ms total) 2024-01-13T18:57:46.308 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:57:46.308 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 1 test from TestOperations 2024-01-13T18:57:46.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:46 smithi099 ceph-mon[138788]: pgmap v3437: 137 pgs: 7 creating+peering, 10 unknown, 120 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:46.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:46 smithi099 ceph-mon[138788]: osdmap e1985: 8 total, 8 up, 8 in 2024-01-13T18:57:46.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:46 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:57:46.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:46 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:57:46.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:46 smithi084 ceph-mon[116404]: pgmap v3437: 137 pgs: 7 creating+peering, 10 unknown, 120 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:46.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:46 smithi084 ceph-mon[116404]: osdmap e1985: 8 total, 8 up, 8 in 2024-01-13T18:57:46.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:46 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:57:46.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:46 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:57:46.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:46 smithi084 ceph-mon[119097]: pgmap v3437: 137 pgs: 7 creating+peering, 10 unknown, 120 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:46.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:46 smithi084 ceph-mon[119097]: osdmap e1985: 8 total, 8 up, 8 in 2024-01-13T18:57:46.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:46 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:57:46.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:46 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:57:47.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:47 smithi099 ceph-mon[138788]: osdmap e1986: 8 total, 8 up, 8 in 2024-01-13T18:57:47.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:47 smithi084 ceph-mon[116404]: osdmap e1986: 8 total, 8 up, 8 in 2024-01-13T18:57:47.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:47 smithi084 ceph-mon[119097]: osdmap e1986: 8 total, 8 up, 8 in 2024-01-13T18:57:48.309 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestOperations.DisableJournalingCorrupt 2024-01-13T18:57:48.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:48 smithi099 ceph-mon[138788]: pgmap v3440: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:48.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:48 smithi099 ceph-mon[138788]: osdmap e1987: 8 total, 8 up, 8 in 2024-01-13T18:57:48.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:48 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3717910510' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:48.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:48 smithi084 ceph-mon[116404]: pgmap v3440: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:48.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:48 smithi084 ceph-mon[116404]: osdmap e1987: 8 total, 8 up, 8 in 2024-01-13T18:57:48.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:48 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3717910510' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:48.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:48 smithi084 ceph-mon[119097]: pgmap v3440: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:48.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:48 smithi084 ceph-mon[119097]: osdmap e1987: 8 total, 8 up, 8 in 2024-01-13T18:57:48.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:48 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3717910510' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:49 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3717910510' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:49 smithi099 ceph-mon[138788]: osdmap e1988: 8 total, 8 up, 8 in 2024-01-13T18:57:49.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:49 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3717910510' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:49.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:49 smithi084 ceph-mon[116404]: osdmap e1988: 8 total, 8 up, 8 in 2024-01-13T18:57:49.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:49 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3717910510' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:49 smithi084 ceph-mon[119097]: osdmap e1988: 8 total, 8 up, 8 in 2024-01-13T18:57:50.347 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:57:50.347 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestOperations.DisableJournalingCorrupt (2038 ms) 2024-01-13T18:57:50.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:50 smithi099 ceph-mon[138788]: pgmap v3443: 137 pgs: 10 creating+peering, 18 unknown, 109 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:50 smithi099 ceph-mon[138788]: osdmap e1989: 8 total, 8 up, 8 in 2024-01-13T18:57:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:50 smithi099 ceph-mon[138788]: osdmap e1990: 8 total, 8 up, 8 in 2024-01-13T18:57:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:57:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:57:50] "GET /metrics HTTP/1.1" 200 36480 "" "Prometheus/2.43.0" 2024-01-13T18:57:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:50 smithi084 ceph-mon[119097]: pgmap v3443: 137 pgs: 10 creating+peering, 18 unknown, 109 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:50 smithi084 ceph-mon[119097]: osdmap e1989: 8 total, 8 up, 8 in 2024-01-13T18:57:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:50 smithi084 ceph-mon[119097]: osdmap e1990: 8 total, 8 up, 8 in 2024-01-13T18:57:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:50 smithi084 ceph-mon[116404]: pgmap v3443: 137 pgs: 10 creating+peering, 18 unknown, 109 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:50 smithi084 ceph-mon[116404]: osdmap e1989: 8 total, 8 up, 8 in 2024-01-13T18:57:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:57:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:57:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:50 smithi084 ceph-mon[116404]: osdmap e1990: 8 total, 8 up, 8 in 2024-01-13T18:57:51.346 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 1 test from TestOperations (2038 ms total) 2024-01-13T18:57:51.346 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:57:51.346 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 2 tests from TestTrash 2024-01-13T18:57:52.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:52 smithi099 ceph-mon[138788]: pgmap v3446: 137 pgs: 10 creating+peering, 11 unknown, 116 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:52 smithi099 ceph-mon[138788]: osdmap e1991: 8 total, 8 up, 8 in 2024-01-13T18:57:52.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:52 smithi084 ceph-mon[119097]: pgmap v3446: 137 pgs: 10 creating+peering, 11 unknown, 116 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:52.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:52 smithi084 ceph-mon[119097]: osdmap e1991: 8 total, 8 up, 8 in 2024-01-13T18:57:52.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:52 smithi084 ceph-mon[116404]: pgmap v3446: 137 pgs: 10 creating+peering, 11 unknown, 116 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:52.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:52 smithi084 ceph-mon[116404]: osdmap e1991: 8 total, 8 up, 8 in 2024-01-13T18:57:53.356 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestTrash.UserRemovingSource 2024-01-13T18:57:53.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:53 smithi099 ceph-mon[138788]: osdmap e1992: 8 total, 8 up, 8 in 2024-01-13T18:57:53.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:53 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4176087139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:53.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:53 smithi084 ceph-mon[119097]: osdmap e1992: 8 total, 8 up, 8 in 2024-01-13T18:57:53.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:53 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4176087139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:53.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:53 smithi084 ceph-mon[116404]: osdmap e1992: 8 total, 8 up, 8 in 2024-01-13T18:57:53.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:53 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4176087139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:54.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:54 smithi099 ceph-mon[138788]: pgmap v3449: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:54.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:54 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:57:54.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:54 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/4176087139' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:54.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:54 smithi099 ceph-mon[138788]: osdmap e1993: 8 total, 8 up, 8 in 2024-01-13T18:57:54.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:54 smithi084 ceph-mon[116404]: pgmap v3449: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:54.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:54 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:57:54.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:54 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/4176087139' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:54.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:54 smithi084 ceph-mon[116404]: osdmap e1993: 8 total, 8 up, 8 in 2024-01-13T18:57:54.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:54 smithi084 ceph-mon[119097]: pgmap v3449: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:54.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:54 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:57:54.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:54 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/4176087139' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:54.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:54 smithi084 ceph-mon[119097]: osdmap e1993: 8 total, 8 up, 8 in 2024-01-13T18:57:55.456 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestTrash.UserRemovingSource (2099 ms) 2024-01-13T18:57:55.456 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestTrash.RestoreMirroringSource 2024-01-13T18:57:55.496 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestTrash.RestoreMirroringSource (41 ms) 2024-01-13T18:57:55.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:55 smithi099 ceph-mon[138788]: osdmap e1994: 8 total, 8 up, 8 in 2024-01-13T18:57:55.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:55 smithi084 ceph-mon[119097]: osdmap e1994: 8 total, 8 up, 8 in 2024-01-13T18:57:55.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:55 smithi084 ceph-mon[116404]: osdmap e1994: 8 total, 8 up, 8 in 2024-01-13T18:57:56.382 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 2 tests from TestTrash (2140 ms total) 2024-01-13T18:57:56.382 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:57:56.382 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 4 tests from TestJournalEntries 2024-01-13T18:57:56.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:56 smithi084 ceph-mon[116404]: pgmap v3452: 137 pgs: 7 creating+peering, 13 unknown, 117 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-01-13T18:57:56.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:56 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:57:56.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:56 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:57:56.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:56 smithi084 ceph-mon[116404]: osdmap e1995: 8 total, 8 up, 8 in 2024-01-13T18:57:56.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:56 smithi084 ceph-mon[119097]: pgmap v3452: 137 pgs: 7 creating+peering, 13 unknown, 117 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-01-13T18:57:56.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:56 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:57:56.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:56 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:57:56.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:56 smithi084 ceph-mon[119097]: osdmap e1995: 8 total, 8 up, 8 in 2024-01-13T18:57:56.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:56 smithi099 ceph-mon[138788]: pgmap v3452: 137 pgs: 7 creating+peering, 13 unknown, 117 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-01-13T18:57:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:56 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:57:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:56 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:57:56.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:56 smithi099 ceph-mon[138788]: osdmap e1995: 8 total, 8 up, 8 in 2024-01-13T18:57:57.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:57 smithi084 ceph-mon[116404]: osdmap e1996: 8 total, 8 up, 8 in 2024-01-13T18:57:57.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:57 smithi084 ceph-mon[119097]: osdmap e1996: 8 total, 8 up, 8 in 2024-01-13T18:57:57.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:57 smithi099 ceph-mon[138788]: osdmap e1996: 8 total, 8 up, 8 in 2024-01-13T18:57:58.401 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalEntries.AioWrite 2024-01-13T18:57:58.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:58 smithi084 ceph-mon[116404]: pgmap v3455: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:58.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:58 smithi084 ceph-mon[116404]: osdmap e1997: 8 total, 8 up, 8 in 2024-01-13T18:57:58.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:58 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2155063858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:58.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:58 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:58.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:58 smithi084 ceph-mon[119097]: pgmap v3455: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:58.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:58 smithi084 ceph-mon[119097]: osdmap e1997: 8 total, 8 up, 8 in 2024-01-13T18:57:58.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:58 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2155063858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:58.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:58 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:58.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:58 smithi099 ceph-mon[138788]: pgmap v3455: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:57:58.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:58 smithi099 ceph-mon[138788]: osdmap e1997: 8 total, 8 up, 8 in 2024-01-13T18:57:58.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:58 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2155063858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:58.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:58 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:57:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:59 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:57:59 smithi084 ceph-mon[116404]: osdmap e1998: 8 total, 8 up, 8 in 2024-01-13T18:57:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:59 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:57:59 smithi084 ceph-mon[119097]: osdmap e1998: 8 total, 8 up, 8 in 2024-01-13T18:57:59.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:59 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:57:59.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:57:59 smithi099 ceph-mon[138788]: osdmap e1998: 8 total, 8 up, 8 in 2024-01-13T18:58:00.423 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:00.423 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalEntries.AioWrite (2022 ms) 2024-01-13T18:58:00.423 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalEntries.AioDiscard 2024-01-13T18:58:00.435 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:00.435 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalEntries.AioDiscard (11 ms) 2024-01-13T18:58:00.435 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalEntries.AioDiscardWithPrune 2024-01-13T18:58:00.441 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:00.441 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalEntries.AioDiscardWithPrune (8 ms) 2024-01-13T18:58:00.442 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalEntries.AioFlush 2024-01-13T18:58:00.450 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:00.450 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalEntries.AioFlush (8 ms) 2024-01-13T18:58:00.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:00 smithi084 ceph-mon[116404]: pgmap v3458: 137 pgs: 11 creating+peering, 17 unknown, 109 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:00.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:00 smithi084 ceph-mon[116404]: osdmap e1999: 8 total, 8 up, 8 in 2024-01-13T18:58:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:58:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:58:00] "GET /metrics HTTP/1.1" 200 36480 "" "Prometheus/2.43.0" 2024-01-13T18:58:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:00 smithi084 ceph-mon[119097]: pgmap v3458: 137 pgs: 11 creating+peering, 17 unknown, 109 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:00 smithi084 ceph-mon[119097]: osdmap e1999: 8 total, 8 up, 8 in 2024-01-13T18:58:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:00 smithi099 ceph-mon[138788]: pgmap v3458: 137 pgs: 11 creating+peering, 17 unknown, 109 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:00.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:00 smithi099 ceph-mon[138788]: osdmap e1999: 8 total, 8 up, 8 in 2024-01-13T18:58:01.424 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 4 tests from TestJournalEntries (2049 ms total) 2024-01-13T18:58:01.424 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:58:01.424 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 16 tests from TestJournalReplay 2024-01-13T18:58:01.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:01 smithi084 ceph-mon[116404]: osdmap e2000: 8 total, 8 up, 8 in 2024-01-13T18:58:01.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:01 smithi084 ceph-mon[119097]: osdmap e2000: 8 total, 8 up, 8 in 2024-01-13T18:58:01.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:01 smithi099 ceph-mon[138788]: osdmap e2000: 8 total, 8 up, 8 in 2024-01-13T18:58:02.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:02 smithi084 ceph-mon[116404]: pgmap v3461: 137 pgs: 11 creating+peering, 9 unknown, 117 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:02.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:02 smithi084 ceph-mon[116404]: osdmap e2001: 8 total, 8 up, 8 in 2024-01-13T18:58:02.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:02 smithi084 ceph-mon[119097]: pgmap v3461: 137 pgs: 11 creating+peering, 9 unknown, 117 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:02.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:02 smithi084 ceph-mon[119097]: osdmap e2001: 8 total, 8 up, 8 in 2024-01-13T18:58:02.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:02 smithi099 ceph-mon[138788]: pgmap v3461: 137 pgs: 11 creating+peering, 9 unknown, 117 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:02.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:02 smithi099 ceph-mon[138788]: osdmap e2001: 8 total, 8 up, 8 in 2024-01-13T18:58:03.440 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.AioDiscardEvent 2024-01-13T18:58:03.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:03 smithi099 ceph-mon[138788]: osdmap e2002: 8 total, 8 up, 8 in 2024-01-13T18:58:03.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:03 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3841412637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:03.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:03 smithi084 ceph-mon[116404]: osdmap e2002: 8 total, 8 up, 8 in 2024-01-13T18:58:03.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:03 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3841412637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:03 smithi084 ceph-mon[119097]: osdmap e2002: 8 total, 8 up, 8 in 2024-01-13T18:58:03.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:03 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3841412637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:04 smithi099 ceph-mon[138788]: pgmap v3464: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:04 smithi099 ceph-mon[138788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:58:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:04 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3841412637' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:58:04.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:04 smithi099 ceph-mon[138788]: osdmap e2003: 8 total, 8 up, 8 in 2024-01-13T18:58:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:04 smithi084 ceph-mon[116404]: pgmap v3464: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:04.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:04 smithi084 ceph-mon[116404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:58:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:04 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3841412637' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:58:04.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:04 smithi084 ceph-mon[116404]: osdmap e2003: 8 total, 8 up, 8 in 2024-01-13T18:58:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:04 smithi084 ceph-mon[119097]: pgmap v3464: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:04 smithi084 ceph-mon[119097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-13T18:58:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:04 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3841412637' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:58:04.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:04 smithi084 ceph-mon[119097]: osdmap e2003: 8 total, 8 up, 8 in 2024-01-13T18:58:05.469 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.469 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.AioDiscardEvent (2030 ms) 2024-01-13T18:58:05.470 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.AioWriteEvent 2024-01-13T18:58:05.481 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.481 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.AioWriteEvent (12 ms) 2024-01-13T18:58:05.482 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.AioFlushEvent 2024-01-13T18:58:05.489 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.490 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.AioFlushEvent (8 ms) 2024-01-13T18:58:05.490 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.SnapCreate 2024-01-13T18:58:05.499 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.499 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.SnapCreate (9 ms) 2024-01-13T18:58:05.499 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.SnapProtect 2024-01-13T18:58:05.506 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.506 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.SnapProtect (7 ms) 2024-01-13T18:58:05.506 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.SnapUnprotect 2024-01-13T18:58:05.513 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.513 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.SnapUnprotect (8 ms) 2024-01-13T18:58:05.513 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.SnapRename 2024-01-13T18:58:05.520 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.520 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.SnapRename (7 ms) 2024-01-13T18:58:05.520 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.SnapRollback 2024-01-13T18:58:05.528 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.528 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.SnapRollback (8 ms) 2024-01-13T18:58:05.528 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.SnapRemove 2024-01-13T18:58:05.536 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.536 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.SnapRemove (7 ms) 2024-01-13T18:58:05.536 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.Rename 2024-01-13T18:58:05.543 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.543 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.Rename (7 ms) 2024-01-13T18:58:05.543 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.Resize 2024-01-13T18:58:05.550 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.550 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.Resize (7 ms) 2024-01-13T18:58:05.550 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.Flatten 2024-01-13T18:58:05.557 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.557 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.Flatten (8 ms) 2024-01-13T18:58:05.557 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.UpdateFeatures 2024-01-13T18:58:05.565 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.565 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.UpdateFeatures (7 ms) 2024-01-13T18:58:05.566 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.MetadataSet 2024-01-13T18:58:05.572 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.572 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.MetadataSet (8 ms) 2024-01-13T18:58:05.573 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.MetadataRemove 2024-01-13T18:58:05.579 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.579 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.MetadataRemove (7 ms) 2024-01-13T18:58:05.579 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalReplay.ObjectPosition 2024-01-13T18:58:05.586 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:05.586 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalReplay.ObjectPosition (6 ms) 2024-01-13T18:58:05.617 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 18:58:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=cleanup t=2024-01-13T18:58:05.352109705Z level=info msg="Completed cleanup jobs" duration=13.009894ms 2024-01-13T18:58:05.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:05 smithi099 ceph-mon[138788]: osdmap e2004: 8 total, 8 up, 8 in 2024-01-13T18:58:05.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:58:05.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:05 smithi084 ceph-mon[116404]: osdmap e2004: 8 total, 8 up, 8 in 2024-01-13T18:58:05.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:58:05.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:05 smithi084 ceph-mon[119097]: osdmap e2004: 8 total, 8 up, 8 in 2024-01-13T18:58:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:58:05.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:06.464 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 16 tests from TestJournalReplay (2146 ms total) 2024-01-13T18:58:06.464 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:58:06.464 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 1 test from TestJournalStress 2024-01-13T18:58:06.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:06 smithi099 ceph-mon[138788]: pgmap v3467: 137 pgs: 9 creating+peering, 11 unknown, 117 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:06.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:06 smithi099 ceph-mon[138788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:58:06.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:06 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T18:58:06.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:06 smithi099 ceph-mon[138788]: osdmap e2005: 8 total, 8 up, 8 in 2024-01-13T18:58:06.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:06 smithi084 ceph-mon[119097]: pgmap v3467: 137 pgs: 9 creating+peering, 11 unknown, 117 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:06.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:06 smithi084 ceph-mon[119097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:58:06.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:06 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T18:58:06.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:06 smithi084 ceph-mon[119097]: osdmap e2005: 8 total, 8 up, 8 in 2024-01-13T18:58:06.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:06 smithi084 ceph-mon[116404]: pgmap v3467: 137 pgs: 9 creating+peering, 11 unknown, 117 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:06.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:06 smithi084 ceph-mon[116404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-13T18:58:06.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:06 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T18:58:06.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:06 smithi084 ceph-mon[116404]: osdmap e2005: 8 total, 8 up, 8 in 2024-01-13T18:58:07.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:07 smithi099 ceph-mon[138788]: osdmap e2006: 8 total, 8 up, 8 in 2024-01-13T18:58:07.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:07 smithi084 ceph-mon[116404]: osdmap e2006: 8 total, 8 up, 8 in 2024-01-13T18:58:07.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:07 smithi084 ceph-mon[119097]: osdmap e2006: 8 total, 8 up, 8 in 2024-01-13T18:58:08.464 INFO:tasks.workunit.client.0.smithi084.stdout:[ RUN ] TestJournalStress.DiscardWithPruneWriteOverlap 2024-01-13T18:58:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:08 smithi099 ceph-mon[138788]: pgmap v3470: 105 pgs: 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:08 smithi099 ceph-mon[138788]: osdmap e2007: 8 total, 8 up, 8 in 2024-01-13T18:58:08.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:08 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3603494965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:08.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:08 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:08 smithi084 ceph-mon[116404]: pgmap v3470: 105 pgs: 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:08 smithi084 ceph-mon[116404]: osdmap e2007: 8 total, 8 up, 8 in 2024-01-13T18:58:08.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:08 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3603494965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:08.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:08 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:08 smithi084 ceph-mon[119097]: pgmap v3470: 105 pgs: 105 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:08 smithi084 ceph-mon[119097]: osdmap e2007: 8 total, 8 up, 8 in 2024-01-13T18:58:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:08 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3603494965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:08.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:08 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:09.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:09 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:58:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:09 smithi099 ceph-mon[138788]: osdmap e2008: 8 total, 8 up, 8 in 2024-01-13T18:58:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:09 smithi099 ceph-mon[138788]: osdmap e2009: 8 total, 8 up, 8 in 2024-01-13T18:58:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:09 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:58:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:09 smithi084 ceph-mon[116404]: osdmap e2008: 8 total, 8 up, 8 in 2024-01-13T18:58:09.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:09 smithi084 ceph-mon[116404]: osdmap e2009: 8 total, 8 up, 8 in 2024-01-13T18:58:09.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:09 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-librbd-smithi084-180317-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-13T18:58:09.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:09 smithi084 ceph-mon[119097]: osdmap e2008: 8 total, 8 up, 8 in 2024-01-13T18:58:09.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:09 smithi084 ceph-mon[119097]: osdmap e2009: 8 total, 8 up, 8 in 2024-01-13T18:58:10.505 INFO:tasks.workunit.client.0.smithi084.stdout:SKIPPING 2024-01-13T18:58:10.506 INFO:tasks.workunit.client.0.smithi084.stdout:[ OK ] TestJournalStress.DiscardWithPruneWriteOverlap (2041 ms) 2024-01-13T18:58:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:58:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:58:10] "GET /metrics HTTP/1.1" 200 36503 "" "Prometheus/2.43.0" 2024-01-13T18:58:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:10 smithi099 ceph-mon[138788]: pgmap v3473: 137 pgs: 7 creating+peering, 22 unknown, 108 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:10 smithi099 ceph-mon[138788]: osdmap e2010: 8 total, 8 up, 8 in 2024-01-13T18:58:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:10 smithi084 ceph-mon[116404]: pgmap v3473: 137 pgs: 7 creating+peering, 22 unknown, 108 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:10 smithi084 ceph-mon[116404]: osdmap e2010: 8 total, 8 up, 8 in 2024-01-13T18:58:11.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:10 smithi084 ceph-mon[119097]: pgmap v3473: 137 pgs: 7 creating+peering, 22 unknown, 108 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:11.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:10 smithi084 ceph-mon[119097]: osdmap e2010: 8 total, 8 up, 8 in 2024-01-13T18:58:11.488 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] 1 test from TestJournalStress (2041 ms total) 2024-01-13T18:58:11.488 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:58:11.488 INFO:tasks.workunit.client.0.smithi084.stdout:[----------] Global test environment tear-down 2024-01-13T18:58:11.488 INFO:tasks.workunit.client.0.smithi084.stdout:[==========] 409 tests from 16 test suites ran. (972385 ms total) 2024-01-13T18:58:11.489 INFO:tasks.workunit.client.0.smithi084.stdout:[ PASSED ] 409 tests. 2024-01-13T18:58:11.489 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:58:11.489 INFO:tasks.workunit.client.0.smithi084.stdout: YOU HAVE 2 DISABLED TESTS 2024-01-13T18:58:11.489 INFO:tasks.workunit.client.0.smithi084.stdout: 2024-01-13T18:58:11.500 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-13T18:58:11.500 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T18:58:11.571 INFO:tasks.workunit:Stopping ['rbd/test_librbd.sh'] on client.0... 2024-01-13T18:58:11.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-13T18:58:11.813 DEBUG:teuthology.parallel:result is None 2024-01-13T18:58:11.813 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:58:11.841 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:58:11.841 DEBUG:teuthology.orchestra.run.smithi084:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:58:11.898 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T18:58:11.899 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-01-13T18:58:11.899 INFO:teuthology.task.print:**** done end test_rbd_api.yaml 2024-01-13T18:58:11.899 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-01-13T18:58:11.899 INFO:teuthology.task.print:**** done start test_rbd_python.yaml 2024-01-13T18:58:11.899 INFO:teuthology.task.full_sequential:In full_sequential, running task workunit... 2024-01-13T18:58:11.900 INFO:tasks.workunit:Pulling workunits from ref quincy 2024-01-13T18:58:11.900 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-13T18:58:11.900 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:58:11.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T18:58:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-01-13T18:58:11.956 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-01-13T18:58:12.016 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-01-13T18:58:12.016 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-01-13T18:58:12.075 INFO:tasks.workunit:timeout=3h 2024-01-13T18:58:12.075 INFO:tasks.workunit:cleanup=True 2024-01-13T18:58:12.076 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch quincy https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 2024-01-13T18:58:12.133 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-13T18:58:12.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:12 smithi099 ceph-mon[138788]: pgmap v3476: 137 pgs: 7 creating+peering, 11 unknown, 119 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:12 smithi099 ceph-mon[138788]: osdmap e2011: 8 total, 8 up, 8 in 2024-01-13T18:58:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:12 smithi084 ceph-mon[116404]: pgmap v3476: 137 pgs: 7 creating+peering, 11 unknown, 119 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:12.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:12 smithi084 ceph-mon[116404]: osdmap e2011: 8 total, 8 up, 8 in 2024-01-13T18:58:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:12 smithi084 ceph-mon[119097]: pgmap v3476: 137 pgs: 7 creating+peering, 11 unknown, 119 active+clean; 4.6 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:12.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:12 smithi084 ceph-mon[119097]: osdmap e2011: 8 total, 8 up, 8 in 2024-01-13T18:58:15.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:14 smithi099 ceph-mon[138788]: pgmap v3478: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:15.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:14 smithi084 ceph-mon[116404]: pgmap v3478: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:15.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:14 smithi084 ceph-mon[119097]: pgmap v3478: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:16 smithi099 ceph-mon[138788]: pgmap v3479: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:17.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:16 smithi084 ceph-mon[116404]: pgmap v3479: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:17.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:16 smithi084 ceph-mon[119097]: pgmap v3479: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:18.339 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-13T18:58:18.396 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-13T18:58:18.398 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-13T18:58:18.399 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-13T18:58:18.445 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-13T18:58:18.491 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-13T18:58:18.527 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-13T18:58:18.529 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-13T18:58:18.529 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-13T18:58:18.565 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-13T18:58:18.568 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-01-13T18:58:18.568 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-13T18:58:18.627 INFO:tasks.workunit:Running workunits matching rbd/test_librbd_python.sh on client.0... 2024-01-13T18:58:18.628 INFO:tasks.workunit:Running workunit rbd/test_librbd_python.sh... 2024-01-13T18:58:18.628 DEBUG:teuthology.orchestra.run.smithi084:workunit test rbd/test_librbd_python.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh 2024-01-13T18:58:18.689 INFO:tasks.workunit.client.0.smithi084.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh 2024-01-13T18:58:18.689 INFO:tasks.workunit.client.0.smithi084.stderr:+ relpath=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../../src/test/pybind 2024-01-13T18:58:18.689 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' -n '' ']' 2024-01-13T18:58:18.690 INFO:tasks.workunit.client.0.smithi084.stderr:+ python3 -m nose -v /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../../src/test/pybind/test_rbd.py 2024-01-13T18:58:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:18 smithi099 ceph-mon[138788]: pgmap v3480: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:18 smithi084 ceph-mon[116404]: pgmap v3480: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:19.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:18 smithi084 ceph-mon[119097]: pgmap v3480: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:58:20] "GET /metrics HTTP/1.1" 200 36479 "" "Prometheus/2.43.0" 2024-01-13T18:58:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:20 smithi099 ceph-mon[138788]: pgmap v3481: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:20 smithi099 ceph-mon[138788]: osdmap e2012: 8 total, 8 up, 8 in 2024-01-13T18:58:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:20 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-1","app": "rbd","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:20 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-1","app": "rbd","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:58:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[116404]: pgmap v3481: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:21.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[116404]: osdmap e2012: 8 total, 8 up, 8 in 2024-01-13T18:58:21.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-1","app": "rbd","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:21.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-1","app": "rbd","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:21.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:58:21.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[119097]: pgmap v3481: 105 pgs: 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[119097]: osdmap e2012: 8 total, 8 up, 8 in 2024-01-13T18:58:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-1","app": "rbd","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-1","app": "rbd","yes_i_really_mean_it": true}]: dispatch 2024-01-13T18:58:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:58:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:22.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:21 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-1","app": "rbd","yes_i_really_mean_it": true}]': finished 2024-01-13T18:58:22.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:21 smithi099 ceph-mon[138788]: osdmap e2013: 8 total, 8 up, 8 in 2024-01-13T18:58:22.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:21 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-1","app": "rbd","yes_i_really_mean_it": true}]': finished 2024-01-13T18:58:22.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:21 smithi084 ceph-mon[116404]: osdmap e2013: 8 total, 8 up, 8 in 2024-01-13T18:58:22.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:21 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-1","app": "rbd","yes_i_really_mean_it": true}]': finished 2024-01-13T18:58:22.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:21 smithi084 ceph-mon[119097]: osdmap e2013: 8 total, 8 up, 8 in 2024-01-13T18:58:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:22 smithi099 ceph-mon[138788]: pgmap v3484: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:23.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:22 smithi099 ceph-mon[138788]: osdmap e2014: 8 total, 8 up, 8 in 2024-01-13T18:58:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:22 smithi084 ceph-mon[116404]: pgmap v3484: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:22 smithi084 ceph-mon[116404]: osdmap e2014: 8 total, 8 up, 8 in 2024-01-13T18:58:23.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:22 smithi084 ceph-mon[119097]: pgmap v3484: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:23.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:22 smithi084 ceph-mon[119097]: osdmap e2014: 8 total, 8 up, 8 in 2024-01-13T18:58:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:23 smithi099 ceph-mon[138788]: osdmap e2015: 8 total, 8 up, 8 in 2024-01-13T18:58:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:23 smithi084 ceph-mon[116404]: osdmap e2015: 8 total, 8 up, 8 in 2024-01-13T18:58:24.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:23 smithi084 ceph-mon[119097]: osdmap e2015: 8 total, 8 up, 8 in 2024-01-13T18:58:24.856 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_flatten_basic ... ok 2024-01-13T18:58:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:24 smithi099 ceph-mon[138788]: pgmap v3487: 137 pgs: 2 creating+peering, 8 unknown, 127 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:24 smithi099 ceph-mon[138788]: osdmap e2016: 8 total, 8 up, 8 in 2024-01-13T18:58:25.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:24 smithi084 ceph-mon[116404]: pgmap v3487: 137 pgs: 2 creating+peering, 8 unknown, 127 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:25.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:24 smithi084 ceph-mon[116404]: osdmap e2016: 8 total, 8 up, 8 in 2024-01-13T18:58:25.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:24 smithi084 ceph-mon[119097]: pgmap v3487: 137 pgs: 2 creating+peering, 8 unknown, 127 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-01-13T18:58:25.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:24 smithi084 ceph-mon[119097]: osdmap e2016: 8 total, 8 up, 8 in 2024-01-13T18:58:26.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:25 smithi099 ceph-mon[138788]: osdmap e2017: 8 total, 8 up, 8 in 2024-01-13T18:58:26.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:25 smithi084 ceph-mon[119097]: osdmap e2017: 8 total, 8 up, 8 in 2024-01-13T18:58:26.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:25 smithi084 ceph-mon[116404]: osdmap e2017: 8 total, 8 up, 8 in 2024-01-13T18:58:26.877 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_flatten_drops_cache ... ok 2024-01-13T18:58:27.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:26 smithi099 ceph-mon[138788]: pgmap v3490: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 136 KiB/s rd, 3.0 KiB/s wr, 167 op/s 2024-01-13T18:58:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:26 smithi099 ceph-mon[138788]: osdmap e2018: 8 total, 8 up, 8 in 2024-01-13T18:58:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:26 smithi084 ceph-mon[116404]: pgmap v3490: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 136 KiB/s rd, 3.0 KiB/s wr, 167 op/s 2024-01-13T18:58:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:26 smithi084 ceph-mon[116404]: osdmap e2018: 8 total, 8 up, 8 in 2024-01-13T18:58:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:26 smithi084 ceph-mon[119097]: pgmap v3490: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 136 KiB/s rd, 3.0 KiB/s wr, 167 op/s 2024-01-13T18:58:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:26 smithi084 ceph-mon[119097]: osdmap e2018: 8 total, 8 up, 8 in 2024-01-13T18:58:28.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:27 smithi099 ceph-mon[138788]: osdmap e2019: 8 total, 8 up, 8 in 2024-01-13T18:58:28.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:27 smithi099 ceph-mon[138788]: pgmap v3493: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 313 KiB/s rd, 18 KiB/s wr, 408 op/s 2024-01-13T18:58:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:27 smithi084 ceph-mon[116404]: osdmap e2019: 8 total, 8 up, 8 in 2024-01-13T18:58:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:27 smithi084 ceph-mon[116404]: pgmap v3493: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 313 KiB/s rd, 18 KiB/s wr, 408 op/s 2024-01-13T18:58:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:27 smithi084 ceph-mon[119097]: osdmap e2019: 8 total, 8 up, 8 in 2024-01-13T18:58:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:27 smithi084 ceph-mon[119097]: pgmap v3493: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 313 KiB/s rd, 18 KiB/s wr, 408 op/s 2024-01-13T18:58:29.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:28 smithi099 ceph-mon[138788]: osdmap e2020: 8 total, 8 up, 8 in 2024-01-13T18:58:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:28 smithi084 ceph-mon[116404]: osdmap e2020: 8 total, 8 up, 8 in 2024-01-13T18:58:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:28 smithi084 ceph-mon[119097]: osdmap e2020: 8 total, 8 up, 8 in 2024-01-13T18:58:30.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:29 smithi099 ceph-mon[138788]: osdmap e2021: 8 total, 8 up, 8 in 2024-01-13T18:58:30.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:29 smithi099 ceph-mon[138788]: pgmap v3496: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 427 KiB/s rd, 35 KiB/s wr, 584 op/s 2024-01-13T18:58:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:29 smithi084 ceph-mon[116404]: osdmap e2021: 8 total, 8 up, 8 in 2024-01-13T18:58:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:29 smithi084 ceph-mon[116404]: pgmap v3496: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 427 KiB/s rd, 35 KiB/s wr, 584 op/s 2024-01-13T18:58:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:29 smithi084 ceph-mon[119097]: osdmap e2021: 8 total, 8 up, 8 in 2024-01-13T18:58:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:29 smithi084 ceph-mon[119097]: pgmap v3496: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 427 KiB/s rd, 35 KiB/s wr, 584 op/s 2024-01-13T18:58:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:58:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:58:30] "GET /metrics HTTP/1.1" 200 36479 "" "Prometheus/2.43.0" 2024-01-13T18:58:30.891 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_flatten_errors ... ok 2024-01-13T18:58:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:30 smithi099 ceph-mon[138788]: osdmap e2022: 8 total, 8 up, 8 in 2024-01-13T18:58:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:58:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:58:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:58:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:30 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:58:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:30 smithi084 ceph-mon[116404]: osdmap e2022: 8 total, 8 up, 8 in 2024-01-13T18:58:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:58:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:58:31.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:58:31.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:30 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:58:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:30 smithi084 ceph-mon[119097]: osdmap e2022: 8 total, 8 up, 8 in 2024-01-13T18:58:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:58:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:58:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:58:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:30 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:58:32.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:31 smithi099 ceph-mon[138788]: osdmap e2023: 8 total, 8 up, 8 in 2024-01-13T18:58:32.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:31 smithi099 ceph-mon[138788]: pgmap v3499: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 273 KiB/s rd, 21 KiB/s wr, 375 op/s 2024-01-13T18:58:32.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:31 smithi084 ceph-mon[119097]: osdmap e2023: 8 total, 8 up, 8 in 2024-01-13T18:58:32.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:31 smithi084 ceph-mon[119097]: pgmap v3499: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 273 KiB/s rd, 21 KiB/s wr, 375 op/s 2024-01-13T18:58:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:31 smithi084 ceph-mon[116404]: osdmap e2023: 8 total, 8 up, 8 in 2024-01-13T18:58:32.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:31 smithi084 ceph-mon[116404]: pgmap v3499: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 273 KiB/s rd, 21 KiB/s wr, 375 op/s 2024-01-13T18:58:32.904 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_flatten_larger_order ... ok 2024-01-13T18:58:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:32 smithi099 ceph-mon[138788]: osdmap e2024: 8 total, 8 up, 8 in 2024-01-13T18:58:33.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:32 smithi084 ceph-mon[119097]: osdmap e2024: 8 total, 8 up, 8 in 2024-01-13T18:58:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:32 smithi084 ceph-mon[116404]: osdmap e2024: 8 total, 8 up, 8 in 2024-01-13T18:58:34.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:33 smithi099 ceph-mon[138788]: osdmap e2025: 8 total, 8 up, 8 in 2024-01-13T18:58:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:33 smithi099 ceph-mon[138788]: pgmap v3502: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 8.0 KiB/s wr, 127 op/s 2024-01-13T18:58:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:33 smithi099 ceph-mon[138788]: osdmap e2026: 8 total, 8 up, 8 in 2024-01-13T18:58:34.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:33 smithi084 ceph-mon[119097]: osdmap e2025: 8 total, 8 up, 8 in 2024-01-13T18:58:34.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:33 smithi084 ceph-mon[119097]: pgmap v3502: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 8.0 KiB/s wr, 127 op/s 2024-01-13T18:58:34.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:33 smithi084 ceph-mon[119097]: osdmap e2026: 8 total, 8 up, 8 in 2024-01-13T18:58:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:33 smithi084 ceph-mon[116404]: osdmap e2025: 8 total, 8 up, 8 in 2024-01-13T18:58:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:33 smithi084 ceph-mon[116404]: pgmap v3502: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 88 KiB/s rd, 8.0 KiB/s wr, 127 op/s 2024-01-13T18:58:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:33 smithi084 ceph-mon[116404]: osdmap e2026: 8 total, 8 up, 8 in 2024-01-13T18:58:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:35 smithi099 ceph-mon[138788]: osdmap e2027: 8 total, 8 up, 8 in 2024-01-13T18:58:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:35 smithi084 ceph-mon[116404]: osdmap e2027: 8 total, 8 up, 8 in 2024-01-13T18:58:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:35 smithi084 ceph-mon[119097]: osdmap e2027: 8 total, 8 up, 8 in 2024-01-13T18:58:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:36.825 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_flatten_multi_level ... ok 2024-01-13T18:58:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:36 smithi099 ceph-mon[138788]: pgmap v3505: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 309 KiB/s rd, 23 KiB/s wr, 419 op/s 2024-01-13T18:58:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:36 smithi099 ceph-mon[138788]: osdmap e2028: 8 total, 8 up, 8 in 2024-01-13T18:58:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:36 smithi084 ceph-mon[116404]: pgmap v3505: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 309 KiB/s rd, 23 KiB/s wr, 419 op/s 2024-01-13T18:58:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:36 smithi084 ceph-mon[116404]: osdmap e2028: 8 total, 8 up, 8 in 2024-01-13T18:58:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:36 smithi084 ceph-mon[119097]: pgmap v3505: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 309 KiB/s rd, 23 KiB/s wr, 419 op/s 2024-01-13T18:58:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:36 smithi084 ceph-mon[119097]: osdmap e2028: 8 total, 8 up, 8 in 2024-01-13T18:58:38.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:37 smithi099 ceph-mon[138788]: osdmap e2029: 8 total, 8 up, 8 in 2024-01-13T18:58:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:37 smithi084 ceph-mon[116404]: osdmap e2029: 8 total, 8 up, 8 in 2024-01-13T18:58:38.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:37 smithi084 ceph-mon[119097]: osdmap e2029: 8 total, 8 up, 8 in 2024-01-13T18:58:38.803 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_flatten_smaller_order ... ok 2024-01-13T18:58:39.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:38 smithi099 ceph-mon[138788]: pgmap v3508: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 521 KiB/s rd, 33 KiB/s wr, 684 op/s 2024-01-13T18:58:39.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:38 smithi099 ceph-mon[138788]: osdmap e2030: 8 total, 8 up, 8 in 2024-01-13T18:58:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:38 smithi099 ceph-mon[138788]: osdmap e2031: 8 total, 8 up, 8 in 2024-01-13T18:58:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:38 smithi084 ceph-mon[116404]: pgmap v3508: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 521 KiB/s rd, 33 KiB/s wr, 684 op/s 2024-01-13T18:58:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:38 smithi084 ceph-mon[116404]: osdmap e2030: 8 total, 8 up, 8 in 2024-01-13T18:58:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:38 smithi084 ceph-mon[116404]: osdmap e2031: 8 total, 8 up, 8 in 2024-01-13T18:58:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:38 smithi084 ceph-mon[119097]: pgmap v3508: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 521 KiB/s rd, 33 KiB/s wr, 684 op/s 2024-01-13T18:58:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:38 smithi084 ceph-mon[119097]: osdmap e2030: 8 total, 8 up, 8 in 2024-01-13T18:58:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:38 smithi084 ceph-mon[119097]: osdmap e2031: 8 total, 8 up, 8 in 2024-01-13T18:58:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:58:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:58:40] "GET /metrics HTTP/1.1" 200 36526 "" "Prometheus/2.43.0" 2024-01-13T18:58:40.839 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_flatten_with_progress ... ok 2024-01-13T18:58:41.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:40 smithi099 ceph-mon[138788]: pgmap v3511: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 388 KiB/s rd, 32 KiB/s wr, 532 op/s 2024-01-13T18:58:41.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:40 smithi099 ceph-mon[138788]: osdmap e2032: 8 total, 8 up, 8 in 2024-01-13T18:58:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:40 smithi084 ceph-mon[116404]: pgmap v3511: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 388 KiB/s rd, 32 KiB/s wr, 532 op/s 2024-01-13T18:58:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:40 smithi084 ceph-mon[116404]: osdmap e2032: 8 total, 8 up, 8 in 2024-01-13T18:58:41.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:40 smithi084 ceph-mon[119097]: pgmap v3511: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 388 KiB/s rd, 32 KiB/s wr, 532 op/s 2024-01-13T18:58:41.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:40 smithi084 ceph-mon[119097]: osdmap e2032: 8 total, 8 up, 8 in 2024-01-13T18:58:42.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:41 smithi099 ceph-mon[138788]: osdmap e2033: 8 total, 8 up, 8 in 2024-01-13T18:58:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:41 smithi084 ceph-mon[116404]: osdmap e2033: 8 total, 8 up, 8 in 2024-01-13T18:58:42.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:41 smithi084 ceph-mon[119097]: osdmap e2033: 8 total, 8 up, 8 in 2024-01-13T18:58:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:42 smithi099 ceph-mon[138788]: pgmap v3514: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 119 KiB/s rd, 18 KiB/s wr, 187 op/s 2024-01-13T18:58:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:42 smithi099 ceph-mon[138788]: osdmap e2034: 8 total, 8 up, 8 in 2024-01-13T18:58:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:42 smithi084 ceph-mon[116404]: pgmap v3514: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 119 KiB/s rd, 18 KiB/s wr, 187 op/s 2024-01-13T18:58:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:42 smithi084 ceph-mon[116404]: osdmap e2034: 8 total, 8 up, 8 in 2024-01-13T18:58:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:42 smithi084 ceph-mon[119097]: pgmap v3514: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 119 KiB/s rd, 18 KiB/s wr, 187 op/s 2024-01-13T18:58:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:42 smithi084 ceph-mon[119097]: osdmap e2034: 8 total, 8 up, 8 in 2024-01-13T18:58:45.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:44 smithi099 ceph-mon[138788]: pgmap v3516: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 518 KiB/s rd, 34 KiB/s wr, 695 op/s 2024-01-13T18:58:45.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:44 smithi099 ceph-mon[138788]: osdmap e2035: 8 total, 8 up, 8 in 2024-01-13T18:58:45.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:44 smithi084 ceph-mon[116404]: pgmap v3516: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 518 KiB/s rd, 34 KiB/s wr, 695 op/s 2024-01-13T18:58:45.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:44 smithi084 ceph-mon[116404]: osdmap e2035: 8 total, 8 up, 8 in 2024-01-13T18:58:45.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:44 smithi084 ceph-mon[119097]: pgmap v3516: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 518 KiB/s rd, 34 KiB/s wr, 695 op/s 2024-01-13T18:58:45.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:44 smithi084 ceph-mon[119097]: osdmap e2035: 8 total, 8 up, 8 in 2024-01-13T18:58:45.799 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_list_children ... ok 2024-01-13T18:58:47.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:46 smithi099 ceph-mon[138788]: pgmap v3518: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 943 KiB/s rd, 29 KiB/s wr, 1.18k op/s 2024-01-13T18:58:47.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:46 smithi099 ceph-mon[138788]: osdmap e2036: 8 total, 8 up, 8 in 2024-01-13T18:58:47.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:46 smithi084 ceph-mon[116404]: pgmap v3518: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 943 KiB/s rd, 29 KiB/s wr, 1.18k op/s 2024-01-13T18:58:47.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:46 smithi084 ceph-mon[116404]: osdmap e2036: 8 total, 8 up, 8 in 2024-01-13T18:58:47.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:46 smithi084 ceph-mon[119097]: pgmap v3518: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 943 KiB/s rd, 29 KiB/s wr, 1.18k op/s 2024-01-13T18:58:47.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:46 smithi084 ceph-mon[119097]: osdmap e2036: 8 total, 8 up, 8 in 2024-01-13T18:58:47.831 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_read ... ok 2024-01-13T18:58:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:47 smithi099 ceph-mon[138788]: osdmap e2037: 8 total, 8 up, 8 in 2024-01-13T18:58:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:47 smithi084 ceph-mon[116404]: osdmap e2037: 8 total, 8 up, 8 in 2024-01-13T18:58:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:47 smithi084 ceph-mon[119097]: osdmap e2037: 8 total, 8 up, 8 in 2024-01-13T18:58:49.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:48 smithi099 ceph-mon[138788]: pgmap v3521: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 33 KiB/s wr, 2.51k op/s 2024-01-13T18:58:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:48 smithi099 ceph-mon[138788]: osdmap e2038: 8 total, 8 up, 8 in 2024-01-13T18:58:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:48 smithi099 ceph-mon[138788]: osdmap e2039: 8 total, 8 up, 8 in 2024-01-13T18:58:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:48 smithi084 ceph-mon[116404]: pgmap v3521: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 33 KiB/s wr, 2.51k op/s 2024-01-13T18:58:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:48 smithi084 ceph-mon[116404]: osdmap e2038: 8 total, 8 up, 8 in 2024-01-13T18:58:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:48 smithi084 ceph-mon[116404]: osdmap e2039: 8 total, 8 up, 8 in 2024-01-13T18:58:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:48 smithi084 ceph-mon[119097]: pgmap v3521: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.1 MiB/s rd, 33 KiB/s wr, 2.51k op/s 2024-01-13T18:58:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:48 smithi084 ceph-mon[119097]: osdmap e2038: 8 total, 8 up, 8 in 2024-01-13T18:58:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:48 smithi084 ceph-mon[119097]: osdmap e2039: 8 total, 8 up, 8 in 2024-01-13T18:58:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:58:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:58:50] "GET /metrics HTTP/1.1" 200 36522 "" "Prometheus/2.43.0" 2024-01-13T18:58:51.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:50 smithi099 ceph-mon[138788]: pgmap v3524: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 36 KiB/s wr, 2.64k op/s 2024-01-13T18:58:51.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:50 smithi099 ceph-mon[138788]: osdmap e2040: 8 total, 8 up, 8 in 2024-01-13T18:58:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:51.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:50 smithi084 ceph-mon[116404]: pgmap v3524: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 36 KiB/s wr, 2.64k op/s 2024-01-13T18:58:51.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:50 smithi084 ceph-mon[116404]: osdmap e2040: 8 total, 8 up, 8 in 2024-01-13T18:58:51.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:50 smithi084 ceph-mon[119097]: pgmap v3524: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 36 KiB/s wr, 2.64k op/s 2024-01-13T18:58:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:50 smithi084 ceph-mon[119097]: osdmap e2040: 8 total, 8 up, 8 in 2024-01-13T18:58:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:58:51.849 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_resize_flatten_multi_level ... ok 2024-01-13T18:58:52.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:51 smithi099 ceph-mon[138788]: osdmap e2041: 8 total, 8 up, 8 in 2024-01-13T18:58:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:51 smithi084 ceph-mon[116404]: osdmap e2041: 8 total, 8 up, 8 in 2024-01-13T18:58:52.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:51 smithi084 ceph-mon[119097]: osdmap e2041: 8 total, 8 up, 8 in 2024-01-13T18:58:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:52 smithi099 ceph-mon[138788]: pgmap v3527: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 531 KiB/s rd, 20 KiB/s wr, 664 op/s 2024-01-13T18:58:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:52 smithi099 ceph-mon[138788]: osdmap e2042: 8 total, 8 up, 8 in 2024-01-13T18:58:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:52 smithi084 ceph-mon[116404]: pgmap v3527: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 531 KiB/s rd, 20 KiB/s wr, 664 op/s 2024-01-13T18:58:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:52 smithi084 ceph-mon[116404]: osdmap e2042: 8 total, 8 up, 8 in 2024-01-13T18:58:53.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:52 smithi084 ceph-mon[119097]: pgmap v3527: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 531 KiB/s rd, 20 KiB/s wr, 664 op/s 2024-01-13T18:58:53.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:52 smithi084 ceph-mon[119097]: osdmap e2042: 8 total, 8 up, 8 in 2024-01-13T18:58:53.813 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_resize_io ... ok 2024-01-13T18:58:54.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:53 smithi099 ceph-mon[138788]: osdmap e2043: 8 total, 8 up, 8 in 2024-01-13T18:58:54.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:53 smithi099 ceph-mon[138788]: osdmap e2044: 8 total, 8 up, 8 in 2024-01-13T18:58:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:53 smithi084 ceph-mon[116404]: osdmap e2043: 8 total, 8 up, 8 in 2024-01-13T18:58:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:53 smithi084 ceph-mon[116404]: osdmap e2044: 8 total, 8 up, 8 in 2024-01-13T18:58:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:53 smithi084 ceph-mon[119097]: osdmap e2043: 8 total, 8 up, 8 in 2024-01-13T18:58:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:53 smithi084 ceph-mon[119097]: osdmap e2044: 8 total, 8 up, 8 in 2024-01-13T18:58:55.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:54 smithi099 ceph-mon[138788]: pgmap v3530: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 266 KiB/s rd, 14 KiB/s wr, 348 op/s 2024-01-13T18:58:55.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:54 smithi084 ceph-mon[116404]: pgmap v3530: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 266 KiB/s rd, 14 KiB/s wr, 348 op/s 2024-01-13T18:58:55.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:54 smithi084 ceph-mon[119097]: pgmap v3530: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 266 KiB/s rd, 14 KiB/s wr, 348 op/s 2024-01-13T18:58:55.883 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_resize_stat ... ok 2024-01-13T18:58:56.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:55 smithi099 ceph-mon[138788]: osdmap e2045: 8 total, 8 up, 8 in 2024-01-13T18:58:56.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:55 smithi099 ceph-mon[138788]: pgmap v3533: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 288 KiB/s rd, 23 KiB/s wr, 391 op/s 2024-01-13T18:58:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:55 smithi084 ceph-mon[116404]: osdmap e2045: 8 total, 8 up, 8 in 2024-01-13T18:58:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:55 smithi084 ceph-mon[116404]: pgmap v3533: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 288 KiB/s rd, 23 KiB/s wr, 391 op/s 2024-01-13T18:58:56.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:55 smithi084 ceph-mon[119097]: osdmap e2045: 8 total, 8 up, 8 in 2024-01-13T18:58:56.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:55 smithi084 ceph-mon[119097]: pgmap v3533: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 288 KiB/s rd, 23 KiB/s wr, 391 op/s 2024-01-13T18:58:57.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:56 smithi099 ceph-mon[138788]: osdmap e2046: 8 total, 8 up, 8 in 2024-01-13T18:58:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:56 smithi084 ceph-mon[116404]: osdmap e2046: 8 total, 8 up, 8 in 2024-01-13T18:58:57.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:56 smithi084 ceph-mon[119097]: osdmap e2046: 8 total, 8 up, 8 in 2024-01-13T18:58:57.899 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_stat ... ok 2024-01-13T18:58:58.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:57 smithi099 ceph-mon[138788]: osdmap e2047: 8 total, 8 up, 8 in 2024-01-13T18:58:58.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:57 smithi099 ceph-mon[138788]: pgmap v3536: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 72 KiB/s rd, 16 KiB/s wr, 125 op/s 2024-01-13T18:58:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:57 smithi084 ceph-mon[116404]: osdmap e2047: 8 total, 8 up, 8 in 2024-01-13T18:58:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:57 smithi084 ceph-mon[116404]: pgmap v3536: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 72 KiB/s rd, 16 KiB/s wr, 125 op/s 2024-01-13T18:58:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:57 smithi084 ceph-mon[119097]: osdmap e2047: 8 total, 8 up, 8 in 2024-01-13T18:58:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:57 smithi084 ceph-mon[119097]: pgmap v3536: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 72 KiB/s rd, 16 KiB/s wr, 125 op/s 2024-01-13T18:58:59.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:58 smithi099 ceph-mon[138788]: osdmap e2048: 8 total, 8 up, 8 in 2024-01-13T18:58:59.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:58 smithi099 ceph-mon[138788]: osdmap e2049: 8 total, 8 up, 8 in 2024-01-13T18:58:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:58 smithi084 ceph-mon[116404]: osdmap e2048: 8 total, 8 up, 8 in 2024-01-13T18:58:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:58 smithi084 ceph-mon[116404]: osdmap e2049: 8 total, 8 up, 8 in 2024-01-13T18:58:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:58 smithi084 ceph-mon[119097]: osdmap e2048: 8 total, 8 up, 8 in 2024-01-13T18:58:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:58 smithi084 ceph-mon[119097]: osdmap e2049: 8 total, 8 up, 8 in 2024-01-13T18:59:00.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:58:59 smithi099 ceph-mon[138788]: pgmap v3539: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 245 KiB/s rd, 22 KiB/s wr, 336 op/s 2024-01-13T18:59:00.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:58:59 smithi084 ceph-mon[116404]: pgmap v3539: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 245 KiB/s rd, 22 KiB/s wr, 336 op/s 2024-01-13T18:59:00.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:58:59 smithi084 ceph-mon[119097]: pgmap v3539: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 245 KiB/s rd, 22 KiB/s wr, 336 op/s 2024-01-13T18:59:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:59:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:59:00] "GET /metrics HTTP/1.1" 200 36522 "" "Prometheus/2.43.0" 2024-01-13T18:59:01.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:00 smithi099 ceph-mon[138788]: osdmap e2050: 8 total, 8 up, 8 in 2024-01-13T18:59:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:00 smithi084 ceph-mon[116404]: osdmap e2050: 8 total, 8 up, 8 in 2024-01-13T18:59:01.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:00 smithi084 ceph-mon[119097]: osdmap e2050: 8 total, 8 up, 8 in 2024-01-13T18:59:01.919 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_stripe_unit_and_count ... ok 2024-01-13T18:59:02.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:01 smithi099 ceph-mon[138788]: osdmap e2051: 8 total, 8 up, 8 in 2024-01-13T18:59:02.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:01 smithi099 ceph-mon[138788]: pgmap v3542: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 236 KiB/s rd, 16 KiB/s wr, 311 op/s 2024-01-13T18:59:02.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:01 smithi084 ceph-mon[116404]: osdmap e2051: 8 total, 8 up, 8 in 2024-01-13T18:59:02.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:01 smithi084 ceph-mon[116404]: pgmap v3542: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 236 KiB/s rd, 16 KiB/s wr, 311 op/s 2024-01-13T18:59:02.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:01 smithi084 ceph-mon[119097]: osdmap e2051: 8 total, 8 up, 8 in 2024-01-13T18:59:02.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:01 smithi084 ceph-mon[119097]: pgmap v3542: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 236 KiB/s rd, 16 KiB/s wr, 311 op/s 2024-01-13T18:59:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:02 smithi099 ceph-mon[138788]: osdmap e2052: 8 total, 8 up, 8 in 2024-01-13T18:59:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:02 smithi084 ceph-mon[116404]: osdmap e2052: 8 total, 8 up, 8 in 2024-01-13T18:59:03.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:02 smithi084 ceph-mon[119097]: osdmap e2052: 8 total, 8 up, 8 in 2024-01-13T18:59:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:03 smithi099 ceph-mon[138788]: osdmap e2053: 8 total, 8 up, 8 in 2024-01-13T18:59:04.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:03 smithi099 ceph-mon[138788]: pgmap v3545: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 272 KiB/s rd, 14 KiB/s wr, 356 op/s 2024-01-13T18:59:04.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:03 smithi099 ceph-mon[138788]: osdmap e2054: 8 total, 8 up, 8 in 2024-01-13T18:59:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:03 smithi084 ceph-mon[116404]: osdmap e2053: 8 total, 8 up, 8 in 2024-01-13T18:59:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:03 smithi084 ceph-mon[116404]: pgmap v3545: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 272 KiB/s rd, 14 KiB/s wr, 356 op/s 2024-01-13T18:59:04.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:03 smithi084 ceph-mon[116404]: osdmap e2054: 8 total, 8 up, 8 in 2024-01-13T18:59:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:03 smithi084 ceph-mon[119097]: osdmap e2053: 8 total, 8 up, 8 in 2024-01-13T18:59:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:03 smithi084 ceph-mon[119097]: pgmap v3545: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 272 KiB/s rd, 14 KiB/s wr, 356 op/s 2024-01-13T18:59:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:03 smithi084 ceph-mon[119097]: osdmap e2054: 8 total, 8 up, 8 in 2024-01-13T18:59:05.944 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_trash_snapshot ... ok 2024-01-13T18:59:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:05 smithi099 ceph-mon[138788]: osdmap e2055: 8 total, 8 up, 8 in 2024-01-13T18:59:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:05 smithi099 ceph-mon[138788]: pgmap v3548: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 307 KiB/s rd, 20 KiB/s wr, 409 op/s 2024-01-13T18:59:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:05 smithi084 ceph-mon[116404]: osdmap e2055: 8 total, 8 up, 8 in 2024-01-13T18:59:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:05 smithi084 ceph-mon[116404]: pgmap v3548: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 307 KiB/s rd, 20 KiB/s wr, 409 op/s 2024-01-13T18:59:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:05 smithi084 ceph-mon[119097]: osdmap e2055: 8 total, 8 up, 8 in 2024-01-13T18:59:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:05 smithi084 ceph-mon[119097]: pgmap v3548: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 307 KiB/s rd, 20 KiB/s wr, 409 op/s 2024-01-13T18:59:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:06 smithi099 ceph-mon[138788]: osdmap e2056: 8 total, 8 up, 8 in 2024-01-13T18:59:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:06 smithi084 ceph-mon[116404]: osdmap e2056: 8 total, 8 up, 8 in 2024-01-13T18:59:07.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:06 smithi084 ceph-mon[119097]: osdmap e2056: 8 total, 8 up, 8 in 2024-01-13T18:59:08.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:07 smithi099 ceph-mon[138788]: osdmap e2057: 8 total, 8 up, 8 in 2024-01-13T18:59:08.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:07 smithi099 ceph-mon[138788]: pgmap v3551: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 294 KiB/s rd, 21 KiB/s wr, 393 op/s 2024-01-13T18:59:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:07 smithi084 ceph-mon[116404]: osdmap e2057: 8 total, 8 up, 8 in 2024-01-13T18:59:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:07 smithi084 ceph-mon[116404]: pgmap v3551: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 294 KiB/s rd, 21 KiB/s wr, 393 op/s 2024-01-13T18:59:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:07 smithi084 ceph-mon[119097]: osdmap e2057: 8 total, 8 up, 8 in 2024-01-13T18:59:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:07 smithi084 ceph-mon[119097]: pgmap v3551: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 294 KiB/s rd, 21 KiB/s wr, 393 op/s 2024-01-13T18:59:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:08 smithi099 ceph-mon[138788]: osdmap e2058: 8 total, 8 up, 8 in 2024-01-13T18:59:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:08 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-2","app": "rbd"}]: dispatch 2024-01-13T18:59:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:08 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-2","app": "rbd"}]: dispatch 2024-01-13T18:59:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:08 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-2","app": "rbd"}]': finished 2024-01-13T18:59:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:08 smithi099 ceph-mon[138788]: osdmap e2059: 8 total, 8 up, 8 in 2024-01-13T18:59:09.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:08 smithi084 ceph-mon[119097]: osdmap e2058: 8 total, 8 up, 8 in 2024-01-13T18:59:09.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:08 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-2","app": "rbd"}]: dispatch 2024-01-13T18:59:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:08 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-2","app": "rbd"}]: dispatch 2024-01-13T18:59:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:08 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-2","app": "rbd"}]': finished 2024-01-13T18:59:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:08 smithi084 ceph-mon[119097]: osdmap e2059: 8 total, 8 up, 8 in 2024-01-13T18:59:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:08 smithi084 ceph-mon[116404]: osdmap e2058: 8 total, 8 up, 8 in 2024-01-13T18:59:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:08 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-2","app": "rbd"}]: dispatch 2024-01-13T18:59:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:08 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-2","app": "rbd"}]: dispatch 2024-01-13T18:59:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:08 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rbd-api-smithi084-186077-2","app": "rbd"}]': finished 2024-01-13T18:59:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:08 smithi084 ceph-mon[116404]: osdmap e2059: 8 total, 8 up, 8 in 2024-01-13T18:59:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:59:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:59:10] "GET /metrics HTTP/1.1" 200 36527 "" "Prometheus/2.43.0" 2024-01-13T18:59:11.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:10 smithi099 ceph-mon[138788]: pgmap v3554: 169 pgs: 28 unknown, 141 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 237 KiB/s rd, 16 KiB/s wr, 313 op/s 2024-01-13T18:59:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:10 smithi099 ceph-mon[138788]: osdmap e2060: 8 total, 8 up, 8 in 2024-01-13T18:59:11.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:10 smithi084 ceph-mon[116404]: pgmap v3554: 169 pgs: 28 unknown, 141 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 237 KiB/s rd, 16 KiB/s wr, 313 op/s 2024-01-13T18:59:11.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:10 smithi084 ceph-mon[116404]: osdmap e2060: 8 total, 8 up, 8 in 2024-01-13T18:59:11.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:10 smithi084 ceph-mon[119097]: pgmap v3554: 169 pgs: 28 unknown, 141 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 237 KiB/s rd, 16 KiB/s wr, 313 op/s 2024-01-13T18:59:11.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:10 smithi084 ceph-mon[119097]: osdmap e2060: 8 total, 8 up, 8 in 2024-01-13T18:59:12.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:11 smithi099 ceph-mon[138788]: osdmap e2061: 8 total, 8 up, 8 in 2024-01-13T18:59:12.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:11 smithi084 ceph-mon[116404]: osdmap e2061: 8 total, 8 up, 8 in 2024-01-13T18:59:12.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:11 smithi084 ceph-mon[119097]: osdmap e2061: 8 total, 8 up, 8 in 2024-01-13T18:59:12.884 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_unprotect_with_children ... ok 2024-01-13T18:59:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:12 smithi099 ceph-mon[138788]: pgmap v3557: 169 pgs: 24 unknown, 145 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 2.7 KiB/s wr, 31 op/s 2024-01-13T18:59:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:12 smithi099 ceph-mon[138788]: osdmap e2062: 8 total, 8 up, 8 in 2024-01-13T18:59:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:12 smithi084 ceph-mon[116404]: pgmap v3557: 169 pgs: 24 unknown, 145 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 2.7 KiB/s wr, 31 op/s 2024-01-13T18:59:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:12 smithi084 ceph-mon[116404]: osdmap e2062: 8 total, 8 up, 8 in 2024-01-13T18:59:13.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:12 smithi084 ceph-mon[119097]: pgmap v3557: 169 pgs: 24 unknown, 145 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 2.7 KiB/s wr, 31 op/s 2024-01-13T18:59:13.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:12 smithi084 ceph-mon[119097]: osdmap e2062: 8 total, 8 up, 8 in 2024-01-13T18:59:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:13 smithi099 ceph-mon[138788]: osdmap e2063: 8 total, 8 up, 8 in 2024-01-13T18:59:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:13 smithi099 ceph-mon[138788]: osdmap e2064: 8 total, 8 up, 8 in 2024-01-13T18:59:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:13 smithi084 ceph-mon[116404]: osdmap e2063: 8 total, 8 up, 8 in 2024-01-13T18:59:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:13 smithi084 ceph-mon[116404]: osdmap e2064: 8 total, 8 up, 8 in 2024-01-13T18:59:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:13 smithi084 ceph-mon[119097]: osdmap e2063: 8 total, 8 up, 8 in 2024-01-13T18:59:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:13 smithi084 ceph-mon[119097]: osdmap e2064: 8 total, 8 up, 8 in 2024-01-13T18:59:15.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:14 smithi099 ceph-mon[138788]: pgmap v3560: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 81 KiB/s rd, 2.5 KiB/s wr, 102 op/s 2024-01-13T18:59:15.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:14 smithi084 ceph-mon[116404]: pgmap v3560: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 81 KiB/s rd, 2.5 KiB/s wr, 102 op/s 2024-01-13T18:59:15.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:14 smithi084 ceph-mon[119097]: pgmap v3560: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 81 KiB/s rd, 2.5 KiB/s wr, 102 op/s 2024-01-13T18:59:16.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:15 smithi099 ceph-mon[138788]: osdmap e2065: 8 total, 8 up, 8 in 2024-01-13T18:59:16.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:15 smithi099 ceph-mon[138788]: pgmap v3563: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 130 KiB/s rd, 5.7 KiB/s wr, 163 op/s 2024-01-13T18:59:16.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:15 smithi084 ceph-mon[116404]: osdmap e2065: 8 total, 8 up, 8 in 2024-01-13T18:59:16.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:15 smithi084 ceph-mon[116404]: pgmap v3563: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 130 KiB/s rd, 5.7 KiB/s wr, 163 op/s 2024-01-13T18:59:16.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:15 smithi084 ceph-mon[119097]: osdmap e2065: 8 total, 8 up, 8 in 2024-01-13T18:59:16.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:15 smithi084 ceph-mon[119097]: pgmap v3563: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 130 KiB/s rd, 5.7 KiB/s wr, 163 op/s 2024-01-13T18:59:16.893 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_unprotected ... ok 2024-01-13T18:59:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:16 smithi099 ceph-mon[138788]: osdmap e2066: 8 total, 8 up, 8 in 2024-01-13T18:59:17.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:16 smithi084 ceph-mon[116404]: osdmap e2066: 8 total, 8 up, 8 in 2024-01-13T18:59:17.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:16 smithi084 ceph-mon[119097]: osdmap e2066: 8 total, 8 up, 8 in 2024-01-13T18:59:18.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:17 smithi099 ceph-mon[138788]: osdmap e2067: 8 total, 8 up, 8 in 2024-01-13T18:59:18.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:17 smithi099 ceph-mon[138788]: pgmap v3566: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 106 KiB/s rd, 8.7 KiB/s wr, 146 op/s 2024-01-13T18:59:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:17 smithi084 ceph-mon[116404]: osdmap e2067: 8 total, 8 up, 8 in 2024-01-13T18:59:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:17 smithi084 ceph-mon[116404]: pgmap v3566: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 106 KiB/s rd, 8.7 KiB/s wr, 146 op/s 2024-01-13T18:59:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:17 smithi084 ceph-mon[119097]: osdmap e2067: 8 total, 8 up, 8 in 2024-01-13T18:59:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:17 smithi084 ceph-mon[119097]: pgmap v3566: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 106 KiB/s rd, 8.7 KiB/s wr, 146 op/s 2024-01-13T18:59:19.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:18 smithi099 ceph-mon[138788]: osdmap e2068: 8 total, 8 up, 8 in 2024-01-13T18:59:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:18 smithi084 ceph-mon[116404]: osdmap e2068: 8 total, 8 up, 8 in 2024-01-13T18:59:19.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:18 smithi084 ceph-mon[119097]: osdmap e2068: 8 total, 8 up, 8 in 2024-01-13T18:59:20.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:19 smithi099 ceph-mon[138788]: osdmap e2069: 8 total, 8 up, 8 in 2024-01-13T18:59:20.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:19 smithi099 ceph-mon[138788]: pgmap v3569: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 168 KiB/s rd, 13 KiB/s wr, 230 op/s 2024-01-13T18:59:20.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:19 smithi084 ceph-mon[116404]: osdmap e2069: 8 total, 8 up, 8 in 2024-01-13T18:59:20.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:19 smithi084 ceph-mon[116404]: pgmap v3569: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 168 KiB/s rd, 13 KiB/s wr, 230 op/s 2024-01-13T18:59:20.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:19 smithi084 ceph-mon[119097]: osdmap e2069: 8 total, 8 up, 8 in 2024-01-13T18:59:20.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:19 smithi084 ceph-mon[119097]: pgmap v3569: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 168 KiB/s rd, 13 KiB/s wr, 230 op/s 2024-01-13T18:59:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:59:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:59:20] "GET /metrics HTTP/1.1" 200 36525 "" "Prometheus/2.43.0" 2024-01-13T18:59:20.930 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_with_params ... ok 2024-01-13T18:59:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:20 smithi099 ceph-mon[138788]: osdmap e2070: 8 total, 8 up, 8 in 2024-01-13T18:59:21.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:20 smithi084 ceph-mon[116404]: osdmap e2070: 8 total, 8 up, 8 in 2024-01-13T18:59:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:21.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:20 smithi084 ceph-mon[119097]: osdmap e2070: 8 total, 8 up, 8 in 2024-01-13T18:59:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:22.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:21 smithi099 ceph-mon[138788]: osdmap e2071: 8 total, 8 up, 8 in 2024-01-13T18:59:22.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:21 smithi099 ceph-mon[138788]: pgmap v3572: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 136 KiB/s rd, 8.2 KiB/s wr, 179 op/s 2024-01-13T18:59:22.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:21 smithi084 ceph-mon[119097]: osdmap e2071: 8 total, 8 up, 8 in 2024-01-13T18:59:22.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:21 smithi084 ceph-mon[119097]: pgmap v3572: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 136 KiB/s rd, 8.2 KiB/s wr, 179 op/s 2024-01-13T18:59:22.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:21 smithi084 ceph-mon[116404]: osdmap e2071: 8 total, 8 up, 8 in 2024-01-13T18:59:22.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:21 smithi084 ceph-mon[116404]: pgmap v3572: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 136 KiB/s rd, 8.2 KiB/s wr, 179 op/s 2024-01-13T18:59:23.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:22 smithi099 ceph-mon[138788]: osdmap e2072: 8 total, 8 up, 8 in 2024-01-13T18:59:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:22 smithi084 ceph-mon[116404]: osdmap e2072: 8 total, 8 up, 8 in 2024-01-13T18:59:23.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:22 smithi084 ceph-mon[119097]: osdmap e2072: 8 total, 8 up, 8 in 2024-01-13T18:59:24.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:23 smithi099 ceph-mon[138788]: osdmap e2073: 8 total, 8 up, 8 in 2024-01-13T18:59:24.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:23 smithi099 ceph-mon[138788]: pgmap v3575: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 110 KiB/s rd, 9.0 KiB/s wr, 155 op/s 2024-01-13T18:59:24.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:23 smithi099 ceph-mon[138788]: osdmap e2074: 8 total, 8 up, 8 in 2024-01-13T18:59:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:23 smithi084 ceph-mon[116404]: osdmap e2073: 8 total, 8 up, 8 in 2024-01-13T18:59:24.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:23 smithi084 ceph-mon[116404]: pgmap v3575: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 110 KiB/s rd, 9.0 KiB/s wr, 155 op/s 2024-01-13T18:59:24.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:23 smithi084 ceph-mon[116404]: osdmap e2074: 8 total, 8 up, 8 in 2024-01-13T18:59:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:23 smithi084 ceph-mon[119097]: osdmap e2073: 8 total, 8 up, 8 in 2024-01-13T18:59:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:23 smithi084 ceph-mon[119097]: pgmap v3575: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 110 KiB/s rd, 9.0 KiB/s wr, 155 op/s 2024-01-13T18:59:24.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:23 smithi084 ceph-mon[119097]: osdmap e2074: 8 total, 8 up, 8 in 2024-01-13T18:59:24.832 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_with_params2 ... ok 2024-01-13T18:59:26.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:25 smithi099 ceph-mon[138788]: osdmap e2075: 8 total, 8 up, 8 in 2024-01-13T18:59:26.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:25 smithi084 ceph-mon[116404]: osdmap e2075: 8 total, 8 up, 8 in 2024-01-13T18:59:26.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:25 smithi084 ceph-mon[119097]: osdmap e2075: 8 total, 8 up, 8 in 2024-01-13T18:59:26.847 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_with_params3 ... SKIP 2024-01-13T18:59:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:26 smithi099 ceph-mon[138788]: pgmap v3578: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 166 KiB/s rd, 16 KiB/s wr, 237 op/s 2024-01-13T18:59:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:26 smithi099 ceph-mon[138788]: osdmap e2076: 8 total, 8 up, 8 in 2024-01-13T18:59:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:26 smithi084 ceph-mon[116404]: pgmap v3578: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 166 KiB/s rd, 16 KiB/s wr, 237 op/s 2024-01-13T18:59:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:26 smithi084 ceph-mon[116404]: osdmap e2076: 8 total, 8 up, 8 in 2024-01-13T18:59:27.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:26 smithi084 ceph-mon[119097]: pgmap v3578: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 166 KiB/s rd, 16 KiB/s wr, 237 op/s 2024-01-13T18:59:27.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:26 smithi084 ceph-mon[119097]: osdmap e2076: 8 total, 8 up, 8 in 2024-01-13T18:59:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:27 smithi099 ceph-mon[138788]: osdmap e2077: 8 total, 8 up, 8 in 2024-01-13T18:59:28.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:27 smithi084 ceph-mon[119097]: osdmap e2077: 8 total, 8 up, 8 in 2024-01-13T18:59:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:27 smithi084 ceph-mon[116404]: osdmap e2077: 8 total, 8 up, 8 in 2024-01-13T18:59:28.827 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestClone.test_write ... ok 2024-01-13T18:59:28.919 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestExclusiveLock.test_acquire_release_lock ... ok 2024-01-13T18:59:29.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:28 smithi099 ceph-mon[138788]: pgmap v3581: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 298 KiB/s rd, 20 KiB/s wr, 396 op/s 2024-01-13T18:59:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:28 smithi099 ceph-mon[138788]: osdmap e2078: 8 total, 8 up, 8 in 2024-01-13T18:59:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:28 smithi099 ceph-mon[138788]: osdmap e2079: 8 total, 8 up, 8 in 2024-01-13T18:59:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:28 smithi084 ceph-mon[116404]: pgmap v3581: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 298 KiB/s rd, 20 KiB/s wr, 396 op/s 2024-01-13T18:59:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:28 smithi084 ceph-mon[116404]: osdmap e2078: 8 total, 8 up, 8 in 2024-01-13T18:59:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:28 smithi084 ceph-mon[116404]: osdmap e2079: 8 total, 8 up, 8 in 2024-01-13T18:59:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:28 smithi084 ceph-mon[119097]: pgmap v3581: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 298 KiB/s rd, 20 KiB/s wr, 396 op/s 2024-01-13T18:59:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:28 smithi084 ceph-mon[119097]: osdmap e2078: 8 total, 8 up, 8 in 2024-01-13T18:59:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:28 smithi084 ceph-mon[119097]: osdmap e2079: 8 total, 8 up, 8 in 2024-01-13T18:59:29.857 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestExclusiveLock.test_break_lock ... ok 2024-01-13T18:59:29.969 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestExclusiveLock.test_follower_discard ... ok 2024-01-13T18:59:30.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:29 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2597822493' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/850292556"}]: dispatch 2024-01-13T18:59:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:29 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2597822493' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/850292556"}]: dispatch 2024-01-13T18:59:30.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:29 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2597822493' entity='client.admin' cmd=[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/850292556"}]: dispatch 2024-01-13T18:59:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:59:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:59:30] "GET /metrics HTTP/1.1" 200 36525 "" "Prometheus/2.43.0" 2024-01-13T18:59:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:30 smithi099 ceph-mon[138788]: pgmap v3584: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 321 KiB/s rd, 21 KiB/s wr, 421 op/s 2024-01-13T18:59:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:30 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2597822493' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/850292556"}]': finished 2024-01-13T18:59:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:30 smithi099 ceph-mon[138788]: osdmap e2080: 8 total, 8 up, 8 in 2024-01-13T18:59:31.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:30 smithi084 ceph-mon[119097]: pgmap v3584: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 321 KiB/s rd, 21 KiB/s wr, 421 op/s 2024-01-13T18:59:31.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:30 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2597822493' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/850292556"}]': finished 2024-01-13T18:59:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:30 smithi084 ceph-mon[119097]: osdmap e2080: 8 total, 8 up, 8 in 2024-01-13T18:59:31.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:30 smithi084 ceph-mon[116404]: pgmap v3584: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 321 KiB/s rd, 21 KiB/s wr, 421 op/s 2024-01-13T18:59:31.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:30 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2597822493' entity='client.admin' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.84:0/850292556"}]': finished 2024-01-13T18:59:31.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:30 smithi084 ceph-mon[116404]: osdmap e2080: 8 total, 8 up, 8 in 2024-01-13T18:59:31.882 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestExclusiveLock.test_follower_flatten ... ok 2024-01-13T18:59:32.014 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestExclusiveLock.test_follower_resize ... ok 2024-01-13T18:59:32.048 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:31 smithi084 ceph-mon[116404]: osdmap e2081: 8 total, 8 up, 8 in 2024-01-13T18:59:32.048 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:31 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:59:32.048 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:31 smithi084 ceph-mon[119097]: osdmap e2081: 8 total, 8 up, 8 in 2024-01-13T18:59:32.048 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:31 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:59:32.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:31 smithi099 ceph-mon[138788]: osdmap e2081: 8 total, 8 up, 8 in 2024-01-13T18:59:32.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:31 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T18:59:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:32 smithi099 ceph-mon[138788]: pgmap v3587: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 105 KiB/s rd, 8.7 KiB/s wr, 143 op/s 2024-01-13T18:59:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:32 smithi099 ceph-mon[138788]: osdmap e2082: 8 total, 8 up, 8 in 2024-01-13T18:59:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:32 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:32 smithi084 ceph-mon[116404]: pgmap v3587: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 105 KiB/s rd, 8.7 KiB/s wr, 143 op/s 2024-01-13T18:59:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:32 smithi084 ceph-mon[116404]: osdmap e2082: 8 total, 8 up, 8 in 2024-01-13T18:59:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:33.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:32 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:32 smithi084 ceph-mon[119097]: pgmap v3587: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 105 KiB/s rd, 8.7 KiB/s wr, 143 op/s 2024-01-13T18:59:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:32 smithi084 ceph-mon[119097]: osdmap e2082: 8 total, 8 up, 8 in 2024-01-13T18:59:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:32 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[116404]: pgmap v3589: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 302 KiB/s rd, 17 KiB/s wr, 409 op/s 2024-01-13T18:59:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:59:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:59:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[116404]: osdmap e2083: 8 total, 8 up, 8 in 2024-01-13T18:59:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[119097]: pgmap v3589: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 302 KiB/s rd, 17 KiB/s wr, 409 op/s 2024-01-13T18:59:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:59:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:59:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:33 smithi084 ceph-mon[119097]: osdmap e2083: 8 total, 8 up, 8 in 2024-01-13T18:59:34.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:33 smithi099 ceph-mon[138788]: pgmap v3589: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 302 KiB/s rd, 17 KiB/s wr, 409 op/s 2024-01-13T18:59:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T18:59:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T18:59:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T18:59:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:33 smithi099 ceph-mon[138788]: osdmap e2083: 8 total, 8 up, 8 in 2024-01-13T18:59:34.828 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestExclusiveLock.test_follower_snap_create ... ok 2024-01-13T18:59:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:35 smithi099 ceph-mon[138788]: osdmap e2084: 8 total, 8 up, 8 in 2024-01-13T18:59:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:35 smithi084 ceph-mon[116404]: osdmap e2084: 8 total, 8 up, 8 in 2024-01-13T18:59:36.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:35 smithi084 ceph-mon[119097]: osdmap e2084: 8 total, 8 up, 8 in 2024-01-13T18:59:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:36.851 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestExclusiveLock.test_follower_snap_rollback ... ok 2024-01-13T18:59:36.972 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestExclusiveLock.test_follower_write ... ok 2024-01-13T18:59:37.080 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestExclusiveLock.test_ownership ... ok 2024-01-13T18:59:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:36 smithi099 ceph-mon[138788]: pgmap v3592: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 378 KiB/s rd, 23 KiB/s wr, 518 op/s 2024-01-13T18:59:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:36 smithi099 ceph-mon[138788]: osdmap e2085: 8 total, 8 up, 8 in 2024-01-13T18:59:37.161 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestExclusiveLock.test_read_only_leadership ... ok 2024-01-13T18:59:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:36 smithi084 ceph-mon[116404]: pgmap v3592: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 378 KiB/s rd, 23 KiB/s wr, 518 op/s 2024-01-13T18:59:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:36 smithi084 ceph-mon[116404]: osdmap e2085: 8 total, 8 up, 8 in 2024-01-13T18:59:37.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:36 smithi084 ceph-mon[119097]: pgmap v3592: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 378 KiB/s rd, 23 KiB/s wr, 518 op/s 2024-01-13T18:59:37.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:36 smithi084 ceph-mon[119097]: osdmap e2085: 8 total, 8 up, 8 in 2024-01-13T18:59:38.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:37 smithi099 ceph-mon[138788]: osdmap e2086: 8 total, 8 up, 8 in 2024-01-13T18:59:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:37 smithi084 ceph-mon[116404]: osdmap e2086: 8 total, 8 up, 8 in 2024-01-13T18:59:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:37 smithi084 ceph-mon[119097]: osdmap e2086: 8 total, 8 up, 8 in 2024-01-13T18:59:38.845 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestExclusiveLock.test_snapshot_leadership ... ok 2024-01-13T18:59:38.930 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_image_add ... ok 2024-01-13T18:59:39.014 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_image_list ... ok 2024-01-13T18:59:39.085 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_image_list_empty ... ok 2024-01-13T18:59:39.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:38 smithi099 ceph-mon[138788]: pgmap v3595: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 214 KiB/s rd, 18 KiB/s wr, 295 op/s 2024-01-13T18:59:39.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:38 smithi099 ceph-mon[138788]: osdmap e2087: 8 total, 8 up, 8 in 2024-01-13T18:59:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:38 smithi099 ceph-mon[138788]: osdmap e2088: 8 total, 8 up, 8 in 2024-01-13T18:59:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:38 smithi084 ceph-mon[116404]: pgmap v3595: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 214 KiB/s rd, 18 KiB/s wr, 295 op/s 2024-01-13T18:59:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:38 smithi084 ceph-mon[116404]: osdmap e2087: 8 total, 8 up, 8 in 2024-01-13T18:59:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:38 smithi084 ceph-mon[116404]: osdmap e2088: 8 total, 8 up, 8 in 2024-01-13T18:59:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:38 smithi084 ceph-mon[119097]: pgmap v3595: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 214 KiB/s rd, 18 KiB/s wr, 295 op/s 2024-01-13T18:59:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:38 smithi084 ceph-mon[119097]: osdmap e2087: 8 total, 8 up, 8 in 2024-01-13T18:59:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:38 smithi084 ceph-mon[119097]: osdmap e2088: 8 total, 8 up, 8 in 2024-01-13T18:59:39.199 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_image_list_move_to_trash ... ok 2024-01-13T18:59:40.658 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_image_many_images ... ok 2024-01-13T18:59:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:59:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:59:40] "GET /metrics HTTP/1.1" 200 36527 "" "Prometheus/2.43.0" 2024-01-13T18:59:40.762 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_image_remove ... ok 2024-01-13T18:59:40.843 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_snap ... ok 2024-01-13T18:59:40.933 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_snap_flags ... ok 2024-01-13T18:59:41.090 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_snap_list_many ... ok 2024-01-13T18:59:41.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:40 smithi099 ceph-mon[138788]: pgmap v3598: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 138 KiB/s rd, 13 KiB/s wr, 191 op/s 2024-01-13T18:59:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:40 smithi084 ceph-mon[116404]: pgmap v3598: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 138 KiB/s rd, 13 KiB/s wr, 191 op/s 2024-01-13T18:59:41.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:40 smithi084 ceph-mon[119097]: pgmap v3598: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 138 KiB/s rd, 13 KiB/s wr, 191 op/s 2024-01-13T18:59:42.863 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_snap_namespace ... ok 2024-01-13T18:59:42.951 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_snap_rename ... ok 2024-01-13T18:59:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:42 smithi099 ceph-mon[138788]: pgmap v3599: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 180 KiB/s rd, 16 KiB/s wr, 247 op/s 2024-01-13T18:59:43.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:42 smithi099 ceph-mon[138788]: osdmap e2089: 8 total, 8 up, 8 in 2024-01-13T18:59:43.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:42 smithi084 ceph-mon[116404]: pgmap v3599: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 180 KiB/s rd, 16 KiB/s wr, 247 op/s 2024-01-13T18:59:43.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:42 smithi084 ceph-mon[116404]: osdmap e2089: 8 total, 8 up, 8 in 2024-01-13T18:59:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:42 smithi084 ceph-mon[119097]: pgmap v3599: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 180 KiB/s rd, 16 KiB/s wr, 247 op/s 2024-01-13T18:59:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:42 smithi084 ceph-mon[119097]: osdmap e2089: 8 total, 8 up, 8 in 2024-01-13T18:59:44.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:43 smithi099 ceph-mon[138788]: osdmap e2090: 8 total, 8 up, 8 in 2024-01-13T18:59:44.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:43 smithi099 ceph-mon[138788]: osdmap e2091: 8 total, 8 up, 8 in 2024-01-13T18:59:44.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:43 smithi084 ceph-mon[119097]: osdmap e2090: 8 total, 8 up, 8 in 2024-01-13T18:59:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:43 smithi084 ceph-mon[119097]: osdmap e2091: 8 total, 8 up, 8 in 2024-01-13T18:59:44.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:43 smithi084 ceph-mon[116404]: osdmap e2090: 8 total, 8 up, 8 in 2024-01-13T18:59:44.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:43 smithi084 ceph-mon[116404]: osdmap e2091: 8 total, 8 up, 8 in 2024-01-13T18:59:44.873 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestGroups.test_group_snap_rollback ... ok 2024-01-13T18:59:44.945 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_access_timestamp ... ok 2024-01-13T18:59:45.027 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_aio_discard ... ok 2024-01-13T18:59:45.103 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_aio_flush ... ok 2024-01-13T18:59:45.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:44 smithi099 ceph-mon[138788]: pgmap v3602: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 692 KiB/s rd, 73 KiB/s wr, 987 op/s 2024-01-13T18:59:45.171 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_aio_read ... ok 2024-01-13T18:59:45.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:44 smithi084 ceph-mon[116404]: pgmap v3602: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 692 KiB/s rd, 73 KiB/s wr, 987 op/s 2024-01-13T18:59:45.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:44 smithi084 ceph-mon[119097]: pgmap v3602: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 692 KiB/s rd, 73 KiB/s wr, 987 op/s 2024-01-13T18:59:45.260 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_aio_write ... ok 2024-01-13T18:59:45.344 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_aio_write_zeroes ... ok 2024-01-13T18:59:45.415 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_block_name_prefix ... ok 2024-01-13T18:59:45.523 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_config_list ... ok 2024-01-13T18:59:45.719 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_copy ... ok 2024-01-13T18:59:45.904 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_copy2 ... ok 2024-01-13T18:59:45.974 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_copy3 ... SKIP 2024-01-13T18:59:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:45 smithi099 ceph-mon[138788]: osdmap e2092: 8 total, 8 up, 8 in 2024-01-13T18:59:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:45 smithi084 ceph-mon[116404]: osdmap e2092: 8 total, 8 up, 8 in 2024-01-13T18:59:46.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:45 smithi084 ceph-mon[119097]: osdmap e2092: 8 total, 8 up, 8 in 2024-01-13T18:59:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:46 smithi099 ceph-mon[138788]: pgmap v3605: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 119 KiB/s wr, 1.56k op/s 2024-01-13T18:59:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:46 smithi084 ceph-mon[116404]: pgmap v3605: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 119 KiB/s wr, 1.56k op/s 2024-01-13T18:59:47.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:46 smithi084 ceph-mon[119097]: pgmap v3605: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 119 KiB/s wr, 1.56k op/s 2024-01-13T18:59:47.901 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_create_snap ... ok 2024-01-13T18:59:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:47 smithi099 ceph-mon[138788]: osdmap e2093: 8 total, 8 up, 8 in 2024-01-13T18:59:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:47 smithi084 ceph-mon[116404]: osdmap e2093: 8 total, 8 up, 8 in 2024-01-13T18:59:48.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:47 smithi084 ceph-mon[119097]: osdmap e2093: 8 total, 8 up, 8 in 2024-01-13T18:59:49.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:48 smithi099 ceph-mon[138788]: pgmap v3607: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 718 KiB/s rd, 58 KiB/s wr, 987 op/s 2024-01-13T18:59:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:48 smithi099 ceph-mon[138788]: osdmap e2094: 8 total, 8 up, 8 in 2024-01-13T18:59:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:48 smithi099 ceph-mon[138788]: osdmap e2095: 8 total, 8 up, 8 in 2024-01-13T18:59:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:48 smithi084 ceph-mon[116404]: pgmap v3607: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 718 KiB/s rd, 58 KiB/s wr, 987 op/s 2024-01-13T18:59:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:48 smithi084 ceph-mon[116404]: osdmap e2094: 8 total, 8 up, 8 in 2024-01-13T18:59:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:48 smithi084 ceph-mon[116404]: osdmap e2095: 8 total, 8 up, 8 in 2024-01-13T18:59:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:48 smithi084 ceph-mon[119097]: pgmap v3607: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 718 KiB/s rd, 58 KiB/s wr, 987 op/s 2024-01-13T18:59:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:48 smithi084 ceph-mon[119097]: osdmap e2094: 8 total, 8 up, 8 in 2024-01-13T18:59:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:48 smithi084 ceph-mon[119097]: osdmap e2095: 8 total, 8 up, 8 in 2024-01-13T18:59:49.835 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_create_snap_exists ... ok 2024-01-13T18:59:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 18:59:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:18:59:50] "GET /metrics HTTP/1.1" 200 36525 "" "Prometheus/2.43.0" 2024-01-13T18:59:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:50 smithi099 ceph-mon[138788]: pgmap v3610: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 542 KiB/s rd, 2.0 MiB/s wr, 761 op/s 2024-01-13T18:59:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:50 smithi099 ceph-mon[138788]: osdmap e2096: 8 total, 8 up, 8 in 2024-01-13T18:59:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:51.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:50 smithi084 ceph-mon[119097]: pgmap v3610: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 542 KiB/s rd, 2.0 MiB/s wr, 761 op/s 2024-01-13T18:59:51.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:50 smithi084 ceph-mon[119097]: osdmap e2096: 8 total, 8 up, 8 in 2024-01-13T18:59:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:50 smithi084 ceph-mon[116404]: pgmap v3610: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 542 KiB/s rd, 2.0 MiB/s wr, 761 op/s 2024-01-13T18:59:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:50 smithi084 ceph-mon[116404]: osdmap e2096: 8 total, 8 up, 8 in 2024-01-13T18:59:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T18:59:52.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:51 smithi099 ceph-mon[138788]: osdmap e2097: 8 total, 8 up, 8 in 2024-01-13T18:59:52.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:51 smithi099 ceph-mon[138788]: pgmap v3613: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 247 KiB/s rd, 2.0 MiB/s wr, 364 op/s 2024-01-13T18:59:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:51 smithi084 ceph-mon[116404]: osdmap e2097: 8 total, 8 up, 8 in 2024-01-13T18:59:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:51 smithi084 ceph-mon[116404]: pgmap v3613: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 247 KiB/s rd, 2.0 MiB/s wr, 364 op/s 2024-01-13T18:59:52.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:51 smithi084 ceph-mon[119097]: osdmap e2097: 8 total, 8 up, 8 in 2024-01-13T18:59:52.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:51 smithi084 ceph-mon[119097]: pgmap v3613: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 247 KiB/s rd, 2.0 MiB/s wr, 364 op/s 2024-01-13T18:59:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:52 smithi099 ceph-mon[138788]: osdmap e2098: 8 total, 8 up, 8 in 2024-01-13T18:59:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:52 smithi084 ceph-mon[116404]: osdmap e2098: 8 total, 8 up, 8 in 2024-01-13T18:59:53.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:52 smithi084 ceph-mon[119097]: osdmap e2098: 8 total, 8 up, 8 in 2024-01-13T18:59:54.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:53 smithi099 ceph-mon[138788]: osdmap e2099: 8 total, 8 up, 8 in 2024-01-13T18:59:54.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:53 smithi099 ceph-mon[138788]: pgmap v3616: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 167 KiB/s rd, 9.7 KiB/s wr, 224 op/s 2024-01-13T18:59:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:53 smithi099 ceph-mon[138788]: osdmap e2100: 8 total, 8 up, 8 in 2024-01-13T18:59:54.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:53 smithi084 ceph-mon[119097]: osdmap e2099: 8 total, 8 up, 8 in 2024-01-13T18:59:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:53 smithi084 ceph-mon[119097]: pgmap v3616: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 167 KiB/s rd, 9.7 KiB/s wr, 224 op/s 2024-01-13T18:59:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:53 smithi084 ceph-mon[119097]: osdmap e2100: 8 total, 8 up, 8 in 2024-01-13T18:59:54.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:53 smithi084 ceph-mon[116404]: osdmap e2099: 8 total, 8 up, 8 in 2024-01-13T18:59:54.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:53 smithi084 ceph-mon[116404]: pgmap v3616: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 167 KiB/s rd, 9.7 KiB/s wr, 224 op/s 2024-01-13T18:59:54.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:53 smithi084 ceph-mon[116404]: osdmap e2100: 8 total, 8 up, 8 in 2024-01-13T18:59:55.841 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_create_snap_flags ... ok 2024-01-13T18:59:55.920 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_create_timestamp ... ok 2024-01-13T18:59:55.991 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_create_with_params ... SKIP 2024-01-13T18:59:56.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:55 smithi099 ceph-mon[138788]: osdmap e2101: 8 total, 8 up, 8 in 2024-01-13T18:59:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:55 smithi084 ceph-mon[116404]: osdmap e2101: 8 total, 8 up, 8 in 2024-01-13T18:59:56.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:55 smithi084 ceph-mon[119097]: osdmap e2101: 8 total, 8 up, 8 in 2024-01-13T18:59:57.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:56 smithi099 ceph-mon[138788]: pgmap v3619: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 121 KiB/s rd, 10 KiB/s wr, 164 op/s 2024-01-13T18:59:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:56 smithi099 ceph-mon[138788]: osdmap e2102: 8 total, 8 up, 8 in 2024-01-13T18:59:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:56 smithi084 ceph-mon[116404]: pgmap v3619: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 121 KiB/s rd, 10 KiB/s wr, 164 op/s 2024-01-13T18:59:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:56 smithi084 ceph-mon[116404]: osdmap e2102: 8 total, 8 up, 8 in 2024-01-13T18:59:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:56 smithi084 ceph-mon[119097]: pgmap v3619: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 121 KiB/s rd, 10 KiB/s wr, 164 op/s 2024-01-13T18:59:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:56 smithi084 ceph-mon[119097]: osdmap e2102: 8 total, 8 up, 8 in 2024-01-13T18:59:58.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:57 smithi099 ceph-mon[138788]: osdmap e2103: 8 total, 8 up, 8 in 2024-01-13T18:59:58.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:57 smithi084 ceph-mon[119097]: osdmap e2103: 8 total, 8 up, 8 in 2024-01-13T18:59:58.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:57 smithi084 ceph-mon[116404]: osdmap e2103: 8 total, 8 up, 8 in 2024-01-13T18:59:59.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:58 smithi099 ceph-mon[138788]: pgmap v3622: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 110 KiB/s rd, 7.0 KiB/s wr, 145 op/s 2024-01-13T18:59:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:58 smithi099 ceph-mon[138788]: osdmap e2104: 8 total, 8 up, 8 in 2024-01-13T18:59:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 18:59:58 smithi099 ceph-mon[138788]: osdmap e2105: 8 total, 8 up, 8 in 2024-01-13T18:59:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:58 smithi084 ceph-mon[116404]: pgmap v3622: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 110 KiB/s rd, 7.0 KiB/s wr, 145 op/s 2024-01-13T18:59:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:58 smithi084 ceph-mon[116404]: osdmap e2104: 8 total, 8 up, 8 in 2024-01-13T18:59:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 18:59:58 smithi084 ceph-mon[116404]: osdmap e2105: 8 total, 8 up, 8 in 2024-01-13T18:59:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:58 smithi084 ceph-mon[119097]: pgmap v3622: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 110 KiB/s rd, 7.0 KiB/s wr, 145 op/s 2024-01-13T18:59:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:58 smithi084 ceph-mon[119097]: osdmap e2104: 8 total, 8 up, 8 in 2024-01-13T18:59:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 18:59:58 smithi084 ceph-mon[119097]: osdmap e2105: 8 total, 8 up, 8 in 2024-01-13T18:59:59.947 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_deep_copy ... ok 2024-01-13T19:00:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:00:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:00:00] "GET /metrics HTTP/1.1" 200 36525 "" "Prometheus/2.43.0" 2024-01-13T19:00:01.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:00 smithi099 ceph-mon[138788]: pgmap v3625: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 122 KiB/s rd, 10 KiB/s wr, 172 op/s 2024-01-13T19:00:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:00 smithi099 ceph-mon[138788]: osdmap e2106: 8 total, 8 up, 8 in 2024-01-13T19:00:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:00 smithi099 ceph-mon[138788]: overall HEALTH_OK 2024-01-13T19:00:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:00 smithi084 ceph-mon[116404]: pgmap v3625: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 122 KiB/s rd, 10 KiB/s wr, 172 op/s 2024-01-13T19:00:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:00 smithi084 ceph-mon[116404]: osdmap e2106: 8 total, 8 up, 8 in 2024-01-13T19:00:01.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:00 smithi084 ceph-mon[116404]: overall HEALTH_OK 2024-01-13T19:00:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:00 smithi084 ceph-mon[119097]: pgmap v3625: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 122 KiB/s rd, 10 KiB/s wr, 172 op/s 2024-01-13T19:00:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:00 smithi084 ceph-mon[119097]: osdmap e2106: 8 total, 8 up, 8 in 2024-01-13T19:00:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:00 smithi084 ceph-mon[119097]: overall HEALTH_OK 2024-01-13T19:00:02.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:01 smithi099 ceph-mon[138788]: osdmap e2107: 8 total, 8 up, 8 in 2024-01-13T19:00:02.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:01 smithi084 ceph-mon[116404]: osdmap e2107: 8 total, 8 up, 8 in 2024-01-13T19:00:02.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:01 smithi084 ceph-mon[119097]: osdmap e2107: 8 total, 8 up, 8 in 2024-01-13T19:00:03.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:02 smithi099 ceph-mon[138788]: pgmap v3628: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 53 KiB/s rd, 8.7 KiB/s wr, 85 op/s 2024-01-13T19:00:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:02 smithi099 ceph-mon[138788]: osdmap e2108: 8 total, 8 up, 8 in 2024-01-13T19:00:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:02 smithi084 ceph-mon[116404]: pgmap v3628: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 53 KiB/s rd, 8.7 KiB/s wr, 85 op/s 2024-01-13T19:00:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:02 smithi084 ceph-mon[116404]: osdmap e2108: 8 total, 8 up, 8 in 2024-01-13T19:00:03.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:02 smithi084 ceph-mon[119097]: pgmap v3628: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 53 KiB/s rd, 8.7 KiB/s wr, 85 op/s 2024-01-13T19:00:03.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:02 smithi084 ceph-mon[119097]: osdmap e2108: 8 total, 8 up, 8 in 2024-01-13T19:00:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:03 smithi099 ceph-mon[138788]: osdmap e2109: 8 total, 8 up, 8 in 2024-01-13T19:00:04.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:03 smithi099 ceph-mon[138788]: osdmap e2110: 8 total, 8 up, 8 in 2024-01-13T19:00:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:03 smithi084 ceph-mon[116404]: osdmap e2109: 8 total, 8 up, 8 in 2024-01-13T19:00:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:03 smithi084 ceph-mon[116404]: osdmap e2110: 8 total, 8 up, 8 in 2024-01-13T19:00:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:03 smithi084 ceph-mon[119097]: osdmap e2109: 8 total, 8 up, 8 in 2024-01-13T19:00:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:03 smithi084 ceph-mon[119097]: osdmap e2110: 8 total, 8 up, 8 in 2024-01-13T19:00:05.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:04 smithi099 ceph-mon[138788]: pgmap v3631: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 136 KiB/s rd, 9.0 KiB/s wr, 179 op/s 2024-01-13T19:00:05.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:04 smithi084 ceph-mon[116404]: pgmap v3631: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 136 KiB/s rd, 9.0 KiB/s wr, 179 op/s 2024-01-13T19:00:05.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:04 smithi084 ceph-mon[119097]: pgmap v3631: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 136 KiB/s rd, 9.0 KiB/s wr, 179 op/s 2024-01-13T19:00:05.905 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_deep_copy_clone ... ok 2024-01-13T19:00:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:05 smithi099 ceph-mon[138788]: osdmap e2111: 8 total, 8 up, 8 in 2024-01-13T19:00:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:05 smithi099 ceph-mon[138788]: pgmap v3634: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 169 KiB/s rd, 14 KiB/s wr, 231 op/s 2024-01-13T19:00:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:05 smithi084 ceph-mon[116404]: osdmap e2111: 8 total, 8 up, 8 in 2024-01-13T19:00:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:05 smithi084 ceph-mon[116404]: pgmap v3634: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 169 KiB/s rd, 14 KiB/s wr, 231 op/s 2024-01-13T19:00:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:05 smithi084 ceph-mon[119097]: osdmap e2111: 8 total, 8 up, 8 in 2024-01-13T19:00:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:05 smithi084 ceph-mon[119097]: pgmap v3634: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 169 KiB/s rd, 14 KiB/s wr, 231 op/s 2024-01-13T19:00:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:06 smithi099 ceph-mon[138788]: osdmap e2112: 8 total, 8 up, 8 in 2024-01-13T19:00:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:06 smithi084 ceph-mon[116404]: osdmap e2112: 8 total, 8 up, 8 in 2024-01-13T19:00:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:06 smithi084 ceph-mon[119097]: osdmap e2112: 8 total, 8 up, 8 in 2024-01-13T19:00:07.875 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_diff_iterate ... FAIL 2024-01-13T19:00:07.875 INFO:tasks.workunit.client.0.smithi084.stderr:ERROR 2024-01-13T19:00:08.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:07 smithi099 ceph-mon[138788]: osdmap e2113: 8 total, 8 up, 8 in 2024-01-13T19:00:08.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:07 smithi099 ceph-mon[138788]: pgmap v3637: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 132 KiB/s rd, 13 KiB/s wr, 183 op/s 2024-01-13T19:00:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:07 smithi084 ceph-mon[116404]: osdmap e2113: 8 total, 8 up, 8 in 2024-01-13T19:00:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:07 smithi084 ceph-mon[116404]: pgmap v3637: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 132 KiB/s rd, 13 KiB/s wr, 183 op/s 2024-01-13T19:00:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:07 smithi084 ceph-mon[119097]: osdmap e2113: 8 total, 8 up, 8 in 2024-01-13T19:00:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:07 smithi084 ceph-mon[119097]: pgmap v3637: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 132 KiB/s rd, 13 KiB/s wr, 183 op/s 2024-01-13T19:00:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:08 smithi099 ceph-mon[138788]: osdmap e2114: 8 total, 8 up, 8 in 2024-01-13T19:00:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:08 smithi099 ceph-mon[138788]: osdmap e2115: 8 total, 8 up, 8 in 2024-01-13T19:00:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:08 smithi084 ceph-mon[116404]: osdmap e2114: 8 total, 8 up, 8 in 2024-01-13T19:00:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:08 smithi084 ceph-mon[116404]: osdmap e2115: 8 total, 8 up, 8 in 2024-01-13T19:00:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:08 smithi084 ceph-mon[119097]: osdmap e2114: 8 total, 8 up, 8 in 2024-01-13T19:00:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:08 smithi084 ceph-mon[119097]: osdmap e2115: 8 total, 8 up, 8 in 2024-01-13T19:00:10.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:09 smithi099 ceph-mon[138788]: pgmap v3640: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 154 KiB/s rd, 13 KiB/s wr, 211 op/s 2024-01-13T19:00:10.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:09 smithi084 ceph-mon[116404]: pgmap v3640: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 154 KiB/s rd, 13 KiB/s wr, 211 op/s 2024-01-13T19:00:10.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:09 smithi084 ceph-mon[119097]: pgmap v3640: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 154 KiB/s rd, 13 KiB/s wr, 211 op/s 2024-01-13T19:00:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:00:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:00:10] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:00:12.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:11 smithi099 ceph-mon[138788]: pgmap v3641: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 135 KiB/s rd, 10 KiB/s wr, 182 op/s 2024-01-13T19:00:12.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:11 smithi084 ceph-mon[116404]: pgmap v3641: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 135 KiB/s rd, 10 KiB/s wr, 182 op/s 2024-01-13T19:00:12.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:11 smithi084 ceph-mon[119097]: pgmap v3641: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 135 KiB/s rd, 10 KiB/s wr, 182 op/s 2024-01-13T19:00:15.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:14 smithi099 ceph-mon[138788]: pgmap v3642: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 80 KiB/s rd, 7.4 KiB/s wr, 112 op/s 2024-01-13T19:00:15.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:14 smithi099 ceph-mon[138788]: osdmap e2116: 8 total, 8 up, 8 in 2024-01-13T19:00:15.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:14 smithi084 ceph-mon[116404]: pgmap v3642: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 80 KiB/s rd, 7.4 KiB/s wr, 112 op/s 2024-01-13T19:00:15.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:14 smithi084 ceph-mon[116404]: osdmap e2116: 8 total, 8 up, 8 in 2024-01-13T19:00:15.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:14 smithi084 ceph-mon[119097]: pgmap v3642: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 80 KiB/s rd, 7.4 KiB/s wr, 112 op/s 2024-01-13T19:00:15.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:14 smithi084 ceph-mon[119097]: osdmap e2116: 8 total, 8 up, 8 in 2024-01-13T19:00:15.324 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_encryption_luks1 ... ok 2024-01-13T19:00:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:16 smithi099 ceph-mon[138788]: pgmap v3644: 137 pgs: 137 active+clean; 8.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 132 KiB/s rd, 579 KiB/s wr, 68 op/s 2024-01-13T19:00:17.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:16 smithi084 ceph-mon[116404]: pgmap v3644: 137 pgs: 137 active+clean; 8.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 132 KiB/s rd, 579 KiB/s wr, 68 op/s 2024-01-13T19:00:17.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:16 smithi084 ceph-mon[119097]: pgmap v3644: 137 pgs: 137 active+clean; 8.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 132 KiB/s rd, 579 KiB/s wr, 68 op/s 2024-01-13T19:00:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:18 smithi099 ceph-mon[138788]: pgmap v3645: 137 pgs: 137 active+clean; 8.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 128 KiB/s rd, 504 KiB/s wr, 79 op/s 2024-01-13T19:00:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:18 smithi084 ceph-mon[116404]: pgmap v3645: 137 pgs: 137 active+clean; 8.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 128 KiB/s rd, 504 KiB/s wr, 79 op/s 2024-01-13T19:00:19.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:18 smithi084 ceph-mon[119097]: pgmap v3645: 137 pgs: 137 active+clean; 8.6 MiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 128 KiB/s rd, 504 KiB/s wr, 79 op/s 2024-01-13T19:00:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:00:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:00:20] "GET /metrics HTTP/1.1" 200 36531 "" "Prometheus/2.43.0" 2024-01-13T19:00:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:20 smithi099 ceph-mon[138788]: pgmap v3646: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 93 KiB/s rd, 412 KiB/s wr, 49 op/s 2024-01-13T19:00:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:21.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:20 smithi084 ceph-mon[119097]: pgmap v3646: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 93 KiB/s rd, 412 KiB/s wr, 49 op/s 2024-01-13T19:00:21.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:21.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:20 smithi084 ceph-mon[116404]: pgmap v3646: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 93 KiB/s rd, 412 KiB/s wr, 49 op/s 2024-01-13T19:00:21.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:23.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:22 smithi099 ceph-mon[138788]: pgmap v3647: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 86 KiB/s rd, 412 KiB/s wr, 40 op/s 2024-01-13T19:00:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:22 smithi084 ceph-mon[116404]: pgmap v3647: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 86 KiB/s rd, 412 KiB/s wr, 40 op/s 2024-01-13T19:00:23.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:22 smithi084 ceph-mon[119097]: pgmap v3647: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 86 KiB/s rd, 412 KiB/s wr, 40 op/s 2024-01-13T19:00:25.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:24 smithi099 ceph-mon[138788]: pgmap v3648: 137 pgs: 137 active+clean; 17 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 115 KiB/s rd, 1.6 MiB/s wr, 40 op/s 2024-01-13T19:00:25.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:24 smithi084 ceph-mon[116404]: pgmap v3648: 137 pgs: 137 active+clean; 17 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 115 KiB/s rd, 1.6 MiB/s wr, 40 op/s 2024-01-13T19:00:25.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:24 smithi084 ceph-mon[119097]: pgmap v3648: 137 pgs: 137 active+clean; 17 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 115 KiB/s rd, 1.6 MiB/s wr, 40 op/s 2024-01-13T19:00:25.457 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_encryption_luks2 ... ok 2024-01-13T19:00:25.530 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_flags ... ok 2024-01-13T19:00:25.602 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_id ... ok 2024-01-13T19:00:25.679 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_image_auto_close ... ok 2024-01-13T19:00:25.778 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_image_config_set_and_get_and_remove ... ok 2024-01-13T19:00:25.869 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_invalidate_cache ... ok 2024-01-13T19:00:25.938 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_large_read ... ok 2024-01-13T19:00:26.075 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_large_write ... ok 2024-01-13T19:00:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:26 smithi099 ceph-mon[138788]: pgmap v3649: 137 pgs: 137 active+clean; 21 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 103 KiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-01-13T19:00:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:26 smithi084 ceph-mon[116404]: pgmap v3649: 137 pgs: 137 active+clean; 21 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 103 KiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-01-13T19:00:27.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:26 smithi084 ceph-mon[119097]: pgmap v3649: 137 pgs: 137 active+clean; 21 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 103 KiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-01-13T19:00:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:27 smithi099 ceph-mon[138788]: osdmap e2117: 8 total, 8 up, 8 in 2024-01-13T19:00:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:27 smithi084 ceph-mon[116404]: osdmap e2117: 8 total, 8 up, 8 in 2024-01-13T19:00:28.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:27 smithi084 ceph-mon[119097]: osdmap e2117: 8 total, 8 up, 8 in 2024-01-13T19:00:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:28 smithi099 ceph-mon[138788]: pgmap v3651: 137 pgs: 137 active+clean; 13 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 124 KiB/s rd, 2.4 MiB/s wr, 130 op/s 2024-01-13T19:00:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:28 smithi099 ceph-mon[138788]: osdmap e2118: 8 total, 8 up, 8 in 2024-01-13T19:00:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:28 smithi084 ceph-mon[116404]: pgmap v3651: 137 pgs: 137 active+clean; 13 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 124 KiB/s rd, 2.4 MiB/s wr, 130 op/s 2024-01-13T19:00:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:28 smithi084 ceph-mon[116404]: osdmap e2118: 8 total, 8 up, 8 in 2024-01-13T19:00:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:28 smithi084 ceph-mon[119097]: pgmap v3651: 137 pgs: 137 active+clean; 13 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 124 KiB/s rd, 2.4 MiB/s wr, 130 op/s 2024-01-13T19:00:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:28 smithi084 ceph-mon[119097]: osdmap e2118: 8 total, 8 up, 8 in 2024-01-13T19:00:30.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:29 smithi099 ceph-mon[138788]: osdmap e2119: 8 total, 8 up, 8 in 2024-01-13T19:00:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:29 smithi084 ceph-mon[116404]: osdmap e2119: 8 total, 8 up, 8 in 2024-01-13T19:00:30.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:29 smithi084 ceph-mon[119097]: osdmap e2119: 8 total, 8 up, 8 in 2024-01-13T19:00:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:00:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:00:30] "GET /metrics HTTP/1.1" 200 36531 "" "Prometheus/2.43.0" 2024-01-13T19:00:31.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:30 smithi099 ceph-mon[138788]: pgmap v3654: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 244 KiB/s rd, 2.0 MiB/s wr, 270 op/s 2024-01-13T19:00:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:30 smithi099 ceph-mon[138788]: osdmap e2120: 8 total, 8 up, 8 in 2024-01-13T19:00:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:30 smithi084 ceph-mon[116404]: pgmap v3654: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 244 KiB/s rd, 2.0 MiB/s wr, 270 op/s 2024-01-13T19:00:31.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:30 smithi084 ceph-mon[116404]: osdmap e2120: 8 total, 8 up, 8 in 2024-01-13T19:00:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:30 smithi084 ceph-mon[119097]: pgmap v3654: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 244 KiB/s rd, 2.0 MiB/s wr, 270 op/s 2024-01-13T19:00:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:30 smithi084 ceph-mon[119097]: osdmap e2120: 8 total, 8 up, 8 in 2024-01-13T19:00:32.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:31 smithi099 ceph-mon[138788]: osdmap e2121: 8 total, 8 up, 8 in 2024-01-13T19:00:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:31 smithi084 ceph-mon[116404]: osdmap e2121: 8 total, 8 up, 8 in 2024-01-13T19:00:32.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:31 smithi084 ceph-mon[119097]: osdmap e2121: 8 total, 8 up, 8 in 2024-01-13T19:00:33.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:32 smithi099 ceph-mon[138788]: pgmap v3657: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 181 KiB/s rd, 12 KiB/s wr, 157 op/s 2024-01-13T19:00:33.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:32 smithi099 ceph-mon[138788]: osdmap e2122: 8 total, 8 up, 8 in 2024-01-13T19:00:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:32 smithi084 ceph-mon[116404]: pgmap v3657: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 181 KiB/s rd, 12 KiB/s wr, 157 op/s 2024-01-13T19:00:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:32 smithi084 ceph-mon[116404]: osdmap e2122: 8 total, 8 up, 8 in 2024-01-13T19:00:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:32 smithi084 ceph-mon[119097]: pgmap v3657: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 181 KiB/s rd, 12 KiB/s wr, 157 op/s 2024-01-13T19:00:33.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:32 smithi084 ceph-mon[119097]: osdmap e2122: 8 total, 8 up, 8 in 2024-01-13T19:00:33.891 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_limit_snaps ... ok 2024-01-13T19:00:34.047 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_list_lockers ... ok 2024-01-13T19:00:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:33 smithi099 ceph-mon[138788]: osdmap e2123: 8 total, 8 up, 8 in 2024-01-13T19:00:34.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:33 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:00:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:33 smithi084 ceph-mon[116404]: osdmap e2123: 8 total, 8 up, 8 in 2024-01-13T19:00:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:33 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:00:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:33 smithi084 ceph-mon[119097]: osdmap e2123: 8 total, 8 up, 8 in 2024-01-13T19:00:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:33 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:00:35.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:34 smithi099 ceph-mon[138788]: pgmap v3660: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 23 KiB/s rd, 2.5 KiB/s wr, 34 op/s 2024-01-13T19:00:35.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:34 smithi099 ceph-mon[138788]: osdmap e2124: 8 total, 8 up, 8 in 2024-01-13T19:00:35.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:00:35.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:00:35.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:00:35.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:34 smithi084 ceph-mon[116404]: pgmap v3660: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 23 KiB/s rd, 2.5 KiB/s wr, 34 op/s 2024-01-13T19:00:35.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:34 smithi084 ceph-mon[116404]: osdmap e2124: 8 total, 8 up, 8 in 2024-01-13T19:00:35.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:00:35.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:00:35.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:00:35.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:34 smithi084 ceph-mon[119097]: pgmap v3660: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 23 KiB/s rd, 2.5 KiB/s wr, 34 op/s 2024-01-13T19:00:35.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:34 smithi084 ceph-mon[119097]: osdmap e2124: 8 total, 8 up, 8 in 2024-01-13T19:00:35.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:00:35.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:00:35.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:00:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:35 smithi084 ceph-mon[116404]: osdmap e2125: 8 total, 8 up, 8 in 2024-01-13T19:00:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:35 smithi084 ceph-mon[116404]: pgmap v3663: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 56 KiB/s rd, 4.2 KiB/s wr, 76 op/s 2024-01-13T19:00:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:35 smithi084 ceph-mon[119097]: osdmap e2125: 8 total, 8 up, 8 in 2024-01-13T19:00:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:35 smithi084 ceph-mon[119097]: pgmap v3663: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 56 KiB/s rd, 4.2 KiB/s wr, 76 op/s 2024-01-13T19:00:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:35 smithi099 ceph-mon[138788]: osdmap e2125: 8 total, 8 up, 8 in 2024-01-13T19:00:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:35 smithi099 ceph-mon[138788]: pgmap v3663: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 56 KiB/s rd, 4.2 KiB/s wr, 76 op/s 2024-01-13T19:00:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:36 smithi084 ceph-mon[116404]: osdmap e2126: 8 total, 8 up, 8 in 2024-01-13T19:00:37.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:36 smithi084 ceph-mon[119097]: osdmap e2126: 8 total, 8 up, 8 in 2024-01-13T19:00:37.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:36 smithi099 ceph-mon[138788]: osdmap e2126: 8 total, 8 up, 8 in 2024-01-13T19:00:37.983 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_list_snaps ... ok 2024-01-13T19:00:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:37 smithi084 ceph-mon[116404]: osdmap e2127: 8 total, 8 up, 8 in 2024-01-13T19:00:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:37 smithi084 ceph-mon[116404]: pgmap v3666: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 71 KiB/s rd, 4.7 KiB/s wr, 97 op/s 2024-01-13T19:00:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:37 smithi084 ceph-mon[119097]: osdmap e2127: 8 total, 8 up, 8 in 2024-01-13T19:00:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:37 smithi084 ceph-mon[119097]: pgmap v3666: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 71 KiB/s rd, 4.7 KiB/s wr, 97 op/s 2024-01-13T19:00:38.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:37 smithi099 ceph-mon[138788]: osdmap e2127: 8 total, 8 up, 8 in 2024-01-13T19:00:38.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:37 smithi099 ceph-mon[138788]: pgmap v3666: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 71 KiB/s rd, 4.7 KiB/s wr, 97 op/s 2024-01-13T19:00:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:38 smithi084 ceph-mon[116404]: osdmap e2128: 8 total, 8 up, 8 in 2024-01-13T19:00:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:38 smithi084 ceph-mon[116404]: osdmap e2129: 8 total, 8 up, 8 in 2024-01-13T19:00:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:38 smithi084 ceph-mon[119097]: osdmap e2128: 8 total, 8 up, 8 in 2024-01-13T19:00:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:38 smithi084 ceph-mon[119097]: osdmap e2129: 8 total, 8 up, 8 in 2024-01-13T19:00:39.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:38 smithi099 ceph-mon[138788]: osdmap e2128: 8 total, 8 up, 8 in 2024-01-13T19:00:39.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:38 smithi099 ceph-mon[138788]: osdmap e2129: 8 total, 8 up, 8 in 2024-01-13T19:00:39.858 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_list_snaps_iterator_auto_close ... ok 2024-01-13T19:00:39.951 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_lock_unlock ... ok 2024-01-13T19:00:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:00:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:00:40] "GET /metrics HTTP/1.1" 200 36529 "" "Prometheus/2.43.0" 2024-01-13T19:00:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:40 smithi099 ceph-mon[138788]: pgmap v3669: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 133 KiB/s rd, 4.2 KiB/s wr, 171 op/s 2024-01-13T19:00:41.119 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:40 smithi099 ceph-mon[138788]: osdmap e2130: 8 total, 8 up, 8 in 2024-01-13T19:00:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:40 smithi084 ceph-mon[116404]: pgmap v3669: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 133 KiB/s rd, 4.2 KiB/s wr, 171 op/s 2024-01-13T19:00:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:40 smithi084 ceph-mon[116404]: osdmap e2130: 8 total, 8 up, 8 in 2024-01-13T19:00:41.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:40 smithi084 ceph-mon[119097]: pgmap v3669: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 133 KiB/s rd, 4.2 KiB/s wr, 171 op/s 2024-01-13T19:00:41.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:40 smithi084 ceph-mon[119097]: osdmap e2130: 8 total, 8 up, 8 in 2024-01-13T19:00:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:41 smithi084 ceph-mon[116404]: osdmap e2131: 8 total, 8 up, 8 in 2024-01-13T19:00:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:41 smithi084 ceph-mon[116404]: pgmap v3672: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 160 KiB/s rd, 6.5 KiB/s wr, 203 op/s 2024-01-13T19:00:42.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:41 smithi084 ceph-mon[119097]: osdmap e2131: 8 total, 8 up, 8 in 2024-01-13T19:00:42.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:41 smithi084 ceph-mon[119097]: pgmap v3672: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 160 KiB/s rd, 6.5 KiB/s wr, 203 op/s 2024-01-13T19:00:42.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:41 smithi099 ceph-mon[138788]: osdmap e2131: 8 total, 8 up, 8 in 2024-01-13T19:00:42.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:41 smithi099 ceph-mon[138788]: pgmap v3672: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 160 KiB/s rd, 6.5 KiB/s wr, 203 op/s 2024-01-13T19:00:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:42 smithi084 ceph-mon[116404]: osdmap e2132: 8 total, 8 up, 8 in 2024-01-13T19:00:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:42 smithi084 ceph-mon[119097]: osdmap e2132: 8 total, 8 up, 8 in 2024-01-13T19:00:43.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:42 smithi099 ceph-mon[138788]: osdmap e2132: 8 total, 8 up, 8 in 2024-01-13T19:00:44.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:43 smithi099 ceph-mon[138788]: osdmap e2133: 8 total, 8 up, 8 in 2024-01-13T19:00:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:43 smithi099 ceph-mon[138788]: pgmap v3675: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 135 KiB/s rd, 8.2 KiB/s wr, 179 op/s 2024-01-13T19:00:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:43 smithi099 ceph-mon[138788]: osdmap e2134: 8 total, 8 up, 8 in 2024-01-13T19:00:44.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:43 smithi084 ceph-mon[116404]: osdmap e2133: 8 total, 8 up, 8 in 2024-01-13T19:00:44.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:43 smithi084 ceph-mon[116404]: pgmap v3675: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 135 KiB/s rd, 8.2 KiB/s wr, 179 op/s 2024-01-13T19:00:44.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:43 smithi084 ceph-mon[116404]: osdmap e2134: 8 total, 8 up, 8 in 2024-01-13T19:00:44.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:43 smithi084 ceph-mon[119097]: osdmap e2133: 8 total, 8 up, 8 in 2024-01-13T19:00:44.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:43 smithi084 ceph-mon[119097]: pgmap v3675: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 135 KiB/s rd, 8.2 KiB/s wr, 179 op/s 2024-01-13T19:00:44.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:43 smithi084 ceph-mon[119097]: osdmap e2134: 8 total, 8 up, 8 in 2024-01-13T19:00:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:45 smithi099 ceph-mon[138788]: osdmap e2135: 8 total, 8 up, 8 in 2024-01-13T19:00:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:45 smithi084 ceph-mon[116404]: osdmap e2135: 8 total, 8 up, 8 in 2024-01-13T19:00:46.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:45 smithi084 ceph-mon[119097]: osdmap e2135: 8 total, 8 up, 8 in 2024-01-13T19:00:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:46 smithi099 ceph-mon[138788]: pgmap v3678: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 97 KiB/s rd, 7.5 KiB/s wr, 134 op/s 2024-01-13T19:00:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:46 smithi099 ceph-mon[138788]: osdmap e2136: 8 total, 8 up, 8 in 2024-01-13T19:00:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:46 smithi084 ceph-mon[116404]: pgmap v3678: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 97 KiB/s rd, 7.5 KiB/s wr, 134 op/s 2024-01-13T19:00:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:46 smithi084 ceph-mon[116404]: osdmap e2136: 8 total, 8 up, 8 in 2024-01-13T19:00:47.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:46 smithi084 ceph-mon[119097]: pgmap v3678: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 97 KiB/s rd, 7.5 KiB/s wr, 134 op/s 2024-01-13T19:00:47.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:46 smithi084 ceph-mon[119097]: osdmap e2136: 8 total, 8 up, 8 in 2024-01-13T19:00:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:47 smithi099 ceph-mon[138788]: osdmap e2137: 8 total, 8 up, 8 in 2024-01-13T19:00:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:47 smithi084 ceph-mon[116404]: osdmap e2137: 8 total, 8 up, 8 in 2024-01-13T19:00:48.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:47 smithi084 ceph-mon[119097]: osdmap e2137: 8 total, 8 up, 8 in 2024-01-13T19:00:49.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:48 smithi099 ceph-mon[138788]: pgmap v3681: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 56 KiB/s rd, 5.5 KiB/s wr, 77 op/s 2024-01-13T19:00:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:48 smithi099 ceph-mon[138788]: osdmap e2138: 8 total, 8 up, 8 in 2024-01-13T19:00:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:48 smithi099 ceph-mon[138788]: osdmap e2139: 8 total, 8 up, 8 in 2024-01-13T19:00:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:48 smithi084 ceph-mon[116404]: pgmap v3681: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 56 KiB/s rd, 5.5 KiB/s wr, 77 op/s 2024-01-13T19:00:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:48 smithi084 ceph-mon[116404]: osdmap e2138: 8 total, 8 up, 8 in 2024-01-13T19:00:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:48 smithi084 ceph-mon[116404]: osdmap e2139: 8 total, 8 up, 8 in 2024-01-13T19:00:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:48 smithi084 ceph-mon[119097]: pgmap v3681: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 56 KiB/s rd, 5.5 KiB/s wr, 77 op/s 2024-01-13T19:00:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:48 smithi084 ceph-mon[119097]: osdmap e2138: 8 total, 8 up, 8 in 2024-01-13T19:00:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:48 smithi084 ceph-mon[119097]: osdmap e2139: 8 total, 8 up, 8 in 2024-01-13T19:00:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:00:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:00:50] "GET /metrics HTTP/1.1" 200 36532 "" "Prometheus/2.43.0" 2024-01-13T19:00:51.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:50 smithi099 ceph-mon[138788]: pgmap v3684: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 55 KiB/s rd, 3.5 KiB/s wr, 72 op/s 2024-01-13T19:00:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:50 smithi099 ceph-mon[138788]: osdmap e2140: 8 total, 8 up, 8 in 2024-01-13T19:00:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:50 smithi084 ceph-mon[116404]: pgmap v3684: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 55 KiB/s rd, 3.5 KiB/s wr, 72 op/s 2024-01-13T19:00:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:50 smithi084 ceph-mon[116404]: osdmap e2140: 8 total, 8 up, 8 in 2024-01-13T19:00:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:50 smithi084 ceph-mon[119097]: pgmap v3684: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 55 KiB/s rd, 3.5 KiB/s wr, 72 op/s 2024-01-13T19:00:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:50 smithi084 ceph-mon[119097]: osdmap e2140: 8 total, 8 up, 8 in 2024-01-13T19:00:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:00:52.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:51 smithi099 ceph-mon[138788]: osdmap e2141: 8 total, 8 up, 8 in 2024-01-13T19:00:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:51 smithi084 ceph-mon[116404]: osdmap e2141: 8 total, 8 up, 8 in 2024-01-13T19:00:52.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:51 smithi084 ceph-mon[119097]: osdmap e2141: 8 total, 8 up, 8 in 2024-01-13T19:00:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:52 smithi099 ceph-mon[138788]: pgmap v3687: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:00:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:52 smithi099 ceph-mon[138788]: osdmap e2142: 8 total, 8 up, 8 in 2024-01-13T19:00:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:52 smithi084 ceph-mon[116404]: pgmap v3687: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:00:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:52 smithi084 ceph-mon[116404]: osdmap e2142: 8 total, 8 up, 8 in 2024-01-13T19:00:53.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:52 smithi084 ceph-mon[119097]: pgmap v3687: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:00:53.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:52 smithi084 ceph-mon[119097]: osdmap e2142: 8 total, 8 up, 8 in 2024-01-13T19:00:54.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:53 smithi099 ceph-mon[138788]: osdmap e2143: 8 total, 8 up, 8 in 2024-01-13T19:00:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:53 smithi099 ceph-mon[138788]: pgmap v3690: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 86 KiB/s rd, 3.2 KiB/s wr, 115 op/s 2024-01-13T19:00:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:53 smithi084 ceph-mon[116404]: osdmap e2143: 8 total, 8 up, 8 in 2024-01-13T19:00:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:53 smithi084 ceph-mon[116404]: pgmap v3690: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 86 KiB/s rd, 3.2 KiB/s wr, 115 op/s 2024-01-13T19:00:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:53 smithi084 ceph-mon[119097]: osdmap e2143: 8 total, 8 up, 8 in 2024-01-13T19:00:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:53 smithi084 ceph-mon[119097]: pgmap v3690: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 86 KiB/s rd, 3.2 KiB/s wr, 115 op/s 2024-01-13T19:00:55.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:54 smithi099 ceph-mon[138788]: osdmap e2144: 8 total, 8 up, 8 in 2024-01-13T19:00:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:54 smithi084 ceph-mon[116404]: osdmap e2144: 8 total, 8 up, 8 in 2024-01-13T19:00:55.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:54 smithi084 ceph-mon[119097]: osdmap e2144: 8 total, 8 up, 8 in 2024-01-13T19:00:56.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:55 smithi099 ceph-mon[138788]: osdmap e2145: 8 total, 8 up, 8 in 2024-01-13T19:00:56.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:55 smithi099 ceph-mon[138788]: pgmap v3693: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 86 KiB/s rd, 3.5 KiB/s wr, 115 op/s 2024-01-13T19:00:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:55 smithi084 ceph-mon[116404]: osdmap e2145: 8 total, 8 up, 8 in 2024-01-13T19:00:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:55 smithi084 ceph-mon[116404]: pgmap v3693: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 86 KiB/s rd, 3.5 KiB/s wr, 115 op/s 2024-01-13T19:00:56.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:55 smithi084 ceph-mon[119097]: osdmap e2145: 8 total, 8 up, 8 in 2024-01-13T19:00:56.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:55 smithi084 ceph-mon[119097]: pgmap v3693: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 86 KiB/s rd, 3.5 KiB/s wr, 115 op/s 2024-01-13T19:00:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:56 smithi099 ceph-mon[138788]: osdmap e2146: 8 total, 8 up, 8 in 2024-01-13T19:00:57.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:56 smithi084 ceph-mon[119097]: osdmap e2146: 8 total, 8 up, 8 in 2024-01-13T19:00:57.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:56 smithi084 ceph-mon[116404]: osdmap e2146: 8 total, 8 up, 8 in 2024-01-13T19:00:58.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:57 smithi099 ceph-mon[138788]: osdmap e2147: 8 total, 8 up, 8 in 2024-01-13T19:00:58.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:57 smithi099 ceph-mon[138788]: pgmap v3696: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 116 KiB/s rd, 3.7 KiB/s wr, 154 op/s 2024-01-13T19:00:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:57 smithi084 ceph-mon[116404]: osdmap e2147: 8 total, 8 up, 8 in 2024-01-13T19:00:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:57 smithi084 ceph-mon[116404]: pgmap v3696: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 116 KiB/s rd, 3.7 KiB/s wr, 154 op/s 2024-01-13T19:00:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:57 smithi084 ceph-mon[119097]: osdmap e2147: 8 total, 8 up, 8 in 2024-01-13T19:00:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:57 smithi084 ceph-mon[119097]: pgmap v3696: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 116 KiB/s rd, 3.7 KiB/s wr, 154 op/s 2024-01-13T19:00:59.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:58 smithi099 ceph-mon[138788]: osdmap e2148: 8 total, 8 up, 8 in 2024-01-13T19:00:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:58 smithi084 ceph-mon[116404]: osdmap e2148: 8 total, 8 up, 8 in 2024-01-13T19:00:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:58 smithi084 ceph-mon[119097]: osdmap e2148: 8 total, 8 up, 8 in 2024-01-13T19:01:00.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:59 smithi099 ceph-mon[138788]: osdmap e2149: 8 total, 8 up, 8 in 2024-01-13T19:01:00.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:00:59 smithi099 ceph-mon[138788]: pgmap v3699: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 120 KiB/s rd, 3.5 KiB/s wr, 159 op/s 2024-01-13T19:01:00.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:59 smithi084 ceph-mon[116404]: osdmap e2149: 8 total, 8 up, 8 in 2024-01-13T19:01:00.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:00:59 smithi084 ceph-mon[116404]: pgmap v3699: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 120 KiB/s rd, 3.5 KiB/s wr, 159 op/s 2024-01-13T19:01:00.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:59 smithi084 ceph-mon[119097]: osdmap e2149: 8 total, 8 up, 8 in 2024-01-13T19:01:00.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:00:59 smithi084 ceph-mon[119097]: pgmap v3699: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 120 KiB/s rd, 3.5 KiB/s wr, 159 op/s 2024-01-13T19:01:00.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:01:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:01:00] "GET /metrics HTTP/1.1" 200 36532 "" "Prometheus/2.43.0" 2024-01-13T19:01:01.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:00 smithi099 ceph-mon[138788]: osdmap e2150: 8 total, 8 up, 8 in 2024-01-13T19:01:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:00 smithi084 ceph-mon[116404]: osdmap e2150: 8 total, 8 up, 8 in 2024-01-13T19:01:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:00 smithi084 ceph-mon[119097]: osdmap e2150: 8 total, 8 up, 8 in 2024-01-13T19:01:02.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:01 smithi084 ceph-mon[116404]: osdmap e2151: 8 total, 8 up, 8 in 2024-01-13T19:01:02.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:01 smithi084 ceph-mon[116404]: pgmap v3702: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:02.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:01 smithi084 ceph-mon[119097]: osdmap e2151: 8 total, 8 up, 8 in 2024-01-13T19:01:02.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:01 smithi084 ceph-mon[119097]: pgmap v3702: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:02.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:01 smithi099 ceph-mon[138788]: osdmap e2151: 8 total, 8 up, 8 in 2024-01-13T19:01:02.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:01 smithi099 ceph-mon[138788]: pgmap v3702: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:02 smithi084 ceph-mon[116404]: osdmap e2152: 8 total, 8 up, 8 in 2024-01-13T19:01:03.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:02 smithi084 ceph-mon[119097]: osdmap e2152: 8 total, 8 up, 8 in 2024-01-13T19:01:03.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:02 smithi099 ceph-mon[138788]: osdmap e2152: 8 total, 8 up, 8 in 2024-01-13T19:01:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:03 smithi084 ceph-mon[116404]: osdmap e2153: 8 total, 8 up, 8 in 2024-01-13T19:01:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:03 smithi084 ceph-mon[116404]: pgmap v3705: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 151 KiB/s rd, 3.7 KiB/s wr, 203 op/s 2024-01-13T19:01:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:03 smithi084 ceph-mon[119097]: osdmap e2153: 8 total, 8 up, 8 in 2024-01-13T19:01:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:03 smithi084 ceph-mon[119097]: pgmap v3705: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 151 KiB/s rd, 3.7 KiB/s wr, 203 op/s 2024-01-13T19:01:04.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:03 smithi099 ceph-mon[138788]: osdmap e2153: 8 total, 8 up, 8 in 2024-01-13T19:01:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:03 smithi099 ceph-mon[138788]: pgmap v3705: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 151 KiB/s rd, 3.7 KiB/s wr, 203 op/s 2024-01-13T19:01:05.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:04 smithi084 ceph-mon[116404]: osdmap e2154: 8 total, 8 up, 8 in 2024-01-13T19:01:05.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:04 smithi084 ceph-mon[119097]: osdmap e2154: 8 total, 8 up, 8 in 2024-01-13T19:01:05.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:04 smithi099 ceph-mon[138788]: osdmap e2154: 8 total, 8 up, 8 in 2024-01-13T19:01:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:05 smithi084 ceph-mon[116404]: osdmap e2155: 8 total, 8 up, 8 in 2024-01-13T19:01:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:05 smithi084 ceph-mon[116404]: pgmap v3708: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 151 KiB/s rd, 3.7 KiB/s wr, 203 op/s 2024-01-13T19:01:06.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:05 smithi084 ceph-mon[119097]: osdmap e2155: 8 total, 8 up, 8 in 2024-01-13T19:01:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:05 smithi084 ceph-mon[119097]: pgmap v3708: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 151 KiB/s rd, 3.7 KiB/s wr, 203 op/s 2024-01-13T19:01:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:06.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:05 smithi099 ceph-mon[138788]: osdmap e2155: 8 total, 8 up, 8 in 2024-01-13T19:01:06.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:05 smithi099 ceph-mon[138788]: pgmap v3708: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 151 KiB/s rd, 3.7 KiB/s wr, 203 op/s 2024-01-13T19:01:06.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:06 smithi084 ceph-mon[116404]: osdmap e2156: 8 total, 8 up, 8 in 2024-01-13T19:01:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:06 smithi084 ceph-mon[119097]: osdmap e2156: 8 total, 8 up, 8 in 2024-01-13T19:01:07.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:06 smithi099 ceph-mon[138788]: osdmap e2156: 8 total, 8 up, 8 in 2024-01-13T19:01:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:07 smithi084 ceph-mon[116404]: osdmap e2157: 8 total, 8 up, 8 in 2024-01-13T19:01:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:07 smithi084 ceph-mon[116404]: pgmap v3711: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 180 KiB/s rd, 3.5 KiB/s wr, 242 op/s 2024-01-13T19:01:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:07 smithi084 ceph-mon[119097]: osdmap e2157: 8 total, 8 up, 8 in 2024-01-13T19:01:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:07 smithi084 ceph-mon[119097]: pgmap v3711: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 180 KiB/s rd, 3.5 KiB/s wr, 242 op/s 2024-01-13T19:01:08.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:07 smithi099 ceph-mon[138788]: osdmap e2157: 8 total, 8 up, 8 in 2024-01-13T19:01:08.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:07 smithi099 ceph-mon[138788]: pgmap v3711: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 180 KiB/s rd, 3.5 KiB/s wr, 242 op/s 2024-01-13T19:01:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:08 smithi084 ceph-mon[116404]: osdmap e2158: 8 total, 8 up, 8 in 2024-01-13T19:01:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:08 smithi084 ceph-mon[119097]: osdmap e2158: 8 total, 8 up, 8 in 2024-01-13T19:01:09.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:08 smithi099 ceph-mon[138788]: osdmap e2158: 8 total, 8 up, 8 in 2024-01-13T19:01:10.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:09 smithi084 ceph-mon[116404]: osdmap e2159: 8 total, 8 up, 8 in 2024-01-13T19:01:10.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:09 smithi084 ceph-mon[116404]: pgmap v3714: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 184 KiB/s rd, 3.5 KiB/s wr, 247 op/s 2024-01-13T19:01:10.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:09 smithi084 ceph-mon[119097]: osdmap e2159: 8 total, 8 up, 8 in 2024-01-13T19:01:10.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:09 smithi084 ceph-mon[119097]: pgmap v3714: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 184 KiB/s rd, 3.5 KiB/s wr, 247 op/s 2024-01-13T19:01:10.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:09 smithi099 ceph-mon[138788]: osdmap e2159: 8 total, 8 up, 8 in 2024-01-13T19:01:10.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:09 smithi099 ceph-mon[138788]: pgmap v3714: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 184 KiB/s rd, 3.5 KiB/s wr, 247 op/s 2024-01-13T19:01:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:01:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:01:10] "GET /metrics HTTP/1.1" 200 36530 "" "Prometheus/2.43.0" 2024-01-13T19:01:11.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:10 smithi099 ceph-mon[138788]: osdmap e2160: 8 total, 8 up, 8 in 2024-01-13T19:01:11.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:10 smithi084 ceph-mon[119097]: osdmap e2160: 8 total, 8 up, 8 in 2024-01-13T19:01:11.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:10 smithi084 ceph-mon[116404]: osdmap e2160: 8 total, 8 up, 8 in 2024-01-13T19:01:12.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:11 smithi099 ceph-mon[138788]: osdmap e2161: 8 total, 8 up, 8 in 2024-01-13T19:01:12.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:11 smithi099 ceph-mon[138788]: pgmap v3717: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-01-13T19:01:12.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:11 smithi084 ceph-mon[116404]: osdmap e2161: 8 total, 8 up, 8 in 2024-01-13T19:01:12.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:11 smithi084 ceph-mon[116404]: pgmap v3717: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-01-13T19:01:12.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:11 smithi084 ceph-mon[119097]: osdmap e2161: 8 total, 8 up, 8 in 2024-01-13T19:01:12.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:11 smithi084 ceph-mon[119097]: pgmap v3717: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-01-13T19:01:13.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:12 smithi099 ceph-mon[138788]: osdmap e2162: 8 total, 8 up, 8 in 2024-01-13T19:01:13.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:12 smithi084 ceph-mon[116404]: osdmap e2162: 8 total, 8 up, 8 in 2024-01-13T19:01:13.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:12 smithi084 ceph-mon[119097]: osdmap e2162: 8 total, 8 up, 8 in 2024-01-13T19:01:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:13 smithi099 ceph-mon[138788]: osdmap e2163: 8 total, 8 up, 8 in 2024-01-13T19:01:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:13 smithi099 ceph-mon[138788]: pgmap v3720: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 216 KiB/s rd, 3.5 KiB/s wr, 290 op/s 2024-01-13T19:01:14.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:13 smithi084 ceph-mon[116404]: osdmap e2163: 8 total, 8 up, 8 in 2024-01-13T19:01:14.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:13 smithi084 ceph-mon[116404]: pgmap v3720: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 216 KiB/s rd, 3.5 KiB/s wr, 290 op/s 2024-01-13T19:01:14.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:13 smithi084 ceph-mon[119097]: osdmap e2163: 8 total, 8 up, 8 in 2024-01-13T19:01:14.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:13 smithi084 ceph-mon[119097]: pgmap v3720: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 216 KiB/s rd, 3.5 KiB/s wr, 290 op/s 2024-01-13T19:01:15.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:14 smithi099 ceph-mon[138788]: osdmap e2164: 8 total, 8 up, 8 in 2024-01-13T19:01:15.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:14 smithi084 ceph-mon[116404]: osdmap e2164: 8 total, 8 up, 8 in 2024-01-13T19:01:15.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:14 smithi084 ceph-mon[119097]: osdmap e2164: 8 total, 8 up, 8 in 2024-01-13T19:01:16.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:15 smithi099 ceph-mon[138788]: pgmap v3722: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 215 KiB/s rd, 4.2 KiB/s wr, 289 op/s 2024-01-13T19:01:16.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:15 smithi099 ceph-mon[138788]: osdmap e2165: 8 total, 8 up, 8 in 2024-01-13T19:01:16.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:15 smithi084 ceph-mon[116404]: pgmap v3722: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 215 KiB/s rd, 4.2 KiB/s wr, 289 op/s 2024-01-13T19:01:16.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:15 smithi084 ceph-mon[116404]: osdmap e2165: 8 total, 8 up, 8 in 2024-01-13T19:01:16.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:15 smithi084 ceph-mon[119097]: pgmap v3722: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 215 KiB/s rd, 4.2 KiB/s wr, 289 op/s 2024-01-13T19:01:16.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:15 smithi084 ceph-mon[119097]: osdmap e2165: 8 total, 8 up, 8 in 2024-01-13T19:01:17.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:16 smithi099 ceph-mon[138788]: osdmap e2166: 8 total, 8 up, 8 in 2024-01-13T19:01:17.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:16 smithi084 ceph-mon[116404]: osdmap e2166: 8 total, 8 up, 8 in 2024-01-13T19:01:17.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:16 smithi084 ceph-mon[119097]: osdmap e2166: 8 total, 8 up, 8 in 2024-01-13T19:01:18.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:17 smithi099 ceph-mon[138788]: pgmap v3725: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 244 KiB/s rd, 3.7 KiB/s wr, 328 op/s 2024-01-13T19:01:18.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:17 smithi099 ceph-mon[138788]: osdmap e2167: 8 total, 8 up, 8 in 2024-01-13T19:01:18.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:17 smithi084 ceph-mon[116404]: pgmap v3725: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 244 KiB/s rd, 3.7 KiB/s wr, 328 op/s 2024-01-13T19:01:18.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:17 smithi084 ceph-mon[116404]: osdmap e2167: 8 total, 8 up, 8 in 2024-01-13T19:01:18.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:17 smithi084 ceph-mon[119097]: pgmap v3725: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 244 KiB/s rd, 3.7 KiB/s wr, 328 op/s 2024-01-13T19:01:18.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:17 smithi084 ceph-mon[119097]: osdmap e2167: 8 total, 8 up, 8 in 2024-01-13T19:01:19.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:19 smithi099 ceph-mon[138788]: osdmap e2168: 8 total, 8 up, 8 in 2024-01-13T19:01:19.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:19 smithi084 ceph-mon[116404]: osdmap e2168: 8 total, 8 up, 8 in 2024-01-13T19:01:19.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:19 smithi084 ceph-mon[119097]: osdmap e2168: 8 total, 8 up, 8 in 2024-01-13T19:01:20.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:20 smithi084 ceph-mon[116404]: pgmap v3728: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 249 KiB/s rd, 3.5 KiB/s wr, 334 op/s 2024-01-13T19:01:20.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:20 smithi084 ceph-mon[116404]: osdmap e2169: 8 total, 8 up, 8 in 2024-01-13T19:01:20.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:20 smithi084 ceph-mon[119097]: pgmap v3728: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 249 KiB/s rd, 3.5 KiB/s wr, 334 op/s 2024-01-13T19:01:20.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:20 smithi084 ceph-mon[119097]: osdmap e2169: 8 total, 8 up, 8 in 2024-01-13T19:01:20.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:20 smithi099 ceph-mon[138788]: pgmap v3728: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 249 KiB/s rd, 3.5 KiB/s wr, 334 op/s 2024-01-13T19:01:20.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:20 smithi099 ceph-mon[138788]: osdmap e2169: 8 total, 8 up, 8 in 2024-01-13T19:01:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:01:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:01:20] "GET /metrics HTTP/1.1" 200 36530 "" "Prometheus/2.43.0" 2024-01-13T19:01:21.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:21 smithi099 ceph-mon[138788]: osdmap e2170: 8 total, 8 up, 8 in 2024-01-13T19:01:21.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:21 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:21.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:21 smithi084 ceph-mon[116404]: osdmap e2170: 8 total, 8 up, 8 in 2024-01-13T19:01:21.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:21 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:21.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:21 smithi084 ceph-mon[119097]: osdmap e2170: 8 total, 8 up, 8 in 2024-01-13T19:01:21.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:21 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:22.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:22 smithi099 ceph-mon[138788]: pgmap v3731: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:22.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:22 smithi099 ceph-mon[138788]: osdmap e2171: 8 total, 8 up, 8 in 2024-01-13T19:01:22.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:22 smithi084 ceph-mon[116404]: pgmap v3731: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:22.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:22 smithi084 ceph-mon[116404]: osdmap e2171: 8 total, 8 up, 8 in 2024-01-13T19:01:22.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:22 smithi084 ceph-mon[119097]: pgmap v3731: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:22.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:22 smithi084 ceph-mon[119097]: osdmap e2171: 8 total, 8 up, 8 in 2024-01-13T19:01:23.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:23 smithi099 ceph-mon[138788]: osdmap e2172: 8 total, 8 up, 8 in 2024-01-13T19:01:23.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:23 smithi084 ceph-mon[116404]: osdmap e2172: 8 total, 8 up, 8 in 2024-01-13T19:01:23.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:23 smithi084 ceph-mon[119097]: osdmap e2172: 8 total, 8 up, 8 in 2024-01-13T19:01:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:24 smithi099 ceph-mon[138788]: pgmap v3734: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 282 KiB/s rd, 3.7 KiB/s wr, 378 op/s 2024-01-13T19:01:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:24 smithi099 ceph-mon[138788]: osdmap e2173: 8 total, 8 up, 8 in 2024-01-13T19:01:24.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:24 smithi084 ceph-mon[116404]: pgmap v3734: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 282 KiB/s rd, 3.7 KiB/s wr, 378 op/s 2024-01-13T19:01:24.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:24 smithi084 ceph-mon[116404]: osdmap e2173: 8 total, 8 up, 8 in 2024-01-13T19:01:24.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:24 smithi084 ceph-mon[119097]: pgmap v3734: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 282 KiB/s rd, 3.7 KiB/s wr, 378 op/s 2024-01-13T19:01:24.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:24 smithi084 ceph-mon[119097]: osdmap e2173: 8 total, 8 up, 8 in 2024-01-13T19:01:25.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:25 smithi099 ceph-mon[138788]: osdmap e2174: 8 total, 8 up, 8 in 2024-01-13T19:01:25.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:25 smithi084 ceph-mon[116404]: osdmap e2174: 8 total, 8 up, 8 in 2024-01-13T19:01:25.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:25 smithi084 ceph-mon[119097]: osdmap e2174: 8 total, 8 up, 8 in 2024-01-13T19:01:26.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:26 smithi099 ceph-mon[138788]: pgmap v3737: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 282 KiB/s rd, 3.7 KiB/s wr, 378 op/s 2024-01-13T19:01:26.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:26 smithi099 ceph-mon[138788]: osdmap e2175: 8 total, 8 up, 8 in 2024-01-13T19:01:26.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:26 smithi084 ceph-mon[116404]: pgmap v3737: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 282 KiB/s rd, 3.7 KiB/s wr, 378 op/s 2024-01-13T19:01:26.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:26 smithi084 ceph-mon[116404]: osdmap e2175: 8 total, 8 up, 8 in 2024-01-13T19:01:26.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:26 smithi084 ceph-mon[119097]: pgmap v3737: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 282 KiB/s rd, 3.7 KiB/s wr, 378 op/s 2024-01-13T19:01:26.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:26 smithi084 ceph-mon[119097]: osdmap e2175: 8 total, 8 up, 8 in 2024-01-13T19:01:27.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:27 smithi099 ceph-mon[138788]: osdmap e2176: 8 total, 8 up, 8 in 2024-01-13T19:01:27.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:27 smithi084 ceph-mon[116404]: osdmap e2176: 8 total, 8 up, 8 in 2024-01-13T19:01:27.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:27 smithi084 ceph-mon[119097]: osdmap e2176: 8 total, 8 up, 8 in 2024-01-13T19:01:28.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:28 smithi099 ceph-mon[138788]: pgmap v3740: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 311 KiB/s rd, 2.5 KiB/s wr, 416 op/s 2024-01-13T19:01:28.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:28 smithi099 ceph-mon[138788]: osdmap e2177: 8 total, 8 up, 8 in 2024-01-13T19:01:28.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:28 smithi084 ceph-mon[116404]: pgmap v3740: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 311 KiB/s rd, 2.5 KiB/s wr, 416 op/s 2024-01-13T19:01:28.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:28 smithi084 ceph-mon[116404]: osdmap e2177: 8 total, 8 up, 8 in 2024-01-13T19:01:28.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:28 smithi084 ceph-mon[119097]: pgmap v3740: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 311 KiB/s rd, 2.5 KiB/s wr, 416 op/s 2024-01-13T19:01:28.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:28 smithi084 ceph-mon[119097]: osdmap e2177: 8 total, 8 up, 8 in 2024-01-13T19:01:29.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:29 smithi099 ceph-mon[138788]: osdmap e2178: 8 total, 8 up, 8 in 2024-01-13T19:01:29.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:29 smithi084 ceph-mon[116404]: osdmap e2178: 8 total, 8 up, 8 in 2024-01-13T19:01:29.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:29 smithi084 ceph-mon[119097]: osdmap e2178: 8 total, 8 up, 8 in 2024-01-13T19:01:30.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:30 smithi099 ceph-mon[138788]: pgmap v3743: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 314 KiB/s rd, 3.2 KiB/s wr, 421 op/s 2024-01-13T19:01:30.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:30 smithi099 ceph-mon[138788]: osdmap e2179: 8 total, 8 up, 8 in 2024-01-13T19:01:30.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:30 smithi084 ceph-mon[116404]: pgmap v3743: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 314 KiB/s rd, 3.2 KiB/s wr, 421 op/s 2024-01-13T19:01:30.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:30 smithi084 ceph-mon[116404]: osdmap e2179: 8 total, 8 up, 8 in 2024-01-13T19:01:30.427 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:01:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:01:30] "GET /metrics HTTP/1.1" 200 36530 "" "Prometheus/2.43.0" 2024-01-13T19:01:30.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:30 smithi084 ceph-mon[119097]: pgmap v3743: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 314 KiB/s rd, 3.2 KiB/s wr, 421 op/s 2024-01-13T19:01:30.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:30 smithi084 ceph-mon[119097]: osdmap e2179: 8 total, 8 up, 8 in 2024-01-13T19:01:31.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:31 smithi099 ceph-mon[138788]: osdmap e2180: 8 total, 8 up, 8 in 2024-01-13T19:01:31.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:31 smithi084 ceph-mon[119097]: osdmap e2180: 8 total, 8 up, 8 in 2024-01-13T19:01:31.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:31 smithi084 ceph-mon[116404]: osdmap e2180: 8 total, 8 up, 8 in 2024-01-13T19:01:32.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:32 smithi084 ceph-mon[116404]: pgmap v3746: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-01-13T19:01:32.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:32 smithi084 ceph-mon[116404]: osdmap e2181: 8 total, 8 up, 8 in 2024-01-13T19:01:32.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:32 smithi084 ceph-mon[119097]: pgmap v3746: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-01-13T19:01:32.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:32 smithi084 ceph-mon[119097]: osdmap e2181: 8 total, 8 up, 8 in 2024-01-13T19:01:32.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:32 smithi099 ceph-mon[138788]: pgmap v3746: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-01-13T19:01:32.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:32 smithi099 ceph-mon[138788]: osdmap e2181: 8 total, 8 up, 8 in 2024-01-13T19:01:33.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:33 smithi084 ceph-mon[116404]: osdmap e2182: 8 total, 8 up, 8 in 2024-01-13T19:01:33.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:33 smithi084 ceph-mon[119097]: osdmap e2182: 8 total, 8 up, 8 in 2024-01-13T19:01:33.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:33 smithi099 ceph-mon[138788]: osdmap e2182: 8 total, 8 up, 8 in 2024-01-13T19:01:34.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:34 smithi084 ceph-mon[116404]: pgmap v3749: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 347 KiB/s rd, 3.7 KiB/s wr, 466 op/s 2024-01-13T19:01:34.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:34 smithi084 ceph-mon[116404]: osdmap e2183: 8 total, 8 up, 8 in 2024-01-13T19:01:34.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:34 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:01:34.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:34 smithi084 ceph-mon[119097]: pgmap v3749: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 347 KiB/s rd, 3.7 KiB/s wr, 466 op/s 2024-01-13T19:01:34.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:34 smithi084 ceph-mon[119097]: osdmap e2183: 8 total, 8 up, 8 in 2024-01-13T19:01:34.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:34 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:01:34.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:34 smithi099 ceph-mon[138788]: pgmap v3749: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 347 KiB/s rd, 3.7 KiB/s wr, 466 op/s 2024-01-13T19:01:34.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:34 smithi099 ceph-mon[138788]: osdmap e2183: 8 total, 8 up, 8 in 2024-01-13T19:01:34.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:34 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:01:35.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:35 smithi084 ceph-mon[116404]: osdmap e2184: 8 total, 8 up, 8 in 2024-01-13T19:01:35.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:01:35.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:01:35.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:01:35.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:35.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:35 smithi084 ceph-mon[119097]: osdmap e2184: 8 total, 8 up, 8 in 2024-01-13T19:01:35.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:01:35.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:01:35.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:01:35.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:35.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:35 smithi099 ceph-mon[138788]: osdmap e2184: 8 total, 8 up, 8 in 2024-01-13T19:01:35.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:01:35.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:01:35.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:01:35.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:36.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:36 smithi084 ceph-mon[116404]: pgmap v3752: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 347 KiB/s rd, 3.5 KiB/s wr, 465 op/s 2024-01-13T19:01:36.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:36 smithi084 ceph-mon[116404]: osdmap e2185: 8 total, 8 up, 8 in 2024-01-13T19:01:36.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:36 smithi084 ceph-mon[119097]: pgmap v3752: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 347 KiB/s rd, 3.5 KiB/s wr, 465 op/s 2024-01-13T19:01:36.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:36 smithi084 ceph-mon[119097]: osdmap e2185: 8 total, 8 up, 8 in 2024-01-13T19:01:36.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:36 smithi099 ceph-mon[138788]: pgmap v3752: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 347 KiB/s rd, 3.5 KiB/s wr, 465 op/s 2024-01-13T19:01:36.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:36 smithi099 ceph-mon[138788]: osdmap e2185: 8 total, 8 up, 8 in 2024-01-13T19:01:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:37 smithi084 ceph-mon[116404]: osdmap e2186: 8 total, 8 up, 8 in 2024-01-13T19:01:37.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:37 smithi084 ceph-mon[119097]: osdmap e2186: 8 total, 8 up, 8 in 2024-01-13T19:01:37.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:37 smithi099 ceph-mon[138788]: osdmap e2186: 8 total, 8 up, 8 in 2024-01-13T19:01:38.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:38 smithi084 ceph-mon[119097]: pgmap v3755: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 375 KiB/s rd, 3.7 KiB/s wr, 504 op/s 2024-01-13T19:01:38.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:38 smithi084 ceph-mon[119097]: osdmap e2187: 8 total, 8 up, 8 in 2024-01-13T19:01:38.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:38 smithi084 ceph-mon[116404]: pgmap v3755: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 375 KiB/s rd, 3.7 KiB/s wr, 504 op/s 2024-01-13T19:01:38.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:38 smithi084 ceph-mon[116404]: osdmap e2187: 8 total, 8 up, 8 in 2024-01-13T19:01:38.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:38 smithi099 ceph-mon[138788]: pgmap v3755: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 375 KiB/s rd, 3.7 KiB/s wr, 504 op/s 2024-01-13T19:01:38.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:38 smithi099 ceph-mon[138788]: osdmap e2187: 8 total, 8 up, 8 in 2024-01-13T19:01:39.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:39 smithi084 ceph-mon[119097]: osdmap e2188: 8 total, 8 up, 8 in 2024-01-13T19:01:39.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:39 smithi084 ceph-mon[116404]: osdmap e2188: 8 total, 8 up, 8 in 2024-01-13T19:01:39.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:39 smithi099 ceph-mon[138788]: osdmap e2188: 8 total, 8 up, 8 in 2024-01-13T19:01:40.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:40 smithi084 ceph-mon[116404]: pgmap v3758: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 379 KiB/s rd, 3.2 KiB/s wr, 509 op/s 2024-01-13T19:01:40.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:40 smithi084 ceph-mon[116404]: osdmap e2189: 8 total, 8 up, 8 in 2024-01-13T19:01:40.427 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:01:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:01:40] "GET /metrics HTTP/1.1" 200 36536 "" "Prometheus/2.43.0" 2024-01-13T19:01:40.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:40 smithi084 ceph-mon[119097]: pgmap v3758: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 379 KiB/s rd, 3.2 KiB/s wr, 509 op/s 2024-01-13T19:01:40.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:40 smithi084 ceph-mon[119097]: osdmap e2189: 8 total, 8 up, 8 in 2024-01-13T19:01:40.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:40 smithi099 ceph-mon[138788]: pgmap v3758: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 379 KiB/s rd, 3.2 KiB/s wr, 509 op/s 2024-01-13T19:01:40.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:40 smithi099 ceph-mon[138788]: osdmap e2189: 8 total, 8 up, 8 in 2024-01-13T19:01:41.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:41 smithi099 ceph-mon[138788]: osdmap e2190: 8 total, 8 up, 8 in 2024-01-13T19:01:41.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:41 smithi084 ceph-mon[116404]: osdmap e2190: 8 total, 8 up, 8 in 2024-01-13T19:01:41.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:41 smithi084 ceph-mon[119097]: osdmap e2190: 8 total, 8 up, 8 in 2024-01-13T19:01:42.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:42 smithi099 ceph-mon[138788]: pgmap v3761: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:42.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:42 smithi099 ceph-mon[138788]: osdmap e2191: 8 total, 8 up, 8 in 2024-01-13T19:01:42.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:42 smithi084 ceph-mon[116404]: pgmap v3761: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:42.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:42 smithi084 ceph-mon[116404]: osdmap e2191: 8 total, 8 up, 8 in 2024-01-13T19:01:42.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:42 smithi084 ceph-mon[119097]: pgmap v3761: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:42.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:42 smithi084 ceph-mon[119097]: osdmap e2191: 8 total, 8 up, 8 in 2024-01-13T19:01:43.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:43 smithi099 ceph-mon[138788]: osdmap e2192: 8 total, 8 up, 8 in 2024-01-13T19:01:43.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:43 smithi084 ceph-mon[116404]: osdmap e2192: 8 total, 8 up, 8 in 2024-01-13T19:01:43.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:43 smithi084 ceph-mon[119097]: osdmap e2192: 8 total, 8 up, 8 in 2024-01-13T19:01:44.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:44 smithi099 ceph-mon[138788]: pgmap v3764: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 412 KiB/s rd, 4.0 KiB/s wr, 553 op/s 2024-01-13T19:01:44.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:44 smithi099 ceph-mon[138788]: osdmap e2193: 8 total, 8 up, 8 in 2024-01-13T19:01:44.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:44 smithi084 ceph-mon[116404]: pgmap v3764: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 412 KiB/s rd, 4.0 KiB/s wr, 553 op/s 2024-01-13T19:01:44.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:44 smithi084 ceph-mon[116404]: osdmap e2193: 8 total, 8 up, 8 in 2024-01-13T19:01:44.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:44 smithi084 ceph-mon[119097]: pgmap v3764: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 412 KiB/s rd, 4.0 KiB/s wr, 553 op/s 2024-01-13T19:01:44.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:44 smithi084 ceph-mon[119097]: osdmap e2193: 8 total, 8 up, 8 in 2024-01-13T19:01:45.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:45 smithi099 ceph-mon[138788]: osdmap e2194: 8 total, 8 up, 8 in 2024-01-13T19:01:45.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:45 smithi084 ceph-mon[119097]: osdmap e2194: 8 total, 8 up, 8 in 2024-01-13T19:01:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:45 smithi084 ceph-mon[116404]: osdmap e2194: 8 total, 8 up, 8 in 2024-01-13T19:01:46.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:46 smithi099 ceph-mon[138788]: pgmap v3767: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 412 KiB/s rd, 3.7 KiB/s wr, 553 op/s 2024-01-13T19:01:46.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:46 smithi099 ceph-mon[138788]: osdmap e2195: 8 total, 8 up, 8 in 2024-01-13T19:01:46.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:46 smithi084 ceph-mon[119097]: pgmap v3767: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 412 KiB/s rd, 3.7 KiB/s wr, 553 op/s 2024-01-13T19:01:46.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:46 smithi084 ceph-mon[119097]: osdmap e2195: 8 total, 8 up, 8 in 2024-01-13T19:01:46.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:46 smithi084 ceph-mon[116404]: pgmap v3767: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 412 KiB/s rd, 3.7 KiB/s wr, 553 op/s 2024-01-13T19:01:46.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:46 smithi084 ceph-mon[116404]: osdmap e2195: 8 total, 8 up, 8 in 2024-01-13T19:01:47.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:47 smithi099 ceph-mon[138788]: osdmap e2196: 8 total, 8 up, 8 in 2024-01-13T19:01:47.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:47 smithi084 ceph-mon[116404]: osdmap e2196: 8 total, 8 up, 8 in 2024-01-13T19:01:47.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:47 smithi084 ceph-mon[119097]: osdmap e2196: 8 total, 8 up, 8 in 2024-01-13T19:01:48.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:48 smithi099 ceph-mon[138788]: pgmap v3770: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 441 KiB/s rd, 3.5 KiB/s wr, 593 op/s 2024-01-13T19:01:48.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:48 smithi099 ceph-mon[138788]: osdmap e2197: 8 total, 8 up, 8 in 2024-01-13T19:01:48.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:48 smithi084 ceph-mon[119097]: pgmap v3770: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 441 KiB/s rd, 3.5 KiB/s wr, 593 op/s 2024-01-13T19:01:48.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:48 smithi084 ceph-mon[119097]: osdmap e2197: 8 total, 8 up, 8 in 2024-01-13T19:01:48.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:48 smithi084 ceph-mon[116404]: pgmap v3770: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 441 KiB/s rd, 3.5 KiB/s wr, 593 op/s 2024-01-13T19:01:48.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:48 smithi084 ceph-mon[116404]: osdmap e2197: 8 total, 8 up, 8 in 2024-01-13T19:01:49.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:49 smithi099 ceph-mon[138788]: osdmap e2198: 8 total, 8 up, 8 in 2024-01-13T19:01:49.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:49 smithi084 ceph-mon[116404]: osdmap e2198: 8 total, 8 up, 8 in 2024-01-13T19:01:49.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:49 smithi084 ceph-mon[119097]: osdmap e2198: 8 total, 8 up, 8 in 2024-01-13T19:01:50.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:50 smithi099 ceph-mon[138788]: pgmap v3773: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 445 KiB/s rd, 3.7 KiB/s wr, 598 op/s 2024-01-13T19:01:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:50 smithi099 ceph-mon[138788]: osdmap e2199: 8 total, 8 up, 8 in 2024-01-13T19:01:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:01:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:01:50] "GET /metrics HTTP/1.1" 200 36532 "" "Prometheus/2.43.0" 2024-01-13T19:01:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:50 smithi084 ceph-mon[116404]: pgmap v3773: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 445 KiB/s rd, 3.7 KiB/s wr, 598 op/s 2024-01-13T19:01:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:50 smithi084 ceph-mon[116404]: osdmap e2199: 8 total, 8 up, 8 in 2024-01-13T19:01:50.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:50 smithi084 ceph-mon[119097]: pgmap v3773: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 445 KiB/s rd, 3.7 KiB/s wr, 598 op/s 2024-01-13T19:01:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:50 smithi084 ceph-mon[119097]: osdmap e2199: 8 total, 8 up, 8 in 2024-01-13T19:01:50.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:01:51.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:51 smithi099 ceph-mon[138788]: osdmap e2200: 8 total, 8 up, 8 in 2024-01-13T19:01:51.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:51 smithi084 ceph-mon[116404]: osdmap e2200: 8 total, 8 up, 8 in 2024-01-13T19:01:51.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:51 smithi084 ceph-mon[119097]: osdmap e2200: 8 total, 8 up, 8 in 2024-01-13T19:01:52.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:52 smithi099 ceph-mon[138788]: pgmap v3776: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:52.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:52 smithi099 ceph-mon[138788]: osdmap e2201: 8 total, 8 up, 8 in 2024-01-13T19:01:52.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:52 smithi084 ceph-mon[116404]: pgmap v3776: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:52.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:52 smithi084 ceph-mon[116404]: osdmap e2201: 8 total, 8 up, 8 in 2024-01-13T19:01:52.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:52 smithi084 ceph-mon[119097]: pgmap v3776: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:01:52.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:52 smithi084 ceph-mon[119097]: osdmap e2201: 8 total, 8 up, 8 in 2024-01-13T19:01:53.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:53 smithi099 ceph-mon[138788]: osdmap e2202: 8 total, 8 up, 8 in 2024-01-13T19:01:53.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:53 smithi084 ceph-mon[116404]: osdmap e2202: 8 total, 8 up, 8 in 2024-01-13T19:01:53.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:53 smithi084 ceph-mon[119097]: osdmap e2202: 8 total, 8 up, 8 in 2024-01-13T19:01:54.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:54 smithi099 ceph-mon[138788]: pgmap v3779: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 479 KiB/s rd, 3.5 KiB/s wr, 644 op/s 2024-01-13T19:01:54.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:54 smithi099 ceph-mon[138788]: osdmap e2203: 8 total, 8 up, 8 in 2024-01-13T19:01:54.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:54 smithi084 ceph-mon[116404]: pgmap v3779: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 479 KiB/s rd, 3.5 KiB/s wr, 644 op/s 2024-01-13T19:01:54.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:54 smithi084 ceph-mon[116404]: osdmap e2203: 8 total, 8 up, 8 in 2024-01-13T19:01:54.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:54 smithi084 ceph-mon[119097]: pgmap v3779: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 479 KiB/s rd, 3.5 KiB/s wr, 644 op/s 2024-01-13T19:01:54.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:54 smithi084 ceph-mon[119097]: osdmap e2203: 8 total, 8 up, 8 in 2024-01-13T19:01:55.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:55 smithi099 ceph-mon[138788]: osdmap e2204: 8 total, 8 up, 8 in 2024-01-13T19:01:55.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:55 smithi084 ceph-mon[119097]: osdmap e2204: 8 total, 8 up, 8 in 2024-01-13T19:01:55.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:55 smithi084 ceph-mon[116404]: osdmap e2204: 8 total, 8 up, 8 in 2024-01-13T19:01:56.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:56 smithi099 ceph-mon[138788]: pgmap v3782: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 479 KiB/s rd, 4.0 KiB/s wr, 645 op/s 2024-01-13T19:01:56.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:56 smithi099 ceph-mon[138788]: osdmap e2205: 8 total, 8 up, 8 in 2024-01-13T19:01:56.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:56 smithi084 ceph-mon[116404]: pgmap v3782: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 479 KiB/s rd, 4.0 KiB/s wr, 645 op/s 2024-01-13T19:01:56.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:56 smithi084 ceph-mon[116404]: osdmap e2205: 8 total, 8 up, 8 in 2024-01-13T19:01:56.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:56 smithi084 ceph-mon[119097]: pgmap v3782: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 479 KiB/s rd, 4.0 KiB/s wr, 645 op/s 2024-01-13T19:01:56.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:56 smithi084 ceph-mon[119097]: osdmap e2205: 8 total, 8 up, 8 in 2024-01-13T19:01:57.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:57 smithi099 ceph-mon[138788]: osdmap e2206: 8 total, 8 up, 8 in 2024-01-13T19:01:57.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:57 smithi084 ceph-mon[116404]: osdmap e2206: 8 total, 8 up, 8 in 2024-01-13T19:01:57.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:57 smithi084 ceph-mon[119097]: osdmap e2206: 8 total, 8 up, 8 in 2024-01-13T19:01:58.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:58 smithi099 ceph-mon[138788]: pgmap v3785: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 507 KiB/s rd, 3.2 KiB/s wr, 683 op/s 2024-01-13T19:01:58.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:58 smithi099 ceph-mon[138788]: osdmap e2207: 8 total, 8 up, 8 in 2024-01-13T19:01:58.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:58 smithi084 ceph-mon[116404]: pgmap v3785: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 507 KiB/s rd, 3.2 KiB/s wr, 683 op/s 2024-01-13T19:01:58.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:58 smithi084 ceph-mon[116404]: osdmap e2207: 8 total, 8 up, 8 in 2024-01-13T19:01:58.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:58 smithi084 ceph-mon[119097]: pgmap v3785: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 507 KiB/s rd, 3.2 KiB/s wr, 683 op/s 2024-01-13T19:01:58.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:58 smithi084 ceph-mon[119097]: osdmap e2207: 8 total, 8 up, 8 in 2024-01-13T19:01:59.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:01:59 smithi099 ceph-mon[138788]: osdmap e2208: 8 total, 8 up, 8 in 2024-01-13T19:01:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:01:59 smithi084 ceph-mon[116404]: osdmap e2208: 8 total, 8 up, 8 in 2024-01-13T19:01:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:01:59 smithi084 ceph-mon[119097]: osdmap e2208: 8 total, 8 up, 8 in 2024-01-13T19:02:00.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:00 smithi099 ceph-mon[138788]: pgmap v3788: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 KiB/s rd, 3.2 KiB/s wr, 688 op/s 2024-01-13T19:02:00.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:00 smithi099 ceph-mon[138788]: osdmap e2209: 8 total, 8 up, 8 in 2024-01-13T19:02:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:02:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:02:00] "GET /metrics HTTP/1.1" 200 36532 "" "Prometheus/2.43.0" 2024-01-13T19:02:00.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:00 smithi084 ceph-mon[116404]: pgmap v3788: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 KiB/s rd, 3.2 KiB/s wr, 688 op/s 2024-01-13T19:02:00.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:00 smithi084 ceph-mon[116404]: osdmap e2209: 8 total, 8 up, 8 in 2024-01-13T19:02:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:00 smithi084 ceph-mon[119097]: pgmap v3788: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 KiB/s rd, 3.2 KiB/s wr, 688 op/s 2024-01-13T19:02:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:00 smithi084 ceph-mon[119097]: osdmap e2209: 8 total, 8 up, 8 in 2024-01-13T19:02:01.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:01 smithi099 ceph-mon[138788]: osdmap e2210: 8 total, 8 up, 8 in 2024-01-13T19:02:01.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:01 smithi084 ceph-mon[116404]: osdmap e2210: 8 total, 8 up, 8 in 2024-01-13T19:02:01.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:01 smithi084 ceph-mon[119097]: osdmap e2210: 8 total, 8 up, 8 in 2024-01-13T19:02:02.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:02 smithi099 ceph-mon[138788]: pgmap v3791: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:02.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:02 smithi099 ceph-mon[138788]: osdmap e2211: 8 total, 8 up, 8 in 2024-01-13T19:02:02.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:02 smithi084 ceph-mon[116404]: pgmap v3791: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:02.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:02 smithi084 ceph-mon[116404]: osdmap e2211: 8 total, 8 up, 8 in 2024-01-13T19:02:02.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:02 smithi084 ceph-mon[119097]: pgmap v3791: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:02.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:02 smithi084 ceph-mon[119097]: osdmap e2211: 8 total, 8 up, 8 in 2024-01-13T19:02:03.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:03 smithi099 ceph-mon[138788]: osdmap e2212: 8 total, 8 up, 8 in 2024-01-13T19:02:03.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:03 smithi084 ceph-mon[116404]: osdmap e2212: 8 total, 8 up, 8 in 2024-01-13T19:02:03.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:03 smithi084 ceph-mon[119097]: osdmap e2212: 8 total, 8 up, 8 in 2024-01-13T19:02:04.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:04 smithi099 ceph-mon[138788]: pgmap v3794: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 544 KiB/s rd, 4.0 KiB/s wr, 732 op/s 2024-01-13T19:02:04.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:04 smithi099 ceph-mon[138788]: osdmap e2213: 8 total, 8 up, 8 in 2024-01-13T19:02:04.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:04 smithi084 ceph-mon[116404]: pgmap v3794: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 544 KiB/s rd, 4.0 KiB/s wr, 732 op/s 2024-01-13T19:02:04.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:04 smithi084 ceph-mon[116404]: osdmap e2213: 8 total, 8 up, 8 in 2024-01-13T19:02:04.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:04 smithi084 ceph-mon[119097]: pgmap v3794: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 544 KiB/s rd, 4.0 KiB/s wr, 732 op/s 2024-01-13T19:02:04.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:04 smithi084 ceph-mon[119097]: osdmap e2213: 8 total, 8 up, 8 in 2024-01-13T19:02:05.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:05 smithi099 ceph-mon[138788]: osdmap e2214: 8 total, 8 up, 8 in 2024-01-13T19:02:05.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:05.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:05 smithi084 ceph-mon[116404]: osdmap e2214: 8 total, 8 up, 8 in 2024-01-13T19:02:05.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:05.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:05 smithi084 ceph-mon[119097]: osdmap e2214: 8 total, 8 up, 8 in 2024-01-13T19:02:05.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:06.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:06 smithi084 ceph-mon[116404]: pgmap v3797: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 544 KiB/s rd, 4.2 KiB/s wr, 732 op/s 2024-01-13T19:02:06.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:06 smithi084 ceph-mon[116404]: osdmap e2215: 8 total, 8 up, 8 in 2024-01-13T19:02:06.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:06 smithi084 ceph-mon[119097]: pgmap v3797: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 544 KiB/s rd, 4.2 KiB/s wr, 732 op/s 2024-01-13T19:02:06.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:06 smithi084 ceph-mon[119097]: osdmap e2215: 8 total, 8 up, 8 in 2024-01-13T19:02:06.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:06 smithi099 ceph-mon[138788]: pgmap v3797: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 544 KiB/s rd, 4.2 KiB/s wr, 732 op/s 2024-01-13T19:02:06.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:06 smithi099 ceph-mon[138788]: osdmap e2215: 8 total, 8 up, 8 in 2024-01-13T19:02:07.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:07 smithi084 ceph-mon[116404]: osdmap e2216: 8 total, 8 up, 8 in 2024-01-13T19:02:07.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:07 smithi084 ceph-mon[119097]: osdmap e2216: 8 total, 8 up, 8 in 2024-01-13T19:02:07.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:07 smithi099 ceph-mon[138788]: osdmap e2216: 8 total, 8 up, 8 in 2024-01-13T19:02:08.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:08 smithi084 ceph-mon[116404]: pgmap v3800: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 571 KiB/s rd, 3.2 KiB/s wr, 770 op/s 2024-01-13T19:02:08.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:08 smithi084 ceph-mon[116404]: osdmap e2217: 8 total, 8 up, 8 in 2024-01-13T19:02:08.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:08 smithi084 ceph-mon[119097]: pgmap v3800: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 571 KiB/s rd, 3.2 KiB/s wr, 770 op/s 2024-01-13T19:02:08.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:08 smithi084 ceph-mon[119097]: osdmap e2217: 8 total, 8 up, 8 in 2024-01-13T19:02:08.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:08 smithi099 ceph-mon[138788]: pgmap v3800: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 571 KiB/s rd, 3.2 KiB/s wr, 770 op/s 2024-01-13T19:02:08.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:08 smithi099 ceph-mon[138788]: osdmap e2217: 8 total, 8 up, 8 in 2024-01-13T19:02:09.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:09 smithi084 ceph-mon[116404]: osdmap e2218: 8 total, 8 up, 8 in 2024-01-13T19:02:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:09 smithi084 ceph-mon[119097]: osdmap e2218: 8 total, 8 up, 8 in 2024-01-13T19:02:09.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:09 smithi099 ceph-mon[138788]: osdmap e2218: 8 total, 8 up, 8 in 2024-01-13T19:02:10.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:10 smithi084 ceph-mon[119097]: pgmap v3803: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 575 KiB/s rd, 3.2 KiB/s wr, 775 op/s 2024-01-13T19:02:10.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:10 smithi084 ceph-mon[119097]: osdmap e2219: 8 total, 8 up, 8 in 2024-01-13T19:02:10.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:10 smithi084 ceph-mon[116404]: pgmap v3803: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 575 KiB/s rd, 3.2 KiB/s wr, 775 op/s 2024-01-13T19:02:10.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:10 smithi084 ceph-mon[116404]: osdmap e2219: 8 total, 8 up, 8 in 2024-01-13T19:02:10.677 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:02:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:02:10] "GET /metrics HTTP/1.1" 200 36535 "" "Prometheus/2.43.0" 2024-01-13T19:02:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:10 smithi099 ceph-mon[138788]: pgmap v3803: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 575 KiB/s rd, 3.2 KiB/s wr, 775 op/s 2024-01-13T19:02:10.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:10 smithi099 ceph-mon[138788]: osdmap e2219: 8 total, 8 up, 8 in 2024-01-13T19:02:11.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:11 smithi084 ceph-mon[116404]: osdmap e2220: 8 total, 8 up, 8 in 2024-01-13T19:02:11.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:11 smithi084 ceph-mon[119097]: osdmap e2220: 8 total, 8 up, 8 in 2024-01-13T19:02:11.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:11 smithi099 ceph-mon[138788]: osdmap e2220: 8 total, 8 up, 8 in 2024-01-13T19:02:12.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:12 smithi084 ceph-mon[116404]: pgmap v3806: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:02:12.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:12 smithi084 ceph-mon[116404]: osdmap e2221: 8 total, 8 up, 8 in 2024-01-13T19:02:12.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:12 smithi084 ceph-mon[119097]: pgmap v3806: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:02:12.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:12 smithi084 ceph-mon[119097]: osdmap e2221: 8 total, 8 up, 8 in 2024-01-13T19:02:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:12 smithi099 ceph-mon[138788]: pgmap v3806: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:02:12.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:12 smithi099 ceph-mon[138788]: osdmap e2221: 8 total, 8 up, 8 in 2024-01-13T19:02:13.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:13 smithi084 ceph-mon[119097]: osdmap e2222: 8 total, 8 up, 8 in 2024-01-13T19:02:13.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:13 smithi084 ceph-mon[116404]: osdmap e2222: 8 total, 8 up, 8 in 2024-01-13T19:02:13.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:13 smithi099 ceph-mon[138788]: osdmap e2222: 8 total, 8 up, 8 in 2024-01-13T19:02:14.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:14 smithi099 ceph-mon[138788]: pgmap v3809: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 609 KiB/s rd, 3.5 KiB/s wr, 819 op/s 2024-01-13T19:02:14.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:14 smithi099 ceph-mon[138788]: osdmap e2223: 8 total, 8 up, 8 in 2024-01-13T19:02:14.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:14 smithi084 ceph-mon[119097]: pgmap v3809: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 609 KiB/s rd, 3.5 KiB/s wr, 819 op/s 2024-01-13T19:02:14.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:14 smithi084 ceph-mon[119097]: osdmap e2223: 8 total, 8 up, 8 in 2024-01-13T19:02:14.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:14 smithi084 ceph-mon[116404]: pgmap v3809: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 609 KiB/s rd, 3.5 KiB/s wr, 819 op/s 2024-01-13T19:02:14.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:14 smithi084 ceph-mon[116404]: osdmap e2223: 8 total, 8 up, 8 in 2024-01-13T19:02:15.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:15 smithi099 ceph-mon[138788]: osdmap e2224: 8 total, 8 up, 8 in 2024-01-13T19:02:15.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:15 smithi084 ceph-mon[116404]: osdmap e2224: 8 total, 8 up, 8 in 2024-01-13T19:02:15.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:15 smithi084 ceph-mon[119097]: osdmap e2224: 8 total, 8 up, 8 in 2024-01-13T19:02:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:16 smithi099 ceph-mon[138788]: pgmap v3812: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 609 KiB/s rd, 3.5 KiB/s wr, 819 op/s 2024-01-13T19:02:16.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:16 smithi099 ceph-mon[138788]: osdmap e2225: 8 total, 8 up, 8 in 2024-01-13T19:02:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:16 smithi084 ceph-mon[119097]: pgmap v3812: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 609 KiB/s rd, 3.5 KiB/s wr, 819 op/s 2024-01-13T19:02:16.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:16 smithi084 ceph-mon[119097]: osdmap e2225: 8 total, 8 up, 8 in 2024-01-13T19:02:16.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:16 smithi084 ceph-mon[116404]: pgmap v3812: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 609 KiB/s rd, 3.5 KiB/s wr, 819 op/s 2024-01-13T19:02:16.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:16 smithi084 ceph-mon[116404]: osdmap e2225: 8 total, 8 up, 8 in 2024-01-13T19:02:17.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:17 smithi099 ceph-mon[138788]: osdmap e2226: 8 total, 8 up, 8 in 2024-01-13T19:02:17.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:17 smithi084 ceph-mon[119097]: osdmap e2226: 8 total, 8 up, 8 in 2024-01-13T19:02:17.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:17 smithi084 ceph-mon[116404]: osdmap e2226: 8 total, 8 up, 8 in 2024-01-13T19:02:18.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:18 smithi099 ceph-mon[138788]: pgmap v3815: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 636 KiB/s rd, 3.5 KiB/s wr, 858 op/s 2024-01-13T19:02:18.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:18 smithi099 ceph-mon[138788]: osdmap e2227: 8 total, 8 up, 8 in 2024-01-13T19:02:18.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:18 smithi084 ceph-mon[116404]: pgmap v3815: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 636 KiB/s rd, 3.5 KiB/s wr, 858 op/s 2024-01-13T19:02:18.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:18 smithi084 ceph-mon[116404]: osdmap e2227: 8 total, 8 up, 8 in 2024-01-13T19:02:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:18 smithi084 ceph-mon[119097]: pgmap v3815: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 636 KiB/s rd, 3.5 KiB/s wr, 858 op/s 2024-01-13T19:02:18.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:18 smithi084 ceph-mon[119097]: osdmap e2227: 8 total, 8 up, 8 in 2024-01-13T19:02:19.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:19 smithi099 ceph-mon[138788]: osdmap e2228: 8 total, 8 up, 8 in 2024-01-13T19:02:19.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:19 smithi084 ceph-mon[116404]: osdmap e2228: 8 total, 8 up, 8 in 2024-01-13T19:02:19.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:19 smithi084 ceph-mon[119097]: osdmap e2228: 8 total, 8 up, 8 in 2024-01-13T19:02:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:02:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:02:20] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:02:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:20 smithi084 ceph-mon[116404]: pgmap v3818: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 640 KiB/s rd, 3.5 KiB/s wr, 863 op/s 2024-01-13T19:02:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:20 smithi084 ceph-mon[116404]: osdmap e2229: 8 total, 8 up, 8 in 2024-01-13T19:02:20.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:20 smithi084 ceph-mon[119097]: pgmap v3818: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 640 KiB/s rd, 3.5 KiB/s wr, 863 op/s 2024-01-13T19:02:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:20 smithi084 ceph-mon[119097]: osdmap e2229: 8 total, 8 up, 8 in 2024-01-13T19:02:20.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:20.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:20 smithi099 ceph-mon[138788]: pgmap v3818: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 640 KiB/s rd, 3.5 KiB/s wr, 863 op/s 2024-01-13T19:02:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:20 smithi099 ceph-mon[138788]: osdmap e2229: 8 total, 8 up, 8 in 2024-01-13T19:02:20.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:21.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:21 smithi099 ceph-mon[138788]: osdmap e2230: 8 total, 8 up, 8 in 2024-01-13T19:02:21.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:21 smithi084 ceph-mon[116404]: osdmap e2230: 8 total, 8 up, 8 in 2024-01-13T19:02:21.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:21 smithi084 ceph-mon[119097]: osdmap e2230: 8 total, 8 up, 8 in 2024-01-13T19:02:22.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:22 smithi099 ceph-mon[138788]: pgmap v3821: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:22.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:22 smithi099 ceph-mon[138788]: osdmap e2231: 8 total, 8 up, 8 in 2024-01-13T19:02:22.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:22 smithi084 ceph-mon[119097]: pgmap v3821: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:22.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:22 smithi084 ceph-mon[119097]: osdmap e2231: 8 total, 8 up, 8 in 2024-01-13T19:02:22.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:22 smithi084 ceph-mon[116404]: pgmap v3821: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:22.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:22 smithi084 ceph-mon[116404]: osdmap e2231: 8 total, 8 up, 8 in 2024-01-13T19:02:23.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:23 smithi099 ceph-mon[138788]: osdmap e2232: 8 total, 8 up, 8 in 2024-01-13T19:02:23.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:23 smithi084 ceph-mon[116404]: osdmap e2232: 8 total, 8 up, 8 in 2024-01-13T19:02:23.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:23 smithi084 ceph-mon[119097]: osdmap e2232: 8 total, 8 up, 8 in 2024-01-13T19:02:24.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:24 smithi099 ceph-mon[138788]: pgmap v3824: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 674 KiB/s rd, 3.2 KiB/s wr, 906 op/s 2024-01-13T19:02:24.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:24 smithi099 ceph-mon[138788]: osdmap e2233: 8 total, 8 up, 8 in 2024-01-13T19:02:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:24 smithi084 ceph-mon[116404]: pgmap v3824: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 674 KiB/s rd, 3.2 KiB/s wr, 906 op/s 2024-01-13T19:02:24.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:24 smithi084 ceph-mon[116404]: osdmap e2233: 8 total, 8 up, 8 in 2024-01-13T19:02:24.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:24 smithi084 ceph-mon[119097]: pgmap v3824: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 674 KiB/s rd, 3.2 KiB/s wr, 906 op/s 2024-01-13T19:02:24.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:24 smithi084 ceph-mon[119097]: osdmap e2233: 8 total, 8 up, 8 in 2024-01-13T19:02:25.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:25 smithi099 ceph-mon[138788]: osdmap e2234: 8 total, 8 up, 8 in 2024-01-13T19:02:25.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:25 smithi084 ceph-mon[116404]: osdmap e2234: 8 total, 8 up, 8 in 2024-01-13T19:02:25.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:25 smithi084 ceph-mon[119097]: osdmap e2234: 8 total, 8 up, 8 in 2024-01-13T19:02:26.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:26 smithi099 ceph-mon[138788]: pgmap v3827: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 674 KiB/s rd, 3.7 KiB/s wr, 907 op/s 2024-01-13T19:02:26.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:26 smithi099 ceph-mon[138788]: osdmap e2235: 8 total, 8 up, 8 in 2024-01-13T19:02:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:26 smithi084 ceph-mon[116404]: pgmap v3827: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 674 KiB/s rd, 3.7 KiB/s wr, 907 op/s 2024-01-13T19:02:26.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:26 smithi084 ceph-mon[116404]: osdmap e2235: 8 total, 8 up, 8 in 2024-01-13T19:02:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:26 smithi084 ceph-mon[119097]: pgmap v3827: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 674 KiB/s rd, 3.7 KiB/s wr, 907 op/s 2024-01-13T19:02:26.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:26 smithi084 ceph-mon[119097]: osdmap e2235: 8 total, 8 up, 8 in 2024-01-13T19:02:27.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:27 smithi099 ceph-mon[138788]: osdmap e2236: 8 total, 8 up, 8 in 2024-01-13T19:02:27.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:27 smithi084 ceph-mon[116404]: osdmap e2236: 8 total, 8 up, 8 in 2024-01-13T19:02:27.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:27 smithi084 ceph-mon[119097]: osdmap e2236: 8 total, 8 up, 8 in 2024-01-13T19:02:28.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:28 smithi099 ceph-mon[138788]: pgmap v3830: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 702 KiB/s rd, 3.7 KiB/s wr, 945 op/s 2024-01-13T19:02:28.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:28 smithi099 ceph-mon[138788]: osdmap e2237: 8 total, 8 up, 8 in 2024-01-13T19:02:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:28 smithi084 ceph-mon[119097]: pgmap v3830: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 702 KiB/s rd, 3.7 KiB/s wr, 945 op/s 2024-01-13T19:02:28.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:28 smithi084 ceph-mon[119097]: osdmap e2237: 8 total, 8 up, 8 in 2024-01-13T19:02:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:28 smithi084 ceph-mon[116404]: pgmap v3830: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 702 KiB/s rd, 3.7 KiB/s wr, 945 op/s 2024-01-13T19:02:28.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:28 smithi084 ceph-mon[116404]: osdmap e2237: 8 total, 8 up, 8 in 2024-01-13T19:02:29.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:29 smithi099 ceph-mon[138788]: osdmap e2238: 8 total, 8 up, 8 in 2024-01-13T19:02:29.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:29 smithi084 ceph-mon[116404]: osdmap e2238: 8 total, 8 up, 8 in 2024-01-13T19:02:29.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:29 smithi084 ceph-mon[119097]: osdmap e2238: 8 total, 8 up, 8 in 2024-01-13T19:02:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:02:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:02:30] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:02:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:30 smithi084 ceph-mon[116404]: pgmap v3833: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 706 KiB/s rd, 3.5 KiB/s wr, 950 op/s 2024-01-13T19:02:30.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:30 smithi084 ceph-mon[116404]: osdmap e2239: 8 total, 8 up, 8 in 2024-01-13T19:02:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:30 smithi084 ceph-mon[119097]: pgmap v3833: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 706 KiB/s rd, 3.5 KiB/s wr, 950 op/s 2024-01-13T19:02:30.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:30 smithi084 ceph-mon[119097]: osdmap e2239: 8 total, 8 up, 8 in 2024-01-13T19:02:30.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:30 smithi099 ceph-mon[138788]: pgmap v3833: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 706 KiB/s rd, 3.5 KiB/s wr, 950 op/s 2024-01-13T19:02:30.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:30 smithi099 ceph-mon[138788]: osdmap e2239: 8 total, 8 up, 8 in 2024-01-13T19:02:31.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:31 smithi099 ceph-mon[138788]: osdmap e2240: 8 total, 8 up, 8 in 2024-01-13T19:02:31.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:31 smithi084 ceph-mon[116404]: osdmap e2240: 8 total, 8 up, 8 in 2024-01-13T19:02:31.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:31 smithi084 ceph-mon[119097]: osdmap e2240: 8 total, 8 up, 8 in 2024-01-13T19:02:32.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:32 smithi099 ceph-mon[138788]: pgmap v3836: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:32.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:32 smithi099 ceph-mon[138788]: osdmap e2241: 8 total, 8 up, 8 in 2024-01-13T19:02:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:32 smithi084 ceph-mon[116404]: pgmap v3836: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:32.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:32 smithi084 ceph-mon[116404]: osdmap e2241: 8 total, 8 up, 8 in 2024-01-13T19:02:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:32 smithi084 ceph-mon[119097]: pgmap v3836: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:32.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:32 smithi084 ceph-mon[119097]: osdmap e2241: 8 total, 8 up, 8 in 2024-01-13T19:02:33.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:33 smithi099 ceph-mon[138788]: osdmap e2242: 8 total, 8 up, 8 in 2024-01-13T19:02:33.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:33 smithi084 ceph-mon[116404]: osdmap e2242: 8 total, 8 up, 8 in 2024-01-13T19:02:33.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:33 smithi084 ceph-mon[119097]: osdmap e2242: 8 total, 8 up, 8 in 2024-01-13T19:02:34.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:34 smithi099 ceph-mon[138788]: pgmap v3839: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 739 KiB/s rd, 4.0 KiB/s wr, 994 op/s 2024-01-13T19:02:34.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:34 smithi099 ceph-mon[138788]: osdmap e2243: 8 total, 8 up, 8 in 2024-01-13T19:02:34.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:34 smithi084 ceph-mon[116404]: pgmap v3839: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 739 KiB/s rd, 4.0 KiB/s wr, 994 op/s 2024-01-13T19:02:34.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:34 smithi084 ceph-mon[116404]: osdmap e2243: 8 total, 8 up, 8 in 2024-01-13T19:02:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:34 smithi084 ceph-mon[119097]: pgmap v3839: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 739 KiB/s rd, 4.0 KiB/s wr, 994 op/s 2024-01-13T19:02:34.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:34 smithi084 ceph-mon[119097]: osdmap e2243: 8 total, 8 up, 8 in 2024-01-13T19:02:35.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:35 smithi099 ceph-mon[138788]: osdmap e2244: 8 total, 8 up, 8 in 2024-01-13T19:02:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:02:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:02:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:02:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:02:35.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[116404]: osdmap e2244: 8 total, 8 up, 8 in 2024-01-13T19:02:35.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:02:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:02:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:02:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:02:35.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[119097]: osdmap e2244: 8 total, 8 up, 8 in 2024-01-13T19:02:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:02:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:02:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:02:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:02:35.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:36.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:36 smithi099 ceph-mon[138788]: pgmap v3842: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 739 KiB/s rd, 4.0 KiB/s wr, 995 op/s 2024-01-13T19:02:36.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:36 smithi099 ceph-mon[138788]: osdmap e2245: 8 total, 8 up, 8 in 2024-01-13T19:02:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:36 smithi084 ceph-mon[116404]: pgmap v3842: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 739 KiB/s rd, 4.0 KiB/s wr, 995 op/s 2024-01-13T19:02:36.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:36 smithi084 ceph-mon[116404]: osdmap e2245: 8 total, 8 up, 8 in 2024-01-13T19:02:36.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:36 smithi084 ceph-mon[119097]: pgmap v3842: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 739 KiB/s rd, 4.0 KiB/s wr, 995 op/s 2024-01-13T19:02:36.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:36 smithi084 ceph-mon[119097]: osdmap e2245: 8 total, 8 up, 8 in 2024-01-13T19:02:37.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:37 smithi099 ceph-mon[138788]: osdmap e2246: 8 total, 8 up, 8 in 2024-01-13T19:02:37.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:37 smithi084 ceph-mon[116404]: osdmap e2246: 8 total, 8 up, 8 in 2024-01-13T19:02:37.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:37 smithi084 ceph-mon[119097]: osdmap e2246: 8 total, 8 up, 8 in 2024-01-13T19:02:38.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:38 smithi099 ceph-mon[138788]: pgmap v3845: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 767 KiB/s rd, 3.2 KiB/s wr, 1.03k op/s 2024-01-13T19:02:38.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:38 smithi099 ceph-mon[138788]: osdmap e2247: 8 total, 8 up, 8 in 2024-01-13T19:02:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:38 smithi084 ceph-mon[116404]: pgmap v3845: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 767 KiB/s rd, 3.2 KiB/s wr, 1.03k op/s 2024-01-13T19:02:38.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:38 smithi084 ceph-mon[116404]: osdmap e2247: 8 total, 8 up, 8 in 2024-01-13T19:02:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:38 smithi084 ceph-mon[119097]: pgmap v3845: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 767 KiB/s rd, 3.2 KiB/s wr, 1.03k op/s 2024-01-13T19:02:38.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:38 smithi084 ceph-mon[119097]: osdmap e2247: 8 total, 8 up, 8 in 2024-01-13T19:02:39.866 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:39 smithi099 ceph-mon[138788]: osdmap e2248: 8 total, 8 up, 8 in 2024-01-13T19:02:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:39 smithi084 ceph-mon[116404]: osdmap e2248: 8 total, 8 up, 8 in 2024-01-13T19:02:39.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:39 smithi084 ceph-mon[119097]: osdmap e2248: 8 total, 8 up, 8 in 2024-01-13T19:02:40.615 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:02:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:02:40] "GET /metrics HTTP/1.1" 200 36534 "" "Prometheus/2.43.0" 2024-01-13T19:02:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:40 smithi084 ceph-mon[116404]: pgmap v3848: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 771 KiB/s rd, 3.5 KiB/s wr, 1.04k op/s 2024-01-13T19:02:40.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:40 smithi084 ceph-mon[116404]: osdmap e2249: 8 total, 8 up, 8 in 2024-01-13T19:02:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:40 smithi084 ceph-mon[119097]: pgmap v3848: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 771 KiB/s rd, 3.5 KiB/s wr, 1.04k op/s 2024-01-13T19:02:40.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:40 smithi084 ceph-mon[119097]: osdmap e2249: 8 total, 8 up, 8 in 2024-01-13T19:02:41.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:40 smithi099 ceph-mon[138788]: pgmap v3848: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 771 KiB/s rd, 3.5 KiB/s wr, 1.04k op/s 2024-01-13T19:02:41.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:40 smithi099 ceph-mon[138788]: osdmap e2249: 8 total, 8 up, 8 in 2024-01-13T19:02:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:41 smithi084 ceph-mon[116404]: osdmap e2250: 8 total, 8 up, 8 in 2024-01-13T19:02:41.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:41 smithi084 ceph-mon[119097]: osdmap e2250: 8 total, 8 up, 8 in 2024-01-13T19:02:42.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:41 smithi099 ceph-mon[138788]: osdmap e2250: 8 total, 8 up, 8 in 2024-01-13T19:02:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:42 smithi084 ceph-mon[116404]: pgmap v3851: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:42 smithi084 ceph-mon[116404]: osdmap e2251: 8 total, 8 up, 8 in 2024-01-13T19:02:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:42 smithi084 ceph-mon[119097]: pgmap v3851: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:42.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:42 smithi084 ceph-mon[119097]: osdmap e2251: 8 total, 8 up, 8 in 2024-01-13T19:02:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:42 smithi099 ceph-mon[138788]: pgmap v3851: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-01-13T19:02:43.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:42 smithi099 ceph-mon[138788]: osdmap e2251: 8 total, 8 up, 8 in 2024-01-13T19:02:43.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:43 smithi084 ceph-mon[116404]: osdmap e2252: 8 total, 8 up, 8 in 2024-01-13T19:02:43.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:43 smithi084 ceph-mon[119097]: osdmap e2252: 8 total, 8 up, 8 in 2024-01-13T19:02:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:43 smithi099 ceph-mon[138788]: osdmap e2252: 8 total, 8 up, 8 in 2024-01-13T19:02:44.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:44 smithi084 ceph-mon[119097]: pgmap v3854: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 804 KiB/s rd, 3.2 KiB/s wr, 1.08k op/s 2024-01-13T19:02:44.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:44 smithi084 ceph-mon[119097]: osdmap e2253: 8 total, 8 up, 8 in 2024-01-13T19:02:44.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:44 smithi084 ceph-mon[116404]: pgmap v3854: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 804 KiB/s rd, 3.2 KiB/s wr, 1.08k op/s 2024-01-13T19:02:44.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:44 smithi084 ceph-mon[116404]: osdmap e2253: 8 total, 8 up, 8 in 2024-01-13T19:02:45.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:44 smithi099 ceph-mon[138788]: pgmap v3854: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 804 KiB/s rd, 3.2 KiB/s wr, 1.08k op/s 2024-01-13T19:02:45.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:44 smithi099 ceph-mon[138788]: osdmap e2253: 8 total, 8 up, 8 in 2024-01-13T19:02:45.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:45 smithi084 ceph-mon[116404]: osdmap e2254: 8 total, 8 up, 8 in 2024-01-13T19:02:45.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:45 smithi084 ceph-mon[119097]: osdmap e2254: 8 total, 8 up, 8 in 2024-01-13T19:02:46.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:45 smithi099 ceph-mon[138788]: osdmap e2254: 8 total, 8 up, 8 in 2024-01-13T19:02:46.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:46 smithi084 ceph-mon[116404]: pgmap v3857: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 804 KiB/s rd, 3.7 KiB/s wr, 1.08k op/s 2024-01-13T19:02:46.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:46 smithi084 ceph-mon[116404]: osdmap e2255: 8 total, 8 up, 8 in 2024-01-13T19:02:46.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:46 smithi084 ceph-mon[119097]: pgmap v3857: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 804 KiB/s rd, 3.7 KiB/s wr, 1.08k op/s 2024-01-13T19:02:46.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:46 smithi084 ceph-mon[119097]: osdmap e2255: 8 total, 8 up, 8 in 2024-01-13T19:02:47.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:46 smithi099 ceph-mon[138788]: pgmap v3857: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 804 KiB/s rd, 3.7 KiB/s wr, 1.08k op/s 2024-01-13T19:02:47.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:46 smithi099 ceph-mon[138788]: osdmap e2255: 8 total, 8 up, 8 in 2024-01-13T19:02:47.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:47 smithi084 ceph-mon[116404]: osdmap e2256: 8 total, 8 up, 8 in 2024-01-13T19:02:47.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:47 smithi084 ceph-mon[119097]: osdmap e2256: 8 total, 8 up, 8 in 2024-01-13T19:02:48.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:47 smithi099 ceph-mon[138788]: osdmap e2256: 8 total, 8 up, 8 in 2024-01-13T19:02:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:48 smithi084 ceph-mon[116404]: pgmap v3860: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 832 KiB/s rd, 3.5 KiB/s wr, 1.12k op/s 2024-01-13T19:02:48.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:48 smithi084 ceph-mon[116404]: osdmap e2257: 8 total, 8 up, 8 in 2024-01-13T19:02:48.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:48 smithi084 ceph-mon[119097]: pgmap v3860: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 832 KiB/s rd, 3.5 KiB/s wr, 1.12k op/s 2024-01-13T19:02:48.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:48 smithi084 ceph-mon[119097]: osdmap e2257: 8 total, 8 up, 8 in 2024-01-13T19:02:49.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:48 smithi099 ceph-mon[138788]: pgmap v3860: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 832 KiB/s rd, 3.5 KiB/s wr, 1.12k op/s 2024-01-13T19:02:49.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:48 smithi099 ceph-mon[138788]: osdmap e2257: 8 total, 8 up, 8 in 2024-01-13T19:02:49.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:49 smithi084 ceph-mon[116404]: osdmap e2258: 8 total, 8 up, 8 in 2024-01-13T19:02:49.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:49 smithi084 ceph-mon[119097]: osdmap e2258: 8 total, 8 up, 8 in 2024-01-13T19:02:50.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:49 smithi099 ceph-mon[138788]: osdmap e2258: 8 total, 8 up, 8 in 2024-01-13T19:02:50.672 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:02:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:02:50] "GET /metrics HTTP/1.1" 200 36536 "" "Prometheus/2.43.0" 2024-01-13T19:02:50.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:50 smithi084 ceph-mon[116404]: pgmap v3863: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 836 KiB/s rd, 3.7 KiB/s wr, 1.12k op/s 2024-01-13T19:02:50.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:50 smithi084 ceph-mon[116404]: osdmap e2259: 8 total, 8 up, 8 in 2024-01-13T19:02:50.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:50 smithi084 ceph-mon[119097]: pgmap v3863: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 836 KiB/s rd, 3.7 KiB/s wr, 1.12k op/s 2024-01-13T19:02:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:50 smithi084 ceph-mon[119097]: osdmap e2259: 8 total, 8 up, 8 in 2024-01-13T19:02:50.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:51.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:50 smithi099 ceph-mon[138788]: pgmap v3863: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 836 KiB/s rd, 3.7 KiB/s wr, 1.12k op/s 2024-01-13T19:02:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:50 smithi099 ceph-mon[138788]: osdmap e2259: 8 total, 8 up, 8 in 2024-01-13T19:02:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:02:52.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:51 smithi099 ceph-mon[138788]: osdmap e2260: 8 total, 8 up, 8 in 2024-01-13T19:02:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:51 smithi084 ceph-mon[116404]: osdmap e2260: 8 total, 8 up, 8 in 2024-01-13T19:02:52.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:51 smithi084 ceph-mon[119097]: osdmap e2260: 8 total, 8 up, 8 in 2024-01-13T19:02:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:52 smithi099 ceph-mon[138788]: pgmap v3866: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:02:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:52 smithi099 ceph-mon[138788]: osdmap e2261: 8 total, 8 up, 8 in 2024-01-13T19:02:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:52 smithi084 ceph-mon[116404]: pgmap v3866: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:02:53.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:52 smithi084 ceph-mon[116404]: osdmap e2261: 8 total, 8 up, 8 in 2024-01-13T19:02:53.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:52 smithi084 ceph-mon[119097]: pgmap v3866: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:02:53.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:52 smithi084 ceph-mon[119097]: osdmap e2261: 8 total, 8 up, 8 in 2024-01-13T19:02:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:53 smithi099 ceph-mon[138788]: osdmap e2262: 8 total, 8 up, 8 in 2024-01-13T19:02:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:53 smithi084 ceph-mon[116404]: osdmap e2262: 8 total, 8 up, 8 in 2024-01-13T19:02:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:53 smithi084 ceph-mon[119097]: osdmap e2262: 8 total, 8 up, 8 in 2024-01-13T19:02:55.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:54 smithi099 ceph-mon[138788]: pgmap v3869: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 869 KiB/s rd, 3.7 KiB/s wr, 1.17k op/s 2024-01-13T19:02:55.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:54 smithi099 ceph-mon[138788]: osdmap e2263: 8 total, 8 up, 8 in 2024-01-13T19:02:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:54 smithi084 ceph-mon[116404]: pgmap v3869: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 869 KiB/s rd, 3.7 KiB/s wr, 1.17k op/s 2024-01-13T19:02:55.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:54 smithi084 ceph-mon[116404]: osdmap e2263: 8 total, 8 up, 8 in 2024-01-13T19:02:55.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:54 smithi084 ceph-mon[119097]: pgmap v3869: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 869 KiB/s rd, 3.7 KiB/s wr, 1.17k op/s 2024-01-13T19:02:55.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:54 smithi084 ceph-mon[119097]: osdmap e2263: 8 total, 8 up, 8 in 2024-01-13T19:02:56.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:55 smithi099 ceph-mon[138788]: osdmap e2264: 8 total, 8 up, 8 in 2024-01-13T19:02:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:55 smithi084 ceph-mon[116404]: osdmap e2264: 8 total, 8 up, 8 in 2024-01-13T19:02:56.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:55 smithi084 ceph-mon[119097]: osdmap e2264: 8 total, 8 up, 8 in 2024-01-13T19:02:57.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:56 smithi099 ceph-mon[138788]: pgmap v3872: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 869 KiB/s rd, 4.2 KiB/s wr, 1.17k op/s 2024-01-13T19:02:57.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:56 smithi099 ceph-mon[138788]: osdmap e2265: 8 total, 8 up, 8 in 2024-01-13T19:02:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:56 smithi084 ceph-mon[116404]: pgmap v3872: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 869 KiB/s rd, 4.2 KiB/s wr, 1.17k op/s 2024-01-13T19:02:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:56 smithi084 ceph-mon[116404]: osdmap e2265: 8 total, 8 up, 8 in 2024-01-13T19:02:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:56 smithi084 ceph-mon[119097]: pgmap v3872: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 869 KiB/s rd, 4.2 KiB/s wr, 1.17k op/s 2024-01-13T19:02:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:56 smithi084 ceph-mon[119097]: osdmap e2265: 8 total, 8 up, 8 in 2024-01-13T19:02:58.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:57 smithi099 ceph-mon[138788]: osdmap e2266: 8 total, 8 up, 8 in 2024-01-13T19:02:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:57 smithi084 ceph-mon[116404]: osdmap e2266: 8 total, 8 up, 8 in 2024-01-13T19:02:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:57 smithi084 ceph-mon[119097]: osdmap e2266: 8 total, 8 up, 8 in 2024-01-13T19:02:59.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:58 smithi099 ceph-mon[138788]: pgmap v3875: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 898 KiB/s rd, 3.2 KiB/s wr, 1.21k op/s 2024-01-13T19:02:59.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:58 smithi099 ceph-mon[138788]: osdmap e2267: 8 total, 8 up, 8 in 2024-01-13T19:02:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:58 smithi084 ceph-mon[116404]: pgmap v3875: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 898 KiB/s rd, 3.2 KiB/s wr, 1.21k op/s 2024-01-13T19:02:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:58 smithi084 ceph-mon[116404]: osdmap e2267: 8 total, 8 up, 8 in 2024-01-13T19:02:59.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:58 smithi084 ceph-mon[119097]: pgmap v3875: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 898 KiB/s rd, 3.2 KiB/s wr, 1.21k op/s 2024-01-13T19:02:59.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:58 smithi084 ceph-mon[119097]: osdmap e2267: 8 total, 8 up, 8 in 2024-01-13T19:03:00.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:02:59 smithi099 ceph-mon[138788]: osdmap e2268: 8 total, 8 up, 8 in 2024-01-13T19:03:00.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:02:59 smithi084 ceph-mon[116404]: osdmap e2268: 8 total, 8 up, 8 in 2024-01-13T19:03:00.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:02:59 smithi084 ceph-mon[119097]: osdmap e2268: 8 total, 8 up, 8 in 2024-01-13T19:03:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:03:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:03:00] "GET /metrics HTTP/1.1" 200 36536 "" "Prometheus/2.43.0" 2024-01-13T19:03:01.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:00 smithi099 ceph-mon[138788]: pgmap v3878: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 901 KiB/s rd, 3.2 KiB/s wr, 1.22k op/s 2024-01-13T19:03:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:00 smithi099 ceph-mon[138788]: osdmap e2269: 8 total, 8 up, 8 in 2024-01-13T19:03:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:00 smithi084 ceph-mon[116404]: pgmap v3878: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 901 KiB/s rd, 3.2 KiB/s wr, 1.22k op/s 2024-01-13T19:03:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:00 smithi084 ceph-mon[116404]: osdmap e2269: 8 total, 8 up, 8 in 2024-01-13T19:03:01.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:00 smithi084 ceph-mon[119097]: pgmap v3878: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 901 KiB/s rd, 3.2 KiB/s wr, 1.22k op/s 2024-01-13T19:03:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:00 smithi084 ceph-mon[119097]: osdmap e2269: 8 total, 8 up, 8 in 2024-01-13T19:03:02.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:01 smithi099 ceph-mon[138788]: osdmap e2270: 8 total, 8 up, 8 in 2024-01-13T19:03:02.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:01 smithi084 ceph-mon[116404]: osdmap e2270: 8 total, 8 up, 8 in 2024-01-13T19:03:02.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:01 smithi084 ceph-mon[119097]: osdmap e2270: 8 total, 8 up, 8 in 2024-01-13T19:03:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:02 smithi099 ceph-mon[138788]: pgmap v3881: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.0 KiB/s rd, 767 B/s wr, 4 op/s 2024-01-13T19:03:03.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:02 smithi099 ceph-mon[138788]: osdmap e2271: 8 total, 8 up, 8 in 2024-01-13T19:03:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:02 smithi084 ceph-mon[116404]: pgmap v3881: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.0 KiB/s rd, 767 B/s wr, 4 op/s 2024-01-13T19:03:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:02 smithi084 ceph-mon[116404]: osdmap e2271: 8 total, 8 up, 8 in 2024-01-13T19:03:03.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:02 smithi084 ceph-mon[119097]: pgmap v3881: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.0 KiB/s rd, 767 B/s wr, 4 op/s 2024-01-13T19:03:03.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:02 smithi084 ceph-mon[119097]: osdmap e2271: 8 total, 8 up, 8 in 2024-01-13T19:03:04.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:03 smithi099 ceph-mon[138788]: osdmap e2272: 8 total, 8 up, 8 in 2024-01-13T19:03:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:03 smithi084 ceph-mon[116404]: osdmap e2272: 8 total, 8 up, 8 in 2024-01-13T19:03:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:03 smithi084 ceph-mon[119097]: osdmap e2272: 8 total, 8 up, 8 in 2024-01-13T19:03:05.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:04 smithi099 ceph-mon[138788]: pgmap v3884: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 935 KiB/s rd, 3.5 KiB/s wr, 1.26k op/s 2024-01-13T19:03:05.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:04 smithi099 ceph-mon[138788]: osdmap e2273: 8 total, 8 up, 8 in 2024-01-13T19:03:05.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:04 smithi084 ceph-mon[116404]: pgmap v3884: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 935 KiB/s rd, 3.5 KiB/s wr, 1.26k op/s 2024-01-13T19:03:05.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:04 smithi084 ceph-mon[116404]: osdmap e2273: 8 total, 8 up, 8 in 2024-01-13T19:03:05.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:04 smithi084 ceph-mon[119097]: pgmap v3884: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 935 KiB/s rd, 3.5 KiB/s wr, 1.26k op/s 2024-01-13T19:03:05.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:04 smithi084 ceph-mon[119097]: osdmap e2273: 8 total, 8 up, 8 in 2024-01-13T19:03:06.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:05 smithi099 ceph-mon[138788]: osdmap e2274: 8 total, 8 up, 8 in 2024-01-13T19:03:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:05 smithi084 ceph-mon[116404]: osdmap e2274: 8 total, 8 up, 8 in 2024-01-13T19:03:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:06.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:05 smithi084 ceph-mon[119097]: osdmap e2274: 8 total, 8 up, 8 in 2024-01-13T19:03:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:06 smithi099 ceph-mon[138788]: pgmap v3887: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 935 KiB/s rd, 3.7 KiB/s wr, 1.26k op/s 2024-01-13T19:03:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:06 smithi099 ceph-mon[138788]: osdmap e2275: 8 total, 8 up, 8 in 2024-01-13T19:03:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:06 smithi084 ceph-mon[116404]: pgmap v3887: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 935 KiB/s rd, 3.7 KiB/s wr, 1.26k op/s 2024-01-13T19:03:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:06 smithi084 ceph-mon[116404]: osdmap e2275: 8 total, 8 up, 8 in 2024-01-13T19:03:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:06 smithi084 ceph-mon[119097]: pgmap v3887: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 935 KiB/s rd, 3.7 KiB/s wr, 1.26k op/s 2024-01-13T19:03:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:06 smithi084 ceph-mon[119097]: osdmap e2275: 8 total, 8 up, 8 in 2024-01-13T19:03:08.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:07 smithi099 ceph-mon[138788]: osdmap e2276: 8 total, 8 up, 8 in 2024-01-13T19:03:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:07 smithi084 ceph-mon[116404]: osdmap e2276: 8 total, 8 up, 8 in 2024-01-13T19:03:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:07 smithi084 ceph-mon[119097]: osdmap e2276: 8 total, 8 up, 8 in 2024-01-13T19:03:09.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:08 smithi099 ceph-mon[138788]: pgmap v3890: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 769 KiB/s rd, 3.0 KiB/s wr, 1.04k op/s 2024-01-13T19:03:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:08 smithi099 ceph-mon[138788]: osdmap e2277: 8 total, 8 up, 8 in 2024-01-13T19:03:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:08 smithi084 ceph-mon[116404]: pgmap v3890: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 769 KiB/s rd, 3.0 KiB/s wr, 1.04k op/s 2024-01-13T19:03:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:08 smithi084 ceph-mon[116404]: osdmap e2277: 8 total, 8 up, 8 in 2024-01-13T19:03:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:08 smithi084 ceph-mon[119097]: pgmap v3890: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 769 KiB/s rd, 3.0 KiB/s wr, 1.04k op/s 2024-01-13T19:03:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:08 smithi084 ceph-mon[119097]: osdmap e2277: 8 total, 8 up, 8 in 2024-01-13T19:03:10.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:09 smithi099 ceph-mon[138788]: osdmap e2278: 8 total, 8 up, 8 in 2024-01-13T19:03:10.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:09 smithi084 ceph-mon[116404]: osdmap e2278: 8 total, 8 up, 8 in 2024-01-13T19:03:10.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:09 smithi084 ceph-mon[119097]: osdmap e2278: 8 total, 8 up, 8 in 2024-01-13T19:03:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:03:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:03:10] "GET /metrics HTTP/1.1" 200 36536 "" "Prometheus/2.43.0" 2024-01-13T19:03:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:10 smithi099 ceph-mon[138788]: pgmap v3893: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 772 KiB/s rd, 3.2 KiB/s wr, 1.04k op/s 2024-01-13T19:03:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:10 smithi099 ceph-mon[138788]: osdmap e2279: 8 total, 8 up, 8 in 2024-01-13T19:03:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:10 smithi084 ceph-mon[116404]: pgmap v3893: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 772 KiB/s rd, 3.2 KiB/s wr, 1.04k op/s 2024-01-13T19:03:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:10 smithi084 ceph-mon[116404]: osdmap e2279: 8 total, 8 up, 8 in 2024-01-13T19:03:11.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:10 smithi084 ceph-mon[119097]: pgmap v3893: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 772 KiB/s rd, 3.2 KiB/s wr, 1.04k op/s 2024-01-13T19:03:11.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:10 smithi084 ceph-mon[119097]: osdmap e2279: 8 total, 8 up, 8 in 2024-01-13T19:03:12.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:11 smithi099 ceph-mon[138788]: osdmap e2280: 8 total, 8 up, 8 in 2024-01-13T19:03:12.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:11 smithi099 ceph-mon[138788]: pgmap v3896: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:03:12.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:11 smithi084 ceph-mon[119097]: osdmap e2280: 8 total, 8 up, 8 in 2024-01-13T19:03:12.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:11 smithi084 ceph-mon[119097]: pgmap v3896: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:03:12.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:11 smithi084 ceph-mon[116404]: osdmap e2280: 8 total, 8 up, 8 in 2024-01-13T19:03:12.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:11 smithi084 ceph-mon[116404]: pgmap v3896: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:03:13.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:12 smithi099 ceph-mon[138788]: osdmap e2281: 8 total, 8 up, 8 in 2024-01-13T19:03:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:12 smithi084 ceph-mon[116404]: osdmap e2281: 8 total, 8 up, 8 in 2024-01-13T19:03:13.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:12 smithi084 ceph-mon[119097]: osdmap e2281: 8 total, 8 up, 8 in 2024-01-13T19:03:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:13 smithi084 ceph-mon[116404]: osdmap e2282: 8 total, 8 up, 8 in 2024-01-13T19:03:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:13 smithi084 ceph-mon[116404]: pgmap v3899: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 993 KiB/s rd, 3.2 KiB/s wr, 1.34k op/s 2024-01-13T19:03:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:13 smithi084 ceph-mon[119097]: osdmap e2282: 8 total, 8 up, 8 in 2024-01-13T19:03:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:13 smithi084 ceph-mon[119097]: pgmap v3899: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 993 KiB/s rd, 3.2 KiB/s wr, 1.34k op/s 2024-01-13T19:03:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:13 smithi099 ceph-mon[138788]: osdmap e2282: 8 total, 8 up, 8 in 2024-01-13T19:03:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:13 smithi099 ceph-mon[138788]: pgmap v3899: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 993 KiB/s rd, 3.2 KiB/s wr, 1.34k op/s 2024-01-13T19:03:15.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:14 smithi099 ceph-mon[138788]: osdmap e2283: 8 total, 8 up, 8 in 2024-01-13T19:03:15.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:14 smithi084 ceph-mon[116404]: osdmap e2283: 8 total, 8 up, 8 in 2024-01-13T19:03:15.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:14 smithi084 ceph-mon[119097]: osdmap e2283: 8 total, 8 up, 8 in 2024-01-13T19:03:16.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:15 smithi084 ceph-mon[116404]: osdmap e2284: 8 total, 8 up, 8 in 2024-01-13T19:03:16.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:15 smithi084 ceph-mon[116404]: pgmap v3902: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 993 KiB/s rd, 3.5 KiB/s wr, 1.34k op/s 2024-01-13T19:03:16.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:15 smithi084 ceph-mon[119097]: osdmap e2284: 8 total, 8 up, 8 in 2024-01-13T19:03:16.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:15 smithi084 ceph-mon[119097]: pgmap v3902: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 993 KiB/s rd, 3.5 KiB/s wr, 1.34k op/s 2024-01-13T19:03:16.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:15 smithi099 ceph-mon[138788]: osdmap e2284: 8 total, 8 up, 8 in 2024-01-13T19:03:16.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:15 smithi099 ceph-mon[138788]: pgmap v3902: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 993 KiB/s rd, 3.5 KiB/s wr, 1.34k op/s 2024-01-13T19:03:17.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:16 smithi084 ceph-mon[116404]: osdmap e2285: 8 total, 8 up, 8 in 2024-01-13T19:03:17.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:16 smithi084 ceph-mon[119097]: osdmap e2285: 8 total, 8 up, 8 in 2024-01-13T19:03:17.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:16 smithi099 ceph-mon[138788]: osdmap e2285: 8 total, 8 up, 8 in 2024-01-13T19:03:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:17 smithi084 ceph-mon[116404]: osdmap e2286: 8 total, 8 up, 8 in 2024-01-13T19:03:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:17 smithi084 ceph-mon[116404]: pgmap v3905: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 KiB/s rd, 3.2 KiB/s wr, 1.38k op/s 2024-01-13T19:03:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:17 smithi084 ceph-mon[119097]: osdmap e2286: 8 total, 8 up, 8 in 2024-01-13T19:03:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:17 smithi084 ceph-mon[119097]: pgmap v3905: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 KiB/s rd, 3.2 KiB/s wr, 1.38k op/s 2024-01-13T19:03:18.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:17 smithi099 ceph-mon[138788]: osdmap e2286: 8 total, 8 up, 8 in 2024-01-13T19:03:18.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:17 smithi099 ceph-mon[138788]: pgmap v3905: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 KiB/s rd, 3.2 KiB/s wr, 1.38k op/s 2024-01-13T19:03:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:18 smithi084 ceph-mon[116404]: osdmap e2287: 8 total, 8 up, 8 in 2024-01-13T19:03:19.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:18 smithi084 ceph-mon[119097]: osdmap e2287: 8 total, 8 up, 8 in 2024-01-13T19:03:19.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:18 smithi099 ceph-mon[138788]: osdmap e2287: 8 total, 8 up, 8 in 2024-01-13T19:03:20.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:19 smithi084 ceph-mon[116404]: osdmap e2288: 8 total, 8 up, 8 in 2024-01-13T19:03:20.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:19 smithi084 ceph-mon[116404]: pgmap v3908: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.7 KiB/s wr, 1.38k op/s 2024-01-13T19:03:20.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:19 smithi084 ceph-mon[119097]: osdmap e2288: 8 total, 8 up, 8 in 2024-01-13T19:03:20.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:19 smithi084 ceph-mon[119097]: pgmap v3908: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.7 KiB/s wr, 1.38k op/s 2024-01-13T19:03:20.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:19 smithi099 ceph-mon[138788]: osdmap e2288: 8 total, 8 up, 8 in 2024-01-13T19:03:20.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:19 smithi099 ceph-mon[138788]: pgmap v3908: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.7 KiB/s wr, 1.38k op/s 2024-01-13T19:03:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:03:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:03:20] "GET /metrics HTTP/1.1" 200 36538 "" "Prometheus/2.43.0" 2024-01-13T19:03:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:20 smithi084 ceph-mon[116404]: osdmap e2289: 8 total, 8 up, 8 in 2024-01-13T19:03:21.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:20 smithi084 ceph-mon[119097]: osdmap e2289: 8 total, 8 up, 8 in 2024-01-13T19:03:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:21.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:20 smithi099 ceph-mon[138788]: osdmap e2289: 8 total, 8 up, 8 in 2024-01-13T19:03:21.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:22.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:21 smithi084 ceph-mon[116404]: osdmap e2290: 8 total, 8 up, 8 in 2024-01-13T19:03:22.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:21 smithi084 ceph-mon[116404]: pgmap v3911: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:03:22.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:21 smithi084 ceph-mon[119097]: osdmap e2290: 8 total, 8 up, 8 in 2024-01-13T19:03:22.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:21 smithi084 ceph-mon[119097]: pgmap v3911: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:03:22.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:21 smithi099 ceph-mon[138788]: osdmap e2290: 8 total, 8 up, 8 in 2024-01-13T19:03:22.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:21 smithi099 ceph-mon[138788]: pgmap v3911: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:03:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:22 smithi084 ceph-mon[116404]: osdmap e2291: 8 total, 8 up, 8 in 2024-01-13T19:03:23.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:22 smithi084 ceph-mon[119097]: osdmap e2291: 8 total, 8 up, 8 in 2024-01-13T19:03:23.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:22 smithi099 ceph-mon[138788]: osdmap e2291: 8 total, 8 up, 8 in 2024-01-13T19:03:24.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:23 smithi099 ceph-mon[138788]: osdmap e2292: 8 total, 8 up, 8 in 2024-01-13T19:03:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:23 smithi099 ceph-mon[138788]: pgmap v3914: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.2 KiB/s wr, 1.43k op/s 2024-01-13T19:03:24.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:23 smithi084 ceph-mon[116404]: osdmap e2292: 8 total, 8 up, 8 in 2024-01-13T19:03:24.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:23 smithi084 ceph-mon[116404]: pgmap v3914: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.2 KiB/s wr, 1.43k op/s 2024-01-13T19:03:24.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:23 smithi084 ceph-mon[119097]: osdmap e2292: 8 total, 8 up, 8 in 2024-01-13T19:03:24.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:23 smithi084 ceph-mon[119097]: pgmap v3914: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.2 KiB/s wr, 1.43k op/s 2024-01-13T19:03:25.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:24 smithi099 ceph-mon[138788]: osdmap e2293: 8 total, 8 up, 8 in 2024-01-13T19:03:25.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:24 smithi084 ceph-mon[119097]: osdmap e2293: 8 total, 8 up, 8 in 2024-01-13T19:03:25.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:24 smithi084 ceph-mon[116404]: osdmap e2293: 8 total, 8 up, 8 in 2024-01-13T19:03:26.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:25 smithi099 ceph-mon[138788]: osdmap e2294: 8 total, 8 up, 8 in 2024-01-13T19:03:26.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:25 smithi099 ceph-mon[138788]: pgmap v3917: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.7 KiB/s wr, 1.43k op/s 2024-01-13T19:03:26.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:25 smithi084 ceph-mon[116404]: osdmap e2294: 8 total, 8 up, 8 in 2024-01-13T19:03:26.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:25 smithi084 ceph-mon[116404]: pgmap v3917: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.7 KiB/s wr, 1.43k op/s 2024-01-13T19:03:26.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:25 smithi084 ceph-mon[119097]: osdmap e2294: 8 total, 8 up, 8 in 2024-01-13T19:03:26.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:25 smithi084 ceph-mon[119097]: pgmap v3917: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.7 KiB/s wr, 1.43k op/s 2024-01-13T19:03:27.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:26 smithi099 ceph-mon[138788]: osdmap e2295: 8 total, 8 up, 8 in 2024-01-13T19:03:27.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:26 smithi084 ceph-mon[116404]: osdmap e2295: 8 total, 8 up, 8 in 2024-01-13T19:03:27.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:26 smithi084 ceph-mon[119097]: osdmap e2295: 8 total, 8 up, 8 in 2024-01-13T19:03:28.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:27 smithi099 ceph-mon[138788]: osdmap e2296: 8 total, 8 up, 8 in 2024-01-13T19:03:28.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:27 smithi099 ceph-mon[138788]: pgmap v3920: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.2 KiB/s wr, 1.47k op/s 2024-01-13T19:03:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:27 smithi084 ceph-mon[116404]: osdmap e2296: 8 total, 8 up, 8 in 2024-01-13T19:03:28.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:27 smithi084 ceph-mon[116404]: pgmap v3920: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.2 KiB/s wr, 1.47k op/s 2024-01-13T19:03:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:27 smithi084 ceph-mon[119097]: osdmap e2296: 8 total, 8 up, 8 in 2024-01-13T19:03:28.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:27 smithi084 ceph-mon[119097]: pgmap v3920: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.2 KiB/s wr, 1.47k op/s 2024-01-13T19:03:29.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:28 smithi099 ceph-mon[138788]: osdmap e2297: 8 total, 8 up, 8 in 2024-01-13T19:03:29.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:28 smithi084 ceph-mon[116404]: osdmap e2297: 8 total, 8 up, 8 in 2024-01-13T19:03:29.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:28 smithi084 ceph-mon[119097]: osdmap e2297: 8 total, 8 up, 8 in 2024-01-13T19:03:30.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:29 smithi084 ceph-mon[116404]: osdmap e2298: 8 total, 8 up, 8 in 2024-01-13T19:03:30.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:29 smithi084 ceph-mon[116404]: pgmap v3923: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.7 KiB/s wr, 1.47k op/s 2024-01-13T19:03:30.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:29 smithi084 ceph-mon[119097]: osdmap e2298: 8 total, 8 up, 8 in 2024-01-13T19:03:30.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:29 smithi084 ceph-mon[119097]: pgmap v3923: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.7 KiB/s wr, 1.47k op/s 2024-01-13T19:03:30.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:29 smithi099 ceph-mon[138788]: osdmap e2298: 8 total, 8 up, 8 in 2024-01-13T19:03:30.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:29 smithi099 ceph-mon[138788]: pgmap v3923: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.7 KiB/s wr, 1.47k op/s 2024-01-13T19:03:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:03:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:03:30] "GET /metrics HTTP/1.1" 200 36538 "" "Prometheus/2.43.0" 2024-01-13T19:03:31.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:30 smithi099 ceph-mon[138788]: osdmap e2299: 8 total, 8 up, 8 in 2024-01-13T19:03:31.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:30 smithi084 ceph-mon[116404]: osdmap e2299: 8 total, 8 up, 8 in 2024-01-13T19:03:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:30 smithi084 ceph-mon[119097]: osdmap e2299: 8 total, 8 up, 8 in 2024-01-13T19:03:32.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:31 smithi099 ceph-mon[138788]: osdmap e2300: 8 total, 8 up, 8 in 2024-01-13T19:03:32.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:31 smithi099 ceph-mon[138788]: pgmap v3926: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-01-13T19:03:32.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:31 smithi084 ceph-mon[116404]: osdmap e2300: 8 total, 8 up, 8 in 2024-01-13T19:03:32.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:31 smithi084 ceph-mon[116404]: pgmap v3926: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-01-13T19:03:32.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:32 smithi084 ceph-mon[119097]: osdmap e2300: 8 total, 8 up, 8 in 2024-01-13T19:03:32.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:32 smithi084 ceph-mon[119097]: pgmap v3926: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-01-13T19:03:33.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:33 smithi099 ceph-mon[138788]: osdmap e2301: 8 total, 8 up, 8 in 2024-01-13T19:03:33.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:33 smithi084 ceph-mon[116404]: osdmap e2301: 8 total, 8 up, 8 in 2024-01-13T19:03:33.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:33 smithi084 ceph-mon[119097]: osdmap e2301: 8 total, 8 up, 8 in 2024-01-13T19:03:34.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:34 smithi099 ceph-mon[138788]: pgmap v3928: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.5 KiB/s wr, 1.50k op/s 2024-01-13T19:03:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:34 smithi099 ceph-mon[138788]: osdmap e2302: 8 total, 8 up, 8 in 2024-01-13T19:03:34.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:34 smithi084 ceph-mon[116404]: pgmap v3928: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.5 KiB/s wr, 1.50k op/s 2024-01-13T19:03:34.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:34 smithi084 ceph-mon[116404]: osdmap e2302: 8 total, 8 up, 8 in 2024-01-13T19:03:34.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:34 smithi084 ceph-mon[119097]: pgmap v3928: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.5 KiB/s wr, 1.50k op/s 2024-01-13T19:03:34.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:34 smithi084 ceph-mon[119097]: osdmap e2302: 8 total, 8 up, 8 in 2024-01-13T19:03:35.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:35 smithi099 ceph-mon[138788]: osdmap e2303: 8 total, 8 up, 8 in 2024-01-13T19:03:35.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:35 smithi084 ceph-mon[116404]: osdmap e2303: 8 total, 8 up, 8 in 2024-01-13T19:03:35.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:35 smithi084 ceph-mon[119097]: osdmap e2303: 8 total, 8 up, 8 in 2024-01-13T19:03:36.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:36 smithi099 ceph-mon[138788]: pgmap v3931: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.5 KiB/s wr, 1.51k op/s 2024-01-13T19:03:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:36 smithi099 ceph-mon[138788]: osdmap e2304: 8 total, 8 up, 8 in 2024-01-13T19:03:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:03:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:03:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:03:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:03:36.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[116404]: pgmap v3931: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.5 KiB/s wr, 1.51k op/s 2024-01-13T19:03:36.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[116404]: osdmap e2304: 8 total, 8 up, 8 in 2024-01-13T19:03:36.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:36.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:03:36.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:03:36.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:03:36.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:03:36.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[119097]: pgmap v3931: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.5 KiB/s wr, 1.51k op/s 2024-01-13T19:03:36.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[119097]: osdmap e2304: 8 total, 8 up, 8 in 2024-01-13T19:03:36.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:36.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:03:36.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:03:36.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:03:36.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:03:37.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:37 smithi099 ceph-mon[138788]: osdmap e2305: 8 total, 8 up, 8 in 2024-01-13T19:03:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:37 smithi084 ceph-mon[116404]: osdmap e2305: 8 total, 8 up, 8 in 2024-01-13T19:03:37.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:37 smithi084 ceph-mon[119097]: osdmap e2305: 8 total, 8 up, 8 in 2024-01-13T19:03:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:38 smithi099 ceph-mon[138788]: pgmap v3934: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.0 KiB/s wr, 1.55k op/s 2024-01-13T19:03:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:38 smithi099 ceph-mon[138788]: osdmap e2306: 8 total, 8 up, 8 in 2024-01-13T19:03:38.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:38 smithi084 ceph-mon[116404]: pgmap v3934: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.0 KiB/s wr, 1.55k op/s 2024-01-13T19:03:38.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:38 smithi084 ceph-mon[116404]: osdmap e2306: 8 total, 8 up, 8 in 2024-01-13T19:03:38.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:38 smithi084 ceph-mon[119097]: pgmap v3934: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.0 KiB/s wr, 1.55k op/s 2024-01-13T19:03:38.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:38 smithi084 ceph-mon[119097]: osdmap e2306: 8 total, 8 up, 8 in 2024-01-13T19:03:39.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:39 smithi099 ceph-mon[138788]: osdmap e2307: 8 total, 8 up, 8 in 2024-01-13T19:03:39.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:39 smithi084 ceph-mon[116404]: osdmap e2307: 8 total, 8 up, 8 in 2024-01-13T19:03:39.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:39 smithi084 ceph-mon[119097]: osdmap e2307: 8 total, 8 up, 8 in 2024-01-13T19:03:40.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:40 smithi099 ceph-mon[138788]: pgmap v3937: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.7 KiB/s wr, 1.56k op/s 2024-01-13T19:03:40.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:40 smithi099 ceph-mon[138788]: osdmap e2308: 8 total, 8 up, 8 in 2024-01-13T19:03:40.426 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:03:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:03:40] "GET /metrics HTTP/1.1" 200 36535 "" "Prometheus/2.43.0" 2024-01-13T19:03:40.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:40 smithi084 ceph-mon[116404]: pgmap v3937: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.7 KiB/s wr, 1.56k op/s 2024-01-13T19:03:40.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:40 smithi084 ceph-mon[116404]: osdmap e2308: 8 total, 8 up, 8 in 2024-01-13T19:03:40.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:40 smithi084 ceph-mon[119097]: pgmap v3937: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 3.7 KiB/s wr, 1.56k op/s 2024-01-13T19:03:40.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:40 smithi084 ceph-mon[119097]: osdmap e2308: 8 total, 8 up, 8 in 2024-01-13T19:03:41.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:41 smithi099 ceph-mon[138788]: osdmap e2309: 8 total, 8 up, 8 in 2024-01-13T19:03:41.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:41 smithi084 ceph-mon[116404]: osdmap e2309: 8 total, 8 up, 8 in 2024-01-13T19:03:41.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:41 smithi084 ceph-mon[119097]: osdmap e2309: 8 total, 8 up, 8 in 2024-01-13T19:03:42.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:42 smithi099 ceph-mon[138788]: pgmap v3940: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-01-13T19:03:42.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:42 smithi099 ceph-mon[138788]: osdmap e2310: 8 total, 8 up, 8 in 2024-01-13T19:03:42.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:42 smithi084 ceph-mon[116404]: pgmap v3940: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-01-13T19:03:42.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:42 smithi084 ceph-mon[116404]: osdmap e2310: 8 total, 8 up, 8 in 2024-01-13T19:03:42.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:42 smithi084 ceph-mon[119097]: pgmap v3940: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-01-13T19:03:42.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:42 smithi084 ceph-mon[119097]: osdmap e2310: 8 total, 8 up, 8 in 2024-01-13T19:03:43.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:43 smithi099 ceph-mon[138788]: osdmap e2311: 8 total, 8 up, 8 in 2024-01-13T19:03:43.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:43 smithi084 ceph-mon[116404]: osdmap e2311: 8 total, 8 up, 8 in 2024-01-13T19:03:43.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:43 smithi084 ceph-mon[119097]: osdmap e2311: 8 total, 8 up, 8 in 2024-01-13T19:03:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:44 smithi099 ceph-mon[138788]: pgmap v3943: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.0 KiB/s wr, 1.60k op/s 2024-01-13T19:03:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:44 smithi099 ceph-mon[138788]: osdmap e2312: 8 total, 8 up, 8 in 2024-01-13T19:03:44.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:44 smithi084 ceph-mon[116404]: pgmap v3943: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.0 KiB/s wr, 1.60k op/s 2024-01-13T19:03:44.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:44 smithi084 ceph-mon[116404]: osdmap e2312: 8 total, 8 up, 8 in 2024-01-13T19:03:44.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:44 smithi084 ceph-mon[119097]: pgmap v3943: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.0 KiB/s wr, 1.60k op/s 2024-01-13T19:03:44.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:44 smithi084 ceph-mon[119097]: osdmap e2312: 8 total, 8 up, 8 in 2024-01-13T19:03:45.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:45 smithi084 ceph-mon[116404]: osdmap e2313: 8 total, 8 up, 8 in 2024-01-13T19:03:45.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:45 smithi084 ceph-mon[119097]: osdmap e2313: 8 total, 8 up, 8 in 2024-01-13T19:03:45.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:45 smithi099 ceph-mon[138788]: osdmap e2313: 8 total, 8 up, 8 in 2024-01-13T19:03:46.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:46 smithi084 ceph-mon[116404]: pgmap v3946: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 4.0 KiB/s wr, 1.60k op/s 2024-01-13T19:03:46.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:46 smithi084 ceph-mon[116404]: osdmap e2314: 8 total, 8 up, 8 in 2024-01-13T19:03:46.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:46 smithi084 ceph-mon[119097]: pgmap v3946: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 4.0 KiB/s wr, 1.60k op/s 2024-01-13T19:03:46.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:46 smithi084 ceph-mon[119097]: osdmap e2314: 8 total, 8 up, 8 in 2024-01-13T19:03:46.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:46 smithi099 ceph-mon[138788]: pgmap v3946: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 4.0 KiB/s wr, 1.60k op/s 2024-01-13T19:03:46.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:46 smithi099 ceph-mon[138788]: osdmap e2314: 8 total, 8 up, 8 in 2024-01-13T19:03:47.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:47 smithi084 ceph-mon[116404]: osdmap e2315: 8 total, 8 up, 8 in 2024-01-13T19:03:47.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:47 smithi084 ceph-mon[119097]: osdmap e2315: 8 total, 8 up, 8 in 2024-01-13T19:03:47.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:47 smithi099 ceph-mon[138788]: osdmap e2315: 8 total, 8 up, 8 in 2024-01-13T19:03:48.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:48 smithi084 ceph-mon[116404]: pgmap v3949: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.7 KiB/s wr, 1.64k op/s 2024-01-13T19:03:48.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:48 smithi084 ceph-mon[116404]: osdmap e2316: 8 total, 8 up, 8 in 2024-01-13T19:03:48.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:48 smithi084 ceph-mon[119097]: pgmap v3949: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.7 KiB/s wr, 1.64k op/s 2024-01-13T19:03:48.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:48 smithi084 ceph-mon[119097]: osdmap e2316: 8 total, 8 up, 8 in 2024-01-13T19:03:48.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:48 smithi099 ceph-mon[138788]: pgmap v3949: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.7 KiB/s wr, 1.64k op/s 2024-01-13T19:03:48.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:48 smithi099 ceph-mon[138788]: osdmap e2316: 8 total, 8 up, 8 in 2024-01-13T19:03:49.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:49 smithi084 ceph-mon[116404]: osdmap e2317: 8 total, 8 up, 8 in 2024-01-13T19:03:49.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:49 smithi084 ceph-mon[119097]: osdmap e2317: 8 total, 8 up, 8 in 2024-01-13T19:03:49.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:49 smithi099 ceph-mon[138788]: osdmap e2317: 8 total, 8 up, 8 in 2024-01-13T19:03:50.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:50 smithi084 ceph-mon[116404]: pgmap v3952: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.5 KiB/s wr, 1.65k op/s 2024-01-13T19:03:50.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:50 smithi084 ceph-mon[116404]: osdmap e2318: 8 total, 8 up, 8 in 2024-01-13T19:03:50.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:50.427 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:03:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:03:50] "GET /metrics HTTP/1.1" 200 36535 "" "Prometheus/2.43.0" 2024-01-13T19:03:50.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:50 smithi084 ceph-mon[119097]: pgmap v3952: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.5 KiB/s wr, 1.65k op/s 2024-01-13T19:03:50.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:50 smithi084 ceph-mon[119097]: osdmap e2318: 8 total, 8 up, 8 in 2024-01-13T19:03:50.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:50.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:50 smithi099 ceph-mon[138788]: pgmap v3952: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.5 KiB/s wr, 1.65k op/s 2024-01-13T19:03:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:50 smithi099 ceph-mon[138788]: osdmap e2318: 8 total, 8 up, 8 in 2024-01-13T19:03:50.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:03:51.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:51 smithi084 ceph-mon[119097]: osdmap e2319: 8 total, 8 up, 8 in 2024-01-13T19:03:51.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:51 smithi084 ceph-mon[116404]: osdmap e2319: 8 total, 8 up, 8 in 2024-01-13T19:03:51.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:51 smithi099 ceph-mon[138788]: osdmap e2319: 8 total, 8 up, 8 in 2024-01-13T19:03:52.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:52 smithi084 ceph-mon[116404]: pgmap v3955: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:03:52.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:52 smithi084 ceph-mon[116404]: osdmap e2320: 8 total, 8 up, 8 in 2024-01-13T19:03:52.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:52 smithi084 ceph-mon[119097]: pgmap v3955: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:03:52.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:52 smithi084 ceph-mon[119097]: osdmap e2320: 8 total, 8 up, 8 in 2024-01-13T19:03:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:52 smithi099 ceph-mon[138788]: pgmap v3955: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-01-13T19:03:52.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:52 smithi099 ceph-mon[138788]: osdmap e2320: 8 total, 8 up, 8 in 2024-01-13T19:03:53.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:53 smithi099 ceph-mon[138788]: osdmap e2321: 8 total, 8 up, 8 in 2024-01-13T19:03:53.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:53 smithi084 ceph-mon[116404]: osdmap e2321: 8 total, 8 up, 8 in 2024-01-13T19:03:53.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:53 smithi084 ceph-mon[119097]: osdmap e2321: 8 total, 8 up, 8 in 2024-01-13T19:03:54.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:54 smithi099 ceph-mon[138788]: pgmap v3958: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.2 KiB/s wr, 1.69k op/s 2024-01-13T19:03:54.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:54 smithi099 ceph-mon[138788]: osdmap e2322: 8 total, 8 up, 8 in 2024-01-13T19:03:54.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:54 smithi084 ceph-mon[116404]: pgmap v3958: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.2 KiB/s wr, 1.69k op/s 2024-01-13T19:03:54.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:54 smithi084 ceph-mon[116404]: osdmap e2322: 8 total, 8 up, 8 in 2024-01-13T19:03:54.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:54 smithi084 ceph-mon[119097]: pgmap v3958: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.2 KiB/s wr, 1.69k op/s 2024-01-13T19:03:54.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:54 smithi084 ceph-mon[119097]: osdmap e2322: 8 total, 8 up, 8 in 2024-01-13T19:03:55.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:55 smithi099 ceph-mon[138788]: osdmap e2323: 8 total, 8 up, 8 in 2024-01-13T19:03:55.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:55 smithi084 ceph-mon[116404]: osdmap e2323: 8 total, 8 up, 8 in 2024-01-13T19:03:55.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:55 smithi084 ceph-mon[119097]: osdmap e2323: 8 total, 8 up, 8 in 2024-01-13T19:03:56.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:56 smithi099 ceph-mon[138788]: pgmap v3961: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.7 KiB/s wr, 1.69k op/s 2024-01-13T19:03:56.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:56 smithi099 ceph-mon[138788]: osdmap e2324: 8 total, 8 up, 8 in 2024-01-13T19:03:56.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:56 smithi084 ceph-mon[116404]: pgmap v3961: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.7 KiB/s wr, 1.69k op/s 2024-01-13T19:03:56.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:56 smithi084 ceph-mon[116404]: osdmap e2324: 8 total, 8 up, 8 in 2024-01-13T19:03:56.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:56 smithi084 ceph-mon[119097]: pgmap v3961: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.7 KiB/s wr, 1.69k op/s 2024-01-13T19:03:56.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:56 smithi084 ceph-mon[119097]: osdmap e2324: 8 total, 8 up, 8 in 2024-01-13T19:03:57.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:57 smithi099 ceph-mon[138788]: osdmap e2325: 8 total, 8 up, 8 in 2024-01-13T19:03:57.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:57 smithi084 ceph-mon[116404]: osdmap e2325: 8 total, 8 up, 8 in 2024-01-13T19:03:57.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:57 smithi084 ceph-mon[119097]: osdmap e2325: 8 total, 8 up, 8 in 2024-01-13T19:03:58.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:58 smithi099 ceph-mon[138788]: pgmap v3964: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 3.5 KiB/s wr, 1.73k op/s 2024-01-13T19:03:58.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:58 smithi099 ceph-mon[138788]: osdmap e2326: 8 total, 8 up, 8 in 2024-01-13T19:03:58.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:58 smithi084 ceph-mon[116404]: pgmap v3964: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 3.5 KiB/s wr, 1.73k op/s 2024-01-13T19:03:58.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:58 smithi084 ceph-mon[116404]: osdmap e2326: 8 total, 8 up, 8 in 2024-01-13T19:03:58.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:58 smithi084 ceph-mon[119097]: pgmap v3964: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 3.5 KiB/s wr, 1.73k op/s 2024-01-13T19:03:58.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:58 smithi084 ceph-mon[119097]: osdmap e2326: 8 total, 8 up, 8 in 2024-01-13T19:03:59.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:03:59 smithi099 ceph-mon[138788]: osdmap e2327: 8 total, 8 up, 8 in 2024-01-13T19:03:59.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:03:59 smithi084 ceph-mon[116404]: osdmap e2327: 8 total, 8 up, 8 in 2024-01-13T19:03:59.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:03:59 smithi084 ceph-mon[119097]: osdmap e2327: 8 total, 8 up, 8 in 2024-01-13T19:04:00.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:00 smithi099 ceph-mon[138788]: pgmap v3967: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 3.7 KiB/s wr, 1.74k op/s 2024-01-13T19:04:00.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:00 smithi099 ceph-mon[138788]: osdmap e2328: 8 total, 8 up, 8 in 2024-01-13T19:04:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:04:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:04:00] "GET /metrics HTTP/1.1" 200 36535 "" "Prometheus/2.43.0" 2024-01-13T19:04:00.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:00 smithi084 ceph-mon[116404]: pgmap v3967: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 3.7 KiB/s wr, 1.74k op/s 2024-01-13T19:04:00.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:00 smithi084 ceph-mon[116404]: osdmap e2328: 8 total, 8 up, 8 in 2024-01-13T19:04:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:00 smithi084 ceph-mon[119097]: pgmap v3967: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 3.7 KiB/s wr, 1.74k op/s 2024-01-13T19:04:00.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:00 smithi084 ceph-mon[119097]: osdmap e2328: 8 total, 8 up, 8 in 2024-01-13T19:04:01.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:01 smithi099 ceph-mon[138788]: osdmap e2329: 8 total, 8 up, 8 in 2024-01-13T19:04:01.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:01 smithi084 ceph-mon[116404]: osdmap e2329: 8 total, 8 up, 8 in 2024-01-13T19:04:01.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:01 smithi084 ceph-mon[119097]: osdmap e2329: 8 total, 8 up, 8 in 2024-01-13T19:04:02.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:02 smithi099 ceph-mon[138788]: pgmap v3970: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-01-13T19:04:02.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:02 smithi099 ceph-mon[138788]: osdmap e2330: 8 total, 8 up, 8 in 2024-01-13T19:04:02.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:02 smithi084 ceph-mon[116404]: pgmap v3970: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-01-13T19:04:02.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:02 smithi084 ceph-mon[116404]: osdmap e2330: 8 total, 8 up, 8 in 2024-01-13T19:04:02.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:02 smithi084 ceph-mon[119097]: pgmap v3970: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-01-13T19:04:02.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:02 smithi084 ceph-mon[119097]: osdmap e2330: 8 total, 8 up, 8 in 2024-01-13T19:04:03.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:03 smithi099 ceph-mon[138788]: osdmap e2331: 8 total, 8 up, 8 in 2024-01-13T19:04:03.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:03 smithi084 ceph-mon[116404]: osdmap e2331: 8 total, 8 up, 8 in 2024-01-13T19:04:03.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:03 smithi084 ceph-mon[119097]: osdmap e2331: 8 total, 8 up, 8 in 2024-01-13T19:04:04.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:04 smithi099 ceph-mon[138788]: pgmap v3973: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 4.2 KiB/s wr, 1.78k op/s 2024-01-13T19:04:04.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:04 smithi099 ceph-mon[138788]: osdmap e2332: 8 total, 8 up, 8 in 2024-01-13T19:04:04.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:04 smithi084 ceph-mon[119097]: pgmap v3973: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 4.2 KiB/s wr, 1.78k op/s 2024-01-13T19:04:04.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:04 smithi084 ceph-mon[119097]: osdmap e2332: 8 total, 8 up, 8 in 2024-01-13T19:04:04.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:04 smithi084 ceph-mon[116404]: pgmap v3973: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 4.2 KiB/s wr, 1.78k op/s 2024-01-13T19:04:04.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:04 smithi084 ceph-mon[116404]: osdmap e2332: 8 total, 8 up, 8 in 2024-01-13T19:04:05.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:05 smithi099 ceph-mon[138788]: osdmap e2333: 8 total, 8 up, 8 in 2024-01-13T19:04:05.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:05.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:05 smithi084 ceph-mon[116404]: osdmap e2333: 8 total, 8 up, 8 in 2024-01-13T19:04:05.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:05.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:05 smithi084 ceph-mon[119097]: osdmap e2333: 8 total, 8 up, 8 in 2024-01-13T19:04:05.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:06.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:06 smithi099 ceph-mon[138788]: pgmap v3976: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 4.0 KiB/s wr, 1.78k op/s 2024-01-13T19:04:06.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:06 smithi099 ceph-mon[138788]: osdmap e2334: 8 total, 8 up, 8 in 2024-01-13T19:04:06.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:06 smithi084 ceph-mon[116404]: pgmap v3976: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 4.0 KiB/s wr, 1.78k op/s 2024-01-13T19:04:06.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:06 smithi084 ceph-mon[116404]: osdmap e2334: 8 total, 8 up, 8 in 2024-01-13T19:04:06.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:06 smithi084 ceph-mon[119097]: pgmap v3976: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 4.0 KiB/s wr, 1.78k op/s 2024-01-13T19:04:06.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:06 smithi084 ceph-mon[119097]: osdmap e2334: 8 total, 8 up, 8 in 2024-01-13T19:04:07.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:07 smithi099 ceph-mon[138788]: osdmap e2335: 8 total, 8 up, 8 in 2024-01-13T19:04:07.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:07 smithi084 ceph-mon[116404]: osdmap e2335: 8 total, 8 up, 8 in 2024-01-13T19:04:07.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:07 smithi084 ceph-mon[119097]: osdmap e2335: 8 total, 8 up, 8 in 2024-01-13T19:04:08.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:08 smithi099 ceph-mon[138788]: pgmap v3979: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.78k op/s 2024-01-13T19:04:08.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:08 smithi099 ceph-mon[138788]: osdmap e2336: 8 total, 8 up, 8 in 2024-01-13T19:04:08.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:08 smithi084 ceph-mon[116404]: pgmap v3979: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.78k op/s 2024-01-13T19:04:08.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:08 smithi084 ceph-mon[116404]: osdmap e2336: 8 total, 8 up, 8 in 2024-01-13T19:04:08.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:08 smithi084 ceph-mon[119097]: pgmap v3979: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.78k op/s 2024-01-13T19:04:08.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:08 smithi084 ceph-mon[119097]: osdmap e2336: 8 total, 8 up, 8 in 2024-01-13T19:04:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:09 smithi099 ceph-mon[138788]: osdmap e2337: 8 total, 8 up, 8 in 2024-01-13T19:04:09.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:09 smithi099 ceph-mon[138788]: osdmap e2338: 8 total, 8 up, 8 in 2024-01-13T19:04:09.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:09 smithi084 ceph-mon[119097]: osdmap e2337: 8 total, 8 up, 8 in 2024-01-13T19:04:09.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:09 smithi084 ceph-mon[119097]: osdmap e2338: 8 total, 8 up, 8 in 2024-01-13T19:04:09.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:09 smithi084 ceph-mon[116404]: osdmap e2337: 8 total, 8 up, 8 in 2024-01-13T19:04:09.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:09 smithi084 ceph-mon[116404]: osdmap e2338: 8 total, 8 up, 8 in 2024-01-13T19:04:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:04:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:04:10] "GET /metrics HTTP/1.1" 200 36539 "" "Prometheus/2.43.0" 2024-01-13T19:04:11.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:10 smithi099 ceph-mon[138788]: pgmap v3983: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.4 MiB/s rd, 5.4 KiB/s wr, 1.91k op/s 2024-01-13T19:04:11.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:10 smithi099 ceph-mon[138788]: osdmap e2339: 8 total, 8 up, 8 in 2024-01-13T19:04:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:10 smithi084 ceph-mon[116404]: pgmap v3983: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.4 MiB/s rd, 5.4 KiB/s wr, 1.91k op/s 2024-01-13T19:04:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:10 smithi084 ceph-mon[116404]: osdmap e2339: 8 total, 8 up, 8 in 2024-01-13T19:04:11.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:10 smithi084 ceph-mon[119097]: pgmap v3983: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.4 MiB/s rd, 5.4 KiB/s wr, 1.91k op/s 2024-01-13T19:04:11.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:10 smithi084 ceph-mon[119097]: osdmap e2339: 8 total, 8 up, 8 in 2024-01-13T19:04:12.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:11 smithi099 ceph-mon[138788]: osdmap e2340: 8 total, 8 up, 8 in 2024-01-13T19:04:12.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:11 smithi084 ceph-mon[116404]: osdmap e2340: 8 total, 8 up, 8 in 2024-01-13T19:04:12.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:11 smithi084 ceph-mon[119097]: osdmap e2340: 8 total, 8 up, 8 in 2024-01-13T19:04:13.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:12 smithi099 ceph-mon[138788]: pgmap v3986: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:04:13.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:12 smithi099 ceph-mon[138788]: osdmap e2341: 8 total, 8 up, 8 in 2024-01-13T19:04:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:12 smithi084 ceph-mon[116404]: pgmap v3986: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:04:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:12 smithi084 ceph-mon[116404]: osdmap e2341: 8 total, 8 up, 8 in 2024-01-13T19:04:13.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:12 smithi084 ceph-mon[119097]: pgmap v3986: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:04:13.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:12 smithi084 ceph-mon[119097]: osdmap e2341: 8 total, 8 up, 8 in 2024-01-13T19:04:14.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:13 smithi099 ceph-mon[138788]: osdmap e2342: 8 total, 8 up, 8 in 2024-01-13T19:04:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:13 smithi099 ceph-mon[138788]: pgmap v3989: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.73k op/s 2024-01-13T19:04:14.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:13 smithi099 ceph-mon[138788]: osdmap e2343: 8 total, 8 up, 8 in 2024-01-13T19:04:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:13 smithi084 ceph-mon[116404]: osdmap e2342: 8 total, 8 up, 8 in 2024-01-13T19:04:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:13 smithi084 ceph-mon[116404]: pgmap v3989: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.73k op/s 2024-01-13T19:04:14.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:13 smithi084 ceph-mon[116404]: osdmap e2343: 8 total, 8 up, 8 in 2024-01-13T19:04:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:13 smithi084 ceph-mon[119097]: osdmap e2342: 8 total, 8 up, 8 in 2024-01-13T19:04:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:13 smithi084 ceph-mon[119097]: pgmap v3989: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.73k op/s 2024-01-13T19:04:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:13 smithi084 ceph-mon[119097]: osdmap e2343: 8 total, 8 up, 8 in 2024-01-13T19:04:16.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:15 smithi099 ceph-mon[138788]: osdmap e2344: 8 total, 8 up, 8 in 2024-01-13T19:04:16.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:15 smithi099 ceph-mon[138788]: pgmap v3992: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.73k op/s 2024-01-13T19:04:16.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:15 smithi084 ceph-mon[116404]: osdmap e2344: 8 total, 8 up, 8 in 2024-01-13T19:04:16.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:15 smithi084 ceph-mon[116404]: pgmap v3992: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.73k op/s 2024-01-13T19:04:16.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:15 smithi084 ceph-mon[119097]: osdmap e2344: 8 total, 8 up, 8 in 2024-01-13T19:04:16.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:15 smithi084 ceph-mon[119097]: pgmap v3992: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.0 KiB/s wr, 1.73k op/s 2024-01-13T19:04:17.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:16 smithi084 ceph-mon[116404]: osdmap e2345: 8 total, 8 up, 8 in 2024-01-13T19:04:17.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:16 smithi084 ceph-mon[119097]: osdmap e2345: 8 total, 8 up, 8 in 2024-01-13T19:04:17.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:16 smithi099 ceph-mon[138788]: osdmap e2345: 8 total, 8 up, 8 in 2024-01-13T19:04:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:17 smithi084 ceph-mon[116404]: osdmap e2346: 8 total, 8 up, 8 in 2024-01-13T19:04:18.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:17 smithi084 ceph-mon[116404]: pgmap v3995: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.69k op/s 2024-01-13T19:04:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:17 smithi084 ceph-mon[119097]: osdmap e2346: 8 total, 8 up, 8 in 2024-01-13T19:04:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:17 smithi084 ceph-mon[119097]: pgmap v3995: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.69k op/s 2024-01-13T19:04:18.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:17 smithi099 ceph-mon[138788]: osdmap e2346: 8 total, 8 up, 8 in 2024-01-13T19:04:18.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:17 smithi099 ceph-mon[138788]: pgmap v3995: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.69k op/s 2024-01-13T19:04:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:18 smithi084 ceph-mon[116404]: osdmap e2347: 8 total, 8 up, 8 in 2024-01-13T19:04:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:18 smithi084 ceph-mon[116404]: osdmap e2348: 8 total, 8 up, 8 in 2024-01-13T19:04:19.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:18 smithi084 ceph-mon[119097]: osdmap e2347: 8 total, 8 up, 8 in 2024-01-13T19:04:19.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:18 smithi084 ceph-mon[119097]: osdmap e2348: 8 total, 8 up, 8 in 2024-01-13T19:04:19.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:18 smithi099 ceph-mon[138788]: osdmap e2347: 8 total, 8 up, 8 in 2024-01-13T19:04:19.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:18 smithi099 ceph-mon[138788]: osdmap e2348: 8 total, 8 up, 8 in 2024-01-13T19:04:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:04:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:04:20] "GET /metrics HTTP/1.1" 200 36540 "" "Prometheus/2.43.0" 2024-01-13T19:04:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:20 smithi099 ceph-mon[138788]: pgmap v3998: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.69k op/s 2024-01-13T19:04:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:20 smithi099 ceph-mon[138788]: osdmap e2349: 8 total, 8 up, 8 in 2024-01-13T19:04:21.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:20 smithi084 ceph-mon[116404]: pgmap v3998: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.69k op/s 2024-01-13T19:04:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:20 smithi084 ceph-mon[116404]: osdmap e2349: 8 total, 8 up, 8 in 2024-01-13T19:04:21.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:20 smithi084 ceph-mon[119097]: pgmap v3998: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.69k op/s 2024-01-13T19:04:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:20 smithi084 ceph-mon[119097]: osdmap e2349: 8 total, 8 up, 8 in 2024-01-13T19:04:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:22.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:21 smithi084 ceph-mon[116404]: osdmap e2350: 8 total, 8 up, 8 in 2024-01-13T19:04:22.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:21 smithi084 ceph-mon[116404]: pgmap v4001: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:04:22.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:21 smithi084 ceph-mon[119097]: osdmap e2350: 8 total, 8 up, 8 in 2024-01-13T19:04:22.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:21 smithi084 ceph-mon[119097]: pgmap v4001: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:04:22.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:21 smithi099 ceph-mon[138788]: osdmap e2350: 8 total, 8 up, 8 in 2024-01-13T19:04:22.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:21 smithi099 ceph-mon[138788]: pgmap v4001: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:04:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:22 smithi084 ceph-mon[116404]: osdmap e2351: 8 total, 8 up, 8 in 2024-01-13T19:04:23.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:22 smithi084 ceph-mon[119097]: osdmap e2351: 8 total, 8 up, 8 in 2024-01-13T19:04:23.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:22 smithi099 ceph-mon[138788]: osdmap e2351: 8 total, 8 up, 8 in 2024-01-13T19:04:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:23 smithi084 ceph-mon[116404]: osdmap e2352: 8 total, 8 up, 8 in 2024-01-13T19:04:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:23 smithi084 ceph-mon[116404]: pgmap v4004: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.65k op/s 2024-01-13T19:04:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:23 smithi084 ceph-mon[116404]: osdmap e2353: 8 total, 8 up, 8 in 2024-01-13T19:04:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:23 smithi084 ceph-mon[119097]: osdmap e2352: 8 total, 8 up, 8 in 2024-01-13T19:04:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:23 smithi084 ceph-mon[119097]: pgmap v4004: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.65k op/s 2024-01-13T19:04:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:23 smithi084 ceph-mon[119097]: osdmap e2353: 8 total, 8 up, 8 in 2024-01-13T19:04:24.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:23 smithi099 ceph-mon[138788]: osdmap e2352: 8 total, 8 up, 8 in 2024-01-13T19:04:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:23 smithi099 ceph-mon[138788]: pgmap v4004: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.65k op/s 2024-01-13T19:04:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:23 smithi099 ceph-mon[138788]: osdmap e2353: 8 total, 8 up, 8 in 2024-01-13T19:04:26.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:25 smithi099 ceph-mon[138788]: osdmap e2354: 8 total, 8 up, 8 in 2024-01-13T19:04:26.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:25 smithi084 ceph-mon[116404]: osdmap e2354: 8 total, 8 up, 8 in 2024-01-13T19:04:26.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:25 smithi084 ceph-mon[119097]: osdmap e2354: 8 total, 8 up, 8 in 2024-01-13T19:04:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:26 smithi099 ceph-mon[138788]: pgmap v4007: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.65k op/s 2024-01-13T19:04:27.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:26 smithi099 ceph-mon[138788]: osdmap e2355: 8 total, 8 up, 8 in 2024-01-13T19:04:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:26 smithi084 ceph-mon[116404]: pgmap v4007: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.65k op/s 2024-01-13T19:04:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:26 smithi084 ceph-mon[116404]: osdmap e2355: 8 total, 8 up, 8 in 2024-01-13T19:04:27.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:26 smithi084 ceph-mon[119097]: pgmap v4007: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.65k op/s 2024-01-13T19:04:27.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:26 smithi084 ceph-mon[119097]: osdmap e2355: 8 total, 8 up, 8 in 2024-01-13T19:04:28.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:27 smithi099 ceph-mon[138788]: osdmap e2356: 8 total, 8 up, 8 in 2024-01-13T19:04:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:27 smithi084 ceph-mon[116404]: osdmap e2356: 8 total, 8 up, 8 in 2024-01-13T19:04:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:27 smithi084 ceph-mon[119097]: osdmap e2356: 8 total, 8 up, 8 in 2024-01-13T19:04:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:28 smithi099 ceph-mon[138788]: pgmap v4010: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.60k op/s 2024-01-13T19:04:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:28 smithi099 ceph-mon[138788]: osdmap e2357: 8 total, 8 up, 8 in 2024-01-13T19:04:29.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:28 smithi099 ceph-mon[138788]: osdmap e2358: 8 total, 8 up, 8 in 2024-01-13T19:04:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:28 smithi084 ceph-mon[116404]: pgmap v4010: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.60k op/s 2024-01-13T19:04:29.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:28 smithi084 ceph-mon[116404]: osdmap e2357: 8 total, 8 up, 8 in 2024-01-13T19:04:29.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:28 smithi084 ceph-mon[116404]: osdmap e2358: 8 total, 8 up, 8 in 2024-01-13T19:04:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:28 smithi084 ceph-mon[119097]: pgmap v4010: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.60k op/s 2024-01-13T19:04:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:28 smithi084 ceph-mon[119097]: osdmap e2357: 8 total, 8 up, 8 in 2024-01-13T19:04:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:28 smithi084 ceph-mon[119097]: osdmap e2358: 8 total, 8 up, 8 in 2024-01-13T19:04:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:29 smithi084 ceph-mon[119097]: pgmap v4013: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.60k op/s 2024-01-13T19:04:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:29 smithi084 ceph-mon[119097]: osdmap e2359: 8 total, 8 up, 8 in 2024-01-13T19:04:30.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:29 smithi084 ceph-mon[116404]: pgmap v4013: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.60k op/s 2024-01-13T19:04:30.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:29 smithi084 ceph-mon[116404]: osdmap e2359: 8 total, 8 up, 8 in 2024-01-13T19:04:30.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:29 smithi099 ceph-mon[138788]: pgmap v4013: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 1.60k op/s 2024-01-13T19:04:30.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:29 smithi099 ceph-mon[138788]: osdmap e2359: 8 total, 8 up, 8 in 2024-01-13T19:04:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:04:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:04:30] "GET /metrics HTTP/1.1" 200 36540 "" "Prometheus/2.43.0" 2024-01-13T19:04:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:31 smithi084 ceph-mon[116404]: osdmap e2360: 8 total, 8 up, 8 in 2024-01-13T19:04:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:31 smithi084 ceph-mon[116404]: pgmap v4016: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:04:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:31 smithi084 ceph-mon[119097]: osdmap e2360: 8 total, 8 up, 8 in 2024-01-13T19:04:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:31 smithi084 ceph-mon[119097]: pgmap v4016: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:04:32.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:31 smithi099 ceph-mon[138788]: osdmap e2360: 8 total, 8 up, 8 in 2024-01-13T19:04:32.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:31 smithi099 ceph-mon[138788]: pgmap v4016: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:04:33.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:32 smithi084 ceph-mon[119097]: osdmap e2361: 8 total, 8 up, 8 in 2024-01-13T19:04:33.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:32 smithi084 ceph-mon[116404]: osdmap e2361: 8 total, 8 up, 8 in 2024-01-13T19:04:33.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:32 smithi099 ceph-mon[138788]: osdmap e2361: 8 total, 8 up, 8 in 2024-01-13T19:04:34.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:33 smithi084 ceph-mon[119097]: osdmap e2362: 8 total, 8 up, 8 in 2024-01-13T19:04:34.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:33 smithi084 ceph-mon[119097]: pgmap v4019: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.56k op/s 2024-01-13T19:04:34.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:33 smithi084 ceph-mon[119097]: osdmap e2363: 8 total, 8 up, 8 in 2024-01-13T19:04:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:33 smithi084 ceph-mon[116404]: osdmap e2362: 8 total, 8 up, 8 in 2024-01-13T19:04:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:33 smithi084 ceph-mon[116404]: pgmap v4019: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.56k op/s 2024-01-13T19:04:34.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:33 smithi084 ceph-mon[116404]: osdmap e2363: 8 total, 8 up, 8 in 2024-01-13T19:04:34.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:33 smithi099 ceph-mon[138788]: osdmap e2362: 8 total, 8 up, 8 in 2024-01-13T19:04:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:33 smithi099 ceph-mon[138788]: pgmap v4019: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.56k op/s 2024-01-13T19:04:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:33 smithi099 ceph-mon[138788]: osdmap e2363: 8 total, 8 up, 8 in 2024-01-13T19:04:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:35 smithi099 ceph-mon[138788]: osdmap e2364: 8 total, 8 up, 8 in 2024-01-13T19:04:36.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:36.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:04:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:35 smithi084 ceph-mon[116404]: osdmap e2364: 8 total, 8 up, 8 in 2024-01-13T19:04:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:04:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:35 smithi084 ceph-mon[119097]: osdmap e2364: 8 total, 8 up, 8 in 2024-01-13T19:04:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:04:37.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:36 smithi099 ceph-mon[138788]: pgmap v4022: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.56k op/s 2024-01-13T19:04:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:36 smithi099 ceph-mon[138788]: osdmap e2365: 8 total, 8 up, 8 in 2024-01-13T19:04:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:04:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:04:37.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:04:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:36 smithi084 ceph-mon[116404]: pgmap v4022: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.56k op/s 2024-01-13T19:04:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:36 smithi084 ceph-mon[116404]: osdmap e2365: 8 total, 8 up, 8 in 2024-01-13T19:04:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:04:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:04:37.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:04:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:36 smithi084 ceph-mon[119097]: pgmap v4022: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.56k op/s 2024-01-13T19:04:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:36 smithi084 ceph-mon[119097]: osdmap e2365: 8 total, 8 up, 8 in 2024-01-13T19:04:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:04:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:04:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:04:38.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:37 smithi099 ceph-mon[138788]: osdmap e2366: 8 total, 8 up, 8 in 2024-01-13T19:04:38.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:37 smithi084 ceph-mon[119097]: osdmap e2366: 8 total, 8 up, 8 in 2024-01-13T19:04:38.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:37 smithi084 ceph-mon[116404]: osdmap e2366: 8 total, 8 up, 8 in 2024-01-13T19:04:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:38 smithi099 ceph-mon[138788]: pgmap v4025: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.51k op/s 2024-01-13T19:04:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:38 smithi099 ceph-mon[138788]: osdmap e2367: 8 total, 8 up, 8 in 2024-01-13T19:04:39.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:38 smithi099 ceph-mon[138788]: osdmap e2368: 8 total, 8 up, 8 in 2024-01-13T19:04:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:38 smithi084 ceph-mon[116404]: pgmap v4025: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.51k op/s 2024-01-13T19:04:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:38 smithi084 ceph-mon[116404]: osdmap e2367: 8 total, 8 up, 8 in 2024-01-13T19:04:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:38 smithi084 ceph-mon[116404]: osdmap e2368: 8 total, 8 up, 8 in 2024-01-13T19:04:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:38 smithi084 ceph-mon[119097]: pgmap v4025: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.51k op/s 2024-01-13T19:04:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:38 smithi084 ceph-mon[119097]: osdmap e2367: 8 total, 8 up, 8 in 2024-01-13T19:04:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:38 smithi084 ceph-mon[119097]: osdmap e2368: 8 total, 8 up, 8 in 2024-01-13T19:04:40.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:39 smithi099 ceph-mon[138788]: pgmap v4028: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.51k op/s 2024-01-13T19:04:40.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:39 smithi084 ceph-mon[116404]: pgmap v4028: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.51k op/s 2024-01-13T19:04:40.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:39 smithi084 ceph-mon[119097]: pgmap v4028: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.51k op/s 2024-01-13T19:04:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:04:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:04:40] "GET /metrics HTTP/1.1" 200 36539 "" "Prometheus/2.43.0" 2024-01-13T19:04:41.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:40 smithi099 ceph-mon[138788]: osdmap e2369: 8 total, 8 up, 8 in 2024-01-13T19:04:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:40 smithi084 ceph-mon[116404]: osdmap e2369: 8 total, 8 up, 8 in 2024-01-13T19:04:41.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:40 smithi084 ceph-mon[119097]: osdmap e2369: 8 total, 8 up, 8 in 2024-01-13T19:04:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:41 smithi084 ceph-mon[116404]: osdmap e2370: 8 total, 8 up, 8 in 2024-01-13T19:04:42.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:41 smithi084 ceph-mon[116404]: pgmap v4031: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:04:42.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:41 smithi084 ceph-mon[119097]: osdmap e2370: 8 total, 8 up, 8 in 2024-01-13T19:04:42.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:41 smithi084 ceph-mon[119097]: pgmap v4031: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:04:42.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:41 smithi099 ceph-mon[138788]: osdmap e2370: 8 total, 8 up, 8 in 2024-01-13T19:04:42.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:41 smithi099 ceph-mon[138788]: pgmap v4031: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:04:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:42 smithi084 ceph-mon[116404]: osdmap e2371: 8 total, 8 up, 8 in 2024-01-13T19:04:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:42 smithi084 ceph-mon[119097]: osdmap e2371: 8 total, 8 up, 8 in 2024-01-13T19:04:43.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:42 smithi099 ceph-mon[138788]: osdmap e2371: 8 total, 8 up, 8 in 2024-01-13T19:04:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:43 smithi084 ceph-mon[116404]: osdmap e2372: 8 total, 8 up, 8 in 2024-01-13T19:04:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:43 smithi084 ceph-mon[116404]: pgmap v4034: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.47k op/s 2024-01-13T19:04:44.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:43 smithi084 ceph-mon[116404]: osdmap e2373: 8 total, 8 up, 8 in 2024-01-13T19:04:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:43 smithi084 ceph-mon[119097]: osdmap e2372: 8 total, 8 up, 8 in 2024-01-13T19:04:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:43 smithi084 ceph-mon[119097]: pgmap v4034: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.47k op/s 2024-01-13T19:04:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:43 smithi084 ceph-mon[119097]: osdmap e2373: 8 total, 8 up, 8 in 2024-01-13T19:04:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:43 smithi099 ceph-mon[138788]: osdmap e2372: 8 total, 8 up, 8 in 2024-01-13T19:04:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:43 smithi099 ceph-mon[138788]: pgmap v4034: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.47k op/s 2024-01-13T19:04:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:43 smithi099 ceph-mon[138788]: osdmap e2373: 8 total, 8 up, 8 in 2024-01-13T19:04:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:45 smithi084 ceph-mon[116404]: osdmap e2374: 8 total, 8 up, 8 in 2024-01-13T19:04:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:45 smithi084 ceph-mon[116404]: pgmap v4037: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.47k op/s 2024-01-13T19:04:46.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:45 smithi084 ceph-mon[119097]: osdmap e2374: 8 total, 8 up, 8 in 2024-01-13T19:04:46.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:45 smithi084 ceph-mon[119097]: pgmap v4037: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.47k op/s 2024-01-13T19:04:46.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:45 smithi099 ceph-mon[138788]: osdmap e2374: 8 total, 8 up, 8 in 2024-01-13T19:04:46.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:45 smithi099 ceph-mon[138788]: pgmap v4037: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.1 MiB/s rd, 5.0 KiB/s wr, 1.47k op/s 2024-01-13T19:04:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:46 smithi084 ceph-mon[116404]: osdmap e2375: 8 total, 8 up, 8 in 2024-01-13T19:04:47.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:46 smithi084 ceph-mon[119097]: osdmap e2375: 8 total, 8 up, 8 in 2024-01-13T19:04:47.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:46 smithi099 ceph-mon[138788]: osdmap e2375: 8 total, 8 up, 8 in 2024-01-13T19:04:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:47 smithi084 ceph-mon[116404]: osdmap e2376: 8 total, 8 up, 8 in 2024-01-13T19:04:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:47 smithi084 ceph-mon[116404]: pgmap v4040: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 5.0 KiB/s wr, 1.42k op/s 2024-01-13T19:04:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:47 smithi084 ceph-mon[119097]: osdmap e2376: 8 total, 8 up, 8 in 2024-01-13T19:04:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:47 smithi084 ceph-mon[119097]: pgmap v4040: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 5.0 KiB/s wr, 1.42k op/s 2024-01-13T19:04:48.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:47 smithi099 ceph-mon[138788]: osdmap e2376: 8 total, 8 up, 8 in 2024-01-13T19:04:48.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:47 smithi099 ceph-mon[138788]: pgmap v4040: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 5.0 KiB/s wr, 1.42k op/s 2024-01-13T19:04:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:48 smithi084 ceph-mon[116404]: osdmap e2377: 8 total, 8 up, 8 in 2024-01-13T19:04:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:48 smithi084 ceph-mon[116404]: osdmap e2378: 8 total, 8 up, 8 in 2024-01-13T19:04:49.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:48 smithi084 ceph-mon[119097]: osdmap e2377: 8 total, 8 up, 8 in 2024-01-13T19:04:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:48 smithi084 ceph-mon[119097]: osdmap e2378: 8 total, 8 up, 8 in 2024-01-13T19:04:49.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:48 smithi099 ceph-mon[138788]: osdmap e2377: 8 total, 8 up, 8 in 2024-01-13T19:04:49.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:48 smithi099 ceph-mon[138788]: osdmap e2378: 8 total, 8 up, 8 in 2024-01-13T19:04:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:04:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:04:50] "GET /metrics HTTP/1.1" 200 36537 "" "Prometheus/2.43.0" 2024-01-13T19:04:51.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:50 smithi099 ceph-mon[138788]: pgmap v4043: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 5.0 KiB/s wr, 1.42k op/s 2024-01-13T19:04:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:50 smithi099 ceph-mon[138788]: osdmap e2379: 8 total, 8 up, 8 in 2024-01-13T19:04:51.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:51.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:50 smithi084 ceph-mon[116404]: pgmap v4043: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 5.0 KiB/s wr, 1.42k op/s 2024-01-13T19:04:51.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:50 smithi084 ceph-mon[116404]: osdmap e2379: 8 total, 8 up, 8 in 2024-01-13T19:04:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:50 smithi084 ceph-mon[119097]: pgmap v4043: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.0 MiB/s rd, 5.0 KiB/s wr, 1.42k op/s 2024-01-13T19:04:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:50 smithi084 ceph-mon[119097]: osdmap e2379: 8 total, 8 up, 8 in 2024-01-13T19:04:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:04:52.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:51 smithi099 ceph-mon[138788]: osdmap e2380: 8 total, 8 up, 8 in 2024-01-13T19:04:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:51 smithi084 ceph-mon[116404]: osdmap e2380: 8 total, 8 up, 8 in 2024-01-13T19:04:52.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:51 smithi084 ceph-mon[119097]: osdmap e2380: 8 total, 8 up, 8 in 2024-01-13T19:04:53.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:52 smithi099 ceph-mon[138788]: pgmap v4046: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-01-13T19:04:53.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:52 smithi099 ceph-mon[138788]: osdmap e2381: 8 total, 8 up, 8 in 2024-01-13T19:04:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:52 smithi084 ceph-mon[116404]: pgmap v4046: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-01-13T19:04:53.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:52 smithi084 ceph-mon[116404]: osdmap e2381: 8 total, 8 up, 8 in 2024-01-13T19:04:53.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:52 smithi084 ceph-mon[119097]: pgmap v4046: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-01-13T19:04:53.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:52 smithi084 ceph-mon[119097]: osdmap e2381: 8 total, 8 up, 8 in 2024-01-13T19:04:54.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:53 smithi099 ceph-mon[138788]: osdmap e2382: 8 total, 8 up, 8 in 2024-01-13T19:04:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:53 smithi099 ceph-mon[138788]: pgmap v4049: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 KiB/s rd, 5.0 KiB/s wr, 1.38k op/s 2024-01-13T19:04:54.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:53 smithi099 ceph-mon[138788]: osdmap e2383: 8 total, 8 up, 8 in 2024-01-13T19:04:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:53 smithi084 ceph-mon[116404]: osdmap e2382: 8 total, 8 up, 8 in 2024-01-13T19:04:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:53 smithi084 ceph-mon[116404]: pgmap v4049: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 KiB/s rd, 5.0 KiB/s wr, 1.38k op/s 2024-01-13T19:04:54.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:53 smithi084 ceph-mon[116404]: osdmap e2383: 8 total, 8 up, 8 in 2024-01-13T19:04:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:53 smithi084 ceph-mon[119097]: osdmap e2382: 8 total, 8 up, 8 in 2024-01-13T19:04:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:53 smithi084 ceph-mon[119097]: pgmap v4049: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 KiB/s rd, 5.0 KiB/s wr, 1.38k op/s 2024-01-13T19:04:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:53 smithi084 ceph-mon[119097]: osdmap e2383: 8 total, 8 up, 8 in 2024-01-13T19:04:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:55 smithi084 ceph-mon[116404]: osdmap e2384: 8 total, 8 up, 8 in 2024-01-13T19:04:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:55 smithi084 ceph-mon[116404]: pgmap v4052: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 KiB/s rd, 5.0 KiB/s wr, 1.38k op/s 2024-01-13T19:04:56.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:55 smithi084 ceph-mon[119097]: osdmap e2384: 8 total, 8 up, 8 in 2024-01-13T19:04:56.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:55 smithi084 ceph-mon[119097]: pgmap v4052: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 KiB/s rd, 5.0 KiB/s wr, 1.38k op/s 2024-01-13T19:04:56.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:55 smithi099 ceph-mon[138788]: osdmap e2384: 8 total, 8 up, 8 in 2024-01-13T19:04:56.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:55 smithi099 ceph-mon[138788]: pgmap v4052: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1022 KiB/s rd, 5.0 KiB/s wr, 1.38k op/s 2024-01-13T19:04:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:56 smithi084 ceph-mon[116404]: osdmap e2385: 8 total, 8 up, 8 in 2024-01-13T19:04:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:56 smithi084 ceph-mon[119097]: osdmap e2385: 8 total, 8 up, 8 in 2024-01-13T19:04:57.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:56 smithi099 ceph-mon[138788]: osdmap e2385: 8 total, 8 up, 8 in 2024-01-13T19:04:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:57 smithi084 ceph-mon[116404]: osdmap e2386: 8 total, 8 up, 8 in 2024-01-13T19:04:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:57 smithi084 ceph-mon[116404]: pgmap v4055: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 989 KiB/s rd, 5.0 KiB/s wr, 1.34k op/s 2024-01-13T19:04:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:57 smithi084 ceph-mon[119097]: osdmap e2386: 8 total, 8 up, 8 in 2024-01-13T19:04:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:57 smithi084 ceph-mon[119097]: pgmap v4055: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 989 KiB/s rd, 5.0 KiB/s wr, 1.34k op/s 2024-01-13T19:04:58.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:57 smithi099 ceph-mon[138788]: osdmap e2386: 8 total, 8 up, 8 in 2024-01-13T19:04:58.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:57 smithi099 ceph-mon[138788]: pgmap v4055: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 989 KiB/s rd, 5.0 KiB/s wr, 1.34k op/s 2024-01-13T19:04:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:58 smithi084 ceph-mon[116404]: osdmap e2387: 8 total, 8 up, 8 in 2024-01-13T19:04:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:04:58 smithi084 ceph-mon[116404]: osdmap e2388: 8 total, 8 up, 8 in 2024-01-13T19:04:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:58 smithi084 ceph-mon[119097]: osdmap e2387: 8 total, 8 up, 8 in 2024-01-13T19:04:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:04:58 smithi084 ceph-mon[119097]: osdmap e2388: 8 total, 8 up, 8 in 2024-01-13T19:04:59.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:58 smithi099 ceph-mon[138788]: osdmap e2387: 8 total, 8 up, 8 in 2024-01-13T19:04:59.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:04:58 smithi099 ceph-mon[138788]: osdmap e2388: 8 total, 8 up, 8 in 2024-01-13T19:05:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:05:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:05:00] "GET /metrics HTTP/1.1" 200 36537 "" "Prometheus/2.43.0" 2024-01-13T19:05:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:00 smithi099 ceph-mon[138788]: pgmap v4058: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 988 KiB/s rd, 5.0 KiB/s wr, 1.34k op/s 2024-01-13T19:05:01.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:00 smithi099 ceph-mon[138788]: osdmap e2389: 8 total, 8 up, 8 in 2024-01-13T19:05:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:00 smithi084 ceph-mon[116404]: pgmap v4058: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 988 KiB/s rd, 5.0 KiB/s wr, 1.34k op/s 2024-01-13T19:05:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:00 smithi084 ceph-mon[116404]: osdmap e2389: 8 total, 8 up, 8 in 2024-01-13T19:05:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:00 smithi084 ceph-mon[119097]: pgmap v4058: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 988 KiB/s rd, 5.0 KiB/s wr, 1.34k op/s 2024-01-13T19:05:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:00 smithi084 ceph-mon[119097]: osdmap e2389: 8 total, 8 up, 8 in 2024-01-13T19:05:02.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:01 smithi084 ceph-mon[116404]: osdmap e2390: 8 total, 8 up, 8 in 2024-01-13T19:05:02.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:01 smithi084 ceph-mon[116404]: pgmap v4061: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:02.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:01 smithi084 ceph-mon[119097]: osdmap e2390: 8 total, 8 up, 8 in 2024-01-13T19:05:02.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:01 smithi084 ceph-mon[119097]: pgmap v4061: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:02.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:01 smithi099 ceph-mon[138788]: osdmap e2390: 8 total, 8 up, 8 in 2024-01-13T19:05:02.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:01 smithi099 ceph-mon[138788]: pgmap v4061: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:03.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:02 smithi084 ceph-mon[116404]: osdmap e2391: 8 total, 8 up, 8 in 2024-01-13T19:05:03.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:02 smithi084 ceph-mon[119097]: osdmap e2391: 8 total, 8 up, 8 in 2024-01-13T19:05:03.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:02 smithi099 ceph-mon[138788]: osdmap e2391: 8 total, 8 up, 8 in 2024-01-13T19:05:04.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:03 smithi084 ceph-mon[116404]: osdmap e2392: 8 total, 8 up, 8 in 2024-01-13T19:05:04.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:03 smithi084 ceph-mon[116404]: pgmap v4064: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 958 KiB/s rd, 5.0 KiB/s wr, 1.30k op/s 2024-01-13T19:05:04.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:03 smithi084 ceph-mon[116404]: osdmap e2393: 8 total, 8 up, 8 in 2024-01-13T19:05:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:03 smithi084 ceph-mon[119097]: osdmap e2392: 8 total, 8 up, 8 in 2024-01-13T19:05:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:03 smithi084 ceph-mon[119097]: pgmap v4064: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 958 KiB/s rd, 5.0 KiB/s wr, 1.30k op/s 2024-01-13T19:05:04.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:03 smithi084 ceph-mon[119097]: osdmap e2393: 8 total, 8 up, 8 in 2024-01-13T19:05:04.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:03 smithi099 ceph-mon[138788]: osdmap e2392: 8 total, 8 up, 8 in 2024-01-13T19:05:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:03 smithi099 ceph-mon[138788]: pgmap v4064: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 958 KiB/s rd, 5.0 KiB/s wr, 1.30k op/s 2024-01-13T19:05:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:03 smithi099 ceph-mon[138788]: osdmap e2393: 8 total, 8 up, 8 in 2024-01-13T19:05:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:05 smithi099 ceph-mon[138788]: osdmap e2394: 8 total, 8 up, 8 in 2024-01-13T19:05:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:05 smithi084 ceph-mon[116404]: osdmap e2394: 8 total, 8 up, 8 in 2024-01-13T19:05:06.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:05 smithi084 ceph-mon[119097]: osdmap e2394: 8 total, 8 up, 8 in 2024-01-13T19:05:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:07.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:06 smithi099 ceph-mon[138788]: pgmap v4067: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 957 KiB/s rd, 5.0 KiB/s wr, 1.29k op/s 2024-01-13T19:05:07.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:06 smithi099 ceph-mon[138788]: osdmap e2395: 8 total, 8 up, 8 in 2024-01-13T19:05:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:06 smithi084 ceph-mon[116404]: pgmap v4067: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 957 KiB/s rd, 5.0 KiB/s wr, 1.29k op/s 2024-01-13T19:05:07.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:06 smithi084 ceph-mon[116404]: osdmap e2395: 8 total, 8 up, 8 in 2024-01-13T19:05:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:06 smithi084 ceph-mon[119097]: pgmap v4067: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 957 KiB/s rd, 5.0 KiB/s wr, 1.29k op/s 2024-01-13T19:05:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:06 smithi084 ceph-mon[119097]: osdmap e2395: 8 total, 8 up, 8 in 2024-01-13T19:05:08.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:07 smithi099 ceph-mon[138788]: osdmap e2396: 8 total, 8 up, 8 in 2024-01-13T19:05:08.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:07 smithi099 ceph-mon[138788]: pgmap v4070: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 924 KiB/s rd, 5.0 KiB/s wr, 1.25k op/s 2024-01-13T19:05:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:07 smithi084 ceph-mon[116404]: osdmap e2396: 8 total, 8 up, 8 in 2024-01-13T19:05:08.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:07 smithi084 ceph-mon[116404]: pgmap v4070: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 924 KiB/s rd, 5.0 KiB/s wr, 1.25k op/s 2024-01-13T19:05:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:07 smithi084 ceph-mon[119097]: osdmap e2396: 8 total, 8 up, 8 in 2024-01-13T19:05:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:07 smithi084 ceph-mon[119097]: pgmap v4070: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 924 KiB/s rd, 5.0 KiB/s wr, 1.25k op/s 2024-01-13T19:05:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:08 smithi099 ceph-mon[138788]: osdmap e2397: 8 total, 8 up, 8 in 2024-01-13T19:05:09.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:08 smithi099 ceph-mon[138788]: osdmap e2398: 8 total, 8 up, 8 in 2024-01-13T19:05:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:08 smithi084 ceph-mon[116404]: osdmap e2397: 8 total, 8 up, 8 in 2024-01-13T19:05:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:08 smithi084 ceph-mon[116404]: osdmap e2398: 8 total, 8 up, 8 in 2024-01-13T19:05:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:08 smithi084 ceph-mon[119097]: osdmap e2397: 8 total, 8 up, 8 in 2024-01-13T19:05:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:08 smithi084 ceph-mon[119097]: osdmap e2398: 8 total, 8 up, 8 in 2024-01-13T19:05:10.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:09 smithi099 ceph-mon[138788]: pgmap v4073: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 925 KiB/s rd, 5.0 KiB/s wr, 1.25k op/s 2024-01-13T19:05:10.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:09 smithi084 ceph-mon[116404]: pgmap v4073: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 925 KiB/s rd, 5.0 KiB/s wr, 1.25k op/s 2024-01-13T19:05:10.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:09 smithi084 ceph-mon[119097]: pgmap v4073: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 925 KiB/s rd, 5.0 KiB/s wr, 1.25k op/s 2024-01-13T19:05:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:05:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:05:10] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:05:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:10 smithi084 ceph-mon[116404]: osdmap e2399: 8 total, 8 up, 8 in 2024-01-13T19:05:11.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:10 smithi084 ceph-mon[119097]: osdmap e2399: 8 total, 8 up, 8 in 2024-01-13T19:05:11.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:10 smithi099 ceph-mon[138788]: osdmap e2399: 8 total, 8 up, 8 in 2024-01-13T19:05:12.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:11 smithi084 ceph-mon[119097]: osdmap e2400: 8 total, 8 up, 8 in 2024-01-13T19:05:12.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:11 smithi084 ceph-mon[119097]: pgmap v4076: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:05:12.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:11 smithi084 ceph-mon[116404]: osdmap e2400: 8 total, 8 up, 8 in 2024-01-13T19:05:12.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:11 smithi084 ceph-mon[116404]: pgmap v4076: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:05:12.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:11 smithi099 ceph-mon[138788]: osdmap e2400: 8 total, 8 up, 8 in 2024-01-13T19:05:12.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:11 smithi099 ceph-mon[138788]: pgmap v4076: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:05:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:12 smithi084 ceph-mon[116404]: osdmap e2401: 8 total, 8 up, 8 in 2024-01-13T19:05:13.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:12 smithi084 ceph-mon[119097]: osdmap e2401: 8 total, 8 up, 8 in 2024-01-13T19:05:13.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:12 smithi099 ceph-mon[138788]: osdmap e2401: 8 total, 8 up, 8 in 2024-01-13T19:05:14.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:13 smithi084 ceph-mon[116404]: osdmap e2402: 8 total, 8 up, 8 in 2024-01-13T19:05:14.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:13 smithi084 ceph-mon[116404]: pgmap v4079: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 892 KiB/s rd, 5.0 KiB/s wr, 1.21k op/s 2024-01-13T19:05:14.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:13 smithi084 ceph-mon[116404]: osdmap e2403: 8 total, 8 up, 8 in 2024-01-13T19:05:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:13 smithi084 ceph-mon[119097]: osdmap e2402: 8 total, 8 up, 8 in 2024-01-13T19:05:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:13 smithi084 ceph-mon[119097]: pgmap v4079: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 892 KiB/s rd, 5.0 KiB/s wr, 1.21k op/s 2024-01-13T19:05:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:13 smithi084 ceph-mon[119097]: osdmap e2403: 8 total, 8 up, 8 in 2024-01-13T19:05:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:13 smithi099 ceph-mon[138788]: osdmap e2402: 8 total, 8 up, 8 in 2024-01-13T19:05:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:13 smithi099 ceph-mon[138788]: pgmap v4079: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 892 KiB/s rd, 5.0 KiB/s wr, 1.21k op/s 2024-01-13T19:05:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:13 smithi099 ceph-mon[138788]: osdmap e2403: 8 total, 8 up, 8 in 2024-01-13T19:05:16.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:15 smithi099 ceph-mon[138788]: osdmap e2404: 8 total, 8 up, 8 in 2024-01-13T19:05:16.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:15 smithi084 ceph-mon[116404]: osdmap e2404: 8 total, 8 up, 8 in 2024-01-13T19:05:16.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:15 smithi084 ceph-mon[119097]: osdmap e2404: 8 total, 8 up, 8 in 2024-01-13T19:05:17.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:16 smithi099 ceph-mon[138788]: pgmap v4082: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 892 KiB/s rd, 5.0 KiB/s wr, 1.21k op/s 2024-01-13T19:05:17.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:16 smithi099 ceph-mon[138788]: osdmap e2405: 8 total, 8 up, 8 in 2024-01-13T19:05:17.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:16 smithi084 ceph-mon[116404]: pgmap v4082: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 892 KiB/s rd, 5.0 KiB/s wr, 1.21k op/s 2024-01-13T19:05:17.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:16 smithi084 ceph-mon[116404]: osdmap e2405: 8 total, 8 up, 8 in 2024-01-13T19:05:17.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:16 smithi084 ceph-mon[119097]: pgmap v4082: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 892 KiB/s rd, 5.0 KiB/s wr, 1.21k op/s 2024-01-13T19:05:17.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:16 smithi084 ceph-mon[119097]: osdmap e2405: 8 total, 8 up, 8 in 2024-01-13T19:05:18.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:17 smithi099 ceph-mon[138788]: osdmap e2406: 8 total, 8 up, 8 in 2024-01-13T19:05:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:17 smithi084 ceph-mon[116404]: osdmap e2406: 8 total, 8 up, 8 in 2024-01-13T19:05:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:17 smithi084 ceph-mon[119097]: osdmap e2406: 8 total, 8 up, 8 in 2024-01-13T19:05:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:18 smithi099 ceph-mon[138788]: pgmap v4085: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 857 KiB/s rd, 5.0 KiB/s wr, 1.16k op/s 2024-01-13T19:05:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:18 smithi099 ceph-mon[138788]: osdmap e2407: 8 total, 8 up, 8 in 2024-01-13T19:05:19.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:18 smithi099 ceph-mon[138788]: osdmap e2408: 8 total, 8 up, 8 in 2024-01-13T19:05:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:18 smithi084 ceph-mon[116404]: pgmap v4085: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 857 KiB/s rd, 5.0 KiB/s wr, 1.16k op/s 2024-01-13T19:05:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:18 smithi084 ceph-mon[116404]: osdmap e2407: 8 total, 8 up, 8 in 2024-01-13T19:05:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:18 smithi084 ceph-mon[116404]: osdmap e2408: 8 total, 8 up, 8 in 2024-01-13T19:05:19.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:18 smithi084 ceph-mon[119097]: pgmap v4085: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 857 KiB/s rd, 5.0 KiB/s wr, 1.16k op/s 2024-01-13T19:05:19.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:18 smithi084 ceph-mon[119097]: osdmap e2407: 8 total, 8 up, 8 in 2024-01-13T19:05:19.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:18 smithi084 ceph-mon[119097]: osdmap e2408: 8 total, 8 up, 8 in 2024-01-13T19:05:20.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:19 smithi084 ceph-mon[116404]: pgmap v4088: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 858 KiB/s rd, 5.0 KiB/s wr, 1.16k op/s 2024-01-13T19:05:20.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:19 smithi084 ceph-mon[119097]: pgmap v4088: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 858 KiB/s rd, 5.0 KiB/s wr, 1.16k op/s 2024-01-13T19:05:20.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:19 smithi099 ceph-mon[138788]: pgmap v4088: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 858 KiB/s rd, 5.0 KiB/s wr, 1.16k op/s 2024-01-13T19:05:20.680 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:05:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:05:20] "GET /metrics HTTP/1.1" 200 36537 "" "Prometheus/2.43.0" 2024-01-13T19:05:21.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:20 smithi084 ceph-mon[119097]: osdmap e2409: 8 total, 8 up, 8 in 2024-01-13T19:05:21.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:21.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:20 smithi084 ceph-mon[116404]: osdmap e2409: 8 total, 8 up, 8 in 2024-01-13T19:05:21.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:21.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:20 smithi099 ceph-mon[138788]: osdmap e2409: 8 total, 8 up, 8 in 2024-01-13T19:05:21.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:22.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:21 smithi084 ceph-mon[116404]: osdmap e2410: 8 total, 8 up, 8 in 2024-01-13T19:05:22.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:21 smithi084 ceph-mon[116404]: pgmap v4091: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:22.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:21 smithi084 ceph-mon[119097]: osdmap e2410: 8 total, 8 up, 8 in 2024-01-13T19:05:22.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:21 smithi084 ceph-mon[119097]: pgmap v4091: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:22.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:21 smithi099 ceph-mon[138788]: osdmap e2410: 8 total, 8 up, 8 in 2024-01-13T19:05:22.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:21 smithi099 ceph-mon[138788]: pgmap v4091: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:22 smithi084 ceph-mon[116404]: osdmap e2411: 8 total, 8 up, 8 in 2024-01-13T19:05:23.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:22 smithi084 ceph-mon[119097]: osdmap e2411: 8 total, 8 up, 8 in 2024-01-13T19:05:23.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:22 smithi099 ceph-mon[138788]: osdmap e2411: 8 total, 8 up, 8 in 2024-01-13T19:05:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:23 smithi084 ceph-mon[116404]: osdmap e2412: 8 total, 8 up, 8 in 2024-01-13T19:05:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:23 smithi084 ceph-mon[116404]: pgmap v4094: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 826 KiB/s rd, 5.0 KiB/s wr, 1.12k op/s 2024-01-13T19:05:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:23 smithi084 ceph-mon[116404]: osdmap e2413: 8 total, 8 up, 8 in 2024-01-13T19:05:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:23 smithi084 ceph-mon[119097]: osdmap e2412: 8 total, 8 up, 8 in 2024-01-13T19:05:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:23 smithi084 ceph-mon[119097]: pgmap v4094: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 826 KiB/s rd, 5.0 KiB/s wr, 1.12k op/s 2024-01-13T19:05:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:23 smithi084 ceph-mon[119097]: osdmap e2413: 8 total, 8 up, 8 in 2024-01-13T19:05:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:23 smithi099 ceph-mon[138788]: osdmap e2412: 8 total, 8 up, 8 in 2024-01-13T19:05:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:23 smithi099 ceph-mon[138788]: pgmap v4094: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 826 KiB/s rd, 5.0 KiB/s wr, 1.12k op/s 2024-01-13T19:05:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:23 smithi099 ceph-mon[138788]: osdmap e2413: 8 total, 8 up, 8 in 2024-01-13T19:05:26.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:25 smithi099 ceph-mon[138788]: osdmap e2414: 8 total, 8 up, 8 in 2024-01-13T19:05:26.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:25 smithi099 ceph-mon[138788]: pgmap v4097: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 827 KiB/s rd, 5.0 KiB/s wr, 1.12k op/s 2024-01-13T19:05:26.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:25 smithi084 ceph-mon[116404]: osdmap e2414: 8 total, 8 up, 8 in 2024-01-13T19:05:26.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:25 smithi084 ceph-mon[116404]: pgmap v4097: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 827 KiB/s rd, 5.0 KiB/s wr, 1.12k op/s 2024-01-13T19:05:26.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:25 smithi084 ceph-mon[119097]: osdmap e2414: 8 total, 8 up, 8 in 2024-01-13T19:05:26.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:25 smithi084 ceph-mon[119097]: pgmap v4097: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 827 KiB/s rd, 5.0 KiB/s wr, 1.12k op/s 2024-01-13T19:05:27.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:26 smithi099 ceph-mon[138788]: osdmap e2415: 8 total, 8 up, 8 in 2024-01-13T19:05:27.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:26 smithi084 ceph-mon[116404]: osdmap e2415: 8 total, 8 up, 8 in 2024-01-13T19:05:27.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:26 smithi084 ceph-mon[119097]: osdmap e2415: 8 total, 8 up, 8 in 2024-01-13T19:05:28.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:27 smithi099 ceph-mon[138788]: osdmap e2416: 8 total, 8 up, 8 in 2024-01-13T19:05:28.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:27 smithi099 ceph-mon[138788]: pgmap v4100: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 792 KiB/s rd, 5.0 KiB/s wr, 1.07k op/s 2024-01-13T19:05:28.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:27 smithi084 ceph-mon[116404]: osdmap e2416: 8 total, 8 up, 8 in 2024-01-13T19:05:28.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:27 smithi084 ceph-mon[116404]: pgmap v4100: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 792 KiB/s rd, 5.0 KiB/s wr, 1.07k op/s 2024-01-13T19:05:28.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:27 smithi084 ceph-mon[119097]: osdmap e2416: 8 total, 8 up, 8 in 2024-01-13T19:05:28.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:27 smithi084 ceph-mon[119097]: pgmap v4100: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 792 KiB/s rd, 5.0 KiB/s wr, 1.07k op/s 2024-01-13T19:05:29.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:28 smithi099 ceph-mon[138788]: osdmap e2417: 8 total, 8 up, 8 in 2024-01-13T19:05:29.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:28 smithi099 ceph-mon[138788]: osdmap e2418: 8 total, 8 up, 8 in 2024-01-13T19:05:29.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:28 smithi084 ceph-mon[116404]: osdmap e2417: 8 total, 8 up, 8 in 2024-01-13T19:05:29.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:28 smithi084 ceph-mon[116404]: osdmap e2418: 8 total, 8 up, 8 in 2024-01-13T19:05:29.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:28 smithi084 ceph-mon[119097]: osdmap e2417: 8 total, 8 up, 8 in 2024-01-13T19:05:29.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:28 smithi084 ceph-mon[119097]: osdmap e2418: 8 total, 8 up, 8 in 2024-01-13T19:05:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:05:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:05:30] "GET /metrics HTTP/1.1" 200 36537 "" "Prometheus/2.43.0" 2024-01-13T19:05:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:30 smithi099 ceph-mon[138788]: pgmap v4103: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 792 KiB/s rd, 5.0 KiB/s wr, 1.07k op/s 2024-01-13T19:05:31.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:30 smithi099 ceph-mon[138788]: osdmap e2419: 8 total, 8 up, 8 in 2024-01-13T19:05:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:30 smithi084 ceph-mon[116404]: pgmap v4103: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 792 KiB/s rd, 5.0 KiB/s wr, 1.07k op/s 2024-01-13T19:05:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:30 smithi084 ceph-mon[116404]: osdmap e2419: 8 total, 8 up, 8 in 2024-01-13T19:05:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:30 smithi084 ceph-mon[119097]: pgmap v4103: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 792 KiB/s rd, 5.0 KiB/s wr, 1.07k op/s 2024-01-13T19:05:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:30 smithi084 ceph-mon[119097]: osdmap e2419: 8 total, 8 up, 8 in 2024-01-13T19:05:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:31 smithi084 ceph-mon[116404]: osdmap e2420: 8 total, 8 up, 8 in 2024-01-13T19:05:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:31 smithi084 ceph-mon[116404]: pgmap v4106: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:05:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:31 smithi084 ceph-mon[119097]: osdmap e2420: 8 total, 8 up, 8 in 2024-01-13T19:05:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:31 smithi084 ceph-mon[119097]: pgmap v4106: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:05:32.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:31 smithi099 ceph-mon[138788]: osdmap e2420: 8 total, 8 up, 8 in 2024-01-13T19:05:32.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:31 smithi099 ceph-mon[138788]: pgmap v4106: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:05:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:32 smithi084 ceph-mon[116404]: osdmap e2421: 8 total, 8 up, 8 in 2024-01-13T19:05:33.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:32 smithi084 ceph-mon[119097]: osdmap e2421: 8 total, 8 up, 8 in 2024-01-13T19:05:33.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:32 smithi099 ceph-mon[138788]: osdmap e2421: 8 total, 8 up, 8 in 2024-01-13T19:05:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:33 smithi084 ceph-mon[116404]: osdmap e2422: 8 total, 8 up, 8 in 2024-01-13T19:05:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:33 smithi084 ceph-mon[116404]: pgmap v4109: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 761 KiB/s rd, 5.0 KiB/s wr, 1.03k op/s 2024-01-13T19:05:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:33 smithi084 ceph-mon[116404]: osdmap e2423: 8 total, 8 up, 8 in 2024-01-13T19:05:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:33 smithi084 ceph-mon[119097]: osdmap e2422: 8 total, 8 up, 8 in 2024-01-13T19:05:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:33 smithi084 ceph-mon[119097]: pgmap v4109: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 761 KiB/s rd, 5.0 KiB/s wr, 1.03k op/s 2024-01-13T19:05:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:33 smithi084 ceph-mon[119097]: osdmap e2423: 8 total, 8 up, 8 in 2024-01-13T19:05:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:33 smithi099 ceph-mon[138788]: osdmap e2422: 8 total, 8 up, 8 in 2024-01-13T19:05:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:33 smithi099 ceph-mon[138788]: pgmap v4109: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 761 KiB/s rd, 5.0 KiB/s wr, 1.03k op/s 2024-01-13T19:05:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:33 smithi099 ceph-mon[138788]: osdmap e2423: 8 total, 8 up, 8 in 2024-01-13T19:05:36.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:35 smithi084 ceph-mon[116404]: osdmap e2424: 8 total, 8 up, 8 in 2024-01-13T19:05:36.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:35 smithi084 ceph-mon[116404]: pgmap v4112: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 761 KiB/s rd, 5.0 KiB/s wr, 1.03k op/s 2024-01-13T19:05:36.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:35 smithi084 ceph-mon[119097]: osdmap e2424: 8 total, 8 up, 8 in 2024-01-13T19:05:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:35 smithi084 ceph-mon[119097]: pgmap v4112: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 761 KiB/s rd, 5.0 KiB/s wr, 1.03k op/s 2024-01-13T19:05:36.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:36.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:35 smithi099 ceph-mon[138788]: osdmap e2424: 8 total, 8 up, 8 in 2024-01-13T19:05:36.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:35 smithi099 ceph-mon[138788]: pgmap v4112: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 761 KiB/s rd, 5.0 KiB/s wr, 1.03k op/s 2024-01-13T19:05:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:36 smithi084 ceph-mon[116404]: osdmap e2425: 8 total, 8 up, 8 in 2024-01-13T19:05:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:05:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:05:37.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:05:37.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:05:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:36 smithi084 ceph-mon[119097]: osdmap e2425: 8 total, 8 up, 8 in 2024-01-13T19:05:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:05:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:05:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:05:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:05:37.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:36 smithi099 ceph-mon[138788]: osdmap e2425: 8 total, 8 up, 8 in 2024-01-13T19:05:37.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:05:37.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:05:37.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:05:37.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:05:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:37 smithi084 ceph-mon[116404]: osdmap e2426: 8 total, 8 up, 8 in 2024-01-13T19:05:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:37 smithi084 ceph-mon[116404]: pgmap v4115: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 728 KiB/s rd, 5.0 KiB/s wr, 984 op/s 2024-01-13T19:05:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:37 smithi084 ceph-mon[119097]: osdmap e2426: 8 total, 8 up, 8 in 2024-01-13T19:05:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:37 smithi084 ceph-mon[119097]: pgmap v4115: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 728 KiB/s rd, 5.0 KiB/s wr, 984 op/s 2024-01-13T19:05:38.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:37 smithi099 ceph-mon[138788]: osdmap e2426: 8 total, 8 up, 8 in 2024-01-13T19:05:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:37 smithi099 ceph-mon[138788]: pgmap v4115: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 728 KiB/s rd, 5.0 KiB/s wr, 984 op/s 2024-01-13T19:05:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:38 smithi084 ceph-mon[116404]: osdmap e2427: 8 total, 8 up, 8 in 2024-01-13T19:05:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:38 smithi084 ceph-mon[116404]: osdmap e2428: 8 total, 8 up, 8 in 2024-01-13T19:05:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:38 smithi084 ceph-mon[119097]: osdmap e2427: 8 total, 8 up, 8 in 2024-01-13T19:05:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:38 smithi084 ceph-mon[119097]: osdmap e2428: 8 total, 8 up, 8 in 2024-01-13T19:05:39.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:38 smithi099 ceph-mon[138788]: osdmap e2427: 8 total, 8 up, 8 in 2024-01-13T19:05:39.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:38 smithi099 ceph-mon[138788]: osdmap e2428: 8 total, 8 up, 8 in 2024-01-13T19:05:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:05:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:05:40] "GET /metrics HTTP/1.1" 200 36537 "" "Prometheus/2.43.0" 2024-01-13T19:05:41.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:40 smithi099 ceph-mon[138788]: pgmap v4118: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 728 KiB/s rd, 5.0 KiB/s wr, 985 op/s 2024-01-13T19:05:41.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:40 smithi099 ceph-mon[138788]: osdmap e2429: 8 total, 8 up, 8 in 2024-01-13T19:05:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:40 smithi084 ceph-mon[116404]: pgmap v4118: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 728 KiB/s rd, 5.0 KiB/s wr, 985 op/s 2024-01-13T19:05:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:40 smithi084 ceph-mon[116404]: osdmap e2429: 8 total, 8 up, 8 in 2024-01-13T19:05:41.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:40 smithi084 ceph-mon[119097]: pgmap v4118: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 728 KiB/s rd, 5.0 KiB/s wr, 985 op/s 2024-01-13T19:05:41.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:40 smithi084 ceph-mon[119097]: osdmap e2429: 8 total, 8 up, 8 in 2024-01-13T19:05:42.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:41 smithi099 ceph-mon[138788]: osdmap e2430: 8 total, 8 up, 8 in 2024-01-13T19:05:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:41 smithi084 ceph-mon[116404]: osdmap e2430: 8 total, 8 up, 8 in 2024-01-13T19:05:42.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:41 smithi084 ceph-mon[119097]: osdmap e2430: 8 total, 8 up, 8 in 2024-01-13T19:05:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:42 smithi084 ceph-mon[116404]: pgmap v4121: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:42 smithi084 ceph-mon[116404]: osdmap e2431: 8 total, 8 up, 8 in 2024-01-13T19:05:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:42 smithi084 ceph-mon[119097]: pgmap v4121: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:42 smithi084 ceph-mon[119097]: osdmap e2431: 8 total, 8 up, 8 in 2024-01-13T19:05:43.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:42 smithi099 ceph-mon[138788]: pgmap v4121: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:43.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:42 smithi099 ceph-mon[138788]: osdmap e2431: 8 total, 8 up, 8 in 2024-01-13T19:05:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:43 smithi084 ceph-mon[116404]: osdmap e2432: 8 total, 8 up, 8 in 2024-01-13T19:05:44.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:43 smithi084 ceph-mon[116404]: pgmap v4124: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 695 KiB/s rd, 5.0 KiB/s wr, 939 op/s 2024-01-13T19:05:44.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:43 smithi084 ceph-mon[116404]: osdmap e2433: 8 total, 8 up, 8 in 2024-01-13T19:05:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:43 smithi084 ceph-mon[119097]: osdmap e2432: 8 total, 8 up, 8 in 2024-01-13T19:05:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:43 smithi084 ceph-mon[119097]: pgmap v4124: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 695 KiB/s rd, 5.0 KiB/s wr, 939 op/s 2024-01-13T19:05:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:43 smithi084 ceph-mon[119097]: osdmap e2433: 8 total, 8 up, 8 in 2024-01-13T19:05:44.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:43 smithi099 ceph-mon[138788]: osdmap e2432: 8 total, 8 up, 8 in 2024-01-13T19:05:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:43 smithi099 ceph-mon[138788]: pgmap v4124: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 695 KiB/s rd, 5.0 KiB/s wr, 939 op/s 2024-01-13T19:05:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:43 smithi099 ceph-mon[138788]: osdmap e2433: 8 total, 8 up, 8 in 2024-01-13T19:05:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:45 smithi084 ceph-mon[116404]: osdmap e2434: 8 total, 8 up, 8 in 2024-01-13T19:05:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:45 smithi084 ceph-mon[116404]: pgmap v4127: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 696 KiB/s rd, 5.0 KiB/s wr, 942 op/s 2024-01-13T19:05:46.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:45 smithi084 ceph-mon[119097]: osdmap e2434: 8 total, 8 up, 8 in 2024-01-13T19:05:46.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:45 smithi084 ceph-mon[119097]: pgmap v4127: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 696 KiB/s rd, 5.0 KiB/s wr, 942 op/s 2024-01-13T19:05:46.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:45 smithi099 ceph-mon[138788]: osdmap e2434: 8 total, 8 up, 8 in 2024-01-13T19:05:46.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:45 smithi099 ceph-mon[138788]: pgmap v4127: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 696 KiB/s rd, 5.0 KiB/s wr, 942 op/s 2024-01-13T19:05:47.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:46 smithi084 ceph-mon[119097]: osdmap e2435: 8 total, 8 up, 8 in 2024-01-13T19:05:47.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:46 smithi084 ceph-mon[116404]: osdmap e2435: 8 total, 8 up, 8 in 2024-01-13T19:05:47.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:46 smithi099 ceph-mon[138788]: osdmap e2435: 8 total, 8 up, 8 in 2024-01-13T19:05:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:47 smithi084 ceph-mon[116404]: osdmap e2436: 8 total, 8 up, 8 in 2024-01-13T19:05:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:47 smithi084 ceph-mon[116404]: pgmap v4130: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 663 KiB/s rd, 5.0 KiB/s wr, 898 op/s 2024-01-13T19:05:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:47 smithi084 ceph-mon[119097]: osdmap e2436: 8 total, 8 up, 8 in 2024-01-13T19:05:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:47 smithi084 ceph-mon[119097]: pgmap v4130: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 663 KiB/s rd, 5.0 KiB/s wr, 898 op/s 2024-01-13T19:05:48.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:47 smithi099 ceph-mon[138788]: osdmap e2436: 8 total, 8 up, 8 in 2024-01-13T19:05:48.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:47 smithi099 ceph-mon[138788]: pgmap v4130: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 663 KiB/s rd, 5.0 KiB/s wr, 898 op/s 2024-01-13T19:05:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:48 smithi084 ceph-mon[116404]: osdmap e2437: 8 total, 8 up, 8 in 2024-01-13T19:05:49.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:48 smithi084 ceph-mon[116404]: osdmap e2438: 8 total, 8 up, 8 in 2024-01-13T19:05:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:48 smithi084 ceph-mon[119097]: osdmap e2437: 8 total, 8 up, 8 in 2024-01-13T19:05:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:48 smithi084 ceph-mon[119097]: osdmap e2438: 8 total, 8 up, 8 in 2024-01-13T19:05:49.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:48 smithi099 ceph-mon[138788]: osdmap e2437: 8 total, 8 up, 8 in 2024-01-13T19:05:49.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:48 smithi099 ceph-mon[138788]: osdmap e2438: 8 total, 8 up, 8 in 2024-01-13T19:05:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:05:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:05:50] "GET /metrics HTTP/1.1" 200 36538 "" "Prometheus/2.43.0" 2024-01-13T19:05:51.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:50 smithi084 ceph-mon[116404]: pgmap v4133: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 662 KiB/s rd, 5.0 KiB/s wr, 897 op/s 2024-01-13T19:05:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:50 smithi084 ceph-mon[116404]: osdmap e2439: 8 total, 8 up, 8 in 2024-01-13T19:05:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:50 smithi084 ceph-mon[119097]: pgmap v4133: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 662 KiB/s rd, 5.0 KiB/s wr, 897 op/s 2024-01-13T19:05:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:50 smithi084 ceph-mon[119097]: osdmap e2439: 8 total, 8 up, 8 in 2024-01-13T19:05:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:51.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:50 smithi099 ceph-mon[138788]: pgmap v4133: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 662 KiB/s rd, 5.0 KiB/s wr, 897 op/s 2024-01-13T19:05:51.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:50 smithi099 ceph-mon[138788]: osdmap e2439: 8 total, 8 up, 8 in 2024-01-13T19:05:51.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:05:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:51 smithi084 ceph-mon[116404]: osdmap e2440: 8 total, 8 up, 8 in 2024-01-13T19:05:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:51 smithi084 ceph-mon[116404]: pgmap v4136: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:52.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:51 smithi084 ceph-mon[119097]: osdmap e2440: 8 total, 8 up, 8 in 2024-01-13T19:05:52.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:51 smithi084 ceph-mon[119097]: pgmap v4136: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:52.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:51 smithi099 ceph-mon[138788]: osdmap e2440: 8 total, 8 up, 8 in 2024-01-13T19:05:52.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:51 smithi099 ceph-mon[138788]: pgmap v4136: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-01-13T19:05:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:52 smithi084 ceph-mon[116404]: osdmap e2441: 8 total, 8 up, 8 in 2024-01-13T19:05:53.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:52 smithi084 ceph-mon[119097]: osdmap e2441: 8 total, 8 up, 8 in 2024-01-13T19:05:53.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:52 smithi099 ceph-mon[138788]: osdmap e2441: 8 total, 8 up, 8 in 2024-01-13T19:05:54.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:53 smithi084 ceph-mon[116404]: osdmap e2442: 8 total, 8 up, 8 in 2024-01-13T19:05:54.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:53 smithi084 ceph-mon[116404]: pgmap v4139: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 630 KiB/s rd, 5.0 KiB/s wr, 856 op/s 2024-01-13T19:05:54.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:53 smithi084 ceph-mon[116404]: osdmap e2443: 8 total, 8 up, 8 in 2024-01-13T19:05:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:53 smithi084 ceph-mon[119097]: osdmap e2442: 8 total, 8 up, 8 in 2024-01-13T19:05:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:53 smithi084 ceph-mon[119097]: pgmap v4139: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 630 KiB/s rd, 5.0 KiB/s wr, 856 op/s 2024-01-13T19:05:54.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:53 smithi084 ceph-mon[119097]: osdmap e2443: 8 total, 8 up, 8 in 2024-01-13T19:05:54.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:53 smithi099 ceph-mon[138788]: osdmap e2442: 8 total, 8 up, 8 in 2024-01-13T19:05:54.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:53 smithi099 ceph-mon[138788]: pgmap v4139: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 630 KiB/s rd, 5.0 KiB/s wr, 856 op/s 2024-01-13T19:05:54.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:53 smithi099 ceph-mon[138788]: osdmap e2443: 8 total, 8 up, 8 in 2024-01-13T19:05:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:55 smithi084 ceph-mon[116404]: osdmap e2444: 8 total, 8 up, 8 in 2024-01-13T19:05:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:55 smithi084 ceph-mon[116404]: pgmap v4142: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 630 KiB/s rd, 5.0 KiB/s wr, 855 op/s 2024-01-13T19:05:56.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:55 smithi084 ceph-mon[119097]: osdmap e2444: 8 total, 8 up, 8 in 2024-01-13T19:05:56.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:55 smithi084 ceph-mon[119097]: pgmap v4142: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 630 KiB/s rd, 5.0 KiB/s wr, 855 op/s 2024-01-13T19:05:56.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:55 smithi099 ceph-mon[138788]: osdmap e2444: 8 total, 8 up, 8 in 2024-01-13T19:05:56.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:55 smithi099 ceph-mon[138788]: pgmap v4142: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 630 KiB/s rd, 5.0 KiB/s wr, 855 op/s 2024-01-13T19:05:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:56 smithi084 ceph-mon[116404]: osdmap e2445: 8 total, 8 up, 8 in 2024-01-13T19:05:57.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:56 smithi084 ceph-mon[119097]: osdmap e2445: 8 total, 8 up, 8 in 2024-01-13T19:05:57.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:56 smithi099 ceph-mon[138788]: osdmap e2445: 8 total, 8 up, 8 in 2024-01-13T19:05:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:57 smithi084 ceph-mon[116404]: osdmap e2446: 8 total, 8 up, 8 in 2024-01-13T19:05:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:57 smithi084 ceph-mon[116404]: pgmap v4145: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 597 KiB/s rd, 5.0 KiB/s wr, 808 op/s 2024-01-13T19:05:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:57 smithi084 ceph-mon[119097]: osdmap e2446: 8 total, 8 up, 8 in 2024-01-13T19:05:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:57 smithi084 ceph-mon[119097]: pgmap v4145: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 597 KiB/s rd, 5.0 KiB/s wr, 808 op/s 2024-01-13T19:05:58.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:57 smithi099 ceph-mon[138788]: osdmap e2446: 8 total, 8 up, 8 in 2024-01-13T19:05:58.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:57 smithi099 ceph-mon[138788]: pgmap v4145: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 597 KiB/s rd, 5.0 KiB/s wr, 808 op/s 2024-01-13T19:05:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:58 smithi084 ceph-mon[116404]: osdmap e2447: 8 total, 8 up, 8 in 2024-01-13T19:05:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:58 smithi084 ceph-mon[116404]: osdmap e2448: 8 total, 8 up, 8 in 2024-01-13T19:05:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:58 smithi084 ceph-mon[119097]: osdmap e2447: 8 total, 8 up, 8 in 2024-01-13T19:05:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:58 smithi084 ceph-mon[119097]: osdmap e2448: 8 total, 8 up, 8 in 2024-01-13T19:05:59.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:58 smithi099 ceph-mon[138788]: osdmap e2447: 8 total, 8 up, 8 in 2024-01-13T19:05:59.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:58 smithi099 ceph-mon[138788]: osdmap e2448: 8 total, 8 up, 8 in 2024-01-13T19:06:00.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:59 smithi084 ceph-mon[116404]: pgmap v4148: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 598 KiB/s rd, 5.0 KiB/s wr, 809 op/s 2024-01-13T19:06:00.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:05:59 smithi084 ceph-mon[116404]: osdmap e2449: 8 total, 8 up, 8 in 2024-01-13T19:06:00.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:59 smithi084 ceph-mon[119097]: pgmap v4148: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 598 KiB/s rd, 5.0 KiB/s wr, 809 op/s 2024-01-13T19:06:00.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:05:59 smithi084 ceph-mon[119097]: osdmap e2449: 8 total, 8 up, 8 in 2024-01-13T19:06:00.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:59 smithi099 ceph-mon[138788]: pgmap v4148: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 598 KiB/s rd, 5.0 KiB/s wr, 809 op/s 2024-01-13T19:06:00.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:05:59 smithi099 ceph-mon[138788]: osdmap e2449: 8 total, 8 up, 8 in 2024-01-13T19:06:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:06:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:06:00] "GET /metrics HTTP/1.1" 200 36538 "" "Prometheus/2.43.0" 2024-01-13T19:06:02.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:01 smithi099 ceph-mon[138788]: osdmap e2450: 8 total, 8 up, 8 in 2024-01-13T19:06:02.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:01 smithi099 ceph-mon[138788]: pgmap v4151: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:06:02.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:01 smithi084 ceph-mon[116404]: osdmap e2450: 8 total, 8 up, 8 in 2024-01-13T19:06:02.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:01 smithi084 ceph-mon[116404]: pgmap v4151: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:06:02.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:01 smithi084 ceph-mon[119097]: osdmap e2450: 8 total, 8 up, 8 in 2024-01-13T19:06:02.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:01 smithi084 ceph-mon[119097]: pgmap v4151: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2024-01-13T19:06:03.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:02 smithi099 ceph-mon[138788]: osdmap e2451: 8 total, 8 up, 8 in 2024-01-13T19:06:03.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:02 smithi084 ceph-mon[116404]: osdmap e2451: 8 total, 8 up, 8 in 2024-01-13T19:06:03.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:02 smithi084 ceph-mon[119097]: osdmap e2451: 8 total, 8 up, 8 in 2024-01-13T19:06:04.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:03 smithi099 ceph-mon[138788]: osdmap e2452: 8 total, 8 up, 8 in 2024-01-13T19:06:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:03 smithi099 ceph-mon[138788]: pgmap v4154: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 564 KiB/s rd, 5.0 KiB/s wr, 765 op/s 2024-01-13T19:06:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:03 smithi099 ceph-mon[138788]: osdmap e2453: 8 total, 8 up, 8 in 2024-01-13T19:06:04.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:03 smithi084 ceph-mon[116404]: osdmap e2452: 8 total, 8 up, 8 in 2024-01-13T19:06:04.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:03 smithi084 ceph-mon[116404]: pgmap v4154: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 564 KiB/s rd, 5.0 KiB/s wr, 765 op/s 2024-01-13T19:06:04.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:03 smithi084 ceph-mon[116404]: osdmap e2453: 8 total, 8 up, 8 in 2024-01-13T19:06:04.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:03 smithi084 ceph-mon[119097]: osdmap e2452: 8 total, 8 up, 8 in 2024-01-13T19:06:04.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:03 smithi084 ceph-mon[119097]: pgmap v4154: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 564 KiB/s rd, 5.0 KiB/s wr, 765 op/s 2024-01-13T19:06:04.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:03 smithi084 ceph-mon[119097]: osdmap e2453: 8 total, 8 up, 8 in 2024-01-13T19:06:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:05 smithi099 ceph-mon[138788]: osdmap e2454: 8 total, 8 up, 8 in 2024-01-13T19:06:06.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:06.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:05 smithi084 ceph-mon[119097]: osdmap e2454: 8 total, 8 up, 8 in 2024-01-13T19:06:06.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:06.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:05 smithi084 ceph-mon[116404]: osdmap e2454: 8 total, 8 up, 8 in 2024-01-13T19:06:06.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:06 smithi084 ceph-mon[116404]: pgmap v4157: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 565 KiB/s rd, 5.0 KiB/s wr, 767 op/s 2024-01-13T19:06:07.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:06 smithi084 ceph-mon[116404]: osdmap e2455: 8 total, 8 up, 8 in 2024-01-13T19:06:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:06 smithi084 ceph-mon[119097]: pgmap v4157: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 565 KiB/s rd, 5.0 KiB/s wr, 767 op/s 2024-01-13T19:06:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:06 smithi084 ceph-mon[119097]: osdmap e2455: 8 total, 8 up, 8 in 2024-01-13T19:06:07.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:06 smithi099 ceph-mon[138788]: pgmap v4157: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 565 KiB/s rd, 5.0 KiB/s wr, 767 op/s 2024-01-13T19:06:07.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:06 smithi099 ceph-mon[138788]: osdmap e2455: 8 total, 8 up, 8 in 2024-01-13T19:06:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:07 smithi084 ceph-mon[116404]: osdmap e2456: 8 total, 8 up, 8 in 2024-01-13T19:06:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:07 smithi084 ceph-mon[116404]: pgmap v4160: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 533 KiB/s rd, 5.0 KiB/s wr, 722 op/s 2024-01-13T19:06:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:07 smithi084 ceph-mon[119097]: osdmap e2456: 8 total, 8 up, 8 in 2024-01-13T19:06:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:07 smithi084 ceph-mon[119097]: pgmap v4160: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 533 KiB/s rd, 5.0 KiB/s wr, 722 op/s 2024-01-13T19:06:08.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:07 smithi099 ceph-mon[138788]: osdmap e2456: 8 total, 8 up, 8 in 2024-01-13T19:06:08.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:07 smithi099 ceph-mon[138788]: pgmap v4160: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 533 KiB/s rd, 5.0 KiB/s wr, 722 op/s 2024-01-13T19:06:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:08 smithi084 ceph-mon[116404]: osdmap e2457: 8 total, 8 up, 8 in 2024-01-13T19:06:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:08 smithi084 ceph-mon[116404]: osdmap e2458: 8 total, 8 up, 8 in 2024-01-13T19:06:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:08 smithi084 ceph-mon[119097]: osdmap e2457: 8 total, 8 up, 8 in 2024-01-13T19:06:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:08 smithi084 ceph-mon[119097]: osdmap e2458: 8 total, 8 up, 8 in 2024-01-13T19:06:09.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:08 smithi099 ceph-mon[138788]: osdmap e2457: 8 total, 8 up, 8 in 2024-01-13T19:06:09.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:08 smithi099 ceph-mon[138788]: osdmap e2458: 8 total, 8 up, 8 in 2024-01-13T19:06:10.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:09 smithi084 ceph-mon[116404]: pgmap v4163: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 533 KiB/s rd, 5.0 KiB/s wr, 723 op/s 2024-01-13T19:06:10.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:09 smithi084 ceph-mon[119097]: pgmap v4163: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 533 KiB/s rd, 5.0 KiB/s wr, 723 op/s 2024-01-13T19:06:10.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:09 smithi099 ceph-mon[138788]: pgmap v4163: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 533 KiB/s rd, 5.0 KiB/s wr, 723 op/s 2024-01-13T19:06:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:06:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:06:10] "GET /metrics HTTP/1.1" 200 36538 "" "Prometheus/2.43.0" 2024-01-13T19:06:11.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:10 smithi084 ceph-mon[116404]: osdmap e2459: 8 total, 8 up, 8 in 2024-01-13T19:06:11.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:10 smithi084 ceph-mon[119097]: osdmap e2459: 8 total, 8 up, 8 in 2024-01-13T19:06:11.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:10 smithi099 ceph-mon[138788]: osdmap e2459: 8 total, 8 up, 8 in 2024-01-13T19:06:12.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:11 smithi084 ceph-mon[116404]: osdmap e2460: 8 total, 8 up, 8 in 2024-01-13T19:06:12.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:11 smithi084 ceph-mon[116404]: pgmap v4166: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:06:12.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:11 smithi084 ceph-mon[119097]: osdmap e2460: 8 total, 8 up, 8 in 2024-01-13T19:06:12.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:11 smithi084 ceph-mon[119097]: pgmap v4166: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:06:12.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:11 smithi099 ceph-mon[138788]: osdmap e2460: 8 total, 8 up, 8 in 2024-01-13T19:06:12.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:11 smithi099 ceph-mon[138788]: pgmap v4166: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:06:13.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:12 smithi084 ceph-mon[116404]: osdmap e2461: 8 total, 8 up, 8 in 2024-01-13T19:06:13.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:12 smithi084 ceph-mon[119097]: osdmap e2461: 8 total, 8 up, 8 in 2024-01-13T19:06:13.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:12 smithi099 ceph-mon[138788]: osdmap e2461: 8 total, 8 up, 8 in 2024-01-13T19:06:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:13 smithi084 ceph-mon[116404]: osdmap e2462: 8 total, 8 up, 8 in 2024-01-13T19:06:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:13 smithi084 ceph-mon[116404]: pgmap v4169: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 500 KiB/s rd, 5.0 KiB/s wr, 679 op/s 2024-01-13T19:06:14.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:13 smithi084 ceph-mon[116404]: osdmap e2463: 8 total, 8 up, 8 in 2024-01-13T19:06:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:13 smithi084 ceph-mon[119097]: osdmap e2462: 8 total, 8 up, 8 in 2024-01-13T19:06:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:13 smithi084 ceph-mon[119097]: pgmap v4169: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 500 KiB/s rd, 5.0 KiB/s wr, 679 op/s 2024-01-13T19:06:14.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:13 smithi084 ceph-mon[119097]: osdmap e2463: 8 total, 8 up, 8 in 2024-01-13T19:06:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:13 smithi099 ceph-mon[138788]: osdmap e2462: 8 total, 8 up, 8 in 2024-01-13T19:06:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:13 smithi099 ceph-mon[138788]: pgmap v4169: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 500 KiB/s rd, 5.0 KiB/s wr, 679 op/s 2024-01-13T19:06:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:13 smithi099 ceph-mon[138788]: osdmap e2463: 8 total, 8 up, 8 in 2024-01-13T19:06:16.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:15 smithi084 ceph-mon[116404]: osdmap e2464: 8 total, 8 up, 8 in 2024-01-13T19:06:16.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:15 smithi084 ceph-mon[119097]: osdmap e2464: 8 total, 8 up, 8 in 2024-01-13T19:06:16.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:15 smithi099 ceph-mon[138788]: osdmap e2464: 8 total, 8 up, 8 in 2024-01-13T19:06:17.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:16 smithi084 ceph-mon[116404]: pgmap v4172: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 501 KiB/s rd, 5.0 KiB/s wr, 682 op/s 2024-01-13T19:06:17.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:16 smithi084 ceph-mon[116404]: osdmap e2465: 8 total, 8 up, 8 in 2024-01-13T19:06:17.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:16 smithi084 ceph-mon[119097]: pgmap v4172: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 501 KiB/s rd, 5.0 KiB/s wr, 682 op/s 2024-01-13T19:06:17.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:16 smithi084 ceph-mon[119097]: osdmap e2465: 8 total, 8 up, 8 in 2024-01-13T19:06:17.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:16 smithi099 ceph-mon[138788]: pgmap v4172: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 501 KiB/s rd, 5.0 KiB/s wr, 682 op/s 2024-01-13T19:06:17.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:16 smithi099 ceph-mon[138788]: osdmap e2465: 8 total, 8 up, 8 in 2024-01-13T19:06:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:17 smithi084 ceph-mon[116404]: osdmap e2466: 8 total, 8 up, 8 in 2024-01-13T19:06:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:17 smithi084 ceph-mon[116404]: pgmap v4175: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 468 KiB/s rd, 5.0 KiB/s wr, 634 op/s 2024-01-13T19:06:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:17 smithi084 ceph-mon[119097]: osdmap e2466: 8 total, 8 up, 8 in 2024-01-13T19:06:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:17 smithi084 ceph-mon[119097]: pgmap v4175: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 468 KiB/s rd, 5.0 KiB/s wr, 634 op/s 2024-01-13T19:06:18.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:17 smithi099 ceph-mon[138788]: osdmap e2466: 8 total, 8 up, 8 in 2024-01-13T19:06:18.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:17 smithi099 ceph-mon[138788]: pgmap v4175: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 468 KiB/s rd, 5.0 KiB/s wr, 634 op/s 2024-01-13T19:06:19.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:18 smithi084 ceph-mon[116404]: osdmap e2467: 8 total, 8 up, 8 in 2024-01-13T19:06:19.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:18 smithi084 ceph-mon[116404]: osdmap e2468: 8 total, 8 up, 8 in 2024-01-13T19:06:19.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:18 smithi084 ceph-mon[119097]: osdmap e2467: 8 total, 8 up, 8 in 2024-01-13T19:06:19.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:18 smithi084 ceph-mon[119097]: osdmap e2468: 8 total, 8 up, 8 in 2024-01-13T19:06:19.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:18 smithi099 ceph-mon[138788]: osdmap e2467: 8 total, 8 up, 8 in 2024-01-13T19:06:19.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:18 smithi099 ceph-mon[138788]: osdmap e2468: 8 total, 8 up, 8 in 2024-01-13T19:06:20.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:19 smithi084 ceph-mon[116404]: pgmap v4178: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 468 KiB/s rd, 5.0 KiB/s wr, 634 op/s 2024-01-13T19:06:20.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:19 smithi084 ceph-mon[119097]: pgmap v4178: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 468 KiB/s rd, 5.0 KiB/s wr, 634 op/s 2024-01-13T19:06:20.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:19 smithi099 ceph-mon[138788]: pgmap v4178: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 468 KiB/s rd, 5.0 KiB/s wr, 634 op/s 2024-01-13T19:06:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:06:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:06:20] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:06:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:20 smithi084 ceph-mon[116404]: osdmap e2469: 8 total, 8 up, 8 in 2024-01-13T19:06:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:20 smithi084 ceph-mon[119097]: osdmap e2469: 8 total, 8 up, 8 in 2024-01-13T19:06:21.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:21.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:20 smithi099 ceph-mon[138788]: osdmap e2469: 8 total, 8 up, 8 in 2024-01-13T19:06:21.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:22.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:21 smithi084 ceph-mon[116404]: osdmap e2470: 8 total, 8 up, 8 in 2024-01-13T19:06:22.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:21 smithi084 ceph-mon[116404]: pgmap v4181: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:06:22.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:21 smithi084 ceph-mon[119097]: osdmap e2470: 8 total, 8 up, 8 in 2024-01-13T19:06:22.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:21 smithi084 ceph-mon[119097]: pgmap v4181: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:06:22.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:21 smithi099 ceph-mon[138788]: osdmap e2470: 8 total, 8 up, 8 in 2024-01-13T19:06:22.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:21 smithi099 ceph-mon[138788]: pgmap v4181: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:06:23.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:22 smithi084 ceph-mon[116404]: osdmap e2471: 8 total, 8 up, 8 in 2024-01-13T19:06:23.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:22 smithi084 ceph-mon[119097]: osdmap e2471: 8 total, 8 up, 8 in 2024-01-13T19:06:23.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:22 smithi099 ceph-mon[138788]: osdmap e2471: 8 total, 8 up, 8 in 2024-01-13T19:06:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:23 smithi084 ceph-mon[116404]: osdmap e2472: 8 total, 8 up, 8 in 2024-01-13T19:06:24.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:23 smithi084 ceph-mon[116404]: pgmap v4184: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 433 KiB/s rd, 5.0 KiB/s wr, 587 op/s 2024-01-13T19:06:24.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:23 smithi084 ceph-mon[116404]: osdmap e2473: 8 total, 8 up, 8 in 2024-01-13T19:06:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:23 smithi084 ceph-mon[119097]: osdmap e2472: 8 total, 8 up, 8 in 2024-01-13T19:06:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:23 smithi084 ceph-mon[119097]: pgmap v4184: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 433 KiB/s rd, 5.0 KiB/s wr, 587 op/s 2024-01-13T19:06:24.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:23 smithi084 ceph-mon[119097]: osdmap e2473: 8 total, 8 up, 8 in 2024-01-13T19:06:24.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:23 smithi099 ceph-mon[138788]: osdmap e2472: 8 total, 8 up, 8 in 2024-01-13T19:06:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:23 smithi099 ceph-mon[138788]: pgmap v4184: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 433 KiB/s rd, 5.0 KiB/s wr, 587 op/s 2024-01-13T19:06:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:23 smithi099 ceph-mon[138788]: osdmap e2473: 8 total, 8 up, 8 in 2024-01-13T19:06:26.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:25 smithi084 ceph-mon[119097]: osdmap e2474: 8 total, 8 up, 8 in 2024-01-13T19:06:26.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:25 smithi084 ceph-mon[116404]: osdmap e2474: 8 total, 8 up, 8 in 2024-01-13T19:06:26.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:25 smithi099 ceph-mon[138788]: osdmap e2474: 8 total, 8 up, 8 in 2024-01-13T19:06:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:26 smithi084 ceph-mon[116404]: pgmap v4187: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 434 KiB/s rd, 5.0 KiB/s wr, 588 op/s 2024-01-13T19:06:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:26 smithi084 ceph-mon[116404]: osdmap e2475: 8 total, 8 up, 8 in 2024-01-13T19:06:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:26 smithi084 ceph-mon[119097]: pgmap v4187: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 434 KiB/s rd, 5.0 KiB/s wr, 588 op/s 2024-01-13T19:06:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:26 smithi084 ceph-mon[119097]: osdmap e2475: 8 total, 8 up, 8 in 2024-01-13T19:06:27.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:26 smithi099 ceph-mon[138788]: pgmap v4187: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 434 KiB/s rd, 5.0 KiB/s wr, 588 op/s 2024-01-13T19:06:27.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:26 smithi099 ceph-mon[138788]: osdmap e2475: 8 total, 8 up, 8 in 2024-01-13T19:06:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:27 smithi084 ceph-mon[116404]: osdmap e2476: 8 total, 8 up, 8 in 2024-01-13T19:06:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:27 smithi084 ceph-mon[116404]: pgmap v4190: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 401 KiB/s rd, 5.0 KiB/s wr, 542 op/s 2024-01-13T19:06:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:27 smithi084 ceph-mon[119097]: osdmap e2476: 8 total, 8 up, 8 in 2024-01-13T19:06:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:27 smithi084 ceph-mon[119097]: pgmap v4190: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 401 KiB/s rd, 5.0 KiB/s wr, 542 op/s 2024-01-13T19:06:28.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:27 smithi099 ceph-mon[138788]: osdmap e2476: 8 total, 8 up, 8 in 2024-01-13T19:06:28.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:27 smithi099 ceph-mon[138788]: pgmap v4190: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 401 KiB/s rd, 5.0 KiB/s wr, 542 op/s 2024-01-13T19:06:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:28 smithi084 ceph-mon[116404]: osdmap e2477: 8 total, 8 up, 8 in 2024-01-13T19:06:29.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:28 smithi084 ceph-mon[116404]: osdmap e2478: 8 total, 8 up, 8 in 2024-01-13T19:06:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:28 smithi084 ceph-mon[119097]: osdmap e2477: 8 total, 8 up, 8 in 2024-01-13T19:06:29.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:28 smithi084 ceph-mon[119097]: osdmap e2478: 8 total, 8 up, 8 in 2024-01-13T19:06:29.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:28 smithi099 ceph-mon[138788]: osdmap e2477: 8 total, 8 up, 8 in 2024-01-13T19:06:29.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:28 smithi099 ceph-mon[138788]: osdmap e2478: 8 total, 8 up, 8 in 2024-01-13T19:06:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:29 smithi084 ceph-mon[116404]: pgmap v4193: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 402 KiB/s rd, 5.0 KiB/s wr, 544 op/s 2024-01-13T19:06:30.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:29 smithi084 ceph-mon[119097]: pgmap v4193: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 402 KiB/s rd, 5.0 KiB/s wr, 544 op/s 2024-01-13T19:06:30.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:29 smithi099 ceph-mon[138788]: pgmap v4193: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 402 KiB/s rd, 5.0 KiB/s wr, 544 op/s 2024-01-13T19:06:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:06:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:06:30] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:06:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:30 smithi084 ceph-mon[116404]: osdmap e2479: 8 total, 8 up, 8 in 2024-01-13T19:06:31.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:30 smithi084 ceph-mon[119097]: osdmap e2479: 8 total, 8 up, 8 in 2024-01-13T19:06:31.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:30 smithi099 ceph-mon[138788]: osdmap e2479: 8 total, 8 up, 8 in 2024-01-13T19:06:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:31 smithi084 ceph-mon[116404]: osdmap e2480: 8 total, 8 up, 8 in 2024-01-13T19:06:32.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:31 smithi084 ceph-mon[116404]: pgmap v4196: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:06:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:31 smithi084 ceph-mon[119097]: osdmap e2480: 8 total, 8 up, 8 in 2024-01-13T19:06:32.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:31 smithi084 ceph-mon[119097]: pgmap v4196: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:06:32.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:31 smithi099 ceph-mon[138788]: osdmap e2480: 8 total, 8 up, 8 in 2024-01-13T19:06:32.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:31 smithi099 ceph-mon[138788]: pgmap v4196: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:06:33.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:32 smithi084 ceph-mon[116404]: osdmap e2481: 8 total, 8 up, 8 in 2024-01-13T19:06:33.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:32 smithi084 ceph-mon[119097]: osdmap e2481: 8 total, 8 up, 8 in 2024-01-13T19:06:33.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:32 smithi099 ceph-mon[138788]: osdmap e2481: 8 total, 8 up, 8 in 2024-01-13T19:06:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:33 smithi084 ceph-mon[116404]: osdmap e2482: 8 total, 8 up, 8 in 2024-01-13T19:06:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:33 smithi084 ceph-mon[116404]: pgmap v4199: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 369 KiB/s rd, 5.0 KiB/s wr, 499 op/s 2024-01-13T19:06:34.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:33 smithi084 ceph-mon[116404]: osdmap e2483: 8 total, 8 up, 8 in 2024-01-13T19:06:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:33 smithi084 ceph-mon[119097]: osdmap e2482: 8 total, 8 up, 8 in 2024-01-13T19:06:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:33 smithi084 ceph-mon[119097]: pgmap v4199: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 369 KiB/s rd, 5.0 KiB/s wr, 499 op/s 2024-01-13T19:06:34.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:33 smithi084 ceph-mon[119097]: osdmap e2483: 8 total, 8 up, 8 in 2024-01-13T19:06:34.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:33 smithi099 ceph-mon[138788]: osdmap e2482: 8 total, 8 up, 8 in 2024-01-13T19:06:34.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:33 smithi099 ceph-mon[138788]: pgmap v4199: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 369 KiB/s rd, 5.0 KiB/s wr, 499 op/s 2024-01-13T19:06:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:33 smithi099 ceph-mon[138788]: osdmap e2483: 8 total, 8 up, 8 in 2024-01-13T19:06:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:35 smithi084 ceph-mon[116404]: osdmap e2484: 8 total, 8 up, 8 in 2024-01-13T19:06:36.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:36.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:35 smithi084 ceph-mon[119097]: osdmap e2484: 8 total, 8 up, 8 in 2024-01-13T19:06:36.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:35 smithi099 ceph-mon[138788]: osdmap e2484: 8 total, 8 up, 8 in 2024-01-13T19:06:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:36 smithi084 ceph-mon[116404]: pgmap v4202: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 369 KiB/s rd, 5.0 KiB/s wr, 500 op/s 2024-01-13T19:06:37.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:36 smithi084 ceph-mon[116404]: osdmap e2485: 8 total, 8 up, 8 in 2024-01-13T19:06:37.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:36 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:06:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:36 smithi084 ceph-mon[119097]: pgmap v4202: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 369 KiB/s rd, 5.0 KiB/s wr, 500 op/s 2024-01-13T19:06:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:36 smithi084 ceph-mon[119097]: osdmap e2485: 8 total, 8 up, 8 in 2024-01-13T19:06:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:36 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:06:37.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:36 smithi099 ceph-mon[138788]: pgmap v4202: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 369 KiB/s rd, 5.0 KiB/s wr, 500 op/s 2024-01-13T19:06:37.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:36 smithi099 ceph-mon[138788]: osdmap e2485: 8 total, 8 up, 8 in 2024-01-13T19:06:37.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:36 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:06:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:37 smithi084 ceph-mon[116404]: osdmap e2486: 8 total, 8 up, 8 in 2024-01-13T19:06:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:37 smithi084 ceph-mon[116404]: pgmap v4205: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 336 KiB/s rd, 5.0 KiB/s wr, 454 op/s 2024-01-13T19:06:38.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:06:38.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:06:38.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:06:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:37 smithi084 ceph-mon[119097]: osdmap e2486: 8 total, 8 up, 8 in 2024-01-13T19:06:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:37 smithi084 ceph-mon[119097]: pgmap v4205: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 336 KiB/s rd, 5.0 KiB/s wr, 454 op/s 2024-01-13T19:06:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:06:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:06:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:06:38.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:37 smithi099 ceph-mon[138788]: osdmap e2486: 8 total, 8 up, 8 in 2024-01-13T19:06:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:37 smithi099 ceph-mon[138788]: pgmap v4205: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 336 KiB/s rd, 5.0 KiB/s wr, 454 op/s 2024-01-13T19:06:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:06:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:06:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:06:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:38 smithi084 ceph-mon[116404]: osdmap e2487: 8 total, 8 up, 8 in 2024-01-13T19:06:39.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:38 smithi084 ceph-mon[116404]: osdmap e2488: 8 total, 8 up, 8 in 2024-01-13T19:06:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:38 smithi084 ceph-mon[119097]: osdmap e2487: 8 total, 8 up, 8 in 2024-01-13T19:06:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:38 smithi084 ceph-mon[119097]: osdmap e2488: 8 total, 8 up, 8 in 2024-01-13T19:06:39.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:38 smithi099 ceph-mon[138788]: osdmap e2487: 8 total, 8 up, 8 in 2024-01-13T19:06:39.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:38 smithi099 ceph-mon[138788]: osdmap e2488: 8 total, 8 up, 8 in 2024-01-13T19:06:40.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:39 smithi084 ceph-mon[119097]: pgmap v4208: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 338 KiB/s rd, 5.0 KiB/s wr, 458 op/s 2024-01-13T19:06:40.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:39 smithi084 ceph-mon[116404]: pgmap v4208: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 338 KiB/s rd, 5.0 KiB/s wr, 458 op/s 2024-01-13T19:06:40.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:39 smithi099 ceph-mon[138788]: pgmap v4208: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 338 KiB/s rd, 5.0 KiB/s wr, 458 op/s 2024-01-13T19:06:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:06:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:06:40] "GET /metrics HTTP/1.1" 200 36532 "" "Prometheus/2.43.0" 2024-01-13T19:06:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:40 smithi084 ceph-mon[116404]: osdmap e2489: 8 total, 8 up, 8 in 2024-01-13T19:06:41.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:40 smithi084 ceph-mon[119097]: osdmap e2489: 8 total, 8 up, 8 in 2024-01-13T19:06:41.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:40 smithi099 ceph-mon[138788]: osdmap e2489: 8 total, 8 up, 8 in 2024-01-13T19:06:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:41 smithi084 ceph-mon[116404]: osdmap e2490: 8 total, 8 up, 8 in 2024-01-13T19:06:42.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:41 smithi084 ceph-mon[116404]: pgmap v4211: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:06:42.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:41 smithi084 ceph-mon[119097]: osdmap e2490: 8 total, 8 up, 8 in 2024-01-13T19:06:42.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:41 smithi084 ceph-mon[119097]: pgmap v4211: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:06:42.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:41 smithi099 ceph-mon[138788]: osdmap e2490: 8 total, 8 up, 8 in 2024-01-13T19:06:42.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:41 smithi099 ceph-mon[138788]: pgmap v4211: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:06:43.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:42 smithi084 ceph-mon[116404]: osdmap e2491: 8 total, 8 up, 8 in 2024-01-13T19:06:43.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:42 smithi084 ceph-mon[119097]: osdmap e2491: 8 total, 8 up, 8 in 2024-01-13T19:06:43.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:42 smithi099 ceph-mon[138788]: osdmap e2491: 8 total, 8 up, 8 in 2024-01-13T19:06:44.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:43 smithi084 ceph-mon[116404]: osdmap e2492: 8 total, 8 up, 8 in 2024-01-13T19:06:44.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:43 smithi084 ceph-mon[116404]: pgmap v4214: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 304 KiB/s rd, 5.0 KiB/s wr, 411 op/s 2024-01-13T19:06:44.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:43 smithi084 ceph-mon[116404]: osdmap e2493: 8 total, 8 up, 8 in 2024-01-13T19:06:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:43 smithi084 ceph-mon[119097]: osdmap e2492: 8 total, 8 up, 8 in 2024-01-13T19:06:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:43 smithi084 ceph-mon[119097]: pgmap v4214: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 304 KiB/s rd, 5.0 KiB/s wr, 411 op/s 2024-01-13T19:06:44.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:43 smithi084 ceph-mon[119097]: osdmap e2493: 8 total, 8 up, 8 in 2024-01-13T19:06:44.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:43 smithi099 ceph-mon[138788]: osdmap e2492: 8 total, 8 up, 8 in 2024-01-13T19:06:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:43 smithi099 ceph-mon[138788]: pgmap v4214: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 304 KiB/s rd, 5.0 KiB/s wr, 411 op/s 2024-01-13T19:06:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:43 smithi099 ceph-mon[138788]: osdmap e2493: 8 total, 8 up, 8 in 2024-01-13T19:06:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:45 smithi084 ceph-mon[116404]: osdmap e2494: 8 total, 8 up, 8 in 2024-01-13T19:06:46.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:45 smithi084 ceph-mon[119097]: osdmap e2494: 8 total, 8 up, 8 in 2024-01-13T19:06:46.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:45 smithi099 ceph-mon[138788]: osdmap e2494: 8 total, 8 up, 8 in 2024-01-13T19:06:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:46 smithi084 ceph-mon[116404]: pgmap v4217: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 305 KiB/s rd, 5.0 KiB/s wr, 414 op/s 2024-01-13T19:06:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:46 smithi084 ceph-mon[116404]: osdmap e2495: 8 total, 8 up, 8 in 2024-01-13T19:06:47.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:46 smithi084 ceph-mon[119097]: pgmap v4217: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 305 KiB/s rd, 5.0 KiB/s wr, 414 op/s 2024-01-13T19:06:47.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:46 smithi084 ceph-mon[119097]: osdmap e2495: 8 total, 8 up, 8 in 2024-01-13T19:06:47.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:46 smithi099 ceph-mon[138788]: pgmap v4217: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 305 KiB/s rd, 5.0 KiB/s wr, 414 op/s 2024-01-13T19:06:47.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:46 smithi099 ceph-mon[138788]: osdmap e2495: 8 total, 8 up, 8 in 2024-01-13T19:06:48.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:47 smithi084 ceph-mon[119097]: osdmap e2496: 8 total, 8 up, 8 in 2024-01-13T19:06:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:47 smithi084 ceph-mon[119097]: pgmap v4220: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 271 KiB/s rd, 5.0 KiB/s wr, 367 op/s 2024-01-13T19:06:48.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:47 smithi084 ceph-mon[116404]: osdmap e2496: 8 total, 8 up, 8 in 2024-01-13T19:06:48.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:47 smithi084 ceph-mon[116404]: pgmap v4220: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 271 KiB/s rd, 5.0 KiB/s wr, 367 op/s 2024-01-13T19:06:48.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:47 smithi099 ceph-mon[138788]: osdmap e2496: 8 total, 8 up, 8 in 2024-01-13T19:06:48.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:47 smithi099 ceph-mon[138788]: pgmap v4220: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 271 KiB/s rd, 5.0 KiB/s wr, 367 op/s 2024-01-13T19:06:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:48 smithi084 ceph-mon[116404]: osdmap e2497: 8 total, 8 up, 8 in 2024-01-13T19:06:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:48 smithi084 ceph-mon[116404]: osdmap e2498: 8 total, 8 up, 8 in 2024-01-13T19:06:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:48 smithi084 ceph-mon[119097]: osdmap e2497: 8 total, 8 up, 8 in 2024-01-13T19:06:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:48 smithi084 ceph-mon[119097]: osdmap e2498: 8 total, 8 up, 8 in 2024-01-13T19:06:49.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:48 smithi099 ceph-mon[138788]: osdmap e2497: 8 total, 8 up, 8 in 2024-01-13T19:06:49.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:48 smithi099 ceph-mon[138788]: osdmap e2498: 8 total, 8 up, 8 in 2024-01-13T19:06:50.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:49 smithi084 ceph-mon[119097]: pgmap v4223: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 271 KiB/s rd, 5.0 KiB/s wr, 368 op/s 2024-01-13T19:06:50.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:49 smithi084 ceph-mon[116404]: pgmap v4223: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 271 KiB/s rd, 5.0 KiB/s wr, 368 op/s 2024-01-13T19:06:50.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:49 smithi099 ceph-mon[138788]: pgmap v4223: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 271 KiB/s rd, 5.0 KiB/s wr, 368 op/s 2024-01-13T19:06:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:06:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:06:50] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:06:51.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:50 smithi084 ceph-mon[119097]: osdmap e2499: 8 total, 8 up, 8 in 2024-01-13T19:06:51.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:50 smithi084 ceph-mon[116404]: osdmap e2499: 8 total, 8 up, 8 in 2024-01-13T19:06:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:51.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:50 smithi099 ceph-mon[138788]: osdmap e2499: 8 total, 8 up, 8 in 2024-01-13T19:06:51.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:06:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:51 smithi084 ceph-mon[116404]: osdmap e2500: 8 total, 8 up, 8 in 2024-01-13T19:06:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:51 smithi084 ceph-mon[116404]: pgmap v4226: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:06:52.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:51 smithi084 ceph-mon[119097]: osdmap e2500: 8 total, 8 up, 8 in 2024-01-13T19:06:52.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:51 smithi084 ceph-mon[119097]: pgmap v4226: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:06:52.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:51 smithi099 ceph-mon[138788]: osdmap e2500: 8 total, 8 up, 8 in 2024-01-13T19:06:52.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:51 smithi099 ceph-mon[138788]: pgmap v4226: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:06:53.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:52 smithi099 ceph-mon[138788]: osdmap e2501: 8 total, 8 up, 8 in 2024-01-13T19:06:53.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:52 smithi084 ceph-mon[119097]: osdmap e2501: 8 total, 8 up, 8 in 2024-01-13T19:06:53.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:52 smithi084 ceph-mon[116404]: osdmap e2501: 8 total, 8 up, 8 in 2024-01-13T19:06:54.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:53 smithi099 ceph-mon[138788]: osdmap e2502: 8 total, 8 up, 8 in 2024-01-13T19:06:54.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:53 smithi099 ceph-mon[138788]: pgmap v4229: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 238 KiB/s rd, 5.0 KiB/s wr, 324 op/s 2024-01-13T19:06:54.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:53 smithi099 ceph-mon[138788]: osdmap e2503: 8 total, 8 up, 8 in 2024-01-13T19:06:54.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:53 smithi084 ceph-mon[116404]: osdmap e2502: 8 total, 8 up, 8 in 2024-01-13T19:06:54.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:53 smithi084 ceph-mon[116404]: pgmap v4229: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 238 KiB/s rd, 5.0 KiB/s wr, 324 op/s 2024-01-13T19:06:54.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:53 smithi084 ceph-mon[116404]: osdmap e2503: 8 total, 8 up, 8 in 2024-01-13T19:06:54.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:53 smithi084 ceph-mon[119097]: osdmap e2502: 8 total, 8 up, 8 in 2024-01-13T19:06:54.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:53 smithi084 ceph-mon[119097]: pgmap v4229: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 238 KiB/s rd, 5.0 KiB/s wr, 324 op/s 2024-01-13T19:06:54.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:53 smithi084 ceph-mon[119097]: osdmap e2503: 8 total, 8 up, 8 in 2024-01-13T19:06:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:55 smithi084 ceph-mon[116404]: osdmap e2504: 8 total, 8 up, 8 in 2024-01-13T19:06:56.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:55 smithi084 ceph-mon[119097]: osdmap e2504: 8 total, 8 up, 8 in 2024-01-13T19:06:56.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:55 smithi099 ceph-mon[138788]: osdmap e2504: 8 total, 8 up, 8 in 2024-01-13T19:06:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:56 smithi084 ceph-mon[116404]: pgmap v4232: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 239 KiB/s rd, 5.0 KiB/s wr, 326 op/s 2024-01-13T19:06:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:56 smithi084 ceph-mon[116404]: osdmap e2505: 8 total, 8 up, 8 in 2024-01-13T19:06:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:56 smithi084 ceph-mon[119097]: pgmap v4232: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 239 KiB/s rd, 5.0 KiB/s wr, 326 op/s 2024-01-13T19:06:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:56 smithi084 ceph-mon[119097]: osdmap e2505: 8 total, 8 up, 8 in 2024-01-13T19:06:57.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:56 smithi099 ceph-mon[138788]: pgmap v4232: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 239 KiB/s rd, 5.0 KiB/s wr, 326 op/s 2024-01-13T19:06:57.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:56 smithi099 ceph-mon[138788]: osdmap e2505: 8 total, 8 up, 8 in 2024-01-13T19:06:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:57 smithi084 ceph-mon[116404]: osdmap e2506: 8 total, 8 up, 8 in 2024-01-13T19:06:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:57 smithi084 ceph-mon[116404]: pgmap v4235: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 205 KiB/s rd, 5.0 KiB/s wr, 279 op/s 2024-01-13T19:06:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:57 smithi084 ceph-mon[119097]: osdmap e2506: 8 total, 8 up, 8 in 2024-01-13T19:06:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:57 smithi084 ceph-mon[119097]: pgmap v4235: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 205 KiB/s rd, 5.0 KiB/s wr, 279 op/s 2024-01-13T19:06:58.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:57 smithi099 ceph-mon[138788]: osdmap e2506: 8 total, 8 up, 8 in 2024-01-13T19:06:58.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:57 smithi099 ceph-mon[138788]: pgmap v4235: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 205 KiB/s rd, 5.0 KiB/s wr, 279 op/s 2024-01-13T19:06:59.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:58 smithi084 ceph-mon[119097]: osdmap e2507: 8 total, 8 up, 8 in 2024-01-13T19:06:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:58 smithi084 ceph-mon[119097]: osdmap e2508: 8 total, 8 up, 8 in 2024-01-13T19:06:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:58 smithi084 ceph-mon[116404]: osdmap e2507: 8 total, 8 up, 8 in 2024-01-13T19:06:59.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:58 smithi084 ceph-mon[116404]: osdmap e2508: 8 total, 8 up, 8 in 2024-01-13T19:06:59.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:58 smithi099 ceph-mon[138788]: osdmap e2507: 8 total, 8 up, 8 in 2024-01-13T19:06:59.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:58 smithi099 ceph-mon[138788]: osdmap e2508: 8 total, 8 up, 8 in 2024-01-13T19:07:00.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:06:59 smithi084 ceph-mon[116404]: pgmap v4238: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 206 KiB/s rd, 5.0 KiB/s wr, 281 op/s 2024-01-13T19:07:00.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:06:59 smithi084 ceph-mon[119097]: pgmap v4238: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 206 KiB/s rd, 5.0 KiB/s wr, 281 op/s 2024-01-13T19:07:00.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:06:59 smithi099 ceph-mon[138788]: pgmap v4238: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 206 KiB/s rd, 5.0 KiB/s wr, 281 op/s 2024-01-13T19:07:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:07:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:07:00] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:07:01.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:00 smithi084 ceph-mon[116404]: osdmap e2509: 8 total, 8 up, 8 in 2024-01-13T19:07:01.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:00 smithi084 ceph-mon[119097]: osdmap e2509: 8 total, 8 up, 8 in 2024-01-13T19:07:01.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:00 smithi099 ceph-mon[138788]: osdmap e2509: 8 total, 8 up, 8 in 2024-01-13T19:07:02.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:01 smithi099 ceph-mon[138788]: osdmap e2510: 8 total, 8 up, 8 in 2024-01-13T19:07:02.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:01 smithi099 ceph-mon[138788]: pgmap v4241: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:07:02.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:01 smithi084 ceph-mon[116404]: osdmap e2510: 8 total, 8 up, 8 in 2024-01-13T19:07:02.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:01 smithi084 ceph-mon[116404]: pgmap v4241: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:07:02.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:01 smithi084 ceph-mon[119097]: osdmap e2510: 8 total, 8 up, 8 in 2024-01-13T19:07:02.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:01 smithi084 ceph-mon[119097]: pgmap v4241: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-01-13T19:07:03.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:02 smithi099 ceph-mon[138788]: osdmap e2511: 8 total, 8 up, 8 in 2024-01-13T19:07:03.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:02 smithi084 ceph-mon[116404]: osdmap e2511: 8 total, 8 up, 8 in 2024-01-13T19:07:03.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:02 smithi084 ceph-mon[119097]: osdmap e2511: 8 total, 8 up, 8 in 2024-01-13T19:07:04.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:03 smithi099 ceph-mon[138788]: osdmap e2512: 8 total, 8 up, 8 in 2024-01-13T19:07:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:03 smithi099 ceph-mon[138788]: pgmap v4244: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 173 KiB/s rd, 5.0 KiB/s wr, 234 op/s 2024-01-13T19:07:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:03 smithi099 ceph-mon[138788]: osdmap e2513: 8 total, 8 up, 8 in 2024-01-13T19:07:04.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:03 smithi084 ceph-mon[116404]: osdmap e2512: 8 total, 8 up, 8 in 2024-01-13T19:07:04.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:03 smithi084 ceph-mon[116404]: pgmap v4244: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 173 KiB/s rd, 5.0 KiB/s wr, 234 op/s 2024-01-13T19:07:04.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:03 smithi084 ceph-mon[116404]: osdmap e2513: 8 total, 8 up, 8 in 2024-01-13T19:07:04.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:03 smithi084 ceph-mon[119097]: osdmap e2512: 8 total, 8 up, 8 in 2024-01-13T19:07:04.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:03 smithi084 ceph-mon[119097]: pgmap v4244: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 173 KiB/s rd, 5.0 KiB/s wr, 234 op/s 2024-01-13T19:07:04.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:03 smithi084 ceph-mon[119097]: osdmap e2513: 8 total, 8 up, 8 in 2024-01-13T19:07:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:05 smithi084 ceph-mon[116404]: osdmap e2514: 8 total, 8 up, 8 in 2024-01-13T19:07:06.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:05 smithi084 ceph-mon[119097]: osdmap e2514: 8 total, 8 up, 8 in 2024-01-13T19:07:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:06.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:05 smithi099 ceph-mon[138788]: osdmap e2514: 8 total, 8 up, 8 in 2024-01-13T19:07:06.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:06 smithi084 ceph-mon[116404]: pgmap v4247: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 174 KiB/s rd, 5.0 KiB/s wr, 238 op/s 2024-01-13T19:07:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:06 smithi084 ceph-mon[116404]: osdmap e2515: 8 total, 8 up, 8 in 2024-01-13T19:07:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:06 smithi084 ceph-mon[119097]: pgmap v4247: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 174 KiB/s rd, 5.0 KiB/s wr, 238 op/s 2024-01-13T19:07:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:06 smithi084 ceph-mon[119097]: osdmap e2515: 8 total, 8 up, 8 in 2024-01-13T19:07:07.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:06 smithi099 ceph-mon[138788]: pgmap v4247: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 174 KiB/s rd, 5.0 KiB/s wr, 238 op/s 2024-01-13T19:07:07.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:06 smithi099 ceph-mon[138788]: osdmap e2515: 8 total, 8 up, 8 in 2024-01-13T19:07:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:07 smithi084 ceph-mon[116404]: osdmap e2516: 8 total, 8 up, 8 in 2024-01-13T19:07:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:07 smithi084 ceph-mon[116404]: pgmap v4250: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 141 KiB/s rd, 5.0 KiB/s wr, 194 op/s 2024-01-13T19:07:08.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:07 smithi084 ceph-mon[119097]: osdmap e2516: 8 total, 8 up, 8 in 2024-01-13T19:07:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:07 smithi084 ceph-mon[119097]: pgmap v4250: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 141 KiB/s rd, 5.0 KiB/s wr, 194 op/s 2024-01-13T19:07:08.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:07 smithi099 ceph-mon[138788]: osdmap e2516: 8 total, 8 up, 8 in 2024-01-13T19:07:08.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:07 smithi099 ceph-mon[138788]: pgmap v4250: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 141 KiB/s rd, 5.0 KiB/s wr, 194 op/s 2024-01-13T19:07:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:08 smithi084 ceph-mon[116404]: osdmap e2517: 8 total, 8 up, 8 in 2024-01-13T19:07:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:08 smithi084 ceph-mon[116404]: osdmap e2518: 8 total, 8 up, 8 in 2024-01-13T19:07:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:08 smithi084 ceph-mon[119097]: osdmap e2517: 8 total, 8 up, 8 in 2024-01-13T19:07:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:08 smithi084 ceph-mon[119097]: osdmap e2518: 8 total, 8 up, 8 in 2024-01-13T19:07:09.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:08 smithi099 ceph-mon[138788]: osdmap e2517: 8 total, 8 up, 8 in 2024-01-13T19:07:09.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:08 smithi099 ceph-mon[138788]: osdmap e2518: 8 total, 8 up, 8 in 2024-01-13T19:07:10.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:09 smithi084 ceph-mon[116404]: pgmap v4253: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 141 KiB/s rd, 5.0 KiB/s wr, 194 op/s 2024-01-13T19:07:10.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:09 smithi084 ceph-mon[119097]: pgmap v4253: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 141 KiB/s rd, 5.0 KiB/s wr, 194 op/s 2024-01-13T19:07:10.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:09 smithi099 ceph-mon[138788]: pgmap v4253: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 141 KiB/s rd, 5.0 KiB/s wr, 194 op/s 2024-01-13T19:07:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:07:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:07:10] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:07:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:10 smithi084 ceph-mon[116404]: osdmap e2519: 8 total, 8 up, 8 in 2024-01-13T19:07:11.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:10 smithi084 ceph-mon[119097]: osdmap e2519: 8 total, 8 up, 8 in 2024-01-13T19:07:11.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:10 smithi099 ceph-mon[138788]: osdmap e2519: 8 total, 8 up, 8 in 2024-01-13T19:07:12.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:11 smithi099 ceph-mon[138788]: osdmap e2520: 8 total, 8 up, 8 in 2024-01-13T19:07:12.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:11 smithi099 ceph-mon[138788]: pgmap v4256: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:07:12.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:11 smithi084 ceph-mon[116404]: osdmap e2520: 8 total, 8 up, 8 in 2024-01-13T19:07:12.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:11 smithi084 ceph-mon[116404]: pgmap v4256: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:07:12.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:11 smithi084 ceph-mon[119097]: osdmap e2520: 8 total, 8 up, 8 in 2024-01-13T19:07:12.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:11 smithi084 ceph-mon[119097]: pgmap v4256: 137 pgs: 137 active+clean; 4.6 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:07:13.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:12 smithi099 ceph-mon[138788]: osdmap e2521: 8 total, 8 up, 8 in 2024-01-13T19:07:13.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:12 smithi084 ceph-mon[116404]: osdmap e2521: 8 total, 8 up, 8 in 2024-01-13T19:07:13.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:12 smithi084 ceph-mon[119097]: osdmap e2521: 8 total, 8 up, 8 in 2024-01-13T19:07:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:13 smithi099 ceph-mon[138788]: osdmap e2522: 8 total, 8 up, 8 in 2024-01-13T19:07:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:13 smithi099 ceph-mon[138788]: pgmap v4259: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 109 KiB/s rd, 5.0 KiB/s wr, 149 op/s 2024-01-13T19:07:14.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:13 smithi099 ceph-mon[138788]: osdmap e2523: 8 total, 8 up, 8 in 2024-01-13T19:07:14.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:13 smithi084 ceph-mon[116404]: osdmap e2522: 8 total, 8 up, 8 in 2024-01-13T19:07:14.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:13 smithi084 ceph-mon[116404]: pgmap v4259: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 109 KiB/s rd, 5.0 KiB/s wr, 149 op/s 2024-01-13T19:07:14.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:13 smithi084 ceph-mon[116404]: osdmap e2523: 8 total, 8 up, 8 in 2024-01-13T19:07:14.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:13 smithi084 ceph-mon[119097]: osdmap e2522: 8 total, 8 up, 8 in 2024-01-13T19:07:14.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:13 smithi084 ceph-mon[119097]: pgmap v4259: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 109 KiB/s rd, 5.0 KiB/s wr, 149 op/s 2024-01-13T19:07:14.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:13 smithi084 ceph-mon[119097]: osdmap e2523: 8 total, 8 up, 8 in 2024-01-13T19:07:16.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:15 smithi084 ceph-mon[119097]: osdmap e2524: 8 total, 8 up, 8 in 2024-01-13T19:07:16.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:15 smithi084 ceph-mon[116404]: osdmap e2524: 8 total, 8 up, 8 in 2024-01-13T19:07:16.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:15 smithi099 ceph-mon[138788]: osdmap e2524: 8 total, 8 up, 8 in 2024-01-13T19:07:17.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:16 smithi084 ceph-mon[116404]: pgmap v4262: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 110 KiB/s rd, 5.0 KiB/s wr, 151 op/s 2024-01-13T19:07:17.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:16 smithi084 ceph-mon[116404]: osdmap e2525: 8 total, 8 up, 8 in 2024-01-13T19:07:17.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:16 smithi084 ceph-mon[119097]: pgmap v4262: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 110 KiB/s rd, 5.0 KiB/s wr, 151 op/s 2024-01-13T19:07:17.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:16 smithi084 ceph-mon[119097]: osdmap e2525: 8 total, 8 up, 8 in 2024-01-13T19:07:17.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:16 smithi099 ceph-mon[138788]: pgmap v4262: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 110 KiB/s rd, 5.0 KiB/s wr, 151 op/s 2024-01-13T19:07:17.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:16 smithi099 ceph-mon[138788]: osdmap e2525: 8 total, 8 up, 8 in 2024-01-13T19:07:18.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:17 smithi084 ceph-mon[116404]: osdmap e2526: 8 total, 8 up, 8 in 2024-01-13T19:07:18.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:17 smithi084 ceph-mon[116404]: pgmap v4265: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 75 KiB/s rd, 5.0 KiB/s wr, 105 op/s 2024-01-13T19:07:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:17 smithi084 ceph-mon[119097]: osdmap e2526: 8 total, 8 up, 8 in 2024-01-13T19:07:18.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:17 smithi084 ceph-mon[119097]: pgmap v4265: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 75 KiB/s rd, 5.0 KiB/s wr, 105 op/s 2024-01-13T19:07:18.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:17 smithi099 ceph-mon[138788]: osdmap e2526: 8 total, 8 up, 8 in 2024-01-13T19:07:18.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:17 smithi099 ceph-mon[138788]: pgmap v4265: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 75 KiB/s rd, 5.0 KiB/s wr, 105 op/s 2024-01-13T19:07:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:18 smithi084 ceph-mon[116404]: osdmap e2527: 8 total, 8 up, 8 in 2024-01-13T19:07:19.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:18 smithi084 ceph-mon[116404]: osdmap e2528: 8 total, 8 up, 8 in 2024-01-13T19:07:19.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:18 smithi084 ceph-mon[119097]: osdmap e2527: 8 total, 8 up, 8 in 2024-01-13T19:07:19.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:18 smithi084 ceph-mon[119097]: osdmap e2528: 8 total, 8 up, 8 in 2024-01-13T19:07:19.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:18 smithi099 ceph-mon[138788]: osdmap e2527: 8 total, 8 up, 8 in 2024-01-13T19:07:19.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:18 smithi099 ceph-mon[138788]: osdmap e2528: 8 total, 8 up, 8 in 2024-01-13T19:07:20.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:19 smithi084 ceph-mon[116404]: pgmap v4268: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 76 KiB/s rd, 5.0 KiB/s wr, 106 op/s 2024-01-13T19:07:20.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:19 smithi084 ceph-mon[119097]: pgmap v4268: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 76 KiB/s rd, 5.0 KiB/s wr, 106 op/s 2024-01-13T19:07:20.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:19 smithi099 ceph-mon[138788]: pgmap v4268: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 76 KiB/s rd, 5.0 KiB/s wr, 106 op/s 2024-01-13T19:07:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:07:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:07:20] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:07:21.009 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_many_snaps ... ok 2024-01-13T19:07:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:20 smithi084 ceph-mon[116404]: osdmap e2529: 8 total, 8 up, 8 in 2024-01-13T19:07:21.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:21.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:20 smithi084 ceph-mon[119097]: osdmap e2529: 8 total, 8 up, 8 in 2024-01-13T19:07:21.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:21.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:20 smithi099 ceph-mon[138788]: osdmap e2529: 8 total, 8 up, 8 in 2024-01-13T19:07:21.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:21.716 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_metadata ... ok 2024-01-13T19:07:21.795 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_modify_timestamp ... ok 2024-01-13T19:07:22.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:21 smithi084 ceph-mon[119097]: osdmap e2530: 8 total, 8 up, 8 in 2024-01-13T19:07:22.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:21 smithi084 ceph-mon[119097]: pgmap v4271: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:07:22.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:21 smithi084 ceph-mon[116404]: osdmap e2530: 8 total, 8 up, 8 in 2024-01-13T19:07:22.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:21 smithi084 ceph-mon[116404]: pgmap v4271: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:07:22.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:21 smithi099 ceph-mon[138788]: osdmap e2530: 8 total, 8 up, 8 in 2024-01-13T19:07:22.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:21 smithi099 ceph-mon[138788]: pgmap v4271: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-01-13T19:07:23.013 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_protect_snap ... ok 2024-01-13T19:07:23.092 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_read ... ok 2024-01-13T19:07:23.161 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_read_bad_offset ... ok 2024-01-13T19:07:23.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:22 smithi084 ceph-mon[116404]: osdmap e2531: 8 total, 8 up, 8 in 2024-01-13T19:07:23.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:22 smithi084 ceph-mon[119097]: osdmap e2531: 8 total, 8 up, 8 in 2024-01-13T19:07:23.241 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_read_with_fadvise_flags ... ok 2024-01-13T19:07:23.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:22 smithi099 ceph-mon[138788]: osdmap e2531: 8 total, 8 up, 8 in 2024-01-13T19:07:24.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:23 smithi084 ceph-mon[119097]: osdmap e2532: 8 total, 8 up, 8 in 2024-01-13T19:07:24.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:23 smithi084 ceph-mon[119097]: pgmap v4274: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 39 KiB/s wr, 828 op/s 2024-01-13T19:07:24.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:23 smithi084 ceph-mon[119097]: osdmap e2533: 8 total, 8 up, 8 in 2024-01-13T19:07:24.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:23 smithi084 ceph-mon[116404]: osdmap e2532: 8 total, 8 up, 8 in 2024-01-13T19:07:24.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:23 smithi084 ceph-mon[116404]: pgmap v4274: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 39 KiB/s wr, 828 op/s 2024-01-13T19:07:24.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:23 smithi084 ceph-mon[116404]: osdmap e2533: 8 total, 8 up, 8 in 2024-01-13T19:07:24.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:23 smithi099 ceph-mon[138788]: osdmap e2532: 8 total, 8 up, 8 in 2024-01-13T19:07:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:23 smithi099 ceph-mon[138788]: pgmap v4274: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 39 KiB/s wr, 828 op/s 2024-01-13T19:07:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:23 smithi099 ceph-mon[138788]: osdmap e2533: 8 total, 8 up, 8 in 2024-01-13T19:07:24.979 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_remove_snap ... ok 2024-01-13T19:07:26.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:25 smithi084 ceph-mon[119097]: osdmap e2534: 8 total, 8 up, 8 in 2024-01-13T19:07:26.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:25 smithi084 ceph-mon[116404]: osdmap e2534: 8 total, 8 up, 8 in 2024-01-13T19:07:26.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:25 smithi099 ceph-mon[138788]: osdmap e2534: 8 total, 8 up, 8 in 2024-01-13T19:07:26.980 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_remove_snap2 ... ok 2024-01-13T19:07:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:26 smithi084 ceph-mon[116404]: pgmap v4277: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 48 KiB/s wr, 931 op/s 2024-01-13T19:07:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:26 smithi084 ceph-mon[116404]: osdmap e2535: 8 total, 8 up, 8 in 2024-01-13T19:07:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:26 smithi084 ceph-mon[119097]: pgmap v4277: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 48 KiB/s wr, 931 op/s 2024-01-13T19:07:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:26 smithi084 ceph-mon[119097]: osdmap e2535: 8 total, 8 up, 8 in 2024-01-13T19:07:27.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:26 smithi099 ceph-mon[138788]: pgmap v4277: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 2.8 MiB/s rd, 48 KiB/s wr, 931 op/s 2024-01-13T19:07:27.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:26 smithi099 ceph-mon[138788]: osdmap e2535: 8 total, 8 up, 8 in 2024-01-13T19:07:28.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:27 smithi084 ceph-mon[116404]: osdmap e2536: 8 total, 8 up, 8 in 2024-01-13T19:07:28.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:27 smithi084 ceph-mon[116404]: pgmap v4280: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 187 KiB/s rd, 15 KiB/s wr, 263 op/s 2024-01-13T19:07:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:27 smithi084 ceph-mon[119097]: osdmap e2536: 8 total, 8 up, 8 in 2024-01-13T19:07:28.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:27 smithi084 ceph-mon[119097]: pgmap v4280: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 187 KiB/s rd, 15 KiB/s wr, 263 op/s 2024-01-13T19:07:28.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:27 smithi099 ceph-mon[138788]: osdmap e2536: 8 total, 8 up, 8 in 2024-01-13T19:07:28.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:27 smithi099 ceph-mon[138788]: pgmap v4280: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 187 KiB/s rd, 15 KiB/s wr, 263 op/s 2024-01-13T19:07:28.980 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_remove_snap_by_id ... ok 2024-01-13T19:07:29.053 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_remove_snap_not_found ... ok 2024-01-13T19:07:29.142 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_remove_with_exclusive_lock ... ok 2024-01-13T19:07:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:28 smithi084 ceph-mon[116404]: osdmap e2537: 8 total, 8 up, 8 in 2024-01-13T19:07:29.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:28 smithi084 ceph-mon[116404]: osdmap e2538: 8 total, 8 up, 8 in 2024-01-13T19:07:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:28 smithi084 ceph-mon[119097]: osdmap e2537: 8 total, 8 up, 8 in 2024-01-13T19:07:29.179 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:28 smithi084 ceph-mon[119097]: osdmap e2538: 8 total, 8 up, 8 in 2024-01-13T19:07:29.216 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_remove_with_snap ... SKIP 2024-01-13T19:07:29.289 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_remove_with_watcher ... SKIP 2024-01-13T19:07:29.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:28 smithi099 ceph-mon[138788]: osdmap e2537: 8 total, 8 up, 8 in 2024-01-13T19:07:29.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:28 smithi099 ceph-mon[138788]: osdmap e2538: 8 total, 8 up, 8 in 2024-01-13T19:07:30.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:29 smithi084 ceph-mon[116404]: pgmap v4283: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 149 KiB/s rd, 8.5 KiB/s wr, 203 op/s 2024-01-13T19:07:30.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:29 smithi084 ceph-mon[119097]: pgmap v4283: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 149 KiB/s rd, 8.5 KiB/s wr, 203 op/s 2024-01-13T19:07:30.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:29 smithi099 ceph-mon[138788]: pgmap v4283: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 149 KiB/s rd, 8.5 KiB/s wr, 203 op/s 2024-01-13T19:07:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:07:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:07:30] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:07:31.008 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_rename_snap ... ok 2024-01-13T19:07:31.091 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_resize ... ok 2024-01-13T19:07:31.174 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_resize_allow_shrink_False ... ok 2024-01-13T19:07:31.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:30 smithi084 ceph-mon[116404]: osdmap e2539: 8 total, 8 up, 8 in 2024-01-13T19:07:31.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:30 smithi084 ceph-mon[119097]: osdmap e2539: 8 total, 8 up, 8 in 2024-01-13T19:07:31.272 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_resize_bytes ... ok 2024-01-13T19:07:31.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:30 smithi099 ceph-mon[138788]: osdmap e2539: 8 total, 8 up, 8 in 2024-01-13T19:07:31.375 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_resize_down ... ok 2024-01-13T19:07:32.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:31 smithi099 ceph-mon[138788]: osdmap e2540: 8 total, 8 up, 8 in 2024-01-13T19:07:32.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:31 smithi099 ceph-mon[138788]: pgmap v4286: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 116 KiB/s rd, 6.7 KiB/s wr, 152 op/s 2024-01-13T19:07:32.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:31 smithi084 ceph-mon[119097]: osdmap e2540: 8 total, 8 up, 8 in 2024-01-13T19:07:32.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:31 smithi084 ceph-mon[119097]: pgmap v4286: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 116 KiB/s rd, 6.7 KiB/s wr, 152 op/s 2024-01-13T19:07:32.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:31 smithi084 ceph-mon[116404]: osdmap e2540: 8 total, 8 up, 8 in 2024-01-13T19:07:32.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:31 smithi084 ceph-mon[116404]: pgmap v4286: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 116 KiB/s rd, 6.7 KiB/s wr, 152 op/s 2024-01-13T19:07:33.035 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_rollback_to_snap ... ok 2024-01-13T19:07:33.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:32 smithi099 ceph-mon[138788]: osdmap e2541: 8 total, 8 up, 8 in 2024-01-13T19:07:33.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:32 smithi084 ceph-mon[119097]: osdmap e2541: 8 total, 8 up, 8 in 2024-01-13T19:07:33.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:32 smithi084 ceph-mon[116404]: osdmap e2541: 8 total, 8 up, 8 in 2024-01-13T19:07:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:33 smithi099 ceph-mon[138788]: osdmap e2542: 8 total, 8 up, 8 in 2024-01-13T19:07:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:33 smithi099 ceph-mon[138788]: pgmap v4289: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 387 KiB/s rd, 24 KiB/s wr, 532 op/s 2024-01-13T19:07:34.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:33 smithi099 ceph-mon[138788]: osdmap e2543: 8 total, 8 up, 8 in 2024-01-13T19:07:34.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:33 smithi084 ceph-mon[116404]: osdmap e2542: 8 total, 8 up, 8 in 2024-01-13T19:07:34.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:33 smithi084 ceph-mon[116404]: pgmap v4289: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 387 KiB/s rd, 24 KiB/s wr, 532 op/s 2024-01-13T19:07:34.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:33 smithi084 ceph-mon[116404]: osdmap e2543: 8 total, 8 up, 8 in 2024-01-13T19:07:34.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:33 smithi084 ceph-mon[119097]: osdmap e2542: 8 total, 8 up, 8 in 2024-01-13T19:07:34.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:33 smithi084 ceph-mon[119097]: pgmap v4289: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 387 KiB/s rd, 24 KiB/s wr, 532 op/s 2024-01-13T19:07:34.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:33 smithi084 ceph-mon[119097]: osdmap e2543: 8 total, 8 up, 8 in 2024-01-13T19:07:34.981 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_rollback_to_snap_sparse ... ok 2024-01-13T19:07:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:35 smithi084 ceph-mon[116404]: osdmap e2544: 8 total, 8 up, 8 in 2024-01-13T19:07:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:35 smithi084 ceph-mon[119097]: osdmap e2544: 8 total, 8 up, 8 in 2024-01-13T19:07:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:36.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:35 smithi099 ceph-mon[138788]: osdmap e2544: 8 total, 8 up, 8 in 2024-01-13T19:07:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:36 smithi084 ceph-mon[116404]: pgmap v4292: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 423 KiB/s rd, 34 KiB/s wr, 593 op/s 2024-01-13T19:07:37.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:36 smithi084 ceph-mon[116404]: osdmap e2545: 8 total, 8 up, 8 in 2024-01-13T19:07:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:36 smithi084 ceph-mon[119097]: pgmap v4292: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 423 KiB/s rd, 34 KiB/s wr, 593 op/s 2024-01-13T19:07:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:36 smithi084 ceph-mon[119097]: osdmap e2545: 8 total, 8 up, 8 in 2024-01-13T19:07:37.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:36 smithi099 ceph-mon[138788]: pgmap v4292: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 423 KiB/s rd, 34 KiB/s wr, 593 op/s 2024-01-13T19:07:37.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:36 smithi099 ceph-mon[138788]: osdmap e2545: 8 total, 8 up, 8 in 2024-01-13T19:07:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[116404]: osdmap e2546: 8 total, 8 up, 8 in 2024-01-13T19:07:38.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[116404]: pgmap v4295: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 195 KiB/s rd, 21 KiB/s wr, 270 op/s 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[119097]: osdmap e2546: 8 total, 8 up, 8 in 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[119097]: pgmap v4295: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 195 KiB/s rd, 21 KiB/s wr, 270 op/s 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:37 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:37 smithi099 ceph-mon[138788]: osdmap e2546: 8 total, 8 up, 8 in 2024-01-13T19:07:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:37 smithi099 ceph-mon[138788]: pgmap v4295: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 195 KiB/s rd, 21 KiB/s wr, 270 op/s 2024-01-13T19:07:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:07:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:37 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:38.976 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_rollback_with_resize ... ok 2024-01-13T19:07:39.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:38 smithi084 ceph-mon[119097]: osdmap e2547: 8 total, 8 up, 8 in 2024-01-13T19:07:39.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:07:39.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:07:39.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:39.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:38 smithi084 ceph-mon[119097]: osdmap e2548: 8 total, 8 up, 8 in 2024-01-13T19:07:39.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:38 smithi084 ceph-mon[116404]: osdmap e2547: 8 total, 8 up, 8 in 2024-01-13T19:07:39.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:07:39.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:07:39.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:39.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:38 smithi084 ceph-mon[116404]: osdmap e2548: 8 total, 8 up, 8 in 2024-01-13T19:07:39.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:38 smithi099 ceph-mon[138788]: osdmap e2547: 8 total, 8 up, 8 in 2024-01-13T19:07:39.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:07:39.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:07:39.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:07:39.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:38 smithi099 ceph-mon[138788]: osdmap e2548: 8 total, 8 up, 8 in 2024-01-13T19:07:40.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:39 smithi084 ceph-mon[116404]: pgmap v4298: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 77 KiB/s rd, 8.2 KiB/s wr, 107 op/s 2024-01-13T19:07:40.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:39 smithi084 ceph-mon[119097]: pgmap v4298: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 77 KiB/s rd, 8.2 KiB/s wr, 107 op/s 2024-01-13T19:07:40.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:39 smithi099 ceph-mon[138788]: pgmap v4298: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 77 KiB/s rd, 8.2 KiB/s wr, 107 op/s 2024-01-13T19:07:40.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:07:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:07:40] "GET /metrics HTTP/1.1" 200 36534 "" "Prometheus/2.43.0" 2024-01-13T19:07:41.025 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_set_no_snap ... ok 2024-01-13T19:07:41.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:40 smithi084 ceph-mon[116404]: osdmap e2549: 8 total, 8 up, 8 in 2024-01-13T19:07:41.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:40 smithi084 ceph-mon[119097]: osdmap e2549: 8 total, 8 up, 8 in 2024-01-13T19:07:41.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:40 smithi099 ceph-mon[138788]: osdmap e2549: 8 total, 8 up, 8 in 2024-01-13T19:07:42.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:41 smithi099 ceph-mon[138788]: osdmap e2550: 8 total, 8 up, 8 in 2024-01-13T19:07:42.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:41 smithi099 ceph-mon[138788]: pgmap v4301: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-01-13T19:07:42.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:41 smithi084 ceph-mon[116404]: osdmap e2550: 8 total, 8 up, 8 in 2024-01-13T19:07:42.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:41 smithi084 ceph-mon[116404]: pgmap v4301: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-01-13T19:07:42.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:41 smithi084 ceph-mon[119097]: osdmap e2550: 8 total, 8 up, 8 in 2024-01-13T19:07:42.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:41 smithi084 ceph-mon[119097]: pgmap v4301: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-01-13T19:07:43.032 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_set_snap ... ok 2024-01-13T19:07:43.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:42 smithi099 ceph-mon[138788]: osdmap e2551: 8 total, 8 up, 8 in 2024-01-13T19:07:43.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:42 smithi084 ceph-mon[116404]: osdmap e2551: 8 total, 8 up, 8 in 2024-01-13T19:07:43.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:42 smithi084 ceph-mon[119097]: osdmap e2551: 8 total, 8 up, 8 in 2024-01-13T19:07:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:43 smithi099 ceph-mon[138788]: osdmap e2552: 8 total, 8 up, 8 in 2024-01-13T19:07:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:43 smithi099 ceph-mon[138788]: pgmap v4304: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 106 KiB/s rd, 10 KiB/s wr, 146 op/s 2024-01-13T19:07:44.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:43 smithi099 ceph-mon[138788]: osdmap e2553: 8 total, 8 up, 8 in 2024-01-13T19:07:44.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:43 smithi084 ceph-mon[116404]: osdmap e2552: 8 total, 8 up, 8 in 2024-01-13T19:07:44.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:43 smithi084 ceph-mon[116404]: pgmap v4304: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 106 KiB/s rd, 10 KiB/s wr, 146 op/s 2024-01-13T19:07:44.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:43 smithi084 ceph-mon[116404]: osdmap e2553: 8 total, 8 up, 8 in 2024-01-13T19:07:44.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:43 smithi084 ceph-mon[119097]: osdmap e2552: 8 total, 8 up, 8 in 2024-01-13T19:07:44.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:43 smithi084 ceph-mon[119097]: pgmap v4304: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 106 KiB/s rd, 10 KiB/s wr, 146 op/s 2024-01-13T19:07:44.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:43 smithi084 ceph-mon[119097]: osdmap e2553: 8 total, 8 up, 8 in 2024-01-13T19:07:44.987 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_set_snap_by_id ... ok 2024-01-13T19:07:46.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:45 smithi084 ceph-mon[116404]: osdmap e2554: 8 total, 8 up, 8 in 2024-01-13T19:07:46.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:45 smithi084 ceph-mon[119097]: osdmap e2554: 8 total, 8 up, 8 in 2024-01-13T19:07:46.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:45 smithi099 ceph-mon[138788]: osdmap e2554: 8 total, 8 up, 8 in 2024-01-13T19:07:46.996 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_set_snap_deleted ... ok 2024-01-13T19:07:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:46 smithi084 ceph-mon[116404]: pgmap v4307: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 163 KiB/s rd, 20 KiB/s wr, 232 op/s 2024-01-13T19:07:47.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:46 smithi084 ceph-mon[116404]: osdmap e2555: 8 total, 8 up, 8 in 2024-01-13T19:07:47.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:46 smithi084 ceph-mon[119097]: pgmap v4307: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 163 KiB/s rd, 20 KiB/s wr, 232 op/s 2024-01-13T19:07:47.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:46 smithi084 ceph-mon[119097]: osdmap e2555: 8 total, 8 up, 8 in 2024-01-13T19:07:47.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:46 smithi099 ceph-mon[138788]: pgmap v4307: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 163 KiB/s rd, 20 KiB/s wr, 232 op/s 2024-01-13T19:07:47.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:46 smithi099 ceph-mon[138788]: osdmap e2555: 8 total, 8 up, 8 in 2024-01-13T19:07:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:47 smithi084 ceph-mon[116404]: osdmap e2556: 8 total, 8 up, 8 in 2024-01-13T19:07:48.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:47 smithi084 ceph-mon[116404]: pgmap v4310: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 104 KiB/s rd, 14 KiB/s wr, 152 op/s 2024-01-13T19:07:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:47 smithi084 ceph-mon[119097]: osdmap e2556: 8 total, 8 up, 8 in 2024-01-13T19:07:48.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:47 smithi084 ceph-mon[119097]: pgmap v4310: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 104 KiB/s rd, 14 KiB/s wr, 152 op/s 2024-01-13T19:07:48.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:47 smithi099 ceph-mon[138788]: osdmap e2556: 8 total, 8 up, 8 in 2024-01-13T19:07:48.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:47 smithi099 ceph-mon[138788]: pgmap v4310: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 104 KiB/s rd, 14 KiB/s wr, 152 op/s 2024-01-13T19:07:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:48 smithi084 ceph-mon[116404]: osdmap e2557: 8 total, 8 up, 8 in 2024-01-13T19:07:49.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:48 smithi084 ceph-mon[116404]: osdmap e2558: 8 total, 8 up, 8 in 2024-01-13T19:07:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:48 smithi084 ceph-mon[119097]: osdmap e2557: 8 total, 8 up, 8 in 2024-01-13T19:07:49.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:48 smithi084 ceph-mon[119097]: osdmap e2558: 8 total, 8 up, 8 in 2024-01-13T19:07:49.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:48 smithi099 ceph-mon[138788]: osdmap e2557: 8 total, 8 up, 8 in 2024-01-13T19:07:49.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:48 smithi099 ceph-mon[138788]: osdmap e2558: 8 total, 8 up, 8 in 2024-01-13T19:07:50.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:07:50 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:07:50] "GET /metrics HTTP/1.1" 200 36537 "" "Prometheus/2.43.0" 2024-01-13T19:07:51.021 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_set_snap_recreated ... ok 2024-01-13T19:07:51.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:50 smithi084 ceph-mon[116404]: pgmap v4313: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 113 KiB/s rd, 14 KiB/s wr, 158 op/s 2024-01-13T19:07:51.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:50 smithi084 ceph-mon[116404]: osdmap e2559: 8 total, 8 up, 8 in 2024-01-13T19:07:51.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:50 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:50 smithi084 ceph-mon[119097]: pgmap v4313: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 113 KiB/s rd, 14 KiB/s wr, 158 op/s 2024-01-13T19:07:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:50 smithi084 ceph-mon[119097]: osdmap e2559: 8 total, 8 up, 8 in 2024-01-13T19:07:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:50 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:51.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:50 smithi099 ceph-mon[138788]: pgmap v4313: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 113 KiB/s rd, 14 KiB/s wr, 158 op/s 2024-01-13T19:07:51.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:50 smithi099 ceph-mon[138788]: osdmap e2559: 8 total, 8 up, 8 in 2024-01-13T19:07:51.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:50 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:07:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:51 smithi084 ceph-mon[116404]: osdmap e2560: 8 total, 8 up, 8 in 2024-01-13T19:07:52.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:51 smithi084 ceph-mon[116404]: pgmap v4316: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 66 KiB/s rd, 9.7 KiB/s wr, 95 op/s 2024-01-13T19:07:52.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:51 smithi084 ceph-mon[119097]: osdmap e2560: 8 total, 8 up, 8 in 2024-01-13T19:07:52.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:51 smithi084 ceph-mon[119097]: pgmap v4316: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 66 KiB/s rd, 9.7 KiB/s wr, 95 op/s 2024-01-13T19:07:52.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:51 smithi099 ceph-mon[138788]: osdmap e2560: 8 total, 8 up, 8 in 2024-01-13T19:07:52.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:51 smithi099 ceph-mon[138788]: pgmap v4316: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 66 KiB/s rd, 9.7 KiB/s wr, 95 op/s 2024-01-13T19:07:53.021 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_set_snap_sparse ... ok 2024-01-13T19:07:53.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:52 smithi084 ceph-mon[116404]: osdmap e2561: 8 total, 8 up, 8 in 2024-01-13T19:07:53.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:52 smithi084 ceph-mon[119097]: osdmap e2561: 8 total, 8 up, 8 in 2024-01-13T19:07:53.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:52 smithi099 ceph-mon[138788]: osdmap e2561: 8 total, 8 up, 8 in 2024-01-13T19:07:54.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:53 smithi099 ceph-mon[138788]: osdmap e2562: 8 total, 8 up, 8 in 2024-01-13T19:07:54.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:53 smithi099 ceph-mon[138788]: pgmap v4319: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 30 KiB/s rd, 5.5 KiB/s wr, 50 op/s 2024-01-13T19:07:54.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:53 smithi099 ceph-mon[138788]: osdmap e2563: 8 total, 8 up, 8 in 2024-01-13T19:07:54.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:53 smithi084 ceph-mon[116404]: osdmap e2562: 8 total, 8 up, 8 in 2024-01-13T19:07:54.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:53 smithi084 ceph-mon[116404]: pgmap v4319: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 30 KiB/s rd, 5.5 KiB/s wr, 50 op/s 2024-01-13T19:07:54.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:53 smithi084 ceph-mon[116404]: osdmap e2563: 8 total, 8 up, 8 in 2024-01-13T19:07:54.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:53 smithi084 ceph-mon[119097]: osdmap e2562: 8 total, 8 up, 8 in 2024-01-13T19:07:54.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:53 smithi084 ceph-mon[119097]: pgmap v4319: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 30 KiB/s rd, 5.5 KiB/s wr, 50 op/s 2024-01-13T19:07:54.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:53 smithi084 ceph-mon[119097]: osdmap e2563: 8 total, 8 up, 8 in 2024-01-13T19:07:56.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:55 smithi084 ceph-mon[116404]: osdmap e2564: 8 total, 8 up, 8 in 2024-01-13T19:07:56.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:55 smithi084 ceph-mon[119097]: osdmap e2564: 8 total, 8 up, 8 in 2024-01-13T19:07:56.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:55 smithi099 ceph-mon[138788]: osdmap e2564: 8 total, 8 up, 8 in 2024-01-13T19:07:57.002 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_size ... ok 2024-01-13T19:07:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:56 smithi084 ceph-mon[116404]: pgmap v4322: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 66 KiB/s rd, 9.0 KiB/s wr, 97 op/s 2024-01-13T19:07:57.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:56 smithi084 ceph-mon[116404]: osdmap e2565: 8 total, 8 up, 8 in 2024-01-13T19:07:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:56 smithi084 ceph-mon[119097]: pgmap v4322: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 66 KiB/s rd, 9.0 KiB/s wr, 97 op/s 2024-01-13T19:07:57.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:56 smithi084 ceph-mon[119097]: osdmap e2565: 8 total, 8 up, 8 in 2024-01-13T19:07:57.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:56 smithi099 ceph-mon[138788]: pgmap v4322: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 66 KiB/s rd, 9.0 KiB/s wr, 97 op/s 2024-01-13T19:07:57.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:56 smithi099 ceph-mon[138788]: osdmap e2565: 8 total, 8 up, 8 in 2024-01-13T19:07:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:57 smithi084 ceph-mon[116404]: osdmap e2566: 8 total, 8 up, 8 in 2024-01-13T19:07:58.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:57 smithi084 ceph-mon[116404]: pgmap v4325: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 81 KiB/s rd, 8.2 KiB/s wr, 110 op/s 2024-01-13T19:07:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:57 smithi084 ceph-mon[119097]: osdmap e2566: 8 total, 8 up, 8 in 2024-01-13T19:07:58.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:57 smithi084 ceph-mon[119097]: pgmap v4325: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 81 KiB/s rd, 8.2 KiB/s wr, 110 op/s 2024-01-13T19:07:58.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:57 smithi099 ceph-mon[138788]: osdmap e2566: 8 total, 8 up, 8 in 2024-01-13T19:07:58.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:57 smithi099 ceph-mon[138788]: pgmap v4325: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 81 KiB/s rd, 8.2 KiB/s wr, 110 op/s 2024-01-13T19:07:58.979 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_snap_exists ... ok 2024-01-13T19:07:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:58 smithi084 ceph-mon[116404]: osdmap e2567: 8 total, 8 up, 8 in 2024-01-13T19:07:59.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:58 smithi084 ceph-mon[116404]: osdmap e2568: 8 total, 8 up, 8 in 2024-01-13T19:07:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:58 smithi084 ceph-mon[119097]: osdmap e2567: 8 total, 8 up, 8 in 2024-01-13T19:07:59.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:58 smithi084 ceph-mon[119097]: osdmap e2568: 8 total, 8 up, 8 in 2024-01-13T19:07:59.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:58 smithi099 ceph-mon[138788]: osdmap e2567: 8 total, 8 up, 8 in 2024-01-13T19:07:59.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:58 smithi099 ceph-mon[138788]: osdmap e2568: 8 total, 8 up, 8 in 2024-01-13T19:08:00.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:07:59 smithi084 ceph-mon[116404]: pgmap v4328: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 101 KiB/s rd, 9.5 KiB/s wr, 138 op/s 2024-01-13T19:08:00.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:07:59 smithi084 ceph-mon[119097]: pgmap v4328: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 101 KiB/s rd, 9.5 KiB/s wr, 138 op/s 2024-01-13T19:08:00.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:07:59 smithi099 ceph-mon[138788]: pgmap v4328: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 101 KiB/s rd, 9.5 KiB/s wr, 138 op/s 2024-01-13T19:08:00.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:00 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:08:00] "GET /metrics HTTP/1.1" 200 36537 "" "Prometheus/2.43.0" 2024-01-13T19:08:01.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:00 smithi099 ceph-mon[138788]: osdmap e2569: 8 total, 8 up, 8 in 2024-01-13T19:08:01.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:00 smithi084 ceph-mon[119097]: osdmap e2569: 8 total, 8 up, 8 in 2024-01-13T19:08:01.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:00 smithi084 ceph-mon[116404]: osdmap e2569: 8 total, 8 up, 8 in 2024-01-13T19:08:02.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:01 smithi099 ceph-mon[138788]: osdmap e2570: 8 total, 8 up, 8 in 2024-01-13T19:08:02.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:01 smithi099 ceph-mon[138788]: pgmap v4331: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 57 KiB/s rd, 5.5 KiB/s wr, 80 op/s 2024-01-13T19:08:02.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:01 smithi084 ceph-mon[116404]: osdmap e2570: 8 total, 8 up, 8 in 2024-01-13T19:08:02.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:01 smithi084 ceph-mon[116404]: pgmap v4331: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 57 KiB/s rd, 5.5 KiB/s wr, 80 op/s 2024-01-13T19:08:02.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:01 smithi084 ceph-mon[119097]: osdmap e2570: 8 total, 8 up, 8 in 2024-01-13T19:08:02.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:01 smithi084 ceph-mon[119097]: pgmap v4331: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 57 KiB/s rd, 5.5 KiB/s wr, 80 op/s 2024-01-13T19:08:03.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:02 smithi099 ceph-mon[138788]: osdmap e2571: 8 total, 8 up, 8 in 2024-01-13T19:08:03.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:02 smithi084 ceph-mon[116404]: osdmap e2571: 8 total, 8 up, 8 in 2024-01-13T19:08:03.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:02 smithi084 ceph-mon[119097]: osdmap e2571: 8 total, 8 up, 8 in 2024-01-13T19:08:04.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:03 smithi099 ceph-mon[138788]: osdmap e2572: 8 total, 8 up, 8 in 2024-01-13T19:08:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:03 smithi099 ceph-mon[138788]: pgmap v4334: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 54 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2024-01-13T19:08:04.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:03 smithi099 ceph-mon[138788]: osdmap e2573: 8 total, 8 up, 8 in 2024-01-13T19:08:04.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:03 smithi084 ceph-mon[116404]: osdmap e2572: 8 total, 8 up, 8 in 2024-01-13T19:08:04.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:03 smithi084 ceph-mon[116404]: pgmap v4334: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 54 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2024-01-13T19:08:04.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:03 smithi084 ceph-mon[116404]: osdmap e2573: 8 total, 8 up, 8 in 2024-01-13T19:08:04.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:03 smithi084 ceph-mon[119097]: osdmap e2572: 8 total, 8 up, 8 in 2024-01-13T19:08:04.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:03 smithi084 ceph-mon[119097]: pgmap v4334: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 54 KiB/s rd, 3.0 KiB/s wr, 75 op/s 2024-01-13T19:08:04.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:03 smithi084 ceph-mon[119097]: osdmap e2573: 8 total, 8 up, 8 in 2024-01-13T19:08:04.993 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_snap_get_id ... ok 2024-01-13T19:08:05.616 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 19:08:05 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a[185784]: logger=cleanup t=2024-01-13T19:08:05.35178098Z level=info msg="Completed cleanup jobs" duration=13.144897ms 2024-01-13T19:08:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:05 smithi084 ceph-mon[116404]: osdmap e2574: 8 total, 8 up, 8 in 2024-01-13T19:08:06.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:05 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:08:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:05 smithi084 ceph-mon[119097]: osdmap e2574: 8 total, 8 up, 8 in 2024-01-13T19:08:06.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:05 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:08:06.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:05 smithi099 ceph-mon[138788]: osdmap e2574: 8 total, 8 up, 8 in 2024-01-13T19:08:06.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:05 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:08:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:06 smithi084 ceph-mon[116404]: pgmap v4337: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 93 KiB/s rd, 7.5 KiB/s wr, 126 op/s 2024-01-13T19:08:07.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:06 smithi084 ceph-mon[116404]: osdmap e2575: 8 total, 8 up, 8 in 2024-01-13T19:08:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:06 smithi084 ceph-mon[119097]: pgmap v4337: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 93 KiB/s rd, 7.5 KiB/s wr, 126 op/s 2024-01-13T19:08:07.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:06 smithi084 ceph-mon[119097]: osdmap e2575: 8 total, 8 up, 8 in 2024-01-13T19:08:07.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:06 smithi099 ceph-mon[138788]: pgmap v4337: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 93 KiB/s rd, 7.5 KiB/s wr, 126 op/s 2024-01-13T19:08:07.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:06 smithi099 ceph-mon[138788]: osdmap e2575: 8 total, 8 up, 8 in 2024-01-13T19:08:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:07 smithi084 ceph-mon[116404]: osdmap e2576: 8 total, 8 up, 8 in 2024-01-13T19:08:08.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:07 smithi084 ceph-mon[116404]: pgmap v4340: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 50 KiB/s rd, 6.0 KiB/s wr, 73 op/s 2024-01-13T19:08:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:07 smithi084 ceph-mon[119097]: osdmap e2576: 8 total, 8 up, 8 in 2024-01-13T19:08:08.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:07 smithi084 ceph-mon[119097]: pgmap v4340: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 50 KiB/s rd, 6.0 KiB/s wr, 73 op/s 2024-01-13T19:08:08.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:07 smithi099 ceph-mon[138788]: osdmap e2576: 8 total, 8 up, 8 in 2024-01-13T19:08:08.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:07 smithi099 ceph-mon[138788]: pgmap v4340: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 50 KiB/s rd, 6.0 KiB/s wr, 73 op/s 2024-01-13T19:08:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:08 smithi084 ceph-mon[116404]: osdmap e2577: 8 total, 8 up, 8 in 2024-01-13T19:08:09.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:08 smithi084 ceph-mon[116404]: osdmap e2578: 8 total, 8 up, 8 in 2024-01-13T19:08:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:08 smithi084 ceph-mon[119097]: osdmap e2577: 8 total, 8 up, 8 in 2024-01-13T19:08:09.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:08 smithi084 ceph-mon[119097]: osdmap e2578: 8 total, 8 up, 8 in 2024-01-13T19:08:09.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:08 smithi099 ceph-mon[138788]: osdmap e2577: 8 total, 8 up, 8 in 2024-01-13T19:08:09.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:08 smithi099 ceph-mon[138788]: osdmap e2578: 8 total, 8 up, 8 in 2024-01-13T19:08:10.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:09 smithi084 ceph-mon[116404]: pgmap v4343: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 72 KiB/s rd, 5.7 KiB/s wr, 97 op/s 2024-01-13T19:08:10.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:09 smithi084 ceph-mon[119097]: pgmap v4343: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 72 KiB/s rd, 5.7 KiB/s wr, 97 op/s 2024-01-13T19:08:10.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:09 smithi099 ceph-mon[138788]: pgmap v4343: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 72 KiB/s rd, 5.7 KiB/s wr, 97 op/s 2024-01-13T19:08:10.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:10 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:08:10] "GET /metrics HTTP/1.1" 200 36536 "" "Prometheus/2.43.0" 2024-01-13T19:08:11.021 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_snap_get_name ... ok 2024-01-13T19:08:11.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:10 smithi084 ceph-mon[116404]: osdmap e2579: 8 total, 8 up, 8 in 2024-01-13T19:08:11.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:10 smithi084 ceph-mon[119097]: osdmap e2579: 8 total, 8 up, 8 in 2024-01-13T19:08:11.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:10 smithi099 ceph-mon[138788]: osdmap e2579: 8 total, 8 up, 8 in 2024-01-13T19:08:12.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:11 smithi099 ceph-mon[138788]: osdmap e2580: 8 total, 8 up, 8 in 2024-01-13T19:08:12.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:11 smithi099 ceph-mon[138788]: pgmap v4346: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 62 KiB/s rd, 4.7 KiB/s wr, 79 op/s 2024-01-13T19:08:12.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:11 smithi084 ceph-mon[116404]: osdmap e2580: 8 total, 8 up, 8 in 2024-01-13T19:08:12.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:11 smithi084 ceph-mon[116404]: pgmap v4346: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 62 KiB/s rd, 4.7 KiB/s wr, 79 op/s 2024-01-13T19:08:12.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:11 smithi084 ceph-mon[119097]: osdmap e2580: 8 total, 8 up, 8 in 2024-01-13T19:08:12.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:11 smithi084 ceph-mon[119097]: pgmap v4346: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 62 KiB/s rd, 4.7 KiB/s wr, 79 op/s 2024-01-13T19:08:13.034 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_snap_timestamp ... ok 2024-01-13T19:08:13.115 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_sparsify ... ok 2024-01-13T19:08:13.226 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_stat ... ok 2024-01-13T19:08:13.299 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_update_features ... SKIP 2024-01-13T19:08:13.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:12 smithi099 ceph-mon[138788]: osdmap e2581: 8 total, 8 up, 8 in 2024-01-13T19:08:13.370 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_use_after_close ... ok 2024-01-13T19:08:13.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:12 smithi084 ceph-mon[116404]: osdmap e2581: 8 total, 8 up, 8 in 2024-01-13T19:08:13.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:12 smithi084 ceph-mon[119097]: osdmap e2581: 8 total, 8 up, 8 in 2024-01-13T19:08:13.448 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_watchers_list ... ok 2024-01-13T19:08:13.530 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_write ... ok 2024-01-13T19:08:13.615 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_write_read ... ok 2024-01-13T19:08:13.699 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_write_with_fadvise_flags ... ok 2024-01-13T19:08:13.791 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_write_zeroes ... ok 2024-01-13T19:08:13.879 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImage.test_write_zeroes_thick_provision ... ok 2024-01-13T19:08:13.977 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImageId.test_read ... ok 2024-01-13T19:08:14.065 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImageId.test_resize ... ok 2024-01-13T19:08:14.152 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestImageId.test_write ... ok 2024-01-13T19:08:14.321 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMigration.test_migrate_abort ... ok 2024-01-13T19:08:14.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:13 smithi099 ceph-mon[138788]: osdmap e2582: 8 total, 8 up, 8 in 2024-01-13T19:08:14.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:13 smithi099 ceph-mon[138788]: pgmap v4349: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 16 KiB/s rd, 1.5 KiB/s wr, 27 op/s 2024-01-13T19:08:14.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:13 smithi099 ceph-mon[138788]: osdmap e2583: 8 total, 8 up, 8 in 2024-01-13T19:08:14.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:13 smithi084 ceph-mon[116404]: osdmap e2582: 8 total, 8 up, 8 in 2024-01-13T19:08:14.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:13 smithi084 ceph-mon[116404]: pgmap v4349: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 16 KiB/s rd, 1.5 KiB/s wr, 27 op/s 2024-01-13T19:08:14.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:13 smithi084 ceph-mon[116404]: osdmap e2583: 8 total, 8 up, 8 in 2024-01-13T19:08:14.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:13 smithi084 ceph-mon[119097]: osdmap e2582: 8 total, 8 up, 8 in 2024-01-13T19:08:14.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:13 smithi084 ceph-mon[119097]: pgmap v4349: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 16 KiB/s rd, 1.5 KiB/s wr, 27 op/s 2024-01-13T19:08:14.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:13 smithi084 ceph-mon[119097]: osdmap e2583: 8 total, 8 up, 8 in 2024-01-13T19:08:14.490 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMigration.test_migrate_abort_with_progress ... ok 2024-01-13T19:08:14.740 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMigration.test_migration ... ok 2024-01-13T19:08:16.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:15 smithi099 ceph-mon[138788]: osdmap e2584: 8 total, 8 up, 8 in 2024-01-13T19:08:16.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:15 smithi099 ceph-mon[138788]: pgmap v4352: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 149 KiB/s rd, 13 KiB/s wr, 209 op/s 2024-01-13T19:08:16.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:15 smithi084 ceph-mon[116404]: osdmap e2584: 8 total, 8 up, 8 in 2024-01-13T19:08:16.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:15 smithi084 ceph-mon[116404]: pgmap v4352: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 149 KiB/s rd, 13 KiB/s wr, 209 op/s 2024-01-13T19:08:16.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:15 smithi084 ceph-mon[119097]: osdmap e2584: 8 total, 8 up, 8 in 2024-01-13T19:08:16.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:15 smithi084 ceph-mon[119097]: pgmap v4352: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 149 KiB/s rd, 13 KiB/s wr, 209 op/s 2024-01-13T19:08:17.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:16 smithi099 ceph-mon[138788]: osdmap e2585: 8 total, 8 up, 8 in 2024-01-13T19:08:17.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:16 smithi084 ceph-mon[116404]: osdmap e2585: 8 total, 8 up, 8 in 2024-01-13T19:08:17.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:16 smithi084 ceph-mon[119097]: osdmap e2585: 8 total, 8 up, 8 in 2024-01-13T19:08:18.120 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMigration.test_migration_import ... ok 2024-01-13T19:08:18.329 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMigration.test_migration_with_progress ... ok 2024-01-13T19:08:18.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:17 smithi099 ceph-mon[138788]: osdmap e2586: 8 total, 8 up, 8 in 2024-01-13T19:08:18.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:17 smithi099 ceph-mon[138788]: pgmap v4355: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 855 KiB/s rd, 46 KiB/s wr, 1.12k op/s 2024-01-13T19:08:18.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:17 smithi084 ceph-mon[116404]: osdmap e2586: 8 total, 8 up, 8 in 2024-01-13T19:08:18.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:17 smithi084 ceph-mon[116404]: pgmap v4355: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 855 KiB/s rd, 46 KiB/s wr, 1.12k op/s 2024-01-13T19:08:18.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:17 smithi084 ceph-mon[119097]: osdmap e2586: 8 total, 8 up, 8 in 2024-01-13T19:08:18.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:17 smithi084 ceph-mon[119097]: pgmap v4355: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 855 KiB/s rd, 46 KiB/s wr, 1.12k op/s 2024-01-13T19:08:19.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:18 smithi099 ceph-mon[138788]: osdmap e2587: 8 total, 8 up, 8 in 2024-01-13T19:08:19.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:18 smithi099 ceph-mon[138788]: osdmap e2588: 8 total, 8 up, 8 in 2024-01-13T19:08:19.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:18 smithi084 ceph-mon[116404]: osdmap e2587: 8 total, 8 up, 8 in 2024-01-13T19:08:19.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:18 smithi084 ceph-mon[116404]: osdmap e2588: 8 total, 8 up, 8 in 2024-01-13T19:08:19.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:18 smithi084 ceph-mon[119097]: osdmap e2587: 8 total, 8 up, 8 in 2024-01-13T19:08:19.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:18 smithi084 ceph-mon[119097]: osdmap e2588: 8 total, 8 up, 8 in 2024-01-13T19:08:20.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:19 smithi084 ceph-mon[116404]: pgmap v4358: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 882 KiB/s rd, 56 KiB/s wr, 1.19k op/s 2024-01-13T19:08:20.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:19 smithi084 ceph-mon[116404]: osdmap e2589: 8 total, 8 up, 8 in 2024-01-13T19:08:20.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:19 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/1b78b1e0-b8b3-441d-95ae-14964b82dda2"}]: dispatch 2024-01-13T19:08:20.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:19 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/1b78b1e0-b8b3-441d-95ae-14964b82dda2"}]: dispatch 2024-01-13T19:08:20.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:19 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/1b78b1e0-b8b3-441d-95ae-14964b82dda2"}]': finished 2024-01-13T19:08:20.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:19 smithi084 ceph-mon[119097]: pgmap v4358: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 882 KiB/s rd, 56 KiB/s wr, 1.19k op/s 2024-01-13T19:08:20.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:19 smithi084 ceph-mon[119097]: osdmap e2589: 8 total, 8 up, 8 in 2024-01-13T19:08:20.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:19 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/1b78b1e0-b8b3-441d-95ae-14964b82dda2"}]: dispatch 2024-01-13T19:08:20.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:19 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/1b78b1e0-b8b3-441d-95ae-14964b82dda2"}]: dispatch 2024-01-13T19:08:20.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:19 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/1b78b1e0-b8b3-441d-95ae-14964b82dda2"}]': finished 2024-01-13T19:08:20.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:19 smithi099 ceph-mon[138788]: pgmap v4358: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 882 KiB/s rd, 56 KiB/s wr, 1.19k op/s 2024-01-13T19:08:20.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:19 smithi099 ceph-mon[138788]: osdmap e2589: 8 total, 8 up, 8 in 2024-01-13T19:08:20.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:19 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/1b78b1e0-b8b3-441d-95ae-14964b82dda2"}]: dispatch 2024-01-13T19:08:20.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:19 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/1b78b1e0-b8b3-441d-95ae-14964b82dda2"}]: dispatch 2024-01-13T19:08:20.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:19 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/1b78b1e0-b8b3-441d-95ae-14964b82dda2"}]': finished 2024-01-13T19:08:20.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:20 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:08:20] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:08:21.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:20 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:08:21.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:20 smithi099 ceph-mon[138788]: osdmap e2590: 8 total, 8 up, 8 in 2024-01-13T19:08:21.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:20 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:08:21.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:20 smithi084 ceph-mon[116404]: osdmap e2590: 8 total, 8 up, 8 in 2024-01-13T19:08:21.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:20 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:08:21.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:20 smithi084 ceph-mon[119097]: osdmap e2590: 8 total, 8 up, 8 in 2024-01-13T19:08:22.060 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMirroring.test_aio_mirror_image_create_snapshot ... ok 2024-01-13T19:08:22.149 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMirroring.test_mirror_image ... SKIP 2024-01-13T19:08:22.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:21 smithi099 ceph-mon[138788]: pgmap v4361: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 161 KiB/s rd, 22 KiB/s wr, 259 op/s 2024-01-13T19:08:22.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:21 smithi084 ceph-mon[116404]: pgmap v4361: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 161 KiB/s rd, 22 KiB/s wr, 259 op/s 2024-01-13T19:08:22.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:21 smithi084 ceph-mon[119097]: pgmap v4361: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 161 KiB/s rd, 22 KiB/s wr, 259 op/s 2024-01-13T19:08:23.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:23 smithi099 ceph-mon[138788]: osdmap e2591: 8 total, 8 up, 8 in 2024-01-13T19:08:23.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:23 smithi084 ceph-mon[116404]: osdmap e2591: 8 total, 8 up, 8 in 2024-01-13T19:08:23.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:23 smithi084 ceph-mon[119097]: osdmap e2591: 8 total, 8 up, 8 in 2024-01-13T19:08:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:24 smithi099 ceph-mon[138788]: osdmap e2592: 8 total, 8 up, 8 in 2024-01-13T19:08:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:24 smithi099 ceph-mon[138788]: pgmap v4364: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 266 KiB/s rd, 14 KiB/s wr, 341 op/s 2024-01-13T19:08:24.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:24 smithi099 ceph-mon[138788]: osdmap e2593: 8 total, 8 up, 8 in 2024-01-13T19:08:24.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:24 smithi084 ceph-mon[116404]: osdmap e2592: 8 total, 8 up, 8 in 2024-01-13T19:08:24.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:24 smithi084 ceph-mon[116404]: pgmap v4364: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 266 KiB/s rd, 14 KiB/s wr, 341 op/s 2024-01-13T19:08:24.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:24 smithi084 ceph-mon[116404]: osdmap e2593: 8 total, 8 up, 8 in 2024-01-13T19:08:24.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:24 smithi084 ceph-mon[119097]: osdmap e2592: 8 total, 8 up, 8 in 2024-01-13T19:08:24.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:24 smithi084 ceph-mon[119097]: pgmap v4364: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 266 KiB/s rd, 14 KiB/s wr, 341 op/s 2024-01-13T19:08:24.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:24 smithi084 ceph-mon[119097]: osdmap e2593: 8 total, 8 up, 8 in 2024-01-13T19:08:26.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[116404]: osdmap e2594: 8 total, 8 up, 8 in 2024-01-13T19:08:26.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/e044a1ec-1dd1-40e7-8441-cc475ac297e3"}]: dispatch 2024-01-13T19:08:26.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/e044a1ec-1dd1-40e7-8441-cc475ac297e3"}]: dispatch 2024-01-13T19:08:26.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/e044a1ec-1dd1-40e7-8441-cc475ac297e3"}]': finished 2024-01-13T19:08:26.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/89b212de-5135-4d48-aa5e-a21d246274a2"}]: dispatch 2024-01-13T19:08:26.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/89b212de-5135-4d48-aa5e-a21d246274a2"}]: dispatch 2024-01-13T19:08:26.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/89b212de-5135-4d48-aa5e-a21d246274a2"}]': finished 2024-01-13T19:08:26.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[119097]: osdmap e2594: 8 total, 8 up, 8 in 2024-01-13T19:08:26.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/e044a1ec-1dd1-40e7-8441-cc475ac297e3"}]: dispatch 2024-01-13T19:08:26.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/e044a1ec-1dd1-40e7-8441-cc475ac297e3"}]: dispatch 2024-01-13T19:08:26.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/e044a1ec-1dd1-40e7-8441-cc475ac297e3"}]': finished 2024-01-13T19:08:26.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/89b212de-5135-4d48-aa5e-a21d246274a2"}]: dispatch 2024-01-13T19:08:26.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/89b212de-5135-4d48-aa5e-a21d246274a2"}]: dispatch 2024-01-13T19:08:26.178 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:25 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/89b212de-5135-4d48-aa5e-a21d246274a2"}]': finished 2024-01-13T19:08:26.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:25 smithi099 ceph-mon[138788]: osdmap e2594: 8 total, 8 up, 8 in 2024-01-13T19:08:26.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:25 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/e044a1ec-1dd1-40e7-8441-cc475ac297e3"}]: dispatch 2024-01-13T19:08:26.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:25 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/e044a1ec-1dd1-40e7-8441-cc475ac297e3"}]: dispatch 2024-01-13T19:08:26.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:25 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/e044a1ec-1dd1-40e7-8441-cc475ac297e3"}]': finished 2024-01-13T19:08:26.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:25 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/89b212de-5135-4d48-aa5e-a21d246274a2"}]: dispatch 2024-01-13T19:08:26.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:25 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/89b212de-5135-4d48-aa5e-a21d246274a2"}]: dispatch 2024-01-13T19:08:26.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:25 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/89b212de-5135-4d48-aa5e-a21d246274a2"}]': finished 2024-01-13T19:08:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:26 smithi084 ceph-mon[116404]: pgmap v4367: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 273 KiB/s rd, 16 KiB/s wr, 352 op/s 2024-01-13T19:08:27.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:26 smithi084 ceph-mon[116404]: osdmap e2595: 8 total, 8 up, 8 in 2024-01-13T19:08:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:26 smithi084 ceph-mon[119097]: pgmap v4367: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 273 KiB/s rd, 16 KiB/s wr, 352 op/s 2024-01-13T19:08:27.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:26 smithi084 ceph-mon[119097]: osdmap e2595: 8 total, 8 up, 8 in 2024-01-13T19:08:27.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:26 smithi099 ceph-mon[138788]: pgmap v4367: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 273 KiB/s rd, 16 KiB/s wr, 352 op/s 2024-01-13T19:08:27.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:26 smithi099 ceph-mon[138788]: osdmap e2595: 8 total, 8 up, 8 in 2024-01-13T19:08:28.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:27 smithi099 ceph-mon[138788]: osdmap e2596: 8 total, 8 up, 8 in 2024-01-13T19:08:28.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:27 smithi099 ceph-mon[138788]: pgmap v4370: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 137 KiB/s rd, 12 KiB/s wr, 190 op/s 2024-01-13T19:08:28.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:27 smithi084 ceph-mon[116404]: osdmap e2596: 8 total, 8 up, 8 in 2024-01-13T19:08:28.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:27 smithi084 ceph-mon[116404]: pgmap v4370: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 137 KiB/s rd, 12 KiB/s wr, 190 op/s 2024-01-13T19:08:28.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:27 smithi084 ceph-mon[119097]: osdmap e2596: 8 total, 8 up, 8 in 2024-01-13T19:08:28.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:27 smithi084 ceph-mon[119097]: pgmap v4370: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 137 KiB/s rd, 12 KiB/s wr, 190 op/s 2024-01-13T19:08:29.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:28 smithi099 ceph-mon[138788]: osdmap e2597: 8 total, 8 up, 8 in 2024-01-13T19:08:29.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:28 smithi099 ceph-mon[138788]: osdmap e2598: 8 total, 8 up, 8 in 2024-01-13T19:08:29.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:28 smithi084 ceph-mon[116404]: osdmap e2597: 8 total, 8 up, 8 in 2024-01-13T19:08:29.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:28 smithi084 ceph-mon[116404]: osdmap e2598: 8 total, 8 up, 8 in 2024-01-13T19:08:29.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:28 smithi084 ceph-mon[119097]: osdmap e2597: 8 total, 8 up, 8 in 2024-01-13T19:08:29.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:28 smithi084 ceph-mon[119097]: osdmap e2598: 8 total, 8 up, 8 in 2024-01-13T19:08:29.984 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMirroring.test_mirror_image_create_snapshot ... ok 2024-01-13T19:08:30.076 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMirroring.test_mirror_image_status ... SKIP 2024-01-13T19:08:30.172 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMirroring.test_mirror_peer ... ok 2024-01-13T19:08:30.268 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMirroring.test_mirror_peer_bootstrap ... ok 2024-01-13T19:08:30.294 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:29 smithi084 ceph-mon[119097]: pgmap v4373: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 128 KiB/s rd, 11 KiB/s wr, 173 op/s 2024-01-13T19:08:30.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:29 smithi084 ceph-mon[119097]: osdmap e2599: 8 total, 8 up, 8 in 2024-01-13T19:08:30.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:29 smithi084 ceph-mon[116404]: pgmap v4373: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 128 KiB/s rd, 11 KiB/s wr, 173 op/s 2024-01-13T19:08:30.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:29 smithi084 ceph-mon[116404]: osdmap e2599: 8 total, 8 up, 8 in 2024-01-13T19:08:30.359 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMirroring.test_site_name ... ok 2024-01-13T19:08:30.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:29 smithi099 ceph-mon[138788]: pgmap v4373: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 128 KiB/s rd, 11 KiB/s wr, 173 op/s 2024-01-13T19:08:30.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:29 smithi099 ceph-mon[138788]: osdmap e2599: 8 total, 8 up, 8 in 2024-01-13T19:08:30.436 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestMirroring.test_uuid ... ok 2024-01-13T19:08:30.507 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestTrash.test_get ... ok 2024-01-13T19:08:30.634 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestTrash.test_list ... ok 2024-01-13T19:08:30.676 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:30 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:08:30] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:08:30.708 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestTrash.test_move ... ok 2024-01-13T19:08:30.837 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestTrash.test_purge ... ok 2024-01-13T19:08:30.906 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestTrash.test_remove ... ok 2024-01-13T19:08:30.978 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestTrash.test_remove_denied ... ok 2024-01-13T19:08:31.048 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestTrash.test_remove_with_progress ... ok 2024-01-13T19:08:31.160 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.TestTrash.test_restore ... ok 2024-01-13T19:08:31.160 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_features_from_string ... ok 2024-01-13T19:08:31.160 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_features_to_string ... ok 2024-01-13T19:08:31.255 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_open_by_id ... ok 2024-01-13T19:08:31.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' 2024-01-13T19:08:31.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]: dispatch 2024-01-13T19:08:31.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]: dispatch 2024-01-13T19:08:31.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]: dispatch 2024-01-13T19:08:31.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]': finished 2024-01-13T19:08:31.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer_client_id"}]: dispatch 2024-01-13T19:08:31.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T19:08:31.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T19:08:31.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' 2024-01-13T19:08:31.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]': finished 2024-01-13T19:08:31.368 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:31 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]: dispatch 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]: dispatch 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]: dispatch 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]': finished 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer_client_id"}]: dispatch 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]': finished 2024-01-13T19:08:31.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]: dispatch 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]: dispatch 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]: dispatch 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/peer/114/224c2eb0-8632-48a9-a8e3-cb3528fe2f6b"}]': finished 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/peer_client_id"}]: dispatch 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{ "prefix": "auth get-or-create", "entity": "client.rbd-mirror-peer", "caps": [ "mon", "profile rbd-mirror-peer", "osd", "profile rbd"], "format": "json"}]: dispatch 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "config-key rm", "key": "rbd/mirror/site_name"}]': finished 2024-01-13T19:08:31.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:31 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1222647498' entity='client.admin' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/site_name"}]: dispatch 2024-01-13T19:08:32.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:32 smithi099 ceph-mon[138788]: pgmap v4375: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 5.4 KiB/s rd, 500 B/s wr, 10 op/s 2024-01-13T19:08:32.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:32 smithi084 ceph-mon[116404]: pgmap v4375: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 5.4 KiB/s rd, 500 B/s wr, 10 op/s 2024-01-13T19:08:32.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:32 smithi084 ceph-mon[119097]: pgmap v4375: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 5.4 KiB/s rd, 500 B/s wr, 10 op/s 2024-01-13T19:08:33.402 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_pool_stats ... FAIL 2024-01-13T19:08:33.403 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_version ... ok 2024-01-13T19:08:33.471 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_create ... ok 2024-01-13T19:08:33.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:33 smithi099 ceph-mon[138788]: osdmap e2600: 8 total, 8 up, 8 in 2024-01-13T19:08:33.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:33 smithi084 ceph-mon[116404]: osdmap e2600: 8 total, 8 up, 8 in 2024-01-13T19:08:33.676 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:33 smithi084 ceph-mon[119097]: osdmap e2600: 8 total, 8 up, 8 in 2024-01-13T19:08:34.135 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_create_defaults ... ok 2024-01-13T19:08:34.244 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_context_manager ... ok 2024-01-13T19:08:34.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:34 smithi099 ceph-mon[138788]: pgmap v4377: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 348 KiB/s rd, 21 KiB/s wr, 479 op/s 2024-01-13T19:08:34.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:34 smithi099 ceph-mon[138788]: osdmap e2601: 8 total, 8 up, 8 in 2024-01-13T19:08:34.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:34 smithi099 ceph-mon[138788]: osdmap e2602: 8 total, 8 up, 8 in 2024-01-13T19:08:34.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:34 smithi084 ceph-mon[116404]: pgmap v4377: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 348 KiB/s rd, 21 KiB/s wr, 479 op/s 2024-01-13T19:08:34.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:34 smithi084 ceph-mon[116404]: osdmap e2601: 8 total, 8 up, 8 in 2024-01-13T19:08:34.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:34 smithi084 ceph-mon[116404]: osdmap e2602: 8 total, 8 up, 8 in 2024-01-13T19:08:34.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:34 smithi084 ceph-mon[119097]: pgmap v4377: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 348 KiB/s rd, 21 KiB/s wr, 479 op/s 2024-01-13T19:08:34.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:34 smithi084 ceph-mon[119097]: osdmap e2601: 8 total, 8 up, 8 in 2024-01-13T19:08:34.677 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:34 smithi084 ceph-mon[119097]: osdmap e2602: 8 total, 8 up, 8 in 2024-01-13T19:08:36.009 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_open_read_only ... ok 2024-01-13T19:08:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:35 smithi084 ceph-mon[116404]: osdmap e2603: 8 total, 8 up, 8 in 2024-01-13T19:08:36.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:35 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:08:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:35 smithi084 ceph-mon[119097]: osdmap e2603: 8 total, 8 up, 8 in 2024-01-13T19:08:36.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:35 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:08:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:35 smithi099 ceph-mon[138788]: osdmap e2603: 8 total, 8 up, 8 in 2024-01-13T19:08:36.367 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:35 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-01-13T19:08:36.532 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_open_dne ... ok 2024-01-13T19:08:37.053 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_open_readonly_dne ... ok 2024-01-13T19:08:37.149 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_aio_open ... ok 2024-01-13T19:08:37.162 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_remove_dne ... ok 2024-01-13T19:08:37.163 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_list_empty ... FAIL 2024-01-13T19:08:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:36 smithi084 ceph-mon[116404]: pgmap v4381: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 578 KiB/s rd, 51 KiB/s wr, 831 op/s 2024-01-13T19:08:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:36 smithi084 ceph-mon[116404]: osdmap e2604: 8 total, 8 up, 8 in 2024-01-13T19:08:37.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:36 smithi084 ceph-mon[119097]: pgmap v4381: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 578 KiB/s rd, 51 KiB/s wr, 831 op/s 2024-01-13T19:08:37.176 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:36 smithi084 ceph-mon[119097]: osdmap e2604: 8 total, 8 up, 8 in 2024-01-13T19:08:37.235 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_list ... FAIL 2024-01-13T19:08:37.310 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_remove_with_progress ... ok 2024-01-13T19:08:37.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:36 smithi099 ceph-mon[138788]: pgmap v4381: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 578 KiB/s rd, 51 KiB/s wr, 831 op/s 2024-01-13T19:08:37.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:36 smithi099 ceph-mon[138788]: osdmap e2604: 8 total, 8 up, 8 in 2024-01-13T19:08:37.379 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_remove_canceled ... ok 2024-01-13T19:08:37.622 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_pool_metadata ... ok 2024-01-13T19:08:37.639 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_config_list ... ok 2024-01-13T19:08:37.649 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_pool_config_set_and_get_and_remove ... ok 2024-01-13T19:08:37.675 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_namespaces ... ok 2024-01-13T19:08:37.682 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_create_group ... ok 2024-01-13T19:08:37.690 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_rename_group ... ok 2024-01-13T19:08:37.690 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_list_groups_empty ... ok 2024-01-13T19:08:37.697 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_list_groups ... ok 2024-01-13T19:08:37.703 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_list_groups_after_removed ... ok 2024-01-13T19:08:37.926 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:37 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:37] ENGINE Bus STOPPING 2024-01-13T19:08:37.926 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:37 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:37] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T19:08:37.926 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:37 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:37] ENGINE Bus STOPPED 2024-01-13T19:08:37.926 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:37 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:37] ENGINE Bus STARTING 2024-01-13T19:08:37.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:37 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:37] ENGINE Serving on http://:::9283 2024-01-13T19:08:37.927 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:37 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:37] ENGINE Bus STARTED 2024-01-13T19:08:38.650 INFO:tasks.workunit.client.0.smithi084.stderr:test_rbd.test_rename ... ok 2024-01-13T19:08:38.650 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T19:08:38.650 INFO:tasks.workunit.client.0.smithi084.stderr:====================================================================== 2024-01-13T19:08:38.650 INFO:tasks.workunit.client.0.smithi084.stderr:ERROR: test_rbd.TestImage.test_diff_iterate 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr:---------------------------------------------------------------------- 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr:Traceback (most recent call last): 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr: File "/usr/lib/python3.6/site-packages/nose/case.py", line 384, in tearDown 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr: try_run(self.inst, ('teardown', 'tearDown')) 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr: File "/usr/lib/python3.6/site-packages/nose/util.py", line 471, in try_run 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr: return func() 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 572, in tearDown 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr: remove_image() 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 118, in remove_image 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr: RBD().remove(ioctx, image_name) 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr: File "rbd.pyx", line 767, in rbd.RBD.remove 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr:rbd.ImageHasSnapshots: [errno 39] RBD image has snapshots (error removing image) 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr:====================================================================== 2024-01-13T19:08:38.651 INFO:tasks.workunit.client.0.smithi084.stderr:FAIL: test_rbd.TestImage.test_diff_iterate 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr:---------------------------------------------------------------------- 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr:Traceback (most recent call last): 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr: File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr: self.test(*self.arg) 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 1213, in test_diff_iterate 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr: check_diff(self.image, 0, IMG_SIZE, 'snap1', [(0, 512, False)]) 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 1437, in check_diff 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr: eq(extents, expected) 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr:AssertionError: [] != [(0, 512, False)] 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr:====================================================================== 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr:FAIL: test_rbd.test_pool_stats 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr:---------------------------------------------------------------------- 2024-01-13T19:08:38.652 INFO:tasks.workunit.client.0.smithi084.stderr:Traceback (most recent call last): 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr: File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr: self.test(*self.arg) 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 139, in _require_new_format 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr: return fn(*args, **kwargs) 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 508, in test_pool_stats 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr: eq(stats['image_count'], 4) 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr:AssertionError: 5 != 4 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr:====================================================================== 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr:FAIL: test_rbd.test_list_empty 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr:---------------------------------------------------------------------- 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr:Traceback (most recent call last): 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr: File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest 2024-01-13T19:08:38.653 INFO:tasks.workunit.client.0.smithi084.stderr: self.test(*self.arg) 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 377, in test_list_empty 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr: eq([], RBD().list(ioctx)) 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr:AssertionError: [] != ['image124'] 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr:====================================================================== 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr:FAIL: test_rbd.test_list 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr:---------------------------------------------------------------------- 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr:Traceback (most recent call last): 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr: File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr: self.test(*self.arg) 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 381, in test_list 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr: eq([image_name], RBD().list(ioctx)) 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr:AssertionError: ['image441'] != ['image124', 'image441'] 2024-01-13T19:08:38.654 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T19:08:38.655 INFO:tasks.workunit.client.0.smithi084.stderr:---------------------------------------------------------------------- 2024-01-13T19:08:38.655 INFO:tasks.workunit.client.0.smithi084.stderr:Ran 171 tests in 619.646s 2024-01-13T19:08:38.655 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-01-13T19:08:38.655 INFO:tasks.workunit.client.0.smithi084.stderr:FAILED (SKIP=8, errors=1, failures=4) 2024-01-13T19:08:38.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T19:08:38.678 INFO:tasks.workunit:Stopping ['rbd/test_librbd_python.sh'] on client.0... 2024-01-13T19:08:38.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-13T19:08:38.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[116404]: pgmap v4383: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 386 KiB/s rd, 39 KiB/s wr, 574 op/s 2024-01-13T19:08:38.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' 2024-01-13T19:08:38.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:08:38.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:38.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:38.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:38.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:38.885 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[119097]: pgmap v4383: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 386 KiB/s rd, 39 KiB/s wr, 574 op/s 2024-01-13T19:08:38.885 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' 2024-01-13T19:08:38.885 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:08:38.885 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:38.885 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:38.885 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:38.885 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:38 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:38.886 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/full_sequential.py", line 30, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d2f11f33b7063c2c1bc47b2b4e9350f48064868f/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d2f11f33b7063c2c1bc47b2b4e9350f48064868f/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/test_librbd_python.sh) on smithi084 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' 2024-01-13T19:08:39.142 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bdb0b09fffbf40e889b6efeb1e7e00aa Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/full_sequential.py", line 30, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d2f11f33b7063c2c1bc47b2b4e9350f48064868f/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d2f11f33b7063c2c1bc47b2b4e9350f48064868f/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/test_librbd_python.sh) on smithi084 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' 2024-01-13T19:08:39.145 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-01-13T19:08:39.155 INFO:tasks.cephadm:Teardown begin 2024-01-13T19:08:39.156 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-13T19:08:39.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-13T19:08:39.170 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:38 smithi099 ceph-mon[138788]: pgmap v4383: 137 pgs: 137 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 386 KiB/s rd, 39 KiB/s wr, 574 op/s 2024-01-13T19:08:39.170 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:38 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' 2024-01-13T19:08:39.171 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-13T19:08:39.171 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:39.171 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:39.171 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:39.171 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:38 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:39.570 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T19:08:39.571 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":54262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/2771886754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2771886754},{"type":"v1","addr":"172.21.15.99:6833","nonce":2771886754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-13T17:58:37.204248+0000","modified":"2024-01-13T18:07:23.147167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":459,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34353":{"gid":34353,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6835/1789617897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1789617897},{"type":"v1","addr":"172.21.15.84:6835","nonce":1789617897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-13T19:08:39.573 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2024-01-13T19:08:39.585 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-13T19:08:39.901 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:39 smithi084 ceph-mon[116404]: osdmap e2605: 8 total, 8 up, 8 in 2024-01-13T19:08:39.901 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:39 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2675709466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T19:08:39.902 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:39 smithi084 ceph-mon[119097]: osdmap e2605: 8 total, 8 up, 8 in 2024-01-13T19:08:39.902 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:39 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2675709466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T19:08:39.981 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T19:08:39.982 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":54262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/2771886754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2771886754},{"type":"v1","addr":"172.21.15.99:6833","nonce":2771886754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-13T17:58:37.204248+0000","modified":"2024-01-13T18:07:23.147167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":459,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34353":{"gid":34353,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6835/1789617897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1789617897},{"type":"v1","addr":"172.21.15.84:6835","nonce":1789617897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-13T19:08:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2024-01-13T19:08:39.997 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-13T19:08:40.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:39 smithi099 ceph-mon[138788]: osdmap e2605: 8 total, 8 up, 8 in 2024-01-13T19:08:40.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:39 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2675709466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T19:08:40.331 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-13T19:08:40.331 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":2605,"fsid":"be08b996-b23c-11ee-95ac-87774f69a715","created":"2024-01-13T17:54:40.414446+0000","modified":"2024-01-13T19:08:38.630294+0000","last_up_change":"2024-01-13T18:07:03.657711+0000","last_in_change":"2024-01-13T17:58:08.708903+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":37,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":115,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-13T17:56:59.053508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-13T17:58:35.312354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-13T17:58:36.379223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-01-13T17:59:04.296556+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"1139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":1139,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b5ccde8-894c-4122-9298-abbb2e68bb8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":239,"up_from":248,"up_thru":2058,"down_at":240,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3732569474},{"type":"v1","addr":"172.21.15.84:6803","nonce":3732569474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3732569474},{"type":"v1","addr":"172.21.15.84:6805","nonce":3732569474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3732569474},{"type":"v1","addr":"172.21.15.84:6809","nonce":3732569474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3732569474},{"type":"v1","addr":"172.21.15.84:6807","nonce":3732569474}]},"public_addr":"172.21.15.84:6803/3732569474","cluster_addr":"172.21.15.84:6805/3732569474","heartbeat_back_addr":"172.21.15.84:6809/3732569474","heartbeat_front_addr":"172.21.15.84:6807/3732569474","state":["exists","up"]},{"osd":1,"uuid":"c0cff3e1-672f-4a63-953e-7cd5a9688060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":266,"up_from":275,"up_thru":2058,"down_at":267,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":217168835},{"type":"v1","addr":"172.21.15.84:6811","nonce":217168835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":217168835},{"type":"v1","addr":"172.21.15.84:6813","nonce":217168835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":217168835},{"type":"v1","addr":"172.21.15.84:6817","nonce":217168835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":217168835},{"type":"v1","addr":"172.21.15.84:6815","nonce":217168835}]},"public_addr":"172.21.15.84:6811/217168835","cluster_addr":"172.21.15.84:6813/217168835","heartbeat_back_addr":"172.21.15.84:6817/217168835","heartbeat_front_addr":"172.21.15.84:6815/217168835","state":["exists","up"]},{"osd":2,"uuid":"13d2364a-7e45-4e3e-98fa-f38889f58d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":294,"up_from":303,"up_thru":2058,"down_at":295,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":454646549},{"type":"v1","addr":"172.21.15.84:6819","nonce":454646549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":454646549},{"type":"v1","addr":"172.21.15.84:6821","nonce":454646549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":454646549},{"type":"v1","addr":"172.21.15.84:6825","nonce":454646549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":454646549},{"type":"v1","addr":"172.21.15.84:6823","nonce":454646549}]},"public_addr":"172.21.15.84:6819/454646549","cluster_addr":"172.21.15.84:6821/454646549","heartbeat_back_addr":"172.21.15.84:6825/454646549","heartbeat_front_addr":"172.21.15.84:6823/454646549","state":["exists","up"]},{"osd":3,"uuid":"f74a3f9c-7b25-4a1e-8282-8f9f7f28c070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":321,"up_from":330,"up_thru":2012,"down_at":322,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1415184987},{"type":"v1","addr":"172.21.15.84:6827","nonce":1415184987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1415184987},{"type":"v1","addr":"172.21.15.84:6829","nonce":1415184987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":1415184987},{"type":"v1","addr":"172.21.15.84:6833","nonce":1415184987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1415184987},{"type":"v1","addr":"172.21.15.84:6831","nonce":1415184987}]},"public_addr":"172.21.15.84:6827/1415184987","cluster_addr":"172.21.15.84:6829/1415184987","heartbeat_back_addr":"172.21.15.84:6833/1415184987","heartbeat_front_addr":"172.21.15.84:6831/1415184987","state":["exists","up"]},{"osd":4,"uuid":"0f581be2-0bfe-4fc4-9b70-60cb787fc03b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":30,"last_clean_end":349,"up_from":358,"up_thru":2058,"down_at":350,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3301222659},{"type":"v1","addr":"172.21.15.99:6801","nonce":3301222659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3301222659},{"type":"v1","addr":"172.21.15.99:6803","nonce":3301222659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3301222659},{"type":"v1","addr":"172.21.15.99:6807","nonce":3301222659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3301222659},{"type":"v1","addr":"172.21.15.99:6805","nonce":3301222659}]},"public_addr":"172.21.15.99:6801/3301222659","cluster_addr":"172.21.15.99:6803/3301222659","heartbeat_back_addr":"172.21.15.99:6807/3301222659","heartbeat_front_addr":"172.21.15.99:6805/3301222659","state":["exists","up"]},{"osd":5,"uuid":"4cf8f8f6-eaf3-47f2-a796-98778558ad85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":377,"up_from":387,"up_thru":2058,"down_at":378,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2423841634},{"type":"v1","addr":"172.21.15.99:6809","nonce":2423841634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2423841634},{"type":"v1","addr":"172.21.15.99:6811","nonce":2423841634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2423841634},{"type":"v1","addr":"172.21.15.99:6815","nonce":2423841634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2423841634},{"type":"v1","addr":"172.21.15.99:6813","nonce":2423841634}]},"public_addr":"172.21.15.99:6809/2423841634","cluster_addr":"172.21.15.99:6811/2423841634","heartbeat_back_addr":"172.21.15.99:6815/2423841634","heartbeat_front_addr":"172.21.15.99:6813/2423841634","state":["exists","up"]},{"osd":6,"uuid":"ae64dc86-5e7d-4812-a9fd-f831ff5806dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":44,"last_clean_end":406,"up_from":415,"up_thru":2058,"down_at":407,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":972288266},{"type":"v1","addr":"172.21.15.99:6817","nonce":972288266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":972288266},{"type":"v1","addr":"172.21.15.99:6819","nonce":972288266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":972288266},{"type":"v1","addr":"172.21.15.99:6823","nonce":972288266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":972288266},{"type":"v1","addr":"172.21.15.99:6821","nonce":972288266}]},"public_addr":"172.21.15.99:6817/972288266","cluster_addr":"172.21.15.99:6819/972288266","heartbeat_back_addr":"172.21.15.99:6823/972288266","heartbeat_front_addr":"172.21.15.99:6821/972288266","state":["exists","up"]},{"osd":7,"uuid":"f700b134-999a-4bca-9f2a-ae52c489c637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":52,"last_clean_end":433,"up_from":442,"up_thru":2058,"down_at":434,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2512047858},{"type":"v1","addr":"172.21.15.99:6825","nonce":2512047858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2512047858},{"type":"v1","addr":"172.21.15.99:6827","nonce":2512047858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2512047858},{"type":"v1","addr":"172.21.15.99:6831","nonce":2512047858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2512047858},{"type":"v1","addr":"172.21.15.99:6829","nonce":2512047858}]},"public_addr":"172.21.15.99:6825/2512047858","cluster_addr":"172.21.15.99:6827/2512047858","heartbeat_back_addr":"172.21.15.99:6831/2512047858","heartbeat_front_addr":"172.21.15.99:6829/2512047858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:24.678950+0000","dead_epoch":239},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:41.002298+0000","dead_epoch":266},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:56:57.271156+0000","dead_epoch":294},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:13.662339+0000","dead_epoch":321},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:29.929851+0000","dead_epoch":349},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:57:47.195878+0000","dead_epoch":377},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:04.470712+0000","dead_epoch":406},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-13T17:58:21.655541+0000","dead_epoch":433}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":7,"to":4}]},{"pgid":"3.10","mappings":[{"from":0,"to":1}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":0,"to":2},{"from":4,"to":1}]},{"pgid":"3.27","mappings":[{"from":4,"to":1}]},{"pgid":"3.31","mappings":[{"from":4,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/850292556":"2024-01-13T19:59:28.981295+0000","172.21.15.84:0/1148350414":"2024-01-13T19:50:07.637932+0000","172.21.15.84:0/3017219834":"2024-01-14T18:02:49.940058+0000","172.21.15.99:0/2746817904":"2024-01-14T18:02:17.631776+0000","172.21.15.99:6833/2558131725":"2024-01-14T18:07:20.125757+0000","172.21.15.99:0/2326576577":"2024-01-14T18:02:17.631776+0000","172.21.15.84:0/2821226797":"2024-01-14T18:01:40.454289+0000","172.21.15.84:0/3490306757":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/2521317593":"2024-01-14T18:02:49.940058+0000","172.21.15.84:0/3637866512":"2024-01-14T18:01:40.454289+0000","172.21.15.84:6801/224903442":"2024-01-14T17:55:24.743295+0000","172.21.15.84:6801/1542179962":"2024-01-14T18:01:40.454289+0000","172.21.15.84:6801/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6800/1542179962":"2024-01-14T18:01:40.454289+0000","172.21.15.84:0/2306273623":"2024-01-14T18:02:49.940058+0000","172.21.15.84:0/3916505137":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/3483932512":"2024-01-14T17:55:03.482577+0000","172.21.15.84:6801/2893470920":"2024-01-14T18:02:49.940058+0000","172.21.15.84:6800/3638674707":"2024-01-14T17:55:03.482577+0000","172.21.15.99:0/3072500759":"2024-01-14T18:02:17.631776+0000","172.21.15.84:0/4022096780":"2024-01-14T17:55:03.482577+0000","172.21.15.84:0/420167088":"2024-01-14T17:55:24.743295+0000","172.21.15.99:6834/3030115055":"2024-01-14T18:02:17.631776+0000","172.21.15.84:0/3454312159":"2024-01-13T19:45:46.335110+0000","172.21.15.84:0/545795461":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/172129685":"2024-01-14T18:01:40.454289+0000","172.21.15.84:0/3336419366":"2024-01-14T17:55:24.743295+0000","172.21.15.84:0/1455901095":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/1247513276":"2024-01-14T18:01:40.454289+0000","172.21.15.99:0/1169866212":"2024-01-14T18:02:17.631776+0000","172.21.15.84:0/3513905448":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/1020358368":"2024-01-14T18:01:40.454289+0000","172.21.15.84:0/2788148928":"2024-01-13T19:50:08.593095+0000","172.21.15.84:6800/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/3218728167":"2024-01-14T18:02:49.940058+0000","172.21.15.99:0/74069489":"2024-01-14T18:02:17.631776+0000","172.21.15.99:0/3989741424":"2024-01-14T18:02:17.631776+0000","172.21.15.84:6801/2300703212":"2024-01-14T17:59:05.164416+0000","172.21.15.84:0/1946108910":"2024-01-14T17:59:05.164416+0000","172.21.15.99:6835/3030115055":"2024-01-14T18:02:17.631776+0000","172.21.15.84:0/1327997714":"2024-01-14T18:02:49.940058+0000","172.21.15.99:6832/2558131725":"2024-01-14T18:07:20.125757+0000","172.21.15.84:0/3763304315":"2024-01-14T18:02:49.940058+0000","172.21.15.84:6800/2893470920":"2024-01-14T18:02:49.940058+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"teuthologyprofile":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":690,"length":1}]},{"pool":60,"snaps":[{"begin":2,"length":1}]},{"pool":63,"snaps":[{"begin":1,"length":2}]},{"pool":68,"snaps":[{"begin":1,"length":2}]},{"pool":98,"snaps":[{"begin":15,"length":2}]},{"pool":99,"snaps":[{"begin":15,"length":5}]},{"pool":100,"snaps":[{"begin":2,"length":1}]},{"pool":101,"snaps":[{"begin":24,"length":1},{"begin":31,"length":1}]},{"pool":102,"snaps":[{"begin":61,"length":3},{"begin":70,"length":4}]},{"pool":104,"snaps":[{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":14,"length":1}]},{"pool":107,"snaps":[{"begin":2,"length":1}]},{"pool":108,"snaps":[{"begin":2,"length":1}]},{"pool":109,"snaps":[{"begin":2,"length":1}]},{"pool":110,"snaps":[{"begin":2,"length":1}]},{"pool":111,"snaps":[{"begin":2,"length":1}]},{"pool":112,"snaps":[{"begin":2,"length":1}]},{"pool":113,"snaps":[{"begin":2,"length":1}]},{"pool":114,"snaps":[{"begin":572,"length":1},{"begin":575,"length":1},{"begin":578,"length":1},{"begin":580,"length":1}]},{"pool":115,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-13T19:08:40.345 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-13T19:08:40.636 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: ::ffff:172.21.15.99 - - [13/Jan/2024:19:08:40] "GET /metrics HTTP/1.1" 200 36533 "" "Prometheus/2.43.0" 2024-01-13T19:08:40.732 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-13T19:08:40.744 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-13T19:08:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:40 smithi099 ceph-mon[138788]: pgmap v4385: 105 pgs: 105 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail 2024-01-13T19:08:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:40 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3791616157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T19:08:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:40 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/2910348388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T19:08:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:08:40.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:08:40.868 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:40 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.927 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-a[150105]: ignoring --setuser ceph since I am not root 2024-01-13T19:08:40.928 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-a[150105]: ignoring --setgroup ceph since I am not root 2024-01-13T19:08:40.928 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-a[150105]: starting mds.a at 2024-01-13T19:08:40.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[116404]: pgmap v4385: 105 pgs: 105 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail 2024-01-13T19:08:40.928 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3791616157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T19:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/2910348388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T19:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-a[116381]: 2024-01-13T19:08:40.721+0000 7fa6b45a7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-13T19:08:40.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[119097]: pgmap v4385: 105 pgs: 105 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail 2024-01-13T19:08:40.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3791616157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-13T19:08:40.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/2910348388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-13T19:08:40.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.930 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-13T19:08:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-13T19:08:40.931 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:40 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' 2024-01-13T19:08:41.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-13T19:08:41.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3401062124' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-01-13T19:08:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[116404]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-13T19:08:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[116404]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-13T19:08:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[116404]: osdmap e2606: 8 total, 8 up, 8 in 2024-01-13T19:08:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/3401062124' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-01-13T19:08:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[116404]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-01-13T19:08:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/207556611' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T19:08:41.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T19:08:41.927 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3401062124' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-01-13T19:08:41.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[119097]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-13T19:08:41.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[119097]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-13T19:08:41.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[119097]: osdmap e2606: 8 total, 8 up, 8 in 2024-01-13T19:08:41.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/3401062124' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-01-13T19:08:41.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[119097]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-01-13T19:08:41.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/207556611' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T19:08:41.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:41 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T19:08:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:41 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3401062124' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-01-13T19:08:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:41 smithi099 ceph-mon[138788]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-13T19:08:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:41 smithi099 ceph-mon[138788]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-13T19:08:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:41 smithi099 ceph-mon[138788]: osdmap e2606: 8 total, 8 up, 8 in 2024-01-13T19:08:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:41 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/3401062124' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-01-13T19:08:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:41 smithi099 ceph-mon[138788]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-01-13T19:08:42.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:41 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/207556611' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T19:08:42.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:41 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-13T19:08:42.745 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2024-01-13T19:08:42.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-13T19:08:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[116404]: pgmap v4387: 105 pgs: 105 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail 2024-01-13T19:08:42.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[116404]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-13T19:08:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[116404]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-13T19:08:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[116404]: Cluster is now healthy 2024-01-13T19:08:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[116404]: mds.? [v2:172.21.15.84:6834/2293566283,v1:172.21.15.84:6835/2293566283] up:boot 2024-01-13T19:08:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-01-13T19:08:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[116404]: fsmap 2 up:standby 2024-01-13T19:08:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[116404]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T19:08:42.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/989107025' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T19:08:42.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[119097]: pgmap v4387: 105 pgs: 105 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail 2024-01-13T19:08:42.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[119097]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-13T19:08:42.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[119097]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-13T19:08:42.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[119097]: Cluster is now healthy 2024-01-13T19:08:42.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[119097]: mds.? [v2:172.21.15.84:6834/2293566283,v1:172.21.15.84:6835/2293566283] up:boot 2024-01-13T19:08:42.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-01-13T19:08:42.928 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[119097]: fsmap 2 up:standby 2024-01-13T19:08:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[119097]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T19:08:42.929 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:42 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/989107025' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T19:08:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:42 smithi099 ceph-mon[138788]: pgmap v4387: 105 pgs: 105 active+clean; 4.6 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail 2024-01-13T19:08:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:42 smithi099 ceph-mon[138788]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-13T19:08:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:42 smithi099 ceph-mon[138788]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-13T19:08:43.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:42 smithi099 ceph-mon[138788]: Cluster is now healthy 2024-01-13T19:08:43.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:42 smithi099 ceph-mon[138788]: mds.? [v2:172.21.15.84:6834/2293566283,v1:172.21.15.84:6835/2293566283] up:boot 2024-01-13T19:08:43.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:42 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-01-13T19:08:43.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:42 smithi099 ceph-mon[138788]: fsmap 2 up:standby 2024-01-13T19:08:43.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:42 smithi099 ceph-mon[138788]: from='mgr.25121 172.21.15.84:0/2232180671' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-13T19:08:43.118 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:42 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/989107025' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T19:08:43.765 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2024-01-13T19:08:43.781 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-13T19:08:43.808 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-13T19:08:43.843 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-01-13T19:08:43.843 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-13T19:08:43.867 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-13T19:08:43.902 INFO:tasks.cephadm:Stopping all daemons... 2024-01-13T19:08:43.902 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-01-13T19:08:43.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.a 2024-01-13T19:08:44.116 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/989107025' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-01-13T19:08:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:43 smithi099 ceph-mon[138788]: osdmap e2607: 8 total, 8 up, 8 in 2024-01-13T19:08:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:43 smithi099 ceph-mon[138788]: from='client.? 172.21.15.84:0/1010805483' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T19:08:44.117 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:43 smithi099 ceph-mon[138788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T19:08:44.131 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/989107025' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-01-13T19:08:44.131 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:43 smithi084 ceph-mon[116404]: osdmap e2607: 8 total, 8 up, 8 in 2024-01-13T19:08:44.131 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:43 smithi084 ceph-mon[116404]: from='client.? 172.21.15.84:0/1010805483' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T19:08:44.131 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:43 smithi084 ceph-mon[116404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T19:08:44.132 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:43 smithi084 systemd[1]: Stopping Ceph mon.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:08:44.132 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/989107025' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-01-13T19:08:44.132 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:43 smithi084 ceph-mon[119097]: osdmap e2607: 8 total, 8 up, 8 in 2024-01-13T19:08:44.132 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:43 smithi084 ceph-mon[119097]: from='client.? 172.21.15.84:0/1010805483' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T19:08:44.132 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:43 smithi084 ceph-mon[119097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-13T19:08:44.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-a[116381]: 2024-01-13T19:08:44.130+0000 7fa6b9db2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:08:44.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-a[116381]: 2024-01-13T19:08:44.130+0000 7fa6b9db2700 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-01-13T19:08:44.427 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:44] ENGINE Bus STOPPING 2024-01-13T19:08:44.427 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:44] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-01-13T19:08:44.427 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:44] ENGINE Bus STOPPED 2024-01-13T19:08:44.427 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:44] ENGINE Bus STARTING 2024-01-13T19:08:44.427 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:44] ENGINE Serving on http://:::9283 2024-01-13T19:08:44.428 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:44 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: [13/Jan/2024:19:08:44] ENGINE Bus STARTED 2024-01-13T19:08:44.833 INFO:journalctl@ceph.mon.a.smithi084.stdout:Jan 13 19:08:44 smithi084 bash[193726]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-a 2024-01-13T19:08:44.840 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.a.service' 2024-01-13T19:08:44.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:08:44.889 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-01-13T19:08:44.889 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-01-13T19:08:44.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.c 2024-01-13T19:08:45.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:44 smithi084 systemd[1]: Stopping Ceph mon.c for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:08:45.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:45 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[119074]: 2024-01-13T19:08:45.093+0000 7fd9bd830700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:08:45.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:45 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c[119074]: 2024-01-13T19:08:45.093+0000 7fd9bd830700 -1 mon.c@2(peon) e4 *** Got Signal Terminated *** 2024-01-13T19:08:45.426 INFO:journalctl@ceph.mon.c.smithi084.stdout:Jan 13 19:08:45 smithi084 bash[193990]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-c 2024-01-13T19:08:45.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.c.service' 2024-01-13T19:08:45.571 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:08:45.572 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-01-13T19:08:45.572 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-01-13T19:08:45.572 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.b 2024-01-13T19:08:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:45 smithi099 systemd[1]: Stopping Ceph mon.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:08:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[138765]: 2024-01-13T19:08:45.791+0000 7ff3270da700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:08:45.867 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b[138765]: 2024-01-13T19:08:45.791+0000 7ff3270da700 -1 mon.b@1(peon) e4 *** Got Signal Terminated *** 2024-01-13T19:08:46.366 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 13 19:08:46 smithi099 bash[212289]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mon-b 2024-01-13T19:08:46.383 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mon.b.service' 2024-01-13T19:08:46.433 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:08:46.433 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-01-13T19:08:46.434 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-01-13T19:08:46.434 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.y 2024-01-13T19:08:46.798 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:46 smithi084 systemd[1]: Stopping Ceph mgr.y for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:08:46.798 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T19:08:46.655+0000 7fcb2a2a1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:08:46.799 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:46 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y[106025]: 2024-01-13T19:08:46.655+0000 7fcb2a2a1700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-01-13T19:08:47.106 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jan 13 19:08:46 smithi084 bash[194135]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-y 2024-01-13T19:08:47.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.y.service' 2024-01-13T19:08:47.148 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:08:47.149 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-01-13T19:08:47.149 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-01-13T19:08:47.149 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.x 2024-01-13T19:08:47.517 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 19:08:47 smithi099 systemd[1]: Stopping Ceph mgr.x for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:08:47.866 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 19:08:47 smithi099 bash[212437]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mgr-x 2024-01-13T19:08:47.867 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 13 19:08:47 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-01-13T19:08:47.878 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mgr.x.service' 2024-01-13T19:08:47.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:08:47.913 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-01-13T19:08:47.914 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-01-13T19:08:47.914 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.0 2024-01-13T19:08:48.426 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 19:08:47 smithi084 systemd[1]: Stopping Ceph osd.0 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:08:48.426 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 19:08:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[125947]: 2024-01-13T19:08:48.138+0000 7f97bbc68700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:08:48.427 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 19:08:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[125947]: 2024-01-13T19:08:48.138+0000 7f97bbc68700 -1 osd.0 2608 *** Got signal Terminated *** 2024-01-13T19:08:48.427 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 19:08:48 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0[125947]: 2024-01-13T19:08:48.138+0000 7f97bbc68700 -1 osd.0 2608 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T19:08:54.177 INFO:journalctl@ceph.osd.0.smithi084.stdout:Jan 13 19:08:53 smithi084 bash[194282]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-0 2024-01-13T19:08:55.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.0.service' 2024-01-13T19:08:55.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:08:55.078 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-01-13T19:08:55.079 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-01-13T19:08:55.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.1 2024-01-13T19:08:55.317 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 19:08:55 smithi084 systemd[1]: Stopping Ceph osd.1 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:08:55.676 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 19:08:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[131867]: 2024-01-13T19:08:55.316+0000 7efe43a13700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:08:55.676 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 19:08:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[131867]: 2024-01-13T19:08:55.316+0000 7efe43a13700 -1 osd.1 2608 *** Got signal Terminated *** 2024-01-13T19:08:55.676 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 19:08:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1[131867]: 2024-01-13T19:08:55.316+0000 7efe43a13700 -1 osd.1 2608 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T19:09:01.408 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jan 13 19:09:00 smithi084 bash[194548]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-1 2024-01-13T19:09:02.119 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.1.service' 2024-01-13T19:09:02.158 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:09:02.158 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-01-13T19:09:02.159 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-01-13T19:09:02.159 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.2 2024-01-13T19:09:02.426 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 19:09:02 smithi084 systemd[1]: Stopping Ceph osd.2 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:02.926 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 19:09:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[138277]: 2024-01-13T19:09:02.426+0000 7fb53de01700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:09:02.927 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 19:09:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[138277]: 2024-01-13T19:09:02.426+0000 7fb53de01700 -1 osd.2 2608 *** Got signal Terminated *** 2024-01-13T19:09:02.927 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 19:09:02 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2[138277]: 2024-01-13T19:09:02.426+0000 7fb53de01700 -1 osd.2 2608 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T19:09:08.422 INFO:journalctl@ceph.osd.2.smithi084.stdout:Jan 13 19:09:07 smithi084 bash[194815]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-2 2024-01-13T19:09:09.126 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.2.service' 2024-01-13T19:09:09.166 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:09:09.166 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-01-13T19:09:09.166 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-01-13T19:09:09.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.3 2024-01-13T19:09:09.414 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 19:09:09 smithi084 systemd[1]: Stopping Ceph osd.3 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:09.676 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 19:09:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[144063]: 2024-01-13T19:09:09.413+0000 7f9fd0ef7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:09:09.676 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 19:09:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[144063]: 2024-01-13T19:09:09.413+0000 7f9fd0ef7700 -1 osd.3 2608 *** Got signal Terminated *** 2024-01-13T19:09:09.677 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 19:09:09 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3[144063]: 2024-01-13T19:09:09.413+0000 7f9fd0ef7700 -1 osd.3 2608 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T19:09:15.026 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:14 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:14.722+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:15.366 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:15 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:15.026+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:15.676 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jan 13 19:09:15 smithi084 bash[195079]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-3 2024-01-13T19:09:16.027 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:15 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:15.750+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:16.366 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:16 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:16.027+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:16.367 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:16 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:16.237+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:16.682 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.3.service' 2024-01-13T19:09:16.721 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:09:16.721 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-01-13T19:09:16.722 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-01-13T19:09:16.722 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.4 2024-01-13T19:09:17.116 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:17 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:16.999+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:17.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:16 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:16.792+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:17.117 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 19:09:16 smithi099 systemd[1]: Stopping Ceph osd.4 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:17.118 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 19:09:16 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T19:09:16.821+0000 7f56fa47e700 -1 osd.4 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.574396+0000 front 2024-01-13T19:08:52.574383+0000 (oldest deadline 2024-01-13T19:09:16.674294+0000) 2024-01-13T19:09:17.118 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 19:09:16 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T19:09:16.950+0000 7f56fde88700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:09:17.118 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 19:09:16 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T19:09:16.950+0000 7f56fde88700 -1 osd.4 2608 *** Got signal Terminated *** 2024-01-13T19:09:17.118 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 19:09:16 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T19:09:16.950+0000 7f56fde88700 -1 osd.4 2608 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T19:09:17.616 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:17 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:17.286+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:18.116 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 19:09:17 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T19:09:17.866+0000 7f56fa47e700 -1 osd.4 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.574396+0000 front 2024-01-13T19:08:52.574383+0000 (oldest deadline 2024-01-13T19:09:16.674294+0000) 2024-01-13T19:09:18.117 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:17 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:17.987+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:18.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:17 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:17.809+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:18.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:18.322+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:19.116 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 19:09:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T19:09:18.867+0000 7f56fa47e700 -1 osd.4 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.574396+0000 front 2024-01-13T19:08:52.574383+0000 (oldest deadline 2024-01-13T19:09:16.674294+0000) 2024-01-13T19:09:19.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:18.789+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:19.117 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:18 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:18.968+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:19.616 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:19 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:19.350+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:20.116 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 19:09:19 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T19:09:19.819+0000 7f56fa47e700 -1 osd.4 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.574396+0000 front 2024-01-13T19:08:52.574383+0000 (oldest deadline 2024-01-13T19:09:16.674294+0000) 2024-01-13T19:09:20.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:19 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:19.750+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:20.117 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:19 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:19.959+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:20.616 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:20 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:20.307+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:21.116 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 19:09:20 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T19:09:20.779+0000 7f56fa47e700 -1 osd.4 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.574396+0000 front 2024-01-13T19:08:52.574383+0000 (oldest deadline 2024-01-13T19:09:16.674294+0000) 2024-01-13T19:09:21.117 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:20 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:20.955+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:21.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:20 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:20.707+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:21.616 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:21 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:21.345+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:22.116 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 19:09:21 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4[145511]: 2024-01-13T19:09:21.786+0000 7f56fa47e700 -1 osd.4 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.574396+0000 front 2024-01-13T19:08:52.574383+0000 (oldest deadline 2024-01-13T19:09:16.674294+0000) 2024-01-13T19:09:22.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:21 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:21.754+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:22.117 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:21 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:21.953+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:22.584 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 13 19:09:22 smithi099 bash[212599]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-4 2024-01-13T19:09:22.585 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:22 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:22.333+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:23.042 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:22 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:22.759+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:23.043 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:22 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:22.974+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:23.043 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:22 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:22.974+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:09:00.008441+0000 front 2024-01-13T19:09:00.008425+0000 (oldest deadline 2024-01-13T19:09:22.308328+0000) 2024-01-13T19:09:23.733 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:23 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:23.380+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:23.842 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.4.service' 2024-01-13T19:09:23.884 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:09:23.884 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-01-13T19:09:23.884 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-01-13T19:09:23.884 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.5 2024-01-13T19:09:23.999 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:23 smithi099 systemd[1]: Stopping Ceph osd.5 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:24.000 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:23 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:23.732+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:24.366 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:23.998+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:24.367 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:23.998+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:09:00.008441+0000 front 2024-01-13T19:09:00.008425+0000 (oldest deadline 2024-01-13T19:09:22.308328+0000) 2024-01-13T19:09:24.367 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:24.128+0000 7f6d25273700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:09:24.367 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:24.128+0000 7f6d25273700 -1 osd.5 2608 *** Got signal Terminated *** 2024-01-13T19:09:24.367 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:24.128+0000 7f6d25273700 -1 osd.5 2608 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T19:09:24.732 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:24.418+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:25.013 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:24 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:24.732+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:25.366 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:25 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:25.014+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:25.367 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:25 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:25.014+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:09:00.008441+0000 front 2024-01-13T19:09:00.008425+0000 (oldest deadline 2024-01-13T19:09:22.308328+0000) 2024-01-13T19:09:25.715 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:25 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:25.431+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:26.057 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:25 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:25.715+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:26.057 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:25 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:25.715+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:59.597431+0000 front 2024-01-13T19:08:59.597441+0000 (oldest deadline 2024-01-13T19:09:25.497305+0000) 2024-01-13T19:09:26.366 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:26 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:26.058+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:26.367 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:26 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:26.058+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:09:00.008441+0000 front 2024-01-13T19:09:00.008425+0000 (oldest deadline 2024-01-13T19:09:22.308328+0000) 2024-01-13T19:09:26.751 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:26 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:26.399+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:26.751 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:26 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:26.399+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:27.032 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:26 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:26.751+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:27.033 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:26 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:26.751+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:59.597431+0000 front 2024-01-13T19:08:59.597441+0000 (oldest deadline 2024-01-13T19:09:25.497305+0000) 2024-01-13T19:09:27.349 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:27 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:27.033+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:27.349 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:27 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:27.033+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:09:00.008441+0000 front 2024-01-13T19:09:00.008425+0000 (oldest deadline 2024-01-13T19:09:22.308328+0000) 2024-01-13T19:09:27.616 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:27 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:27.350+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:27.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:27 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:27.350+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:28.050 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:27 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:27.776+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:28.050 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:27 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:27.776+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:59.597431+0000 front 2024-01-13T19:08:59.597441+0000 (oldest deadline 2024-01-13T19:09:25.497305+0000) 2024-01-13T19:09:28.318 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:28.050+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:28.319 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:28.050+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:09:00.008441+0000 front 2024-01-13T19:09:00.008425+0000 (oldest deadline 2024-01-13T19:09:22.308328+0000) 2024-01-13T19:09:28.616 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:28.319+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:28.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:28.319+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:29.079 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:28.792+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:29.079 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:28 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:28.792+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:59.597431+0000 front 2024-01-13T19:08:59.597441+0000 (oldest deadline 2024-01-13T19:09:25.497305+0000) 2024-01-13T19:09:29.367 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:29.080+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:48.807404+0000 front 2024-01-13T19:08:48.807501+0000 (oldest deadline 2024-01-13T19:09:14.107423+0000) 2024-01-13T19:09:29.367 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5[151294]: 2024-01-13T19:09:29.080+0000 7f6d1f865700 -1 osd.5 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:09:00.008441+0000 front 2024-01-13T19:09:00.008425+0000 (oldest deadline 2024-01-13T19:09:22.308328+0000) 2024-01-13T19:09:29.367 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:29.325+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:29.367 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:29.325+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:30.117 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 13 19:09:29 smithi099 bash[212861]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-5 2024-01-13T19:09:30.118 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:29.751+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:30.118 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:29 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:29.751+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:59.597431+0000 front 2024-01-13T19:08:59.597441+0000 (oldest deadline 2024-01-13T19:09:25.497305+0000) 2024-01-13T19:09:30.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:30 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:30.347+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:30.618 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:30 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:30.347+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:30.618 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:30 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:30.347+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:31.090 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:30 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:30.764+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:31.090 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:30 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:30.764+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:59.597431+0000 front 2024-01-13T19:08:59.597441+0000 (oldest deadline 2024-01-13T19:09:25.497305+0000) 2024-01-13T19:09:31.097 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.5.service' 2024-01-13T19:09:31.139 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:09:31.139 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-01-13T19:09:31.139 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-01-13T19:09:31.139 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.6 2024-01-13T19:09:31.360 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:31 smithi099 systemd[1]: Stopping Ceph osd.6 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:31.616 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:31 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:31.394+0000 7f609c23d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:09:31.617 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:31 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:31.394+0000 7f609c23d700 -1 osd.6 2608 *** Got signal Terminated *** 2024-01-13T19:09:31.617 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:31 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:31.394+0000 7f609c23d700 -1 osd.6 2608 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T19:09:31.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:31 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:31.361+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:31.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:31 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:31.361+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:31.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:31 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:31.361+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:32.116 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:31 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:31.813+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:32.116 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:31 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:31.813+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:59.597431+0000 front 2024-01-13T19:08:59.597441+0000 (oldest deadline 2024-01-13T19:09:25.497305+0000) 2024-01-13T19:09:32.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:31 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:31.813+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:05.497886+0000 front 2024-01-13T19:09:05.497836+0000 (oldest deadline 2024-01-13T19:09:30.797675+0000) 2024-01-13T19:09:32.824 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:32 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:32.392+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:32.825 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:32 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:32.392+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:32.825 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:32 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:32.392+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:33.116 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:32 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:32.825+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:33.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:32 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:32.825+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:59.597431+0000 front 2024-01-13T19:08:59.597441+0000 (oldest deadline 2024-01-13T19:09:25.497305+0000) 2024-01-13T19:09:33.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:32 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:32.825+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:05.497886+0000 front 2024-01-13T19:09:05.497836+0000 (oldest deadline 2024-01-13T19:09:30.797675+0000) 2024-01-13T19:09:33.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:33.363+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:33.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:33.363+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:33.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:33.363+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:34.116 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:33.789+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:34.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:33.789+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:59.597431+0000 front 2024-01-13T19:08:59.597441+0000 (oldest deadline 2024-01-13T19:09:25.497305+0000) 2024-01-13T19:09:34.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:33 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:33.789+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:05.497886+0000 front 2024-01-13T19:09:05.497836+0000 (oldest deadline 2024-01-13T19:09:30.797675+0000) 2024-01-13T19:09:34.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:34.341+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:34.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:34.341+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:34.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:34.341+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:35.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:34.754+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:35.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:34.754+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:59.597431+0000 front 2024-01-13T19:08:59.597441+0000 (oldest deadline 2024-01-13T19:09:25.497305+0000) 2024-01-13T19:09:35.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:34 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:34.755+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:05.497886+0000 front 2024-01-13T19:09:05.497836+0000 (oldest deadline 2024-01-13T19:09:30.797675+0000) 2024-01-13T19:09:35.616 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:35.351+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:35.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:35.351+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:35.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:35.351+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:36.116 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:35.732+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:49.096164+0000 front 2024-01-13T19:08:49.096112+0000 (oldest deadline 2024-01-13T19:09:13.795983+0000) 2024-01-13T19:09:36.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:35.732+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:59.597431+0000 front 2024-01-13T19:08:59.597441+0000 (oldest deadline 2024-01-13T19:09:25.497305+0000) 2024-01-13T19:09:36.117 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:35 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6[157144]: 2024-01-13T19:09:35.732+0000 7f609502c700 -1 osd.6 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:05.497886+0000 front 2024-01-13T19:09:05.497836+0000 (oldest deadline 2024-01-13T19:09:30.797675+0000) 2024-01-13T19:09:36.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:36.333+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:36.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:36.333+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:36.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:36.333+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:36.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:36 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:36.333+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-01-13T19:09:14.124011+0000 front 2024-01-13T19:09:14.124073+0000 (oldest deadline 2024-01-13T19:09:35.823875+0000) 2024-01-13T19:09:37.352 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 13 19:09:37 smithi099 bash[213124]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-6 2024-01-13T19:09:37.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:37.352+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:37.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:37.352+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:37.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:37.352+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:37.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:37 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:37.352+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-01-13T19:09:14.124011+0000 front 2024-01-13T19:09:14.124073+0000 (oldest deadline 2024-01-13T19:09:35.823875+0000) 2024-01-13T19:09:38.254 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.6.service' 2024-01-13T19:09:38.293 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:09:38.293 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-01-13T19:09:38.294 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-01-13T19:09:38.294 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.7 2024-01-13T19:09:38.546 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:38.334+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:38.546 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:38.334+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:38.546 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:38.334+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:38.546 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:38.334+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-01-13T19:09:14.124011+0000 front 2024-01-13T19:09:14.124073+0000 (oldest deadline 2024-01-13T19:09:35.823875+0000) 2024-01-13T19:09:38.546 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:38 smithi099 systemd[1]: Stopping Ceph osd.7 for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:38.866 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:38.546+0000 7facc0db8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:09:38.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:38.546+0000 7facc0db8700 -1 osd.7 2608 *** Got signal Terminated *** 2024-01-13T19:09:38.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:38 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:38.546+0000 7facc0db8700 -1 osd.7 2608 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-13T19:09:39.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:39.374+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:39.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:39.374+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:39.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:39.374+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:39.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:39 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:39.374+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-01-13T19:09:14.124011+0000 front 2024-01-13T19:09:14.124073+0000 (oldest deadline 2024-01-13T19:09:35.823875+0000) 2024-01-13T19:09:40.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:40 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:40.405+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:40.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:40 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:40.405+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:40.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:40 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:40.405+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:40.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:40 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:40.405+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-01-13T19:09:14.124011+0000 front 2024-01-13T19:09:14.124073+0000 (oldest deadline 2024-01-13T19:09:35.823875+0000) 2024-01-13T19:09:41.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:41.447+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:41.868 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:41.447+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:41.868 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:41.447+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:41.868 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:41 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:41.447+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-01-13T19:09:14.124011+0000 front 2024-01-13T19:09:14.124073+0000 (oldest deadline 2024-01-13T19:09:35.823875+0000) 2024-01-13T19:09:42.866 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:42 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:42.424+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:42.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:42 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:42.424+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:42.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:42 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:42.424+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:42.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:42 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:42.424+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-01-13T19:09:14.124011+0000 front 2024-01-13T19:09:14.124073+0000 (oldest deadline 2024-01-13T19:09:35.823875+0000) 2024-01-13T19:09:43.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:43.453+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-01-13T19:08:52.120388+0000 front 2024-01-13T19:08:52.120321+0000 (oldest deadline 2024-01-13T19:09:16.220262+0000) 2024-01-13T19:09:43.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:43.453+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-01-13T19:08:58.422124+0000 front 2024-01-13T19:08:58.422057+0000 (oldest deadline 2024-01-13T19:09:26.022341+0000) 2024-01-13T19:09:43.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:43.453+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-01-13T19:09:07.123249+0000 front 2024-01-13T19:09:07.123135+0000 (oldest deadline 2024-01-13T19:09:29.423135+0000) 2024-01-13T19:09:43.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:43.453+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-01-13T19:09:14.124011+0000 front 2024-01-13T19:09:14.124073+0000 (oldest deadline 2024-01-13T19:09:35.823875+0000) 2024-01-13T19:09:43.867 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:43 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7[163691]: 2024-01-13T19:09:43.453+0000 7facb93a6700 -1 osd.7 2608 heartbeat_check: no reply from 172.21.15.99:6804 osd.4 since back 2024-01-13T19:09:18.724612+0000 front 2024-01-13T19:09:18.724682+0000 (oldest deadline 2024-01-13T19:09:42.824549+0000) 2024-01-13T19:09:44.617 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 13 19:09:44 smithi099 bash[213387]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-osd-7 2024-01-13T19:09:45.453 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@osd.7.service' 2024-01-13T19:09:45.492 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:09:45.493 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-01-13T19:09:45.493 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-01-13T19:09:45.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@mds.a 2024-01-13T19:09:45.817 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 19:09:45 smithi084 systemd[1]: Stopping Ceph mds.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:45.866 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:45.603Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.84:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.84:8765: connect: connection refused" 2024-01-13T19:09:45.867 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:45.603Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.84:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.84:8765: connect: connection refused" 2024-01-13T19:09:45.867 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:45.605Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.84:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.84:8765: connect: connection refused" 2024-01-13T19:09:45.867 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:45 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:45.605Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.84:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.84:8765: connect: connection refused" 2024-01-13T19:09:46.176 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 19:09:45 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-a[150105]: 2024-01-13T19:09:45.816+0000 7f3f5e549700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:09:46.176 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 19:09:45 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-a[150105]: 2024-01-13T19:09:45.816+0000 7f3f5e549700 -1 mds.a *** got signal Terminated *** 2024-01-13T19:09:49.229 INFO:journalctl@ceph.mds.a.smithi084.stdout:Jan 13 19:09:49 smithi084 bash[195342]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-a 2024-01-13T19:09:49.234 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mds.a.service' 2024-01-13T19:09:49.269 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:09:49.269 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-01-13T19:09:49.269 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-01-13T19:09:49.269 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@mds.b 2024-01-13T19:09:49.617 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 19:09:49 smithi099 systemd[1]: Stopping Ceph mds.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:49.617 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 19:09:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-b[169815]: 2024-01-13T19:09:49.502+0000 7fac4655e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-13T19:09:49.617 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 19:09:49 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-b[169815]: 2024-01-13T19:09:49.502+0000 7fac4655e700 -1 mds.b *** got signal Terminated *** 2024-01-13T19:09:53.773 INFO:journalctl@ceph.mds.b.smithi099.stdout:Jan 13 19:09:53 smithi099 bash[213646]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-mds-b 2024-01-13T19:09:53.779 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@mds.b.service' 2024-01-13T19:09:53.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:09:53.815 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-01-13T19:09:53.815 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-01-13T19:09:53.815 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-be08b996-b23c-11ee-95ac-87774f69a715@prometheus.a 2024-01-13T19:09:54.055 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:53 smithi099 systemd[1]: Stopping Ceph prometheus.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:54.366 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.056Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-01-13T19:09:54.367 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.056Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-01-13T19:09:54.367 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.056Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-01-13T19:09:54.367 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.056Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-01-13T19:09:54.367 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.056Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-01-13T19:09:54.367 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.056Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-01-13T19:09:54.368 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.056Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-01-13T19:09:54.368 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.056Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-01-13T19:09:54.368 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.056Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-01-13T19:09:54.368 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.058Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-01-13T19:09:54.368 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.058Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-01-13T19:09:54.368 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a[180145]: ts=2024-01-13T19:09:54.058Z caller=main.go:1147 level=info msg="See you next time!" 2024-01-13T19:09:54.368 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 13 19:09:54 smithi099 bash[213790]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-prometheus-a 2024-01-13T19:09:54.422 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-be08b996-b23c-11ee-95ac-87774f69a715@prometheus.a.service' 2024-01-13T19:09:54.456 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-13T19:09:54.457 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-01-13T19:09:54.457 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid be08b996-b23c-11ee-95ac-87774f69a715 --force --keep-logs 2024-01-13T19:09:55.676 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 19:09:55 smithi084 systemd[1]: Stopping Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:56.176 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 19:09:55 smithi084 ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a[160493]: ts=2024-01-13T19:09:55.782Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-01-13T19:09:56.176 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 19:09:55 smithi084 bash[195794]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-alertmanager-a 2024-01-13T19:09:56.657 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 19:09:56 smithi084 systemd[1]: Stopping Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:56.658 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 19:09:56 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@alertmanager.a.service: Succeeded. 2024-01-13T19:09:56.658 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Jan 13 19:09:56 smithi084 systemd[1]: Stopped Ceph alertmanager.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T19:09:56.926 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 19:09:56 smithi084 bash[195923]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-a 2024-01-13T19:09:56.927 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 19:09:56 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-01-13T19:09:57.294 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 19:09:56 smithi084 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-01-13T19:09:57.294 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Jan 13 19:09:56 smithi084 systemd[1]: Stopped Ceph node-exporter.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T19:09:57.296 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid be08b996-b23c-11ee-95ac-87774f69a715 --force --keep-logs 2024-01-13T19:09:58.617 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 19:09:58 smithi099 systemd[1]: Stopping Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:59.015 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 19:09:58 smithi099 bash[214242]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-grafana-a 2024-01-13T19:09:59.015 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 19:09:58 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-01-13T19:09:59.366 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 19:09:59 smithi099 systemd[1]: Stopping Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715... 2024-01-13T19:09:59.367 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 19:09:59 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-01-13T19:09:59.367 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 13 19:09:59 smithi099 systemd[1]: Stopped Ceph grafana.a for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T19:09:59.738 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 19:09:59 smithi099 bash[214370]: ceph-be08b996-b23c-11ee-95ac-87774f69a715-node-exporter-b 2024-01-13T19:09:59.738 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 19:09:59 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-01-13T19:09:59.993 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 19:09:59 smithi099 systemd[1]: ceph-be08b996-b23c-11ee-95ac-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-01-13T19:09:59.993 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 13 19:09:59 smithi099 systemd[1]: Stopped Ceph node-exporter.b for be08b996-b23c-11ee-95ac-87774f69a715. 2024-01-13T19:10:00.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-13T19:10:00.138 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-13T19:10:00.167 INFO:tasks.cephadm:Archiving crash dumps... 2024-01-13T19:10:00.170 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129/remote/smithi084/crash 2024-01-13T19:10:00.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/crash -- . 2024-01-13T19:10:00.317 INFO:teuthology.orchestra.run.smithi084.stderr:tar: /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/crash: Cannot open: No such file or directory 2024-01-13T19:10:00.318 INFO:teuthology.orchestra.run.smithi084.stderr:tar: Error is not recoverable: exiting now 2024-01-13T19:10:00.320 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129/remote/smithi099/crash 2024-01-13T19:10:00.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/crash -- . 2024-01-13T19:10:00.392 INFO:teuthology.orchestra.run.smithi099.stderr:tar: /var/lib/ceph/be08b996-b23c-11ee-95ac-87774f69a715/crash: Cannot open: No such file or directory 2024-01-13T19:10:00.392 INFO:teuthology.orchestra.run.smithi099.stderr:tar: Error is not recoverable: exiting now 2024-01-13T19:10:00.393 INFO:tasks.cephadm:Checking cluster log for badness... 2024-01-13T19:10:00.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/be08b996-b23c-11ee-95ac-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-01-13T19:10:00.424 INFO:teuthology.orchestra.run.smithi084.stderr:grep: /var/log/ceph/be08b996-b23c-11ee-95ac-87774f69a715/ceph.log: No such file or directory 2024-01-13T19:10:00.425 INFO:tasks.cephadm:Compressing logs... 2024-01-13T19:10:00.426 DEBUG:teuthology.orchestra.run.smithi084:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-13T19:10:00.468 DEBUG:teuthology.orchestra.run.smithi099:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-13T19:10:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-01-13T19:10:00.495 INFO:teuthology.orchestra.run.smithi099.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-01-13T19:11:51.802 INFO:tasks.cephadm:Archiving logs... 2024-01-13T19:11:51.803 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129/remote/smithi084/log 2024-01-13T19:11:51.804 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-13T19:12:03.751 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129/remote/smithi099/log 2024-01-13T19:12:03.752 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-13T19:12:12.927 INFO:tasks.cephadm:Removing cluster... 2024-01-13T19:12:12.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid be08b996-b23c-11ee-95ac-87774f69a715 --force 2024-01-13T19:12:13.477 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid be08b996-b23c-11ee-95ac-87774f69a715 --force 2024-01-13T19:12:14.009 INFO:tasks.cephadm:Removing cephadm ... 2024-01-13T19:12:14.009 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-13T19:12:14.028 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-13T19:12:14.046 INFO:tasks.cephadm:Teardown complete 2024-01-13T19:12:14.046 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-13T19:12:14.057 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-13T19:12:14.057 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-13T19:12:14.070 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-13T19:12:14.162 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-13T19:12:14.171 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-13T19:12:14.172 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-13T19:12:14.174 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-13T19:12:14.189 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2024-01-13T19:12:14.191 INFO:teuthology.orchestra.run.smithi099.stderr:bash: ntpq: command not found 2024-01-13T19:12:14.193 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-13T19:12:14.193 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-01-13T19:12:14.193 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 5 +976us[ +976us] +/- 97ms 2024-01-13T19:12:14.194 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv02.front.sepia.ceph.com 3 6 377 64 +641us[ +646us] +/- 65ms 2024-01-13T19:12:14.194 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -1546us[-1546us] +/- 74ms 2024-01-13T19:12:14.194 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-01-13T19:12:14.195 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-13T19:12:14.195 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-01-13T19:12:14.195 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 6 +974us[+1035us] +/- 97ms 2024-01-13T19:12:14.196 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv02.front.sepia.ceph.com 3 7 377 3 +650us[ +711us] +/- 66ms 2024-01-13T19:12:14.196 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -1533us[-1473us] +/- 74ms 2024-01-13T19:12:14.196 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-01-13T19:12:14.197 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-13T19:12:14.207 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-13T19:12:14.208 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-13T19:12:14.264 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-13T19:12:14.341 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-13T19:12:14.412 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-13T19:12:14.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T19:12:14.443 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-13T19:12:14.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T19:12:14.473 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-13T19:12:14.483 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-13T19:12:14.510 INFO:teuthology.task.internal:Duration was 6943.867906 seconds 2024-01-13T19:12:14.511 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-13T19:12:14.542 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-13T19:12:14.543 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-13T19:12:14.545 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-13T19:12:14.588 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-13T19:12:14.590 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-13T19:12:14.936 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-13T19:12:14.936 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-01-13T19:12:14.936 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-13T19:12:14.959 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-01-13T19:12:14.959 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-13T19:12:14.983 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-13T19:12:14.983 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-13T19:12:15.002 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-13T19:12:15.092 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-13T19:12:15.092 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-13T19:12:15.095 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-13T19:12:15.302 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-13T19:12:15.314 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-13T19:12:15.315 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-13T19:12:15.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-13T19:12:15.369 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-13T19:12:15.381 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-13T19:12:15.384 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-13T19:12:15.408 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-01-13T19:12:15.435 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-01-13T19:12:15.449 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-13T19:12:15.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T19:12:15.478 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-13T19:12:15.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T19:12:15.506 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-13T19:12:15.517 INFO:teuthology.task.internal:Transferring archived files... 2024-01-13T19:12:15.519 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129/remote/smithi084 2024-01-13T19:12:15.519 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-13T19:12:15.570 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129/remote/smithi099 2024-01-13T19:12:15.570 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-13T19:12:15.614 INFO:teuthology.task.internal:Removing archive directory... 2024-01-13T19:12:15.614 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-13T19:12:15.617 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-13T19:12:15.664 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-13T19:12:15.678 INFO:teuthology.task.internal:Not uploading archives. 2024-01-13T19:12:15.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-13T19:12:15.748 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-13T19:12:15.749 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-13T19:12:15.751 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-13T19:12:15.766 INFO:teuthology.orchestra.run.smithi084.stdout: 525359 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jan 13 19:12 /home/ubuntu/cephtest 2024-01-13T19:12:15.766 INFO:teuthology.orchestra.run.smithi084.stdout: 1317430 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Jan 13 18:58 /home/ubuntu/cephtest/mnt.0 2024-01-13T19:12:15.767 INFO:teuthology.orchestra.run.smithi084.stdout: 1317431 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Jan 13 18:58 /home/ubuntu/cephtest/mnt.0/client.0 2024-01-13T19:12:15.767 INFO:teuthology.orchestra.run.smithi084.stdout: 1317509 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 13 18:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-13T19:12:15.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T19:12:15.768 INFO:teuthology.orchestra.run.smithi084.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-01-13T19:12:15.768 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi084 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-01-13T19:12:15.777 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-13T19:12:15.789 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-13T19:12:15.818 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi084 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-01-13T19:12:15.818 INFO:teuthology.nuke:Checking targets against current locks 2024-01-13T19:12:15.827 INFO:teuthology.orchestra.run.smithi099.stdout: 525366 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 13 19:12 /home/ubuntu/cephtest 2024-01-13T19:12:15.846 DEBUG:teuthology.nuke:shortname: smithi084 2024-01-13T19:12:15.846 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T19:12:15.867 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 16:53:56.551432', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0aGLuGhiJx1YWLbwSQfgUcG5/YmiyC0C6dboBQb2XF37ohvkIJVAxab7eP/U2IKwr55KzOxGCWLj7/e15lFSw='} 2024-01-13T19:12:15.871 DEBUG:teuthology.nuke:shortname: smithi099 2024-01-13T19:12:15.871 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T19:12:15.892 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 16:53:56.549445', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPxZ9Wkx+QiFZtrjFJ5OTlcUQyS7BRFw31Bv/Ys+Cz0Bw4/VcI4EerC/bZjqnZWVuX+CaHNamPwDVp02xztQ5A='} 2024-01-13T19:12:15.921 INFO:teuthology.orchestra.console.smithi084:Power off 2024-01-13T19:12:15.922 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T19:12:15.946 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-01-13T19:12:15.947 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T19:12:15.963 INFO:teuthology.orchestra.console.smithi099:Power off 2024-01-13T19:12:15.963 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T19:12:15.973 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-13T19:12:15.986 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-01-13T19:12:15.986 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T19:12:16.008 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-01-13T19:12:19.974 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T19:12:20.010 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T19:12:20.086 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-13T19:12:20.120 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-01-13T19:12:24.088 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T19:12:24.120 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T19:12:24.199 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-01-13T19:12:24.230 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-01-13T19:12:24.301 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-01-13T19:12:24.331 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-01-13T19:12:24.438 INFO:teuthology.run:Summary data: description: rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} duration: 6943.867906332016 failure_reason: 'Command failed (workunit test rbd/test_librbd_python.sh) on smithi084 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=bdb0b09fffbf40e889b6efeb1e7e00aa status: fail success: false 2024-01-13T19:12:24.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:12:24.520 INFO:teuthology.run:FAIL